2023-03-02T10:23:26.997 INFO:root:teuthology version: 0.0.1.dev49+gc7c3cc8 2023-03-02T10:23:26.998 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi/7191644 --owner scheduled_vshankar@teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} --verbose -- /home/teuthworker/archive/vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi/7191644/orig.config.yaml 2023-03-02T10:23:27.056 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-03-02T10:23:27.148 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi/7191644 branch: wip-vshankar-testing-20230222.044949 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} email: vshankar@redhat.com first_in_suite: false job_id: '7191644' kernel: client: branch: testing flavor: default kdb: true sha1: 6c92a82cc8b8e718121a418823844125df590db9 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20230222.044949 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 802de851643c97960b33dacc1e3ce8486e6d7d3c subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 802de851643c97960b33dacc1e3ce8486e6d7d3c kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=crc - wsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230222.044949 sha1: 802de851643c97960b33dacc1e3ce8486e6d7d3c owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 sha1: 802de851643c97960b33dacc1e3ce8486e6d7d3c sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230222.044949 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_802de851643c97960b33dacc1e3ce8486e6d7d3c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 802de851643c97960b33dacc1e3ce8486e6d7d3c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 500 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6 timestamp: 2023-03-02_09:21:58 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.31660 2023-03-02T10:23:27.149 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_802de851643c97960b33dacc1e3ce8486e6d7d3c/qa; will attempt to use it 2023-03-02T10:23:27.150 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_802de851643c97960b33dacc1e3ce8486e6d7d3c/qa/tasks 2023-03-02T10:23:27.150 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-03-02T10:23:27.152 INFO:teuthology.task.internal:Checking packages... 2023-03-02T10:23:27.181 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '802de851643c97960b33dacc1e3ce8486e6d7d3c' 2023-03-02T10:23:27.181 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-03-02T10:23:27.182 INFO:teuthology.packaging:ref: None 2023-03-02T10:23:27.182 INFO:teuthology.packaging:tag: None 2023-03-02T10:23:27.182 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230222.044949 2023-03-02T10:23:27.183 INFO:teuthology.packaging:sha1: 802de851643c97960b33dacc1e3ce8486e6d7d3c 2023-03-02T10:23:27.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230222.044949 2023-03-02T10:23:27.324 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2462.g802de851 2023-03-02T10:23:27.324 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-03-02T10:23:27.332 INFO:teuthology.task.internal:no buildpackages task found 2023-03-02T10:23:27.333 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-03-02T10:23:27.341 INFO:teuthology.task.internal:Saving configuration 2023-03-02T10:23:27.362 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-03-02T10:23:27.370 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-02T10:23:27.400 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi/7191644', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-02 10:18:18.502274', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-02T10:23:27.426 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi/7191644', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-02 10:18:18.501120', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-02T10:23:27.455 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-02_09:21:58-fs-wip-vshankar-testing-20230222.044949-testing-default-smithi/7191644', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-02 10:18:18.499668', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-02T10:23:27.455 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-03-02T10:23:27.462 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-03-02T10:23:27.462 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-03-02T10:23:27.463 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-03-02T10:23:27.463 INFO:teuthology.run_tasks:Running task console_log... 2023-03-02T10:23:27.584 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f28913f5790>, signals=[15]) 2023-03-02T10:23:27.585 INFO:teuthology.run_tasks:Running task internal.connect... 2023-03-02T10:23:27.592 INFO:teuthology.task.internal:Opening connections... 2023-03-02T10:23:27.594 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2023-03-02T10:23:27.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-02T10:23:27.668 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2023-03-02T10:23:27.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-02T10:23:27.735 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2023-03-02T10:23:27.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-02T10:23:27.803 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-03-02T10:23:27.810 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-03-02T10:23:27.830 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-03-02T10:23:27.831 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-03-02T10:23:27.890 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-03-02T10:23:27.891 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-03-02T10:23:27.891 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-03-02T10:23:27.891 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-03-02T10:23:27.891 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-03-02T10:23:27.891 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-03-02T10:23:27.891 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-02T10:23:27.892 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-03-02T10:23:27.892 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-02T10:23:27.892 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-03-02T10:23:27.892 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-02T10:23:27.892 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-02T10:23:27.892 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:23:27.892 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-02T10:23:27.893 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-02T10:23:27.893 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-02T10:23:27.893 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-02T10:23:27.894 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-03-02T10:23:27.917 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2023-03-02T10:23:27.938 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2023-03-02T10:23:27.938 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2023-03-02T10:23:27.999 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Red Hat Enterprise Linux" 2023-03-02T10:23:27.999 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8.6 (Ootpa)" 2023-03-02T10:23:27.999 INFO:teuthology.orchestra.run.smithi122.stdout:ID="rhel" 2023-03-02T10:23:27.999 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="fedora" 2023-03-02T10:23:27.999 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8.6" 2023-03-02T10:23:28.000 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8" 2023-03-02T10:23:28.000 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-02T10:23:28.000 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2023-03-02T10:23:28.000 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-02T10:23:28.000 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.redhat.com/" 2023-03-02T10:23:28.000 INFO:teuthology.orchestra.run.smithi122.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-02T10:23:28.000 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-02T10:23:28.000 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:23:28.001 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-02T10:23:28.001 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-02T10:23:28.001 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-02T10:23:28.001 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-02T10:23:28.001 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2023-03-02T10:23:28.025 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2023-03-02T10:23:28.045 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2023-03-02T10:23:28.045 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-03-02T10:23:28.105 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2023-03-02T10:23:28.106 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)" 2023-03-02T10:23:28.106 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2023-03-02T10:23:28.106 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2023-03-02T10:23:28.106 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6" 2023-03-02T10:23:28.106 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-03-02T10:23:28.106 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-02T10:23:28.107 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-03-02T10:23:28.107 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-02T10:23:28.107 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2023-03-02T10:23:28.107 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-02T10:23:28.107 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-02T10:23:28.107 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:23:28.107 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-02T10:23:28.108 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-02T10:23:28.108 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-02T10:23:28.108 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-02T10:23:28.108 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-03-02T10:23:28.141 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-03-02T10:23:28.154 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-03-02T10:23:28.163 INFO:teuthology.task.internal:Checking for old test directory... 2023-03-02T10:23:28.163 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2023-03-02T10:23:28.166 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2023-03-02T10:23:28.168 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2023-03-02T10:23:28.187 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-03-02T10:23:28.215 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-03-02T10:23:28.216 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2023-03-02T10:23:28.225 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2023-03-02T10:23:28.227 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2023-03-02T10:23:28.255 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-03-02T10:23:28.345 INFO:teuthology.run_tasks:Running task kernel... 2023-03-02T10:23:28.364 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '6c92a82cc8b8e718121a418823844125df590db9'} 2023-03-02T10:23:28.365 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-03-02T10:23:28.365 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-03-02T10:23:28.365 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-02T10:23:28.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-02T10:23:28.386 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-03-02T10:23:28.620 DEBUG:teuthology.task.kernel:sha1 for client.0 is 6c92a82cc8b8e718121a418823844125df590db9 2023-03-02T10:23:28.621 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6c92a82cc8b8e718121a418823844125df590db9"... 2023-03-02T10:23:28.621 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-03-02T10:23:28.641 INFO:teuthology.orchestra.run.smithi057.stdout:4.18.0-372.9.1.el8.x86_64 2023-03-02T10:23:28.641 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs 6c92a82cc8b8e718121a418823844125df590db9 2023-03-02T10:23:28.642 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-03-02T10:23:28.642 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum upgrade -y linux-firmware 2023-03-02T10:23:29.772 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-03-02T10:23:29.772 INFO:teuthology.orchestra.run.smithi057.stdout:Unable to read consumer identity 2023-03-02T10:23:33.584 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-03-02T10:23:34.601 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 14 MB/s | 14 MB 00:00 2023-03-02T10:23:37.859 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 436 kB/s | 24 kB 00:00 2023-03-02T10:23:38.745 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-03-02T10:23:38.747 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-03-02T10:23:38.747 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-03-02T10:23:38.875 INFO:teuthology.task.kernel:Downloading kernel 6c92a82cc8b8e718121a418823844125df590db9 on client.0... 2023-03-02T10:23:38.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6c92a82cc8b8e718121a418823844125df590db9 2023-03-02T10:23:39.025 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/6c92a82cc8b8e718121a418823844125df590db9/centos/8/flavors/default/x86_64/ 2023-03-02T10:23:39.026 DEBUG:teuthology.orchestra.run.smithi057:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.2.0_ceph_g6c92a82cc8b8-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/6c92a82cc8b8e718121a418823844125df590db9/centos/8/flavors/default/x86_64/ --input-file=- 2023-03-02T10:23:39.028 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi057.front.sepia.ceph.com to complete... 2023-03-02T10:26:17.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02 10:26:17 URL:https://3.chacra.ceph.com/r/kernel/testing/6c92a82cc8b8e718121a418823844125df590db9/centos/8/flavors/default/x86_64/kernel-6.2.0_ceph_g6c92a82cc8b8-1.x86_64.rpm [383026524/383026524] -> "/tmp/kernel.x86_64.rpm" [1] 2023-03-02T10:26:17.656 INFO:teuthology.orchestra.run.smithi057.stderr:FINISHED --2023-03-02 10:26:17-- 2023-03-02T10:26:17.656 INFO:teuthology.orchestra.run.smithi057.stderr:Total wall clock time: 2m 39s 2023-03-02T10:26:17.656 INFO:teuthology.orchestra.run.smithi057.stderr:Downloaded: 1 files, 365M in 2m 37s (2.32 MB/s) 2023-03-02T10:26:17.708 INFO:teuthology.task.kernel:Installing kernel 6c92a82cc8b8e718121a418823844125df590db9 on client.0... 2023-03-02T10:26:17.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-03-02T10:26:19.764 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying... ######################################## 2023-03-02T10:26:19.818 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing... ######################################## 2023-03-02T10:26:19.903 INFO:teuthology.orchestra.run.smithi057.stdout:Updating / installing... 2023-03-02T10:27:01.242 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-6.2.0_ceph_g6c92a82cc8b8-1 ######################################## 2023-03-02T10:27:22.206 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-03-02T10:27:22.207 DEBUG:teuthology.orchestra.run.smithi057:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-03-02T10:27:22.258 INFO:teuthology.orchestra.run.smithi057.stdout:/boot/System.map-6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:27:22.285 INFO:teuthology.orchestra.run.smithi057.stdout:/boot/config-6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:27:22.285 INFO:teuthology.orchestra.run.smithi057.stdout:/boot/vmlinuz-6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:27:22.286 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:27:22.286 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel 2023-03-02T10:27:22.286 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch 2023-03-02T10:27:22.286 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86 2023-03-02T10:27:22.286 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto 2023-03-02T10:27:22.286 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-03-02T10:27:22.286 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-03-02T10:27:22.287 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-03-02T10:27:22.287 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-03-02T10:27:22.287 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-03-02T10:27:22.287 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-03-02T10:27:22.287 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-03-02T10:27:22.287 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/crc32c-intel.ko 2023-03-02T10:27:22.287 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-03-02T10:27:22.287 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-03-02T10:27:22.288 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-03-02T10:27:22.288 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-03-02T10:27:22.288 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/serpent-avx2.ko 2023-03-02T10:27:22.288 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-03-02T10:27:22.288 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-03-02T10:27:22.288 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-03-02T10:27:22.288 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-03-02T10:27:22.289 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-03-02T10:27:22.289 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-03-02T10:27:22.289 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-03-02T10:27:22.289 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/kernel 2023-03-02T10:27:22.289 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/kernel/cpu 2023-03-02T10:27:22.289 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/kernel/cpu/mce 2023-03-02T10:27:22.289 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-03-02T10:27:22.290 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/kvm 2023-03-02T10:27:22.290 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/kvm/kvm-amd.ko 2023-03-02T10:27:22.290 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/kvm/kvm-intel.ko 2023-03-02T10:27:22.290 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/arch/x86/kvm/kvm.ko 2023-03-02T10:27:22.290 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto 2023-03-02T10:27:22.290 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/ansi_cprng.ko 2023-03-02T10:27:22.290 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/anubis.ko 2023-03-02T10:27:22.290 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/arc4.ko 2023-03-02T10:27:22.291 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/async_tx 2023-03-02T10:27:22.291 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/async_tx/async_memcpy.ko 2023-03-02T10:27:22.291 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/async_tx/async_pq.ko 2023-03-02T10:27:22.291 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/async_tx/async_raid6_recov.ko 2023-03-02T10:27:22.291 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/async_tx/async_tx.ko 2023-03-02T10:27:22.291 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/async_tx/async_xor.ko 2023-03-02T10:27:22.291 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/async_tx/raid6test.ko 2023-03-02T10:27:22.292 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/authenc.ko 2023-03-02T10:27:22.292 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/authencesn.ko 2023-03-02T10:27:22.292 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/blake2b_generic.ko 2023-03-02T10:27:22.292 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/blowfish_common.ko 2023-03-02T10:27:22.292 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/blowfish_generic.ko 2023-03-02T10:27:22.292 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/camellia_generic.ko 2023-03-02T10:27:22.292 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/cast5_generic.ko 2023-03-02T10:27:22.292 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/cast6_generic.ko 2023-03-02T10:27:22.293 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/cast_common.ko 2023-03-02T10:27:22.293 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/ccm.ko 2023-03-02T10:27:22.293 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/cmac.ko 2023-03-02T10:27:22.293 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/crc32_generic.ko 2023-03-02T10:27:22.293 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/crypto_engine.ko 2023-03-02T10:27:22.293 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/crypto_user.ko 2023-03-02T10:27:22.293 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/cts.ko 2023-03-02T10:27:22.294 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/des_generic.ko 2023-03-02T10:27:22.294 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/dh_generic.ko 2023-03-02T10:27:22.294 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/echainiv.ko 2023-03-02T10:27:22.294 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/essiv.ko 2023-03-02T10:27:22.294 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/fcrypt.ko 2023-03-02T10:27:22.294 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/khazad.ko 2023-03-02T10:27:22.294 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/lz4.ko 2023-03-02T10:27:22.294 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/lz4hc.ko 2023-03-02T10:27:22.295 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/md4.ko 2023-03-02T10:27:22.295 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/michael_mic.ko 2023-03-02T10:27:22.295 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/pcbc.ko 2023-03-02T10:27:22.295 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/pcrypt.ko 2023-03-02T10:27:22.295 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/rmd160.ko 2023-03-02T10:27:22.295 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/seed.ko 2023-03-02T10:27:22.295 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/serpent_generic.ko 2023-03-02T10:27:22.295 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/tcrypt.ko 2023-03-02T10:27:22.296 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/tea.ko 2023-03-02T10:27:22.296 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/twofish_common.ko 2023-03-02T10:27:22.296 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/twofish_generic.ko 2023-03-02T10:27:22.296 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/vmac.ko 2023-03-02T10:27:22.296 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/wp512.ko 2023-03-02T10:27:22.296 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/xcbc.ko 2023-03-02T10:27:22.296 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/xor.ko 2023-03-02T10:27:22.297 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/crypto/xxhash_generic.ko 2023-03-02T10:27:22.297 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers 2023-03-02T10:27:22.297 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/acpi 2023-03-02T10:27:22.297 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/acpi/acpi_ipmi.ko 2023-03-02T10:27:22.297 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/acpi/acpi_pad.ko 2023-03-02T10:27:22.297 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/acpi/custom_method.ko 2023-03-02T10:27:22.297 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/acpi/ec_sys.ko 2023-03-02T10:27:22.297 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/acpi/platform_profile.ko 2023-03-02T10:27:22.298 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/acpi/sbs.ko 2023-03-02T10:27:22.298 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/acpi/sbshc.ko 2023-03-02T10:27:22.298 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/acpi/video.ko 2023-03-02T10:27:22.298 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata 2023-03-02T10:27:22.298 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/acard-ahci.ko 2023-03-02T10:27:22.298 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/ahci_platform.ko 2023-03-02T10:27:22.298 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/ata_generic.ko 2023-03-02T10:27:22.298 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/libahci_platform.ko 2023-03-02T10:27:22.299 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_acpi.ko 2023-03-02T10:27:22.299 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_ali.ko 2023-03-02T10:27:22.299 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_amd.ko 2023-03-02T10:27:22.299 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_artop.ko 2023-03-02T10:27:22.299 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_atiixp.ko 2023-03-02T10:27:22.299 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_atp867x.ko 2023-03-02T10:27:22.299 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_cmd640.ko 2023-03-02T10:27:22.300 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_cmd64x.ko 2023-03-02T10:27:22.300 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_cypress.ko 2023-03-02T10:27:22.300 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_efar.ko 2023-03-02T10:27:22.300 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_hpt366.ko 2023-03-02T10:27:22.300 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_hpt37x.ko 2023-03-02T10:27:22.300 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_hpt3x2n.ko 2023-03-02T10:27:22.300 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_hpt3x3.ko 2023-03-02T10:27:22.301 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_it8213.ko 2023-03-02T10:27:22.301 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_it821x.ko 2023-03-02T10:27:22.301 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_jmicron.ko 2023-03-02T10:27:22.301 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_marvell.ko 2023-03-02T10:27:22.301 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_mpiix.ko 2023-03-02T10:27:22.301 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_netcell.ko 2023-03-02T10:27:22.301 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_ninja32.ko 2023-03-02T10:27:22.302 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_ns87410.ko 2023-03-02T10:27:22.302 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_ns87415.ko 2023-03-02T10:27:22.302 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_oldpiix.ko 2023-03-02T10:27:22.302 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_opti.ko 2023-03-02T10:27:22.302 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_optidma.ko 2023-03-02T10:27:22.302 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_pcmcia.ko 2023-03-02T10:27:22.302 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_pdc2027x.ko 2023-03-02T10:27:22.302 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-03-02T10:27:22.303 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_piccolo.ko 2023-03-02T10:27:22.303 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_rdc.ko 2023-03-02T10:27:22.303 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_sch.ko 2023-03-02T10:27:22.303 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_serverworks.ko 2023-03-02T10:27:22.303 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_sil680.ko 2023-03-02T10:27:22.303 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_sis.ko 2023-03-02T10:27:22.303 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_sl82c105.ko 2023-03-02T10:27:22.303 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_triflex.ko 2023-03-02T10:27:22.304 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pata_via.ko 2023-03-02T10:27:22.304 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/pdc_adma.ko 2023-03-02T10:27:22.304 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_inic162x.ko 2023-03-02T10:27:22.304 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_mv.ko 2023-03-02T10:27:22.304 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_nv.ko 2023-03-02T10:27:22.304 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_promise.ko 2023-03-02T10:27:22.304 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_qstor.ko 2023-03-02T10:27:22.304 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_sil.ko 2023-03-02T10:27:22.305 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_sil24.ko 2023-03-02T10:27:22.305 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_sis.ko 2023-03-02T10:27:22.305 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_svw.ko 2023-03-02T10:27:22.305 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_sx4.ko 2023-03-02T10:27:22.305 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_uli.ko 2023-03-02T10:27:22.305 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_via.ko 2023-03-02T10:27:22.305 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ata/sata_vsc.ko 2023-03-02T10:27:22.306 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/auxdisplay 2023-03-02T10:27:22.306 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/auxdisplay/ks0108.ko 2023-03-02T10:27:22.306 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/base 2023-03-02T10:27:22.306 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/base/regmap 2023-03-02T10:27:22.306 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/base/regmap/regmap-i2c.ko 2023-03-02T10:27:22.306 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/bcma 2023-03-02T10:27:22.306 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/bcma/bcma.ko 2023-03-02T10:27:22.306 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block 2023-03-02T10:27:22.307 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/aoe 2023-03-02T10:27:22.307 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/aoe/aoe.ko 2023-03-02T10:27:22.307 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/brd.ko 2023-03-02T10:27:22.307 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/drbd 2023-03-02T10:27:22.307 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/drbd/drbd.ko 2023-03-02T10:27:22.307 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/floppy.ko 2023-03-02T10:27:22.307 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/loop.ko 2023-03-02T10:27:22.307 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/mtip32xx 2023-03-02T10:27:22.308 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-03-02T10:27:22.308 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/nbd.ko 2023-03-02T10:27:22.308 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/null_blk 2023-03-02T10:27:22.308 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/null_blk/null_blk.ko 2023-03-02T10:27:22.308 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/pktcdvd.ko 2023-03-02T10:27:22.308 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/rbd.ko 2023-03-02T10:27:22.308 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/virtio_blk.ko 2023-03-02T10:27:22.309 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/xen-blkback 2023-03-02T10:27:22.309 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-03-02T10:27:22.309 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/xen-blkfront.ko 2023-03-02T10:27:22.309 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/zram 2023-03-02T10:27:22.309 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/block/zram/zram.ko 2023-03-02T10:27:22.309 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char 2023-03-02T10:27:22.309 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/hangcheck-timer.ko 2023-03-02T10:27:22.309 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/hw_random 2023-03-02T10:27:22.310 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/hw_random/amd-rng.ko 2023-03-02T10:27:22.310 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/hw_random/intel-rng.ko 2023-03-02T10:27:22.310 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-03-02T10:27:22.310 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/hw_random/via-rng.ko 2023-03-02T10:27:22.310 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/hw_random/virtio-rng.ko 2023-03-02T10:27:22.310 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/ipmi 2023-03-02T10:27:22.310 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-03-02T10:27:22.311 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-03-02T10:27:22.311 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-03-02T10:27:22.311 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/ipmi/ipmi_si.ko 2023-03-02T10:27:22.311 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-03-02T10:27:22.311 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-03-02T10:27:22.311 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/lp.ko 2023-03-02T10:27:22.311 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/mwave 2023-03-02T10:27:22.311 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/mwave/mwave.ko 2023-03-02T10:27:22.312 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/pcmcia 2023-03-02T10:27:22.312 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-03-02T10:27:22.312 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-03-02T10:27:22.312 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/ppdev.ko 2023-03-02T10:27:22.312 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/tlclk.ko 2023-03-02T10:27:22.312 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/tpm 2023-03-02T10:27:22.312 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/tpm/tpm.ko 2023-03-02T10:27:22.312 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/tpm/tpm_atmel.ko 2023-03-02T10:27:22.313 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/tpm/tpm_infineon.ko 2023-03-02T10:27:22.313 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/tpm/tpm_nsc.ko 2023-03-02T10:27:22.313 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/tpm/tpm_tis.ko 2023-03-02T10:27:22.313 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-03-02T10:27:22.313 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/uv_mmtimer.ko 2023-03-02T10:27:22.313 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/char/virtio_console.ko 2023-03-02T10:27:22.313 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/cpufreq 2023-03-02T10:27:22.314 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-03-02T10:27:22.314 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-03-02T10:27:22.314 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/cpufreq/p4-clockmod.ko 2023-03-02T10:27:22.314 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-03-02T10:27:22.314 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/cpufreq/powernow-k8.ko 2023-03-02T10:27:22.314 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/cpufreq/speedstep-lib.ko 2023-03-02T10:27:22.314 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto 2023-03-02T10:27:22.314 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/ccp 2023-03-02T10:27:22.315 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-03-02T10:27:22.315 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/ccp/ccp.ko 2023-03-02T10:27:22.315 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/padlock-aes.ko 2023-03-02T10:27:22.315 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/padlock-sha.ko 2023-03-02T10:27:22.315 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/qat 2023-03-02T10:27:22.315 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/qat/qat_common 2023-03-02T10:27:22.315 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-03-02T10:27:22.315 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/qat/qat_dh895xcc 2023-03-02T10:27:22.316 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-03-02T10:27:22.316 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/virtio 2023-03-02T10:27:22.316 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-03-02T10:27:22.316 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/dca 2023-03-02T10:27:22.316 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/dca/dca.ko 2023-03-02T10:27:22.316 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/devfreq 2023-03-02T10:27:22.316 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-03-02T10:27:22.317 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/dma 2023-03-02T10:27:22.317 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/dma/dw 2023-03-02T10:27:22.317 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/dma/dw/dw_dmac.ko 2023-03-02T10:27:22.317 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/dma/ioat 2023-03-02T10:27:22.317 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/dma/ioat/ioatdma.ko 2023-03-02T10:27:22.317 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac 2023-03-02T10:27:22.317 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/amd64_edac.ko 2023-03-02T10:27:22.317 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/e752x_edac.ko 2023-03-02T10:27:22.318 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/edac_mce_amd.ko 2023-03-02T10:27:22.318 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/i3000_edac.ko 2023-03-02T10:27:22.318 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/i3200_edac.ko 2023-03-02T10:27:22.318 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/i5100_edac.ko 2023-03-02T10:27:22.318 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/i5400_edac.ko 2023-03-02T10:27:22.318 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/i7300_edac.ko 2023-03-02T10:27:22.318 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/i7core_edac.ko 2023-03-02T10:27:22.319 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/i82975x_edac.ko 2023-03-02T10:27:22.319 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/ie31200_edac.ko 2023-03-02T10:27:22.319 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/sb_edac.ko 2023-03-02T10:27:22.319 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/edac/x38_edac.ko 2023-03-02T10:27:22.319 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/firmware 2023-03-02T10:27:22.319 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/firmware/edd.ko 2023-03-02T10:27:22.319 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/firmware/iscsi_ibft.ko 2023-03-02T10:27:22.319 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/gpio 2023-03-02T10:27:22.320 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/gpio/gpio-ich.ko 2023-03-02T10:27:22.320 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/gpio/gpio-viperboard.ko 2023-03-02T10:27:22.320 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid 2023-03-02T10:27:22.320 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-appleir.ko 2023-03-02T10:27:22.320 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-aureal.ko 2023-03-02T10:27:22.320 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-axff.ko 2023-03-02T10:27:22.320 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-dr.ko 2023-03-02T10:27:22.320 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-elecom.ko 2023-03-02T10:27:22.321 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-elo.ko 2023-03-02T10:27:22.321 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-emsff.ko 2023-03-02T10:27:22.321 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-gaff.ko 2023-03-02T10:27:22.321 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-gt683r.ko 2023-03-02T10:27:22.321 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-gyration.ko 2023-03-02T10:27:22.321 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-holtek-kbd.ko 2023-03-02T10:27:22.321 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-holtek-mouse.ko 2023-03-02T10:27:22.321 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-holtekff.ko 2023-03-02T10:27:22.322 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-hyperv.ko 2023-03-02T10:27:22.322 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-icade.ko 2023-03-02T10:27:22.322 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-keytouch.ko 2023-03-02T10:27:22.322 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-kye.ko 2023-03-02T10:27:22.322 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-lcpower.ko 2023-03-02T10:27:22.322 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-led.ko 2023-03-02T10:27:22.322 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-lenovo.ko 2023-03-02T10:27:22.323 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-logitech-dj.ko 2023-03-02T10:27:22.323 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-03-02T10:27:22.323 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-multitouch.ko 2023-03-02T10:27:22.323 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-ortek.ko 2023-03-02T10:27:22.323 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-penmount.ko 2023-03-02T10:27:22.323 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-petalynx.ko 2023-03-02T10:27:22.323 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-picolcd.ko 2023-03-02T10:27:22.323 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-pl.ko 2023-03-02T10:27:22.324 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-plantronics.ko 2023-03-02T10:27:22.324 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-primax.ko 2023-03-02T10:27:22.324 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-rmi.ko 2023-03-02T10:27:22.324 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat-arvo.ko 2023-03-02T10:27:22.324 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat-common.ko 2023-03-02T10:27:22.324 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat-isku.ko 2023-03-02T10:27:22.324 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat-kone.ko 2023-03-02T10:27:22.324 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-03-02T10:27:22.325 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat-konepure.ko 2023-03-02T10:27:22.325 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-03-02T10:27:22.325 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat-lua.ko 2023-03-02T10:27:22.325 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat-pyra.ko 2023-03-02T10:27:22.325 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat-ryos.ko 2023-03-02T10:27:22.325 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat-savu.ko 2023-03-02T10:27:22.325 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-roccat.ko 2023-03-02T10:27:22.325 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-saitek.ko 2023-03-02T10:27:22.326 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-samsung.ko 2023-03-02T10:27:22.326 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-sensor-hub.ko 2023-03-02T10:27:22.326 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-sjoy.ko 2023-03-02T10:27:22.326 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-sony.ko 2023-03-02T10:27:22.326 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-speedlink.ko 2023-03-02T10:27:22.326 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-steelseries.ko 2023-03-02T10:27:22.326 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-sunplus.ko 2023-03-02T10:27:22.327 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-thrustmaster.ko 2023-03-02T10:27:22.327 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-tivo.ko 2023-03-02T10:27:22.327 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-tmff.ko 2023-03-02T10:27:22.327 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-topseed.ko 2023-03-02T10:27:22.327 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-twinhan.ko 2023-03-02T10:27:22.327 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-uclogic.ko 2023-03-02T10:27:22.327 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-waltop.ko 2023-03-02T10:27:22.327 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-wiimote.ko 2023-03-02T10:27:22.328 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-xinmo.ko 2023-03-02T10:27:22.328 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-zpff.ko 2023-03-02T10:27:22.328 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/hid-zydacron.ko 2023-03-02T10:27:22.328 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/uhid.ko 2023-03-02T10:27:22.328 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hid/wacom.ko 2023-03-02T10:27:22.328 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hv 2023-03-02T10:27:22.328 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hv/hv_balloon.ko 2023-03-02T10:27:22.328 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hv/hv_utils.ko 2023-03-02T10:27:22.329 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hv/hv_vmbus.ko 2023-03-02T10:27:22.329 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon 2023-03-02T10:27:22.329 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/abituguru.ko 2023-03-02T10:27:22.329 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/abituguru3.ko 2023-03-02T10:27:22.329 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/acpi_power_meter.ko 2023-03-02T10:27:22.329 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ad7414.ko 2023-03-02T10:27:22.329 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ad7418.ko 2023-03-02T10:27:22.330 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adc128d818.ko 2023-03-02T10:27:22.330 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adm1025.ko 2023-03-02T10:27:22.330 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adm1026.ko 2023-03-02T10:27:22.330 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adm1029.ko 2023-03-02T10:27:22.330 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adm1031.ko 2023-03-02T10:27:22.330 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adm9240.ko 2023-03-02T10:27:22.330 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ads7828.ko 2023-03-02T10:27:22.330 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adt7410.ko 2023-03-02T10:27:22.331 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adt7411.ko 2023-03-02T10:27:22.331 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adt7462.ko 2023-03-02T10:27:22.331 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adt7470.ko 2023-03-02T10:27:22.331 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adt7475.ko 2023-03-02T10:27:22.331 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/adt7x10.ko 2023-03-02T10:27:22.331 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/amc6821.ko 2023-03-02T10:27:22.331 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/applesmc.ko 2023-03-02T10:27:22.332 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/asb100.ko 2023-03-02T10:27:22.332 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/asc7621.ko 2023-03-02T10:27:22.332 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/asus_atk0110.ko 2023-03-02T10:27:22.332 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/atxp1.ko 2023-03-02T10:27:22.332 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/coretemp.ko 2023-03-02T10:27:22.332 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-03-02T10:27:22.332 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/dme1737.ko 2023-03-02T10:27:22.332 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ds1621.ko 2023-03-02T10:27:22.333 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ds620.ko 2023-03-02T10:27:22.333 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/emc1403.ko 2023-03-02T10:27:22.333 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/emc6w201.ko 2023-03-02T10:27:22.333 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/f71805f.ko 2023-03-02T10:27:22.333 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/f71882fg.ko 2023-03-02T10:27:22.333 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/f75375s.ko 2023-03-02T10:27:22.333 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/fam15h_power.ko 2023-03-02T10:27:22.333 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/fschmd.ko 2023-03-02T10:27:22.334 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/g760a.ko 2023-03-02T10:27:22.334 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/g762.ko 2023-03-02T10:27:22.334 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/gl518sm.ko 2023-03-02T10:27:22.334 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/gl520sm.ko 2023-03-02T10:27:22.334 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/hwmon-vid.ko 2023-03-02T10:27:22.334 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/i5500_temp.ko 2023-03-02T10:27:22.334 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/i5k_amb.ko 2023-03-02T10:27:22.335 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ibmaem.ko 2023-03-02T10:27:22.335 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ibmpex.ko 2023-03-02T10:27:22.335 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ina209.ko 2023-03-02T10:27:22.335 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ina2xx.ko 2023-03-02T10:27:22.335 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/it87.ko 2023-03-02T10:27:22.335 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/k10temp.ko 2023-03-02T10:27:22.335 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/k8temp.ko 2023-03-02T10:27:22.335 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lineage-pem.ko 2023-03-02T10:27:22.336 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm63.ko 2023-03-02T10:27:22.336 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm73.ko 2023-03-02T10:27:22.336 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm75.ko 2023-03-02T10:27:22.336 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm77.ko 2023-03-02T10:27:22.336 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm78.ko 2023-03-02T10:27:22.336 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm80.ko 2023-03-02T10:27:22.336 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm83.ko 2023-03-02T10:27:22.336 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm85.ko 2023-03-02T10:27:22.337 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm87.ko 2023-03-02T10:27:22.337 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm90.ko 2023-03-02T10:27:22.337 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm92.ko 2023-03-02T10:27:22.337 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm93.ko 2023-03-02T10:27:22.337 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm95234.ko 2023-03-02T10:27:22.337 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm95241.ko 2023-03-02T10:27:22.337 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/lm95245.ko 2023-03-02T10:27:22.338 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ltc2945.ko 2023-03-02T10:27:22.338 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ltc4151.ko 2023-03-02T10:27:22.338 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ltc4215.ko 2023-03-02T10:27:22.338 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ltc4222.ko 2023-03-02T10:27:22.338 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ltc4245.ko 2023-03-02T10:27:22.338 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ltc4260.ko 2023-03-02T10:27:22.338 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/ltc4261.ko 2023-03-02T10:27:22.338 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/max16065.ko 2023-03-02T10:27:22.339 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/max1619.ko 2023-03-02T10:27:22.339 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/max1668.ko 2023-03-02T10:27:22.339 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/max197.ko 2023-03-02T10:27:22.339 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/max6639.ko 2023-03-02T10:27:22.339 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/max6650.ko 2023-03-02T10:27:22.339 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/max6697.ko 2023-03-02T10:27:22.339 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/mcp3021.ko 2023-03-02T10:27:22.339 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/nct6683.ko 2023-03-02T10:27:22.340 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/nct6775-core.ko 2023-03-02T10:27:22.340 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/nct6775.ko 2023-03-02T10:27:22.340 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/nct7802.ko 2023-03-02T10:27:22.340 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pc87360.ko 2023-03-02T10:27:22.340 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pc87427.ko 2023-03-02T10:27:22.340 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pcf8591.ko 2023-03-02T10:27:22.340 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus 2023-03-02T10:27:22.340 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-03-02T10:27:22.341 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-03-02T10:27:22.341 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-03-02T10:27:22.341 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/max16064.ko 2023-03-02T10:27:22.341 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/max34440.ko 2023-03-02T10:27:22.341 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/max8688.ko 2023-03-02T10:27:22.341 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-03-02T10:27:22.341 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-03-02T10:27:22.342 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-03-02T10:27:22.342 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-03-02T10:27:22.342 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-03-02T10:27:22.342 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-03-02T10:27:22.342 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/powr1220.ko 2023-03-02T10:27:22.342 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/sch5627.ko 2023-03-02T10:27:22.342 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/sch5636.ko 2023-03-02T10:27:22.342 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/sch56xx-common.ko 2023-03-02T10:27:22.343 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/sht15.ko 2023-03-02T10:27:22.343 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/sht21.ko 2023-03-02T10:27:22.343 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/shtc1.ko 2023-03-02T10:27:22.343 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/sis5595.ko 2023-03-02T10:27:22.343 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/smsc47b397.ko 2023-03-02T10:27:22.343 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/smsc47m1.ko 2023-03-02T10:27:22.343 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/smsc47m192.ko 2023-03-02T10:27:22.343 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/thmc50.ko 2023-03-02T10:27:22.344 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/tmp102.ko 2023-03-02T10:27:22.344 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/tmp103.ko 2023-03-02T10:27:22.344 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/tmp401.ko 2023-03-02T10:27:22.344 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/tmp421.ko 2023-03-02T10:27:22.344 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/via-cputemp.ko 2023-03-02T10:27:22.344 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/via686a.ko 2023-03-02T10:27:22.344 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/vt1211.ko 2023-03-02T10:27:22.344 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/vt8231.ko 2023-03-02T10:27:22.345 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/w83627ehf.ko 2023-03-02T10:27:22.345 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/w83627hf.ko 2023-03-02T10:27:22.345 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/w83781d.ko 2023-03-02T10:27:22.345 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/w83791d.ko 2023-03-02T10:27:22.345 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/w83792d.ko 2023-03-02T10:27:22.345 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/w83793.ko 2023-03-02T10:27:22.345 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/w83795.ko 2023-03-02T10:27:22.346 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/w83l785ts.ko 2023-03-02T10:27:22.346 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/hwmon/w83l786ng.ko 2023-03-02T10:27:22.346 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c 2023-03-02T10:27:22.346 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/algos 2023-03-02T10:27:22.346 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-03-02T10:27:22.346 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-03-02T10:27:22.346 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses 2023-03-02T10:27:22.346 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-03-02T10:27:22.347 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-03-02T10:27:22.347 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-03-02T10:27:22.347 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-03-02T10:27:22.347 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-03-02T10:27:22.347 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-03-02T10:27:22.347 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-03-02T10:27:22.347 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-03-02T10:27:22.348 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-i801.ko 2023-03-02T10:27:22.348 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-isch.ko 2023-03-02T10:27:22.348 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-03-02T10:27:22.348 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-03-02T10:27:22.348 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-03-02T10:27:22.348 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-parport.ko 2023-03-02T10:27:22.348 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-03-02T10:27:22.348 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-03-02T10:27:22.349 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-03-02T10:27:22.349 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-03-02T10:27:22.349 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-03-02T10:27:22.349 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-03-02T10:27:22.349 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-via.ko 2023-03-02T10:27:22.349 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-03-02T10:27:22.349 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-03-02T10:27:22.349 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/i2c-dev.ko 2023-03-02T10:27:22.350 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/i2c-mux.ko 2023-03-02T10:27:22.350 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-03-02T10:27:22.350 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/i2c-smbus.ko 2023-03-02T10:27:22.350 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/i2c/i2c-stub.ko 2023-03-02T10:27:22.350 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband 2023-03-02T10:27:22.350 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/core 2023-03-02T10:27:22.350 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/core/ib_cm.ko 2023-03-02T10:27:22.351 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/core/ib_core.ko 2023-03-02T10:27:22.351 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/core/ib_umad.ko 2023-03-02T10:27:22.351 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-03-02T10:27:22.351 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/core/iw_cm.ko 2023-03-02T10:27:22.351 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/core/rdma_cm.ko 2023-03-02T10:27:22.351 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-03-02T10:27:22.351 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/hw 2023-03-02T10:27:22.351 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/hw/cxgb4 2023-03-02T10:27:22.352 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-03-02T10:27:22.352 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/hw/mlx4 2023-03-02T10:27:22.352 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-03-02T10:27:22.352 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/hw/mlx5 2023-03-02T10:27:22.352 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-03-02T10:27:22.352 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/hw/mthca 2023-03-02T10:27:22.352 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-03-02T10:27:22.352 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/ulp 2023-03-02T10:27:22.353 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/ulp/ipoib 2023-03-02T10:27:22.353 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-03-02T10:27:22.353 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/ulp/iser 2023-03-02T10:27:22.353 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-03-02T10:27:22.353 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/ulp/isert 2023-03-02T10:27:22.353 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-03-02T10:27:22.353 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/ulp/srp 2023-03-02T10:27:22.354 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-03-02T10:27:22.354 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/ulp/srpt 2023-03-02T10:27:22.354 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-03-02T10:27:22.354 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input 2023-03-02T10:27:22.354 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/gameport 2023-03-02T10:27:22.354 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-03-02T10:27:22.354 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/gameport/fm801-gp.ko 2023-03-02T10:27:22.354 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/gameport/gameport.ko 2023-03-02T10:27:22.355 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/gameport/lightning.ko 2023-03-02T10:27:22.355 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/gameport/ns558.ko 2023-03-02T10:27:22.355 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/joydev.ko 2023-03-02T10:27:22.355 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/keyboard 2023-03-02T10:27:22.355 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/keyboard/gpio_keys.ko 2023-03-02T10:27:22.355 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/mouse 2023-03-02T10:27:22.355 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/mouse/appletouch.ko 2023-03-02T10:27:22.355 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/mouse/bcm5974.ko 2023-03-02T10:27:22.356 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/mouse/cyapatp.ko 2023-03-02T10:27:22.356 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/mouse/elan_i2c.ko 2023-03-02T10:27:22.356 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/mouse/sermouse.ko 2023-03-02T10:27:22.356 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-03-02T10:27:22.356 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/mouse/synaptics_usb.ko 2023-03-02T10:27:22.356 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/mouse/vsxxxaa.ko 2023-03-02T10:27:22.356 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/rmi4 2023-03-02T10:27:22.357 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/rmi4/rmi_core.ko 2023-03-02T10:27:22.357 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/serio 2023-03-02T10:27:22.357 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/serio/altera_ps2.ko 2023-03-02T10:27:22.357 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/serio/arc_ps2.ko 2023-03-02T10:27:22.357 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-03-02T10:27:22.357 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/serio/serio_raw.ko 2023-03-02T10:27:22.357 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/input/sparse-keymap.ko 2023-03-02T10:27:22.357 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/iommu 2023-03-02T10:27:22.358 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/iommu/amd 2023-03-02T10:27:22.358 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/iommu/amd/iommu_v2.ko 2023-03-02T10:27:22.358 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds 2023-03-02T10:27:22.358 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/leds-blinkm.ko 2023-03-02T10:27:22.358 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/leds-lm3530.ko 2023-03-02T10:27:22.358 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/leds-lp3944.ko 2023-03-02T10:27:22.358 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/leds-ss4200.ko 2023-03-02T10:27:22.358 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/trigger 2023-03-02T10:27:22.359 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-03-02T10:27:22.359 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-03-02T10:27:22.359 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-03-02T10:27:22.359 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-03-02T10:27:22.359 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-03-02T10:27:22.359 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-03-02T10:27:22.359 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-03-02T10:27:22.360 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-03-02T10:27:22.360 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-03-02T10:27:22.360 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md 2023-03-02T10:27:22.360 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/bcache 2023-03-02T10:27:22.360 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/bcache/bcache.ko 2023-03-02T10:27:22.360 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-bio-prison.ko 2023-03-02T10:27:22.360 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-cache-smq.ko 2023-03-02T10:27:22.360 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-cache.ko 2023-03-02T10:27:22.361 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-crypt.ko 2023-03-02T10:27:22.361 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-delay.ko 2023-03-02T10:27:22.361 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-flakey.ko 2023-03-02T10:27:22.361 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-log-userspace.ko 2023-03-02T10:27:22.361 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-multipath.ko 2023-03-02T10:27:22.361 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-queue-length.ko 2023-03-02T10:27:22.361 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-raid.ko 2023-03-02T10:27:22.362 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-round-robin.ko 2023-03-02T10:27:22.362 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-service-time.ko 2023-03-02T10:27:22.362 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-switch.ko 2023-03-02T10:27:22.362 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-thin-pool.ko 2023-03-02T10:27:22.362 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/dm-verity.ko 2023-03-02T10:27:22.362 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/faulty.ko 2023-03-02T10:27:22.362 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/linear.ko 2023-03-02T10:27:22.362 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/multipath.ko 2023-03-02T10:27:22.363 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/persistent-data 2023-03-02T10:27:22.363 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-03-02T10:27:22.363 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/raid0.ko 2023-03-02T10:27:22.363 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/raid1.ko 2023-03-02T10:27:22.363 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/raid10.ko 2023-03-02T10:27:22.363 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/md/raid456.ko 2023-03-02T10:27:22.363 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/message 2023-03-02T10:27:22.363 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/message/fusion 2023-03-02T10:27:22.364 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/message/fusion/mptbase.ko 2023-03-02T10:27:22.364 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/message/fusion/mptctl.ko 2023-03-02T10:27:22.364 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/message/fusion/mptfc.ko 2023-03-02T10:27:22.364 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/message/fusion/mptlan.ko 2023-03-02T10:27:22.364 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/message/fusion/mptsas.ko 2023-03-02T10:27:22.364 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/message/fusion/mptscsih.ko 2023-03-02T10:27:22.364 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/message/fusion/mptspi.ko 2023-03-02T10:27:22.364 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/mfd 2023-03-02T10:27:22.365 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/mfd/lpc_ich.ko 2023-03-02T10:27:22.365 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/mfd/lpc_sch.ko 2023-03-02T10:27:22.365 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/mfd/mfd-core.ko 2023-03-02T10:27:22.365 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/mfd/sm501.ko 2023-03-02T10:27:22.365 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/mfd/viperboard.ko 2023-03-02T10:27:22.365 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/mfd/vx855.ko 2023-03-02T10:27:22.365 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/mfd/wl1273-core.ko 2023-03-02T10:27:22.366 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc 2023-03-02T10:27:22.366 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/altera-stapl 2023-03-02T10:27:22.366 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-03-02T10:27:22.366 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/apds9802als.ko 2023-03-02T10:27:22.366 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/apds990x.ko 2023-03-02T10:27:22.366 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/bh1770glc.ko 2023-03-02T10:27:22.366 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/cb710 2023-03-02T10:27:22.366 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/cb710/cb710.ko 2023-03-02T10:27:22.367 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/eeprom 2023-03-02T10:27:22.367 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/eeprom/at24.ko 2023-03-02T10:27:22.367 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/eeprom/eeprom.ko 2023-03-02T10:27:22.367 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-03-02T10:27:22.367 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/eeprom/max6875.ko 2023-03-02T10:27:22.367 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/enclosure.ko 2023-03-02T10:27:22.367 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/hpilo.ko 2023-03-02T10:27:22.368 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/isl29003.ko 2023-03-02T10:27:22.368 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/isl29020.ko 2023-03-02T10:27:22.368 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/lis3lv02d 2023-03-02T10:27:22.368 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-03-02T10:27:22.368 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-03-02T10:27:22.368 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/mei 2023-03-02T10:27:22.368 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/mei/mei-me.ko 2023-03-02T10:27:22.368 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/mei/mei-txe.ko 2023-03-02T10:27:22.369 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/mei/mei.ko 2023-03-02T10:27:22.369 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/sgi-gru 2023-03-02T10:27:22.369 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/sgi-gru/gru.ko 2023-03-02T10:27:22.369 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/sgi-xp 2023-03-02T10:27:22.369 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/sgi-xp/xp.ko 2023-03-02T10:27:22.369 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/sgi-xp/xpc.ko 2023-03-02T10:27:22.369 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-03-02T10:27:22.369 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/tifm_7xx1.ko 2023-03-02T10:27:22.370 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/tifm_core.ko 2023-03-02T10:27:22.370 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/tsl2550.ko 2023-03-02T10:27:22.370 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/vmw_balloon.ko 2023-03-02T10:27:22.370 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/vmw_vmci 2023-03-02T10:27:22.370 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-03-02T10:27:22.370 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net 2023-03-02T10:27:22.370 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/bonding 2023-03-02T10:27:22.371 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/bonding/bonding.ko 2023-03-02T10:27:22.371 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/dsa 2023-03-02T10:27:22.371 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/dsa/b53 2023-03-02T10:27:22.371 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/dsa/b53/b53_common.ko 2023-03-02T10:27:22.371 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/dsa/bcm-sf2.ko 2023-03-02T10:27:22.371 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/dsa/mv88e6060.ko 2023-03-02T10:27:22.371 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/dsa/mv88e6xxx 2023-03-02T10:27:22.371 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-03-02T10:27:22.372 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/dummy.ko 2023-03-02T10:27:22.372 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/eql.ko 2023-03-02T10:27:22.372 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet 2023-03-02T10:27:22.372 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/3com 2023-03-02T10:27:22.372 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-03-02T10:27:22.372 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-03-02T10:27:22.372 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-03-02T10:27:22.372 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-03-02T10:27:22.373 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/8390 2023-03-02T10:27:22.373 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/8390/8390.ko 2023-03-02T10:27:22.373 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-03-02T10:27:22.373 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-03-02T10:27:22.373 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-03-02T10:27:22.373 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/adaptec 2023-03-02T10:27:22.373 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-03-02T10:27:22.373 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/agere 2023-03-02T10:27:22.374 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/agere/et131x.ko 2023-03-02T10:27:22.374 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/alteon 2023-03-02T10:27:22.374 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-03-02T10:27:22.374 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/altera 2023-03-02T10:27:22.374 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-03-02T10:27:22.374 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/amd 2023-03-02T10:27:22.374 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-03-02T10:27:22.375 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-03-02T10:27:22.375 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-03-02T10:27:22.375 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/atheros 2023-03-02T10:27:22.375 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/atheros/alx 2023-03-02T10:27:22.375 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-03-02T10:27:22.375 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/atheros/atl1c 2023-03-02T10:27:22.375 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-03-02T10:27:22.375 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/atheros/atl1e 2023-03-02T10:27:22.376 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-03-02T10:27:22.376 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/atheros/atlx 2023-03-02T10:27:22.376 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-03-02T10:27:22.376 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-03-02T10:27:22.376 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/broadcom 2023-03-02T10:27:22.376 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-03-02T10:27:22.376 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-03-02T10:27:22.377 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-03-02T10:27:22.377 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-03-02T10:27:22.377 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-03-02T10:27:22.377 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/broadcom/genet 2023-03-02T10:27:22.377 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-03-02T10:27:22.377 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-03-02T10:27:22.377 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/brocade 2023-03-02T10:27:22.377 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/brocade/bna 2023-03-02T10:27:22.378 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-03-02T10:27:22.378 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/chelsio 2023-03-02T10:27:22.378 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/chelsio/cxgb 2023-03-02T10:27:22.378 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-03-02T10:27:22.378 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-03-02T10:27:22.378 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-03-02T10:27:22.378 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-03-02T10:27:22.378 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-03-02T10:27:22.379 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-03-02T10:27:22.379 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-03-02T10:27:22.379 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-03-02T10:27:22.379 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-03-02T10:27:22.379 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/cisco 2023-03-02T10:27:22.379 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/cisco/enic 2023-03-02T10:27:22.379 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-03-02T10:27:22.380 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dec 2023-03-02T10:27:22.380 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dec/tulip 2023-03-02T10:27:22.380 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-03-02T10:27:22.380 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-03-02T10:27:22.380 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-03-02T10:27:22.380 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-03-02T10:27:22.380 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-03-02T10:27:22.380 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-03-02T10:27:22.381 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dlink 2023-03-02T10:27:22.381 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-03-02T10:27:22.381 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-03-02T10:27:22.381 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/dnet.ko 2023-03-02T10:27:22.381 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/emulex 2023-03-02T10:27:22.381 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/emulex/benet 2023-03-02T10:27:22.381 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-03-02T10:27:22.381 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/ethoc.ko 2023-03-02T10:27:22.382 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel 2023-03-02T10:27:22.382 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/e100.ko 2023-03-02T10:27:22.382 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/e1000 2023-03-02T10:27:22.382 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-03-02T10:27:22.382 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/e1000e 2023-03-02T10:27:22.382 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-03-02T10:27:22.382 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/fm10k 2023-03-02T10:27:22.383 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-03-02T10:27:22.383 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/i40e 2023-03-02T10:27:22.383 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-03-02T10:27:22.383 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/iavf 2023-03-02T10:27:22.383 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-03-02T10:27:22.383 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/igb 2023-03-02T10:27:22.383 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-03-02T10:27:22.383 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/igbvf 2023-03-02T10:27:22.384 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-03-02T10:27:22.384 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/ixgb 2023-03-02T10:27:22.384 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-03-02T10:27:22.384 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/ixgbe 2023-03-02T10:27:22.384 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-03-02T10:27:22.384 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/ixgbevf 2023-03-02T10:27:22.384 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-03-02T10:27:22.384 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/jme.ko 2023-03-02T10:27:22.385 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/marvell 2023-03-02T10:27:22.385 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-03-02T10:27:22.385 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/marvell/skge.ko 2023-03-02T10:27:22.385 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-03-02T10:27:22.385 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/mellanox 2023-03-02T10:27:22.385 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/mellanox/mlx4 2023-03-02T10:27:22.385 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-03-02T10:27:22.386 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-03-02T10:27:22.386 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/mellanox/mlx5 2023-03-02T10:27:22.386 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-03-02T10:27:22.386 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-03-02T10:27:22.386 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/micrel 2023-03-02T10:27:22.386 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-03-02T10:27:22.386 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/myricom 2023-03-02T10:27:22.386 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/myricom/myri10ge 2023-03-02T10:27:22.387 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-03-02T10:27:22.387 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/natsemi 2023-03-02T10:27:22.387 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-03-02T10:27:22.387 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-03-02T10:27:22.387 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/neterion 2023-03-02T10:27:22.387 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-03-02T10:27:22.387 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/nvidia 2023-03-02T10:27:22.387 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-03-02T10:27:22.388 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/packetengines 2023-03-02T10:27:22.388 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-03-02T10:27:22.388 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-03-02T10:27:22.388 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/qlogic 2023-03-02T10:27:22.388 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/qlogic/netxen 2023-03-02T10:27:22.388 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-03-02T10:27:22.388 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-03-02T10:27:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-03-02T10:27:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-03-02T10:27:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/rdc 2023-03-02T10:27:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-03-02T10:27:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/realtek 2023-03-02T10:27:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-03-02T10:27:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-03-02T10:27:22.390 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/realtek/atp.ko 2023-03-02T10:27:22.390 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-03-02T10:27:22.390 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/rocker 2023-03-02T10:27:22.390 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-03-02T10:27:22.390 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/sfc 2023-03-02T10:27:22.390 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-03-02T10:27:22.390 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/silan 2023-03-02T10:27:22.390 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-03-02T10:27:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/sis 2023-03-02T10:27:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/sis/sis190.ko 2023-03-02T10:27:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/sis/sis900.ko 2023-03-02T10:27:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/smsc 2023-03-02T10:27:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-03-02T10:27:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-03-02T10:27:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-03-02T10:27:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-03-02T10:27:22.392 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/stmicro 2023-03-02T10:27:22.392 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/stmicro/stmmac 2023-03-02T10:27:22.392 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-03-02T10:27:22.392 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-03-02T10:27:22.392 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/sun 2023-03-02T10:27:22.392 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/sun/cassini.ko 2023-03-02T10:27:22.392 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/sun/niu.ko 2023-03-02T10:27:22.392 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/sun/sungem.ko 2023-03-02T10:27:22.393 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-03-02T10:27:22.393 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/tehuti 2023-03-02T10:27:22.393 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-03-02T10:27:22.393 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/ti 2023-03-02T10:27:22.393 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/ti/tlan.ko 2023-03-02T10:27:22.393 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/via 2023-03-02T10:27:22.393 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-03-02T10:27:22.394 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-03-02T10:27:22.394 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/wiznet 2023-03-02T10:27:22.394 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-03-02T10:27:22.394 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-03-02T10:27:22.394 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/xircom 2023-03-02T10:27:22.394 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-03-02T10:27:22.394 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/geneve.ko 2023-03-02T10:27:22.394 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/hyperv 2023-03-02T10:27:22.395 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-03-02T10:27:22.395 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ieee802154 2023-03-02T10:27:22.395 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ieee802154/fakelb.ko 2023-03-02T10:27:22.395 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ifb.ko 2023-03-02T10:27:22.395 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ipvlan 2023-03-02T10:27:22.395 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ipvlan/ipvlan.ko 2023-03-02T10:27:22.395 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/macvlan.ko 2023-03-02T10:27:22.395 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/macvtap.ko 2023-03-02T10:27:22.396 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/mdio 2023-03-02T10:27:22.396 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/mdio.ko 2023-03-02T10:27:22.396 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-03-02T10:27:22.396 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-03-02T10:27:22.396 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/mii.ko 2023-03-02T10:27:22.396 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/net_failover.ko 2023-03-02T10:27:22.396 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/netconsole.ko 2023-03-02T10:27:22.397 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/nlmon.ko 2023-03-02T10:27:22.397 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/pcs 2023-03-02T10:27:22.397 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-03-02T10:27:22.397 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-03-02T10:27:22.397 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy 2023-03-02T10:27:22.397 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/amd.ko 2023-03-02T10:27:22.397 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-03-02T10:27:22.397 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-03-02T10:27:22.398 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/bcm7xxx.ko 2023-03-02T10:27:22.398 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/bcm87xx.ko 2023-03-02T10:27:22.398 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/broadcom.ko 2023-03-02T10:27:22.398 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/cicada.ko 2023-03-02T10:27:22.398 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/davicom.ko 2023-03-02T10:27:22.398 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/dp83640.ko 2023-03-02T10:27:22.398 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/et1011c.ko 2023-03-02T10:27:22.398 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/icplus.ko 2023-03-02T10:27:22.399 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/lxt.ko 2023-03-02T10:27:22.399 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/marvell.ko 2023-03-02T10:27:22.399 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/micrel.ko 2023-03-02T10:27:22.399 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/national.ko 2023-03-02T10:27:22.399 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/phylink.ko 2023-03-02T10:27:22.399 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/qsemi.ko 2023-03-02T10:27:22.399 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/realtek.ko 2023-03-02T10:27:22.400 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/smsc.ko 2023-03-02T10:27:22.400 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/ste10Xp.ko 2023-03-02T10:27:22.400 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/phy/vitesse.ko 2023-03-02T10:27:22.400 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ppp 2023-03-02T10:27:22.400 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ppp/bsd_comp.ko 2023-03-02T10:27:22.400 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ppp/ppp_async.ko 2023-03-02T10:27:22.400 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ppp/ppp_deflate.ko 2023-03-02T10:27:22.400 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ppp/ppp_generic.ko 2023-03-02T10:27:22.401 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ppp/ppp_mppe.ko 2023-03-02T10:27:22.401 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ppp/ppp_synctty.ko 2023-03-02T10:27:22.401 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ppp/pppoe.ko 2023-03-02T10:27:22.402 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ppp/pppox.ko 2023-03-02T10:27:22.402 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/ppp/pptp.ko 2023-03-02T10:27:22.402 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/slip 2023-03-02T10:27:22.402 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/slip/slhc.ko 2023-03-02T10:27:22.403 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/slip/slip.ko 2023-03-02T10:27:22.403 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/sungem_phy.ko 2023-03-02T10:27:22.403 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/tap.ko 2023-03-02T10:27:22.403 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/team 2023-03-02T10:27:22.404 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/team/team.ko 2023-03-02T10:27:22.404 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/team/team_mode_activebackup.ko 2023-03-02T10:27:22.404 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/team/team_mode_broadcast.ko 2023-03-02T10:27:22.404 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-03-02T10:27:22.404 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/team/team_mode_random.ko 2023-03-02T10:27:22.405 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-03-02T10:27:22.405 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/tun.ko 2023-03-02T10:27:22.405 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/veth.ko 2023-03-02T10:27:22.405 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/virtio_net.ko 2023-03-02T10:27:22.406 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/vmxnet3 2023-03-02T10:27:22.406 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-03-02T10:27:22.406 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/vxlan 2023-03-02T10:27:22.407 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/vxlan/vxlan.ko 2023-03-02T10:27:22.407 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/xen-netback 2023-03-02T10:27:22.407 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/xen-netback/xen-netback.ko 2023-03-02T10:27:22.407 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/net/xen-netfront.ko 2023-03-02T10:27:22.408 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ntb 2023-03-02T10:27:22.408 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ntb/ntb.ko 2023-03-02T10:27:22.408 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/nvme 2023-03-02T10:27:22.408 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/nvme/host 2023-03-02T10:27:22.409 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/nvme/host/nvme-core.ko 2023-03-02T10:27:22.409 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/nvme/host/nvme.ko 2023-03-02T10:27:22.409 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/parport 2023-03-02T10:27:22.409 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/parport/parport.ko 2023-03-02T10:27:22.410 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/parport/parport_cs.ko 2023-03-02T10:27:22.410 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/parport/parport_pc.ko 2023-03-02T10:27:22.410 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/parport/parport_serial.ko 2023-03-02T10:27:22.410 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pci 2023-03-02T10:27:22.411 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pci/hotplug 2023-03-02T10:27:22.411 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-03-02T10:27:22.411 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pci/pcie 2023-03-02T10:27:22.411 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pci/pcie/aer_inject.ko 2023-03-02T10:27:22.412 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pci/xen-pcifront.ko 2023-03-02T10:27:22.412 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pcmcia 2023-03-02T10:27:22.412 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pcmcia/i82092.ko 2023-03-02T10:27:22.412 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pcmcia/pd6729.ko 2023-03-02T10:27:22.413 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pcmcia/yenta_socket.ko 2023-03-02T10:27:22.413 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pinctrl 2023-03-02T10:27:22.413 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pinctrl/intel 2023-03-02T10:27:22.413 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-03-02T10:27:22.414 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform 2023-03-02T10:27:22.414 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86 2023-03-02T10:27:22.414 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/acer-wmi.ko 2023-03-02T10:27:22.415 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/acerhdf.ko 2023-03-02T10:27:22.415 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/apple-gmux.ko 2023-03-02T10:27:22.415 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/asus-laptop.ko 2023-03-02T10:27:22.415 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-03-02T10:27:22.416 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/asus-wmi.ko 2023-03-02T10:27:22.416 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/classmate-laptop.ko 2023-03-02T10:27:22.416 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-03-02T10:27:22.416 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-03-02T10:27:22.417 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-03-02T10:27:22.417 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-03-02T10:27:22.417 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/hdaps.ko 2023-03-02T10:27:22.417 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/intel 2023-03-02T10:27:22.418 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-03-02T10:27:22.418 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/intel_ips.ko 2023-03-02T10:27:22.418 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/msi-wmi.ko 2023-03-02T10:27:22.418 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/mxm-wmi.ko 2023-03-02T10:27:22.419 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-03-02T10:27:22.419 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/samsung-laptop.ko 2023-03-02T10:27:22.419 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/samsung-q10.ko 2023-03-02T10:27:22.420 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/topstar-laptop.ko 2023-03-02T10:27:22.420 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-03-02T10:27:22.420 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/toshiba_haps.ko 2023-03-02T10:27:22.420 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/wmi-bmof.ko 2023-03-02T10:27:22.420 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/platform/x86/wmi.ko 2023-03-02T10:27:22.420 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/powercap 2023-03-02T10:27:22.420 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/powercap/intel_rapl_common.ko 2023-03-02T10:27:22.420 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/powercap/intel_rapl_msr.ko 2023-03-02T10:27:22.421 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pps 2023-03-02T10:27:22.421 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pps/clients 2023-03-02T10:27:22.421 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pps/clients/pps-gpio.ko 2023-03-02T10:27:22.421 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pps/clients/pps-ldisc.ko 2023-03-02T10:27:22.421 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pps/clients/pps_parport.ko 2023-03-02T10:27:22.421 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/pps/pps_core.ko 2023-03-02T10:27:22.422 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ptp 2023-03-02T10:27:22.422 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ptp/ptp.ko 2023-03-02T10:27:22.422 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ptp/ptp_kvm.ko 2023-03-02T10:27:22.422 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc 2023-03-02T10:27:22.422 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-bq32k.ko 2023-03-02T10:27:22.422 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-bq4802.ko 2023-03-02T10:27:22.423 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-ds1286.ko 2023-03-02T10:27:22.423 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-ds1307.ko 2023-03-02T10:27:22.423 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-ds1374.ko 2023-03-02T10:27:22.423 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-ds1511.ko 2023-03-02T10:27:22.423 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-ds1553.ko 2023-03-02T10:27:22.423 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-ds1672.ko 2023-03-02T10:27:22.423 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-ds1742.ko 2023-03-02T10:27:22.424 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-ds2404.ko 2023-03-02T10:27:22.424 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-ds3232.ko 2023-03-02T10:27:22.424 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-em3027.ko 2023-03-02T10:27:22.424 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-fm3130.ko 2023-03-02T10:27:22.424 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-isl12022.ko 2023-03-02T10:27:22.424 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-isl1208.ko 2023-03-02T10:27:22.424 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-m41t80.ko 2023-03-02T10:27:22.425 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-m48t35.ko 2023-03-02T10:27:22.425 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-m48t59.ko 2023-03-02T10:27:22.425 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-max6900.ko 2023-03-02T10:27:22.425 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-msm6242.ko 2023-03-02T10:27:22.425 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-pcf2127.ko 2023-03-02T10:27:22.425 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-pcf85063.ko 2023-03-02T10:27:22.425 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-pcf8523.ko 2023-03-02T10:27:22.426 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-pcf8563.ko 2023-03-02T10:27:22.426 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-pcf8583.ko 2023-03-02T10:27:22.426 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-rp5c01.ko 2023-03-02T10:27:22.426 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-rs5c372.ko 2023-03-02T10:27:22.426 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-03-02T10:27:22.426 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-rx8025.ko 2023-03-02T10:27:22.426 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-rx8581.ko 2023-03-02T10:27:22.427 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-03-02T10:27:22.427 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-v3020.ko 2023-03-02T10:27:22.427 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/rtc/rtc-x1205.ko 2023-03-02T10:27:22.427 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi 2023-03-02T10:27:22.427 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/3w-9xxx.ko 2023-03-02T10:27:22.428 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/3w-sas.ko 2023-03-02T10:27:22.428 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/3w-xxxx.ko 2023-03-02T10:27:22.428 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/BusLogic.ko 2023-03-02T10:27:22.428 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/a100u2w.ko 2023-03-02T10:27:22.428 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/aacraid 2023-03-02T10:27:22.428 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/aacraid/aacraid.ko 2023-03-02T10:27:22.428 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/advansys.ko 2023-03-02T10:27:22.429 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/aic7xxx 2023-03-02T10:27:22.429 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-03-02T10:27:22.429 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-03-02T10:27:22.429 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/am53c974.ko 2023-03-02T10:27:22.429 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/arcmsr 2023-03-02T10:27:22.429 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-03-02T10:27:22.429 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/atp870u.ko 2023-03-02T10:27:22.429 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/be2iscsi 2023-03-02T10:27:22.430 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-03-02T10:27:22.430 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/bfa 2023-03-02T10:27:22.430 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/bfa/bfa.ko 2023-03-02T10:27:22.430 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/bnx2fc 2023-03-02T10:27:22.430 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-03-02T10:27:22.430 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/bnx2i 2023-03-02T10:27:22.430 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-03-02T10:27:22.431 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/ch.ko 2023-03-02T10:27:22.431 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/csiostor 2023-03-02T10:27:22.431 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/csiostor/csiostor.ko 2023-03-02T10:27:22.431 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/cxgbi 2023-03-02T10:27:22.431 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/cxgbi/cxgb3i 2023-03-02T10:27:22.431 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-03-02T10:27:22.431 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/cxgbi/cxgb4i 2023-03-02T10:27:22.431 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-03-02T10:27:22.432 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-03-02T10:27:22.432 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/dc395x.ko 2023-03-02T10:27:22.432 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/device_handler 2023-03-02T10:27:22.432 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-03-02T10:27:22.432 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-03-02T10:27:22.432 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-03-02T10:27:22.432 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-03-02T10:27:22.433 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/dmx3191d.ko 2023-03-02T10:27:22.433 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/esas2r 2023-03-02T10:27:22.433 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/esas2r/esas2r.ko 2023-03-02T10:27:22.433 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/esp_scsi.ko 2023-03-02T10:27:22.433 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/fcoe 2023-03-02T10:27:22.433 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/fcoe/fcoe.ko 2023-03-02T10:27:22.433 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-03-02T10:27:22.433 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/fnic 2023-03-02T10:27:22.434 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/fnic/fnic.ko 2023-03-02T10:27:22.434 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/hpsa.ko 2023-03-02T10:27:22.434 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/hptiop.ko 2023-03-02T10:27:22.434 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/hv_storvsc.ko 2023-03-02T10:27:22.434 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/initio.ko 2023-03-02T10:27:22.434 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/ipr.ko 2023-03-02T10:27:22.434 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/ips.ko 2023-03-02T10:27:22.435 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/isci 2023-03-02T10:27:22.435 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/isci/isci.ko 2023-03-02T10:27:22.435 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-03-02T10:27:22.435 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/iscsi_tcp.ko 2023-03-02T10:27:22.435 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/libfc 2023-03-02T10:27:22.435 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/libfc/libfc.ko 2023-03-02T10:27:22.435 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/libiscsi.ko 2023-03-02T10:27:22.435 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/libiscsi_tcp.ko 2023-03-02T10:27:22.436 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/libsas 2023-03-02T10:27:22.436 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/libsas/libsas.ko 2023-03-02T10:27:22.436 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/lpfc 2023-03-02T10:27:22.436 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/lpfc/lpfc.ko 2023-03-02T10:27:22.436 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/megaraid 2023-03-02T10:27:22.436 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/megaraid.ko 2023-03-02T10:27:22.436 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-03-02T10:27:22.436 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-03-02T10:27:22.437 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-03-02T10:27:22.437 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/mpt3sas 2023-03-02T10:27:22.437 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-03-02T10:27:22.437 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/mvsas 2023-03-02T10:27:22.437 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/mvsas/mvsas.ko 2023-03-02T10:27:22.437 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/mvumi.ko 2023-03-02T10:27:22.437 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/pm8001 2023-03-02T10:27:22.438 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-03-02T10:27:22.438 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/pmcraid.ko 2023-03-02T10:27:22.438 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/qla1280.ko 2023-03-02T10:27:22.438 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/qla2xxx 2023-03-02T10:27:22.438 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-03-02T10:27:22.438 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-03-02T10:27:22.438 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/qla4xxx 2023-03-02T10:27:22.439 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-03-02T10:27:22.439 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/raid_class.ko 2023-03-02T10:27:22.439 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/scsi_debug.ko 2023-03-02T10:27:22.439 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/scsi_transport_fc.ko 2023-03-02T10:27:22.439 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-03-02T10:27:22.439 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/scsi_transport_sas.ko 2023-03-02T10:27:22.439 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/scsi_transport_spi.ko 2023-03-02T10:27:22.439 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/scsi_transport_srp.ko 2023-03-02T10:27:22.440 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/ses.ko 2023-03-02T10:27:22.440 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/st.ko 2023-03-02T10:27:22.440 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/stex.ko 2023-03-02T10:27:22.440 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/sym53c8xx_2 2023-03-02T10:27:22.440 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-03-02T10:27:22.440 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/virtio_scsi.ko 2023-03-02T10:27:22.440 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/vmw_pvscsi.ko 2023-03-02T10:27:22.441 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/scsi/wd719x.ko 2023-03-02T10:27:22.441 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ssb 2023-03-02T10:27:22.441 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ssb/ssb.ko 2023-03-02T10:27:22.441 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target 2023-03-02T10:27:22.441 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target/iscsi 2023-03-02T10:27:22.441 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-03-02T10:27:22.441 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target/loopback 2023-03-02T10:27:22.441 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target/loopback/tcm_loop.ko 2023-03-02T10:27:22.442 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target/target_core_file.ko 2023-03-02T10:27:22.442 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target/target_core_iblock.ko 2023-03-02T10:27:22.442 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target/target_core_mod.ko 2023-03-02T10:27:22.442 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target/target_core_pscsi.ko 2023-03-02T10:27:22.442 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target/target_core_user.ko 2023-03-02T10:27:22.442 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target/tcm_fc 2023-03-02T10:27:22.442 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-03-02T10:27:22.443 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal 2023-03-02T10:27:22.443 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel 2023-03-02T10:27:22.443 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal 2023-03-02T10:27:22.443 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-03-02T10:27:22.443 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-03-02T10:27:22.443 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-03-02T10:27:22.444 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-03-02T10:27:22.444 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-03-02T10:27:22.444 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-03-02T10:27:22.444 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-03-02T10:27:22.444 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-03-02T10:27:22.444 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-03-02T10:27:22.444 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-03-02T10:27:22.445 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-03-02T10:27:22.445 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-03-02T10:27:22.445 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-03-02T10:27:22.445 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-03-02T10:27:22.445 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-03-02T10:27:22.445 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty 2023-03-02T10:27:22.445 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/ipwireless 2023-03-02T10:27:22.446 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-03-02T10:27:22.446 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/n_gsm.ko 2023-03-02T10:27:22.446 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/n_hdlc.ko 2023-03-02T10:27:22.446 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/nozomi.ko 2023-03-02T10:27:22.446 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/serial 2023-03-02T10:27:22.446 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/serial/8250 2023-03-02T10:27:22.446 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-03-02T10:27:22.446 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/serial/arc_uart.ko 2023-03-02T10:27:22.447 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/serial/jsm 2023-03-02T10:27:22.447 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/serial/jsm/jsm.ko 2023-03-02T10:27:22.447 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/tty/synclink_gt.ko 2023-03-02T10:27:22.447 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ufs 2023-03-02T10:27:22.447 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ufs/core 2023-03-02T10:27:22.447 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ufs/core/ufshcd-core.ko 2023-03-02T10:27:22.447 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ufs/host 2023-03-02T10:27:22.447 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-03-02T10:27:22.448 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/uio 2023-03-02T10:27:22.448 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/uio/uio.ko 2023-03-02T10:27:22.448 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/uio/uio_aec.ko 2023-03-02T10:27:22.448 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/uio/uio_cif.ko 2023-03-02T10:27:22.448 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/uio/uio_pci_generic.ko 2023-03-02T10:27:22.448 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/uio/uio_sercos3.ko 2023-03-02T10:27:22.448 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb 2023-03-02T10:27:22.448 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/class 2023-03-02T10:27:22.449 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/class/cdc-acm.ko 2023-03-02T10:27:22.449 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/class/cdc-wdm.ko 2023-03-02T10:27:22.449 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/class/usblp.ko 2023-03-02T10:27:22.449 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/class/usbtmc.ko 2023-03-02T10:27:22.449 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/host 2023-03-02T10:27:22.449 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/host/sl811-hcd.ko 2023-03-02T10:27:22.449 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/host/u132-hcd.ko 2023-03-02T10:27:22.450 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/image 2023-03-02T10:27:22.450 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/image/mdc800.ko 2023-03-02T10:27:22.450 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/image/microtek.ko 2023-03-02T10:27:22.450 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc 2023-03-02T10:27:22.450 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/adutux.ko 2023-03-02T10:27:22.450 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/appledisplay.ko 2023-03-02T10:27:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/emi26.ko 2023-03-02T10:27:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/emi62.ko 2023-03-02T10:27:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/ezusb.ko 2023-03-02T10:27:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/ftdi-elan.ko 2023-03-02T10:27:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/idmouse.ko 2023-03-02T10:27:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/iowarrior.ko 2023-03-02T10:27:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/isight_firmware.ko 2023-03-02T10:27:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/ldusb.ko 2023-03-02T10:27:22.452 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/legousbtower.ko 2023-03-02T10:27:22.452 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/sisusbvga 2023-03-02T10:27:22.452 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-03-02T10:27:22.452 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/trancevibrator.ko 2023-03-02T10:27:22.452 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/usb3503.ko 2023-03-02T10:27:22.452 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/usblcd.ko 2023-03-02T10:27:22.452 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/usbsevseg.ko 2023-03-02T10:27:22.452 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/uss720.ko 2023-03-02T10:27:22.453 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/misc/yurex.ko 2023-03-02T10:27:22.453 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/phy 2023-03-02T10:27:22.453 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/phy/phy-generic.ko 2023-03-02T10:27:22.453 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial 2023-03-02T10:27:22.453 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/aircable.ko 2023-03-02T10:27:22.453 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/ark3116.ko 2023-03-02T10:27:22.453 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/belkin_sa.ko 2023-03-02T10:27:22.454 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/ch341.ko 2023-03-02T10:27:22.454 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/cp210x.ko 2023-03-02T10:27:22.454 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/cyberjack.ko 2023-03-02T10:27:22.454 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/cypress_m8.ko 2023-03-02T10:27:22.454 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/digi_acceleport.ko 2023-03-02T10:27:22.454 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/empeg.ko 2023-03-02T10:27:22.454 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/ftdi_sio.ko 2023-03-02T10:27:22.455 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/garmin_gps.ko 2023-03-02T10:27:22.455 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/io_edgeport.ko 2023-03-02T10:27:22.455 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/io_ti.ko 2023-03-02T10:27:22.455 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/ipaq.ko 2023-03-02T10:27:22.455 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/ipw.ko 2023-03-02T10:27:22.455 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/ir-usb.ko 2023-03-02T10:27:22.455 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-03-02T10:27:22.455 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/keyspan.ko 2023-03-02T10:27:22.456 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/keyspan_pda.ko 2023-03-02T10:27:22.456 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/kl5kusb105.ko 2023-03-02T10:27:22.456 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/kobil_sct.ko 2023-03-02T10:27:22.456 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/mct_u232.ko 2023-03-02T10:27:22.456 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/mos7720.ko 2023-03-02T10:27:22.456 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/mos7840.ko 2023-03-02T10:27:22.456 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/navman.ko 2023-03-02T10:27:22.456 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/omninet.ko 2023-03-02T10:27:22.457 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/opticon.ko 2023-03-02T10:27:22.457 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/option.ko 2023-03-02T10:27:22.457 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/oti6858.ko 2023-03-02T10:27:22.457 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/pl2303.ko 2023-03-02T10:27:22.457 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/qcaux.ko 2023-03-02T10:27:22.457 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/qcserial.ko 2023-03-02T10:27:22.457 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/quatech2.ko 2023-03-02T10:27:22.458 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/safe_serial.ko 2023-03-02T10:27:22.458 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/sierra.ko 2023-03-02T10:27:22.458 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/spcp8x5.ko 2023-03-02T10:27:22.458 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/ssu100.ko 2023-03-02T10:27:22.458 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/symbolserial.ko 2023-03-02T10:27:22.458 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-03-02T10:27:22.458 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-03-02T10:27:22.458 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/usb_debug.ko 2023-03-02T10:27:22.459 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/usb_wwan.ko 2023-03-02T10:27:22.459 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/visor.ko 2023-03-02T10:27:22.459 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/whiteheat.ko 2023-03-02T10:27:22.459 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/serial/xsens_mt.ko 2023-03-02T10:27:22.459 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage 2023-03-02T10:27:22.459 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/uas.ko 2023-03-02T10:27:22.459 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-alauda.ko 2023-03-02T10:27:22.459 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-cypress.ko 2023-03-02T10:27:22.460 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-datafab.ko 2023-03-02T10:27:22.460 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-03-02T10:27:22.460 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-freecom.ko 2023-03-02T10:27:22.460 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-isd200.ko 2023-03-02T10:27:22.460 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-03-02T10:27:22.460 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-karma.ko 2023-03-02T10:27:22.460 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-onetouch.ko 2023-03-02T10:27:22.461 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-realtek.ko 2023-03-02T10:27:22.461 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-sddr09.ko 2023-03-02T10:27:22.461 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-sddr55.ko 2023-03-02T10:27:22.461 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/ums-usbat.ko 2023-03-02T10:27:22.461 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/storage/usb-storage.ko 2023-03-02T10:27:22.462 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/usbip 2023-03-02T10:27:22.462 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/usbip/usbip-core.ko 2023-03-02T10:27:22.462 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/usbip/usbip-host.ko 2023-03-02T10:27:22.462 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-03-02T10:27:22.463 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/vfio 2023-03-02T10:27:22.463 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/vfio/pci 2023-03-02T10:27:22.463 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-03-02T10:27:22.463 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/vfio/pci/vfio-pci.ko 2023-03-02T10:27:22.463 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/vfio/vfio.ko 2023-03-02T10:27:22.463 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-03-02T10:27:22.464 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/vhost 2023-03-02T10:27:22.464 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/vhost/vhost.ko 2023-03-02T10:27:22.464 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/vhost/vhost_iotlb.ko 2023-03-02T10:27:22.464 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/vhost/vhost_net.ko 2023-03-02T10:27:22.464 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/vhost/vhost_scsi.ko 2023-03-02T10:27:22.464 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/video 2023-03-02T10:27:22.465 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/video/backlight 2023-03-02T10:27:22.465 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/video/backlight/apple_bl.ko 2023-03-02T10:27:22.465 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/video/backlight/lcd.ko 2023-03-02T10:27:22.465 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/video/backlight/platform_lcd.ko 2023-03-02T10:27:22.466 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/virtio 2023-03-02T10:27:22.466 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/virtio/virtio.ko 2023-03-02T10:27:22.466 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/virtio/virtio_balloon.ko 2023-03-02T10:27:22.466 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/virtio/virtio_mmio.ko 2023-03-02T10:27:22.467 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/virtio/virtio_pci.ko 2023-03-02T10:27:22.467 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-03-02T10:27:22.467 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-03-02T10:27:22.467 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/virtio/virtio_ring.ko 2023-03-02T10:27:22.468 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1 2023-03-02T10:27:22.468 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/masters 2023-03-02T10:27:22.468 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/masters/ds1wm.ko 2023-03-02T10:27:22.468 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/masters/ds2482.ko 2023-03-02T10:27:22.468 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/masters/ds2490.ko 2023-03-02T10:27:22.468 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves 2023-03-02T10:27:22.468 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-03-02T10:27:22.469 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-03-02T10:27:22.469 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-03-02T10:27:22.469 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-03-02T10:27:22.469 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-03-02T10:27:22.469 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-03-02T10:27:22.470 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-03-02T10:27:22.470 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-03-02T10:27:22.470 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-03-02T10:27:22.470 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves/w1_smem.ko 2023-03-02T10:27:22.470 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/slaves/w1_therm.ko 2023-03-02T10:27:22.470 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/w1/wire.ko 2023-03-02T10:27:22.470 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog 2023-03-02T10:27:22.471 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/alim1535_wdt.ko 2023-03-02T10:27:22.471 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/alim7101_wdt.ko 2023-03-02T10:27:22.471 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/f71808e_wdt.ko 2023-03-02T10:27:22.471 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/hpwdt.ko 2023-03-02T10:27:22.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/i6300esb.ko 2023-03-02T10:27:22.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-03-02T10:27:22.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/iTCO_wdt.ko 2023-03-02T10:27:22.472 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/ib700wdt.ko 2023-03-02T10:27:22.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/ibmasr.ko 2023-03-02T10:27:22.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-03-02T10:27:22.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/it8712f_wdt.ko 2023-03-02T10:27:22.473 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/it87_wdt.ko 2023-03-02T10:27:22.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/machzwd.ko 2023-03-02T10:27:22.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/nv_tco.ko 2023-03-02T10:27:22.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/pcwd_pci.ko 2023-03-02T10:27:22.474 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/pcwd_usb.ko 2023-03-02T10:27:22.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-03-02T10:27:22.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/sch311x_wdt.ko 2023-03-02T10:27:22.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/softdog.ko 2023-03-02T10:27:22.475 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/sp5100_tco.ko 2023-03-02T10:27:22.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/via_wdt.ko 2023-03-02T10:27:22.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-03-02T10:27:22.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/w83877f_wdt.ko 2023-03-02T10:27:22.476 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/w83977f_wdt.ko 2023-03-02T10:27:22.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/wdt_pci.ko 2023-03-02T10:27:22.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/watchdog/xen_wdt.ko 2023-03-02T10:27:22.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/xen 2023-03-02T10:27:22.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/xen/xen-acpi-processor.ko 2023-03-02T10:27:22.477 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/xen/xen-evtchn.ko 2023-03-02T10:27:22.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/xen/xen-gntalloc.ko 2023-03-02T10:27:22.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/xen/xen-gntdev.ko 2023-03-02T10:27:22.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/xen/xen-pciback 2023-03-02T10:27:22.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-03-02T10:27:22.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/xen/xen-privcmd.ko 2023-03-02T10:27:22.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/xen/xenfs 2023-03-02T10:27:22.478 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/drivers/xen/xenfs/xenfs.ko 2023-03-02T10:27:22.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs 2023-03-02T10:27:22.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/9p 2023-03-02T10:27:22.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/9p/9p.ko 2023-03-02T10:27:22.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/affs 2023-03-02T10:27:22.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/affs/affs.ko 2023-03-02T10:27:22.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/befs 2023-03-02T10:27:22.479 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/befs/befs.ko 2023-03-02T10:27:22.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/binfmt_misc.ko 2023-03-02T10:27:22.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/btrfs 2023-03-02T10:27:22.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/btrfs/btrfs.ko 2023-03-02T10:27:22.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/cachefiles 2023-03-02T10:27:22.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/cachefiles/cachefiles.ko 2023-03-02T10:27:22.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ceph 2023-03-02T10:27:22.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ceph/ceph.ko 2023-03-02T10:27:22.480 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/cifs 2023-03-02T10:27:22.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/cifs/cifs.ko 2023-03-02T10:27:22.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/coda 2023-03-02T10:27:22.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/coda/coda.ko 2023-03-02T10:27:22.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/cramfs 2023-03-02T10:27:22.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/cramfs/cramfs.ko 2023-03-02T10:27:22.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/dlm 2023-03-02T10:27:22.481 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/dlm/dlm.ko 2023-03-02T10:27:22.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ecryptfs 2023-03-02T10:27:22.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ecryptfs/ecryptfs.ko 2023-03-02T10:27:22.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/f2fs 2023-03-02T10:27:22.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/f2fs/f2fs.ko 2023-03-02T10:27:22.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/fat 2023-03-02T10:27:22.482 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/fat/fat.ko 2023-03-02T10:27:22.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/fat/msdos.ko 2023-03-02T10:27:22.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/fat/vfat.ko 2023-03-02T10:27:22.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/fscache 2023-03-02T10:27:22.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/fscache/fscache.ko 2023-03-02T10:27:22.483 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/fuse 2023-03-02T10:27:22.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/fuse/cuse.ko 2023-03-02T10:27:22.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/fuse/fuse.ko 2023-03-02T10:27:22.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/gfs2 2023-03-02T10:27:22.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/gfs2/gfs2.ko 2023-03-02T10:27:22.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/hfs 2023-03-02T10:27:22.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/hfs/hfs.ko 2023-03-02T10:27:22.484 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/hfsplus 2023-03-02T10:27:22.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/hfsplus/hfsplus.ko 2023-03-02T10:27:22.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/isofs 2023-03-02T10:27:22.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/isofs/isofs.ko 2023-03-02T10:27:22.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/jfs 2023-03-02T10:27:22.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/jfs/jfs.ko 2023-03-02T10:27:22.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/lockd 2023-03-02T10:27:22.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/lockd/lockd.ko 2023-03-02T10:27:22.485 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/minix 2023-03-02T10:27:22.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/minix/minix.ko 2023-03-02T10:27:22.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/netfs 2023-03-02T10:27:22.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/netfs/netfs.ko 2023-03-02T10:27:22.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs 2023-03-02T10:27:22.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs/blocklayout 2023-03-02T10:27:22.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-03-02T10:27:22.486 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs/filelayout 2023-03-02T10:27:22.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-03-02T10:27:22.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs/flexfilelayout 2023-03-02T10:27:22.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-03-02T10:27:22.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs/nfs.ko 2023-03-02T10:27:22.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs/nfsv3.ko 2023-03-02T10:27:22.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs/nfsv4.ko 2023-03-02T10:27:22.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs_common 2023-03-02T10:27:22.487 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs_common/grace.ko 2023-03-02T10:27:22.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfs_common/nfs_acl.ko 2023-03-02T10:27:22.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfsd 2023-03-02T10:27:22.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nfsd/nfsd.ko 2023-03-02T10:27:22.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nilfs2 2023-03-02T10:27:22.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nilfs2/nilfs2.ko 2023-03-02T10:27:22.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls 2023-03-02T10:27:22.488 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/mac-celtic.ko 2023-03-02T10:27:22.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/mac-centeuro.ko 2023-03-02T10:27:22.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/mac-croatian.ko 2023-03-02T10:27:22.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/mac-cyrillic.ko 2023-03-02T10:27:22.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/mac-gaelic.ko 2023-03-02T10:27:22.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/mac-greek.ko 2023-03-02T10:27:22.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/mac-iceland.ko 2023-03-02T10:27:22.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/mac-inuit.ko 2023-03-02T10:27:22.489 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/mac-roman.ko 2023-03-02T10:27:22.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/mac-romanian.ko 2023-03-02T10:27:22.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/mac-turkish.ko 2023-03-02T10:27:22.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp1250.ko 2023-03-02T10:27:22.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp1251.ko 2023-03-02T10:27:22.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp1255.ko 2023-03-02T10:27:22.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp737.ko 2023-03-02T10:27:22.490 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp775.ko 2023-03-02T10:27:22.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp850.ko 2023-03-02T10:27:22.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp852.ko 2023-03-02T10:27:22.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp855.ko 2023-03-02T10:27:22.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp857.ko 2023-03-02T10:27:22.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp860.ko 2023-03-02T10:27:22.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp861.ko 2023-03-02T10:27:22.491 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp862.ko 2023-03-02T10:27:22.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp863.ko 2023-03-02T10:27:22.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp864.ko 2023-03-02T10:27:22.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp865.ko 2023-03-02T10:27:22.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp866.ko 2023-03-02T10:27:22.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp869.ko 2023-03-02T10:27:22.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp874.ko 2023-03-02T10:27:22.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp932.ko 2023-03-02T10:27:22.492 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp936.ko 2023-03-02T10:27:22.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp949.ko 2023-03-02T10:27:22.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_cp950.ko 2023-03-02T10:27:22.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_euc-jp.ko 2023-03-02T10:27:22.493 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_iso8859-1.ko 2023-03-02T10:27:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_iso8859-13.ko 2023-03-02T10:27:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_iso8859-14.ko 2023-03-02T10:27:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_iso8859-15.ko 2023-03-02T10:27:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_iso8859-2.ko 2023-03-02T10:27:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_iso8859-3.ko 2023-03-02T10:27:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_iso8859-4.ko 2023-03-02T10:27:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_iso8859-5.ko 2023-03-02T10:27:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_iso8859-6.ko 2023-03-02T10:27:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_iso8859-7.ko 2023-03-02T10:27:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_iso8859-9.ko 2023-03-02T10:27:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_koi8-r.ko 2023-03-02T10:27:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_koi8-ru.ko 2023-03-02T10:27:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_koi8-u.ko 2023-03-02T10:27:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/nls/nls_utf8.ko 2023-03-02T10:27:22.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ocfs2 2023-03-02T10:27:22.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ocfs2/cluster 2023-03-02T10:27:22.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-03-02T10:27:22.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ocfs2/dlm 2023-03-02T10:27:22.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-03-02T10:27:22.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ocfs2/dlmfs 2023-03-02T10:27:22.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-03-02T10:27:22.496 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ocfs2/ocfs2.ko 2023-03-02T10:27:22.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-03-02T10:27:22.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-03-02T10:27:22.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-03-02T10:27:22.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/overlayfs 2023-03-02T10:27:22.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/overlayfs/overlay.ko 2023-03-02T10:27:22.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/pstore 2023-03-02T10:27:22.497 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/pstore/ramoops.ko 2023-03-02T10:27:22.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/reiserfs 2023-03-02T10:27:22.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/reiserfs/reiserfs.ko 2023-03-02T10:27:22.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/romfs 2023-03-02T10:27:22.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/romfs/romfs.ko 2023-03-02T10:27:22.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/smbfs_common 2023-03-02T10:27:22.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/smbfs_common/cifs_arc4.ko 2023-03-02T10:27:22.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/smbfs_common/cifs_md4.ko 2023-03-02T10:27:22.498 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/squashfs 2023-03-02T10:27:22.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/squashfs/squashfs.ko 2023-03-02T10:27:22.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/sysv 2023-03-02T10:27:22.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/sysv/sysv.ko 2023-03-02T10:27:22.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/udf 2023-03-02T10:27:22.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/udf/udf.ko 2023-03-02T10:27:22.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ufs 2023-03-02T10:27:22.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/ufs/ufs.ko 2023-03-02T10:27:22.499 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/xfs 2023-03-02T10:27:22.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/fs/xfs/xfs.ko 2023-03-02T10:27:22.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/kernel 2023-03-02T10:27:22.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/kernel/rcu 2023-03-02T10:27:22.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/kernel/rcu/rcutorture.ko 2023-03-02T10:27:22.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/kernel/torture.ko 2023-03-02T10:27:22.500 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/kernel/trace 2023-03-02T10:27:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-03-02T10:27:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib 2023-03-02T10:27:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/asn1_encoder.ko 2023-03-02T10:27:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/crc-itu-t.ko 2023-03-02T10:27:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/crc8.ko 2023-03-02T10:27:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/crypto 2023-03-02T10:27:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/crypto/libarc4.ko 2023-03-02T10:27:22.501 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/crypto/libdes.ko 2023-03-02T10:27:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/libcrc32c.ko 2023-03-02T10:27:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/lru_cache.ko 2023-03-02T10:27:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/lz4 2023-03-02T10:27:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/lz4/lz4_compress.ko 2023-03-02T10:27:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/lz4/lz4hc_compress.ko 2023-03-02T10:27:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/math 2023-03-02T10:27:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/math/cordic.ko 2023-03-02T10:27:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/raid6 2023-03-02T10:27:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/raid6/raid6_pq.ko 2023-03-02T10:27:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/reed_solomon 2023-03-02T10:27:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/reed_solomon/reed_solomon.ko 2023-03-02T10:27:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/ts_bm.ko 2023-03-02T10:27:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/ts_fsm.ko 2023-03-02T10:27:22.503 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/ts_kmp.ko 2023-03-02T10:27:22.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/zstd 2023-03-02T10:27:22.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/lib/zstd/zstd_compress.ko 2023-03-02T10:27:22.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/mm 2023-03-02T10:27:22.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/mm/hwpoison-inject.ko 2023-03-02T10:27:22.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net 2023-03-02T10:27:22.504 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/6lowpan 2023-03-02T10:27:22.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/6lowpan/6lowpan.ko 2023-03-02T10:27:22.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/6lowpan/nhc_dest.ko 2023-03-02T10:27:22.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/6lowpan/nhc_fragment.ko 2023-03-02T10:27:22.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/6lowpan/nhc_hop.ko 2023-03-02T10:27:22.505 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/6lowpan/nhc_ipv6.ko 2023-03-02T10:27:22.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/6lowpan/nhc_mobility.ko 2023-03-02T10:27:22.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/6lowpan/nhc_routing.ko 2023-03-02T10:27:22.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/6lowpan/nhc_udp.ko 2023-03-02T10:27:22.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/802 2023-03-02T10:27:22.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/802/garp.ko 2023-03-02T10:27:22.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/802/mrp.ko 2023-03-02T10:27:22.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/802/p8022.ko 2023-03-02T10:27:22.506 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/802/psnap.ko 2023-03-02T10:27:22.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/802/stp.ko 2023-03-02T10:27:22.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/8021q 2023-03-02T10:27:22.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/8021q/8021q.ko 2023-03-02T10:27:22.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/9p 2023-03-02T10:27:22.507 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/9p/9pnet.ko 2023-03-02T10:27:22.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/9p/9pnet_fd.ko 2023-03-02T10:27:22.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/9p/9pnet_rdma.ko 2023-03-02T10:27:22.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/9p/9pnet_virtio.ko 2023-03-02T10:27:22.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/batman-adv 2023-03-02T10:27:22.508 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/batman-adv/batman-adv.ko 2023-03-02T10:27:22.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge 2023-03-02T10:27:22.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/br_netfilter.ko 2023-03-02T10:27:22.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/bridge.ko 2023-03-02T10:27:22.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter 2023-03-02T10:27:22.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-03-02T10:27:22.509 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_among.ko 2023-03-02T10:27:22.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_arp.ko 2023-03-02T10:27:22.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-03-02T10:27:22.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-03-02T10:27:22.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_ip.ko 2023-03-02T10:27:22.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-03-02T10:27:22.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_limit.ko 2023-03-02T10:27:22.510 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_log.ko 2023-03-02T10:27:22.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_mark.ko 2023-03-02T10:27:22.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-03-02T10:27:22.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-03-02T10:27:22.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-03-02T10:27:22.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-03-02T10:27:22.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_snat.ko 2023-03-02T10:27:22.511 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_stp.ko 2023-03-02T10:27:22.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-03-02T10:27:22.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-03-02T10:27:22.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-03-02T10:27:22.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-03-02T10:27:22.512 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/ebtables.ko 2023-03-02T10:27:22.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-03-02T10:27:22.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-03-02T10:27:22.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-03-02T10:27:22.513 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ceph 2023-03-02T10:27:22.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ceph/libceph.ko 2023-03-02T10:27:22.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/core 2023-03-02T10:27:22.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/core/failover.ko 2023-03-02T10:27:22.514 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/core/pktgen.ko 2023-03-02T10:27:22.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dccp 2023-03-02T10:27:22.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dccp/dccp.ko 2023-03-02T10:27:22.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dccp/dccp_diag.ko 2023-03-02T10:27:22.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dccp/dccp_ipv4.ko 2023-03-02T10:27:22.515 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dccp/dccp_ipv6.ko 2023-03-02T10:27:22.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dns_resolver 2023-03-02T10:27:22.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dns_resolver/dns_resolver.ko 2023-03-02T10:27:22.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dsa 2023-03-02T10:27:22.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dsa/dsa_core.ko 2023-03-02T10:27:22.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dsa/tag_brcm.ko 2023-03-02T10:27:22.516 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dsa/tag_dsa.ko 2023-03-02T10:27:22.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dsa/tag_none.ko 2023-03-02T10:27:22.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/dsa/tag_trailer.ko 2023-03-02T10:27:22.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ieee802154 2023-03-02T10:27:22.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ieee802154/6lowpan 2023-03-02T10:27:22.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-03-02T10:27:22.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ieee802154/ieee802154.ko 2023-03-02T10:27:22.517 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ieee802154/ieee802154_socket.ko 2023-03-02T10:27:22.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4 2023-03-02T10:27:22.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/ah4.ko 2023-03-02T10:27:22.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/esp4.ko 2023-03-02T10:27:22.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/fou.ko 2023-03-02T10:27:22.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/gre.ko 2023-03-02T10:27:22.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/inet_diag.ko 2023-03-02T10:27:22.518 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/ip_gre.ko 2023-03-02T10:27:22.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/ip_tunnel.ko 2023-03-02T10:27:22.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/ip_vti.ko 2023-03-02T10:27:22.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/ipcomp.ko 2023-03-02T10:27:22.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/ipip.ko 2023-03-02T10:27:22.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter 2023-03-02T10:27:22.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/arp_tables.ko 2023-03-02T10:27:22.519 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-03-02T10:27:22.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-03-02T10:27:22.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2023-03-02T10:27:22.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-03-02T10:27:22.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-03-02T10:27:22.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-03-02T10:27:22.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-03-02T10:27:22.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-03-02T10:27:22.520 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-03-02T10:27:22.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-03-02T10:27:22.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/iptable_security.ko 2023-03-02T10:27:22.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-03-02T10:27:22.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-03-02T10:27:22.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-03-02T10:27:22.521 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-03-02T10:27:22.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-03-02T10:27:22.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-03-02T10:27:22.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-03-02T10:27:22.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-03-02T10:27:22.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-03-02T10:27:22.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-03-02T10:27:22.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_bic.ko 2023-03-02T10:27:22.522 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_dctcp.ko 2023-03-02T10:27:22.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_diag.ko 2023-03-02T10:27:22.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_highspeed.ko 2023-03-02T10:27:22.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_htcp.ko 2023-03-02T10:27:22.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_hybla.ko 2023-03-02T10:27:22.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_illinois.ko 2023-03-02T10:27:22.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_lp.ko 2023-03-02T10:27:22.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_scalable.ko 2023-03-02T10:27:22.523 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_vegas.ko 2023-03-02T10:27:22.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_veno.ko 2023-03-02T10:27:22.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_westwood.ko 2023-03-02T10:27:22.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tcp_yeah.ko 2023-03-02T10:27:22.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/tunnel4.ko 2023-03-02T10:27:22.524 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/udp_diag.ko 2023-03-02T10:27:22.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/udp_tunnel.ko 2023-03-02T10:27:22.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv4/xfrm4_tunnel.ko 2023-03-02T10:27:22.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6 2023-03-02T10:27:22.525 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/ah6.ko 2023-03-02T10:27:22.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/esp6.ko 2023-03-02T10:27:22.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/fou6.ko 2023-03-02T10:27:22.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/ip6_tunnel.ko 2023-03-02T10:27:22.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-03-02T10:27:22.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/ip6_vti.ko 2023-03-02T10:27:22.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/ipcomp6.ko 2023-03-02T10:27:22.526 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter 2023-03-02T10:27:22.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-03-02T10:27:22.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-03-02T10:27:22.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-03-02T10:27:22.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-03-02T10:27:22.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-03-02T10:27:22.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-03-02T10:27:22.527 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-03-02T10:27:22.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-03-02T10:27:22.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-03-02T10:27:22.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-03-02T10:27:22.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-03-02T10:27:22.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-03-02T10:27:22.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-03-02T10:27:22.528 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-03-02T10:27:22.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-03-02T10:27:22.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-03-02T10:27:22.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-03-02T10:27:22.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-03-02T10:27:22.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-03-02T10:27:22.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-03-02T10:27:22.529 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-03-02T10:27:22.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-03-02T10:27:22.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-03-02T10:27:22.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-03-02T10:27:22.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/sit.ko 2023-03-02T10:27:22.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/tunnel6.ko 2023-03-02T10:27:22.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/ipv6/xfrm6_tunnel.ko 2023-03-02T10:27:22.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/key 2023-03-02T10:27:22.530 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/key/af_key.ko 2023-03-02T10:27:22.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/l2tp 2023-03-02T10:27:22.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/l2tp/l2tp_core.ko 2023-03-02T10:27:22.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/l2tp/l2tp_debugfs.ko 2023-03-02T10:27:22.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/l2tp/l2tp_eth.ko 2023-03-02T10:27:22.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/l2tp/l2tp_ip.ko 2023-03-02T10:27:22.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/l2tp/l2tp_ip6.ko 2023-03-02T10:27:22.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/l2tp/l2tp_netlink.ko 2023-03-02T10:27:22.531 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/l2tp/l2tp_ppp.ko 2023-03-02T10:27:22.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/llc 2023-03-02T10:27:22.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/llc/llc.ko 2023-03-02T10:27:22.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/mac802154 2023-03-02T10:27:22.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/mac802154/mac802154.ko 2023-03-02T10:27:22.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/mpls 2023-03-02T10:27:22.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/mpls/mpls_gso.ko 2023-03-02T10:27:22.532 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter 2023-03-02T10:27:22.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset 2023-03-02T10:27:22.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set.ko 2023-03-02T10:27:22.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-03-02T10:27:22.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-03-02T10:27:22.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-03-02T10:27:22.533 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-03-02T10:27:22.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-03-02T10:27:22.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-03-02T10:27:22.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-03-02T10:27:22.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-03-02T10:27:22.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-03-02T10:27:22.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-03-02T10:27:22.534 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-03-02T10:27:22.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-03-02T10:27:22.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-03-02T10:27:22.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-03-02T10:27:22.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-03-02T10:27:22.535 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs 2023-03-02T10:27:22.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs.ko 2023-03-02T10:27:22.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-03-02T10:27:22.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-03-02T10:27:22.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-03-02T10:27:22.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-03-02T10:27:22.536 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-03-02T10:27:22.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-03-02T10:27:22.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-03-02T10:27:22.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-03-02T10:27:22.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-03-02T10:27:22.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-03-02T10:27:22.537 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-03-02T10:27:22.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-03-02T10:27:22.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-03-02T10:27:22.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conncount.ko 2023-03-02T10:27:22.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack.ko 2023-03-02T10:27:22.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-03-02T10:27:22.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-03-02T10:27:22.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-03-02T10:27:22.538 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_h323.ko 2023-03-02T10:27:22.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_irc.ko 2023-03-02T10:27:22.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-03-02T10:27:22.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-03-02T10:27:22.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-03-02T10:27:22.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_sane.ko 2023-03-02T10:27:22.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_sip.ko 2023-03-02T10:27:22.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-03-02T10:27:22.539 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-03-02T10:27:22.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_dup_netdev.ko 2023-03-02T10:27:22.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_flow_table.ko 2023-03-02T10:27:22.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_flow_table_inet.ko 2023-03-02T10:27:22.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_log_syslog.ko 2023-03-02T10:27:22.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_nat.ko 2023-03-02T10:27:22.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_nat_amanda.ko 2023-03-02T10:27:22.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_nat_ftp.ko 2023-03-02T10:27:22.540 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_nat_irc.ko 2023-03-02T10:27:22.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_nat_sip.ko 2023-03-02T10:27:22.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_nat_tftp.ko 2023-03-02T10:27:22.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_synproxy_core.ko 2023-03-02T10:27:22.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nf_tables.ko 2023-03-02T10:27:22.541 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nfnetlink.ko 2023-03-02T10:27:22.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nfnetlink_acct.ko 2023-03-02T10:27:22.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nfnetlink_log.ko 2023-03-02T10:27:22.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nfnetlink_osf.ko 2023-03-02T10:27:22.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nfnetlink_queue.ko 2023-03-02T10:27:22.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_chain_nat.ko 2023-03-02T10:27:22.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_compat.ko 2023-03-02T10:27:22.542 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_ct.ko 2023-03-02T10:27:22.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_dup_netdev.ko 2023-03-02T10:27:22.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_fib.ko 2023-03-02T10:27:22.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_fwd_netdev.ko 2023-03-02T10:27:22.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_hash.ko 2023-03-02T10:27:22.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_limit.ko 2023-03-02T10:27:22.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_log.ko 2023-03-02T10:27:22.543 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_masq.ko 2023-03-02T10:27:22.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_nat.ko 2023-03-02T10:27:22.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_numgen.ko 2023-03-02T10:27:22.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_queue.ko 2023-03-02T10:27:22.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_quota.ko 2023-03-02T10:27:22.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_redir.ko 2023-03-02T10:27:22.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_reject.ko 2023-03-02T10:27:22.544 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_reject_inet.ko 2023-03-02T10:27:22.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_socket.ko 2023-03-02T10:27:22.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/nft_tunnel.ko 2023-03-02T10:27:22.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_AUDIT.ko 2023-03-02T10:27:22.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_CHECKSUM.ko 2023-03-02T10:27:22.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_CLASSIFY.ko 2023-03-02T10:27:22.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-03-02T10:27:22.545 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_CT.ko 2023-03-02T10:27:22.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_DSCP.ko 2023-03-02T10:27:22.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_HL.ko 2023-03-02T10:27:22.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_HMARK.ko 2023-03-02T10:27:22.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_IDLETIMER.ko 2023-03-02T10:27:22.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_LED.ko 2023-03-02T10:27:22.546 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_LOG.ko 2023-03-02T10:27:22.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_MASQUERADE.ko 2023-03-02T10:27:22.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_NETMAP.ko 2023-03-02T10:27:22.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_NFLOG.ko 2023-03-02T10:27:22.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_NFQUEUE.ko 2023-03-02T10:27:22.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_RATEEST.ko 2023-03-02T10:27:22.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_REDIRECT.ko 2023-03-02T10:27:22.547 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_SECMARK.ko 2023-03-02T10:27:22.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_TCPMSS.ko 2023-03-02T10:27:22.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-03-02T10:27:22.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_TEE.ko 2023-03-02T10:27:22.548 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_TPROXY.ko 2023-03-02T10:27:22.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_TRACE.ko 2023-03-02T10:27:22.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_addrtype.ko 2023-03-02T10:27:22.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_bpf.ko 2023-03-02T10:27:22.549 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_cgroup.ko 2023-03-02T10:27:22.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_cluster.ko 2023-03-02T10:27:22.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_comment.ko 2023-03-02T10:27:22.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_connbytes.ko 2023-03-02T10:27:22.550 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_connlabel.ko 2023-03-02T10:27:22.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_connlimit.ko 2023-03-02T10:27:22.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_connmark.ko 2023-03-02T10:27:22.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_conntrack.ko 2023-03-02T10:27:22.551 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_cpu.ko 2023-03-02T10:27:22.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_dccp.ko 2023-03-02T10:27:22.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_devgroup.ko 2023-03-02T10:27:22.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_dscp.ko 2023-03-02T10:27:22.552 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_ecn.ko 2023-03-02T10:27:22.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_esp.ko 2023-03-02T10:27:22.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_hashlimit.ko 2023-03-02T10:27:22.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_helper.ko 2023-03-02T10:27:22.553 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_hl.ko 2023-03-02T10:27:22.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_ipcomp.ko 2023-03-02T10:27:22.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_iprange.ko 2023-03-02T10:27:22.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_ipvs.ko 2023-03-02T10:27:22.554 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_l2tp.ko 2023-03-02T10:27:22.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_length.ko 2023-03-02T10:27:22.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_limit.ko 2023-03-02T10:27:22.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_mac.ko 2023-03-02T10:27:22.555 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_mark.ko 2023-03-02T10:27:22.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_multiport.ko 2023-03-02T10:27:22.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_nat.ko 2023-03-02T10:27:22.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_nfacct.ko 2023-03-02T10:27:22.556 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_osf.ko 2023-03-02T10:27:22.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_owner.ko 2023-03-02T10:27:22.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_physdev.ko 2023-03-02T10:27:22.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_pkttype.ko 2023-03-02T10:27:22.557 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_policy.ko 2023-03-02T10:27:22.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_quota.ko 2023-03-02T10:27:22.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_rateest.ko 2023-03-02T10:27:22.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_realm.ko 2023-03-02T10:27:22.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_recent.ko 2023-03-02T10:27:22.558 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_sctp.ko 2023-03-02T10:27:22.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_set.ko 2023-03-02T10:27:22.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_socket.ko 2023-03-02T10:27:22.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_state.ko 2023-03-02T10:27:22.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_statistic.ko 2023-03-02T10:27:22.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_string.ko 2023-03-02T10:27:22.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_tcpmss.ko 2023-03-02T10:27:22.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_time.ko 2023-03-02T10:27:22.559 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netfilter/xt_u32.ko 2023-03-02T10:27:22.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netlink 2023-03-02T10:27:22.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/netlink/netlink_diag.ko 2023-03-02T10:27:22.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/nsh 2023-03-02T10:27:22.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/nsh/nsh.ko 2023-03-02T10:27:22.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/openvswitch 2023-03-02T10:27:22.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/openvswitch/openvswitch.ko 2023-03-02T10:27:22.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/openvswitch/vport-geneve.ko 2023-03-02T10:27:22.560 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/openvswitch/vport-gre.ko 2023-03-02T10:27:22.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/openvswitch/vport-vxlan.ko 2023-03-02T10:27:22.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/packet 2023-03-02T10:27:22.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/packet/af_packet_diag.ko 2023-03-02T10:27:22.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/rds 2023-03-02T10:27:22.561 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/rds/rds.ko 2023-03-02T10:27:22.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/rds/rds_rdma.ko 2023-03-02T10:27:22.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/rds/rds_tcp.ko 2023-03-02T10:27:22.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched 2023-03-02T10:27:22.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/act_csum.ko 2023-03-02T10:27:22.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/act_gact.ko 2023-03-02T10:27:22.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/act_ipt.ko 2023-03-02T10:27:22.562 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/act_mirred.ko 2023-03-02T10:27:22.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/act_nat.ko 2023-03-02T10:27:22.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/act_pedit.ko 2023-03-02T10:27:22.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/act_police.ko 2023-03-02T10:27:22.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/act_simple.ko 2023-03-02T10:27:22.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/act_skbedit.ko 2023-03-02T10:27:22.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/act_vlan.ko 2023-03-02T10:27:22.563 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/cls_basic.ko 2023-03-02T10:27:22.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/cls_bpf.ko 2023-03-02T10:27:22.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/cls_flow.ko 2023-03-02T10:27:22.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/cls_fw.ko 2023-03-02T10:27:22.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/cls_route.ko 2023-03-02T10:27:22.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/cls_rsvp.ko 2023-03-02T10:27:22.564 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/cls_rsvp6.ko 2023-03-02T10:27:22.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/cls_tcindex.ko 2023-03-02T10:27:22.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/cls_u32.ko 2023-03-02T10:27:22.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/em_cmp.ko 2023-03-02T10:27:22.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/em_ipset.ko 2023-03-02T10:27:22.565 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/em_meta.ko 2023-03-02T10:27:22.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/em_nbyte.ko 2023-03-02T10:27:22.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/em_text.ko 2023-03-02T10:27:22.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/em_u32.ko 2023-03-02T10:27:22.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_cbq.ko 2023-03-02T10:27:22.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_choke.ko 2023-03-02T10:27:22.566 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_codel.ko 2023-03-02T10:27:22.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_drr.ko 2023-03-02T10:27:22.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_dsmark.ko 2023-03-02T10:27:22.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_fq.ko 2023-03-02T10:27:22.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_gred.ko 2023-03-02T10:27:22.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_hfsc.ko 2023-03-02T10:27:22.567 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_hhf.ko 2023-03-02T10:27:22.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_htb.ko 2023-03-02T10:27:22.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_ingress.ko 2023-03-02T10:27:22.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_mqprio.ko 2023-03-02T10:27:22.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_multiq.ko 2023-03-02T10:27:22.568 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_netem.ko 2023-03-02T10:27:22.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_pie.ko 2023-03-02T10:27:22.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_plug.ko 2023-03-02T10:27:22.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_prio.ko 2023-03-02T10:27:22.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_qfq.ko 2023-03-02T10:27:22.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_red.ko 2023-03-02T10:27:22.569 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_sfb.ko 2023-03-02T10:27:22.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_sfq.ko 2023-03-02T10:27:22.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_tbf.ko 2023-03-02T10:27:22.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sched/sch_teql.ko 2023-03-02T10:27:22.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sctp 2023-03-02T10:27:22.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sctp/sctp.ko 2023-03-02T10:27:22.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sctp/sctp_diag.ko 2023-03-02T10:27:22.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sunrpc 2023-03-02T10:27:22.570 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sunrpc/auth_gss 2023-03-02T10:27:22.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-03-02T10:27:22.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-03-02T10:27:22.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sunrpc/sunrpc.ko 2023-03-02T10:27:22.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sunrpc/xprtrdma 2023-03-02T10:27:22.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-03-02T10:27:22.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/tipc 2023-03-02T10:27:22.571 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/tipc/diag.ko 2023-03-02T10:27:22.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/tipc/tipc.ko 2023-03-02T10:27:22.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/unix 2023-03-02T10:27:22.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/unix/unix_diag.ko 2023-03-02T10:27:22.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/vmw_vsock 2023-03-02T10:27:22.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-03-02T10:27:22.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-03-02T10:27:22.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/vmw_vsock/vsock.ko 2023-03-02T10:27:22.572 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/vmw_vsock/vsock_diag.ko 2023-03-02T10:27:22.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/vmw_vsock/vsock_loopback.ko 2023-03-02T10:27:22.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/xfrm 2023-03-02T10:27:22.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/net/xfrm/xfrm_ipcomp.ko 2023-03-02T10:27:22.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/security 2023-03-02T10:27:22.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/security/keys 2023-03-02T10:27:22.573 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/security/keys/encrypted-keys 2023-03-02T10:27:22.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-03-02T10:27:22.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/security/keys/trusted-keys 2023-03-02T10:27:22.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/security/keys/trusted-keys/trusted.ko 2023-03-02T10:27:22.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/virt 2023-03-02T10:27:22.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/virt/lib 2023-03-02T10:27:22.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/kernel/virt/lib/irqbypass.ko 2023-03-02T10:27:22.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.alias 2023-03-02T10:27:22.574 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.alias.bin 2023-03-02T10:27:22.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.builtin 2023-03-02T10:27:22.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.builtin.bin 2023-03-02T10:27:22.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.builtin.modinfo 2023-03-02T10:27:22.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.dep 2023-03-02T10:27:22.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.dep.bin 2023-03-02T10:27:22.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.devname 2023-03-02T10:27:22.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.order 2023-03-02T10:27:22.575 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.softdep 2023-03-02T10:27:22.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.symbols 2023-03-02T10:27:22.576 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.2.0-ceph-g6c92a82cc8b8/modules.symbols.bin 2023-03-02T10:27:22.577 DEBUG:teuthology.task.kernel:get_image_version: 6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:27:22.577 DEBUG:teuthology.orchestra.run.smithi057:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-03-02T10:27:22.605 INFO:teuthology.orchestra.run.smithi057.stdout:postinstall scriptlet (using /bin/sh): 2023-03-02T10:27:22.606 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.2.0-ceph-g6c92a82cc8b8 -a -r /boot/System.map-6.2.0-ceph-g6c92a82cc8b8 ]; then 2023-03-02T10:27:22.606 INFO:teuthology.orchestra.run.smithi057.stdout:cp /boot/vmlinuz-6.2.0-ceph-g6c92a82cc8b8 /boot/.vmlinuz-6.2.0-ceph-g6c92a82cc8b8-rpm 2023-03-02T10:27:22.606 INFO:teuthology.orchestra.run.smithi057.stdout:cp /boot/System.map-6.2.0-ceph-g6c92a82cc8b8 /boot/.System.map-6.2.0-ceph-g6c92a82cc8b8-rpm 2023-03-02T10:27:22.606 INFO:teuthology.orchestra.run.smithi057.stdout:rm -f /boot/vmlinuz-6.2.0-ceph-g6c92a82cc8b8 /boot/System.map-6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:27:22.606 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/installkernel 6.2.0-ceph-g6c92a82cc8b8 /boot/.vmlinuz-6.2.0-ceph-g6c92a82cc8b8-rpm /boot/.System.map-6.2.0-ceph-g6c92a82cc8b8-rpm 2023-03-02T10:27:22.607 INFO:teuthology.orchestra.run.smithi057.stdout:rm -f /boot/.vmlinuz-6.2.0-ceph-g6c92a82cc8b8-rpm /boot/.System.map-6.2.0-ceph-g6c92a82cc8b8-rpm 2023-03-02T10:27:22.607 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2023-03-02T10:27:22.607 INFO:teuthology.orchestra.run.smithi057.stdout:preuninstall scriptlet (using /bin/sh): 2023-03-02T10:27:22.607 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-03-02T10:27:22.607 INFO:teuthology.orchestra.run.smithi057.stdout:new-kernel-pkg --remove 6.2.0-ceph-g6c92a82cc8b8 --rminitrd --initrdfile=/boot/initramfs-6.2.0-ceph-g6c92a82cc8b8.img 2023-03-02T10:27:22.607 INFO:teuthology.orchestra.run.smithi057.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-03-02T10:27:22.607 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-install remove 6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:27:22.607 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2023-03-02T10:27:22.608 INFO:teuthology.orchestra.run.smithi057.stdout:postuninstall scriptlet (using /bin/sh): 2023-03-02T10:27:22.608 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/update-bootloader ]; then 2023-03-02T10:27:22.608 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/update-bootloader --remove 6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:27:22.608 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2023-03-02T10:27:22.609 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -qi grub2-tools 2023-03-02T10:27:22.688 INFO:teuthology.orchestra.run.smithi057.stdout:Name : grub2-tools 2023-03-02T10:27:22.689 INFO:teuthology.orchestra.run.smithi057.stdout:Epoch : 1 2023-03-02T10:27:22.689 INFO:teuthology.orchestra.run.smithi057.stdout:Version : 2.02 2023-03-02T10:27:22.689 INFO:teuthology.orchestra.run.smithi057.stdout:Release : 123.el8 2023-03-02T10:27:22.689 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: x86_64 2023-03-02T10:27:22.690 INFO:teuthology.orchestra.run.smithi057.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-03-02T10:27:22.690 INFO:teuthology.orchestra.run.smithi057.stdout:Group : System Environment/Base 2023-03-02T10:27:22.690 INFO:teuthology.orchestra.run.smithi057.stdout:Size : 9265450 2023-03-02T10:27:22.690 INFO:teuthology.orchestra.run.smithi057.stdout:License : GPLv3+ 2023-03-02T10:27:22.690 INFO:teuthology.orchestra.run.smithi057.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-03-02T10:27:22.690 INFO:teuthology.orchestra.run.smithi057.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-03-02T10:27:22.690 INFO:teuthology.orchestra.run.smithi057.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-03-02T10:27:22.691 INFO:teuthology.orchestra.run.smithi057.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-03-02T10:27:22.691 INFO:teuthology.orchestra.run.smithi057.stdout:Relocations : (not relocatable) 2023-03-02T10:27:22.691 INFO:teuthology.orchestra.run.smithi057.stdout:Packager : Red Hat, Inc. 2023-03-02T10:27:22.691 INFO:teuthology.orchestra.run.smithi057.stdout:Vendor : Red Hat, Inc. 2023-03-02T10:27:22.691 INFO:teuthology.orchestra.run.smithi057.stdout:URL : http://www.gnu.org/software/grub/ 2023-03-02T10:27:22.691 INFO:teuthology.orchestra.run.smithi057.stdout:Summary : Support tools for GRUB. 2023-03-02T10:27:22.691 INFO:teuthology.orchestra.run.smithi057.stdout:Description : 2023-03-02T10:27:22.692 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:27:22.692 INFO:teuthology.orchestra.run.smithi057.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-03-02T10:27:22.692 INFO:teuthology.orchestra.run.smithi057.stdout:customizable bootloader with modular architecture. It supports a rich 2023-03-02T10:27:22.692 INFO:teuthology.orchestra.run.smithi057.stdout:variety of kernel formats, file systems, computer architectures and 2023-03-02T10:27:22.692 INFO:teuthology.orchestra.run.smithi057.stdout:hardware devices. 2023-03-02T10:27:22.692 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:27:22.692 INFO:teuthology.orchestra.run.smithi057.stdout:This subpackage provides tools for support of all platforms. 2023-03-02T10:27:22.693 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-03-02T10:27:22.694 INFO:teuthology.task.kernel:Updating grub on smithi057 to boot 6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:27:22.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-03-02T10:27:28.033 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2023-03-02T10:27:29.703 INFO:teuthology.orchestra.run.smithi057.stderr:done 2023-03-02T10:27:29.705 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2023-03-02T10:27:29.724 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.FqKwoEJgst 2023-03-02T10:27:29.725 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.FqKwoEJgst 2023-03-02T10:27:29.796 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.FqKwoEJgst 2023-03-02T10:27:29.943 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.FqKwoEJgst is 6KB 2023-03-02T10:27:29.991 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.FqKwoEJgst 2023-03-02T10:27:30.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo /bin/ls /boot/loader/entries || true 2023-03-02T10:27:30.077 INFO:teuthology.orchestra.run.smithi057.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-03-02T10:27:30.077 INFO:teuthology.orchestra.run.smithi057.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-03-02T10:27:30.077 INFO:teuthology.orchestra.run.smithi057.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.2.0-ceph-g6c92a82cc8b8.conf 2023-03-02T10:27:30.078 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:27:30.234 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2023-03-02T10:28:00.237 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-03-02T10:28:00.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-03-02T10:28:00.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-02T10:28:18.565 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-03-02T10:28:48.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-03-02T10:28:48.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-02T10:29:48.570 DEBUG:teuthology.orchestra.remote:timed out 2023-03-02T10:30:18.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-03-02T10:30:18.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-02T10:30:18.921 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-03-02T10:30:19.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-03-02T10:30:19.381 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.2.0-ceph-g6c92a82cc8b8"... 2023-03-02T10:30:19.381 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-03-02T10:30:19.443 INFO:teuthology.orchestra.run.smithi057.stdout:6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:30:19.444 DEBUG:teuthology.task.kernel:current kernel version is 6.2.0-ceph-g6c92a82cc8b8 vs 6.2.0-ceph-g6c92a82cc8b8 2023-03-02T10:30:19.444 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-03-02T10:30:19.444 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-03-02T10:30:20.446 DEBUG:teuthology.parallel:result is None 2023-03-02T10:30:20.446 INFO:teuthology.run_tasks:Running task internal.base... 2023-03-02T10:30:20.454 INFO:teuthology.task.internal:Creating test directory... 2023-03-02T10:30:20.455 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-02T10:30:20.461 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-02T10:30:20.464 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-02T10:30:20.523 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-03-02T10:30:20.532 INFO:teuthology.run_tasks:Running task internal.archive... 2023-03-02T10:30:20.545 INFO:teuthology.task.internal:Creating archive directory... 2023-03-02T10:30:20.545 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-02T10:30:20.551 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-02T10:30:20.555 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-02T10:30:20.641 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-03-02T10:30:20.654 INFO:teuthology.task.internal:Enabling coredump saving... 2023-03-02T10:30:20.654 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-02T10:30:20.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-02T10:30:20.674 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-02T10:30:20.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-02T10:30:20.694 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-02T10:30:20.699 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-02T10:30:20.717 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-02T10:30:20.767 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-02T10:30:20.784 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-02T10:30:20.791 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-02T10:30:20.805 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-02T10:30:20.839 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-02T10:30:20.882 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-02T10:30:20.887 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-03-02T10:30:20.895 INFO:teuthology.task.internal:Configuring sudo... 2023-03-02T10:30:20.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-02T10:30:20.900 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-02T10:30:20.902 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-02T10:30:20.993 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-03-02T10:30:21.003 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-03-02T10:30:21.005 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-02T10:30:21.010 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-02T10:30:21.012 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-02T10:30:21.068 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-02T10:30:21.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-02T10:30:21.264 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-02T10:30:21.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-02T10:30:21.460 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:30:21.473 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-02T10:30:21.571 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-02T10:30:21.622 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-02T10:30:21.678 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-02T10:30:21.770 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-02T10:30:21.812 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-03-02T10:30:21.813 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-02T10:30:21.885 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-02T10:30:21.937 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-02T10:30:21.991 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-02T10:30:22.080 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-02T10:30:22.122 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-02T10:30:22.122 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-02T10:30:22.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2023-03-02T10:30:22.196 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2023-03-02T10:30:22.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2023-03-02T10:30:22.269 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-02T10:30:22.296 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-02T10:30:22.347 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-02T10:30:22.724 INFO:teuthology.run_tasks:Running task internal.timer... 2023-03-02T10:30:22.733 INFO:teuthology.task.internal:Starting timer... 2023-03-02T10:30:22.734 INFO:teuthology.run_tasks:Running task pcp... 2023-03-02T10:30:22.744 INFO:teuthology.run_tasks:Running task selinux... 2023-03-02T10:30:22.753 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-03-02T10:30:22.754 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2023-03-02T10:30:22.908 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2023-03-02T10:30:22.914 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2023-03-02T10:30:22.975 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2023-03-02T10:30:22.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2023-03-02T10:30:23.055 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2023-03-02T10:30:23.057 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-03-02T10:30:23.058 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2023-03-02T10:30:23.129 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2023-03-02T10:30:23.130 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2023-03-02T10:30:23.154 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2023-03-02T10:30:23.154 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2023-03-02T10:30:23.184 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2023-03-02T10:30:23.185 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi122.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive'} 2023-03-02T10:30:23.186 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-02T10:30:23.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-02T10:30:23.287 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-02T10:30:23.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-02T10:30:23.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-02T10:30:23.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-02T10:30:23.343 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-03-02T10:30:23.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2023-03-02T10:30:23.443 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2023-03-02T10:30:23.472 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2023-03-02T10:30:23.499 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-03-02T10:30:23.509 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-03-02T10:30:23.518 INFO:teuthology.repo_utils:Fetching main from origin 2023-03-02T10:30:23.675 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-03-02T10:30:23.693 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-03-02T10:30:23.695 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi122.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-03-02T10:42:47.913 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2023-03-02T10:42:47.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-03-02T10:42:47.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-02T10:42:48.013 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-03-02T10:42:48.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-03-02T10:42:48.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-02T10:42:48.216 DEBUG:teuthology.orchestra.run.smithi122:> true 2023-03-02T10:42:48.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-03-02T10:42:48.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-02T10:42:48.358 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-03-02T10:42:48.428 INFO:teuthology.run_tasks:Running task clock... 2023-03-02T10:42:48.440 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-03-02T10:42:48.440 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-02T10:42:48.441 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-02T10:42:48.446 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-02T10:42:48.447 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-02T10:42:48.449 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-02T10:42:48.449 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-02T10:42:48.483 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-02T10:42:48.499 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-02T10:42:48.502 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-02T10:42:48.517 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-02T10:42:48.546 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-02T10:42:48.569 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2023-03-02T10:42:48.582 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2023-03-02T10:42:48.585 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2023-03-02T10:42:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-02T10:42:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-02T10:42:48.598 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2023-03-02T10:42:48.611 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-02T10:42:48.613 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-02T10:42:48.627 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-02T10:42:48.693 INFO:teuthology.orchestra.run.smithi122.stderr:bash: ntpq: command not found 2023-03-02T10:42:48.697 INFO:teuthology.orchestra.run.smithi136.stderr:bash: ntpq: command not found 2023-03-02T10:42:48.698 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-02T10:42:48.699 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2023-03-02T10:42:48.699 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.699 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.699 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.699 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.700 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-02T10:42:48.700 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2023-03-02T10:42:48.700 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.700 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.702 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.702 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.722 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2023-03-02T10:42:48.761 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2023-03-02T10:42:48.808 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-02T10:42:48.855 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-02T10:42:48.979 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2023-03-02T10:42:48.988 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-02T10:42:48.989 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2023-03-02T10:42:48.989 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.989 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.989 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.989 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-02T10:42:48.991 INFO:teuthology.run_tasks:Running task pexec... 2023-03-02T10:42:49.001 INFO:teuthology.task.pexec:Executing custom commands... 2023-03-02T10:42:49.002 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi057.front.sepia.ceph.com 2023-03-02T10:42:49.002 DEBUG:teuthology.orchestra.run.smithi057:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-03-02T10:42:49.003 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi122.front.sepia.ceph.com 2023-03-02T10:42:49.003 DEBUG:teuthology.orchestra.run.smithi122:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-03-02T10:42:49.004 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi136.front.sepia.ceph.com 2023-03-02T10:42:49.004 DEBUG:teuthology.orchestra.run.smithi136:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-03-02T10:42:49.374 INFO:teuthology.orchestra.run.smithi122.stdout:Updating Subscription Management repositories. 2023-03-02T10:42:49.376 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-03-02T10:42:49.594 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-03-02T10:42:50.202 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:06:20 ago on Thu 02 Mar 2023 10:36:29 AM UTC. 2023-03-02T10:42:50.206 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:06:20 ago on Thu 02 Mar 2023 10:36:29 AM UTC. 2023-03-02T10:42:50.631 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:07 ago on Thu 02 Mar 2023 10:40:43 AM UTC. 2023-03-02T10:42:51.930 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2023-03-02T10:42:51.931 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2023-03-02T10:42:51.931 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2023-03-02T10:42:51.932 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2023-03-02T10:42:51.932 INFO:teuthology.orchestra.run.smithi122.stdout:Resetting modules: 2023-03-02T10:42:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: container-tools 2023-03-02T10:42:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:42:51.932 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2023-03-02T10:42:51.932 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2023-03-02T10:42:51.933 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:42:51.956 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2023-03-02T10:42:51.957 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2023-03-02T10:42:51.957 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2023-03-02T10:42:51.958 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2023-03-02T10:42:51.958 INFO:teuthology.orchestra.run.smithi136.stdout:Resetting modules: 2023-03-02T10:42:51.958 INFO:teuthology.orchestra.run.smithi136.stdout: container-tools 2023-03-02T10:42:51.958 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:42:51.958 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2023-03-02T10:42:51.958 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2023-03-02T10:42:51.958 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:42:52.647 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-03-02T10:42:52.649 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-03-02T10:42:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2023-03-02T10:42:52.649 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-03-02T10:42:52.650 INFO:teuthology.orchestra.run.smithi057.stdout:Resetting modules: 2023-03-02T10:42:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: container-tools 2023-03-02T10:42:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:42:52.650 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-03-02T10:42:52.650 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-03-02T10:42:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:42:52.868 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:06:23 ago on Thu 02 Mar 2023 10:36:29 AM UTC. 2023-03-02T10:42:52.937 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:06:23 ago on Thu 02 Mar 2023 10:36:29 AM UTC. 2023-03-02T10:42:54.135 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:10 ago on Thu 02 Mar 2023 10:40:43 AM UTC. 2023-03-02T10:42:55.922 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2023-03-02T10:42:56.121 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2023-03-02T10:42:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:Updating Subscription Management repositories. 2023-03-02T10:42:56.594 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-03-02T10:42:57.145 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-03-02T10:42:57.282 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:06:27 ago on Thu 02 Mar 2023 10:36:29 AM UTC. 2023-03-02T10:42:57.546 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:06:28 ago on Thu 02 Mar 2023 10:36:29 AM UTC. 2023-03-02T10:42:57.867 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-03-02T10:42:58.991 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:15 ago on Thu 02 Mar 2023 10:40:43 AM UTC. 2023-03-02T10:42:58.997 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2023-03-02T10:42:59.000 INFO:teuthology.orchestra.run.smithi122.stdout:========================================================================================================================= 2023-03-02T10:42:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2023-03-02T10:42:59.001 INFO:teuthology.orchestra.run.smithi122.stdout:========================================================================================================================= 2023-03-02T10:42:59.001 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2023-03-02T10:42:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: conmon x86_64 2:2.1.3-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 56 k 2023-03-02T10:42:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: container-selinux noarch 2:2.189.0-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 59 k 2023-03-02T10:42:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: containernetworking-plugins x86_64 1:1.1.1-3.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 18 M 2023-03-02T10:42:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: containers-common x86_64 2:1-39.module+el8.6.0+16891+aaa3bd4c rhel-8-for-x86_64-appstream-rpms 109 k 2023-03-02T10:42:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: criu x86_64 3.15-3.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 518 k 2023-03-02T10:42:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: fuse-overlayfs x86_64 1.9-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 73 k 2023-03-02T10:42:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: libslirp x86_64 4.4.0-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 70 k 2023-03-02T10:42:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: runc x86_64 1:1.1.3-3.module+el8.6.0+16986+c8760fe3 rhel-8-for-x86_64-appstream-rpms 3.0 M 2023-03-02T10:42:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: slirp4netns x86_64 1.2.0-2.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-02T10:42:59.002 INFO:teuthology.orchestra.run.smithi122.stdout:Installing group/module packages: 2023-03-02T10:42:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-03-02T10:42:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-03-02T10:42:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-03-02T10:42:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-03-02T10:42:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-03-02T10:42:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-03-02T10:42:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-03-02T10:42:59.004 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2023-03-02T10:42:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-03-02T10:42:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-03-02T10:42:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-03-02T10:42:59.004 INFO:teuthology.orchestra.run.smithi122.stdout:Installing module profiles: 2023-03-02T10:42:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: container-tools/common 2023-03-02T10:42:59.005 INFO:teuthology.orchestra.run.smithi122.stdout:Enabling module streams: 2023-03-02T10:42:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: container-tools rhel8 2023-03-02T10:42:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:42:59.005 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2023-03-02T10:42:59.005 INFO:teuthology.orchestra.run.smithi122.stdout:========================================================================================================================= 2023-03-02T10:42:59.005 INFO:teuthology.orchestra.run.smithi122.stdout:Install 10 Packages 2023-03-02T10:42:59.006 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 9 Packages 2023-03-02T10:42:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:42:59.006 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 40 M 2023-03-02T10:42:59.006 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2023-03-02T10:42:59.080 INFO:teuthology.orchestra.run.smithi122.stdout:(1/19): python3-pyxdg-0.25-16.el8.noarch.rpm 1.2 MB/s | 94 kB 00:00 2023-03-02T10:42:59.106 INFO:teuthology.orchestra.run.smithi122.stdout:(2/19): python3-pytoml-0.1.14-5.git7dea353.el8. 245 kB/s | 25 kB 00:00 2023-03-02T10:42:59.131 INFO:teuthology.orchestra.run.smithi122.stdout:(3/19): yajl-2.1.0-10.el8.x86_64.rpm 322 kB/s | 41 kB 00:00 2023-03-02T10:42:59.156 INFO:teuthology.orchestra.run.smithi122.stdout:(4/19): udica-0.2.6-4.module+el8.6.0+16771+28df 653 kB/s | 49 kB 00:00 2023-03-02T10:42:59.190 INFO:teuthology.orchestra.run.smithi122.stdout:(5/19): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-03-02T10:42:59.215 INFO:teuthology.orchestra.run.smithi122.stdout:(6/19): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-03-02T10:42:59.241 INFO:teuthology.orchestra.run.smithi122.stdout:(7/19): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-03-02T10:42:59.260 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2023-03-02T10:42:59.263 INFO:teuthology.orchestra.run.smithi136.stdout:========================================================================================================================= 2023-03-02T10:42:59.263 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2023-03-02T10:42:59.263 INFO:teuthology.orchestra.run.smithi136.stdout:========================================================================================================================= 2023-03-02T10:42:59.263 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2023-03-02T10:42:59.264 INFO:teuthology.orchestra.run.smithi136.stdout: conmon x86_64 2:2.1.3-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 56 k 2023-03-02T10:42:59.264 INFO:teuthology.orchestra.run.smithi136.stdout: container-selinux noarch 2:2.189.0-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 59 k 2023-03-02T10:42:59.264 INFO:teuthology.orchestra.run.smithi136.stdout: containernetworking-plugins x86_64 1:1.1.1-3.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 18 M 2023-03-02T10:42:59.264 INFO:teuthology.orchestra.run.smithi136.stdout: containers-common x86_64 2:1-39.module+el8.6.0+16891+aaa3bd4c rhel-8-for-x86_64-appstream-rpms 109 k 2023-03-02T10:42:59.265 INFO:teuthology.orchestra.run.smithi136.stdout: criu x86_64 3.15-3.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 518 k 2023-03-02T10:42:59.265 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-overlayfs x86_64 1.9-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 73 k 2023-03-02T10:42:59.265 INFO:teuthology.orchestra.run.smithi136.stdout: libslirp x86_64 4.4.0-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 70 k 2023-03-02T10:42:59.265 INFO:teuthology.orchestra.run.smithi136.stdout: runc x86_64 1:1.1.3-3.module+el8.6.0+16986+c8760fe3 rhel-8-for-x86_64-appstream-rpms 3.0 M 2023-03-02T10:42:59.265 INFO:teuthology.orchestra.run.smithi136.stdout: slirp4netns x86_64 1.2.0-2.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-02T10:42:59.265 INFO:teuthology.orchestra.run.smithi136.stdout:Installing group/module packages: 2023-03-02T10:42:59.265 INFO:teuthology.orchestra.run.smithi136.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-03-02T10:42:59.265 INFO:teuthology.orchestra.run.smithi136.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-03-02T10:42:59.266 INFO:teuthology.orchestra.run.smithi136.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-03-02T10:42:59.266 INFO:teuthology.orchestra.run.smithi136.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-03-02T10:42:59.266 INFO:teuthology.orchestra.run.smithi136.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-03-02T10:42:59.266 INFO:teuthology.orchestra.run.smithi136.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-03-02T10:42:59.266 INFO:teuthology.orchestra.run.smithi136.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-03-02T10:42:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2023-03-02T10:42:59.266 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-03-02T10:42:59.267 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-03-02T10:42:59.267 INFO:teuthology.orchestra.run.smithi136.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-03-02T10:42:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:Installing module profiles: 2023-03-02T10:42:59.267 INFO:teuthology.orchestra.run.smithi136.stdout: container-tools/common 2023-03-02T10:42:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:Enabling module streams: 2023-03-02T10:42:59.267 INFO:teuthology.orchestra.run.smithi136.stdout: container-tools rhel8 2023-03-02T10:42:59.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:42:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2023-03-02T10:42:59.268 INFO:teuthology.orchestra.run.smithi136.stdout:========================================================================================================================= 2023-03-02T10:42:59.268 INFO:teuthology.orchestra.run.smithi136.stdout:Install 10 Packages 2023-03-02T10:42:59.268 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 9 Packages 2023-03-02T10:42:59.268 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:42:59.269 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 40 M 2023-03-02T10:42:59.269 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2023-03-02T10:42:59.333 INFO:teuthology.orchestra.run.smithi136.stdout:(1/19): yajl-2.1.0-10.el8.x86_64.rpm 623 kB/s | 41 kB 00:00 2023-03-02T10:42:59.349 INFO:teuthology.orchestra.run.smithi122.stdout:(8/19): toolbox-0.0.99.3-0.6.module+el8.6.0+167 20 MB/s | 2.2 MB 00:00 2023-03-02T10:42:59.350 INFO:teuthology.orchestra.run.smithi136.stdout:(2/19): python3-pytoml-0.1.14-5.git7dea353.el8. 301 kB/s | 25 kB 00:00 2023-03-02T10:42:59.366 INFO:teuthology.orchestra.run.smithi136.stdout:(3/19): udica-0.2.6-4.module+el8.6.0+16771+28df 1.4 MB/s | 49 kB 00:00 2023-03-02T10:42:59.383 INFO:teuthology.orchestra.run.smithi136.stdout:(4/19): python3-pyxdg-0.25-16.el8.noarch.rpm 806 kB/s | 94 kB 00:00 2023-03-02T10:42:59.417 INFO:teuthology.orchestra.run.smithi136.stdout:(5/19): cockpit-podman-49.1-1.module+el8.6.0+16 7.6 MB/s | 524 kB 00:00 2023-03-02T10:42:59.434 INFO:teuthology.orchestra.run.smithi136.stdout:(6/19): python3-podman-4.0.1-1.module+el8.6.0+1 2.9 MB/s | 149 kB 00:00 2023-03-02T10:42:59.459 INFO:teuthology.orchestra.run.smithi136.stdout:(7/19): crun-1.5-1.module+el8.6.0+16771+28dfca7 5.0 MB/s | 213 kB 00:00 2023-03-02T10:42:59.466 INFO:teuthology.orchestra.run.smithi122.stdout:(9/19): skopeo-1.9.1-1.module+el8.6.0+16771+28d 28 MB/s | 7.0 MB 00:00 2023-03-02T10:42:59.491 INFO:teuthology.orchestra.run.smithi122.stdout:(10/19): conmon-2.1.3-1.module+el8.6.0+16771+28 395 kB/s | 56 kB 00:00 2023-03-02T10:42:59.517 INFO:teuthology.orchestra.run.smithi122.stdout:(11/19): slirp4netns-1.2.0-2.module+el8.6.0+167 1.1 MB/s | 54 kB 00:00 2023-03-02T10:42:59.560 INFO:teuthology.orchestra.run.smithi136.stdout:(8/19): toolbox-0.0.99.3-0.6.module+el8.6.0+167 22 MB/s | 2.2 MB 00:00 2023-03-02T10:42:59.593 INFO:teuthology.orchestra.run.smithi136.stdout:(9/19): conmon-2.1.3-1.module+el8.6.0+16771+28d 1.6 MB/s | 56 kB 00:00 2023-03-02T10:42:59.609 INFO:teuthology.orchestra.run.smithi122.stdout:(12/19): buildah-1.26.2-1.module+el8.6.0+16771+ 17 MB/s | 8.0 MB 00:00 2023-03-02T10:42:59.634 INFO:teuthology.orchestra.run.smithi122.stdout:(13/19): containers-common-1-39.module+el8.6.0+ 933 kB/s | 109 kB 00:00 2023-03-02T10:42:59.652 INFO:teuthology.orchestra.run.smithi136.stdout:(10/19): slirp4netns-1.2.0-2.module+el8.6.0+167 929 kB/s | 54 kB 00:00 2023-03-02T10:42:59.660 INFO:teuthology.orchestra.run.smithi122.stdout:(14/19): libslirp-4.4.0-1.module+el8.6.0+16771+ 1.4 MB/s | 70 kB 00:00 2023-03-02T10:42:59.693 INFO:teuthology.orchestra.run.smithi122.stdout:(15/19): criu-3.15-3.module+el8.6.0+16771+28dfc 8.6 MB/s | 518 kB 00:00 2023-03-02T10:42:59.710 INFO:teuthology.orchestra.run.smithi122.stdout:(16/19): container-selinux-2.189.0-1.module+el8 1.1 MB/s | 59 kB 00:00 2023-03-02T10:42:59.760 INFO:teuthology.orchestra.run.smithi136.stdout:(11/19): skopeo-1.9.1-1.module+el8.6.0+16771+28 22 MB/s | 7.0 MB 00:00 2023-03-02T10:42:59.761 INFO:teuthology.orchestra.run.smithi122.stdout:(17/19): fuse-overlayfs-1.9-1.module+el8.6.0+16 1.4 MB/s | 73 kB 00:00 2023-03-02T10:42:59.827 INFO:teuthology.orchestra.run.smithi122.stdout:(18/19): runc-1.1.3-3.module+el8.6.0+16986+c876 22 MB/s | 3.0 MB 00:00 2023-03-02T10:42:59.852 INFO:teuthology.orchestra.run.smithi136.stdout:(12/19): buildah-1.26.2-1.module+el8.6.0+16771+ 16 MB/s | 8.0 MB 00:00 2023-03-02T10:42:59.877 INFO:teuthology.orchestra.run.smithi136.stdout:(13/19): containers-common-1-39.module+el8.6.0+ 937 kB/s | 109 kB 00:00 2023-03-02T10:42:59.894 INFO:teuthology.orchestra.run.smithi136.stdout:(14/19): libslirp-4.4.0-1.module+el8.6.0+16771+ 1.6 MB/s | 70 kB 00:00 2023-03-02T10:42:59.928 INFO:teuthology.orchestra.run.smithi136.stdout:(15/19): criu-3.15-3.module+el8.6.0+16771+28dfc 10 MB/s | 518 kB 00:00 2023-03-02T10:42:59.953 INFO:teuthology.orchestra.run.smithi136.stdout:(16/19): container-selinux-2.189.0-1.module+el8 1.0 MB/s | 59 kB 00:00 2023-03-02T10:42:59.995 INFO:teuthology.orchestra.run.smithi136.stdout:(17/19): fuse-overlayfs-1.9-1.module+el8.6.0+16 1.7 MB/s | 73 kB 00:00 2023-03-02T10:43:00.070 INFO:teuthology.orchestra.run.smithi136.stdout:(18/19): runc-1.1.3-3.module+el8.6.0+16986+c876 21 MB/s | 3.0 MB 00:00 2023-03-02T10:43:00.086 INFO:teuthology.orchestra.run.smithi122.stdout:(19/19): containernetworking-plugins-1.1.1-3.mo 31 MB/s | 18 MB 00:00 2023-03-02T10:43:00.086 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2023-03-02T10:43:00.087 INFO:teuthology.orchestra.run.smithi122.stdout:Total 37 MB/s | 40 MB 00:01 2023-03-02T10:43:00.362 INFO:teuthology.orchestra.run.smithi136.stdout:(19/19): containernetworking-plugins-1.1.1-3.mo 26 MB/s | 18 MB 00:00 2023-03-02T10:43:00.363 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2023-03-02T10:43:00.363 INFO:teuthology.orchestra.run.smithi136.stdout:Total 37 MB/s | 40 MB 00:01 2023-03-02T10:43:00.500 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2023-03-02T10:43:00.544 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2023-03-02T10:43:00.545 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2023-03-02T10:43:00.779 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2023-03-02T10:43:00.823 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2023-03-02T10:43:00.823 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2023-03-02T10:43:00.898 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2023-03-02T10:43:00.902 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2023-03-02T10:43:01.020 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-03-02T10:43:01.023 INFO:teuthology.orchestra.run.smithi057.stdout:========================================================================================================================= 2023-03-02T10:43:01.023 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-03-02T10:43:01.023 INFO:teuthology.orchestra.run.smithi057.stdout:========================================================================================================================= 2023-03-02T10:43:01.024 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2023-03-02T10:43:01.024 INFO:teuthology.orchestra.run.smithi057.stdout: conmon x86_64 2:2.1.3-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 56 k 2023-03-02T10:43:01.024 INFO:teuthology.orchestra.run.smithi057.stdout: container-selinux noarch 2:2.189.0-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 59 k 2023-03-02T10:43:01.024 INFO:teuthology.orchestra.run.smithi057.stdout: containernetworking-plugins x86_64 1:1.1.1-3.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 18 M 2023-03-02T10:43:01.024 INFO:teuthology.orchestra.run.smithi057.stdout: containers-common x86_64 2:1-39.module+el8.6.0+16891+aaa3bd4c rhel-8-for-x86_64-appstream-rpms 109 k 2023-03-02T10:43:01.024 INFO:teuthology.orchestra.run.smithi057.stdout: criu x86_64 3.15-3.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 518 k 2023-03-02T10:43:01.024 INFO:teuthology.orchestra.run.smithi057.stdout: fuse-overlayfs x86_64 1.9-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 73 k 2023-03-02T10:43:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: libslirp x86_64 4.4.0-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 70 k 2023-03-02T10:43:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: runc x86_64 1:1.1.3-3.module+el8.6.0+16986+c8760fe3 rhel-8-for-x86_64-appstream-rpms 3.0 M 2023-03-02T10:43:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: slirp4netns x86_64 1.2.0-2.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-02T10:43:01.025 INFO:teuthology.orchestra.run.smithi057.stdout:Installing group/module packages: 2023-03-02T10:43:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-03-02T10:43:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-03-02T10:43:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-03-02T10:43:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-03-02T10:43:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-03-02T10:43:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-03-02T10:43:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-03-02T10:43:01.026 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-03-02T10:43:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-03-02T10:43:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-03-02T10:43:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-03-02T10:43:01.027 INFO:teuthology.orchestra.run.smithi057.stdout:Installing module profiles: 2023-03-02T10:43:01.027 INFO:teuthology.orchestra.run.smithi057.stdout: container-tools/common 2023-03-02T10:43:01.027 INFO:teuthology.orchestra.run.smithi057.stdout:Enabling module streams: 2023-03-02T10:43:01.027 INFO:teuthology.orchestra.run.smithi057.stdout: container-tools rhel8 2023-03-02T10:43:01.027 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:43:01.027 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-03-02T10:43:01.027 INFO:teuthology.orchestra.run.smithi057.stdout:========================================================================================================================= 2023-03-02T10:43:01.027 INFO:teuthology.orchestra.run.smithi057.stdout:Install 10 Packages 2023-03-02T10:43:01.028 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 9 Packages 2023-03-02T10:43:01.028 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:43:01.028 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 40 M 2023-03-02T10:43:01.028 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-03-02T10:43:01.101 INFO:teuthology.orchestra.run.smithi057.stdout:(1/19): yajl-2.1.0-10.el8.x86_64.rpm 564 kB/s | 41 kB 00:00 2023-03-02T10:43:01.126 INFO:teuthology.orchestra.run.smithi057.stdout:(2/19): python3-pytoml-0.1.14-5.git7dea353.el8. 255 kB/s | 25 kB 00:00 2023-03-02T10:43:01.144 INFO:teuthology.orchestra.run.smithi057.stdout:(3/19): udica-0.2.6-4.module+el8.6.0+16771+28df 1.1 MB/s | 49 kB 00:00 2023-03-02T10:43:01.169 INFO:teuthology.orchestra.run.smithi057.stdout:(4/19): python3-pyxdg-0.25-16.el8.noarch.rpm 670 kB/s | 94 kB 00:00 2023-03-02T10:43:01.189 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2023-03-02T10:43:01.193 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2023-03-02T10:43:01.211 INFO:teuthology.orchestra.run.smithi057.stdout:(5/19): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-03-02T10:43:01.236 INFO:teuthology.orchestra.run.smithi057.stdout:(6/19): python3-podman-4.0.1-1.module+el8.6.0+1 2.2 MB/s | 149 kB 00:00 2023-03-02T10:43:01.262 INFO:teuthology.orchestra.run.smithi057.stdout:(7/19): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-03-02T10:43:01.412 INFO:teuthology.orchestra.run.smithi057.stdout:(8/19): toolbox-0.0.99.3-0.6.module+el8.6.0+167 15 MB/s | 2.2 MB 00:00 2023-03-02T10:43:01.445 INFO:teuthology.orchestra.run.smithi057.stdout:(9/19): conmon-2.1.3-1.module+el8.6.0+16771+28d 1.7 MB/s | 56 kB 00:00 2023-03-02T10:43:01.479 INFO:teuthology.orchestra.run.smithi057.stdout:(10/19): slirp4netns-1.2.0-2.module+el8.6.0+167 1.6 MB/s | 54 kB 00:00 2023-03-02T10:43:01.680 INFO:teuthology.orchestra.run.smithi057.stdout:(11/19): skopeo-1.9.1-1.module+el8.6.0+16771+28 16 MB/s | 7.0 MB 00:00 2023-03-02T10:43:01.780 INFO:teuthology.orchestra.run.smithi057.stdout:(12/19): buildah-1.26.2-1.module+el8.6.0+16771+ 13 MB/s | 8.0 MB 00:00 2023-03-02T10:43:01.805 INFO:teuthology.orchestra.run.smithi057.stdout:(13/19): containers-common-1-39.module+el8.6.0+ 877 kB/s | 109 kB 00:00 2023-03-02T10:43:01.830 INFO:teuthology.orchestra.run.smithi057.stdout:(14/19): libslirp-4.4.0-1.module+el8.6.0+16771+ 1.4 MB/s | 70 kB 00:00 2023-03-02T10:43:01.872 INFO:teuthology.orchestra.run.smithi057.stdout:(15/19): container-selinux-2.189.0-1.module+el8 1.4 MB/s | 59 kB 00:00 2023-03-02T10:43:01.897 INFO:teuthology.orchestra.run.smithi057.stdout:(16/19): criu-3.15-3.module+el8.6.0+16771+28dfc 5.5 MB/s | 518 kB 00:00 2023-03-02T10:43:01.939 INFO:teuthology.orchestra.run.smithi057.stdout:(17/19): fuse-overlayfs-1.9-1.module+el8.6.0+16 1.7 MB/s | 73 kB 00:00 2023-03-02T10:43:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2023-03-02T10:43:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771+2 1/1 2023-03-02T10:43:02.011 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771 1/28 2023-03-02T10:43:02.048 INFO:teuthology.orchestra.run.smithi057.stdout:(18/19): runc-1.1.3-3.module+el8.6.0+16986+c876 17 MB/s | 3.0 MB 00:00 2023-03-02T10:43:02.210 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : container-selinux-2:2.189.0-1.module+el8.6.0+16771 1/28 2023-03-02T10:43:02.225 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2023-03-02T10:43:02.237 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771+2 1/1 2023-03-02T10:43:02.289 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771 1/28 2023-03-02T10:43:02.398 INFO:teuthology.orchestra.run.smithi057.stdout:(19/19): containernetworking-plugins-1.1.1-3.mo 20 MB/s | 18 MB 00:00 2023-03-02T10:43:02.399 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-03-02T10:43:02.399 INFO:teuthology.orchestra.run.smithi057.stdout:Total 29 MB/s | 40 MB 00:01 2023-03-02T10:43:02.498 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : container-selinux-2:2.189.0-1.module+el8.6.0+16771 1/28 2023-03-02T10:43:03.518 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-03-02T10:43:03.574 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-03-02T10:43:03.574 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-03-02T10:43:04.326 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-03-02T10:43:04.331 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-03-02T10:43:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-03-02T10:43:05.509 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771+2 1/1 2023-03-02T10:43:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771 1/28 2023-03-02T10:43:05.810 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : container-selinux-2:2.189.0-1.module+el8.6.0+16771 1/28 2023-03-02T10:43:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771 1/28 2023-03-02T10:43:19.291 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77 2/28 2023-03-02T10:43:19.364 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77 2/28 2023-03-02T10:43:19.508 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771 1/28 2023-03-02T10:43:19.753 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77 2/28 2023-03-02T10:43:19.822 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77 2/28 2023-03-02T10:43:19.988 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : criu-3.15-3.module+el8.6.0+16771+28dfca77.x86_64 3/28 2023-03-02T10:43:20.199 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : runc-1:1.1.3-3.module+el8.6.0+16986+c8760fe3.x86_6 4/28 2023-03-02T10:43:20.338 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : criu-3.15-3.module+el8.6.0+16771+28dfca77.x86_64 3/28 2023-03-02T10:43:20.409 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : libslirp-4.4.0-1.module+el8.6.0+16771+28dfca77.x86 5/28 2023-03-02T10:43:20.594 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : runc-1:1.1.3-3.module+el8.6.0+16986+c8760fe3.x86_6 4/28 2023-03-02T10:43:20.783 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libslirp-4.4.0-1.module+el8.6.0+16771+28dfca77.x86 5/28 2023-03-02T10:43:22.151 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : slirp4netns-1.2.0-2.module+el8.6.0+16771+28dfca77. 6/28 2023-03-02T10:43:22.415 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : containernetworking-plugins-1:1.1.1-3.module+el8.6 7/28 2023-03-02T10:43:22.578 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : slirp4netns-1.2.0-2.module+el8.6.0+16771+28dfca77. 6/28 2023-03-02T10:43:22.629 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/28 2023-03-02T10:43:22.783 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : yajl-2.1.0-10.el8.x86_64 9/28 2023-03-02T10:43:22.819 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : containernetworking-plugins-1:1.1.1-3.module+el8.6 7/28 2023-03-02T10:43:22.969 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 10/28 2023-03-02T10:43:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : containers-common-2:1-39.module+el8.6.0+16891+aaa3 11/28 2023-03-02T10:43:22.970 INFO:teuthology.orchestra.run.smithi122.stdout:warning: /etc/containers/registries.conf created as /etc/containers/registries.conf.rpmnew 2023-03-02T10:43:22.970 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:43:23.024 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/28 2023-03-02T10:43:23.172 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : yajl-2.1.0-10.el8.x86_64 9/28 2023-03-02T10:43:23.390 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 10/28 2023-03-02T10:43:23.390 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : containers-common-2:1-39.module+el8.6.0+16891+aaa3 11/28 2023-03-02T10:43:23.390 INFO:teuthology.orchestra.run.smithi136.stdout:warning: /etc/containers/registries.conf created as /etc/containers/registries.conf.rpmnew 2023-03-02T10:43:23.390 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:43:23.442 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 12/28 2023-03-02T10:43:23.871 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 12/28 2023-03-02T10:43:24.300 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 13/28 2023-03-02T10:43:24.732 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 13/28 2023-03-02T10:43:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 14/28 2023-03-02T10:43:25.480 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 15/28 2023-03-02T10:43:25.524 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 14/28 2023-03-02T10:43:25.702 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 16/28 2023-03-02T10:43:25.895 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 17/28 2023-03-02T10:43:25.933 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 15/28 2023-03-02T10:43:26.134 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : conmon-2:2.1.3-1.module+el8.6.0+16771+28dfca77.x86 18/28 2023-03-02T10:43:26.155 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 16/28 2023-03-02T10:43:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 19/28 2023-03-02T10:43:26.361 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 17/28 2023-03-02T10:43:26.449 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : containers-common-2:1-27.module+el8.6.0+14877+f643 20/28 2023-03-02T10:43:26.565 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771 1/28 2023-03-02T10:43:26.576 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : conmon-2:2.1.3-1.module+el8.6.0+16771+28dfca77.x86 18/28 2023-03-02T10:43:26.617 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 21/28 2023-03-02T10:43:26.741 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 22/28 2023-03-02T10:43:26.741 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2023-03-02T10:43:26.756 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77 2/28 2023-03-02T10:43:26.768 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 19/28 2023-03-02T10:43:26.874 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77 2/28 2023-03-02T10:43:26.883 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2023-03-02T10:43:26.940 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : containers-common-2:1-27.module+el8.6.0+14877+f643 20/28 2023-03-02T10:43:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 24/28 2023-03-02T10:43:27.079 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 21/28 2023-03-02T10:43:27.208 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 25/28 2023-03-02T10:43:27.227 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 22/28 2023-03-02T10:43:27.227 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2023-03-02T10:43:27.346 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 26/28 2023-03-02T10:43:27.436 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2023-03-02T10:43:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : containernetworking-plugins-1:1.0.1-2.module+el8.6 27/28 2023-03-02T10:43:27.546 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : criu-3.15-3.module+el8.6.0+16771+28dfca77.x86_64 3/28 2023-03-02T10:43:27.607 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 24/28 2023-03-02T10:43:27.657 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2023-03-02T10:43:27.752 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 25/28 2023-03-02T10:43:27.753 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : runc-1:1.1.3-3.module+el8.6.0+16986+c8760fe3.x86_6 4/28 2023-03-02T10:43:27.900 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 26/28 2023-03-02T10:43:27.925 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libslirp-4.4.0-1.module+el8.6.0+16771+28dfca77.x86 5/28 2023-03-02T10:43:28.101 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : containernetworking-plugins-1:1.0.1-2.module+el8.6 27/28 2023-03-02T10:43:28.243 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2023-03-02T10:43:29.996 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : slirp4netns-1.2.0-2.module+el8.6.0+16771+28dfca77. 6/28 2023-03-02T10:43:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : containernetworking-plugins-1:1.1.1-3.module+el8.6 7/28 2023-03-02T10:43:30.381 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/28 2023-03-02T10:43:30.545 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : yajl-2.1.0-10.el8.x86_64 9/28 2023-03-02T10:43:30.752 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 10/28 2023-03-02T10:43:30.752 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : containers-common-2:1-39.module+el8.6.0+16891+aaa3 11/28 2023-03-02T10:43:30.752 INFO:teuthology.orchestra.run.smithi057.stdout:warning: /etc/containers/registries.conf created as /etc/containers/registries.conf.rpmnew 2023-03-02T10:43:30.752 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:43:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 12/28 2023-03-02T10:43:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 13/28 2023-03-02T10:43:33.338 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 14/28 2023-03-02T10:43:33.774 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 15/28 2023-03-02T10:43:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 16/28 2023-03-02T10:43:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 17/28 2023-03-02T10:43:34.409 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : conmon-2:2.1.3-1.module+el8.6.0+16771+28dfca77.x86 18/28 2023-03-02T10:43:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 19/28 2023-03-02T10:43:34.761 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : containers-common-2:1-27.module+el8.6.0+14877+f643 20/28 2023-03-02T10:43:34.924 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 21/28 2023-03-02T10:43:35.082 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 22/28 2023-03-02T10:43:35.082 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2023-03-02T10:43:35.283 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: container-selinux-2:2.179.1-1.module+el8.6.0+14877 23/28 2023-03-02T10:43:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 24/28 2023-03-02T10:43:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 25/28 2023-03-02T10:43:35.773 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 26/28 2023-03-02T10:43:35.948 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : containernetworking-plugins-1:1.0.1-2.module+el8.6 27/28 2023-03-02T10:43:36.098 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2023-03-02T10:43:46.099 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771 28/28 2023-03-02T10:43:46.263 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771 28/28 2023-03-02T10:43:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2023-03-02T10:43:46.364 INFO:teuthology.orchestra.run.smithi122.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-02T10:43:46.364 INFO:teuthology.orchestra.run.smithi122.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-02T10:43:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:43:46.509 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2023-03-02T10:43:46.509 INFO:teuthology.orchestra.run.smithi136.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-02T10:43:46.510 INFO:teuthology.orchestra.run.smithi136.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-02T10:43:46.510 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:43:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/28 2023-03-02T10:43:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/28 2023-03-02T10:43:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/28 2023-03-02T10:43:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/28 2023-03-02T10:43:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/28 2023-03-02T10:43:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/28 2023-03-02T10:43:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/28 2023-03-02T10:43:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/28 2023-03-02T10:43:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/28 2023-03-02T10:43:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/28 2023-03-02T10:43:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : conmon-2:2.1.3-1.module+el8.6.0+16771+28dfca77.x86 11/28 2023-03-02T10:43:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 12/28 2023-03-02T10:43:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : slirp4netns-1.2.0-2.module+el8.6.0+16771+28dfca77. 13/28 2023-03-02T10:43:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 14/28 2023-03-02T10:43:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module+el8.6 15/28 2023-03-02T10:43:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : containernetworking-plugins-1:1.0.1-2.module+el8.6 16/28 2023-03-02T10:43:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : containers-common-2:1-39.module+el8.6.0+16891+aaa3 17/28 2023-03-02T10:43:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : containers-common-2:1-27.module+el8.6.0+14877+f643 18/28 2023-03-02T10:43:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+16771+28dfca77.x86 19/28 2023-03-02T10:43:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 20/28 2023-03-02T10:43:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : criu-3.15-3.module+el8.6.0+16771+28dfca77.x86_64 21/28 2023-03-02T10:43:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 22/28 2023-03-02T10:43:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : container-selinux-2:2.189.0-1.module+el8.6.0+16771 23/28 2023-03-02T10:43:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : container-selinux-2:2.179.1-1.module+el8.6.0+14877 24/28 2023-03-02T10:43:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : runc-1:1.1.3-3.module+el8.6.0+16986+c8760fe3.x86_6 25/28 2023-03-02T10:43:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 26/28 2023-03-02T10:43:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77 27/28 2023-03-02T10:43:46.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/28 2023-03-02T10:43:46.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/28 2023-03-02T10:43:46.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/28 2023-03-02T10:43:46.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/28 2023-03-02T10:43:46.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/28 2023-03-02T10:43:46.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/28 2023-03-02T10:43:46.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/28 2023-03-02T10:43:46.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/28 2023-03-02T10:43:46.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/28 2023-03-02T10:43:46.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/28 2023-03-02T10:43:46.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : conmon-2:2.1.3-1.module+el8.6.0+16771+28dfca77.x86 11/28 2023-03-02T10:43:46.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 12/28 2023-03-02T10:43:46.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : slirp4netns-1.2.0-2.module+el8.6.0+16771+28dfca77. 13/28 2023-03-02T10:43:46.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 14/28 2023-03-02T10:43:46.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module+el8.6 15/28 2023-03-02T10:43:46.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : containernetworking-plugins-1:1.0.1-2.module+el8.6 16/28 2023-03-02T10:43:46.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : containers-common-2:1-39.module+el8.6.0+16891+aaa3 17/28 2023-03-02T10:43:46.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : containers-common-2:1-27.module+el8.6.0+14877+f643 18/28 2023-03-02T10:43:46.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+16771+28dfca77.x86 19/28 2023-03-02T10:43:46.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 20/28 2023-03-02T10:43:46.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : criu-3.15-3.module+el8.6.0+16771+28dfca77.x86_64 21/28 2023-03-02T10:43:46.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 22/28 2023-03-02T10:43:46.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : container-selinux-2:2.189.0-1.module+el8.6.0+16771 23/28 2023-03-02T10:43:46.686 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : container-selinux-2:2.179.1-1.module+el8.6.0+14877 24/28 2023-03-02T10:43:46.687 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : runc-1:1.1.3-3.module+el8.6.0+16986+c8760fe3.x86_6 25/28 2023-03-02T10:43:46.688 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 26/28 2023-03-02T10:43:46.688 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77 27/28 2023-03-02T10:43:47.977 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 28/28 2023-03-02T10:43:47.977 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:07:18 ago on Thu 02 Mar 2023 10:36:29 AM UTC. 2023-03-02T10:43:48.123 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 28/28 2023-03-02T10:43:48.123 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:07:18 ago on Thu 02 Mar 2023 10:36:29 AM UTC. 2023-03-02T10:43:50.877 INFO:teuthology.orchestra.run.smithi122.stdout:Installed products updated. 2023-03-02T10:43:51.071 INFO:teuthology.orchestra.run.smithi136.stdout:Installed products updated. 2023-03-02T10:43:51.153 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:43:51.153 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2023-03-02T10:43:51.153 INFO:teuthology.orchestra.run.smithi122.stdout: conmon-2:2.1.3-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.153 INFO:teuthology.orchestra.run.smithi122.stdout: container-selinux-2:2.189.0-1.module+el8.6.0+16771+28dfca77.noarch 2023-03-02T10:43:51.153 INFO:teuthology.orchestra.run.smithi122.stdout: containernetworking-plugins-1:1.1.1-3.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.154 INFO:teuthology.orchestra.run.smithi122.stdout: containers-common-2:1-39.module+el8.6.0+16891+aaa3bd4c.x86_64 2023-03-02T10:43:51.154 INFO:teuthology.orchestra.run.smithi122.stdout: criu-3.15-3.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.154 INFO:teuthology.orchestra.run.smithi122.stdout: fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.154 INFO:teuthology.orchestra.run.smithi122.stdout: libslirp-4.4.0-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.154 INFO:teuthology.orchestra.run.smithi122.stdout: runc-1:1.1.3-3.module+el8.6.0+16986+c8760fe3.x86_64 2023-03-02T10:43:51.154 INFO:teuthology.orchestra.run.smithi122.stdout: slirp4netns-1.2.0-2.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.155 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2023-03-02T10:43:51.155 INFO:teuthology.orchestra.run.smithi122.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.155 INFO:teuthology.orchestra.run.smithi122.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-03-02T10:43:51.156 INFO:teuthology.orchestra.run.smithi122.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-03-02T10:43:51.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-03-02T10:43:51.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-03-02T10:43:51.157 INFO:teuthology.orchestra.run.smithi122.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.157 INFO:teuthology.orchestra.run.smithi122.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.157 INFO:teuthology.orchestra.run.smithi122.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-03-02T10:43:51.157 INFO:teuthology.orchestra.run.smithi122.stdout: yajl-2.1.0-10.el8.x86_64 2023-03-02T10:43:51.158 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:43:51.158 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2023-03-02T10:43:51.293 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:43:51.294 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2023-03-02T10:43:51.294 INFO:teuthology.orchestra.run.smithi136.stdout: conmon-2:2.1.3-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.294 INFO:teuthology.orchestra.run.smithi136.stdout: container-selinux-2:2.189.0-1.module+el8.6.0+16771+28dfca77.noarch 2023-03-02T10:43:51.294 INFO:teuthology.orchestra.run.smithi136.stdout: containernetworking-plugins-1:1.1.1-3.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.295 INFO:teuthology.orchestra.run.smithi136.stdout: containers-common-2:1-39.module+el8.6.0+16891+aaa3bd4c.x86_64 2023-03-02T10:43:51.295 INFO:teuthology.orchestra.run.smithi136.stdout: criu-3.15-3.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.295 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.296 INFO:teuthology.orchestra.run.smithi136.stdout: libslirp-4.4.0-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.296 INFO:teuthology.orchestra.run.smithi136.stdout: runc-1:1.1.3-3.module+el8.6.0+16986+c8760fe3.x86_64 2023-03-02T10:43:51.296 INFO:teuthology.orchestra.run.smithi136.stdout: slirp4netns-1.2.0-2.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.297 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2023-03-02T10:43:51.297 INFO:teuthology.orchestra.run.smithi136.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.297 INFO:teuthology.orchestra.run.smithi136.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-03-02T10:43:51.298 INFO:teuthology.orchestra.run.smithi136.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.298 INFO:teuthology.orchestra.run.smithi136.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-03-02T10:43:51.298 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-03-02T10:43:51.299 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-03-02T10:43:51.299 INFO:teuthology.orchestra.run.smithi136.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.299 INFO:teuthology.orchestra.run.smithi136.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:43:51.299 INFO:teuthology.orchestra.run.smithi136.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-03-02T10:43:51.300 INFO:teuthology.orchestra.run.smithi136.stdout: yajl-2.1.0-10.el8.x86_64 2023-03-02T10:43:51.300 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:43:51.300 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2023-03-02T10:43:51.327 DEBUG:teuthology.parallel:result is None 2023-03-02T10:43:51.468 DEBUG:teuthology.parallel:result is None 2023-03-02T10:44:00.040 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module+el8.6.0+16771 28/28 2023-03-02T10:44:00.681 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 28/28 2023-03-02T10:44:00.682 INFO:teuthology.orchestra.run.smithi057.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-02T10:44:00.682 INFO:teuthology.orchestra.run.smithi057.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-02T10:44:00.682 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:44:01.001 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/28 2023-03-02T10:44:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/28 2023-03-02T10:44:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/28 2023-03-02T10:44:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/28 2023-03-02T10:44:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/28 2023-03-02T10:44:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/28 2023-03-02T10:44:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/28 2023-03-02T10:44:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/28 2023-03-02T10:44:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/28 2023-03-02T10:44:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/28 2023-03-02T10:44:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : conmon-2:2.1.3-1.module+el8.6.0+16771+28dfca77.x86 11/28 2023-03-02T10:44:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : conmon-2:2.1.0-1.module+el8.6.0+14877+f643d2d6.x86 12/28 2023-03-02T10:44:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : slirp4netns-1.2.0-2.module+el8.6.0+16771+28dfca77. 13/28 2023-03-02T10:44:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : slirp4netns-1.1.8-2.module+el8.6.0+14877+f643d2d6. 14/28 2023-03-02T10:44:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module+el8.6 15/28 2023-03-02T10:44:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : containernetworking-plugins-1:1.0.1-2.module+el8.6 16/28 2023-03-02T10:44:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : containers-common-2:1-39.module+el8.6.0+16891+aaa3 17/28 2023-03-02T10:44:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : containers-common-2:1-27.module+el8.6.0+14877+f643 18/28 2023-03-02T10:44:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+16771+28dfca77.x86 19/28 2023-03-02T10:44:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libslirp-4.4.0-1.module+el8.6.0+14877+f643d2d6.x86 20/28 2023-03-02T10:44:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : criu-3.15-3.module+el8.6.0+16771+28dfca77.x86_64 21/28 2023-03-02T10:44:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : criu-3.15-3.module+el8.6.0+14877+f643d2d6.x86_64 22/28 2023-03-02T10:44:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : container-selinux-2:2.189.0-1.module+el8.6.0+16771 23/28 2023-03-02T10:44:01.005 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : container-selinux-2:2.179.1-1.module+el8.6.0+14877 24/28 2023-03-02T10:44:01.005 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : runc-1:1.1.3-3.module+el8.6.0+16986+c8760fe3.x86_6 25/28 2023-03-02T10:44:01.005 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : runc-1:1.0.3-2.module+el8.6.0+14877+f643d2d6.x86_6 26/28 2023-03-02T10:44:01.005 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77 27/28 2023-03-02T10:44:03.225 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-overlayfs-1.8.2-1.module+el8.6.0+14877+f643d2 28/28 2023-03-02T10:44:03.226 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:03:19 ago on Thu 02 Mar 2023 10:40:43 AM UTC. 2023-03-02T10:44:06.042 INFO:teuthology.orchestra.run.smithi057.stdout:Installed products updated. 2023-03-02T10:44:06.263 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:44:06.263 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2023-03-02T10:44:06.263 INFO:teuthology.orchestra.run.smithi057.stdout: conmon-2:2.1.3-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:44:06.263 INFO:teuthology.orchestra.run.smithi057.stdout: container-selinux-2:2.189.0-1.module+el8.6.0+16771+28dfca77.noarch 2023-03-02T10:44:06.264 INFO:teuthology.orchestra.run.smithi057.stdout: containernetworking-plugins-1:1.1.1-3.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:44:06.264 INFO:teuthology.orchestra.run.smithi057.stdout: containers-common-2:1-39.module+el8.6.0+16891+aaa3bd4c.x86_64 2023-03-02T10:44:06.264 INFO:teuthology.orchestra.run.smithi057.stdout: criu-3.15-3.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:44:06.264 INFO:teuthology.orchestra.run.smithi057.stdout: fuse-overlayfs-1.9-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:44:06.264 INFO:teuthology.orchestra.run.smithi057.stdout: libslirp-4.4.0-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:44:06.264 INFO:teuthology.orchestra.run.smithi057.stdout: runc-1:1.1.3-3.module+el8.6.0+16986+c8760fe3.x86_64 2023-03-02T10:44:06.264 INFO:teuthology.orchestra.run.smithi057.stdout: slirp4netns-1.2.0-2.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:44:06.265 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-03-02T10:44:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:44:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-03-02T10:44:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:44:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-03-02T10:44:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-03-02T10:44:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-03-02T10:44:06.266 INFO:teuthology.orchestra.run.smithi057.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:44:06.266 INFO:teuthology.orchestra.run.smithi057.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-03-02T10:44:06.266 INFO:teuthology.orchestra.run.smithi057.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-03-02T10:44:06.266 INFO:teuthology.orchestra.run.smithi057.stdout: yajl-2.1.0-10.el8.x86_64 2023-03-02T10:44:06.266 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:44:06.266 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-03-02T10:44:06.631 DEBUG:teuthology.parallel:result is None 2023-03-02T10:44:06.632 INFO:teuthology.run_tasks:Running task install... 2023-03-02T10:44:06.640 DEBUG:teuthology.task.install:project ceph 2023-03-02T10:44:06.641 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '802de851643c97960b33dacc1e3ce8486e6d7d3c'}} 2023-03-02T10:44:06.641 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '802de851643c97960b33dacc1e3ce8486e6d7d3c'} 2023-03-02T10:44:06.641 INFO:teuthology.task.install:Using flavor: default 2023-03-02T10:44:06.647 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-03-02T10:44:06.648 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-03-02T10:44:06.648 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '802de851643c97960b33dacc1e3ce8486e6d7d3c', 'tag': None, 'wait_for_package': False} 2023-03-02T10:44:06.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=802de851643c97960b33dacc1e3ce8486e6d7d3c 2023-03-02T10:44:06.652 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '802de851643c97960b33dacc1e3ce8486e6d7d3c', 'tag': None, 'wait_for_package': False} 2023-03-02T10:44:06.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=802de851643c97960b33dacc1e3ce8486e6d7d3c 2023-03-02T10:44:06.654 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '802de851643c97960b33dacc1e3ce8486e6d7d3c', 'tag': None, 'wait_for_package': False} 2023-03-02T10:44:06.655 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=802de851643c97960b33dacc1e3ce8486e6d7d3c 2023-03-02T10:44:06.825 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/ 2023-03-02T10:44:06.825 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2462.g802de851 2023-03-02T10:44:06.840 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/ 2023-03-02T10:44:06.840 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2462.g802de851 2023-03-02T10:44:06.841 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/ 2023-03-02T10:44:06.842 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2462.g802de851 2023-03-02T10:44:06.943 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-02T10:44:06.943 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:44:06.944 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-02T10:44:06.948 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-02T10:44:06.949 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-02T10:44:06.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-02T10:44:06.954 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-02T10:44:06.955 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-03-02T10:44:06.955 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-02T10:44:06.984 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-02T10:44:06.985 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/802de851643c97960b33dacc1e3ce8486e6d7d3c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-02T10:44:06.990 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-02T10:44:06.991 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/802de851643c97960b33dacc1e3ce8486e6d7d3c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-02T10:44:07.043 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-02T10:44:07.044 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/802de851643c97960b33dacc1e3ce8486e6d7d3c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-02T10:44:07.056 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-02T10:44:07.065 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-02T10:44:07.138 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-02T10:44:07.150 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-02T10:44:07.182 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2023-03-02T10:44:07.183 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2023-03-02T10:44:07.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-02T10:44:07.206 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2023-03-02T10:44:07.207 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2023-03-02T10:44:07.319 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-02T10:44:07.416 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2023-03-02T10:44:07.421 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2023-03-02T10:44:07.576 INFO:teuthology.orchestra.run.smithi122.stdout:Updating Subscription Management repositories. 2023-03-02T10:44:07.579 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-03-02T10:44:07.834 INFO:teuthology.orchestra.run.smithi122.stdout:44 files removed 2023-03-02T10:44:07.843 INFO:teuthology.orchestra.run.smithi136.stdout:44 files removed 2023-03-02T10:44:07.880 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-02T10:44:07.890 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-02T10:44:07.969 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-03-02T10:44:08.210 INFO:teuthology.orchestra.run.smithi122.stdout:Updating Subscription Management repositories. 2023-03-02T10:44:08.222 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-03-02T10:44:08.304 INFO:teuthology.orchestra.run.smithi057.stdout:44 files removed 2023-03-02T10:44:08.378 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-02T10:44:08.820 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 319 kB/s | 80 kB 00:00 2023-03-02T10:44:08.842 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 312 kB/s | 80 kB 00:00 2023-03-02T10:44:08.923 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-03-02T10:44:09.096 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 38 kB/s | 9.3 kB 00:00 2023-03-02T10:44:09.109 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 40 kB/s | 9.3 kB 00:00 2023-03-02T10:44:09.355 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 6.2 kB/s | 1.5 kB 00:00 2023-03-02T10:44:09.368 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 6.3 kB/s | 1.5 kB 00:00 2023-03-02T10:44:09.670 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 308 kB/s | 80 kB 00:00 2023-03-02T10:44:09.946 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 39 kB/s | 9.3 kB 00:00 2023-03-02T10:44:10.205 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 6.4 kB/s | 1.5 kB 00:00 2023-03-02T10:44:11.702 INFO:teuthology.orchestra.run.smithi136.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-03-02T10:44:11.705 INFO:teuthology.orchestra.run.smithi122.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-03-02T10:44:12.497 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-03-02T10:44:13.060 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 10 MB/s | 14 MB 00:01 2023-03-02T10:44:13.302 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 8.7 MB/s | 14 MB 00:01 2023-03-02T10:44:14.039 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 14 MB 00:01 2023-03-02T10:44:16.094 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 520 kB/s | 24 kB 00:00 2023-03-02T10:44:16.331 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 434 kB/s | 24 kB 00:00 2023-03-02T10:44:17.012 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-03-02T10:44:17.208 INFO:teuthology.orchestra.run.smithi122.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-03-02T10:44:18.222 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 523 kB/s | 24 kB 00:00 2023-03-02T10:44:19.465 INFO:teuthology.orchestra.run.smithi057.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 45 MB/s | 53 MB 00:01 2023-03-02T10:44:25.085 INFO:teuthology.orchestra.run.smithi122.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-03-02T10:44:25.138 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-03-02T10:44:28.941 INFO:teuthology.orchestra.run.smithi057.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 MB/s | 47 MB 00:01 2023-03-02T10:44:36.025 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-02T10:44:36.025 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-02T10:44:36.040 INFO:teuthology.orchestra.run.smithi122.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-02T10:44:36.040 INFO:teuthology.orchestra.run.smithi122.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-02T10:44:36.042 INFO:teuthology.orchestra.run.smithi122.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-02T10:44:36.043 INFO:teuthology.orchestra.run.smithi122.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-02T10:44:36.045 INFO:teuthology.orchestra.run.smithi122.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-02T10:44:36.048 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-02T10:44:36.049 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-02T10:44:36.087 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-02T10:44:36.088 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-02T10:44:36.102 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-02T10:44:36.103 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-02T10:44:36.105 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-02T10:44:36.106 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-02T10:44:36.108 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-02T10:44:36.111 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-02T10:44:36.112 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-02T10:44:36.182 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2023-03-02T10:44:36.194 INFO:teuthology.orchestra.run.smithi122.stdout:=========================================================================================================================== 2023-03-02T10:44:36.194 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2023-03-02T10:44:36.195 INFO:teuthology.orchestra.run.smithi122.stdout:=========================================================================================================================== 2023-03-02T10:44:36.195 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2023-03-02T10:44:36.195 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-02T10:44:36.195 INFO:teuthology.orchestra.run.smithi122.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-02T10:44:36.196 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:18.0.0-2462.g802de851.el8 ceph 6.4 k 2023-03-02T10:44:36.196 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:18.0.0-2462.g802de851.el8 ceph 5.2 M 2023-03-02T10:44:36.196 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:18.0.0-2462.g802de851.el8 ceph 844 k 2023-03-02T10:44:36.196 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2462.g802de851.el8 ceph 165 k 2023-03-02T10:44:36.196 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:18.0.0-2462.g802de851.el8 ceph 1.5 M 2023-03-02T10:44:36.196 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 120 k 2023-03-02T10:44:36.196 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 1.7 M 2023-03-02T10:44:36.197 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 7.4 M 2023-03-02T10:44:36.197 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 47 k 2023-03-02T10:44:36.197 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:18.0.0-2462.g802de851.el8 ceph 13 M 2023-03-02T10:44:36.197 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:18.0.0-2462.g802de851.el8 ceph 48 M 2023-03-02T10:44:36.197 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 263 k 2023-03-02T10:44:36.197 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 82 k 2023-03-02T10:44:36.197 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror x86_64 2:18.0.0-2462.g802de851.el8 ceph 258 k 2023-03-02T10:44:36.198 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 18 k 2023-03-02T10:44:36.198 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-02T10:44:36.198 INFO:teuthology.orchestra.run.smithi122.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-02T10:44:36.198 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-02T10:44:36.199 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:18.0.0-2462.g802de851.el8 ceph 30 k 2023-03-02T10:44:36.199 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:18.0.0-2462.g802de851.el8 ceph 768 k 2023-03-02T10:44:36.199 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:18.0.0-2462.g802de851.el8 ceph 139 k 2023-03-02T10:44:36.199 INFO:teuthology.orchestra.run.smithi122.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-02T10:44:36.199 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-02T10:44:36.199 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-02T10:44:36.199 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-02T10:44:36.200 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-02T10:44:36.200 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-02T10:44:36.200 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:18.0.0-2462.g802de851.el8 ceph 190 k 2023-03-02T10:44:36.200 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:18.0.0-2462.g802de851.el8 ceph 371 k 2023-03-02T10:44:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:18.0.0-2462.g802de851.el8 ceph 365 k 2023-03-02T10:44:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:18.0.0-2462.g802de851.el8 ceph 107 k 2023-03-02T10:44:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:18.0.0-2462.g802de851.el8 ceph 94 k 2023-03-02T10:44:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.4 M 2023-03-02T10:44:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:18.0.0-2462.g802de851.el8 ceph 180 k 2023-03-02T10:44:36.201 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-02T10:44:36.202 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2023-03-02T10:44:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-02T10:44:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.6 M 2023-03-02T10:44:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.6 M 2023-03-02T10:44:36.202 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2023-03-02T10:44:36.202 INFO:teuthology.orchestra.run.smithi122.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-02T10:44:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:18.0.0-2462.g802de851.el8 ceph 24 M 2023-03-02T10:44:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 23 k 2023-03-02T10:44:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:18.0.0-2462.g802de851.el8 ceph 2.3 M 2023-03-02T10:44:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 236 k 2023-03-02T10:44:36.203 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.9 M 2023-03-02T10:44:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:18.0.0-2462.g802de851.el8 ceph 17 M 2023-03-02T10:44:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 15 k 2023-03-02T10:44:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:18.0.0-2462.g802de851.el8 ceph 24 k 2023-03-02T10:44:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-02T10:44:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-02T10:44:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-02T10:44:36.204 INFO:teuthology.orchestra.run.smithi122.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-02T10:44:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-02T10:44:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:18.0.0-2462.g802de851.el8 ceph 137 k 2023-03-02T10:44:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-02T10:44:36.205 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-02T10:44:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-02T10:44:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-02T10:44:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-02T10:44:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-02T10:44:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:18.0.0-2462.g802de851.el8 ceph 474 k 2023-03-02T10:44:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-02T10:44:36.206 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:18.0.0-2462.g802de851.el8 ceph 6.5 M 2023-03-02T10:44:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-02T10:44:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-02T10:44:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-02T10:44:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-02T10:44:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-02T10:44:36.207 INFO:teuthology.orchestra.run.smithi122.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-02T10:44:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-02T10:44:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-02T10:44:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-02T10:44:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-02T10:44:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-02T10:44:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-02T10:44:36.208 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-02T10:44:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-02T10:44:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-02T10:44:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-02T10:44:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:18.0.0-2462.g802de851.el8 ceph 45 k 2023-03-02T10:44:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:18.0.0-2462.g802de851.el8 ceph 117 k 2023-03-02T10:44:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-02T10:44:36.209 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-02T10:44:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-02T10:44:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-02T10:44:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-02T10:44:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-02T10:44:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-02T10:44:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-02T10:44:36.210 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-02T10:44:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-02T10:44:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-02T10:44:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-02T10:44:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-02T10:44:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-02T10:44:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-02T10:44:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-02T10:44:36.211 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-02T10:44:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-02T10:44:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-02T10:44:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-02T10:44:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-02T10:44:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-02T10:44:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-02T10:44:36.212 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-02T10:44:36.213 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-02T10:44:36.213 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-02T10:44:36.213 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-02T10:44:36.213 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-02T10:44:36.214 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-02T10:44:36.214 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-02T10:44:36.214 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-02T10:44:36.214 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-02T10:44:36.214 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-02T10:44:36.214 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-02T10:44:36.214 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-02T10:44:36.214 INFO:teuthology.orchestra.run.smithi122.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-02T10:44:36.215 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-02T10:44:36.215 INFO:teuthology.orchestra.run.smithi122.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-02T10:44:36.215 INFO:teuthology.orchestra.run.smithi122.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-02T10:44:36.215 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-02T10:44:36.215 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-02T10:44:36.215 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-02T10:44:36.215 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-02T10:44:36.216 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-02T10:44:36.216 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-02T10:44:36.216 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-02T10:44:36.216 INFO:teuthology.orchestra.run.smithi122.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-02T10:44:36.216 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-02T10:44:36.216 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-02T10:44:36.217 INFO:teuthology.orchestra.run.smithi122.stdout:Enabling module streams: 2023-03-02T10:44:36.217 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql 10 2023-03-02T10:44:36.217 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:44:36.217 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2023-03-02T10:44:36.217 INFO:teuthology.orchestra.run.smithi122.stdout:=========================================================================================================================== 2023-03-02T10:44:36.217 INFO:teuthology.orchestra.run.smithi122.stdout:Install 128 Packages 2023-03-02T10:44:36.217 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 3 Packages 2023-03-02T10:44:36.218 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:44:36.219 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 205 M 2023-03-02T10:44:36.219 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2023-03-02T10:44:36.244 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2023-03-02T10:44:36.257 INFO:teuthology.orchestra.run.smithi136.stdout:=========================================================================================================================== 2023-03-02T10:44:36.257 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2023-03-02T10:44:36.258 INFO:teuthology.orchestra.run.smithi136.stdout:=========================================================================================================================== 2023-03-02T10:44:36.258 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2023-03-02T10:44:36.258 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-02T10:44:36.259 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-02T10:44:36.259 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:18.0.0-2462.g802de851.el8 ceph 6.4 k 2023-03-02T10:44:36.259 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:18.0.0-2462.g802de851.el8 ceph 5.2 M 2023-03-02T10:44:36.259 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:18.0.0-2462.g802de851.el8 ceph 844 k 2023-03-02T10:44:36.260 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2462.g802de851.el8 ceph 165 k 2023-03-02T10:44:36.260 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:18.0.0-2462.g802de851.el8 ceph 1.5 M 2023-03-02T10:44:36.260 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 120 k 2023-03-02T10:44:36.261 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 1.7 M 2023-03-02T10:44:36.261 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 7.4 M 2023-03-02T10:44:36.261 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 47 k 2023-03-02T10:44:36.261 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:18.0.0-2462.g802de851.el8 ceph 13 M 2023-03-02T10:44:36.262 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:18.0.0-2462.g802de851.el8 ceph 48 M 2023-03-02T10:44:36.262 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 263 k 2023-03-02T10:44:36.262 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 82 k 2023-03-02T10:44:36.262 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:18.0.0-2462.g802de851.el8 ceph 258 k 2023-03-02T10:44:36.263 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 18 k 2023-03-02T10:44:36.263 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-02T10:44:36.263 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-02T10:44:36.264 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-02T10:44:36.264 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:18.0.0-2462.g802de851.el8 ceph 30 k 2023-03-02T10:44:36.264 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:18.0.0-2462.g802de851.el8 ceph 768 k 2023-03-02T10:44:36.264 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:18.0.0-2462.g802de851.el8 ceph 139 k 2023-03-02T10:44:36.265 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-02T10:44:36.265 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-02T10:44:36.265 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-02T10:44:36.266 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-02T10:44:36.266 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-02T10:44:36.266 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-02T10:44:36.266 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:18.0.0-2462.g802de851.el8 ceph 190 k 2023-03-02T10:44:36.267 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:18.0.0-2462.g802de851.el8 ceph 371 k 2023-03-02T10:44:36.267 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:18.0.0-2462.g802de851.el8 ceph 365 k 2023-03-02T10:44:36.267 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:18.0.0-2462.g802de851.el8 ceph 107 k 2023-03-02T10:44:36.267 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:18.0.0-2462.g802de851.el8 ceph 94 k 2023-03-02T10:44:36.267 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.4 M 2023-03-02T10:44:36.267 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:18.0.0-2462.g802de851.el8 ceph 180 k 2023-03-02T10:44:36.268 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-02T10:44:36.268 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2023-03-02T10:44:36.268 INFO:teuthology.orchestra.run.smithi136.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-02T10:44:36.268 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.6 M 2023-03-02T10:44:36.268 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.6 M 2023-03-02T10:44:36.268 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2023-03-02T10:44:36.269 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-02T10:44:36.269 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:18.0.0-2462.g802de851.el8 ceph 24 M 2023-03-02T10:44:36.269 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 23 k 2023-03-02T10:44:36.269 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:18.0.0-2462.g802de851.el8 ceph 2.3 M 2023-03-02T10:44:36.270 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 236 k 2023-03-02T10:44:36.270 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.9 M 2023-03-02T10:44:36.270 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:18.0.0-2462.g802de851.el8 ceph 17 M 2023-03-02T10:44:36.270 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 15 k 2023-03-02T10:44:36.271 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:18.0.0-2462.g802de851.el8 ceph 24 k 2023-03-02T10:44:36.271 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-02T10:44:36.271 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-02T10:44:36.272 INFO:teuthology.orchestra.run.smithi136.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-02T10:44:36.272 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-02T10:44:36.272 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-02T10:44:36.272 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:18.0.0-2462.g802de851.el8 ceph 137 k 2023-03-02T10:44:36.273 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-02T10:44:36.273 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-02T10:44:36.273 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-02T10:44:36.273 INFO:teuthology.orchestra.run.smithi136.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-02T10:44:36.274 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-02T10:44:36.274 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-02T10:44:36.274 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:18.0.0-2462.g802de851.el8 ceph 474 k 2023-03-02T10:44:36.274 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-02T10:44:36.275 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:18.0.0-2462.g802de851.el8 ceph 6.5 M 2023-03-02T10:44:36.275 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-02T10:44:36.275 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-02T10:44:36.275 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-02T10:44:36.275 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-02T10:44:36.275 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-02T10:44:36.276 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-02T10:44:36.276 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-02T10:44:36.276 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-02T10:44:36.276 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-02T10:44:36.276 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-02T10:44:36.277 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-02T10:44:36.277 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-02T10:44:36.277 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-02T10:44:36.277 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-02T10:44:36.277 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-02T10:44:36.277 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-02T10:44:36.277 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:18.0.0-2462.g802de851.el8 ceph 45 k 2023-03-02T10:44:36.278 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:18.0.0-2462.g802de851.el8 ceph 117 k 2023-03-02T10:44:36.278 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-02T10:44:36.278 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-02T10:44:36.278 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-02T10:44:36.278 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-02T10:44:36.278 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-02T10:44:36.278 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-02T10:44:36.279 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-02T10:44:36.279 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-02T10:44:36.279 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-02T10:44:36.279 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-02T10:44:36.280 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-02T10:44:36.280 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-02T10:44:36.280 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-02T10:44:36.280 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-02T10:44:36.281 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-02T10:44:36.281 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-02T10:44:36.282 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-02T10:44:36.282 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-02T10:44:36.282 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-02T10:44:36.282 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-02T10:44:36.283 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-02T10:44:36.283 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-02T10:44:36.283 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-02T10:44:36.284 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-02T10:44:36.284 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-02T10:44:36.284 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-02T10:44:36.285 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-02T10:44:36.285 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-02T10:44:36.285 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-02T10:44:36.285 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-02T10:44:36.286 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-02T10:44:36.286 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-02T10:44:36.286 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-02T10:44:36.287 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-02T10:44:36.287 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-02T10:44:36.287 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-02T10:44:36.287 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-02T10:44:36.288 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-02T10:44:36.288 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-02T10:44:36.288 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-02T10:44:36.288 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-02T10:44:36.288 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-02T10:44:36.289 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-02T10:44:36.289 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-02T10:44:36.289 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-02T10:44:36.290 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-02T10:44:36.290 INFO:teuthology.orchestra.run.smithi136.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-02T10:44:36.290 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-02T10:44:36.290 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-02T10:44:36.291 INFO:teuthology.orchestra.run.smithi136.stdout:Enabling module streams: 2023-03-02T10:44:36.291 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql 10 2023-03-02T10:44:36.291 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:44:36.291 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2023-03-02T10:44:36.291 INFO:teuthology.orchestra.run.smithi136.stdout:=========================================================================================================================== 2023-03-02T10:44:36.291 INFO:teuthology.orchestra.run.smithi136.stdout:Install 128 Packages 2023-03-02T10:44:36.291 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 3 Packages 2023-03-02T10:44:36.292 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:44:36.292 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 205 M 2023-03-02T10:44:36.292 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2023-03-02T10:44:36.361 INFO:teuthology.orchestra.run.smithi122.stdout:(1/131): ceph-18.0.0-2462.g802de851.el8.x86_64. 43 kB/s | 6.4 kB 00:00 2023-03-02T10:44:36.421 INFO:teuthology.orchestra.run.smithi136.stdout:(1/131): ceph-18.0.0-2462.g802de851.el8.x86_64. 43 kB/s | 6.4 kB 00:00 2023-03-02T10:44:36.852 INFO:teuthology.orchestra.run.smithi122.stdout:(2/131): ceph-base-18.0.0-2462.g802de851.el8.x8 8.1 MB/s | 5.2 MB 00:00 2023-03-02T10:44:36.944 INFO:teuthology.orchestra.run.smithi122.stdout:(3/131): ceph-fuse-18.0.0-2462.g802de851.el8.x8 1.4 MB/s | 844 kB 00:00 2023-03-02T10:44:36.969 INFO:teuthology.orchestra.run.smithi122.stdout:(4/131): ceph-immutable-object-cache-18.0.0-246 1.4 MB/s | 165 kB 00:00 2023-03-02T10:44:37.145 INFO:teuthology.orchestra.run.smithi122.stdout:(5/131): ceph-mgr-18.0.0-2462.g802de851.el8.x86 8.8 MB/s | 1.5 MB 00:00 2023-03-02T10:44:37.387 INFO:teuthology.orchestra.run.smithi136.stdout:(2/131): ceph-fuse-18.0.0-2462.g802de851.el8.x8 874 kB/s | 844 kB 00:00 2023-03-02T10:44:37.537 INFO:teuthology.orchestra.run.smithi122.stdout:(6/131): ceph-mon-18.0.0-2462.g802de851.el8.x86 9.9 MB/s | 3.9 MB 00:00 2023-03-02T10:44:37.562 INFO:teuthology.orchestra.run.smithi136.stdout:(3/131): ceph-immutable-object-cache-18.0.0-246 947 kB/s | 165 kB 00:00 2023-03-02T10:44:37.837 INFO:teuthology.orchestra.run.smithi136.stdout:(4/131): ceph-base-18.0.0-2462.g802de851.el8.x8 3.3 MB/s | 5.2 MB 00:01 2023-03-02T10:44:38.312 INFO:teuthology.orchestra.run.smithi122.stdout:(7/131): ceph-mds-18.0.0-2462.g802de851.el8.x86 1.7 MB/s | 2.3 MB 00:01 2023-03-02T10:44:38.371 INFO:teuthology.orchestra.run.smithi136.stdout:(5/131): ceph-mgr-18.0.0-2462.g802de851.el8.x86 2.9 MB/s | 1.5 MB 00:00 2023-03-02T10:44:38.963 INFO:teuthology.orchestra.run.smithi122.stdout:(8/131): ceph-common-18.0.0-2462.g802de851.el8. 8.9 MB/s | 24 MB 00:02 2023-03-02T10:44:39.096 INFO:teuthology.orchestra.run.smithi136.stdout:(6/131): ceph-mon-18.0.0-2462.g802de851.el8.x86 5.4 MB/s | 3.9 MB 00:00 2023-03-02T10:44:39.163 INFO:teuthology.orchestra.run.smithi122.stdout:(9/131): ceph-osd-18.0.0-2462.g802de851.el8.x86 10 MB/s | 17 MB 00:01 2023-03-02T10:44:39.223 INFO:teuthology.orchestra.run.smithi122.stdout:(10/131): ceph-selinux-18.0.0-2462.g802de851.el 94 kB/s | 24 kB 00:00 2023-03-02T10:44:39.288 INFO:teuthology.orchestra.run.smithi136.stdout:(7/131): ceph-mds-18.0.0-2462.g802de851.el8.x86 1.3 MB/s | 2.3 MB 00:01 2023-03-02T10:44:39.314 INFO:teuthology.orchestra.run.smithi122.stdout:(11/131): cephfs-mirror-18.0.0-2462.g802de851.e 2.8 MB/s | 258 kB 00:00 2023-03-02T10:44:39.397 INFO:teuthology.orchestra.run.smithi122.stdout:(12/131): libcephfs-devel-18.0.0-2462.g802de851 366 kB/s | 30 kB 00:00 2023-03-02T10:44:39.564 INFO:teuthology.orchestra.run.smithi122.stdout:(13/131): libcephfs2-18.0.0-2462.g802de851.el8. 4.5 MB/s | 768 kB 00:00 2023-03-02T10:44:39.648 INFO:teuthology.orchestra.run.smithi122.stdout:(14/131): libcephsqlite-18.0.0-2462.g802de851.e 1.6 MB/s | 137 kB 00:00 2023-03-02T10:44:39.732 INFO:teuthology.orchestra.run.smithi122.stdout:(15/131): librados-devel-18.0.0-2462.g802de851. 1.6 MB/s | 139 kB 00:00 2023-03-02T10:44:39.840 INFO:teuthology.orchestra.run.smithi122.stdout:(16/131): libradosstriper1-18.0.0-2462.g802de85 4.3 MB/s | 474 kB 00:00 2023-03-02T10:44:40.724 INFO:teuthology.orchestra.run.smithi122.stdout:(17/131): librgw2-18.0.0-2462.g802de851.el8.x86 7.3 MB/s | 6.5 MB 00:00 2023-03-02T10:44:40.799 INFO:teuthology.orchestra.run.smithi122.stdout:(18/131): python3-ceph-argparse-18.0.0-2462.g80 595 kB/s | 45 kB 00:00 2023-03-02T10:44:40.875 INFO:teuthology.orchestra.run.smithi122.stdout:(19/131): python3-ceph-common-18.0.0-2462.g802d 1.5 MB/s | 117 kB 00:00 2023-03-02T10:44:40.967 INFO:teuthology.orchestra.run.smithi122.stdout:(20/131): python3-cephfs-18.0.0-2462.g802de851. 2.0 MB/s | 190 kB 00:00 2023-03-02T10:44:41.051 INFO:teuthology.orchestra.run.smithi122.stdout:(21/131): python3-rados-18.0.0-2462.g802de851.e 4.4 MB/s | 371 kB 00:00 2023-03-02T10:44:41.134 INFO:teuthology.orchestra.run.smithi122.stdout:(22/131): python3-rbd-18.0.0-2462.g802de851.el8 4.3 MB/s | 365 kB 00:00 2023-03-02T10:44:41.209 INFO:teuthology.orchestra.run.smithi122.stdout:(23/131): python3-rgw-18.0.0-2462.g802de851.el8 1.4 MB/s | 107 kB 00:00 2023-03-02T10:44:41.284 INFO:teuthology.orchestra.run.smithi122.stdout:(24/131): rbd-fuse-18.0.0-2462.g802de851.el8.x8 1.2 MB/s | 94 kB 00:00 2023-03-02T10:44:41.591 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-02T10:44:41.592 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-02T10:44:41.608 INFO:teuthology.orchestra.run.smithi057.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-02T10:44:41.609 INFO:teuthology.orchestra.run.smithi057.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-02T10:44:41.611 INFO:teuthology.orchestra.run.smithi057.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-02T10:44:41.612 INFO:teuthology.orchestra.run.smithi057.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-02T10:44:41.614 INFO:teuthology.orchestra.run.smithi057.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-02T10:44:41.618 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-02T10:44:41.619 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-02T10:44:41.770 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-03-02T10:44:41.784 INFO:teuthology.orchestra.run.smithi057.stdout:=========================================================================================================================== 2023-03-02T10:44:41.785 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-03-02T10:44:41.785 INFO:teuthology.orchestra.run.smithi057.stdout:=========================================================================================================================== 2023-03-02T10:44:41.786 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-03-02T10:44:41.786 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-02T10:44:41.786 INFO:teuthology.orchestra.run.smithi057.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-02T10:44:41.786 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:18.0.0-2462.g802de851.el8 ceph 6.4 k 2023-03-02T10:44:41.786 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:18.0.0-2462.g802de851.el8 ceph 5.2 M 2023-03-02T10:44:41.786 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:18.0.0-2462.g802de851.el8 ceph 844 k 2023-03-02T10:44:41.787 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2462.g802de851.el8 ceph 165 k 2023-03-02T10:44:41.787 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:18.0.0-2462.g802de851.el8 ceph 1.5 M 2023-03-02T10:44:41.787 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 120 k 2023-03-02T10:44:41.787 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 1.7 M 2023-03-02T10:44:41.788 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 7.4 M 2023-03-02T10:44:41.788 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 47 k 2023-03-02T10:44:41.788 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:18.0.0-2462.g802de851.el8 ceph 13 M 2023-03-02T10:44:41.788 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:18.0.0-2462.g802de851.el8 ceph 48 M 2023-03-02T10:44:41.788 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 263 k 2023-03-02T10:44:41.788 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 82 k 2023-03-02T10:44:41.789 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror x86_64 2:18.0.0-2462.g802de851.el8 ceph 258 k 2023-03-02T10:44:41.789 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 18 k 2023-03-02T10:44:41.789 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-02T10:44:41.789 INFO:teuthology.orchestra.run.smithi057.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-02T10:44:41.789 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-02T10:44:41.789 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:18.0.0-2462.g802de851.el8 ceph 30 k 2023-03-02T10:44:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:18.0.0-2462.g802de851.el8 ceph 768 k 2023-03-02T10:44:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:18.0.0-2462.g802de851.el8 ceph 139 k 2023-03-02T10:44:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-02T10:44:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-02T10:44:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-02T10:44:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-02T10:44:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-02T10:44:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-02T10:44:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:18.0.0-2462.g802de851.el8 ceph 190 k 2023-03-02T10:44:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:18.0.0-2462.g802de851.el8 ceph 371 k 2023-03-02T10:44:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:18.0.0-2462.g802de851.el8 ceph 365 k 2023-03-02T10:44:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:18.0.0-2462.g802de851.el8 ceph 107 k 2023-03-02T10:44:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:18.0.0-2462.g802de851.el8 ceph 94 k 2023-03-02T10:44:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.4 M 2023-03-02T10:44:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:18.0.0-2462.g802de851.el8 ceph 180 k 2023-03-02T10:44:41.792 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-02T10:44:41.792 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2023-03-02T10:44:41.792 INFO:teuthology.orchestra.run.smithi057.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-02T10:44:41.792 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.6 M 2023-03-02T10:44:41.792 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.6 M 2023-03-02T10:44:41.792 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-03-02T10:44:41.792 INFO:teuthology.orchestra.run.smithi057.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-02T10:44:41.793 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:18.0.0-2462.g802de851.el8 ceph 24 M 2023-03-02T10:44:41.793 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 23 k 2023-03-02T10:44:41.793 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:18.0.0-2462.g802de851.el8 ceph 2.3 M 2023-03-02T10:44:41.793 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 236 k 2023-03-02T10:44:41.793 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:18.0.0-2462.g802de851.el8 ceph 3.9 M 2023-03-02T10:44:41.793 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:18.0.0-2462.g802de851.el8 ceph 17 M 2023-03-02T10:44:41.793 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2462.g802de851.el8 ceph-noarch 15 k 2023-03-02T10:44:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:18.0.0-2462.g802de851.el8 ceph 24 k 2023-03-02T10:44:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-02T10:44:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-02T10:44:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-02T10:44:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-02T10:44:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-02T10:44:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:18.0.0-2462.g802de851.el8 ceph 137 k 2023-03-02T10:44:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-02T10:44:41.795 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-02T10:44:41.795 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-02T10:44:41.795 INFO:teuthology.orchestra.run.smithi057.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-02T10:44:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-02T10:44:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-02T10:44:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:18.0.0-2462.g802de851.el8 ceph 474 k 2023-03-02T10:44:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-02T10:44:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:18.0.0-2462.g802de851.el8 ceph 6.5 M 2023-03-02T10:44:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-02T10:44:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-02T10:44:41.797 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-02T10:44:41.797 INFO:teuthology.orchestra.run.smithi057.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-02T10:44:41.797 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-02T10:44:41.797 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-02T10:44:41.797 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-02T10:44:41.797 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-02T10:44:41.797 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-02T10:44:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-02T10:44:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-02T10:44:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-02T10:44:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-02T10:44:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-02T10:44:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-02T10:44:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-02T10:44:41.799 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:18.0.0-2462.g802de851.el8 ceph 45 k 2023-03-02T10:44:41.799 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:18.0.0-2462.g802de851.el8 ceph 117 k 2023-03-02T10:44:41.799 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-02T10:44:41.799 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-02T10:44:41.799 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-02T10:44:41.800 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-02T10:44:41.800 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-02T10:44:41.800 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-02T10:44:41.800 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-02T10:44:41.800 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-02T10:44:41.800 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-02T10:44:41.801 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-02T10:44:41.801 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-02T10:44:41.801 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-02T10:44:41.801 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-02T10:44:41.801 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-02T10:44:41.801 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-02T10:44:41.801 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-02T10:44:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-02T10:44:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-02T10:44:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-02T10:44:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-02T10:44:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-02T10:44:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-02T10:44:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-02T10:44:41.803 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-02T10:44:41.803 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-02T10:44:41.803 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-02T10:44:41.807 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-02T10:44:41.807 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-02T10:44:41.808 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-02T10:44:41.808 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-02T10:44:41.808 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-02T10:44:41.808 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-02T10:44:41.808 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-02T10:44:41.808 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-02T10:44:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-02T10:44:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-02T10:44:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-02T10:44:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-02T10:44:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-02T10:44:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-02T10:44:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-02T10:44:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-02T10:44:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-02T10:44:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-02T10:44:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-02T10:44:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-02T10:44:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-02T10:44:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-02T10:44:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-02T10:44:41.811 INFO:teuthology.orchestra.run.smithi057.stdout:Enabling module streams: 2023-03-02T10:44:41.811 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql 10 2023-03-02T10:44:41.811 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:44:41.811 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-03-02T10:44:41.811 INFO:teuthology.orchestra.run.smithi057.stdout:=========================================================================================================================== 2023-03-02T10:44:41.811 INFO:teuthology.orchestra.run.smithi057.stdout:Install 128 Packages 2023-03-02T10:44:41.811 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 3 Packages 2023-03-02T10:44:41.812 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:44:41.812 INFO:teuthology.orchestra.run.smithi122.stdout:(25/131): rbd-mirror-18.0.0-2462.g802de851.el8. 6.7 MB/s | 3.4 MB 00:00 2023-03-02T10:44:41.813 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 205 M 2023-03-02T10:44:41.813 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-03-02T10:44:41.902 INFO:teuthology.orchestra.run.smithi122.stdout:(26/131): rbd-nbd-18.0.0-2462.g802de851.el8.x86 1.8 MB/s | 180 kB 00:00 2023-03-02T10:44:41.977 INFO:teuthology.orchestra.run.smithi122.stdout:(27/131): ceph-grafana-dashboards-18.0.0-2462.g 308 kB/s | 23 kB 00:00 2023-03-02T10:44:42.058 INFO:teuthology.orchestra.run.smithi057.stdout:(1/131): ceph-18.0.0-2462.g802de851.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2023-03-02T10:44:42.061 INFO:teuthology.orchestra.run.smithi122.stdout:(28/131): ceph-mgr-cephadm-18.0.0-2462.g802de85 1.4 MB/s | 120 kB 00:00 2023-03-02T10:44:42.386 INFO:teuthology.orchestra.run.smithi122.stdout:(29/131): ceph-mgr-dashboard-18.0.0-2462.g802de 5.3 MB/s | 1.7 MB 00:00 2023-03-02T10:44:42.842 INFO:teuthology.orchestra.run.smithi057.stdout:(2/131): ceph-fuse-18.0.0-2462.g802de851.el8.x8 1.1 MB/s | 844 kB 00:00 2023-03-02T10:44:43.000 INFO:teuthology.orchestra.run.smithi057.stdout:(3/131): ceph-immutable-object-cache-18.0.0-246 1.0 MB/s | 165 kB 00:00 2023-03-02T10:44:43.395 INFO:teuthology.orchestra.run.smithi122.stdout:(30/131): ceph-test-18.0.0-2462.g802de851.el8.x 11 MB/s | 48 MB 00:04 2023-03-02T10:44:43.504 INFO:teuthology.orchestra.run.smithi122.stdout:(31/131): ceph-mgr-diskprediction-local-18.0.0- 6.6 MB/s | 7.4 MB 00:01 2023-03-02T10:44:43.529 INFO:teuthology.orchestra.run.smithi122.stdout:(32/131): ceph-mgr-modules-core-18.0.0-2462.g80 1.7 MB/s | 236 kB 00:00 2023-03-02T10:44:43.554 INFO:teuthology.orchestra.run.smithi122.stdout:(33/131): ceph-mgr-rook-18.0.0-2462.g802de851.e 950 kB/s | 47 kB 00:00 2023-03-02T10:44:43.576 INFO:teuthology.orchestra.run.smithi057.stdout:(4/131): ceph-mds-18.0.0-2462.g802de851.el8.x86 3.9 MB/s | 2.3 MB 00:00 2023-03-02T10:44:43.579 INFO:teuthology.orchestra.run.smithi122.stdout:(34/131): ceph-prometheus-alerts-18.0.0-2462.g8 288 kB/s | 15 kB 00:00 2023-03-02T10:44:43.605 INFO:teuthology.orchestra.run.smithi136.stdout:(8/131): ceph-osd-18.0.0-2462.g802de851.el8.x86 3.8 MB/s | 17 MB 00:04 2023-03-02T10:44:43.613 INFO:teuthology.orchestra.run.smithi122.stdout:(35/131): ceph-volume-18.0.0-2462.g802de851.el8 4.4 MB/s | 263 kB 00:00 2023-03-02T10:44:43.639 INFO:teuthology.orchestra.run.smithi122.stdout:(36/131): cephadm-18.0.0-2462.g802de851.el8.noa 1.4 MB/s | 82 kB 00:00 2023-03-02T10:44:43.671 INFO:teuthology.orchestra.run.smithi136.stdout:(9/131): ceph-selinux-18.0.0-2462.g802de851.el8 365 kB/s | 24 kB 00:00 2023-03-02T10:44:43.672 INFO:teuthology.orchestra.run.smithi122.stdout:(37/131): cephfs-top-18.0.0-2462.g802de851.el8. 307 kB/s | 18 kB 00:00 2023-03-02T10:44:43.868 INFO:teuthology.orchestra.run.smithi057.stdout:(5/131): ceph-base-18.0.0-2462.g802de851.el8.x8 2.5 MB/s | 5.2 MB 00:02 2023-03-02T10:44:43.909 INFO:teuthology.orchestra.run.smithi057.stdout:(6/131): ceph-mgr-18.0.0-2462.g802de851.el8.x86 4.6 MB/s | 1.5 MB 00:00 2023-03-02T10:44:43.956 INFO:teuthology.orchestra.run.smithi122.stdout:(38/131): ceph-radosgw-18.0.0-2462.g802de851.el 2.3 MB/s | 13 MB 00:05 2023-03-02T10:44:43.981 INFO:teuthology.orchestra.run.smithi122.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 191 kB/s | 59 kB 00:00 2023-03-02T10:44:44.007 INFO:teuthology.orchestra.run.smithi122.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 833 kB/s | 306 kB 00:00 2023-03-02T10:44:44.057 INFO:teuthology.orchestra.run.smithi122.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2023-03-02T10:44:44.107 INFO:teuthology.orchestra.run.smithi122.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-03-02T10:44:44.124 INFO:teuthology.orchestra.run.smithi122.stdout:(43/131): libunwind-1.3.1-3.el8.x86_64.rpm 447 kB/s | 75 kB 00:00 2023-03-02T10:44:44.158 INFO:teuthology.orchestra.run.smithi122.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 659 kB/s | 33 kB 00:00 2023-03-02T10:44:44.183 INFO:teuthology.orchestra.run.smithi122.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 278 kB/s | 16 kB 00:00 2023-03-02T10:44:44.209 INFO:teuthology.orchestra.run.smithi122.stdout:(46/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.0 MB/s | 476 kB 00:00 2023-03-02T10:44:44.234 INFO:teuthology.orchestra.run.smithi122.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-03-02T10:44:44.259 INFO:teuthology.orchestra.run.smithi122.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-03-02T10:44:44.284 INFO:teuthology.orchestra.run.smithi122.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 220 kB/s | 11 kB 00:00 2023-03-02T10:44:44.310 INFO:teuthology.orchestra.run.smithi122.stdout:(50/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-03-02T10:44:44.335 INFO:teuthology.orchestra.run.smithi122.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 232 kB/s | 18 kB 00:00 2023-03-02T10:44:44.343 INFO:teuthology.orchestra.run.smithi057.stdout:(7/131): ceph-mon-18.0.0-2462.g802de851.el8.x86 8.2 MB/s | 3.9 MB 00:00 2023-03-02T10:44:44.360 INFO:teuthology.orchestra.run.smithi122.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 969 kB/s | 49 kB 00:00 2023-03-02T10:44:44.394 INFO:teuthology.orchestra.run.smithi122.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-03-02T10:44:44.419 INFO:teuthology.orchestra.run.smithi122.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-03-02T10:44:44.455 INFO:teuthology.orchestra.run.smithi136.stdout:(10/131): ceph-common-18.0.0-2462.g802de851.el8 3.0 MB/s | 24 MB 00:08 2023-03-02T10:44:44.485 INFO:teuthology.orchestra.run.smithi122.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 5.8 MB/s | 1.2 MB 00:00 2023-03-02T10:44:44.520 INFO:teuthology.orchestra.run.smithi122.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-03-02T10:44:44.545 INFO:teuthology.orchestra.run.smithi122.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 559 kB/s | 34 kB 00:00 2023-03-02T10:44:44.570 INFO:teuthology.orchestra.run.smithi122.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-03-02T10:44:44.596 INFO:teuthology.orchestra.run.smithi122.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-03-02T10:44:44.621 INFO:teuthology.orchestra.run.smithi122.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 810 kB/s | 61 kB 00:00 2023-03-02T10:44:44.647 INFO:teuthology.orchestra.run.smithi122.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 246 kB/s | 19 kB 00:00 2023-03-02T10:44:44.663 INFO:teuthology.orchestra.run.smithi136.stdout:(11/131): cephfs-mirror-18.0.0-2462.g802de851.e 1.2 MB/s | 258 kB 00:00 2023-03-02T10:44:44.672 INFO:teuthology.orchestra.run.smithi122.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 315 kB/s | 24 kB 00:00 2023-03-02T10:44:44.698 INFO:teuthology.orchestra.run.smithi122.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 387 kB/s | 29 kB 00:00 2023-03-02T10:44:44.723 INFO:teuthology.orchestra.run.smithi122.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 364 kB/s | 27 kB 00:00 2023-03-02T10:44:44.747 INFO:teuthology.orchestra.run.smithi136.stdout:(12/131): libcephfs-devel-18.0.0-2462.g802de851 366 kB/s | 30 kB 00:00 2023-03-02T10:44:44.748 INFO:teuthology.orchestra.run.smithi122.stdout:(65/131): python3-waitress-1.2.1-2.el8.1.noarch 3.1 MB/s | 241 kB 00:00 2023-03-02T10:44:44.773 INFO:teuthology.orchestra.run.smithi122.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.2 MB/s | 251 kB 00:00 2023-03-02T10:44:44.799 INFO:teuthology.orchestra.run.smithi122.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 810 kB/s | 61 kB 00:00 2023-03-02T10:44:44.824 INFO:teuthology.orchestra.run.smithi122.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-03-02T10:44:44.841 INFO:teuthology.orchestra.run.smithi122.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 341 kB/s | 23 kB 00:00 2023-03-02T10:44:44.866 INFO:teuthology.orchestra.run.smithi122.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-03-02T10:44:44.933 INFO:teuthology.orchestra.run.smithi122.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-03-02T10:44:44.975 INFO:teuthology.orchestra.run.smithi122.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-03-02T10:44:45.059 INFO:teuthology.orchestra.run.smithi122.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2023-03-02T10:44:45.101 INFO:teuthology.orchestra.run.smithi122.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 5.7 MB/s | 1.7 MB 00:00 2023-03-02T10:44:45.135 INFO:teuthology.orchestra.run.smithi122.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-03-02T10:44:45.147 INFO:teuthology.orchestra.run.smithi136.stdout:(13/131): libcephfs2-18.0.0-2462.g802de851.el8. 1.9 MB/s | 768 kB 00:00 2023-03-02T10:44:45.185 INFO:teuthology.orchestra.run.smithi122.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 464 kB/s | 39 kB 00:00 2023-03-02T10:44:45.235 INFO:teuthology.orchestra.run.smithi122.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 7.1 MB/s | 688 kB 00:00 2023-03-02T10:44:45.269 INFO:teuthology.orchestra.run.smithi122.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 6.3 MB/s | 538 kB 00:00 2023-03-02T10:44:45.294 INFO:teuthology.orchestra.run.smithi122.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-03-02T10:44:45.320 INFO:teuthology.orchestra.run.smithi122.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-03-02T10:44:45.361 INFO:teuthology.orchestra.run.smithi122.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-03-02T10:44:45.412 INFO:teuthology.orchestra.run.smithi122.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 531 kB/s | 27 kB 00:00 2023-03-02T10:44:45.554 INFO:teuthology.orchestra.run.smithi122.stdout:(83/131): python3-scipy-1.0.0-21.module+el8.5.0 19 MB/s | 14 MB 00:00 2023-03-02T10:44:45.585 INFO:teuthology.orchestra.run.smithi057.stdout:(8/131): ceph-radosgw-18.0.0-2462.g802de851.el8 11 MB/s | 13 MB 00:01 2023-03-02T10:44:45.587 INFO:teuthology.orchestra.run.smithi122.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-03-02T10:44:45.648 INFO:teuthology.orchestra.run.smithi136.stdout:(14/131): ceph-radosgw-18.0.0-2462.g802de851.el 2.0 MB/s | 13 MB 00:06 2023-03-02T10:44:45.655 INFO:teuthology.orchestra.run.smithi122.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 438 kB/s | 44 kB 00:00 2023-03-02T10:44:45.673 INFO:teuthology.orchestra.run.smithi136.stdout:(15/131): libcephsqlite-18.0.0-2462.g802de851.e 261 kB/s | 137 kB 00:00 2023-03-02T10:44:45.715 INFO:teuthology.orchestra.run.smithi136.stdout:(16/131): librados-devel-18.0.0-2462.g802de851. 2.0 MB/s | 139 kB 00:00 2023-03-02T10:44:45.755 INFO:teuthology.orchestra.run.smithi122.stdout:(86/131): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-03-02T10:44:45.781 INFO:teuthology.orchestra.run.smithi122.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 3.6 MB/s | 457 kB 00:00 2023-03-02T10:44:45.793 INFO:teuthology.orchestra.run.smithi057.stdout:(9/131): ceph-osd-18.0.0-2462.g802de851.el8.x86 9.0 MB/s | 17 MB 00:01 2023-03-02T10:44:45.806 INFO:teuthology.orchestra.run.smithi122.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2023-03-02T10:44:45.807 INFO:teuthology.orchestra.run.smithi136.stdout:(17/131): libradosstriper1-18.0.0-2462.g802de85 3.5 MB/s | 474 kB 00:00 2023-03-02T10:44:45.819 INFO:teuthology.orchestra.run.smithi057.stdout:(10/131): ceph-selinux-18.0.0-2462.g802de851.el 104 kB/s | 24 kB 00:00 2023-03-02T10:44:45.823 INFO:teuthology.orchestra.run.smithi122.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-03-02T10:44:45.856 INFO:teuthology.orchestra.run.smithi122.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-03-02T10:44:45.857 INFO:teuthology.orchestra.run.smithi136.stdout:(18/131): python3-ceph-argparse-18.0.0-2462.g80 894 kB/s | 45 kB 00:00 2023-03-02T10:44:45.873 INFO:teuthology.orchestra.run.smithi122.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-03-02T10:44:45.894 INFO:teuthology.orchestra.run.smithi057.stdout:(11/131): cephfs-mirror-18.0.0-2462.g802de851.e 3.4 MB/s | 258 kB 00:00 2023-03-02T10:44:45.907 INFO:teuthology.orchestra.run.smithi122.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-03-02T10:44:45.932 INFO:teuthology.orchestra.run.smithi136.stdout:(19/131): python3-ceph-common-18.0.0-2462.g802d 1.5 MB/s | 117 kB 00:00 2023-03-02T10:44:45.961 INFO:teuthology.orchestra.run.smithi057.stdout:(12/131): libcephfs-devel-18.0.0-2462.g802de851 458 kB/s | 30 kB 00:00 2023-03-02T10:44:45.966 INFO:teuthology.orchestra.run.smithi122.stdout:(93/131): python3-numpy-1.14.3-10.el8.x86_64.rp 9.9 MB/s | 3.7 MB 00:00 2023-03-02T10:44:45.999 INFO:teuthology.orchestra.run.smithi122.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2023-03-02T10:44:46.033 INFO:teuthology.orchestra.run.smithi122.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2023-03-02T10:44:46.061 INFO:teuthology.orchestra.run.smithi057.stdout:(13/131): libcephfs2-18.0.0-2462.g802de851.el8. 7.5 MB/s | 768 kB 00:00 2023-03-02T10:44:46.066 INFO:teuthology.orchestra.run.smithi136.stdout:(20/131): python3-cephfs-18.0.0-2462.g802de851. 1.4 MB/s | 190 kB 00:00 2023-03-02T10:44:46.083 INFO:teuthology.orchestra.run.smithi122.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.9 MB/s | 202 kB 00:00 2023-03-02T10:44:46.128 INFO:teuthology.orchestra.run.smithi057.stdout:(14/131): libcephsqlite-18.0.0-2462.g802de851.e 2.0 MB/s | 137 kB 00:00 2023-03-02T10:44:46.134 INFO:teuthology.orchestra.run.smithi122.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-03-02T10:44:46.203 INFO:teuthology.orchestra.run.smithi057.stdout:(15/131): librados-devel-18.0.0-2462.g802de851. 1.8 MB/s | 139 kB 00:00 2023-03-02T10:44:46.233 INFO:teuthology.orchestra.run.smithi136.stdout:(21/131): python3-rados-18.0.0-2462.g802de851.e 2.2 MB/s | 371 kB 00:00 2023-03-02T10:44:46.234 INFO:teuthology.orchestra.run.smithi122.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-03-02T10:44:46.287 INFO:teuthology.orchestra.run.smithi057.stdout:(16/131): libradosstriper1-18.0.0-2462.g802de85 5.6 MB/s | 474 kB 00:00 2023-03-02T10:44:46.309 INFO:teuthology.orchestra.run.smithi122.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-03-02T10:44:46.376 INFO:teuthology.orchestra.run.smithi122.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.6 MB/s | 808 kB 00:00 2023-03-02T10:44:46.410 INFO:teuthology.orchestra.run.smithi122.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-03-02T10:44:46.452 INFO:teuthology.orchestra.run.smithi122.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-03-02T10:44:46.477 INFO:teuthology.orchestra.run.smithi122.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-03-02T10:44:46.503 INFO:teuthology.orchestra.run.smithi122.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 845 kB/s | 43 kB 00:00 2023-03-02T10:44:46.528 INFO:teuthology.orchestra.run.smithi122.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-03-02T10:44:46.533 INFO:teuthology.orchestra.run.smithi136.stdout:(22/131): python3-rbd-18.0.0-2462.g802de851.el8 1.2 MB/s | 365 kB 00:00 2023-03-02T10:44:46.553 INFO:teuthology.orchestra.run.smithi122.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 959 kB/s | 48 kB 00:00 2023-03-02T10:44:46.578 INFO:teuthology.orchestra.run.smithi122.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-03-02T10:44:46.604 INFO:teuthology.orchestra.run.smithi122.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 846 kB/s | 43 kB 00:00 2023-03-02T10:44:46.629 INFO:teuthology.orchestra.run.smithi122.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-03-02T10:44:46.655 INFO:teuthology.orchestra.run.smithi122.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-03-02T10:44:46.697 INFO:teuthology.orchestra.run.smithi122.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.1 MB/s | 560 kB 00:00 2023-03-02T10:44:46.708 INFO:teuthology.orchestra.run.smithi136.stdout:(23/131): python3-rgw-18.0.0-2462.g802de851.el8 609 kB/s | 107 kB 00:00 2023-03-02T10:44:46.713 INFO:teuthology.orchestra.run.smithi122.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 317 kB/s | 19 kB 00:00 2023-03-02T10:44:46.739 INFO:teuthology.orchestra.run.smithi122.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-03-02T10:44:46.808 INFO:teuthology.orchestra.run.smithi136.stdout:(24/131): rbd-fuse-18.0.0-2462.g802de851.el8.x8 946 kB/s | 94 kB 00:00 2023-03-02T10:44:46.899 INFO:teuthology.orchestra.run.smithi122.stdout:(114/131): postgresql-server-10.21-2.module+el8 6.6 MB/s | 5.1 MB 00:00 2023-03-02T10:44:46.920 INFO:teuthology.orchestra.run.smithi057.stdout:(17/131): librgw2-18.0.0-2462.g802de851.el8.x86 10 MB/s | 6.5 MB 00:00 2023-03-02T10:44:46.988 INFO:teuthology.orchestra.run.smithi057.stdout:(18/131): python3-ceph-argparse-18.0.0-2462.g80 669 kB/s | 45 kB 00:00 2023-03-02T10:44:47.063 INFO:teuthology.orchestra.run.smithi057.stdout:(19/131): python3-ceph-common-18.0.0-2462.g802d 1.5 MB/s | 117 kB 00:00 2023-03-02T10:44:47.065 INFO:teuthology.orchestra.run.smithi122.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 55 kB/s | 18 kB 00:00 2023-03-02T10:44:47.090 INFO:teuthology.orchestra.run.smithi122.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 1.5 MB/s | 559 kB 00:00 2023-03-02T10:44:47.115 INFO:teuthology.orchestra.run.smithi122.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2023-03-02T10:44:47.138 INFO:teuthology.orchestra.run.smithi057.stdout:(20/131): python3-cephfs-18.0.0-2462.g802de851. 2.5 MB/s | 190 kB 00:00 2023-03-02T10:44:47.149 INFO:teuthology.orchestra.run.smithi122.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 2.4 MB/s | 605 kB 00:00 2023-03-02T10:44:47.174 INFO:teuthology.orchestra.run.smithi122.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-03-02T10:44:47.208 INFO:teuthology.orchestra.run.smithi122.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-03-02T10:44:47.230 INFO:teuthology.orchestra.run.smithi057.stdout:(21/131): python3-rados-18.0.0-2462.g802de851.e 4.0 MB/s | 371 kB 00:00 2023-03-02T10:44:47.233 INFO:teuthology.orchestra.run.smithi122.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.0 MB/s | 60 kB 00:00 2023-03-02T10:44:47.259 INFO:teuthology.orchestra.run.smithi122.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-03-02T10:44:47.284 INFO:teuthology.orchestra.run.smithi122.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-03-02T10:44:47.309 INFO:teuthology.orchestra.run.smithi122.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 766 kB/s | 39 kB 00:00 2023-03-02T10:44:47.313 INFO:teuthology.orchestra.run.smithi057.stdout:(22/131): python3-rbd-18.0.0-2462.g802de851.el8 4.3 MB/s | 365 kB 00:00 2023-03-02T10:44:47.368 INFO:teuthology.orchestra.run.smithi122.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 7.5 MB/s | 644 kB 00:00 2023-03-02T10:44:47.389 INFO:teuthology.orchestra.run.smithi057.stdout:(23/131): python3-rgw-18.0.0-2462.g802de851.el8 1.4 MB/s | 107 kB 00:00 2023-03-02T10:44:47.394 INFO:teuthology.orchestra.run.smithi122.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.0 MB/s | 171 kB 00:00 2023-03-02T10:44:47.419 INFO:teuthology.orchestra.run.smithi122.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-03-02T10:44:47.464 INFO:teuthology.orchestra.run.smithi057.stdout:(24/131): rbd-fuse-18.0.0-2462.g802de851.el8.x8 1.2 MB/s | 94 kB 00:00 2023-03-02T10:44:47.469 INFO:teuthology.orchestra.run.smithi122.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.1 MB/s | 2.3 MB 00:00 2023-03-02T10:44:47.519 INFO:teuthology.orchestra.run.smithi122.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-03-02T10:44:47.831 INFO:teuthology.orchestra.run.smithi057.stdout:(25/131): rbd-mirror-18.0.0-2462.g802de851.el8. 9.4 MB/s | 3.4 MB 00:00 2023-03-02T10:44:47.915 INFO:teuthology.orchestra.run.smithi057.stdout:(26/131): rbd-nbd-18.0.0-2462.g802de851.el8.x86 2.1 MB/s | 180 kB 00:00 2023-03-02T10:44:47.990 INFO:teuthology.orchestra.run.smithi057.stdout:(27/131): ceph-grafana-dashboards-18.0.0-2462.g 309 kB/s | 23 kB 00:00 2023-03-02T10:44:48.082 INFO:teuthology.orchestra.run.smithi057.stdout:(28/131): ceph-mgr-cephadm-18.0.0-2462.g802de85 1.3 MB/s | 120 kB 00:00 2023-03-02T10:44:48.283 INFO:teuthology.orchestra.run.smithi057.stdout:(29/131): ceph-mgr-dashboard-18.0.0-2462.g802de 8.7 MB/s | 1.7 MB 00:00 2023-03-02T10:44:48.350 INFO:teuthology.orchestra.run.smithi136.stdout:(25/131): librgw2-18.0.0-2462.g802de851.el8.x86 2.5 MB/s | 6.5 MB 00:02 2023-03-02T10:44:48.526 INFO:teuthology.orchestra.run.smithi136.stdout:(26/131): rbd-nbd-18.0.0-2462.g802de851.el8.x86 1.0 MB/s | 180 kB 00:00 2023-03-02T10:44:48.626 INFO:teuthology.orchestra.run.smithi136.stdout:(27/131): ceph-grafana-dashboards-18.0.0-2462.g 231 kB/s | 23 kB 00:00 2023-03-02T10:44:48.809 INFO:teuthology.orchestra.run.smithi136.stdout:(28/131): ceph-mgr-cephadm-18.0.0-2462.g802de85 658 kB/s | 120 kB 00:00 2023-03-02T10:44:48.968 INFO:teuthology.orchestra.run.smithi136.stdout:(29/131): rbd-mirror-18.0.0-2462.g802de851.el8. 1.6 MB/s | 3.4 MB 00:02 2023-03-02T10:44:48.975 INFO:teuthology.orchestra.run.smithi057.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-03-02T10:44:49.058 INFO:teuthology.orchestra.run.smithi057.stdout:(31/131): ceph-mgr-modules-core-18.0.0-2462.g80 2.8 MB/s | 236 kB 00:00 2023-03-02T10:44:49.134 INFO:teuthology.orchestra.run.smithi057.stdout:(32/131): ceph-mgr-rook-18.0.0-2462.g802de851.e 632 kB/s | 47 kB 00:00 2023-03-02T10:44:49.200 INFO:teuthology.orchestra.run.smithi057.stdout:(33/131): ceph-prometheus-alerts-18.0.0-2462.g8 219 kB/s | 15 kB 00:00 2023-03-02T10:44:49.220 INFO:teuthology.orchestra.run.smithi122.stdout:(130/131): librbd1-18.0.0-2462.g802de851.el8.x8 2.0 MB/s | 3.6 MB 00:01 2023-03-02T10:44:49.284 INFO:teuthology.orchestra.run.smithi057.stdout:(34/131): ceph-volume-18.0.0-2462.g802de851.el8 3.1 MB/s | 263 kB 00:00 2023-03-02T10:44:49.336 INFO:teuthology.orchestra.run.smithi122.stdout:(131/131): librados2-18.0.0-2462.g802de851.el8. 1.9 MB/s | 3.6 MB 00:01 2023-03-02T10:44:49.339 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2023-03-02T10:44:49.339 INFO:teuthology.orchestra.run.smithi122.stdout:Total 16 MB/s | 205 MB 00:13 2023-03-02T10:44:49.351 INFO:teuthology.orchestra.run.smithi057.stdout:(35/131): cephadm-18.0.0-2462.g802de851.el8.noa 1.2 MB/s | 82 kB 00:00 2023-03-02T10:44:49.410 INFO:teuthology.orchestra.run.smithi057.stdout:(36/131): cephfs-top-18.0.0-2462.g802de851.el8. 310 kB/s | 18 kB 00:00 2023-03-02T10:44:49.535 INFO:teuthology.orchestra.run.smithi136.stdout:(30/131): ceph-mgr-dashboard-18.0.0-2462.g802de 2.4 MB/s | 1.7 MB 00:00 2023-03-02T10:44:49.635 INFO:teuthology.orchestra.run.smithi057.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-03-02T10:44:49.644 INFO:teuthology.orchestra.run.smithi136.stdout:(31/131): ceph-mgr-modules-core-18.0.0-2462.g80 2.1 MB/s | 236 kB 00:00 2023-03-02T10:44:49.694 INFO:teuthology.orchestra.run.smithi136.stdout:(32/131): ceph-mgr-rook-18.0.0-2462.g802de851.e 953 kB/s | 47 kB 00:00 2023-03-02T10:44:49.736 INFO:teuthology.orchestra.run.smithi136.stdout:(33/131): ceph-prometheus-alerts-18.0.0-2462.g8 350 kB/s | 15 kB 00:00 2023-03-02T10:44:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:(34/131): ceph-volume-18.0.0-2462.g802de851.el8 2.8 MB/s | 263 kB 00:00 2023-03-02T10:44:49.879 INFO:teuthology.orchestra.run.smithi136.stdout:(35/131): cephadm-18.0.0-2462.g802de851.el8.noa 1.6 MB/s | 82 kB 00:00 2023-03-02T10:44:49.920 INFO:teuthology.orchestra.run.smithi136.stdout:(36/131): cephfs-top-18.0.0-2462.g802de851.el8. 435 kB/s | 18 kB 00:00 2023-03-02T10:44:50.069 INFO:teuthology.orchestra.run.smithi057.stdout:(38/131): ceph-test-18.0.0-2462.g802de851.el8.x 11 MB/s | 48 MB 00:04 2023-03-02T10:44:50.094 INFO:teuthology.orchestra.run.smithi057.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 128 kB/s | 59 kB 00:00 2023-03-02T10:44:50.120 INFO:teuthology.orchestra.run.smithi136.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2023-03-02T10:44:50.171 INFO:teuthology.orchestra.run.smithi136.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2023-03-02T10:44:50.191 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2023-03-02T10:44:50.202 INFO:teuthology.orchestra.run.smithi057.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 565 kB/s | 75 kB 00:00 2023-03-02T10:44:50.221 INFO:teuthology.orchestra.run.smithi136.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-03-02T10:44:50.236 INFO:teuthology.orchestra.run.smithi057.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.3 MB/s | 476 kB 00:00 2023-03-02T10:44:50.262 INFO:teuthology.orchestra.run.smithi057.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 749 kB/s | 44 kB 00:00 2023-03-02T10:44:50.295 INFO:teuthology.orchestra.run.smithi057.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2023-03-02T10:44:50.305 INFO:teuthology.orchestra.run.smithi136.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 5.6 MB/s | 476 kB 00:00 2023-03-02T10:44:50.311 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2023-03-02T10:44:50.311 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2023-03-02T10:44:50.320 INFO:teuthology.orchestra.run.smithi057.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 565 kB/s | 33 kB 00:00 2023-03-02T10:44:50.345 INFO:teuthology.orchestra.run.smithi057.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 326 kB/s | 16 kB 00:00 2023-03-02T10:44:50.355 INFO:teuthology.orchestra.run.smithi136.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 876 kB/s | 44 kB 00:00 2023-03-02T10:44:50.404 INFO:teuthology.orchestra.run.smithi057.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-03-02T10:44:50.405 INFO:teuthology.orchestra.run.smithi136.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-03-02T10:44:50.429 INFO:teuthology.orchestra.run.smithi057.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-03-02T10:44:50.455 INFO:teuthology.orchestra.run.smithi057.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-03-02T10:44:50.456 INFO:teuthology.orchestra.run.smithi136.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 663 kB/s | 33 kB 00:00 2023-03-02T10:44:50.480 INFO:teuthology.orchestra.run.smithi057.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-03-02T10:44:50.505 INFO:teuthology.orchestra.run.smithi057.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-03-02T10:44:50.506 INFO:teuthology.orchestra.run.smithi136.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 327 kB/s | 16 kB 00:00 2023-03-02T10:44:50.556 INFO:teuthology.orchestra.run.smithi057.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 982 kB/s | 49 kB 00:00 2023-03-02T10:44:50.557 INFO:teuthology.orchestra.run.smithi136.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-03-02T10:44:50.606 INFO:teuthology.orchestra.run.smithi057.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.2 MB/s | 59 kB 00:00 2023-03-02T10:44:50.640 INFO:teuthology.orchestra.run.smithi136.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-03-02T10:44:50.656 INFO:teuthology.orchestra.run.smithi057.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-03-02T10:44:50.707 INFO:teuthology.orchestra.run.smithi136.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-03-02T10:44:50.723 INFO:teuthology.orchestra.run.smithi057.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 4.8 MB/s | 1.2 MB 00:00 2023-03-02T10:44:50.757 INFO:teuthology.orchestra.run.smithi136.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 223 kB/s | 11 kB 00:00 2023-03-02T10:44:50.773 INFO:teuthology.orchestra.run.smithi057.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-03-02T10:44:50.799 INFO:teuthology.orchestra.run.smithi057.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-03-02T10:44:50.800 INFO:teuthology.orchestra.run.smithi136.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 423 kB/s | 18 kB 00:00 2023-03-02T10:44:50.824 INFO:teuthology.orchestra.run.smithi057.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 672 kB/s | 34 kB 00:00 2023-03-02T10:44:50.858 INFO:teuthology.orchestra.run.smithi057.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-03-02T10:44:50.883 INFO:teuthology.orchestra.run.smithi057.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 1.0 MB/s | 61 kB 00:00 2023-03-02T10:44:50.908 INFO:teuthology.orchestra.run.smithi057.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 375 kB/s | 19 kB 00:00 2023-03-02T10:44:50.933 INFO:teuthology.orchestra.run.smithi057.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 478 kB/s | 24 kB 00:00 2023-03-02T10:44:50.958 INFO:teuthology.orchestra.run.smithi136.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 7.4 MB/s | 1.2 MB 00:00 2023-03-02T10:44:50.959 INFO:teuthology.orchestra.run.smithi057.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 586 kB/s | 29 kB 00:00 2023-03-02T10:44:50.984 INFO:teuthology.orchestra.run.smithi057.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 548 kB/s | 27 kB 00:00 2023-03-02T10:44:51.018 INFO:teuthology.orchestra.run.smithi057.stdout:(64/131): python3-waitress-1.2.1-2.el8.1.noarch 4.0 MB/s | 241 kB 00:00 2023-03-02T10:44:51.050 INFO:teuthology.orchestra.run.smithi136.stdout:(51/131): ceph-mgr-diskprediction-local-18.0.0- 3.6 MB/s | 7.4 MB 00:02 2023-03-02T10:44:51.051 INFO:teuthology.orchestra.run.smithi057.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2023-03-02T10:44:51.067 INFO:teuthology.orchestra.run.smithi136.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 448 kB/s | 49 kB 00:00 2023-03-02T10:44:51.076 INFO:teuthology.orchestra.run.smithi057.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-03-02T10:44:51.102 INFO:teuthology.orchestra.run.smithi057.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-03-02T10:44:51.117 INFO:teuthology.orchestra.run.smithi136.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-03-02T10:44:51.127 INFO:teuthology.orchestra.run.smithi057.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 459 kB/s | 23 kB 00:00 2023-03-02T10:44:51.161 INFO:teuthology.orchestra.run.smithi057.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 70 kB 00:00 2023-03-02T10:44:51.176 INFO:teuthology.orchestra.run.smithi136.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-03-02T10:44:51.201 INFO:teuthology.orchestra.run.smithi136.stdout:(55/131): python3-more-itertools-7.2.0-3.el8.no 390 kB/s | 59 kB 00:00 2023-03-02T10:44:51.219 INFO:teuthology.orchestra.run.smithi057.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 809 kB/s | 47 kB 00:00 2023-03-02T10:44:51.226 INFO:teuthology.orchestra.run.smithi136.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2023-03-02T10:44:51.252 INFO:teuthology.orchestra.run.smithi136.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 671 kB/s | 34 kB 00:00 2023-03-02T10:44:51.261 INFO:teuthology.orchestra.run.smithi057.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-03-02T10:44:51.287 INFO:teuthology.orchestra.run.smithi136.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-03-02T10:44:51.303 INFO:teuthology.orchestra.run.smithi057.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-03-02T10:44:51.344 INFO:teuthology.orchestra.run.smithi136.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 670 kB/s | 61 kB 00:00 2023-03-02T10:44:51.345 INFO:teuthology.orchestra.run.smithi057.stdout:(73/131): thrift-0.13.0-2.el8.x86_64.rpm 7.1 MB/s | 1.7 MB 00:00 2023-03-02T10:44:51.369 INFO:teuthology.orchestra.run.smithi136.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 224 kB/s | 19 kB 00:00 2023-03-02T10:44:51.379 INFO:teuthology.orchestra.run.smithi057.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-03-02T10:44:51.394 INFO:teuthology.orchestra.run.smithi136.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 475 kB/s | 24 kB 00:00 2023-03-02T10:44:51.420 INFO:teuthology.orchestra.run.smithi136.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 581 kB/s | 29 kB 00:00 2023-03-02T10:44:51.429 INFO:teuthology.orchestra.run.smithi057.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 580 kB/s | 48 kB 00:00 2023-03-02T10:44:51.434 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2023-03-02T10:44:51.439 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2023-03-02T10:44:51.453 INFO:teuthology.orchestra.run.smithi136.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 469 kB/s | 27 kB 00:00 2023-03-02T10:44:51.454 INFO:teuthology.orchestra.run.smithi057.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2023-03-02T10:44:51.479 INFO:teuthology.orchestra.run.smithi136.stdout:(64/131): python3-waitress-1.2.1-2.el8.1.noarch 4.0 MB/s | 241 kB 00:00 2023-03-02T10:44:51.479 INFO:teuthology.orchestra.run.smithi057.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 851 kB/s | 43 kB 00:00 2023-03-02T10:44:51.513 INFO:teuthology.orchestra.run.smithi057.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-03-02T10:44:51.529 INFO:teuthology.orchestra.run.smithi136.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-03-02T10:44:51.547 INFO:teuthology.orchestra.run.smithi057.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.4 MB/s | 229 kB 00:00 2023-03-02T10:44:51.555 INFO:teuthology.orchestra.run.smithi136.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-03-02T10:44:51.580 INFO:teuthology.orchestra.run.smithi136.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-03-02T10:44:51.589 INFO:teuthology.orchestra.run.smithi057.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 7.3 MB/s | 560 kB 00:00 2023-03-02T10:44:51.605 INFO:teuthology.orchestra.run.smithi136.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 458 kB/s | 23 kB 00:00 2023-03-02T10:44:51.614 INFO:teuthology.orchestra.run.smithi057.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 280 kB/s | 19 kB 00:00 2023-03-02T10:44:51.630 INFO:teuthology.orchestra.run.smithi136.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-03-02T10:44:51.648 INFO:teuthology.orchestra.run.smithi057.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-03-02T10:44:51.681 INFO:teuthology.orchestra.run.smithi136.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 939 kB/s | 47 kB 00:00 2023-03-02T10:44:51.689 INFO:teuthology.orchestra.run.smithi057.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 7.3 MB/s | 559 kB 00:00 2023-03-02T10:44:51.715 INFO:teuthology.orchestra.run.smithi057.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 268 kB/s | 18 kB 00:00 2023-03-02T10:44:51.723 INFO:teuthology.orchestra.run.smithi136.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-03-02T10:44:51.757 INFO:teuthology.orchestra.run.smithi136.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2023-03-02T10:44:51.757 INFO:teuthology.orchestra.run.smithi057.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.8 MB/s | 605 kB 00:00 2023-03-02T10:44:51.798 INFO:teuthology.orchestra.run.smithi136.stdout:(73/131): thrift-0.13.0-2.el8.x86_64.rpm 7.9 MB/s | 1.7 MB 00:00 2023-03-02T10:44:51.799 INFO:teuthology.orchestra.run.smithi057.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-03-02T10:44:51.824 INFO:teuthology.orchestra.run.smithi136.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-03-02T10:44:51.841 INFO:teuthology.orchestra.run.smithi057.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-03-02T10:44:51.866 INFO:teuthology.orchestra.run.smithi136.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.4 MB/s | 87 kB 00:00 2023-03-02T10:44:51.883 INFO:teuthology.orchestra.run.smithi057.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 2.0 MB/s | 83 kB 00:00 2023-03-02T10:44:51.891 INFO:teuthology.orchestra.run.smithi136.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 522 kB/s | 48 kB 00:00 2023-03-02T10:44:51.916 INFO:teuthology.orchestra.run.smithi136.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 852 kB/s | 43 kB 00:00 2023-03-02T10:44:51.924 INFO:teuthology.orchestra.run.smithi057.stdout:(89/131): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-03-02T10:44:51.966 INFO:teuthology.orchestra.run.smithi136.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-03-02T10:44:52.000 INFO:teuthology.orchestra.run.smithi136.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-03-02T10:44:52.034 INFO:teuthology.orchestra.run.smithi136.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.1 MB/s | 560 kB 00:00 2023-03-02T10:44:52.051 INFO:teuthology.orchestra.run.smithi136.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 373 kB/s | 19 kB 00:00 2023-03-02T10:44:52.076 INFO:teuthology.orchestra.run.smithi136.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-03-02T10:44:52.110 INFO:teuthology.orchestra.run.smithi136.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.3 MB/s | 559 kB 00:00 2023-03-02T10:44:52.127 INFO:teuthology.orchestra.run.smithi136.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 356 kB/s | 18 kB 00:00 2023-03-02T10:44:52.160 INFO:teuthology.orchestra.run.smithi136.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-03-02T10:44:52.175 INFO:teuthology.orchestra.run.smithi057.stdout:(90/131): ceph-common-18.0.0-2462.g802de851.el8 2.4 MB/s | 24 MB 00:10 2023-03-02T10:44:52.194 INFO:teuthology.orchestra.run.smithi136.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-03-02T10:44:52.200 INFO:teuthology.orchestra.run.smithi057.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 357 kB/s | 98 kB 00:00 2023-03-02T10:44:52.236 INFO:teuthology.orchestra.run.smithi136.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-03-02T10:44:52.259 INFO:teuthology.orchestra.run.smithi057.stdout:(92/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 4.6 MB/s | 2.3 MB 00:00 2023-03-02T10:44:52.284 INFO:teuthology.orchestra.run.smithi057.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 514 kB/s | 39 kB 00:00 2023-03-02T10:44:52.309 INFO:teuthology.orchestra.run.smithi057.stdout:(94/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 432 kB/s | 58 kB 00:00 2023-03-02T10:44:52.328 INFO:teuthology.orchestra.run.smithi136.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 902 kB/s | 83 kB 00:00 2023-03-02T10:44:52.343 INFO:teuthology.orchestra.run.smithi057.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-03-02T10:44:52.368 INFO:teuthology.orchestra.run.smithi057.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.3 MB/s | 138 kB 00:00 2023-03-02T10:44:52.370 INFO:teuthology.orchestra.run.smithi136.stdout:(89/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 11 MB/s | 2.3 MB 00:00 2023-03-02T10:44:52.395 INFO:teuthology.orchestra.run.smithi136.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 894 kB/s | 60 kB 00:00 2023-03-02T10:44:52.401 INFO:teuthology.orchestra.run.smithi057.stdout:(97/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 4.4 MB/s | 644 kB 00:00 2023-03-02T10:44:52.427 INFO:teuthology.orchestra.run.smithi057.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-03-02T10:44:52.429 INFO:teuthology.orchestra.run.smithi136.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.6 MB/s | 98 kB 00:00 2023-03-02T10:44:52.452 INFO:teuthology.orchestra.run.smithi057.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-03-02T10:44:52.454 INFO:teuthology.orchestra.run.smithi136.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 984 kB/s | 58 kB 00:00 2023-03-02T10:44:52.471 INFO:teuthology.orchestra.run.smithi136.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 921 kB/s | 39 kB 00:00 2023-03-02T10:44:52.486 INFO:teuthology.orchestra.run.smithi057.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-03-02T10:44:52.505 INFO:teuthology.orchestra.run.smithi136.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 13 MB/s | 644 kB 00:00 2023-03-02T10:44:52.519 INFO:teuthology.orchestra.run.smithi057.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-03-02T10:44:52.530 INFO:teuthology.orchestra.run.smithi136.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-03-02T10:44:52.545 INFO:teuthology.orchestra.run.smithi057.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 662 kB/s | 39 kB 00:00 2023-03-02T10:44:52.555 INFO:teuthology.orchestra.run.smithi136.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-03-02T10:44:52.603 INFO:teuthology.orchestra.run.smithi057.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 8.0 MB/s | 688 kB 00:00 2023-03-02T10:44:52.623 INFO:teuthology.orchestra.run.smithi136.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-03-02T10:44:52.637 INFO:teuthology.orchestra.run.smithi057.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 5.7 MB/s | 538 kB 00:00 2023-03-02T10:44:52.665 INFO:teuthology.orchestra.run.smithi136.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-03-02T10:44:52.670 INFO:teuthology.orchestra.run.smithi057.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-03-02T10:44:52.704 INFO:teuthology.orchestra.run.smithi057.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2023-03-02T10:44:52.706 INFO:teuthology.orchestra.run.smithi136.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-03-02T10:44:52.756 INFO:teuthology.orchestra.run.smithi057.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 8.4 MB/s | 713 kB 00:00 2023-03-02T10:44:52.757 INFO:teuthology.orchestra.run.smithi136.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-03-02T10:44:52.796 INFO:teuthology.orchestra.run.smithi057.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 638 kB/s | 27 kB 00:00 2023-03-02T10:44:52.798 INFO:teuthology.orchestra.run.smithi136.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 939 kB/s | 39 kB 00:00 2023-03-02T10:44:52.847 INFO:teuthology.orchestra.run.smithi057.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2023-03-02T10:44:52.849 INFO:teuthology.orchestra.run.smithi136.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-03-02T10:44:52.889 INFO:teuthology.orchestra.run.smithi057.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-03-02T10:44:52.899 INFO:teuthology.orchestra.run.smithi136.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 11 MB/s | 538 kB 00:00 2023-03-02T10:44:53.030 INFO:teuthology.orchestra.run.smithi057.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-03-02T10:44:53.058 INFO:teuthology.orchestra.run.smithi136.stdout:(104/131): python3-scipy-1.0.0-21.module+el8.5. 26 MB/s | 14 MB 00:00 2023-03-02T10:44:53.081 INFO:teuthology.orchestra.run.smithi057.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-03-02T10:44:53.083 INFO:teuthology.orchestra.run.smithi136.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 855 kB/s | 157 kB 00:00 2023-03-02T10:44:53.109 INFO:teuthology.orchestra.run.smithi136.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-03-02T10:44:53.131 INFO:teuthology.orchestra.run.smithi057.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 4.4 MB/s | 225 kB 00:00 2023-03-02T10:44:53.142 INFO:teuthology.orchestra.run.smithi136.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-03-02T10:44:53.176 INFO:teuthology.orchestra.run.smithi136.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 796 kB/s | 27 kB 00:00 2023-03-02T10:44:53.190 INFO:teuthology.orchestra.run.smithi057.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 12 MB/s | 3.7 MB 00:00 2023-03-02T10:44:53.215 INFO:teuthology.orchestra.run.smithi057.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 767 kB/s | 64 kB 00:00 2023-03-02T10:44:53.239 INFO:teuthology.orchestra.run.smithi136.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 5.0 MB/s | 320 kB 00:00 2023-03-02T10:44:53.240 INFO:teuthology.orchestra.run.smithi057.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-03-02T10:44:53.274 INFO:teuthology.orchestra.run.smithi057.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 340 kB/s | 20 kB 00:00 2023-03-02T10:44:53.285 INFO:teuthology.orchestra.run.smithi136.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 966 kB/s | 44 kB 00:00 2023-03-02T10:44:53.299 INFO:teuthology.orchestra.run.smithi057.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.7 MB/s | 103 kB 00:00 2023-03-02T10:44:53.358 INFO:teuthology.orchestra.run.smithi057.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-03-02T10:44:53.360 INFO:teuthology.orchestra.run.smithi136.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-03-02T10:44:53.400 INFO:teuthology.orchestra.run.smithi057.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-03-02T10:44:53.402 INFO:teuthology.orchestra.run.smithi136.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-03-02T10:44:53.444 INFO:teuthology.orchestra.run.smithi136.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-03-02T10:44:53.511 INFO:teuthology.orchestra.run.smithi136.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-03-02T10:44:53.536 INFO:teuthology.orchestra.run.smithi136.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 697 kB/s | 64 kB 00:00 2023-03-02T10:44:53.561 INFO:teuthology.orchestra.run.smithi136.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-03-02T10:44:53.587 INFO:teuthology.orchestra.run.smithi136.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 396 kB/s | 20 kB 00:00 2023-03-02T10:44:53.612 INFO:teuthology.orchestra.run.smithi136.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-03-02T10:44:53.646 INFO:teuthology.orchestra.run.smithi136.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-03-02T10:44:53.658 INFO:teuthology.orchestra.run.smithi057.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 10 MB/s | 14 MB 00:01 2023-03-02T10:44:53.688 INFO:teuthology.orchestra.run.smithi136.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-03-02T10:44:53.700 INFO:teuthology.orchestra.run.smithi057.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-03-02T10:44:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.0 MB/s | 354 kB 00:00 2023-03-02T10:44:53.805 INFO:teuthology.orchestra.run.smithi136.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 25 MB/s | 4.9 MB 00:00 2023-03-02T10:44:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 8.9 MB/s | 4.9 MB 00:00 2023-03-02T10:44:53.846 INFO:teuthology.orchestra.run.smithi136.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-03-02T10:44:53.930 INFO:teuthology.orchestra.run.smithi136.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-03-02T10:44:53.943 INFO:teuthology.orchestra.run.smithi057.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 8.7 MB/s | 4.7 MB 00:00 2023-03-02T10:44:53.956 INFO:teuthology.orchestra.run.smithi136.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-03-02T10:44:53.985 INFO:teuthology.orchestra.run.smithi057.stdout:(126/131): postgresql-contrib-10.21-2.module+el 5.6 MB/s | 808 kB 00:00 2023-03-02T10:44:54.014 INFO:teuthology.orchestra.run.smithi136.stdout:(125/131): postgresql-contrib-10.21-2.module+el 14 MB/s | 808 kB 00:00 2023-03-02T10:44:54.060 INFO:teuthology.orchestra.run.smithi057.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-03-02T10:44:54.160 INFO:teuthology.orchestra.run.smithi057.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-03-02T10:44:54.227 INFO:teuthology.orchestra.run.smithi057.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 12 MB/s | 798 kB 00:00 2023-03-02T10:44:54.423 INFO:teuthology.orchestra.run.smithi136.stdout:(126/131): ceph-test-18.0.0-2462.g802de851.el8. 4.4 MB/s | 48 MB 00:10 2023-03-02T10:44:54.482 INFO:teuthology.orchestra.run.smithi136.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 3.2 MB/s | 1.5 MB 00:00 2023-03-02T10:44:54.565 INFO:teuthology.orchestra.run.smithi136.stdout:(128/131): postgresql-server-10.21-2.module+el8 8.0 MB/s | 5.1 MB 00:00 2023-03-02T10:44:54.616 INFO:teuthology.orchestra.run.smithi136.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-03-02T10:44:54.778 INFO:teuthology.orchestra.run.smithi057.stdout:(130/131): librbd1-18.0.0-2462.g802de851.el8.x8 5.0 MB/s | 3.6 MB 00:00 2023-03-02T10:44:55.244 INFO:teuthology.orchestra.run.smithi057.stdout:(131/131): librados2-18.0.0-2462.g802de851.el8. 2.9 MB/s | 3.6 MB 00:01 2023-03-02T10:44:55.246 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-03-02T10:44:55.247 INFO:teuthology.orchestra.run.smithi057.stdout:Total 15 MB/s | 205 MB 00:13 2023-03-02T10:44:56.365 INFO:teuthology.orchestra.run.smithi136.stdout:(130/131): librbd1-18.0.0-2462.g802de851.el8.x8 1.9 MB/s | 3.6 MB 00:01 2023-03-02T10:44:56.725 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2023-03-02T10:44:56.893 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-02T10:44:57.058 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-02T10:44:57.124 INFO:teuthology.orchestra.run.smithi136.stdout:(131/131): librados2-18.0.0-2462.g802de851.el8. 1.3 MB/s | 3.6 MB 00:02 2023-03-02T10:44:57.126 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2023-03-02T10:44:57.127 INFO:teuthology.orchestra.run.smithi136.stdout:Total 9.8 MB/s | 205 MB 00:20 2023-03-02T10:44:57.268 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-03-02T10:44:57.412 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-02T10:44:57.509 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-02T10:44:57.728 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-02T10:44:57.963 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2023-03-02T10:44:58.082 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2023-03-02T10:44:58.083 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2023-03-02T10:44:58.156 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-02T10:44:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:18.0.0-2462.g802de851.el8.x86_64 6/134 2023-03-02T10:44:58.413 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-03-02T10:44:58.567 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-03-02T10:44:58.567 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-03-02T10:44:58.770 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:18.0.0-2462.g802de851.el8.x86_64 6/134 2023-03-02T10:44:58.945 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:18.0.0-2462.g802de851.el8.x86_64 7/134 2023-03-02T10:44:59.053 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:18.0.0-2462.g802de851.el8.x86_64 7/134 2023-03-02T10:44:59.204 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2023-03-02T10:44:59.208 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2023-03-02T10:44:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 8/134 2023-03-02T10:44:59.292 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 8/134 2023-03-02T10:44:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:18.0.0-2462.g802de851.el8.x86_64 9/134 2023-03-02T10:44:59.732 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-02T10:44:59.880 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-03-02T10:44:59.885 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-03-02T10:44:59.914 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-02T10:45:00.311 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-02T10:45:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-02T10:45:00.678 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 14/134 2023-03-02T10:45:00.764 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 14/134 2023-03-02T10:45:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:18.0.0-2462.g802de851.el8.x86 15/134 2023-03-02T10:45:00.953 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2462.g802de851.el8.x86 15/134 2023-03-02T10:45:01.086 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-02T10:45:01.226 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-02T10:45:01.419 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-02T10:45:02.040 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-02T10:45:02.228 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-02T10:45:02.826 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-02T10:45:03.027 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-03-02T10:45:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-03-02T10:45:03.967 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-03-02T10:45:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2023-03-02T10:45:04.202 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-02T10:45:04.220 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-03-02T10:45:04.377 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-02T10:45:04.431 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-03-02T10:45:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-03-02T10:45:04.600 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-03-02T10:45:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-03-02T10:45:04.789 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-03-02T10:45:04.834 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-03-02T10:45:04.838 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-03-02T10:45:04.999 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-02T10:45:05.062 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-02T10:45:05.205 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-02T10:45:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:18.0.0-2462.g802de851.el8. 26/134 2023-03-02T10:45:05.233 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-03-02T10:45:05.358 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-03-02T10:45:05.388 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:18.0.0-2462.g802de851.el 27/134 2023-03-02T10:45:05.446 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:18.0.0-2462.g802de851.el8.x86_64 5/134 2023-03-02T10:45:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-03-02T10:45:05.733 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-03-02T10:45:05.838 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:18.0.0-2462.g802de851.el8.x86_64 5/134 2023-03-02T10:45:06.054 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:18.0.0-2462.g802de851.el8.x86_64 6/134 2023-03-02T10:45:06.179 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:18.0.0-2462.g802de851.el8.x86_64 6/134 2023-03-02T10:45:06.286 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-03-02T10:45:06.292 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:18.0.0-2462.g802de851.el8.x86_6 28/134 2023-03-02T10:45:06.370 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 7/134 2023-03-02T10:45:06.468 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 7/134 2023-03-02T10:45:06.491 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:18.0.0-2462.g802de851.el8.x86_64 5/134 2023-03-02T10:45:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:18.0.0-2462.g802de851.el8.x86_64 8/134 2023-03-02T10:45:06.635 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-03-02T10:45:06.793 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-03-02T10:45:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-03-02T10:45:07.029 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:18.0.0-2462.g802de851.el8.x86_64 5/134 2023-03-02T10:45:07.032 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-02T10:45:07.174 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-03-02T10:45:07.183 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:18.0.0-2462.g802de851.el8.x86_64 6/134 2023-03-02T10:45:07.231 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-02T10:45:07.344 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-02T10:45:07.382 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:18.0.0-2462.g802de851.el8.x86_64 6/134 2023-03-02T10:45:07.549 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 7/134 2023-03-02T10:45:07.649 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-02T10:45:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 7/134 2023-03-02T10:45:07.864 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:18.0.0-2462.g802de851.el8.x86_64 8/134 2023-03-02T10:45:07.873 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-02T10:45:08.030 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-03-02T10:45:08.045 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 14/134 2023-03-02T10:45:08.149 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 14/134 2023-03-02T10:45:08.287 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:18.0.0-2462.g802de851.el8.x86 15/134 2023-03-02T10:45:08.293 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-02T10:45:08.432 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2462.g802de851.el8.x86 15/134 2023-03-02T10:45:08.507 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-02T10:45:08.951 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-03-02T10:45:08.953 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-02T10:45:09.089 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-02T10:45:09.143 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-03-02T10:45:09.325 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-03-02T10:45:09.421 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-03-02T10:45:09.470 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-03-02T10:45:09.598 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-02T10:45:09.610 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-03-02T10:45:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-02T10:45:09.740 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 14/134 2023-03-02T10:45:09.778 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-03-02T10:45:09.812 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-02T10:45:09.914 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 14/134 2023-03-02T10:45:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:18.0.0-2462.g802de851.el8.x86_64 36/134 2023-03-02T10:45:10.082 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:18.0.0-2462.g802de851.el8.x86 15/134 2023-03-02T10:45:10.197 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:18.0.0-2462.g802de851.el8.x86_6 37/134 2023-03-02T10:45:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2462.g802de851.el8.x86 15/134 2023-03-02T10:45:10.334 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-03-02T10:45:10.440 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-03-02T10:45:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-03-02T10:45:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-03-02T10:45:10.645 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-03-02T10:45:10.711 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-03-02T10:45:10.729 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-03-02T10:45:10.864 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-03-02T10:45:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-03-02T10:45:11.057 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-03-02T10:45:11.108 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-03-02T10:45:11.246 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-03-02T10:45:11.260 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-03-02T10:45:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-03-02T10:45:11.423 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-03-02T10:45:11.427 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-03-02T10:45:11.644 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-03-02T10:45:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-03-02T10:45:12.061 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-03-02T10:45:12.107 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-03-02T10:45:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-03-02T10:45:12.312 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-03-02T10:45:12.350 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-03-02T10:45:12.440 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-03-02T10:45:12.573 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-03-02T10:45:12.574 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-03-02T10:45:12.803 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-02T10:45:12.918 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-03-02T10:45:12.958 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:18.0.0-2462.g802de851.el8. 26/134 2023-03-02T10:45:13.112 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:18.0.0-2462.g802de851.el 27/134 2023-03-02T10:45:13.126 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-03-02T10:45:13.251 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-03-02T10:45:13.286 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-03-02T10:45:13.332 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:18.0.0-2462.g802de851.el8.x86_6 28/134 2023-03-02T10:45:13.423 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-03-02T10:45:13.506 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-03-02T10:45:13.535 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-03-02T10:45:13.655 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-03-02T10:45:13.804 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-03-02T10:45:14.116 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-03-02T10:45:14.357 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-03-02T10:45:14.407 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-03-02T10:45:14.622 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-03-02T10:45:14.656 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-03-02T10:45:14.841 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-03-02T10:45:14.896 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-03-02T10:45:15.017 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-03-02T10:45:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-02T10:45:15.203 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-03-02T10:45:15.269 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-03-02T10:45:15.376 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-03-02T10:45:15.398 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:18.0.0-2462.g802de851.el8. 26/134 2023-03-02T10:45:15.447 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-03-02T10:45:15.563 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:18.0.0-2462.g802de851.el 27/134 2023-03-02T10:45:15.680 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-03-02T10:45:15.848 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:18.0.0-2462.g802de851.el8.x86_6 28/134 2023-03-02T10:45:15.887 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-03-02T10:45:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-02T10:45:16.039 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-03-02T10:45:16.101 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-02T10:45:16.245 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-03-02T10:45:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-03-02T10:45:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-03-02T10:45:16.558 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-03-02T10:45:16.667 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-02T10:45:16.811 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-03-02T10:45:16.854 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-02T10:45:17.049 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-03-02T10:45:17.091 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-02T10:45:17.237 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-02T10:45:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-02T10:45:17.412 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-02T10:45:17.480 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-02T10:45:17.590 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:18.0.0-2462.g802de851.el8.x86_64 36/134 2023-03-02T10:45:17.611 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-02T10:45:17.732 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:18.0.0-2462.g802de851.el8.x86_6 37/134 2023-03-02T10:45:17.784 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-02T10:45:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-03-02T10:45:17.993 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-03-02T10:45:17.994 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-02T10:45:18.159 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-03-02T10:45:18.169 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-02T10:45:18.257 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-03-02T10:45:18.337 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-02T10:45:18.439 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-03-02T10:45:18.464 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-02T10:45:18.469 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-03-02T10:45:18.695 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-03-02T10:45:18.711 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-02T10:45:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-03-02T10:45:18.937 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-02T10:45:18.968 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-03-02T10:45:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-02T10:45:19.162 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-03-02T10:45:19.313 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-03-02T10:45:19.356 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-02T10:45:19.508 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-03-02T10:45:19.558 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-02T10:45:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-03-02T10:45:19.741 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-03-02T10:45:19.759 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-02T10:45:19.870 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-03-02T10:45:19.968 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-02T10:45:20.012 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-03-02T10:45:20.144 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-03-02T10:45:20.231 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-03-02T10:45:20.421 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-03-02T10:45:20.425 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-03-02T10:45:20.683 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-03-02T10:45:20.809 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-03-02T10:45:20.934 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-02T10:45:21.054 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-02T10:45:21.103 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-03-02T10:45:21.166 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-02T10:45:21.303 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-03-02T10:45:21.304 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-02T10:45:21.348 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:18.0.0-2462.g802de851.el8.x86_64 36/134 2023-03-02T10:45:21.540 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:18.0.0-2462.g802de851.el8.x86_6 37/134 2023-03-02T10:45:21.563 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-03-02T10:45:21.567 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-02T10:45:21.700 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-03-02T10:45:21.814 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-03-02T10:45:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-02T10:45:21.886 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-03-02T10:45:22.088 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-03-02T10:45:22.142 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-02T10:45:22.168 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-03-02T10:45:22.198 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-03-02T10:45:22.317 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-02T10:45:22.366 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-03-02T10:45:22.479 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-03-02T10:45:22.551 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-03-02T10:45:22.680 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-03-02T10:45:22.830 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-03-02T10:45:22.838 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-03-02T10:45:22.977 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-03-02T10:45:22.987 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-03-02T10:45:23.058 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-02T10:45:23.153 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-03-02T10:45:23.221 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-03-02T10:45:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:18.0.0-2462.g802de851.el8.x86_64 92/134 2023-03-02T10:45:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:18.0.0-2462.g802de851.el8.x86_64 92/134 2023-03-02T10:45:23.369 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-03-02T10:45:23.469 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-03-02T10:45:23.484 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:18.0.0-2462.g802de851.el8.x86_64 93/134 2023-03-02T10:45:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-03-02T10:45:23.710 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-03-02T10:45:23.738 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-03-02T10:45:23.900 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-03-02T10:45:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-03-02T10:45:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-03-02T10:45:24.276 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-03-02T10:45:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-03-02T10:45:24.466 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-02T10:45:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-03-02T10:45:24.653 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-02T10:45:24.915 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-02T10:45:25.005 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-03-02T10:45:25.106 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-02T10:45:25.271 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-02T10:45:25.291 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-03-02T10:45:25.402 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-02T10:45:25.532 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-03-02T10:45:25.568 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-02T10:45:25.754 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-02T10:45:25.781 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-03-02T10:45:25.961 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-02T10:45:26.028 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-03-02T10:45:26.136 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-02T10:45:26.264 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-02T10:45:26.357 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-03-02T10:45:26.504 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-02T10:45:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-03-02T10:45:26.745 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-02T10:45:26.809 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-03-02T10:45:26.913 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-02T10:45:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-03-02T10:45:27.137 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-02T10:45:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-03-02T10:45:27.340 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-02T10:45:27.404 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-03-02T10:45:27.489 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-02T10:45:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 94/134 2023-03-02T10:45:27.688 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-02T10:45:27.781 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-03-02T10:45:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 94/134 2023-03-02T10:45:28.110 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-03-02T10:45:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 94/134 2023-03-02T10:45:28.421 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-03-02T10:45:28.634 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 95/134 2023-03-02T10:45:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-03-02T10:45:28.710 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 95/134 2023-03-02T10:45:28.826 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-02T10:45:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-02T10:45:28.924 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 96/134 2023-03-02T10:45:29.050 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-02T10:45:29.077 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-02T10:45:29.315 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-02T10:45:29.373 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-02T10:45:29.606 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-02T10:45:29.647 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-02T10:45:29.793 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-02T10:45:29.952 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-02T10:45:29.965 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-02T10:45:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-02T10:45:30.165 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-02T10:45:30.348 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-02T10:45:30.572 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-02T10:45:30.750 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-02T10:45:30.886 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-02T10:45:30.965 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-02T10:45:31.152 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-02T10:45:31.165 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:18.0.0-2462.g802de851.el8.x86_64 92/134 2023-03-02T10:45:31.225 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:18.0.0-2462.g802de851.el8.x86_64 92/134 2023-03-02T10:45:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-02T10:45:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:18.0.0-2462.g802de851.el8.x86_64 93/134 2023-03-02T10:45:31.562 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-02T10:45:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-02T10:45:32.090 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-02T10:45:32.267 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-02T10:45:32.518 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-02T10:45:34.070 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-02T10:45:34.381 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-02T10:45:34.665 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-02T10:45:35.090 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-02T10:45:35.163 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 94/134 2023-03-02T10:45:35.374 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-02T10:45:35.390 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 94/134 2023-03-02T10:45:35.563 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-02T10:45:35.948 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 94/134 2023-03-02T10:45:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 95/134 2023-03-02T10:45:36.320 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 95/134 2023-03-02T10:45:36.447 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 96/134 2023-03-02T10:45:36.475 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-02T10:45:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:18.0.0-2462.g802de851.el8.x86_64 92/134 2023-03-02T10:45:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:18.0.0-2462.g802de851.el8.x86_64 92/134 2023-03-02T10:45:36.962 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:18.0.0-2462.g802de851.el8.x86_64 93/134 2023-03-02T10:45:43.376 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 94/134 2023-03-02T10:45:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 94/134 2023-03-02T10:45:44.368 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 94/134 2023-03-02T10:45:44.673 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 95/134 2023-03-02T10:45:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 95/134 2023-03-02T10:45:44.993 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 96/134 2023-03-02T10:45:47.908 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 96/134 2023-03-02T10:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2023-03-02T10:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2023-03-02T10:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /dev 2023-03-02T10:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /run 2023-03-02T10:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2023-03-02T10:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2023-03-02T10:45:47.909 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2023-03-02T10:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2023-03-02T10:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /dev 2023-03-02T10:45:47.910 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:45:48.306 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 97/134 2023-03-02T10:45:49.792 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 97/134 2023-03-02T10:45:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 98/134 2023-03-02T10:45:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 98/134 2023-03-02T10:45:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 99/134 2023-03-02T10:45:50.787 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 99/134 2023-03-02T10:45:50.922 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 100/134 2023-03-02T10:45:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 100/134 2023-03-02T10:45:52.584 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:18.0.0-2462.g802de851.el8.noarch 101/134 2023-03-02T10:45:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:18.0.0-2462.g802de851.el8.noarch 101/134 2023-03-02T10:45:52.911 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2462.g802de851.e 102/134 2023-03-02T10:45:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2462.g802de851. 103/134 2023-03-02T10:45:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noa 104/134 2023-03-02T10:45:53.489 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noa 104/134 2023-03-02T10:45:53.805 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.n 105/134 2023-03-02T10:45:54.765 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.n 105/134 2023-03-02T10:45:54.904 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2462.g802 106/134 2023-03-02T10:45:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2462.g802 106/134 2023-03-02T10:45:55.374 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2462.g802de851.el 107/134 2023-03-02T10:45:55.452 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 96/134 2023-03-02T10:45:55.452 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2023-03-02T10:45:55.453 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2023-03-02T10:45:55.453 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2023-03-02T10:45:55.453 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /run 2023-03-02T10:45:55.453 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2023-03-02T10:45:55.453 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2023-03-02T10:45:55.453 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2023-03-02T10:45:55.453 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2023-03-02T10:45:55.453 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2023-03-02T10:45:55.454 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:45:55.570 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 108/134 2023-03-02T10:45:55.606 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 108/134 2023-03-02T10:45:55.760 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 97/134 2023-03-02T10:45:55.788 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 109/134 2023-03-02T10:45:55.800 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 109/134 2023-03-02T10:45:57.024 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:18.0.0-2462.g802de851.el8.x86_64 110/134 2023-03-02T10:45:57.242 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 97/134 2023-03-02T10:45:57.277 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 111/134 2023-03-02T10:45:57.311 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 111/134 2023-03-02T10:45:57.431 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 98/134 2023-03-02T10:45:57.488 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2462.g802de 112/134 2023-03-02T10:45:57.530 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2462.g802de 112/134 2023-03-02T10:45:57.647 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 98/134 2023-03-02T10:45:57.679 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 113/134 2023-03-02T10:45:57.818 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 99/134 2023-03-02T10:45:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 113/134 2023-03-02T10:45:58.180 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 114/134 2023-03-02T10:45:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 99/134 2023-03-02T10:45:58.351 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 100/134 2023-03-02T10:45:58.368 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 100/134 2023-03-02T10:45:59.967 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:18.0.0-2462.g802de851.el8.noarch 101/134 2023-03-02T10:46:00.175 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:18.0.0-2462.g802de851.el8.noarch 101/134 2023-03-02T10:46:00.298 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2462.g802de851.e 102/134 2023-03-02T10:46:00.537 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2462.g802de851. 103/134 2023-03-02T10:46:00.725 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noa 104/134 2023-03-02T10:46:00.941 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noa 104/134 2023-03-02T10:46:01.188 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.n 105/134 2023-03-02T10:46:02.149 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.n 105/134 2023-03-02T10:46:02.291 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2462.g802 106/134 2023-03-02T10:46:02.380 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2462.g802 106/134 2023-03-02T10:46:02.692 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 114/134 2023-03-02T10:46:02.749 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2462.g802de851.el 107/134 2023-03-02T10:46:02.956 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:18.0.0-2462.g802de851.el8.x86_64 115/134 2023-03-02T10:46:03.002 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 108/134 2023-03-02T10:46:03.036 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 108/134 2023-03-02T10:46:03.095 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-03-02T10:46:03.208 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 109/134 2023-03-02T10:46:03.220 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 109/134 2023-03-02T10:46:03.283 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-03-02T10:46:04.122 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-03-02T10:46:04.458 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:18.0.0-2462.g802de851.el8.x86_64 110/134 2023-03-02T10:46:04.459 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-03-02T10:46:04.640 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:18.0.0-2462.g802de851.el8.x86_64 119/134 2023-03-02T10:46:04.647 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 111/134 2023-03-02T10:46:04.681 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 111/134 2023-03-02T10:46:04.799 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-02T10:46:04.833 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2462.g802de 112/134 2023-03-02T10:46:04.874 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2462.g802de 112/134 2023-03-02T10:46:04.999 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:18.0.0-2462.g802de851.el8.x86_ 121/134 2023-03-02T10:46:05.066 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 113/134 2023-03-02T10:46:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-02T10:46:05.410 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 113/134 2023-03-02T10:46:05.608 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 114/134 2023-03-02T10:46:07.272 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-02T10:46:07.528 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 96/134 2023-03-02T10:46:07.528 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2023-03-02T10:46:07.528 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2023-03-02T10:46:07.528 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2023-03-02T10:46:07.528 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /run 2023-03-02T10:46:07.529 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2023-03-02T10:46:07.529 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2023-03-02T10:46:07.529 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2023-03-02T10:46:07.529 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2023-03-02T10:46:07.529 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2023-03-02T10:46:07.529 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:46:07.530 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-02T10:46:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-02T10:46:07.695 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-top-2:18.0.0-2462.g802de851.el8.noarch 124/134 2023-03-02T10:46:07.957 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 97/134 2023-03-02T10:46:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:18.0.0-2462.g802de851.el8.x86_64 125/134 2023-03-02T10:46:08.315 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:18.0.0-2462.g802de851.el8.x86_64 126/134 2023-03-02T10:46:08.580 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-02T10:46:08.703 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-02T10:46:08.711 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-02T10:46:08.871 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-03-02T10:46:09.069 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-03-02T10:46:09.144 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-03-02T10:46:09.328 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-03-02T10:46:09.340 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-03-02T10:46:09.340 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-02T10:46:09.572 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-02T10:46:09.572 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-02T10:46:09.790 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-02T10:46:09.823 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 97/134 2023-03-02T10:46:09.985 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-02T10:46:10.011 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 98/134 2023-03-02T10:46:10.121 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 114/134 2023-03-02T10:46:10.287 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-02T10:46:10.287 INFO:teuthology.orchestra.run.smithi122.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-02T10:46:10.287 INFO:teuthology.orchestra.run.smithi122.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-02T10:46:10.287 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:46:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 98/134 2023-03-02T10:46:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:18.0.0-2462.g802de851.el8.x86_64 1/134 2023-03-02T10:46:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 2/134 2023-03-02T10:46:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 3/134 2023-03-02T10:46:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:18.0.0-2462.g802de851.el8.x86_64 4/134 2023-03-02T10:46:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2462.g802de 5/134 2023-03-02T10:46:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 6/134 2023-03-02T10:46:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 7/134 2023-03-02T10:46:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 8/134 2023-03-02T10:46:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 9/134 2023-03-02T10:46:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 10/134 2023-03-02T10:46:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 11/134 2023-03-02T10:46:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:18.0.0-2462.g802de851.el8.x86_64 12/134 2023-03-02T10:46:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 13/134 2023-03-02T10:46:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:18.0.0-2462.g802de851.el8.x86_ 14/134 2023-03-02T10:46:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 15/134 2023-03-02T10:46:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 16/134 2023-03-02T10:46:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:18.0.0-2462.g802de851.el8.x86_6 17/134 2023-03-02T10:46:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:18.0.0-2462.g802de851.el8.x86 18/134 2023-03-02T10:46:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:18.0.0-2462.g802de851.el8.x86_64 19/134 2023-03-02T10:46:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2462.g802de851.el 20/134 2023-03-02T10:46:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:18.0.0-2462.g802de851.el8. 21/134 2023-03-02T10:46:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:18.0.0-2462.g802de851.el8.x86_6 22/134 2023-03-02T10:46:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:18.0.0-2462.g802de851.el8.x86_64 23/134 2023-03-02T10:46:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:18.0.0-2462.g802de851.el8.x86_64 24/134 2023-03-02T10:46:10.522 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:18.0.0-2462.g802de851.el8.x86_64 25/134 2023-03-02T10:46:10.522 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:18.0.0-2462.g802de851.el8.x86_64 26/134 2023-03-02T10:46:10.522 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 27/134 2023-03-02T10:46:10.522 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:18.0.0-2462.g802de851.el8.x86_64 28/134 2023-03-02T10:46:10.522 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2462.g802de851. 29/134 2023-03-02T10:46:10.522 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noa 30/134 2023-03-02T10:46:10.522 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.n 31/134 2023-03-02T10:46:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2462.g802 32/134 2023-03-02T10:46:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2462.g802de851.el 33/134 2023-03-02T10:46:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 34/134 2023-03-02T10:46:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2462.g802de851.e 35/134 2023-03-02T10:46:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 36/134 2023-03-02T10:46:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:18.0.0-2462.g802de851.el8.noarch 37/134 2023-03-02T10:46:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-top-2:18.0.0-2462.g802de851.el8.noarch 38/134 2023-03-02T10:46:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-02T10:46:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-02T10:46:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-02T10:46:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-02T10:46:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-02T10:46:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-02T10:46:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-02T10:46:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-02T10:46:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-02T10:46:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-02T10:46:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-02T10:46:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-02T10:46:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-02T10:46:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-02T10:46:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-02T10:46:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-02T10:46:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-02T10:46:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-02T10:46:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-02T10:46:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-02T10:46:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-02T10:46:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-02T10:46:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-02T10:46:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-02T10:46:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-02T10:46:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-02T10:46:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-02T10:46:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-02T10:46:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-02T10:46:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-02T10:46:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-02T10:46:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-02T10:46:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-02T10:46:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-03-02T10:46:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-03-02T10:46:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-03-02T10:46:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-03-02T10:46:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-03-02T10:46:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-03-02T10:46:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-03-02T10:46:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-03-02T10:46:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-03-02T10:46:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-03-02T10:46:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-03-02T10:46:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-03-02T10:46:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-03-02T10:46:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-03-02T10:46:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-03-02T10:46:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-03-02T10:46:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-03-02T10:46:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-03-02T10:46:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-03-02T10:46:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-03-02T10:46:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-03-02T10:46:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-03-02T10:46:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-03-02T10:46:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-03-02T10:46:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-03-02T10:46:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-03-02T10:46:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-03-02T10:46:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-03-02T10:46:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-03-02T10:46:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-03-02T10:46:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-03-02T10:46:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-03-02T10:46:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-03-02T10:46:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-03-02T10:46:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-03-02T10:46:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-03-02T10:46:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-03-02T10:46:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-03-02T10:46:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-03-02T10:46:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-03-02T10:46:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-03-02T10:46:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-03-02T10:46:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-03-02T10:46:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-03-02T10:46:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-03-02T10:46:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-03-02T10:46:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-03-02T10:46:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-03-02T10:46:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-02T10:46:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-03-02T10:46:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-02T10:46:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-03-02T10:46:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-03-02T10:46:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-03-02T10:46:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-03-02T10:46:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-03-02T10:46:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-02T10:46:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:18.0.0-2462.g802de851.el8.x86_64 129/134 2023-03-02T10:46:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-02T10:46:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:18.0.0-2462.g802de851.el8.x86_64 131/134 2023-03-02T10:46:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-02T10:46:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-02T10:46:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 99/134 2023-03-02T10:46:10.980 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:18.0.0-2462.g802de851.el8.x86_64 115/134 2023-03-02T10:46:11.068 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 99/134 2023-03-02T10:46:11.265 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 100/134 2023-03-02T10:46:11.270 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-03-02T10:46:11.344 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 100/134 2023-03-02T10:46:11.484 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:18.0.0-2462.g802de851.el8.x86_64 117/134 2023-03-02T10:46:11.732 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-03-02T10:46:11.981 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-03-02T10:46:12.169 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-03-02T10:46:12.402 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-03-02T10:46:12.569 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:18.0.0-2462.g802de851.el8.x86_ 121/134 2023-03-02T10:46:12.741 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-02T10:46:13.033 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-02T10:46:13.033 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:49 ago on Thu 02 Mar 2023 10:44:24 AM UTC. 2023-03-02T10:46:14.730 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:18.0.0-2462.g802de851.el8.noarch 101/134 2023-03-02T10:46:14.862 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-02T10:46:14.922 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephadm-2:18.0.0-2462.g802de851.el8.noarch 101/134 2023-03-02T10:46:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2462.g802de851.e 102/134 2023-03-02T10:46:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-02T10:46:15.190 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-02T10:46:15.314 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2462.g802de851. 103/134 2023-03-02T10:46:15.440 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:18.0.0-2462.g802de851.el8.noarch 124/134 2023-03-02T10:46:15.514 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noa 104/134 2023-03-02T10:46:15.601 INFO:teuthology.orchestra.run.smithi122.stdout:Installed products updated. 2023-03-02T10:46:15.664 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:18.0.0-2462.g802de851.el8.x86_64 125/134 2023-03-02T10:46:15.814 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:46:15.815 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2023-03-02T10:46:15.815 INFO:teuthology.orchestra.run.smithi122.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-02T10:46:15.815 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.815 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.815 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2023-03-02T10:46:15.816 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-02T10:46:15.816 INFO:teuthology.orchestra.run.smithi122.stdout: automake-1.16.1-7.el8.noarch 2023-03-02T10:46:15.816 INFO:teuthology.orchestra.run.smithi122.stdout: bison-3.0.4-10.el8.x86_64 2023-03-02T10:46:15.816 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.816 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.816 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.816 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.817 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:15.817 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.817 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.817 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.818 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:15.819 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:15.819 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:15.819 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:15.819 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:15.819 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.819 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.819 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:15.820 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.820 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.820 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.820 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:15.820 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:15.820 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.820 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:15.821 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-02T10:46:15.821 INFO:teuthology.orchestra.run.smithi122.stdout: flex-2.6.1-9.el8.x86_64 2023-03-02T10:46:15.821 INFO:teuthology.orchestra.run.smithi122.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-02T10:46:15.821 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-02T10:46:15.821 INFO:teuthology.orchestra.run.smithi122.stdout: jq-1.6-3.el8.x86_64 2023-03-02T10:46:15.821 INFO:teuthology.orchestra.run.smithi122.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-02T10:46:15.821 INFO:teuthology.orchestra.run.smithi122.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-02T10:46:15.822 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-02T10:46:15.822 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.822 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.822 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.822 INFO:teuthology.orchestra.run.smithi122.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-02T10:46:15.822 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-02T10:46:15.822 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-02T10:46:15.822 INFO:teuthology.orchestra.run.smithi122.stdout: libpq-13.5-1.el8.x86_64 2023-03-02T10:46:15.823 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-02T10:46:15.823 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-02T10:46:15.823 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.823 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.823 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-02T10:46:15.823 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.823 INFO:teuthology.orchestra.run.smithi122.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-02T10:46:15.824 INFO:teuthology.orchestra.run.smithi122.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-02T10:46:15.824 INFO:teuthology.orchestra.run.smithi122.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-02T10:46:15.824 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-02T10:46:15.824 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-02T10:46:15.824 INFO:teuthology.orchestra.run.smithi122.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-02T10:46:15.824 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-02T10:46:15.824 INFO:teuthology.orchestra.run.smithi122.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-02T10:46:15.825 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-02T10:46:15.825 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-02T10:46:15.825 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-02T10:46:15.825 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-02T10:46:15.825 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-02T10:46:15.825 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-02T10:46:15.825 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-02T10:46:15.826 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-02T10:46:15.826 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-02T10:46:15.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-02T10:46:15.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-02T10:46:15.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-02T10:46:15.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-02T10:46:15.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-02T10:46:15.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-02T10:46:15.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-02T10:46:15.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-02T10:46:15.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-02T10:46:15.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-02T10:46:15.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-02T10:46:15.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-02T10:46:15.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-02T10:46:15.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-02T10:46:15.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-02T10:46:15.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-02T10:46:15.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-02T10:46:15.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-02T10:46:15.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-02T10:46:15.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-02T10:46:15.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-02T10:46:15.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-02T10:46:15.830 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-02T10:46:15.830 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-02T10:46:15.830 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-02T10:46:15.830 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-02T10:46:15.830 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-02T10:46:15.830 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-2.6-1.el8.noarch 2023-03-02T10:46:15.830 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-02T10:46:15.831 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-02T10:46:15.831 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-02T10:46:15.831 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-02T10:46:15.831 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-02T10:46:15.831 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-02T10:46:15.831 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.831 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-02T10:46:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-02T10:46:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-02T10:46:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-02T10:46:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-02T10:46:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-02T10:46:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-02T10:46:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-02T10:46:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-02T10:46:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-02T10:46:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-02T10:46:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-02T10:46:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-02T10:46:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-02T10:46:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-02T10:46:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-02T10:46:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-02T10:46:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-02T10:46:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-02T10:46:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-02T10:46:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-02T10:46:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-03-02T10:46:15.837 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2023-03-02T10:46:15.838 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noa 104/134 2023-03-02T10:46:15.986 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:18.0.0-2462.g802de851.el8.x86_64 126/134 2023-03-02T10:46:16.026 DEBUG:teuthology.parallel:result is None 2023-03-02T10:46:16.027 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.n 105/134 2023-03-02T10:46:16.282 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-02T10:46:16.480 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-03-02T10:46:16.555 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-03-02T10:46:16.780 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-03-02T10:46:16.792 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-03-02T10:46:16.955 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-03-02T10:46:16.964 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-03-02T10:46:17.132 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-03-02T10:46:17.132 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-02T10:46:17.317 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-02T10:46:17.317 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-02T10:46:17.335 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.n 105/134 2023-03-02T10:46:17.496 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2462.g802 106/134 2023-03-02T10:46:17.535 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-02T10:46:17.673 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2462.g802 106/134 2023-03-02T10:46:17.762 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-02T10:46:18.056 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-02T10:46:18.056 INFO:teuthology.orchestra.run.smithi136.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-02T10:46:18.057 INFO:teuthology.orchestra.run.smithi136.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-02T10:46:18.057 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:46:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2462.g802de851.el 107/134 2023-03-02T10:46:18.282 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:18.0.0-2462.g802de851.el8.x86_64 1/134 2023-03-02T10:46:18.282 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 2/134 2023-03-02T10:46:18.283 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 3/134 2023-03-02T10:46:18.283 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:18.0.0-2462.g802de851.el8.x86_64 4/134 2023-03-02T10:46:18.283 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2462.g802de 5/134 2023-03-02T10:46:18.283 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 6/134 2023-03-02T10:46:18.283 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 7/134 2023-03-02T10:46:18.283 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 8/134 2023-03-02T10:46:18.283 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 9/134 2023-03-02T10:46:18.284 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 10/134 2023-03-02T10:46:18.284 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 11/134 2023-03-02T10:46:18.284 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:18.0.0-2462.g802de851.el8.x86_64 12/134 2023-03-02T10:46:18.284 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 13/134 2023-03-02T10:46:18.284 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:18.0.0-2462.g802de851.el8.x86_ 14/134 2023-03-02T10:46:18.284 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 15/134 2023-03-02T10:46:18.284 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 16/134 2023-03-02T10:46:18.284 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:18.0.0-2462.g802de851.el8.x86_6 17/134 2023-03-02T10:46:18.285 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:18.0.0-2462.g802de851.el8.x86 18/134 2023-03-02T10:46:18.285 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:18.0.0-2462.g802de851.el8.x86_64 19/134 2023-03-02T10:46:18.285 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2462.g802de851.el 20/134 2023-03-02T10:46:18.285 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:18.0.0-2462.g802de851.el8. 21/134 2023-03-02T10:46:18.285 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:18.0.0-2462.g802de851.el8.x86_6 22/134 2023-03-02T10:46:18.285 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:18.0.0-2462.g802de851.el8.x86_64 23/134 2023-03-02T10:46:18.285 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:18.0.0-2462.g802de851.el8.x86_64 24/134 2023-03-02T10:46:18.286 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:18.0.0-2462.g802de851.el8.x86_64 25/134 2023-03-02T10:46:18.292 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 108/134 2023-03-02T10:46:18.293 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:18.0.0-2462.g802de851.el8.x86_64 26/134 2023-03-02T10:46:18.293 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 27/134 2023-03-02T10:46:18.293 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:18.0.0-2462.g802de851.el8.x86_64 28/134 2023-03-02T10:46:18.294 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2462.g802de851. 29/134 2023-03-02T10:46:18.294 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noa 30/134 2023-03-02T10:46:18.294 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.n 31/134 2023-03-02T10:46:18.294 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2462.g802 32/134 2023-03-02T10:46:18.294 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2462.g802de851.el 33/134 2023-03-02T10:46:18.294 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 34/134 2023-03-02T10:46:18.294 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2462.g802de851.e 35/134 2023-03-02T10:46:18.295 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 36/134 2023-03-02T10:46:18.295 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:18.0.0-2462.g802de851.el8.noarch 37/134 2023-03-02T10:46:18.295 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:18.0.0-2462.g802de851.el8.noarch 38/134 2023-03-02T10:46:18.295 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-02T10:46:18.295 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-02T10:46:18.295 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-02T10:46:18.295 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-02T10:46:18.296 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-02T10:46:18.296 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-02T10:46:18.296 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-02T10:46:18.296 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-02T10:46:18.296 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-02T10:46:18.296 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-02T10:46:18.296 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-02T10:46:18.296 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-02T10:46:18.297 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-02T10:46:18.297 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-02T10:46:18.297 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-02T10:46:18.297 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-02T10:46:18.297 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-02T10:46:18.297 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-02T10:46:18.297 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-02T10:46:18.297 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-02T10:46:18.298 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-02T10:46:18.298 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-02T10:46:18.298 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-02T10:46:18.298 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-02T10:46:18.298 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-02T10:46:18.298 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-02T10:46:18.298 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-02T10:46:18.299 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-02T10:46:18.299 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-02T10:46:18.299 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-02T10:46:18.299 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-02T10:46:18.299 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-02T10:46:18.299 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-02T10:46:18.299 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-03-02T10:46:18.300 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-03-02T10:46:18.300 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-03-02T10:46:18.300 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-03-02T10:46:18.300 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-03-02T10:46:18.300 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-03-02T10:46:18.300 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-03-02T10:46:18.300 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-03-02T10:46:18.300 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-03-02T10:46:18.301 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-03-02T10:46:18.301 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-03-02T10:46:18.301 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-03-02T10:46:18.301 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-03-02T10:46:18.301 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-03-02T10:46:18.301 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-03-02T10:46:18.301 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-03-02T10:46:18.302 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-03-02T10:46:18.302 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-03-02T10:46:18.302 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-03-02T10:46:18.302 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-03-02T10:46:18.302 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-03-02T10:46:18.303 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-03-02T10:46:18.304 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-03-02T10:46:18.304 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-03-02T10:46:18.304 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-03-02T10:46:18.304 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-03-02T10:46:18.304 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-03-02T10:46:18.304 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-03-02T10:46:18.304 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-03-02T10:46:18.305 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-03-02T10:46:18.305 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-03-02T10:46:18.305 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-03-02T10:46:18.305 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-03-02T10:46:18.305 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-03-02T10:46:18.305 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-03-02T10:46:18.305 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-03-02T10:46:18.306 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-03-02T10:46:18.306 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-03-02T10:46:18.306 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-03-02T10:46:18.306 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-03-02T10:46:18.306 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-03-02T10:46:18.306 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-03-02T10:46:18.307 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-03-02T10:46:18.307 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-03-02T10:46:18.307 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-03-02T10:46:18.307 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-03-02T10:46:18.307 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-03-02T10:46:18.308 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-03-02T10:46:18.308 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-03-02T10:46:18.308 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-03-02T10:46:18.308 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-03-02T10:46:18.308 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-03-02T10:46:18.308 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-03-02T10:46:18.308 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-03-02T10:46:18.308 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-03-02T10:46:18.309 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-03-02T10:46:18.309 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-03-02T10:46:18.309 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:18.0.0-2462.g802de851.el8.x86_64 129/134 2023-03-02T10:46:18.309 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-02T10:46:18.309 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:18.0.0-2462.g802de851.el8.x86_64 131/134 2023-03-02T10:46:18.309 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-02T10:46:18.309 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-02T10:46:18.396 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 108/134 2023-03-02T10:46:18.565 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 109/134 2023-03-02T10:46:18.623 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 109/134 2023-03-02T10:46:20.144 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:18.0.0-2462.g802de851.el8.x86_64 110/134 2023-03-02T10:46:20.470 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 111/134 2023-03-02T10:46:20.572 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 111/134 2023-03-02T10:46:20.722 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2462.g802de 112/134 2023-03-02T10:46:20.756 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-02T10:46:20.756 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:56 ago on Thu 02 Mar 2023 10:44:24 AM UTC. 2023-03-02T10:46:20.835 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2462.g802de 112/134 2023-03-02T10:46:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 113/134 2023-03-02T10:46:21.483 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 113/134 2023-03-02T10:46:21.663 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 114/134 2023-03-02T10:46:23.213 INFO:teuthology.orchestra.run.smithi136.stdout:Installed products updated. 2023-03-02T10:46:23.437 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:46:23.438 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2023-03-02T10:46:23.438 INFO:teuthology.orchestra.run.smithi136.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-02T10:46:23.438 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.438 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.438 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2023-03-02T10:46:23.438 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-02T10:46:23.439 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.1-7.el8.noarch 2023-03-02T10:46:23.439 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.0.4-10.el8.x86_64 2023-03-02T10:46:23.439 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.439 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.439 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.439 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.439 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:23.440 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.440 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.440 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.440 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:23.440 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:23.440 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:23.440 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:23.440 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:23.441 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.441 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.441 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:23.441 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.441 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.441 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.441 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:23.442 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:23.442 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.442 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:23.442 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-02T10:46:23.442 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.1-9.el8.x86_64 2023-03-02T10:46:23.442 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-02T10:46:23.443 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-02T10:46:23.443 INFO:teuthology.orchestra.run.smithi136.stdout: jq-1.6-3.el8.x86_64 2023-03-02T10:46:23.443 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-02T10:46:23.443 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-02T10:46:23.444 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-02T10:46:23.444 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.444 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.444 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.445 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-02T10:46:23.445 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-02T10:46:23.445 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-02T10:46:23.445 INFO:teuthology.orchestra.run.smithi136.stdout: libpq-13.5-1.el8.x86_64 2023-03-02T10:46:23.445 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-02T10:46:23.445 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-02T10:46:23.445 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.446 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.446 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-02T10:46:23.446 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.446 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-02T10:46:23.446 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-02T10:46:23.446 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-02T10:46:23.446 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-02T10:46:23.447 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-02T10:46:23.447 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-02T10:46:23.447 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-02T10:46:23.447 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-02T10:46:23.447 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-02T10:46:23.447 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-02T10:46:23.447 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-02T10:46:23.448 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-02T10:46:23.448 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-02T10:46:23.448 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-02T10:46:23.448 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-02T10:46:23.448 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-02T10:46:23.448 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-02T10:46:23.448 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-02T10:46:23.449 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-02T10:46:23.449 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-02T10:46:23.449 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-02T10:46:23.449 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-02T10:46:23.449 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.449 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.449 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.450 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-02T10:46:23.450 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-02T10:46:23.450 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-02T10:46:23.450 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-02T10:46:23.450 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-02T10:46:23.450 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-02T10:46:23.450 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-02T10:46:23.450 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-02T10:46:23.451 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-02T10:46:23.451 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-02T10:46:23.451 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-02T10:46:23.451 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-02T10:46:23.451 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-02T10:46:23.451 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-02T10:46:23.451 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-02T10:46:23.452 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-02T10:46:23.452 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-02T10:46:23.452 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-02T10:46:23.452 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-02T10:46:23.452 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-02T10:46:23.452 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-02T10:46:23.452 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-02T10:46:23.452 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-2.6-1.el8.noarch 2023-03-02T10:46:23.453 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-02T10:46:23.453 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-02T10:46:23.453 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-02T10:46:23.453 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-02T10:46:23.453 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-02T10:46:23.453 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-02T10:46:23.453 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.454 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.454 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-02T10:46:23.454 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-02T10:46:23.454 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.454 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-02T10:46:23.454 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-02T10:46:23.454 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-02T10:46:23.454 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-02T10:46:23.455 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-02T10:46:23.455 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-02T10:46:23.455 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-02T10:46:23.455 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-02T10:46:23.455 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-02T10:46:23.455 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-02T10:46:23.455 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-02T10:46:23.456 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-02T10:46:23.456 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-02T10:46:23.456 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.456 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.456 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:23.456 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-02T10:46:23.456 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-02T10:46:23.456 INFO:teuthology.orchestra.run.smithi136.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-02T10:46:23.457 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-02T10:46:23.457 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-02T10:46:23.457 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-02T10:46:23.457 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:46:23.458 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2023-03-02T10:46:23.643 DEBUG:teuthology.parallel:result is None 2023-03-02T10:46:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 114/134 2023-03-02T10:46:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:18.0.0-2462.g802de851.el8.x86_64 115/134 2023-03-02T10:46:29.217 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-03-02T10:46:29.395 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:18.0.0-2462.g802de851.el8.x86_64 117/134 2023-03-02T10:46:29.648 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-03-02T10:46:29.795 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-03-02T10:46:30.118 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-03-02T10:46:30.334 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-03-02T10:46:30.526 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:18.0.0-2462.g802de851.el8.x86_ 121/134 2023-03-02T10:46:30.666 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-02T10:46:34.765 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-02T10:46:35.162 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-02T10:46:35.231 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-02T10:46:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-top-2:18.0.0-2462.g802de851.el8.noarch 124/134 2023-03-02T10:46:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:18.0.0-2462.g802de851.el8.x86_64 125/134 2023-03-02T10:46:36.007 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:18.0.0-2462.g802de851.el8.x86_64 126/134 2023-03-02T10:46:36.327 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-02T10:46:36.503 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-03-02T10:46:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-03-02T10:46:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-03-02T10:46:36.893 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-03-02T10:46:37.077 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-03-02T10:46:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-03-02T10:46:37.298 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-03-02T10:46:37.299 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-02T10:46:37.545 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-02T10:46:37.545 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-02T10:46:37.818 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-02T10:46:38.037 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-02T10:46:38.476 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-02T10:46:38.477 INFO:teuthology.orchestra.run.smithi057.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-03-02T10:46:38.477 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:46:38.942 INFO:teuthology.orchestra.run.smithi057.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-02T10:46:38.942 INFO:teuthology.orchestra.run.smithi057.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-02T10:46:38.942 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:46:39.305 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:18.0.0-2462.g802de851.el8.x86_64 1/134 2023-03-02T10:46:39.305 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 2/134 2023-03-02T10:46:39.306 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 3/134 2023-03-02T10:46:39.306 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:18.0.0-2462.g802de851.el8.x86_64 4/134 2023-03-02T10:46:39.306 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2462.g802de 5/134 2023-03-02T10:46:39.306 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 6/134 2023-03-02T10:46:39.306 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 7/134 2023-03-02T10:46:39.306 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 8/134 2023-03-02T10:46:39.306 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 9/134 2023-03-02T10:46:39.307 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 10/134 2023-03-02T10:46:39.307 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 11/134 2023-03-02T10:46:39.307 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:18.0.0-2462.g802de851.el8.x86_64 12/134 2023-03-02T10:46:39.307 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 13/134 2023-03-02T10:46:39.307 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:18.0.0-2462.g802de851.el8.x86_ 14/134 2023-03-02T10:46:39.308 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 15/134 2023-03-02T10:46:39.308 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 16/134 2023-03-02T10:46:39.309 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:18.0.0-2462.g802de851.el8.x86_6 17/134 2023-03-02T10:46:39.309 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:18.0.0-2462.g802de851.el8.x86 18/134 2023-03-02T10:46:39.309 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:18.0.0-2462.g802de851.el8.x86_64 19/134 2023-03-02T10:46:39.309 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2462.g802de851.el 20/134 2023-03-02T10:46:39.310 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:18.0.0-2462.g802de851.el8. 21/134 2023-03-02T10:46:39.310 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:18.0.0-2462.g802de851.el8.x86_6 22/134 2023-03-02T10:46:39.310 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:18.0.0-2462.g802de851.el8.x86_64 23/134 2023-03-02T10:46:39.310 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:18.0.0-2462.g802de851.el8.x86_64 24/134 2023-03-02T10:46:39.310 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:18.0.0-2462.g802de851.el8.x86_64 25/134 2023-03-02T10:46:39.318 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:18.0.0-2462.g802de851.el8.x86_64 26/134 2023-03-02T10:46:39.318 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 27/134 2023-03-02T10:46:39.318 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:18.0.0-2462.g802de851.el8.x86_64 28/134 2023-03-02T10:46:39.319 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2462.g802de851. 29/134 2023-03-02T10:46:39.319 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noa 30/134 2023-03-02T10:46:39.319 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.n 31/134 2023-03-02T10:46:39.319 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2462.g802 32/134 2023-03-02T10:46:39.319 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2462.g802de851.el 33/134 2023-03-02T10:46:39.319 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 34/134 2023-03-02T10:46:39.319 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2462.g802de851.e 35/134 2023-03-02T10:46:39.320 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 36/134 2023-03-02T10:46:39.320 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephadm-2:18.0.0-2462.g802de851.el8.noarch 37/134 2023-03-02T10:46:39.320 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-top-2:18.0.0-2462.g802de851.el8.noarch 38/134 2023-03-02T10:46:39.320 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-02T10:46:39.320 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-02T10:46:39.320 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-02T10:46:39.320 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-02T10:46:39.320 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-02T10:46:39.321 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-02T10:46:39.321 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-02T10:46:39.321 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-02T10:46:39.321 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-02T10:46:39.321 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-02T10:46:39.321 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-02T10:46:39.321 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-02T10:46:39.322 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-02T10:46:39.322 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-02T10:46:39.322 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-02T10:46:39.322 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-02T10:46:39.322 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-02T10:46:39.322 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-02T10:46:39.322 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-02T10:46:39.322 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-02T10:46:39.323 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-02T10:46:39.323 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-02T10:46:39.323 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-02T10:46:39.323 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-02T10:46:39.323 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-02T10:46:39.323 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-02T10:46:39.323 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-02T10:46:39.324 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-02T10:46:39.324 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-02T10:46:39.324 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-02T10:46:39.324 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-02T10:46:39.324 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-02T10:46:39.324 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-02T10:46:39.324 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-03-02T10:46:39.324 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-03-02T10:46:39.325 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-03-02T10:46:39.325 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-03-02T10:46:39.325 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-03-02T10:46:39.325 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-03-02T10:46:39.325 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-03-02T10:46:39.325 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-03-02T10:46:39.325 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-03-02T10:46:39.326 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-03-02T10:46:39.326 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-03-02T10:46:39.326 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-03-02T10:46:39.326 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-03-02T10:46:39.326 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-03-02T10:46:39.326 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-03-02T10:46:39.326 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-03-02T10:46:39.327 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-03-02T10:46:39.327 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-03-02T10:46:39.327 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-03-02T10:46:39.327 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-03-02T10:46:39.327 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-03-02T10:46:39.327 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-03-02T10:46:39.327 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-03-02T10:46:39.327 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-03-02T10:46:39.328 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-03-02T10:46:39.328 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-03-02T10:46:39.328 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-03-02T10:46:39.328 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-03-02T10:46:39.328 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-03-02T10:46:39.328 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-03-02T10:46:39.328 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-03-02T10:46:39.328 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-03-02T10:46:39.329 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-03-02T10:46:39.329 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-03-02T10:46:39.329 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-03-02T10:46:39.329 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-03-02T10:46:39.329 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-03-02T10:46:39.329 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-03-02T10:46:39.329 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-03-02T10:46:39.330 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-03-02T10:46:39.330 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-03-02T10:46:39.330 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-03-02T10:46:39.330 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-03-02T10:46:39.330 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-03-02T10:46:39.330 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-03-02T10:46:39.330 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-03-02T10:46:39.330 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-03-02T10:46:39.331 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-03-02T10:46:39.331 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-03-02T10:46:39.331 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-03-02T10:46:39.331 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-03-02T10:46:39.331 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-03-02T10:46:39.331 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-03-02T10:46:39.331 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-03-02T10:46:39.331 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-03-02T10:46:39.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-03-02T10:46:39.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-03-02T10:46:39.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:18.0.0-2462.g802de851.el8.x86_64 129/134 2023-03-02T10:46:39.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-02T10:46:39.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:18.0.0-2462.g802de851.el8.x86_64 131/134 2023-03-02T10:46:39.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-02T10:46:39.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-02T10:46:42.861 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-02T10:46:42.861 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:14 ago on Thu 02 Mar 2023 10:44:28 AM UTC. 2023-03-02T10:46:45.661 INFO:teuthology.orchestra.run.smithi057.stdout:Installed products updated. 2023-03-02T10:46:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:46:45.906 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2023-03-02T10:46:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-02T10:46:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.907 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-03-02T10:46:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-02T10:46:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: automake-1.16.1-7.el8.noarch 2023-03-02T10:46:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: bison-3.0.4-10.el8.x86_64 2023-03-02T10:46:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top-2:18.0.0-2462.g802de851.el8.noarch 2023-03-02T10:46:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-02T10:46:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: flex-2.6.1-9.el8.x86_64 2023-03-02T10:46:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-02T10:46:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-02T10:46:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: jq-1.6-3.el8.x86_64 2023-03-02T10:46:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-02T10:46:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-02T10:46:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-02T10:46:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-02T10:46:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-02T10:46:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-02T10:46:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: libpq-13.5-1.el8.x86_64 2023-03-02T10:46:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-02T10:46:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-02T10:46:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-02T10:46:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-02T10:46:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-02T10:46:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-02T10:46:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-02T10:46:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-02T10:46:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-02T10:46:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-02T10:46:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-02T10:46:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-02T10:46:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-02T10:46:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-02T10:46:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-02T10:46:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-02T10:46:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-02T10:46:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-02T10:46:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-02T10:46:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-02T10:46:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-02T10:46:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-02T10:46:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-02T10:46:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-02T10:46:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-02T10:46:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-02T10:46:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-02T10:46:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-02T10:46:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-02T10:46:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-02T10:46:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-02T10:46:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-02T10:46:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-02T10:46:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-02T10:46:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-02T10:46:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-02T10:46:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-02T10:46:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-02T10:46:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-02T10:46:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-02T10:46:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-02T10:46:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-02T10:46:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-02T10:46:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-02T10:46:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-02T10:46:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-02T10:46:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-02T10:46:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-2.6-1.el8.noarch 2023-03-02T10:46:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-02T10:46:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-02T10:46:45.920 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-02T10:46:45.920 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-02T10:46:45.920 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-02T10:46:45.920 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-02T10:46:45.920 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.920 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.920 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-02T10:46:45.921 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-02T10:46:45.921 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.921 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-02T10:46:45.921 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-02T10:46:45.921 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-02T10:46:45.921 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-02T10:46:45.921 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-02T10:46:45.921 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-02T10:46:45.922 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-02T10:46:45.922 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-02T10:46:45.922 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-02T10:46:45.922 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-02T10:46:45.922 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-02T10:46:45.922 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-02T10:46:45.922 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-02T10:46:45.923 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.923 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.923 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:18.0.0-2462.g802de851.el8.x86_64 2023-03-02T10:46:45.923 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-02T10:46:45.923 INFO:teuthology.orchestra.run.smithi057.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-02T10:46:45.923 INFO:teuthology.orchestra.run.smithi057.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-02T10:46:45.923 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-02T10:46:45.923 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-02T10:46:45.924 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-02T10:46:45.924 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:46:45.924 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-03-02T10:46:46.623 DEBUG:teuthology.parallel:result is None 2023-03-02T10:46:46.624 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=802de851643c97960b33dacc1e3ce8486e6d7d3c 2023-03-02T10:46:46.792 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-02T10:46:46.875 INFO:teuthology.orchestra.run.smithi057.stdout:18.0.0-2462.g802de851.el8 2023-03-02T10:46:46.876 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2462.g802de851.el8 2023-03-02T10:46:46.877 INFO:teuthology.task.install:The correct ceph version 18.0.0-2462.g802de851 is installed. 2023-03-02T10:46:46.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=802de851643c97960b33dacc1e3ce8486e6d7d3c 2023-03-02T10:46:47.023 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-02T10:46:47.053 INFO:teuthology.orchestra.run.smithi122.stdout:18.0.0-2462.g802de851.el8 2023-03-02T10:46:47.053 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2462.g802de851.el8 2023-03-02T10:46:47.054 INFO:teuthology.task.install:The correct ceph version 18.0.0-2462.g802de851 is installed. 2023-03-02T10:46:47.054 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=802de851643c97960b33dacc1e3ce8486e6d7d3c 2023-03-02T10:46:47.197 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-02T10:46:47.227 INFO:teuthology.orchestra.run.smithi136.stdout:18.0.0-2462.g802de851.el8 2023-03-02T10:46:47.227 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2462.g802de851.el8 2023-03-02T10:46:47.228 INFO:teuthology.task.install:The correct ceph version 18.0.0-2462.g802de851 is installed. 2023-03-02T10:46:47.229 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-03-02T10:46:47.229 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:46:47.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-02T10:46:47.357 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-03-02T10:46:47.358 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-02T10:46:47.406 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-02T10:46:47.407 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-02T10:46:47.452 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-03-02T10:46:47.453 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:46:47.453 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2023-03-02T10:46:47.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-02T10:46:47.665 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-03-02T10:46:47.665 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2023-03-02T10:46:47.702 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-02T10:46:47.772 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-02T10:46:47.773 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2023-03-02T10:46:47.805 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-02T10:46:47.875 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-03-02T10:46:47.875 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:46:47.875 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-02T10:46:47.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-02T10:46:48.119 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-03-02T10:46:48.119 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-02T10:46:48.152 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-02T10:46:48.224 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-02T10:46:48.225 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-02T10:46:48.256 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-02T10:46:48.326 INFO:teuthology.run_tasks:Running task cephadm... 2023-03-02T10:46:48.418 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '802de851643c97960b33dacc1e3ce8486e6d7d3c', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-03-02T10:46:48.418 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c 2023-03-02T10:46:48.428 INFO:tasks.cephadm:Cluster fsid is 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:46:48.429 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-03-02T10:46:48.430 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.57', 'mon.b': '172.21.15.122', 'mon.c': '172.21.15.136'} 2023-03-02T10:46:48.430 INFO:tasks.cephadm:First mon is mon.a on smithi057 2023-03-02T10:46:48.430 INFO:tasks.cephadm:First mgr is x 2023-03-02T10:46:48.430 INFO:tasks.cephadm:Normalizing hostnames... 2023-03-02T10:46:48.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname $(hostname -s) 2023-03-02T10:46:48.535 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname $(hostname -s) 2023-03-02T10:46:48.568 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname $(hostname -s) 2023-03-02T10:46:48.601 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-03-02T10:46:48.602 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=802de851643c97960b33dacc1e3ce8486e6d7d3c 2023-03-02T10:46:48.742 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '802de851643c97960b33dacc1e3ce8486e6d7d3c', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/68174/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-2462-g802de851', 'node_name': '172.21.2.4+braggi04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-2462.g802de851'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-02-22 06:20:03.196708', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20230222.044949', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-03-02T10:46:48.886 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-vshankar-testing-20230222.044949, sha1 802de851643c97960b33dacc1e3ce8486e6d7d3c from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=802de851643c97960b33dacc1e3ce8486e6d7d3c 2023-03-02T10:46:48.886 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/x86_64/flavors/default/cephadm 2023-03-02T10:46:48.887 DEBUG:teuthology.orchestra.run.smithi057:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-03-02T10:46:49.279 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-rw-r--. 1 ubuntu ubuntu 378437 Mar 2 10:46 /home/ubuntu/cephtest/cephadm 2023-03-02T10:46:49.280 DEBUG:teuthology.orchestra.run.smithi122:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-03-02T10:46:49.653 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-rw-r--. 1 ubuntu ubuntu 378437 Mar 2 10:46 /home/ubuntu/cephtest/cephadm 2023-03-02T10:46:49.653 DEBUG:teuthology.orchestra.run.smithi136:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230222.044949/802de851643c97960b33dacc1e3ce8486e6d7d3c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-03-02T10:46:49.991 INFO:teuthology.orchestra.run.smithi136.stdout:-rw-rw-r--. 1 ubuntu ubuntu 378437 Mar 2 10:46 /home/ubuntu/cephtest/cephadm 2023-03-02T10:46:49.992 DEBUG:teuthology.orchestra.run.smithi057:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-03-02T10:46:50.065 DEBUG:teuthology.orchestra.run.smithi122:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-03-02T10:46:50.087 DEBUG:teuthology.orchestra.run.smithi136:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-03-02T10:46:50.127 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c on all hosts... 2023-03-02T10:46:50.128 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c pull 2023-03-02T10:46:50.136 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c pull 2023-03-02T10:46:50.139 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c pull 2023-03-02T10:46:51.485 INFO:teuthology.orchestra.run.smithi136.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c... 2023-03-02T10:46:51.509 INFO:teuthology.orchestra.run.smithi122.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c... 2023-03-02T10:46:54.904 INFO:teuthology.orchestra.run.smithi057.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c... 2023-03-02T10:47:28.468 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:47:28.468 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev)", 2023-03-02T10:47:28.468 INFO:teuthology.orchestra.run.smithi057.stdout: "image_id": "635875b567003ef93f6ca3f4f94b02e754088ba6482d0225c4a91731141ddcb5", 2023-03-02T10:47:28.469 INFO:teuthology.orchestra.run.smithi057.stdout: "repo_digests": [ 2023-03-02T10:47:28.469 INFO:teuthology.orchestra.run.smithi057.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:77ac3d24b8181abbe9021e07a8d476c68e23e9aeaeac00f458051cfb4424d406" 2023-03-02T10:47:28.469 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-03-02T10:47:28.469 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:47:40.981 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2023-03-02T10:47:40.982 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev)", 2023-03-02T10:47:40.982 INFO:teuthology.orchestra.run.smithi136.stdout: "image_id": "635875b567003ef93f6ca3f4f94b02e754088ba6482d0225c4a91731141ddcb5", 2023-03-02T10:47:40.982 INFO:teuthology.orchestra.run.smithi136.stdout: "repo_digests": [ 2023-03-02T10:47:40.982 INFO:teuthology.orchestra.run.smithi136.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:77ac3d24b8181abbe9021e07a8d476c68e23e9aeaeac00f458051cfb4424d406" 2023-03-02T10:47:40.982 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2023-03-02T10:47:40.982 INFO:teuthology.orchestra.run.smithi136.stdout:} 2023-03-02T10:47:41.288 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2023-03-02T10:47:41.288 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_version": "ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev)", 2023-03-02T10:47:41.288 INFO:teuthology.orchestra.run.smithi122.stdout: "image_id": "635875b567003ef93f6ca3f4f94b02e754088ba6482d0225c4a91731141ddcb5", 2023-03-02T10:47:41.289 INFO:teuthology.orchestra.run.smithi122.stdout: "repo_digests": [ 2023-03-02T10:47:41.289 INFO:teuthology.orchestra.run.smithi122.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:77ac3d24b8181abbe9021e07a8d476c68e23e9aeaeac00f458051cfb4424d406" 2023-03-02T10:47:41.289 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2023-03-02T10:47:41.289 INFO:teuthology.orchestra.run.smithi122.stdout:} 2023-03-02T10:47:41.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph 2023-03-02T10:47:41.366 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph 2023-03-02T10:47:41.396 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph 2023-03-02T10:47:41.428 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /etc/ceph 2023-03-02T10:47:41.476 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /etc/ceph 2023-03-02T10:47:41.503 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /etc/ceph 2023-03-02T10:47:41.531 INFO:tasks.cephadm:Writing seed config... 2023-03-02T10:47:41.534 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-03-02T10:47:41.534 INFO:tasks.cephadm: override: [client] debug client = 20 2023-03-02T10:47:41.535 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-03-02T10:47:41.535 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-03-02T10:47:41.536 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-03-02T10:47:41.536 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-03-02T10:47:41.536 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-03-02T10:47:41.537 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-03-02T10:47:41.537 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-03-02T10:47:41.537 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-03-02T10:47:41.538 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-03-02T10:47:41.538 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-03-02T10:47:41.539 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-03-02T10:47:41.539 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-03-02T10:47:41.539 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-03-02T10:47:41.539 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-03-02T10:47:41.540 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-03-02T10:47:41.540 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-03-02T10:47:41.540 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-03-02T10:47:41.540 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-03-02T10:47:41.540 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-03-02T10:47:41.541 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-03-02T10:47:41.541 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-03-02T10:47:41.541 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-03-02T10:47:41.541 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-03-02T10:47:41.541 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-03-02T10:47:41.542 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-03-02T10:47:41.542 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-03-02T10:47:41.542 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-03-02T10:47:41.542 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-03-02T10:47:41.542 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-03-02T10:47:41.543 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-03-02T10:47:41.543 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-03-02T10:47:41.543 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-03-02T10:47:41.543 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-03-02T10:47:41.543 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-03-02T10:47:41.544 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-03-02T10:47:41.544 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-03-02T10:47:41.544 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-03-02T10:47:41.544 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-03-02T10:47:41.544 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-03-02T10:47:41.545 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-03-02T10:47:41.545 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-03-02T10:47:41.545 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-03-02T10:47:41.545 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-03-02T10:47:41.546 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:47:41.546 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-03-02T10:47:41.575 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 886f029e-b8e7-11ed-9ae9-001a4aab830c ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-03-02T10:47:41.576 DEBUG:teuthology.orchestra.run.smithi057:mon.a> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mon.a.service 2023-03-02T10:47:41.618 DEBUG:teuthology.orchestra.run.smithi057:mgr.x> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mgr.x.service 2023-03-02T10:47:41.661 INFO:tasks.cephadm:Bootstrapping... 2023-03-02T10:47:41.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c -v bootstrap --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.57 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-03-02T10:47:41.663 INFO:journalctl@ceph.mon.a.smithi057.stdout:-- Logs begin at Thu 2023-03-02 10:29:06 UTC. -- 2023-03-02T10:47:41.703 INFO:journalctl@ceph.mgr.x.smithi057.stdout:-- Logs begin at Thu 2023-03-02 10:29:06 UTC. -- 2023-03-02T10:47:41.972 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-03-02T10:47:41.975 INFO:teuthology.orchestra.run.smithi057.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c', '-v', 'bootstrap', '--fsid', '886f029e-b8e7-11ed-9ae9-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.57', '--skip-admin-label'] 2023-03-02T10:47:42.126 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stdout 4.1.1 2023-03-02T10:47:42.126 INFO:teuthology.orchestra.run.smithi057.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-03-02T10:47:42.127 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying podman|docker is present... 2023-03-02T10:47:42.279 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stdout 4.1.1 2023-03-02T10:47:42.279 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying lvm2 is present... 2023-03-02T10:47:42.279 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying time synchronization is in place... 2023-03-02T10:47:42.289 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-03-02T10:47:42.290 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-03-02T10:47:42.298 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-03-02T10:47:42.298 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2023-03-02T10:47:42.307 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout enabled 2023-03-02T10:47:42.316 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout active 2023-03-02T10:47:42.316 INFO:teuthology.orchestra.run.smithi057.stdout:Unit chronyd.service is enabled and running 2023-03-02T10:47:42.316 INFO:teuthology.orchestra.run.smithi057.stdout:Repeating the final host check... 2023-03-02T10:47:42.469 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stdout 4.1.1 2023-03-02T10:47:42.469 INFO:teuthology.orchestra.run.smithi057.stdout:podman (/bin/podman) version 4.1.1 is present 2023-03-02T10:47:42.469 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl is present 2023-03-02T10:47:42.469 INFO:teuthology.orchestra.run.smithi057.stdout:lvcreate is present 2023-03-02T10:47:42.478 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-03-02T10:47:42.478 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-03-02T10:47:42.487 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-03-02T10:47:42.487 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2023-03-02T10:47:42.496 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout enabled 2023-03-02T10:47:42.505 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout active 2023-03-02T10:47:42.505 INFO:teuthology.orchestra.run.smithi057.stdout:Unit chronyd.service is enabled and running 2023-03-02T10:47:42.505 INFO:teuthology.orchestra.run.smithi057.stdout:Host looks OK 2023-03-02T10:47:42.506 INFO:teuthology.orchestra.run.smithi057.stdout:Cluster fsid: 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:47:42.506 INFO:teuthology.orchestra.run.smithi057.stdout:Acquiring lock 140354847463240 on /run/cephadm/886f029e-b8e7-11ed-9ae9-001a4aab830c.lock 2023-03-02T10:47:42.506 INFO:teuthology.orchestra.run.smithi057.stdout:Lock 140354847463240 acquired on /run/cephadm/886f029e-b8e7-11ed-9ae9-001a4aab830c.lock 2023-03-02T10:47:42.506 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying IP 172.21.15.57 port 3300 ... 2023-03-02T10:47:42.507 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying IP 172.21.15.57 port 6789 ... 2023-03-02T10:47:42.507 INFO:teuthology.orchestra.run.smithi057.stdout:Base mon IP(s) is [172.21.15.57:3300, 172.21.15.57:6789], mon addrv is [v2:172.21.15.57:3300,v1:172.21.15.57:6789] 2023-03-02T10:47:42.512 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-03-02T10:47:42.512 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.57 metric 100 2023-03-02T10:47:42.516 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-03-02T10:47:42.516 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-03-02T10:47:42.516 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1781sec hoplimit 64 pref medium 2023-03-02T10:47:42.521 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-03-02T10:47:42.521 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-03-02T10:47:42.522 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-03-02T10:47:42.522 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-03-02T10:47:42.522 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-03-02T10:47:42.523 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-03-02T10:47:42.523 INFO:teuthology.orchestra.run.smithi057.stdout:Mon IP `172.21.15.57` is in CIDR network `172.21.0.0/20` 2023-03-02T10:47:42.523 INFO:teuthology.orchestra.run.smithi057.stdout:Mon IP `172.21.15.57` is in CIDR network `172.21.0.0/20` 2023-03-02T10:47:42.523 INFO:teuthology.orchestra.run.smithi057.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-03-02T10:47:42.524 INFO:teuthology.orchestra.run.smithi057.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-03-02T10:47:42.524 INFO:teuthology.orchestra.run.smithi057.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c... 2023-03-02T10:47:45.088 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stdout 635875b567003ef93f6ca3f4f94b02e754088ba6482d0225c4a91731141ddcb5 2023-03-02T10:47:45.088 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c... 2023-03-02T10:47:45.088 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Getting image source signatures 2023-03-02T10:47:45.088 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Copying blob sha256:3392f87c68794c63b77875be11ce9bd651815eb70d458cd59e0beb13bafebbf7 2023-03-02T10:47:45.088 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Copying blob sha256:4ef69b820011cb216760536bd683e53e03e0de703a28853f710a3c81acd0e100 2023-03-02T10:47:45.089 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Copying blob sha256:c9a93b47ad083f6acb64b4e977bea670e87fb6dd3607ac0db42af43a5aaac227 2023-03-02T10:47:45.089 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Copying blob sha256:ea0a20a2c44861ba5e4cd80a32868b6f8265cd3ee81310d4d493a1b50d1c0d8c 2023-03-02T10:47:45.089 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Copying config sha256:635875b567003ef93f6ca3f4f94b02e754088ba6482d0225c4a91731141ddcb5 2023-03-02T10:47:45.089 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Writing manifest to image destination 2023-03-02T10:47:45.089 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/podman: stderr Storing signatures 2023-03-02T10:47:45.951 INFO:teuthology.orchestra.run.smithi057.stdout:ceph: stdout ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev) 2023-03-02T10:47:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:Ceph version: ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev) 2023-03-02T10:47:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:Extracting ceph user uid/gid from container image... 2023-03-02T10:47:46.707 INFO:teuthology.orchestra.run.smithi057.stdout:stat: stdout 167 167 2023-03-02T10:47:46.708 INFO:teuthology.orchestra.run.smithi057.stdout:Creating initial keys... 2023-03-02T10:47:47.363 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph-authtool: stdout AQDTfgBk63yNAhAAki20oYQOxEbjFRmCp33Krw== 2023-03-02T10:47:48.119 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph-authtool: stdout AQDTfgBkzq3VKhAAuRAvGETM6sn78qjhge4HAA== 2023-03-02T10:47:48.877 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph-authtool: stdout AQDUfgBk9ZPgGhAA8mYfpbViWYGDjbGBtzcScA== 2023-03-02T10:47:48.878 INFO:teuthology.orchestra.run.smithi057.stdout:Creating initial monmap... 2023-03-02T10:47:49.634 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-03-02T10:47:49.634 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-03-02T10:47:49.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:47:49.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-03-02T10:47:49.635 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool for a [v2:172.21.15.57:3300,v1:172.21.15.57:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-03-02T10:47:49.635 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = pacific 2023-03-02T10:47:49.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: set fsid to 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:47:49.635 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-03-02T10:47:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:47:49.636 INFO:teuthology.orchestra.run.smithi057.stdout:Creating mon... 2023-03-02T10:47:57.110 INFO:teuthology.orchestra.run.smithi057.stdout:create mon.a on 2023-03-02T10:47:57.256 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-03-02T10:47:57.393 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-03-02T10:47:57.537 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c.target → /etc/systemd/system/ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c.target. 2023-03-02T10:47:57.538 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c.target → /etc/systemd/system/ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c.target. 2023-03-02T10:47:57.727 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mon.a 2023-03-02T10:47:57.728 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Failed to reset failed state of unit ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mon.a.service: Unit ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mon.a.service not loaded. 2023-03-02T10:47:57.863 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c.target.wants/ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@.service. 2023-03-02T10:47:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:57 smithi057 systemd[1]: Starting Ceph mon.a for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:47:58.486 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:58 smithi057 podman[91535]: 2023-03-02T10:47:58.486 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:58 smithi057 bash[91535]: d93f0b609aeda6e097ac7307d24c6549d88366d98c8e020a9d2675c6c16d16fa 2023-03-02T10:47:58.556 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-03-02T10:47:58.557 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout disabled 2023-03-02T10:47:58.567 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-03-02T10:47:58.567 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2023-03-02T10:47:58.568 INFO:teuthology.orchestra.run.smithi057.stdout:firewalld.service is not enabled 2023-03-02T10:47:58.568 INFO:teuthology.orchestra.run.smithi057.stdout:Not possible to enable service . firewalld.service is not available 2023-03-02T10:47:58.568 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mon to start... 2023-03-02T10:47:58.569 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mon... 2023-03-02T10:47:58.806 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:58 smithi057 ceph-mon[91574]: mkfs 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:47:58.806 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:58 smithi057 ceph-mon[91574]: mon.a is new leader, mons a in quorum (ranks 0) 2023-03-02T10:47:58.806 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:58 smithi057 systemd[1]: Started Ceph mon.a for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:47:59.537 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout cluster: 2023-03-02T10:47:59.537 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout id: 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:47:59.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-03-02T10:47:59.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:47:59.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout services: 2023-03-02T10:47:59.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.634716s) 2023-03-02T10:47:59.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-03-02T10:47:59.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-03-02T10:47:59.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:47:59.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout data: 2023-03-02T10:47:59.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-03-02T10:47:59.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-03-02T10:47:59.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-03-02T10:47:59.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout pgs: 2023-03-02T10:47:59.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:47:59.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.027+0000 7f52422aa700 1 Processor -- start 2023-03-02T10:47:59.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.027+0000 7f52422aa700 1 -- start start 2023-03-02T10:47:59.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.028+0000 7f52422aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c108240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:47:59.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.028+0000 7f52422aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c079d20 con 0x7f523c105e60 2023-03-02T10:47:59.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.028+0000 7f523bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c108240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:47:59.541 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.028+0000 7f523bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c108240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38892/0 (socket says 172.21.15.57:38892) 2023-03-02T10:47:59.542 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.028+0000 7f523bfff700 1 -- 172.21.15.57:0/302710698 learned_addr learned my addr 172.21.15.57:0/302710698 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:47:59.543 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.029+0000 7f523bfff700 1 -- 172.21.15.57:0/302710698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c079e60 con 0x7f523c105e60 2023-03-02T10:47:59.543 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.029+0000 7f523bfff700 1 --2- 172.21.15.57:0/302710698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c108240 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f522c0098a0 tx=0x7f522c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32101cd6b76ad027 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:47:59.544 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.029+0000 7f523affd700 1 -- 172.21.15.57:0/302710698 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f522c004160 con 0x7f523c105e60 2023-03-02T10:47:59.544 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.029+0000 7f523affd700 1 -- 172.21.15.57:0/302710698 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0042c0 con 0x7f523c105e60 2023-03-02T10:47:59.544 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.029+0000 7f523affd700 1 -- 172.21.15.57:0/302710698 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f522c0045a0 con 0x7f523c105e60 2023-03-02T10:47:59.544 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.030+0000 7f52422aa700 1 -- 172.21.15.57:0/302710698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 msgr2=0x7f523c108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:47:59.544 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.030+0000 7f52422aa700 1 --2- 172.21.15.57:0/302710698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c108240 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f522c0098a0 tx=0x7f522c009bb0 comp rx=0 tx=0).stop 2023-03-02T10:47:59.544 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.030+0000 7f52422aa700 1 -- 172.21.15.57:0/302710698 shutdown_connections 2023-03-02T10:47:59.545 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.030+0000 7f52422aa700 1 --2- 172.21.15.57:0/302710698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c108240 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:47:59.545 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.030+0000 7f52422aa700 1 -- 172.21.15.57:0/302710698 >> 172.21.15.57:0/302710698 conn(0x7f523c0ff880 msgr2=0x7f523c101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:47:59.545 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.030+0000 7f52422aa700 1 -- 172.21.15.57:0/302710698 shutdown_connections 2023-03-02T10:47:59.545 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.030+0000 7f52422aa700 1 -- 172.21.15.57:0/302710698 wait complete. 2023-03-02T10:47:59.545 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.030+0000 7f52422aa700 1 Processor -- start 2023-03-02T10:47:59.545 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.031+0000 7f52422aa700 1 -- start start 2023-03-02T10:47:59.545 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.031+0000 7f52422aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:47:59.545 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.031+0000 7f52422aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c198cf0 con 0x7f523c105e60 2023-03-02T10:47:59.546 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.031+0000 7f523bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:47:59.546 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.031+0000 7f523bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c1987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38904/0 (socket says 172.21.15.57:38904) 2023-03-02T10:47:59.546 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.031+0000 7f523bfff700 1 -- 172.21.15.57:0/2110896454 learned_addr learned my addr 172.21.15.57:0/2110896454 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:47:59.546 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.031+0000 7f523bfff700 1 -- 172.21.15.57:0/2110896454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c009550 con 0x7f523c105e60 2023-03-02T10:47:59.546 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.031+0000 7f523bfff700 1 --2- 172.21.15.57:0/2110896454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c1987b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f522c004000 tx=0x7f522c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:47:59.546 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.032+0000 7f52397fa700 1 -- 172.21.15.57:0/2110896454 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f522c011630 con 0x7f523c105e60 2023-03-02T10:47:59.546 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.032+0000 7f52397fa700 1 -- 172.21.15.57:0/2110896454 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c011790 con 0x7f523c105e60 2023-03-02T10:47:59.547 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.032+0000 7f52422aa700 1 -- 172.21.15.57:0/2110896454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c108a90 con 0x7f523c105e60 2023-03-02T10:47:59.547 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.032+0000 7f52397fa700 1 -- 172.21.15.57:0/2110896454 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f522c011a30 con 0x7f523c105e60 2023-03-02T10:47:59.547 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.032+0000 7f52422aa700 1 -- 172.21.15.57:0/2110896454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c108900 con 0x7f523c105e60 2023-03-02T10:47:59.547 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.032+0000 7f52397fa700 1 -- 172.21.15.57:0/2110896454 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f522c017020 con 0x7f523c105e60 2023-03-02T10:47:59.547 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.032+0000 7f52397fa700 1 -- 172.21.15.57:0/2110896454 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f522c01c450 con 0x7f523c105e60 2023-03-02T10:47:59.547 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.033+0000 7f52422aa700 1 -- 172.21.15.57:0/2110896454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c1925d0 con 0x7f523c105e60 2023-03-02T10:47:59.547 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.035+0000 7f52397fa700 1 -- 172.21.15.57:0/2110896454 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72046 (secure 0 0 0) 0x7f522c01b450 con 0x7f523c105e60 2023-03-02T10:47:59.548 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.109+0000 7f52422aa700 1 -- 172.21.15.57:0/2110896454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f523c061bc0 con 0x7f523c105e60 2023-03-02T10:47:59.548 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.109+0000 7f52397fa700 1 -- 172.21.15.57:0/2110896454 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f523c061bc0 con 0x7f523c105e60 2023-03-02T10:47:59.548 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.110+0000 7f52422aa700 1 -- 172.21.15.57:0/2110896454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 msgr2=0x7f523c1987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:47:59.548 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.110+0000 7f52422aa700 1 --2- 172.21.15.57:0/2110896454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c1987b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f522c004000 tx=0x7f522c004750 comp rx=0 tx=0).stop 2023-03-02T10:47:59.548 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.110+0000 7f52422aa700 1 -- 172.21.15.57:0/2110896454 shutdown_connections 2023-03-02T10:47:59.548 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.110+0000 7f52422aa700 1 --2- 172.21.15.57:0/2110896454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f523c105e60 0x7f523c1987b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:47:59.548 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.110+0000 7f52422aa700 1 -- 172.21.15.57:0/2110896454 >> 172.21.15.57:0/2110896454 conn(0x7f523c0ff880 msgr2=0x7f523c101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:47:59.548 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.110+0000 7f52422aa700 1 -- 172.21.15.57:0/2110896454 shutdown_connections 2023-03-02T10:47:59.549 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:47:59.110+0000 7f52422aa700 1 -- 172.21.15.57:0/2110896454 wait complete. 2023-03-02T10:47:59.549 INFO:teuthology.orchestra.run.smithi057.stdout:mon is available 2023-03-02T10:47:59.549 INFO:teuthology.orchestra.run.smithi057.stdout:Assimilating anything we can from ceph.conf... 2023-03-02T10:47:59.788 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:59 smithi057 ceph-mon[91574]: mon.a is new leader, mons a in quorum (ranks 0) 2023-03-02T10:47:59.788 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:59 smithi057 ceph-mon[91574]: monmap e1: 1 mons at {a=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0]} removed_ranks: {} 2023-03-02T10:47:59.788 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:59 smithi057 ceph-mon[91574]: fsmap 2023-03-02T10:47:59.789 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:59 smithi057 ceph-mon[91574]: osdmap e1: 0 total, 0 up, 0 in 2023-03-02T10:47:59.789 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:59 smithi057 ceph-mon[91574]: mgrmap e1: no daemons active 2023-03-02T10:47:59.789 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:47:59 smithi057 ceph-mon[91574]: from='client.? 172.21.15.57:0/2110896454' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-03-02T10:48:00.600 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:48:00.601 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [global] 2023-03-02T10:48:00.601 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout fsid = 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:48:00.601 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.57:3300,v1:172.21.15.57:6789] 2023-03-02T10:48:00.601 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-03-02T10:48:00.601 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-03-02T10:48:00.602 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-03-02T10:48:00.602 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-03-02T10:48:00.602 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:48:00.602 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [mgr] 2023-03-02T10:48:00.602 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-03-02T10:48:00.602 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:48:00.602 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [osd] 2023-03-02T10:48:00.602 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-03-02T10:48:00.603 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-03-02T10:48:00.603 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-03-02T10:48:00.603 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-03-02T10:48:00.603 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-03-02T10:48:00.603 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.002+0000 7faed7a99700 1 Processor -- start 2023-03-02T10:48:00.603 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.002+0000 7faed7a99700 1 -- start start 2023-03-02T10:48:00.603 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.002+0000 7faed7a99700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed0108280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:00.604 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.002+0000 7faed7a99700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed0079ce0 con 0x7faed0105ea0 2023-03-02T10:48:00.604 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.002+0000 7faed5835700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed0108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:00.604 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.002+0000 7faed5835700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed0108280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38920/0 (socket says 172.21.15.57:38920) 2023-03-02T10:48:00.604 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.002+0000 7faed5835700 1 -- 172.21.15.57:0/2011183923 learned_addr learned my addr 172.21.15.57:0/2011183923 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:00.604 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.003+0000 7faed5835700 1 -- 172.21.15.57:0/2011183923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0079e20 con 0x7faed0105ea0 2023-03-02T10:48:00.604 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.003+0000 7faed5835700 1 --2- 172.21.15.57:0/2011183923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed0108280 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7faecc0098a0 tx=0x7faecc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a808d98f19e5c9e3 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:00.604 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.003+0000 7faed4833700 1 -- 172.21.15.57:0/2011183923 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faecc004160 con 0x7faed0105ea0 2023-03-02T10:48:00.604 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.003+0000 7faed4833700 1 -- 172.21.15.57:0/2011183923 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc0042c0 con 0x7faed0105ea0 2023-03-02T10:48:00.605 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.003+0000 7faed4833700 1 -- 172.21.15.57:0/2011183923 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faecc0045a0 con 0x7faed0105ea0 2023-03-02T10:48:00.605 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.003+0000 7faed7a99700 1 -- 172.21.15.57:0/2011183923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 msgr2=0x7faed0108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:00.605 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.003+0000 7faed7a99700 1 --2- 172.21.15.57:0/2011183923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed0108280 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7faecc0098a0 tx=0x7faecc009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:00.605 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.003+0000 7faed7a99700 1 -- 172.21.15.57:0/2011183923 shutdown_connections 2023-03-02T10:48:00.605 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.003+0000 7faed7a99700 1 --2- 172.21.15.57:0/2011183923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed0108280 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:00.605 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.003+0000 7faed7a99700 1 -- 172.21.15.57:0/2011183923 >> 172.21.15.57:0/2011183923 conn(0x7faed00ff8a0 msgr2=0x7faed0101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:00.605 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.004+0000 7faed7a99700 1 -- 172.21.15.57:0/2011183923 shutdown_connections 2023-03-02T10:48:00.606 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.004+0000 7faed7a99700 1 -- 172.21.15.57:0/2011183923 wait complete. 2023-03-02T10:48:00.606 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.004+0000 7faed7a99700 1 Processor -- start 2023-03-02T10:48:00.606 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.004+0000 7faed7a99700 1 -- start start 2023-03-02T10:48:00.606 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.005+0000 7faed7a99700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed01987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:00.606 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.005+0000 7faed7a99700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed0198d00 con 0x7faed0105ea0 2023-03-02T10:48:00.606 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.005+0000 7faed5835700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed01987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:00.606 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.005+0000 7faed5835700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed01987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38922/0 (socket says 172.21.15.57:38922) 2023-03-02T10:48:00.606 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.005+0000 7faed5835700 1 -- 172.21.15.57:0/695427048 learned_addr learned my addr 172.21.15.57:0/695427048 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:00.607 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.005+0000 7faed5835700 1 -- 172.21.15.57:0/695427048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009550 con 0x7faed0105ea0 2023-03-02T10:48:00.607 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.005+0000 7faed5835700 1 --2- 172.21.15.57:0/695427048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed01987c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7faecc004000 tx=0x7faecc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:00.607 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.005+0000 7faec6ffd700 1 -- 172.21.15.57:0/695427048 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faecc011630 con 0x7faed0105ea0 2023-03-02T10:48:00.607 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.005+0000 7faec6ffd700 1 -- 172.21.15.57:0/695427048 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc011790 con 0x7faed0105ea0 2023-03-02T10:48:00.607 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.005+0000 7faed7a99700 1 -- 172.21.15.57:0/695427048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed0108a70 con 0x7faed0105ea0 2023-03-02T10:48:00.607 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.005+0000 7faec6ffd700 1 -- 172.21.15.57:0/695427048 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faecc011a30 con 0x7faed0105ea0 2023-03-02T10:48:00.607 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.006+0000 7faed7a99700 1 -- 172.21.15.57:0/695427048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed01088e0 con 0x7faed0105ea0 2023-03-02T10:48:00.607 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.006+0000 7faec6ffd700 1 -- 172.21.15.57:0/695427048 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7faecc017020 con 0x7faed0105ea0 2023-03-02T10:48:00.608 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.006+0000 7faec6ffd700 1 -- 172.21.15.57:0/695427048 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7faecc01c450 con 0x7faed0105ea0 2023-03-02T10:48:00.608 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.007+0000 7faed7a99700 1 -- 172.21.15.57:0/695427048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed01925d0 con 0x7faed0105ea0 2023-03-02T10:48:00.608 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.009+0000 7faec6ffd700 1 -- 172.21.15.57:0/695427048 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72046 (secure 0 0 0) 0x7faecc01b450 con 0x7faed0105ea0 2023-03-02T10:48:00.608 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.080+0000 7faed7a99700 1 -- 172.21.15.57:0/695427048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7faed0061bc0 con 0x7faed0105ea0 2023-03-02T10:48:00.608 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.084+0000 7faec6ffd700 1 -- 172.21.15.57:0/695427048 <== mon.0 v2:172.21.15.57:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faecc01b5f0 con 0x7faed0105ea0 2023-03-02T10:48:00.608 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.084+0000 7faec6ffd700 1 -- 172.21.15.57:0/695427048 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7faed0061bc0 con 0x7faed0105ea0 2023-03-02T10:48:00.608 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.085+0000 7faed7a99700 1 -- 172.21.15.57:0/695427048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 msgr2=0x7faed01987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:00.609 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.085+0000 7faed7a99700 1 --2- 172.21.15.57:0/695427048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed01987c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7faecc004000 tx=0x7faecc004750 comp rx=0 tx=0).stop 2023-03-02T10:48:00.609 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.085+0000 7faed7a99700 1 -- 172.21.15.57:0/695427048 shutdown_connections 2023-03-02T10:48:00.609 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.085+0000 7faed7a99700 1 --2- 172.21.15.57:0/695427048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faed0105ea0 0x7faed01987c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:00.609 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.085+0000 7faed7a99700 1 -- 172.21.15.57:0/695427048 >> 172.21.15.57:0/695427048 conn(0x7faed00ff8a0 msgr2=0x7faed01011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:00.609 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.085+0000 7faed7a99700 1 -- 172.21.15.57:0/695427048 shutdown_connections 2023-03-02T10:48:00.609 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:00.085+0000 7faed7a99700 1 -- 172.21.15.57:0/695427048 wait complete. 2023-03-02T10:48:00.609 INFO:teuthology.orchestra.run.smithi057.stdout:Generating new minimal ceph.conf... 2023-03-02T10:48:00.837 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:00 smithi057 ceph-mon[91574]: from='client.? 172.21.15.57:0/695427048' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-03-02T10:48:00.837 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:00 smithi057 ceph-mon[91574]: from='client.? 172.21.15.57:0/695427048' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-03-02T10:48:01.558 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.041+0000 7fa8f9f45700 1 Processor -- start 2023-03-02T10:48:01.558 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.041+0000 7fa8f9f45700 1 -- start start 2023-03-02T10:48:01.558 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.041+0000 7fa8f9f45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f4105760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:01.558 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.041+0000 7fa8f9f45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4105ca0 con 0x7fa8f4105350 2023-03-02T10:48:01.558 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.041+0000 7fa8f37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f4105760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:01.559 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.041+0000 7fa8f37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f4105760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38936/0 (socket says 172.21.15.57:38936) 2023-03-02T10:48:01.559 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.041+0000 7fa8f37fe700 1 -- 172.21.15.57:0/3518591881 learned_addr learned my addr 172.21.15.57:0/3518591881 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:01.559 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.042+0000 7fa8f37fe700 1 -- 172.21.15.57:0/3518591881 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f4105de0 con 0x7fa8f4105350 2023-03-02T10:48:01.559 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.042+0000 7fa8f37fe700 1 --2- 172.21.15.57:0/3518591881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f4105760 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40098a0 tx=0x7fa8e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e2c1d5c8beed19 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:01.559 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.042+0000 7fa8f27fc700 1 -- 172.21.15.57:0/3518591881 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8e4004160 con 0x7fa8f4105350 2023-03-02T10:48:01.559 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.042+0000 7fa8f27fc700 1 -- 172.21.15.57:0/3518591881 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8e40042c0 con 0x7fa8f4105350 2023-03-02T10:48:01.559 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.042+0000 7fa8f27fc700 1 -- 172.21.15.57:0/3518591881 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8e4011a00 con 0x7fa8f4105350 2023-03-02T10:48:01.560 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.042+0000 7fa8f9f45700 1 -- 172.21.15.57:0/3518591881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 msgr2=0x7fa8f4105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:01.560 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.042+0000 7fa8f9f45700 1 --2- 172.21.15.57:0/3518591881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f4105760 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40098a0 tx=0x7fa8e4009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:01.560 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.043+0000 7fa8f9f45700 1 -- 172.21.15.57:0/3518591881 shutdown_connections 2023-03-02T10:48:01.560 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.043+0000 7fa8f9f45700 1 --2- 172.21.15.57:0/3518591881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f4105760 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:01.560 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.043+0000 7fa8f9f45700 1 -- 172.21.15.57:0/3518591881 >> 172.21.15.57:0/3518591881 conn(0x7fa8f41009b0 msgr2=0x7fa8f4102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:01.560 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.043+0000 7fa8f9f45700 1 -- 172.21.15.57:0/3518591881 shutdown_connections 2023-03-02T10:48:01.560 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.043+0000 7fa8f9f45700 1 -- 172.21.15.57:0/3518591881 wait complete. 2023-03-02T10:48:01.561 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.044+0000 7fa8f9f45700 1 Processor -- start 2023-03-02T10:48:01.561 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.044+0000 7fa8f9f45700 1 -- start start 2023-03-02T10:48:01.561 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.044+0000 7fa8f9f45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:01.561 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.044+0000 7fa8f9f45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f419b760 con 0x7fa8f4105350 2023-03-02T10:48:01.561 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.044+0000 7fa8f37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:01.561 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.044+0000 7fa8f37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f419b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38950/0 (socket says 172.21.15.57:38950) 2023-03-02T10:48:01.561 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.044+0000 7fa8f37fe700 1 -- 172.21.15.57:0/772621229 learned_addr learned my addr 172.21.15.57:0/772621229 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:01.562 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.045+0000 7fa8f37fe700 1 -- 172.21.15.57:0/772621229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e4009550 con 0x7fa8f4105350 2023-03-02T10:48:01.562 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.045+0000 7fa8f37fe700 1 --2- 172.21.15.57:0/772621229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f419b220 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4003f50 tx=0x7fa8e4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:01.562 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.045+0000 7fa8f0ff9700 1 -- 172.21.15.57:0/772621229 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8e40039e0 con 0x7fa8f4105350 2023-03-02T10:48:01.562 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.045+0000 7fa8f0ff9700 1 -- 172.21.15.57:0/772621229 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8e4003b40 con 0x7fa8f4105350 2023-03-02T10:48:01.562 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.045+0000 7fa8f9f45700 1 -- 172.21.15.57:0/772621229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f41073e0 con 0x7fa8f4105350 2023-03-02T10:48:01.562 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.045+0000 7fa8f0ff9700 1 -- 172.21.15.57:0/772621229 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8e4019690 con 0x7fa8f4105350 2023-03-02T10:48:01.562 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.045+0000 7fa8f9f45700 1 -- 172.21.15.57:0/772621229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f4107250 con 0x7fa8f4105350 2023-03-02T10:48:01.563 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.045+0000 7fa8f0ff9700 1 -- 172.21.15.57:0/772621229 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fa8e402c070 con 0x7fa8f4105350 2023-03-02T10:48:01.563 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.045+0000 7fa8f0ff9700 1 -- 172.21.15.57:0/772621229 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa8e400b3e0 con 0x7fa8f4105350 2023-03-02T10:48:01.563 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.046+0000 7fa8f9f45700 1 -- 172.21.15.57:0/772621229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f4109810 con 0x7fa8f4105350 2023-03-02T10:48:01.563 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.049+0000 7fa8f0ff9700 1 -- 172.21.15.57:0/772621229 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72046 (secure 0 0 0) 0x7fa8e402a060 con 0x7fa8f4105350 2023-03-02T10:48:01.563 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.120+0000 7fa8f9f45700 1 -- 172.21.15.57:0/772621229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fa8f419bd70 con 0x7fa8f4105350 2023-03-02T10:48:01.563 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.121+0000 7fa8f0ff9700 1 -- 172.21.15.57:0/772621229 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fa8e4019d80 con 0x7fa8f4105350 2023-03-02T10:48:01.563 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.122+0000 7fa8f9f45700 1 -- 172.21.15.57:0/772621229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 msgr2=0x7fa8f419b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:01.564 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.122+0000 7fa8f9f45700 1 --2- 172.21.15.57:0/772621229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f419b220 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4003f50 tx=0x7fa8e4011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:01.564 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.122+0000 7fa8f9f45700 1 -- 172.21.15.57:0/772621229 shutdown_connections 2023-03-02T10:48:01.564 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.122+0000 7fa8f9f45700 1 --2- 172.21.15.57:0/772621229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8f4105350 0x7fa8f419b220 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:01.564 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.122+0000 7fa8f9f45700 1 -- 172.21.15.57:0/772621229 >> 172.21.15.57:0/772621229 conn(0x7fa8f41009b0 msgr2=0x7fa8f4101710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:01.564 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.122+0000 7fa8f9f45700 1 -- 172.21.15.57:0/772621229 shutdown_connections 2023-03-02T10:48:01.564 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:01.122+0000 7fa8f9f45700 1 -- 172.21.15.57:0/772621229 wait complete. 2023-03-02T10:48:01.564 INFO:teuthology.orchestra.run.smithi057.stdout:Restarting the monitor... 2023-03-02T10:48:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:01 smithi057 ceph-mon[91574]: from='client.? 172.21.15.57:0/772621229' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:48:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:01 smithi057 systemd[1]: Stopping Ceph mon.a for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:48:02.271 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:01 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mon-a[91551]: 2023-03-02T10:48:01.956+0000 7f2b17268700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-03-02T10:48:02.272 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:01 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mon-a[91551]: 2023-03-02T10:48:01.956+0000 7f2b17268700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-03-02T10:48:02.549 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:02 smithi057 bash[91911]: ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mon-a 2023-03-02T10:48:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:02 smithi057 systemd[1]: ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mon.a.service: Succeeded. 2023-03-02T10:48:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:02 smithi057 systemd[1]: Stopped Ceph mon.a for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:48:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:02 smithi057 systemd[1]: Starting Ceph mon.a for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:48:03.152 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:02 smithi057 podman[92033]: 2023-03-02T10:48:03.152 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: set uid:gid to 167:167 (ceph:ceph) 2023-03-02T10:48:03.222 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev), process ceph-mon, pid 7 2023-03-02T10:48:03.223 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: pidfile_write: ignore empty --pid-file 2023-03-02T10:48:03.223 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 bash[92033]: cdf0c9e71571d3022259f750815ad6f918f24ccee8b64d1e6fd2dfff05e5d01b 2023-03-02T10:48:03.223 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: load: jerasure load: lrc 2023-03-02T10:48:03.223 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: RocksDB version: 6.15.5 2023-03-02T10:48:03.223 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-03-02T10:48:03.224 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Compile date Feb 22 2023 2023-03-02T10:48:03.224 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: DB SUMMARY 2023-03-02T10:48:03.224 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: DB Session ID: 13T92QHIOJ7W0OXEG7IJ 2023-03-02T10:48:03.224 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: CURRENT file: CURRENT 2023-03-02T10:48:03.224 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: IDENTITY file: IDENTITY 2023-03-02T10:48:03.224 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-03-02T10:48:03.224 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-03-02T10:48:03.225 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 98703 ; 2023-03-02T10:48:03.225 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.error_if_exists: 0 2023-03-02T10:48:03.225 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.create_if_missing: 0 2023-03-02T10:48:03.225 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.paranoid_checks: 1 2023-03-02T10:48:03.225 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-03-02T10:48:03.225 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.env: 0x55b9bc2824a0 2023-03-02T10:48:03.225 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.fs: Posix File System 2023-03-02T10:48:03.226 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.info_log: 0x55b9be97e480 2023-03-02T10:48:03.226 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_file_opening_threads: 16 2023-03-02T10:48:03.226 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.statistics: (nil) 2023-03-02T10:48:03.226 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.use_fsync: 0 2023-03-02T10:48:03.226 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_log_file_size: 0 2023-03-02T10:48:03.226 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-03-02T10:48:03.226 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.log_file_time_to_roll: 0 2023-03-02T10:48:03.227 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.keep_log_file_num: 1000 2023-03-02T10:48:03.227 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.recycle_log_file_num: 0 2023-03-02T10:48:03.227 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.allow_fallocate: 1 2023-03-02T10:48:03.227 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.allow_mmap_reads: 0 2023-03-02T10:48:03.227 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.allow_mmap_writes: 0 2023-03-02T10:48:03.227 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.use_direct_reads: 0 2023-03-02T10:48:03.227 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-03-02T10:48:03.228 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.create_missing_column_families: 0 2023-03-02T10:48:03.228 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.db_log_dir: 2023-03-02T10:48:03.228 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2023-03-02T10:48:03.228 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.table_cache_numshardbits: 6 2023-03-02T10:48:03.228 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.WAL_ttl_seconds: 0 2023-03-02T10:48:03.228 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.WAL_size_limit_MB: 0 2023-03-02T10:48:03.228 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-03-02T10:48:03.229 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-03-02T10:48:03.229 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.is_fd_close_on_exec: 1 2023-03-02T10:48:03.229 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.advise_random_on_open: 1 2023-03-02T10:48:03.229 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.db_write_buffer_size: 0 2023-03-02T10:48:03.229 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.write_buffer_manager: 0x55b9bebf2f90 2023-03-02T10:48:03.229 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-03-02T10:48:03.229 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-03-02T10:48:03.230 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-03-02T10:48:03.230 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.use_adaptive_mutex: 0 2023-03-02T10:48:03.230 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.rate_limiter: (nil) 2023-03-02T10:48:03.230 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-03-02T10:48:03.230 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.wal_recovery_mode: 2 2023-03-02T10:48:03.230 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.enable_thread_tracking: 0 2023-03-02T10:48:03.230 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.enable_pipelined_write: 0 2023-03-02T10:48:03.231 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.unordered_write: 0 2023-03-02T10:48:03.231 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-03-02T10:48:03.231 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-03-02T10:48:03.231 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-03-02T10:48:03.231 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-03-02T10:48:03.231 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.row_cache: None 2023-03-02T10:48:03.231 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.wal_filter: None 2023-03-02T10:48:03.231 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-03-02T10:48:03.232 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.allow_ingest_behind: 0 2023-03-02T10:48:03.232 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.preserve_deletes: 0 2023-03-02T10:48:03.232 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.two_write_queues: 0 2023-03-02T10:48:03.232 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.manual_wal_flush: 0 2023-03-02T10:48:03.232 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.atomic_flush: 0 2023-03-02T10:48:03.232 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-03-02T10:48:03.232 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.persist_stats_to_disk: 0 2023-03-02T10:48:03.233 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.write_dbid_to_manifest: 0 2023-03-02T10:48:03.233 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.log_readahead_size: 0 2023-03-02T10:48:03.233 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-03-02T10:48:03.233 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.best_efforts_recovery: 0 2023-03-02T10:48:03.233 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-03-02T10:48:03.233 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-03-02T10:48:03.233 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.allow_data_in_errors: 0 2023-03-02T10:48:03.234 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.db_host_id: __hostname__ 2023-03-02T10:48:03.234 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_background_jobs: 2 2023-03-02T10:48:03.235 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_background_compactions: -1 2023-03-02T10:48:03.235 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_subcompactions: 1 2023-03-02T10:48:03.235 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-03-02T10:48:03.236 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-03-02T10:48:03.236 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.delayed_write_rate : 16777216 2023-03-02T10:48:03.236 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_total_wal_size: 0 2023-03-02T10:48:03.236 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-03-02T10:48:03.236 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.stats_dump_period_sec: 600 2023-03-02T10:48:03.236 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.stats_persist_period_sec: 600 2023-03-02T10:48:03.236 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-03-02T10:48:03.237 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_open_files: -1 2023-03-02T10:48:03.237 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.bytes_per_sync: 0 2023-03-02T10:48:03.237 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.wal_bytes_per_sync: 0 2023-03-02T10:48:03.237 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.strict_bytes_per_sync: 0 2023-03-02T10:48:03.237 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_readahead_size: 0 2023-03-02T10:48:03.237 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_background_flushes: -1 2023-03-02T10:48:03.237 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Compression algorithms supported: 2023-03-02T10:48:03.238 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-03-02T10:48:03.238 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: kZSTD supported: 0 2023-03-02T10:48:03.238 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: kXpressCompression supported: 0 2023-03-02T10:48:03.238 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: kLZ4HCCompression supported: 1 2023-03-02T10:48:03.238 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: kZlibCompression supported: 1 2023-03-02T10:48:03.238 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: kSnappyCompression supported: 1 2023-03-02T10:48:03.238 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: kLZ4Compression supported: 1 2023-03-02T10:48:03.239 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: kBZip2Compression supported: 0 2023-03-02T10:48:03.239 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Fast CRC32 supported: Supported on x86 2023-03-02T10:48:03.239 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2023-03-02T10:48:03.239 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-03-02T10:48:03.239 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-03-02T10:48:03.239 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.merge_operator: 2023-03-02T10:48:03.239 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_filter: None 2023-03-02T10:48:03.240 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_filter_factory: None 2023-03-02T10:48:03.240 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.sst_partitioner_factory: None 2023-03-02T10:48:03.240 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.memtable_factory: SkipListFactory 2023-03-02T10:48:03.240 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.table_factory: BlockBasedTable 2023-03-02T10:48:03.240 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b9be8fdb20) 2023-03-02T10:48:03.240 INFO:journalctl@ceph.mon.a.smithi057.stdout: cache_index_and_filter_blocks: 1 2023-03-02T10:48:03.240 INFO:journalctl@ceph.mon.a.smithi057.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-03-02T10:48:03.241 INFO:journalctl@ceph.mon.a.smithi057.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-03-02T10:48:03.241 INFO:journalctl@ceph.mon.a.smithi057.stdout: pin_top_level_index_and_filter: 1 2023-03-02T10:48:03.241 INFO:journalctl@ceph.mon.a.smithi057.stdout: index_type: 0 2023-03-02T10:48:03.241 INFO:journalctl@ceph.mon.a.smithi057.stdout: data_block_index_type: 0 2023-03-02T10:48:03.241 INFO:journalctl@ceph.mon.a.smithi057.stdout: index_shortening: 1 2023-03-02T10:48:03.241 INFO:journalctl@ceph.mon.a.smithi057.stdout: data_block_hash_table_util_ratio: 0.750000 2023-03-02T10:48:03.241 INFO:journalctl@ceph.mon.a.smithi057.stdout: hash_index_allow_collision: 1 2023-03-02T10:48:03.242 INFO:journalctl@ceph.mon.a.smithi057.stdout: checksum: 1 2023-03-02T10:48:03.242 INFO:journalctl@ceph.mon.a.smithi057.stdout: no_block_cache: 0 2023-03-02T10:48:03.242 INFO:journalctl@ceph.mon.a.smithi057.stdout: block_cache: 0x55b9be9bb350 2023-03-02T10:48:03.242 INFO:journalctl@ceph.mon.a.smithi057.stdout: block_cache_name: BinnedLRUCache 2023-03-02T10:48:03.242 INFO:journalctl@ceph.mon.a.smithi057.stdout: block_cache_options: 2023-03-02T10:48:03.242 INFO:journalctl@ceph.mon.a.smithi057.stdout: capacity : 536870912 2023-03-02T10:48:03.242 INFO:journalctl@ceph.mon.a.smithi057.stdout: num_shard_bits : 4 2023-03-02T10:48:03.243 INFO:journalctl@ceph.mon.a.smithi057.stdout: strict_capacity_limit : 0 2023-03-02T10:48:03.243 INFO:journalctl@ceph.mon.a.smithi057.stdout: high_pri_pool_ratio: 0.000 2023-03-02T10:48:03.243 INFO:journalctl@ceph.mon.a.smithi057.stdout: block_cache_compressed: (nil) 2023-03-02T10:48:03.243 INFO:journalctl@ceph.mon.a.smithi057.stdout: persistent_cache: (nil) 2023-03-02T10:48:03.243 INFO:journalctl@ceph.mon.a.smithi057.stdout: block_size: 4096 2023-03-02T10:48:03.243 INFO:journalctl@ceph.mon.a.smithi057.stdout: block_size_deviation: 10 2023-03-02T10:48:03.243 INFO:journalctl@ceph.mon.a.smithi057.stdout: block_restart_interval: 16 2023-03-02T10:48:03.244 INFO:journalctl@ceph.mon.a.smithi057.stdout: index_block_restart_interval: 1 2023-03-02T10:48:03.244 INFO:journalctl@ceph.mon.a.smithi057.stdout: metadata_block_size: 4096 2023-03-02T10:48:03.244 INFO:journalctl@ceph.mon.a.smithi057.stdout: partition_filters: 0 2023-03-02T10:48:03.244 INFO:journalctl@ceph.mon.a.smithi057.stdout: use_delta_encoding: 1 2023-03-02T10:48:03.244 INFO:journalctl@ceph.mon.a.smithi057.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-03-02T10:48:03.244 INFO:journalctl@ceph.mon.a.smithi057.stdout: whole_key_filtering: 1 2023-03-02T10:48:03.244 INFO:journalctl@ceph.mon.a.smithi057.stdout: verify_compression: 0 2023-03-02T10:48:03.245 INFO:journalctl@ceph.mon.a.smithi057.stdout: read_amp_bytes_per_bit: 0 2023-03-02T10:48:03.245 INFO:journalctl@ceph.mon.a.smithi057.stdout: format_version: 4 2023-03-02T10:48:03.245 INFO:journalctl@ceph.mon.a.smithi057.stdout: enable_index_compression: 1 2023-03-02T10:48:03.245 INFO:journalctl@ceph.mon.a.smithi057.stdout: block_align: 0 2023-03-02T10:48:03.245 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.write_buffer_size: 33554432 2023-03-02T10:48:03.245 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_write_buffer_number: 2 2023-03-02T10:48:03.245 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compression: NoCompression 2023-03-02T10:48:03.246 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.bottommost_compression: Disabled 2023-03-02T10:48:03.246 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.prefix_extractor: nullptr 2023-03-02T10:48:03.246 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-03-02T10:48:03.246 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.num_levels: 7 2023-03-02T10:48:03.246 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-03-02T10:48:03.246 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-03-02T10:48:03.246 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-03-02T10:48:03.246 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-03-02T10:48:03.247 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-03-02T10:48:03.247 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-03-02T10:48:03.247 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-03-02T10:48:03.247 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-03-02T10:48:03.247 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-03-02T10:48:03.247 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-03-02T10:48:03.247 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compression_opts.window_bits: -14 2023-03-02T10:48:03.248 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compression_opts.level: 32767 2023-03-02T10:48:03.248 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compression_opts.strategy: 0 2023-03-02T10:48:03.248 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-03-02T10:48:03.248 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-03-02T10:48:03.248 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-03-02T10:48:03.248 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compression_opts.enabled: false 2023-03-02T10:48:03.248 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-03-02T10:48:03.249 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-03-02T10:48:03.249 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-03-02T10:48:03.249 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.target_file_size_base: 67108864 2023-03-02T10:48:03.249 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.target_file_size_multiplier: 1 2023-03-02T10:48:03.249 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-03-02T10:48:03.249 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-03-02T10:48:03.249 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-03-02T10:48:03.250 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-03-02T10:48:03.250 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-03-02T10:48:03.250 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-03-02T10:48:03.250 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-03-02T10:48:03.250 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-03-02T10:48:03.250 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-03-02T10:48:03.250 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-03-02T10:48:03.251 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-03-02T10:48:03.251 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-03-02T10:48:03.251 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.arena_block_size: 4194304 2023-03-02T10:48:03.251 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-03-02T10:48:03.251 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-03-02T10:48:03.251 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-03-02T10:48:03.251 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.disable_auto_compactions: 0 2023-03-02T10:48:03.252 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-03-02T10:48:03.252 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-03-02T10:48:03.252 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-03-02T10:48:03.252 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-03-02T10:48:03.252 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-03-02T10:48:03.252 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-03-02T10:48:03.252 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-03-02T10:48:03.253 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-03-02T10:48:03.253 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-03-02T10:48:03.253 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-03-02T10:48:03.253 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.table_properties_collectors: 2023-03-02T10:48:03.253 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.inplace_update_support: 0 2023-03-02T10:48:03.253 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.inplace_update_num_locks: 10000 2023-03-02T10:48:03.253 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-03-02T10:48:03.254 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-03-02T10:48:03.254 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.memtable_huge_page_size: 0 2023-03-02T10:48:03.254 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.bloom_locality: 0 2023-03-02T10:48:03.254 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.max_successive_merges: 0 2023-03-02T10:48:03.254 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.optimize_filters_for_hits: 0 2023-03-02T10:48:03.254 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.paranoid_file_checks: 0 2023-03-02T10:48:03.254 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.force_consistency_checks: 1 2023-03-02T10:48:03.254 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.report_bg_io_stats: 0 2023-03-02T10:48:03.255 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.ttl: 2592000 2023-03-02T10:48:03.255 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.periodic_compaction_seconds: 0 2023-03-02T10:48:03.255 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.enable_blob_files: false 2023-03-02T10:48:03.255 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.min_blob_size: 0 2023-03-02T10:48:03.255 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.blob_file_size: 268435456 2023-03-02T10:48:03.255 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.blob_compression_type: NoCompression 2023-03-02T10:48:03.255 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.enable_blob_garbage_collection: false 2023-03-02T10:48:03.256 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-03-02T10:48:03.256 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-03-02T10:48:03.256 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-03-02T10:48:03.256 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-03-02T10:48:03.256 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: EVENT_LOG_v1 {"time_micros": 1677754083159685, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-03-02T10:48:03.256 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-03-02T10:48:03.256 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-03-02T10:48:03.257 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: EVENT_LOG_v1 {"time_micros": 1677754083160813, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93878, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91955, "index_size": 283, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13658, "raw_average_key_size": 50, "raw_value_size": 84496, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1677754083, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "1afa2ad6-709e-4a5d-b554-d77c6b0e4d74", "db_session_id": "13T92QHIOJ7W0OXEG7IJ"}} 2023-03-02T10:48:03.257 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-03-02T10:48:03.257 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: EVENT_LOG_v1 {"time_micros": 1677754083161580, "job": 1, "event": "recovery_finished"} 2023-03-02T10:48:03.257 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-03-02T10:48:03.257 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55b9be94f880 2023-03-02T10:48:03.257 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: DB pointer 0x55b9be98c000 2023-03-02T10:48:03.258 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-03-02T10:48:03.258 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-03-02T10:48:03.258 INFO:journalctl@ceph.mon.a.smithi057.stdout: ** DB Stats ** 2023-03-02T10:48:03.258 INFO:journalctl@ceph.mon.a.smithi057.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-03-02T10:48:03.258 INFO:journalctl@ceph.mon.a.smithi057.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-03-02T10:48:03.258 INFO:journalctl@ceph.mon.a.smithi057.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-03-02T10:48:03.258 INFO:journalctl@ceph.mon.a.smithi057.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-03-02T10:48:03.258 INFO:journalctl@ceph.mon.a.smithi057.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-03-02T10:48:03.259 INFO:journalctl@ceph.mon.a.smithi057.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-03-02T10:48:03.259 INFO:journalctl@ceph.mon.a.smithi057.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-03-02T10:48:03.259 INFO:journalctl@ceph.mon.a.smithi057.stdout: 2023-03-02T10:48:03.259 INFO:journalctl@ceph.mon.a.smithi057.stdout: ** Compaction Stats [default] ** 2023-03-02T10:48:03.259 INFO:journalctl@ceph.mon.a.smithi057.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-03-02T10:48:03.259 INFO:journalctl@ceph.mon.a.smithi057.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-03-02T10:48:03.259 INFO:journalctl@ceph.mon.a.smithi057.stdout: L0 2/0 93.44 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.3 0.00 0.00 1 0.001 0 0 2023-03-02T10:48:03.260 INFO:journalctl@ceph.mon.a.smithi057.stdout: Sum 2/0 93.44 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.3 0.00 0.00 1 0.001 0 0 2023-03-02T10:48:03.260 INFO:journalctl@ceph.mon.a.smithi057.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.3 0.00 0.00 1 0.001 0 0 2023-03-02T10:48:03.260 INFO:journalctl@ceph.mon.a.smithi057.stdout: 2023-03-02T10:48:03.260 INFO:journalctl@ceph.mon.a.smithi057.stdout: ** Compaction Stats [default] ** 2023-03-02T10:48:03.260 INFO:journalctl@ceph.mon.a.smithi057.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-03-02T10:48:03.260 INFO:journalctl@ceph.mon.a.smithi057.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-03-02T10:48:03.260 INFO:journalctl@ceph.mon.a.smithi057.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 116.3 0.00 0.00 1 0.001 0 0 2023-03-02T10:48:03.261 INFO:journalctl@ceph.mon.a.smithi057.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-03-02T10:48:03.261 INFO:journalctl@ceph.mon.a.smithi057.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-03-02T10:48:03.261 INFO:journalctl@ceph.mon.a.smithi057.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-03-02T10:48:03.261 INFO:journalctl@ceph.mon.a.smithi057.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-03-02T10:48:03.261 INFO:journalctl@ceph.mon.a.smithi057.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-03-02T10:48:03.261 INFO:journalctl@ceph.mon.a.smithi057.stdout: AddFile(Keys): cumulative 0, interval 0 2023-03-02T10:48:03.261 INFO:journalctl@ceph.mon.a.smithi057.stdout: Cumulative compaction: 0.00 GB write, 17.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-03-02T10:48:03.262 INFO:journalctl@ceph.mon.a.smithi057.stdout: Interval compaction: 0.00 GB write, 17.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-03-02T10:48:03.262 INFO:journalctl@ceph.mon.a.smithi057.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-03-02T10:48:03.262 INFO:journalctl@ceph.mon.a.smithi057.stdout: 2023-03-02T10:48:03.262 INFO:journalctl@ceph.mon.a.smithi057.stdout: ** File Read Latency Histogram By Level [default] ** 2023-03-02T10:48:03.262 INFO:journalctl@ceph.mon.a.smithi057.stdout: 2023-03-02T10:48:03.262 INFO:journalctl@ceph.mon.a.smithi057.stdout: ** Compaction Stats [default] ** 2023-03-02T10:48:03.262 INFO:journalctl@ceph.mon.a.smithi057.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-03-02T10:48:03.263 INFO:journalctl@ceph.mon.a.smithi057.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-03-02T10:48:03.263 INFO:journalctl@ceph.mon.a.smithi057.stdout: L0 2/0 93.44 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.3 0.00 0.00 1 0.001 0 0 2023-03-02T10:48:03.263 INFO:journalctl@ceph.mon.a.smithi057.stdout: Sum 2/0 93.44 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.3 0.00 0.00 1 0.001 0 0 2023-03-02T10:48:03.263 INFO:journalctl@ceph.mon.a.smithi057.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-03-02T10:48:03.263 INFO:journalctl@ceph.mon.a.smithi057.stdout: 2023-03-02T10:48:03.263 INFO:journalctl@ceph.mon.a.smithi057.stdout: ** Compaction Stats [default] ** 2023-03-02T10:48:03.263 INFO:journalctl@ceph.mon.a.smithi057.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-03-02T10:48:03.264 INFO:journalctl@ceph.mon.a.smithi057.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-03-02T10:48:03.264 INFO:journalctl@ceph.mon.a.smithi057.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 116.3 0.00 0.00 1 0.001 0 0 2023-03-02T10:48:03.264 INFO:journalctl@ceph.mon.a.smithi057.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-03-02T10:48:03.264 INFO:journalctl@ceph.mon.a.smithi057.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-03-02T10:48:03.264 INFO:journalctl@ceph.mon.a.smithi057.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-03-02T10:48:03.264 INFO:journalctl@ceph.mon.a.smithi057.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-03-02T10:48:03.264 INFO:journalctl@ceph.mon.a.smithi057.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-03-02T10:48:03.264 INFO:journalctl@ceph.mon.a.smithi057.stdout: AddFile(Keys): cumulative 0, interval 0 2023-03-02T10:48:03.265 INFO:journalctl@ceph.mon.a.smithi057.stdout: Cumulative compaction: 0.00 GB write, 17.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-03-02T10:48:03.265 INFO:journalctl@ceph.mon.a.smithi057.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-03-02T10:48:03.265 INFO:journalctl@ceph.mon.a.smithi057.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-03-02T10:48:03.265 INFO:journalctl@ceph.mon.a.smithi057.stdout: 2023-03-02T10:48:03.265 INFO:journalctl@ceph.mon.a.smithi057.stdout: ** File Read Latency Histogram By Level [default] ** 2023-03-02T10:48:03.265 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: starting mon.a rank 0 at public addrs [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] at bind addrs [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:48:03.265 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: mon.a@-1(???) e1 preinit fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:48:03.266 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: mon.a@-1(???).mds e1 new map 2023-03-02T10:48:03.266 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: mon.a@-1(???).mds e1 print_map 2023-03-02T10:48:03.266 INFO:journalctl@ceph.mon.a.smithi057.stdout: e1 2023-03-02T10:48:03.266 INFO:journalctl@ceph.mon.a.smithi057.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-03-02T10:48:03.266 INFO:journalctl@ceph.mon.a.smithi057.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-03-02T10:48:03.266 INFO:journalctl@ceph.mon.a.smithi057.stdout: legacy client fscid: -1 2023-03-02T10:48:03.266 INFO:journalctl@ceph.mon.a.smithi057.stdout: 2023-03-02T10:48:03.267 INFO:journalctl@ceph.mon.a.smithi057.stdout: No filesystems configured 2023-03-02T10:48:03.267 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-03-02T10:48:03.267 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-03-02T10:48:03.267 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-03-02T10:48:03.267 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-03-02T10:48:03.267 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-03-02T10:48:03.267 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta expand map: {default=false} 2023-03-02T10:48:03.268 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta from 'false' to 'false' 2023-03-02T10:48:03.268 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta expanded map: {default=false} 2023-03-02T10:48:03.268 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta expand map: {default=info} 2023-03-02T10:48:03.268 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta from 'info' to 'info' 2023-03-02T10:48:03.268 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta expanded map: {default=info} 2023-03-02T10:48:03.268 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta expand map: {default=daemon} 2023-03-02T10:48:03.268 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta from 'daemon' to 'daemon' 2023-03-02T10:48:03.269 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta expanded map: {default=daemon} 2023-03-02T10:48:03.269 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta expand map: {default=debug} 2023-03-02T10:48:03.269 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta from 'debug' to 'debug' 2023-03-02T10:48:03.269 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: expand_channel_meta expanded map: {default=debug} 2023-03-02T10:48:03.269 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: mon.a is new leader, mons a in quorum (ranks 0) 2023-03-02T10:48:03.269 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: monmap e1: 1 mons at {a=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0]} removed_ranks: {} 2023-03-02T10:48:03.269 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: fsmap 2023-03-02T10:48:03.270 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: osdmap e1: 0 total, 0 up, 0 in 2023-03-02T10:48:03.270 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 ceph-mon[92072]: mgrmap e1: no daemons active 2023-03-02T10:48:03.270 INFO:teuthology.orchestra.run.smithi057.stdout:Setting mon public_network to 172.21.0.0/20 2023-03-02T10:48:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:03 smithi057 systemd[1]: Started Ceph mon.a for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:48:04.200 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.704+0000 7f9d167ab700 1 Processor -- start 2023-03-02T10:48:04.201 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.704+0000 7f9d167ab700 1 -- start start 2023-03-02T10:48:04.201 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.704+0000 7f9d167ab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d10108260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:04.201 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.704+0000 7f9d167ab700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10079d00 con 0x7f9d10105e80 2023-03-02T10:48:04.201 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.705+0000 7f9d0ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d10108260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:04.201 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.705+0000 7f9d0ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d10108260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38962/0 (socket says 172.21.15.57:38962) 2023-03-02T10:48:04.202 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.705+0000 7f9d0ffff700 1 -- 172.21.15.57:0/4027626358 learned_addr learned my addr 172.21.15.57:0/4027626358 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:04.202 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.705+0000 7f9d0ffff700 1 -- 172.21.15.57:0/4027626358 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d10079e40 con 0x7f9d10105e80 2023-03-02T10:48:04.202 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.705+0000 7f9d0ffff700 1 --2- 172.21.15.57:0/4027626358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d10108260 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9d000098a0 tx=0x7f9d00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6dd2d7b0a37df51 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:04.202 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.706+0000 7f9d0effd700 1 -- 172.21.15.57:0/4027626358 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d00004160 con 0x7f9d10105e80 2023-03-02T10:48:04.202 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.706+0000 7f9d0effd700 1 -- 172.21.15.57:0/4027626358 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d000042c0 con 0x7f9d10105e80 2023-03-02T10:48:04.202 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.706+0000 7f9d0effd700 1 -- 172.21.15.57:0/4027626358 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d00011a00 con 0x7f9d10105e80 2023-03-02T10:48:04.202 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.706+0000 7f9d167ab700 1 -- 172.21.15.57:0/4027626358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 msgr2=0x7f9d10108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:04.203 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.706+0000 7f9d167ab700 1 --2- 172.21.15.57:0/4027626358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d10108260 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9d000098a0 tx=0x7f9d00009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:04.203 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.706+0000 7f9d167ab700 1 -- 172.21.15.57:0/4027626358 shutdown_connections 2023-03-02T10:48:04.203 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.706+0000 7f9d167ab700 1 --2- 172.21.15.57:0/4027626358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d10108260 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:04.203 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.706+0000 7f9d167ab700 1 -- 172.21.15.57:0/4027626358 >> 172.21.15.57:0/4027626358 conn(0x7f9d100ff8a0 msgr2=0x7f9d10101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:04.203 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.706+0000 7f9d167ab700 1 -- 172.21.15.57:0/4027626358 shutdown_connections 2023-03-02T10:48:04.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.706+0000 7f9d167ab700 1 -- 172.21.15.57:0/4027626358 wait complete. 2023-03-02T10:48:04.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.707+0000 7f9d167ab700 1 Processor -- start 2023-03-02T10:48:04.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.707+0000 7f9d167ab700 1 -- start start 2023-03-02T10:48:04.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.707+0000 7f9d167ab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d101057f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:04.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.707+0000 7f9d167ab700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10105d30 con 0x7f9d10105e80 2023-03-02T10:48:04.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.708+0000 7f9d0ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d101057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:04.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.708+0000 7f9d0ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d101057f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38972/0 (socket says 172.21.15.57:38972) 2023-03-02T10:48:04.204 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.708+0000 7f9d0ffff700 1 -- 172.21.15.57:0/1253525752 learned_addr learned my addr 172.21.15.57:0/1253525752 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:04.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.708+0000 7f9d0ffff700 1 -- 172.21.15.57:0/1253525752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d00009550 con 0x7f9d10105e80 2023-03-02T10:48:04.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.708+0000 7f9d0ffff700 1 --2- 172.21.15.57:0/1253525752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d101057f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009fb0 tx=0x7f9d00011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:04.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.708+0000 7f9d0d7fa700 1 -- 172.21.15.57:0/1253525752 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d00003930 con 0x7f9d10105e80 2023-03-02T10:48:04.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.708+0000 7f9d0d7fa700 1 -- 172.21.15.57:0/1253525752 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d00003a90 con 0x7f9d10105e80 2023-03-02T10:48:04.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.708+0000 7f9d0d7fa700 1 -- 172.21.15.57:0/1253525752 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d000195e0 con 0x7f9d10105e80 2023-03-02T10:48:04.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.708+0000 7f9d167ab700 1 -- 172.21.15.57:0/1253525752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d101095a0 con 0x7f9d10105e80 2023-03-02T10:48:04.205 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.709+0000 7f9d167ab700 1 -- 172.21.15.57:0/1253525752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d10109410 con 0x7f9d10105e80 2023-03-02T10:48:04.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.709+0000 7f9d0d7fa700 1 -- 172.21.15.57:0/1253525752 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9d0002a020 con 0x7f9d10105e80 2023-03-02T10:48:04.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.709+0000 7f9d0d7fa700 1 -- 172.21.15.57:0/1253525752 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9d0002dba0 con 0x7f9d10105e80 2023-03-02T10:48:04.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.709+0000 7f9d167ab700 1 -- 172.21.15.57:0/1253525752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d10061bc0 con 0x7f9d10105e80 2023-03-02T10:48:04.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.712+0000 7f9d0d7fa700 1 -- 172.21.15.57:0/1253525752 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72046 (secure 0 0 0) 0x7f9d00003c00 con 0x7f9d10105e80 2023-03-02T10:48:04.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.783+0000 7f9d167ab700 1 -- 172.21.15.57:0/1253525752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f9d10104780 con 0x7f9d10105e80 2023-03-02T10:48:04.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.786+0000 7f9d0d7fa700 1 -- 172.21.15.57:0/1253525752 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9d00019cd0 con 0x7f9d10105e80 2023-03-02T10:48:04.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.787+0000 7f9d167ab700 1 -- 172.21.15.57:0/1253525752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 msgr2=0x7f9d101057f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:04.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.787+0000 7f9d167ab700 1 --2- 172.21.15.57:0/1253525752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d101057f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009fb0 tx=0x7f9d00011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:04.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.787+0000 7f9d167ab700 1 -- 172.21.15.57:0/1253525752 shutdown_connections 2023-03-02T10:48:04.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.787+0000 7f9d167ab700 1 --2- 172.21.15.57:0/1253525752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d10105e80 0x7f9d101057f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:04.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.787+0000 7f9d167ab700 1 -- 172.21.15.57:0/1253525752 >> 172.21.15.57:0/1253525752 conn(0x7f9d100ff8a0 msgr2=0x7f9d10100620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:04.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.787+0000 7f9d167ab700 1 -- 172.21.15.57:0/1253525752 shutdown_connections 2023-03-02T10:48:04.207 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:03.787+0000 7f9d167ab700 1 -- 172.21.15.57:0/1253525752 wait complete. 2023-03-02T10:48:04.207 INFO:teuthology.orchestra.run.smithi057.stdout:Wrote config to /etc/ceph/ceph.conf 2023-03-02T10:48:04.207 INFO:teuthology.orchestra.run.smithi057.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-03-02T10:48:04.207 INFO:teuthology.orchestra.run.smithi057.stdout:Creating mgr... 2023-03-02T10:48:04.208 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying port 9283 ... 2023-03-02T10:48:04.208 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying port 8765 ... 2023-03-02T10:48:04.394 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mgr.x 2023-03-02T10:48:04.395 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Failed to reset failed state of unit ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mgr.x.service: Unit ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mgr.x.service not loaded. 2023-03-02T10:48:04.535 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c.target.wants/ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mgr.x.service → /etc/systemd/system/ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@.service. 2023-03-02T10:48:04.925 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:04 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1253525752' entity='client.admin' 2023-03-02T10:48:04.926 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:04 smithi057 systemd[1]: Starting Ceph mgr.x for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:48:05.182 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:04 smithi057 podman[92304]: 2023-03-02T10:48:05.183 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:05 smithi057 bash[92304]: ef88e7660acc0844416ca945f89a925be70eea8acb2ec6a22292eeddc58b2717 2023-03-02T10:48:05.236 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-03-02T10:48:05.236 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout disabled 2023-03-02T10:48:05.247 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-03-02T10:48:05.247 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2023-03-02T10:48:05.248 INFO:teuthology.orchestra.run.smithi057.stdout:firewalld.service is not enabled 2023-03-02T10:48:05.248 INFO:teuthology.orchestra.run.smithi057.stdout:Not possible to enable service . firewalld.service is not available 2023-03-02T10:48:05.259 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-03-02T10:48:05.260 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout disabled 2023-03-02T10:48:05.270 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-03-02T10:48:05.271 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2023-03-02T10:48:05.271 INFO:teuthology.orchestra.run.smithi057.stdout:firewalld.service is not enabled 2023-03-02T10:48:05.271 INFO:teuthology.orchestra.run.smithi057.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-03-02T10:48:05.271 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mgr to start... 2023-03-02T10:48:05.272 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mgr... 2023-03-02T10:48:05.505 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:05 smithi057 systemd[1]: Started Ceph mgr.x for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:48:05.505 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:05 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:05.312+0000 7f20add68200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-02T10:48:05.505 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:05 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:05.403+0000 7f20add68200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-02T10:48:05.820 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:05 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:05.503+0000 7f20add68200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-02T10:48:05.820 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:05 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:05.616+0000 7f20add68200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-02T10:48:06.072 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:05 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/427386001' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-03-02T10:48:06.072 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:05 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:05.818+0000 7f20add68200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-02T10:48:06.334 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:48:06.341 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2023-03-02T10:48:06.342 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:48:06.342 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "health": { 2023-03-02T10:48:06.342 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-03-02T10:48:06.342 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-03-02T10:48:06.342 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-03-02T10:48:06.343 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:06.343 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-03-02T10:48:06.343 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-03-02T10:48:06.343 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 0 2023-03-02T10:48:06.343 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:06.343 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-03-02T10:48:06.343 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "a" 2023-03-02T10:48:06.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:06.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-03-02T10:48:06.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "monmap": { 2023-03-02T10:48:06.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:06.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-03-02T10:48:06.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-03-02T10:48:06.344 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:06.345 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-03-02T10:48:06.345 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:06.345 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-03-02T10:48:06.345 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-03-02T10:48:06.345 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-03-02T10:48:06.345 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-03-02T10:48:06.345 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-03-02T10:48:06.346 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-03-02T10:48:06.346 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:06.346 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-03-02T10:48:06.346 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-03-02T10:48:06.346 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-03-02T10:48:06.346 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-03-02T10:48:06.346 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-03-02T10:48:06.346 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-03-02T10:48:06.347 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-03-02T10:48:06.347 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-03-02T10:48:06.347 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-03-02T10:48:06.347 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:06.347 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-03-02T10:48:06.347 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:06.347 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-03-02T10:48:06.347 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-03-02T10:48:06.348 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:06.348 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-03-02T10:48:06.348 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": false, 2023-03-02T10:48:06.348 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-03-02T10:48:06.348 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modules": [ 2023-03-02T10:48:06.348 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "iostat", 2023-03-02T10:48:06.348 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "nfs", 2023-03-02T10:48:06.348 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "restful" 2023-03-02T10:48:06.349 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:06.349 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-02T10:48:06.349 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:06.349 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-03-02T10:48:06.349 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:06.349 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modified": "2023-03-02T10:47:58.477991+0000", 2023-03-02T10:48:06.349 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-02T10:48:06.350 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:06.350 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-03-02T10:48:06.350 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2023-03-02T10:48:06.350 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.802+0000 7f7b9585d700 1 Processor -- start 2023-03-02T10:48:06.350 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.803+0000 7f7b9585d700 1 -- start start 2023-03-02T10:48:06.350 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.803+0000 7f7b9585d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b90104650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:06.350 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.803+0000 7f7b9585d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b90104b90 con 0x7f7b90104240 2023-03-02T10:48:06.350 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.804+0000 7f7b8effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b90104650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:06.351 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.804+0000 7f7b8effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b90104650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38998/0 (socket says 172.21.15.57:38998) 2023-03-02T10:48:06.351 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.804+0000 7f7b8effd700 1 -- 172.21.15.57:0/3927347973 learned_addr learned my addr 172.21.15.57:0/3927347973 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:06.351 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.804+0000 7f7b8effd700 1 -- 172.21.15.57:0/3927347973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b90104cd0 con 0x7f7b90104240 2023-03-02T10:48:06.351 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.804+0000 7f7b8effd700 1 --2- 172.21.15.57:0/3927347973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b90104650 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000bb40 tx=0x7f7b8000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de522849ce60f7ed server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:06.351 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.804+0000 7f7b8dffb700 1 -- 172.21.15.57:0/3927347973 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b8000dbe0 con 0x7f7b90104240 2023-03-02T10:48:06.351 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.804+0000 7f7b8dffb700 1 -- 172.21.15.57:0/3927347973 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7b800044d0 con 0x7f7b90104240 2023-03-02T10:48:06.351 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.804+0000 7f7b8dffb700 1 -- 172.21.15.57:0/3927347973 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b80010470 con 0x7f7b90104240 2023-03-02T10:48:06.352 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.805+0000 7f7b9585d700 1 -- 172.21.15.57:0/3927347973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 msgr2=0x7f7b90104650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:06.352 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.805+0000 7f7b9585d700 1 --2- 172.21.15.57:0/3927347973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b90104650 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000bb40 tx=0x7f7b8000be50 comp rx=0 tx=0).stop 2023-03-02T10:48:06.352 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.805+0000 7f7b9585d700 1 -- 172.21.15.57:0/3927347973 shutdown_connections 2023-03-02T10:48:06.352 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.805+0000 7f7b9585d700 1 --2- 172.21.15.57:0/3927347973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b90104650 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:06.352 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.805+0000 7f7b9585d700 1 -- 172.21.15.57:0/3927347973 >> 172.21.15.57:0/3927347973 conn(0x7f7b900ff8a0 msgr2=0x7f7b90101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:06.352 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.805+0000 7f7b9585d700 1 -- 172.21.15.57:0/3927347973 shutdown_connections 2023-03-02T10:48:06.352 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.805+0000 7f7b9585d700 1 -- 172.21.15.57:0/3927347973 wait complete. 2023-03-02T10:48:06.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.806+0000 7f7b9585d700 1 Processor -- start 2023-03-02T10:48:06.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.806+0000 7f7b9585d700 1 -- start start 2023-03-02T10:48:06.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.806+0000 7f7b9585d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b9019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:06.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.806+0000 7f7b9585d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9019b6c0 con 0x7f7b90104240 2023-03-02T10:48:06.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.806+0000 7f7b8effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b9019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:06.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.806+0000 7f7b8effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b9019b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39000/0 (socket says 172.21.15.57:39000) 2023-03-02T10:48:06.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.806+0000 7f7b8effd700 1 -- 172.21.15.57:0/427386001 learned_addr learned my addr 172.21.15.57:0/427386001 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:06.353 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.807+0000 7f7b8effd700 1 -- 172.21.15.57:0/427386001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8000b7f0 con 0x7f7b90104240 2023-03-02T10:48:06.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.807+0000 7f7b8effd700 1 --2- 172.21.15.57:0/427386001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b9019b180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7b80003a80 tx=0x7f7b80003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:06.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.807+0000 7f7b9485b700 1 -- 172.21.15.57:0/427386001 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b800106e0 con 0x7f7b90104240 2023-03-02T10:48:06.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.807+0000 7f7b9585d700 1 -- 172.21.15.57:0/427386001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b901062d0 con 0x7f7b90104240 2023-03-02T10:48:06.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.807+0000 7f7b9485b700 1 -- 172.21.15.57:0/427386001 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7b80010ce0 con 0x7f7b90104240 2023-03-02T10:48:06.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.807+0000 7f7b9485b700 1 -- 172.21.15.57:0/427386001 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b80021c60 con 0x7f7b90104240 2023-03-02T10:48:06.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.807+0000 7f7b9585d700 1 -- 172.21.15.57:0/427386001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b90106140 con 0x7f7b90104240 2023-03-02T10:48:06.354 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.807+0000 7f7b9485b700 1 -- 172.21.15.57:0/427386001 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f7b8002a3f0 con 0x7f7b90104240 2023-03-02T10:48:06.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.808+0000 7f7b9485b700 1 -- 172.21.15.57:0/427386001 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7b80019570 con 0x7f7b90104240 2023-03-02T10:48:06.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.809+0000 7f7b767fc700 1 -- 172.21.15.57:0/427386001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b700052f0 con 0x7f7b90104240 2023-03-02T10:48:06.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.811+0000 7f7b9485b700 1 -- 172.21.15.57:0/427386001 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72046 (secure 0 0 0) 0x7f7b8002f060 con 0x7f7b90104240 2023-03-02T10:48:06.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.899+0000 7f7b767fc700 1 -- 172.21.15.57:0/427386001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7b70005c90 con 0x7f7b90104240 2023-03-02T10:48:06.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.899+0000 7f7b9485b700 1 -- 172.21.15.57:0/427386001 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f7b80021410 con 0x7f7b90104240 2023-03-02T10:48:06.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.900+0000 7f7b767fc700 1 -- 172.21.15.57:0/427386001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 msgr2=0x7f7b9019b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:06.355 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.900+0000 7f7b767fc700 1 --2- 172.21.15.57:0/427386001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b9019b180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7b80003a80 tx=0x7f7b80003df0 comp rx=0 tx=0).stop 2023-03-02T10:48:06.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.900+0000 7f7b767fc700 1 -- 172.21.15.57:0/427386001 shutdown_connections 2023-03-02T10:48:06.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.900+0000 7f7b767fc700 1 --2- 172.21.15.57:0/427386001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b90104240 0x7f7b9019b180 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:06.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.900+0000 7f7b767fc700 1 -- 172.21.15.57:0/427386001 >> 172.21.15.57:0/427386001 conn(0x7f7b900ff8a0 msgr2=0x7f7b9018dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:06.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.900+0000 7f7b767fc700 1 -- 172.21.15.57:0/427386001 shutdown_connections 2023-03-02T10:48:06.356 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:05.900+0000 7f7b767fc700 1 -- 172.21.15.57:0/427386001 wait complete. 2023-03-02T10:48:06.357 INFO:teuthology.orchestra.run.smithi057.stdout:mgr not available, waiting (1/15)... 2023-03-02T10:48:06.432 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:06 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:06.206+0000 7f20add68200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-02T10:48:06.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:06 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:06.308+0000 7f20add68200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-02T10:48:06.932 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:06 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:06.453+0000 7f20add68200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-02T10:48:06.933 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:06 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:06.561+0000 7f20add68200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-02T10:48:07.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:07 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:07.045+0000 7f20add68200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-02T10:48:08.182 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:07 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:07.725+0000 7f20add68200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-02T10:48:08.183 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:07 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:07.911+0000 7f20add68200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-02T10:48:08.896 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:08 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:08.786+0000 7f20add68200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:48:09.171 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:08 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:08.896+0000 7f20add68200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-02T10:48:09.171 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:09 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:09.104+0000 7f20add68200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:48:09.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:48:09.303 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2023-03-02T10:48:09.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:48:09.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "health": { 2023-03-02T10:48:09.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-03-02T10:48:09.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-03-02T10:48:09.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-03-02T10:48:09.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:09.304 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-03-02T10:48:09.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-03-02T10:48:09.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 0 2023-03-02T10:48:09.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:09.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-03-02T10:48:09.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "a" 2023-03-02T10:48:09.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:09.305 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-03-02T10:48:09.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "monmap": { 2023-03-02T10:48:09.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:09.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-03-02T10:48:09.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-03-02T10:48:09.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:09.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-03-02T10:48:09.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:09.306 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-03-02T10:48:09.307 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-03-02T10:48:09.312 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-03-02T10:48:09.312 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-03-02T10:48:09.313 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-03-02T10:48:09.313 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-03-02T10:48:09.313 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:09.313 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-03-02T10:48:09.313 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-03-02T10:48:09.313 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-03-02T10:48:09.313 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-03-02T10:48:09.314 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-03-02T10:48:09.314 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-03-02T10:48:09.314 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-03-02T10:48:09.314 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-03-02T10:48:09.314 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-03-02T10:48:09.314 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:09.314 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-03-02T10:48:09.314 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:09.315 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-03-02T10:48:09.315 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-03-02T10:48:09.315 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:09.315 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-03-02T10:48:09.315 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": false, 2023-03-02T10:48:09.315 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-03-02T10:48:09.315 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modules": [ 2023-03-02T10:48:09.316 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "iostat", 2023-03-02T10:48:09.316 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "nfs", 2023-03-02T10:48:09.316 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "restful" 2023-03-02T10:48:09.316 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:09.316 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-02T10:48:09.317 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:09.317 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-03-02T10:48:09.317 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:09.317 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modified": "2023-03-02T10:47:58.477991+0000", 2023-03-02T10:48:09.317 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-02T10:48:09.317 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:09.317 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-03-02T10:48:09.318 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2023-03-02T10:48:09.318 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.791+0000 7f9b95279700 1 Processor -- start 2023-03-02T10:48:09.318 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.791+0000 7f9b95279700 1 -- start start 2023-03-02T10:48:09.318 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.791+0000 7f9b95279700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9010a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:09.318 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.791+0000 7f9b95279700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b90105cc0 con 0x7f9b90079cc0 2023-03-02T10:48:09.318 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.792+0000 7f9b8effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9010a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:09.318 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.792+0000 7f9b8effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9010a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44810/0 (socket says 172.21.15.57:44810) 2023-03-02T10:48:09.318 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.792+0000 7f9b8effd700 1 -- 172.21.15.57:0/3865154256 learned_addr learned my addr 172.21.15.57:0/3865154256 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:09.319 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.792+0000 7f9b8effd700 1 -- 172.21.15.57:0/3865154256 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9010a810 con 0x7f9b90079cc0 2023-03-02T10:48:09.319 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.792+0000 7f9b8effd700 1 --2- 172.21.15.57:0/3865154256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9010a2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9b800098a0 tx=0x7f9b80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2cec8a820aa175 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:09.319 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.792+0000 7f9b8dffb700 1 -- 172.21.15.57:0/3865154256 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b80004160 con 0x7f9b90079cc0 2023-03-02T10:48:09.319 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.792+0000 7f9b8dffb700 1 -- 172.21.15.57:0/3865154256 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b800042c0 con 0x7f9b90079cc0 2023-03-02T10:48:09.319 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.792+0000 7f9b8dffb700 1 -- 172.21.15.57:0/3865154256 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b80011a00 con 0x7f9b90079cc0 2023-03-02T10:48:09.319 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.793+0000 7f9b95279700 1 -- 172.21.15.57:0/3865154256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 msgr2=0x7f9b9010a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:09.320 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.793+0000 7f9b95279700 1 --2- 172.21.15.57:0/3865154256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9010a2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9b800098a0 tx=0x7f9b80009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:09.320 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.793+0000 7f9b95279700 1 -- 172.21.15.57:0/3865154256 shutdown_connections 2023-03-02T10:48:09.320 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.793+0000 7f9b95279700 1 --2- 172.21.15.57:0/3865154256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9010a2d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:09.320 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.793+0000 7f9b95279700 1 -- 172.21.15.57:0/3865154256 >> 172.21.15.57:0/3865154256 conn(0x7f9b900ff8a0 msgr2=0x7f9b90101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:09.321 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.793+0000 7f9b95279700 1 -- 172.21.15.57:0/3865154256 shutdown_connections 2023-03-02T10:48:09.321 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.793+0000 7f9b95279700 1 -- 172.21.15.57:0/3865154256 wait complete. 2023-03-02T10:48:09.321 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.794+0000 7f9b95279700 1 Processor -- start 2023-03-02T10:48:09.321 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.795+0000 7f9b95279700 1 -- start start 2023-03-02T10:48:09.321 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.795+0000 7f9b95279700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:09.321 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.795+0000 7f9b95279700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9019b6e0 con 0x7f9b90079cc0 2023-03-02T10:48:09.322 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.795+0000 7f9b8effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:09.322 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.795+0000 7f9b8effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9019b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44814/0 (socket says 172.21.15.57:44814) 2023-03-02T10:48:09.322 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.795+0000 7f9b8effd700 1 -- 172.21.15.57:0/1918865479 learned_addr learned my addr 172.21.15.57:0/1918865479 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:09.322 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.795+0000 7f9b8effd700 1 -- 172.21.15.57:0/1918865479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80009550 con 0x7f9b90079cc0 2023-03-02T10:48:09.322 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.796+0000 7f9b8effd700 1 --2- 172.21.15.57:0/1918865479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9019b1a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9b80006af0 tx=0x7f9b80011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:09.322 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.796+0000 7f9b77fff700 1 -- 172.21.15.57:0/1918865479 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b80003a40 con 0x7f9b90079cc0 2023-03-02T10:48:09.322 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.796+0000 7f9b77fff700 1 -- 172.21.15.57:0/1918865479 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b80003ba0 con 0x7f9b90079cc0 2023-03-02T10:48:09.323 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.796+0000 7f9b95279700 1 -- 172.21.15.57:0/1918865479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9010b7a0 con 0x7f9b90079cc0 2023-03-02T10:48:09.323 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.796+0000 7f9b77fff700 1 -- 172.21.15.57:0/1918865479 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8001a700 con 0x7f9b90079cc0 2023-03-02T10:48:09.323 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.796+0000 7f9b95279700 1 -- 172.21.15.57:0/1918865479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9010b610 con 0x7f9b90079cc0 2023-03-02T10:48:09.323 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.796+0000 7f9b77fff700 1 -- 172.21.15.57:0/1918865479 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9b80017020 con 0x7f9b90079cc0 2023-03-02T10:48:09.323 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.796+0000 7f9b77fff700 1 -- 172.21.15.57:0/1918865479 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9b800193c0 con 0x7f9b90079cc0 2023-03-02T10:48:09.323 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.797+0000 7f9b95279700 1 -- 172.21.15.57:0/1918865479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b90061bc0 con 0x7f9b90079cc0 2023-03-02T10:48:09.323 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.799+0000 7f9b77fff700 1 -- 172.21.15.57:0/1918865479 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72046 (secure 0 0 0) 0x7f9b80024ad0 con 0x7f9b90079cc0 2023-03-02T10:48:09.323 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.876+0000 7f9b95279700 1 -- 172.21.15.57:0/1918865479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9b9019bc30 con 0x7f9b90079cc0 2023-03-02T10:48:09.324 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.877+0000 7f9b77fff700 1 -- 172.21.15.57:0/1918865479 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f9b80024c70 con 0x7f9b90079cc0 2023-03-02T10:48:09.324 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.877+0000 7f9b95279700 1 -- 172.21.15.57:0/1918865479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 msgr2=0x7f9b9019b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:09.324 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.877+0000 7f9b95279700 1 --2- 172.21.15.57:0/1918865479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9019b1a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9b80006af0 tx=0x7f9b80011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:09.324 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.878+0000 7f9b95279700 1 -- 172.21.15.57:0/1918865479 shutdown_connections 2023-03-02T10:48:09.324 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.878+0000 7f9b95279700 1 --2- 172.21.15.57:0/1918865479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b90079cc0 0x7f9b9019b1a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:09.324 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.878+0000 7f9b95279700 1 -- 172.21.15.57:0/1918865479 >> 172.21.15.57:0/1918865479 conn(0x7f9b900ff8a0 msgr2=0x7f9b90100660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:09.324 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.878+0000 7f9b95279700 1 -- 172.21.15.57:0/1918865479 shutdown_connections 2023-03-02T10:48:09.325 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:08.878+0000 7f9b95279700 1 -- 172.21.15.57:0/1918865479 wait complete. 2023-03-02T10:48:09.325 INFO:teuthology.orchestra.run.smithi057.stdout:mgr not available, waiting (2/15)... 2023-03-02T10:48:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:09 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1918865479' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-03-02T10:48:09.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:09 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:09.327+0000 7f20add68200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-02T10:48:09.932 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:09 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:09.498+0000 7f20add68200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-02T10:48:10.432 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:09 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:09.949+0000 7f20add68200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-02T10:48:10.928 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:10 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:10.590+0000 7f20add68200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-02T10:48:11.183 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:10 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:10.927+0000 7f20add68200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-02T10:48:11.183 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:11 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:11.151+0000 7f20add68200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-02T10:48:11.545 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:11 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:11.285+0000 7f20add68200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-02T10:48:11.545 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:11 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:11.544+0000 7f20add68200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-02T10:48:12.369 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:48:12.370 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2023-03-02T10:48:12.370 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:48:12.370 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "health": { 2023-03-02T10:48:12.370 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-03-02T10:48:12.370 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-03-02T10:48:12.370 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-03-02T10:48:12.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:12.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-03-02T10:48:12.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-03-02T10:48:12.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 0 2023-03-02T10:48:12.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:12.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-03-02T10:48:12.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "a" 2023-03-02T10:48:12.371 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:12.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-03-02T10:48:12.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "monmap": { 2023-03-02T10:48:12.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:12.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-03-02T10:48:12.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-03-02T10:48:12.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:12.372 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-03-02T10:48:12.373 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:11 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3292830954' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-03-02T10:48:12.379 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:12.379 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-03-02T10:48:12.379 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-03-02T10:48:12.379 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-03-02T10:48:12.379 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-03-02T10:48:12.380 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-03-02T10:48:12.380 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-03-02T10:48:12.380 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:12.380 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-03-02T10:48:12.380 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-03-02T10:48:12.380 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-03-02T10:48:12.380 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-03-02T10:48:12.381 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-03-02T10:48:12.381 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-03-02T10:48:12.381 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-03-02T10:48:12.381 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-03-02T10:48:12.381 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-03-02T10:48:12.381 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:12.381 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-03-02T10:48:12.382 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:12.382 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-03-02T10:48:12.382 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-03-02T10:48:12.382 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:12.382 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-03-02T10:48:12.382 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": false, 2023-03-02T10:48:12.382 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-03-02T10:48:12.383 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modules": [ 2023-03-02T10:48:12.383 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "iostat", 2023-03-02T10:48:12.383 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "nfs", 2023-03-02T10:48:12.383 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "restful" 2023-03-02T10:48:12.383 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:12.383 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-02T10:48:12.383 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:12.384 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-03-02T10:48:12.384 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:12.384 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modified": "2023-03-02T10:47:58.477991+0000", 2023-03-02T10:48:12.384 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-02T10:48:12.384 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:12.384 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-03-02T10:48:12.384 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2023-03-02T10:48:12.385 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.806+0000 7fb0b26c7700 1 Processor -- start 2023-03-02T10:48:12.385 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.806+0000 7fb0b26c7700 1 -- start start 2023-03-02T10:48:12.385 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.807+0000 7fb0b26c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:12.385 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.807+0000 7fb0b26c7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac108410 con 0x7fb0ac079cc0 2023-03-02T10:48:12.385 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.807+0000 7fb0abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:12.385 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.807+0000 7fb0abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac107ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44828/0 (socket says 172.21.15.57:44828) 2023-03-02T10:48:12.385 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.807+0000 7fb0abfff700 1 -- 172.21.15.57:0/1669392713 learned_addr learned my addr 172.21.15.57:0/1669392713 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:12.386 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.807+0000 7fb0abfff700 1 -- 172.21.15.57:0/1669392713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac108550 con 0x7fb0ac079cc0 2023-03-02T10:48:12.386 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.807+0000 7fb0abfff700 1 --2- 172.21.15.57:0/1669392713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac107ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0098a0 tx=0x7fb09c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc22b11a22e7d95 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:12.386 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.808+0000 7fb0aaffd700 1 -- 172.21.15.57:0/1669392713 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb09c004160 con 0x7fb0ac079cc0 2023-03-02T10:48:12.386 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.808+0000 7fb0aaffd700 1 -- 172.21.15.57:0/1669392713 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb09c0042c0 con 0x7fb0ac079cc0 2023-03-02T10:48:12.386 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.808+0000 7fb0aaffd700 1 -- 172.21.15.57:0/1669392713 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb09c011a00 con 0x7fb0ac079cc0 2023-03-02T10:48:12.386 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.808+0000 7fb0b26c7700 1 -- 172.21.15.57:0/1669392713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 msgr2=0x7fb0ac107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:12.386 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.808+0000 7fb0b26c7700 1 --2- 172.21.15.57:0/1669392713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac107ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0098a0 tx=0x7fb09c009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:12.386 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.808+0000 7fb0b26c7700 1 -- 172.21.15.57:0/1669392713 shutdown_connections 2023-03-02T10:48:12.387 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.808+0000 7fb0b26c7700 1 --2- 172.21.15.57:0/1669392713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac107ed0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:12.387 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.808+0000 7fb0b26c7700 1 -- 172.21.15.57:0/1669392713 >> 172.21.15.57:0/1669392713 conn(0x7fb0ac0ff8a0 msgr2=0x7fb0ac101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:12.387 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.808+0000 7fb0b26c7700 1 -- 172.21.15.57:0/1669392713 shutdown_connections 2023-03-02T10:48:12.387 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.808+0000 7fb0b26c7700 1 -- 172.21.15.57:0/1669392713 wait complete. 2023-03-02T10:48:12.387 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.809+0000 7fb0b26c7700 1 Processor -- start 2023-03-02T10:48:12.387 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.809+0000 7fb0b26c7700 1 -- start start 2023-03-02T10:48:12.387 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.810+0000 7fb0b26c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac19b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:12.388 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.810+0000 7fb0b26c7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac19b6c0 con 0x7fb0ac079cc0 2023-03-02T10:48:12.388 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.810+0000 7fb0abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac19b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:12.388 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.810+0000 7fb0abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac19b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44830/0 (socket says 172.21.15.57:44830) 2023-03-02T10:48:12.388 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.810+0000 7fb0abfff700 1 -- 172.21.15.57:0/3292830954 learned_addr learned my addr 172.21.15.57:0/3292830954 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:12.388 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.810+0000 7fb0abfff700 1 -- 172.21.15.57:0/3292830954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c009550 con 0x7fb0ac079cc0 2023-03-02T10:48:12.388 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.810+0000 7fb0abfff700 1 --2- 172.21.15.57:0/3292830954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac19b180 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb09c006af0 tx=0x7fb09c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:12.388 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.810+0000 7fb0a97fa700 1 -- 172.21.15.57:0/3292830954 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb09c003a40 con 0x7fb0ac079cc0 2023-03-02T10:48:12.389 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.811+0000 7fb0a97fa700 1 -- 172.21.15.57:0/3292830954 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb09c003ba0 con 0x7fb0ac079cc0 2023-03-02T10:48:12.389 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.811+0000 7fb0b26c7700 1 -- 172.21.15.57:0/3292830954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ac1095a0 con 0x7fb0ac079cc0 2023-03-02T10:48:12.389 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.811+0000 7fb0a97fa700 1 -- 172.21.15.57:0/3292830954 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb09c01a700 con 0x7fb0ac079cc0 2023-03-02T10:48:12.389 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.811+0000 7fb0b26c7700 1 -- 172.21.15.57:0/3292830954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ac109410 con 0x7fb0ac079cc0 2023-03-02T10:48:12.389 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.811+0000 7fb0a97fa700 1 -- 172.21.15.57:0/3292830954 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb09c017020 con 0x7fb0ac079cc0 2023-03-02T10:48:12.389 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.811+0000 7fb0a97fa700 1 -- 172.21.15.57:0/3292830954 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb09c0193c0 con 0x7fb0ac079cc0 2023-03-02T10:48:12.389 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.812+0000 7fb0b26c7700 1 -- 172.21.15.57:0/3292830954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ac061bc0 con 0x7fb0ac079cc0 2023-03-02T10:48:12.390 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.814+0000 7fb0a97fa700 1 -- 172.21.15.57:0/3292830954 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72046 (secure 0 0 0) 0x7fb09c024ad0 con 0x7fb0ac079cc0 2023-03-02T10:48:12.390 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.913+0000 7fb0b26c7700 1 -- 172.21.15.57:0/3292830954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb0ac19be10 con 0x7fb0ac079cc0 2023-03-02T10:48:12.390 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.913+0000 7fb0a97fa700 1 -- 172.21.15.57:0/3292830954 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fb09c024c70 con 0x7fb0ac079cc0 2023-03-02T10:48:12.390 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.914+0000 7fb0b26c7700 1 -- 172.21.15.57:0/3292830954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 msgr2=0x7fb0ac19b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:12.390 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.914+0000 7fb0b26c7700 1 --2- 172.21.15.57:0/3292830954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac19b180 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb09c006af0 tx=0x7fb09c011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:12.390 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.914+0000 7fb0b26c7700 1 -- 172.21.15.57:0/3292830954 shutdown_connections 2023-03-02T10:48:12.390 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.914+0000 7fb0b26c7700 1 --2- 172.21.15.57:0/3292830954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0ac079cc0 0x7fb0ac19b180 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:12.390 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.915+0000 7fb0b26c7700 1 -- 172.21.15.57:0/3292830954 >> 172.21.15.57:0/3292830954 conn(0x7fb0ac0ff8a0 msgr2=0x7fb0ac1005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:12.391 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.915+0000 7fb0b26c7700 1 -- 172.21.15.57:0/3292830954 shutdown_connections 2023-03-02T10:48:12.391 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:11.915+0000 7fb0b26c7700 1 -- 172.21.15.57:0/3292830954 wait complete. 2023-03-02T10:48:12.391 INFO:teuthology.orchestra.run.smithi057.stdout:mgr not available, waiting (3/15)... 2023-03-02T10:48:12.682 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:12.571+0000 7f20add68200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-02T10:48:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: Activating manager daemon x 2023-03-02T10:48:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: mgrmap e2: x(active, starting, since 0.0035051s) 2023-03-02T10:48:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: from='mgr.14100 172.21.15.57:0/1114793051' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-02T10:48:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: from='mgr.14100 172.21.15.57:0/1114793051' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-02T10:48:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: from='mgr.14100 172.21.15.57:0/1114793051' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-02T10:48:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: from='mgr.14100 172.21.15.57:0/1114793051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:48:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: from='mgr.14100 172.21.15.57:0/1114793051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-02T10:48:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: Manager daemon x is now available 2023-03-02T10:48:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: from='mgr.14100 172.21.15.57:0/1114793051' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-02T10:48:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: from='mgr.14100 172.21.15.57:0/1114793051' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-02T10:48:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: from='mgr.14100 172.21.15.57:0/1114793051' entity='mgr.x' 2023-03-02T10:48:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: from='mgr.14100 172.21.15.57:0/1114793051' entity='mgr.x' 2023-03-02T10:48:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:12 smithi057 ceph-mon[92072]: from='mgr.14100 172.21.15.57:0/1114793051' entity='mgr.x' 2023-03-02T10:48:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:14 smithi057 ceph-mon[92072]: mgrmap e3: x(active, since 1.00815s) 2023-03-02T10:48:15.643 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:48:15.643 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2023-03-02T10:48:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:48:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "health": { 2023-03-02T10:48:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-03-02T10:48:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-03-02T10:48:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-03-02T10:48:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-03-02T10:48:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-03-02T10:48:15.645 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 0 2023-03-02T10:48:15.645 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:15.645 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-03-02T10:48:15.645 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "a" 2023-03-02T10:48:15.645 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:15.645 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-03-02T10:48:15.646 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "monmap": { 2023-03-02T10:48:15.646 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:15.646 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-03-02T10:48:15.646 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-03-02T10:48:15.646 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:15.646 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-03-02T10:48:15.646 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:15.646 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-03-02T10:48:15.647 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-03-02T10:48:15.647 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-03-02T10:48:15.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-03-02T10:48:15.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-03-02T10:48:15.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-03-02T10:48:15.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:15.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-03-02T10:48:15.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-03-02T10:48:15.653 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-03-02T10:48:15.654 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-03-02T10:48:15.654 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-03-02T10:48:15.654 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-03-02T10:48:15.654 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-03-02T10:48:15.654 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-03-02T10:48:15.654 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-03-02T10:48:15.655 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:15.655 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-03-02T10:48:15.655 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:15.655 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-03-02T10:48:15.655 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-03-02T10:48:15.655 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:15.655 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-03-02T10:48:15.655 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": true, 2023-03-02T10:48:15.656 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-03-02T10:48:15.656 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modules": [ 2023-03-02T10:48:15.656 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "iostat", 2023-03-02T10:48:15.656 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "nfs", 2023-03-02T10:48:15.656 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "restful" 2023-03-02T10:48:15.656 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ], 2023-03-02T10:48:15.656 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-02T10:48:15.656 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:15.657 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-03-02T10:48:15.657 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-02T10:48:15.657 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "modified": "2023-03-02T10:47:58.477991+0000", 2023-03-02T10:48:15.657 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-02T10:48:15.657 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout }, 2023-03-02T10:48:15.657 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-03-02T10:48:15.657 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2023-03-02T10:48:15.658 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.847+0000 7f6961a5d700 1 Processor -- start 2023-03-02T10:48:15.658 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.847+0000 7f6961a5d700 1 -- start start 2023-03-02T10:48:15.658 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.847+0000 7f6961a5d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c107f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:15.658 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.847+0000 7f6961a5d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c108470 con 0x7f695c079c60 2023-03-02T10:48:15.658 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.848+0000 7f695affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:15.658 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.848+0000 7f695affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c107f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44906/0 (socket says 172.21.15.57:44906) 2023-03-02T10:48:15.658 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.848+0000 7f695affd700 1 -- 172.21.15.57:0/4279456618 learned_addr learned my addr 172.21.15.57:0/4279456618 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:15.658 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.848+0000 7f695affd700 1 -- 172.21.15.57:0/4279456618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c1085b0 con 0x7f695c079c60 2023-03-02T10:48:15.659 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.848+0000 7f695affd700 1 --2- 172.21.15.57:0/4279456618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c107f30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f694c0098a0 tx=0x7f694c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1b809408c1a37c server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:15.659 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.848+0000 7f6959ffb700 1 -- 172.21.15.57:0/4279456618 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c004160 con 0x7f695c079c60 2023-03-02T10:48:15.659 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.848+0000 7f6959ffb700 1 -- 172.21.15.57:0/4279456618 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f694c0042c0 con 0x7f695c079c60 2023-03-02T10:48:15.659 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.848+0000 7f6959ffb700 1 -- 172.21.15.57:0/4279456618 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c011a00 con 0x7f695c079c60 2023-03-02T10:48:15.659 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.849+0000 7f6961a5d700 1 -- 172.21.15.57:0/4279456618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 msgr2=0x7f695c107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:15.660 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.849+0000 7f6961a5d700 1 --2- 172.21.15.57:0/4279456618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c107f30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f694c0098a0 tx=0x7f694c009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:15.660 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.849+0000 7f6961a5d700 1 -- 172.21.15.57:0/4279456618 shutdown_connections 2023-03-02T10:48:15.660 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.849+0000 7f6961a5d700 1 --2- 172.21.15.57:0/4279456618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c107f30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:15.660 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.849+0000 7f6961a5d700 1 -- 172.21.15.57:0/4279456618 >> 172.21.15.57:0/4279456618 conn(0x7f695c0ff8a0 msgr2=0x7f695c101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:15.660 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.849+0000 7f6961a5d700 1 -- 172.21.15.57:0/4279456618 shutdown_connections 2023-03-02T10:48:15.660 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.849+0000 7f6961a5d700 1 -- 172.21.15.57:0/4279456618 wait complete. 2023-03-02T10:48:15.660 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.850+0000 7f6961a5d700 1 Processor -- start 2023-03-02T10:48:15.661 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.850+0000 7f6961a5d700 1 -- start start 2023-03-02T10:48:15.661 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.850+0000 7f6961a5d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:15.661 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.850+0000 7f6961a5d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c1994f0 con 0x7f695c079c60 2023-03-02T10:48:15.661 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.850+0000 7f695affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:15.661 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.850+0000 7f695affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44908/0 (socket says 172.21.15.57:44908) 2023-03-02T10:48:15.661 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.850+0000 7f695affd700 1 -- 172.21.15.57:0/3524312604 learned_addr learned my addr 172.21.15.57:0/3524312604 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:15.661 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.851+0000 7f695affd700 1 -- 172.21.15.57:0/3524312604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c009550 con 0x7f695c079c60 2023-03-02T10:48:15.661 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.851+0000 7f695affd700 1 --2- 172.21.15.57:0/3524312604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c198fb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f694c006af0 tx=0x7f694c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:15.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.851+0000 7f6960a5b700 1 -- 172.21.15.57:0/3524312604 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c003a40 con 0x7f695c079c60 2023-03-02T10:48:15.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.851+0000 7f6960a5b700 1 -- 172.21.15.57:0/3524312604 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f694c003ba0 con 0x7f695c079c60 2023-03-02T10:48:15.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.851+0000 7f6961a5d700 1 -- 172.21.15.57:0/3524312604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c1095a0 con 0x7f695c079c60 2023-03-02T10:48:15.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.851+0000 7f6960a5b700 1 -- 172.21.15.57:0/3524312604 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f694c01a700 con 0x7f695c079c60 2023-03-02T10:48:15.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.851+0000 7f6961a5d700 1 -- 172.21.15.57:0/3524312604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c109410 con 0x7f695c079c60 2023-03-02T10:48:15.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.852+0000 7f6960a5b700 1 -- 172.21.15.57:0/3524312604 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 43498+0+0 (secure 0 0 0) 0x7f694c017020 con 0x7f695c079c60 2023-03-02T10:48:15.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.852+0000 7f6961a5d700 1 -- 172.21.15.57:0/3524312604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c061bc0 con 0x7f695c079c60 2023-03-02T10:48:15.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.853+0000 7f6960a5b700 1 --2- 172.21.15.57:0/3524312604 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f69440367d0 0x7f6944038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:15.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.853+0000 7f6960a5b700 1 -- 172.21.15.57:0/3524312604 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f694c049af0 con 0x7f695c079c60 2023-03-02T10:48:15.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.853+0000 7f695a7fc700 1 --2- 172.21.15.57:0/3524312604 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f69440367d0 0x7f6944038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:15.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.853+0000 7f695a7fc700 1 --2- 172.21.15.57:0/3524312604 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f69440367d0 0x7f6944038c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6950006fd0 tx=0x7f6950006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:15.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:14.858+0000 7f6960a5b700 1 -- 172.21.15.57:0/3524312604 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f694c018530 con 0x7f695c079c60 2023-03-02T10:48:15.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.134+0000 7f6961a5d700 1 -- 172.21.15.57:0/3524312604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f695c199a40 con 0x7f695c079c60 2023-03-02T10:48:15.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.134+0000 7f6960a5b700 1 -- 172.21.15.57:0/3524312604 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f694c018350 con 0x7f695c079c60 2023-03-02T10:48:15.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.137+0000 7f6961a5d700 1 -- 172.21.15.57:0/3524312604 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f69440367d0 msgr2=0x7f6944038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:15.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.137+0000 7f6961a5d700 1 --2- 172.21.15.57:0/3524312604 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f69440367d0 0x7f6944038c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6950006fd0 tx=0x7f6950006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:15.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.137+0000 7f6961a5d700 1 -- 172.21.15.57:0/3524312604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 msgr2=0x7f695c198fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:15.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.137+0000 7f6961a5d700 1 --2- 172.21.15.57:0/3524312604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c198fb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f694c006af0 tx=0x7f694c011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:15.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.137+0000 7f6961a5d700 1 -- 172.21.15.57:0/3524312604 shutdown_connections 2023-03-02T10:48:15.665 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.137+0000 7f6961a5d700 1 --2- 172.21.15.57:0/3524312604 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f69440367d0 0x7f6944038c80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:15.665 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.137+0000 7f6961a5d700 1 --2- 172.21.15.57:0/3524312604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f695c079c60 0x7f695c198fb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:15.665 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.137+0000 7f6961a5d700 1 -- 172.21.15.57:0/3524312604 >> 172.21.15.57:0/3524312604 conn(0x7f695c0ff8a0 msgr2=0x7f695c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:15.665 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.137+0000 7f6961a5d700 1 -- 172.21.15.57:0/3524312604 shutdown_connections 2023-03-02T10:48:15.665 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:15.137+0000 7f6961a5d700 1 -- 172.21.15.57:0/3524312604 wait complete. 2023-03-02T10:48:15.665 INFO:teuthology.orchestra.run.smithi057.stdout:mgr is available 2023-03-02T10:48:15.863 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:15 smithi057 ceph-mon[92072]: mgrmap e4: x(active, since 2s) 2023-03-02T10:48:15.863 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:15 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3524312604' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-03-02T10:48:16.809 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:48:16.809 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [global] 2023-03-02T10:48:16.809 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout fsid = 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:48:16.809 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-03-02T10:48:16.810 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-03-02T10:48:16.810 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-03-02T10:48:16.810 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-03-02T10:48:16.810 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:48:16.810 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [mgr] 2023-03-02T10:48:16.810 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-03-02T10:48:16.810 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 2023-03-02T10:48:16.810 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout [osd] 2023-03-02T10:48:16.811 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-03-02T10:48:16.811 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-03-02T10:48:16.811 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-03-02T10:48:16.811 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-03-02T10:48:16.811 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-03-02T10:48:16.811 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.070+0000 7f716157c700 1 Processor -- start 2023-03-02T10:48:16.811 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.070+0000 7f716157c700 1 -- start start 2023-03-02T10:48:16.812 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.070+0000 7f716157c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c105760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:16.812 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.070+0000 7f716157c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c105ca0 con 0x7f715c105350 2023-03-02T10:48:16.812 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.071+0000 7f715affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c105760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:16.812 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.071+0000 7f715affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c105760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42844/0 (socket says 172.21.15.57:42844) 2023-03-02T10:48:16.812 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.071+0000 7f715affd700 1 -- 172.21.15.57:0/1425023730 learned_addr learned my addr 172.21.15.57:0/1425023730 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:16.812 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.071+0000 7f715affd700 1 -- 172.21.15.57:0/1425023730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c105de0 con 0x7f715c105350 2023-03-02T10:48:16.812 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.071+0000 7f715affd700 1 --2- 172.21.15.57:0/1425023730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c105760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f714c0098a0 tx=0x7f714c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94898c7352e1202 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:16.812 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.071+0000 7f7159ffb700 1 -- 172.21.15.57:0/1425023730 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f714c004160 con 0x7f715c105350 2023-03-02T10:48:16.813 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.072+0000 7f7159ffb700 1 -- 172.21.15.57:0/1425023730 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f714c0042c0 con 0x7f715c105350 2023-03-02T10:48:16.813 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.072+0000 7f7159ffb700 1 -- 172.21.15.57:0/1425023730 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f714c011a00 con 0x7f715c105350 2023-03-02T10:48:16.813 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.072+0000 7f716157c700 1 -- 172.21.15.57:0/1425023730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 msgr2=0x7f715c105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:16.813 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.072+0000 7f716157c700 1 --2- 172.21.15.57:0/1425023730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c105760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f714c0098a0 tx=0x7f714c009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:16.813 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.072+0000 7f716157c700 1 -- 172.21.15.57:0/1425023730 shutdown_connections 2023-03-02T10:48:16.813 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.072+0000 7f716157c700 1 --2- 172.21.15.57:0/1425023730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c105760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:16.813 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.072+0000 7f716157c700 1 -- 172.21.15.57:0/1425023730 >> 172.21.15.57:0/1425023730 conn(0x7f715c1009b0 msgr2=0x7f715c102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:16.814 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.072+0000 7f716157c700 1 -- 172.21.15.57:0/1425023730 shutdown_connections 2023-03-02T10:48:16.814 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.072+0000 7f716157c700 1 -- 172.21.15.57:0/1425023730 wait complete. 2023-03-02T10:48:16.814 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.073+0000 7f716157c700 1 Processor -- start 2023-03-02T10:48:16.814 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.073+0000 7f716157c700 1 -- start start 2023-03-02T10:48:16.814 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.073+0000 7f716157c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c07bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:16.814 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.073+0000 7f716157c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c07c150 con 0x7f715c105350 2023-03-02T10:48:16.814 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.073+0000 7f715affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c07bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:16.814 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.073+0000 7f715affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c07bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42848/0 (socket says 172.21.15.57:42848) 2023-03-02T10:48:16.815 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.073+0000 7f715affd700 1 -- 172.21.15.57:0/2380670540 learned_addr learned my addr 172.21.15.57:0/2380670540 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:16.815 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.074+0000 7f715affd700 1 -- 172.21.15.57:0/2380670540 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c009550 con 0x7f715c105350 2023-03-02T10:48:16.815 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.074+0000 7f715affd700 1 --2- 172.21.15.57:0/2380670540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c07bc10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f714c006af0 tx=0x7f714c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:16.815 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.074+0000 7f7143fff700 1 -- 172.21.15.57:0/2380670540 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f714c0038b0 con 0x7f715c105350 2023-03-02T10:48:16.817 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.074+0000 7f7143fff700 1 -- 172.21.15.57:0/2380670540 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f714c003a10 con 0x7f715c105350 2023-03-02T10:48:16.818 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.074+0000 7f716157c700 1 -- 172.21.15.57:0/2380670540 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c1073e0 con 0x7f715c105350 2023-03-02T10:48:16.818 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.074+0000 7f7143fff700 1 -- 172.21.15.57:0/2380670540 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f714c019550 con 0x7f715c105350 2023-03-02T10:48:16.818 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.074+0000 7f716157c700 1 -- 172.21.15.57:0/2380670540 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c107250 con 0x7f715c105350 2023-03-02T10:48:16.819 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.075+0000 7f7143fff700 1 -- 172.21.15.57:0/2380670540 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 43498+0+0 (secure 0 0 0) 0x7f714c02a020 con 0x7f715c105350 2023-03-02T10:48:16.819 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.075+0000 7f716157c700 1 -- 172.21.15.57:0/2380670540 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c061bc0 con 0x7f715c105350 2023-03-02T10:48:16.819 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.076+0000 7f7143fff700 1 --2- 172.21.15.57:0/2380670540 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f7144036750 0x7f7144038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:16.819 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.076+0000 7f7143fff700 1 -- 172.21.15.57:0/2380670540 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f714c0499b0 con 0x7f715c105350 2023-03-02T10:48:16.819 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.076+0000 7f715a7fc700 1 --2- 172.21.15.57:0/2380670540 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f7144036750 0x7f7144038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:16.819 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.076+0000 7f715a7fc700 1 --2- 172.21.15.57:0/2380670540 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f7144036750 0x7f7144038c00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7150006fd0 tx=0x7f7150006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:16.820 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.080+0000 7f7143fff700 1 -- 172.21.15.57:0/2380670540 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f714c00bbd0 con 0x7f715c105350 2023-03-02T10:48:16.820 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.278+0000 7f716157c700 1 -- 172.21.15.57:0/2380670540 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f715c07aa10 con 0x7f715c105350 2023-03-02T10:48:16.820 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.279+0000 7f7143fff700 1 -- 172.21.15.57:0/2380670540 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f714c00bbd0 con 0x7f715c105350 2023-03-02T10:48:16.820 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.281+0000 7f716157c700 1 -- 172.21.15.57:0/2380670540 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f7144036750 msgr2=0x7f7144038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:16.820 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.281+0000 7f716157c700 1 --2- 172.21.15.57:0/2380670540 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f7144036750 0x7f7144038c00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7150006fd0 tx=0x7f7150006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:16.821 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.281+0000 7f716157c700 1 -- 172.21.15.57:0/2380670540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 msgr2=0x7f715c07bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:16.821 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.281+0000 7f716157c700 1 --2- 172.21.15.57:0/2380670540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c07bc10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f714c006af0 tx=0x7f714c011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:16.821 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.281+0000 7f716157c700 1 -- 172.21.15.57:0/2380670540 shutdown_connections 2023-03-02T10:48:16.821 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.281+0000 7f716157c700 1 --2- 172.21.15.57:0/2380670540 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f7144036750 0x7f7144038c00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:16.821 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.281+0000 7f716157c700 1 --2- 172.21.15.57:0/2380670540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f715c105350 0x7f715c07bc10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:16.821 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.281+0000 7f716157c700 1 -- 172.21.15.57:0/2380670540 >> 172.21.15.57:0/2380670540 conn(0x7f715c1009b0 msgr2=0x7f715c101710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:16.822 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.281+0000 7f716157c700 1 -- 172.21.15.57:0/2380670540 shutdown_connections 2023-03-02T10:48:16.822 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:16.281+0000 7f716157c700 1 -- 172.21.15.57:0/2380670540 wait complete. 2023-03-02T10:48:16.822 INFO:teuthology.orchestra.run.smithi057.stdout:Enabling cephadm module... 2023-03-02T10:48:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:16 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2380670540' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-03-02T10:48:17.903 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:17 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3605559412' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-03-02T10:48:17.903 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:17 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: ignoring --setuser ceph since I am not root 2023-03-02T10:48:17.904 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:17 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: ignoring --setgroup ceph since I am not root 2023-03-02T10:48:17.904 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:17 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:17.811+0000 7f2d857bc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-02T10:48:18.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.289+0000 7f11c6df7700 1 Processor -- start 2023-03-02T10:48:18.076 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.289+0000 7f11c6df7700 1 -- start start 2023-03-02T10:48:18.076 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.289+0000 7f11c6df7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0108260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:18.076 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.289+0000 7f11c6df7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0079d00 con 0x7f11c0105e80 2023-03-02T10:48:18.076 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.290+0000 7f11c4b93700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0108260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:18.076 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.290+0000 7f11c4b93700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0108260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42862/0 (socket says 172.21.15.57:42862) 2023-03-02T10:48:18.077 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.290+0000 7f11c4b93700 1 -- 172.21.15.57:0/3990821301 learned_addr learned my addr 172.21.15.57:0/3990821301 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:18.077 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.290+0000 7f11c4b93700 1 -- 172.21.15.57:0/3990821301 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0079e40 con 0x7f11c0105e80 2023-03-02T10:48:18.077 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.290+0000 7f11c4b93700 1 --2- 172.21.15.57:0/3990821301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0108260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11b40098a0 tx=0x7f11b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe770e0e7a9f52d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:18.077 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.291+0000 7f11bf7fe700 1 -- 172.21.15.57:0/3990821301 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11b4004160 con 0x7f11c0105e80 2023-03-02T10:48:18.077 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.291+0000 7f11bf7fe700 1 -- 172.21.15.57:0/3990821301 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f11b40042c0 con 0x7f11c0105e80 2023-03-02T10:48:18.078 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.291+0000 7f11bf7fe700 1 -- 172.21.15.57:0/3990821301 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11b4011a00 con 0x7f11c0105e80 2023-03-02T10:48:18.078 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.291+0000 7f11c6df7700 1 -- 172.21.15.57:0/3990821301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 msgr2=0x7f11c0108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:18.078 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.291+0000 7f11c6df7700 1 --2- 172.21.15.57:0/3990821301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0108260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11b40098a0 tx=0x7f11b4009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:18.079 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.291+0000 7f11c6df7700 1 -- 172.21.15.57:0/3990821301 shutdown_connections 2023-03-02T10:48:18.079 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.291+0000 7f11c6df7700 1 --2- 172.21.15.57:0/3990821301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0108260 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:18.079 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.291+0000 7f11c6df7700 1 -- 172.21.15.57:0/3990821301 >> 172.21.15.57:0/3990821301 conn(0x7f11c00ff880 msgr2=0x7f11c0101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:18.079 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.291+0000 7f11c6df7700 1 -- 172.21.15.57:0/3990821301 shutdown_connections 2023-03-02T10:48:18.079 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.291+0000 7f11c6df7700 1 -- 172.21.15.57:0/3990821301 wait complete. 2023-03-02T10:48:18.079 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.292+0000 7f11c6df7700 1 Processor -- start 2023-03-02T10:48:18.079 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.292+0000 7f11c6df7700 1 -- start start 2023-03-02T10:48:18.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.293+0000 7f11c6df7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:18.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.293+0000 7f11c6df7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c01994f0 con 0x7f11c0105e80 2023-03-02T10:48:18.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.293+0000 7f11c4b93700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:18.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.293+0000 7f11c4b93700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42868/0 (socket says 172.21.15.57:42868) 2023-03-02T10:48:18.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.293+0000 7f11c4b93700 1 -- 172.21.15.57:0/3605559412 learned_addr learned my addr 172.21.15.57:0/3605559412 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:18.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.293+0000 7f11c4b93700 1 -- 172.21.15.57:0/3605559412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4009550 con 0x7f11c0105e80 2023-03-02T10:48:18.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.293+0000 7f11c4b93700 1 --2- 172.21.15.57:0/3605559412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0198fb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009fb0 tx=0x7f11b4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:18.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.294+0000 7f11bdffb700 1 -- 172.21.15.57:0/3605559412 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11b4003930 con 0x7f11c0105e80 2023-03-02T10:48:18.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.294+0000 7f11bdffb700 1 -- 172.21.15.57:0/3605559412 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f11b4003a90 con 0x7f11c0105e80 2023-03-02T10:48:18.081 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.294+0000 7f11c6df7700 1 -- 172.21.15.57:0/3605559412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c01095a0 con 0x7f11c0105e80 2023-03-02T10:48:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.294+0000 7f11bdffb700 1 -- 172.21.15.57:0/3605559412 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11b40195e0 con 0x7f11c0105e80 2023-03-02T10:48:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.294+0000 7f11c6df7700 1 -- 172.21.15.57:0/3605559412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c0109410 con 0x7f11c0105e80 2023-03-02T10:48:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.295+0000 7f11c6df7700 1 -- 172.21.15.57:0/3605559412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c0061bc0 con 0x7f11c0105e80 2023-03-02T10:48:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.295+0000 7f11bdffb700 1 -- 172.21.15.57:0/3605559412 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 43498+0+0 (secure 0 0 0) 0x7f11b402a020 con 0x7f11c0105e80 2023-03-02T10:48:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.296+0000 7f11bdffb700 1 --2- 172.21.15.57:0/3605559412 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f11b00367d0 0x7f11b0038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.296+0000 7f11bdffb700 1 -- 172.21.15.57:0/3605559412 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f11b4049be0 con 0x7f11c0105e80 2023-03-02T10:48:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.296+0000 7f11bffff700 1 --2- 172.21.15.57:0/3605559412 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f11b00367d0 0x7f11b0038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:18.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.296+0000 7f11bffff700 1 --2- 172.21.15.57:0/3605559412 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f11b00367d0 0x7f11b0038c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11ac006fd0 tx=0x7f11ac006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:18.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.300+0000 7f11bdffb700 1 -- 172.21.15.57:0/3605559412 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f11b4003c00 con 0x7f11c0105e80 2023-03-02T10:48:18.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.555+0000 7f11c6df7700 1 -- 172.21.15.57:0/3605559412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f11c0199a40 con 0x7f11c0105e80 2023-03-02T10:48:18.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.594+0000 7f11bdffb700 1 -- 172.21.15.57:0/3605559412 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 5) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f11b4017020 con 0x7f11c0105e80 2023-03-02T10:48:18.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.595+0000 7f11bdffb700 1 -- 172.21.15.57:0/3605559412 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f11b4049290 con 0x7f11c0105e80 2023-03-02T10:48:18.083 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.598+0000 7f11c6df7700 1 -- 172.21.15.57:0/3605559412 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f11b00367d0 msgr2=0x7f11b0038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:18.084 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.598+0000 7f11c6df7700 1 --2- 172.21.15.57:0/3605559412 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f11b00367d0 0x7f11b0038c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11ac006fd0 tx=0x7f11ac006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:18.084 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.598+0000 7f11c6df7700 1 -- 172.21.15.57:0/3605559412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 msgr2=0x7f11c0198fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:18.084 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.598+0000 7f11c6df7700 1 --2- 172.21.15.57:0/3605559412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0198fb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009fb0 tx=0x7f11b4011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:18.084 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.598+0000 7f11c6df7700 1 -- 172.21.15.57:0/3605559412 shutdown_connections 2023-03-02T10:48:18.084 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.598+0000 7f11c6df7700 1 --2- 172.21.15.57:0/3605559412 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f11b00367d0 0x7f11b0038c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:18.084 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.598+0000 7f11c6df7700 1 --2- 172.21.15.57:0/3605559412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11c0105e80 0x7f11c0198fb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:18.084 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.598+0000 7f11c6df7700 1 -- 172.21.15.57:0/3605559412 >> 172.21.15.57:0/3605559412 conn(0x7f11c00ff880 msgr2=0x7f11c0100630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:18.085 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.598+0000 7f11c6df7700 1 -- 172.21.15.57:0/3605559412 shutdown_connections 2023-03-02T10:48:18.085 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:17.598+0000 7f11c6df7700 1 -- 172.21.15.57:0/3605559412 wait complete. 2023-03-02T10:48:18.183 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:17 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:17.901+0000 7f2d857bc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-02T10:48:18.183 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:18 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:18.002+0000 7f2d857bc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-02T10:48:18.183 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:18 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:18.114+0000 7f2d857bc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-02T10:48:18.600 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:18 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:18.315+0000 7f2d857bc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-02T10:48:18.920 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:18 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3605559412' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-03-02T10:48:18.921 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:18 smithi057 ceph-mon[92072]: mgrmap e5: x(active, since 5s) 2023-03-02T10:48:18.921 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:18 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:18.682+0000 7f2d857bc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-02T10:48:18.921 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:18 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:18.785+0000 7f2d857bc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-02T10:48:19.183 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:18 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:18.947+0000 7f2d857bc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-02T10:48:19.183 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:19 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:19.060+0000 7f2d857bc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-02T10:48:19.237 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2023-03-02T10:48:19.238 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-03-02T10:48:19.238 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": true, 2023-03-02T10:48:19.238 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-03-02T10:48:19.238 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-03-02T10:48:19.238 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2023-03-02T10:48:19.238 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.522+0000 7f34512cb700 1 Processor -- start 2023-03-02T10:48:19.238 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.522+0000 7f34512cb700 1 -- start start 2023-03-02T10:48:19.239 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.522+0000 7f34512cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:19.239 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.522+0000 7f34512cb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c108410 con 0x7f344c079cc0 2023-03-02T10:48:19.239 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.523+0000 7f344affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:19.239 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.523+0000 7f344affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c107ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42912/0 (socket says 172.21.15.57:42912) 2023-03-02T10:48:19.239 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.523+0000 7f344affd700 1 -- 172.21.15.57:0/1382004513 learned_addr learned my addr 172.21.15.57:0/1382004513 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:19.239 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.523+0000 7f344affd700 1 -- 172.21.15.57:0/1382004513 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c108550 con 0x7f344c079cc0 2023-03-02T10:48:19.239 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.523+0000 7f344affd700 1 --2- 172.21.15.57:0/1382004513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c107ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f343c0098a0 tx=0x7f343c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40856809eace3806 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:19.239 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.523+0000 7f3449ffb700 1 -- 172.21.15.57:0/1382004513 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f343c004160 con 0x7f344c079cc0 2023-03-02T10:48:19.240 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.523+0000 7f3449ffb700 1 -- 172.21.15.57:0/1382004513 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f343c0042c0 con 0x7f344c079cc0 2023-03-02T10:48:19.240 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.523+0000 7f3449ffb700 1 -- 172.21.15.57:0/1382004513 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f343c011a00 con 0x7f344c079cc0 2023-03-02T10:48:19.240 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.524+0000 7f34512cb700 1 -- 172.21.15.57:0/1382004513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 msgr2=0x7f344c107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:19.240 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.524+0000 7f34512cb700 1 --2- 172.21.15.57:0/1382004513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c107ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f343c0098a0 tx=0x7f343c009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:19.240 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.524+0000 7f34512cb700 1 -- 172.21.15.57:0/1382004513 shutdown_connections 2023-03-02T10:48:19.240 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.524+0000 7f34512cb700 1 --2- 172.21.15.57:0/1382004513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c107ed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:19.240 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.524+0000 7f34512cb700 1 -- 172.21.15.57:0/1382004513 >> 172.21.15.57:0/1382004513 conn(0x7f344c0ff8a0 msgr2=0x7f344c101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:19.241 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.524+0000 7f34512cb700 1 -- 172.21.15.57:0/1382004513 shutdown_connections 2023-03-02T10:48:19.241 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.524+0000 7f34512cb700 1 -- 172.21.15.57:0/1382004513 wait complete. 2023-03-02T10:48:19.241 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.525+0000 7f34512cb700 1 Processor -- start 2023-03-02T10:48:19.241 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.525+0000 7f34512cb700 1 -- start start 2023-03-02T10:48:19.241 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.525+0000 7f34512cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:19.241 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.525+0000 7f34512cb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c1994c0 con 0x7f344c079cc0 2023-03-02T10:48:19.241 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.525+0000 7f344affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:19.242 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.525+0000 7f344affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42914/0 (socket says 172.21.15.57:42914) 2023-03-02T10:48:19.242 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.525+0000 7f344affd700 1 -- 172.21.15.57:0/18675481 learned_addr learned my addr 172.21.15.57:0/18675481 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:19.242 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.526+0000 7f344affd700 1 -- 172.21.15.57:0/18675481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c009550 con 0x7f344c079cc0 2023-03-02T10:48:19.242 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.526+0000 7f344affd700 1 --2- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c198f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f343c006af0 tx=0x7f343c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:19.242 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.526+0000 7f3433fff700 1 -- 172.21.15.57:0/18675481 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f343c003a40 con 0x7f344c079cc0 2023-03-02T10:48:19.242 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.526+0000 7f3433fff700 1 -- 172.21.15.57:0/18675481 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f343c003ba0 con 0x7f344c079cc0 2023-03-02T10:48:19.242 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.526+0000 7f34512cb700 1 -- 172.21.15.57:0/18675481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344c1095a0 con 0x7f344c079cc0 2023-03-02T10:48:19.242 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.526+0000 7f3433fff700 1 -- 172.21.15.57:0/18675481 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f343c01a700 con 0x7f344c079cc0 2023-03-02T10:48:19.243 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.526+0000 7f34512cb700 1 -- 172.21.15.57:0/18675481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344c109410 con 0x7f344c079cc0 2023-03-02T10:48:19.243 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.527+0000 7f3433fff700 1 -- 172.21.15.57:0/18675481 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f343c017020 con 0x7f344c079cc0 2023-03-02T10:48:19.243 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.527+0000 7f3433fff700 1 --2- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f3434036870 0x7f3434038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:19.243 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.527+0000 7f3433fff700 1 -- 172.21.15.57:0/18675481 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f343c049b60 con 0x7f344c079cc0 2023-03-02T10:48:19.243 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.527+0000 7f34512cb700 1 -- 172.21.15.57:0/18675481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344c061bc0 con 0x7f344c079cc0 2023-03-02T10:48:19.243 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.527+0000 7f344a7fc700 1 -- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f3434036870 msgr2=0x7f3434038d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3078589149 2023-03-02T10:48:19.243 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.527+0000 7f344a7fc700 1 --2- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f3434036870 0x7f3434038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-02T10:48:19.244 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.532+0000 7f3433fff700 1 -- 172.21.15.57:0/18675481 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f343c02d3f0 con 0x7f344c079cc0 2023-03-02T10:48:19.244 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.729+0000 7f344a7fc700 1 -- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f3434036870 msgr2=0x7f3434038d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3078589149 2023-03-02T10:48:19.244 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.729+0000 7f344a7fc700 1 --2- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f3434036870 0x7f3434038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-02T10:48:19.244 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.786+0000 7f34512cb700 1 -- 172.21.15.57:0/18675481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f344c19c930 con 0x7f344c079cc0 2023-03-02T10:48:19.244 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.787+0000 7f3433fff700 1 -- 172.21.15.57:0/18675481 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f343c047030 con 0x7f344c079cc0 2023-03-02T10:48:19.244 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.789+0000 7f34512cb700 1 -- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f3434036870 msgr2=0x7f3434038d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-02T10:48:19.244 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.789+0000 7f34512cb700 1 --2- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f3434036870 0x7f3434038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:19.244 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.789+0000 7f34512cb700 1 -- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 msgr2=0x7f344c198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:19.245 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.789+0000 7f34512cb700 1 --2- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c198f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f343c006af0 tx=0x7f343c011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:19.245 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.789+0000 7f34512cb700 1 -- 172.21.15.57:0/18675481 shutdown_connections 2023-03-02T10:48:19.245 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.789+0000 7f34512cb700 1 --2- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7f3434036870 0x7f3434038d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:19.245 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.789+0000 7f34512cb700 1 --2- 172.21.15.57:0/18675481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f344c079cc0 0x7f344c198f80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:19.245 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.789+0000 7f34512cb700 1 -- 172.21.15.57:0/18675481 >> 172.21.15.57:0/18675481 conn(0x7f344c0ff8a0 msgr2=0x7f344c1005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:19.245 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.789+0000 7f34512cb700 1 -- 172.21.15.57:0/18675481 shutdown_connections 2023-03-02T10:48:19.245 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:18.789+0000 7f34512cb700 1 -- 172.21.15.57:0/18675481 wait complete. 2023-03-02T10:48:19.246 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for the mgr to restart... 2023-03-02T10:48:19.246 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mgr epoch 5... 2023-03-02T10:48:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:19 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/18675481' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-03-02T10:48:19.933 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:19 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:19.575+0000 7f2d857bc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-02T10:48:20.682 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:20 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:20.247+0000 7f2d857bc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-02T10:48:20.683 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:20 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:20.434+0000 7f2d857bc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-02T10:48:21.611 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:21 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:21.298+0000 7f2d857bc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:48:21.611 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:21 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:21.408+0000 7f2d857bc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-02T10:48:21.932 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:21 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:21.609+0000 7f2d857bc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:48:21.933 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:21 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:21.832+0000 7f2d857bc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-02T10:48:22.432 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:22 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:22.005+0000 7f2d857bc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-02T10:48:22.932 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:22 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:22.459+0000 7f2d857bc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-02T10:48:23.432 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:23 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:23.109+0000 7f2d857bc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-02T10:48:23.819 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:23 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:23.459+0000 7f2d857bc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-02T10:48:23.819 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:23 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:23.683+0000 7f2d857bc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-02T10:48:23.819 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:23 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:23.817+0000 7f2d857bc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-02T10:48:24.432 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:24 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:24.069+0000 7f2d857bc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-02T10:48:25.432 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:25 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:25.052+0000 7f2d857bc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-02T10:48:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:25 smithi057 ceph-mon[92072]: Active manager daemon x restarted 2023-03-02T10:48:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:25 smithi057 ceph-mon[92072]: Activating manager daemon x 2023-03-02T10:48:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:25 smithi057 ceph-mon[92072]: osdmap e2: 0 total, 0 up, 0 in 2023-03-02T10:48:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: mgrmap e6: x(active, starting, since 0.0529939s) 2023-03-02T10:48:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:48:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-02T10:48:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-02T10:48:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-02T10:48:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-02T10:48:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: Manager daemon x is now available 2023-03-02T10:48:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: Found migration_current of "None". Setting to last migration. 2023-03-02T10:48:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:48:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:48:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:48:26.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-02T10:48:26.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:26 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-02T10:48:26.516 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2023-03-02T10:48:26.516 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-03-02T10:48:26.517 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "initialized": true 2023-03-02T10:48:26.517 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2023-03-02T10:48:26.517 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.742+0000 7fdf801a8700 1 Processor -- start 2023-03-02T10:48:26.517 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.743+0000 7fdf801a8700 1 -- start start 2023-03-02T10:48:26.517 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.743+0000 7fdf801a8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78105760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:26.517 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.743+0000 7fdf801a8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf78105ca0 con 0x7fdf78105350 2023-03-02T10:48:26.517 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.743+0000 7fdf7df44700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78105760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:26.518 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.743+0000 7fdf7df44700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78105760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42926/0 (socket says 172.21.15.57:42926) 2023-03-02T10:48:26.518 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.743+0000 7fdf7df44700 1 -- 172.21.15.57:0/4083170974 learned_addr learned my addr 172.21.15.57:0/4083170974 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:26.518 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.743+0000 7fdf7df44700 1 -- 172.21.15.57:0/4083170974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78105de0 con 0x7fdf78105350 2023-03-02T10:48:26.518 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.744+0000 7fdf7df44700 1 --2- 172.21.15.57:0/4083170974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78105760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf740098a0 tx=0x7fdf74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd2776b07f2a525 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:26.518 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.744+0000 7fdf7cf42700 1 -- 172.21.15.57:0/4083170974 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf74004160 con 0x7fdf78105350 2023-03-02T10:48:26.518 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.744+0000 7fdf7cf42700 1 -- 172.21.15.57:0/4083170974 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf740042c0 con 0x7fdf78105350 2023-03-02T10:48:26.518 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.744+0000 7fdf7cf42700 1 -- 172.21.15.57:0/4083170974 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf74011a00 con 0x7fdf78105350 2023-03-02T10:48:26.519 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.745+0000 7fdf801a8700 1 -- 172.21.15.57:0/4083170974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 msgr2=0x7fdf78105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:26.519 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.745+0000 7fdf801a8700 1 --2- 172.21.15.57:0/4083170974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78105760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf740098a0 tx=0x7fdf74009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:26.519 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.745+0000 7fdf801a8700 1 -- 172.21.15.57:0/4083170974 shutdown_connections 2023-03-02T10:48:26.519 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.745+0000 7fdf801a8700 1 --2- 172.21.15.57:0/4083170974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78105760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:26.519 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.745+0000 7fdf801a8700 1 -- 172.21.15.57:0/4083170974 >> 172.21.15.57:0/4083170974 conn(0x7fdf781009b0 msgr2=0x7fdf78102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:26.519 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.745+0000 7fdf801a8700 1 -- 172.21.15.57:0/4083170974 shutdown_connections 2023-03-02T10:48:26.519 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.745+0000 7fdf801a8700 1 -- 172.21.15.57:0/4083170974 wait complete. 2023-03-02T10:48:26.519 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.746+0000 7fdf801a8700 1 Processor -- start 2023-03-02T10:48:26.520 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.746+0000 7fdf801a8700 1 -- start start 2023-03-02T10:48:26.520 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.746+0000 7fdf801a8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:26.520 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.746+0000 7fdf801a8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf78199570 con 0x7fdf78105350 2023-03-02T10:48:26.520 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.746+0000 7fdf7df44700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:26.520 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.746+0000 7fdf7df44700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42942/0 (socket says 172.21.15.57:42942) 2023-03-02T10:48:26.520 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.746+0000 7fdf7df44700 1 -- 172.21.15.57:0/2308585931 learned_addr learned my addr 172.21.15.57:0/2308585931 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:26.520 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.746+0000 7fdf7df44700 1 -- 172.21.15.57:0/2308585931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf74009550 con 0x7fdf78105350 2023-03-02T10:48:26.521 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.747+0000 7fdf7df44700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78199030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdf74006af0 tx=0x7fdf74011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:26.521 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.747+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf740038b0 con 0x7fdf78105350 2023-03-02T10:48:26.521 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.747+0000 7fdf801a8700 1 -- 172.21.15.57:0/2308585931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf781073e0 con 0x7fdf78105350 2023-03-02T10:48:26.521 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.747+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf74003a10 con 0x7fdf78105350 2023-03-02T10:48:26.521 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.747+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf74019550 con 0x7fdf78105350 2023-03-02T10:48:26.521 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.747+0000 7fdf801a8700 1 -- 172.21.15.57:0/2308585931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf78107250 con 0x7fdf78105350 2023-03-02T10:48:26.521 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.748+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 43509+0+0 (secure 0 0 0) 0x7fdf7402a020 con 0x7fdf78105350 2023-03-02T10:48:26.521 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.748+0000 7fdf6effd700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 0x7fdf64038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:26.522 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.748+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 --> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf64039360 con 0x7fdf640367a0 2023-03-02T10:48:26.522 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.748+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdf74049900 con 0x7fdf78105350 2023-03-02T10:48:26.522 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.748+0000 7fdf7d743700 1 -- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 msgr2=0x7fdf64038c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3078589149 2023-03-02T10:48:26.522 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.748+0000 7fdf7d743700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 0x7fdf64038c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-02T10:48:26.522 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.949+0000 7fdf7d743700 1 -- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 msgr2=0x7fdf64038c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3078589149 2023-03-02T10:48:26.522 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:19.949+0000 7fdf7d743700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 0x7fdf64038c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-02T10:48:26.522 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:20.350+0000 7fdf7d743700 1 -- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 msgr2=0x7fdf64038c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3078589149 2023-03-02T10:48:26.523 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:20.350+0000 7fdf7d743700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 0x7fdf64038c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-02T10:48:26.523 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:21.151+0000 7fdf7d743700 1 -- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 msgr2=0x7fdf64038c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3078589149 2023-03-02T10:48:26.523 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:21.151+0000 7fdf7d743700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 0x7fdf64038c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-03-02T10:48:26.523 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:22.752+0000 7fdf7d743700 1 -- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 msgr2=0x7fdf64038c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3078589149 2023-03-02T10:48:26.523 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:22.752+0000 7fdf7d743700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 0x7fdf64038c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-03-02T10:48:26.523 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:25.105+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mgrmap(e 6) v1 ==== 43319+0+0 (secure 0 0 0) 0x7fdf74017020 con 0x7fdf78105350 2023-03-02T10:48:26.523 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:25.106+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 msgr2=0x7fdf64038c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-02T10:48:26.523 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:25.106+0000 7fdf6effd700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 0x7fdf64038c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:26.524 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.118+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 7) v1 ==== 43429+0+0 (secure 0 0 0) 0x7fdf7400f050 con 0x7fdf78105350 2023-03-02T10:48:26.524 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.118+0000 7fdf6effd700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fdf64039fe0 0x7fdf6403c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:26.524 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.118+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 --> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf64039360 con 0x7fdf64039fe0 2023-03-02T10:48:26.524 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.119+0000 7fdf7d743700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fdf64039fe0 0x7fdf6403c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:26.524 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.119+0000 7fdf7d743700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fdf64039fe0 0x7fdf6403c3c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdf68003a10 tx=0x7fdf68009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:26.524 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.120+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 <== mgr.14120 v2:172.21.15.57:6800/3127649723 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fdf64039360 con 0x7fdf64039fe0 2023-03-02T10:48:26.524 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.131+0000 7fdf801a8700 1 -- 172.21.15.57:0/2308585931 --> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fdf781996b0 con 0x7fdf64039fe0 2023-03-02T10:48:26.524 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.131+0000 7fdf6effd700 1 -- 172.21.15.57:0/2308585931 <== mgr.14120 v2:172.21.15.57:6800/3127649723 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fdf68018aa0 con 0x7fdf64039fe0 2023-03-02T10:48:26.525 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.131+0000 7fdf801a8700 1 -- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fdf64039fe0 msgr2=0x7fdf6403c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:26.525 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.131+0000 7fdf801a8700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fdf64039fe0 0x7fdf6403c3c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdf68003a10 tx=0x7fdf68009290 comp rx=0 tx=0).stop 2023-03-02T10:48:26.525 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.131+0000 7fdf801a8700 1 -- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 msgr2=0x7fdf78199030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:26.526 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.131+0000 7fdf801a8700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78199030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdf74006af0 tx=0x7fdf74011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:26.526 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.131+0000 7fdf801a8700 1 -- 172.21.15.57:0/2308585931 shutdown_connections 2023-03-02T10:48:26.526 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.131+0000 7fdf801a8700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fdf64039fe0 0x7fdf6403c3c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:26.526 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.131+0000 7fdf801a8700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf78105350 0x7fdf78199030 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:26.527 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.131+0000 7fdf801a8700 1 --2- 172.21.15.57:0/2308585931 >> [v2:172.21.15.57:6800/3078589149,v1:172.21.15.57:6801/3078589149] conn(0x7fdf640367a0 0x7fdf64038c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:26.527 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.131+0000 7fdf801a8700 1 -- 172.21.15.57:0/2308585931 >> 172.21.15.57:0/2308585931 conn(0x7fdf781009b0 msgr2=0x7fdf78101710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:26.527 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.132+0000 7fdf801a8700 1 -- 172.21.15.57:0/2308585931 shutdown_connections 2023-03-02T10:48:26.527 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.132+0000 7fdf801a8700 1 -- 172.21.15.57:0/2308585931 wait complete. 2023-03-02T10:48:26.527 INFO:teuthology.orchestra.run.smithi057.stdout:mgr epoch 5 is available 2023-03-02T10:48:26.527 INFO:teuthology.orchestra.run.smithi057.stdout:Setting orchestrator backend to cephadm... 2023-03-02T10:48:27.379 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:27 smithi057 ceph-mon[92072]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-03-02T10:48:27.379 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:27 smithi057 ceph-mon[92072]: mgrmap e7: x(active, since 1.06676s) 2023-03-02T10:48:27.380 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:27 smithi057 ceph-mon[92072]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-03-02T10:48:27.380 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:27 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:27.380 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:27 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:27.677 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.972+0000 7f3686461700 1 Processor -- start 2023-03-02T10:48:27.678 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.972+0000 7f3686461700 1 -- start start 2023-03-02T10:48:27.678 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.972+0000 7f3686461700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f3680108220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:27.678 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.972+0000 7f3686461700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680079d40 con 0x7f3680105e40 2023-03-02T10:48:27.678 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.973+0000 7f367ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f3680108220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:27.678 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.973+0000 7f367ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f3680108220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49372/0 (socket says 172.21.15.57:49372) 2023-03-02T10:48:27.678 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.973+0000 7f367ffff700 1 -- 172.21.15.57:0/4149266923 learned_addr learned my addr 172.21.15.57:0/4149266923 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:27.679 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.973+0000 7f367ffff700 1 -- 172.21.15.57:0/4149266923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680079e80 con 0x7f3680105e40 2023-03-02T10:48:27.679 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.973+0000 7f367ffff700 1 --2- 172.21.15.57:0/4149266923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f3680108220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f36700098a0 tx=0x7f3670009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347def7b9df5f0f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:27.679 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.974+0000 7f367effd700 1 -- 172.21.15.57:0/4149266923 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3670004160 con 0x7f3680105e40 2023-03-02T10:48:27.679 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.974+0000 7f367effd700 1 -- 172.21.15.57:0/4149266923 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36700042c0 con 0x7f3680105e40 2023-03-02T10:48:27.679 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.974+0000 7f367effd700 1 -- 172.21.15.57:0/4149266923 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3670011a00 con 0x7f3680105e40 2023-03-02T10:48:27.679 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.974+0000 7f3686461700 1 -- 172.21.15.57:0/4149266923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 msgr2=0x7f3680108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:27.679 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.974+0000 7f3686461700 1 --2- 172.21.15.57:0/4149266923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f3680108220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f36700098a0 tx=0x7f3670009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:27.680 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.974+0000 7f3686461700 1 -- 172.21.15.57:0/4149266923 shutdown_connections 2023-03-02T10:48:27.680 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.974+0000 7f3686461700 1 --2- 172.21.15.57:0/4149266923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f3680108220 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:27.680 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.974+0000 7f3686461700 1 -- 172.21.15.57:0/4149266923 >> 172.21.15.57:0/4149266923 conn(0x7f36800ff8a0 msgr2=0x7f3680101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:27.680 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.974+0000 7f3686461700 1 -- 172.21.15.57:0/4149266923 shutdown_connections 2023-03-02T10:48:27.680 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.974+0000 7f3686461700 1 -- 172.21.15.57:0/4149266923 wait complete. 2023-03-02T10:48:27.680 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.975+0000 7f3686461700 1 Processor -- start 2023-03-02T10:48:27.680 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.975+0000 7f3686461700 1 -- start start 2023-03-02T10:48:27.681 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.976+0000 7f3686461700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f36801057b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:27.681 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.976+0000 7f3686461700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680105cf0 con 0x7f3680105e40 2023-03-02T10:48:27.681 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.976+0000 7f367ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f36801057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:27.681 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.976+0000 7f367ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f36801057b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49378/0 (socket says 172.21.15.57:49378) 2023-03-02T10:48:27.681 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.976+0000 7f367ffff700 1 -- 172.21.15.57:0/2130222728 learned_addr learned my addr 172.21.15.57:0/2130222728 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:27.681 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.976+0000 7f367ffff700 1 -- 172.21.15.57:0/2130222728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009550 con 0x7f3680105e40 2023-03-02T10:48:27.681 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.976+0000 7f367ffff700 1 --2- 172.21.15.57:0/2130222728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f36801057b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3670006af0 tx=0x7f3670011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:27.681 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.977+0000 7f367d7fa700 1 -- 172.21.15.57:0/2130222728 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3670003a40 con 0x7f3680105e40 2023-03-02T10:48:27.682 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.977+0000 7f367d7fa700 1 -- 172.21.15.57:0/2130222728 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3670003ba0 con 0x7f3680105e40 2023-03-02T10:48:27.682 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.977+0000 7f3686461700 1 -- 172.21.15.57:0/2130222728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36801095c0 con 0x7f3680105e40 2023-03-02T10:48:27.682 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.977+0000 7f367d7fa700 1 -- 172.21.15.57:0/2130222728 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367001a700 con 0x7f3680105e40 2023-03-02T10:48:27.682 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.977+0000 7f3686461700 1 -- 172.21.15.57:0/2130222728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3680109430 con 0x7f3680105e40 2023-03-02T10:48:27.682 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.978+0000 7f367d7fa700 1 -- 172.21.15.57:0/2130222728 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 43429+0+0 (secure 0 0 0) 0x7f3670017020 con 0x7f3680105e40 2023-03-02T10:48:27.682 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.978+0000 7f3686461700 1 -- 172.21.15.57:0/2130222728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3680061bc0 con 0x7f3680105e40 2023-03-02T10:48:27.682 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.978+0000 7f367d7fa700 1 --2- 172.21.15.57:0/2130222728 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f36680367e0 0x7f3668038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:27.682 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.978+0000 7f367d7fa700 1 -- 172.21.15.57:0/2130222728 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3670049b20 con 0x7f3680105e40 2023-03-02T10:48:27.683 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.978+0000 7f367f7fe700 1 --2- 172.21.15.57:0/2130222728 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f36680367e0 0x7f3668038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:27.683 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.979+0000 7f367f7fe700 1 --2- 172.21.15.57:0/2130222728 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f36680367e0 0x7f3668038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3674006fd0 tx=0x7f3674006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:27.683 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:26.983+0000 7f367d7fa700 1 -- 172.21.15.57:0/2130222728 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f3670018350 con 0x7f3680105e40 2023-03-02T10:48:27.683 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.200+0000 7f3686461700 1 -- 172.21.15.57:0/2130222728 --> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f3680100d30 con 0x7f36680367e0 2023-03-02T10:48:27.683 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.206+0000 7f367d7fa700 1 -- 172.21.15.57:0/2130222728 <== mgr.14120 v2:172.21.15.57:6800/3127649723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3680100d30 con 0x7f36680367e0 2023-03-02T10:48:27.683 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.208+0000 7f3686461700 1 -- 172.21.15.57:0/2130222728 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f36680367e0 msgr2=0x7f3668038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:27.683 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.208+0000 7f3686461700 1 --2- 172.21.15.57:0/2130222728 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f36680367e0 0x7f3668038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3674006fd0 tx=0x7f3674006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:27.684 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.208+0000 7f3686461700 1 -- 172.21.15.57:0/2130222728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 msgr2=0x7f36801057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:27.684 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.208+0000 7f3686461700 1 --2- 172.21.15.57:0/2130222728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f36801057b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3670006af0 tx=0x7f3670011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:27.684 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.208+0000 7f3686461700 1 -- 172.21.15.57:0/2130222728 shutdown_connections 2023-03-02T10:48:27.684 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.208+0000 7f3686461700 1 --2- 172.21.15.57:0/2130222728 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f36680367e0 0x7f3668038c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:27.684 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.208+0000 7f3686461700 1 --2- 172.21.15.57:0/2130222728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3680105e40 0x7f36801057b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:27.684 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.208+0000 7f3686461700 1 -- 172.21.15.57:0/2130222728 >> 172.21.15.57:0/2130222728 conn(0x7f36800ff8a0 msgr2=0x7f3680100620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:27.684 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.208+0000 7f3686461700 1 -- 172.21.15.57:0/2130222728 shutdown_connections 2023-03-02T10:48:27.684 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:27.208+0000 7f3686461700 1 -- 172.21.15.57:0/2130222728 wait complete. 2023-03-02T10:48:28.493 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:28 smithi057 ceph-mon[92072]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:48:28.494 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:28 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:28.494 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:28 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:48:28.494 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:28 smithi057 ceph-mon[92072]: mgrmap e8: x(active, since 2s) 2023-03-02T10:48:28.494 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:28 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:28.494 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:28 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:28.737 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout value unchanged 2023-03-02T10:48:28.741 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.161+0000 7f15e10d8700 1 Processor -- start 2023-03-02T10:48:28.742 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.161+0000 7f15e10d8700 1 -- start start 2023-03-02T10:48:28.742 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.161+0000 7f15e10d8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc108220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:28.742 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.161+0000 7f15e10d8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc079d40 con 0x7f15dc105e40 2023-03-02T10:48:28.742 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.162+0000 7f15dad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc108220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:28.742 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.162+0000 7f15dad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc108220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49380/0 (socket says 172.21.15.57:49380) 2023-03-02T10:48:28.742 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.162+0000 7f15dad9d700 1 -- 172.21.15.57:0/1850225543 learned_addr learned my addr 172.21.15.57:0/1850225543 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:28.743 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.162+0000 7f15dad9d700 1 -- 172.21.15.57:0/1850225543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc079e80 con 0x7f15dc105e40 2023-03-02T10:48:28.743 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.162+0000 7f15dad9d700 1 --2- 172.21.15.57:0/1850225543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc108220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f15cc0098a0 tx=0x7f15cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151d2c56081f2a2b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:28.743 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.162+0000 7f15d9d9b700 1 -- 172.21.15.57:0/1850225543 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15cc004160 con 0x7f15dc105e40 2023-03-02T10:48:28.743 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.163+0000 7f15d9d9b700 1 -- 172.21.15.57:0/1850225543 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15cc0042c0 con 0x7f15dc105e40 2023-03-02T10:48:28.743 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.163+0000 7f15d9d9b700 1 -- 172.21.15.57:0/1850225543 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15cc011a00 con 0x7f15dc105e40 2023-03-02T10:48:28.743 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.163+0000 7f15e10d8700 1 -- 172.21.15.57:0/1850225543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 msgr2=0x7f15dc108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:28.743 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.163+0000 7f15e10d8700 1 --2- 172.21.15.57:0/1850225543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc108220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f15cc0098a0 tx=0x7f15cc009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:28.744 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.163+0000 7f15e10d8700 1 -- 172.21.15.57:0/1850225543 shutdown_connections 2023-03-02T10:48:28.744 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.163+0000 7f15e10d8700 1 --2- 172.21.15.57:0/1850225543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc108220 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:28.744 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.163+0000 7f15e10d8700 1 -- 172.21.15.57:0/1850225543 >> 172.21.15.57:0/1850225543 conn(0x7f15dc0ff8a0 msgr2=0x7f15dc101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:28.744 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.163+0000 7f15e10d8700 1 -- 172.21.15.57:0/1850225543 shutdown_connections 2023-03-02T10:48:28.744 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.163+0000 7f15e10d8700 1 -- 172.21.15.57:0/1850225543 wait complete. 2023-03-02T10:48:28.744 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.164+0000 7f15e10d8700 1 Processor -- start 2023-03-02T10:48:28.744 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.164+0000 7f15e10d8700 1 -- start start 2023-03-02T10:48:28.744 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.165+0000 7f15e10d8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:28.745 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.165+0000 7f15e10d8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc1994c0 con 0x7f15dc105e40 2023-03-02T10:48:28.745 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.165+0000 7f15dad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:28.745 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.165+0000 7f15dad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49388/0 (socket says 172.21.15.57:49388) 2023-03-02T10:48:28.746 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.165+0000 7f15dad9d700 1 -- 172.21.15.57:0/612417979 learned_addr learned my addr 172.21.15.57:0/612417979 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:28.746 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.165+0000 7f15dad9d700 1 -- 172.21.15.57:0/612417979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc009550 con 0x7f15dc105e40 2023-03-02T10:48:28.746 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.165+0000 7f15dad9d700 1 --2- 172.21.15.57:0/612417979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc198f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009fb0 tx=0x7f15cc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:28.746 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.165+0000 7f15c3fff700 1 -- 172.21.15.57:0/612417979 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15cc003930 con 0x7f15dc105e40 2023-03-02T10:48:28.746 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.166+0000 7f15c3fff700 1 -- 172.21.15.57:0/612417979 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15cc003a90 con 0x7f15dc105e40 2023-03-02T10:48:28.746 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.166+0000 7f15e10d8700 1 -- 172.21.15.57:0/612417979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15dc1095c0 con 0x7f15dc105e40 2023-03-02T10:48:28.746 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.166+0000 7f15c3fff700 1 -- 172.21.15.57:0/612417979 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15cc0195e0 con 0x7f15dc105e40 2023-03-02T10:48:28.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.166+0000 7f15e10d8700 1 -- 172.21.15.57:0/612417979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc109430 con 0x7f15dc105e40 2023-03-02T10:48:28.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.166+0000 7f15c3fff700 1 -- 172.21.15.57:0/612417979 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f15cc02a020 con 0x7f15dc105e40 2023-03-02T10:48:28.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.167+0000 7f15e10d8700 1 -- 172.21.15.57:0/612417979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15dc061bc0 con 0x7f15dc105e40 2023-03-02T10:48:28.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.167+0000 7f15c3fff700 1 --2- 172.21.15.57:0/612417979 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f15c4036820 0x7f15c4038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:28.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.167+0000 7f15c3fff700 1 -- 172.21.15.57:0/612417979 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f15cc049c80 con 0x7f15dc105e40 2023-03-02T10:48:28.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.167+0000 7f15da59c700 1 --2- 172.21.15.57:0/612417979 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f15c4036820 0x7f15c4038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:28.747 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.168+0000 7f15da59c700 1 --2- 172.21.15.57:0/612417979 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f15c4036820 0x7f15c4038cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f15d0006fd0 tx=0x7f15d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:28.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.172+0000 7f15c3fff700 1 -- 172.21.15.57:0/612417979 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f15cc04f020 con 0x7f15dc105e40 2023-03-02T10:48:28.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.371+0000 7f15e10d8700 1 -- 172.21.15.57:0/612417979 --> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f15dc199c60 con 0x7f15c4036820 2023-03-02T10:48:28.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.371+0000 7f15c3fff700 1 -- 172.21.15.57:0/612417979 <== mgr.14120 v2:172.21.15.57:6800/3127649723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f15dc199c60 con 0x7f15c4036820 2023-03-02T10:48:28.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.373+0000 7f15e10d8700 1 -- 172.21.15.57:0/612417979 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f15c4036820 msgr2=0x7f15c4038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:28.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.373+0000 7f15e10d8700 1 --2- 172.21.15.57:0/612417979 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f15c4036820 0x7f15c4038cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f15d0006fd0 tx=0x7f15d0006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:28.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.373+0000 7f15e10d8700 1 -- 172.21.15.57:0/612417979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 msgr2=0x7f15dc198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:28.748 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.373+0000 7f15e10d8700 1 --2- 172.21.15.57:0/612417979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc198f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009fb0 tx=0x7f15cc011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:28.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.374+0000 7f15e10d8700 1 -- 172.21.15.57:0/612417979 shutdown_connections 2023-03-02T10:48:28.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.374+0000 7f15e10d8700 1 --2- 172.21.15.57:0/612417979 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f15c4036820 0x7f15c4038cd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:28.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.374+0000 7f15e10d8700 1 --2- 172.21.15.57:0/612417979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15dc105e40 0x7f15dc198f80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:28.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.374+0000 7f15e10d8700 1 -- 172.21.15.57:0/612417979 >> 172.21.15.57:0/612417979 conn(0x7f15dc0ff8a0 msgr2=0x7f15dc100600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:28.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.374+0000 7f15e10d8700 1 -- 172.21.15.57:0/612417979 shutdown_connections 2023-03-02T10:48:28.749 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:28.374+0000 7f15e10d8700 1 -- 172.21.15.57:0/612417979 wait complete. 2023-03-02T10:48:28.750 INFO:teuthology.orchestra.run.smithi057.stdout:Generating ssh key... 2023-03-02T10:48:29.544 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-mon[92072]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:48:29.933 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: Generating public/private rsa key pair. 2023-03-02T10:48:29.933 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: Your identification has been saved in /tmp/tmp29c6wb09/key. 2023-03-02T10:48:29.933 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: Your public key has been saved in /tmp/tmp29c6wb09/key.pub. 2023-03-02T10:48:29.934 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: The key fingerprint is: 2023-03-02T10:48:29.934 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: SHA256:nanpAGgAEDjsV4Pn4tVyDiZpZSWcUT44eRk0ubAbeag ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:48:29.934 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: The key's randomart image is: 2023-03-02T10:48:29.934 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: +---[RSA 3072]----+ 2023-03-02T10:48:29.934 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: |B. oo**. | 2023-03-02T10:48:29.934 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: |+. . X=.+ | 2023-03-02T10:48:29.934 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: |o. B+B=. | 2023-03-02T10:48:29.935 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: | o B @o=.. o | 2023-03-02T10:48:29.935 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: | * B O S + | 2023-03-02T10:48:29.935 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: | . E o . o | 2023-03-02T10:48:29.935 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: | . o | 2023-03-02T10:48:29.935 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: | o | 2023-03-02T10:48:29.935 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: | . | 2023-03-02T10:48:29.936 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:29 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: +----[SHA256]-----+ 2023-03-02T10:48:30.002 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.203+0000 7f73cc9d8700 1 Processor -- start 2023-03-02T10:48:30.003 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.203+0000 7f73cc9d8700 1 -- start start 2023-03-02T10:48:30.003 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.203+0000 7f73cc9d8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:30.003 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.203+0000 7f73cc9d8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c8108410 con 0x7f73c8079cc0 2023-03-02T10:48:30.003 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.204+0000 7f73c659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:30.003 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.204+0000 7f73c659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8107ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49394/0 (socket says 172.21.15.57:49394) 2023-03-02T10:48:30.003 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.204+0000 7f73c659c700 1 -- 172.21.15.57:0/2289836111 learned_addr learned my addr 172.21.15.57:0/2289836111 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:30.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.204+0000 7f73c659c700 1 -- 172.21.15.57:0/2289836111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c8108550 con 0x7f73c8079cc0 2023-03-02T10:48:30.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.204+0000 7f73c659c700 1 --2- 172.21.15.57:0/2289836111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8107ed0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f73b80098a0 tx=0x7f73b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9aa18d015e15df1 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:30.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.204+0000 7f73c559a700 1 -- 172.21.15.57:0/2289836111 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73b8004160 con 0x7f73c8079cc0 2023-03-02T10:48:30.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.205+0000 7f73c559a700 1 -- 172.21.15.57:0/2289836111 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73b80042c0 con 0x7f73c8079cc0 2023-03-02T10:48:30.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.205+0000 7f73c559a700 1 -- 172.21.15.57:0/2289836111 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73b8011a00 con 0x7f73c8079cc0 2023-03-02T10:48:30.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.205+0000 7f73cc9d8700 1 -- 172.21.15.57:0/2289836111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 msgr2=0x7f73c8107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:30.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.205+0000 7f73cc9d8700 1 --2- 172.21.15.57:0/2289836111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8107ed0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f73b80098a0 tx=0x7f73b8009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:30.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.205+0000 7f73cc9d8700 1 -- 172.21.15.57:0/2289836111 shutdown_connections 2023-03-02T10:48:30.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.205+0000 7f73cc9d8700 1 --2- 172.21.15.57:0/2289836111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8107ed0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:30.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.205+0000 7f73cc9d8700 1 -- 172.21.15.57:0/2289836111 >> 172.21.15.57:0/2289836111 conn(0x7f73c80ff8a0 msgr2=0x7f73c8101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:30.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.205+0000 7f73cc9d8700 1 -- 172.21.15.57:0/2289836111 shutdown_connections 2023-03-02T10:48:30.006 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.205+0000 7f73cc9d8700 1 -- 172.21.15.57:0/2289836111 wait complete. 2023-03-02T10:48:30.006 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.206+0000 7f73cc9d8700 1 Processor -- start 2023-03-02T10:48:30.006 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.206+0000 7f73cc9d8700 1 -- start start 2023-03-02T10:48:30.006 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.206+0000 7f73cc9d8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8105830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:30.007 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.206+0000 7f73cc9d8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c8105d70 con 0x7f73c8079cc0 2023-03-02T10:48:30.007 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.206+0000 7f73c659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8105830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:30.007 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.206+0000 7f73c659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8105830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49408/0 (socket says 172.21.15.57:49408) 2023-03-02T10:48:30.007 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.206+0000 7f73c659c700 1 -- 172.21.15.57:0/4111929165 learned_addr learned my addr 172.21.15.57:0/4111929165 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:30.008 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.207+0000 7f73c659c700 1 -- 172.21.15.57:0/4111929165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b8009550 con 0x7f73c8079cc0 2023-03-02T10:48:30.008 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.207+0000 7f73c659c700 1 --2- 172.21.15.57:0/4111929165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8105830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f73b8006af0 tx=0x7f73b8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:30.008 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.207+0000 7f73b77fe700 1 -- 172.21.15.57:0/4111929165 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73b8003a40 con 0x7f73c8079cc0 2023-03-02T10:48:30.008 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.207+0000 7f73cc9d8700 1 -- 172.21.15.57:0/4111929165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c81095a0 con 0x7f73c8079cc0 2023-03-02T10:48:30.009 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.207+0000 7f73b77fe700 1 -- 172.21.15.57:0/4111929165 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73b8003ba0 con 0x7f73c8079cc0 2023-03-02T10:48:30.009 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.207+0000 7f73b77fe700 1 -- 172.21.15.57:0/4111929165 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73b801a700 con 0x7f73c8079cc0 2023-03-02T10:48:30.009 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.207+0000 7f73cc9d8700 1 -- 172.21.15.57:0/4111929165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c8109410 con 0x7f73c8079cc0 2023-03-02T10:48:30.009 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.208+0000 7f73cc9d8700 1 -- 172.21.15.57:0/4111929165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c8061bc0 con 0x7f73c8079cc0 2023-03-02T10:48:30.010 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.209+0000 7f73b77fe700 1 -- 172.21.15.57:0/4111929165 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f73b8017020 con 0x7f73c8079cc0 2023-03-02T10:48:30.010 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.209+0000 7f73b77fe700 1 --2- 172.21.15.57:0/4111929165 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f73b0036820 0x7f73b0038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:30.010 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.209+0000 7f73b77fe700 1 -- 172.21.15.57:0/4111929165 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f73b8049bf0 con 0x7f73c8079cc0 2023-03-02T10:48:30.011 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.209+0000 7f73c5d9b700 1 --2- 172.21.15.57:0/4111929165 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f73b0036820 0x7f73b0038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:30.011 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.210+0000 7f73c5d9b700 1 --2- 172.21.15.57:0/4111929165 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f73b0036820 0x7f73b0038cd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f73bc006fd0 tx=0x7f73bc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:30.011 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.214+0000 7f73b77fe700 1 -- 172.21.15.57:0/4111929165 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f73b8018530 con 0x7f73c8079cc0 2023-03-02T10:48:30.011 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.413+0000 7f73cc9d8700 1 -- 172.21.15.57:0/4111929165 --> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f73c8100cd0 con 0x7f73b0036820 2023-03-02T10:48:30.012 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.555+0000 7f73b77fe700 1 -- 172.21.15.57:0/4111929165 <== mgr.14120 v2:172.21.15.57:6800/3127649723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f73c8100cd0 con 0x7f73b0036820 2023-03-02T10:48:30.012 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.557+0000 7f73cc9d8700 1 -- 172.21.15.57:0/4111929165 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f73b0036820 msgr2=0x7f73b0038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:30.012 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.557+0000 7f73cc9d8700 1 --2- 172.21.15.57:0/4111929165 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f73b0036820 0x7f73b0038cd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f73bc006fd0 tx=0x7f73bc006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:30.012 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.557+0000 7f73cc9d8700 1 -- 172.21.15.57:0/4111929165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 msgr2=0x7f73c8105830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:30.013 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.558+0000 7f73cc9d8700 1 --2- 172.21.15.57:0/4111929165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8105830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f73b8006af0 tx=0x7f73b8011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:30.013 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.558+0000 7f73cc9d8700 1 -- 172.21.15.57:0/4111929165 shutdown_connections 2023-03-02T10:48:30.013 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.558+0000 7f73cc9d8700 1 --2- 172.21.15.57:0/4111929165 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f73b0036820 0x7f73b0038cd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:30.013 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.558+0000 7f73cc9d8700 1 --2- 172.21.15.57:0/4111929165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73c8079cc0 0x7f73c8105830 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:30.013 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.558+0000 7f73cc9d8700 1 -- 172.21.15.57:0/4111929165 >> 172.21.15.57:0/4111929165 conn(0x7f73c80ff8a0 msgr2=0x7f73c81005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:30.013 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.558+0000 7f73cc9d8700 1 -- 172.21.15.57:0/4111929165 shutdown_connections 2023-03-02T10:48:30.014 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:29.558+0000 7f73cc9d8700 1 -- 172.21.15.57:0/4111929165 wait complete. 2023-03-02T10:48:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:30 smithi057 ceph-mon[92072]: [02/Mar/2023:10:48:29] ENGINE Bus STARTING 2023-03-02T10:48:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:30 smithi057 ceph-mon[92072]: [02/Mar/2023:10:48:29] ENGINE Serving on https://172.21.15.57:7150 2023-03-02T10:48:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:30 smithi057 ceph-mon[92072]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:48:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:30 smithi057 ceph-mon[92072]: Generating ssh key... 2023-03-02T10:48:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:30 smithi057 ceph-mon[92072]: [02/Mar/2023:10:48:29] ENGINE Serving on https://172.21.15.57:8765 2023-03-02T10:48:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:30 smithi057 ceph-mon[92072]: [02/Mar/2023:10:48:29] ENGINE Bus STARTED 2023-03-02T10:48:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:30 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:48:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:30 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:30 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:31.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvg9306uUHqDH0MzGgXYd7vUWS0E8OpEFyJ1OsCE8hIA7n7urIBWexV/YIUhGfE8vfvQBlmZNPTAMVaGAzMI/R5y0MYefSWHrQpoLLptj1BVETYjgP1J/Qe204w5F+9q9udQKpu/NRpGsiQGwJcx7g7tO2Wy8b6acZLwxBW22BI2b47xkZgTrs5tws6eht+pnQYVMw4y/ItXcf76zyBirFqU1pvF9TChkpeeDIrN+s6GKlNe2TpVc2bi3Y0cR2kZIyKZ5bM8V0V8ZGep3/eC4ztZP4j+icCGoN9Er1nn4QlSSlmo4YCDHXIJfe+Rrdddsz9vANNtdeGZ+qvWG0tnWHOtSP7oXtiSeEmn4gaskNtTO8YsihpuKDUDaf8l+Zn8Xqwq+ZxssmXZEfSQ73KPbluLGgGxUplRT+VWP75wMnSMa0nV+h4cbRzgJGjdW1OFsxarCkB9FFmtWoztx1yGCaDZq5ApSRDtz2hDNkknGuNGKFtgy1gYwyRfwZAiOy9zU= ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:48:31.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.461+0000 7fc0b8815700 1 Processor -- start 2023-03-02T10:48:31.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.461+0000 7fc0b8815700 1 -- start start 2023-03-02T10:48:31.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.462+0000 7fc0b8815700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4108280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:31.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.462+0000 7fc0b8815700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4079ce0 con 0x7fc0b4105ea0 2023-03-02T10:48:31.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.462+0000 7fc0b259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:31.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.462+0000 7fc0b259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4108280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49412/0 (socket says 172.21.15.57:49412) 2023-03-02T10:48:31.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.462+0000 7fc0b259c700 1 -- 172.21.15.57:0/2845559699 learned_addr learned my addr 172.21.15.57:0/2845559699 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:31.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.462+0000 7fc0b259c700 1 -- 172.21.15.57:0/2845559699 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b4079e20 con 0x7fc0b4105ea0 2023-03-02T10:48:31.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.462+0000 7fc0b259c700 1 --2- 172.21.15.57:0/2845559699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4108280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40098a0 tx=0x7fc0a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab9525d2ebb28c9 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:31.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.463+0000 7fc0b159a700 1 -- 172.21.15.57:0/2845559699 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4004160 con 0x7fc0b4105ea0 2023-03-02T10:48:31.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.463+0000 7fc0b159a700 1 -- 172.21.15.57:0/2845559699 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc0a40042c0 con 0x7fc0b4105ea0 2023-03-02T10:48:31.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.463+0000 7fc0b159a700 1 -- 172.21.15.57:0/2845559699 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4011a00 con 0x7fc0b4105ea0 2023-03-02T10:48:31.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.463+0000 7fc0b8815700 1 -- 172.21.15.57:0/2845559699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 msgr2=0x7fc0b4108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:31.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.463+0000 7fc0b8815700 1 --2- 172.21.15.57:0/2845559699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4108280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40098a0 tx=0x7fc0a4009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:31.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.463+0000 7fc0b8815700 1 -- 172.21.15.57:0/2845559699 shutdown_connections 2023-03-02T10:48:31.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.463+0000 7fc0b8815700 1 --2- 172.21.15.57:0/2845559699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4108280 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:31.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.463+0000 7fc0b8815700 1 -- 172.21.15.57:0/2845559699 >> 172.21.15.57:0/2845559699 conn(0x7fc0b40ff8a0 msgr2=0x7fc0b4101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:31.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.463+0000 7fc0b8815700 1 -- 172.21.15.57:0/2845559699 shutdown_connections 2023-03-02T10:48:31.068 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.463+0000 7fc0b8815700 1 -- 172.21.15.57:0/2845559699 wait complete. 2023-03-02T10:48:31.068 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.464+0000 7fc0b8815700 1 Processor -- start 2023-03-02T10:48:31.068 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.464+0000 7fc0b8815700 1 -- start start 2023-03-02T10:48:31.068 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.465+0000 7fc0b8815700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4105810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:31.068 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.465+0000 7fc0b8815700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4105d50 con 0x7fc0b4105ea0 2023-03-02T10:48:31.068 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.465+0000 7fc0b259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4105810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:31.068 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.465+0000 7fc0b259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4105810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49428/0 (socket says 172.21.15.57:49428) 2023-03-02T10:48:31.069 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.465+0000 7fc0b259c700 1 -- 172.21.15.57:0/1405452534 learned_addr learned my addr 172.21.15.57:0/1405452534 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:31.069 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.465+0000 7fc0b259c700 1 -- 172.21.15.57:0/1405452534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4009550 con 0x7fc0b4105ea0 2023-03-02T10:48:31.069 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.465+0000 7fc0b259c700 1 --2- 172.21.15.57:0/1405452534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4105810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4006af0 tx=0x7fc0a4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:31.069 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.465+0000 7fc0a37fe700 1 -- 172.21.15.57:0/1405452534 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4003a40 con 0x7fc0b4105ea0 2023-03-02T10:48:31.069 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.466+0000 7fc0b8815700 1 -- 172.21.15.57:0/1405452534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b41095c0 con 0x7fc0b4105ea0 2023-03-02T10:48:31.069 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.466+0000 7fc0a37fe700 1 -- 172.21.15.57:0/1405452534 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc0a4003ba0 con 0x7fc0b4105ea0 2023-03-02T10:48:31.069 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.466+0000 7fc0a37fe700 1 -- 172.21.15.57:0/1405452534 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a401a700 con 0x7fc0b4105ea0 2023-03-02T10:48:31.070 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.466+0000 7fc0b8815700 1 -- 172.21.15.57:0/1405452534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b4109430 con 0x7fc0b4105ea0 2023-03-02T10:48:31.070 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.466+0000 7fc0a37fe700 1 -- 172.21.15.57:0/1405452534 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7fc0a4017020 con 0x7fc0b4105ea0 2023-03-02T10:48:31.070 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.467+0000 7fc0b8815700 1 -- 172.21.15.57:0/1405452534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b4061bc0 con 0x7fc0b4105ea0 2023-03-02T10:48:31.070 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.467+0000 7fc0a37fe700 1 --2- 172.21.15.57:0/1405452534 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fc09c036820 0x7fc09c038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:31.070 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.467+0000 7fc0a37fe700 1 -- 172.21.15.57:0/1405452534 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc0a4049c70 con 0x7fc0b4105ea0 2023-03-02T10:48:31.070 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.467+0000 7fc0b1d9b700 1 --2- 172.21.15.57:0/1405452534 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fc09c036820 0x7fc09c038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:31.070 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.467+0000 7fc0b1d9b700 1 --2- 172.21.15.57:0/1405452534 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fc09c036820 0x7fc09c038cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8006fd0 tx=0x7fc0a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:31.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.472+0000 7fc0a37fe700 1 -- 172.21.15.57:0/1405452534 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fc0a4050080 con 0x7fc0b4105ea0 2023-03-02T10:48:31.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.670+0000 7fc0b8815700 1 -- 172.21.15.57:0/1405452534 --> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0b4100d50 con 0x7fc09c036820 2023-03-02T10:48:31.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.671+0000 7fc0a37fe700 1 -- 172.21.15.57:0/1405452534 <== mgr.14120 v2:172.21.15.57:6800/3127649723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fc0b4100d50 con 0x7fc09c036820 2023-03-02T10:48:31.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.673+0000 7fc0b8815700 1 -- 172.21.15.57:0/1405452534 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fc09c036820 msgr2=0x7fc09c038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:31.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.673+0000 7fc0b8815700 1 --2- 172.21.15.57:0/1405452534 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fc09c036820 0x7fc09c038cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8006fd0 tx=0x7fc0a8006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:31.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.673+0000 7fc0b8815700 1 -- 172.21.15.57:0/1405452534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 msgr2=0x7fc0b4105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:31.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.673+0000 7fc0b8815700 1 --2- 172.21.15.57:0/1405452534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4105810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4006af0 tx=0x7fc0a4011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:31.071 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.673+0000 7fc0b8815700 1 -- 172.21.15.57:0/1405452534 shutdown_connections 2023-03-02T10:48:31.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.673+0000 7fc0b8815700 1 --2- 172.21.15.57:0/1405452534 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fc09c036820 0x7fc09c038cd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:31.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.673+0000 7fc0b8815700 1 --2- 172.21.15.57:0/1405452534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0b4105ea0 0x7fc0b4105810 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:31.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.673+0000 7fc0b8815700 1 -- 172.21.15.57:0/1405452534 >> 172.21.15.57:0/1405452534 conn(0x7fc0b40ff8a0 msgr2=0x7fc0b4100640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:31.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.673+0000 7fc0b8815700 1 -- 172.21.15.57:0/1405452534 shutdown_connections 2023-03-02T10:48:31.072 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:30.673+0000 7fc0b8815700 1 -- 172.21.15.57:0/1405452534 wait complete. 2023-03-02T10:48:31.072 INFO:teuthology.orchestra.run.smithi057.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-03-02T10:48:31.072 INFO:teuthology.orchestra.run.smithi057.stdout:Adding key to root@localhost authorized_keys... 2023-03-02T10:48:31.073 INFO:teuthology.orchestra.run.smithi057.stdout:Adding host smithi057... 2023-03-02T10:48:31.374 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:31 smithi057 ceph-mon[92072]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:48:32.989 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:32 smithi057 ceph-mon[92072]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi057", "addr": "172.21.15.57", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:48:32.989 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:32 smithi057 ceph-mon[92072]: Deploying cephadm binary to smithi057 2023-03-02T10:48:34.536 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Added host 'smithi057' with addr '172.21.15.57' 2023-03-02T10:48:34.536 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.538+0000 7fbcd22f8700 1 Processor -- start 2023-03-02T10:48:34.536 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.538+0000 7fbcd22f8700 1 -- start start 2023-03-02T10:48:34.536 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.539+0000 7fbcd22f8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc108280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:34.536 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.539+0000 7fbcd22f8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc079ce0 con 0x7fbccc105ea0 2023-03-02T10:48:34.537 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.539+0000 7fbccbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:34.537 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.539+0000 7fbccbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc108280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49444/0 (socket says 172.21.15.57:49444) 2023-03-02T10:48:34.537 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.539+0000 7fbccbfff700 1 -- 172.21.15.57:0/2117731706 learned_addr learned my addr 172.21.15.57:0/2117731706 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:34.537 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.539+0000 7fbccbfff700 1 -- 172.21.15.57:0/2117731706 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc079e20 con 0x7fbccc105ea0 2023-03-02T10:48:34.537 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.539+0000 7fbccbfff700 1 --2- 172.21.15.57:0/2117731706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc108280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0098a0 tx=0x7fbcbc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33d637e19aaf10e server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:34.537 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.539+0000 7fbccb7fe700 1 -- 172.21.15.57:0/2117731706 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcbc004160 con 0x7fbccc105ea0 2023-03-02T10:48:34.537 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.540+0000 7fbccb7fe700 1 -- 172.21.15.57:0/2117731706 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbcbc0042c0 con 0x7fbccc105ea0 2023-03-02T10:48:34.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.540+0000 7fbccb7fe700 1 -- 172.21.15.57:0/2117731706 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcbc011a00 con 0x7fbccc105ea0 2023-03-02T10:48:34.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.540+0000 7fbcd22f8700 1 -- 172.21.15.57:0/2117731706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 msgr2=0x7fbccc108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:34.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.540+0000 7fbcd22f8700 1 --2- 172.21.15.57:0/2117731706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc108280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0098a0 tx=0x7fbcbc009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:34.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.540+0000 7fbcd22f8700 1 -- 172.21.15.57:0/2117731706 shutdown_connections 2023-03-02T10:48:34.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.540+0000 7fbcd22f8700 1 --2- 172.21.15.57:0/2117731706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc108280 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:34.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.540+0000 7fbcd22f8700 1 -- 172.21.15.57:0/2117731706 >> 172.21.15.57:0/2117731706 conn(0x7fbccc0ff8a0 msgr2=0x7fbccc101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:34.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.540+0000 7fbcd22f8700 1 -- 172.21.15.57:0/2117731706 shutdown_connections 2023-03-02T10:48:34.538 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.540+0000 7fbcd22f8700 1 -- 172.21.15.57:0/2117731706 wait complete. 2023-03-02T10:48:34.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.541+0000 7fbcd22f8700 1 Processor -- start 2023-03-02T10:48:34.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.541+0000 7fbcd22f8700 1 -- start start 2023-03-02T10:48:34.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.541+0000 7fbcd22f8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc105810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:34.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.541+0000 7fbcd22f8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc105d50 con 0x7fbccc105ea0 2023-03-02T10:48:34.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.541+0000 7fbccbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc105810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:34.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.541+0000 7fbccbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc105810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49458/0 (socket says 172.21.15.57:49458) 2023-03-02T10:48:34.539 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.542+0000 7fbccbfff700 1 -- 172.21.15.57:0/3652198704 learned_addr learned my addr 172.21.15.57:0/3652198704 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:34.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.542+0000 7fbccbfff700 1 -- 172.21.15.57:0/3652198704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc009550 con 0x7fbccc105ea0 2023-03-02T10:48:34.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.542+0000 7fbccbfff700 1 --2- 172.21.15.57:0/3652198704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc105810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009fb0 tx=0x7fbcbc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:34.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.542+0000 7fbcc9ffb700 1 -- 172.21.15.57:0/3652198704 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcbc003930 con 0x7fbccc105ea0 2023-03-02T10:48:34.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.542+0000 7fbcc9ffb700 1 -- 172.21.15.57:0/3652198704 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbcbc003a90 con 0x7fbccc105ea0 2023-03-02T10:48:34.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.542+0000 7fbcc9ffb700 1 -- 172.21.15.57:0/3652198704 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcbc0195e0 con 0x7fbccc105ea0 2023-03-02T10:48:34.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.542+0000 7fbcd22f8700 1 -- 172.21.15.57:0/3652198704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc1095c0 con 0x7fbccc105ea0 2023-03-02T10:48:34.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.542+0000 7fbcd22f8700 1 -- 172.21.15.57:0/3652198704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc109430 con 0x7fbccc105ea0 2023-03-02T10:48:34.540 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.543+0000 7fbcd22f8700 1 -- 172.21.15.57:0/3652198704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc061bc0 con 0x7fbccc105ea0 2023-03-02T10:48:34.541 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.543+0000 7fbcc9ffb700 1 -- 172.21.15.57:0/3652198704 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7fbcbc02a020 con 0x7fbccc105ea0 2023-03-02T10:48:34.541 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.544+0000 7fbcc9ffb700 1 --2- 172.21.15.57:0/3652198704 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbcb80367d0 0x7fbcb8038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:34.541 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.544+0000 7fbcc9ffb700 1 -- 172.21.15.57:0/3652198704 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbcbc049c70 con 0x7fbccc105ea0 2023-03-02T10:48:34.541 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.544+0000 7fbcc37fe700 1 --2- 172.21.15.57:0/3652198704 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbcb80367d0 0x7fbcb8038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:34.541 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.544+0000 7fbcc37fe700 1 --2- 172.21.15.57:0/3652198704 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbcb80367d0 0x7fbcb8038c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4006fd0 tx=0x7fbcb4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:34.541 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.548+0000 7fbcc9ffb700 1 -- 172.21.15.57:0/3652198704 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fbcbc018350 con 0x7fbccc105ea0 2023-03-02T10:48:34.541 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:31.747+0000 7fbcd22f8700 1 -- 172.21.15.57:0/3652198704 --> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi057", "addr": "172.21.15.57", "target": ["mon-mgr", ""]}) v1 -- 0x7fbccc100d80 con 0x7fbcb80367d0 2023-03-02T10:48:34.542 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:34.082+0000 7fbcc9ffb700 1 -- 172.21.15.57:0/3652198704 <== mgr.14120 v2:172.21.15.57:6800/3127649723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fbccc100d80 con 0x7fbcb80367d0 2023-03-02T10:48:34.542 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:34.085+0000 7fbcd22f8700 1 -- 172.21.15.57:0/3652198704 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbcb80367d0 msgr2=0x7fbcb8038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:34.542 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:34.085+0000 7fbcd22f8700 1 --2- 172.21.15.57:0/3652198704 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbcb80367d0 0x7fbcb8038c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4006fd0 tx=0x7fbcb4006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:34.542 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:34.086+0000 7fbcd22f8700 1 -- 172.21.15.57:0/3652198704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 msgr2=0x7fbccc105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:34.542 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:34.086+0000 7fbcd22f8700 1 --2- 172.21.15.57:0/3652198704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc105810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009fb0 tx=0x7fbcbc011ad0 comp rx=0 tx=0).stop 2023-03-02T10:48:34.542 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:34.086+0000 7fbcd22f8700 1 -- 172.21.15.57:0/3652198704 shutdown_connections 2023-03-02T10:48:34.542 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:34.086+0000 7fbcd22f8700 1 --2- 172.21.15.57:0/3652198704 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbcb80367d0 0x7fbcb8038c80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:34.542 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:34.086+0000 7fbcd22f8700 1 --2- 172.21.15.57:0/3652198704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc105ea0 0x7fbccc105810 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:34.543 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:34.086+0000 7fbcd22f8700 1 -- 172.21.15.57:0/3652198704 >> 172.21.15.57:0/3652198704 conn(0x7fbccc0ff8a0 msgr2=0x7fbccc100670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:34.543 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:34.086+0000 7fbcd22f8700 1 -- 172.21.15.57:0/3652198704 shutdown_connections 2023-03-02T10:48:34.543 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:34.086+0000 7fbcd22f8700 1 -- 172.21.15.57:0/3652198704 wait complete. 2023-03-02T10:48:34.543 INFO:teuthology.orchestra.run.smithi057.stdout:Deploying unmanaged mon service... 2023-03-02T10:48:35.089 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:35 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:35.089 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:35 smithi057 ceph-mon[92072]: Added host smithi057 2023-03-02T10:48:35.090 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:35 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:48:35.996 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-03-02T10:48:35.996 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f197ef71700 1 Processor -- start 2023-03-02T10:48:35.996 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f197ef71700 1 -- start start 2023-03-02T10:48:35.997 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f197ef71700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f19781056e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:35.997 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f197ef71700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1978105c20 con 0x7f19781052d0 2023-03-02T10:48:35.997 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f197cd0d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f19781056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:35.997 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f197cd0d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f19781056e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49462/0 (socket says 172.21.15.57:49462) 2023-03-02T10:48:35.997 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f197cd0d700 1 -- 172.21.15.57:0/390960694 learned_addr learned my addr 172.21.15.57:0/390960694 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:35.997 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f197cd0d700 1 -- 172.21.15.57:0/390960694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1978105d60 con 0x7f19781052d0 2023-03-02T10:48:35.997 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f197cd0d700 1 --2- 172.21.15.57:0/390960694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f19781056e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f196c0098a0 tx=0x7f196c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa2a171fda1bbb5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:35.998 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f19777fe700 1 -- 172.21.15.57:0/390960694 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f196c004160 con 0x7f19781052d0 2023-03-02T10:48:35.998 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f19777fe700 1 -- 172.21.15.57:0/390960694 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f196c0042c0 con 0x7f19781052d0 2023-03-02T10:48:35.998 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.010+0000 7f19777fe700 1 -- 172.21.15.57:0/390960694 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f196c011a00 con 0x7f19781052d0 2023-03-02T10:48:35.998 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.011+0000 7f197ef71700 1 -- 172.21.15.57:0/390960694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 msgr2=0x7f19781056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:35.998 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.011+0000 7f197ef71700 1 --2- 172.21.15.57:0/390960694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f19781056e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f196c0098a0 tx=0x7f196c009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:35.998 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.011+0000 7f197ef71700 1 -- 172.21.15.57:0/390960694 shutdown_connections 2023-03-02T10:48:35.998 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.011+0000 7f197ef71700 1 --2- 172.21.15.57:0/390960694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f19781056e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:35.999 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.011+0000 7f197ef71700 1 -- 172.21.15.57:0/390960694 >> 172.21.15.57:0/390960694 conn(0x7f1978100930 msgr2=0x7f1978102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:35.999 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.011+0000 7f197ef71700 1 -- 172.21.15.57:0/390960694 shutdown_connections 2023-03-02T10:48:35.999 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.011+0000 7f197ef71700 1 -- 172.21.15.57:0/390960694 wait complete. 2023-03-02T10:48:35.999 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.012+0000 7f197ef71700 1 Processor -- start 2023-03-02T10:48:35.999 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.012+0000 7f197ef71700 1 -- start start 2023-03-02T10:48:35.999 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.012+0000 7f197ef71700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f1978198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:35.999 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.012+0000 7f197ef71700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1978199510 con 0x7f19781052d0 2023-03-02T10:48:36.000 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.012+0000 7f197cd0d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f1978198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:36.000 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.012+0000 7f197cd0d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f1978198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49476/0 (socket says 172.21.15.57:49476) 2023-03-02T10:48:36.000 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.012+0000 7f197cd0d700 1 -- 172.21.15.57:0/1184234306 learned_addr learned my addr 172.21.15.57:0/1184234306 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:36.000 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.012+0000 7f197cd0d700 1 -- 172.21.15.57:0/1184234306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c009550 con 0x7f19781052d0 2023-03-02T10:48:36.000 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.013+0000 7f197cd0d700 1 --2- 172.21.15.57:0/1184234306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f1978198fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f196c011a20 tx=0x7f196c011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:36.000 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.013+0000 7f1975ffb700 1 -- 172.21.15.57:0/1184234306 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f196c0039c0 con 0x7f19781052d0 2023-03-02T10:48:36.000 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.013+0000 7f197ef71700 1 -- 172.21.15.57:0/1184234306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1978107360 con 0x7f19781052d0 2023-03-02T10:48:36.001 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.013+0000 7f1975ffb700 1 -- 172.21.15.57:0/1184234306 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f196c003b20 con 0x7f19781052d0 2023-03-02T10:48:36.001 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.013+0000 7f1975ffb700 1 -- 172.21.15.57:0/1184234306 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f196c01a5a0 con 0x7f19781052d0 2023-03-02T10:48:36.002 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.013+0000 7f197ef71700 1 -- 172.21.15.57:0/1184234306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19781071d0 con 0x7f19781052d0 2023-03-02T10:48:36.003 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.014+0000 7f1975ffb700 1 -- 172.21.15.57:0/1184234306 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f196c017020 con 0x7f19781052d0 2023-03-02T10:48:36.003 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.014+0000 7f197ef71700 1 -- 172.21.15.57:0/1184234306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1978061bc0 con 0x7f19781052d0 2023-03-02T10:48:36.003 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.014+0000 7f1975ffb700 1 --2- 172.21.15.57:0/1184234306 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1968036820 0x7f1968038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:36.003 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.014+0000 7f1975ffb700 1 -- 172.21.15.57:0/1184234306 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f196c049bf0 con 0x7f19781052d0 2023-03-02T10:48:36.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.014+0000 7f1977fff700 1 --2- 172.21.15.57:0/1184234306 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1968036820 0x7f1968038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:36.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.015+0000 7f1977fff700 1 --2- 172.21.15.57:0/1184234306 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1968036820 0x7f1968038cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1964006fd0 tx=0x7f1964006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:36.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.019+0000 7f1975ffb700 1 -- 172.21.15.57:0/1184234306 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f196c018530 con 0x7f19781052d0 2023-03-02T10:48:36.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.237+0000 7f197ef71700 1 -- 172.21.15.57:0/1184234306 --> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f1978101db0 con 0x7f1968036820 2023-03-02T10:48:36.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.243+0000 7f1975ffb700 1 -- 172.21.15.57:0/1184234306 <== mgr.14120 v2:172.21.15.57:6800/3127649723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1978101db0 con 0x7f1968036820 2023-03-02T10:48:36.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.245+0000 7f197ef71700 1 -- 172.21.15.57:0/1184234306 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1968036820 msgr2=0x7f1968038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:36.004 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.245+0000 7f197ef71700 1 --2- 172.21.15.57:0/1184234306 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1968036820 0x7f1968038cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1964006fd0 tx=0x7f1964006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:36.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.245+0000 7f197ef71700 1 -- 172.21.15.57:0/1184234306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 msgr2=0x7f1978198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:36.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.245+0000 7f197ef71700 1 --2- 172.21.15.57:0/1184234306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f1978198fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f196c011a20 tx=0x7f196c011b00 comp rx=0 tx=0).stop 2023-03-02T10:48:36.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.245+0000 7f197ef71700 1 -- 172.21.15.57:0/1184234306 shutdown_connections 2023-03-02T10:48:36.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.245+0000 7f197ef71700 1 --2- 172.21.15.57:0/1184234306 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1968036820 0x7f1968038cd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:36.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.245+0000 7f197ef71700 1 --2- 172.21.15.57:0/1184234306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19781052d0 0x7f1978198fd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:36.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.245+0000 7f197ef71700 1 -- 172.21.15.57:0/1184234306 >> 172.21.15.57:0/1184234306 conn(0x7f1978100930 msgr2=0x7f19781016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:36.005 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.246+0000 7f197ef71700 1 -- 172.21.15.57:0/1184234306 shutdown_connections 2023-03-02T10:48:36.006 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:35.246+0000 7f197ef71700 1 -- 172.21.15.57:0/1184234306 wait complete. 2023-03-02T10:48:36.006 INFO:teuthology.orchestra.run.smithi057.stdout:Deploying unmanaged mgr service... 2023-03-02T10:48:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:36 smithi057 ceph-mon[92072]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:48:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:36 smithi057 ceph-mon[92072]: Saving service mon spec with placement count:5 2023-03-02T10:48:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:36 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:36 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:37.060 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-03-02T10:48:37.061 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.455+0000 7fe2de1d9700 1 Processor -- start 2023-03-02T10:48:37.061 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.456+0000 7fe2de1d9700 1 -- start start 2023-03-02T10:48:37.061 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.456+0000 7fe2de1d9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d810a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:37.061 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.456+0000 7fe2de1d9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8105ce0 con 0x7fe2d8079ca0 2023-03-02T10:48:37.061 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.456+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d810a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:37.061 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.456+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d810a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45242/0 (socket says 172.21.15.57:45242) 2023-03-02T10:48:37.062 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.456+0000 7fe2d77fe700 1 -- 172.21.15.57:0/1751624075 learned_addr learned my addr 172.21.15.57:0/1751624075 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:37.062 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.456+0000 7fe2d77fe700 1 -- 172.21.15.57:0/1751624075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d810a830 con 0x7fe2d8079ca0 2023-03-02T10:48:37.062 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.457+0000 7fe2d77fe700 1 --2- 172.21.15.57:0/1751624075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d810a2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80098a0 tx=0x7fe2c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef078ecaf644ef00 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:37.062 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.457+0000 7fe2d67fc700 1 -- 172.21.15.57:0/1751624075 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2c8004160 con 0x7fe2d8079ca0 2023-03-02T10:48:37.062 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.457+0000 7fe2d67fc700 1 -- 172.21.15.57:0/1751624075 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2c80042c0 con 0x7fe2d8079ca0 2023-03-02T10:48:37.062 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.457+0000 7fe2d67fc700 1 -- 172.21.15.57:0/1751624075 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2c80119b0 con 0x7fe2d8079ca0 2023-03-02T10:48:37.062 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.457+0000 7fe2de1d9700 1 -- 172.21.15.57:0/1751624075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 msgr2=0x7fe2d810a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:37.063 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.457+0000 7fe2de1d9700 1 --2- 172.21.15.57:0/1751624075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d810a2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80098a0 tx=0x7fe2c8009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:37.063 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.457+0000 7fe2de1d9700 1 -- 172.21.15.57:0/1751624075 shutdown_connections 2023-03-02T10:48:37.063 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.457+0000 7fe2de1d9700 1 --2- 172.21.15.57:0/1751624075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d810a2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:37.063 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.457+0000 7fe2de1d9700 1 -- 172.21.15.57:0/1751624075 >> 172.21.15.57:0/1751624075 conn(0x7fe2d80ff880 msgr2=0x7fe2d8101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:37.063 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.458+0000 7fe2de1d9700 1 -- 172.21.15.57:0/1751624075 shutdown_connections 2023-03-02T10:48:37.063 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.458+0000 7fe2de1d9700 1 -- 172.21.15.57:0/1751624075 wait complete. 2023-03-02T10:48:37.063 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.458+0000 7fe2de1d9700 1 Processor -- start 2023-03-02T10:48:37.064 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.458+0000 7fe2de1d9700 1 -- start start 2023-03-02T10:48:37.064 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.459+0000 7fe2de1d9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:37.064 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.459+0000 7fe2de1d9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d819b700 con 0x7fe2d8079ca0 2023-03-02T10:48:37.064 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.459+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:37.064 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.459+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d819b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45244/0 (socket says 172.21.15.57:45244) 2023-03-02T10:48:37.064 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.459+0000 7fe2d77fe700 1 -- 172.21.15.57:0/2618416977 learned_addr learned my addr 172.21.15.57:0/2618416977 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:37.064 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.459+0000 7fe2d77fe700 1 -- 172.21.15.57:0/2618416977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8009550 con 0x7fe2d8079ca0 2023-03-02T10:48:37.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.459+0000 7fe2d77fe700 1 --2- 172.21.15.57:0/2618416977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d819b1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8000c00 tx=0x7fe2c8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:37.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.459+0000 7fe2d4ff9700 1 -- 172.21.15.57:0/2618416977 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2c80039f0 con 0x7fe2d8079ca0 2023-03-02T10:48:37.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.459+0000 7fe2d4ff9700 1 -- 172.21.15.57:0/2618416977 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2c8003b50 con 0x7fe2d8079ca0 2023-03-02T10:48:37.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.459+0000 7fe2d4ff9700 1 -- 172.21.15.57:0/2618416977 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2c801a780 con 0x7fe2d8079ca0 2023-03-02T10:48:37.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.459+0000 7fe2de1d9700 1 -- 172.21.15.57:0/2618416977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d810b800 con 0x7fe2d8079ca0 2023-03-02T10:48:37.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.460+0000 7fe2de1d9700 1 -- 172.21.15.57:0/2618416977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d810b670 con 0x7fe2d8079ca0 2023-03-02T10:48:37.065 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.460+0000 7fe2d4ff9700 1 -- 172.21.15.57:0/2618416977 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7fe2c8017020 con 0x7fe2d8079ca0 2023-03-02T10:48:37.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.461+0000 7fe2de1d9700 1 -- 172.21.15.57:0/2618416977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d810b990 con 0x7fe2d8079ca0 2023-03-02T10:48:37.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.461+0000 7fe2d4ff9700 1 --2- 172.21.15.57:0/2618416977 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fe2c0036820 0x7fe2c0038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:37.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.461+0000 7fe2d4ff9700 1 -- 172.21.15.57:0/2618416977 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe2c8049c10 con 0x7fe2d8079ca0 2023-03-02T10:48:37.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.461+0000 7fe2d6ffd700 1 --2- 172.21.15.57:0/2618416977 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fe2c0036820 0x7fe2c0038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:37.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.461+0000 7fe2d6ffd700 1 --2- 172.21.15.57:0/2618416977 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fe2c0036820 0x7fe2c0038cd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc006fd0 tx=0x7fe2cc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:37.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.466+0000 7fe2d4ff9700 1 -- 172.21.15.57:0/2618416977 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fe2c802d3f0 con 0x7fe2d8079ca0 2023-03-02T10:48:37.066 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.688+0000 7fe2de1d9700 1 -- 172.21.15.57:0/2618416977 --> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe2d8100ce0 con 0x7fe2c0036820 2023-03-02T10:48:37.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.693+0000 7fe2d4ff9700 1 -- 172.21.15.57:0/2618416977 <== mgr.14120 v2:172.21.15.57:6800/3127649723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe2d8100ce0 con 0x7fe2c0036820 2023-03-02T10:48:37.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.696+0000 7fe2de1d9700 1 -- 172.21.15.57:0/2618416977 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fe2c0036820 msgr2=0x7fe2c0038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:37.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.696+0000 7fe2de1d9700 1 --2- 172.21.15.57:0/2618416977 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fe2c0036820 0x7fe2c0038cd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc006fd0 tx=0x7fe2cc006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:37.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.696+0000 7fe2de1d9700 1 -- 172.21.15.57:0/2618416977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 msgr2=0x7fe2d819b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:37.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.696+0000 7fe2de1d9700 1 --2- 172.21.15.57:0/2618416977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d819b1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8000c00 tx=0x7fe2c8011a30 comp rx=0 tx=0).stop 2023-03-02T10:48:37.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.696+0000 7fe2de1d9700 1 -- 172.21.15.57:0/2618416977 shutdown_connections 2023-03-02T10:48:37.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.696+0000 7fe2de1d9700 1 --2- 172.21.15.57:0/2618416977 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fe2c0036820 0x7fe2c0038cd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:37.067 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.696+0000 7fe2de1d9700 1 --2- 172.21.15.57:0/2618416977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8079ca0 0x7fe2d819b1c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:37.068 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.696+0000 7fe2de1d9700 1 -- 172.21.15.57:0/2618416977 >> 172.21.15.57:0/2618416977 conn(0x7fe2d80ff880 msgr2=0x7fe2d81005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:37.068 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.696+0000 7fe2de1d9700 1 -- 172.21.15.57:0/2618416977 shutdown_connections 2023-03-02T10:48:37.068 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:36.696+0000 7fe2de1d9700 1 -- 172.21.15.57:0/2618416977 wait complete. 2023-03-02T10:48:37.850 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:37 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:37.851 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:37 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:38.122 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.526+0000 7f5b9495e700 1 Processor -- start 2023-03-02T10:48:38.122 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.526+0000 7f5b9495e700 1 -- start start 2023-03-02T10:48:38.122 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.526+0000 7f5b9495e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9010a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:38.122 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.526+0000 7f5b9495e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b90105cc0 con 0x7f5b90079cc0 2023-03-02T10:48:38.122 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.526+0000 7f5b8e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9010a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:38.123 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.526+0000 7f5b8e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9010a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45254/0 (socket says 172.21.15.57:45254) 2023-03-02T10:48:38.123 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.526+0000 7f5b8e59c700 1 -- 172.21.15.57:0/2441804965 learned_addr learned my addr 172.21.15.57:0/2441804965 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:38.123 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.527+0000 7f5b8e59c700 1 -- 172.21.15.57:0/2441804965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9010a810 con 0x7f5b90079cc0 2023-03-02T10:48:38.123 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.527+0000 7f5b8e59c700 1 --2- 172.21.15.57:0/2441804965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9010a2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5b800098a0 tx=0x7f5b80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1f91a9e8addd7b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:38.123 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.527+0000 7f5b8d59a700 1 -- 172.21.15.57:0/2441804965 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b80004160 con 0x7f5b90079cc0 2023-03-02T10:48:38.123 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.527+0000 7f5b8d59a700 1 -- 172.21.15.57:0/2441804965 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b800042c0 con 0x7f5b90079cc0 2023-03-02T10:48:38.123 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.527+0000 7f5b8d59a700 1 -- 172.21.15.57:0/2441804965 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b800119b0 con 0x7f5b90079cc0 2023-03-02T10:48:38.124 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.528+0000 7f5b9495e700 1 -- 172.21.15.57:0/2441804965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 msgr2=0x7f5b9010a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:38.124 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.528+0000 7f5b9495e700 1 --2- 172.21.15.57:0/2441804965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9010a2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5b800098a0 tx=0x7f5b80009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:38.124 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.528+0000 7f5b9495e700 1 -- 172.21.15.57:0/2441804965 shutdown_connections 2023-03-02T10:48:38.124 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.528+0000 7f5b9495e700 1 --2- 172.21.15.57:0/2441804965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9010a2d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:38.124 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.528+0000 7f5b9495e700 1 -- 172.21.15.57:0/2441804965 >> 172.21.15.57:0/2441804965 conn(0x7f5b900ff8a0 msgr2=0x7f5b90101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:38.124 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.528+0000 7f5b9495e700 1 -- 172.21.15.57:0/2441804965 shutdown_connections 2023-03-02T10:48:38.124 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.528+0000 7f5b9495e700 1 -- 172.21.15.57:0/2441804965 wait complete. 2023-03-02T10:48:38.124 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.529+0000 7f5b9495e700 1 Processor -- start 2023-03-02T10:48:38.125 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.529+0000 7f5b9495e700 1 -- start start 2023-03-02T10:48:38.125 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.529+0000 7f5b9495e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9019b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:38.125 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.529+0000 7f5b9495e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9019b700 con 0x7f5b90079cc0 2023-03-02T10:48:38.125 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.529+0000 7f5b8e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9019b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:38.125 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.529+0000 7f5b8e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9019b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45270/0 (socket says 172.21.15.57:45270) 2023-03-02T10:48:38.125 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.529+0000 7f5b8e59c700 1 -- 172.21.15.57:0/3828157824 learned_addr learned my addr 172.21.15.57:0/3828157824 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:38.125 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.529+0000 7f5b8e59c700 1 -- 172.21.15.57:0/3828157824 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b80009550 con 0x7f5b90079cc0 2023-03-02T10:48:38.126 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.530+0000 7f5b8e59c700 1 --2- 172.21.15.57:0/3828157824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9019b1c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b80003e60 tx=0x7f5b80011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:38.126 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.530+0000 7f5b7f7fe700 1 -- 172.21.15.57:0/3828157824 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b80003970 con 0x7f5b90079cc0 2023-03-02T10:48:38.126 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.530+0000 7f5b9495e700 1 -- 172.21.15.57:0/3828157824 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9010b7e0 con 0x7f5b90079cc0 2023-03-02T10:48:38.126 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.530+0000 7f5b7f7fe700 1 -- 172.21.15.57:0/3828157824 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b80003ad0 con 0x7f5b90079cc0 2023-03-02T10:48:38.126 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.530+0000 7f5b7f7fe700 1 -- 172.21.15.57:0/3828157824 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b800195e0 con 0x7f5b90079cc0 2023-03-02T10:48:38.126 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.530+0000 7f5b9495e700 1 -- 172.21.15.57:0/3828157824 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9010b650 con 0x7f5b90079cc0 2023-03-02T10:48:38.126 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.531+0000 7f5b7f7fe700 1 -- 172.21.15.57:0/3828157824 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f5b8002a020 con 0x7f5b90079cc0 2023-03-02T10:48:38.127 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.531+0000 7f5b9495e700 1 -- 172.21.15.57:0/3828157824 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9010b970 con 0x7f5b90079cc0 2023-03-02T10:48:38.127 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.531+0000 7f5b7f7fe700 1 --2- 172.21.15.57:0/3828157824 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f5b780367d0 0x7f5b78038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:38.127 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.531+0000 7f5b7f7fe700 1 -- 172.21.15.57:0/3828157824 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5b80049f40 con 0x7f5b90079cc0 2023-03-02T10:48:38.127 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.531+0000 7f5b8dd9b700 1 --2- 172.21.15.57:0/3828157824 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f5b780367d0 0x7f5b78038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:38.127 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.532+0000 7f5b8dd9b700 1 --2- 172.21.15.57:0/3828157824 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f5b780367d0 0x7f5b78038c80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5b84006fd0 tx=0x7f5b84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:38.127 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.536+0000 7f5b7f7fe700 1 -- 172.21.15.57:0/3828157824 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f5b80018710 con 0x7f5b90079cc0 2023-03-02T10:48:38.127 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.737+0000 7f5b9495e700 1 -- 172.21.15.57:0/3828157824 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f5b9019ede0 con 0x7f5b90079cc0 2023-03-02T10:48:38.128 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.741+0000 7f5b7f7fe700 1 -- 172.21.15.57:0/3828157824 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f5b80018350 con 0x7f5b90079cc0 2023-03-02T10:48:38.128 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.743+0000 7f5b9495e700 1 -- 172.21.15.57:0/3828157824 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f5b780367d0 msgr2=0x7f5b78038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:38.128 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.743+0000 7f5b9495e700 1 --2- 172.21.15.57:0/3828157824 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f5b780367d0 0x7f5b78038c80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5b84006fd0 tx=0x7f5b84006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:38.128 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.743+0000 7f5b9495e700 1 -- 172.21.15.57:0/3828157824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 msgr2=0x7f5b9019b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:38.128 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.743+0000 7f5b9495e700 1 --2- 172.21.15.57:0/3828157824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9019b1c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b80003e60 tx=0x7f5b80011aa0 comp rx=0 tx=0).stop 2023-03-02T10:48:38.128 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.743+0000 7f5b9495e700 1 -- 172.21.15.57:0/3828157824 shutdown_connections 2023-03-02T10:48:38.128 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.743+0000 7f5b9495e700 1 --2- 172.21.15.57:0/3828157824 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f5b780367d0 0x7f5b78038c80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:38.128 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.743+0000 7f5b9495e700 1 --2- 172.21.15.57:0/3828157824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b90079cc0 0x7f5b9019b1c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:38.129 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.743+0000 7f5b9495e700 1 -- 172.21.15.57:0/3828157824 >> 172.21.15.57:0/3828157824 conn(0x7f5b900ff8a0 msgr2=0x7f5b90100650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:38.129 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.744+0000 7f5b9495e700 1 -- 172.21.15.57:0/3828157824 shutdown_connections 2023-03-02T10:48:38.129 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:37.744+0000 7f5b9495e700 1 -- 172.21.15.57:0/3828157824 wait complete. 2023-03-02T10:48:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:38 smithi057 ceph-mon[92072]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:48:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:38 smithi057 ceph-mon[92072]: Saving service mgr spec with placement count:2 2023-03-02T10:48:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:38 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3828157824' entity='client.admin' 2023-03-02T10:48:39.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.865+0000 7f1274dd9700 1 Processor -- start 2023-03-02T10:48:39.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.865+0000 7f1274dd9700 1 -- start start 2023-03-02T10:48:39.586 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.866+0000 7f1274dd9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127007a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:39.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.866+0000 7f1274dd9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127007a7f0 con 0x7f127007bdc0 2023-03-02T10:48:39.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.866+0000 7f126e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127007a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:39.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.866+0000 7f126e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127007a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45272/0 (socket says 172.21.15.57:45272) 2023-03-02T10:48:39.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.866+0000 7f126e59c700 1 -- 172.21.15.57:0/2203179634 learned_addr learned my addr 172.21.15.57:0/2203179634 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:39.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.866+0000 7f126e59c700 1 -- 172.21.15.57:0/2203179634 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127007a930 con 0x7f127007bdc0 2023-03-02T10:48:39.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.866+0000 7f126e59c700 1 --2- 172.21.15.57:0/2203179634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127007a2b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f12600098a0 tx=0x7f1260009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8361b67ffaa4934f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:39.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.867+0000 7f126d59a700 1 -- 172.21.15.57:0/2203179634 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1260004160 con 0x7f127007bdc0 2023-03-02T10:48:39.587 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.867+0000 7f126d59a700 1 -- 172.21.15.57:0/2203179634 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12600042c0 con 0x7f127007bdc0 2023-03-02T10:48:39.588 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.867+0000 7f126d59a700 1 -- 172.21.15.57:0/2203179634 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12600119b0 con 0x7f127007bdc0 2023-03-02T10:48:39.588 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.867+0000 7f1274dd9700 1 -- 172.21.15.57:0/2203179634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 msgr2=0x7f127007a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:39.588 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.867+0000 7f1274dd9700 1 --2- 172.21.15.57:0/2203179634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127007a2b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f12600098a0 tx=0x7f1260009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:39.588 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.867+0000 7f1274dd9700 1 -- 172.21.15.57:0/2203179634 shutdown_connections 2023-03-02T10:48:39.588 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.867+0000 7f1274dd9700 1 --2- 172.21.15.57:0/2203179634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127007a2b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:39.588 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.867+0000 7f1274dd9700 1 -- 172.21.15.57:0/2203179634 >> 172.21.15.57:0/2203179634 conn(0x7f12701009b0 msgr2=0x7f1270102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:39.588 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.867+0000 7f1274dd9700 1 -- 172.21.15.57:0/2203179634 shutdown_connections 2023-03-02T10:48:39.589 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.868+0000 7f1274dd9700 1 -- 172.21.15.57:0/2203179634 wait complete. 2023-03-02T10:48:39.589 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.869+0000 7f1274dd9700 1 Processor -- start 2023-03-02T10:48:39.589 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.869+0000 7f1274dd9700 1 -- start start 2023-03-02T10:48:39.589 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.869+0000 7f1274dd9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127019b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:39.589 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.869+0000 7f1274dd9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127019b770 con 0x7f127007bdc0 2023-03-02T10:48:39.589 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.869+0000 7f126e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127019b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:39.589 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.869+0000 7f126e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127019b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45274/0 (socket says 172.21.15.57:45274) 2023-03-02T10:48:39.589 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.869+0000 7f126e59c700 1 -- 172.21.15.57:0/4107853032 learned_addr learned my addr 172.21.15.57:0/4107853032 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:39.590 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.870+0000 7f126e59c700 1 -- 172.21.15.57:0/4107853032 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1260009550 con 0x7f127007bdc0 2023-03-02T10:48:39.590 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.870+0000 7f126e59c700 1 --2- 172.21.15.57:0/4107853032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127019b230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1260003e60 tx=0x7f1260011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:39.590 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.870+0000 7f125f7fe700 1 -- 172.21.15.57:0/4107853032 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1260003a60 con 0x7f127007bdc0 2023-03-02T10:48:39.590 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.870+0000 7f125f7fe700 1 -- 172.21.15.57:0/4107853032 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1260003bc0 con 0x7f127007bdc0 2023-03-02T10:48:39.590 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.870+0000 7f1274dd9700 1 -- 172.21.15.57:0/4107853032 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127010b860 con 0x7f127007bdc0 2023-03-02T10:48:39.590 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.870+0000 7f125f7fe700 1 -- 172.21.15.57:0/4107853032 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12600196c0 con 0x7f127007bdc0 2023-03-02T10:48:39.590 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.870+0000 7f1274dd9700 1 -- 172.21.15.57:0/4107853032 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127010b6d0 con 0x7f127007bdc0 2023-03-02T10:48:39.591 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.871+0000 7f125f7fe700 1 -- 172.21.15.57:0/4107853032 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f1260017020 con 0x7f127007bdc0 2023-03-02T10:48:39.591 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.871+0000 7f1274dd9700 1 -- 172.21.15.57:0/4107853032 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127010b9f0 con 0x7f127007bdc0 2023-03-02T10:48:39.591 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.872+0000 7f125f7fe700 1 --2- 172.21.15.57:0/4107853032 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1258036850 0x7f1258038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:39.591 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.872+0000 7f125f7fe700 1 -- 172.21.15.57:0/4107853032 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f126004a0c0 con 0x7f127007bdc0 2023-03-02T10:48:39.591 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.872+0000 7f126dd9b700 1 --2- 172.21.15.57:0/4107853032 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1258036850 0x7f1258038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:39.591 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.872+0000 7f126dd9b700 1 --2- 172.21.15.57:0/4107853032 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1258036850 0x7f1258038d00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1264006fd0 tx=0x7f1264006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:39.591 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:38.876+0000 7f125f7fe700 1 -- 172.21.15.57:0/4107853032 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f1260010c00 con 0x7f127007bdc0 2023-03-02T10:48:39.591 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.073+0000 7f1274dd9700 1 -- 172.21.15.57:0/4107853032 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f127019eec0 con 0x7f127007bdc0 2023-03-02T10:48:39.592 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.077+0000 7f125f7fe700 1 -- 172.21.15.57:0/4107853032 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f12600107f0 con 0x7f127007bdc0 2023-03-02T10:48:39.592 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.080+0000 7f1274dd9700 1 -- 172.21.15.57:0/4107853032 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1258036850 msgr2=0x7f1258038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:39.592 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.080+0000 7f1274dd9700 1 --2- 172.21.15.57:0/4107853032 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1258036850 0x7f1258038d00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1264006fd0 tx=0x7f1264006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:39.592 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.080+0000 7f1274dd9700 1 -- 172.21.15.57:0/4107853032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 msgr2=0x7f127019b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:39.592 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.080+0000 7f1274dd9700 1 --2- 172.21.15.57:0/4107853032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127019b230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1260003e60 tx=0x7f1260011a30 comp rx=0 tx=0).stop 2023-03-02T10:48:39.592 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.080+0000 7f1274dd9700 1 -- 172.21.15.57:0/4107853032 shutdown_connections 2023-03-02T10:48:39.592 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.080+0000 7f1274dd9700 1 --2- 172.21.15.57:0/4107853032 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f1258036850 0x7f1258038d00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:39.592 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.080+0000 7f1274dd9700 1 --2- 172.21.15.57:0/4107853032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127007bdc0 0x7f127019b230 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:39.593 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.080+0000 7f1274dd9700 1 -- 172.21.15.57:0/4107853032 >> 172.21.15.57:0/4107853032 conn(0x7f12701009b0 msgr2=0x7f1270101750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:39.593 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.081+0000 7f1274dd9700 1 -- 172.21.15.57:0/4107853032 shutdown_connections 2023-03-02T10:48:39.593 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:39.081+0000 7f1274dd9700 1 -- 172.21.15.57:0/4107853032 wait complete. 2023-03-02T10:48:39.593 INFO:teuthology.orchestra.run.smithi057.stdout:Enabling the dashboard module... 2023-03-02T10:48:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:39 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:39 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/4107853032' entity='client.admin' 2023-03-02T10:48:41.534 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:41 smithi057 ceph-mon[92072]: from='mgr.14120 172.21.15.57:0/2248068408' entity='mgr.x' 2023-03-02T10:48:41.534 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:41 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/4258227210' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-03-02T10:48:41.535 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:41 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: ignoring --setuser ceph since I am not root 2023-03-02T10:48:41.535 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:41 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: ignoring --setgroup ceph since I am not root 2023-03-02T10:48:41.535 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:41 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:41.517+0000 7f9867821200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-02T10:48:41.808 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:41 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:41.624+0000 7f9867821200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-02T10:48:41.809 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:41 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:41.733+0000 7f9867821200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-02T10:48:41.956 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.058+0000 7ff787964700 1 Processor -- start 2023-03-02T10:48:41.957 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.058+0000 7ff787964700 1 -- start start 2023-03-02T10:48:41.957 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.058+0000 7ff787964700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780104650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:41.957 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.059+0000 7ff787964700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780104b90 con 0x7ff780104240 2023-03-02T10:48:41.957 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.059+0000 7ff785700700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780104650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:41.957 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.059+0000 7ff785700700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780104650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45290/0 (socket says 172.21.15.57:45290) 2023-03-02T10:48:41.957 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.059+0000 7ff785700700 1 -- 172.21.15.57:0/644257661 learned_addr learned my addr 172.21.15.57:0/644257661 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:41.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.059+0000 7ff785700700 1 -- 172.21.15.57:0/644257661 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780104cd0 con 0x7ff780104240 2023-03-02T10:48:41.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.059+0000 7ff785700700 1 --2- 172.21.15.57:0/644257661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780104650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0098a0 tx=0x7ff77c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fd2b3a6650edf server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:41.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.060+0000 7ff777fff700 1 -- 172.21.15.57:0/644257661 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff77c004160 con 0x7ff780104240 2023-03-02T10:48:41.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.060+0000 7ff777fff700 1 -- 172.21.15.57:0/644257661 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff77c0042c0 con 0x7ff780104240 2023-03-02T10:48:41.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.060+0000 7ff777fff700 1 -- 172.21.15.57:0/644257661 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff77c0119b0 con 0x7ff780104240 2023-03-02T10:48:41.958 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.060+0000 7ff787964700 1 -- 172.21.15.57:0/644257661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 msgr2=0x7ff780104650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:41.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.060+0000 7ff787964700 1 --2- 172.21.15.57:0/644257661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780104650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0098a0 tx=0x7ff77c009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:41.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.060+0000 7ff787964700 1 -- 172.21.15.57:0/644257661 shutdown_connections 2023-03-02T10:48:41.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.060+0000 7ff787964700 1 --2- 172.21.15.57:0/644257661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780104650 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:41.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.060+0000 7ff787964700 1 -- 172.21.15.57:0/644257661 >> 172.21.15.57:0/644257661 conn(0x7ff7800ff8a0 msgr2=0x7ff780101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:41.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.060+0000 7ff787964700 1 -- 172.21.15.57:0/644257661 shutdown_connections 2023-03-02T10:48:41.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.061+0000 7ff787964700 1 -- 172.21.15.57:0/644257661 wait complete. 2023-03-02T10:48:41.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.061+0000 7ff787964700 1 Processor -- start 2023-03-02T10:48:41.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.062+0000 7ff787964700 1 -- start start 2023-03-02T10:48:41.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.062+0000 7ff787964700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:41.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.062+0000 7ff787964700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7801994c0 con 0x7ff780104240 2023-03-02T10:48:41.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.062+0000 7ff785700700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:41.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.062+0000 7ff785700700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45292/0 (socket says 172.21.15.57:45292) 2023-03-02T10:48:41.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.062+0000 7ff785700700 1 -- 172.21.15.57:0/4258227210 learned_addr learned my addr 172.21.15.57:0/4258227210 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:41.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.062+0000 7ff785700700 1 -- 172.21.15.57:0/4258227210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c009550 con 0x7ff780104240 2023-03-02T10:48:41.960 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.063+0000 7ff785700700 1 --2- 172.21.15.57:0/4258227210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780198f80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff77c003e60 tx=0x7ff77c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:41.961 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.063+0000 7ff7767fc700 1 -- 172.21.15.57:0/4258227210 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff77c003970 con 0x7ff780104240 2023-03-02T10:48:41.961 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.063+0000 7ff7767fc700 1 -- 172.21.15.57:0/4258227210 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff77c003ad0 con 0x7ff780104240 2023-03-02T10:48:41.961 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.063+0000 7ff787964700 1 -- 172.21.15.57:0/4258227210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff780106310 con 0x7ff780104240 2023-03-02T10:48:41.961 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.063+0000 7ff7767fc700 1 -- 172.21.15.57:0/4258227210 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff77c0195e0 con 0x7ff780104240 2023-03-02T10:48:41.961 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.063+0000 7ff787964700 1 -- 172.21.15.57:0/4258227210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff780106180 con 0x7ff780104240 2023-03-02T10:48:41.961 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.064+0000 7ff7767fc700 1 -- 172.21.15.57:0/4258227210 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7ff77c02a020 con 0x7ff780104240 2023-03-02T10:48:41.961 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.064+0000 7ff787964700 1 -- 172.21.15.57:0/4258227210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff780108700 con 0x7ff780104240 2023-03-02T10:48:41.962 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.064+0000 7ff7767fc700 1 --2- 172.21.15.57:0/4258227210 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7ff76c0367d0 0x7ff76c038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:41.962 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.064+0000 7ff7767fc700 1 -- 172.21.15.57:0/4258227210 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff77c049d80 con 0x7ff780104240 2023-03-02T10:48:41.962 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.065+0000 7ff784eff700 1 --2- 172.21.15.57:0/4258227210 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7ff76c0367d0 0x7ff76c038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:41.962 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.065+0000 7ff784eff700 1 --2- 172.21.15.57:0/4258227210 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7ff76c0367d0 0x7ff76c038c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff770006fd0 tx=0x7ff770006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:41.962 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.069+0000 7ff7767fc700 1 -- 172.21.15.57:0/4258227210 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7ff77c023b80 con 0x7ff780104240 2023-03-02T10:48:41.962 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:40.326+0000 7ff787964700 1 -- 172.21.15.57:0/4258227210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7ff78019cba0 con 0x7ff780104240 2023-03-02T10:48:41.962 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.278+0000 7ff7767fc700 1 -- 172.21.15.57:0/4258227210 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 9) v1 ==== 43522+0+0 (secure 0 0 0) 0x7ff77c017020 con 0x7ff780104240 2023-03-02T10:48:41.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.279+0000 7ff7767fc700 1 -- 172.21.15.57:0/4258227210 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7ff77c040930 con 0x7ff780104240 2023-03-02T10:48:41.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.281+0000 7ff787964700 1 -- 172.21.15.57:0/4258227210 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7ff76c0367d0 msgr2=0x7ff76c038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:41.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.281+0000 7ff787964700 1 --2- 172.21.15.57:0/4258227210 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7ff76c0367d0 0x7ff76c038c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff770006fd0 tx=0x7ff770006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:41.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.281+0000 7ff787964700 1 -- 172.21.15.57:0/4258227210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 msgr2=0x7ff780198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:41.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.281+0000 7ff787964700 1 --2- 172.21.15.57:0/4258227210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780198f80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff77c003e60 tx=0x7ff77c011aa0 comp rx=0 tx=0).stop 2023-03-02T10:48:41.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.282+0000 7ff787964700 1 -- 172.21.15.57:0/4258227210 shutdown_connections 2023-03-02T10:48:41.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.282+0000 7ff787964700 1 --2- 172.21.15.57:0/4258227210 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7ff76c0367d0 0x7ff76c038c80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:41.963 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.282+0000 7ff787964700 1 --2- 172.21.15.57:0/4258227210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff780104240 0x7ff780198f80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:41.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.282+0000 7ff787964700 1 -- 172.21.15.57:0/4258227210 >> 172.21.15.57:0/4258227210 conn(0x7ff7800ff8a0 msgr2=0x7ff7800798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:41.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.282+0000 7ff787964700 1 -- 172.21.15.57:0/4258227210 shutdown_connections 2023-03-02T10:48:41.964 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:41.282+0000 7ff787964700 1 -- 172.21.15.57:0/4258227210 wait complete. 2023-03-02T10:48:42.112 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:41 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:41.843+0000 7f9867821200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-02T10:48:42.112 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:42 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:42.053+0000 7f9867821200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-02T10:48:42.390 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:42 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/4258227210' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-03-02T10:48:42.390 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:42 smithi057 ceph-mon[92072]: mgrmap e9: x(active, since 16s) 2023-03-02T10:48:42.827 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:42 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:42.441+0000 7f9867821200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-02T10:48:42.828 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:42 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:42.541+0000 7f9867821200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-02T10:48:42.828 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:42 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:42.689+0000 7f9867821200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-02T10:48:42.828 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:42 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:42.826+0000 7f9867821200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-02T10:48:43.388 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2023-03-02T10:48:43.389 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-03-02T10:48:43.389 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "available": true, 2023-03-02T10:48:43.389 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-03-02T10:48:43.390 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-03-02T10:48:43.390 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2023-03-02T10:48:43.390 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.698+0000 7fbcbfcd1700 1 Processor -- start 2023-03-02T10:48:43.391 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.698+0000 7fbcbfcd1700 1 -- start start 2023-03-02T10:48:43.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.698+0000 7fbcbfcd1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8105760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:43.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.698+0000 7fbcbfcd1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8105ca0 con 0x7fbcb8105350 2023-03-02T10:48:43.397 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.699+0000 7fbcbda6d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8105760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:43.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.699+0000 7fbcbda6d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8105760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45304/0 (socket says 172.21.15.57:45304) 2023-03-02T10:48:43.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.699+0000 7fbcbda6d700 1 -- 172.21.15.57:0/2875042643 learned_addr learned my addr 172.21.15.57:0/2875042643 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:43.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.699+0000 7fbcbda6d700 1 -- 172.21.15.57:0/2875042643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb8105de0 con 0x7fbcb8105350 2023-03-02T10:48:43.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.699+0000 7fbcbda6d700 1 --2- 172.21.15.57:0/2875042643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8105760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40098a0 tx=0x7fbcb4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b74ab9543bff2a server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:43.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.699+0000 7fbcbca6b700 1 -- 172.21.15.57:0/2875042643 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4004160 con 0x7fbcb8105350 2023-03-02T10:48:43.398 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.699+0000 7fbcbca6b700 1 -- 172.21.15.57:0/2875042643 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbcb40042c0 con 0x7fbcb8105350 2023-03-02T10:48:43.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.699+0000 7fbcbca6b700 1 -- 172.21.15.57:0/2875042643 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcb40119b0 con 0x7fbcb8105350 2023-03-02T10:48:43.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.700+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/2875042643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 msgr2=0x7fbcb8105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:43.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.700+0000 7fbcbfcd1700 1 --2- 172.21.15.57:0/2875042643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8105760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40098a0 tx=0x7fbcb4009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:43.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.700+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/2875042643 shutdown_connections 2023-03-02T10:48:43.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.700+0000 7fbcbfcd1700 1 --2- 172.21.15.57:0/2875042643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8105760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:43.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.700+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/2875042643 >> 172.21.15.57:0/2875042643 conn(0x7fbcb81009b0 msgr2=0x7fbcb8102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:43.399 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.700+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/2875042643 shutdown_connections 2023-03-02T10:48:43.400 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.700+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/2875042643 wait complete. 2023-03-02T10:48:43.400 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.701+0000 7fbcbfcd1700 1 Processor -- start 2023-03-02T10:48:43.400 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.701+0000 7fbcbfcd1700 1 -- start start 2023-03-02T10:48:43.400 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.701+0000 7fbcbfcd1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:43.400 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.701+0000 7fbcbfcd1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8199550 con 0x7fbcb8105350 2023-03-02T10:48:43.400 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.701+0000 7fbcbda6d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:43.400 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.701+0000 7fbcbda6d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45310/0 (socket says 172.21.15.57:45310) 2023-03-02T10:48:43.401 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.701+0000 7fbcbda6d700 1 -- 172.21.15.57:0/69625014 learned_addr learned my addr 172.21.15.57:0/69625014 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:43.401 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.701+0000 7fbcbda6d700 1 -- 172.21.15.57:0/69625014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb4009550 con 0x7fbcb8105350 2023-03-02T10:48:43.401 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.702+0000 7fbcbda6d700 1 --2- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8199010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4003f00 tx=0x7fbcb4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:43.401 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.702+0000 7fbcaeffd700 1 -- 172.21.15.57:0/69625014 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4003b20 con 0x7fbcb8105350 2023-03-02T10:48:43.401 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.702+0000 7fbcaeffd700 1 -- 172.21.15.57:0/69625014 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbcb4003c80 con 0x7fbcb8105350 2023-03-02T10:48:43.402 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.702+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/69625014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb8107420 con 0x7fbcb8105350 2023-03-02T10:48:43.402 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.702+0000 7fbcaeffd700 1 -- 172.21.15.57:0/69625014 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4019770 con 0x7fbcb8105350 2023-03-02T10:48:43.402 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.702+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/69625014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb8107290 con 0x7fbcb8105350 2023-03-02T10:48:43.403 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.703+0000 7fbcaeffd700 1 -- 172.21.15.57:0/69625014 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 43522+0+0 (secure 0 0 0) 0x7fbcb402c070 con 0x7fbcb8105350 2023-03-02T10:48:43.403 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.703+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/69625014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb8109810 con 0x7fbcb8105350 2023-03-02T10:48:43.403 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.703+0000 7fbcaeffd700 1 --2- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbca40368c0 0x7fbca4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:43.403 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.703+0000 7fbcaeffd700 1 -- 172.21.15.57:0/69625014 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbcb4049ee0 con 0x7fbcb8105350 2023-03-02T10:48:43.404 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.703+0000 7fbcbd26c700 1 -- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbca40368c0 msgr2=0x7fbca4038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3127649723 2023-03-02T10:48:43.404 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.703+0000 7fbcbd26c700 1 --2- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbca40368c0 0x7fbca4038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-02T10:48:43.404 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.708+0000 7fbcaeffd700 1 -- 172.21.15.57:0/69625014 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fbcb402d9a0 con 0x7fbcb8105350 2023-03-02T10:48:43.405 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.904+0000 7fbcbd26c700 1 -- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbca40368c0 msgr2=0x7fbca4038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3127649723 2023-03-02T10:48:43.405 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.904+0000 7fbcbd26c700 1 --2- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbca40368c0 0x7fbca4038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-02T10:48:43.405 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.990+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/69625014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fbcb819cc50 con 0x7fbcb8105350 2023-03-02T10:48:43.405 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.990+0000 7fbcaeffd700 1 -- 172.21.15.57:0/69625014 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fbcb402d350 con 0x7fbcb8105350 2023-03-02T10:48:43.405 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.992+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbca40368c0 msgr2=0x7fbca4038d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-02T10:48:43.405 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.992+0000 7fbcbfcd1700 1 --2- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbca40368c0 0x7fbca4038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:43.406 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.992+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 msgr2=0x7fbcb8199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:43.406 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.992+0000 7fbcbfcd1700 1 --2- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8199010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4003f00 tx=0x7fbcb4011a30 comp rx=0 tx=0).stop 2023-03-02T10:48:43.406 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.992+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/69625014 shutdown_connections 2023-03-02T10:48:43.406 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.992+0000 7fbcbfcd1700 1 --2- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7fbca40368c0 0x7fbca4038d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:43.406 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.992+0000 7fbcbfcd1700 1 --2- 172.21.15.57:0/69625014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcb8105350 0x7fbcb8199010 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:43.407 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.992+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/69625014 >> 172.21.15.57:0/69625014 conn(0x7fbcb81009b0 msgr2=0x7fbcb8101710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:43.407 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.992+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/69625014 shutdown_connections 2023-03-02T10:48:43.407 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:42.992+0000 7fbcbfcd1700 1 -- 172.21.15.57:0/69625014 wait complete. 2023-03-02T10:48:43.407 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for the mgr to restart... 2023-03-02T10:48:43.407 INFO:teuthology.orchestra.run.smithi057.stdout:Waiting for mgr epoch 9... 2023-03-02T10:48:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:43 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/69625014' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-03-02T10:48:43.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:43 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:43.317+0000 7f9867821200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-02T10:48:44.432 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:43 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:43.997+0000 7f9867821200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-02T10:48:44.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:44 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:44.184+0000 7f9867821200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-02T10:48:45.355 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:45 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:45.047+0000 7f9867821200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:48:45.355 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:45 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:45.154+0000 7f9867821200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-02T10:48:45.682 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:45 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:45.353+0000 7f9867821200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:48:45.683 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:45 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:45.574+0000 7f9867821200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-02T10:48:46.182 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:45 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:45.748+0000 7f9867821200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-02T10:48:46.682 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:46 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:46.201+0000 7f9867821200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-02T10:48:47.182 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:46 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:46.840+0000 7f9867821200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-02T10:48:47.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:47 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:47.181+0000 7f9867821200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-02T10:48:47.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:47 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:47.409+0000 7f9867821200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-02T10:48:47.797 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:47 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:47.544+0000 7f9867821200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-02T10:48:48.182 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:47 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:47.796+0000 7f9867821200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-02T10:48:49.181 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:48:48 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:48:48.776+0000 7f9867821200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-02T10:48:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:49 smithi057 ceph-mon[92072]: Active manager daemon x restarted 2023-03-02T10:48:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:49 smithi057 ceph-mon[92072]: Activating manager daemon x 2023-03-02T10:48:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:49 smithi057 ceph-mon[92072]: osdmap e3: 0 total, 0 up, 0 in 2023-03-02T10:48:50.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:50 smithi057 ceph-mon[92072]: mgrmap e10: x(active, starting, since 0.407519s) 2023-03-02T10:48:50.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:48:50.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-02T10:48:50.443 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-02T10:48:50.443 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-02T10:48:50.443 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-02T10:48:50.443 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:50 smithi057 ceph-mon[92072]: Manager daemon x is now available 2023-03-02T10:48:50.443 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:48:50.443 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:48:50.443 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-02T10:48:50.443 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-02T10:48:50.781 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout { 2023-03-02T10:48:50.781 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-03-02T10:48:50.782 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout "initialized": true 2023-03-02T10:48:50.782 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout } 2023-03-02T10:48:50.782 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.951+0000 7f9eb9522700 1 Processor -- start 2023-03-02T10:48:50.782 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.951+0000 7f9eb9522700 1 -- start start 2023-03-02T10:48:50.783 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.952+0000 7f9eb9522700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb4108220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:50.783 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.952+0000 7f9eb9522700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb4079d40 con 0x7f9eb4105e40 2023-03-02T10:48:50.783 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.952+0000 7f9eb2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb4108220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:50.784 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.952+0000 7f9eb2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb4108220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45324/0 (socket says 172.21.15.57:45324) 2023-03-02T10:48:50.784 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.952+0000 7f9eb2ffd700 1 -- 172.21.15.57:0/3227909808 learned_addr learned my addr 172.21.15.57:0/3227909808 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:50.784 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.952+0000 7f9eb2ffd700 1 -- 172.21.15.57:0/3227909808 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4079e80 con 0x7f9eb4105e40 2023-03-02T10:48:50.784 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.952+0000 7f9eb2ffd700 1 --2- 172.21.15.57:0/3227909808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb4108220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40098a0 tx=0x7f9ea4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeed68da8d4adf48 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:50.784 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.952+0000 7f9eb1ffb700 1 -- 172.21.15.57:0/3227909808 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ea4004160 con 0x7f9eb4105e40 2023-03-02T10:48:50.784 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.953+0000 7f9eb1ffb700 1 -- 172.21.15.57:0/3227909808 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ea40042c0 con 0x7f9eb4105e40 2023-03-02T10:48:50.784 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.953+0000 7f9eb1ffb700 1 -- 172.21.15.57:0/3227909808 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ea40119b0 con 0x7f9eb4105e40 2023-03-02T10:48:50.784 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.953+0000 7f9eb9522700 1 -- 172.21.15.57:0/3227909808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 msgr2=0x7f9eb4108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:50.785 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.953+0000 7f9eb9522700 1 --2- 172.21.15.57:0/3227909808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb4108220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40098a0 tx=0x7f9ea4009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:50.785 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.953+0000 7f9eb9522700 1 -- 172.21.15.57:0/3227909808 shutdown_connections 2023-03-02T10:48:50.785 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.953+0000 7f9eb9522700 1 --2- 172.21.15.57:0/3227909808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb4108220 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:50.785 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.953+0000 7f9eb9522700 1 -- 172.21.15.57:0/3227909808 >> 172.21.15.57:0/3227909808 conn(0x7f9eb40ff8a0 msgr2=0x7f9eb4101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:50.785 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.953+0000 7f9eb9522700 1 -- 172.21.15.57:0/3227909808 shutdown_connections 2023-03-02T10:48:50.785 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.953+0000 7f9eb9522700 1 -- 172.21.15.57:0/3227909808 wait complete. 2023-03-02T10:48:50.785 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.954+0000 7f9eb9522700 1 Processor -- start 2023-03-02T10:48:50.786 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.954+0000 7f9eb9522700 1 -- start start 2023-03-02T10:48:50.786 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.954+0000 7f9eb9522700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:50.786 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.954+0000 7f9eb9522700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb419b670 con 0x7f9eb4105e40 2023-03-02T10:48:50.786 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.954+0000 7f9eb2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:50.786 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.954+0000 7f9eb2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb419b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45336/0 (socket says 172.21.15.57:45336) 2023-03-02T10:48:50.786 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.954+0000 7f9eb2ffd700 1 -- 172.21.15.57:0/830359683 learned_addr learned my addr 172.21.15.57:0/830359683 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:50.786 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.955+0000 7f9eb2ffd700 1 -- 172.21.15.57:0/830359683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea4009550 con 0x7f9eb4105e40 2023-03-02T10:48:50.787 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.955+0000 7f9eb2ffd700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb419b130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4003e60 tx=0x7f9ea4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:50.787 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.955+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ea4003970 con 0x7f9eb4105e40 2023-03-02T10:48:50.787 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.955+0000 7f9eb9522700 1 -- 172.21.15.57:0/830359683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb4109600 con 0x7f9eb4105e40 2023-03-02T10:48:50.787 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.955+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ea4003ad0 con 0x7f9eb4105e40 2023-03-02T10:48:50.787 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.955+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ea40195e0 con 0x7f9eb4105e40 2023-03-02T10:48:50.787 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.955+0000 7f9eb9522700 1 -- 172.21.15.57:0/830359683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb4109470 con 0x7f9eb4105e40 2023-03-02T10:48:50.787 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.956+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 43522+0+0 (secure 0 0 0) 0x7f9ea402a020 con 0x7f9eb4105e40 2023-03-02T10:48:50.787 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.957+0000 7f9e9bfff700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 0x7f9e9c038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:50.788 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.957+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 --> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e9c0393e0 con 0x7f9e9c036820 2023-03-02T10:48:50.788 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.957+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9ea4049f00 con 0x7f9eb4105e40 2023-03-02T10:48:50.788 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.957+0000 7f9eb27fc700 1 -- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 msgr2=0x7f9e9c038cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3127649723 2023-03-02T10:48:50.788 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:43.957+0000 7f9eb27fc700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 0x7f9e9c038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-02T10:48:50.788 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:44.158+0000 7f9eb27fc700 1 -- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 msgr2=0x7f9e9c038cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3127649723 2023-03-02T10:48:50.788 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:44.158+0000 7f9eb27fc700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 0x7f9e9c038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-02T10:48:50.788 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:44.559+0000 7f9eb27fc700 1 -- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 msgr2=0x7f9e9c038cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3127649723 2023-03-02T10:48:50.788 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:44.559+0000 7f9eb27fc700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 0x7f9e9c038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-02T10:48:50.789 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:45.360+0000 7f9eb27fc700 1 -- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 msgr2=0x7f9e9c038cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3127649723 2023-03-02T10:48:50.789 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:45.360+0000 7f9eb27fc700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 0x7f9e9c038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-03-02T10:48:50.789 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:46.961+0000 7f9eb27fc700 1 -- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 msgr2=0x7f9e9c038cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/3127649723 2023-03-02T10:48:50.789 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:46.961+0000 7f9eb27fc700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 0x7f9e9c038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-03-02T10:48:50.789 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:49.185+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mgrmap(e 10) v1 ==== 43332+0+0 (secure 0 0 0) 0x7f9ea4017020 con 0x7f9eb4105e40 2023-03-02T10:48:50.789 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:49.185+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 msgr2=0x7f9e9c038cd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-02T10:48:50.789 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:49.185+0000 7f9e9bfff700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 0x7f9e9c038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:50.790 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.192+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 11) v1 ==== 43442+0+0 (secure 0 0 0) 0x7f9ea400f050 con 0x7f9eb4105e40 2023-03-02T10:48:50.790 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.192+0000 7f9e9bfff700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f9e9c03a240 0x7f9e9c03c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:50.790 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.193+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e9c0393e0 con 0x7f9e9c03a240 2023-03-02T10:48:50.790 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.193+0000 7f9eb27fc700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f9e9c03a240 0x7f9e9c03c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:50.790 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.194+0000 7f9eb27fc700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f9e9c03a240 0x7f9e9c03c620 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8003a10 tx=0x7f9ea80092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:50.790 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.195+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f9e9c0393e0 con 0x7f9e9c03a240 2023-03-02T10:48:50.790 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.202+0000 7f9eb9522700 1 -- 172.21.15.57:0/830359683 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f9eb419b7b0 con 0x7f9e9c03a240 2023-03-02T10:48:50.790 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.202+0000 7f9e9bfff700 1 -- 172.21.15.57:0/830359683 <== mgr.14152 v2:172.21.15.57:6800/1987811557 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f9ea800a050 con 0x7f9e9c03a240 2023-03-02T10:48:50.791 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.202+0000 7f9eb9522700 1 -- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f9e9c03a240 msgr2=0x7f9e9c03c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:50.791 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.202+0000 7f9eb9522700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f9e9c03a240 0x7f9e9c03c620 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8003a10 tx=0x7f9ea80092b0 comp rx=0 tx=0).stop 2023-03-02T10:48:50.791 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.202+0000 7f9eb9522700 1 -- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 msgr2=0x7f9eb419b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:50.791 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.202+0000 7f9eb9522700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb419b130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4003e60 tx=0x7f9ea4011aa0 comp rx=0 tx=0).stop 2023-03-02T10:48:50.791 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.203+0000 7f9eb9522700 1 -- 172.21.15.57:0/830359683 shutdown_connections 2023-03-02T10:48:50.791 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.203+0000 7f9eb9522700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f9e9c03a240 0x7f9e9c03c620 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:50.791 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.203+0000 7f9eb9522700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eb4105e40 0x7f9eb419b130 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:50.792 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.203+0000 7f9eb9522700 1 --2- 172.21.15.57:0/830359683 >> [v2:172.21.15.57:6800/3127649723,v1:172.21.15.57:6801/3127649723] conn(0x7f9e9c036820 0x7f9e9c038cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:50.792 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.203+0000 7f9eb9522700 1 -- 172.21.15.57:0/830359683 >> 172.21.15.57:0/830359683 conn(0x7f9eb40ff8a0 msgr2=0x7f9eb41005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:50.792 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.203+0000 7f9eb9522700 1 -- 172.21.15.57:0/830359683 shutdown_connections 2023-03-02T10:48:50.792 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:50.203+0000 7f9eb9522700 1 -- 172.21.15.57:0/830359683 wait complete. 2023-03-02T10:48:50.792 INFO:teuthology.orchestra.run.smithi057.stdout:mgr epoch 9 is available 2023-03-02T10:48:50.793 INFO:teuthology.orchestra.run.smithi057.stdout:Generating a dashboard self-signed certificate... 2023-03-02T10:48:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:51 smithi057 ceph-mon[92072]: mgrmap e11: x(active, since 1.41637s) 2023-03-02T10:48:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:51 smithi057 ceph-mon[92072]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-03-02T10:48:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:51 smithi057 ceph-mon[92072]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-03-02T10:48:52.292 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-03-02T10:48:52.292 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.427+0000 7f5ccad8f700 1 Processor -- start 2023-03-02T10:48:52.293 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.427+0000 7f5ccad8f700 1 -- start start 2023-03-02T10:48:52.293 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.428+0000 7f5ccad8f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4105760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:52.293 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.428+0000 7f5ccad8f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4105ca0 con 0x7f5cc4105350 2023-03-02T10:48:52.293 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.428+0000 7f5cc8b2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4105760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:52.293 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.428+0000 7f5cc8b2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4105760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55034/0 (socket says 172.21.15.57:55034) 2023-03-02T10:48:52.294 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.428+0000 7f5cc8b2b700 1 -- 172.21.15.57:0/2588407229 learned_addr learned my addr 172.21.15.57:0/2588407229 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:52.294 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.428+0000 7f5cc8b2b700 1 -- 172.21.15.57:0/2588407229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4105de0 con 0x7f5cc4105350 2023-03-02T10:48:52.294 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.429+0000 7f5cc8b2b700 1 --2- 172.21.15.57:0/2588407229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4105760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80098a0 tx=0x7f5cb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca500ff6f3536269 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:52.294 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.429+0000 7f5cc37fe700 1 -- 172.21.15.57:0/2588407229 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cb8004160 con 0x7f5cc4105350 2023-03-02T10:48:52.294 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.429+0000 7f5cc37fe700 1 -- 172.21.15.57:0/2588407229 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5cb80042c0 con 0x7f5cc4105350 2023-03-02T10:48:52.294 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.429+0000 7f5cc37fe700 1 -- 172.21.15.57:0/2588407229 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cb80119b0 con 0x7f5cc4105350 2023-03-02T10:48:52.294 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.429+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2588407229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 msgr2=0x7f5cc4105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:52.295 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.429+0000 7f5ccad8f700 1 --2- 172.21.15.57:0/2588407229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4105760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80098a0 tx=0x7f5cb8009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:52.295 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.429+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2588407229 shutdown_connections 2023-03-02T10:48:52.295 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.429+0000 7f5ccad8f700 1 --2- 172.21.15.57:0/2588407229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4105760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:52.295 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.429+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2588407229 >> 172.21.15.57:0/2588407229 conn(0x7f5cc41009b0 msgr2=0x7f5cc4102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:52.295 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.429+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2588407229 shutdown_connections 2023-03-02T10:48:52.295 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.429+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2588407229 wait complete. 2023-03-02T10:48:52.295 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.430+0000 7f5ccad8f700 1 Processor -- start 2023-03-02T10:48:52.295 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.431+0000 7f5ccad8f700 1 -- start start 2023-03-02T10:48:52.296 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.431+0000 7f5ccad8f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:52.296 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.431+0000 7f5ccad8f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4199550 con 0x7f5cc4105350 2023-03-02T10:48:52.296 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.431+0000 7f5cc8b2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:52.296 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.431+0000 7f5cc8b2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55038/0 (socket says 172.21.15.57:55038) 2023-03-02T10:48:52.296 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.431+0000 7f5cc8b2b700 1 -- 172.21.15.57:0/2042817233 learned_addr learned my addr 172.21.15.57:0/2042817233 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:52.296 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.431+0000 7f5cc8b2b700 1 -- 172.21.15.57:0/2042817233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8009550 con 0x7f5cc4105350 2023-03-02T10:48:52.296 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.432+0000 7f5cc8b2b700 1 --2- 172.21.15.57:0/2042817233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4199010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8006af0 tx=0x7f5cb8011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:52.298 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.432+0000 7f5cc1ffb700 1 -- 172.21.15.57:0/2042817233 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cb8003a40 con 0x7f5cc4105350 2023-03-02T10:48:52.299 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.432+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2042817233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc4107420 con 0x7f5cc4105350 2023-03-02T10:48:52.299 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.432+0000 7f5cc1ffb700 1 -- 172.21.15.57:0/2042817233 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5cb8003ba0 con 0x7f5cc4105350 2023-03-02T10:48:52.299 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.432+0000 7f5cc1ffb700 1 -- 172.21.15.57:0/2042817233 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cb80196c0 con 0x7f5cc4105350 2023-03-02T10:48:52.299 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.432+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2042817233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc4107290 con 0x7f5cc4105350 2023-03-02T10:48:52.299 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.433+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2042817233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc4109810 con 0x7f5cc4105350 2023-03-02T10:48:52.299 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.433+0000 7f5cc1ffb700 1 -- 172.21.15.57:0/2042817233 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 43522+0+0 (secure 0 0 0) 0x7f5cb802a020 con 0x7f5cc4105350 2023-03-02T10:48:52.299 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.433+0000 7f5cc1ffb700 1 --2- 172.21.15.57:0/2042817233 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5cb4036820 0x7f5cb4038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:52.300 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.433+0000 7f5cc1ffb700 1 -- 172.21.15.57:0/2042817233 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5cb8049e40 con 0x7f5cc4105350 2023-03-02T10:48:52.300 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.433+0000 7f5cc3fff700 1 --2- 172.21.15.57:0/2042817233 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5cb4036820 0x7f5cb4038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:52.300 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.434+0000 7f5cc3fff700 1 --2- 172.21.15.57:0/2042817233 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5cb4036820 0x7f5cb4038cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0006fd0 tx=0x7f5cb0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:52.300 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.442+0000 7f5cc1ffb700 1 -- 172.21.15.57:0/2042817233 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f5cb801aa80 con 0x7f5cc4105350 2023-03-02T10:48:52.300 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.656+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2042817233 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cc4101e20 con 0x7f5cb4036820 2023-03-02T10:48:52.300 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.696+0000 7f5cc1ffb700 1 -- 172.21.15.57:0/2042817233 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f5cc4101e20 con 0x7f5cb4036820 2023-03-02T10:48:52.300 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.698+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2042817233 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5cb4036820 msgr2=0x7f5cb4038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:52.301 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.698+0000 7f5ccad8f700 1 --2- 172.21.15.57:0/2042817233 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5cb4036820 0x7f5cb4038cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0006fd0 tx=0x7f5cb0006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:52.301 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.698+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2042817233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 msgr2=0x7f5cc4199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:52.301 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.698+0000 7f5ccad8f700 1 --2- 172.21.15.57:0/2042817233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4199010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8006af0 tx=0x7f5cb8011a10 comp rx=0 tx=0).stop 2023-03-02T10:48:52.301 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.698+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2042817233 shutdown_connections 2023-03-02T10:48:52.301 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.698+0000 7f5ccad8f700 1 --2- 172.21.15.57:0/2042817233 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5cb4036820 0x7f5cb4038cd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:52.301 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.698+0000 7f5ccad8f700 1 --2- 172.21.15.57:0/2042817233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc4105350 0x7f5cc4199010 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:52.301 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.698+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2042817233 >> 172.21.15.57:0/2042817233 conn(0x7f5cc41009b0 msgr2=0x7f5cc4101710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:52.301 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.699+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2042817233 shutdown_connections 2023-03-02T10:48:52.302 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:51.699+0000 7f5ccad8f700 1 -- 172.21.15.57:0/2042817233 wait complete. 2023-03-02T10:48:52.302 INFO:teuthology.orchestra.run.smithi057.stdout:Creating initial admin user... 2023-03-02T10:48:52.551 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:52 smithi057 ceph-mon[92072]: mgrmap e12: x(active, since 2s) 2023-03-02T10:48:52.551 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:48:52.552 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:48:52.552 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:48:53.456 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:53 smithi057 ceph-mon[92072]: [02/Mar/2023:10:48:51] ENGINE Bus STARTING 2023-03-02T10:48:53.457 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:53 smithi057 ceph-mon[92072]: [02/Mar/2023:10:48:51] ENGINE Serving on https://172.21.15.57:7150 2023-03-02T10:48:53.457 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:53 smithi057 ceph-mon[92072]: [02/Mar/2023:10:48:51] ENGINE Serving on https://172.21.15.57:8765 2023-03-02T10:48:53.457 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:53 smithi057 ceph-mon[92072]: [02/Mar/2023:10:48:51] ENGINE Bus STARTED 2023-03-02T10:48:53.457 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:53 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:48:53.661 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$9cO20jwIeQ1OD3wVYhBukeZMgjy7p.XY9L.StnsKWAZSsAP3PGxMm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1677754133, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-03-02T10:48:53.661 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.770+0000 7f5705d8d700 1 Processor -- start 2023-03-02T10:48:53.661 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.770+0000 7f5705d8d700 1 -- start start 2023-03-02T10:48:53.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.771+0000 7f5705d8d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700107f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:53.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.771+0000 7f5705d8d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5700108470 con 0x7f5700079c60 2023-03-02T10:48:53.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.771+0000 7f56ff7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:53.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.771+0000 7f56ff7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700107f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55048/0 (socket says 172.21.15.57:55048) 2023-03-02T10:48:53.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.771+0000 7f56ff7fe700 1 -- 172.21.15.57:0/2566089965 learned_addr learned my addr 172.21.15.57:0/2566089965 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:53.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.771+0000 7f56ff7fe700 1 -- 172.21.15.57:0/2566089965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57001085b0 con 0x7f5700079c60 2023-03-02T10:48:53.662 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.771+0000 7f56ff7fe700 1 --2- 172.21.15.57:0/2566089965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700107f30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f56f00098a0 tx=0x7f56f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea80cdffb2c1280 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:53.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.772+0000 7f56feffd700 1 -- 172.21.15.57:0/2566089965 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f0004160 con 0x7f5700079c60 2023-03-02T10:48:53.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.772+0000 7f56feffd700 1 -- 172.21.15.57:0/2566089965 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56f00042c0 con 0x7f5700079c60 2023-03-02T10:48:53.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.772+0000 7f56feffd700 1 -- 172.21.15.57:0/2566089965 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f00119b0 con 0x7f5700079c60 2023-03-02T10:48:53.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.772+0000 7f5705d8d700 1 -- 172.21.15.57:0/2566089965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 msgr2=0x7f5700107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:53.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.772+0000 7f5705d8d700 1 --2- 172.21.15.57:0/2566089965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700107f30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f56f00098a0 tx=0x7f56f0009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:53.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.772+0000 7f5705d8d700 1 -- 172.21.15.57:0/2566089965 shutdown_connections 2023-03-02T10:48:53.663 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.772+0000 7f5705d8d700 1 --2- 172.21.15.57:0/2566089965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700107f30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:53.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.772+0000 7f5705d8d700 1 -- 172.21.15.57:0/2566089965 >> 172.21.15.57:0/2566089965 conn(0x7f57000ff8a0 msgr2=0x7f5700101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:53.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.772+0000 7f5705d8d700 1 -- 172.21.15.57:0/2566089965 shutdown_connections 2023-03-02T10:48:53.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.772+0000 7f5705d8d700 1 -- 172.21.15.57:0/2566089965 wait complete. 2023-03-02T10:48:53.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.773+0000 7f5705d8d700 1 Processor -- start 2023-03-02T10:48:53.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.773+0000 7f5705d8d700 1 -- start start 2023-03-02T10:48:53.664 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.773+0000 7f5705d8d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700105890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:53.665 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.773+0000 7f5705d8d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5700105dd0 con 0x7f5700079c60 2023-03-02T10:48:53.665 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.774+0000 7f56ff7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700105890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:53.665 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.774+0000 7f56ff7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700105890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55056/0 (socket says 172.21.15.57:55056) 2023-03-02T10:48:53.665 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.774+0000 7f56ff7fe700 1 -- 172.21.15.57:0/2591566152 learned_addr learned my addr 172.21.15.57:0/2591566152 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:53.665 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.774+0000 7f56ff7fe700 1 -- 172.21.15.57:0/2591566152 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f0009550 con 0x7f5700079c60 2023-03-02T10:48:53.666 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.774+0000 7f56ff7fe700 1 --2- 172.21.15.57:0/2591566152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700105890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f56f0003e60 tx=0x7f56f0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:53.666 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.774+0000 7f56fd7fa700 1 -- 172.21.15.57:0/2591566152 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f0003970 con 0x7f5700079c60 2023-03-02T10:48:53.666 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.774+0000 7f56fd7fa700 1 -- 172.21.15.57:0/2591566152 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56f0003ad0 con 0x7f5700079c60 2023-03-02T10:48:53.666 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.774+0000 7f5705d8d700 1 -- 172.21.15.57:0/2591566152 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57001095e0 con 0x7f5700079c60 2023-03-02T10:48:53.666 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.774+0000 7f56fd7fa700 1 -- 172.21.15.57:0/2591566152 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f00195e0 con 0x7f5700079c60 2023-03-02T10:48:53.666 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.774+0000 7f5705d8d700 1 -- 172.21.15.57:0/2591566152 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5700109450 con 0x7f5700079c60 2023-03-02T10:48:53.666 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.775+0000 7f56fd7fa700 1 -- 172.21.15.57:0/2591566152 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 43522+0+0 (secure 0 0 0) 0x7f56f002a020 con 0x7f5700079c60 2023-03-02T10:48:53.667 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.775+0000 7f5705d8d700 1 -- 172.21.15.57:0/2591566152 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5700061bc0 con 0x7f5700079c60 2023-03-02T10:48:53.667 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.776+0000 7f56fd7fa700 1 --2- 172.21.15.57:0/2591566152 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56ec036820 0x7f56ec038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:53.667 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.776+0000 7f56fd7fa700 1 -- 172.21.15.57:0/2591566152 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f56f0049e80 con 0x7f5700079c60 2023-03-02T10:48:53.667 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.776+0000 7f56f6ffd700 1 --2- 172.21.15.57:0/2591566152 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56ec036820 0x7f56ec038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:53.667 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.776+0000 7f56f6ffd700 1 --2- 172.21.15.57:0/2591566152 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56ec036820 0x7f56ec038cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56e8006fd0 tx=0x7f56e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:53.667 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:52.781+0000 7f56fd7fa700 1 -- 172.21.15.57:0/2591566152 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f56f00198c0 con 0x7f5700079c60 2023-03-02T10:48:53.667 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.011+0000 7f5705d8d700 1 -- 172.21.15.57:0/2591566152 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f57001046a0 con 0x7f56ec036820 2023-03-02T10:48:53.668 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.263+0000 7f56fd7fa700 1 -- 172.21.15.57:0/2591566152 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f57001046a0 con 0x7f56ec036820 2023-03-02T10:48:53.668 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.265+0000 7f5705d8d700 1 -- 172.21.15.57:0/2591566152 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56ec036820 msgr2=0x7f56ec038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:53.668 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.265+0000 7f5705d8d700 1 --2- 172.21.15.57:0/2591566152 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56ec036820 0x7f56ec038cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56e8006fd0 tx=0x7f56e8006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:53.668 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.265+0000 7f5705d8d700 1 -- 172.21.15.57:0/2591566152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 msgr2=0x7f5700105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:53.668 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.265+0000 7f5705d8d700 1 --2- 172.21.15.57:0/2591566152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700105890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f56f0003e60 tx=0x7f56f0011aa0 comp rx=0 tx=0).stop 2023-03-02T10:48:53.668 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.265+0000 7f5705d8d700 1 -- 172.21.15.57:0/2591566152 shutdown_connections 2023-03-02T10:48:53.668 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.265+0000 7f5705d8d700 1 --2- 172.21.15.57:0/2591566152 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56ec036820 0x7f56ec038cd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:53.669 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.265+0000 7f5705d8d700 1 --2- 172.21.15.57:0/2591566152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5700079c60 0x7f5700105890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:53.669 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.265+0000 7f5705d8d700 1 -- 172.21.15.57:0/2591566152 >> 172.21.15.57:0/2591566152 conn(0x7f57000ff8a0 msgr2=0x7f5700100640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:53.669 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.265+0000 7f5705d8d700 1 -- 172.21.15.57:0/2591566152 shutdown_connections 2023-03-02T10:48:53.669 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:53.265+0000 7f5705d8d700 1 -- 172.21.15.57:0/2591566152 wait complete. 2023-03-02T10:48:53.669 INFO:teuthology.orchestra.run.smithi057.stdout:Fetching dashboard port number... 2023-03-02T10:48:54.525 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:54 smithi057 ceph-mon[92072]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:48:54.526 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:54 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:48:54.921 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stdout 8443 2023-03-02T10:48:54.922 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.132+0000 7f07c08e6700 1 Processor -- start 2023-03-02T10:48:54.922 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.132+0000 7f07c08e6700 1 -- start start 2023-03-02T10:48:54.922 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.132+0000 7f07c08e6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc106050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:54.922 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.132+0000 7f07c08e6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc079d40 con 0x7f07bc103c30 2023-03-02T10:48:54.922 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.132+0000 7f07ba59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:54.922 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.132+0000 7f07ba59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55072/0 (socket says 172.21.15.57:55072) 2023-03-02T10:48:54.922 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.132+0000 7f07ba59c700 1 -- 172.21.15.57:0/1601100940 learned_addr learned my addr 172.21.15.57:0/1601100940 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:54.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.133+0000 7f07ba59c700 1 -- 172.21.15.57:0/1601100940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc079e80 con 0x7f07bc103c30 2023-03-02T10:48:54.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.133+0000 7f07ba59c700 1 --2- 172.21.15.57:0/1601100940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc106050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0098a0 tx=0x7f07ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa84cb453e69cd0b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:54.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.133+0000 7f07b959a700 1 -- 172.21.15.57:0/1601100940 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07ac004160 con 0x7f07bc103c30 2023-03-02T10:48:54.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.133+0000 7f07b959a700 1 -- 172.21.15.57:0/1601100940 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07ac0042c0 con 0x7f07bc103c30 2023-03-02T10:48:54.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.133+0000 7f07b959a700 1 -- 172.21.15.57:0/1601100940 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07ac0119b0 con 0x7f07bc103c30 2023-03-02T10:48:54.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.134+0000 7f07c08e6700 1 -- 172.21.15.57:0/1601100940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 msgr2=0x7f07bc106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:54.923 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.134+0000 7f07c08e6700 1 --2- 172.21.15.57:0/1601100940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc106050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0098a0 tx=0x7f07ac009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:54.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.134+0000 7f07c08e6700 1 -- 172.21.15.57:0/1601100940 shutdown_connections 2023-03-02T10:48:54.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.134+0000 7f07c08e6700 1 --2- 172.21.15.57:0/1601100940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc106050 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:54.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.134+0000 7f07c08e6700 1 -- 172.21.15.57:0/1601100940 >> 172.21.15.57:0/1601100940 conn(0x7f07bc0ff8a0 msgr2=0x7f07bc101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:54.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.134+0000 7f07c08e6700 1 -- 172.21.15.57:0/1601100940 shutdown_connections 2023-03-02T10:48:54.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.134+0000 7f07c08e6700 1 -- 172.21.15.57:0/1601100940 wait complete. 2023-03-02T10:48:54.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.136+0000 7f07c08e6700 1 Processor -- start 2023-03-02T10:48:54.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.136+0000 7f07c08e6700 1 -- start start 2023-03-02T10:48:54.924 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.136+0000 7f07c08e6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:54.925 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.136+0000 7f07c08e6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc19fae0 con 0x7f07bc103c30 2023-03-02T10:48:54.925 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.136+0000 7f07ba59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:54.925 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.137+0000 7f07ba59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc19f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55086/0 (socket says 172.21.15.57:55086) 2023-03-02T10:48:54.925 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.137+0000 7f07ba59c700 1 -- 172.21.15.57:0/170547443 learned_addr learned my addr 172.21.15.57:0/170547443 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:54.925 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.137+0000 7f07ba59c700 1 -- 172.21.15.57:0/170547443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac009550 con 0x7f07bc103c30 2023-03-02T10:48:54.925 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.137+0000 7f07ba59c700 1 --2- 172.21.15.57:0/170547443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc19f5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f07ac000c00 tx=0x7f07ac011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:54.925 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.137+0000 7f07ab7fe700 1 -- 172.21.15.57:0/170547443 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07ac0039f0 con 0x7f07bc103c30 2023-03-02T10:48:54.926 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.137+0000 7f07ab7fe700 1 -- 172.21.15.57:0/170547443 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07ac003b50 con 0x7f07bc103c30 2023-03-02T10:48:54.926 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.137+0000 7f07c08e6700 1 -- 172.21.15.57:0/170547443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07bc107430 con 0x7f07bc103c30 2023-03-02T10:48:54.926 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.137+0000 7f07ab7fe700 1 -- 172.21.15.57:0/170547443 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07ac01a780 con 0x7f07bc103c30 2023-03-02T10:48:54.926 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.137+0000 7f07c08e6700 1 -- 172.21.15.57:0/170547443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07bc1072a0 con 0x7f07bc103c30 2023-03-02T10:48:54.926 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.138+0000 7f07ab7fe700 1 -- 172.21.15.57:0/170547443 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 43522+0+0 (secure 0 0 0) 0x7f07ac017020 con 0x7f07bc103c30 2023-03-02T10:48:54.926 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.138+0000 7f07c08e6700 1 -- 172.21.15.57:0/170547443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07bc1075c0 con 0x7f07bc103c30 2023-03-02T10:48:54.926 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.139+0000 7f07ab7fe700 1 --2- 172.21.15.57:0/170547443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f07a4036870 0x7f07a4038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:54.926 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.139+0000 7f07ab7fe700 1 -- 172.21.15.57:0/170547443 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f07ac049de0 con 0x7f07bc103c30 2023-03-02T10:48:54.927 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.139+0000 7f07b9d9b700 1 --2- 172.21.15.57:0/170547443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f07a4036870 0x7f07a4038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:54.927 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.140+0000 7f07b9d9b700 1 --2- 172.21.15.57:0/170547443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f07a4036870 0x7f07a4038d20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f07b0006fd0 tx=0x7f07b0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:54.927 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.144+0000 7f07ab7fe700 1 -- 172.21.15.57:0/170547443 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f07ac018b80 con 0x7f07bc103c30 2023-03-02T10:48:54.927 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.345+0000 7f07c08e6700 1 -- 172.21.15.57:0/170547443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f07bc1a0060 con 0x7f07bc103c30 2023-03-02T10:48:54.927 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.345+0000 7f07ab7fe700 1 -- 172.21.15.57:0/170547443 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f07ac018350 con 0x7f07bc103c30 2023-03-02T10:48:54.927 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.347+0000 7f07c08e6700 1 -- 172.21.15.57:0/170547443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f07a4036870 msgr2=0x7f07a4038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:54.927 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.347+0000 7f07c08e6700 1 --2- 172.21.15.57:0/170547443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f07a4036870 0x7f07a4038d20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f07b0006fd0 tx=0x7f07b0006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:54.928 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.347+0000 7f07c08e6700 1 -- 172.21.15.57:0/170547443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 msgr2=0x7f07bc19f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:54.928 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.347+0000 7f07c08e6700 1 --2- 172.21.15.57:0/170547443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc19f5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f07ac000c00 tx=0x7f07ac011a30 comp rx=0 tx=0).stop 2023-03-02T10:48:54.928 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.347+0000 7f07c08e6700 1 -- 172.21.15.57:0/170547443 shutdown_connections 2023-03-02T10:48:54.928 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.347+0000 7f07c08e6700 1 --2- 172.21.15.57:0/170547443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f07a4036870 0x7f07a4038d20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:54.928 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.347+0000 7f07c08e6700 1 --2- 172.21.15.57:0/170547443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07bc103c30 0x7f07bc19f5a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:54.928 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.347+0000 7f07c08e6700 1 -- 172.21.15.57:0/170547443 >> 172.21.15.57:0/170547443 conn(0x7f07bc0ff8a0 msgr2=0x7f07bc109a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:54.928 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.348+0000 7f07c08e6700 1 -- 172.21.15.57:0/170547443 shutdown_connections 2023-03-02T10:48:54.928 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:54.348+0000 7f07c08e6700 1 -- 172.21.15.57:0/170547443 wait complete. 2023-03-02T10:48:54.932 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-03-02T10:48:54.933 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout disabled 2023-03-02T10:48:54.943 INFO:teuthology.orchestra.run.smithi057.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-03-02T10:48:54.944 INFO:teuthology.orchestra.run.smithi057.stdout:systemctl: stdout inactive 2023-03-02T10:48:54.944 INFO:teuthology.orchestra.run.smithi057.stdout:firewalld.service is not enabled 2023-03-02T10:48:54.944 INFO:teuthology.orchestra.run.smithi057.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-03-02T10:48:54.946 INFO:teuthology.orchestra.run.smithi057.stdout:Ceph Dashboard is now available at: 2023-03-02T10:48:54.946 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:48:54.946 INFO:teuthology.orchestra.run.smithi057.stdout: URL: https://smithi057.front.sepia.ceph.com:8443/ 2023-03-02T10:48:54.947 INFO:teuthology.orchestra.run.smithi057.stdout: User: admin 2023-03-02T10:48:54.947 INFO:teuthology.orchestra.run.smithi057.stdout: Password: jj95wxmubb 2023-03-02T10:48:54.947 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:48:54.947 INFO:teuthology.orchestra.run.smithi057.stdout:Saving cluster configuration to /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config directory 2023-03-02T10:48:54.948 INFO:teuthology.orchestra.run.smithi057.stdout:Enabling autotune for osd_memory_target 2023-03-02T10:48:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:55 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/170547443' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-03-02T10:48:56.225 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.586+0000 7ff394bfd700 1 Processor -- start 2023-03-02T10:48:56.225 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.587+0000 7ff394bfd700 1 -- start start 2023-03-02T10:48:56.225 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.587+0000 7ff394bfd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390107f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:56.225 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.587+0000 7ff394bfd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff390108470 con 0x7ff390079c60 2023-03-02T10:48:56.226 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.587+0000 7ff38e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:56.226 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.587+0000 7ff38e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390107f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55092/0 (socket says 172.21.15.57:55092) 2023-03-02T10:48:56.226 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.587+0000 7ff38e59c700 1 -- 172.21.15.57:0/1520036940 learned_addr learned my addr 172.21.15.57:0/1520036940 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:56.226 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.587+0000 7ff38e59c700 1 -- 172.21.15.57:0/1520036940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3901085b0 con 0x7ff390079c60 2023-03-02T10:48:56.226 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.588+0000 7ff38e59c700 1 --2- 172.21.15.57:0/1520036940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390107f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3800098a0 tx=0x7ff380009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49df3d96974445d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:56.226 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.588+0000 7ff38dd9b700 1 -- 172.21.15.57:0/1520036940 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff380004160 con 0x7ff390079c60 2023-03-02T10:48:56.226 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.588+0000 7ff38dd9b700 1 -- 172.21.15.57:0/1520036940 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3800042c0 con 0x7ff390079c60 2023-03-02T10:48:56.226 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.588+0000 7ff38dd9b700 1 -- 172.21.15.57:0/1520036940 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3800119b0 con 0x7ff390079c60 2023-03-02T10:48:56.227 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.588+0000 7ff394bfd700 1 -- 172.21.15.57:0/1520036940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 msgr2=0x7ff390107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:56.227 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.588+0000 7ff394bfd700 1 --2- 172.21.15.57:0/1520036940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390107f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3800098a0 tx=0x7ff380009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:56.227 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.588+0000 7ff394bfd700 1 -- 172.21.15.57:0/1520036940 shutdown_connections 2023-03-02T10:48:56.227 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.588+0000 7ff394bfd700 1 --2- 172.21.15.57:0/1520036940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390107f30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:56.227 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.588+0000 7ff394bfd700 1 -- 172.21.15.57:0/1520036940 >> 172.21.15.57:0/1520036940 conn(0x7ff3900ff8a0 msgr2=0x7ff390101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:56.227 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.588+0000 7ff394bfd700 1 -- 172.21.15.57:0/1520036940 shutdown_connections 2023-03-02T10:48:56.227 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.589+0000 7ff394bfd700 1 -- 172.21.15.57:0/1520036940 wait complete. 2023-03-02T10:48:56.228 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.589+0000 7ff394bfd700 1 Processor -- start 2023-03-02T10:48:56.228 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.589+0000 7ff394bfd700 1 -- start start 2023-03-02T10:48:56.228 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.589+0000 7ff394bfd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390105890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:56.228 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.589+0000 7ff394bfd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff390105dd0 con 0x7ff390079c60 2023-03-02T10:48:56.228 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.590+0000 7ff38e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390105890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:56.228 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.590+0000 7ff38e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390105890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55098/0 (socket says 172.21.15.57:55098) 2023-03-02T10:48:56.228 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.590+0000 7ff38e59c700 1 -- 172.21.15.57:0/2616876071 learned_addr learned my addr 172.21.15.57:0/2616876071 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:56.229 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.590+0000 7ff38e59c700 1 -- 172.21.15.57:0/2616876071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380009550 con 0x7ff390079c60 2023-03-02T10:48:56.229 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.590+0000 7ff38e59c700 1 --2- 172.21.15.57:0/2616876071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390105890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff380003e60 tx=0x7ff380011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:56.229 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.590+0000 7ff387fff700 1 -- 172.21.15.57:0/2616876071 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff380003970 con 0x7ff390079c60 2023-03-02T10:48:56.229 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.590+0000 7ff387fff700 1 -- 172.21.15.57:0/2616876071 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff380003ad0 con 0x7ff390079c60 2023-03-02T10:48:56.229 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.590+0000 7ff387fff700 1 -- 172.21.15.57:0/2616876071 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3800195e0 con 0x7ff390079c60 2023-03-02T10:48:56.229 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.590+0000 7ff394bfd700 1 -- 172.21.15.57:0/2616876071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3901095e0 con 0x7ff390079c60 2023-03-02T10:48:56.229 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.590+0000 7ff394bfd700 1 -- 172.21.15.57:0/2616876071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff390109450 con 0x7ff390079c60 2023-03-02T10:48:56.229 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.591+0000 7ff387fff700 1 -- 172.21.15.57:0/2616876071 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7ff38002a020 con 0x7ff390079c60 2023-03-02T10:48:56.230 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.591+0000 7ff394bfd700 1 -- 172.21.15.57:0/2616876071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff390061bc0 con 0x7ff390079c60 2023-03-02T10:48:56.230 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.592+0000 7ff387fff700 1 --2- 172.21.15.57:0/2616876071 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff37c036900 0x7ff37c038db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:56.230 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.592+0000 7ff387fff700 1 -- 172.21.15.57:0/2616876071 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff380049e90 con 0x7ff390079c60 2023-03-02T10:48:56.230 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.592+0000 7ff385d9b700 1 --2- 172.21.15.57:0/2616876071 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff37c036900 0x7ff37c038db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:56.230 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.592+0000 7ff385d9b700 1 --2- 172.21.15.57:0/2616876071 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff37c036900 0x7ff37c038db0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff378006fd0 tx=0x7ff378006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:56.230 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.596+0000 7ff387fff700 1 -- 172.21.15.57:0/2616876071 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7ff380023b80 con 0x7ff390079c60 2023-03-02T10:48:56.230 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.792+0000 7ff394bfd700 1 -- 172.21.15.57:0/2616876071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff390104da0 con 0x7ff390079c60 2023-03-02T10:48:56.231 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.793+0000 7ff387fff700 1 -- 172.21.15.57:0/2616876071 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff390104da0 con 0x7ff390079c60 2023-03-02T10:48:56.231 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.794+0000 7ff394bfd700 1 -- 172.21.15.57:0/2616876071 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff37c036900 msgr2=0x7ff37c038db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:56.231 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.794+0000 7ff394bfd700 1 --2- 172.21.15.57:0/2616876071 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff37c036900 0x7ff37c038db0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff378006fd0 tx=0x7ff378006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:56.231 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.794+0000 7ff394bfd700 1 -- 172.21.15.57:0/2616876071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 msgr2=0x7ff390105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:56.231 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.794+0000 7ff394bfd700 1 --2- 172.21.15.57:0/2616876071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390105890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff380003e60 tx=0x7ff380011aa0 comp rx=0 tx=0).stop 2023-03-02T10:48:56.231 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.795+0000 7ff394bfd700 1 -- 172.21.15.57:0/2616876071 shutdown_connections 2023-03-02T10:48:56.231 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.795+0000 7ff394bfd700 1 --2- 172.21.15.57:0/2616876071 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff37c036900 0x7ff37c038db0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:56.231 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.795+0000 7ff394bfd700 1 --2- 172.21.15.57:0/2616876071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff390079c60 0x7ff390105890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:56.232 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.795+0000 7ff394bfd700 1 -- 172.21.15.57:0/2616876071 >> 172.21.15.57:0/2616876071 conn(0x7ff3900ff8a0 msgr2=0x7ff390100630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:56.232 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.795+0000 7ff394bfd700 1 -- 172.21.15.57:0/2616876071 shutdown_connections 2023-03-02T10:48:56.232 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:55.795+0000 7ff394bfd700 1 -- 172.21.15.57:0/2616876071 wait complete. 2023-03-02T10:48:56.473 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:56 smithi057 ceph-mon[92072]: mgrmap e13: x(active, since 6s) 2023-03-02T10:48:57.484 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.699+0000 7f0405362700 1 Processor -- start 2023-03-02T10:48:57.484 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.699+0000 7f0405362700 1 -- start start 2023-03-02T10:48:57.484 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.700+0000 7f0405362700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f04001040a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.700+0000 7f0405362700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0400079ce0 con 0x7f0400103c90 2023-03-02T10:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.700+0000 7f03feffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f04001040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.700+0000 7f03feffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f04001040a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51592/0 (socket says 172.21.15.57:51592) 2023-03-02T10:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.700+0000 7f03feffd700 1 -- 172.21.15.57:0/581677746 learned_addr learned my addr 172.21.15.57:0/581677746 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.700+0000 7f03feffd700 1 -- 172.21.15.57:0/581677746 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400079e20 con 0x7f0400103c90 2023-03-02T10:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.700+0000 7f03feffd700 1 --2- 172.21.15.57:0/581677746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f04001040a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f03f00098a0 tx=0x7f03f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87312a8cbcfe8854 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.701+0000 7f03fe7fc700 1 -- 172.21.15.57:0/581677746 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03f0004160 con 0x7f0400103c90 2023-03-02T10:48:57.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.701+0000 7f03fe7fc700 1 -- 172.21.15.57:0/581677746 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03f00042c0 con 0x7f0400103c90 2023-03-02T10:48:57.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.701+0000 7f03fe7fc700 1 -- 172.21.15.57:0/581677746 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03f00119b0 con 0x7f0400103c90 2023-03-02T10:48:57.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.701+0000 7f0405362700 1 -- 172.21.15.57:0/581677746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 msgr2=0x7f04001040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:57.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.701+0000 7f0405362700 1 --2- 172.21.15.57:0/581677746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f04001040a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f03f00098a0 tx=0x7f03f0009bb0 comp rx=0 tx=0).stop 2023-03-02T10:48:57.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.701+0000 7f0405362700 1 -- 172.21.15.57:0/581677746 shutdown_connections 2023-03-02T10:48:57.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.701+0000 7f0405362700 1 --2- 172.21.15.57:0/581677746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f04001040a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:57.486 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.701+0000 7f0405362700 1 -- 172.21.15.57:0/581677746 >> 172.21.15.57:0/581677746 conn(0x7f04000ff8a0 msgr2=0x7f0400101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:57.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.701+0000 7f0405362700 1 -- 172.21.15.57:0/581677746 shutdown_connections 2023-03-02T10:48:57.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.701+0000 7f0405362700 1 -- 172.21.15.57:0/581677746 wait complete. 2023-03-02T10:48:57.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.702+0000 7f0405362700 1 Processor -- start 2023-03-02T10:48:57.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.702+0000 7f0405362700 1 -- start start 2023-03-02T10:48:57.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.702+0000 7f0405362700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f040019b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:57.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.702+0000 7f0405362700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040019b700 con 0x7f0400103c90 2023-03-02T10:48:57.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.702+0000 7f03feffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f040019b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:57.487 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.702+0000 7f03feffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f040019b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51604/0 (socket says 172.21.15.57:51604) 2023-03-02T10:48:57.488 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.702+0000 7f03feffd700 1 -- 172.21.15.57:0/266196658 learned_addr learned my addr 172.21.15.57:0/266196658 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:48:57.488 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.703+0000 7f03feffd700 1 -- 172.21.15.57:0/266196658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f0009550 con 0x7f0400103c90 2023-03-02T10:48:57.488 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.703+0000 7f03feffd700 1 --2- 172.21.15.57:0/266196658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f040019b1c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f03f0000c00 tx=0x7f03f0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:57.488 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.703+0000 7f03fcff9700 1 -- 172.21.15.57:0/266196658 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03f00039f0 con 0x7f0400103c90 2023-03-02T10:48:57.488 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.703+0000 7f03fcff9700 1 -- 172.21.15.57:0/266196658 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03f0003b50 con 0x7f0400103c90 2023-03-02T10:48:57.488 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.703+0000 7f0405362700 1 -- 172.21.15.57:0/266196658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0400105420 con 0x7f0400103c90 2023-03-02T10:48:57.488 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.703+0000 7f03fcff9700 1 -- 172.21.15.57:0/266196658 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03f001a780 con 0x7f0400103c90 2023-03-02T10:48:57.488 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.703+0000 7f0405362700 1 -- 172.21.15.57:0/266196658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0400105290 con 0x7f0400103c90 2023-03-02T10:48:57.489 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.704+0000 7f03fcff9700 1 -- 172.21.15.57:0/266196658 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7f03f0017020 con 0x7f0400103c90 2023-03-02T10:48:57.489 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.704+0000 7f0405362700 1 -- 172.21.15.57:0/266196658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04001055b0 con 0x7f0400103c90 2023-03-02T10:48:57.489 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.704+0000 7f03fcff9700 1 --2- 172.21.15.57:0/266196658 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f03ec036910 0x7f03ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:48:57.489 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.705+0000 7f03fcff9700 1 -- 172.21.15.57:0/266196658 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f03f0049e50 con 0x7f0400103c90 2023-03-02T10:48:57.489 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.705+0000 7f03f7fff700 1 --2- 172.21.15.57:0/266196658 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f03ec036910 0x7f03ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:48:57.489 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.705+0000 7f03f7fff700 1 --2- 172.21.15.57:0/266196658 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f03ec036910 0x7f03ec038dc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03e8006fd0 tx=0x7f03e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:48:57.489 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:56.709+0000 7f03fcff9700 1 -- 172.21.15.57:0/266196658 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f03f0024440 con 0x7f0400103c90 2023-03-02T10:48:57.490 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.012+0000 7f0405362700 1 -- 172.21.15.57:0/266196658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f04001949c0 con 0x7f0400103c90 2023-03-02T10:48:57.490 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.015+0000 7f03fcff9700 1 -- 172.21.15.57:0/266196658 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v30)=0 set mgr/dashboard/cluster/status v30) v1 ==== 153+0+0 (secure 0 0 0) 0x7f03f0020240 con 0x7f0400103c90 2023-03-02T10:48:57.490 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.017+0000 7f0405362700 1 -- 172.21.15.57:0/266196658 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f03ec036910 msgr2=0x7f03ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:57.490 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.017+0000 7f0405362700 1 --2- 172.21.15.57:0/266196658 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f03ec036910 0x7f03ec038dc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03e8006fd0 tx=0x7f03e8006e40 comp rx=0 tx=0).stop 2023-03-02T10:48:57.490 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.017+0000 7f0405362700 1 -- 172.21.15.57:0/266196658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 msgr2=0x7f040019b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:48:57.490 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.017+0000 7f0405362700 1 --2- 172.21.15.57:0/266196658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f040019b1c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f03f0000c00 tx=0x7f03f0011a30 comp rx=0 tx=0).stop 2023-03-02T10:48:57.490 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.017+0000 7f0405362700 1 -- 172.21.15.57:0/266196658 shutdown_connections 2023-03-02T10:48:57.491 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.017+0000 7f0405362700 1 --2- 172.21.15.57:0/266196658 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f03ec036910 0x7f03ec038dc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:57.491 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.017+0000 7f0405362700 1 --2- 172.21.15.57:0/266196658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0400103c90 0x7f040019b1c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:48:57.491 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.017+0000 7f0405362700 1 -- 172.21.15.57:0/266196658 >> 172.21.15.57:0/266196658 conn(0x7f04000ff8a0 msgr2=0x7f040018f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:48:57.491 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.018+0000 7f0405362700 1 -- 172.21.15.57:0/266196658 shutdown_connections 2023-03-02T10:48:57.491 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr 2023-03-02T10:48:57.018+0000 7f0405362700 1 -- 172.21.15.57:0/266196658 wait complete. 2023-03-02T10:48:57.491 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-03-02T10:48:57.491 INFO:teuthology.orchestra.run.smithi057.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-03-02T10:48:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:48:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-03-02T10:48:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:48:57.492 INFO:teuthology.orchestra.run.smithi057.stdout:Or, if you are only running a single cluster on this host: 2023-03-02T10:48:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:48:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-03-02T10:48:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:48:57.492 INFO:teuthology.orchestra.run.smithi057.stdout:Please consider enabling telemetry to help improve Ceph: 2023-03-02T10:48:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:48:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: ceph telemetry on 2023-03-02T10:48:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:48:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:For more information see: 2023-03-02T10:48:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:48:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-03-02T10:48:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:48:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:Bootstrap complete. 2023-03-02T10:48:57.531 INFO:tasks.cephadm:Fetching config... 2023-03-02T10:48:57.531 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:48:57.531 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-03-02T10:48:57.558 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-03-02T10:48:57.558 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:48:57.559 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-03-02T10:48:57.625 INFO:tasks.cephadm:Fetching mon keyring... 2023-03-02T10:48:57.625 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:48:57.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/keyring of=/dev/stdout 2023-03-02T10:48:57.709 INFO:tasks.cephadm:Fetching pub ssh key... 2023-03-02T10:48:57.710 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:48:57.710 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-03-02T10:48:57.776 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-03-02T10:48:57.776 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvg9306uUHqDH0MzGgXYd7vUWS0E8OpEFyJ1OsCE8hIA7n7urIBWexV/YIUhGfE8vfvQBlmZNPTAMVaGAzMI/R5y0MYefSWHrQpoLLptj1BVETYjgP1J/Qe204w5F+9q9udQKpu/NRpGsiQGwJcx7g7tO2Wy8b6acZLwxBW22BI2b47xkZgTrs5tws6eht+pnQYVMw4y/ItXcf76zyBirFqU1pvF9TChkpeeDIrN+s6GKlNe2TpVc2bi3Y0cR2kZIyKZ5bM8V0V8ZGep3/eC4ztZP4j+icCGoN9Er1nn4QlSSlmo4YCDHXIJfe+Rrdddsz9vANNtdeGZ+qvWG0tnWHOtSP7oXtiSeEmn4gaskNtTO8YsihpuKDUDaf8l+Zn8Xqwq+ZxssmXZEfSQ73KPbluLGgGxUplRT+VWP75wMnSMa0nV+h4cbRzgJGjdW1OFsxarCkB9FFmtWoztx1yGCaDZq5ApSRDtz2hDNkknGuNGKFtgy1gYwyRfwZAiOy9zU= ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-03-02T10:48:57.902 INFO:teuthology.orchestra.run.smithi057.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvg9306uUHqDH0MzGgXYd7vUWS0E8OpEFyJ1OsCE8hIA7n7urIBWexV/YIUhGfE8vfvQBlmZNPTAMVaGAzMI/R5y0MYefSWHrQpoLLptj1BVETYjgP1J/Qe204w5F+9q9udQKpu/NRpGsiQGwJcx7g7tO2Wy8b6acZLwxBW22BI2b47xkZgTrs5tws6eht+pnQYVMw4y/ItXcf76zyBirFqU1pvF9TChkpeeDIrN+s6GKlNe2TpVc2bi3Y0cR2kZIyKZ5bM8V0V8ZGep3/eC4ztZP4j+icCGoN9Er1nn4QlSSlmo4YCDHXIJfe+Rrdddsz9vANNtdeGZ+qvWG0tnWHOtSP7oXtiSeEmn4gaskNtTO8YsihpuKDUDaf8l+Zn8Xqwq+ZxssmXZEfSQ73KPbluLGgGxUplRT+VWP75wMnSMa0nV+h4cbRzgJGjdW1OFsxarCkB9FFmtWoztx1yGCaDZq5ApSRDtz2hDNkknGuNGKFtgy1gYwyRfwZAiOy9zU= ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:48:57.922 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvg9306uUHqDH0MzGgXYd7vUWS0E8OpEFyJ1OsCE8hIA7n7urIBWexV/YIUhGfE8vfvQBlmZNPTAMVaGAzMI/R5y0MYefSWHrQpoLLptj1BVETYjgP1J/Qe204w5F+9q9udQKpu/NRpGsiQGwJcx7g7tO2Wy8b6acZLwxBW22BI2b47xkZgTrs5tws6eht+pnQYVMw4y/ItXcf76zyBirFqU1pvF9TChkpeeDIrN+s6GKlNe2TpVc2bi3Y0cR2kZIyKZ5bM8V0V8ZGep3/eC4ztZP4j+icCGoN9Er1nn4QlSSlmo4YCDHXIJfe+Rrdddsz9vANNtdeGZ+qvWG0tnWHOtSP7oXtiSeEmn4gaskNtTO8YsihpuKDUDaf8l+Zn8Xqwq+ZxssmXZEfSQ73KPbluLGgGxUplRT+VWP75wMnSMa0nV+h4cbRzgJGjdW1OFsxarCkB9FFmtWoztx1yGCaDZq5ApSRDtz2hDNkknGuNGKFtgy1gYwyRfwZAiOy9zU= ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-03-02T10:48:57.969 INFO:teuthology.orchestra.run.smithi122.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvg9306uUHqDH0MzGgXYd7vUWS0E8OpEFyJ1OsCE8hIA7n7urIBWexV/YIUhGfE8vfvQBlmZNPTAMVaGAzMI/R5y0MYefSWHrQpoLLptj1BVETYjgP1J/Qe204w5F+9q9udQKpu/NRpGsiQGwJcx7g7tO2Wy8b6acZLwxBW22BI2b47xkZgTrs5tws6eht+pnQYVMw4y/ItXcf76zyBirFqU1pvF9TChkpeeDIrN+s6GKlNe2TpVc2bi3Y0cR2kZIyKZ5bM8V0V8ZGep3/eC4ztZP4j+icCGoN9Er1nn4QlSSlmo4YCDHXIJfe+Rrdddsz9vANNtdeGZ+qvWG0tnWHOtSP7oXtiSeEmn4gaskNtTO8YsihpuKDUDaf8l+Zn8Xqwq+ZxssmXZEfSQ73KPbluLGgGxUplRT+VWP75wMnSMa0nV+h4cbRzgJGjdW1OFsxarCkB9FFmtWoztx1yGCaDZq5ApSRDtz2hDNkknGuNGKFtgy1gYwyRfwZAiOy9zU= ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:48:57.983 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvg9306uUHqDH0MzGgXYd7vUWS0E8OpEFyJ1OsCE8hIA7n7urIBWexV/YIUhGfE8vfvQBlmZNPTAMVaGAzMI/R5y0MYefSWHrQpoLLptj1BVETYjgP1J/Qe204w5F+9q9udQKpu/NRpGsiQGwJcx7g7tO2Wy8b6acZLwxBW22BI2b47xkZgTrs5tws6eht+pnQYVMw4y/ItXcf76zyBirFqU1pvF9TChkpeeDIrN+s6GKlNe2TpVc2bi3Y0cR2kZIyKZ5bM8V0V8ZGep3/eC4ztZP4j+icCGoN9Er1nn4QlSSlmo4YCDHXIJfe+Rrdddsz9vANNtdeGZ+qvWG0tnWHOtSP7oXtiSeEmn4gaskNtTO8YsihpuKDUDaf8l+Zn8Xqwq+ZxssmXZEfSQ73KPbluLGgGxUplRT+VWP75wMnSMa0nV+h4cbRzgJGjdW1OFsxarCkB9FFmtWoztx1yGCaDZq5ApSRDtz2hDNkknGuNGKFtgy1gYwyRfwZAiOy9zU= ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-03-02T10:48:58.028 INFO:teuthology.orchestra.run.smithi136.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvg9306uUHqDH0MzGgXYd7vUWS0E8OpEFyJ1OsCE8hIA7n7urIBWexV/YIUhGfE8vfvQBlmZNPTAMVaGAzMI/R5y0MYefSWHrQpoLLptj1BVETYjgP1J/Qe204w5F+9q9udQKpu/NRpGsiQGwJcx7g7tO2Wy8b6acZLwxBW22BI2b47xkZgTrs5tws6eht+pnQYVMw4y/ItXcf76zyBirFqU1pvF9TChkpeeDIrN+s6GKlNe2TpVc2bi3Y0cR2kZIyKZ5bM8V0V8ZGep3/eC4ztZP4j+icCGoN9Er1nn4QlSSlmo4YCDHXIJfe+Rrdddsz9vANNtdeGZ+qvWG0tnWHOtSP7oXtiSeEmn4gaskNtTO8YsihpuKDUDaf8l+Zn8Xqwq+ZxssmXZEfSQ73KPbluLGgGxUplRT+VWP75wMnSMa0nV+h4cbRzgJGjdW1OFsxarCkB9FFmtWoztx1yGCaDZq5ApSRDtz2hDNkknGuNGKFtgy1gYwyRfwZAiOy9zU= ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:48:58.041 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-03-02T10:48:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:48:58 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/266196658' entity='client.admin' 2023-03-02T10:48:59.040 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:49:00.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.771+0000 7ffa45de4700 1 -- 172.21.15.57:0/2429593960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa400ff5f0 msgr2=0x7ffa400ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:00.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.771+0000 7ffa45de4700 1 --2- 172.21.15.57:0/2429593960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa400ff5f0 0x7ffa400ffa00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009910 tx=0x7ffa30009c20 comp rx=0 tx=0).stop 2023-03-02T10:49:00.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.771+0000 7ffa45de4700 1 -- 172.21.15.57:0/2429593960 shutdown_connections 2023-03-02T10:49:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.771+0000 7ffa45de4700 1 --2- 172.21.15.57:0/2429593960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa400ff5f0 0x7ffa400ffa00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.771+0000 7ffa45de4700 1 -- 172.21.15.57:0/2429593960 >> 172.21.15.57:0/2429593960 conn(0x7ffa400fab70 msgr2=0x7ffa400fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.771+0000 7ffa45de4700 1 -- 172.21.15.57:0/2429593960 shutdown_connections 2023-03-02T10:49:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.771+0000 7ffa45de4700 1 -- 172.21.15.57:0/2429593960 wait complete. 2023-03-02T10:49:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.772+0000 7ffa45de4700 1 Processor -- start 2023-03-02T10:49:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.772+0000 7ffa45de4700 1 -- start start 2023-03-02T10:49:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.772+0000 7ffa45de4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa400ff5f0 0x7ffa40194710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.772+0000 7ffa45de4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa40194c50 con 0x7ffa400ff5f0 2023-03-02T10:49:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.772+0000 7ffa3f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa400ff5f0 0x7ffa40194710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.772+0000 7ffa3f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa400ff5f0 0x7ffa40194710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51626/0 (socket says 172.21.15.57:51626) 2023-03-02T10:49:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.772+0000 7ffa3f7fe700 1 -- 172.21.15.57:0/3612262291 learned_addr learned my addr 172.21.15.57:0/3612262291 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:49:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.772+0000 7ffa3f7fe700 1 -- 172.21.15.57:0/3612262291 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa300095f0 con 0x7ffa400ff5f0 2023-03-02T10:49:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.773+0000 7ffa3f7fe700 1 --2- 172.21.15.57:0/3612262291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa400ff5f0 0x7ffa40194710 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffa30004f40 tx=0x7ffa300057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.773+0000 7ffa3cff9700 1 -- 172.21.15.57:0/3612262291 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa3001d070 con 0x7ffa400ff5f0 2023-03-02T10:49:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.773+0000 7ffa3cff9700 1 -- 172.21.15.57:0/3612262291 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa3000bc10 con 0x7ffa400ff5f0 2023-03-02T10:49:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.773+0000 7ffa3cff9700 1 -- 172.21.15.57:0/3612262291 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa30003a70 con 0x7ffa400ff5f0 2023-03-02T10:49:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.773+0000 7ffa45de4700 1 -- 172.21.15.57:0/3612262291 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa401054c0 con 0x7ffa400ff5f0 2023-03-02T10:49:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.773+0000 7ffa45de4700 1 -- 172.21.15.57:0/3612262291 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa40105330 con 0x7ffa400ff5f0 2023-03-02T10:49:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.774+0000 7ffa3cff9700 1 -- 172.21.15.57:0/3612262291 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7ffa30028030 con 0x7ffa400ff5f0 2023-03-02T10:49:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.774+0000 7ffa45de4700 1 -- 172.21.15.57:0/3612262291 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa40105650 con 0x7ffa400ff5f0 2023-03-02T10:49:00.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.774+0000 7ffa3cff9700 1 --2- 172.21.15.57:0/3612262291 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffa28036900 0x7ffa28038db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:00.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.774+0000 7ffa3cff9700 1 -- 172.21.15.57:0/3612262291 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ffa30049930 con 0x7ffa400ff5f0 2023-03-02T10:49:00.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.774+0000 7ffa3effd700 1 --2- 172.21.15.57:0/3612262291 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffa28036900 0x7ffa28038db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:00.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.775+0000 7ffa3effd700 1 --2- 172.21.15.57:0/3612262291 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffa28036900 0x7ffa28038db0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffa34006fd0 tx=0x7ffa34006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.779+0000 7ffa3cff9700 1 -- 172.21.15.57:0/3612262291 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7ffa3000bd80 con 0x7ffa400ff5f0 2023-03-02T10:49:00.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.980+0000 7ffa45de4700 1 -- 172.21.15.57:0/3612262291 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7ffa4018e1f0 con 0x7ffa400ff5f0 2023-03-02T10:49:00.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.988+0000 7ffa3cff9700 1 -- 172.21.15.57:0/3612262291 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7ffa30026070 con 0x7ffa400ff5f0 2023-03-02T10:49:00.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.991+0000 7ffa45de4700 1 -- 172.21.15.57:0/3612262291 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffa28036900 msgr2=0x7ffa28038db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:00.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.991+0000 7ffa45de4700 1 --2- 172.21.15.57:0/3612262291 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffa28036900 0x7ffa28038db0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffa34006fd0 tx=0x7ffa34006e40 comp rx=0 tx=0).stop 2023-03-02T10:49:00.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.991+0000 7ffa45de4700 1 -- 172.21.15.57:0/3612262291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa400ff5f0 msgr2=0x7ffa40194710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:00.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.991+0000 7ffa45de4700 1 --2- 172.21.15.57:0/3612262291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa400ff5f0 0x7ffa40194710 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffa30004f40 tx=0x7ffa300057c0 comp rx=0 tx=0).stop 2023-03-02T10:49:00.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.992+0000 7ffa45de4700 1 -- 172.21.15.57:0/3612262291 shutdown_connections 2023-03-02T10:49:00.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.992+0000 7ffa45de4700 1 --2- 172.21.15.57:0/3612262291 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffa28036900 0x7ffa28038db0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:00.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.992+0000 7ffa45de4700 1 --2- 172.21.15.57:0/3612262291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa400ff5f0 0x7ffa40194710 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:00.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.992+0000 7ffa45de4700 1 -- 172.21.15.57:0/3612262291 >> 172.21.15.57:0/3612262291 conn(0x7ffa400fab70 msgr2=0x7ffa400fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:00.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.992+0000 7ffa45de4700 1 -- 172.21.15.57:0/3612262291 shutdown_connections 2023-03-02T10:49:00.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:00.992+0000 7ffa45de4700 1 -- 172.21.15.57:0/3612262291 wait complete. 2023-03-02T10:49:01.454 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-03-02T10:49:01.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-03-02T10:49:02.189 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:49:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:01 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3612262291' entity='client.admin' 2023-03-02T10:49:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:49:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.590+0000 7f0756507700 1 -- 172.21.15.57:0/850385496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07500ff5f0 msgr2=0x7f07500ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.590+0000 7f0756507700 1 --2- 172.21.15.57:0/850385496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07500ff5f0 0x7f07500ffa00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0740009910 tx=0x7f0740009c20 comp rx=0 tx=0).stop 2023-03-02T10:49:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.590+0000 7f0756507700 1 -- 172.21.15.57:0/850385496 shutdown_connections 2023-03-02T10:49:03.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.590+0000 7f0756507700 1 --2- 172.21.15.57:0/850385496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07500ff5f0 0x7f07500ffa00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:03.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.590+0000 7f0756507700 1 -- 172.21.15.57:0/850385496 >> 172.21.15.57:0/850385496 conn(0x7f07500fab70 msgr2=0x7f07500fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:03.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.590+0000 7f0756507700 1 -- 172.21.15.57:0/850385496 shutdown_connections 2023-03-02T10:49:03.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.590+0000 7f0756507700 1 -- 172.21.15.57:0/850385496 wait complete. 2023-03-02T10:49:03.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.590+0000 7f0756507700 1 Processor -- start 2023-03-02T10:49:03.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.591+0000 7f0756507700 1 -- start start 2023-03-02T10:49:03.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.591+0000 7f0756507700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07500ff5f0 0x7f0750196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:03.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.591+0000 7f0756507700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0750196e60 con 0x7f07500ff5f0 2023-03-02T10:49:03.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.591+0000 7f074ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07500ff5f0 0x7f0750196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:03.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.591+0000 7f074ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07500ff5f0 0x7f0750196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51644/0 (socket says 172.21.15.57:51644) 2023-03-02T10:49:03.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.591+0000 7f074ffff700 1 -- 172.21.15.57:0/2446005178 learned_addr learned my addr 172.21.15.57:0/2446005178 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:49:03.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.591+0000 7f074ffff700 1 -- 172.21.15.57:0/2446005178 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07400095f0 con 0x7f07500ff5f0 2023-03-02T10:49:03.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.591+0000 7f074ffff700 1 --2- 172.21.15.57:0/2446005178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07500ff5f0 0x7f0750196920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0740004f40 tx=0x7f07400057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:03.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.592+0000 7f074d7fa700 1 -- 172.21.15.57:0/2446005178 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f074001d070 con 0x7f07500ff5f0 2023-03-02T10:49:03.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.592+0000 7f074d7fa700 1 -- 172.21.15.57:0/2446005178 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f074000bc10 con 0x7f07500ff5f0 2023-03-02T10:49:03.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.592+0000 7f0756507700 1 -- 172.21.15.57:0/2446005178 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07501054c0 con 0x7f07500ff5f0 2023-03-02T10:49:03.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.592+0000 7f074d7fa700 1 -- 172.21.15.57:0/2446005178 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0740003a70 con 0x7f07500ff5f0 2023-03-02T10:49:03.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.592+0000 7f0756507700 1 -- 172.21.15.57:0/2446005178 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0750105330 con 0x7f07500ff5f0 2023-03-02T10:49:03.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.593+0000 7f074d7fa700 1 -- 172.21.15.57:0/2446005178 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7f0740028030 con 0x7f07500ff5f0 2023-03-02T10:49:03.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.593+0000 7f0756507700 1 -- 172.21.15.57:0/2446005178 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0750105650 con 0x7f07500ff5f0 2023-03-02T10:49:03.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.593+0000 7f074d7fa700 1 --2- 172.21.15.57:0/2446005178 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0738036900 0x7f0738038db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:03.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.593+0000 7f074d7fa700 1 -- 172.21.15.57:0/2446005178 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f07400499d0 con 0x7f07500ff5f0 2023-03-02T10:49:03.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.593+0000 7f074f7fe700 1 --2- 172.21.15.57:0/2446005178 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0738036900 0x7f0738038db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:03.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.594+0000 7f074f7fe700 1 --2- 172.21.15.57:0/2446005178 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0738036900 0x7f0738038db0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0744006fd0 tx=0x7f0744006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:03.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.598+0000 7f074d7fa700 1 -- 172.21.15.57:0/2446005178 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f074000bd80 con 0x7f07500ff5f0 2023-03-02T10:49:03.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.801+0000 7f0756507700 1 -- 172.21.15.57:0/2446005178 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f0750060a60 con 0x7f0738036900 2023-03-02T10:49:03.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.804+0000 7f074d7fa700 1 -- 172.21.15.57:0/2446005178 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0750060a60 con 0x7f0738036900 2023-03-02T10:49:03.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.806+0000 7f0756507700 1 -- 172.21.15.57:0/2446005178 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0738036900 msgr2=0x7f0738038db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:03.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.806+0000 7f0756507700 1 --2- 172.21.15.57:0/2446005178 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0738036900 0x7f0738038db0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0744006fd0 tx=0x7f0744006e40 comp rx=0 tx=0).stop 2023-03-02T10:49:03.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.806+0000 7f0756507700 1 -- 172.21.15.57:0/2446005178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07500ff5f0 msgr2=0x7f0750196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:03.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.806+0000 7f0756507700 1 --2- 172.21.15.57:0/2446005178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07500ff5f0 0x7f0750196920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0740004f40 tx=0x7f07400057c0 comp rx=0 tx=0).stop 2023-03-02T10:49:03.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.806+0000 7f0756507700 1 -- 172.21.15.57:0/2446005178 shutdown_connections 2023-03-02T10:49:03.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.806+0000 7f0756507700 1 --2- 172.21.15.57:0/2446005178 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0738036900 0x7f0738038db0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:03.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.806+0000 7f0756507700 1 --2- 172.21.15.57:0/2446005178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07500ff5f0 0x7f0750196920 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:03.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.806+0000 7f0756507700 1 -- 172.21.15.57:0/2446005178 >> 172.21.15.57:0/2446005178 conn(0x7f07500fab70 msgr2=0x7f07500fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:03.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.806+0000 7f0756507700 1 -- 172.21.15.57:0/2446005178 shutdown_connections 2023-03-02T10:49:03.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:03.807+0000 7f0756507700 1 -- 172.21.15.57:0/2446005178 wait complete. 2023-03-02T10:49:04.291 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi122 2023-03-02T10:49:04.292 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-03-02T10:49:04.292 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.conf 2023-03-02T10:49:04.314 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-03-02T10:49:04.314 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:49:04.373 INFO:tasks.cephadm:Adding host smithi122 to orchestrator... 2023-03-02T10:49:04.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch host add smithi122 2023-03-02T10:49:05.131 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:49:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:04 smithi057 ceph-mon[92072]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:49:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:05.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:05.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:05.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:04 smithi057 ceph-mon[92072]: Updating smithi057:/etc/ceph/ceph.conf 2023-03-02T10:49:05.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:04 smithi057 ceph-mon[92072]: Updating smithi057:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:06 smithi057 ceph-mon[92072]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:49:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:06 smithi057 ceph-mon[92072]: Updating smithi057:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:49:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:06 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:06 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:06 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:06.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.395+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2081045270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c341035c0 msgr2=0x7f0c34103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:06.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.395+0000 7f0c38b9d700 1 --2- 172.21.15.57:0/2081045270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c341035c0 0x7f0c34103990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009910 tx=0x7f0c24009c20 comp rx=0 tx=0).stop 2023-03-02T10:49:06.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.395+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2081045270 shutdown_connections 2023-03-02T10:49:06.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.395+0000 7f0c38b9d700 1 --2- 172.21.15.57:0/2081045270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c341035c0 0x7f0c34103990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:06.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.395+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2081045270 >> 172.21.15.57:0/2081045270 conn(0x7f0c340756a0 msgr2=0x7f0c34075aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:06.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.395+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2081045270 shutdown_connections 2023-03-02T10:49:06.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.395+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2081045270 wait complete. 2023-03-02T10:49:06.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.396+0000 7f0c38b9d700 1 Processor -- start 2023-03-02T10:49:06.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.396+0000 7f0c38b9d700 1 -- start start 2023-03-02T10:49:06.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.396+0000 7f0c38b9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c341035c0 0x7f0c3419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:06.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.396+0000 7f0c38b9d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3419ade0 con 0x7f0c341035c0 2023-03-02T10:49:06.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.396+0000 7f0c3259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c341035c0 0x7f0c3419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:06.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.396+0000 7f0c3259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c341035c0 0x7f0c3419a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37884/0 (socket says 172.21.15.57:37884) 2023-03-02T10:49:06.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.396+0000 7f0c3259c700 1 -- 172.21.15.57:0/2496074800 learned_addr learned my addr 172.21.15.57:0/2496074800 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:49:06.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.397+0000 7f0c3259c700 1 -- 172.21.15.57:0/2496074800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240095f0 con 0x7f0c341035c0 2023-03-02T10:49:06.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.397+0000 7f0c3259c700 1 --2- 172.21.15.57:0/2496074800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c341035c0 0x7f0c3419a8a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c24006010 tx=0x7f0c24004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:06.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.397+0000 7f0c237fe700 1 -- 172.21.15.57:0/2496074800 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c2401d070 con 0x7f0c341035c0 2023-03-02T10:49:06.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.397+0000 7f0c237fe700 1 -- 172.21.15.57:0/2496074800 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c240044a0 con 0x7f0c341035c0 2023-03-02T10:49:06.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.397+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2496074800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c34108950 con 0x7f0c341035c0 2023-03-02T10:49:06.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.397+0000 7f0c237fe700 1 -- 172.21.15.57:0/2496074800 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c24003a70 con 0x7f0c341035c0 2023-03-02T10:49:06.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.397+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2496074800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c341087c0 con 0x7f0c341035c0 2023-03-02T10:49:06.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.398+0000 7f0c237fe700 1 -- 172.21.15.57:0/2496074800 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7f0c24028030 con 0x7f0c341035c0 2023-03-02T10:49:06.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.398+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2496074800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c34108ae0 con 0x7f0c341035c0 2023-03-02T10:49:06.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.398+0000 7f0c237fe700 1 --2- 172.21.15.57:0/2496074800 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0c1c036900 0x7f0c1c038db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:06.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.398+0000 7f0c237fe700 1 -- 172.21.15.57:0/2496074800 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0c24049ab0 con 0x7f0c341035c0 2023-03-02T10:49:06.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.398+0000 7f0c31d9b700 1 --2- 172.21.15.57:0/2496074800 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0c1c036900 0x7f0c1c038db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:06.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.399+0000 7f0c31d9b700 1 --2- 172.21.15.57:0/2496074800 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0c1c036900 0x7f0c1c038db0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c28006fd0 tx=0x7f0c28006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:06.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.403+0000 7f0c237fe700 1 -- 172.21.15.57:0/2496074800 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f0c2402aba0 con 0x7f0c341035c0 2023-03-02T10:49:06.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:06.610+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2496074800 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c34195e20 con 0x7f0c1c036900 2023-03-02T10:49:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:07 smithi057 ceph-mon[92072]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:49:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:07 smithi057 ceph-mon[92072]: Deploying cephadm binary to smithi122 2023-03-02T10:49:08.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:08.513+0000 7f0c237fe700 1 -- 172.21.15.57:0/2496074800 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0c34195e20 con 0x7f0c1c036900 2023-03-02T10:49:08.515 INFO:teuthology.orchestra.run.smithi057.stdout:Added host 'smithi122' with addr '172.21.15.122' 2023-03-02T10:49:08.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:08.516+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2496074800 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0c1c036900 msgr2=0x7f0c1c038db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:08.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:08.516+0000 7f0c38b9d700 1 --2- 172.21.15.57:0/2496074800 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0c1c036900 0x7f0c1c038db0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c28006fd0 tx=0x7f0c28006e40 comp rx=0 tx=0).stop 2023-03-02T10:49:08.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:08.516+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2496074800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c341035c0 msgr2=0x7f0c3419a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:08.516+0000 7f0c38b9d700 1 --2- 172.21.15.57:0/2496074800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c341035c0 0x7f0c3419a8a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c24006010 tx=0x7f0c24004ff0 comp rx=0 tx=0).stop 2023-03-02T10:49:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:08.516+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2496074800 shutdown_connections 2023-03-02T10:49:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:08.516+0000 7f0c38b9d700 1 --2- 172.21.15.57:0/2496074800 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0c1c036900 0x7f0c1c038db0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:08.516+0000 7f0c38b9d700 1 --2- 172.21.15.57:0/2496074800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c341035c0 0x7f0c3419a8a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:08.516+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2496074800 >> 172.21.15.57:0/2496074800 conn(0x7f0c340756a0 msgr2=0x7f0c340675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:08.516+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2496074800 shutdown_connections 2023-03-02T10:49:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:08.516+0000 7f0c38b9d700 1 -- 172.21.15.57:0/2496074800 wait complete. 2023-03-02T10:49:09.035 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch host ls --format=json 2023-03-02T10:49:09.770 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:49:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:09 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:09 smithi057 ceph-mon[92072]: Added host smithi122 2023-03-02T10:49:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:09 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:09 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:09 smithi057 ceph-mon[92072]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:11.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.085+0000 7fdcc8694700 1 -- 172.21.15.57:0/8778963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcc01046d0 msgr2=0x7fdcc0104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:11.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.085+0000 7fdcc8694700 1 --2- 172.21.15.57:0/8778963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcc01046d0 0x7fdcc0104aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009910 tx=0x7fdcbc009c20 comp rx=0 tx=0).stop 2023-03-02T10:49:11.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.086+0000 7fdcc8694700 1 -- 172.21.15.57:0/8778963 shutdown_connections 2023-03-02T10:49:11.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.086+0000 7fdcc8694700 1 --2- 172.21.15.57:0/8778963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcc01046d0 0x7fdcc0104aa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:11.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.086+0000 7fdcc8694700 1 -- 172.21.15.57:0/8778963 >> 172.21.15.57:0/8778963 conn(0x7fdcc00756a0 msgr2=0x7fdcc0075aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:11.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.086+0000 7fdcc8694700 1 -- 172.21.15.57:0/8778963 shutdown_connections 2023-03-02T10:49:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.086+0000 7fdcc8694700 1 -- 172.21.15.57:0/8778963 wait complete. 2023-03-02T10:49:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.086+0000 7fdcc8694700 1 Processor -- start 2023-03-02T10:49:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.086+0000 7fdcc8694700 1 -- start start 2023-03-02T10:49:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.087+0000 7fdcc8694700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcc01046d0 0x7fdcc019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.087+0000 7fdcc8694700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc019ad70 con 0x7fdcc01046d0 2023-03-02T10:49:11.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.087+0000 7fdcc6430700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcc01046d0 0x7fdcc019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:11.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.087+0000 7fdcc6430700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcc01046d0 0x7fdcc019a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37910/0 (socket says 172.21.15.57:37910) 2023-03-02T10:49:11.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.087+0000 7fdcc6430700 1 -- 172.21.15.57:0/833495670 learned_addr learned my addr 172.21.15.57:0/833495670 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:49:11.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.087+0000 7fdcc6430700 1 -- 172.21.15.57:0/833495670 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc0095f0 con 0x7fdcc01046d0 2023-03-02T10:49:11.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.087+0000 7fdcc6430700 1 --2- 172.21.15.57:0/833495670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcc01046d0 0x7fdcc019a830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004f40 tx=0x7fdcbc005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:11.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.088+0000 7fdcb77fe700 1 -- 172.21.15.57:0/833495670 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcbc01d070 con 0x7fdcc01046d0 2023-03-02T10:49:11.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.088+0000 7fdcb77fe700 1 -- 172.21.15.57:0/833495670 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcbc004370 con 0x7fdcc01046d0 2023-03-02T10:49:11.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.088+0000 7fdcc8694700 1 -- 172.21.15.57:0/833495670 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc0109a40 con 0x7fdcc01046d0 2023-03-02T10:49:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.088+0000 7fdcb77fe700 1 -- 172.21.15.57:0/833495670 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcbc0039b0 con 0x7fdcc01046d0 2023-03-02T10:49:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.088+0000 7fdcc8694700 1 -- 172.21.15.57:0/833495670 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc01098b0 con 0x7fdcc01046d0 2023-03-02T10:49:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.089+0000 7fdcb77fe700 1 -- 172.21.15.57:0/833495670 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7fdcbc028030 con 0x7fdcc01046d0 2023-03-02T10:49:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.089+0000 7fdcc8694700 1 -- 172.21.15.57:0/833495670 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc0109bd0 con 0x7fdcc01046d0 2023-03-02T10:49:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.089+0000 7fdcb77fe700 1 --2- 172.21.15.57:0/833495670 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcac0368c0 0x7fdcac038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.089+0000 7fdcb77fe700 1 -- 172.21.15.57:0/833495670 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdcbc049a70 con 0x7fdcc01046d0 2023-03-02T10:49:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.089+0000 7fdcc5c2f700 1 --2- 172.21.15.57:0/833495670 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcac0368c0 0x7fdcac038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:11.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.090+0000 7fdcc5c2f700 1 --2- 172.21.15.57:0/833495670 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcac0368c0 0x7fdcac038d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0006fd0 tx=0x7fdcb0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:11.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.094+0000 7fdcb77fe700 1 -- 172.21.15.57:0/833495670 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fdcbc02a980 con 0x7fdcc01046d0 2023-03-02T10:49:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:10 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:11.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.296+0000 7fdcc8694700 1 -- 172.21.15.57:0/833495670 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdcc0195e20 con 0x7fdcac0368c0 2023-03-02T10:49:11.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.297+0000 7fdcb77fe700 1 -- 172.21.15.57:0/833495670 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fdcc0195e20 con 0x7fdcac0368c0 2023-03-02T10:49:11.298 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:49:11.299 INFO:teuthology.orchestra.run.smithi057.stdout:[{"addr": "172.21.15.57", "hostname": "smithi057", "labels": [], "status": ""}, {"addr": "172.21.15.122", "hostname": "smithi122", "labels": [], "status": ""}] 2023-03-02T10:49:11.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.299+0000 7fdcc8694700 1 -- 172.21.15.57:0/833495670 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcac0368c0 msgr2=0x7fdcac038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:11.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.299+0000 7fdcc8694700 1 --2- 172.21.15.57:0/833495670 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcac0368c0 0x7fdcac038d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0006fd0 tx=0x7fdcb0006e40 comp rx=0 tx=0).stop 2023-03-02T10:49:11.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.299+0000 7fdcc8694700 1 -- 172.21.15.57:0/833495670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcc01046d0 msgr2=0x7fdcc019a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:11.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.299+0000 7fdcc8694700 1 --2- 172.21.15.57:0/833495670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcc01046d0 0x7fdcc019a830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004f40 tx=0x7fdcbc005020 comp rx=0 tx=0).stop 2023-03-02T10:49:11.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.299+0000 7fdcc8694700 1 -- 172.21.15.57:0/833495670 shutdown_connections 2023-03-02T10:49:11.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.299+0000 7fdcc8694700 1 --2- 172.21.15.57:0/833495670 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcac0368c0 0x7fdcac038d70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:11.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.299+0000 7fdcc8694700 1 --2- 172.21.15.57:0/833495670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcc01046d0 0x7fdcc019a830 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:11.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.299+0000 7fdcc8694700 1 -- 172.21.15.57:0/833495670 >> 172.21.15.57:0/833495670 conn(0x7fdcc00756a0 msgr2=0x7fdcc0103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:11.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.299+0000 7fdcc8694700 1 -- 172.21.15.57:0/833495670 shutdown_connections 2023-03-02T10:49:11.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:11.299+0000 7fdcc8694700 1 -- 172.21.15.57:0/833495670 wait complete. 2023-03-02T10:49:11.775 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi136 2023-03-02T10:49:11.775 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-02T10:49:11.776 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.conf 2023-03-02T10:49:11.796 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-02T10:49:11.796 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:49:11.856 INFO:tasks.cephadm:Adding host smithi136 to orchestrator... 2023-03-02T10:49:11.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch host add smithi136 2023-03-02T10:49:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:12 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:12 smithi057 ceph-mon[92072]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:12 smithi057 ceph-mon[92072]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:49:12.592 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:49:14.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.127+0000 7f0179108700 1 -- 172.21.15.57:0/2900923644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01741035c0 msgr2=0x7f0174103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:14.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.127+0000 7f0179108700 1 --2- 172.21.15.57:0/2900923644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01741035c0 0x7f0174103990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0164009910 tx=0x7f0164009c20 comp rx=0 tx=0).stop 2023-03-02T10:49:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.127+0000 7f0179108700 1 -- 172.21.15.57:0/2900923644 shutdown_connections 2023-03-02T10:49:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.127+0000 7f0179108700 1 --2- 172.21.15.57:0/2900923644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01741035c0 0x7f0174103990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.127+0000 7f0179108700 1 -- 172.21.15.57:0/2900923644 >> 172.21.15.57:0/2900923644 conn(0x7f01740756a0 msgr2=0x7f0174075aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.127+0000 7f0179108700 1 -- 172.21.15.57:0/2900923644 shutdown_connections 2023-03-02T10:49:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.127+0000 7f0179108700 1 -- 172.21.15.57:0/2900923644 wait complete. 2023-03-02T10:49:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.128+0000 7f0179108700 1 Processor -- start 2023-03-02T10:49:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.128+0000 7f0179108700 1 -- start start 2023-03-02T10:49:14.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.128+0000 7f0179108700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01741035c0 0x7f017419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:14.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.128+0000 7f0179108700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017419ade0 con 0x7f01741035c0 2023-03-02T10:49:14.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.128+0000 7f0172d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01741035c0 0x7f017419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:14.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.128+0000 7f0172d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01741035c0 0x7f017419a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37924/0 (socket says 172.21.15.57:37924) 2023-03-02T10:49:14.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.128+0000 7f0172d9d700 1 -- 172.21.15.57:0/2478578248 learned_addr learned my addr 172.21.15.57:0/2478578248 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:49:14.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.129+0000 7f0172d9d700 1 -- 172.21.15.57:0/2478578248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01640095f0 con 0x7f01741035c0 2023-03-02T10:49:14.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.129+0000 7f0172d9d700 1 --2- 172.21.15.57:0/2478578248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01741035c0 0x7f017419a8a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0164005850 tx=0x7f0164004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:14.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.129+0000 7f015bfff700 1 -- 172.21.15.57:0/2478578248 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f016401d070 con 0x7f01741035c0 2023-03-02T10:49:14.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.129+0000 7f015bfff700 1 -- 172.21.15.57:0/2478578248 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0164004370 con 0x7f01741035c0 2023-03-02T10:49:14.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.129+0000 7f0179108700 1 -- 172.21.15.57:0/2478578248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0174108950 con 0x7f01741035c0 2023-03-02T10:49:14.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.129+0000 7f015bfff700 1 -- 172.21.15.57:0/2478578248 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0164003ab0 con 0x7f01741035c0 2023-03-02T10:49:14.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.129+0000 7f0179108700 1 -- 172.21.15.57:0/2478578248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01741087c0 con 0x7f01741035c0 2023-03-02T10:49:14.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.130+0000 7f015bfff700 1 -- 172.21.15.57:0/2478578248 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7f0164028030 con 0x7f01741035c0 2023-03-02T10:49:14.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.130+0000 7f015bfff700 1 --2- 172.21.15.57:0/2478578248 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f015c0368c0 0x7f015c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:14.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.130+0000 7f015bfff700 1 -- 172.21.15.57:0/2478578248 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0164049a70 con 0x7f01741035c0 2023-03-02T10:49:14.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.131+0000 7f017259c700 1 --2- 172.21.15.57:0/2478578248 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f015c0368c0 0x7f015c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:14.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.131+0000 7f0179108700 1 -- 172.21.15.57:0/2478578248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0174108ae0 con 0x7f01741035c0 2023-03-02T10:49:14.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.131+0000 7f017259c700 1 --2- 172.21.15.57:0/2478578248 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f015c0368c0 0x7f015c038d70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0168006fd0 tx=0x7f0168006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:14.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.136+0000 7f015bfff700 1 -- 172.21.15.57:0/2478578248 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f0164026070 con 0x7f01741035c0 2023-03-02T10:49:14.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:14.342+0000 7f0179108700 1 -- 172.21.15.57:0/2478578248 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}) v1 -- 0x7f017419b2e0 con 0x7f015c0368c0 2023-03-02T10:49:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:14 smithi057 ceph-mon[92072]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:49:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:15 smithi057 ceph-mon[92072]: Updating smithi122:/etc/ceph/ceph.conf 2023-03-02T10:49:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:15 smithi057 ceph-mon[92072]: Updating smithi122:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:15 smithi057 ceph-mon[92072]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:49:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:15 smithi057 ceph-mon[92072]: Updating smithi122:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:49:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:15 smithi057 ceph-mon[92072]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:49:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:15.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:15.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:16.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:16.291+0000 7f015bfff700 1 -- 172.21.15.57:0/2478578248 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f017419b2e0 con 0x7f015c0368c0 2023-03-02T10:49:16.293 INFO:teuthology.orchestra.run.smithi057.stdout:Added host 'smithi136' with addr '172.21.15.136' 2023-03-02T10:49:16.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:16.294+0000 7f0179108700 1 -- 172.21.15.57:0/2478578248 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f015c0368c0 msgr2=0x7f015c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:16.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:16.294+0000 7f0179108700 1 --2- 172.21.15.57:0/2478578248 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f015c0368c0 0x7f015c038d70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0168006fd0 tx=0x7f0168006e40 comp rx=0 tx=0).stop 2023-03-02T10:49:16.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:16.294+0000 7f0179108700 1 -- 172.21.15.57:0/2478578248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01741035c0 msgr2=0x7f017419a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:16.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:16.294+0000 7f0179108700 1 --2- 172.21.15.57:0/2478578248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01741035c0 0x7f017419a8a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0164005850 tx=0x7f0164004ff0 comp rx=0 tx=0).stop 2023-03-02T10:49:16.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:16.294+0000 7f0179108700 1 -- 172.21.15.57:0/2478578248 shutdown_connections 2023-03-02T10:49:16.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:16.294+0000 7f0179108700 1 --2- 172.21.15.57:0/2478578248 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f015c0368c0 0x7f015c038d70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:16.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:16.294+0000 7f0179108700 1 --2- 172.21.15.57:0/2478578248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01741035c0 0x7f017419a8a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:16.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:16.294+0000 7f0179108700 1 -- 172.21.15.57:0/2478578248 >> 172.21.15.57:0/2478578248 conn(0x7f01740756a0 msgr2=0x7f01740675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:16.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:16.294+0000 7f0179108700 1 -- 172.21.15.57:0/2478578248 shutdown_connections 2023-03-02T10:49:16.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:16.294+0000 7f0179108700 1 -- 172.21.15.57:0/2478578248 wait complete. 2023-03-02T10:49:16.469 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:16 smithi057 ceph-mon[92072]: Deploying cephadm binary to smithi136 2023-03-02T10:49:16.470 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:16 smithi057 ceph-mon[92072]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:16.799 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch host ls --format=json 2023-03-02T10:49:17.528 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:49:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:17 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:17 smithi057 ceph-mon[92072]: Added host smithi136 2023-03-02T10:49:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:17 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:17 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:18.588 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:18 smithi057 ceph-mon[92072]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:18.588 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:18 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:18.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.794+0000 7fb57976d700 1 -- 172.21.15.57:0/3765972632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb574105730 msgr2=0x7fb574105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.794+0000 7fb57976d700 1 --2- 172.21.15.57:0/3765972632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb574105730 0x7fb574105b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb564009910 tx=0x7fb564009c20 comp rx=0 tx=0).stop 2023-03-02T10:49:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.794+0000 7fb57976d700 1 -- 172.21.15.57:0/3765972632 shutdown_connections 2023-03-02T10:49:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.794+0000 7fb57976d700 1 --2- 172.21.15.57:0/3765972632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb574105730 0x7fb574105b00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.794+0000 7fb57976d700 1 -- 172.21.15.57:0/3765972632 >> 172.21.15.57:0/3765972632 conn(0x7fb5740756a0 msgr2=0x7fb574075aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.794+0000 7fb57976d700 1 -- 172.21.15.57:0/3765972632 shutdown_connections 2023-03-02T10:49:18.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.794+0000 7fb57976d700 1 -- 172.21.15.57:0/3765972632 wait complete. 2023-03-02T10:49:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.795+0000 7fb57976d700 1 Processor -- start 2023-03-02T10:49:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.795+0000 7fb57976d700 1 -- start start 2023-03-02T10:49:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.795+0000 7fb57976d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb574105730 0x7fb5740feee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.795+0000 7fb57976d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb574100ec0 con 0x7fb574105730 2023-03-02T10:49:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.795+0000 7fb572ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb574105730 0x7fb5740feee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.795+0000 7fb572ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb574105730 0x7fb5740feee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53100/0 (socket says 172.21.15.57:53100) 2023-03-02T10:49:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.795+0000 7fb572ffd700 1 -- 172.21.15.57:0/4203948387 learned_addr learned my addr 172.21.15.57:0/4203948387 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:49:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.796+0000 7fb572ffd700 1 -- 172.21.15.57:0/4203948387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640095f0 con 0x7fb574105730 2023-03-02T10:49:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.796+0000 7fb572ffd700 1 --2- 172.21.15.57:0/4203948387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb574105730 0x7fb5740feee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb564005850 tx=0x7fb564004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.796+0000 7fb55bfff700 1 -- 172.21.15.57:0/4203948387 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb56401d070 con 0x7fb574105730 2023-03-02T10:49:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.796+0000 7fb57976d700 1 -- 172.21.15.57:0/4203948387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5741099f0 con 0x7fb574105730 2023-03-02T10:49:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.796+0000 7fb55bfff700 1 -- 172.21.15.57:0/4203948387 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb564004370 con 0x7fb574105730 2023-03-02T10:49:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.796+0000 7fb55bfff700 1 -- 172.21.15.57:0/4203948387 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb564003ab0 con 0x7fb574105730 2023-03-02T10:49:18.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.796+0000 7fb57976d700 1 -- 172.21.15.57:0/4203948387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb574109860 con 0x7fb574105730 2023-03-02T10:49:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.797+0000 7fb55bfff700 1 -- 172.21.15.57:0/4203948387 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7fb564028030 con 0x7fb574105730 2023-03-02T10:49:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.797+0000 7fb57976d700 1 -- 172.21.15.57:0/4203948387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb574109b80 con 0x7fb574105730 2023-03-02T10:49:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.797+0000 7fb55bfff700 1 --2- 172.21.15.57:0/4203948387 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb55c0368c0 0x7fb55c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.797+0000 7fb55bfff700 1 -- 172.21.15.57:0/4203948387 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb564049a90 con 0x7fb574105730 2023-03-02T10:49:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.798+0000 7fb5727fc700 1 --2- 172.21.15.57:0/4203948387 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb55c0368c0 0x7fb55c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.798+0000 7fb5727fc700 1 --2- 172.21.15.57:0/4203948387 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb55c0368c0 0x7fb55c038d70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb568006fd0 tx=0x7fb568006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:18.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:18.805+0000 7fb55bfff700 1 -- 172.21.15.57:0/4203948387 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fb5640044e0 con 0x7fb574105730 2023-03-02T10:49:19.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.007+0000 7fb57976d700 1 -- 172.21.15.57:0/4203948387 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb574100410 con 0x7fb55c0368c0 2023-03-02T10:49:19.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.008+0000 7fb55bfff700 1 -- 172.21.15.57:0/4203948387 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7fb574100410 con 0x7fb55c0368c0 2023-03-02T10:49:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:49:19.010 INFO:teuthology.orchestra.run.smithi057.stdout:[{"addr": "172.21.15.57", "hostname": "smithi057", "labels": [], "status": ""}, {"addr": "172.21.15.122", "hostname": "smithi122", "labels": [], "status": ""}, {"addr": "172.21.15.136", "hostname": "smithi136", "labels": [], "status": ""}] 2023-03-02T10:49:19.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.010+0000 7fb57976d700 1 -- 172.21.15.57:0/4203948387 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb55c0368c0 msgr2=0x7fb55c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:19.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.010+0000 7fb57976d700 1 --2- 172.21.15.57:0/4203948387 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb55c0368c0 0x7fb55c038d70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb568006fd0 tx=0x7fb568006e40 comp rx=0 tx=0).stop 2023-03-02T10:49:19.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.011+0000 7fb57976d700 1 -- 172.21.15.57:0/4203948387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb574105730 msgr2=0x7fb5740feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:19.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.011+0000 7fb57976d700 1 --2- 172.21.15.57:0/4203948387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb574105730 0x7fb5740feee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb564005850 tx=0x7fb564004ff0 comp rx=0 tx=0).stop 2023-03-02T10:49:19.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.011+0000 7fb57976d700 1 -- 172.21.15.57:0/4203948387 shutdown_connections 2023-03-02T10:49:19.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.011+0000 7fb57976d700 1 --2- 172.21.15.57:0/4203948387 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb55c0368c0 0x7fb55c038d70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:19.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.011+0000 7fb57976d700 1 --2- 172.21.15.57:0/4203948387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb574105730 0x7fb5740feee0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:19.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.011+0000 7fb57976d700 1 -- 172.21.15.57:0/4203948387 >> 172.21.15.57:0/4203948387 conn(0x7fb5740756a0 msgr2=0x7fb5740fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:19.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.011+0000 7fb57976d700 1 -- 172.21.15.57:0/4203948387 shutdown_connections 2023-03-02T10:49:19.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:19.011+0000 7fb57976d700 1 -- 172.21.15.57:0/4203948387 wait complete. 2023-03-02T10:49:19.540 INFO:tasks.cephadm:Setting crush tunables to default 2023-03-02T10:49:19.541 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd crush tunables default 2023-03-02T10:49:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:19 smithi057 ceph-mon[92072]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:49:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:19 smithi057 ceph-mon[92072]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:20.270 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:49:21.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.552+0000 7fed7a33b700 1 -- 172.21.15.57:0/901113527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed741035c0 msgr2=0x7fed74103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:21.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.552+0000 7fed7a33b700 1 --2- 172.21.15.57:0/901113527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed741035c0 0x7fed74103990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed64009910 tx=0x7fed64009c20 comp rx=0 tx=0).stop 2023-03-02T10:49:21.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.553+0000 7fed7a33b700 1 -- 172.21.15.57:0/901113527 shutdown_connections 2023-03-02T10:49:21.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.553+0000 7fed7a33b700 1 --2- 172.21.15.57:0/901113527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed741035c0 0x7fed74103990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:21.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.553+0000 7fed7a33b700 1 -- 172.21.15.57:0/901113527 >> 172.21.15.57:0/901113527 conn(0x7fed740756a0 msgr2=0x7fed74075aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:21.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.553+0000 7fed7a33b700 1 -- 172.21.15.57:0/901113527 shutdown_connections 2023-03-02T10:49:21.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.553+0000 7fed7a33b700 1 -- 172.21.15.57:0/901113527 wait complete. 2023-03-02T10:49:21.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.553+0000 7fed7a33b700 1 Processor -- start 2023-03-02T10:49:21.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.553+0000 7fed7a33b700 1 -- start start 2023-03-02T10:49:21.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.554+0000 7fed7a33b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed741035c0 0x7fed7419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:21.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.554+0000 7fed7a33b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7419cfb0 con 0x7fed741035c0 2023-03-02T10:49:21.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.554+0000 7fed73fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed741035c0 0x7fed7419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:21.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.554+0000 7fed73fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed741035c0 0x7fed7419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53118/0 (socket says 172.21.15.57:53118) 2023-03-02T10:49:21.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.554+0000 7fed73fff700 1 -- 172.21.15.57:0/3513974333 learned_addr learned my addr 172.21.15.57:0/3513974333 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:49:21.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.554+0000 7fed73fff700 1 -- 172.21.15.57:0/3513974333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640095f0 con 0x7fed741035c0 2023-03-02T10:49:21.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.554+0000 7fed73fff700 1 --2- 172.21.15.57:0/3513974333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed741035c0 0x7fed7419ca70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed64006010 tx=0x7fed64004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:21.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.555+0000 7fed71ffb700 1 -- 172.21.15.57:0/3513974333 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed6401d070 con 0x7fed741035c0 2023-03-02T10:49:21.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.555+0000 7fed71ffb700 1 -- 172.21.15.57:0/3513974333 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed640044a0 con 0x7fed741035c0 2023-03-02T10:49:21.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.555+0000 7fed7a33b700 1 -- 172.21.15.57:0/3513974333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed74108950 con 0x7fed741035c0 2023-03-02T10:49:21.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.555+0000 7fed71ffb700 1 -- 172.21.15.57:0/3513974333 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed64003a70 con 0x7fed741035c0 2023-03-02T10:49:21.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.555+0000 7fed7a33b700 1 -- 172.21.15.57:0/3513974333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed741087c0 con 0x7fed741035c0 2023-03-02T10:49:21.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.556+0000 7fed71ffb700 1 -- 172.21.15.57:0/3513974333 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7fed64028030 con 0x7fed741035c0 2023-03-02T10:49:21.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.556+0000 7fed7a33b700 1 -- 172.21.15.57:0/3513974333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed74108ae0 con 0x7fed741035c0 2023-03-02T10:49:21.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.556+0000 7fed71ffb700 1 --2- 172.21.15.57:0/3513974333 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fed60036900 0x7fed60038db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:21.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.556+0000 7fed71ffb700 1 -- 172.21.15.57:0/3513974333 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fed64049a90 con 0x7fed741035c0 2023-03-02T10:49:21.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.556+0000 7fed6bfff700 1 --2- 172.21.15.57:0/3513974333 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fed60036900 0x7fed60038db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:21.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.557+0000 7fed6bfff700 1 --2- 172.21.15.57:0/3513974333 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fed60036900 0x7fed60038db0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fed5c006fd0 tx=0x7fed5c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:21.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.561+0000 7fed71ffb700 1 -- 172.21.15.57:0/3513974333 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fed6402aba0 con 0x7fed741035c0 2023-03-02T10:49:21.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:21.764+0000 7fed7a33b700 1 -- 172.21.15.57:0/3513974333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fed74197ff0 con 0x7fed741035c0 2023-03-02T10:49:22.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:22.344+0000 7fed71ffb700 1 -- 172.21.15.57:0/3513974333 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fed64026020 con 0x7fed741035c0 2023-03-02T10:49:22.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:22.346+0000 7fed7a33b700 1 -- 172.21.15.57:0/3513974333 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fed60036900 msgr2=0x7fed60038db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:22.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:22.346+0000 7fed7a33b700 1 --2- 172.21.15.57:0/3513974333 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fed60036900 0x7fed60038db0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fed5c006fd0 tx=0x7fed5c006e40 comp rx=0 tx=0).stop 2023-03-02T10:49:22.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:22.346+0000 7fed7a33b700 1 -- 172.21.15.57:0/3513974333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed741035c0 msgr2=0x7fed7419ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:22.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:22.346+0000 7fed7a33b700 1 --2- 172.21.15.57:0/3513974333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed741035c0 0x7fed7419ca70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed64006010 tx=0x7fed64004ff0 comp rx=0 tx=0).stop 2023-03-02T10:49:22.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:22.346+0000 7fed7a33b700 1 -- 172.21.15.57:0/3513974333 shutdown_connections 2023-03-02T10:49:22.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:22.346+0000 7fed7a33b700 1 --2- 172.21.15.57:0/3513974333 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fed60036900 0x7fed60038db0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:22.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:22.346+0000 7fed7a33b700 1 --2- 172.21.15.57:0/3513974333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed741035c0 0x7fed7419ca70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:22.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:22.346+0000 7fed7a33b700 1 -- 172.21.15.57:0/3513974333 >> 172.21.15.57:0/3513974333 conn(0x7fed740756a0 msgr2=0x7fed74067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:22.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:22.346+0000 7fed7a33b700 1 -- 172.21.15.57:0/3513974333 shutdown_connections 2023-03-02T10:49:22.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:22.346+0000 7fed7a33b700 1 -- 172.21.15.57:0/3513974333 wait complete. 2023-03-02T10:49:22.349 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2023-03-02T10:49:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:49:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: Updating smithi136:/etc/ceph/ceph.conf 2023-03-02T10:49:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3513974333' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-03-02T10:49:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:22.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:22.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:22.770 INFO:tasks.cephadm:Adding mon.a on smithi057 2023-03-02T10:49:22.771 INFO:tasks.cephadm:Adding mon.b on smithi122 2023-03-02T10:49:22.771 INFO:tasks.cephadm:Adding mon.c on smithi136 2023-03-02T10:49:22.772 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch apply mon '3;smithi057:172.21.15.57=a;smithi122:172.21.15.122=b;smithi136:172.21.15.136=c' 2023-03-02T10:49:23.438 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:23 smithi057 ceph-mon[92072]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:23 smithi057 ceph-mon[92072]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:49:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:23 smithi057 ceph-mon[92072]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:49:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:23 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3513974333' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-03-02T10:49:23.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:23 smithi057 ceph-mon[92072]: osdmap e4: 0 total, 0 up, 0 in 2023-03-02T10:49:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.649+0000 7f563d755700 1 -- 172.21.15.136:0/685419102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5638104550 msgr2=0x7f5638104920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:24.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.649+0000 7f563d755700 1 --2- 172.21.15.136:0/685419102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5638104550 0x7f5638104920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5628009910 tx=0x7f5628009c20 comp rx=0 tx=0).stop 2023-03-02T10:49:24.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.649+0000 7f563d755700 1 -- 172.21.15.136:0/685419102 shutdown_connections 2023-03-02T10:49:24.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.649+0000 7f563d755700 1 --2- 172.21.15.136:0/685419102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5638104550 0x7f5638104920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:24.651 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.649+0000 7f563d755700 1 -- 172.21.15.136:0/685419102 >> 172.21.15.136:0/685419102 conn(0x7f56380fa020 msgr2=0x7f56380fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.649+0000 7f563d755700 1 -- 172.21.15.136:0/685419102 shutdown_connections 2023-03-02T10:49:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.649+0000 7f563d755700 1 -- 172.21.15.136:0/685419102 wait complete. 2023-03-02T10:49:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.650+0000 7f563d755700 1 Processor -- start 2023-03-02T10:49:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.650+0000 7f563d755700 1 -- start start 2023-03-02T10:49:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.650+0000 7f563d755700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5638104550 0x7f56380fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.650+0000 7f563d755700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380fc4a0 con 0x7f5638104550 2023-03-02T10:49:24.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.650+0000 7f5636ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5638104550 0x7f56380fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:24.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.650+0000 7f5636ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5638104550 0x7f56380fa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.136:38486/0 (socket says 172.21.15.136:38486) 2023-03-02T10:49:24.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.650+0000 7f5636ffd700 1 -- 172.21.15.136:0/245666682 learned_addr learned my addr 172.21.15.136:0/245666682 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-02T10:49:24.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.651+0000 7f5636ffd700 1 -- 172.21.15.136:0/245666682 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56280095f0 con 0x7f5638104550 2023-03-02T10:49:24.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.651+0000 7f5636ffd700 1 --2- 172.21.15.136:0/245666682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5638104550 0x7f56380fa4c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5628004f40 tx=0x7f5628005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:24.654 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.651+0000 7f561ffff700 1 -- 172.21.15.136:0/245666682 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f562801d070 con 0x7f5638104550 2023-03-02T10:49:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.651+0000 7f563d755700 1 -- 172.21.15.136:0/245666682 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56381088a0 con 0x7f5638104550 2023-03-02T10:49:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.651+0000 7f561ffff700 1 -- 172.21.15.136:0/245666682 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5628004370 con 0x7f5638104550 2023-03-02T10:49:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.651+0000 7f561ffff700 1 -- 172.21.15.136:0/245666682 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5628003a30 con 0x7f5638104550 2023-03-02T10:49:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.651+0000 7f563d755700 1 -- 172.21.15.136:0/245666682 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5638108710 con 0x7f5638104550 2023-03-02T10:49:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.652+0000 7f561ffff700 1 -- 172.21.15.136:0/245666682 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7f5628028030 con 0x7f5638104550 2023-03-02T10:49:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.652+0000 7f561ffff700 1 --2- 172.21.15.136:0/245666682 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56200368c0 0x7f5620038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.652+0000 7f563d755700 1 -- 172.21.15.136:0/245666682 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5638108a30 con 0x7f5638104550 2023-03-02T10:49:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.652+0000 7f561ffff700 1 -- 172.21.15.136:0/245666682 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5628049b60 con 0x7f5638104550 2023-03-02T10:49:24.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.653+0000 7f56367fc700 1 --2- 172.21.15.136:0/245666682 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56200368c0 0x7f5620038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:24.656 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.653+0000 7f56367fc700 1 --2- 172.21.15.136:0/245666682 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56200368c0 0x7f5620038d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f562c006fd0 tx=0x7f562c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:24.658 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.658+0000 7f561ffff700 1 -- 172.21.15.136:0/245666682 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f562802aa00 con 0x7f5638104550 2023-03-02T10:49:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:24 smithi057 ceph-mon[92072]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:24.850 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.848+0000 7f563d755700 1 -- 172.21.15.136:0/245666682 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi057:172.21.15.57=a;smithi122:172.21.15.122=b;smithi136:172.21.15.136=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f56380fbb20 con 0x7f56200368c0 2023-03-02T10:49:24.855 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.854+0000 7f561ffff700 1 -- 172.21.15.136:0/245666682 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f56380fbb20 con 0x7f56200368c0 2023-03-02T10:49:24.855 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled mon update... 2023-03-02T10:49:24.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.856+0000 7f563d755700 1 -- 172.21.15.136:0/245666682 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56200368c0 msgr2=0x7f5620038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:24.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.856+0000 7f563d755700 1 --2- 172.21.15.136:0/245666682 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56200368c0 0x7f5620038d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f562c006fd0 tx=0x7f562c006e40 comp rx=0 tx=0).stop 2023-03-02T10:49:24.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.856+0000 7f563d755700 1 -- 172.21.15.136:0/245666682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5638104550 msgr2=0x7f56380fa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:24.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.856+0000 7f563d755700 1 --2- 172.21.15.136:0/245666682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5638104550 0x7f56380fa4c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5628004f40 tx=0x7f5628005020 comp rx=0 tx=0).stop 2023-03-02T10:49:24.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.856+0000 7f563d755700 1 -- 172.21.15.136:0/245666682 shutdown_connections 2023-03-02T10:49:24.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.856+0000 7f563d755700 1 --2- 172.21.15.136:0/245666682 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56200368c0 0x7f5620038d70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:24.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.856+0000 7f563d755700 1 --2- 172.21.15.136:0/245666682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5638104550 0x7f56380fa4c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:24.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.856+0000 7f563d755700 1 -- 172.21.15.136:0/245666682 >> 172.21.15.136:0/245666682 conn(0x7f56380fa020 msgr2=0x7f5638068900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:24.858 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.857+0000 7f563d755700 1 -- 172.21.15.136:0/245666682 shutdown_connections 2023-03-02T10:49:24.859 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:24.857+0000 7f563d755700 1 -- 172.21.15.136:0/245666682 wait complete. 2023-03-02T10:49:25.299 DEBUG:teuthology.orchestra.run.smithi122:mon.b> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mon.b.service 2023-03-02T10:49:25.302 DEBUG:teuthology.orchestra.run.smithi136:mon.c> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mon.c.service 2023-03-02T10:49:25.304 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-03-02T10:49:25.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph mon dump -f json 2023-03-02T10:49:25.333 INFO:journalctl@ceph.mon.c.smithi136.stdout:-- Logs begin at Thu 2023-03-02 10:22:36 UTC. -- 2023-03-02T10:49:25.339 INFO:journalctl@ceph.mon.b.smithi122.stdout:-- Logs begin at Thu 2023-03-02 10:22:37 UTC. -- 2023-03-02T10:49:26.112 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:25 smithi057 ceph-mon[92072]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi057:172.21.15.57=a;smithi122:172.21.15.122=b;smithi136:172.21.15.136=c", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:49:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:25 smithi057 ceph-mon[92072]: Saving service mon spec with placement smithi057:172.21.15.57=a;smithi122:172.21.15.122=b;smithi136:172.21.15.136=c;count:3 2023-03-02T10:49:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:25 smithi057 ceph-mon[92072]: Deploying daemon mon.c on smithi136 2023-03-02T10:49:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:25 smithi057 ceph-mon[92072]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:27.695 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.693+0000 7faf9616d700 1 -- 172.21.15.136:0/3289411244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf90104560 msgr2=0x7faf90104930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:27.696 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.693+0000 7faf9616d700 1 --2- 172.21.15.136:0/3289411244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf90104560 0x7faf90104930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf80009910 tx=0x7faf80009c20 comp rx=0 tx=0).stop 2023-03-02T10:49:27.696 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.693+0000 7faf9616d700 1 -- 172.21.15.136:0/3289411244 shutdown_connections 2023-03-02T10:49:27.696 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.693+0000 7faf9616d700 1 --2- 172.21.15.136:0/3289411244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf90104560 0x7faf90104930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:27.696 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.693+0000 7faf9616d700 1 -- 172.21.15.136:0/3289411244 >> 172.21.15.136:0/3289411244 conn(0x7faf900fa010 msgr2=0x7faf900fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:27.696 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.693+0000 7faf9616d700 1 -- 172.21.15.136:0/3289411244 shutdown_connections 2023-03-02T10:49:27.697 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.693+0000 7faf9616d700 1 -- 172.21.15.136:0/3289411244 wait complete. 2023-03-02T10:49:27.697 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.694+0000 7faf9616d700 1 Processor -- start 2023-03-02T10:49:27.697 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.694+0000 7faf9616d700 1 -- start start 2023-03-02T10:49:27.697 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.695+0000 7faf9616d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf90104560 0x7faf90193630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:27.698 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.695+0000 7faf9616d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf90068ec0 con 0x7faf90104560 2023-03-02T10:49:27.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.695+0000 7faf8f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf90104560 0x7faf90193630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:27.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.695+0000 7faf8f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf90104560 0x7faf90193630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.136:38492/0 (socket says 172.21.15.136:38492) 2023-03-02T10:49:27.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.695+0000 7faf8f7fe700 1 -- 172.21.15.136:0/1214075165 learned_addr learned my addr 172.21.15.136:0/1214075165 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-02T10:49:27.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.695+0000 7faf8f7fe700 1 -- 172.21.15.136:0/1214075165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf800095f0 con 0x7faf90104560 2023-03-02T10:49:27.699 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.696+0000 7faf8f7fe700 1 --2- 172.21.15.136:0/1214075165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf90104560 0x7faf90193630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf80004f40 tx=0x7faf80005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:27.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.696+0000 7faf8cff9700 1 -- 172.21.15.136:0/1214075165 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf8001d070 con 0x7faf90104560 2023-03-02T10:49:27.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.696+0000 7faf9616d700 1 -- 172.21.15.136:0/1214075165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf901088b0 con 0x7faf90104560 2023-03-02T10:49:27.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.696+0000 7faf8cff9700 1 -- 172.21.15.136:0/1214075165 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf80004370 con 0x7faf90104560 2023-03-02T10:49:27.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.696+0000 7faf8cff9700 1 -- 172.21.15.136:0/1214075165 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf800039b0 con 0x7faf90104560 2023-03-02T10:49:27.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.696+0000 7faf9616d700 1 -- 172.21.15.136:0/1214075165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf90108720 con 0x7faf90104560 2023-03-02T10:49:27.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.697+0000 7faf8cff9700 1 -- 172.21.15.136:0/1214075165 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7faf80028030 con 0x7faf90104560 2023-03-02T10:49:27.700 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.697+0000 7faf8cff9700 1 --2- 172.21.15.136:0/1214075165 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf780368c0 0x7faf78038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:27.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.697+0000 7faf8cff9700 1 -- 172.21.15.136:0/1214075165 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7faf80049ca0 con 0x7faf90104560 2023-03-02T10:49:27.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.697+0000 7faf9616d700 1 -- 172.21.15.136:0/1214075165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf90108a40 con 0x7faf90104560 2023-03-02T10:49:27.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.697+0000 7faf8effd700 1 --2- 172.21.15.136:0/1214075165 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf780368c0 0x7faf78038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:27.701 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.698+0000 7faf8effd700 1 --2- 172.21.15.136:0/1214075165 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf780368c0 0x7faf78038d70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf84006fd0 tx=0x7faf84006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:27.703 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.702+0000 7faf8cff9700 1 -- 172.21.15.136:0/1214075165 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7faf80026070 con 0x7faf90104560 2023-03-02T10:49:27.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.980+0000 7faf9616d700 1 -- 172.21.15.136:0/1214075165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faf901037f0 con 0x7faf90104560 2023-03-02T10:49:27.982 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.981+0000 7faf8cff9700 1 -- 172.21.15.136:0/1214075165 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7faf80029360 con 0x7faf90104560 2023-03-02T10:49:27.983 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:49:27.983 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","modified":"2023-03-02T10:47:49.231223Z","created":"2023-03-02T10:47:49.231223Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-03-02T10:49:27.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.983+0000 7faf9616d700 1 -- 172.21.15.136:0/1214075165 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf780368c0 msgr2=0x7faf78038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:27.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.983+0000 7faf9616d700 1 --2- 172.21.15.136:0/1214075165 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf780368c0 0x7faf78038d70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf84006fd0 tx=0x7faf84006e40 comp rx=0 tx=0).stop 2023-03-02T10:49:27.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.983+0000 7faf9616d700 1 -- 172.21.15.136:0/1214075165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf90104560 msgr2=0x7faf90193630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:27.984 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.983+0000 7faf9616d700 1 --2- 172.21.15.136:0/1214075165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf90104560 0x7faf90193630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf80004f40 tx=0x7faf80005020 comp rx=0 tx=0).stop 2023-03-02T10:49:27.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.983+0000 7faf9616d700 1 -- 172.21.15.136:0/1214075165 shutdown_connections 2023-03-02T10:49:27.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.983+0000 7faf9616d700 1 --2- 172.21.15.136:0/1214075165 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf780368c0 0x7faf78038d70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:27.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.983+0000 7faf9616d700 1 --2- 172.21.15.136:0/1214075165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf90104560 0x7faf90193630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:27.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.983+0000 7faf9616d700 1 -- 172.21.15.136:0/1214075165 >> 172.21.15.136:0/1214075165 conn(0x7faf900fa010 msgr2=0x7faf900fac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:27.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.983+0000 7faf9616d700 1 -- 172.21.15.136:0/1214075165 shutdown_connections 2023-03-02T10:49:27.985 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:27.983+0000 7faf9616d700 1 -- 172.21.15.136:0/1214075165 wait complete. 2023-03-02T10:49:27.986 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2023-03-02T10:49:28.143 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:28 smithi136 ceph-mon[125702]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-03-02T10:49:28.418 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:28 smithi136 systemd[1]: Started Ceph mon.c for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:49:29.467 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-03-02T10:49:29.467 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph mon dump -f json 2023-03-02T10:49:30.109 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:49:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:49:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: mon.a calling monitor election 2023-03-02T10:49:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: mon.c calling monitor election 2023-03-02T10:49:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:33.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-03-02T10:49:33.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: monmap e2: 2 mons at {a=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],c=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} 2023-03-02T10:49:33.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: fsmap 2023-03-02T10:49:33.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: osdmap e4: 0 total, 0 up, 0 in 2023-03-02T10:49:33.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: mgrmap e13: x(active, since 44s) 2023-03-02T10:49:33.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T10:49:33.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:33.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:33.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:33.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:49:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: mon.a calling monitor election 2023-03-02T10:49:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: mon.c calling monitor election 2023-03-02T10:49:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-03-02T10:49:33.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: monmap e2: 2 mons at {a=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],c=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} 2023-03-02T10:49:33.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: fsmap 2023-03-02T10:49:33.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: osdmap e4: 0 total, 0 up, 0 in 2023-03-02T10:49:33.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: mgrmap e13: x(active, since 44s) 2023-03-02T10:49:33.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T10:49:33.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:33.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:33.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:33.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:34.270 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.269+0000 7f1ad8e33700 1 -- 172.21.15.136:0/1954455006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1abc0057d0 msgr2=0x7f1abc007c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:34.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.269+0000 7f1ad8e33700 1 --2- 172.21.15.136:0/1954455006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1abc0057d0 0x7f1abc007c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40fdd00 tx=0x7f1ac4010ec0 comp rx=0 tx=0).stop 2023-03-02T10:49:34.271 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.269+0000 7f1ad8e33700 1 -- 172.21.15.136:0/1954455006 shutdown_connections 2023-03-02T10:49:34.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.269+0000 7f1ad8e33700 1 --2- 172.21.15.136:0/1954455006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1abc0057d0 0x7f1abc007c50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:34.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.269+0000 7f1ad8e33700 1 -- 172.21.15.136:0/1954455006 >> 172.21.15.136:0/1954455006 conn(0x7f1ad4074b70 msgr2=0x7f1ad4074f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:34.272 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.269+0000 7f1ad8e33700 1 -- 172.21.15.136:0/1954455006 shutdown_connections 2023-03-02T10:49:34.273 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.269+0000 7f1ad8e33700 1 -- 172.21.15.136:0/1954455006 wait complete. 2023-03-02T10:49:34.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.271+0000 7f1ad8e33700 1 Processor -- start 2023-03-02T10:49:34.276 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.271+0000 7f1ad8e33700 1 -- start start 2023-03-02T10:49:34.277 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.271+0000 7f1ad8e33700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1abc0057d0 0x7f1ad4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:34.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.271+0000 7f1ad8e33700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ad4198f50 0x7f1ad4192870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:34.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.271+0000 7f1ad8e33700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4199480 con 0x7f1abc0057d0 2023-03-02T10:49:34.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.271+0000 7f1ad8e33700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad41995f0 con 0x7f1ad4198f50 2023-03-02T10:49:34.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.271+0000 7f1ad1d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ad4198f50 0x7f1ad4192870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:34.278 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.271+0000 7f1ad1d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ad4198f50 0x7f1ad4192870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35022/0 (socket says 172.21.15.136:35022) 2023-03-02T10:49:34.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.271+0000 7f1ad1d9b700 1 -- 172.21.15.136:0/2079349103 learned_addr learned my addr 172.21.15.136:0/2079349103 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-02T10:49:34.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.272+0000 7f1ad1d9b700 1 -- 172.21.15.136:0/2079349103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ad4198f50 msgr2=0x7f1ad4192870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-03-02T10:49:34.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.272+0000 7f1ad1d9b700 1 -- 172.21.15.136:0/2079349103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ad4198f50 msgr2=0x7f1ad4192870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T10:49:34.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.272+0000 7f1ad1d9b700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ad4198f50 0x7f1ad4192870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T10:49:34.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.272+0000 7f1ad259c700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1abc0057d0 0x7f1ad4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:34.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.272+0000 7f1ad1d9b700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ad4198f50 0x7f1ad4192870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-02T10:49:34.279 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.272+0000 7f1ad259c700 1 -- 172.21.15.136:0/2079349103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ad4198f50 msgr2=0x7f1ad4192870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-02T10:49:34.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.272+0000 7f1ad259c700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ad4198f50 0x7f1ad4192870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:34.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.272+0000 7f1ad259c700 1 -- 172.21.15.136:0/2079349103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4010910 con 0x7f1abc0057d0 2023-03-02T10:49:34.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.272+0000 7f1ad259c700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1abc0057d0 0x7f1ad4198a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ac401b000 tx=0x7f1ac40047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:34.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.272+0000 7f1ac37fe700 1 -- 172.21.15.136:0/2079349103 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f1ac4013b00 con 0x7f1abc0057d0 2023-03-02T10:49:34.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.273+0000 7f1ad8e33700 1 -- 172.21.15.136:0/2079349103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad41053d0 con 0x7f1abc0057d0 2023-03-02T10:49:34.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.273+0000 7f1ac37fe700 1 -- 172.21.15.136:0/2079349103 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ac40044f0 con 0x7f1abc0057d0 2023-03-02T10:49:34.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.273+0000 7f1ac37fe700 1 -- 172.21.15.136:0/2079349103 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f1ac4003c90 con 0x7f1abc0057d0 2023-03-02T10:49:34.280 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.273+0000 7f1ad8e33700 1 -- 172.21.15.136:0/2079349103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad4105240 con 0x7f1abc0057d0 2023-03-02T10:49:34.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.274+0000 7f1ac37fe700 1 -- 172.21.15.136:0/2079349103 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7f1ac4033070 con 0x7f1abc0057d0 2023-03-02T10:49:34.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.274+0000 7f1ad8e33700 1 -- 172.21.15.136:0/2079349103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad4105560 con 0x7f1abc0057d0 2023-03-02T10:49:34.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.274+0000 7f1ac37fe700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f1ab4036700 0x7f1ab4038bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:34.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.274+0000 7f1ac37fe700 1 -- 172.21.15.136:0/2079349103 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1ac404b140 con 0x7f1abc0057d0 2023-03-02T10:49:34.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.274+0000 7f1ad1d9b700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f1ab4036700 0x7f1ab4038bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:34.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.275+0000 7f1ad1d9b700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f1ab4036700 0x7f1ab4038bb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009180 tx=0x7f1ac8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:34.282 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.279+0000 7f1ac37fe700 1 -- 172.21.15.136:0/2079349103 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f1ac4023770 con 0x7f1abc0057d0 2023-03-02T10:49:34.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.538+0000 7f1ad8e33700 1 -- 172.21.15.136:0/2079349103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1ad4076690 con 0x7f1abc0057d0 2023-03-02T10:49:34.539 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.538+0000 7f1ac37fe700 1 -- 172.21.15.136:0/2079349103 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f1ac40192f0 con 0x7f1abc0057d0 2023-03-02T10:49:34.540 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:49:34.540 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":2,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","modified":"2023-03-02T10:49:28.107880Z","created":"2023-03-02T10:47:49.231223Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-03-02T10:49:34.541 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.540+0000 7f1ad8e33700 1 -- 172.21.15.136:0/2079349103 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f1ab4036700 msgr2=0x7f1ab4038bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:34.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.540+0000 7f1ad8e33700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f1ab4036700 0x7f1ab4038bb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009180 tx=0x7f1ac8008040 comp rx=0 tx=0).stop 2023-03-02T10:49:34.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.540+0000 7f1ad8e33700 1 -- 172.21.15.136:0/2079349103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1abc0057d0 msgr2=0x7f1ad4198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:34.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.540+0000 7f1ad8e33700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1abc0057d0 0x7f1ad4198a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ac401b000 tx=0x7f1ac40047a0 comp rx=0 tx=0).stop 2023-03-02T10:49:34.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.541+0000 7f1ad8e33700 1 -- 172.21.15.136:0/2079349103 shutdown_connections 2023-03-02T10:49:34.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.541+0000 7f1ad8e33700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f1ab4036700 0x7f1ab4038bb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:34.542 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.541+0000 7f1ad8e33700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1abc0057d0 0x7f1ad4198a10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:34.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.541+0000 7f1ad8e33700 1 --2- 172.21.15.136:0/2079349103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ad4198f50 0x7f1ad4192870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:34.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.541+0000 7f1ad8e33700 1 -- 172.21.15.136:0/2079349103 >> 172.21.15.136:0/2079349103 conn(0x7f1ad4074b70 msgr2=0x7f1ad40ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:34.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.541+0000 7f1ad8e33700 1 -- 172.21.15.136:0/2079349103 shutdown_connections 2023-03-02T10:49:34.543 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:34.541+0000 7f1ad8e33700 1 -- 172.21.15.136:0/2079349103 wait complete. 2023-03-02T10:49:34.543 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 2 2023-03-02T10:49:34.570 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:34 smithi136 ceph-mon[125702]: Deploying daemon mon.b on smithi122 2023-03-02T10:49:34.570 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:34 smithi136 ceph-mon[125702]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:34.570 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:34 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:34 smithi057 ceph-mon[92072]: Deploying daemon mon.b on smithi122 2023-03-02T10:49:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:34 smithi057 ceph-mon[92072]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:34 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:35 smithi136 ceph-mon[125702]: from='client.? 172.21.15.136:0/2079349103' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-03-02T10:49:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:35 smithi057 ceph-mon[92072]: from='client.? 172.21.15.136:0/2079349103' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-03-02T10:49:35.948 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:35 smithi122 systemd[1]: Starting Ceph mon.b for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:49:35.958 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-03-02T10:49:35.958 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph mon dump -f json 2023-03-02T10:49:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:35 smithi122 podman[125401]: 2023-03-02T10:49:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 bash[125401]: e1703f37e01d79bbf15ea1674068cd70e0615ecbaeb0915c8da251005ee857c8 2023-03-02T10:49:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: set uid:gid to 167:167 (ceph:ceph) 2023-03-02T10:49:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev), process ceph-mon, pid 7 2023-03-02T10:49:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: pidfile_write: ignore empty --pid-file 2023-03-02T10:49:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: load: jerasure load: lrc 2023-03-02T10:49:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: RocksDB version: 6.15.5 2023-03-02T10:49:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-03-02T10:49:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Compile date Feb 22 2023 2023-03-02T10:49:36.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: DB SUMMARY 2023-03-02T10:49:36.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: DB Session ID: INSEP9NKK1OKV8B59P3R 2023-03-02T10:49:36.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: CURRENT file: CURRENT 2023-03-02T10:49:36.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: IDENTITY file: IDENTITY 2023-03-02T10:49:36.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2023-03-02T10:49:36.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-03-02T10:49:36.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-03-02T10:49:36.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.error_if_exists: 0 2023-03-02T10:49:36.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.create_if_missing: 0 2023-03-02T10:49:36.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.paranoid_checks: 1 2023-03-02T10:49:36.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-03-02T10:49:36.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.env: 0x55faacd6b4a0 2023-03-02T10:49:36.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.fs: Posix File System 2023-03-02T10:49:36.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.info_log: 0x55faae23e480 2023-03-02T10:49:36.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_file_opening_threads: 16 2023-03-02T10:49:36.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.statistics: (nil) 2023-03-02T10:49:36.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.use_fsync: 0 2023-03-02T10:49:36.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_log_file_size: 0 2023-03-02T10:49:36.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-03-02T10:49:36.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.log_file_time_to_roll: 0 2023-03-02T10:49:36.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.keep_log_file_num: 1000 2023-03-02T10:49:36.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.recycle_log_file_num: 0 2023-03-02T10:49:36.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.allow_fallocate: 1 2023-03-02T10:49:36.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.allow_mmap_reads: 0 2023-03-02T10:49:36.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.allow_mmap_writes: 0 2023-03-02T10:49:36.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.use_direct_reads: 0 2023-03-02T10:49:36.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-03-02T10:49:36.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.create_missing_column_families: 0 2023-03-02T10:49:36.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.db_log_dir: 2023-03-02T10:49:36.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2023-03-02T10:49:36.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.table_cache_numshardbits: 6 2023-03-02T10:49:36.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.WAL_ttl_seconds: 0 2023-03-02T10:49:36.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.WAL_size_limit_MB: 0 2023-03-02T10:49:36.209 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-03-02T10:49:36.209 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-03-02T10:49:36.209 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.is_fd_close_on_exec: 1 2023-03-02T10:49:36.209 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.advise_random_on_open: 1 2023-03-02T10:49:36.209 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.db_write_buffer_size: 0 2023-03-02T10:49:36.209 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.write_buffer_manager: 0x55faae4b2f30 2023-03-02T10:49:36.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-03-02T10:49:36.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-03-02T10:49:36.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-03-02T10:49:36.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.use_adaptive_mutex: 0 2023-03-02T10:49:36.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.rate_limiter: (nil) 2023-03-02T10:49:36.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-03-02T10:49:36.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.wal_recovery_mode: 2 2023-03-02T10:49:36.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.enable_thread_tracking: 0 2023-03-02T10:49:36.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.enable_pipelined_write: 0 2023-03-02T10:49:36.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.unordered_write: 0 2023-03-02T10:49:36.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-03-02T10:49:36.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-03-02T10:49:36.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-03-02T10:49:36.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-03-02T10:49:36.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.row_cache: None 2023-03-02T10:49:36.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.wal_filter: None 2023-03-02T10:49:36.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-03-02T10:49:36.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.allow_ingest_behind: 0 2023-03-02T10:49:36.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.preserve_deletes: 0 2023-03-02T10:49:36.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.two_write_queues: 0 2023-03-02T10:49:36.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.manual_wal_flush: 0 2023-03-02T10:49:36.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.atomic_flush: 0 2023-03-02T10:49:36.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-03-02T10:49:36.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.persist_stats_to_disk: 0 2023-03-02T10:49:36.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.write_dbid_to_manifest: 0 2023-03-02T10:49:36.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.log_readahead_size: 0 2023-03-02T10:49:36.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-03-02T10:49:36.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.best_efforts_recovery: 0 2023-03-02T10:49:36.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-03-02T10:49:36.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-03-02T10:49:36.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.allow_data_in_errors: 0 2023-03-02T10:49:36.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.db_host_id: __hostname__ 2023-03-02T10:49:36.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_background_jobs: 2 2023-03-02T10:49:36.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_background_compactions: -1 2023-03-02T10:49:36.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_subcompactions: 1 2023-03-02T10:49:36.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-03-02T10:49:36.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-03-02T10:49:36.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.delayed_write_rate : 16777216 2023-03-02T10:49:36.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_total_wal_size: 0 2023-03-02T10:49:36.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-03-02T10:49:36.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.stats_dump_period_sec: 600 2023-03-02T10:49:36.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.stats_persist_period_sec: 600 2023-03-02T10:49:36.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-03-02T10:49:36.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_open_files: -1 2023-03-02T10:49:36.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.bytes_per_sync: 0 2023-03-02T10:49:36.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.wal_bytes_per_sync: 0 2023-03-02T10:49:36.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.strict_bytes_per_sync: 0 2023-03-02T10:49:36.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_readahead_size: 0 2023-03-02T10:49:36.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_background_flushes: -1 2023-03-02T10:49:36.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Compression algorithms supported: 2023-03-02T10:49:36.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-03-02T10:49:36.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: kZSTD supported: 0 2023-03-02T10:49:36.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: kXpressCompression supported: 0 2023-03-02T10:49:36.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: kLZ4HCCompression supported: 1 2023-03-02T10:49:36.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: kZlibCompression supported: 1 2023-03-02T10:49:36.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: kSnappyCompression supported: 1 2023-03-02T10:49:36.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: kLZ4Compression supported: 1 2023-03-02T10:49:36.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: kBZip2Compression supported: 0 2023-03-02T10:49:36.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Fast CRC32 supported: Supported on x86 2023-03-02T10:49:36.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 2023-03-02T10:49:36.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-03-02T10:49:36.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-03-02T10:49:36.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.merge_operator: 2023-03-02T10:49:36.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_filter: None 2023-03-02T10:49:36.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_filter_factory: None 2023-03-02T10:49:36.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.sst_partitioner_factory: None 2023-03-02T10:49:36.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.memtable_factory: SkipListFactory 2023-03-02T10:49:36.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.table_factory: BlockBasedTable 2023-03-02T10:49:36.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55faae1bdb20) 2023-03-02T10:49:36.220 INFO:journalctl@ceph.mon.b.smithi122.stdout: cache_index_and_filter_blocks: 1 2023-03-02T10:49:36.220 INFO:journalctl@ceph.mon.b.smithi122.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-03-02T10:49:36.220 INFO:journalctl@ceph.mon.b.smithi122.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-03-02T10:49:36.220 INFO:journalctl@ceph.mon.b.smithi122.stdout: pin_top_level_index_and_filter: 1 2023-03-02T10:49:36.220 INFO:journalctl@ceph.mon.b.smithi122.stdout: index_type: 0 2023-03-02T10:49:36.221 INFO:journalctl@ceph.mon.b.smithi122.stdout: data_block_index_type: 0 2023-03-02T10:49:36.221 INFO:journalctl@ceph.mon.b.smithi122.stdout: index_shortening: 1 2023-03-02T10:49:36.221 INFO:journalctl@ceph.mon.b.smithi122.stdout: data_block_hash_table_util_ratio: 0.750000 2023-03-02T10:49:36.221 INFO:journalctl@ceph.mon.b.smithi122.stdout: hash_index_allow_collision: 1 2023-03-02T10:49:36.221 INFO:journalctl@ceph.mon.b.smithi122.stdout: checksum: 1 2023-03-02T10:49:36.221 INFO:journalctl@ceph.mon.b.smithi122.stdout: no_block_cache: 0 2023-03-02T10:49:36.222 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_cache: 0x55faae27b350 2023-03-02T10:49:36.222 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_cache_name: BinnedLRUCache 2023-03-02T10:49:36.222 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_cache_options: 2023-03-02T10:49:36.222 INFO:journalctl@ceph.mon.b.smithi122.stdout: capacity : 536870912 2023-03-02T10:49:36.222 INFO:journalctl@ceph.mon.b.smithi122.stdout: num_shard_bits : 4 2023-03-02T10:49:36.222 INFO:journalctl@ceph.mon.b.smithi122.stdout: strict_capacity_limit : 0 2023-03-02T10:49:36.222 INFO:journalctl@ceph.mon.b.smithi122.stdout: high_pri_pool_ratio: 0.000 2023-03-02T10:49:36.223 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_cache_compressed: (nil) 2023-03-02T10:49:36.223 INFO:journalctl@ceph.mon.b.smithi122.stdout: persistent_cache: (nil) 2023-03-02T10:49:36.223 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_size: 4096 2023-03-02T10:49:36.223 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_size_deviation: 10 2023-03-02T10:49:36.223 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_restart_interval: 16 2023-03-02T10:49:36.223 INFO:journalctl@ceph.mon.b.smithi122.stdout: index_block_restart_interval: 1 2023-03-02T10:49:36.223 INFO:journalctl@ceph.mon.b.smithi122.stdout: metadata_block_size: 4096 2023-03-02T10:49:36.224 INFO:journalctl@ceph.mon.b.smithi122.stdout: partition_filters: 0 2023-03-02T10:49:36.224 INFO:journalctl@ceph.mon.b.smithi122.stdout: use_delta_encoding: 1 2023-03-02T10:49:36.224 INFO:journalctl@ceph.mon.b.smithi122.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-03-02T10:49:36.224 INFO:journalctl@ceph.mon.b.smithi122.stdout: whole_key_filtering: 1 2023-03-02T10:49:36.224 INFO:journalctl@ceph.mon.b.smithi122.stdout: verify_compression: 0 2023-03-02T10:49:36.224 INFO:journalctl@ceph.mon.b.smithi122.stdout: read_amp_bytes_per_bit: 0 2023-03-02T10:49:36.224 INFO:journalctl@ceph.mon.b.smithi122.stdout: format_version: 4 2023-03-02T10:49:36.224 INFO:journalctl@ceph.mon.b.smithi122.stdout: enable_index_compression: 1 2023-03-02T10:49:36.225 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_align: 0 2023-03-02T10:49:36.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.write_buffer_size: 33554432 2023-03-02T10:49:36.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_write_buffer_number: 2 2023-03-02T10:49:36.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compression: NoCompression 2023-03-02T10:49:36.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.bottommost_compression: Disabled 2023-03-02T10:49:36.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.prefix_extractor: nullptr 2023-03-02T10:49:36.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-03-02T10:49:36.226 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.num_levels: 7 2023-03-02T10:49:36.226 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-03-02T10:49:36.226 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-03-02T10:49:36.226 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-03-02T10:49:36.226 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-03-02T10:49:36.226 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-03-02T10:49:36.226 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-03-02T10:49:36.226 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-03-02T10:49:36.227 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-03-02T10:49:36.227 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-03-02T10:49:36.227 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-03-02T10:49:36.228 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compression_opts.window_bits: -14 2023-03-02T10:49:36.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compression_opts.level: 32767 2023-03-02T10:49:36.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compression_opts.strategy: 0 2023-03-02T10:49:36.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-03-02T10:49:36.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-03-02T10:49:36.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-03-02T10:49:36.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compression_opts.enabled: false 2023-03-02T10:49:36.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-03-02T10:49:36.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-03-02T10:49:36.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-03-02T10:49:36.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.target_file_size_base: 67108864 2023-03-02T10:49:36.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.target_file_size_multiplier: 1 2023-03-02T10:49:36.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-03-02T10:49:36.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-03-02T10:49:36.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-03-02T10:49:36.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-03-02T10:49:36.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-03-02T10:49:36.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-03-02T10:49:36.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-03-02T10:49:36.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-03-02T10:49:36.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-03-02T10:49:36.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-03-02T10:49:36.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-03-02T10:49:36.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-03-02T10:49:36.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.arena_block_size: 4194304 2023-03-02T10:49:36.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-03-02T10:49:36.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-03-02T10:49:36.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-03-02T10:49:36.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.disable_auto_compactions: 0 2023-03-02T10:49:36.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-03-02T10:49:36.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-03-02T10:49:36.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-03-02T10:49:36.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-03-02T10:49:36.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-03-02T10:49:36.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-03-02T10:49:36.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-03-02T10:49:36.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-03-02T10:49:36.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-03-02T10:49:36.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-03-02T10:49:36.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.table_properties_collectors: 2023-03-02T10:49:36.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.inplace_update_support: 0 2023-03-02T10:49:36.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.inplace_update_num_locks: 10000 2023-03-02T10:49:36.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-03-02T10:49:36.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-03-02T10:49:36.236 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.memtable_huge_page_size: 0 2023-03-02T10:49:36.236 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.bloom_locality: 0 2023-03-02T10:49:36.236 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.max_successive_merges: 0 2023-03-02T10:49:36.236 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.optimize_filters_for_hits: 0 2023-03-02T10:49:36.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.paranoid_file_checks: 0 2023-03-02T10:49:36.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.force_consistency_checks: 1 2023-03-02T10:49:36.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.report_bg_io_stats: 0 2023-03-02T10:49:36.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.ttl: 2592000 2023-03-02T10:49:36.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.periodic_compaction_seconds: 0 2023-03-02T10:49:36.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.enable_blob_files: false 2023-03-02T10:49:36.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.min_blob_size: 0 2023-03-02T10:49:36.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.blob_file_size: 268435456 2023-03-02T10:49:36.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.blob_compression_type: NoCompression 2023-03-02T10:49:36.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.enable_blob_garbage_collection: false 2023-03-02T10:49:36.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-03-02T10:49:36.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-03-02T10:49:36.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2023-03-02T10:49:36.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2023-03-02T10:49:36.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: EVENT_LOG_v1 {"time_micros": 1677754176161178, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-03-02T10:49:36.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2023-03-02T10:49:36.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-03-02T10:49:36.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: EVENT_LOG_v1 {"time_micros": 1677754176161585, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1670, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1677754176, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "daf472f3-f396-4945-aba4-1f865ed8b03b", "db_session_id": "INSEP9NKK1OKV8B59P3R"}} 2023-03-02T10:49:36.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2023-03-02T10:49:36.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: EVENT_LOG_v1 {"time_micros": 1677754176162310, "job": 1, "event": "recovery_finished"} 2023-03-02T10:49:36.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-03-02T10:49:36.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55faae20f880 2023-03-02T10:49:36.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: DB pointer 0x55faae24c000 2023-03-02T10:49:36.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-03-02T10:49:36.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-03-02T10:49:36.243 INFO:journalctl@ceph.mon.b.smithi122.stdout: ** DB Stats ** 2023-03-02T10:49:36.244 INFO:journalctl@ceph.mon.b.smithi122.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-03-02T10:49:36.244 INFO:journalctl@ceph.mon.b.smithi122.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-03-02T10:49:36.244 INFO:journalctl@ceph.mon.b.smithi122.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-03-02T10:49:36.244 INFO:journalctl@ceph.mon.b.smithi122.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-03-02T10:49:36.245 INFO:journalctl@ceph.mon.b.smithi122.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-03-02T10:49:36.245 INFO:journalctl@ceph.mon.b.smithi122.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-03-02T10:49:36.245 INFO:journalctl@ceph.mon.b.smithi122.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-03-02T10:49:36.245 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2023-03-02T10:49:36.246 INFO:journalctl@ceph.mon.b.smithi122.stdout: ** Compaction Stats [default] ** 2023-03-02T10:49:36.246 INFO:journalctl@ceph.mon.b.smithi122.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-03-02T10:49:36.246 INFO:journalctl@ceph.mon.b.smithi122.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-03-02T10:49:36.246 INFO:journalctl@ceph.mon.b.smithi122.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-03-02T10:49:36.247 INFO:journalctl@ceph.mon.b.smithi122.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-03-02T10:49:36.247 INFO:journalctl@ceph.mon.b.smithi122.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-03-02T10:49:36.247 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2023-03-02T10:49:36.247 INFO:journalctl@ceph.mon.b.smithi122.stdout: ** Compaction Stats [default] ** 2023-03-02T10:49:36.248 INFO:journalctl@ceph.mon.b.smithi122.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-03-02T10:49:36.248 INFO:journalctl@ceph.mon.b.smithi122.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-03-02T10:49:36.248 INFO:journalctl@ceph.mon.b.smithi122.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-03-02T10:49:36.249 INFO:journalctl@ceph.mon.b.smithi122.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-03-02T10:49:36.249 INFO:journalctl@ceph.mon.b.smithi122.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-03-02T10:49:36.249 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-03-02T10:49:36.249 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-03-02T10:49:36.250 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-03-02T10:49:36.250 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(Keys): cumulative 0, interval 0 2023-03-02T10:49:36.250 INFO:journalctl@ceph.mon.b.smithi122.stdout: Cumulative compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-03-02T10:49:36.250 INFO:journalctl@ceph.mon.b.smithi122.stdout: Interval compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-03-02T10:49:36.251 INFO:journalctl@ceph.mon.b.smithi122.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-03-02T10:49:36.251 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2023-03-02T10:49:36.251 INFO:journalctl@ceph.mon.b.smithi122.stdout: ** File Read Latency Histogram By Level [default] ** 2023-03-02T10:49:36.252 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2023-03-02T10:49:36.252 INFO:journalctl@ceph.mon.b.smithi122.stdout: ** Compaction Stats [default] ** 2023-03-02T10:49:36.252 INFO:journalctl@ceph.mon.b.smithi122.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-03-02T10:49:36.252 INFO:journalctl@ceph.mon.b.smithi122.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-03-02T10:49:36.253 INFO:journalctl@ceph.mon.b.smithi122.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-03-02T10:49:36.253 INFO:journalctl@ceph.mon.b.smithi122.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-03-02T10:49:36.253 INFO:journalctl@ceph.mon.b.smithi122.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-03-02T10:49:36.253 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2023-03-02T10:49:36.254 INFO:journalctl@ceph.mon.b.smithi122.stdout: ** Compaction Stats [default] ** 2023-03-02T10:49:36.254 INFO:journalctl@ceph.mon.b.smithi122.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-03-02T10:49:36.254 INFO:journalctl@ceph.mon.b.smithi122.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-03-02T10:49:36.254 INFO:journalctl@ceph.mon.b.smithi122.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-03-02T10:49:36.255 INFO:journalctl@ceph.mon.b.smithi122.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-03-02T10:49:36.255 INFO:journalctl@ceph.mon.b.smithi122.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-03-02T10:49:36.255 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-03-02T10:49:36.255 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-03-02T10:49:36.256 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-03-02T10:49:36.256 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(Keys): cumulative 0, interval 0 2023-03-02T10:49:36.256 INFO:journalctl@ceph.mon.b.smithi122.stdout: Cumulative compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-03-02T10:49:36.256 INFO:journalctl@ceph.mon.b.smithi122.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-03-02T10:49:36.257 INFO:journalctl@ceph.mon.b.smithi122.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-03-02T10:49:36.257 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2023-03-02T10:49:36.257 INFO:journalctl@ceph.mon.b.smithi122.stdout: ** File Read Latency Histogram By Level [default] ** 2023-03-02T10:49:36.257 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-03-02T10:49:36.258 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: using public_addr v2:172.21.15.122:0/0 -> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] 2023-03-02T10:49:36.258 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: starting mon.b rank -1 at public addrs [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] at bind addrs [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:49:36.258 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(???) e0 preinit fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:49:36.258 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).mds e1 new map 2023-03-02T10:49:36.259 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).mds e1 print_map 2023-03-02T10:49:36.259 INFO:journalctl@ceph.mon.b.smithi122.stdout: e1 2023-03-02T10:49:36.259 INFO:journalctl@ceph.mon.b.smithi122.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-03-02T10:49:36.259 INFO:journalctl@ceph.mon.b.smithi122.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-03-02T10:49:36.259 INFO:journalctl@ceph.mon.b.smithi122.stdout: legacy client fscid: -1 2023-03-02T10:49:36.259 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2023-03-02T10:49:36.259 INFO:journalctl@ceph.mon.b.smithi122.stdout: No filesystems configured 2023-03-02T10:49:36.260 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-03-02T10:49:36.260 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-03-02T10:49:36.260 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-03-02T10:49:36.260 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-03-02T10:49:36.260 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-03-02T10:49:36.260 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-03-02T10:49:36.260 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-03-02T10:49:36.261 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-03-02T10:49:36.261 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-03-02T10:49:36.261 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-03-02T10:49:36.261 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: Deploying cephadm binary to smithi136 2023-03-02T10:49:36.261 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:36.261 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.262 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: Added host smithi136 2023-03-02T10:49:36.262 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:36.262 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.262 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:36.262 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.262 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.262 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:49:36.262 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:36.263 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:36.263 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.263 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.263 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.263 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.263 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:49:36.263 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:36.263 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:36.264 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: Updating smithi136:/etc/ceph/ceph.conf 2023-03-02T10:49:36.264 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3513974333' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-03-02T10:49:36.264 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.264 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.264 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.264 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:36.264 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:49:36.265 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:49:36.265 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3513974333' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-03-02T10:49:36.265 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: osdmap e4: 0 total, 0 up, 0 in 2023-03-02T10:49:36.265 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:36.265 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi057:172.21.15.57=a;smithi122:172.21.15.122=b;smithi136:172.21.15.136=c", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:49:36.265 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: Saving service mon spec with placement smithi057:172.21.15.57=a;smithi122:172.21.15.122=b;smithi136:172.21.15.136=c;count:3 2023-03-02T10:49:36.265 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.266 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:36.266 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:36.266 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:36.266 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.266 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:36.266 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:36.266 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: Deploying daemon mon.c on smithi136 2023-03-02T10:49:36.267 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:36.267 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:49:36.267 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:36.267 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.a calling monitor election 2023-03-02T10:49:36.267 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:36.267 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:36.267 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:36.267 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.c calling monitor election 2023-03-02T10:49:36.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:36.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:36.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:36.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:36.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-03-02T10:49:36.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: monmap e2: 2 mons at {a=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],c=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} 2023-03-02T10:49:36.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: fsmap 2023-03-02T10:49:36.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: osdmap e4: 0 total, 0 up, 0 in 2023-03-02T10:49:36.269 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mgrmap e13: x(active, since 44s) 2023-03-02T10:49:36.269 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T10:49:36.269 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.269 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:36.269 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:36.269 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:36.269 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: Deploying daemon mon.b on smithi122 2023-03-02T10:49:36.270 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:36.270 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:36.270 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: from='client.? 172.21.15.136:0/2079349103' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-03-02T10:49:36.270 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-03-02T10:49:36.270 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 ceph-mon[125440]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-03-02T10:49:36.607 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:49:36.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:36 smithi122 systemd[1]: Started Ceph mon.b for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:49:41.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.399+0000 7fcfb6b25700 1 -- 172.21.15.136:0/4132227148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb0104660 msgr2=0x7fcfa0007820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:41.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.399+0000 7fcfb6b25700 1 --2- 172.21.15.136:0/4132227148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb0104660 0x7fcfa0007820 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4014c90 tx=0x7fcfa400f4a0 comp rx=0 tx=0).stop 2023-03-02T10:49:41.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.399+0000 7fcfb6b25700 1 -- 172.21.15.136:0/4132227148 shutdown_connections 2023-03-02T10:49:41.400 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.399+0000 7fcfb6b25700 1 --2- 172.21.15.136:0/4132227148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb0104660 0x7fcfa0007820 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:41.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.399+0000 7fcfb6b25700 1 -- 172.21.15.136:0/4132227148 >> 172.21.15.136:0/4132227148 conn(0x7fcfb0074360 msgr2=0x7fcfb0074760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:41.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.399+0000 7fcfb6b25700 1 -- 172.21.15.136:0/4132227148 shutdown_connections 2023-03-02T10:49:41.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.399+0000 7fcfb6b25700 1 -- 172.21.15.136:0/4132227148 wait complete. 2023-03-02T10:49:41.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.400+0000 7fcfb6b25700 1 Processor -- start 2023-03-02T10:49:41.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.400+0000 7fcfb6b25700 1 -- start start 2023-03-02T10:49:41.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.400+0000 7fcfb6b25700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb0104660 0x7fcfb01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:41.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.400+0000 7fcfb6b25700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0198d20 0x7fcfb0192850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:41.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.400+0000 7fcfb6b25700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb0192d90 0x7fcfb0193230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:41.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.400+0000 7fcfb6b25700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0199330 con 0x7fcfb0192d90 2023-03-02T10:49:41.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.400+0000 7fcfb6b25700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb019f5f0 con 0x7fcfb0198d20 2023-03-02T10:49:41.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.400+0000 7fcfb6b25700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb019f760 con 0x7fcfb0104660 2023-03-02T10:49:41.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.400+0000 7fcfb48c1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb0104660 0x7fcfb01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:41.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.400+0000 7fcfb48c1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb0104660 0x7fcfb01987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35044/0 (socket says 172.21.15.136:35044) 2023-03-02T10:49:41.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.400+0000 7fcfb48c1700 1 -- 172.21.15.136:0/2750469753 learned_addr learned my addr 172.21.15.136:0/2750469753 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-02T10:49:41.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb50c2700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb0192d90 0x7fcfb0193230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:41.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb48c1700 1 -- 172.21.15.136:0/2750469753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb0104660 msgr2=0x7fcfb01987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-03-02T10:49:41.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb48c1700 1 -- 172.21.15.136:0/2750469753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb0104660 msgr2=0x7fcfb01987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T10:49:41.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb48c1700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb0104660 0x7fcfb01987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T10:49:41.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb48c1700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb0104660 0x7fcfb01987e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-02T10:49:41.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfaffff700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0198d20 0x7fcfb0192850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:41.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfaffff700 1 -- 172.21.15.136:0/2750469753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0198d20 msgr2=0x7fcfb0192850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-03-02T10:49:41.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfaffff700 1 -- 172.21.15.136:0/2750469753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0198d20 msgr2=0x7fcfb0192850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T10:49:41.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfaffff700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0198d20 0x7fcfb0192850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T10:49:41.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb50c2700 1 -- 172.21.15.136:0/2750469753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb0104660 msgr2=0x7fcfb01987e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-02T10:49:41.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb50c2700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb0104660 0x7fcfb01987e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:41.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfaffff700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0198d20 0x7fcfb0192850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-02T10:49:41.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb50c2700 1 -- 172.21.15.136:0/2750469753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0198d20 msgr2=0x7fcfb0192850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-02T10:49:41.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb50c2700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0198d20 0x7fcfb0192850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:41.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb50c2700 1 -- 172.21.15.136:0/2750469753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa4014970 con 0x7fcfb0192d90 2023-03-02T10:49:41.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb50c2700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb0192d90 0x7fcfb0193230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800bd50 tx=0x7fcfa800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:41.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfadffb700 1 -- 172.21.15.136:0/2750469753 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa800cd10 con 0x7fcfb0192d90 2023-03-02T10:49:41.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfadffb700 1 -- 172.21.15.136:0/2750469753 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfa800ce70 con 0x7fcfb0192d90 2023-03-02T10:49:41.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfb6b25700 1 -- 172.21.15.136:0/2750469753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb0105460 con 0x7fcfb0192d90 2023-03-02T10:49:41.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.401+0000 7fcfadffb700 1 -- 172.21.15.136:0/2750469753 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8012840 con 0x7fcfb0192d90 2023-03-02T10:49:41.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.402+0000 7fcfb6b25700 1 -- 172.21.15.136:0/2750469753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb00689f0 con 0x7fcfb0192d90 2023-03-02T10:49:41.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.402+0000 7fcfadffb700 1 -- 172.21.15.136:0/2750469753 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7fcfa801b030 con 0x7fcfb0192d90 2023-03-02T10:49:41.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.403+0000 7fcfadffb700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcf94036da0 0x7fcf94039250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:41.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.403+0000 7fcfadffb700 1 -- 172.21.15.136:0/2750469753 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcfa8048130 con 0x7fcfb0192d90 2023-03-02T10:49:41.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.403+0000 7fcfb48c1700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcf94036da0 0x7fcf94039250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:41.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.403+0000 7fcfb6b25700 1 -- 172.21.15.136:0/2750469753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb01055f0 con 0x7fcfb0192d90 2023-03-02T10:49:41.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.403+0000 7fcfb48c1700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcf94036da0 0x7fcf94039250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4000c00 tx=0x7fcfa4005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:41.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.408+0000 7fcfadffb700 1 -- 172.21.15.136:0/2750469753 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fcfa8019070 con 0x7fcfb0192d90 2023-03-02T10:49:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:49:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: mon.a calling monitor election 2023-03-02T10:49:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: mon.c calling monitor election 2023-03-02T10:49:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:41.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:41.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-03-02T10:49:41.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: monmap e3: 3 mons at {a=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} 2023-03-02T10:49:41.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: fsmap 2023-03-02T10:49:41.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: osdmap e4: 0 total, 0 up, 0 in 2023-03-02T10:49:41.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: mgrmap e13: x(active, since 52s) 2023-03-02T10:49:41.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-03-02T10:49:41.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-03-02T10:49:41.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-03-02T10:49:41.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: mon.b (rank 2) addr [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] is down (out of quorum) 2023-03-02T10:49:41.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:41.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:41.682 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.680+0000 7fcfb6b25700 1 -- 172.21.15.136:0/2750469753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcfb01a46b0 con 0x7fcfb0192d90 2023-03-02T10:49:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:49:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: mon.a calling monitor election 2023-03-02T10:49:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: mon.c calling monitor election 2023-03-02T10:49:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:41.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-03-02T10:49:41.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: monmap e3: 3 mons at {a=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} 2023-03-02T10:49:41.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: fsmap 2023-03-02T10:49:41.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: osdmap e4: 0 total, 0 up, 0 in 2023-03-02T10:49:41.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: mgrmap e13: x(active, since 52s) 2023-03-02T10:49:41.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-03-02T10:49:41.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-03-02T10:49:41.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-03-02T10:49:41.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: mon.b (rank 2) addr [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] is down (out of quorum) 2023-03-02T10:49:41.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:41.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:41.687 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.682+0000 7fcfadffb700 1 -- 172.21.15.136:0/2750469753 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1274 (secure 0 0 0) 0x7fcfa8011890 con 0x7fcfb0192d90 2023-03-02T10:49:41.688 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-03-02T10:49:41.688 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":3,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","modified":"2023-03-02T10:49:36.185575Z","created":"2023-03-02T10:47:49.231223Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-03-02T10:49:41.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 -- 172.21.15.136:0/2750469753 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcf94036da0 msgr2=0x7fcf94039250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:41.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcf94036da0 0x7fcf94039250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4000c00 tx=0x7fcfa4005da0 comp rx=0 tx=0).stop 2023-03-02T10:49:41.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 -- 172.21.15.136:0/2750469753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb0192d90 msgr2=0x7fcfb0193230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:41.689 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb0192d90 0x7fcfb0193230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800bd50 tx=0x7fcfa800be30 comp rx=0 tx=0).stop 2023-03-02T10:49:41.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 -- 172.21.15.136:0/2750469753 shutdown_connections 2023-03-02T10:49:41.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcf94036da0 0x7fcf94039250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:41.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb0192d90 0x7fcfb0193230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:41.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb0104660 0x7fcfb01987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:41.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 --2- 172.21.15.136:0/2750469753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0198d20 0x7fcfb0192850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:41.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 -- 172.21.15.136:0/2750469753 >> 172.21.15.136:0/2750469753 conn(0x7fcfb0074360 msgr2=0x7fcfb0102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:41.690 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 -- 172.21.15.136:0/2750469753 shutdown_connections 2023-03-02T10:49:41.691 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:41.684+0000 7fcfb6b25700 1 -- 172.21.15.136:0/2750469753 wait complete. 2023-03-02T10:49:41.691 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 3 2023-03-02T10:49:42.072 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-03-02T10:49:42.072 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph config generate-minimal-conf 2023-03-02T10:49:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:42 smithi136 ceph-mon[125702]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:42 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:42 smithi136 ceph-mon[125702]: from='client.? 172.21.15.136:0/2750469753' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-03-02T10:49:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:42 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:42 smithi057 ceph-mon[92072]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:42 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:42 smithi057 ceph-mon[92072]: from='client.? 172.21.15.136:0/2750469753' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-03-02T10:49:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:42 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:42.822 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:49:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:49:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: mon.a calling monitor election 2023-03-02T10:49:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: mon.c calling monitor election 2023-03-02T10:49:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:49:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-03-02T10:49:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: monmap e3: 3 mons at {a=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} 2023-03-02T10:49:43.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: fsmap 2023-03-02T10:49:43.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: osdmap e4: 0 total, 0 up, 0 in 2023-03-02T10:49:43.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: mgrmap e13: x(active, since 52s) 2023-03-02T10:49:43.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-03-02T10:49:43.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-03-02T10:49:43.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-03-02T10:49:43.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: mon.b (rank 2) addr [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] is down (out of quorum) 2023-03-02T10:49:43.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:43.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:43.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:43.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:43.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='client.? 172.21.15.136:0/2750469753' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-03-02T10:49:43.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:44.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.441+0000 7f4367bc7700 1 -- 172.21.15.57:0/134161291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4360068080 msgr2=0x7f4360068450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:44.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.441+0000 7f4367bc7700 1 --2- 172.21.15.57:0/134161291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4360068080 0x7f4360068450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f435c009910 tx=0x7f435c009c20 comp rx=0 tx=0).stop 2023-03-02T10:49:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.441+0000 7f4367bc7700 1 -- 172.21.15.57:0/134161291 shutdown_connections 2023-03-02T10:49:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.441+0000 7f4367bc7700 1 --2- 172.21.15.57:0/134161291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4360068080 0x7f4360068450 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.441+0000 7f4367bc7700 1 -- 172.21.15.57:0/134161291 >> 172.21.15.57:0/134161291 conn(0x7f43600754f0 msgr2=0x7f43600758f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.441+0000 7f4367bc7700 1 -- 172.21.15.57:0/134161291 shutdown_connections 2023-03-02T10:49:44.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.441+0000 7f4367bc7700 1 -- 172.21.15.57:0/134161291 wait complete. 2023-03-02T10:49:44.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.442+0000 7f4367bc7700 1 Processor -- start 2023-03-02T10:49:44.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.442+0000 7f4367bc7700 1 -- start start 2023-03-02T10:49:44.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.442+0000 7f4367bc7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4360071d00 0x7f43600720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:44.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.442+0000 7f4367bc7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f436006fd70 0x7f43600701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:44.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.442+0000 7f4367bc7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4360070720 0x7f43601ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:44.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.442+0000 7f4367bc7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43601ac800 con 0x7f4360071d00 2023-03-02T10:49:44.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.442+0000 7f4367bc7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43601ac940 con 0x7f436006fd70 2023-03-02T10:49:44.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.442+0000 7f4367bc7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43601aca80 con 0x7f4360070720 2023-03-02T10:49:44.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4365963700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4360071d00 0x7f43600720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:44.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4365963700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4360071d00 0x7f43600720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35012/0 (socket says 172.21.15.57:35012) 2023-03-02T10:49:44.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4365963700 1 -- 172.21.15.57:0/2246370442 learned_addr learned my addr 172.21.15.57:0/2246370442 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:49:44.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4365162700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f436006fd70 0x7f43600701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:44.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4366164700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4360070720 0x7f43601ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:44.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4365963700 1 -- 172.21.15.57:0/2246370442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4360070720 msgr2=0x7f43601ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:44.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4365963700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4360070720 0x7f43601ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:44.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4365963700 1 -- 172.21.15.57:0/2246370442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f436006fd70 msgr2=0x7f43600701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:44.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4365963700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f436006fd70 0x7f43600701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:44.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4365963700 1 -- 172.21.15.57:0/2246370442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c0095f0 con 0x7f4360071d00 2023-03-02T10:49:44.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4365162700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f436006fd70 0x7f43600701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:49:44.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.443+0000 7f4365963700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4360071d00 0x7f43600720d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f435c014000 tx=0x7f435c004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:44.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.444+0000 7f4356ffd700 1 -- 172.21.15.57:0/2246370442 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c01d070 con 0x7f4360071d00 2023-03-02T10:49:44.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.444+0000 7f4356ffd700 1 -- 172.21.15.57:0/2246370442 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f435c005000 con 0x7f4360071d00 2023-03-02T10:49:44.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.444+0000 7f4367bc7700 1 -- 172.21.15.57:0/2246370442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436010bd00 con 0x7f4360071d00 2023-03-02T10:49:44.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.444+0000 7f4356ffd700 1 -- 172.21.15.57:0/2246370442 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c00fc80 con 0x7f4360071d00 2023-03-02T10:49:44.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.444+0000 7f4367bc7700 1 -- 172.21.15.57:0/2246370442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436010bb70 con 0x7f4360071d00 2023-03-02T10:49:44.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.445+0000 7f4356ffd700 1 -- 172.21.15.57:0/2246370442 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7f435c028030 con 0x7f4360071d00 2023-03-02T10:49:44.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.445+0000 7f4367bc7700 1 -- 172.21.15.57:0/2246370442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436010be90 con 0x7f4360071d00 2023-03-02T10:49:44.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.445+0000 7f4356ffd700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f434c036d70 0x7f434c039220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:44.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.445+0000 7f4356ffd700 1 -- 172.21.15.57:0/2246370442 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f435c0496a0 con 0x7f4360071d00 2023-03-02T10:49:44.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.445+0000 7f4365162700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f434c036d70 0x7f434c039220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: mon.b calling monitor election 2023-03-02T10:49:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: Updating smithi057:/etc/ceph/ceph.conf 2023-03-02T10:49:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: Updating smithi122:/etc/ceph/ceph.conf 2023-03-02T10:49:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: Updating smithi136:/etc/ceph/ceph.conf 2023-03-02T10:49:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: mon.b calling monitor election 2023-03-02T10:49:44.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: mon.c calling monitor election 2023-03-02T10:49:44.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: mon.a calling monitor election 2023-03-02T10:49:44.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-03-02T10:49:44.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: monmap e3: 3 mons at {a=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} 2023-03-02T10:49:44.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: fsmap 2023-03-02T10:49:44.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: osdmap e4: 0 total, 0 up, 0 in 2023-03-02T10:49:44.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: mgrmap e13: x(active, since 54s) 2023-03-02T10:49:44.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-03-02T10:49:44.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: Cluster is now healthy 2023-03-02T10:49:44.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T10:49:44.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: Updating smithi122:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:44.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:44.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:44.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-02T10:49:44.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:44.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:44.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.446+0000 7f4365162700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f434c036d70 0x7f434c039220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4350009ec0 tx=0x7f4350009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:44.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.452+0000 7f4356ffd700 1 -- 172.21.15.57:0/2246370442 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f435c015350 con 0x7f4360071d00 2023-03-02T10:49:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: mon.b calling monitor election 2023-03-02T10:49:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: Updating smithi057:/etc/ceph/ceph.conf 2023-03-02T10:49:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: Updating smithi122:/etc/ceph/ceph.conf 2023-03-02T10:49:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: Updating smithi136:/etc/ceph/ceph.conf 2023-03-02T10:49:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: mon.b calling monitor election 2023-03-02T10:49:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: mon.c calling monitor election 2023-03-02T10:49:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: mon.a calling monitor election 2023-03-02T10:49:44.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-03-02T10:49:44.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: monmap e3: 3 mons at {a=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} 2023-03-02T10:49:44.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: fsmap 2023-03-02T10:49:44.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: osdmap e4: 0 total, 0 up, 0 in 2023-03-02T10:49:44.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: mgrmap e13: x(active, since 54s) 2023-03-02T10:49:44.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-03-02T10:49:44.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: Cluster is now healthy 2023-03-02T10:49:44.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T10:49:44.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: Updating smithi122:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:44.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:44.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:44.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-02T10:49:44.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:44.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:44.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.651+0000 7f4367bc7700 1 -- 172.21.15.57:0/2246370442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f43601ad440 con 0x7f4360071d00 2023-03-02T10:49:44.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.651+0000 7f4356ffd700 1 -- 172.21.15.57:0/2246370442 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f435c026020 con 0x7f4360071d00 2023-03-02T10:49:44.653 INFO:teuthology.orchestra.run.smithi057.stdout:# minimal ceph.conf for 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:49:44.653 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-03-02T10:49:44.653 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:49:44.653 INFO:teuthology.orchestra.run.smithi057.stdout: mon_host = [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] 2023-03-02T10:49:44.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.653+0000 7f4367bc7700 1 -- 172.21.15.57:0/2246370442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f434c036d70 msgr2=0x7f434c039220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:44.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.653+0000 7f4367bc7700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f434c036d70 0x7f434c039220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4350009ec0 tx=0x7f4350009210 comp rx=0 tx=0).stop 2023-03-02T10:49:44.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.653+0000 7f4367bc7700 1 -- 172.21.15.57:0/2246370442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4360071d00 msgr2=0x7f43600720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:44.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.653+0000 7f4367bc7700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4360071d00 0x7f43600720d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f435c014000 tx=0x7f435c004cb0 comp rx=0 tx=0).stop 2023-03-02T10:49:44.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.654+0000 7f4367bc7700 1 -- 172.21.15.57:0/2246370442 shutdown_connections 2023-03-02T10:49:44.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.654+0000 7f4367bc7700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f434c036d70 0x7f434c039220 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:44.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.654+0000 7f4367bc7700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4360070720 0x7f43601ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:44.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.654+0000 7f4367bc7700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4360071d00 0x7f43600720d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:44.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.654+0000 7f4367bc7700 1 --2- 172.21.15.57:0/2246370442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f436006fd70 0x7f43600701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:44.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.654+0000 7f4367bc7700 1 -- 172.21.15.57:0/2246370442 >> 172.21.15.57:0/2246370442 conn(0x7f43600754f0 msgr2=0x7f4360107600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:44.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.654+0000 7f4367bc7700 1 -- 172.21.15.57:0/2246370442 shutdown_connections 2023-03-02T10:49:44.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:44.654+0000 7f4367bc7700 1 -- 172.21.15.57:0/2246370442 wait complete. 2023-03-02T10:49:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: mon.b calling monitor election 2023-03-02T10:49:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: Updating smithi057:/etc/ceph/ceph.conf 2023-03-02T10:49:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: Updating smithi122:/etc/ceph/ceph.conf 2023-03-02T10:49:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: Updating smithi136:/etc/ceph/ceph.conf 2023-03-02T10:49:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: mon.b calling monitor election 2023-03-02T10:49:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: mon.c calling monitor election 2023-03-02T10:49:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: mon.a calling monitor election 2023-03-02T10:49:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-03-02T10:49:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: monmap e3: 3 mons at {a=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0]} removed_ranks: {} 2023-03-02T10:49:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: fsmap 2023-03-02T10:49:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: osdmap e4: 0 total, 0 up, 0 in 2023-03-02T10:49:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: mgrmap e13: x(active, since 54s) 2023-03-02T10:49:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-03-02T10:49:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: Cluster is now healthy 2023-03-02T10:49:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T10:49:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: Updating smithi122:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:44.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:44.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-02T10:49:44.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:44.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:49:45.429 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:45 smithi057 ceph-mon[92072]: Updating smithi057:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:45.430 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:45 smithi057 ceph-mon[92072]: Reconfiguring mon.a (unknown last config time)... 2023-03-02T10:49:45.430 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:45 smithi057 ceph-mon[92072]: Reconfiguring daemon mon.a on smithi057 2023-03-02T10:49:45.430 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:45 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:45.430 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:45 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2246370442' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:45.432 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-03-02T10:49:45.432 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:49:45.433 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.conf 2023-03-02T10:49:45.481 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:49:45.481 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:49:45.564 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-03-02T10:49:45.564 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.conf 2023-03-02T10:49:45.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:45 smithi136 ceph-mon[125702]: Updating smithi057:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:45.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:45 smithi136 ceph-mon[125702]: Reconfiguring mon.a (unknown last config time)... 2023-03-02T10:49:45.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:45 smithi136 ceph-mon[125702]: Reconfiguring daemon mon.a on smithi057 2023-03-02T10:49:45.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:45 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:45.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:45 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2246370442' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:45.595 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:45 smithi122 ceph-mon[125440]: Updating smithi057:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:49:45.595 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:45 smithi122 ceph-mon[125440]: Reconfiguring mon.a (unknown last config time)... 2023-03-02T10:49:45.595 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:45 smithi122 ceph-mon[125440]: Reconfiguring daemon mon.a on smithi057 2023-03-02T10:49:45.595 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:45 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:45.595 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:45 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2246370442' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:45.601 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-03-02T10:49:45.601 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:49:45.669 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-02T10:49:45.670 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.conf 2023-03-02T10:49:45.706 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-02T10:49:45.707 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:49:45.777 INFO:tasks.cephadm:Adding mgr.x on smithi057 2023-03-02T10:49:45.777 INFO:tasks.cephadm:Adding mgr.y on smithi122 2023-03-02T10:49:45.777 INFO:tasks.cephadm:Adding mgr.z on smithi136 2023-03-02T10:49:45.778 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch apply mgr '3;smithi057=x;smithi122=y;smithi136=z' 2023-03-02T10:49:46.452 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:49:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:46 smithi122 ceph-mon[125440]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:46 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:46 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:46 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:46 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-02T10:49:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:46 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:46 smithi136 ceph-mon[125702]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:46 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:46 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:46 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:46 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-02T10:49:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:46 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:46 smithi057 ceph-mon[92072]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:46 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:46 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:46 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:46 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-02T10:49:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:46 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:47 smithi136 ceph-mon[125702]: Reconfiguring mon.b (monmap changed)... 2023-03-02T10:49:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:47 smithi136 ceph-mon[125702]: Reconfiguring daemon mon.b on smithi122 2023-03-02T10:49:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-02T10:49:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:47.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.618+0000 7f4f42bad700 1 -- 172.21.15.136:0/1892992431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c0fe6b0 msgr2=0x7f4f3c0feac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:47.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.618+0000 7f4f42bad700 1 --2- 172.21.15.136:0/1892992431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c0fe6b0 0x7f4f3c0feac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009910 tx=0x7f4f24009c20 comp rx=0 tx=0).stop 2023-03-02T10:49:47.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.618+0000 7f4f42bad700 1 -- 172.21.15.136:0/1892992431 shutdown_connections 2023-03-02T10:49:47.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.618+0000 7f4f42bad700 1 --2- 172.21.15.136:0/1892992431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c0fe6b0 0x7f4f3c0feac0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:47.620 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.618+0000 7f4f42bad700 1 -- 172.21.15.136:0/1892992431 >> 172.21.15.136:0/1892992431 conn(0x7f4f3c0f9c10 msgr2=0x7f4f3c0fc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:47.621 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.618+0000 7f4f42bad700 1 -- 172.21.15.136:0/1892992431 shutdown_connections 2023-03-02T10:49:47.621 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.618+0000 7f4f42bad700 1 -- 172.21.15.136:0/1892992431 wait complete. 2023-03-02T10:49:47.622 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.618+0000 7f4f42bad700 1 Processor -- start 2023-03-02T10:49:47.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.618+0000 7f4f42bad700 1 -- start start 2023-03-02T10:49:47.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f42bad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c0fe6b0 0x7f4f3c193890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:47.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f42bad700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c193dd0 0x7f4f3c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:47.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f42bad700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c194240 0x7f4f3c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:47.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f42bad700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c19bb60 con 0x7f4f3c0fe6b0 2023-03-02T10:49:47.623 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f42bad700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c19bcd0 con 0x7f4f3c193dd0 2023-03-02T10:49:47.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f42bad700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c19be90 con 0x7f4f3c194240 2023-03-02T10:49:47.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f40949700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c0fe6b0 0x7f4f3c193890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:47.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f4114a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c194240 0x7f4f3c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:47.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f40949700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c0fe6b0 0x7f4f3c193890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.136:38558/0 (socket says 172.21.15.136:38558) 2023-03-02T10:49:47.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f40949700 1 -- 172.21.15.136:0/4210115052 learned_addr learned my addr 172.21.15.136:0/4210115052 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-02T10:49:47.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f4114a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c194240 0x7f4f3c19b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35058/0 (socket says 172.21.15.136:35058) 2023-03-02T10:49:47.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f3bfff700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c193dd0 0x7f4f3c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:47.624 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f4114a700 1 -- 172.21.15.136:0/4210115052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c193dd0 msgr2=0x7f4f3c198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:47.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f4114a700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c193dd0 0x7f4f3c198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:47.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f4114a700 1 -- 172.21.15.136:0/4210115052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c0fe6b0 msgr2=0x7f4f3c193890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:47.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f4114a700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c0fe6b0 0x7f4f3c193890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:47.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f4114a700 1 -- 172.21.15.136:0/4210115052 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f240095f0 con 0x7f4f3c194240 2023-03-02T10:49:47.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f40949700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c0fe6b0 0x7f4f3c193890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:49:47.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f4114a700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c194240 0x7f4f3c19b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400bd50 tx=0x7f4f3400bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:47.625 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f39ffb700 1 -- 172.21.15.136:0/4210115052 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400cc90 con 0x7f4f3c194240 2023-03-02T10:49:47.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f39ffb700 1 -- 172.21.15.136:0/4210115052 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f3400cdf0 con 0x7f4f3c194240 2023-03-02T10:49:47.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.619+0000 7f4f42bad700 1 -- 172.21.15.136:0/4210115052 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c104530 con 0x7f4f3c194240 2023-03-02T10:49:47.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.620+0000 7f4f39ffb700 1 -- 172.21.15.136:0/4210115052 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f340127a0 con 0x7f4f3c194240 2023-03-02T10:49:47.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.620+0000 7f4f42bad700 1 -- 172.21.15.136:0/4210115052 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c1043a0 con 0x7f4f3c194240 2023-03-02T10:49:47.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.621+0000 7f4f42bad700 1 -- 172.21.15.136:0/4210115052 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c18d190 con 0x7f4f3c194240 2023-03-02T10:49:47.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.621+0000 7f4f39ffb700 1 -- 172.21.15.136:0/4210115052 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7f4f3401b030 con 0x7f4f3c194240 2023-03-02T10:49:47.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.621+0000 7f4f39ffb700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4f28036d50 0x7f4f28039200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:47.626 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.621+0000 7f4f39ffb700 1 -- 172.21.15.136:0/4210115052 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4f34048120 con 0x7f4f3c194240 2023-03-02T10:49:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.621+0000 7f4f40949700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4f28036d50 0x7f4f28039200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.622+0000 7f4f40949700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4f28036d50 0x7f4f28039200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4f24005850 tx=0x7f4f2400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.626+0000 7f4f39ffb700 1 -- 172.21.15.136:0/4210115052 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f4f3401cd50 con 0x7f4f3c194240 2023-03-02T10:49:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:47 smithi057 ceph-mon[92072]: Reconfiguring mon.b (monmap changed)... 2023-03-02T10:49:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:47 smithi057 ceph-mon[92072]: Reconfiguring daemon mon.b on smithi122 2023-03-02T10:49:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-02T10:49:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:47 smithi122 ceph-mon[125440]: Reconfiguring mon.b (monmap changed)... 2023-03-02T10:49:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:47 smithi122 ceph-mon[125440]: Reconfiguring daemon mon.b on smithi122 2023-03-02T10:49:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-02T10:49:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-02T10:49:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:47.839 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.838+0000 7f4f42bad700 1 -- 172.21.15.136:0/4210115052 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi057=x;smithi122=y;smithi136=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f3c0614d0 con 0x7f4f28036d50 2023-03-02T10:49:47.846 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.844+0000 7f4f39ffb700 1 -- 172.21.15.136:0/4210115052 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4f3c0614d0 con 0x7f4f28036d50 2023-03-02T10:49:47.846 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled mgr update... 2023-03-02T10:49:47.848 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 -- 172.21.15.136:0/4210115052 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4f28036d50 msgr2=0x7f4f28039200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4f28036d50 0x7f4f28039200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4f24005850 tx=0x7f4f2400b540 comp rx=0 tx=0).stop 2023-03-02T10:49:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 -- 172.21.15.136:0/4210115052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c194240 msgr2=0x7f4f3c19b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c194240 0x7f4f3c19b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400bd50 tx=0x7f4f3400bd80 comp rx=0 tx=0).stop 2023-03-02T10:49:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 -- 172.21.15.136:0/4210115052 shutdown_connections 2023-03-02T10:49:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4f28036d50 0x7f4f28039200 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c194240 0x7f4f3c19b3c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c0fe6b0 0x7f4f3c193890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 --2- 172.21.15.136:0/4210115052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c193dd0 0x7f4f3c198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 -- 172.21.15.136:0/4210115052 >> 172.21.15.136:0/4210115052 conn(0x7f4f3c0f9c10 msgr2=0x7f4f3c0fa8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 -- 172.21.15.136:0/4210115052 shutdown_connections 2023-03-02T10:49:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:49:47.847+0000 7f4f42bad700 1 -- 172.21.15.136:0/4210115052 wait complete. 2023-03-02T10:49:48.389 DEBUG:teuthology.orchestra.run.smithi122:mgr.y> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mgr.y.service 2023-03-02T10:49:48.392 DEBUG:teuthology.orchestra.run.smithi136:mgr.z> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mgr.z.service 2023-03-02T10:49:48.394 INFO:tasks.cephadm:Deploying OSDs... 2023-03-02T10:49:48.394 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:49:48.394 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2023-03-02T10:49:48.425 INFO:journalctl@ceph.mgr.z.smithi136.stdout:-- Logs begin at Thu 2023-03-02 10:22:36 UTC. -- 2023-03-02T10:49:48.427 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-02T10:49:48.427 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2023-03-02T10:49:48.428 INFO:journalctl@ceph.mgr.y.smithi122.stdout:-- Logs begin at Thu 2023-03-02 10:22:37 UTC. -- 2023-03-02T10:49:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-02T10:49:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:48.499 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-03-02T10:49:48.499 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:48.499 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:48.499 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-03-02 10:49:00.317353887 +0000 2023-03-02T10:49:48.499 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-03-02 10:41:58.147874088 +0000 2023-03-02T10:49:48.499 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-03-02 10:41:58.147874088 +0000 2023-03-02T10:49:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-03-02 10:41:58.109874644 +0000 2023-03-02T10:49:48.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-02T10:49:48.579 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:48 smithi057 ceph-mon[92072]: Reconfiguring mon.c (monmap changed)... 2023-03-02T10:49:48.580 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:48 smithi057 ceph-mon[92072]: Reconfiguring daemon mon.c on smithi136 2023-03-02T10:49:48.580 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:48 smithi057 ceph-mon[92072]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:48.580 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:48 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-03-02T10:49:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-03-02T10:49:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000386956 s, 1.3 MB/s 2023-03-02T10:49:48.586 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-02T10:49:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:48 smithi136 ceph-mon[125702]: Reconfiguring mon.c (monmap changed)... 2023-03-02T10:49:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:48 smithi136 ceph-mon[125702]: Reconfiguring daemon mon.c on smithi136 2023-03-02T10:49:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:48 smithi136 ceph-mon[125702]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:48 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:48.655 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2023-03-02T10:49:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:48 smithi122 ceph-mon[125440]: Reconfiguring mon.c (monmap changed)... 2023-03-02T10:49:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:48 smithi122 ceph-mon[125440]: Reconfiguring daemon mon.c on smithi136 2023-03-02T10:49:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:48 smithi122 ceph-mon[125440]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:48 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:48.724 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-02T10:49:48.724 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:48.724 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-03-02T10:49:48.725 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:48.725 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:48.725 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-03-02 10:49:00.317353887 +0000 2023-03-02T10:49:48.725 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-03-02 10:41:59.242858068 +0000 2023-03-02T10:49:48.725 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-03-02 10:41:59.242858068 +0000 2023-03-02T10:49:48.725 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-03-02 10:41:59.204858624 +0000 2023-03-02T10:49:48.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-02T10:49:48.805 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-03-02T10:49:48.805 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-03-02T10:49:48.805 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000295381 s, 1.7 MB/s 2023-03-02T10:49:48.807 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-02T10:49:48.875 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2023-03-02T10:49:48.943 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-02T10:49:48.943 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:48.943 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-03-02T10:49:48.944 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:48.944 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:48.944 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-03-02 10:49:00.317353887 +0000 2023-03-02T10:49:48.944 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-03-02 10:42:00.334842091 +0000 2023-03-02T10:49:48.944 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-03-02 10:42:00.334842091 +0000 2023-03-02T10:49:48.944 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-03-02 10:42:00.295842662 +0000 2023-03-02T10:49:48.945 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-02T10:49:49.024 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-03-02T10:49:49.024 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-03-02T10:49:49.024 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000379723 s, 1.3 MB/s 2023-03-02T10:49:49.026 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-02T10:49:49.093 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2023-03-02T10:49:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-02T10:49:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:49.161 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-03-02T10:49:49.161 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:49.161 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:49.162 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-03-02 10:49:00.317353887 +0000 2023-03-02T10:49:49.162 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-03-02 10:42:01.407826393 +0000 2023-03-02T10:49:49.162 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-03-02 10:42:01.407826393 +0000 2023-03-02T10:49:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-03-02 10:42:01.364827022 +0000 2023-03-02T10:49:49.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-02T10:49:49.241 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-03-02T10:49:49.241 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-03-02T10:49:49.242 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000330337 s, 1.5 MB/s 2023-03-02T10:49:49.243 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-02T10:49:49.310 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-03-02T10:49:49.311 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2023-03-02T10:49:49.331 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-02T10:49:49.332 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2023-03-02T10:49:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-02T10:49:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:49.392 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 349098 Links: 1 2023-03-02T10:49:49.392 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:49.392 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:49.393 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-03-02 10:49:35.627822167 +0000 2023-03-02T10:49:49.393 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-03-02 10:37:27.099763064 +0000 2023-03-02T10:49:49.393 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-03-02 10:37:27.099763064 +0000 2023-03-02T10:49:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2023-03-02T10:49:49.393 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-02T10:49:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi057=x;smithi122=y;smithi136=z", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:49:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: Saving service mgr spec with placement smithi057=x;smithi122=y;smithi136=z;count:3 2023-03-02T10:49:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-02T10:49:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-02T10:49:49.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-02T10:49:49.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:49.460 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-03-02T10:49:49.461 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-03-02T10:49:49.461 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000309143 s, 1.7 MB/s 2023-03-02T10:49:49.462 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-02T10:49:49.521 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2023-03-02T10:49:49.531 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi057=x;smithi122=y;smithi136=z", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:49:49.532 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: Saving service mgr spec with placement smithi057=x;smithi122=y;smithi136=z;count:3 2023-03-02T10:49:49.532 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:49.532 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:49.532 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:49.532 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:49.532 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:49.532 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:49.533 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-02T10:49:49.533 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-02T10:49:49.533 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-02T10:49:49.533 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:49.580 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-02T10:49:49.581 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:49.581 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 349124 Links: 1 2023-03-02T10:49:49.581 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:49.581 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:49.581 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-03-02 10:49:35.627822167 +0000 2023-03-02T10:49:49.581 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-03-02 10:37:27.626750508 +0000 2023-03-02T10:49:49.581 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-03-02 10:37:27.626750508 +0000 2023-03-02T10:49:49.582 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2023-03-02T10:49:49.582 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-02T10:49:49.646 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi057=x;smithi122=y;smithi136=z", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:49:49.647 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: Saving service mgr spec with placement smithi057=x;smithi122=y;smithi136=z;count:3 2023-03-02T10:49:49.647 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:49.647 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:49.647 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:49.647 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:49.647 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:49.647 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:49.648 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-02T10:49:49.648 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-02T10:49:49.648 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-02T10:49:49.648 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:49.649 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-03-02T10:49:49.649 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-03-02T10:49:49.649 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000244337 s, 2.1 MB/s 2023-03-02T10:49:49.650 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-02T10:49:49.709 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2023-03-02T10:49:49.766 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-02T10:49:49.767 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:49.767 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 357310 Links: 1 2023-03-02T10:49:49.767 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:49.767 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:49.767 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-03-02 10:49:35.627822167 +0000 2023-03-02T10:49:49.767 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-03-02 10:37:28.149738047 +0000 2023-03-02T10:49:49.768 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-03-02 10:37:28.149738047 +0000 2023-03-02T10:49:49.768 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2023-03-02T10:49:49.768 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-02T10:49:49.833 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-03-02T10:49:49.833 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-03-02T10:49:49.833 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000225272 s, 2.3 MB/s 2023-03-02T10:49:49.834 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-02T10:49:49.894 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2023-03-02T10:49:49.953 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-02T10:49:49.953 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:49.954 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 365572 Links: 1 2023-03-02T10:49:49.954 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:49.954 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:49.955 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-03-02 10:49:35.627822167 +0000 2023-03-02T10:49:49.955 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-03-02 10:37:28.678725443 +0000 2023-03-02T10:49:49.955 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-03-02 10:37:28.678725443 +0000 2023-03-02T10:49:49.955 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2023-03-02T10:49:49.956 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-02T10:49:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-03-02T10:49:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-03-02T10:49:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000197976 s, 2.6 MB/s 2023-03-02T10:49:50.022 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-02T10:49:50.079 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-03-02T10:49:50.080 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2023-03-02T10:49:50.100 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-02T10:49:50.101 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2023-03-02T10:49:50.158 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-02T10:49:50.159 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:50.159 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 354955 Links: 1 2023-03-02T10:49:50.159 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:50.159 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:50.159 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-03-02 10:49:49.938941202 +0000 2023-03-02T10:49:50.159 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-03-02 10:37:27.100950348 +0000 2023-03-02T10:49:50.159 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-03-02 10:37:27.100950348 +0000 2023-03-02T10:49:50.159 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-03-02T10:49:50.160 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-02T10:49:50.224 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:49 smithi136 systemd[1]: Starting Ceph mgr.z for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:49:50.227 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-03-02T10:49:50.228 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-03-02T10:49:50.228 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000215107 s, 2.4 MB/s 2023-03-02T10:49:50.229 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-02T10:49:50.287 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2023-03-02T10:49:50.345 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-02T10:49:50.345 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:50.345 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 363801 Links: 1 2023-03-02T10:49:50.345 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:50.346 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:50.346 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-03-02 10:49:49.938941202 +0000 2023-03-02T10:49:50.346 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-03-02 10:37:27.639937559 +0000 2023-03-02T10:49:50.346 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-03-02 10:37:27.639937559 +0000 2023-03-02T10:49:50.346 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-03-02T10:49:50.346 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-02T10:49:50.411 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-03-02T10:49:50.412 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-03-02T10:49:50.412 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000205728 s, 2.5 MB/s 2023-03-02T10:49:50.413 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-02T10:49:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:50 smithi122 ceph-mon[125440]: Deploying daemon mgr.z on smithi136 2023-03-02T10:49:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:50 smithi122 ceph-mon[125440]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:50.472 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2023-03-02T10:49:50.512 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:50 smithi136 podman[127582]: 2023-03-02T10:49:50.513 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:50 smithi136 ceph-mon[125702]: Deploying daemon mgr.z on smithi136 2023-03-02T10:49:50.513 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:50 smithi136 ceph-mon[125702]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:50.531 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-02T10:49:50.531 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:50.532 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 354228 Links: 1 2023-03-02T10:49:50.532 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:50.532 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:50.532 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-03-02 10:49:49.938941202 +0000 2023-03-02T10:49:50.532 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-03-02 10:37:28.168925007 +0000 2023-03-02T10:49:50.532 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-03-02 10:37:28.168925007 +0000 2023-03-02T10:49:50.532 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-03-02T10:49:50.533 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-02T10:49:50.598 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-03-02T10:49:50.598 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-03-02T10:49:50.598 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000218463 s, 2.3 MB/s 2023-03-02T10:49:50.599 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-02T10:49:50.658 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2023-03-02T10:49:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:50 smithi057 ceph-mon[92072]: Deploying daemon mgr.z on smithi136 2023-03-02T10:49:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:50 smithi057 ceph-mon[92072]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:50.716 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-02T10:49:50.717 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-02T10:49:50.717 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 355250 Links: 1 2023-03-02T10:49:50.717 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-02T10:49:50.718 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-03-02T10:49:50.718 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-03-02 10:49:49.939941180 +0000 2023-03-02T10:49:50.718 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-03-02 10:37:28.709912171 +0000 2023-03-02T10:49:50.719 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-03-02 10:37:28.709912171 +0000 2023-03-02T10:49:50.719 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-03-02T10:49:50.720 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-02T10:49:50.781 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:50 smithi136 bash[127582]: f9962d57fc846263553fb345f087e348115e7da21665c83dbf215a4e9e1c4b31 2023-03-02T10:49:50.782 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:50 smithi136 ceph-mgr[127745]: -- 172.21.15.136:0/241029582 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563f31c10b60 con 0x563f31be4c00 2023-03-02T10:49:50.782 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:50 smithi136 systemd[1]: Started Ceph mgr.z for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:49:50.782 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:50 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:50.645+0000 7f2672339200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-02T10:49:50.782 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:50 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:50.727+0000 7f2672339200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-02T10:49:50.784 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-03-02T10:49:50.784 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-03-02T10:49:50.784 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000237376 s, 2.2 MB/s 2023-03-02T10:49:50.785 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-02T10:49:50.842 INFO:tasks.cephadm:Deploying osd.0 on smithi057 with /dev/vg_nvme/lv_4... 2023-03-02T10:49:50.843 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-03-02T10:49:51.085 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:50 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:50.821+0000 7f2672339200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-02T10:49:51.085 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:50 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:50.917+0000 7f2672339200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-02T10:49:51.340 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:51.083+0000 7f2672339200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-02T10:49:51.581 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:49:51.707 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:51.391+0000 7f2672339200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-02T10:49:51.708 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:51.478+0000 7f2672339200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-02T10:49:51.708 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:51.611+0000 7f2672339200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-02T10:49:51.708 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:51.708 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:51.709 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-02T10:49:51.709 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-02T10:49:51.709 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-02T10:49:51.709 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:51.709 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-mon[125702]: Deploying daemon mgr.y on smithi122 2023-03-02T10:49:51.709 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-mon[125702]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:51.893 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:51 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:51.894 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:51 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:51.894 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:51 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-02T10:49:51.894 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:51 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-02T10:49:51.894 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:51 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-02T10:49:51.894 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:51 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:51.895 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:51 smithi122 ceph-mon[125440]: Deploying daemon mgr.y on smithi122 2023-03-02T10:49:51.895 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:51 smithi122 ceph-mon[125440]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:51 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:51 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:51 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-02T10:49:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:51 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-02T10:49:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:51 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-02T10:49:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:51 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:51 smithi057 ceph-mon[92072]: Deploying daemon mgr.y on smithi122 2023-03-02T10:49:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:51 smithi057 ceph-mon[92072]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:52.090 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:51 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:51.705+0000 7f2672339200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-02T10:49:52.202 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:52 smithi122 systemd[1]: Starting Ceph mgr.y for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:49:52.590 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:52 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:52.121+0000 7f2672339200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-02T10:49:52.618 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:52 smithi122 podman[126880]: 2023-03-02T10:49:52.922 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:52 smithi122 bash[126880]: 0bdbfcdb51f3f3dd2ba2dc08779d3e33a4d4cc87c662e97584d9db89d1835775 2023-03-02T10:49:52.923 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:52 smithi122 ceph-mgr[126918]: -- 172.21.15.122:0/3713236682 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562790c52b60 con 0x562790c27000 2023-03-02T10:49:52.923 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:52 smithi122 systemd[1]: Started Ceph mgr.y for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:49:52.923 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:52 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:52.740+0000 7f1de6aac200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-02T10:49:52.923 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:52 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:52.826+0000 7f1de6aac200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-02T10:49:53.090 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:52 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:52.694+0000 7f2672339200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-02T10:49:53.090 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:52 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:52.866+0000 7f2672339200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-02T10:49:53.201 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:52 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:52.921+0000 7f1de6aac200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-02T10:49:53.202 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:53 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:53.022+0000 7f1de6aac200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-02T10:49:53.429 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-03-02T10:49:53.429 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-03-02T10:49:53.429 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2023-03-02T10:49:53.430 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2023-03-02T10:49:53.430 INFO:teuthology.orchestra.run.smithi057.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.015715 s, 667 MB/s 2023-03-02T10:49:53.430 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2023-03-02T10:49:53.546 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:53 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:53.213+0000 7f1de6aac200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-02T10:49:53.867 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:53 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:53.544+0000 7f1de6aac200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-02T10:49:53.868 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:53 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:53.635+0000 7f1de6aac200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-02T10:49:53.868 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:53 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:53.771+0000 7f1de6aac200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-02T10:49:53.868 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:53 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:53.866+0000 7f1de6aac200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-02T10:49:53.869 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:53 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:53.869 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:53 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:53.869 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:53 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:53.870 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:53 smithi122 ceph-mon[125440]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:53.882 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi057:vg_nvme/lv_4 2023-03-02T10:49:53.933 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:53 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:53.933 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:53 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:53.934 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:53 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:53.934 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:53 smithi136 ceph-mon[125702]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:53.934 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:53 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:53.663+0000 7f2672339200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:49:53.934 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:53 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:53.758+0000 7f2672339200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-02T10:49:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:53 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:53 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:53 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:53 smithi057 ceph-mon[92072]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:54.281 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:53 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:53.931+0000 7f2672339200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:49:54.282 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:54 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:54.126+0000 7f2672339200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-02T10:49:54.590 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:54 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:54.278+0000 7f2672339200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-02T10:49:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:49:54.701 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:54 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:54.316+0000 7f1de6aac200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-02T10:49:55.090 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:54 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:54.693+0000 7f2672339200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-02T10:49:55.201 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:54 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:54.905+0000 7f1de6aac200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-02T10:49:55.202 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:55.071+0000 7f1de6aac200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-02T10:49:55.524 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:55.215+0000 7f2672339200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-02T10:49:55.525 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.525 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.525 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.525 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.526 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.526 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:55.526 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:55.526 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.526 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-02T10:49:55.526 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-02T10:49:55.526 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:55.550 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.550 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.551 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.551 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.551 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.551 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:55.551 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:55.551 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.551 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-02T10:49:55.551 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-02T10:49:55.552 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:55.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:55.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:55.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-02T10:49:55.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-02T10:49:55.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:55.822 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:55.522+0000 7f2672339200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-02T10:49:55.822 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:55.708+0000 7f2672339200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-02T10:49:56.090 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:55 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:55.820+0000 7f2672339200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-02T10:49:56.091 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:56 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:56.030+0000 7f2672339200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-02T10:49:56.093 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:55.836+0000 7f1de6aac200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:49:56.093 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:55 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:55.926+0000 7f1de6aac200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-02T10:49:56.094 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:56 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:56.092+0000 7f1de6aac200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:49:56.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.379+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3653364772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ba4105880 msgr2=0x7f0ba4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:56.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.379+0000 7f0ba8ad6700 1 --2- 172.21.15.57:0/3653364772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ba4105880 0x7f0ba4107ce0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009990 tx=0x7f0b9c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:49:56.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.380+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3653364772 shutdown_connections 2023-03-02T10:49:56.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.380+0000 7f0ba8ad6700 1 --2- 172.21.15.57:0/3653364772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ba4105880 0x7f0ba4107ce0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:56.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.380+0000 7f0ba8ad6700 1 --2- 172.21.15.57:0/3653364772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4100640 0x7f0ba4102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:56.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.380+0000 7f0ba8ad6700 1 --2- 172.21.15.57:0/3653364772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ba4102f60 0x7f0ba4105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:56.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.380+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3653364772 >> 172.21.15.57:0/3653364772 conn(0x7f0ba40fa0a0 msgr2=0x7f0ba40fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:49:56.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.380+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3653364772 shutdown_connections 2023-03-02T10:49:56.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.380+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3653364772 wait complete. 2023-03-02T10:49:56.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.380+0000 7f0ba8ad6700 1 Processor -- start 2023-03-02T10:49:56.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba8ad6700 1 -- start start 2023-03-02T10:49:56.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba8ad6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4100640 0x7f0ba4195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:56.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba8ad6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ba4102f60 0x7f0ba4195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:56.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba8ad6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ba4105880 0x7f0ba419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:56.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba8ad6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba419d3d0 con 0x7f0ba4102f60 2023-03-02T10:49:56.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba8ad6700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba419d510 con 0x7f0ba4105880 2023-03-02T10:49:56.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba8ad6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba419d6a0 con 0x7f0ba4100640 2023-03-02T10:49:56.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4100640 0x7f0ba4195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:56.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0b99d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ba4102f60 0x7f0ba4195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:56.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4100640 0x7f0ba4195850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:32950/0 (socket says 172.21.15.57:32950) 2023-03-02T10:49:56.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba259c700 1 -- 172.21.15.57:0/3383962307 learned_addr learned my addr 172.21.15.57:0/3383962307 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:49:56.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba2d9d700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ba4105880 0x7f0ba419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:56.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba259c700 1 -- 172.21.15.57:0/3383962307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ba4105880 msgr2=0x7f0ba419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:56.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba259c700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ba4105880 0x7f0ba419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:56.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba259c700 1 -- 172.21.15.57:0/3383962307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ba4102f60 msgr2=0x7f0ba4195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:49:56.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba259c700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ba4102f60 0x7f0ba4195d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:49:56.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0ba259c700 1 -- 172.21.15.57:0/3383962307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c0095f0 con 0x7f0ba4100640 2023-03-02T10:49:56.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.381+0000 7f0b99d9b700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ba4102f60 0x7f0ba4195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:49:56.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.382+0000 7f0ba259c700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4100640 0x7f0ba4195850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400ef10 tx=0x7f0b9400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:56.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.382+0000 7f0b9bfff700 1 -- 172.21.15.57:0/3383962307 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400c9c0 con 0x7f0ba4100640 2023-03-02T10:49:56.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.382+0000 7f0b9bfff700 1 -- 172.21.15.57:0/3383962307 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b9400f040 con 0x7f0ba4100640 2023-03-02T10:49:56.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.382+0000 7f0b9bfff700 1 -- 172.21.15.57:0/3383962307 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94014480 con 0x7f0ba4100640 2023-03-02T10:49:56.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.382+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3383962307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba410b500 con 0x7f0ba4100640 2023-03-02T10:49:56.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.382+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3383962307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba410b370 con 0x7f0ba4100640 2023-03-02T10:49:56.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.383+0000 7f0b9bfff700 1 -- 172.21.15.57:0/3383962307 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7f0b9400cb20 con 0x7f0ba4100640 2023-03-02T10:49:56.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.383+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3383962307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba40fbc10 con 0x7f0ba4100640 2023-03-02T10:49:56.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.383+0000 7f0b9bfff700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0b90036a30 0x7f0b90038ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:49:56.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.383+0000 7f0b9bfff700 1 -- 172.21.15.57:0/3383962307 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0b94048d60 con 0x7f0ba4100640 2023-03-02T10:49:56.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.383+0000 7f0b99d9b700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0b90036a30 0x7f0b90038ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:49:56.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.384+0000 7f0b99d9b700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0b90036a30 0x7f0b90038ee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c011490 tx=0x7f0b8c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:49:56.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.388+0000 7f0b9bfff700 1 -- 172.21.15.57:0/3383962307 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f0b9401b960 con 0x7f0ba4100640 2023-03-02T10:49:56.395 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:56 smithi057 ceph-mon[92072]: Reconfiguring mgr.x (unknown last config time)... 2023-03-02T10:49:56.395 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:56 smithi057 ceph-mon[92072]: Reconfiguring daemon mgr.x on smithi057 2023-03-02T10:49:56.395 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:56 smithi057 ceph-mon[92072]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:56.426 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:56 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:56.278+0000 7f1de6aac200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-02T10:49:56.428 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:56 smithi122 ceph-mon[125440]: Reconfiguring mgr.x (unknown last config time)... 2023-03-02T10:49:56.428 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:56 smithi122 ceph-mon[125440]: Reconfiguring daemon mgr.x on smithi057 2023-03-02T10:49:56.428 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:56 smithi122 ceph-mon[125440]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:56 smithi136 ceph-mon[125702]: Reconfiguring mgr.x (unknown last config time)... 2023-03-02T10:49:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:56 smithi136 ceph-mon[125702]: Reconfiguring daemon mgr.x on smithi057 2023-03-02T10:49:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:56 smithi136 ceph-mon[125702]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:56.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:56.603+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3383962307 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ba4061720 con 0x7f0b90036a30 2023-03-02T10:49:56.701 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:56 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:56.424+0000 7f1de6aac200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-02T10:49:57.201 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:56 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:56.837+0000 7f1de6aac200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-02T10:49:57.340 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:49:56 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:49:56.884+0000 7f2672339200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-02T10:49:57.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:57.500+0000 7f0b9bfff700 1 -- 172.21.15.57:0/3383962307 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mgrmap(e 14) v1 ==== 86691+0+0 (secure 0 0 0) 0x7f0b9401e980 con 0x7f0ba4100640 2023-03-02T10:49:57.684 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:57.359+0000 7f1de6aac200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-02T10:49:57.685 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:57.685 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:57.686 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:57.686 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:57.686 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:57.686 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:57.687 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:49:57.687 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:49:57.687 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:49:57.687 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:57.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: Standby manager daemon z started 2023-03-02T10:49:57.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-02T10:49:57.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:49:57.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-02T10:49:57.689 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:49:57.689 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-mon[125440]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:57.746 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:57.746 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:57.747 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:57.747 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:57.747 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:57.748 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:57.748 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:49:57.748 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:49:57.748 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:49:57.749 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:57.749 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: Standby manager daemon z started 2023-03-02T10:49:57.749 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-02T10:49:57.750 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:49:57.750 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-02T10:49:57.750 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:49:57.750 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:57 smithi057 ceph-mon[92072]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:49:57.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:49:57.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:49:57.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:49:57.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: Standby manager daemon z started 2023-03-02T10:49:57.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-02T10:49:57.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:49:57.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-02T10:49:57.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.136:0/3075222901' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:49:57.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:57 smithi136 ceph-mon[125702]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:57.951 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:57.683+0000 7f1de6aac200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-02T10:49:57.952 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:57.868+0000 7f1de6aac200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-02T10:49:58.451 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:57 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:57.981+0000 7f1de6aac200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-02T10:49:58.452 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:58 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:58.191+0000 7f1de6aac200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-02T10:49:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:58 smithi136 ceph-mon[125702]: mgrmap e14: x(active, since 68s), standbys: z 2023-03-02T10:49:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:58 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-02T10:49:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:58 smithi057 ceph-mon[92072]: mgrmap e14: x(active, since 68s), standbys: z 2023-03-02T10:49:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:58 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-02T10:49:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:58 smithi122 ceph-mon[125440]: mgrmap e14: x(active, since 68s), standbys: z 2023-03-02T10:49:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:58 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-02T10:49:59.451 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:49:59 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:49:59.063+0000 7f1de6aac200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-02T10:49:59.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:49:59.515+0000 7f0b9bfff700 1 -- 172.21.15.57:0/3383962307 <== mon.1 v2:172.21.15.136:3300/0 8 ==== mgrmap(e 15) v1 ==== 129817+0+0 (secure 0 0 0) 0x7f0b9401e460 con 0x7f0ba4100640 2023-03-02T10:49:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:59 smithi136 ceph-mon[125702]: Standby manager daemon y started 2023-03-02T10:49:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-02T10:49:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:49:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-02T10:49:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:49:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:59 smithi136 ceph-mon[125702]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:59 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1268323716' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cfc44e0-909d-44b5-8e46-9b49c6b752c5"}]: dispatch 2023-03-02T10:49:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:59 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1268323716' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cfc44e0-909d-44b5-8e46-9b49c6b752c5"}]': finished 2023-03-02T10:49:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:59 smithi136 ceph-mon[125702]: osdmap e5: 1 total, 0 up, 1 in 2023-03-02T10:49:59.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:49:59 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:49:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:59 smithi057 ceph-mon[92072]: Standby manager daemon y started 2023-03-02T10:49:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-02T10:49:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:49:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-02T10:49:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:49:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:59 smithi057 ceph-mon[92072]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:59 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1268323716' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cfc44e0-909d-44b5-8e46-9b49c6b752c5"}]: dispatch 2023-03-02T10:49:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:59 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1268323716' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cfc44e0-909d-44b5-8e46-9b49c6b752c5"}]': finished 2023-03-02T10:49:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:59 smithi057 ceph-mon[92072]: osdmap e5: 1 total, 0 up, 1 in 2023-03-02T10:49:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:49:59 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:49:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:59 smithi122 ceph-mon[125440]: Standby manager daemon y started 2023-03-02T10:49:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-02T10:49:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:49:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-02T10:49:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.122:0/905727585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:49:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:59 smithi122 ceph-mon[125440]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:49:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:59 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1268323716' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cfc44e0-909d-44b5-8e46-9b49c6b752c5"}]: dispatch 2023-03-02T10:49:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:59 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1268323716' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cfc44e0-909d-44b5-8e46-9b49c6b752c5"}]': finished 2023-03-02T10:49:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:59 smithi122 ceph-mon[125440]: osdmap e5: 1 total, 0 up, 1 in 2023-03-02T10:49:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:49:59 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:00 smithi136 ceph-mon[125702]: mgrmap e15: x(active, since 70s), standbys: z, y 2023-03-02T10:50:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:00 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-02T10:50:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T10:50:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:00 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2427052050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:50:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:00 smithi057 ceph-mon[92072]: mgrmap e15: x(active, since 70s), standbys: z, y 2023-03-02T10:50:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:00 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-02T10:50:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T10:50:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:00 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2427052050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:50:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:00 smithi122 ceph-mon[125440]: mgrmap e15: x(active, since 70s), standbys: z, y 2023-03-02T10:50:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:00 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-02T10:50:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T10:50:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:00 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2427052050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:50:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:01 smithi136 ceph-mon[125702]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:01 smithi057 ceph-mon[92072]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:01 smithi122 ceph-mon[125440]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:04 smithi122 ceph-mon[125440]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:04 smithi136 ceph-mon[125702]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:04.601 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:04 smithi057 ceph-mon[92072]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:06 smithi136 ceph-mon[125702]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:06 smithi057 ceph-mon[92072]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:06 smithi122 ceph-mon[125440]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:07.495 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-03-02T10:50:07.495 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:07.495 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:07 smithi057 ceph-mon[92072]: Deploying daemon osd.0 on smithi057 2023-03-02T10:50:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-03-02T10:50:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:07 smithi136 ceph-mon[125702]: Deploying daemon osd.0 on smithi057 2023-03-02T10:50:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-03-02T10:50:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:07 smithi122 ceph-mon[125440]: Deploying daemon osd.0 on smithi057 2023-03-02T10:50:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:08 smithi057 ceph-mon[92072]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:08 smithi136 ceph-mon[125702]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:08 smithi122 ceph-mon[125440]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:10.518 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:10 smithi057 ceph-mon[92072]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:10 smithi136 ceph-mon[125702]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:10 smithi122 ceph-mon[125440]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:12 smithi057 ceph-mon[92072]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:12 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:12 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:12 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:12 smithi136 ceph-mon[125702]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:12 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:12 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:12 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:12 smithi122 ceph-mon[125440]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:12 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:12 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:12 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:14 smithi057 ceph-mon[92072]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:14 smithi136 ceph-mon[125702]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:14 smithi122 ceph-mon[125440]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:15.081 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 0 on host 'smithi057' 2023-03-02T10:50:15.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.079+0000 7f0b9bfff700 1 -- 172.21.15.57:0/3383962307 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0ba4061720 con 0x7f0b90036a30 2023-03-02T10:50:15.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.082+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3383962307 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0b90036a30 msgr2=0x7f0b90038ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:15.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.082+0000 7f0ba8ad6700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0b90036a30 0x7f0b90038ee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c011490 tx=0x7f0b8c009260 comp rx=0 tx=0).stop 2023-03-02T10:50:15.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.082+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3383962307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4100640 msgr2=0x7f0ba4195850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:15.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.082+0000 7f0ba8ad6700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4100640 0x7f0ba4195850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400ef10 tx=0x7f0b9400c3a0 comp rx=0 tx=0).stop 2023-03-02T10:50:15.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.082+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3383962307 shutdown_connections 2023-03-02T10:50:15.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.082+0000 7f0ba8ad6700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0b90036a30 0x7f0b90038ee0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:15.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.082+0000 7f0ba8ad6700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ba4105880 0x7f0ba419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:15.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.082+0000 7f0ba8ad6700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4100640 0x7f0ba4195850 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:15.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.082+0000 7f0ba8ad6700 1 --2- 172.21.15.57:0/3383962307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ba4102f60 0x7f0ba4195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:15.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.082+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3383962307 >> 172.21.15.57:0/3383962307 conn(0x7f0ba40fa0a0 msgr2=0x7f0ba4101280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:50:15.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.083+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3383962307 shutdown_connections 2023-03-02T10:50:15.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:50:15.083+0000 7f0ba8ad6700 1 -- 172.21.15.57:0/3383962307 wait complete. 2023-03-02T10:50:15.539 DEBUG:teuthology.orchestra.run.smithi057:osd.0> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.0.service 2023-03-02T10:50:15.543 INFO:tasks.cephadm:Deploying osd.1 on smithi122 with /dev/vg_nvme/lv_4... 2023-03-02T10:50:15.543 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-03-02T10:50:15.589 INFO:journalctl@ceph.osd.0.smithi057.stdout:-- Logs begin at Thu 2023-03-02 10:29:06 UTC. -- 2023-03-02T10:50:16.192 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.b/config 2023-03-02T10:50:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:16 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:16 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:16 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:16 smithi136 ceph-mon[125702]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:16 smithi136 ceph-mon[125702]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-03-02T10:50:16.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:16 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:16.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:16 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:16.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:16 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:16.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:16 smithi122 ceph-mon[125440]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:16.433 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:16 smithi122 ceph-mon[125440]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-03-02T10:50:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:16 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:16 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:16 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:16 smithi057 ceph-mon[92072]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:16 smithi057 ceph-mon[92072]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-03-02T10:50:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:17 smithi057 ceph-mon[92072]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-03-02T10:50:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:17 smithi057 ceph-mon[92072]: osdmap e6: 1 total, 0 up, 1 in 2023-03-02T10:50:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:17 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:17.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:17 smithi057 ceph-mon[92072]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:50:17.434 INFO:journalctl@ceph.osd.0.smithi057.stdout:Mar 02 10:50:17 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-0[104839]: 2023-03-02T10:50:17.107+0000 7fcc84ad4700 -1 osd.0 0 waiting for initial osdmap 2023-03-02T10:50:17.434 INFO:journalctl@ceph.osd.0.smithi057.stdout:Mar 02 10:50:17 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-0[104839]: 2023-03-02T10:50:17.111+0000 7fcc800c8700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:50:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:17 smithi122 ceph-mon[125440]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-03-02T10:50:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:17 smithi122 ceph-mon[125440]: osdmap e6: 1 total, 0 up, 1 in 2023-03-02T10:50:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:17 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:17 smithi122 ceph-mon[125440]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:50:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:17 smithi136 ceph-mon[125702]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-03-02T10:50:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:17 smithi136 ceph-mon[125702]: osdmap e6: 1 total, 0 up, 1 in 2023-03-02T10:50:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:17 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:17 smithi136 ceph-mon[125702]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:50:17.724 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-03-02T10:50:17.725 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-03-02T10:50:17.725 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2023-03-02T10:50:17.725 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2023-03-02T10:50:17.725 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0106594 s, 984 MB/s 2023-03-02T10:50:17.725 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2023-03-02T10:50:18.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi122:vg_nvme/lv_4 2023-03-02T10:50:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:18 smithi057 ceph-mon[92072]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:50:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:18 smithi057 ceph-mon[92072]: osdmap e7: 1 total, 0 up, 1 in 2023-03-02T10:50:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:18 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:18 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:18 smithi057 ceph-mon[92072]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:18 smithi122 ceph-mon[125440]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:50:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:18 smithi122 ceph-mon[125440]: osdmap e7: 1 total, 0 up, 1 in 2023-03-02T10:50:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:18 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:18 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:18 smithi122 ceph-mon[125440]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:18 smithi136 ceph-mon[125702]: from='osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:50:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:18 smithi136 ceph-mon[125702]: osdmap e7: 1 total, 0 up, 1 in 2023-03-02T10:50:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:18 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:18 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:18 smithi136 ceph-mon[125702]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-02T10:50:18.786 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.b/config 2023-03-02T10:50:19.317 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:50:19.317 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:50:19.317 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:19.317 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568] boot 2023-03-02T10:50:19.317 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: osdmap e8: 1 total, 1 up, 1 in 2023-03-02T10:50:19.318 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:19.318 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi057 2023-03-02T10:50:19.318 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.318 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.318 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:50:19.319 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 17276M 2023-03-02T10:50:19.319 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.319 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:19.319 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:19.319 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:50:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:50:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:19.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568] boot 2023-03-02T10:50:19.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: osdmap e8: 1 total, 1 up, 1 in 2023-03-02T10:50:19.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:19.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi057 2023-03-02T10:50:19.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:50:19.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 17276M 2023-03-02T10:50:19.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:19.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:19.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:50:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:50:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: osd.0 [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568] boot 2023-03-02T10:50:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: osdmap e8: 1 total, 1 up, 1 in 2023-03-02T10:50:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:50:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi057 2023-03-02T10:50:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:50:19.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 17276M 2023-03-02T10:50:19.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:19.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:19.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:19.980 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.977+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/106016917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c54100640 msgr2=0x7f7c54106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:19.981 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.977+0000 7f7c5b6f5700 1 --2- 172.21.15.122:0/106016917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c54100640 0x7f7c54106f00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00b0a0 tx=0x7f7c4c00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:50:19.981 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.977+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/106016917 shutdown_connections 2023-03-02T10:50:19.981 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.977+0000 7f7c5b6f5700 1 --2- 172.21.15.122:0/106016917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c54100640 0x7f7c54106f00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:19.981 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.977+0000 7f7c5b6f5700 1 --2- 172.21.15.122:0/106016917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c540feac0 0x7f7c540feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:19.981 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.977+0000 7f7c5b6f5700 1 --2- 172.21.15.122:0/106016917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c540ffcb0 0x7f7c54100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:19.981 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.977+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/106016917 >> 172.21.15.122:0/106016917 conn(0x7f7c540fa0a0 msgr2=0x7f7c540fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:50:19.982 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.977+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/106016917 shutdown_connections 2023-03-02T10:50:19.982 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.977+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/106016917 wait complete. 2023-03-02T10:50:19.982 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c5b6f5700 1 Processor -- start 2023-03-02T10:50:19.982 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c5b6f5700 1 -- start start 2023-03-02T10:50:19.982 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c5b6f5700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c540feac0 0x7f7c54102b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:50:19.982 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c5b6f5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c540ffcb0 0x7f7c541011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:50:19.982 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c5b6f5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c54100640 0x7f7c541016e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:50:19.982 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c5b6f5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54101e80 con 0x7f7c540ffcb0 2023-03-02T10:50:19.983 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c5b6f5700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54101ff0 con 0x7f7c540feac0 2023-03-02T10:50:19.983 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c5b6f5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5419f970 con 0x7f7c54100640 2023-03-02T10:50:19.983 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c59491700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c540feac0 0x7f7c54102b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:50:19.983 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c59491700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c540feac0 0x7f7c54102b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58840/0 (socket says 172.21.15.122:58840) 2023-03-02T10:50:19.983 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c59491700 1 -- 172.21.15.122:0/2612840030 learned_addr learned my addr 172.21.15.122:0/2612840030 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-03-02T10:50:19.983 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c58c90700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c540ffcb0 0x7f7c541011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:50:19.983 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c59491700 1 -- 172.21.15.122:0/2612840030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c54100640 msgr2=0x7f7c541016e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:19.984 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c59491700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c54100640 0x7f7c541016e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:19.984 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c59491700 1 -- 172.21.15.122:0/2612840030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c540ffcb0 msgr2=0x7f7c541011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:19.984 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c59491700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c540ffcb0 0x7f7c541011a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:19.984 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c59491700 1 -- 172.21.15.122:0/2612840030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c009d00 con 0x7f7c540feac0 2023-03-02T10:50:19.984 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c59491700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c540feac0 0x7f7c54102b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c990 tx=0x7f7c4400cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:50:19.984 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c4a7fc700 1 -- 172.21.15.122:0/2612840030 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44007b00 con 0x7f7c540feac0 2023-03-02T10:50:19.984 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.978+0000 7f7c4a7fc700 1 -- 172.21.15.122:0/2612840030 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c44007c60 con 0x7f7c540feac0 2023-03-02T10:50:19.984 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.979+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/2612840030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5410a430 con 0x7f7c540feac0 2023-03-02T10:50:19.985 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.979+0000 7f7c4a7fc700 1 -- 172.21.15.122:0/2612840030 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44018660 con 0x7f7c540feac0 2023-03-02T10:50:19.986 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.979+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/2612840030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5410a2a0 con 0x7f7c540feac0 2023-03-02T10:50:19.986 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.979+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/2612840030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c541069a0 con 0x7f7c540feac0 2023-03-02T10:50:19.986 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.980+0000 7f7c4a7fc700 1 -- 172.21.15.122:0/2612840030 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 15) v1 ==== 129817+0+0 (secure 0 0 0) 0x7f7c4400f450 con 0x7f7c540feac0 2023-03-02T10:50:19.986 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.981+0000 7f7c4a7fc700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c4009b3d0 0x7f7c4009d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:50:19.987 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.981+0000 7f7c4a7fc700 1 -- 172.21.15.122:0/2612840030 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f7c440c35a0 con 0x7f7c540feac0 2023-03-02T10:50:19.987 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.981+0000 7f7c58c90700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c4009b3d0 0x7f7c4009d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:50:19.987 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.982+0000 7f7c58c90700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c4009b3d0 0x7f7c4009d880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c50005ea0 tx=0x7f7c50005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:50:19.987 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:19.985+0000 7f7c4a7fc700 1 -- 172.21.15.122:0/2612840030 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f7c440908f0 con 0x7f7c540feac0 2023-03-02T10:50:20.176 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:20.174+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/2612840030 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c540616f0 con 0x7f7c4009b3d0 2023-03-02T10:50:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:20 smithi136 ceph-mon[125702]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:20 smithi136 ceph-mon[125702]: osdmap e9: 1 total, 1 up, 1 in 2023-03-02T10:50:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:20 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:50:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:20 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:50:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:20 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:20 smithi057 ceph-mon[92072]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:20 smithi057 ceph-mon[92072]: osdmap e9: 1 total, 1 up, 1 in 2023-03-02T10:50:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:20 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:50:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:20 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:50:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:20 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:20 smithi122 ceph-mon[125440]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:20 smithi122 ceph-mon[125440]: osdmap e9: 1 total, 1 up, 1 in 2023-03-02T10:50:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:20 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:50:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:20 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:50:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:20 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:21.374 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:21 smithi122 ceph-mon[125440]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:50:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:21 smithi136 ceph-mon[125702]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:50:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:21 smithi057 ceph-mon[92072]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:50:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:22 smithi136 ceph-mon[125702]: pgmap v45: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:22 smithi057 ceph-mon[92072]: pgmap v45: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:22 smithi122 ceph-mon[125440]: pgmap v45: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:23 smithi136 ceph-mon[125702]: from='client.? 172.21.15.122:0/3934036722' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca0af291-6446-4019-a4cd-16a4998db8da"}]: dispatch 2023-03-02T10:50:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:23 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca0af291-6446-4019-a4cd-16a4998db8da"}]: dispatch 2023-03-02T10:50:23.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:23 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca0af291-6446-4019-a4cd-16a4998db8da"}]': finished 2023-03-02T10:50:23.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:23 smithi136 ceph-mon[125702]: osdmap e10: 2 total, 1 up, 2 in 2023-03-02T10:50:23.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:23.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:23 smithi136 ceph-mon[125702]: from='client.? 172.21.15.122:0/3448592329' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:50:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:23 smithi057 ceph-mon[92072]: from='client.? 172.21.15.122:0/3934036722' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca0af291-6446-4019-a4cd-16a4998db8da"}]: dispatch 2023-03-02T10:50:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:23 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca0af291-6446-4019-a4cd-16a4998db8da"}]: dispatch 2023-03-02T10:50:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:23 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca0af291-6446-4019-a4cd-16a4998db8da"}]': finished 2023-03-02T10:50:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:23 smithi057 ceph-mon[92072]: osdmap e10: 2 total, 1 up, 2 in 2023-03-02T10:50:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:23 smithi057 ceph-mon[92072]: from='client.? 172.21.15.122:0/3448592329' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:50:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:23 smithi122 ceph-mon[125440]: from='client.? 172.21.15.122:0/3934036722' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca0af291-6446-4019-a4cd-16a4998db8da"}]: dispatch 2023-03-02T10:50:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:23 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca0af291-6446-4019-a4cd-16a4998db8da"}]: dispatch 2023-03-02T10:50:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:23 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca0af291-6446-4019-a4cd-16a4998db8da"}]': finished 2023-03-02T10:50:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:23 smithi122 ceph-mon[125440]: osdmap e10: 2 total, 1 up, 2 in 2023-03-02T10:50:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:23 smithi122 ceph-mon[125440]: from='client.? 172.21.15.122:0/3448592329' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:50:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:24 smithi136 ceph-mon[125702]: pgmap v47: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:24 smithi057 ceph-mon[92072]: pgmap v47: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:24 smithi122 ceph-mon[125440]: pgmap v47: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:26 smithi136 ceph-mon[125702]: pgmap v48: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:26 smithi057 ceph-mon[92072]: pgmap v48: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:26.693 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:26 smithi122 ceph-mon[125440]: pgmap v48: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:28 smithi136 ceph-mon[125702]: pgmap v49: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:28 smithi057 ceph-mon[92072]: pgmap v49: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:28 smithi122 ceph-mon[125440]: pgmap v49: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-03-02T10:50:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-03-02T10:50:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-03-02T10:50:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:30 smithi136 ceph-mon[125702]: pgmap v50: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:30 smithi136 ceph-mon[125702]: Deploying daemon osd.1 on smithi122 2023-03-02T10:50:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:30 smithi057 ceph-mon[92072]: pgmap v50: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:30 smithi057 ceph-mon[92072]: Deploying daemon osd.1 on smithi122 2023-03-02T10:50:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:30 smithi122 ceph-mon[125440]: pgmap v50: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:30 smithi122 ceph-mon[125440]: Deploying daemon osd.1 on smithi122 2023-03-02T10:50:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:32 smithi136 ceph-mon[125702]: pgmap v51: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:32 smithi057 ceph-mon[92072]: pgmap v51: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:32 smithi122 ceph-mon[125440]: pgmap v51: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:34 smithi122 ceph-mon[125440]: pgmap v52: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:34 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:34 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:34 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:34 smithi136 ceph-mon[125702]: pgmap v52: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:34 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:34 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:34 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:34 smithi057 ceph-mon[92072]: pgmap v52: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:34 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:34 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:34 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:36 smithi122 ceph-mon[125440]: pgmap v53: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:36.493 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.491+0000 7f7c4a7fc700 1 -- 172.21.15.122:0/2612840030 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7c540616f0 con 0x7f7c4009b3d0 2023-03-02T10:50:36.493 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 1 on host 'smithi122' 2023-03-02T10:50:36.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/2612840030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c4009b3d0 msgr2=0x7f7c4009d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:36.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c4009b3d0 0x7f7c4009d880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c50005ea0 tx=0x7f7c50005e30 comp rx=0 tx=0).stop 2023-03-02T10:50:36.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/2612840030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c540feac0 msgr2=0x7f7c54102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:36.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c540feac0 0x7f7c54102b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c990 tx=0x7f7c4400cd50 comp rx=0 tx=0).stop 2023-03-02T10:50:36.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/2612840030 shutdown_connections 2023-03-02T10:50:36.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c4009b3d0 0x7f7c4009d880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:36.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c54100640 0x7f7c541016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:36.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c540feac0 0x7f7c54102b60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:36.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 --2- 172.21.15.122:0/2612840030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c540ffcb0 0x7f7c541011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:36.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/2612840030 >> 172.21.15.122:0/2612840030 conn(0x7f7c540fa0a0 msgr2=0x7f7c540fc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:50:36.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/2612840030 shutdown_connections 2023-03-02T10:50:36.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:50:36.494+0000 7f7c5b6f5700 1 -- 172.21.15.122:0/2612840030 wait complete. 2023-03-02T10:50:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:36 smithi136 ceph-mon[125702]: pgmap v53: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:36 smithi057 ceph-mon[92072]: pgmap v53: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:36.879 DEBUG:teuthology.orchestra.run.smithi122:osd.1> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.1.service 2023-03-02T10:50:36.881 INFO:tasks.cephadm:Deploying osd.2 on smithi136 with /dev/vg_nvme/lv_4... 2023-03-02T10:50:36.881 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-03-02T10:50:36.913 INFO:journalctl@ceph.osd.1.smithi122.stdout:-- Logs begin at Thu 2023-03-02 10:22:37 UTC. -- 2023-03-02T10:50:37.526 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:50:37.769 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:37 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:37.769 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:37 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:37.770 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:37 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:37.770 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:37 smithi136 ceph-mon[125702]: pgmap v54: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:37.780 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 10:50:37 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-1[130537]: 2023-03-02T10:50:37.602+0000 7f3f18e395c0 -1 osd.1 0 log_to_monitors true 2023-03-02T10:50:37.781 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:37 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:37.781 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:37 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:37.781 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:37 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:37.781 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:37 smithi122 ceph-mon[125440]: pgmap v54: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:37 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:37 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:37 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:37 smithi057 ceph-mon[92072]: pgmap v54: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:38.811 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:38 smithi122 ceph-mon[125440]: from='osd.1 [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-02T10:50:38.811 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:38 smithi122 ceph-mon[125440]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-02T10:50:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:38 smithi136 ceph-mon[125702]: from='osd.1 [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-02T10:50:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:38 smithi136 ceph-mon[125702]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-02T10:50:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:38 smithi057 ceph-mon[92072]: from='osd.1 [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-02T10:50:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:38 smithi057 ceph-mon[92072]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-02T10:50:39.043 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-03-02T10:50:39.044 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-03-02T10:50:39.044 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2023-03-02T10:50:39.044 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2023-03-02T10:50:39.044 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00808426 s, 1.3 GB/s 2023-03-02T10:50:39.044 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2023-03-02T10:50:39.478 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi136:vg_nvme/lv_4 2023-03-02T10:50:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-03-02T10:50:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: osdmap e11: 2 total, 1 up, 2 in 2023-03-02T10:50:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: from='osd.1 [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:50:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:50:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi122 2023-03-02T10:50:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: pgmap v56: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:39.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:50:39.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 17168M 2023-03-02T10:50:39.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:39.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:39.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:39.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:39 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-03-02T10:50:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: osdmap e11: 2 total, 1 up, 2 in 2023-03-02T10:50:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: from='osd.1 [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:50:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:50:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi122 2023-03-02T10:50:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: pgmap v56: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:50:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 17168M 2023-03-02T10:50:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:39.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:39.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:39.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:39 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:39.951 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-1[130537]: 2023-03-02T10:50:39.528+0000 7f3f0cdbe700 -1 osd.1 0 waiting for initial osdmap 2023-03-02T10:50:39.952 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-1[130537]: 2023-03-02T10:50:39.531+0000 7f3f06baf700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:50:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-03-02T10:50:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: osdmap e11: 2 total, 1 up, 2 in 2023-03-02T10:50:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: from='osd.1 [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:50:39.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:50:39.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi122 2023-03-02T10:50:39.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:39.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: pgmap v56: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:39.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:39.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:50:39.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 17168M 2023-03-02T10:50:39.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:39.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:39.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:39.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:39 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:40.110 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:50:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:40 smithi136 ceph-mon[125702]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:50:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:40 smithi136 ceph-mon[125702]: osdmap e12: 2 total, 1 up, 2 in 2023-03-02T10:50:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:40 smithi057 ceph-mon[92072]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:50:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:40 smithi057 ceph-mon[92072]: osdmap e12: 2 total, 1 up, 2 in 2023-03-02T10:50:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:40 smithi122 ceph-mon[125440]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:50:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:40 smithi122 ceph-mon[125440]: osdmap e12: 2 total, 1 up, 2 in 2023-03-02T10:50:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:41.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.282+0000 7f23576ef700 1 -- 172.21.15.136:0/3494625231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100640 msgr2=0x7f2350106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:41.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.282+0000 7f23576ef700 1 --2- 172.21.15.136:0/3494625231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100640 0x7f2350106f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f234800b0a0 tx=0x7f234800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:50:41.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.282+0000 7f23576ef700 1 -- 172.21.15.136:0/3494625231 shutdown_connections 2023-03-02T10:50:41.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.282+0000 7f23576ef700 1 --2- 172.21.15.136:0/3494625231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100640 0x7f2350106f00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:41.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.282+0000 7f23576ef700 1 --2- 172.21.15.136:0/3494625231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23500feac0 0x7f23500feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:41.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.282+0000 7f23576ef700 1 --2- 172.21.15.136:0/3494625231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23500ffcb0 0x7f2350100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:41.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.282+0000 7f23576ef700 1 -- 172.21.15.136:0/3494625231 >> 172.21.15.136:0/3494625231 conn(0x7f23500fa0a0 msgr2=0x7f23500fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:50:41.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.282+0000 7f23576ef700 1 -- 172.21.15.136:0/3494625231 shutdown_connections 2023-03-02T10:50:41.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.282+0000 7f23576ef700 1 -- 172.21.15.136:0/3494625231 wait complete. 2023-03-02T10:50:41.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.282+0000 7f23576ef700 1 Processor -- start 2023-03-02T10:50:41.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.282+0000 7f23576ef700 1 -- start start 2023-03-02T10:50:41.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f23576ef700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23500feac0 0x7f23500689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:50:41.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f23576ef700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23500ffcb0 0x7f235019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:50:41.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f23576ef700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100640 0x7f235019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:50:41.287 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f23576ef700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235019d3d0 con 0x7f23500feac0 2023-03-02T10:50:41.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f23576ef700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235019d540 con 0x7f23500ffcb0 2023-03-02T10:50:41.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f23576ef700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235019d700 con 0x7f2350100640 2023-03-02T10:50:41.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f2355c8c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100640 0x7f235019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:50:41.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f2355c8c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100640 0x7f235019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35090/0 (socket says 172.21.15.136:35090) 2023-03-02T10:50:41.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f2355c8c700 1 -- 172.21.15.136:0/1140232784 learned_addr learned my addr 172.21.15.136:0/1140232784 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-02T10:50:41.288 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f235548b700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23500feac0 0x7f23500689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:50:41.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f2354c8a700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23500ffcb0 0x7f235019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:50:41.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f2355c8c700 1 -- 172.21.15.136:0/1140232784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23500ffcb0 msgr2=0x7f235019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:41.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f2355c8c700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23500ffcb0 0x7f235019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:41.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f2355c8c700 1 -- 172.21.15.136:0/1140232784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23500feac0 msgr2=0x7f23500689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:41.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f2355c8c700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23500feac0 0x7f23500689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:41.289 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f2355c8c700 1 -- 172.21.15.136:0/1140232784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2348009d00 con 0x7f2350100640 2023-03-02T10:50:41.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f2355c8c700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100640 0x7f235019cc30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f234800b070 tx=0x7f2348012620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:50:41.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f23467fc700 1 -- 172.21.15.136:0/1140232784 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234800e040 con 0x7f2350100640 2023-03-02T10:50:41.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f23576ef700 1 -- 172.21.15.136:0/1140232784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235010a430 con 0x7f2350100640 2023-03-02T10:50:41.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f23467fc700 1 -- 172.21.15.136:0/1140232784 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2348012c50 con 0x7f2350100640 2023-03-02T10:50:41.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f23467fc700 1 -- 172.21.15.136:0/1140232784 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348005570 con 0x7f2350100640 2023-03-02T10:50:41.290 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.283+0000 7f23576ef700 1 -- 172.21.15.136:0/1140232784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235010a2a0 con 0x7f2350100640 2023-03-02T10:50:41.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.284+0000 7f23576ef700 1 -- 172.21.15.136:0/1140232784 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2350106020 con 0x7f2350100640 2023-03-02T10:50:41.298 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.285+0000 7f23467fc700 1 -- 172.21.15.136:0/1140232784 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) v1 ==== 129817+0+0 (secure 0 0 0) 0x7f23480056d0 con 0x7f2350100640 2023-03-02T10:50:41.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.286+0000 7f23467fc700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f233c09b350 0x7f233c09d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:50:41.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.286+0000 7f23467fc700 1 -- 172.21.15.136:0/1140232784 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f23480c4ed0 con 0x7f2350100640 2023-03-02T10:50:41.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.286+0000 7f235548b700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f233c09b350 0x7f233c09d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:50:41.299 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.286+0000 7f235548b700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f233c09b350 0x7f233c09d800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f23500ffb10 tx=0x7f234c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:50:41.300 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.290+0000 7f23467fc700 1 -- 172.21.15.136:0/1140232784 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f2348092090 con 0x7f2350100640 2023-03-02T10:50:41.481 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:41.479+0000 7f23576ef700 1 -- 172.21.15.136:0/1140232784 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2350061520 con 0x7f233c09b350 2023-03-02T10:50:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:41 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:50:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:41 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:50:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:41 smithi136 ceph-mon[125702]: osd.1 [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717] boot 2023-03-02T10:50:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:41 smithi136 ceph-mon[125702]: osdmap e13: 2 total, 2 up, 2 in 2023-03-02T10:50:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:41 smithi136 ceph-mon[125702]: pgmap v59: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:50:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:50:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:41 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:50:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:41 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:50:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:41 smithi057 ceph-mon[92072]: osd.1 [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717] boot 2023-03-02T10:50:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:41 smithi057 ceph-mon[92072]: osdmap e13: 2 total, 2 up, 2 in 2023-03-02T10:50:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:41 smithi057 ceph-mon[92072]: pgmap v59: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:50:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:50:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:41 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:50:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:41 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:50:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:41 smithi122 ceph-mon[125440]: osd.1 [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717] boot 2023-03-02T10:50:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:41 smithi122 ceph-mon[125440]: osdmap e13: 2 total, 2 up, 2 in 2023-03-02T10:50:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:41 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:50:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:41 smithi122 ceph-mon[125440]: pgmap v59: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-02T10:50:41.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:41 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:50:41.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:41 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:50:41.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:41 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:42 smithi136 ceph-mon[125702]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:50:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:42 smithi136 ceph-mon[125702]: osdmap e14: 2 total, 2 up, 2 in 2023-03-02T10:50:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:42 smithi057 ceph-mon[92072]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:50:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:42 smithi057 ceph-mon[92072]: osdmap e14: 2 total, 2 up, 2 in 2023-03-02T10:50:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:42 smithi122 ceph-mon[125440]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:50:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:42 smithi122 ceph-mon[125440]: osdmap e14: 2 total, 2 up, 2 in 2023-03-02T10:50:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:44 smithi136 ceph-mon[125702]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:44 smithi136 ceph-mon[125702]: from='client.? 172.21.15.136:0/3620295430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0882e69-9661-4006-9350-108c73b8cbcc"}]: dispatch 2023-03-02T10:50:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:44 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0882e69-9661-4006-9350-108c73b8cbcc"}]: dispatch 2023-03-02T10:50:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:44 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0882e69-9661-4006-9350-108c73b8cbcc"}]': finished 2023-03-02T10:50:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:44 smithi136 ceph-mon[125702]: osdmap e15: 3 total, 2 up, 3 in 2023-03-02T10:50:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:50:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:44 smithi057 ceph-mon[92072]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:44 smithi057 ceph-mon[92072]: from='client.? 172.21.15.136:0/3620295430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0882e69-9661-4006-9350-108c73b8cbcc"}]: dispatch 2023-03-02T10:50:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:44 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0882e69-9661-4006-9350-108c73b8cbcc"}]: dispatch 2023-03-02T10:50:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:44 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0882e69-9661-4006-9350-108c73b8cbcc"}]': finished 2023-03-02T10:50:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:44 smithi057 ceph-mon[92072]: osdmap e15: 3 total, 2 up, 3 in 2023-03-02T10:50:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:50:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:44 smithi122 ceph-mon[125440]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:44 smithi122 ceph-mon[125440]: from='client.? 172.21.15.136:0/3620295430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0882e69-9661-4006-9350-108c73b8cbcc"}]: dispatch 2023-03-02T10:50:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:44 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0882e69-9661-4006-9350-108c73b8cbcc"}]: dispatch 2023-03-02T10:50:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:44 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0882e69-9661-4006-9350-108c73b8cbcc"}]': finished 2023-03-02T10:50:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:44 smithi122 ceph-mon[125440]: osdmap e15: 3 total, 2 up, 3 in 2023-03-02T10:50:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:50:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:45 smithi136 ceph-mon[125702]: from='client.? 172.21.15.136:0/1264096868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:50:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:45 smithi057 ceph-mon[92072]: from='client.? 172.21.15.136:0/1264096868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:50:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:45 smithi122 ceph-mon[125440]: from='client.? 172.21.15.136:0/1264096868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:50:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:46 smithi136 ceph-mon[125702]: pgmap v63: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:46 smithi057 ceph-mon[92072]: pgmap v63: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:46 smithi122 ceph-mon[125440]: pgmap v63: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:48 smithi136 ceph-mon[125702]: pgmap v64: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:48 smithi057 ceph-mon[92072]: pgmap v64: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:48 smithi122 ceph-mon[125440]: pgmap v64: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:50.508 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:50 smithi136 ceph-mon[125702]: pgmap v65: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:50 smithi057 ceph-mon[92072]: pgmap v65: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:50 smithi122 ceph-mon[125440]: pgmap v65: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:51.508 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:51 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-03-02T10:50:51.508 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:51 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:51 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-03-02T10:50:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:51 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:51 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-03-02T10:50:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:51 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:52.438 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:52 smithi136 ceph-mon[125702]: Deploying daemon osd.2 on smithi136 2023-03-02T10:50:52.438 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:52 smithi136 ceph-mon[125702]: pgmap v66: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:52 smithi057 ceph-mon[92072]: Deploying daemon osd.2 on smithi136 2023-03-02T10:50:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:52 smithi057 ceph-mon[92072]: pgmap v66: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:52 smithi122 ceph-mon[125440]: Deploying daemon osd.2 on smithi136 2023-03-02T10:50:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:52 smithi122 ceph-mon[125440]: pgmap v66: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:54 smithi136 ceph-mon[125702]: pgmap v67: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:54 smithi057 ceph-mon[92072]: pgmap v67: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:54 smithi122 ceph-mon[125440]: pgmap v67: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:56.266 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:56 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:56.266 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:56 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:56.266 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:56 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:56.267 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:56 smithi136 ceph-mon[125702]: pgmap v68: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:56 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:56 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:56 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:56 smithi057 ceph-mon[92072]: pgmap v68: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:56 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:56 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:56 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:56 smithi122 ceph-mon[125440]: pgmap v68: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:57.901 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.900+0000 7f23467fc700 1 -- 172.21.15.136:0/1140232784 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2350061520 con 0x7f233c09b350 2023-03-02T10:50:57.902 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 2 on host 'smithi136' 2023-03-02T10:50:57.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 -- 172.21.15.136:0/1140232784 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f233c09b350 msgr2=0x7f233c09d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:57.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f233c09b350 0x7f233c09d800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f23500ffb10 tx=0x7f234c00b410 comp rx=0 tx=0).stop 2023-03-02T10:50:57.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 -- 172.21.15.136:0/1140232784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100640 msgr2=0x7f235019cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:50:57.903 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100640 0x7f235019cc30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f234800b070 tx=0x7f2348012620 comp rx=0 tx=0).stop 2023-03-02T10:50:57.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 -- 172.21.15.136:0/1140232784 shutdown_connections 2023-03-02T10:50:57.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f233c09b350 0x7f233c09d800 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:57.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2350100640 0x7f235019cc30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:57.904 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23500feac0 0x7f23500689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:57.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 --2- 172.21.15.136:0/1140232784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23500ffcb0 0x7f235019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:50:57.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 -- 172.21.15.136:0/1140232784 >> 172.21.15.136:0/1140232784 conn(0x7f23500fa0a0 msgr2=0x7f2350103160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:50:57.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 -- 172.21.15.136:0/1140232784 shutdown_connections 2023-03-02T10:50:57.905 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:50:57.902+0000 7f23576ef700 1 -- 172.21.15.136:0/1140232784 wait complete. 2023-03-02T10:50:58.302 DEBUG:teuthology.orchestra.run.smithi136:osd.2> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.2.service 2023-03-02T10:50:58.304 INFO:tasks.cephadm:Deploying osd.3 on smithi057 with /dev/vg_nvme/lv_3... 2023-03-02T10:50:58.305 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-03-02T10:50:58.333 INFO:journalctl@ceph.osd.2.smithi136.stdout:-- Logs begin at Thu 2023-03-02 10:22:36 UTC. -- 2023-03-02T10:50:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:58 smithi136 ceph-mon[125702]: pgmap v69: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:58 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:58 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:58 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:58 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:58 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:58 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:58 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:58 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:58 smithi057 ceph-mon[92072]: pgmap v69: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:58 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:58 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:58 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:58 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:58 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:58 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:58 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:58 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:58 smithi122 ceph-mon[125440]: pgmap v69: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:50:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:58 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:58 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:58 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:50:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:58 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:50:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:58 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:58 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:58 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:50:58.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:58 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:50:58.945 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:50:59.074 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 10:50:58 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-2[131505]: 2023-03-02T10:50:58.968+0000 7f62a2d575c0 -1 osd.2 0 log_to_monitors true 2023-03-02T10:50:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:59 smithi136 ceph-mon[125702]: from='osd.2 [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-02T10:50:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:50:59 smithi136 ceph-mon[125702]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-02T10:50:59.479 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:59 smithi057 ceph-mon[92072]: from='osd.2 [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-02T10:50:59.480 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:50:59 smithi057 ceph-mon[92072]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-02T10:50:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:59 smithi122 ceph-mon[125440]: from='osd.2 [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-02T10:50:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:50:59 smithi122 ceph-mon[125440]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-02T10:51:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:00 smithi057 ceph-mon[92072]: pgmap v70: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:51:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:00 smithi057 ceph-mon[92072]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-03-02T10:51:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:00 smithi057 ceph-mon[92072]: osdmap e16: 3 total, 2 up, 3 in 2023-03-02T10:51:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:00 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:00 smithi057 ceph-mon[92072]: from='osd.2 [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:51:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:00 smithi057 ceph-mon[92072]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:51:00.508 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 10:51:00 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-2[131505]: 2023-03-02T10:51:00.274+0000 7f6296cdc700 -1 osd.2 0 waiting for initial osdmap 2023-03-02T10:51:00.508 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 10:51:00 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-2[131505]: 2023-03-02T10:51:00.282+0000 7f62902cc700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:51:00.508 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:00 smithi136 ceph-mon[125702]: pgmap v70: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:51:00.509 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:00 smithi136 ceph-mon[125702]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-03-02T10:51:00.509 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:00 smithi136 ceph-mon[125702]: osdmap e16: 3 total, 2 up, 3 in 2023-03-02T10:51:00.509 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:00 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:00.509 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:00 smithi136 ceph-mon[125702]: from='osd.2 [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:51:00.509 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:00 smithi136 ceph-mon[125702]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:51:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:00 smithi122 ceph-mon[125440]: pgmap v70: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:51:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:00 smithi122 ceph-mon[125440]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-03-02T10:51:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:00 smithi122 ceph-mon[125440]: osdmap e16: 3 total, 2 up, 3 in 2023-03-02T10:51:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:00 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:00 smithi122 ceph-mon[125440]: from='osd.2 [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:51:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:00 smithi122 ceph-mon[125440]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:51:00.744 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-03-02T10:51:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-03-02T10:51:00.745 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2023-03-02T10:51:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2023-03-02T10:51:00.745 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0208186 s, 504 MB/s 2023-03-02T10:51:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2023-03-02T10:51:01.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi057:vg_nvme/lv_3 2023-03-02T10:51:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:01 smithi136 ceph-mon[125702]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:51:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:01 smithi136 ceph-mon[125702]: osdmap e17: 3 total, 2 up, 3 in 2023-03-02T10:51:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:01.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:01 smithi057 ceph-mon[92072]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:51:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:01 smithi057 ceph-mon[92072]: osdmap e17: 3 total, 2 up, 3 in 2023-03-02T10:51:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:01.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:01.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:01.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:01 smithi122 ceph-mon[125440]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:51:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:01 smithi122 ceph-mon[125440]: osdmap e17: 3 total, 2 up, 3 in 2023-03-02T10:51:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:01.987 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:51:02.520 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:02 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:51:02.521 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:02 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:51:02.521 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:02 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi136 2023-03-02T10:51:02.521 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:02 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 17168M 2023-03-02T10:51:02.521 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:02 smithi057 ceph-mon[92072]: pgmap v73: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:51:02.521 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:02 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:02.521 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:02 smithi057 ceph-mon[92072]: osd.2 [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212] boot 2023-03-02T10:51:02.521 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:02 smithi057 ceph-mon[92072]: osdmap e18: 3 total, 3 up, 3 in 2023-03-02T10:51:02.522 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:02 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:02 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:51:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:02 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:51:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:02 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi136 2023-03-02T10:51:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:02 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 17168M 2023-03-02T10:51:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:02 smithi136 ceph-mon[125702]: pgmap v73: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:51:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:02 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:02 smithi136 ceph-mon[125702]: osd.2 [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212] boot 2023-03-02T10:51:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:02 smithi136 ceph-mon[125702]: osdmap e18: 3 total, 3 up, 3 in 2023-03-02T10:51:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:02 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:02 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:51:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:02 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:51:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:02 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi136 2023-03-02T10:51:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:02 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 17168M 2023-03-02T10:51:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:02 smithi122 ceph-mon[125440]: pgmap v73: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-02T10:51:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:02 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:02.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:02 smithi122 ceph-mon[125440]: osd.2 [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212] boot 2023-03-02T10:51:02.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:02 smithi122 ceph-mon[125440]: osdmap e18: 3 total, 3 up, 3 in 2023-03-02T10:51:02.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:02 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:51:03.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.369+0000 7fc88abf5700 1 -- 172.21.15.57:0/675444985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc884105880 msgr2=0x7fc884107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:03.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.369+0000 7fc88abf5700 1 --2- 172.21.15.57:0/675444985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc884105880 0x7fc884107ce0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00b0a0 tx=0x7fc87c00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:51:03.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.369+0000 7fc88abf5700 1 -- 172.21.15.57:0/675444985 shutdown_connections 2023-03-02T10:51:03.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.369+0000 7fc88abf5700 1 --2- 172.21.15.57:0/675444985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc884105880 0x7fc884107ce0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:03.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.369+0000 7fc88abf5700 1 --2- 172.21.15.57:0/675444985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc884100640 0x7fc884102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.369+0000 7fc88abf5700 1 --2- 172.21.15.57:0/675444985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc884102f60 0x7fc884105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.369+0000 7fc88abf5700 1 -- 172.21.15.57:0/675444985 >> 172.21.15.57:0/675444985 conn(0x7fc8840fa0a0 msgr2=0x7fc8840fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:51:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.369+0000 7fc88abf5700 1 -- 172.21.15.57:0/675444985 shutdown_connections 2023-03-02T10:51:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.369+0000 7fc88abf5700 1 -- 172.21.15.57:0/675444985 wait complete. 2023-03-02T10:51:03.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.370+0000 7fc88abf5700 1 Processor -- start 2023-03-02T10:51:03.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc88abf5700 1 -- start start 2023-03-02T10:51:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc88abf5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc884100640 0x7fc8841959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc88abf5700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc884102f60 0x7fc884195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc88abf5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc884105880 0x7fc88419cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc88abf5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88419d560 con 0x7fc884100640 2023-03-02T10:51:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc88abf5700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88419d6a0 con 0x7fc884102f60 2023-03-02T10:51:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc88abf5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88419d830 con 0x7fc884105880 2023-03-02T10:51:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc888991700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc884100640 0x7fc8841959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc888991700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc884100640 0x7fc8841959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45866/0 (socket says 172.21.15.57:45866) 2023-03-02T10:51:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc888991700 1 -- 172.21.15.57:0/10165640 learned_addr learned my addr 172.21.15.57:0/10165640 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:51:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc889192700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc884105880 0x7fc88419cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.371+0000 7fc883fff700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc884102f60 0x7fc884195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.372+0000 7fc889192700 1 -- 172.21.15.57:0/10165640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc884102f60 msgr2=0x7fc884195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.372+0000 7fc889192700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc884102f60 0x7fc884195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.372+0000 7fc889192700 1 -- 172.21.15.57:0/10165640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc884100640 msgr2=0x7fc8841959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.372+0000 7fc889192700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc884100640 0x7fc8841959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.372+0000 7fc889192700 1 -- 172.21.15.57:0/10165640 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878009520 con 0x7fc884105880 2023-03-02T10:51:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.372+0000 7fc889192700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc884105880 0x7fc88419cf90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00b070 tx=0x7fc87c00bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:51:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.372+0000 7fc881ffb700 1 -- 172.21.15.57:0/10165640 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00e040 con 0x7fc884105880 2023-03-02T10:51:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.372+0000 7fc881ffb700 1 -- 172.21.15.57:0/10165640 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc87c004c50 con 0x7fc884105880 2023-03-02T10:51:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.372+0000 7fc88abf5700 1 -- 172.21.15.57:0/10165640 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c009d00 con 0x7fc884105880 2023-03-02T10:51:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.372+0000 7fc881ffb700 1 -- 172.21.15.57:0/10165640 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c01dea0 con 0x7fc884105880 2023-03-02T10:51:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.372+0000 7fc88abf5700 1 -- 172.21.15.57:0/10165640 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88410b500 con 0x7fc884105880 2023-03-02T10:51:03.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.373+0000 7fc88abf5700 1 -- 172.21.15.57:0/10165640 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88410b690 con 0x7fc884105880 2023-03-02T10:51:03.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.375+0000 7fc881ffb700 1 -- 172.21.15.57:0/10165640 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) v1 ==== 129817+0+0 (secure 0 0 0) 0x7fc87c01d470 con 0x7fc884105880 2023-03-02T10:51:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.376+0000 7fc881ffb700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc87409b350 0x7fc87409d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.376+0000 7fc888991700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc87409b350 0x7fc87409d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.376+0000 7fc881ffb700 1 -- 172.21.15.57:0/10165640 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2851+0+0 (secure 0 0 0) 0x7fc87c0c5280 con 0x7fc884105880 2023-03-02T10:51:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.376+0000 7fc888991700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc87409b350 0x7fc87409d800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc878009ef0 tx=0x7fc878009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:51:03.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.379+0000 7fc881ffb700 1 -- 172.21.15.57:0/10165640 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fc87c092130 con 0x7fc884105880 2023-03-02T10:51:03.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:03.584+0000 7fc88abf5700 1 -- 172.21.15.57:0/10165640 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8840609d0 con 0x7fc87409b350 2023-03-02T10:51:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:03 smithi057 ceph-mon[92072]: osdmap e19: 3 total, 3 up, 3 in 2023-03-02T10:51:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:03 smithi122 ceph-mon[125440]: osdmap e19: 3 total, 3 up, 3 in 2023-03-02T10:51:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:03 smithi136 ceph-mon[125702]: osdmap e19: 3 total, 3 up, 3 in 2023-03-02T10:51:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:04 smithi057 ceph-mon[92072]: pgmap v76: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-03-02T10:51:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:04 smithi057 ceph-mon[92072]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:51:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:51:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:51:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-03-02T10:51:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:04 smithi057 ceph-mon[92072]: osdmap e20: 3 total, 3 up, 3 in 2023-03-02T10:51:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-03-02T10:51:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:04 smithi122 ceph-mon[125440]: pgmap v76: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-03-02T10:51:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:04 smithi122 ceph-mon[125440]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:51:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:51:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:51:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-03-02T10:51:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:04 smithi122 ceph-mon[125440]: osdmap e20: 3 total, 3 up, 3 in 2023-03-02T10:51:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-03-02T10:51:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:04 smithi136 ceph-mon[125702]: pgmap v76: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-03-02T10:51:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:04 smithi136 ceph-mon[125702]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:51:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:51:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:51:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-03-02T10:51:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:04 smithi136 ceph-mon[125702]: osdmap e20: 3 total, 3 up, 3 in 2023-03-02T10:51:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-03-02T10:51:05.933 INFO:journalctl@ceph.osd.0.smithi057.stdout:Mar 02 10:51:05 smithi057 sudo[108061]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-03-02T10:51:05.933 INFO:journalctl@ceph.osd.0.smithi057.stdout:Mar 02 10:51:05 smithi057 sudo[108061]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:05.933 INFO:journalctl@ceph.osd.0.smithi057.stdout:Mar 02 10:51:05 smithi057 sudo[108061]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:05.933 INFO:journalctl@ceph.osd.0.smithi057.stdout:Mar 02 10:51:05 smithi057 sudo[108061]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:06 smithi057 ceph-mon[92072]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:06 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-03-02T10:51:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:06 smithi057 ceph-mon[92072]: osdmap e21: 3 total, 3 up, 3 in 2023-03-02T10:51:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:06 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:06.433 INFO:journalctl@ceph.osd.0.smithi057.stdout:Mar 02 10:51:06 smithi057 sudo[108076]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-03-02T10:51:06.434 INFO:journalctl@ceph.osd.0.smithi057.stdout:Mar 02 10:51:06 smithi057 sudo[108076]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:06.434 INFO:journalctl@ceph.osd.0.smithi057.stdout:Mar 02 10:51:06 smithi057 sudo[108076]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:06.434 INFO:journalctl@ceph.osd.0.smithi057.stdout:Mar 02 10:51:06 smithi057 sudo[108076]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:06.583 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:06 smithi122 ceph-mon[125440]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:06.583 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:06 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-03-02T10:51:06.583 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:06 smithi122 ceph-mon[125440]: osdmap e21: 3 total, 3 up, 3 in 2023-03-02T10:51:06.584 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:06 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:06.584 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 10:51:06 smithi122 sudo[132859]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-03-02T10:51:06.584 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 10:51:06 smithi122 sudo[132859]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:06.584 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 10:51:06 smithi122 sudo[132859]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:06.584 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 10:51:06 smithi122 sudo[132859]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:06 smithi136 ceph-mon[125702]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:06 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-03-02T10:51:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:06 smithi136 ceph-mon[125702]: osdmap e21: 3 total, 3 up, 3 in 2023-03-02T10:51:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:06 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:06.952 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 10:51:06 smithi122 sudo[132862]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-03-02T10:51:06.952 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 10:51:06 smithi122 sudo[132862]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:06.953 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 10:51:06 smithi122 sudo[132862]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:06.953 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 10:51:06 smithi122 sudo[132862]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:07.101 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 10:51:06 smithi136 sudo[133731]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-03-02T10:51:07.102 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 10:51:06 smithi136 sudo[133731]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:07.102 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 10:51:06 smithi136 sudo[133731]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:07.102 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 10:51:06 smithi136 sudo[133731]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:07.590 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 10:51:07 smithi136 sudo[133734]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-03-02T10:51:07.590 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 10:51:07 smithi136 sudo[133734]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:07.591 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 10:51:07 smithi136 sudo[133734]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:07.591 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 10:51:07 smithi136 sudo[133734]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:07.851 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 sudo[108190]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-03-02T10:51:07.851 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 sudo[108190]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:07.851 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 sudo[108190]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:07.852 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 sudo[108190]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:07.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:07.870+0000 7fc881ffb700 1 -- 172.21.15.57:0/10165640 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fc87c092500 con 0x7fc884105880 2023-03-02T10:51:08.121 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:07 smithi136 ceph-mon[125702]: osdmap e22: 3 total, 3 up, 3 in 2023-03-02T10:51:08.122 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:07 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3962653443' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6780f146-3f9c-486e-8c2c-415f2e8190e8"}]: dispatch 2023-03-02T10:51:08.122 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:07 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3962653443' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6780f146-3f9c-486e-8c2c-415f2e8190e8"}]': finished 2023-03-02T10:51:08.122 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:07 smithi136 ceph-mon[125702]: osdmap e23: 4 total, 3 up, 4 in 2023-03-02T10:51:08.122 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:08.122 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:08.122 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:08.122 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:07 smithi136 ceph-mon[125702]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-02T10:51:08.123 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 sudo[133737]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-03-02T10:51:08.123 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 sudo[133737]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:08.123 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 sudo[133737]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:08.123 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 sudo[133737]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 sudo[108195]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-03-02T10:51:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 sudo[108195]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 sudo[108195]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 sudo[108195]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 ceph-mon[92072]: osdmap e22: 3 total, 3 up, 3 in 2023-03-02T10:51:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3962653443' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6780f146-3f9c-486e-8c2c-415f2e8190e8"}]: dispatch 2023-03-02T10:51:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3962653443' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6780f146-3f9c-486e-8c2c-415f2e8190e8"}]': finished 2023-03-02T10:51:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 ceph-mon[92072]: osdmap e23: 4 total, 3 up, 4 in 2023-03-02T10:51:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:07 smithi057 ceph-mon[92072]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-02T10:51:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:07 smithi122 ceph-mon[125440]: osdmap e22: 3 total, 3 up, 3 in 2023-03-02T10:51:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:07 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3962653443' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6780f146-3f9c-486e-8c2c-415f2e8190e8"}]: dispatch 2023-03-02T10:51:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:07 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3962653443' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6780f146-3f9c-486e-8c2c-415f2e8190e8"}]': finished 2023-03-02T10:51:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:07 smithi122 ceph-mon[125440]: osdmap e23: 4 total, 3 up, 4 in 2023-03-02T10:51:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:07 smithi122 ceph-mon[125440]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-02T10:51:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 sudo[133740]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-03-02T10:51:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 sudo[133740]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 sudo[133740]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 sudo[133740]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:08.856 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 sudo[132865]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-03-02T10:51:08.856 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 sudo[132865]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:08.857 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 sudo[132865]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:08.857 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 sudo[132865]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2301139129' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:51:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-02T10:51:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:51:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:51:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:51:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-02T10:51:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-03-02T10:51:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:51:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:51:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:51:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-02T10:51:09.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:51:09.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:51:09.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:51:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 sudo[132868]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-03-02T10:51:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 sudo[132868]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-02T10:51:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 sudo[132868]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-02T10:51:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 sudo[132868]: pam_unix(sudo:session): session closed for user root 2023-03-02T10:51:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2301139129' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:51:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-02T10:51:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:51:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:51:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:51:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-02T10:51:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-03-02T10:51:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:51:09.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:51:09.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:51:09.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-02T10:51:09.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:51:09.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:51:09.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:51:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:09.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2301139129' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:51:09.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-02T10:51:09.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:51:09.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:51:09.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:51:09.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-02T10:51:09.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-03-02T10:51:09.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:51:09.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:51:09.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:51:09.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-02T10:51:09.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:51:09.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:51:09.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:51:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:09 smithi057 ceph-mon[92072]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-02T10:51:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:09 smithi057 ceph-mon[92072]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-02T10:51:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:09 smithi057 ceph-mon[92072]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:09 smithi122 ceph-mon[125440]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-02T10:51:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:09 smithi122 ceph-mon[125440]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-02T10:51:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:09 smithi122 ceph-mon[125440]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:09 smithi136 ceph-mon[125702]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-02T10:51:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:09 smithi136 ceph-mon[125702]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-02T10:51:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:09 smithi136 ceph-mon[125702]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:12.356 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:12 smithi057 ceph-mon[92072]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:12 smithi136 ceph-mon[125702]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:12 smithi122 ceph-mon[125440]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:14.478 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:14 smithi057 ceph-mon[92072]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 218 KiB/s wr, 15 op/s 2023-03-02T10:51:14.478 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-03-02T10:51:14.479 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:14 smithi136 ceph-mon[125702]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 218 KiB/s wr, 15 op/s 2023-03-02T10:51:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-03-02T10:51:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:14 smithi122 ceph-mon[125440]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 218 KiB/s wr, 15 op/s 2023-03-02T10:51:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-03-02T10:51:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:15 smithi136 ceph-mon[125702]: Deploying daemon osd.3 on smithi057 2023-03-02T10:51:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:15 smithi057 ceph-mon[92072]: Deploying daemon osd.3 on smithi057 2023-03-02T10:51:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:15 smithi122 ceph-mon[125440]: Deploying daemon osd.3 on smithi057 2023-03-02T10:51:16.568 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:16 smithi057 ceph-mon[92072]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-03-02T10:51:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:16 smithi136 ceph-mon[125702]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-03-02T10:51:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:16 smithi122 ceph-mon[125440]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-03-02T10:51:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:18 smithi136 ceph-mon[125702]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-03-02T10:51:18.653 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:18 smithi057 ceph-mon[92072]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-03-02T10:51:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:18 smithi122 ceph-mon[125440]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-03-02T10:51:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:19 smithi136 ceph-mon[125702]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-03-02T10:51:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:19 smithi057 ceph-mon[92072]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-03-02T10:51:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:19 smithi122 ceph-mon[125440]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-03-02T10:51:22.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.251+0000 7fc881ffb700 1 -- 172.21.15.57:0/10165640 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc8840609d0 con 0x7fc87409b350 2023-03-02T10:51:22.253 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 3 on host 'smithi057' 2023-03-02T10:51:22.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.253+0000 7fc88abf5700 1 -- 172.21.15.57:0/10165640 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc87409b350 msgr2=0x7fc87409d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:22.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.253+0000 7fc88abf5700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc87409b350 0x7fc87409d800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc878009ef0 tx=0x7fc878009260 comp rx=0 tx=0).stop 2023-03-02T10:51:22.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.254+0000 7fc88abf5700 1 -- 172.21.15.57:0/10165640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc884105880 msgr2=0x7fc88419cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:22.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.254+0000 7fc88abf5700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc884105880 0x7fc88419cf90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00b070 tx=0x7fc87c00bab0 comp rx=0 tx=0).stop 2023-03-02T10:51:22.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.254+0000 7fc88abf5700 1 -- 172.21.15.57:0/10165640 shutdown_connections 2023-03-02T10:51:22.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.254+0000 7fc88abf5700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc87409b350 0x7fc87409d800 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:22.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.254+0000 7fc88abf5700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc884105880 0x7fc88419cf90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:22.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.254+0000 7fc88abf5700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc884100640 0x7fc8841959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:22.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.254+0000 7fc88abf5700 1 --2- 172.21.15.57:0/10165640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc884102f60 0x7fc884195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:22.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.254+0000 7fc88abf5700 1 -- 172.21.15.57:0/10165640 >> 172.21.15.57:0/10165640 conn(0x7fc8840fa0a0 msgr2=0x7fc884101280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:51:22.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.254+0000 7fc88abf5700 1 -- 172.21.15.57:0/10165640 shutdown_connections 2023-03-02T10:51:22.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:51:22.254+0000 7fc88abf5700 1 -- 172.21.15.57:0/10165640 wait complete. 2023-03-02T10:51:22.478 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:22 smithi057 ceph-mon[92072]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-03-02T10:51:22.478 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.478 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.479 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:22.479 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:22.479 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.479 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.479 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:22 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:22 smithi136 ceph-mon[125702]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-03-02T10:51:22.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:22 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:22 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:22 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:22.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:22 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:22.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:22 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:22 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:22 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:22 smithi122 ceph-mon[125440]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-03-02T10:51:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:22 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:22 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:22 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:22 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:22 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:22 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:22 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:22.725 DEBUG:teuthology.orchestra.run.smithi057:osd.3> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.3.service 2023-03-02T10:51:22.729 INFO:tasks.cephadm:Deploying osd.4 on smithi122 with /dev/vg_nvme/lv_3... 2023-03-02T10:51:22.729 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-03-02T10:51:22.777 INFO:journalctl@ceph.osd.3.smithi057.stdout:-- Logs begin at Thu 2023-03-02 10:29:06 UTC. -- 2023-03-02T10:51:23.182 INFO:journalctl@ceph.osd.3.smithi057.stdout:Mar 02 10:51:22 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-3[110388]: 2023-03-02T10:51:22.921+0000 7fdc0759e5c0 -1 osd.3 0 log_to_monitors true 2023-03-02T10:51:23.381 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.b/config 2023-03-02T10:51:23.589 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:23.590 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:23 smithi122 ceph-mon[125440]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-03-02T10:51:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:23 smithi136 ceph-mon[125702]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-03-02T10:51:23.633 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:23.633 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:23 smithi057 ceph-mon[92072]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-03-02T10:51:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:24 smithi057 ceph-mon[92072]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-03-02T10:51:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:24 smithi057 ceph-mon[92072]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-03-02T10:51:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:24 smithi057 ceph-mon[92072]: osdmap e24: 4 total, 3 up, 4 in 2023-03-02T10:51:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:24 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:24 smithi057 ceph-mon[92072]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:51:24.434 INFO:journalctl@ceph.osd.3.smithi057.stdout:Mar 02 10:51:24 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-3[110388]: 2023-03-02T10:51:24.276+0000 7fdbfb523700 -1 osd.3 0 waiting for initial osdmap 2023-03-02T10:51:24.434 INFO:journalctl@ceph.osd.3.smithi057.stdout:Mar 02 10:51:24 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-3[110388]: 2023-03-02T10:51:24.282+0000 7fdbf5314700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:51:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:24 smithi136 ceph-mon[125702]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-03-02T10:51:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:24 smithi136 ceph-mon[125702]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-03-02T10:51:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:24 smithi136 ceph-mon[125702]: osdmap e24: 4 total, 3 up, 4 in 2023-03-02T10:51:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:24 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:24 smithi136 ceph-mon[125702]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:51:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:24 smithi122 ceph-mon[125440]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-03-02T10:51:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:24 smithi122 ceph-mon[125440]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-03-02T10:51:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:24 smithi122 ceph-mon[125440]: osdmap e24: 4 total, 3 up, 4 in 2023-03-02T10:51:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:24 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:24 smithi122 ceph-mon[125440]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:51:24.939 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-03-02T10:51:24.939 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-03-02T10:51:24.939 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2023-03-02T10:51:24.939 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2023-03-02T10:51:24.939 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0144193 s, 727 MB/s 2023-03-02T10:51:24.940 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2023-03-02T10:51:25.333 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi122:vg_nvme/lv_3 2023-03-02T10:51:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:51:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: osdmap e25: 4 total, 3 up, 4 in 2023-03-02T10:51:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:25.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:25.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:25.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:25.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:25 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:51:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: osdmap e25: 4 total, 3 up, 4 in 2023-03-02T10:51:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:25.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:25.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:25.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:25.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: from='osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:51:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: osdmap e25: 4 total, 3 up, 4 in 2023-03-02T10:51:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:25.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:25.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:25.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:25.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:25 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:25.966 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.b/config 2023-03-02T10:51:26.516 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:26 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:51:26.516 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:26 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:51:26.516 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:26 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi057 2023-03-02T10:51:26.517 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:26 smithi122 ceph-mon[125440]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:26.517 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:26 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 8638M 2023-03-02T10:51:26.517 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:26 smithi122 ceph-mon[125440]: osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841] boot 2023-03-02T10:51:26.517 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:26 smithi122 ceph-mon[125440]: osdmap e26: 4 total, 4 up, 4 in 2023-03-02T10:51:26.517 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:26 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:26 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:51:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:26 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:51:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:26 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi057 2023-03-02T10:51:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:26 smithi136 ceph-mon[125702]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:26 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 8638M 2023-03-02T10:51:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:26 smithi136 ceph-mon[125702]: osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841] boot 2023-03-02T10:51:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:26 smithi136 ceph-mon[125702]: osdmap e26: 4 total, 4 up, 4 in 2023-03-02T10:51:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:26 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:26 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:51:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:26 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:51:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:26 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi057 2023-03-02T10:51:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:26 smithi057 ceph-mon[92072]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-03-02T10:51:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:26 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 8638M 2023-03-02T10:51:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:26 smithi057 ceph-mon[92072]: osd.3 [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841] boot 2023-03-02T10:51:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:26 smithi057 ceph-mon[92072]: osdmap e26: 4 total, 4 up, 4 in 2023-03-02T10:51:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:26 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:51:27.259 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.256+0000 7f3df92e7700 1 -- 172.21.15.122:0/3827334546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df41017f0 msgr2=0x7f3df41080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:27.259 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.256+0000 7f3df92e7700 1 --2- 172.21.15.122:0/3827334546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df41017f0 0x7f3df41080b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00b0a0 tx=0x7f3dec00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:51:27.259 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.256+0000 7f3df92e7700 1 -- 172.21.15.122:0/3827334546 shutdown_connections 2023-03-02T10:51:27.259 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.256+0000 7f3df92e7700 1 --2- 172.21.15.122:0/3827334546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df41017f0 0x7f3df41080b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:27.259 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.256+0000 7f3df92e7700 1 --2- 172.21.15.122:0/3827334546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3df40ffc70 0x7f3df4100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:27.260 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.256+0000 7f3df92e7700 1 --2- 172.21.15.122:0/3827334546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df4100e60 0x7f3df41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:27.260 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.256+0000 7f3df92e7700 1 -- 172.21.15.122:0/3827334546 >> 172.21.15.122:0/3827334546 conn(0x7f3df40fb270 msgr2=0x7f3df40fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:51:27.260 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.256+0000 7f3df92e7700 1 -- 172.21.15.122:0/3827334546 shutdown_connections 2023-03-02T10:51:27.260 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.256+0000 7f3df92e7700 1 -- 172.21.15.122:0/3827334546 wait complete. 2023-03-02T10:51:27.260 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df92e7700 1 Processor -- start 2023-03-02T10:51:27.260 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df92e7700 1 -- start start 2023-03-02T10:51:27.260 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df92e7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df40ffc70 0x7f3df4195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:27.260 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df92e7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df4100e60 0x7f3df4195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:27.261 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df92e7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3df41017f0 0x7f3df419cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:27.261 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df92e7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df419d5c0 con 0x7f3df40ffc70 2023-03-02T10:51:27.261 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df92e7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df419d700 con 0x7f3df4100e60 2023-03-02T10:51:27.261 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df92e7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df419d890 con 0x7f3df41017f0 2023-03-02T10:51:27.261 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df27fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df4100e60 0x7f3df4195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:27.261 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df27fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df4100e60 0x7f3df4195f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58924/0 (socket says 172.21.15.122:58924) 2023-03-02T10:51:27.261 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df27fc700 1 -- 172.21.15.122:0/1479242725 learned_addr learned my addr 172.21.15.122:0/1479242725 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-03-02T10:51:27.262 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.257+0000 7f3df2ffd700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df40ffc70 0x7f3df4195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:27.262 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3df37fe700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3df41017f0 0x7f3df419cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:27.262 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3df27fc700 1 -- 172.21.15.122:0/1479242725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3df41017f0 msgr2=0x7f3df419cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:27.262 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3df27fc700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3df41017f0 0x7f3df419cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:27.262 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3df27fc700 1 -- 172.21.15.122:0/1479242725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df40ffc70 msgr2=0x7f3df4195a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:27.262 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3df27fc700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df40ffc70 0x7f3df4195a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:27.262 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3df27fc700 1 -- 172.21.15.122:0/1479242725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec009d00 con 0x7f3df4100e60 2023-03-02T10:51:27.263 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3df2ffd700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df40ffc70 0x7f3df4195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:51:27.263 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3df37fe700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3df41017f0 0x7f3df419cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:51:27.263 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3df27fc700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df4100e60 0x7f3df4195f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3de400e9a0 tx=0x7f3de400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:51:27.263 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3ddbfff700 1 -- 172.21.15.122:0/1479242725 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4009790 con 0x7f3df4100e60 2023-03-02T10:51:27.263 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3df92e7700 1 -- 172.21.15.122:0/1479242725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df410b600 con 0x7f3df4100e60 2023-03-02T10:51:27.263 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3ddbfff700 1 -- 172.21.15.122:0/1479242725 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3de400cbd0 con 0x7f3df4100e60 2023-03-02T10:51:27.263 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3ddbfff700 1 -- 172.21.15.122:0/1479242725 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4018680 con 0x7f3df4100e60 2023-03-02T10:51:27.263 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.258+0000 7f3df92e7700 1 -- 172.21.15.122:0/1479242725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df410b470 con 0x7f3df4100e60 2023-03-02T10:51:27.264 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.259+0000 7f3df92e7700 1 -- 172.21.15.122:0/1479242725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df4106b50 con 0x7f3df4100e60 2023-03-02T10:51:27.265 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.260+0000 7f3ddbfff700 1 -- 172.21.15.122:0/1479242725 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f3de400c040 con 0x7f3df4100e60 2023-03-02T10:51:27.265 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.260+0000 7f3ddbfff700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3ddc09b3a0 0x7f3ddc09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:27.265 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.261+0000 7f3ddbfff700 1 -- 172.21.15.122:0/1479242725 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f3de4014070 con 0x7f3df4100e60 2023-03-02T10:51:27.265 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.261+0000 7f3df2ffd700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3ddc09b3a0 0x7f3ddc09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:27.265 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.261+0000 7f3df2ffd700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3ddc09b3a0 0x7f3ddc09d850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3de8005950 tx=0x7f3de80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:51:27.266 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.265+0000 7f3ddbfff700 1 -- 172.21.15.122:0/1479242725 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f3de4050800 con 0x7f3df4100e60 2023-03-02T10:51:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:27 smithi122 ceph-mon[125440]: osdmap e27: 4 total, 4 up, 4 in 2023-03-02T10:51:27.455 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:27.454+0000 7f3df92e7700 1 -- 172.21.15.122:0/1479242725 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3df40614d0 con 0x7f3ddc09b3a0 2023-03-02T10:51:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:27 smithi136 ceph-mon[125702]: osdmap e27: 4 total, 4 up, 4 in 2023-03-02T10:51:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:27 smithi057 ceph-mon[92072]: osdmap e27: 4 total, 4 up, 4 in 2023-03-02T10:51:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:28 smithi136 ceph-mon[125702]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:28 smithi136 ceph-mon[125702]: osdmap e28: 4 total, 4 up, 4 in 2023-03-02T10:51:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:28 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:51:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:28 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:51:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:28 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:28 smithi136 ceph-mon[125702]: osdmap e29: 4 total, 4 up, 4 in 2023-03-02T10:51:28.625 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:28 smithi122 ceph-mon[125440]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:28.626 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:28 smithi122 ceph-mon[125440]: osdmap e28: 4 total, 4 up, 4 in 2023-03-02T10:51:28.626 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:28 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:51:28.626 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:28 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:51:28.626 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:28 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:28.626 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:28 smithi122 ceph-mon[125440]: osdmap e29: 4 total, 4 up, 4 in 2023-03-02T10:51:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:28 smithi057 ceph-mon[92072]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:28 smithi057 ceph-mon[92072]: osdmap e28: 4 total, 4 up, 4 in 2023-03-02T10:51:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:28 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:51:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:28 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:51:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:28 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:28 smithi057 ceph-mon[92072]: osdmap e29: 4 total, 4 up, 4 in 2023-03-02T10:51:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:29 smithi136 ceph-mon[125702]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:51:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:29 smithi136 ceph-mon[125702]: osdmap e30: 4 total, 4 up, 4 in 2023-03-02T10:51:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:29 smithi057 ceph-mon[92072]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:51:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:29 smithi057 ceph-mon[92072]: osdmap e30: 4 total, 4 up, 4 in 2023-03-02T10:51:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:29 smithi122 ceph-mon[125440]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:51:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:29 smithi122 ceph-mon[125440]: osdmap e30: 4 total, 4 up, 4 in 2023-03-02T10:51:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:30 smithi136 ceph-mon[125702]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:30 smithi136 ceph-mon[125702]: from='client.? 172.21.15.122:0/1207724845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f79aa927-c257-4a89-a24a-d235a136cd70"}]: dispatch 2023-03-02T10:51:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:30 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f79aa927-c257-4a89-a24a-d235a136cd70"}]: dispatch 2023-03-02T10:51:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:30 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f79aa927-c257-4a89-a24a-d235a136cd70"}]': finished 2023-03-02T10:51:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:30 smithi136 ceph-mon[125702]: osdmap e31: 5 total, 4 up, 5 in 2023-03-02T10:51:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:30 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:30 smithi057 ceph-mon[92072]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:30 smithi057 ceph-mon[92072]: from='client.? 172.21.15.122:0/1207724845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f79aa927-c257-4a89-a24a-d235a136cd70"}]: dispatch 2023-03-02T10:51:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:30 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f79aa927-c257-4a89-a24a-d235a136cd70"}]: dispatch 2023-03-02T10:51:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:30 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f79aa927-c257-4a89-a24a-d235a136cd70"}]': finished 2023-03-02T10:51:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:30 smithi057 ceph-mon[92072]: osdmap e31: 5 total, 4 up, 5 in 2023-03-02T10:51:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:30 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:30 smithi122 ceph-mon[125440]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 22 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:30 smithi122 ceph-mon[125440]: from='client.? 172.21.15.122:0/1207724845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f79aa927-c257-4a89-a24a-d235a136cd70"}]: dispatch 2023-03-02T10:51:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:30 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f79aa927-c257-4a89-a24a-d235a136cd70"}]: dispatch 2023-03-02T10:51:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:30 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f79aa927-c257-4a89-a24a-d235a136cd70"}]': finished 2023-03-02T10:51:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:30 smithi122 ceph-mon[125440]: osdmap e31: 5 total, 4 up, 5 in 2023-03-02T10:51:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:30 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:31 smithi136 ceph-mon[125702]: from='client.? 172.21.15.122:0/1006246471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:51:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:31 smithi057 ceph-mon[92072]: from='client.? 172.21.15.122:0/1006246471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:51:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:31 smithi122 ceph-mon[125440]: from='client.? 172.21.15.122:0/1006246471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:51:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:32 smithi136 ceph-mon[125702]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:32 smithi057 ceph-mon[92072]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:32 smithi122 ceph-mon[125440]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:34 smithi136 ceph-mon[125702]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-03-02T10:51:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:34 smithi057 ceph-mon[92072]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-03-02T10:51:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:34 smithi122 ceph-mon[125440]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-03-02T10:51:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:36 smithi122 ceph-mon[125440]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-03-02T10:51:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:36 smithi136 ceph-mon[125702]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-03-02T10:51:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:36 smithi057 ceph-mon[92072]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-03-02T10:51:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:37 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-03-02T10:51:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:37 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:37 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-03-02T10:51:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:37 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:37 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-03-02T10:51:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:37 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:38 smithi057 ceph-mon[92072]: Deploying daemon osd.4 on smithi122 2023-03-02T10:51:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:38 smithi057 ceph-mon[92072]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:51:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:38 smithi122 ceph-mon[125440]: Deploying daemon osd.4 on smithi122 2023-03-02T10:51:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:38 smithi122 ceph-mon[125440]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:51:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:38 smithi136 ceph-mon[125702]: Deploying daemon osd.4 on smithi122 2023-03-02T10:51:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:38 smithi136 ceph-mon[125702]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:51:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:40 smithi057 ceph-mon[92072]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-03-02T10:51:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:40 smithi122 ceph-mon[125440]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-03-02T10:51:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:40 smithi136 ceph-mon[125702]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-03-02T10:51:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:42 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:42 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:42 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:42 smithi136 ceph-mon[125702]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2023-03-02T10:51:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:42 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:42 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:42 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:42 smithi057 ceph-mon[92072]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2023-03-02T10:51:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:42 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:42 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:42 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:42 smithi122 ceph-mon[125440]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2023-03-02T10:51:44.052 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.049+0000 7f3ddbfff700 1 -- 172.21.15.122:0/1479242725 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3df40614d0 con 0x7f3ddc09b3a0 2023-03-02T10:51:44.052 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 4 on host 'smithi122' 2023-03-02T10:51:44.053 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.051+0000 7f3df92e7700 1 -- 172.21.15.122:0/1479242725 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3ddc09b3a0 msgr2=0x7f3ddc09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:44.053 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.051+0000 7f3df92e7700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3ddc09b3a0 0x7f3ddc09d850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3de8005950 tx=0x7f3de80058e0 comp rx=0 tx=0).stop 2023-03-02T10:51:44.053 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.051+0000 7f3df92e7700 1 -- 172.21.15.122:0/1479242725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df4100e60 msgr2=0x7f3df4195f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:44.054 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.051+0000 7f3df92e7700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df4100e60 0x7f3df4195f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3de400e9a0 tx=0x7f3de400ed60 comp rx=0 tx=0).stop 2023-03-02T10:51:44.054 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.051+0000 7f3df92e7700 1 -- 172.21.15.122:0/1479242725 shutdown_connections 2023-03-02T10:51:44.054 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.051+0000 7f3df92e7700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3ddc09b3a0 0x7f3ddc09d850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:44.054 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.051+0000 7f3df92e7700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3df41017f0 0x7f3df419cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:44.054 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.051+0000 7f3df92e7700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df40ffc70 0x7f3df4195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:44.054 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.051+0000 7f3df92e7700 1 --2- 172.21.15.122:0/1479242725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3df4100e60 0x7f3df4195f80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:44.054 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.051+0000 7f3df92e7700 1 -- 172.21.15.122:0/1479242725 >> 172.21.15.122:0/1479242725 conn(0x7f3df40fb270 msgr2=0x7f3df40fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:51:44.055 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.052+0000 7f3df92e7700 1 -- 172.21.15.122:0/1479242725 shutdown_connections 2023-03-02T10:51:44.055 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:51:44.052+0000 7f3df92e7700 1 -- 172.21.15.122:0/1479242725 wait complete. 2023-03-02T10:51:44.455 DEBUG:teuthology.orchestra.run.smithi122:osd.4> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.4.service 2023-03-02T10:51:44.458 INFO:tasks.cephadm:Deploying osd.5 on smithi136 with /dev/vg_nvme/lv_3... 2023-03-02T10:51:44.458 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-03-02T10:51:44.487 INFO:journalctl@ceph.osd.4.smithi122.stdout:-- Logs begin at Thu 2023-03-02 10:22:37 UTC. -- 2023-03-02T10:51:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:44 smithi057 ceph-mon[92072]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-03-02T10:51:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:44 smithi122 ceph-mon[125440]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-03-02T10:51:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:44 smithi136 ceph-mon[125702]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-03-02T10:51:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:51:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:45.102 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:51:45.306 INFO:journalctl@ceph.osd.4.smithi122.stdout:Mar 02 10:51:45 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-4[136107]: 2023-03-02T10:51:45.022+0000 7f71186025c0 -1 osd.4 0 log_to_monitors true 2023-03-02T10:51:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:45 smithi136 ceph-mon[125702]: from='osd.4 [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-02T10:51:45.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:45 smithi136 ceph-mon[125702]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-02T10:51:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:45 smithi057 ceph-mon[92072]: from='osd.4 [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-02T10:51:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:45 smithi057 ceph-mon[92072]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-02T10:51:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:45 smithi122 ceph-mon[125440]: from='osd.4 [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-02T10:51:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:45 smithi122 ceph-mon[125440]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-02T10:51:46.630 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-03-02T10:51:46.631 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-03-02T10:51:46.631 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2023-03-02T10:51:46.631 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2023-03-02T10:51:46.631 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122755 s, 854 MB/s 2023-03-02T10:51:46.631 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2023-03-02T10:51:46.645 INFO:journalctl@ceph.osd.4.smithi122.stdout:Mar 02 10:51:46 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-4[136107]: 2023-03-02T10:51:46.407+0000 7f710c587700 -1 osd.4 0 waiting for initial osdmap 2023-03-02T10:51:46.645 INFO:journalctl@ceph.osd.4.smithi122.stdout:Mar 02 10:51:46 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-4[136107]: 2023-03-02T10:51:46.415+0000 7f7104374700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:51:46.646 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:46 smithi122 ceph-mon[125440]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:46.646 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:46 smithi122 ceph-mon[125440]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-03-02T10:51:46.646 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:46 smithi122 ceph-mon[125440]: osdmap e32: 5 total, 4 up, 5 in 2023-03-02T10:51:46.646 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:46 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:46.646 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:46 smithi122 ceph-mon[125440]: from='osd.4 [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:51:46.646 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:46 smithi122 ceph-mon[125440]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:51:46.665 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:46 smithi136 ceph-mon[125702]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:46.666 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:46 smithi136 ceph-mon[125702]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-03-02T10:51:46.666 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:46 smithi136 ceph-mon[125702]: osdmap e32: 5 total, 4 up, 5 in 2023-03-02T10:51:46.666 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:46 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:46.666 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:46 smithi136 ceph-mon[125702]: from='osd.4 [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:51:46.666 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:46 smithi136 ceph-mon[125702]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:51:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:46 smithi057 ceph-mon[92072]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:46 smithi057 ceph-mon[92072]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-03-02T10:51:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:46 smithi057 ceph-mon[92072]: osdmap e32: 5 total, 4 up, 5 in 2023-03-02T10:51:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:46 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:46 smithi057 ceph-mon[92072]: from='osd.4 [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:51:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:46 smithi057 ceph-mon[92072]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:51:47.042 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi136:vg_nvme/lv_3 2023-03-02T10:51:47.680 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:51:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:51:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: osdmap e33: 5 total, 4 up, 5 in 2023-03-02T10:51:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:51:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: osdmap e33: 5 total, 4 up, 5 in 2023-03-02T10:51:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:51:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: osdmap e33: 5 total, 4 up, 5 in 2023-03-02T10:51:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:51:47.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:47.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:47.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:51:47.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:51:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:48 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:51:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:48 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:51:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:48 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi122 2023-03-02T10:51:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:48 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 8584M 2023-03-02T10:51:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:48 smithi136 ceph-mon[125702]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:48.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:48 smithi136 ceph-mon[125702]: osd.4 [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996] boot 2023-03-02T10:51:48.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:48 smithi136 ceph-mon[125702]: osdmap e34: 5 total, 5 up, 5 in 2023-03-02T10:51:48.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:48 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:48 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:51:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:48 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:51:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:48 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi122 2023-03-02T10:51:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:48 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 8584M 2023-03-02T10:51:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:48 smithi057 ceph-mon[92072]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:48 smithi057 ceph-mon[92072]: osd.4 [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996] boot 2023-03-02T10:51:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:48 smithi057 ceph-mon[92072]: osdmap e34: 5 total, 5 up, 5 in 2023-03-02T10:51:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:48 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:48 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:51:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:48 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:51:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:48 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi122 2023-03-02T10:51:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:48 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 8584M 2023-03-02T10:51:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:48 smithi122 ceph-mon[125440]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2023-03-02T10:51:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:48 smithi122 ceph-mon[125440]: osd.4 [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996] boot 2023-03-02T10:51:48.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:48 smithi122 ceph-mon[125440]: osdmap e34: 5 total, 5 up, 5 in 2023-03-02T10:51:48.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:48 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:51:48.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.859+0000 7f28e52a7700 1 -- 172.21.15.136:0/2915190910 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e0100e50 msgr2=0x7f28e01012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:48.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.859+0000 7f28e52a7700 1 --2- 172.21.15.136:0/2915190910 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e0100e50 0x7f28e01012a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009990 tx=0x7f28d0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:51:48.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.859+0000 7f28e52a7700 1 -- 172.21.15.136:0/2915190910 shutdown_connections 2023-03-02T10:51:48.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.859+0000 7f28e52a7700 1 --2- 172.21.15.136:0/2915190910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e01017e0 0x7f28e01080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:48.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.859+0000 7f28e52a7700 1 --2- 172.21.15.136:0/2915190910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e00ffc60 0x7f28e0100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:48.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.859+0000 7f28e52a7700 1 --2- 172.21.15.136:0/2915190910 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e0100e50 0x7f28e01012a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:48.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.859+0000 7f28e52a7700 1 -- 172.21.15.136:0/2915190910 >> 172.21.15.136:0/2915190910 conn(0x7f28e00fb240 msgr2=0x7f28e00fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:51:48.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.859+0000 7f28e52a7700 1 -- 172.21.15.136:0/2915190910 shutdown_connections 2023-03-02T10:51:48.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.859+0000 7f28e52a7700 1 -- 172.21.15.136:0/2915190910 wait complete. 2023-03-02T10:51:48.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28e52a7700 1 Processor -- start 2023-03-02T10:51:48.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28e52a7700 1 -- start start 2023-03-02T10:51:48.863 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28e52a7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e00ffc60 0x7f28e0074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:48.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28e52a7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e0100e50 0x7f28e0072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:48.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28e52a7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e01017e0 0x7f28e0072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:48.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28e52a7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e0073660 con 0x7f28e0100e50 2023-03-02T10:51:48.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28e52a7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00737d0 con 0x7f28e01017e0 2023-03-02T10:51:48.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28e52a7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e019f980 con 0x7f28e00ffc60 2023-03-02T10:51:48.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28deffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e00ffc60 0x7f28e0074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:48.864 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28deffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e00ffc60 0x7f28e0074340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35170/0 (socket says 172.21.15.136:35170) 2023-03-02T10:51:48.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28deffd700 1 -- 172.21.15.136:0/498447281 learned_addr learned my addr 172.21.15.136:0/498447281 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-02T10:51:48.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28de7fc700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e0100e50 0x7f28e0072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:48.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28df7fe700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e01017e0 0x7f28e0072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:48.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28deffd700 1 -- 172.21.15.136:0/498447281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e01017e0 msgr2=0x7f28e0072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:48.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28deffd700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e01017e0 0x7f28e0072ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:48.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28deffd700 1 -- 172.21.15.136:0/498447281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e0100e50 msgr2=0x7f28e0072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:51:48.865 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28deffd700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e0100e50 0x7f28e0072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:51:48.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28deffd700 1 -- 172.21.15.136:0/498447281 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d00095f0 con 0x7f28e00ffc60 2023-03-02T10:51:48.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.860+0000 7f28df7fe700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e01017e0 0x7f28e0072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:51:48.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.861+0000 7f28deffd700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e00ffc60 0x7f28e0074340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f28d400d980 tx=0x7f28d400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:51:48.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.861+0000 7f28c7fff700 1 -- 172.21.15.136:0/498447281 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4004020 con 0x7f28e00ffc60 2023-03-02T10:51:48.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.861+0000 7f28c7fff700 1 -- 172.21.15.136:0/498447281 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28d4009730 con 0x7f28e00ffc60 2023-03-02T10:51:48.866 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.861+0000 7f28e52a7700 1 -- 172.21.15.136:0/498447281 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e010b5e0 con 0x7f28e00ffc60 2023-03-02T10:51:48.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.861+0000 7f28c7fff700 1 -- 172.21.15.136:0/498447281 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4003a80 con 0x7f28e00ffc60 2023-03-02T10:51:48.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.861+0000 7f28e52a7700 1 -- 172.21.15.136:0/498447281 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e010b450 con 0x7f28e00ffc60 2023-03-02T10:51:48.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.862+0000 7f28e52a7700 1 -- 172.21.15.136:0/498447281 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e01a00a0 con 0x7f28e00ffc60 2023-03-02T10:51:48.867 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.863+0000 7f28c7fff700 1 -- 172.21.15.136:0/498447281 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f28d400b030 con 0x7f28e00ffc60 2023-03-02T10:51:48.868 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.863+0000 7f28c7fff700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28c809b3a0 0x7f28c809d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:51:48.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.863+0000 7f28c7fff700 1 -- 172.21.15.136:0/498447281 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f28d40c3a20 con 0x7f28e00ffc60 2023-03-02T10:51:48.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.863+0000 7f28de7fc700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28c809b3a0 0x7f28c809d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:51:48.869 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.864+0000 7f28de7fc700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28c809b3a0 0x7f28c809d850 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f28d000b5c0 tx=0x7f28d0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:51:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:48.868+0000 7f28c7fff700 1 -- 172.21.15.136:0/498447281 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f28d4090400 con 0x7f28e00ffc60 2023-03-02T10:51:49.060 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:51:49.059+0000 7f28e52a7700 1 -- 172.21.15.136:0/498447281 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f28e01a0650 con 0x7f28c809b3a0 2023-03-02T10:51:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:49 smithi136 ceph-mon[125702]: osdmap e35: 5 total, 5 up, 5 in 2023-03-02T10:51:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:49 smithi136 ceph-mon[125702]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:51:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:51:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:51:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:49 smithi136 ceph-mon[125702]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:49 smithi057 ceph-mon[92072]: osdmap e35: 5 total, 5 up, 5 in 2023-03-02T10:51:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:49 smithi057 ceph-mon[92072]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:51:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:51:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:51:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:49 smithi057 ceph-mon[92072]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:49 smithi122 ceph-mon[125440]: osdmap e35: 5 total, 5 up, 5 in 2023-03-02T10:51:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:49 smithi122 ceph-mon[125440]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:51:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:51:50.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:51:50.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:50.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:49 smithi122 ceph-mon[125440]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:52 smithi136 ceph-mon[125702]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:52 smithi136 ceph-mon[125702]: from='client.? 172.21.15.136:0/467467033' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "805a1c8d-9f65-42ac-b478-d085491724a0"}]: dispatch 2023-03-02T10:51:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:52 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "805a1c8d-9f65-42ac-b478-d085491724a0"}]: dispatch 2023-03-02T10:51:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:52 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "805a1c8d-9f65-42ac-b478-d085491724a0"}]': finished 2023-03-02T10:51:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:52 smithi136 ceph-mon[125702]: osdmap e36: 6 total, 5 up, 6 in 2023-03-02T10:51:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:51:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:52 smithi136 ceph-mon[125702]: from='client.? 172.21.15.136:0/894644821' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:51:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:52 smithi057 ceph-mon[92072]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:52 smithi057 ceph-mon[92072]: from='client.? 172.21.15.136:0/467467033' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "805a1c8d-9f65-42ac-b478-d085491724a0"}]: dispatch 2023-03-02T10:51:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:52 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "805a1c8d-9f65-42ac-b478-d085491724a0"}]: dispatch 2023-03-02T10:51:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:52 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "805a1c8d-9f65-42ac-b478-d085491724a0"}]': finished 2023-03-02T10:51:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:52 smithi057 ceph-mon[92072]: osdmap e36: 6 total, 5 up, 6 in 2023-03-02T10:51:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:51:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:52 smithi057 ceph-mon[92072]: from='client.? 172.21.15.136:0/894644821' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:51:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:52 smithi122 ceph-mon[125440]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:52 smithi122 ceph-mon[125440]: from='client.? 172.21.15.136:0/467467033' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "805a1c8d-9f65-42ac-b478-d085491724a0"}]: dispatch 2023-03-02T10:51:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:52 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "805a1c8d-9f65-42ac-b478-d085491724a0"}]: dispatch 2023-03-02T10:51:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:52 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "805a1c8d-9f65-42ac-b478-d085491724a0"}]': finished 2023-03-02T10:51:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:52 smithi122 ceph-mon[125440]: osdmap e36: 6 total, 5 up, 6 in 2023-03-02T10:51:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:51:52.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:52 smithi122 ceph-mon[125440]: from='client.? 172.21.15.136:0/894644821' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:51:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:54 smithi136 ceph-mon[125702]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:54 smithi057 ceph-mon[92072]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:54 smithi122 ceph-mon[125440]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:56 smithi136 ceph-mon[125702]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:56 smithi057 ceph-mon[92072]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:56 smithi122 ceph-mon[125440]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:58 smithi136 ceph-mon[125702]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:58 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-03-02T10:51:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:58 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:58 smithi057 ceph-mon[92072]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:58 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-03-02T10:51:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:58 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:58 smithi122 ceph-mon[125440]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:51:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:58 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-03-02T10:51:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:58 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:51:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:51:59 smithi136 ceph-mon[125702]: Deploying daemon osd.5 on smithi136 2023-03-02T10:51:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:51:59 smithi057 ceph-mon[92072]: Deploying daemon osd.5 on smithi136 2023-03-02T10:51:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:51:59 smithi122 ceph-mon[125440]: Deploying daemon osd.5 on smithi136 2023-03-02T10:52:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:00 smithi136 ceph-mon[125702]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:00 smithi057 ceph-mon[92072]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:00 smithi122 ceph-mon[125440]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:02 smithi136 ceph-mon[125702]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:02 smithi057 ceph-mon[92072]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:02 smithi122 ceph-mon[125440]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:03 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:03.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:03 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:03.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:03 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:03 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:03 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:03 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:03 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:03 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:03 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:04 smithi136 ceph-mon[125702]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:04 smithi057 ceph-mon[92072]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:04 smithi122 ceph-mon[125440]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:05.281 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.278+0000 7f28c7fff700 1 -- 172.21.15.136:0/498447281 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f28e01a0650 con 0x7f28c809b3a0 2023-03-02T10:52:05.281 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 5 on host 'smithi136' 2023-03-02T10:52:05.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.280+0000 7f28e52a7700 1 -- 172.21.15.136:0/498447281 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28c809b3a0 msgr2=0x7f28c809d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:05.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.280+0000 7f28e52a7700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28c809b3a0 0x7f28c809d850 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f28d000b5c0 tx=0x7f28d0005960 comp rx=0 tx=0).stop 2023-03-02T10:52:05.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.280+0000 7f28e52a7700 1 -- 172.21.15.136:0/498447281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e00ffc60 msgr2=0x7f28e0074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:05.283 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.280+0000 7f28e52a7700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e00ffc60 0x7f28e0074340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f28d400d980 tx=0x7f28d400dc90 comp rx=0 tx=0).stop 2023-03-02T10:52:05.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.280+0000 7f28e52a7700 1 -- 172.21.15.136:0/498447281 shutdown_connections 2023-03-02T10:52:05.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.280+0000 7f28e52a7700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28c809b3a0 0x7f28c809d850 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:05.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.280+0000 7f28e52a7700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e01017e0 0x7f28e0072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:05.284 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.280+0000 7f28e52a7700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e00ffc60 0x7f28e0074340 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:05.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.280+0000 7f28e52a7700 1 --2- 172.21.15.136:0/498447281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e0100e50 0x7f28e0072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:05.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.280+0000 7f28e52a7700 1 -- 172.21.15.136:0/498447281 >> 172.21.15.136:0/498447281 conn(0x7f28e00fb240 msgr2=0x7f28e00fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:52:05.285 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.280+0000 7f28e52a7700 1 -- 172.21.15.136:0/498447281 shutdown_connections 2023-03-02T10:52:05.286 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:05.281+0000 7f28e52a7700 1 -- 172.21.15.136:0/498447281 wait complete. 2023-03-02T10:52:05.668 DEBUG:teuthology.orchestra.run.smithi136:osd.5> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.5.service 2023-03-02T10:52:05.671 INFO:tasks.cephadm:Deploying osd.6 on smithi057 with /dev/vg_nvme/lv_2... 2023-03-02T10:52:05.671 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-03-02T10:52:05.710 INFO:journalctl@ceph.osd.5.smithi136.stdout:-- Logs begin at Thu 2023-03-02 10:22:36 UTC. -- 2023-03-02T10:52:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:05 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:05 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:05 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:05.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:05 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:05.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:05 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:05 smithi136 ceph-mon[125702]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:05.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:05 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:05 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:05 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:05 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:05 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:05 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:05 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:05 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:05 smithi057 ceph-mon[92072]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:05 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:05 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:05 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:05 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:05 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:05 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:05 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:05 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:05 smithi122 ceph-mon[125440]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:05 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:05 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:05 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:06.433 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:52:06.475 INFO:journalctl@ceph.osd.5.smithi136.stdout:Mar 02 10:52:06 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-5[136985]: 2023-03-02T10:52:06.275+0000 7fa07a6ec5c0 -1 osd.5 0 log_to_monitors true 2023-03-02T10:52:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:06 smithi136 ceph-mon[125702]: from='osd.5 [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-02T10:52:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:06 smithi136 ceph-mon[125702]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-02T10:52:06.927 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:06 smithi057 ceph-mon[92072]: from='osd.5 [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-02T10:52:06.927 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:06 smithi057 ceph-mon[92072]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-02T10:52:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:06 smithi122 ceph-mon[125440]: from='osd.5 [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-02T10:52:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:06 smithi122 ceph-mon[125440]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-02T10:52:07.835 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:07 smithi136 ceph-mon[125702]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-03-02T10:52:07.835 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:07 smithi136 ceph-mon[125702]: osdmap e37: 6 total, 5 up, 6 in 2023-03-02T10:52:07.836 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:07.836 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:07 smithi136 ceph-mon[125702]: from='osd.5 [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:52:07.836 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:07 smithi136 ceph-mon[125702]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:52:07.836 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:07 smithi136 ceph-mon[125702]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:07.836 INFO:journalctl@ceph.osd.5.smithi136.stdout:Mar 02 10:52:07 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-5[136985]: 2023-03-02T10:52:07.586+0000 7fa06e671700 -1 osd.5 0 waiting for initial osdmap 2023-03-02T10:52:07.837 INFO:journalctl@ceph.osd.5.smithi136.stdout:Mar 02 10:52:07 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-5[136985]: 2023-03-02T10:52:07.595+0000 7fa067c61700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:52:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:07 smithi057 ceph-mon[92072]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-03-02T10:52:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:07 smithi057 ceph-mon[92072]: osdmap e37: 6 total, 5 up, 6 in 2023-03-02T10:52:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:07 smithi057 ceph-mon[92072]: from='osd.5 [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:52:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:07 smithi057 ceph-mon[92072]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:52:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:07 smithi057 ceph-mon[92072]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:07 smithi122 ceph-mon[125440]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-03-02T10:52:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:07 smithi122 ceph-mon[125440]: osdmap e37: 6 total, 5 up, 6 in 2023-03-02T10:52:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:07 smithi122 ceph-mon[125440]: from='osd.5 [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:52:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:07 smithi122 ceph-mon[125440]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:52:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:07 smithi122 ceph-mon[125440]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2023-03-02T10:52:08.154 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-03-02T10:52:08.154 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-03-02T10:52:08.155 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2023-03-02T10:52:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2023-03-02T10:52:08.155 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0215547 s, 486 MB/s 2023-03-02T10:52:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2023-03-02T10:52:08.631 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi057:vg_nvme/lv_2 2023-03-02T10:52:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:52:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: osdmap e38: 6 total, 5 up, 6 in 2023-03-02T10:52:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi136 2023-03-02T10:52:08.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:08.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:08.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:08.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:08.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 8584M 2023-03-02T10:52:08.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:08.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:08.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:08.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:08.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: osd.5 [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400] boot 2023-03-02T10:52:08.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: osdmap e39: 6 total, 6 up, 6 in 2023-03-02T10:52:08.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:52:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: osdmap e38: 6 total, 5 up, 6 in 2023-03-02T10:52:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi136 2023-03-02T10:52:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 8584M 2023-03-02T10:52:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:08.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:08.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:08.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:08.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: osd.5 [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400] boot 2023-03-02T10:52:08.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: osdmap e39: 6 total, 6 up, 6 in 2023-03-02T10:52:08.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:52:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: osdmap e38: 6 total, 5 up, 6 in 2023-03-02T10:52:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi136 2023-03-02T10:52:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:09.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:09.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:09.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 8584M 2023-03-02T10:52:09.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:09.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:09.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:09.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:09.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: osd.5 [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400] boot 2023-03-02T10:52:09.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: osdmap e39: 6 total, 6 up, 6 in 2023-03-02T10:52:09.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:52:09.369 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:52:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:10 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:52:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:10 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:52:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:10 smithi057 ceph-mon[92072]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:10 smithi057 ceph-mon[92072]: osdmap e40: 6 total, 6 up, 6 in 2023-03-02T10:52:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:10 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:52:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:10 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:52:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:10 smithi136 ceph-mon[125702]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:10 smithi136 ceph-mon[125702]: osdmap e40: 6 total, 6 up, 6 in 2023-03-02T10:52:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:10 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:52:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:10 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:52:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:10 smithi122 ceph-mon[125440]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:10 smithi122 ceph-mon[125440]: osdmap e40: 6 total, 6 up, 6 in 2023-03-02T10:52:10.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.742+0000 7f490842d700 1 -- 172.21.15.57:0/3265421424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49000ffbd0 msgr2=0x7f49000fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:10.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.742+0000 7f490842d700 1 --2- 172.21.15.57:0/3265421424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49000ffbd0 0x7f49000fffe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009990 tx=0x7f48fc009ca0 comp rx=0 tx=0).stop 2023-03-02T10:52:10.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.742+0000 7f490842d700 1 -- 172.21.15.57:0/3265421424 shutdown_connections 2023-03-02T10:52:10.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.742+0000 7f490842d700 1 --2- 172.21.15.57:0/3265421424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4900101750 0x7f4900108010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:10.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.742+0000 7f490842d700 1 --2- 172.21.15.57:0/3265421424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49000ffbd0 0x7f49000fffe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:10.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.742+0000 7f490842d700 1 --2- 172.21.15.57:0/3265421424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4900100dc0 0x7f4900101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:10.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.742+0000 7f490842d700 1 -- 172.21.15.57:0/3265421424 >> 172.21.15.57:0/3265421424 conn(0x7f49000fb1b0 msgr2=0x7f49000fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:52:10.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.742+0000 7f490842d700 1 -- 172.21.15.57:0/3265421424 shutdown_connections 2023-03-02T10:52:10.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.742+0000 7f490842d700 1 -- 172.21.15.57:0/3265421424 wait complete. 2023-03-02T10:52:10.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.743+0000 7f490842d700 1 Processor -- start 2023-03-02T10:52:10.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.743+0000 7f490842d700 1 -- start start 2023-03-02T10:52:10.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.743+0000 7f490842d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000ffbd0 0x7f4900074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:10.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.743+0000 7f490842d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4900100dc0 0x7f4900072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:10.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.743+0000 7f490842d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4900101750 0x7f4900072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:10.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.743+0000 7f490842d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4900073660 con 0x7f4900101750 2023-03-02T10:52:10.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.743+0000 7f490842d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49000737d0 con 0x7f49000ffbd0 2023-03-02T10:52:10.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.743+0000 7f490842d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490019f9d0 con 0x7f4900100dc0 2023-03-02T10:52:10.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49061c9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000ffbd0 0x7f4900074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:10.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49061c9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000ffbd0 0x7f4900074340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:47934/0 (socket says 172.21.15.57:47934) 2023-03-02T10:52:10.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49061c9700 1 -- 172.21.15.57:0/1348686275 learned_addr learned my addr 172.21.15.57:0/1348686275 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:52:10.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49069ca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4900101750 0x7f4900072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:10.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49059c8700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4900100dc0 0x7f4900072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:10.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49069ca700 1 -- 172.21.15.57:0/1348686275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4900100dc0 msgr2=0x7f4900072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:10.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49069ca700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4900100dc0 0x7f4900072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:10.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49069ca700 1 -- 172.21.15.57:0/1348686275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000ffbd0 msgr2=0x7f4900074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:10.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49069ca700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000ffbd0 0x7f4900074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:10.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49069ca700 1 -- 172.21.15.57:0/1348686275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0095f0 con 0x7f4900101750 2023-03-02T10:52:10.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49059c8700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4900100dc0 0x7f4900072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:52:10.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49061c9700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000ffbd0 0x7f4900074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:52:10.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f49069ca700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4900101750 0x7f4900072ec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f48f800ab40 tx=0x7f48f800ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:52:10.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f48f77fe700 1 -- 172.21.15.57:0/1348686275 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f800f070 con 0x7f4900101750 2023-03-02T10:52:10.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f490842d700 1 -- 172.21.15.57:0/1348686275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490010b530 con 0x7f4900101750 2023-03-02T10:52:10.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f48f77fe700 1 -- 172.21.15.57:0/1348686275 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f48f8007a70 con 0x7f4900101750 2023-03-02T10:52:10.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.744+0000 7f48f77fe700 1 -- 172.21.15.57:0/1348686275 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f8005280 con 0x7f4900101750 2023-03-02T10:52:10.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.745+0000 7f490842d700 1 -- 172.21.15.57:0/1348686275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490010b3a0 con 0x7f4900101750 2023-03-02T10:52:10.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.745+0000 7f490842d700 1 -- 172.21.15.57:0/1348686275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49001071a0 con 0x7f4900101750 2023-03-02T10:52:10.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.747+0000 7f48f77fe700 1 -- 172.21.15.57:0/1348686275 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f48f8019020 con 0x7f4900101750 2023-03-02T10:52:10.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.748+0000 7f48f77fe700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48ec09b420 0x7f48ec09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:10.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.749+0000 7f49061c9700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48ec09b420 0x7f48ec09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:10.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.749+0000 7f48f77fe700 1 -- 172.21.15.57:0/1348686275 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f48f80c3a70 con 0x7f4900101750 2023-03-02T10:52:10.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.749+0000 7f49061c9700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48ec09b420 0x7f48ec09d8d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48fc006010 tx=0x7f48fc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:52:10.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.752+0000 7f48f77fe700 1 -- 172.21.15.57:0/1348686275 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f48f8090220 con 0x7f4900101750 2023-03-02T10:52:10.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:10.958+0000 7f490842d700 1 -- 172.21.15.57:0/1348686275 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f49000616b0 con 0x7f48ec09b420 2023-03-02T10:52:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:11 smithi136 ceph-mon[125702]: osdmap e41: 6 total, 6 up, 6 in 2023-03-02T10:52:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:11 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:52:11.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:11 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:52:11.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:11 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:11 smithi057 ceph-mon[92072]: osdmap e41: 6 total, 6 up, 6 in 2023-03-02T10:52:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:11 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:52:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:11 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:52:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:11 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:11 smithi122 ceph-mon[125440]: osdmap e41: 6 total, 6 up, 6 in 2023-03-02T10:52:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:11 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:52:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:11 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:52:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:11 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:12.250 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:12 smithi057 ceph-mon[92072]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:52:12.251 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:12 smithi057 ceph-mon[92072]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:12.251 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:12 smithi057 ceph-mon[92072]: osdmap e42: 6 total, 6 up, 6 in 2023-03-02T10:52:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:12 smithi136 ceph-mon[125702]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:52:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:12 smithi136 ceph-mon[125702]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:12 smithi136 ceph-mon[125702]: osdmap e42: 6 total, 6 up, 6 in 2023-03-02T10:52:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:12 smithi122 ceph-mon[125440]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:52:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:12 smithi122 ceph-mon[125440]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:12 smithi122 ceph-mon[125440]: osdmap e42: 6 total, 6 up, 6 in 2023-03-02T10:52:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:13 smithi136 ceph-mon[125702]: osdmap e43: 6 total, 6 up, 6 in 2023-03-02T10:52:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:13 smithi057 ceph-mon[92072]: osdmap e43: 6 total, 6 up, 6 in 2023-03-02T10:52:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:13 smithi122 ceph-mon[125440]: osdmap e43: 6 total, 6 up, 6 in 2023-03-02T10:52:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:14 smithi136 ceph-mon[125702]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-03-02T10:52:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:14 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2550597972' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "818fc49e-7291-4275-82c8-ee8b86ae5676"}]: dispatch 2023-03-02T10:52:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:14 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2550597972' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "818fc49e-7291-4275-82c8-ee8b86ae5676"}]': finished 2023-03-02T10:52:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:14 smithi136 ceph-mon[125702]: osdmap e44: 7 total, 6 up, 7 in 2023-03-02T10:52:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:14 smithi057 ceph-mon[92072]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-03-02T10:52:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:14 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2550597972' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "818fc49e-7291-4275-82c8-ee8b86ae5676"}]: dispatch 2023-03-02T10:52:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:14 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2550597972' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "818fc49e-7291-4275-82c8-ee8b86ae5676"}]': finished 2023-03-02T10:52:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:14 smithi057 ceph-mon[92072]: osdmap e44: 7 total, 6 up, 7 in 2023-03-02T10:52:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:14 smithi122 ceph-mon[125440]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-03-02T10:52:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:14 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2550597972' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "818fc49e-7291-4275-82c8-ee8b86ae5676"}]: dispatch 2023-03-02T10:52:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:14 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2550597972' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "818fc49e-7291-4275-82c8-ee8b86ae5676"}]': finished 2023-03-02T10:52:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:14 smithi122 ceph-mon[125440]: osdmap e44: 7 total, 6 up, 7 in 2023-03-02T10:52:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:15 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3438717115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:52:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:15 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3438717115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:52:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:15 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3438717115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:52:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:16 smithi136 ceph-mon[125702]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-03-02T10:52:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:16 smithi057 ceph-mon[92072]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-03-02T10:52:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:16 smithi122 ceph-mon[125440]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-03-02T10:52:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:18 smithi136 ceph-mon[125702]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-02T10:52:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:18 smithi057 ceph-mon[92072]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-02T10:52:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:18 smithi122 ceph-mon[125440]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-02T10:52:20.545 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:20 smithi057 ceph-mon[92072]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:52:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:20 smithi136 ceph-mon[125702]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:52:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:20 smithi122 ceph-mon[125440]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:52:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:21 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-03-02T10:52:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:21 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:21 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-03-02T10:52:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:21 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:21 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-03-02T10:52:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:21 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:22 smithi136 ceph-mon[125702]: Deploying daemon osd.6 on smithi057 2023-03-02T10:52:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:22 smithi136 ceph-mon[125702]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:22.643 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:22 smithi057 ceph-mon[92072]: Deploying daemon osd.6 on smithi057 2023-03-02T10:52:22.644 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:22 smithi057 ceph-mon[92072]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:22 smithi122 ceph-mon[125440]: Deploying daemon osd.6 on smithi057 2023-03-02T10:52:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:22 smithi122 ceph-mon[125440]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:24 smithi136 ceph-mon[125702]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:24 smithi057 ceph-mon[92072]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:24 smithi122 ceph-mon[125440]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:26 smithi136 ceph-mon[125702]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:26 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:26 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:26 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:26.642 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:26 smithi057 ceph-mon[92072]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:26.642 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:26 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:26.642 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:26 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:26.642 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:26 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:26 smithi122 ceph-mon[125440]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:26 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:26 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:26 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:28.559 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:28 smithi057 ceph-mon[92072]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:28 smithi136 ceph-mon[125702]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:28 smithi122 ceph-mon[125440]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:29.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.702+0000 7f48f77fe700 1 -- 172.21.15.57:0/1348686275 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f49000616b0 con 0x7f48ec09b420 2023-03-02T10:52:29.704 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 6 on host 'smithi057' 2023-03-02T10:52:29.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 -- 172.21.15.57:0/1348686275 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48ec09b420 msgr2=0x7f48ec09d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:29.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48ec09b420 0x7f48ec09d8d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48fc006010 tx=0x7f48fc005960 comp rx=0 tx=0).stop 2023-03-02T10:52:29.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 -- 172.21.15.57:0/1348686275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4900101750 msgr2=0x7f4900072ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:29.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4900101750 0x7f4900072ec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f48f800ab40 tx=0x7f48f800ae50 comp rx=0 tx=0).stop 2023-03-02T10:52:29.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 -- 172.21.15.57:0/1348686275 shutdown_connections 2023-03-02T10:52:29.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48ec09b420 0x7f48ec09d8d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:29.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4900101750 0x7f4900072ec0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:29.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49000ffbd0 0x7f4900074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:29.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 --2- 172.21.15.57:0/1348686275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4900100dc0 0x7f4900072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:29.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 -- 172.21.15.57:0/1348686275 >> 172.21.15.57:0/1348686275 conn(0x7f49000fb1b0 msgr2=0x7f49001042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:52:29.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 -- 172.21.15.57:0/1348686275 shutdown_connections 2023-03-02T10:52:29.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:52:29.704+0000 7f490842d700 1 -- 172.21.15.57:0/1348686275 wait complete. 2023-03-02T10:52:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:29 smithi057 ceph-mon[92072]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:29 smithi122 ceph-mon[125440]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:30.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:30.229 DEBUG:teuthology.orchestra.run.smithi057:osd.6> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.6.service 2023-03-02T10:52:30.231 INFO:tasks.cephadm:Deploying osd.7 on smithi122 with /dev/vg_nvme/lv_2... 2023-03-02T10:52:30.232 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-03-02T10:52:30.285 INFO:journalctl@ceph.osd.6.smithi057.stdout:-- Logs begin at Thu 2023-03-02 10:29:06 UTC. -- 2023-03-02T10:52:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:29 smithi136 ceph-mon[125702]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:30.892 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.b/config 2023-03-02T10:52:31.082 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:30 smithi057 ceph-mon[92072]: from='osd.6 [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-03-02T10:52:31.082 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:30 smithi057 ceph-mon[92072]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-03-02T10:52:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:30 smithi122 ceph-mon[125440]: from='osd.6 [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-03-02T10:52:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:30 smithi122 ceph-mon[125440]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-03-02T10:52:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:30 smithi136 ceph-mon[125702]: from='osd.6 [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-03-02T10:52:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:30 smithi136 ceph-mon[125702]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-03-02T10:52:32.183 INFO:journalctl@ceph.osd.6.smithi057.stdout:Mar 02 10:52:31 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-6[115827]: 2023-03-02T10:52:31.947+0000 7f291b23c700 -1 osd.6 0 waiting for initial osdmap 2023-03-02T10:52:32.183 INFO:journalctl@ceph.osd.6.smithi057.stdout:Mar 02 10:52:31 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-6[115827]: 2023-03-02T10:52:31.961+0000 7f291582e700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:52:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:31 smithi057 ceph-mon[92072]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-03-02T10:52:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:31 smithi057 ceph-mon[92072]: osdmap e45: 7 total, 6 up, 7 in 2023-03-02T10:52:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:31 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:31 smithi057 ceph-mon[92072]: from='osd.6 [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:52:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:31 smithi057 ceph-mon[92072]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:52:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:31 smithi057 ceph-mon[92072]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:31 smithi122 ceph-mon[125440]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-03-02T10:52:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:31 smithi122 ceph-mon[125440]: osdmap e45: 7 total, 6 up, 7 in 2023-03-02T10:52:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:31 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:31 smithi122 ceph-mon[125440]: from='osd.6 [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:52:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:31 smithi122 ceph-mon[125440]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:52:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:31 smithi122 ceph-mon[125440]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:31 smithi136 ceph-mon[125702]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-03-02T10:52:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:31 smithi136 ceph-mon[125702]: osdmap e45: 7 total, 6 up, 7 in 2023-03-02T10:52:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:31 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:31 smithi136 ceph-mon[125702]: from='osd.6 [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:52:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:31 smithi136 ceph-mon[125702]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:52:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:31 smithi136 ceph-mon[125702]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:32.413 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-03-02T10:52:32.413 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-03-02T10:52:32.413 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2023-03-02T10:52:32.413 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2023-03-02T10:52:32.413 INFO:teuthology.orchestra.run.smithi122.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107191 s, 978 MB/s 2023-03-02T10:52:32.414 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2023-03-02T10:52:32.847 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi122:vg_nvme/lv_2 2023-03-02T10:52:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:52:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: osdmap e46: 7 total, 6 up, 7 in 2023-03-02T10:52:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:32 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:52:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: osdmap e46: 7 total, 6 up, 7 in 2023-03-02T10:52:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:32 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:52:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: osdmap e46: 7 total, 6 up, 7 in 2023-03-02T10:52:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:32 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:33.490 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.b/config 2023-03-02T10:52:34.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:33 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:52:34.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:33 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:52:34.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:33 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi057 2023-03-02T10:52:34.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:33 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 5758M 2023-03-02T10:52:34.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:33 smithi122 ceph-mon[125440]: osd.6 [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280] boot 2023-03-02T10:52:34.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:33 smithi122 ceph-mon[125440]: osdmap e47: 7 total, 7 up, 7 in 2023-03-02T10:52:34.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:33 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:34.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:33 smithi122 ceph-mon[125440]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:33 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:52:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:33 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:52:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:33 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi057 2023-03-02T10:52:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:33 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 5758M 2023-03-02T10:52:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:33 smithi136 ceph-mon[125702]: osd.6 [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280] boot 2023-03-02T10:52:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:33 smithi136 ceph-mon[125702]: osdmap e47: 7 total, 7 up, 7 in 2023-03-02T10:52:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:33 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:33 smithi136 ceph-mon[125702]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:33 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:52:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:33 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:52:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:33 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi057 2023-03-02T10:52:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:33 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 5758M 2023-03-02T10:52:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:33 smithi057 ceph-mon[92072]: osd.6 [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280] boot 2023-03-02T10:52:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:33 smithi057 ceph-mon[92072]: osdmap e47: 7 total, 7 up, 7 in 2023-03-02T10:52:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:33 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:52:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:33 smithi057 ceph-mon[92072]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2023-03-02T10:52:34.692 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 -- 172.21.15.122:0/1330435917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d900fecc0 msgr2=0x7f5d900ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:34.693 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 --2- 172.21.15.122:0/1330435917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d900fecc0 0x7f5d900ff130 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009990 tx=0x7f5d80009ca0 comp rx=0 tx=0).stop 2023-03-02T10:52:34.693 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 -- 172.21.15.122:0/1330435917 shutdown_connections 2023-03-02T10:52:34.693 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 --2- 172.21.15.122:0/1330435917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d900ff670 0x7f5d90106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:34.693 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 --2- 172.21.15.122:0/1330435917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d90100070 0x7f5d90100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:34.693 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 --2- 172.21.15.122:0/1330435917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d900fecc0 0x7f5d900ff130 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:34.693 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 -- 172.21.15.122:0/1330435917 >> 172.21.15.122:0/1330435917 conn(0x7f5d900f9820 msgr2=0x7f5d900fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:52:34.694 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 -- 172.21.15.122:0/1330435917 shutdown_connections 2023-03-02T10:52:34.694 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 -- 172.21.15.122:0/1330435917 wait complete. 2023-03-02T10:52:34.694 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 Processor -- start 2023-03-02T10:52:34.694 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 -- start start 2023-03-02T10:52:34.694 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d900fecc0 0x7f5d900fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:34.694 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.691+0000 7f5d97591700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d900ff670 0x7f5d9019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:34.694 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d97591700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d90100070 0x7f5d9019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:34.695 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d97591700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9019d530 con 0x7f5d90100070 2023-03-02T10:52:34.695 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d97591700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9019d6a0 con 0x7f5d900fecc0 2023-03-02T10:52:34.695 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d97591700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9019d860 con 0x7f5d900ff670 2023-03-02T10:52:34.695 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d9532d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d900fecc0 0x7f5d900fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:34.695 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d9532d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d900fecc0 0x7f5d900fe740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59026/0 (socket says 172.21.15.122:59026) 2023-03-02T10:52:34.695 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d9532d700 1 -- 172.21.15.122:0/223096905 learned_addr learned my addr 172.21.15.122:0/223096905 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-03-02T10:52:34.695 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d94b2c700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d900ff670 0x7f5d9019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:34.696 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d95b2e700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d90100070 0x7f5d9019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d9532d700 1 -- 172.21.15.122:0/223096905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d900ff670 msgr2=0x7f5d9019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d9532d700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d900ff670 0x7f5d9019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d9532d700 1 -- 172.21.15.122:0/223096905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d90100070 msgr2=0x7f5d9019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d9532d700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d90100070 0x7f5d9019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d9532d700 1 -- 172.21.15.122:0/223096905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800095f0 con 0x7f5d900fecc0 2023-03-02T10:52:34.697 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d9532d700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d900fecc0 0x7f5d900fe740 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00b530 tx=0x7f5d8c00b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:52:34.698 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d867fc700 1 -- 172.21.15.122:0/223096905 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c011830 con 0x7f5d900fecc0 2023-03-02T10:52:34.698 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d867fc700 1 -- 172.21.15.122:0/223096905 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d8c011e50 con 0x7f5d900fecc0 2023-03-02T10:52:34.698 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d867fc700 1 -- 172.21.15.122:0/223096905 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c00f2e0 con 0x7f5d900fecc0 2023-03-02T10:52:34.698 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d97591700 1 -- 172.21.15.122:0/223096905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9010a500 con 0x7f5d900fecc0 2023-03-02T10:52:34.698 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.692+0000 7f5d97591700 1 -- 172.21.15.122:0/223096905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9010a370 con 0x7f5d900fecc0 2023-03-02T10:52:34.698 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.693+0000 7f5d97591700 1 -- 172.21.15.122:0/223096905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d901060e0 con 0x7f5d900fecc0 2023-03-02T10:52:34.698 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.694+0000 7f5d867fc700 1 -- 172.21.15.122:0/223096905 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f5d8c021070 con 0x7f5d900fecc0 2023-03-02T10:52:34.698 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.695+0000 7f5d867fc700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5d7c09b3a0 0x7f5d7c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:34.699 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.695+0000 7f5d867fc700 1 -- 172.21.15.122:0/223096905 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f5d8c0c4210 con 0x7f5d900fecc0 2023-03-02T10:52:34.699 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.695+0000 7f5d94b2c700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5d7c09b3a0 0x7f5d7c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:34.699 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.696+0000 7f5d94b2c700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5d7c09b3a0 0x7f5d7c09d850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d900fe4b0 tx=0x7f5d80005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:52:34.699 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.698+0000 7f5d867fc700 1 -- 172.21.15.122:0/223096905 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f5d8c052800 con 0x7f5d900fecc0 2023-03-02T10:52:34.886 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:34.885+0000 7f5d97591700 1 -- 172.21.15.122:0/223096905 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d90061630 con 0x7f5d7c09b3a0 2023-03-02T10:52:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:35 smithi136 ceph-mon[125702]: osdmap e48: 7 total, 7 up, 7 in 2023-03-02T10:52:35.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:35 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:52:35.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:35 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:52:35.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:35 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:35 smithi057 ceph-mon[92072]: osdmap e48: 7 total, 7 up, 7 in 2023-03-02T10:52:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:35 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:52:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:35 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:52:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:35 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:35 smithi122 ceph-mon[125440]: osdmap e48: 7 total, 7 up, 7 in 2023-03-02T10:52:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:35 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:52:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:35 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:52:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:35 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:36 smithi122 ceph-mon[125440]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:52:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:36 smithi122 ceph-mon[125440]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:36 smithi136 ceph-mon[125702]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:52:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:36 smithi136 ceph-mon[125702]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:36 smithi057 ceph-mon[92072]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:52:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:36 smithi057 ceph-mon[92072]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:38 smithi136 ceph-mon[125702]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:38 smithi136 ceph-mon[125702]: from='client.? 172.21.15.122:0/3188204585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "942b92f0-db14-4495-9b71-672ee373313c"}]: dispatch 2023-03-02T10:52:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:38 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "942b92f0-db14-4495-9b71-672ee373313c"}]: dispatch 2023-03-02T10:52:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:38 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "942b92f0-db14-4495-9b71-672ee373313c"}]': finished 2023-03-02T10:52:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:38 smithi136 ceph-mon[125702]: osdmap e49: 8 total, 7 up, 8 in 2023-03-02T10:52:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:38 smithi136 ceph-mon[125702]: from='client.? 172.21.15.122:0/926917223' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:52:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:38 smithi057 ceph-mon[92072]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:38 smithi057 ceph-mon[92072]: from='client.? 172.21.15.122:0/3188204585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "942b92f0-db14-4495-9b71-672ee373313c"}]: dispatch 2023-03-02T10:52:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:38 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "942b92f0-db14-4495-9b71-672ee373313c"}]: dispatch 2023-03-02T10:52:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:38 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "942b92f0-db14-4495-9b71-672ee373313c"}]': finished 2023-03-02T10:52:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:38 smithi057 ceph-mon[92072]: osdmap e49: 8 total, 7 up, 8 in 2023-03-02T10:52:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:38 smithi057 ceph-mon[92072]: from='client.? 172.21.15.122:0/926917223' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:52:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:38 smithi122 ceph-mon[125440]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:38 smithi122 ceph-mon[125440]: from='client.? 172.21.15.122:0/3188204585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "942b92f0-db14-4495-9b71-672ee373313c"}]: dispatch 2023-03-02T10:52:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:38 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "942b92f0-db14-4495-9b71-672ee373313c"}]: dispatch 2023-03-02T10:52:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:38 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "942b92f0-db14-4495-9b71-672ee373313c"}]': finished 2023-03-02T10:52:38.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:38 smithi122 ceph-mon[125440]: osdmap e49: 8 total, 7 up, 8 in 2023-03-02T10:52:38.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:38.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:38 smithi122 ceph-mon[125440]: from='client.? 172.21.15.122:0/926917223' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:52:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:40 smithi136 ceph-mon[125702]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:40 smithi057 ceph-mon[92072]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:40 smithi122 ceph-mon[125440]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:42.565 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:42 smithi122 ceph-mon[125440]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:42 smithi136 ceph-mon[125702]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:42 smithi057 ceph-mon[92072]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:44 smithi136 ceph-mon[125702]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-03-02T10:52:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:44 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:44.629 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:44 smithi122 ceph-mon[125440]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:44.629 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-03-02T10:52:44.629 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:44 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:44 smithi057 ceph-mon[92072]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-03-02T10:52:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:44 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:45 smithi122 ceph-mon[125440]: Deploying daemon osd.7 on smithi122 2023-03-02T10:52:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:45 smithi136 ceph-mon[125702]: Deploying daemon osd.7 on smithi122 2023-03-02T10:52:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:45 smithi057 ceph-mon[92072]: Deploying daemon osd.7 on smithi122 2023-03-02T10:52:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:46 smithi122 ceph-mon[125440]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:46 smithi136 ceph-mon[125702]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:46 smithi057 ceph-mon[92072]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:48 smithi136 ceph-mon[125702]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:48.611 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:48 smithi122 ceph-mon[125440]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:48 smithi057 ceph-mon[92072]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:50.022 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:50.023 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:50.023 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:50.023 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:49 smithi122 ceph-mon[125440]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:49 smithi136 ceph-mon[125702]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:49 smithi057 ceph-mon[92072]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:51.622 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.621+0000 7f5d867fc700 1 -- 172.21.15.122:0/223096905 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5d90061630 con 0x7f5d7c09b3a0 2023-03-02T10:52:51.623 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 7 on host 'smithi122' 2023-03-02T10:52:51.624 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 -- 172.21.15.122:0/223096905 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5d7c09b3a0 msgr2=0x7f5d7c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:51.624 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5d7c09b3a0 0x7f5d7c09d850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d900fe4b0 tx=0x7f5d80005fd0 comp rx=0 tx=0).stop 2023-03-02T10:52:51.625 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 -- 172.21.15.122:0/223096905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d900fecc0 msgr2=0x7f5d900fe740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:51.625 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d900fecc0 0x7f5d900fe740 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00b530 tx=0x7f5d8c00b840 comp rx=0 tx=0).stop 2023-03-02T10:52:51.625 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 -- 172.21.15.122:0/223096905 shutdown_connections 2023-03-02T10:52:51.625 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f5d7c09b3a0 0x7f5d7c09d850 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:51.625 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d90100070 0x7f5d9019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:51.625 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d900fecc0 0x7f5d900fe740 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:51.625 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 --2- 172.21.15.122:0/223096905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d900ff670 0x7f5d9019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:51.626 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 -- 172.21.15.122:0/223096905 >> 172.21.15.122:0/223096905 conn(0x7f5d900f9820 msgr2=0x7f5d90103220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:52:51.626 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 -- 172.21.15.122:0/223096905 shutdown_connections 2023-03-02T10:52:51.626 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:52:51.623+0000 7f5d97591700 1 -- 172.21.15.122:0/223096905 wait complete. 2023-03-02T10:52:52.081 DEBUG:teuthology.orchestra.run.smithi122:osd.7> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.7.service 2023-03-02T10:52:52.083 INFO:tasks.cephadm:Deploying osd.8 on smithi136 with /dev/vg_nvme/lv_2... 2023-03-02T10:52:52.083 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-03-02T10:52:52.111 INFO:journalctl@ceph.osd.7.smithi122.stdout:-- Logs begin at Thu 2023-03-02 10:22:37 UTC. -- 2023-03-02T10:52:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:52 smithi122 ceph-mon[125440]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:52 smithi136 ceph-mon[125702]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:52.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:52 smithi057 ceph-mon[92072]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:52:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:52.733 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:52:52.947 INFO:journalctl@ceph.osd.7.smithi122.stdout:Mar 02 10:52:52 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-7[141681]: 2023-03-02T10:52:52.738+0000 7f77b7e495c0 -1 osd.7 0 log_to_monitors true 2023-03-02T10:52:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:53 smithi122 ceph-mon[125440]: from='osd.7 [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-02T10:52:53.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:53 smithi122 ceph-mon[125440]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-02T10:52:53.526 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:53 smithi136 ceph-mon[125702]: from='osd.7 [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-02T10:52:53.526 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:53 smithi136 ceph-mon[125702]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-02T10:52:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:53 smithi057 ceph-mon[92072]: from='osd.7 [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-02T10:52:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:53 smithi057 ceph-mon[92072]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-02T10:52:54.279 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-03-02T10:52:54.280 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-03-02T10:52:54.280 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2023-03-02T10:52:54.280 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2023-03-02T10:52:54.280 INFO:teuthology.orchestra.run.smithi136.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00819155 s, 1.3 GB/s 2023-03-02T10:52:54.280 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2023-03-02T10:52:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:54 smithi136 ceph-mon[125702]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:54 smithi136 ceph-mon[125702]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-03-02T10:52:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:54 smithi136 ceph-mon[125702]: osdmap e50: 8 total, 7 up, 8 in 2023-03-02T10:52:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:54 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:54 smithi136 ceph-mon[125702]: from='osd.7 [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:52:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:54 smithi136 ceph-mon[125702]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:52:54.675 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi136:vg_nvme/lv_2 2023-03-02T10:52:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:54 smithi057 ceph-mon[92072]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:54 smithi057 ceph-mon[92072]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-03-02T10:52:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:54 smithi057 ceph-mon[92072]: osdmap e50: 8 total, 7 up, 8 in 2023-03-02T10:52:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:54 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:54 smithi057 ceph-mon[92072]: from='osd.7 [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:52:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:54 smithi057 ceph-mon[92072]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:52:54.701 INFO:journalctl@ceph.osd.7.smithi122.stdout:Mar 02 10:52:54 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-7[141681]: 2023-03-02T10:52:54.285+0000 7f77abdce700 -1 osd.7 0 waiting for initial osdmap 2023-03-02T10:52:54.702 INFO:journalctl@ceph.osd.7.smithi122.stdout:Mar 02 10:52:54 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-7[141681]: 2023-03-02T10:52:54.298+0000 7f77a73c2700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:52:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:54 smithi122 ceph-mon[125440]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:54 smithi122 ceph-mon[125440]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-03-02T10:52:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:54 smithi122 ceph-mon[125440]: osdmap e50: 8 total, 7 up, 8 in 2023-03-02T10:52:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:54 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:54.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:54 smithi122 ceph-mon[125440]: from='osd.7 [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:52:54.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:54 smithi122 ceph-mon[125440]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:52:55.315 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:52:55.549 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:52:55.549 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: osdmap e51: 8 total, 7 up, 8 in 2023-03-02T10:52:55.549 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:55.549 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:55.550 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi122 2023-03-02T10:52:55.550 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:55.550 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:55.550 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:55.551 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:55.551 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:55.551 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 5722M 2023-03-02T10:52:55.551 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:55.551 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:55.551 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:55.552 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:52:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: osdmap e51: 8 total, 7 up, 8 in 2023-03-02T10:52:55.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:55.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:55.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi122 2023-03-02T10:52:55.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:55.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:55.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:55.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:55.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:55.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 5722M 2023-03-02T10:52:55.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:55.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:55.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:55.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:52:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: osdmap e51: 8 total, 7 up, 8 in 2023-03-02T10:52:55.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:55.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:55.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi122 2023-03-02T10:52:55.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:55.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:55.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:55.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:55.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:52:55.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 5722M 2023-03-02T10:52:55.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:55.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:55.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:52:55.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:52:56.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.396+0000 7f4fcf44b700 1 -- 172.21.15.136:0/2496654742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fc80fdf50 msgr2=0x7f4fc80fe360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:56.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.396+0000 7f4fcf44b700 1 --2- 172.21.15.136:0/2496654742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fc80fdf50 0x7f4fc80fe360 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009990 tx=0x7f4fb8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:52:56.401 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.396+0000 7f4fcf44b700 1 -- 172.21.15.136:0/2496654742 shutdown_connections 2023-03-02T10:52:56.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.396+0000 7f4fcf44b700 1 --2- 172.21.15.136:0/2496654742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc81018b0 0x7f4fc8108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:56.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.396+0000 7f4fcf44b700 1 --2- 172.21.15.136:0/2496654742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fc80fdf50 0x7f4fc80fe360 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:56.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.396+0000 7f4fcf44b700 1 --2- 172.21.15.136:0/2496654742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fc8100f20 0x7f4fc8101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:56.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.396+0000 7f4fcf44b700 1 -- 172.21.15.136:0/2496654742 >> 172.21.15.136:0/2496654742 conn(0x7f4fc80f9930 msgr2=0x7f4fc80fbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:52:56.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.396+0000 7f4fcf44b700 1 -- 172.21.15.136:0/2496654742 shutdown_connections 2023-03-02T10:52:56.402 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.396+0000 7f4fcf44b700 1 -- 172.21.15.136:0/2496654742 wait complete. 2023-03-02T10:52:56.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcf44b700 1 Processor -- start 2023-03-02T10:52:56.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcf44b700 1 -- start start 2023-03-02T10:52:56.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcf44b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fc80fdf50 0x7f4fc8100890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:56.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcf44b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc8100f20 0x7f4fc80feed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:56.403 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcf44b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fc81018b0 0x7f4fc80ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:56.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcf44b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80ffbb0 con 0x7f4fc8100f20 2023-03-02T10:52:56.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcf44b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80ffd20 con 0x7f4fc80fdf50 2023-03-02T10:52:56.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcf44b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc819fad0 con 0x7f4fc81018b0 2023-03-02T10:52:56.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcd9e8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fc81018b0 0x7f4fc80ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:56.404 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcd9e8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fc81018b0 0x7f4fc80ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35294/0 (socket says 172.21.15.136:35294) 2023-03-02T10:52:56.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcd9e8700 1 -- 172.21.15.136:0/3589312094 learned_addr learned my addr 172.21.15.136:0/3589312094 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-02T10:52:56.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcd1e7700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fc80fdf50 0x7f4fc8100890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:56.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcc9e6700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc8100f20 0x7f4fc80feed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:56.405 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcd9e8700 1 -- 172.21.15.136:0/3589312094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fc80fdf50 msgr2=0x7f4fc8100890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:56.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcd9e8700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fc80fdf50 0x7f4fc8100890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:56.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcd9e8700 1 -- 172.21.15.136:0/3589312094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc8100f20 msgr2=0x7f4fc80feed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:52:56.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcd9e8700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc8100f20 0x7f4fc80feed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:52:56.406 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.397+0000 7f4fcd9e8700 1 -- 172.21.15.136:0/3589312094 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb80095f0 con 0x7f4fc81018b0 2023-03-02T10:52:56.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.398+0000 7f4fcc9e6700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc8100f20 0x7f4fc80feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:52:56.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.398+0000 7f4fcd1e7700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fc80fdf50 0x7f4fc8100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:52:56.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.398+0000 7f4fcd9e8700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fc81018b0 0x7f4fc80ff410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000b970 tx=0x7f4fc000bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:52:56.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.398+0000 7f4fbe7fc700 1 -- 172.21.15.136:0/3589312094 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000c9b0 con 0x7f4fc81018b0 2023-03-02T10:52:56.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.398+0000 7f4fcf44b700 1 -- 172.21.15.136:0/3589312094 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc810b6f0 con 0x7f4fc81018b0 2023-03-02T10:52:56.407 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.398+0000 7f4fbe7fc700 1 -- 172.21.15.136:0/3589312094 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fc0014440 con 0x7f4fc81018b0 2023-03-02T10:52:56.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.398+0000 7f4fbe7fc700 1 -- 172.21.15.136:0/3589312094 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00075d0 con 0x7f4fc81018b0 2023-03-02T10:52:56.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.398+0000 7f4fcf44b700 1 -- 172.21.15.136:0/3589312094 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc810b560 con 0x7f4fc81018b0 2023-03-02T10:52:56.408 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.399+0000 7f4fcf44b700 1 -- 172.21.15.136:0/3589312094 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc8107310 con 0x7f4fc81018b0 2023-03-02T10:52:56.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.400+0000 7f4fbe7fc700 1 -- 172.21.15.136:0/3589312094 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f4fc001b030 con 0x7f4fc81018b0 2023-03-02T10:52:56.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.400+0000 7f4fbe7fc700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4fb409b3a0 0x7f4fb409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:52:56.409 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.400+0000 7f4fbe7fc700 1 -- 172.21.15.136:0/3589312094 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f4fc0006e40 con 0x7f4fc81018b0 2023-03-02T10:52:56.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.401+0000 7f4fcd1e7700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4fb409b3a0 0x7f4fb409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:52:56.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.401+0000 7f4fcd1e7700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4fb409b3a0 0x7f4fb409d850 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8006010 tx=0x7f4fb800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:52:56.410 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.404+0000 7f4fbe7fc700 1 -- 172.21.15.136:0/3589312094 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f4fc00902f0 con 0x7f4fc81018b0 2023-03-02T10:52:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:56 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:52:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:56 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:52:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:56 smithi136 ceph-mon[125702]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:56 smithi136 ceph-mon[125702]: osd.7 [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822] boot 2023-03-02T10:52:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:56 smithi136 ceph-mon[125702]: osdmap e52: 8 total, 8 up, 8 in 2023-03-02T10:52:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:56 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:56 smithi136 ceph-mon[125702]: osdmap e53: 8 total, 8 up, 8 in 2023-03-02T10:52:56.597 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:52:56.595+0000 7f4fcf44b700 1 -- 172.21.15.136:0/3589312094 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fc80616a0 con 0x7f4fb409b3a0 2023-03-02T10:52:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:56 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:52:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:56 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:52:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:56 smithi057 ceph-mon[92072]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:56 smithi057 ceph-mon[92072]: osd.7 [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822] boot 2023-03-02T10:52:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:56 smithi057 ceph-mon[92072]: osdmap e52: 8 total, 8 up, 8 in 2023-03-02T10:52:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:56 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:56 smithi057 ceph-mon[92072]: osdmap e53: 8 total, 8 up, 8 in 2023-03-02T10:52:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:56 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:52:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:56 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:52:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:56 smithi122 ceph-mon[125440]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2023-03-02T10:52:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:56 smithi122 ceph-mon[125440]: osd.7 [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822] boot 2023-03-02T10:52:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:56 smithi122 ceph-mon[125440]: osdmap e52: 8 total, 8 up, 8 in 2023-03-02T10:52:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:56 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:52:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:56 smithi122 ceph-mon[125440]: osdmap e53: 8 total, 8 up, 8 in 2023-03-02T10:52:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:52:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:52:57.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:57.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:57 smithi136 ceph-mon[125702]: osdmap e54: 8 total, 8 up, 8 in 2023-03-02T10:52:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:52:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:52:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:57 smithi057 ceph-mon[92072]: osdmap e54: 8 total, 8 up, 8 in 2023-03-02T10:52:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:52:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:52:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:52:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:57 smithi122 ceph-mon[125440]: osdmap e54: 8 total, 8 up, 8 in 2023-03-02T10:52:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:58 smithi136 ceph-mon[125702]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:52:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:58 smithi136 ceph-mon[125702]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:52:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:58 smithi136 ceph-mon[125702]: osdmap e55: 8 total, 8 up, 8 in 2023-03-02T10:52:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:58 smithi057 ceph-mon[92072]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:52:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:58 smithi057 ceph-mon[92072]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:52:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:58 smithi057 ceph-mon[92072]: osdmap e55: 8 total, 8 up, 8 in 2023-03-02T10:52:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:58 smithi122 ceph-mon[125440]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:52:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:58 smithi122 ceph-mon[125440]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:52:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:58 smithi122 ceph-mon[125440]: osdmap e55: 8 total, 8 up, 8 in 2023-03-02T10:52:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:59 smithi136 ceph-mon[125702]: from='client.? 172.21.15.136:0/3713466369' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfb28b1d-2458-4e6f-a849-6f14011393fe"}]: dispatch 2023-03-02T10:52:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:59 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfb28b1d-2458-4e6f-a849-6f14011393fe"}]: dispatch 2023-03-02T10:52:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:59 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfb28b1d-2458-4e6f-a849-6f14011393fe"}]': finished 2023-03-02T10:52:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:59 smithi136 ceph-mon[125702]: osdmap e56: 9 total, 8 up, 9 in 2023-03-02T10:52:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:52:59 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:52:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:59 smithi057 ceph-mon[92072]: from='client.? 172.21.15.136:0/3713466369' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfb28b1d-2458-4e6f-a849-6f14011393fe"}]: dispatch 2023-03-02T10:52:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:59 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfb28b1d-2458-4e6f-a849-6f14011393fe"}]: dispatch 2023-03-02T10:52:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:59 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfb28b1d-2458-4e6f-a849-6f14011393fe"}]': finished 2023-03-02T10:52:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:59 smithi057 ceph-mon[92072]: osdmap e56: 9 total, 8 up, 9 in 2023-03-02T10:52:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:52:59 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:52:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:59 smithi122 ceph-mon[125440]: from='client.? 172.21.15.136:0/3713466369' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfb28b1d-2458-4e6f-a849-6f14011393fe"}]: dispatch 2023-03-02T10:52:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:59 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfb28b1d-2458-4e6f-a849-6f14011393fe"}]: dispatch 2023-03-02T10:52:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:59 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfb28b1d-2458-4e6f-a849-6f14011393fe"}]': finished 2023-03-02T10:52:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:59 smithi122 ceph-mon[125440]: osdmap e56: 9 total, 8 up, 9 in 2023-03-02T10:52:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:52:59 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:00 smithi136 ceph-mon[125702]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:00 smithi136 ceph-mon[125702]: from='client.? 172.21.15.136:0/527452804' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:53:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:00 smithi057 ceph-mon[92072]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:00 smithi057 ceph-mon[92072]: from='client.? 172.21.15.136:0/527452804' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:53:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:00 smithi122 ceph-mon[125440]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:00 smithi122 ceph-mon[125440]: from='client.? 172.21.15.136:0/527452804' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:53:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:02 smithi136 ceph-mon[125702]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:02 smithi057 ceph-mon[92072]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:02 smithi122 ceph-mon[125440]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:04 smithi136 ceph-mon[125702]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:04 smithi057 ceph-mon[92072]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:04 smithi122 ceph-mon[125440]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:06.445 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:06 smithi136 ceph-mon[125702]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:06.445 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:06 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-03-02T10:53:06.445 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:06 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:06 smithi057 ceph-mon[92072]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:06 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-03-02T10:53:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:06 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:06 smithi122 ceph-mon[125440]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:06 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-03-02T10:53:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:06 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:07 smithi136 ceph-mon[125702]: Deploying daemon osd.8 on smithi136 2023-03-02T10:53:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:07 smithi057 ceph-mon[92072]: Deploying daemon osd.8 on smithi136 2023-03-02T10:53:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:07 smithi122 ceph-mon[125440]: Deploying daemon osd.8 on smithi136 2023-03-02T10:53:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:08 smithi057 ceph-mon[92072]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:08 smithi122 ceph-mon[125440]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:08 smithi136 ceph-mon[125702]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:10 smithi136 ceph-mon[125702]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:10 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:10 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:10 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:10 smithi057 ceph-mon[92072]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:10 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:10 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:10 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:10 smithi122 ceph-mon[125440]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:10 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:10 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:10 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:12 smithi057 ceph-mon[92072]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:12 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:12 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:12 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:12 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:12 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:12 smithi122 ceph-mon[125440]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:12 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:12 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:12 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:12 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:12 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:12.721 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:12 smithi136 ceph-mon[125702]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:12.721 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:12 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:12.721 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:12 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:12.721 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:12 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:12.721 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:12 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:12.721 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:12 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:12.722 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.720+0000 7f4fbe7fc700 1 -- 172.21.15.136:0/3589312094 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4fc80616a0 con 0x7f4fb409b3a0 2023-03-02T10:53:12.722 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 8 on host 'smithi136' 2023-03-02T10:53:12.723 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 -- 172.21.15.136:0/3589312094 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4fb409b3a0 msgr2=0x7f4fb409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:12.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4fb409b3a0 0x7f4fb409d850 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8006010 tx=0x7f4fb800b540 comp rx=0 tx=0).stop 2023-03-02T10:53:12.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 -- 172.21.15.136:0/3589312094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fc81018b0 msgr2=0x7f4fc80ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:12.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fc81018b0 0x7f4fc80ff410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000b970 tx=0x7f4fc000bd30 comp rx=0 tx=0).stop 2023-03-02T10:53:12.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 -- 172.21.15.136:0/3589312094 shutdown_connections 2023-03-02T10:53:12.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4fb409b3a0 0x7f4fb409d850 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:12.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fc81018b0 0x7f4fc80ff410 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:12.724 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fc80fdf50 0x7f4fc8100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:12.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 --2- 172.21.15.136:0/3589312094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fc8100f20 0x7f4fc80feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:12.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 -- 172.21.15.136:0/3589312094 >> 172.21.15.136:0/3589312094 conn(0x7f4fc80f9930 msgr2=0x7f4fc8104450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:53:12.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 -- 172.21.15.136:0/3589312094 shutdown_connections 2023-03-02T10:53:12.725 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:53:12.723+0000 7f4fcf44b700 1 -- 172.21.15.136:0/3589312094 wait complete. 2023-03-02T10:53:13.117 DEBUG:teuthology.orchestra.run.smithi136:osd.8> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.8.service 2023-03-02T10:53:13.120 INFO:tasks.cephadm:Deploying osd.9 on smithi057 with /dev/vg_nvme/lv_1... 2023-03-02T10:53:13.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-03-02T10:53:13.150 INFO:journalctl@ceph.osd.8.smithi136.stdout:-- Logs begin at Thu 2023-03-02 10:22:36 UTC. -- 2023-03-02T10:53:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:53:13.976 INFO:journalctl@ceph.osd.8.smithi136.stdout:Mar 02 10:53:13 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-8[142485]: 2023-03-02T10:53:13.822+0000 7f2e8864d5c0 -1 osd.8 0 log_to_monitors true 2023-03-02T10:53:13.977 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:13 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:13.977 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:13 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:13.977 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:13 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:13.977 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:13 smithi136 ceph-mon[125702]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:14.119 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:13 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:14.120 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:13 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:14.120 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:13 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:14.120 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:13 smithi057 ceph-mon[92072]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:13 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:13 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:13 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:13 smithi122 ceph-mon[125440]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:14 smithi057 ceph-mon[92072]: from='osd.8 [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-02T10:53:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:14 smithi057 ceph-mon[92072]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-02T10:53:15.013 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:14 smithi136 ceph-mon[125702]: from='osd.8 [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-02T10:53:15.014 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:14 smithi136 ceph-mon[125702]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-02T10:53:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:14 smithi122 ceph-mon[125440]: from='osd.8 [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-02T10:53:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:14 smithi122 ceph-mon[125440]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-02T10:53:15.687 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-03-02T10:53:15.687 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-03-02T10:53:15.687 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2023-03-02T10:53:15.687 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2023-03-02T10:53:15.687 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0211663 s, 495 MB/s 2023-03-02T10:53:15.688 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2023-03-02T10:53:16.090 INFO:journalctl@ceph.osd.8.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-8[142485]: 2023-03-02T10:53:15.741+0000 7f2e7c5d2700 -1 osd.8 0 waiting for initial osdmap 2023-03-02T10:53:16.090 INFO:journalctl@ceph.osd.8.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-8[142485]: 2023-03-02T10:53:15.755+0000 7f2e743bf700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:53:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-03-02T10:53:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: osdmap e57: 9 total, 8 up, 9 in 2023-03-02T10:53:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='osd.8 [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:53:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:53:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi136 2023-03-02T10:53:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 5722M 2023-03-02T10:53:16.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:16.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:16.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.164 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-03-02T10:53:16.165 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: osdmap e57: 9 total, 8 up, 9 in 2023-03-02T10:53:16.165 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:16.165 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='osd.8 [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:53:16.165 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:53:16.165 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:16.165 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi136 2023-03-02T10:53:16.165 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.166 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.166 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:16.166 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:16.166 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:16.166 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 5722M 2023-03-02T10:53:16.166 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.166 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:16.167 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:16.167 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.168 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi057:vg_nvme/lv_1 2023-03-02T10:53:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-03-02T10:53:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: osdmap e57: 9 total, 8 up, 9 in 2023-03-02T10:53:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='osd.8 [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:53:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:53:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi136 2023-03-02T10:53:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:16.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 5722M 2023-03-02T10:53:16.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:16.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:16.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:16.904 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:53:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:16 smithi136 ceph-mon[125702]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:53:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:16 smithi136 ceph-mon[125702]: osdmap e58: 9 total, 8 up, 9 in 2023-03-02T10:53:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:16 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:16 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:17.161 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:16 smithi057 ceph-mon[92072]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:53:17.161 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:16 smithi057 ceph-mon[92072]: osdmap e58: 9 total, 8 up, 9 in 2023-03-02T10:53:17.162 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:16 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:17.162 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:16 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:16 smithi122 ceph-mon[125440]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:53:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:16 smithi122 ceph-mon[125440]: osdmap e58: 9 total, 8 up, 9 in 2023-03-02T10:53:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:16 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:16 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:17 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:53:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:17 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:53:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:17 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:17 smithi136 ceph-mon[125702]: osd.8 [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277] boot 2023-03-02T10:53:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:17 smithi136 ceph-mon[125702]: osdmap e59: 9 total, 9 up, 9 in 2023-03-02T10:53:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:17 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:17 smithi136 ceph-mon[125702]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:17 smithi136 ceph-mon[125702]: osdmap e60: 9 total, 9 up, 9 in 2023-03-02T10:53:18.180 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:17 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:53:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:17 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:53:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:17 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:17 smithi057 ceph-mon[92072]: osd.8 [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277] boot 2023-03-02T10:53:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:17 smithi057 ceph-mon[92072]: osdmap e59: 9 total, 9 up, 9 in 2023-03-02T10:53:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:17 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:17 smithi057 ceph-mon[92072]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:17 smithi057 ceph-mon[92072]: osdmap e60: 9 total, 9 up, 9 in 2023-03-02T10:53:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:17 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:53:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:17 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:53:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:17 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:17 smithi122 ceph-mon[125440]: osd.8 [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277] boot 2023-03-02T10:53:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:17 smithi122 ceph-mon[125440]: osdmap e59: 9 total, 9 up, 9 in 2023-03-02T10:53:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:17 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:53:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:17 smithi122 ceph-mon[125440]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-03-02T10:53:18.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:17 smithi122 ceph-mon[125440]: osdmap e60: 9 total, 9 up, 9 in 2023-03-02T10:53:18.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.389+0000 7f6125153700 1 -- 172.21.15.57:0/3580356628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61200feac0 msgr2=0x7f61200feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:18.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.389+0000 7f6125153700 1 --2- 172.21.15.57:0/3580356628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61200feac0 0x7f61200feed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6110009990 tx=0x7f6110009ca0 comp rx=0 tx=0).stop 2023-03-02T10:53:18.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.389+0000 7f6125153700 1 -- 172.21.15.57:0/3580356628 shutdown_connections 2023-03-02T10:53:18.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.389+0000 7f6125153700 1 --2- 172.21.15.57:0/3580356628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6120100640 0x7f6120106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:18.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.389+0000 7f6125153700 1 --2- 172.21.15.57:0/3580356628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61200feac0 0x7f61200feed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:18.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.389+0000 7f6125153700 1 --2- 172.21.15.57:0/3580356628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61200ffcb0 0x7f6120100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:18.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.389+0000 7f6125153700 1 -- 172.21.15.57:0/3580356628 >> 172.21.15.57:0/3580356628 conn(0x7f61200fa0a0 msgr2=0x7f61200fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:53:18.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.389+0000 7f6125153700 1 -- 172.21.15.57:0/3580356628 shutdown_connections 2023-03-02T10:53:18.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.389+0000 7f6125153700 1 -- 172.21.15.57:0/3580356628 wait complete. 2023-03-02T10:53:18.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.390+0000 7f6125153700 1 Processor -- start 2023-03-02T10:53:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.390+0000 7f6125153700 1 -- start start 2023-03-02T10:53:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.390+0000 7f6125153700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61200feac0 0x7f6120195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:53:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.390+0000 7f6125153700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61200ffcb0 0x7f6120195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:53:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.390+0000 7f6125153700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6120100640 0x7f612019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:53:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.390+0000 7f6125153700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612019d4d0 con 0x7f61200ffcb0 2023-03-02T10:53:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.390+0000 7f6125153700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612019d610 con 0x7f61200feac0 2023-03-02T10:53:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.390+0000 7f6125153700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612019d7a0 con 0x7f6120100640 2023-03-02T10:53:18.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.390+0000 7f6117fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61200ffcb0 0x7f6120195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:53:18.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.390+0000 7f6117fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61200ffcb0 0x7f6120195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52282/0 (socket says 172.21.15.57:52282) 2023-03-02T10:53:18.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.390+0000 7f6117fff700 1 -- 172.21.15.57:0/3067079419 learned_addr learned my addr 172.21.15.57:0/3067079419 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:53:18.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f611ed9d700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61200feac0 0x7f6120195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:53:18.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f611f59e700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6120100640 0x7f612019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:53:18.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f6117fff700 1 -- 172.21.15.57:0/3067079419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6120100640 msgr2=0x7f612019cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:18.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f6117fff700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6120100640 0x7f612019cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f6117fff700 1 -- 172.21.15.57:0/3067079419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61200feac0 msgr2=0x7f6120195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f6117fff700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61200feac0 0x7f6120195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f6117fff700 1 -- 172.21.15.57:0/3067079419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61100095f0 con 0x7f61200ffcb0 2023-03-02T10:53:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f611f59e700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6120100640 0x7f612019cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:53:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f6117fff700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61200ffcb0 0x7f6120195e90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f610800d950 tx=0x7f610800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:53:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f611cd99700 1 -- 172.21.15.57:0/3067079419 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108009940 con 0x7f61200ffcb0 2023-03-02T10:53:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f6125153700 1 -- 172.21.15.57:0/3067079419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612010a420 con 0x7f61200ffcb0 2023-03-02T10:53:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f611cd99700 1 -- 172.21.15.57:0/3067079419 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6108010460 con 0x7f61200ffcb0 2023-03-02T10:53:18.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f611cd99700 1 -- 172.21.15.57:0/3067079419 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610800f620 con 0x7f61200ffcb0 2023-03-02T10:53:18.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.391+0000 7f6125153700 1 -- 172.21.15.57:0/3067079419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612010a290 con 0x7f61200ffcb0 2023-03-02T10:53:18.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.392+0000 7f6125153700 1 -- 172.21.15.57:0/3067079419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6120066750 con 0x7f61200ffcb0 2023-03-02T10:53:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.395+0000 7f611cd99700 1 -- 172.21.15.57:0/3067079419 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f6108022070 con 0x7f61200ffcb0 2023-03-02T10:53:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.396+0000 7f611cd99700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f610c09b3a0 0x7f610c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:53:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.396+0000 7f611cd99700 1 -- 172.21.15.57:0/3067079419 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f61080c42b0 con 0x7f61200ffcb0 2023-03-02T10:53:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.396+0000 7f611ed9d700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f610c09b3a0 0x7f610c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:53:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.396+0000 7f611ed9d700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f610c09b3a0 0x7f610c09d850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f611000b2e0 tx=0x7f6110005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:53:18.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.399+0000 7f611cd99700 1 -- 172.21.15.57:0/3067079419 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f61080905b0 con 0x7f61200ffcb0 2023-03-02T10:53:18.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:18.604+0000 7f6125153700 1 -- 172.21.15.57:0/3067079419 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f612019e300 con 0x7f610c09b3a0 2023-03-02T10:53:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:53:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:53:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:19 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:19 smithi136 ceph-mon[125702]: osdmap e61: 9 total, 9 up, 9 in 2023-03-02T10:53:19.646 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:53:19.646 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:53:19.647 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:19 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:19.647 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:19 smithi057 ceph-mon[92072]: osdmap e61: 9 total, 9 up, 9 in 2023-03-02T10:53:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:53:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:53:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:19 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:19 smithi122 ceph-mon[125440]: osdmap e61: 9 total, 9 up, 9 in 2023-03-02T10:53:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:20 smithi057 ceph-mon[92072]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:53:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:20 smithi057 ceph-mon[92072]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:20 smithi136 ceph-mon[125702]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:53:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:20 smithi136 ceph-mon[125702]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:20 smithi122 ceph-mon[125440]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:53:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:20 smithi122 ceph-mon[125440]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 52 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:21 smithi136 ceph-mon[125702]: osdmap e62: 9 total, 9 up, 9 in 2023-03-02T10:53:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:21 smithi136 ceph-mon[125702]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 128 KiB/s, 0 objects/s recovering 2023-03-02T10:53:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:21 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/536532539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6423cab2-6626-44c1-a9b3-109e1091a0ff"}]: dispatch 2023-03-02T10:53:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:21 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/536532539' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6423cab2-6626-44c1-a9b3-109e1091a0ff"}]': finished 2023-03-02T10:53:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:21 smithi136 ceph-mon[125702]: osdmap e63: 10 total, 9 up, 10 in 2023-03-02T10:53:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:21 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:21 smithi057 ceph-mon[92072]: osdmap e62: 9 total, 9 up, 9 in 2023-03-02T10:53:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:21 smithi057 ceph-mon[92072]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 128 KiB/s, 0 objects/s recovering 2023-03-02T10:53:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:21 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/536532539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6423cab2-6626-44c1-a9b3-109e1091a0ff"}]: dispatch 2023-03-02T10:53:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:21 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/536532539' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6423cab2-6626-44c1-a9b3-109e1091a0ff"}]': finished 2023-03-02T10:53:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:21 smithi057 ceph-mon[92072]: osdmap e63: 10 total, 9 up, 10 in 2023-03-02T10:53:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:21 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:21 smithi122 ceph-mon[125440]: osdmap e62: 9 total, 9 up, 9 in 2023-03-02T10:53:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:21 smithi122 ceph-mon[125440]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 128 KiB/s, 0 objects/s recovering 2023-03-02T10:53:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:21 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/536532539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6423cab2-6626-44c1-a9b3-109e1091a0ff"}]: dispatch 2023-03-02T10:53:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:21 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/536532539' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6423cab2-6626-44c1-a9b3-109e1091a0ff"}]': finished 2023-03-02T10:53:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:21 smithi122 ceph-mon[125440]: osdmap e63: 10 total, 9 up, 10 in 2023-03-02T10:53:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:21 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:22 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2482296509' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:53:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:22 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2482296509' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:53:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:22 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2482296509' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:53:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:24 smithi136 ceph-mon[125702]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-03-02T10:53:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:24 smithi057 ceph-mon[92072]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-03-02T10:53:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:24 smithi122 ceph-mon[125440]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-03-02T10:53:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:26 smithi136 ceph-mon[125702]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-03-02T10:53:26.630 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:26 smithi057 ceph-mon[92072]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-03-02T10:53:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:26 smithi122 ceph-mon[125440]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-03-02T10:53:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:28 smithi136 ceph-mon[125702]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:53:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:28 smithi057 ceph-mon[92072]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:53:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:28 smithi122 ceph-mon[125440]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:53:29.539 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-03-02T10:53:29.539 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:29 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:29.539 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:29 smithi057 ceph-mon[92072]: Deploying daemon osd.9 on smithi057 2023-03-02T10:53:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-03-02T10:53:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:29 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:29 smithi136 ceph-mon[125702]: Deploying daemon osd.9 on smithi057 2023-03-02T10:53:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-03-02T10:53:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:29 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:29 smithi122 ceph-mon[125440]: Deploying daemon osd.9 on smithi057 2023-03-02T10:53:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:30 smithi136 ceph-mon[125702]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:30 smithi057 ceph-mon[92072]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:30 smithi122 ceph-mon[125440]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:32 smithi057 ceph-mon[92072]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:32 smithi136 ceph-mon[125702]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:32 smithi122 ceph-mon[125440]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:34 smithi136 ceph-mon[125702]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:34 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:34 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:34 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:34 smithi057 ceph-mon[92072]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:34 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:34 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:34 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:34 smithi122 ceph-mon[125440]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:34 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:34 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:34 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:36 smithi057 ceph-mon[92072]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:36 smithi136 ceph-mon[125702]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:36 smithi122 ceph-mon[125440]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:37.225 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 9 on host 'smithi057' 2023-03-02T10:53:37.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.224+0000 7f611cd99700 1 -- 172.21.15.57:0/3067079419 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f612019e300 con 0x7f610c09b3a0 2023-03-02T10:53:37.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 -- 172.21.15.57:0/3067079419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f610c09b3a0 msgr2=0x7f610c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:37.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f610c09b3a0 0x7f610c09d850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f611000b2e0 tx=0x7f6110005960 comp rx=0 tx=0).stop 2023-03-02T10:53:37.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 -- 172.21.15.57:0/3067079419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61200ffcb0 msgr2=0x7f6120195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:37.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61200ffcb0 0x7f6120195e90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f610800d950 tx=0x7f610800dc60 comp rx=0 tx=0).stop 2023-03-02T10:53:37.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 -- 172.21.15.57:0/3067079419 shutdown_connections 2023-03-02T10:53:37.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f610c09b3a0 0x7f610c09d850 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:37.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6120100640 0x7f612019cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:37.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61200feac0 0x7f6120195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:37.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 --2- 172.21.15.57:0/3067079419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61200ffcb0 0x7f6120195e90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:37.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 -- 172.21.15.57:0/3067079419 >> 172.21.15.57:0/3067079419 conn(0x7f61200fa0a0 msgr2=0x7f6120067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:53:37.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 -- 172.21.15.57:0/3067079419 shutdown_connections 2023-03-02T10:53:37.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:53:37.226+0000 7f6125153700 1 -- 172.21.15.57:0/3067079419 wait complete. 2023-03-02T10:53:37.749 DEBUG:teuthology.orchestra.run.smithi057:osd.9> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.9.service 2023-03-02T10:53:37.752 INFO:tasks.cephadm:Deploying osd.10 on smithi122 with /dev/vg_nvme/lv_1... 2023-03-02T10:53:37.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-03-02T10:53:37.801 INFO:journalctl@ceph.osd.9.smithi057.stdout:-- Logs begin at Thu 2023-03-02 10:29:06 UTC. -- 2023-03-02T10:53:38.050 INFO:journalctl@ceph.osd.9.smithi057.stdout:Mar 02 10:53:37 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-9[121378]: 2023-03-02T10:53:37.841+0000 7f882d8d85c0 -1 osd.9 0 log_to_monitors true 2023-03-02T10:53:38.304 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.305 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.305 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:38.305 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:38.305 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.305 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.305 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.306 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:38.306 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:38 smithi057 ceph-mon[92072]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:38.306 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:38 smithi057 ceph-mon[92072]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-03-02T10:53:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:38.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:38 smithi136 ceph-mon[125702]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:38.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:38 smithi136 ceph-mon[125702]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-03-02T10:53:38.410 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.b/config 2023-03-02T10:53:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:38 smithi122 ceph-mon[125440]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:38 smithi122 ceph-mon[125440]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-03-02T10:53:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:39 smithi057 ceph-mon[92072]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-03-02T10:53:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:39 smithi057 ceph-mon[92072]: osdmap e64: 10 total, 9 up, 10 in 2023-03-02T10:53:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:39 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:39 smithi057 ceph-mon[92072]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:53:39.435 INFO:journalctl@ceph.osd.9.smithi057.stdout:Mar 02 10:53:39 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-9[121378]: 2023-03-02T10:53:39.238+0000 7f882185d700 -1 osd.9 0 waiting for initial osdmap 2023-03-02T10:53:39.435 INFO:journalctl@ceph.osd.9.smithi057.stdout:Mar 02 10:53:39 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-9[121378]: 2023-03-02T10:53:39.264+0000 7f881be4f700 -1 osd.9 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:53:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:39 smithi122 ceph-mon[125440]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-03-02T10:53:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:39 smithi122 ceph-mon[125440]: osdmap e64: 10 total, 9 up, 10 in 2023-03-02T10:53:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:39 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:39 smithi122 ceph-mon[125440]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:53:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:39 smithi136 ceph-mon[125702]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-03-02T10:53:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:39 smithi136 ceph-mon[125702]: osdmap e64: 10 total, 9 up, 10 in 2023-03-02T10:53:39.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:39 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:39.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:39 smithi136 ceph-mon[125702]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-03-02T10:53:40.029 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-03-02T10:53:40.029 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-03-02T10:53:40.029 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2023-03-02T10:53:40.029 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2023-03-02T10:53:40.029 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0139598 s, 751 MB/s 2023-03-02T10:53:40.030 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2023-03-02T10:53:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:53:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: osdmap e65: 10 total, 9 up, 10 in 2023-03-02T10:53:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:40.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:40.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:40.444 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:53:40.445 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: osdmap e65: 10 total, 9 up, 10 in 2023-03-02T10:53:40.445 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:40.446 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:40.446 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:40.446 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:40.446 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:40.446 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.446 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.446 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.447 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.447 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:40.447 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:40.447 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:40.447 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:40.454 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi122:vg_nvme/lv_1 2023-03-02T10:53:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-03-02T10:53:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: osdmap e65: 10 total, 9 up, 10 in 2023-03-02T10:53:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:40.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:53:40.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:40.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:40.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:53:40.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:41.089 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.b/config 2023-03-02T10:53:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:41 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:53:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:41 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:53:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:41 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi057 2023-03-02T10:53:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:41 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 4319M 2023-03-02T10:53:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:41 smithi136 ceph-mon[125702]: osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718] boot 2023-03-02T10:53:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:41 smithi136 ceph-mon[125702]: osdmap e66: 10 total, 10 up, 10 in 2023-03-02T10:53:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:41.607 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:41 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:53:41.608 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:41 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:53:41.608 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:41 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi057 2023-03-02T10:53:41.608 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:41 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 4319M 2023-03-02T10:53:41.608 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:41 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:41.608 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:41 smithi122 ceph-mon[125440]: osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718] boot 2023-03-02T10:53:41.608 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:41 smithi122 ceph-mon[125440]: osdmap e66: 10 total, 10 up, 10 in 2023-03-02T10:53:41.608 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:41 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:41 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:53:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:41 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:53:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:41 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi057 2023-03-02T10:53:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:41 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 4319M 2023-03-02T10:53:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:41 smithi057 ceph-mon[92072]: osd.9 [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718] boot 2023-03-02T10:53:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:41 smithi057 ceph-mon[92072]: osdmap e66: 10 total, 10 up, 10 in 2023-03-02T10:53:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:53:42.319 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.316+0000 7f02126b9700 1 -- 172.21.15.122:0/1919910490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f020c0ff430 msgr2=0x7f020c0ff880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:42.320 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.316+0000 7f02126b9700 1 --2- 172.21.15.122:0/1919910490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f020c0ff430 0x7f020c0ff880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009990 tx=0x7f01f4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:53:42.321 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.316+0000 7f02126b9700 1 -- 172.21.15.122:0/1919910490 shutdown_connections 2023-03-02T10:53:42.321 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.316+0000 7f02126b9700 1 --2- 172.21.15.122:0/1919910490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c0ffdc0 0x7f020c106680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:42.321 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.316+0000 7f02126b9700 1 --2- 172.21.15.122:0/1919910490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f020c0fe240 0x7f020c0fe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:42.322 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.316+0000 7f02126b9700 1 --2- 172.21.15.122:0/1919910490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f020c0ff430 0x7f020c0ff880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:42.322 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.316+0000 7f02126b9700 1 -- 172.21.15.122:0/1919910490 >> 172.21.15.122:0/1919910490 conn(0x7f020c0f9820 msgr2=0x7f020c0fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:53:42.322 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.316+0000 7f02126b9700 1 -- 172.21.15.122:0/1919910490 shutdown_connections 2023-03-02T10:53:42.323 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.316+0000 7f02126b9700 1 -- 172.21.15.122:0/1919910490 wait complete. 2023-03-02T10:53:42.323 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.316+0000 7f02126b9700 1 Processor -- start 2023-03-02T10:53:42.323 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f02126b9700 1 -- start start 2023-03-02T10:53:42.323 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f02126b9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f020c0fe240 0x7f020c195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:53:42.324 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f02126b9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f020c0ff430 0x7f020c195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:53:42.324 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f02126b9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c0ffdc0 0x7f020c19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:53:42.324 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f02126b9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c19d500 con 0x7f020c0ffdc0 2023-03-02T10:53:42.325 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f02126b9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c19d640 con 0x7f020c0ff430 2023-03-02T10:53:42.325 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f02126b9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c19d7d0 con 0x7f020c0fe240 2023-03-02T10:53:42.325 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f020c0ff430 0x7f020c195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:53:42.325 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f020c0ff430 0x7f020c195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59166/0 (socket says 172.21.15.122:59166) 2023-03-02T10:53:42.326 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f020b7fe700 1 -- 172.21.15.122:0/2298699949 learned_addr learned my addr 172.21.15.122:0/2298699949 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-03-02T10:53:42.326 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f020bfff700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f020c0fe240 0x7f020c195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:53:42.326 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f020b7fe700 1 -- 172.21.15.122:0/2298699949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f020c0fe240 msgr2=0x7f020c195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:42.326 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f020b7fe700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f020c0fe240 0x7f020c195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:42.327 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f020b7fe700 1 -- 172.21.15.122:0/2298699949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c0ffdc0 msgr2=0x7f020c19cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:42.327 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f020b7fe700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c0ffdc0 0x7f020c19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:42.327 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f020b7fe700 1 -- 172.21.15.122:0/2298699949 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40095f0 con 0x7f020c0ff430 2023-03-02T10:53:42.327 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.317+0000 7f020b7fe700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f020c0ff430 0x7f020c195ec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01f4004760 tx=0x7f01f4004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:53:42.328 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.318+0000 7f02097fa700 1 -- 172.21.15.122:0/2298699949 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f401d070 con 0x7f020c0ff430 2023-03-02T10:53:42.328 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.318+0000 7f02097fa700 1 -- 172.21.15.122:0/2298699949 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01f4004cf0 con 0x7f020c0ff430 2023-03-02T10:53:42.328 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.318+0000 7f02126b9700 1 -- 172.21.15.122:0/2298699949 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c109c20 con 0x7f020c0ff430 2023-03-02T10:53:42.328 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.318+0000 7f02097fa700 1 -- 172.21.15.122:0/2298699949 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f4005280 con 0x7f020c0ff430 2023-03-02T10:53:42.329 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.318+0000 7f02126b9700 1 -- 172.21.15.122:0/2298699949 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c109a90 con 0x7f020c0ff430 2023-03-02T10:53:42.330 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.319+0000 7f02126b9700 1 -- 172.21.15.122:0/2298699949 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c19ded0 con 0x7f020c0ff430 2023-03-02T10:53:42.331 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.320+0000 7f02097fa700 1 -- 172.21.15.122:0/2298699949 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f01f400c040 con 0x7f020c0ff430 2023-03-02T10:53:42.331 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.320+0000 7f02097fa700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f01f809b420 0x7f01f809d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:53:42.331 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.320+0000 7f02097fa700 1 -- 172.21.15.122:0/2298699949 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f01f40c5650 con 0x7f020c0ff430 2023-03-02T10:53:42.332 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.320+0000 7f020bfff700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f01f809b420 0x7f01f809d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:53:42.332 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.321+0000 7f020bfff700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f01f809b420 0x7f01f809d8d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f020c0ff290 tx=0x7f01fc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:53:42.332 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.324+0000 7f02097fa700 1 -- 172.21.15.122:0/2298699949 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f01f405a800 con 0x7f020c0ff430 2023-03-02T10:53:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:42 smithi122 ceph-mon[125440]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:42 smithi122 ceph-mon[125440]: osdmap e67: 10 total, 10 up, 10 in 2023-03-02T10:53:42.518 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:42.516+0000 7f02126b9700 1 -- 172.21.15.122:0/2298699949 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f020c19e540 con 0x7f01f809b420 2023-03-02T10:53:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:42 smithi136 ceph-mon[125702]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:42 smithi136 ceph-mon[125702]: osdmap e67: 10 total, 10 up, 10 in 2023-03-02T10:53:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:42 smithi057 ceph-mon[92072]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 53 MiB used, 805 GiB / 805 GiB avail 2023-03-02T10:53:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:42 smithi057 ceph-mon[92072]: osdmap e67: 10 total, 10 up, 10 in 2023-03-02T10:53:43.572 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:53:43.573 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:53:43.573 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:43 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:53:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:43 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:53:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:43 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:43 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:53:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:43 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:53:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:43 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:44 smithi122 ceph-mon[125440]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:53:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:44 smithi122 ceph-mon[125440]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:44 smithi136 ceph-mon[125702]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:53:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:44 smithi136 ceph-mon[125702]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:44 smithi057 ceph-mon[92072]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:53:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:44 smithi057 ceph-mon[92072]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:45 smithi136 ceph-mon[125702]: from='client.? 172.21.15.122:0/2040338700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "affb12a9-38b2-4b1e-a4e0-64269959428c"}]: dispatch 2023-03-02T10:53:45.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:45 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "affb12a9-38b2-4b1e-a4e0-64269959428c"}]: dispatch 2023-03-02T10:53:45.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:45 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "affb12a9-38b2-4b1e-a4e0-64269959428c"}]': finished 2023-03-02T10:53:45.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:45 smithi136 ceph-mon[125702]: osdmap e68: 11 total, 10 up, 11 in 2023-03-02T10:53:45.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:45 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:53:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:45 smithi057 ceph-mon[92072]: from='client.? 172.21.15.122:0/2040338700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "affb12a9-38b2-4b1e-a4e0-64269959428c"}]: dispatch 2023-03-02T10:53:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:45 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "affb12a9-38b2-4b1e-a4e0-64269959428c"}]: dispatch 2023-03-02T10:53:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:45 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "affb12a9-38b2-4b1e-a4e0-64269959428c"}]': finished 2023-03-02T10:53:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:45 smithi057 ceph-mon[92072]: osdmap e68: 11 total, 10 up, 11 in 2023-03-02T10:53:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:45 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:53:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:45 smithi122 ceph-mon[125440]: from='client.? 172.21.15.122:0/2040338700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "affb12a9-38b2-4b1e-a4e0-64269959428c"}]: dispatch 2023-03-02T10:53:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:45 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "affb12a9-38b2-4b1e-a4e0-64269959428c"}]: dispatch 2023-03-02T10:53:45.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:45 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "affb12a9-38b2-4b1e-a4e0-64269959428c"}]': finished 2023-03-02T10:53:45.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:45 smithi122 ceph-mon[125440]: osdmap e68: 11 total, 10 up, 11 in 2023-03-02T10:53:45.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:45 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:53:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:46 smithi136 ceph-mon[125702]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:46 smithi136 ceph-mon[125702]: from='client.? 172.21.15.122:0/3345010930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:53:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:46 smithi057 ceph-mon[92072]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:46 smithi057 ceph-mon[92072]: from='client.? 172.21.15.122:0/3345010930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:53:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:46 smithi122 ceph-mon[125440]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:46 smithi122 ceph-mon[125440]: from='client.? 172.21.15.122:0/3345010930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:53:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:48 smithi136 ceph-mon[125702]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:48.596 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:48 smithi122 ceph-mon[125440]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:48 smithi057 ceph-mon[92072]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:50 smithi122 ceph-mon[125440]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:50 smithi136 ceph-mon[125702]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:50 smithi057 ceph-mon[92072]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:52 smithi122 ceph-mon[125440]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-03-02T10:53:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:52 smithi136 ceph-mon[125702]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-03-02T10:53:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:52 smithi057 ceph-mon[92072]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-03-02T10:53:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:53:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:53 smithi122 ceph-mon[125440]: Deploying daemon osd.10 on smithi122 2023-03-02T10:53:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:53 smithi136 ceph-mon[125702]: Deploying daemon osd.10 on smithi122 2023-03-02T10:53:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:53 smithi057 ceph-mon[92072]: Deploying daemon osd.10 on smithi122 2023-03-02T10:53:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:54 smithi122 ceph-mon[125440]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:54 smithi136 ceph-mon[125702]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:54 smithi057 ceph-mon[92072]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:56 smithi122 ceph-mon[125440]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:56 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:56 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:56 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:56 smithi136 ceph-mon[125702]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:56 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:56 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:56 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:56 smithi057 ceph-mon[92072]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:56 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:56 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:53:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:56 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:53:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:58 smithi122 ceph-mon[125440]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:58 smithi136 ceph-mon[125702]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:58 smithi057 ceph-mon[92072]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:53:59.178 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.177+0000 7f02097fa700 1 -- 172.21.15.122:0/2298699949 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f020c19e540 con 0x7f01f809b420 2023-03-02T10:53:59.179 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 10 on host 'smithi122' 2023-03-02T10:53:59.180 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 -- 172.21.15.122:0/2298699949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f01f809b420 msgr2=0x7f01f809d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:59.180 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f01f809b420 0x7f01f809d8d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f020c0ff290 tx=0x7f01fc00b410 comp rx=0 tx=0).stop 2023-03-02T10:53:59.180 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 -- 172.21.15.122:0/2298699949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f020c0ff430 msgr2=0x7f020c195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:53:59.180 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f020c0ff430 0x7f020c195ec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01f4004760 tx=0x7f01f4004790 comp rx=0 tx=0).stop 2023-03-02T10:53:59.180 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 -- 172.21.15.122:0/2298699949 shutdown_connections 2023-03-02T10:53:59.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f01f809b420 0x7f01f809d8d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:59.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f020c0ffdc0 0x7f020c19cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:59.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f020c0fe240 0x7f020c195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:59.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 --2- 172.21.15.122:0/2298699949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f020c0ff430 0x7f020c195ec0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:53:59.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 -- 172.21.15.122:0/2298699949 >> 172.21.15.122:0/2298699949 conn(0x7f020c0f9820 msgr2=0x7f020c0fb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:53:59.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 -- 172.21.15.122:0/2298699949 shutdown_connections 2023-03-02T10:53:59.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-03-02T10:53:59.179+0000 7f02126b9700 1 -- 172.21.15.122:0/2298699949 wait complete. 2023-03-02T10:53:59.690 DEBUG:teuthology.orchestra.run.smithi122:osd.10> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.10.service 2023-03-02T10:53:59.693 INFO:tasks.cephadm:Deploying osd.11 on smithi136 with /dev/vg_nvme/lv_1... 2023-03-02T10:53:59.694 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-03-02T10:53:59.723 INFO:journalctl@ceph.osd.10.smithi122.stdout:-- Logs begin at Thu 2023-03-02 10:22:37 UTC. -- 2023-03-02T10:54:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:59 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:59 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:59 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:59 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:00.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:59 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:59 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:59 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:00.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:59 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:53:59 smithi136 ceph-mon[125702]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:54:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:59 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:59 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:59 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:59 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:59 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:59 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:59 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:59 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:53:59 smithi057 ceph-mon[92072]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:54:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:59 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.431 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:59 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:59 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:00.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:59 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:00.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:59 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:59 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:59 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:00.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:59 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:00.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:53:59 smithi122 ceph-mon[125440]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:54:00.433 INFO:journalctl@ceph.osd.10.smithi122.stdout:Mar 02 10:54:00 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-10[147146]: 2023-03-02T10:54:00.056+0000 7f07caf765c0 -1 osd.10 0 log_to_monitors true 2023-03-02T10:54:00.433 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:54:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:00 smithi136 ceph-mon[125702]: from='osd.10 [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-02T10:54:01.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:00 smithi136 ceph-mon[125702]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-02T10:54:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:00 smithi057 ceph-mon[92072]: from='osd.10 [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-02T10:54:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:00 smithi057 ceph-mon[92072]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-02T10:54:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:00 smithi122 ceph-mon[125440]: from='osd.10 [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-02T10:54:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:00 smithi122 ceph-mon[125440]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-02T10:54:01.831 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-03-02T10:54:01.831 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-03-02T10:54:01.831 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2023-03-02T10:54:01.832 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2023-03-02T10:54:01.832 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00916835 s, 1.1 GB/s 2023-03-02T10:54:01.832 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2023-03-02T10:54:02.182 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-03-02T10:54:02.183 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: osdmap e69: 11 total, 10 up, 11 in 2023-03-02T10:54:02.183 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:02.183 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='osd.10 [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:54:02.183 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:54:02.183 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:54:02.184 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.184 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.184 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.184 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.184 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.184 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.184 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.184 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:02.185 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:02.185 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:01 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.186 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch daemon add osd smithi136:vg_nvme/lv_1 2023-03-02T10:54:02.201 INFO:journalctl@ceph.osd.10.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-10[147146]: 2023-03-02T10:54:01.941+0000 7f07beefb700 -1 osd.10 0 waiting for initial osdmap 2023-03-02T10:54:02.202 INFO:journalctl@ceph.osd.10.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-10[147146]: 2023-03-02T10:54:01.954+0000 7f07b8cec700 -1 osd.10 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:54:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-03-02T10:54:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: osdmap e69: 11 total, 10 up, 11 in 2023-03-02T10:54:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='osd.10 [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:54:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:54:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:54:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:01 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-03-02T10:54:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: osdmap e69: 11 total, 10 up, 11 in 2023-03-02T10:54:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='osd.10 [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:54:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2023-03-02T10:54:02.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:54:02.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:02.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:02.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:02.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:01 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:02.823 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:54:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:02 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi122 2023-03-02T10:54:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:02 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 4292M 2023-03-02T10:54:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:02 smithi122 ceph-mon[125440]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:54:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:02 smithi122 ceph-mon[125440]: osdmap e70: 11 total, 10 up, 11 in 2023-03-02T10:54:03.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:02 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:03.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:02 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:03.283 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:02 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi122 2023-03-02T10:54:03.283 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:02 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 4292M 2023-03-02T10:54:03.283 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:02 smithi136 ceph-mon[125702]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:54:03.283 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:02 smithi136 ceph-mon[125702]: osdmap e70: 11 total, 10 up, 11 in 2023-03-02T10:54:03.284 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:02 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:03.284 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:02 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:02 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi122 2023-03-02T10:54:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:02 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 4292M 2023-03-02T10:54:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:02 smithi057 ceph-mon[92072]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2023-03-02T10:54:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:02 smithi057 ceph-mon[92072]: osdmap e70: 11 total, 10 up, 11 in 2023-03-02T10:54:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:02 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:03.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:02 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:04.006 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.005+0000 7feae9666700 1 -- 172.21.15.136:0/2071880721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feae40fed50 msgr2=0x7feae40ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:04.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.005+0000 7feae9666700 1 --2- 172.21.15.136:0/2071880721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feae40fed50 0x7feae40ff1c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fead4009990 tx=0x7fead4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:54:04.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.005+0000 7feae9666700 1 -- 172.21.15.136:0/2071880721 shutdown_connections 2023-03-02T10:54:04.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.005+0000 7feae9666700 1 --2- 172.21.15.136:0/2071880721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feae40ff700 0x7feae4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:04.007 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.005+0000 7feae9666700 1 --2- 172.21.15.136:0/2071880721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feae4100100 0x7feae4100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:04.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.005+0000 7feae9666700 1 --2- 172.21.15.136:0/2071880721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feae40fed50 0x7feae40ff1c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:04.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.005+0000 7feae9666700 1 -- 172.21.15.136:0/2071880721 >> 172.21.15.136:0/2071880721 conn(0x7feae40f98d0 msgr2=0x7feae40fbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:04.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.005+0000 7feae9666700 1 -- 172.21.15.136:0/2071880721 shutdown_connections 2023-03-02T10:54:04.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.005+0000 7feae9666700 1 -- 172.21.15.136:0/2071880721 wait complete. 2023-03-02T10:54:04.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae9666700 1 Processor -- start 2023-03-02T10:54:04.008 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae9666700 1 -- start start 2023-03-02T10:54:04.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae9666700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feae40fed50 0x7feae40fe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:04.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae9666700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feae40ff700 0x7feae419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:04.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae9666700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feae4100100 0x7feae419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:04.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae9666700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae419d4a0 con 0x7feae40ff700 2023-03-02T10:54:04.010 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae9666700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae419d610 con 0x7feae40fed50 2023-03-02T10:54:04.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae9666700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae419d7d0 con 0x7feae4100100 2023-03-02T10:54:04.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feae4100100 0x7feae419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:04.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feae4100100 0x7feae419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35442/0 (socket says 172.21.15.136:35442) 2023-03-02T10:54:04.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae37fe700 1 -- 172.21.15.136:0/348769030 learned_addr learned my addr 172.21.15.136:0/348769030 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-02T10:54:04.011 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae2ffd700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feae40fed50 0x7feae40fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:04.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.006+0000 7feae27fc700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feae40ff700 0x7feae419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:04.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.007+0000 7feae37fe700 1 -- 172.21.15.136:0/348769030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feae40fed50 msgr2=0x7feae40fe7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:04.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.007+0000 7feae37fe700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feae40fed50 0x7feae40fe7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:04.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.007+0000 7feae37fe700 1 -- 172.21.15.136:0/348769030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feae40ff700 msgr2=0x7feae419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:04.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.007+0000 7feae37fe700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feae40ff700 0x7feae419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:04.012 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.007+0000 7feae37fe700 1 -- 172.21.15.136:0/348769030 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead40095f0 con 0x7feae4100100 2023-03-02T10:54:04.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.007+0000 7feae37fe700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feae4100100 0x7feae419ccd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feadc007ee0 tx=0x7feadc00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:04.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.007+0000 7feacbfff700 1 -- 172.21.15.136:0/348769030 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc017070 con 0x7feae4100100 2023-03-02T10:54:04.013 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.007+0000 7feacbfff700 1 -- 172.21.15.136:0/348769030 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feadc00f040 con 0x7feae4100100 2023-03-02T10:54:04.014 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.007+0000 7feae9666700 1 -- 172.21.15.136:0/348769030 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae410a4d0 con 0x7feae4100100 2023-03-02T10:54:04.014 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.007+0000 7feacbfff700 1 -- 172.21.15.136:0/348769030 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc005580 con 0x7feae4100100 2023-03-02T10:54:04.014 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.007+0000 7feae9666700 1 -- 172.21.15.136:0/348769030 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae410a340 con 0x7feae4100100 2023-03-02T10:54:04.014 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.008+0000 7feae9666700 1 -- 172.21.15.136:0/348769030 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae4105a00 con 0x7feae4100100 2023-03-02T10:54:04.015 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.009+0000 7feacbfff700 1 -- 172.21.15.136:0/348769030 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7feadc004c40 con 0x7feae4100100 2023-03-02T10:54:04.016 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.009+0000 7feacbfff700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7feacc09b420 0x7feacc09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:04.016 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.010+0000 7feacbfff700 1 -- 172.21.15.136:0/348769030 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6723+0+0 (secure 0 0 0) 0x7feadc0c4110 con 0x7feae4100100 2023-03-02T10:54:04.016 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.010+0000 7feae2ffd700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7feacc09b420 0x7feacc09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:04.016 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.010+0000 7feae2ffd700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7feacc09b420 0x7feacc09d8d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feae4068420 tx=0x7fead800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:04.017 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.014+0000 7feacbfff700 1 -- 172.21.15.136:0/348769030 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7feadc0900b0 con 0x7feae4100100 2023-03-02T10:54:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:03 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:54:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:03 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:54:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:03 smithi136 ceph-mon[125702]: osd.10 [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576] boot 2023-03-02T10:54:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:03 smithi136 ceph-mon[125702]: osdmap e71: 11 total, 11 up, 11 in 2023-03-02T10:54:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:03 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:03 smithi136 ceph-mon[125702]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:54:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:03 smithi136 ceph-mon[125702]: osdmap e72: 11 total, 11 up, 11 in 2023-03-02T10:54:04.204 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:04.203+0000 7feae9666700 1 -- 172.21.15.136:0/348769030 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7feae4061750 con 0x7feacc09b420 2023-03-02T10:54:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:03 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:54:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:03 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:54:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:03 smithi057 ceph-mon[92072]: osd.10 [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576] boot 2023-03-02T10:54:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:03 smithi057 ceph-mon[92072]: osdmap e71: 11 total, 11 up, 11 in 2023-03-02T10:54:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:03 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:03 smithi057 ceph-mon[92072]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:54:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:03 smithi057 ceph-mon[92072]: osdmap e72: 11 total, 11 up, 11 in 2023-03-02T10:54:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:03 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:54:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:03 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:54:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:03 smithi122 ceph-mon[125440]: osd.10 [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576] boot 2023-03-02T10:54:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:03 smithi122 ceph-mon[125440]: osdmap e71: 11 total, 11 up, 11 in 2023-03-02T10:54:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:03 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:54:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:03 smithi122 ceph-mon[125440]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-03-02T10:54:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:03 smithi122 ceph-mon[125440]: osdmap e72: 11 total, 11 up, 11 in 2023-03-02T10:54:05.269 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:04 smithi136 ceph-mon[125702]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:54:05.270 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:54:05.270 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:54:05.270 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:05.270 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:04 smithi136 ceph-mon[125702]: osdmap e73: 11 total, 11 up, 11 in 2023-03-02T10:54:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:04 smithi057 ceph-mon[92072]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:54:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:54:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:54:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:04 smithi057 ceph-mon[92072]: osdmap e73: 11 total, 11 up, 11 in 2023-03-02T10:54:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:04 smithi122 ceph-mon[125440]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:54:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-02T10:54:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-02T10:54:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:04 smithi122 ceph-mon[125440]: osdmap e73: 11 total, 11 up, 11 in 2023-03-02T10:54:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:06 smithi136 ceph-mon[125702]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:06 smithi136 ceph-mon[125702]: osdmap e74: 11 total, 11 up, 11 in 2023-03-02T10:54:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:06 smithi057 ceph-mon[92072]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:06 smithi057 ceph-mon[92072]: osdmap e74: 11 total, 11 up, 11 in 2023-03-02T10:54:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:06 smithi122 ceph-mon[125440]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 65 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:06 smithi122 ceph-mon[125440]: osdmap e74: 11 total, 11 up, 11 in 2023-03-02T10:54:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:07 smithi136 ceph-mon[125702]: osdmap e75: 11 total, 11 up, 11 in 2023-03-02T10:54:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:07 smithi136 ceph-mon[125702]: from='client.? 172.21.15.136:0/3999078626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a0e8a36-2be5-40ea-945a-289748a2cfdb"}]: dispatch 2023-03-02T10:54:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:07 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a0e8a36-2be5-40ea-945a-289748a2cfdb"}]: dispatch 2023-03-02T10:54:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:07 smithi136 ceph-mon[125702]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a0e8a36-2be5-40ea-945a-289748a2cfdb"}]': finished 2023-03-02T10:54:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:07 smithi136 ceph-mon[125702]: osdmap e76: 12 total, 11 up, 12 in 2023-03-02T10:54:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:07 smithi136 ceph-mon[125702]: from='client.? 172.21.15.136:0/819246282' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:54:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:07 smithi057 ceph-mon[92072]: osdmap e75: 11 total, 11 up, 11 in 2023-03-02T10:54:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:07 smithi057 ceph-mon[92072]: from='client.? 172.21.15.136:0/3999078626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a0e8a36-2be5-40ea-945a-289748a2cfdb"}]: dispatch 2023-03-02T10:54:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:07 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a0e8a36-2be5-40ea-945a-289748a2cfdb"}]: dispatch 2023-03-02T10:54:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:07 smithi057 ceph-mon[92072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a0e8a36-2be5-40ea-945a-289748a2cfdb"}]': finished 2023-03-02T10:54:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:07 smithi057 ceph-mon[92072]: osdmap e76: 12 total, 11 up, 12 in 2023-03-02T10:54:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:07 smithi057 ceph-mon[92072]: from='client.? 172.21.15.136:0/819246282' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:54:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:07 smithi122 ceph-mon[125440]: osdmap e75: 11 total, 11 up, 11 in 2023-03-02T10:54:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:07 smithi122 ceph-mon[125440]: from='client.? 172.21.15.136:0/3999078626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a0e8a36-2be5-40ea-945a-289748a2cfdb"}]: dispatch 2023-03-02T10:54:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:07 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a0e8a36-2be5-40ea-945a-289748a2cfdb"}]: dispatch 2023-03-02T10:54:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:07 smithi122 ceph-mon[125440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a0e8a36-2be5-40ea-945a-289748a2cfdb"}]': finished 2023-03-02T10:54:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:07 smithi122 ceph-mon[125440]: osdmap e76: 12 total, 11 up, 12 in 2023-03-02T10:54:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:07.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:07 smithi122 ceph-mon[125440]: from='client.? 172.21.15.136:0/819246282' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-02T10:54:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:08 smithi136 ceph-mon[125702]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-03-02T10:54:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:08 smithi057 ceph-mon[92072]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-03-02T10:54:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:08 smithi122 ceph-mon[125440]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 66 MiB used, 983 GiB / 983 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-03-02T10:54:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:10 smithi136 ceph-mon[125702]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-03-02T10:54:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:10 smithi057 ceph-mon[92072]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-03-02T10:54:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:10 smithi122 ceph-mon[125440]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-03-02T10:54:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:12 smithi136 ceph-mon[125702]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-02T10:54:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:12 smithi057 ceph-mon[92072]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-02T10:54:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:12 smithi122 ceph-mon[125440]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-02T10:54:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:13 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-03-02T10:54:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:13 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:13 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-03-02T10:54:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:13 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:13 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-03-02T10:54:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:13 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:14.535 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:14 smithi136 ceph-mon[125702]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:54:14.535 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:14 smithi136 ceph-mon[125702]: Deploying daemon osd.11 on smithi136 2023-03-02T10:54:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:14 smithi057 ceph-mon[92072]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:54:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:14 smithi057 ceph-mon[92072]: Deploying daemon osd.11 on smithi136 2023-03-02T10:54:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:14 smithi122 ceph-mon[125440]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-02T10:54:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:14 smithi122 ceph-mon[125440]: Deploying daemon osd.11 on smithi136 2023-03-02T10:54:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:16 smithi136 ceph-mon[125702]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:16 smithi057 ceph-mon[92072]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:16 smithi122 ceph-mon[125440]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:18 smithi136 ceph-mon[125702]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:18 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:18 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:18 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:18 smithi057 ceph-mon[92072]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:18 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:18 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:18 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:18 smithi122 ceph-mon[125440]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:18 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:18 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:18 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:20.392 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 11 on host 'smithi136' 2023-03-02T10:54:20.392 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.390+0000 7feacbfff700 1 -- 172.21.15.136:0/348769030 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7feae4061750 con 0x7feacc09b420 2023-03-02T10:54:20.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 -- 172.21.15.136:0/348769030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7feacc09b420 msgr2=0x7feacc09d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:20.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7feacc09b420 0x7feacc09d8d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feae4068420 tx=0x7fead800b410 comp rx=0 tx=0).stop 2023-03-02T10:54:20.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 -- 172.21.15.136:0/348769030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feae4100100 msgr2=0x7feae419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:20.394 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feae4100100 0x7feae419ccd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feadc007ee0 tx=0x7feadc00d3b0 comp rx=0 tx=0).stop 2023-03-02T10:54:20.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 -- 172.21.15.136:0/348769030 shutdown_connections 2023-03-02T10:54:20.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7feacc09b420 0x7feacc09d8d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:20.395 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feae4100100 0x7feae419ccd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:20.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feae40fed50 0x7feae40fe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:20.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 --2- 172.21.15.136:0/348769030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feae40ff700 0x7feae419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:20.397 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 -- 172.21.15.136:0/348769030 >> 172.21.15.136:0/348769030 conn(0x7feae40f98d0 msgr2=0x7feae40fba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:20.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 -- 172.21.15.136:0/348769030 shutdown_connections 2023-03-02T10:54:20.398 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:20.392+0000 7feae9666700 1 -- 172.21.15.136:0/348769030 wait complete. 2023-03-02T10:54:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:20 smithi136 ceph-mon[125702]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:20 smithi057 ceph-mon[92072]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:20 smithi122 ceph-mon[125440]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:20.832 DEBUG:teuthology.orchestra.run.smithi136:osd.11> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@osd.11.service 2023-03-02T10:54:20.834 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-03-02T10:54:20.834 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd stat -f json 2023-03-02T10:54:20.863 INFO:journalctl@ceph.osd.11.smithi136.stdout:-- Logs begin at Thu 2023-03-02 10:22:36 UTC. -- 2023-03-02T10:54:21.579 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:54:21.656 INFO:journalctl@ceph.osd.11.smithi136.stdout:Mar 02 10:54:21 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-11[147929]: 2023-03-02T10:54:21.507+0000 7f33b8ae45c0 -1 osd.11 0 log_to_monitors true 2023-03-02T10:54:21.657 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:21 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.657 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:21 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.657 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:21 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:21.657 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:21 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:21.657 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:21 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.657 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:21 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:21 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:21 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:21 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:21 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:21 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:21 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:21 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:21 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:21 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:21 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:21 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:21 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:21 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:21 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:21 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:21 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:21 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:21 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:22 smithi057 ceph-mon[92072]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:22 smithi057 ceph-mon[92072]: from='osd.11 [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-02T10:54:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:22 smithi057 ceph-mon[92072]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-02T10:54:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:22 smithi122 ceph-mon[125440]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:22 smithi122 ceph-mon[125440]: from='osd.11 [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-02T10:54:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:22 smithi122 ceph-mon[125440]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-02T10:54:22.789 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:22 smithi136 ceph-mon[125702]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:22.789 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:22 smithi136 ceph-mon[125702]: from='osd.11 [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-02T10:54:22.789 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:22 smithi136 ceph-mon[125702]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-02T10:54:22.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.961+0000 7f9888317700 1 -- 172.21.15.57:0/3233479986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9880105880 msgr2=0x7f9880107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:22.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.961+0000 7f9888317700 1 --2- 172.21.15.57:0/3233479986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9880105880 0x7f9880107ce0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f987800b0a0 tx=0x7f987800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:54:22.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.961+0000 7f9888317700 1 -- 172.21.15.57:0/3233479986 shutdown_connections 2023-03-02T10:54:22.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.961+0000 7f9888317700 1 --2- 172.21.15.57:0/3233479986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9880105880 0x7f9880107ce0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:22.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.961+0000 7f9888317700 1 --2- 172.21.15.57:0/3233479986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9880100640 0x7f9880102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:22.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.961+0000 7f9888317700 1 --2- 172.21.15.57:0/3233479986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880102f60 0x7f9880105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:22.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.961+0000 7f9888317700 1 -- 172.21.15.57:0/3233479986 >> 172.21.15.57:0/3233479986 conn(0x7f98800fa0a0 msgr2=0x7f98800fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:22.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.961+0000 7f9888317700 1 -- 172.21.15.57:0/3233479986 shutdown_connections 2023-03-02T10:54:22.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.961+0000 7f9888317700 1 -- 172.21.15.57:0/3233479986 wait complete. 2023-03-02T10:54:22.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f9888317700 1 Processor -- start 2023-03-02T10:54:22.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f9888317700 1 -- start start 2023-03-02T10:54:22.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f9888317700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880100640 0x7f9880195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:22.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f9888317700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9880102f60 0x7f9880195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:22.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f9888317700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9880105880 0x7f988019cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:22.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f9888317700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988019d590 con 0x7f9880102f60 2023-03-02T10:54:22.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f9888317700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988019d6d0 con 0x7f9880105880 2023-03-02T10:54:22.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f9888317700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988019d860 con 0x7f9880100640 2023-03-02T10:54:22.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f98858b2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9880102f60 0x7f9880195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:22.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f98858b2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9880102f60 0x7f9880195f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46774/0 (socket says 172.21.15.57:46774) 2023-03-02T10:54:22.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f98858b2700 1 -- 172.21.15.57:0/2933259873 learned_addr learned my addr 172.21.15.57:0/2933259873 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:22.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.962+0000 7f98860b3700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880100640 0x7f9880195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98868b4700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9880105880 0x7f988019cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98858b2700 1 -- 172.21.15.57:0/2933259873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880100640 msgr2=0x7f9880195a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98858b2700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880100640 0x7f9880195a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98858b2700 1 -- 172.21.15.57:0/2933259873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9880105880 msgr2=0x7f988019cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98858b2700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9880105880 0x7f988019cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98858b2700 1 -- 172.21.15.57:0/2933259873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9878009d00 con 0x7f9880102f60 2023-03-02T10:54:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98860b3700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880100640 0x7f9880195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:54:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98868b4700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9880105880 0x7f988019cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:54:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98858b2700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9880102f60 0x7f9880195f50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f987000e9c0 tx=0x7f987000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98777fe700 1 -- 172.21.15.57:0/2933259873 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98700097b0 con 0x7f9880102f60 2023-03-02T10:54:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f9888317700 1 -- 172.21.15.57:0/2933259873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988010b530 con 0x7f9880102f60 2023-03-02T10:54:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98777fe700 1 -- 172.21.15.57:0/2933259873 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9870004cf0 con 0x7f9880102f60 2023-03-02T10:54:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f98777fe700 1 -- 172.21.15.57:0/2933259873 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870005700 con 0x7f9880102f60 2023-03-02T10:54:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.963+0000 7f9888317700 1 -- 172.21.15.57:0/2933259873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988010b3a0 con 0x7f9880102f60 2023-03-02T10:54:22.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.964+0000 7f9888317700 1 -- 172.21.15.57:0/2933259873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98800fbc10 con 0x7f9880102f60 2023-03-02T10:54:22.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.967+0000 7f98777fe700 1 -- 172.21.15.57:0/2933259873 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f987001e020 con 0x7f9880102f60 2023-03-02T10:54:22.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.968+0000 7f98777fe700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f986c09b3a0 0x7f986c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:22.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.968+0000 7f98777fe700 1 -- 172.21.15.57:0/2933259873 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f9870014070 con 0x7f9880102f60 2023-03-02T10:54:22.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.968+0000 7f98860b3700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f986c09b3a0 0x7f986c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:22.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.968+0000 7f98860b3700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f986c09b3a0 0x7f986c09d850 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f987c005fd0 tx=0x7f987c005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:22.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:22.971+0000 7f98777fe700 1 -- 172.21.15.57:0/2933259873 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f9870090df0 con 0x7f9880102f60 2023-03-02T10:54:23.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.173+0000 7f9888317700 1 -- 172.21.15.57:0/2933259873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f98800611a0 con 0x7f9880102f60 2023-03-02T10:54:23.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.173+0000 7f98777fe700 1 -- 172.21.15.57:0/2933259873 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) v1 ==== 74+0+133 (secure 0 0 0) 0x7f9870094410 con 0x7f9880102f60 2023-03-02T10:54:23.175 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:23.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.175+0000 7f9888317700 1 -- 172.21.15.57:0/2933259873 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f986c09b3a0 msgr2=0x7f986c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:23.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.175+0000 7f9888317700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f986c09b3a0 0x7f986c09d850 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f987c005fd0 tx=0x7f987c005f60 comp rx=0 tx=0).stop 2023-03-02T10:54:23.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.175+0000 7f9888317700 1 -- 172.21.15.57:0/2933259873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9880102f60 msgr2=0x7f9880195f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:23.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.175+0000 7f9888317700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9880102f60 0x7f9880195f50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f987000e9c0 tx=0x7f987000ed80 comp rx=0 tx=0).stop 2023-03-02T10:54:23.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.175+0000 7f9888317700 1 -- 172.21.15.57:0/2933259873 shutdown_connections 2023-03-02T10:54:23.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.175+0000 7f9888317700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f986c09b3a0 0x7f986c09d850 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:23.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.175+0000 7f9888317700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9880105880 0x7f988019cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:23.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.175+0000 7f9888317700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880100640 0x7f9880195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:23.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.175+0000 7f9888317700 1 --2- 172.21.15.57:0/2933259873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9880102f60 0x7f9880195f50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:23.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.176+0000 7f9888317700 1 -- 172.21.15.57:0/2933259873 >> 172.21.15.57:0/2933259873 conn(0x7f98800fa0a0 msgr2=0x7f9880101280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:23.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.176+0000 7f9888317700 1 -- 172.21.15.57:0/2933259873 shutdown_connections 2023-03-02T10:54:23.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:23.176+0000 7f9888317700 1 -- 172.21.15.57:0/2933259873 wait complete. 2023-03-02T10:54:23.678 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-03-02T10:54:23.678 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: osdmap e77: 12 total, 11 up, 12 in 2023-03-02T10:54:23.678 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:23.678 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='osd.11 [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:54:23.679 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:54:23.679 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.679 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.679 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.679 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.679 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.679 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.679 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.680 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:23.680 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:23.680 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.680 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:23 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2933259873' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-03-02T10:54:23.681 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":77,"num_osds":12,"num_up_osds":11,"osd_up_since":1677754442,"num_in_osds":12,"osd_in_since":1677754446,"num_remapped_pgs":0} 2023-03-02T10:54:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-03-02T10:54:23.750 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: osdmap e77: 12 total, 11 up, 12 in 2023-03-02T10:54:23.750 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:23.751 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='osd.11 [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:54:23.751 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:54:23.751 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.752 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.752 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.752 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.752 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.752 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.752 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.753 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:23.753 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:23.753 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.753 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:23 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2933259873' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-03-02T10:54:23.840 INFO:journalctl@ceph.osd.11.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-11[147929]: 2023-03-02T10:54:23.411+0000 7f33aca69700 -1 osd.11 0 waiting for initial osdmap 2023-03-02T10:54:23.841 INFO:journalctl@ceph.osd.11.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-11[147929]: 2023-03-02T10:54:23.431+0000 7f33a5858700 -1 osd.11 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-02T10:54:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-03-02T10:54:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: osdmap e77: 12 total, 11 up, 12 in 2023-03-02T10:54:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='osd.11 [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:54:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2023-03-02T10:54:23.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:54:23.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:23.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:23.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:23.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:23 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2933259873' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-03-02T10:54:24.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd stat -f json 2023-03-02T10:54:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:24 smithi057 ceph-mon[92072]: Detected new or changed devices on smithi136 2023-03-02T10:54:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:24 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 4292M 2023-03-02T10:54:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:24 smithi057 ceph-mon[92072]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:24 smithi057 ceph-mon[92072]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:54:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:24 smithi057 ceph-mon[92072]: osdmap e78: 12 total, 11 up, 12 in 2023-03-02T10:54:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:24 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:24 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:24 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:24 smithi122 ceph-mon[125440]: Detected new or changed devices on smithi136 2023-03-02T10:54:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:24 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 4292M 2023-03-02T10:54:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:24 smithi122 ceph-mon[125440]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:24 smithi122 ceph-mon[125440]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:54:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:24 smithi122 ceph-mon[125440]: osdmap e78: 12 total, 11 up, 12 in 2023-03-02T10:54:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:24 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:24 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:24 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:24 smithi136 ceph-mon[125702]: Detected new or changed devices on smithi136 2023-03-02T10:54:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:24 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 4292M 2023-03-02T10:54:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:24 smithi136 ceph-mon[125702]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:24 smithi136 ceph-mon[125702]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2023-03-02T10:54:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:24 smithi136 ceph-mon[125702]: osdmap e78: 12 total, 11 up, 12 in 2023-03-02T10:54:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:24 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:24 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:24 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:25.427 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:54:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:25 smithi057 ceph-mon[92072]: purged_snaps scrub starts 2023-03-02T10:54:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:25 smithi057 ceph-mon[92072]: purged_snaps scrub ok 2023-03-02T10:54:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:25 smithi057 ceph-mon[92072]: osd.11 [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859] boot 2023-03-02T10:54:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:25 smithi057 ceph-mon[92072]: osdmap e79: 12 total, 12 up, 12 in 2023-03-02T10:54:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:25 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:25 smithi122 ceph-mon[125440]: purged_snaps scrub starts 2023-03-02T10:54:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:25 smithi122 ceph-mon[125440]: purged_snaps scrub ok 2023-03-02T10:54:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:25 smithi122 ceph-mon[125440]: osd.11 [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859] boot 2023-03-02T10:54:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:25 smithi122 ceph-mon[125440]: osdmap e79: 12 total, 12 up, 12 in 2023-03-02T10:54:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:25 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:25 smithi136 ceph-mon[125702]: purged_snaps scrub starts 2023-03-02T10:54:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:25 smithi136 ceph-mon[125702]: purged_snaps scrub ok 2023-03-02T10:54:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:25 smithi136 ceph-mon[125702]: osd.11 [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859] boot 2023-03-02T10:54:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:25 smithi136 ceph-mon[125702]: osdmap e79: 12 total, 12 up, 12 in 2023-03-02T10:54:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:25 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:54:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:26 smithi057 ceph-mon[92072]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:26 smithi057 ceph-mon[92072]: osdmap e80: 12 total, 12 up, 12 in 2023-03-02T10:54:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:26 smithi122 ceph-mon[125440]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:26 smithi122 ceph-mon[125440]: osdmap e80: 12 total, 12 up, 12 in 2023-03-02T10:54:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:26 smithi136 ceph-mon[125702]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-02T10:54:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:26 smithi136 ceph-mon[125702]: osdmap e80: 12 total, 12 up, 12 in 2023-03-02T10:54:26.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.902+0000 7f92ee918700 1 -- 172.21.15.57:0/1404908450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e81058e0 msgr2=0x7f92e8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:26.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.902+0000 7f92ee918700 1 --2- 172.21.15.57:0/1404908450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e81058e0 0x7f92e8107ce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f92e000b0a0 tx=0x7f92e000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:54:26.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.902+0000 7f92ee918700 1 -- 172.21.15.57:0/1404908450 shutdown_connections 2023-03-02T10:54:26.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.902+0000 7f92ee918700 1 --2- 172.21.15.57:0/1404908450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e81058e0 0x7f92e8107ce0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.902+0000 7f92ee918700 1 --2- 172.21.15.57:0/1404908450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92e81006a0 0x7f92e8102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.902+0000 7f92ee918700 1 --2- 172.21.15.57:0/1404908450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8102fc0 0x7f92e81053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.902+0000 7f92ee918700 1 -- 172.21.15.57:0/1404908450 >> 172.21.15.57:0/1404908450 conn(0x7f92e80fa0a0 msgr2=0x7f92e80fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.902+0000 7f92ee918700 1 -- 172.21.15.57:0/1404908450 shutdown_connections 2023-03-02T10:54:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.902+0000 7f92ee918700 1 -- 172.21.15.57:0/1404908450 wait complete. 2023-03-02T10:54:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92ee918700 1 Processor -- start 2023-03-02T10:54:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92ee918700 1 -- start start 2023-03-02T10:54:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92ee918700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92e81006a0 0x7f92e8195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92ee918700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e8102fc0 0x7f92e8195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92ee918700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e81058e0 0x7f92e819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92ee918700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e819d500 con 0x7f92e8102fc0 2023-03-02T10:54:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92ee918700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e819d640 con 0x7f92e81006a0 2023-03-02T10:54:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92ee918700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e819d7d0 con 0x7f92e81058e0 2023-03-02T10:54:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92e77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e8102fc0 0x7f92e8195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92e77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e8102fc0 0x7f92e8195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55108/0 (socket says 172.21.15.57:55108) 2023-03-02T10:54:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92e77fe700 1 -- 172.21.15.57:0/3661709129 learned_addr learned my addr 172.21.15.57:0/3661709129 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92e7fff700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92e81006a0 0x7f92e8195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92eceb5700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e81058e0 0x7f92e819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92e77fe700 1 -- 172.21.15.57:0/3661709129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e81058e0 msgr2=0x7f92e819cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:26.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92e77fe700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e81058e0 0x7f92e819cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:26.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92e77fe700 1 -- 172.21.15.57:0/3661709129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92e81006a0 msgr2=0x7f92e8195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:26.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92e77fe700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92e81006a0 0x7f92e8195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:26.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.903+0000 7f92e77fe700 1 -- 172.21.15.57:0/3661709129 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e0009d00 con 0x7f92e8102fc0 2023-03-02T10:54:26.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.904+0000 7f92e77fe700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e8102fc0 0x7f92e8195ec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00c9b0 tx=0x7f92dc00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:26.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.904+0000 7f92e57fa700 1 -- 172.21.15.57:0/3661709129 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc007b00 con 0x7f92e8102fc0 2023-03-02T10:54:26.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.904+0000 7f92e57fa700 1 -- 172.21.15.57:0/3661709129 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92dc007c60 con 0x7f92e8102fc0 2023-03-02T10:54:26.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.904+0000 7f92e57fa700 1 -- 172.21.15.57:0/3661709129 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc018660 con 0x7f92e8102fc0 2023-03-02T10:54:26.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.904+0000 7f92ee918700 1 -- 172.21.15.57:0/3661709129 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e810b550 con 0x7f92e8102fc0 2023-03-02T10:54:26.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.904+0000 7f92ee918700 1 -- 172.21.15.57:0/3661709129 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e810b3c0 con 0x7f92e8102fc0 2023-03-02T10:54:26.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.905+0000 7f92ee918700 1 -- 172.21.15.57:0/3661709129 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e80fbc10 con 0x7f92e8102fc0 2023-03-02T10:54:26.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.906+0000 7f92e57fa700 1 -- 172.21.15.57:0/3661709129 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f92dc00f450 con 0x7f92e8102fc0 2023-03-02T10:54:26.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.907+0000 7f92e57fa700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f92d009b420 0x7f92d009d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:26.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.907+0000 7f92e57fa700 1 -- 172.21.15.57:0/3661709129 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f92dc0c4c10 con 0x7f92e8102fc0 2023-03-02T10:54:26.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.907+0000 7f92e7fff700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f92d009b420 0x7f92d009d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:26.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.908+0000 7f92e7fff700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f92d009b420 0x7f92d009d8d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92d8005950 tx=0x7f92d800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:26.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:26.911+0000 7f92e57fa700 1 -- 172.21.15.57:0/3661709129 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f92dc090930 con 0x7f92e8102fc0 2023-03-02T10:54:27.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.109+0000 7f92ee918700 1 -- 172.21.15.57:0/3661709129 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f92e80613a0 con 0x7f92e8102fc0 2023-03-02T10:54:27.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.109+0000 7f92e57fa700 1 -- 172.21.15.57:0/3661709129 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7f92dc093f50 con 0x7f92e8102fc0 2023-03-02T10:54:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:27.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.111+0000 7f92ee918700 1 -- 172.21.15.57:0/3661709129 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f92d009b420 msgr2=0x7f92d009d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:27.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.111+0000 7f92ee918700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f92d009b420 0x7f92d009d8d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92d8005950 tx=0x7f92d800b410 comp rx=0 tx=0).stop 2023-03-02T10:54:27.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.111+0000 7f92ee918700 1 -- 172.21.15.57:0/3661709129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e8102fc0 msgr2=0x7f92e8195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:27.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.111+0000 7f92ee918700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e8102fc0 0x7f92e8195ec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00c9b0 tx=0x7f92dc00ccc0 comp rx=0 tx=0).stop 2023-03-02T10:54:27.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.111+0000 7f92ee918700 1 -- 172.21.15.57:0/3661709129 shutdown_connections 2023-03-02T10:54:27.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.111+0000 7f92ee918700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f92d009b420 0x7f92d009d8d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:27.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.111+0000 7f92ee918700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e81058e0 0x7f92e819cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:27.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.111+0000 7f92ee918700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92e81006a0 0x7f92e8195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:27.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.111+0000 7f92ee918700 1 --2- 172.21.15.57:0/3661709129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e8102fc0 0x7f92e8195ec0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:27.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.111+0000 7f92ee918700 1 -- 172.21.15.57:0/3661709129 >> 172.21.15.57:0/3661709129 conn(0x7f92e80fa0a0 msgr2=0x7f92e81012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:27.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.112+0000 7f92ee918700 1 -- 172.21.15.57:0/3661709129 shutdown_connections 2023-03-02T10:54:27.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:27.112+0000 7f92ee918700 1 -- 172.21.15.57:0/3661709129 wait complete. 2023-03-02T10:54:27.634 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1677754464,"num_in_osds":12,"osd_in_since":1677754446,"num_remapped_pgs":0} 2023-03-02T10:54:27.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd dump --format=json 2023-03-02T10:54:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:27 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3661709129' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-03-02T10:54:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:27 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3661709129' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-03-02T10:54:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:27 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3661709129' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-03-02T10:54:28.372 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:54:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:28 smithi122 ceph-mon[125440]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:28.712 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:28 smithi057 ceph-mon[92072]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:28 smithi136 ceph-mon[125702]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.660+0000 7f3d604aa700 1 -- 172.21.15.57:0/1033128605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d5810c460 msgr2=0x7f3d5810e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.660+0000 7f3d604aa700 1 --2- 172.21.15.57:0/1033128605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d5810c460 0x7f3d5810e840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000b0a0 tx=0x7f3d5000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:54:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.660+0000 7f3d604aa700 1 -- 172.21.15.57:0/1033128605 shutdown_connections 2023-03-02T10:54:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.660+0000 7f3d604aa700 1 --2- 172.21.15.57:0/1033128605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d5810c460 0x7f3d5810e840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.660+0000 7f3d604aa700 1 --2- 172.21.15.57:0/1033128605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d580728d0 0x7f3d58072ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.660+0000 7f3d604aa700 1 --2- 172.21.15.57:0/1033128605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d580731e0 0x7f3d5810bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.660+0000 7f3d604aa700 1 -- 172.21.15.57:0/1033128605 >> 172.21.15.57:0/1033128605 conn(0x7f3d580fb6a0 msgr2=0x7f3d580fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.660+0000 7f3d604aa700 1 -- 172.21.15.57:0/1033128605 shutdown_connections 2023-03-02T10:54:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.660+0000 7f3d604aa700 1 -- 172.21.15.57:0/1033128605 wait complete. 2023-03-02T10:54:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d604aa700 1 Processor -- start 2023-03-02T10:54:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d604aa700 1 -- start start 2023-03-02T10:54:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d604aa700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d580728d0 0x7f3d58197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d604aa700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d580731e0 0x7f3d58198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d604aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d5810c460 0x7f3d5819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d604aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5819cfd0 con 0x7f3d5810c460 2023-03-02T10:54:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d604aa700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5819d140 con 0x7f3d580731e0 2023-03-02T10:54:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d604aa700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5819d300 con 0x7f3d580728d0 2023-03-02T10:54:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d5ea47700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d5810c460 0x7f3d5819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:29.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d5da45700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d580731e0 0x7f3d58198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:29.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d5ea47700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d5810c460 0x7f3d5819c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55132/0 (socket says 172.21.15.57:55132) 2023-03-02T10:54:29.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d5ea47700 1 -- 172.21.15.57:0/4163368584 learned_addr learned my addr 172.21.15.57:0/4163368584 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:29.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d5da45700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d580731e0 0x7f3d58198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:57788/0 (socket says 172.21.15.57:57788) 2023-03-02T10:54:29.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.661+0000 7f3d5e246700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d580728d0 0x7f3d58197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:29.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.662+0000 7f3d5ea47700 1 -- 172.21.15.57:0/4163368584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d580728d0 msgr2=0x7f3d58197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:29.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.662+0000 7f3d5ea47700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d580728d0 0x7f3d58197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:29.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.662+0000 7f3d5ea47700 1 -- 172.21.15.57:0/4163368584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d580731e0 msgr2=0x7f3d58198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:29.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.662+0000 7f3d5ea47700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d580731e0 0x7f3d58198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:29.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.662+0000 7f3d5ea47700 1 -- 172.21.15.57:0/4163368584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d50009d00 con 0x7f3d5810c460 2023-03-02T10:54:29.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.662+0000 7f3d5ea47700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d5810c460 0x7f3d5819c990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3d500079b0 tx=0x7f3d500079e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:29.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.662+0000 7f3d4f7fe700 1 -- 172.21.15.57:0/4163368584 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000e040 con 0x7f3d5810c460 2023-03-02T10:54:29.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.662+0000 7f3d604aa700 1 -- 172.21.15.57:0/4163368584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d58111df0 con 0x7f3d5810c460 2023-03-02T10:54:29.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.662+0000 7f3d4f7fe700 1 -- 172.21.15.57:0/4163368584 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d50006080 con 0x7f3d5810c460 2023-03-02T10:54:29.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.662+0000 7f3d4f7fe700 1 -- 172.21.15.57:0/4163368584 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5001b8f0 con 0x7f3d5810c460 2023-03-02T10:54:29.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.662+0000 7f3d604aa700 1 -- 172.21.15.57:0/4163368584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d58111c60 con 0x7f3d5810c460 2023-03-02T10:54:29.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.663+0000 7f3d604aa700 1 -- 172.21.15.57:0/4163368584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d58111f80 con 0x7f3d5810c460 2023-03-02T10:54:29.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.665+0000 7f3d4f7fe700 1 -- 172.21.15.57:0/4163368584 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f3d5001ba50 con 0x7f3d5810c460 2023-03-02T10:54:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.665+0000 7f3d4f7fe700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4409b420 0x7f3d4409d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.665+0000 7f3d4f7fe700 1 -- 172.21.15.57:0/4163368584 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3d500c7120 con 0x7f3d5810c460 2023-03-02T10:54:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.666+0000 7f3d5e246700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4409b420 0x7f3d4409d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.666+0000 7f3d5e246700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4409b420 0x7f3d4409d8d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d54005950 tx=0x7f3d5400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.668+0000 7f3d4f7fe700 1 -- 172.21.15.57:0/4163368584 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f3d50092ed0 con 0x7f3d5810c460 2023-03-02T10:54:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:29 smithi122 ceph-mon[125440]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:29 smithi136 ceph-mon[125702]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:29.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.865+0000 7f3d604aa700 1 -- 172.21.15.57:0/4163368584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d58199340 con 0x7f3d5810c460 2023-03-02T10:54:29.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.866+0000 7f3d4f7fe700 1 -- 172.21.15.57:0/4163368584 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18425 (secure 0 0 0) 0x7f3d500964f0 con 0x7f3d5810c460 2023-03-02T10:54:29.867 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:29.867 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":80,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:54:25.424612+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:54:29.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 -- 172.21.15.57:0/4163368584 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4409b420 msgr2=0x7f3d4409d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:29.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4409b420 0x7f3d4409d8d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d54005950 tx=0x7f3d5400b410 comp rx=0 tx=0).stop 2023-03-02T10:54:29.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 -- 172.21.15.57:0/4163368584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d5810c460 msgr2=0x7f3d5819c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:29.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d5810c460 0x7f3d5819c990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3d500079b0 tx=0x7f3d500079e0 comp rx=0 tx=0).stop 2023-03-02T10:54:29.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 -- 172.21.15.57:0/4163368584 shutdown_connections 2023-03-02T10:54:29.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4409b420 0x7f3d4409d8d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:29.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d5810c460 0x7f3d5819c990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d580728d0 0x7f3d58197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 --2- 172.21.15.57:0/4163368584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d580731e0 0x7f3d58198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 -- 172.21.15.57:0/4163368584 >> 172.21.15.57:0/4163368584 conn(0x7f3d580fb6a0 msgr2=0x7f3d58103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 -- 172.21.15.57:0/4163368584 shutdown_connections 2023-03-02T10:54:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:29.868+0000 7f3d604aa700 1 -- 172.21.15.57:0/4163368584 wait complete. 2023-03-02T10:54:29.887 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:29 smithi057 ceph-mon[92072]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:30.373 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-02T10:51:03.600226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-02T10:54:30.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd pool get .mgr pg_num 2023-03-02T10:54:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:30 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/4163368584' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:54:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:30 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/4163368584' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:54:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:30 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/4163368584' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:54:31.105 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:54:31.605 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:31 smithi057 ceph-mon[92072]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:31 smithi136 ceph-mon[125702]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:31 smithi122 ceph-mon[125440]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.396+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2291376464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a80ff490 msgr2=0x7fe7a810b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.396+0000 7fe7ae9c9700 1 --2- 172.21.15.57:0/2291376464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a80ff490 0x7fe7a810b920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000b0a0 tx=0x7fe7a000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:54:32.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.396+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2291376464 shutdown_connections 2023-03-02T10:54:32.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.396+0000 7fe7ae9c9700 1 --2- 172.21.15.57:0/2291376464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a80ff490 0x7fe7a810b920 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:32.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.396+0000 7fe7ae9c9700 1 --2- 172.21.15.57:0/2291376464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a8104af0 0x7fe7a8104ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:32.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.396+0000 7fe7ae9c9700 1 --2- 172.21.15.57:0/2291376464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7a80feae0 0x7fe7a80fef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:32.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.396+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2291376464 >> 172.21.15.57:0/2291376464 conn(0x7fe7a8075c50 msgr2=0x7fe7a8076050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:32.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.396+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2291376464 shutdown_connections 2023-03-02T10:54:32.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.396+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2291376464 wait complete. 2023-03-02T10:54:32.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe7ae9c9700 1 Processor -- start 2023-03-02T10:54:32.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe7ae9c9700 1 -- start start 2023-03-02T10:54:32.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe7ae9c9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7a80feae0 0x7fe7a8195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:32.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe7ae9c9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a80ff490 0x7fe7a81962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:32.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe7ae9c9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a8104af0 0x7fe7a819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:32.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe7ae9c9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a819ad40 con 0x7fe7a80ff490 2023-03-02T10:54:32.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe7ae9c9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a819aeb0 con 0x7fe7a80feae0 2023-03-02T10:54:32.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe7ae9c9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a819b070 con 0x7fe7a8104af0 2023-03-02T10:54:32.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe79ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a80ff490 0x7fe7a81962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:32.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe79ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a80ff490 0x7fe7a81962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55150/0 (socket says 172.21.15.57:55150) 2023-03-02T10:54:32.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe79ffff700 1 -- 172.21.15.57:0/2183467158 learned_addr learned my addr 172.21.15.57:0/2183467158 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:32.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe7a7fff700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7a80feae0 0x7fe7a8195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:32.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.397+0000 7fe7acf66700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a8104af0 0x7fe7a819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:32.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.398+0000 7fe79ffff700 1 -- 172.21.15.57:0/2183467158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a8104af0 msgr2=0x7fe7a819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:32.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.398+0000 7fe79ffff700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a8104af0 0x7fe7a819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:32.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.398+0000 7fe79ffff700 1 -- 172.21.15.57:0/2183467158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7a80feae0 msgr2=0x7fe7a8195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:32.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.398+0000 7fe79ffff700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7a80feae0 0x7fe7a8195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:32.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.398+0000 7fe79ffff700 1 -- 172.21.15.57:0/2183467158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a0009d00 con 0x7fe7a80ff490 2023-03-02T10:54:32.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.398+0000 7fe79ffff700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a80ff490 0x7fe7a81962a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe79000d980 tx=0x7fe79000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:32.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.398+0000 7fe7a5ffb700 1 -- 172.21.15.57:0/2183467158 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790004220 con 0x7fe7a80ff490 2023-03-02T10:54:32.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.398+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2183467158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a810eb20 con 0x7fe7a80ff490 2023-03-02T10:54:32.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.398+0000 7fe7a5ffb700 1 -- 172.21.15.57:0/2183467158 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe790007640 con 0x7fe7a80ff490 2023-03-02T10:54:32.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.398+0000 7fe7a5ffb700 1 -- 172.21.15.57:0/2183467158 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790005690 con 0x7fe7a80ff490 2023-03-02T10:54:32.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.398+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2183467158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a810e990 con 0x7fe7a80ff490 2023-03-02T10:54:32.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.399+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2183467158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a810ecb0 con 0x7fe7a80ff490 2023-03-02T10:54:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.400+0000 7fe7a5ffb700 1 -- 172.21.15.57:0/2183467158 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fe790021070 con 0x7fe7a80ff490 2023-03-02T10:54:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.401+0000 7fe7a5ffb700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe79409b3a0 0x7fe79409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.402+0000 7fe7a5ffb700 1 -- 172.21.15.57:0/2183467158 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe7900c4bc0 con 0x7fe7a80ff490 2023-03-02T10:54:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.402+0000 7fe7a7fff700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe79409b3a0 0x7fe79409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.402+0000 7fe7a7fff700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe79409b3a0 0x7fe79409d850 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe798005950 tx=0x7fe79800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:32.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.404+0000 7fe7a5ffb700 1 -- 172.21.15.57:0/2183467158 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fe7900909d0 con 0x7fe7a80ff490 2023-03-02T10:54:32.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.599+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2183467158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7a81a2e30 con 0x7fe7a80ff490 2023-03-02T10:54:32.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.599+0000 7fe7a5ffb700 1 -- 172.21.15.57:0/2183467158 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe790016020 con 0x7fe7a80ff490 2023-03-02T10:54:32.601 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-02T10:54:32.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2183467158 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe79409b3a0 msgr2=0x7fe79409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:32.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe79409b3a0 0x7fe79409d850 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe798005950 tx=0x7fe79800b410 comp rx=0 tx=0).stop 2023-03-02T10:54:32.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2183467158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a80ff490 msgr2=0x7fe7a81962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:32.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a80ff490 0x7fe7a81962a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe79000d980 tx=0x7fe79000dc90 comp rx=0 tx=0).stop 2023-03-02T10:54:32.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2183467158 shutdown_connections 2023-03-02T10:54:32.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe79409b3a0 0x7fe79409d850 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:32.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a8104af0 0x7fe7a819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:32.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7a80feae0 0x7fe7a8195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:32.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 --2- 172.21.15.57:0/2183467158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a80ff490 0x7fe7a81962a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:32.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2183467158 >> 172.21.15.57:0/2183467158 conn(0x7fe7a8075c50 msgr2=0x7fe7a80686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:32.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2183467158 shutdown_connections 2023-03-02T10:54:32.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:32.602+0000 7fe7ae9c9700 1 -- 172.21.15.57:0/2183467158 wait complete. 2023-03-02T10:54:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:32 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2183467158' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:54:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:32 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2183467158' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:54:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:32 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2183467158' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:54:33.109 INFO:tasks.cephadm:Adding mds.a on smithi057 2023-03-02T10:54:33.110 INFO:tasks.cephadm:Adding mds.d on smithi057 2023-03-02T10:54:33.110 INFO:tasks.cephadm:Adding mds.g on smithi057 2023-03-02T10:54:33.110 INFO:tasks.cephadm:Adding mds.j on smithi057 2023-03-02T10:54:33.111 INFO:tasks.cephadm:Adding mds.b on smithi122 2023-03-02T10:54:33.111 INFO:tasks.cephadm:Adding mds.e on smithi122 2023-03-02T10:54:33.111 INFO:tasks.cephadm:Adding mds.h on smithi122 2023-03-02T10:54:33.111 INFO:tasks.cephadm:Adding mds.k on smithi122 2023-03-02T10:54:33.111 INFO:tasks.cephadm:Adding mds.c on smithi136 2023-03-02T10:54:33.111 INFO:tasks.cephadm:Adding mds.f on smithi136 2023-03-02T10:54:33.112 INFO:tasks.cephadm:Adding mds.i on smithi136 2023-03-02T10:54:33.112 INFO:tasks.cephadm:Adding mds.l on smithi136 2023-03-02T10:54:33.112 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph orch apply mds all '12;smithi057=a;smithi057=d;smithi057=g;smithi057=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l' 2023-03-02T10:54:33.763 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.c/config 2023-03-02T10:54:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:34 smithi136 ceph-mon[125702]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:34 smithi057 ceph-mon[92072]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:34 smithi122 ceph-mon[125440]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:34.938 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.936+0000 7f96dc301700 1 -- 172.21.15.136:0/2197762498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d40ff670 msgr2=0x7f96d4106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:34.938 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.936+0000 7f96dc301700 1 --2- 172.21.15.136:0/2197762498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d40ff670 0x7f96d4106f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00b0a0 tx=0x7f96cc00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:54:34.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.936+0000 7f96dc301700 1 -- 172.21.15.136:0/2197762498 shutdown_connections 2023-03-02T10:54:34.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.936+0000 7f96dc301700 1 --2- 172.21.15.136:0/2197762498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d40ff670 0x7f96d4106f20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:34.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.936+0000 7f96dc301700 1 --2- 172.21.15.136:0/2197762498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96d4100070 0x7f96d4100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:34.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.936+0000 7f96dc301700 1 --2- 172.21.15.136:0/2197762498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96d40fecc0 0x7f96d40ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:34.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.936+0000 7f96dc301700 1 -- 172.21.15.136:0/2197762498 >> 172.21.15.136:0/2197762498 conn(0x7f96d40f9820 msgr2=0x7f96d40fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:34.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.936+0000 7f96dc301700 1 -- 172.21.15.136:0/2197762498 shutdown_connections 2023-03-02T10:54:34.939 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.936+0000 7f96dc301700 1 -- 172.21.15.136:0/2197762498 wait complete. 2023-03-02T10:54:34.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96dc301700 1 Processor -- start 2023-03-02T10:54:34.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96dc301700 1 -- start start 2023-03-02T10:54:34.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96dc301700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96d40fecc0 0x7f96d40fe720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:34.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96dc301700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96d40ff670 0x7f96d419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:34.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96dc301700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d4100070 0x7f96d419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:34.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96dc301700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d419d520 con 0x7f96d40ff670 2023-03-02T10:54:34.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96dc301700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d419d690 con 0x7f96d40fecc0 2023-03-02T10:54:34.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96dc301700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d419d850 con 0x7f96d4100070 2023-03-02T10:54:34.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96da89e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d4100070 0x7f96d419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:34.942 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96da09d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96d40fecc0 0x7f96d40fe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:34.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96da09d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96d40fecc0 0x7f96d40fe720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.136:51612/0 (socket says 172.21.15.136:51612) 2023-03-02T10:54:34.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96da89e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d4100070 0x7f96d419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35568/0 (socket says 172.21.15.136:35568) 2023-03-02T10:54:34.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96da09d700 1 -- 172.21.15.136:0/1928956628 learned_addr learned my addr 172.21.15.136:0/1928956628 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-03-02T10:54:34.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.937+0000 7f96d989c700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96d40ff670 0x7f96d419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:34.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.938+0000 7f96da89e700 1 -- 172.21.15.136:0/1928956628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96d40fecc0 msgr2=0x7f96d40fe720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:34.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.938+0000 7f96da89e700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96d40fecc0 0x7f96d40fe720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:34.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.938+0000 7f96da89e700 1 -- 172.21.15.136:0/1928956628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96d40ff670 msgr2=0x7f96d419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:34.943 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.938+0000 7f96da89e700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96d40ff670 0x7f96d419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:34.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.938+0000 7f96da89e700 1 -- 172.21.15.136:0/1928956628 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc009d00 con 0x7f96d4100070 2023-03-02T10:54:34.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.938+0000 7f96da89e700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d4100070 0x7f96d419cd80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00b070 tx=0x7f96cc004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:34.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.938+0000 7f96cb7fe700 1 -- 172.21.15.136:0/1928956628 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc00e040 con 0x7f96d4100070 2023-03-02T10:54:34.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.938+0000 7f96cb7fe700 1 -- 172.21.15.136:0/1928956628 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96cc00cec0 con 0x7f96d4100070 2023-03-02T10:54:34.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.938+0000 7f96cb7fe700 1 -- 172.21.15.136:0/1928956628 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc01b970 con 0x7f96d4100070 2023-03-02T10:54:34.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.938+0000 7f96dc301700 1 -- 172.21.15.136:0/1928956628 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d410a400 con 0x7f96d4100070 2023-03-02T10:54:34.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.938+0000 7f96dc301700 1 -- 172.21.15.136:0/1928956628 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d410a270 con 0x7f96d4100070 2023-03-02T10:54:34.944 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.939+0000 7f96dc301700 1 -- 172.21.15.136:0/1928956628 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d4066750 con 0x7f96d4100070 2023-03-02T10:54:34.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.940+0000 7f96cb7fe700 1 -- 172.21.15.136:0/1928956628 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f96cc01dbe0 con 0x7f96d4100070 2023-03-02T10:54:34.945 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.940+0000 7f96cb7fe700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f96c009b3a0 0x7f96c009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:34.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.940+0000 7f96cb7fe700 1 -- 172.21.15.136:0/1928956628 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f96cc0c68e0 con 0x7f96d4100070 2023-03-02T10:54:34.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.941+0000 7f96da09d700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f96c009b3a0 0x7f96c009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:34.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.941+0000 7f96da09d700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f96c009b3a0 0x7f96c009d850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f96c4005950 tx=0x7f96c400b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:34.946 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:34.945+0000 7f96cb7fe700 1 -- 172.21.15.136:0/1928956628 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f96cc092780 con 0x7f96d4100070 2023-03-02T10:54:35.139 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.137+0000 7f96dc301700 1 -- 172.21.15.136:0/1928956628 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi057=a;smithi057=d;smithi057=g;smithi057=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f96d40609d0 con 0x7f96c009b3a0 2023-03-02T10:54:35.147 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.146+0000 7f96cb7fe700 1 -- 172.21.15.136:0/1928956628 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f96d40609d0 con 0x7f96c009b3a0 2023-03-02T10:54:35.148 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled mds.all update... 2023-03-02T10:54:35.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 -- 172.21.15.136:0/1928956628 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f96c009b3a0 msgr2=0x7f96c009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:35.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f96c009b3a0 0x7f96c009d850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f96c4005950 tx=0x7f96c400b500 comp rx=0 tx=0).stop 2023-03-02T10:54:35.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 -- 172.21.15.136:0/1928956628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d4100070 msgr2=0x7f96d419cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:35.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d4100070 0x7f96d419cd80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00b070 tx=0x7f96cc004c80 comp rx=0 tx=0).stop 2023-03-02T10:54:35.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 -- 172.21.15.136:0/1928956628 shutdown_connections 2023-03-02T10:54:35.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f96c009b3a0 0x7f96c009d850 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:35.150 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d4100070 0x7f96d419cd80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:35.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96d40fecc0 0x7f96d40fe720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:35.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 --2- 172.21.15.136:0/1928956628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96d40ff670 0x7f96d419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:35.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 -- 172.21.15.136:0/1928956628 >> 172.21.15.136:0/1928956628 conn(0x7f96d40f9820 msgr2=0x7f96d40fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:35.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 -- 172.21.15.136:0/1928956628 shutdown_connections 2023-03-02T10:54:35.151 INFO:teuthology.orchestra.run.smithi136.stderr:2023-03-02T10:54:35.148+0000 7f96dc301700 1 -- 172.21.15.136:0/1928956628 wait complete. 2023-03-02T10:54:35.605 DEBUG:teuthology.orchestra.run.smithi057:mds.a> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.a.service 2023-03-02T10:54:35.608 DEBUG:teuthology.orchestra.run.smithi057:mds.d> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.d.service 2023-03-02T10:54:35.653 DEBUG:teuthology.orchestra.run.smithi057:mds.g> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.g.service 2023-03-02T10:54:35.664 INFO:journalctl@ceph.mds.a.smithi057.stdout:-- Logs begin at Thu 2023-03-02 10:29:06 UTC. -- 2023-03-02T10:54:35.666 DEBUG:teuthology.orchestra.run.smithi057:mds.j> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.j.service 2023-03-02T10:54:35.702 INFO:journalctl@ceph.mds.d.smithi057.stdout:-- Logs begin at Thu 2023-03-02 10:29:06 UTC. -- 2023-03-02T10:54:35.703 DEBUG:teuthology.orchestra.run.smithi122:mds.b> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.b.service 2023-03-02T10:54:35.706 DEBUG:teuthology.orchestra.run.smithi122:mds.e> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.e.service 2023-03-02T10:54:35.715 INFO:journalctl@ceph.mds.g.smithi057.stdout:-- Logs begin at Thu 2023-03-02 10:29:06 UTC. -- 2023-03-02T10:54:35.736 INFO:journalctl@ceph.mds.b.smithi122.stdout:-- Logs begin at Thu 2023-03-02 10:22:37 UTC. -- 2023-03-02T10:54:35.737 DEBUG:teuthology.orchestra.run.smithi122:mds.h> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.h.service 2023-03-02T10:54:35.749 INFO:journalctl@ceph.mds.j.smithi057.stdout:-- Logs begin at Thu 2023-03-02 10:29:06 UTC. -- 2023-03-02T10:54:35.762 INFO:journalctl@ceph.mds.e.smithi122.stdout:-- Logs begin at Thu 2023-03-02 10:22:37 UTC. -- 2023-03-02T10:54:35.763 DEBUG:teuthology.orchestra.run.smithi122:mds.k> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.k.service 2023-03-02T10:54:35.788 INFO:journalctl@ceph.mds.h.smithi122.stdout:-- Logs begin at Thu 2023-03-02 10:22:37 UTC. -- 2023-03-02T10:54:35.789 DEBUG:teuthology.orchestra.run.smithi136:mds.c> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.c.service 2023-03-02T10:54:35.791 DEBUG:teuthology.orchestra.run.smithi136:mds.f> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.f.service 2023-03-02T10:54:35.814 INFO:journalctl@ceph.mds.k.smithi122.stdout:-- Logs begin at Thu 2023-03-02 10:22:37 UTC. -- 2023-03-02T10:54:35.821 INFO:journalctl@ceph.mds.c.smithi136.stdout:-- Logs begin at Thu 2023-03-02 10:22:36 UTC. -- 2023-03-02T10:54:35.822 DEBUG:teuthology.orchestra.run.smithi136:mds.i> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.i.service 2023-03-02T10:54:35.848 INFO:journalctl@ceph.mds.f.smithi136.stdout:-- Logs begin at Thu 2023-03-02 10:22:36 UTC. -- 2023-03-02T10:54:35.849 DEBUG:teuthology.orchestra.run.smithi136:mds.l> sudo journalctl -f -n 0 -u ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.l.service 2023-03-02T10:54:35.875 INFO:journalctl@ceph.mds.i.smithi136.stdout:-- Logs begin at Thu 2023-03-02 10:22:36 UTC. -- 2023-03-02T10:54:35.876 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-03-02T10:54:35.876 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:54:35.901 INFO:journalctl@ceph.mds.l.smithi136.stdout:-- Logs begin at Thu 2023-03-02 10:22:36 UTC. -- 2023-03-02T10:54:36.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.051+0000 7ffba63ff700 1 -- 172.21.15.57:0/2771850345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba01057f0 msgr2=0x7ffba0107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.051+0000 7ffba63ff700 1 --2- 172.21.15.57:0/2771850345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba01057f0 0x7ffba0107bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800b0a0 tx=0x7ffb9800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.051+0000 7ffba63ff700 1 -- 172.21.15.57:0/2771850345 shutdown_connections 2023-03-02T10:54:36.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.051+0000 7ffba63ff700 1 --2- 172.21.15.57:0/2771850345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba01057f0 0x7ffba0107bd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.051+0000 7ffba63ff700 1 --2- 172.21.15.57:0/2771850345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba01005b0 0x7ffba0102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.051+0000 7ffba63ff700 1 --2- 172.21.15.57:0/2771850345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba0102ed0 0x7ffba01052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.051+0000 7ffba63ff700 1 -- 172.21.15.57:0/2771850345 >> 172.21.15.57:0/2771850345 conn(0x7ffba00f9fd0 msgr2=0x7ffba00fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:36.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.051+0000 7ffba63ff700 1 -- 172.21.15.57:0/2771850345 shutdown_connections 2023-03-02T10:54:36.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.051+0000 7ffba63ff700 1 -- 172.21.15.57:0/2771850345 wait complete. 2023-03-02T10:54:36.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.052+0000 7ffba63ff700 1 Processor -- start 2023-03-02T10:54:36.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.052+0000 7ffba63ff700 1 -- start start 2023-03-02T10:54:36.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffba63ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba01005b0 0x7ffba0195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffba63ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0102ed0 0x7ffba0195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffba63ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba01057f0 0x7ffba019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffba63ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba019d4c0 con 0x7ffba01005b0 2023-03-02T10:54:36.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffba63ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba019d600 con 0x7ffba01057f0 2023-03-02T10:54:36.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffba63ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba019d790 con 0x7ffba0102ed0 2023-03-02T10:54:36.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffb9ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba01005b0 0x7ffba0195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffb9ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba01005b0 0x7ffba0195940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42008/0 (socket says 172.21.15.57:42008) 2023-03-02T10:54:36.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffb9ffff700 1 -- 172.21.15.57:0/2072705162 learned_addr learned my addr 172.21.15.57:0/2072705162 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:36.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffb977fe700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0102ed0 0x7ffba0195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffba499c700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba01057f0 0x7ffba019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffb9ffff700 1 -- 172.21.15.57:0/2072705162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0102ed0 msgr2=0x7ffba0195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffb9ffff700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0102ed0 0x7ffba0195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffb9ffff700 1 -- 172.21.15.57:0/2072705162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba01057f0 msgr2=0x7ffba019cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffb9ffff700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba01057f0 0x7ffba019cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffb9ffff700 1 -- 172.21.15.57:0/2072705162 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98009d00 con 0x7ffba01005b0 2023-03-02T10:54:36.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffb9ffff700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba01005b0 0x7ffba0195940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000d950 tx=0x7ffb9000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:36.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.053+0000 7ffb9dffb700 1 -- 172.21.15.57:0/2072705162 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb90004220 con 0x7ffba01005b0 2023-03-02T10:54:36.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.054+0000 7ffba63ff700 1 -- 172.21.15.57:0/2072705162 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba010b420 con 0x7ffba01005b0 2023-03-02T10:54:36.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.054+0000 7ffb9dffb700 1 -- 172.21.15.57:0/2072705162 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb90007620 con 0x7ffba01005b0 2023-03-02T10:54:36.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.054+0000 7ffb9dffb700 1 -- 172.21.15.57:0/2072705162 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb90005690 con 0x7ffba01005b0 2023-03-02T10:54:36.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.054+0000 7ffba63ff700 1 -- 172.21.15.57:0/2072705162 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba010b290 con 0x7ffba01005b0 2023-03-02T10:54:36.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.055+0000 7ffba63ff700 1 -- 172.21.15.57:0/2072705162 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba00fbb40 con 0x7ffba01005b0 2023-03-02T10:54:36.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.056+0000 7ffb9dffb700 1 -- 172.21.15.57:0/2072705162 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7ffb90021070 con 0x7ffba01005b0 2023-03-02T10:54:36.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.057+0000 7ffb9dffb700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffb8c09b3a0 0x7ffb8c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.057+0000 7ffb9dffb700 1 -- 172.21.15.57:0/2072705162 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ffb900c4880 con 0x7ffba01005b0 2023-03-02T10:54:36.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.057+0000 7ffb977fe700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffb8c09b3a0 0x7ffb8c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.057+0000 7ffb977fe700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffb8c09b3a0 0x7ffb8c09d850 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb88005950 tx=0x7ffb8800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:36.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.061+0000 7ffb9dffb700 1 -- 172.21.15.57:0/2072705162 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7ffb900905a0 con 0x7ffba01005b0 2023-03-02T10:54:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi057=a;smithi057=d;smithi057=g;smithi057=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:54:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: Saving service mds.all spec with placement smithi057=a;smithi057=d;smithi057=g;smithi057=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l;count:12 2023-03-02T10:54:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:36 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:36.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.260+0000 7ffba63ff700 1 -- 172.21.15.57:0/2072705162 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffba0061460 con 0x7ffba01005b0 2023-03-02T10:54:36.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.261+0000 7ffb9dffb700 1 -- 172.21.15.57:0/2072705162 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18425 (secure 0 0 0) 0x7ffb90016020 con 0x7ffba01005b0 2023-03-02T10:54:36.263 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:36.263 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":80,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:54:25.424612+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:54:36.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 -- 172.21.15.57:0/2072705162 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffb8c09b3a0 msgr2=0x7ffb8c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffb8c09b3a0 0x7ffb8c09d850 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb88005950 tx=0x7ffb8800b410 comp rx=0 tx=0).stop 2023-03-02T10:54:36.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 -- 172.21.15.57:0/2072705162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba01005b0 msgr2=0x7ffba0195940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba01005b0 0x7ffba0195940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000d950 tx=0x7ffb9000dc60 comp rx=0 tx=0).stop 2023-03-02T10:54:36.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 -- 172.21.15.57:0/2072705162 shutdown_connections 2023-03-02T10:54:36.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ffb8c09b3a0 0x7ffb8c09d850 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba01057f0 0x7ffba019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba01005b0 0x7ffba0195940 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 --2- 172.21.15.57:0/2072705162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0102ed0 0x7ffba0195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 -- 172.21.15.57:0/2072705162 >> 172.21.15.57:0/2072705162 conn(0x7ffba00f9fd0 msgr2=0x7ffba01011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:36.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 -- 172.21.15.57:0/2072705162 shutdown_connections 2023-03-02T10:54:36.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.264+0000 7ffba63ff700 1 -- 172.21.15.57:0/2072705162 wait complete. 2023-03-02T10:54:36.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-02T10:51:03.600226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-02T10:54:36.282 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-02T10:54:36.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.438+0000 7f4a983ff700 1 -- 172.21.15.57:0/2894146528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a901016b0 msgr2=0x7f4a90107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.438+0000 7f4a983ff700 1 --2- 172.21.15.57:0/2894146528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a901016b0 0x7f4a90107f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009f90 tx=0x7f4a8800b330 comp rx=0 tx=0).stop 2023-03-02T10:54:36.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.438+0000 7f4a983ff700 1 -- 172.21.15.57:0/2894146528 shutdown_connections 2023-03-02T10:54:36.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.438+0000 7f4a983ff700 1 --2- 172.21.15.57:0/2894146528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a901016b0 0x7f4a90107f50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.438+0000 7f4a983ff700 1 --2- 172.21.15.57:0/2894146528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a900ffa70 0x7f4a900ffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.438+0000 7f4a983ff700 1 --2- 172.21.15.57:0/2894146528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a90100d00 0x7f4a90101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.438+0000 7f4a983ff700 1 -- 172.21.15.57:0/2894146528 >> 172.21.15.57:0/2894146528 conn(0x7f4a900fb090 msgr2=0x7f4a900fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:36.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.438+0000 7f4a983ff700 1 -- 172.21.15.57:0/2894146528 shutdown_connections 2023-03-02T10:54:36.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.438+0000 7f4a983ff700 1 -- 172.21.15.57:0/2894146528 wait complete. 2023-03-02T10:54:36.441 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi057=a;smithi057=d;smithi057=g;smithi057=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:54:36.442 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: Saving service mds.all spec with placement smithi057=a;smithi057=d;smithi057=g;smithi057=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l;count:12 2023-03-02T10:54:36.442 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:36.442 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:36.442 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:36.442 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:36.442 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:36.442 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:36.443 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:36.443 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:36.443 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:36.443 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:36 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:36.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.439+0000 7f4a983ff700 1 Processor -- start 2023-03-02T10:54:36.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.439+0000 7f4a983ff700 1 -- start start 2023-03-02T10:54:36.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.439+0000 7f4a983ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a900ffa70 0x7f4a901958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.439+0000 7f4a983ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a90100d00 0x7f4a90195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.439+0000 7f4a983ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a901016b0 0x7f4a9019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.439+0000 7f4a983ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9019d460 con 0x7f4a900ffa70 2023-03-02T10:54:36.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.439+0000 7f4a983ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9019d5a0 con 0x7f4a90100d00 2023-03-02T10:54:36.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.439+0000 7f4a983ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9019d730 con 0x7f4a901016b0 2023-03-02T10:54:36.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9619b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a900ffa70 0x7f4a901958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9619b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a900ffa70 0x7f4a901958e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42026/0 (socket says 172.21.15.57:42026) 2023-03-02T10:54:36.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9619b700 1 -- 172.21.15.57:0/1078596836 learned_addr learned my addr 172.21.15.57:0/1078596836 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:36.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9599a700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a90100d00 0x7f4a90195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9699c700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a901016b0 0x7f4a9019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9619b700 1 -- 172.21.15.57:0/1078596836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a901016b0 msgr2=0x7f4a9019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9619b700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a901016b0 0x7f4a9019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9619b700 1 -- 172.21.15.57:0/1078596836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a90100d00 msgr2=0x7f4a90195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9619b700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a90100d00 0x7f4a90195e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9619b700 1 -- 172.21.15.57:0/1078596836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a88009c40 con 0x7f4a900ffa70 2023-03-02T10:54:36.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9599a700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a90100d00 0x7f4a90195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:54:36.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a9619b700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a900ffa70 0x7f4a901958e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00e9c0 tx=0x7f4a8c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:36.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a877fe700 1 -- 172.21.15.57:0/1078596836 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c004a30 con 0x7f4a900ffa70 2023-03-02T10:54:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a983ff700 1 -- 172.21.15.57:0/1078596836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9010b420 con 0x7f4a900ffa70 2023-03-02T10:54:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a877fe700 1 -- 172.21.15.57:0/1078596836 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a8c00cc80 con 0x7f4a900ffa70 2023-03-02T10:54:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a877fe700 1 -- 172.21.15.57:0/1078596836 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0054e0 con 0x7f4a900ffa70 2023-03-02T10:54:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.440+0000 7f4a983ff700 1 -- 172.21.15.57:0/1078596836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9010b290 con 0x7f4a900ffa70 2023-03-02T10:54:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.441+0000 7f4a983ff700 1 -- 172.21.15.57:0/1078596836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a901069c0 con 0x7f4a900ffa70 2023-03-02T10:54:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.443+0000 7f4a877fe700 1 -- 172.21.15.57:0/1078596836 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f4a8c01e020 con 0x7f4a900ffa70 2023-03-02T10:54:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.444+0000 7f4a877fe700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a7c09b3a0 0x7f4a7c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.444+0000 7f4a9599a700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a7c09b3a0 0x7f4a7c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.444+0000 7f4a877fe700 1 -- 172.21.15.57:0/1078596836 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4a8c014070 con 0x7f4a900ffa70 2023-03-02T10:54:36.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.444+0000 7f4a9599a700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a7c09b3a0 0x7f4a7c09d850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4a80005950 tx=0x7f4a8000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:36.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.448+0000 7f4a877fe700 1 -- 172.21.15.57:0/1078596836 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f4a8c090940 con 0x7f4a900ffa70 2023-03-02T10:54:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi057=a;smithi057=d;smithi057=g;smithi057=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:54:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: Saving service mds.all spec with placement smithi057=a;smithi057=d;smithi057=g;smithi057=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l;count:12 2023-03-02T10:54:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:54:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:54:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:36 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:36.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.645+0000 7f4a983ff700 1 -- 172.21.15.57:0/1078596836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a900611a0 con 0x7f4a900ffa70 2023-03-02T10:54:36.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.645+0000 7f4a877fe700 1 -- 172.21.15.57:0/1078596836 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a8c093f60 con 0x7f4a900ffa70 2023-03-02T10:54:36.647 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-02T10:54:36.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 -- 172.21.15.57:0/1078596836 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a7c09b3a0 msgr2=0x7f4a7c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a7c09b3a0 0x7f4a7c09d850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4a80005950 tx=0x7f4a8000b410 comp rx=0 tx=0).stop 2023-03-02T10:54:36.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 -- 172.21.15.57:0/1078596836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a900ffa70 msgr2=0x7f4a901958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a900ffa70 0x7f4a901958e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00e9c0 tx=0x7f4a8c00ecd0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 -- 172.21.15.57:0/1078596836 shutdown_connections 2023-03-02T10:54:36.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a7c09b3a0 0x7f4a7c09d850 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a901016b0 0x7f4a9019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a900ffa70 0x7f4a901958e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 --2- 172.21.15.57:0/1078596836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a90100d00 0x7f4a90195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 -- 172.21.15.57:0/1078596836 >> 172.21.15.57:0/1078596836 conn(0x7f4a900fb090 msgr2=0x7f4a900fd270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:36.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 -- 172.21.15.57:0/1078596836 shutdown_connections 2023-03-02T10:54:36.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.648+0000 7f4a983ff700 1 -- 172.21.15.57:0/1078596836 wait complete. 2023-03-02T10:54:36.665 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:54:36.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.819+0000 7fb1c97ff700 1 -- 172.21.15.57:0/4019877728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1c40683c0 msgr2=0x7fb1c4102620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.819+0000 7fb1c97ff700 1 --2- 172.21.15.57:0/4019877728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1c40683c0 0x7fb1c4102620 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009990 tx=0x7fb1b4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.819+0000 7fb1c97ff700 1 -- 172.21.15.57:0/4019877728 shutdown_connections 2023-03-02T10:54:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.819+0000 7fb1c97ff700 1 --2- 172.21.15.57:0/4019877728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1c4105670 0x7fb1c4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.819+0000 7fb1c97ff700 1 --2- 172.21.15.57:0/4019877728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1c40683c0 0x7fb1c4102620 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.819+0000 7fb1c97ff700 1 --2- 172.21.15.57:0/4019877728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1c4102b60 0x7fb1c4104fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.819+0000 7fb1c97ff700 1 -- 172.21.15.57:0/4019877728 >> 172.21.15.57:0/4019877728 conn(0x7fb1c40f9fd0 msgr2=0x7fb1c40fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:36.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.819+0000 7fb1c97ff700 1 -- 172.21.15.57:0/4019877728 shutdown_connections 2023-03-02T10:54:36.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.819+0000 7fb1c97ff700 1 -- 172.21.15.57:0/4019877728 wait complete. 2023-03-02T10:54:36.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.820+0000 7fb1c97ff700 1 Processor -- start 2023-03-02T10:54:36.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.820+0000 7fb1c97ff700 1 -- start start 2023-03-02T10:54:36.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.820+0000 7fb1c97ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1c40683c0 0x7fb1c40fff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.820+0000 7fb1c97ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1c4102b60 0x7fb1c40fe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.820+0000 7fb1c97ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1c4105670 0x7fb1c40feb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.820+0000 7fb1c97ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c40ff2a0 con 0x7fb1c4102b60 2023-03-02T10:54:36.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.820+0000 7fb1c97ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c40ff410 con 0x7fb1c40683c0 2023-03-02T10:54:36.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.820+0000 7fb1c97ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c419f890 con 0x7fb1c4105670 2023-03-02T10:54:36.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1c4102b60 0x7fb1c40fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1c37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1c4105670 0x7fb1c40feb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1c4102b60 0x7fb1c40fe5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42058/0 (socket says 172.21.15.57:42058) 2023-03-02T10:54:36.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1bbfff700 1 -- 172.21.15.57:0/1611038922 learned_addr learned my addr 172.21.15.57:0/1611038922 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:36.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1c37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1c4105670 0x7fb1c40feb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:40252/0 (socket says 172.21.15.57:40252) 2023-03-02T10:54:36.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1c2ffd700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1c40683c0 0x7fb1c40fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1bbfff700 1 -- 172.21.15.57:0/1611038922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1c4105670 msgr2=0x7fb1c40feb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1bbfff700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1c4105670 0x7fb1c40feb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1bbfff700 1 -- 172.21.15.57:0/1611038922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1c40683c0 msgr2=0x7fb1c40fff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:36.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1bbfff700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1c40683c0 0x7fb1c40fff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:36.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1bbfff700 1 -- 172.21.15.57:0/1611038922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b40095f0 con 0x7fb1c4102b60 2023-03-02T10:54:36.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1bbfff700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1c4102b60 0x7fb1c40fe5c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00e9a0 tx=0x7fb1ac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:36.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1c0ff9700 1 -- 172.21.15.57:0/1611038922 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac009790 con 0x7fb1c4102b60 2023-03-02T10:54:36.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1c0ff9700 1 -- 172.21.15.57:0/1611038922 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1ac010430 con 0x7fb1c4102b60 2023-03-02T10:54:36.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1c97ff700 1 -- 172.21.15.57:0/1611038922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c410b3f0 con 0x7fb1c4102b60 2023-03-02T10:54:36.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1c0ff9700 1 -- 172.21.15.57:0/1611038922 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac018680 con 0x7fb1c4102b60 2023-03-02T10:54:36.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.821+0000 7fb1c97ff700 1 -- 172.21.15.57:0/1611038922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c410b260 con 0x7fb1c4102b60 2023-03-02T10:54:36.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.822+0000 7fb1c97ff700 1 -- 172.21.15.57:0/1611038922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c40fbb40 con 0x7fb1c4102b60 2023-03-02T10:54:36.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.824+0000 7fb1c0ff9700 1 -- 172.21.15.57:0/1611038922 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fb1ac00c040 con 0x7fb1c4102b60 2023-03-02T10:54:36.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.825+0000 7fb1c0ff9700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb1b009b3a0 0x7fb1b009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:36.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.825+0000 7fb1c0ff9700 1 -- 172.21.15.57:0/1611038922 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb1ac014070 con 0x7fb1c4102b60 2023-03-02T10:54:36.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.825+0000 7fb1c2ffd700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb1b009b3a0 0x7fb1b009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:36.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.825+0000 7fb1c2ffd700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb1b009b3a0 0x7fb1b009d850 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400b2e0 tx=0x7fb1b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:36.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:36.829+0000 7fb1c0ff9700 1 -- 172.21.15.57:0/1611038922 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fb1ac050800 con 0x7fb1c4102b60 2023-03-02T10:54:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.071+0000 7fb1c97ff700 1 -- 172.21.15.57:0/1611038922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1c402cd50 con 0x7fb1c4102b60 2023-03-02T10:54:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.071+0000 7fb1c0ff9700 1 -- 172.21.15.57:0/1611038922 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7fb1ac090a20 con 0x7fb1c4102b60 2023-03-02T10:54:37.073 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:37.073 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-03-02T10:54:37.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.073+0000 7fb1c97ff700 1 -- 172.21.15.57:0/1611038922 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb1b009b3a0 msgr2=0x7fb1b009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:37.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.073+0000 7fb1c97ff700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb1b009b3a0 0x7fb1b009d850 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400b2e0 tx=0x7fb1b4005fb0 comp rx=0 tx=0).stop 2023-03-02T10:54:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.073+0000 7fb1c97ff700 1 -- 172.21.15.57:0/1611038922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1c4102b60 msgr2=0x7fb1c40fe5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.073+0000 7fb1c97ff700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1c4102b60 0x7fb1c40fe5c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00e9a0 tx=0x7fb1ac00ecb0 comp rx=0 tx=0).stop 2023-03-02T10:54:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.073+0000 7fb1c97ff700 1 -- 172.21.15.57:0/1611038922 shutdown_connections 2023-03-02T10:54:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.073+0000 7fb1c97ff700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb1b009b3a0 0x7fb1b009d850 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.073+0000 7fb1c97ff700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1c4105670 0x7fb1c40feb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.073+0000 7fb1c97ff700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1c40683c0 0x7fb1c40fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.073+0000 7fb1c97ff700 1 --2- 172.21.15.57:0/1611038922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1c4102b60 0x7fb1c40fe5c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.073+0000 7fb1c97ff700 1 -- 172.21.15.57:0/1611038922 >> 172.21.15.57:0/1611038922 conn(0x7fb1c40f9fd0 msgr2=0x7fb1c4100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.073+0000 7fb1c97ff700 1 -- 172.21.15.57:0/1611038922 shutdown_connections 2023-03-02T10:54:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:37.074+0000 7fb1c97ff700 1 -- 172.21.15.57:0/1611038922 wait complete. 2023-03-02T10:54:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 1 2023-03-02T10:54:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:37 smithi057 ceph-mon[92072]: Deploying daemon mds.l on smithi136 2023-03-02T10:54:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:37 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2072705162' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:54:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:37 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1078596836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:54:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:37 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1611038922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:37 smithi122 ceph-mon[125440]: Deploying daemon mds.l on smithi136 2023-03-02T10:54:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:37 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2072705162' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:54:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:37 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1078596836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:54:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:37 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1611038922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:37.524 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:37 smithi136 ceph-mon[125702]: Deploying daemon mds.l on smithi136 2023-03-02T10:54:37.524 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:37 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2072705162' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:54:37.524 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:37 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1078596836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:54:37.524 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:37 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1611038922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:37.525 INFO:journalctl@ceph.mds.l.smithi136.stdout:Mar 02 10:54:37 smithi136 systemd[1]: Starting Ceph mds.l for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:54:37.525 INFO:journalctl@ceph.mds.l.smithi136.stdout:Mar 02 10:54:37 smithi136 podman[150831]: 2023-03-02T10:54:37.774 INFO:journalctl@ceph.mds.l.smithi136.stdout:Mar 02 10:54:37 smithi136 bash[150831]: 661f82b2bbd862c20fc9e6cecda024826a58578b703c52ff5a3cfc9368cbb47a 2023-03-02T10:54:38.090 INFO:journalctl@ceph.mds.l.smithi136.stdout:Mar 02 10:54:37 smithi136 ceph-mds[150869]: -- 172.21.15.136:0/1594670884 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c7a3d24b60 con 0x55c7a3cf8800 2023-03-02T10:54:38.090 INFO:journalctl@ceph.mds.l.smithi136.stdout:Mar 02 10:54:37 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-l[150847]: starting mds.l at 2023-03-02T10:54:38.091 INFO:journalctl@ceph.mds.l.smithi136.stdout:Mar 02 10:54:37 smithi136 systemd[1]: Started Ceph mds.l for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:54:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:38 smithi057 ceph-mon[92072]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:38 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.136:6832/2838612280,v1:172.21.15.136:6833/2838612280] up:boot 2023-03-02T10:54:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:38 smithi057 ceph-mon[92072]: fsmap 1 up:standby 2023-03-02T10:54:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-02T10:54:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:38 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:38 smithi122 ceph-mon[125440]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:38 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.136:6832/2838612280,v1:172.21.15.136:6833/2838612280] up:boot 2023-03-02T10:54:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:38 smithi122 ceph-mon[125440]: fsmap 1 up:standby 2023-03-02T10:54:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-02T10:54:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:38 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:38 smithi136 ceph-mon[125702]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:38 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.136:6832/2838612280,v1:172.21.15.136:6833/2838612280] up:boot 2023-03-02T10:54:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:38 smithi136 ceph-mon[125702]: fsmap 1 up:standby 2023-03-02T10:54:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-02T10:54:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:38.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:38 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:39.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:54:39.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.257+0000 7fe7ebbff700 1 -- 172.21.15.57:0/861499951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e40ffac0 msgr2=0x7fe7e40ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:39.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.257+0000 7fe7ebbff700 1 --2- 172.21.15.57:0/861499951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e40ffac0 0x7fe7e40ffed0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009990 tx=0x7fe7e0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:54:39.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.257+0000 7fe7ebbff700 1 -- 172.21.15.57:0/861499951 shutdown_connections 2023-03-02T10:54:39.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.257+0000 7fe7ebbff700 1 --2- 172.21.15.57:0/861499951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7e4101700 0x7fe7e4107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:39.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.257+0000 7fe7ebbff700 1 --2- 172.21.15.57:0/861499951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e40ffac0 0x7fe7e40ffed0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:39.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.257+0000 7fe7ebbff700 1 --2- 172.21.15.57:0/861499951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7e4100d50 0x7fe7e41011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:39.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.257+0000 7fe7ebbff700 1 -- 172.21.15.57:0/861499951 >> 172.21.15.57:0/861499951 conn(0x7fe7e40fb0c0 msgr2=0x7fe7e40fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:39.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.257+0000 7fe7ebbff700 1 -- 172.21.15.57:0/861499951 shutdown_connections 2023-03-02T10:54:39.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.257+0000 7fe7ebbff700 1 -- 172.21.15.57:0/861499951 wait complete. 2023-03-02T10:54:39.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7ebbff700 1 Processor -- start 2023-03-02T10:54:39.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7ebbff700 1 -- start start 2023-03-02T10:54:39.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7ebbff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7e40ffac0 0x7fe7e4074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:39.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7ebbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7e4100d50 0x7fe7e4072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:39.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7ebbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e4101700 0x7fe7e4072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7ebbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e4073660 con 0x7fe7e4101700 2023-03-02T10:54:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7ebbff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e40737d0 con 0x7fe7e40ffac0 2023-03-02T10:54:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7ebbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e419f890 con 0x7fe7e4100d50 2023-03-02T10:54:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7e999b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7e40ffac0 0x7fe7e4074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7ea19c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e4101700 0x7fe7e4072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7e999b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7e40ffac0 0x7fe7e4074340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:57488/0 (socket says 172.21.15.57:57488) 2023-03-02T10:54:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.258+0000 7fe7e999b700 1 -- 172.21.15.57:0/3296708876 learned_addr learned my addr 172.21.15.57:0/3296708876 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7e919a700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7e4100d50 0x7fe7e4072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7e999b700 1 -- 172.21.15.57:0/3296708876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7e4100d50 msgr2=0x7fe7e4072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7e999b700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7e4100d50 0x7fe7e4072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7e999b700 1 -- 172.21.15.57:0/3296708876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e4101700 msgr2=0x7fe7e4072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7e999b700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e4101700 0x7fe7e4072ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7e999b700 1 -- 172.21.15.57:0/3296708876 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e00095f0 con 0x7fe7e40ffac0 2023-03-02T10:54:39.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7ea19c700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e4101700 0x7fe7e4072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:54:39.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7e999b700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7e40ffac0 0x7fe7e4074340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0004730 tx=0x7fe7e0004760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:39.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7daffd700 1 -- 172.21.15.57:0/3296708876 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e001d070 con 0x7fe7e40ffac0 2023-03-02T10:54:39.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7ebbff700 1 -- 172.21.15.57:0/3296708876 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e410b470 con 0x7fe7e40ffac0 2023-03-02T10:54:39.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7daffd700 1 -- 172.21.15.57:0/3296708876 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7e0004c90 con 0x7fe7e40ffac0 2023-03-02T10:54:39.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7daffd700 1 -- 172.21.15.57:0/3296708876 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0005570 con 0x7fe7e40ffac0 2023-03-02T10:54:39.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.259+0000 7fe7ebbff700 1 -- 172.21.15.57:0/3296708876 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e410b2e0 con 0x7fe7e40ffac0 2023-03-02T10:54:39.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.260+0000 7fe7ebbff700 1 -- 172.21.15.57:0/3296708876 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e4106ae0 con 0x7fe7e40ffac0 2023-03-02T10:54:39.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.262+0000 7fe7daffd700 1 -- 172.21.15.57:0/3296708876 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fe7e000b050 con 0x7fe7e40ffac0 2023-03-02T10:54:39.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.263+0000 7fe7daffd700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe7d009b3a0 0x7fe7d009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:39.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.263+0000 7fe7daffd700 1 -- 172.21.15.57:0/3296708876 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe7e00c6250 con 0x7fe7e40ffac0 2023-03-02T10:54:39.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.263+0000 7fe7e919a700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe7d009b3a0 0x7fe7d009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:39.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.263+0000 7fe7e919a700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe7d009b3a0 0x7fe7d009d850 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009bf0 tx=0x7fe7d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:39.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.265+0000 7fe7daffd700 1 -- 172.21.15.57:0/3296708876 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fe7e0092000 con 0x7fe7e40ffac0 2023-03-02T10:54:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:39 smithi057 ceph-mon[92072]: Deploying daemon mds.k on smithi122 2023-03-02T10:54:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:39 smithi122 ceph-mon[125440]: Deploying daemon mds.k on smithi122 2023-03-02T10:54:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.512+0000 7fe7ebbff700 1 -- 172.21.15.57:0/3296708876 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7e40611d0 con 0x7fe7e40ffac0 2023-03-02T10:54:39.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.513+0000 7fe7daffd700 1 -- 172.21.15.57:0/3296708876 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7fe7e0095620 con 0x7fe7e40ffac0 2023-03-02T10:54:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:39.514 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-03-02T10:54:39.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 -- 172.21.15.57:0/3296708876 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe7d009b3a0 msgr2=0x7fe7d009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:39.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe7d009b3a0 0x7fe7d009d850 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009bf0 tx=0x7fe7d4009260 comp rx=0 tx=0).stop 2023-03-02T10:54:39.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 -- 172.21.15.57:0/3296708876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7e40ffac0 msgr2=0x7fe7e4074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:39.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7e40ffac0 0x7fe7e4074340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0004730 tx=0x7fe7e0004760 comp rx=0 tx=0).stop 2023-03-02T10:54:39.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 -- 172.21.15.57:0/3296708876 shutdown_connections 2023-03-02T10:54:39.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe7d009b3a0 0x7fe7d009d850 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:39.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e4101700 0x7fe7e4072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:39.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7e40ffac0 0x7fe7e4074340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:39.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 --2- 172.21.15.57:0/3296708876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7e4100d50 0x7fe7e4072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:39.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 -- 172.21.15.57:0/3296708876 >> 172.21.15.57:0/3296708876 conn(0x7fe7e40fb0c0 msgr2=0x7fe7e40fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:39.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 -- 172.21.15.57:0/3296708876 shutdown_connections 2023-03-02T10:54:39.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:39.515+0000 7fe7ebbff700 1 -- 172.21.15.57:0/3296708876 wait complete. 2023-03-02T10:54:39.518 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 2 2023-03-02T10:54:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:39 smithi136 ceph-mon[125702]: Deploying daemon mds.k on smithi122 2023-03-02T10:54:39.764 INFO:journalctl@ceph.mds.k.smithi122.stdout:Mar 02 10:54:39 smithi122 systemd[1]: Starting Ceph mds.k for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:54:40.054 INFO:journalctl@ceph.mds.k.smithi122.stdout:Mar 02 10:54:39 smithi122 podman[149876]: 2023-03-02T10:54:40.054 INFO:journalctl@ceph.mds.k.smithi122.stdout:Mar 02 10:54:39 smithi122 ceph-mds[149915]: -- 172.21.15.122:0/271132545 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55795091ab60 con 0x5579508ef000 2023-03-02T10:54:40.055 INFO:journalctl@ceph.mds.k.smithi122.stdout:Mar 02 10:54:39 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-k[149892]: starting mds.k at 2023-03-02T10:54:40.055 INFO:journalctl@ceph.mds.k.smithi122.stdout:Mar 02 10:54:39 smithi122 bash[149876]: f17f90280f9d11bc6f0dd31e3ec200de2f7e2b48151bc3de175f07af11eaf359 2023-03-02T10:54:40.451 INFO:journalctl@ceph.mds.k.smithi122.stdout:Mar 02 10:54:40 smithi122 systemd[1]: Started Ceph mds.k for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:54:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:40 smithi122 ceph-mon[125440]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:40 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3296708876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:40 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:40 smithi136 ceph-mon[125702]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:40 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3296708876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:40 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:40 smithi057 ceph-mon[92072]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:40 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3296708876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:40 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:41.428 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:41 smithi057 ceph-mon[92072]: Deploying daemon mds.j on smithi057 2023-03-02T10:54:41.428 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:41 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:boot 2023-03-02T10:54:41.428 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:41 smithi057 ceph-mon[92072]: fsmap 2 up:standby 2023-03-02T10:54:41.428 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:41 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-02T10:54:41.533 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:54:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:41 smithi136 ceph-mon[125702]: Deploying daemon mds.j on smithi057 2023-03-02T10:54:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:41 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:boot 2023-03-02T10:54:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:41 smithi136 ceph-mon[125702]: fsmap 2 up:standby 2023-03-02T10:54:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:41 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-02T10:54:41.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.693+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1776131577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8f01005b0 msgr2=0x7fc8f0102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:41.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.693+0000 7fc8f55ff700 1 --2- 172.21.15.57:0/1776131577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8f01005b0 0x7fc8f0102990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00098f0 tx=0x7fc8e0009c00 comp rx=0 tx=0).stop 2023-03-02T10:54:41.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.693+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1776131577 shutdown_connections 2023-03-02T10:54:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.693+0000 7fc8f55ff700 1 --2- 172.21.15.57:0/1776131577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f01057f0 0x7fc8f0107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.693+0000 7fc8f55ff700 1 --2- 172.21.15.57:0/1776131577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8f01005b0 0x7fc8f0102990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.693+0000 7fc8f55ff700 1 --2- 172.21.15.57:0/1776131577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8f0102ed0 0x7fc8f01052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.693+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1776131577 >> 172.21.15.57:0/1776131577 conn(0x7fc8f00f9fd0 msgr2=0x7fc8f00fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.693+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1776131577 shutdown_connections 2023-03-02T10:54:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.693+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1776131577 wait complete. 2023-03-02T10:54:41.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8f55ff700 1 Processor -- start 2023-03-02T10:54:41.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8f55ff700 1 -- start start 2023-03-02T10:54:41.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8f55ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8f01005b0 0x7fc8f00fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:41.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8f55ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f0102ed0 0x7fc8f00fe560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:41.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8f55ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8f01057f0 0x7fc8f00feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:41.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8f55ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f00ff240 con 0x7fc8f0102ed0 2023-03-02T10:54:41.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8f55ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f00ff3b0 con 0x7fc8f01057f0 2023-03-02T10:54:41.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8f55ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f019f8e0 con 0x7fc8f01005b0 2023-03-02T10:54:41.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8ee7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f0102ed0 0x7fc8f00fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:41.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8ee7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f0102ed0 0x7fc8f00fe560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42102/0 (socket says 172.21.15.57:42102) 2023-03-02T10:54:41.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8ee7fc700 1 -- 172.21.15.57:0/1781206388 learned_addr learned my addr 172.21.15.57:0/1781206388 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:41.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8ef7fe700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8f01057f0 0x7fc8f00feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:41.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.694+0000 7fc8eeffd700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8f01005b0 0x7fc8f00fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:41.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8ee7fc700 1 -- 172.21.15.57:0/1781206388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8f01005b0 msgr2=0x7fc8f00fff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:41.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8ee7fc700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8f01005b0 0x7fc8f00fff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:41.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8ee7fc700 1 -- 172.21.15.57:0/1781206388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8f01057f0 msgr2=0x7fc8f00feaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:41.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8ee7fc700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8f01057f0 0x7fc8f00feaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:41.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8ee7fc700 1 -- 172.21.15.57:0/1781206388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e8009d00 con 0x7fc8f0102ed0 2023-03-02T10:54:41.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8eeffd700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8f01005b0 0x7fc8f00fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:54:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8ee7fc700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f0102ed0 0x7fc8f00fe560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400e9a0 tx=0x7fc8e400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8d7fff700 1 -- 172.21.15.57:0/1781206388 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4009790 con 0x7fc8f0102ed0 2023-03-02T10:54:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1781206388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e0009520 con 0x7fc8f0102ed0 2023-03-02T10:54:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8d7fff700 1 -- 172.21.15.57:0/1781206388 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8e400cbd0 con 0x7fc8f0102ed0 2023-03-02T10:54:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8d7fff700 1 -- 172.21.15.57:0/1781206388 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4018680 con 0x7fc8f0102ed0 2023-03-02T10:54:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.695+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1781206388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f010b400 con 0x7fc8f0102ed0 2023-03-02T10:54:41.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.696+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1781206388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f010b590 con 0x7fc8f0102ed0 2023-03-02T10:54:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.699+0000 7fc8d7fff700 1 -- 172.21.15.57:0/1781206388 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fc8e400c040 con 0x7fc8f0102ed0 2023-03-02T10:54:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.700+0000 7fc8d7fff700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc8d809b3a0 0x7fc8d809d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.700+0000 7fc8d7fff700 1 -- 172.21.15.57:0/1781206388 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc8e4014070 con 0x7fc8f0102ed0 2023-03-02T10:54:41.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.700+0000 7fc8eeffd700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc8d809b3a0 0x7fc8d809d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:41.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.700+0000 7fc8eeffd700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc8d809b3a0 0x7fc8d809d850 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00098c0 tx=0x7fc8e0019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:41 smithi122 ceph-mon[125440]: Deploying daemon mds.j on smithi057 2023-03-02T10:54:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:41 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:boot 2023-03-02T10:54:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:41 smithi122 ceph-mon[125440]: fsmap 2 up:standby 2023-03-02T10:54:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:41 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-02T10:54:41.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:41.703+0000 7fc8d7fff700 1 -- 172.21.15.57:0/1781206388 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fc8e4090e00 con 0x7fc8f0102ed0 2023-03-02T10:54:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.000+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1781206388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8f00fbb40 con 0x7fc8f0102ed0 2023-03-02T10:54:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.001+0000 7fc8d7fff700 1 -- 172.21.15.57:0/1781206388 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2017 (secure 0 0 0) 0x7fc8e4026020 con 0x7fc8f0102ed0 2023-03-02T10:54:42.002 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:42.003 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-03-02T10:54:42.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.003+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1781206388 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc8d809b3a0 msgr2=0x7fc8d809d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:42.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.003+0000 7fc8f55ff700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc8d809b3a0 0x7fc8d809d850 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00098c0 tx=0x7fc8e0019040 comp rx=0 tx=0).stop 2023-03-02T10:54:42.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.003+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1781206388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f0102ed0 msgr2=0x7fc8f00fe560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:42.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.003+0000 7fc8f55ff700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f0102ed0 0x7fc8f00fe560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400e9a0 tx=0x7fc8e400ecb0 comp rx=0 tx=0).stop 2023-03-02T10:54:42.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.003+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1781206388 shutdown_connections 2023-03-02T10:54:42.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.003+0000 7fc8f55ff700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc8d809b3a0 0x7fc8d809d850 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:42.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.003+0000 7fc8f55ff700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8f01057f0 0x7fc8f00feaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:42.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.003+0000 7fc8f55ff700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8f01005b0 0x7fc8f00fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.003+0000 7fc8f55ff700 1 --2- 172.21.15.57:0/1781206388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f0102ed0 0x7fc8f00fe560 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.004+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1781206388 >> 172.21.15.57:0/1781206388 conn(0x7fc8f00f9fd0 msgr2=0x7fc8f01011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.004+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1781206388 shutdown_connections 2023-03-02T10:54:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:42.004+0000 7fc8f55ff700 1 -- 172.21.15.57:0/1781206388 wait complete. 2023-03-02T10:54:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 3 2023-03-02T10:54:42.291 INFO:journalctl@ceph.mds.j.smithi057.stdout:Mar 02 10:54:42 smithi057 systemd[1]: Starting Ceph mds.j for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:54:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:42 smithi136 ceph-mon[125702]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:42 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1781206388' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:42.632 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:42 smithi057 ceph-mon[92072]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:42.632 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:42 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1781206388' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:42.632 INFO:journalctl@ceph.mds.j.smithi057.stdout:Mar 02 10:54:42 smithi057 podman[125306]: 2023-03-02T10:54:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:42 smithi122 ceph-mon[125440]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:42.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:42 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1781206388' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:43.182 INFO:journalctl@ceph.mds.j.smithi057.stdout:Mar 02 10:54:42 smithi057 ceph-mds[125346]: -- 172.21.15.57:0/2760001100 <== mon.0 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c47c61ab60 con 0x55c47c5eec00 2023-03-02T10:54:43.183 INFO:journalctl@ceph.mds.j.smithi057.stdout:Mar 02 10:54:42 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-j[125322]: starting mds.j at 2023-03-02T10:54:43.183 INFO:journalctl@ceph.mds.j.smithi057.stdout:Mar 02 10:54:42 smithi057 bash[125306]: 7cbfb5a028bf06176eeb99d14167ad86c37dcfddaf14de712742658f37de6037 2023-03-02T10:54:43.183 INFO:journalctl@ceph.mds.j.smithi057.stdout:Mar 02 10:54:42 smithi057 systemd[1]: Started Ceph mds.j for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:54:44.003 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:43 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:44.004 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:43 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:44.004 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:43 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:44.004 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:43 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:44.004 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:43 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:44.004 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:43 smithi057 ceph-mon[92072]: Deploying daemon mds.d on smithi057 2023-03-02T10:54:44.004 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:43 smithi057 ceph-mon[92072]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:44.004 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:43 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.57:6834/4011698957,v1:172.21.15.57:6835/4011698957] up:boot 2023-03-02T10:54:44.005 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:43 smithi057 ceph-mon[92072]: fsmap 3 up:standby 2023-03-02T10:54:44.005 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:43 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-02T10:54:44.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:54:44.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.181+0000 7fe26e9ff700 1 -- 172.21.15.57:0/2273085194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2681005d0 msgr2=0x7fe268106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:44.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.181+0000 7fe26e9ff700 1 --2- 172.21.15.57:0/2273085194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2681005d0 0x7fe268106e70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe26000b0a0 tx=0x7fe26000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:54:44.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.181+0000 7fe26e9ff700 1 -- 172.21.15.57:0/2273085194 shutdown_connections 2023-03-02T10:54:44.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.181+0000 7fe26e9ff700 1 --2- 172.21.15.57:0/2273085194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2681005d0 0x7fe268106e70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:44.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.181+0000 7fe26e9ff700 1 --2- 172.21.15.57:0/2273085194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2680fe990 0x7fe2680feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:44.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.181+0000 7fe26e9ff700 1 --2- 172.21.15.57:0/2273085194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2680ffc20 0x7fe268100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:44.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.181+0000 7fe26e9ff700 1 -- 172.21.15.57:0/2273085194 >> 172.21.15.57:0/2273085194 conn(0x7fe2680f9fd0 msgr2=0x7fe2680fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:44.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.181+0000 7fe26e9ff700 1 -- 172.21.15.57:0/2273085194 shutdown_connections 2023-03-02T10:54:44.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.181+0000 7fe26e9ff700 1 -- 172.21.15.57:0/2273085194 wait complete. 2023-03-02T10:54:44.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.182+0000 7fe26e9ff700 1 Processor -- start 2023-03-02T10:54:44.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.182+0000 7fe26e9ff700 1 -- start start 2023-03-02T10:54:44.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.182+0000 7fe26e9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2680fe990 0x7fe268109260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:44.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.182+0000 7fe26e9ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2680ffc20 0x7fe2681078a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:44.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.182+0000 7fe26e9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2681005d0 0x7fe268107de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:44.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.182+0000 7fe26e9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe268108580 con 0x7fe2680fe990 2023-03-02T10:54:44.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.182+0000 7fe26e9ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2681086f0 con 0x7fe2680ffc20 2023-03-02T10:54:44.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.182+0000 7fe26e9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26819f9b0 con 0x7fe2681005d0 2023-03-02T10:54:44.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.182+0000 7fe267fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2680fe990 0x7fe268109260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:44.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.182+0000 7fe267fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2680fe990 0x7fe268109260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42144/0 (socket says 172.21.15.57:42144) 2023-03-02T10:54:44.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.182+0000 7fe267fff700 1 -- 172.21.15.57:0/118218507 learned_addr learned my addr 172.21.15.57:0/118218507 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:44.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe25f7fe700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2680ffc20 0x7fe2681078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:44.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe26cf9c700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2681005d0 0x7fe268107de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:44.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe267fff700 1 -- 172.21.15.57:0/118218507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2681005d0 msgr2=0x7fe268107de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:44.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe267fff700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2681005d0 0x7fe268107de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:44.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe267fff700 1 -- 172.21.15.57:0/118218507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2680ffc20 msgr2=0x7fe2681078a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe267fff700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2680ffc20 0x7fe2681078a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe267fff700 1 -- 172.21.15.57:0/118218507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260009d00 con 0x7fe2680fe990 2023-03-02T10:54:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe26cf9c700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2681005d0 0x7fe268107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:54:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe267fff700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2680fe990 0x7fe268109260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe25800d950 tx=0x7fe25800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe265ffb700 1 -- 172.21.15.57:0/118218507 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258009b40 con 0x7fe2680fe990 2023-03-02T10:54:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe26e9ff700 1 -- 172.21.15.57:0/118218507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26810b4a0 con 0x7fe2680fe990 2023-03-02T10:54:44.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe265ffb700 1 -- 172.21.15.57:0/118218507 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe258009ca0 con 0x7fe2680fe990 2023-03-02T10:54:44.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe265ffb700 1 -- 172.21.15.57:0/118218507 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25800f620 con 0x7fe2680fe990 2023-03-02T10:54:44.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.183+0000 7fe26e9ff700 1 -- 172.21.15.57:0/118218507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26810b310 con 0x7fe2680fe990 2023-03-02T10:54:44.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.184+0000 7fe26e9ff700 1 -- 172.21.15.57:0/118218507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe268105980 con 0x7fe2680fe990 2023-03-02T10:54:44.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.186+0000 7fe265ffb700 1 -- 172.21.15.57:0/118218507 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fe258018030 con 0x7fe2680fe990 2023-03-02T10:54:44.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.187+0000 7fe265ffb700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe25409b3a0 0x7fe25409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:44.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.187+0000 7fe265ffb700 1 -- 172.21.15.57:0/118218507 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe2580c4e10 con 0x7fe2680fe990 2023-03-02T10:54:44.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.187+0000 7fe25f7fe700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe25409b3a0 0x7fe25409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:44.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.187+0000 7fe25f7fe700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe25409b3a0 0x7fe25409d850 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe250005950 tx=0x7fe2500058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:44.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.191+0000 7fe265ffb700 1 -- 172.21.15.57:0/118218507 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fe2580c8030 con 0x7fe2680fe990 2023-03-02T10:54:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:43 smithi122 ceph-mon[125440]: Deploying daemon mds.d on smithi057 2023-03-02T10:54:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:43 smithi122 ceph-mon[125440]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:44.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:43 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.57:6834/4011698957,v1:172.21.15.57:6835/4011698957] up:boot 2023-03-02T10:54:44.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:43 smithi122 ceph-mon[125440]: fsmap 3 up:standby 2023-03-02T10:54:44.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:43 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-02T10:54:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:43 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:43 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:43 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:43 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:43 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:43 smithi136 ceph-mon[125702]: Deploying daemon mds.d on smithi057 2023-03-02T10:54:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:43 smithi136 ceph-mon[125702]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:43 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.57:6834/4011698957,v1:172.21.15.57:6835/4011698957] up:boot 2023-03-02T10:54:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:43 smithi136 ceph-mon[125702]: fsmap 3 up:standby 2023-03-02T10:54:44.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:43 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-02T10:54:44.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.447+0000 7fe26e9ff700 1 -- 172.21.15.57:0/118218507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe268061450 con 0x7fe2680fe990 2023-03-02T10:54:44.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.448+0000 7fe265ffb700 1 -- 172.21.15.57:0/118218507 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2774 (secure 0 0 0) 0x7fe258016090 con 0x7fe2680fe990 2023-03-02T10:54:44.450 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:44.450 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-03-02T10:54:44.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.450+0000 7fe26e9ff700 1 -- 172.21.15.57:0/118218507 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe25409b3a0 msgr2=0x7fe25409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:44.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.450+0000 7fe26e9ff700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe25409b3a0 0x7fe25409d850 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe250005950 tx=0x7fe2500058e0 comp rx=0 tx=0).stop 2023-03-02T10:54:44.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.450+0000 7fe26e9ff700 1 -- 172.21.15.57:0/118218507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2680fe990 msgr2=0x7fe268109260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:44.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.450+0000 7fe26e9ff700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2680fe990 0x7fe268109260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe25800d950 tx=0x7fe25800dd10 comp rx=0 tx=0).stop 2023-03-02T10:54:44.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.450+0000 7fe26e9ff700 1 -- 172.21.15.57:0/118218507 shutdown_connections 2023-03-02T10:54:44.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.450+0000 7fe26e9ff700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe25409b3a0 0x7fe25409d850 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:44.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.450+0000 7fe26e9ff700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2681005d0 0x7fe268107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:44.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.450+0000 7fe26e9ff700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2680fe990 0x7fe268109260 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:44.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.450+0000 7fe26e9ff700 1 --2- 172.21.15.57:0/118218507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2680ffc20 0x7fe2681078a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:44.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.451+0000 7fe26e9ff700 1 -- 172.21.15.57:0/118218507 >> 172.21.15.57:0/118218507 conn(0x7fe2680f9fd0 msgr2=0x7fe2680fc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:44.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.451+0000 7fe26e9ff700 1 -- 172.21.15.57:0/118218507 shutdown_connections 2023-03-02T10:54:44.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:44.451+0000 7fe26e9ff700 1 -- 172.21.15.57:0/118218507 wait complete. 2023-03-02T10:54:44.454 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 4 2023-03-02T10:54:45.094 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:44 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/118218507' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:45.095 INFO:journalctl@ceph.mds.d.smithi057.stdout:Mar 02 10:54:44 smithi057 systemd[1]: Starting Ceph mds.d for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:54:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:44 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/118218507' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:44 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/118218507' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:45.376 INFO:journalctl@ceph.mds.d.smithi057.stdout:Mar 02 10:54:45 smithi057 podman[125692]: 2023-03-02T10:54:45.874 INFO:journalctl@ceph.mds.d.smithi057.stdout:Mar 02 10:54:45 smithi057 ceph-mds[125731]: -- 172.21.15.57:0/304301995 <== mon.0 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d93a3a0b60 con 0x55d93a374c00 2023-03-02T10:54:45.874 INFO:journalctl@ceph.mds.d.smithi057.stdout:Mar 02 10:54:45 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-d[125708]: starting mds.d at 2023-03-02T10:54:45.874 INFO:journalctl@ceph.mds.d.smithi057.stdout:Mar 02 10:54:45 smithi057 bash[125692]: 88fe599e8b7c895e0653c1575183d2485ec999d1a02d509e5a64342daa38398a 2023-03-02T10:54:45.875 INFO:journalctl@ceph.mds.d.smithi057.stdout:Mar 02 10:54:45 smithi057 systemd[1]: Started Ceph mds.d for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:54:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:45 smithi057 ceph-mon[92072]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:45 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:45 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:45 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:45 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:45 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:45 smithi122 ceph-mon[125440]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:45 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:45 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:45 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:45 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:45 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:45 smithi136 ceph-mon[125702]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:45 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:45 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:45 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:45 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:45 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:46.468 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:54:46.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.641+0000 7f433ddff700 1 -- 172.21.15.57:0/3896074993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43380ffc20 msgr2=0x7f4338100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:46.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.641+0000 7f433ddff700 1 --2- 172.21.15.57:0/3896074993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43380ffc20 0x7f4338100090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f432c009990 tx=0x7f432c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.641+0000 7f433ddff700 1 -- 172.21.15.57:0/3896074993 shutdown_connections 2023-03-02T10:54:46.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.641+0000 7f433ddff700 1 --2- 172.21.15.57:0/3896074993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43381005d0 0x7f4338106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.641+0000 7f433ddff700 1 --2- 172.21.15.57:0/3896074993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43380fe990 0x7f43380feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.641+0000 7f433ddff700 1 --2- 172.21.15.57:0/3896074993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43380ffc20 0x7f4338100090 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.641+0000 7f433ddff700 1 -- 172.21.15.57:0/3896074993 >> 172.21.15.57:0/3896074993 conn(0x7f43380f9fd0 msgr2=0x7f43380fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:46.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.641+0000 7f433ddff700 1 -- 172.21.15.57:0/3896074993 shutdown_connections 2023-03-02T10:54:46.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.641+0000 7f433ddff700 1 -- 172.21.15.57:0/3896074993 wait complete. 2023-03-02T10:54:46.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.642+0000 7f433ddff700 1 Processor -- start 2023-03-02T10:54:46.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.642+0000 7f433ddff700 1 -- start start 2023-03-02T10:54:46.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.642+0000 7f433ddff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43380fe990 0x7f43381979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:46.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.642+0000 7f433ddff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43380ffc20 0x7f4338197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:46.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.642+0000 7f433ddff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43381005d0 0x7f433819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:46.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.642+0000 7f433ddff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433819f560 con 0x7f43380fe990 2023-03-02T10:54:46.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.642+0000 7f433ddff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433819f6a0 con 0x7f43381005d0 2023-03-02T10:54:46.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.642+0000 7f433ddff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433819f830 con 0x7f43380ffc20 2023-03-02T10:54:46.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.642+0000 7f43377fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43380fe990 0x7f43381979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:46.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f43377fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43380fe990 0x7f43381979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38186/0 (socket says 172.21.15.57:38186) 2023-03-02T10:54:46.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f43377fe700 1 -- 172.21.15.57:0/102428512 learned_addr learned my addr 172.21.15.57:0/102428512 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:46.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f4337fff700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43381005d0 0x7f433819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:46.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f4336ffd700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43380ffc20 0x7f4338197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:46.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f43377fe700 1 -- 172.21.15.57:0/102428512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43380ffc20 msgr2=0x7f4338197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:46.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f43377fe700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43380ffc20 0x7f4338197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f43377fe700 1 -- 172.21.15.57:0/102428512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43381005d0 msgr2=0x7f433819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:46.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f43377fe700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43381005d0 0x7f433819ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f43377fe700 1 -- 172.21.15.57:0/102428512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0095f0 con 0x7f43380fe990 2023-03-02T10:54:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f4336ffd700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43380ffc20 0x7f4338197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:54:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f43377fe700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43380fe990 0x7f43381979e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f432800e9a0 tx=0x7f432800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f4334ff9700 1 -- 172.21.15.57:0/102428512 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328009790 con 0x7f43380fe990 2023-03-02T10:54:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f433ddff700 1 -- 172.21.15.57:0/102428512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433810a2f0 con 0x7f43380fe990 2023-03-02T10:54:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f4334ff9700 1 -- 172.21.15.57:0/102428512 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f432800cbd0 con 0x7f43380fe990 2023-03-02T10:54:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f4334ff9700 1 -- 172.21.15.57:0/102428512 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328018680 con 0x7f43380fe990 2023-03-02T10:54:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.643+0000 7f433ddff700 1 -- 172.21.15.57:0/102428512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433810a160 con 0x7f43380fe990 2023-03-02T10:54:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.644+0000 7f433ddff700 1 -- 172.21.15.57:0/102428512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4338067280 con 0x7f43380fe990 2023-03-02T10:54:46.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.646+0000 7f4334ff9700 1 -- 172.21.15.57:0/102428512 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f432800c040 con 0x7f43380fe990 2023-03-02T10:54:46.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.646+0000 7f4334ff9700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f432009b3a0 0x7f432009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:46.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.647+0000 7f4334ff9700 1 -- 172.21.15.57:0/102428512 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4328014070 con 0x7f43380fe990 2023-03-02T10:54:46.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.647+0000 7f4336ffd700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f432009b3a0 0x7f432009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:46.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.647+0000 7f4336ffd700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f432009b3a0 0x7f432009d850 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f432c00b2e0 tx=0x7f432c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:46.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.649+0000 7f4334ff9700 1 -- 172.21.15.57:0/102428512 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f4328090dc0 con 0x7f43380fe990 2023-03-02T10:54:46.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.895+0000 7f433ddff700 1 -- 172.21.15.57:0/102428512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43381a0390 con 0x7f43380fe990 2023-03-02T10:54:46.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.896+0000 7f4334ff9700 1 -- 172.21.15.57:0/102428512 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3531 (secure 0 0 0) 0x7f4328026020 con 0x7f43380fe990 2023-03-02T10:54:46.897 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:46.897 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-03-02T10:54:46.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 -- 172.21.15.57:0/102428512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f432009b3a0 msgr2=0x7f432009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:46.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f432009b3a0 0x7f432009d850 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f432c00b2e0 tx=0x7f432c005fb0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 -- 172.21.15.57:0/102428512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43380fe990 msgr2=0x7f43381979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:46.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43380fe990 0x7f43381979e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f432800e9a0 tx=0x7f432800ecb0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 -- 172.21.15.57:0/102428512 shutdown_connections 2023-03-02T10:54:46.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f432009b3a0 0x7f432009d850 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43381005d0 0x7f433819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43380fe990 0x7f43381979e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 --2- 172.21.15.57:0/102428512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43380ffc20 0x7f4338197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:46.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 -- 172.21.15.57:0/102428512 >> 172.21.15.57:0/102428512 conn(0x7f43380f9fd0 msgr2=0x7f43380676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:46.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 -- 172.21.15.57:0/102428512 shutdown_connections 2023-03-02T10:54:46.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:46.898+0000 7f433ddff700 1 -- 172.21.15.57:0/102428512 wait complete. 2023-03-02T10:54:46.901 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2023-03-02T10:54:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:46 smithi057 ceph-mon[92072]: Deploying daemon mds.e on smithi122 2023-03-02T10:54:47.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:46 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.57:6836/3098678156,v1:172.21.15.57:6837/3098678156] up:boot 2023-03-02T10:54:47.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:46 smithi057 ceph-mon[92072]: fsmap 4 up:standby 2023-03-02T10:54:47.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:46 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-02T10:54:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:46 smithi122 ceph-mon[125440]: Deploying daemon mds.e on smithi122 2023-03-02T10:54:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:46 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.57:6836/3098678156,v1:172.21.15.57:6837/3098678156] up:boot 2023-03-02T10:54:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:46 smithi122 ceph-mon[125440]: fsmap 4 up:standby 2023-03-02T10:54:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:46 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-02T10:54:47.203 INFO:journalctl@ceph.mds.e.smithi122.stdout:Mar 02 10:54:47 smithi122 systemd[1]: Starting Ceph mds.e for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:54:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:46 smithi136 ceph-mon[125702]: Deploying daemon mds.e on smithi122 2023-03-02T10:54:47.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:46 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.57:6836/3098678156,v1:172.21.15.57:6837/3098678156] up:boot 2023-03-02T10:54:47.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:46 smithi136 ceph-mon[125702]: fsmap 4 up:standby 2023-03-02T10:54:47.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:46 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-02T10:54:47.582 INFO:journalctl@ceph.mds.e.smithi122.stdout:Mar 02 10:54:47 smithi122 podman[150226]: 2023-03-02T10:54:47.888 INFO:journalctl@ceph.mds.e.smithi122.stdout:Mar 02 10:54:47 smithi122 bash[150226]: fa7ee93894ca8f4e44519fc45fd3fe1ae9428ce6e79d1afaa7269314537d191e 2023-03-02T10:54:47.888 INFO:journalctl@ceph.mds.e.smithi122.stdout:Mar 02 10:54:47 smithi122 ceph-mds[150264]: -- 172.21.15.122:0/145660492 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560ca1bc6b60 con 0x560ca1b9a800 2023-03-02T10:54:47.889 INFO:journalctl@ceph.mds.e.smithi122.stdout:Mar 02 10:54:47 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-e[150242]: starting mds.e at 2023-03-02T10:54:47.889 INFO:journalctl@ceph.mds.e.smithi122.stdout:Mar 02 10:54:47 smithi122 systemd[1]: Started Ceph mds.e for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:54:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:47 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/102428512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:47 smithi057 ceph-mon[92072]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:47 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:47 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/102428512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:47 smithi122 ceph-mon[125440]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:47 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:47 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/102428512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:47 smithi136 ceph-mon[125702]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:47 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:48.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:54:48.930 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:48 smithi136 ceph-mon[125702]: Deploying daemon mds.f on smithi136 2023-03-02T10:54:48.930 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:48 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] up:boot 2023-03-02T10:54:48.930 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:48 smithi136 ceph-mon[125702]: fsmap 5 up:standby 2023-03-02T10:54:48.931 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:48 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-02T10:54:49.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.085+0000 7efe29fff700 1 -- 172.21.15.57:0/1347850511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe24100d50 msgr2=0x7efe241011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:49.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.085+0000 7efe29fff700 1 --2- 172.21.15.57:0/1347850511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe24100d50 0x7efe241011c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efe18009990 tx=0x7efe18009ca0 comp rx=0 tx=0).stop 2023-03-02T10:54:49.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.085+0000 7efe29fff700 1 -- 172.21.15.57:0/1347850511 shutdown_connections 2023-03-02T10:54:49.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.085+0000 7efe29fff700 1 --2- 172.21.15.57:0/1347850511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe24101700 0x7efe24107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:49.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.085+0000 7efe29fff700 1 --2- 172.21.15.57:0/1347850511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe240ffac0 0x7efe240ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:49.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.085+0000 7efe29fff700 1 --2- 172.21.15.57:0/1347850511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe24100d50 0x7efe241011c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:49.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.085+0000 7efe29fff700 1 -- 172.21.15.57:0/1347850511 >> 172.21.15.57:0/1347850511 conn(0x7efe240fb0c0 msgr2=0x7efe240fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:49.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.085+0000 7efe29fff700 1 -- 172.21.15.57:0/1347850511 shutdown_connections 2023-03-02T10:54:49.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.085+0000 7efe29fff700 1 -- 172.21.15.57:0/1347850511 wait complete. 2023-03-02T10:54:49.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.086+0000 7efe29fff700 1 Processor -- start 2023-03-02T10:54:49.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.086+0000 7efe29fff700 1 -- start start 2023-03-02T10:54:49.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.086+0000 7efe29fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe240ffac0 0x7efe24074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:49.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.086+0000 7efe29fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe24100d50 0x7efe24072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:49.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.086+0000 7efe29fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe24101700 0x7efe24072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:49.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.086+0000 7efe29fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe24073660 con 0x7efe240ffac0 2023-03-02T10:54:49.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.086+0000 7efe29fff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe240737d0 con 0x7efe24100d50 2023-03-02T10:54:49.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.086+0000 7efe29fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2419f8a0 con 0x7efe24101700 2023-03-02T10:54:49.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.086+0000 7efe237fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe240ffac0 0x7efe24074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:49.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe237fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe240ffac0 0x7efe24074340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38214/0 (socket says 172.21.15.57:38214) 2023-03-02T10:54:49.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe237fe700 1 -- 172.21.15.57:0/121162468 learned_addr learned my addr 172.21.15.57:0/121162468 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:49.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe22ffd700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe24100d50 0x7efe24072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:49.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe237fe700 1 -- 172.21.15.57:0/121162468 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe24101700 msgr2=0x7efe24072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:49.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe237fe700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe24101700 0x7efe24072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:49.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe237fe700 1 -- 172.21.15.57:0/121162468 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe24100d50 msgr2=0x7efe24072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:49.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe237fe700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe24100d50 0x7efe24072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:49.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe237fe700 1 -- 172.21.15.57:0/121162468 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe180095f0 con 0x7efe240ffac0 2023-03-02T10:54:49.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe237fe700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe240ffac0 0x7efe24074340 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe1400d980 tx=0x7efe1400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:49.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe20ff9700 1 -- 172.21.15.57:0/121162468 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14004220 con 0x7efe240ffac0 2023-03-02T10:54:49.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe20ff9700 1 -- 172.21.15.57:0/121162468 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe14007640 con 0x7efe240ffac0 2023-03-02T10:54:49.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe29fff700 1 -- 172.21.15.57:0/121162468 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2410b470 con 0x7efe240ffac0 2023-03-02T10:54:49.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe20ff9700 1 -- 172.21.15.57:0/121162468 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14004e60 con 0x7efe240ffac0 2023-03-02T10:54:49.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.087+0000 7efe29fff700 1 -- 172.21.15.57:0/121162468 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2410b2e0 con 0x7efe240ffac0 2023-03-02T10:54:49.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.088+0000 7efe29fff700 1 -- 172.21.15.57:0/121162468 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe24106ae0 con 0x7efe240ffac0 2023-03-02T10:54:49.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.090+0000 7efe20ff9700 1 -- 172.21.15.57:0/121162468 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7efe14021070 con 0x7efe240ffac0 2023-03-02T10:54:49.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.091+0000 7efe20ff9700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efe0c09b420 0x7efe0c09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:49.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.091+0000 7efe20ff9700 1 -- 172.21.15.57:0/121162468 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7efe140c4850 con 0x7efe240ffac0 2023-03-02T10:54:49.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.091+0000 7efe22ffd700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efe0c09b420 0x7efe0c09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:49.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.091+0000 7efe22ffd700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efe0c09b420 0x7efe0c09d8d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe1800b2e0 tx=0x7efe18005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:49.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.095+0000 7efe20ff9700 1 -- 172.21.15.57:0/121162468 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7efe14090570 con 0x7efe240ffac0 2023-03-02T10:54:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:48 smithi057 ceph-mon[92072]: Deploying daemon mds.f on smithi136 2023-03-02T10:54:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:48 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] up:boot 2023-03-02T10:54:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:48 smithi057 ceph-mon[92072]: fsmap 5 up:standby 2023-03-02T10:54:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:48 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-02T10:54:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:48 smithi122 ceph-mon[125440]: Deploying daemon mds.f on smithi136 2023-03-02T10:54:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:48 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] up:boot 2023-03-02T10:54:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:48 smithi122 ceph-mon[125440]: fsmap 5 up:standby 2023-03-02T10:54:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:48 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-02T10:54:49.341 INFO:journalctl@ceph.mds.f.smithi136.stdout:Mar 02 10:54:49 smithi136 systemd[1]: Starting Ceph mds.f for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:54:49.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.343+0000 7efe29fff700 1 -- 172.21.15.57:0/121162468 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe24061450 con 0x7efe240ffac0 2023-03-02T10:54:49.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.343+0000 7efe20ff9700 1 -- 172.21.15.57:0/121162468 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4291 (secure 0 0 0) 0x7efe14016020 con 0x7efe240ffac0 2023-03-02T10:54:49.344 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:49.345 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24491,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2023-03-02T10:54:49.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.345+0000 7efe29fff700 1 -- 172.21.15.57:0/121162468 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efe0c09b420 msgr2=0x7efe0c09d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:49.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.345+0000 7efe29fff700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efe0c09b420 0x7efe0c09d8d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe1800b2e0 tx=0x7efe18005fb0 comp rx=0 tx=0).stop 2023-03-02T10:54:49.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.345+0000 7efe29fff700 1 -- 172.21.15.57:0/121162468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe240ffac0 msgr2=0x7efe24074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:49.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.345+0000 7efe29fff700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe240ffac0 0x7efe24074340 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe1400d980 tx=0x7efe1400dd40 comp rx=0 tx=0).stop 2023-03-02T10:54:49.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.345+0000 7efe29fff700 1 -- 172.21.15.57:0/121162468 shutdown_connections 2023-03-02T10:54:49.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.345+0000 7efe29fff700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efe0c09b420 0x7efe0c09d8d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:49.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.345+0000 7efe29fff700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe24101700 0x7efe24072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:49.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.345+0000 7efe29fff700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe240ffac0 0x7efe24074340 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:49.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.345+0000 7efe29fff700 1 --2- 172.21.15.57:0/121162468 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe24100d50 0x7efe24072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:49.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.345+0000 7efe29fff700 1 -- 172.21.15.57:0/121162468 >> 172.21.15.57:0/121162468 conn(0x7efe240fb0c0 msgr2=0x7efe240fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:49.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.346+0000 7efe29fff700 1 -- 172.21.15.57:0/121162468 shutdown_connections 2023-03-02T10:54:49.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:49.346+0000 7efe29fff700 1 -- 172.21.15.57:0/121162468 wait complete. 2023-03-02T10:54:49.349 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 6 2023-03-02T10:54:49.729 INFO:journalctl@ceph.mds.f.smithi136.stdout:Mar 02 10:54:49 smithi136 podman[151179]: 2023-03-02T10:54:50.090 INFO:journalctl@ceph.mds.f.smithi136.stdout:Mar 02 10:54:49 smithi136 bash[151179]: 19342c197c893a9f161d945f7a8e9e8c1084444add4be5a0c6587caff2f55124 2023-03-02T10:54:50.091 INFO:journalctl@ceph.mds.f.smithi136.stdout:Mar 02 10:54:49 smithi136 ceph-mds[151218]: -- 172.21.15.136:0/1836365418 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5632c7d28b60 con 0x5632c7cfd000 2023-03-02T10:54:50.091 INFO:journalctl@ceph.mds.f.smithi136.stdout:Mar 02 10:54:49 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-f[151195]: starting mds.f at 2023-03-02T10:54:50.091 INFO:journalctl@ceph.mds.f.smithi136.stdout:Mar 02 10:54:49 smithi136 systemd[1]: Started Ceph mds.f for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:54:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:49 smithi136 ceph-mon[125702]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:49 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/121162468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:50.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:50.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:50.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:50.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:50.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:49 smithi057 ceph-mon[92072]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:49 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/121162468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:49 smithi122 ceph-mon[125440]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:49 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/121162468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:51.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:50 smithi136 ceph-mon[125702]: Deploying daemon mds.c on smithi136 2023-03-02T10:54:51.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:50 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] up:boot 2023-03-02T10:54:51.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:50 smithi136 ceph-mon[125702]: fsmap 6 up:standby 2023-03-02T10:54:51.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:50 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-02T10:54:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:50 smithi057 ceph-mon[92072]: Deploying daemon mds.c on smithi136 2023-03-02T10:54:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:50 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] up:boot 2023-03-02T10:54:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:50 smithi057 ceph-mon[92072]: fsmap 6 up:standby 2023-03-02T10:54:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-02T10:54:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:50 smithi122 ceph-mon[125440]: Deploying daemon mds.c on smithi136 2023-03-02T10:54:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:50 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] up:boot 2023-03-02T10:54:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:50 smithi122 ceph-mon[125440]: fsmap 6 up:standby 2023-03-02T10:54:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:50 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-02T10:54:51.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:54:51.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.531+0000 7f42a33ff700 1 -- 172.21.15.57:0/1651799694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f429c100cb0 msgr2=0x7f429c101100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:51.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.531+0000 7f42a33ff700 1 --2- 172.21.15.57:0/1651799694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f429c100cb0 0x7f429c101100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f428c009990 tx=0x7f428c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:54:51.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.531+0000 7f42a33ff700 1 -- 172.21.15.57:0/1651799694 shutdown_connections 2023-03-02T10:54:51.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.531+0000 7f42a33ff700 1 --2- 172.21.15.57:0/1651799694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f429c101640 0x7f429c107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:51.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.531+0000 7f42a33ff700 1 --2- 172.21.15.57:0/1651799694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f429c0ffac0 0x7f429c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:51.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.531+0000 7f42a33ff700 1 --2- 172.21.15.57:0/1651799694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f429c100cb0 0x7f429c101100 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:51.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.531+0000 7f42a33ff700 1 -- 172.21.15.57:0/1651799694 >> 172.21.15.57:0/1651799694 conn(0x7f429c0fb0c0 msgr2=0x7f429c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:51.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.531+0000 7f42a33ff700 1 -- 172.21.15.57:0/1651799694 shutdown_connections 2023-03-02T10:54:51.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.531+0000 7f42a33ff700 1 -- 172.21.15.57:0/1651799694 wait complete. 2023-03-02T10:54:51.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a33ff700 1 Processor -- start 2023-03-02T10:54:51.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a33ff700 1 -- start start 2023-03-02T10:54:51.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a33ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f429c0ffac0 0x7f429c195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:51.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a33ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f429c100cb0 0x7f429c195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:51.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a33ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f429c101640 0x7f429c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:51.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a33ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c19d3f0 con 0x7f429c101640 2023-03-02T10:54:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a33ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c19d530 con 0x7f429c100cb0 2023-03-02T10:54:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a33ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c19d6c0 con 0x7f429c0ffac0 2023-03-02T10:54:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a199c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f429c101640 0x7f429c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a119b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f429c0ffac0 0x7f429c195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a199c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f429c101640 0x7f429c19ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38226/0 (socket says 172.21.15.57:38226) 2023-03-02T10:54:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a199c700 1 -- 172.21.15.57:0/1497418968 learned_addr learned my addr 172.21.15.57:0/1497418968 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a099a700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f429c100cb0 0x7f429c195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:51.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a199c700 1 -- 172.21.15.57:0/1497418968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f429c0ffac0 msgr2=0x7f429c195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:51.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a199c700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f429c0ffac0 0x7f429c195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:51.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a199c700 1 -- 172.21.15.57:0/1497418968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f429c100cb0 msgr2=0x7f429c195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:51.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a199c700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f429c100cb0 0x7f429c195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:51.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.532+0000 7f42a199c700 1 -- 172.21.15.57:0/1497418968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c0095f0 con 0x7f429c101640 2023-03-02T10:54:51.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.533+0000 7f42a199c700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f429c101640 0x7f429c19ce20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f429400ef30 tx=0x7f429400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:51.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.533+0000 7f42927fc700 1 -- 172.21.15.57:0/1497418968 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4294018070 con 0x7f429c101640 2023-03-02T10:54:51.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.533+0000 7f42927fc700 1 -- 172.21.15.57:0/1497418968 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f429400f040 con 0x7f429c101640 2023-03-02T10:54:51.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.533+0000 7f42927fc700 1 -- 172.21.15.57:0/1497418968 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429400cd00 con 0x7f429c101640 2023-03-02T10:54:51.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.533+0000 7f42a33ff700 1 -- 172.21.15.57:0/1497418968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c10b490 con 0x7f429c101640 2023-03-02T10:54:51.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.533+0000 7f42a33ff700 1 -- 172.21.15.57:0/1497418968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c10b300 con 0x7f429c101640 2023-03-02T10:54:51.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.534+0000 7f42a33ff700 1 -- 172.21.15.57:0/1497418968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429c106a40 con 0x7f429c101640 2023-03-02T10:54:51.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.535+0000 7f42927fc700 1 -- 172.21.15.57:0/1497418968 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f4294003a00 con 0x7f429c101640 2023-03-02T10:54:51.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.536+0000 7f42927fc700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f428809b3a0 0x7f428809d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:51.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.536+0000 7f42927fc700 1 -- 172.21.15.57:0/1497418968 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f42940c4830 con 0x7f429c101640 2023-03-02T10:54:51.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.537+0000 7f42a119b700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f428809b3a0 0x7f428809d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:51.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.537+0000 7f42a119b700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f428809b3a0 0x7f428809d850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f429c100b10 tx=0x7f429800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:51.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.540+0000 7f42927fc700 1 -- 172.21.15.57:0/1497418968 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f42940905e0 con 0x7f429c101640 2023-03-02T10:54:51.590 INFO:journalctl@ceph.mds.c.smithi136.stdout:Mar 02 10:54:51 smithi136 systemd[1]: Starting Ceph mds.c for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:54:51.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.787+0000 7f42a33ff700 1 -- 172.21.15.57:0/1497418968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f429c02cd50 con 0x7f429c101640 2023-03-02T10:54:51.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.788+0000 7f42927fc700 1 -- 172.21.15.57:0/1497418968 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5051 (secure 0 0 0) 0x7f4294093c00 con 0x7f429c101640 2023-03-02T10:54:51.789 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:51.789 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24491,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2023-03-02T10:54:51.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 -- 172.21.15.57:0/1497418968 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f428809b3a0 msgr2=0x7f428809d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:51.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f428809b3a0 0x7f428809d850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f429c100b10 tx=0x7f429800b410 comp rx=0 tx=0).stop 2023-03-02T10:54:51.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 -- 172.21.15.57:0/1497418968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f429c101640 msgr2=0x7f429c19ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:51.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f429c101640 0x7f429c19ce20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f429400ef30 tx=0x7f429400c3a0 comp rx=0 tx=0).stop 2023-03-02T10:54:51.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 -- 172.21.15.57:0/1497418968 shutdown_connections 2023-03-02T10:54:51.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f428809b3a0 0x7f428809d850 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:51.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f429c101640 0x7f429c19ce20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:51.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f429c0ffac0 0x7f429c195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:51.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 --2- 172.21.15.57:0/1497418968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f429c100cb0 0x7f429c195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:51.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 -- 172.21.15.57:0/1497418968 >> 172.21.15.57:0/1497418968 conn(0x7f429c0fb0c0 msgr2=0x7f429c0fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:51.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 -- 172.21.15.57:0/1497418968 shutdown_connections 2023-03-02T10:54:51.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:51.790+0000 7f42a33ff700 1 -- 172.21.15.57:0/1497418968 wait complete. 2023-03-02T10:54:51.793 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2023-03-02T10:54:51.862 INFO:journalctl@ceph.mds.c.smithi136.stdout:Mar 02 10:54:51 smithi136 podman[151516]: 2023-03-02T10:54:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:51 smithi057 ceph-mon[92072]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:51 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1497418968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:51 smithi122 ceph-mon[125440]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:51 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1497418968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:51 smithi136 ceph-mon[125702]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:51 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1497418968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:52.341 INFO:journalctl@ceph.mds.c.smithi136.stdout:Mar 02 10:54:51 smithi136 bash[151516]: 76a79272ea98b58a6e1000466456d2f24e63f7757c04adcabd1e4435e32b5ae4 2023-03-02T10:54:52.341 INFO:journalctl@ceph.mds.c.smithi136.stdout:Mar 02 10:54:51 smithi136 ceph-mds[151555]: -- 172.21.15.136:0/3447793651 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5638ecf3cb60 con 0x5638ecf11000 2023-03-02T10:54:52.341 INFO:journalctl@ceph.mds.c.smithi136.stdout:Mar 02 10:54:51 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-c[151532]: starting mds.c at 2023-03-02T10:54:52.341 INFO:journalctl@ceph.mds.c.smithi136.stdout:Mar 02 10:54:51 smithi136 systemd[1]: Started Ceph mds.c for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:54:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:52 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] up:boot 2023-03-02T10:54:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:52 smithi057 ceph-mon[92072]: fsmap 7 up:standby 2023-03-02T10:54:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-02T10:54:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:52 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:52 smithi057 ceph-mon[92072]: Deploying daemon mds.h on smithi122 2023-03-02T10:54:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:52 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] up:boot 2023-03-02T10:54:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:52 smithi122 ceph-mon[125440]: fsmap 7 up:standby 2023-03-02T10:54:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-02T10:54:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:53.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:53.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:53.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:52 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:53.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:52 smithi122 ceph-mon[125440]: Deploying daemon mds.h on smithi122 2023-03-02T10:54:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:52 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] up:boot 2023-03-02T10:54:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:52 smithi136 ceph-mon[125702]: fsmap 7 up:standby 2023-03-02T10:54:53.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-02T10:54:53.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:53.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:53.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:53.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:53.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:52 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:53.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:52 smithi136 ceph-mon[125702]: Deploying daemon mds.h on smithi122 2023-03-02T10:54:53.539 INFO:journalctl@ceph.mds.h.smithi122.stdout:Mar 02 10:54:53 smithi122 systemd[1]: Starting Ceph mds.h for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:54:53.807 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:54:53.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.974+0000 7f4d103ff700 1 -- 172.21.15.57:0/1089184663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d08100d50 msgr2=0x7f4d081011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:53.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.974+0000 7f4d103ff700 1 --2- 172.21.15.57:0/1089184663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d08100d50 0x7f4d081011c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009990 tx=0x7f4cf8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:54:53.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.974+0000 7f4d103ff700 1 -- 172.21.15.57:0/1089184663 shutdown_connections 2023-03-02T10:54:53.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.974+0000 7f4d103ff700 1 --2- 172.21.15.57:0/1089184663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d08101700 0x7f4d08107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:53.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.974+0000 7f4d103ff700 1 --2- 172.21.15.57:0/1089184663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d080ffac0 0x7f4d080ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:53.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.974+0000 7f4d103ff700 1 --2- 172.21.15.57:0/1089184663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d08100d50 0x7f4d081011c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:53.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.974+0000 7f4d103ff700 1 -- 172.21.15.57:0/1089184663 >> 172.21.15.57:0/1089184663 conn(0x7f4d080fb0c0 msgr2=0x7f4d080fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:53.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.974+0000 7f4d103ff700 1 -- 172.21.15.57:0/1089184663 shutdown_connections 2023-03-02T10:54:53.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.974+0000 7f4d103ff700 1 -- 172.21.15.57:0/1089184663 wait complete. 2023-03-02T10:54:53.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.975+0000 7f4d103ff700 1 Processor -- start 2023-03-02T10:54:53.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.975+0000 7f4d103ff700 1 -- start start 2023-03-02T10:54:53.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.975+0000 7f4d103ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d080ffac0 0x7f4d08074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:53.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.975+0000 7f4d103ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d08100d50 0x7f4d08072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:53.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.975+0000 7f4d103ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d08101700 0x7f4d08072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:53.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.975+0000 7f4d103ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08073660 con 0x7f4d08100d50 2023-03-02T10:54:53.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.975+0000 7f4d103ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080737d0 con 0x7f4d08101700 2023-03-02T10:54:53.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d103ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0819f7d0 con 0x7f4d080ffac0 2023-03-02T10:54:53.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0d99a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d08100d50 0x7f4d08072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:53.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0d99a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d08100d50 0x7f4d08072980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38252/0 (socket says 172.21.15.57:38252) 2023-03-02T10:54:53.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0d99a700 1 -- 172.21.15.57:0/3458612945 learned_addr learned my addr 172.21.15.57:0/3458612945 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:53.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0e19b700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d080ffac0 0x7f4d08074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:53.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0e99c700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d08101700 0x7f4d08072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:53.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0d99a700 1 -- 172.21.15.57:0/3458612945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d080ffac0 msgr2=0x7f4d08074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:53.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0d99a700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d080ffac0 0x7f4d08074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:53.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0d99a700 1 -- 172.21.15.57:0/3458612945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d08101700 msgr2=0x7f4d08072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0d99a700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d08101700 0x7f4d08072ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0d99a700 1 -- 172.21.15.57:0/3458612945 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d04009520 con 0x7f4d08100d50 2023-03-02T10:54:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0e99c700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d08101700 0x7f4d08072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:54:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d0d99a700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d08100d50 0x7f4d08072980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000c00 tx=0x7f4cf800f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4cff7fe700 1 -- 172.21.15.57:0/3458612945 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf801d070 con 0x7f4d08100d50 2023-03-02T10:54:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4d103ff700 1 -- 172.21.15.57:0/3458612945 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf80095f0 con 0x7f4d08100d50 2023-03-02T10:54:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4cff7fe700 1 -- 172.21.15.57:0/3458612945 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4cf800fc00 con 0x7f4d08100d50 2023-03-02T10:54:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.976+0000 7f4cff7fe700 1 -- 172.21.15.57:0/3458612945 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8017650 con 0x7f4d08100d50 2023-03-02T10:54:53.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.977+0000 7f4d103ff700 1 -- 172.21.15.57:0/3458612945 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0810b420 con 0x7f4d08100d50 2023-03-02T10:54:53.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.978+0000 7f4d103ff700 1 -- 172.21.15.57:0/3458612945 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d08106a60 con 0x7f4d08100d50 2023-03-02T10:54:53.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.979+0000 7f4cff7fe700 1 -- 172.21.15.57:0/3458612945 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f4cf8028030 con 0x7f4d08100d50 2023-03-02T10:54:53.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.980+0000 7f4cff7fe700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4cf409b3a0 0x7f4cf409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:53.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.980+0000 7f4cff7fe700 1 -- 172.21.15.57:0/3458612945 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4cf80c5f50 con 0x7f4d08100d50 2023-03-02T10:54:53.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.980+0000 7f4d0e19b700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4cf409b3a0 0x7f4cf409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:53.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.980+0000 7f4d0e19b700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4cf409b3a0 0x7f4cf409d850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009df0 tx=0x7f4d04009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:53.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:53.984+0000 7f4cff7fe700 1 -- 172.21.15.57:0/3458612945 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f4cf8091d00 con 0x7f4d08100d50 2023-03-02T10:54:54.097 INFO:journalctl@ceph.mds.h.smithi122.stdout:Mar 02 10:54:53 smithi122 podman[150570]: 2023-03-02T10:54:54.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.232+0000 7f4d103ff700 1 -- 172.21.15.57:0/3458612945 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d0819f9c0 con 0x7f4d08100d50 2023-03-02T10:54:54.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.233+0000 7f4cff7fe700 1 -- 172.21.15.57:0/3458612945 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5811 (secure 0 0 0) 0x7f4cf8095320 con 0x7f4d08100d50 2023-03-02T10:54:54.234 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:54.234 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24491,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-03-02T10:54:54.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 -- 172.21.15.57:0/3458612945 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4cf409b3a0 msgr2=0x7f4cf409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:54.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4cf409b3a0 0x7f4cf409d850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009df0 tx=0x7f4d04009260 comp rx=0 tx=0).stop 2023-03-02T10:54:54.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 -- 172.21.15.57:0/3458612945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d08100d50 msgr2=0x7f4d08072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:54.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d08100d50 0x7f4d08072980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000c00 tx=0x7f4cf800f460 comp rx=0 tx=0).stop 2023-03-02T10:54:54.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 -- 172.21.15.57:0/3458612945 shutdown_connections 2023-03-02T10:54:54.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4cf409b3a0 0x7f4cf409d850 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:54.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d08101700 0x7f4d08072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:54.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d080ffac0 0x7f4d08074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:54.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 --2- 172.21.15.57:0/3458612945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d08100d50 0x7f4d08072980 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:54.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 -- 172.21.15.57:0/3458612945 >> 172.21.15.57:0/3458612945 conn(0x7f4d080fb0c0 msgr2=0x7f4d080fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:54.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 -- 172.21.15.57:0/3458612945 shutdown_connections 2023-03-02T10:54:54.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:54.235+0000 7f4d103ff700 1 -- 172.21.15.57:0/3458612945 wait complete. 2023-03-02T10:54:54.238 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-03-02T10:54:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:54 smithi122 ceph-mon[125440]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:54 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:54 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:54 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:54 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:54 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:54 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3458612945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:54.453 INFO:journalctl@ceph.mds.h.smithi122.stdout:Mar 02 10:54:54 smithi122 bash[150570]: 889d096c2b06775203ea46712586a77a12e714f02543581fbded5bb9fbccc28e 2023-03-02T10:54:54.453 INFO:journalctl@ceph.mds.h.smithi122.stdout:Mar 02 10:54:54 smithi122 ceph-mds[150610]: -- 172.21.15.122:0/2889984122 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d629a32b60 con 0x55d629a06800 2023-03-02T10:54:54.453 INFO:journalctl@ceph.mds.h.smithi122.stdout:Mar 02 10:54:54 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-h[150587]: starting mds.h at 2023-03-02T10:54:54.453 INFO:journalctl@ceph.mds.h.smithi122.stdout:Mar 02 10:54:54 smithi122 systemd[1]: Started Ceph mds.h for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:54:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:54 smithi136 ceph-mon[125702]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:54 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:54 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:54 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:54 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:54 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:54 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3458612945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:54 smithi057 ceph-mon[92072]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:54 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:54 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:54 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:54 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:54 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:54 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3458612945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:55.471 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:55 smithi136 ceph-mon[125702]: Deploying daemon mds.i on smithi136 2023-03-02T10:54:55.471 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:55 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.122:6836/2380932917,v1:172.21.15.122:6837/2380932917] up:boot 2023-03-02T10:54:55.471 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:55 smithi136 ceph-mon[125702]: fsmap 8 up:standby 2023-03-02T10:54:55.471 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:55 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-02T10:54:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:55 smithi057 ceph-mon[92072]: Deploying daemon mds.i on smithi136 2023-03-02T10:54:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:55 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.122:6836/2380932917,v1:172.21.15.122:6837/2380932917] up:boot 2023-03-02T10:54:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:55 smithi057 ceph-mon[92072]: fsmap 8 up:standby 2023-03-02T10:54:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:55 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-02T10:54:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:55 smithi122 ceph-mon[125440]: Deploying daemon mds.i on smithi136 2023-03-02T10:54:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:55 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.122:6836/2380932917,v1:172.21.15.122:6837/2380932917] up:boot 2023-03-02T10:54:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:55 smithi122 ceph-mon[125440]: fsmap 8 up:standby 2023-03-02T10:54:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:55 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-02T10:54:56.082 INFO:journalctl@ceph.mds.i.smithi136.stdout:Mar 02 10:54:55 smithi136 systemd[1]: Starting Ceph mds.i for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:54:56.253 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:54:56.336 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:56 smithi136 ceph-mon[125702]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:56.336 INFO:journalctl@ceph.mds.i.smithi136.stdout:Mar 02 10:54:56 smithi136 podman[151856]: 2023-03-02T10:54:56.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.423+0000 7f762bdff700 1 -- 172.21.15.57:0/1818221586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76241005b0 msgr2=0x7f7624102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:56.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.423+0000 7f762bdff700 1 --2- 172.21.15.57:0/1818221586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76241005b0 0x7f7624102990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76200098f0 tx=0x7f7620009c00 comp rx=0 tx=0).stop 2023-03-02T10:54:56.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.423+0000 7f762bdff700 1 -- 172.21.15.57:0/1818221586 shutdown_connections 2023-03-02T10:54:56.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.423+0000 7f762bdff700 1 --2- 172.21.15.57:0/1818221586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76241057f0 0x7f7624107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:56.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.423+0000 7f762bdff700 1 --2- 172.21.15.57:0/1818221586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76241005b0 0x7f7624102990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:56.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.423+0000 7f762bdff700 1 --2- 172.21.15.57:0/1818221586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7624102ed0 0x7f76241052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:56.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.423+0000 7f762bdff700 1 -- 172.21.15.57:0/1818221586 >> 172.21.15.57:0/1818221586 conn(0x7f76240f9fd0 msgr2=0x7f76240fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:56.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.423+0000 7f762bdff700 1 -- 172.21.15.57:0/1818221586 shutdown_connections 2023-03-02T10:54:56.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.423+0000 7f762bdff700 1 -- 172.21.15.57:0/1818221586 wait complete. 2023-03-02T10:54:56.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.423+0000 7f762bdff700 1 Processor -- start 2023-03-02T10:54:56.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f762bdff700 1 -- start start 2023-03-02T10:54:56.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f762bdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76241005b0 0x7f7624197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:56.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f762bdff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7624102ed0 0x7f7624198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:56.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f762bdff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76241057f0 0x7f762419f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:56.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f762bdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762419f650 con 0x7f76241005b0 2023-03-02T10:54:56.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f762bdff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762419f790 con 0x7f76241057f0 2023-03-02T10:54:56.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f762bdff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762419f920 con 0x7f7624102ed0 2023-03-02T10:54:56.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f7629b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76241005b0 0x7f7624197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:56.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f762939a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7624102ed0 0x7f7624198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:56.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f7629b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76241005b0 0x7f7624197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57990/0 (socket says 172.21.15.57:57990) 2023-03-02T10:54:56.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f7629b9b700 1 -- 172.21.15.57:0/95946033 learned_addr learned my addr 172.21.15.57:0/95946033 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:56.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f762a39c700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76241057f0 0x7f762419f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f7629b9b700 1 -- 172.21.15.57:0/95946033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7624102ed0 msgr2=0x7f7624198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f7629b9b700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7624102ed0 0x7f7624198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f7629b9b700 1 -- 172.21.15.57:0/95946033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76241057f0 msgr2=0x7f762419f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f7629b9b700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76241057f0 0x7f762419f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.424+0000 7f7629b9b700 1 -- 172.21.15.57:0/95946033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7620009520 con 0x7f76241005b0 2023-03-02T10:54:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.425+0000 7f762939a700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7624102ed0 0x7f7624198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:54:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.425+0000 7f7629b9b700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76241005b0 0x7f7624197ad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7620009fd0 tx=0x7f762000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.425+0000 7f761affd700 1 -- 172.21.15.57:0/95946033 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762001c070 con 0x7f76241005b0 2023-03-02T10:54:56.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.425+0000 7f761affd700 1 -- 172.21.15.57:0/95946033 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f762000f820 con 0x7f76241005b0 2023-03-02T10:54:56.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.425+0000 7f762bdff700 1 -- 172.21.15.57:0/95946033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762410b450 con 0x7f76241005b0 2023-03-02T10:54:56.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.425+0000 7f761affd700 1 -- 172.21.15.57:0/95946033 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620003b20 con 0x7f76241005b0 2023-03-02T10:54:56.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.425+0000 7f762bdff700 1 -- 172.21.15.57:0/95946033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762410b2c0 con 0x7f76241005b0 2023-03-02T10:54:56.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.426+0000 7f762bdff700 1 -- 172.21.15.57:0/95946033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7624107360 con 0x7f76241005b0 2023-03-02T10:54:56.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.428+0000 7f761affd700 1 -- 172.21.15.57:0/95946033 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f7620029020 con 0x7f76241005b0 2023-03-02T10:54:56.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.429+0000 7f761affd700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f761009b3a0 0x7f761009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:56.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.429+0000 7f761affd700 1 -- 172.21.15.57:0/95946033 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f76200c60c0 con 0x7f76241005b0 2023-03-02T10:54:56.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.429+0000 7f762939a700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f761009b3a0 0x7f761009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:56.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.429+0000 7f762939a700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f761009b3a0 0x7f761009d850 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7614005950 tx=0x7f761400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:56.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.431+0000 7f761affd700 1 -- 172.21.15.57:0/95946033 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f7620091e70 con 0x7f76241005b0 2023-03-02T10:54:56.590 INFO:journalctl@ceph.mds.i.smithi136.stdout:Mar 02 10:54:56 smithi136 bash[151856]: d150f7152eb0b397c3740fed056e5f4d0242b844355231a1720ca8bfab738290 2023-03-02T10:54:56.590 INFO:journalctl@ceph.mds.i.smithi136.stdout:Mar 02 10:54:56 smithi136 ceph-mds[151894]: -- 172.21.15.136:0/2184915550 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f0e04a0b60 con 0x55f0e0475000 2023-03-02T10:54:56.591 INFO:journalctl@ceph.mds.i.smithi136.stdout:Mar 02 10:54:56 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-i[151872]: starting mds.i at 2023-03-02T10:54:56.591 INFO:journalctl@ceph.mds.i.smithi136.stdout:Mar 02 10:54:56 smithi136 systemd[1]: Started Ceph mds.i for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:54:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:56 smithi057 ceph-mon[92072]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:56.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.691+0000 7f762bdff700 1 -- 172.21.15.57:0/95946033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76240613d0 con 0x7f76241005b0 2023-03-02T10:54:56.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.692+0000 7f761affd700 1 -- 172.21.15.57:0/95946033 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6571 (secure 0 0 0) 0x7f762000ba30 con 0x7f76241005b0 2023-03-02T10:54:56.693 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:56.693 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14598,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24491,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-03-02T10:54:56.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 -- 172.21.15.57:0/95946033 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f761009b3a0 msgr2=0x7f761009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:56.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f761009b3a0 0x7f761009d850 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7614005950 tx=0x7f761400b410 comp rx=0 tx=0).stop 2023-03-02T10:54:56.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 -- 172.21.15.57:0/95946033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76241005b0 msgr2=0x7f7624197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:56.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76241005b0 0x7f7624197ad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7620009fd0 tx=0x7f762000b790 comp rx=0 tx=0).stop 2023-03-02T10:54:56.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 -- 172.21.15.57:0/95946033 shutdown_connections 2023-03-02T10:54:56.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f761009b3a0 0x7f761009d850 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:56.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76241057f0 0x7f762419f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:56.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76241005b0 0x7f7624197ad0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:56.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 --2- 172.21.15.57:0/95946033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7624102ed0 0x7f7624198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:56.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 -- 172.21.15.57:0/95946033 >> 172.21.15.57:0/95946033 conn(0x7f76240f9fd0 msgr2=0x7f76240fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:56.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 -- 172.21.15.57:0/95946033 shutdown_connections 2023-03-02T10:54:56.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:56.694+0000 7f762bdff700 1 -- 172.21.15.57:0/95946033 wait complete. 2023-03-02T10:54:56.697 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2023-03-02T10:54:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:56 smithi122 ceph-mon[125440]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:57.609 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:57.609 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:57.609 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:57.609 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:57.610 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:57.610 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:57 smithi057 ceph-mon[92072]: Deploying daemon mds.g on smithi057 2023-03-02T10:54:57.610 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:57 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/95946033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:57.610 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:57 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] up:boot 2023-03-02T10:54:57.610 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:57 smithi057 ceph-mon[92072]: fsmap 9 up:standby 2023-03-02T10:54:57.610 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:57 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-02T10:54:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:57.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:57.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:57 smithi122 ceph-mon[125440]: Deploying daemon mds.g on smithi057 2023-03-02T10:54:57.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:57 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/95946033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:57.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:57 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] up:boot 2023-03-02T10:54:57.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:57 smithi122 ceph-mon[125440]: fsmap 9 up:standby 2023-03-02T10:54:57.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:57 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-02T10:54:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:54:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:54:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:54:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:54:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:57 smithi136 ceph-mon[125702]: Deploying daemon mds.g on smithi057 2023-03-02T10:54:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:57 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/95946033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:54:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:57 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] up:boot 2023-03-02T10:54:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:57 smithi136 ceph-mon[125702]: fsmap 9 up:standby 2023-03-02T10:54:57.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:57 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-02T10:54:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:54:58 smithi057 ceph-mon[92072]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:58.683 INFO:journalctl@ceph.mds.g.smithi057.stdout:Mar 02 10:54:58 smithi057 systemd[1]: Starting Ceph mds.g for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:54:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:54:58 smithi122 ceph-mon[125440]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:58.713 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:54:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:54:58 smithi136 ceph-mon[125702]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:54:58.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.878+0000 7f195efff700 1 -- 172.21.15.57:0/4028349000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1958102ed0 msgr2=0x7f19581052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:58.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.878+0000 7f195efff700 1 --2- 172.21.15.57:0/4028349000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1958102ed0 0x7f19581052b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f194000b0a0 tx=0x7f194000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:54:58.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.879+0000 7f195efff700 1 -- 172.21.15.57:0/4028349000 shutdown_connections 2023-03-02T10:54:58.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.879+0000 7f195efff700 1 --2- 172.21.15.57:0/4028349000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19581057f0 0x7f1958107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:58.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.879+0000 7f195efff700 1 --2- 172.21.15.57:0/4028349000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19581005b0 0x7f1958102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:58.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.879+0000 7f195efff700 1 --2- 172.21.15.57:0/4028349000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1958102ed0 0x7f19581052b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:58.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.879+0000 7f195efff700 1 -- 172.21.15.57:0/4028349000 >> 172.21.15.57:0/4028349000 conn(0x7f19580f9fd0 msgr2=0x7f19580fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:58.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.879+0000 7f195efff700 1 -- 172.21.15.57:0/4028349000 shutdown_connections 2023-03-02T10:54:58.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.879+0000 7f195efff700 1 -- 172.21.15.57:0/4028349000 wait complete. 2023-03-02T10:54:58.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.879+0000 7f195efff700 1 Processor -- start 2023-03-02T10:54:58.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.879+0000 7f195efff700 1 -- start start 2023-03-02T10:54:58.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195efff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19581005b0 0x7f19580fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:58.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195efff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1958102ed0 0x7f19580fe560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:58.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195efff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19581057f0 0x7f19580feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:58.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195efff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580ff240 con 0x7f19581057f0 2023-03-02T10:54:58.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195efff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580ff3b0 con 0x7f1958102ed0 2023-03-02T10:54:58.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195efff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195819f9f0 con 0x7f19581005b0 2023-03-02T10:54:58.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195d59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19581057f0 0x7f19580feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:58.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195d59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19581057f0 0x7f19580feaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57996/0 (socket says 172.21.15.57:57996) 2023-03-02T10:54:58.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195d59c700 1 -- 172.21.15.57:0/1556839903 learned_addr learned my addr 172.21.15.57:0/1556839903 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:54:58.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f1957fff700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1958102ed0 0x7f19580fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:58.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195cd9b700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19581005b0 0x7f19580fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:58.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195d59c700 1 -- 172.21.15.57:0/1556839903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19581005b0 msgr2=0x7f19580fff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:58.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195d59c700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19581005b0 0x7f19580fff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:58.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195d59c700 1 -- 172.21.15.57:0/1556839903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1958102ed0 msgr2=0x7f19580fe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:58.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195d59c700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1958102ed0 0x7f19580fe560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:58.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195d59c700 1 -- 172.21.15.57:0/1556839903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1940009d00 con 0x7f19581057f0 2023-03-02T10:54:58.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f1957fff700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1958102ed0 0x7f19580fe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:54:58.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.880+0000 7f195d59c700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19581057f0 0x7f19580feaa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f195000d6d0 tx=0x7f195000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:58.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.881+0000 7f1955ffb700 1 -- 172.21.15.57:0/1556839903 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950004a30 con 0x7f19581057f0 2023-03-02T10:54:58.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.881+0000 7f195efff700 1 -- 172.21.15.57:0/1556839903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195810b420 con 0x7f19581057f0 2023-03-02T10:54:58.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.881+0000 7f1955ffb700 1 -- 172.21.15.57:0/1556839903 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19500054e0 con 0x7f19581057f0 2023-03-02T10:54:58.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.881+0000 7f1955ffb700 1 -- 172.21.15.57:0/1556839903 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195000fb60 con 0x7f19581057f0 2023-03-02T10:54:58.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.881+0000 7f195efff700 1 -- 172.21.15.57:0/1556839903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195810b290 con 0x7f19581057f0 2023-03-02T10:54:58.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.882+0000 7f195efff700 1 -- 172.21.15.57:0/1556839903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19580fbb40 con 0x7f19581057f0 2023-03-02T10:54:58.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.883+0000 7f1955ffb700 1 -- 172.21.15.57:0/1556839903 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f1950021070 con 0x7f19581057f0 2023-03-02T10:54:58.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.884+0000 7f1955ffb700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f194409b3a0 0x7f194409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:54:58.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.884+0000 7f1955ffb700 1 -- 172.21.15.57:0/1556839903 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f19500c4530 con 0x7f19581057f0 2023-03-02T10:54:58.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.884+0000 7f195cd9b700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f194409b3a0 0x7f194409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:54:58.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.885+0000 7f195cd9b700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f194409b3a0 0x7f194409d850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1948005950 tx=0x7f19480058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:54:58.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:58.889+0000 7f1955ffb700 1 -- 172.21.15.57:0/1556839903 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f1950090250 con 0x7f19581057f0 2023-03-02T10:54:59.032 INFO:journalctl@ceph.mds.g.smithi057.stdout:Mar 02 10:54:58 smithi057 podman[126261]: 2023-03-02T10:54:59.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.165+0000 7f195efff700 1 -- 172.21.15.57:0/1556839903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1958061420 con 0x7f19581057f0 2023-03-02T10:54:59.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.166+0000 7f1955ffb700 1 -- 172.21.15.57:0/1556839903 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7333 (secure 0 0 0) 0x7f1950016090 con 0x7f19581057f0 2023-03-02T10:54:59.167 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:54:59.167 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14598,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24491,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24520,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-03-02T10:54:59.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 -- 172.21.15.57:0/1556839903 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f194409b3a0 msgr2=0x7f194409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:59.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f194409b3a0 0x7f194409d850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1948005950 tx=0x7f19480058e0 comp rx=0 tx=0).stop 2023-03-02T10:54:59.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 -- 172.21.15.57:0/1556839903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19581057f0 msgr2=0x7f19580feaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:54:59.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19581057f0 0x7f19580feaa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f195000d6d0 tx=0x7f195000da90 comp rx=0 tx=0).stop 2023-03-02T10:54:59.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 -- 172.21.15.57:0/1556839903 shutdown_connections 2023-03-02T10:54:59.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f194409b3a0 0x7f194409d850 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:59.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19581057f0 0x7f19580feaa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:59.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19581005b0 0x7f19580fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:59.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 --2- 172.21.15.57:0/1556839903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1958102ed0 0x7f19580fe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:54:59.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 -- 172.21.15.57:0/1556839903 >> 172.21.15.57:0/1556839903 conn(0x7f19580f9fd0 msgr2=0x7f19581012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:54:59.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 -- 172.21.15.57:0/1556839903 shutdown_connections 2023-03-02T10:54:59.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:54:59.168+0000 7f195efff700 1 -- 172.21.15.57:0/1556839903 wait complete. 2023-03-02T10:54:59.171 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 10 2023-03-02T10:54:59.432 INFO:journalctl@ceph.mds.g.smithi057.stdout:Mar 02 10:54:59 smithi057 bash[126261]: 531936c7007bfebdaf577214aec7cc4cfd29ebfb4e4116fce986f3b4fc79e5fe 2023-03-02T10:54:59.433 INFO:journalctl@ceph.mds.g.smithi057.stdout:Mar 02 10:54:59 smithi057 ceph-mds[126343]: -- 172.21.15.57:0/2273653145 <== mon.0 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562087e24b60 con 0x562087df9000 2023-03-02T10:54:59.433 INFO:journalctl@ceph.mds.g.smithi057.stdout:Mar 02 10:54:59 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-g[126305]: starting mds.g at 2023-03-02T10:54:59.433 INFO:journalctl@ceph.mds.g.smithi057.stdout:Mar 02 10:54:59 smithi057 systemd[1]: Started Ceph mds.g for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:55:00.263 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:00 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:00.264 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:00 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:00.264 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:00 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:55:00.264 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:00 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:55:00.264 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:00 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:00.264 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:00 smithi057 ceph-mon[92072]: Deploying daemon mds.a on smithi057 2023-03-02T10:55:00.264 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:00 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1556839903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:00.264 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:00 smithi057 ceph-mon[92072]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:00.265 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:00 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.57:6838/1832653465,v1:172.21.15.57:6839/1832653465] up:boot 2023-03-02T10:55:00.265 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:00 smithi057 ceph-mon[92072]: fsmap 10 up:standby 2023-03-02T10:55:00.265 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:00 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-02T10:55:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:00 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:00 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:00 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:55:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:00 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:55:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:00 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:00 smithi122 ceph-mon[125440]: Deploying daemon mds.a on smithi057 2023-03-02T10:55:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:00 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1556839903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:00 smithi122 ceph-mon[125440]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:00 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.57:6838/1832653465,v1:172.21.15.57:6839/1832653465] up:boot 2023-03-02T10:55:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:00 smithi122 ceph-mon[125440]: fsmap 10 up:standby 2023-03-02T10:55:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:00 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-02T10:55:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:00 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:00 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:00 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:00 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:00 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:00 smithi136 ceph-mon[125702]: Deploying daemon mds.a on smithi057 2023-03-02T10:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:00 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1556839903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:00 smithi136 ceph-mon[125702]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:00 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.57:6838/1832653465,v1:172.21.15.57:6839/1832653465] up:boot 2023-03-02T10:55:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:00 smithi136 ceph-mon[125702]: fsmap 10 up:standby 2023-03-02T10:55:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:00 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-02T10:55:01.182 INFO:journalctl@ceph.mds.a.smithi057.stdout:Mar 02 10:55:00 smithi057 systemd[1]: Starting Ceph mds.a for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:55:01.188 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:55:01.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.350+0000 7f54291ff700 1 -- 172.21.15.57:0/2830890390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5424102b60 msgr2=0x7f5424104fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:01.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.350+0000 7f54291ff700 1 --2- 172.21.15.57:0/2830890390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5424102b60 0x7f5424104fe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5418009990 tx=0x7f5418009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:01.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.350+0000 7f54291ff700 1 -- 172.21.15.57:0/2830890390 shutdown_connections 2023-03-02T10:55:01.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.350+0000 7f54291ff700 1 --2- 172.21.15.57:0/2830890390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5424105670 0x7f5424107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:01.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.350+0000 7f54291ff700 1 --2- 172.21.15.57:0/2830890390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54240683c0 0x7f5424102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:01.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.350+0000 7f54291ff700 1 --2- 172.21.15.57:0/2830890390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5424102b60 0x7f5424104fe0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:01.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.350+0000 7f54291ff700 1 -- 172.21.15.57:0/2830890390 >> 172.21.15.57:0/2830890390 conn(0x7f54240f9fd0 msgr2=0x7f54240fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:01.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.350+0000 7f54291ff700 1 -- 172.21.15.57:0/2830890390 shutdown_connections 2023-03-02T10:55:01.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.350+0000 7f54291ff700 1 -- 172.21.15.57:0/2830890390 wait complete. 2023-03-02T10:55:01.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.351+0000 7f54291ff700 1 Processor -- start 2023-03-02T10:55:01.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.351+0000 7f54291ff700 1 -- start start 2023-03-02T10:55:01.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.351+0000 7f54291ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54240683c0 0x7f5424195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:01.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.351+0000 7f54291ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5424102b60 0x7f5424195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:01.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.351+0000 7f54291ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5424105670 0x7f542419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:01.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.351+0000 7f54291ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542419d3f0 con 0x7f5424105670 2023-03-02T10:55:01.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.351+0000 7f54291ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542419d530 con 0x7f5424102b60 2023-03-02T10:55:01.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.351+0000 7f54291ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542419d6c0 con 0x7f54240683c0 2023-03-02T10:55:01.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f542359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5424105670 0x7f542419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:01.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f5422d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54240683c0 0x7f5424195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:01.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f542259c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5424102b60 0x7f5424195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:01.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f5422d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54240683c0 0x7f5424195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:44454/0 (socket says 172.21.15.57:44454) 2023-03-02T10:55:01.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f5422d9d700 1 -- 172.21.15.57:0/407873067 learned_addr learned my addr 172.21.15.57:0/407873067 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:01.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f542359e700 1 -- 172.21.15.57:0/407873067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54240683c0 msgr2=0x7f5424195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f542359e700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54240683c0 0x7f5424195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f542359e700 1 -- 172.21.15.57:0/407873067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5424102b60 msgr2=0x7f5424195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f542359e700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5424102b60 0x7f5424195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f542359e700 1 -- 172.21.15.57:0/407873067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54180095f0 con 0x7f5424105670 2023-03-02T10:55:01.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f542259c700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5424102b60 0x7f5424195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:01.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f542359e700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5424105670 0x7f542419ce20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f541c00ab40 tx=0x7f541c00ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:01.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f540bfff700 1 -- 172.21.15.57:0/407873067 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00f070 con 0x7f5424105670 2023-03-02T10:55:01.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f54291ff700 1 -- 172.21.15.57:0/407873067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542410b460 con 0x7f5424105670 2023-03-02T10:55:01.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f54291ff700 1 -- 172.21.15.57:0/407873067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542410b2d0 con 0x7f5424105670 2023-03-02T10:55:01.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f540bfff700 1 -- 172.21.15.57:0/407873067 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f541c007a70 con 0x7f5424105670 2023-03-02T10:55:01.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.352+0000 7f540bfff700 1 -- 172.21.15.57:0/407873067 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c005280 con 0x7f5424105670 2023-03-02T10:55:01.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.354+0000 7f54291ff700 1 -- 172.21.15.57:0/407873067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5410005320 con 0x7f5424105670 2023-03-02T10:55:01.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.355+0000 7f540bfff700 1 -- 172.21.15.57:0/407873067 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f541c019020 con 0x7f5424105670 2023-03-02T10:55:01.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.356+0000 7f540bfff700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f540c09b3a0 0x7f540c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.356+0000 7f540bfff700 1 -- 172.21.15.57:0/407873067 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f541c0c3ca0 con 0x7f5424105670 2023-03-02T10:55:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.356+0000 7f5422d9d700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f540c09b3a0 0x7f540c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.356+0000 7f5422d9d700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f540c09b3a0 0x7f540c09d850 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f541400bd10 tx=0x7f541400b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.361+0000 7f540bfff700 1 -- 172.21.15.57:0/407873067 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f541c0c8070 con 0x7f5424105670 2023-03-02T10:55:01.581 INFO:journalctl@ceph.mds.a.smithi057.stdout:Mar 02 10:55:01 smithi057 podman[126649]: 2023-03-02T10:55:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.641+0000 7f54291ff700 1 -- 172.21.15.57:0/407873067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5410005f70 con 0x7f5424105670 2023-03-02T10:55:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.641+0000 7f540bfff700 1 -- 172.21.15.57:0/407873067 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8091 (secure 0 0 0) 0x7f541c08fb40 con 0x7f5424105670 2023-03-02T10:55:01.643 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:01.643 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14598,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24491,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24520,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-03-02T10:55:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 -- 172.21.15.57:0/407873067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f540c09b3a0 msgr2=0x7f540c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f540c09b3a0 0x7f540c09d850 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f541400bd10 tx=0x7f541400b480 comp rx=0 tx=0).stop 2023-03-02T10:55:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 -- 172.21.15.57:0/407873067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5424105670 msgr2=0x7f542419ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5424105670 0x7f542419ce20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f541c00ab40 tx=0x7f541c00ae50 comp rx=0 tx=0).stop 2023-03-02T10:55:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 -- 172.21.15.57:0/407873067 shutdown_connections 2023-03-02T10:55:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f540c09b3a0 0x7f540c09d850 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5424105670 0x7f542419ce20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54240683c0 0x7f5424195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 --2- 172.21.15.57:0/407873067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5424102b60 0x7f5424195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 -- 172.21.15.57:0/407873067 >> 172.21.15.57:0/407873067 conn(0x7f54240f9fd0 msgr2=0x7f5424100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 -- 172.21.15.57:0/407873067 shutdown_connections 2023-03-02T10:55:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:01.644+0000 7f54291ff700 1 -- 172.21.15.57:0/407873067 wait complete. 2023-03-02T10:55:01.647 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 11 2023-03-02T10:55:01.932 INFO:journalctl@ceph.mds.a.smithi057.stdout:Mar 02 10:55:01 smithi057 bash[126649]: 97054fc42498448298fd69121f970752e66e9eaa3cd3ed8b5c97cab5e2bbad08 2023-03-02T10:55:01.933 INFO:journalctl@ceph.mds.a.smithi057.stdout:Mar 02 10:55:01 smithi057 ceph-mds[126731]: -- 172.21.15.57:0/2212536253 <== mon.0 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561a0a062b60 con 0x561a0a037000 2023-03-02T10:55:01.933 INFO:journalctl@ceph.mds.a.smithi057.stdout:Mar 02 10:55:01 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-a[126708]: starting mds.a at 2023-03-02T10:55:01.933 INFO:journalctl@ceph.mds.a.smithi057.stdout:Mar 02 10:55:01 smithi057 systemd[1]: Started Ceph mds.a for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:55:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:02 smithi136 ceph-mon[125702]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:02 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/407873067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:02 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:02 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:02 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:55:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:02 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:55:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:02 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:02 smithi057 ceph-mon[92072]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:02 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/407873067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:02 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:02 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:02 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:55:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:02 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:55:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:02 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:02 smithi122 ceph-mon[125440]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:02 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/407873067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:02 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:02 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:02 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-02T10:55:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:02 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-02T10:55:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:02 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:03.323 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:55:03 smithi122 systemd[1]: Starting Ceph mds.b for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:55:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:03 smithi136 ceph-mon[125702]: Deploying daemon mds.b on smithi122 2023-03-02T10:55:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:03 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.57:6840/3731858530,v1:172.21.15.57:6841/3731858530] up:boot 2023-03-02T10:55:03.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:03 smithi136 ceph-mon[125702]: fsmap 11 up:standby 2023-03-02T10:55:03.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:03 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-02T10:55:03.604 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:55:03 smithi122 podman[150909]: 2023-03-02T10:55:03.604 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:03 smithi122 ceph-mon[125440]: Deploying daemon mds.b on smithi122 2023-03-02T10:55:03.604 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:03 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.57:6840/3731858530,v1:172.21.15.57:6841/3731858530] up:boot 2023-03-02T10:55:03.604 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:03 smithi122 ceph-mon[125440]: fsmap 11 up:standby 2023-03-02T10:55:03.605 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:03 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-02T10:55:03.663 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:55:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:03 smithi057 ceph-mon[92072]: Deploying daemon mds.b on smithi122 2023-03-02T10:55:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:03 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.57:6840/3731858530,v1:172.21.15.57:6841/3731858530] up:boot 2023-03-02T10:55:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:03 smithi057 ceph-mon[92072]: fsmap 11 up:standby 2023-03-02T10:55:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:03 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-02T10:55:03.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.835+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2451868784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ab40ffc20 msgr2=0x7f0ab4100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.835+0000 7f0ab9dff700 1 --2- 172.21.15.57:0/2451868784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ab40ffc20 0x7f0ab4100090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009990 tx=0x7f0aa8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.836+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2451868784 shutdown_connections 2023-03-02T10:55:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.836+0000 7f0ab9dff700 1 --2- 172.21.15.57:0/2451868784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab41005d0 0x7f0ab4106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.836+0000 7f0ab9dff700 1 --2- 172.21.15.57:0/2451868784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ab40fe990 0x7f0ab40feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.836+0000 7f0ab9dff700 1 --2- 172.21.15.57:0/2451868784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ab40ffc20 0x7f0ab4100090 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.836+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2451868784 >> 172.21.15.57:0/2451868784 conn(0x7f0ab40f9fd0 msgr2=0x7f0ab40fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.836+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2451868784 shutdown_connections 2023-03-02T10:55:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.836+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2451868784 wait complete. 2023-03-02T10:55:03.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.836+0000 7f0ab9dff700 1 Processor -- start 2023-03-02T10:55:03.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.836+0000 7f0ab9dff700 1 -- start start 2023-03-02T10:55:03.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab9dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ab40fe990 0x7f0ab410b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:03.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab9dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab40ffc20 0x7f0ab4109ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:03.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab9dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ab41005d0 0x7f0ab410a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab9dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab410abc0 con 0x7f0ab41005d0 2023-03-02T10:55:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab9dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab410ad30 con 0x7f0ab40fe990 2023-03-02T10:55:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab9dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab419f8e0 con 0x7f0ab40ffc20 2023-03-02T10:55:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ab41005d0 0x7f0ab410a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ab41005d0 0x7f0ab410a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58074/0 (socket says 172.21.15.57:58074) 2023-03-02T10:55:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab3fff700 1 -- 172.21.15.57:0/2582576266 learned_addr learned my addr 172.21.15.57:0/2582576266 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab37fe700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ab40fe990 0x7f0ab410b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab2ffd700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab40ffc20 0x7f0ab4109ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab3fff700 1 -- 172.21.15.57:0/2582576266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab40ffc20 msgr2=0x7f0ab4109ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab3fff700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab40ffc20 0x7f0ab4109ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab3fff700 1 -- 172.21.15.57:0/2582576266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ab40fe990 msgr2=0x7f0ab410b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab3fff700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ab40fe990 0x7f0ab410b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab3fff700 1 -- 172.21.15.57:0/2582576266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80095f0 con 0x7f0ab41005d0 2023-03-02T10:55:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab2ffd700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab40ffc20 0x7f0ab4109ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.837+0000 7f0ab3fff700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ab41005d0 0x7f0ab410a420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0aac007ee0 tx=0x7f0aac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:03.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.838+0000 7f0ab0ff9700 1 -- 172.21.15.57:0/2582576266 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac017070 con 0x7f0ab41005d0 2023-03-02T10:55:03.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.838+0000 7f0ab0ff9700 1 -- 172.21.15.57:0/2582576266 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0aac00f040 con 0x7f0ab41005d0 2023-03-02T10:55:03.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.838+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2582576266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab4067ca0 con 0x7f0ab41005d0 2023-03-02T10:55:03.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.838+0000 7f0ab0ff9700 1 -- 172.21.15.57:0/2582576266 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac005740 con 0x7f0ab41005d0 2023-03-02T10:55:03.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.838+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2582576266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab4067b10 con 0x7f0ab41005d0 2023-03-02T10:55:03.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.839+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2582576266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab4105820 con 0x7f0ab41005d0 2023-03-02T10:55:03.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.840+0000 7f0ab0ff9700 1 -- 172.21.15.57:0/2582576266 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f0aac004c40 con 0x7f0ab41005d0 2023-03-02T10:55:03.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.841+0000 7f0ab0ff9700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0a9c09b420 0x7f0a9c09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:03.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.841+0000 7f0ab0ff9700 1 -- 172.21.15.57:0/2582576266 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0aac0c43d0 con 0x7f0ab41005d0 2023-03-02T10:55:03.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.841+0000 7f0ab37fe700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0a9c09b420 0x7f0a9c09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:03.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.842+0000 7f0ab37fe700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0a9c09b420 0x7f0a9c09d8d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4005950 tx=0x7f0aa400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:03.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:03.846+0000 7f0ab0ff9700 1 -- 172.21.15.57:0/2582576266 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f0aac0900f0 con 0x7f0ab41005d0 2023-03-02T10:55:04.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.096+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2582576266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ab40613e0 con 0x7f0ab41005d0 2023-03-02T10:55:04.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.097+0000 7f0ab0ff9700 1 -- 172.21.15.57:0/2582576266 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8849 (secure 0 0 0) 0x7f0aac093710 con 0x7f0ab41005d0 2023-03-02T10:55:04.098 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:04.098 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14598,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6841/3731858530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6840","nonce":3731858530},{"type":"v1","addr":"172.21.15.57:6841","nonce":3731858530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24491,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24520,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-03-02T10:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2582576266 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0a9c09b420 msgr2=0x7f0a9c09d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0a9c09b420 0x7f0a9c09d8d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4005950 tx=0x7f0aa400b410 comp rx=0 tx=0).stop 2023-03-02T10:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2582576266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ab41005d0 msgr2=0x7f0ab410a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ab41005d0 0x7f0ab410a420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0aac007ee0 tx=0x7f0aac00d3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:04.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2582576266 shutdown_connections 2023-03-02T10:55:04.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0a9c09b420 0x7f0a9c09d8d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ab41005d0 0x7f0ab410a420 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ab40fe990 0x7f0ab410b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 --2- 172.21.15.57:0/2582576266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab40ffc20 0x7f0ab4109ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2582576266 >> 172.21.15.57:0/2582576266 conn(0x7f0ab40f9fd0 msgr2=0x7f0ab40fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2582576266 shutdown_connections 2023-03-02T10:55:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:04.099+0000 7f0ab9dff700 1 -- 172.21.15.57:0/2582576266 wait complete. 2023-03-02T10:55:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 12 2023-03-02T10:55:04.201 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:55:03 smithi122 ceph-mds[150947]: -- 172.21.15.122:0/3387013376 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56112e29cb60 con 0x56112e270c00 2023-03-02T10:55:04.202 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:55:03 smithi122 bash[150909]: d15b6987f758db791580d12d60268e1415b26d4beaf8b9619474c1e02fa7800a 2023-03-02T10:55:04.202 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:55:03 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: starting mds.b at 2023-03-02T10:55:04.202 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:55:03 smithi122 systemd[1]: Started Ceph mds.b for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:55:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:04 smithi057 ceph-mon[92072]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:55:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:04 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2582576266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:04 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:04 smithi136 ceph-mon[125702]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:55:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:04 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2582576266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:04 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:04 smithi122 ceph-mon[125440]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:55:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:04 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2582576266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:04 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:05 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] up:boot 2023-03-02T10:55:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:05 smithi057 ceph-mon[92072]: fsmap 12 up:standby 2023-03-02T10:55:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:05 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-02T10:55:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:05 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] up:boot 2023-03-02T10:55:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:05 smithi122 ceph-mon[125440]: fsmap 12 up:standby 2023-03-02T10:55:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:05 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-02T10:55:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:05 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] up:boot 2023-03-02T10:55:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:05 smithi136 ceph-mon[125702]: fsmap 12 up:standby 2023-03-02T10:55:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:05 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-02T10:55:06.117 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:55:06.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.285+0000 7f7982fff700 1 -- 172.21.15.57:0/1867242426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c102ea0 msgr2=0x7f797c105280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:06.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.285+0000 7f7982fff700 1 --2- 172.21.15.57:0/1867242426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c102ea0 0x7f797c105280 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7968009990 tx=0x7f7968009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.285+0000 7f7982fff700 1 -- 172.21.15.57:0/1867242426 shutdown_connections 2023-03-02T10:55:06.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.285+0000 7f7982fff700 1 --2- 172.21.15.57:0/1867242426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f797c1057c0 0x7f797c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.285+0000 7f7982fff700 1 --2- 172.21.15.57:0/1867242426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f797c100580 0x7f797c102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.285+0000 7f7982fff700 1 --2- 172.21.15.57:0/1867242426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c102ea0 0x7f797c105280 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.285+0000 7f7982fff700 1 -- 172.21.15.57:0/1867242426 >> 172.21.15.57:0/1867242426 conn(0x7f797c0f9f40 msgr2=0x7f797c0fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:06.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.285+0000 7f7982fff700 1 -- 172.21.15.57:0/1867242426 shutdown_connections 2023-03-02T10:55:06.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.285+0000 7f7982fff700 1 -- 172.21.15.57:0/1867242426 wait complete. 2023-03-02T10:55:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.285+0000 7f7982fff700 1 Processor -- start 2023-03-02T10:55:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f7982fff700 1 -- start start 2023-03-02T10:55:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f7982fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f797c100580 0x7f797c0ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f7982fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c102ea0 0x7f797c0fe530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f7982fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f797c1057c0 0x7f797c0fea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f7982fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0ff210 con 0x7f797c102ea0 2023-03-02T10:55:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f7982fff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0ff380 con 0x7f797c100580 2023-03-02T10:55:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f7982fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c19f7f0 con 0x7f797c1057c0 2023-03-02T10:55:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f797bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c102ea0 0x7f797c0fe530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f797bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c102ea0 0x7f797c0fe530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37454/0 (socket says 172.21.15.57:37454) 2023-03-02T10:55:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f797bfff700 1 -- 172.21.15.57:0/39464762 learned_addr learned my addr 172.21.15.57:0/39464762 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f798159c700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f797c1057c0 0x7f797c0fea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f7980d9b700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f797c100580 0x7f797c0ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f797bfff700 1 -- 172.21.15.57:0/39464762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f797c1057c0 msgr2=0x7f797c0fea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f797bfff700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f797c1057c0 0x7f797c0fea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f797bfff700 1 -- 172.21.15.57:0/39464762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f797c100580 msgr2=0x7f797c0ffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f797bfff700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f797c100580 0x7f797c0ffef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.286+0000 7f797bfff700 1 -- 172.21.15.57:0/39464762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680095f0 con 0x7f797c102ea0 2023-03-02T10:55:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.287+0000 7f797bfff700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c102ea0 0x7f797c0fe530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f79680059d0 tx=0x7f7968004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.287+0000 7f7979ffb700 1 -- 172.21.15.57:0/39464762 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796801d070 con 0x7f797c102ea0 2023-03-02T10:55:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.287+0000 7f7979ffb700 1 -- 172.21.15.57:0/39464762 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f796800fb90 con 0x7f797c102ea0 2023-03-02T10:55:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.287+0000 7f7979ffb700 1 -- 172.21.15.57:0/39464762 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79680173f0 con 0x7f797c102ea0 2023-03-02T10:55:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.287+0000 7f7982fff700 1 -- 172.21.15.57:0/39464762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c10b3a0 con 0x7f797c102ea0 2023-03-02T10:55:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.287+0000 7f7982fff700 1 -- 172.21.15.57:0/39464762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c10b210 con 0x7f797c102ea0 2023-03-02T10:55:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.288+0000 7f7982fff700 1 -- 172.21.15.57:0/39464762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c067210 con 0x7f797c102ea0 2023-03-02T10:55:06.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.289+0000 7f7979ffb700 1 -- 172.21.15.57:0/39464762 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f7968029030 con 0x7f797c102ea0 2023-03-02T10:55:06.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.290+0000 7f7979ffb700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f796c09b420 0x7f796c09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:06.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.290+0000 7f7979ffb700 1 -- 172.21.15.57:0/39464762 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f79680c5c60 con 0x7f797c102ea0 2023-03-02T10:55:06.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.290+0000 7f7980d9b700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f796c09b420 0x7f796c09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:06.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.291+0000 7f7980d9b700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f796c09b420 0x7f796c09d8d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7970009c60 tx=0x7f7970009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:06.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.294+0000 7f7979ffb700 1 -- 172.21.15.57:0/39464762 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f796805b800 con 0x7f797c102ea0 2023-03-02T10:55:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:06 smithi057 ceph-mon[92072]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:06.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.558+0000 7f7982fff700 1 -- 172.21.15.57:0/39464762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f797c1a0220 con 0x7f797c102ea0 2023-03-02T10:55:06.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.559+0000 7f7979ffb700 1 -- 172.21.15.57:0/39464762 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9607 (secure 0 0 0) 0x7f7968091b00 con 0x7f797c102ea0 2023-03-02T10:55:06.561 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14598,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6841/3731858530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6840","nonce":3731858530},{"type":"v1","addr":"172.21.15.57:6841","nonce":3731858530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24491,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24520,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6839/316639764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":316639764},{"type":"v1","addr":"172.21.15.122:6839","nonce":316639764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-03-02T10:55:06.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 -- 172.21.15.57:0/39464762 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f796c09b420 msgr2=0x7f796c09d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:06.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f796c09b420 0x7f796c09d8d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7970009c60 tx=0x7f7970009260 comp rx=0 tx=0).stop 2023-03-02T10:55:06.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 -- 172.21.15.57:0/39464762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c102ea0 msgr2=0x7f797c0fe530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:06.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c102ea0 0x7f797c0fe530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f79680059d0 tx=0x7f7968004730 comp rx=0 tx=0).stop 2023-03-02T10:55:06.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 -- 172.21.15.57:0/39464762 shutdown_connections 2023-03-02T10:55:06.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f796c09b420 0x7f796c09d8d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f797c1057c0 0x7f797c0fea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f797c100580 0x7f797c0ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 --2- 172.21.15.57:0/39464762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c102ea0 0x7f797c0fe530 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 -- 172.21.15.57:0/39464762 >> 172.21.15.57:0/39464762 conn(0x7f797c0f9f40 msgr2=0x7f797c1019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:06.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 -- 172.21.15.57:0/39464762 shutdown_connections 2023-03-02T10:55:06.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.561+0000 7f7982fff700 1 -- 172.21.15.57:0/39464762 wait complete. 2023-03-02T10:55:06.565 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 13 2023-03-02T10:55:06.580 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:55:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:06 smithi122 ceph-mon[125440]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.743+0000 7fc619dff700 1 -- 172.21.15.57:0/1759603158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc614100ca0 msgr2=0x7fc6141010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.743+0000 7fc619dff700 1 --2- 172.21.15.57:0/1759603158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc614100ca0 0x7fc6141010f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc608009990 tx=0x7fc608009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.743+0000 7fc619dff700 1 -- 172.21.15.57:0/1759603158 shutdown_connections 2023-03-02T10:55:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.743+0000 7fc619dff700 1 --2- 172.21.15.57:0/1759603158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc614101630 0x7fc614107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.743+0000 7fc619dff700 1 --2- 172.21.15.57:0/1759603158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6140ffab0 0x7fc6140ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.743+0000 7fc619dff700 1 --2- 172.21.15.57:0/1759603158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc614100ca0 0x7fc6141010f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.743+0000 7fc619dff700 1 -- 172.21.15.57:0/1759603158 >> 172.21.15.57:0/1759603158 conn(0x7fc6140fb0b0 msgr2=0x7fc6140fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.743+0000 7fc619dff700 1 -- 172.21.15.57:0/1759603158 shutdown_connections 2023-03-02T10:55:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.744+0000 7fc619dff700 1 -- 172.21.15.57:0/1759603158 wait complete. 2023-03-02T10:55:06.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.744+0000 7fc619dff700 1 Processor -- start 2023-03-02T10:55:06.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc619dff700 1 -- start start 2023-03-02T10:55:06.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc619dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ffab0 0x7fc614195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:06.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc619dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc614100ca0 0x7fc614195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:06.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc619dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc614101630 0x7fc61419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:06.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc619dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61419d3b0 con 0x7fc614100ca0 2023-03-02T10:55:06.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc619dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61419d4f0 con 0x7fc614101630 2023-03-02T10:55:06.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc619dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61419d680 con 0x7fc6140ffab0 2023-03-02T10:55:06.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc612ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc614100ca0 0x7fc614195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:06.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc6137fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ffab0 0x7fc614195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:06.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc612ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc614100ca0 0x7fc614195d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37472/0 (socket says 172.21.15.57:37472) 2023-03-02T10:55:06.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc6137fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ffab0 0x7fc614195830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:41110/0 (socket says 172.21.15.57:41110) 2023-03-02T10:55:06.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc612ffd700 1 -- 172.21.15.57:0/1770233947 learned_addr learned my addr 172.21.15.57:0/1770233947 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:06.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc613fff700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc614101630 0x7fc61419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:06.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc6137fe700 1 -- 172.21.15.57:0/1770233947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc614101630 msgr2=0x7fc61419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:06.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc6137fe700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc614101630 0x7fc61419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc6137fe700 1 -- 172.21.15.57:0/1770233947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc614100ca0 msgr2=0x7fc614195d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:06.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.745+0000 7fc6137fe700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc614100ca0 0x7fc614195d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.746+0000 7fc6137fe700 1 -- 172.21.15.57:0/1770233947 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6080095f0 con 0x7fc6140ffab0 2023-03-02T10:55:06.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.746+0000 7fc612ffd700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc614100ca0 0x7fc614195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:06.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.746+0000 7fc6137fe700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ffab0 0x7fc614195830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc60400e9c0 tx=0x7fc60400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:06.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.746+0000 7fc610ff9700 1 -- 172.21.15.57:0/1770233947 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604004220 con 0x7fc6140ffab0 2023-03-02T10:55:06.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.746+0000 7fc610ff9700 1 -- 172.21.15.57:0/1770233947 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc604004380 con 0x7fc6140ffab0 2023-03-02T10:55:06.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.746+0000 7fc610ff9700 1 -- 172.21.15.57:0/1770233947 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604003be0 con 0x7fc6140ffab0 2023-03-02T10:55:06.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.746+0000 7fc619dff700 1 -- 172.21.15.57:0/1770233947 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61410b460 con 0x7fc6140ffab0 2023-03-02T10:55:06.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.746+0000 7fc619dff700 1 -- 172.21.15.57:0/1770233947 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61410b2d0 con 0x7fc6140ffab0 2023-03-02T10:55:06.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.747+0000 7fc619dff700 1 -- 172.21.15.57:0/1770233947 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc614106a30 con 0x7fc6140ffab0 2023-03-02T10:55:06.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.749+0000 7fc610ff9700 1 -- 172.21.15.57:0/1770233947 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fc60401e020 con 0x7fc6140ffab0 2023-03-02T10:55:06.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.750+0000 7fc610ff9700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc5fc09b3a0 0x7fc5fc09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:06.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.750+0000 7fc610ff9700 1 -- 172.21.15.57:0/1770233947 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc604014070 con 0x7fc6140ffab0 2023-03-02T10:55:06.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.750+0000 7fc612ffd700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc5fc09b3a0 0x7fc5fc09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:06.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.750+0000 7fc612ffd700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc5fc09b3a0 0x7fc5fc09d850 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc60800b2e0 tx=0x7fc608005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:06.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.752+0000 7fc610ff9700 1 -- 172.21.15.57:0/1770233947 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fc604090b30 con 0x7fc6140ffab0 2023-03-02T10:55:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:06 smithi136 ceph-mon[125702]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:06.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.958+0000 7fc619dff700 1 -- 172.21.15.57:0/1770233947 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc614061330 con 0x7fc6140ffab0 2023-03-02T10:55:06.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.959+0000 7fc610ff9700 1 -- 172.21.15.57:0/1770233947 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18425 (secure 0 0 0) 0x7fc604094150 con 0x7fc6140ffab0 2023-03-02T10:55:06.961 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:06.961 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":80,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:54:25.424612+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:55:06.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 -- 172.21.15.57:0/1770233947 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc5fc09b3a0 msgr2=0x7fc5fc09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:06.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc5fc09b3a0 0x7fc5fc09d850 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc60800b2e0 tx=0x7fc608005fb0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 -- 172.21.15.57:0/1770233947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ffab0 msgr2=0x7fc614195830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:06.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ffab0 0x7fc614195830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc60400e9c0 tx=0x7fc60400ecd0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 -- 172.21.15.57:0/1770233947 shutdown_connections 2023-03-02T10:55:06.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc5fc09b3a0 0x7fc5fc09d850 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc614101630 0x7fc61419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ffab0 0x7fc614195830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 --2- 172.21.15.57:0/1770233947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc614100ca0 0x7fc614195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:06.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 -- 172.21.15.57:0/1770233947 >> 172.21.15.57:0/1770233947 conn(0x7fc6140fb0b0 msgr2=0x7fc6140fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:06.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 -- 172.21.15.57:0/1770233947 shutdown_connections 2023-03-02T10:55:06.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:06.962+0000 7fc619dff700 1 -- 172.21.15.57:0/1770233947 wait complete. 2023-03-02T10:55:06.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-02T10:51:03.600226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-02T10:55:06.983 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-02T10:55:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.142+0000 7fdcd17ff700 1 -- 172.21.15.57:0/957202061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc072ee0 msgr2=0x7fdccc073350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.142+0000 7fdcd17ff700 1 --2- 172.21.15.57:0/957202061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc072ee0 0x7fdccc073350 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009990 tx=0x7fdcc0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.142+0000 7fdcd17ff700 1 -- 172.21.15.57:0/957202061 shutdown_connections 2023-03-02T10:55:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.142+0000 7fdcd17ff700 1 --2- 172.21.15.57:0/957202061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdccc1079c0 0x7fdccc109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.142+0000 7fdcd17ff700 1 --2- 172.21.15.57:0/957202061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc0744b0 0x7fdccc0729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.142+0000 7fdcd17ff700 1 --2- 172.21.15.57:0/957202061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc072ee0 0x7fdccc073350 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.142+0000 7fdcd17ff700 1 -- 172.21.15.57:0/957202061 >> 172.21.15.57:0/957202061 conn(0x7fdccc0fb100 msgr2=0x7fdccc0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.142+0000 7fdcd17ff700 1 -- 172.21.15.57:0/957202061 shutdown_connections 2023-03-02T10:55:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.142+0000 7fdcd17ff700 1 -- 172.21.15.57:0/957202061 wait complete. 2023-03-02T10:55:07.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.143+0000 7fdcd17ff700 1 Processor -- start 2023-03-02T10:55:07.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.143+0000 7fdcd17ff700 1 -- start start 2023-03-02T10:55:07.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.143+0000 7fdcd17ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdccc072ee0 0x7fdccc197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.143+0000 7fdcd17ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0744b0 0x7fdccc197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.143+0000 7fdcd17ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc1079c0 0x7fdccc19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.143+0000 7fdcd17ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc19f5f0 con 0x7fdccc0744b0 2023-03-02T10:55:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.143+0000 7fdcd17ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc19f730 con 0x7fdccc072ee0 2023-03-02T10:55:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.143+0000 7fdcd17ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc19f8c0 con 0x7fdccc1079c0 2023-03-02T10:55:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdcca7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0744b0 0x7fdccc197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc1079c0 0x7fdccc19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc1079c0 0x7fdccc19f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:41122/0 (socket says 172.21.15.57:41122) 2023-03-02T10:55:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdccb7fe700 1 -- 172.21.15.57:0/421860719 learned_addr learned my addr 172.21.15.57:0/421860719 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:07.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdcca7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0744b0 0x7fdccc197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37492/0 (socket says 172.21.15.57:37492) 2023-03-02T10:55:07.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdccaffd700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdccc072ee0 0x7fdccc197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdccb7fe700 1 -- 172.21.15.57:0/421860719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdccc072ee0 msgr2=0x7fdccc197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdccb7fe700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdccc072ee0 0x7fdccc197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdccb7fe700 1 -- 172.21.15.57:0/421860719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0744b0 msgr2=0x7fdccc197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdccb7fe700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0744b0 0x7fdccc197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdccb7fe700 1 -- 172.21.15.57:0/421860719 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc009520 con 0x7fdccc1079c0 2023-03-02T10:55:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdcca7fc700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0744b0 0x7fdccc197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdccb7fe700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc1079c0 0x7fdccc19f020 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4007ee0 tx=0x7fdcc400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdcb3fff700 1 -- 172.21.15.57:0/421860719 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4017070 con 0x7fdccc1079c0 2023-03-02T10:55:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdcd17ff700 1 -- 172.21.15.57:0/421860719 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc00095f0 con 0x7fdccc1079c0 2023-03-02T10:55:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdcb3fff700 1 -- 172.21.15.57:0/421860719 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcc400f040 con 0x7fdccc1079c0 2023-03-02T10:55:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdcb3fff700 1 -- 172.21.15.57:0/421860719 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4005740 con 0x7fdccc1079c0 2023-03-02T10:55:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.144+0000 7fdcd17ff700 1 -- 172.21.15.57:0/421860719 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc10d680 con 0x7fdccc1079c0 2023-03-02T10:55:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.145+0000 7fdcd17ff700 1 -- 172.21.15.57:0/421860719 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc106150 con 0x7fdccc1079c0 2023-03-02T10:55:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.147+0000 7fdcb3fff700 1 -- 172.21.15.57:0/421860719 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fdcc400dc60 con 0x7fdccc1079c0 2023-03-02T10:55:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.148+0000 7fdcb3fff700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcb409b3a0 0x7fdcb409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.148+0000 7fdcb3fff700 1 -- 172.21.15.57:0/421860719 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdcc4042e40 con 0x7fdccc1079c0 2023-03-02T10:55:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.148+0000 7fdccaffd700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcb409b3a0 0x7fdcb409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.148+0000 7fdccaffd700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcb409b3a0 0x7fdcb409d850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0741d0 tx=0x7fdcbc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.150+0000 7fdcb3fff700 1 -- 172.21.15.57:0/421860719 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fdcc40903d0 con 0x7fdccc1079c0 2023-03-02T10:55:07.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.352+0000 7fdcd17ff700 1 -- 172.21.15.57:0/421860719 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdccc02cd50 con 0x7fdccc1079c0 2023-03-02T10:55:07.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.353+0000 7fdcb3fff700 1 -- 172.21.15.57:0/421860719 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcc4097020 con 0x7fdccc1079c0 2023-03-02T10:55:07.355 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-02T10:55:07.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 -- 172.21.15.57:0/421860719 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcb409b3a0 msgr2=0x7fdcb409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcb409b3a0 0x7fdcb409d850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0741d0 tx=0x7fdcbc009260 comp rx=0 tx=0).stop 2023-03-02T10:55:07.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 -- 172.21.15.57:0/421860719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc1079c0 msgr2=0x7fdccc19f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc1079c0 0x7fdccc19f020 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4007ee0 tx=0x7fdcc400d3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 -- 172.21.15.57:0/421860719 shutdown_connections 2023-03-02T10:55:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdcb409b3a0 0x7fdcb409d850 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdccc1079c0 0x7fdccc19f020 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdccc072ee0 0x7fdccc197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 --2- 172.21.15.57:0/421860719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0744b0 0x7fdccc197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 -- 172.21.15.57:0/421860719 >> 172.21.15.57:0/421860719 conn(0x7fdccc0fb100 msgr2=0x7fdccc0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 -- 172.21.15.57:0/421860719 shutdown_connections 2023-03-02T10:55:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.355+0000 7fdcd17ff700 1 -- 172.21.15.57:0/421860719 wait complete. 2023-03-02T10:55:07.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-02T10:55:07.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.536+0000 7fce4d1ff700 1 -- 172.21.15.57:0/1922460907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce48101700 msgr2=0x7fce48107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.536+0000 7fce4d1ff700 1 --2- 172.21.15.57:0/1922460907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce48101700 0x7fce48107fa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b0a0 tx=0x7fce4000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.536+0000 7fce4d1ff700 1 -- 172.21.15.57:0/1922460907 shutdown_connections 2023-03-02T10:55:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.536+0000 7fce4d1ff700 1 --2- 172.21.15.57:0/1922460907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce48101700 0x7fce48107fa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.536+0000 7fce4d1ff700 1 --2- 172.21.15.57:0/1922460907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce480ffac0 0x7fce480ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.536+0000 7fce4d1ff700 1 --2- 172.21.15.57:0/1922460907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce48100d50 0x7fce481011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.536+0000 7fce4d1ff700 1 -- 172.21.15.57:0/1922460907 >> 172.21.15.57:0/1922460907 conn(0x7fce480fb0c0 msgr2=0x7fce480fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.536+0000 7fce4d1ff700 1 -- 172.21.15.57:0/1922460907 shutdown_connections 2023-03-02T10:55:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.536+0000 7fce4d1ff700 1 -- 172.21.15.57:0/1922460907 wait complete. 2023-03-02T10:55:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4d1ff700 1 Processor -- start 2023-03-02T10:55:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4d1ff700 1 -- start start 2023-03-02T10:55:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4d1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce480ffac0 0x7fce481958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4d1ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce48100d50 0x7fce48195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4d1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce48101700 0x7fce4819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4d1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4819d440 con 0x7fce48101700 2023-03-02T10:55:07.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4d1ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4819d580 con 0x7fce48100d50 2023-03-02T10:55:07.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4d1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4819d710 con 0x7fce480ffac0 2023-03-02T10:55:07.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce48101700 0x7fce4819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce48101700 0x7fce4819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37502/0 (socket says 172.21.15.57:37502) 2023-03-02T10:55:07.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4759e700 1 -- 172.21.15.57:0/993460937 learned_addr learned my addr 172.21.15.57:0/993460937 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:07.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce4659c700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce48100d50 0x7fce48195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.537+0000 7fce46d9d700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce480ffac0 0x7fce481958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.538+0000 7fce4759e700 1 -- 172.21.15.57:0/993460937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce480ffac0 msgr2=0x7fce481958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.538+0000 7fce4759e700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce480ffac0 0x7fce481958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.538+0000 7fce4759e700 1 -- 172.21.15.57:0/993460937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce48100d50 msgr2=0x7fce48195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.538+0000 7fce4759e700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce48100d50 0x7fce48195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.538+0000 7fce4759e700 1 -- 172.21.15.57:0/993460937 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40009d00 con 0x7fce48101700 2023-03-02T10:55:07.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.538+0000 7fce4759e700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce48101700 0x7fce4819ce70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b780 tx=0x7fce4000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:07.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.538+0000 7fce2ffff700 1 -- 172.21.15.57:0/993460937 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000e040 con 0x7fce48101700 2023-03-02T10:55:07.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.538+0000 7fce4d1ff700 1 -- 172.21.15.57:0/993460937 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4810b450 con 0x7fce48101700 2023-03-02T10:55:07.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.538+0000 7fce2ffff700 1 -- 172.21.15.57:0/993460937 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce40004c50 con 0x7fce48101700 2023-03-02T10:55:07.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.538+0000 7fce2ffff700 1 -- 172.21.15.57:0/993460937 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40005280 con 0x7fce48101700 2023-03-02T10:55:07.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.538+0000 7fce4d1ff700 1 -- 172.21.15.57:0/993460937 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4810b2c0 con 0x7fce48101700 2023-03-02T10:55:07.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.539+0000 7fce4d1ff700 1 -- 172.21.15.57:0/993460937 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce48106ab0 con 0x7fce48101700 2023-03-02T10:55:07.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.541+0000 7fce2ffff700 1 -- 172.21.15.57:0/993460937 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fce4001d470 con 0x7fce48101700 2023-03-02T10:55:07.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.541+0000 7fce2ffff700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fce3009b3a0 0x7fce3009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.542+0000 7fce2ffff700 1 -- 172.21.15.57:0/993460937 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fce400c61f0 con 0x7fce48101700 2023-03-02T10:55:07.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.542+0000 7fce46d9d700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fce3009b3a0 0x7fce3009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.542+0000 7fce46d9d700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fce3009b3a0 0x7fce3009d850 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce38009c60 tx=0x7fce38009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:07.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.546+0000 7fce2ffff700 1 -- 172.21.15.57:0/993460937 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fce40091fa0 con 0x7fce48101700 2023-03-02T10:55:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:07 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/39464762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:07 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1770233947' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:55:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:07 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:07 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/39464762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:07 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1770233947' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:55:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:07 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.754+0000 7fce4d1ff700 1 -- 172.21.15.57:0/993460937 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fce48067280 con 0x7fce48101700 2023-03-02T10:55:07.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.754+0000 7fce2ffff700 1 -- 172.21.15.57:0/993460937 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7fce400955c0 con 0x7fce48101700 2023-03-02T10:55:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:07.757 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-03-02T10:55:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-03-02T10:55:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2023-03-02T10:55:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2023-03-02T10:55:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:55:07.758 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-03-02T10:55:07.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.757+0000 7fce4d1ff700 1 -- 172.21.15.57:0/993460937 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fce3009b3a0 msgr2=0x7fce3009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.757+0000 7fce4d1ff700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fce3009b3a0 0x7fce3009d850 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce38009c60 tx=0x7fce38009260 comp rx=0 tx=0).stop 2023-03-02T10:55:07.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.757+0000 7fce4d1ff700 1 -- 172.21.15.57:0/993460937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce48101700 msgr2=0x7fce4819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.757+0000 7fce4d1ff700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce48101700 0x7fce4819ce70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b780 tx=0x7fce4000bab0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.758+0000 7fce4d1ff700 1 -- 172.21.15.57:0/993460937 shutdown_connections 2023-03-02T10:55:07.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.758+0000 7fce4d1ff700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fce3009b3a0 0x7fce3009d850 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.758+0000 7fce4d1ff700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce48101700 0x7fce4819ce70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.758+0000 7fce4d1ff700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce480ffac0 0x7fce481958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.758+0000 7fce4d1ff700 1 --2- 172.21.15.57:0/993460937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce48100d50 0x7fce48195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.758+0000 7fce4d1ff700 1 -- 172.21.15.57:0/993460937 >> 172.21.15.57:0/993460937 conn(0x7fce480fb0c0 msgr2=0x7fce480fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:07.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.758+0000 7fce4d1ff700 1 -- 172.21.15.57:0/993460937 shutdown_connections 2023-03-02T10:55:07.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.758+0000 7fce4d1ff700 1 -- 172.21.15.57:0/993460937 wait complete. 2023-03-02T10:55:07.776 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-02T10:55:07.777 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-02T10:55:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:07 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/39464762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:07 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1770233947' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:07.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:55:07.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:07 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:07.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.947+0000 7fc099dff700 1 -- 172.21.15.57:0/966257783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0941057f0 msgr2=0x7fc094107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.947+0000 7fc099dff700 1 --2- 172.21.15.57:0/966257783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0941057f0 0x7fc094107bd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00b0a0 tx=0x7fc08c00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.947+0000 7fc099dff700 1 -- 172.21.15.57:0/966257783 shutdown_connections 2023-03-02T10:55:07.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.947+0000 7fc099dff700 1 --2- 172.21.15.57:0/966257783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0941057f0 0x7fc094107bd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.947+0000 7fc099dff700 1 --2- 172.21.15.57:0/966257783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0941005b0 0x7fc094102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.947+0000 7fc099dff700 1 --2- 172.21.15.57:0/966257783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc094102ed0 0x7fc0941052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.947+0000 7fc099dff700 1 -- 172.21.15.57:0/966257783 >> 172.21.15.57:0/966257783 conn(0x7fc0940f9fd0 msgr2=0x7fc0940fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:07.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.947+0000 7fc099dff700 1 -- 172.21.15.57:0/966257783 shutdown_connections 2023-03-02T10:55:07.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.947+0000 7fc099dff700 1 -- 172.21.15.57:0/966257783 wait complete. 2023-03-02T10:55:07.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.948+0000 7fc099dff700 1 Processor -- start 2023-03-02T10:55:07.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.948+0000 7fc099dff700 1 -- start start 2023-03-02T10:55:07.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.948+0000 7fc099dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0941005b0 0x7fc094195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.948+0000 7fc099dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc094102ed0 0x7fc094195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.948+0000 7fc099dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0941057f0 0x7fc09419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.948+0000 7fc099dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09419d4c0 con 0x7fc0941057f0 2023-03-02T10:55:07.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.948+0000 7fc099dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09419d600 con 0x7fc094102ed0 2023-03-02T10:55:07.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.948+0000 7fc099dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09419d790 con 0x7fc0941005b0 2023-03-02T10:55:07.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0941005b0 0x7fc094195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0941005b0 0x7fc094195940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:41154/0 (socket says 172.21.15.57:41154) 2023-03-02T10:55:07.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc092ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc094102ed0 0x7fc094195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc0937fe700 1 -- 172.21.15.57:0/2034840900 learned_addr learned my addr 172.21.15.57:0/2034840900 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:07.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc093fff700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0941057f0 0x7fc09419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc092ffd700 1 -- 172.21.15.57:0/2034840900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0941005b0 msgr2=0x7fc094195940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc092ffd700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0941005b0 0x7fc094195940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc092ffd700 1 -- 172.21.15.57:0/2034840900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0941057f0 msgr2=0x7fc09419cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:07.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc092ffd700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0941057f0 0x7fc09419cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:07.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc092ffd700 1 -- 172.21.15.57:0/2034840900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c009d00 con 0x7fc094102ed0 2023-03-02T10:55:07.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc0937fe700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0941005b0 0x7fc094195940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:07.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc093fff700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0941057f0 0x7fc09419cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:07.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc092ffd700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc094102ed0 0x7fc094195e80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc08800e9f0 tx=0x7fc08800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:07.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc090ff9700 1 -- 172.21.15.57:0/2034840900 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08800c9c0 con 0x7fc094102ed0 2023-03-02T10:55:07.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc090ff9700 1 -- 172.21.15.57:0/2034840900 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc088010430 con 0x7fc094102ed0 2023-03-02T10:55:07.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc099dff700 1 -- 172.21.15.57:0/2034840900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09410b420 con 0x7fc094102ed0 2023-03-02T10:55:07.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.949+0000 7fc090ff9700 1 -- 172.21.15.57:0/2034840900 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088018680 con 0x7fc094102ed0 2023-03-02T10:55:07.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.950+0000 7fc099dff700 1 -- 172.21.15.57:0/2034840900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09410b290 con 0x7fc094102ed0 2023-03-02T10:55:07.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.950+0000 7fc099dff700 1 -- 172.21.15.57:0/2034840900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0940fbb40 con 0x7fc094102ed0 2023-03-02T10:55:07.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.952+0000 7fc090ff9700 1 -- 172.21.15.57:0/2034840900 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fc08800c040 con 0x7fc094102ed0 2023-03-02T10:55:07.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.953+0000 7fc090ff9700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc07c09b3a0 0x7fc07c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:07.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.953+0000 7fc090ff9700 1 -- 172.21.15.57:0/2034840900 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc088014070 con 0x7fc094102ed0 2023-03-02T10:55:07.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.953+0000 7fc0937fe700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc07c09b3a0 0x7fc07c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:07.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.953+0000 7fc0937fe700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc07c09b3a0 0x7fc07c09d850 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc084005950 tx=0x7fc084009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:07.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:07.956+0000 7fc090ff9700 1 -- 172.21.15.57:0/2034840900 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fc088090bd0 con 0x7fc094102ed0 2023-03-02T10:55:08.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:08.157+0000 7fc099dff700 1 -- 172.21.15.57:0/2034840900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc0940613d0 con 0x7fc094102ed0 2023-03-02T10:55:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:08 smithi136 ceph-mon[125702]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:08 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/421860719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:55:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:08 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:55:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:08 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/993460937' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-03-02T10:55:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:08 smithi057 ceph-mon[92072]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:08 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/421860719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:55:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:08 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:55:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:08 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/993460937' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-03-02T10:55:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:08 smithi122 ceph-mon[125440]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:08 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/421860719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:55:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:08 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:55:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:08 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/993460937' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-03-02T10:55:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.137+0000 7fc090ff9700 1 -- 172.21.15.57:0/2034840900 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc0880941f0 con 0x7fc094102ed0 2023-03-02T10:55:09.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.140+0000 7fc099dff700 1 -- 172.21.15.57:0/2034840900 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc07c09b3a0 msgr2=0x7fc07c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.140+0000 7fc099dff700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc07c09b3a0 0x7fc07c09d850 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc084005950 tx=0x7fc084009260 comp rx=0 tx=0).stop 2023-03-02T10:55:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.140+0000 7fc099dff700 1 -- 172.21.15.57:0/2034840900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc094102ed0 msgr2=0x7fc094195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.140+0000 7fc099dff700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc094102ed0 0x7fc094195e80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc08800e9f0 tx=0x7fc08800ed00 comp rx=0 tx=0).stop 2023-03-02T10:55:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.141+0000 7fc099dff700 1 -- 172.21.15.57:0/2034840900 shutdown_connections 2023-03-02T10:55:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.141+0000 7fc099dff700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc07c09b3a0 0x7fc07c09d850 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.141+0000 7fc099dff700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0941057f0 0x7fc09419cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.141+0000 7fc099dff700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0941005b0 0x7fc094195940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.141+0000 7fc099dff700 1 --2- 172.21.15.57:0/2034840900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc094102ed0 0x7fc094195e80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.141+0000 7fc099dff700 1 -- 172.21.15.57:0/2034840900 >> 172.21.15.57:0/2034840900 conn(0x7fc0940f9fd0 msgr2=0x7fc0941011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.141+0000 7fc099dff700 1 -- 172.21.15.57:0/2034840900 shutdown_connections 2023-03-02T10:55:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.141+0000 7fc099dff700 1 -- 172.21.15.57:0/2034840900 wait complete. 2023-03-02T10:55:09.145 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2023-03-02T10:55:09.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-02T10:55:09.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.327+0000 7f33103ff700 1 -- 172.21.15.57:0/3092338583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081057f0 msgr2=0x7f3308107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.327+0000 7f33103ff700 1 --2- 172.21.15.57:0/3092338583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081057f0 0x7f3308107bd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f330000b0a0 tx=0x7f330000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.327+0000 7f33103ff700 1 -- 172.21.15.57:0/3092338583 shutdown_connections 2023-03-02T10:55:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.327+0000 7f33103ff700 1 --2- 172.21.15.57:0/3092338583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081057f0 0x7f3308107bd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.327+0000 7f33103ff700 1 --2- 172.21.15.57:0/3092338583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081005b0 0x7f3308102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.327+0000 7f33103ff700 1 --2- 172.21.15.57:0/3092338583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 0x7f33081052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.327+0000 7f33103ff700 1 -- 172.21.15.57:0/3092338583 >> 172.21.15.57:0/3092338583 conn(0x7f33080f9fd0 msgr2=0x7f33080fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:09.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.327+0000 7f33103ff700 1 -- 172.21.15.57:0/3092338583 shutdown_connections 2023-03-02T10:55:09.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.327+0000 7f33103ff700 1 -- 172.21.15.57:0/3092338583 wait complete. 2023-03-02T10:55:09.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.329+0000 7f33103ff700 1 Processor -- start 2023-03-02T10:55:09.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.329+0000 7f33103ff700 1 -- start start 2023-03-02T10:55:09.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.329+0000 7f33103ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f3308195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:09.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.329+0000 7f33103ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 0x7f3308195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:09.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.329+0000 7f33103ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 0x7f330819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:09.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.329+0000 7f33103ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330819d4a0 con 0x7f33081005b0 2023-03-02T10:55:09.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.329+0000 7f33103ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330819d5e0 con 0x7f33081057f0 2023-03-02T10:55:09.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.329+0000 7f33103ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330819d770 con 0x7f3308102ed0 2023-03-02T10:55:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330e19b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f3308195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330e19b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f3308195920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37552/0 (socket says 172.21.15.57:37552) 2023-03-02T10:55:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330e19b700 1 -- 172.21.15.57:0/3657571412 learned_addr learned my addr 172.21.15.57:0/3657571412 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330d99a700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 0x7f3308195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330e99c700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 0x7f330819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330e19b700 1 -- 172.21.15.57:0/3657571412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 msgr2=0x7f3308195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330e19b700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 0x7f3308195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330e19b700 1 -- 172.21.15.57:0/3657571412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 msgr2=0x7f330819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330e19b700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 0x7f330819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330e19b700 1 -- 172.21.15.57:0/3657571412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3300009d00 con 0x7f33081005b0 2023-03-02T10:55:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330e99c700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 0x7f330819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f330e19b700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f3308195920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f330400d980 tx=0x7f330400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f32ff7fe700 1 -- 172.21.15.57:0/3657571412 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400f890 con 0x7f33081005b0 2023-03-02T10:55:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f33103ff700 1 -- 172.21.15.57:0/3657571412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330810b420 con 0x7f33081005b0 2023-03-02T10:55:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f32ff7fe700 1 -- 172.21.15.57:0/3657571412 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3304010460 con 0x7f33081005b0 2023-03-02T10:55:09.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.330+0000 7f32ff7fe700 1 -- 172.21.15.57:0/3657571412 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400e610 con 0x7f33081005b0 2023-03-02T10:55:09.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.331+0000 7f33103ff700 1 -- 172.21.15.57:0/3657571412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330810b290 con 0x7f33081005b0 2023-03-02T10:55:09.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.332+0000 7f33103ff700 1 -- 172.21.15.57:0/3657571412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33080fbb40 con 0x7f33081005b0 2023-03-02T10:55:09.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.334+0000 7f32ff7fe700 1 -- 172.21.15.57:0/3657571412 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f3304022070 con 0x7f33081005b0 2023-03-02T10:55:09.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.335+0000 7f32ff7fe700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b3a0 0x7f32f409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:09.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.335+0000 7f32ff7fe700 1 -- 172.21.15.57:0/3657571412 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f33040c4460 con 0x7f33081005b0 2023-03-02T10:55:09.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.335+0000 7f330d99a700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b3a0 0x7f32f409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:09.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.335+0000 7f330d99a700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b3a0 0x7f32f409d850 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f32f8005950 tx=0x7f32f800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:09.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.337+0000 7f32ff7fe700 1 -- 172.21.15.57:0/3657571412 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f3304090100 con 0x7f33081005b0 2023-03-02T10:55:09.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:09.554+0000 7f33103ff700 1 -- 172.21.15.57:0/3657571412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f330802cd50 con 0x7f33081005b0 2023-03-02T10:55:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:09 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2034840900' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-03-02T10:55:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:09 smithi136 ceph-mon[125702]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-03-02T10:55:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:09 smithi136 ceph-mon[125702]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-03-02T10:55:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:09 smithi136 ceph-mon[125702]: osdmap e81: 12 total, 12 up, 12 in 2023-03-02T10:55:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:09 smithi136 ceph-mon[125702]: pgmap v261: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:09 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2034840900' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-03-02T10:55:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:09 smithi057 ceph-mon[92072]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-03-02T10:55:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:09 smithi057 ceph-mon[92072]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-03-02T10:55:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:09 smithi057 ceph-mon[92072]: osdmap e81: 12 total, 12 up, 12 in 2023-03-02T10:55:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:09 smithi057 ceph-mon[92072]: pgmap v261: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:09 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2034840900' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-03-02T10:55:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:09 smithi122 ceph-mon[125440]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-03-02T10:55:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:09 smithi122 ceph-mon[125440]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-03-02T10:55:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:09 smithi122 ceph-mon[125440]: osdmap e81: 12 total, 12 up, 12 in 2023-03-02T10:55:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:09 smithi122 ceph-mon[125440]: pgmap v261: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:55:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.136+0000 7f32ff7fe700 1 -- 172.21.15.57:0/3657571412 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7f33040200d0 con 0x7f33081005b0 2023-03-02T10:55:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.141+0000 7f33103ff700 1 -- 172.21.15.57:0/3657571412 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b3a0 msgr2=0x7f32f409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.141+0000 7f33103ff700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b3a0 0x7f32f409d850 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f32f8005950 tx=0x7f32f800b410 comp rx=0 tx=0).stop 2023-03-02T10:55:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.141+0000 7f33103ff700 1 -- 172.21.15.57:0/3657571412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 msgr2=0x7f3308195920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.141+0000 7f33103ff700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f3308195920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f330400d980 tx=0x7f330400dc90 comp rx=0 tx=0).stop 2023-03-02T10:55:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.143+0000 7f33103ff700 1 -- 172.21.15.57:0/3657571412 shutdown_connections 2023-03-02T10:55:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.143+0000 7f33103ff700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b3a0 0x7f32f409d850 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.143+0000 7f33103ff700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 0x7f330819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.143+0000 7f33103ff700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f3308195920 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f330400d980 tx=0x7f330400dc90 comp rx=0 tx=0).stop 2023-03-02T10:55:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.143+0000 7f33103ff700 1 --2- 172.21.15.57:0/3657571412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 0x7f3308195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.143+0000 7f33103ff700 1 -- 172.21.15.57:0/3657571412 >> 172.21.15.57:0/3657571412 conn(0x7f33080f9fd0 msgr2=0x7f33081011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:10.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.146+0000 7f33103ff700 1 -- 172.21.15.57:0/3657571412 shutdown_connections 2023-03-02T10:55:10.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.147+0000 7f33103ff700 1 -- 172.21.15.57:0/3657571412 wait complete. 2023-03-02T10:55:10.157 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2023-03-02T10:55:10.174 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-02T10:55:10.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.338+0000 7fca7fbff700 1 -- 172.21.15.57:0/1257010816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca780ffab0 msgr2=0x7fca780ffec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.338+0000 7fca7fbff700 1 --2- 172.21.15.57:0/1257010816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca780ffab0 0x7fca780ffec0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca74009990 tx=0x7fca74009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.338+0000 7fca7fbff700 1 -- 172.21.15.57:0/1257010816 shutdown_connections 2023-03-02T10:55:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.338+0000 7fca7fbff700 1 --2- 172.21.15.57:0/1257010816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca78101630 0x7fca78107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.338+0000 7fca7fbff700 1 --2- 172.21.15.57:0/1257010816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca780ffab0 0x7fca780ffec0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.338+0000 7fca7fbff700 1 --2- 172.21.15.57:0/1257010816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca78100ca0 0x7fca781010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.338+0000 7fca7fbff700 1 -- 172.21.15.57:0/1257010816 >> 172.21.15.57:0/1257010816 conn(0x7fca780fb0b0 msgr2=0x7fca780fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:10.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.338+0000 7fca7fbff700 1 -- 172.21.15.57:0/1257010816 shutdown_connections 2023-03-02T10:55:10.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.338+0000 7fca7fbff700 1 -- 172.21.15.57:0/1257010816 wait complete. 2023-03-02T10:55:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.339+0000 7fca7fbff700 1 Processor -- start 2023-03-02T10:55:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.339+0000 7fca7fbff700 1 -- start start 2023-03-02T10:55:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.339+0000 7fca7fbff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca780ffab0 0x7fca78195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.339+0000 7fca7fbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca78100ca0 0x7fca78195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.339+0000 7fca7fbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca78101630 0x7fca7819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.339+0000 7fca7fbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7819d3e0 con 0x7fca78100ca0 2023-03-02T10:55:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.339+0000 7fca7fbff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7819d520 con 0x7fca780ffab0 2023-03-02T10:55:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.339+0000 7fca7fbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7819d6b0 con 0x7fca78101630 2023-03-02T10:55:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7d19a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca78100ca0 0x7fca78195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7d19a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca78100ca0 0x7fca78195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37572/0 (socket says 172.21.15.57:37572) 2023-03-02T10:55:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7d19a700 1 -- 172.21.15.57:0/150900254 learned_addr learned my addr 172.21.15.57:0/150900254 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7e19c700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca78101630 0x7fca7819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7d99b700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca780ffab0 0x7fca78195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7d19a700 1 -- 172.21.15.57:0/150900254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca78101630 msgr2=0x7fca7819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7d19a700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca78101630 0x7fca7819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7d19a700 1 -- 172.21.15.57:0/150900254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca780ffab0 msgr2=0x7fca78195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7d19a700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca780ffab0 0x7fca78195860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7d19a700 1 -- 172.21.15.57:0/150900254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740095f0 con 0x7fca78100ca0 2023-03-02T10:55:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7d19a700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca78100ca0 0x7fca78195da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca6800d980 tx=0x7fca6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca6effd700 1 -- 172.21.15.57:0/150900254 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68004220 con 0x7fca78100ca0 2023-03-02T10:55:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca6effd700 1 -- 172.21.15.57:0/150900254 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca68007640 con 0x7fca78100ca0 2023-03-02T10:55:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7fbff700 1 -- 172.21.15.57:0/150900254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7810b410 con 0x7fca78100ca0 2023-03-02T10:55:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca6effd700 1 -- 172.21.15.57:0/150900254 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68005690 con 0x7fca78100ca0 2023-03-02T10:55:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.340+0000 7fca7fbff700 1 -- 172.21.15.57:0/150900254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7810b280 con 0x7fca78100ca0 2023-03-02T10:55:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.341+0000 7fca7fbff700 1 -- 172.21.15.57:0/150900254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca78107090 con 0x7fca78100ca0 2023-03-02T10:55:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.343+0000 7fca6effd700 1 -- 172.21.15.57:0/150900254 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fca68021070 con 0x7fca78100ca0 2023-03-02T10:55:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.344+0000 7fca6effd700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fca6409b420 0x7fca6409d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.344+0000 7fca6effd700 1 -- 172.21.15.57:0/150900254 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7879+0+0 (secure 0 0 0) 0x7fca680c4fe0 con 0x7fca78100ca0 2023-03-02T10:55:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.344+0000 7fca7d99b700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fca6409b420 0x7fca6409d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.345+0000 7fca7d99b700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fca6409b420 0x7fca6409d8d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fca74006010 tx=0x7fca74005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:10.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.347+0000 7fca6effd700 1 -- 172.21.15.57:0/150900254 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fca68090a10 con 0x7fca78100ca0 2023-03-02T10:55:10.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.598+0000 7fca7fbff700 1 -- 172.21.15.57:0/150900254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fca7802cd50 con 0x7fca78100ca0 2023-03-02T10:55:10.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.605+0000 7fca6effd700 1 -- 172.21.15.57:0/150900254 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fca68016030 con 0x7fca78100ca0 2023-03-02T10:55:10.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.610+0000 7fca7fbff700 1 -- 172.21.15.57:0/150900254 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fca6409b420 msgr2=0x7fca6409d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:10.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.610+0000 7fca7fbff700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fca6409b420 0x7fca6409d8d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fca74006010 tx=0x7fca74005960 comp rx=0 tx=0).stop 2023-03-02T10:55:10.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.610+0000 7fca7fbff700 1 -- 172.21.15.57:0/150900254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca78100ca0 msgr2=0x7fca78195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:10.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.610+0000 7fca7fbff700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca78100ca0 0x7fca78195da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca6800d980 tx=0x7fca6800dc90 comp rx=0 tx=0).stop 2023-03-02T10:55:10.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.620+0000 7fca7fbff700 1 -- 172.21.15.57:0/150900254 shutdown_connections 2023-03-02T10:55:10.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.620+0000 7fca7fbff700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fca6409b420 0x7fca6409d8d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.620+0000 7fca7fbff700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca78101630 0x7fca7819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.620+0000 7fca7fbff700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca780ffab0 0x7fca78195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.620+0000 7fca7fbff700 1 --2- 172.21.15.57:0/150900254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca78100ca0 0x7fca78195da0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.620+0000 7fca7fbff700 1 -- 172.21.15.57:0/150900254 >> 172.21.15.57:0/150900254 conn(0x7fca780fb0b0 msgr2=0x7fca781041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:10.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.622+0000 7fca7fbff700 1 -- 172.21.15.57:0/150900254 shutdown_connections 2023-03-02T10:55:10.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.622+0000 7fca7fbff700 1 -- 172.21.15.57:0/150900254 wait complete. 2023-03-02T10:55:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 2 and data pool 3 2023-03-02T10:55:10.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:55:10.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.803+0000 7f3dab3ff700 1 -- 172.21.15.57:0/2439941312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3da4102ed0 msgr2=0x7f3da41052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:10.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.803+0000 7f3dab3ff700 1 --2- 172.21.15.57:0/2439941312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3da4102ed0 0x7f3da41052b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009990 tx=0x7f3d94009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.803+0000 7f3dab3ff700 1 -- 172.21.15.57:0/2439941312 shutdown_connections 2023-03-02T10:55:10.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.803+0000 7f3dab3ff700 1 --2- 172.21.15.57:0/2439941312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da41057f0 0x7f3da4107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.803+0000 7f3dab3ff700 1 --2- 172.21.15.57:0/2439941312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3da41005b0 0x7f3da4102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.803+0000 7f3dab3ff700 1 --2- 172.21.15.57:0/2439941312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3da4102ed0 0x7f3da41052b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.803+0000 7f3dab3ff700 1 -- 172.21.15.57:0/2439941312 >> 172.21.15.57:0/2439941312 conn(0x7f3da40f9fd0 msgr2=0x7f3da40fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:10.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.803+0000 7f3dab3ff700 1 -- 172.21.15.57:0/2439941312 shutdown_connections 2023-03-02T10:55:10.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.804+0000 7f3dab3ff700 1 -- 172.21.15.57:0/2439941312 wait complete. 2023-03-02T10:55:10.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.804+0000 7f3dab3ff700 1 Processor -- start 2023-03-02T10:55:10.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3dab3ff700 1 -- start start 2023-03-02T10:55:10.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3dab3ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da41005b0 0x7f3da4195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:10.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3dab3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3da4102ed0 0x7f3da4195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:10.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3dab3ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3da41057f0 0x7f3da419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:10.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3dab3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da419d3e0 con 0x7f3da4102ed0 2023-03-02T10:55:10.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3dab3ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da419d520 con 0x7f3da41057f0 2023-03-02T10:55:10.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3dab3ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da419d6b0 con 0x7f3da41005b0 2023-03-02T10:55:10.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3da899a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3da4102ed0 0x7f3da4195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:10.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3da919b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da41005b0 0x7f3da4195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:10.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3da999c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3da41057f0 0x7f3da419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:10.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3da919b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da41005b0 0x7f3da4195860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:41218/0 (socket says 172.21.15.57:41218) 2023-03-02T10:55:10.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.805+0000 7f3da919b700 1 -- 172.21.15.57:0/4131578426 learned_addr learned my addr 172.21.15.57:0/4131578426 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:10.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3da919b700 1 -- 172.21.15.57:0/4131578426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3da41057f0 msgr2=0x7f3da419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:10.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3da919b700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3da41057f0 0x7f3da419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3da919b700 1 -- 172.21.15.57:0/4131578426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3da4102ed0 msgr2=0x7f3da4195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:10.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3da919b700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3da4102ed0 0x7f3da4195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:10.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3da919b700 1 -- 172.21.15.57:0/4131578426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940095f0 con 0x7f3da41005b0 2023-03-02T10:55:10.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3da999c700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3da41057f0 0x7f3da419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:10.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3da899a700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3da4102ed0 0x7f3da4195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:10.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3da919b700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da41005b0 0x7f3da4195860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3da000e970 tx=0x7f3da000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:10.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3d9a7fc700 1 -- 172.21.15.57:0/4131578426 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0009790 con 0x7f3da41005b0 2023-03-02T10:55:10.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3d9a7fc700 1 -- 172.21.15.57:0/4131578426 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3da000c7e0 con 0x7f3da41005b0 2023-03-02T10:55:10.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3d9a7fc700 1 -- 172.21.15.57:0/4131578426 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da00054e0 con 0x7f3da41005b0 2023-03-02T10:55:10.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3dab3ff700 1 -- 172.21.15.57:0/4131578426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da410b470 con 0x7f3da41005b0 2023-03-02T10:55:10.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.806+0000 7f3dab3ff700 1 -- 172.21.15.57:0/4131578426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da410b2e0 con 0x7f3da41005b0 2023-03-02T10:55:10.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.807+0000 7f3dab3ff700 1 -- 172.21.15.57:0/4131578426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da40fbb40 con 0x7f3da41005b0 2023-03-02T10:55:10.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.809+0000 7f3d9a7fc700 1 -- 172.21.15.57:0/4131578426 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f3da001e020 con 0x7f3da41005b0 2023-03-02T10:55:10.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.810+0000 7f3d9a7fc700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d9009b420 0x7f3d9009d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:10.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.810+0000 7f3d9a7fc700 1 -- 172.21.15.57:0/4131578426 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3da0014070 con 0x7f3da41005b0 2023-03-02T10:55:10.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.810+0000 7f3da899a700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d9009b420 0x7f3d9009d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:10.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.810+0000 7f3da899a700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d9009b420 0x7f3d9009d8d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400b2e0 tx=0x7f3d94005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:10.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:10.812+0000 7f3d9a7fc700 1 -- 172.21.15.57:0/4131578426 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f3da0090ca0 con 0x7f3da41005b0 2023-03-02T10:55:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:10 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3657571412' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-03-02T10:55:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:10 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:10 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:10 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3657571412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-03-02T10:55:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:10 smithi136 ceph-mon[125702]: osdmap e82: 12 total, 12 up, 12 in 2023-03-02T10:55:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:10 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:10 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:10 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3657571412' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-03-02T10:55:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:10 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:10 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:10 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3657571412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-03-02T10:55:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:10 smithi057 ceph-mon[92072]: osdmap e82: 12 total, 12 up, 12 in 2023-03-02T10:55:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:10 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:10 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:10 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3657571412' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-03-02T10:55:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:10 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:10 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:10 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3657571412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-03-02T10:55:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:10 smithi122 ceph-mon[125440]: osdmap e82: 12 total, 12 up, 12 in 2023-03-02T10:55:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:10 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:10 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:11.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.013+0000 7f3dab3ff700 1 -- 172.21.15.57:0/4131578426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3da402cd50 con 0x7f3da41005b0 2023-03-02T10:55:11.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.015+0000 7f3d9a7fc700 1 -- 172.21.15.57:0/4131578426 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22135 (secure 0 0 0) 0x7f3da00942c0 con 0x7f3da41005b0 2023-03-02T10:55:11.018 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:11.018 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":83,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:10.600663+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:55:11.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.017+0000 7f3dab3ff700 1 -- 172.21.15.57:0/4131578426 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d9009b420 msgr2=0x7f3d9009d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:11.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.017+0000 7f3dab3ff700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d9009b420 0x7f3d9009d8d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400b2e0 tx=0x7f3d94005fb0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.017+0000 7f3dab3ff700 1 -- 172.21.15.57:0/4131578426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da41005b0 msgr2=0x7f3da4195860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:11.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.017+0000 7f3dab3ff700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da41005b0 0x7f3da4195860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3da000e970 tx=0x7f3da000ec80 comp rx=0 tx=0).stop 2023-03-02T10:55:11.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.017+0000 7f3dab3ff700 1 -- 172.21.15.57:0/4131578426 shutdown_connections 2023-03-02T10:55:11.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.017+0000 7f3dab3ff700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d9009b420 0x7f3d9009d8d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.017+0000 7f3dab3ff700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3da41057f0 0x7f3da419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.017+0000 7f3dab3ff700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da41005b0 0x7f3da4195860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.017+0000 7f3dab3ff700 1 --2- 172.21.15.57:0/4131578426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3da4102ed0 0x7f3da4195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.017+0000 7f3dab3ff700 1 -- 172.21.15.57:0/4131578426 >> 172.21.15.57:0/4131578426 conn(0x7f3da40f9fd0 msgr2=0x7f3da41011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:11.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.018+0000 7f3dab3ff700 1 -- 172.21.15.57:0/4131578426 shutdown_connections 2023-03-02T10:55:11.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.018+0000 7f3dab3ff700 1 -- 172.21.15.57:0/4131578426 wait complete. 2023-03-02T10:55:11.036 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:55:11.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.188+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3148764130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e9c0fe990 msgr2=0x7f8e9c0feda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:11.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.188+0000 7f8ea27ff700 1 --2- 172.21.15.57:0/3148764130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e9c0fe990 0x7f8e9c0feda0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009990 tx=0x7f8e8c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.188+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3148764130 shutdown_connections 2023-03-02T10:55:11.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.188+0000 7f8ea27ff700 1 --2- 172.21.15.57:0/3148764130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e9c1005d0 0x7f8e9c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.188+0000 7f8ea27ff700 1 --2- 172.21.15.57:0/3148764130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e9c0fe990 0x7f8e9c0feda0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.188+0000 7f8ea27ff700 1 --2- 172.21.15.57:0/3148764130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c0ffc20 0x7f8e9c100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.188+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3148764130 >> 172.21.15.57:0/3148764130 conn(0x7f8e9c0f9fd0 msgr2=0x7f8e9c0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:11.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.188+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3148764130 shutdown_connections 2023-03-02T10:55:11.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.188+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3148764130 wait complete. 2023-03-02T10:55:11.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.189+0000 7f8ea27ff700 1 Processor -- start 2023-03-02T10:55:11.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.189+0000 7f8ea27ff700 1 -- start start 2023-03-02T10:55:11.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.189+0000 7f8ea27ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e9c0fe990 0x7f8e9c1029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:11.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.189+0000 7f8ea27ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e9c0ffc20 0x7f8e9c101000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:11.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.189+0000 7f8ea27ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c1005d0 0x7f8e9c101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:11.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.189+0000 7f8ea27ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c101ce0 con 0x7f8e9c0fe990 2023-03-02T10:55:11.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.189+0000 7f8ea27ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c101e50 con 0x7f8e9c1005d0 2023-03-02T10:55:11.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.189+0000 7f8ea27ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c19f8b0 con 0x7f8e9c0ffc20 2023-03-02T10:55:11.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.189+0000 7f8e9bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e9c0fe990 0x7f8e9c1029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:11.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e9bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e9c0fe990 0x7f8e9c1029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37612/0 (socket says 172.21.15.57:37612) 2023-03-02T10:55:11.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e937fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e9c0ffc20 0x7f8e9c101000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:11.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e9bfff700 1 -- 172.21.15.57:0/3025289650 learned_addr learned my addr 172.21.15.57:0/3025289650 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:11.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8ea0d9c700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c1005d0 0x7f8e9c101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:11.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e9bfff700 1 -- 172.21.15.57:0/3025289650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e9c0ffc20 msgr2=0x7f8e9c101000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:11.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e9bfff700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e9c0ffc20 0x7f8e9c101000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e9bfff700 1 -- 172.21.15.57:0/3025289650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c1005d0 msgr2=0x7f8e9c101540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:11.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e9bfff700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c1005d0 0x7f8e9c101540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e9bfff700 1 -- 172.21.15.57:0/3025289650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c0095f0 con 0x7f8e9c0fe990 2023-03-02T10:55:11.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e9bfff700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e9c0fe990 0x7f8e9c1029c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c004730 tx=0x7f8e8c004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:11.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e99ffb700 1 -- 172.21.15.57:0/3025289650 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c01d070 con 0x7f8e9c0fe990 2023-03-02T10:55:11.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3025289650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c10a340 con 0x7f8e9c0fe990 2023-03-02T10:55:11.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e99ffb700 1 -- 172.21.15.57:0/3025289650 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e8c004c90 con 0x7f8e9c0fe990 2023-03-02T10:55:11.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8e99ffb700 1 -- 172.21.15.57:0/3025289650 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0054b0 con 0x7f8e9c0fe990 2023-03-02T10:55:11.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.190+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3025289650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c10a1b0 con 0x7f8e9c0fe990 2023-03-02T10:55:11.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.191+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3025289650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9c067280 con 0x7f8e9c0fe990 2023-03-02T10:55:11.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.194+0000 7f8e99ffb700 1 -- 172.21.15.57:0/3025289650 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f8e8c00b050 con 0x7f8e9c0fe990 2023-03-02T10:55:11.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.194+0000 7f8e99ffb700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e8809b3a0 0x7f8e8809d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:11.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.195+0000 7f8e99ffb700 1 -- 172.21.15.57:0/3025289650 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8e8c0c63c0 con 0x7f8e9c0fe990 2023-03-02T10:55:11.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.195+0000 7f8e937fe700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e8809b3a0 0x7f8e8809d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:11.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.195+0000 7f8e937fe700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e8809b3a0 0x7f8e8809d850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009c60 tx=0x7f8e84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:11.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.198+0000 7f8e99ffb700 1 -- 172.21.15.57:0/3025289650 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f8e8c091f10 con 0x7f8e9c0fe990 2023-03-02T10:55:11.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.395+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3025289650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e9c1a0360 con 0x7f8e9c0fe990 2023-03-02T10:55:11.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.397+0000 7f8e99ffb700 1 -- 172.21.15.57:0/3025289650 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22135 (secure 0 0 0) 0x7f8e8c02f090 con 0x7f8e9c0fe990 2023-03-02T10:55:11.399 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:11.399 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":83,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:10.600663+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:55:11.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.399+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3025289650 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e8809b3a0 msgr2=0x7f8e8809d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:11.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.399+0000 7f8ea27ff700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e8809b3a0 0x7f8e8809d850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009c60 tx=0x7f8e84009260 comp rx=0 tx=0).stop 2023-03-02T10:55:11.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.399+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3025289650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e9c0fe990 msgr2=0x7f8e9c1029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.399+0000 7f8ea27ff700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e9c0fe990 0x7f8e9c1029c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c004730 tx=0x7f8e8c004760 comp rx=0 tx=0).stop 2023-03-02T10:55:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.399+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3025289650 shutdown_connections 2023-03-02T10:55:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.399+0000 7f8ea27ff700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e8809b3a0 0x7f8e8809d850 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.399+0000 7f8ea27ff700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c1005d0 0x7f8e9c101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.399+0000 7f8ea27ff700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e9c0fe990 0x7f8e9c1029c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.399+0000 7f8ea27ff700 1 --2- 172.21.15.57:0/3025289650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e9c0ffc20 0x7f8e9c101000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.400+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3025289650 >> 172.21.15.57:0/3025289650 conn(0x7f8e9c0f9fd0 msgr2=0x7f8e9c0676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:11.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.400+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3025289650 shutdown_connections 2023-03-02T10:55:11.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.400+0000 7f8ea27ff700 1 -- 172.21.15.57:0/3025289650 wait complete. 2023-03-02T10:55:11.418 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-02T10:55:11.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.573+0000 7f3c3bbff700 1 -- 172.21.15.57:0/3719211867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c34100540 msgr2=0x7f3c34106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:11.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.573+0000 7f3c3bbff700 1 --2- 172.21.15.57:0/3719211867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c34100540 0x7f3c34106e00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00b0a0 tx=0x7f3c2c00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.573+0000 7f3c3bbff700 1 -- 172.21.15.57:0/3719211867 shutdown_connections 2023-03-02T10:55:11.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.573+0000 7f3c3bbff700 1 --2- 172.21.15.57:0/3719211867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c34100540 0x7f3c34106e00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.573+0000 7f3c3bbff700 1 --2- 172.21.15.57:0/3719211867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c340fe9c0 0x7f3c340fedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.573+0000 7f3c3bbff700 1 --2- 172.21.15.57:0/3719211867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c340ffbb0 0x7f3c34100000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.573+0000 7f3c3bbff700 1 -- 172.21.15.57:0/3719211867 >> 172.21.15.57:0/3719211867 conn(0x7f3c340f9fe0 msgr2=0x7f3c340fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.573+0000 7f3c3bbff700 1 -- 172.21.15.57:0/3719211867 shutdown_connections 2023-03-02T10:55:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.573+0000 7f3c3bbff700 1 -- 172.21.15.57:0/3719211867 wait complete. 2023-03-02T10:55:11.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.573+0000 7f3c3bbff700 1 Processor -- start 2023-03-02T10:55:11.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3bbff700 1 -- start start 2023-03-02T10:55:11.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3bbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c340fe9c0 0x7f3c34102950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:11.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3bbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c340ffbb0 0x7f3c34100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:11.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3bbff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c34100540 0x7f3c341014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:11.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3bbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34101c70 con 0x7f3c340ffbb0 2023-03-02T10:55:11.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3bbff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34101de0 con 0x7f3c34100540 2023-03-02T10:55:11.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3bbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3419f980 con 0x7f3c340fe9c0 2023-03-02T10:55:11.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3919a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c340ffbb0 0x7f3c34100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:11.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3919a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c340ffbb0 0x7f3c34100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37624/0 (socket says 172.21.15.57:37624) 2023-03-02T10:55:11.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3919a700 1 -- 172.21.15.57:0/2214664443 learned_addr learned my addr 172.21.15.57:0/2214664443 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:11.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3999b700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c340fe9c0 0x7f3c34102950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:11.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3a19c700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c34100540 0x7f3c341014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:11.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3919a700 1 -- 172.21.15.57:0/2214664443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c340fe9c0 msgr2=0x7f3c34102950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:11.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3919a700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c340fe9c0 0x7f3c34102950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3919a700 1 -- 172.21.15.57:0/2214664443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c34100540 msgr2=0x7f3c341014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:11.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3919a700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c34100540 0x7f3c341014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:11.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.574+0000 7f3c3919a700 1 -- 172.21.15.57:0/2214664443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c009d00 con 0x7f3c340ffbb0 2023-03-02T10:55:11.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.575+0000 7f3c3919a700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c340ffbb0 0x7f3c34100f90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400d980 tx=0x7f3c2400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:11.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.575+0000 7f3c2affd700 1 -- 172.21.15.57:0/2214664443 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24004220 con 0x7f3c340ffbb0 2023-03-02T10:55:11.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.575+0000 7f3c2affd700 1 -- 172.21.15.57:0/2214664443 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c24007640 con 0x7f3c340ffbb0 2023-03-02T10:55:11.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.575+0000 7f3c3bbff700 1 -- 172.21.15.57:0/2214664443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3410a380 con 0x7f3c340ffbb0 2023-03-02T10:55:11.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.575+0000 7f3c2affd700 1 -- 172.21.15.57:0/2214664443 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24005690 con 0x7f3c340ffbb0 2023-03-02T10:55:11.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.575+0000 7f3c3bbff700 1 -- 172.21.15.57:0/2214664443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3410a1f0 con 0x7f3c340ffbb0 2023-03-02T10:55:11.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.576+0000 7f3c3bbff700 1 -- 172.21.15.57:0/2214664443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c341a0000 con 0x7f3c340ffbb0 2023-03-02T10:55:11.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.578+0000 7f3c2affd700 1 -- 172.21.15.57:0/2214664443 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f3c24021070 con 0x7f3c340ffbb0 2023-03-02T10:55:11.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.579+0000 7f3c2affd700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3c2009b420 0x7f3c2009d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:11.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.579+0000 7f3c2affd700 1 -- 172.21.15.57:0/2214664443 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3c240c4f80 con 0x7f3c340ffbb0 2023-03-02T10:55:11.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.579+0000 7f3c3999b700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3c2009b420 0x7f3c2009d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:11.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.580+0000 7f3c3999b700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3c2009b420 0x7f3c2009d8d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c340ffa10 tx=0x7f3c30009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:11.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.582+0000 7f3c2affd700 1 -- 172.21.15.57:0/2214664443 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f3c24090950 con 0x7f3c340ffbb0 2023-03-02T10:55:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:55:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/150900254' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-03-02T10:55:11.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-03-02T10:55:11.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: osdmap e83: 12 total, 12 up, 12 in 2023-03-02T10:55:11.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/150900254' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-03-02T10:55:11.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-03-02T10:55:11.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-03-02T10:55:11.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/4131578426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:11.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: pgmap v264: 97 pgs: 23 creating+peering, 63 unknown, 11 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2023-03-02T10:55:11.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:11 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3025289650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:11.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:11.830+0000 7f3c3bbff700 1 -- 172.21.15.57:0/2214664443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3c341a05b0 con 0x7f3c340ffbb0 2023-03-02T10:55:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:55:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/150900254' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-03-02T10:55:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-03-02T10:55:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: osdmap e83: 12 total, 12 up, 12 in 2023-03-02T10:55:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/150900254' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-03-02T10:55:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-03-02T10:55:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-03-02T10:55:11.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/4131578426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:11.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: pgmap v264: 97 pgs: 23 creating+peering, 63 unknown, 11 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2023-03-02T10:55:11.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:11 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3025289650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:55:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:55:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:55:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/150900254' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-03-02T10:55:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-03-02T10:55:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: osdmap e83: 12 total, 12 up, 12 in 2023-03-02T10:55:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/150900254' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-03-02T10:55:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-03-02T10:55:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-03-02T10:55:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/4131578426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: pgmap v264: 97 pgs: 23 creating+peering, 63 unknown, 11 active+clean; 577 KiB data, 73 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2023-03-02T10:55:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:11 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3025289650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:12.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.618+0000 7f3c2affd700 1 -- 172.21.15.57:0/2214664443 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3c24016030 con 0x7f3c340ffbb0 2023-03-02T10:55:12.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 -- 172.21.15.57:0/2214664443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3c2009b420 msgr2=0x7f3c2009d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:12.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3c2009b420 0x7f3c2009d8d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c340ffa10 tx=0x7f3c30009260 comp rx=0 tx=0).stop 2023-03-02T10:55:12.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 -- 172.21.15.57:0/2214664443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c340ffbb0 msgr2=0x7f3c34100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:12.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c340ffbb0 0x7f3c34100f90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400d980 tx=0x7f3c2400dc90 comp rx=0 tx=0).stop 2023-03-02T10:55:12.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 -- 172.21.15.57:0/2214664443 shutdown_connections 2023-03-02T10:55:12.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3c2009b420 0x7f3c2009d8d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:12.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c34100540 0x7f3c341014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:12.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c340fe9c0 0x7f3c34102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:12.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 --2- 172.21.15.57:0/2214664443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c340ffbb0 0x7f3c34100f90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:12.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 -- 172.21.15.57:0/2214664443 >> 172.21.15.57:0/2214664443 conn(0x7f3c340f9fe0 msgr2=0x7f3c340688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:12.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 -- 172.21.15.57:0/2214664443 shutdown_connections 2023-03-02T10:55:12.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.621+0000 7f3c3bbff700 1 -- 172.21.15.57:0/2214664443 wait complete. 2023-03-02T10:55:12.642 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-03-02T10:55:12.642 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-03-02T10:55:12.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.804+0000 7f570bdff700 1 -- 172.21.15.57:0/3570477245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57040ffac0 msgr2=0x7f57040ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:12.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.804+0000 7f570bdff700 1 --2- 172.21.15.57:0/3570477245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57040ffac0 0x7f57040ffed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5700009990 tx=0x7f5700009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:12.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.804+0000 7f570bdff700 1 -- 172.21.15.57:0/3570477245 shutdown_connections 2023-03-02T10:55:12.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.804+0000 7f570bdff700 1 --2- 172.21.15.57:0/3570477245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5704101700 0x7f5704107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:12.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.804+0000 7f570bdff700 1 --2- 172.21.15.57:0/3570477245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57040ffac0 0x7f57040ffed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:12.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.804+0000 7f570bdff700 1 --2- 172.21.15.57:0/3570477245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5704100d50 0x7f57041011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:12.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.804+0000 7f570bdff700 1 -- 172.21.15.57:0/3570477245 >> 172.21.15.57:0/3570477245 conn(0x7f57040fb100 msgr2=0x7f57040fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:12.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.804+0000 7f570bdff700 1 -- 172.21.15.57:0/3570477245 shutdown_connections 2023-03-02T10:55:12.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.804+0000 7f570bdff700 1 -- 172.21.15.57:0/3570477245 wait complete. 2023-03-02T10:55:12.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.804+0000 7f570bdff700 1 Processor -- start 2023-03-02T10:55:12.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570bdff700 1 -- start start 2023-03-02T10:55:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570bdff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57040ffac0 0x7f57041957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570bdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5704100d50 0x7f5704195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570bdff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5704101700 0x7f570419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570bdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570419d360 con 0x7f5704100d50 2023-03-02T10:55:12.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570bdff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570419d4a0 con 0x7f5704101700 2023-03-02T10:55:12.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570bdff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570419d630 con 0x7f57040ffac0 2023-03-02T10:55:12.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570939a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5704100d50 0x7f5704195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:12.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570939a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5704100d50 0x7f5704195d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37642/0 (socket says 172.21.15.57:37642) 2023-03-02T10:55:12.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570939a700 1 -- 172.21.15.57:0/162861517 learned_addr learned my addr 172.21.15.57:0/162861517 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:12.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570a39c700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5704101700 0x7f570419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:12.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f5709b9b700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57040ffac0 0x7f57041957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:12.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570939a700 1 -- 172.21.15.57:0/162861517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57040ffac0 msgr2=0x7f57041957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:12.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570939a700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57040ffac0 0x7f57041957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:12.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570939a700 1 -- 172.21.15.57:0/162861517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5704101700 msgr2=0x7f570419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:12.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570939a700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5704101700 0x7f570419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:12.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570939a700 1 -- 172.21.15.57:0/162861517 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57000095f0 con 0x7f5704100d50 2023-03-02T10:55:12.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.805+0000 7f570939a700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5704100d50 0x7f5704195d20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f56f400d950 tx=0x7f56f400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:12.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.806+0000 7f56faffd700 1 -- 172.21.15.57:0/162861517 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4009940 con 0x7f5704100d50 2023-03-02T10:55:12.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.806+0000 7f56faffd700 1 -- 172.21.15.57:0/162861517 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56f4010460 con 0x7f5704100d50 2023-03-02T10:55:12.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.806+0000 7f570bdff700 1 -- 172.21.15.57:0/162861517 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570410b420 con 0x7f5704100d50 2023-03-02T10:55:12.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.806+0000 7f56faffd700 1 -- 172.21.15.57:0/162861517 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f400f620 con 0x7f5704100d50 2023-03-02T10:55:12.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.806+0000 7f570bdff700 1 -- 172.21.15.57:0/162861517 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570410b290 con 0x7f5704100d50 2023-03-02T10:55:12.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.807+0000 7f570bdff700 1 -- 172.21.15.57:0/162861517 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5704106ae0 con 0x7f5704100d50 2023-03-02T10:55:12.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.808+0000 7f56faffd700 1 -- 172.21.15.57:0/162861517 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f56f4022070 con 0x7f5704100d50 2023-03-02T10:55:12.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.809+0000 7f56faffd700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56f009b420 0x7f56f009d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:12.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.810+0000 7f5709b9b700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56f009b420 0x7f56f009d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:12.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.810+0000 7f56faffd700 1 -- 172.21.15.57:0/162861517 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f56f40c4aa0 con 0x7f5704100d50 2023-03-02T10:55:12.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.810+0000 7f5709b9b700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56f009b420 0x7f56f009d8d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5700006010 tx=0x7f570000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:12.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:12.814+0000 7f56faffd700 1 -- 172.21.15.57:0/162861517 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f56f4090560 con 0x7f5704100d50 2023-03-02T10:55:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:12 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] up:active 2023-03-02T10:55:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:12 smithi057 ceph-mon[92072]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-02T10:55:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:12 smithi057 ceph-mon[92072]: osdmap e84: 12 total, 12 up, 12 in 2023-03-02T10:55:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:12 smithi057 ceph-mon[92072]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-02T10:55:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:12 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2214664443' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-03-02T10:55:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:12 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] up:active 2023-03-02T10:55:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:12 smithi122 ceph-mon[125440]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-02T10:55:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:12 smithi122 ceph-mon[125440]: osdmap e84: 12 total, 12 up, 12 in 2023-03-02T10:55:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:12 smithi122 ceph-mon[125440]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-02T10:55:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:12 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2214664443' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-03-02T10:55:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.059+0000 7f570bdff700 1 -- 172.21.15.57:0/162861517 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f5704061700 con 0x7f5704100d50 2023-03-02T10:55:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:12 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] up:active 2023-03-02T10:55:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:12 smithi136 ceph-mon[125702]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-02T10:55:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:12 smithi136 ceph-mon[125702]: osdmap e84: 12 total, 12 up, 12 in 2023-03-02T10:55:13.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:12 smithi136 ceph-mon[125702]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-02T10:55:13.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:12 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2214664443' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-03-02T10:55:13.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.513+0000 7f56faffd700 1 -- 172.21.15.57:0/162861517 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f56f4020020 con 0x7f5704100d50 2023-03-02T10:55:13.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 -- 172.21.15.57:0/162861517 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56f009b420 msgr2=0x7f56f009d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:13.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56f009b420 0x7f56f009d8d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5700006010 tx=0x7f570000b540 comp rx=0 tx=0).stop 2023-03-02T10:55:13.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 -- 172.21.15.57:0/162861517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5704100d50 msgr2=0x7f5704195d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5704100d50 0x7f5704195d20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f56f400d950 tx=0x7f56f400dc60 comp rx=0 tx=0).stop 2023-03-02T10:55:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 -- 172.21.15.57:0/162861517 shutdown_connections 2023-03-02T10:55:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f56f009b420 0x7f56f009d8d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5704101700 0x7f570419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57040ffac0 0x7f57041957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 --2- 172.21.15.57:0/162861517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5704100d50 0x7f5704195d20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 -- 172.21.15.57:0/162861517 >> 172.21.15.57:0/162861517 conn(0x7f57040fb100 msgr2=0x7f57040fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:13.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 -- 172.21.15.57:0/162861517 shutdown_connections 2023-03-02T10:55:13.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.516+0000 7f570bdff700 1 -- 172.21.15.57:0/162861517 wait complete. 2023-03-02T10:55:13.540 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-03-02T10:55:13.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.701+0000 7f7f921ff700 1 -- 172.21.15.57:0/3939954382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f8c100d50 msgr2=0x7f7f8c1011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:13.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.701+0000 7f7f921ff700 1 --2- 172.21.15.57:0/3939954382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f8c100d50 0x7f7f8c1011c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009990 tx=0x7f7f80009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:13.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.701+0000 7f7f921ff700 1 -- 172.21.15.57:0/3939954382 shutdown_connections 2023-03-02T10:55:13.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.701+0000 7f7f921ff700 1 --2- 172.21.15.57:0/3939954382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c101700 0x7f7f8c107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:13.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.701+0000 7f7f921ff700 1 --2- 172.21.15.57:0/3939954382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f8c0ffac0 0x7f7f8c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:13.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.701+0000 7f7f921ff700 1 --2- 172.21.15.57:0/3939954382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f8c100d50 0x7f7f8c1011c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:13.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.701+0000 7f7f921ff700 1 -- 172.21.15.57:0/3939954382 >> 172.21.15.57:0/3939954382 conn(0x7f7f8c0fb100 msgr2=0x7f7f8c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:13.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.701+0000 7f7f921ff700 1 -- 172.21.15.57:0/3939954382 shutdown_connections 2023-03-02T10:55:13.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.701+0000 7f7f921ff700 1 -- 172.21.15.57:0/3939954382 wait complete. 2023-03-02T10:55:13.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f921ff700 1 Processor -- start 2023-03-02T10:55:13.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f921ff700 1 -- start start 2023-03-02T10:55:13.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f921ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f8c0ffac0 0x7f7f8c074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:13.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f921ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c100d50 0x7f7f8c072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:13.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f921ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f8c101700 0x7f7f8c072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:13.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f921ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c073660 con 0x7f7f8c0ffac0 2023-03-02T10:55:13.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f921ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0737d0 con 0x7f7f8c100d50 2023-03-02T10:55:13.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f921ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c19f810 con 0x7f7f8c101700 2023-03-02T10:55:13.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f8c0ffac0 0x7f7f8c074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f8c0ffac0 0x7f7f8c074340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37656/0 (socket says 172.21.15.57:37656) 2023-03-02T10:55:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8b7fe700 1 -- 172.21.15.57:0/2100297118 learned_addr learned my addr 172.21.15.57:0/2100297118 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8affd700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c100d50 0x7f7f8c072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8b7fe700 1 -- 172.21.15.57:0/2100297118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f8c101700 msgr2=0x7f7f8c072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8bfff700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f8c101700 0x7f7f8c072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8b7fe700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f8c101700 0x7f7f8c072ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8b7fe700 1 -- 172.21.15.57:0/2100297118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c100d50 msgr2=0x7f7f8c072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:13.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8b7fe700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c100d50 0x7f7f8c072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:13.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8b7fe700 1 -- 172.21.15.57:0/2100297118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f800095f0 con 0x7f7f8c0ffac0 2023-03-02T10:55:13.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8affd700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c100d50 0x7f7f8c072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.702+0000 7f7f8b7fe700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f8c0ffac0 0x7f7f8c074340 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c9b0 tx=0x7f7f7c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.703+0000 7f7f88ff9700 1 -- 172.21.15.57:0/2100297118 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c007b00 con 0x7f7f8c0ffac0 2023-03-02T10:55:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.703+0000 7f7f88ff9700 1 -- 172.21.15.57:0/2100297118 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f7c007c60 con 0x7f7f8c0ffac0 2023-03-02T10:55:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.703+0000 7f7f88ff9700 1 -- 172.21.15.57:0/2100297118 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c018660 con 0x7f7f8c0ffac0 2023-03-02T10:55:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.703+0000 7f7f921ff700 1 -- 172.21.15.57:0/2100297118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8c10b420 con 0x7f7f8c0ffac0 2023-03-02T10:55:13.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.703+0000 7f7f921ff700 1 -- 172.21.15.57:0/2100297118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8c10b290 con 0x7f7f8c0ffac0 2023-03-02T10:55:13.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.704+0000 7f7f921ff700 1 -- 172.21.15.57:0/2100297118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8c1070a0 con 0x7f7f8c0ffac0 2023-03-02T10:55:13.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.705+0000 7f7f88ff9700 1 -- 172.21.15.57:0/2100297118 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f7f7c018880 con 0x7f7f8c0ffac0 2023-03-02T10:55:13.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.706+0000 7f7f88ff9700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f7409b3a0 0x7f7f7409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:13.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.706+0000 7f7f88ff9700 1 -- 172.21.15.57:0/2100297118 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7f7c0c5090 con 0x7f7f8c0ffac0 2023-03-02T10:55:13.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.706+0000 7f7f8affd700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f7409b3a0 0x7f7f7409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:13.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.707+0000 7f7f8affd700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f7409b3a0 0x7f7f7409d850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7f80006010 tx=0x7f7f8000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:13.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.710+0000 7f7f88ff9700 1 -- 172.21.15.57:0/2100297118 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f7f7c090a60 con 0x7f7f8c0ffac0 2023-03-02T10:55:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:13 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2214664443' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-03-02T10:55:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:13 smithi057 ceph-mon[92072]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-02T10:55:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:13 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/162861517' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-03-02T10:55:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:13 smithi057 ceph-mon[92072]: pgmap v266: 97 pgs: 23 creating+peering, 39 unknown, 35 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2023-03-02T10:55:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:13 smithi057 ceph-mon[92072]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-03-02T10:55:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:13 smithi057 ceph-mon[92072]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-03-02T10:55:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:13 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/162861517' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-03-02T10:55:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:13 smithi057 ceph-mon[92072]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-03-02T10:55:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:13 smithi057 ceph-mon[92072]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-03-02T10:55:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:13 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2214664443' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-03-02T10:55:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:13 smithi122 ceph-mon[125440]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-02T10:55:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:13 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/162861517' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-03-02T10:55:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:13 smithi122 ceph-mon[125440]: pgmap v266: 97 pgs: 23 creating+peering, 39 unknown, 35 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2023-03-02T10:55:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:13 smithi122 ceph-mon[125440]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-03-02T10:55:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:13 smithi122 ceph-mon[125440]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-03-02T10:55:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:13 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/162861517' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-03-02T10:55:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:13 smithi122 ceph-mon[125440]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-03-02T10:55:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:13 smithi122 ceph-mon[125440]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-03-02T10:55:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:13.954+0000 7f7f921ff700 1 -- 172.21.15.57:0/2100297118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f7f8c02cd50 con 0x7f7f8c0ffac0 2023-03-02T10:55:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:13 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2214664443' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-03-02T10:55:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:13 smithi136 ceph-mon[125702]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-02T10:55:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:13 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/162861517' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-03-02T10:55:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:13 smithi136 ceph-mon[125702]: pgmap v266: 97 pgs: 23 creating+peering, 39 unknown, 35 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2023-03-02T10:55:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:13 smithi136 ceph-mon[125702]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-03-02T10:55:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:13 smithi136 ceph-mon[125702]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-03-02T10:55:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:13 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/162861517' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-03-02T10:55:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:13 smithi136 ceph-mon[125702]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-03-02T10:55:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:13 smithi136 ceph-mon[125702]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-03-02T10:55:14.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.520+0000 7f7f88ff9700 1 -- 172.21.15.57:0/2100297118 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f7f7c094080 con 0x7f7f8c0ffac0 2023-03-02T10:55:14.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 -- 172.21.15.57:0/2100297118 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f7409b3a0 msgr2=0x7f7f7409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:14.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f7409b3a0 0x7f7f7409d850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7f80006010 tx=0x7f7f8000b260 comp rx=0 tx=0).stop 2023-03-02T10:55:14.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 -- 172.21.15.57:0/2100297118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f8c0ffac0 msgr2=0x7f7f8c074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:14.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f8c0ffac0 0x7f7f8c074340 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c9b0 tx=0x7f7f7c00cd70 comp rx=0 tx=0).stop 2023-03-02T10:55:14.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 -- 172.21.15.57:0/2100297118 shutdown_connections 2023-03-02T10:55:14.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f7409b3a0 0x7f7f7409d850 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:14.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f8c101700 0x7f7f8c072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f8c0ffac0 0x7f7f8c074340 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 --2- 172.21.15.57:0/2100297118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c100d50 0x7f7f8c072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 -- 172.21.15.57:0/2100297118 >> 172.21.15.57:0/2100297118 conn(0x7f7f8c0fb100 msgr2=0x7f7f8c1041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 -- 172.21.15.57:0/2100297118 shutdown_connections 2023-03-02T10:55:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.523+0000 7f7f921ff700 1 -- 172.21.15.57:0/2100297118 wait complete. 2023-03-02T10:55:14.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-03-02T10:55:14.633 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:55:14 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:55:14.332+0000 7f8db07c6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-02T10:55:14.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.710+0000 7fbad87ff700 1 -- 172.21.15.57:0/1663460414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad00fe990 msgr2=0x7fbad00feda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:14.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.710+0000 7fbad87ff700 1 --2- 172.21.15.57:0/1663460414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad00fe990 0x7fbad00feda0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009990 tx=0x7fbacc009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:14.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.710+0000 7fbad87ff700 1 -- 172.21.15.57:0/1663460414 shutdown_connections 2023-03-02T10:55:14.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.710+0000 7fbad87ff700 1 --2- 172.21.15.57:0/1663460414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad01005d0 0x7fbad0106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:14.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.710+0000 7fbad87ff700 1 --2- 172.21.15.57:0/1663460414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad00fe990 0x7fbad00feda0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:14.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.710+0000 7fbad87ff700 1 --2- 172.21.15.57:0/1663460414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbad00ffc20 0x7fbad0100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:14.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.710+0000 7fbad87ff700 1 -- 172.21.15.57:0/1663460414 >> 172.21.15.57:0/1663460414 conn(0x7fbad00f9fd0 msgr2=0x7fbad00fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:14.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.710+0000 7fbad87ff700 1 -- 172.21.15.57:0/1663460414 shutdown_connections 2023-03-02T10:55:14.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.710+0000 7fbad87ff700 1 -- 172.21.15.57:0/1663460414 wait complete. 2023-03-02T10:55:14.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.711+0000 7fbad87ff700 1 Processor -- start 2023-03-02T10:55:14.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.711+0000 7fbad87ff700 1 -- start start 2023-03-02T10:55:14.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.711+0000 7fbad87ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad00fe990 0x7fbad01957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:14.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.711+0000 7fbad87ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbad00ffc20 0x7fbad0195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:14.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.711+0000 7fbad87ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad01005d0 0x7fbad019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:14.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.711+0000 7fbad87ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad019d350 con 0x7fbad00fe990 2023-03-02T10:55:14.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.711+0000 7fbad87ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad019d490 con 0x7fbad00ffc20 2023-03-02T10:55:14.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.711+0000 7fbad87ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad019d620 con 0x7fbad01005d0 2023-03-02T10:55:14.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad659b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad00fe990 0x7fbad01957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:14.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad659b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad00fe990 0x7fbad01957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37678/0 (socket says 172.21.15.57:37678) 2023-03-02T10:55:14.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad659b700 1 -- 172.21.15.57:0/1696331929 learned_addr learned my addr 172.21.15.57:0/1696331929 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:14.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad5d9a700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbad00ffc20 0x7fbad0195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:14.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad6d9c700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad01005d0 0x7fbad019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:14.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad659b700 1 -- 172.21.15.57:0/1696331929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad01005d0 msgr2=0x7fbad019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:14.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad659b700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad01005d0 0x7fbad019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:14.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad659b700 1 -- 172.21.15.57:0/1696331929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbad00ffc20 msgr2=0x7fbad0195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:14.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad659b700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbad00ffc20 0x7fbad0195d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:14.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad659b700 1 -- 172.21.15.57:0/1696331929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0095f0 con 0x7fbad00fe990 2023-03-02T10:55:14.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad6d9c700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad01005d0 0x7fbad019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:14.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad659b700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad00fe990 0x7fbad01957d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbacc005910 tx=0x7fbacc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:14.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbac77fe700 1 -- 172.21.15.57:0/1696331929 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc01d070 con 0x7fbad00fe990 2023-03-02T10:55:14.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad87ff700 1 -- 172.21.15.57:0/1696331929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad010a340 con 0x7fbad00fe990 2023-03-02T10:55:14.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbac77fe700 1 -- 172.21.15.57:0/1696331929 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbacc00fb80 con 0x7fbad00fe990 2023-03-02T10:55:14.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbac77fe700 1 -- 172.21.15.57:0/1696331929 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc017650 con 0x7fbad00fe990 2023-03-02T10:55:14.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.712+0000 7fbad87ff700 1 -- 172.21.15.57:0/1696331929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad010a1b0 con 0x7fbad00fe990 2023-03-02T10:55:14.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.713+0000 7fbad87ff700 1 -- 172.21.15.57:0/1696331929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad019dc20 con 0x7fbad00fe990 2023-03-02T10:55:14.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.715+0000 7fbac77fe700 1 -- 172.21.15.57:0/1696331929 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fbacc029030 con 0x7fbad00fe990 2023-03-02T10:55:14.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.716+0000 7fbac77fe700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbabc09b3a0 0x7fbabc09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:14.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.716+0000 7fbac77fe700 1 -- 172.21.15.57:0/1696331929 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbacc0c6240 con 0x7fbad00fe990 2023-03-02T10:55:14.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.716+0000 7fbad5d9a700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbabc09b3a0 0x7fbabc09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:14.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.716+0000 7fbad5d9a700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbabc09b3a0 0x7fbabc09d850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbac000ac50 tx=0x7fbac000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:14.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.720+0000 7fbac77fe700 1 -- 172.21.15.57:0/1696331929 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fbacc091d90 con 0x7fbad00fe990 2023-03-02T10:55:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:14 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2100297118' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-03-02T10:55:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:14 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] up:active 2023-03-02T10:55:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:14 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2100297118' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-03-02T10:55:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:14 smithi057 ceph-mon[92072]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-03-02T10:55:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:14 smithi057 ceph-mon[92072]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-03-02T10:55:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:14 smithi057 ceph-mon[92072]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-03-02T10:55:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:14 smithi057 ceph-mon[92072]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-03-02T10:55:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:14 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2100297118' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-03-02T10:55:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:14 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] up:active 2023-03-02T10:55:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:14 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2100297118' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-03-02T10:55:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:14 smithi122 ceph-mon[125440]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-03-02T10:55:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:14 smithi122 ceph-mon[125440]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-03-02T10:55:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:14 smithi122 ceph-mon[125440]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-03-02T10:55:14.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:14 smithi122 ceph-mon[125440]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-03-02T10:55:14.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:14.965+0000 7fbad87ff700 1 -- 172.21.15.57:0/1696331929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fbad019e1d0 con 0x7fbad00fe990 2023-03-02T10:55:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:14 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2100297118' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-03-02T10:55:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:14 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] up:active 2023-03-02T10:55:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:14 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2100297118' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-03-02T10:55:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:14 smithi136 ceph-mon[125702]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-03-02T10:55:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:14 smithi136 ceph-mon[125702]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-03-02T10:55:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:14 smithi136 ceph-mon[125702]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-03-02T10:55:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:14 smithi136 ceph-mon[125702]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-03-02T10:55:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.531+0000 7fbac77fe700 1 -- 172.21.15.57:0/1696331929 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7fbacc0953b0 con 0x7fbad00fe990 2023-03-02T10:55:15.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 -- 172.21.15.57:0/1696331929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbabc09b3a0 msgr2=0x7fbabc09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:15.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbabc09b3a0 0x7fbabc09d850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbac000ac50 tx=0x7fbac000a380 comp rx=0 tx=0).stop 2023-03-02T10:55:15.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 -- 172.21.15.57:0/1696331929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad00fe990 msgr2=0x7fbad01957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:15.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad00fe990 0x7fbad01957d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbacc005910 tx=0x7fbacc00f690 comp rx=0 tx=0).stop 2023-03-02T10:55:15.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 -- 172.21.15.57:0/1696331929 shutdown_connections 2023-03-02T10:55:15.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbabc09b3a0 0x7fbabc09d850 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:15.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbad01005d0 0x7fbad019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:15.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad00fe990 0x7fbad01957d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:15.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 --2- 172.21.15.57:0/1696331929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbad00ffc20 0x7fbad0195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:15.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 -- 172.21.15.57:0/1696331929 >> 172.21.15.57:0/1696331929 conn(0x7fbad00f9fd0 msgr2=0x7fbad00676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:15.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 -- 172.21.15.57:0/1696331929 shutdown_connections 2023-03-02T10:55:15.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.535+0000 7fbad87ff700 1 -- 172.21.15.57:0/1696331929 wait complete. 2023-03-02T10:55:15.560 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2023-03-02T10:55:15.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-03-02T10:55:15.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.723+0000 7fcbedbff700 1 -- 172.21.15.57:0/795878080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80fe990 msgr2=0x7fcbe80feda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:15.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.723+0000 7fcbedbff700 1 --2- 172.21.15.57:0/795878080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80fe990 0x7fcbe80feda0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009990 tx=0x7fcbd8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:15.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.723+0000 7fcbedbff700 1 -- 172.21.15.57:0/795878080 shutdown_connections 2023-03-02T10:55:15.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.723+0000 7fcbedbff700 1 --2- 172.21.15.57:0/795878080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe81005d0 0x7fcbe8106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:15.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.723+0000 7fcbedbff700 1 --2- 172.21.15.57:0/795878080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80fe990 0x7fcbe80feda0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:15.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.723+0000 7fcbedbff700 1 --2- 172.21.15.57:0/795878080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe80ffc20 0x7fcbe8100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:15.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.723+0000 7fcbedbff700 1 -- 172.21.15.57:0/795878080 >> 172.21.15.57:0/795878080 conn(0x7fcbe80f9fd0 msgr2=0x7fcbe80fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:15.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.723+0000 7fcbedbff700 1 -- 172.21.15.57:0/795878080 shutdown_connections 2023-03-02T10:55:15.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.724+0000 7fcbedbff700 1 -- 172.21.15.57:0/795878080 wait complete. 2023-03-02T10:55:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.724+0000 7fcbedbff700 1 Processor -- start 2023-03-02T10:55:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.724+0000 7fcbedbff700 1 -- start start 2023-03-02T10:55:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbedbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe80fe990 0x7fcbe81957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbedbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80ffc20 0x7fcbe8195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbedbff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe81005d0 0x7fcbe819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbedbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe819d370 con 0x7fcbe80ffc20 2023-03-02T10:55:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbedbff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe819d4b0 con 0x7fcbe81005d0 2023-03-02T10:55:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbedbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe819d640 con 0x7fcbe80fe990 2023-03-02T10:55:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbdeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80ffc20 0x7fcbe8195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbdeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80ffc20 0x7fcbe8195d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37696/0 (socket says 172.21.15.57:37696) 2023-03-02T10:55:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbdeffd700 1 -- 172.21.15.57:0/2718535063 learned_addr learned my addr 172.21.15.57:0/2718535063 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbe77fe700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe80fe990 0x7fcbe81957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbe7fff700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe81005d0 0x7fcbe819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbdeffd700 1 -- 172.21.15.57:0/2718535063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe80fe990 msgr2=0x7fcbe81957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbdeffd700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe80fe990 0x7fcbe81957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbdeffd700 1 -- 172.21.15.57:0/2718535063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe81005d0 msgr2=0x7fcbe819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbdeffd700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe81005d0 0x7fcbe819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbdeffd700 1 -- 172.21.15.57:0/2718535063 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd80095f0 con 0x7fcbe80ffc20 2023-03-02T10:55:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbe7fff700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe81005d0 0x7fcbe819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbdeffd700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80ffc20 0x7fcbe8195d30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000d950 tx=0x7fcbd000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.725+0000 7fcbe57fa700 1 -- 172.21.15.57:0/2718535063 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0009940 con 0x7fcbe80ffc20 2023-03-02T10:55:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.726+0000 7fcbe57fa700 1 -- 172.21.15.57:0/2718535063 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbd0010460 con 0x7fcbe80ffc20 2023-03-02T10:55:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.726+0000 7fcbedbff700 1 -- 172.21.15.57:0/2718535063 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe810a2f0 con 0x7fcbe80ffc20 2023-03-02T10:55:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.726+0000 7fcbe57fa700 1 -- 172.21.15.57:0/2718535063 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000f620 con 0x7fcbe80ffc20 2023-03-02T10:55:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.726+0000 7fcbedbff700 1 -- 172.21.15.57:0/2718535063 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe810a160 con 0x7fcbe80ffc20 2023-03-02T10:55:15.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.726+0000 7fcbedbff700 1 -- 172.21.15.57:0/2718535063 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe819dd30 con 0x7fcbe80ffc20 2023-03-02T10:55:15.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.728+0000 7fcbe57fa700 1 -- 172.21.15.57:0/2718535063 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fcbd0022070 con 0x7fcbe80ffc20 2023-03-02T10:55:15.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.729+0000 7fcbe57fa700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcbd409b3a0 0x7fcbd409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:15.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.729+0000 7fcbe57fa700 1 -- 172.21.15.57:0/2718535063 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcbd00c4be0 con 0x7fcbe80ffc20 2023-03-02T10:55:15.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.729+0000 7fcbe77fe700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcbd409b3a0 0x7fcbd409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:15.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.729+0000 7fcbe77fe700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcbd409b3a0 0x7fcbd409d850 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800b2e0 tx=0x7fcbd8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:15.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.731+0000 7fcbe57fa700 1 -- 172.21.15.57:0/2718535063 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fcbd00905b0 con 0x7fcbe80ffc20 2023-03-02T10:55:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1696331929' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-03-02T10:55:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-mon[92072]: pgmap v267: 97 pgs: 23 creating+peering, 74 active+clean; 580 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 9 op/s 2023-03-02T10:55:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] up:active 2023-03-02T10:55:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1696331929' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-03-02T10:55:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-mon[92072]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-03-02T10:55:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-mon[92072]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-03-02T10:55:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-mon[92072]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-03-02T10:55:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-mon[92072]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-03-02T10:55:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:15 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1696331929' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-03-02T10:55:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:15 smithi122 ceph-mon[125440]: pgmap v267: 97 pgs: 23 creating+peering, 74 active+clean; 580 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 9 op/s 2023-03-02T10:55:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:15 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] up:active 2023-03-02T10:55:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:15 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1696331929' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-03-02T10:55:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:15 smithi122 ceph-mon[125440]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-03-02T10:55:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:15 smithi122 ceph-mon[125440]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-03-02T10:55:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:15 smithi122 ceph-mon[125440]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-03-02T10:55:15.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:15 smithi122 ceph-mon[125440]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-03-02T10:55:15.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:15.963+0000 7fcbedbff700 1 -- 172.21.15.57:0/2718535063 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbe8067db0 con 0x7fcbd409b3a0 2023-03-02T10:55:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:15 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1696331929' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-03-02T10:55:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:15 smithi136 ceph-mon[125702]: pgmap v267: 97 pgs: 23 creating+peering, 74 active+clean; 580 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 9 op/s 2023-03-02T10:55:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:15 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] up:active 2023-03-02T10:55:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:15 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1696331929' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-03-02T10:55:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:15 smithi136 ceph-mon[125702]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-03-02T10:55:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:15 smithi136 ceph-mon[125702]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-03-02T10:55:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:15 smithi136 ceph-mon[125702]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-03-02T10:55:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:15 smithi136 ceph-mon[125702]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-03-02T10:55:16.432 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:55:15.968+0000 7f98173c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:55:16.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:55:15.969+0000 7f98173c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:55:16.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:55:15.969+0000 7f98173c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:55:16.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:55:15.969+0000 7f98173c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:55:16.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:55:15 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:55:15.969+0000 7f98173c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:55:16.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.579+0000 7fcbe57fa700 1 -- 172.21.15.57:0/2718535063 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcbe8067db0 con 0x7fcbd409b3a0 2023-03-02T10:55:16.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 -- 172.21.15.57:0/2718535063 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcbd409b3a0 msgr2=0x7fcbd409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:16.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcbd409b3a0 0x7fcbd409d850 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800b2e0 tx=0x7fcbd8005fb0 comp rx=0 tx=0).stop 2023-03-02T10:55:16.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 -- 172.21.15.57:0/2718535063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80ffc20 msgr2=0x7fcbe8195d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:16.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80ffc20 0x7fcbe8195d30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000d950 tx=0x7fcbd000dc60 comp rx=0 tx=0).stop 2023-03-02T10:55:16.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 -- 172.21.15.57:0/2718535063 shutdown_connections 2023-03-02T10:55:16.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcbd409b3a0 0x7fcbd409d850 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:16.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe81005d0 0x7fcbe819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:16.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe80fe990 0x7fcbe81957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:16.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 --2- 172.21.15.57:0/2718535063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80ffc20 0x7fcbe8195d30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:16.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 -- 172.21.15.57:0/2718535063 >> 172.21.15.57:0/2718535063 conn(0x7fcbe80f9fd0 msgr2=0x7fcbe80676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:16.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 -- 172.21.15.57:0/2718535063 shutdown_connections 2023-03-02T10:55:16.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.582+0000 7fcbedbff700 1 -- 172.21.15.57:0/2718535063 wait complete. 2023-03-02T10:55:16.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-03-02T10:55:16.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.766+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/1906626821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cf4102b60 msgr2=0x7f0cf4104fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:16.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.766+0000 7f0cfb1ff700 1 --2- 172.21.15.57:0/1906626821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cf4102b60 0x7f0cf4104fe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009990 tx=0x7f0ce8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:16.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.766+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/1906626821 shutdown_connections 2023-03-02T10:55:16.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.766+0000 7f0cfb1ff700 1 --2- 172.21.15.57:0/1906626821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cf4105670 0x7f0cf4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:16.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.766+0000 7f0cfb1ff700 1 --2- 172.21.15.57:0/1906626821 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cf40683c0 0x7f0cf4102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:16.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.766+0000 7f0cfb1ff700 1 --2- 172.21.15.57:0/1906626821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cf4102b60 0x7f0cf4104fe0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:16.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.766+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/1906626821 >> 172.21.15.57:0/1906626821 conn(0x7f0cf40f9fd0 msgr2=0x7f0cf40fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:16.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.766+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/1906626821 shutdown_connections 2023-03-02T10:55:16.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.766+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/1906626821 wait complete. 2023-03-02T10:55:16.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.767+0000 7f0cfb1ff700 1 Processor -- start 2023-03-02T10:55:16.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.767+0000 7f0cfb1ff700 1 -- start start 2023-03-02T10:55:16.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.767+0000 7f0cfb1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cf40683c0 0x7f0cf4197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:16.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.767+0000 7f0cfb1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cf4102b60 0x7f0cf4197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:16.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.767+0000 7f0cfb1ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cf4105670 0x7f0cf419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cfb1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf419f5a0 con 0x7f0cf40683c0 2023-03-02T10:55:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cfb1ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf419f6e0 con 0x7f0cf4105670 2023-03-02T10:55:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cfb1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf419f870 con 0x7f0cf4102b60 2023-03-02T10:55:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf8f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cf40683c0 0x7f0cf4197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf8f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cf40683c0 0x7f0cf4197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47874/0 (socket says 172.21.15.57:47874) 2023-03-02T10:55:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf8f9b700 1 -- 172.21.15.57:0/210796329 learned_addr learned my addr 172.21.15.57:0/210796329 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf3fff700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cf4102b60 0x7f0cf4197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf979c700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cf4105670 0x7f0cf419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf8f9b700 1 -- 172.21.15.57:0/210796329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cf4102b60 msgr2=0x7f0cf4197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf8f9b700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cf4102b60 0x7f0cf4197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf8f9b700 1 -- 172.21.15.57:0/210796329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cf4105670 msgr2=0x7f0cf419efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf8f9b700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cf4105670 0x7f0cf419efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf8f9b700 1 -- 172.21.15.57:0/210796329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce80095f0 con 0x7f0cf40683c0 2023-03-02T10:55:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf3fff700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cf4102b60 0x7f0cf4197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:16.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf979c700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cf4105670 0x7f0cf419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:55:16.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf8f9b700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cf40683c0 0x7f0cf4197a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400d980 tx=0x7f0ce400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:16.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf1ffb700 1 -- 172.21.15.57:0/210796329 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4009b40 con 0x7f0cf40683c0 2023-03-02T10:55:16.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf1ffb700 1 -- 172.21.15.57:0/210796329 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ce400de60 con 0x7f0cf40683c0 2023-03-02T10:55:16.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/210796329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf410b460 con 0x7f0cf40683c0 2023-03-02T10:55:16.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cf1ffb700 1 -- 172.21.15.57:0/210796329 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce400f620 con 0x7f0cf40683c0 2023-03-02T10:55:16.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.768+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/210796329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf410b2d0 con 0x7f0cf40683c0 2023-03-02T10:55:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.769+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/210796329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf4067280 con 0x7f0cf40683c0 2023-03-02T10:55:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.771+0000 7f0cf1ffb700 1 -- 172.21.15.57:0/210796329 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f0ce4022070 con 0x7f0cf40683c0 2023-03-02T10:55:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.772+0000 7f0cf1ffb700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cdc09b3a0 0x7f0cdc09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.772+0000 7f0cf1ffb700 1 -- 172.21.15.57:0/210796329 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0ce40c4950 con 0x7f0cf40683c0 2023-03-02T10:55:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.772+0000 7f0cf3fff700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cdc09b3a0 0x7f0cdc09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.772+0000 7f0cf3fff700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cdc09b3a0 0x7f0cdc09d850 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800b5c0 tx=0x7f0ce8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:16.775+0000 7f0cf1ffb700 1 -- 172.21.15.57:0/210796329 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f0ce4090320 con 0x7f0cf40683c0 2023-03-02T10:55:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:16 smithi057 ceph-mon[92072]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:16 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] up:active 2023-03-02T10:55:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:16 smithi057 ceph-mon[92072]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-03-02T10:55:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:16 smithi057 ceph-mon[92072]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-03-02T10:55:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:16 smithi057 ceph-mon[92072]: Cluster is now healthy 2023-03-02T10:55:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:16 smithi057 ceph-mon[92072]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-03-02T10:55:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:16 smithi057 ceph-mon[92072]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-03-02T10:55:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:16 smithi057 ceph-mon[92072]: daemon mds.e is now active in filesystem cephfs as rank 4 2023-03-02T10:55:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:16 smithi122 ceph-mon[125440]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:16 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] up:active 2023-03-02T10:55:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:16 smithi122 ceph-mon[125440]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-03-02T10:55:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:16 smithi122 ceph-mon[125440]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-03-02T10:55:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:16 smithi122 ceph-mon[125440]: Cluster is now healthy 2023-03-02T10:55:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:16 smithi122 ceph-mon[125440]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-03-02T10:55:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:16 smithi122 ceph-mon[125440]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-03-02T10:55:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:16 smithi122 ceph-mon[125440]: daemon mds.e is now active in filesystem cephfs as rank 4 2023-03-02T10:55:17.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.009+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/210796329 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cf4107390 con 0x7f0cdc09b3a0 2023-03-02T10:55:17.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.013+0000 7f0cf1ffb700 1 -- 172.21.15.57:0/210796329 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f0cf4107390 con 0x7f0cdc09b3a0 2023-03-02T10:55:17.016 INFO:teuthology.orchestra.run.smithi057.stdout:/volumes/_nogroup/sv_0/422b29d1-52e6-4aa4-b379-0f6fce3611d7 2023-03-02T10:55:17.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/210796329 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cdc09b3a0 msgr2=0x7f0cdc09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cdc09b3a0 0x7f0cdc09d850 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800b5c0 tx=0x7f0ce8005fd0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/210796329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cf40683c0 msgr2=0x7f0cf4197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cf40683c0 0x7f0cf4197a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400d980 tx=0x7f0ce400dd40 comp rx=0 tx=0).stop 2023-03-02T10:55:17.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/210796329 shutdown_connections 2023-03-02T10:55:17.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cdc09b3a0 0x7f0cdc09d850 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cf4105670 0x7f0cf419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cf40683c0 0x7f0cf4197a20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 --2- 172.21.15.57:0/210796329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cf4102b60 0x7f0cf4197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/210796329 >> 172.21.15.57:0/210796329 conn(0x7f0cf40f9fd0 msgr2=0x7f0cf40fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:17.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/210796329 shutdown_connections 2023-03-02T10:55:17.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.015+0000 7f0cfb1ff700 1 -- 172.21.15.57:0/210796329 wait complete. 2023-03-02T10:55:17.032 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-03-02T10:55:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:16 smithi136 ceph-mon[125702]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:16 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] up:active 2023-03-02T10:55:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:16 smithi136 ceph-mon[125702]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-03-02T10:55:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:16 smithi136 ceph-mon[125702]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-03-02T10:55:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:16 smithi136 ceph-mon[125702]: Cluster is now healthy 2023-03-02T10:55:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:16 smithi136 ceph-mon[125702]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-03-02T10:55:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:16 smithi136 ceph-mon[125702]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-03-02T10:55:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:16 smithi136 ceph-mon[125702]: daemon mds.e is now active in filesystem cephfs as rank 4 2023-03-02T10:55:17.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.189+0000 7f265b1ff700 1 -- 172.21.15.57:0/3988233925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2654101700 msgr2=0x7f2654107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.189+0000 7f265b1ff700 1 --2- 172.21.15.57:0/3988233925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2654101700 0x7f2654107fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f264c00b0a0 tx=0x7f264c00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.189+0000 7f265b1ff700 1 -- 172.21.15.57:0/3988233925 shutdown_connections 2023-03-02T10:55:17.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.189+0000 7f265b1ff700 1 --2- 172.21.15.57:0/3988233925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2654101700 0x7f2654107fa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.189+0000 7f265b1ff700 1 --2- 172.21.15.57:0/3988233925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f26540ffac0 0x7f26540ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.189+0000 7f265b1ff700 1 --2- 172.21.15.57:0/3988233925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2654100d50 0x7f26541011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.189+0000 7f265b1ff700 1 -- 172.21.15.57:0/3988233925 >> 172.21.15.57:0/3988233925 conn(0x7f26540fb100 msgr2=0x7f26540fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:17.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.189+0000 7f265b1ff700 1 -- 172.21.15.57:0/3988233925 shutdown_connections 2023-03-02T10:55:17.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.189+0000 7f265b1ff700 1 -- 172.21.15.57:0/3988233925 wait complete. 2023-03-02T10:55:17.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.189+0000 7f265b1ff700 1 Processor -- start 2023-03-02T10:55:17.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f265b1ff700 1 -- start start 2023-03-02T10:55:17.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f265b1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26540ffac0 0x7f2654195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:17.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f265b1ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2654100d50 0x7f2654195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:17.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f265b1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2654101700 0x7f265419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:17.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f265b1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265419d3d0 con 0x7f26540ffac0 2023-03-02T10:55:17.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f265b1ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265419d510 con 0x7f2654100d50 2023-03-02T10:55:17.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f265b1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265419d6a0 con 0x7f2654101700 2023-03-02T10:55:17.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f2658f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26540ffac0 0x7f2654195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:17.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f2658f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26540ffac0 0x7f2654195850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47880/0 (socket says 172.21.15.57:47880) 2023-03-02T10:55:17.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f2658f9b700 1 -- 172.21.15.57:0/3483156245 learned_addr learned my addr 172.21.15.57:0/3483156245 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:17.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f2653fff700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2654100d50 0x7f2654195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:17.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f265979c700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2654101700 0x7f265419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:17.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f2658f9b700 1 -- 172.21.15.57:0/3483156245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2654101700 msgr2=0x7f265419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f2658f9b700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2654101700 0x7f265419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f2658f9b700 1 -- 172.21.15.57:0/3483156245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2654100d50 msgr2=0x7f2654195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f2658f9b700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2654100d50 0x7f2654195d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f2658f9b700 1 -- 172.21.15.57:0/3483156245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c009d00 con 0x7f26540ffac0 2023-03-02T10:55:17.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f2653fff700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2654100d50 0x7f2654195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:55:17.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.190+0000 7f2658f9b700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26540ffac0 0x7f2654195850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f264800d950 tx=0x7f264800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:17.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.191+0000 7f2651ffb700 1 -- 172.21.15.57:0/3483156245 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2648009b40 con 0x7f26540ffac0 2023-03-02T10:55:17.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.191+0000 7f265b1ff700 1 -- 172.21.15.57:0/3483156245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265410b420 con 0x7f26540ffac0 2023-03-02T10:55:17.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.191+0000 7f2651ffb700 1 -- 172.21.15.57:0/3483156245 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2648009ca0 con 0x7f26540ffac0 2023-03-02T10:55:17.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.191+0000 7f2651ffb700 1 -- 172.21.15.57:0/3483156245 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264800f620 con 0x7f26540ffac0 2023-03-02T10:55:17.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.191+0000 7f265b1ff700 1 -- 172.21.15.57:0/3483156245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265410b290 con 0x7f26540ffac0 2023-03-02T10:55:17.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.192+0000 7f265b1ff700 1 -- 172.21.15.57:0/3483156245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26541069c0 con 0x7f26540ffac0 2023-03-02T10:55:17.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.193+0000 7f2651ffb700 1 -- 172.21.15.57:0/3483156245 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f2648018030 con 0x7f26540ffac0 2023-03-02T10:55:17.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.194+0000 7f2651ffb700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f264409b3a0 0x7f264409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:17.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.194+0000 7f2651ffb700 1 -- 172.21.15.57:0/3483156245 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f26480c5160 con 0x7f26540ffac0 2023-03-02T10:55:17.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.194+0000 7f2653fff700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f264409b3a0 0x7f264409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:17.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.195+0000 7f2653fff700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f264409b3a0 0x7f264409d850 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2640005fd0 tx=0x7f2640005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:17.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.198+0000 7f2651ffb700 1 -- 172.21.15.57:0/3483156245 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f2648090b30 con 0x7f26540ffac0 2023-03-02T10:55:17.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.427+0000 7f265b1ff700 1 -- 172.21.15.57:0/3483156245 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f2654061540 con 0x7f264409b3a0 2023-03-02T10:55:17.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.450+0000 7f2651ffb700 1 -- 172.21.15.57:0/3483156245 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2654061540 con 0x7f264409b3a0 2023-03-02T10:55:17.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 -- 172.21.15.57:0/3483156245 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f264409b3a0 msgr2=0x7f264409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f264409b3a0 0x7f264409d850 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2640005fd0 tx=0x7f2640005e20 comp rx=0 tx=0).stop 2023-03-02T10:55:17.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 -- 172.21.15.57:0/3483156245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26540ffac0 msgr2=0x7f2654195850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26540ffac0 0x7f2654195850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f264800d950 tx=0x7f264800dd10 comp rx=0 tx=0).stop 2023-03-02T10:55:17.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 -- 172.21.15.57:0/3483156245 shutdown_connections 2023-03-02T10:55:17.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f264409b3a0 0x7f264409d850 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2654101700 0x7f265419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26540ffac0 0x7f2654195850 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 --2- 172.21.15.57:0/3483156245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2654100d50 0x7f2654195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 -- 172.21.15.57:0/3483156245 >> 172.21.15.57:0/3483156245 conn(0x7f26540fb100 msgr2=0x7f26540fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:17.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 -- 172.21.15.57:0/3483156245 shutdown_connections 2023-03-02T10:55:17.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.453+0000 7f265b1ff700 1 -- 172.21.15.57:0/3483156245 wait complete. 2023-03-02T10:55:17.470 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-03-02T10:55:17.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.629+0000 7f43b05ff700 1 -- 172.21.15.57:0/3759410483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43a8074570 msgr2=0x7f43a80729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.629+0000 7f43b05ff700 1 --2- 172.21.15.57:0/3759410483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43a8074570 0x7f43a80729c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009990 tx=0x7f43a4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.629+0000 7f43b05ff700 1 -- 172.21.15.57:0/3759410483 shutdown_connections 2023-03-02T10:55:17.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.629+0000 7f43b05ff700 1 --2- 172.21.15.57:0/3759410483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43a8107940 0x7f43a8109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.629+0000 7f43b05ff700 1 --2- 172.21.15.57:0/3759410483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43a8074570 0x7f43a80729c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.629+0000 7f43b05ff700 1 --2- 172.21.15.57:0/3759410483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a8072f90 0x7f43a8073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.629+0000 7f43b05ff700 1 -- 172.21.15.57:0/3759410483 >> 172.21.15.57:0/3759410483 conn(0x7f43a80fb0f0 msgr2=0x7f43a80fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:17.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.629+0000 7f43b05ff700 1 -- 172.21.15.57:0/3759410483 shutdown_connections 2023-03-02T10:55:17.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.629+0000 7f43b05ff700 1 -- 172.21.15.57:0/3759410483 wait complete. 2023-03-02T10:55:17.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43b05ff700 1 Processor -- start 2023-03-02T10:55:17.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43b05ff700 1 -- start start 2023-03-02T10:55:17.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43b05ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43a8072f90 0x7f43a81979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:17.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43b05ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43a8074570 0x7f43a8197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:17.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43b05ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a8107940 0x7f43a819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:17.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43b05ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a819f560 con 0x7f43a8074570 2023-03-02T10:55:17.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43b05ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a819f6a0 con 0x7f43a8072f90 2023-03-02T10:55:17.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43b05ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a819f830 con 0x7f43a8107940 2023-03-02T10:55:17.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43adb9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43a8074570 0x7f43a8197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:17.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43adb9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43a8074570 0x7f43a8197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47888/0 (socket says 172.21.15.57:47888) 2023-03-02T10:55:17.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43adb9a700 1 -- 172.21.15.57:0/4206795787 learned_addr learned my addr 172.21.15.57:0/4206795787 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:17.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.630+0000 7f43ae39b700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43a8072f90 0x7f43a81979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:17.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f43aeb9c700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a8107940 0x7f43a819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:17.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f43adb9a700 1 -- 172.21.15.57:0/4206795787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a8107940 msgr2=0x7f43a819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f43adb9a700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a8107940 0x7f43a819ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f43adb9a700 1 -- 172.21.15.57:0/4206795787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43a8072f90 msgr2=0x7f43a81979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f43adb9a700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43a8072f90 0x7f43a81979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f43adb9a700 1 -- 172.21.15.57:0/4206795787 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a40095f0 con 0x7f43a8074570 2023-03-02T10:55:17.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f43adb9a700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43a8074570 0x7f43a8197f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f439800d950 tx=0x7f439800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:17.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f439f7fe700 1 -- 172.21.15.57:0/4206795787 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439800f890 con 0x7f43a8074570 2023-03-02T10:55:17.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f439f7fe700 1 -- 172.21.15.57:0/4206795787 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4398010460 con 0x7f43a8074570 2023-03-02T10:55:17.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f43b05ff700 1 -- 172.21.15.57:0/4206795787 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a810d5f0 con 0x7f43a8074570 2023-03-02T10:55:17.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f439f7fe700 1 -- 172.21.15.57:0/4206795787 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439800e610 con 0x7f43a8074570 2023-03-02T10:55:17.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.631+0000 7f43b05ff700 1 -- 172.21.15.57:0/4206795787 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a810d460 con 0x7f43a8074570 2023-03-02T10:55:17.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.632+0000 7f43b05ff700 1 -- 172.21.15.57:0/4206795787 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a8106080 con 0x7f43a8074570 2023-03-02T10:55:17.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.634+0000 7f439f7fe700 1 -- 172.21.15.57:0/4206795787 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f4398022070 con 0x7f43a8074570 2023-03-02T10:55:17.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.634+0000 7f439f7fe700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f439409b3a0 0x7f439409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:17.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.635+0000 7f439f7fe700 1 -- 172.21.15.57:0/4206795787 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f43980c4ac0 con 0x7f43a8074570 2023-03-02T10:55:17.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.635+0000 7f43ae39b700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f439409b3a0 0x7f439409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:17.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.635+0000 7f43ae39b700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f439409b3a0 0x7f439409d850 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f43a400b5c0 tx=0x7f43a4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:17.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.638+0000 7f439f7fe700 1 -- 172.21.15.57:0/4206795787 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f4398090580 con 0x7f43a8074570 2023-03-02T10:55:17.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.655+0000 7f439f7fe700 1 -- 172.21.15.57:0/4206795787 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f4398018030 con 0x7f43a8074570 2023-03-02T10:55:17.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.877+0000 7f43b05ff700 1 -- 172.21.15.57:0/4206795787 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f43a80614b0 con 0x7f439409b3a0 2023-03-02T10:55:17.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.880+0000 7f439f7fe700 1 -- 172.21.15.57:0/4206795787 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f43a80614b0 con 0x7f439409b3a0 2023-03-02T10:55:17.882 INFO:teuthology.orchestra.run.smithi057.stdout:/volumes/_nogroup/sv_1/d0d9fb7b-a0b0-4a2e-aa06-576c9b7d593e 2023-03-02T10:55:17.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.882+0000 7f43b05ff700 1 -- 172.21.15.57:0/4206795787 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f439409b3a0 msgr2=0x7f439409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.882+0000 7f43b05ff700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f439409b3a0 0x7f439409d850 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f43a400b5c0 tx=0x7f43a4005fd0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.882+0000 7f43b05ff700 1 -- 172.21.15.57:0/4206795787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43a8074570 msgr2=0x7f43a8197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:17.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.882+0000 7f43b05ff700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43a8074570 0x7f43a8197f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f439800d950 tx=0x7f439800dc60 comp rx=0 tx=0).stop 2023-03-02T10:55:17.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.882+0000 7f43b05ff700 1 -- 172.21.15.57:0/4206795787 shutdown_connections 2023-03-02T10:55:17.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.882+0000 7f43b05ff700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f439409b3a0 0x7f439409d850 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.882+0000 7f43b05ff700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43a8107940 0x7f43a819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.883+0000 7f43b05ff700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43a8072f90 0x7f43a81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.883+0000 7f43b05ff700 1 --2- 172.21.15.57:0/4206795787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43a8074570 0x7f43a8197f20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:17.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.883+0000 7f43b05ff700 1 -- 172.21.15.57:0/4206795787 >> 172.21.15.57:0/4206795787 conn(0x7f43a80fb0f0 msgr2=0x7f43a80fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:17.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.883+0000 7f43b05ff700 1 -- 172.21.15.57:0/4206795787 shutdown_connections 2023-03-02T10:55:17.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:17.883+0000 7f43b05ff700 1 -- 172.21.15.57:0/4206795787 wait complete. 2023-03-02T10:55:17.898 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:17 smithi057 ceph-mon[92072]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:17.899 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:17 smithi057 ceph-mon[92072]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 12 op/s 2023-03-02T10:55:17.899 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:17 smithi057 ceph-mon[92072]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:17.899 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:17 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] up:active 2023-03-02T10:55:17.899 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:17 smithi057 ceph-mon[92072]: fsmap cephfs:5 7 up:standby 5 up:active 2023-03-02T10:55:17.899 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:17 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:55:17.900 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:55:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:17 smithi122 ceph-mon[125440]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:17 smithi122 ceph-mon[125440]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 12 op/s 2023-03-02T10:55:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:17 smithi122 ceph-mon[125440]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:17 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] up:active 2023-03-02T10:55:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:17 smithi122 ceph-mon[125440]: fsmap cephfs:5 7 up:standby 5 up:active 2023-03-02T10:55:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:17 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:55:18.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.052+0000 7fef7bdff700 1 -- 172.21.15.57:0/2990259801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef741005d0 msgr2=0x7fef74106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.052+0000 7fef7bdff700 1 --2- 172.21.15.57:0/2990259801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef741005d0 0x7fef74106e70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009990 tx=0x7fef6c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.052+0000 7fef7bdff700 1 -- 172.21.15.57:0/2990259801 shutdown_connections 2023-03-02T10:55:18.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.052+0000 7fef7bdff700 1 --2- 172.21.15.57:0/2990259801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef741005d0 0x7fef74106e70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.052+0000 7fef7bdff700 1 --2- 172.21.15.57:0/2990259801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef740fe990 0x7fef740feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.052+0000 7fef7bdff700 1 --2- 172.21.15.57:0/2990259801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef740ffc20 0x7fef74100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.052+0000 7fef7bdff700 1 -- 172.21.15.57:0/2990259801 >> 172.21.15.57:0/2990259801 conn(0x7fef740f9fd0 msgr2=0x7fef740fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:18.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.053+0000 7fef7bdff700 1 -- 172.21.15.57:0/2990259801 shutdown_connections 2023-03-02T10:55:18.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.053+0000 7fef7bdff700 1 -- 172.21.15.57:0/2990259801 wait complete. 2023-03-02T10:55:18.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.053+0000 7fef7bdff700 1 Processor -- start 2023-03-02T10:55:18.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.053+0000 7fef7bdff700 1 -- start start 2023-03-02T10:55:18.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7bdff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef740fe990 0x7fef741979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7bdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef740ffc20 0x7fef74197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7bdff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef741005d0 0x7fef7419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7bdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7419f550 con 0x7fef740ffc20 2023-03-02T10:55:18.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7bdff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7419f690 con 0x7fef741005d0 2023-03-02T10:55:18.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7bdff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7419f820 con 0x7fef740fe990 2023-03-02T10:55:18.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7939a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef740ffc20 0x7fef74197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7939a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef740ffc20 0x7fef74197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47912/0 (socket says 172.21.15.57:47912) 2023-03-02T10:55:18.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7939a700 1 -- 172.21.15.57:0/272364214 learned_addr learned my addr 172.21.15.57:0/272364214 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:18.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7a39c700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef741005d0 0x7fef7419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef79b9b700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef740fe990 0x7fef741979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7939a700 1 -- 172.21.15.57:0/272364214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef740fe990 msgr2=0x7fef741979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7939a700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef740fe990 0x7fef741979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7939a700 1 -- 172.21.15.57:0/272364214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef741005d0 msgr2=0x7fef7419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7939a700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef741005d0 0x7fef7419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7939a700 1 -- 172.21.15.57:0/272364214 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0095f0 con 0x7fef740ffc20 2023-03-02T10:55:18.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7939a700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef740ffc20 0x7fef74197f10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef6400d980 tx=0x7fef6400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:18.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef6affd700 1 -- 172.21.15.57:0/272364214 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64004220 con 0x7fef740ffc20 2023-03-02T10:55:18.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef7bdff700 1 -- 172.21.15.57:0/272364214 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7410a340 con 0x7fef740ffc20 2023-03-02T10:55:18.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef6affd700 1 -- 172.21.15.57:0/272364214 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef64007640 con 0x7fef740ffc20 2023-03-02T10:55:18.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.054+0000 7fef6affd700 1 -- 172.21.15.57:0/272364214 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64005610 con 0x7fef740ffc20 2023-03-02T10:55:18.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.055+0000 7fef7bdff700 1 -- 172.21.15.57:0/272364214 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7410a1b0 con 0x7fef740ffc20 2023-03-02T10:55:18.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.055+0000 7fef7bdff700 1 -- 172.21.15.57:0/272364214 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7419ff60 con 0x7fef740ffc20 2023-03-02T10:55:18.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.057+0000 7fef6affd700 1 -- 172.21.15.57:0/272364214 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fef64021070 con 0x7fef740ffc20 2023-03-02T10:55:18.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.058+0000 7fef6affd700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fef6009b3e0 0x7fef6009d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.058+0000 7fef6affd700 1 -- 172.21.15.57:0/272364214 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fef640c50d0 con 0x7fef740ffc20 2023-03-02T10:55:18.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.058+0000 7fef79b9b700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fef6009b3e0 0x7fef6009d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.058+0000 7fef79b9b700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fef6009b3e0 0x7fef6009d890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef70009380 tx=0x7fef7000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:18.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.061+0000 7fef6affd700 1 -- 172.21.15.57:0/272364214 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fef64090a60 con 0x7fef740ffc20 2023-03-02T10:55:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:17 smithi136 ceph-mon[125702]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:17 smithi136 ceph-mon[125702]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 12 op/s 2023-03-02T10:55:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:17 smithi136 ceph-mon[125702]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:17 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] up:active 2023-03-02T10:55:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:17 smithi136 ceph-mon[125702]: fsmap cephfs:5 7 up:standby 5 up:active 2023-03-02T10:55:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:17 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:55:18.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.309+0000 7fef7bdff700 1 -- 172.21.15.57:0/272364214 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef741a0510 con 0x7fef740ffc20 2023-03-02T10:55:18.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.310+0000 7fef6affd700 1 -- 172.21.15.57:0/272364214 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10828 (secure 0 0 0) 0x7fef64016070 con 0x7fef740ffc20 2023-03-02T10:55:18.312 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:18.312 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-02T10:55:10.601054+0000","modified":"2023-03-02T10:55:17.554509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24520,"mds_2":24505,"mds_3":24493,"mds_4":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14634":{"gid":14634,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6841/3731858530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6840","nonce":3731858530},{"type":"v1","addr":"172.21.15.57:6841","nonce":3731858530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"e","rank":4,"incarnation":24,"state":"up:active","state_seq":9,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24505":{"gid":24505,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/316639764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":316639764},{"type":"v1","addr":"172.21.15.122:6839","nonce":316639764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-02T10:55:18.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 -- 172.21.15.57:0/272364214 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fef6009b3e0 msgr2=0x7fef6009d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fef6009b3e0 0x7fef6009d890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef70009380 tx=0x7fef7000b040 comp rx=0 tx=0).stop 2023-03-02T10:55:18.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 -- 172.21.15.57:0/272364214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef740ffc20 msgr2=0x7fef74197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef740ffc20 0x7fef74197f10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef6400d980 tx=0x7fef6400dc90 comp rx=0 tx=0).stop 2023-03-02T10:55:18.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 -- 172.21.15.57:0/272364214 shutdown_connections 2023-03-02T10:55:18.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fef6009b3e0 0x7fef6009d890 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef741005d0 0x7fef7419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef740fe990 0x7fef741979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 --2- 172.21.15.57:0/272364214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef740ffc20 0x7fef74197f10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 -- 172.21.15.57:0/272364214 >> 172.21.15.57:0/272364214 conn(0x7fef740f9fd0 msgr2=0x7fef740676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:18.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 -- 172.21.15.57:0/272364214 shutdown_connections 2023-03-02T10:55:18.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.312+0000 7fef7bdff700 1 -- 172.21.15.57:0/272364214 wait complete. 2023-03-02T10:55:18.316 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-03-02T10:55:18.329 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:55:18.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.482+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/4042281180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e68102ed0 msgr2=0x7f3e681052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.482+0000 7f3e6e1ff700 1 --2- 172.21.15.57:0/4042281180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e68102ed0 0x7f3e681052b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009990 tx=0x7f3e50009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.482+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/4042281180 shutdown_connections 2023-03-02T10:55:18.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.482+0000 7f3e6e1ff700 1 --2- 172.21.15.57:0/4042281180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e681057f0 0x7f3e68107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.482+0000 7f3e6e1ff700 1 --2- 172.21.15.57:0/4042281180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e681005b0 0x7f3e68102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.482+0000 7f3e6e1ff700 1 --2- 172.21.15.57:0/4042281180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e68102ed0 0x7f3e681052b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.482+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/4042281180 >> 172.21.15.57:0/4042281180 conn(0x7f3e680f9fd0 msgr2=0x7f3e680fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:18.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.482+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/4042281180 shutdown_connections 2023-03-02T10:55:18.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.482+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/4042281180 wait complete. 2023-03-02T10:55:18.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.482+0000 7f3e6e1ff700 1 Processor -- start 2023-03-02T10:55:18.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e6e1ff700 1 -- start start 2023-03-02T10:55:18.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e6e1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e681005b0 0x7f3e68195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e6e1ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e68102ed0 0x7f3e68195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e6e1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e681057f0 0x7f3e6819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e6e1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6819d3f0 con 0x7f3e681057f0 2023-03-02T10:55:18.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e6e1ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6819d530 con 0x7f3e68102ed0 2023-03-02T10:55:18.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e6e1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6819d6c0 con 0x7f3e681005b0 2023-03-02T10:55:18.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e67fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e681057f0 0x7f3e6819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e5effd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e68102ed0 0x7f3e68195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e67fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e681057f0 0x7f3e6819ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47930/0 (socket says 172.21.15.57:47930) 2023-03-02T10:55:18.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e67fff700 1 -- 172.21.15.57:0/2994446512 learned_addr learned my addr 172.21.15.57:0/2994446512 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:18.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e677fe700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e681005b0 0x7f3e68195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e67fff700 1 -- 172.21.15.57:0/2994446512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e681005b0 msgr2=0x7f3e68195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e67fff700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e681005b0 0x7f3e68195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e67fff700 1 -- 172.21.15.57:0/2994446512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e68102ed0 msgr2=0x7f3e68195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e67fff700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e68102ed0 0x7f3e68195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e67fff700 1 -- 172.21.15.57:0/2994446512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e500095f0 con 0x7f3e681057f0 2023-03-02T10:55:18.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.483+0000 7f3e677fe700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e681005b0 0x7f3e68195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:18.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.484+0000 7f3e67fff700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e681057f0 0x7f3e6819ce20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000e970 tx=0x7f3e6000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:18.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.484+0000 7f3e657fa700 1 -- 172.21.15.57:0/2994446512 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60004a30 con 0x7f3e681057f0 2023-03-02T10:55:18.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.484+0000 7f3e657fa700 1 -- 172.21.15.57:0/2994446512 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e600054e0 con 0x7f3e681057f0 2023-03-02T10:55:18.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.484+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/2994446512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6810b470 con 0x7f3e681057f0 2023-03-02T10:55:18.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.484+0000 7f3e657fa700 1 -- 172.21.15.57:0/2994446512 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000cd30 con 0x7f3e681057f0 2023-03-02T10:55:18.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.484+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/2994446512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6810b2e0 con 0x7f3e681057f0 2023-03-02T10:55:18.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.485+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/2994446512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e680fbb40 con 0x7f3e681057f0 2023-03-02T10:55:18.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.486+0000 7f3e657fa700 1 -- 172.21.15.57:0/2994446512 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f3e6001e020 con 0x7f3e681057f0 2023-03-02T10:55:18.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.487+0000 7f3e657fa700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3e5409b3e0 0x7f3e5409d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.488+0000 7f3e657fa700 1 -- 172.21.15.57:0/2994446512 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3e60014070 con 0x7f3e681057f0 2023-03-02T10:55:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.488+0000 7f3e677fe700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3e5409b3e0 0x7f3e5409d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.488+0000 7f3e677fe700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3e5409b3e0 0x7f3e5409d890 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e68068140 tx=0x7f3e58009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:18.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.491+0000 7f3e657fa700 1 -- 172.21.15.57:0/2994446512 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f3e60090d20 con 0x7f3e681057f0 2023-03-02T10:55:18.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.695+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/2994446512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e6802cd50 con 0x7f3e681057f0 2023-03-02T10:55:18.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.697+0000 7f3e657fa700 1 -- 172.21.15.57:0/2994446512 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22122 (secure 0 0 0) 0x7f3e60094340 con 0x7f3e681057f0 2023-03-02T10:55:18.699 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:18.699 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":84,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:11.603333+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:55:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/2994446512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3e5409b3e0 msgr2=0x7f3e5409d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3e5409b3e0 0x7f3e5409d890 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e68068140 tx=0x7f3e58009040 comp rx=0 tx=0).stop 2023-03-02T10:55:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/2994446512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e681057f0 msgr2=0x7f3e6819ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e681057f0 0x7f3e6819ce20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000e970 tx=0x7f3e6000ec80 comp rx=0 tx=0).stop 2023-03-02T10:55:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/2994446512 shutdown_connections 2023-03-02T10:55:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3e5409b3e0 0x7f3e5409d890 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e681057f0 0x7f3e6819ce20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e681005b0 0x7f3e68195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 --2- 172.21.15.57:0/2994446512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e68102ed0 0x7f3e68195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/2994446512 >> 172.21.15.57:0/2994446512 conn(0x7f3e680f9fd0 msgr2=0x7f3e68101270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/2994446512 shutdown_connections 2023-03-02T10:55:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.699+0000 7f3e6e1ff700 1 -- 172.21.15.57:0/2994446512 wait complete. 2023-03-02T10:55:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-02T10:55:18.717 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-02T10:55:18.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.870+0000 7f8fe17ff700 1 -- 172.21.15.57:0/3371296978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc102ed0 msgr2=0x7f8fdc1052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.870+0000 7f8fe17ff700 1 --2- 172.21.15.57:0/3371296978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc102ed0 0x7f8fdc1052b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009990 tx=0x7f8fd0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.870+0000 7f8fe17ff700 1 -- 172.21.15.57:0/3371296978 shutdown_connections 2023-03-02T10:55:18.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.870+0000 7f8fe17ff700 1 --2- 172.21.15.57:0/3371296978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc1057f0 0x7f8fdc107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.870+0000 7f8fe17ff700 1 --2- 172.21.15.57:0/3371296978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fdc1005b0 0x7f8fdc102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.870+0000 7f8fe17ff700 1 --2- 172.21.15.57:0/3371296978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc102ed0 0x7f8fdc1052b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.870+0000 7f8fe17ff700 1 -- 172.21.15.57:0/3371296978 >> 172.21.15.57:0/3371296978 conn(0x7f8fdc0f9fd0 msgr2=0x7f8fdc0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:18.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.870+0000 7f8fe17ff700 1 -- 172.21.15.57:0/3371296978 shutdown_connections 2023-03-02T10:55:18.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.870+0000 7f8fe17ff700 1 -- 172.21.15.57:0/3371296978 wait complete. 2023-03-02T10:55:18.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fe17ff700 1 Processor -- start 2023-03-02T10:55:18.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fe17ff700 1 -- start start 2023-03-02T10:55:18.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fe17ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc1005b0 0x7f8fdc195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fe17ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fdc102ed0 0x7f8fdc195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fe17ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc1057f0 0x7f8fdc19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fe17ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc19d3e0 con 0x7f8fdc1005b0 2023-03-02T10:55:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fe17ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc19d520 con 0x7f8fdc102ed0 2023-03-02T10:55:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fe17ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc19d6b0 con 0x7f8fdc1057f0 2023-03-02T10:55:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fdaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc1005b0 0x7f8fdc195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fdaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc1005b0 0x7f8fdc195860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47950/0 (socket says 172.21.15.57:47950) 2023-03-02T10:55:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fdaffd700 1 -- 172.21.15.57:0/4172028184 learned_addr learned my addr 172.21.15.57:0/4172028184 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fdb7fe700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc1057f0 0x7f8fdc19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fda7fc700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fdc102ed0 0x7f8fdc195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fdaffd700 1 -- 172.21.15.57:0/4172028184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc1057f0 msgr2=0x7f8fdc19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fdaffd700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc1057f0 0x7f8fdc19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fdaffd700 1 -- 172.21.15.57:0/4172028184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fdc102ed0 msgr2=0x7f8fdc195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fdaffd700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fdc102ed0 0x7f8fdc195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.871+0000 7f8fdaffd700 1 -- 172.21.15.57:0/4172028184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00095f0 con 0x7f8fdc1005b0 2023-03-02T10:55:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.872+0000 7f8fdaffd700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc1005b0 0x7f8fdc195860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00d980 tx=0x7f8fcc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.872+0000 7f8fc3fff700 1 -- 172.21.15.57:0/4172028184 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc009b40 con 0x7f8fdc1005b0 2023-03-02T10:55:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.872+0000 7f8fe17ff700 1 -- 172.21.15.57:0/4172028184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc10b470 con 0x7f8fdc1005b0 2023-03-02T10:55:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.872+0000 7f8fc3fff700 1 -- 172.21.15.57:0/4172028184 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fcc00de60 con 0x7f8fdc1005b0 2023-03-02T10:55:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.872+0000 7f8fc3fff700 1 -- 172.21.15.57:0/4172028184 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00f620 con 0x7f8fdc1005b0 2023-03-02T10:55:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.872+0000 7f8fe17ff700 1 -- 172.21.15.57:0/4172028184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc10b2e0 con 0x7f8fdc1005b0 2023-03-02T10:55:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.873+0000 7f8fe17ff700 1 -- 172.21.15.57:0/4172028184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc0fbb40 con 0x7f8fdc1005b0 2023-03-02T10:55:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.874+0000 7f8fc3fff700 1 -- 172.21.15.57:0/4172028184 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f8fcc022070 con 0x7f8fdc1005b0 2023-03-02T10:55:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.875+0000 7f8fc3fff700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8fc409b3e0 0x7f8fc409d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.875+0000 7f8fc3fff700 1 -- 172.21.15.57:0/4172028184 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8fcc0c49f0 con 0x7f8fdc1005b0 2023-03-02T10:55:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.875+0000 7f8fda7fc700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8fc409b3e0 0x7f8fc409d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:18.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.876+0000 7f8fda7fc700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8fc409b3e0 0x7f8fc409d890 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000b2e0 tx=0x7f8fd0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:18.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:18.880+0000 7f8fc3fff700 1 -- 172.21.15.57:0/4172028184 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f8fcc090380 con 0x7f8fdc1005b0 2023-03-02T10:55:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:18 smithi057 ceph-mon[92072]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-03-02T10:55:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:18 smithi057 ceph-mon[92072]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:18 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/272364214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:18 smithi122 ceph-mon[125440]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-03-02T10:55:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:18 smithi122 ceph-mon[125440]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:18 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/272364214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:19.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.076+0000 7f8fe17ff700 1 -- 172.21.15.57:0/4172028184 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fdc0614f0 con 0x7f8fc409b3e0 2023-03-02T10:55:19.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.088+0000 7f8fc3fff700 1 -- 172.21.15.57:0/4172028184 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335018 (secure 0 0 0) 0x7f8fdc0614f0 con 0x7f8fc409b3e0 2023-03-02T10:55:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:18 smithi136 ceph-mon[125702]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-03-02T10:55:19.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:18 smithi136 ceph-mon[125702]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:55:19.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:18 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/272364214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:55:19.095 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:19.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 -- 172.21.15.57:0/4172028184 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8fc409b3e0 msgr2=0x7f8fc409d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:19.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8fc409b3e0 0x7f8fc409d890 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000b2e0 tx=0x7f8fd0005fb0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 -- 172.21.15.57:0/4172028184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc1005b0 msgr2=0x7f8fdc195860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:19.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc1005b0 0x7f8fdc195860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00d980 tx=0x7f8fcc00dd40 comp rx=0 tx=0).stop 2023-03-02T10:55:19.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 -- 172.21.15.57:0/4172028184 shutdown_connections 2023-03-02T10:55:19.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8fc409b3e0 0x7f8fc409d890 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc1057f0 0x7f8fdc19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc1005b0 0x7f8fdc195860 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 --2- 172.21.15.57:0/4172028184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fdc102ed0 0x7f8fdc195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 -- 172.21.15.57:0/4172028184 >> 172.21.15.57:0/4172028184 conn(0x7f8fdc0f9fd0 msgr2=0x7f8fdc1011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:19.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 -- 172.21.15.57:0/4172028184 shutdown_connections 2023-03-02T10:55:19.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.092+0000 7f8fe17ff700 1 -- 172.21.15.57:0/4172028184 wait complete. 2023-03-02T10:55:19.098 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-03-02T10:55:19.110 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2023-03-02T10:55:17.257874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594114,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":270,"num_write_kb":2957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":77824,"kb_used_data":10784,"kb_used_omap":0,"kb_used_meta":66944,"kb_avail":1124864000,"statfs":{"total":1151940427776,"available":1151860736000,"internally_reserved":0,"allocated":11042816,"data_stored":6929261,"data_compressed":110277,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":68550656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3746,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.122247"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.631062+0000","last_change":"2023-03-02T10:55:10.630366+0000","last_active":"2023-03-02T10:55:10.631062+0000","last_peered":"2023-03-02T10:55:10.631062+0000","last_clean":"2023-03-02T10:55:10.631062+0000","last_became_active":"2023-03-02T10:55:10.630035+0000","last_became_peered":"2023-03-02T10:55:10.630035+0000","last_unstale":"2023-03-02T10:55:10.631062+0000","last_undegraded":"2023-03-02T10:55:10.631062+0000","last_fullsized":"2023-03-02T10:55:10.631062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:00:41.832233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774242+0000","last_change":"2023-03-02T10:55:10.628111+0000","last_active":"2023-03-02T10:55:11.774242+0000","last_peered":"2023-03-02T10:55:11.774242+0000","last_clean":"2023-03-02T10:55:11.774242+0000","last_became_active":"2023-03-02T10:55:10.626879+0000","last_became_peered":"2023-03-02T10:55:10.626879+0000","last_unstale":"2023-03-02T10:55:11.774242+0000","last_undegraded":"2023-03-02T10:55:11.774242+0000","last_fullsized":"2023-03-02T10:55:11.774242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:08:52.120684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774254+0000","last_change":"2023-03-02T10:55:10.624392+0000","last_active":"2023-03-02T10:55:11.774254+0000","last_peered":"2023-03-02T10:55:11.774254+0000","last_clean":"2023-03-02T10:55:11.774254+0000","last_became_active":"2023-03-02T10:55:10.624095+0000","last_became_peered":"2023-03-02T10:55:10.624095+0000","last_unstale":"2023-03-02T10:55:11.774254+0000","last_undegraded":"2023-03-02T10:55:11.774254+0000","last_fullsized":"2023-03-02T10:55:11.774254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:30:55.174383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774418+0000","last_change":"2023-03-02T10:55:10.619950+0000","last_active":"2023-03-02T10:55:11.774418+0000","last_peered":"2023-03-02T10:55:11.774418+0000","last_clean":"2023-03-02T10:55:11.774418+0000","last_became_active":"2023-03-02T10:55:10.619543+0000","last_became_peered":"2023-03-02T10:55:10.619543+0000","last_unstale":"2023-03-02T10:55:11.774418+0000","last_undegraded":"2023-03-02T10:55:11.774418+0000","last_fullsized":"2023-03-02T10:55:11.774418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:08:02.321422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.773931+0000","last_change":"2023-03-02T10:55:10.626403+0000","last_active":"2023-03-02T10:55:11.773931+0000","last_peered":"2023-03-02T10:55:11.773931+0000","last_clean":"2023-03-02T10:55:11.773931+0000","last_became_active":"2023-03-02T10:55:10.626062+0000","last_became_peered":"2023-03-02T10:55:10.626062+0000","last_unstale":"2023-03-02T10:55:11.773931+0000","last_undegraded":"2023-03-02T10:55:11.773931+0000","last_fullsized":"2023-03-02T10:55:11.773931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:35:06.798468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.612009+0000","last_change":"2023-03-02T10:55:10.623903+0000","last_active":"2023-03-02T10:55:11.612009+0000","last_peered":"2023-03-02T10:55:11.612009+0000","last_clean":"2023-03-02T10:55:11.612009+0000","last_became_active":"2023-03-02T10:55:10.623422+0000","last_became_peered":"2023-03-02T10:55:10.623422+0000","last_unstale":"2023-03-02T10:55:11.612009+0000","last_undegraded":"2023-03-02T10:55:11.612009+0000","last_fullsized":"2023-03-02T10:55:11.612009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:21.066552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633763+0000","last_change":"2023-03-02T10:55:10.633210+0000","last_active":"2023-03-02T10:55:10.633763+0000","last_peered":"2023-03-02T10:55:10.633763+0000","last_clean":"2023-03-02T10:55:10.633763+0000","last_became_active":"2023-03-02T10:55:10.632898+0000","last_became_peered":"2023-03-02T10:55:10.632898+0000","last_unstale":"2023-03-02T10:55:10.633763+0000","last_undegraded":"2023-03-02T10:55:10.633763+0000","last_fullsized":"2023-03-02T10:55:10.633763+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:04.043328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.637289+0000","last_change":"2023-03-02T10:55:10.634427+0000","last_active":"2023-03-02T10:55:10.637289+0000","last_peered":"2023-03-02T10:55:10.637289+0000","last_clean":"2023-03-02T10:55:10.637289+0000","last_became_active":"2023-03-02T10:55:10.634159+0000","last_became_peered":"2023-03-02T10:55:10.634159+0000","last_unstale":"2023-03-02T10:55:10.637289+0000","last_undegraded":"2023-03-02T10:55:10.637289+0000","last_fullsized":"2023-03-02T10:55:10.637289+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:59:09.344860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551554+0000","last_change":"2023-03-02T10:55:10.622775+0000","last_active":"2023-03-02T10:55:11.551554+0000","last_peered":"2023-03-02T10:55:11.551554+0000","last_clean":"2023-03-02T10:55:11.551554+0000","last_became_active":"2023-03-02T10:55:10.616254+0000","last_became_peered":"2023-03-02T10:55:10.616254+0000","last_unstale":"2023-03-02T10:55:11.551554+0000","last_undegraded":"2023-03-02T10:55:11.551554+0000","last_fullsized":"2023-03-02T10:55:11.551554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:01:56.832512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.612324+0000","last_change":"2023-03-02T10:55:10.620311+0000","last_active":"2023-03-02T10:55:11.612324+0000","last_peered":"2023-03-02T10:55:11.612324+0000","last_clean":"2023-03-02T10:55:11.612324+0000","last_became_active":"2023-03-02T10:55:10.620028+0000","last_became_peered":"2023-03-02T10:55:10.620028+0000","last_unstale":"2023-03-02T10:55:11.612324+0000","last_undegraded":"2023-03-02T10:55:11.612324+0000","last_fullsized":"2023-03-02T10:55:11.612324+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:16:13.770927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.622826+0000","last_change":"2023-03-02T10:55:10.621316+0000","last_active":"2023-03-02T10:55:10.622826+0000","last_peered":"2023-03-02T10:55:10.622826+0000","last_clean":"2023-03-02T10:55:10.622826+0000","last_became_active":"2023-03-02T10:55:10.620803+0000","last_became_peered":"2023-03-02T10:55:10.620803+0000","last_unstale":"2023-03-02T10:55:10.622826+0000","last_undegraded":"2023-03-02T10:55:10.622826+0000","last_fullsized":"2023-03-02T10:55:10.622826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:20:18.434138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774427+0000","last_change":"2023-03-02T10:55:10.625305+0000","last_active":"2023-03-02T10:55:11.774427+0000","last_peered":"2023-03-02T10:55:11.774427+0000","last_clean":"2023-03-02T10:55:11.774427+0000","last_became_active":"2023-03-02T10:55:10.625025+0000","last_became_peered":"2023-03-02T10:55:10.625025+0000","last_unstale":"2023-03-02T10:55:11.774427+0000","last_undegraded":"2023-03-02T10:55:11.774427+0000","last_fullsized":"2023-03-02T10:55:11.774427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:35:40.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774980+0000","last_change":"2023-03-02T10:55:10.626408+0000","last_active":"2023-03-02T10:55:11.774980+0000","last_peered":"2023-03-02T10:55:11.774980+0000","last_clean":"2023-03-02T10:55:11.774980+0000","last_became_active":"2023-03-02T10:55:10.625510+0000","last_became_peered":"2023-03-02T10:55:10.625510+0000","last_unstale":"2023-03-02T10:55:11.774980+0000","last_undegraded":"2023-03-02T10:55:11.774980+0000","last_fullsized":"2023-03-02T10:55:11.774980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:59:10.622871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.773951+0000","last_change":"2023-03-02T10:55:10.629323+0000","last_active":"2023-03-02T10:55:11.773951+0000","last_peered":"2023-03-02T10:55:11.773951+0000","last_clean":"2023-03-02T10:55:11.773951+0000","last_became_active":"2023-03-02T10:55:10.627038+0000","last_became_peered":"2023-03-02T10:55:10.627038+0000","last_unstale":"2023-03-02T10:55:11.773951+0000","last_undegraded":"2023-03-02T10:55:11.773951+0000","last_fullsized":"2023-03-02T10:55:11.773951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:57:21.241810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.773533+0000","last_change":"2023-03-02T10:55:10.624312+0000","last_active":"2023-03-02T10:55:11.773533+0000","last_peered":"2023-03-02T10:55:11.773533+0000","last_clean":"2023-03-02T10:55:11.773533+0000","last_became_active":"2023-03-02T10:55:10.623997+0000","last_became_peered":"2023-03-02T10:55:10.623997+0000","last_unstale":"2023-03-02T10:55:11.773533+0000","last_undegraded":"2023-03-02T10:55:11.773533+0000","last_fullsized":"2023-03-02T10:55:11.773533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:09:43.683852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551466+0000","last_change":"2023-03-02T10:55:10.622473+0000","last_active":"2023-03-02T10:55:11.551466+0000","last_peered":"2023-03-02T10:55:11.551466+0000","last_clean":"2023-03-02T10:55:11.551466+0000","last_became_active":"2023-03-02T10:55:10.622148+0000","last_became_peered":"2023-03-02T10:55:10.622148+0000","last_unstale":"2023-03-02T10:55:11.551466+0000","last_undegraded":"2023-03-02T10:55:11.551466+0000","last_fullsized":"2023-03-02T10:55:11.551466+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:54:52.132792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.631077+0000","last_change":"2023-03-02T10:55:10.630380+0000","last_active":"2023-03-02T10:55:10.631077+0000","last_peered":"2023-03-02T10:55:10.631077+0000","last_clean":"2023-03-02T10:55:10.631077+0000","last_became_active":"2023-03-02T10:55:10.630088+0000","last_became_peered":"2023-03-02T10:55:10.630088+0000","last_unstale":"2023-03-02T10:55:10.631077+0000","last_undegraded":"2023-03-02T10:55:10.631077+0000","last_fullsized":"2023-03-02T10:55:10.631077+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:08:58.983902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.246724+0000","last_change":"2023-03-02T10:55:10.620547+0000","last_active":"2023-03-02T10:55:11.246724+0000","last_peered":"2023-03-02T10:55:11.246724+0000","last_clean":"2023-03-02T10:55:11.246724+0000","last_became_active":"2023-03-02T10:55:10.620225+0000","last_became_peered":"2023-03-02T10:55:10.620225+0000","last_unstale":"2023-03-02T10:55:11.246724+0000","last_undegraded":"2023-03-02T10:55:11.246724+0000","last_fullsized":"2023-03-02T10:55:11.246724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:47:38.669432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774401+0000","last_change":"2023-03-02T10:55:10.625108+0000","last_active":"2023-03-02T10:55:11.774401+0000","last_peered":"2023-03-02T10:55:11.774401+0000","last_clean":"2023-03-02T10:55:11.774401+0000","last_became_active":"2023-03-02T10:55:10.624797+0000","last_became_peered":"2023-03-02T10:55:10.624797+0000","last_unstale":"2023-03-02T10:55:11.774401+0000","last_undegraded":"2023-03-02T10:55:11.774401+0000","last_fullsized":"2023-03-02T10:55:11.774401+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:06:57.777889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'11","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:15.546822+0000","last_change":"2023-03-02T10:55:10.146541+0000","last_active":"2023-03-02T10:55:15.546822+0000","last_peered":"2023-03-02T10:55:15.546822+0000","last_clean":"2023-03-02T10:55:15.546822+0000","last_became_active":"2023-03-02T10:55:10.146239+0000","last_became_peered":"2023-03-02T10:55:10.146239+0000","last_unstale":"2023-03-02T10:55:15.546822+0000","last_undegraded":"2023-03-02T10:55:15.546822+0000","last_fullsized":"2023-03-02T10:55:15.546822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:56:07.036002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.622514+0000","last_change":"2023-03-02T10:55:10.619811+0000","last_active":"2023-03-02T10:55:10.622514+0000","last_peered":"2023-03-02T10:55:10.622514+0000","last_clean":"2023-03-02T10:55:10.622514+0000","last_became_active":"2023-03-02T10:55:10.617190+0000","last_became_peered":"2023-03-02T10:55:10.617190+0000","last_unstale":"2023-03-02T10:55:10.622514+0000","last_undegraded":"2023-03-02T10:55:10.622514+0000","last_fullsized":"2023-03-02T10:55:10.622514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:20:52.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774166+0000","last_change":"2023-03-02T10:55:10.155970+0000","last_active":"2023-03-02T10:55:11.774166+0000","last_peered":"2023-03-02T10:55:11.774166+0000","last_clean":"2023-03-02T10:55:11.774166+0000","last_became_active":"2023-03-02T10:55:10.155667+0000","last_became_peered":"2023-03-02T10:55:10.155667+0000","last_unstale":"2023-03-02T10:55:11.774166+0000","last_undegraded":"2023-03-02T10:55:11.774166+0000","last_fullsized":"2023-03-02T10:55:11.774166+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:46:36.366891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774414+0000","last_change":"2023-03-02T10:55:10.623738+0000","last_active":"2023-03-02T10:55:11.774414+0000","last_peered":"2023-03-02T10:55:11.774414+0000","last_clean":"2023-03-02T10:55:11.774414+0000","last_became_active":"2023-03-02T10:55:10.620543+0000","last_became_peered":"2023-03-02T10:55:10.620543+0000","last_unstale":"2023-03-02T10:55:11.774414+0000","last_undegraded":"2023-03-02T10:55:11.774414+0000","last_fullsized":"2023-03-02T10:55:11.774414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:44:46.238712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774401+0000","last_change":"2023-03-02T10:55:10.151476+0000","last_active":"2023-03-02T10:55:11.774401+0000","last_peered":"2023-03-02T10:55:11.774401+0000","last_clean":"2023-03-02T10:55:11.774401+0000","last_became_active":"2023-03-02T10:55:10.151140+0000","last_became_peered":"2023-03-02T10:55:10.151140+0000","last_unstale":"2023-03-02T10:55:11.774401+0000","last_undegraded":"2023-03-02T10:55:11.774401+0000","last_fullsized":"2023-03-02T10:55:11.774401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:37:56.513433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551520+0000","last_change":"2023-03-02T10:55:10.627844+0000","last_active":"2023-03-02T10:55:11.551520+0000","last_peered":"2023-03-02T10:55:11.551520+0000","last_clean":"2023-03-02T10:55:11.551520+0000","last_became_active":"2023-03-02T10:55:10.626972+0000","last_became_peered":"2023-03-02T10:55:10.626972+0000","last_unstale":"2023-03-02T10:55:11.551520+0000","last_undegraded":"2023-03-02T10:55:11.551520+0000","last_fullsized":"2023-03-02T10:55:11.551520+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:36:58.650285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774326+0000","last_change":"2023-03-02T10:55:10.153277+0000","last_active":"2023-03-02T10:55:11.774326+0000","last_peered":"2023-03-02T10:55:11.774326+0000","last_clean":"2023-03-02T10:55:11.774326+0000","last_became_active":"2023-03-02T10:55:10.152983+0000","last_became_peered":"2023-03-02T10:55:10.152983+0000","last_unstale":"2023-03-02T10:55:11.774326+0000","last_undegraded":"2023-03-02T10:55:11.774326+0000","last_fullsized":"2023-03-02T10:55:11.774326+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:15.045107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.615586+0000","last_change":"2023-03-02T10:55:10.630295+0000","last_active":"2023-03-02T10:55:11.615586+0000","last_peered":"2023-03-02T10:55:11.615586+0000","last_clean":"2023-03-02T10:55:11.615586+0000","last_became_active":"2023-03-02T10:55:10.629004+0000","last_became_peered":"2023-03-02T10:55:10.629004+0000","last_unstale":"2023-03-02T10:55:11.615586+0000","last_undegraded":"2023-03-02T10:55:11.615586+0000","last_fullsized":"2023-03-02T10:55:11.615586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:05:51.414347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.526808+0000","last_change":"2023-03-02T10:55:10.153222+0000","last_active":"2023-03-02T10:55:13.526808+0000","last_peered":"2023-03-02T10:55:13.526808+0000","last_clean":"2023-03-02T10:55:13.526808+0000","last_became_active":"2023-03-02T10:55:10.152928+0000","last_became_peered":"2023-03-02T10:55:10.152928+0000","last_unstale":"2023-03-02T10:55:13.526808+0000","last_undegraded":"2023-03-02T10:55:13.526808+0000","last_fullsized":"2023-03-02T10:55:13.526808+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:12:56.648713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774742+0000","last_change":"2023-03-02T10:55:10.617722+0000","last_active":"2023-03-02T10:55:11.774742+0000","last_peered":"2023-03-02T10:55:11.774742+0000","last_clean":"2023-03-02T10:55:11.774742+0000","last_became_active":"2023-03-02T10:55:10.617425+0000","last_became_peered":"2023-03-02T10:55:10.617425+0000","last_unstale":"2023-03-02T10:55:11.774742+0000","last_undegraded":"2023-03-02T10:55:11.774742+0000","last_fullsized":"2023-03-02T10:55:11.774742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:57:37.397568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.611943+0000","last_change":"2023-03-02T10:55:10.154877+0000","last_active":"2023-03-02T10:55:11.611943+0000","last_peered":"2023-03-02T10:55:11.611943+0000","last_clean":"2023-03-02T10:55:11.611943+0000","last_became_active":"2023-03-02T10:55:10.154562+0000","last_became_peered":"2023-03-02T10:55:10.154562+0000","last_unstale":"2023-03-02T10:55:11.611943+0000","last_undegraded":"2023-03-02T10:55:11.611943+0000","last_fullsized":"2023-03-02T10:55:11.611943+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:36:03.044346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.615450+0000","last_change":"2023-03-02T10:55:10.628418+0000","last_active":"2023-03-02T10:55:11.615450+0000","last_peered":"2023-03-02T10:55:11.615450+0000","last_clean":"2023-03-02T10:55:11.615450+0000","last_became_active":"2023-03-02T10:55:10.627715+0000","last_became_peered":"2023-03-02T10:55:10.627715+0000","last_unstale":"2023-03-02T10:55:11.615450+0000","last_undegraded":"2023-03-02T10:55:11.615450+0000","last_fullsized":"2023-03-02T10:55:11.615450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:16:59.756440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774936+0000","last_change":"2023-03-02T10:55:10.158875+0000","last_active":"2023-03-02T10:55:11.774936+0000","last_peered":"2023-03-02T10:55:11.774936+0000","last_clean":"2023-03-02T10:55:11.774936+0000","last_became_active":"2023-03-02T10:55:10.157653+0000","last_became_peered":"2023-03-02T10:55:10.157653+0000","last_unstale":"2023-03-02T10:55:11.774936+0000","last_undegraded":"2023-03-02T10:55:11.774936+0000","last_fullsized":"2023-03-02T10:55:11.774936+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:50:03.808602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.637269+0000","last_change":"2023-03-02T10:55:10.634280+0000","last_active":"2023-03-02T10:55:10.637269+0000","last_peered":"2023-03-02T10:55:10.637269+0000","last_clean":"2023-03-02T10:55:10.637269+0000","last_became_active":"2023-03-02T10:55:10.633764+0000","last_became_peered":"2023-03-02T10:55:10.633764+0000","last_unstale":"2023-03-02T10:55:10.637269+0000","last_undegraded":"2023-03-02T10:55:10.637269+0000","last_fullsized":"2023-03-02T10:55:10.637269+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:17:25.110036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.521916+0000","last_change":"2023-03-02T10:55:10.154532+0000","last_active":"2023-03-02T10:55:13.521916+0000","last_peered":"2023-03-02T10:55:13.521916+0000","last_clean":"2023-03-02T10:55:13.521916+0000","last_became_active":"2023-03-02T10:55:10.152116+0000","last_became_peered":"2023-03-02T10:55:10.152116+0000","last_unstale":"2023-03-02T10:55:13.521916+0000","last_undegraded":"2023-03-02T10:55:13.521916+0000","last_fullsized":"2023-03-02T10:55:13.521916+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:19:50.439666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.246648+0000","last_change":"2023-03-02T10:55:10.628790+0000","last_active":"2023-03-02T10:55:11.246648+0000","last_peered":"2023-03-02T10:55:11.246648+0000","last_clean":"2023-03-02T10:55:11.246648+0000","last_became_active":"2023-03-02T10:55:10.628452+0000","last_became_peered":"2023-03-02T10:55:10.628452+0000","last_unstale":"2023-03-02T10:55:11.246648+0000","last_undegraded":"2023-03-02T10:55:11.246648+0000","last_fullsized":"2023-03-02T10:55:11.246648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:08:30.061925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.523143+0000","last_change":"2023-03-02T10:55:10.152684+0000","last_active":"2023-03-02T10:55:13.523143+0000","last_peered":"2023-03-02T10:55:13.523143+0000","last_clean":"2023-03-02T10:55:13.523143+0000","last_became_active":"2023-03-02T10:55:10.152184+0000","last_became_peered":"2023-03-02T10:55:10.152184+0000","last_unstale":"2023-03-02T10:55:13.523143+0000","last_undegraded":"2023-03-02T10:55:13.523143+0000","last_fullsized":"2023-03-02T10:55:13.523143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:39:21.100760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551540+0000","last_change":"2023-03-02T10:55:10.625990+0000","last_active":"2023-03-02T10:55:11.551540+0000","last_peered":"2023-03-02T10:55:11.551540+0000","last_clean":"2023-03-02T10:55:11.551540+0000","last_became_active":"2023-03-02T10:55:10.625677+0000","last_became_peered":"2023-03-02T10:55:10.625677+0000","last_unstale":"2023-03-02T10:55:11.551540+0000","last_undegraded":"2023-03-02T10:55:11.551540+0000","last_fullsized":"2023-03-02T10:55:11.551540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:08.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.525379+0000","last_change":"2023-03-02T10:55:10.151541+0000","last_active":"2023-03-02T10:55:13.525379+0000","last_peered":"2023-03-02T10:55:13.525379+0000","last_clean":"2023-03-02T10:55:13.525379+0000","last_became_active":"2023-03-02T10:55:10.151262+0000","last_became_peered":"2023-03-02T10:55:10.151262+0000","last_unstale":"2023-03-02T10:55:13.525379+0000","last_undegraded":"2023-03-02T10:55:13.525379+0000","last_fullsized":"2023-03-02T10:55:13.525379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:00:49.821191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774411+0000","last_change":"2023-03-02T10:55:10.629541+0000","last_active":"2023-03-02T10:55:11.774411+0000","last_peered":"2023-03-02T10:55:11.774411+0000","last_clean":"2023-03-02T10:55:11.774411+0000","last_became_active":"2023-03-02T10:55:10.627473+0000","last_became_peered":"2023-03-02T10:55:10.627473+0000","last_unstale":"2023-03-02T10:55:11.774411+0000","last_undegraded":"2023-03-02T10:55:11.774411+0000","last_fullsized":"2023-03-02T10:55:11.774411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:22:52.995113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.523331+0000","last_change":"2023-03-02T10:55:10.152615+0000","last_active":"2023-03-02T10:55:13.523331+0000","last_peered":"2023-03-02T10:55:13.523331+0000","last_clean":"2023-03-02T10:55:13.523331+0000","last_became_active":"2023-03-02T10:55:10.152304+0000","last_became_peered":"2023-03-02T10:55:10.152304+0000","last_unstale":"2023-03-02T10:55:13.523331+0000","last_undegraded":"2023-03-02T10:55:13.523331+0000","last_fullsized":"2023-03-02T10:55:13.523331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:43:00.934520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551529+0000","last_change":"2023-03-02T10:55:10.627653+0000","last_active":"2023-03-02T10:55:11.551529+0000","last_peered":"2023-03-02T10:55:11.551529+0000","last_clean":"2023-03-02T10:55:11.551529+0000","last_became_active":"2023-03-02T10:55:10.626570+0000","last_became_peered":"2023-03-02T10:55:10.626570+0000","last_unstale":"2023-03-02T10:55:11.551529+0000","last_undegraded":"2023-03-02T10:55:11.551529+0000","last_fullsized":"2023-03-02T10:55:11.551529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:40:39.311514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'8","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.522434+0000","last_change":"2023-03-02T10:55:10.149121+0000","last_active":"2023-03-02T10:55:13.522434+0000","last_peered":"2023-03-02T10:55:13.522434+0000","last_clean":"2023-03-02T10:55:13.522434+0000","last_became_active":"2023-03-02T10:55:10.148800+0000","last_became_peered":"2023-03-02T10:55:10.148800+0000","last_unstale":"2023-03-02T10:55:13.522434+0000","last_undegraded":"2023-03-02T10:55:13.522434+0000","last_fullsized":"2023-03-02T10:55:13.522434+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:32:30.918248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1596,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774248+0000","last_change":"2023-03-02T10:55:10.625497+0000","last_active":"2023-03-02T10:55:11.774248+0000","last_peered":"2023-03-02T10:55:11.774248+0000","last_clean":"2023-03-02T10:55:11.774248+0000","last_became_active":"2023-03-02T10:55:10.625037+0000","last_became_peered":"2023-03-02T10:55:10.625037+0000","last_unstale":"2023-03-02T10:55:11.774248+0000","last_undegraded":"2023-03-02T10:55:11.774248+0000","last_fullsized":"2023-03-02T10:55:11.774248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:55:56.478111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774777+0000","last_change":"2023-03-02T10:55:10.148957+0000","last_active":"2023-03-02T10:55:11.774777+0000","last_peered":"2023-03-02T10:55:11.774777+0000","last_clean":"2023-03-02T10:55:11.774777+0000","last_became_active":"2023-03-02T10:55:10.148624+0000","last_became_peered":"2023-03-02T10:55:10.148624+0000","last_unstale":"2023-03-02T10:55:11.774777+0000","last_undegraded":"2023-03-02T10:55:11.774777+0000","last_fullsized":"2023-03-02T10:55:11.774777+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:53:33.062648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774872+0000","last_change":"2023-03-02T10:55:10.633311+0000","last_active":"2023-03-02T10:55:11.774872+0000","last_peered":"2023-03-02T10:55:11.774872+0000","last_clean":"2023-03-02T10:55:11.774872+0000","last_became_active":"2023-03-02T10:55:10.632174+0000","last_became_peered":"2023-03-02T10:55:10.632174+0000","last_unstale":"2023-03-02T10:55:11.774872+0000","last_undegraded":"2023-03-02T10:55:11.774872+0000","last_fullsized":"2023-03-02T10:55:11.774872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:50:47.536118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.522389+0000","last_change":"2023-03-02T10:55:10.153392+0000","last_active":"2023-03-02T10:55:13.522389+0000","last_peered":"2023-03-02T10:55:13.522389+0000","last_clean":"2023-03-02T10:55:13.522389+0000","last_became_active":"2023-03-02T10:55:10.152513+0000","last_became_peered":"2023-03-02T10:55:10.152513+0000","last_unstale":"2023-03-02T10:55:13.522389+0000","last_undegraded":"2023-03-02T10:55:13.522389+0000","last_fullsized":"2023-03-02T10:55:13.522389+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:26:40.675118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633811+0000","last_change":"2023-03-02T10:55:10.631953+0000","last_active":"2023-03-02T10:55:10.633811+0000","last_peered":"2023-03-02T10:55:10.633811+0000","last_clean":"2023-03-02T10:55:10.633811+0000","last_became_active":"2023-03-02T10:55:10.631624+0000","last_became_peered":"2023-03-02T10:55:10.631624+0000","last_unstale":"2023-03-02T10:55:10.633811+0000","last_undegraded":"2023-03-02T10:55:10.633811+0000","last_fullsized":"2023-03-02T10:55:10.633811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:15:20.136421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.773879+0000","last_change":"2023-03-02T10:55:10.150597+0000","last_active":"2023-03-02T10:55:11.773879+0000","last_peered":"2023-03-02T10:55:11.773879+0000","last_clean":"2023-03-02T10:55:11.773879+0000","last_became_active":"2023-03-02T10:55:10.150024+0000","last_became_peered":"2023-03-02T10:55:10.150024+0000","last_unstale":"2023-03-02T10:55:11.773879+0000","last_undegraded":"2023-03-02T10:55:11.773879+0000","last_fullsized":"2023-03-02T10:55:11.773879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:30.043240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633790+0000","last_change":"2023-03-02T10:55:10.633052+0000","last_active":"2023-03-02T10:55:10.633790+0000","last_peered":"2023-03-02T10:55:10.633790+0000","last_clean":"2023-03-02T10:55:10.633790+0000","last_became_active":"2023-03-02T10:55:10.632766+0000","last_became_peered":"2023-03-02T10:55:10.632766+0000","last_unstale":"2023-03-02T10:55:10.633790+0000","last_undegraded":"2023-03-02T10:55:10.633790+0000","last_fullsized":"2023-03-02T10:55:10.633790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:55.079556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.773834+0000","last_change":"2023-03-02T10:55:10.154559+0000","last_active":"2023-03-02T10:55:11.773834+0000","last_peered":"2023-03-02T10:55:11.773834+0000","last_clean":"2023-03-02T10:55:11.773834+0000","last_became_active":"2023-03-02T10:55:10.154058+0000","last_became_peered":"2023-03-02T10:55:10.154058+0000","last_unstale":"2023-03-02T10:55:11.773834+0000","last_undegraded":"2023-03-02T10:55:11.773834+0000","last_fullsized":"2023-03-02T10:55:11.773834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:23:26.823020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.615134+0000","last_change":"2023-03-02T10:55:10.622951+0000","last_active":"2023-03-02T10:55:11.615134+0000","last_peered":"2023-03-02T10:55:11.615134+0000","last_clean":"2023-03-02T10:55:11.615134+0000","last_became_active":"2023-03-02T10:55:10.622643+0000","last_became_peered":"2023-03-02T10:55:10.622643+0000","last_unstale":"2023-03-02T10:55:11.615134+0000","last_undegraded":"2023-03-02T10:55:11.615134+0000","last_fullsized":"2023-03-02T10:55:11.615134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:53:05.459021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774564+0000","last_change":"2023-03-02T10:55:10.153755+0000","last_active":"2023-03-02T10:55:11.774564+0000","last_peered":"2023-03-02T10:55:11.774564+0000","last_clean":"2023-03-02T10:55:11.774564+0000","last_became_active":"2023-03-02T10:55:10.153473+0000","last_became_peered":"2023-03-02T10:55:10.153473+0000","last_unstale":"2023-03-02T10:55:11.774564+0000","last_undegraded":"2023-03-02T10:55:11.774564+0000","last_fullsized":"2023-03-02T10:55:11.774564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:48:46.455449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633872+0000","last_change":"2023-03-02T10:55:10.633149+0000","last_active":"2023-03-02T10:55:10.633872+0000","last_peered":"2023-03-02T10:55:10.633872+0000","last_clean":"2023-03-02T10:55:10.633872+0000","last_became_active":"2023-03-02T10:55:10.632816+0000","last_became_peered":"2023-03-02T10:55:10.632816+0000","last_unstale":"2023-03-02T10:55:10.633872+0000","last_undegraded":"2023-03-02T10:55:10.633872+0000","last_fullsized":"2023-03-02T10:55:10.633872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:25:41.585257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.612224+0000","last_change":"2023-03-02T10:55:10.150486+0000","last_active":"2023-03-02T10:55:11.612224+0000","last_peered":"2023-03-02T10:55:11.612224+0000","last_clean":"2023-03-02T10:55:11.612224+0000","last_became_active":"2023-03-02T10:55:10.150186+0000","last_became_peered":"2023-03-02T10:55:10.150186+0000","last_unstale":"2023-03-02T10:55:11.612224+0000","last_undegraded":"2023-03-02T10:55:11.612224+0000","last_fullsized":"2023-03-02T10:55:11.612224+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:06:18.637162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.612243+0000","last_change":"2023-03-02T10:55:10.628622+0000","last_active":"2023-03-02T10:55:11.612243+0000","last_peered":"2023-03-02T10:55:11.612243+0000","last_clean":"2023-03-02T10:55:11.612243+0000","last_became_active":"2023-03-02T10:55:10.628258+0000","last_became_peered":"2023-03-02T10:55:10.628258+0000","last_unstale":"2023-03-02T10:55:11.612243+0000","last_undegraded":"2023-03-02T10:55:11.612243+0000","last_fullsized":"2023-03-02T10:55:11.612243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:46.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.145951+0000","last_change":"2023-03-02T10:55:10.156995+0000","last_active":"2023-03-02T10:55:13.145951+0000","last_peered":"2023-03-02T10:55:13.145951+0000","last_clean":"2023-03-02T10:55:13.145951+0000","last_became_active":"2023-03-02T10:55:10.156686+0000","last_became_peered":"2023-03-02T10:55:10.156686+0000","last_unstale":"2023-03-02T10:55:13.145951+0000","last_undegraded":"2023-03-02T10:55:13.145951+0000","last_fullsized":"2023-03-02T10:55:13.145951+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:03:08.237799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.612082+0000","last_change":"2023-03-02T10:55:10.637176+0000","last_active":"2023-03-02T10:55:11.612082+0000","last_peered":"2023-03-02T10:55:11.612082+0000","last_clean":"2023-03-02T10:55:11.612082+0000","last_became_active":"2023-03-02T10:55:10.636843+0000","last_became_peered":"2023-03-02T10:55:10.636843+0000","last_unstale":"2023-03-02T10:55:11.612082+0000","last_undegraded":"2023-03-02T10:55:11.612082+0000","last_fullsized":"2023-03-02T10:55:11.612082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:41:25.442808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.615206+0000","last_change":"2023-03-02T10:55:10.613814+0000","last_active":"2023-03-02T10:55:11.615206+0000","last_peered":"2023-03-02T10:55:11.615206+0000","last_clean":"2023-03-02T10:55:11.615206+0000","last_became_active":"2023-03-02T10:55:10.613496+0000","last_became_peered":"2023-03-02T10:55:10.613496+0000","last_unstale":"2023-03-02T10:55:11.615206+0000","last_undegraded":"2023-03-02T10:55:11.615206+0000","last_fullsized":"2023-03-02T10:55:11.615206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:55:58.332549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.524301+0000","last_change":"2023-03-02T10:55:10.160751+0000","last_active":"2023-03-02T10:55:13.524301+0000","last_peered":"2023-03-02T10:55:13.524301+0000","last_clean":"2023-03-02T10:55:13.524301+0000","last_became_active":"2023-03-02T10:55:10.160433+0000","last_became_peered":"2023-03-02T10:55:10.160433+0000","last_unstale":"2023-03-02T10:55:13.524301+0000","last_undegraded":"2023-03-02T10:55:13.524301+0000","last_fullsized":"2023-03-02T10:55:13.524301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:11:23.326464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.622540+0000","last_change":"2023-03-02T10:55:10.619761+0000","last_active":"2023-03-02T10:55:10.622540+0000","last_peered":"2023-03-02T10:55:10.622540+0000","last_clean":"2023-03-02T10:55:10.622540+0000","last_became_active":"2023-03-02T10:55:10.617361+0000","last_became_peered":"2023-03-02T10:55:10.617361+0000","last_unstale":"2023-03-02T10:55:10.622540+0000","last_undegraded":"2023-03-02T10:55:10.622540+0000","last_fullsized":"2023-03-02T10:55:10.622540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:26:55.492653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774158+0000","last_change":"2023-03-02T10:55:10.151553+0000","last_active":"2023-03-02T10:55:11.774158+0000","last_peered":"2023-03-02T10:55:11.774158+0000","last_clean":"2023-03-02T10:55:11.774158+0000","last_became_active":"2023-03-02T10:55:10.151369+0000","last_became_peered":"2023-03-02T10:55:10.151369+0000","last_unstale":"2023-03-02T10:55:11.774158+0000","last_undegraded":"2023-03-02T10:55:11.774158+0000","last_fullsized":"2023-03-02T10:55:11.774158+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:30:42.550362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":372,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.616451+0000","last_change":"2023-03-02T10:54:06.270813+0000","last_active":"2023-03-02T10:55:10.616451+0000","last_peered":"2023-03-02T10:55:10.616451+0000","last_clean":"2023-03-02T10:55:10.616451+0000","last_became_active":"2023-03-02T10:54:06.270329+0000","last_became_peered":"2023-03-02T10:54:06.270329+0000","last_unstale":"2023-03-02T10:55:10.616451+0000","last_undegraded":"2023-03-02T10:55:10.616451+0000","last_fullsized":"2023-03-02T10:55:10.616451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_clean_scrub_stamp":"2023-03-02T10:51:04.207601+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:07.546806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774662+0000","last_change":"2023-03-02T10:55:10.629032+0000","last_active":"2023-03-02T10:55:11.774662+0000","last_peered":"2023-03-02T10:55:11.774662+0000","last_clean":"2023-03-02T10:55:11.774662+0000","last_became_active":"2023-03-02T10:55:10.628696+0000","last_became_peered":"2023-03-02T10:55:10.628696+0000","last_unstale":"2023-03-02T10:55:11.774662+0000","last_undegraded":"2023-03-02T10:55:11.774662+0000","last_fullsized":"2023-03-02T10:55:11.774662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:32:58.399900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:14.538267+0000","last_change":"2023-03-02T10:55:10.153240+0000","last_active":"2023-03-02T10:55:14.538267+0000","last_peered":"2023-03-02T10:55:14.538267+0000","last_clean":"2023-03-02T10:55:14.538267+0000","last_became_active":"2023-03-02T10:55:10.152977+0000","last_became_peered":"2023-03-02T10:55:10.152977+0000","last_unstale":"2023-03-02T10:55:14.538267+0000","last_undegraded":"2023-03-02T10:55:14.538267+0000","last_fullsized":"2023-03-02T10:55:14.538267+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:46:49.873113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774305+0000","last_change":"2023-03-02T10:55:10.154392+0000","last_active":"2023-03-02T10:55:11.774305+0000","last_peered":"2023-03-02T10:55:11.774305+0000","last_clean":"2023-03-02T10:55:11.774305+0000","last_became_active":"2023-03-02T10:55:10.154110+0000","last_became_peered":"2023-03-02T10:55:10.154110+0000","last_unstale":"2023-03-02T10:55:11.774305+0000","last_undegraded":"2023-03-02T10:55:11.774305+0000","last_fullsized":"2023-03-02T10:55:11.774305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:11:05.910487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774989+0000","last_change":"2023-03-02T10:55:10.627181+0000","last_active":"2023-03-02T10:55:11.774989+0000","last_peered":"2023-03-02T10:55:11.774989+0000","last_clean":"2023-03-02T10:55:11.774989+0000","last_became_active":"2023-03-02T10:55:10.626891+0000","last_became_peered":"2023-03-02T10:55:10.626891+0000","last_unstale":"2023-03-02T10:55:11.774989+0000","last_undegraded":"2023-03-02T10:55:11.774989+0000","last_fullsized":"2023-03-02T10:55:11.774989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:37.990553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'7","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:15.546968+0000","last_change":"2023-03-02T10:55:10.146146+0000","last_active":"2023-03-02T10:55:15.546968+0000","last_peered":"2023-03-02T10:55:15.546968+0000","last_clean":"2023-03-02T10:55:15.546968+0000","last_became_active":"2023-03-02T10:55:10.145824+0000","last_became_peered":"2023-03-02T10:55:10.145824+0000","last_unstale":"2023-03-02T10:55:15.546968+0000","last_undegraded":"2023-03-02T10:55:15.546968+0000","last_fullsized":"2023-03-02T10:55:15.546968+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:05:35.846016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.638245+0000","last_change":"2023-03-02T10:55:10.636566+0000","last_active":"2023-03-02T10:55:10.638245+0000","last_peered":"2023-03-02T10:55:10.638245+0000","last_clean":"2023-03-02T10:55:10.638245+0000","last_became_active":"2023-03-02T10:55:10.636033+0000","last_became_peered":"2023-03-02T10:55:10.636033+0000","last_unstale":"2023-03-02T10:55:10.638245+0000","last_undegraded":"2023-03-02T10:55:10.638245+0000","last_fullsized":"2023-03-02T10:55:10.638245+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:35:24.955628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774334+0000","last_change":"2023-03-02T10:55:10.156550+0000","last_active":"2023-03-02T10:55:11.774334+0000","last_peered":"2023-03-02T10:55:11.774334+0000","last_clean":"2023-03-02T10:55:11.774334+0000","last_became_active":"2023-03-02T10:55:10.156286+0000","last_became_peered":"2023-03-02T10:55:10.156286+0000","last_unstale":"2023-03-02T10:55:11.774334+0000","last_undegraded":"2023-03-02T10:55:11.774334+0000","last_fullsized":"2023-03-02T10:55:11.774334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:45:51.476117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774199+0000","last_change":"2023-03-02T10:55:10.631769+0000","last_active":"2023-03-02T10:55:11.774199+0000","last_peered":"2023-03-02T10:55:11.774199+0000","last_clean":"2023-03-02T10:55:11.774199+0000","last_became_active":"2023-03-02T10:55:10.631429+0000","last_became_peered":"2023-03-02T10:55:10.631429+0000","last_unstale":"2023-03-02T10:55:11.774199+0000","last_undegraded":"2023-03-02T10:55:11.774199+0000","last_fullsized":"2023-03-02T10:55:11.774199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:42:52.764994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.524716+0000","last_change":"2023-03-02T10:55:10.152435+0000","last_active":"2023-03-02T10:55:13.524716+0000","last_peered":"2023-03-02T10:55:13.524716+0000","last_clean":"2023-03-02T10:55:13.524716+0000","last_became_active":"2023-03-02T10:55:10.152008+0000","last_became_peered":"2023-03-02T10:55:10.152008+0000","last_unstale":"2023-03-02T10:55:13.524716+0000","last_undegraded":"2023-03-02T10:55:13.524716+0000","last_fullsized":"2023-03-02T10:55:13.524716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:46:39.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774041+0000","last_change":"2023-03-02T10:55:10.624337+0000","last_active":"2023-03-02T10:55:11.774041+0000","last_peered":"2023-03-02T10:55:11.774041+0000","last_clean":"2023-03-02T10:55:11.774041+0000","last_became_active":"2023-03-02T10:55:10.623979+0000","last_became_peered":"2023-03-02T10:55:10.623979+0000","last_unstale":"2023-03-02T10:55:11.774041+0000","last_undegraded":"2023-03-02T10:55:11.774041+0000","last_fullsized":"2023-03-02T10:55:11.774041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:14:39.173460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.524831+0000","last_change":"2023-03-02T10:55:10.152406+0000","last_active":"2023-03-02T10:55:13.524831+0000","last_peered":"2023-03-02T10:55:13.524831+0000","last_clean":"2023-03-02T10:55:13.524831+0000","last_became_active":"2023-03-02T10:55:10.152026+0000","last_became_peered":"2023-03-02T10:55:10.152026+0000","last_unstale":"2023-03-02T10:55:13.524831+0000","last_undegraded":"2023-03-02T10:55:13.524831+0000","last_fullsized":"2023-03-02T10:55:13.524831+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:49:17.617792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.621038+0000","last_change":"2023-03-02T10:55:10.620061+0000","last_active":"2023-03-02T10:55:10.621038+0000","last_peered":"2023-03-02T10:55:10.621038+0000","last_clean":"2023-03-02T10:55:10.621038+0000","last_became_active":"2023-03-02T10:55:10.619753+0000","last_became_peered":"2023-03-02T10:55:10.619753+0000","last_unstale":"2023-03-02T10:55:10.621038+0000","last_undegraded":"2023-03-02T10:55:10.621038+0000","last_fullsized":"2023-03-02T10:55:10.621038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:40:02.479733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774763+0000","last_change":"2023-03-02T10:55:10.149827+0000","last_active":"2023-03-02T10:55:11.774763+0000","last_peered":"2023-03-02T10:55:11.774763+0000","last_clean":"2023-03-02T10:55:11.774763+0000","last_became_active":"2023-03-02T10:55:10.149522+0000","last_became_peered":"2023-03-02T10:55:10.149522+0000","last_unstale":"2023-03-02T10:55:11.774763+0000","last_undegraded":"2023-03-02T10:55:11.774763+0000","last_fullsized":"2023-03-02T10:55:11.774763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:23:27.072235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.622639+0000","last_change":"2023-03-02T10:55:10.618992+0000","last_active":"2023-03-02T10:55:10.622639+0000","last_peered":"2023-03-02T10:55:10.622639+0000","last_clean":"2023-03-02T10:55:10.622639+0000","last_became_active":"2023-03-02T10:55:10.618678+0000","last_became_peered":"2023-03-02T10:55:10.618678+0000","last_unstale":"2023-03-02T10:55:10.622639+0000","last_undegraded":"2023-03-02T10:55:10.622639+0000","last_fullsized":"2023-03-02T10:55:10.622639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:33:26.966579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774038+0000","last_change":"2023-03-02T10:55:10.152075+0000","last_active":"2023-03-02T10:55:11.774038+0000","last_peered":"2023-03-02T10:55:11.774038+0000","last_clean":"2023-03-02T10:55:11.774038+0000","last_became_active":"2023-03-02T10:55:10.151781+0000","last_became_peered":"2023-03-02T10:55:10.151781+0000","last_unstale":"2023-03-02T10:55:11.774038+0000","last_undegraded":"2023-03-02T10:55:11.774038+0000","last_fullsized":"2023-03-02T10:55:11.774038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:46:25.506942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.632102+0000","last_change":"2023-03-02T10:55:10.625524+0000","last_active":"2023-03-02T10:55:10.632102+0000","last_peered":"2023-03-02T10:55:10.632102+0000","last_clean":"2023-03-02T10:55:10.632102+0000","last_became_active":"2023-03-02T10:55:10.625249+0000","last_became_peered":"2023-03-02T10:55:10.625249+0000","last_unstale":"2023-03-02T10:55:10.632102+0000","last_undegraded":"2023-03-02T10:55:10.632102+0000","last_fullsized":"2023-03-02T10:55:10.632102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:03:16.230549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774912+0000","last_change":"2023-03-02T10:55:10.159691+0000","last_active":"2023-03-02T10:55:11.774912+0000","last_peered":"2023-03-02T10:55:11.774912+0000","last_clean":"2023-03-02T10:55:11.774912+0000","last_became_active":"2023-03-02T10:55:10.159360+0000","last_became_peered":"2023-03-02T10:55:10.159360+0000","last_unstale":"2023-03-02T10:55:11.774912+0000","last_undegraded":"2023-03-02T10:55:11.774912+0000","last_fullsized":"2023-03-02T10:55:11.774912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:21:05.305932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.622737+0000","last_change":"2023-03-02T10:55:10.621119+0000","last_active":"2023-03-02T10:55:10.622737+0000","last_peered":"2023-03-02T10:55:10.622737+0000","last_clean":"2023-03-02T10:55:10.622737+0000","last_became_active":"2023-03-02T10:55:10.620370+0000","last_became_peered":"2023-03-02T10:55:10.620370+0000","last_unstale":"2023-03-02T10:55:10.622737+0000","last_undegraded":"2023-03-02T10:55:10.622737+0000","last_fullsized":"2023-03-02T10:55:10.622737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:33:20.678615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.615464+0000","last_change":"2023-03-02T10:55:10.155403+0000","last_active":"2023-03-02T10:55:11.615464+0000","last_peered":"2023-03-02T10:55:11.615464+0000","last_clean":"2023-03-02T10:55:11.615464+0000","last_became_active":"2023-03-02T10:55:10.152547+0000","last_became_peered":"2023-03-02T10:55:10.152547+0000","last_unstale":"2023-03-02T10:55:11.615464+0000","last_undegraded":"2023-03-02T10:55:11.615464+0000","last_fullsized":"2023-03-02T10:55:11.615464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:18:30.564037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.632260+0000","last_change":"2023-03-02T10:55:10.626243+0000","last_active":"2023-03-02T10:55:10.632260+0000","last_peered":"2023-03-02T10:55:10.632260+0000","last_clean":"2023-03-02T10:55:10.632260+0000","last_became_active":"2023-03-02T10:55:10.625924+0000","last_became_peered":"2023-03-02T10:55:10.625924+0000","last_unstale":"2023-03-02T10:55:10.632260+0000","last_undegraded":"2023-03-02T10:55:10.632260+0000","last_fullsized":"2023-03-02T10:55:10.632260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:03:50.833602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774930+0000","last_change":"2023-03-02T10:55:10.159307+0000","last_active":"2023-03-02T10:55:11.774930+0000","last_peered":"2023-03-02T10:55:11.774930+0000","last_clean":"2023-03-02T10:55:11.774930+0000","last_became_active":"2023-03-02T10:55:10.158979+0000","last_became_peered":"2023-03-02T10:55:10.158979+0000","last_unstale":"2023-03-02T10:55:11.774930+0000","last_undegraded":"2023-03-02T10:55:11.774930+0000","last_fullsized":"2023-03-02T10:55:11.774930+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:13:54.984801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633508+0000","last_change":"2023-03-02T10:55:10.630995+0000","last_active":"2023-03-02T10:55:10.633508+0000","last_peered":"2023-03-02T10:55:10.633508+0000","last_clean":"2023-03-02T10:55:10.633508+0000","last_became_active":"2023-03-02T10:55:10.630654+0000","last_became_peered":"2023-03-02T10:55:10.630654+0000","last_unstale":"2023-03-02T10:55:10.633508+0000","last_undegraded":"2023-03-02T10:55:10.633508+0000","last_fullsized":"2023-03-02T10:55:10.633508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:25:50.945152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633911+0000","last_change":"2023-03-02T10:55:10.633263+0000","last_active":"2023-03-02T10:55:10.633911+0000","last_peered":"2023-03-02T10:55:10.633911+0000","last_clean":"2023-03-02T10:55:10.633911+0000","last_became_active":"2023-03-02T10:55:10.632796+0000","last_became_peered":"2023-03-02T10:55:10.632796+0000","last_unstale":"2023-03-02T10:55:10.633911+0000","last_undegraded":"2023-03-02T10:55:10.633911+0000","last_fullsized":"2023-03-02T10:55:10.633911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:04:02.060792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774184+0000","last_change":"2023-03-02T10:55:10.620195+0000","last_active":"2023-03-02T10:55:11.774184+0000","last_peered":"2023-03-02T10:55:11.774184+0000","last_clean":"2023-03-02T10:55:11.774184+0000","last_became_active":"2023-03-02T10:55:10.619904+0000","last_became_peered":"2023-03-02T10:55:10.619904+0000","last_unstale":"2023-03-02T10:55:11.774184+0000","last_undegraded":"2023-03-02T10:55:11.774184+0000","last_fullsized":"2023-03-02T10:55:11.774184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:03:43.176587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774989+0000","last_change":"2023-03-02T10:55:10.619427+0000","last_active":"2023-03-02T10:55:11.774989+0000","last_peered":"2023-03-02T10:55:11.774989+0000","last_clean":"2023-03-02T10:55:11.774989+0000","last_became_active":"2023-03-02T10:55:10.618184+0000","last_became_peered":"2023-03-02T10:55:10.618184+0000","last_unstale":"2023-03-02T10:55:11.774989+0000","last_undegraded":"2023-03-02T10:55:11.774989+0000","last_fullsized":"2023-03-02T10:55:11.774989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:00.907091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774028+0000","last_change":"2023-03-02T10:55:10.630058+0000","last_active":"2023-03-02T10:55:11.774028+0000","last_peered":"2023-03-02T10:55:11.774028+0000","last_clean":"2023-03-02T10:55:11.774028+0000","last_became_active":"2023-03-02T10:55:10.626022+0000","last_became_peered":"2023-03-02T10:55:10.626022+0000","last_unstale":"2023-03-02T10:55:11.774028+0000","last_undegraded":"2023-03-02T10:55:11.774028+0000","last_fullsized":"2023-03-02T10:55:11.774028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:23:27.900984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.775034+0000","last_change":"2023-03-02T10:55:10.621984+0000","last_active":"2023-03-02T10:55:11.775034+0000","last_peered":"2023-03-02T10:55:11.775034+0000","last_clean":"2023-03-02T10:55:11.775034+0000","last_became_active":"2023-03-02T10:55:10.621636+0000","last_became_peered":"2023-03-02T10:55:10.621636+0000","last_unstale":"2023-03-02T10:55:11.775034+0000","last_undegraded":"2023-03-02T10:55:11.775034+0000","last_fullsized":"2023-03-02T10:55:11.775034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:10:41.154358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633935+0000","last_change":"2023-03-02T10:55:10.633194+0000","last_active":"2023-03-02T10:55:10.633935+0000","last_peered":"2023-03-02T10:55:10.633935+0000","last_clean":"2023-03-02T10:55:10.633935+0000","last_became_active":"2023-03-02T10:55:10.632860+0000","last_became_peered":"2023-03-02T10:55:10.632860+0000","last_unstale":"2023-03-02T10:55:10.633935+0000","last_undegraded":"2023-03-02T10:55:10.633935+0000","last_fullsized":"2023-03-02T10:55:10.633935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:34:58.071830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774379+0000","last_change":"2023-03-02T10:55:10.613717+0000","last_active":"2023-03-02T10:55:11.774379+0000","last_peered":"2023-03-02T10:55:11.774379+0000","last_clean":"2023-03-02T10:55:11.774379+0000","last_became_active":"2023-03-02T10:55:10.613391+0000","last_became_peered":"2023-03-02T10:55:10.613391+0000","last_unstale":"2023-03-02T10:55:11.774379+0000","last_undegraded":"2023-03-02T10:55:11.774379+0000","last_fullsized":"2023-03-02T10:55:11.774379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:51:23.532086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.638619+0000","last_change":"2023-03-02T10:55:10.637730+0000","last_active":"2023-03-02T10:55:10.638619+0000","last_peered":"2023-03-02T10:55:10.638619+0000","last_clean":"2023-03-02T10:55:10.638619+0000","last_became_active":"2023-03-02T10:55:10.637097+0000","last_became_peered":"2023-03-02T10:55:10.637097+0000","last_unstale":"2023-03-02T10:55:10.638619+0000","last_undegraded":"2023-03-02T10:55:10.638619+0000","last_fullsized":"2023-03-02T10:55:10.638619+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:41:19.587933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.615141+0000","last_change":"2023-03-02T10:55:10.617374+0000","last_active":"2023-03-02T10:55:11.615141+0000","last_peered":"2023-03-02T10:55:11.615141+0000","last_clean":"2023-03-02T10:55:11.615141+0000","last_became_active":"2023-03-02T10:55:10.617061+0000","last_became_peered":"2023-03-02T10:55:10.617061+0000","last_unstale":"2023-03-02T10:55:11.615141+0000","last_undegraded":"2023-03-02T10:55:11.615141+0000","last_fullsized":"2023-03-02T10:55:11.615141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:03:41.270487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.623282+0000","last_change":"2023-03-02T10:55:10.622246+0000","last_active":"2023-03-02T10:55:10.623282+0000","last_peered":"2023-03-02T10:55:10.623282+0000","last_clean":"2023-03-02T10:55:10.623282+0000","last_became_active":"2023-03-02T10:55:10.621938+0000","last_became_peered":"2023-03-02T10:55:10.621938+0000","last_unstale":"2023-03-02T10:55:10.623282+0000","last_undegraded":"2023-03-02T10:55:10.623282+0000","last_fullsized":"2023-03-02T10:55:10.623282+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:39:35.605113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551508+0000","last_change":"2023-03-02T10:55:10.623502+0000","last_active":"2023-03-02T10:55:11.551508+0000","last_peered":"2023-03-02T10:55:11.551508+0000","last_clean":"2023-03-02T10:55:11.551508+0000","last_became_active":"2023-03-02T10:55:10.623160+0000","last_became_peered":"2023-03-02T10:55:10.623160+0000","last_unstale":"2023-03-02T10:55:11.551508+0000","last_undegraded":"2023-03-02T10:55:11.551508+0000","last_fullsized":"2023-03-02T10:55:11.551508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:30:49.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774918+0000","last_change":"2023-03-02T10:55:10.636452+0000","last_active":"2023-03-02T10:55:11.774918+0000","last_peered":"2023-03-02T10:55:11.774918+0000","last_clean":"2023-03-02T10:55:11.774918+0000","last_became_active":"2023-03-02T10:55:10.636176+0000","last_became_peered":"2023-03-02T10:55:10.636176+0000","last_unstale":"2023-03-02T10:55:11.774918+0000","last_undegraded":"2023-03-02T10:55:11.774918+0000","last_fullsized":"2023-03-02T10:55:11.774918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:51.303295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.623352+0000","last_change":"2023-03-02T10:55:10.621378+0000","last_active":"2023-03-02T10:55:10.623352+0000","last_peered":"2023-03-02T10:55:10.623352+0000","last_clean":"2023-03-02T10:55:10.623352+0000","last_became_active":"2023-03-02T10:55:10.620771+0000","last_became_peered":"2023-03-02T10:55:10.620771+0000","last_unstale":"2023-03-02T10:55:10.623352+0000","last_undegraded":"2023-03-02T10:55:10.623352+0000","last_fullsized":"2023-03-02T10:55:10.623352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:07:55.415801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":254019,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3746,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":12984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416397,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5944,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739208,"statfs":{"total":95995035648,"available":95988948992,"internally_reserved":0,"allocated":901120,"data_stored":430296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":10,"up_from":71,"seq":304942678032,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6200,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738952,"statfs":{"total":95995035648,"available":95988686848,"internally_reserved":0,"allocated":966656,"data_stored":1021557,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":1.046},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.92300000000000004}]},{"osd":3,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.099}]},{"osd":4,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":1.083},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.25},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":1.006}]},{"osd":9,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.139},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.96699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]}]},{"osd":9,"up_from":66,"seq":283467841557,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6156,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738996,"statfs":{"total":95995035648,"available":95988731904,"internally_reserved":0,"allocated":921600,"data_stored":430622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.504},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.73199999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.79500000000000004}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.81000000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6268,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738884,"statfs":{"total":95995035648,"available":95988617216,"internally_reserved":0,"allocated":905216,"data_stored":430318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.312},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.439},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55300000000000005}]},{"osd":9,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.63100000000000001}]},{"osd":10,"last update":"Thu Mar 2 10:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.60199999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299421,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6388,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738764,"statfs":{"total":95995035648,"available":95988494336,"internally_reserved":0,"allocated":962560,"data_stored":1021874,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84499999999999997,"5min":1.034,"15min":1.034},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29099999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.438},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.41299999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63600000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.77600000000000002,"5min":1.129,"15min":1.129},"last":0.625},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.41699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71499999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.38700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81699999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77600000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.747,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67400000000000004,"15min":0.67100000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.49399999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73499999999999999}]},{"osd":9,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.754}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.78100000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":6,"up_from":47,"seq":201863462947,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6196,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738956,"statfs":{"total":95995035648,"available":95988690944,"internally_reserved":0,"allocated":897024,"data_stored":429730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.41199999999999998,"15min":0.40100000000000002},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.45200000000000001,"15min":0.44},"min":{"1min":0.36799999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.373}]},{"osd":1,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.55200000000000005,"15min":0.53500000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.311},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.59799999999999998,"15min":0.57999999999999996},"min":{"1min":0.60199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.52000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.42299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.40300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.505}]},{"osd":4,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90600000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.50700000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.67300000000000004,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.439,"15min":0.439},"max":{"1min":1.016,"5min":1.05,"15min":1.05},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.70999999999999996,"15min":0.69399999999999995},"min":{"1min":0.60999999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Mar 2 10:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.73899999999999999,"15min":0.72599999999999998},"min":{"1min":0.57599999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.747,"15min":0.73499999999999999},"min":{"1min":0.629,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.61799999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.67000000000000004}]},{"osd":9,"last update":"Thu Mar 2 10:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.65500000000000003}]},{"osd":10,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7172,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737980,"statfs":{"total":95995035648,"available":95987691520,"internally_reserved":0,"allocated":913408,"data_stored":432282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.496,"15min":0.499},"min":{"1min":0.33600000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Mar 2 10:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Mar 2 10:54:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.379,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.41399999999999998,"15min":0.39900000000000002},"min":{"1min":0.27800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.497,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":1.008}]},{"osd":5,"last update":"Thu Mar 2 10:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90400000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.88},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Mar 2 10:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.98199999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":1.032},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.84399999999999997}]},{"osd":9,"last update":"Thu Mar 2 10:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.077}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.056}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7168,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737984,"statfs":{"total":95995035648,"available":95987695616,"internally_reserved":0,"allocated":909312,"data_stored":430408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 2 10:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.52500000000000002,"15min":0.48299999999999998},"min":{"1min":0.46800000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.53300000000000003,"15min":0.499},"min":{"1min":0.45300000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58499999999999996,"15min":0.54400000000000004},"min":{"1min":0.48599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.436}]},{"osd":3,"last update":"Thu Mar 2 10:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.41899999999999998},"min":{"1min":0.29099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71199999999999997,"5min":0.755,"15min":0.755},"last":0.377},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.432,"15min":0.41399999999999998},"min":{"1min":0.32200000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57199999999999995,"15min":0.55200000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56000000000000005,"15min":0.54300000000000004},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Mar 2 10:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63100000000000001,"15min":0.62},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.999,"5min":1.149,"15min":1.149},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.93200000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.01,"5min":1.171,"15min":1.171},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.47299999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.054,"5min":1.298,"15min":1.298},"last":0.745},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0740000000000001,"5min":1.23,"15min":1.23},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Mar 2 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.60999999999999999}]},{"osd":9,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.629},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.71899999999999997}]},{"osd":10,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.69499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411381,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7096,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":93738056,"statfs":{"total":95995035648,"available":95987769344,"internally_reserved":0,"allocated":901120,"data_stored":422790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.496},"min":{"1min":0.375,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.503},"min":{"1min":0.41199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.82899999999999996,"5min":0.874,"15min":0.874},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53400000000000003,"15min":0.51200000000000001},"min":{"1min":0.36299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72199999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.439},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.54200000000000004,"15min":0.50800000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Mar 2 10:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.56000000000000005},"min":{"1min":0.46999999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79800000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.57899999999999996},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Mar 2 10:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.497},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Mar 2 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.501,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77300000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Mar 2 10:54:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.46600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81000000000000005,"5min":0.871,"15min":0.871},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.38700000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.6639999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.374}]},{"osd":9,"last update":"Thu Mar 2 10:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47799999999999998}]},{"osd":10,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.53900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149744,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6464,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738688,"statfs":{"total":95995035648,"available":95988416512,"internally_reserved":0,"allocated":909312,"data_stored":429683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.375,"15min":0.372},"min":{"1min":0.309,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.39900000000000002,"15min":0.38700000000000001},"min":{"1min":0.28199999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.44600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.38}]},{"osd":2,"last update":"Thu Mar 2 10:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78000000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61499999999999999,"15min":0.60599999999999998},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65900000000000003,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Mar 2 10:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.65100000000000002,"15min":0.64100000000000001},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.874,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Mar 2 10:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.375,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83399999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.624}]},{"osd":7,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.80000000000000004,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0029999999999999,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.53400000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.70199999999999996}]},{"osd":8,"last update":"Thu Mar 2 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":6.9539999999999997,"5min":6.9539999999999997,"15min":6.9539999999999997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.76300000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.80300000000000005}]},{"osd":10,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.501},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67200000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888108,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6328,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738824,"statfs":{"total":95995035648,"available":95988555776,"internally_reserved":0,"allocated":901120,"data_stored":429752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65300000000000002,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":5.8860000000000001,"15min":5.8860000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64000000000000001,"15min":0.67400000000000004},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.95599999999999996,"5min":5.577,"15min":5.577},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.307},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.36599999999999999,"15min":0.35199999999999998},"min":{"1min":0.27600000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53500000000000003,"15min":0.51900000000000002},"min":{"1min":0.40000000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.55300000000000005,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.35799999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Mar 2 10:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77500000000000002,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.436},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Mar 2 10:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.498,"5min":0.443,"15min":0.443},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Mar 2 10:54:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.34899999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.39100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55800000000000005}]},{"osd":9,"last update":"Thu Mar 2 10:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.628},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.61799999999999999}]},{"osd":10,"last update":"Thu Mar 2 10:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.57099999999999995}]}]},{"osd":5,"up_from":39,"seq":167503724582,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6444,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738708,"statfs":{"total":95995035648,"available":95988436992,"internally_reserved":0,"allocated":954368,"data_stored":1019949,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86699999999999999,"5min":1.51,"15min":1.51},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.433},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40300000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.86299999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.41899999999999998},"min":{"1min":0.32100000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64300000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Mar 2 10:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Mar 2 10:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61399999999999999,"15min":0.60599999999999998},"min":{"1min":0.46100000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92900000000000005,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:54:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.63600000000000001,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.52300000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85599999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51600000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59299999999999997}]},{"osd":9,"last update":"Thu Mar 2 10:54:47 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.60299999999999998}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.62},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-02T10:55:19.120 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-02T10:55:19.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.304+0000 7ff1f57ff700 1 -- 172.21.15.57:0/4249744194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f0102ed0 msgr2=0x7ff1f01052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:19.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.304+0000 7ff1f57ff700 1 --2- 172.21.15.57:0/4249744194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f0102ed0 0x7ff1f01052b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009990 tx=0x7ff1d8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.304+0000 7ff1f57ff700 1 -- 172.21.15.57:0/4249744194 shutdown_connections 2023-03-02T10:55:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.304+0000 7ff1f57ff700 1 --2- 172.21.15.57:0/4249744194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f01057f0 0x7ff1f0107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.304+0000 7ff1f57ff700 1 --2- 172.21.15.57:0/4249744194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1f01005b0 0x7ff1f0102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.304+0000 7ff1f57ff700 1 --2- 172.21.15.57:0/4249744194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f0102ed0 0x7ff1f01052b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.304+0000 7ff1f57ff700 1 -- 172.21.15.57:0/4249744194 >> 172.21.15.57:0/4249744194 conn(0x7ff1f00f9fd0 msgr2=0x7ff1f00fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.304+0000 7ff1f57ff700 1 -- 172.21.15.57:0/4249744194 shutdown_connections 2023-03-02T10:55:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.304+0000 7ff1f57ff700 1 -- 172.21.15.57:0/4249744194 wait complete. 2023-03-02T10:55:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1f57ff700 1 Processor -- start 2023-03-02T10:55:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1f57ff700 1 -- start start 2023-03-02T10:55:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1f57ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f01005b0 0x7ff1f00fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1f57ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1f0102ed0 0x7ff1f00fe560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1f57ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f01057f0 0x7ff1f00feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1f57ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00ff240 con 0x7ff1f01005b0 2023-03-02T10:55:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1f57ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00ff3b0 con 0x7ff1f01057f0 2023-03-02T10:55:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1f57ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f019f880 con 0x7ff1f0102ed0 2023-03-02T10:55:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1eeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f01005b0 0x7ff1f00fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1eeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f01005b0 0x7ff1f00fff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47964/0 (socket says 172.21.15.57:47964) 2023-03-02T10:55:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1eeffd700 1 -- 172.21.15.57:0/3574711029 learned_addr learned my addr 172.21.15.57:0/3574711029 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.305+0000 7ff1ef7fe700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f01057f0 0x7ff1f00feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1e67fc700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1f0102ed0 0x7ff1f00fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1eeffd700 1 -- 172.21.15.57:0/3574711029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1f0102ed0 msgr2=0x7ff1f00fe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1eeffd700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1f0102ed0 0x7ff1f00fe560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1eeffd700 1 -- 172.21.15.57:0/3574711029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f01057f0 msgr2=0x7ff1f00feaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1eeffd700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f01057f0 0x7ff1f00feaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1eeffd700 1 -- 172.21.15.57:0/3574711029 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d80095f0 con 0x7ff1f01005b0 2023-03-02T10:55:19.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1eeffd700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f01005b0 0x7ff1f00fff20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000e970 tx=0x7ff1e000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:19.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1ecff9700 1 -- 172.21.15.57:0/3574711029 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0009790 con 0x7ff1f01005b0 2023-03-02T10:55:19.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1ecff9700 1 -- 172.21.15.57:0/3574711029 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1e000eec0 con 0x7ff1f01005b0 2023-03-02T10:55:19.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1f57ff700 1 -- 172.21.15.57:0/3574711029 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f010b420 con 0x7ff1f01005b0 2023-03-02T10:55:19.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1ecff9700 1 -- 172.21.15.57:0/3574711029 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0005590 con 0x7ff1f01005b0 2023-03-02T10:55:19.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.306+0000 7ff1f57ff700 1 -- 172.21.15.57:0/3574711029 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f010b290 con 0x7ff1f01005b0 2023-03-02T10:55:19.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.307+0000 7ff1f57ff700 1 -- 172.21.15.57:0/3574711029 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f00fbb40 con 0x7ff1f01005b0 2023-03-02T10:55:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.309+0000 7ff1ecff9700 1 -- 172.21.15.57:0/3574711029 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7ff1e001e020 con 0x7ff1f01005b0 2023-03-02T10:55:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.309+0000 7ff1ecff9700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff1dc09b3e0 0x7ff1dc09d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.310+0000 7ff1e67fc700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff1dc09b3e0 0x7ff1dc09d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.310+0000 7ff1ecff9700 1 -- 172.21.15.57:0/3574711029 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff1e0014070 con 0x7ff1f01005b0 2023-03-02T10:55:19.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.310+0000 7ff1e67fc700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff1dc09b3e0 0x7ff1dc09d890 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8006010 tx=0x7ff1d800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:19.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.313+0000 7ff1ecff9700 1 -- 172.21.15.57:0/3574711029 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7ff1e0090b00 con 0x7ff1f01005b0 2023-03-02T10:55:19.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.508+0000 7ff1f57ff700 1 -- 172.21.15.57:0/3574711029 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1f0061560 con 0x7ff1dc09b3e0 2023-03-02T10:55:19.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.518+0000 7ff1ecff9700 1 -- 172.21.15.57:0/3574711029 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335607 (secure 0 0 0) 0x7ff1f0061560 con 0x7ff1dc09b3e0 2023-03-02T10:55:19.523 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:19.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 -- 172.21.15.57:0/3574711029 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff1dc09b3e0 msgr2=0x7ff1dc09d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:19.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff1dc09b3e0 0x7ff1dc09d890 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8006010 tx=0x7ff1d800b260 comp rx=0 tx=0).stop 2023-03-02T10:55:19.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 -- 172.21.15.57:0/3574711029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f01005b0 msgr2=0x7ff1f00fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:19.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f01005b0 0x7ff1f00fff20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000e970 tx=0x7ff1e000ec80 comp rx=0 tx=0).stop 2023-03-02T10:55:19.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 -- 172.21.15.57:0/3574711029 shutdown_connections 2023-03-02T10:55:19.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff1dc09b3e0 0x7ff1dc09d890 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f01057f0 0x7ff1f00feaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f01005b0 0x7ff1f00fff20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 --2- 172.21.15.57:0/3574711029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1f0102ed0 0x7ff1f00fe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:19.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 -- 172.21.15.57:0/3574711029 >> 172.21.15.57:0/3574711029 conn(0x7ff1f00f9fd0 msgr2=0x7ff1f01011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:19.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 -- 172.21.15.57:0/3574711029 shutdown_connections 2023-03-02T10:55:19.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:19.522+0000 7ff1f57ff700 1 -- 172.21.15.57:0/3574711029 wait complete. 2023-03-02T10:55:19.527 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-03-02T10:55:19.539 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2023-03-02T10:55:19.258362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":637593,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":175,"num_read_kb":187,"num_write":385,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":316,"ondisk_log_size":316,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":78520,"kb_used_data":11032,"kb_used_omap":0,"kb_used_meta":67392,"kb_avail":1124863304,"statfs":{"total":1151940427776,"available":1151860023296,"internally_reserved":0,"allocated":11296768,"data_stored":7001328,"data_compressed":110277,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":69009408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47225,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":39,"num_read_kb":68,"num_write":204,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.654630"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.631062+0000","last_change":"2023-03-02T10:55:10.630366+0000","last_active":"2023-03-02T10:55:10.631062+0000","last_peered":"2023-03-02T10:55:10.631062+0000","last_clean":"2023-03-02T10:55:10.631062+0000","last_became_active":"2023-03-02T10:55:10.630035+0000","last_became_peered":"2023-03-02T10:55:10.630035+0000","last_unstale":"2023-03-02T10:55:10.631062+0000","last_undegraded":"2023-03-02T10:55:10.631062+0000","last_fullsized":"2023-03-02T10:55:10.631062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:00:41.832233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774242+0000","last_change":"2023-03-02T10:55:10.628111+0000","last_active":"2023-03-02T10:55:11.774242+0000","last_peered":"2023-03-02T10:55:11.774242+0000","last_clean":"2023-03-02T10:55:11.774242+0000","last_became_active":"2023-03-02T10:55:10.626879+0000","last_became_peered":"2023-03-02T10:55:10.626879+0000","last_unstale":"2023-03-02T10:55:11.774242+0000","last_undegraded":"2023-03-02T10:55:11.774242+0000","last_fullsized":"2023-03-02T10:55:11.774242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:08:52.120684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774254+0000","last_change":"2023-03-02T10:55:10.624392+0000","last_active":"2023-03-02T10:55:11.774254+0000","last_peered":"2023-03-02T10:55:11.774254+0000","last_clean":"2023-03-02T10:55:11.774254+0000","last_became_active":"2023-03-02T10:55:10.624095+0000","last_became_peered":"2023-03-02T10:55:10.624095+0000","last_unstale":"2023-03-02T10:55:11.774254+0000","last_undegraded":"2023-03-02T10:55:11.774254+0000","last_fullsized":"2023-03-02T10:55:11.774254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:30:55.174383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774418+0000","last_change":"2023-03-02T10:55:10.619950+0000","last_active":"2023-03-02T10:55:11.774418+0000","last_peered":"2023-03-02T10:55:11.774418+0000","last_clean":"2023-03-02T10:55:11.774418+0000","last_became_active":"2023-03-02T10:55:10.619543+0000","last_became_peered":"2023-03-02T10:55:10.619543+0000","last_unstale":"2023-03-02T10:55:11.774418+0000","last_undegraded":"2023-03-02T10:55:11.774418+0000","last_fullsized":"2023-03-02T10:55:11.774418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:08:02.321422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.773931+0000","last_change":"2023-03-02T10:55:10.626403+0000","last_active":"2023-03-02T10:55:11.773931+0000","last_peered":"2023-03-02T10:55:11.773931+0000","last_clean":"2023-03-02T10:55:11.773931+0000","last_became_active":"2023-03-02T10:55:10.626062+0000","last_became_peered":"2023-03-02T10:55:10.626062+0000","last_unstale":"2023-03-02T10:55:11.773931+0000","last_undegraded":"2023-03-02T10:55:11.773931+0000","last_fullsized":"2023-03-02T10:55:11.773931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:35:06.798468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.612009+0000","last_change":"2023-03-02T10:55:10.623903+0000","last_active":"2023-03-02T10:55:11.612009+0000","last_peered":"2023-03-02T10:55:11.612009+0000","last_clean":"2023-03-02T10:55:11.612009+0000","last_became_active":"2023-03-02T10:55:10.623422+0000","last_became_peered":"2023-03-02T10:55:10.623422+0000","last_unstale":"2023-03-02T10:55:11.612009+0000","last_undegraded":"2023-03-02T10:55:11.612009+0000","last_fullsized":"2023-03-02T10:55:11.612009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:21.066552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633763+0000","last_change":"2023-03-02T10:55:10.633210+0000","last_active":"2023-03-02T10:55:10.633763+0000","last_peered":"2023-03-02T10:55:10.633763+0000","last_clean":"2023-03-02T10:55:10.633763+0000","last_became_active":"2023-03-02T10:55:10.632898+0000","last_became_peered":"2023-03-02T10:55:10.632898+0000","last_unstale":"2023-03-02T10:55:10.633763+0000","last_undegraded":"2023-03-02T10:55:10.633763+0000","last_fullsized":"2023-03-02T10:55:10.633763+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:04.043328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.637289+0000","last_change":"2023-03-02T10:55:10.634427+0000","last_active":"2023-03-02T10:55:10.637289+0000","last_peered":"2023-03-02T10:55:10.637289+0000","last_clean":"2023-03-02T10:55:10.637289+0000","last_became_active":"2023-03-02T10:55:10.634159+0000","last_became_peered":"2023-03-02T10:55:10.634159+0000","last_unstale":"2023-03-02T10:55:10.637289+0000","last_undegraded":"2023-03-02T10:55:10.637289+0000","last_fullsized":"2023-03-02T10:55:10.637289+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:59:09.344860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551554+0000","last_change":"2023-03-02T10:55:10.622775+0000","last_active":"2023-03-02T10:55:11.551554+0000","last_peered":"2023-03-02T10:55:11.551554+0000","last_clean":"2023-03-02T10:55:11.551554+0000","last_became_active":"2023-03-02T10:55:10.616254+0000","last_became_peered":"2023-03-02T10:55:10.616254+0000","last_unstale":"2023-03-02T10:55:11.551554+0000","last_undegraded":"2023-03-02T10:55:11.551554+0000","last_fullsized":"2023-03-02T10:55:11.551554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:01:56.832512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.612324+0000","last_change":"2023-03-02T10:55:10.620311+0000","last_active":"2023-03-02T10:55:11.612324+0000","last_peered":"2023-03-02T10:55:11.612324+0000","last_clean":"2023-03-02T10:55:11.612324+0000","last_became_active":"2023-03-02T10:55:10.620028+0000","last_became_peered":"2023-03-02T10:55:10.620028+0000","last_unstale":"2023-03-02T10:55:11.612324+0000","last_undegraded":"2023-03-02T10:55:11.612324+0000","last_fullsized":"2023-03-02T10:55:11.612324+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:16:13.770927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.622826+0000","last_change":"2023-03-02T10:55:10.621316+0000","last_active":"2023-03-02T10:55:10.622826+0000","last_peered":"2023-03-02T10:55:10.622826+0000","last_clean":"2023-03-02T10:55:10.622826+0000","last_became_active":"2023-03-02T10:55:10.620803+0000","last_became_peered":"2023-03-02T10:55:10.620803+0000","last_unstale":"2023-03-02T10:55:10.622826+0000","last_undegraded":"2023-03-02T10:55:10.622826+0000","last_fullsized":"2023-03-02T10:55:10.622826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:20:18.434138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774427+0000","last_change":"2023-03-02T10:55:10.625305+0000","last_active":"2023-03-02T10:55:11.774427+0000","last_peered":"2023-03-02T10:55:11.774427+0000","last_clean":"2023-03-02T10:55:11.774427+0000","last_became_active":"2023-03-02T10:55:10.625025+0000","last_became_peered":"2023-03-02T10:55:10.625025+0000","last_unstale":"2023-03-02T10:55:11.774427+0000","last_undegraded":"2023-03-02T10:55:11.774427+0000","last_fullsized":"2023-03-02T10:55:11.774427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:35:40.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774980+0000","last_change":"2023-03-02T10:55:10.626408+0000","last_active":"2023-03-02T10:55:11.774980+0000","last_peered":"2023-03-02T10:55:11.774980+0000","last_clean":"2023-03-02T10:55:11.774980+0000","last_became_active":"2023-03-02T10:55:10.625510+0000","last_became_peered":"2023-03-02T10:55:10.625510+0000","last_unstale":"2023-03-02T10:55:11.774980+0000","last_undegraded":"2023-03-02T10:55:11.774980+0000","last_fullsized":"2023-03-02T10:55:11.774980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:59:10.622871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.773951+0000","last_change":"2023-03-02T10:55:10.629323+0000","last_active":"2023-03-02T10:55:11.773951+0000","last_peered":"2023-03-02T10:55:11.773951+0000","last_clean":"2023-03-02T10:55:11.773951+0000","last_became_active":"2023-03-02T10:55:10.627038+0000","last_became_peered":"2023-03-02T10:55:10.627038+0000","last_unstale":"2023-03-02T10:55:11.773951+0000","last_undegraded":"2023-03-02T10:55:11.773951+0000","last_fullsized":"2023-03-02T10:55:11.773951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:57:21.241810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.773533+0000","last_change":"2023-03-02T10:55:10.624312+0000","last_active":"2023-03-02T10:55:11.773533+0000","last_peered":"2023-03-02T10:55:11.773533+0000","last_clean":"2023-03-02T10:55:11.773533+0000","last_became_active":"2023-03-02T10:55:10.623997+0000","last_became_peered":"2023-03-02T10:55:10.623997+0000","last_unstale":"2023-03-02T10:55:11.773533+0000","last_undegraded":"2023-03-02T10:55:11.773533+0000","last_fullsized":"2023-03-02T10:55:11.773533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:09:43.683852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551466+0000","last_change":"2023-03-02T10:55:10.622473+0000","last_active":"2023-03-02T10:55:11.551466+0000","last_peered":"2023-03-02T10:55:11.551466+0000","last_clean":"2023-03-02T10:55:11.551466+0000","last_became_active":"2023-03-02T10:55:10.622148+0000","last_became_peered":"2023-03-02T10:55:10.622148+0000","last_unstale":"2023-03-02T10:55:11.551466+0000","last_undegraded":"2023-03-02T10:55:11.551466+0000","last_fullsized":"2023-03-02T10:55:11.551466+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:54:52.132792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.631077+0000","last_change":"2023-03-02T10:55:10.630380+0000","last_active":"2023-03-02T10:55:10.631077+0000","last_peered":"2023-03-02T10:55:10.631077+0000","last_clean":"2023-03-02T10:55:10.631077+0000","last_became_active":"2023-03-02T10:55:10.630088+0000","last_became_peered":"2023-03-02T10:55:10.630088+0000","last_unstale":"2023-03-02T10:55:10.631077+0000","last_undegraded":"2023-03-02T10:55:10.631077+0000","last_fullsized":"2023-03-02T10:55:10.631077+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:08:58.983902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.246724+0000","last_change":"2023-03-02T10:55:10.620547+0000","last_active":"2023-03-02T10:55:11.246724+0000","last_peered":"2023-03-02T10:55:11.246724+0000","last_clean":"2023-03-02T10:55:11.246724+0000","last_became_active":"2023-03-02T10:55:10.620225+0000","last_became_peered":"2023-03-02T10:55:10.620225+0000","last_unstale":"2023-03-02T10:55:11.246724+0000","last_undegraded":"2023-03-02T10:55:11.246724+0000","last_fullsized":"2023-03-02T10:55:11.246724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:47:38.669432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774401+0000","last_change":"2023-03-02T10:55:10.625108+0000","last_active":"2023-03-02T10:55:11.774401+0000","last_peered":"2023-03-02T10:55:11.774401+0000","last_clean":"2023-03-02T10:55:11.774401+0000","last_became_active":"2023-03-02T10:55:10.624797+0000","last_became_peered":"2023-03-02T10:55:10.624797+0000","last_unstale":"2023-03-02T10:55:11.774401+0000","last_undegraded":"2023-03-02T10:55:11.774401+0000","last_fullsized":"2023-03-02T10:55:11.774401+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:06:57.777889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'11","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:15.546822+0000","last_change":"2023-03-02T10:55:10.146541+0000","last_active":"2023-03-02T10:55:15.546822+0000","last_peered":"2023-03-02T10:55:15.546822+0000","last_clean":"2023-03-02T10:55:15.546822+0000","last_became_active":"2023-03-02T10:55:10.146239+0000","last_became_peered":"2023-03-02T10:55:10.146239+0000","last_unstale":"2023-03-02T10:55:15.546822+0000","last_undegraded":"2023-03-02T10:55:15.546822+0000","last_fullsized":"2023-03-02T10:55:15.546822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:56:07.036002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.622514+0000","last_change":"2023-03-02T10:55:10.619811+0000","last_active":"2023-03-02T10:55:10.622514+0000","last_peered":"2023-03-02T10:55:10.622514+0000","last_clean":"2023-03-02T10:55:10.622514+0000","last_became_active":"2023-03-02T10:55:10.617190+0000","last_became_peered":"2023-03-02T10:55:10.617190+0000","last_unstale":"2023-03-02T10:55:10.622514+0000","last_undegraded":"2023-03-02T10:55:10.622514+0000","last_fullsized":"2023-03-02T10:55:10.622514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:20:52.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774166+0000","last_change":"2023-03-02T10:55:10.155970+0000","last_active":"2023-03-02T10:55:11.774166+0000","last_peered":"2023-03-02T10:55:11.774166+0000","last_clean":"2023-03-02T10:55:11.774166+0000","last_became_active":"2023-03-02T10:55:10.155667+0000","last_became_peered":"2023-03-02T10:55:10.155667+0000","last_unstale":"2023-03-02T10:55:11.774166+0000","last_undegraded":"2023-03-02T10:55:11.774166+0000","last_fullsized":"2023-03-02T10:55:11.774166+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:46:36.366891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774414+0000","last_change":"2023-03-02T10:55:10.623738+0000","last_active":"2023-03-02T10:55:11.774414+0000","last_peered":"2023-03-02T10:55:11.774414+0000","last_clean":"2023-03-02T10:55:11.774414+0000","last_became_active":"2023-03-02T10:55:10.620543+0000","last_became_peered":"2023-03-02T10:55:10.620543+0000","last_unstale":"2023-03-02T10:55:11.774414+0000","last_undegraded":"2023-03-02T10:55:11.774414+0000","last_fullsized":"2023-03-02T10:55:11.774414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:44:46.238712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:17.568094+0000","last_change":"2023-03-02T10:55:10.151476+0000","last_active":"2023-03-02T10:55:17.568094+0000","last_peered":"2023-03-02T10:55:17.568094+0000","last_clean":"2023-03-02T10:55:17.568094+0000","last_became_active":"2023-03-02T10:55:10.151140+0000","last_became_peered":"2023-03-02T10:55:10.151140+0000","last_unstale":"2023-03-02T10:55:17.568094+0000","last_undegraded":"2023-03-02T10:55:17.568094+0000","last_fullsized":"2023-03-02T10:55:17.568094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:37:56.513433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551520+0000","last_change":"2023-03-02T10:55:10.627844+0000","last_active":"2023-03-02T10:55:11.551520+0000","last_peered":"2023-03-02T10:55:11.551520+0000","last_clean":"2023-03-02T10:55:11.551520+0000","last_became_active":"2023-03-02T10:55:10.626972+0000","last_became_peered":"2023-03-02T10:55:10.626972+0000","last_unstale":"2023-03-02T10:55:11.551520+0000","last_undegraded":"2023-03-02T10:55:11.551520+0000","last_fullsized":"2023-03-02T10:55:11.551520+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:36:58.650285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:16.562057+0000","last_change":"2023-03-02T10:55:10.153277+0000","last_active":"2023-03-02T10:55:16.562057+0000","last_peered":"2023-03-02T10:55:16.562057+0000","last_clean":"2023-03-02T10:55:16.562057+0000","last_became_active":"2023-03-02T10:55:10.152983+0000","last_became_peered":"2023-03-02T10:55:10.152983+0000","last_unstale":"2023-03-02T10:55:16.562057+0000","last_undegraded":"2023-03-02T10:55:16.562057+0000","last_fullsized":"2023-03-02T10:55:16.562057+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:15.045107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.615586+0000","last_change":"2023-03-02T10:55:10.630295+0000","last_active":"2023-03-02T10:55:11.615586+0000","last_peered":"2023-03-02T10:55:11.615586+0000","last_clean":"2023-03-02T10:55:11.615586+0000","last_became_active":"2023-03-02T10:55:10.629004+0000","last_became_peered":"2023-03-02T10:55:10.629004+0000","last_unstale":"2023-03-02T10:55:11.615586+0000","last_undegraded":"2023-03-02T10:55:11.615586+0000","last_fullsized":"2023-03-02T10:55:11.615586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:05:51.414347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:17.571436+0000","last_change":"2023-03-02T10:55:10.153222+0000","last_active":"2023-03-02T10:55:17.571436+0000","last_peered":"2023-03-02T10:55:17.571436+0000","last_clean":"2023-03-02T10:55:17.571436+0000","last_became_active":"2023-03-02T10:55:10.152928+0000","last_became_peered":"2023-03-02T10:55:10.152928+0000","last_unstale":"2023-03-02T10:55:17.571436+0000","last_undegraded":"2023-03-02T10:55:17.571436+0000","last_fullsized":"2023-03-02T10:55:17.571436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:12:56.648713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774742+0000","last_change":"2023-03-02T10:55:10.617722+0000","last_active":"2023-03-02T10:55:11.774742+0000","last_peered":"2023-03-02T10:55:11.774742+0000","last_clean":"2023-03-02T10:55:11.774742+0000","last_became_active":"2023-03-02T10:55:10.617425+0000","last_became_peered":"2023-03-02T10:55:10.617425+0000","last_unstale":"2023-03-02T10:55:11.774742+0000","last_undegraded":"2023-03-02T10:55:11.774742+0000","last_fullsized":"2023-03-02T10:55:11.774742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:57:37.397568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:15.546312+0000","last_change":"2023-03-02T10:55:10.154877+0000","last_active":"2023-03-02T10:55:15.546312+0000","last_peered":"2023-03-02T10:55:15.546312+0000","last_clean":"2023-03-02T10:55:15.546312+0000","last_became_active":"2023-03-02T10:55:10.154562+0000","last_became_peered":"2023-03-02T10:55:10.154562+0000","last_unstale":"2023-03-02T10:55:15.546312+0000","last_undegraded":"2023-03-02T10:55:15.546312+0000","last_fullsized":"2023-03-02T10:55:15.546312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:36:03.044346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.615450+0000","last_change":"2023-03-02T10:55:10.628418+0000","last_active":"2023-03-02T10:55:11.615450+0000","last_peered":"2023-03-02T10:55:11.615450+0000","last_clean":"2023-03-02T10:55:11.615450+0000","last_became_active":"2023-03-02T10:55:10.627715+0000","last_became_peered":"2023-03-02T10:55:10.627715+0000","last_unstale":"2023-03-02T10:55:11.615450+0000","last_undegraded":"2023-03-02T10:55:11.615450+0000","last_fullsized":"2023-03-02T10:55:11.615450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:16:59.756440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:14.539858+0000","last_change":"2023-03-02T10:55:10.158875+0000","last_active":"2023-03-02T10:55:14.539858+0000","last_peered":"2023-03-02T10:55:14.539858+0000","last_clean":"2023-03-02T10:55:14.539858+0000","last_became_active":"2023-03-02T10:55:10.157653+0000","last_became_peered":"2023-03-02T10:55:10.157653+0000","last_unstale":"2023-03-02T10:55:14.539858+0000","last_undegraded":"2023-03-02T10:55:14.539858+0000","last_fullsized":"2023-03-02T10:55:14.539858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:50:03.808602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.637269+0000","last_change":"2023-03-02T10:55:10.634280+0000","last_active":"2023-03-02T10:55:10.637269+0000","last_peered":"2023-03-02T10:55:10.637269+0000","last_clean":"2023-03-02T10:55:10.637269+0000","last_became_active":"2023-03-02T10:55:10.633764+0000","last_became_peered":"2023-03-02T10:55:10.633764+0000","last_unstale":"2023-03-02T10:55:10.637269+0000","last_undegraded":"2023-03-02T10:55:10.637269+0000","last_fullsized":"2023-03-02T10:55:10.637269+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:17:25.110036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:16.564484+0000","last_change":"2023-03-02T10:55:10.154532+0000","last_active":"2023-03-02T10:55:16.564484+0000","last_peered":"2023-03-02T10:55:16.564484+0000","last_clean":"2023-03-02T10:55:16.564484+0000","last_became_active":"2023-03-02T10:55:10.152116+0000","last_became_peered":"2023-03-02T10:55:10.152116+0000","last_unstale":"2023-03-02T10:55:16.564484+0000","last_undegraded":"2023-03-02T10:55:16.564484+0000","last_fullsized":"2023-03-02T10:55:16.564484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:19:50.439666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.246648+0000","last_change":"2023-03-02T10:55:10.628790+0000","last_active":"2023-03-02T10:55:11.246648+0000","last_peered":"2023-03-02T10:55:11.246648+0000","last_clean":"2023-03-02T10:55:11.246648+0000","last_became_active":"2023-03-02T10:55:10.628452+0000","last_became_peered":"2023-03-02T10:55:10.628452+0000","last_unstale":"2023-03-02T10:55:11.246648+0000","last_undegraded":"2023-03-02T10:55:11.246648+0000","last_fullsized":"2023-03-02T10:55:11.246648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:08:30.061925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:18.572675+0000","last_change":"2023-03-02T10:55:10.152684+0000","last_active":"2023-03-02T10:55:18.572675+0000","last_peered":"2023-03-02T10:55:18.572675+0000","last_clean":"2023-03-02T10:55:18.572675+0000","last_became_active":"2023-03-02T10:55:10.152184+0000","last_became_peered":"2023-03-02T10:55:10.152184+0000","last_unstale":"2023-03-02T10:55:18.572675+0000","last_undegraded":"2023-03-02T10:55:18.572675+0000","last_fullsized":"2023-03-02T10:55:18.572675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:39:21.100760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551540+0000","last_change":"2023-03-02T10:55:10.625990+0000","last_active":"2023-03-02T10:55:11.551540+0000","last_peered":"2023-03-02T10:55:11.551540+0000","last_clean":"2023-03-02T10:55:11.551540+0000","last_became_active":"2023-03-02T10:55:10.625677+0000","last_became_peered":"2023-03-02T10:55:10.625677+0000","last_unstale":"2023-03-02T10:55:11.551540+0000","last_undegraded":"2023-03-02T10:55:11.551540+0000","last_fullsized":"2023-03-02T10:55:11.551540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:08.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.525379+0000","last_change":"2023-03-02T10:55:10.151541+0000","last_active":"2023-03-02T10:55:13.525379+0000","last_peered":"2023-03-02T10:55:13.525379+0000","last_clean":"2023-03-02T10:55:13.525379+0000","last_became_active":"2023-03-02T10:55:10.151262+0000","last_became_peered":"2023-03-02T10:55:10.151262+0000","last_unstale":"2023-03-02T10:55:13.525379+0000","last_undegraded":"2023-03-02T10:55:13.525379+0000","last_fullsized":"2023-03-02T10:55:13.525379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:00:49.821191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774411+0000","last_change":"2023-03-02T10:55:10.629541+0000","last_active":"2023-03-02T10:55:11.774411+0000","last_peered":"2023-03-02T10:55:11.774411+0000","last_clean":"2023-03-02T10:55:11.774411+0000","last_became_active":"2023-03-02T10:55:10.627473+0000","last_became_peered":"2023-03-02T10:55:10.627473+0000","last_unstale":"2023-03-02T10:55:11.774411+0000","last_undegraded":"2023-03-02T10:55:11.774411+0000","last_fullsized":"2023-03-02T10:55:11.774411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:22:52.995113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:15.547152+0000","last_change":"2023-03-02T10:55:10.152615+0000","last_active":"2023-03-02T10:55:15.547152+0000","last_peered":"2023-03-02T10:55:15.547152+0000","last_clean":"2023-03-02T10:55:15.547152+0000","last_became_active":"2023-03-02T10:55:10.152304+0000","last_became_peered":"2023-03-02T10:55:10.152304+0000","last_unstale":"2023-03-02T10:55:15.547152+0000","last_undegraded":"2023-03-02T10:55:15.547152+0000","last_fullsized":"2023-03-02T10:55:15.547152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:43:00.934520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551529+0000","last_change":"2023-03-02T10:55:10.627653+0000","last_active":"2023-03-02T10:55:11.551529+0000","last_peered":"2023-03-02T10:55:11.551529+0000","last_clean":"2023-03-02T10:55:11.551529+0000","last_became_active":"2023-03-02T10:55:10.626570+0000","last_became_peered":"2023-03-02T10:55:10.626570+0000","last_unstale":"2023-03-02T10:55:11.551529+0000","last_undegraded":"2023-03-02T10:55:11.551529+0000","last_fullsized":"2023-03-02T10:55:11.551529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:40:39.311514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'21","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:18.576140+0000","last_change":"2023-03-02T10:55:10.149121+0000","last_active":"2023-03-02T10:55:18.576140+0000","last_peered":"2023-03-02T10:55:18.576140+0000","last_clean":"2023-03-02T10:55:18.576140+0000","last_became_active":"2023-03-02T10:55:10.148800+0000","last_became_peered":"2023-03-02T10:55:10.148800+0000","last_unstale":"2023-03-02T10:55:18.576140+0000","last_undegraded":"2023-03-02T10:55:18.576140+0000","last_fullsized":"2023-03-02T10:55:18.576140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:32:30.918248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40658,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":38,"num_write":23,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774248+0000","last_change":"2023-03-02T10:55:10.625497+0000","last_active":"2023-03-02T10:55:11.774248+0000","last_peered":"2023-03-02T10:55:11.774248+0000","last_clean":"2023-03-02T10:55:11.774248+0000","last_became_active":"2023-03-02T10:55:10.625037+0000","last_became_peered":"2023-03-02T10:55:10.625037+0000","last_unstale":"2023-03-02T10:55:11.774248+0000","last_undegraded":"2023-03-02T10:55:11.774248+0000","last_fullsized":"2023-03-02T10:55:11.774248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:55:56.478111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:16.562758+0000","last_change":"2023-03-02T10:55:10.148957+0000","last_active":"2023-03-02T10:55:16.562758+0000","last_peered":"2023-03-02T10:55:16.562758+0000","last_clean":"2023-03-02T10:55:16.562758+0000","last_became_active":"2023-03-02T10:55:10.148624+0000","last_became_peered":"2023-03-02T10:55:10.148624+0000","last_unstale":"2023-03-02T10:55:16.562758+0000","last_undegraded":"2023-03-02T10:55:16.562758+0000","last_fullsized":"2023-03-02T10:55:16.562758+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:53:33.062648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774872+0000","last_change":"2023-03-02T10:55:10.633311+0000","last_active":"2023-03-02T10:55:11.774872+0000","last_peered":"2023-03-02T10:55:11.774872+0000","last_clean":"2023-03-02T10:55:11.774872+0000","last_became_active":"2023-03-02T10:55:10.632174+0000","last_became_peered":"2023-03-02T10:55:10.632174+0000","last_unstale":"2023-03-02T10:55:11.774872+0000","last_undegraded":"2023-03-02T10:55:11.774872+0000","last_fullsized":"2023-03-02T10:55:11.774872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:50:47.536118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:16.564200+0000","last_change":"2023-03-02T10:55:10.153392+0000","last_active":"2023-03-02T10:55:16.564200+0000","last_peered":"2023-03-02T10:55:16.564200+0000","last_clean":"2023-03-02T10:55:16.564200+0000","last_became_active":"2023-03-02T10:55:10.152513+0000","last_became_peered":"2023-03-02T10:55:10.152513+0000","last_unstale":"2023-03-02T10:55:16.564200+0000","last_undegraded":"2023-03-02T10:55:16.564200+0000","last_fullsized":"2023-03-02T10:55:16.564200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:26:40.675118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633811+0000","last_change":"2023-03-02T10:55:10.631953+0000","last_active":"2023-03-02T10:55:10.633811+0000","last_peered":"2023-03-02T10:55:10.633811+0000","last_clean":"2023-03-02T10:55:10.633811+0000","last_became_active":"2023-03-02T10:55:10.631624+0000","last_became_peered":"2023-03-02T10:55:10.631624+0000","last_unstale":"2023-03-02T10:55:10.633811+0000","last_undegraded":"2023-03-02T10:55:10.633811+0000","last_fullsized":"2023-03-02T10:55:10.633811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:15:20.136421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:17.569675+0000","last_change":"2023-03-02T10:55:10.150597+0000","last_active":"2023-03-02T10:55:17.569675+0000","last_peered":"2023-03-02T10:55:17.569675+0000","last_clean":"2023-03-02T10:55:17.569675+0000","last_became_active":"2023-03-02T10:55:10.150024+0000","last_became_peered":"2023-03-02T10:55:10.150024+0000","last_unstale":"2023-03-02T10:55:17.569675+0000","last_undegraded":"2023-03-02T10:55:17.569675+0000","last_fullsized":"2023-03-02T10:55:17.569675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:30.043240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633790+0000","last_change":"2023-03-02T10:55:10.633052+0000","last_active":"2023-03-02T10:55:10.633790+0000","last_peered":"2023-03-02T10:55:10.633790+0000","last_clean":"2023-03-02T10:55:10.633790+0000","last_became_active":"2023-03-02T10:55:10.632766+0000","last_became_peered":"2023-03-02T10:55:10.632766+0000","last_unstale":"2023-03-02T10:55:10.633790+0000","last_undegraded":"2023-03-02T10:55:10.633790+0000","last_fullsized":"2023-03-02T10:55:10.633790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:55.079556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:16.561757+0000","last_change":"2023-03-02T10:55:10.154559+0000","last_active":"2023-03-02T10:55:16.561757+0000","last_peered":"2023-03-02T10:55:16.561757+0000","last_clean":"2023-03-02T10:55:16.561757+0000","last_became_active":"2023-03-02T10:55:10.154058+0000","last_became_peered":"2023-03-02T10:55:10.154058+0000","last_unstale":"2023-03-02T10:55:16.561757+0000","last_undegraded":"2023-03-02T10:55:16.561757+0000","last_fullsized":"2023-03-02T10:55:16.561757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:23:26.823020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.615134+0000","last_change":"2023-03-02T10:55:10.622951+0000","last_active":"2023-03-02T10:55:11.615134+0000","last_peered":"2023-03-02T10:55:11.615134+0000","last_clean":"2023-03-02T10:55:11.615134+0000","last_became_active":"2023-03-02T10:55:10.622643+0000","last_became_peered":"2023-03-02T10:55:10.622643+0000","last_unstale":"2023-03-02T10:55:11.615134+0000","last_undegraded":"2023-03-02T10:55:11.615134+0000","last_fullsized":"2023-03-02T10:55:11.615134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:53:05.459021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:16.869347+0000","last_change":"2023-03-02T10:55:10.153755+0000","last_active":"2023-03-02T10:55:16.869347+0000","last_peered":"2023-03-02T10:55:16.869347+0000","last_clean":"2023-03-02T10:55:16.869347+0000","last_became_active":"2023-03-02T10:55:10.153473+0000","last_became_peered":"2023-03-02T10:55:10.153473+0000","last_unstale":"2023-03-02T10:55:16.869347+0000","last_undegraded":"2023-03-02T10:55:16.869347+0000","last_fullsized":"2023-03-02T10:55:16.869347+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:48:46.455449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633872+0000","last_change":"2023-03-02T10:55:10.633149+0000","last_active":"2023-03-02T10:55:10.633872+0000","last_peered":"2023-03-02T10:55:10.633872+0000","last_clean":"2023-03-02T10:55:10.633872+0000","last_became_active":"2023-03-02T10:55:10.632816+0000","last_became_peered":"2023-03-02T10:55:10.632816+0000","last_unstale":"2023-03-02T10:55:10.633872+0000","last_undegraded":"2023-03-02T10:55:10.633872+0000","last_fullsized":"2023-03-02T10:55:10.633872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:25:41.585257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.612224+0000","last_change":"2023-03-02T10:55:10.150486+0000","last_active":"2023-03-02T10:55:11.612224+0000","last_peered":"2023-03-02T10:55:11.612224+0000","last_clean":"2023-03-02T10:55:11.612224+0000","last_became_active":"2023-03-02T10:55:10.150186+0000","last_became_peered":"2023-03-02T10:55:10.150186+0000","last_unstale":"2023-03-02T10:55:11.612224+0000","last_undegraded":"2023-03-02T10:55:11.612224+0000","last_fullsized":"2023-03-02T10:55:11.612224+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:06:18.637162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.946658+0000","last_change":"2023-03-02T10:55:10.628622+0000","last_active":"2023-03-02T10:55:13.946658+0000","last_peered":"2023-03-02T10:55:13.946658+0000","last_clean":"2023-03-02T10:55:13.946658+0000","last_became_active":"2023-03-02T10:55:10.628258+0000","last_became_peered":"2023-03-02T10:55:10.628258+0000","last_unstale":"2023-03-02T10:55:13.946658+0000","last_undegraded":"2023-03-02T10:55:13.946658+0000","last_fullsized":"2023-03-02T10:55:13.946658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:46.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.145951+0000","last_change":"2023-03-02T10:55:10.156995+0000","last_active":"2023-03-02T10:55:13.145951+0000","last_peered":"2023-03-02T10:55:13.145951+0000","last_clean":"2023-03-02T10:55:13.145951+0000","last_became_active":"2023-03-02T10:55:10.156686+0000","last_became_peered":"2023-03-02T10:55:10.156686+0000","last_unstale":"2023-03-02T10:55:13.145951+0000","last_undegraded":"2023-03-02T10:55:13.145951+0000","last_fullsized":"2023-03-02T10:55:13.145951+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:03:08.237799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.612082+0000","last_change":"2023-03-02T10:55:10.637176+0000","last_active":"2023-03-02T10:55:11.612082+0000","last_peered":"2023-03-02T10:55:11.612082+0000","last_clean":"2023-03-02T10:55:11.612082+0000","last_became_active":"2023-03-02T10:55:10.636843+0000","last_became_peered":"2023-03-02T10:55:10.636843+0000","last_unstale":"2023-03-02T10:55:11.612082+0000","last_undegraded":"2023-03-02T10:55:11.612082+0000","last_fullsized":"2023-03-02T10:55:11.612082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:41:25.442808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.615206+0000","last_change":"2023-03-02T10:55:10.613814+0000","last_active":"2023-03-02T10:55:11.615206+0000","last_peered":"2023-03-02T10:55:11.615206+0000","last_clean":"2023-03-02T10:55:11.615206+0000","last_became_active":"2023-03-02T10:55:10.613496+0000","last_became_peered":"2023-03-02T10:55:10.613496+0000","last_unstale":"2023-03-02T10:55:11.615206+0000","last_undegraded":"2023-03-02T10:55:11.615206+0000","last_fullsized":"2023-03-02T10:55:11.615206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:55:58.332549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:17.569269+0000","last_change":"2023-03-02T10:55:10.160751+0000","last_active":"2023-03-02T10:55:17.569269+0000","last_peered":"2023-03-02T10:55:17.569269+0000","last_clean":"2023-03-02T10:55:17.569269+0000","last_became_active":"2023-03-02T10:55:10.160433+0000","last_became_peered":"2023-03-02T10:55:10.160433+0000","last_unstale":"2023-03-02T10:55:17.569269+0000","last_undegraded":"2023-03-02T10:55:17.569269+0000","last_fullsized":"2023-03-02T10:55:17.569269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:11:23.326464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.622540+0000","last_change":"2023-03-02T10:55:10.619761+0000","last_active":"2023-03-02T10:55:10.622540+0000","last_peered":"2023-03-02T10:55:10.622540+0000","last_clean":"2023-03-02T10:55:10.622540+0000","last_became_active":"2023-03-02T10:55:10.617361+0000","last_became_peered":"2023-03-02T10:55:10.617361+0000","last_unstale":"2023-03-02T10:55:10.622540+0000","last_undegraded":"2023-03-02T10:55:10.622540+0000","last_fullsized":"2023-03-02T10:55:10.622540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:26:55.492653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:17.568402+0000","last_change":"2023-03-02T10:55:10.151553+0000","last_active":"2023-03-02T10:55:17.568402+0000","last_peered":"2023-03-02T10:55:17.568402+0000","last_clean":"2023-03-02T10:55:17.568402+0000","last_became_active":"2023-03-02T10:55:10.151369+0000","last_became_peered":"2023-03-02T10:55:10.151369+0000","last_unstale":"2023-03-02T10:55:17.568402+0000","last_undegraded":"2023-03-02T10:55:17.568402+0000","last_fullsized":"2023-03-02T10:55:17.568402+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:30:42.550362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":372,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.616451+0000","last_change":"2023-03-02T10:54:06.270813+0000","last_active":"2023-03-02T10:55:10.616451+0000","last_peered":"2023-03-02T10:55:10.616451+0000","last_clean":"2023-03-02T10:55:10.616451+0000","last_became_active":"2023-03-02T10:54:06.270329+0000","last_became_peered":"2023-03-02T10:54:06.270329+0000","last_unstale":"2023-03-02T10:55:10.616451+0000","last_undegraded":"2023-03-02T10:55:10.616451+0000","last_fullsized":"2023-03-02T10:55:10.616451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_clean_scrub_stamp":"2023-03-02T10:51:04.207601+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:07.546806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774662+0000","last_change":"2023-03-02T10:55:10.629032+0000","last_active":"2023-03-02T10:55:11.774662+0000","last_peered":"2023-03-02T10:55:11.774662+0000","last_clean":"2023-03-02T10:55:11.774662+0000","last_became_active":"2023-03-02T10:55:10.628696+0000","last_became_peered":"2023-03-02T10:55:10.628696+0000","last_unstale":"2023-03-02T10:55:11.774662+0000","last_undegraded":"2023-03-02T10:55:11.774662+0000","last_fullsized":"2023-03-02T10:55:11.774662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:32:58.399900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:14.538267+0000","last_change":"2023-03-02T10:55:10.153240+0000","last_active":"2023-03-02T10:55:14.538267+0000","last_peered":"2023-03-02T10:55:14.538267+0000","last_clean":"2023-03-02T10:55:14.538267+0000","last_became_active":"2023-03-02T10:55:10.152977+0000","last_became_peered":"2023-03-02T10:55:10.152977+0000","last_unstale":"2023-03-02T10:55:14.538267+0000","last_undegraded":"2023-03-02T10:55:14.538267+0000","last_fullsized":"2023-03-02T10:55:14.538267+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:46:49.873113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:16.562689+0000","last_change":"2023-03-02T10:55:10.154392+0000","last_active":"2023-03-02T10:55:16.562689+0000","last_peered":"2023-03-02T10:55:16.562689+0000","last_clean":"2023-03-02T10:55:16.562689+0000","last_became_active":"2023-03-02T10:55:10.154110+0000","last_became_peered":"2023-03-02T10:55:10.154110+0000","last_unstale":"2023-03-02T10:55:16.562689+0000","last_undegraded":"2023-03-02T10:55:16.562689+0000","last_fullsized":"2023-03-02T10:55:16.562689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:11:05.910487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774989+0000","last_change":"2023-03-02T10:55:10.627181+0000","last_active":"2023-03-02T10:55:11.774989+0000","last_peered":"2023-03-02T10:55:11.774989+0000","last_clean":"2023-03-02T10:55:11.774989+0000","last_became_active":"2023-03-02T10:55:10.626891+0000","last_became_peered":"2023-03-02T10:55:10.626891+0000","last_unstale":"2023-03-02T10:55:11.774989+0000","last_undegraded":"2023-03-02T10:55:11.774989+0000","last_fullsized":"2023-03-02T10:55:11.774989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:37.990553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'7","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:15.546968+0000","last_change":"2023-03-02T10:55:10.146146+0000","last_active":"2023-03-02T10:55:15.546968+0000","last_peered":"2023-03-02T10:55:15.546968+0000","last_clean":"2023-03-02T10:55:15.546968+0000","last_became_active":"2023-03-02T10:55:10.145824+0000","last_became_peered":"2023-03-02T10:55:10.145824+0000","last_unstale":"2023-03-02T10:55:15.546968+0000","last_undegraded":"2023-03-02T10:55:15.546968+0000","last_fullsized":"2023-03-02T10:55:15.546968+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:05:35.846016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.638245+0000","last_change":"2023-03-02T10:55:10.636566+0000","last_active":"2023-03-02T10:55:10.638245+0000","last_peered":"2023-03-02T10:55:10.638245+0000","last_clean":"2023-03-02T10:55:10.638245+0000","last_became_active":"2023-03-02T10:55:10.636033+0000","last_became_peered":"2023-03-02T10:55:10.636033+0000","last_unstale":"2023-03-02T10:55:10.638245+0000","last_undegraded":"2023-03-02T10:55:10.638245+0000","last_fullsized":"2023-03-02T10:55:10.638245+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:35:24.955628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:16.562288+0000","last_change":"2023-03-02T10:55:10.156550+0000","last_active":"2023-03-02T10:55:16.562288+0000","last_peered":"2023-03-02T10:55:16.562288+0000","last_clean":"2023-03-02T10:55:16.562288+0000","last_became_active":"2023-03-02T10:55:10.156286+0000","last_became_peered":"2023-03-02T10:55:10.156286+0000","last_unstale":"2023-03-02T10:55:16.562288+0000","last_undegraded":"2023-03-02T10:55:16.562288+0000","last_fullsized":"2023-03-02T10:55:16.562288+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:45:51.476117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774199+0000","last_change":"2023-03-02T10:55:10.631769+0000","last_active":"2023-03-02T10:55:11.774199+0000","last_peered":"2023-03-02T10:55:11.774199+0000","last_clean":"2023-03-02T10:55:11.774199+0000","last_became_active":"2023-03-02T10:55:10.631429+0000","last_became_peered":"2023-03-02T10:55:10.631429+0000","last_unstale":"2023-03-02T10:55:11.774199+0000","last_undegraded":"2023-03-02T10:55:11.774199+0000","last_fullsized":"2023-03-02T10:55:11.774199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:42:52.764994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.524716+0000","last_change":"2023-03-02T10:55:10.152435+0000","last_active":"2023-03-02T10:55:13.524716+0000","last_peered":"2023-03-02T10:55:13.524716+0000","last_clean":"2023-03-02T10:55:13.524716+0000","last_became_active":"2023-03-02T10:55:10.152008+0000","last_became_peered":"2023-03-02T10:55:10.152008+0000","last_unstale":"2023-03-02T10:55:13.524716+0000","last_undegraded":"2023-03-02T10:55:13.524716+0000","last_fullsized":"2023-03-02T10:55:13.524716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:46:39.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774041+0000","last_change":"2023-03-02T10:55:10.624337+0000","last_active":"2023-03-02T10:55:11.774041+0000","last_peered":"2023-03-02T10:55:11.774041+0000","last_clean":"2023-03-02T10:55:11.774041+0000","last_became_active":"2023-03-02T10:55:10.623979+0000","last_became_peered":"2023-03-02T10:55:10.623979+0000","last_unstale":"2023-03-02T10:55:11.774041+0000","last_undegraded":"2023-03-02T10:55:11.774041+0000","last_fullsized":"2023-03-02T10:55:11.774041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:14:39.173460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.524831+0000","last_change":"2023-03-02T10:55:10.152406+0000","last_active":"2023-03-02T10:55:13.524831+0000","last_peered":"2023-03-02T10:55:13.524831+0000","last_clean":"2023-03-02T10:55:13.524831+0000","last_became_active":"2023-03-02T10:55:10.152026+0000","last_became_peered":"2023-03-02T10:55:10.152026+0000","last_unstale":"2023-03-02T10:55:13.524831+0000","last_undegraded":"2023-03-02T10:55:13.524831+0000","last_fullsized":"2023-03-02T10:55:13.524831+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:49:17.617792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.621038+0000","last_change":"2023-03-02T10:55:10.620061+0000","last_active":"2023-03-02T10:55:10.621038+0000","last_peered":"2023-03-02T10:55:10.621038+0000","last_clean":"2023-03-02T10:55:10.621038+0000","last_became_active":"2023-03-02T10:55:10.619753+0000","last_became_peered":"2023-03-02T10:55:10.619753+0000","last_unstale":"2023-03-02T10:55:10.621038+0000","last_undegraded":"2023-03-02T10:55:10.621038+0000","last_fullsized":"2023-03-02T10:55:10.621038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:40:02.479733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'2","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:15.545816+0000","last_change":"2023-03-02T10:55:10.149827+0000","last_active":"2023-03-02T10:55:15.545816+0000","last_peered":"2023-03-02T10:55:15.545816+0000","last_clean":"2023-03-02T10:55:15.545816+0000","last_became_active":"2023-03-02T10:55:10.149522+0000","last_became_peered":"2023-03-02T10:55:10.149522+0000","last_unstale":"2023-03-02T10:55:15.545816+0000","last_undegraded":"2023-03-02T10:55:15.545816+0000","last_fullsized":"2023-03-02T10:55:15.545816+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:23:27.072235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.622639+0000","last_change":"2023-03-02T10:55:10.618992+0000","last_active":"2023-03-02T10:55:10.622639+0000","last_peered":"2023-03-02T10:55:10.622639+0000","last_clean":"2023-03-02T10:55:10.622639+0000","last_became_active":"2023-03-02T10:55:10.618678+0000","last_became_peered":"2023-03-02T10:55:10.618678+0000","last_unstale":"2023-03-02T10:55:10.622639+0000","last_undegraded":"2023-03-02T10:55:10.622639+0000","last_fullsized":"2023-03-02T10:55:10.622639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:33:26.966579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:13.525008+0000","last_change":"2023-03-02T10:55:10.152075+0000","last_active":"2023-03-02T10:55:13.525008+0000","last_peered":"2023-03-02T10:55:13.525008+0000","last_clean":"2023-03-02T10:55:13.525008+0000","last_became_active":"2023-03-02T10:55:10.151781+0000","last_became_peered":"2023-03-02T10:55:10.151781+0000","last_unstale":"2023-03-02T10:55:13.525008+0000","last_undegraded":"2023-03-02T10:55:13.525008+0000","last_fullsized":"2023-03-02T10:55:13.525008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:46:25.506942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.632102+0000","last_change":"2023-03-02T10:55:10.625524+0000","last_active":"2023-03-02T10:55:10.632102+0000","last_peered":"2023-03-02T10:55:10.632102+0000","last_clean":"2023-03-02T10:55:10.632102+0000","last_became_active":"2023-03-02T10:55:10.625249+0000","last_became_peered":"2023-03-02T10:55:10.625249+0000","last_unstale":"2023-03-02T10:55:10.632102+0000","last_undegraded":"2023-03-02T10:55:10.632102+0000","last_fullsized":"2023-03-02T10:55:10.632102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:03:16.230549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:15.547150+0000","last_change":"2023-03-02T10:55:10.159691+0000","last_active":"2023-03-02T10:55:15.547150+0000","last_peered":"2023-03-02T10:55:15.547150+0000","last_clean":"2023-03-02T10:55:15.547150+0000","last_became_active":"2023-03-02T10:55:10.159360+0000","last_became_peered":"2023-03-02T10:55:10.159360+0000","last_unstale":"2023-03-02T10:55:15.547150+0000","last_undegraded":"2023-03-02T10:55:15.547150+0000","last_fullsized":"2023-03-02T10:55:15.547150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:21:05.305932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.622737+0000","last_change":"2023-03-02T10:55:10.621119+0000","last_active":"2023-03-02T10:55:10.622737+0000","last_peered":"2023-03-02T10:55:10.622737+0000","last_clean":"2023-03-02T10:55:10.622737+0000","last_became_active":"2023-03-02T10:55:10.620370+0000","last_became_peered":"2023-03-02T10:55:10.620370+0000","last_unstale":"2023-03-02T10:55:10.622737+0000","last_undegraded":"2023-03-02T10:55:10.622737+0000","last_fullsized":"2023-03-02T10:55:10.622737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:33:20.678615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:16.562710+0000","last_change":"2023-03-02T10:55:10.155403+0000","last_active":"2023-03-02T10:55:16.562710+0000","last_peered":"2023-03-02T10:55:16.562710+0000","last_clean":"2023-03-02T10:55:16.562710+0000","last_became_active":"2023-03-02T10:55:10.152547+0000","last_became_peered":"2023-03-02T10:55:10.152547+0000","last_unstale":"2023-03-02T10:55:16.562710+0000","last_undegraded":"2023-03-02T10:55:16.562710+0000","last_fullsized":"2023-03-02T10:55:16.562710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:18:30.564037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.632260+0000","last_change":"2023-03-02T10:55:10.626243+0000","last_active":"2023-03-02T10:55:10.632260+0000","last_peered":"2023-03-02T10:55:10.632260+0000","last_clean":"2023-03-02T10:55:10.632260+0000","last_became_active":"2023-03-02T10:55:10.625924+0000","last_became_peered":"2023-03-02T10:55:10.625924+0000","last_unstale":"2023-03-02T10:55:10.632260+0000","last_undegraded":"2023-03-02T10:55:10.632260+0000","last_fullsized":"2023-03-02T10:55:10.632260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:03:50.833602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:16.561988+0000","last_change":"2023-03-02T10:55:10.159307+0000","last_active":"2023-03-02T10:55:16.561988+0000","last_peered":"2023-03-02T10:55:16.561988+0000","last_clean":"2023-03-02T10:55:16.561988+0000","last_became_active":"2023-03-02T10:55:10.158979+0000","last_became_peered":"2023-03-02T10:55:10.158979+0000","last_unstale":"2023-03-02T10:55:16.561988+0000","last_undegraded":"2023-03-02T10:55:16.561988+0000","last_fullsized":"2023-03-02T10:55:16.561988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:13:54.984801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633508+0000","last_change":"2023-03-02T10:55:10.630995+0000","last_active":"2023-03-02T10:55:10.633508+0000","last_peered":"2023-03-02T10:55:10.633508+0000","last_clean":"2023-03-02T10:55:10.633508+0000","last_became_active":"2023-03-02T10:55:10.630654+0000","last_became_peered":"2023-03-02T10:55:10.630654+0000","last_unstale":"2023-03-02T10:55:10.633508+0000","last_undegraded":"2023-03-02T10:55:10.633508+0000","last_fullsized":"2023-03-02T10:55:10.633508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:25:50.945152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633911+0000","last_change":"2023-03-02T10:55:10.633263+0000","last_active":"2023-03-02T10:55:10.633911+0000","last_peered":"2023-03-02T10:55:10.633911+0000","last_clean":"2023-03-02T10:55:10.633911+0000","last_became_active":"2023-03-02T10:55:10.632796+0000","last_became_peered":"2023-03-02T10:55:10.632796+0000","last_unstale":"2023-03-02T10:55:10.633911+0000","last_undegraded":"2023-03-02T10:55:10.633911+0000","last_fullsized":"2023-03-02T10:55:10.633911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:04:02.060792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774184+0000","last_change":"2023-03-02T10:55:10.620195+0000","last_active":"2023-03-02T10:55:11.774184+0000","last_peered":"2023-03-02T10:55:11.774184+0000","last_clean":"2023-03-02T10:55:11.774184+0000","last_became_active":"2023-03-02T10:55:10.619904+0000","last_became_peered":"2023-03-02T10:55:10.619904+0000","last_unstale":"2023-03-02T10:55:11.774184+0000","last_undegraded":"2023-03-02T10:55:11.774184+0000","last_fullsized":"2023-03-02T10:55:11.774184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:03:43.176587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774989+0000","last_change":"2023-03-02T10:55:10.619427+0000","last_active":"2023-03-02T10:55:11.774989+0000","last_peered":"2023-03-02T10:55:11.774989+0000","last_clean":"2023-03-02T10:55:11.774989+0000","last_became_active":"2023-03-02T10:55:10.618184+0000","last_became_peered":"2023-03-02T10:55:10.618184+0000","last_unstale":"2023-03-02T10:55:11.774989+0000","last_undegraded":"2023-03-02T10:55:11.774989+0000","last_fullsized":"2023-03-02T10:55:11.774989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:00.907091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774028+0000","last_change":"2023-03-02T10:55:10.630058+0000","last_active":"2023-03-02T10:55:11.774028+0000","last_peered":"2023-03-02T10:55:11.774028+0000","last_clean":"2023-03-02T10:55:11.774028+0000","last_became_active":"2023-03-02T10:55:10.626022+0000","last_became_peered":"2023-03-02T10:55:10.626022+0000","last_unstale":"2023-03-02T10:55:11.774028+0000","last_undegraded":"2023-03-02T10:55:11.774028+0000","last_fullsized":"2023-03-02T10:55:11.774028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:23:27.900984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.775034+0000","last_change":"2023-03-02T10:55:10.621984+0000","last_active":"2023-03-02T10:55:11.775034+0000","last_peered":"2023-03-02T10:55:11.775034+0000","last_clean":"2023-03-02T10:55:11.775034+0000","last_became_active":"2023-03-02T10:55:10.621636+0000","last_became_peered":"2023-03-02T10:55:10.621636+0000","last_unstale":"2023-03-02T10:55:11.775034+0000","last_undegraded":"2023-03-02T10:55:11.775034+0000","last_fullsized":"2023-03-02T10:55:11.775034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:10:41.154358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.633935+0000","last_change":"2023-03-02T10:55:10.633194+0000","last_active":"2023-03-02T10:55:10.633935+0000","last_peered":"2023-03-02T10:55:10.633935+0000","last_clean":"2023-03-02T10:55:10.633935+0000","last_became_active":"2023-03-02T10:55:10.632860+0000","last_became_peered":"2023-03-02T10:55:10.632860+0000","last_unstale":"2023-03-02T10:55:10.633935+0000","last_undegraded":"2023-03-02T10:55:10.633935+0000","last_fullsized":"2023-03-02T10:55:10.633935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:34:58.071830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774379+0000","last_change":"2023-03-02T10:55:10.613717+0000","last_active":"2023-03-02T10:55:11.774379+0000","last_peered":"2023-03-02T10:55:11.774379+0000","last_clean":"2023-03-02T10:55:11.774379+0000","last_became_active":"2023-03-02T10:55:10.613391+0000","last_became_peered":"2023-03-02T10:55:10.613391+0000","last_unstale":"2023-03-02T10:55:11.774379+0000","last_undegraded":"2023-03-02T10:55:11.774379+0000","last_fullsized":"2023-03-02T10:55:11.774379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:51:23.532086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.638619+0000","last_change":"2023-03-02T10:55:10.637730+0000","last_active":"2023-03-02T10:55:10.638619+0000","last_peered":"2023-03-02T10:55:10.638619+0000","last_clean":"2023-03-02T10:55:10.638619+0000","last_became_active":"2023-03-02T10:55:10.637097+0000","last_became_peered":"2023-03-02T10:55:10.637097+0000","last_unstale":"2023-03-02T10:55:10.638619+0000","last_undegraded":"2023-03-02T10:55:10.638619+0000","last_fullsized":"2023-03-02T10:55:10.638619+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:41:19.587933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.615141+0000","last_change":"2023-03-02T10:55:10.617374+0000","last_active":"2023-03-02T10:55:11.615141+0000","last_peered":"2023-03-02T10:55:11.615141+0000","last_clean":"2023-03-02T10:55:11.615141+0000","last_became_active":"2023-03-02T10:55:10.617061+0000","last_became_peered":"2023-03-02T10:55:10.617061+0000","last_unstale":"2023-03-02T10:55:11.615141+0000","last_undegraded":"2023-03-02T10:55:11.615141+0000","last_fullsized":"2023-03-02T10:55:11.615141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:03:41.270487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.623282+0000","last_change":"2023-03-02T10:55:10.622246+0000","last_active":"2023-03-02T10:55:10.623282+0000","last_peered":"2023-03-02T10:55:10.623282+0000","last_clean":"2023-03-02T10:55:10.623282+0000","last_became_active":"2023-03-02T10:55:10.621938+0000","last_became_peered":"2023-03-02T10:55:10.621938+0000","last_unstale":"2023-03-02T10:55:10.623282+0000","last_undegraded":"2023-03-02T10:55:10.623282+0000","last_fullsized":"2023-03-02T10:55:10.623282+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:39:35.605113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.551508+0000","last_change":"2023-03-02T10:55:10.623502+0000","last_active":"2023-03-02T10:55:11.551508+0000","last_peered":"2023-03-02T10:55:11.551508+0000","last_clean":"2023-03-02T10:55:11.551508+0000","last_became_active":"2023-03-02T10:55:10.623160+0000","last_became_peered":"2023-03-02T10:55:10.623160+0000","last_unstale":"2023-03-02T10:55:11.551508+0000","last_undegraded":"2023-03-02T10:55:11.551508+0000","last_fullsized":"2023-03-02T10:55:11.551508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:30:49.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-02T10:55:11.774918+0000","last_change":"2023-03-02T10:55:10.636452+0000","last_active":"2023-03-02T10:55:11.774918+0000","last_peered":"2023-03-02T10:55:11.774918+0000","last_clean":"2023-03-02T10:55:11.774918+0000","last_became_active":"2023-03-02T10:55:10.636176+0000","last_became_peered":"2023-03-02T10:55:10.636176+0000","last_unstale":"2023-03-02T10:55:11.774918+0000","last_undegraded":"2023-03-02T10:55:11.774918+0000","last_fullsized":"2023-03-02T10:55:11.774918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:51.303295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-03-02T10:55:10.623352+0000","last_change":"2023-03-02T10:55:10.621378+0000","last_active":"2023-03-02T10:55:10.623352+0000","last_peered":"2023-03-02T10:55:10.623352+0000","last_clean":"2023-03-02T10:55:10.623352+0000","last_became_active":"2023-03-02T10:55:10.620771+0000","last_became_peered":"2023-03-02T10:55:10.620771+0000","last_unstale":"2023-03-02T10:55:10.623352+0000","last_undegraded":"2023-03-02T10:55:10.623352+0000","last_fullsized":"2023-03-02T10:55:10.623352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:07:55.415801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":254019,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":47102,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":39,"num_read_kb":68,"num_write":203,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":78653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416397,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5944,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739208,"statfs":{"total":95995035648,"available":95988948992,"internally_reserved":0,"allocated":901120,"data_stored":430296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":10,"up_from":71,"seq":304942678033,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6396,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738756,"statfs":{"total":95995035648,"available":95988486144,"internally_reserved":0,"allocated":1036288,"data_stored":1058093,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.753}]},{"osd":3,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.78100000000000003}]},{"osd":9,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.80200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]},{"osd":9,"up_from":66,"seq":283467841557,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6156,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738996,"statfs":{"total":95995035648,"available":95988731904,"internally_reserved":0,"allocated":921600,"data_stored":430622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.504},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.73199999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.79500000000000004}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.81000000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070490,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6356,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738796,"statfs":{"total":95995035648,"available":95988527104,"internally_reserved":0,"allocated":929792,"data_stored":431198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.749},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.69299999999999995}]},{"osd":9,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.90500000000000003}]},{"osd":10,"last update":"Thu Mar 2 10:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.92800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299421,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6388,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738764,"statfs":{"total":95995035648,"available":95988494336,"internally_reserved":0,"allocated":962560,"data_stored":1021874,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84499999999999997,"5min":1.034,"15min":1.034},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29099999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.438},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.41299999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63600000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.77600000000000002,"5min":1.129,"15min":1.129},"last":0.625},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.41699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71499999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.38700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81699999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77600000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.747,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.76500000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.49199999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67400000000000004,"15min":0.67100000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.49399999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73499999999999999}]},{"osd":9,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.754}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.78100000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":6,"up_from":47,"seq":201863462948,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6216,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738936,"statfs":{"total":95995035648,"available":95988670464,"internally_reserved":0,"allocated":917504,"data_stored":430575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.41199999999999998,"15min":0.40100000000000002},"min":{"1min":0.32600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.45200000000000001,"15min":0.44},"min":{"1min":0.36799999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.377}]},{"osd":1,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.55200000000000005,"15min":0.53500000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.624},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.497}]},{"osd":2,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.59799999999999998,"15min":0.57999999999999996},"min":{"1min":0.60199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.52000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.42299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.40300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90600000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.50700000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Mar 2 10:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.67300000000000004,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.439,"15min":0.439},"max":{"1min":1.016,"5min":1.05,"15min":1.05},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.70999999999999996,"15min":0.69399999999999995},"min":{"1min":0.60999999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Mar 2 10:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.73899999999999999,"15min":0.72599999999999998},"min":{"1min":0.57599999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.747,"15min":0.73499999999999999},"min":{"1min":0.629,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73599999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58099999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.56599999999999995}]},{"osd":10,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.75800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7172,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737980,"statfs":{"total":95995035648,"available":95987691520,"internally_reserved":0,"allocated":913408,"data_stored":432282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.496,"15min":0.499},"min":{"1min":0.33600000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Mar 2 10:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Mar 2 10:54:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.379,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.41399999999999998,"15min":0.39900000000000002},"min":{"1min":0.27800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.497,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":1.008}]},{"osd":5,"last update":"Thu Mar 2 10:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90400000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.88},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Mar 2 10:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.98199999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":1.032},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.84399999999999997}]},{"osd":9,"last update":"Thu Mar 2 10:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.077}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.056}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7196,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737956,"statfs":{"total":95995035648,"available":95987666944,"internally_reserved":0,"allocated":937984,"data_stored":431876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 2 10:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.52500000000000002,"15min":0.48299999999999998},"min":{"1min":0.46800000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.53300000000000003,"15min":0.499},"min":{"1min":0.45300000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58499999999999996,"15min":0.54400000000000004},"min":{"1min":0.48599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Mar 2 10:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.41899999999999998},"min":{"1min":0.29099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71199999999999997,"5min":0.755,"15min":0.755},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.432,"15min":0.41399999999999998},"min":{"1min":0.32200000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57199999999999995,"15min":0.55200000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56000000000000005,"15min":0.54300000000000004},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Mar 2 10:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.61899999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75800000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94299999999999995,"5min":1.149,"15min":1.149},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Mar 2 10:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.93200000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.01,"5min":1.171,"15min":1.171},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.47299999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.054,"5min":1.298,"15min":1.298},"last":0.745},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0740000000000001,"5min":1.23,"15min":1.23},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Mar 2 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.72399999999999998}]},{"osd":9,"last update":"Thu Mar 2 10:54:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.623},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.57199999999999995}]},{"osd":10,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.748},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.71599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411382,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7280,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737872,"statfs":{"total":95995035648,"available":95987580928,"internally_reserved":0,"allocated":958464,"data_stored":450957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.496},"min":{"1min":0.375,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.503},"min":{"1min":0.41199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.82899999999999996,"5min":0.874,"15min":0.874},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53400000000000003,"15min":0.51200000000000001},"min":{"1min":0.36299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72199999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.54200000000000004,"15min":0.50800000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Mar 2 10:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.56000000000000005},"min":{"1min":0.46999999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79800000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.57899999999999996},"min":{"1min":0.48499999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.498}]},{"osd":4,"last update":"Thu Mar 2 10:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Mar 2 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.501,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77300000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Mar 2 10:54:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.46600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81000000000000005,"5min":0.871,"15min":0.871},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Mar 2 10:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.6639999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.441},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.60599999999999998}]},{"osd":9,"last update":"Thu Mar 2 10:54:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.66200000000000003}]},{"osd":10,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64600000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":3,"up_from":26,"seq":111669149744,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6464,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738688,"statfs":{"total":95995035648,"available":95988416512,"internally_reserved":0,"allocated":909312,"data_stored":429683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.375,"15min":0.372},"min":{"1min":0.309,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.39900000000000002,"15min":0.38700000000000001},"min":{"1min":0.28199999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.44600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.38}]},{"osd":2,"last update":"Thu Mar 2 10:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78000000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61499999999999999,"15min":0.60599999999999998},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65900000000000003,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Mar 2 10:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.65100000000000002,"15min":0.64100000000000001},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.874,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Mar 2 10:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.375,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83399999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.624}]},{"osd":7,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.80000000000000004,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0029999999999999,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.53400000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.70199999999999996}]},{"osd":8,"last update":"Thu Mar 2 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":6.9539999999999997,"5min":6.9539999999999997,"15min":6.9539999999999997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.76300000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.80300000000000005}]},{"osd":10,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.501},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67200000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888109,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6408,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738744,"statfs":{"total":95995035648,"available":95988473856,"internally_reserved":0,"allocated":917504,"data_stored":430820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65300000000000002,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":5.8860000000000001,"15min":5.8860000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64000000000000001,"15min":0.67400000000000004},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.95599999999999996,"5min":5.577,"15min":5.577},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.36599999999999999,"15min":0.35199999999999998},"min":{"1min":0.27600000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53500000000000003,"15min":0.51900000000000002},"min":{"1min":0.40000000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.55300000000000005,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.35799999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Mar 2 10:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.56299999999999994,"15min":0.54600000000000004},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.42799999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Mar 2 10:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.498,"5min":0.443,"15min":0.443},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.627},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Mar 2 10:54:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.34899999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.39100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64700000000000002}]},{"osd":8,"last update":"Thu Mar 2 10:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.90800000000000003}]},{"osd":9,"last update":"Thu Mar 2 10:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.93100000000000005}]},{"osd":10,"last update":"Thu Mar 2 10:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.69499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":5,"up_from":39,"seq":167503724583,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6544,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738608,"statfs":{"total":95995035648,"available":95988334592,"internally_reserved":0,"allocated":991232,"data_stored":1023052,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":1.51,"15min":1.51},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.56200000000000006},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83899999999999997,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42399999999999999,"15min":0.41799999999999998},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59299999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.85299999999999998}]},{"osd":3,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57099999999999995,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76600000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79600000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97299999999999998,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Mar 2 10:54:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.63600000000000001,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.878},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.52300000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85599999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":1.0289999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":1.0409999999999999}]},{"osd":9,"last update":"Thu Mar 2 10:54:47 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.95499999999999996}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":1}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":21227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":42768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-02T10:55:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-02T10:55:19.548 INFO:tasks.cephadm:Setting up client nodes... 2023-03-02T10:55:19.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-03-02T10:55:19.652 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:55:19 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:55:19.332+0000 7f8db07c6700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-03-02T10:55:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:19 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2994446512' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:19 smithi057 ceph-mon[92072]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:55:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:19 smithi057 ceph-mon[92072]: pgmap v269: 97 pgs: 97 active+clean; 623 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 12 KiB/s wr, 28 op/s 2023-03-02T10:55:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:19 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2994446512' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:19 smithi122 ceph-mon[125440]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:55:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:19 smithi122 ceph-mon[125440]: pgmap v269: 97 pgs: 97 active+clean; 623 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 12 KiB/s wr, 28 op/s 2023-03-02T10:55:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:19 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2994446512' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:19 smithi136 ceph-mon[125702]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:55:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:19 smithi136 ceph-mon[125702]: pgmap v269: 97 pgs: 97 active+clean; 623 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 12 KiB/s wr, 28 op/s 2023-03-02T10:55:20.309 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:20.889 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:20 smithi057 ceph-mon[92072]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:55:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:20 smithi122 ceph-mon[125440]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:55:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:20 smithi136 ceph-mon[125702]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:55:21.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.687+0000 7fca15dcd700 1 -- 172.21.15.57:0/2374032651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10101750 msgr2=0x7fca10108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:21.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.687+0000 7fca15dcd700 1 --2- 172.21.15.57:0/2374032651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10101750 0x7fca10108010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fca0800b0a0 tx=0x7fca0800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:21.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.687+0000 7fca15dcd700 1 -- 172.21.15.57:0/2374032651 shutdown_connections 2023-03-02T10:55:21.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.687+0000 7fca15dcd700 1 --2- 172.21.15.57:0/2374032651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10101750 0x7fca10108010 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:21.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.687+0000 7fca15dcd700 1 --2- 172.21.15.57:0/2374032651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca100ffbd0 0x7fca100fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:21.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.687+0000 7fca15dcd700 1 --2- 172.21.15.57:0/2374032651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca10100dc0 0x7fca10101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:21.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.687+0000 7fca15dcd700 1 -- 172.21.15.57:0/2374032651 >> 172.21.15.57:0/2374032651 conn(0x7fca100fb1b0 msgr2=0x7fca100fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:21.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.687+0000 7fca15dcd700 1 -- 172.21.15.57:0/2374032651 shutdown_connections 2023-03-02T10:55:21.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.687+0000 7fca15dcd700 1 -- 172.21.15.57:0/2374032651 wait complete. 2023-03-02T10:55:21.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.688+0000 7fca15dcd700 1 Processor -- start 2023-03-02T10:55:21.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.688+0000 7fca15dcd700 1 -- start start 2023-03-02T10:55:21.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.688+0000 7fca15dcd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca100ffbd0 0x7fca10074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:21.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.688+0000 7fca15dcd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10100dc0 0x7fca10072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:21.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.688+0000 7fca15dcd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca10101750 0x7fca10072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:21.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.688+0000 7fca15dcd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca10073660 con 0x7fca10100dc0 2023-03-02T10:55:21.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.688+0000 7fca15dcd700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca100737d0 con 0x7fca100ffbd0 2023-03-02T10:55:21.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.688+0000 7fca15dcd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1019fac0 con 0x7fca10101750 2023-03-02T10:55:21.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10100dc0 0x7fca10072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:21.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10100dc0 0x7fca10072980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47986/0 (socket says 172.21.15.57:47986) 2023-03-02T10:55:21.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0effd700 1 -- 172.21.15.57:0/1394088904 learned_addr learned my addr 172.21.15.57:0/1394088904 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:21.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0f7fe700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca100ffbd0 0x7fca10074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:21.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0ffff700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca10101750 0x7fca10072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:21.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0effd700 1 -- 172.21.15.57:0/1394088904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca10101750 msgr2=0x7fca10072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:21.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0effd700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca10101750 0x7fca10072ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:21.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0effd700 1 -- 172.21.15.57:0/1394088904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca100ffbd0 msgr2=0x7fca10074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:21.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0effd700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca100ffbd0 0x7fca10074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:21.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0effd700 1 -- 172.21.15.57:0/1394088904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08009d00 con 0x7fca10100dc0 2023-03-02T10:55:21.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0ffff700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca10101750 0x7fca10072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:21.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0effd700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10100dc0 0x7fca10072980 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fca0400e9a0 tx=0x7fca0400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:21.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0cff9700 1 -- 172.21.15.57:0/1394088904 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04009790 con 0x7fca10100dc0 2023-03-02T10:55:21.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0cff9700 1 -- 172.21.15.57:0/1394088904 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca0400cbd0 con 0x7fca10100dc0 2023-03-02T10:55:21.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca15dcd700 1 -- 172.21.15.57:0/1394088904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1010b590 con 0x7fca10100dc0 2023-03-02T10:55:21.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.689+0000 7fca0cff9700 1 -- 172.21.15.57:0/1394088904 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04018680 con 0x7fca10100dc0 2023-03-02T10:55:21.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.690+0000 7fca15dcd700 1 -- 172.21.15.57:0/1394088904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1010b400 con 0x7fca10100dc0 2023-03-02T10:55:21.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.690+0000 7fca15dcd700 1 -- 172.21.15.57:0/1394088904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca10107120 con 0x7fca10100dc0 2023-03-02T10:55:21.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.692+0000 7fca0cff9700 1 -- 172.21.15.57:0/1394088904 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fca0400c040 con 0x7fca10100dc0 2023-03-02T10:55:21.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.693+0000 7fca0cff9700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc9f809b3e0 0x7fc9f809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.693+0000 7fca0cff9700 1 -- 172.21.15.57:0/1394088904 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fca04014070 con 0x7fca10100dc0 2023-03-02T10:55:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.693+0000 7fca0f7fe700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc9f809b3e0 0x7fc9f809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.693+0000 7fca0f7fe700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc9f809b3e0 0x7fc9f809d890 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fca10100c20 tx=0x7fca00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.697+0000 7fca0cff9700 1 -- 172.21.15.57:0/1394088904 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fca04050800 con 0x7fca10100dc0 2023-03-02T10:55:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:21 smithi057 ceph-mon[92072]: pgmap v270: 97 pgs: 97 active+clean; 623 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 KiB/s wr, 26 op/s 2023-03-02T10:55:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:21 smithi122 ceph-mon[125440]: pgmap v270: 97 pgs: 97 active+clean; 623 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 KiB/s wr, 26 op/s 2023-03-02T10:55:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.972+0000 7fca15dcd700 1 -- 172.21.15.57:0/1394088904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fca10061420 con 0x7fca10100dc0 2023-03-02T10:55:21.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.976+0000 7fca0cff9700 1 -- 172.21.15.57:0/1394088904 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7fca04090ae0 con 0x7fca10100dc0 2023-03-02T10:55:21.978 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2023-03-02T10:55:21.979 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCZgABk+AATOhAAMwV4JUFiTekRMYUL8wPgZA== 2023-03-02T10:55:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.978+0000 7fca15dcd700 1 -- 172.21.15.57:0/1394088904 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc9f809b3e0 msgr2=0x7fc9f809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:21.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.979+0000 7fca15dcd700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc9f809b3e0 0x7fc9f809d890 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fca10100c20 tx=0x7fca00009260 comp rx=0 tx=0).stop 2023-03-02T10:55:21.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.979+0000 7fca15dcd700 1 -- 172.21.15.57:0/1394088904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10100dc0 msgr2=0x7fca10072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:21.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.979+0000 7fca15dcd700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10100dc0 0x7fca10072980 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fca0400e9a0 tx=0x7fca0400ecb0 comp rx=0 tx=0).stop 2023-03-02T10:55:21.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.979+0000 7fca15dcd700 1 -- 172.21.15.57:0/1394088904 shutdown_connections 2023-03-02T10:55:21.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.979+0000 7fca15dcd700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc9f809b3e0 0x7fc9f809d890 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:21.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.979+0000 7fca15dcd700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca10101750 0x7fca10072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:21.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.979+0000 7fca15dcd700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca100ffbd0 0x7fca10074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:21.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.979+0000 7fca15dcd700 1 --2- 172.21.15.57:0/1394088904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10100dc0 0x7fca10072980 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:21.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.979+0000 7fca15dcd700 1 -- 172.21.15.57:0/1394088904 >> 172.21.15.57:0/1394088904 conn(0x7fca100fb1b0 msgr2=0x7fca10104260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:21.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.979+0000 7fca15dcd700 1 -- 172.21.15.57:0/1394088904 shutdown_connections 2023-03-02T10:55:21.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:21.979+0000 7fca15dcd700 1 -- 172.21.15.57:0/1394088904 wait complete. 2023-03-02T10:55:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:21 smithi136 ceph-mon[125702]: pgmap v270: 97 pgs: 97 active+clean; 623 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 KiB/s wr, 26 op/s 2023-03-02T10:55:22.510 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:55:22.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-03-02T10:55:22.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-03-02T10:55:22.576 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-03-02T10:55:22.577 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-03-02T10:55:22.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph mgr dump --format=json 2023-03-02T10:55:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:22 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1394088904' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-03-02T10:55:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:22 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1394088904' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-03-02T10:55:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:22 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1394088904' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-03-02T10:55:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:22 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1394088904' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-03-02T10:55:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:22 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1394088904' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-03-02T10:55:23.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:22 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1394088904' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-03-02T10:55:23.344 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:23.856 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:23 smithi057 ceph-mon[92072]: pgmap v271: 97 pgs: 97 active+clean; 623 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.1 KiB/s wr, 23 op/s 2023-03-02T10:55:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:23 smithi122 ceph-mon[125440]: pgmap v271: 97 pgs: 97 active+clean; 623 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.1 KiB/s wr, 23 op/s 2023-03-02T10:55:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:23 smithi136 ceph-mon[125702]: pgmap v271: 97 pgs: 97 active+clean; 623 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.1 KiB/s wr, 23 op/s 2023-03-02T10:55:24.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.616+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/4082263690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5bc103df0 msgr2=0x7fa5bc10b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:24.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.616+0000 7fa5c3f6c700 1 --2- 172.21.15.57:0/4082263690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5bc103df0 0x7fa5bc10b9c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400b0d0 tx=0x7fa5b400b3e0 comp rx=0 tx=0).stop 2023-03-02T10:55:24.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.616+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/4082263690 shutdown_connections 2023-03-02T10:55:24.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.616+0000 7fa5c3f6c700 1 --2- 172.21.15.57:0/4082263690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5bc103df0 0x7fa5bc10b9c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:24.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.616+0000 7fa5c3f6c700 1 --2- 172.21.15.57:0/4082263690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5bc0fedb0 0x7fa5bc0ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:24.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.616+0000 7fa5c3f6c700 1 --2- 172.21.15.57:0/4082263690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5bc0ff750 0x7fa5bc103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:24.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.617+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/4082263690 >> 172.21.15.57:0/4082263690 conn(0x7fa5bc0fa620 msgr2=0x7fa5bc0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:24.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.617+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/4082263690 shutdown_connections 2023-03-02T10:55:24.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.617+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/4082263690 wait complete. 2023-03-02T10:55:24.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.617+0000 7fa5c3f6c700 1 Processor -- start 2023-03-02T10:55:24.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c3f6c700 1 -- start start 2023-03-02T10:55:24.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c3f6c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5bc0fedb0 0x7fa5bc197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:24.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c3f6c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5bc0ff750 0x7fa5bc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:24.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c3f6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5bc103df0 0x7fa5bc19c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c3f6c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc19ce70 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c3f6c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc19cfe0 con 0x7fa5bc0ff750 2023-03-02T10:55:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c3f6c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc19d1a0 con 0x7fa5bc103df0 2023-03-02T10:55:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c1d08700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5bc0fedb0 0x7fa5bc197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c1d08700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5bc0fedb0 0x7fa5bc197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48002/0 (socket says 172.21.15.57:48002) 2023-03-02T10:55:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c1d08700 1 -- 172.21.15.57:0/1455671978 learned_addr learned my addr 172.21.15.57:0/1455671978 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c1507700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5bc0ff750 0x7fa5bc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c2509700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5bc103df0 0x7fa5bc19c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c1d08700 1 -- 172.21.15.57:0/1455671978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5bc103df0 msgr2=0x7fa5bc19c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c1d08700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5bc103df0 0x7fa5bc19c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c1d08700 1 -- 172.21.15.57:0/1455671978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5bc0ff750 msgr2=0x7fa5bc1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c1d08700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5bc0ff750 0x7fa5bc1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.618+0000 7fa5c1d08700 1 -- 172.21.15.57:0/1455671978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b4009d00 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.619+0000 7fa5c1d08700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5bc0fedb0 0x7fa5bc197e90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800d950 tx=0x7fa5b800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:24.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.619+0000 7fa5b2ffd700 1 -- 172.21.15.57:0/1455671978 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8009940 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.619+0000 7fa5b2ffd700 1 -- 172.21.15.57:0/1455671978 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5b8010460 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.619+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/1455671978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc10ec10 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.619+0000 7fa5b2ffd700 1 -- 172.21.15.57:0/1455671978 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800f620 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.619+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/1455671978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc10ea80 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.620+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/1455671978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc10eda0 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.621+0000 7fa5b2ffd700 1 -- 172.21.15.57:0/1455671978 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fa5b8022070 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.622+0000 7fa5b2ffd700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa5a809b3e0 0x7fa5a809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:24.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.622+0000 7fa5b2ffd700 1 -- 172.21.15.57:0/1455671978 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa5b80c4b50 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.622+0000 7fa5c1507700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa5a809b3e0 0x7fa5a809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:24.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.623+0000 7fa5c1507700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa5a809b3e0 0x7fa5a809d890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc1994a0 tx=0x7fa5ac009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:24.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.626+0000 7fa5b2ffd700 1 -- 172.21.15.57:0/1455671978 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fa5b80905d0 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.879+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/1455671978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa5bc066750 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.884+0000 7fa5b2ffd700 1 -- 172.21.15.57:0/1455671978 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+249882 (secure 0 0 0) 0x7fa5b8020020 con 0x7fa5bc0fedb0 2023-03-02T10:55:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:24.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.887+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/1455671978 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa5a809b3e0 msgr2=0x7fa5a809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:24.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.887+0000 7fa5c3f6c700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa5a809b3e0 0x7fa5a809d890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc1994a0 tx=0x7fa5ac009190 comp rx=0 tx=0).stop 2023-03-02T10:55:24.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.887+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/1455671978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5bc0fedb0 msgr2=0x7fa5bc197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:24.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.887+0000 7fa5c3f6c700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5bc0fedb0 0x7fa5bc197e90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800d950 tx=0x7fa5b800dc60 comp rx=0 tx=0).stop 2023-03-02T10:55:24.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.887+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/1455671978 shutdown_connections 2023-03-02T10:55:24.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.887+0000 7fa5c3f6c700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa5a809b3e0 0x7fa5a809d890 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:24.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.887+0000 7fa5c3f6c700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5bc103df0 0x7fa5bc19c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:24.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.887+0000 7fa5c3f6c700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5bc0fedb0 0x7fa5bc197e90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:24.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.887+0000 7fa5c3f6c700 1 --2- 172.21.15.57:0/1455671978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5bc0ff750 0x7fa5bc1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:24.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.887+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/1455671978 >> 172.21.15.57:0/1455671978 conn(0x7fa5bc0fa620 msgr2=0x7fa5bc068750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:24.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.888+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/1455671978 shutdown_connections 2023-03-02T10:55:24.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:24.888+0000 7fa5c3f6c700 1 -- 172.21.15.57:0/1455671978 wait complete. 2023-03-02T10:55:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:24 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1455671978' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-03-02T10:55:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:24 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1455671978' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-03-02T10:55:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:24 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1455671978' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-03-02T10:55:25.342 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1987811557},{"type":"v1","addr":"172.21.15.57:6801","nonce":1987811557}]},"active_addr":"172.21.15.57:6801/1987811557","active_change":"2023-03-02T10:48:48.779165+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.57:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":3849795987}]},{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":4090317536}]},{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":209440554}]},{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":3364489589}]},{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":3290768138}]}]}} 2023-03-02T10:55:25.349 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-03-02T10:55:25.350 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-03-02T10:55:25.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd dump --format=json 2023-03-02T10:55:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:25 smithi122 ceph-mon[125440]: pgmap v272: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.2 KiB/s wr, 24 op/s 2023-03-02T10:55:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:25 smithi136 ceph-mon[125702]: pgmap v272: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.2 KiB/s wr, 24 op/s 2023-03-02T10:55:26.345 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:25 smithi057 ceph-mon[92072]: pgmap v272: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.2 KiB/s wr, 24 op/s 2023-03-02T10:55:27.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.468+0000 7f6304e9c700 1 -- 172.21.15.57:0/294611239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63000728d0 msgr2=0x7f6300072ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:27.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.468+0000 7f6304e9c700 1 --2- 172.21.15.57:0/294611239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63000728d0 0x7f6300072ca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009990 tx=0x7f62f0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:27.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.468+0000 7f6304e9c700 1 -- 172.21.15.57:0/294611239 shutdown_connections 2023-03-02T10:55:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.468+0000 7f6304e9c700 1 --2- 172.21.15.57:0/294611239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f630010c460 0x7f630010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.468+0000 7f6304e9c700 1 --2- 172.21.15.57:0/294611239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63000728d0 0x7f6300072ca0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.468+0000 7f6304e9c700 1 --2- 172.21.15.57:0/294611239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63000731e0 0x7f630010bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.468+0000 7f6304e9c700 1 -- 172.21.15.57:0/294611239 >> 172.21.15.57:0/294611239 conn(0x7f63000fb6a0 msgr2=0x7f63000fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.468+0000 7f6304e9c700 1 -- 172.21.15.57:0/294611239 shutdown_connections 2023-03-02T10:55:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.468+0000 7f6304e9c700 1 -- 172.21.15.57:0/294611239 wait complete. 2023-03-02T10:55:27.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.469+0000 7f6304e9c700 1 Processor -- start 2023-03-02T10:55:27.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.469+0000 7f6304e9c700 1 -- start start 2023-03-02T10:55:27.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.469+0000 7f6304e9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63000728d0 0x7f6300198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:27.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.469+0000 7f6304e9c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63000731e0 0x7f6300198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:27.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.469+0000 7f6304e9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630010c460 0x7f630019c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:27.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.469+0000 7f6304e9c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630019d010 con 0x7f630010c460 2023-03-02T10:55:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.469+0000 7f6304e9c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630019d180 con 0x7f63000731e0 2023-03-02T10:55:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.469+0000 7f6304e9c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630019d340 con 0x7f63000728d0 2023-03-02T10:55:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62fed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630010c460 0x7f630019c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62fed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630010c460 0x7f630019c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33358/0 (socket says 172.21.15.57:33358) 2023-03-02T10:55:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62fed9d700 1 -- 172.21.15.57:0/738742442 learned_addr learned my addr 172.21.15.57:0/738742442 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62fe59c700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63000728d0 0x7f6300198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62fdd9b700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63000731e0 0x7f6300198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62fed9d700 1 -- 172.21.15.57:0/738742442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63000728d0 msgr2=0x7f6300198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62fed9d700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63000728d0 0x7f6300198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62fed9d700 1 -- 172.21.15.57:0/738742442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63000731e0 msgr2=0x7f6300198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62fed9d700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63000731e0 0x7f6300198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62fed9d700 1 -- 172.21.15.57:0/738742442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f00095f0 con 0x7f630010c460 2023-03-02T10:55:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62fed9d700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630010c460 0x7f630019c9d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009fd0 tx=0x7f62f800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62ef7fe700 1 -- 172.21.15.57:0/738742442 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8018070 con 0x7f630010c460 2023-03-02T10:55:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f6304e9c700 1 -- 172.21.15.57:0/738742442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6300111e80 con 0x7f630010c460 2023-03-02T10:55:27.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62ef7fe700 1 -- 172.21.15.57:0/738742442 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62f800f040 con 0x7f630010c460 2023-03-02T10:55:27.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f62ef7fe700 1 -- 172.21.15.57:0/738742442 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f800cdb0 con 0x7f630010c460 2023-03-02T10:55:27.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.470+0000 7f6304e9c700 1 -- 172.21.15.57:0/738742442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6300111cf0 con 0x7f630010c460 2023-03-02T10:55:27.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.471+0000 7f6304e9c700 1 -- 172.21.15.57:0/738742442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6300112010 con 0x7f630010c460 2023-03-02T10:55:27.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.473+0000 7f62ef7fe700 1 -- 172.21.15.57:0/738742442 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f62f8004ad0 con 0x7f630010c460 2023-03-02T10:55:27.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.474+0000 7f62ef7fe700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f62e809b3e0 0x7f62e809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:27.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.474+0000 7f62ef7fe700 1 -- 172.21.15.57:0/738742442 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f62f80c4b10 con 0x7f630010c460 2023-03-02T10:55:27.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.474+0000 7f62fe59c700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f62e809b3e0 0x7f62e809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:27.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.474+0000 7f62fe59c700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f62e809b3e0 0x7f62e809d890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f62f000b2e0 tx=0x7f62f0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:27.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.478+0000 7f62ef7fe700 1 -- 172.21.15.57:0/738742442 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f62f8090530 con 0x7f630010c460 2023-03-02T10:55:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.674+0000 7f6304e9c700 1 -- 172.21.15.57:0/738742442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6300066750 con 0x7f630010c460 2023-03-02T10:55:27.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.676+0000 7f62ef7fe700 1 -- 172.21.15.57:0/738742442 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22122 (secure 0 0 0) 0x7f62f8093b50 con 0x7f630010c460 2023-03-02T10:55:27.677 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:27.678 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":84,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:11.603333+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:55:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 -- 172.21.15.57:0/738742442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f62e809b3e0 msgr2=0x7f62e809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f62e809b3e0 0x7f62e809d890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f62f000b2e0 tx=0x7f62f0005fb0 comp rx=0 tx=0).stop 2023-03-02T10:55:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 -- 172.21.15.57:0/738742442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630010c460 msgr2=0x7f630019c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630010c460 0x7f630019c9d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009fd0 tx=0x7f62f800ef90 comp rx=0 tx=0).stop 2023-03-02T10:55:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 -- 172.21.15.57:0/738742442 shutdown_connections 2023-03-02T10:55:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f62e809b3e0 0x7f62e809d890 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630010c460 0x7f630019c9d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:27.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63000728d0 0x7f6300198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:27.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 --2- 172.21.15.57:0/738742442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63000731e0 0x7f6300198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:27.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 -- 172.21.15.57:0/738742442 >> 172.21.15.57:0/738742442 conn(0x7f63000fb6a0 msgr2=0x7f630010e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:27.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 -- 172.21.15.57:0/738742442 shutdown_connections 2023-03-02T10:55:27.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:27.678+0000 7f6304e9c700 1 -- 172.21.15.57:0/738742442 wait complete. 2023-03-02T10:55:28.191 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-03-02T10:55:28.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd dump --format=json 2023-03-02T10:55:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:28 smithi057 ceph-mon[92072]: pgmap v273: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.5 KiB/s wr, 22 op/s 2023-03-02T10:55:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:28 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/738742442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:28 smithi136 ceph-mon[125702]: pgmap v273: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.5 KiB/s wr, 22 op/s 2023-03-02T10:55:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:28 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/738742442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:28 smithi122 ceph-mon[125440]: pgmap v273: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.5 KiB/s wr, 22 op/s 2023-03-02T10:55:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:28 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/738742442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:28.925 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:29 smithi057 ceph-mon[92072]: pgmap v274: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 23 op/s 2023-03-02T10:55:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:29 smithi136 ceph-mon[125702]: pgmap v274: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 23 op/s 2023-03-02T10:55:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:29 smithi122 ceph-mon[125440]: pgmap v274: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 23 op/s 2023-03-02T10:55:30.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.192+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/3046733011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbf40feae0 msgr2=0x7fdbf40fef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:30.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.192+0000 7fdbfb3d1700 1 --2- 172.21.15.57:0/3046733011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbf40feae0 0x7fdbf40fef50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009990 tx=0x7fdbe4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.192+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/3046733011 shutdown_connections 2023-03-02T10:55:30.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.192+0000 7fdbfb3d1700 1 --2- 172.21.15.57:0/3046733011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf40ff490 0x7fdbf410b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.192+0000 7fdbfb3d1700 1 --2- 172.21.15.57:0/3046733011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbf4104af0 0x7fdbf4104ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.192+0000 7fdbfb3d1700 1 --2- 172.21.15.57:0/3046733011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbf40feae0 0x7fdbf40fef50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.193+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/3046733011 >> 172.21.15.57:0/3046733011 conn(0x7fdbf4075c50 msgr2=0x7fdbf4076050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.193+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/3046733011 shutdown_connections 2023-03-02T10:55:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.193+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/3046733011 wait complete. 2023-03-02T10:55:30.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.193+0000 7fdbfb3d1700 1 Processor -- start 2023-03-02T10:55:30.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.193+0000 7fdbfb3d1700 1 -- start start 2023-03-02T10:55:30.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbfb3d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbf40feae0 0x7fdbf4195ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:30.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbfb3d1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbf40ff490 0x7fdbf4196220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:30.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbfb3d1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf4104af0 0x7fdbf41995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:30.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbfb3d1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4199bd0 con 0x7fdbf40feae0 2023-03-02T10:55:30.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbfb3d1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4199d40 con 0x7fdbf4104af0 2023-03-02T10:55:30.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbfb3d1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4199f00 con 0x7fdbf40ff490 2023-03-02T10:55:30.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf916d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbf40feae0 0x7fdbf4195ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:30.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf916d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbf40feae0 0x7fdbf4195ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33382/0 (socket says 172.21.15.57:33382) 2023-03-02T10:55:30.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf916d700 1 -- 172.21.15.57:0/2474078869 learned_addr learned my addr 172.21.15.57:0/2474078869 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:30.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf996e700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf4104af0 0x7fdbf41995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:30.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf896c700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbf40ff490 0x7fdbf4196220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf916d700 1 -- 172.21.15.57:0/2474078869 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbf40ff490 msgr2=0x7fdbf4196220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf916d700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbf40ff490 0x7fdbf4196220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf916d700 1 -- 172.21.15.57:0/2474078869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf4104af0 msgr2=0x7fdbf41995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf916d700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf4104af0 0x7fdbf41995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf916d700 1 -- 172.21.15.57:0/2474078869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe40095f0 con 0x7fdbf40feae0 2023-03-02T10:55:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf996e700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf4104af0 0x7fdbf41995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.194+0000 7fdbf896c700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbf40ff490 0x7fdbf4196220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.195+0000 7fdbf916d700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbf40feae0 0x7fdbf4195ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000c920 tx=0x7fdbf000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:30.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.195+0000 7fdbea7fc700 1 -- 172.21.15.57:0/2474078869 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0007b00 con 0x7fdbf40feae0 2023-03-02T10:55:30.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.195+0000 7fdbea7fc700 1 -- 172.21.15.57:0/2474078869 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbf0004cf0 con 0x7fdbf40feae0 2023-03-02T10:55:30.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.195+0000 7fdbea7fc700 1 -- 172.21.15.57:0/2474078869 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0005610 con 0x7fdbf40feae0 2023-03-02T10:55:30.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.195+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/2474078869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf410ebd0 con 0x7fdbf40feae0 2023-03-02T10:55:30.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.195+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/2474078869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf410ea40 con 0x7fdbf40feae0 2023-03-02T10:55:30.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.196+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/2474078869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf410ed60 con 0x7fdbf40feae0 2023-03-02T10:55:30.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.197+0000 7fdbea7fc700 1 -- 172.21.15.57:0/2474078869 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fdbf0007c60 con 0x7fdbf40feae0 2023-03-02T10:55:30.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.198+0000 7fdbea7fc700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdbe009b3e0 0x7fdbe009d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:30.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.198+0000 7fdbea7fc700 1 -- 172.21.15.57:0/2474078869 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdbf00c4ff0 con 0x7fdbf40feae0 2023-03-02T10:55:30.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.198+0000 7fdbf896c700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdbe009b3e0 0x7fdbe009d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:30.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.199+0000 7fdbf896c700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdbe009b3e0 0x7fdbe009d890 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdbf41972b0 tx=0x7fdbe4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:30.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.202+0000 7fdbea7fc700 1 -- 172.21.15.57:0/2474078869 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fdbf0090980 con 0x7fdbf40feae0 2023-03-02T10:55:30.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.403+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/2474078869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbf41a2de0 con 0x7fdbf40feae0 2023-03-02T10:55:30.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.405+0000 7fdbea7fc700 1 -- 172.21.15.57:0/2474078869 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22122 (secure 0 0 0) 0x7fdbf001d030 con 0x7fdbf40feae0 2023-03-02T10:55:30.406 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:55:30.406 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":84,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:11.603333+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:55:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/2474078869 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdbe009b3e0 msgr2=0x7fdbe009d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdbe009b3e0 0x7fdbe009d890 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdbf41972b0 tx=0x7fdbe4005fb0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/2474078869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbf40feae0 msgr2=0x7fdbf4195ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbf40feae0 0x7fdbf4195ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000c920 tx=0x7fdbf000cce0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/2474078869 shutdown_connections 2023-03-02T10:55:30.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdbe009b3e0 0x7fdbe009d890 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf4104af0 0x7fdbf41995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbf40feae0 0x7fdbf4195ce0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 --2- 172.21.15.57:0/2474078869 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbf40ff490 0x7fdbf4196220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:30.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/2474078869 >> 172.21.15.57:0/2474078869 conn(0x7fdbf4075c50 msgr2=0x7fdbf40686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:30.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/2474078869 shutdown_connections 2023-03-02T10:55:30.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:30.407+0000 7fdbfb3d1700 1 -- 172.21.15.57:0/2474078869 wait complete. 2023-03-02T10:55:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:30 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2474078869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:30.826 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2023-03-02T10:55:30.826 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2023-03-02T10:55:30.827 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2023-03-02T10:55:30.827 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2023-03-02T10:55:30.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2023-03-02T10:55:30.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2023-03-02T10:55:30.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2023-03-02T10:55:30.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2023-03-02T10:55:30.830 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2023-03-02T10:55:30.830 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2023-03-02T10:55:30.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2023-03-02T10:55:30.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2023-03-02T10:55:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:30 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2474078869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:30.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:30 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2474078869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:55:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:31 smithi136 ceph-mon[125702]: pgmap v275: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-03-02T10:55:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:31 smithi057 ceph-mon[92072]: pgmap v275: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-03-02T10:55:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:31 smithi122 ceph-mon[125440]: pgmap v275: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-03-02T10:55:32.755 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:32.909 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:32.910 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:33.102 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:33.103 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:33.333 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:33.333 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:33.638 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:33.955 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:34.576 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:34 smithi057 ceph-mon[92072]: pgmap v276: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-03-02T10:55:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:34 smithi136 ceph-mon[125702]: pgmap v276: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-03-02T10:55:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:34 smithi122 ceph-mon[125440]: pgmap v276: 97 pgs: 97 active+clean; 633 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-03-02T10:55:35.024 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:35.024 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:36 smithi136 ceph-mon[125702]: pgmap v277: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-03-02T10:55:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:36 smithi057 ceph-mon[92072]: pgmap v277: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-03-02T10:55:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:36 smithi122 ceph-mon[125440]: pgmap v277: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-03-02T10:55:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.743+0000 7f74185d4700 1 -- 172.21.15.57:0/839247893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74100ffe30 msgr2=0x7f7410100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.743+0000 7f74185d4700 1 --2- 172.21.15.57:0/839247893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74100ffe30 0x7f7410100200 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f740c0099c0 tx=0x7f740c009cd0 comp rx=0 tx=0).stop 2023-03-02T10:55:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.743+0000 7f74185d4700 1 -- 172.21.15.57:0/839247893 shutdown_connections 2023-03-02T10:55:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.743+0000 7f74185d4700 1 --2- 172.21.15.57:0/839247893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7410104e70 0x7f741010ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.743+0000 7f74185d4700 1 --2- 172.21.15.57:0/839247893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74100ffe30 0x7f7410100200 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:36.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.743+0000 7f74185d4700 1 --2- 172.21.15.57:0/839247893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74101007d0 0x7f7410104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:36.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.743+0000 7f74185d4700 1 -- 172.21.15.57:0/839247893 >> 172.21.15.57:0/839247893 conn(0x7f74100fb6a0 msgr2=0x7f74100fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:36.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.743+0000 7f74185d4700 1 -- 172.21.15.57:0/839247893 shutdown_connections 2023-03-02T10:55:36.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.743+0000 7f74185d4700 1 -- 172.21.15.57:0/839247893 wait complete. 2023-03-02T10:55:36.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f74185d4700 1 Processor -- start 2023-03-02T10:55:36.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f74185d4700 1 -- start start 2023-03-02T10:55:36.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f74185d4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74100ffe30 0x7f7410195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:36.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f74185d4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74101007d0 0x7f7410196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:36.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f74185d4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7410104e70 0x7f741019a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:36.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f74185d4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741019adf0 con 0x7f74100ffe30 2023-03-02T10:55:36.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f74185d4700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741019af60 con 0x7f7410104e70 2023-03-02T10:55:36.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f74185d4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741019b120 con 0x7f74101007d0 2023-03-02T10:55:36.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f7416370700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74100ffe30 0x7f7410195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:36.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f7416370700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74100ffe30 0x7f7410195e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36788/0 (socket says 172.21.15.57:36788) 2023-03-02T10:55:36.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f7416370700 1 -- 172.21.15.57:0/3894979485 learned_addr learned my addr 172.21.15.57:0/3894979485 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:36.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.744+0000 7f7415b6f700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74101007d0 0x7f7410196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:36.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f7416b71700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7410104e70 0x7f741019a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:36.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f7416370700 1 -- 172.21.15.57:0/3894979485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74101007d0 msgr2=0x7f7410196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:36.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f7416370700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74101007d0 0x7f7410196350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:36.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f7416370700 1 -- 172.21.15.57:0/3894979485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7410104e70 msgr2=0x7f741019a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:36.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f7416370700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7410104e70 0x7f741019a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:36.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f7416370700 1 -- 172.21.15.57:0/3894979485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c0095f0 con 0x7f74100ffe30 2023-03-02T10:55:36.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f7415b6f700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74101007d0 0x7f7410196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:36.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f7416370700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74100ffe30 0x7f7410195e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f740c004730 tx=0x7f740c004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:36.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f74077fe700 1 -- 172.21.15.57:0/3894979485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c01d070 con 0x7f74100ffe30 2023-03-02T10:55:36.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f74077fe700 1 -- 172.21.15.57:0/3894979485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f740c003f90 con 0x7f74100ffe30 2023-03-02T10:55:36.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f74185d4700 1 -- 172.21.15.57:0/3894979485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741010fc90 con 0x7f74100ffe30 2023-03-02T10:55:36.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.745+0000 7f74077fe700 1 -- 172.21.15.57:0/3894979485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c00fcc0 con 0x7f74100ffe30 2023-03-02T10:55:36.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.746+0000 7f74185d4700 1 -- 172.21.15.57:0/3894979485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741010fb00 con 0x7f74100ffe30 2023-03-02T10:55:36.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.747+0000 7f74185d4700 1 -- 172.21.15.57:0/3894979485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74100fcb60 con 0x7f74100ffe30 2023-03-02T10:55:36.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.748+0000 7f74077fe700 1 -- 172.21.15.57:0/3894979485 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f740c028030 con 0x7f74100ffe30 2023-03-02T10:55:36.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.749+0000 7f74077fe700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f73fc09b3e0 0x7f73fc09d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:36.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.749+0000 7f74077fe700 1 -- 172.21.15.57:0/3894979485 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f740c0c5b90 con 0x7f74100ffe30 2023-03-02T10:55:36.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.749+0000 7f7415b6f700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f73fc09b3e0 0x7f73fc09d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:36.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.750+0000 7f74077fe700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576] conn(0x7f73fc0a4bb0 0x7f73fc0a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:36.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.750+0000 7f74077fe700 1 -- 172.21.15.57:0/3894979485 --> [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73fc0a7670 con 0x7f73fc0a4bb0 2023-03-02T10:55:36.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.750+0000 7f74077fe700 1 -- 172.21.15.57:0/3894979485 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f740c0ca2a0 con 0x7f74100ffe30 2023-03-02T10:55:36.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.750+0000 7f7416b71700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576] conn(0x7f73fc0a4bb0 0x7f73fc0a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:36.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.750+0000 7f7415b6f700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f73fc09b3e0 0x7f73fc09d890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7410197420 tx=0x7f740000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:36.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.750+0000 7f7416b71700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576] conn(0x7f73fc0a4bb0 0x7f73fc0a6fc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:36.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.751+0000 7f74077fe700 1 -- 172.21.15.57:0/3894979485 <== osd.10 v2:172.21.15.122:6824/2262114576 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f73fc0a7670 con 0x7f73fc0a4bb0 2023-03-02T10:55:36.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.768+0000 7f74185d4700 1 -- 172.21.15.57:0/3894979485 --> [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f741010fe20 con 0x7f73fc0a4bb0 2023-03-02T10:55:36.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.769+0000 7f74077fe700 1 -- 172.21.15.57:0/3894979485 <== osd.10 v2:172.21.15.122:6824/2262114576 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f741010fe20 con 0x7f73fc0a4bb0 2023-03-02T10:55:36.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.770+0000 7f74185d4700 1 -- 172.21.15.57:0/3894979485 >> [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576] conn(0x7f73fc0a4bb0 msgr2=0x7f73fc0a6fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:36.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.770+0000 7f74185d4700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576] conn(0x7f73fc0a4bb0 0x7f73fc0a6fc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:36.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.770+0000 7f74185d4700 1 -- 172.21.15.57:0/3894979485 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f73fc09b3e0 msgr2=0x7f73fc09d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:36.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.770+0000 7f74185d4700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f73fc09b3e0 0x7f73fc09d890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7410197420 tx=0x7f740000a300 comp rx=0 tx=0).stop 2023-03-02T10:55:36.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.770+0000 7f74185d4700 1 -- 172.21.15.57:0/3894979485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74100ffe30 msgr2=0x7f7410195e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:36.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.770+0000 7f74185d4700 1 --2- 172.21.15.57:0/3894979485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74100ffe30 0x7f7410195e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f740c004730 tx=0x7f740c004760 comp rx=0 tx=0).stop 2023-03-02T10:55:36.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.770+0000 7f7416b71700 1 -- 172.21.15.57:0/3894979485 reap_dead start 2023-03-02T10:55:36.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.770+0000 7f74185d4700 1 -- 172.21.15.57:0/3894979485 shutdown_connections 2023-03-02T10:55:36.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.770+0000 7f74185d4700 1 -- 172.21.15.57:0/3894979485 >> 172.21.15.57:0/3894979485 conn(0x7f74100fb6a0 msgr2=0x7f74100fc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:36.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.770+0000 7f74185d4700 1 -- 172.21.15.57:0/3894979485 shutdown_connections 2023-03-02T10:55:36.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:36.770+0000 7f74185d4700 1 -- 172.21.15.57:0/3894979485 wait complete. 2023-03-02T10:55:38.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.916+0000 7f46fbfcf700 1 -- 172.21.15.57:0/3998518550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f4100e10 msgr2=0x7f46f41011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:38.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.916+0000 7f46fbfcf700 1 --2- 172.21.15.57:0/3998518550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f4100e10 0x7f46f41011e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009990 tx=0x7f46f0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:38.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.916+0000 7f46fbfcf700 1 -- 172.21.15.57:0/3998518550 shutdown_connections 2023-03-02T10:55:38.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.916+0000 7f46fbfcf700 1 --2- 172.21.15.57:0/3998518550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f410a1f0 0x7f46f410c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:38.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.916+0000 7f46fbfcf700 1 --2- 172.21.15.57:0/3998518550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f4100e10 0x7f46f41011e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:38.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.916+0000 7f46fbfcf700 1 --2- 172.21.15.57:0/3998518550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4101720 0x7f46f4109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:38.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.916+0000 7f46fbfcf700 1 -- 172.21.15.57:0/3998518550 >> 172.21.15.57:0/3998518550 conn(0x7f46f40fa620 msgr2=0x7f46f40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:38.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.916+0000 7f46fbfcf700 1 -- 172.21.15.57:0/3998518550 shutdown_connections 2023-03-02T10:55:38.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.916+0000 7f46fbfcf700 1 -- 172.21.15.57:0/3998518550 wait complete. 2023-03-02T10:55:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.917+0000 7f46fbfcf700 1 Processor -- start 2023-03-02T10:55:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.917+0000 7f46fbfcf700 1 -- start start 2023-03-02T10:55:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.917+0000 7f46fbfcf700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4100e10 0x7f46f4197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.917+0000 7f46fbfcf700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f4101720 0x7f46f4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.917+0000 7f46fbfcf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f410a1f0 0x7f46f419c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.917+0000 7f46fbfcf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f419cee0 con 0x7f46f410a1f0 2023-03-02T10:55:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fbfcf700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f419d050 con 0x7f46f4100e10 2023-03-02T10:55:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fbfcf700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f419d210 con 0x7f46f4101720 2023-03-02T10:55:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fa56c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f410a1f0 0x7f46f419c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fa56c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f410a1f0 0x7f46f419c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36802/0 (socket says 172.21.15.57:36802) 2023-03-02T10:55:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fa56c700 1 -- 172.21.15.57:0/2691110090 learned_addr learned my addr 172.21.15.57:0/2691110090 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46f9d6b700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4100e10 0x7f46f4197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46f956a700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f4101720 0x7f46f4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fa56c700 1 -- 172.21.15.57:0/2691110090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f4101720 msgr2=0x7f46f4198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fa56c700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f4101720 0x7f46f4198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fa56c700 1 -- 172.21.15.57:0/2691110090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4100e10 msgr2=0x7f46f4197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fa56c700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4100e10 0x7f46f4197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fa56c700 1 -- 172.21.15.57:0/2691110090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f00095f0 con 0x7f46f410a1f0 2023-03-02T10:55:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fa56c700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f410a1f0 0x7f46f419c8a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00ef30 tx=0x7f46ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46eaffd700 1 -- 172.21.15.57:0/2691110090 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec018070 con 0x7f46f410a1f0 2023-03-02T10:55:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.918+0000 7f46fbfcf700 1 -- 172.21.15.57:0/2691110090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f410fd00 con 0x7f46f410a1f0 2023-03-02T10:55:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.919+0000 7f46eaffd700 1 -- 172.21.15.57:0/2691110090 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46ec00f040 con 0x7f46f410a1f0 2023-03-02T10:55:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.919+0000 7f46eaffd700 1 -- 172.21.15.57:0/2691110090 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec00cd00 con 0x7f46f410a1f0 2023-03-02T10:55:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.919+0000 7f46fbfcf700 1 -- 172.21.15.57:0/2691110090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f410fb70 con 0x7f46f410a1f0 2023-03-02T10:55:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.919+0000 7f46fbfcf700 1 -- 172.21.15.57:0/2691110090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46f40fc530 con 0x7f46f410a1f0 2023-03-02T10:55:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.921+0000 7f46eaffd700 1 -- 172.21.15.57:0/2691110090 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f46ec003a00 con 0x7f46f410a1f0 2023-03-02T10:55:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.922+0000 7f46eaffd700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f46e009b460 0x7f46e009d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.922+0000 7f46eaffd700 1 -- 172.21.15.57:0/2691110090 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f46ec0c5710 con 0x7f46f410a1f0 2023-03-02T10:55:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.922+0000 7f46eaffd700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212] conn(0x7f46e00a4c30 0x7f46e00a7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.922+0000 7f46f9d6b700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f46e009b460 0x7f46e009d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.922+0000 7f46eaffd700 1 -- 172.21.15.57:0/2691110090 --> [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46e00a76f0 con 0x7f46e00a4c30 2023-03-02T10:55:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.922+0000 7f46eaffd700 1 -- 172.21.15.57:0/2691110090 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46ec0c5b70 con 0x7f46f410a1f0 2023-03-02T10:55:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.923+0000 7f46f956a700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212] conn(0x7f46e00a4c30 0x7f46e00a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.923+0000 7f46f9d6b700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f46e009b460 0x7f46e009d910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f46f000b2e0 tx=0x7f46f0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.923+0000 7f46f956a700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212] conn(0x7f46e00a4c30 0x7f46e00a7040 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.924+0000 7f46eaffd700 1 -- 172.21.15.57:0/2691110090 <== osd.2 v2:172.21.15.136:6800/3723258212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f46e00a76f0 con 0x7f46e00a4c30 2023-03-02T10:55:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.942+0000 7f46fbfcf700 1 -- 172.21.15.57:0/2691110090 --> [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46f410fe90 con 0x7f46e00a4c30 2023-03-02T10:55:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.943+0000 7f46eaffd700 1 -- 172.21.15.57:0/2691110090 <== osd.2 v2:172.21.15.136:6800/3723258212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f46f410fe90 con 0x7f46e00a4c30 2023-03-02T10:55:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.943+0000 7f46fbfcf700 1 -- 172.21.15.57:0/2691110090 >> [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212] conn(0x7f46e00a4c30 msgr2=0x7f46e00a7040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.943+0000 7f46fbfcf700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212] conn(0x7f46e00a4c30 0x7f46e00a7040 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.943+0000 7f46fbfcf700 1 -- 172.21.15.57:0/2691110090 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f46e009b460 msgr2=0x7f46e009d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.943+0000 7f46fbfcf700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f46e009b460 0x7f46e009d910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f46f000b2e0 tx=0x7f46f0005fb0 comp rx=0 tx=0).stop 2023-03-02T10:55:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.943+0000 7f46fbfcf700 1 -- 172.21.15.57:0/2691110090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f410a1f0 msgr2=0x7f46f419c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.943+0000 7f46fbfcf700 1 --2- 172.21.15.57:0/2691110090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f410a1f0 0x7f46f419c8a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00ef30 tx=0x7f46ec00c3a0 comp rx=0 tx=0).stop 2023-03-02T10:55:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.943+0000 7f46fa56c700 1 -- 172.21.15.57:0/2691110090 reap_dead start 2023-03-02T10:55:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.944+0000 7f46fbfcf700 1 -- 172.21.15.57:0/2691110090 shutdown_connections 2023-03-02T10:55:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.944+0000 7f46fbfcf700 1 -- 172.21.15.57:0/2691110090 >> 172.21.15.57:0/2691110090 conn(0x7f46f40fa620 msgr2=0x7f46f410c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.944+0000 7f46fbfcf700 1 -- 172.21.15.57:0/2691110090 shutdown_connections 2023-03-02T10:55:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:37.944+0000 7f46fbfcf700 1 -- 172.21.15.57:0/2691110090 wait complete. 2023-03-02T10:55:38.545 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:38 smithi057 ceph-mon[92072]: pgmap v278: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 426 B/s wr, 10 op/s 2023-03-02T10:55:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:38 smithi136 ceph-mon[125702]: pgmap v278: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 426 B/s wr, 10 op/s 2023-03-02T10:55:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:38 smithi122 ceph-mon[125440]: pgmap v278: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 426 B/s wr, 10 op/s 2023-03-02T10:55:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.019+0000 7f15497f5700 1 -- 172.21.15.57:0/2092396818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f154410a240 msgr2=0x7f154410c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.019+0000 7f15497f5700 1 --2- 172.21.15.57:0/2092396818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f154410a240 0x7f154410c680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f153c00b0a0 tx=0x7f153c00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.019+0000 7f15497f5700 1 -- 172.21.15.57:0/2092396818 shutdown_connections 2023-03-02T10:55:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.019+0000 7f15497f5700 1 --2- 172.21.15.57:0/2092396818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f154410a240 0x7f154410c680 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.019+0000 7f15497f5700 1 --2- 172.21.15.57:0/2092396818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1544100e70 0x7f1544101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.019+0000 7f15497f5700 1 --2- 172.21.15.57:0/2092396818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1544101780 0x7f1544109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.019+0000 7f15497f5700 1 -- 172.21.15.57:0/2092396818 >> 172.21.15.57:0/2092396818 conn(0x7f15440fa620 msgr2=0x7f15440fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.019+0000 7f15497f5700 1 -- 172.21.15.57:0/2092396818 shutdown_connections 2023-03-02T10:55:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.019+0000 7f15497f5700 1 -- 172.21.15.57:0/2092396818 wait complete. 2023-03-02T10:55:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.019+0000 7f15497f5700 1 Processor -- start 2023-03-02T10:55:39.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.019+0000 7f15497f5700 1 -- start start 2023-03-02T10:55:39.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f15497f5700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1544100e70 0x7f1544195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:39.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f15497f5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1544101780 0x7f1544196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:39.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f15497f5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f154410a240 0x7f154419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:39.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f15497f5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154419adb0 con 0x7f1544101780 2023-03-02T10:55:39.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f15497f5700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154419af20 con 0x7f1544100e70 2023-03-02T10:55:39.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f15497f5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154419b0e0 con 0x7f154410a240 2023-03-02T10:55:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f153bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1544101780 0x7f1544196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f153bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1544101780 0x7f1544196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36822/0 (socket says 172.21.15.57:36822) 2023-03-02T10:55:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f153bfff700 1 -- 172.21.15.57:0/3463026451 learned_addr learned my addr 172.21.15.57:0/3463026451 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f1542ffd700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1544100e70 0x7f1544195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f15437fe700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f154410a240 0x7f154419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f153bfff700 1 -- 172.21.15.57:0/3463026451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f154410a240 msgr2=0x7f154419a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f153bfff700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f154410a240 0x7f154419a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f153bfff700 1 -- 172.21.15.57:0/3463026451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1544100e70 msgr2=0x7f1544195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f153bfff700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1544100e70 0x7f1544195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f153bfff700 1 -- 172.21.15.57:0/3463026451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c009d00 con 0x7f1544101780 2023-03-02T10:55:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f15437fe700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f154410a240 0x7f154419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.020+0000 7f153bfff700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1544101780 0x7f1544196310 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f152c00d980 tx=0x7f152c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.021+0000 7f1540ff9700 1 -- 172.21.15.57:0/3463026451 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c004220 con 0x7f1544101780 2023-03-02T10:55:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.021+0000 7f15497f5700 1 -- 172.21.15.57:0/3463026451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154410fd10 con 0x7f1544101780 2023-03-02T10:55:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.021+0000 7f1540ff9700 1 -- 172.21.15.57:0/3463026451 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f152c007640 con 0x7f1544101780 2023-03-02T10:55:39.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.021+0000 7f1540ff9700 1 -- 172.21.15.57:0/3463026451 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c005610 con 0x7f1544101780 2023-03-02T10:55:39.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.021+0000 7f15497f5700 1 -- 172.21.15.57:0/3463026451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154410fb80 con 0x7f1544101780 2023-03-02T10:55:39.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.021+0000 7f15497f5700 1 -- 172.21.15.57:0/3463026451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1544060c90 con 0x7f1544101780 2023-03-02T10:55:39.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.023+0000 7f1540ff9700 1 -- 172.21.15.57:0/3463026451 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f152c021070 con 0x7f1544101780 2023-03-02T10:55:39.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.024+0000 7f1540ff9700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f153009b3e0 0x7f153009d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:39.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.024+0000 7f1540ff9700 1 -- 172.21.15.57:0/3463026451 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f152c0c5260 con 0x7f1544101780 2023-03-02T10:55:39.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.024+0000 7f1542ffd700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f153009b3e0 0x7f153009d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:39.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.024+0000 7f1540ff9700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841] conn(0x7f15300a4bb0 0x7f15300a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:39.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.024+0000 7f1540ff9700 1 -- 172.21.15.57:0/3463026451 --> [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15300a7670 con 0x7f15300a4bb0 2023-03-02T10:55:39.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.024+0000 7f1540ff9700 1 -- 172.21.15.57:0/3463026451 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f152c0c55d0 con 0x7f1544101780 2023-03-02T10:55:39.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.024+0000 7f15437fe700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841] conn(0x7f15300a4bb0 0x7f15300a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:39.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.024+0000 7f1542ffd700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f153009b3e0 0x7f153009d890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1534005950 tx=0x7f153400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:39.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.025+0000 7f15437fe700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841] conn(0x7f15300a4bb0 0x7f15300a6fc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:39.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.025+0000 7f1540ff9700 1 -- 172.21.15.57:0/3463026451 <== osd.3 v2:172.21.15.57:6810/137683841 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f15300a7670 con 0x7f15300a4bb0 2023-03-02T10:55:39.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.041+0000 7f15497f5700 1 -- 172.21.15.57:0/3463026451 --> [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f154410fea0 con 0x7f15300a4bb0 2023-03-02T10:55:39.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f1540ff9700 1 -- 172.21.15.57:0/3463026451 <== osd.3 v2:172.21.15.57:6810/137683841 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f154410fea0 con 0x7f15300a4bb0 2023-03-02T10:55:39.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f15497f5700 1 -- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841] conn(0x7f15300a4bb0 msgr2=0x7f15300a6fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f15497f5700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841] conn(0x7f15300a4bb0 0x7f15300a6fc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f15497f5700 1 -- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f153009b3e0 msgr2=0x7f153009d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f15497f5700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f153009b3e0 0x7f153009d890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1534005950 tx=0x7f153400b410 comp rx=0 tx=0).stop 2023-03-02T10:55:39.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f15497f5700 1 -- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1544101780 msgr2=0x7f1544196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f15497f5700 1 --2- 172.21.15.57:0/3463026451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1544101780 0x7f1544196310 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f152c00d980 tx=0x7f152c00dc90 comp rx=0 tx=0).stop 2023-03-02T10:55:39.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f15437fe700 1 -- 172.21.15.57:0/3463026451 reap_dead start 2023-03-02T10:55:39.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f15497f5700 1 -- 172.21.15.57:0/3463026451 shutdown_connections 2023-03-02T10:55:39.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f15497f5700 1 -- 172.21.15.57:0/3463026451 >> 172.21.15.57:0/3463026451 conn(0x7f15440fa620 msgr2=0x7f1544101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:39.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f15497f5700 1 -- 172.21.15.57:0/3463026451 shutdown_connections 2023-03-02T10:55:39.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.042+0000 7f15497f5700 1 -- 172.21.15.57:0/3463026451 wait complete. 2023-03-02T10:55:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.693+0000 7ff31c366700 1 -- 172.21.15.57:0/4157161997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff314100e10 msgr2=0x7ff3141011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.693+0000 7ff31c366700 1 --2- 172.21.15.57:0/4157161997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff314100e10 0x7ff3141011e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff310009990 tx=0x7ff310009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.693+0000 7ff31c366700 1 -- 172.21.15.57:0/4157161997 shutdown_connections 2023-03-02T10:55:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.693+0000 7ff31c366700 1 --2- 172.21.15.57:0/4157161997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff31410a1f0 0x7ff31410c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.693+0000 7ff31c366700 1 --2- 172.21.15.57:0/4157161997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff314100e10 0x7ff3141011e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.693+0000 7ff31c366700 1 --2- 172.21.15.57:0/4157161997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff314101720 0x7ff314109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.693+0000 7ff31c366700 1 -- 172.21.15.57:0/4157161997 >> 172.21.15.57:0/4157161997 conn(0x7ff3140fa620 msgr2=0x7ff3140fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.693+0000 7ff31c366700 1 -- 172.21.15.57:0/4157161997 shutdown_connections 2023-03-02T10:55:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.693+0000 7ff31c366700 1 -- 172.21.15.57:0/4157161997 wait complete. 2023-03-02T10:55:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.693+0000 7ff31c366700 1 Processor -- start 2023-03-02T10:55:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31c366700 1 -- start start 2023-03-02T10:55:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31c366700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314100e10 0x7ff314195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31c366700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff314101720 0x7ff3141961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31c366700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff31410a1f0 0x7ff3141995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31c366700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff314199ba0 con 0x7ff31410a1f0 2023-03-02T10:55:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31c366700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff314199d10 con 0x7ff314100e10 2023-03-02T10:55:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31c366700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff314199ed0 con 0x7ff314101720 2023-03-02T10:55:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31a903700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff31410a1f0 0x7ff3141995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31a903700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff31410a1f0 0x7ff3141995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36846/0 (socket says 172.21.15.57:36846) 2023-03-02T10:55:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31a903700 1 -- 172.21.15.57:0/2298768728 learned_addr learned my addr 172.21.15.57:0/2298768728 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:39.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff319901700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff314101720 0x7ff3141961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:39.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31a102700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314100e10 0x7ff314195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:39.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31a903700 1 -- 172.21.15.57:0/2298768728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff314101720 msgr2=0x7ff3141961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31a903700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff314101720 0x7ff3141961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31a903700 1 -- 172.21.15.57:0/2298768728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314100e10 msgr2=0x7ff314195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31a903700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314100e10 0x7ff314195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31a903700 1 -- 172.21.15.57:0/2298768728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3100095f0 con 0x7ff31410a1f0 2023-03-02T10:55:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.694+0000 7ff31a102700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314100e10 0x7ff314195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.695+0000 7ff31a903700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff31410a1f0 0x7ff3141995a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00ef30 tx=0x7ff30c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.695+0000 7ff30b7fe700 1 -- 172.21.15.57:0/2298768728 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c018070 con 0x7ff31410a1f0 2023-03-02T10:55:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.695+0000 7ff30b7fe700 1 -- 172.21.15.57:0/2298768728 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff30c00f040 con 0x7ff31410a1f0 2023-03-02T10:55:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.695+0000 7ff31c366700 1 -- 172.21.15.57:0/2298768728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31410fd00 con 0x7ff31410a1f0 2023-03-02T10:55:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.695+0000 7ff30b7fe700 1 -- 172.21.15.57:0/2298768728 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c00cdb0 con 0x7ff31410a1f0 2023-03-02T10:55:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.695+0000 7ff31c366700 1 -- 172.21.15.57:0/2298768728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31410fb70 con 0x7ff31410a1f0 2023-03-02T10:55:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.696+0000 7ff31c366700 1 -- 172.21.15.57:0/2298768728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff314060c90 con 0x7ff31410a1f0 2023-03-02T10:55:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.697+0000 7ff30b7fe700 1 -- 172.21.15.57:0/2298768728 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7ff30c003a00 con 0x7ff31410a1f0 2023-03-02T10:55:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.698+0000 7ff30b7fe700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff30009b460 0x7ff30009d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.698+0000 7ff31a102700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff30009b460 0x7ff30009d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.698+0000 7ff30b7fe700 1 -- 172.21.15.57:0/2298768728 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff30c0c54f0 con 0x7ff31410a1f0 2023-03-02T10:55:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.699+0000 7ff30b7fe700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996] conn(0x7ff3000a4c30 0x7ff3000a7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.699+0000 7ff30b7fe700 1 -- 172.21.15.57:0/2298768728 --> [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3000a76f0 con 0x7ff3000a4c30 2023-03-02T10:55:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.699+0000 7ff30b7fe700 1 -- 172.21.15.57:0/2298768728 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff30c0c5860 con 0x7ff31410a1f0 2023-03-02T10:55:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.699+0000 7ff31a102700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff30009b460 0x7ff30009d910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff31000b2e0 tx=0x7ff310005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.699+0000 7ff319901700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996] conn(0x7ff3000a4c30 0x7ff3000a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.699+0000 7ff319901700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996] conn(0x7ff3000a4c30 0x7ff3000a7040 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.700+0000 7ff30b7fe700 1 -- 172.21.15.57:0/2298768728 <== osd.4 v2:172.21.15.122:6808/2152605996 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7ff3000a76f0 con 0x7ff3000a4c30 2023-03-02T10:55:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.716+0000 7ff31c366700 1 -- 172.21.15.57:0/2298768728 --> [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff31410fe90 con 0x7ff3000a4c30 2023-03-02T10:55:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff30b7fe700 1 -- 172.21.15.57:0/2298768728 <== osd.4 v2:172.21.15.122:6808/2152605996 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff31410fe90 con 0x7ff3000a4c30 2023-03-02T10:55:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff31c366700 1 -- 172.21.15.57:0/2298768728 >> [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996] conn(0x7ff3000a4c30 msgr2=0x7ff3000a7040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff31c366700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996] conn(0x7ff3000a4c30 0x7ff3000a7040 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff31c366700 1 -- 172.21.15.57:0/2298768728 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff30009b460 msgr2=0x7ff30009d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff31c366700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff30009b460 0x7ff30009d910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff31000b2e0 tx=0x7ff310005c00 comp rx=0 tx=0).stop 2023-03-02T10:55:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff31c366700 1 -- 172.21.15.57:0/2298768728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff31410a1f0 msgr2=0x7ff3141995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff31c366700 1 --2- 172.21.15.57:0/2298768728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff31410a1f0 0x7ff3141995a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00ef30 tx=0x7ff30c00c3a0 comp rx=0 tx=0).stop 2023-03-02T10:55:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff31a903700 1 -- 172.21.15.57:0/2298768728 reap_dead start 2023-03-02T10:55:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff31c366700 1 -- 172.21.15.57:0/2298768728 shutdown_connections 2023-03-02T10:55:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff31c366700 1 -- 172.21.15.57:0/2298768728 >> 172.21.15.57:0/2298768728 conn(0x7ff3140fa620 msgr2=0x7ff314101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff31c366700 1 -- 172.21.15.57:0/2298768728 shutdown_connections 2023-03-02T10:55:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:39.717+0000 7ff31c366700 1 -- 172.21.15.57:0/2298768728 wait complete. 2023-03-02T10:55:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:39 smithi136 ceph-mon[125702]: pgmap v279: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-02T10:55:39.857 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:39 smithi057 ceph-mon[92072]: pgmap v279: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-02T10:55:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:39 smithi122 ceph-mon[125440]: pgmap v279: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-02T10:55:40.612 INFO:teuthology.orchestra.run.smithi057.stdout:304942678037 2023-03-02T10:55:40.612 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.10 2023-03-02T10:55:41.017 INFO:teuthology.orchestra.run.smithi057.stdout:77309411387 2023-03-02T10:55:41.017 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.2 2023-03-02T10:55:41.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.280+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/1362053425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa19c100e10 msgr2=0x7fa19c1011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:41.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.280+0000 7fa1a3ce8700 1 --2- 172.21.15.57:0/1362053425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa19c100e10 0x7fa19c1011e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa198009990 tx=0x7fa198009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:41.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.280+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/1362053425 shutdown_connections 2023-03-02T10:55:41.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.280+0000 7fa1a3ce8700 1 --2- 172.21.15.57:0/1362053425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa19c10a1f0 0x7fa19c10c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:41.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.280+0000 7fa1a3ce8700 1 --2- 172.21.15.57:0/1362053425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa19c100e10 0x7fa19c1011e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:41.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.280+0000 7fa1a3ce8700 1 --2- 172.21.15.57:0/1362053425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa19c101720 0x7fa19c109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:41.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.280+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/1362053425 >> 172.21.15.57:0/1362053425 conn(0x7fa19c0fa620 msgr2=0x7fa19c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:41.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.281+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/1362053425 shutdown_connections 2023-03-02T10:55:41.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.281+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/1362053425 wait complete. 2023-03-02T10:55:41.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.281+0000 7fa1a3ce8700 1 Processor -- start 2023-03-02T10:55:41.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.281+0000 7fa1a3ce8700 1 -- start start 2023-03-02T10:55:41.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a3ce8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa19c100e10 0x7fa19c0fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:41.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a3ce8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa19c101720 0x7fa19c0fefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:41.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a3ce8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa19c10a1f0 0x7fa19c1a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:41.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a3ce8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0ff7d0 con 0x7fa19c101720 2023-03-02T10:55:41.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a3ce8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c1a4460 con 0x7fa19c10a1f0 2023-03-02T10:55:41.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a3ce8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c1a45a0 con 0x7fa19c100e10 2023-03-02T10:55:41.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a1283700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa19c101720 0x7fa19c0fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:41.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a1283700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa19c101720 0x7fa19c0fefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36868/0 (socket says 172.21.15.57:36868) 2023-03-02T10:55:41.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a1283700 1 -- 172.21.15.57:0/3720118096 learned_addr learned my addr 172.21.15.57:0/3720118096 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:41.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a1a84700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa19c100e10 0x7fa19c0fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:41.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a2285700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa19c10a1f0 0x7fa19c1a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:41.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a1283700 1 -- 172.21.15.57:0/3720118096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa19c100e10 msgr2=0x7fa19c0fea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:41.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a1283700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa19c100e10 0x7fa19c0fea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:41.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a1283700 1 -- 172.21.15.57:0/3720118096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa19c10a1f0 msgr2=0x7fa19c1a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:41.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a1283700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa19c10a1f0 0x7fa19c1a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:41.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.282+0000 7fa1a1283700 1 -- 172.21.15.57:0/3720118096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1980095f0 con 0x7fa19c101720 2023-03-02T10:55:41.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.283+0000 7fa1a1283700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa19c101720 0x7fa19c0fefa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00d950 tx=0x7fa18c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:41.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.283+0000 7fa192ffd700 1 -- 172.21.15.57:0/3720118096 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c009b40 con 0x7fa19c101720 2023-03-02T10:55:41.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.283+0000 7fa192ffd700 1 -- 172.21.15.57:0/3720118096 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa18c009ca0 con 0x7fa19c101720 2023-03-02T10:55:41.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.283+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/3720118096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c10fcc0 con 0x7fa19c101720 2023-03-02T10:55:41.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.283+0000 7fa192ffd700 1 -- 172.21.15.57:0/3720118096 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00f620 con 0x7fa19c101720 2023-03-02T10:55:41.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.283+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/3720118096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c10fb30 con 0x7fa19c101720 2023-03-02T10:55:41.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.284+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/3720118096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa19c060c10 con 0x7fa19c101720 2023-03-02T10:55:41.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.285+0000 7fa192ffd700 1 -- 172.21.15.57:0/3720118096 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fa18c018030 con 0x7fa19c101720 2023-03-02T10:55:41.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.286+0000 7fa192ffd700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa18809b3e0 0x7fa18809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:41.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.286+0000 7fa192ffd700 1 -- 172.21.15.57:0/3720118096 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa18c0c5150 con 0x7fa19c101720 2023-03-02T10:55:41.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.286+0000 7fa1a1a84700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa18809b3e0 0x7fa18809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:41.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.286+0000 7fa192ffd700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718] conn(0x7fa1880a4bb0 0x7fa1880a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:41.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.286+0000 7fa192ffd700 1 -- 172.21.15.57:0/3720118096 --> [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1880a7670 con 0x7fa1880a4bb0 2023-03-02T10:55:41.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.286+0000 7fa192ffd700 1 -- 172.21.15.57:0/3720118096 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa18c0c55b0 con 0x7fa19c101720 2023-03-02T10:55:41.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.287+0000 7fa1a2285700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718] conn(0x7fa1880a4bb0 0x7fa1880a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:41.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.287+0000 7fa1a1a84700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa18809b3e0 0x7fa18809d890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa198006010 tx=0x7fa19800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:41.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.287+0000 7fa1a2285700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718] conn(0x7fa1880a4bb0 0x7fa1880a6fc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:41.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.288+0000 7fa192ffd700 1 -- 172.21.15.57:0/3720118096 <== osd.9 v2:172.21.15.57:6826/1053351718 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fa1880a7670 con 0x7fa1880a4bb0 2023-03-02T10:55:41.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.305+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/3720118096 --> [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa19c10fe50 con 0x7fa1880a4bb0 2023-03-02T10:55:41.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.305+0000 7fa192ffd700 1 -- 172.21.15.57:0/3720118096 <== osd.9 v2:172.21.15.57:6826/1053351718 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa19c10fe50 con 0x7fa1880a4bb0 2023-03-02T10:55:41.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.305+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718] conn(0x7fa1880a4bb0 msgr2=0x7fa1880a6fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:41.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.305+0000 7fa1a3ce8700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718] conn(0x7fa1880a4bb0 0x7fa1880a6fc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:41.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.305+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa18809b3e0 msgr2=0x7fa18809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:41.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.305+0000 7fa1a3ce8700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa18809b3e0 0x7fa18809d890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa198006010 tx=0x7fa19800b540 comp rx=0 tx=0).stop 2023-03-02T10:55:41.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.305+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa19c101720 msgr2=0x7fa19c0fefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:41.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.305+0000 7fa1a3ce8700 1 --2- 172.21.15.57:0/3720118096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa19c101720 0x7fa19c0fefa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00d950 tx=0x7fa18c00dd10 comp rx=0 tx=0).stop 2023-03-02T10:55:41.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.305+0000 7fa1a2285700 1 -- 172.21.15.57:0/3720118096 reap_dead start 2023-03-02T10:55:41.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.306+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/3720118096 shutdown_connections 2023-03-02T10:55:41.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.306+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/3720118096 >> 172.21.15.57:0/3720118096 conn(0x7fa19c0fa620 msgr2=0x7fa19c101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:41.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.306+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/3720118096 shutdown_connections 2023-03-02T10:55:41.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:41.306+0000 7fa1a3ce8700 1 -- 172.21.15.57:0/3720118096 wait complete. 2023-03-02T10:55:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:111669149749 2023-03-02T10:55:41.460 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.3 2023-03-02T10:55:42.411 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:42 smithi057 ceph-mon[92072]: pgmap v280: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2023-03-02T10:55:42.563 INFO:teuthology.orchestra.run.smithi057.stdout:146028888114 2023-03-02T10:55:42.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.4 2023-03-02T10:55:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:42 smithi136 ceph-mon[125702]: pgmap v280: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2023-03-02T10:55:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:42 smithi122 ceph-mon[125440]: pgmap v280: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2023-03-02T10:55:42.748 INFO:teuthology.orchestra.run.smithi057.stdout:283467841563 2023-03-02T10:55:42.748 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.9 2023-03-02T10:55:43.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.078+0000 7f2965f67700 1 -- 172.21.15.57:0/68118340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2960100e10 msgr2=0x7f29601011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.078+0000 7f2965f67700 1 --2- 172.21.15.57:0/68118340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2960100e10 0x7f29601011e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2950009990 tx=0x7f2950009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.078+0000 7f2965f67700 1 -- 172.21.15.57:0/68118340 shutdown_connections 2023-03-02T10:55:43.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.078+0000 7f2965f67700 1 --2- 172.21.15.57:0/68118340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296010a1f0 0x7f296010c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.078+0000 7f2965f67700 1 --2- 172.21.15.57:0/68118340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2960100e10 0x7f29601011e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.078+0000 7f2965f67700 1 --2- 172.21.15.57:0/68118340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2960101720 0x7f2960109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.078+0000 7f2965f67700 1 -- 172.21.15.57:0/68118340 >> 172.21.15.57:0/68118340 conn(0x7f29600fa620 msgr2=0x7f29600fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:43.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.078+0000 7f2965f67700 1 -- 172.21.15.57:0/68118340 shutdown_connections 2023-03-02T10:55:43.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.078+0000 7f2965f67700 1 -- 172.21.15.57:0/68118340 wait complete. 2023-03-02T10:55:43.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.079+0000 7f2965f67700 1 Processor -- start 2023-03-02T10:55:43.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.079+0000 7f2965f67700 1 -- start start 2023-03-02T10:55:43.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.080+0000 7f2965f67700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2960100e10 0x7f29600fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.080+0000 7f2965f67700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2960101720 0x7f29600fefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.080+0000 7f2965f67700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296010a1f0 0x7f29601a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.080+0000 7f2965f67700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29600ff840 con 0x7f2960101720 2023-03-02T10:55:43.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.080+0000 7f2965f67700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29601a44d0 con 0x7f296010a1f0 2023-03-02T10:55:43.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.080+0000 7f2965f67700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29601a4610 con 0x7f2960100e10 2023-03-02T10:55:43.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.080+0000 7f295effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2960101720 0x7f29600fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.080+0000 7f295effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2960101720 0x7f29600fefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36892/0 (socket says 172.21.15.57:36892) 2023-03-02T10:55:43.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.080+0000 7f295effd700 1 -- 172.21.15.57:0/1475402011 learned_addr learned my addr 172.21.15.57:0/1475402011 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:43.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.081+0000 7f295ffff700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296010a1f0 0x7f29601a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.081+0000 7f295effd700 1 -- 172.21.15.57:0/1475402011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2960100e10 msgr2=0x7f29600fea60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-02T10:55:43.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.081+0000 7f295effd700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2960100e10 0x7f29600fea60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.081+0000 7f295effd700 1 -- 172.21.15.57:0/1475402011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296010a1f0 msgr2=0x7f29601a3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.081+0000 7f295effd700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f296010a1f0 0x7f29601a3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.081+0000 7f295effd700 1 -- 172.21.15.57:0/1475402011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500095f0 con 0x7f2960101720 2023-03-02T10:55:43.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.081+0000 7f295effd700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2960101720 0x7f29600fefa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f295400e9f0 tx=0x7f295400edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:43.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.082+0000 7f295cff9700 1 -- 172.21.15.57:0/1475402011 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295400cbd0 con 0x7f2960101720 2023-03-02T10:55:43.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.082+0000 7f2965f67700 1 -- 172.21.15.57:0/1475402011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296010fcd0 con 0x7f2960101720 2023-03-02T10:55:43.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.082+0000 7f295cff9700 1 -- 172.21.15.57:0/1475402011 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f295400cd30 con 0x7f2960101720 2023-03-02T10:55:43.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.082+0000 7f295cff9700 1 -- 172.21.15.57:0/1475402011 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954010430 con 0x7f2960101720 2023-03-02T10:55:43.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.082+0000 7f2965f67700 1 -- 172.21.15.57:0/1475402011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296010fb40 con 0x7f2960101720 2023-03-02T10:55:43.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.083+0000 7f2965f67700 1 -- 172.21.15.57:0/1475402011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29600fc530 con 0x7f2960101720 2023-03-02T10:55:43.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.084+0000 7f295cff9700 1 -- 172.21.15.57:0/1475402011 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f295401e020 con 0x7f2960101720 2023-03-02T10:55:43.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.085+0000 7f295cff9700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f294809b460 0x7f294809d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.085+0000 7f295cff9700 1 -- 172.21.15.57:0/1475402011 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2954014070 con 0x7f2960101720 2023-03-02T10:55:43.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.085+0000 7f295f7fe700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f294809b460 0x7f294809d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.086+0000 7f295cff9700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277] conn(0x7f29480a4c30 0x7f29480a7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.086+0000 7f295cff9700 1 -- 172.21.15.57:0/1475402011 --> [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29480a76f0 con 0x7f29480a4c30 2023-03-02T10:55:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.086+0000 7f295cff9700 1 -- 172.21.15.57:0/1475402011 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29540c5c30 con 0x7f2960101720 2023-03-02T10:55:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.086+0000 7f295ffff700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277] conn(0x7f29480a4c30 0x7f29480a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.086+0000 7f295f7fe700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f294809b460 0x7f294809d910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f29500098e0 tx=0x7f2950000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.086+0000 7f295ffff700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277] conn(0x7f29480a4c30 0x7f29480a7040 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.087+0000 7f295cff9700 1 -- 172.21.15.57:0/1475402011 <== osd.8 v2:172.21.15.136:6816/4084154277 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f29480a76f0 con 0x7f29480a4c30 2023-03-02T10:55:43.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.105+0000 7f2965f67700 1 -- 172.21.15.57:0/1475402011 --> [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f296010fe60 con 0x7f29480a4c30 2023-03-02T10:55:43.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.105+0000 7f295cff9700 1 -- 172.21.15.57:0/1475402011 <== osd.8 v2:172.21.15.136:6816/4084154277 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f296010fe60 con 0x7f29480a4c30 2023-03-02T10:55:43.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.106+0000 7f2965f67700 1 -- 172.21.15.57:0/1475402011 >> [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277] conn(0x7f29480a4c30 msgr2=0x7f29480a7040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.106+0000 7f2965f67700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277] conn(0x7f29480a4c30 0x7f29480a7040 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.106+0000 7f2965f67700 1 -- 172.21.15.57:0/1475402011 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f294809b460 msgr2=0x7f294809d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.106+0000 7f2965f67700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f294809b460 0x7f294809d910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f29500098e0 tx=0x7f2950000bc0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.106+0000 7f2965f67700 1 -- 172.21.15.57:0/1475402011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2960101720 msgr2=0x7f29600fefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.106+0000 7f2965f67700 1 --2- 172.21.15.57:0/1475402011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2960101720 0x7f29600fefa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f295400e9f0 tx=0x7f295400edb0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.106+0000 7f295ffff700 1 -- 172.21.15.57:0/1475402011 reap_dead start 2023-03-02T10:55:43.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.106+0000 7f2965f67700 1 -- 172.21.15.57:0/1475402011 shutdown_connections 2023-03-02T10:55:43.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.106+0000 7f2965f67700 1 -- 172.21.15.57:0/1475402011 >> 172.21.15.57:0/1475402011 conn(0x7f29600fa620 msgr2=0x7f296010c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:43.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.106+0000 7f2965f67700 1 -- 172.21.15.57:0/1475402011 shutdown_connections 2023-03-02T10:55:43.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.106+0000 7f2965f67700 1 -- 172.21.15.57:0/1475402011 wait complete. 2023-03-02T10:55:43.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.353+0000 7f662ef07700 1 -- 172.21.15.57:0/2615643322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f662810c400 msgr2=0x7f662810e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.353+0000 7f662ef07700 1 --2- 172.21.15.57:0/2615643322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f662810c400 0x7f662810e7e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f662000b0a0 tx=0x7f662000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.353+0000 7f662ef07700 1 -- 172.21.15.57:0/2615643322 shutdown_connections 2023-03-02T10:55:43.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.353+0000 7f662ef07700 1 --2- 172.21.15.57:0/2615643322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f662810c400 0x7f662810e7e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.353+0000 7f662ef07700 1 --2- 172.21.15.57:0/2615643322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6628072930 0x7f6628072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.353+0000 7f662ef07700 1 --2- 172.21.15.57:0/2615643322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6628073240 0x7f662810bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.353+0000 7f662ef07700 1 -- 172.21.15.57:0/2615643322 >> 172.21.15.57:0/2615643322 conn(0x7f66280fb6a0 msgr2=0x7f66280fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:43.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.353+0000 7f662ef07700 1 -- 172.21.15.57:0/2615643322 shutdown_connections 2023-03-02T10:55:43.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.353+0000 7f662ef07700 1 -- 172.21.15.57:0/2615643322 wait complete. 2023-03-02T10:55:43.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.354+0000 7f662ef07700 1 Processor -- start 2023-03-02T10:55:43.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.354+0000 7f662ef07700 1 -- start start 2023-03-02T10:55:43.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.354+0000 7f662ef07700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6628072930 0x7f6628197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.354+0000 7f662ef07700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6628073240 0x7f66281984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.354+0000 7f662ef07700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f662810c400 0x7f662819c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.354+0000 7f662ef07700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662819cf90 con 0x7f662810c400 2023-03-02T10:55:43.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.354+0000 7f662ef07700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662819d100 con 0x7f6628072930 2023-03-02T10:55:43.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.354+0000 7f662ef07700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662819d2c0 con 0x7f6628073240 2023-03-02T10:55:43.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f662cca3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6628072930 0x7f6628197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f662d4a4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f662810c400 0x7f662819c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f662cca3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6628072930 0x7f6628197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:49982/0 (socket says 172.21.15.57:49982) 2023-03-02T10:55:43.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f6627fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6628073240 0x7f66281984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f662cca3700 1 -- 172.21.15.57:0/3293091256 learned_addr learned my addr 172.21.15.57:0/3293091256 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:43.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f662cca3700 1 -- 172.21.15.57:0/3293091256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6628073240 msgr2=0x7f66281984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f662cca3700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6628073240 0x7f66281984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f662cca3700 1 -- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f662810c400 msgr2=0x7f662819c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f662cca3700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f662810c400 0x7f662819c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f662cca3700 1 -- 172.21.15.57:0/3293091256 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6620009d00 con 0x7f6628072930 2023-03-02T10:55:43.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f662d4a4700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f662810c400 0x7f662819c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:43.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.355+0000 7f662cca3700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6628072930 0x7f6628197fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f661c00d950 tx=0x7f661c00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:43.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.356+0000 7f6625ffb700 1 -- 172.21.15.57:0/3293091256 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00f890 con 0x7f6628072930 2023-03-02T10:55:43.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.356+0000 7f662ef07700 1 -- 172.21.15.57:0/3293091256 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6628111df0 con 0x7f6628072930 2023-03-02T10:55:43.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.356+0000 7f6625ffb700 1 -- 172.21.15.57:0/3293091256 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f661c010460 con 0x7f6628072930 2023-03-02T10:55:43.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.356+0000 7f662ef07700 1 -- 172.21.15.57:0/3293091256 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6628111c60 con 0x7f6628072930 2023-03-02T10:55:43.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.356+0000 7f6625ffb700 1 -- 172.21.15.57:0/3293091256 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00e610 con 0x7f6628072930 2023-03-02T10:55:43.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.357+0000 7f662ef07700 1 -- 172.21.15.57:0/3293091256 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f660c000ff0 con 0x7f6628072930 2023-03-02T10:55:43.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.361+0000 7f6625ffb700 1 -- 172.21.15.57:0/3293091256 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f661c018030 con 0x7f6628072930 2023-03-02T10:55:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.362+0000 7f6625ffb700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f661809b4e0 0x7f661809d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.362+0000 7f6625ffb700 1 -- 172.21.15.57:0/3293091256 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f661c0c4df0 con 0x7f6628072930 2023-03-02T10:55:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.362+0000 7f6625ffb700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280] conn(0x7f66180a4cb0 0x7f66180a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.362+0000 7f6625ffb700 1 -- 172.21.15.57:0/3293091256 --> [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66180a7770 con 0x7f66180a4cb0 2023-03-02T10:55:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.362+0000 7f6625ffb700 1 -- 172.21.15.57:0/3293091256 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f661c0c51a0 con 0x7f6628072930 2023-03-02T10:55:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.362+0000 7f6627fff700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f661809b4e0 0x7f661809d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.362+0000 7f662d4a4700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280] conn(0x7f66180a4cb0 0x7f66180a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.363+0000 7f662d4a4700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280] conn(0x7f66180a4cb0 0x7f66180a70c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.363+0000 7f6627fff700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f661809b4e0 0x7f661809d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f66281995c0 tx=0x7f661400b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:43.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.364+0000 7f6625ffb700 1 -- 172.21.15.57:0/3293091256 <== osd.6 v2:172.21.15.57:6818/2002099280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f66180a7770 con 0x7f66180a4cb0 2023-03-02T10:55:43.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.381+0000 7f662ef07700 1 -- 172.21.15.57:0/3293091256 --> [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f660c002d70 con 0x7f66180a4cb0 2023-03-02T10:55:43.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.381+0000 7f6625ffb700 1 -- 172.21.15.57:0/3293091256 <== osd.6 v2:172.21.15.57:6818/2002099280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f660c002d70 con 0x7f66180a4cb0 2023-03-02T10:55:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.382+0000 7f662ef07700 1 -- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280] conn(0x7f66180a4cb0 msgr2=0x7f66180a70c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.382+0000 7f662ef07700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280] conn(0x7f66180a4cb0 0x7f66180a70c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.382+0000 7f662ef07700 1 -- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f661809b4e0 msgr2=0x7f661809d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.382+0000 7f662ef07700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f661809b4e0 0x7f661809d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f66281995c0 tx=0x7f661400b3c0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.382+0000 7f662ef07700 1 -- 172.21.15.57:0/3293091256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6628072930 msgr2=0x7f6628197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.382+0000 7f662ef07700 1 --2- 172.21.15.57:0/3293091256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6628072930 0x7f6628197fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f661c00d950 tx=0x7f661c00dc60 comp rx=0 tx=0).stop 2023-03-02T10:55:43.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.382+0000 7f662d4a4700 1 -- 172.21.15.57:0/3293091256 reap_dead start 2023-03-02T10:55:43.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.382+0000 7f662ef07700 1 -- 172.21.15.57:0/3293091256 shutdown_connections 2023-03-02T10:55:43.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.382+0000 7f662ef07700 1 -- 172.21.15.57:0/3293091256 >> 172.21.15.57:0/3293091256 conn(0x7f66280fb6a0 msgr2=0x7f6628103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:43.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.382+0000 7f662ef07700 1 -- 172.21.15.57:0/3293091256 shutdown_connections 2023-03-02T10:55:43.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.382+0000 7f662ef07700 1 -- 172.21.15.57:0/3293091256 wait complete. 2023-03-02T10:55:43.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.612+0000 7f9fadbcf700 1 -- 172.21.15.57:0/514610129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa8104e70 msgr2=0x7f9fa810ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.612+0000 7f9fadbcf700 1 --2- 172.21.15.57:0/514610129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa8104e70 0x7f9fa810ca40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000b0d0 tx=0x7f9fa000b3e0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.613+0000 7f9fadbcf700 1 -- 172.21.15.57:0/514610129 shutdown_connections 2023-03-02T10:55:43.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.613+0000 7f9fadbcf700 1 --2- 172.21.15.57:0/514610129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa8104e70 0x7f9fa810ca40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.613+0000 7f9fadbcf700 1 --2- 172.21.15.57:0/514610129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fa80ffe30 0x7f9fa8100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.613+0000 7f9fadbcf700 1 --2- 172.21.15.57:0/514610129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fa81007d0 0x7f9fa8104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.613+0000 7f9fadbcf700 1 -- 172.21.15.57:0/514610129 >> 172.21.15.57:0/514610129 conn(0x7f9fa80fb6a0 msgr2=0x7f9fa80fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:43.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.613+0000 7f9fadbcf700 1 -- 172.21.15.57:0/514610129 shutdown_connections 2023-03-02T10:55:43.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.613+0000 7f9fadbcf700 1 -- 172.21.15.57:0/514610129 wait complete. 2023-03-02T10:55:43.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.613+0000 7f9fadbcf700 1 Processor -- start 2023-03-02T10:55:43.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9fadbcf700 1 -- start start 2023-03-02T10:55:43.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9fadbcf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa80ffe30 0x7f9fa8072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9fadbcf700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fa81007d0 0x7f9fa8072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9fadbcf700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fa8104e70 0x7f9fa81a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9fadbcf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8073670 con 0x7f9fa80ffe30 2023-03-02T10:55:43.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9fadbcf700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa81a4550 con 0x7f9fa8104e70 2023-03-02T10:55:43.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9fadbcf700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa81a4690 con 0x7f9fa81007d0 2023-03-02T10:55:43.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9fa77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa80ffe30 0x7f9fa8072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9fa77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa80ffe30 0x7f9fa8072890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36930/0 (socket says 172.21.15.57:36930) 2023-03-02T10:55:43.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9fa77fe700 1 -- 172.21.15.57:0/1753768235 learned_addr learned my addr 172.21.15.57:0/1753768235 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:43.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9fa7fff700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fa8104e70 0x7f9fa81a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.614+0000 7f9f9ffff700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fa81007d0 0x7f9fa8072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.615+0000 7f9fa77fe700 1 -- 172.21.15.57:0/1753768235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fa81007d0 msgr2=0x7f9fa8072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.615+0000 7f9fa77fe700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fa81007d0 0x7f9fa8072dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.615+0000 7f9fa77fe700 1 -- 172.21.15.57:0/1753768235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fa8104e70 msgr2=0x7f9fa81a4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.615+0000 7f9fa77fe700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fa8104e70 0x7f9fa81a4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.615+0000 7f9fa77fe700 1 -- 172.21.15.57:0/1753768235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98009520 con 0x7f9fa80ffe30 2023-03-02T10:55:43.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.615+0000 7f9fa77fe700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa80ffe30 0x7f9fa8072890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800eb60 tx=0x7f9f9800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:43.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.615+0000 7f9fa57fa700 1 -- 172.21.15.57:0/1753768235 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800cc90 con 0x7f9fa80ffe30 2023-03-02T10:55:43.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.615+0000 7f9fadbcf700 1 -- 172.21.15.57:0/1753768235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa0009d00 con 0x7f9fa80ffe30 2023-03-02T10:55:43.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.615+0000 7f9fa57fa700 1 -- 172.21.15.57:0/1753768235 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f980044e0 con 0x7f9fa80ffe30 2023-03-02T10:55:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.615+0000 7f9fa57fa700 1 -- 172.21.15.57:0/1753768235 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f98010430 con 0x7f9fa80ffe30 2023-03-02T10:55:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.615+0000 7f9fadbcf700 1 -- 172.21.15.57:0/1753768235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa810fc80 con 0x7f9fa80ffe30 2023-03-02T10:55:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.616+0000 7f9fadbcf700 1 -- 172.21.15.57:0/1753768235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9fa80fcaa0 con 0x7f9fa80ffe30 2023-03-02T10:55:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.618+0000 7f9fa57fa700 1 -- 172.21.15.57:0/1753768235 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f9f9800c040 con 0x7f9fa80ffe30 2023-03-02T10:55:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.619+0000 7f9fa57fa700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f9f9409b3e0 0x7f9f9409d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.619+0000 7f9fa57fa700 1 -- 172.21.15.57:0/1753768235 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9f98014070 con 0x7f9fa80ffe30 2023-03-02T10:55:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.619+0000 7f9f9ffff700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f9f9409b3e0 0x7f9f9409d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.619+0000 7f9fa57fa700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717] conn(0x7f9f940a4bb0 0x7f9f940a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:43.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.619+0000 7f9fa57fa700 1 -- 172.21.15.57:0/1753768235 --> [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f940a7670 con 0x7f9f940a4bb0 2023-03-02T10:55:43.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.619+0000 7f9fa57fa700 1 -- 172.21.15.57:0/1753768235 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f980c5730 con 0x7f9fa80ffe30 2023-03-02T10:55:43.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.619+0000 7f9f9ffff700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f9f9409b3e0 0x7f9f9409d890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8074080 tx=0x7f9f90009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:43.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.619+0000 7f9fa7fff700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717] conn(0x7f9f940a4bb0 0x7f9f940a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:43.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.620+0000 7f9fa7fff700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717] conn(0x7f9f940a4bb0 0x7f9f940a6fc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:43.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.621+0000 7f9fa57fa700 1 -- 172.21.15.57:0/1753768235 <== osd.1 v2:172.21.15.122:6800/3137030717 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f9f940a7670 con 0x7f9f940a4bb0 2023-03-02T10:55:43.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.637+0000 7f9fadbcf700 1 -- 172.21.15.57:0/1753768235 --> [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9fa810faf0 con 0x7f9f940a4bb0 2023-03-02T10:55:43.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.638+0000 7f9fa57fa700 1 -- 172.21.15.57:0/1753768235 <== osd.1 v2:172.21.15.122:6800/3137030717 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9fa810faf0 con 0x7f9f940a4bb0 2023-03-02T10:55:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.638+0000 7f9fadbcf700 1 -- 172.21.15.57:0/1753768235 >> [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717] conn(0x7f9f940a4bb0 msgr2=0x7f9f940a6fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.638+0000 7f9fadbcf700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717] conn(0x7f9f940a4bb0 0x7f9f940a6fc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.638+0000 7f9fadbcf700 1 -- 172.21.15.57:0/1753768235 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f9f9409b3e0 msgr2=0x7f9f9409d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.638+0000 7f9fadbcf700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f9f9409b3e0 0x7f9f9409d890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8074080 tx=0x7f9f90009260 comp rx=0 tx=0).stop 2023-03-02T10:55:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.638+0000 7f9fadbcf700 1 -- 172.21.15.57:0/1753768235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa80ffe30 msgr2=0x7f9fa8072890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.638+0000 7f9fadbcf700 1 --2- 172.21.15.57:0/1753768235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa80ffe30 0x7f9fa8072890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800eb60 tx=0x7f9f9800ee70 comp rx=0 tx=0).stop 2023-03-02T10:55:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.638+0000 7f9fa7fff700 1 -- 172.21.15.57:0/1753768235 reap_dead start 2023-03-02T10:55:43.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.639+0000 7f9fadbcf700 1 -- 172.21.15.57:0/1753768235 shutdown_connections 2023-03-02T10:55:43.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.639+0000 7f9fadbcf700 1 -- 172.21.15.57:0/1753768235 >> 172.21.15.57:0/1753768235 conn(0x7f9fa80fb6a0 msgr2=0x7f9fa80fc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:43.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.639+0000 7f9fadbcf700 1 -- 172.21.15.57:0/1753768235 shutdown_connections 2023-03-02T10:55:43.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.639+0000 7f9fadbcf700 1 -- 172.21.15.57:0/1753768235 wait complete. 2023-03-02T10:55:44.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.572+0000 7ff03eca8700 1 -- 172.21.15.57:0/2865989335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0380fedb0 msgr2=0x7ff0380ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.572+0000 7ff03eca8700 1 --2- 172.21.15.57:0/2865989335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0380fedb0 0x7ff0380ff180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0099c0 tx=0x7ff02c009cd0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.572+0000 7ff03eca8700 1 -- 172.21.15.57:0/2865989335 shutdown_connections 2023-03-02T10:55:44.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.572+0000 7ff03eca8700 1 --2- 172.21.15.57:0/2865989335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff038103df0 0x7ff03810b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.572+0000 7ff03eca8700 1 --2- 172.21.15.57:0/2865989335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0380fedb0 0x7ff0380ff180 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.572+0000 7ff03eca8700 1 --2- 172.21.15.57:0/2865989335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0380ff750 0x7ff038103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.572+0000 7ff03eca8700 1 -- 172.21.15.57:0/2865989335 >> 172.21.15.57:0/2865989335 conn(0x7ff0380fa620 msgr2=0x7ff0380fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:44.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.572+0000 7ff03eca8700 1 -- 172.21.15.57:0/2865989335 shutdown_connections 2023-03-02T10:55:44.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.572+0000 7ff03eca8700 1 -- 172.21.15.57:0/2865989335 wait complete. 2023-03-02T10:55:44.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.573+0000 7ff03eca8700 1 Processor -- start 2023-03-02T10:55:44.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.573+0000 7ff03eca8700 1 -- start start 2023-03-02T10:55:44.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.574+0000 7ff03eca8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0380fedb0 0x7ff03819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.574+0000 7ff03eca8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0380ff750 0x7ff03819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.574+0000 7ff03eca8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff038103df0 0x7ff038194a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.574+0000 7ff03eca8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0381950c0 con 0x7ff038103df0 2023-03-02T10:55:44.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.574+0000 7ff03eca8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff038195230 con 0x7ff0380ff750 2023-03-02T10:55:44.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.574+0000 7ff03eca8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0381953f0 con 0x7ff0380fedb0 2023-03-02T10:55:44.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.574+0000 7ff03d245700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff038103df0 0x7ff038194a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.574+0000 7ff03d245700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff038103df0 0x7ff038194a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36916/0 (socket says 172.21.15.57:36916) 2023-03-02T10:55:44.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.574+0000 7ff03d245700 1 -- 172.21.15.57:0/3436511515 learned_addr learned my addr 172.21.15.57:0/3436511515 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:44.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.574+0000 7ff03ca44700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0380fedb0 0x7ff03819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.574+0000 7ff037fff700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0380ff750 0x7ff03819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.575+0000 7ff03d245700 1 -- 172.21.15.57:0/3436511515 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0380fedb0 msgr2=0x7ff03819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.575+0000 7ff03d245700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0380fedb0 0x7ff03819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.575+0000 7ff03d245700 1 -- 172.21.15.57:0/3436511515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0380ff750 msgr2=0x7ff03819af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.575+0000 7ff03d245700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0380ff750 0x7ff03819af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.575+0000 7ff03d245700 1 -- 172.21.15.57:0/3436511515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c0095f0 con 0x7ff038103df0 2023-03-02T10:55:44.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.575+0000 7ff03d245700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff038103df0 0x7ff038194a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff030007d70 tx=0x7ff03000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:44.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.575+0000 7ff035ffb700 1 -- 172.21.15.57:0/3436511515 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03000ac90 con 0x7ff038103df0 2023-03-02T10:55:44.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.575+0000 7ff03eca8700 1 -- 172.21.15.57:0/3436511515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03810ec10 con 0x7ff038103df0 2023-03-02T10:55:44.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.575+0000 7ff035ffb700 1 -- 172.21.15.57:0/3436511515 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff03000adf0 con 0x7ff038103df0 2023-03-02T10:55:44.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.575+0000 7ff035ffb700 1 -- 172.21.15.57:0/3436511515 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300115e0 con 0x7ff038103df0 2023-03-02T10:55:44.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.575+0000 7ff03eca8700 1 -- 172.21.15.57:0/3436511515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03810ea80 con 0x7ff038103df0 2023-03-02T10:55:44.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.576+0000 7ff03eca8700 1 -- 172.21.15.57:0/3436511515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff0380fbb50 con 0x7ff038103df0 2023-03-02T10:55:44.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.578+0000 7ff035ffb700 1 -- 172.21.15.57:0/3436511515 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7ff030022070 con 0x7ff038103df0 2023-03-02T10:55:44.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.578+0000 7ff035ffb700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff02809b3e0 0x7ff02809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.579+0000 7ff035ffb700 1 -- 172.21.15.57:0/3436511515 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff0300c54d0 con 0x7ff038103df0 2023-03-02T10:55:44.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.579+0000 7ff03ca44700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff02809b3e0 0x7ff02809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.579+0000 7ff035ffb700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859] conn(0x7ff0280a4bb0 0x7ff0280a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.579+0000 7ff035ffb700 1 -- 172.21.15.57:0/3436511515 --> [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0280a7670 con 0x7ff0280a4bb0 2023-03-02T10:55:44.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.579+0000 7ff035ffb700 1 -- 172.21.15.57:0/3436511515 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0300c5840 con 0x7ff038103df0 2023-03-02T10:55:44.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.579+0000 7ff03ca44700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff02809b3e0 0x7ff02809d890 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00b580 tx=0x7ff02c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:44.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.579+0000 7ff037fff700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859] conn(0x7ff0280a4bb0 0x7ff0280a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.580+0000 7ff037fff700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859] conn(0x7ff0280a4bb0 0x7ff0280a6fc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:44.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.581+0000 7ff035ffb700 1 -- 172.21.15.57:0/3436511515 <== osd.11 v2:172.21.15.136:6824/3852616859 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7ff0280a7670 con 0x7ff0280a4bb0 2023-03-02T10:55:44.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.600+0000 7ff03eca8700 1 -- 172.21.15.57:0/3436511515 --> [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff03810eda0 con 0x7ff0280a4bb0 2023-03-02T10:55:44.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.601+0000 7ff035ffb700 1 -- 172.21.15.57:0/3436511515 <== osd.11 v2:172.21.15.136:6824/3852616859 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff03810eda0 con 0x7ff0280a4bb0 2023-03-02T10:55:44.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.601+0000 7ff03eca8700 1 -- 172.21.15.57:0/3436511515 >> [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859] conn(0x7ff0280a4bb0 msgr2=0x7ff0280a6fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.601+0000 7ff03eca8700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859] conn(0x7ff0280a4bb0 0x7ff0280a6fc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.601+0000 7ff03eca8700 1 -- 172.21.15.57:0/3436511515 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff02809b3e0 msgr2=0x7ff02809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.601+0000 7ff03eca8700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff02809b3e0 0x7ff02809d890 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00b580 tx=0x7ff02c0058e0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.601+0000 7ff03eca8700 1 -- 172.21.15.57:0/3436511515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff038103df0 msgr2=0x7ff038194a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.601+0000 7ff03eca8700 1 --2- 172.21.15.57:0/3436511515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff038103df0 0x7ff038194a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff030007d70 tx=0x7ff03000a340 comp rx=0 tx=0).stop 2023-03-02T10:55:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.601+0000 7ff03d245700 1 -- 172.21.15.57:0/3436511515 reap_dead start 2023-03-02T10:55:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.601+0000 7ff03eca8700 1 -- 172.21.15.57:0/3436511515 shutdown_connections 2023-03-02T10:55:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.601+0000 7ff03eca8700 1 -- 172.21.15.57:0/3436511515 >> 172.21.15.57:0/3436511515 conn(0x7ff0380fa620 msgr2=0x7ff0380fb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:44.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.602+0000 7ff03eca8700 1 -- 172.21.15.57:0/3436511515 shutdown_connections 2023-03-02T10:55:44.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:43.602+0000 7ff03eca8700 1 -- 172.21.15.57:0/3436511515 wait complete. 2023-03-02T10:55:44.170 INFO:teuthology.orchestra.run.smithi057.stdout:201863462953 2023-03-02T10:55:44.170 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.6 2023-03-02T10:55:44.385 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:44 smithi057 ceph-mon[92072]: pgmap v281: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2023-03-02T10:55:44.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.077+0000 7f00c4166700 1 -- 172.21.15.57:0/3896633188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00bc10a1f0 msgr2=0x7f00bc10c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.077+0000 7f00c4166700 1 --2- 172.21.15.57:0/3896633188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00bc10a1f0 0x7f00bc10c680 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f00b400b0a0 tx=0x7f00b400b3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.077+0000 7f00c4166700 1 -- 172.21.15.57:0/3896633188 shutdown_connections 2023-03-02T10:55:44.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.077+0000 7f00c4166700 1 --2- 172.21.15.57:0/3896633188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00bc10a1f0 0x7f00bc10c680 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.077+0000 7f00c4166700 1 --2- 172.21.15.57:0/3896633188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00bc100e10 0x7f00bc1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.077+0000 7f00c4166700 1 --2- 172.21.15.57:0/3896633188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00bc101720 0x7f00bc109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.077+0000 7f00c4166700 1 -- 172.21.15.57:0/3896633188 >> 172.21.15.57:0/3896633188 conn(0x7f00bc0fa620 msgr2=0x7f00bc0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:44.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.077+0000 7f00c4166700 1 -- 172.21.15.57:0/3896633188 shutdown_connections 2023-03-02T10:55:44.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.077+0000 7f00c4166700 1 -- 172.21.15.57:0/3896633188 wait complete. 2023-03-02T10:55:44.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.078+0000 7f00c4166700 1 Processor -- start 2023-03-02T10:55:44.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.078+0000 7f00c4166700 1 -- start start 2023-03-02T10:55:44.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.078+0000 7f00c4166700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00bc100e10 0x7f00bc195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.078+0000 7f00c4166700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00bc101720 0x7f00bc1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.078+0000 7f00c4166700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00bc10a1f0 0x7f00bc19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.078+0000 7f00c4166700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc19ad70 con 0x7f00bc10a1f0 2023-03-02T10:55:44.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.078+0000 7f00c4166700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc19aee0 con 0x7f00bc101720 2023-03-02T10:55:44.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.078+0000 7f00c4166700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc19b0a0 con 0x7f00bc100e10 2023-03-02T10:55:44.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c2703700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00bc10a1f0 0x7f00bc19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c1f02700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00bc100e10 0x7f00bc195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c2703700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00bc10a1f0 0x7f00bc19a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36944/0 (socket says 172.21.15.57:36944) 2023-03-02T10:55:44.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c2703700 1 -- 172.21.15.57:0/489161384 learned_addr learned my addr 172.21.15.57:0/489161384 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:44.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c1701700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00bc101720 0x7f00bc1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c2703700 1 -- 172.21.15.57:0/489161384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00bc100e10 msgr2=0x7f00bc195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c2703700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00bc100e10 0x7f00bc195d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c2703700 1 -- 172.21.15.57:0/489161384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00bc101720 msgr2=0x7f00bc1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c2703700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00bc101720 0x7f00bc1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c2703700 1 -- 172.21.15.57:0/489161384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4009d00 con 0x7f00bc10a1f0 2023-03-02T10:55:44.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c2703700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00bc10a1f0 0x7f00bc19a730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f00b400b780 tx=0x7f00b4007990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:44.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00b2ffd700 1 -- 172.21.15.57:0/489161384 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400e040 con 0x7f00bc10a1f0 2023-03-02T10:55:44.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c4166700 1 -- 172.21.15.57:0/489161384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc10fcb0 con 0x7f00bc10a1f0 2023-03-02T10:55:44.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00b2ffd700 1 -- 172.21.15.57:0/489161384 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00b400be40 con 0x7f00bc10a1f0 2023-03-02T10:55:44.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00b2ffd700 1 -- 172.21.15.57:0/489161384 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b40052a0 con 0x7f00bc10a1f0 2023-03-02T10:55:44.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.079+0000 7f00c4166700 1 -- 172.21.15.57:0/489161384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00bc10fb20 con 0x7f00bc10a1f0 2023-03-02T10:55:44.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.080+0000 7f00c4166700 1 -- 172.21.15.57:0/489161384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00bc060c50 con 0x7f00bc10a1f0 2023-03-02T10:55:44.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.082+0000 7f00b2ffd700 1 -- 172.21.15.57:0/489161384 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f00b402d070 con 0x7f00bc10a1f0 2023-03-02T10:55:44.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.083+0000 7f00b2ffd700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f00a809b3e0 0x7f00a809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.083+0000 7f00b2ffd700 1 -- 172.21.15.57:0/489161384 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f00b40c6830 con 0x7f00bc10a1f0 2023-03-02T10:55:44.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.083+0000 7f00c1f02700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f00a809b3e0 0x7f00a809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.083+0000 7f00b2ffd700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400] conn(0x7f00a80a4bb0 0x7f00a80a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.083+0000 7f00b2ffd700 1 -- 172.21.15.57:0/489161384 --> [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00a80a7670 con 0x7f00a80a4bb0 2023-03-02T10:55:44.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.083+0000 7f00b2ffd700 1 -- 172.21.15.57:0/489161384 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00b40c6ba0 con 0x7f00bc10a1f0 2023-03-02T10:55:44.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.083+0000 7f00c1f02700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f00a809b3e0 0x7f00a809d890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009c60 tx=0x7f00b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:44.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.083+0000 7f00c1701700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400] conn(0x7f00a80a4bb0 0x7f00a80a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.084+0000 7f00c1701700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400] conn(0x7f00a80a4bb0 0x7f00a80a6fc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:44.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.084+0000 7f00b2ffd700 1 -- 172.21.15.57:0/489161384 <== osd.5 v2:172.21.15.136:6808/3384464400 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f00a80a7670 con 0x7f00a80a4bb0 2023-03-02T10:55:44.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.102+0000 7f00c4166700 1 -- 172.21.15.57:0/489161384 --> [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f00bc10fe40 con 0x7f00a80a4bb0 2023-03-02T10:55:44.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00b2ffd700 1 -- 172.21.15.57:0/489161384 <== osd.5 v2:172.21.15.136:6808/3384464400 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f00bc10fe40 con 0x7f00a80a4bb0 2023-03-02T10:55:44.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00c4166700 1 -- 172.21.15.57:0/489161384 >> [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400] conn(0x7f00a80a4bb0 msgr2=0x7f00a80a6fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00c4166700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400] conn(0x7f00a80a4bb0 0x7f00a80a6fc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00c4166700 1 -- 172.21.15.57:0/489161384 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f00a809b3e0 msgr2=0x7f00a809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00c4166700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f00a809b3e0 0x7f00a809d890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009c60 tx=0x7f00b8009260 comp rx=0 tx=0).stop 2023-03-02T10:55:44.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00c4166700 1 -- 172.21.15.57:0/489161384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00bc10a1f0 msgr2=0x7f00bc19a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00c4166700 1 --2- 172.21.15.57:0/489161384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00bc10a1f0 0x7f00bc19a730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f00b400b780 tx=0x7f00b4007990 comp rx=0 tx=0).stop 2023-03-02T10:55:44.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00c2703700 1 -- 172.21.15.57:0/489161384 reap_dead start 2023-03-02T10:55:44.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00c4166700 1 -- 172.21.15.57:0/489161384 shutdown_connections 2023-03-02T10:55:44.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00c4166700 1 -- 172.21.15.57:0/489161384 >> 172.21.15.57:0/489161384 conn(0x7f00bc0fa620 msgr2=0x7f00bc101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:44.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00c4166700 1 -- 172.21.15.57:0/489161384 shutdown_connections 2023-03-02T10:55:44.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.103+0000 7f00c4166700 1 -- 172.21.15.57:0/489161384 wait complete. 2023-03-02T10:55:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:44 smithi136 ceph-mon[125702]: pgmap v281: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2023-03-02T10:55:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:44 smithi122 ceph-mon[125440]: pgmap v281: 97 pgs: 97 active+clean; 637 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2023-03-02T10:55:44.750 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:44.788 INFO:teuthology.orchestra.run.smithi057.stdout:253403070496 2023-03-02T10:55:44.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.8 2023-03-02T10:55:44.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.904+0000 7f3d015d9700 1 -- 172.21.15.57:0/1898138982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cfc101720 msgr2=0x7f3cfc109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.904+0000 7f3d015d9700 1 --2- 172.21.15.57:0/1898138982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cfc101720 0x7f3cfc109c10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009990 tx=0x7f3ce4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.904+0000 7f3d015d9700 1 -- 172.21.15.57:0/1898138982 shutdown_connections 2023-03-02T10:55:44.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.904+0000 7f3d015d9700 1 --2- 172.21.15.57:0/1898138982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cfc10a1f0 0x7f3cfc10c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.904+0000 7f3d015d9700 1 --2- 172.21.15.57:0/1898138982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3cfc100e10 0x7f3cfc1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.904+0000 7f3d015d9700 1 --2- 172.21.15.57:0/1898138982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cfc101720 0x7f3cfc109c10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.904+0000 7f3d015d9700 1 -- 172.21.15.57:0/1898138982 >> 172.21.15.57:0/1898138982 conn(0x7f3cfc0fa620 msgr2=0x7f3cfc0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:44.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.904+0000 7f3d015d9700 1 -- 172.21.15.57:0/1898138982 shutdown_connections 2023-03-02T10:55:44.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.904+0000 7f3d015d9700 1 -- 172.21.15.57:0/1898138982 wait complete. 2023-03-02T10:55:44.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.905+0000 7f3d015d9700 1 Processor -- start 2023-03-02T10:55:44.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.905+0000 7f3d015d9700 1 -- start start 2023-03-02T10:55:44.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.905+0000 7f3d015d9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3cfc100e10 0x7f3cfc19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.905+0000 7f3d015d9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cfc101720 0x7f3cfc19bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.905+0000 7f3d015d9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cfc10a1f0 0x7f3cfc195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.905+0000 7f3d015d9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc196120 con 0x7f3cfc101720 2023-03-02T10:55:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.905+0000 7f3d015d9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc196290 con 0x7f3cfc100e10 2023-03-02T10:55:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.905+0000 7f3d015d9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc196450 con 0x7f3cfc10a1f0 2023-03-02T10:55:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cf3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cfc101720 0x7f3cfc19bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cf3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cfc101720 0x7f3cfc19bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36968/0 (socket says 172.21.15.57:36968) 2023-03-02T10:55:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cf3fff700 1 -- 172.21.15.57:0/3288721838 learned_addr learned my addr 172.21.15.57:0/3288721838 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:44.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cfaffd700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3cfc100e10 0x7f3cfc19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cfb7fe700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cfc10a1f0 0x7f3cfc195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cf3fff700 1 -- 172.21.15.57:0/3288721838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cfc10a1f0 msgr2=0x7f3cfc195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cf3fff700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cfc10a1f0 0x7f3cfc195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cf3fff700 1 -- 172.21.15.57:0/3288721838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3cfc100e10 msgr2=0x7f3cfc19ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cf3fff700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3cfc100e10 0x7f3cfc19ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cf3fff700 1 -- 172.21.15.57:0/3288721838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40095f0 con 0x7f3cfc101720 2023-03-02T10:55:44.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cfb7fe700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cfc10a1f0 0x7f3cfc195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:44.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cf3fff700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cfc101720 0x7f3cfc19bf80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4000c00 tx=0x7f3ce4004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:44.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.906+0000 7f3cf8ff9700 1 -- 172.21.15.57:0/3288721838 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce401d070 con 0x7f3cfc101720 2023-03-02T10:55:44.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.907+0000 7f3d015d9700 1 -- 172.21.15.57:0/3288721838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cfc10fcc0 con 0x7f3cfc101720 2023-03-02T10:55:44.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.907+0000 7f3cf8ff9700 1 -- 172.21.15.57:0/3288721838 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ce4021410 con 0x7f3cfc101720 2023-03-02T10:55:44.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.907+0000 7f3cf8ff9700 1 -- 172.21.15.57:0/3288721838 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4017650 con 0x7f3cfc101720 2023-03-02T10:55:44.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.907+0000 7f3d015d9700 1 -- 172.21.15.57:0/3288721838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cfc10fb30 con 0x7f3cfc101720 2023-03-02T10:55:44.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.908+0000 7f3d015d9700 1 -- 172.21.15.57:0/3288721838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3cfc060c50 con 0x7f3cfc101720 2023-03-02T10:55:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.909+0000 7f3cf8ff9700 1 -- 172.21.15.57:0/3288721838 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f3ce4028030 con 0x7f3cfc101720 2023-03-02T10:55:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.910+0000 7f3cf8ff9700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3ce809b460 0x7f3ce809d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.910+0000 7f3cf8ff9700 1 -- 172.21.15.57:0/3288721838 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3ce40c5ff0 con 0x7f3cfc101720 2023-03-02T10:55:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.910+0000 7f3cfaffd700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3ce809b460 0x7f3ce809d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.910+0000 7f3cf8ff9700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822] conn(0x7f3ce80a4c30 0x7f3ce80a7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.910+0000 7f3cf8ff9700 1 -- 172.21.15.57:0/3288721838 --> [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ce80a76f0 con 0x7f3ce80a4c30 2023-03-02T10:55:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.910+0000 7f3cf8ff9700 1 -- 172.21.15.57:0/3288721838 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ce40c86c0 con 0x7f3cfc101720 2023-03-02T10:55:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.911+0000 7f3cfb7fe700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822] conn(0x7f3ce80a4c30 0x7f3ce80a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.911+0000 7f3cfaffd700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3ce809b460 0x7f3ce809d910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009c60 tx=0x7f3cec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.911+0000 7f3cfb7fe700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822] conn(0x7f3ce80a4c30 0x7f3ce80a7040 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:44.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.912+0000 7f3cf8ff9700 1 -- 172.21.15.57:0/3288721838 <== osd.7 v2:172.21.15.122:6816/3795364822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f3ce80a76f0 con 0x7f3ce80a4c30 2023-03-02T10:55:44.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.929+0000 7f3d015d9700 1 -- 172.21.15.57:0/3288721838 --> [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3cfc061000 con 0x7f3ce80a4c30 2023-03-02T10:55:44.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.929+0000 7f3cf8ff9700 1 -- 172.21.15.57:0/3288721838 <== osd.7 v2:172.21.15.122:6816/3795364822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3cfc061000 con 0x7f3ce80a4c30 2023-03-02T10:55:44.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.930+0000 7f3d015d9700 1 -- 172.21.15.57:0/3288721838 >> [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822] conn(0x7f3ce80a4c30 msgr2=0x7f3ce80a7040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.930+0000 7f3d015d9700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822] conn(0x7f3ce80a4c30 0x7f3ce80a7040 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:44.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.930+0000 7f3d015d9700 1 -- 172.21.15.57:0/3288721838 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3ce809b460 msgr2=0x7f3ce809d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.930+0000 7f3d015d9700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3ce809b460 0x7f3ce809d910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009c60 tx=0x7f3cec009260 comp rx=0 tx=0).stop 2023-03-02T10:55:44.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.930+0000 7f3d015d9700 1 -- 172.21.15.57:0/3288721838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cfc101720 msgr2=0x7f3cfc19bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:44.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.930+0000 7f3d015d9700 1 --2- 172.21.15.57:0/3288721838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cfc101720 0x7f3cfc19bf80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4000c00 tx=0x7f3ce4004790 comp rx=0 tx=0).stop 2023-03-02T10:55:44.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.930+0000 7f3cfb7fe700 1 -- 172.21.15.57:0/3288721838 reap_dead start 2023-03-02T10:55:44.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.930+0000 7f3d015d9700 1 -- 172.21.15.57:0/3288721838 shutdown_connections 2023-03-02T10:55:44.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.930+0000 7f3d015d9700 1 -- 172.21.15.57:0/3288721838 >> 172.21.15.57:0/3288721838 conn(0x7f3cfc0fa620 msgr2=0x7f3cfc101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:44.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.930+0000 7f3d015d9700 1 -- 172.21.15.57:0/3288721838 shutdown_connections 2023-03-02T10:55:44.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:44.930+0000 7f3d015d9700 1 -- 172.21.15.57:0/3288721838 wait complete. 2023-03-02T10:55:45.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.167+0000 7fdfce31b700 1 -- 172.21.15.57:0/3559208327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfc810c520 msgr2=0x7fdfc810e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:45.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.167+0000 7fdfce31b700 1 --2- 172.21.15.57:0/3559208327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfc810c520 0x7fdfc810e900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000b0a0 tx=0x7fdfc000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:45.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.167+0000 7fdfce31b700 1 -- 172.21.15.57:0/3559208327 shutdown_connections 2023-03-02T10:55:45.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.167+0000 7fdfce31b700 1 --2- 172.21.15.57:0/3559208327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfc810c520 0x7fdfc810e900 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:45.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.167+0000 7fdfce31b700 1 --2- 172.21.15.57:0/3559208327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfc80fe970 0x7fdfc80fed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:45.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.167+0000 7fdfce31b700 1 --2- 172.21.15.57:0/3559208327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfc80ff280 0x7fdfc810bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:45.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.167+0000 7fdfce31b700 1 -- 172.21.15.57:0/3559208327 >> 172.21.15.57:0/3559208327 conn(0x7fdfc8075c50 msgr2=0x7fdfc8076050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:45.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.167+0000 7fdfce31b700 1 -- 172.21.15.57:0/3559208327 shutdown_connections 2023-03-02T10:55:45.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.167+0000 7fdfce31b700 1 -- 172.21.15.57:0/3559208327 wait complete. 2023-03-02T10:55:45.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.168+0000 7fdfce31b700 1 Processor -- start 2023-03-02T10:55:45.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.168+0000 7fdfce31b700 1 -- start start 2023-03-02T10:55:45.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.168+0000 7fdfce31b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfc80fe970 0x7fdfc8198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:45.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfce31b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfc80ff280 0x7fdfc8198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:45.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfce31b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfc810c520 0x7fdfc819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:45.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfce31b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc819cfe0 con 0x7fdfc80ff280 2023-03-02T10:55:45.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfce31b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc819d150 con 0x7fdfc810c520 2023-03-02T10:55:45.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfce31b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc819d310 con 0x7fdfc80fe970 2023-03-02T10:55:45.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfc77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfc80ff280 0x7fdfc8198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:45.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfc77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfc80ff280 0x7fdfc8198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36994/0 (socket says 172.21.15.57:36994) 2023-03-02T10:55:45.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfc77fe700 1 -- 172.21.15.57:0/747325056 learned_addr learned my addr 172.21.15.57:0/747325056 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:45.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfc7fff700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfc80fe970 0x7fdfc8198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:45.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfcc8b8700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfc810c520 0x7fdfc819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:45.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfc77fe700 1 -- 172.21.15.57:0/747325056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfc80fe970 msgr2=0x7fdfc8198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:45.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfc77fe700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdfc80fe970 0x7fdfc8198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:45.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfc77fe700 1 -- 172.21.15.57:0/747325056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfc810c520 msgr2=0x7fdfc819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:45.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfc77fe700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfc810c520 0x7fdfc819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:45.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfc77fe700 1 -- 172.21.15.57:0/747325056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0009d00 con 0x7fdfc80ff280 2023-03-02T10:55:45.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfcc8b8700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfc810c520 0x7fdfc819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:45.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.169+0000 7fdfc77fe700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfc80ff280 0x7fdfc8198540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00d980 tx=0x7fdfbc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:45.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.170+0000 7fdfc57fa700 1 -- 172.21.15.57:0/747325056 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc004220 con 0x7fdfc80ff280 2023-03-02T10:55:45.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.170+0000 7fdfce31b700 1 -- 172.21.15.57:0/747325056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc8111e50 con 0x7fdfc80ff280 2023-03-02T10:55:45.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.170+0000 7fdfc57fa700 1 -- 172.21.15.57:0/747325056 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfbc007640 con 0x7fdfc80ff280 2023-03-02T10:55:45.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.170+0000 7fdfc57fa700 1 -- 172.21.15.57:0/747325056 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc005610 con 0x7fdfc80ff280 2023-03-02T10:55:45.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.170+0000 7fdfce31b700 1 -- 172.21.15.57:0/747325056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc8111cc0 con 0x7fdfc80ff280 2023-03-02T10:55:45.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.171+0000 7fdfce31b700 1 -- 172.21.15.57:0/747325056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdfc80fcde0 con 0x7fdfc80ff280 2023-03-02T10:55:45.180 INFO:teuthology.orchestra.run.smithi057.stdout:55834574911 2023-03-02T10:55:45.181 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.1 2023-03-02T10:55:45.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.172+0000 7fdfc57fa700 1 -- 172.21.15.57:0/747325056 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fdfbc021070 con 0x7fdfc80ff280 2023-03-02T10:55:45.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.173+0000 7fdfc57fa700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdfb009b3e0 0x7fdfb009d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:45.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.173+0000 7fdfc57fa700 1 -- 172.21.15.57:0/747325056 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdfbc0c5120 con 0x7fdfc80ff280 2023-03-02T10:55:45.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.173+0000 7fdfc7fff700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdfb009b3e0 0x7fdfb009d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:45.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.174+0000 7fdfc57fa700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568] conn(0x7fdfb00a4bb0 0x7fdfb00a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:45.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.174+0000 7fdfc57fa700 1 -- 172.21.15.57:0/747325056 --> [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfb00a7670 con 0x7fdfb00a4bb0 2023-03-02T10:55:45.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.174+0000 7fdfc57fa700 1 -- 172.21.15.57:0/747325056 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfbc0c5580 con 0x7fdfc80ff280 2023-03-02T10:55:45.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.174+0000 7fdfcc8b8700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568] conn(0x7fdfb00a4bb0 0x7fdfb00a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:45.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.174+0000 7fdfc7fff700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdfb009b3e0 0x7fdfb009d890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009c60 tx=0x7fdfb8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.174+0000 7fdfcc8b8700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568] conn(0x7fdfb00a4bb0 0x7fdfb00a6fc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.175+0000 7fdfc57fa700 1 -- 172.21.15.57:0/747325056 <== osd.0 v2:172.21.15.57:6802/3424789568 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fdfb00a7670 con 0x7fdfb00a4bb0 2023-03-02T10:55:45.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.192+0000 7fdfce31b700 1 -- 172.21.15.57:0/747325056 --> [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdfc8111fe0 con 0x7fdfb00a4bb0 2023-03-02T10:55:45.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.192+0000 7fdfc57fa700 1 -- 172.21.15.57:0/747325056 <== osd.0 v2:172.21.15.57:6802/3424789568 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdfc8111fe0 con 0x7fdfb00a4bb0 2023-03-02T10:55:45.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.192+0000 7fdfce31b700 1 -- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568] conn(0x7fdfb00a4bb0 msgr2=0x7fdfb00a6fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:45.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.192+0000 7fdfce31b700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568] conn(0x7fdfb00a4bb0 0x7fdfb00a6fc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:45.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.192+0000 7fdfce31b700 1 -- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdfb009b3e0 msgr2=0x7fdfb009d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:45.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.192+0000 7fdfce31b700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fdfb009b3e0 0x7fdfb009d890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009c60 tx=0x7fdfb8009260 comp rx=0 tx=0).stop 2023-03-02T10:55:45.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.192+0000 7fdfce31b700 1 -- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfc80ff280 msgr2=0x7fdfc8198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:45.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.192+0000 7fdfce31b700 1 --2- 172.21.15.57:0/747325056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfc80ff280 0x7fdfc8198540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00d980 tx=0x7fdfbc00dc90 comp rx=0 tx=0).stop 2023-03-02T10:55:45.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.192+0000 7fdfcc8b8700 1 -- 172.21.15.57:0/747325056 reap_dead start 2023-03-02T10:55:45.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.193+0000 7fdfce31b700 1 -- 172.21.15.57:0/747325056 shutdown_connections 2023-03-02T10:55:45.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.193+0000 7fdfce31b700 1 -- 172.21.15.57:0/747325056 >> 172.21.15.57:0/747325056 conn(0x7fdfc8075c50 msgr2=0x7fdfc80fc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:45.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.193+0000 7fdfce31b700 1 -- 172.21.15.57:0/747325056 shutdown_connections 2023-03-02T10:55:45.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:45.193+0000 7fdfce31b700 1 -- 172.21.15.57:0/747325056 wait complete. 2023-03-02T10:55:45.901 INFO:teuthology.orchestra.run.smithi057.stdout:339302416403 2023-03-02T10:55:45.902 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.11 2023-03-02T10:55:46.059 INFO:teuthology.orchestra.run.smithi057.stdout:34359738437 2023-03-02T10:55:46.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.0 2023-03-02T10:55:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:46 smithi136 ceph-mon[125702]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:55:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:46 smithi057 ceph-mon[92072]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:55:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:46 smithi122 ceph-mon[125440]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:55:47.110 INFO:teuthology.orchestra.run.smithi057.stdout:223338299427 2023-03-02T10:55:47.111 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.7 2023-03-02T10:55:47.117 INFO:teuthology.orchestra.run.smithi057.stdout:167503724589 2023-03-02T10:55:47.118 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph osd last-stat-seq osd.5 2023-03-02T10:55:47.191 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:47.425 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:47.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.547+0000 7f28ecd6e700 1 -- 172.21.15.57:0/571812111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e8101790 msgr2=0x7f28e8109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:47.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.547+0000 7f28ecd6e700 1 --2- 172.21.15.57:0/571812111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e8101790 0x7f28e8109c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009990 tx=0x7f28d0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:47.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.547+0000 7f28ecd6e700 1 -- 172.21.15.57:0/571812111 shutdown_connections 2023-03-02T10:55:47.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.547+0000 7f28ecd6e700 1 --2- 172.21.15.57:0/571812111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e810a1c0 0x7f28e810c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:47.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.547+0000 7f28ecd6e700 1 --2- 172.21.15.57:0/571812111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e8100e80 0x7f28e8101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:47.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.547+0000 7f28ecd6e700 1 --2- 172.21.15.57:0/571812111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e8101790 0x7f28e8109c80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:47.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.547+0000 7f28ecd6e700 1 -- 172.21.15.57:0/571812111 >> 172.21.15.57:0/571812111 conn(0x7f28e80fa610 msgr2=0x7f28e80fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:47.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.547+0000 7f28ecd6e700 1 -- 172.21.15.57:0/571812111 shutdown_connections 2023-03-02T10:55:47.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.547+0000 7f28ecd6e700 1 -- 172.21.15.57:0/571812111 wait complete. 2023-03-02T10:55:47.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.547+0000 7f28ecd6e700 1 Processor -- start 2023-03-02T10:55:47.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28ecd6e700 1 -- start start 2023-03-02T10:55:47.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28ecd6e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e8100e80 0x7f28e80fead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:47.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28ecd6e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e8101790 0x7f28e80ff010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:47.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28ecd6e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e810a1c0 0x7f28e81a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:47.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28ecd6e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80ff840 con 0x7f28e8100e80 2023-03-02T10:55:47.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28ecd6e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e81a43b0 con 0x7f28e8101790 2023-03-02T10:55:47.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28ecd6e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e81a44f0 con 0x7f28e810a1c0 2023-03-02T10:55:47.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28e659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e8100e80 0x7f28e80fead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:47.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28e659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e8100e80 0x7f28e80fead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48546/0 (socket says 172.21.15.57:48546) 2023-03-02T10:55:47.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28e659c700 1 -- 172.21.15.57:0/4083194331 learned_addr learned my addr 172.21.15.57:0/4083194331 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:47.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28ddd9b700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e8101790 0x7f28e80ff010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:47.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28e6d9d700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e810a1c0 0x7f28e81a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:47.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28e659c700 1 -- 172.21.15.57:0/4083194331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e810a1c0 msgr2=0x7f28e81a3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:47.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28e659c700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e810a1c0 0x7f28e81a3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:47.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28e659c700 1 -- 172.21.15.57:0/4083194331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e8101790 msgr2=0x7f28e80ff010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:47.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28e659c700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e8101790 0x7f28e80ff010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28e659c700 1 -- 172.21.15.57:0/4083194331 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d00095f0 con 0x7f28e8100e80 2023-03-02T10:55:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.548+0000 7f28e6d9d700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e810a1c0 0x7f28e81a3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.549+0000 7f28e659c700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e8100e80 0x7f28e80fead0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f28d80060b0 tx=0x7f28d800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.549+0000 7f28dffff700 1 -- 172.21.15.57:0/4083194331 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800ddd0 con 0x7f28e8100e80 2023-03-02T10:55:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.549+0000 7f28ecd6e700 1 -- 172.21.15.57:0/4083194331 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e810fc60 con 0x7f28e8100e80 2023-03-02T10:55:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.549+0000 7f28dffff700 1 -- 172.21.15.57:0/4083194331 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28d800f040 con 0x7f28e8100e80 2023-03-02T10:55:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.549+0000 7f28dffff700 1 -- 172.21.15.57:0/4083194331 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8014690 con 0x7f28e8100e80 2023-03-02T10:55:47.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.549+0000 7f28ecd6e700 1 -- 172.21.15.57:0/4083194331 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e810fad0 con 0x7f28e8100e80 2023-03-02T10:55:47.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.550+0000 7f28ecd6e700 1 -- 172.21.15.57:0/4083194331 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e80681c0 con 0x7f28e8100e80 2023-03-02T10:55:47.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.551+0000 7f28dffff700 1 -- 172.21.15.57:0/4083194331 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f28d801c030 con 0x7f28e8100e80 2023-03-02T10:55:47.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.552+0000 7f28dffff700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28d409b3e0 0x7f28d409d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:47.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.553+0000 7f28dffff700 1 -- 172.21.15.57:0/4083194331 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f28d80c4760 con 0x7f28e8100e80 2023-03-02T10:55:47.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.553+0000 7f28ddd9b700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28d409b3e0 0x7f28d409d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:47.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.555+0000 7f28ddd9b700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28d409b3e0 0x7f28d409d890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f28d000b5c0 tx=0x7f28d0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.560+0000 7f28dffff700 1 -- 172.21.15.57:0/4083194331 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f28d804e800 con 0x7f28e8100e80 2023-03-02T10:55:47.596 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:47.780 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:47.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.842+0000 7f28ecd6e700 1 -- 172.21.15.57:0/4083194331 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f28e81a4f80 con 0x7f28e8100e80 2023-03-02T10:55:47.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.842+0000 7f28dffff700 1 -- 172.21.15.57:0/4083194331 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f28d801a070 con 0x7f28e8100e80 2023-03-02T10:55:47.844 INFO:teuthology.orchestra.run.smithi057.stdout:304942678039 2023-03-02T10:55:47.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.844+0000 7f28ecd6e700 1 -- 172.21.15.57:0/4083194331 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28d409b3e0 msgr2=0x7f28d409d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:47.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.844+0000 7f28ecd6e700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28d409b3e0 0x7f28d409d890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f28d000b5c0 tx=0x7f28d0005960 comp rx=0 tx=0).stop 2023-03-02T10:55:47.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.844+0000 7f28ecd6e700 1 -- 172.21.15.57:0/4083194331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e8100e80 msgr2=0x7f28e80fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:47.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.844+0000 7f28ecd6e700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e8100e80 0x7f28e80fead0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f28d80060b0 tx=0x7f28d800d3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:47.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.844+0000 7f28ecd6e700 1 -- 172.21.15.57:0/4083194331 shutdown_connections 2023-03-02T10:55:47.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.844+0000 7f28ecd6e700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f28d409b3e0 0x7f28d409d890 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:47.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.844+0000 7f28ecd6e700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28e810a1c0 0x7f28e81a3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:47.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.844+0000 7f28ecd6e700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28e8100e80 0x7f28e80fead0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:47.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.844+0000 7f28ecd6e700 1 --2- 172.21.15.57:0/4083194331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28e8101790 0x7f28e80ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:47.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.845+0000 7f28ecd6e700 1 -- 172.21.15.57:0/4083194331 >> 172.21.15.57:0/4083194331 conn(0x7f28e80fa610 msgr2=0x7f28e810c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:47.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.845+0000 7f28ecd6e700 1 -- 172.21.15.57:0/4083194331 shutdown_connections 2023-03-02T10:55:47.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:47.845+0000 7f28ecd6e700 1 -- 172.21.15.57:0/4083194331 wait complete. 2023-03-02T10:55:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:48 smithi136 ceph-mon[125702]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2023-03-02T10:55:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:48 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/4083194331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-03-02T10:55:48.594 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:48 smithi057 ceph-mon[92072]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2023-03-02T10:55:48.594 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:48 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/4083194331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-03-02T10:55:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:48 smithi122 ceph-mon[125440]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2023-03-02T10:55:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:48 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/4083194331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-03-02T10:55:49.238 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678037 got 304942678039 for osd.10 2023-03-02T10:55:49.239 DEBUG:teuthology.parallel:result is None 2023-03-02T10:55:49.348 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:49.621 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2023-03-02T10:55:49.621 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2023-03-02T10:55:49.621 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-03-02T10:55:49.621 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-03-02T10:55:49.622 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2023-03-02T10:55:49.622 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-03-02T10:55:49.622 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-03-02T10:55:49.622 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:49 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-03-02T10:55:49.622 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:49 smithi057 ceph-mon[92072]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2023-03-02T10:55:49.791 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2023-03-02T10:55:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2023-03-02T10:55:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-03-02T10:55:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-03-02T10:55:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2023-03-02T10:55:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-03-02T10:55:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-03-02T10:55:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:49 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-03-02T10:55:49.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:49 smithi136 ceph-mon[125702]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2023-03-02T10:55:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2023-03-02T10:55:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2023-03-02T10:55:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-03-02T10:55:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-03-02T10:55:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2023-03-02T10:55:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-03-02T10:55:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-03-02T10:55:49.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:49 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-03-02T10:55:49.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:49 smithi122 ceph-mon[125440]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2023-03-02T10:55:49.989 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:50.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.051+0000 7fd9c6add700 1 -- 172.21.15.57:0/1167514784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c0104e70 msgr2=0x7fd9c010ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:50.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.051+0000 7fd9c6add700 1 --2- 172.21.15.57:0/1167514784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c0104e70 0x7fd9c010ca40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800b0d0 tx=0x7fd9b800b3e0 comp rx=0 tx=0).stop 2023-03-02T10:55:50.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.051+0000 7fd9c6add700 1 -- 172.21.15.57:0/1167514784 shutdown_connections 2023-03-02T10:55:50.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.051+0000 7fd9c6add700 1 --2- 172.21.15.57:0/1167514784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c0104e70 0x7fd9c010ca40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.051+0000 7fd9c6add700 1 --2- 172.21.15.57:0/1167514784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c00ffe30 0x7fd9c0100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.051+0000 7fd9c6add700 1 --2- 172.21.15.57:0/1167514784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c01007d0 0x7fd9c0104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.051+0000 7fd9c6add700 1 -- 172.21.15.57:0/1167514784 >> 172.21.15.57:0/1167514784 conn(0x7fd9c00fb6a0 msgr2=0x7fd9c00fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.051+0000 7fd9c6add700 1 -- 172.21.15.57:0/1167514784 shutdown_connections 2023-03-02T10:55:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.051+0000 7fd9c6add700 1 -- 172.21.15.57:0/1167514784 wait complete. 2023-03-02T10:55:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.052+0000 7fd9c6add700 1 Processor -- start 2023-03-02T10:55:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.052+0000 7fd9c6add700 1 -- start start 2023-03-02T10:55:50.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.053+0000 7fd9c6add700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c00ffe30 0x7fd9c010c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:50.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.053+0000 7fd9c6add700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c01007d0 0x7fd9c0109500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:50.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.053+0000 7fd9c6add700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c0104e70 0x7fd9c0109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:50.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.053+0000 7fd9c6add700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0109f80 con 0x7fd9c01007d0 2023-03-02T10:55:50.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.053+0000 7fd9c6add700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c010a0f0 con 0x7fd9c0104e70 2023-03-02T10:55:50.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.053+0000 7fd9c6add700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c010a2b0 con 0x7fd9c00ffe30 2023-03-02T10:55:50.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.053+0000 7fd9bffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c01007d0 0x7fd9c0109500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:50.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.053+0000 7fd9c4879700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c00ffe30 0x7fd9c010c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:50.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.053+0000 7fd9bffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c01007d0 0x7fd9c0109500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48564/0 (socket says 172.21.15.57:48564) 2023-03-02T10:55:50.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.053+0000 7fd9bffff700 1 -- 172.21.15.57:0/2095367244 learned_addr learned my addr 172.21.15.57:0/2095367244 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:50.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.054+0000 7fd9c507a700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c0104e70 0x7fd9c0109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:50.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.054+0000 7fd9c4879700 1 -- 172.21.15.57:0/2095367244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c0104e70 msgr2=0x7fd9c0109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:50.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.054+0000 7fd9c4879700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c0104e70 0x7fd9c0109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:50.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.054+0000 7fd9c4879700 1 -- 172.21.15.57:0/2095367244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c01007d0 msgr2=0x7fd9c0109500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:50.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.054+0000 7fd9c4879700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c01007d0 0x7fd9c0109500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:50.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.054+0000 7fd9c4879700 1 -- 172.21.15.57:0/2095367244 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009d00 con 0x7fd9c00ffe30 2023-03-02T10:55:50.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.054+0000 7fd9c4879700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c00ffe30 0x7fd9c010c540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400e9f0 tx=0x7fd9b400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:50.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.055+0000 7fd9bdffb700 1 -- 172.21.15.57:0/2095367244 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b40096d0 con 0x7fd9c00ffe30 2023-03-02T10:55:50.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.055+0000 7fd9c6add700 1 -- 172.21.15.57:0/2095367244 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c0074250 con 0x7fd9c00ffe30 2023-03-02T10:55:50.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.055+0000 7fd9bdffb700 1 -- 172.21.15.57:0/2095367244 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9b400cbd0 con 0x7fd9c00ffe30 2023-03-02T10:55:50.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.055+0000 7fd9bdffb700 1 -- 172.21.15.57:0/2095367244 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4018680 con 0x7fd9c00ffe30 2023-03-02T10:55:50.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.055+0000 7fd9c6add700 1 -- 172.21.15.57:0/2095367244 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c00740c0 con 0x7fd9c00ffe30 2023-03-02T10:55:50.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.056+0000 7fd9c6add700 1 -- 172.21.15.57:0/2095367244 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c00743e0 con 0x7fd9c00ffe30 2023-03-02T10:55:50.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.057+0000 7fd9bdffb700 1 -- 172.21.15.57:0/2095367244 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fd9b400c040 con 0x7fd9c00ffe30 2023-03-02T10:55:50.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.058+0000 7fd9bdffb700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9b009b460 0x7fd9b009d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:50.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.058+0000 7fd9bdffb700 1 -- 172.21.15.57:0/2095367244 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd9b4014070 con 0x7fd9c00ffe30 2023-03-02T10:55:50.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.058+0000 7fd9bffff700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9b009b460 0x7fd9b009d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:50.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.059+0000 7fd9bffff700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9b009b460 0x7fd9b009d910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9c010ada0 tx=0x7fd9ac009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:50.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.061+0000 7fd9bdffb700 1 -- 172.21.15.57:0/2095367244 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fd9b4090cd0 con 0x7fd9c00ffe30 2023-03-02T10:55:50.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.272+0000 7fd9c6add700 1 -- 172.21.15.57:0/2095367244 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd9c0066750 con 0x7fd9c00ffe30 2023-03-02T10:55:50.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.273+0000 7fd9bdffb700 1 -- 172.21.15.57:0/2095367244 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9b40942f0 con 0x7fd9c00ffe30 2023-03-02T10:55:50.274 INFO:teuthology.orchestra.run.smithi057.stdout:111669149751 2023-03-02T10:55:50.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 -- 172.21.15.57:0/2095367244 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9b009b460 msgr2=0x7fd9b009d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:50.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9b009b460 0x7fd9b009d910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9c010ada0 tx=0x7fd9ac009210 comp rx=0 tx=0).stop 2023-03-02T10:55:50.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 -- 172.21.15.57:0/2095367244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c00ffe30 msgr2=0x7fd9c010c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:50.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c00ffe30 0x7fd9c010c540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400e9f0 tx=0x7fd9b400ed00 comp rx=0 tx=0).stop 2023-03-02T10:55:50.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 -- 172.21.15.57:0/2095367244 shutdown_connections 2023-03-02T10:55:50.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9b009b460 0x7fd9b009d910 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:50.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c0104e70 0x7fd9c0109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:50.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c00ffe30 0x7fd9c010c540 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:50.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 --2- 172.21.15.57:0/2095367244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c01007d0 0x7fd9c0109500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:50.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 -- 172.21.15.57:0/2095367244 >> 172.21.15.57:0/2095367244 conn(0x7fd9c00fb6a0 msgr2=0x7fd9c00fc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:50.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 -- 172.21.15.57:0/2095367244 shutdown_connections 2023-03-02T10:55:50.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:50.275+0000 7fd9c6add700 1 -- 172.21.15.57:0/2095367244 wait complete. 2023-03-02T10:55:50.568 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2023-03-02T10:55:50.568 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2023-03-02T10:55:50.569 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-03-02T10:55:50.569 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-03-02T10:55:50.569 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2023-03-02T10:55:50.569 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-03-02T10:55:50.569 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-03-02T10:55:50.569 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:50 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-03-02T10:55:50.570 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:50 smithi057 ceph-mon[92072]: osdmap e85: 12 total, 12 up, 12 in 2023-03-02T10:55:50.570 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:50 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2095367244' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-03-02T10:55:50.739 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:50.740 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:50 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2023-03-02T10:55:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:50 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2023-03-02T10:55:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:50 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-03-02T10:55:50.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:50 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-03-02T10:55:50.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:50 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2023-03-02T10:55:50.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:50 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-03-02T10:55:50.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:50 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-03-02T10:55:50.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:50 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-03-02T10:55:50.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:50 smithi136 ceph-mon[125702]: osdmap e85: 12 total, 12 up, 12 in 2023-03-02T10:55:50.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:50 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2095367244' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-03-02T10:55:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:50 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2023-03-02T10:55:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:50 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2023-03-02T10:55:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:50 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-03-02T10:55:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:50 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-03-02T10:55:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:50 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2023-03-02T10:55:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:50 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-03-02T10:55:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:50 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-03-02T10:55:50.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:50 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-03-02T10:55:50.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:50 smithi122 ceph-mon[125440]: osdmap e85: 12 total, 12 up, 12 in 2023-03-02T10:55:50.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:50 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2095367244' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-03-02T10:55:51.087 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149749 got 111669149751 for osd.3 2023-03-02T10:55:51.088 DEBUG:teuthology.parallel:result is None 2023-03-02T10:55:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:51 smithi136 ceph-mon[125702]: osdmap e86: 12 total, 12 up, 12 in 2023-03-02T10:55:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:51 smithi136 ceph-mon[125702]: pgmap v287: 97 pgs: 4 peering, 93 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 7 op/s 2023-03-02T10:55:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:51 smithi057 ceph-mon[92072]: osdmap e86: 12 total, 12 up, 12 in 2023-03-02T10:55:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:51 smithi057 ceph-mon[92072]: pgmap v287: 97 pgs: 4 peering, 93 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 7 op/s 2023-03-02T10:55:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:51 smithi122 ceph-mon[125440]: osdmap e86: 12 total, 12 up, 12 in 2023-03-02T10:55:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:51 smithi122 ceph-mon[125440]: pgmap v287: 97 pgs: 4 peering, 93 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 7 op/s 2023-03-02T10:55:51.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.977+0000 7fc6434d9700 1 -- 172.21.15.57:0/1203377328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc63c100e70 msgr2=0x7fc63c101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:51.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.977+0000 7fc6434d9700 1 --2- 172.21.15.57:0/1203377328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc63c100e70 0x7fc63c101240 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc638009990 tx=0x7fc638009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:51.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.977+0000 7fc6434d9700 1 -- 172.21.15.57:0/1203377328 shutdown_connections 2023-03-02T10:55:51.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.977+0000 7fc6434d9700 1 --2- 172.21.15.57:0/1203377328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc63c10a240 0x7fc63c10c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:51.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.977+0000 7fc6434d9700 1 --2- 172.21.15.57:0/1203377328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc63c100e70 0x7fc63c101240 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:51.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.977+0000 7fc6434d9700 1 --2- 172.21.15.57:0/1203377328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc63c101780 0x7fc63c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:51.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.977+0000 7fc6434d9700 1 -- 172.21.15.57:0/1203377328 >> 172.21.15.57:0/1203377328 conn(0x7fc63c075cd0 msgr2=0x7fc63c0760d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:51.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.977+0000 7fc6434d9700 1 -- 172.21.15.57:0/1203377328 shutdown_connections 2023-03-02T10:55:51.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.977+0000 7fc6434d9700 1 -- 172.21.15.57:0/1203377328 wait complete. 2023-03-02T10:55:51.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.978+0000 7fc6434d9700 1 Processor -- start 2023-03-02T10:55:51.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.978+0000 7fc6434d9700 1 -- start start 2023-03-02T10:55:51.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc6434d9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc63c100e70 0x7fc63c0feac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:51.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc6434d9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc63c101780 0x7fc63c0ff000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:51.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc6434d9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc63c10a240 0x7fc63c1a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:51.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc6434d9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0ff830 con 0x7fc63c100e70 2023-03-02T10:55:51.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc6434d9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c1a4430 con 0x7fc63c10a240 2023-03-02T10:55:51.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc6434d9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c1a4570 con 0x7fc63c101780 2023-03-02T10:55:51.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc641275700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc63c100e70 0x7fc63c0feac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:51.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc641275700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc63c100e70 0x7fc63c0feac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48580/0 (socket says 172.21.15.57:48580) 2023-03-02T10:55:51.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc641275700 1 -- 172.21.15.57:0/717215816 learned_addr learned my addr 172.21.15.57:0/717215816 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:51.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc640a74700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc63c101780 0x7fc63c0ff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:51.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc641a76700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc63c10a240 0x7fc63c1a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:51.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc641275700 1 -- 172.21.15.57:0/717215816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc63c101780 msgr2=0x7fc63c0ff000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:51.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc641275700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc63c101780 0x7fc63c0ff000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:51.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc641275700 1 -- 172.21.15.57:0/717215816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc63c10a240 msgr2=0x7fc63c1a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:51.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc641275700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc63c10a240 0x7fc63c1a3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:51.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc641275700 1 -- 172.21.15.57:0/717215816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380095f0 con 0x7fc63c100e70 2023-03-02T10:55:51.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc640a74700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc63c101780 0x7fc63c0ff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:51.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.979+0000 7fc641275700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc63c100e70 0x7fc63c0feac0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc6380095c0 tx=0x7fc63800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:51.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.980+0000 7fc6327fc700 1 -- 172.21.15.57:0/717215816 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63801d070 con 0x7fc63c100e70 2023-03-02T10:55:51.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.980+0000 7fc6327fc700 1 -- 172.21.15.57:0/717215816 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc63800fc00 con 0x7fc63c100e70 2023-03-02T10:55:51.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.980+0000 7fc6434d9700 1 -- 172.21.15.57:0/717215816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c10fcd0 con 0x7fc63c100e70 2023-03-02T10:55:51.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.980+0000 7fc6327fc700 1 -- 172.21.15.57:0/717215816 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638017650 con 0x7fc63c100e70 2023-03-02T10:55:51.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.980+0000 7fc6434d9700 1 -- 172.21.15.57:0/717215816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c10fb40 con 0x7fc63c100e70 2023-03-02T10:55:51.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.981+0000 7fc6434d9700 1 -- 172.21.15.57:0/717215816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63c10fe60 con 0x7fc63c100e70 2023-03-02T10:55:51.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.982+0000 7fc6327fc700 1 -- 172.21.15.57:0/717215816 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fc638029030 con 0x7fc63c100e70 2023-03-02T10:55:51.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.983+0000 7fc6327fc700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc62809b3e0 0x7fc62809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:51.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.983+0000 7fc6327fc700 1 -- 172.21.15.57:0/717215816 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc6380c6370 con 0x7fc63c100e70 2023-03-02T10:55:51.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.983+0000 7fc640a74700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc62809b3e0 0x7fc62809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:51.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.983+0000 7fc640a74700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc62809b3e0 0x7fc62809d890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc62c005950 tx=0x7fc62c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:51.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:51.987+0000 7fc6327fc700 1 -- 172.21.15.57:0/717215816 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fc638091c90 con 0x7fc63c100e70 2023-03-02T10:55:52.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.211+0000 7fc6434d9700 1 -- 172.21.15.57:0/717215816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fc63c100100 con 0x7fc63c100e70 2023-03-02T10:55:52.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.211+0000 7fc6327fc700 1 -- 172.21.15.57:0/717215816 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6380952b0 con 0x7fc63c100e70 2023-03-02T10:55:52.213 INFO:teuthology.orchestra.run.smithi057.stdout:283467841565 2023-03-02T10:55:52.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 -- 172.21.15.57:0/717215816 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc62809b3e0 msgr2=0x7fc62809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:52.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc62809b3e0 0x7fc62809d890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc62c005950 tx=0x7fc62c0058e0 comp rx=0 tx=0).stop 2023-03-02T10:55:52.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 -- 172.21.15.57:0/717215816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc63c100e70 msgr2=0x7fc63c0feac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:52.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc63c100e70 0x7fc63c0feac0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc6380095c0 tx=0x7fc63800f710 comp rx=0 tx=0).stop 2023-03-02T10:55:52.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 -- 172.21.15.57:0/717215816 shutdown_connections 2023-03-02T10:55:52.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc62809b3e0 0x7fc62809d890 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:52.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc63c10a240 0x7fc63c1a3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:52.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc63c100e70 0x7fc63c0feac0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 --2- 172.21.15.57:0/717215816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc63c101780 0x7fc63c0ff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 -- 172.21.15.57:0/717215816 >> 172.21.15.57:0/717215816 conn(0x7fc63c075cd0 msgr2=0x7fc63c0fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 -- 172.21.15.57:0/717215816 shutdown_connections 2023-03-02T10:55:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.214+0000 7fc6434d9700 1 -- 172.21.15.57:0/717215816 wait complete. 2023-03-02T10:55:52.312 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:52.464 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:55:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:52 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/717215816' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-03-02T10:55:52.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.877+0000 7f721734a700 1 -- 172.21.15.57:0/2850297583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210101720 msgr2=0x7f7210109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:52.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.877+0000 7f721734a700 1 --2- 172.21.15.57:0/2850297583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210101720 0x7f7210109c10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7200009990 tx=0x7f7200009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:52.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.877+0000 7f721734a700 1 -- 172.21.15.57:0/2850297583 shutdown_connections 2023-03-02T10:55:52.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.877+0000 7f721734a700 1 --2- 172.21.15.57:0/2850297583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f721010a1f0 0x7f721010c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:52.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.877+0000 7f721734a700 1 --2- 172.21.15.57:0/2850297583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7210100e10 0x7f72101011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:52.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.877+0000 7f721734a700 1 --2- 172.21.15.57:0/2850297583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7210101720 0x7f7210109c10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:52.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.877+0000 7f721734a700 1 -- 172.21.15.57:0/2850297583 >> 172.21.15.57:0/2850297583 conn(0x7f72100fa620 msgr2=0x7f72100fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:52.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.877+0000 7f721734a700 1 -- 172.21.15.57:0/2850297583 shutdown_connections 2023-03-02T10:55:52.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.877+0000 7f721734a700 1 -- 172.21.15.57:0/2850297583 wait complete. 2023-03-02T10:55:52.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.878+0000 7f721734a700 1 Processor -- start 2023-03-02T10:55:52.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.878+0000 7f721734a700 1 -- start start 2023-03-02T10:55:52.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.878+0000 7f721734a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210100e10 0x7f7210197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:52.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.878+0000 7f721734a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7210101720 0x7f7210198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:52.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.878+0000 7f721734a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f721010a1f0 0x7f721019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:52.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.878+0000 7f721734a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721019ced0 con 0x7f721010a1f0 2023-03-02T10:55:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.878+0000 7f721734a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721019d040 con 0x7f7210101720 2023-03-02T10:55:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.878+0000 7f721734a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721019d200 con 0x7f7210100e10 2023-03-02T10:55:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72158e7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f721010a1f0 0x7f721019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72150e6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210100e10 0x7f7210197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72150e6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210100e10 0x7f7210197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:56630/0 (socket says 172.21.15.57:56630) 2023-03-02T10:55:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72158e7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f721010a1f0 0x7f721019c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48600/0 (socket says 172.21.15.57:48600) 2023-03-02T10:55:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72150e6700 1 -- 172.21.15.57:0/2620702353 learned_addr learned my addr 172.21.15.57:0/2620702353 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72148e5700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7210101720 0x7f7210198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72150e6700 1 -- 172.21.15.57:0/2620702353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7210101720 msgr2=0x7f7210198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72150e6700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7210101720 0x7f7210198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72150e6700 1 -- 172.21.15.57:0/2620702353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f721010a1f0 msgr2=0x7f721019c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72150e6700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f721010a1f0 0x7f721019c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72150e6700 1 -- 172.21.15.57:0/2620702353 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72000095f0 con 0x7f7210100e10 2023-03-02T10:55:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.879+0000 7f72158e7700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f721010a1f0 0x7f721019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.880+0000 7f72150e6700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210100e10 0x7f7210197ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f720c00d950 tx=0x7f720c00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:52.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.880+0000 7f72067fc700 1 -- 172.21.15.57:0/2620702353 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c00f890 con 0x7f7210100e10 2023-03-02T10:55:52.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.880+0000 7f721734a700 1 -- 172.21.15.57:0/2620702353 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721010fcc0 con 0x7f7210100e10 2023-03-02T10:55:52.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.880+0000 7f721734a700 1 -- 172.21.15.57:0/2620702353 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721010fb30 con 0x7f7210100e10 2023-03-02T10:55:52.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.880+0000 7f72067fc700 1 -- 172.21.15.57:0/2620702353 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f720c010460 con 0x7f7210100e10 2023-03-02T10:55:52.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.880+0000 7f72067fc700 1 -- 172.21.15.57:0/2620702353 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c00e610 con 0x7f7210100e10 2023-03-02T10:55:52.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.881+0000 7f721734a700 1 -- 172.21.15.57:0/2620702353 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721010fe50 con 0x7f7210100e10 2023-03-02T10:55:52.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.882+0000 7f72067fc700 1 -- 172.21.15.57:0/2620702353 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f720c018030 con 0x7f7210100e10 2023-03-02T10:55:52.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.883+0000 7f72067fc700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f71fc09b460 0x7f71fc09d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:52.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.883+0000 7f72067fc700 1 -- 172.21.15.57:0/2620702353 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f720c0c4f70 con 0x7f7210100e10 2023-03-02T10:55:52.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.883+0000 7f72148e5700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f71fc09b460 0x7f71fc09d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:52.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.884+0000 7f72148e5700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f71fc09b460 0x7f71fc09d910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f720000b5c0 tx=0x7f7200005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:52.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:52.888+0000 7f72067fc700 1 -- 172.21.15.57:0/2620702353 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f720c090800 con 0x7f7210100e10 2023-03-02T10:55:52.908 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:52 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/717215816' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-03-02T10:55:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:52 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/717215816' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-03-02T10:55:53.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.099+0000 7f721734a700 1 -- 172.21.15.57:0/2620702353 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7210066750 con 0x7f7210100e10 2023-03-02T10:55:53.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.100+0000 7f72067fc700 1 -- 172.21.15.57:0/2620702353 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f720c016020 con 0x7f7210100e10 2023-03-02T10:55:53.101 INFO:teuthology.orchestra.run.smithi057.stdout:77309411389 2023-03-02T10:55:53.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 -- 172.21.15.57:0/2620702353 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f71fc09b460 msgr2=0x7f71fc09d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:53.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f71fc09b460 0x7f71fc09d910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f720000b5c0 tx=0x7f7200005960 comp rx=0 tx=0).stop 2023-03-02T10:55:53.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 -- 172.21.15.57:0/2620702353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210100e10 msgr2=0x7f7210197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:53.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210100e10 0x7f7210197ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f720c00d950 tx=0x7f720c00dc60 comp rx=0 tx=0).stop 2023-03-02T10:55:53.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 -- 172.21.15.57:0/2620702353 shutdown_connections 2023-03-02T10:55:53.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f71fc09b460 0x7f71fc09d910 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:53.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f721010a1f0 0x7f721019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:53.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7210100e10 0x7f7210197ef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:53.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 --2- 172.21.15.57:0/2620702353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7210101720 0x7f7210198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:53.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 -- 172.21.15.57:0/2620702353 >> 172.21.15.57:0/2620702353 conn(0x7f72100fa620 msgr2=0x7f72100fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:53.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 -- 172.21.15.57:0/2620702353 shutdown_connections 2023-03-02T10:55:53.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:53.103+0000 7f721734a700 1 -- 172.21.15.57:0/2620702353 wait complete. 2023-03-02T10:55:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:53 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2620702353' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-03-02T10:55:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:53 smithi136 ceph-mon[125702]: pgmap v288: 97 pgs: 4 peering, 93 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2023-03-02T10:55:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:53 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2620702353' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-03-02T10:55:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:53 smithi057 ceph-mon[92072]: pgmap v288: 97 pgs: 4 peering, 93 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2023-03-02T10:55:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:53 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2620702353' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-03-02T10:55:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:53 smithi122 ceph-mon[125440]: pgmap v288: 97 pgs: 4 peering, 93 active+clean; 638 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2023-03-02T10:55:55.297 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841563 got 283467841565 for osd.9 2023-03-02T10:55:55.297 DEBUG:teuthology.parallel:result is None 2023-03-02T10:55:55.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.911+0000 7f21bb663700 1 -- 172.21.15.57:0/878069583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21b4101720 msgr2=0x7f21b4109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:55.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.911+0000 7f21bb663700 1 --2- 172.21.15.57:0/878069583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21b4101720 0x7f21b4109c10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009990 tx=0x7f21a4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:55.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.911+0000 7f21bb663700 1 -- 172.21.15.57:0/878069583 shutdown_connections 2023-03-02T10:55:55.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.911+0000 7f21bb663700 1 --2- 172.21.15.57:0/878069583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21b410a1f0 0x7f21b410c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:55.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.911+0000 7f21bb663700 1 --2- 172.21.15.57:0/878069583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21b4100e10 0x7f21b41011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.911+0000 7f21bb663700 1 --2- 172.21.15.57:0/878069583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21b4101720 0x7f21b4109c10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.911+0000 7f21bb663700 1 -- 172.21.15.57:0/878069583 >> 172.21.15.57:0/878069583 conn(0x7f21b40fa620 msgr2=0x7f21b40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.911+0000 7f21bb663700 1 -- 172.21.15.57:0/878069583 shutdown_connections 2023-03-02T10:55:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.911+0000 7f21bb663700 1 -- 172.21.15.57:0/878069583 wait complete. 2023-03-02T10:55:55.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.912+0000 7f21bb663700 1 Processor -- start 2023-03-02T10:55:55.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.912+0000 7f21bb663700 1 -- start start 2023-03-02T10:55:55.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21bb663700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21b4100e10 0x7f21b4197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:55.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21bb663700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21b4101720 0x7f21b4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:55.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21bb663700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21b410a1f0 0x7f21b419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:55.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21bb663700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b419cf00 con 0x7f21b4100e10 2023-03-02T10:55:55.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21bb663700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b419d070 con 0x7f21b410a1f0 2023-03-02T10:55:55.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21bb663700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b419d230 con 0x7f21b4101720 2023-03-02T10:55:55.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21b93ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21b4100e10 0x7f21b4197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:55.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21b93ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21b4100e10 0x7f21b4197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48620/0 (socket says 172.21.15.57:48620) 2023-03-02T10:55:55.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21b93ff700 1 -- 172.21.15.57:0/1275388313 learned_addr learned my addr 172.21.15.57:0/1275388313 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:55.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21b8bfe700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21b4101720 0x7f21b4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:55.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21b9c00700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21b410a1f0 0x7f21b419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:55.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21b93ff700 1 -- 172.21.15.57:0/1275388313 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21b4101720 msgr2=0x7f21b4198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:55.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21b93ff700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21b4101720 0x7f21b4198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:55.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21b93ff700 1 -- 172.21.15.57:0/1275388313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21b410a1f0 msgr2=0x7f21b419c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:55.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21b93ff700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21b410a1f0 0x7f21b419c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:55.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21b93ff700 1 -- 172.21.15.57:0/1275388313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40095f0 con 0x7f21b4100e10 2023-03-02T10:55:55.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.913+0000 7f21b9c00700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21b410a1f0 0x7f21b419c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:55.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.914+0000 7f21b93ff700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21b4100e10 0x7f21b4197f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f21b000d950 tx=0x7f21b000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:55.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.914+0000 7f21aa7fc700 1 -- 172.21.15.57:0/1275388313 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0009940 con 0x7f21b4100e10 2023-03-02T10:55:55.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.914+0000 7f21aa7fc700 1 -- 172.21.15.57:0/1275388313 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21b0010460 con 0x7f21b4100e10 2023-03-02T10:55:55.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.914+0000 7f21bb663700 1 -- 172.21.15.57:0/1275388313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b410fcd0 con 0x7f21b4100e10 2023-03-02T10:55:55.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.914+0000 7f21aa7fc700 1 -- 172.21.15.57:0/1275388313 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000f620 con 0x7f21b4100e10 2023-03-02T10:55:55.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.914+0000 7f21bb663700 1 -- 172.21.15.57:0/1275388313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b410fb40 con 0x7f21b4100e10 2023-03-02T10:55:55.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.915+0000 7f21bb663700 1 -- 172.21.15.57:0/1275388313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b410fe60 con 0x7f21b4100e10 2023-03-02T10:55:55.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.917+0000 7f21aa7fc700 1 -- 172.21.15.57:0/1275388313 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f21b0022070 con 0x7f21b4100e10 2023-03-02T10:55:55.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.918+0000 7f21aa7fc700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f21a009b3e0 0x7f21a009d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:55.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.918+0000 7f21aa7fc700 1 -- 172.21.15.57:0/1275388313 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f21b00c4c80 con 0x7f21b4100e10 2023-03-02T10:55:55.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.918+0000 7f21b8bfe700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f21a009b3e0 0x7f21a009d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:55.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.919+0000 7f21b8bfe700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f21a009b3e0 0x7f21a009d890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f21b4199530 tx=0x7f21a4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:55.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:55.921+0000 7f21aa7fc700 1 -- 172.21.15.57:0/1275388313 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f21b0090570 con 0x7f21b4100e10 2023-03-02T10:55:56.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.160+0000 7f21bb663700 1 -- 172.21.15.57:0/1275388313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f21b41a4ff0 con 0x7f21b4100e10 2023-03-02T10:55:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:146028888117 2023-03-02T10:55:56.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.161+0000 7f21aa7fc700 1 -- 172.21.15.57:0/1275388313 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21b0020070 con 0x7f21b4100e10 2023-03-02T10:55:56.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 -- 172.21.15.57:0/1275388313 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f21a009b3e0 msgr2=0x7f21a009d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f21a009b3e0 0x7f21a009d890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f21b4199530 tx=0x7f21a4005fd0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 -- 172.21.15.57:0/1275388313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21b4100e10 msgr2=0x7f21b4197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21b4100e10 0x7f21b4197f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f21b000d950 tx=0x7f21b000dc60 comp rx=0 tx=0).stop 2023-03-02T10:55:56.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 -- 172.21.15.57:0/1275388313 shutdown_connections 2023-03-02T10:55:56.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f21a009b3e0 0x7f21a009d890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21b410a1f0 0x7f21b419c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21b4100e10 0x7f21b4197f20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 --2- 172.21.15.57:0/1275388313 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21b4101720 0x7f21b4198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 -- 172.21.15.57:0/1275388313 >> 172.21.15.57:0/1275388313 conn(0x7f21b40fa620 msgr2=0x7f21b40fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:56.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 -- 172.21.15.57:0/1275388313 shutdown_connections 2023-03-02T10:55:56.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.163+0000 7f21bb663700 1 -- 172.21.15.57:0/1275388313 wait complete. 2023-03-02T10:55:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.211+0000 7f84da297700 1 -- 172.21.15.57:0/1046467408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84d40728b0 msgr2=0x7f84d4072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.211+0000 7f84da297700 1 --2- 172.21.15.57:0/1046467408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84d40728b0 0x7f84d4072c80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009990 tx=0x7f84c4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.211+0000 7f84da297700 1 -- 172.21.15.57:0/1046467408 shutdown_connections 2023-03-02T10:55:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.211+0000 7f84da297700 1 --2- 172.21.15.57:0/1046467408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84d410c480 0x7f84d410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.211+0000 7f84da297700 1 --2- 172.21.15.57:0/1046467408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84d40728b0 0x7f84d4072c80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.211+0000 7f84da297700 1 --2- 172.21.15.57:0/1046467408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d40731c0 0x7f84d410bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.211+0000 7f84da297700 1 -- 172.21.15.57:0/1046467408 >> 172.21.15.57:0/1046467408 conn(0x7f84d40fb6a0 msgr2=0x7f84d40fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.211+0000 7f84da297700 1 -- 172.21.15.57:0/1046467408 shutdown_connections 2023-03-02T10:55:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.211+0000 7f84da297700 1 -- 172.21.15.57:0/1046467408 wait complete. 2023-03-02T10:55:56.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.212+0000 7f84da297700 1 Processor -- start 2023-03-02T10:55:56.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.212+0000 7f84da297700 1 -- start start 2023-03-02T10:55:56.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.212+0000 7f84da297700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d40728b0 0x7f84d4197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.212+0000 7f84da297700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84d40731c0 0x7f84d41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.212+0000 7f84da297700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84d410c480 0x7f84d419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.212+0000 7f84da297700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d419ce70 con 0x7f84d410c480 2023-03-02T10:55:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.212+0000 7f84da297700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d419cfe0 con 0x7f84d40728b0 2023-03-02T10:55:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.212+0000 7f84da297700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d419d1a0 con 0x7f84d40731c0 2023-03-02T10:55:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d8834700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84d410c480 0x7f84d419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d3fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d40728b0 0x7f84d4197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d3fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d40728b0 0x7f84d4197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:60498/0 (socket says 172.21.15.57:60498) 2023-03-02T10:55:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d3fff700 1 -- 172.21.15.57:0/3649012892 learned_addr learned my addr 172.21.15.57:0/3649012892 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84cb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84d40731c0 0x7f84d41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d3fff700 1 -- 172.21.15.57:0/3649012892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84d40731c0 msgr2=0x7f84d41983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d3fff700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84d40731c0 0x7f84d41983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d3fff700 1 -- 172.21.15.57:0/3649012892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84d410c480 msgr2=0x7f84d419c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d3fff700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84d410c480 0x7f84d419c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d3fff700 1 -- 172.21.15.57:0/3649012892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c40095f0 con 0x7f84d40728b0 2023-03-02T10:55:56.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d8834700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84d410c480 0x7f84d419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:56.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d3fff700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d40728b0 0x7f84d4197e90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f84c4000c00 tx=0x7f84c40047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:56.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d1ffb700 1 -- 172.21.15.57:0/3649012892 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c401d070 con 0x7f84d40728b0 2023-03-02T10:55:56.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84d1ffb700 1 -- 172.21.15.57:0/3649012892 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84c4021410 con 0x7f84d40728b0 2023-03-02T10:55:56.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.213+0000 7f84da297700 1 -- 172.21.15.57:0/3649012892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d4111dd0 con 0x7f84d40728b0 2023-03-02T10:55:56.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.214+0000 7f84d1ffb700 1 -- 172.21.15.57:0/3649012892 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4017650 con 0x7f84d40728b0 2023-03-02T10:55:56.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.214+0000 7f84da297700 1 -- 172.21.15.57:0/3649012892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d4111c40 con 0x7f84d40728b0 2023-03-02T10:55:56.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.214+0000 7f84da297700 1 -- 172.21.15.57:0/3649012892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d4111f60 con 0x7f84d40728b0 2023-03-02T10:55:56.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.216+0000 7f84d1ffb700 1 -- 172.21.15.57:0/3649012892 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f84c4028030 con 0x7f84d40728b0 2023-03-02T10:55:56.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.217+0000 7f84d1ffb700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f84c009b3e0 0x7f84c009d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:56.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.217+0000 7f84d1ffb700 1 -- 172.21.15.57:0/3649012892 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f84c40c6730 con 0x7f84d40728b0 2023-03-02T10:55:56.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.217+0000 7f84cb7fe700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f84c009b3e0 0x7f84c009d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:56.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.218+0000 7f84cb7fe700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f84c009b3e0 0x7f84c009d890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f84d41994a0 tx=0x7f84bc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:56.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.220+0000 7f84d1ffb700 1 -- 172.21.15.57:0/3649012892 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f84c4092050 con 0x7f84d40728b0 2023-03-02T10:55:56.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.434+0000 7f84da297700 1 -- 172.21.15.57:0/3649012892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84d4066750 con 0x7f84d40728b0 2023-03-02T10:55:56.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.435+0000 7f84d1ffb700 1 -- 172.21.15.57:0/3649012892 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84c4026090 con 0x7f84d40728b0 2023-03-02T10:55:56.436 INFO:teuthology.orchestra.run.smithi057.stdout:34359738439 2023-03-02T10:55:56.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 -- 172.21.15.57:0/3649012892 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f84c009b3e0 msgr2=0x7f84c009d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f84c009b3e0 0x7f84c009d890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f84d41994a0 tx=0x7f84bc009260 comp rx=0 tx=0).stop 2023-03-02T10:55:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 -- 172.21.15.57:0/3649012892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d40728b0 msgr2=0x7f84d4197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d40728b0 0x7f84d4197e90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f84c4000c00 tx=0x7f84c40047b0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 -- 172.21.15.57:0/3649012892 shutdown_connections 2023-03-02T10:55:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f84c009b3e0 0x7f84c009d890 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84d410c480 0x7f84d419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d40728b0 0x7f84d4197e90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 --2- 172.21.15.57:0/3649012892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84d40731c0 0x7f84d41983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 -- 172.21.15.57:0/3649012892 >> 172.21.15.57:0/3649012892 conn(0x7f84d40fb6a0 msgr2=0x7f84d410e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 -- 172.21.15.57:0/3649012892 shutdown_connections 2023-03-02T10:55:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.437+0000 7f84da297700 1 -- 172.21.15.57:0/3649012892 wait complete. 2023-03-02T10:55:56.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.440+0000 7fd56c6af700 1 -- 172.21.15.57:0/68179118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd56410a210 msgr2=0x7fd56410c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.440+0000 7fd56c6af700 1 --2- 172.21.15.57:0/68179118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd56410a210 0x7fd56410c680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009f90 tx=0x7fd55c00b330 comp rx=0 tx=0).stop 2023-03-02T10:55:56.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.441+0000 7fd56c6af700 1 -- 172.21.15.57:0/68179118 shutdown_connections 2023-03-02T10:55:56.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.441+0000 7fd56c6af700 1 --2- 172.21.15.57:0/68179118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd56410a210 0x7fd56410c680 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.441+0000 7fd56c6af700 1 --2- 172.21.15.57:0/68179118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd564100cf0 0x7fd5641010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.441+0000 7fd56c6af700 1 --2- 172.21.15.57:0/68179118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd564101690 0x7fd564109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.441+0000 7fd56c6af700 1 -- 172.21.15.57:0/68179118 >> 172.21.15.57:0/68179118 conn(0x7fd5640fa620 msgr2=0x7fd5640fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:56.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.441+0000 7fd56c6af700 1 -- 172.21.15.57:0/68179118 shutdown_connections 2023-03-02T10:55:56.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.441+0000 7fd56c6af700 1 -- 172.21.15.57:0/68179118 wait complete. 2023-03-02T10:55:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.441+0000 7fd56c6af700 1 Processor -- start 2023-03-02T10:55:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd56c6af700 1 -- start start 2023-03-02T10:55:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd56c6af700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd564100cf0 0x7fd564195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:56.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd56c6af700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd564101690 0x7fd5641962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:56.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd56c6af700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd56410a210 0x7fd56419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:56.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd56c6af700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56419ad70 con 0x7fd564101690 2023-03-02T10:55:56.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd56c6af700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56419aee0 con 0x7fd564100cf0 2023-03-02T10:55:56.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd56c6af700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56419b0a0 con 0x7fd56410a210 2023-03-02T10:55:56.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd569c4a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd564101690 0x7fd5641962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:56.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd569c4a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd564101690 0x7fd5641962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52960/0 (socket says 172.21.15.57:52960) 2023-03-02T10:55:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd569c4a700 1 -- 172.21.15.57:0/1289551050 learned_addr learned my addr 172.21.15.57:0/1289551050 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd56a44b700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd564100cf0 0x7fd564195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.442+0000 7fd56ac4c700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd56410a210 0x7fd56419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.443+0000 7fd569c4a700 1 -- 172.21.15.57:0/1289551050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd56410a210 msgr2=0x7fd56419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.443+0000 7fd569c4a700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd56410a210 0x7fd56419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.443+0000 7fd569c4a700 1 -- 172.21.15.57:0/1289551050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd564100cf0 msgr2=0x7fd564195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.443+0000 7fd569c4a700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd564100cf0 0x7fd564195d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.443+0000 7fd569c4a700 1 -- 172.21.15.57:0/1289551050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c009c40 con 0x7fd564101690 2023-03-02T10:55:56.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.443+0000 7fd569c4a700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd564101690 0x7fd5641962d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd55400d980 tx=0x7fd55400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:56.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.443+0000 7fd55b7fe700 1 -- 172.21.15.57:0/1289551050 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554004220 con 0x7fd564101690 2023-03-02T10:55:56.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.443+0000 7fd56c6af700 1 -- 172.21.15.57:0/1289551050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56410fcb0 con 0x7fd564101690 2023-03-02T10:55:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.443+0000 7fd55b7fe700 1 -- 172.21.15.57:0/1289551050 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd554007640 con 0x7fd564101690 2023-03-02T10:55:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.443+0000 7fd55b7fe700 1 -- 172.21.15.57:0/1289551050 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554005580 con 0x7fd564101690 2023-03-02T10:55:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.443+0000 7fd56c6af700 1 -- 172.21.15.57:0/1289551050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56410fb20 con 0x7fd564101690 2023-03-02T10:55:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.444+0000 7fd56c6af700 1 -- 172.21.15.57:0/1289551050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56410fe40 con 0x7fd564101690 2023-03-02T10:55:56.448 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:56 smithi057 ceph-mon[92072]: pgmap v289: 97 pgs: 4 peering, 93 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2023-03-02T10:55:56.448 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:56 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1275388313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-03-02T10:55:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.447+0000 7fd55b7fe700 1 -- 172.21.15.57:0/1289551050 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fd554021070 con 0x7fd564101690 2023-03-02T10:55:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.448+0000 7fd55b7fe700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd55009b3e0 0x7fd55009d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.448+0000 7fd55b7fe700 1 -- 172.21.15.57:0/1289551050 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd5540c4bc0 con 0x7fd564101690 2023-03-02T10:55:56.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.448+0000 7fd56a44b700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd55009b3e0 0x7fd55009d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:56.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.449+0000 7fd56a44b700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd55009b3e0 0x7fd55009d890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd560005fd0 tx=0x7fd560009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:56.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.454+0000 7fd55b7fe700 1 -- 172.21.15.57:0/1289551050 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fd5540904b0 con 0x7fd564101690 2023-03-02T10:55:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:56 smithi136 ceph-mon[125702]: pgmap v289: 97 pgs: 4 peering, 93 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2023-03-02T10:55:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:56 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1275388313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-03-02T10:55:56.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.668+0000 7fd56c6af700 1 -- 172.21.15.57:0/1289551050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fd564104b10 con 0x7fd564101690 2023-03-02T10:55:56.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.669+0000 7fd55b7fe700 1 -- 172.21.15.57:0/1289551050 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd554016030 con 0x7fd564101690 2023-03-02T10:55:56.671 INFO:teuthology.orchestra.run.smithi057.stdout:253403070498 2023-03-02T10:55:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 -- 172.21.15.57:0/1289551050 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd55009b3e0 msgr2=0x7fd55009d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd55009b3e0 0x7fd55009d890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd560005fd0 tx=0x7fd560009310 comp rx=0 tx=0).stop 2023-03-02T10:55:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 -- 172.21.15.57:0/1289551050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd564101690 msgr2=0x7fd5641962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd564101690 0x7fd5641962d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd55400d980 tx=0x7fd55400dc90 comp rx=0 tx=0).stop 2023-03-02T10:55:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 -- 172.21.15.57:0/1289551050 shutdown_connections 2023-03-02T10:55:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd55009b3e0 0x7fd55009d890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd56410a210 0x7fd56419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd564100cf0 0x7fd564195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 --2- 172.21.15.57:0/1289551050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd564101690 0x7fd5641962d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 -- 172.21.15.57:0/1289551050 >> 172.21.15.57:0/1289551050 conn(0x7fd5640fa620 msgr2=0x7fd564101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 -- 172.21.15.57:0/1289551050 shutdown_connections 2023-03-02T10:55:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:56.671+0000 7fd56c6af700 1 -- 172.21.15.57:0/1289551050 wait complete. 2023-03-02T10:55:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:56 smithi122 ceph-mon[125440]: pgmap v289: 97 pgs: 4 peering, 93 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2023-03-02T10:55:56.831 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:56 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1275388313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-03-02T10:55:57.195 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411387 got 77309411389 for osd.2 2023-03-02T10:55:57.195 DEBUG:teuthology.parallel:result is None 2023-03-02T10:55:57.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.111+0000 7fd4289a8700 1 -- 172.21.15.57:0/1715775512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd424101720 msgr2=0x7fd424109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:57.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.111+0000 7fd4289a8700 1 --2- 172.21.15.57:0/1715775512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd424101720 0x7fd424109c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd418009990 tx=0x7fd418009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.111+0000 7fd4289a8700 1 -- 172.21.15.57:0/1715775512 shutdown_connections 2023-03-02T10:55:57.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.111+0000 7fd4289a8700 1 --2- 172.21.15.57:0/1715775512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42410a1f0 0x7fd42410c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.111+0000 7fd4289a8700 1 --2- 172.21.15.57:0/1715775512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd424100e10 0x7fd4241011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.111+0000 7fd4289a8700 1 --2- 172.21.15.57:0/1715775512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd424101720 0x7fd424109c10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.111+0000 7fd4289a8700 1 -- 172.21.15.57:0/1715775512 >> 172.21.15.57:0/1715775512 conn(0x7fd4240fa620 msgr2=0x7fd4240fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:57.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.111+0000 7fd4289a8700 1 -- 172.21.15.57:0/1715775512 shutdown_connections 2023-03-02T10:55:57.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.111+0000 7fd4289a8700 1 -- 172.21.15.57:0/1715775512 wait complete. 2023-03-02T10:55:57.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.112+0000 7fd4289a8700 1 Processor -- start 2023-03-02T10:55:57.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.112+0000 7fd4289a8700 1 -- start start 2023-03-02T10:55:57.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.112+0000 7fd4289a8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd424100e10 0x7fd424195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:57.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.112+0000 7fd4289a8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd424101720 0x7fd424196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:57.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.112+0000 7fd4289a8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd42410a1f0 0x7fd42419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:57.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.112+0000 7fd4289a8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42419ad00 con 0x7fd424100e10 2023-03-02T10:55:57.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.112+0000 7fd4289a8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42419ae70 con 0x7fd424101720 2023-03-02T10:55:57.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.112+0000 7fd4289a8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42419b030 con 0x7fd42410a1f0 2023-03-02T10:55:57.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd42259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd424100e10 0x7fd424195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:57.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd42259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd424100e10 0x7fd424195d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52970/0 (socket says 172.21.15.57:52970) 2023-03-02T10:55:57.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd42259c700 1 -- 172.21.15.57:0/4253378253 learned_addr learned my addr 172.21.15.57:0/4253378253 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:57.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd421d9b700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd424101720 0x7fd424196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd422d9d700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd42410a1f0 0x7fd42419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd42259c700 1 -- 172.21.15.57:0/4253378253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd42410a1f0 msgr2=0x7fd42419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd42259c700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd42410a1f0 0x7fd42419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd42259c700 1 -- 172.21.15.57:0/4253378253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd424101720 msgr2=0x7fd424196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd42259c700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd424101720 0x7fd424196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd42259c700 1 -- 172.21.15.57:0/4253378253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4180095f0 con 0x7fd424100e10 2023-03-02T10:55:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd422d9d700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd42410a1f0 0x7fd42419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:55:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.113+0000 7fd42259c700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd424100e10 0x7fd424195d20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd41400b550 tx=0x7fd41400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.114+0000 7fd4137fe700 1 -- 172.21.15.57:0/4253378253 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414011830 con 0x7fd424100e10 2023-03-02T10:55:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.114+0000 7fd4137fe700 1 -- 172.21.15.57:0/4253378253 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd414011e50 con 0x7fd424100e10 2023-03-02T10:55:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.114+0000 7fd4137fe700 1 -- 172.21.15.57:0/4253378253 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41400f2e0 con 0x7fd424100e10 2023-03-02T10:55:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.114+0000 7fd4289a8700 1 -- 172.21.15.57:0/4253378253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42410fd50 con 0x7fd424100e10 2023-03-02T10:55:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.114+0000 7fd4289a8700 1 -- 172.21.15.57:0/4253378253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42410fbc0 con 0x7fd424100e10 2023-03-02T10:55:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.115+0000 7fd4289a8700 1 -- 172.21.15.57:0/4253378253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42410fee0 con 0x7fd424100e10 2023-03-02T10:55:57.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.117+0000 7fd4137fe700 1 -- 172.21.15.57:0/4253378253 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fd414021070 con 0x7fd424100e10 2023-03-02T10:55:57.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.118+0000 7fd4137fe700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd40c09b460 0x7fd40c09d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:57.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.118+0000 7fd4137fe700 1 -- 172.21.15.57:0/4253378253 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd4140c4890 con 0x7fd424100e10 2023-03-02T10:55:57.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.118+0000 7fd421d9b700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd40c09b460 0x7fd40c09d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:57.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.119+0000 7fd421d9b700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd40c09b460 0x7fd40c09d910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd424197330 tx=0x7fd41800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:57.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.123+0000 7fd4137fe700 1 -- 172.21.15.57:0/4253378253 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fd414090120 con 0x7fd424100e10 2023-03-02T10:55:57.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.343+0000 7fd4289a8700 1 -- 172.21.15.57:0/4253378253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fd424197070 con 0x7fd424100e10 2023-03-02T10:55:57.344 INFO:teuthology.orchestra.run.smithi057.stdout:339302416406 2023-03-02T10:55:57.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.343+0000 7fd4137fe700 1 -- 172.21.15.57:0/4253378253 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fd414015070 con 0x7fd424100e10 2023-03-02T10:55:57.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 -- 172.21.15.57:0/4253378253 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd40c09b460 msgr2=0x7fd40c09d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:57.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd40c09b460 0x7fd40c09d910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd424197330 tx=0x7fd41800b260 comp rx=0 tx=0).stop 2023-03-02T10:55:57.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 -- 172.21.15.57:0/4253378253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd424100e10 msgr2=0x7fd424195d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:57.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd424100e10 0x7fd424195d20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd41400b550 tx=0x7fd41400b860 comp rx=0 tx=0).stop 2023-03-02T10:55:57.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 -- 172.21.15.57:0/4253378253 shutdown_connections 2023-03-02T10:55:57.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd40c09b460 0x7fd40c09d910 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd42410a1f0 0x7fd42419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd424100e10 0x7fd424195d20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 --2- 172.21.15.57:0/4253378253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd424101720 0x7fd424196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 -- 172.21.15.57:0/4253378253 >> 172.21.15.57:0/4253378253 conn(0x7fd4240fa620 msgr2=0x7fd424101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:57.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 -- 172.21.15.57:0/4253378253 shutdown_connections 2023-03-02T10:55:57.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.347+0000 7fd4289a8700 1 -- 172.21.15.57:0/4253378253 wait complete. 2023-03-02T10:55:57.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.433+0000 7f1742660700 1 -- 172.21.15.57:0/911983295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173c101720 msgr2=0x7f173c109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:57.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.433+0000 7f1742660700 1 --2- 172.21.15.57:0/911983295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173c101720 0x7f173c109c10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1730009990 tx=0x7f1730009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.433+0000 7f1742660700 1 -- 172.21.15.57:0/911983295 shutdown_connections 2023-03-02T10:55:57.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.433+0000 7f1742660700 1 --2- 172.21.15.57:0/911983295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f173c10a1f0 0x7f173c10c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.433+0000 7f1742660700 1 --2- 172.21.15.57:0/911983295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f173c100e10 0x7f173c1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.433+0000 7f1742660700 1 --2- 172.21.15.57:0/911983295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173c101720 0x7f173c109c10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.433+0000 7f1742660700 1 -- 172.21.15.57:0/911983295 >> 172.21.15.57:0/911983295 conn(0x7f173c0fa620 msgr2=0x7f173c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:57.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.433+0000 7f1742660700 1 -- 172.21.15.57:0/911983295 shutdown_connections 2023-03-02T10:55:57.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.433+0000 7f1742660700 1 -- 172.21.15.57:0/911983295 wait complete. 2023-03-02T10:55:57.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.434+0000 7f1742660700 1 Processor -- start 2023-03-02T10:55:57.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.434+0000 7f1742660700 1 -- start start 2023-03-02T10:55:57.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f1742660700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f173c100e10 0x7f173c19b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:57.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f1742660700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173c101720 0x7f173c19bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f1742660700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f173c10a1f0 0x7f173c195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f1742660700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c1960d0 con 0x7f173c101720 2023-03-02T10:55:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f1742660700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c196240 con 0x7f173c10a1f0 2023-03-02T10:55:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f1742660700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c196400 con 0x7f173c100e10 2023-03-02T10:55:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f173b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173c101720 0x7f173c19bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f173b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173c101720 0x7f173c19bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52990/0 (socket says 172.21.15.57:52990) 2023-03-02T10:55:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f173b7fe700 1 -- 172.21.15.57:0/959053174 learned_addr learned my addr 172.21.15.57:0/959053174 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f173bfff700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f173c100e10 0x7f173c19b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:57.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f1740bfd700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f173c10a1f0 0x7f173c195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:57.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f173b7fe700 1 -- 172.21.15.57:0/959053174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f173c100e10 msgr2=0x7f173c19b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:57.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f173b7fe700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f173c100e10 0x7f173c19b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f173b7fe700 1 -- 172.21.15.57:0/959053174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f173c10a1f0 msgr2=0x7f173c195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:57.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f173b7fe700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f173c10a1f0 0x7f173c195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.435+0000 7f173b7fe700 1 -- 172.21.15.57:0/959053174 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17300095f0 con 0x7f173c101720 2023-03-02T10:55:57.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.436+0000 7f173b7fe700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173c101720 0x7f173c19bf30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1730000c00 tx=0x7f173000f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.436+0000 7f17397fa700 1 -- 172.21.15.57:0/959053174 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173001d070 con 0x7f173c101720 2023-03-02T10:55:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.436+0000 7f17397fa700 1 -- 172.21.15.57:0/959053174 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f173000fce0 con 0x7f173c101720 2023-03-02T10:55:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.436+0000 7f1742660700 1 -- 172.21.15.57:0/959053174 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c10fcc0 con 0x7f173c101720 2023-03-02T10:55:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.436+0000 7f17397fa700 1 -- 172.21.15.57:0/959053174 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300176e0 con 0x7f173c101720 2023-03-02T10:55:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.436+0000 7f1742660700 1 -- 172.21.15.57:0/959053174 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173c10fb30 con 0x7f173c101720 2023-03-02T10:55:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.437+0000 7f1742660700 1 -- 172.21.15.57:0/959053174 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173c10fe50 con 0x7f173c101720 2023-03-02T10:55:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.438+0000 7f17397fa700 1 -- 172.21.15.57:0/959053174 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f1730029030 con 0x7f173c101720 2023-03-02T10:55:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.439+0000 7f17397fa700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f172409b3e0 0x7f172409d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.439+0000 7f17397fa700 1 -- 172.21.15.57:0/959053174 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f17300c62a0 con 0x7f173c101720 2023-03-02T10:55:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.439+0000 7f173bfff700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f172409b3e0 0x7f172409d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:57.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.440+0000 7f173bfff700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f172409b3e0 0x7f172409d890 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f172c005fd0 tx=0x7f172c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.443+0000 7f17397fa700 1 -- 172.21.15.57:0/959053174 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f173005b800 con 0x7f173c101720 2023-03-02T10:55:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:57 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3649012892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-03-02T10:55:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:57 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1289551050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-03-02T10:55:57.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.646+0000 7f1742660700 1 -- 172.21.15.57:0/959053174 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f173c104a70 con 0x7f173c101720 2023-03-02T10:55:57.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.646+0000 7f17397fa700 1 -- 172.21.15.57:0/959053174 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1730091bc0 con 0x7f173c101720 2023-03-02T10:55:57.647 INFO:teuthology.orchestra.run.smithi057.stdout:55834574914 2023-03-02T10:55:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.648+0000 7f1742660700 1 -- 172.21.15.57:0/959053174 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f172409b3e0 msgr2=0x7f172409d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.648+0000 7f1742660700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f172409b3e0 0x7f172409d890 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f172c005fd0 tx=0x7f172c00a560 comp rx=0 tx=0).stop 2023-03-02T10:55:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.648+0000 7f1742660700 1 -- 172.21.15.57:0/959053174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173c101720 msgr2=0x7f173c19bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.648+0000 7f1742660700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173c101720 0x7f173c19bf30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1730000c00 tx=0x7f173000f830 comp rx=0 tx=0).stop 2023-03-02T10:55:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.648+0000 7f1742660700 1 -- 172.21.15.57:0/959053174 shutdown_connections 2023-03-02T10:55:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.648+0000 7f1742660700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f172409b3e0 0x7f172409d890 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.648+0000 7f1742660700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f173c10a1f0 0x7f173c195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.648+0000 7f1742660700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f173c100e10 0x7f173c19b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.648+0000 7f1742660700 1 --2- 172.21.15.57:0/959053174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173c101720 0x7f173c19bf30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.648+0000 7f1742660700 1 -- 172.21.15.57:0/959053174 >> 172.21.15.57:0/959053174 conn(0x7f173c0fa620 msgr2=0x7f173c101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.648+0000 7f1742660700 1 -- 172.21.15.57:0/959053174 shutdown_connections 2023-03-02T10:55:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:57.649+0000 7f1742660700 1 -- 172.21.15.57:0/959053174 wait complete. 2023-03-02T10:55:57.668 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:57 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3649012892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-03-02T10:55:57.668 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:57 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1289551050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-03-02T10:55:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:57 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3649012892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-03-02T10:55:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:57 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1289551050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-03-02T10:55:57.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070496 got 253403070498 for osd.8 2023-03-02T10:55:57.873 DEBUG:teuthology.parallel:result is None 2023-03-02T10:55:58.413 INFO:tasks.cephadm.ceph_manager.ceph:need seq 339302416403 got 339302416406 for osd.11 2023-03-02T10:55:58.414 DEBUG:teuthology.parallel:result is None 2023-03-02T10:55:58.557 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:58 smithi057 ceph-mon[92072]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2 op/s; 91 B/s, 1 keys/s, 2 objects/s recovering 2023-03-02T10:55:58.557 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:58 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/4253378253' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-03-02T10:55:58.557 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:58 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/959053174' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-03-02T10:55:58.576 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738437 got 34359738439 for osd.0 2023-03-02T10:55:58.576 DEBUG:teuthology.parallel:result is None 2023-03-02T10:55:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:58 smithi136 ceph-mon[125702]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2 op/s; 91 B/s, 1 keys/s, 2 objects/s recovering 2023-03-02T10:55:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:58 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/4253378253' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-03-02T10:55:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:58 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/959053174' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-03-02T10:55:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:58 smithi122 ceph-mon[125440]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2 op/s; 91 B/s, 1 keys/s, 2 objects/s recovering 2023-03-02T10:55:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:58 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/4253378253' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-03-02T10:55:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:58 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/959053174' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-03-02T10:55:59.008 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888114 got 146028888117 for osd.4 2023-03-02T10:55:59.009 DEBUG:teuthology.parallel:result is None 2023-03-02T10:55:59.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.322+0000 7f032dd6f700 1 -- 172.21.15.57:0/3422382398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f032810a1f0 msgr2=0x7f032810c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.322+0000 7f032dd6f700 1 --2- 172.21.15.57:0/3422382398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f032810a1f0 0x7f032810c680 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f032000b0a0 tx=0x7f032000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.322+0000 7f032dd6f700 1 -- 172.21.15.57:0/3422382398 shutdown_connections 2023-03-02T10:55:59.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.322+0000 7f032dd6f700 1 --2- 172.21.15.57:0/3422382398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f032810a1f0 0x7f032810c680 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.322+0000 7f032dd6f700 1 --2- 172.21.15.57:0/3422382398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0328100e10 0x7f03281011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.322+0000 7f032dd6f700 1 --2- 172.21.15.57:0/3422382398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0328101720 0x7f0328109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.322+0000 7f032dd6f700 1 -- 172.21.15.57:0/3422382398 >> 172.21.15.57:0/3422382398 conn(0x7f03280fa620 msgr2=0x7f03280fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:59.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.322+0000 7f032dd6f700 1 -- 172.21.15.57:0/3422382398 shutdown_connections 2023-03-02T10:55:59.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.322+0000 7f032dd6f700 1 -- 172.21.15.57:0/3422382398 wait complete. 2023-03-02T10:55:59.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.323+0000 7f032dd6f700 1 Processor -- start 2023-03-02T10:55:59.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.323+0000 7f032dd6f700 1 -- start start 2023-03-02T10:55:59.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.323+0000 7f032dd6f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0328100e10 0x7f03280fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.323+0000 7f032dd6f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0328101720 0x7f03280fefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f032dd6f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f032810a1f0 0x7f03281a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f032dd6f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03280ff7d0 con 0x7f0328100e10 2023-03-02T10:55:59.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f032dd6f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03281a44a0 con 0x7f032810a1f0 2023-03-02T10:55:59.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f032dd6f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03281a45e0 con 0x7f0328101720 2023-03-02T10:55:59.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f0327fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f032810a1f0 0x7f03281a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f03277fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0328100e10 0x7f03280fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f0327fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f032810a1f0 0x7f03281a3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:60554/0 (socket says 172.21.15.57:60554) 2023-03-02T10:55:59.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f0327fff700 1 -- 172.21.15.57:0/619242188 learned_addr learned my addr 172.21.15.57:0/619242188 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:59.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f0326ffd700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0328101720 0x7f03280fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f0327fff700 1 -- 172.21.15.57:0/619242188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0328101720 msgr2=0x7f03280fefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f0327fff700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0328101720 0x7f03280fefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f0327fff700 1 -- 172.21.15.57:0/619242188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0328100e10 msgr2=0x7f03280fea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f0327fff700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0328100e10 0x7f03280fea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f0327fff700 1 -- 172.21.15.57:0/619242188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0320009d00 con 0x7f032810a1f0 2023-03-02T10:55:59.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f03277fe700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0328100e10 0x7f03280fea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:55:59.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.324+0000 7f0327fff700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f032810a1f0 0x7f03281a3f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f032000b780 tx=0x7f0320007990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:59.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.325+0000 7f0324ff9700 1 -- 172.21.15.57:0/619242188 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032000e040 con 0x7f032810a1f0 2023-03-02T10:55:59.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.325+0000 7f0324ff9700 1 -- 172.21.15.57:0/619242188 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f032001d470 con 0x7f032810a1f0 2023-03-02T10:55:59.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.325+0000 7f032dd6f700 1 -- 172.21.15.57:0/619242188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032810fcb0 con 0x7f032810a1f0 2023-03-02T10:55:59.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.325+0000 7f0324ff9700 1 -- 172.21.15.57:0/619242188 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200052a0 con 0x7f032810a1f0 2023-03-02T10:55:59.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.325+0000 7f032dd6f700 1 -- 172.21.15.57:0/619242188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032810fb20 con 0x7f032810a1f0 2023-03-02T10:55:59.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.326+0000 7f032dd6f700 1 -- 172.21.15.57:0/619242188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032810fe40 con 0x7f032810a1f0 2023-03-02T10:55:59.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.329+0000 7f0324ff9700 1 -- 172.21.15.57:0/619242188 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f032001d8c0 con 0x7f032810a1f0 2023-03-02T10:55:59.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.330+0000 7f0324ff9700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f031009b3e0 0x7f031009d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.330+0000 7f0324ff9700 1 -- 172.21.15.57:0/619242188 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f03200c6870 con 0x7f032810a1f0 2023-03-02T10:55:59.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.330+0000 7f03277fe700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f031009b3e0 0x7f031009d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.331+0000 7f03277fe700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f031009b3e0 0x7f031009d890 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0318011490 tx=0x7f0318009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:59.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.332+0000 7f0324ff9700 1 -- 172.21.15.57:0/619242188 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f0320092190 con 0x7f032810a1f0 2023-03-02T10:55:59.348 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574911 got 55834574914 for osd.1 2023-03-02T10:55:59.349 DEBUG:teuthology.parallel:result is None 2023-03-02T10:55:59.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.285+0000 7fbdf9aab700 1 -- 172.21.15.57:0/3822094654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4101720 msgr2=0x7fbdf4109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.285+0000 7fbdf9aab700 1 --2- 172.21.15.57:0/3822094654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4101720 0x7fbdf4109c10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009990 tx=0x7fbde8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.285+0000 7fbdf9aab700 1 -- 172.21.15.57:0/3822094654 shutdown_connections 2023-03-02T10:55:59.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.285+0000 7fbdf9aab700 1 --2- 172.21.15.57:0/3822094654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdf410a1f0 0x7fbdf410c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.285+0000 7fbdf9aab700 1 --2- 172.21.15.57:0/3822094654 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdf4100e10 0x7fbdf41011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.285+0000 7fbdf9aab700 1 --2- 172.21.15.57:0/3822094654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4101720 0x7fbdf4109c10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.285+0000 7fbdf9aab700 1 -- 172.21.15.57:0/3822094654 >> 172.21.15.57:0/3822094654 conn(0x7fbdf40fa620 msgr2=0x7fbdf40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:59.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.285+0000 7fbdf9aab700 1 -- 172.21.15.57:0/3822094654 shutdown_connections 2023-03-02T10:55:59.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.285+0000 7fbdf9aab700 1 -- 172.21.15.57:0/3822094654 wait complete. 2023-03-02T10:55:59.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.286+0000 7fbdf9aab700 1 Processor -- start 2023-03-02T10:55:59.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.286+0000 7fbdf9aab700 1 -- start start 2023-03-02T10:55:59.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf9aab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4100e10 0x7fbdf4195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf9aab700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdf4101720 0x7fbdf4196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf9aab700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdf410a1f0 0x7fbdf419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf9aab700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf419ad00 con 0x7fbdf4100e10 2023-03-02T10:55:59.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf9aab700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf419ae70 con 0x7fbdf4101720 2023-03-02T10:55:59.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf9aab700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf419b030 con 0x7fbdf410a1f0 2023-03-02T10:55:59.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4100e10 0x7fbdf4195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4100e10 0x7fbdf4195d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53002/0 (socket says 172.21.15.57:53002) 2023-03-02T10:55:59.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf37fe700 1 -- 172.21.15.57:0/491275717 learned_addr learned my addr 172.21.15.57:0/491275717 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:59.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf2ffd700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdf4101720 0x7fbdf4196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf3fff700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdf410a1f0 0x7fbdf419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf37fe700 1 -- 172.21.15.57:0/491275717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdf410a1f0 msgr2=0x7fbdf419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf37fe700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdf410a1f0 0x7fbdf419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf37fe700 1 -- 172.21.15.57:0/491275717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdf4101720 msgr2=0x7fbdf4196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf37fe700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdf4101720 0x7fbdf4196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf37fe700 1 -- 172.21.15.57:0/491275717 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80095f0 con 0x7fbdf4100e10 2023-03-02T10:55:59.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf37fe700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4100e10 0x7fbdf4195d20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbde400d950 tx=0x7fbde400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:59.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.287+0000 7fbdf0ff9700 1 -- 172.21.15.57:0/491275717 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4009940 con 0x7fbdf4100e10 2023-03-02T10:55:59.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.288+0000 7fbdf0ff9700 1 -- 172.21.15.57:0/491275717 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbde4010460 con 0x7fbdf4100e10 2023-03-02T10:55:59.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.288+0000 7fbdf9aab700 1 -- 172.21.15.57:0/491275717 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf410fcc0 con 0x7fbdf4100e10 2023-03-02T10:55:59.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.288+0000 7fbdf0ff9700 1 -- 172.21.15.57:0/491275717 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde400f620 con 0x7fbdf4100e10 2023-03-02T10:55:59.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.288+0000 7fbdf9aab700 1 -- 172.21.15.57:0/491275717 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf410fb30 con 0x7fbdf4100e10 2023-03-02T10:55:59.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.289+0000 7fbdf9aab700 1 -- 172.21.15.57:0/491275717 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf410fe50 con 0x7fbdf4100e10 2023-03-02T10:55:59.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.290+0000 7fbdf0ff9700 1 -- 172.21.15.57:0/491275717 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fbde4022070 con 0x7fbdf4100e10 2023-03-02T10:55:59.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.291+0000 7fbdf0ff9700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbddc09b3e0 0x7fbddc09d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.291+0000 7fbdf0ff9700 1 -- 172.21.15.57:0/491275717 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbde40c4d40 con 0x7fbdf4100e10 2023-03-02T10:55:59.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.291+0000 7fbdf2ffd700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbddc09b3e0 0x7fbddc09d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.292+0000 7fbdf2ffd700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbddc09b3e0 0x7fbddc09d890 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4197330 tx=0x7fbde8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:59.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.295+0000 7fbdf0ff9700 1 -- 172.21.15.57:0/491275717 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fbde40905d0 con 0x7fbdf4100e10 2023-03-02T10:55:59.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.508+0000 7fbdf9aab700 1 -- 172.21.15.57:0/491275717 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbdf4104a70 con 0x7fbdf4100e10 2023-03-02T10:55:59.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.508+0000 7fbdf0ff9700 1 -- 172.21.15.57:0/491275717 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbde4020020 con 0x7fbdf4100e10 2023-03-02T10:55:59.510 INFO:teuthology.orchestra.run.smithi057.stdout:167503724591 2023-03-02T10:55:59.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 -- 172.21.15.57:0/491275717 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbddc09b3e0 msgr2=0x7fbddc09d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbddc09b3e0 0x7fbddc09d890 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4197330 tx=0x7fbde8005fd0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 -- 172.21.15.57:0/491275717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4100e10 msgr2=0x7fbdf4195d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4100e10 0x7fbdf4195d20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbde400d950 tx=0x7fbde400dc60 comp rx=0 tx=0).stop 2023-03-02T10:55:59.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 -- 172.21.15.57:0/491275717 shutdown_connections 2023-03-02T10:55:59.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbddc09b3e0 0x7fbddc09d890 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdf410a1f0 0x7fbdf419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4100e10 0x7fbdf4195d20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 --2- 172.21.15.57:0/491275717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdf4101720 0x7fbdf4196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 -- 172.21.15.57:0/491275717 >> 172.21.15.57:0/491275717 conn(0x7fbdf40fa620 msgr2=0x7fbdf4101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:59.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 -- 172.21.15.57:0/491275717 shutdown_connections 2023-03-02T10:55:59.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.511+0000 7fbdf9aab700 1 -- 172.21.15.57:0/491275717 wait complete. 2023-03-02T10:55:59.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.546+0000 7f032dd6f700 1 -- 172.21.15.57:0/619242188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0328066750 con 0x7f032810a1f0 2023-03-02T10:55:59.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.546+0000 7f0324ff9700 1 -- 172.21.15.57:0/619242188 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0320025e90 con 0x7f032810a1f0 2023-03-02T10:55:59.548 INFO:teuthology.orchestra.run.smithi057.stdout:223338299430 2023-03-02T10:55:59.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 -- 172.21.15.57:0/619242188 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f031009b3e0 msgr2=0x7f031009d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f031009b3e0 0x7f031009d890 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0318011490 tx=0x7f0318009260 comp rx=0 tx=0).stop 2023-03-02T10:55:59.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 -- 172.21.15.57:0/619242188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f032810a1f0 msgr2=0x7f03281a3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f032810a1f0 0x7f03281a3f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f032000b780 tx=0x7f0320007990 comp rx=0 tx=0).stop 2023-03-02T10:55:59.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 -- 172.21.15.57:0/619242188 shutdown_connections 2023-03-02T10:55:59.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f031009b3e0 0x7f031009d890 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f032810a1f0 0x7f03281a3f60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0328100e10 0x7f03280fea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 --2- 172.21.15.57:0/619242188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0328101720 0x7f03280fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 -- 172.21.15.57:0/619242188 >> 172.21.15.57:0/619242188 conn(0x7f03280fa620 msgr2=0x7f0328101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:59.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 -- 172.21.15.57:0/619242188 shutdown_connections 2023-03-02T10:55:59.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.549+0000 7f032dd6f700 1 -- 172.21.15.57:0/619242188 wait complete. 2023-03-02T10:55:59.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.734+0000 7f184a13e700 1 -- 172.21.15.57:0/3198465725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1844101720 msgr2=0x7f1844109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.734+0000 7f184a13e700 1 --2- 172.21.15.57:0/3198465725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1844101720 0x7f1844109c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1838009990 tx=0x7f1838009ca0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.734+0000 7f184a13e700 1 -- 172.21.15.57:0/3198465725 shutdown_connections 2023-03-02T10:55:59.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.734+0000 7f184a13e700 1 --2- 172.21.15.57:0/3198465725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184410a1f0 0x7f184410c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.734+0000 7f184a13e700 1 --2- 172.21.15.57:0/3198465725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1844100e10 0x7f18441011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.734+0000 7f184a13e700 1 --2- 172.21.15.57:0/3198465725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1844101720 0x7f1844109c10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.734+0000 7f184a13e700 1 -- 172.21.15.57:0/3198465725 >> 172.21.15.57:0/3198465725 conn(0x7f18440fa620 msgr2=0x7f18440fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:59.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.734+0000 7f184a13e700 1 -- 172.21.15.57:0/3198465725 shutdown_connections 2023-03-02T10:55:59.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.734+0000 7f184a13e700 1 -- 172.21.15.57:0/3198465725 wait complete. 2023-03-02T10:55:59.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.735+0000 7f184a13e700 1 Processor -- start 2023-03-02T10:55:59.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.735+0000 7f184a13e700 1 -- start start 2023-03-02T10:55:59.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.735+0000 7f184a13e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1844100e10 0x7f184419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.735+0000 7f184a13e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1844101720 0x7f184419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f184a13e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184410a1f0 0x7f1844195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f184a13e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1844196140 con 0x7f184410a1f0 2023-03-02T10:55:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f184a13e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18441962b0 con 0x7f1844100e10 2023-03-02T10:55:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f184a13e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1844196470 con 0x7f1844101720 2023-03-02T10:55:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f1843fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184410a1f0 0x7f1844195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f1842ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1844101720 0x7f184419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f1843fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184410a1f0 0x7f1844195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53026/0 (socket says 172.21.15.57:53026) 2023-03-02T10:55:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f1842ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1844101720 0x7f184419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:36764/0 (socket says 172.21.15.57:36764) 2023-03-02T10:55:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f1843fff700 1 -- 172.21.15.57:0/337552008 learned_addr learned my addr 172.21.15.57:0/337552008 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:55:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f18437fe700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1844100e10 0x7f184419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f1843fff700 1 -- 172.21.15.57:0/337552008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1844101720 msgr2=0x7f184419bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f1843fff700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1844101720 0x7f184419bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f1843fff700 1 -- 172.21.15.57:0/337552008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1844100e10 msgr2=0x7f184419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f1843fff700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1844100e10 0x7f184419ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f1843fff700 1 -- 172.21.15.57:0/337552008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380095f0 con 0x7f184410a1f0 2023-03-02T10:55:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.736+0000 7f1843fff700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184410a1f0 0x7f1844195ad0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f183c00ef30 tx=0x7f183c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.737+0000 7f1840ff9700 1 -- 172.21.15.57:0/337552008 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c018070 con 0x7f184410a1f0 2023-03-02T10:55:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.737+0000 7f1840ff9700 1 -- 172.21.15.57:0/337552008 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f183c00f040 con 0x7f184410a1f0 2023-03-02T10:55:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.737+0000 7f184a13e700 1 -- 172.21.15.57:0/337552008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184410fcc0 con 0x7f184410a1f0 2023-03-02T10:55:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.737+0000 7f1840ff9700 1 -- 172.21.15.57:0/337552008 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00cd00 con 0x7f184410a1f0 2023-03-02T10:55:59.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.737+0000 7f184a13e700 1 -- 172.21.15.57:0/337552008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184410fb30 con 0x7f184410a1f0 2023-03-02T10:55:59.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.738+0000 7f184a13e700 1 -- 172.21.15.57:0/337552008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184410fe50 con 0x7f184410a1f0 2023-03-02T10:55:59.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.739+0000 7f1840ff9700 1 -- 172.21.15.57:0/337552008 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f183c003a00 con 0x7f184410a1f0 2023-03-02T10:55:59.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.740+0000 7f1840ff9700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f182c09b460 0x7f182c09d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:55:59.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.740+0000 7f1840ff9700 1 -- 172.21.15.57:0/337552008 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f183c0c5630 con 0x7f184410a1f0 2023-03-02T10:55:59.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.740+0000 7f18437fe700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f182c09b460 0x7f182c09d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:55:59.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.741+0000 7f18437fe700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f182c09b460 0x7f182c09d910 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1834009c60 tx=0x7f1834009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:55:59.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.743+0000 7f1840ff9700 1 -- 172.21.15.57:0/337552008 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f183c090f50 con 0x7f184410a1f0 2023-03-02T10:55:59.766 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:59 smithi057 ceph-mon[92072]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6 op/s; 75 B/s, 1 keys/s, 1 objects/s recovering 2023-03-02T10:55:59.767 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:55:59 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/491275717' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-03-02T10:55:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:59 smithi136 ceph-mon[125702]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6 op/s; 75 B/s, 1 keys/s, 1 objects/s recovering 2023-03-02T10:55:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:55:59 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/491275717' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-03-02T10:55:59.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.948+0000 7f184a13e700 1 -- 172.21.15.57:0/337552008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1844104a70 con 0x7f184410a1f0 2023-03-02T10:55:59.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.949+0000 7f1840ff9700 1 -- 172.21.15.57:0/337552008 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f183c094570 con 0x7f184410a1f0 2023-03-02T10:55:59.950 INFO:teuthology.orchestra.run.smithi057.stdout:201863462957 2023-03-02T10:55:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:59 smithi122 ceph-mon[125440]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6 op/s; 75 B/s, 1 keys/s, 1 objects/s recovering 2023-03-02T10:55:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:55:59 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/491275717' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-03-02T10:55:59.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 -- 172.21.15.57:0/337552008 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f182c09b460 msgr2=0x7f182c09d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f182c09b460 0x7f182c09d910 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1834009c60 tx=0x7f1834009260 comp rx=0 tx=0).stop 2023-03-02T10:55:59.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 -- 172.21.15.57:0/337552008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184410a1f0 msgr2=0x7f1844195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:55:59.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184410a1f0 0x7f1844195ad0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f183c00ef30 tx=0x7f183c00c3a0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 -- 172.21.15.57:0/337552008 shutdown_connections 2023-03-02T10:55:59.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f182c09b460 0x7f182c09d910 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184410a1f0 0x7f1844195ad0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1844100e10 0x7f184419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 --2- 172.21.15.57:0/337552008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1844101720 0x7f184419bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:55:59.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 -- 172.21.15.57:0/337552008 >> 172.21.15.57:0/337552008 conn(0x7f18440fa620 msgr2=0x7f1844101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:55:59.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 -- 172.21.15.57:0/337552008 shutdown_connections 2023-03-02T10:55:59.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:55:59.951+0000 7f184a13e700 1 -- 172.21.15.57:0/337552008 wait complete. 2023-03-02T10:56:00.096 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299427 got 223338299430 for osd.7 2023-03-02T10:56:00.096 DEBUG:teuthology.parallel:result is None 2023-03-02T10:56:00.456 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724589 got 167503724591 for osd.5 2023-03-02T10:56:00.456 DEBUG:teuthology.parallel:result is None 2023-03-02T10:56:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:00 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/619242188' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-03-02T10:56:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:00 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/337552008' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-03-02T10:56:00.740 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462953 got 201863462957 for osd.6 2023-03-02T10:56:00.741 DEBUG:teuthology.parallel:result is None 2023-03-02T10:56:00.741 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-03-02T10:56:00.742 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph pg dump --format=json 2023-03-02T10:56:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:00 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/619242188' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-03-02T10:56:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:00 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/337552008' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-03-02T10:56:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:00 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/619242188' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-03-02T10:56:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:00 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/337552008' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-03-02T10:56:01.475 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:56:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:01 smithi136 ceph-mon[125702]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 68 B/s, 0 keys/s, 1 objects/s recovering 2023-03-02T10:56:01.856 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:01 smithi057 ceph-mon[92072]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 68 B/s, 0 keys/s, 1 objects/s recovering 2023-03-02T10:56:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:01 smithi122 ceph-mon[125440]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 68 B/s, 0 keys/s, 1 objects/s recovering 2023-03-02T10:56:02.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.861+0000 7fd761751700 1 -- 172.21.15.57:0/2805541730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd75c0ff750 msgr2=0x7fd75c103710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:02.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.861+0000 7fd761751700 1 --2- 172.21.15.57:0/2805541730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd75c0ff750 0x7fd75c103710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd7440099c0 tx=0x7fd744009cd0 comp rx=0 tx=0).stop 2023-03-02T10:56:02.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.861+0000 7fd761751700 1 -- 172.21.15.57:0/2805541730 shutdown_connections 2023-03-02T10:56:02.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.861+0000 7fd761751700 1 --2- 172.21.15.57:0/2805541730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75c103df0 0x7fd75c10b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:02.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.861+0000 7fd761751700 1 --2- 172.21.15.57:0/2805541730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd75c0fedb0 0x7fd75c0ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:02.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.861+0000 7fd761751700 1 --2- 172.21.15.57:0/2805541730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd75c0ff750 0x7fd75c103710 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:02.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.861+0000 7fd761751700 1 -- 172.21.15.57:0/2805541730 >> 172.21.15.57:0/2805541730 conn(0x7fd75c0fa620 msgr2=0x7fd75c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:02.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.861+0000 7fd761751700 1 -- 172.21.15.57:0/2805541730 shutdown_connections 2023-03-02T10:56:02.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.861+0000 7fd761751700 1 -- 172.21.15.57:0/2805541730 wait complete. 2023-03-02T10:56:02.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd761751700 1 Processor -- start 2023-03-02T10:56:02.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd761751700 1 -- start start 2023-03-02T10:56:02.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd761751700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75c0fedb0 0x7fd75c195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:02.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd761751700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd75c0ff750 0x7fd75c1962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:02.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd761751700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd75c103df0 0x7fd75c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:02.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd761751700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c19ad40 con 0x7fd75c0ff750 2023-03-02T10:56:02.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd761751700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c19aeb0 con 0x7fd75c0fedb0 2023-03-02T10:56:02.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd761751700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c19b070 con 0x7fd75c103df0 2023-03-02T10:56:02.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd753fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd75c0ff750 0x7fd75c1962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:02.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd753fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd75c0ff750 0x7fd75c1962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53040/0 (socket says 172.21.15.57:53040) 2023-03-02T10:56:02.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd753fff700 1 -- 172.21.15.57:0/632710927 learned_addr learned my addr 172.21.15.57:0/632710927 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:02.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd75b7fe700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd75c103df0 0x7fd75c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:02.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.862+0000 7fd75affd700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75c0fedb0 0x7fd75c195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:02.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.863+0000 7fd753fff700 1 -- 172.21.15.57:0/632710927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd75c103df0 msgr2=0x7fd75c19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:02.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.863+0000 7fd753fff700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd75c103df0 0x7fd75c19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:02.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.863+0000 7fd753fff700 1 -- 172.21.15.57:0/632710927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75c0fedb0 msgr2=0x7fd75c195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:02.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.863+0000 7fd753fff700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75c0fedb0 0x7fd75c195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:02.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.863+0000 7fd753fff700 1 -- 172.21.15.57:0/632710927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7440095f0 con 0x7fd75c0ff750 2023-03-02T10:56:02.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.863+0000 7fd753fff700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd75c0ff750 0x7fd75c1962a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd744009990 tx=0x7fd744004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:02.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.863+0000 7fd758ff9700 1 -- 172.21.15.57:0/632710927 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74401d070 con 0x7fd75c0ff750 2023-03-02T10:56:02.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.863+0000 7fd758ff9700 1 -- 172.21.15.57:0/632710927 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd744003f90 con 0x7fd75c0ff750 2023-03-02T10:56:02.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.863+0000 7fd761751700 1 -- 172.21.15.57:0/632710927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c10eb80 con 0x7fd75c0ff750 2023-03-02T10:56:02.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.863+0000 7fd758ff9700 1 -- 172.21.15.57:0/632710927 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744022c00 con 0x7fd75c0ff750 2023-03-02T10:56:02.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.863+0000 7fd761751700 1 -- 172.21.15.57:0/632710927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c10e9f0 con 0x7fd75c0ff750 2023-03-02T10:56:02.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.864+0000 7fd761751700 1 -- 172.21.15.57:0/632710927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c10ed10 con 0x7fd75c0ff750 2023-03-02T10:56:02.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.867+0000 7fd758ff9700 1 -- 172.21.15.57:0/632710927 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fd744029030 con 0x7fd75c0ff750 2023-03-02T10:56:02.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.867+0000 7fd758ff9700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd74809b3e0 0x7fd74809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:02.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.868+0000 7fd758ff9700 1 -- 172.21.15.57:0/632710927 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd7440c6480 con 0x7fd75c0ff750 2023-03-02T10:56:02.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.868+0000 7fd75affd700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd74809b3e0 0x7fd74809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:02.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.868+0000 7fd75affd700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd74809b3e0 0x7fd74809d890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd74c005950 tx=0x7fd74c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:02.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:02.870+0000 7fd758ff9700 1 -- 172.21.15.57:0/632710927 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fd744091e00 con 0x7fd75c0ff750 2023-03-02T10:56:03.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.064+0000 7fd761751700 1 -- 172.21.15.57:0/632710927 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd75c0fb0c0 con 0x7fd74809b3e0 2023-03-02T10:56:03.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.075+0000 7fd758ff9700 1 -- 172.21.15.57:0/632710927 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340692 (secure 0 0 0) 0x7fd75c0fb0c0 con 0x7fd74809b3e0 2023-03-02T10:56:03.080 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:03.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 -- 172.21.15.57:0/632710927 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd74809b3e0 msgr2=0x7fd74809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:03.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd74809b3e0 0x7fd74809d890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd74c005950 tx=0x7fd74c00b410 comp rx=0 tx=0).stop 2023-03-02T10:56:03.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 -- 172.21.15.57:0/632710927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd75c0ff750 msgr2=0x7fd75c1962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:03.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd75c0ff750 0x7fd75c1962a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd744009990 tx=0x7fd744004730 comp rx=0 tx=0).stop 2023-03-02T10:56:03.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 -- 172.21.15.57:0/632710927 shutdown_connections 2023-03-02T10:56:03.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd74809b3e0 0x7fd74809d890 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:03.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd75c103df0 0x7fd75c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:03.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75c0fedb0 0x7fd75c195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:03.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 --2- 172.21.15.57:0/632710927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd75c0ff750 0x7fd75c1962a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:03.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 -- 172.21.15.57:0/632710927 >> 172.21.15.57:0/632710927 conn(0x7fd75c0fa620 msgr2=0x7fd75c1028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:03.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 -- 172.21.15.57:0/632710927 shutdown_connections 2023-03-02T10:56:03.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:03.079+0000 7fd761751700 1 -- 172.21.15.57:0/632710927 wait complete. 2023-03-02T10:56:03.084 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-03-02T10:56:03.575 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-03-02T10:56:01.270016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653705,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":555,"num_read_kb":415,"num_write":413,"num_write_kb":3065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1181469,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":79752,"kb_used_data":11496,"kb_used_omap":0,"kb_used_meta":68160,"kb_avail":1124862072,"statfs":{"total":1151940427776,"available":1151858761728,"internally_reserved":0,"allocated":11771904,"data_stored":7324698,"data_compressed":110277,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":69795840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-4,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":733,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.736768"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.538895+0000","last_change":"2023-03-02T10:55:10.630366+0000","last_active":"2023-03-02T10:55:49.538895+0000","last_peered":"2023-03-02T10:55:49.538895+0000","last_clean":"2023-03-02T10:55:49.538895+0000","last_became_active":"2023-03-02T10:55:10.630035+0000","last_became_peered":"2023-03-02T10:55:10.630035+0000","last_unstale":"2023-03-02T10:55:49.538895+0000","last_undegraded":"2023-03-02T10:55:49.538895+0000","last_fullsized":"2023-03-02T10:55:49.538895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:00:41.832233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543567+0000","last_change":"2023-03-02T10:55:10.628111+0000","last_active":"2023-03-02T10:55:49.543567+0000","last_peered":"2023-03-02T10:55:49.543567+0000","last_clean":"2023-03-02T10:55:49.543567+0000","last_became_active":"2023-03-02T10:55:10.626879+0000","last_became_peered":"2023-03-02T10:55:10.626879+0000","last_unstale":"2023-03-02T10:55:49.543567+0000","last_undegraded":"2023-03-02T10:55:49.543567+0000","last_fullsized":"2023-03-02T10:55:49.543567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:08:52.120684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543597+0000","last_change":"2023-03-02T10:55:10.624392+0000","last_active":"2023-03-02T10:55:49.543597+0000","last_peered":"2023-03-02T10:55:49.543597+0000","last_clean":"2023-03-02T10:55:49.543597+0000","last_became_active":"2023-03-02T10:55:10.624095+0000","last_became_peered":"2023-03-02T10:55:10.624095+0000","last_unstale":"2023-03-02T10:55:49.543597+0000","last_undegraded":"2023-03-02T10:55:49.543597+0000","last_fullsized":"2023-03-02T10:55:49.543597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:30:55.174383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540748+0000","last_change":"2023-03-02T10:55:10.619950+0000","last_active":"2023-03-02T10:55:49.540748+0000","last_peered":"2023-03-02T10:55:49.540748+0000","last_clean":"2023-03-02T10:55:49.540748+0000","last_became_active":"2023-03-02T10:55:10.619543+0000","last_became_peered":"2023-03-02T10:55:10.619543+0000","last_unstale":"2023-03-02T10:55:49.540748+0000","last_undegraded":"2023-03-02T10:55:49.540748+0000","last_fullsized":"2023-03-02T10:55:49.540748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:08:02.321422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.536510+0000","last_change":"2023-03-02T10:55:10.626403+0000","last_active":"2023-03-02T10:55:49.536510+0000","last_peered":"2023-03-02T10:55:49.536510+0000","last_clean":"2023-03-02T10:55:49.536510+0000","last_became_active":"2023-03-02T10:55:10.626062+0000","last_became_peered":"2023-03-02T10:55:10.626062+0000","last_unstale":"2023-03-02T10:55:49.536510+0000","last_undegraded":"2023-03-02T10:55:49.536510+0000","last_fullsized":"2023-03-02T10:55:49.536510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:35:06.798468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540128+0000","last_change":"2023-03-02T10:55:10.623903+0000","last_active":"2023-03-02T10:55:49.540128+0000","last_peered":"2023-03-02T10:55:49.540128+0000","last_clean":"2023-03-02T10:55:49.540128+0000","last_became_active":"2023-03-02T10:55:10.623422+0000","last_became_peered":"2023-03-02T10:55:10.623422+0000","last_unstale":"2023-03-02T10:55:49.540128+0000","last_undegraded":"2023-03-02T10:55:49.540128+0000","last_fullsized":"2023-03-02T10:55:49.540128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:21.066552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542066+0000","last_change":"2023-03-02T10:55:10.633210+0000","last_active":"2023-03-02T10:55:49.542066+0000","last_peered":"2023-03-02T10:55:49.542066+0000","last_clean":"2023-03-02T10:55:49.542066+0000","last_became_active":"2023-03-02T10:55:10.632898+0000","last_became_peered":"2023-03-02T10:55:10.632898+0000","last_unstale":"2023-03-02T10:55:49.542066+0000","last_undegraded":"2023-03-02T10:55:49.542066+0000","last_fullsized":"2023-03-02T10:55:49.542066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:04.043328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542626+0000","last_change":"2023-03-02T10:55:10.634427+0000","last_active":"2023-03-02T10:55:49.542626+0000","last_peered":"2023-03-02T10:55:49.542626+0000","last_clean":"2023-03-02T10:55:49.542626+0000","last_became_active":"2023-03-02T10:55:10.634159+0000","last_became_peered":"2023-03-02T10:55:10.634159+0000","last_unstale":"2023-03-02T10:55:49.542626+0000","last_undegraded":"2023-03-02T10:55:49.542626+0000","last_fullsized":"2023-03-02T10:55:49.542626+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:59:09.344860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534871+0000","last_change":"2023-03-02T10:55:10.622775+0000","last_active":"2023-03-02T10:55:49.534871+0000","last_peered":"2023-03-02T10:55:49.534871+0000","last_clean":"2023-03-02T10:55:49.534871+0000","last_became_active":"2023-03-02T10:55:10.616254+0000","last_became_peered":"2023-03-02T10:55:10.616254+0000","last_unstale":"2023-03-02T10:55:49.534871+0000","last_undegraded":"2023-03-02T10:55:49.534871+0000","last_fullsized":"2023-03-02T10:55:49.534871+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:01:56.832512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540496+0000","last_change":"2023-03-02T10:55:10.620311+0000","last_active":"2023-03-02T10:55:49.540496+0000","last_peered":"2023-03-02T10:55:49.540496+0000","last_clean":"2023-03-02T10:55:49.540496+0000","last_became_active":"2023-03-02T10:55:10.620028+0000","last_became_peered":"2023-03-02T10:55:10.620028+0000","last_unstale":"2023-03-02T10:55:49.540496+0000","last_undegraded":"2023-03-02T10:55:49.540496+0000","last_fullsized":"2023-03-02T10:55:49.540496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:16:13.770927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540117+0000","last_change":"2023-03-02T10:55:10.621316+0000","last_active":"2023-03-02T10:55:49.540117+0000","last_peered":"2023-03-02T10:55:49.540117+0000","last_clean":"2023-03-02T10:55:49.540117+0000","last_became_active":"2023-03-02T10:55:10.620803+0000","last_became_peered":"2023-03-02T10:55:10.620803+0000","last_unstale":"2023-03-02T10:55:49.540117+0000","last_undegraded":"2023-03-02T10:55:49.540117+0000","last_fullsized":"2023-03-02T10:55:49.540117+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:20:18.434138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540657+0000","last_change":"2023-03-02T10:55:10.625305+0000","last_active":"2023-03-02T10:55:49.540657+0000","last_peered":"2023-03-02T10:55:49.540657+0000","last_clean":"2023-03-02T10:55:49.540657+0000","last_became_active":"2023-03-02T10:55:10.625025+0000","last_became_peered":"2023-03-02T10:55:10.625025+0000","last_unstale":"2023-03-02T10:55:49.540657+0000","last_undegraded":"2023-03-02T10:55:49.540657+0000","last_fullsized":"2023-03-02T10:55:49.540657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:35:40.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539838+0000","last_change":"2023-03-02T10:55:10.626408+0000","last_active":"2023-03-02T10:55:49.539838+0000","last_peered":"2023-03-02T10:55:49.539838+0000","last_clean":"2023-03-02T10:55:49.539838+0000","last_became_active":"2023-03-02T10:55:10.625510+0000","last_became_peered":"2023-03-02T10:55:10.625510+0000","last_unstale":"2023-03-02T10:55:49.539838+0000","last_undegraded":"2023-03-02T10:55:49.539838+0000","last_fullsized":"2023-03-02T10:55:49.539838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:59:10.622871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543469+0000","last_change":"2023-03-02T10:55:10.629323+0000","last_active":"2023-03-02T10:55:49.543469+0000","last_peered":"2023-03-02T10:55:49.543469+0000","last_clean":"2023-03-02T10:55:49.543469+0000","last_became_active":"2023-03-02T10:55:10.627038+0000","last_became_peered":"2023-03-02T10:55:10.627038+0000","last_unstale":"2023-03-02T10:55:49.543469+0000","last_undegraded":"2023-03-02T10:55:49.543469+0000","last_fullsized":"2023-03-02T10:55:49.543469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:57:21.241810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543343+0000","last_change":"2023-03-02T10:55:10.624312+0000","last_active":"2023-03-02T10:55:49.543343+0000","last_peered":"2023-03-02T10:55:49.543343+0000","last_clean":"2023-03-02T10:55:49.543343+0000","last_became_active":"2023-03-02T10:55:10.623997+0000","last_became_peered":"2023-03-02T10:55:10.623997+0000","last_unstale":"2023-03-02T10:55:49.543343+0000","last_undegraded":"2023-03-02T10:55:49.543343+0000","last_fullsized":"2023-03-02T10:55:49.543343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:09:43.683852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534296+0000","last_change":"2023-03-02T10:55:10.622473+0000","last_active":"2023-03-02T10:55:49.534296+0000","last_peered":"2023-03-02T10:55:49.534296+0000","last_clean":"2023-03-02T10:55:49.534296+0000","last_became_active":"2023-03-02T10:55:10.622148+0000","last_became_peered":"2023-03-02T10:55:10.622148+0000","last_unstale":"2023-03-02T10:55:49.534296+0000","last_undegraded":"2023-03-02T10:55:49.534296+0000","last_fullsized":"2023-03-02T10:55:49.534296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:54:52.132792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539795+0000","last_change":"2023-03-02T10:55:10.630380+0000","last_active":"2023-03-02T10:55:49.539795+0000","last_peered":"2023-03-02T10:55:49.539795+0000","last_clean":"2023-03-02T10:55:49.539795+0000","last_became_active":"2023-03-02T10:55:10.630088+0000","last_became_peered":"2023-03-02T10:55:10.630088+0000","last_unstale":"2023-03-02T10:55:49.539795+0000","last_undegraded":"2023-03-02T10:55:49.539795+0000","last_fullsized":"2023-03-02T10:55:49.539795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:08:58.983902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533147+0000","last_change":"2023-03-02T10:55:10.620547+0000","last_active":"2023-03-02T10:55:49.533147+0000","last_peered":"2023-03-02T10:55:49.533147+0000","last_clean":"2023-03-02T10:55:49.533147+0000","last_became_active":"2023-03-02T10:55:10.620225+0000","last_became_peered":"2023-03-02T10:55:10.620225+0000","last_unstale":"2023-03-02T10:55:49.533147+0000","last_undegraded":"2023-03-02T10:55:49.533147+0000","last_fullsized":"2023-03-02T10:55:49.533147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:47:38.669432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534655+0000","last_change":"2023-03-02T10:55:10.625108+0000","last_active":"2023-03-02T10:55:49.534655+0000","last_peered":"2023-03-02T10:55:49.534655+0000","last_clean":"2023-03-02T10:55:49.534655+0000","last_became_active":"2023-03-02T10:55:10.624797+0000","last_became_peered":"2023-03-02T10:55:10.624797+0000","last_unstale":"2023-03-02T10:55:49.534655+0000","last_undegraded":"2023-03-02T10:55:49.534655+0000","last_fullsized":"2023-03-02T10:55:49.534655+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:06:57.777889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":71,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:59.563101+0000","last_change":"2023-03-02T10:55:10.146541+0000","last_active":"2023-03-02T10:55:59.563101+0000","last_peered":"2023-03-02T10:55:59.563101+0000","last_clean":"2023-03-02T10:55:59.563101+0000","last_became_active":"2023-03-02T10:55:10.146239+0000","last_became_peered":"2023-03-02T10:55:10.146239+0000","last_unstale":"2023-03-02T10:55:59.563101+0000","last_undegraded":"2023-03-02T10:55:59.563101+0000","last_fullsized":"2023-03-02T10:55:59.563101+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:56:07.036002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542885+0000","last_change":"2023-03-02T10:55:10.619811+0000","last_active":"2023-03-02T10:55:49.542885+0000","last_peered":"2023-03-02T10:55:49.542885+0000","last_clean":"2023-03-02T10:55:49.542885+0000","last_became_active":"2023-03-02T10:55:10.617190+0000","last_became_peered":"2023-03-02T10:55:10.617190+0000","last_unstale":"2023-03-02T10:55:49.542885+0000","last_undegraded":"2023-03-02T10:55:49.542885+0000","last_fullsized":"2023-03-02T10:55:49.542885+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:20:52.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542992+0000","last_change":"2023-03-02T10:55:10.155970+0000","last_active":"2023-03-02T10:55:49.542992+0000","last_peered":"2023-03-02T10:55:49.542992+0000","last_clean":"2023-03-02T10:55:49.542992+0000","last_became_active":"2023-03-02T10:55:10.155667+0000","last_became_peered":"2023-03-02T10:55:10.155667+0000","last_unstale":"2023-03-02T10:55:49.542992+0000","last_undegraded":"2023-03-02T10:55:49.542992+0000","last_fullsized":"2023-03-02T10:55:49.542992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:46:36.366891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543760+0000","last_change":"2023-03-02T10:55:10.623738+0000","last_active":"2023-03-02T10:55:49.543760+0000","last_peered":"2023-03-02T10:55:49.543760+0000","last_clean":"2023-03-02T10:55:49.543760+0000","last_became_active":"2023-03-02T10:55:10.620543+0000","last_became_peered":"2023-03-02T10:55:10.620543+0000","last_unstale":"2023-03-02T10:55:49.543760+0000","last_undegraded":"2023-03-02T10:55:49.543760+0000","last_fullsized":"2023-03-02T10:55:49.543760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:44:46.238712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.148470+0000","last_change":"2023-03-02T10:55:51.148470+0000","last_active":"2023-03-02T10:55:51.148470+0000","last_peered":"2023-03-02T10:55:51.148470+0000","last_clean":"2023-03-02T10:55:51.148470+0000","last_became_active":"2023-03-02T10:55:50.544811+0000","last_became_peered":"2023-03-02T10:55:50.544811+0000","last_unstale":"2023-03-02T10:55:51.148470+0000","last_undegraded":"2023-03-02T10:55:51.148470+0000","last_fullsized":"2023-03-02T10:55:51.148470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:32:12.108148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534458+0000","last_change":"2023-03-02T10:55:10.627844+0000","last_active":"2023-03-02T10:55:49.534458+0000","last_peered":"2023-03-02T10:55:49.534458+0000","last_clean":"2023-03-02T10:55:49.534458+0000","last_became_active":"2023-03-02T10:55:10.626972+0000","last_became_peered":"2023-03-02T10:55:10.626972+0000","last_unstale":"2023-03-02T10:55:49.534458+0000","last_undegraded":"2023-03-02T10:55:49.534458+0000","last_fullsized":"2023-03-02T10:55:49.534458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:36:58.650285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537357+0000","last_change":"2023-03-02T10:55:10.153277+0000","last_active":"2023-03-02T10:55:49.537357+0000","last_peered":"2023-03-02T10:55:49.537357+0000","last_clean":"2023-03-02T10:55:49.537357+0000","last_became_active":"2023-03-02T10:55:10.152983+0000","last_became_peered":"2023-03-02T10:55:10.152983+0000","last_unstale":"2023-03-02T10:55:49.537357+0000","last_undegraded":"2023-03-02T10:55:49.537357+0000","last_fullsized":"2023-03-02T10:55:49.537357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:15.045107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541978+0000","last_change":"2023-03-02T10:55:10.630295+0000","last_active":"2023-03-02T10:55:49.541978+0000","last_peered":"2023-03-02T10:55:49.541978+0000","last_clean":"2023-03-02T10:55:49.541978+0000","last_became_active":"2023-03-02T10:55:10.629004+0000","last_became_peered":"2023-03-02T10:55:10.629004+0000","last_unstale":"2023-03-02T10:55:49.541978+0000","last_undegraded":"2023-03-02T10:55:49.541978+0000","last_fullsized":"2023-03-02T10:55:49.541978+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:05:51.414347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:56.625752+0000","last_change":"2023-03-02T10:55:10.153222+0000","last_active":"2023-03-02T10:55:56.625752+0000","last_peered":"2023-03-02T10:55:56.625752+0000","last_clean":"2023-03-02T10:55:56.625752+0000","last_became_active":"2023-03-02T10:55:10.152928+0000","last_became_peered":"2023-03-02T10:55:10.152928+0000","last_unstale":"2023-03-02T10:55:56.625752+0000","last_undegraded":"2023-03-02T10:55:56.625752+0000","last_fullsized":"2023-03-02T10:55:56.625752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:12:56.648713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.536598+0000","last_change":"2023-03-02T10:55:10.617722+0000","last_active":"2023-03-02T10:55:49.536598+0000","last_peered":"2023-03-02T10:55:49.536598+0000","last_clean":"2023-03-02T10:55:49.536598+0000","last_became_active":"2023-03-02T10:55:10.617425+0000","last_became_peered":"2023-03-02T10:55:10.617425+0000","last_unstale":"2023-03-02T10:55:49.536598+0000","last_undegraded":"2023-03-02T10:55:49.536598+0000","last_fullsized":"2023-03-02T10:55:49.536598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:57:37.397568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:50.806747+0000","last_change":"2023-03-02T10:55:50.806747+0000","last_active":"2023-03-02T10:55:50.806747+0000","last_peered":"2023-03-02T10:55:50.806747+0000","last_clean":"2023-03-02T10:55:50.806747+0000","last_became_active":"2023-03-02T10:55:50.544008+0000","last_became_peered":"2023-03-02T10:55:50.544008+0000","last_unstale":"2023-03-02T10:55:50.806747+0000","last_undegraded":"2023-03-02T10:55:50.806747+0000","last_fullsized":"2023-03-02T10:55:50.806747+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:21:20.672207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542100+0000","last_change":"2023-03-02T10:55:10.628418+0000","last_active":"2023-03-02T10:55:49.542100+0000","last_peered":"2023-03-02T10:55:49.542100+0000","last_clean":"2023-03-02T10:55:49.542100+0000","last_became_active":"2023-03-02T10:55:10.627715+0000","last_became_peered":"2023-03-02T10:55:10.627715+0000","last_unstale":"2023-03-02T10:55:49.542100+0000","last_undegraded":"2023-03-02T10:55:49.542100+0000","last_fullsized":"2023-03-02T10:55:49.542100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:16:59.756440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539748+0000","last_change":"2023-03-02T10:55:10.158875+0000","last_active":"2023-03-02T10:55:49.539748+0000","last_peered":"2023-03-02T10:55:49.539748+0000","last_clean":"2023-03-02T10:55:49.539748+0000","last_became_active":"2023-03-02T10:55:10.157653+0000","last_became_peered":"2023-03-02T10:55:10.157653+0000","last_unstale":"2023-03-02T10:55:49.539748+0000","last_undegraded":"2023-03-02T10:55:49.539748+0000","last_fullsized":"2023-03-02T10:55:49.539748+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:50:03.808602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542552+0000","last_change":"2023-03-02T10:55:10.634280+0000","last_active":"2023-03-02T10:55:49.542552+0000","last_peered":"2023-03-02T10:55:49.542552+0000","last_clean":"2023-03-02T10:55:49.542552+0000","last_became_active":"2023-03-02T10:55:10.633764+0000","last_became_peered":"2023-03-02T10:55:10.633764+0000","last_unstale":"2023-03-02T10:55:49.542552+0000","last_undegraded":"2023-03-02T10:55:49.542552+0000","last_fullsized":"2023-03-02T10:55:49.542552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:17:25.110036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541628+0000","last_change":"2023-03-02T10:55:10.154532+0000","last_active":"2023-03-02T10:55:49.541628+0000","last_peered":"2023-03-02T10:55:49.541628+0000","last_clean":"2023-03-02T10:55:49.541628+0000","last_became_active":"2023-03-02T10:55:10.152116+0000","last_became_peered":"2023-03-02T10:55:10.152116+0000","last_unstale":"2023-03-02T10:55:49.541628+0000","last_undegraded":"2023-03-02T10:55:49.541628+0000","last_fullsized":"2023-03-02T10:55:49.541628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:19:50.439666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.532910+0000","last_change":"2023-03-02T10:55:10.628790+0000","last_active":"2023-03-02T10:55:49.532910+0000","last_peered":"2023-03-02T10:55:49.532910+0000","last_clean":"2023-03-02T10:55:49.532910+0000","last_became_active":"2023-03-02T10:55:10.628452+0000","last_became_peered":"2023-03-02T10:55:10.628452+0000","last_unstale":"2023-03-02T10:55:49.532910+0000","last_undegraded":"2023-03-02T10:55:49.532910+0000","last_fullsized":"2023-03-02T10:55:49.532910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:08:30.061925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":102,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:58.627834+0000","last_change":"2023-03-02T10:55:10.152684+0000","last_active":"2023-03-02T10:55:58.627834+0000","last_peered":"2023-03-02T10:55:58.627834+0000","last_clean":"2023-03-02T10:55:58.627834+0000","last_became_active":"2023-03-02T10:55:10.152184+0000","last_became_peered":"2023-03-02T10:55:10.152184+0000","last_unstale":"2023-03-02T10:55:58.627834+0000","last_undegraded":"2023-03-02T10:55:58.627834+0000","last_fullsized":"2023-03-02T10:55:58.627834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:39:21.100760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534868+0000","last_change":"2023-03-02T10:55:10.625990+0000","last_active":"2023-03-02T10:55:49.534868+0000","last_peered":"2023-03-02T10:55:49.534868+0000","last_clean":"2023-03-02T10:55:49.534868+0000","last_became_active":"2023-03-02T10:55:10.625677+0000","last_became_peered":"2023-03-02T10:55:10.625677+0000","last_unstale":"2023-03-02T10:55:49.534868+0000","last_undegraded":"2023-03-02T10:55:49.534868+0000","last_fullsized":"2023-03-02T10:55:49.534868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:08.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539232+0000","last_change":"2023-03-02T10:55:10.151541+0000","last_active":"2023-03-02T10:55:49.539232+0000","last_peered":"2023-03-02T10:55:49.539232+0000","last_clean":"2023-03-02T10:55:49.539232+0000","last_became_active":"2023-03-02T10:55:10.151262+0000","last_became_peered":"2023-03-02T10:55:10.151262+0000","last_unstale":"2023-03-02T10:55:49.539232+0000","last_undegraded":"2023-03-02T10:55:49.539232+0000","last_fullsized":"2023-03-02T10:55:49.539232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:00:49.821191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543757+0000","last_change":"2023-03-02T10:55:10.629541+0000","last_active":"2023-03-02T10:55:49.543757+0000","last_peered":"2023-03-02T10:55:49.543757+0000","last_clean":"2023-03-02T10:55:49.543757+0000","last_became_active":"2023-03-02T10:55:10.627473+0000","last_became_peered":"2023-03-02T10:55:10.627473+0000","last_unstale":"2023-03-02T10:55:49.543757+0000","last_undegraded":"2023-03-02T10:55:49.543757+0000","last_fullsized":"2023-03-02T10:55:49.543757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:22:52.995113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542098+0000","last_change":"2023-03-02T10:55:10.152615+0000","last_active":"2023-03-02T10:55:49.542098+0000","last_peered":"2023-03-02T10:55:49.542098+0000","last_clean":"2023-03-02T10:55:49.542098+0000","last_became_active":"2023-03-02T10:55:10.152304+0000","last_became_peered":"2023-03-02T10:55:10.152304+0000","last_unstale":"2023-03-02T10:55:49.542098+0000","last_undegraded":"2023-03-02T10:55:49.542098+0000","last_fullsized":"2023-03-02T10:55:49.542098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:43:00.934520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534648+0000","last_change":"2023-03-02T10:55:10.627653+0000","last_active":"2023-03-02T10:55:49.534648+0000","last_peered":"2023-03-02T10:55:49.534648+0000","last_clean":"2023-03-02T10:55:49.534648+0000","last_became_active":"2023-03-02T10:55:10.626570+0000","last_became_peered":"2023-03-02T10:55:10.626570+0000","last_unstale":"2023-03-02T10:55:49.534648+0000","last_undegraded":"2023-03-02T10:55:49.534648+0000","last_fullsized":"2023-03-02T10:55:49.534648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:40:39.311514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'29","reported_seq":133,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:58.627645+0000","last_change":"2023-03-02T10:55:10.149121+0000","last_active":"2023-03-02T10:55:58.627645+0000","last_peered":"2023-03-02T10:55:58.627645+0000","last_clean":"2023-03-02T10:55:58.627645+0000","last_became_active":"2023-03-02T10:55:10.148800+0000","last_became_peered":"2023-03-02T10:55:10.148800+0000","last_unstale":"2023-03-02T10:55:58.627645+0000","last_undegraded":"2023-03-02T10:55:58.627645+0000","last_fullsized":"2023-03-02T10:55:58.627645+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:32:30.918248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55969,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":90,"num_read_kb":99,"num_write":31,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537512+0000","last_change":"2023-03-02T10:55:10.625497+0000","last_active":"2023-03-02T10:55:49.537512+0000","last_peered":"2023-03-02T10:55:49.537512+0000","last_clean":"2023-03-02T10:55:49.537512+0000","last_became_active":"2023-03-02T10:55:10.625037+0000","last_became_peered":"2023-03-02T10:55:10.625037+0000","last_unstale":"2023-03-02T10:55:49.537512+0000","last_undegraded":"2023-03-02T10:55:49.537512+0000","last_fullsized":"2023-03-02T10:55:49.537512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:55:56.478111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534121+0000","last_change":"2023-03-02T10:55:10.148957+0000","last_active":"2023-03-02T10:55:49.534121+0000","last_peered":"2023-03-02T10:55:49.534121+0000","last_clean":"2023-03-02T10:55:49.534121+0000","last_became_active":"2023-03-02T10:55:10.148624+0000","last_became_peered":"2023-03-02T10:55:10.148624+0000","last_unstale":"2023-03-02T10:55:49.534121+0000","last_undegraded":"2023-03-02T10:55:49.534121+0000","last_fullsized":"2023-03-02T10:55:49.534121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:53:33.062648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540391+0000","last_change":"2023-03-02T10:55:10.633311+0000","last_active":"2023-03-02T10:55:49.540391+0000","last_peered":"2023-03-02T10:55:49.540391+0000","last_clean":"2023-03-02T10:55:49.540391+0000","last_became_active":"2023-03-02T10:55:10.632174+0000","last_became_peered":"2023-03-02T10:55:10.632174+0000","last_unstale":"2023-03-02T10:55:49.540391+0000","last_undegraded":"2023-03-02T10:55:49.540391+0000","last_fullsized":"2023-03-02T10:55:49.540391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:50:47.536118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542053+0000","last_change":"2023-03-02T10:55:10.153392+0000","last_active":"2023-03-02T10:55:49.542053+0000","last_peered":"2023-03-02T10:55:49.542053+0000","last_clean":"2023-03-02T10:55:49.542053+0000","last_became_active":"2023-03-02T10:55:10.152513+0000","last_became_peered":"2023-03-02T10:55:10.152513+0000","last_unstale":"2023-03-02T10:55:49.542053+0000","last_undegraded":"2023-03-02T10:55:49.542053+0000","last_fullsized":"2023-03-02T10:55:49.542053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:26:40.675118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540160+0000","last_change":"2023-03-02T10:55:10.631953+0000","last_active":"2023-03-02T10:55:49.540160+0000","last_peered":"2023-03-02T10:55:49.540160+0000","last_clean":"2023-03-02T10:55:49.540160+0000","last_became_active":"2023-03-02T10:55:10.631624+0000","last_became_peered":"2023-03-02T10:55:10.631624+0000","last_unstale":"2023-03-02T10:55:49.540160+0000","last_undegraded":"2023-03-02T10:55:49.540160+0000","last_fullsized":"2023-03-02T10:55:49.540160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:15:20.136421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:56.631391+0000","last_change":"2023-03-02T10:55:10.150597+0000","last_active":"2023-03-02T10:55:56.631391+0000","last_peered":"2023-03-02T10:55:56.631391+0000","last_clean":"2023-03-02T10:55:56.631391+0000","last_became_active":"2023-03-02T10:55:10.150024+0000","last_became_peered":"2023-03-02T10:55:10.150024+0000","last_unstale":"2023-03-02T10:55:56.631391+0000","last_undegraded":"2023-03-02T10:55:56.631391+0000","last_fullsized":"2023-03-02T10:55:56.631391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:30.043240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539596+0000","last_change":"2023-03-02T10:55:10.633052+0000","last_active":"2023-03-02T10:55:49.539596+0000","last_peered":"2023-03-02T10:55:49.539596+0000","last_clean":"2023-03-02T10:55:49.539596+0000","last_became_active":"2023-03-02T10:55:10.632766+0000","last_became_peered":"2023-03-02T10:55:10.632766+0000","last_unstale":"2023-03-02T10:55:49.539596+0000","last_undegraded":"2023-03-02T10:55:49.539596+0000","last_fullsized":"2023-03-02T10:55:49.539596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:55.079556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.536268+0000","last_change":"2023-03-02T10:55:10.154559+0000","last_active":"2023-03-02T10:55:49.536268+0000","last_peered":"2023-03-02T10:55:49.536268+0000","last_clean":"2023-03-02T10:55:49.536268+0000","last_became_active":"2023-03-02T10:55:10.154058+0000","last_became_peered":"2023-03-02T10:55:10.154058+0000","last_unstale":"2023-03-02T10:55:49.536268+0000","last_undegraded":"2023-03-02T10:55:49.536268+0000","last_fullsized":"2023-03-02T10:55:49.536268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:23:26.823020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541697+0000","last_change":"2023-03-02T10:55:10.622951+0000","last_active":"2023-03-02T10:55:49.541697+0000","last_peered":"2023-03-02T10:55:49.541697+0000","last_clean":"2023-03-02T10:55:49.541697+0000","last_became_active":"2023-03-02T10:55:10.622643+0000","last_became_peered":"2023-03-02T10:55:10.622643+0000","last_unstale":"2023-03-02T10:55:49.541697+0000","last_undegraded":"2023-03-02T10:55:49.541697+0000","last_fullsized":"2023-03-02T10:55:49.541697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:53:05.459021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:50.547995+0000","last_change":"2023-03-02T10:55:50.547995+0000","last_active":"2023-03-02T10:55:50.547995+0000","last_peered":"2023-03-02T10:55:50.547995+0000","last_clean":"2023-03-02T10:55:50.547995+0000","last_became_active":"2023-03-02T10:55:50.541460+0000","last_became_peered":"2023-03-02T10:55:50.541460+0000","last_unstale":"2023-03-02T10:55:50.547995+0000","last_undegraded":"2023-03-02T10:55:50.547995+0000","last_fullsized":"2023-03-02T10:55:50.547995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:02:50.853731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.538722+0000","last_change":"2023-03-02T10:55:10.633149+0000","last_active":"2023-03-02T10:55:49.538722+0000","last_peered":"2023-03-02T10:55:49.538722+0000","last_clean":"2023-03-02T10:55:49.538722+0000","last_became_active":"2023-03-02T10:55:10.632816+0000","last_became_peered":"2023-03-02T10:55:10.632816+0000","last_unstale":"2023-03-02T10:55:49.538722+0000","last_undegraded":"2023-03-02T10:55:49.538722+0000","last_fullsized":"2023-03-02T10:55:49.538722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:25:41.585257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533012+0000","last_change":"2023-03-02T10:55:10.150486+0000","last_active":"2023-03-02T10:55:49.533012+0000","last_peered":"2023-03-02T10:55:49.533012+0000","last_clean":"2023-03-02T10:55:49.533012+0000","last_became_active":"2023-03-02T10:55:10.150186+0000","last_became_peered":"2023-03-02T10:55:10.150186+0000","last_unstale":"2023-03-02T10:55:49.533012+0000","last_undegraded":"2023-03-02T10:55:49.533012+0000","last_fullsized":"2023-03-02T10:55:49.533012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:06:18.637162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540413+0000","last_change":"2023-03-02T10:55:10.628622+0000","last_active":"2023-03-02T10:55:49.540413+0000","last_peered":"2023-03-02T10:55:49.540413+0000","last_clean":"2023-03-02T10:55:49.540413+0000","last_became_active":"2023-03-02T10:55:10.628258+0000","last_became_peered":"2023-03-02T10:55:10.628258+0000","last_unstale":"2023-03-02T10:55:49.540413+0000","last_undegraded":"2023-03-02T10:55:49.540413+0000","last_fullsized":"2023-03-02T10:55:49.540413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:46.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:58.562028+0000","last_change":"2023-03-02T10:55:51.151512+0000","last_active":"2023-03-02T10:55:58.562028+0000","last_peered":"2023-03-02T10:55:58.562028+0000","last_clean":"2023-03-02T10:55:58.562028+0000","last_became_active":"2023-03-02T10:55:50.544349+0000","last_became_peered":"2023-03-02T10:55:50.544349+0000","last_unstale":"2023-03-02T10:55:58.562028+0000","last_undegraded":"2023-03-02T10:55:58.562028+0000","last_fullsized":"2023-03-02T10:55:58.562028+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:13.679666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.092083+0000","last_change":"2023-03-02T10:55:51.092083+0000","last_active":"2023-03-02T10:55:51.092083+0000","last_peered":"2023-03-02T10:55:51.092083+0000","last_clean":"2023-03-02T10:55:51.092083+0000","last_became_active":"2023-03-02T10:55:51.091536+0000","last_became_peered":"2023-03-02T10:55:51.091536+0000","last_unstale":"2023-03-02T10:55:51.092083+0000","last_undegraded":"2023-03-02T10:55:51.092083+0000","last_fullsized":"2023-03-02T10:55:51.092083+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:18:38.983021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541745+0000","last_change":"2023-03-02T10:55:10.613814+0000","last_active":"2023-03-02T10:55:49.541745+0000","last_peered":"2023-03-02T10:55:49.541745+0000","last_clean":"2023-03-02T10:55:49.541745+0000","last_became_active":"2023-03-02T10:55:10.613496+0000","last_became_peered":"2023-03-02T10:55:10.613496+0000","last_unstale":"2023-03-02T10:55:49.541745+0000","last_undegraded":"2023-03-02T10:55:49.541745+0000","last_fullsized":"2023-03-02T10:55:49.541745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:55:58.332549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":62,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:57.632016+0000","last_change":"2023-03-02T10:55:10.160751+0000","last_active":"2023-03-02T10:55:57.632016+0000","last_peered":"2023-03-02T10:55:57.632016+0000","last_clean":"2023-03-02T10:55:57.632016+0000","last_became_active":"2023-03-02T10:55:10.160433+0000","last_became_peered":"2023-03-02T10:55:10.160433+0000","last_unstale":"2023-03-02T10:55:57.632016+0000","last_undegraded":"2023-03-02T10:55:57.632016+0000","last_fullsized":"2023-03-02T10:55:57.632016+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:11:23.326464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542780+0000","last_change":"2023-03-02T10:55:10.619761+0000","last_active":"2023-03-02T10:55:49.542780+0000","last_peered":"2023-03-02T10:55:49.542780+0000","last_clean":"2023-03-02T10:55:49.542780+0000","last_became_active":"2023-03-02T10:55:10.617361+0000","last_became_peered":"2023-03-02T10:55:10.617361+0000","last_unstale":"2023-03-02T10:55:49.542780+0000","last_undegraded":"2023-03-02T10:55:49.542780+0000","last_fullsized":"2023-03-02T10:55:49.542780+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:26:55.492653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540413+0000","last_change":"2023-03-02T10:55:10.151553+0000","last_active":"2023-03-02T10:55:49.540413+0000","last_peered":"2023-03-02T10:55:49.540413+0000","last_clean":"2023-03-02T10:55:49.540413+0000","last_became_active":"2023-03-02T10:55:10.151369+0000","last_became_peered":"2023-03-02T10:55:10.151369+0000","last_unstale":"2023-03-02T10:55:49.540413+0000","last_undegraded":"2023-03-02T10:55:49.540413+0000","last_fullsized":"2023-03-02T10:55:49.540413+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:30:42.550362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":374,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539716+0000","last_change":"2023-03-02T10:54:06.270813+0000","last_active":"2023-03-02T10:55:49.539716+0000","last_peered":"2023-03-02T10:55:49.539716+0000","last_clean":"2023-03-02T10:55:49.539716+0000","last_became_active":"2023-03-02T10:54:06.270329+0000","last_became_peered":"2023-03-02T10:54:06.270329+0000","last_unstale":"2023-03-02T10:55:49.539716+0000","last_undegraded":"2023-03-02T10:55:49.539716+0000","last_fullsized":"2023-03-02T10:55:49.539716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_clean_scrub_stamp":"2023-03-02T10:51:04.207601+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:07.546806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539630+0000","last_change":"2023-03-02T10:55:10.629032+0000","last_active":"2023-03-02T10:55:49.539630+0000","last_peered":"2023-03-02T10:55:49.539630+0000","last_clean":"2023-03-02T10:55:49.539630+0000","last_became_active":"2023-03-02T10:55:10.628696+0000","last_became_peered":"2023-03-02T10:55:10.628696+0000","last_unstale":"2023-03-02T10:55:49.539630+0000","last_undegraded":"2023-03-02T10:55:49.539630+0000","last_fullsized":"2023-03-02T10:55:49.539630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:32:58.399900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539930+0000","last_change":"2023-03-02T10:55:10.153240+0000","last_active":"2023-03-02T10:55:49.539930+0000","last_peered":"2023-03-02T10:55:49.539930+0000","last_clean":"2023-03-02T10:55:49.539930+0000","last_became_active":"2023-03-02T10:55:10.152977+0000","last_became_peered":"2023-03-02T10:55:10.152977+0000","last_unstale":"2023-03-02T10:55:49.539930+0000","last_undegraded":"2023-03-02T10:55:49.539930+0000","last_fullsized":"2023-03-02T10:55:49.539930+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:46:49.873113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537639+0000","last_change":"2023-03-02T10:55:10.154392+0000","last_active":"2023-03-02T10:55:49.537639+0000","last_peered":"2023-03-02T10:55:49.537639+0000","last_clean":"2023-03-02T10:55:49.537639+0000","last_became_active":"2023-03-02T10:55:10.154110+0000","last_became_peered":"2023-03-02T10:55:10.154110+0000","last_unstale":"2023-03-02T10:55:49.537639+0000","last_undegraded":"2023-03-02T10:55:49.537639+0000","last_fullsized":"2023-03-02T10:55:49.537639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:11:05.910487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539801+0000","last_change":"2023-03-02T10:55:10.627181+0000","last_active":"2023-03-02T10:55:49.539801+0000","last_peered":"2023-03-02T10:55:49.539801+0000","last_clean":"2023-03-02T10:55:49.539801+0000","last_became_active":"2023-03-02T10:55:10.626891+0000","last_became_peered":"2023-03-02T10:55:10.626891+0000","last_unstale":"2023-03-02T10:55:49.539801+0000","last_undegraded":"2023-03-02T10:55:49.539801+0000","last_fullsized":"2023-03-02T10:55:49.539801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:37.990553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533056+0000","last_change":"2023-03-02T10:55:10.146146+0000","last_active":"2023-03-02T10:55:49.533056+0000","last_peered":"2023-03-02T10:55:49.533056+0000","last_clean":"2023-03-02T10:55:49.533056+0000","last_became_active":"2023-03-02T10:55:10.145824+0000","last_became_peered":"2023-03-02T10:55:10.145824+0000","last_unstale":"2023-03-02T10:55:49.533056+0000","last_undegraded":"2023-03-02T10:55:49.533056+0000","last_fullsized":"2023-03-02T10:55:49.533056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:05:35.846016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543066+0000","last_change":"2023-03-02T10:55:10.636566+0000","last_active":"2023-03-02T10:55:49.543066+0000","last_peered":"2023-03-02T10:55:49.543066+0000","last_clean":"2023-03-02T10:55:49.543066+0000","last_became_active":"2023-03-02T10:55:10.636033+0000","last_became_peered":"2023-03-02T10:55:10.636033+0000","last_unstale":"2023-03-02T10:55:49.543066+0000","last_undegraded":"2023-03-02T10:55:49.543066+0000","last_fullsized":"2023-03-02T10:55:49.543066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:35:24.955628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540621+0000","last_change":"2023-03-02T10:55:10.156550+0000","last_active":"2023-03-02T10:55:49.540621+0000","last_peered":"2023-03-02T10:55:49.540621+0000","last_clean":"2023-03-02T10:55:49.540621+0000","last_became_active":"2023-03-02T10:55:10.156286+0000","last_became_peered":"2023-03-02T10:55:10.156286+0000","last_unstale":"2023-03-02T10:55:49.540621+0000","last_undegraded":"2023-03-02T10:55:49.540621+0000","last_fullsized":"2023-03-02T10:55:49.540621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:45:51.476117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543564+0000","last_change":"2023-03-02T10:55:10.631769+0000","last_active":"2023-03-02T10:55:49.543564+0000","last_peered":"2023-03-02T10:55:49.543564+0000","last_clean":"2023-03-02T10:55:49.543564+0000","last_became_active":"2023-03-02T10:55:10.631429+0000","last_became_peered":"2023-03-02T10:55:10.631429+0000","last_unstale":"2023-03-02T10:55:49.543564+0000","last_undegraded":"2023-03-02T10:55:49.543564+0000","last_fullsized":"2023-03-02T10:55:49.543564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:42:52.764994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534314+0000","last_change":"2023-03-02T10:55:10.152435+0000","last_active":"2023-03-02T10:55:49.534314+0000","last_peered":"2023-03-02T10:55:49.534314+0000","last_clean":"2023-03-02T10:55:49.534314+0000","last_became_active":"2023-03-02T10:55:10.152008+0000","last_became_peered":"2023-03-02T10:55:10.152008+0000","last_unstale":"2023-03-02T10:55:49.534314+0000","last_undegraded":"2023-03-02T10:55:49.534314+0000","last_fullsized":"2023-03-02T10:55:49.534314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:46:39.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.536281+0000","last_change":"2023-03-02T10:55:10.624337+0000","last_active":"2023-03-02T10:55:49.536281+0000","last_peered":"2023-03-02T10:55:49.536281+0000","last_clean":"2023-03-02T10:55:49.536281+0000","last_became_active":"2023-03-02T10:55:10.623979+0000","last_became_peered":"2023-03-02T10:55:10.623979+0000","last_unstale":"2023-03-02T10:55:49.536281+0000","last_undegraded":"2023-03-02T10:55:49.536281+0000","last_fullsized":"2023-03-02T10:55:49.536281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:14:39.173460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542638+0000","last_change":"2023-03-02T10:55:10.152406+0000","last_active":"2023-03-02T10:55:49.542638+0000","last_peered":"2023-03-02T10:55:49.542638+0000","last_clean":"2023-03-02T10:55:49.542638+0000","last_became_active":"2023-03-02T10:55:10.152026+0000","last_became_peered":"2023-03-02T10:55:10.152026+0000","last_unstale":"2023-03-02T10:55:49.542638+0000","last_undegraded":"2023-03-02T10:55:49.542638+0000","last_fullsized":"2023-03-02T10:55:49.542638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:49:17.617792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537877+0000","last_change":"2023-03-02T10:55:10.620061+0000","last_active":"2023-03-02T10:55:49.537877+0000","last_peered":"2023-03-02T10:55:49.537877+0000","last_clean":"2023-03-02T10:55:49.537877+0000","last_became_active":"2023-03-02T10:55:10.619753+0000","last_became_peered":"2023-03-02T10:55:10.619753+0000","last_unstale":"2023-03-02T10:55:49.537877+0000","last_undegraded":"2023-03-02T10:55:49.537877+0000","last_fullsized":"2023-03-02T10:55:49.537877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:40:02.479733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534006+0000","last_change":"2023-03-02T10:55:10.149827+0000","last_active":"2023-03-02T10:55:49.534006+0000","last_peered":"2023-03-02T10:55:49.534006+0000","last_clean":"2023-03-02T10:55:49.534006+0000","last_became_active":"2023-03-02T10:55:10.149522+0000","last_became_peered":"2023-03-02T10:55:10.149522+0000","last_unstale":"2023-03-02T10:55:49.534006+0000","last_undegraded":"2023-03-02T10:55:49.534006+0000","last_fullsized":"2023-03-02T10:55:49.534006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:23:27.072235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542687+0000","last_change":"2023-03-02T10:55:10.618992+0000","last_active":"2023-03-02T10:55:49.542687+0000","last_peered":"2023-03-02T10:55:49.542687+0000","last_clean":"2023-03-02T10:55:49.542687+0000","last_became_active":"2023-03-02T10:55:10.618678+0000","last_became_peered":"2023-03-02T10:55:10.618678+0000","last_unstale":"2023-03-02T10:55:49.542687+0000","last_undegraded":"2023-03-02T10:55:49.542687+0000","last_fullsized":"2023-03-02T10:55:49.542687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:33:26.966579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.321810+0000","last_change":"2023-03-02T10:55:51.321810+0000","last_active":"2023-03-02T10:55:51.321810+0000","last_peered":"2023-03-02T10:55:51.321810+0000","last_clean":"2023-03-02T10:55:51.321810+0000","last_became_active":"2023-03-02T10:55:50.544110+0000","last_became_peered":"2023-03-02T10:55:50.544110+0000","last_unstale":"2023-03-02T10:55:51.321810+0000","last_undegraded":"2023-03-02T10:55:51.321810+0000","last_fullsized":"2023-03-02T10:55:51.321810+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:59:33.358979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539914+0000","last_change":"2023-03-02T10:55:10.625524+0000","last_active":"2023-03-02T10:55:49.539914+0000","last_peered":"2023-03-02T10:55:49.539914+0000","last_clean":"2023-03-02T10:55:49.539914+0000","last_became_active":"2023-03-02T10:55:10.625249+0000","last_became_peered":"2023-03-02T10:55:10.625249+0000","last_unstale":"2023-03-02T10:55:49.539914+0000","last_undegraded":"2023-03-02T10:55:49.539914+0000","last_fullsized":"2023-03-02T10:55:49.539914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:03:16.230549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:55.659942+0000","last_change":"2023-03-02T10:55:10.159691+0000","last_active":"2023-03-02T10:55:55.659942+0000","last_peered":"2023-03-02T10:55:55.659942+0000","last_clean":"2023-03-02T10:55:55.659942+0000","last_became_active":"2023-03-02T10:55:10.159360+0000","last_became_peered":"2023-03-02T10:55:10.159360+0000","last_unstale":"2023-03-02T10:55:55.659942+0000","last_undegraded":"2023-03-02T10:55:55.659942+0000","last_fullsized":"2023-03-02T10:55:55.659942+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:21:05.305932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540203+0000","last_change":"2023-03-02T10:55:10.621119+0000","last_active":"2023-03-02T10:55:49.540203+0000","last_peered":"2023-03-02T10:55:49.540203+0000","last_clean":"2023-03-02T10:55:49.540203+0000","last_became_active":"2023-03-02T10:55:10.620370+0000","last_became_peered":"2023-03-02T10:55:10.620370+0000","last_unstale":"2023-03-02T10:55:49.540203+0000","last_undegraded":"2023-03-02T10:55:49.540203+0000","last_fullsized":"2023-03-02T10:55:49.540203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:33:20.678615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541953+0000","last_change":"2023-03-02T10:55:10.155403+0000","last_active":"2023-03-02T10:55:49.541953+0000","last_peered":"2023-03-02T10:55:49.541953+0000","last_clean":"2023-03-02T10:55:49.541953+0000","last_became_active":"2023-03-02T10:55:10.152547+0000","last_became_peered":"2023-03-02T10:55:10.152547+0000","last_unstale":"2023-03-02T10:55:49.541953+0000","last_undegraded":"2023-03-02T10:55:49.541953+0000","last_fullsized":"2023-03-02T10:55:49.541953+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:18:30.564037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.094932+0000","last_change":"2023-03-02T10:55:51.094932+0000","last_active":"2023-03-02T10:55:51.094932+0000","last_peered":"2023-03-02T10:55:51.094932+0000","last_clean":"2023-03-02T10:55:51.094932+0000","last_became_active":"2023-03-02T10:55:51.091808+0000","last_became_peered":"2023-03-02T10:55:51.091808+0000","last_unstale":"2023-03-02T10:55:51.094932+0000","last_undegraded":"2023-03-02T10:55:51.094932+0000","last_fullsized":"2023-03-02T10:55:51.094932+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:26:42.737673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539999+0000","last_change":"2023-03-02T10:55:10.159307+0000","last_active":"2023-03-02T10:55:49.539999+0000","last_peered":"2023-03-02T10:55:49.539999+0000","last_clean":"2023-03-02T10:55:49.539999+0000","last_became_active":"2023-03-02T10:55:10.158979+0000","last_became_peered":"2023-03-02T10:55:10.158979+0000","last_unstale":"2023-03-02T10:55:49.539999+0000","last_undegraded":"2023-03-02T10:55:49.539999+0000","last_fullsized":"2023-03-02T10:55:49.539999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:13:54.984801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539959+0000","last_change":"2023-03-02T10:55:10.630995+0000","last_active":"2023-03-02T10:55:49.539959+0000","last_peered":"2023-03-02T10:55:49.539959+0000","last_clean":"2023-03-02T10:55:49.539959+0000","last_became_active":"2023-03-02T10:55:10.630654+0000","last_became_peered":"2023-03-02T10:55:10.630654+0000","last_unstale":"2023-03-02T10:55:49.539959+0000","last_undegraded":"2023-03-02T10:55:49.539959+0000","last_fullsized":"2023-03-02T10:55:49.539959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:25:50.945152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537849+0000","last_change":"2023-03-02T10:55:10.633263+0000","last_active":"2023-03-02T10:55:49.537849+0000","last_peered":"2023-03-02T10:55:49.537849+0000","last_clean":"2023-03-02T10:55:49.537849+0000","last_became_active":"2023-03-02T10:55:10.632796+0000","last_became_peered":"2023-03-02T10:55:10.632796+0000","last_unstale":"2023-03-02T10:55:49.537849+0000","last_undegraded":"2023-03-02T10:55:49.537849+0000","last_fullsized":"2023-03-02T10:55:49.537849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:04:02.060792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533967+0000","last_change":"2023-03-02T10:55:10.620195+0000","last_active":"2023-03-02T10:55:49.533967+0000","last_peered":"2023-03-02T10:55:49.533967+0000","last_clean":"2023-03-02T10:55:49.533967+0000","last_became_active":"2023-03-02T10:55:10.619904+0000","last_became_peered":"2023-03-02T10:55:10.619904+0000","last_unstale":"2023-03-02T10:55:49.533967+0000","last_undegraded":"2023-03-02T10:55:49.533967+0000","last_fullsized":"2023-03-02T10:55:49.533967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:03:43.176587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533939+0000","last_change":"2023-03-02T10:55:10.619427+0000","last_active":"2023-03-02T10:55:49.533939+0000","last_peered":"2023-03-02T10:55:49.533939+0000","last_clean":"2023-03-02T10:55:49.533939+0000","last_became_active":"2023-03-02T10:55:10.618184+0000","last_became_peered":"2023-03-02T10:55:10.618184+0000","last_unstale":"2023-03-02T10:55:49.533939+0000","last_undegraded":"2023-03-02T10:55:49.533939+0000","last_fullsized":"2023-03-02T10:55:49.533939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:00.907091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543814+0000","last_change":"2023-03-02T10:55:10.630058+0000","last_active":"2023-03-02T10:55:49.543814+0000","last_peered":"2023-03-02T10:55:49.543814+0000","last_clean":"2023-03-02T10:55:49.543814+0000","last_became_active":"2023-03-02T10:55:10.626022+0000","last_became_peered":"2023-03-02T10:55:10.626022+0000","last_unstale":"2023-03-02T10:55:49.543814+0000","last_undegraded":"2023-03-02T10:55:49.543814+0000","last_fullsized":"2023-03-02T10:55:49.543814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:23:27.900984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539897+0000","last_change":"2023-03-02T10:55:10.621984+0000","last_active":"2023-03-02T10:55:49.539897+0000","last_peered":"2023-03-02T10:55:49.539897+0000","last_clean":"2023-03-02T10:55:49.539897+0000","last_became_active":"2023-03-02T10:55:10.621636+0000","last_became_peered":"2023-03-02T10:55:10.621636+0000","last_unstale":"2023-03-02T10:55:49.539897+0000","last_undegraded":"2023-03-02T10:55:49.539897+0000","last_fullsized":"2023-03-02T10:55:49.539897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:10:41.154358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.538439+0000","last_change":"2023-03-02T10:55:10.633194+0000","last_active":"2023-03-02T10:55:49.538439+0000","last_peered":"2023-03-02T10:55:49.538439+0000","last_clean":"2023-03-02T10:55:49.538439+0000","last_became_active":"2023-03-02T10:55:10.632860+0000","last_became_peered":"2023-03-02T10:55:10.632860+0000","last_unstale":"2023-03-02T10:55:49.538439+0000","last_undegraded":"2023-03-02T10:55:49.538439+0000","last_fullsized":"2023-03-02T10:55:49.538439+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:34:58.071830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.535109+0000","last_change":"2023-03-02T10:55:10.613717+0000","last_active":"2023-03-02T10:55:49.535109+0000","last_peered":"2023-03-02T10:55:49.535109+0000","last_clean":"2023-03-02T10:55:49.535109+0000","last_became_active":"2023-03-02T10:55:10.613391+0000","last_became_peered":"2023-03-02T10:55:10.613391+0000","last_unstale":"2023-03-02T10:55:49.535109+0000","last_undegraded":"2023-03-02T10:55:49.535109+0000","last_fullsized":"2023-03-02T10:55:49.535109+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:51:23.532086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542907+0000","last_change":"2023-03-02T10:55:10.637730+0000","last_active":"2023-03-02T10:55:49.542907+0000","last_peered":"2023-03-02T10:55:49.542907+0000","last_clean":"2023-03-02T10:55:49.542907+0000","last_became_active":"2023-03-02T10:55:10.637097+0000","last_became_peered":"2023-03-02T10:55:10.637097+0000","last_unstale":"2023-03-02T10:55:49.542907+0000","last_undegraded":"2023-03-02T10:55:49.542907+0000","last_fullsized":"2023-03-02T10:55:49.542907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:41:19.587933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541693+0000","last_change":"2023-03-02T10:55:10.617374+0000","last_active":"2023-03-02T10:55:49.541693+0000","last_peered":"2023-03-02T10:55:49.541693+0000","last_clean":"2023-03-02T10:55:49.541693+0000","last_became_active":"2023-03-02T10:55:10.617061+0000","last_became_peered":"2023-03-02T10:55:10.617061+0000","last_unstale":"2023-03-02T10:55:49.541693+0000","last_undegraded":"2023-03-02T10:55:49.541693+0000","last_fullsized":"2023-03-02T10:55:49.541693+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:03:41.270487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542759+0000","last_change":"2023-03-02T10:55:10.622246+0000","last_active":"2023-03-02T10:55:49.542759+0000","last_peered":"2023-03-02T10:55:49.542759+0000","last_clean":"2023-03-02T10:55:49.542759+0000","last_became_active":"2023-03-02T10:55:10.621938+0000","last_became_peered":"2023-03-02T10:55:10.621938+0000","last_unstale":"2023-03-02T10:55:49.542759+0000","last_undegraded":"2023-03-02T10:55:49.542759+0000","last_fullsized":"2023-03-02T10:55:49.542759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:39:35.605113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534507+0000","last_change":"2023-03-02T10:55:10.623502+0000","last_active":"2023-03-02T10:55:49.534507+0000","last_peered":"2023-03-02T10:55:49.534507+0000","last_clean":"2023-03-02T10:55:49.534507+0000","last_became_active":"2023-03-02T10:55:10.623160+0000","last_became_peered":"2023-03-02T10:55:10.623160+0000","last_unstale":"2023-03-02T10:55:49.534507+0000","last_undegraded":"2023-03-02T10:55:49.534507+0000","last_fullsized":"2023-03-02T10:55:49.534507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:30:49.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539815+0000","last_change":"2023-03-02T10:55:10.636452+0000","last_active":"2023-03-02T10:55:49.539815+0000","last_peered":"2023-03-02T10:55:49.539815+0000","last_clean":"2023-03-02T10:55:49.539815+0000","last_became_active":"2023-03-02T10:55:10.636176+0000","last_became_peered":"2023-03-02T10:55:10.636176+0000","last_unstale":"2023-03-02T10:55:49.539815+0000","last_undegraded":"2023-03-02T10:55:49.539815+0000","last_fullsized":"2023-03-02T10:55:49.539815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:51.303295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.092168+0000","last_change":"2023-03-02T10:55:51.092168+0000","last_active":"2023-03-02T10:55:51.092168+0000","last_peered":"2023-03-02T10:55:51.092168+0000","last_clean":"2023-03-02T10:55:51.092168+0000","last_became_active":"2023-03-02T10:55:51.091735+0000","last_became_peered":"2023-03-02T10:55:51.091735+0000","last_unstale":"2023-03-02T10:55:51.092168+0000","last_undegraded":"2023-03-02T10:55:51.092168+0000","last_fullsized":"2023-03-02T10:55:51.092168+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:25:46.235073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":254019,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63091,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":419,"num_read_kb":296,"num_write":230,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":610,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":189273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416407,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6048,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739104,"statfs":{"total":95995035648,"available":95988842496,"internally_reserved":0,"allocated":942080,"data_stored":448834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":3.8109999999999999}]},{"osd":1,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.56799999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":9,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.68899999999999995}]},{"osd":10,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.72099999999999997}]}]},{"osd":10,"up_from":71,"seq":304942678042,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6504,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738648,"statfs":{"total":95995035648,"available":95988375552,"internally_reserved":0,"allocated":1081344,"data_stored":1095287,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.308},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.627},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.66500000000000004}]},{"osd":9,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.53300000000000003}]},{"osd":11,"last update":"Thu Mar 2 10:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68500000000000005}]}]},{"osd":9,"up_from":66,"seq":283467841567,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6260,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738892,"statfs":{"total":95995035648,"available":95988625408,"internally_reserved":0,"allocated":962560,"data_stored":448277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.55200000000000005,"5min":0.871,"15min":0.871},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.58799999999999997,"5min":1.823,"15min":1.823},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67900000000000005,"15min":0.69199999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85499999999999998,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.73599999999999999,"15min":0.76000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.747,"5min":0.999,"15min":0.999},"last":6.7990000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.71899999999999997,"15min":0.73899999999999999},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79700000000000004,"5min":1.266,"15min":1.266},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.65900000000000003,"15min":0.68899999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63400000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.36099999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57799999999999996,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.92700000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.85899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.83099999999999996,"15min":0.86099999999999999},"min":{"1min":0.53700000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.86899999999999999,"5min":1.956,"15min":1.956},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.84199999999999997,"15min":0.876},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.82999999999999996,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.82199999999999995,"15min":0.85699999999999998},"min":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2569999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.82799999999999996,"15min":0.85899999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89700000000000002,"5min":1.452,"15min":1.452},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.90000000000000002,"15min":0.93000000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.86899999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.89600000000000002,"15min":0.92700000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2130000000000001,"5min":1.522,"15min":1.522},"last":0.64300000000000002}]},{"osd":8,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95999999999999996,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":6.8170000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.93400000000000005,"15min":0.96499999999999997},"min":{"1min":0.63100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.90600000000000003,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.75600000000000001}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.68400000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070499,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6440,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738712,"statfs":{"total":95995035648,"available":95988441088,"internally_reserved":0,"allocated":950272,"data_stored":448494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58499999999999996,"15min":0.57299999999999995},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78000000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63100000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76200000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79900000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.748},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.875},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.88500000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.71499999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.05,"5min":0.79700000000000004,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":0.80400000000000005}]},{"osd":10,"last update":"Thu Mar 2 10:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.91000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]},{"osd":7,"up_from":52,"seq":223338299431,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6492,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738660,"statfs":{"total":95995035648,"available":95988387840,"internally_reserved":0,"allocated":1003520,"data_stored":1040841,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84499999999999997,"5min":1.034,"15min":1.034},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.41499999999999998},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60799999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.76100000000000001,"5min":1.129,"15min":1.129},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.438,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80200000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.746}]},{"osd":3,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81899999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.81899999999999995}]},{"osd":4,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70599999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.46000000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84899999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90500000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.80200000000000005}]},{"osd":8,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.87,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.91500000000000004}]},{"osd":9,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81599999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69699999999999995,"15min":0.70099999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92100000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.873}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.90300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]},{"osd":6,"up_from":47,"seq":201863462957,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738848,"statfs":{"total":95995035648,"available":95988580352,"internally_reserved":0,"allocated":942080,"data_stored":447893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.41399999999999998,"15min":0.40200000000000002},"min":{"1min":0.30599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65000000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.53600000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.91400000000000003,"5min":0.999,"15min":0.999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60399999999999998,"15min":0.58199999999999996},"min":{"1min":0.46300000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.82399999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.499,"15min":0.495},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.83299999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97999999999999998,"5min":1.069,"15min":1.069},"last":0.625}]},{"osd":5,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.69599999999999995,"15min":0.67000000000000004},"min":{"1min":0.5,"5min":0.439,"15min":0.439},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.69399999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92700000000000005,"5min":1.03,"15min":1.03},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Mar 2 10:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.73899999999999999,"15min":0.72599999999999998},"min":{"1min":0.57599999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.747,"15min":0.73499999999999999},"min":{"1min":0.629,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.748}]},{"osd":8,"last update":"Thu Mar 2 10:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0049999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.83499999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.84099999999999997,"15min":0.86199999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97099999999999997,"5min":1.234,"15min":1.234},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.018,"5min":1.163,"15min":1.163},"last":0.78500000000000003}]},{"osd":10,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7384,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737768,"statfs":{"total":95995035648,"available":95987474432,"internally_reserved":0,"allocated":999424,"data_stored":504737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51000000000000001,"15min":0.48799999999999999},"min":{"1min":0.36499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.75,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.505,"15min":0.502},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81100000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Mar 2 10:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Mar 2 10:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.42399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90500000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.55100000000000005},"min":{"1min":0.44900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Mar 2 10:55:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.443,"15min":0.40899999999999997},"min":{"1min":0.29199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.53000000000000003,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Mar 2 10:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90400000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.47499999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93400000000000005,"5min":1.097,"15min":1.097},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.51700000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96999999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":2.7480000000000002}]},{"osd":7,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.81899999999999995}]},{"osd":8,"last update":"Thu Mar 2 10:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.878},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.68700000000000006}]},{"osd":9,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.56999999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0209999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.53300000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.85199999999999998}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.83399999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7220,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737932,"statfs":{"total":95995035648,"available":95987642368,"internally_reserved":0,"allocated":962560,"data_stored":449194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54700000000000004,"15min":0.48999999999999999},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.873,"15min":0.873},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.56200000000000006,"15min":0.50900000000000001},"min":{"1min":0.50800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58499999999999996,"15min":0.54400000000000004},"min":{"1min":0.48599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Mar 2 10:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.41899999999999998},"min":{"1min":0.29099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71199999999999997,"5min":0.755,"15min":0.755},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.432,"15min":0.41399999999999998},"min":{"1min":0.32200000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.496}]},{"osd":4,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.64800000000000002,"15min":0.57799999999999996},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.7569999999999997,"5min":4.7569999999999997,"15min":4.7569999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80500000000000005,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Mar 2 10:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.61899999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75800000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94299999999999995,"5min":1.149,"15min":1.149},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Mar 2 10:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.434},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.63400000000000001,"15min":0.64100000000000001},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76600000000000001,"5min":1.171,"15min":1.171},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.47299999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.054,"5min":1.298,"15min":1.298},"last":0.745},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0740000000000001,"5min":1.23,"15min":1.23},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.79200000000000004,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.86299999999999999,"5min":1.179,"15min":1.179},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78300000000000003,"15min":0.79700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.012,"5min":1.117,"15min":1.117},"last":0.68700000000000006}]},{"osd":9,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.76400000000000001,"15min":0.78100000000000003},"min":{"1min":0.40500000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.093,"5min":1.149,"15min":1.149},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1950000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.61799999999999999}]},{"osd":10,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.68100000000000005}]},{"osd":11,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.748}]}]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7468,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737684,"statfs":{"total":95995035648,"available":95987388416,"internally_reserved":0,"allocated":1019904,"data_stored":505363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.496},"min":{"1min":0.375,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.442},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.503},"min":{"1min":0.41199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.82899999999999996,"5min":0.874,"15min":0.874},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53400000000000003,"15min":0.51200000000000001},"min":{"1min":0.36299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72199999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.54200000000000004,"15min":0.50800000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Mar 2 10:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.623,"15min":0.57399999999999995},"min":{"1min":0.38200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.8140000000000001,"5min":3.8140000000000001,"15min":3.8140000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.61899999999999999,"15min":0.58899999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":3.7669999999999999},"last":0.497}]},{"osd":4,"last update":"Thu Mar 2 10:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Mar 2 10:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.502,"15min":0.50800000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72499999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":0.871,"15min":0.871},"last":0.755},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.63400000000000001,"15min":0.61399999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":4.0490000000000004,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":0.63}]},{"osd":7,"last update":"Thu Mar 2 10:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.6639999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.31900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.83999999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.76800000000000002}]},{"osd":9,"last update":"Thu Mar 2 10:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.69899999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.73999999999999999,"15min":0.71899999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.1790000000000003,"5min":4.1790000000000003,"15min":4.1790000000000003},"last":0.73899999999999999}]},{"osd":10,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.83699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6568,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738584,"statfs":{"total":95995035648,"available":95988310016,"internally_reserved":0,"allocated":950272,"data_stored":447270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:34 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":0.56899999999999995,"15min":0.437},"min":{"1min":0.29599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":14.122,"5min":14.122,"15min":14.122},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.0860000000000001,"5min":0.54000000000000004,"15min":0.434},"min":{"1min":0.31900000000000001,"5min":0.245,"15min":0.245},"max":{"1min":9.1010000000000009,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.60799999999999998,"15min":0.57099999999999995},"min":{"1min":0.39100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.175,"5min":0.68200000000000005,"15min":0.59599999999999997},"min":{"1min":0.38,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":9.0719999999999992,"5min":9.0719999999999992,"15min":9.0719999999999992},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.65500000000000003,"15min":0.60999999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.64700000000000002,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.623}]},{"osd":4,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65900000000000003,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Mar 2 10:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.68500000000000005,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.41599999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Mar 2 10:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.62,"15min":0.56699999999999995},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.0170000000000003,"5min":5.0170000000000003,"15min":5.0170000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":0.69699999999999995,"15min":0.60699999999999998},"min":{"1min":0.39000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":9.1270000000000007,"5min":9.1270000000000007,"15min":9.1270000000000007},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.80000000000000004,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0029999999999999,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.749},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.53400000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.88400000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":6.9539999999999997,"5min":6.9539999999999997,"15min":6.9539999999999997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.76300000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.76500000000000001,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.82799999999999996,"15min":0.80900000000000005},"min":{"1min":0.56599999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.80400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888118,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6496,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738656,"statfs":{"total":95995035648,"available":95988383744,"internally_reserved":0,"allocated":942080,"data_stored":448138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65300000000000002,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":5.8860000000000001,"15min":5.8860000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64000000000000001,"15min":0.67400000000000004},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.95599999999999996,"5min":5.577,"15min":5.577},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38200000000000001,"15min":0.34999999999999998},"min":{"1min":0.30399999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.65700000000000003,"5min":0.872,"15min":0.872},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.35899999999999999},"min":{"1min":0.34300000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.47999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57699999999999996,"15min":0.54300000000000004},"min":{"1min":0.49199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.56399999999999995,"15min":0.53600000000000003},"min":{"1min":0.47199999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.55500000000000005},"min":{"1min":0.38700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Mar 2 10:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.56299999999999994,"15min":0.54600000000000004},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.42799999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Mar 2 10:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60199999999999998,"15min":0.58299999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80300000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63700000000000001,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Mar 2 10:54:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.34899999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.503},{"interface":"front","average":{"1min":0.62,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.39100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.45200000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.70299999999999996},"min":{"1min":0.52400000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.85999999999999999,"5min":1.087,"15min":1.087},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.70499999999999996,"15min":0.69499999999999995},"min":{"1min":0.55800000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95199999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.751},"min":{"1min":0.50800000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1180000000000001,"5min":1.149,"15min":1.149},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.107,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67700000000000005}]},{"osd":10,"last update":"Thu Mar 2 10:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.66000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":5,"up_from":39,"seq":167503724592,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6568,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738584,"statfs":{"total":95995035648,"available":95988310016,"internally_reserved":0,"allocated":1015808,"data_stored":1040370,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":1.51,"15min":1.51},"last":0.505},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.56200000000000006},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83899999999999997,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42399999999999999,"15min":0.41799999999999998},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59299999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.443}]},{"osd":3,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57099999999999995,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76600000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79600000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97299999999999998,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.878,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85599999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67300000000000004,"15min":0.67800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.70399999999999996}]},{"osd":8,"last update":"Thu Mar 2 10:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.44700000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.65800000000000003}]},{"osd":9,"last update":"Thu Mar 2 10:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.749,"15min":0.751},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.67300000000000004}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.74299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":58079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-02T10:56:03.584 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph pg dump --format=json 2023-03-02T10:56:04.318 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:56:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:04 smithi136 ceph-mon[125702]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:04 smithi136 ceph-mon[125702]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 61 B/s, 0 keys/s, 1 objects/s recovering 2023-03-02T10:56:04.592 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:04 smithi057 ceph-mon[92072]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:04.592 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:04 smithi057 ceph-mon[92072]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 61 B/s, 0 keys/s, 1 objects/s recovering 2023-03-02T10:56:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:04 smithi122 ceph-mon[125440]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:04 smithi122 ceph-mon[125440]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 61 B/s, 0 keys/s, 1 objects/s recovering 2023-03-02T10:56:05.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.694+0000 7f48d835b700 1 -- 172.21.15.57:0/3318223678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48d0104e70 msgr2=0x7f48d010ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:05.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.694+0000 7f48d835b700 1 --2- 172.21.15.57:0/3318223678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48d0104e70 0x7f48d010ca40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f48c800b0d0 tx=0x7f48c800b3e0 comp rx=0 tx=0).stop 2023-03-02T10:56:05.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.694+0000 7f48d835b700 1 -- 172.21.15.57:0/3318223678 shutdown_connections 2023-03-02T10:56:05.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.694+0000 7f48d835b700 1 --2- 172.21.15.57:0/3318223678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48d0104e70 0x7f48d010ca40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:05.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.694+0000 7f48d835b700 1 --2- 172.21.15.57:0/3318223678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d00ffe30 0x7f48d0100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:05.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.694+0000 7f48d835b700 1 --2- 172.21.15.57:0/3318223678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d01007d0 0x7f48d0104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:05.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.694+0000 7f48d835b700 1 -- 172.21.15.57:0/3318223678 >> 172.21.15.57:0/3318223678 conn(0x7f48d00fb6a0 msgr2=0x7f48d00fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:05.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.694+0000 7f48d835b700 1 -- 172.21.15.57:0/3318223678 shutdown_connections 2023-03-02T10:56:05.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.694+0000 7f48d835b700 1 -- 172.21.15.57:0/3318223678 wait complete. 2023-03-02T10:56:05.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.695+0000 7f48d835b700 1 Processor -- start 2023-03-02T10:56:05.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.695+0000 7f48d835b700 1 -- start start 2023-03-02T10:56:05.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.695+0000 7f48d835b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48d00ffe30 0x7f48d0195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:05.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.695+0000 7f48d835b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d01007d0 0x7f48d01962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:05.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.695+0000 7f48d835b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d0104e70 0x7f48d019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:05.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.695+0000 7f48d835b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d019ad90 con 0x7f48d00ffe30 2023-03-02T10:56:05.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.695+0000 7f48d835b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d019af00 con 0x7f48d0104e70 2023-03-02T10:56:05.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.695+0000 7f48d835b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d019b0c0 con 0x7f48d01007d0 2023-03-02T10:56:05.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d58f6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d01007d0 0x7f48d01962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:05.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d58f6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d01007d0 0x7f48d01962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:36794/0 (socket says 172.21.15.57:36794) 2023-03-02T10:56:05.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d58f6700 1 -- 172.21.15.57:0/613183061 learned_addr learned my addr 172.21.15.57:0/613183061 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:05.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d60f7700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48d00ffe30 0x7f48d0195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:05.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d68f8700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d0104e70 0x7f48d019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:05.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d58f6700 1 -- 172.21.15.57:0/613183061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d0104e70 msgr2=0x7f48d019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:05.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d58f6700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d0104e70 0x7f48d019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:05.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d58f6700 1 -- 172.21.15.57:0/613183061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48d00ffe30 msgr2=0x7f48d0195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:05.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d58f6700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48d00ffe30 0x7f48d0195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:05.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d58f6700 1 -- 172.21.15.57:0/613183061 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c8009d00 con 0x7f48d01007d0 2023-03-02T10:56:05.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d68f8700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d0104e70 0x7f48d019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:05.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.696+0000 7f48d60f7700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48d00ffe30 0x7f48d0195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:05.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.697+0000 7f48d58f6700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d01007d0 0x7f48d01962f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f48c000e940 tx=0x7f48c000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:05.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.697+0000 7f48c77fe700 1 -- 172.21.15.57:0/613183061 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0009730 con 0x7f48d01007d0 2023-03-02T10:56:05.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.697+0000 7f48d835b700 1 -- 172.21.15.57:0/613183061 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d010fc30 con 0x7f48d01007d0 2023-03-02T10:56:05.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.697+0000 7f48c77fe700 1 -- 172.21.15.57:0/613183061 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f48c0010430 con 0x7f48d01007d0 2023-03-02T10:56:05.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.697+0000 7f48d835b700 1 -- 172.21.15.57:0/613183061 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d010faa0 con 0x7f48d01007d0 2023-03-02T10:56:05.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.697+0000 7f48c77fe700 1 -- 172.21.15.57:0/613183061 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c000cea0 con 0x7f48d01007d0 2023-03-02T10:56:05.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.698+0000 7f48d835b700 1 -- 172.21.15.57:0/613183061 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d010fdc0 con 0x7f48d01007d0 2023-03-02T10:56:05.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.699+0000 7f48c77fe700 1 -- 172.21.15.57:0/613183061 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f48c000c040 con 0x7f48d01007d0 2023-03-02T10:56:05.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.700+0000 7f48c77fe700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48bc09b3e0 0x7f48bc09d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:05.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.700+0000 7f48d60f7700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48bc09b3e0 0x7f48bc09d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:05.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.700+0000 7f48c77fe700 1 -- 172.21.15.57:0/613183061 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f48c0014070 con 0x7f48d01007d0 2023-03-02T10:56:05.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.701+0000 7f48d60f7700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48bc09b3e0 0x7f48bc09d890 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f48cc005950 tx=0x7f48cc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:05.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.703+0000 7f48c77fe700 1 -- 172.21.15.57:0/613183061 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f48c0090ba0 con 0x7f48d01007d0 2023-03-02T10:56:05.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.896+0000 7f48d835b700 1 -- 172.21.15.57:0/613183061 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48d00fc740 con 0x7f48bc09b3e0 2023-03-02T10:56:05.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.906+0000 7f48c77fe700 1 -- 172.21.15.57:0/613183061 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340769 (secure 0 0 0) 0x7f48d00fc740 con 0x7f48bc09b3e0 2023-03-02T10:56:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:05.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 -- 172.21.15.57:0/613183061 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48bc09b3e0 msgr2=0x7f48bc09d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48bc09b3e0 0x7f48bc09d890 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f48cc005950 tx=0x7f48cc00b410 comp rx=0 tx=0).stop 2023-03-02T10:56:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 -- 172.21.15.57:0/613183061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d01007d0 msgr2=0x7f48d01962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d01007d0 0x7f48d01962f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f48c000e940 tx=0x7f48c000ec50 comp rx=0 tx=0).stop 2023-03-02T10:56:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 -- 172.21.15.57:0/613183061 shutdown_connections 2023-03-02T10:56:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f48bc09b3e0 0x7f48bc09d890 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d0104e70 0x7f48d019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:05.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48d00ffe30 0x7f48d0195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:05.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 --2- 172.21.15.57:0/613183061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d01007d0 0x7f48d01962f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:05.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 -- 172.21.15.57:0/613183061 >> 172.21.15.57:0/613183061 conn(0x7f48d00fb6a0 msgr2=0x7f48d00fc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:05.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 -- 172.21.15.57:0/613183061 shutdown_connections 2023-03-02T10:56:05.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:05.910+0000 7f48d835b700 1 -- 172.21.15.57:0/613183061 wait complete. 2023-03-02T10:56:05.914 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-03-02T10:56:06.418 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2023-03-02T10:56:05.271411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653705,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":595,"num_read_kb":435,"num_write":413,"num_write_kb":3065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1181469,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":79752,"kb_used_data":11496,"kb_used_omap":0,"kb_used_meta":68160,"kb_avail":1124862072,"statfs":{"total":1151940427776,"available":1151858761728,"internally_reserved":0,"allocated":11771904,"data_stored":7324698,"data_compressed":110277,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":69795840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-4,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":733,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003486"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.538895+0000","last_change":"2023-03-02T10:55:10.630366+0000","last_active":"2023-03-02T10:55:49.538895+0000","last_peered":"2023-03-02T10:55:49.538895+0000","last_clean":"2023-03-02T10:55:49.538895+0000","last_became_active":"2023-03-02T10:55:10.630035+0000","last_became_peered":"2023-03-02T10:55:10.630035+0000","last_unstale":"2023-03-02T10:55:49.538895+0000","last_undegraded":"2023-03-02T10:55:49.538895+0000","last_fullsized":"2023-03-02T10:55:49.538895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:00:41.832233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543567+0000","last_change":"2023-03-02T10:55:10.628111+0000","last_active":"2023-03-02T10:55:49.543567+0000","last_peered":"2023-03-02T10:55:49.543567+0000","last_clean":"2023-03-02T10:55:49.543567+0000","last_became_active":"2023-03-02T10:55:10.626879+0000","last_became_peered":"2023-03-02T10:55:10.626879+0000","last_unstale":"2023-03-02T10:55:49.543567+0000","last_undegraded":"2023-03-02T10:55:49.543567+0000","last_fullsized":"2023-03-02T10:55:49.543567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:08:52.120684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543597+0000","last_change":"2023-03-02T10:55:10.624392+0000","last_active":"2023-03-02T10:55:49.543597+0000","last_peered":"2023-03-02T10:55:49.543597+0000","last_clean":"2023-03-02T10:55:49.543597+0000","last_became_active":"2023-03-02T10:55:10.624095+0000","last_became_peered":"2023-03-02T10:55:10.624095+0000","last_unstale":"2023-03-02T10:55:49.543597+0000","last_undegraded":"2023-03-02T10:55:49.543597+0000","last_fullsized":"2023-03-02T10:55:49.543597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:30:55.174383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540748+0000","last_change":"2023-03-02T10:55:10.619950+0000","last_active":"2023-03-02T10:55:49.540748+0000","last_peered":"2023-03-02T10:55:49.540748+0000","last_clean":"2023-03-02T10:55:49.540748+0000","last_became_active":"2023-03-02T10:55:10.619543+0000","last_became_peered":"2023-03-02T10:55:10.619543+0000","last_unstale":"2023-03-02T10:55:49.540748+0000","last_undegraded":"2023-03-02T10:55:49.540748+0000","last_fullsized":"2023-03-02T10:55:49.540748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:08:02.321422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.536510+0000","last_change":"2023-03-02T10:55:10.626403+0000","last_active":"2023-03-02T10:55:49.536510+0000","last_peered":"2023-03-02T10:55:49.536510+0000","last_clean":"2023-03-02T10:55:49.536510+0000","last_became_active":"2023-03-02T10:55:10.626062+0000","last_became_peered":"2023-03-02T10:55:10.626062+0000","last_unstale":"2023-03-02T10:55:49.536510+0000","last_undegraded":"2023-03-02T10:55:49.536510+0000","last_fullsized":"2023-03-02T10:55:49.536510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:35:06.798468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540128+0000","last_change":"2023-03-02T10:55:10.623903+0000","last_active":"2023-03-02T10:55:49.540128+0000","last_peered":"2023-03-02T10:55:49.540128+0000","last_clean":"2023-03-02T10:55:49.540128+0000","last_became_active":"2023-03-02T10:55:10.623422+0000","last_became_peered":"2023-03-02T10:55:10.623422+0000","last_unstale":"2023-03-02T10:55:49.540128+0000","last_undegraded":"2023-03-02T10:55:49.540128+0000","last_fullsized":"2023-03-02T10:55:49.540128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:21.066552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542066+0000","last_change":"2023-03-02T10:55:10.633210+0000","last_active":"2023-03-02T10:55:49.542066+0000","last_peered":"2023-03-02T10:55:49.542066+0000","last_clean":"2023-03-02T10:55:49.542066+0000","last_became_active":"2023-03-02T10:55:10.632898+0000","last_became_peered":"2023-03-02T10:55:10.632898+0000","last_unstale":"2023-03-02T10:55:49.542066+0000","last_undegraded":"2023-03-02T10:55:49.542066+0000","last_fullsized":"2023-03-02T10:55:49.542066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:04.043328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542626+0000","last_change":"2023-03-02T10:55:10.634427+0000","last_active":"2023-03-02T10:55:49.542626+0000","last_peered":"2023-03-02T10:55:49.542626+0000","last_clean":"2023-03-02T10:55:49.542626+0000","last_became_active":"2023-03-02T10:55:10.634159+0000","last_became_peered":"2023-03-02T10:55:10.634159+0000","last_unstale":"2023-03-02T10:55:49.542626+0000","last_undegraded":"2023-03-02T10:55:49.542626+0000","last_fullsized":"2023-03-02T10:55:49.542626+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:59:09.344860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534871+0000","last_change":"2023-03-02T10:55:10.622775+0000","last_active":"2023-03-02T10:55:49.534871+0000","last_peered":"2023-03-02T10:55:49.534871+0000","last_clean":"2023-03-02T10:55:49.534871+0000","last_became_active":"2023-03-02T10:55:10.616254+0000","last_became_peered":"2023-03-02T10:55:10.616254+0000","last_unstale":"2023-03-02T10:55:49.534871+0000","last_undegraded":"2023-03-02T10:55:49.534871+0000","last_fullsized":"2023-03-02T10:55:49.534871+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:01:56.832512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540496+0000","last_change":"2023-03-02T10:55:10.620311+0000","last_active":"2023-03-02T10:55:49.540496+0000","last_peered":"2023-03-02T10:55:49.540496+0000","last_clean":"2023-03-02T10:55:49.540496+0000","last_became_active":"2023-03-02T10:55:10.620028+0000","last_became_peered":"2023-03-02T10:55:10.620028+0000","last_unstale":"2023-03-02T10:55:49.540496+0000","last_undegraded":"2023-03-02T10:55:49.540496+0000","last_fullsized":"2023-03-02T10:55:49.540496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:16:13.770927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540117+0000","last_change":"2023-03-02T10:55:10.621316+0000","last_active":"2023-03-02T10:55:49.540117+0000","last_peered":"2023-03-02T10:55:49.540117+0000","last_clean":"2023-03-02T10:55:49.540117+0000","last_became_active":"2023-03-02T10:55:10.620803+0000","last_became_peered":"2023-03-02T10:55:10.620803+0000","last_unstale":"2023-03-02T10:55:49.540117+0000","last_undegraded":"2023-03-02T10:55:49.540117+0000","last_fullsized":"2023-03-02T10:55:49.540117+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:20:18.434138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540657+0000","last_change":"2023-03-02T10:55:10.625305+0000","last_active":"2023-03-02T10:55:49.540657+0000","last_peered":"2023-03-02T10:55:49.540657+0000","last_clean":"2023-03-02T10:55:49.540657+0000","last_became_active":"2023-03-02T10:55:10.625025+0000","last_became_peered":"2023-03-02T10:55:10.625025+0000","last_unstale":"2023-03-02T10:55:49.540657+0000","last_undegraded":"2023-03-02T10:55:49.540657+0000","last_fullsized":"2023-03-02T10:55:49.540657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:35:40.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539838+0000","last_change":"2023-03-02T10:55:10.626408+0000","last_active":"2023-03-02T10:55:49.539838+0000","last_peered":"2023-03-02T10:55:49.539838+0000","last_clean":"2023-03-02T10:55:49.539838+0000","last_became_active":"2023-03-02T10:55:10.625510+0000","last_became_peered":"2023-03-02T10:55:10.625510+0000","last_unstale":"2023-03-02T10:55:49.539838+0000","last_undegraded":"2023-03-02T10:55:49.539838+0000","last_fullsized":"2023-03-02T10:55:49.539838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:59:10.622871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543469+0000","last_change":"2023-03-02T10:55:10.629323+0000","last_active":"2023-03-02T10:55:49.543469+0000","last_peered":"2023-03-02T10:55:49.543469+0000","last_clean":"2023-03-02T10:55:49.543469+0000","last_became_active":"2023-03-02T10:55:10.627038+0000","last_became_peered":"2023-03-02T10:55:10.627038+0000","last_unstale":"2023-03-02T10:55:49.543469+0000","last_undegraded":"2023-03-02T10:55:49.543469+0000","last_fullsized":"2023-03-02T10:55:49.543469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:57:21.241810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543343+0000","last_change":"2023-03-02T10:55:10.624312+0000","last_active":"2023-03-02T10:55:49.543343+0000","last_peered":"2023-03-02T10:55:49.543343+0000","last_clean":"2023-03-02T10:55:49.543343+0000","last_became_active":"2023-03-02T10:55:10.623997+0000","last_became_peered":"2023-03-02T10:55:10.623997+0000","last_unstale":"2023-03-02T10:55:49.543343+0000","last_undegraded":"2023-03-02T10:55:49.543343+0000","last_fullsized":"2023-03-02T10:55:49.543343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:09:43.683852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534296+0000","last_change":"2023-03-02T10:55:10.622473+0000","last_active":"2023-03-02T10:55:49.534296+0000","last_peered":"2023-03-02T10:55:49.534296+0000","last_clean":"2023-03-02T10:55:49.534296+0000","last_became_active":"2023-03-02T10:55:10.622148+0000","last_became_peered":"2023-03-02T10:55:10.622148+0000","last_unstale":"2023-03-02T10:55:49.534296+0000","last_undegraded":"2023-03-02T10:55:49.534296+0000","last_fullsized":"2023-03-02T10:55:49.534296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:54:52.132792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539795+0000","last_change":"2023-03-02T10:55:10.630380+0000","last_active":"2023-03-02T10:55:49.539795+0000","last_peered":"2023-03-02T10:55:49.539795+0000","last_clean":"2023-03-02T10:55:49.539795+0000","last_became_active":"2023-03-02T10:55:10.630088+0000","last_became_peered":"2023-03-02T10:55:10.630088+0000","last_unstale":"2023-03-02T10:55:49.539795+0000","last_undegraded":"2023-03-02T10:55:49.539795+0000","last_fullsized":"2023-03-02T10:55:49.539795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:08:58.983902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533147+0000","last_change":"2023-03-02T10:55:10.620547+0000","last_active":"2023-03-02T10:55:49.533147+0000","last_peered":"2023-03-02T10:55:49.533147+0000","last_clean":"2023-03-02T10:55:49.533147+0000","last_became_active":"2023-03-02T10:55:10.620225+0000","last_became_peered":"2023-03-02T10:55:10.620225+0000","last_unstale":"2023-03-02T10:55:49.533147+0000","last_undegraded":"2023-03-02T10:55:49.533147+0000","last_fullsized":"2023-03-02T10:55:49.533147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:47:38.669432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534655+0000","last_change":"2023-03-02T10:55:10.625108+0000","last_active":"2023-03-02T10:55:49.534655+0000","last_peered":"2023-03-02T10:55:49.534655+0000","last_clean":"2023-03-02T10:55:49.534655+0000","last_became_active":"2023-03-02T10:55:10.624797+0000","last_became_peered":"2023-03-02T10:55:10.624797+0000","last_unstale":"2023-03-02T10:55:49.534655+0000","last_undegraded":"2023-03-02T10:55:49.534655+0000","last_fullsized":"2023-03-02T10:55:49.534655+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:06:57.777889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":71,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:59.563101+0000","last_change":"2023-03-02T10:55:10.146541+0000","last_active":"2023-03-02T10:55:59.563101+0000","last_peered":"2023-03-02T10:55:59.563101+0000","last_clean":"2023-03-02T10:55:59.563101+0000","last_became_active":"2023-03-02T10:55:10.146239+0000","last_became_peered":"2023-03-02T10:55:10.146239+0000","last_unstale":"2023-03-02T10:55:59.563101+0000","last_undegraded":"2023-03-02T10:55:59.563101+0000","last_fullsized":"2023-03-02T10:55:59.563101+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:56:07.036002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542885+0000","last_change":"2023-03-02T10:55:10.619811+0000","last_active":"2023-03-02T10:55:49.542885+0000","last_peered":"2023-03-02T10:55:49.542885+0000","last_clean":"2023-03-02T10:55:49.542885+0000","last_became_active":"2023-03-02T10:55:10.617190+0000","last_became_peered":"2023-03-02T10:55:10.617190+0000","last_unstale":"2023-03-02T10:55:49.542885+0000","last_undegraded":"2023-03-02T10:55:49.542885+0000","last_fullsized":"2023-03-02T10:55:49.542885+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:20:52.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542992+0000","last_change":"2023-03-02T10:55:10.155970+0000","last_active":"2023-03-02T10:55:49.542992+0000","last_peered":"2023-03-02T10:55:49.542992+0000","last_clean":"2023-03-02T10:55:49.542992+0000","last_became_active":"2023-03-02T10:55:10.155667+0000","last_became_peered":"2023-03-02T10:55:10.155667+0000","last_unstale":"2023-03-02T10:55:49.542992+0000","last_undegraded":"2023-03-02T10:55:49.542992+0000","last_fullsized":"2023-03-02T10:55:49.542992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:46:36.366891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543760+0000","last_change":"2023-03-02T10:55:10.623738+0000","last_active":"2023-03-02T10:55:49.543760+0000","last_peered":"2023-03-02T10:55:49.543760+0000","last_clean":"2023-03-02T10:55:49.543760+0000","last_became_active":"2023-03-02T10:55:10.620543+0000","last_became_peered":"2023-03-02T10:55:10.620543+0000","last_unstale":"2023-03-02T10:55:49.543760+0000","last_undegraded":"2023-03-02T10:55:49.543760+0000","last_fullsized":"2023-03-02T10:55:49.543760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:44:46.238712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.148470+0000","last_change":"2023-03-02T10:55:51.148470+0000","last_active":"2023-03-02T10:55:51.148470+0000","last_peered":"2023-03-02T10:55:51.148470+0000","last_clean":"2023-03-02T10:55:51.148470+0000","last_became_active":"2023-03-02T10:55:50.544811+0000","last_became_peered":"2023-03-02T10:55:50.544811+0000","last_unstale":"2023-03-02T10:55:51.148470+0000","last_undegraded":"2023-03-02T10:55:51.148470+0000","last_fullsized":"2023-03-02T10:55:51.148470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:32:12.108148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534458+0000","last_change":"2023-03-02T10:55:10.627844+0000","last_active":"2023-03-02T10:55:49.534458+0000","last_peered":"2023-03-02T10:55:49.534458+0000","last_clean":"2023-03-02T10:55:49.534458+0000","last_became_active":"2023-03-02T10:55:10.626972+0000","last_became_peered":"2023-03-02T10:55:10.626972+0000","last_unstale":"2023-03-02T10:55:49.534458+0000","last_undegraded":"2023-03-02T10:55:49.534458+0000","last_fullsized":"2023-03-02T10:55:49.534458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:36:58.650285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537357+0000","last_change":"2023-03-02T10:55:10.153277+0000","last_active":"2023-03-02T10:55:49.537357+0000","last_peered":"2023-03-02T10:55:49.537357+0000","last_clean":"2023-03-02T10:55:49.537357+0000","last_became_active":"2023-03-02T10:55:10.152983+0000","last_became_peered":"2023-03-02T10:55:10.152983+0000","last_unstale":"2023-03-02T10:55:49.537357+0000","last_undegraded":"2023-03-02T10:55:49.537357+0000","last_fullsized":"2023-03-02T10:55:49.537357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:15.045107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541978+0000","last_change":"2023-03-02T10:55:10.630295+0000","last_active":"2023-03-02T10:55:49.541978+0000","last_peered":"2023-03-02T10:55:49.541978+0000","last_clean":"2023-03-02T10:55:49.541978+0000","last_became_active":"2023-03-02T10:55:10.629004+0000","last_became_peered":"2023-03-02T10:55:10.629004+0000","last_unstale":"2023-03-02T10:55:49.541978+0000","last_undegraded":"2023-03-02T10:55:49.541978+0000","last_fullsized":"2023-03-02T10:55:49.541978+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:05:51.414347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":68,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:01.632846+0000","last_change":"2023-03-02T10:55:10.153222+0000","last_active":"2023-03-02T10:56:01.632846+0000","last_peered":"2023-03-02T10:56:01.632846+0000","last_clean":"2023-03-02T10:56:01.632846+0000","last_became_active":"2023-03-02T10:55:10.152928+0000","last_became_peered":"2023-03-02T10:55:10.152928+0000","last_unstale":"2023-03-02T10:56:01.632846+0000","last_undegraded":"2023-03-02T10:56:01.632846+0000","last_fullsized":"2023-03-02T10:56:01.632846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:12:56.648713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.536598+0000","last_change":"2023-03-02T10:55:10.617722+0000","last_active":"2023-03-02T10:55:49.536598+0000","last_peered":"2023-03-02T10:55:49.536598+0000","last_clean":"2023-03-02T10:55:49.536598+0000","last_became_active":"2023-03-02T10:55:10.617425+0000","last_became_peered":"2023-03-02T10:55:10.617425+0000","last_unstale":"2023-03-02T10:55:49.536598+0000","last_undegraded":"2023-03-02T10:55:49.536598+0000","last_fullsized":"2023-03-02T10:55:49.536598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:57:37.397568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:50.806747+0000","last_change":"2023-03-02T10:55:50.806747+0000","last_active":"2023-03-02T10:55:50.806747+0000","last_peered":"2023-03-02T10:55:50.806747+0000","last_clean":"2023-03-02T10:55:50.806747+0000","last_became_active":"2023-03-02T10:55:50.544008+0000","last_became_peered":"2023-03-02T10:55:50.544008+0000","last_unstale":"2023-03-02T10:55:50.806747+0000","last_undegraded":"2023-03-02T10:55:50.806747+0000","last_fullsized":"2023-03-02T10:55:50.806747+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:21:20.672207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542100+0000","last_change":"2023-03-02T10:55:10.628418+0000","last_active":"2023-03-02T10:55:49.542100+0000","last_peered":"2023-03-02T10:55:49.542100+0000","last_clean":"2023-03-02T10:55:49.542100+0000","last_became_active":"2023-03-02T10:55:10.627715+0000","last_became_peered":"2023-03-02T10:55:10.627715+0000","last_unstale":"2023-03-02T10:55:49.542100+0000","last_undegraded":"2023-03-02T10:55:49.542100+0000","last_fullsized":"2023-03-02T10:55:49.542100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:16:59.756440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539748+0000","last_change":"2023-03-02T10:55:10.158875+0000","last_active":"2023-03-02T10:55:49.539748+0000","last_peered":"2023-03-02T10:55:49.539748+0000","last_clean":"2023-03-02T10:55:49.539748+0000","last_became_active":"2023-03-02T10:55:10.157653+0000","last_became_peered":"2023-03-02T10:55:10.157653+0000","last_unstale":"2023-03-02T10:55:49.539748+0000","last_undegraded":"2023-03-02T10:55:49.539748+0000","last_fullsized":"2023-03-02T10:55:49.539748+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:50:03.808602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542552+0000","last_change":"2023-03-02T10:55:10.634280+0000","last_active":"2023-03-02T10:55:49.542552+0000","last_peered":"2023-03-02T10:55:49.542552+0000","last_clean":"2023-03-02T10:55:49.542552+0000","last_became_active":"2023-03-02T10:55:10.633764+0000","last_became_peered":"2023-03-02T10:55:10.633764+0000","last_unstale":"2023-03-02T10:55:49.542552+0000","last_undegraded":"2023-03-02T10:55:49.542552+0000","last_fullsized":"2023-03-02T10:55:49.542552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:17:25.110036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541628+0000","last_change":"2023-03-02T10:55:10.154532+0000","last_active":"2023-03-02T10:55:49.541628+0000","last_peered":"2023-03-02T10:55:49.541628+0000","last_clean":"2023-03-02T10:55:49.541628+0000","last_became_active":"2023-03-02T10:55:10.152116+0000","last_became_peered":"2023-03-02T10:55:10.152116+0000","last_unstale":"2023-03-02T10:55:49.541628+0000","last_undegraded":"2023-03-02T10:55:49.541628+0000","last_fullsized":"2023-03-02T10:55:49.541628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:19:50.439666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.532910+0000","last_change":"2023-03-02T10:55:10.628790+0000","last_active":"2023-03-02T10:55:49.532910+0000","last_peered":"2023-03-02T10:55:49.532910+0000","last_clean":"2023-03-02T10:55:49.532910+0000","last_became_active":"2023-03-02T10:55:10.628452+0000","last_became_peered":"2023-03-02T10:55:10.628452+0000","last_unstale":"2023-03-02T10:55:49.532910+0000","last_undegraded":"2023-03-02T10:55:49.532910+0000","last_fullsized":"2023-03-02T10:55:49.532910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:08:30.061925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":112,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:03.634813+0000","last_change":"2023-03-02T10:55:10.152684+0000","last_active":"2023-03-02T10:56:03.634813+0000","last_peered":"2023-03-02T10:56:03.634813+0000","last_clean":"2023-03-02T10:56:03.634813+0000","last_became_active":"2023-03-02T10:55:10.152184+0000","last_became_peered":"2023-03-02T10:55:10.152184+0000","last_unstale":"2023-03-02T10:56:03.634813+0000","last_undegraded":"2023-03-02T10:56:03.634813+0000","last_fullsized":"2023-03-02T10:56:03.634813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:39:21.100760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534868+0000","last_change":"2023-03-02T10:55:10.625990+0000","last_active":"2023-03-02T10:55:49.534868+0000","last_peered":"2023-03-02T10:55:49.534868+0000","last_clean":"2023-03-02T10:55:49.534868+0000","last_became_active":"2023-03-02T10:55:10.625677+0000","last_became_peered":"2023-03-02T10:55:10.625677+0000","last_unstale":"2023-03-02T10:55:49.534868+0000","last_undegraded":"2023-03-02T10:55:49.534868+0000","last_fullsized":"2023-03-02T10:55:49.534868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:08.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539232+0000","last_change":"2023-03-02T10:55:10.151541+0000","last_active":"2023-03-02T10:55:49.539232+0000","last_peered":"2023-03-02T10:55:49.539232+0000","last_clean":"2023-03-02T10:55:49.539232+0000","last_became_active":"2023-03-02T10:55:10.151262+0000","last_became_peered":"2023-03-02T10:55:10.151262+0000","last_unstale":"2023-03-02T10:55:49.539232+0000","last_undegraded":"2023-03-02T10:55:49.539232+0000","last_fullsized":"2023-03-02T10:55:49.539232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:00:49.821191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543757+0000","last_change":"2023-03-02T10:55:10.629541+0000","last_active":"2023-03-02T10:55:49.543757+0000","last_peered":"2023-03-02T10:55:49.543757+0000","last_clean":"2023-03-02T10:55:49.543757+0000","last_became_active":"2023-03-02T10:55:10.627473+0000","last_became_peered":"2023-03-02T10:55:10.627473+0000","last_unstale":"2023-03-02T10:55:49.543757+0000","last_undegraded":"2023-03-02T10:55:49.543757+0000","last_fullsized":"2023-03-02T10:55:49.543757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:22:52.995113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542098+0000","last_change":"2023-03-02T10:55:10.152615+0000","last_active":"2023-03-02T10:55:49.542098+0000","last_peered":"2023-03-02T10:55:49.542098+0000","last_clean":"2023-03-02T10:55:49.542098+0000","last_became_active":"2023-03-02T10:55:10.152304+0000","last_became_peered":"2023-03-02T10:55:10.152304+0000","last_unstale":"2023-03-02T10:55:49.542098+0000","last_undegraded":"2023-03-02T10:55:49.542098+0000","last_fullsized":"2023-03-02T10:55:49.542098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:43:00.934520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534648+0000","last_change":"2023-03-02T10:55:10.627653+0000","last_active":"2023-03-02T10:55:49.534648+0000","last_peered":"2023-03-02T10:55:49.534648+0000","last_clean":"2023-03-02T10:55:49.534648+0000","last_became_active":"2023-03-02T10:55:10.626570+0000","last_became_peered":"2023-03-02T10:55:10.626570+0000","last_unstale":"2023-03-02T10:55:49.534648+0000","last_undegraded":"2023-03-02T10:55:49.534648+0000","last_fullsized":"2023-03-02T10:55:49.534648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:40:39.311514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'29","reported_seq":143,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:03.634697+0000","last_change":"2023-03-02T10:55:10.149121+0000","last_active":"2023-03-02T10:56:03.634697+0000","last_peered":"2023-03-02T10:56:03.634697+0000","last_clean":"2023-03-02T10:56:03.634697+0000","last_became_active":"2023-03-02T10:55:10.148800+0000","last_became_peered":"2023-03-02T10:55:10.148800+0000","last_unstale":"2023-03-02T10:56:03.634697+0000","last_undegraded":"2023-03-02T10:56:03.634697+0000","last_fullsized":"2023-03-02T10:56:03.634697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:32:30.918248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55969,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":100,"num_read_kb":104,"num_write":31,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537512+0000","last_change":"2023-03-02T10:55:10.625497+0000","last_active":"2023-03-02T10:55:49.537512+0000","last_peered":"2023-03-02T10:55:49.537512+0000","last_clean":"2023-03-02T10:55:49.537512+0000","last_became_active":"2023-03-02T10:55:10.625037+0000","last_became_peered":"2023-03-02T10:55:10.625037+0000","last_unstale":"2023-03-02T10:55:49.537512+0000","last_undegraded":"2023-03-02T10:55:49.537512+0000","last_fullsized":"2023-03-02T10:55:49.537512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:55:56.478111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534121+0000","last_change":"2023-03-02T10:55:10.148957+0000","last_active":"2023-03-02T10:55:49.534121+0000","last_peered":"2023-03-02T10:55:49.534121+0000","last_clean":"2023-03-02T10:55:49.534121+0000","last_became_active":"2023-03-02T10:55:10.148624+0000","last_became_peered":"2023-03-02T10:55:10.148624+0000","last_unstale":"2023-03-02T10:55:49.534121+0000","last_undegraded":"2023-03-02T10:55:49.534121+0000","last_fullsized":"2023-03-02T10:55:49.534121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:53:33.062648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540391+0000","last_change":"2023-03-02T10:55:10.633311+0000","last_active":"2023-03-02T10:55:49.540391+0000","last_peered":"2023-03-02T10:55:49.540391+0000","last_clean":"2023-03-02T10:55:49.540391+0000","last_became_active":"2023-03-02T10:55:10.632174+0000","last_became_peered":"2023-03-02T10:55:10.632174+0000","last_unstale":"2023-03-02T10:55:49.540391+0000","last_undegraded":"2023-03-02T10:55:49.540391+0000","last_fullsized":"2023-03-02T10:55:49.540391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:50:47.536118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542053+0000","last_change":"2023-03-02T10:55:10.153392+0000","last_active":"2023-03-02T10:55:49.542053+0000","last_peered":"2023-03-02T10:55:49.542053+0000","last_clean":"2023-03-02T10:55:49.542053+0000","last_became_active":"2023-03-02T10:55:10.152513+0000","last_became_peered":"2023-03-02T10:55:10.152513+0000","last_unstale":"2023-03-02T10:55:49.542053+0000","last_undegraded":"2023-03-02T10:55:49.542053+0000","last_fullsized":"2023-03-02T10:55:49.542053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:26:40.675118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540160+0000","last_change":"2023-03-02T10:55:10.631953+0000","last_active":"2023-03-02T10:55:49.540160+0000","last_peered":"2023-03-02T10:55:49.540160+0000","last_clean":"2023-03-02T10:55:49.540160+0000","last_became_active":"2023-03-02T10:55:10.631624+0000","last_became_peered":"2023-03-02T10:55:10.631624+0000","last_unstale":"2023-03-02T10:55:49.540160+0000","last_undegraded":"2023-03-02T10:55:49.540160+0000","last_fullsized":"2023-03-02T10:55:49.540160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:15:20.136421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":68,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:01.637287+0000","last_change":"2023-03-02T10:55:10.150597+0000","last_active":"2023-03-02T10:56:01.637287+0000","last_peered":"2023-03-02T10:56:01.637287+0000","last_clean":"2023-03-02T10:56:01.637287+0000","last_became_active":"2023-03-02T10:55:10.150024+0000","last_became_peered":"2023-03-02T10:55:10.150024+0000","last_unstale":"2023-03-02T10:56:01.637287+0000","last_undegraded":"2023-03-02T10:56:01.637287+0000","last_fullsized":"2023-03-02T10:56:01.637287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:30.043240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539596+0000","last_change":"2023-03-02T10:55:10.633052+0000","last_active":"2023-03-02T10:55:49.539596+0000","last_peered":"2023-03-02T10:55:49.539596+0000","last_clean":"2023-03-02T10:55:49.539596+0000","last_became_active":"2023-03-02T10:55:10.632766+0000","last_became_peered":"2023-03-02T10:55:10.632766+0000","last_unstale":"2023-03-02T10:55:49.539596+0000","last_undegraded":"2023-03-02T10:55:49.539596+0000","last_fullsized":"2023-03-02T10:55:49.539596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:55.079556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.536268+0000","last_change":"2023-03-02T10:55:10.154559+0000","last_active":"2023-03-02T10:55:49.536268+0000","last_peered":"2023-03-02T10:55:49.536268+0000","last_clean":"2023-03-02T10:55:49.536268+0000","last_became_active":"2023-03-02T10:55:10.154058+0000","last_became_peered":"2023-03-02T10:55:10.154058+0000","last_unstale":"2023-03-02T10:55:49.536268+0000","last_undegraded":"2023-03-02T10:55:49.536268+0000","last_fullsized":"2023-03-02T10:55:49.536268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:23:26.823020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541697+0000","last_change":"2023-03-02T10:55:10.622951+0000","last_active":"2023-03-02T10:55:49.541697+0000","last_peered":"2023-03-02T10:55:49.541697+0000","last_clean":"2023-03-02T10:55:49.541697+0000","last_became_active":"2023-03-02T10:55:10.622643+0000","last_became_peered":"2023-03-02T10:55:10.622643+0000","last_unstale":"2023-03-02T10:55:49.541697+0000","last_undegraded":"2023-03-02T10:55:49.541697+0000","last_fullsized":"2023-03-02T10:55:49.541697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:53:05.459021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:50.547995+0000","last_change":"2023-03-02T10:55:50.547995+0000","last_active":"2023-03-02T10:55:50.547995+0000","last_peered":"2023-03-02T10:55:50.547995+0000","last_clean":"2023-03-02T10:55:50.547995+0000","last_became_active":"2023-03-02T10:55:50.541460+0000","last_became_peered":"2023-03-02T10:55:50.541460+0000","last_unstale":"2023-03-02T10:55:50.547995+0000","last_undegraded":"2023-03-02T10:55:50.547995+0000","last_fullsized":"2023-03-02T10:55:50.547995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:02:50.853731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.538722+0000","last_change":"2023-03-02T10:55:10.633149+0000","last_active":"2023-03-02T10:55:49.538722+0000","last_peered":"2023-03-02T10:55:49.538722+0000","last_clean":"2023-03-02T10:55:49.538722+0000","last_became_active":"2023-03-02T10:55:10.632816+0000","last_became_peered":"2023-03-02T10:55:10.632816+0000","last_unstale":"2023-03-02T10:55:49.538722+0000","last_undegraded":"2023-03-02T10:55:49.538722+0000","last_fullsized":"2023-03-02T10:55:49.538722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:25:41.585257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533012+0000","last_change":"2023-03-02T10:55:10.150486+0000","last_active":"2023-03-02T10:55:49.533012+0000","last_peered":"2023-03-02T10:55:49.533012+0000","last_clean":"2023-03-02T10:55:49.533012+0000","last_became_active":"2023-03-02T10:55:10.150186+0000","last_became_peered":"2023-03-02T10:55:10.150186+0000","last_unstale":"2023-03-02T10:55:49.533012+0000","last_undegraded":"2023-03-02T10:55:49.533012+0000","last_fullsized":"2023-03-02T10:55:49.533012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:06:18.637162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540413+0000","last_change":"2023-03-02T10:55:10.628622+0000","last_active":"2023-03-02T10:55:49.540413+0000","last_peered":"2023-03-02T10:55:49.540413+0000","last_clean":"2023-03-02T10:55:49.540413+0000","last_became_active":"2023-03-02T10:55:10.628258+0000","last_became_peered":"2023-03-02T10:55:10.628258+0000","last_unstale":"2023-03-02T10:55:49.540413+0000","last_undegraded":"2023-03-02T10:55:49.540413+0000","last_fullsized":"2023-03-02T10:55:49.540413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:46.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:58.562028+0000","last_change":"2023-03-02T10:55:51.151512+0000","last_active":"2023-03-02T10:55:58.562028+0000","last_peered":"2023-03-02T10:55:58.562028+0000","last_clean":"2023-03-02T10:55:58.562028+0000","last_became_active":"2023-03-02T10:55:50.544349+0000","last_became_peered":"2023-03-02T10:55:50.544349+0000","last_unstale":"2023-03-02T10:55:58.562028+0000","last_undegraded":"2023-03-02T10:55:58.562028+0000","last_fullsized":"2023-03-02T10:55:58.562028+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:13.679666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.092083+0000","last_change":"2023-03-02T10:55:51.092083+0000","last_active":"2023-03-02T10:55:51.092083+0000","last_peered":"2023-03-02T10:55:51.092083+0000","last_clean":"2023-03-02T10:55:51.092083+0000","last_became_active":"2023-03-02T10:55:51.091536+0000","last_became_peered":"2023-03-02T10:55:51.091536+0000","last_unstale":"2023-03-02T10:55:51.092083+0000","last_undegraded":"2023-03-02T10:55:51.092083+0000","last_fullsized":"2023-03-02T10:55:51.092083+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:18:38.983021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541745+0000","last_change":"2023-03-02T10:55:10.613814+0000","last_active":"2023-03-02T10:55:49.541745+0000","last_peered":"2023-03-02T10:55:49.541745+0000","last_clean":"2023-03-02T10:55:49.541745+0000","last_became_active":"2023-03-02T10:55:10.613496+0000","last_became_peered":"2023-03-02T10:55:10.613496+0000","last_unstale":"2023-03-02T10:55:49.541745+0000","last_undegraded":"2023-03-02T10:55:49.541745+0000","last_fullsized":"2023-03-02T10:55:49.541745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:55:58.332549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":67,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:02.637947+0000","last_change":"2023-03-02T10:55:10.160751+0000","last_active":"2023-03-02T10:56:02.637947+0000","last_peered":"2023-03-02T10:56:02.637947+0000","last_clean":"2023-03-02T10:56:02.637947+0000","last_became_active":"2023-03-02T10:55:10.160433+0000","last_became_peered":"2023-03-02T10:55:10.160433+0000","last_unstale":"2023-03-02T10:56:02.637947+0000","last_undegraded":"2023-03-02T10:56:02.637947+0000","last_fullsized":"2023-03-02T10:56:02.637947+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:11:23.326464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542780+0000","last_change":"2023-03-02T10:55:10.619761+0000","last_active":"2023-03-02T10:55:49.542780+0000","last_peered":"2023-03-02T10:55:49.542780+0000","last_clean":"2023-03-02T10:55:49.542780+0000","last_became_active":"2023-03-02T10:55:10.617361+0000","last_became_peered":"2023-03-02T10:55:10.617361+0000","last_unstale":"2023-03-02T10:55:49.542780+0000","last_undegraded":"2023-03-02T10:55:49.542780+0000","last_fullsized":"2023-03-02T10:55:49.542780+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:26:55.492653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540413+0000","last_change":"2023-03-02T10:55:10.151553+0000","last_active":"2023-03-02T10:55:49.540413+0000","last_peered":"2023-03-02T10:55:49.540413+0000","last_clean":"2023-03-02T10:55:49.540413+0000","last_became_active":"2023-03-02T10:55:10.151369+0000","last_became_peered":"2023-03-02T10:55:10.151369+0000","last_unstale":"2023-03-02T10:55:49.540413+0000","last_undegraded":"2023-03-02T10:55:49.540413+0000","last_fullsized":"2023-03-02T10:55:49.540413+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:30:42.550362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":374,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539716+0000","last_change":"2023-03-02T10:54:06.270813+0000","last_active":"2023-03-02T10:55:49.539716+0000","last_peered":"2023-03-02T10:55:49.539716+0000","last_clean":"2023-03-02T10:55:49.539716+0000","last_became_active":"2023-03-02T10:54:06.270329+0000","last_became_peered":"2023-03-02T10:54:06.270329+0000","last_unstale":"2023-03-02T10:55:49.539716+0000","last_undegraded":"2023-03-02T10:55:49.539716+0000","last_fullsized":"2023-03-02T10:55:49.539716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_clean_scrub_stamp":"2023-03-02T10:51:04.207601+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:07.546806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539630+0000","last_change":"2023-03-02T10:55:10.629032+0000","last_active":"2023-03-02T10:55:49.539630+0000","last_peered":"2023-03-02T10:55:49.539630+0000","last_clean":"2023-03-02T10:55:49.539630+0000","last_became_active":"2023-03-02T10:55:10.628696+0000","last_became_peered":"2023-03-02T10:55:10.628696+0000","last_unstale":"2023-03-02T10:55:49.539630+0000","last_undegraded":"2023-03-02T10:55:49.539630+0000","last_fullsized":"2023-03-02T10:55:49.539630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:32:58.399900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539930+0000","last_change":"2023-03-02T10:55:10.153240+0000","last_active":"2023-03-02T10:55:49.539930+0000","last_peered":"2023-03-02T10:55:49.539930+0000","last_clean":"2023-03-02T10:55:49.539930+0000","last_became_active":"2023-03-02T10:55:10.152977+0000","last_became_peered":"2023-03-02T10:55:10.152977+0000","last_unstale":"2023-03-02T10:55:49.539930+0000","last_undegraded":"2023-03-02T10:55:49.539930+0000","last_fullsized":"2023-03-02T10:55:49.539930+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:46:49.873113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537639+0000","last_change":"2023-03-02T10:55:10.154392+0000","last_active":"2023-03-02T10:55:49.537639+0000","last_peered":"2023-03-02T10:55:49.537639+0000","last_clean":"2023-03-02T10:55:49.537639+0000","last_became_active":"2023-03-02T10:55:10.154110+0000","last_became_peered":"2023-03-02T10:55:10.154110+0000","last_unstale":"2023-03-02T10:55:49.537639+0000","last_undegraded":"2023-03-02T10:55:49.537639+0000","last_fullsized":"2023-03-02T10:55:49.537639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:11:05.910487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539801+0000","last_change":"2023-03-02T10:55:10.627181+0000","last_active":"2023-03-02T10:55:49.539801+0000","last_peered":"2023-03-02T10:55:49.539801+0000","last_clean":"2023-03-02T10:55:49.539801+0000","last_became_active":"2023-03-02T10:55:10.626891+0000","last_became_peered":"2023-03-02T10:55:10.626891+0000","last_unstale":"2023-03-02T10:55:49.539801+0000","last_undegraded":"2023-03-02T10:55:49.539801+0000","last_fullsized":"2023-03-02T10:55:49.539801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:37.990553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533056+0000","last_change":"2023-03-02T10:55:10.146146+0000","last_active":"2023-03-02T10:55:49.533056+0000","last_peered":"2023-03-02T10:55:49.533056+0000","last_clean":"2023-03-02T10:55:49.533056+0000","last_became_active":"2023-03-02T10:55:10.145824+0000","last_became_peered":"2023-03-02T10:55:10.145824+0000","last_unstale":"2023-03-02T10:55:49.533056+0000","last_undegraded":"2023-03-02T10:55:49.533056+0000","last_fullsized":"2023-03-02T10:55:49.533056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:05:35.846016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543066+0000","last_change":"2023-03-02T10:55:10.636566+0000","last_active":"2023-03-02T10:55:49.543066+0000","last_peered":"2023-03-02T10:55:49.543066+0000","last_clean":"2023-03-02T10:55:49.543066+0000","last_became_active":"2023-03-02T10:55:10.636033+0000","last_became_peered":"2023-03-02T10:55:10.636033+0000","last_unstale":"2023-03-02T10:55:49.543066+0000","last_undegraded":"2023-03-02T10:55:49.543066+0000","last_fullsized":"2023-03-02T10:55:49.543066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:35:24.955628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540621+0000","last_change":"2023-03-02T10:55:10.156550+0000","last_active":"2023-03-02T10:55:49.540621+0000","last_peered":"2023-03-02T10:55:49.540621+0000","last_clean":"2023-03-02T10:55:49.540621+0000","last_became_active":"2023-03-02T10:55:10.156286+0000","last_became_peered":"2023-03-02T10:55:10.156286+0000","last_unstale":"2023-03-02T10:55:49.540621+0000","last_undegraded":"2023-03-02T10:55:49.540621+0000","last_fullsized":"2023-03-02T10:55:49.540621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:45:51.476117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543564+0000","last_change":"2023-03-02T10:55:10.631769+0000","last_active":"2023-03-02T10:55:49.543564+0000","last_peered":"2023-03-02T10:55:49.543564+0000","last_clean":"2023-03-02T10:55:49.543564+0000","last_became_active":"2023-03-02T10:55:10.631429+0000","last_became_peered":"2023-03-02T10:55:10.631429+0000","last_unstale":"2023-03-02T10:55:49.543564+0000","last_undegraded":"2023-03-02T10:55:49.543564+0000","last_fullsized":"2023-03-02T10:55:49.543564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:42:52.764994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534314+0000","last_change":"2023-03-02T10:55:10.152435+0000","last_active":"2023-03-02T10:55:49.534314+0000","last_peered":"2023-03-02T10:55:49.534314+0000","last_clean":"2023-03-02T10:55:49.534314+0000","last_became_active":"2023-03-02T10:55:10.152008+0000","last_became_peered":"2023-03-02T10:55:10.152008+0000","last_unstale":"2023-03-02T10:55:49.534314+0000","last_undegraded":"2023-03-02T10:55:49.534314+0000","last_fullsized":"2023-03-02T10:55:49.534314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:46:39.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.536281+0000","last_change":"2023-03-02T10:55:10.624337+0000","last_active":"2023-03-02T10:55:49.536281+0000","last_peered":"2023-03-02T10:55:49.536281+0000","last_clean":"2023-03-02T10:55:49.536281+0000","last_became_active":"2023-03-02T10:55:10.623979+0000","last_became_peered":"2023-03-02T10:55:10.623979+0000","last_unstale":"2023-03-02T10:55:49.536281+0000","last_undegraded":"2023-03-02T10:55:49.536281+0000","last_fullsized":"2023-03-02T10:55:49.536281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:14:39.173460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542638+0000","last_change":"2023-03-02T10:55:10.152406+0000","last_active":"2023-03-02T10:55:49.542638+0000","last_peered":"2023-03-02T10:55:49.542638+0000","last_clean":"2023-03-02T10:55:49.542638+0000","last_became_active":"2023-03-02T10:55:10.152026+0000","last_became_peered":"2023-03-02T10:55:10.152026+0000","last_unstale":"2023-03-02T10:55:49.542638+0000","last_undegraded":"2023-03-02T10:55:49.542638+0000","last_fullsized":"2023-03-02T10:55:49.542638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:49:17.617792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537877+0000","last_change":"2023-03-02T10:55:10.620061+0000","last_active":"2023-03-02T10:55:49.537877+0000","last_peered":"2023-03-02T10:55:49.537877+0000","last_clean":"2023-03-02T10:55:49.537877+0000","last_became_active":"2023-03-02T10:55:10.619753+0000","last_became_peered":"2023-03-02T10:55:10.619753+0000","last_unstale":"2023-03-02T10:55:49.537877+0000","last_undegraded":"2023-03-02T10:55:49.537877+0000","last_fullsized":"2023-03-02T10:55:49.537877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:40:02.479733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534006+0000","last_change":"2023-03-02T10:55:10.149827+0000","last_active":"2023-03-02T10:55:49.534006+0000","last_peered":"2023-03-02T10:55:49.534006+0000","last_clean":"2023-03-02T10:55:49.534006+0000","last_became_active":"2023-03-02T10:55:10.149522+0000","last_became_peered":"2023-03-02T10:55:10.149522+0000","last_unstale":"2023-03-02T10:55:49.534006+0000","last_undegraded":"2023-03-02T10:55:49.534006+0000","last_fullsized":"2023-03-02T10:55:49.534006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:23:27.072235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542687+0000","last_change":"2023-03-02T10:55:10.618992+0000","last_active":"2023-03-02T10:55:49.542687+0000","last_peered":"2023-03-02T10:55:49.542687+0000","last_clean":"2023-03-02T10:55:49.542687+0000","last_became_active":"2023-03-02T10:55:10.618678+0000","last_became_peered":"2023-03-02T10:55:10.618678+0000","last_unstale":"2023-03-02T10:55:49.542687+0000","last_undegraded":"2023-03-02T10:55:49.542687+0000","last_fullsized":"2023-03-02T10:55:49.542687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:33:26.966579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.321810+0000","last_change":"2023-03-02T10:55:51.321810+0000","last_active":"2023-03-02T10:55:51.321810+0000","last_peered":"2023-03-02T10:55:51.321810+0000","last_clean":"2023-03-02T10:55:51.321810+0000","last_became_active":"2023-03-02T10:55:50.544110+0000","last_became_peered":"2023-03-02T10:55:50.544110+0000","last_unstale":"2023-03-02T10:55:51.321810+0000","last_undegraded":"2023-03-02T10:55:51.321810+0000","last_fullsized":"2023-03-02T10:55:51.321810+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:59:33.358979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539914+0000","last_change":"2023-03-02T10:55:10.625524+0000","last_active":"2023-03-02T10:55:49.539914+0000","last_peered":"2023-03-02T10:55:49.539914+0000","last_clean":"2023-03-02T10:55:49.539914+0000","last_became_active":"2023-03-02T10:55:10.625249+0000","last_became_peered":"2023-03-02T10:55:10.625249+0000","last_unstale":"2023-03-02T10:55:49.539914+0000","last_undegraded":"2023-03-02T10:55:49.539914+0000","last_fullsized":"2023-03-02T10:55:49.539914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:03:16.230549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":66,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:00.667724+0000","last_change":"2023-03-02T10:55:10.159691+0000","last_active":"2023-03-02T10:56:00.667724+0000","last_peered":"2023-03-02T10:56:00.667724+0000","last_clean":"2023-03-02T10:56:00.667724+0000","last_became_active":"2023-03-02T10:55:10.159360+0000","last_became_peered":"2023-03-02T10:55:10.159360+0000","last_unstale":"2023-03-02T10:56:00.667724+0000","last_undegraded":"2023-03-02T10:56:00.667724+0000","last_fullsized":"2023-03-02T10:56:00.667724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:21:05.305932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":47,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540203+0000","last_change":"2023-03-02T10:55:10.621119+0000","last_active":"2023-03-02T10:55:49.540203+0000","last_peered":"2023-03-02T10:55:49.540203+0000","last_clean":"2023-03-02T10:55:49.540203+0000","last_became_active":"2023-03-02T10:55:10.620370+0000","last_became_peered":"2023-03-02T10:55:10.620370+0000","last_unstale":"2023-03-02T10:55:49.540203+0000","last_undegraded":"2023-03-02T10:55:49.540203+0000","last_fullsized":"2023-03-02T10:55:49.540203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:33:20.678615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541953+0000","last_change":"2023-03-02T10:55:10.155403+0000","last_active":"2023-03-02T10:55:49.541953+0000","last_peered":"2023-03-02T10:55:49.541953+0000","last_clean":"2023-03-02T10:55:49.541953+0000","last_became_active":"2023-03-02T10:55:10.152547+0000","last_became_peered":"2023-03-02T10:55:10.152547+0000","last_unstale":"2023-03-02T10:55:49.541953+0000","last_undegraded":"2023-03-02T10:55:49.541953+0000","last_fullsized":"2023-03-02T10:55:49.541953+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:18:30.564037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.094932+0000","last_change":"2023-03-02T10:55:51.094932+0000","last_active":"2023-03-02T10:55:51.094932+0000","last_peered":"2023-03-02T10:55:51.094932+0000","last_clean":"2023-03-02T10:55:51.094932+0000","last_became_active":"2023-03-02T10:55:51.091808+0000","last_became_peered":"2023-03-02T10:55:51.091808+0000","last_unstale":"2023-03-02T10:55:51.094932+0000","last_undegraded":"2023-03-02T10:55:51.094932+0000","last_fullsized":"2023-03-02T10:55:51.094932+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:26:42.737673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539999+0000","last_change":"2023-03-02T10:55:10.159307+0000","last_active":"2023-03-02T10:55:49.539999+0000","last_peered":"2023-03-02T10:55:49.539999+0000","last_clean":"2023-03-02T10:55:49.539999+0000","last_became_active":"2023-03-02T10:55:10.158979+0000","last_became_peered":"2023-03-02T10:55:10.158979+0000","last_unstale":"2023-03-02T10:55:49.539999+0000","last_undegraded":"2023-03-02T10:55:49.539999+0000","last_fullsized":"2023-03-02T10:55:49.539999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:13:54.984801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539959+0000","last_change":"2023-03-02T10:55:10.630995+0000","last_active":"2023-03-02T10:55:49.539959+0000","last_peered":"2023-03-02T10:55:49.539959+0000","last_clean":"2023-03-02T10:55:49.539959+0000","last_became_active":"2023-03-02T10:55:10.630654+0000","last_became_peered":"2023-03-02T10:55:10.630654+0000","last_unstale":"2023-03-02T10:55:49.539959+0000","last_undegraded":"2023-03-02T10:55:49.539959+0000","last_fullsized":"2023-03-02T10:55:49.539959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:25:50.945152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537849+0000","last_change":"2023-03-02T10:55:10.633263+0000","last_active":"2023-03-02T10:55:49.537849+0000","last_peered":"2023-03-02T10:55:49.537849+0000","last_clean":"2023-03-02T10:55:49.537849+0000","last_became_active":"2023-03-02T10:55:10.632796+0000","last_became_peered":"2023-03-02T10:55:10.632796+0000","last_unstale":"2023-03-02T10:55:49.537849+0000","last_undegraded":"2023-03-02T10:55:49.537849+0000","last_fullsized":"2023-03-02T10:55:49.537849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:04:02.060792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533967+0000","last_change":"2023-03-02T10:55:10.620195+0000","last_active":"2023-03-02T10:55:49.533967+0000","last_peered":"2023-03-02T10:55:49.533967+0000","last_clean":"2023-03-02T10:55:49.533967+0000","last_became_active":"2023-03-02T10:55:10.619904+0000","last_became_peered":"2023-03-02T10:55:10.619904+0000","last_unstale":"2023-03-02T10:55:49.533967+0000","last_undegraded":"2023-03-02T10:55:49.533967+0000","last_fullsized":"2023-03-02T10:55:49.533967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:03:43.176587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533939+0000","last_change":"2023-03-02T10:55:10.619427+0000","last_active":"2023-03-02T10:55:49.533939+0000","last_peered":"2023-03-02T10:55:49.533939+0000","last_clean":"2023-03-02T10:55:49.533939+0000","last_became_active":"2023-03-02T10:55:10.618184+0000","last_became_peered":"2023-03-02T10:55:10.618184+0000","last_unstale":"2023-03-02T10:55:49.533939+0000","last_undegraded":"2023-03-02T10:55:49.533939+0000","last_fullsized":"2023-03-02T10:55:49.533939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:00.907091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.543814+0000","last_change":"2023-03-02T10:55:10.630058+0000","last_active":"2023-03-02T10:55:49.543814+0000","last_peered":"2023-03-02T10:55:49.543814+0000","last_clean":"2023-03-02T10:55:49.543814+0000","last_became_active":"2023-03-02T10:55:10.626022+0000","last_became_peered":"2023-03-02T10:55:10.626022+0000","last_unstale":"2023-03-02T10:55:49.543814+0000","last_undegraded":"2023-03-02T10:55:49.543814+0000","last_fullsized":"2023-03-02T10:55:49.543814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:23:27.900984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539897+0000","last_change":"2023-03-02T10:55:10.621984+0000","last_active":"2023-03-02T10:55:49.539897+0000","last_peered":"2023-03-02T10:55:49.539897+0000","last_clean":"2023-03-02T10:55:49.539897+0000","last_became_active":"2023-03-02T10:55:10.621636+0000","last_became_peered":"2023-03-02T10:55:10.621636+0000","last_unstale":"2023-03-02T10:55:49.539897+0000","last_undegraded":"2023-03-02T10:55:49.539897+0000","last_fullsized":"2023-03-02T10:55:49.539897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:10:41.154358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.538439+0000","last_change":"2023-03-02T10:55:10.633194+0000","last_active":"2023-03-02T10:55:49.538439+0000","last_peered":"2023-03-02T10:55:49.538439+0000","last_clean":"2023-03-02T10:55:49.538439+0000","last_became_active":"2023-03-02T10:55:10.632860+0000","last_became_peered":"2023-03-02T10:55:10.632860+0000","last_unstale":"2023-03-02T10:55:49.538439+0000","last_undegraded":"2023-03-02T10:55:49.538439+0000","last_fullsized":"2023-03-02T10:55:49.538439+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:34:58.071830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.535109+0000","last_change":"2023-03-02T10:55:10.613717+0000","last_active":"2023-03-02T10:55:49.535109+0000","last_peered":"2023-03-02T10:55:49.535109+0000","last_clean":"2023-03-02T10:55:49.535109+0000","last_became_active":"2023-03-02T10:55:10.613391+0000","last_became_peered":"2023-03-02T10:55:10.613391+0000","last_unstale":"2023-03-02T10:55:49.535109+0000","last_undegraded":"2023-03-02T10:55:49.535109+0000","last_fullsized":"2023-03-02T10:55:49.535109+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:51:23.532086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542907+0000","last_change":"2023-03-02T10:55:10.637730+0000","last_active":"2023-03-02T10:55:49.542907+0000","last_peered":"2023-03-02T10:55:49.542907+0000","last_clean":"2023-03-02T10:55:49.542907+0000","last_became_active":"2023-03-02T10:55:10.637097+0000","last_became_peered":"2023-03-02T10:55:10.637097+0000","last_unstale":"2023-03-02T10:55:49.542907+0000","last_undegraded":"2023-03-02T10:55:49.542907+0000","last_fullsized":"2023-03-02T10:55:49.542907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:41:19.587933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541693+0000","last_change":"2023-03-02T10:55:10.617374+0000","last_active":"2023-03-02T10:55:49.541693+0000","last_peered":"2023-03-02T10:55:49.541693+0000","last_clean":"2023-03-02T10:55:49.541693+0000","last_became_active":"2023-03-02T10:55:10.617061+0000","last_became_peered":"2023-03-02T10:55:10.617061+0000","last_unstale":"2023-03-02T10:55:49.541693+0000","last_undegraded":"2023-03-02T10:55:49.541693+0000","last_fullsized":"2023-03-02T10:55:49.541693+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:03:41.270487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542759+0000","last_change":"2023-03-02T10:55:10.622246+0000","last_active":"2023-03-02T10:55:49.542759+0000","last_peered":"2023-03-02T10:55:49.542759+0000","last_clean":"2023-03-02T10:55:49.542759+0000","last_became_active":"2023-03-02T10:55:10.621938+0000","last_became_peered":"2023-03-02T10:55:10.621938+0000","last_unstale":"2023-03-02T10:55:49.542759+0000","last_undegraded":"2023-03-02T10:55:49.542759+0000","last_fullsized":"2023-03-02T10:55:49.542759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:39:35.605113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534507+0000","last_change":"2023-03-02T10:55:10.623502+0000","last_active":"2023-03-02T10:55:49.534507+0000","last_peered":"2023-03-02T10:55:49.534507+0000","last_clean":"2023-03-02T10:55:49.534507+0000","last_became_active":"2023-03-02T10:55:10.623160+0000","last_became_peered":"2023-03-02T10:55:10.623160+0000","last_unstale":"2023-03-02T10:55:49.534507+0000","last_undegraded":"2023-03-02T10:55:49.534507+0000","last_fullsized":"2023-03-02T10:55:49.534507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:30:49.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539815+0000","last_change":"2023-03-02T10:55:10.636452+0000","last_active":"2023-03-02T10:55:49.539815+0000","last_peered":"2023-03-02T10:55:49.539815+0000","last_clean":"2023-03-02T10:55:49.539815+0000","last_became_active":"2023-03-02T10:55:10.636176+0000","last_became_peered":"2023-03-02T10:55:10.636176+0000","last_unstale":"2023-03-02T10:55:49.539815+0000","last_undegraded":"2023-03-02T10:55:49.539815+0000","last_fullsized":"2023-03-02T10:55:49.539815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:51.303295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.092168+0000","last_change":"2023-03-02T10:55:51.092168+0000","last_active":"2023-03-02T10:55:51.092168+0000","last_peered":"2023-03-02T10:55:51.092168+0000","last_clean":"2023-03-02T10:55:51.092168+0000","last_became_active":"2023-03-02T10:55:51.091735+0000","last_became_peered":"2023-03-02T10:55:51.091735+0000","last_unstale":"2023-03-02T10:55:51.092168+0000","last_undegraded":"2023-03-02T10:55:51.092168+0000","last_fullsized":"2023-03-02T10:55:51.092168+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:25:46.235073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":254019,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63091,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":459,"num_read_kb":316,"num_write":230,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":610,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":189273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416407,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6048,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739104,"statfs":{"total":95995035648,"available":95988842496,"internally_reserved":0,"allocated":942080,"data_stored":448834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":3.8109999999999999}]},{"osd":1,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.56799999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":9,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.68899999999999995}]},{"osd":10,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.72099999999999997}]}]},{"osd":10,"up_from":71,"seq":304942678043,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6504,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738648,"statfs":{"total":95995035648,"available":95988375552,"internally_reserved":0,"allocated":1081344,"data_stored":1095287,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.37}]},{"osd":2,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.505}]},{"osd":4,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.63},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.72699999999999998}]},{"osd":9,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.69599999999999995}]},{"osd":11,"last update":"Thu Mar 2 10:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.65700000000000003}]}]},{"osd":9,"up_from":66,"seq":283467841567,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6260,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738892,"statfs":{"total":95995035648,"available":95988625408,"internally_reserved":0,"allocated":962560,"data_stored":448277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.55200000000000005,"5min":0.871,"15min":0.871},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.58799999999999997,"5min":1.823,"15min":1.823},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67900000000000005,"15min":0.69199999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85499999999999998,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.73599999999999999,"15min":0.76000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.747,"5min":0.999,"15min":0.999},"last":6.7990000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.71899999999999997,"15min":0.73899999999999999},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79700000000000004,"5min":1.266,"15min":1.266},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.65900000000000003,"15min":0.68899999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63400000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.36099999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57799999999999996,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.92700000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.85899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.83099999999999996,"15min":0.86099999999999999},"min":{"1min":0.53700000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.86899999999999999,"5min":1.956,"15min":1.956},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.84199999999999997,"15min":0.876},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.82999999999999996,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.82199999999999995,"15min":0.85699999999999998},"min":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2569999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.82799999999999996,"15min":0.85899999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89700000000000002,"5min":1.452,"15min":1.452},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.90000000000000002,"15min":0.93000000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.86899999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.89600000000000002,"15min":0.92700000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2130000000000001,"5min":1.522,"15min":1.522},"last":0.64300000000000002}]},{"osd":8,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95999999999999996,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":6.8170000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.93400000000000005,"15min":0.96499999999999997},"min":{"1min":0.63100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.90600000000000003,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.75600000000000001}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.68400000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070500,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6440,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738712,"statfs":{"total":95995035648,"available":95988441088,"internally_reserved":0,"allocated":950272,"data_stored":448494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.499},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58499999999999996,"15min":0.57299999999999995},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78000000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63100000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76200000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79900000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.749}]},{"osd":6,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.879}]},{"osd":9,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.71499999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.05,"5min":0.79700000000000004,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":0.71199999999999997}]},{"osd":10,"last update":"Thu Mar 2 10:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.83299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":7,"up_from":52,"seq":223338299431,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6492,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738660,"statfs":{"total":95995035648,"available":95988387840,"internally_reserved":0,"allocated":1003520,"data_stored":1040841,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84499999999999997,"5min":1.034,"15min":1.034},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.41499999999999998},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60799999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.76100000000000001,"5min":1.129,"15min":1.129},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.438,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80200000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.746}]},{"osd":3,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81899999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.81899999999999995}]},{"osd":4,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70599999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.46000000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84899999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90500000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.80200000000000005}]},{"osd":8,"last update":"Thu Mar 2 10:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.87,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.91500000000000004}]},{"osd":9,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81599999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69699999999999995,"15min":0.70099999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92100000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.873}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.90300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]},{"osd":6,"up_from":47,"seq":201863462958,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738848,"statfs":{"total":95995035648,"available":95988580352,"internally_reserved":0,"allocated":942080,"data_stored":447893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.41399999999999998,"15min":0.40200000000000002},"min":{"1min":0.30599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.308},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65000000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.53600000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.91400000000000003,"5min":0.999,"15min":0.999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60399999999999998,"15min":0.58199999999999996},"min":{"1min":0.46300000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.82399999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.499,"15min":0.495},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.83299999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97999999999999998,"5min":1.069,"15min":1.069},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.69599999999999995,"15min":0.67000000000000004},"min":{"1min":0.5,"5min":0.439,"15min":0.439},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.69399999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92700000000000005,"5min":1.03,"15min":1.03},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Mar 2 10:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.73899999999999999,"15min":0.72599999999999998},"min":{"1min":0.57599999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.747,"15min":0.73499999999999999},"min":{"1min":0.629,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.69699999999999995}]},{"osd":8,"last update":"Thu Mar 2 10:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0049999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70999999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.84099999999999997,"15min":0.86199999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97099999999999997,"5min":1.234,"15min":1.234},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.018,"5min":1.163,"15min":1.163},"last":0.58199999999999996}]},{"osd":10,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7384,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737768,"statfs":{"total":95995035648,"available":95987474432,"internally_reserved":0,"allocated":999424,"data_stored":504737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51000000000000001,"15min":0.48799999999999999},"min":{"1min":0.36499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.75,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.316},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.505,"15min":0.502},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81100000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Mar 2 10:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.42399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90500000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.55100000000000005},"min":{"1min":0.44900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79300000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Mar 2 10:55:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.443,"15min":0.40899999999999997},"min":{"1min":0.29199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.53000000000000003,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Mar 2 10:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90400000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Mar 2 10:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.47499999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93400000000000005,"5min":1.097,"15min":1.097},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.51700000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96999999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.38600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.629}]},{"osd":8,"last update":"Thu Mar 2 10:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65900000000000003}]},{"osd":9,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.56999999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0209999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.53300000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.73799999999999999}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.64700000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7220,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737932,"statfs":{"total":95995035648,"available":95987642368,"internally_reserved":0,"allocated":962560,"data_stored":449194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54700000000000004,"15min":0.48999999999999999},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.873,"15min":0.873},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.56200000000000006,"15min":0.50900000000000001},"min":{"1min":0.50800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58499999999999996,"15min":0.54400000000000004},"min":{"1min":0.48599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Mar 2 10:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.41899999999999998},"min":{"1min":0.29099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71199999999999997,"5min":0.755,"15min":0.755},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.432,"15min":0.41399999999999998},"min":{"1min":0.32200000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.64800000000000002,"15min":0.57799999999999996},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.7569999999999997,"5min":4.7569999999999997,"15min":4.7569999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80500000000000005,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Mar 2 10:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.61899999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75800000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94299999999999995,"5min":1.149,"15min":1.149},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Mar 2 10:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.63400000000000001,"15min":0.64100000000000001},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76600000000000001,"5min":1.171,"15min":1.171},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.47299999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.054,"5min":1.298,"15min":1.298},"last":0.745},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0740000000000001,"5min":1.23,"15min":1.23},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.79200000000000004,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.86299999999999999,"5min":1.179,"15min":1.179},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78300000000000003,"15min":0.79700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.012,"5min":1.117,"15min":1.117},"last":0.63200000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.76400000000000001,"15min":0.78100000000000003},"min":{"1min":0.40500000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.093,"5min":1.149,"15min":1.149},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1950000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.58499999999999996}]},{"osd":10,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.70699999999999996}]},{"osd":11,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.78400000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7468,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737684,"statfs":{"total":95995035648,"available":95987388416,"internally_reserved":0,"allocated":1019904,"data_stored":505363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.496},"min":{"1min":0.375,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.503},"min":{"1min":0.41199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.82899999999999996,"5min":0.874,"15min":0.874},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53400000000000003,"15min":0.51200000000000001},"min":{"1min":0.36299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72199999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.754},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.54200000000000004,"15min":0.50800000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.84199999999999997}]},{"osd":3,"last update":"Thu Mar 2 10:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.623,"15min":0.57399999999999995},"min":{"1min":0.38200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.8140000000000001,"5min":3.8140000000000001,"15min":3.8140000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.61899999999999999,"15min":0.58899999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":3.7669999999999999},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Mar 2 10:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.502,"15min":0.50800000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72499999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Mar 2 10:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":0.871,"15min":0.871},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.63400000000000001,"15min":0.61399999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":4.0490000000000004,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.6639999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.31900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.83999999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.91500000000000004}]},{"osd":9,"last update":"Thu Mar 2 10:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.69899999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.73999999999999999,"15min":0.71899999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.1790000000000003,"5min":4.1790000000000003,"15min":4.1790000000000003},"last":1.0129999999999999}]},{"osd":10,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6568,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738584,"statfs":{"total":95995035648,"available":95988310016,"internally_reserved":0,"allocated":950272,"data_stored":447270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:34 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":0.56899999999999995,"15min":0.437},"min":{"1min":0.29599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":14.122,"5min":14.122,"15min":14.122},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.0860000000000001,"5min":0.54000000000000004,"15min":0.434},"min":{"1min":0.31900000000000001,"5min":0.245,"15min":0.245},"max":{"1min":9.1010000000000009,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.60799999999999998,"15min":0.57099999999999995},"min":{"1min":0.39100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.175,"5min":0.68200000000000005,"15min":0.59599999999999997},"min":{"1min":0.38,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":9.0719999999999992,"5min":9.0719999999999992,"15min":9.0719999999999992},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.65500000000000003,"15min":0.60999999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.64700000000000002,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.623}]},{"osd":4,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65900000000000003,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Mar 2 10:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.68500000000000005,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.41599999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Mar 2 10:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.62,"15min":0.56699999999999995},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.0170000000000003,"5min":5.0170000000000003,"15min":5.0170000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":0.69699999999999995,"15min":0.60699999999999998},"min":{"1min":0.39000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":9.1270000000000007,"5min":9.1270000000000007,"15min":9.1270000000000007},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.80000000000000004,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0029999999999999,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.749},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.53400000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.88400000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":6.9539999999999997,"5min":6.9539999999999997,"15min":6.9539999999999997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.76300000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.76500000000000001,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.82799999999999996,"15min":0.80900000000000005},"min":{"1min":0.56599999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Mar 2 10:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.80400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888119,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6496,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738656,"statfs":{"total":95995035648,"available":95988383744,"internally_reserved":0,"allocated":942080,"data_stored":448138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65300000000000002,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":5.8860000000000001,"15min":5.8860000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64000000000000001,"15min":0.67400000000000004},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.95599999999999996,"5min":5.577,"15min":5.577},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38200000000000001,"15min":0.34999999999999998},"min":{"1min":0.30399999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.65700000000000003,"5min":0.872,"15min":0.872},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.35899999999999999},"min":{"1min":0.34300000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.47999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57699999999999996,"15min":0.54300000000000004},"min":{"1min":0.49199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.56399999999999995,"15min":0.53600000000000003},"min":{"1min":0.47199999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.55500000000000005},"min":{"1min":0.38700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Mar 2 10:55:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.56299999999999994,"15min":0.54600000000000004},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.42799999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Mar 2 10:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60199999999999998,"15min":0.58299999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80300000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63700000000000001,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Mar 2 10:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.745},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.52100000000000002},"min":{"1min":0.44500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":1.02,"15min":1.02},"last":0.61199999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.70299999999999996},"min":{"1min":0.52400000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.85999999999999999,"5min":1.087,"15min":1.087},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.70499999999999996,"15min":0.69499999999999995},"min":{"1min":0.55800000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95199999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.874}]},{"osd":9,"last update":"Thu Mar 2 10:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.751},"min":{"1min":0.50800000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1180000000000001,"5min":1.149,"15min":1.149},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.107,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.81399999999999995}]},{"osd":10,"last update":"Thu Mar 2 10:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.71599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":5,"up_from":39,"seq":167503724593,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6568,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738584,"statfs":{"total":95995035648,"available":95988310016,"internally_reserved":0,"allocated":1015808,"data_stored":1040370,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":1.51,"15min":1.51},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.5}]},{"osd":1,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.56200000000000006},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83899999999999997,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42399999999999999,"15min":0.41799999999999998},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59299999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57099999999999995,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76600000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79600000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Mar 2 10:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97299999999999998,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.878,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Mar 2 10:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.54000000000000004,"5min":0.374,"15min":0.374},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.81699999999999995}]},{"osd":8,"last update":"Thu Mar 2 10:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.44700000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.86099999999999999}]},{"osd":9,"last update":"Thu Mar 2 10:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.749,"15min":0.751},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.86799999999999999}]},{"osd":10,"last update":"Thu Mar 2 10:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.89200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":58079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-02T10:56:06.426 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-03-02T10:56:06.427 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-03-02T10:56:06.427 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-03-02T10:56:06.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph health --format=json 2023-03-02T10:56:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:06 smithi136 ceph-mon[125702]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 61 B/s, 0 objects/s recovering 2023-03-02T10:56:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:06 smithi057 ceph-mon[92072]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 61 B/s, 0 objects/s recovering 2023-03-02T10:56:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:06 smithi122 ceph-mon[125440]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 61 B/s, 0 objects/s recovering 2023-03-02T10:56:07.195 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:56:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:07 smithi136 ceph-mon[125702]: from='client.24832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:07 smithi057 ceph-mon[92072]: from='client.24832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:07 smithi122 ceph-mon[125440]: from='client.24832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:08.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.585+0000 7f6a5f792700 1 -- 172.21.15.57:0/2836386686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a58101790 msgr2=0x7f6a58109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:08.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.585+0000 7f6a5f792700 1 --2- 172.21.15.57:0/2836386686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a58101790 0x7f6a58109c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009990 tx=0x7f6a48009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:08.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.585+0000 7f6a5f792700 1 -- 172.21.15.57:0/2836386686 shutdown_connections 2023-03-02T10:56:08.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.585+0000 7f6a5f792700 1 --2- 172.21.15.57:0/2836386686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5810a1c0 0x7f6a5810c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:08.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.585+0000 7f6a5f792700 1 --2- 172.21.15.57:0/2836386686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a58100e80 0x7f6a58101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:08.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.585+0000 7f6a5f792700 1 --2- 172.21.15.57:0/2836386686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a58101790 0x7f6a58109c80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:08.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.585+0000 7f6a5f792700 1 -- 172.21.15.57:0/2836386686 >> 172.21.15.57:0/2836386686 conn(0x7f6a580fa610 msgr2=0x7f6a580fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:08.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.585+0000 7f6a5f792700 1 -- 172.21.15.57:0/2836386686 shutdown_connections 2023-03-02T10:56:08.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.585+0000 7f6a5f792700 1 -- 172.21.15.57:0/2836386686 wait complete. 2023-03-02T10:56:08.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5f792700 1 Processor -- start 2023-03-02T10:56:08.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5f792700 1 -- start start 2023-03-02T10:56:08.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5f792700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a58100e80 0x7f6a580fead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:08.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5f792700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a58101790 0x7f6a580ff010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:08.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5f792700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5810a1c0 0x7f6a581a3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:08.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5f792700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580ff840 con 0x7f6a58101790 2023-03-02T10:56:08.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5f792700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a581a4400 con 0x7f6a5810a1c0 2023-03-02T10:56:08.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5f792700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a581a4540 con 0x7f6a58100e80 2023-03-02T10:56:08.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5cd2d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a58101790 0x7f6a580ff010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:08.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5cd2d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a58101790 0x7f6a580ff010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34664/0 (socket says 172.21.15.57:34664) 2023-03-02T10:56:08.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5cd2d700 1 -- 172.21.15.57:0/3728620992 learned_addr learned my addr 172.21.15.57:0/3728620992 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:08.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5d52e700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a58100e80 0x7f6a580fead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:08.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.586+0000 7f6a5dd2f700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5810a1c0 0x7f6a581a3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:08.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.587+0000 7f6a5cd2d700 1 -- 172.21.15.57:0/3728620992 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a58100e80 msgr2=0x7f6a580fead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:08.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.587+0000 7f6a5cd2d700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a58100e80 0x7f6a580fead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:08.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.587+0000 7f6a5cd2d700 1 -- 172.21.15.57:0/3728620992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5810a1c0 msgr2=0x7f6a581a3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:08.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.587+0000 7f6a5cd2d700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5810a1c0 0x7f6a581a3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:08.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.587+0000 7f6a5cd2d700 1 -- 172.21.15.57:0/3728620992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480095f0 con 0x7f6a58101790 2023-03-02T10:56:08.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.587+0000 7f6a5cd2d700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a58101790 0x7f6a580ff010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6a480095c0 tx=0x7f6a4800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:08.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.587+0000 7f6a4e7fc700 1 -- 172.21.15.57:0/3728620992 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4801d070 con 0x7f6a58101790 2023-03-02T10:56:08.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.587+0000 7f6a4e7fc700 1 -- 172.21.15.57:0/3728620992 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a4800fc00 con 0x7f6a58101790 2023-03-02T10:56:08.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.587+0000 7f6a5f792700 1 -- 172.21.15.57:0/3728620992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5810fc60 con 0x7f6a58101790 2023-03-02T10:56:08.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.587+0000 7f6a4e7fc700 1 -- 172.21.15.57:0/3728620992 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48017650 con 0x7f6a58101790 2023-03-02T10:56:08.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.587+0000 7f6a5f792700 1 -- 172.21.15.57:0/3728620992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5810fad0 con 0x7f6a58101790 2023-03-02T10:56:08.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.588+0000 7f6a5f792700 1 -- 172.21.15.57:0/3728620992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a580681c0 con 0x7f6a58101790 2023-03-02T10:56:08.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:08 smithi136 ceph-mon[125702]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 61 B/s, 0 objects/s recovering 2023-03-02T10:56:08.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.590+0000 7f6a4e7fc700 1 -- 172.21.15.57:0/3728620992 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f6a48029030 con 0x7f6a58101790 2023-03-02T10:56:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.590+0000 7f6a4e7fc700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6a4409b3e0 0x7f6a4409d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.591+0000 7f6a4e7fc700 1 -- 172.21.15.57:0/3728620992 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6a480c6750 con 0x7f6a58101790 2023-03-02T10:56:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.591+0000 7f6a5d52e700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6a4409b3e0 0x7f6a4409d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.591+0000 7f6a5d52e700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6a4409b3e0 0x7f6a4409d890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6a54005fd0 tx=0x7f6a5400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.593+0000 7f6a4e7fc700 1 -- 172.21.15.57:0/3728620992 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f6a48092070 con 0x7f6a58101790 2023-03-02T10:56:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:08 smithi057 ceph-mon[92072]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 61 B/s, 0 objects/s recovering 2023-03-02T10:56:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:08 smithi122 ceph-mon[125440]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 61 B/s, 0 objects/s recovering 2023-03-02T10:56:08.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.839+0000 7f6a5f792700 1 -- 172.21.15.57:0/3728620992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6a58066750 con 0x7f6a58101790 2023-03-02T10:56:08.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.839+0000 7f6a4e7fc700 1 -- 172.21.15.57:0/3728620992 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6a48095690 con 0x7f6a58101790 2023-03-02T10:56:08.840 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:08.841 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-03-02T10:56:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 -- 172.21.15.57:0/3728620992 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6a4409b3e0 msgr2=0x7f6a4409d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6a4409b3e0 0x7f6a4409d890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6a54005fd0 tx=0x7f6a5400a560 comp rx=0 tx=0).stop 2023-03-02T10:56:08.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 -- 172.21.15.57:0/3728620992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a58101790 msgr2=0x7f6a580ff010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:08.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a58101790 0x7f6a580ff010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6a480095c0 tx=0x7f6a4800f710 comp rx=0 tx=0).stop 2023-03-02T10:56:08.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 -- 172.21.15.57:0/3728620992 shutdown_connections 2023-03-02T10:56:08.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6a4409b3e0 0x7f6a4409d890 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:08.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5810a1c0 0x7f6a581a3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:08.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a58100e80 0x7f6a580fead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:08.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 --2- 172.21.15.57:0/3728620992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a58101790 0x7f6a580ff010 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:08.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 -- 172.21.15.57:0/3728620992 >> 172.21.15.57:0/3728620992 conn(0x7f6a580fa610 msgr2=0x7f6a5810c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:08.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 -- 172.21.15.57:0/3728620992 shutdown_connections 2023-03-02T10:56:08.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:08.841+0000 7f6a5f792700 1 -- 172.21.15.57:0/3728620992 wait complete. 2023-03-02T10:56:09.305 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-03-02T10:56:09.305 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:56:09.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.463+0000 7f39ee3ff700 1 -- 172.21.15.57:0/1777566236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e80fe990 msgr2=0x7f39e80feda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:09.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.463+0000 7f39ee3ff700 1 --2- 172.21.15.57:0/1777566236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e80fe990 0x7f39e80feda0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009990 tx=0x7f39d8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.463+0000 7f39ee3ff700 1 -- 172.21.15.57:0/1777566236 shutdown_connections 2023-03-02T10:56:09.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.463+0000 7f39ee3ff700 1 --2- 172.21.15.57:0/1777566236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39e81005d0 0x7f39e8106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.463+0000 7f39ee3ff700 1 --2- 172.21.15.57:0/1777566236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e80fe990 0x7f39e80feda0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.463+0000 7f39ee3ff700 1 --2- 172.21.15.57:0/1777566236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39e80ffc20 0x7f39e8100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.463+0000 7f39ee3ff700 1 -- 172.21.15.57:0/1777566236 >> 172.21.15.57:0/1777566236 conn(0x7f39e80f9fd0 msgr2=0x7f39e80fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:09.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.463+0000 7f39ee3ff700 1 -- 172.21.15.57:0/1777566236 shutdown_connections 2023-03-02T10:56:09.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.463+0000 7f39ee3ff700 1 -- 172.21.15.57:0/1777566236 wait complete. 2023-03-02T10:56:09.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.464+0000 7f39ee3ff700 1 Processor -- start 2023-03-02T10:56:09.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.464+0000 7f39ee3ff700 1 -- start start 2023-03-02T10:56:09.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ee3ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39e80fe990 0x7f39e8068250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:09.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ee3ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39e80ffc20 0x7f39e819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:09.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ee3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e81005d0 0x7f39e819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:09.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ee3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e819d320 con 0x7f39e81005d0 2023-03-02T10:56:09.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ee3ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e819d490 con 0x7f39e80fe990 2023-03-02T10:56:09.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ee3ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e819d650 con 0x7f39e80ffc20 2023-03-02T10:56:09.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ec99c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e81005d0 0x7f39e819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:09.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ec99c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e81005d0 0x7f39e819cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34690/0 (socket says 172.21.15.57:34690) 2023-03-02T10:56:09.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ec99c700 1 -- 172.21.15.57:0/2548107934 learned_addr learned my addr 172.21.15.57:0/2548107934 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:09.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39e7fff700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39e80fe990 0x7f39e8068250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:09.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39e77fe700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39e80ffc20 0x7f39e819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:09.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ec99c700 1 -- 172.21.15.57:0/2548107934 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39e80ffc20 msgr2=0x7f39e819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:09.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ec99c700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39e80ffc20 0x7f39e819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ec99c700 1 -- 172.21.15.57:0/2548107934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39e80fe990 msgr2=0x7f39e8068250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:09.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ec99c700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39e80fe990 0x7f39e8068250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.465+0000 7f39ec99c700 1 -- 172.21.15.57:0/2548107934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d80095f0 con 0x7f39e81005d0 2023-03-02T10:56:09.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.466+0000 7f39ec99c700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e81005d0 0x7f39e819cb80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f39e0007ee0 tx=0x7f39e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:09.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.466+0000 7f39e57fa700 1 -- 172.21.15.57:0/2548107934 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0017070 con 0x7f39e81005d0 2023-03-02T10:56:09.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.466+0000 7f39e57fa700 1 -- 172.21.15.57:0/2548107934 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39e000f040 con 0x7f39e81005d0 2023-03-02T10:56:09.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.466+0000 7f39ee3ff700 1 -- 172.21.15.57:0/2548107934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e810a2f0 con 0x7f39e81005d0 2023-03-02T10:56:09.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.466+0000 7f39e57fa700 1 -- 172.21.15.57:0/2548107934 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0005740 con 0x7f39e81005d0 2023-03-02T10:56:09.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.466+0000 7f39ee3ff700 1 -- 172.21.15.57:0/2548107934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e810a160 con 0x7f39e81005d0 2023-03-02T10:56:09.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.467+0000 7f39ee3ff700 1 -- 172.21.15.57:0/2548107934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e81059b0 con 0x7f39e81005d0 2023-03-02T10:56:09.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.468+0000 7f39e57fa700 1 -- 172.21.15.57:0/2548107934 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f39e000dc60 con 0x7f39e81005d0 2023-03-02T10:56:09.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.469+0000 7f39e57fa700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f39d009b3e0 0x7f39d009d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:09.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.469+0000 7f39e57fa700 1 -- 172.21.15.57:0/2548107934 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f39e00c4f70 con 0x7f39e81005d0 2023-03-02T10:56:09.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.469+0000 7f39e7fff700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f39d009b3e0 0x7f39d009d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:09.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.470+0000 7f39e7fff700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f39d009b3e0 0x7f39d009d890 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f39d800b5c0 tx=0x7f39d8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:09.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.472+0000 7f39e57fa700 1 -- 172.21.15.57:0/2548107934 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f39e0090860 con 0x7f39e81005d0 2023-03-02T10:56:09.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.675+0000 7f39ee3ff700 1 -- 172.21.15.57:0/2548107934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39e802cd50 con 0x7f39e81005d0 2023-03-02T10:56:09.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.676+0000 7f39e57fa700 1 -- 172.21.15.57:0/2548107934 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22553 (secure 0 0 0) 0x7f39e0093e80 con 0x7f39e81005d0 2023-03-02T10:56:09.678 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:09.678 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":86,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:50.530934+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:56:09.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 -- 172.21.15.57:0/2548107934 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f39d009b3e0 msgr2=0x7f39d009d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:09.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f39d009b3e0 0x7f39d009d890 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f39d800b5c0 tx=0x7f39d8005fd0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 -- 172.21.15.57:0/2548107934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e81005d0 msgr2=0x7f39e819cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:09.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e81005d0 0x7f39e819cb80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f39e0007ee0 tx=0x7f39e000d3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 -- 172.21.15.57:0/2548107934 shutdown_connections 2023-03-02T10:56:09.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f39d009b3e0 0x7f39d009d890 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e81005d0 0x7f39e819cb80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39e80fe990 0x7f39e8068250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 --2- 172.21.15.57:0/2548107934 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39e80ffc20 0x7f39e819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 -- 172.21.15.57:0/2548107934 >> 172.21.15.57:0/2548107934 conn(0x7f39e80f9fd0 msgr2=0x7f39e80fc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:09.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 -- 172.21.15.57:0/2548107934 shutdown_connections 2023-03-02T10:56:09.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.679+0000 7f39ee3ff700 1 -- 172.21.15.57:0/2548107934 wait complete. 2023-03-02T10:56:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:09 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3728620992' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-03-02T10:56:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:09 smithi057 ceph-mon[92072]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:09.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-02T10:51:03.600226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-02T10:55:08.504787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-02T10:55:09.909014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-02T10:56:09.697 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-02T10:56:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:09 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3728620992' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-03-02T10:56:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:09 smithi136 ceph-mon[125702]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:09.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.852+0000 7f7c959ff700 1 -- 172.21.15.57:0/3256898024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c900ffc20 msgr2=0x7f7c90100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:09.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.852+0000 7f7c959ff700 1 --2- 172.21.15.57:0/3256898024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c900ffc20 0x7f7c90100090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800b0a0 tx=0x7f7c7800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.853+0000 7f7c959ff700 1 -- 172.21.15.57:0/3256898024 shutdown_connections 2023-03-02T10:56:09.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.853+0000 7f7c959ff700 1 --2- 172.21.15.57:0/3256898024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c901005d0 0x7f7c90106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.853+0000 7f7c959ff700 1 --2- 172.21.15.57:0/3256898024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c900fe990 0x7f7c900feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.853+0000 7f7c959ff700 1 --2- 172.21.15.57:0/3256898024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c900ffc20 0x7f7c90100090 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.853+0000 7f7c959ff700 1 -- 172.21.15.57:0/3256898024 >> 172.21.15.57:0/3256898024 conn(0x7f7c900f9fd0 msgr2=0x7f7c900fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:09.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.853+0000 7f7c959ff700 1 -- 172.21.15.57:0/3256898024 shutdown_connections 2023-03-02T10:56:09.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.853+0000 7f7c959ff700 1 -- 172.21.15.57:0/3256898024 wait complete. 2023-03-02T10:56:09.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c959ff700 1 Processor -- start 2023-03-02T10:56:09.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c959ff700 1 -- start start 2023-03-02T10:56:09.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c959ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c900fe990 0x7f7c901959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:09.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c959ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c900ffc20 0x7f7c90195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:09.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c959ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c901005d0 0x7f7c9019cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:09.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c959ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9019d550 con 0x7f7c901005d0 2023-03-02T10:56:09.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c959ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9019d690 con 0x7f7c900ffc20 2023-03-02T10:56:09.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c959ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9019d820 con 0x7f7c900fe990 2023-03-02T10:56:09.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c8f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c901005d0 0x7f7c9019cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:09.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c8f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c901005d0 0x7f7c9019cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34714/0 (socket says 172.21.15.57:34714) 2023-03-02T10:56:09.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c8f7fe700 1 -- 172.21.15.57:0/1055809918 learned_addr learned my addr 172.21.15.57:0/1055809918 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:09.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c8effd700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c900fe990 0x7f7c901959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:09.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.854+0000 7f7c867fc700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c900ffc20 0x7f7c90195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:09.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.855+0000 7f7c8f7fe700 1 -- 172.21.15.57:0/1055809918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c900fe990 msgr2=0x7f7c901959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:09.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.855+0000 7f7c8f7fe700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c900fe990 0x7f7c901959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.855+0000 7f7c8f7fe700 1 -- 172.21.15.57:0/1055809918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c900ffc20 msgr2=0x7f7c90195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.855+0000 7f7c8f7fe700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c900ffc20 0x7f7c90195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.855+0000 7f7c8f7fe700 1 -- 172.21.15.57:0/1055809918 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c78009d00 con 0x7f7c901005d0 2023-03-02T10:56:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.855+0000 7f7c8f7fe700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c901005d0 0x7f7c9019cf80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800e940 tx=0x7f7c8800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.855+0000 7f7c949fd700 1 -- 172.21.15.57:0/1055809918 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c880097b0 con 0x7f7c901005d0 2023-03-02T10:56:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.855+0000 7f7c959ff700 1 -- 172.21.15.57:0/1055809918 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9010b4c0 con 0x7f7c901005d0 2023-03-02T10:56:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.855+0000 7f7c949fd700 1 -- 172.21.15.57:0/1055809918 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c88005020 con 0x7f7c901005d0 2023-03-02T10:56:09.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.855+0000 7f7c949fd700 1 -- 172.21.15.57:0/1055809918 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800cc40 con 0x7f7c901005d0 2023-03-02T10:56:09.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.855+0000 7f7c959ff700 1 -- 172.21.15.57:0/1055809918 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9010b330 con 0x7f7c901005d0 2023-03-02T10:56:09.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.856+0000 7f7c959ff700 1 -- 172.21.15.57:0/1055809918 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c901059b0 con 0x7f7c901005d0 2023-03-02T10:56:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.858+0000 7f7c949fd700 1 -- 172.21.15.57:0/1055809918 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f7c8801e020 con 0x7f7c901005d0 2023-03-02T10:56:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.859+0000 7f7c949fd700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c7c09b3e0 0x7f7c7c09d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.859+0000 7f7c949fd700 1 -- 172.21.15.57:0/1055809918 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7c88014070 con 0x7f7c901005d0 2023-03-02T10:56:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.859+0000 7f7c8effd700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c7c09b3e0 0x7f7c7c09d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.859+0000 7f7c8effd700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c7c09b3e0 0x7f7c7c09d890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009c60 tx=0x7f7c80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:09.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:09.862+0000 7f7c949fd700 1 -- 172.21.15.57:0/1055809918 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f7c88090c90 con 0x7f7c901005d0 2023-03-02T10:56:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:09 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3728620992' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-03-02T10:56:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:09 smithi122 ceph-mon[125440]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:10.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.058+0000 7f7c959ff700 1 -- 172.21.15.57:0/1055809918 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c900613e0 con 0x7f7c901005d0 2023-03-02T10:56:10.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.059+0000 7f7c949fd700 1 -- 172.21.15.57:0/1055809918 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c88005190 con 0x7f7c901005d0 2023-03-02T10:56:10.060 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-02T10:56:10.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 -- 172.21.15.57:0/1055809918 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c7c09b3e0 msgr2=0x7f7c7c09d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c7c09b3e0 0x7f7c7c09d890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009c60 tx=0x7f7c80009260 comp rx=0 tx=0).stop 2023-03-02T10:56:10.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 -- 172.21.15.57:0/1055809918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c901005d0 msgr2=0x7f7c9019cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c901005d0 0x7f7c9019cf80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800e940 tx=0x7f7c8800ec50 comp rx=0 tx=0).stop 2023-03-02T10:56:10.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 -- 172.21.15.57:0/1055809918 shutdown_connections 2023-03-02T10:56:10.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7c7c09b3e0 0x7f7c7c09d890 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c901005d0 0x7f7c9019cf80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c900fe990 0x7f7c901959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 --2- 172.21.15.57:0/1055809918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c900ffc20 0x7f7c90195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 -- 172.21.15.57:0/1055809918 >> 172.21.15.57:0/1055809918 conn(0x7f7c900f9fd0 msgr2=0x7f7c900fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:10.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 -- 172.21.15.57:0/1055809918 shutdown_connections 2023-03-02T10:56:10.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.061+0000 7f7c959ff700 1 -- 172.21.15.57:0/1055809918 wait complete. 2023-03-02T10:56:10.077 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-02T10:56:10.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.234+0000 7fd9c5bff700 1 -- 172.21.15.57:0/969789576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c00ffac0 msgr2=0x7fd9c00ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.234+0000 7fd9c5bff700 1 --2- 172.21.15.57:0/969789576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c00ffac0 0x7fd9c00ffed0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009990 tx=0x7fd9b0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.234+0000 7fd9c5bff700 1 -- 172.21.15.57:0/969789576 shutdown_connections 2023-03-02T10:56:10.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.234+0000 7fd9c5bff700 1 --2- 172.21.15.57:0/969789576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c0101700 0x7fd9c0107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.234+0000 7fd9c5bff700 1 --2- 172.21.15.57:0/969789576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c00ffac0 0x7fd9c00ffed0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.234+0000 7fd9c5bff700 1 --2- 172.21.15.57:0/969789576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c0100d50 0x7fd9c01011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.234+0000 7fd9c5bff700 1 -- 172.21.15.57:0/969789576 >> 172.21.15.57:0/969789576 conn(0x7fd9c00fb100 msgr2=0x7fd9c00fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:10.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.234+0000 7fd9c5bff700 1 -- 172.21.15.57:0/969789576 shutdown_connections 2023-03-02T10:56:10.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.234+0000 7fd9c5bff700 1 -- 172.21.15.57:0/969789576 wait complete. 2023-03-02T10:56:10.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9c5bff700 1 Processor -- start 2023-03-02T10:56:10.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9c5bff700 1 -- start start 2023-03-02T10:56:10.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9c5bff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c00ffac0 0x7fd9c0195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:10.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9c5bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c0100d50 0x7fd9c0195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:10.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9c5bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c0101700 0x7fd9c019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:10.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9c5bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c019d2d0 con 0x7fd9c0101700 2023-03-02T10:56:10.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9c5bff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c019d410 con 0x7fd9c00ffac0 2023-03-02T10:56:10.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9c5bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c019d5a0 con 0x7fd9c0100d50 2023-03-02T10:56:10.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9bffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c0101700 0x7fd9c019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:10.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9bf7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c00ffac0 0x7fd9c0195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:10.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9bffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c0101700 0x7fd9c019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34732/0 (socket says 172.21.15.57:34732) 2023-03-02T10:56:10.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9bffff700 1 -- 172.21.15.57:0/980090401 learned_addr learned my addr 172.21.15.57:0/980090401 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:10.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.235+0000 7fd9beffd700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c0100d50 0x7fd9c0195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:10.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9bffff700 1 -- 172.21.15.57:0/980090401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c0100d50 msgr2=0x7fd9c0195c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9bffff700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c0100d50 0x7fd9c0195c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9bffff700 1 -- 172.21.15.57:0/980090401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c00ffac0 msgr2=0x7fd9c0195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9bffff700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c00ffac0 0x7fd9c0195750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9bffff700 1 -- 172.21.15.57:0/980090401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b00095f0 con 0x7fd9c0101700 2023-03-02T10:56:10.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9bf7fe700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c00ffac0 0x7fd9c0195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:10.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9bffff700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c0101700 0x7fd9c019cd00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8007ee0 tx=0x7fd9b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:10.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9bcff9700 1 -- 172.21.15.57:0/980090401 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8017070 con 0x7fd9c0101700 2023-03-02T10:56:10.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9bcff9700 1 -- 172.21.15.57:0/980090401 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9b800f040 con 0x7fd9c0101700 2023-03-02T10:56:10.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9c5bff700 1 -- 172.21.15.57:0/980090401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c010b420 con 0x7fd9c0101700 2023-03-02T10:56:10.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9bcff9700 1 -- 172.21.15.57:0/980090401 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8005740 con 0x7fd9c0101700 2023-03-02T10:56:10.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.236+0000 7fd9c5bff700 1 -- 172.21.15.57:0/980090401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c010b290 con 0x7fd9c0101700 2023-03-02T10:56:10.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.237+0000 7fd9c5bff700 1 -- 172.21.15.57:0/980090401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c01069f0 con 0x7fd9c0101700 2023-03-02T10:56:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.238+0000 7fd9bcff9700 1 -- 172.21.15.57:0/980090401 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fd9b800dc60 con 0x7fd9c0101700 2023-03-02T10:56:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.239+0000 7fd9bcff9700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9a809b3e0 0x7fd9a809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.239+0000 7fd9bcff9700 1 -- 172.21.15.57:0/980090401 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd9b80c4990 con 0x7fd9c0101700 2023-03-02T10:56:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.239+0000 7fd9bf7fe700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9a809b3e0 0x7fd9a809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.240+0000 7fd9bf7fe700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9a809b3e0 0x7fd9a809d890 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000b5c0 tx=0x7fd9b0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.243+0000 7fd9bcff9700 1 -- 172.21.15.57:0/980090401 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fd9b8090220 con 0x7fd9c0101700 2023-03-02T10:56:10.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.446+0000 7fd9c5bff700 1 -- 172.21.15.57:0/980090401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9c00611d0 con 0x7fd9c0101700 2023-03-02T10:56:10.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.446+0000 7fd9bcff9700 1 -- 172.21.15.57:0/980090401 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9b8093840 con 0x7fd9c0101700 2023-03-02T10:56:10.447 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-03-02T10:56:10.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 -- 172.21.15.57:0/980090401 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9a809b3e0 msgr2=0x7fd9a809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9a809b3e0 0x7fd9a809d890 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000b5c0 tx=0x7fd9b0005960 comp rx=0 tx=0).stop 2023-03-02T10:56:10.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 -- 172.21.15.57:0/980090401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c0101700 msgr2=0x7fd9c019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c0101700 0x7fd9c019cd00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8007ee0 tx=0x7fd9b800d3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 -- 172.21.15.57:0/980090401 shutdown_connections 2023-03-02T10:56:10.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fd9a809b3e0 0x7fd9a809d890 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9c0101700 0x7fd9c019cd00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9c00ffac0 0x7fd9c0195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 --2- 172.21.15.57:0/980090401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9c0100d50 0x7fd9c0195c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 -- 172.21.15.57:0/980090401 >> 172.21.15.57:0/980090401 conn(0x7fd9c00fb100 msgr2=0x7fd9c00fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:10.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 -- 172.21.15.57:0/980090401 shutdown_connections 2023-03-02T10:56:10.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.448+0000 7fd9c5bff700 1 -- 172.21.15.57:0/980090401 wait complete. 2023-03-02T10:56:10.465 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-02T10:56:10.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.622+0000 7fc0727ff700 1 -- 172.21.15.57:0/1275692514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06c101700 msgr2=0x7fc06c107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.622+0000 7fc0727ff700 1 --2- 172.21.15.57:0/1275692514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06c101700 0x7fc06c107fa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc064009990 tx=0x7fc064009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.622+0000 7fc0727ff700 1 -- 172.21.15.57:0/1275692514 shutdown_connections 2023-03-02T10:56:10.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.622+0000 7fc0727ff700 1 --2- 172.21.15.57:0/1275692514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06c101700 0x7fc06c107fa0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.622+0000 7fc0727ff700 1 --2- 172.21.15.57:0/1275692514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc06c0ffac0 0x7fc06c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.622+0000 7fc0727ff700 1 --2- 172.21.15.57:0/1275692514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc06c100d50 0x7fc06c1011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.622+0000 7fc0727ff700 1 -- 172.21.15.57:0/1275692514 >> 172.21.15.57:0/1275692514 conn(0x7fc06c0fb100 msgr2=0x7fc06c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:10.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.623+0000 7fc0727ff700 1 -- 172.21.15.57:0/1275692514 shutdown_connections 2023-03-02T10:56:10.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.623+0000 7fc0727ff700 1 -- 172.21.15.57:0/1275692514 wait complete. 2023-03-02T10:56:10.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.623+0000 7fc0727ff700 1 Processor -- start 2023-03-02T10:56:10.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.623+0000 7fc0727ff700 1 -- start start 2023-03-02T10:56:10.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc0727ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06c0ffac0 0x7fc06c1957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:10.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc0727ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc06c100d50 0x7fc06c195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:10.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc0727ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc06c101700 0x7fc06c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:10.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc0727ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c19d360 con 0x7fc06c0ffac0 2023-03-02T10:56:10.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc0727ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c19d4a0 con 0x7fc06c101700 2023-03-02T10:56:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc0727ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c19d630 con 0x7fc06c100d50 2023-03-02T10:56:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc06bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06c0ffac0 0x7fc06c1957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc06bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06c0ffac0 0x7fc06c1957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34740/0 (socket says 172.21.15.57:34740) 2023-03-02T10:56:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc06bfff700 1 -- 172.21.15.57:0/3808615251 learned_addr learned my addr 172.21.15.57:0/3808615251 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc0637fe700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc06c100d50 0x7fc06c195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc06bfff700 1 -- 172.21.15.57:0/3808615251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc06c100d50 msgr2=0x7fc06c195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc06bfff700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc06c100d50 0x7fc06c195d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc06bfff700 1 -- 172.21.15.57:0/3808615251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc06c101700 msgr2=0x7fc06c19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc070d9c700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc06c101700 0x7fc06c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc06bfff700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc06c101700 0x7fc06c19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc06bfff700 1 -- 172.21.15.57:0/3808615251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640095f0 con 0x7fc06c0ffac0 2023-03-02T10:56:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc06bfff700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06c0ffac0 0x7fc06c1957e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00d980 tx=0x7fc05c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc069ffb700 1 -- 172.21.15.57:0/3808615251 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c004220 con 0x7fc06c0ffac0 2023-03-02T10:56:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc0727ff700 1 -- 172.21.15.57:0/3808615251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c10b470 con 0x7fc06c0ffac0 2023-03-02T10:56:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.624+0000 7fc069ffb700 1 -- 172.21.15.57:0/3808615251 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc05c007640 con 0x7fc06c0ffac0 2023-03-02T10:56:10.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.625+0000 7fc069ffb700 1 -- 172.21.15.57:0/3808615251 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c005610 con 0x7fc06c0ffac0 2023-03-02T10:56:10.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.625+0000 7fc0727ff700 1 -- 172.21.15.57:0/3808615251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c10b2e0 con 0x7fc06c0ffac0 2023-03-02T10:56:10.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.625+0000 7fc0727ff700 1 -- 172.21.15.57:0/3808615251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c106a90 con 0x7fc06c0ffac0 2023-03-02T10:56:10.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.627+0000 7fc069ffb700 1 -- 172.21.15.57:0/3808615251 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fc05c021070 con 0x7fc06c0ffac0 2023-03-02T10:56:10.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.628+0000 7fc069ffb700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc05809b3e0 0x7fc05809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:10.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.628+0000 7fc069ffb700 1 -- 172.21.15.57:0/3808615251 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc05c0c5210 con 0x7fc06c0ffac0 2023-03-02T10:56:10.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.628+0000 7fc0637fe700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc05809b3e0 0x7fc05809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:10.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.629+0000 7fc0637fe700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc05809b3e0 0x7fc05809d890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc05400f540 tx=0x7fc05400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:10.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.631+0000 7fc069ffb700 1 -- 172.21.15.57:0/3808615251 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fc05c090b00 con 0x7fc06c0ffac0 2023-03-02T10:56:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:10 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2548107934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:10 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1055809918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:10 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/980090401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:10.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.842+0000 7fc0727ff700 1 -- 172.21.15.57:0/3808615251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc06c02cd50 con 0x7fc06c0ffac0 2023-03-02T10:56:10.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.842+0000 7fc069ffb700 1 -- 172.21.15.57:0/3808615251 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc05c016070 con 0x7fc06c0ffac0 2023-03-02T10:56:10.843 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-03-02T10:56:10.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.844+0000 7fc0727ff700 1 -- 172.21.15.57:0/3808615251 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc05809b3e0 msgr2=0x7fc05809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.844+0000 7fc0727ff700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc05809b3e0 0x7fc05809d890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc05400f540 tx=0x7fc05400b040 comp rx=0 tx=0).stop 2023-03-02T10:56:10.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.844+0000 7fc0727ff700 1 -- 172.21.15.57:0/3808615251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06c0ffac0 msgr2=0x7fc06c1957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:10.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.844+0000 7fc0727ff700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06c0ffac0 0x7fc06c1957e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00d980 tx=0x7fc05c00dc90 comp rx=0 tx=0).stop 2023-03-02T10:56:10.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.845+0000 7fc0727ff700 1 -- 172.21.15.57:0/3808615251 shutdown_connections 2023-03-02T10:56:10.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.845+0000 7fc0727ff700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc05809b3e0 0x7fc05809d890 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.845+0000 7fc0727ff700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc06c101700 0x7fc06c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.845+0000 7fc0727ff700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06c0ffac0 0x7fc06c1957e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.845+0000 7fc0727ff700 1 --2- 172.21.15.57:0/3808615251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc06c100d50 0x7fc06c195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:10.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.845+0000 7fc0727ff700 1 -- 172.21.15.57:0/3808615251 >> 172.21.15.57:0/3808615251 conn(0x7fc06c0fb100 msgr2=0x7fc06c0fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:10.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.845+0000 7fc0727ff700 1 -- 172.21.15.57:0/3808615251 shutdown_connections 2023-03-02T10:56:10.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:10.845+0000 7fc0727ff700 1 -- 172.21.15.57:0/3808615251 wait complete. 2023-03-02T10:56:10.860 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:10 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2548107934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:10.860 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:10 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1055809918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:10.860 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:10 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/980090401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:10.862 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:56:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:10 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2548107934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:10 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1055809918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:10 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/980090401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:11.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.019+0000 7f49ef7ff700 1 -- 172.21.15.57:0/210594774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e80683a0 msgr2=0x7f49e8102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.019+0000 7f49ef7ff700 1 --2- 172.21.15.57:0/210594774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e80683a0 0x7f49e8102640 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009990 tx=0x7f49e4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.020+0000 7f49ef7ff700 1 -- 172.21.15.57:0/210594774 shutdown_connections 2023-03-02T10:56:11.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.020+0000 7f49ef7ff700 1 --2- 172.21.15.57:0/210594774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e8105670 0x7f49e8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.020+0000 7f49ef7ff700 1 --2- 172.21.15.57:0/210594774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e80683a0 0x7f49e8102640 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.020+0000 7f49ef7ff700 1 --2- 172.21.15.57:0/210594774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8102b80 0x7f49e8104fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.020+0000 7f49ef7ff700 1 -- 172.21.15.57:0/210594774 >> 172.21.15.57:0/210594774 conn(0x7f49e80f9fd0 msgr2=0x7f49e80fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.020+0000 7f49ef7ff700 1 -- 172.21.15.57:0/210594774 shutdown_connections 2023-03-02T10:56:11.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.020+0000 7f49ef7ff700 1 -- 172.21.15.57:0/210594774 wait complete. 2023-03-02T10:56:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.020+0000 7f49ef7ff700 1 Processor -- start 2023-03-02T10:56:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.020+0000 7f49ef7ff700 1 -- start start 2023-03-02T10:56:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ef7ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e80683a0 0x7f49e8195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ef7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e8102b80 0x7f49e8195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ef7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8105670 0x7f49e819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ef7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e819d3c0 con 0x7f49e8102b80 2023-03-02T10:56:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ef7ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e819d500 con 0x7f49e80683a0 2023-03-02T10:56:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ef7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e819d690 con 0x7f49e8105670 2023-03-02T10:56:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ecd9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e8102b80 0x7f49e8195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ed59b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e80683a0 0x7f49e8195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ecd9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e8102b80 0x7f49e8195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34768/0 (socket says 172.21.15.57:34768) 2023-03-02T10:56:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ecd9a700 1 -- 172.21.15.57:0/2658565478 learned_addr learned my addr 172.21.15.57:0/2658565478 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49edd9c700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8105670 0x7f49e819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ecd9a700 1 -- 172.21.15.57:0/2658565478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8105670 msgr2=0x7f49e819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ecd9a700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8105670 0x7f49e819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ecd9a700 1 -- 172.21.15.57:0/2658565478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e80683a0 msgr2=0x7f49e8195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ecd9a700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e80683a0 0x7f49e8195840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ecd9a700 1 -- 172.21.15.57:0/2658565478 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40095f0 con 0x7f49e8102b80 2023-03-02T10:56:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.021+0000 7f49ecd9a700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e8102b80 0x7f49e8195d80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f49d800e9a0 tx=0x7f49d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.022+0000 7f49de7fc700 1 -- 172.21.15.57:0/2658565478 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8009790 con 0x7f49e8102b80 2023-03-02T10:56:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.022+0000 7f49de7fc700 1 -- 172.21.15.57:0/2658565478 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49d8010430 con 0x7f49e8102b80 2023-03-02T10:56:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.022+0000 7f49de7fc700 1 -- 172.21.15.57:0/2658565478 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8018680 con 0x7f49e8102b80 2023-03-02T10:56:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.022+0000 7f49ef7ff700 1 -- 172.21.15.57:0/2658565478 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e810b3f0 con 0x7f49e8102b80 2023-03-02T10:56:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.022+0000 7f49ef7ff700 1 -- 172.21.15.57:0/2658565478 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e810b260 con 0x7f49e8102b80 2023-03-02T10:56:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.023+0000 7f49ef7ff700 1 -- 172.21.15.57:0/2658565478 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e80fbb40 con 0x7f49e8102b80 2023-03-02T10:56:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.024+0000 7f49de7fc700 1 -- 172.21.15.57:0/2658565478 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f49d800c040 con 0x7f49e8102b80 2023-03-02T10:56:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.025+0000 7f49de7fc700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f49d409b3e0 0x7f49d409d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.025+0000 7f49de7fc700 1 -- 172.21.15.57:0/2658565478 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f49d8014070 con 0x7f49e8102b80 2023-03-02T10:56:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.025+0000 7f49ed59b700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f49d409b3e0 0x7f49d409d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.026+0000 7f49ed59b700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f49d409b3e0 0x7f49d409d890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f49e400b680 tx=0x7f49e4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.028+0000 7f49de7fc700 1 -- 172.21.15.57:0/2658565478 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f49d8090bf0 con 0x7f49e8102b80 2023-03-02T10:56:11.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.284+0000 7f49ef7ff700 1 -- 172.21.15.57:0/2658565478 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49e802cd50 con 0x7f49e8102b80 2023-03-02T10:56:11.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.285+0000 7f49de7fc700 1 -- 172.21.15.57:0/2658565478 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10828 (secure 0 0 0) 0x7f49d8026070 con 0x7f49e8102b80 2023-03-02T10:56:11.286 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:11.286 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-02T10:55:10.601054+0000","modified":"2023-03-02T10:55:17.554509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24520,"mds_2":24505,"mds_3":24493,"mds_4":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14634":{"gid":14634,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6841/3731858530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6840","nonce":3731858530},{"type":"v1","addr":"172.21.15.57:6841","nonce":3731858530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"e","rank":4,"incarnation":24,"state":"up:active","state_seq":9,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24505":{"gid":24505,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/316639764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":316639764},{"type":"v1","addr":"172.21.15.122:6839","nonce":316639764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-02T10:56:11.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.287+0000 7f49ef7ff700 1 -- 172.21.15.57:0/2658565478 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f49d409b3e0 msgr2=0x7f49d409d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.287+0000 7f49ef7ff700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f49d409b3e0 0x7f49d409d890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f49e400b680 tx=0x7f49e4005fd0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.287+0000 7f49ef7ff700 1 -- 172.21.15.57:0/2658565478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e8102b80 msgr2=0x7f49e8195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.287+0000 7f49ef7ff700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e8102b80 0x7f49e8195d80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f49d800e9a0 tx=0x7f49d800ecb0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.288+0000 7f49ef7ff700 1 -- 172.21.15.57:0/2658565478 shutdown_connections 2023-03-02T10:56:11.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.288+0000 7f49ef7ff700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f49d409b3e0 0x7f49d409d890 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.288+0000 7f49ef7ff700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8105670 0x7f49e819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.288+0000 7f49ef7ff700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49e80683a0 0x7f49e8195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.288+0000 7f49ef7ff700 1 --2- 172.21.15.57:0/2658565478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e8102b80 0x7f49e8195d80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.288+0000 7f49ef7ff700 1 -- 172.21.15.57:0/2658565478 >> 172.21.15.57:0/2658565478 conn(0x7f49e80f9fd0 msgr2=0x7f49e8100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.288+0000 7f49ef7ff700 1 -- 172.21.15.57:0/2658565478 shutdown_connections 2023-03-02T10:56:11.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.288+0000 7f49ef7ff700 1 -- 172.21.15.57:0/2658565478 wait complete. 2023-03-02T10:56:11.291 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-03-02T10:56:11.305 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-03-02T10:55:10.601054+0000', 'modified': '2023-03-02T10:55:17.554509+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24560, 'mds_1': 24520, 'mds_2': 24505, 'mds_3': 24493, 'mds_4': 24491}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'h', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6837/2380932917', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 2380932917}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 2380932917}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14622': {'gid': 14622, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.57:6839/1832653465', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6838', 'nonce': 1832653465}, {'type': 'v1', 'addr': '172.21.15.57:6839', 'nonce': 1832653465}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14634': {'gid': 14634, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.57:6841/3731858530', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6840', 'nonce': 3731858530}, {'type': 'v1', 'addr': '172.21.15.57:6841', 'nonce': 3731858530}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24451': {'gid': 24451, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6833/2838612280', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6832', 'nonce': 2838612280}, {'type': 'v1', 'addr': '172.21.15.136:6833', 'nonce': 2838612280}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24458': {'gid': 24458, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6833/953074371', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6832', 'nonce': 953074371}, {'type': 'v1', 'addr': '172.21.15.122:6833', 'nonce': 953074371}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24491': {'gid': 24491, 'name': 'e', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.122:6835/1841258715', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 1841258715}, {'type': 'v1', 'addr': '172.21.15.122:6835', 'nonce': 1841258715}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24493': {'gid': 24493, 'name': 'f', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.136:6835/2199127047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 2199127047}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 2199127047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24505': {'gid': 24505, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.136:6837/2130761226', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 2130761226}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 2130761226}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24520': {'gid': 24520, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.136:6839/1702113579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 1702113579}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 1702113579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6839/316639764', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 316639764}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 316639764}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-02T10:56:11.305 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-03-02T10:56:11.306 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-03-02T10:56:11.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.465+0000 7f08c27ff700 1 -- 172.21.15.57:0/3057794938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08bc1005d0 msgr2=0x7f08bc106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.465+0000 7f08c27ff700 1 --2- 172.21.15.57:0/3057794938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08bc1005d0 0x7f08bc106e70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f08b400b0a0 tx=0x7f08b400b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.465+0000 7f08c27ff700 1 -- 172.21.15.57:0/3057794938 shutdown_connections 2023-03-02T10:56:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.465+0000 7f08c27ff700 1 --2- 172.21.15.57:0/3057794938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08bc1005d0 0x7f08bc106e70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.465+0000 7f08c27ff700 1 --2- 172.21.15.57:0/3057794938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08bc0fe990 0x7f08bc0feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.465+0000 7f08c27ff700 1 --2- 172.21.15.57:0/3057794938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08bc0ffc20 0x7f08bc100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.466+0000 7f08c27ff700 1 -- 172.21.15.57:0/3057794938 >> 172.21.15.57:0/3057794938 conn(0x7f08bc0f9fd0 msgr2=0x7f08bc0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.466+0000 7f08c27ff700 1 -- 172.21.15.57:0/3057794938 shutdown_connections 2023-03-02T10:56:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.466+0000 7f08c27ff700 1 -- 172.21.15.57:0/3057794938 wait complete. 2023-03-02T10:56:11.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.466+0000 7f08c27ff700 1 Processor -- start 2023-03-02T10:56:11.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.466+0000 7f08c27ff700 1 -- start start 2023-03-02T10:56:11.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08c27ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08bc0fe990 0x7f08bc1029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08c27ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08bc0ffc20 0x7f08bc101000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08c27ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08bc1005d0 0x7f08bc101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08c27ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc101ce0 con 0x7f08bc0fe990 2023-03-02T10:56:11.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08c27ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc101e50 con 0x7f08bc0ffc20 2023-03-02T10:56:11.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08c27ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc19f9d0 con 0x7f08bc1005d0 2023-03-02T10:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08bc0fe990 0x7f08bc1029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08bc0fe990 0x7f08bc1029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34790/0 (socket says 172.21.15.57:34790) 2023-03-02T10:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08bbfff700 1 -- 172.21.15.57:0/4294434339 learned_addr learned my addr 172.21.15.57:0/4294434339 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08b37fe700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08bc0ffc20 0x7f08bc101000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08c0d9c700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08bc1005d0 0x7f08bc101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08bbfff700 1 -- 172.21.15.57:0/4294434339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08bc1005d0 msgr2=0x7f08bc101540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08bbfff700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08bc1005d0 0x7f08bc101540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08bbfff700 1 -- 172.21.15.57:0/4294434339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08bc0ffc20 msgr2=0x7f08bc101000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08bbfff700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08bc0ffc20 0x7f08bc101000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08bbfff700 1 -- 172.21.15.57:0/4294434339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b4009d00 con 0x7f08bc0fe990 2023-03-02T10:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08bbfff700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08bc0fe990 0x7f08bc1029c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00e9a0 tx=0x7f08ac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08b9ffb700 1 -- 172.21.15.57:0/4294434339 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac009790 con 0x7f08bc0fe990 2023-03-02T10:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08c27ff700 1 -- 172.21.15.57:0/4294434339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc10a370 con 0x7f08bc0fe990 2023-03-02T10:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08b9ffb700 1 -- 172.21.15.57:0/4294434339 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08ac010430 con 0x7f08bc0fe990 2023-03-02T10:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.467+0000 7f08b9ffb700 1 -- 172.21.15.57:0/4294434339 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac018680 con 0x7f08bc0fe990 2023-03-02T10:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.468+0000 7f08c27ff700 1 -- 172.21.15.57:0/4294434339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc10a1e0 con 0x7f08bc0fe990 2023-03-02T10:56:11.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.470+0000 7f08b9ffb700 1 -- 172.21.15.57:0/4294434339 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f08ac00c040 con 0x7f08bc0fe990 2023-03-02T10:56:11.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.472+0000 7f08b9ffb700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f08a809b3e0 0x7f08a809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.472+0000 7f08b37fe700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f08a809b3e0 0x7f08a809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.472+0000 7f08b9ffb700 1 -- 172.21.15.57:0/4294434339 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f08ac014070 con 0x7f08bc0fe990 2023-03-02T10:56:11.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.472+0000 7f08d6202b80 1 Processor -- start 2023-03-02T10:56:11.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.472+0000 7f08d6202b80 1 -- start start 2023-03-02T10:56:11.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.472+0000 7f08b37fe700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f08a809b3e0 0x7f08a809d890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009a10 tx=0x7f08a4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.472+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876da820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.472+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876db340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.472+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.472+0000 7f08d6202b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558587641a10 con 0x5585876db920 2023-03-02T10:56:11.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08d6202b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585875f3f30 con 0x5585876dad60 2023-03-02T10:56:11.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08d6202b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585875c4110 con 0x5585876da410 2023-03-02T10:56:11.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08bbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876da820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08b37fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876db340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08c0d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08bbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876da820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:60372/0 (socket says 172.21.15.57:60372) 2023-03-02T10:56:11.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08bbfff700 1 -- 172.21.15.57:0/978310499 learned_addr learned my addr 172.21.15.57:0/978310499 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08c0d9c700 1 -- 172.21.15.57:0/978310499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 msgr2=0x5585876da820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08c0d9c700 1 --2- 172.21.15.57:0/978310499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876da820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08c0d9c700 1 -- 172.21.15.57:0/978310499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 msgr2=0x5585876db340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08c0d9c700 1 --2- 172.21.15.57:0/978310499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876db340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08c0d9c700 1 -- 172.21.15.57:0/978310499 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585874ae5e0 con 0x5585876db920 2023-03-02T10:56:11.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08c0d9c700 1 --2- 172.21.15.57:0/978310499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876dbd90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009fd0 tx=0x7f08b4009410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b45ec908a707a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08b27fc700 1 -- 172.21.15.57:0/978310499 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400e040 con 0x5585876db920 2023-03-02T10:56:11.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.473+0000 7f08b27fc700 1 -- 172.21.15.57:0/978310499 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08b4009b80 con 0x5585876db920 2023-03-02T10:56:11.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.474+0000 7f08b27fc700 1 -- 172.21.15.57:0/978310499 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b401c6a0 con 0x5585876db920 2023-03-02T10:56:11.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.474+0000 7f08d6202b80 1 -- 172.21.15.57:0/978310499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 msgr2=0x5585876dbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.474+0000 7f08d6202b80 1 --2- 172.21.15.57:0/978310499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876dbd90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009fd0 tx=0x7f08b4009410 comp rx=0 tx=0).stop 2023-03-02T10:56:11.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.474+0000 7f08d6202b80 1 -- 172.21.15.57:0/978310499 shutdown_connections 2023-03-02T10:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.474+0000 7f08d6202b80 1 --2- 172.21.15.57:0/978310499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876dbd90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.474+0000 7f08d6202b80 1 --2- 172.21.15.57:0/978310499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876da820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.474+0000 7f08d6202b80 1 --2- 172.21.15.57:0/978310499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876db340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.474+0000 7f08d6202b80 1 -- 172.21.15.57:0/978310499 >> 172.21.15.57:0/978310499 conn(0x5585876cfc00 msgr2=0x5585876d4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.474+0000 7f08d6202b80 1 -- 172.21.15.57:0/978310499 shutdown_connections 2023-03-02T10:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.474+0000 7f08d6202b80 1 -- 172.21.15.57:0/978310499 wait complete. 2023-03-02T10:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08d6202b80 1 -- start start 2023-03-02T10:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08d6202b80 1 Processor -- start 2023-03-02T10:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876e43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876eb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08d6202b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558587632b70 con 0x5585876db920 2023-03-02T10:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08d6202b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858762c0a0 con 0x5585876dad60 2023-03-02T10:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08d6202b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585874b08d0 con 0x5585876da410 2023-03-02T10:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08d6202b80 10 client.0 _ll_register_callbacks cb 0x5585875d24d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:11.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08c0d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876eb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08bbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08c0d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876eb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34816/0 (socket says 172.21.15.57:34816) 2023-03-02T10:56:11.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08c0d9c700 1 -- 172.21.15.57:0/1152904010 learned_addr learned my addr 172.21.15.57:0/1152904010 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.475+0000 7f08b37fe700 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876e43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f08c0d9c700 1 -- 172.21.15.57:0/1152904010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 msgr2=0x5585876e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f08c0d9c700 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876e3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f08c0d9c700 1 -- 172.21.15.57:0/1152904010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 msgr2=0x5585876e43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f08c0d9c700 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876e43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f08c0d9c700 1 -- 172.21.15.57:0/1152904010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc1076e0 con 0x5585876db920 2023-03-02T10:56:11.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f08c0d9c700 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876eb430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f08b400b070 tx=0x7f08b4007980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d203c430a27eef6e server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f089b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:11.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f089b7fe700 1 -- 172.21.15.57:0/1152904010 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400e040 con 0x5585876db920 2023-03-02T10:56:11.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f089b7fe700 1 -- 172.21.15.57:0/1152904010 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f08b402d470 con 0x5585876db920 2023-03-02T10:56:11.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f08d6202b80 1 -- 172.21.15.57:0/1152904010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558587625120 con 0x5585876db920 2023-03-02T10:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f089b7fe700 1 -- 172.21.15.57:0/1152904010 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08b402d630 con 0x5585876db920 2023-03-02T10:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f08d6202b80 10 client.15003 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f08d6202b80 1 -- 172.21.15.57:0/1152904010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55858745ad90 con 0x5585876db920 2023-03-02T10:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.476+0000 7f089b7fe700 1 -- 172.21.15.57:0/1152904010 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558587625120 con 0x5585876db920 2023-03-02T10:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.477+0000 7f089b7fe700 1 -- 172.21.15.57:0/1152904010 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f08b4036070 con 0x5585876db920 2023-03-02T10:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.477+0000 7f08d6202b80 10 client.15003 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.477+0000 7f08d6202b80 10 client.15003 resolve_mds: resolved name 'e' to daemon mds.e 2023-03-02T10:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.477+0000 7f08d6202b80 20 client.15003 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:11.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.477+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x5585876eec80 0x5585876ee360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.477+0000 7f08d6202b80 4 client.15003 mds_command: new command op to 24491 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:11.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.477+0000 7f08d6202b80 1 -- 172.21.15.57:0/1152904010 --> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558587624e40 con 0x5585876eec80 2023-03-02T10:56:11.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.477+0000 7f08bbfff700 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x5585876eec80 0x5585876ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.478+0000 7f089b7fe700 10 client.15003 ms_handle_connect on v2:172.21.15.122:6834/1841258715 2023-03-02T10:56:11.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.478+0000 7f08bbfff700 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x5585876eec80 0x5585876ee360 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ac37464c10f5f3cf server_cookie=2fedc47386429859 in_seq=0 out_seq=0 2023-03-02T10:56:11.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.479+0000 7f089b7fe700 1 -- 172.21.15.57:0/1152904010 <== mds.4 v2:172.21.15.122:6834/1841258715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x558587624e40 con 0x5585876eec80 2023-03-02T10:56:11.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.479+0000 7f089b7fe700 10 client.15003 handle_command_reply: tid=0 2023-03-02T10:56:11.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.479+0000 7f08d6202b80 1 client.15003 shutdown 2023-03-02T10:56:11.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f08d6202b80 1 -- 172.21.15.57:0/1152904010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 msgr2=0x5585876eb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876eb430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f08b400b070 tx=0x7f08b4007980 comp rx=0 tx=0).stop 2023-03-02T10:56:11.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f08d6202b80 1 -- 172.21.15.57:0/1152904010 shutdown_connections 2023-03-02T10:56:11.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x5585876eec80 0x5585876ee360 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876eb430 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1152904010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876e43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f089b7fe700 0 client.15003 ms_handle_reset on v2:172.21.15.122:6834/1841258715 2023-03-02T10:56:11.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f08d6202b80 1 -- 172.21.15.57:0/1152904010 >> 172.21.15.57:0/1152904010 conn(0x5585876cfc00 msgr2=0x5585876d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f08d6202b80 1 -- 172.21.15.57:0/1152904010 shutdown_connections 2023-03-02T10:56:11.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f08d6202b80 1 -- 172.21.15.57:0/1152904010 wait complete. 2023-03-02T10:56:11.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.480+0000 7f08d6202b80 20 client.15003 trim_cache size 0 max 16384 2023-03-02T10:56:11.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.497+0000 7f08d6202b80 1 Processor -- start 2023-03-02T10:56:11.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.497+0000 7f08d6202b80 1 -- start start 2023-03-02T10:56:11.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876e1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876de890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08d6202b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558587624e70 con 0x5585876db920 2023-03-02T10:56:11.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08d6202b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558587625150 con 0x5585876dad60 2023-03-02T10:56:11.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08d6202b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x558587538ed0 con 0x5585876da410 2023-03-02T10:56:11.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08c0d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08c0d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876de890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34832/0 (socket says 172.21.15.57:34832) 2023-03-02T10:56:11.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08c0d9c700 1 -- 172.21.15.57:0/2534869284 learned_addr learned my addr 172.21.15.57:0/2534869284 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08b37fe700 1 --2- 172.21.15.57:0/2534869284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876e1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08bbfff700 1 --2- 172.21.15.57:0/2534869284 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08c0d9c700 1 -- 172.21.15.57:0/2534869284 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 msgr2=0x5585876e2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08c0d9c700 1 --2- 172.21.15.57:0/2534869284 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876e2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08c0d9c700 1 -- 172.21.15.57:0/2534869284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 msgr2=0x5585876e1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08c0d9c700 1 --2- 172.21.15.57:0/2534869284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876e1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08c0d9c700 1 -- 172.21.15.57:0/2534869284 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585875f3140 con 0x5585876db920 2023-03-02T10:56:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08c0d9c700 1 --2- 172.21.15.57:0/2534869284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876de890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f08b400b780 tx=0x7f08b4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2943eadaaed06049 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.498+0000 7f08b2ffd700 1 -- 172.21.15.57:0/2534869284 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400e040 con 0x5585876db920 2023-03-02T10:56:11.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08b2ffd700 1 -- 172.21.15.57:0/2534869284 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08b4033070 con 0x5585876db920 2023-03-02T10:56:11.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08b2ffd700 1 -- 172.21.15.57:0/2534869284 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b402db90 con 0x5585876db920 2023-03-02T10:56:11.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08d6202b80 1 -- 172.21.15.57:0/2534869284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 msgr2=0x5585876de890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08d6202b80 1 --2- 172.21.15.57:0/2534869284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876de890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f08b400b780 tx=0x7f08b4000f40 comp rx=0 tx=0).stop 2023-03-02T10:56:11.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08d6202b80 1 -- 172.21.15.57:0/2534869284 shutdown_connections 2023-03-02T10:56:11.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08d6202b80 1 --2- 172.21.15.57:0/2534869284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876db920 0x5585876de890 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08d6202b80 1 --2- 172.21.15.57:0/2534869284 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876da410 0x5585876e2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08d6202b80 1 --2- 172.21.15.57:0/2534869284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876dad60 0x5585876e1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08d6202b80 1 -- 172.21.15.57:0/2534869284 >> 172.21.15.57:0/2534869284 conn(0x5585876cfc00 msgr2=0x5585876d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08d6202b80 1 -- 172.21.15.57:0/2534869284 shutdown_connections 2023-03-02T10:56:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08d6202b80 1 -- 172.21.15.57:0/2534869284 wait complete. 2023-03-02T10:56:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.499+0000 7f08d6202b80 1 -- start start 2023-03-02T10:56:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08d6202b80 1 Processor -- start 2023-03-02T10:56:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876da410 0x5585876f4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876dad60 0x5585876f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08d6202b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876db920 0x5585877404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08d6202b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585876f53e0 con 0x5585876dad60 2023-03-02T10:56:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08d6202b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558587740a10 con 0x5585876da410 2023-03-02T10:56:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08d6202b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x558587740bd0 con 0x5585876db920 2023-03-02T10:56:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08d6202b80 10 client.0 _ll_register_callbacks cb 0x5585875d24d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08b37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876dad60 0x5585876f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08b37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876dad60 0x5585876f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34836/0 (socket says 172.21.15.57:34836) 2023-03-02T10:56:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08b37fe700 1 -- 172.21.15.57:0/1556997276 learned_addr learned my addr 172.21.15.57:0/1556997276 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08bbfff700 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876da410 0x5585876f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08c0d9c700 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876db920 0x5585877404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08b37fe700 1 -- 172.21.15.57:0/1556997276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876db920 msgr2=0x5585877404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08b37fe700 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876db920 0x5585877404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08b37fe700 1 -- 172.21.15.57:0/1556997276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876da410 msgr2=0x5585876f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08b37fe700 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876da410 0x5585876f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.500+0000 7f08b37fe700 1 -- 172.21.15.57:0/1556997276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55858745ad90 con 0x5585876dad60 2023-03-02T10:56:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f08b37fe700 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876dad60 0x5585876f4cd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f08a4015730 tx=0x7f08a4004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45432eb3e652a807 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f089b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f089b7fe700 1 -- 172.21.15.57:0/1556997276 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4013450 con 0x5585876dad60 2023-03-02T10:56:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f08d6202b80 1 -- 172.21.15.57:0/1556997276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585875fd760 con 0x5585876dad60 2023-03-02T10:56:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f089b7fe700 1 -- 172.21.15.57:0/1556997276 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f08a40135b0 con 0x5585876dad60 2023-03-02T10:56:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f089b7fe700 1 -- 172.21.15.57:0/1556997276 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08a4005a50 con 0x5585876dad60 2023-03-02T10:56:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f08d6202b80 10 client.15009 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f08d6202b80 1 -- 172.21.15.57:0/1556997276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558587481200 con 0x5585876dad60 2023-03-02T10:56:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f089b7fe700 1 -- 172.21.15.57:0/1556997276 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5585875fd760 con 0x5585876dad60 2023-03-02T10:56:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f089b7fe700 1 -- 172.21.15.57:0/1556997276 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f08a4006020 con 0x5585876dad60 2023-03-02T10:56:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f08d6202b80 10 client.15009 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f08d6202b80 10 client.15009 resolve_mds: resolved name 'e' to daemon mds.e 2023-03-02T10:56:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f08d6202b80 20 client.15009 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x558587745a90 0x558587742380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f08d6202b80 4 client.15009 mds_command: new command op to 24491 tid=0[{"prefix": "status"}] 2023-03-02T10:56:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.501+0000 7f08d6202b80 1 -- 172.21.15.57:0/1556997276 --> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5585874b0f10 con 0x558587745a90 2023-03-02T10:56:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f08bbfff700 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x558587745a90 0x558587742380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f08bbfff700 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x558587745a90 0x558587742380 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=28a45ed35c0a0efa server_cookie=240866beb701d6d3 in_seq=0 out_seq=0 2023-03-02T10:56:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f089b7fe700 10 client.15009 ms_handle_connect on v2:172.21.15.122:6834/1841258715 2023-03-02T10:56:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f089b7fe700 1 -- 172.21.15.57:0/1556997276 <== mds.4 v2:172.21.15.122:6834/1841258715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5585874b0f10 con 0x558587745a90 2023-03-02T10:56:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f089b7fe700 10 client.15009 handle_command_reply: tid=0 2023-03-02T10:56:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f08d6202b80 1 client.15009 shutdown 2023-03-02T10:56:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f08d6202b80 1 -- 172.21.15.57:0/1556997276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876dad60 msgr2=0x5585876f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876dad60 0x5585876f4cd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f08a4015730 tx=0x7f08a4004860 comp rx=0 tx=0).stop 2023-03-02T10:56:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f08d6202b80 1 -- 172.21.15.57:0/1556997276 shutdown_connections 2023-03-02T10:56:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x558587745a90 0x558587742380 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585876db920 0x5585877404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585876da410 0x5585876f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f08d6202b80 1 --2- 172.21.15.57:0/1556997276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5585876dad60 0x5585876f4cd0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.502+0000 7f089b7fe700 0 client.15009 ms_handle_reset on v2:172.21.15.122:6834/1841258715 2023-03-02T10:56:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08d6202b80 1 -- 172.21.15.57:0/1556997276 >> 172.21.15.57:0/1556997276 conn(0x5585876cfc00 msgr2=0x5585876e1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08d6202b80 1 -- 172.21.15.57:0/1556997276 shutdown_connections 2023-03-02T10:56:11.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08d6202b80 1 -- 172.21.15.57:0/1556997276 wait complete. 2023-03-02T10:56:11.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08d6202b80 20 client.15009 trim_cache size 0 max 16384 2023-03-02T10:56:11.513 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:56:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 4, 2023-03-02T10:56:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 24491, 2023-03-02T10:56:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-03-02T10:56:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-03-02T10:56:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-03-02T10:56:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 54.951796078000001, 2023-03-02T10:56:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 26, 2023-03-02T10:56:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 86, 2023-03-02T10:56:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 84, 2023-03-02T10:56:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 83.918263272999994 2023-03-02T10:56:11.515 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 -- 172.21.15.57:0/4294434339 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f08a809b3e0 msgr2=0x7f08a809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f08a809b3e0 0x7f08a809d890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009a10 tx=0x7f08a4009190 comp rx=0 tx=0).stop 2023-03-02T10:56:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 -- 172.21.15.57:0/4294434339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08bc0fe990 msgr2=0x7f08bc1029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08bc0fe990 0x7f08bc1029c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00e9a0 tx=0x7f08ac00ecb0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 -- 172.21.15.57:0/4294434339 shutdown_connections 2023-03-02T10:56:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f08a809b3e0 0x7f08a809d890 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08bc1005d0 0x7f08bc101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08bc0fe990 0x7f08bc1029c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 --2- 172.21.15.57:0/4294434339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08bc0ffc20 0x7f08bc101000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 -- 172.21.15.57:0/4294434339 >> 172.21.15.57:0/4294434339 conn(0x7f08bc0f9fd0 msgr2=0x7f08bc0676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 -- 172.21.15.57:0/4294434339 shutdown_connections 2023-03-02T10:56:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.503+0000 7f08c27ff700 1 -- 172.21.15.57:0/4294434339 wait complete. 2023-03-02T10:56:11.519 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-03-02T10:56:11.559 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:11 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:56:11.560 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:11 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3808615251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:11.560 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:11 smithi057 ceph-mon[92072]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:11.560 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:11 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2658565478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:11.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.680+0000 7f6e771ff700 1 -- 172.21.15.57:0/2143022883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e701005d0 msgr2=0x7f6e70106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.680+0000 7f6e771ff700 1 --2- 172.21.15.57:0/2143022883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e701005d0 0x7f6e70106e70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800b0a0 tx=0x7f6e6800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.680+0000 7f6e771ff700 1 -- 172.21.15.57:0/2143022883 shutdown_connections 2023-03-02T10:56:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.680+0000 7f6e771ff700 1 --2- 172.21.15.57:0/2143022883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e701005d0 0x7f6e70106e70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.680+0000 7f6e771ff700 1 --2- 172.21.15.57:0/2143022883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e700fe990 0x7f6e700feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.680+0000 7f6e771ff700 1 --2- 172.21.15.57:0/2143022883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e700ffc20 0x7f6e70100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.680+0000 7f6e771ff700 1 -- 172.21.15.57:0/2143022883 >> 172.21.15.57:0/2143022883 conn(0x7f6e700f9fd0 msgr2=0x7f6e700fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.680+0000 7f6e771ff700 1 -- 172.21.15.57:0/2143022883 shutdown_connections 2023-03-02T10:56:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.680+0000 7f6e771ff700 1 -- 172.21.15.57:0/2143022883 wait complete. 2023-03-02T10:56:11.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.681+0000 7f6e771ff700 1 Processor -- start 2023-03-02T10:56:11.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.681+0000 7f6e771ff700 1 -- start start 2023-03-02T10:56:11.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e771ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e700fe990 0x7f6e70194800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e771ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e700ffc20 0x7f6e70194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e771ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e701005d0 0x7f6e7019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e771ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7019c380 con 0x7f6e700fe990 2023-03-02T10:56:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e771ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7019c4c0 con 0x7f6e700ffc20 2023-03-02T10:56:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e771ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7019c650 con 0x7f6e701005d0 2023-03-02T10:56:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e74f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e700fe990 0x7f6e70194800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e74f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e700fe990 0x7f6e70194800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34856/0 (socket says 172.21.15.57:34856) 2023-03-02T10:56:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e74f9b700 1 -- 172.21.15.57:0/3535754871 learned_addr learned my addr 172.21.15.57:0/3535754871 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e700ffc20 0x7f6e70194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e74f9b700 1 -- 172.21.15.57:0/3535754871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e701005d0 msgr2=0x7f6e7019bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e7579c700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e701005d0 0x7f6e7019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e701005d0 0x7f6e7019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e74f9b700 1 -- 172.21.15.57:0/3535754871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e700ffc20 msgr2=0x7f6e70194d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e700ffc20 0x7f6e70194d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e74f9b700 1 -- 172.21.15.57:0/3535754871 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e64009520 con 0x7f6e700fe990 2023-03-02T10:56:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e700ffc20 0x7f6e70194d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.682+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e700fe990 0x7f6e70194800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400eb30 tx=0x7f6e6400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.683+0000 7f6e6dffb700 1 -- 172.21.15.57:0/3535754871 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64009880 con 0x7f6e700fe990 2023-03-02T10:56:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.683+0000 7f6e6dffb700 1 -- 172.21.15.57:0/3535754871 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e640044e0 con 0x7f6e700fe990 2023-03-02T10:56:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.683+0000 7f6e6dffb700 1 -- 172.21.15.57:0/3535754871 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64010430 con 0x7f6e700fe990 2023-03-02T10:56:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.683+0000 7f6e771ff700 1 -- 172.21.15.57:0/3535754871 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e68009d00 con 0x7f6e700fe990 2023-03-02T10:56:11.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.683+0000 7f6e771ff700 1 -- 172.21.15.57:0/3535754871 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7010a2f0 con 0x7f6e700fe990 2023-03-02T10:56:11.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.685+0000 7f6e6dffb700 1 -- 172.21.15.57:0/3535754871 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f6e6401e020 con 0x7f6e700fe990 2023-03-02T10:56:11.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.686+0000 7f6e6dffb700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6e6009b460 0x7f6e6009d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.686+0000 7f6e6dffb700 1 -- 172.21.15.57:0/3535754871 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6e64014070 con 0x7f6e700fe990 2023-03-02T10:56:11.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.686+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6e6009b460 0x7f6e6009d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e8ab1eb80 1 Processor -- start 2023-03-02T10:56:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e8ab1eb80 1 -- start start 2023-03-02T10:56:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6e6009b460 0x7f6e6009d910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009cb0 tx=0x7f6e5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 0x5574682d8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x5574682d9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55746823fa10 con 0x5574682d8d60 2023-03-02T10:56:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574681f1f30 con 0x5574682d9920 2023-03-02T10:56:11.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574681c2110 con 0x5574682d8410 2023-03-02T10:56:11.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34864/0 (socket says 172.21.15.57:34864) 2023-03-02T10:56:11.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e6ffff700 1 -- 172.21.15.57:0/2538302448 learned_addr learned my addr 172.21.15.57:0/2538302448 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/2538302448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 0x5574682d8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.687+0000 7f6e7579c700 1 --2- 172.21.15.57:0/2538302448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x5574682d9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.688+0000 7f6e6ffff700 1 -- 172.21.15.57:0/2538302448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 msgr2=0x5574682d8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.688+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/2538302448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 0x5574682d8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.688+0000 7f6e6ffff700 1 -- 172.21.15.57:0/2538302448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 msgr2=0x5574682d9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.688+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/2538302448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x5574682d9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.688+0000 7f6e6ffff700 1 -- 172.21.15.57:0/2538302448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574680ac5e0 con 0x5574682d8d60 2023-03-02T10:56:11.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.688+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/2538302448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 0x5574682d8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:11.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.688+0000 7f6e7579c700 1 --2- 172.21.15.57:0/2538302448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x5574682d9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:11.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.688+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/2538302448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d9340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c011fb0 tx=0x7f6e5c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6a1e79b0491044 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.688+0000 7f6e5affd700 1 -- 172.21.15.57:0/2538302448 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c003680 con 0x5574682d8d60 2023-03-02T10:56:11.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.688+0000 7f6e5affd700 1 -- 172.21.15.57:0/2538302448 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e5c003ca0 con 0x5574682d8d60 2023-03-02T10:56:11.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.688+0000 7f6e5affd700 1 -- 172.21.15.57:0/2538302448 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c012d30 con 0x5574682d8d60 2023-03-02T10:56:11.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.689+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2538302448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 msgr2=0x5574682d9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.689+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/2538302448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d9340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c011fb0 tx=0x7f6e5c014000 comp rx=0 tx=0).stop 2023-03-02T10:56:11.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.689+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2538302448 shutdown_connections 2023-03-02T10:56:11.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.689+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/2538302448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x5574682d9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.689+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/2538302448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 0x5574682d8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.689+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/2538302448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d9340 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.689+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2538302448 >> 172.21.15.57:0/2538302448 conn(0x5574682cdc00 msgr2=0x5574682d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.689+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2538302448 shutdown_connections 2023-03-02T10:56:11.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.689+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2538302448 wait complete. 2023-03-02T10:56:11.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.689+0000 7f6e8ab1eb80 1 -- start start 2023-03-02T10:56:11.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.689+0000 7f6e8ab1eb80 1 Processor -- start 2023-03-02T10:56:11.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d8410 0x5574682e4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682e4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d9920 0x5574682eb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x557468230b70 con 0x5574682d8d60 2023-03-02T10:56:11.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55746822a0a0 con 0x5574682d8410 2023-03-02T10:56:11.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574680ae8d0 con 0x5574682d9920 2023-03-02T10:56:11.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e8ab1eb80 10 client.0 _ll_register_callbacks cb 0x5574681d04d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:11.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682e4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34880/0 (socket says 172.21.15.57:34880) 2023-03-02T10:56:11.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e6ffff700 1 -- 172.21.15.57:0/1680761595 learned_addr learned my addr 172.21.15.57:0/1680761595 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d8410 0x5574682e4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e7579c700 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d9920 0x5574682eb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e6ffff700 1 -- 172.21.15.57:0/1680761595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d9920 msgr2=0x5574682eb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d9920 0x5574682eb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e6ffff700 1 -- 172.21.15.57:0/1680761595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d8410 msgr2=0x5574682e4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d8410 0x5574682e4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.690+0000 7f6e6ffff700 1 -- 172.21.15.57:0/1680761595 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c011c60 con 0x5574682d8d60 2023-03-02T10:56:11.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.691+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682e4790 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c011f80 tx=0x7f6e5c012680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37699fe5915b64fa server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.691+0000 7f6e4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:11.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.691+0000 7f6e4ffff700 1 -- 172.21.15.57:0/1680761595 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c003680 con 0x5574682d8d60 2023-03-02T10:56:11.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.691+0000 7f6e4ffff700 1 -- 172.21.15.57:0/1680761595 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6e5c018070 con 0x5574682d8d60 2023-03-02T10:56:11.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.691+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1680761595 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574681fb760 con 0x5574682d8d60 2023-03-02T10:56:11.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.691+0000 7f6e4ffff700 1 -- 172.21.15.57:0/1680761595 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e5c0037e0 con 0x5574682d8d60 2023-03-02T10:56:11.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.691+0000 7f6e8ab1eb80 10 client.15021 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:11.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.691+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1680761595 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557468058d90 con 0x5574682d8d60 2023-03-02T10:56:11.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.691+0000 7f6e4ffff700 1 -- 172.21.15.57:0/1680761595 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5574681fb760 con 0x5574682d8d60 2023-03-02T10:56:11.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.691+0000 7f6e4ffff700 1 -- 172.21.15.57:0/1680761595 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6e5c020ce0 con 0x5574682d8d60 2023-03-02T10:56:11.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.691+0000 7f6e8ab1eb80 10 client.15021 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:11.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.692+0000 7f6e8ab1eb80 10 client.15021 resolve_mds: resolved name 'f' to daemon mds.f 2023-03-02T10:56:11.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.692+0000 7f6e8ab1eb80 20 client.15021 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:11.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.692+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x5574682ef910 0x5574682ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.692+0000 7f6e8ab1eb80 4 client.15021 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:11.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.692+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1680761595 --> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557468223120 con 0x5574682ef910 2023-03-02T10:56:11.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.692+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x5574682ef910 0x5574682ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.692+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x5574682ef910 0x5574682ee7c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=924d34b2cc4b365b server_cookie=9554a9007cf6805d in_seq=0 out_seq=0 2023-03-02T10:56:11.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.692+0000 7f6e4ffff700 10 client.15021 ms_handle_connect on v2:172.21.15.136:6834/2199127047 2023-03-02T10:56:11.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e4ffff700 1 -- 172.21.15.57:0/1680761595 <== mds.3 v2:172.21.15.136:6834/2199127047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x557468223120 con 0x5574682ef910 2023-03-02T10:56:11.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e4ffff700 10 client.15021 handle_command_reply: tid=0 2023-03-02T10:56:11.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e8ab1eb80 1 client.15021 shutdown 2023-03-02T10:56:11.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1680761595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 msgr2=0x5574682e4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682e4790 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c011f80 tx=0x7f6e5c012680 comp rx=0 tx=0).stop 2023-03-02T10:56:11.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1680761595 shutdown_connections 2023-03-02T10:56:11.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x5574682ef910 0x5574682ee7c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d9920 0x5574682eb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d8410 0x5574682e4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e4ffff700 0 client.15021 ms_handle_reset on v2:172.21.15.136:6834/2199127047 2023-03-02T10:56:11.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/1680761595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682e4790 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1680761595 >> 172.21.15.57:0/1680761595 conn(0x5574682cdc00 msgr2=0x5574682d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1680761595 shutdown_connections 2023-03-02T10:56:11.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.693+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1680761595 wait complete. 2023-03-02T10:56:11.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.694+0000 7f6e8ab1eb80 20 client.15021 trim_cache size 0 max 16384 2023-03-02T10:56:11.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.711+0000 7f6e8ab1eb80 1 Processor -- start 2023-03-02T10:56:11.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.711+0000 7f6e8ab1eb80 1 -- start start 2023-03-02T10:56:11.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.711+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8410 0x5574682dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.711+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8d60 0x5574682dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.711+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x5574682e4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.711+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574681fb790 con 0x5574682d8410 2023-03-02T10:56:11.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.711+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x557468136f00 con 0x5574682d9920 2023-03-02T10:56:11.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.711+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574681c6f80 con 0x5574682d8d60 2023-03-02T10:56:11.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.711+0000 7f6e74f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8410 0x5574682dfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8d60 0x5574682dffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8d60 0x5574682dffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:60456/0 (socket says 172.21.15.57:60456) 2023-03-02T10:56:11.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e6ffff700 1 -- 172.21.15.57:0/1398198122 learned_addr learned my addr 172.21.15.57:0/1398198122 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e74f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8410 0x5574682dfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34884/0 (socket says 172.21.15.57:34884) 2023-03-02T10:56:11.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e7579c700 1 --2- 172.21.15.57:0/1398198122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x5574682e4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e6ffff700 1 -- 172.21.15.57:0/1398198122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 msgr2=0x5574682e4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/1398198122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x5574682e4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e6ffff700 1 -- 172.21.15.57:0/1398198122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8410 msgr2=0x5574682dfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/1398198122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8410 0x5574682dfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e6ffff700 1 -- 172.21.15.57:0/1398198122 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574681f1140 con 0x5574682d8d60 2023-03-02T10:56:11.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/1398198122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8d60 0x5574682dffc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c011a50 tx=0x7f6e5c003e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e3847b4c8f82309 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e5b7fe700 1 -- 172.21.15.57:0/1398198122 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c02c4d0 con 0x5574682d8d60 2023-03-02T10:56:11.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e5b7fe700 1 -- 172.21.15.57:0/1398198122 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e5c0126f0 con 0x5574682d8d60 2023-03-02T10:56:11.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.712+0000 7f6e5b7fe700 1 -- 172.21.15.57:0/1398198122 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c02cdc0 con 0x5574682d8d60 2023-03-02T10:56:11.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.713+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1398198122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8d60 msgr2=0x5574682dffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.713+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/1398198122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8d60 0x5574682dffc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c011a50 tx=0x7f6e5c003e80 comp rx=0 tx=0).stop 2023-03-02T10:56:11.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.713+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1398198122 shutdown_connections 2023-03-02T10:56:11.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.713+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/1398198122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x5574682e4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.713+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/1398198122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8410 0x5574682dfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.713+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/1398198122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8d60 0x5574682dffc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.713+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1398198122 >> 172.21.15.57:0/1398198122 conn(0x5574682cdc00 msgr2=0x5574682deaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.713+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1398198122 shutdown_connections 2023-03-02T10:56:11.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.713+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/1398198122 wait complete. 2023-03-02T10:56:11.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.713+0000 7f6e8ab1eb80 1 -- start start 2023-03-02T10:56:11.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e8ab1eb80 1 Processor -- start 2023-03-02T10:56:11.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 0x5574682d70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e8ab1eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x557468342f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x557468343490 con 0x5574682d8d60 2023-03-02T10:56:11.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574683435d0 con 0x5574682d9920 2023-03-02T10:56:11.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e8ab1eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x557468343790 con 0x5574682d8410 2023-03-02T10:56:11.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e8ab1eb80 10 client.0 _ll_register_callbacks cb 0x7f6e64005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:11.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34886/0 (socket says 172.21.15.57:34886) 2023-03-02T10:56:11.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e6ffff700 1 -- 172.21.15.57:0/2051039586 learned_addr learned my addr 172.21.15.57:0/2051039586 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 0x5574682d70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e7579c700 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x557468342f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e6ffff700 1 -- 172.21.15.57:0/2051039586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 msgr2=0x5574682d70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 0x5574682d70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e6ffff700 1 -- 172.21.15.57:0/2051039586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 msgr2=0x557468342f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x557468342f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.714+0000 7f6e6ffff700 1 -- 172.21.15.57:0/2051039586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557468058d90 con 0x5574682d8d60 2023-03-02T10:56:11.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.715+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 0x5574682d70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:11.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.715+0000 7f6e7579c700 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x557468342f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:56:11.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.715+0000 7f6e6ffff700 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d75f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00a010 tx=0x7f6e5c009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fa5c69cdaa62d1 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.715+0000 7f6e4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:11.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.715+0000 7f6e4ffff700 1 -- 172.21.15.57:0/2051039586 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c012d80 con 0x5574682d8d60 2023-03-02T10:56:11.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.715+0000 7f6e4ffff700 1 -- 172.21.15.57:0/2051039586 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6e5c018040 con 0x5574682d8d60 2023-03-02T10:56:11.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.715+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2051039586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e5c003ca0 con 0x5574682d8d60 2023-03-02T10:56:11.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.715+0000 7f6e4ffff700 1 -- 172.21.15.57:0/2051039586 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e5c02cb40 con 0x5574682d8d60 2023-03-02T10:56:11.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.715+0000 7f6e8ab1eb80 10 client.15027 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:11.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.715+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2051039586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55746807f200 con 0x5574682d8d60 2023-03-02T10:56:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.715+0000 7f6e4ffff700 1 -- 172.21.15.57:0/2051039586 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e5c003ca0 con 0x5574682d8d60 2023-03-02T10:56:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.716+0000 7f6e4ffff700 1 -- 172.21.15.57:0/2051039586 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6e5c052070 con 0x5574682d8d60 2023-03-02T10:56:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.716+0000 7f6e8ab1eb80 10 client.15027 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.716+0000 7f6e8ab1eb80 10 client.15027 resolve_mds: resolved name 'f' to daemon mds.f 2023-03-02T10:56:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.716+0000 7f6e8ab1eb80 20 client.15027 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.716+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x5574683480b0 0x557468344a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.716+0000 7f6e8ab1eb80 4 client.15027 mds_command: new command op to 24493 tid=0[{"prefix": "status"}] 2023-03-02T10:56:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.716+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2051039586 --> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557468222e40 con 0x5574683480b0 2023-03-02T10:56:11.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.716+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x5574683480b0 0x557468344a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.716+0000 7f6e74f9b700 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x5574683480b0 0x557468344a30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9d8450c5bd97185a server_cookie=b903bbd2e4340ef6 in_seq=0 out_seq=0 2023-03-02T10:56:11.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.716+0000 7f6e4ffff700 10 client.15027 ms_handle_connect on v2:172.21.15.136:6834/2199127047 2023-03-02T10:56:11.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e4ffff700 1 -- 172.21.15.57:0/2051039586 <== mds.3 v2:172.21.15.136:6834/2199127047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x557468222e40 con 0x5574683480b0 2023-03-02T10:56:11.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e4ffff700 10 client.15027 handle_command_reply: tid=0 2023-03-02T10:56:11.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 1 client.15027 shutdown 2023-03-02T10:56:11.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2051039586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 msgr2=0x5574682d75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d75f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00a010 tx=0x7f6e5c009370 comp rx=0 tx=0).stop 2023-03-02T10:56:11.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2051039586 shutdown_connections 2023-03-02T10:56:11.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x5574683480b0 0x557468344a30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5574682d9920 0x557468342f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5574682d8410 0x5574682d70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 1 --2- 172.21.15.57:0/2051039586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5574682d8d60 0x5574682d75f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e4ffff700 0 client.15027 ms_handle_reset on v2:172.21.15.136:6834/2199127047 2023-03-02T10:56:11.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2051039586 >> 172.21.15.57:0/2051039586 conn(0x5574682cdc00 msgr2=0x5574682dfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2051039586 shutdown_connections 2023-03-02T10:56:11.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 1 -- 172.21.15.57:0/2051039586 wait complete. 2023-03-02T10:56:11.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.717+0000 7f6e8ab1eb80 20 client.15027 trim_cache size 0 max 16384 2023-03-02T10:56:11.733 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:11.733 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:56:11.733 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 3, 2023-03-02T10:56:11.734 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 24493, 2023-03-02T10:56:11.734 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-03-02T10:56:11.734 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-03-02T10:56:11.734 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-03-02T10:56:11.734 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 56.180696644000001, 2023-03-02T10:56:11.734 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 26, 2023-03-02T10:56:11.735 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 86, 2023-03-02T10:56:11.735 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 84, 2023-03-02T10:56:11.735 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 81.985766905999995 2023-03-02T10:56:11.735 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:11.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 -- 172.21.15.57:0/3535754871 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6e6009b460 msgr2=0x7f6e6009d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6e6009b460 0x7f6e6009d910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009cb0 tx=0x7f6e5c009260 comp rx=0 tx=0).stop 2023-03-02T10:56:11.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 -- 172.21.15.57:0/3535754871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e700fe990 msgr2=0x7f6e70194800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e700fe990 0x7f6e70194800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400eb30 tx=0x7f6e6400eef0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 -- 172.21.15.57:0/3535754871 shutdown_connections 2023-03-02T10:56:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f6e6009b460 0x7f6e6009d910 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e701005d0 0x7f6e7019bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e700fe990 0x7f6e70194800 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 --2- 172.21.15.57:0/3535754871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e700ffc20 0x7f6e70194d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 -- 172.21.15.57:0/3535754871 >> 172.21.15.57:0/3535754871 conn(0x7f6e700f9fd0 msgr2=0x7f6e700fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 -- 172.21.15.57:0/3535754871 shutdown_connections 2023-03-02T10:56:11.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.718+0000 7f6e771ff700 1 -- 172.21.15.57:0/3535754871 wait complete. 2023-03-02T10:56:11.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-03-02T10:56:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:11 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:56:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:11 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3808615251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:11 smithi136 ceph-mon[125702]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:11 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2658565478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:11.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.937+0000 7ff610dff700 1 -- 172.21.15.57:0/2405557788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff60c102b60 msgr2=0x7ff60c104fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.937+0000 7ff610dff700 1 --2- 172.21.15.57:0/2405557788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff60c102b60 0x7ff60c104fe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff600009990 tx=0x7ff600009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.937+0000 7ff610dff700 1 -- 172.21.15.57:0/2405557788 shutdown_connections 2023-03-02T10:56:11.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.937+0000 7ff610dff700 1 --2- 172.21.15.57:0/2405557788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff60c105670 0x7ff60c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.937+0000 7ff610dff700 1 --2- 172.21.15.57:0/2405557788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c0683c0 0x7ff60c102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.937+0000 7ff610dff700 1 --2- 172.21.15.57:0/2405557788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff60c102b60 0x7ff60c104fe0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.937+0000 7ff610dff700 1 -- 172.21.15.57:0/2405557788 >> 172.21.15.57:0/2405557788 conn(0x7ff60c0f9fd0 msgr2=0x7ff60c0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.937+0000 7ff610dff700 1 -- 172.21.15.57:0/2405557788 shutdown_connections 2023-03-02T10:56:11.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.937+0000 7ff610dff700 1 -- 172.21.15.57:0/2405557788 wait complete. 2023-03-02T10:56:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff610dff700 1 Processor -- start 2023-03-02T10:56:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff610dff700 1 -- start start 2023-03-02T10:56:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff610dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff60c0683c0 0x7ff60c195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff610dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c102b60 0x7ff60c195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff610dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff60c105670 0x7ff60c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff610dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c19d3f0 con 0x7ff60c105670 2023-03-02T10:56:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff610dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c19d530 con 0x7ff60c102b60 2023-03-02T10:56:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff610dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c19d6c0 con 0x7ff60c0683c0 2023-03-02T10:56:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff60a59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff60c0683c0 0x7ff60c195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff60ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff60c105670 0x7ff60c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff609d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c102b60 0x7ff60c195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff60a59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff60c0683c0 0x7ff60c195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:60488/0 (socket says 172.21.15.57:60488) 2023-03-02T10:56:11.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.938+0000 7ff60a59c700 1 -- 172.21.15.57:0/336253150 learned_addr learned my addr 172.21.15.57:0/336253150 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff60a59c700 1 -- 172.21.15.57:0/336253150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c102b60 msgr2=0x7ff60c195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff60a59c700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c102b60 0x7ff60c195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff60a59c700 1 -- 172.21.15.57:0/336253150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff60c105670 msgr2=0x7ff60c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff60a59c700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff60c105670 0x7ff60c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff60a59c700 1 -- 172.21.15.57:0/336253150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc009520 con 0x7ff60c0683c0 2023-03-02T10:56:11.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff60ad9d700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff60c105670 0x7ff60c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:11.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff609d9b700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c102b60 0x7ff60c195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:11.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff60a59c700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff60c0683c0 0x7ff60c195870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00ea30 tx=0x7ff5fc00ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff5fb7fe700 1 -- 172.21.15.57:0/336253150 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00cbd0 con 0x7ff60c0683c0 2023-03-02T10:56:11.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff5fb7fe700 1 -- 172.21.15.57:0/336253150 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5fc00eed0 con 0x7ff60c0683c0 2023-03-02T10:56:11.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff610dff700 1 -- 172.21.15.57:0/336253150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6000095f0 con 0x7ff60c0683c0 2023-03-02T10:56:11.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff5fb7fe700 1 -- 172.21.15.57:0/336253150 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc003d20 con 0x7ff60c0683c0 2023-03-02T10:56:11.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.939+0000 7ff610dff700 1 -- 172.21.15.57:0/336253150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c10b460 con 0x7ff60c0683c0 2023-03-02T10:56:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.942+0000 7ff5fb7fe700 1 -- 172.21.15.57:0/336253150 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7ff5fc01e020 con 0x7ff60c0683c0 2023-03-02T10:56:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.943+0000 7ff5fb7fe700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff5f409b460 0x7ff5f409d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.943+0000 7ff5fb7fe700 1 -- 172.21.15.57:0/336253150 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff5fc014070 con 0x7ff60c0683c0 2023-03-02T10:56:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.943+0000 7ff609d9b700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff5f409b460 0x7ff5f409d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.943+0000 7ff624630b80 1 Processor -- start 2023-03-02T10:56:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.943+0000 7ff624630b80 1 -- start start 2023-03-02T10:56:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.943+0000 7ff609d9b700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff5f409b460 0x7ff5f409d910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff60000b2e0 tx=0x7ff600005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff624630b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 0x556bb8bfc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff624630b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfcd60 0x556bb8bfd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff624630b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8bfdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff624630b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb8b63a10 con 0x556bb8bfd920 2023-03-02T10:56:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff624630b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb8b15f30 con 0x556bb8bfc410 2023-03-02T10:56:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff624630b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb8ae6110 con 0x556bb8bfcd60 2023-03-02T10:56:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff60ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8bfdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff60a59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 0x556bb8bfc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff60ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8bfdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34910/0 (socket says 172.21.15.57:34910) 2023-03-02T10:56:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff60ad9d700 1 -- 172.21.15.57:0/456615245 learned_addr learned my addr 172.21.15.57:0/456615245 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff609d9b700 1 --2- 172.21.15.57:0/456615245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfcd60 0x556bb8bfd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff60a59c700 1 -- 172.21.15.57:0/456615245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfcd60 msgr2=0x556bb8bfd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff60a59c700 1 --2- 172.21.15.57:0/456615245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfcd60 0x556bb8bfd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff60a59c700 1 -- 172.21.15.57:0/456615245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 msgr2=0x556bb8bfdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff60a59c700 1 --2- 172.21.15.57:0/456615245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8bfdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff60a59c700 1 -- 172.21.15.57:0/456615245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bb89d05e0 con 0x556bb8bfc410 2023-03-02T10:56:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff60ad9d700 1 --2- 172.21.15.57:0/456615245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8bfdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.944+0000 7ff60a59c700 1 --2- 172.21.15.57:0/456615245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 0x556bb8bfc820 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc091220 tx=0x7ff5fc0946b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fab89d26f1df714 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff5f8ff9700 1 -- 172.21.15.57:0/456615245 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc09bed0 con 0x556bb8bfc410 2023-03-02T10:56:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff5f8ff9700 1 -- 172.21.15.57:0/456615245 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5fc0980b0 con 0x556bb8bfc410 2023-03-02T10:56:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff5f8ff9700 1 -- 172.21.15.57:0/456615245 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc094c70 con 0x556bb8bfc410 2023-03-02T10:56:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff624630b80 1 -- 172.21.15.57:0/456615245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 msgr2=0x556bb8bfc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff624630b80 1 --2- 172.21.15.57:0/456615245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 0x556bb8bfc820 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc091220 tx=0x7ff5fc0946b0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff624630b80 1 -- 172.21.15.57:0/456615245 shutdown_connections 2023-03-02T10:56:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff624630b80 1 --2- 172.21.15.57:0/456615245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8bfdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff624630b80 1 --2- 172.21.15.57:0/456615245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 0x556bb8bfc820 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff624630b80 1 --2- 172.21.15.57:0/456615245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfcd60 0x556bb8bfd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff624630b80 1 -- 172.21.15.57:0/456615245 >> 172.21.15.57:0/456615245 conn(0x556bb8bf1c00 msgr2=0x556bb8bf6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff624630b80 1 -- 172.21.15.57:0/456615245 shutdown_connections 2023-03-02T10:56:11.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.945+0000 7ff624630b80 1 -- 172.21.15.57:0/456615245 wait complete. 2023-03-02T10:56:11.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff624630b80 1 -- start start 2023-03-02T10:56:11.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff624630b80 1 Processor -- start 2023-03-02T10:56:11.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff624630b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 0x556bb8c05fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff624630b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfcd60 0x556bb8c064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff624630b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfd920 0x556bb8c0d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff624630b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb8b54b70 con 0x556bb8bfcd60 2023-03-02T10:56:11.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff624630b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb8b4e0a0 con 0x556bb8bfc410 2023-03-02T10:56:11.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff624630b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb89d28d0 con 0x556bb8bfd920 2023-03-02T10:56:11.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff624630b80 10 client.0 _ll_register_callbacks cb 0x556bb8af44d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:11.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff609d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfcd60 0x556bb8c064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff60a59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 0x556bb8c05fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff60a59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 0x556bb8c05fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:35308/0 (socket says 172.21.15.57:35308) 2023-03-02T10:56:11.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff60a59c700 1 -- 172.21.15.57:0/227984552 learned_addr learned my addr 172.21.15.57:0/227984552 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.946+0000 7ff60ad9d700 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfd920 0x556bb8c0d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff60a59c700 1 -- 172.21.15.57:0/227984552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfd920 msgr2=0x556bb8c0d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff60a59c700 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfd920 0x556bb8c0d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff60a59c700 1 -- 172.21.15.57:0/227984552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfcd60 msgr2=0x556bb8c064f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff60a59c700 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfcd60 0x556bb8c064f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff60a59c700 1 -- 172.21.15.57:0/227984552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c10b460 con 0x556bb8bfc410 2023-03-02T10:56:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:11 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:56:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:11 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3808615251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:11 smithi122 ceph-mon[125440]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:11.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:11 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2658565478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:11.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff60a59c700 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 0x556bb8c05fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc094970 tx=0x7ff5fc098220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63142a4b757a8a33 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff5f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:56:11.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/227984552 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc094c10 con 0x556bb8bfc410 2023-03-02T10:56:11.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/227984552 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff5fc09bed0 con 0x556bb8bfc410 2023-03-02T10:56:11.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff624630b80 1 -- 172.21.15.57:0/227984552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556bb8b1f760 con 0x556bb8bfc410 2023-03-02T10:56:11.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/227984552 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5fc09ba40 con 0x556bb8bfc410 2023-03-02T10:56:11.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff624630b80 10 client.24935 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:11.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff624630b80 1 -- 172.21.15.57:0/227984552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556bb897cd90 con 0x556bb8bfc410 2023-03-02T10:56:11.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/227984552 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556bb8b1f760 con 0x556bb8bfc410 2023-03-02T10:56:11.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/227984552 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff5fc095140 con 0x556bb8bfc410 2023-03-02T10:56:11.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.947+0000 7ff624630b80 10 client.24935 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:11.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.948+0000 7ff624630b80 10 client.24935 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-02T10:56:11.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.948+0000 7ff624630b80 20 client.24935 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:11.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.948+0000 7ff624630b80 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x556bb8c11320 0x556bb8c10460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.948+0000 7ff624630b80 4 client.24935 mds_command: new command op to 24505 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:11.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.948+0000 7ff624630b80 1 -- 172.21.15.57:0/227984552 --> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556bb8b47120 con 0x556bb8c11320 2023-03-02T10:56:11.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.948+0000 7ff609d9b700 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x556bb8c11320 0x556bb8c10460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.948+0000 7ff5f1ffb700 10 client.24935 ms_handle_connect on v2:172.21.15.136:6836/2130761226 2023-03-02T10:56:11.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.948+0000 7ff609d9b700 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x556bb8c11320 0x556bb8c10460 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=95ff19f26606fd00 server_cookie=ed49829435154050 in_seq=0 out_seq=0 2023-03-02T10:56:11.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/227984552 <== mds.2 v2:172.21.15.136:6836/2130761226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x556bb8b47120 con 0x556bb8c11320 2023-03-02T10:56:11.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff5f1ffb700 10 client.24935 handle_command_reply: tid=0 2023-03-02T10:56:11.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 1 client.24935 shutdown 2023-03-02T10:56:11.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 1 -- 172.21.15.57:0/227984552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 msgr2=0x556bb8c05fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 0x556bb8c05fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc094970 tx=0x7ff5fc098220 comp rx=0 tx=0).stop 2023-03-02T10:56:11.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 1 -- 172.21.15.57:0/227984552 shutdown_connections 2023-03-02T10:56:11.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x556bb8c11320 0x556bb8c10460 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfd920 0x556bb8c0d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfc410 0x556bb8c05fb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 1 --2- 172.21.15.57:0/227984552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfcd60 0x556bb8c064f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff5f1ffb700 0 client.24935 ms_handle_reset on v2:172.21.15.136:6836/2130761226 2023-03-02T10:56:11.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 1 -- 172.21.15.57:0/227984552 >> 172.21.15.57:0/227984552 conn(0x556bb8bf1c00 msgr2=0x556bb8bf6650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 1 -- 172.21.15.57:0/227984552 shutdown_connections 2023-03-02T10:56:11.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 1 -- 172.21.15.57:0/227984552 wait complete. 2023-03-02T10:56:11.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.949+0000 7ff624630b80 20 client.24935 trim_cache size 0 max 16384 2023-03-02T10:56:11.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff624630b80 1 Processor -- start 2023-03-02T10:56:11.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff624630b80 1 -- start start 2023-03-02T10:56:11.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff624630b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfc410 0x556bb8c03d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff624630b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 0x556bb8c008a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff624630b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfd920 0x556bb8c00de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff624630b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb8b54b70 con 0x556bb8bfc410 2023-03-02T10:56:11.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff624630b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb8c0f1a0 con 0x556bb8bfcd60 2023-03-02T10:56:11.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff624630b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb8bf3c80 con 0x556bb8bfd920 2023-03-02T10:56:11.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff60a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfc410 0x556bb8c03d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff60a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfc410 0x556bb8c03d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34924/0 (socket says 172.21.15.57:34924) 2023-03-02T10:56:11.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff60a59c700 1 -- 172.21.15.57:0/3747547130 learned_addr learned my addr 172.21.15.57:0/3747547130 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff609d9b700 1 --2- 172.21.15.57:0/3747547130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 0x556bb8c008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff60ad9d700 1 --2- 172.21.15.57:0/3747547130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfd920 0x556bb8c00de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff60a59c700 1 -- 172.21.15.57:0/3747547130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfd920 msgr2=0x556bb8c00de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff60a59c700 1 --2- 172.21.15.57:0/3747547130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfd920 0x556bb8c00de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff60a59c700 1 -- 172.21.15.57:0/3747547130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 msgr2=0x556bb8c008a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff60a59c700 1 --2- 172.21.15.57:0/3747547130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 0x556bb8c008a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff60a59c700 1 -- 172.21.15.57:0/3747547130 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bb8b15140 con 0x556bb8bfc410 2023-03-02T10:56:11.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.967+0000 7ff609d9b700 1 --2- 172.21.15.57:0/3747547130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 0x556bb8c008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:11.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff60a59c700 1 --2- 172.21.15.57:0/3747547130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfc410 0x556bb8c03d40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc000c00 tx=0x7ff5fc092d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4d307b2c1fa85f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff5f97fa700 1 -- 172.21.15.57:0/3747547130 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc09bed0 con 0x556bb8bfc410 2023-03-02T10:56:11.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff5f97fa700 1 -- 172.21.15.57:0/3747547130 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5fc01fde0 con 0x556bb8bfc410 2023-03-02T10:56:11.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff5f97fa700 1 -- 172.21.15.57:0/3747547130 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc094c70 con 0x556bb8bfc410 2023-03-02T10:56:11.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff624630b80 1 -- 172.21.15.57:0/3747547130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfc410 msgr2=0x556bb8c03d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff624630b80 1 --2- 172.21.15.57:0/3747547130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfc410 0x556bb8c03d40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc000c00 tx=0x7ff5fc092d60 comp rx=0 tx=0).stop 2023-03-02T10:56:11.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff624630b80 1 -- 172.21.15.57:0/3747547130 shutdown_connections 2023-03-02T10:56:11.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff624630b80 1 --2- 172.21.15.57:0/3747547130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfd920 0x556bb8c00de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff624630b80 1 --2- 172.21.15.57:0/3747547130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfc410 0x556bb8c03d40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff624630b80 1 --2- 172.21.15.57:0/3747547130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 0x556bb8c008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff624630b80 1 -- 172.21.15.57:0/3747547130 >> 172.21.15.57:0/3747547130 conn(0x556bb8bf1c00 msgr2=0x556bb8c04c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff624630b80 1 -- 172.21.15.57:0/3747547130 shutdown_connections 2023-03-02T10:56:11.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.968+0000 7ff624630b80 1 -- 172.21.15.57:0/3747547130 wait complete. 2023-03-02T10:56:11.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff624630b80 1 -- start start 2023-03-02T10:56:11.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff624630b80 1 Processor -- start 2023-03-02T10:56:11.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff624630b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfc410 0x556bb8c5f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff624630b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 0x556bb8c5fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff624630b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8c666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff624630b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb8c66be0 con 0x556bb8bfd920 2023-03-02T10:56:11.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff624630b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb8c66d50 con 0x556bb8bfcd60 2023-03-02T10:56:11.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff624630b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb8c66f10 con 0x556bb8bfc410 2023-03-02T10:56:11.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff624630b80 10 client.0 _ll_register_callbacks cb 0x556bb8af44d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:11.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff609d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 0x556bb8c5fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff60a59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfc410 0x556bb8c5f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff60ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8c666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff60a59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfc410 0x556bb8c5f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:60524/0 (socket says 172.21.15.57:60524) 2023-03-02T10:56:11.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff60a59c700 1 -- 172.21.15.57:0/581199794 learned_addr learned my addr 172.21.15.57:0/581199794 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.969+0000 7ff60ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8c666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34930/0 (socket says 172.21.15.57:34930) 2023-03-02T10:56:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff60ad9d700 1 -- 172.21.15.57:0/581199794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfc410 msgr2=0x556bb8c5f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff60ad9d700 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfc410 0x556bb8c5f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff60ad9d700 1 -- 172.21.15.57:0/581199794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 msgr2=0x556bb8c5fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff60ad9d700 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 0x556bb8c5fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff60ad9d700 1 -- 172.21.15.57:0/581199794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bb897cd90 con 0x556bb8bfd920 2023-03-02T10:56:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff609d9b700 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 0x556bb8c5fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff60ad9d700 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8c666a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x556bb8c06d10 tx=0x7ff604007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c898e7a83ac2d6c server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:11.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff5f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:11.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/581199794 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60401c070 con 0x556bb8bfd920 2023-03-02T10:56:11.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff624630b80 1 -- 172.21.15.57:0/581199794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5fc0980b0 con 0x556bb8bfd920 2023-03-02T10:56:11.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/581199794 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff60400ebe0 con 0x556bb8bfd920 2023-03-02T10:56:11.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/581199794 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff60400eda0 con 0x556bb8bfd920 2023-03-02T10:56:11.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff624630b80 10 client.15045 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:11.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.970+0000 7ff624630b80 1 -- 172.21.15.57:0/581199794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556bb89a3200 con 0x556bb8bfd920 2023-03-02T10:56:11.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.971+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/581199794 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5fc0980b0 con 0x556bb8bfd920 2023-03-02T10:56:11.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.971+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/581199794 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff604016400 con 0x556bb8bfd920 2023-03-02T10:56:11.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.971+0000 7ff624630b80 10 client.15045 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:11.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.971+0000 7ff624630b80 10 client.15045 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-02T10:56:11.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.971+0000 7ff624630b80 20 client.15045 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:11.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.971+0000 7ff624630b80 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x556bb8c6bd10 0x556bb8c68680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:11.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.971+0000 7ff624630b80 4 client.15045 mds_command: new command op to 24505 tid=0[{"prefix": "status"}] 2023-03-02T10:56:11.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.971+0000 7ff624630b80 1 -- 172.21.15.57:0/581199794 --> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556bb8b46e40 con 0x556bb8c6bd10 2023-03-02T10:56:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.971+0000 7ff60a59c700 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x556bb8c6bd10 0x556bb8c68680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.971+0000 7ff5f1ffb700 10 client.15045 ms_handle_connect on v2:172.21.15.136:6836/2130761226 2023-03-02T10:56:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.971+0000 7ff60a59c700 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x556bb8c6bd10 0x556bb8c68680 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2cdae3f179eb299e server_cookie=e614f790bcc23f69 in_seq=0 out_seq=0 2023-03-02T10:56:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff5f1ffb700 1 -- 172.21.15.57:0/581199794 <== mds.2 v2:172.21.15.136:6836/2130761226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x556bb8b46e40 con 0x556bb8c6bd10 2023-03-02T10:56:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff5f1ffb700 10 client.15045 handle_command_reply: tid=0 2023-03-02T10:56:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 1 client.15045 shutdown 2023-03-02T10:56:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 1 -- 172.21.15.57:0/581199794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 msgr2=0x556bb8c666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8c666a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x556bb8c06d10 tx=0x7ff604007eb0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 1 -- 172.21.15.57:0/581199794 shutdown_connections 2023-03-02T10:56:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x556bb8c6bd10 0x556bb8c68680 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556bb8bfd920 0x556bb8c666a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556bb8bfc410 0x556bb8c5f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 1 --2- 172.21.15.57:0/581199794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bb8bfcd60 0x556bb8c5fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff5f1ffb700 0 client.15045 ms_handle_reset on v2:172.21.15.136:6836/2130761226 2023-03-02T10:56:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 1 -- 172.21.15.57:0/581199794 >> 172.21.15.57:0/581199794 conn(0x556bb8bf1c00 msgr2=0x556bb8c03d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 1 -- 172.21.15.57:0/581199794 shutdown_connections 2023-03-02T10:56:11.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 1 -- 172.21.15.57:0/581199794 wait complete. 2023-03-02T10:56:11.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff624630b80 20 client.15045 trim_cache size 0 max 16384 2023-03-02T10:56:11.983 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:11.983 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:56:11.983 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 2, 2023-03-02T10:56:11.984 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 24505, 2023-03-02T10:56:11.984 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-03-02T10:56:11.984 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-03-02T10:56:11.984 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-03-02T10:56:11.984 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 57.443106098000001, 2023-03-02T10:56:11.984 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 26, 2023-03-02T10:56:11.984 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 86, 2023-03-02T10:56:11.985 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 84, 2023-03-02T10:56:11.985 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 80.107474293999999 2023-03-02T10:56:11.985 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:11.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff610dff700 1 -- 172.21.15.57:0/336253150 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff5f409b460 msgr2=0x7ff5f409d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff610dff700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff5f409b460 0x7ff5f409d910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff60000b2e0 tx=0x7ff600005fb0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff610dff700 1 -- 172.21.15.57:0/336253150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff60c0683c0 msgr2=0x7ff60c195870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.972+0000 7ff610dff700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff60c0683c0 0x7ff60c195870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00ea30 tx=0x7ff5fc00ed40 comp rx=0 tx=0).stop 2023-03-02T10:56:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.973+0000 7ff610dff700 1 -- 172.21.15.57:0/336253150 shutdown_connections 2023-03-02T10:56:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.973+0000 7ff610dff700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff5f409b460 0x7ff5f409d910 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.973+0000 7ff610dff700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff60c105670 0x7ff60c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.973+0000 7ff610dff700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff60c0683c0 0x7ff60c195870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.973+0000 7ff610dff700 1 --2- 172.21.15.57:0/336253150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c102b60 0x7ff60c195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:11.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.973+0000 7ff610dff700 1 -- 172.21.15.57:0/336253150 >> 172.21.15.57:0/336253150 conn(0x7ff60c0f9fd0 msgr2=0x7ff60c100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:11.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.973+0000 7ff610dff700 1 -- 172.21.15.57:0/336253150 shutdown_connections 2023-03-02T10:56:11.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:11.973+0000 7ff610dff700 1 -- 172.21.15.57:0/336253150 wait complete. 2023-03-02T10:56:11.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-03-02T10:56:12.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.148+0000 7fcec69ff700 1 -- 172.21.15.57:0/2287366424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcec00ffc20 msgr2=0x7fcec0100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.148+0000 7fcec69ff700 1 --2- 172.21.15.57:0/2287366424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcec00ffc20 0x7fcec0100090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009990 tx=0x7fceb4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.148+0000 7fcec69ff700 1 -- 172.21.15.57:0/2287366424 shutdown_connections 2023-03-02T10:56:12.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.148+0000 7fcec69ff700 1 --2- 172.21.15.57:0/2287366424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec01005d0 0x7fcec0106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.148+0000 7fcec69ff700 1 --2- 172.21.15.57:0/2287366424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec00fe990 0x7fcec00feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.148+0000 7fcec69ff700 1 --2- 172.21.15.57:0/2287366424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcec00ffc20 0x7fcec0100090 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.148+0000 7fcec69ff700 1 -- 172.21.15.57:0/2287366424 >> 172.21.15.57:0/2287366424 conn(0x7fcec00f9fd0 msgr2=0x7fcec00fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.148+0000 7fcec69ff700 1 -- 172.21.15.57:0/2287366424 shutdown_connections 2023-03-02T10:56:12.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.148+0000 7fcec69ff700 1 -- 172.21.15.57:0/2287366424 wait complete. 2023-03-02T10:56:12.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.149+0000 7fcec69ff700 1 Processor -- start 2023-03-02T10:56:12.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.149+0000 7fcec69ff700 1 -- start start 2023-03-02T10:56:12.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcec69ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec00fe990 0x7fcec0195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcec69ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcec00ffc20 0x7fcec0195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcec69ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec01005d0 0x7fcec019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcec69ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec019d2d0 con 0x7fcec00ffc20 2023-03-02T10:56:12.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcec69ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec019d410 con 0x7fcec01005d0 2023-03-02T10:56:12.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcec69ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec019d5a0 con 0x7fcec00fe990 2023-03-02T10:56:12.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcebf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcec00ffc20 0x7fcec0195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcebf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcec00ffc20 0x7fcec0195c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34948/0 (socket says 172.21.15.57:34948) 2023-03-02T10:56:12.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcebf7fe700 1 -- 172.21.15.57:0/442696185 learned_addr learned my addr 172.21.15.57:0/442696185 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:12.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcec4f9c700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec01005d0 0x7fcec019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcebffff700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec00fe990 0x7fcec0195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcebf7fe700 1 -- 172.21.15.57:0/442696185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec00fe990 msgr2=0x7fcec0195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec00fe990 0x7fcec0195750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcebf7fe700 1 -- 172.21.15.57:0/442696185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec01005d0 msgr2=0x7fcec019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec01005d0 0x7fcec019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcebf7fe700 1 -- 172.21.15.57:0/442696185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb40095f0 con 0x7fcec00ffc20 2023-03-02T10:56:12.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.150+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcec00ffc20 0x7fcec0195c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fceb40059d0 tx=0x7fceb40047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.151+0000 7fcebd7fa700 1 -- 172.21.15.57:0/442696185 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb401d070 con 0x7fcec00ffc20 2023-03-02T10:56:12.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.151+0000 7fcec69ff700 1 -- 172.21.15.57:0/442696185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec010b4a0 con 0x7fcec00ffc20 2023-03-02T10:56:12.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.151+0000 7fcebd7fa700 1 -- 172.21.15.57:0/442696185 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fceb400fb90 con 0x7fcec00ffc20 2023-03-02T10:56:12.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.151+0000 7fcebd7fa700 1 -- 172.21.15.57:0/442696185 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4017650 con 0x7fcec00ffc20 2023-03-02T10:56:12.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.151+0000 7fcec69ff700 1 -- 172.21.15.57:0/442696185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec010b310 con 0x7fcec00ffc20 2023-03-02T10:56:12.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.153+0000 7fcebd7fa700 1 -- 172.21.15.57:0/442696185 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7fceb4029030 con 0x7fcec00ffc20 2023-03-02T10:56:12.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.154+0000 7fcebd7fa700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcea809b3e0 0x7fcea809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.155+0000 7fcebd7fa700 1 -- 172.21.15.57:0/442696185 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fceb40c65d0 con 0x7fcec00ffc20 2023-03-02T10:56:12.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.155+0000 7fcebffff700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcea809b3e0 0x7fcea809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.155+0000 7fcebffff700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcea809b3e0 0x7fcea809d890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009c60 tx=0x7fceb0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.156+0000 7fceda410b80 1 Processor -- start 2023-03-02T10:56:12.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.156+0000 7fceda410b80 1 -- start start 2023-03-02T10:56:12.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fceda410b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506bd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fceda410b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506bdd60 0x556e506be340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fceda410b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506be920 0x556e506bed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fceda410b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e50624a10 con 0x556e506bd410 2023-03-02T10:56:12.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fceda410b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e505d6f30 con 0x556e506be920 2023-03-02T10:56:12.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fceda410b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e505a7110 con 0x556e506bdd60 2023-03-02T10:56:12.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fcebffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506bd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fcebffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506bd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34964/0 (socket says 172.21.15.57:34964) 2023-03-02T10:56:12.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fcebffff700 1 -- 172.21.15.57:0/4097389263 learned_addr learned my addr 172.21.15.57:0/4097389263 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:12.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/4097389263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506bdd60 0x556e506be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fcec4f9c700 1 --2- 172.21.15.57:0/4097389263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506be920 0x556e506bed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fcebffff700 1 -- 172.21.15.57:0/4097389263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506bdd60 msgr2=0x556e506be340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fcebffff700 1 --2- 172.21.15.57:0/4097389263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506bdd60 0x556e506be340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fcebffff700 1 -- 172.21.15.57:0/4097389263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506be920 msgr2=0x556e506bed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fcebffff700 1 --2- 172.21.15.57:0/4097389263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506be920 0x556e506bed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fcebffff700 1 -- 172.21.15.57:0/4097389263 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e504915e0 con 0x556e506bd410 2023-03-02T10:56:12.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.157+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/4097389263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506bdd60 0x556e506be340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:12.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.158+0000 7fcebffff700 1 --2- 172.21.15.57:0/4097389263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506bd820 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fceb000e4e0 tx=0x7fceb0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17169bbbbe3a91ae server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.158+0000 7fcea67fc700 1 -- 172.21.15.57:0/4097389263 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000ee00 con 0x556e506bd410 2023-03-02T10:56:12.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.158+0000 7fcea67fc700 1 -- 172.21.15.57:0/4097389263 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fceb0021070 con 0x556e506bd410 2023-03-02T10:56:12.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.158+0000 7fcea67fc700 1 -- 172.21.15.57:0/4097389263 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb001d7b0 con 0x556e506bd410 2023-03-02T10:56:12.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.159+0000 7fceda410b80 1 -- 172.21.15.57:0/4097389263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 msgr2=0x556e506bd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.159+0000 7fceda410b80 1 --2- 172.21.15.57:0/4097389263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506bd820 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fceb000e4e0 tx=0x7fceb0014000 comp rx=0 tx=0).stop 2023-03-02T10:56:12.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.159+0000 7fceda410b80 1 -- 172.21.15.57:0/4097389263 shutdown_connections 2023-03-02T10:56:12.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.159+0000 7fceda410b80 1 --2- 172.21.15.57:0/4097389263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506be920 0x556e506bed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.159+0000 7fceda410b80 1 --2- 172.21.15.57:0/4097389263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506bd820 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.159+0000 7fceda410b80 1 --2- 172.21.15.57:0/4097389263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506bdd60 0x556e506be340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.159+0000 7fceda410b80 1 -- 172.21.15.57:0/4097389263 >> 172.21.15.57:0/4097389263 conn(0x556e506b2c00 msgr2=0x556e506b7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.159+0000 7fceda410b80 1 -- 172.21.15.57:0/4097389263 shutdown_connections 2023-03-02T10:56:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.159+0000 7fceda410b80 1 -- 172.21.15.57:0/4097389263 wait complete. 2023-03-02T10:56:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.159+0000 7fceda410b80 1 -- start start 2023-03-02T10:56:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.159+0000 7fceda410b80 1 Processor -- start 2023-03-02T10:56:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fceda410b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fceda410b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506bdd60 0x556e506c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fceda410b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506be920 0x556e506ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fceda410b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e50615b70 con 0x556e506bd410 2023-03-02T10:56:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fceda410b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e5060f0a0 con 0x556e506be920 2023-03-02T10:56:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fceda410b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e504938d0 con 0x556e506bdd60 2023-03-02T10:56:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fceda410b80 10 client.0 _ll_register_callbacks cb 0x556e505b54d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fcebffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fcebffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34980/0 (socket says 172.21.15.57:34980) 2023-03-02T10:56:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fcebffff700 1 -- 172.21.15.57:0/1442102962 learned_addr learned my addr 172.21.15.57:0/1442102962 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fcec4f9c700 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506be920 0x556e506ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506bdd60 0x556e506c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fcebffff700 1 -- 172.21.15.57:0/1442102962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506bdd60 msgr2=0x556e506c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fcebffff700 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506bdd60 0x556e506c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fcebffff700 1 -- 172.21.15.57:0/1442102962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506be920 msgr2=0x556e506ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fcebffff700 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506be920 0x556e506ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.160+0000 7fcebffff700 1 -- 172.21.15.57:0/1442102962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb0017070 con 0x556e506bd410 2023-03-02T10:56:12.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.161+0000 7fcebffff700 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c6f30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fceb000e4b0 tx=0x7fceb000edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c15ed8a96f9097 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.161+0000 7fce9f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:12.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.161+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1442102962 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0005250 con 0x556e506bd410 2023-03-02T10:56:12.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.161+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1442102962 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fceb00053b0 con 0x556e506bd410 2023-03-02T10:56:12.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.161+0000 7fceda410b80 1 -- 172.21.15.57:0/1442102962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e505e0760 con 0x556e506bd410 2023-03-02T10:56:12.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.161+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1442102962 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fceb0005570 con 0x556e506bd410 2023-03-02T10:56:12.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.161+0000 7fceda410b80 10 client.15057 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:12.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.161+0000 7fceda410b80 1 -- 172.21.15.57:0/1442102962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556e5043dd90 con 0x556e506bd410 2023-03-02T10:56:12.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.161+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1442102962 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556e505e0760 con 0x556e506bd410 2023-03-02T10:56:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.161+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1442102962 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fceb001c6b0 con 0x556e506bd410 2023-03-02T10:56:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.162+0000 7fceda410b80 10 client.15057 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.162+0000 7fceda410b80 10 client.15057 resolve_mds: resolved name 'i' to daemon mds.i 2023-03-02T10:56:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.162+0000 7fceda410b80 20 client.15057 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.162+0000 7fceda410b80 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x556e506d20c0 0x556e506d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.162+0000 7fceda410b80 4 client.15057 mds_command: new command op to 24520 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.162+0000 7fceda410b80 1 -- 172.21.15.57:0/1442102962 --> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e50608120 con 0x556e506d20c0 2023-03-02T10:56:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.162+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x556e506d20c0 0x556e506d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.162+0000 7fce9f7fe700 10 client.15057 ms_handle_connect on v2:172.21.15.136:6838/1702113579 2023-03-02T10:56:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.162+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x556e506d20c0 0x556e506d14f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ecc356f8e5fc53f9 server_cookie=1f44b2993143a27 in_seq=0 out_seq=0 2023-03-02T10:56:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1442102962 <== mds.1 v2:172.21.15.136:6838/1702113579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x556e50608120 con 0x556e506d20c0 2023-03-02T10:56:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fce9f7fe700 10 client.15057 handle_command_reply: tid=0 2023-03-02T10:56:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fceda410b80 1 client.15057 shutdown 2023-03-02T10:56:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fceda410b80 1 -- 172.21.15.57:0/1442102962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 msgr2=0x556e506c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fceda410b80 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c6f30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fceb000e4b0 tx=0x7fceb000edb0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fceda410b80 1 -- 172.21.15.57:0/1442102962 shutdown_connections 2023-03-02T10:56:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fceda410b80 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x556e506d20c0 0x556e506d14f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fceda410b80 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506be920 0x556e506ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fce9f7fe700 0 client.15057 ms_handle_reset on v2:172.21.15.136:6838/1702113579 2023-03-02T10:56:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fceda410b80 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c6f30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fceda410b80 1 --2- 172.21.15.57:0/1442102962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506bdd60 0x556e506c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fceda410b80 1 -- 172.21.15.57:0/1442102962 >> 172.21.15.57:0/1442102962 conn(0x556e506b2c00 msgr2=0x556e506b7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fceda410b80 1 -- 172.21.15.57:0/1442102962 shutdown_connections 2023-03-02T10:56:12.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.163+0000 7fceda410b80 1 -- 172.21.15.57:0/1442102962 wait complete. 2023-03-02T10:56:12.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.164+0000 7fceda410b80 20 client.15057 trim_cache size 0 max 16384 2023-03-02T10:56:12.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.190+0000 7fceda410b80 1 Processor -- start 2023-03-02T10:56:12.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.190+0000 7fceda410b80 1 -- start start 2023-03-02T10:56:12.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.190+0000 7fceda410b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.190+0000 7fceda410b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.190+0000 7fceda410b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506be920 0x556e506d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.190+0000 7fceda410b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e506b9360 con 0x556e506bd410 2023-03-02T10:56:12.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.190+0000 7fceda410b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e506b27f0 con 0x556e506bdd60 2023-03-02T10:56:12.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.190+0000 7fceda410b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e505e0760 con 0x556e506be920 2023-03-02T10:56:12.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcebffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcebf7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcebf7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506c4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:35376/0 (socket says 172.21.15.57:35376) 2023-03-02T10:56:12.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcebffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34984/0 (socket says 172.21.15.57:34984) 2023-03-02T10:56:12.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcebf7fe700 1 -- 172.21.15.57:0/4093838114 learned_addr learned my addr 172.21.15.57:0/4093838114 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:12.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcec4f9c700 1 --2- 172.21.15.57:0/4093838114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506be920 0x556e506d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcec4f9c700 1 -- 172.21.15.57:0/4093838114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 msgr2=0x556e506c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcec4f9c700 1 --2- 172.21.15.57:0/4093838114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcec4f9c700 1 -- 172.21.15.57:0/4093838114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 msgr2=0x556e506c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcec4f9c700 1 --2- 172.21.15.57:0/4093838114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcec4f9c700 1 -- 172.21.15.57:0/4093838114 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e505d6140 con 0x556e506be920 2023-03-02T10:56:12.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/4093838114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:12.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcebffff700 1 --2- 172.21.15.57:0/4093838114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:12.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.191+0000 7fcec4f9c700 1 --2- 172.21.15.57:0/4093838114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506be920 0x556e506d14f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x556e506b0140 tx=0x7fceb8015680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b39b68157131dc23 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fcea6ffd700 1 -- 172.21.15.57:0/4093838114 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb8015e60 con 0x556e506be920 2023-03-02T10:56:12.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fcea6ffd700 1 -- 172.21.15.57:0/4093838114 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fceb8004050 con 0x556e506be920 2023-03-02T10:56:12.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fcea6ffd700 1 -- 172.21.15.57:0/4093838114 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb801f6d0 con 0x556e506be920 2023-03-02T10:56:12.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fceda410b80 1 -- 172.21.15.57:0/4093838114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506be920 msgr2=0x556e506d14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fceda410b80 1 --2- 172.21.15.57:0/4093838114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506be920 0x556e506d14f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x556e506b0140 tx=0x7fceb8015680 comp rx=0 tx=0).stop 2023-03-02T10:56:12.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fceda410b80 1 -- 172.21.15.57:0/4093838114 shutdown_connections 2023-03-02T10:56:12.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fceda410b80 1 --2- 172.21.15.57:0/4093838114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506be920 0x556e506d14f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fceda410b80 1 --2- 172.21.15.57:0/4093838114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fceda410b80 1 --2- 172.21.15.57:0/4093838114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fceda410b80 1 -- 172.21.15.57:0/4093838114 >> 172.21.15.57:0/4093838114 conn(0x556e506b2c00 msgr2=0x556e506b7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fceda410b80 1 -- 172.21.15.57:0/4093838114 shutdown_connections 2023-03-02T10:56:12.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.192+0000 7fceda410b80 1 -- 172.21.15.57:0/4093838114 wait complete. 2023-03-02T10:56:12.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.193+0000 7fceda410b80 1 -- start start 2023-03-02T10:56:12.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.193+0000 7fceda410b80 1 Processor -- start 2023-03-02T10:56:12.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.193+0000 7fceda410b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506d62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.193+0000 7fceda410b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506d67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.193+0000 7fceda410b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506be920 0x556e506d97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fceda410b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e506d9d10 con 0x556e506bd410 2023-03-02T10:56:12.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fceda410b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e506d9e80 con 0x556e506bdd60 2023-03-02T10:56:12.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fceda410b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e506da040 con 0x556e506be920 2023-03-02T10:56:12.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fceda410b80 10 client.0 _ll_register_callbacks cb 0x556e505b54d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:12.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcebf7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506d67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcebffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506d62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcebf7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506d67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:35392/0 (socket says 172.21.15.57:35392) 2023-03-02T10:56:12.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcebf7fe700 1 -- 172.21.15.57:0/1882186109 learned_addr learned my addr 172.21.15.57:0/1882186109 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:12.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcec4f9c700 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506be920 0x556e506d97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcebffff700 1 -- 172.21.15.57:0/1882186109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506be920 msgr2=0x556e506d97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcebffff700 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506be920 0x556e506d97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcebffff700 1 -- 172.21.15.57:0/1882186109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 msgr2=0x556e506d67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcebffff700 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506d67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcebffff700 1 -- 172.21.15.57:0/1882186109 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e5043dd90 con 0x556e506bd410 2023-03-02T10:56:12.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506d67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:12.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fcebffff700 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506d62a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fceb000e480 tx=0x7fceb001cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95527c6cdf862338 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fce9f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:12.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1882186109 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb001c620 con 0x556e506bd410 2023-03-02T10:56:12.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1882186109 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fceb001c780 con 0x556e506bd410 2023-03-02T10:56:12.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.194+0000 7fceda410b80 1 -- 172.21.15.57:0/1882186109 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fceb0021070 con 0x556e506bd410 2023-03-02T10:56:12.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1882186109 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fceb0005250 con 0x556e506bd410 2023-03-02T10:56:12.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fceda410b80 10 client.15063 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:12.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fceda410b80 1 -- 172.21.15.57:0/1882186109 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fcec010b4a0 con 0x556e506bd410 2023-03-02T10:56:12.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1882186109 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fceb0049020 con 0x556e506bd410 2023-03-02T10:56:12.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1882186109 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fceb0003c60 con 0x556e506bd410 2023-03-02T10:56:12.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fceda410b80 10 client.15063 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:12.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fceda410b80 10 client.15063 resolve_mds: resolved name 'i' to daemon mds.i 2023-03-02T10:56:12.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fceda410b80 20 client.15063 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:12.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fceda410b80 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x556e50729140 0x556e50725a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fceda410b80 4 client.15063 mds_command: new command op to 24520 tid=0[{"prefix": "status"}] 2023-03-02T10:56:12.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fceda410b80 1 -- 172.21.15.57:0/1882186109 --> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556e50607e40 con 0x556e50729140 2023-03-02T10:56:12.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.195+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x556e50729140 0x556e50725a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fcebf7fe700 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x556e50729140 0x556e50725a90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dace563755c6c379 server_cookie=8713f4dc4213b1b1 in_seq=0 out_seq=0 2023-03-02T10:56:12.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fce9f7fe700 10 client.15063 ms_handle_connect on v2:172.21.15.136:6838/1702113579 2023-03-02T10:56:12.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fce9f7fe700 1 -- 172.21.15.57:0/1882186109 <== mds.1 v2:172.21.15.136:6838/1702113579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x556e50607e40 con 0x556e50729140 2023-03-02T10:56:12.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fce9f7fe700 10 client.15063 handle_command_reply: tid=0 2023-03-02T10:56:12.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fceda410b80 1 client.15063 shutdown 2023-03-02T10:56:12.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fceda410b80 1 -- 172.21.15.57:0/1882186109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 msgr2=0x556e506d62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fceda410b80 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506d62a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fceb000e480 tx=0x7fceb001cec0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fceda410b80 1 -- 172.21.15.57:0/1882186109 shutdown_connections 2023-03-02T10:56:12.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fceda410b80 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x556e50729140 0x556e50725a90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fceda410b80 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556e506be920 0x556e506d97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fceda410b80 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556e506bd410 0x556e506d62a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fce9f7fe700 0 client.15063 ms_handle_reset on v2:172.21.15.136:6838/1702113579 2023-03-02T10:56:12.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fceda410b80 1 --2- 172.21.15.57:0/1882186109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e506bdd60 0x556e506d67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.196+0000 7fceda410b80 1 -- 172.21.15.57:0/1882186109 >> 172.21.15.57:0/1882186109 conn(0x556e506b2c00 msgr2=0x556e506c4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fceda410b80 1 -- 172.21.15.57:0/1882186109 shutdown_connections 2023-03-02T10:56:12.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fceda410b80 1 -- 172.21.15.57:0/1882186109 wait complete. 2023-03-02T10:56:12.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fceda410b80 20 client.15063 trim_cache size 0 max 16384 2023-03-02T10:56:12.207 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:56:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 1, 2023-03-02T10:56:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 24520, 2023-03-02T10:56:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-03-02T10:56:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-03-02T10:56:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-03-02T10:56:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 58.683759340000002, 2023-03-02T10:56:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 26, 2023-03-02T10:56:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 86, 2023-03-02T10:56:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 84, 2023-03-02T10:56:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 75.850746814000004 2023-03-02T10:56:12.209 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:12.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fcec69ff700 1 -- 172.21.15.57:0/442696185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcea809b3e0 msgr2=0x7fcea809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fcec69ff700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcea809b3e0 0x7fcea809d890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009c60 tx=0x7fceb0009260 comp rx=0 tx=0).stop 2023-03-02T10:56:12.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fcec69ff700 1 -- 172.21.15.57:0/442696185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcec00ffc20 msgr2=0x7fcec0195c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fcec69ff700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcec00ffc20 0x7fcec0195c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fceb40059d0 tx=0x7fceb40047a0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fcec69ff700 1 -- 172.21.15.57:0/442696185 shutdown_connections 2023-03-02T10:56:12.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fcec69ff700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fcea809b3e0 0x7fcea809d890 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fcec69ff700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec01005d0 0x7fcec019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fcec69ff700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec00fe990 0x7fcec0195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.197+0000 7fcec69ff700 1 --2- 172.21.15.57:0/442696185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcec00ffc20 0x7fcec0195c90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.198+0000 7fcec69ff700 1 -- 172.21.15.57:0/442696185 >> 172.21.15.57:0/442696185 conn(0x7fcec00f9fd0 msgr2=0x7fcec00fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.198+0000 7fcec69ff700 1 -- 172.21.15.57:0/442696185 shutdown_connections 2023-03-02T10:56:12.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.198+0000 7fcec69ff700 1 -- 172.21.15.57:0/442696185 wait complete. 2023-03-02T10:56:12.217 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-03-02T10:56:12.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.380+0000 7fafa55ff700 1 -- 172.21.15.57:0/956886754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa0100540 msgr2=0x7fafa0106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.380+0000 7fafa55ff700 1 --2- 172.21.15.57:0/956886754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa0100540 0x7fafa0106e00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faf9800b0a0 tx=0x7faf9800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.380+0000 7fafa55ff700 1 -- 172.21.15.57:0/956886754 shutdown_connections 2023-03-02T10:56:12.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.380+0000 7fafa55ff700 1 --2- 172.21.15.57:0/956886754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa0100540 0x7fafa0106e00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.380+0000 7fafa55ff700 1 --2- 172.21.15.57:0/956886754 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa00fe9c0 0x7fafa00fedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.380+0000 7fafa55ff700 1 --2- 172.21.15.57:0/956886754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafa00ffbb0 0x7fafa0100000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.380+0000 7fafa55ff700 1 -- 172.21.15.57:0/956886754 >> 172.21.15.57:0/956886754 conn(0x7fafa00f9fe0 msgr2=0x7fafa00fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.380+0000 7fafa55ff700 1 -- 172.21.15.57:0/956886754 shutdown_connections 2023-03-02T10:56:12.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.380+0000 7fafa55ff700 1 -- 172.21.15.57:0/956886754 wait complete. 2023-03-02T10:56:12.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7fafa55ff700 1 Processor -- start 2023-03-02T10:56:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7fafa55ff700 1 -- start start 2023-03-02T10:56:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7fafa55ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa00fe9c0 0x7fafa0197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7fafa55ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa00ffbb0 0x7fafa0198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7fafa55ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafa0100540 0x7fafa019f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7fafa55ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa019f680 con 0x7fafa00ffbb0 2023-03-02T10:56:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7fafa55ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa019f7c0 con 0x7fafa0100540 2023-03-02T10:56:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7fafa55ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa019f950 con 0x7fafa00fe9c0 2023-03-02T10:56:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7faf9effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa00fe9c0 0x7fafa0197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7faf9e7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa00ffbb0 0x7fafa0198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7faf9effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa00fe9c0 0x7fafa0197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:60586/0 (socket says 172.21.15.57:60586) 2023-03-02T10:56:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7faf9effd700 1 -- 172.21.15.57:0/3230408709 learned_addr learned my addr 172.21.15.57:0/3230408709 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7faf9f7fe700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafa0100540 0x7fafa019f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7faf9effd700 1 -- 172.21.15.57:0/3230408709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafa0100540 msgr2=0x7fafa019f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.381+0000 7faf9effd700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafa0100540 0x7fafa019f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.382+0000 7faf9effd700 1 -- 172.21.15.57:0/3230408709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa00ffbb0 msgr2=0x7fafa0198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.382+0000 7faf9effd700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa00ffbb0 0x7fafa0198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.382+0000 7faf9effd700 1 -- 172.21.15.57:0/3230408709 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf98009d00 con 0x7fafa00fe9c0 2023-03-02T10:56:12.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.382+0000 7faf9effd700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa00fe9c0 0x7fafa0197b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf9000e970 tx=0x7faf9000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.382+0000 7faf87fff700 1 -- 172.21.15.57:0/3230408709 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90009790 con 0x7fafa00fe9c0 2023-03-02T10:56:12.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.382+0000 7fafa55ff700 1 -- 172.21.15.57:0/3230408709 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa010a330 con 0x7fafa00fe9c0 2023-03-02T10:56:12.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.382+0000 7faf87fff700 1 -- 172.21.15.57:0/3230408709 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf9000c7e0 con 0x7fafa00fe9c0 2023-03-02T10:56:12.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.382+0000 7faf87fff700 1 -- 172.21.15.57:0/3230408709 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90003c70 con 0x7fafa00fe9c0 2023-03-02T10:56:12.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.382+0000 7fafa55ff700 1 -- 172.21.15.57:0/3230408709 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa010a1a0 con 0x7fafa00fe9c0 2023-03-02T10:56:12.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.386+0000 7faf87fff700 1 -- 172.21.15.57:0/3230408709 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7faf9001e020 con 0x7fafa00fe9c0 2023-03-02T10:56:12.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.387+0000 7faf87fff700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf8809b460 0x7faf8809d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.387+0000 7faf87fff700 1 -- 172.21.15.57:0/3230408709 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faf90014070 con 0x7fafa00fe9c0 2023-03-02T10:56:12.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.387+0000 7fafb8f86b80 1 Processor -- start 2023-03-02T10:56:12.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.387+0000 7faf9e7fc700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf8809b460 0x7faf8809d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.387+0000 7fafb8f86b80 1 -- start start 2023-03-02T10:56:12.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0ada410 0x5573d0ada820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adad60 0x5573d0adb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0adbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d0a41a10 con 0x5573d0adad60 2023-03-02T10:56:12.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d09f3f30 con 0x5573d0ada410 2023-03-02T10:56:12.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d09c4110 con 0x5573d0adb920 2023-03-02T10:56:12.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9effd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0ada410 0x5573d0ada820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9e7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adad60 0x5573d0adb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0adbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0adbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:60600/0 (socket says 172.21.15.57:60600) 2023-03-02T10:56:12.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9effd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0ada410 0x5573d0ada820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:35418/0 (socket says 172.21.15.57:35418) 2023-03-02T10:56:12.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9effd700 1 -- 172.21.15.57:0/2158156078 learned_addr learned my addr 172.21.15.57:0/2158156078 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:12.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9e7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adad60 0x5573d0adb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35038/0 (socket says 172.21.15.57:35038) 2023-03-02T10:56:12.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9e7fc700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf8809b460 0x7faf8809d910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf94009c60 tx=0x7faf94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9f7fe700 1 -- 172.21.15.57:0/2158156078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0ada410 msgr2=0x5573d0ada820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9f7fe700 1 --2- 172.21.15.57:0/2158156078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0ada410 0x5573d0ada820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9f7fe700 1 -- 172.21.15.57:0/2158156078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adad60 msgr2=0x5573d0adb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9f7fe700 1 --2- 172.21.15.57:0/2158156078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adad60 0x5573d0adb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.388+0000 7faf9f7fe700 1 -- 172.21.15.57:0/2158156078 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573d08ae5e0 con 0x5573d0adb920 2023-03-02T10:56:12.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.389+0000 7faf9f7fe700 1 --2- 172.21.15.57:0/2158156078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0adbd90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faf98009fd0 tx=0x7faf98009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0a13b93b01b0937 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.389+0000 7faf857fa700 1 -- 172.21.15.57:0/2158156078 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9800e040 con 0x5573d0adb920 2023-03-02T10:56:12.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.389+0000 7faf857fa700 1 -- 172.21.15.57:0/2158156078 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf98006000 con 0x5573d0adb920 2023-03-02T10:56:12.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.389+0000 7faf857fa700 1 -- 172.21.15.57:0/2158156078 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98003c60 con 0x5573d0adb920 2023-03-02T10:56:12.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.389+0000 7fafb8f86b80 1 -- 172.21.15.57:0/2158156078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 msgr2=0x5573d0adbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.389+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/2158156078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0adbd90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faf98009fd0 tx=0x7faf98009c60 comp rx=0 tx=0).stop 2023-03-02T10:56:12.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.390+0000 7fafb8f86b80 1 -- 172.21.15.57:0/2158156078 shutdown_connections 2023-03-02T10:56:12.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.390+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/2158156078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0adbd90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.390+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/2158156078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0ada410 0x5573d0ada820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.390+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/2158156078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adad60 0x5573d0adb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.390+0000 7fafb8f86b80 1 -- 172.21.15.57:0/2158156078 >> 172.21.15.57:0/2158156078 conn(0x5573d0acfc00 msgr2=0x5573d0ad4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.390+0000 7fafb8f86b80 1 -- 172.21.15.57:0/2158156078 shutdown_connections 2023-03-02T10:56:12.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.390+0000 7fafb8f86b80 1 -- 172.21.15.57:0/2158156078 wait complete. 2023-03-02T10:56:12.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.390+0000 7fafb8f86b80 1 -- start start 2023-03-02T10:56:12.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.390+0000 7fafb8f86b80 1 Processor -- start 2023-03-02T10:56:12.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0ada410 0x5573d0ae3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 0x5573d0ae4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0aeb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d0a32b70 con 0x5573d0ada410 2023-03-02T10:56:12.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d0a2c0a0 con 0x5573d0adad60 2023-03-02T10:56:12.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d08b08d0 con 0x5573d0adb920 2023-03-02T10:56:12.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7fafb8f86b80 10 client.0 _ll_register_callbacks cb 0x5573d09d24d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:12.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7faf9f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0aeb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7faf9f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0aeb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:60602/0 (socket says 172.21.15.57:60602) 2023-03-02T10:56:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7faf9f7fe700 1 -- 172.21.15.57:0/3001201373 learned_addr learned my addr 172.21.15.57:0/3001201373 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7faf9e7fc700 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 0x5573d0ae4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7faf9f7fe700 1 -- 172.21.15.57:0/3001201373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 msgr2=0x5573d0ae4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7faf9f7fe700 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 0x5573d0ae4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7faf9f7fe700 1 -- 172.21.15.57:0/3001201373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0ada410 msgr2=0x5573d0ae3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7faf9f7fe700 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0ada410 0x5573d0ae3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.391+0000 7faf9f7fe700 1 -- 172.21.15.57:0/3001201373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa0107730 con 0x5573d0adb920 2023-03-02T10:56:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.392+0000 7faf9f7fe700 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0aeb480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf98009590 tx=0x7faf980095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=887701f7d86a8f90 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.392+0000 7faf82ff5700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:56:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.392+0000 7faf82ff5700 1 -- 172.21.15.57:0/3001201373 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9800e040 con 0x5573d0adb920 2023-03-02T10:56:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.392+0000 7faf82ff5700 1 -- 172.21.15.57:0/3001201373 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faf98003a00 con 0x5573d0adb920 2023-03-02T10:56:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.392+0000 7fafb8f86b80 1 -- 172.21.15.57:0/3001201373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573d09fd760 con 0x5573d0adb920 2023-03-02T10:56:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.392+0000 7faf82ff5700 1 -- 172.21.15.57:0/3001201373 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf98003bc0 con 0x5573d0adb920 2023-03-02T10:56:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.392+0000 7fafb8f86b80 10 client.24934 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.392+0000 7fafb8f86b80 1 -- 172.21.15.57:0/3001201373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5573d085ad90 con 0x5573d0adb920 2023-03-02T10:56:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.393+0000 7faf82ff5700 1 -- 172.21.15.57:0/3001201373 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5573d09fd760 con 0x5573d0adb920 2023-03-02T10:56:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.393+0000 7faf82ff5700 1 -- 172.21.15.57:0/3001201373 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf98019070 con 0x5573d0adb920 2023-03-02T10:56:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.393+0000 7fafb8f86b80 10 client.24934 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.393+0000 7fafb8f86b80 10 client.24934 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-02T10:56:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.393+0000 7fafb8f86b80 20 client.24934 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.393+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5573d0af7600 0x5573d0af6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.393+0000 7fafb8f86b80 4 client.24934 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.393+0000 7fafb8f86b80 1 -- 172.21.15.57:0/3001201373 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573d0a25120 con 0x5573d0af7600 2023-03-02T10:56:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.393+0000 7faf9effd700 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5573d0af7600 0x5573d0af6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.394+0000 7faf82ff5700 10 client.24934 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.394+0000 7faf9effd700 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5573d0af7600 0x5573d0af6bc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b0ef444b952aad3 server_cookie=a946817802a69cc in_seq=0 out_seq=0 2023-03-02T10:56:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.394+0000 7faf82ff5700 1 -- 172.21.15.57:0/3001201373 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5573d0a25120 con 0x5573d0af7600 2023-03-02T10:56:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.394+0000 7faf82ff5700 10 client.24934 handle_command_reply: tid=0 2023-03-02T10:56:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.394+0000 7fafb8f86b80 1 client.24934 shutdown 2023-03-02T10:56:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7fafb8f86b80 1 -- 172.21.15.57:0/3001201373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 msgr2=0x5573d0aeb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0aeb480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf98009590 tx=0x7faf980095c0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7fafb8f86b80 1 -- 172.21.15.57:0/3001201373 shutdown_connections 2023-03-02T10:56:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5573d0af7600 0x5573d0af6bc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adb920 0x5573d0aeb480 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0ada410 0x5573d0ae3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7faf82ff5700 0 client.24934 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/3001201373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 0x5573d0ae4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7fafb8f86b80 1 -- 172.21.15.57:0/3001201373 >> 172.21.15.57:0/3001201373 conn(0x5573d0acfc00 msgr2=0x5573d0ad4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7fafb8f86b80 1 -- 172.21.15.57:0/3001201373 shutdown_connections 2023-03-02T10:56:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7fafb8f86b80 1 -- 172.21.15.57:0/3001201373 wait complete. 2023-03-02T10:56:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.395+0000 7fafb8f86b80 20 client.24934 trim_cache size 0 max 16384 2023-03-02T10:56:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7fafb8f86b80 1 Processor -- start 2023-03-02T10:56:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7fafb8f86b80 1 -- start start 2023-03-02T10:56:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0ada410 0x5573d0af6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 0x5573d0ae3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adb920 0x5573d0ae4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d0ae3ad0 con 0x5573d0adb920 2023-03-02T10:56:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d0a25120 con 0x5573d0adad60 2023-03-02T10:56:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d09fd760 con 0x5573d0ada410 2023-03-02T10:56:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7faf9e7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 0x5573d0ae3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7faf9e7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 0x5573d0ae3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:35430/0 (socket says 172.21.15.57:35430) 2023-03-02T10:56:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7faf9f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adb920 0x5573d0ae4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7faf9e7fc700 1 -- 172.21.15.57:0/324324000 learned_addr learned my addr 172.21.15.57:0/324324000 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.414+0000 7faf9effd700 1 --2- 172.21.15.57:0/324324000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0ada410 0x5573d0af6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.415+0000 7faf9e7fc700 1 -- 172.21.15.57:0/324324000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0ada410 msgr2=0x5573d0af6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.415+0000 7faf9e7fc700 1 --2- 172.21.15.57:0/324324000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0ada410 0x5573d0af6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.415+0000 7faf9e7fc700 1 -- 172.21.15.57:0/324324000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adb920 msgr2=0x5573d0ae4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.415+0000 7faf9e7fc700 1 --2- 172.21.15.57:0/324324000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adb920 0x5573d0ae4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.415+0000 7faf9e7fc700 1 -- 172.21.15.57:0/324324000 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573d09f3140 con 0x5573d0adad60 2023-03-02T10:56:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.415+0000 7faf9f7fe700 1 --2- 172.21.15.57:0/324324000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adb920 0x5573d0ae4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.415+0000 7faf9e7fc700 1 --2- 172.21.15.57:0/324324000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 0x5573d0ae3f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf940042b0 tx=0x7faf94014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9347f6b7660f9a29 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.415+0000 7faf85ffb700 1 -- 172.21.15.57:0/324324000 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9402b070 con 0x5573d0adad60 2023-03-02T10:56:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.415+0000 7faf85ffb700 1 -- 172.21.15.57:0/324324000 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf94023040 con 0x5573d0adad60 2023-03-02T10:56:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.415+0000 7faf85ffb700 1 -- 172.21.15.57:0/324324000 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94022070 con 0x5573d0adad60 2023-03-02T10:56:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.416+0000 7fafb8f86b80 1 -- 172.21.15.57:0/324324000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 msgr2=0x5573d0ae3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.416+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/324324000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 0x5573d0ae3f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf940042b0 tx=0x7faf94014000 comp rx=0 tx=0).stop 2023-03-02T10:56:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.416+0000 7fafb8f86b80 1 -- 172.21.15.57:0/324324000 shutdown_connections 2023-03-02T10:56:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.416+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/324324000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0adb920 0x5573d0ae4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.416+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/324324000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0ada410 0x5573d0af6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.416+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/324324000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adad60 0x5573d0ae3f00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.416+0000 7fafb8f86b80 1 -- 172.21.15.57:0/324324000 >> 172.21.15.57:0/324324000 conn(0x5573d0acfc00 msgr2=0x5573d0ad4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.416+0000 7fafb8f86b80 1 -- 172.21.15.57:0/324324000 shutdown_connections 2023-03-02T10:56:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.416+0000 7fafb8f86b80 1 -- 172.21.15.57:0/324324000 wait complete. 2023-03-02T10:56:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.416+0000 7fafb8f86b80 1 -- start start 2023-03-02T10:56:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.416+0000 7fafb8f86b80 1 Processor -- start 2023-03-02T10:56:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0ada410 0x5573d0afb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adad60 0x5573d0afbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7fafb8f86b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adb920 0x5573d0afea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d0afef40 con 0x5573d0ada410 2023-03-02T10:56:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d0aff0b0 con 0x5573d0adb920 2023-03-02T10:56:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7fafb8f86b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573d0aff270 con 0x5573d0adad60 2023-03-02T10:56:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7fafb8f86b80 10 client.0 _ll_register_callbacks cb 0x5573d09d24d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf9effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0ada410 0x5573d0afb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf9effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0ada410 0x5573d0afb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35068/0 (socket says 172.21.15.57:35068) 2023-03-02T10:56:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf9effd700 1 -- 172.21.15.57:0/665421319 learned_addr learned my addr 172.21.15.57:0/665421319 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf9e7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adad60 0x5573d0afbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf9f7fe700 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adb920 0x5573d0afea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf9effd700 1 -- 172.21.15.57:0/665421319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adad60 msgr2=0x5573d0afbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf9effd700 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adad60 0x5573d0afbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf9effd700 1 -- 172.21.15.57:0/665421319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adb920 msgr2=0x5573d0afea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf9effd700 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adb920 0x5573d0afea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf9effd700 1 -- 172.21.15.57:0/665421319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5573d085ad90 con 0x5573d0ada410 2023-03-02T10:56:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf9effd700 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0ada410 0x5573d0afb600 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faf90009230 tx=0x7faf900980b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5308a0016c2812 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.417+0000 7faf82ff5700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7faf82ff5700 1 -- 172.21.15.57:0/665421319 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9009bde0 con 0x5573d0ada410 2023-03-02T10:56:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7faf82ff5700 1 -- 172.21.15.57:0/665421319 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faf90003dd0 con 0x5573d0ada410 2023-03-02T10:56:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7fafb8f86b80 1 -- 172.21.15.57:0/665421319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf98006000 con 0x5573d0ada410 2023-03-02T10:56:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7faf82ff5700 1 -- 172.21.15.57:0/665421319 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf90092a60 con 0x5573d0ada410 2023-03-02T10:56:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7fafb8f86b80 10 client.15078 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7fafb8f86b80 1 -- 172.21.15.57:0/665421319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7faf94017070 con 0x5573d0ada410 2023-03-02T10:56:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7faf82ff5700 1 -- 172.21.15.57:0/665421319 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf98006000 con 0x5573d0ada410 2023-03-02T10:56:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7faf82ff5700 1 -- 172.21.15.57:0/665421319 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf9001f340 con 0x5573d0ada410 2023-03-02T10:56:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7fafb8f86b80 10 client.15078 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7fafb8f86b80 10 client.15078 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-02T10:56:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7fafb8f86b80 20 client.15078 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5573d0b4e690 0x5573d0b4b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7fafb8f86b80 4 client.15078 mds_command: new command op to 24560 tid=0[{"prefix": "status"}] 2023-03-02T10:56:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.418+0000 7fafb8f86b80 1 -- 172.21.15.57:0/665421319 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5573d0a24e40 con 0x5573d0b4e690 2023-03-02T10:56:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.419+0000 7faf9e7fc700 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5573d0b4e690 0x5573d0b4b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.419+0000 7faf9e7fc700 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5573d0b4e690 0x5573d0b4b050 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d456448886051340 server_cookie=9ee2d8db828d7078 in_seq=0 out_seq=0 2023-03-02T10:56:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.419+0000 7faf82ff5700 10 client.15078 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.419+0000 7faf82ff5700 1 -- 172.21.15.57:0/665421319 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5573d0a24e40 con 0x5573d0b4e690 2023-03-02T10:56:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.419+0000 7faf82ff5700 10 client.15078 handle_command_reply: tid=0 2023-03-02T10:56:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.419+0000 7fafb8f86b80 1 client.15078 shutdown 2023-03-02T10:56:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.419+0000 7fafb8f86b80 1 -- 172.21.15.57:0/665421319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0ada410 msgr2=0x5573d0afb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.419+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0ada410 0x5573d0afb600 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faf90009230 tx=0x7faf900980b0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafb8f86b80 1 -- 172.21.15.57:0/665421319 shutdown_connections 2023-03-02T10:56:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5573d0b4e690 0x5573d0b4b050 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573d0adb920 0x5573d0afea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7faf82ff5700 0 client.15078 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5573d0ada410 0x5573d0afb600 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafb8f86b80 1 --2- 172.21.15.57:0/665421319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5573d0adad60 0x5573d0afbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafb8f86b80 1 -- 172.21.15.57:0/665421319 >> 172.21.15.57:0/665421319 conn(0x5573d0acfc00 msgr2=0x5573d0af6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafb8f86b80 1 -- 172.21.15.57:0/665421319 shutdown_connections 2023-03-02T10:56:12.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafb8f86b80 1 -- 172.21.15.57:0/665421319 wait complete. 2023-03-02T10:56:12.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafb8f86b80 20 client.15078 trim_cache size 0 max 16384 2023-03-02T10:56:12.430 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:12.430 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:56:12.430 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-03-02T10:56:12.430 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 24560, 2023-03-02T10:56:12.431 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-03-02T10:56:12.431 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-03-02T10:56:12.431 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-03-02T10:56:12.431 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 61.814270851000003, 2023-03-02T10:56:12.431 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 26, 2023-03-02T10:56:12.431 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 86, 2023-03-02T10:56:12.431 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 84, 2023-03-02T10:56:12.432 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 68.680694708999994 2023-03-02T10:56:12.432 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafa55ff700 1 -- 172.21.15.57:0/3230408709 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf8809b460 msgr2=0x7faf8809d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafa55ff700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf8809b460 0x7faf8809d910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf94009c60 tx=0x7faf94009260 comp rx=0 tx=0).stop 2023-03-02T10:56:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafa55ff700 1 -- 172.21.15.57:0/3230408709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa00fe9c0 msgr2=0x7fafa0197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafa55ff700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa00fe9c0 0x7fafa0197b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf9000e970 tx=0x7faf9000ec80 comp rx=0 tx=0).stop 2023-03-02T10:56:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafa55ff700 1 -- 172.21.15.57:0/3230408709 shutdown_connections 2023-03-02T10:56:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafa55ff700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7faf8809b460 0x7faf8809d910 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafa55ff700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafa0100540 0x7fafa019f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafa55ff700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafa00fe9c0 0x7fafa0197b00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafa55ff700 1 --2- 172.21.15.57:0/3230408709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa00ffbb0 0x7fafa0198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:12.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.420+0000 7fafa55ff700 1 -- 172.21.15.57:0/3230408709 >> 172.21.15.57:0/3230408709 conn(0x7fafa00f9fe0 msgr2=0x7fafa0068890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:12.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.421+0000 7fafa55ff700 1 -- 172.21.15.57:0/3230408709 shutdown_connections 2023-03-02T10:56:12.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:12.421+0000 7fafa55ff700 1 -- 172.21.15.57:0/3230408709 wait complete. 2023-03-02T10:56:12.436 INFO:tasks.cephadm:Setup complete, yielding 2023-03-02T10:56:12.436 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-03-02T10:56:12.446 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi057.front.sepia.ceph.com 2023-03-02T10:56:12.446 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- bash -c 'ceph orch status' 2023-03-02T10:56:13.208 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:56:14.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.606+0000 7f3fc563d700 1 -- 172.21.15.57:0/15373736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0072f90 msgr2=0x7f3fc0073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:14.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.606+0000 7f3fc563d700 1 --2- 172.21.15.57:0/15373736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0072f90 0x7f3fc0073400 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009990 tx=0x7f3fb4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:14.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.607+0000 7f3fc563d700 1 -- 172.21.15.57:0/15373736 shutdown_connections 2023-03-02T10:56:14.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.607+0000 7f3fc563d700 1 --2- 172.21.15.57:0/15373736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc0107a60 0x7f3fc0109ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:14.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.607+0000 7f3fc563d700 1 --2- 172.21.15.57:0/15373736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fc0074570 0x7f3fc00729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:14.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.607+0000 7f3fc563d700 1 --2- 172.21.15.57:0/15373736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0072f90 0x7f3fc0073400 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:14.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.607+0000 7f3fc563d700 1 -- 172.21.15.57:0/15373736 >> 172.21.15.57:0/15373736 conn(0x7f3fc00fb1b0 msgr2=0x7f3fc00fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:14.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.607+0000 7f3fc563d700 1 -- 172.21.15.57:0/15373736 shutdown_connections 2023-03-02T10:56:14.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.607+0000 7f3fc563d700 1 -- 172.21.15.57:0/15373736 wait complete. 2023-03-02T10:56:14.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.607+0000 7f3fc563d700 1 Processor -- start 2023-03-02T10:56:14.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.607+0000 7f3fc563d700 1 -- start start 2023-03-02T10:56:14.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fc563d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0072f90 0x7f3fc0197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:14.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fc563d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fc0074570 0x7f3fc0198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:14.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fc563d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc0107a60 0x7f3fc019f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:14.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fc563d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc019f690 con 0x7f3fc0072f90 2023-03-02T10:56:14.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fc563d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc019f7d0 con 0x7f3fc0074570 2023-03-02T10:56:14.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fc563d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc019f960 con 0x7f3fc0107a60 2023-03-02T10:56:14.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fbeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0072f90 0x7f3fc0197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:14.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fbeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0072f90 0x7f3fc0197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35086/0 (socket says 172.21.15.57:35086) 2023-03-02T10:56:14.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fbeffd700 1 -- 172.21.15.57:0/402799564 learned_addr learned my addr 172.21.15.57:0/402799564 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:14.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fbe7fc700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fc0074570 0x7f3fc0198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:14.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fbf7fe700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc0107a60 0x7f3fc019f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:14.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fbeffd700 1 -- 172.21.15.57:0/402799564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc0107a60 msgr2=0x7f3fc019f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:14.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fbeffd700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc0107a60 0x7f3fc019f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:14.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fbeffd700 1 -- 172.21.15.57:0/402799564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fc0074570 msgr2=0x7f3fc0198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:14.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fbeffd700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fc0074570 0x7f3fc0198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:14.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.608+0000 7f3fbeffd700 1 -- 172.21.15.57:0/402799564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40095f0 con 0x7f3fc0072f90 2023-03-02T10:56:14.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.609+0000 7f3fbeffd700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0072f90 0x7f3fc0197b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000d980 tx=0x7f3fb000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:14.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.609+0000 7f3fa7fff700 1 -- 172.21.15.57:0/402799564 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0004220 con 0x7f3fc0072f90 2023-03-02T10:56:14.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.609+0000 7f3fa7fff700 1 -- 172.21.15.57:0/402799564 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fb0007640 con 0x7f3fc0072f90 2023-03-02T10:56:14.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.609+0000 7f3fc563d700 1 -- 172.21.15.57:0/402799564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc010d710 con 0x7f3fc0072f90 2023-03-02T10:56:14.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.609+0000 7f3fa7fff700 1 -- 172.21.15.57:0/402799564 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0005610 con 0x7f3fc0072f90 2023-03-02T10:56:14.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.609+0000 7f3fc563d700 1 -- 172.21.15.57:0/402799564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc010d580 con 0x7f3fc0072f90 2023-03-02T10:56:14.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.610+0000 7f3fc563d700 1 -- 172.21.15.57:0/402799564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc01061a0 con 0x7f3fc0072f90 2023-03-02T10:56:14.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.611+0000 7f3fa7fff700 1 -- 172.21.15.57:0/402799564 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f3fb0021070 con 0x7f3fc0072f90 2023-03-02T10:56:14.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.612+0000 7f3fa7fff700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3fa809b3e0 0x7f3fa809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:14.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.612+0000 7f3fa7fff700 1 -- 172.21.15.57:0/402799564 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3fb00c4d80 con 0x7f3fc0072f90 2023-03-02T10:56:14.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.612+0000 7f3fbe7fc700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3fa809b3e0 0x7f3fa809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:14.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.613+0000 7f3fbe7fc700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3fa809b3e0 0x7f3fa809d890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400b2e0 tx=0x7f3fb4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:14.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.617+0000 7f3fa7fff700 1 -- 172.21.15.57:0/402799564 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f3fb0090670 con 0x7f3fc0072f90 2023-03-02T10:56:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:14 smithi057 ceph-mon[92072]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T10:56:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:14 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:14 smithi122 ceph-mon[125440]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T10:56:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:14 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.838+0000 7f3fc563d700 1 -- 172.21.15.57:0/402799564 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fc0061750 con 0x7f3fa809b3e0 2023-03-02T10:56:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:14 smithi136 ceph-mon[125702]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T10:56:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:14 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:14.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.839+0000 7f3fa7fff700 1 -- 172.21.15.57:0/402799564 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3fc0061750 con 0x7f3fa809b3e0 2023-03-02T10:56:14.842 INFO:teuthology.orchestra.run.smithi057.stdout:Backend: cephadm 2023-03-02T10:56:14.842 INFO:teuthology.orchestra.run.smithi057.stdout:Available: Yes 2023-03-02T10:56:14.843 INFO:teuthology.orchestra.run.smithi057.stdout:Paused: No 2023-03-02T10:56:14.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.841+0000 7f3fc563d700 1 -- 172.21.15.57:0/402799564 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3fa809b3e0 msgr2=0x7f3fa809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:14.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.841+0000 7f3fc563d700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3fa809b3e0 0x7f3fa809d890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400b2e0 tx=0x7f3fb4005fb0 comp rx=0 tx=0).stop 2023-03-02T10:56:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.841+0000 7f3fc563d700 1 -- 172.21.15.57:0/402799564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0072f90 msgr2=0x7f3fc0197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.841+0000 7f3fc563d700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0072f90 0x7f3fc0197b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000d980 tx=0x7f3fb000dc90 comp rx=0 tx=0).stop 2023-03-02T10:56:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.841+0000 7f3fc563d700 1 -- 172.21.15.57:0/402799564 shutdown_connections 2023-03-02T10:56:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.841+0000 7f3fc563d700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3fa809b3e0 0x7f3fa809d890 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.841+0000 7f3fc563d700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc0107a60 0x7f3fc019f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.841+0000 7f3fc563d700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0072f90 0x7f3fc0197b10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.841+0000 7f3fc563d700 1 --2- 172.21.15.57:0/402799564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fc0074570 0x7f3fc0198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.841+0000 7f3fc563d700 1 -- 172.21.15.57:0/402799564 >> 172.21.15.57:0/402799564 conn(0x7f3fc00fb1b0 msgr2=0x7f3fc00fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.842+0000 7f3fc563d700 1 -- 172.21.15.57:0/402799564 shutdown_connections 2023-03-02T10:56:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:14.842+0000 7f3fc563d700 1 -- 172.21.15.57:0/402799564 wait complete. 2023-03-02T10:56:15.315 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- bash -c 'ceph orch ps' 2023-03-02T10:56:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:56:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:56:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:15 smithi057 ceph-mon[92072]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:56:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:56:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:15 smithi122 ceph-mon[125440]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:56:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:56:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:15 smithi136 ceph-mon[125702]: from='mgr.14152 172.21.15.57:0/80315974' entity='mgr.x' 2023-03-02T10:56:16.050 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:56:16.568 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:16 smithi057 ceph-mon[92072]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:16.568 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:16 smithi057 ceph-mon[92072]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:16 smithi122 ceph-mon[125440]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:16 smithi122 ceph-mon[125440]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:16 smithi136 ceph-mon[125702]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:16 smithi136 ceph-mon[125702]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.319+0000 7f0eda03b700 1 -- 172.21.15.57:0/3661285865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ed4100dc0 msgr2=0x7f0ed4101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.319+0000 7f0eda03b700 1 --2- 172.21.15.57:0/3661285865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ed4100dc0 0x7f0ed4101210 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009990 tx=0x7f0ec8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.319+0000 7f0eda03b700 1 -- 172.21.15.57:0/3661285865 shutdown_connections 2023-03-02T10:56:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.319+0000 7f0eda03b700 1 --2- 172.21.15.57:0/3661285865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ed4101750 0x7f0ed4108010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.319+0000 7f0eda03b700 1 --2- 172.21.15.57:0/3661285865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ed40ffbd0 0x7f0ed40fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.319+0000 7f0eda03b700 1 --2- 172.21.15.57:0/3661285865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ed4100dc0 0x7f0ed4101210 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.319+0000 7f0eda03b700 1 -- 172.21.15.57:0/3661285865 >> 172.21.15.57:0/3661285865 conn(0x7f0ed40fb1b0 msgr2=0x7f0ed40fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.319+0000 7f0eda03b700 1 -- 172.21.15.57:0/3661285865 shutdown_connections 2023-03-02T10:56:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.319+0000 7f0eda03b700 1 -- 172.21.15.57:0/3661285865 wait complete. 2023-03-02T10:56:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.320+0000 7f0eda03b700 1 Processor -- start 2023-03-02T10:56:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.320+0000 7f0eda03b700 1 -- start start 2023-03-02T10:56:17.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.320+0000 7f0eda03b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ed40ffbd0 0x7f0ed4197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:17.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.320+0000 7f0eda03b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ed4100dc0 0x7f0ed41980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:17.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.320+0000 7f0eda03b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ed4101750 0x7f0ed419f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:17.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.320+0000 7f0eda03b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed419f720 con 0x7f0ed4100dc0 2023-03-02T10:56:17.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.320+0000 7f0eda03b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed419f860 con 0x7f0ed40ffbd0 2023-03-02T10:56:17.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.320+0000 7f0eda03b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed419f9f0 con 0x7f0ed4101750 2023-03-02T10:56:17.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ed4100dc0 0x7f0ed41980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:17.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ed4100dc0 0x7f0ed41980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38278/0 (socket says 172.21.15.57:38278) 2023-03-02T10:56:17.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed2ffd700 1 -- 172.21.15.57:0/2871971833 learned_addr learned my addr 172.21.15.57:0/2871971833 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:17.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed3fff700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ed4101750 0x7f0ed419f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:17.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed37fe700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ed40ffbd0 0x7f0ed4197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:17.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed2ffd700 1 -- 172.21.15.57:0/2871971833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ed4101750 msgr2=0x7f0ed419f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:17.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed2ffd700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ed4101750 0x7f0ed419f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:17.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed2ffd700 1 -- 172.21.15.57:0/2871971833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ed40ffbd0 msgr2=0x7f0ed4197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:17.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed2ffd700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ed40ffbd0 0x7f0ed4197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:17.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed2ffd700 1 -- 172.21.15.57:0/2871971833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec80095f0 con 0x7f0ed4100dc0 2023-03-02T10:56:17.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed2ffd700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ed4100dc0 0x7f0ed41980e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800b620 tx=0x7f0ec8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:17.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed0ff9700 1 -- 172.21.15.57:0/2871971833 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec801d070 con 0x7f0ed4100dc0 2023-03-02T10:56:17.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.321+0000 7f0ed0ff9700 1 -- 172.21.15.57:0/2871971833 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ec8022470 con 0x7f0ed4100dc0 2023-03-02T10:56:17.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.322+0000 7f0eda03b700 1 -- 172.21.15.57:0/2871971833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed4073590 con 0x7f0ed4100dc0 2023-03-02T10:56:17.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.322+0000 7f0ed0ff9700 1 -- 172.21.15.57:0/2871971833 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8017650 con 0x7f0ed4100dc0 2023-03-02T10:56:17.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.322+0000 7f0eda03b700 1 -- 172.21.15.57:0/2871971833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed4073400 con 0x7f0ed4100dc0 2023-03-02T10:56:17.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.323+0000 7f0eda03b700 1 -- 172.21.15.57:0/2871971833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed419fff0 con 0x7f0ed4100dc0 2023-03-02T10:56:17.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.324+0000 7f0ed0ff9700 1 -- 172.21.15.57:0/2871971833 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f0ec8029030 con 0x7f0ed4100dc0 2023-03-02T10:56:17.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.325+0000 7f0ed0ff9700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0ebc09b460 0x7f0ebc09d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:17.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.325+0000 7f0ed0ff9700 1 -- 172.21.15.57:0/2871971833 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0ec80c6a00 con 0x7f0ed4100dc0 2023-03-02T10:56:17.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.325+0000 7f0ed37fe700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0ebc09b460 0x7f0ebc09d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:17.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.326+0000 7f0ed37fe700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0ebc09b460 0x7f0ebc09d910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4100c20 tx=0x7f0ec4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:17.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.328+0000 7f0ed0ff9700 1 -- 172.21.15.57:0/2871971833 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f0ec8092380 con 0x7f0ed4100dc0 2023-03-02T10:56:17.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.534+0000 7f0eda03b700 1 -- 172.21.15.57:0/2871971833 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ed41a05a0 con 0x7f0ebc09b460 2023-03-02T10:56:17.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.548+0000 7f0ed0ff9700 1 -- 172.21.15.57:0/2871971833 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4154 (secure 0 0 0) 0x7f0ed41a05a0 con 0x7f0ebc09b460 2023-03-02T10:56:17.550 INFO:teuthology.orchestra.run.smithi057.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-03-02T10:56:17.550 INFO:teuthology.orchestra.run.smithi057.stdout:mds.a smithi057 running (76s) 3s ago 75s 16.7M - 18.0.0-2462-g802de851 635875b56700 97054fc42498 2023-03-02T10:56:17.550 INFO:teuthology.orchestra.run.smithi057.stdout:mds.b smithi122 running (74s) 4s ago 73s 29.9M - 18.0.0-2462-g802de851 635875b56700 d15b6987f758 2023-03-02T10:56:17.550 INFO:teuthology.orchestra.run.smithi057.stdout:mds.c smithi136 running (86s) 4s ago 85s 19.6M - 18.0.0-2462-g802de851 635875b56700 76a79272ea98 2023-03-02T10:56:17.550 INFO:teuthology.orchestra.run.smithi057.stdout:mds.d smithi057 running (92s) 3s ago 92s 13.7M - 18.0.0-2462-g802de851 635875b56700 88fe599e8b7c 2023-03-02T10:56:17.551 INFO:teuthology.orchestra.run.smithi057.stdout:mds.e smithi122 running (90s) 4s ago 89s 21.5M - 18.0.0-2462-g802de851 635875b56700 fa7ee93894ca 2023-03-02T10:56:17.551 INFO:teuthology.orchestra.run.smithi057.stdout:mds.f smithi136 running (88s) 4s ago 87s 18.3M - 18.0.0-2462-g802de851 635875b56700 19342c197c89 2023-03-02T10:56:17.551 INFO:teuthology.orchestra.run.smithi057.stdout:mds.g smithi057 running (78s) 3s ago 78s 16.7M - 18.0.0-2462-g802de851 635875b56700 531936c7007b 2023-03-02T10:56:17.551 INFO:teuthology.orchestra.run.smithi057.stdout:mds.h smithi122 running (83s) 4s ago 83s 18.1M - 18.0.0-2462-g802de851 635875b56700 889d096c2b06 2023-03-02T10:56:17.551 INFO:teuthology.orchestra.run.smithi057.stdout:mds.i smithi136 running (81s) 4s ago 81s 21.2M - 18.0.0-2462-g802de851 635875b56700 d150f7152eb0 2023-03-02T10:56:17.551 INFO:teuthology.orchestra.run.smithi057.stdout:mds.j smithi057 running (95s) 3s ago 94s 13.7M - 18.0.0-2462-g802de851 635875b56700 7cbfb5a028bf 2023-03-02T10:56:17.551 INFO:teuthology.orchestra.run.smithi057.stdout:mds.k smithi122 running (97s) 4s ago 97s 18.2M - 18.0.0-2462-g802de851 635875b56700 f17f90280f9d 2023-03-02T10:56:17.551 INFO:teuthology.orchestra.run.smithi057.stdout:mds.l smithi136 running (100s) 4s ago 99s 17.0M - 18.0.0-2462-g802de851 635875b56700 661f82b2bbd8 2023-03-02T10:56:17.552 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.x smithi057 *:9283,8765 running (8m) 3s ago 8m 503M - 18.0.0-2462-g802de851 635875b56700 ef88e7660acc 2023-03-02T10:56:17.552 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.y smithi122 *:8443,8765 running (6m) 4s ago 6m 431M - 18.0.0-2462-g802de851 635875b56700 0bdbfcdb51f3 2023-03-02T10:56:17.552 INFO:teuthology.orchestra.run.smithi057.stdout:mgr.z smithi136 *:8443,8765 running (6m) 4s ago 6m 434M - 18.0.0-2462-g802de851 635875b56700 f9962d57fc84 2023-03-02T10:56:17.552 INFO:teuthology.orchestra.run.smithi057.stdout:mon.a smithi057 running (8m) 3s ago 8m 93.3M 2048M 18.0.0-2462-g802de851 635875b56700 cdf0c9e71571 2023-03-02T10:56:17.552 INFO:teuthology.orchestra.run.smithi057.stdout:mon.b smithi122 running (6m) 4s ago 6m 62.8M 2048M 18.0.0-2462-g802de851 635875b56700 e1703f37e01d 2023-03-02T10:56:17.552 INFO:teuthology.orchestra.run.smithi057.stdout:mon.c smithi136 running (6m) 4s ago 6m 63.5M 2048M 18.0.0-2462-g802de851 635875b56700 50e350210dba 2023-03-02T10:56:17.552 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 smithi057 running (6m) 3s ago 6m 66.7M 4319M 18.0.0-2462-g802de851 635875b56700 0949b2900eeb 2023-03-02T10:56:17.553 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 smithi122 running (5m) 4s ago 5m 74.7M 4292M 18.0.0-2462-g802de851 635875b56700 da968b278044 2023-03-02T10:56:17.553 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 smithi136 running (5m) 4s ago 5m 72.2M 4292M 18.0.0-2462-g802de851 635875b56700 09f711e0cb5a 2023-03-02T10:56:17.553 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 smithi057 running (4m) 3s ago 4m 61.7M 4319M 18.0.0-2462-g802de851 635875b56700 fe7a168889f4 2023-03-02T10:56:17.553 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 smithi122 running (4m) 4s ago 4m 63.1M 4292M 18.0.0-2462-g802de851 635875b56700 3fb543e98c1d 2023-03-02T10:56:17.553 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 smithi136 running (4m) 4s ago 4m 67.5M 4292M 18.0.0-2462-g802de851 635875b56700 5aa7c33ce0e7 2023-03-02T10:56:17.553 INFO:teuthology.orchestra.run.smithi057.stdout:osd.6 smithi057 running (3m) 3s ago 3m 58.6M 4319M 18.0.0-2462-g802de851 635875b56700 11c55bc3e8dc 2023-03-02T10:56:17.553 INFO:teuthology.orchestra.run.smithi057.stdout:osd.7 smithi122 running (3m) 4s ago 3m 63.5M 4292M 18.0.0-2462-g802de851 635875b56700 4dd9089f25b4 2023-03-02T10:56:17.553 INFO:teuthology.orchestra.run.smithi057.stdout:osd.8 smithi136 running (3m) 4s ago 3m 64.1M 4292M 18.0.0-2462-g802de851 635875b56700 828a492ebfcc 2023-03-02T10:56:17.554 INFO:teuthology.orchestra.run.smithi057.stdout:osd.9 smithi057 running (2m) 3s ago 2m 54.9M 4319M 18.0.0-2462-g802de851 635875b56700 0fc957875abd 2023-03-02T10:56:17.554 INFO:teuthology.orchestra.run.smithi057.stdout:osd.10 smithi122 running (2m) 4s ago 2m 60.8M 4292M 18.0.0-2462-g802de851 635875b56700 39460384d13c 2023-03-02T10:56:17.554 INFO:teuthology.orchestra.run.smithi057.stdout:osd.11 smithi136 running (2m) 4s ago 2m 53.8M 4292M 18.0.0-2462-g802de851 635875b56700 ae15ab056424 2023-03-02T10:56:17.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 -- 172.21.15.57:0/2871971833 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0ebc09b460 msgr2=0x7f0ebc09d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:17.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0ebc09b460 0x7f0ebc09d910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4100c20 tx=0x7f0ec4009260 comp rx=0 tx=0).stop 2023-03-02T10:56:17.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 -- 172.21.15.57:0/2871971833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ed4100dc0 msgr2=0x7f0ed41980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:17.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ed4100dc0 0x7f0ed41980e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800b620 tx=0x7f0ec8005740 comp rx=0 tx=0).stop 2023-03-02T10:56:17.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 -- 172.21.15.57:0/2871971833 shutdown_connections 2023-03-02T10:56:17.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0ebc09b460 0x7f0ebc09d910 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:17.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ed4101750 0x7f0ed419f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:17.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ed40ffbd0 0x7f0ed4197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:17.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 --2- 172.21.15.57:0/2871971833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ed4100dc0 0x7f0ed41980e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:17.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 -- 172.21.15.57:0/2871971833 >> 172.21.15.57:0/2871971833 conn(0x7f0ed40fb1b0 msgr2=0x7f0ed40fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:17.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 -- 172.21.15.57:0/2871971833 shutdown_connections 2023-03-02T10:56:17.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:17.550+0000 7f0eda03b700 1 -- 172.21.15.57:0/2871971833 wait complete. 2023-03-02T10:56:17.950 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- bash -c 'ceph orch ls' 2023-03-02T10:56:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:18 smithi057 ceph-mon[92072]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:18.689 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:56:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:18 smithi122 ceph-mon[125440]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:18 smithi136 ceph-mon[125702]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:19.608 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:19 smithi057 ceph-mon[92072]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:19 smithi122 ceph-mon[125440]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:19 smithi136 ceph-mon[125702]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:20.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.177+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3453183137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a0103000 msgr2=0x7f44a01053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:20.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.177+0000 7f44a7ffa700 1 --2- 172.21.15.57:0/3453183137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a0103000 0x7f44a01053e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4490009990 tx=0x7f4490009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:20.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.177+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3453183137 shutdown_connections 2023-03-02T10:56:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.177+0000 7f44a7ffa700 1 --2- 172.21.15.57:0/3453183137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44a0105920 0x7f44a0107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.177+0000 7f44a7ffa700 1 --2- 172.21.15.57:0/3453183137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44a01006e0 0x7f44a0102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.177+0000 7f44a7ffa700 1 --2- 172.21.15.57:0/3453183137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a0103000 0x7f44a01053e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.177+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3453183137 >> 172.21.15.57:0/3453183137 conn(0x7f44a00fa0c0 msgr2=0x7f44a00fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.177+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3453183137 shutdown_connections 2023-03-02T10:56:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.177+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3453183137 wait complete. 2023-03-02T10:56:20.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a7ffa700 1 Processor -- start 2023-03-02T10:56:20.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a7ffa700 1 -- start start 2023-03-02T10:56:20.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a7ffa700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44a01006e0 0x7f44a01958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:20.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a7ffa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a0103000 0x7f44a0195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:20.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a7ffa700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44a0105920 0x7f44a019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:20.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a7ffa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a019d420 con 0x7f44a0103000 2023-03-02T10:56:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a7ffa700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a019d560 con 0x7f44a01006e0 2023-03-02T10:56:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a7ffa700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a019d6f0 con 0x7f44a0105920 2023-03-02T10:56:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a5595700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a0103000 0x7f44a0195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a5595700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a0103000 0x7f44a0195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38294/0 (socket says 172.21.15.57:38294) 2023-03-02T10:56:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a5595700 1 -- 172.21.15.57:0/3311641644 learned_addr learned my addr 172.21.15.57:0/3311641644 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a5d96700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44a01006e0 0x7f44a01958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a6597700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44a0105920 0x7f44a019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a5595700 1 -- 172.21.15.57:0/3311641644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44a0105920 msgr2=0x7f44a019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.178+0000 7f44a5595700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44a0105920 0x7f44a019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.179+0000 7f44a5595700 1 -- 172.21.15.57:0/3311641644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44a01006e0 msgr2=0x7f44a01958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.179+0000 7f44a5595700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44a01006e0 0x7f44a01958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.179+0000 7f44a5595700 1 -- 172.21.15.57:0/3311641644 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44900095f0 con 0x7f44a0103000 2023-03-02T10:56:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.179+0000 7f44a5595700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a0103000 0x7f44a0195de0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f44900059d0 tx=0x7f449000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.179+0000 7f4496ffd700 1 -- 172.21.15.57:0/3311641644 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449001d070 con 0x7f44a0103000 2023-03-02T10:56:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.179+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3311641644 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a010b500 con 0x7f44a0103000 2023-03-02T10:56:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.179+0000 7f4496ffd700 1 -- 172.21.15.57:0/3311641644 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f449000fd60 con 0x7f44a0103000 2023-03-02T10:56:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.179+0000 7f4496ffd700 1 -- 172.21.15.57:0/3311641644 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490017650 con 0x7f44a0103000 2023-03-02T10:56:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.179+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3311641644 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a010b370 con 0x7f44a0103000 2023-03-02T10:56:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.180+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3311641644 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a00fbc30 con 0x7f44a0103000 2023-03-02T10:56:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.181+0000 7f4496ffd700 1 -- 172.21.15.57:0/3311641644 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 129897+0+0 (secure 0 0 0) 0x7f4490029030 con 0x7f44a0103000 2023-03-02T10:56:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.182+0000 7f4496ffd700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f448c09b3e0 0x7f448c09d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.182+0000 7f4496ffd700 1 -- 172.21.15.57:0/3311641644 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f44900c64a0 con 0x7f44a0103000 2023-03-02T10:56:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.182+0000 7f44a5d96700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f448c09b3e0 0x7f448c09d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.183+0000 7f44a5d96700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f448c09b3e0 0x7f448c09d890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f449c009bf0 tx=0x7f449c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:20.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.187+0000 7f4496ffd700 1 -- 172.21.15.57:0/3311641644 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f449005b800 con 0x7f44a0103000 2023-03-02T10:56:20.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.392+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3311641644 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f44a0061660 con 0x7f448c09b3e0 2023-03-02T10:56:20.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.397+0000 7f4496ffd700 1 -- 172.21.15.57:0/3311641644 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7f44a0061660 con 0x7f448c09b3e0 2023-03-02T10:56:20.400 INFO:teuthology.orchestra.run.smithi057.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-03-02T10:56:20.400 INFO:teuthology.orchestra.run.smithi057.stdout:mds.all 12/12 6s ago 105s smithi057=a;smithi057=d;smithi057=g;smithi057=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l;count:12 2023-03-02T10:56:20.400 INFO:teuthology.orchestra.run.smithi057.stdout:mgr 3/3 6s ago 6m smithi057=x;smithi122=y;smithi136=z;count:3 2023-03-02T10:56:20.400 INFO:teuthology.orchestra.run.smithi057.stdout:mon 3/3 6s ago 6m smithi057:172.21.15.57=a;smithi122:172.21.15.122=b;smithi136:172.21.15.136=c;count:3 2023-03-02T10:56:20.400 INFO:teuthology.orchestra.run.smithi057.stdout:osd 12 6s ago - 2023-03-02T10:56:20.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.399+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3311641644 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f448c09b3e0 msgr2=0x7f448c09d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:20.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.399+0000 7f44a7ffa700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f448c09b3e0 0x7f448c09d890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f449c009bf0 tx=0x7f449c009260 comp rx=0 tx=0).stop 2023-03-02T10:56:20.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.399+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3311641644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a0103000 msgr2=0x7f44a0195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:20.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.399+0000 7f44a7ffa700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a0103000 0x7f44a0195de0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f44900059d0 tx=0x7f449000f510 comp rx=0 tx=0).stop 2023-03-02T10:56:20.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.399+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3311641644 shutdown_connections 2023-03-02T10:56:20.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.399+0000 7f44a7ffa700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f448c09b3e0 0x7f448c09d890 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:20.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.399+0000 7f44a7ffa700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44a0105920 0x7f44a019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:20.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.399+0000 7f44a7ffa700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44a01006e0 0x7f44a01958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:20.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.399+0000 7f44a7ffa700 1 --2- 172.21.15.57:0/3311641644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a0103000 0x7f44a0195de0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:20.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.399+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3311641644 >> 172.21.15.57:0/3311641644 conn(0x7f44a00fa0c0 msgr2=0x7f44a0101320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:20.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.400+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3311641644 shutdown_connections 2023-03-02T10:56:20.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:20.400+0000 7f44a7ffa700 1 -- 172.21.15.57:0/3311641644 wait complete. 2023-03-02T10:56:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:20 smithi057 ceph-mon[92072]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:20 smithi122 ceph-mon[125440]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:20 smithi136 ceph-mon[125702]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:20.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- bash -c 'ceph orch host ls' 2023-03-02T10:56:21.629 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:56:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:21 smithi057 ceph-mon[92072]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:21 smithi122 ceph-mon[125440]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:21 smithi136 ceph-mon[125702]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:22 smithi057 ceph-mon[92072]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:22 smithi057 ceph-mon[92072]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-03-02T10:56:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:22 smithi122 ceph-mon[125440]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:22 smithi122 ceph-mon[125440]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-03-02T10:56:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:22 smithi136 ceph-mon[125702]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:22 smithi136 ceph-mon[125702]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-03-02T10:56:22.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.918+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1043080995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d18100d70 msgr2=0x7f4d181011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:22.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.918+0000 7f4d1c9ec700 1 --2- 172.21.15.57:0/1043080995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d18100d70 0x7f4d181011c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009990 tx=0x7f4d0c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:22.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.918+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1043080995 shutdown_connections 2023-03-02T10:56:22.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.918+0000 7f4d1c9ec700 1 --2- 172.21.15.57:0/1043080995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d18101700 0x7f4d18107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:22.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.918+0000 7f4d1c9ec700 1 --2- 172.21.15.57:0/1043080995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d180ffb80 0x7f4d180fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:22.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.918+0000 7f4d1c9ec700 1 --2- 172.21.15.57:0/1043080995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d18100d70 0x7f4d181011c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:22.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.918+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1043080995 >> 172.21.15.57:0/1043080995 conn(0x7f4d180fb160 msgr2=0x7f4d180fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:22.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.918+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1043080995 shutdown_connections 2023-03-02T10:56:22.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.918+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1043080995 wait complete. 2023-03-02T10:56:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d1c9ec700 1 Processor -- start 2023-03-02T10:56:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d1c9ec700 1 -- start start 2023-03-02T10:56:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d1c9ec700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d180ffb80 0x7f4d18197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d1c9ec700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d18100d70 0x7f4d18198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d1c9ec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d18101700 0x7f4d1819f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d1c9ec700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1819f670 con 0x7f4d18101700 2023-03-02T10:56:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d1c9ec700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1819f7b0 con 0x7f4d18100d70 2023-03-02T10:56:22.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d1c9ec700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1819f940 con 0x7f4d180ffb80 2023-03-02T10:56:22.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d16d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d18101700 0x7f4d1819f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:22.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d1659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d180ffb80 0x7f4d18197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:22.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d15d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d18100d70 0x7f4d18198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:22.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d16d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d18101700 0x7f4d1819f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38310/0 (socket says 172.21.15.57:38310) 2023-03-02T10:56:22.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d1659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d180ffb80 0x7f4d18197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:41718/0 (socket says 172.21.15.57:41718) 2023-03-02T10:56:22.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.919+0000 7f4d16d9d700 1 -- 172.21.15.57:0/1126278370 learned_addr learned my addr 172.21.15.57:0/1126278370 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:22.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.920+0000 7f4d16d9d700 1 -- 172.21.15.57:0/1126278370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d180ffb80 msgr2=0x7f4d18197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:22.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.920+0000 7f4d16d9d700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d180ffb80 0x7f4d18197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:22.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.920+0000 7f4d16d9d700 1 -- 172.21.15.57:0/1126278370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d18100d70 msgr2=0x7f4d18198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:22.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.920+0000 7f4d16d9d700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d18100d70 0x7f4d18198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:22.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.920+0000 7f4d16d9d700 1 -- 172.21.15.57:0/1126278370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0095f0 con 0x7f4d18101700 2023-03-02T10:56:22.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.920+0000 7f4d16d9d700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d18101700 0x7f4d1819f0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000ef30 tx=0x7f4d1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:22.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.920+0000 7f4d077fe700 1 -- 172.21.15.57:0/1126278370 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d10018070 con 0x7f4d18101700 2023-03-02T10:56:22.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.920+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1126278370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1810b530 con 0x7f4d18101700 2023-03-02T10:56:22.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.920+0000 7f4d077fe700 1 -- 172.21.15.57:0/1126278370 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d1000f040 con 0x7f4d18101700 2023-03-02T10:56:22.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.920+0000 7f4d077fe700 1 -- 172.21.15.57:0/1126278370 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1000cd00 con 0x7f4d18101700 2023-03-02T10:56:22.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.920+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1126278370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1810b3a0 con 0x7f4d18101700 2023-03-02T10:56:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.921+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1126278370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d18192290 con 0x7f4d18101700 2023-03-02T10:56:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.923+0000 7f4d077fe700 1 -- 172.21.15.57:0/1126278370 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f4d10003a00 con 0x7f4d18101700 2023-03-02T10:56:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.923+0000 7f4d077fe700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4d0009b3a0 0x7f4d0009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.924+0000 7f4d077fe700 1 -- 172.21.15.57:0/1126278370 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4d100c4c80 con 0x7f4d18101700 2023-03-02T10:56:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.924+0000 7f4d1659c700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4d0009b3a0 0x7f4d0009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.924+0000 7f4d1659c700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4d0009b3a0 0x7f4d0009d850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4d18100bd0 tx=0x7f4d0800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:22.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:22.928+0000 7f4d077fe700 1 -- 172.21.15.57:0/1126278370 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f4d100905e0 con 0x7f4d18101700 2023-03-02T10:56:23.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.131+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1126278370 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d18061680 con 0x7f4d0009b3a0 2023-03-02T10:56:23.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.133+0000 7f4d077fe700 1 -- 172.21.15.57:0/1126278370 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f4d18061680 con 0x7f4d0009b3a0 2023-03-02T10:56:23.135 INFO:teuthology.orchestra.run.smithi057.stdout:HOST ADDR LABELS STATUS 2023-03-02T10:56:23.135 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057 172.21.15.57 2023-03-02T10:56:23.135 INFO:teuthology.orchestra.run.smithi057.stdout:smithi122 172.21.15.122 2023-03-02T10:56:23.136 INFO:teuthology.orchestra.run.smithi057.stdout:smithi136 172.21.15.136 2023-03-02T10:56:23.136 INFO:teuthology.orchestra.run.smithi057.stdout:3 hosts in cluster 2023-03-02T10:56:23.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1126278370 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4d0009b3a0 msgr2=0x7f4d0009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:23.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4d0009b3a0 0x7f4d0009d850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4d18100bd0 tx=0x7f4d0800b410 comp rx=0 tx=0).stop 2023-03-02T10:56:23.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1126278370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d18101700 msgr2=0x7f4d1819f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d18101700 0x7f4d1819f0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000ef30 tx=0x7f4d1000c3a0 comp rx=0 tx=0).stop 2023-03-02T10:56:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1126278370 shutdown_connections 2023-03-02T10:56:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4d0009b3a0 0x7f4d0009d850 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d18101700 0x7f4d1819f0a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d180ffb80 0x7f4d18197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 --2- 172.21.15.57:0/1126278370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d18100d70 0x7f4d18198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1126278370 >> 172.21.15.57:0/1126278370 conn(0x7f4d180fb160 msgr2=0x7f4d18106670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:23.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1126278370 shutdown_connections 2023-03-02T10:56:23.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:23.135+0000 7f4d1c9ec700 1 -- 172.21.15.57:0/1126278370 wait complete. 2023-03-02T10:56:23.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- bash -c 'ceph orch device ls' 2023-03-02T10:56:24.373 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:56:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:24 smithi122 ceph-mon[125440]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:24 smithi122 ceph-mon[125440]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T10:56:24.745 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:24 smithi057 ceph-mon[92072]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:24.746 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:24 smithi057 ceph-mon[92072]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T10:56:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:24 smithi136 ceph-mon[125702]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:24 smithi136 ceph-mon[125702]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T10:56:25.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.759+0000 7fe18fc1c700 1 -- 172.21.15.57:0/955652757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe188105900 msgr2=0x7fe188107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:25.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.759+0000 7fe18fc1c700 1 --2- 172.21.15.57:0/955652757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe188105900 0x7fe188107ce0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe18000b0a0 tx=0x7fe18000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:25.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.760+0000 7fe18fc1c700 1 -- 172.21.15.57:0/955652757 shutdown_connections 2023-03-02T10:56:25.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.760+0000 7fe18fc1c700 1 --2- 172.21.15.57:0/955652757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe188105900 0x7fe188107ce0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:25.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.760+0000 7fe18fc1c700 1 --2- 172.21.15.57:0/955652757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1881006c0 0x7fe188102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:25.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.760+0000 7fe18fc1c700 1 --2- 172.21.15.57:0/955652757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe188102fe0 0x7fe1881053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:25.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.760+0000 7fe18fc1c700 1 -- 172.21.15.57:0/955652757 >> 172.21.15.57:0/955652757 conn(0x7fe1880fa0a0 msgr2=0x7fe1880fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:25.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.760+0000 7fe18fc1c700 1 -- 172.21.15.57:0/955652757 shutdown_connections 2023-03-02T10:56:25.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.760+0000 7fe18fc1c700 1 -- 172.21.15.57:0/955652757 wait complete. 2023-03-02T10:56:25.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.760+0000 7fe18fc1c700 1 Processor -- start 2023-03-02T10:56:25.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.760+0000 7fe18fc1c700 1 -- start start 2023-03-02T10:56:25.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18fc1c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1881006c0 0x7fe188195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:25.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18fc1c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe188102fe0 0x7fe188195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:25.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18fc1c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe188105900 0x7fe18819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:25.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18fc1c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18819d4e0 con 0x7fe188105900 2023-03-02T10:56:25.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18fc1c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18819d620 con 0x7fe1881006c0 2023-03-02T10:56:25.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18fc1c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18819d7b0 con 0x7fe188102fe0 2023-03-02T10:56:25.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18e1b9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe188105900 0x7fe18819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:25.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18e1b9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe188105900 0x7fe18819cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38320/0 (socket says 172.21.15.57:38320) 2023-03-02T10:56:25.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18e1b9700 1 -- 172.21.15.57:0/3396310211 learned_addr learned my addr 172.21.15.57:0/3396310211 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:25.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18d9b8700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1881006c0 0x7fe188195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:25.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18d1b7700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe188102fe0 0x7fe188195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:25.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18e1b9700 1 -- 172.21.15.57:0/3396310211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe188102fe0 msgr2=0x7fe188195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:25.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18e1b9700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe188102fe0 0x7fe188195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:25.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18e1b9700 1 -- 172.21.15.57:0/3396310211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1881006c0 msgr2=0x7fe188195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:25.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18e1b9700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1881006c0 0x7fe188195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:25.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18e1b9700 1 -- 172.21.15.57:0/3396310211 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180009d00 con 0x7fe188105900 2023-03-02T10:56:25.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.761+0000 7fe18e1b9700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe188105900 0x7fe18819cf10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe18000b070 tx=0x7fe180004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:25.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.762+0000 7fe17effd700 1 -- 172.21.15.57:0/3396310211 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18000e040 con 0x7fe188105900 2023-03-02T10:56:25.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.762+0000 7fe18fc1c700 1 -- 172.21.15.57:0/3396310211 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18810b500 con 0x7fe188105900 2023-03-02T10:56:25.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.762+0000 7fe17effd700 1 -- 172.21.15.57:0/3396310211 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe18001bb20 con 0x7fe188105900 2023-03-02T10:56:25.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.762+0000 7fe17effd700 1 -- 172.21.15.57:0/3396310211 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180005800 con 0x7fe188105900 2023-03-02T10:56:25.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.762+0000 7fe18fc1c700 1 -- 172.21.15.57:0/3396310211 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18810b370 con 0x7fe188105900 2023-03-02T10:56:25.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.763+0000 7fe18fc1c700 1 -- 172.21.15.57:0/3396310211 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1880fbc10 con 0x7fe188105900 2023-03-02T10:56:25.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.764+0000 7fe17effd700 1 -- 172.21.15.57:0/3396310211 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fe18000bd70 con 0x7fe188105900 2023-03-02T10:56:25.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.765+0000 7fe17effd700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe17409b3a0 0x7fe17409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:25.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.765+0000 7fe17effd700 1 -- 172.21.15.57:0/3396310211 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe1800c6c10 con 0x7fe188105900 2023-03-02T10:56:25.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.765+0000 7fe18d9b8700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe17409b3a0 0x7fe17409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:25.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.766+0000 7fe18d9b8700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe17409b3a0 0x7fe17409d850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe184005950 tx=0x7fe18400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:25.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.769+0000 7fe17effd700 1 -- 172.21.15.57:0/3396310211 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fe180092570 con 0x7fe188105900 2023-03-02T10:56:25.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.975+0000 7fe18fc1c700 1 -- 172.21.15.57:0/3396310211 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1880614b0 con 0x7fe17409b3a0 2023-03-02T10:56:25.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.977+0000 7fe17effd700 1 -- 172.21.15.57:0/3396310211 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7fe1880614b0 con 0x7fe17409b3a0 2023-03-02T10:56:25.979 INFO:teuthology.orchestra.run.smithi057.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-03-02T10:56:25.980 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN 4000G No 2m ago LVM detected, locked 2023-03-02T10:56:25.980 INFO:teuthology.orchestra.run.smithi057.stdout:smithi122 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010U400BGN 400G No 2m ago LVM detected, locked 2023-03-02T10:56:25.980 INFO:teuthology.orchestra.run.smithi057.stdout:smithi136 /dev/nvme0n1 ssd INTEL_SSDPEDMX020T4_CVPD514100122P0SGN 2000G No 2m ago LVM detected, locked 2023-03-02T10:56:25.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 -- 172.21.15.57:0/3396310211 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe17409b3a0 msgr2=0x7fe17409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:25.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe17409b3a0 0x7fe17409d850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe184005950 tx=0x7fe18400a300 comp rx=0 tx=0).stop 2023-03-02T10:56:25.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 -- 172.21.15.57:0/3396310211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe188105900 msgr2=0x7fe18819cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:25.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe188105900 0x7fe18819cf10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe18000b070 tx=0x7fe180004d00 comp rx=0 tx=0).stop 2023-03-02T10:56:25.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 -- 172.21.15.57:0/3396310211 shutdown_connections 2023-03-02T10:56:25.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe17409b3a0 0x7fe17409d850 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:25.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe188105900 0x7fe18819cf10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:25.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1881006c0 0x7fe188195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:25.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 --2- 172.21.15.57:0/3396310211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe188102fe0 0x7fe188195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:25.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 -- 172.21.15.57:0/3396310211 >> 172.21.15.57:0/3396310211 conn(0x7fe1880fa0a0 msgr2=0x7fe188101300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:25.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 -- 172.21.15.57:0/3396310211 shutdown_connections 2023-03-02T10:56:25.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:25.979+0000 7fe18fc1c700 1 -- 172.21.15.57:0/3396310211 wait complete. 2023-03-02T10:56:26.469 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-03-02T10:56:26.478 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi057.front.sepia.ceph.com 2023-03-02T10:56:26.479 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- bash -c 'ceph fs dump' 2023-03-02T10:56:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:26 smithi057 ceph-mon[92072]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:56:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:26 smithi122 ceph-mon[125440]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:56:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:26 smithi136 ceph-mon[125702]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:56:27.213 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:56:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:27 smithi122 ceph-mon[125440]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:27.748 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:27 smithi057 ceph-mon[92072]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:27 smithi136 ceph-mon[125702]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:56:28.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.600+0000 7f602ac44700 1 -- 172.21.15.57:0/3120090075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60240feac0 msgr2=0x7f60240feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:28.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.600+0000 7f602ac44700 1 --2- 172.21.15.57:0/3120090075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60240feac0 0x7f60240feed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6020009990 tx=0x7f6020009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:28.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.600+0000 7f602ac44700 1 -- 172.21.15.57:0/3120090075 shutdown_connections 2023-03-02T10:56:28.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.600+0000 7f602ac44700 1 --2- 172.21.15.57:0/3120090075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6024100640 0x7f6024106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:28.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.600+0000 7f602ac44700 1 --2- 172.21.15.57:0/3120090075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60240feac0 0x7f60240feed0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:28.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.600+0000 7f602ac44700 1 --2- 172.21.15.57:0/3120090075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60240ffcb0 0x7f6024100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:28.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.600+0000 7f602ac44700 1 -- 172.21.15.57:0/3120090075 >> 172.21.15.57:0/3120090075 conn(0x7f60240fa0a0 msgr2=0x7f60240fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:28.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.600+0000 7f602ac44700 1 -- 172.21.15.57:0/3120090075 shutdown_connections 2023-03-02T10:56:28.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.601+0000 7f602ac44700 1 -- 172.21.15.57:0/3120090075 wait complete. 2023-03-02T10:56:28.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.601+0000 7f602ac44700 1 Processor -- start 2023-03-02T10:56:28.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.601+0000 7f602ac44700 1 -- start start 2023-03-02T10:56:28.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f602ac44700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60240feac0 0x7f6024102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:28.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f602ac44700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60240ffcb0 0x7f6024101090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:28.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f602ac44700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6024100640 0x7f60241015d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:28.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f602ac44700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024101d70 con 0x7f60240feac0 2023-03-02T10:56:28.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f602ac44700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024101ee0 con 0x7f60240ffcb0 2023-03-02T10:56:28.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f602ac44700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602419f8c0 con 0x7f6024100640 2023-03-02T10:56:28.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f60289e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60240feac0 0x7f6024102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:28.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f60289e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60240feac0 0x7f6024102a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45496/0 (socket says 172.21.15.57:45496) 2023-03-02T10:56:28.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f60289e0700 1 -- 172.21.15.57:0/2428985309 learned_addr learned my addr 172.21.15.57:0/2428985309 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:28.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f601bfff700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60240ffcb0 0x7f6024101090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:28.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f60291e1700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6024100640 0x7f60241015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:28.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f60289e0700 1 -- 172.21.15.57:0/2428985309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6024100640 msgr2=0x7f60241015d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:28.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f60289e0700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6024100640 0x7f60241015d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:28.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f60289e0700 1 -- 172.21.15.57:0/2428985309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60240ffcb0 msgr2=0x7f6024101090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:28.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f60289e0700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60240ffcb0 0x7f6024101090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:28.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f60289e0700 1 -- 172.21.15.57:0/2428985309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200095f0 con 0x7f60240feac0 2023-03-02T10:56:28.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f60291e1700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6024100640 0x7f60241015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:56:28.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.602+0000 7f60289e0700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60240feac0 0x7f6024102a50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6020000c00 tx=0x7f60200047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:28.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.603+0000 7f6019ffb700 1 -- 172.21.15.57:0/2428985309 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602001d070 con 0x7f60240feac0 2023-03-02T10:56:28.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.603+0000 7f6019ffb700 1 -- 172.21.15.57:0/2428985309 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6020004200 con 0x7f60240feac0 2023-03-02T10:56:28.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.603+0000 7f602ac44700 1 -- 172.21.15.57:0/2428985309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602410a420 con 0x7f60240feac0 2023-03-02T10:56:28.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.603+0000 7f6019ffb700 1 -- 172.21.15.57:0/2428985309 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602000f460 con 0x7f60240feac0 2023-03-02T10:56:28.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.603+0000 7f602ac44700 1 -- 172.21.15.57:0/2428985309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602410a290 con 0x7f60240feac0 2023-03-02T10:56:28.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.604+0000 7f602ac44700 1 -- 172.21.15.57:0/2428985309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602419fef0 con 0x7f60240feac0 2023-03-02T10:56:28.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.605+0000 7f6019ffb700 1 -- 172.21.15.57:0/2428985309 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f6020029030 con 0x7f60240feac0 2023-03-02T10:56:28.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.606+0000 7f6019ffb700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f600c09b3a0 0x7f600c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:28.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.606+0000 7f6019ffb700 1 -- 172.21.15.57:0/2428985309 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f60200c62d0 con 0x7f60240feac0 2023-03-02T10:56:28.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.606+0000 7f601bfff700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f600c09b3a0 0x7f600c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:28.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.607+0000 7f601bfff700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f600c09b3a0 0x7f600c09d850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f601400ac50 tx=0x7f601400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:28.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.610+0000 7f6019ffb700 1 -- 172.21.15.57:0/2428985309 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f6020091c30 con 0x7f60240feac0 2023-03-02T10:56:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:28 smithi057 ceph-mon[92072]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-03-02T10:56:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:28 smithi122 ceph-mon[125440]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-03-02T10:56:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:28 smithi136 ceph-mon[125702]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-03-02T10:56:28.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.855+0000 7f602ac44700 1 -- 172.21.15.57:0/2428985309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f60241a04a0 con 0x7f60240feac0 2023-03-02T10:56:28.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.855+0000 7f6019ffb700 1 -- 172.21.15.57:0/2428985309 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+2929 (secure 0 0 0) 0x7f6020027b90 con 0x7f60240feac0 2023-03-02T10:56:28.857 INFO:teuthology.orchestra.run.smithi057.stdout:e26 2023-03-02T10:56:28.858 INFO:teuthology.orchestra.run.smithi057.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-03-02T10:56:28.858 INFO:teuthology.orchestra.run.smithi057.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-03-02T10:56:28.858 INFO:teuthology.orchestra.run.smithi057.stdout:legacy client fscid: 1 2023-03-02T10:56:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:28.858 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem 'cephfs' (1) 2023-03-02T10:56:28.858 INFO:teuthology.orchestra.run.smithi057.stdout:fs_name cephfs 2023-03-02T10:56:28.858 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 26 2023-03-02T10:56:28.859 INFO:teuthology.orchestra.run.smithi057.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-03-02T10:56:28.859 INFO:teuthology.orchestra.run.smithi057.stdout:created 2023-03-02T10:55:10.601054+0000 2023-03-02T10:56:28.859 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2023-03-02T10:55:17.554509+0000 2023-03-02T10:56:28.859 INFO:teuthology.orchestra.run.smithi057.stdout:tableserver 0 2023-03-02T10:56:28.859 INFO:teuthology.orchestra.run.smithi057.stdout:root 0 2023-03-02T10:56:28.859 INFO:teuthology.orchestra.run.smithi057.stdout:session_timeout 300 2023-03-02T10:56:28.859 INFO:teuthology.orchestra.run.smithi057.stdout:session_autoclose 300 2023-03-02T10:56:28.860 INFO:teuthology.orchestra.run.smithi057.stdout:max_file_size 1099511627776 2023-03-02T10:56:28.860 INFO:teuthology.orchestra.run.smithi057.stdout:max_xattr_size 65536 2023-03-02T10:56:28.860 INFO:teuthology.orchestra.run.smithi057.stdout:required_client_features {} 2023-03-02T10:56:28.860 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure 0 2023-03-02T10:56:28.860 INFO:teuthology.orchestra.run.smithi057.stdout:last_failure_osd_epoch 0 2023-03-02T10:56:28.860 INFO:teuthology.orchestra.run.smithi057.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-03-02T10:56:28.860 INFO:teuthology.orchestra.run.smithi057.stdout:max_mds 5 2023-03-02T10:56:28.860 INFO:teuthology.orchestra.run.smithi057.stdout:in 0,1,2,3,4 2023-03-02T10:56:28.861 INFO:teuthology.orchestra.run.smithi057.stdout:up {0=24560,1=24520,2=24505,3=24493,4=24491} 2023-03-02T10:56:28.861 INFO:teuthology.orchestra.run.smithi057.stdout:failed 2023-03-02T10:56:28.861 INFO:teuthology.orchestra.run.smithi057.stdout:damaged 2023-03-02T10:56:28.861 INFO:teuthology.orchestra.run.smithi057.stdout:stopped 2023-03-02T10:56:28.861 INFO:teuthology.orchestra.run.smithi057.stdout:data_pools [3] 2023-03-02T10:56:28.861 INFO:teuthology.orchestra.run.smithi057.stdout:metadata_pool 2 2023-03-02T10:56:28.861 INFO:teuthology.orchestra.run.smithi057.stdout:inline_data disabled 2023-03-02T10:56:28.862 INFO:teuthology.orchestra.run.smithi057.stdout:balancer 2023-03-02T10:56:28.862 INFO:teuthology.orchestra.run.smithi057.stdout:bal_rank_mask -1 2023-03-02T10:56:28.862 INFO:teuthology.orchestra.run.smithi057.stdout:standby_count_wanted 0 2023-03-02T10:56:28.862 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b{0:24560} state up:active seq 3 addr [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.862 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.k{0:24458} state up:standby-replay seq 1 addr [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.862 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.i{1:24520} state up:active seq 6 addr [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.862 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.l{1:24451} state up:standby-replay seq 1 addr [v2:172.21.15.136:6832/2838612280,v1:172.21.15.136:6833/2838612280] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.862 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c{2:24505} state up:active seq 7 addr [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.863 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a{2:14634} state up:standby-replay seq 1 addr [v2:172.21.15.57:6840/3731858530,v1:172.21.15.57:6841/3731858530] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.863 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.f{3:24493} state up:active seq 8 addr [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.863 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.g{3:14622} state up:standby-replay seq 1 addr [v2:172.21.15.57:6838/1832653465,v1:172.21.15.57:6839/1832653465] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.863 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.e{4:24491} state up:active seq 9 addr [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.863 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.h{4:14598} state up:standby-replay seq 1 addr [v2:172.21.15.122:6836/2380932917,v1:172.21.15.122:6837/2380932917] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:28.864 INFO:teuthology.orchestra.run.smithi057.stdout:Standby daemons: 2023-03-02T10:56:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:28.864 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.j{-1:14547} state up:standby seq 1 addr [v2:172.21.15.57:6834/4011698957,v1:172.21.15.57:6835/4011698957] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.864 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d{-1:14559} state up:standby seq 1 addr [v2:172.21.15.57:6836/3098678156,v1:172.21.15.57:6837/3098678156] compat {c=[1],r=[1],i=[7ff]}] 2023-03-02T10:56:28.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 -- 172.21.15.57:0/2428985309 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f600c09b3a0 msgr2=0x7f600c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:28.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f600c09b3a0 0x7f600c09d850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f601400ac50 tx=0x7f601400a380 comp rx=0 tx=0).stop 2023-03-02T10:56:28.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 -- 172.21.15.57:0/2428985309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60240feac0 msgr2=0x7f6024102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:28.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60240feac0 0x7f6024102a50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6020000c00 tx=0x7f60200047b0 comp rx=0 tx=0).stop 2023-03-02T10:56:28.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 -- 172.21.15.57:0/2428985309 shutdown_connections 2023-03-02T10:56:28.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f600c09b3a0 0x7f600c09d850 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:28.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6024100640 0x7f60241015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:28.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60240feac0 0x7f6024102a50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:28.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 --2- 172.21.15.57:0/2428985309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60240ffcb0 0x7f6024101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:28.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 -- 172.21.15.57:0/2428985309 >> 172.21.15.57:0/2428985309 conn(0x7f60240fa0a0 msgr2=0x7f6024067f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:28.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 -- 172.21.15.57:0/2428985309 shutdown_connections 2023-03-02T10:56:28.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:28.857+0000 7f602ac44700 1 -- 172.21.15.57:0/2428985309 wait complete. 2023-03-02T10:56:28.866 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-03-02T10:56:29.413 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- bash -c 'ceph osd dump' 2023-03-02T10:56:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:29 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2428985309' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-03-02T10:56:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:29 smithi057 ceph-mon[92072]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:56:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:29 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2428985309' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-03-02T10:56:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:29 smithi136 ceph-mon[125702]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:56:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:29 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2428985309' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-03-02T10:56:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:29 smithi122 ceph-mon[125440]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:56:30.152 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:56:31.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.525+0000 7f8f05357700 1 -- 172.21.15.57:0/1222462343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f000ffcb0 msgr2=0x7f8f00100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:31.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.525+0000 7f8f05357700 1 --2- 172.21.15.57:0/1222462343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f000ffcb0 0x7f8f00100100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009990 tx=0x7f8ee8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:31.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.525+0000 7f8f05357700 1 -- 172.21.15.57:0/1222462343 shutdown_connections 2023-03-02T10:56:31.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.525+0000 7f8f05357700 1 --2- 172.21.15.57:0/1222462343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f00100640 0x7f8f00106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:31.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.525+0000 7f8f05357700 1 --2- 172.21.15.57:0/1222462343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f000feac0 0x7f8f000feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:31.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.525+0000 7f8f05357700 1 --2- 172.21.15.57:0/1222462343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f000ffcb0 0x7f8f00100100 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:31.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.525+0000 7f8f05357700 1 -- 172.21.15.57:0/1222462343 >> 172.21.15.57:0/1222462343 conn(0x7f8f000fa0a0 msgr2=0x7f8f000fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:31.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.525+0000 7f8f05357700 1 -- 172.21.15.57:0/1222462343 shutdown_connections 2023-03-02T10:56:31.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.525+0000 7f8f05357700 1 -- 172.21.15.57:0/1222462343 wait complete. 2023-03-02T10:56:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.525+0000 7f8f05357700 1 Processor -- start 2023-03-02T10:56:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8f05357700 1 -- start start 2023-03-02T10:56:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8f05357700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f000feac0 0x7f8f000689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8f05357700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f000ffcb0 0x7f8f0019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8f05357700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f00100640 0x7f8f0019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8f05357700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0019d510 con 0x7f8f00100640 2023-03-02T10:56:31.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8f05357700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0019d680 con 0x7f8f000ffcb0 2023-03-02T10:56:31.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8f05357700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0019d840 con 0x7f8f000feac0 2023-03-02T10:56:31.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8eff7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f00100640 0x7f8f0019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:31.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8eff7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f00100640 0x7f8f0019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45520/0 (socket says 172.21.15.57:45520) 2023-03-02T10:56:31.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8eff7fe700 1 -- 172.21.15.57:0/1569683930 learned_addr learned my addr 172.21.15.57:0/1569683930 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:31.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8efeffd700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f000feac0 0x7f8f000689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:31.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8ef7fff700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f000ffcb0 0x7f8f0019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8eff7fe700 1 -- 172.21.15.57:0/1569683930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f000feac0 msgr2=0x7f8f000689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8eff7fe700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f000feac0 0x7f8f000689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8eff7fe700 1 -- 172.21.15.57:0/1569683930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f000ffcb0 msgr2=0x7f8f0019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8eff7fe700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f000ffcb0 0x7f8f0019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.526+0000 7f8eff7fe700 1 -- 172.21.15.57:0/1569683930 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee80095f0 con 0x7f8f00100640 2023-03-02T10:56:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.527+0000 7f8eff7fe700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f00100640 0x7f8f0019cd40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8007ee0 tx=0x7f8ef800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.527+0000 7f8efcff9700 1 -- 172.21.15.57:0/1569683930 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8017070 con 0x7f8f00100640 2023-03-02T10:56:31.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.527+0000 7f8efcff9700 1 -- 172.21.15.57:0/1569683930 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ef800f040 con 0x7f8f00100640 2023-03-02T10:56:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.527+0000 7f8f05357700 1 -- 172.21.15.57:0/1569683930 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0010a4c0 con 0x7f8f00100640 2023-03-02T10:56:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.527+0000 7f8efcff9700 1 -- 172.21.15.57:0/1569683930 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8005740 con 0x7f8f00100640 2023-03-02T10:56:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.527+0000 7f8f05357700 1 -- 172.21.15.57:0/1569683930 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0010a330 con 0x7f8f00100640 2023-03-02T10:56:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.528+0000 7f8f05357700 1 -- 172.21.15.57:0/1569683930 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f00106050 con 0x7f8f00100640 2023-03-02T10:56:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.529+0000 7f8efcff9700 1 -- 172.21.15.57:0/1569683930 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f8ef80058a0 con 0x7f8f00100640 2023-03-02T10:56:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.531+0000 7f8efcff9700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8eec09b420 0x7f8eec09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.531+0000 7f8efeffd700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8eec09b420 0x7f8eec09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.531+0000 7f8efcff9700 1 -- 172.21.15.57:0/1569683930 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8ef80c4900 con 0x7f8f00100640 2023-03-02T10:56:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.531+0000 7f8efeffd700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8eec09b420 0x7f8eec09d8d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0006fd0 tx=0x7f8ef0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:31.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.535+0000 7f8efcff9700 1 -- 172.21.15.57:0/1569683930 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f8ef80901d0 con 0x7f8f00100640 2023-03-02T10:56:31.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.735+0000 7f8f05357700 1 -- 172.21.15.57:0/1569683930 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f8f0002cd50 con 0x7f8f00100640 2023-03-02T10:56:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.735+0000 7f8efcff9700 1 -- 172.21.15.57:0/1569683930 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v86) v1 ==== 56+0+5289 (secure 0 0 0) 0x7f8ef80937f0 con 0x7f8f00100640 2023-03-02T10:56:31.737 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 86 2023-03-02T10:56:31.738 INFO:teuthology.orchestra.run.smithi057.stdout:fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c 2023-03-02T10:56:31.738 INFO:teuthology.orchestra.run.smithi057.stdout:created 2023-03-02T10:47:58.477515+0000 2023-03-02T10:56:31.738 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2023-03-02T10:55:50.530934+0000 2023-03-02T10:56:31.738 INFO:teuthology.orchestra.run.smithi057.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-03-02T10:56:31.738 INFO:teuthology.orchestra.run.smithi057.stdout:crush_version 26 2023-03-02T10:56:31.738 INFO:teuthology.orchestra.run.smithi057.stdout:full_ratio 0.95 2023-03-02T10:56:31.738 INFO:teuthology.orchestra.run.smithi057.stdout:backfillfull_ratio 0.9 2023-03-02T10:56:31.739 INFO:teuthology.orchestra.run.smithi057.stdout:nearfull_ratio 0.85 2023-03-02T10:56:31.739 INFO:teuthology.orchestra.run.smithi057.stdout:require_min_compat_client luminous 2023-03-02T10:56:31.739 INFO:teuthology.orchestra.run.smithi057.stdout:min_compat_client luminous 2023-03-02T10:56:31.739 INFO:teuthology.orchestra.run.smithi057.stdout:require_osd_release reef 2023-03-02T10:56:31.739 INFO:teuthology.orchestra.run.smithi057.stdout:stretch_mode_enabled false 2023-03-02T10:56:31.739 INFO:teuthology.orchestra.run.smithi057.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-03-02T10:56:31.739 INFO:teuthology.orchestra.run.smithi057.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-03-02T10:56:31.740 INFO:teuthology.orchestra.run.smithi057.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-03-02T10:56:31.740 INFO:teuthology.orchestra.run.smithi057.stdout:max_osd 12 2023-03-02T10:56:31.740 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6802/3424789568,v1:172.21.15.57:6803/3424789568] [v2:172.21.15.57:6804/3424789568,v1:172.21.15.57:6805/3424789568] exists,up 3cfc44e0-909d-44b5-8e46-9b49c6b752c5 2023-03-02T10:56:31.740 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 up in weight 1 up_from 13 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/3137030717,v1:172.21.15.122:6801/3137030717] [v2:172.21.15.122:6802/3137030717,v1:172.21.15.122:6803/3137030717] exists,up ca0af291-6446-4019-a4cd-16a4998db8da 2023-03-02T10:56:31.740 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 up in weight 1 up_from 18 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6800/3723258212,v1:172.21.15.136:6801/3723258212] [v2:172.21.15.136:6802/3723258212,v1:172.21.15.136:6803/3723258212] exists,up b0882e69-9661-4006-9350-108c73b8cbcc 2023-03-02T10:56:31.740 INFO:teuthology.orchestra.run.smithi057.stdout:osd.3 up in weight 1 up_from 26 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6810/137683841,v1:172.21.15.57:6811/137683841] [v2:172.21.15.57:6812/137683841,v1:172.21.15.57:6813/137683841] exists,up 6780f146-3f9c-486e-8c2c-415f2e8190e8 2023-03-02T10:56:31.740 INFO:teuthology.orchestra.run.smithi057.stdout:osd.4 up in weight 1 up_from 34 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6808/2152605996,v1:172.21.15.122:6809/2152605996] [v2:172.21.15.122:6810/2152605996,v1:172.21.15.122:6811/2152605996] exists,up f79aa927-c257-4a89-a24a-d235a136cd70 2023-03-02T10:56:31.740 INFO:teuthology.orchestra.run.smithi057.stdout:osd.5 up in weight 1 up_from 39 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6808/3384464400,v1:172.21.15.136:6809/3384464400] [v2:172.21.15.136:6810/3384464400,v1:172.21.15.136:6811/3384464400] exists,up 805a1c8d-9f65-42ac-b478-d085491724a0 2023-03-02T10:56:31.741 INFO:teuthology.orchestra.run.smithi057.stdout:osd.6 up in weight 1 up_from 47 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6818/2002099280,v1:172.21.15.57:6819/2002099280] [v2:172.21.15.57:6820/2002099280,v1:172.21.15.57:6821/2002099280] exists,up 818fc49e-7291-4275-82c8-ee8b86ae5676 2023-03-02T10:56:31.741 INFO:teuthology.orchestra.run.smithi057.stdout:osd.7 up in weight 1 up_from 52 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6816/3795364822,v1:172.21.15.122:6817/3795364822] [v2:172.21.15.122:6818/3795364822,v1:172.21.15.122:6819/3795364822] exists,up 942b92f0-db14-4495-9b71-672ee373313c 2023-03-02T10:56:31.741 INFO:teuthology.orchestra.run.smithi057.stdout:osd.8 up in weight 1 up_from 59 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6816/4084154277,v1:172.21.15.136:6817/4084154277] [v2:172.21.15.136:6818/4084154277,v1:172.21.15.136:6819/4084154277] exists,up cfb28b1d-2458-4e6f-a849-6f14011393fe 2023-03-02T10:56:31.741 INFO:teuthology.orchestra.run.smithi057.stdout:osd.9 up in weight 1 up_from 66 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6826/1053351718,v1:172.21.15.57:6827/1053351718] [v2:172.21.15.57:6828/1053351718,v1:172.21.15.57:6829/1053351718] exists,up 6423cab2-6626-44c1-a9b3-109e1091a0ff 2023-03-02T10:56:31.741 INFO:teuthology.orchestra.run.smithi057.stdout:osd.10 up in weight 1 up_from 71 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6824/2262114576,v1:172.21.15.122:6825/2262114576] [v2:172.21.15.122:6826/2262114576,v1:172.21.15.122:6827/2262114576] exists,up affb12a9-38b2-4b1e-a4e0-64269959428c 2023-03-02T10:56:31.741 INFO:teuthology.orchestra.run.smithi057.stdout:osd.11 up in weight 1 up_from 79 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6824/3852616859,v1:172.21.15.136:6825/3852616859] [v2:172.21.15.136:6826/3852616859,v1:172.21.15.136:6827/3852616859] exists,up 7a0e8a36-2be5-40ea-945a-289748a2cfdb 2023-03-02T10:56:31.741 INFO:teuthology.orchestra.run.smithi057.stdout:pg_upmap_items 2.2 [7,11] 2023-03-02T10:56:31.741 INFO:teuthology.orchestra.run.smithi057.stdout:pg_upmap_items 2.b [2,4] 2023-03-02T10:56:31.742 INFO:teuthology.orchestra.run.smithi057.stdout:pg_upmap_items 2.f [8,11] 2023-03-02T10:56:31.742 INFO:teuthology.orchestra.run.smithi057.stdout:pg_upmap_items 2.1a [8,4] 2023-03-02T10:56:31.742 INFO:teuthology.orchestra.run.smithi057.stdout:pg_upmap_items 2.1d [2,1] 2023-03-02T10:56:31.742 INFO:teuthology.orchestra.run.smithi057.stdout:pg_upmap_items 3.3 [4,9] 2023-03-02T10:56:31.742 INFO:teuthology.orchestra.run.smithi057.stdout:pg_upmap_items 3.c [3,9] 2023-03-02T10:56:31.742 INFO:teuthology.orchestra.run.smithi057.stdout:pg_upmap_items 3.2c [4,9] 2023-03-02T10:56:31.742 INFO:teuthology.orchestra.run.smithi057.stdout:blocklist 172.21.15.57:6801/3127649723 expires 2023-03-03T10:48:48.778597+0000 2023-03-02T10:56:31.743 INFO:teuthology.orchestra.run.smithi057.stdout:blocklist 172.21.15.57:0/126285177 expires 2023-03-03T10:48:48.778597+0000 2023-03-02T10:56:31.743 INFO:teuthology.orchestra.run.smithi057.stdout:blocklist 172.21.15.57:0/3958644270 expires 2023-03-03T10:48:25.055116+0000 2023-03-02T10:56:31.743 INFO:teuthology.orchestra.run.smithi057.stdout:blocklist 172.21.15.57:0/1960665779 expires 2023-03-03T10:48:25.055116+0000 2023-03-02T10:56:31.743 INFO:teuthology.orchestra.run.smithi057.stdout:blocklist 172.21.15.57:0/1985055462 expires 2023-03-03T10:48:48.778597+0000 2023-03-02T10:56:31.743 INFO:teuthology.orchestra.run.smithi057.stdout:blocklist 172.21.15.57:6800/3078589149 expires 2023-03-03T10:48:25.055116+0000 2023-03-02T10:56:31.743 INFO:teuthology.orchestra.run.smithi057.stdout:blocklist 172.21.15.57:6801/3078589149 expires 2023-03-03T10:48:25.055116+0000 2023-03-02T10:56:31.743 INFO:teuthology.orchestra.run.smithi057.stdout:blocklist 172.21.15.57:6800/3127649723 expires 2023-03-03T10:48:48.778597+0000 2023-03-02T10:56:31.743 INFO:teuthology.orchestra.run.smithi057.stdout:blocklist 172.21.15.57:0/3996571687 expires 2023-03-03T10:48:25.055116+0000 2023-03-02T10:56:31.744 INFO:teuthology.orchestra.run.smithi057.stdout:blocklist 172.21.15.57:0/3295199770 expires 2023-03-03T10:48:48.778597+0000 2023-03-02T10:56:31.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 -- 172.21.15.57:0/1569683930 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8eec09b420 msgr2=0x7f8eec09d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:31.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8eec09b420 0x7f8eec09d8d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0006fd0 tx=0x7f8ef0008040 comp rx=0 tx=0).stop 2023-03-02T10:56:31.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 -- 172.21.15.57:0/1569683930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f00100640 msgr2=0x7f8f0019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:31.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f00100640 0x7f8f0019cd40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8007ee0 tx=0x7f8ef800d3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:31.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 -- 172.21.15.57:0/1569683930 shutdown_connections 2023-03-02T10:56:31.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8eec09b420 0x7f8eec09d8d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:31.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f00100640 0x7f8f0019cd40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:31.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f000feac0 0x7f8f000689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:31.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 --2- 172.21.15.57:0/1569683930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f000ffcb0 0x7f8f0019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:31.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 -- 172.21.15.57:0/1569683930 >> 172.21.15.57:0/1569683930 conn(0x7f8f000fa0a0 msgr2=0x7f8f00103190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:31.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 -- 172.21.15.57:0/1569683930 shutdown_connections 2023-03-02T10:56:31.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:31.738+0000 7f8f05357700 1 -- 172.21.15.57:0/1569683930 wait complete. 2023-03-02T10:56:32.250 INFO:teuthology.run_tasks:Running task fs.ready... 2023-03-02T10:56:32.279 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:56:32.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.438+0000 7fe09cfff700 1 -- 172.21.15.57:0/3722405969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0981005d0 msgr2=0x7fe098106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:32.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.438+0000 7fe09cfff700 1 --2- 172.21.15.57:0/3722405969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0981005d0 0x7fe098106e70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe09000b0a0 tx=0x7fe09000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.438+0000 7fe09cfff700 1 -- 172.21.15.57:0/3722405969 shutdown_connections 2023-03-02T10:56:32.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.438+0000 7fe09cfff700 1 --2- 172.21.15.57:0/3722405969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0981005d0 0x7fe098106e70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.438+0000 7fe09cfff700 1 --2- 172.21.15.57:0/3722405969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0980fe990 0x7fe0980feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.438+0000 7fe09cfff700 1 --2- 172.21.15.57:0/3722405969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ffc20 0x7fe098100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.438+0000 7fe09cfff700 1 -- 172.21.15.57:0/3722405969 >> 172.21.15.57:0/3722405969 conn(0x7fe0980f9fd0 msgr2=0x7fe0980fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:32.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.438+0000 7fe09cfff700 1 -- 172.21.15.57:0/3722405969 shutdown_connections 2023-03-02T10:56:32.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.438+0000 7fe09cfff700 1 -- 172.21.15.57:0/3722405969 wait complete. 2023-03-02T10:56:32.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe09cfff700 1 Processor -- start 2023-03-02T10:56:32.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe09cfff700 1 -- start start 2023-03-02T10:56:32.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe09cfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0980fe990 0x7fe098195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe09cfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ffc20 0x7fe098195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe09cfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0981005d0 0x7fe09819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe09cfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09819d480 con 0x7fe0980fe990 2023-03-02T10:56:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe09cfff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09819d5c0 con 0x7fe0980ffc20 2023-03-02T10:56:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe09cfff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09819d750 con 0x7fe0981005d0 2023-03-02T10:56:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe09659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0980fe990 0x7fe098195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe09659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0980fe990 0x7fe098195900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45542/0 (socket says 172.21.15.57:45542) 2023-03-02T10:56:32.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe09659c700 1 -- 172.21.15.57:0/1654119067 learned_addr learned my addr 172.21.15.57:0/1654119067 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:32.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe096d9d700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0981005d0 0x7fe09819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:32.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.439+0000 7fe08dd9b700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ffc20 0x7fe098195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:32.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe09659c700 1 -- 172.21.15.57:0/1654119067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0981005d0 msgr2=0x7fe09819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:32.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe09659c700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0981005d0 0x7fe09819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe09659c700 1 -- 172.21.15.57:0/1654119067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ffc20 msgr2=0x7fe098195e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:32.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe09659c700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ffc20 0x7fe098195e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe09659c700 1 -- 172.21.15.57:0/1654119067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe090009d00 con 0x7fe0980fe990 2023-03-02T10:56:32.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe08dd9b700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ffc20 0x7fe098195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:32.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe09659c700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0980fe990 0x7fe098195900 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe08800d980 tx=0x7fe08800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:32.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe08ffff700 1 -- 172.21.15.57:0/1654119067 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088004220 con 0x7fe0980fe990 2023-03-02T10:56:32.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe09cfff700 1 -- 172.21.15.57:0/1654119067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09810a2f0 con 0x7fe0980fe990 2023-03-02T10:56:32.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe08ffff700 1 -- 172.21.15.57:0/1654119067 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe088007640 con 0x7fe0980fe990 2023-03-02T10:56:32.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe08ffff700 1 -- 172.21.15.57:0/1654119067 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088005610 con 0x7fe0980fe990 2023-03-02T10:56:32.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.440+0000 7fe09cfff700 1 -- 172.21.15.57:0/1654119067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09810a160 con 0x7fe0980fe990 2023-03-02T10:56:32.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.441+0000 7fe09cfff700 1 -- 172.21.15.57:0/1654119067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe098067280 con 0x7fe0980fe990 2023-03-02T10:56:32.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.442+0000 7fe08ffff700 1 -- 172.21.15.57:0/1654119067 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fe088021070 con 0x7fe0980fe990 2023-03-02T10:56:32.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.443+0000 7fe08ffff700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe08409b3a0 0x7fe08409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:32.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.443+0000 7fe08ffff700 1 -- 172.21.15.57:0/1654119067 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe0880c4d80 con 0x7fe0980fe990 2023-03-02T10:56:32.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.443+0000 7fe08dd9b700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe08409b3a0 0x7fe08409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:32.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.444+0000 7fe08dd9b700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe08409b3a0 0x7fe08409d850 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe080005e10 tx=0x7fe080005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:32.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.448+0000 7fe08ffff700 1 -- 172.21.15.57:0/1654119067 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fe088090650 con 0x7fe0980fe990 2023-03-02T10:56:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:32 smithi136 ceph-mon[125702]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-03-02T10:56:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:32 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1569683930' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-03-02T10:56:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.646+0000 7fe09cfff700 1 -- 172.21.15.57:0/1654119067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe09819e3a0 con 0x7fe0980fe990 2023-03-02T10:56:32.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.648+0000 7fe08ffff700 1 -- 172.21.15.57:0/1654119067 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22553 (secure 0 0 0) 0x7fe088016070 con 0x7fe0980fe990 2023-03-02T10:56:32.650 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:32.651 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":86,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:50.530934+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:56:32.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 -- 172.21.15.57:0/1654119067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe08409b3a0 msgr2=0x7fe08409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:32.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe08409b3a0 0x7fe08409d850 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe080005e10 tx=0x7fe080005d60 comp rx=0 tx=0).stop 2023-03-02T10:56:32.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 -- 172.21.15.57:0/1654119067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0980fe990 msgr2=0x7fe098195900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:32.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0980fe990 0x7fe098195900 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe08800d980 tx=0x7fe08800dc90 comp rx=0 tx=0).stop 2023-03-02T10:56:32.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 -- 172.21.15.57:0/1654119067 shutdown_connections 2023-03-02T10:56:32.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fe08409b3a0 0x7fe08409d850 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0981005d0 0x7fe09819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0980fe990 0x7fe098195900 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 --2- 172.21.15.57:0/1654119067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ffc20 0x7fe098195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 -- 172.21.15.57:0/1654119067 >> 172.21.15.57:0/1654119067 conn(0x7fe0980f9fd0 msgr2=0x7fe0980676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:32.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 -- 172.21.15.57:0/1654119067 shutdown_connections 2023-03-02T10:56:32.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.650+0000 7fe09cfff700 1 -- 172.21.15.57:0/1654119067 wait complete. 2023-03-02T10:56:32.666 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:32 smithi057 ceph-mon[92072]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-03-02T10:56:32.666 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:32 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1569683930' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-03-02T10:56:32.668 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-02T10:51:03.600226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-02T10:55:08.504787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-02T10:55:09.909014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-02T10:56:32.669 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-02T10:56:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:32 smithi122 ceph-mon[125440]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-03-02T10:56:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:32 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1569683930' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-03-02T10:56:32.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.825+0000 7f00ab1ff700 1 -- 172.21.15.57:0/1612851512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a4102ed0 msgr2=0x7f00a41052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:32.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.825+0000 7f00ab1ff700 1 --2- 172.21.15.57:0/1612851512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a4102ed0 0x7f00a41052b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0094009990 tx=0x7f0094009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.825+0000 7f00ab1ff700 1 -- 172.21.15.57:0/1612851512 shutdown_connections 2023-03-02T10:56:32.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.825+0000 7f00ab1ff700 1 --2- 172.21.15.57:0/1612851512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00a41057f0 0x7f00a4107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.825+0000 7f00ab1ff700 1 --2- 172.21.15.57:0/1612851512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00a41005b0 0x7f00a4102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.825+0000 7f00ab1ff700 1 --2- 172.21.15.57:0/1612851512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a4102ed0 0x7f00a41052b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.825+0000 7f00ab1ff700 1 -- 172.21.15.57:0/1612851512 >> 172.21.15.57:0/1612851512 conn(0x7f00a40f9fd0 msgr2=0x7f00a40fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:32.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.825+0000 7f00ab1ff700 1 -- 172.21.15.57:0/1612851512 shutdown_connections 2023-03-02T10:56:32.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.825+0000 7f00ab1ff700 1 -- 172.21.15.57:0/1612851512 wait complete. 2023-03-02T10:56:32.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00ab1ff700 1 Processor -- start 2023-03-02T10:56:32.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00ab1ff700 1 -- start start 2023-03-02T10:56:32.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00ab1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a41005b0 0x7f00a40fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:32.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00ab1ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00a4102ed0 0x7f00a40fe560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:32.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00ab1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00a41057f0 0x7f00a40feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00ab1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a40ff240 con 0x7f00a41005b0 2023-03-02T10:56:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00ab1ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a40ff3b0 con 0x7f00a4102ed0 2023-03-02T10:56:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00ab1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a419f890 con 0x7f00a41057f0 2023-03-02T10:56:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00a8f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a41005b0 0x7f00a40fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00a8f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a41005b0 0x7f00a40fff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45558/0 (socket says 172.21.15.57:45558) 2023-03-02T10:56:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00a8f9b700 1 -- 172.21.15.57:0/2337040409 learned_addr learned my addr 172.21.15.57:0/2337040409 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f009bfff700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00a4102ed0 0x7f00a40fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.826+0000 7f00a979c700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00a41057f0 0x7f00a40feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.827+0000 7f00a8f9b700 1 -- 172.21.15.57:0/2337040409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00a41057f0 msgr2=0x7f00a40feaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.827+0000 7f00a8f9b700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00a41057f0 0x7f00a40feaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.827+0000 7f00a8f9b700 1 -- 172.21.15.57:0/2337040409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00a4102ed0 msgr2=0x7f00a40fe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.827+0000 7f00a8f9b700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00a4102ed0 0x7f00a40fe560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.827+0000 7f00a8f9b700 1 -- 172.21.15.57:0/2337040409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940095f0 con 0x7f00a41005b0 2023-03-02T10:56:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.827+0000 7f00a8f9b700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a41005b0 0x7f00a40fff20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f00a000d980 tx=0x7f00a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.827+0000 7f0099ffb700 1 -- 172.21.15.57:0/2337040409 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0009930 con 0x7f00a41005b0 2023-03-02T10:56:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.827+0000 7f00ab1ff700 1 -- 172.21.15.57:0/2337040409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a410b420 con 0x7f00a41005b0 2023-03-02T10:56:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.827+0000 7f0099ffb700 1 -- 172.21.15.57:0/2337040409 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00a0010460 con 0x7f00a41005b0 2023-03-02T10:56:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.827+0000 7f0099ffb700 1 -- 172.21.15.57:0/2337040409 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a000f620 con 0x7f00a41005b0 2023-03-02T10:56:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.827+0000 7f00ab1ff700 1 -- 172.21.15.57:0/2337040409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a410b290 con 0x7f00a41005b0 2023-03-02T10:56:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.828+0000 7f00ab1ff700 1 -- 172.21.15.57:0/2337040409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a40fbb40 con 0x7f00a41005b0 2023-03-02T10:56:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.829+0000 7f0099ffb700 1 -- 172.21.15.57:0/2337040409 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f00a0022070 con 0x7f00a41005b0 2023-03-02T10:56:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.830+0000 7f0099ffb700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f008c09b3a0 0x7f008c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.830+0000 7f0099ffb700 1 -- 172.21.15.57:0/2337040409 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f00a00c4900 con 0x7f00a41005b0 2023-03-02T10:56:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.830+0000 7f009bfff700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f008c09b3a0 0x7f008c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.831+0000 7f009bfff700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f008c09b3a0 0x7f008c09d850 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f009400b5c0 tx=0x7f0094005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:32.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:32.834+0000 7f0099ffb700 1 -- 172.21.15.57:0/2337040409 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f00a00901d0 con 0x7f00a41005b0 2023-03-02T10:56:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.029+0000 7f00ab1ff700 1 -- 172.21.15.57:0/2337040409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00a4061450 con 0x7f00a41005b0 2023-03-02T10:56:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.029+0000 7f0099ffb700 1 -- 172.21.15.57:0/2337040409 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00a0017020 con 0x7f00a41005b0 2023-03-02T10:56:33.031 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-02T10:56:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 -- 172.21.15.57:0/2337040409 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f008c09b3a0 msgr2=0x7f008c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f008c09b3a0 0x7f008c09d850 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f009400b5c0 tx=0x7f0094005fd0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 -- 172.21.15.57:0/2337040409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a41005b0 msgr2=0x7f00a40fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a41005b0 0x7f00a40fff20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f00a000d980 tx=0x7f00a000dc90 comp rx=0 tx=0).stop 2023-03-02T10:56:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 -- 172.21.15.57:0/2337040409 shutdown_connections 2023-03-02T10:56:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f008c09b3a0 0x7f008c09d850 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00a41057f0 0x7f00a40feaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a41005b0 0x7f00a40fff20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 --2- 172.21.15.57:0/2337040409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00a4102ed0 0x7f00a40fe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 -- 172.21.15.57:0/2337040409 >> 172.21.15.57:0/2337040409 conn(0x7f00a40f9fd0 msgr2=0x7f00a4101270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 -- 172.21.15.57:0/2337040409 shutdown_connections 2023-03-02T10:56:33.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.031+0000 7f00ab1ff700 1 -- 172.21.15.57:0/2337040409 wait complete. 2023-03-02T10:56:33.049 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-02T10:56:33.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.204+0000 7ff1287ff700 1 -- 172.21.15.57:0/2772914375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1201057e0 msgr2=0x7ff120107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.204+0000 7ff1287ff700 1 --2- 172.21.15.57:0/2772914375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1201057e0 0x7ff120107be0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff11800b0a0 tx=0x7ff11800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.204+0000 7ff1287ff700 1 -- 172.21.15.57:0/2772914375 shutdown_connections 2023-03-02T10:56:33.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.204+0000 7ff1287ff700 1 --2- 172.21.15.57:0/2772914375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1201057e0 0x7ff120107be0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.204+0000 7ff1287ff700 1 --2- 172.21.15.57:0/2772914375 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1201005a0 0x7ff120102980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.204+0000 7ff1287ff700 1 --2- 172.21.15.57:0/2772914375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff120102ec0 0x7ff1201052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.204+0000 7ff1287ff700 1 -- 172.21.15.57:0/2772914375 >> 172.21.15.57:0/2772914375 conn(0x7ff1200f9fe0 msgr2=0x7ff1200fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:33.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.204+0000 7ff1287ff700 1 -- 172.21.15.57:0/2772914375 shutdown_connections 2023-03-02T10:56:33.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.204+0000 7ff1287ff700 1 -- 172.21.15.57:0/2772914375 wait complete. 2023-03-02T10:56:33.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.205+0000 7ff1287ff700 1 Processor -- start 2023-03-02T10:56:33.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.205+0000 7ff1287ff700 1 -- start start 2023-03-02T10:56:33.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.205+0000 7ff1287ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1201005a0 0x7ff1201958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.205+0000 7ff1287ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff120102ec0 0x7ff120195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.205+0000 7ff1287ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1201057e0 0x7ff12019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.205+0000 7ff1287ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12019d440 con 0x7ff1201057e0 2023-03-02T10:56:33.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.205+0000 7ff1287ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12019d580 con 0x7ff120102ec0 2023-03-02T10:56:33.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.205+0000 7ff1287ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12019d710 con 0x7ff1201005a0 2023-03-02T10:56:33.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff126d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1201057e0 0x7ff12019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff126d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1201057e0 0x7ff12019ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45584/0 (socket says 172.21.15.57:45584) 2023-03-02T10:56:33.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff126d9c700 1 -- 172.21.15.57:0/2496749711 learned_addr learned my addr 172.21.15.57:0/2496749711 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:33.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff12659b700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1201005a0 0x7ff1201958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff125d9a700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff120102ec0 0x7ff120195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff126d9c700 1 -- 172.21.15.57:0/2496749711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1201005a0 msgr2=0x7ff1201958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff126d9c700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1201005a0 0x7ff1201958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff126d9c700 1 -- 172.21.15.57:0/2496749711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff120102ec0 msgr2=0x7ff120195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff126d9c700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff120102ec0 0x7ff120195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff126d9c700 1 -- 172.21.15.57:0/2496749711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff118009d00 con 0x7ff1201057e0 2023-03-02T10:56:33.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff126d9c700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1201057e0 0x7ff12019ce70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff11800b780 tx=0x7ff11800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:33.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff1177fe700 1 -- 172.21.15.57:0/2496749711 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11800e040 con 0x7ff1201057e0 2023-03-02T10:56:33.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff1177fe700 1 -- 172.21.15.57:0/2496749711 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff118004c50 con 0x7ff1201057e0 2023-03-02T10:56:33.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff1287ff700 1 -- 172.21.15.57:0/2496749711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12010b400 con 0x7ff1201057e0 2023-03-02T10:56:33.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff1177fe700 1 -- 172.21.15.57:0/2496749711 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180053b0 con 0x7ff1201057e0 2023-03-02T10:56:33.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.206+0000 7ff1287ff700 1 -- 172.21.15.57:0/2496749711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12010b270 con 0x7ff1201057e0 2023-03-02T10:56:33.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.207+0000 7ff1287ff700 1 -- 172.21.15.57:0/2496749711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1200fbb50 con 0x7ff1201057e0 2023-03-02T10:56:33.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.210+0000 7ff1177fe700 1 -- 172.21.15.57:0/2496749711 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7ff11801d9c0 con 0x7ff1201057e0 2023-03-02T10:56:33.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.211+0000 7ff1177fe700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff10c09b420 0x7ff10c09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.211+0000 7ff1177fe700 1 -- 172.21.15.57:0/2496749711 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff1180c6990 con 0x7ff1201057e0 2023-03-02T10:56:33.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.211+0000 7ff12659b700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff10c09b420 0x7ff10c09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.211+0000 7ff12659b700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff10c09b420 0x7ff10c09d8d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009c60 tx=0x7ff11c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:33.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.212+0000 7ff1177fe700 1 -- 172.21.15.57:0/2496749711 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7ff118092350 con 0x7ff1201057e0 2023-03-02T10:56:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.411+0000 7ff1287ff700 1 -- 172.21.15.57:0/2496749711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1200611a0 con 0x7ff1201057e0 2023-03-02T10:56:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.411+0000 7ff1177fe700 1 -- 172.21.15.57:0/2496749711 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff118095970 con 0x7ff1201057e0 2023-03-02T10:56:33.413 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-03-02T10:56:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 -- 172.21.15.57:0/2496749711 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff10c09b420 msgr2=0x7ff10c09d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff10c09b420 0x7ff10c09d8d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009c60 tx=0x7ff11c009260 comp rx=0 tx=0).stop 2023-03-02T10:56:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 -- 172.21.15.57:0/2496749711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1201057e0 msgr2=0x7ff12019ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1201057e0 0x7ff12019ce70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff11800b780 tx=0x7ff11800bab0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 -- 172.21.15.57:0/2496749711 shutdown_connections 2023-03-02T10:56:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff10c09b420 0x7ff10c09d8d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1201057e0 0x7ff12019ce70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1201005a0 0x7ff1201958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 --2- 172.21.15.57:0/2496749711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff120102ec0 0x7ff120195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 -- 172.21.15.57:0/2496749711 >> 172.21.15.57:0/2496749711 conn(0x7ff1200f9fe0 msgr2=0x7ff1201011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:33.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 -- 172.21.15.57:0/2496749711 shutdown_connections 2023-03-02T10:56:33.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.414+0000 7ff1287ff700 1 -- 172.21.15.57:0/2496749711 wait complete. 2023-03-02T10:56:33.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-02T10:56:33.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.587+0000 7fa6567ff700 1 -- 172.21.15.57:0/3929063160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa650102ed0 msgr2=0x7fa6501052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.587+0000 7fa6567ff700 1 --2- 172.21.15.57:0/3929063160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa650102ed0 0x7fa6501052b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa644009990 tx=0x7fa644009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.587+0000 7fa6567ff700 1 -- 172.21.15.57:0/3929063160 shutdown_connections 2023-03-02T10:56:33.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.587+0000 7fa6567ff700 1 --2- 172.21.15.57:0/3929063160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6501057f0 0x7fa650107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.587+0000 7fa6567ff700 1 --2- 172.21.15.57:0/3929063160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6501005b0 0x7fa650102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.587+0000 7fa6567ff700 1 --2- 172.21.15.57:0/3929063160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa650102ed0 0x7fa6501052b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.587+0000 7fa6567ff700 1 -- 172.21.15.57:0/3929063160 >> 172.21.15.57:0/3929063160 conn(0x7fa6500f9fd0 msgr2=0x7fa6500fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:33.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.587+0000 7fa6567ff700 1 -- 172.21.15.57:0/3929063160 shutdown_connections 2023-03-02T10:56:33.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.587+0000 7fa6567ff700 1 -- 172.21.15.57:0/3929063160 wait complete. 2023-03-02T10:56:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa6567ff700 1 Processor -- start 2023-03-02T10:56:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa6567ff700 1 -- start start 2023-03-02T10:56:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa6567ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6501005b0 0x7fa650197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa6567ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa650102ed0 0x7fa650197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa6567ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6501057f0 0x7fa65019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa6567ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65019f590 con 0x7fa650102ed0 2023-03-02T10:56:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa6567ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65019f6d0 con 0x7fa6501005b0 2023-03-02T10:56:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa6567ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65019f860 con 0x7fa6501057f0 2023-03-02T10:56:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa64f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa650102ed0 0x7fa650197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa64f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa650102ed0 0x7fa650197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45596/0 (socket says 172.21.15.57:45596) 2023-03-02T10:56:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa64f7fe700 1 -- 172.21.15.57:0/3965865931 learned_addr learned my addr 172.21.15.57:0/3965865931 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa64ffff700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6501005b0 0x7fa650197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa654d9c700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6501057f0 0x7fa65019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa64f7fe700 1 -- 172.21.15.57:0/3965865931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6501057f0 msgr2=0x7fa65019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa64f7fe700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6501057f0 0x7fa65019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa64f7fe700 1 -- 172.21.15.57:0/3965865931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6501005b0 msgr2=0x7fa650197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa64f7fe700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6501005b0 0x7fa650197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.588+0000 7fa64f7fe700 1 -- 172.21.15.57:0/3965865931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6440095f0 con 0x7fa650102ed0 2023-03-02T10:56:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.589+0000 7fa64f7fe700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa650102ed0 0x7fa650197f50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa644000c00 tx=0x7fa64400f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.589+0000 7fa64d7fa700 1 -- 172.21.15.57:0/3965865931 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64401d070 con 0x7fa650102ed0 2023-03-02T10:56:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.589+0000 7fa64d7fa700 1 -- 172.21.15.57:0/3965865931 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa64400fb50 con 0x7fa650102ed0 2023-03-02T10:56:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.589+0000 7fa6567ff700 1 -- 172.21.15.57:0/3965865931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65010b420 con 0x7fa650102ed0 2023-03-02T10:56:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.589+0000 7fa64d7fa700 1 -- 172.21.15.57:0/3965865931 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440173f0 con 0x7fa650102ed0 2023-03-02T10:56:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.589+0000 7fa6567ff700 1 -- 172.21.15.57:0/3965865931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65010b290 con 0x7fa650102ed0 2023-03-02T10:56:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.590+0000 7fa6567ff700 1 -- 172.21.15.57:0/3965865931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa650107360 con 0x7fa650102ed0 2023-03-02T10:56:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.591+0000 7fa64d7fa700 1 -- 172.21.15.57:0/3965865931 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fa644029030 con 0x7fa650102ed0 2023-03-02T10:56:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.592+0000 7fa64d7fa700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa63809b3a0 0x7fa63809d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.592+0000 7fa64d7fa700 1 -- 172.21.15.57:0/3965865931 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa6440c6070 con 0x7fa650102ed0 2023-03-02T10:56:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.592+0000 7fa64ffff700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa63809b3a0 0x7fa63809d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.593+0000 7fa64ffff700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa63809b3a0 0x7fa63809d850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa640005950 tx=0x7fa64000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.596+0000 7fa64d7fa700 1 -- 172.21.15.57:0/3965865931 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fa6440919d0 con 0x7fa650102ed0 2023-03-02T10:56:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:33 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1654119067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:33 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2337040409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:33 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1654119067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:33 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2337040409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:33.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.797+0000 7fa6567ff700 1 -- 172.21.15.57:0/3965865931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6500616e0 con 0x7fa650102ed0 2023-03-02T10:56:33.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.797+0000 7fa64d7fa700 1 -- 172.21.15.57:0/3965865931 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa644094ff0 con 0x7fa650102ed0 2023-03-02T10:56:33.798 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-03-02T10:56:33.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 -- 172.21.15.57:0/3965865931 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa63809b3a0 msgr2=0x7fa63809d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa63809b3a0 0x7fa63809d850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa640005950 tx=0x7fa64000b410 comp rx=0 tx=0).stop 2023-03-02T10:56:33.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 -- 172.21.15.57:0/3965865931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa650102ed0 msgr2=0x7fa650197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa650102ed0 0x7fa650197f50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa644000c00 tx=0x7fa64400f710 comp rx=0 tx=0).stop 2023-03-02T10:56:33.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 -- 172.21.15.57:0/3965865931 shutdown_connections 2023-03-02T10:56:33.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fa63809b3a0 0x7fa63809d850 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6501057f0 0x7fa65019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6501005b0 0x7fa650197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 --2- 172.21.15.57:0/3965865931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa650102ed0 0x7fa650197f50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 -- 172.21.15.57:0/3965865931 >> 172.21.15.57:0/3965865931 conn(0x7fa6500f9fd0 msgr2=0x7fa6500fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:33.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 -- 172.21.15.57:0/3965865931 shutdown_connections 2023-03-02T10:56:33.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.800+0000 7fa6567ff700 1 -- 172.21.15.57:0/3965865931 wait complete. 2023-03-02T10:56:33.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:56:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:33 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1654119067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:33 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2337040409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:33.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.969+0000 7ff59f5ff700 1 -- 172.21.15.57:0/3117058769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff598100d50 msgr2=0x7ff5981011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.969+0000 7ff59f5ff700 1 --2- 172.21.15.57:0/3117058769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff598100d50 0x7ff5981011c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff588009990 tx=0x7ff588009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.969+0000 7ff59f5ff700 1 -- 172.21.15.57:0/3117058769 shutdown_connections 2023-03-02T10:56:33.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.969+0000 7ff59f5ff700 1 --2- 172.21.15.57:0/3117058769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff598101700 0x7ff598107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.969+0000 7ff59f5ff700 1 --2- 172.21.15.57:0/3117058769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5980ffac0 0x7ff5980ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.969+0000 7ff59f5ff700 1 --2- 172.21.15.57:0/3117058769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff598100d50 0x7ff5981011c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.969+0000 7ff59f5ff700 1 -- 172.21.15.57:0/3117058769 >> 172.21.15.57:0/3117058769 conn(0x7ff5980fb0c0 msgr2=0x7ff5980fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:33.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.969+0000 7ff59f5ff700 1 -- 172.21.15.57:0/3117058769 shutdown_connections 2023-03-02T10:56:33.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.969+0000 7ff59f5ff700 1 -- 172.21.15.57:0/3117058769 wait complete. 2023-03-02T10:56:33.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59f5ff700 1 Processor -- start 2023-03-02T10:56:33.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59f5ff700 1 -- start start 2023-03-02T10:56:33.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59f5ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5980ffac0 0x7ff598074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59f5ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff598100d50 0x7ff598072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59f5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff598101700 0x7ff598072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59f5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff598073660 con 0x7ff598101700 2023-03-02T10:56:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59f5ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980737d0 con 0x7ff5980ffac0 2023-03-02T10:56:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59f5ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59819f860 con 0x7ff598100d50 2023-03-02T10:56:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59db9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff598101700 0x7ff598072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59db9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff598101700 0x7ff598072ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45624/0 (socket says 172.21.15.57:45624) 2023-03-02T10:56:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59d39b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5980ffac0 0x7ff598074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59db9c700 1 -- 172.21.15.57:0/824278929 learned_addr learned my addr 172.21.15.57:0/824278929 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.970+0000 7ff59cb9a700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff598100d50 0x7ff598072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff59d39b700 1 -- 172.21.15.57:0/824278929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff598100d50 msgr2=0x7ff598072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff59d39b700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff598100d50 0x7ff598072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff59d39b700 1 -- 172.21.15.57:0/824278929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff598101700 msgr2=0x7ff598072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff59d39b700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff598101700 0x7ff598072ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff59d39b700 1 -- 172.21.15.57:0/824278929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5880095f0 con 0x7ff5980ffac0 2023-03-02T10:56:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff59db9c700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff598101700 0x7ff598072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff59d39b700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5980ffac0 0x7ff598074340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff59400e9f0 tx=0x7ff59400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff58e7fc700 1 -- 172.21.15.57:0/824278929 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400c9c0 con 0x7ff5980ffac0 2023-03-02T10:56:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff59f5ff700 1 -- 172.21.15.57:0/824278929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59810b420 con 0x7ff5980ffac0 2023-03-02T10:56:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff59f5ff700 1 -- 172.21.15.57:0/824278929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59810b290 con 0x7ff5980ffac0 2023-03-02T10:56:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff58e7fc700 1 -- 172.21.15.57:0/824278929 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff594010430 con 0x7ff5980ffac0 2023-03-02T10:56:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.971+0000 7ff58e7fc700 1 -- 172.21.15.57:0/824278929 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594018680 con 0x7ff5980ffac0 2023-03-02T10:56:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.972+0000 7ff59f5ff700 1 -- 172.21.15.57:0/824278929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57c005320 con 0x7ff5980ffac0 2023-03-02T10:56:33.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.974+0000 7ff58e7fc700 1 -- 172.21.15.57:0/824278929 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7ff59400c040 con 0x7ff5980ffac0 2023-03-02T10:56:33.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.975+0000 7ff58e7fc700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff58409b3a0 0x7ff58409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:33.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.975+0000 7ff58e7fc700 1 -- 172.21.15.57:0/824278929 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff594014070 con 0x7ff5980ffac0 2023-03-02T10:56:33.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.975+0000 7ff59cb9a700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff58409b3a0 0x7ff58409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:33.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.976+0000 7ff59cb9a700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff58409b3a0 0x7ff58409d850 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff58800b2e0 tx=0x7ff588005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:33.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:33.978+0000 7ff58e7fc700 1 -- 172.21.15.57:0/824278929 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7ff594050800 con 0x7ff5980ffac0 2023-03-02T10:56:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.224+0000 7ff59f5ff700 1 -- 172.21.15.57:0/824278929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff57c005190 con 0x7ff5980ffac0 2023-03-02T10:56:34.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.225+0000 7ff58e7fc700 1 -- 172.21.15.57:0/824278929 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10828 (secure 0 0 0) 0x7ff5940909c0 con 0x7ff5980ffac0 2023-03-02T10:56:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:34.227 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-02T10:55:10.601054+0000","modified":"2023-03-02T10:55:17.554509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24520,"mds_2":24505,"mds_3":24493,"mds_4":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14634":{"gid":14634,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6841/3731858530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6840","nonce":3731858530},{"type":"v1","addr":"172.21.15.57:6841","nonce":3731858530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"e","rank":4,"incarnation":24,"state":"up:active","state_seq":9,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24505":{"gid":24505,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/316639764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":316639764},{"type":"v1","addr":"172.21.15.122:6839","nonce":316639764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-02T10:56:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 -- 172.21.15.57:0/824278929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff58409b3a0 msgr2=0x7ff58409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff58409b3a0 0x7ff58409d850 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff58800b2e0 tx=0x7ff588005fb0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 -- 172.21.15.57:0/824278929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5980ffac0 msgr2=0x7ff598074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5980ffac0 0x7ff598074340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff59400e9f0 tx=0x7ff59400ed00 comp rx=0 tx=0).stop 2023-03-02T10:56:34.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 -- 172.21.15.57:0/824278929 shutdown_connections 2023-03-02T10:56:34.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff58409b3a0 0x7ff58409d850 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff598101700 0x7ff598072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5980ffac0 0x7ff598074340 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 --2- 172.21.15.57:0/824278929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff598100d50 0x7ff598072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 -- 172.21.15.57:0/824278929 >> 172.21.15.57:0/824278929 conn(0x7ff5980fb0c0 msgr2=0x7ff598104230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 -- 172.21.15.57:0/824278929 shutdown_connections 2023-03-02T10:56:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.228+0000 7ff59f5ff700 1 -- 172.21.15.57:0/824278929 wait complete. 2023-03-02T10:56:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-03-02T10:56:34.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:56:34.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.398+0000 7f00bedff700 1 -- 172.21.15.57:0/2785542025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b81005d0 msgr2=0x7f00b8106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.398+0000 7f00bedff700 1 --2- 172.21.15.57:0/2785542025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b81005d0 0x7f00b8106e70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f00b000b0a0 tx=0x7f00b000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.398+0000 7f00bedff700 1 -- 172.21.15.57:0/2785542025 shutdown_connections 2023-03-02T10:56:34.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.398+0000 7f00bedff700 1 --2- 172.21.15.57:0/2785542025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b81005d0 0x7f00b8106e70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.398+0000 7f00bedff700 1 --2- 172.21.15.57:0/2785542025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00b80fe990 0x7f00b80feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.398+0000 7f00bedff700 1 --2- 172.21.15.57:0/2785542025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00b80ffc20 0x7f00b8100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.398+0000 7f00bedff700 1 -- 172.21.15.57:0/2785542025 >> 172.21.15.57:0/2785542025 conn(0x7f00b80f9fd0 msgr2=0x7f00b80fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:34.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.398+0000 7f00bedff700 1 -- 172.21.15.57:0/2785542025 shutdown_connections 2023-03-02T10:56:34.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.398+0000 7f00bedff700 1 -- 172.21.15.57:0/2785542025 wait complete. 2023-03-02T10:56:34.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.399+0000 7f00bedff700 1 Processor -- start 2023-03-02T10:56:34.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.399+0000 7f00bedff700 1 -- start start 2023-03-02T10:56:34.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.399+0000 7f00bedff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00b80fe990 0x7f00b8197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:34.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.399+0000 7f00bedff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00b80ffc20 0x7f00b8198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:34.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.399+0000 7f00bedff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b81005d0 0x7f00b819f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:34.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.399+0000 7f00bedff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b819f670 con 0x7f00b81005d0 2023-03-02T10:56:34.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.399+0000 7f00bedff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b819f7b0 con 0x7f00b80ffc20 2023-03-02T10:56:34.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.399+0000 7f00bedff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b819f940 con 0x7f00b80fe990 2023-03-02T10:56:34.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.399+0000 7f00bd39c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b81005d0 0x7f00b819f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:34.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.399+0000 7f00bd39c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b81005d0 0x7f00b819f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45632/0 (socket says 172.21.15.57:45632) 2023-03-02T10:56:34.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.399+0000 7f00bd39c700 1 -- 172.21.15.57:0/3815476419 learned_addr learned my addr 172.21.15.57:0/3815476419 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:34.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00affff700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00b80ffc20 0x7f00b8198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:34.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00bcb9b700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00b80fe990 0x7f00b8197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:34.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00bd39c700 1 -- 172.21.15.57:0/3815476419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00b80fe990 msgr2=0x7f00b8197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00bd39c700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00b80fe990 0x7f00b8197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00bd39c700 1 -- 172.21.15.57:0/3815476419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00b80ffc20 msgr2=0x7f00b8198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00bd39c700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00b80ffc20 0x7f00b8198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00bd39c700 1 -- 172.21.15.57:0/3815476419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0009d00 con 0x7f00b81005d0 2023-03-02T10:56:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00bd39c700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b81005d0 0x7f00b819f0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f00b000b780 tx=0x7f00b000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00adffb700 1 -- 172.21.15.57:0/3815476419 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b000e040 con 0x7f00b81005d0 2023-03-02T10:56:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00adffb700 1 -- 172.21.15.57:0/3815476419 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00b00094a0 con 0x7f00b81005d0 2023-03-02T10:56:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00bedff700 1 -- 172.21.15.57:0/3815476419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b810a2f0 con 0x7f00b81005d0 2023-03-02T10:56:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00adffb700 1 -- 172.21.15.57:0/3815476419 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0005390 con 0x7f00b81005d0 2023-03-02T10:56:34.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.400+0000 7f00bedff700 1 -- 172.21.15.57:0/3815476419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b810a160 con 0x7f00b81005d0 2023-03-02T10:56:34.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.401+0000 7f00bedff700 1 -- 172.21.15.57:0/3815476419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b8067280 con 0x7f00b81005d0 2023-03-02T10:56:34.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.403+0000 7f00adffb700 1 -- 172.21.15.57:0/3815476419 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f00b001d470 con 0x7f00b81005d0 2023-03-02T10:56:34.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.403+0000 7f00adffb700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f00a009b3a0 0x7f00a009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:34.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.404+0000 7f00adffb700 1 -- 172.21.15.57:0/3815476419 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f00b00c66d0 con 0x7f00b81005d0 2023-03-02T10:56:34.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.404+0000 7f00bcb9b700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f00a009b3a0 0x7f00a009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:34.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.404+0000 7f00bcb9b700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f00a009b3a0 0x7f00a009d850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f00b4005950 tx=0x7f00b400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:34.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.407+0000 7f00adffb700 1 -- 172.21.15.57:0/3815476419 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f00b0092090 con 0x7f00b81005d0 2023-03-02T10:56:34.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.608+0000 7f00bedff700 1 -- 172.21.15.57:0/3815476419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00b81a0360 con 0x7f00b81005d0 2023-03-02T10:56:34.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.610+0000 7f00adffb700 1 -- 172.21.15.57:0/3815476419 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22553 (secure 0 0 0) 0x7f00b00956b0 con 0x7f00b81005d0 2023-03-02T10:56:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:34.611 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":86,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:50.530934+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:56:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 -- 172.21.15.57:0/3815476419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f00a009b3a0 msgr2=0x7f00a009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f00a009b3a0 0x7f00a009d850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f00b4005950 tx=0x7f00b400b410 comp rx=0 tx=0).stop 2023-03-02T10:56:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 -- 172.21.15.57:0/3815476419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b81005d0 msgr2=0x7f00b819f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b81005d0 0x7f00b819f0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f00b000b780 tx=0x7f00b000bd60 comp rx=0 tx=0).stop 2023-03-02T10:56:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 -- 172.21.15.57:0/3815476419 shutdown_connections 2023-03-02T10:56:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f00a009b3a0 0x7f00a009d850 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b81005d0 0x7f00b819f0a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00b80fe990 0x7f00b8197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 --2- 172.21.15.57:0/3815476419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00b80ffc20 0x7f00b8198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 -- 172.21.15.57:0/3815476419 >> 172.21.15.57:0/3815476419 conn(0x7f00b80f9fd0 msgr2=0x7f00b80676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 -- 172.21.15.57:0/3815476419 shutdown_connections 2023-03-02T10:56:34.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.612+0000 7f00bedff700 1 -- 172.21.15.57:0/3815476419 wait complete. 2023-03-02T10:56:34.627 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:34 smithi057 ceph-mon[92072]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-02T10:56:34.628 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:34 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2496749711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:34.628 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:34 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3965865931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:34.628 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:34 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/824278929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:34.629 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-02T10:51:03.600226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-02T10:55:08.504787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-02T10:55:09.909014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-02T10:56:34.630 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-02T10:56:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:34 smithi122 ceph-mon[125440]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-02T10:56:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:34 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2496749711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:34 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3965865931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:34 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/824278929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:34.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.785+0000 7f36acdff700 1 -- 172.21.15.57:0/2918238277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36a80ffc20 msgr2=0x7f36a8100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.785+0000 7f36acdff700 1 --2- 172.21.15.57:0/2918238277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36a80ffc20 0x7f36a8100090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3690009990 tx=0x7f3690009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.785+0000 7f36acdff700 1 -- 172.21.15.57:0/2918238277 shutdown_connections 2023-03-02T10:56:34.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.785+0000 7f36acdff700 1 --2- 172.21.15.57:0/2918238277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a81005d0 0x7f36a8106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.785+0000 7f36acdff700 1 --2- 172.21.15.57:0/2918238277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a80fe990 0x7f36a80feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.785+0000 7f36acdff700 1 --2- 172.21.15.57:0/2918238277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36a80ffc20 0x7f36a8100090 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.785+0000 7f36acdff700 1 -- 172.21.15.57:0/2918238277 >> 172.21.15.57:0/2918238277 conn(0x7f36a80f9fd0 msgr2=0x7f36a80fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:34.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.786+0000 7f36acdff700 1 -- 172.21.15.57:0/2918238277 shutdown_connections 2023-03-02T10:56:34.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.786+0000 7f36acdff700 1 -- 172.21.15.57:0/2918238277 wait complete. 2023-03-02T10:56:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.786+0000 7f36acdff700 1 Processor -- start 2023-03-02T10:56:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.786+0000 7f36acdff700 1 -- start start 2023-03-02T10:56:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.786+0000 7f36acdff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a80fe990 0x7f36a8195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f36acdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36a80ffc20 0x7f36a8195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f36acdff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a81005d0 0x7f36a819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f36acdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a819d280 con 0x7f36a80ffc20 2023-03-02T10:56:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f36acdff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a819d3c0 con 0x7f36a81005d0 2023-03-02T10:56:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f36acdff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a819d550 con 0x7f36a80fe990 2023-03-02T10:56:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f369ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36a80ffc20 0x7f36a8195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f369ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36a80ffc20 0x7f36a8195c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45636/0 (socket says 172.21.15.57:45636) 2023-03-02T10:56:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f369ffff700 1 -- 172.21.15.57:0/3198936843 learned_addr learned my addr 172.21.15.57:0/3198936843 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f36a659c700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a80fe990 0x7f36a8195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f36a6d9d700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a81005d0 0x7f36a819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f369ffff700 1 -- 172.21.15.57:0/3198936843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a80fe990 msgr2=0x7f36a8195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f369ffff700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a80fe990 0x7f36a8195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f369ffff700 1 -- 172.21.15.57:0/3198936843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a81005d0 msgr2=0x7f36a819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f369ffff700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a81005d0 0x7f36a819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f369ffff700 1 -- 172.21.15.57:0/3198936843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900095f0 con 0x7f36a80ffc20 2023-03-02T10:56:34.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f369ffff700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36a80ffc20 0x7f36a8195c40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3690000c00 tx=0x7f369000f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:34.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f369f7fe700 1 -- 172.21.15.57:0/3198936843 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369001d070 con 0x7f36a80ffc20 2023-03-02T10:56:34.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f369f7fe700 1 -- 172.21.15.57:0/3198936843 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f369000fc30 con 0x7f36a80ffc20 2023-03-02T10:56:34.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.787+0000 7f36acdff700 1 -- 172.21.15.57:0/3198936843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a810a2f0 con 0x7f36a80ffc20 2023-03-02T10:56:34.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.788+0000 7f369f7fe700 1 -- 172.21.15.57:0/3198936843 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690017650 con 0x7f36a80ffc20 2023-03-02T10:56:34.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.788+0000 7f36acdff700 1 -- 172.21.15.57:0/3198936843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a810a160 con 0x7f36a80ffc20 2023-03-02T10:56:34.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.789+0000 7f36acdff700 1 -- 172.21.15.57:0/3198936843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a819db80 con 0x7f36a80ffc20 2023-03-02T10:56:34.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.790+0000 7f369f7fe700 1 -- 172.21.15.57:0/3198936843 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f3690029030 con 0x7f36a80ffc20 2023-03-02T10:56:34.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.791+0000 7f369f7fe700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f369409b3a0 0x7f369409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:34.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.791+0000 7f369f7fe700 1 -- 172.21.15.57:0/3198936843 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f36900c6130 con 0x7f36a80ffc20 2023-03-02T10:56:34.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.791+0000 7f36a659c700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f369409b3a0 0x7f369409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:34.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.792+0000 7f36a659c700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f369409b3a0 0x7f369409d850 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f369800ac50 tx=0x7f369800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:34.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.795+0000 7f369f7fe700 1 -- 172.21.15.57:0/3198936843 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f369005b800 con 0x7f36a80ffc20 2023-03-02T10:56:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:34 smithi136 ceph-mon[125702]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-02T10:56:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:34 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2496749711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:34 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3965865931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:34 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/824278929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:34.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.992+0000 7f36acdff700 1 -- 172.21.15.57:0/3198936843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36a819e130 con 0x7f36a80ffc20 2023-03-02T10:56:34.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.993+0000 7f369f7fe700 1 -- 172.21.15.57:0/3198936843 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3690027020 con 0x7f36a80ffc20 2023-03-02T10:56:34.994 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-02T10:56:34.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 -- 172.21.15.57:0/3198936843 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f369409b3a0 msgr2=0x7f369409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f369409b3a0 0x7f369409d850 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f369800ac50 tx=0x7f369800a380 comp rx=0 tx=0).stop 2023-03-02T10:56:34.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 -- 172.21.15.57:0/3198936843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36a80ffc20 msgr2=0x7f36a8195c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:34.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36a80ffc20 0x7f36a8195c40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3690000c00 tx=0x7f369000f780 comp rx=0 tx=0).stop 2023-03-02T10:56:34.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 -- 172.21.15.57:0/3198936843 shutdown_connections 2023-03-02T10:56:34.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f369409b3a0 0x7f369409d850 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a81005d0 0x7f36a819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a80fe990 0x7f36a8195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 --2- 172.21.15.57:0/3198936843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36a80ffc20 0x7f36a8195c40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 -- 172.21.15.57:0/3198936843 >> 172.21.15.57:0/3198936843 conn(0x7f36a80f9fd0 msgr2=0x7f36a8067700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 -- 172.21.15.57:0/3198936843 shutdown_connections 2023-03-02T10:56:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:34.995+0000 7f36acdff700 1 -- 172.21.15.57:0/3198936843 wait complete. 2023-03-02T10:56:35.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-02T10:56:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.167+0000 7f2e389ff700 1 -- 172.21.15.57:0/3160582506 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e340ffc20 msgr2=0x7f2e34100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.167+0000 7f2e389ff700 1 --2- 172.21.15.57:0/3160582506 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e340ffc20 0x7f2e34100090 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009990 tx=0x7f2e1c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.167+0000 7f2e389ff700 1 -- 172.21.15.57:0/3160582506 shutdown_connections 2023-03-02T10:56:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.167+0000 7f2e389ff700 1 --2- 172.21.15.57:0/3160582506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e341005d0 0x7f2e34106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.168+0000 7f2e389ff700 1 --2- 172.21.15.57:0/3160582506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e340fe990 0x7f2e340feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.168+0000 7f2e389ff700 1 --2- 172.21.15.57:0/3160582506 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e340ffc20 0x7f2e34100090 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.168+0000 7f2e389ff700 1 -- 172.21.15.57:0/3160582506 >> 172.21.15.57:0/3160582506 conn(0x7f2e340f9fd0 msgr2=0x7f2e340fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:35.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.168+0000 7f2e389ff700 1 -- 172.21.15.57:0/3160582506 shutdown_connections 2023-03-02T10:56:35.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.168+0000 7f2e389ff700 1 -- 172.21.15.57:0/3160582506 wait complete. 2023-03-02T10:56:35.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.168+0000 7f2e389ff700 1 Processor -- start 2023-03-02T10:56:35.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.168+0000 7f2e389ff700 1 -- start start 2023-03-02T10:56:35.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e389ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e340fe990 0x7f2e341957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e389ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e340ffc20 0x7f2e34195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e389ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e341005d0 0x7f2e3419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e389ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3419d370 con 0x7f2e340fe990 2023-03-02T10:56:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e389ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3419d4b0 con 0x7f2e341005d0 2023-03-02T10:56:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e389ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3419d640 con 0x7f2e340ffc20 2023-03-02T10:56:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e3259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e340fe990 0x7f2e341957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e3259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e340fe990 0x7f2e341957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45656/0 (socket says 172.21.15.57:45656) 2023-03-02T10:56:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e3259c700 1 -- 172.21.15.57:0/578352306 learned_addr learned my addr 172.21.15.57:0/578352306 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e2bfff700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e340ffc20 0x7f2e34195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e32d9d700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e341005d0 0x7f2e3419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e3259c700 1 -- 172.21.15.57:0/578352306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e340ffc20 msgr2=0x7f2e34195d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e3259c700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e340ffc20 0x7f2e34195d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e3259c700 1 -- 172.21.15.57:0/578352306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e341005d0 msgr2=0x7f2e3419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e3259c700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e341005d0 0x7f2e3419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e3259c700 1 -- 172.21.15.57:0/578352306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0095f0 con 0x7f2e340fe990 2023-03-02T10:56:35.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e2bfff700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e340ffc20 0x7f2e34195d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:35.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e3259c700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e340fe990 0x7f2e341957f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400d980 tx=0x7f2e2400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:35.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.169+0000 7f2e2b7fe700 1 -- 172.21.15.57:0/578352306 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400bb60 con 0x7f2e340fe990 2023-03-02T10:56:35.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.170+0000 7f2e2b7fe700 1 -- 172.21.15.57:0/578352306 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e24007640 con 0x7f2e340fe990 2023-03-02T10:56:35.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.170+0000 7f2e389ff700 1 -- 172.21.15.57:0/578352306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3410a2f0 con 0x7f2e340fe990 2023-03-02T10:56:35.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.170+0000 7f2e2b7fe700 1 -- 172.21.15.57:0/578352306 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24004e90 con 0x7f2e340fe990 2023-03-02T10:56:35.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.170+0000 7f2e389ff700 1 -- 172.21.15.57:0/578352306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3410a160 con 0x7f2e340fe990 2023-03-02T10:56:35.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.170+0000 7f2e389ff700 1 -- 172.21.15.57:0/578352306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e34067280 con 0x7f2e340fe990 2023-03-02T10:56:35.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.173+0000 7f2e2b7fe700 1 -- 172.21.15.57:0/578352306 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f2e24021070 con 0x7f2e340fe990 2023-03-02T10:56:35.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.174+0000 7f2e2b7fe700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e2009b3a0 0x7f2e2009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.174+0000 7f2e2b7fe700 1 -- 172.21.15.57:0/578352306 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2e240c5280 con 0x7f2e340fe990 2023-03-02T10:56:35.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.174+0000 7f2e2bfff700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e2009b3a0 0x7f2e2009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.174+0000 7f2e2bfff700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e2009b3a0 0x7f2e2009d850 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c006010 tx=0x7f2e1c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:35.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.177+0000 7f2e2b7fe700 1 -- 172.21.15.57:0/578352306 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f2e24090bb0 con 0x7f2e340fe990 2023-03-02T10:56:35.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.373+0000 7f2e389ff700 1 -- 172.21.15.57:0/578352306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e3419e150 con 0x7f2e340fe990 2023-03-02T10:56:35.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.373+0000 7f2e2b7fe700 1 -- 172.21.15.57:0/578352306 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e24016070 con 0x7f2e340fe990 2023-03-02T10:56:35.374 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-03-02T10:56:35.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.375+0000 7f2e389ff700 1 -- 172.21.15.57:0/578352306 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e2009b3a0 msgr2=0x7f2e2009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.375+0000 7f2e389ff700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e2009b3a0 0x7f2e2009d850 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c006010 tx=0x7f2e1c00b540 comp rx=0 tx=0).stop 2023-03-02T10:56:35.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.375+0000 7f2e389ff700 1 -- 172.21.15.57:0/578352306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e340fe990 msgr2=0x7f2e341957f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.375+0000 7f2e389ff700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e340fe990 0x7f2e341957f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400d980 tx=0x7f2e2400dd40 comp rx=0 tx=0).stop 2023-03-02T10:56:35.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.375+0000 7f2e389ff700 1 -- 172.21.15.57:0/578352306 shutdown_connections 2023-03-02T10:56:35.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.375+0000 7f2e389ff700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e2009b3a0 0x7f2e2009d850 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.375+0000 7f2e389ff700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e341005d0 0x7f2e3419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.375+0000 7f2e389ff700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e340fe990 0x7f2e341957f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.375+0000 7f2e389ff700 1 --2- 172.21.15.57:0/578352306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e340ffc20 0x7f2e34195d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.375+0000 7f2e389ff700 1 -- 172.21.15.57:0/578352306 >> 172.21.15.57:0/578352306 conn(0x7f2e340f9fd0 msgr2=0x7f2e34067680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.376+0000 7f2e389ff700 1 -- 172.21.15.57:0/578352306 shutdown_connections 2023-03-02T10:56:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.376+0000 7f2e389ff700 1 -- 172.21.15.57:0/578352306 wait complete. 2023-03-02T10:56:35.392 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-02T10:56:35.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.548+0000 7f89423ff700 1 -- 172.21.15.57:0/198359247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f893c0ffc20 msgr2=0x7f893c100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.548+0000 7f89423ff700 1 --2- 172.21.15.57:0/198359247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f893c0ffc20 0x7f893c100090 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8924009990 tx=0x7f8924009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.548+0000 7f89423ff700 1 -- 172.21.15.57:0/198359247 shutdown_connections 2023-03-02T10:56:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.548+0000 7f89423ff700 1 --2- 172.21.15.57:0/198359247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f893c1005d0 0x7f893c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.548+0000 7f89423ff700 1 --2- 172.21.15.57:0/198359247 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f893c0fe990 0x7f893c0feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.548+0000 7f89423ff700 1 --2- 172.21.15.57:0/198359247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f893c0ffc20 0x7f893c100090 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.548+0000 7f89423ff700 1 -- 172.21.15.57:0/198359247 >> 172.21.15.57:0/198359247 conn(0x7f893c0f9fd0 msgr2=0x7f893c0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.548+0000 7f89423ff700 1 -- 172.21.15.57:0/198359247 shutdown_connections 2023-03-02T10:56:35.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.548+0000 7f89423ff700 1 -- 172.21.15.57:0/198359247 wait complete. 2023-03-02T10:56:35.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.549+0000 7f89423ff700 1 Processor -- start 2023-03-02T10:56:35.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.549+0000 7f89423ff700 1 -- start start 2023-03-02T10:56:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.549+0000 7f89423ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f893c0fe990 0x7f893c068250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.549+0000 7f89423ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f893c0ffc20 0x7f893c19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.549+0000 7f89423ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f893c1005d0 0x7f893c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.549+0000 7f89423ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c19f520 con 0x7f893c0fe990 2023-03-02T10:56:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.549+0000 7f89423ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c19f690 con 0x7f893c1005d0 2023-03-02T10:56:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.549+0000 7f89423ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c19f850 con 0x7f893c0ffc20 2023-03-02T10:56:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f893bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f893c0fe990 0x7f893c068250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f893bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f893c0fe990 0x7f893c068250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45676/0 (socket says 172.21.15.57:45676) 2023-03-02T10:56:35.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f893bfff700 1 -- 172.21.15.57:0/4116575809 learned_addr learned my addr 172.21.15.57:0/4116575809 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:35.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f89337fe700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f893c0ffc20 0x7f893c19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f894099c700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f893c1005d0 0x7f893c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f893bfff700 1 -- 172.21.15.57:0/4116575809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f893c0ffc20 msgr2=0x7f893c19c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f893bfff700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f893c0ffc20 0x7f893c19c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f893bfff700 1 -- 172.21.15.57:0/4116575809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f893c1005d0 msgr2=0x7f893c19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f893bfff700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f893c1005d0 0x7f893c19ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f893bfff700 1 -- 172.21.15.57:0/4116575809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89240095f0 con 0x7f893c0fe990 2023-03-02T10:56:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f894099c700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f893c1005d0 0x7f893c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f893bfff700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f893c0fe990 0x7f893c068250 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f892c00d950 tx=0x7f892c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f8939ffb700 1 -- 172.21.15.57:0/4116575809 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c009940 con 0x7f893c0fe990 2023-03-02T10:56:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f89423ff700 1 -- 172.21.15.57:0/4116575809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893c10a340 con 0x7f893c0fe990 2023-03-02T10:56:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f8939ffb700 1 -- 172.21.15.57:0/4116575809 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f892c010460 con 0x7f893c0fe990 2023-03-02T10:56:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f8939ffb700 1 -- 172.21.15.57:0/4116575809 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c00f620 con 0x7f893c0fe990 2023-03-02T10:56:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.550+0000 7f89423ff700 1 -- 172.21.15.57:0/4116575809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c10a1b0 con 0x7f893c0fe990 2023-03-02T10:56:35.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.551+0000 7f89423ff700 1 -- 172.21.15.57:0/4116575809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893c105fc0 con 0x7f893c0fe990 2023-03-02T10:56:35.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.554+0000 7f8939ffb700 1 -- 172.21.15.57:0/4116575809 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f892c022070 con 0x7f893c0fe990 2023-03-02T10:56:35.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.554+0000 7f8939ffb700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f892809b3a0 0x7f892809d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.555+0000 7f8939ffb700 1 -- 172.21.15.57:0/4116575809 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f892c0c4c80 con 0x7f893c0fe990 2023-03-02T10:56:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.555+0000 7f89337fe700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f892809b3a0 0x7f892809d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.555+0000 7f89337fe700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f892809b3a0 0x7f892809d850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f892400b5c0 tx=0x7f8924005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.557+0000 7f8939ffb700 1 -- 172.21.15.57:0/4116575809 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f892c0905b0 con 0x7f893c0fe990 2023-03-02T10:56:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:35 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3815476419' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:35 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3198936843' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:35 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3815476419' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:35 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3198936843' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:35.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.759+0000 7f89423ff700 1 -- 172.21.15.57:0/4116575809 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f893c067280 con 0x7f893c0fe990 2023-03-02T10:56:35.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.759+0000 7f8939ffb700 1 -- 172.21.15.57:0/4116575809 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f892c020070 con 0x7f893c0fe990 2023-03-02T10:56:35.761 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-03-02T10:56:35.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 -- 172.21.15.57:0/4116575809 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f892809b3a0 msgr2=0x7f892809d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f892809b3a0 0x7f892809d850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f892400b5c0 tx=0x7f8924005fd0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 -- 172.21.15.57:0/4116575809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f893c0fe990 msgr2=0x7f893c068250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f893c0fe990 0x7f893c068250 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f892c00d950 tx=0x7f892c00dc60 comp rx=0 tx=0).stop 2023-03-02T10:56:35.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 -- 172.21.15.57:0/4116575809 shutdown_connections 2023-03-02T10:56:35.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f892809b3a0 0x7f892809d850 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f893c1005d0 0x7f893c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f893c0fe990 0x7f893c068250 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 --2- 172.21.15.57:0/4116575809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f893c0ffc20 0x7f893c19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 -- 172.21.15.57:0/4116575809 >> 172.21.15.57:0/4116575809 conn(0x7f893c0f9fd0 msgr2=0x7f893c103100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:35.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 -- 172.21.15.57:0/4116575809 shutdown_connections 2023-03-02T10:56:35.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.762+0000 7f89423ff700 1 -- 172.21.15.57:0/4116575809 wait complete. 2023-03-02T10:56:35.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:56:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:35 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3815476419' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:35 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3198936843' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:35.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.931+0000 7f3d66fff700 1 -- 172.21.15.57:0/3585952106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d60102b60 msgr2=0x7f3d60104fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.931+0000 7f3d66fff700 1 --2- 172.21.15.57:0/3585952106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d60102b60 0x7f3d60104fe0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009990 tx=0x7f3d50009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.931+0000 7f3d66fff700 1 -- 172.21.15.57:0/3585952106 shutdown_connections 2023-03-02T10:56:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.931+0000 7f3d66fff700 1 --2- 172.21.15.57:0/3585952106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d60105670 0x7f3d60107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.931+0000 7f3d66fff700 1 --2- 172.21.15.57:0/3585952106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d600683c0 0x7f3d60102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.931+0000 7f3d66fff700 1 --2- 172.21.15.57:0/3585952106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d60102b60 0x7f3d60104fe0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.931+0000 7f3d66fff700 1 -- 172.21.15.57:0/3585952106 >> 172.21.15.57:0/3585952106 conn(0x7f3d600f9fd0 msgr2=0x7f3d600fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.931+0000 7f3d66fff700 1 -- 172.21.15.57:0/3585952106 shutdown_connections 2023-03-02T10:56:35.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.931+0000 7f3d66fff700 1 -- 172.21.15.57:0/3585952106 wait complete. 2023-03-02T10:56:35.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.932+0000 7f3d66fff700 1 Processor -- start 2023-03-02T10:56:35.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.932+0000 7f3d66fff700 1 -- start start 2023-03-02T10:56:35.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d66fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d600683c0 0x7f3d60195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d66fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d60102b60 0x7f3d60195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d66fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d60105670 0x7f3d6019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d66fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6019d3a0 con 0x7f3d60105670 2023-03-02T10:56:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d66fff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6019d4e0 con 0x7f3d60102b60 2023-03-02T10:56:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d66fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6019d670 con 0x7f3d600683c0 2023-03-02T10:56:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d6559c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d60105670 0x7f3d6019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d6559c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d60105670 0x7f3d6019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45692/0 (socket says 172.21.15.57:45692) 2023-03-02T10:56:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d6559c700 1 -- 172.21.15.57:0/2498107555 learned_addr learned my addr 172.21.15.57:0/2498107555 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d57fff700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d60102b60 0x7f3d60195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d64d9b700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d600683c0 0x7f3d60195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d6559c700 1 -- 172.21.15.57:0/2498107555 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d600683c0 msgr2=0x7f3d60195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d6559c700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d600683c0 0x7f3d60195820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d6559c700 1 -- 172.21.15.57:0/2498107555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d60102b60 msgr2=0x7f3d60195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d6559c700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d60102b60 0x7f3d60195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d6559c700 1 -- 172.21.15.57:0/2498107555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500095f0 con 0x7f3d60105670 2023-03-02T10:56:35.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.933+0000 7f3d6559c700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d60105670 0x7f3d6019cdd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800ef30 tx=0x7f3d5800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:35.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.934+0000 7f3d55ffb700 1 -- 172.21.15.57:0/2498107555 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58018070 con 0x7f3d60105670 2023-03-02T10:56:35.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.934+0000 7f3d55ffb700 1 -- 172.21.15.57:0/2498107555 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d5800f040 con 0x7f3d60105670 2023-03-02T10:56:35.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.934+0000 7f3d66fff700 1 -- 172.21.15.57:0/2498107555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6010b410 con 0x7f3d60105670 2023-03-02T10:56:35.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.934+0000 7f3d55ffb700 1 -- 172.21.15.57:0/2498107555 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800cdb0 con 0x7f3d60105670 2023-03-02T10:56:35.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.934+0000 7f3d66fff700 1 -- 172.21.15.57:0/2498107555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6010b280 con 0x7f3d60105670 2023-03-02T10:56:35.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.935+0000 7f3d66fff700 1 -- 172.21.15.57:0/2498107555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d600fbb40 con 0x7f3d60105670 2023-03-02T10:56:35.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.936+0000 7f3d55ffb700 1 -- 172.21.15.57:0/2498107555 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f3d58003a00 con 0x7f3d60105670 2023-03-02T10:56:35.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.937+0000 7f3d55ffb700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4809b420 0x7f3d4809d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:35.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.937+0000 7f3d55ffb700 1 -- 172.21.15.57:0/2498107555 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3d580c4c50 con 0x7f3d60105670 2023-03-02T10:56:35.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.937+0000 7f3d64d9b700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4809b420 0x7f3d4809d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:35.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.938+0000 7f3d64d9b700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4809b420 0x7f3d4809d8d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3d600680e0 tx=0x7f3d5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:35.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:35.941+0000 7f3d55ffb700 1 -- 172.21.15.57:0/2498107555 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f3d58090610 con 0x7f3d60105670 2023-03-02T10:56:36.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.182+0000 7f3d66fff700 1 -- 172.21.15.57:0/2498107555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d600613e0 con 0x7f3d60105670 2023-03-02T10:56:36.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.183+0000 7f3d55ffb700 1 -- 172.21.15.57:0/2498107555 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10828 (secure 0 0 0) 0x7f3d58093c30 con 0x7f3d60105670 2023-03-02T10:56:36.184 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:36.185 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-02T10:55:10.601054+0000","modified":"2023-03-02T10:55:17.554509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24520,"mds_2":24505,"mds_3":24493,"mds_4":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14634":{"gid":14634,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6841/3731858530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6840","nonce":3731858530},{"type":"v1","addr":"172.21.15.57:6841","nonce":3731858530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"e","rank":4,"incarnation":24,"state":"up:active","state_seq":9,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24505":{"gid":24505,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/316639764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":316639764},{"type":"v1","addr":"172.21.15.122:6839","nonce":316639764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-02T10:56:36.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.185+0000 7f3d66fff700 1 -- 172.21.15.57:0/2498107555 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4809b420 msgr2=0x7f3d4809d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.185+0000 7f3d66fff700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4809b420 0x7f3d4809d8d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3d600680e0 tx=0x7f3d5c009260 comp rx=0 tx=0).stop 2023-03-02T10:56:36.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.185+0000 7f3d66fff700 1 -- 172.21.15.57:0/2498107555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d60105670 msgr2=0x7f3d6019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.185+0000 7f3d66fff700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d60105670 0x7f3d6019cdd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800ef30 tx=0x7f3d5800c3a0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.185+0000 7f3d66fff700 1 -- 172.21.15.57:0/2498107555 shutdown_connections 2023-03-02T10:56:36.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.185+0000 7f3d66fff700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3d4809b420 0x7f3d4809d8d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.185+0000 7f3d66fff700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d60105670 0x7f3d6019cdd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.185+0000 7f3d66fff700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d600683c0 0x7f3d60195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.185+0000 7f3d66fff700 1 --2- 172.21.15.57:0/2498107555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d60102b60 0x7f3d60195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.185+0000 7f3d66fff700 1 -- 172.21.15.57:0/2498107555 >> 172.21.15.57:0/2498107555 conn(0x7f3d600f9fd0 msgr2=0x7f3d60100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.185+0000 7f3d66fff700 1 -- 172.21.15.57:0/2498107555 shutdown_connections 2023-03-02T10:56:36.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.186+0000 7f3d66fff700 1 -- 172.21.15.57:0/2498107555 wait complete. 2023-03-02T10:56:36.188 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-03-02T10:56:36.202 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:56:36.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.355+0000 7f4a995ff700 1 -- 172.21.15.57:0/1362265614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a94102ed0 msgr2=0x7f4a941052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.355+0000 7f4a995ff700 1 --2- 172.21.15.57:0/1362265614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a94102ed0 0x7f4a941052b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009990 tx=0x7f4a7c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.355+0000 7f4a995ff700 1 -- 172.21.15.57:0/1362265614 shutdown_connections 2023-03-02T10:56:36.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.355+0000 7f4a995ff700 1 --2- 172.21.15.57:0/1362265614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a941057f0 0x7f4a94107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.355+0000 7f4a995ff700 1 --2- 172.21.15.57:0/1362265614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a941005b0 0x7f4a94102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.355+0000 7f4a995ff700 1 --2- 172.21.15.57:0/1362265614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a94102ed0 0x7f4a941052b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.355+0000 7f4a995ff700 1 -- 172.21.15.57:0/1362265614 >> 172.21.15.57:0/1362265614 conn(0x7f4a940f9fd0 msgr2=0x7f4a940fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.355+0000 7f4a995ff700 1 -- 172.21.15.57:0/1362265614 shutdown_connections 2023-03-02T10:56:36.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.355+0000 7f4a995ff700 1 -- 172.21.15.57:0/1362265614 wait complete. 2023-03-02T10:56:36.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.356+0000 7f4a995ff700 1 Processor -- start 2023-03-02T10:56:36.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.356+0000 7f4a995ff700 1 -- start start 2023-03-02T10:56:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.356+0000 7f4a995ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a941005b0 0x7f4a94197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.356+0000 7f4a995ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a94102ed0 0x7f4a94197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.356+0000 7f4a995ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a941057f0 0x7f4a9419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.356+0000 7f4a995ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9419f5b0 con 0x7f4a941057f0 2023-03-02T10:56:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.356+0000 7f4a995ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9419f6f0 con 0x7f4a94102ed0 2023-03-02T10:56:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.356+0000 7f4a995ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9419f880 con 0x7f4a941005b0 2023-03-02T10:56:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.356+0000 7f4a937fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a941057f0 0x7f4a9419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.356+0000 7f4a937fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a941057f0 0x7f4a9419efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42508/0 (socket says 172.21.15.57:42508) 2023-03-02T10:56:36.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.356+0000 7f4a937fe700 1 -- 172.21.15.57:0/3967701389 learned_addr learned my addr 172.21.15.57:0/3967701389 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:36.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a8a7fc700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a94102ed0 0x7f4a94197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a92ffd700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a941005b0 0x7f4a94197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a937fe700 1 -- 172.21.15.57:0/3967701389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a941005b0 msgr2=0x7f4a94197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a937fe700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a941005b0 0x7f4a94197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a937fe700 1 -- 172.21.15.57:0/3967701389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a94102ed0 msgr2=0x7f4a94197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a937fe700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a94102ed0 0x7f4a94197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a937fe700 1 -- 172.21.15.57:0/3967701389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c0095f0 con 0x7f4a941057f0 2023-03-02T10:56:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a92ffd700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a941005b0 0x7f4a94197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a937fe700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a941057f0 0x7f4a9419efe0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00efc0 tx=0x7f4a8c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a90ff9700 1 -- 172.21.15.57:0/3967701389 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c018070 con 0x7f4a941057f0 2023-03-02T10:56:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a90ff9700 1 -- 172.21.15.57:0/3967701389 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a8c00f040 con 0x7f4a941057f0 2023-03-02T10:56:36.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a995ff700 1 -- 172.21.15.57:0/3967701389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9410b420 con 0x7f4a941057f0 2023-03-02T10:56:36.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a90ff9700 1 -- 172.21.15.57:0/3967701389 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c00cd50 con 0x7f4a941057f0 2023-03-02T10:56:36.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.357+0000 7f4a995ff700 1 -- 172.21.15.57:0/3967701389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9410b290 con 0x7f4a941057f0 2023-03-02T10:56:36.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.358+0000 7f4a995ff700 1 -- 172.21.15.57:0/3967701389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a94107360 con 0x7f4a941057f0 2023-03-02T10:56:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.360+0000 7f4a90ff9700 1 -- 172.21.15.57:0/3967701389 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f4a8c003a00 con 0x7f4a941057f0 2023-03-02T10:56:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.360+0000 7f4a90ff9700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a8009b3a0 0x7f4a8009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.361+0000 7f4a90ff9700 1 -- 172.21.15.57:0/3967701389 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4a8c0c5570 con 0x7f4a941057f0 2023-03-02T10:56:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.361+0000 7f4a92ffd700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a8009b3a0 0x7f4a8009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.361+0000 7f4a92ffd700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a8009b3a0 0x7f4a8009d850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4a94068140 tx=0x7f4a84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.363+0000 7f4a90ff9700 1 -- 172.21.15.57:0/3967701389 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f4a8c090f30 con 0x7f4a941057f0 2023-03-02T10:56:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.561+0000 7f4a995ff700 1 -- 172.21.15.57:0/3967701389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a9402cd50 con 0x7f4a941057f0 2023-03-02T10:56:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.562+0000 7f4a90ff9700 1 -- 172.21.15.57:0/3967701389 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22553 (secure 0 0 0) 0x7f4a8c094550 con 0x7f4a941057f0 2023-03-02T10:56:36.563 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:36.563 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":86,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:50.530934+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:56:36.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.564+0000 7f4a995ff700 1 -- 172.21.15.57:0/3967701389 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a8009b3a0 msgr2=0x7f4a8009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.564+0000 7f4a995ff700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a8009b3a0 0x7f4a8009d850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4a94068140 tx=0x7f4a84009260 comp rx=0 tx=0).stop 2023-03-02T10:56:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.564+0000 7f4a995ff700 1 -- 172.21.15.57:0/3967701389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a941057f0 msgr2=0x7f4a9419efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.564+0000 7f4a995ff700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a941057f0 0x7f4a9419efe0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00efc0 tx=0x7f4a8c00c3a0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.564+0000 7f4a995ff700 1 -- 172.21.15.57:0/3967701389 shutdown_connections 2023-03-02T10:56:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.564+0000 7f4a995ff700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f4a8009b3a0 0x7f4a8009d850 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.564+0000 7f4a995ff700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a941057f0 0x7f4a9419efe0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.564+0000 7f4a995ff700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a941005b0 0x7f4a94197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.564+0000 7f4a995ff700 1 --2- 172.21.15.57:0/3967701389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a94102ed0 0x7f4a94197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.564+0000 7f4a995ff700 1 -- 172.21.15.57:0/3967701389 >> 172.21.15.57:0/3967701389 conn(0x7f4a940f9fd0 msgr2=0x7f4a940fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.565+0000 7f4a995ff700 1 -- 172.21.15.57:0/3967701389 shutdown_connections 2023-03-02T10:56:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.565+0000 7f4a995ff700 1 -- 172.21.15.57:0/3967701389 wait complete. 2023-03-02T10:56:36.579 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:36 smithi057 ceph-mon[92072]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:56:36.580 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:36 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/578352306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:36.580 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:36 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/4116575809' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:36.580 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:36 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2498107555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:36.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-03-02T10:55:10.601054+0000', 'modified': '2023-03-02T10:55:17.554509+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24560, 'mds_1': 24520, 'mds_2': 24505, 'mds_3': 24493, 'mds_4': 24491}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'h', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6837/2380932917', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 2380932917}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 2380932917}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14622': {'gid': 14622, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.57:6839/1832653465', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6838', 'nonce': 1832653465}, {'type': 'v1', 'addr': '172.21.15.57:6839', 'nonce': 1832653465}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14634': {'gid': 14634, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.57:6841/3731858530', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6840', 'nonce': 3731858530}, {'type': 'v1', 'addr': '172.21.15.57:6841', 'nonce': 3731858530}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24451': {'gid': 24451, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6833/2838612280', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6832', 'nonce': 2838612280}, {'type': 'v1', 'addr': '172.21.15.136:6833', 'nonce': 2838612280}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24458': {'gid': 24458, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6833/953074371', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6832', 'nonce': 953074371}, {'type': 'v1', 'addr': '172.21.15.122:6833', 'nonce': 953074371}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24491': {'gid': 24491, 'name': 'e', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.122:6835/1841258715', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 1841258715}, {'type': 'v1', 'addr': '172.21.15.122:6835', 'nonce': 1841258715}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24493': {'gid': 24493, 'name': 'f', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.136:6835/2199127047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 2199127047}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 2199127047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24505': {'gid': 24505, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.136:6837/2130761226', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 2130761226}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 2130761226}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24520': {'gid': 24520, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.136:6839/1702113579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 1702113579}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 1702113579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6839/316639764', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 316639764}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 316639764}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-02T10:56:36.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-03-02T10:56:36.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-03-02T10:56:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:36 smithi122 ceph-mon[125440]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:56:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:36 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/578352306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:36 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/4116575809' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:36 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2498107555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:36.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.736+0000 7f2a76bff700 1 -- 172.21.15.57:0/2742745008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a70102ed0 msgr2=0x7f2a701052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.736+0000 7f2a76bff700 1 --2- 172.21.15.57:0/2742745008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a70102ed0 0x7f2a701052b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009990 tx=0x7f2a58009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.736+0000 7f2a76bff700 1 -- 172.21.15.57:0/2742745008 shutdown_connections 2023-03-02T10:56:36.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.736+0000 7f2a76bff700 1 --2- 172.21.15.57:0/2742745008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a701057f0 0x7f2a70107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.736+0000 7f2a76bff700 1 --2- 172.21.15.57:0/2742745008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a701005b0 0x7f2a70102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.736+0000 7f2a76bff700 1 --2- 172.21.15.57:0/2742745008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a70102ed0 0x7f2a701052b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.736+0000 7f2a76bff700 1 -- 172.21.15.57:0/2742745008 >> 172.21.15.57:0/2742745008 conn(0x7f2a700f9fd0 msgr2=0x7f2a700fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.736+0000 7f2a76bff700 1 -- 172.21.15.57:0/2742745008 shutdown_connections 2023-03-02T10:56:36.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.736+0000 7f2a76bff700 1 -- 172.21.15.57:0/2742745008 wait complete. 2023-03-02T10:56:36.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.737+0000 7f2a76bff700 1 Processor -- start 2023-03-02T10:56:36.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.737+0000 7f2a76bff700 1 -- start start 2023-03-02T10:56:36.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a76bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a701005b0 0x7f2a70195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a76bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a70102ed0 0x7f2a70195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a76bff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a701057f0 0x7f2a7019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a76bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7019d390 con 0x7f2a70102ed0 2023-03-02T10:56:36.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a76bff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7019d4d0 con 0x7f2a701057f0 2023-03-02T10:56:36.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a76bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7019d660 con 0x7f2a701005b0 2023-03-02T10:56:36.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a70102ed0 0x7f2a70195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a70102ed0 0x7f2a70195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42524/0 (socket says 172.21.15.57:42524) 2023-03-02T10:56:36.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a6ffff700 1 -- 172.21.15.57:0/2532788882 learned_addr learned my addr 172.21.15.57:0/2532788882 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:36.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a7499b700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a701005b0 0x7f2a70195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a7519c700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a701057f0 0x7f2a7019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a6ffff700 1 -- 172.21.15.57:0/2532788882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a701005b0 msgr2=0x7f2a70195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a6ffff700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a701005b0 0x7f2a70195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a6ffff700 1 -- 172.21.15.57:0/2532788882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a701057f0 msgr2=0x7f2a7019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a6ffff700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a701057f0 0x7f2a7019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a6ffff700 1 -- 172.21.15.57:0/2532788882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a580095f0 con 0x7f2a70102ed0 2023-03-02T10:56:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.738+0000 7f2a6ffff700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a70102ed0 0x7f2a70195d50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2a58000c00 tx=0x7f2a5800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.739+0000 7f2a6dffb700 1 -- 172.21.15.57:0/2532788882 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5801d070 con 0x7f2a70102ed0 2023-03-02T10:56:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.739+0000 7f2a6dffb700 1 -- 172.21.15.57:0/2532788882 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a5800fb50 con 0x7f2a70102ed0 2023-03-02T10:56:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.739+0000 7f2a76bff700 1 -- 172.21.15.57:0/2532788882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7010b420 con 0x7f2a70102ed0 2023-03-02T10:56:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.739+0000 7f2a6dffb700 1 -- 172.21.15.57:0/2532788882 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58017650 con 0x7f2a70102ed0 2023-03-02T10:56:36.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.739+0000 7f2a76bff700 1 -- 172.21.15.57:0/2532788882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7010b290 con 0x7f2a70102ed0 2023-03-02T10:56:36.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.741+0000 7f2a6dffb700 1 -- 172.21.15.57:0/2532788882 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f2a58029030 con 0x7f2a70102ed0 2023-03-02T10:56:36.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.742+0000 7f2a6dffb700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2a5c09b3a0 0x7f2a5c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.742+0000 7f2a6dffb700 1 -- 172.21.15.57:0/2532788882 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2a580c61c0 con 0x7f2a70102ed0 2023-03-02T10:56:36.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.742+0000 7f2a7499b700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2a5c09b3a0 0x7f2a5c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a8a614b80 1 Processor -- start 2023-03-02T10:56:36.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a7499b700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2a5c09b3a0 0x7f2a5c09d850 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009550 tx=0x7f2a600091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a8a614b80 1 -- start start 2023-03-02T10:56:36.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32410 0x55edfed32820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed32d60 0x55edfed33340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed33d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfec99a10 con 0x55edfed33920 2023-03-02T10:56:36.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfec4bf30 con 0x55edfed32d60 2023-03-02T10:56:36.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfec1c110 con 0x55edfed32410 2023-03-02T10:56:36.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a7519c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed33d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a7519c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed33d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42534/0 (socket says 172.21.15.57:42534) 2023-03-02T10:56:36.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a7519c700 1 -- 172.21.15.57:0/2649680398 learned_addr learned my addr 172.21.15.57:0/2649680398 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:36.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.743+0000 7f2a7499b700 1 --2- 172.21.15.57:0/2649680398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32410 0x55edfed32820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.744+0000 7f2a6ffff700 1 --2- 172.21.15.57:0/2649680398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed32d60 0x55edfed33340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.744+0000 7f2a7519c700 1 -- 172.21.15.57:0/2649680398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32410 msgr2=0x55edfed32820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.744+0000 7f2a7519c700 1 --2- 172.21.15.57:0/2649680398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32410 0x55edfed32820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.744+0000 7f2a7519c700 1 -- 172.21.15.57:0/2649680398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed32d60 msgr2=0x55edfed33340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.744+0000 7f2a7519c700 1 --2- 172.21.15.57:0/2649680398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed32d60 0x55edfed33340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.744+0000 7f2a7519c700 1 -- 172.21.15.57:0/2649680398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edfeb065e0 con 0x55edfed33920 2023-03-02T10:56:36.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.744+0000 7f2a6ffff700 1 --2- 172.21.15.57:0/2649680398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed32d60 0x55edfed33340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:36.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.744+0000 7f2a7519c700 1 --2- 172.21.15.57:0/2649680398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed33d90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800bc00 tx=0x7f2a6800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da1c6ad396f4b3c server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.744+0000 7f2a66ffd700 1 -- 172.21.15.57:0/2649680398 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800faf0 con 0x55edfed33920 2023-03-02T10:56:36.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.744+0000 7f2a66ffd700 1 -- 172.21.15.57:0/2649680398 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a6800fc50 con 0x55edfed33920 2023-03-02T10:56:36.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.744+0000 7f2a66ffd700 1 -- 172.21.15.57:0/2649680398 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68010630 con 0x55edfed33920 2023-03-02T10:56:36.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.745+0000 7f2a8a614b80 1 -- 172.21.15.57:0/2649680398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 msgr2=0x55edfed33d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.745+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/2649680398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed33d90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800bc00 tx=0x7f2a6800bf10 comp rx=0 tx=0).stop 2023-03-02T10:56:36.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.745+0000 7f2a8a614b80 1 -- 172.21.15.57:0/2649680398 shutdown_connections 2023-03-02T10:56:36.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.745+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/2649680398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed33d90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.745+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/2649680398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32410 0x55edfed32820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.745+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/2649680398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed32d60 0x55edfed33340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.745+0000 7f2a8a614b80 1 -- 172.21.15.57:0/2649680398 >> 172.21.15.57:0/2649680398 conn(0x55edfed27c00 msgr2=0x55edfed2cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.745+0000 7f2a8a614b80 1 -- 172.21.15.57:0/2649680398 shutdown_connections 2023-03-02T10:56:36.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.745+0000 7f2a8a614b80 1 -- 172.21.15.57:0/2649680398 wait complete. 2023-03-02T10:56:36.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.745+0000 7f2a8a614b80 1 -- start start 2023-03-02T10:56:36.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a8a614b80 1 Processor -- start 2023-03-02T10:56:36.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32410 0x55edfed3bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32d60 0x55edfed3c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed33920 0x55edfed434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfec8ab70 con 0x55edfed32d60 2023-03-02T10:56:36.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfec840a0 con 0x55edfed33920 2023-03-02T10:56:36.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfeb088d0 con 0x55edfed32410 2023-03-02T10:56:36.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a8a614b80 10 client.0 _ll_register_callbacks cb 0x55edfec2a4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:36.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32d60 0x55edfed3c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32d60 0x55edfed3c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42542/0 (socket says 172.21.15.57:42542) 2023-03-02T10:56:36.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a6ffff700 1 -- 172.21.15.57:0/1669432341 learned_addr learned my addr 172.21.15.57:0/1669432341 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:36.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a7519c700 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed33920 0x55edfed434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.746+0000 7f2a7499b700 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32410 0x55edfed3bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a6ffff700 1 -- 172.21.15.57:0/1669432341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32410 msgr2=0x55edfed3bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a6ffff700 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32410 0x55edfed3bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a6ffff700 1 -- 172.21.15.57:0/1669432341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed33920 msgr2=0x55edfed434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a6ffff700 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed33920 0x55edfed434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a6ffff700 1 -- 172.21.15.57:0/1669432341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6800b830 con 0x55edfed32d60 2023-03-02T10:56:36.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a6ffff700 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32d60 0x55edfed3c470 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2a58093b30 tx=0x7f2a58009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d44fd072397e23 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:36.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1669432341 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580c5040 con 0x55edfed32d60 2023-03-02T10:56:36.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1669432341 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2a58099170 con 0x55edfed32d60 2023-03-02T10:56:36.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1669432341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55edfec55760 con 0x55edfed32d60 2023-03-02T10:56:36.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1669432341 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a580957e0 con 0x55edfed32d60 2023-03-02T10:56:36.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a8a614b80 10 client.15198 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:36.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1669432341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55edfeab2d90 con 0x55edfed32d60 2023-03-02T10:56:36.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1669432341 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a58061080 con 0x55edfed32d60 2023-03-02T10:56:36.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1669432341 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2a58062f80 con 0x55edfed32d60 2023-03-02T10:56:36.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.747+0000 7f2a8a614b80 10 client.15198 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:36.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.748+0000 7f2a8a614b80 10 client.15198 resolve_mds: resolved name 'e' to daemon mds.e 2023-03-02T10:56:36.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.748+0000 7f2a8a614b80 20 client.15198 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:36.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.748+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55edfed46e90 0x55edfed463e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.748+0000 7f2a8a614b80 4 client.15198 mds_command: new command op to 24491 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:36.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.748+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1669432341 --> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55edfec7d120 con 0x55edfed46e90 2023-03-02T10:56:36.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.748+0000 7f2a7499b700 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55edfed46e90 0x55edfed463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.748+0000 7f2a4ffff700 10 client.15198 ms_handle_connect on v2:172.21.15.122:6834/1841258715 2023-03-02T10:56:36.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.748+0000 7f2a7499b700 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55edfed46e90 0x55edfed463e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9e8b119b7e38179e server_cookie=e991072dba9c1d5e in_seq=0 out_seq=0 2023-03-02T10:56:36.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1669432341 <== mds.4 v2:172.21.15.122:6834/1841258715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55edfec7d120 con 0x55edfed46e90 2023-03-02T10:56:36.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a4ffff700 10 client.15198 handle_command_reply: tid=0 2023-03-02T10:56:36.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a8a614b80 1 client.15198 shutdown 2023-03-02T10:56:36.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1669432341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32d60 msgr2=0x55edfed3c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32d60 0x55edfed3c470 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2a58093b30 tx=0x7f2a58009310 comp rx=0 tx=0).stop 2023-03-02T10:56:36.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1669432341 shutdown_connections 2023-03-02T10:56:36.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55edfed46e90 0x55edfed463e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed33920 0x55edfed434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32410 0x55edfed3bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1669432341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32d60 0x55edfed3c470 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a4ffff700 0 client.15198 ms_handle_reset on v2:172.21.15.122:6834/1841258715 2023-03-02T10:56:36.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1669432341 >> 172.21.15.57:0/1669432341 conn(0x55edfed27c00 msgr2=0x55edfed2c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1669432341 shutdown_connections 2023-03-02T10:56:36.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.749+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1669432341 wait complete. 2023-03-02T10:56:36.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.750+0000 7f2a8a614b80 20 client.15198 trim_cache size 0 max 16384 2023-03-02T10:56:36.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a8a614b80 1 Processor -- start 2023-03-02T10:56:36.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a8a614b80 1 -- start start 2023-03-02T10:56:36.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32410 0x55edfed33cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32d60 0x55edfed3ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed33920 0x55edfed2c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfed2e900 con 0x55edfed32410 2023-03-02T10:56:36.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfed48170 con 0x55edfed33920 2023-03-02T10:56:36.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfec7d120 con 0x55edfed32d60 2023-03-02T10:56:36.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a7499b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32410 0x55edfed33cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a7499b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32410 0x55edfed33cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42558/0 (socket says 172.21.15.57:42558) 2023-03-02T10:56:36.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a7499b700 1 -- 172.21.15.57:0/747453939 learned_addr learned my addr 172.21.15.57:0/747453939 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:36.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a6ffff700 1 --2- 172.21.15.57:0/747453939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32d60 0x55edfed3ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a7499b700 1 -- 172.21.15.57:0/747453939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32d60 msgr2=0x55edfed3ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a7519c700 1 --2- 172.21.15.57:0/747453939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed33920 0x55edfed2c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a7499b700 1 --2- 172.21.15.57:0/747453939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32d60 0x55edfed3ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a7499b700 1 -- 172.21.15.57:0/747453939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed33920 msgr2=0x55edfed2c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a7499b700 1 --2- 172.21.15.57:0/747453939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed33920 0x55edfed2c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.767+0000 7f2a7499b700 1 -- 172.21.15.57:0/747453939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edfec4b140 con 0x55edfed32410 2023-03-02T10:56:36.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.768+0000 7f2a6ffff700 1 --2- 172.21.15.57:0/747453939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32d60 0x55edfed3ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:56:36.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.768+0000 7f2a7499b700 1 --2- 172.21.15.57:0/747453939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32410 0x55edfed33cf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55edfed3b3b0 tx=0x7f2a60013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba18138e9cfaa06a server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.768+0000 7f2a677fe700 1 -- 172.21.15.57:0/747453939 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a60028070 con 0x55edfed32410 2023-03-02T10:56:36.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.768+0000 7f2a677fe700 1 -- 172.21.15.57:0/747453939 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a6000f040 con 0x55edfed32410 2023-03-02T10:56:36.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.768+0000 7f2a677fe700 1 -- 172.21.15.57:0/747453939 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a60029d10 con 0x55edfed32410 2023-03-02T10:56:36.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.768+0000 7f2a8a614b80 1 -- 172.21.15.57:0/747453939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32410 msgr2=0x55edfed33cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.768+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/747453939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32410 0x55edfed33cf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55edfed3b3b0 tx=0x7f2a60013000 comp rx=0 tx=0).stop 2023-03-02T10:56:36.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.768+0000 7f2a8a614b80 1 -- 172.21.15.57:0/747453939 shutdown_connections 2023-03-02T10:56:36.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.768+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/747453939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed33920 0x55edfed2c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.768+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/747453939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed32410 0x55edfed33cf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.768+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/747453939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32d60 0x55edfed3ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 1 -- 172.21.15.57:0/747453939 >> 172.21.15.57:0/747453939 conn(0x55edfed27c00 msgr2=0x55edfed2cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 1 -- 172.21.15.57:0/747453939 shutdown_connections 2023-03-02T10:56:36.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 1 -- 172.21.15.57:0/747453939 wait complete. 2023-03-02T10:56:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 1 -- start start 2023-03-02T10:56:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 1 Processor -- start 2023-03-02T10:56:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed32410 0x55edfed2c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32d60 0x55edfed2ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed9c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfed9cca0 con 0x55edfed33920 2023-03-02T10:56:36.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfed9ce10 con 0x55edfed32410 2023-03-02T10:56:36.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfed9cfd0 con 0x55edfed32d60 2023-03-02T10:56:36.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a8a614b80 10 client.0 _ll_register_callbacks cb 0x55edfec2a4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:36.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a7519c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed9c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a7519c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed9c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42564/0 (socket says 172.21.15.57:42564) 2023-03-02T10:56:36.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.769+0000 7f2a7519c700 1 -- 172.21.15.57:0/1772892071 learned_addr learned my addr 172.21.15.57:0/1772892071 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:36.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a6ffff700 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32d60 0x55edfed2ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a7499b700 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed32410 0x55edfed2c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a7519c700 1 -- 172.21.15.57:0/1772892071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32d60 msgr2=0x55edfed2ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a7519c700 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32d60 0x55edfed2ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a7519c700 1 -- 172.21.15.57:0/1772892071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed32410 msgr2=0x55edfed2c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a7519c700 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed32410 0x55edfed2c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a7519c700 1 -- 172.21.15.57:0/1772892071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a600048e0 con 0x55edfed33920 2023-03-02T10:56:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a7519c700 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed9c720 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2a68019000 tx=0x7f2a680056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c78167cae3ae32d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1772892071 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68020070 con 0x55edfed33920 2023-03-02T10:56:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1772892071 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2a68005270 con 0x55edfed33920 2023-03-02T10:56:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1772892071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a6800fc50 con 0x55edfed33920 2023-03-02T10:56:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1772892071 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a68005470 con 0x55edfed33920 2023-03-02T10:56:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a8a614b80 10 client.15204 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.770+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1772892071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55edfead9200 con 0x55edfed33920 2023-03-02T10:56:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.771+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1772892071 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a6800fc50 con 0x55edfed33920 2023-03-02T10:56:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.771+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1772892071 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2a680116a0 con 0x55edfed33920 2023-03-02T10:56:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.771+0000 7f2a8a614b80 10 client.15204 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.771+0000 7f2a8a614b80 10 client.15204 resolve_mds: resolved name 'e' to daemon mds.e 2023-03-02T10:56:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.771+0000 7f2a8a614b80 20 client.15204 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.771+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55edfeda1c70 0x55edfed9e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.771+0000 7f2a8a614b80 4 client.15204 mds_command: new command op to 24491 tid=0[{"prefix": "status"}] 2023-03-02T10:56:36.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.771+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1772892071 --> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55edfec7ce40 con 0x55edfeda1c70 2023-03-02T10:56:36.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.771+0000 7f2a7499b700 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55edfeda1c70 0x55edfed9e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a4ffff700 10 client.15204 ms_handle_connect on v2:172.21.15.122:6834/1841258715 2023-03-02T10:56:36.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a7499b700 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55edfeda1c70 0x55edfed9e620 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=95abb450a0e9b5d6 server_cookie=62b64c5ed1c81c50 in_seq=0 out_seq=0 2023-03-02T10:56:36.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1772892071 <== mds.4 v2:172.21.15.122:6834/1841258715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55edfec7ce40 con 0x55edfeda1c70 2023-03-02T10:56:36.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a4ffff700 10 client.15204 handle_command_reply: tid=0 2023-03-02T10:56:36.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 1 client.15204 shutdown 2023-03-02T10:56:36.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1772892071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 msgr2=0x55edfed9c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed9c720 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2a68019000 tx=0x7f2a680056a0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1772892071 shutdown_connections 2023-03-02T10:56:36.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55edfeda1c70 0x55edfed9e620 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55edfed33920 0x55edfed9c720 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55edfed32410 0x55edfed2c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a4ffff700 0 client.15204 ms_handle_reset on v2:172.21.15.122:6834/1841258715 2023-03-02T10:56:36.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 1 --2- 172.21.15.57:0/1772892071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edfed32d60 0x55edfed2ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1772892071 >> 172.21.15.57:0/1772892071 conn(0x55edfed27c00 msgr2=0x55edfed463e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1772892071 shutdown_connections 2023-03-02T10:56:36.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 1 -- 172.21.15.57:0/1772892071 wait complete. 2023-03-02T10:56:36.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.772+0000 7f2a8a614b80 20 client.15204 trim_cache size 0 max 16384 2023-03-02T10:56:36.785 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:56:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 4, 2023-03-02T10:56:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 24491, 2023-03-02T10:56:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-03-02T10:56:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-03-02T10:56:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-03-02T10:56:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 80.221323295000005, 2023-03-02T10:56:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 26, 2023-03-02T10:56:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 86, 2023-03-02T10:56:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 84, 2023-03-02T10:56:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 109.187789369 2023-03-02T10:56:36.786 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:36.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 -- 172.21.15.57:0/2532788882 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2a5c09b3a0 msgr2=0x7f2a5c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2a5c09b3a0 0x7f2a5c09d850 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009550 tx=0x7f2a600091b0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 -- 172.21.15.57:0/2532788882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a70102ed0 msgr2=0x7f2a70195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a70102ed0 0x7f2a70195d50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2a58000c00 tx=0x7f2a5800f710 comp rx=0 tx=0).stop 2023-03-02T10:56:36.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 -- 172.21.15.57:0/2532788882 shutdown_connections 2023-03-02T10:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2a5c09b3a0 0x7f2a5c09d850 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a701057f0 0x7f2a7019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a701005b0 0x7f2a70195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 --2- 172.21.15.57:0/2532788882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a70102ed0 0x7f2a70195d50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 -- 172.21.15.57:0/2532788882 >> 172.21.15.57:0/2532788882 conn(0x7f2a700f9fd0 msgr2=0x7f2a701011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 -- 172.21.15.57:0/2532788882 shutdown_connections 2023-03-02T10:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.773+0000 7f2a76bff700 1 -- 172.21.15.57:0/2532788882 wait complete. 2023-03-02T10:56:36.789 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-03-02T10:56:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:36 smithi136 ceph-mon[125702]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-02T10:56:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:36 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/578352306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:36 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/4116575809' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:36 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2498107555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.943+0000 7f33107ff700 1 -- 172.21.15.57:0/823872400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 msgr2=0x7f3308102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.943+0000 7f33107ff700 1 --2- 172.21.15.57:0/823872400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f3308102990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3304009990 tx=0x7f3304009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.943+0000 7f33107ff700 1 -- 172.21.15.57:0/823872400 shutdown_connections 2023-03-02T10:56:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.943+0000 7f33107ff700 1 --2- 172.21.15.57:0/823872400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 0x7f3308107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.943+0000 7f33107ff700 1 --2- 172.21.15.57:0/823872400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f3308102990 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.943+0000 7f33107ff700 1 --2- 172.21.15.57:0/823872400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 0x7f33081052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.943+0000 7f33107ff700 1 -- 172.21.15.57:0/823872400 >> 172.21.15.57:0/823872400 conn(0x7f33080f9fd0 msgr2=0x7f33080fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.943+0000 7f33107ff700 1 -- 172.21.15.57:0/823872400 shutdown_connections 2023-03-02T10:56:36.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.943+0000 7f33107ff700 1 -- 172.21.15.57:0/823872400 wait complete. 2023-03-02T10:56:36.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f33107ff700 1 Processor -- start 2023-03-02T10:56:36.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f33107ff700 1 -- start start 2023-03-02T10:56:36.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f33107ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f33080fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f33107ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 0x7f33080fe560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f33107ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 0x7f33080feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f33107ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ff240 con 0x7f33081005b0 2023-03-02T10:56:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f33107ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080ff3b0 con 0x7f33081057f0 2023-03-02T10:56:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f33107ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330819f8f0 con 0x7f3308102ed0 2023-03-02T10:56:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f330e59b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f33080fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f330e59b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f33080fff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42590/0 (socket says 172.21.15.57:42590) 2023-03-02T10:56:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f330e59b700 1 -- 172.21.15.57:0/4161687481 learned_addr learned my addr 172.21.15.57:0/4161687481 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f330ed9c700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 0x7f33080feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f330dd9a700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 0x7f33080fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f330e59b700 1 -- 172.21.15.57:0/4161687481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 msgr2=0x7f33080fe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f330e59b700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 0x7f33080fe560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f330e59b700 1 -- 172.21.15.57:0/4161687481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 msgr2=0x7f33080feaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f330e59b700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 0x7f33080feaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f330e59b700 1 -- 172.21.15.57:0/4161687481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33040095f0 con 0x7f33081005b0 2023-03-02T10:56:36.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.944+0000 7f330dd9a700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 0x7f33080fe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:56:36.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.945+0000 7f330e59b700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f33080fff20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f330400b680 tx=0x7f3304005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.945+0000 7f32ff7fe700 1 -- 172.21.15.57:0/4161687481 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330401d070 con 0x7f33081005b0 2023-03-02T10:56:36.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.945+0000 7f32ff7fe700 1 -- 172.21.15.57:0/4161687481 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3304021410 con 0x7f33081005b0 2023-03-02T10:56:36.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.945+0000 7f33107ff700 1 -- 172.21.15.57:0/4161687481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330810b450 con 0x7f33081005b0 2023-03-02T10:56:36.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.945+0000 7f32ff7fe700 1 -- 172.21.15.57:0/4161687481 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304017650 con 0x7f33081005b0 2023-03-02T10:56:36.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.945+0000 7f33107ff700 1 -- 172.21.15.57:0/4161687481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330810b2c0 con 0x7f33081005b0 2023-03-02T10:56:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.947+0000 7f32ff7fe700 1 -- 172.21.15.57:0/4161687481 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f3304028030 con 0x7f33081005b0 2023-03-02T10:56:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.948+0000 7f32ff7fe700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b420 0x7f32f409d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.948+0000 7f32ff7fe700 1 -- 172.21.15.57:0/4161687481 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f33040c6320 con 0x7f33081005b0 2023-03-02T10:56:36.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.949+0000 7f330dd9a700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b420 0x7f32f409d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.949+0000 7f330dd9a700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b420 0x7f32f409d8d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f32f8005fd0 tx=0x7f32f8005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.949+0000 7f33241cfb80 1 Processor -- start 2023-03-02T10:56:36.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.949+0000 7f33241cfb80 1 -- start start 2023-03-02T10:56:36.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.949+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1410 0x564ac98f1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.949+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac98f2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.949+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f2920 0x564ac98f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.949+0000 7f33241cfb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac9858a10 con 0x564ac98f1d60 2023-03-02T10:56:36.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.949+0000 7f33241cfb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac980af30 con 0x564ac98f2920 2023-03-02T10:56:36.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.949+0000 7f33241cfb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac97db110 con 0x564ac98f1410 2023-03-02T10:56:36.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f330dd9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac98f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f330dd9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac98f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42604/0 (socket says 172.21.15.57:42604) 2023-03-02T10:56:36.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f330dd9a700 1 -- 172.21.15.57:0/2139028772 learned_addr learned my addr 172.21.15.57:0/2139028772 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:36.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f330ed9c700 1 --2- 172.21.15.57:0/2139028772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f2920 0x564ac98f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f330e59b700 1 --2- 172.21.15.57:0/2139028772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1410 0x564ac98f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f330dd9a700 1 -- 172.21.15.57:0/2139028772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1410 msgr2=0x564ac98f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f330dd9a700 1 --2- 172.21.15.57:0/2139028772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1410 0x564ac98f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f330dd9a700 1 -- 172.21.15.57:0/2139028772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f2920 msgr2=0x564ac98f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f330dd9a700 1 --2- 172.21.15.57:0/2139028772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f2920 0x564ac98f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f330dd9a700 1 -- 172.21.15.57:0/2139028772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ac96c55e0 con 0x564ac98f1d60 2023-03-02T10:56:36.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f330dd9a700 1 --2- 172.21.15.57:0/2139028772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac98f2340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f32f800edd0 tx=0x7f32f8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e67b8474147f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f32fcff9700 1 -- 172.21.15.57:0/2139028772 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8022070 con 0x564ac98f1d60 2023-03-02T10:56:36.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f32fcff9700 1 -- 172.21.15.57:0/2139028772 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32f800ee00 con 0x564ac98f1d60 2023-03-02T10:56:36.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.950+0000 7f32fcff9700 1 -- 172.21.15.57:0/2139028772 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8005440 con 0x564ac98f1d60 2023-03-02T10:56:36.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.951+0000 7f33241cfb80 1 -- 172.21.15.57:0/2139028772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 msgr2=0x564ac98f2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.951+0000 7f33241cfb80 1 --2- 172.21.15.57:0/2139028772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac98f2340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f32f800edd0 tx=0x7f32f8009f90 comp rx=0 tx=0).stop 2023-03-02T10:56:36.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.951+0000 7f33241cfb80 1 -- 172.21.15.57:0/2139028772 shutdown_connections 2023-03-02T10:56:36.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.951+0000 7f33241cfb80 1 --2- 172.21.15.57:0/2139028772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f2920 0x564ac98f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.951+0000 7f33241cfb80 1 --2- 172.21.15.57:0/2139028772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1410 0x564ac98f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.951+0000 7f33241cfb80 1 --2- 172.21.15.57:0/2139028772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac98f2340 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.951+0000 7f33241cfb80 1 -- 172.21.15.57:0/2139028772 >> 172.21.15.57:0/2139028772 conn(0x564ac98e6c00 msgr2=0x564ac98ebf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.951+0000 7f33241cfb80 1 -- 172.21.15.57:0/2139028772 shutdown_connections 2023-03-02T10:56:36.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.951+0000 7f33241cfb80 1 -- 172.21.15.57:0/2139028772 wait complete. 2023-03-02T10:56:36.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.951+0000 7f33241cfb80 1 -- start start 2023-03-02T10:56:36.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f33241cfb80 1 Processor -- start 2023-03-02T10:56:36.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f1410 0x564ac98faf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1d60 0x564ac98fb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f2920 0x564ac99024b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f33241cfb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac9849b70 con 0x564ac98f2920 2023-03-02T10:56:36.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f33241cfb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac98430a0 con 0x564ac98f1410 2023-03-02T10:56:36.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f33241cfb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac96c78d0 con 0x564ac98f1d60 2023-03-02T10:56:36.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f33241cfb80 10 client.0 _ll_register_callbacks cb 0x564ac97e94d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:36.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f330ed9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f2920 0x564ac99024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f330e59b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f1410 0x564ac98faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f330ed9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f2920 0x564ac99024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42612/0 (socket says 172.21.15.57:42612) 2023-03-02T10:56:36.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f330ed9c700 1 -- 172.21.15.57:0/4118603783 learned_addr learned my addr 172.21.15.57:0/4118603783 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:36.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f330e59b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f1410 0x564ac98faf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33586/0 (socket says 172.21.15.57:33586) 2023-03-02T10:56:36.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f330dd9a700 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1d60 0x564ac98fb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f330ed9c700 1 -- 172.21.15.57:0/4118603783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1d60 msgr2=0x564ac98fb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f330ed9c700 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1d60 0x564ac98fb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.952+0000 7f330ed9c700 1 -- 172.21.15.57:0/4118603783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f1410 msgr2=0x564ac98faf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.953+0000 7f330ed9c700 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f1410 0x564ac98faf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.953+0000 7f330ed9c700 1 -- 172.21.15.57:0/4118603783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f800eab0 con 0x564ac98f2920 2023-03-02T10:56:36.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.953+0000 7f330ed9c700 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f2920 0x564ac99024b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3300011ed0 tx=0x7f3300014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33a8598214b2127 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.953+0000 7f32f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:36.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.953+0000 7f32f1ffb700 1 -- 172.21.15.57:0/4118603783 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330000e040 con 0x564ac98f2920 2023-03-02T10:56:36.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.953+0000 7f32f1ffb700 1 -- 172.21.15.57:0/4118603783 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f33000093a0 con 0x564ac98f2920 2023-03-02T10:56:36.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.953+0000 7f33241cfb80 1 -- 172.21.15.57:0/4118603783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ac9814760 con 0x564ac98f2920 2023-03-02T10:56:36.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.953+0000 7f32f1ffb700 1 -- 172.21.15.57:0/4118603783 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3300024030 con 0x564ac98f2920 2023-03-02T10:56:36.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.953+0000 7f33241cfb80 10 client.15216 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:36.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.953+0000 7f33241cfb80 1 -- 172.21.15.57:0/4118603783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564ac9671d90 con 0x564ac98f2920 2023-03-02T10:56:36.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.953+0000 7f32f1ffb700 1 -- 172.21.15.57:0/4118603783 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564ac9814760 con 0x564ac98f2920 2023-03-02T10:56:36.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.954+0000 7f32f1ffb700 1 -- 172.21.15.57:0/4118603783 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f330001c020 con 0x564ac98f2920 2023-03-02T10:56:36.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.954+0000 7f33241cfb80 10 client.15216 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:36.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.954+0000 7f33241cfb80 10 client.15216 resolve_mds: resolved name 'f' to daemon mds.f 2023-03-02T10:56:36.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.954+0000 7f33241cfb80 20 client.15216 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:36.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.954+0000 7f33241cfb80 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x564ac9906210 0x564ac9905610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.954+0000 7f33241cfb80 4 client.15216 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:36.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.954+0000 7f33241cfb80 1 -- 172.21.15.57:0/4118603783 --> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ac983c120 con 0x564ac9906210 2023-03-02T10:56:36.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.954+0000 7f330e59b700 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x564ac9906210 0x564ac9905610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.954+0000 7f32f1ffb700 10 client.15216 ms_handle_connect on v2:172.21.15.136:6834/2199127047 2023-03-02T10:56:36.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.954+0000 7f330e59b700 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x564ac9906210 0x564ac9905610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a6d73981dca69c42 server_cookie=48dbf74c1f22b14d in_seq=0 out_seq=0 2023-03-02T10:56:36.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f32f1ffb700 1 -- 172.21.15.57:0/4118603783 <== mds.3 v2:172.21.15.136:6834/2199127047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x564ac983c120 con 0x564ac9906210 2023-03-02T10:56:36.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f32f1ffb700 10 client.15216 handle_command_reply: tid=0 2023-03-02T10:56:36.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f33241cfb80 1 client.15216 shutdown 2023-03-02T10:56:36.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f33241cfb80 1 -- 172.21.15.57:0/4118603783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f2920 msgr2=0x564ac99024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f33241cfb80 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f2920 0x564ac99024b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3300011ed0 tx=0x7f3300014600 comp rx=0 tx=0).stop 2023-03-02T10:56:36.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f33241cfb80 1 -- 172.21.15.57:0/4118603783 shutdown_connections 2023-03-02T10:56:36.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f33241cfb80 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x564ac9906210 0x564ac9905610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f33241cfb80 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f2920 0x564ac99024b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f33241cfb80 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f1410 0x564ac98faf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f32f1ffb700 0 client.15216 ms_handle_reset on v2:172.21.15.136:6834/2199127047 2023-03-02T10:56:36.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f33241cfb80 1 --2- 172.21.15.57:0/4118603783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1d60 0x564ac98fb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f33241cfb80 1 -- 172.21.15.57:0/4118603783 >> 172.21.15.57:0/4118603783 conn(0x564ac98e6c00 msgr2=0x564ac98eb650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f33241cfb80 1 -- 172.21.15.57:0/4118603783 shutdown_connections 2023-03-02T10:56:36.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.955+0000 7f33241cfb80 1 -- 172.21.15.57:0/4118603783 wait complete. 2023-03-02T10:56:36.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.956+0000 7f33241cfb80 20 client.15216 trim_cache size 0 max 16384 2023-03-02T10:56:36.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f33241cfb80 1 Processor -- start 2023-03-02T10:56:36.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f33241cfb80 1 -- start start 2023-03-02T10:56:36.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1410 0x564ac9905610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac9905b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f2920 0x564ac98f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f33241cfb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac983b110 con 0x564ac98f1d60 2023-03-02T10:56:36.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f33241cfb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac98ed900 con 0x564ac98f2920 2023-03-02T10:56:36.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f33241cfb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac983c120 con 0x564ac98f1410 2023-03-02T10:56:36.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f330dd9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac9905b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f330dd9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac9905b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42628/0 (socket says 172.21.15.57:42628) 2023-03-02T10:56:36.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f330dd9a700 1 -- 172.21.15.57:0/291497651 learned_addr learned my addr 172.21.15.57:0/291497651 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:36.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f330e59b700 1 --2- 172.21.15.57:0/291497651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1410 0x564ac9905610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f330ed9c700 1 --2- 172.21.15.57:0/291497651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f2920 0x564ac98f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f330dd9a700 1 -- 172.21.15.57:0/291497651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1410 msgr2=0x564ac9905610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f330dd9a700 1 --2- 172.21.15.57:0/291497651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1410 0x564ac9905610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f330dd9a700 1 -- 172.21.15.57:0/291497651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f2920 msgr2=0x564ac98f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f330dd9a700 1 --2- 172.21.15.57:0/291497651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f2920 0x564ac98f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f330dd9a700 1 -- 172.21.15.57:0/291497651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ac980a140 con 0x564ac98f1d60 2023-03-02T10:56:36.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.973+0000 7f330e59b700 1 --2- 172.21.15.57:0/291497651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1410 0x564ac9905610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:36.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f330dd9a700 1 --2- 172.21.15.57:0/291497651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac9905b50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f32f8011a30 tx=0x7f32f800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33482e4142899b56 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f32fd7fa700 1 -- 172.21.15.57:0/291497651 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8022070 con 0x564ac98f1d60 2023-03-02T10:56:36.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f32fd7fa700 1 -- 172.21.15.57:0/291497651 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32f8023040 con 0x564ac98f1d60 2023-03-02T10:56:36.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f32fd7fa700 1 -- 172.21.15.57:0/291497651 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8004990 con 0x564ac98f1d60 2023-03-02T10:56:36.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f33241cfb80 1 -- 172.21.15.57:0/291497651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 msgr2=0x564ac9905b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f33241cfb80 1 --2- 172.21.15.57:0/291497651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac9905b50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f32f8011a30 tx=0x7f32f800e990 comp rx=0 tx=0).stop 2023-03-02T10:56:36.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f33241cfb80 1 -- 172.21.15.57:0/291497651 shutdown_connections 2023-03-02T10:56:36.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f33241cfb80 1 --2- 172.21.15.57:0/291497651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f2920 0x564ac98f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f33241cfb80 1 --2- 172.21.15.57:0/291497651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f1410 0x564ac9905610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f33241cfb80 1 --2- 172.21.15.57:0/291497651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1d60 0x564ac9905b50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f33241cfb80 1 -- 172.21.15.57:0/291497651 >> 172.21.15.57:0/291497651 conn(0x564ac98e6c00 msgr2=0x564ac98f8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f33241cfb80 1 -- 172.21.15.57:0/291497651 shutdown_connections 2023-03-02T10:56:36.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.974+0000 7f33241cfb80 1 -- 172.21.15.57:0/291497651 wait complete. 2023-03-02T10:56:36.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f33241cfb80 1 -- start start 2023-03-02T10:56:36.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f33241cfb80 1 Processor -- start 2023-03-02T10:56:36.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1410 0x564ac990cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f1d60 0x564ac990d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f33241cfb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f2920 0x564ac990e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f33241cfb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac990e5e0 con 0x564ac98f1410 2023-03-02T10:56:36.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f33241cfb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac990e750 con 0x564ac98f1d60 2023-03-02T10:56:36.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f33241cfb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ac990e910 con 0x564ac98f2920 2023-03-02T10:56:36.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f33241cfb80 10 client.0 _ll_register_callbacks cb 0x564ac97e94d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:36.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f330e59b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1410 0x564ac990cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f330e59b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1410 0x564ac990cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42634/0 (socket says 172.21.15.57:42634) 2023-03-02T10:56:36.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f330e59b700 1 -- 172.21.15.57:0/3704245527 learned_addr learned my addr 172.21.15.57:0/3704245527 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:36.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f330dd9a700 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f1d60 0x564ac990d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.975+0000 7f330ed9c700 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f2920 0x564ac990e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f330e59b700 1 -- 172.21.15.57:0/3704245527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f2920 msgr2=0x564ac990e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f330e59b700 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f2920 0x564ac990e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f330e59b700 1 -- 172.21.15.57:0/3704245527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f1d60 msgr2=0x564ac990d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:36.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f330e59b700 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f1d60 0x564ac990d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f330e59b700 1 -- 172.21.15.57:0/3704245527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ac96c55e0 con 0x564ac98f1410 2023-03-02T10:56:36.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f330e59b700 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1410 0x564ac990cb50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f33040955f0 tx=0x7f3304021c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c9a31e04c4495b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:36.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f32f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:36.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f32f1ffb700 1 -- 172.21.15.57:0/3704245527 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33040ad040 con 0x564ac98f1410 2023-03-02T10:56:36.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f32f1ffb700 1 -- 172.21.15.57:0/3704245527 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3304021580 con 0x564ac98f1410 2023-03-02T10:56:36.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f33241cfb80 1 -- 172.21.15.57:0/3704245527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32f800ee00 con 0x564ac98f1410 2023-03-02T10:56:36.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f32f1ffb700 1 -- 172.21.15.57:0/3704245527 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33040c3160 con 0x564ac98f1410 2023-03-02T10:56:36.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f33241cfb80 10 client.15222 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:36.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f33241cfb80 1 -- 172.21.15.57:0/3704245527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564ac9698200 con 0x564ac98f1410 2023-03-02T10:56:36.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f32f1ffb700 1 -- 172.21.15.57:0/3704245527 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32f800ee00 con 0x564ac98f1410 2023-03-02T10:56:36.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.976+0000 7f32f1ffb700 1 -- 172.21.15.57:0/3704245527 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3304095c30 con 0x564ac98f1410 2023-03-02T10:56:36.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.977+0000 7f33241cfb80 10 client.15222 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:36.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.977+0000 7f33241cfb80 10 client.15222 resolve_mds: resolved name 'f' to daemon mds.f 2023-03-02T10:56:36.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.977+0000 7f33241cfb80 20 client.15222 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:36.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.977+0000 7f33241cfb80 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x564ac995d950 0x564ac995a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:36.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.977+0000 7f33241cfb80 4 client.15222 mds_command: new command op to 24493 tid=0[{"prefix": "status"}] 2023-03-02T10:56:36.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.977+0000 7f33241cfb80 1 -- 172.21.15.57:0/3704245527 --> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564ac983be40 con 0x564ac995d950 2023-03-02T10:56:36.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.977+0000 7f330dd9a700 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x564ac995d950 0x564ac995a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:36.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.977+0000 7f330dd9a700 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x564ac995d950 0x564ac995a310 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=68afeb30483811b server_cookie=4c6c8f7524cbabcf in_seq=0 out_seq=0 2023-03-02T10:56:36.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.977+0000 7f32f1ffb700 10 client.15222 ms_handle_connect on v2:172.21.15.136:6834/2199127047 2023-03-02T10:56:36.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f32f1ffb700 1 -- 172.21.15.57:0/3704245527 <== mds.3 v2:172.21.15.136:6834/2199127047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x564ac983be40 con 0x564ac995d950 2023-03-02T10:56:36.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f32f1ffb700 10 client.15222 handle_command_reply: tid=0 2023-03-02T10:56:36.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 1 client.15222 shutdown 2023-03-02T10:56:36.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 1 -- 172.21.15.57:0/3704245527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1410 msgr2=0x564ac990cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1410 0x564ac990cb50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f33040955f0 tx=0x7f3304021c00 comp rx=0 tx=0).stop 2023-03-02T10:56:36.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 1 -- 172.21.15.57:0/3704245527 shutdown_connections 2023-03-02T10:56:36.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x564ac995d950 0x564ac995a310 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564ac98f2920 0x564ac990e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564ac98f1410 0x564ac990cb50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f32f1ffb700 0 client.15222 ms_handle_reset on v2:172.21.15.136:6834/2199127047 2023-03-02T10:56:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 1 --2- 172.21.15.57:0/3704245527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ac98f1d60 0x564ac990d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 1 -- 172.21.15.57:0/3704245527 >> 172.21.15.57:0/3704245527 conn(0x564ac98e6c00 msgr2=0x564ac98f58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 1 -- 172.21.15.57:0/3704245527 shutdown_connections 2023-03-02T10:56:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 1 -- 172.21.15.57:0/3704245527 wait complete. 2023-03-02T10:56:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33241cfb80 20 client.15222 trim_cache size 0 max 16384 2023-03-02T10:56:36.990 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:36.990 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:56:36.990 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 3, 2023-03-02T10:56:36.990 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 24493, 2023-03-02T10:56:36.990 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-03-02T10:56:36.990 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-03-02T10:56:36.990 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-03-02T10:56:36.991 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 81.441652747999996, 2023-03-02T10:56:36.991 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 26, 2023-03-02T10:56:36.991 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 86, 2023-03-02T10:56:36.991 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 84, 2023-03-02T10:56:36.991 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 107.246716613 2023-03-02T10:56:36.991 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:36.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33107ff700 1 -- 172.21.15.57:0/4161687481 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b420 msgr2=0x7f32f409d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33107ff700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b420 0x7f32f409d8d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f32f8005fd0 tx=0x7f32f8005ee0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33107ff700 1 -- 172.21.15.57:0/4161687481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 msgr2=0x7f33080fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:36.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33107ff700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f33080fff20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f330400b680 tx=0x7f3304005740 comp rx=0 tx=0).stop 2023-03-02T10:56:36.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.978+0000 7f33107ff700 1 -- 172.21.15.57:0/4161687481 shutdown_connections 2023-03-02T10:56:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.979+0000 7f33107ff700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f32f409b420 0x7f32f409d8d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.979+0000 7f33107ff700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33081057f0 0x7f33080feaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.979+0000 7f33107ff700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33081005b0 0x7f33080fff20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.979+0000 7f33107ff700 1 --2- 172.21.15.57:0/4161687481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3308102ed0 0x7f33080fe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.979+0000 7f33107ff700 1 -- 172.21.15.57:0/4161687481 >> 172.21.15.57:0/4161687481 conn(0x7f33080f9fd0 msgr2=0x7f33081011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.979+0000 7f33107ff700 1 -- 172.21.15.57:0/4161687481 shutdown_connections 2023-03-02T10:56:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:36.979+0000 7f33107ff700 1 -- 172.21.15.57:0/4161687481 wait complete. 2023-03-02T10:56:36.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-03-02T10:56:37.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.149+0000 7f0ccddff700 1 -- 172.21.15.57:0/646891813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc80ffc20 msgr2=0x7f0cc8100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.149+0000 7f0ccddff700 1 --2- 172.21.15.57:0/646891813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc80ffc20 0x7f0cc8100090 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009990 tx=0x7f0cbc009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.149+0000 7f0ccddff700 1 -- 172.21.15.57:0/646891813 shutdown_connections 2023-03-02T10:56:37.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.149+0000 7f0ccddff700 1 --2- 172.21.15.57:0/646891813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cc81005d0 0x7f0cc8106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.149+0000 7f0ccddff700 1 --2- 172.21.15.57:0/646891813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc80fe990 0x7f0cc80feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.149+0000 7f0ccddff700 1 --2- 172.21.15.57:0/646891813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc80ffc20 0x7f0cc8100090 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.149+0000 7f0ccddff700 1 -- 172.21.15.57:0/646891813 >> 172.21.15.57:0/646891813 conn(0x7f0cc80f9fd0 msgr2=0x7f0cc80fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.149+0000 7f0ccddff700 1 -- 172.21.15.57:0/646891813 shutdown_connections 2023-03-02T10:56:37.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.149+0000 7f0ccddff700 1 -- 172.21.15.57:0/646891813 wait complete. 2023-03-02T10:56:37.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0ccddff700 1 Processor -- start 2023-03-02T10:56:37.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0ccddff700 1 -- start start 2023-03-02T10:56:37.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0ccddff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc80fe990 0x7f0cc8195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0ccddff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc80ffc20 0x7f0cc8195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0ccddff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cc81005d0 0x7f0cc819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0ccddff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc819d3c0 con 0x7f0cc80ffc20 2023-03-02T10:56:37.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0ccddff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc819d500 con 0x7f0cc81005d0 2023-03-02T10:56:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0ccddff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc819d690 con 0x7f0cc80fe990 2023-03-02T10:56:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0cc6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc80ffc20 0x7f0cc8195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0cc6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc80ffc20 0x7f0cc8195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42656/0 (socket says 172.21.15.57:42656) 2023-03-02T10:56:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0cc6ffd700 1 -- 172.21.15.57:0/1412653949 learned_addr learned my addr 172.21.15.57:0/1412653949 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.150+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc80fe990 0x7f0cc8195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0cc7fff700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cc81005d0 0x7f0cc819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0cc6ffd700 1 -- 172.21.15.57:0/1412653949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc80fe990 msgr2=0x7f0cc8195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0cc6ffd700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc80fe990 0x7f0cc8195840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0cc6ffd700 1 -- 172.21.15.57:0/1412653949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cc81005d0 msgr2=0x7f0cc819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0cc6ffd700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cc81005d0 0x7f0cc819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0cc6ffd700 1 -- 172.21.15.57:0/1412653949 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc0095f0 con 0x7f0cc80ffc20 2023-03-02T10:56:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0cc6ffd700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc80ffc20 0x7f0cc8195d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b680 tx=0x7f0cbc0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0cc4ff9700 1 -- 172.21.15.57:0/1412653949 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc01d070 con 0x7f0cc80ffc20 2023-03-02T10:56:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0cc4ff9700 1 -- 172.21.15.57:0/1412653949 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cbc022470 con 0x7f0cc80ffc20 2023-03-02T10:56:37.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0ccddff700 1 -- 172.21.15.57:0/1412653949 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc810b4a0 con 0x7f0cc80ffc20 2023-03-02T10:56:37.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0cc4ff9700 1 -- 172.21.15.57:0/1412653949 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc017650 con 0x7f0cc80ffc20 2023-03-02T10:56:37.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.151+0000 7f0ccddff700 1 -- 172.21.15.57:0/1412653949 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc810b310 con 0x7f0cc80ffc20 2023-03-02T10:56:37.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.154+0000 7f0cc4ff9700 1 -- 172.21.15.57:0/1412653949 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f0cbc029030 con 0x7f0cc80ffc20 2023-03-02T10:56:37.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.155+0000 7f0cc4ff9700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cb009b420 0x7f0cb009d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.155+0000 7f0cc4ff9700 1 -- 172.21.15.57:0/1412653949 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0cbc0c6310 con 0x7f0cc80ffc20 2023-03-02T10:56:37.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.155+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cb009b420 0x7f0cb009d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cb009b420 0x7f0cb009d8d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009c60 tx=0x7f0cb8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0ce1740b80 1 Processor -- start 2023-03-02T10:56:37.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0ce1740b80 1 -- start start 2023-03-02T10:56:37.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a981cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a982740 0x55e34a982bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 0x55e34a989990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a8e4a10 con 0x55e34a9818b0 2023-03-02T10:56:37.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a896f30 con 0x55e34a982740 2023-03-02T10:56:37.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a867110 con 0x55e34a9830f0 2023-03-02T10:56:37.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0cc77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a981cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0cc77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a981cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42670/0 (socket says 172.21.15.57:42670) 2023-03-02T10:56:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0cc77fe700 1 -- 172.21.15.57:0/2928287604 learned_addr learned my addr 172.21.15.57:0/2928287604 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0cc6ffd700 1 --2- 172.21.15.57:0/2928287604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a982740 0x55e34a982bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0cc7fff700 1 --2- 172.21.15.57:0/2928287604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 0x55e34a989990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0cc77fe700 1 -- 172.21.15.57:0/2928287604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 msgr2=0x55e34a989990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/2928287604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 0x55e34a989990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0cc77fe700 1 -- 172.21.15.57:0/2928287604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a982740 msgr2=0x55e34a982bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.156+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/2928287604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a982740 0x55e34a982bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.157+0000 7f0cc77fe700 1 -- 172.21.15.57:0/2928287604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e34a7515e0 con 0x55e34a9818b0 2023-03-02T10:56:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.157+0000 7f0cc7fff700 1 --2- 172.21.15.57:0/2928287604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 0x55e34a989990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:56:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.157+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/2928287604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a981cc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800e4e0 tx=0x7f0cb8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2855251b3c96fe server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.157+0000 7f0cadffb700 1 -- 172.21.15.57:0/2928287604 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800ee00 con 0x55e34a9818b0 2023-03-02T10:56:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.157+0000 7f0cadffb700 1 -- 172.21.15.57:0/2928287604 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cb8021070 con 0x55e34a9818b0 2023-03-02T10:56:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.157+0000 7f0cadffb700 1 -- 172.21.15.57:0/2928287604 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb801d7b0 con 0x55e34a9818b0 2023-03-02T10:56:37.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.158+0000 7f0ce1740b80 1 -- 172.21.15.57:0/2928287604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 msgr2=0x55e34a981cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.158+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/2928287604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a981cc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800e4e0 tx=0x7f0cb8014000 comp rx=0 tx=0).stop 2023-03-02T10:56:37.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.158+0000 7f0ce1740b80 1 -- 172.21.15.57:0/2928287604 shutdown_connections 2023-03-02T10:56:37.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.158+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/2928287604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 0x55e34a989990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.158+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/2928287604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a981cc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.158+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/2928287604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a982740 0x55e34a982bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.158+0000 7f0ce1740b80 1 -- 172.21.15.57:0/2928287604 >> 172.21.15.57:0/2928287604 conn(0x55e34a972c00 msgr2=0x55e34a977f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.158+0000 7f0ce1740b80 1 -- 172.21.15.57:0/2928287604 shutdown_connections 2023-03-02T10:56:37.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.158+0000 7f0ce1740b80 1 -- 172.21.15.57:0/2928287604 wait complete. 2023-03-02T10:56:37.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.158+0000 7f0ce1740b80 1 -- start start 2023-03-02T10:56:37.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.158+0000 7f0ce1740b80 1 Processor -- start 2023-03-02T10:56:37.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a98b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a982740 0x55e34a98b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 0x55e34a9928e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a8d5b70 con 0x55e34a9818b0 2023-03-02T10:56:37.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a8cf0a0 con 0x55e34a982740 2023-03-02T10:56:37.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a7538d0 con 0x55e34a9830f0 2023-03-02T10:56:37.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0ce1740b80 10 client.0 _ll_register_callbacks cb 0x55e34a8754d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:37.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a98b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a98b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42678/0 (socket says 172.21.15.57:42678) 2023-03-02T10:56:37.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc77fe700 1 -- 172.21.15.57:0/1696829664 learned_addr learned my addr 172.21.15.57:0/1696829664 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc7fff700 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 0x55e34a9928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc6ffd700 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a982740 0x55e34a98b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc77fe700 1 -- 172.21.15.57:0/1696829664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 msgr2=0x55e34a9928e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 0x55e34a9928e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc77fe700 1 -- 172.21.15.57:0/1696829664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a982740 msgr2=0x55e34a98b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a982740 0x55e34a98b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc77fe700 1 -- 172.21.15.57:0/1696829664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb8017070 con 0x55e34a9818b0 2023-03-02T10:56:37.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc7fff700 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 0x55e34a9928e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:37.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a98b360 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800e4b0 tx=0x7f0cb800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62962b63d79e22a1 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0ca6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:37.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1696829664 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80054b0 con 0x55e34a9818b0 2023-03-02T10:56:37.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1696829664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e34a8a0760 con 0x55e34a9818b0 2023-03-02T10:56:37.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.159+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1696829664 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0cb8005610 con 0x55e34a9818b0 2023-03-02T10:56:37.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1696829664 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cb8003680 con 0x55e34a9818b0 2023-03-02T10:56:37.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0ce1740b80 10 client.15234 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:37.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1696829664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e34a6fdd90 con 0x55e34a9818b0 2023-03-02T10:56:37.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1696829664 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e34a8a0760 con 0x55e34a9818b0 2023-03-02T10:56:37.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1696829664 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0cb801c9a0 con 0x55e34a9818b0 2023-03-02T10:56:37.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0ce1740b80 10 client.15234 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:37.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0ce1740b80 10 client.15234 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-02T10:56:37.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0ce1740b80 20 client.15234 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:37.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55e34a996430 0x55e34a995890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0ce1740b80 4 client.15234 mds_command: new command op to 24505 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:37.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1696829664 --> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e34a8c8120 con 0x55e34a996430 2023-03-02T10:56:37.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.160+0000 7f0cc6ffd700 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55e34a996430 0x55e34a995890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.161+0000 7f0cc6ffd700 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55e34a996430 0x55e34a995890 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=54dda4b4735b5753 server_cookie=6ab40b70f9ea264 in_seq=0 out_seq=0 2023-03-02T10:56:37.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.161+0000 7f0ca6ffd700 10 client.15234 ms_handle_connect on v2:172.21.15.136:6836/2130761226 2023-03-02T10:56:37.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.161+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1696829664 <== mds.2 v2:172.21.15.136:6836/2130761226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55e34a8c8120 con 0x55e34a996430 2023-03-02T10:56:37.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ca6ffd700 10 client.15234 handle_command_reply: tid=0 2023-03-02T10:56:37.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 1 client.15234 shutdown 2023-03-02T10:56:37.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1696829664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 msgr2=0x55e34a98b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a98b360 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800e4b0 tx=0x7f0cb800ef10 comp rx=0 tx=0).stop 2023-03-02T10:56:37.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1696829664 shutdown_connections 2023-03-02T10:56:37.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55e34a996430 0x55e34a995890 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a9830f0 0x55e34a9928e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a98b360 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ca6ffd700 0 client.15234 ms_handle_reset on v2:172.21.15.136:6836/2130761226 2023-03-02T10:56:37.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1696829664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a982740 0x55e34a98b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1696829664 >> 172.21.15.57:0/1696829664 conn(0x55e34a972c00 msgr2=0x55e34a977650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1696829664 shutdown_connections 2023-03-02T10:56:37.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1696829664 wait complete. 2023-03-02T10:56:37.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.162+0000 7f0ce1740b80 20 client.15234 trim_cache size 0 max 16384 2023-03-02T10:56:37.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.179+0000 7f0ce1740b80 1 Processor -- start 2023-03-02T10:56:37.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0ce1740b80 1 -- start start 2023-03-02T10:56:37.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a9818b0 0x55e34a995890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a982740 0x55e34a986120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9830f0 0x55e34a986660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a8a0760 con 0x55e34a9830f0 2023-03-02T10:56:37.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a8c7110 con 0x55e34a9818b0 2023-03-02T10:56:37.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a7dbed0 con 0x55e34a982740 2023-03-02T10:56:37.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cc7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9830f0 0x55e34a986660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cc7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9830f0 0x55e34a986660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42680/0 (socket says 172.21.15.57:42680) 2023-03-02T10:56:37.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cc7fff700 1 -- 172.21.15.57:0/3672184172 learned_addr learned my addr 172.21.15.57:0/3672184172 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cc6ffd700 1 --2- 172.21.15.57:0/3672184172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a982740 0x55e34a986120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/3672184172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a9818b0 0x55e34a995890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cc7fff700 1 -- 172.21.15.57:0/3672184172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a982740 msgr2=0x55e34a986120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cc7fff700 1 --2- 172.21.15.57:0/3672184172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a982740 0x55e34a986120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cc7fff700 1 -- 172.21.15.57:0/3672184172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a9818b0 msgr2=0x55e34a995890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cc7fff700 1 --2- 172.21.15.57:0/3672184172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a9818b0 0x55e34a995890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cc7fff700 1 -- 172.21.15.57:0/3672184172 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e34a896140 con 0x55e34a9830f0 2023-03-02T10:56:37.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cc7fff700 1 --2- 172.21.15.57:0/3672184172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9830f0 0x55e34a986660 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009810 tx=0x7f0cc0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5d7a0d147caab3 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.180+0000 7f0cae7fc700 1 -- 172.21.15.57:0/3672184172 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0004bb0 con 0x55e34a9830f0 2023-03-02T10:56:37.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0cae7fc700 1 -- 172.21.15.57:0/3672184172 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cc000f070 con 0x55e34a9830f0 2023-03-02T10:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0cae7fc700 1 -- 172.21.15.57:0/3672184172 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0007d20 con 0x55e34a9830f0 2023-03-02T10:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0ce1740b80 1 -- 172.21.15.57:0/3672184172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9830f0 msgr2=0x55e34a986660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/3672184172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9830f0 0x55e34a986660 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009810 tx=0x7f0cc0009b20 comp rx=0 tx=0).stop 2023-03-02T10:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0ce1740b80 1 -- 172.21.15.57:0/3672184172 shutdown_connections 2023-03-02T10:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/3672184172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9830f0 0x55e34a986660 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/3672184172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a9818b0 0x55e34a995890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/3672184172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a982740 0x55e34a986120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0ce1740b80 1 -- 172.21.15.57:0/3672184172 >> 172.21.15.57:0/3672184172 conn(0x55e34a972c00 msgr2=0x55e34a989610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0ce1740b80 1 -- 172.21.15.57:0/3672184172 shutdown_connections 2023-03-02T10:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0ce1740b80 1 -- 172.21.15.57:0/3672184172 wait complete. 2023-03-02T10:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.181+0000 7f0ce1740b80 1 -- start start 2023-03-02T10:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0ce1740b80 1 Processor -- start 2023-03-02T10:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a99c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a982740 0x55e34a99c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0ce1740b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a9830f0 0x55e34a99d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a99dcf0 con 0x55e34a9818b0 2023-03-02T10:56:37.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a99de60 con 0x55e34a9830f0 2023-03-02T10:56:37.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0ce1740b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e34a99e020 con 0x55e34a982740 2023-03-02T10:56:37.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0ce1740b80 10 client.0 _ll_register_callbacks cb 0x55e34a8754d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:37.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0cc77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a99c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0cc77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a99c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42688/0 (socket says 172.21.15.57:42688) 2023-03-02T10:56:37.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0cc77fe700 1 -- 172.21.15.57:0/1954058479 learned_addr learned my addr 172.21.15.57:0/1954058479 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0cc7fff700 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a9830f0 0x55e34a99d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0cc77fe700 1 -- 172.21.15.57:0/1954058479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a982740 msgr2=0x55e34a99c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0cc6ffd700 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a982740 0x55e34a99c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a982740 0x55e34a99c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0cc77fe700 1 -- 172.21.15.57:0/1954058479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a9830f0 msgr2=0x55e34a99d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a9830f0 0x55e34a99d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0cc77fe700 1 -- 172.21.15.57:0/1954058479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc0003ca0 con 0x55e34a9818b0 2023-03-02T10:56:37.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0cc77fe700 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a99c260 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009ec0 tx=0x7f0cb8005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2840e4b957cd7510 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.182+0000 7f0ca6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:37.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1954058479 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80050f0 con 0x55e34a9818b0 2023-03-02T10:56:37.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1954058479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0cb8021070 con 0x55e34a9818b0 2023-03-02T10:56:37.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1954058479 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0cb801d690 con 0x55e34a9818b0 2023-03-02T10:56:37.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1954058479 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cb801dae0 con 0x55e34a9818b0 2023-03-02T10:56:37.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ce1740b80 10 client.15240 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:37.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1954058479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e34a724200 con 0x55e34a9818b0 2023-03-02T10:56:37.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1954058479 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cb8021070 con 0x55e34a9818b0 2023-03-02T10:56:37.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1954058479 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0cb8003680 con 0x55e34a9818b0 2023-03-02T10:56:37.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ce1740b80 10 client.15240 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:37.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ce1740b80 10 client.15240 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-02T10:56:37.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ce1740b80 20 client.15240 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:37.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55e34a9ed1b0 0x55e34a9e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ce1740b80 4 client.15240 mds_command: new command op to 24505 tid=0[{"prefix": "status"}] 2023-03-02T10:56:37.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.183+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1954058479 --> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e34a8c7e40 con 0x55e34a9ed1b0 2023-03-02T10:56:37.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0cc6ffd700 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55e34a9ed1b0 0x55e34a9e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0cc6ffd700 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55e34a9ed1b0 0x55e34a9e9c90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3771503102cafd55 server_cookie=8edba7e8b26ce0c9 in_seq=0 out_seq=0 2023-03-02T10:56:37.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ca6ffd700 10 client.15240 ms_handle_connect on v2:172.21.15.136:6836/2130761226 2023-03-02T10:56:37.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ca6ffd700 1 -- 172.21.15.57:0/1954058479 <== mds.2 v2:172.21.15.136:6836/2130761226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x55e34a8c7e40 con 0x55e34a9ed1b0 2023-03-02T10:56:37.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ca6ffd700 10 client.15240 handle_command_reply: tid=0 2023-03-02T10:56:37.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ce1740b80 1 client.15240 shutdown 2023-03-02T10:56:37.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1954058479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 msgr2=0x55e34a99c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a99c260 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009ec0 tx=0x7f0cb8005760 comp rx=0 tx=0).stop 2023-03-02T10:56:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1954058479 shutdown_connections 2023-03-02T10:56:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55e34a9ed1b0 0x55e34a9e9c90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e34a9830f0 0x55e34a99d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e34a9818b0 0x55e34a99c260 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ca6ffd700 0 client.15240 ms_handle_reset on v2:172.21.15.136:6836/2130761226 2023-03-02T10:56:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ce1740b80 1 --2- 172.21.15.57:0/1954058479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e34a982740 0x55e34a99c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.184+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1954058479 >> 172.21.15.57:0/1954058479 conn(0x55e34a972c00 msgr2=0x55e34a995890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1954058479 shutdown_connections 2023-03-02T10:56:37.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ce1740b80 1 -- 172.21.15.57:0/1954058479 wait complete. 2023-03-02T10:56:37.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ce1740b80 20 client.15240 trim_cache size 0 max 16384 2023-03-02T10:56:37.195 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:56:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 2, 2023-03-02T10:56:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 24505, 2023-03-02T10:56:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-03-02T10:56:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-03-02T10:56:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-03-02T10:56:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 82.655697046, 2023-03-02T10:56:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 26, 2023-03-02T10:56:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 86, 2023-03-02T10:56:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 84, 2023-03-02T10:56:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 105.320063781 2023-03-02T10:56:37.197 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:37.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 -- 172.21.15.57:0/1412653949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cb009b420 msgr2=0x7f0cb009d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cb009b420 0x7f0cb009d8d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009c60 tx=0x7f0cb8009260 comp rx=0 tx=0).stop 2023-03-02T10:56:37.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 -- 172.21.15.57:0/1412653949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc80ffc20 msgr2=0x7f0cc8195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc80ffc20 0x7f0cc8195d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b680 tx=0x7f0cbc0057b0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 -- 172.21.15.57:0/1412653949 shutdown_connections 2023-03-02T10:56:37.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f0cb009b420 0x7f0cb009d8d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cc81005d0 0x7f0cc819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cc80fe990 0x7f0cc8195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 --2- 172.21.15.57:0/1412653949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc80ffc20 0x7f0cc8195d80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 -- 172.21.15.57:0/1412653949 >> 172.21.15.57:0/1412653949 conn(0x7f0cc80f9fd0 msgr2=0x7f0cc80fc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 -- 172.21.15.57:0/1412653949 shutdown_connections 2023-03-02T10:56:37.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.185+0000 7f0ccddff700 1 -- 172.21.15.57:0/1412653949 wait complete. 2023-03-02T10:56:37.201 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-03-02T10:56:37.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.357+0000 7ff75dfff700 1 -- 172.21.15.57:0/500524423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff758102ed0 msgr2=0x7ff7581052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.357+0000 7ff75dfff700 1 --2- 172.21.15.57:0/500524423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff758102ed0 0x7ff7581052b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009990 tx=0x7ff74c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.357+0000 7ff75dfff700 1 -- 172.21.15.57:0/500524423 shutdown_connections 2023-03-02T10:56:37.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.357+0000 7ff75dfff700 1 --2- 172.21.15.57:0/500524423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7581057f0 0x7ff758107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.357+0000 7ff75dfff700 1 --2- 172.21.15.57:0/500524423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7581005b0 0x7ff758102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.357+0000 7ff75dfff700 1 --2- 172.21.15.57:0/500524423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff758102ed0 0x7ff7581052b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.357+0000 7ff75dfff700 1 -- 172.21.15.57:0/500524423 >> 172.21.15.57:0/500524423 conn(0x7ff7580f9fd0 msgr2=0x7ff7580fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.357+0000 7ff75dfff700 1 -- 172.21.15.57:0/500524423 shutdown_connections 2023-03-02T10:56:37.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.357+0000 7ff75dfff700 1 -- 172.21.15.57:0/500524423 wait complete. 2023-03-02T10:56:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff75dfff700 1 Processor -- start 2023-03-02T10:56:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff75dfff700 1 -- start start 2023-03-02T10:56:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff75dfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7581005b0 0x7ff758195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff75dfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff758102ed0 0x7ff758195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff75dfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7581057f0 0x7ff75819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff75dfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75819d390 con 0x7ff758102ed0 2023-03-02T10:56:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff75dfff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75819d4d0 con 0x7ff7581005b0 2023-03-02T10:56:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff75dfff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75819d660 con 0x7ff7581057f0 2023-03-02T10:56:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff756ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff758102ed0 0x7ff758195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff756ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff758102ed0 0x7ff758195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42710/0 (socket says 172.21.15.57:42710) 2023-03-02T10:56:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff756ffd700 1 -- 172.21.15.57:0/2998289739 learned_addr learned my addr 172.21.15.57:0/2998289739 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff7577fe700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7581005b0 0x7ff758195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.358+0000 7ff757fff700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7581057f0 0x7ff75819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.359+0000 7ff756ffd700 1 -- 172.21.15.57:0/2998289739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7581057f0 msgr2=0x7ff75819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.359+0000 7ff756ffd700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7581057f0 0x7ff75819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.359+0000 7ff756ffd700 1 -- 172.21.15.57:0/2998289739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7581005b0 msgr2=0x7ff758195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.359+0000 7ff756ffd700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7581005b0 0x7ff758195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.359+0000 7ff756ffd700 1 -- 172.21.15.57:0/2998289739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c0095f0 con 0x7ff758102ed0 2023-03-02T10:56:37.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.359+0000 7ff756ffd700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff758102ed0 0x7ff758195d50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0098e0 tx=0x7ff74c004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.359+0000 7ff754ff9700 1 -- 172.21.15.57:0/2998289739 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c01d070 con 0x7ff758102ed0 2023-03-02T10:56:37.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.359+0000 7ff754ff9700 1 -- 172.21.15.57:0/2998289739 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff74c021410 con 0x7ff758102ed0 2023-03-02T10:56:37.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.359+0000 7ff75dfff700 1 -- 172.21.15.57:0/2998289739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75810b420 con 0x7ff758102ed0 2023-03-02T10:56:37.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.359+0000 7ff754ff9700 1 -- 172.21.15.57:0/2998289739 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c017650 con 0x7ff758102ed0 2023-03-02T10:56:37.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.359+0000 7ff75dfff700 1 -- 172.21.15.57:0/2998289739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75810b290 con 0x7ff758102ed0 2023-03-02T10:56:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.362+0000 7ff754ff9700 1 -- 172.21.15.57:0/2998289739 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7ff74c028030 con 0x7ff758102ed0 2023-03-02T10:56:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.363+0000 7ff754ff9700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff74009b3a0 0x7ff74009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.363+0000 7ff754ff9700 1 -- 172.21.15.57:0/2998289739 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff74c0c6270 con 0x7ff758102ed0 2023-03-02T10:56:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.363+0000 7ff7577fe700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff74009b3a0 0x7ff74009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.363+0000 7ff771971b80 1 Processor -- start 2023-03-02T10:56:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.363+0000 7ff7577fe700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff74009b3a0 0x7ff74009d850 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff758068140 tx=0x7ff748009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.363+0000 7ff771971b80 1 -- start start 2023-03-02T10:56:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff771971b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf29f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff771971b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2a0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff771971b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf2a0920 0x5634bf2a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff771971b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf206a10 con 0x5634bf29f410 2023-03-02T10:56:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff771971b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf1b8f30 con 0x5634bf2a0920 2023-03-02T10:56:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff771971b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf189110 con 0x5634bf29fd60 2023-03-02T10:56:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff7577fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf29f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff7577fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf29f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42718/0 (socket says 172.21.15.57:42718) 2023-03-02T10:56:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff7577fe700 1 -- 172.21.15.57:0/4101390738 learned_addr learned my addr 172.21.15.57:0/4101390738 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff756ffd700 1 --2- 172.21.15.57:0/4101390738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff757fff700 1 --2- 172.21.15.57:0/4101390738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf2a0920 0x5634bf2a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff7577fe700 1 -- 172.21.15.57:0/4101390738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 msgr2=0x5634bf2a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff7577fe700 1 --2- 172.21.15.57:0/4101390738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff7577fe700 1 -- 172.21.15.57:0/4101390738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf2a0920 msgr2=0x5634bf2a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff7577fe700 1 --2- 172.21.15.57:0/4101390738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf2a0920 0x5634bf2a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff7577fe700 1 -- 172.21.15.57:0/4101390738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634bf0735e0 con 0x5634bf29f410 2023-03-02T10:56:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff757fff700 1 --2- 172.21.15.57:0/4101390738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf2a0920 0x5634bf2a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.364+0000 7ff7577fe700 1 --2- 172.21.15.57:0/4101390738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf29f820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff748011d50 tx=0x7ff748014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e099aca58fc850dc server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.365+0000 7ff73dffb700 1 -- 172.21.15.57:0/4101390738 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74800ebd0 con 0x5634bf29f410 2023-03-02T10:56:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.365+0000 7ff73dffb700 1 -- 172.21.15.57:0/4101390738 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff748021070 con 0x5634bf29f410 2023-03-02T10:56:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.365+0000 7ff73dffb700 1 -- 172.21.15.57:0/4101390738 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74801d670 con 0x5634bf29f410 2023-03-02T10:56:37.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.365+0000 7ff771971b80 1 -- 172.21.15.57:0/4101390738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 msgr2=0x5634bf29f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.365+0000 7ff771971b80 1 --2- 172.21.15.57:0/4101390738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf29f820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff748011d50 tx=0x7ff748014000 comp rx=0 tx=0).stop 2023-03-02T10:56:37.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.365+0000 7ff771971b80 1 -- 172.21.15.57:0/4101390738 shutdown_connections 2023-03-02T10:56:37.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.365+0000 7ff771971b80 1 --2- 172.21.15.57:0/4101390738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf2a0920 0x5634bf2a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.365+0000 7ff771971b80 1 --2- 172.21.15.57:0/4101390738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf29f820 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.365+0000 7ff771971b80 1 --2- 172.21.15.57:0/4101390738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.365+0000 7ff771971b80 1 -- 172.21.15.57:0/4101390738 >> 172.21.15.57:0/4101390738 conn(0x5634bf294c00 msgr2=0x5634bf299f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff771971b80 1 -- 172.21.15.57:0/4101390738 shutdown_connections 2023-03-02T10:56:37.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff771971b80 1 -- 172.21.15.57:0/4101390738 wait complete. 2023-03-02T10:56:37.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff771971b80 1 -- start start 2023-03-02T10:56:37.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff771971b80 1 Processor -- start 2023-03-02T10:56:37.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff771971b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff771971b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff771971b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf2a0920 0x5634bf2b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff771971b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf1f7b70 con 0x5634bf29f410 2023-03-02T10:56:37.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff771971b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf1f10a0 con 0x5634bf2a0920 2023-03-02T10:56:37.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff771971b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf0758d0 con 0x5634bf29fd60 2023-03-02T10:56:37.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff771971b80 10 client.0 _ll_register_callbacks cb 0x5634bf1974d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:37.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.366+0000 7ff7577fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff7577fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42730/0 (socket says 172.21.15.57:42730) 2023-03-02T10:56:37.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff7577fe700 1 -- 172.21.15.57:0/4272144979 learned_addr learned my addr 172.21.15.57:0/4272144979 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff756ffd700 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff757fff700 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf2a0920 0x5634bf2b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff7577fe700 1 -- 172.21.15.57:0/4272144979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 msgr2=0x5634bf2a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff7577fe700 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff7577fe700 1 -- 172.21.15.57:0/4272144979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf2a0920 msgr2=0x5634bf2b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff7577fe700 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf2a0920 0x5634bf2b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff7577fe700 1 -- 172.21.15.57:0/4272144979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff748017070 con 0x5634bf29f410 2023-03-02T10:56:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff7577fe700 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a8f60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff74801cfc0 tx=0x7ff748011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464828743d905c38 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff736ffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff736ffd700 1 -- 172.21.15.57:0/4272144979 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74801c410 con 0x5634bf29f410 2023-03-02T10:56:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff736ffd700 1 -- 172.21.15.57:0/4272144979 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff74801c570 con 0x5634bf29f410 2023-03-02T10:56:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.367+0000 7ff771971b80 1 -- 172.21.15.57:0/4272144979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634bf1c2760 con 0x5634bf29f410 2023-03-02T10:56:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff736ffd700 1 -- 172.21.15.57:0/4272144979 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff74801c730 con 0x5634bf29f410 2023-03-02T10:56:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff771971b80 10 client.15252 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff771971b80 1 -- 172.21.15.57:0/4272144979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5634bf01fd90 con 0x5634bf29f410 2023-03-02T10:56:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff736ffd700 1 -- 172.21.15.57:0/4272144979 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5634bf1c2760 con 0x5634bf29f410 2023-03-02T10:56:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff736ffd700 1 -- 172.21.15.57:0/4272144979 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff7480038e0 con 0x5634bf29f410 2023-03-02T10:56:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff771971b80 10 client.15252 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff771971b80 10 client.15252 resolve_mds: resolved name 'i' to daemon mds.i 2023-03-02T10:56:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff771971b80 20 client.15252 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff771971b80 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x5634bf2b46a0 0x5634bf2b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff771971b80 4 client.15252 mds_command: new command op to 24520 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff771971b80 1 -- 172.21.15.57:0/4272144979 --> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634bf1ea120 con 0x5634bf2b46a0 2023-03-02T10:56:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.368+0000 7ff756ffd700 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x5634bf2b46a0 0x5634bf2b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.369+0000 7ff756ffd700 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x5634bf2b46a0 0x5634bf2b3520 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d98e6f12c63b9c server_cookie=ea4608048e5c613e in_seq=0 out_seq=0 2023-03-02T10:56:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.369+0000 7ff736ffd700 10 client.15252 ms_handle_connect on v2:172.21.15.136:6838/1702113579 2023-03-02T10:56:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.369+0000 7ff736ffd700 1 -- 172.21.15.57:0/4272144979 <== mds.1 v2:172.21.15.136:6838/1702113579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5634bf1ea120 con 0x5634bf2b46a0 2023-03-02T10:56:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.369+0000 7ff736ffd700 10 client.15252 handle_command_reply: tid=0 2023-03-02T10:56:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.369+0000 7ff771971b80 1 client.15252 shutdown 2023-03-02T10:56:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff771971b80 1 -- 172.21.15.57:0/4272144979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 msgr2=0x5634bf2a8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff771971b80 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a8f60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff74801cfc0 tx=0x7ff748011d80 comp rx=0 tx=0).stop 2023-03-02T10:56:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff771971b80 1 -- 172.21.15.57:0/4272144979 shutdown_connections 2023-03-02T10:56:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff771971b80 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x5634bf2b46a0 0x5634bf2b3520 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff771971b80 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf2a0920 0x5634bf2b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff771971b80 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a8f60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff771971b80 1 --2- 172.21.15.57:0/4272144979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff736ffd700 0 client.15252 ms_handle_reset on v2:172.21.15.136:6838/1702113579 2023-03-02T10:56:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff771971b80 1 -- 172.21.15.57:0/4272144979 >> 172.21.15.57:0/4272144979 conn(0x5634bf294c00 msgr2=0x5634bf299650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff771971b80 1 -- 172.21.15.57:0/4272144979 shutdown_connections 2023-03-02T10:56:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff771971b80 1 -- 172.21.15.57:0/4272144979 wait complete. 2023-03-02T10:56:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.370+0000 7ff771971b80 20 client.15252 trim_cache size 0 max 16384 2023-03-02T10:56:37.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff771971b80 1 Processor -- start 2023-03-02T10:56:37.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff771971b80 1 -- start start 2023-03-02T10:56:37.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff771971b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff771971b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf29fd60 0x5634bf2a6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff771971b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf2a0920 0x5634bf2b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff771971b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf1ea120 con 0x5634bf29f410 2023-03-02T10:56:37.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff771971b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf1c2760 con 0x5634bf29fd60 2023-03-02T10:56:37.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff771971b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf1e9110 con 0x5634bf2a0920 2023-03-02T10:56:37.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff7577fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff7577fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42736/0 (socket says 172.21.15.57:42736) 2023-03-02T10:56:37.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff7577fe700 1 -- 172.21.15.57:0/116764046 learned_addr learned my addr 172.21.15.57:0/116764046 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff7577fe700 1 -- 172.21.15.57:0/116764046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf2a0920 msgr2=0x5634bf2b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff756ffd700 1 --2- 172.21.15.57:0/116764046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf29fd60 0x5634bf2a6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff7577fe700 1 --2- 172.21.15.57:0/116764046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf2a0920 0x5634bf2b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff7577fe700 1 -- 172.21.15.57:0/116764046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf29fd60 msgr2=0x5634bf2a6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff7577fe700 1 --2- 172.21.15.57:0/116764046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf29fd60 0x5634bf2a6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.388+0000 7ff7577fe700 1 -- 172.21.15.57:0/116764046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634bf1b8140 con 0x5634bf29f410 2023-03-02T10:56:37.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff7577fe700 1 --2- 172.21.15.57:0/116764046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a7c30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff748009b20 tx=0x7ff748011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4888d416fe62ab server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff73e7fc700 1 -- 172.21.15.57:0/116764046 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480092d0 con 0x5634bf29f410 2023-03-02T10:56:37.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff73e7fc700 1 -- 172.21.15.57:0/116764046 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff748011df0 con 0x5634bf29f410 2023-03-02T10:56:37.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff73e7fc700 1 -- 172.21.15.57:0/116764046 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff748005320 con 0x5634bf29f410 2023-03-02T10:56:37.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff771971b80 1 -- 172.21.15.57:0/116764046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 msgr2=0x5634bf2a7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff771971b80 1 --2- 172.21.15.57:0/116764046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a7c30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff748009b20 tx=0x7ff748011cd0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff771971b80 1 -- 172.21.15.57:0/116764046 shutdown_connections 2023-03-02T10:56:37.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff771971b80 1 --2- 172.21.15.57:0/116764046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf2a0920 0x5634bf2b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff771971b80 1 --2- 172.21.15.57:0/116764046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf29f410 0x5634bf2a7c30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff771971b80 1 --2- 172.21.15.57:0/116764046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf29fd60 0x5634bf2a6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff771971b80 1 -- 172.21.15.57:0/116764046 >> 172.21.15.57:0/116764046 conn(0x5634bf294c00 msgr2=0x5634bf299650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff771971b80 1 -- 172.21.15.57:0/116764046 shutdown_connections 2023-03-02T10:56:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.389+0000 7ff771971b80 1 -- 172.21.15.57:0/116764046 wait complete. 2023-03-02T10:56:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff771971b80 1 -- start start 2023-03-02T10:56:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff771971b80 1 Processor -- start 2023-03-02T10:56:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff771971b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf29f410 0x5634bf2b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff771971b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff771971b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf2a0920 0x5634bf2bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff771971b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf2bba10 con 0x5634bf2a0920 2023-03-02T10:56:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff771971b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf2bbb80 con 0x5634bf29f410 2023-03-02T10:56:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff771971b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634bf2bbd40 con 0x5634bf29fd60 2023-03-02T10:56:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff771971b80 10 client.0 _ll_register_callbacks cb 0x5634bf1974d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff757fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf2a0920 0x5634bf2bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff757fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf2a0920 0x5634bf2bb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42752/0 (socket says 172.21.15.57:42752) 2023-03-02T10:56:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff757fff700 1 -- 172.21.15.57:0/3909706737 learned_addr learned my addr 172.21.15.57:0/3909706737 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.390+0000 7ff7577fe700 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf29f410 0x5634bf2b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff756ffd700 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff757fff700 1 -- 172.21.15.57:0/3909706737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 msgr2=0x5634bf2ba4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff757fff700 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2ba4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff757fff700 1 -- 172.21.15.57:0/3909706737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf29f410 msgr2=0x5634bf2b9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff757fff700 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf29f410 0x5634bf2b9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff757fff700 1 -- 172.21.15.57:0/3909706737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634bf01fd90 con 0x5634bf2a0920 2023-03-02T10:56:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff7577fe700 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf29f410 0x5634bf2b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff756ffd700 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2ba4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff757fff700 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf2a0920 0x5634bf2bb4d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x5634bf29b330 tx=0x7ff750007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1e0fff42e32c82 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff736ffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff736ffd700 1 -- 172.21.15.57:0/3909706737 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75000e040 con 0x5634bf2a0920 2023-03-02T10:56:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff736ffd700 1 -- 172.21.15.57:0/3909706737 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff750004bb0 con 0x5634bf2a0920 2023-03-02T10:56:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff771971b80 1 -- 172.21.15.57:0/3909706737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff748021070 con 0x5634bf2a0920 2023-03-02T10:56:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff736ffd700 1 -- 172.21.15.57:0/3909706737 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff750004d70 con 0x5634bf2a0920 2023-03-02T10:56:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff771971b80 10 client.15258 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff771971b80 1 -- 172.21.15.57:0/3909706737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5634bf046200 con 0x5634bf2a0920 2023-03-02T10:56:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.391+0000 7ff736ffd700 1 -- 172.21.15.57:0/3909706737 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff748021070 con 0x5634bf2a0920 2023-03-02T10:56:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.392+0000 7ff736ffd700 1 -- 172.21.15.57:0/3909706737 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff750017900 con 0x5634bf2a0920 2023-03-02T10:56:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.392+0000 7ff771971b80 10 client.15258 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.392+0000 7ff771971b80 10 client.15258 resolve_mds: resolved name 'i' to daemon mds.i 2023-03-02T10:56:37.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.392+0000 7ff771971b80 20 client.15258 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:37.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.392+0000 7ff771971b80 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x5634bf30b1e0 0x5634bf307b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.392+0000 7ff771971b80 4 client.15258 mds_command: new command op to 24520 tid=0[{"prefix": "status"}] 2023-03-02T10:56:37.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.392+0000 7ff771971b80 1 -- 172.21.15.57:0/3909706737 --> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5634bf1e9e40 con 0x5634bf30b1e0 2023-03-02T10:56:37.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.392+0000 7ff7577fe700 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x5634bf30b1e0 0x5634bf307b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.392+0000 7ff736ffd700 10 client.15258 ms_handle_connect on v2:172.21.15.136:6838/1702113579 2023-03-02T10:56:37.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.392+0000 7ff7577fe700 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x5634bf30b1e0 0x5634bf307b70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3286b10c07890898 server_cookie=92ee3af8e10cd93c in_seq=0 out_seq=0 2023-03-02T10:56:37.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff736ffd700 1 -- 172.21.15.57:0/3909706737 <== mds.1 v2:172.21.15.136:6838/1702113579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5634bf1e9e40 con 0x5634bf30b1e0 2023-03-02T10:56:37.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff736ffd700 10 client.15258 handle_command_reply: tid=0 2023-03-02T10:56:37.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 1 client.15258 shutdown 2023-03-02T10:56:37.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 1 -- 172.21.15.57:0/3909706737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf2a0920 msgr2=0x5634bf2bb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf2a0920 0x5634bf2bb4d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x5634bf29b330 tx=0x7ff750007dd0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 1 -- 172.21.15.57:0/3909706737 shutdown_connections 2023-03-02T10:56:37.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x5634bf30b1e0 0x5634bf307b70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5634bf2a0920 0x5634bf2bb4d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff736ffd700 0 client.15258 ms_handle_reset on v2:172.21.15.136:6838/1702113579 2023-03-02T10:56:37.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634bf29f410 0x5634bf2b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 1 --2- 172.21.15.57:0/3909706737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634bf29fd60 0x5634bf2ba4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 1 -- 172.21.15.57:0/3909706737 >> 172.21.15.57:0/3909706737 conn(0x5634bf294c00 msgr2=0x5634bf2a6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 1 -- 172.21.15.57:0/3909706737 shutdown_connections 2023-03-02T10:56:37.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 1 -- 172.21.15.57:0/3909706737 wait complete. 2023-03-02T10:56:37.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.393+0000 7ff771971b80 20 client.15258 trim_cache size 0 max 16384 2023-03-02T10:56:37.404 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:56:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 1, 2023-03-02T10:56:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 24520, 2023-03-02T10:56:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-03-02T10:56:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-03-02T10:56:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-03-02T10:56:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 83.880295584999999, 2023-03-02T10:56:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 26, 2023-03-02T10:56:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 86, 2023-03-02T10:56:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 84, 2023-03-02T10:56:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 101.04728407100001 2023-03-02T10:56:37.406 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 -- 172.21.15.57:0/2998289739 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff74009b3a0 msgr2=0x7ff74009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff74009b3a0 0x7ff74009d850 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff758068140 tx=0x7ff748009260 comp rx=0 tx=0).stop 2023-03-02T10:56:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 -- 172.21.15.57:0/2998289739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff758102ed0 msgr2=0x7ff758195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff758102ed0 0x7ff758195d50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0098e0 tx=0x7ff74c004710 comp rx=0 tx=0).stop 2023-03-02T10:56:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 -- 172.21.15.57:0/2998289739 shutdown_connections 2023-03-02T10:56:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff74009b3a0 0x7ff74009d850 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7581057f0 0x7ff75819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7581005b0 0x7ff758195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 --2- 172.21.15.57:0/2998289739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff758102ed0 0x7ff758195d50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 -- 172.21.15.57:0/2998289739 >> 172.21.15.57:0/2998289739 conn(0x7ff7580f9fd0 msgr2=0x7ff7581011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 -- 172.21.15.57:0/2998289739 shutdown_connections 2023-03-02T10:56:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.394+0000 7ff75dfff700 1 -- 172.21.15.57:0/2998289739 wait complete. 2023-03-02T10:56:37.409 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-03-02T10:56:37.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.563+0000 7f2e763ff700 1 -- 172.21.15.57:0/2264867262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e70102ed0 msgr2=0x7f2e701052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.563+0000 7f2e763ff700 1 --2- 172.21.15.57:0/2264867262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e70102ed0 0x7f2e701052b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009990 tx=0x7f2e58009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.563+0000 7f2e763ff700 1 -- 172.21.15.57:0/2264867262 shutdown_connections 2023-03-02T10:56:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.563+0000 7f2e763ff700 1 --2- 172.21.15.57:0/2264867262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e701057f0 0x7f2e70107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.563+0000 7f2e763ff700 1 --2- 172.21.15.57:0/2264867262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e701005b0 0x7f2e70102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.563+0000 7f2e763ff700 1 --2- 172.21.15.57:0/2264867262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e70102ed0 0x7f2e701052b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.563+0000 7f2e763ff700 1 -- 172.21.15.57:0/2264867262 >> 172.21.15.57:0/2264867262 conn(0x7f2e700f9fd0 msgr2=0x7f2e700fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.563+0000 7f2e763ff700 1 -- 172.21.15.57:0/2264867262 shutdown_connections 2023-03-02T10:56:37.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.563+0000 7f2e763ff700 1 -- 172.21.15.57:0/2264867262 wait complete. 2023-03-02T10:56:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.564+0000 7f2e763ff700 1 Processor -- start 2023-03-02T10:56:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.564+0000 7f2e763ff700 1 -- start start 2023-03-02T10:56:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.564+0000 7f2e763ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e701005b0 0x7f2e70197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.564+0000 7f2e763ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e70102ed0 0x7f2e70197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.564+0000 7f2e763ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e701057f0 0x7f2e7019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.564+0000 7f2e763ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7019f5f0 con 0x7f2e701005b0 2023-03-02T10:56:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.564+0000 7f2e763ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7019f730 con 0x7f2e701057f0 2023-03-02T10:56:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.564+0000 7f2e763ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7019f8c0 con 0x7f2e70102ed0 2023-03-02T10:56:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.564+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e701005b0 0x7f2e70197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.564+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e701005b0 0x7f2e70197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42768/0 (socket says 172.21.15.57:42768) 2023-03-02T10:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.564+0000 7f2e6ffff700 1 -- 172.21.15.57:0/3600126454 learned_addr learned my addr 172.21.15.57:0/3600126454 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e677fe700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e70102ed0 0x7f2e70197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e7499c700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e701057f0 0x7f2e7019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e6ffff700 1 -- 172.21.15.57:0/3600126454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e70102ed0 msgr2=0x7f2e70197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e70102ed0 0x7f2e70197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e6ffff700 1 -- 172.21.15.57:0/3600126454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e701057f0 msgr2=0x7f2e7019f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e701057f0 0x7f2e7019f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e6ffff700 1 -- 172.21.15.57:0/3600126454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e60009520 con 0x7f2e701005b0 2023-03-02T10:56:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e677fe700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e70102ed0 0x7f2e70197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e701005b0 0x7f2e70197a70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000ea30 tx=0x7f2e6000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e6dffb700 1 -- 172.21.15.57:0/3600126454 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60009820 con 0x7f2e701005b0 2023-03-02T10:56:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e763ff700 1 -- 172.21.15.57:0/3600126454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e580095f0 con 0x7f2e701005b0 2023-03-02T10:56:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e6dffb700 1 -- 172.21.15.57:0/3600126454 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e600044e0 con 0x7f2e701005b0 2023-03-02T10:56:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e6dffb700 1 -- 172.21.15.57:0/3600126454 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60003e80 con 0x7f2e701005b0 2023-03-02T10:56:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.565+0000 7f2e763ff700 1 -- 172.21.15.57:0/3600126454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7010b420 con 0x7f2e701005b0 2023-03-02T10:56:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.569+0000 7f2e6dffb700 1 -- 172.21.15.57:0/3600126454 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f2e6001e020 con 0x7f2e701005b0 2023-03-02T10:56:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e6dffb700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e5c09b3a0 0x7f2e5c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e89d97b80 1 Processor -- start 2023-03-02T10:56:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e89d97b80 1 -- start start 2023-03-02T10:56:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e6dffb700 1 -- 172.21.15.57:0/3600126454 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2e60014070 con 0x7f2e701005b0 2023-03-02T10:56:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e677fe700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e5c09b3a0 0x7f2e5c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293466820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f293467340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293467920 0x55f293467d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2933cda10 con 0x55f293466410 2023-03-02T10:56:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29337ff30 con 0x55f293467920 2023-03-02T10:56:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f293350110 con 0x55f293466d60 2023-03-02T10:56:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293466820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293466820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42782/0 (socket says 172.21.15.57:42782) 2023-03-02T10:56:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.570+0000 7f2e6ffff700 1 -- 172.21.15.57:0/1734538686 learned_addr learned my addr 172.21.15.57:0/1734538686 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e677fe700 1 --2- 172.21.15.57:0/1734538686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f293467340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e7499c700 1 --2- 172.21.15.57:0/1734538686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293467920 0x55f293467d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e677fe700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e5c09b3a0 0x7f2e5c09d850 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2e58006010 tx=0x7f2e5800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e6ffff700 1 -- 172.21.15.57:0/1734538686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 msgr2=0x55f293467340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/1734538686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f293467340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e6ffff700 1 -- 172.21.15.57:0/1734538686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293467920 msgr2=0x55f293467d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/1734538686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293467920 0x55f293467d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e6ffff700 1 -- 172.21.15.57:0/1734538686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f29323a5e0 con 0x55f293466410 2023-03-02T10:56:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/1734538686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293466820 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2e60004800 tx=0x7f2e600945a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef75186c2377081 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e667fc700 1 -- 172.21.15.57:0/1734538686 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60095160 con 0x55f293466410 2023-03-02T10:56:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e667fc700 1 -- 172.21.15.57:0/1734538686 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e60094a60 con 0x55f293466410 2023-03-02T10:56:37.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.571+0000 7f2e667fc700 1 -- 172.21.15.57:0/1734538686 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e600c5300 con 0x55f293466410 2023-03-02T10:56:37.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.572+0000 7f2e89d97b80 1 -- 172.21.15.57:0/1734538686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 msgr2=0x55f293466820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.572+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/1734538686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293466820 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2e60004800 tx=0x7f2e600945a0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.572+0000 7f2e89d97b80 1 -- 172.21.15.57:0/1734538686 shutdown_connections 2023-03-02T10:56:37.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.572+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/1734538686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293467920 0x55f293467d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.572+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/1734538686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293466820 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.572+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/1734538686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f293467340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.572+0000 7f2e89d97b80 1 -- 172.21.15.57:0/1734538686 >> 172.21.15.57:0/1734538686 conn(0x55f29345bc00 msgr2=0x55f293460f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.572+0000 7f2e89d97b80 1 -- 172.21.15.57:0/1734538686 shutdown_connections 2023-03-02T10:56:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.572+0000 7f2e89d97b80 1 -- 172.21.15.57:0/1734538686 wait complete. 2023-03-02T10:56:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.572+0000 7f2e89d97b80 1 -- start start 2023-03-02T10:56:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e89d97b80 1 Processor -- start 2023-03-02T10:56:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 0x55f29346ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466d60 0x55f2934704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293467920 0x55f293477520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2933beb70 con 0x55f293466d60 2023-03-02T10:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2933b80a0 con 0x55f293466410 2023-03-02T10:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29323c8d0 con 0x55f293467920 2023-03-02T10:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e89d97b80 10 client.0 _ll_register_callbacks cb 0x55f29335e4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 0x55f29346ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e677fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466d60 0x55f2934704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 0x55f29346ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33726/0 (socket says 172.21.15.57:33726) 2023-03-02T10:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e6ffff700 1 -- 172.21.15.57:0/919044850 learned_addr learned my addr 172.21.15.57:0/919044850 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.573+0000 7f2e7499c700 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293467920 0x55f293477520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e6ffff700 1 -- 172.21.15.57:0/919044850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293467920 msgr2=0x55f293477520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293467920 0x55f293477520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e6ffff700 1 -- 172.21.15.57:0/919044850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466d60 msgr2=0x55f2934704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466d60 0x55f2934704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e6ffff700 1 -- 172.21.15.57:0/919044850 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7010b420 con 0x55f293466410 2023-03-02T10:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e677fe700 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466d60 0x55f2934704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 0x55f29346ffa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e600037a0 tx=0x7f2e600c31f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbacb0d6de6c94f8 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e4f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:56:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/919044850 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60094160 con 0x55f293466410 2023-03-02T10:56:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/919044850 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2e60094cc0 con 0x55f293466410 2023-03-02T10:56:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e89d97b80 1 -- 172.21.15.57:0/919044850 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f293389760 con 0x55f293466410 2023-03-02T10:56:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/919044850 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e60094e80 con 0x55f293466410 2023-03-02T10:56:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e89d97b80 10 client.25151 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e89d97b80 1 -- 172.21.15.57:0/919044850 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f2931e6d90 con 0x55f293466410 2023-03-02T10:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.574+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/919044850 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e60062030 con 0x55f293466410 2023-03-02T10:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.575+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/919044850 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2e60098150 con 0x55f293466410 2023-03-02T10:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.575+0000 7f2e89d97b80 10 client.25151 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.575+0000 7f2e89d97b80 10 client.25151 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-02T10:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.575+0000 7f2e89d97b80 20 client.25151 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.575+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f29347ad30 0x55f29347a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.575+0000 7f2e89d97b80 4 client.25151 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.575+0000 7f2e89d97b80 1 -- 172.21.15.57:0/919044850 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2933b1120 con 0x55f29347ad30 2023-03-02T10:56:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.575+0000 7f2e677fe700 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f29347ad30 0x55f29347a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.575+0000 7f2e677fe700 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f29347ad30 0x55f29347a450 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c8cdd2d75e6e8a6 server_cookie=bbaa91b107de7dda in_seq=0 out_seq=0 2023-03-02T10:56:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e4f7fe700 10 client.25151 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/919044850 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55f2933b1120 con 0x55f29347ad30 2023-03-02T10:56:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e4f7fe700 10 client.25151 handle_command_reply: tid=0 2023-03-02T10:56:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e89d97b80 1 client.25151 shutdown 2023-03-02T10:56:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e89d97b80 1 -- 172.21.15.57:0/919044850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 msgr2=0x55f29346ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 0x55f29346ffa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e600037a0 tx=0x7f2e600c31f0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e89d97b80 1 -- 172.21.15.57:0/919044850 shutdown_connections 2023-03-02T10:56:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f29347ad30 0x55f29347a450 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293467920 0x55f293477520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e4f7fe700 0 client.25151 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 0x55f29346ffa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/919044850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466d60 0x55f2934704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.576+0000 7f2e89d97b80 1 -- 172.21.15.57:0/919044850 >> 172.21.15.57:0/919044850 conn(0x55f29345bc00 msgr2=0x55f293460650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.577+0000 7f2e89d97b80 1 -- 172.21.15.57:0/919044850 shutdown_connections 2023-03-02T10:56:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.577+0000 7f2e89d97b80 1 -- 172.21.15.57:0/919044850 wait complete. 2023-03-02T10:56:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.577+0000 7f2e89d97b80 20 client.25151 trim_cache size 0 max 16384 2023-03-02T10:56:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.594+0000 7f2e89d97b80 1 Processor -- start 2023-03-02T10:56:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.594+0000 7f2e89d97b80 1 -- start start 2023-03-02T10:56:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.594+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293477d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.594+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f29346ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.594+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293467920 0x55f29346ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.594+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f29346fb70 con 0x55f293466410 2023-03-02T10:56:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.594+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f293461b10 con 0x55f293467920 2023-03-02T10:56:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.594+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f293462360 con 0x55f293466d60 2023-03-02T10:56:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.594+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293477d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.594+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293477d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42808/0 (socket says 172.21.15.57:42808) 2023-03-02T10:56:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.594+0000 7f2e6ffff700 1 -- 172.21.15.57:0/3616958268 learned_addr learned my addr 172.21.15.57:0/3616958268 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e677fe700 1 --2- 172.21.15.57:0/3616958268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f29346ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e7499c700 1 --2- 172.21.15.57:0/3616958268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293467920 0x55f29346ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e6ffff700 1 -- 172.21.15.57:0/3616958268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 msgr2=0x55f29346ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/3616958268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f29346ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e6ffff700 1 -- 172.21.15.57:0/3616958268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293467920 msgr2=0x55f29346ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/3616958268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293467920 0x55f29346ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e6ffff700 1 -- 172.21.15.57:0/3616958268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f29337f140 con 0x55f293466410 2023-03-02T10:56:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e7499c700 1 --2- 172.21.15.57:0/3616958268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293467920 0x55f29346ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:56:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/3616958268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293477d50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2e60003750 tx=0x7f2e60000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397c5135bb7ed9e0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e66ffd700 1 -- 172.21.15.57:0/3616958268 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e600908a0 con 0x55f293466410 2023-03-02T10:56:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e66ffd700 1 -- 172.21.15.57:0/3616958268 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e60062050 con 0x55f293466410 2023-03-02T10:56:37.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.595+0000 7f2e66ffd700 1 -- 172.21.15.57:0/3616958268 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6009bef0 con 0x55f293466410 2023-03-02T10:56:37.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 -- 172.21.15.57:0/3616958268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 msgr2=0x55f293477d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/3616958268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293477d50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2e60003750 tx=0x7f2e60000bc0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 -- 172.21.15.57:0/3616958268 shutdown_connections 2023-03-02T10:56:37.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/3616958268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293467920 0x55f29346ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/3616958268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293466410 0x55f293477d50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/3616958268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f29346ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 -- 172.21.15.57:0/3616958268 >> 172.21.15.57:0/3616958268 conn(0x55f29345bc00 msgr2=0x55f29347a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 -- 172.21.15.57:0/3616958268 shutdown_connections 2023-03-02T10:56:37.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 -- 172.21.15.57:0/3616958268 wait complete. 2023-03-02T10:56:37.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 -- start start 2023-03-02T10:56:37.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 Processor -- start 2023-03-02T10:56:37.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 0x55f29347ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f29347f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293467920 0x55f2934cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f293483af0 con 0x55f293467920 2023-03-02T10:56:37.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f293483c60 con 0x55f293466410 2023-03-02T10:56:37.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2934ccac0 con 0x55f293466d60 2023-03-02T10:56:37.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.596+0000 7f2e89d97b80 10 client.0 _ll_register_callbacks cb 0x55f29335e4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:37.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e7499c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293467920 0x55f2934cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e7499c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293467920 0x55f2934cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42820/0 (socket says 172.21.15.57:42820) 2023-03-02T10:56:37.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e7499c700 1 -- 172.21.15.57:0/2462027297 learned_addr learned my addr 172.21.15.57:0/2462027297 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:37.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e677fe700 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f29347f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 0x55f29347ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e7499c700 1 -- 172.21.15.57:0/2462027297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 msgr2=0x55f29347f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e7499c700 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f29347f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e7499c700 1 -- 172.21.15.57:0/2462027297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 msgr2=0x55f29347ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:37.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e7499c700 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 0x55f29347ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e7499c700 1 -- 172.21.15.57:0/2462027297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2931e6d90 con 0x55f293467920 2023-03-02T10:56:37.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e7499c700 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293467920 0x55f2934cc580 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2e68007af0 tx=0x7f2e68007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e00f9428c0f595 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:37.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e4f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:37.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/2462027297 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68003c00 con 0x55f293467920 2023-03-02T10:56:37.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e89d97b80 1 -- 172.21.15.57:0/2462027297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e60094a60 con 0x55f293467920 2023-03-02T10:56:37.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/2462027297 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2e68009e30 con 0x55f293467920 2023-03-02T10:56:37.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/2462027297 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e68003d60 con 0x55f293467920 2023-03-02T10:56:37.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.597+0000 7f2e89d97b80 10 client.15276 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:37.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.598+0000 7f2e89d97b80 1 -- 172.21.15.57:0/2462027297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f29320d200 con 0x55f293467920 2023-03-02T10:56:37.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.598+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/2462027297 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e60094a60 con 0x55f293467920 2023-03-02T10:56:37.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.598+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/2462027297 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2e68004630 con 0x55f293467920 2023-03-02T10:56:37.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.598+0000 7f2e89d97b80 10 client.15276 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:37.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.598+0000 7f2e89d97b80 10 client.15276 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-02T10:56:37.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.598+0000 7f2e89d97b80 20 client.15276 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:37.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.598+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f2934d17a0 0x55f2934ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:37.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.598+0000 7f2e89d97b80 4 client.15276 mds_command: new command op to 24560 tid=0[{"prefix": "status"}] 2023-03-02T10:56:37.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.598+0000 7f2e89d97b80 1 -- 172.21.15.57:0/2462027297 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f2933b0e40 con 0x55f2934d17a0 2023-03-02T10:56:37.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.598+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f2934d17a0 0x55f2934ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:37.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e6ffff700 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f2934d17a0 0x55f2934ce130 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e288ecdb8ce7b33 server_cookie=3ab56fd3d0ae18c in_seq=0 out_seq=0 2023-03-02T10:56:37.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e4f7fe700 10 client.15276 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:37.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e4f7fe700 1 -- 172.21.15.57:0/2462027297 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55f2933b0e40 con 0x55f2934d17a0 2023-03-02T10:56:37.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e4f7fe700 10 client.15276 handle_command_reply: tid=0 2023-03-02T10:56:37.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 1 client.15276 shutdown 2023-03-02T10:56:37.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 1 -- 172.21.15.57:0/2462027297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293467920 msgr2=0x55f2934cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293467920 0x55f2934cc580 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2e68007af0 tx=0x7f2e68007e00 comp rx=0 tx=0).stop 2023-03-02T10:56:37.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 1 -- 172.21.15.57:0/2462027297 shutdown_connections 2023-03-02T10:56:37.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f2934d17a0 0x55f2934ce130 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f293467920 0x55f2934cc580 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f293466410 0x55f29347ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e4f7fe700 0 client.15276 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:37.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 1 --2- 172.21.15.57:0/2462027297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f293466d60 0x55f29347f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 1 -- 172.21.15.57:0/2462027297 >> 172.21.15.57:0/2462027297 conn(0x55f29345bc00 msgr2=0x55f29346ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 1 -- 172.21.15.57:0/2462027297 shutdown_connections 2023-03-02T10:56:37.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 1 -- 172.21.15.57:0/2462027297 wait complete. 2023-03-02T10:56:37.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.599+0000 7f2e89d97b80 20 client.15276 trim_cache size 0 max 16384 2023-03-02T10:56:37.610 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:37.610 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "886f029e-b8e7-11ed-9ae9-001a4aab830c", 2023-03-02T10:56:37.610 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-03-02T10:56:37.610 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 24560, 2023-03-02T10:56:37.611 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-03-02T10:56:37.611 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-03-02T10:56:37.611 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-03-02T10:56:37.611 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 86.993819952999999, 2023-03-02T10:56:37.611 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 26, 2023-03-02T10:56:37.611 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 86, 2023-03-02T10:56:37.611 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 84, 2023-03-02T10:56:37.612 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 93.860243056000002 2023-03-02T10:56:37.612 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:37.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 -- 172.21.15.57:0/3600126454 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e5c09b3a0 msgr2=0x7f2e5c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e5c09b3a0 0x7f2e5c09d850 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2e58006010 tx=0x7f2e5800b260 comp rx=0 tx=0).stop 2023-03-02T10:56:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 -- 172.21.15.57:0/3600126454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e701005b0 msgr2=0x7f2e70197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e701005b0 0x7f2e70197a70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000ea30 tx=0x7f2e6000edf0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 -- 172.21.15.57:0/3600126454 shutdown_connections 2023-03-02T10:56:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f2e5c09b3a0 0x7f2e5c09d850 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e701057f0 0x7f2e7019f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e701005b0 0x7f2e70197a70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 --2- 172.21.15.57:0/3600126454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e70102ed0 0x7f2e70197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:37.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 -- 172.21.15.57:0/3600126454 >> 172.21.15.57:0/3600126454 conn(0x7f2e700f9fd0 msgr2=0x7f2e700fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:37.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 -- 172.21.15.57:0/3600126454 shutdown_connections 2023-03-02T10:56:37.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:37.600+0000 7f2e763ff700 1 -- 172.21.15.57:0/3600126454 wait complete. 2023-03-02T10:56:37.615 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:37 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3967701389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:37.616 INFO:teuthology.run_tasks:Running task kclient... 2023-03-02T10:56:37.641 INFO:tasks.kclient:Mounting kernel clients... 2023-03-02T10:56:37.642 INFO:tasks.kclient:config is {'client.0': {}} 2023-03-02T10:56:37.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:37.643 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-03-02T10:56:37.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:37.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-03-02T10:56:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:37 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3967701389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:37.756 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2023-03-02T10:56:37.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-02T10:56:37.758 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2023-03-02T10:56:37.758 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-02T10:56:37.759 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-03-02T10:56:37.759 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-03-02T10:56:37.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:802de851643c97960b33dacc1e3ce8486e6d7d3c shell --fsid 886f029e-b8e7-11ed-9ae9-001a4aab830c -- ceph fs ls 2023-03-02T10:56:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:37 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3967701389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:38.494 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/mon.a/config 2023-03-02T10:56:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:38 smithi057 ceph-mon[92072]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-02T10:56:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:38 smithi122 ceph-mon[125440]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-02T10:56:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:38 smithi136 ceph-mon[125702]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-02T10:56:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:39 smithi057 ceph-mon[92072]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:39 smithi136 ceph-mon[125702]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:39.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.898+0000 7f29e8b92700 1 -- 172.21.15.57:0/565994329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e4104af0 msgr2=0x7f29e4104ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:39.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.898+0000 7f29e8b92700 1 --2- 172.21.15.57:0/565994329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e4104af0 0x7f29e4104ec0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f29d4009990 tx=0x7f29d4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:39.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.898+0000 7f29e8b92700 1 -- 172.21.15.57:0/565994329 shutdown_connections 2023-03-02T10:56:39.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.898+0000 7f29e8b92700 1 --2- 172.21.15.57:0/565994329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29e40ff490 0x7f29e410b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:39.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.898+0000 7f29e8b92700 1 --2- 172.21.15.57:0/565994329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e4104af0 0x7f29e4104ec0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:39.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.898+0000 7f29e8b92700 1 --2- 172.21.15.57:0/565994329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29e40feae0 0x7f29e40fef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:39.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.898+0000 7f29e8b92700 1 -- 172.21.15.57:0/565994329 >> 172.21.15.57:0/565994329 conn(0x7f29e4075c50 msgr2=0x7f29e4076050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:39.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.898+0000 7f29e8b92700 1 -- 172.21.15.57:0/565994329 shutdown_connections 2023-03-02T10:56:39.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.898+0000 7f29e8b92700 1 -- 172.21.15.57:0/565994329 wait complete. 2023-03-02T10:56:39.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e8b92700 1 Processor -- start 2023-03-02T10:56:39.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e8b92700 1 -- start start 2023-03-02T10:56:39.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e8b92700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e40feae0 0x7f29e4197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:39.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e8b92700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29e40ff490 0x7f29e4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:39.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e8b92700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29e4104af0 0x7f29e419c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:39.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e8b92700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e419cee0 con 0x7f29e40feae0 2023-03-02T10:56:39.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e8b92700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e419d050 con 0x7f29e4104af0 2023-03-02T10:56:39.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e8b92700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e419d210 con 0x7f29e40ff490 2023-03-02T10:56:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e40feae0 0x7f29e4197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e40feae0 0x7f29e4197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42842/0 (socket says 172.21.15.57:42842) 2023-03-02T10:56:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e259c700 1 -- 172.21.15.57:0/1173771677 learned_addr learned my addr 172.21.15.57:0/1173771677 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e2d9d700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29e4104af0 0x7f29e419c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e1d9b700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29e40ff490 0x7f29e4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.899+0000 7f29e259c700 1 -- 172.21.15.57:0/1173771677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29e40ff490 msgr2=0x7f29e4198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.900+0000 7f29e259c700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29e40ff490 0x7f29e4198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.900+0000 7f29e259c700 1 -- 172.21.15.57:0/1173771677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29e4104af0 msgr2=0x7f29e419c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.900+0000 7f29e259c700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29e4104af0 0x7f29e419c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.900+0000 7f29e259c700 1 -- 172.21.15.57:0/1173771677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40095f0 con 0x7f29e40feae0 2023-03-02T10:56:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.900+0000 7f29e2d9d700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29e4104af0 0x7f29e419c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.900+0000 7f29e259c700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e40feae0 0x7f29e4197f00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f29d40098e0 tx=0x7f29d400f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.900+0000 7f29d37fe700 1 -- 172.21.15.57:0/1173771677 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d401d070 con 0x7f29e40feae0 2023-03-02T10:56:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.900+0000 7f29d37fe700 1 -- 172.21.15.57:0/1173771677 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29d4005510 con 0x7f29e40feae0 2023-03-02T10:56:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.900+0000 7f29e8b92700 1 -- 172.21.15.57:0/1173771677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e410eb40 con 0x7f29e40feae0 2023-03-02T10:56:39.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.900+0000 7f29d37fe700 1 -- 172.21.15.57:0/1173771677 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4004c90 con 0x7f29e40feae0 2023-03-02T10:56:39.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.900+0000 7f29e8b92700 1 -- 172.21.15.57:0/1173771677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e410e9b0 con 0x7f29e40feae0 2023-03-02T10:56:39.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.901+0000 7f29e8b92700 1 -- 172.21.15.57:0/1173771677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e410ecd0 con 0x7f29e40feae0 2023-03-02T10:56:39.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.903+0000 7f29d37fe700 1 -- 172.21.15.57:0/1173771677 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f29d4028030 con 0x7f29e40feae0 2023-03-02T10:56:39.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.903+0000 7f29d37fe700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f29cc09b420 0x7f29cc09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:39.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.904+0000 7f29d37fe700 1 -- 172.21.15.57:0/1173771677 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f29d40c5da0 con 0x7f29e40feae0 2023-03-02T10:56:39.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.904+0000 7f29e1d9b700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f29cc09b420 0x7f29cc09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:39.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.904+0000 7f29e1d9b700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f29cc09b420 0x7f29cc09d8d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f29d8005fd0 tx=0x7f29d800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:39.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:39.906+0000 7f29d37fe700 1 -- 172.21.15.57:0/1173771677 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f29d4091760 con 0x7f29e40feae0 2023-03-02T10:56:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:39 smithi122 ceph-mon[125440]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T10:56:40.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.147+0000 7f29e8b92700 1 -- 172.21.15.57:0/1173771677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f29e4199320 con 0x7f29e40feae0 2023-03-02T10:56:40.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.148+0000 7f29d37fe700 1 -- 172.21.15.57:0/1173771677 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f29d4026060 con 0x7f29e40feae0 2023-03-02T10:56:40.149 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-02T10:56:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 -- 172.21.15.57:0/1173771677 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f29cc09b420 msgr2=0x7f29cc09d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f29cc09b420 0x7f29cc09d8d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f29d8005fd0 tx=0x7f29d800a560 comp rx=0 tx=0).stop 2023-03-02T10:56:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 -- 172.21.15.57:0/1173771677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e40feae0 msgr2=0x7f29e4197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e40feae0 0x7f29e4197f00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f29d40098e0 tx=0x7f29d400f720 comp rx=0 tx=0).stop 2023-03-02T10:56:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 -- 172.21.15.57:0/1173771677 shutdown_connections 2023-03-02T10:56:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f29cc09b420 0x7f29cc09d8d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29e4104af0 0x7f29e419c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e40feae0 0x7f29e4197f00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 --2- 172.21.15.57:0/1173771677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29e40ff490 0x7f29e4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 -- 172.21.15.57:0/1173771677 >> 172.21.15.57:0/1173771677 conn(0x7f29e4075c50 msgr2=0x7f29e40fc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 -- 172.21.15.57:0/1173771677 shutdown_connections 2023-03-02T10:56:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:40.150+0000 7f29e8b92700 1 -- 172.21.15.57:0/1173771677 wait complete. 2023-03-02T10:56:40.693 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-02T10:56:40.694 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-02T10:56:40.694 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-03-02T10:56:40.694 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-02T10:56:40.695 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-03-02T10:56:40.695 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-02T10:56:40.695 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-02T10:56:40.695 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-02T10:56:40.695 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-03-02T10:56:40.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:40.696 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-03-02T10:56:40.725 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-02T10:56:40.725 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-02T10:56:40.725 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-03-02T10:56:40.725 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-03-02T10:56:40.725 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-03-02T10:56:40.726 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-03-02T10:56:40.726 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-02T10:56:40.726 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-03-02T10:56:40.726 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-03-02T10:56:40.726 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-02T10:56:40.726 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-03-02T10:56:40.726 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-03-02T10:56:40.727 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-02T10:56:40.727 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-03-02T10:56:40.727 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-03-02T10:56:40.727 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-03-02T10:56:40.727 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 41566sec preferred_lft 41566sec 2023-03-02T10:56:40.727 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-03-02T10:56:40.727 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-03-02T10:56:40.727 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-02T10:56:40.728 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-03-02T10:56:40.728 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-03-02T10:56:40.728 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-02T10:56:40.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:40.729 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-03-02T10:56:40.729 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-03-02T10:56:40.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add name ceph-brx type bridge 2023-03-02T10:56:40.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr flush dev ceph-brx 2023-03-02T10:56:40.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set ceph-brx up 2023-03-02T10:56:40.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-02T10:56:40.730 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-03-02T10:56:40.829 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:40 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1173771677' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-03-02T10:56:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:40 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1173771677' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-03-02T10:56:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:40 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1173771677' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-03-02T10:56:41.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:41.129 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-02T10:56:41.174 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-03-02T10:56:41.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:41.177 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-03-02T10:56:41.242 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-03-02T10:56:41.242 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-02T10:56:41.242 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-03-02T10:56:41.242 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-03-02T10:56:41.242 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-02T10:56:41.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:41.243 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-03-02T10:56:41.244 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-03-02T10:56:41.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-02T10:56:41.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-02T10:56:41.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-02T10:56:41.244 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-03-02T10:56:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:41 smithi136 ceph-mon[125702]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:41 smithi057 ceph-mon[92072]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:41 smithi122 ceph-mon[125440]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T10:56:42.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:42.110 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-03-02T10:56:42.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:42.138 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2023-03-02T10:56:42.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:42.205 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-03-02T10:56:42.206 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-03-02T10:56:42.206 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--tmp-cephfs 2023-03-02T10:56:42.206 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-03-02T10:56:42.206 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-03-02T10:56:42.334 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-03-02T10:56:42.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:42.335 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-03-02T10:56:42.335 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-03-02T10:56:42.335 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-03-02T10:56:42.335 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-02T10:56:42.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-03-02T10:56:42.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-03-02T10:56:42.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-03-02T10:56:42.336 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-03-02T10:56:42.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:42.517 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-03-02T10:56:42.518 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-03-02T10:56:42.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2023-03-02T10:56:42.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.0 master ceph-brx 2023-03-02T10:56:42.519 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-03-02T10:56:42.642 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-02T10:56:42.643 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /tmp/cephfs 2023-03-02T10:56:42.669 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/tmp/cephfs' 2023-03-02T10:56:42.670 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-02T10:56:42.670 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /tmp/cephfs 2023-03-02T10:56:42.736 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-03-02T10:56:42.737 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-03-02T10:56:42.737 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/d0d9fb7b-a0b0-4a2e-aa06-576c9b7d593e 2023-03-02T10:56:42.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:42.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/d0d9fb7b-a0b0-4a2e-aa06-576c9b7d593e /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context=system_u:object_r:postgresql_db_t:s0 2023-03-02T10:56:42.933 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0" 2023-03-02T10:56:42.933 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-03-02T10:56:42.933 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-03-02T10:56:43.411 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0" 2023-03-02T10:56:43.411 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-03-02T10:56:43.412 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-03-02T10:56:43.412 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.122:3300,172.21.15.136:3300" 2023-03-02T10:56:43.412 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.57:3300,172.21.15.122:3300,172.21.15.136:3300:/volumes/_nogroup/sv_1/d0d9fb7b-a0b0-4a2e-aa06-576c9b7d593e 2023-03-02T10:56:43.412 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=886f029e-b8e7-11ed-9ae9-001a4aab830c" will pass to kernel 2023-03-02T10:56:43.416 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-02T10:56:43.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:43.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /tmp/cephfs 2023-03-02T10:56:43.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:43.462 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-02T10:56:43.665 INFO:teuthology.orchestra.run.smithi057.stdout:client15285 2023-03-02T10:56:43.665 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-02T10:56:43.666 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-02T10:56:43.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:43.693 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-02T10:56:43.786 INFO:teuthology.orchestra.run.smithi057.stdout:client15285 2023-03-02T10:56:43.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:43.787 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-02T10:56:43.839 INFO:teuthology.orchestra.run.smithi057.stdout:client15285 2023-03-02T10:56:43.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-02T10:56:43.840 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/cephfs && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c.client15285/status') 2023-03-02T10:56:43.906 INFO:teuthology.orchestra.run.smithi057.stdout:instance: client.15285 (3)192.168.0.1:0/3184288185 2023-03-02T10:56:43.906 INFO:teuthology.orchestra.run.smithi057.stdout:blocklisted: false 2023-03-02T10:56:43.906 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2023-03-02T10:56:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2023-03-02T10:56:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:70 bytes copied, 4.0638e-05 s, 1.7 MB/s 2023-03-02T10:56:43.908 INFO:teuthology.run_tasks:Running task check-counter... 2023-03-02T10:56:43.923 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-03-02T10:56:43.962 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:56:44.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.116+0000 7f7f655ff700 1 -- 172.21.15.57:0/3015680449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f601005b0 msgr2=0x7f7f60102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.116+0000 7f7f655ff700 1 --2- 172.21.15.57:0/3015680449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f601005b0 0x7f7f60102990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009990 tx=0x7f7f50009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.116+0000 7f7f655ff700 1 -- 172.21.15.57:0/3015680449 shutdown_connections 2023-03-02T10:56:44.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.116+0000 7f7f655ff700 1 --2- 172.21.15.57:0/3015680449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f601057f0 0x7f7f60107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.116+0000 7f7f655ff700 1 --2- 172.21.15.57:0/3015680449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f601005b0 0x7f7f60102990 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.116+0000 7f7f655ff700 1 --2- 172.21.15.57:0/3015680449 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f60102ed0 0x7f7f601052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.116+0000 7f7f655ff700 1 -- 172.21.15.57:0/3015680449 >> 172.21.15.57:0/3015680449 conn(0x7f7f600f9fd0 msgr2=0x7f7f600fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.116+0000 7f7f655ff700 1 -- 172.21.15.57:0/3015680449 shutdown_connections 2023-03-02T10:56:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.116+0000 7f7f655ff700 1 -- 172.21.15.57:0/3015680449 wait complete. 2023-03-02T10:56:44.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.117+0000 7f7f655ff700 1 Processor -- start 2023-03-02T10:56:44.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.117+0000 7f7f655ff700 1 -- start start 2023-03-02T10:56:44.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f655ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f601005b0 0x7f7f601957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f655ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f60102ed0 0x7f7f60195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f655ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f601057f0 0x7f7f6019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f655ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6019d340 con 0x7f7f60102ed0 2023-03-02T10:56:44.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f655ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6019d480 con 0x7f7f601057f0 2023-03-02T10:56:44.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f655ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6019d610 con 0x7f7f601005b0 2023-03-02T10:56:44.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5e7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f60102ed0 0x7f7f60195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5e7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f60102ed0 0x7f7f60195d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42864/0 (socket says 172.21.15.57:42864) 2023-03-02T10:56:44.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5e7fc700 1 -- 172.21.15.57:0/4278321989 learned_addr learned my addr 172.21.15.57:0/4278321989 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:44.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5effd700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f601005b0 0x7f7f601957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5f7fe700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f601057f0 0x7f7f6019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5e7fc700 1 -- 172.21.15.57:0/4278321989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f601005b0 msgr2=0x7f7f601957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5e7fc700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f601005b0 0x7f7f601957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5e7fc700 1 -- 172.21.15.57:0/4278321989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f601057f0 msgr2=0x7f7f6019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5e7fc700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f601057f0 0x7f7f6019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5e7fc700 1 -- 172.21.15.57:0/4278321989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f500095f0 con 0x7f7f60102ed0 2023-03-02T10:56:44.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5f7fe700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f601057f0 0x7f7f6019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:56:44.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.118+0000 7f7f5e7fc700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f60102ed0 0x7f7f60195d00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400e9a0 tx=0x7f7f5400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:44.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.119+0000 7f7f47fff700 1 -- 172.21.15.57:0/4278321989 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54009790 con 0x7f7f60102ed0 2023-03-02T10:56:44.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.119+0000 7f7f655ff700 1 -- 172.21.15.57:0/4278321989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6010b410 con 0x7f7f60102ed0 2023-03-02T10:56:44.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.119+0000 7f7f47fff700 1 -- 172.21.15.57:0/4278321989 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f5400cbd0 con 0x7f7f60102ed0 2023-03-02T10:56:44.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.119+0000 7f7f47fff700 1 -- 172.21.15.57:0/4278321989 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54018680 con 0x7f7f60102ed0 2023-03-02T10:56:44.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.119+0000 7f7f655ff700 1 -- 172.21.15.57:0/4278321989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6010b280 con 0x7f7f60102ed0 2023-03-02T10:56:44.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.119+0000 7f7f655ff700 1 -- 172.21.15.57:0/4278321989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6019dd50 con 0x7f7f60102ed0 2023-03-02T10:56:44.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.121+0000 7f7f47fff700 1 -- 172.21.15.57:0/4278321989 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f7f5400c040 con 0x7f7f60102ed0 2023-03-02T10:56:44.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.122+0000 7f7f47fff700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f4809b3a0 0x7f7f4809d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.122+0000 7f7f47fff700 1 -- 172.21.15.57:0/4278321989 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7f54014070 con 0x7f7f60102ed0 2023-03-02T10:56:44.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.122+0000 7f7f5effd700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f4809b3a0 0x7f7f4809d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.123+0000 7f7f5effd700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f4809b3a0 0x7f7f4809d850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7f50006010 tx=0x7f7f5000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:44.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.125+0000 7f7f47fff700 1 -- 172.21.15.57:0/4278321989 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f7f54091010 con 0x7f7f60102ed0 2023-03-02T10:56:44.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.327+0000 7f7f655ff700 1 -- 172.21.15.57:0/4278321989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f6019e300 con 0x7f7f60102ed0 2023-03-02T10:56:44.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.328+0000 7f7f47fff700 1 -- 172.21.15.57:0/4278321989 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22553 (secure 0 0 0) 0x7f7f54026020 con 0x7f7f60102ed0 2023-03-02T10:56:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:44.330 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":86,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:50.530934+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:56:44.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.330+0000 7f7f655ff700 1 -- 172.21.15.57:0/4278321989 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f4809b3a0 msgr2=0x7f7f4809d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.330+0000 7f7f655ff700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f4809b3a0 0x7f7f4809d850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7f50006010 tx=0x7f7f5000b260 comp rx=0 tx=0).stop 2023-03-02T10:56:44.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.330+0000 7f7f655ff700 1 -- 172.21.15.57:0/4278321989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f60102ed0 msgr2=0x7f7f60195d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.331+0000 7f7f655ff700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f60102ed0 0x7f7f60195d00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400e9a0 tx=0x7f7f5400ed60 comp rx=0 tx=0).stop 2023-03-02T10:56:44.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.331+0000 7f7f655ff700 1 -- 172.21.15.57:0/4278321989 shutdown_connections 2023-03-02T10:56:44.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.331+0000 7f7f655ff700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f7f4809b3a0 0x7f7f4809d850 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.331+0000 7f7f655ff700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f601057f0 0x7f7f6019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.331+0000 7f7f655ff700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7f601005b0 0x7f7f601957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.331+0000 7f7f655ff700 1 --2- 172.21.15.57:0/4278321989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f60102ed0 0x7f7f60195d00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.331+0000 7f7f655ff700 1 -- 172.21.15.57:0/4278321989 >> 172.21.15.57:0/4278321989 conn(0x7f7f600f9fd0 msgr2=0x7f7f60101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:44.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.331+0000 7f7f655ff700 1 -- 172.21.15.57:0/4278321989 shutdown_connections 2023-03-02T10:56:44.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.331+0000 7f7f655ff700 1 -- 172.21.15.57:0/4278321989 wait complete. 2023-03-02T10:56:44.349 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-02T10:51:03.600226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-02T10:55:08.504787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-02T10:55:09.909014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-02T10:56:44.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-02T10:56:44.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.505+0000 7fc4861ff700 1 -- 172.21.15.57:0/880939431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc480102ed0 msgr2=0x7fc4801052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.505+0000 7fc4861ff700 1 --2- 172.21.15.57:0/880939431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc480102ed0 0x7fc4801052b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc468009990 tx=0x7fc468009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.505+0000 7fc4861ff700 1 -- 172.21.15.57:0/880939431 shutdown_connections 2023-03-02T10:56:44.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.505+0000 7fc4861ff700 1 --2- 172.21.15.57:0/880939431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4801057f0 0x7fc480107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.505+0000 7fc4861ff700 1 --2- 172.21.15.57:0/880939431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4801005b0 0x7fc480102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.505+0000 7fc4861ff700 1 --2- 172.21.15.57:0/880939431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc480102ed0 0x7fc4801052b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.505+0000 7fc4861ff700 1 -- 172.21.15.57:0/880939431 >> 172.21.15.57:0/880939431 conn(0x7fc4800f9fd0 msgr2=0x7fc4800fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:44.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.505+0000 7fc4861ff700 1 -- 172.21.15.57:0/880939431 shutdown_connections 2023-03-02T10:56:44.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.505+0000 7fc4861ff700 1 -- 172.21.15.57:0/880939431 wait complete. 2023-03-02T10:56:44.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.506+0000 7fc4861ff700 1 Processor -- start 2023-03-02T10:56:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.506+0000 7fc4861ff700 1 -- start start 2023-03-02T10:56:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.506+0000 7fc4861ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4801005b0 0x7fc4800fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.506+0000 7fc4861ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc480102ed0 0x7fc4800fe560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.506+0000 7fc4861ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4801057f0 0x7fc4800feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.506+0000 7fc4861ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800ff240 con 0x7fc480102ed0 2023-03-02T10:56:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.506+0000 7fc4861ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800ff3b0 con 0x7fc4801005b0 2023-03-02T10:56:44.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.506+0000 7fc4861ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48019f890 con 0x7fc4801057f0 2023-03-02T10:56:44.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc476ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc480102ed0 0x7fc4800fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc476ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc480102ed0 0x7fc4800fe560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42882/0 (socket says 172.21.15.57:42882) 2023-03-02T10:56:44.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc476ffd700 1 -- 172.21.15.57:0/2279408541 learned_addr learned my addr 172.21.15.57:0/2279408541 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:44.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc47f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4801005b0 0x7fc4800fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc47ffff700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4801057f0 0x7fc4800feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc476ffd700 1 -- 172.21.15.57:0/2279408541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4801057f0 msgr2=0x7fc4800feaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc476ffd700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4801057f0 0x7fc4800feaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc476ffd700 1 -- 172.21.15.57:0/2279408541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4801005b0 msgr2=0x7fc4800fff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc476ffd700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4801005b0 0x7fc4800fff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc476ffd700 1 -- 172.21.15.57:0/2279408541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4680095f0 con 0x7fc480102ed0 2023-03-02T10:56:44.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc476ffd700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc480102ed0 0x7fc4800fe560 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc468000c00 tx=0x7fc46800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:44.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc47d7fa700 1 -- 172.21.15.57:0/2279408541 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46801d070 con 0x7fc480102ed0 2023-03-02T10:56:44.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc4861ff700 1 -- 172.21.15.57:0/2279408541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48010b420 con 0x7fc480102ed0 2023-03-02T10:56:44.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc47d7fa700 1 -- 172.21.15.57:0/2279408541 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc46800fb50 con 0x7fc480102ed0 2023-03-02T10:56:44.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.507+0000 7fc47d7fa700 1 -- 172.21.15.57:0/2279408541 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4680173f0 con 0x7fc480102ed0 2023-03-02T10:56:44.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.508+0000 7fc4861ff700 1 -- 172.21.15.57:0/2279408541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48010b290 con 0x7fc480102ed0 2023-03-02T10:56:44.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.508+0000 7fc4861ff700 1 -- 172.21.15.57:0/2279408541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4800fbb40 con 0x7fc480102ed0 2023-03-02T10:56:44.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.510+0000 7fc47d7fa700 1 -- 172.21.15.57:0/2279408541 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fc468029030 con 0x7fc480102ed0 2023-03-02T10:56:44.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.511+0000 7fc47d7fa700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc46c09b3a0 0x7fc46c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.511+0000 7fc47d7fa700 1 -- 172.21.15.57:0/2279408541 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc4680c5fe0 con 0x7fc480102ed0 2023-03-02T10:56:44.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.511+0000 7fc47f7fe700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc46c09b3a0 0x7fc46c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.511+0000 7fc47f7fe700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc46c09b3a0 0x7fc46c09d850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc470005950 tx=0x7fc47000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:44.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.515+0000 7fc47d7fa700 1 -- 172.21.15.57:0/2279408541 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fc4680919a0 con 0x7fc480102ed0 2023-03-02T10:56:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:44 smithi136 ceph-mon[125702]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T10:56:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:44 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/4278321989' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:44 smithi057 ceph-mon[92072]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T10:56:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:44 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/4278321989' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:44 smithi122 ceph-mon[125440]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T10:56:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:44 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/4278321989' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:44.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.711+0000 7fc4861ff700 1 -- 172.21.15.57:0/2279408541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc48019fa50 con 0x7fc480102ed0 2023-03-02T10:56:44.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.711+0000 7fc47d7fa700 1 -- 172.21.15.57:0/2279408541 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc468094fc0 con 0x7fc480102ed0 2023-03-02T10:56:44.713 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-02T10:56:44.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 -- 172.21.15.57:0/2279408541 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc46c09b3a0 msgr2=0x7fc46c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc46c09b3a0 0x7fc46c09d850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc470005950 tx=0x7fc47000b410 comp rx=0 tx=0).stop 2023-03-02T10:56:44.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 -- 172.21.15.57:0/2279408541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc480102ed0 msgr2=0x7fc4800fe560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc480102ed0 0x7fc4800fe560 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc468000c00 tx=0x7fc46800f710 comp rx=0 tx=0).stop 2023-03-02T10:56:44.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 -- 172.21.15.57:0/2279408541 shutdown_connections 2023-03-02T10:56:44.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc46c09b3a0 0x7fc46c09d850 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4801057f0 0x7fc4800feaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4801005b0 0x7fc4800fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 --2- 172.21.15.57:0/2279408541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc480102ed0 0x7fc4800fe560 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 -- 172.21.15.57:0/2279408541 >> 172.21.15.57:0/2279408541 conn(0x7fc4800f9fd0 msgr2=0x7fc480101270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:44.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 -- 172.21.15.57:0/2279408541 shutdown_connections 2023-03-02T10:56:44.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.714+0000 7fc4861ff700 1 -- 172.21.15.57:0/2279408541 wait complete. 2023-03-02T10:56:44.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-02T10:56:44.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.886+0000 7f3f5edff700 1 -- 172.21.15.57:0/2713099736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f581005b0 msgr2=0x7f3f58102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.886+0000 7f3f5edff700 1 --2- 172.21.15.57:0/2713099736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f581005b0 0x7f3f58102990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009990 tx=0x7f3f4c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.887+0000 7f3f5edff700 1 -- 172.21.15.57:0/2713099736 shutdown_connections 2023-03-02T10:56:44.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.887+0000 7f3f5edff700 1 --2- 172.21.15.57:0/2713099736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f581057f0 0x7f3f58107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.887+0000 7f3f5edff700 1 --2- 172.21.15.57:0/2713099736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f581005b0 0x7f3f58102990 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.887+0000 7f3f5edff700 1 --2- 172.21.15.57:0/2713099736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f58102ed0 0x7f3f581052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.887+0000 7f3f5edff700 1 -- 172.21.15.57:0/2713099736 >> 172.21.15.57:0/2713099736 conn(0x7f3f580f9fd0 msgr2=0x7f3f580fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:44.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.887+0000 7f3f5edff700 1 -- 172.21.15.57:0/2713099736 shutdown_connections 2023-03-02T10:56:44.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.887+0000 7f3f5edff700 1 -- 172.21.15.57:0/2713099736 wait complete. 2023-03-02T10:56:44.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f5edff700 1 Processor -- start 2023-03-02T10:56:44.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f5edff700 1 -- start start 2023-03-02T10:56:44.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f5edff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f581005b0 0x7f3f58195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f5edff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f58102ed0 0x7f3f58195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f5edff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f581057f0 0x7f3f5819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f5edff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5819d3a0 con 0x7f3f581005b0 2023-03-02T10:56:44.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f5edff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5819d4e0 con 0x7f3f581057f0 2023-03-02T10:56:44.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f5edff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5819d670 con 0x7f3f58102ed0 2023-03-02T10:56:44.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f5cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f581005b0 0x7f3f58195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f5cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f581005b0 0x7f3f58195820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42902/0 (socket says 172.21.15.57:42902) 2023-03-02T10:56:44.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f5cb9b700 1 -- 172.21.15.57:0/3630556862 learned_addr learned my addr 172.21.15.57:0/3630556862 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:44.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.888+0000 7f3f57fff700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f58102ed0 0x7f3f58195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f5d39c700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f581057f0 0x7f3f5819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f5cb9b700 1 -- 172.21.15.57:0/3630556862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f58102ed0 msgr2=0x7f3f58195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f5cb9b700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f58102ed0 0x7f3f58195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f5cb9b700 1 -- 172.21.15.57:0/3630556862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f581057f0 msgr2=0x7f3f5819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:44.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f5cb9b700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f581057f0 0x7f3f5819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:44.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f5cb9b700 1 -- 172.21.15.57:0/3630556862 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c0095f0 con 0x7f3f581005b0 2023-03-02T10:56:44.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f5cb9b700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f581005b0 0x7f3f58195820 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00b680 tx=0x7f3f4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:44.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f55ffb700 1 -- 172.21.15.57:0/3630556862 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c01d070 con 0x7f3f581005b0 2023-03-02T10:56:44.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f5edff700 1 -- 172.21.15.57:0/3630556862 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5810b400 con 0x7f3f581005b0 2023-03-02T10:56:44.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f55ffb700 1 -- 172.21.15.57:0/3630556862 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f4c0054f0 con 0x7f3f581005b0 2023-03-02T10:56:44.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f55ffb700 1 -- 172.21.15.57:0/3630556862 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c004ca0 con 0x7f3f581005b0 2023-03-02T10:56:44.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.889+0000 7f3f5edff700 1 -- 172.21.15.57:0/3630556862 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5810b270 con 0x7f3f581005b0 2023-03-02T10:56:44.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.890+0000 7f3f5edff700 1 -- 172.21.15.57:0/3630556862 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f580fbb40 con 0x7f3f581005b0 2023-03-02T10:56:44.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.892+0000 7f3f55ffb700 1 -- 172.21.15.57:0/3630556862 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f3f4c00b050 con 0x7f3f581005b0 2023-03-02T10:56:44.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.893+0000 7f3f55ffb700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3f4809b3a0 0x7f3f4809d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:44.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.893+0000 7f3f55ffb700 1 -- 172.21.15.57:0/3630556862 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3f4c0c66a0 con 0x7f3f581005b0 2023-03-02T10:56:44.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.893+0000 7f3f57fff700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3f4809b3a0 0x7f3f4809d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:44.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.894+0000 7f3f57fff700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3f4809b3a0 0x7f3f4809d850 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3f44005950 tx=0x7f3f4400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:44.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:44.896+0000 7f3f55ffb700 1 -- 172.21.15.57:0/3630556862 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f3f4c092000 con 0x7f3f581005b0 2023-03-02T10:56:45.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.092+0000 7f3f5edff700 1 -- 172.21.15.57:0/3630556862 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f58061410 con 0x7f3f581005b0 2023-03-02T10:56:45.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.093+0000 7f3f55ffb700 1 -- 172.21.15.57:0/3630556862 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f4c02f020 con 0x7f3f581005b0 2023-03-02T10:56:45.094 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-03-02T10:56:45.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 -- 172.21.15.57:0/3630556862 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3f4809b3a0 msgr2=0x7f3f4809d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3f4809b3a0 0x7f3f4809d850 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3f44005950 tx=0x7f3f4400b410 comp rx=0 tx=0).stop 2023-03-02T10:56:45.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 -- 172.21.15.57:0/3630556862 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f581005b0 msgr2=0x7f3f58195820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f581005b0 0x7f3f58195820 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00b680 tx=0x7f3f4c004730 comp rx=0 tx=0).stop 2023-03-02T10:56:45.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 -- 172.21.15.57:0/3630556862 shutdown_connections 2023-03-02T10:56:45.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3f4809b3a0 0x7f3f4809d850 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f581057f0 0x7f3f5819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f581005b0 0x7f3f58195820 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 --2- 172.21.15.57:0/3630556862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f58102ed0 0x7f3f58195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 -- 172.21.15.57:0/3630556862 >> 172.21.15.57:0/3630556862 conn(0x7f3f580f9fd0 msgr2=0x7f3f581011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:45.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 -- 172.21.15.57:0/3630556862 shutdown_connections 2023-03-02T10:56:45.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.095+0000 7f3f5edff700 1 -- 172.21.15.57:0/3630556862 wait complete. 2023-03-02T10:56:45.111 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-02T10:56:45.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.267+0000 7fb4757ff700 1 -- 172.21.15.57:0/3402219325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470102ed0 msgr2=0x7fb4701052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.267+0000 7fb4757ff700 1 --2- 172.21.15.57:0/3402219325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470102ed0 0x7fb4701052b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb458009990 tx=0x7fb458009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.267+0000 7fb4757ff700 1 -- 172.21.15.57:0/3402219325 shutdown_connections 2023-03-02T10:56:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.267+0000 7fb4757ff700 1 --2- 172.21.15.57:0/3402219325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4701057f0 0x7fb470107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.267+0000 7fb4757ff700 1 --2- 172.21.15.57:0/3402219325 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4701005b0 0x7fb470102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.267+0000 7fb4757ff700 1 --2- 172.21.15.57:0/3402219325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470102ed0 0x7fb4701052b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.267+0000 7fb4757ff700 1 -- 172.21.15.57:0/3402219325 >> 172.21.15.57:0/3402219325 conn(0x7fb4700f9fd0 msgr2=0x7fb4700fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:45.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.268+0000 7fb4757ff700 1 -- 172.21.15.57:0/3402219325 shutdown_connections 2023-03-02T10:56:45.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.268+0000 7fb4757ff700 1 -- 172.21.15.57:0/3402219325 wait complete. 2023-03-02T10:56:45.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.268+0000 7fb4757ff700 1 Processor -- start 2023-03-02T10:56:45.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.268+0000 7fb4757ff700 1 -- start start 2023-03-02T10:56:45.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4757ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4701005b0 0x7fb4700fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:45.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4757ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470102ed0 0x7fb4700fe560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:45.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4757ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4701057f0 0x7fb4700feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:45.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4757ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4700ff240 con 0x7fb470102ed0 2023-03-02T10:56:45.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4757ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4700ff3b0 con 0x7fb4701057f0 2023-03-02T10:56:45.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4757ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47019f890 con 0x7fb4701005b0 2023-03-02T10:56:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4667fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470102ed0 0x7fb4700fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4667fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470102ed0 0x7fb4700fe560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42916/0 (socket says 172.21.15.57:42916) 2023-03-02T10:56:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4667fc700 1 -- 172.21.15.57:0/2052041336 learned_addr learned my addr 172.21.15.57:0/2052041336 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb46effd700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4701005b0 0x7fb4700fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb46f7fe700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4701057f0 0x7fb4700feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4667fc700 1 -- 172.21.15.57:0/2052041336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4701005b0 msgr2=0x7fb4700fff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4667fc700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4701005b0 0x7fb4700fff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4667fc700 1 -- 172.21.15.57:0/2052041336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4701057f0 msgr2=0x7fb4700feaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4667fc700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4701057f0 0x7fb4700feaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4667fc700 1 -- 172.21.15.57:0/2052041336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4580095f0 con 0x7fb470102ed0 2023-03-02T10:56:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb46f7fe700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4701057f0 0x7fb4700feaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb4667fc700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470102ed0 0x7fb4700fe560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb458000c00 tx=0x7fb45800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.269+0000 7fb46cff9700 1 -- 172.21.15.57:0/2052041336 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45801d070 con 0x7fb470102ed0 2023-03-02T10:56:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.270+0000 7fb46cff9700 1 -- 172.21.15.57:0/2052041336 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb45800fc00 con 0x7fb470102ed0 2023-03-02T10:56:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.270+0000 7fb4757ff700 1 -- 172.21.15.57:0/2052041336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47010b420 con 0x7fb470102ed0 2023-03-02T10:56:45.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.270+0000 7fb46cff9700 1 -- 172.21.15.57:0/2052041336 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458017650 con 0x7fb470102ed0 2023-03-02T10:56:45.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.270+0000 7fb4757ff700 1 -- 172.21.15.57:0/2052041336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47010b290 con 0x7fb470102ed0 2023-03-02T10:56:45.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.271+0000 7fb4757ff700 1 -- 172.21.15.57:0/2052041336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4700fbb40 con 0x7fb470102ed0 2023-03-02T10:56:45.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.272+0000 7fb46cff9700 1 -- 172.21.15.57:0/2052041336 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fb458029030 con 0x7fb470102ed0 2023-03-02T10:56:45.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.273+0000 7fb46cff9700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb45c09b3a0 0x7fb45c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:45.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.273+0000 7fb46cff9700 1 -- 172.21.15.57:0/2052041336 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb4580c63b0 con 0x7fb470102ed0 2023-03-02T10:56:45.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.273+0000 7fb46effd700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb45c09b3a0 0x7fb45c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:45.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.274+0000 7fb46effd700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb45c09b3a0 0x7fb45c09d850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb460005950 tx=0x7fb4600058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:45.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.276+0000 7fb46cff9700 1 -- 172.21.15.57:0/2052041336 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fb458091d70 con 0x7fb470102ed0 2023-03-02T10:56:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:45 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2279408541' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:45 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3630556862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:45.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.480+0000 7fb4757ff700 1 -- 172.21.15.57:0/2052041336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4700615a0 con 0x7fb470102ed0 2023-03-02T10:56:45.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.480+0000 7fb46cff9700 1 -- 172.21.15.57:0/2052041336 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb458095390 con 0x7fb470102ed0 2023-03-02T10:56:45.481 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-03-02T10:56:45.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 -- 172.21.15.57:0/2052041336 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb45c09b3a0 msgr2=0x7fb45c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb45c09b3a0 0x7fb45c09d850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb460005950 tx=0x7fb4600058e0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 -- 172.21.15.57:0/2052041336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470102ed0 msgr2=0x7fb4700fe560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470102ed0 0x7fb4700fe560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb458000c00 tx=0x7fb45800f710 comp rx=0 tx=0).stop 2023-03-02T10:56:45.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 -- 172.21.15.57:0/2052041336 shutdown_connections 2023-03-02T10:56:45.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb45c09b3a0 0x7fb45c09d850 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4701057f0 0x7fb4700feaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4701005b0 0x7fb4700fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 --2- 172.21.15.57:0/2052041336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470102ed0 0x7fb4700fe560 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 -- 172.21.15.57:0/2052041336 >> 172.21.15.57:0/2052041336 conn(0x7fb4700f9fd0 msgr2=0x7fb470101270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:45.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 -- 172.21.15.57:0/2052041336 shutdown_connections 2023-03-02T10:56:45.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.482+0000 7fb4757ff700 1 -- 172.21.15.57:0/2052041336 wait complete. 2023-03-02T10:56:45.499 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:56:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.653+0000 7f313a7ff700 1 -- 172.21.15.57:0/4183995030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31340744d0 msgr2=0x7f31340729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.653+0000 7f313a7ff700 1 --2- 172.21.15.57:0/4183995030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31340744d0 0x7f31340729c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3124009990 tx=0x7f3124009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.653+0000 7f313a7ff700 1 -- 172.21.15.57:0/4183995030 shutdown_connections 2023-03-02T10:56:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.653+0000 7f313a7ff700 1 --2- 172.21.15.57:0/4183995030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31341079a0 0x7f3134109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.653+0000 7f313a7ff700 1 --2- 172.21.15.57:0/4183995030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31340744d0 0x7f31340729c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.653+0000 7f313a7ff700 1 --2- 172.21.15.57:0/4183995030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3134072f00 0x7f3134073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.653+0000 7f313a7ff700 1 -- 172.21.15.57:0/4183995030 >> 172.21.15.57:0/4183995030 conn(0x7f31340fb0c0 msgr2=0x7f31340fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.653+0000 7f313a7ff700 1 -- 172.21.15.57:0/4183995030 shutdown_connections 2023-03-02T10:56:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.653+0000 7f313a7ff700 1 -- 172.21.15.57:0/4183995030 wait complete. 2023-03-02T10:56:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.653+0000 7f313a7ff700 1 Processor -- start 2023-03-02T10:56:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f313a7ff700 1 -- start start 2023-03-02T10:56:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f313a7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3134072f00 0x7f3134197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f313a7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31340744d0 0x7f3134197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f313a7ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31341079a0 0x7f313419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f313a7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313419f5b0 con 0x7f3134072f00 2023-03-02T10:56:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f313a7ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313419f6f0 con 0x7f31341079a0 2023-03-02T10:56:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f313a7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313419f880 con 0x7f31340744d0 2023-03-02T10:56:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f3133fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3134072f00 0x7f3134197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f3133fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3134072f00 0x7f3134197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42928/0 (socket says 172.21.15.57:42928) 2023-03-02T10:56:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f312b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31340744d0 0x7f3134197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f3133fff700 1 -- 172.21.15.57:0/1467045785 learned_addr learned my addr 172.21.15.57:0/1467045785 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f3138d9c700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31341079a0 0x7f313419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f3133fff700 1 -- 172.21.15.57:0/1467045785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31340744d0 msgr2=0x7f3134197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f3133fff700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31340744d0 0x7f3134197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f3133fff700 1 -- 172.21.15.57:0/1467045785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31341079a0 msgr2=0x7f313419efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f3133fff700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31341079a0 0x7f313419efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f3133fff700 1 -- 172.21.15.57:0/1467045785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31240095f0 con 0x7f3134072f00 2023-03-02T10:56:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.654+0000 7f3133fff700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3134072f00 0x7f3134197a80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f312400b680 tx=0x7f3124004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.655+0000 7f3131ffb700 1 -- 172.21.15.57:0/1467045785 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312401d070 con 0x7f3134072f00 2023-03-02T10:56:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.655+0000 7f3131ffb700 1 -- 172.21.15.57:0/1467045785 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31240054f0 con 0x7f3134072f00 2023-03-02T10:56:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.655+0000 7f313a7ff700 1 -- 172.21.15.57:0/1467045785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313410d630 con 0x7f3134072f00 2023-03-02T10:56:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.655+0000 7f3131ffb700 1 -- 172.21.15.57:0/1467045785 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124004be0 con 0x7f3134072f00 2023-03-02T10:56:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.655+0000 7f313a7ff700 1 -- 172.21.15.57:0/1467045785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313410d4a0 con 0x7f3134072f00 2023-03-02T10:56:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.656+0000 7f313a7ff700 1 -- 172.21.15.57:0/1467045785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3134106130 con 0x7f3134072f00 2023-03-02T10:56:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.657+0000 7f3131ffb700 1 -- 172.21.15.57:0/1467045785 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f312400b050 con 0x7f3134072f00 2023-03-02T10:56:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.658+0000 7f3131ffb700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f312009b420 0x7f312009d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.658+0000 7f3131ffb700 1 -- 172.21.15.57:0/1467045785 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f31240c64b0 con 0x7f3134072f00 2023-03-02T10:56:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.658+0000 7f312b7fe700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f312009b420 0x7f312009d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.659+0000 7f312b7fe700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f312009b420 0x7f312009d8d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f311c009550 tx=0x7f311c0091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.661+0000 7f3131ffb700 1 -- 172.21.15.57:0/1467045785 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f3124091e10 con 0x7f3134072f00 2023-03-02T10:56:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:45 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2279408541' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:45 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3630556862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:45 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2279408541' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:45 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3630556862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:45.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.863+0000 7f313a7ff700 1 -- 172.21.15.57:0/1467045785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f313402cd50 con 0x7f3134072f00 2023-03-02T10:56:45.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.865+0000 7f3131ffb700 1 -- 172.21.15.57:0/1467045785 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22553 (secure 0 0 0) 0x7f312402f090 con 0x7f3134072f00 2023-03-02T10:56:45.866 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:45.866 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":86,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:50.530934+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:56:45.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 -- 172.21.15.57:0/1467045785 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f312009b420 msgr2=0x7f312009d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f312009b420 0x7f312009d8d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f311c009550 tx=0x7f311c0091b0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 -- 172.21.15.57:0/1467045785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3134072f00 msgr2=0x7f3134197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:45.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3134072f00 0x7f3134197a80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f312400b680 tx=0x7f3124004730 comp rx=0 tx=0).stop 2023-03-02T10:56:45.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 -- 172.21.15.57:0/1467045785 shutdown_connections 2023-03-02T10:56:45.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f312009b420 0x7f312009d8d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31341079a0 0x7f313419efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3134072f00 0x7f3134197a80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 --2- 172.21.15.57:0/1467045785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31340744d0 0x7f3134197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:45.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 -- 172.21.15.57:0/1467045785 >> 172.21.15.57:0/1467045785 conn(0x7f31340fb0c0 msgr2=0x7f31340fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:45.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 -- 172.21.15.57:0/1467045785 shutdown_connections 2023-03-02T10:56:45.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:45.867+0000 7f313a7ff700 1 -- 172.21.15.57:0/1467045785 wait complete. 2023-03-02T10:56:45.884 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-02T10:51:03.600226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-02T10:55:08.504787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-02T10:55:09.909014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-02T10:56:45.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-02T10:56:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.040+0000 7efc467ff700 1 -- 172.21.15.57:0/291661377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc40102b60 msgr2=0x7efc40104fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.040+0000 7efc467ff700 1 --2- 172.21.15.57:0/291661377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc40102b60 0x7efc40104fe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efc34009990 tx=0x7efc34009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.040+0000 7efc467ff700 1 -- 172.21.15.57:0/291661377 shutdown_connections 2023-03-02T10:56:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.040+0000 7efc467ff700 1 --2- 172.21.15.57:0/291661377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc40105670 0x7efc40107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.041+0000 7efc467ff700 1 --2- 172.21.15.57:0/291661377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc400683c0 0x7efc40102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.041+0000 7efc467ff700 1 --2- 172.21.15.57:0/291661377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc40102b60 0x7efc40104fe0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.041+0000 7efc467ff700 1 -- 172.21.15.57:0/291661377 >> 172.21.15.57:0/291661377 conn(0x7efc400f9fd0 msgr2=0x7efc400fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:46.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.041+0000 7efc467ff700 1 -- 172.21.15.57:0/291661377 shutdown_connections 2023-03-02T10:56:46.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.041+0000 7efc467ff700 1 -- 172.21.15.57:0/291661377 wait complete. 2023-03-02T10:56:46.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.041+0000 7efc467ff700 1 Processor -- start 2023-03-02T10:56:46.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.041+0000 7efc467ff700 1 -- start start 2023-03-02T10:56:46.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc467ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400683c0 0x7efc40195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc467ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc40102b60 0x7efc40195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc467ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc40105670 0x7efc4019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc467ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4019d3b0 con 0x7efc400683c0 2023-03-02T10:56:46.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc467ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4019d4f0 con 0x7efc40102b60 2023-03-02T10:56:46.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc467ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4019d680 con 0x7efc40105670 2023-03-02T10:56:46.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc3ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400683c0 0x7efc40195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc3ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400683c0 0x7efc40195830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53882/0 (socket says 172.21.15.57:53882) 2023-03-02T10:56:46.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc3ffff700 1 -- 172.21.15.57:0/1624457185 learned_addr learned my addr 172.21.15.57:0/1624457185 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:46.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc3f7fe700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc40102b60 0x7efc40195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc44d9c700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc40105670 0x7efc4019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc3ffff700 1 -- 172.21.15.57:0/1624457185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc40105670 msgr2=0x7efc4019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc3ffff700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc40105670 0x7efc4019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc3ffff700 1 -- 172.21.15.57:0/1624457185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc40102b60 msgr2=0x7efc40195d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc3ffff700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc40102b60 0x7efc40195d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc3ffff700 1 -- 172.21.15.57:0/1624457185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc340095f0 con 0x7efc400683c0 2023-03-02T10:56:46.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc44d9c700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc40105670 0x7efc4019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:56:46.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc3ffff700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400683c0 0x7efc40195830 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efc3000efc0 tx=0x7efc3000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:46.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.042+0000 7efc3d7fa700 1 -- 172.21.15.57:0/1624457185 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000ca70 con 0x7efc400683c0 2023-03-02T10:56:46.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.043+0000 7efc467ff700 1 -- 172.21.15.57:0/1624457185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4010b410 con 0x7efc400683c0 2023-03-02T10:56:46.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.043+0000 7efc3d7fa700 1 -- 172.21.15.57:0/1624457185 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc3000f040 con 0x7efc400683c0 2023-03-02T10:56:46.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.043+0000 7efc3d7fa700 1 -- 172.21.15.57:0/1624457185 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc30014480 con 0x7efc400683c0 2023-03-02T10:56:46.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.043+0000 7efc467ff700 1 -- 172.21.15.57:0/1624457185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4010b280 con 0x7efc400683c0 2023-03-02T10:56:46.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.043+0000 7efc467ff700 1 -- 172.21.15.57:0/1624457185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc400fbb40 con 0x7efc400683c0 2023-03-02T10:56:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.045+0000 7efc3d7fa700 1 -- 172.21.15.57:0/1624457185 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7efc3000cd60 con 0x7efc400683c0 2023-03-02T10:56:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.046+0000 7efc3d7fa700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efc2809b3a0 0x7efc2809d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.046+0000 7efc3d7fa700 1 -- 172.21.15.57:0/1624457185 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efc300c5aa0 con 0x7efc400683c0 2023-03-02T10:56:46.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.046+0000 7efc3f7fe700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efc2809b3a0 0x7efc2809d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.047+0000 7efc3f7fe700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efc2809b3a0 0x7efc2809d850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efc3400b2e0 tx=0x7efc34005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:46.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.048+0000 7efc3d7fa700 1 -- 172.21.15.57:0/1624457185 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7efc30091370 con 0x7efc400683c0 2023-03-02T10:56:46.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.250+0000 7efc467ff700 1 -- 172.21.15.57:0/1624457185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc40067280 con 0x7efc400683c0 2023-03-02T10:56:46.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.250+0000 7efc3d7fa700 1 -- 172.21.15.57:0/1624457185 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc30094990 con 0x7efc400683c0 2023-03-02T10:56:46.251 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-02T10:56:46.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 -- 172.21.15.57:0/1624457185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efc2809b3a0 msgr2=0x7efc2809d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efc2809b3a0 0x7efc2809d850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efc3400b2e0 tx=0x7efc34005fb0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 -- 172.21.15.57:0/1624457185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400683c0 msgr2=0x7efc40195830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400683c0 0x7efc40195830 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efc3000efc0 tx=0x7efc3000c3a0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 -- 172.21.15.57:0/1624457185 shutdown_connections 2023-03-02T10:56:46.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efc2809b3a0 0x7efc2809d850 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc40105670 0x7efc4019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400683c0 0x7efc40195830 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 --2- 172.21.15.57:0/1624457185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc40102b60 0x7efc40195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 -- 172.21.15.57:0/1624457185 >> 172.21.15.57:0/1624457185 conn(0x7efc400f9fd0 msgr2=0x7efc40100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:46.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 -- 172.21.15.57:0/1624457185 shutdown_connections 2023-03-02T10:56:46.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.252+0000 7efc467ff700 1 -- 172.21.15.57:0/1624457185 wait complete. 2023-03-02T10:56:46.269 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-02T10:56:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.426+0000 7f8fb29ff700 1 -- 172.21.15.57:0/981742459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fac1005b0 msgr2=0x7f8fac102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.426+0000 7f8fb29ff700 1 --2- 172.21.15.57:0/981742459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fac1005b0 0x7f8fac102990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009990 tx=0x7f8f9c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.426+0000 7f8fb29ff700 1 -- 172.21.15.57:0/981742459 shutdown_connections 2023-03-02T10:56:46.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.426+0000 7f8fb29ff700 1 --2- 172.21.15.57:0/981742459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fac1057f0 0x7f8fac107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.426+0000 7f8fb29ff700 1 --2- 172.21.15.57:0/981742459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fac1005b0 0x7f8fac102990 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.426+0000 7f8fb29ff700 1 --2- 172.21.15.57:0/981742459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fac102ed0 0x7f8fac1052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.426+0000 7f8fb29ff700 1 -- 172.21.15.57:0/981742459 >> 172.21.15.57:0/981742459 conn(0x7f8fac0f9fd0 msgr2=0x7f8fac0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:46.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.426+0000 7f8fb29ff700 1 -- 172.21.15.57:0/981742459 shutdown_connections 2023-03-02T10:56:46.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.426+0000 7f8fb29ff700 1 -- 172.21.15.57:0/981742459 wait complete. 2023-03-02T10:56:46.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.427+0000 7f8fb29ff700 1 Processor -- start 2023-03-02T10:56:46.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.427+0000 7f8fb29ff700 1 -- start start 2023-03-02T10:56:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.427+0000 7f8fb29ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fac1005b0 0x7f8fac195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.427+0000 7f8fb29ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fac102ed0 0x7f8fac195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fb29ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fac1057f0 0x7f8fac19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fb29ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac19d3f0 con 0x7f8fac102ed0 2023-03-02T10:56:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fb29ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac19d530 con 0x7f8fac1005b0 2023-03-02T10:56:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fb29ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac19d6c0 con 0x7f8fac1057f0 2023-03-02T10:56:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fab7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fac102ed0 0x7f8fac195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fab7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fac102ed0 0x7f8fac195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53892/0 (socket says 172.21.15.57:53892) 2023-03-02T10:56:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fab7fe700 1 -- 172.21.15.57:0/3294301241 learned_addr learned my addr 172.21.15.57:0/3294301241 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fabfff700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fac1005b0 0x7f8fac195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fb0f9c700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fac1057f0 0x7f8fac19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fab7fe700 1 -- 172.21.15.57:0/3294301241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fac1057f0 msgr2=0x7f8fac19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fab7fe700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fac1057f0 0x7f8fac19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fab7fe700 1 -- 172.21.15.57:0/3294301241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fac1005b0 msgr2=0x7f8fac195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fab7fe700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fac1005b0 0x7f8fac195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fab7fe700 1 -- 172.21.15.57:0/3294301241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c0095f0 con 0x7f8fac102ed0 2023-03-02T10:56:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fb0f9c700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fac1057f0 0x7f8fac19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:56:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fab7fe700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fac102ed0 0x7f8fac195db0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000d980 tx=0x7f8fa000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fa97fa700 1 -- 172.21.15.57:0/3294301241 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0004220 con 0x7f8fac102ed0 2023-03-02T10:56:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fb29ff700 1 -- 172.21.15.57:0/3294301241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fac10b450 con 0x7f8fac102ed0 2023-03-02T10:56:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fa97fa700 1 -- 172.21.15.57:0/3294301241 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fa0007640 con 0x7f8fac102ed0 2023-03-02T10:56:46.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.428+0000 7f8fa97fa700 1 -- 172.21.15.57:0/3294301241 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0005610 con 0x7f8fac102ed0 2023-03-02T10:56:46.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.429+0000 7f8fb29ff700 1 -- 172.21.15.57:0/3294301241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac10b2c0 con 0x7f8fac102ed0 2023-03-02T10:56:46.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.430+0000 7f8fb29ff700 1 -- 172.21.15.57:0/3294301241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fac0fbb40 con 0x7f8fac102ed0 2023-03-02T10:56:46.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.431+0000 7f8fa97fa700 1 -- 172.21.15.57:0/3294301241 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f8fa0021070 con 0x7f8fac102ed0 2023-03-02T10:56:46.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.432+0000 7f8fa97fa700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8f9409b3a0 0x7f8f9409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.432+0000 7f8fa97fa700 1 -- 172.21.15.57:0/3294301241 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8fa00c4d80 con 0x7f8fac102ed0 2023-03-02T10:56:46.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.432+0000 7f8fabfff700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8f9409b3a0 0x7f8f9409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.432+0000 7f8fabfff700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8f9409b3a0 0x7f8f9409d850 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00b5c0 tx=0x7f8f9c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.436+0000 7f8fa97fa700 1 -- 172.21.15.57:0/3294301241 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f8fa0090650 con 0x7f8fac102ed0 2023-03-02T10:56:46.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.636+0000 7f8fb29ff700 1 -- 172.21.15.57:0/3294301241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8fac0611d0 con 0x7f8fac102ed0 2023-03-02T10:56:46.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.637+0000 7f8fa97fa700 1 -- 172.21.15.57:0/3294301241 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8fa0016070 con 0x7f8fac102ed0 2023-03-02T10:56:46.638 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-03-02T10:56:46.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 -- 172.21.15.57:0/3294301241 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8f9409b3a0 msgr2=0x7f8f9409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8f9409b3a0 0x7f8f9409d850 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00b5c0 tx=0x7f8f9c005fd0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 -- 172.21.15.57:0/3294301241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fac102ed0 msgr2=0x7f8fac195db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fac102ed0 0x7f8fac195db0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000d980 tx=0x7f8fa000dc90 comp rx=0 tx=0).stop 2023-03-02T10:56:46.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 -- 172.21.15.57:0/3294301241 shutdown_connections 2023-03-02T10:56:46.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8f9409b3a0 0x7f8f9409d850 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fac1057f0 0x7f8fac19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fac1005b0 0x7f8fac195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 --2- 172.21.15.57:0/3294301241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fac102ed0 0x7f8fac195db0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 -- 172.21.15.57:0/3294301241 >> 172.21.15.57:0/3294301241 conn(0x7f8fac0f9fd0 msgr2=0x7f8fac1011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:46.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 -- 172.21.15.57:0/3294301241 shutdown_connections 2023-03-02T10:56:46.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.639+0000 7f8fb29ff700 1 -- 172.21.15.57:0/3294301241 wait complete. 2023-03-02T10:56:46.654 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:46 smithi057 ceph-mon[92072]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2023-03-02T10:56:46.654 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:46 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/2052041336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:46.654 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:46 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1467045785' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:46.654 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:46 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1624457185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:46.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-02T10:56:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:46 smithi122 ceph-mon[125440]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2023-03-02T10:56:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:46 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/2052041336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:46 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1467045785' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:46 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1624457185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:46.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.812+0000 7fb5417ff700 1 -- 172.21.15.57:0/4143428242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53c0fe990 msgr2=0x7fb53c0feda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.812+0000 7fb5417ff700 1 --2- 172.21.15.57:0/4143428242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53c0fe990 0x7fb53c0feda0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00b0a0 tx=0x7fb52c00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.812+0000 7fb5417ff700 1 -- 172.21.15.57:0/4143428242 shutdown_connections 2023-03-02T10:56:46.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.812+0000 7fb5417ff700 1 --2- 172.21.15.57:0/4143428242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb53c1005d0 0x7fb53c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.812+0000 7fb5417ff700 1 --2- 172.21.15.57:0/4143428242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53c0fe990 0x7fb53c0feda0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.812+0000 7fb5417ff700 1 --2- 172.21.15.57:0/4143428242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb53c0ffc20 0x7fb53c100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.812+0000 7fb5417ff700 1 -- 172.21.15.57:0/4143428242 >> 172.21.15.57:0/4143428242 conn(0x7fb53c0f9fd0 msgr2=0x7fb53c0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:46.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.812+0000 7fb5417ff700 1 -- 172.21.15.57:0/4143428242 shutdown_connections 2023-03-02T10:56:46.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.812+0000 7fb5417ff700 1 -- 172.21.15.57:0/4143428242 wait complete. 2023-03-02T10:56:46.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.812+0000 7fb5417ff700 1 Processor -- start 2023-03-02T10:56:46.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.812+0000 7fb5417ff700 1 -- start start 2023-03-02T10:56:46.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb5417ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53c0fe990 0x7fb53c197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb5417ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb53c0ffc20 0x7fb53c1980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb5417ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb53c1005d0 0x7fb53c19f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb5417ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c19f730 con 0x7fb53c0fe990 2023-03-02T10:56:46.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb5417ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c19f870 con 0x7fb53c1005d0 2023-03-02T10:56:46.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb5417ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c19fa00 con 0x7fb53c0ffc20 2023-03-02T10:56:46.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb53affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53c0fe990 0x7fb53c197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb53affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53c0fe990 0x7fb53c197bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53912/0 (socket says 172.21.15.57:53912) 2023-03-02T10:56:46.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb53affd700 1 -- 172.21.15.57:0/1596799117 learned_addr learned my addr 172.21.15.57:0/1596799117 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:46.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb52bfff700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb53c0ffc20 0x7fb53c1980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb53affd700 1 -- 172.21.15.57:0/1596799117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb53c0ffc20 msgr2=0x7fb53c1980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb53affd700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb53c0ffc20 0x7fb53c1980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb53b7fe700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb53c1005d0 0x7fb53c19f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb53affd700 1 -- 172.21.15.57:0/1596799117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb53c1005d0 msgr2=0x7fb53c19f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:46.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb53affd700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb53c1005d0 0x7fb53c19f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:46.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb53affd700 1 -- 172.21.15.57:0/1596799117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c009d00 con 0x7fb53c0fe990 2023-03-02T10:56:46.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb53b7fe700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb53c1005d0 0x7fb53c19f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:56:46.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.813+0000 7fb53affd700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53c0fe990 0x7fb53c197bb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb52c007a60 tx=0x7fb52c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:46.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.814+0000 7fb538ff9700 1 -- 172.21.15.57:0/1596799117 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c00e040 con 0x7fb53c0fe990 2023-03-02T10:56:46.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.814+0000 7fb538ff9700 1 -- 172.21.15.57:0/1596799117 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb52c004e60 con 0x7fb53c0fe990 2023-03-02T10:56:46.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.814+0000 7fb5417ff700 1 -- 172.21.15.57:0/1596799117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c10a340 con 0x7fb53c0fe990 2023-03-02T10:56:46.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.814+0000 7fb538ff9700 1 -- 172.21.15.57:0/1596799117 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c005330 con 0x7fb53c0fe990 2023-03-02T10:56:46.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.814+0000 7fb5417ff700 1 -- 172.21.15.57:0/1596799117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c10a1b0 con 0x7fb53c0fe990 2023-03-02T10:56:46.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.815+0000 7fb5417ff700 1 -- 172.21.15.57:0/1596799117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c1a0050 con 0x7fb53c0fe990 2023-03-02T10:56:46.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.816+0000 7fb538ff9700 1 -- 172.21.15.57:0/1596799117 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fb52c01da30 con 0x7fb53c0fe990 2023-03-02T10:56:46.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.817+0000 7fb538ff9700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb52409b420 0x7fb52409d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:46.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.817+0000 7fb538ff9700 1 -- 172.21.15.57:0/1596799117 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb52c0c6ad0 con 0x7fb53c0fe990 2023-03-02T10:56:46.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.817+0000 7fb52bfff700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb52409b420 0x7fb52409d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:46.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.818+0000 7fb52bfff700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb52409b420 0x7fb52409d8d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb530009c60 tx=0x7fb530009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:46.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:46.820+0000 7fb538ff9700 1 -- 172.21.15.57:0/1596799117 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fb52c092490 con 0x7fb53c0fe990 2023-03-02T10:56:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:46 smithi136 ceph-mon[125702]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2023-03-02T10:56:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:46 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/2052041336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:46 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1467045785' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:46 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1624457185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:47.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.016+0000 7fb5417ff700 1 -- 172.21.15.57:0/1596799117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb53c1a0600 con 0x7fb53c0fe990 2023-03-02T10:56:47.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.017+0000 7fb538ff9700 1 -- 172.21.15.57:0/1596799117 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb52c095ab0 con 0x7fb53c0fe990 2023-03-02T10:56:47.018 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-03-02T10:56:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 -- 172.21.15.57:0/1596799117 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb52409b420 msgr2=0x7fb52409d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb52409b420 0x7fb52409d8d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb530009c60 tx=0x7fb530009260 comp rx=0 tx=0).stop 2023-03-02T10:56:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 -- 172.21.15.57:0/1596799117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53c0fe990 msgr2=0x7fb53c197bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53c0fe990 0x7fb53c197bb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb52c007a60 tx=0x7fb52c00bd60 comp rx=0 tx=0).stop 2023-03-02T10:56:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 -- 172.21.15.57:0/1596799117 shutdown_connections 2023-03-02T10:56:47.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fb52409b420 0x7fb52409d8d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb53c1005d0 0x7fb53c19f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53c0fe990 0x7fb53c197bb0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 --2- 172.21.15.57:0/1596799117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb53c0ffc20 0x7fb53c1980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 -- 172.21.15.57:0/1596799117 >> 172.21.15.57:0/1596799117 conn(0x7fb53c0f9fd0 msgr2=0x7fb53c067680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:47.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 -- 172.21.15.57:0/1596799117 shutdown_connections 2023-03-02T10:56:47.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.019+0000 7fb5417ff700 1 -- 172.21.15.57:0/1596799117 wait complete. 2023-03-02T10:56:47.035 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-03-02T10:56:47.036 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:56:47.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.188+0000 7ff3a49ff700 1 -- 172.21.15.57:0/1482140136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3a0102ed0 msgr2=0x7ff3a01052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.188+0000 7ff3a49ff700 1 --2- 172.21.15.57:0/1482140136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3a0102ed0 0x7ff3a01052b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff388009990 tx=0x7ff388009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.188+0000 7ff3a49ff700 1 -- 172.21.15.57:0/1482140136 shutdown_connections 2023-03-02T10:56:47.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.188+0000 7ff3a49ff700 1 --2- 172.21.15.57:0/1482140136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3a01057f0 0x7ff3a0107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.188+0000 7ff3a49ff700 1 --2- 172.21.15.57:0/1482140136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3a01005b0 0x7ff3a0102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.188+0000 7ff3a49ff700 1 --2- 172.21.15.57:0/1482140136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3a0102ed0 0x7ff3a01052b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.188+0000 7ff3a49ff700 1 -- 172.21.15.57:0/1482140136 >> 172.21.15.57:0/1482140136 conn(0x7ff3a00f9fd0 msgr2=0x7ff3a00fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:47.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.189+0000 7ff3a49ff700 1 -- 172.21.15.57:0/1482140136 shutdown_connections 2023-03-02T10:56:47.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.189+0000 7ff3a49ff700 1 -- 172.21.15.57:0/1482140136 wait complete. 2023-03-02T10:56:47.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.189+0000 7ff3a49ff700 1 Processor -- start 2023-03-02T10:56:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.189+0000 7ff3a49ff700 1 -- start start 2023-03-02T10:56:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.189+0000 7ff3a49ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3a01005b0 0x7ff3a0195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff3a49ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3a0102ed0 0x7ff3a0195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff3a49ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3a01057f0 0x7ff3a019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff3a49ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a019d3e0 con 0x7ff3a01057f0 2023-03-02T10:56:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff3a49ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a019d520 con 0x7ff3a01005b0 2023-03-02T10:56:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff3a49ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a019d6b0 con 0x7ff3a0102ed0 2023-03-02T10:56:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff39ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3a01057f0 0x7ff3a019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff39ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3a01057f0 0x7ff3a019ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53930/0 (socket says 172.21.15.57:53930) 2023-03-02T10:56:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff39ed9d700 1 -- 172.21.15.57:0/3198160912 learned_addr learned my addr 172.21.15.57:0/3198160912 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff39e59c700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3a01005b0 0x7ff3a0195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff397fff700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3a0102ed0 0x7ff3a0195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff39ed9d700 1 -- 172.21.15.57:0/3198160912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3a0102ed0 msgr2=0x7ff3a0195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff39ed9d700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3a0102ed0 0x7ff3a0195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff39ed9d700 1 -- 172.21.15.57:0/3198160912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3a01005b0 msgr2=0x7ff3a0195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff39ed9d700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3a01005b0 0x7ff3a0195860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff39ed9d700 1 -- 172.21.15.57:0/3198160912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880095f0 con 0x7ff3a01057f0 2023-03-02T10:56:47.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff39ed9d700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3a01057f0 0x7ff3a019ce10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff398007f10 tx=0x7ff39800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:47.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.190+0000 7ff3977fe700 1 -- 172.21.15.57:0/3198160912 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398017070 con 0x7ff3a01057f0 2023-03-02T10:56:47.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.191+0000 7ff3977fe700 1 -- 172.21.15.57:0/3198160912 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff39800f040 con 0x7ff3a01057f0 2023-03-02T10:56:47.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.191+0000 7ff3a49ff700 1 -- 172.21.15.57:0/3198160912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a010b470 con 0x7ff3a01057f0 2023-03-02T10:56:47.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.191+0000 7ff3977fe700 1 -- 172.21.15.57:0/3198160912 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398005680 con 0x7ff3a01057f0 2023-03-02T10:56:47.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.191+0000 7ff3a49ff700 1 -- 172.21.15.57:0/3198160912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a010b2e0 con 0x7ff3a01057f0 2023-03-02T10:56:47.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.192+0000 7ff3a49ff700 1 -- 172.21.15.57:0/3198160912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a00fbb40 con 0x7ff3a01057f0 2023-03-02T10:56:47.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.193+0000 7ff3977fe700 1 -- 172.21.15.57:0/3198160912 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7ff398004cb0 con 0x7ff3a01057f0 2023-03-02T10:56:47.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.194+0000 7ff3977fe700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff38c09b420 0x7ff38c09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:47.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.194+0000 7ff3977fe700 1 -- 172.21.15.57:0/3198160912 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff3980c47e0 con 0x7ff3a01057f0 2023-03-02T10:56:47.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.195+0000 7ff39e59c700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff38c09b420 0x7ff38c09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:47.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.195+0000 7ff39e59c700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff38c09b420 0x7ff38c09d8d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff390005950 tx=0x7ff39000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:47.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.199+0000 7ff3977fe700 1 -- 172.21.15.57:0/3198160912 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7ff398090110 con 0x7ff3a01057f0 2023-03-02T10:56:47.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.443+0000 7ff3a49ff700 1 -- 172.21.15.57:0/3198160912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3a00613e0 con 0x7ff3a01057f0 2023-03-02T10:56:47.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.444+0000 7ff3977fe700 1 -- 172.21.15.57:0/3198160912 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10828 (secure 0 0 0) 0x7ff398093730 con 0x7ff3a01057f0 2023-03-02T10:56:47.446 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:47.446 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-02T10:55:10.601054+0000","modified":"2023-03-02T10:55:17.554509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24520,"mds_2":24505,"mds_3":24493,"mds_4":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14634":{"gid":14634,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6841/3731858530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6840","nonce":3731858530},{"type":"v1","addr":"172.21.15.57:6841","nonce":3731858530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"e","rank":4,"incarnation":24,"state":"up:active","state_seq":9,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24505":{"gid":24505,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/316639764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":316639764},{"type":"v1","addr":"172.21.15.122:6839","nonce":316639764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-02T10:56:47.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.446+0000 7ff3a49ff700 1 -- 172.21.15.57:0/3198160912 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff38c09b420 msgr2=0x7ff38c09d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.446+0000 7ff3a49ff700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff38c09b420 0x7ff38c09d8d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff390005950 tx=0x7ff39000b410 comp rx=0 tx=0).stop 2023-03-02T10:56:47.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.447+0000 7ff3a49ff700 1 -- 172.21.15.57:0/3198160912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3a01057f0 msgr2=0x7ff3a019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.447+0000 7ff3a49ff700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3a01057f0 0x7ff3a019ce10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff398007f10 tx=0x7ff39800d3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.447+0000 7ff3a49ff700 1 -- 172.21.15.57:0/3198160912 shutdown_connections 2023-03-02T10:56:47.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.447+0000 7ff3a49ff700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7ff38c09b420 0x7ff38c09d8d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.447+0000 7ff3a49ff700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3a01057f0 0x7ff3a019ce10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.447+0000 7ff3a49ff700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3a01005b0 0x7ff3a0195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.447+0000 7ff3a49ff700 1 --2- 172.21.15.57:0/3198160912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3a0102ed0 0x7ff3a0195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.447+0000 7ff3a49ff700 1 -- 172.21.15.57:0/3198160912 >> 172.21.15.57:0/3198160912 conn(0x7ff3a00f9fd0 msgr2=0x7ff3a01012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:47.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.447+0000 7ff3a49ff700 1 -- 172.21.15.57:0/3198160912 shutdown_connections 2023-03-02T10:56:47.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.447+0000 7ff3a49ff700 1 -- 172.21.15.57:0/3198160912 wait complete. 2023-03-02T10:56:47.449 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-03-02T10:56:47.463 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-03-02T10:56:47.463 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-03-02T10:56:47.464 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-02T10:56:47.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.617+0000 7f732b7ff700 1 -- 172.21.15.57:0/1568218680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73240ffac0 msgr2=0x7f73240ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.617+0000 7f732b7ff700 1 --2- 172.21.15.57:0/1568218680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73240ffac0 0x7f73240ffed0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7320009990 tx=0x7f7320009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.617+0000 7f732b7ff700 1 -- 172.21.15.57:0/1568218680 shutdown_connections 2023-03-02T10:56:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.617+0000 7f732b7ff700 1 --2- 172.21.15.57:0/1568218680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7324101700 0x7f7324107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.617+0000 7f732b7ff700 1 --2- 172.21.15.57:0/1568218680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73240ffac0 0x7f73240ffed0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.617+0000 7f732b7ff700 1 --2- 172.21.15.57:0/1568218680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7324100d50 0x7f73241011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.617+0000 7f732b7ff700 1 -- 172.21.15.57:0/1568218680 >> 172.21.15.57:0/1568218680 conn(0x7f73240fb0c0 msgr2=0x7f73240fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:47.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.617+0000 7f732b7ff700 1 -- 172.21.15.57:0/1568218680 shutdown_connections 2023-03-02T10:56:47.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.617+0000 7f732b7ff700 1 -- 172.21.15.57:0/1568218680 wait complete. 2023-03-02T10:56:47.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f732b7ff700 1 Processor -- start 2023-03-02T10:56:47.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f732b7ff700 1 -- start start 2023-03-02T10:56:47.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f732b7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73240ffac0 0x7f73241957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:47.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f732b7ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7324100d50 0x7f7324195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:47.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f732b7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7324101700 0x7f732419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f732b7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732419d350 con 0x7f73240ffac0 2023-03-02T10:56:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f732b7ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732419d490 con 0x7f7324100d50 2023-03-02T10:56:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f732b7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732419d620 con 0x7f7324101700 2023-03-02T10:56:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f732959b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73240ffac0 0x7f73241957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:47.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f732959b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73240ffac0 0x7f73241957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53940/0 (socket says 172.21.15.57:53940) 2023-03-02T10:56:47.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f732959b700 1 -- 172.21.15.57:0/944973940 learned_addr learned my addr 172.21.15.57:0/944973940 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:47.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.618+0000 7f7328d9a700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7324100d50 0x7f7324195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:47.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f7329d9c700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7324101700 0x7f732419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:47.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f732959b700 1 -- 172.21.15.57:0/944973940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7324101700 msgr2=0x7f732419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f732959b700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7324101700 0x7f732419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f732959b700 1 -- 172.21.15.57:0/944973940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7324100d50 msgr2=0x7f7324195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f732959b700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7324100d50 0x7f7324195d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f732959b700 1 -- 172.21.15.57:0/944973940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73200095f0 con 0x7f73240ffac0 2023-03-02T10:56:47.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f7328d9a700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7324100d50 0x7f7324195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:47.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f732959b700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73240ffac0 0x7f73241957d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f73200059d0 tx=0x7f732000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f731a7fc700 1 -- 172.21.15.57:0/944973940 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732001d070 con 0x7f73240ffac0 2023-03-02T10:56:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f732b7ff700 1 -- 172.21.15.57:0/944973940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732410b420 con 0x7f73240ffac0 2023-03-02T10:56:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f731a7fc700 1 -- 172.21.15.57:0/944973940 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f732000fd60 con 0x7f73240ffac0 2023-03-02T10:56:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f731a7fc700 1 -- 172.21.15.57:0/944973940 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320017650 con 0x7f73240ffac0 2023-03-02T10:56:47.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.619+0000 7f732b7ff700 1 -- 172.21.15.57:0/944973940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732410b290 con 0x7f73240ffac0 2023-03-02T10:56:47.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.620+0000 7f732b7ff700 1 -- 172.21.15.57:0/944973940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7324106ae0 con 0x7f73240ffac0 2023-03-02T10:56:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.621+0000 7f731a7fc700 1 -- 172.21.15.57:0/944973940 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f7320029030 con 0x7f73240ffac0 2023-03-02T10:56:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.622+0000 7f731a7fc700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f731009b3a0 0x7f731009d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.622+0000 7f731a7fc700 1 -- 172.21.15.57:0/944973940 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f73200c6680 con 0x7f73240ffac0 2023-03-02T10:56:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.623+0000 7f7328d9a700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f731009b3a0 0x7f731009d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.623+0000 7f7328d9a700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f731009b3a0 0x7f731009d850 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7314009cb0 tx=0x7f7314009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.625+0000 7f731a7fc700 1 -- 172.21.15.57:0/944973940 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f7320091fe0 con 0x7f73240ffac0 2023-03-02T10:56:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:47 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3294301241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:47 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1596799117' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:47 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3294301241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:47 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1596799117' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:47.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.818+0000 7f732b7ff700 1 -- 172.21.15.57:0/944973940 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73240613f0 con 0x7f731009b3a0 2023-03-02T10:56:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.829+0000 7f731a7fc700 1 -- 172.21.15.57:0/944973940 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344331 (secure 0 0 0) 0x7f73240613f0 con 0x7f731009b3a0 2023-03-02T10:56:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:47.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 -- 172.21.15.57:0/944973940 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f731009b3a0 msgr2=0x7f731009d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f731009b3a0 0x7f731009d850 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7314009cb0 tx=0x7f7314009260 comp rx=0 tx=0).stop 2023-03-02T10:56:47.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 -- 172.21.15.57:0/944973940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73240ffac0 msgr2=0x7f73241957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:47.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73240ffac0 0x7f73241957d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f73200059d0 tx=0x7f732000f510 comp rx=0 tx=0).stop 2023-03-02T10:56:47.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 -- 172.21.15.57:0/944973940 shutdown_connections 2023-03-02T10:56:47.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f731009b3a0 0x7f731009d850 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7324101700 0x7f732419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73240ffac0 0x7f73241957d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 --2- 172.21.15.57:0/944973940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7324100d50 0x7f7324195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:47.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 -- 172.21.15.57:0/944973940 >> 172.21.15.57:0/944973940 conn(0x7f73240fb0c0 msgr2=0x7f73240fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:47.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 -- 172.21.15.57:0/944973940 shutdown_connections 2023-03-02T10:56:47.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:47.833+0000 7f732b7ff700 1 -- 172.21.15.57:0/944973940 wait complete. 2023-03-02T10:56:47.837 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-03-02T10:56:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:47 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3294301241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:47 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1596799117' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:47.849 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2023-03-02T10:56:47.282349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659900,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1009,"num_read_kb":644,"num_write":427,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1181469,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":853,"ondisk_log_size":853,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":80528,"kb_used_data":11504,"kb_used_omap":0,"kb_used_meta":68928,"kb_avail":1124861296,"statfs":{"total":1151940427776,"available":1151857967104,"internally_reserved":0,"allocated":11780096,"data_stored":7337619,"data_compressed":110277,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":70582272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5664,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":56,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002910"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.303694+0000","last_change":"2023-03-02T10:55:10.630366+0000","last_active":"2023-03-02T10:56:19.303694+0000","last_peered":"2023-03-02T10:56:19.303694+0000","last_clean":"2023-03-02T10:56:19.303694+0000","last_became_active":"2023-03-02T10:55:10.630035+0000","last_became_peered":"2023-03-02T10:55:10.630035+0000","last_unstale":"2023-03-02T10:56:19.303694+0000","last_undegraded":"2023-03-02T10:56:19.303694+0000","last_fullsized":"2023-03-02T10:56:19.303694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:00:41.832233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298589+0000","last_change":"2023-03-02T10:55:10.628111+0000","last_active":"2023-03-02T10:56:19.298589+0000","last_peered":"2023-03-02T10:56:19.298589+0000","last_clean":"2023-03-02T10:56:19.298589+0000","last_became_active":"2023-03-02T10:55:10.626879+0000","last_became_peered":"2023-03-02T10:55:10.626879+0000","last_unstale":"2023-03-02T10:56:19.298589+0000","last_undegraded":"2023-03-02T10:56:19.298589+0000","last_fullsized":"2023-03-02T10:56:19.298589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:08:52.120684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302330+0000","last_change":"2023-03-02T10:55:10.624392+0000","last_active":"2023-03-02T10:56:19.302330+0000","last_peered":"2023-03-02T10:56:19.302330+0000","last_clean":"2023-03-02T10:56:19.302330+0000","last_became_active":"2023-03-02T10:55:10.624095+0000","last_became_peered":"2023-03-02T10:55:10.624095+0000","last_unstale":"2023-03-02T10:56:19.302330+0000","last_undegraded":"2023-03-02T10:56:19.302330+0000","last_fullsized":"2023-03-02T10:56:19.302330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:30:55.174383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.285450+0000","last_change":"2023-03-02T10:55:10.619950+0000","last_active":"2023-03-02T10:56:19.285450+0000","last_peered":"2023-03-02T10:56:19.285450+0000","last_clean":"2023-03-02T10:56:19.285450+0000","last_became_active":"2023-03-02T10:55:10.619543+0000","last_became_peered":"2023-03-02T10:55:10.619543+0000","last_unstale":"2023-03-02T10:56:19.285450+0000","last_undegraded":"2023-03-02T10:56:19.285450+0000","last_fullsized":"2023-03-02T10:56:19.285450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:08:02.321422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291593+0000","last_change":"2023-03-02T10:55:10.626403+0000","last_active":"2023-03-02T10:56:19.291593+0000","last_peered":"2023-03-02T10:56:19.291593+0000","last_clean":"2023-03-02T10:56:19.291593+0000","last_became_active":"2023-03-02T10:55:10.626062+0000","last_became_peered":"2023-03-02T10:55:10.626062+0000","last_unstale":"2023-03-02T10:56:19.291593+0000","last_undegraded":"2023-03-02T10:56:19.291593+0000","last_fullsized":"2023-03-02T10:56:19.291593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:35:06.798468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.299050+0000","last_change":"2023-03-02T10:55:10.623903+0000","last_active":"2023-03-02T10:56:19.299050+0000","last_peered":"2023-03-02T10:56:19.299050+0000","last_clean":"2023-03-02T10:56:19.299050+0000","last_became_active":"2023-03-02T10:55:10.623422+0000","last_became_peered":"2023-03-02T10:55:10.623422+0000","last_unstale":"2023-03-02T10:56:19.299050+0000","last_undegraded":"2023-03-02T10:56:19.299050+0000","last_fullsized":"2023-03-02T10:56:19.299050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:21.066552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.289681+0000","last_change":"2023-03-02T10:55:10.633210+0000","last_active":"2023-03-02T10:56:19.289681+0000","last_peered":"2023-03-02T10:56:19.289681+0000","last_clean":"2023-03-02T10:56:19.289681+0000","last_became_active":"2023-03-02T10:55:10.632898+0000","last_became_peered":"2023-03-02T10:55:10.632898+0000","last_unstale":"2023-03-02T10:56:19.289681+0000","last_undegraded":"2023-03-02T10:56:19.289681+0000","last_fullsized":"2023-03-02T10:56:19.289681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:04.043328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292969+0000","last_change":"2023-03-02T10:55:10.634427+0000","last_active":"2023-03-02T10:56:19.292969+0000","last_peered":"2023-03-02T10:56:19.292969+0000","last_clean":"2023-03-02T10:56:19.292969+0000","last_became_active":"2023-03-02T10:55:10.634159+0000","last_became_peered":"2023-03-02T10:55:10.634159+0000","last_unstale":"2023-03-02T10:56:19.292969+0000","last_undegraded":"2023-03-02T10:56:19.292969+0000","last_fullsized":"2023-03-02T10:56:19.292969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:59:09.344860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302795+0000","last_change":"2023-03-02T10:55:10.622775+0000","last_active":"2023-03-02T10:56:19.302795+0000","last_peered":"2023-03-02T10:56:19.302795+0000","last_clean":"2023-03-02T10:56:19.302795+0000","last_became_active":"2023-03-02T10:55:10.616254+0000","last_became_peered":"2023-03-02T10:55:10.616254+0000","last_unstale":"2023-03-02T10:56:19.302795+0000","last_undegraded":"2023-03-02T10:56:19.302795+0000","last_fullsized":"2023-03-02T10:56:19.302795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:01:56.832512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.301052+0000","last_change":"2023-03-02T10:55:10.620311+0000","last_active":"2023-03-02T10:56:19.301052+0000","last_peered":"2023-03-02T10:56:19.301052+0000","last_clean":"2023-03-02T10:56:19.301052+0000","last_became_active":"2023-03-02T10:55:10.620028+0000","last_became_peered":"2023-03-02T10:55:10.620028+0000","last_unstale":"2023-03-02T10:56:19.301052+0000","last_undegraded":"2023-03-02T10:56:19.301052+0000","last_fullsized":"2023-03-02T10:56:19.301052+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:16:13.770927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302566+0000","last_change":"2023-03-02T10:55:10.621316+0000","last_active":"2023-03-02T10:56:19.302566+0000","last_peered":"2023-03-02T10:56:19.302566+0000","last_clean":"2023-03-02T10:56:19.302566+0000","last_became_active":"2023-03-02T10:55:10.620803+0000","last_became_peered":"2023-03-02T10:55:10.620803+0000","last_unstale":"2023-03-02T10:56:19.302566+0000","last_undegraded":"2023-03-02T10:56:19.302566+0000","last_fullsized":"2023-03-02T10:56:19.302566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:20:18.434138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297665+0000","last_change":"2023-03-02T10:55:10.625305+0000","last_active":"2023-03-02T10:56:19.297665+0000","last_peered":"2023-03-02T10:56:19.297665+0000","last_clean":"2023-03-02T10:56:19.297665+0000","last_became_active":"2023-03-02T10:55:10.625025+0000","last_became_peered":"2023-03-02T10:55:10.625025+0000","last_unstale":"2023-03-02T10:56:19.297665+0000","last_undegraded":"2023-03-02T10:56:19.297665+0000","last_fullsized":"2023-03-02T10:56:19.297665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:35:40.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292434+0000","last_change":"2023-03-02T10:55:10.626408+0000","last_active":"2023-03-02T10:56:19.292434+0000","last_peered":"2023-03-02T10:56:19.292434+0000","last_clean":"2023-03-02T10:56:19.292434+0000","last_became_active":"2023-03-02T10:55:10.625510+0000","last_became_peered":"2023-03-02T10:55:10.625510+0000","last_unstale":"2023-03-02T10:56:19.292434+0000","last_undegraded":"2023-03-02T10:56:19.292434+0000","last_fullsized":"2023-03-02T10:56:19.292434+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:59:10.622871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291632+0000","last_change":"2023-03-02T10:55:10.629323+0000","last_active":"2023-03-02T10:56:19.291632+0000","last_peered":"2023-03-02T10:56:19.291632+0000","last_clean":"2023-03-02T10:56:19.291632+0000","last_became_active":"2023-03-02T10:55:10.627038+0000","last_became_peered":"2023-03-02T10:55:10.627038+0000","last_unstale":"2023-03-02T10:56:19.291632+0000","last_undegraded":"2023-03-02T10:56:19.291632+0000","last_fullsized":"2023-03-02T10:56:19.291632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:57:21.241810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297389+0000","last_change":"2023-03-02T10:55:10.624312+0000","last_active":"2023-03-02T10:56:19.297389+0000","last_peered":"2023-03-02T10:56:19.297389+0000","last_clean":"2023-03-02T10:56:19.297389+0000","last_became_active":"2023-03-02T10:55:10.623997+0000","last_became_peered":"2023-03-02T10:55:10.623997+0000","last_unstale":"2023-03-02T10:56:19.297389+0000","last_undegraded":"2023-03-02T10:56:19.297389+0000","last_fullsized":"2023-03-02T10:56:19.297389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:09:43.683852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302825+0000","last_change":"2023-03-02T10:55:10.622473+0000","last_active":"2023-03-02T10:56:19.302825+0000","last_peered":"2023-03-02T10:56:19.302825+0000","last_clean":"2023-03-02T10:56:19.302825+0000","last_became_active":"2023-03-02T10:55:10.622148+0000","last_became_peered":"2023-03-02T10:55:10.622148+0000","last_unstale":"2023-03-02T10:56:19.302825+0000","last_undegraded":"2023-03-02T10:56:19.302825+0000","last_fullsized":"2023-03-02T10:56:19.302825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:54:52.132792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.303973+0000","last_change":"2023-03-02T10:55:10.630380+0000","last_active":"2023-03-02T10:56:19.303973+0000","last_peered":"2023-03-02T10:56:19.303973+0000","last_clean":"2023-03-02T10:56:19.303973+0000","last_became_active":"2023-03-02T10:55:10.630088+0000","last_became_peered":"2023-03-02T10:55:10.630088+0000","last_unstale":"2023-03-02T10:56:19.303973+0000","last_undegraded":"2023-03-02T10:56:19.303973+0000","last_fullsized":"2023-03-02T10:56:19.303973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:08:58.983902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.293634+0000","last_change":"2023-03-02T10:55:10.620547+0000","last_active":"2023-03-02T10:56:19.293634+0000","last_peered":"2023-03-02T10:56:19.293634+0000","last_clean":"2023-03-02T10:56:19.293634+0000","last_became_active":"2023-03-02T10:55:10.620225+0000","last_became_peered":"2023-03-02T10:55:10.620225+0000","last_unstale":"2023-03-02T10:56:19.293634+0000","last_undegraded":"2023-03-02T10:56:19.293634+0000","last_fullsized":"2023-03-02T10:56:19.293634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:47:38.669432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.285943+0000","last_change":"2023-03-02T10:55:10.625108+0000","last_active":"2023-03-02T10:56:19.285943+0000","last_peered":"2023-03-02T10:56:19.285943+0000","last_clean":"2023-03-02T10:56:19.285943+0000","last_became_active":"2023-03-02T10:55:10.624797+0000","last_became_peered":"2023-03-02T10:55:10.624797+0000","last_unstale":"2023-03-02T10:56:19.285943+0000","last_undegraded":"2023-03-02T10:56:19.285943+0000","last_fullsized":"2023-03-02T10:56:19.285943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:06:57.777889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":116,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:44.641909+0000","last_change":"2023-03-02T10:55:10.146541+0000","last_active":"2023-03-02T10:56:44.641909+0000","last_peered":"2023-03-02T10:56:44.641909+0000","last_clean":"2023-03-02T10:56:44.641909+0000","last_became_active":"2023-03-02T10:55:10.146239+0000","last_became_peered":"2023-03-02T10:55:10.146239+0000","last_unstale":"2023-03-02T10:56:44.641909+0000","last_undegraded":"2023-03-02T10:56:44.641909+0000","last_fullsized":"2023-03-02T10:56:44.641909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:56:07.036002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.293417+0000","last_change":"2023-03-02T10:55:10.619811+0000","last_active":"2023-03-02T10:56:19.293417+0000","last_peered":"2023-03-02T10:56:19.293417+0000","last_clean":"2023-03-02T10:56:19.293417+0000","last_became_active":"2023-03-02T10:55:10.617190+0000","last_became_peered":"2023-03-02T10:55:10.617190+0000","last_unstale":"2023-03-02T10:56:19.293417+0000","last_undegraded":"2023-03-02T10:56:19.293417+0000","last_fullsized":"2023-03-02T10:56:19.293417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:20:52.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542992+0000","last_change":"2023-03-02T10:55:10.155970+0000","last_active":"2023-03-02T10:55:49.542992+0000","last_peered":"2023-03-02T10:55:49.542992+0000","last_clean":"2023-03-02T10:55:49.542992+0000","last_became_active":"2023-03-02T10:55:10.155667+0000","last_became_peered":"2023-03-02T10:55:10.155667+0000","last_unstale":"2023-03-02T10:55:49.542992+0000","last_undegraded":"2023-03-02T10:55:49.542992+0000","last_fullsized":"2023-03-02T10:55:49.542992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:46:36.366891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302580+0000","last_change":"2023-03-02T10:55:10.623738+0000","last_active":"2023-03-02T10:56:19.302580+0000","last_peered":"2023-03-02T10:56:19.302580+0000","last_clean":"2023-03-02T10:56:19.302580+0000","last_became_active":"2023-03-02T10:55:10.620543+0000","last_became_peered":"2023-03-02T10:55:10.620543+0000","last_unstale":"2023-03-02T10:56:19.302580+0000","last_undegraded":"2023-03-02T10:56:19.302580+0000","last_fullsized":"2023-03-02T10:56:19.302580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:44:46.238712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.148470+0000","last_change":"2023-03-02T10:55:51.148470+0000","last_active":"2023-03-02T10:55:51.148470+0000","last_peered":"2023-03-02T10:55:51.148470+0000","last_clean":"2023-03-02T10:55:51.148470+0000","last_became_active":"2023-03-02T10:55:50.544811+0000","last_became_peered":"2023-03-02T10:55:50.544811+0000","last_unstale":"2023-03-02T10:55:51.148470+0000","last_undegraded":"2023-03-02T10:55:51.148470+0000","last_fullsized":"2023-03-02T10:55:51.148470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:32:12.108148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.294276+0000","last_change":"2023-03-02T10:55:10.627844+0000","last_active":"2023-03-02T10:56:19.294276+0000","last_peered":"2023-03-02T10:56:19.294276+0000","last_clean":"2023-03-02T10:56:19.294276+0000","last_became_active":"2023-03-02T10:55:10.626972+0000","last_became_peered":"2023-03-02T10:55:10.626972+0000","last_unstale":"2023-03-02T10:56:19.294276+0000","last_undegraded":"2023-03-02T10:56:19.294276+0000","last_fullsized":"2023-03-02T10:56:19.294276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:36:58.650285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537357+0000","last_change":"2023-03-02T10:55:10.153277+0000","last_active":"2023-03-02T10:55:49.537357+0000","last_peered":"2023-03-02T10:55:49.537357+0000","last_clean":"2023-03-02T10:55:49.537357+0000","last_became_active":"2023-03-02T10:55:10.152983+0000","last_became_peered":"2023-03-02T10:55:10.152983+0000","last_unstale":"2023-03-02T10:55:49.537357+0000","last_undegraded":"2023-03-02T10:55:49.537357+0000","last_fullsized":"2023-03-02T10:55:49.537357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:15.045107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298653+0000","last_change":"2023-03-02T10:55:10.630295+0000","last_active":"2023-03-02T10:56:19.298653+0000","last_peered":"2023-03-02T10:56:19.298653+0000","last_clean":"2023-03-02T10:56:19.298653+0000","last_became_active":"2023-03-02T10:55:10.629004+0000","last_became_peered":"2023-03-02T10:55:10.629004+0000","last_unstale":"2023-03-02T10:56:19.298653+0000","last_undegraded":"2023-03-02T10:56:19.298653+0000","last_fullsized":"2023-03-02T10:56:19.298653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:05:51.414347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'7","reported_seq":110,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:41.687313+0000","last_change":"2023-03-02T10:55:10.153222+0000","last_active":"2023-03-02T10:56:41.687313+0000","last_peered":"2023-03-02T10:56:41.687313+0000","last_clean":"2023-03-02T10:56:41.687313+0000","last_became_active":"2023-03-02T10:55:10.152928+0000","last_became_peered":"2023-03-02T10:55:10.152928+0000","last_unstale":"2023-03-02T10:56:41.687313+0000","last_undegraded":"2023-03-02T10:56:41.687313+0000","last_fullsized":"2023-03-02T10:56:41.687313+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:12:56.648713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.281881+0000","last_change":"2023-03-02T10:55:10.617722+0000","last_active":"2023-03-02T10:56:19.281881+0000","last_peered":"2023-03-02T10:56:19.281881+0000","last_clean":"2023-03-02T10:56:19.281881+0000","last_became_active":"2023-03-02T10:55:10.617425+0000","last_became_peered":"2023-03-02T10:55:10.617425+0000","last_unstale":"2023-03-02T10:56:19.281881+0000","last_undegraded":"2023-03-02T10:56:19.281881+0000","last_fullsized":"2023-03-02T10:56:19.281881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:57:37.397568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:50.806747+0000","last_change":"2023-03-02T10:55:50.806747+0000","last_active":"2023-03-02T10:55:50.806747+0000","last_peered":"2023-03-02T10:55:50.806747+0000","last_clean":"2023-03-02T10:55:50.806747+0000","last_became_active":"2023-03-02T10:55:50.544008+0000","last_became_peered":"2023-03-02T10:55:50.544008+0000","last_unstale":"2023-03-02T10:55:50.806747+0000","last_undegraded":"2023-03-02T10:55:50.806747+0000","last_fullsized":"2023-03-02T10:55:50.806747+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:21:20.672207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298392+0000","last_change":"2023-03-02T10:55:10.628418+0000","last_active":"2023-03-02T10:56:19.298392+0000","last_peered":"2023-03-02T10:56:19.298392+0000","last_clean":"2023-03-02T10:56:19.298392+0000","last_became_active":"2023-03-02T10:55:10.627715+0000","last_became_peered":"2023-03-02T10:55:10.627715+0000","last_unstale":"2023-03-02T10:56:19.298392+0000","last_undegraded":"2023-03-02T10:56:19.298392+0000","last_fullsized":"2023-03-02T10:56:19.298392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:16:59.756440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539748+0000","last_change":"2023-03-02T10:55:10.158875+0000","last_active":"2023-03-02T10:55:49.539748+0000","last_peered":"2023-03-02T10:55:49.539748+0000","last_clean":"2023-03-02T10:55:49.539748+0000","last_became_active":"2023-03-02T10:55:10.157653+0000","last_became_peered":"2023-03-02T10:55:10.157653+0000","last_unstale":"2023-03-02T10:55:49.539748+0000","last_undegraded":"2023-03-02T10:55:49.539748+0000","last_fullsized":"2023-03-02T10:55:49.539748+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:50:03.808602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292893+0000","last_change":"2023-03-02T10:55:10.634280+0000","last_active":"2023-03-02T10:56:19.292893+0000","last_peered":"2023-03-02T10:56:19.292893+0000","last_clean":"2023-03-02T10:56:19.292893+0000","last_became_active":"2023-03-02T10:55:10.633764+0000","last_became_peered":"2023-03-02T10:55:10.633764+0000","last_unstale":"2023-03-02T10:56:19.292893+0000","last_undegraded":"2023-03-02T10:56:19.292893+0000","last_fullsized":"2023-03-02T10:56:19.292893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:17:25.110036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541628+0000","last_change":"2023-03-02T10:55:10.154532+0000","last_active":"2023-03-02T10:55:49.541628+0000","last_peered":"2023-03-02T10:55:49.541628+0000","last_clean":"2023-03-02T10:55:49.541628+0000","last_became_active":"2023-03-02T10:55:10.152116+0000","last_became_peered":"2023-03-02T10:55:10.152116+0000","last_unstale":"2023-03-02T10:55:49.541628+0000","last_undegraded":"2023-03-02T10:55:49.541628+0000","last_fullsized":"2023-03-02T10:55:49.541628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:19:50.439666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291548+0000","last_change":"2023-03-02T10:55:10.628790+0000","last_active":"2023-03-02T10:56:19.291548+0000","last_peered":"2023-03-02T10:56:19.291548+0000","last_clean":"2023-03-02T10:56:19.291548+0000","last_became_active":"2023-03-02T10:55:10.628452+0000","last_became_peered":"2023-03-02T10:55:10.628452+0000","last_unstale":"2023-03-02T10:56:19.291548+0000","last_undegraded":"2023-03-02T10:56:19.291548+0000","last_fullsized":"2023-03-02T10:56:19.291548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:08:30.061925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":193,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:43.689668+0000","last_change":"2023-03-02T10:55:10.152684+0000","last_active":"2023-03-02T10:56:43.689668+0000","last_peered":"2023-03-02T10:56:43.689668+0000","last_clean":"2023-03-02T10:56:43.689668+0000","last_became_active":"2023-03-02T10:55:10.152184+0000","last_became_peered":"2023-03-02T10:55:10.152184+0000","last_unstale":"2023-03-02T10:56:43.689668+0000","last_undegraded":"2023-03-02T10:56:43.689668+0000","last_fullsized":"2023-03-02T10:56:43.689668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:39:21.100760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296883+0000","last_change":"2023-03-02T10:55:10.625990+0000","last_active":"2023-03-02T10:56:19.296883+0000","last_peered":"2023-03-02T10:56:19.296883+0000","last_clean":"2023-03-02T10:56:19.296883+0000","last_became_active":"2023-03-02T10:55:10.625677+0000","last_became_peered":"2023-03-02T10:55:10.625677+0000","last_unstale":"2023-03-02T10:56:19.296883+0000","last_undegraded":"2023-03-02T10:56:19.296883+0000","last_fullsized":"2023-03-02T10:56:19.296883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:08.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539232+0000","last_change":"2023-03-02T10:55:10.151541+0000","last_active":"2023-03-02T10:55:49.539232+0000","last_peered":"2023-03-02T10:55:49.539232+0000","last_clean":"2023-03-02T10:55:49.539232+0000","last_became_active":"2023-03-02T10:55:10.151262+0000","last_became_peered":"2023-03-02T10:55:10.151262+0000","last_unstale":"2023-03-02T10:55:49.539232+0000","last_undegraded":"2023-03-02T10:55:49.539232+0000","last_fullsized":"2023-03-02T10:55:49.539232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:00:49.821191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298994+0000","last_change":"2023-03-02T10:55:10.629541+0000","last_active":"2023-03-02T10:56:19.298994+0000","last_peered":"2023-03-02T10:56:19.298994+0000","last_clean":"2023-03-02T10:56:19.298994+0000","last_became_active":"2023-03-02T10:55:10.627473+0000","last_became_peered":"2023-03-02T10:55:10.627473+0000","last_unstale":"2023-03-02T10:56:19.298994+0000","last_undegraded":"2023-03-02T10:56:19.298994+0000","last_fullsized":"2023-03-02T10:56:19.298994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:22:52.995113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542098+0000","last_change":"2023-03-02T10:55:10.152615+0000","last_active":"2023-03-02T10:55:49.542098+0000","last_peered":"2023-03-02T10:55:49.542098+0000","last_clean":"2023-03-02T10:55:49.542098+0000","last_became_active":"2023-03-02T10:55:10.152304+0000","last_became_peered":"2023-03-02T10:55:10.152304+0000","last_unstale":"2023-03-02T10:55:49.542098+0000","last_undegraded":"2023-03-02T10:55:49.542098+0000","last_fullsized":"2023-03-02T10:55:49.542098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:43:00.934520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.300447+0000","last_change":"2023-03-02T10:55:10.627653+0000","last_active":"2023-03-02T10:56:19.300447+0000","last_peered":"2023-03-02T10:56:19.300447+0000","last_clean":"2023-03-02T10:56:19.300447+0000","last_became_active":"2023-03-02T10:55:10.626570+0000","last_became_peered":"2023-03-02T10:55:10.626570+0000","last_unstale":"2023-03-02T10:56:19.300447+0000","last_undegraded":"2023-03-02T10:56:19.300447+0000","last_fullsized":"2023-03-02T10:56:19.300447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:40:39.311514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'35","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:43.690299+0000","last_change":"2023-03-02T10:55:10.149121+0000","last_active":"2023-03-02T10:56:43.690299+0000","last_peered":"2023-03-02T10:56:43.690299+0000","last_clean":"2023-03-02T10:56:43.690299+0000","last_became_active":"2023-03-02T10:55:10.148800+0000","last_became_peered":"2023-03-02T10:55:10.148800+0000","last_unstale":"2023-03-02T10:56:43.690299+0000","last_undegraded":"2023-03-02T10:56:43.690299+0000","last_fullsized":"2023-03-02T10:56:43.690299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:32:30.918248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61882,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":182,"num_read_kb":146,"num_write":37,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.294314+0000","last_change":"2023-03-02T10:55:10.625497+0000","last_active":"2023-03-02T10:56:19.294314+0000","last_peered":"2023-03-02T10:56:19.294314+0000","last_clean":"2023-03-02T10:56:19.294314+0000","last_became_active":"2023-03-02T10:55:10.625037+0000","last_became_peered":"2023-03-02T10:55:10.625037+0000","last_unstale":"2023-03-02T10:56:19.294314+0000","last_undegraded":"2023-03-02T10:56:19.294314+0000","last_fullsized":"2023-03-02T10:56:19.294314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:55:56.478111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534121+0000","last_change":"2023-03-02T10:55:10.148957+0000","last_active":"2023-03-02T10:55:49.534121+0000","last_peered":"2023-03-02T10:55:49.534121+0000","last_clean":"2023-03-02T10:55:49.534121+0000","last_became_active":"2023-03-02T10:55:10.148624+0000","last_became_peered":"2023-03-02T10:55:10.148624+0000","last_unstale":"2023-03-02T10:55:49.534121+0000","last_undegraded":"2023-03-02T10:55:49.534121+0000","last_fullsized":"2023-03-02T10:55:49.534121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:53:33.062648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296476+0000","last_change":"2023-03-02T10:55:10.633311+0000","last_active":"2023-03-02T10:56:19.296476+0000","last_peered":"2023-03-02T10:56:19.296476+0000","last_clean":"2023-03-02T10:56:19.296476+0000","last_became_active":"2023-03-02T10:55:10.632174+0000","last_became_peered":"2023-03-02T10:55:10.632174+0000","last_unstale":"2023-03-02T10:56:19.296476+0000","last_undegraded":"2023-03-02T10:56:19.296476+0000","last_fullsized":"2023-03-02T10:56:19.296476+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:50:47.536118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542053+0000","last_change":"2023-03-02T10:55:10.153392+0000","last_active":"2023-03-02T10:55:49.542053+0000","last_peered":"2023-03-02T10:55:49.542053+0000","last_clean":"2023-03-02T10:55:49.542053+0000","last_became_active":"2023-03-02T10:55:10.152513+0000","last_became_peered":"2023-03-02T10:55:10.152513+0000","last_unstale":"2023-03-02T10:55:49.542053+0000","last_undegraded":"2023-03-02T10:55:49.542053+0000","last_fullsized":"2023-03-02T10:55:49.542053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:26:40.675118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.299896+0000","last_change":"2023-03-02T10:55:10.631953+0000","last_active":"2023-03-02T10:56:19.299896+0000","last_peered":"2023-03-02T10:56:19.299896+0000","last_clean":"2023-03-02T10:56:19.299896+0000","last_became_active":"2023-03-02T10:55:10.631624+0000","last_became_peered":"2023-03-02T10:55:10.631624+0000","last_unstale":"2023-03-02T10:56:19.299896+0000","last_undegraded":"2023-03-02T10:56:19.299896+0000","last_fullsized":"2023-03-02T10:56:19.299896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:15:20.136421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":110,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:41.689782+0000","last_change":"2023-03-02T10:55:10.150597+0000","last_active":"2023-03-02T10:56:41.689782+0000","last_peered":"2023-03-02T10:56:41.689782+0000","last_clean":"2023-03-02T10:56:41.689782+0000","last_became_active":"2023-03-02T10:55:10.150024+0000","last_became_peered":"2023-03-02T10:55:10.150024+0000","last_unstale":"2023-03-02T10:56:41.689782+0000","last_undegraded":"2023-03-02T10:56:41.689782+0000","last_fullsized":"2023-03-02T10:56:41.689782+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:30.043240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291417+0000","last_change":"2023-03-02T10:55:10.633052+0000","last_active":"2023-03-02T10:56:19.291417+0000","last_peered":"2023-03-02T10:56:19.291417+0000","last_clean":"2023-03-02T10:56:19.291417+0000","last_became_active":"2023-03-02T10:55:10.632766+0000","last_became_peered":"2023-03-02T10:55:10.632766+0000","last_unstale":"2023-03-02T10:56:19.291417+0000","last_undegraded":"2023-03-02T10:56:19.291417+0000","last_fullsized":"2023-03-02T10:56:19.291417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:55.079556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.536268+0000","last_change":"2023-03-02T10:55:10.154559+0000","last_active":"2023-03-02T10:55:49.536268+0000","last_peered":"2023-03-02T10:55:49.536268+0000","last_clean":"2023-03-02T10:55:49.536268+0000","last_became_active":"2023-03-02T10:55:10.154058+0000","last_became_peered":"2023-03-02T10:55:10.154058+0000","last_unstale":"2023-03-02T10:55:49.536268+0000","last_undegraded":"2023-03-02T10:55:49.536268+0000","last_fullsized":"2023-03-02T10:55:49.536268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:23:26.823020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298189+0000","last_change":"2023-03-02T10:55:10.622951+0000","last_active":"2023-03-02T10:56:19.298189+0000","last_peered":"2023-03-02T10:56:19.298189+0000","last_clean":"2023-03-02T10:56:19.298189+0000","last_became_active":"2023-03-02T10:55:10.622643+0000","last_became_peered":"2023-03-02T10:55:10.622643+0000","last_unstale":"2023-03-02T10:56:19.298189+0000","last_undegraded":"2023-03-02T10:56:19.298189+0000","last_fullsized":"2023-03-02T10:56:19.298189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:53:05.459021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:50.547995+0000","last_change":"2023-03-02T10:55:50.547995+0000","last_active":"2023-03-02T10:55:50.547995+0000","last_peered":"2023-03-02T10:55:50.547995+0000","last_clean":"2023-03-02T10:55:50.547995+0000","last_became_active":"2023-03-02T10:55:50.541460+0000","last_became_peered":"2023-03-02T10:55:50.541460+0000","last_unstale":"2023-03-02T10:55:50.547995+0000","last_undegraded":"2023-03-02T10:55:50.547995+0000","last_fullsized":"2023-03-02T10:55:50.547995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:02:50.853731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.299636+0000","last_change":"2023-03-02T10:55:10.633149+0000","last_active":"2023-03-02T10:56:19.299636+0000","last_peered":"2023-03-02T10:56:19.299636+0000","last_clean":"2023-03-02T10:56:19.299636+0000","last_became_active":"2023-03-02T10:55:10.632816+0000","last_became_peered":"2023-03-02T10:55:10.632816+0000","last_unstale":"2023-03-02T10:56:19.299636+0000","last_undegraded":"2023-03-02T10:56:19.299636+0000","last_fullsized":"2023-03-02T10:56:19.299636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:25:41.585257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533012+0000","last_change":"2023-03-02T10:55:10.150486+0000","last_active":"2023-03-02T10:55:49.533012+0000","last_peered":"2023-03-02T10:55:49.533012+0000","last_clean":"2023-03-02T10:55:49.533012+0000","last_became_active":"2023-03-02T10:55:10.150186+0000","last_became_peered":"2023-03-02T10:55:10.150186+0000","last_unstale":"2023-03-02T10:55:49.533012+0000","last_undegraded":"2023-03-02T10:55:49.533012+0000","last_fullsized":"2023-03-02T10:55:49.533012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:06:18.637162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292486+0000","last_change":"2023-03-02T10:55:10.628622+0000","last_active":"2023-03-02T10:56:19.292486+0000","last_peered":"2023-03-02T10:56:19.292486+0000","last_clean":"2023-03-02T10:56:19.292486+0000","last_became_active":"2023-03-02T10:55:10.628258+0000","last_became_peered":"2023-03-02T10:55:10.628258+0000","last_unstale":"2023-03-02T10:56:19.292486+0000","last_undegraded":"2023-03-02T10:56:19.292486+0000","last_fullsized":"2023-03-02T10:56:19.292486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:46.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":72,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:43.640833+0000","last_change":"2023-03-02T10:55:51.151512+0000","last_active":"2023-03-02T10:56:43.640833+0000","last_peered":"2023-03-02T10:56:43.640833+0000","last_clean":"2023-03-02T10:56:43.640833+0000","last_became_active":"2023-03-02T10:55:50.544349+0000","last_became_peered":"2023-03-02T10:55:50.544349+0000","last_unstale":"2023-03-02T10:56:43.640833+0000","last_undegraded":"2023-03-02T10:56:43.640833+0000","last_fullsized":"2023-03-02T10:56:43.640833+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:13.679666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.290561+0000","last_change":"2023-03-02T10:55:51.092083+0000","last_active":"2023-03-02T10:56:19.290561+0000","last_peered":"2023-03-02T10:56:19.290561+0000","last_clean":"2023-03-02T10:56:19.290561+0000","last_became_active":"2023-03-02T10:55:51.091536+0000","last_became_peered":"2023-03-02T10:55:51.091536+0000","last_unstale":"2023-03-02T10:56:19.290561+0000","last_undegraded":"2023-03-02T10:56:19.290561+0000","last_fullsized":"2023-03-02T10:56:19.290561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:18:38.983021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298285+0000","last_change":"2023-03-02T10:55:10.613814+0000","last_active":"2023-03-02T10:56:19.298285+0000","last_peered":"2023-03-02T10:56:19.298285+0000","last_clean":"2023-03-02T10:56:19.298285+0000","last_became_active":"2023-03-02T10:55:10.613496+0000","last_became_peered":"2023-03-02T10:55:10.613496+0000","last_unstale":"2023-03-02T10:56:19.298285+0000","last_undegraded":"2023-03-02T10:56:19.298285+0000","last_fullsized":"2023-03-02T10:56:19.298285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:55:58.332549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:42.690391+0000","last_change":"2023-03-02T10:55:10.160751+0000","last_active":"2023-03-02T10:56:42.690391+0000","last_peered":"2023-03-02T10:56:42.690391+0000","last_clean":"2023-03-02T10:56:42.690391+0000","last_became_active":"2023-03-02T10:55:10.160433+0000","last_became_peered":"2023-03-02T10:55:10.160433+0000","last_unstale":"2023-03-02T10:56:42.690391+0000","last_undegraded":"2023-03-02T10:56:42.690391+0000","last_fullsized":"2023-03-02T10:56:42.690391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:11:23.326464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.301472+0000","last_change":"2023-03-02T10:55:10.619761+0000","last_active":"2023-03-02T10:56:19.301472+0000","last_peered":"2023-03-02T10:56:19.301472+0000","last_clean":"2023-03-02T10:56:19.301472+0000","last_became_active":"2023-03-02T10:55:10.617361+0000","last_became_peered":"2023-03-02T10:55:10.617361+0000","last_unstale":"2023-03-02T10:56:19.301472+0000","last_undegraded":"2023-03-02T10:56:19.301472+0000","last_fullsized":"2023-03-02T10:56:19.301472+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:26:55.492653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540413+0000","last_change":"2023-03-02T10:55:10.151553+0000","last_active":"2023-03-02T10:55:49.540413+0000","last_peered":"2023-03-02T10:55:49.540413+0000","last_clean":"2023-03-02T10:55:49.540413+0000","last_became_active":"2023-03-02T10:55:10.151369+0000","last_became_peered":"2023-03-02T10:55:10.151369+0000","last_unstale":"2023-03-02T10:55:49.540413+0000","last_undegraded":"2023-03-02T10:55:49.540413+0000","last_fullsized":"2023-03-02T10:55:49.540413+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:30:42.550362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":374,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539716+0000","last_change":"2023-03-02T10:54:06.270813+0000","last_active":"2023-03-02T10:55:49.539716+0000","last_peered":"2023-03-02T10:55:49.539716+0000","last_clean":"2023-03-02T10:55:49.539716+0000","last_became_active":"2023-03-02T10:54:06.270329+0000","last_became_peered":"2023-03-02T10:54:06.270329+0000","last_unstale":"2023-03-02T10:55:49.539716+0000","last_undegraded":"2023-03-02T10:55:49.539716+0000","last_fullsized":"2023-03-02T10:55:49.539716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_clean_scrub_stamp":"2023-03-02T10:51:04.207601+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:07.546806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.288665+0000","last_change":"2023-03-02T10:55:10.629032+0000","last_active":"2023-03-02T10:56:19.288665+0000","last_peered":"2023-03-02T10:56:19.288665+0000","last_clean":"2023-03-02T10:56:19.288665+0000","last_became_active":"2023-03-02T10:55:10.628696+0000","last_became_peered":"2023-03-02T10:55:10.628696+0000","last_unstale":"2023-03-02T10:56:19.288665+0000","last_undegraded":"2023-03-02T10:56:19.288665+0000","last_fullsized":"2023-03-02T10:56:19.288665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:32:58.399900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539930+0000","last_change":"2023-03-02T10:55:10.153240+0000","last_active":"2023-03-02T10:55:49.539930+0000","last_peered":"2023-03-02T10:55:49.539930+0000","last_clean":"2023-03-02T10:55:49.539930+0000","last_became_active":"2023-03-02T10:55:10.152977+0000","last_became_peered":"2023-03-02T10:55:10.152977+0000","last_unstale":"2023-03-02T10:55:49.539930+0000","last_undegraded":"2023-03-02T10:55:49.539930+0000","last_fullsized":"2023-03-02T10:55:49.539930+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:46:49.873113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537639+0000","last_change":"2023-03-02T10:55:10.154392+0000","last_active":"2023-03-02T10:55:49.537639+0000","last_peered":"2023-03-02T10:55:49.537639+0000","last_clean":"2023-03-02T10:55:49.537639+0000","last_became_active":"2023-03-02T10:55:10.154110+0000","last_became_peered":"2023-03-02T10:55:10.154110+0000","last_unstale":"2023-03-02T10:55:49.537639+0000","last_undegraded":"2023-03-02T10:55:49.537639+0000","last_fullsized":"2023-03-02T10:55:49.537639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:11:05.910487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291035+0000","last_change":"2023-03-02T10:55:10.627181+0000","last_active":"2023-03-02T10:56:19.291035+0000","last_peered":"2023-03-02T10:56:19.291035+0000","last_clean":"2023-03-02T10:56:19.291035+0000","last_became_active":"2023-03-02T10:55:10.626891+0000","last_became_peered":"2023-03-02T10:55:10.626891+0000","last_unstale":"2023-03-02T10:56:19.291035+0000","last_undegraded":"2023-03-02T10:56:19.291035+0000","last_fullsized":"2023-03-02T10:56:19.291035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:37.990553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:23.744621+0000","last_change":"2023-03-02T10:55:10.146146+0000","last_active":"2023-03-02T10:56:23.744621+0000","last_peered":"2023-03-02T10:56:23.744621+0000","last_clean":"2023-03-02T10:56:23.744621+0000","last_became_active":"2023-03-02T10:55:10.145824+0000","last_became_peered":"2023-03-02T10:55:10.145824+0000","last_unstale":"2023-03-02T10:56:23.744621+0000","last_undegraded":"2023-03-02T10:56:23.744621+0000","last_fullsized":"2023-03-02T10:56:23.744621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:05:35.846016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.287810+0000","last_change":"2023-03-02T10:55:10.636566+0000","last_active":"2023-03-02T10:56:19.287810+0000","last_peered":"2023-03-02T10:56:19.287810+0000","last_clean":"2023-03-02T10:56:19.287810+0000","last_became_active":"2023-03-02T10:55:10.636033+0000","last_became_peered":"2023-03-02T10:55:10.636033+0000","last_unstale":"2023-03-02T10:56:19.287810+0000","last_undegraded":"2023-03-02T10:56:19.287810+0000","last_fullsized":"2023-03-02T10:56:19.287810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:35:24.955628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540621+0000","last_change":"2023-03-02T10:55:10.156550+0000","last_active":"2023-03-02T10:55:49.540621+0000","last_peered":"2023-03-02T10:55:49.540621+0000","last_clean":"2023-03-02T10:55:49.540621+0000","last_became_active":"2023-03-02T10:55:10.156286+0000","last_became_peered":"2023-03-02T10:55:10.156286+0000","last_unstale":"2023-03-02T10:55:49.540621+0000","last_undegraded":"2023-03-02T10:55:49.540621+0000","last_fullsized":"2023-03-02T10:55:49.540621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:45:51.476117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297640+0000","last_change":"2023-03-02T10:55:10.631769+0000","last_active":"2023-03-02T10:56:19.297640+0000","last_peered":"2023-03-02T10:56:19.297640+0000","last_clean":"2023-03-02T10:56:19.297640+0000","last_became_active":"2023-03-02T10:55:10.631429+0000","last_became_peered":"2023-03-02T10:55:10.631429+0000","last_unstale":"2023-03-02T10:56:19.297640+0000","last_undegraded":"2023-03-02T10:56:19.297640+0000","last_fullsized":"2023-03-02T10:56:19.297640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:42:52.764994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534314+0000","last_change":"2023-03-02T10:55:10.152435+0000","last_active":"2023-03-02T10:55:49.534314+0000","last_peered":"2023-03-02T10:55:49.534314+0000","last_clean":"2023-03-02T10:55:49.534314+0000","last_became_active":"2023-03-02T10:55:10.152008+0000","last_became_peered":"2023-03-02T10:55:10.152008+0000","last_unstale":"2023-03-02T10:55:49.534314+0000","last_undegraded":"2023-03-02T10:55:49.534314+0000","last_fullsized":"2023-03-02T10:55:49.534314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:46:39.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.262937+0000","last_change":"2023-03-02T10:55:10.624337+0000","last_active":"2023-03-02T10:56:19.262937+0000","last_peered":"2023-03-02T10:56:19.262937+0000","last_clean":"2023-03-02T10:56:19.262937+0000","last_became_active":"2023-03-02T10:55:10.623979+0000","last_became_peered":"2023-03-02T10:55:10.623979+0000","last_unstale":"2023-03-02T10:56:19.262937+0000","last_undegraded":"2023-03-02T10:56:19.262937+0000","last_fullsized":"2023-03-02T10:56:19.262937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:14:39.173460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542638+0000","last_change":"2023-03-02T10:55:10.152406+0000","last_active":"2023-03-02T10:55:49.542638+0000","last_peered":"2023-03-02T10:55:49.542638+0000","last_clean":"2023-03-02T10:55:49.542638+0000","last_became_active":"2023-03-02T10:55:10.152026+0000","last_became_peered":"2023-03-02T10:55:10.152026+0000","last_unstale":"2023-03-02T10:55:49.542638+0000","last_undegraded":"2023-03-02T10:55:49.542638+0000","last_fullsized":"2023-03-02T10:55:49.542638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:49:17.617792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296326+0000","last_change":"2023-03-02T10:55:10.620061+0000","last_active":"2023-03-02T10:56:19.296326+0000","last_peered":"2023-03-02T10:56:19.296326+0000","last_clean":"2023-03-02T10:56:19.296326+0000","last_became_active":"2023-03-02T10:55:10.619753+0000","last_became_peered":"2023-03-02T10:55:10.619753+0000","last_unstale":"2023-03-02T10:56:19.296326+0000","last_undegraded":"2023-03-02T10:56:19.296326+0000","last_fullsized":"2023-03-02T10:56:19.296326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:40:02.479733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534006+0000","last_change":"2023-03-02T10:55:10.149827+0000","last_active":"2023-03-02T10:55:49.534006+0000","last_peered":"2023-03-02T10:55:49.534006+0000","last_clean":"2023-03-02T10:55:49.534006+0000","last_became_active":"2023-03-02T10:55:10.149522+0000","last_became_peered":"2023-03-02T10:55:10.149522+0000","last_unstale":"2023-03-02T10:55:49.534006+0000","last_undegraded":"2023-03-02T10:55:49.534006+0000","last_fullsized":"2023-03-02T10:55:49.534006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:23:27.072235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292559+0000","last_change":"2023-03-02T10:55:10.618992+0000","last_active":"2023-03-02T10:56:19.292559+0000","last_peered":"2023-03-02T10:56:19.292559+0000","last_clean":"2023-03-02T10:56:19.292559+0000","last_became_active":"2023-03-02T10:55:10.618678+0000","last_became_peered":"2023-03-02T10:55:10.618678+0000","last_unstale":"2023-03-02T10:56:19.292559+0000","last_undegraded":"2023-03-02T10:56:19.292559+0000","last_fullsized":"2023-03-02T10:56:19.292559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:33:26.966579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.321810+0000","last_change":"2023-03-02T10:55:51.321810+0000","last_active":"2023-03-02T10:55:51.321810+0000","last_peered":"2023-03-02T10:55:51.321810+0000","last_clean":"2023-03-02T10:55:51.321810+0000","last_became_active":"2023-03-02T10:55:50.544110+0000","last_became_peered":"2023-03-02T10:55:50.544110+0000","last_unstale":"2023-03-02T10:55:51.321810+0000","last_undegraded":"2023-03-02T10:55:51.321810+0000","last_fullsized":"2023-03-02T10:55:51.321810+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:59:33.358979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302786+0000","last_change":"2023-03-02T10:55:10.625524+0000","last_active":"2023-03-02T10:56:19.302786+0000","last_peered":"2023-03-02T10:56:19.302786+0000","last_clean":"2023-03-02T10:56:19.302786+0000","last_became_active":"2023-03-02T10:55:10.625249+0000","last_became_peered":"2023-03-02T10:55:10.625249+0000","last_unstale":"2023-03-02T10:56:19.302786+0000","last_undegraded":"2023-03-02T10:56:19.302786+0000","last_fullsized":"2023-03-02T10:56:19.302786+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:03:16.230549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:40.733254+0000","last_change":"2023-03-02T10:55:10.159691+0000","last_active":"2023-03-02T10:56:40.733254+0000","last_peered":"2023-03-02T10:56:40.733254+0000","last_clean":"2023-03-02T10:56:40.733254+0000","last_became_active":"2023-03-02T10:55:10.159360+0000","last_became_peered":"2023-03-02T10:55:10.159360+0000","last_unstale":"2023-03-02T10:56:40.733254+0000","last_undegraded":"2023-03-02T10:56:40.733254+0000","last_fullsized":"2023-03-02T10:56:40.733254+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:21:05.305932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302559+0000","last_change":"2023-03-02T10:55:10.621119+0000","last_active":"2023-03-02T10:56:19.302559+0000","last_peered":"2023-03-02T10:56:19.302559+0000","last_clean":"2023-03-02T10:56:19.302559+0000","last_became_active":"2023-03-02T10:55:10.620370+0000","last_became_peered":"2023-03-02T10:55:10.620370+0000","last_unstale":"2023-03-02T10:56:19.302559+0000","last_undegraded":"2023-03-02T10:56:19.302559+0000","last_fullsized":"2023-03-02T10:56:19.302559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:33:20.678615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541953+0000","last_change":"2023-03-02T10:55:10.155403+0000","last_active":"2023-03-02T10:55:49.541953+0000","last_peered":"2023-03-02T10:55:49.541953+0000","last_clean":"2023-03-02T10:55:49.541953+0000","last_became_active":"2023-03-02T10:55:10.152547+0000","last_became_peered":"2023-03-02T10:55:10.152547+0000","last_unstale":"2023-03-02T10:55:49.541953+0000","last_undegraded":"2023-03-02T10:55:49.541953+0000","last_fullsized":"2023-03-02T10:55:49.541953+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:18:30.564037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291964+0000","last_change":"2023-03-02T10:55:51.094932+0000","last_active":"2023-03-02T10:56:19.291964+0000","last_peered":"2023-03-02T10:56:19.291964+0000","last_clean":"2023-03-02T10:56:19.291964+0000","last_became_active":"2023-03-02T10:55:51.091808+0000","last_became_peered":"2023-03-02T10:55:51.091808+0000","last_unstale":"2023-03-02T10:56:19.291964+0000","last_undegraded":"2023-03-02T10:56:19.291964+0000","last_fullsized":"2023-03-02T10:56:19.291964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:26:42.737673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539999+0000","last_change":"2023-03-02T10:55:10.159307+0000","last_active":"2023-03-02T10:55:49.539999+0000","last_peered":"2023-03-02T10:55:49.539999+0000","last_clean":"2023-03-02T10:55:49.539999+0000","last_became_active":"2023-03-02T10:55:10.158979+0000","last_became_peered":"2023-03-02T10:55:10.158979+0000","last_unstale":"2023-03-02T10:55:49.539999+0000","last_undegraded":"2023-03-02T10:55:49.539999+0000","last_fullsized":"2023-03-02T10:55:49.539999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:13:54.984801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297738+0000","last_change":"2023-03-02T10:55:10.630995+0000","last_active":"2023-03-02T10:56:19.297738+0000","last_peered":"2023-03-02T10:56:19.297738+0000","last_clean":"2023-03-02T10:56:19.297738+0000","last_became_active":"2023-03-02T10:55:10.630654+0000","last_became_peered":"2023-03-02T10:55:10.630654+0000","last_unstale":"2023-03-02T10:56:19.297738+0000","last_undegraded":"2023-03-02T10:56:19.297738+0000","last_fullsized":"2023-03-02T10:56:19.297738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:25:50.945152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297504+0000","last_change":"2023-03-02T10:55:10.633263+0000","last_active":"2023-03-02T10:56:19.297504+0000","last_peered":"2023-03-02T10:56:19.297504+0000","last_clean":"2023-03-02T10:56:19.297504+0000","last_became_active":"2023-03-02T10:55:10.632796+0000","last_became_peered":"2023-03-02T10:55:10.632796+0000","last_unstale":"2023-03-02T10:56:19.297504+0000","last_undegraded":"2023-03-02T10:56:19.297504+0000","last_fullsized":"2023-03-02T10:56:19.297504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:04:02.060792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.286082+0000","last_change":"2023-03-02T10:55:10.620195+0000","last_active":"2023-03-02T10:56:19.286082+0000","last_peered":"2023-03-02T10:56:19.286082+0000","last_clean":"2023-03-02T10:56:19.286082+0000","last_became_active":"2023-03-02T10:55:10.619904+0000","last_became_peered":"2023-03-02T10:55:10.619904+0000","last_unstale":"2023-03-02T10:56:19.286082+0000","last_undegraded":"2023-03-02T10:56:19.286082+0000","last_fullsized":"2023-03-02T10:56:19.286082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:03:43.176587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.286504+0000","last_change":"2023-03-02T10:55:10.619427+0000","last_active":"2023-03-02T10:56:19.286504+0000","last_peered":"2023-03-02T10:56:19.286504+0000","last_clean":"2023-03-02T10:56:19.286504+0000","last_became_active":"2023-03-02T10:55:10.618184+0000","last_became_peered":"2023-03-02T10:55:10.618184+0000","last_unstale":"2023-03-02T10:56:19.286504+0000","last_undegraded":"2023-03-02T10:56:19.286504+0000","last_fullsized":"2023-03-02T10:56:19.286504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:00.907091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.295503+0000","last_change":"2023-03-02T10:55:10.630058+0000","last_active":"2023-03-02T10:56:19.295503+0000","last_peered":"2023-03-02T10:56:19.295503+0000","last_clean":"2023-03-02T10:56:19.295503+0000","last_became_active":"2023-03-02T10:55:10.626022+0000","last_became_peered":"2023-03-02T10:55:10.626022+0000","last_unstale":"2023-03-02T10:56:19.295503+0000","last_undegraded":"2023-03-02T10:56:19.295503+0000","last_fullsized":"2023-03-02T10:56:19.295503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:23:27.900984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.290432+0000","last_change":"2023-03-02T10:55:10.621984+0000","last_active":"2023-03-02T10:56:19.290432+0000","last_peered":"2023-03-02T10:56:19.290432+0000","last_clean":"2023-03-02T10:56:19.290432+0000","last_became_active":"2023-03-02T10:55:10.621636+0000","last_became_peered":"2023-03-02T10:55:10.621636+0000","last_unstale":"2023-03-02T10:56:19.290432+0000","last_undegraded":"2023-03-02T10:56:19.290432+0000","last_fullsized":"2023-03-02T10:56:19.290432+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:10:41.154358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.294292+0000","last_change":"2023-03-02T10:55:10.633194+0000","last_active":"2023-03-02T10:56:19.294292+0000","last_peered":"2023-03-02T10:56:19.294292+0000","last_clean":"2023-03-02T10:56:19.294292+0000","last_became_active":"2023-03-02T10:55:10.632860+0000","last_became_peered":"2023-03-02T10:55:10.632860+0000","last_unstale":"2023-03-02T10:56:19.294292+0000","last_undegraded":"2023-03-02T10:56:19.294292+0000","last_fullsized":"2023-03-02T10:56:19.294292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:34:58.071830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.300407+0000","last_change":"2023-03-02T10:55:10.613717+0000","last_active":"2023-03-02T10:56:19.300407+0000","last_peered":"2023-03-02T10:56:19.300407+0000","last_clean":"2023-03-02T10:56:19.300407+0000","last_became_active":"2023-03-02T10:55:10.613391+0000","last_became_peered":"2023-03-02T10:55:10.613391+0000","last_unstale":"2023-03-02T10:56:19.300407+0000","last_undegraded":"2023-03-02T10:56:19.300407+0000","last_fullsized":"2023-03-02T10:56:19.300407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:51:23.532086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297955+0000","last_change":"2023-03-02T10:55:10.637730+0000","last_active":"2023-03-02T10:56:19.297955+0000","last_peered":"2023-03-02T10:56:19.297955+0000","last_clean":"2023-03-02T10:56:19.297955+0000","last_became_active":"2023-03-02T10:55:10.637097+0000","last_became_peered":"2023-03-02T10:55:10.637097+0000","last_unstale":"2023-03-02T10:56:19.297955+0000","last_undegraded":"2023-03-02T10:56:19.297955+0000","last_fullsized":"2023-03-02T10:56:19.297955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:41:19.587933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292829+0000","last_change":"2023-03-02T10:55:10.617374+0000","last_active":"2023-03-02T10:56:19.292829+0000","last_peered":"2023-03-02T10:56:19.292829+0000","last_clean":"2023-03-02T10:56:19.292829+0000","last_became_active":"2023-03-02T10:55:10.617061+0000","last_became_peered":"2023-03-02T10:55:10.617061+0000","last_unstale":"2023-03-02T10:56:19.292829+0000","last_undegraded":"2023-03-02T10:56:19.292829+0000","last_fullsized":"2023-03-02T10:56:19.292829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:03:41.270487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.287281+0000","last_change":"2023-03-02T10:55:10.622246+0000","last_active":"2023-03-02T10:56:19.287281+0000","last_peered":"2023-03-02T10:56:19.287281+0000","last_clean":"2023-03-02T10:56:19.287281+0000","last_became_active":"2023-03-02T10:55:10.621938+0000","last_became_peered":"2023-03-02T10:55:10.621938+0000","last_unstale":"2023-03-02T10:56:19.287281+0000","last_undegraded":"2023-03-02T10:56:19.287281+0000","last_fullsized":"2023-03-02T10:56:19.287281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:39:35.605113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.301744+0000","last_change":"2023-03-02T10:55:10.623502+0000","last_active":"2023-03-02T10:56:19.301744+0000","last_peered":"2023-03-02T10:56:19.301744+0000","last_clean":"2023-03-02T10:56:19.301744+0000","last_became_active":"2023-03-02T10:55:10.623160+0000","last_became_peered":"2023-03-02T10:55:10.623160+0000","last_unstale":"2023-03-02T10:56:19.301744+0000","last_undegraded":"2023-03-02T10:56:19.301744+0000","last_fullsized":"2023-03-02T10:56:19.301744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:30:49.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296470+0000","last_change":"2023-03-02T10:55:10.636452+0000","last_active":"2023-03-02T10:56:19.296470+0000","last_peered":"2023-03-02T10:56:19.296470+0000","last_clean":"2023-03-02T10:56:19.296470+0000","last_became_active":"2023-03-02T10:55:10.636176+0000","last_became_peered":"2023-03-02T10:55:10.636176+0000","last_unstale":"2023-03-02T10:56:19.296470+0000","last_undegraded":"2023-03-02T10:56:19.296470+0000","last_fullsized":"2023-03-02T10:56:19.296470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:51.303295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297592+0000","last_change":"2023-03-02T10:55:51.092168+0000","last_active":"2023-03-02T10:56:19.297592+0000","last_peered":"2023-03-02T10:56:19.297592+0000","last_clean":"2023-03-02T10:56:19.297592+0000","last_became_active":"2023-03-02T10:55:51.091735+0000","last_became_peered":"2023-03-02T10:55:51.091735+0000","last_unstale":"2023-03-02T10:56:19.297592+0000","last_undegraded":"2023-03-02T10:56:19.297592+0000","last_fullsized":"2023-03-02T10:56:19.297592+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:25:46.235073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":254019,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69286,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":873,"num_read_kb":525,"num_write":244,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":610,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":202194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416416,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6112,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739040,"statfs":{"total":95995035648,"available":95988776960,"internally_reserved":0,"allocated":942080,"data_stored":448834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.8109999999999999,"5min":3.8109999999999999,"15min":3.8109999999999999},"last":0.495}]},{"osd":1,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.48699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.745,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.624}]},{"osd":2,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.37},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.55500000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90300000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80400000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80000000000000004,"5min":1.214,"15min":1.214},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95999999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97799999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98999999999999999,"5min":1.53,"15min":1.53},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.58699999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.032,"5min":1.125,"15min":1.125},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.70199999999999996},"min":{"1min":0.54900000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.89000000000000001,"5min":1.089,"15min":1.089},"last":0.71999999999999997}]},{"osd":8,"last update":"Thu Mar 2 10:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.69999999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78800000000000003,"15min":0.78900000000000003},"min":{"1min":0.65400000000000003,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94499999999999995,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78300000000000003,"15min":0.77900000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1439999999999999,"5min":1.194,"15min":1.194},"last":0.77500000000000002}]},{"osd":10,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.745},"min":{"1min":0.59199999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.92800000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.63800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":1.49,"15min":1.49},"last":0.753}]}]},{"osd":10,"up_from":71,"seq":304942678051,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6572,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738580,"statfs":{"total":95995035648,"available":95988305920,"internally_reserved":0,"allocated":1085440,"data_stored":1101341,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76600000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64600000000000002,"15min":0.64400000000000002},"min":{"1min":0.47199999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69599999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.099,"5min":2.121,"15min":2.121},"last":0.62}]},{"osd":4,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.52000000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.25,"5min":1.97,"15min":1.97},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.52000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0580000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.56799999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.998,"5min":1.097,"15min":1.097},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.53500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.67200000000000004}]},{"osd":9,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.81000000000000005,"15min":0.82099999999999995},"min":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.139,"5min":1.28,"15min":1.28},"last":0.752},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.86199999999999999,"15min":0.88800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96699999999999997,"5min":2.302,"15min":2.302},"last":0.63300000000000001}]},{"osd":11,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77500000000000002,"15min":0.77600000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97899999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69399999999999995}]}]},{"osd":9,"up_from":66,"seq":283467841576,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6260,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738892,"statfs":{"total":95995035648,"available":95988625408,"internally_reserved":0,"allocated":962560,"data_stored":448277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.55200000000000005,"5min":0.871,"15min":0.871},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.58799999999999997,"5min":1.823,"15min":1.823},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67900000000000005,"15min":0.69199999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85499999999999998,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.73599999999999999,"15min":0.76000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.747,"5min":0.999,"15min":0.999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.71899999999999997,"15min":0.73899999999999999},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79700000000000004,"5min":1.266,"15min":1.266},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.65900000000000003,"15min":0.68899999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63400000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.36099999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57799999999999996,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.442}]},{"osd":4,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.92700000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.85899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.83099999999999996,"15min":0.86099999999999999},"min":{"1min":0.53700000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.86899999999999999,"5min":1.956,"15min":1.956},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.84199999999999997,"15min":0.876},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.82999999999999996,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.82199999999999995,"15min":0.85699999999999998},"min":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2569999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.82799999999999996,"15min":0.85899999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89700000000000002,"5min":1.452,"15min":1.452},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.90000000000000002,"15min":0.93000000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.86899999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.89600000000000002,"15min":0.92700000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2130000000000001,"5min":1.522,"15min":1.522},"last":0.72499999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95999999999999996,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.93400000000000005,"15min":0.96499999999999997},"min":{"1min":0.63100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.90600000000000003,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.624}]},{"osd":10,"last update":"Thu Mar 2 10:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.83899999999999997,"15min":0.85299999999999998},"min":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.749}]}]},{"osd":8,"up_from":59,"seq":253403070508,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6440,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738712,"statfs":{"total":95995035648,"available":95988441088,"internally_reserved":0,"allocated":950272,"data_stored":448494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.60399999999999998,"15min":0.54000000000000004},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":5.7919999999999998,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.63400000000000001,"15min":0.58299999999999996},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.8049999999999997,"5min":5.8049999999999997,"15min":5.8049999999999997},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.61199999999999999,"15min":0.58199999999999996},"min":{"1min":0.52900000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81699999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61399999999999999,"15min":0.59799999999999998},"min":{"1min":0.56000000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47099999999999997,"15min":0.45700000000000002},"min":{"1min":0.42699999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.63},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.47999999999999998,"15min":0.46899999999999997},"min":{"1min":0.45400000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.502}]},{"osd":3,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":0.71499999999999997,"15min":0.64100000000000001},"min":{"1min":0.48499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.62},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.68899999999999995,"15min":0.63100000000000001},"min":{"1min":0.49399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.3940000000000001,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.60099999999999998,"15min":0.57899999999999996},"min":{"1min":0.53500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.64500000000000002,"15min":0.627},"min":{"1min":0.64300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84499999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.59599999999999997,"15min":0.57799999999999996},"min":{"1min":0.57499999999999996,"5min":0.312,"15min":0.312},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.46500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.71999999999999997,"15min":0.69699999999999995},"min":{"1min":0.63900000000000001,"5min":0.377,"15min":0.377},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":0.80300000000000005,"15min":0.747},"min":{"1min":0.64200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":3.9089999999999998,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.748}]},{"osd":7,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.71199999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.70899999999999996,"15min":0.68899999999999995},"min":{"1min":0.626,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90100000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.83399999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.71499999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.05,"5min":0.79700000000000004,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Mar 2 10:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.71699999999999997,"15min":0.69699999999999995},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.76900000000000002,"15min":0.753},"min":{"1min":0.77900000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.88500000000000001}]},{"osd":11,"last update":"Thu Mar 2 10:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.82699999999999996}]}]},{"osd":7,"up_from":52,"seq":223338299440,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6556,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738596,"statfs":{"total":95995035648,"available":95988322304,"internally_reserved":0,"allocated":1003520,"data_stored":1041123,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84499999999999997,"5min":1.034,"15min":1.034},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.41499999999999998},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60799999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.76100000000000001,"5min":1.129,"15min":1.129},"last":0.441},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.438,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80200000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81899999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70599999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.497}]},{"osd":5,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63}]},{"osd":6,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.46000000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84899999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90500000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58699999999999997}]},{"osd":8,"last update":"Thu Mar 2 10:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84899999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91500000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77700000000000002}]},{"osd":9,"last update":"Thu Mar 2 10:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.58899999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98199999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.66000000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.69399999999999995}]},{"osd":10,"last update":"Thu Mar 2 10:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.502,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66000000000000003}]},{"osd":11,"last update":"Thu Mar 2 10:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.748}]}]},{"osd":6,"up_from":47,"seq":201863462966,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6368,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738784,"statfs":{"total":95995035648,"available":95988514816,"internally_reserved":0,"allocated":942080,"data_stored":447893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42099999999999999,"15min":0.40400000000000003},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.44700000000000001,"15min":0.438},"min":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69699999999999995,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.748,"5min":0.999,"15min":0.999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.46300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73499999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.58999999999999997},"min":{"1min":0.48899999999999999,"5min":0.435,"15min":0.435},"max":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.499,"15min":0.495},"min":{"1min":0.35399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84099999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.93100000000000005,"5min":1.042,"15min":1.042},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.48399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86499999999999999,"5min":1.069,"15min":1.069},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68799999999999994,"15min":0.66700000000000004},"min":{"1min":0.502,"5min":0.439,"15min":0.439},"max":{"1min":0.81999999999999995,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70899999999999996,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":1.03},"last":0.85099999999999998}]},{"osd":7,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.51600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.89000000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.73499999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.82299999999999995}]},{"osd":8,"last update":"Thu Mar 2 10:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88100000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.81100000000000005},"min":{"1min":0.61499999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.99199999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.88800000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.84099999999999997,"15min":0.86199999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97099999999999997,"5min":1.234,"15min":1.234},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.018,"5min":1.163,"15min":1.163},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.61299999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.86299999999999999,"15min":0.88100000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":0.94599999999999995,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.97299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7516,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":93737636,"statfs":{"total":95995035648,"available":95987339264,"internally_reserved":0,"allocated":1003520,"data_stored":510650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51000000000000001,"15min":0.48799999999999999},"min":{"1min":0.36499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.75,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.505,"15min":0.502},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81100000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.52000000000000002},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76900000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.56999999999999995,"15min":0.53700000000000003},"min":{"1min":0.44600000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Mar 2 10:56:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57699999999999996,"15min":0.54200000000000004},"min":{"1min":0.432,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90600000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.55600000000000005},"min":{"1min":0.44600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91700000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Mar 2 10:55:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.443,"15min":0.40899999999999997},"min":{"1min":0.29199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.53000000000000003,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.65000000000000002,"15min":0.60999999999999999},"min":{"1min":0.60899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89000000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.65100000000000002,"15min":0.59699999999999998},"min":{"1min":0.57099999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.75}]},{"osd":6,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.629,"15min":0.60399999999999998},"min":{"1min":0.51900000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88600000000000001,"5min":1.097,"15min":1.097},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.68700000000000006,"15min":0.66100000000000003},"min":{"1min":0.52800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.38600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.628},{"interface":"front","average":{"1min":0.746,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.72699999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.73099999999999998,"15min":0.70299999999999996},"min":{"1min":0.67100000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98199999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.59999999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.018,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70599999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.76300000000000001},"min":{"1min":0.59999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.83299999999999996}]},{"osd":10,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.68999999999999995,"15min":0.67800000000000005},"min":{"1min":0.55000000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96299999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.61199999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.056,"5min":1.169,"15min":1.169},"last":0.77700000000000002}]},{"osd":11,"last update":"Thu Mar 2 10:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.85299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7284,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737868,"statfs":{"total":95995035648,"available":95987576832,"internally_reserved":0,"allocated":962560,"data_stored":449194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54700000000000004,"15min":0.48999999999999999},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.873,"15min":0.873},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.56200000000000006,"15min":0.50900000000000001},"min":{"1min":0.50800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.54300000000000004},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.65700000000000003,"15min":0.56799999999999995},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.782,"5min":4.782,"15min":4.782},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Mar 2 10:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.64800000000000002,"15min":0.57799999999999996},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.7569999999999997,"5min":4.7569999999999997,"15min":4.7569999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80500000000000005,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Mar 2 10:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78400000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.52100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Mar 2 10:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.36499999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.65100000000000002,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.372,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.871,"5min":1.171,"15min":1.171},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.47299999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.054,"5min":1.298,"15min":1.298},"last":0.745},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0740000000000001,"5min":1.23,"15min":1.23},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Mar 2 10:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.81299999999999994,"15min":0.82099999999999995},"min":{"1min":0.54200000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.8220000000000001,"5min":4.8220000000000001,"15min":4.8220000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76900000000000002,"15min":0.79300000000000004},"min":{"1min":0.52700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.752}]},{"osd":9,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.76400000000000001,"15min":0.78100000000000003},"min":{"1min":0.40500000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.093,"5min":1.149,"15min":1.149},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1950000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.63}]},{"osd":10,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.64200000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.91000000000000003,"5min":1.22,"15min":1.22},"last":0.47199999999999998}]},{"osd":11,"last update":"Thu Mar 2 10:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.63900000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77300000000000002,"15min":0.77100000000000002},"min":{"1min":0.66600000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.77100000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7532,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":93737620,"statfs":{"total":95995035648,"available":95987322880,"internally_reserved":0,"allocated":1019904,"data_stored":505753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.58699999999999997,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.60799999999999998,"15min":0.52800000000000002},"min":{"1min":0.39100000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":3.9239999999999999,"5min":3.9239999999999999,"15min":3.9239999999999999},"last":0.75}]},{"osd":1,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55400000000000005,"15min":0.51800000000000002},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.56799999999999995,"15min":0.51700000000000002},"min":{"1min":0.41899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.67700000000000005,"15min":0.59199999999999997},"min":{"1min":0.45700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.505},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.65900000000000003,"15min":0.60199999999999998},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.4500000000000002,"5min":4.4500000000000002,"15min":4.4500000000000002},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Mar 2 10:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Mar 2 10:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.48499999999999999,"15min":0.47499999999999998},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51100000000000001},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Mar 2 10:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":0.871,"15min":0.871},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.63400000000000001,"15min":0.61399999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":4.0490000000000004,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Mar 2 10:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.6639999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.39100000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.91500000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56200000000000006}]},{"osd":9,"last update":"Thu Mar 2 10:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.69899999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.73999999999999999,"15min":0.71899999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.1790000000000003,"5min":4.1790000000000003,"15min":4.1790000000000003},"last":0.71199999999999997}]},{"osd":10,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.51800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70299999999999996}]},{"osd":11,"last update":"Thu Mar 2 10:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.67500000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149763,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6632,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738520,"statfs":{"total":95995035648,"available":95988244480,"internally_reserved":0,"allocated":950272,"data_stored":447270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.57399999999999995,"15min":0.438},"min":{"1min":0.33300000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61699999999999999,"5min":14.122,"15min":14.122},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.54200000000000004,"15min":0.435},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59999999999999998,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61899999999999999,"15min":0.57499999999999996},"min":{"1min":0.433,"5min":0.316,"15min":0.316},"max":{"1min":0.84699999999999998,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.67600000000000005,"15min":0.59399999999999997},"min":{"1min":0.437,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65000000000000002,"5min":9.0719999999999992,"15min":9.0719999999999992},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64800000000000002,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69699999999999995,"5min":4.306,"15min":4.306},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.62},"min":{"1min":0.499,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83099999999999996,"5min":1.421,"15min":1.421},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Mar 2 10:56:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.67000000000000004,"15min":0.63300000000000001},"min":{"1min":0.51500000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.875},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.70999999999999996,"15min":0.65400000000000003},"min":{"1min":0.55600000000000005,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69999999999999996,"15min":0.65800000000000003},"min":{"1min":0.56100000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.155,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.68200000000000005,"15min":0.624},"min":{"1min":0.504,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.60499999999999998,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85599999999999998,"5min":5.0170000000000003,"15min":5.0170000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.68899999999999995,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73699999999999999,"5min":9.1270000000000007,"15min":9.1270000000000007},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Mar 2 10:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.81299999999999994,"15min":0.82699999999999996},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.748,"15min":0.71399999999999997},"min":{"1min":0.52800000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.84199999999999997}]},{"osd":8,"last update":"Thu Mar 2 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":6.9539999999999997,"5min":6.9539999999999997,"15min":6.9539999999999997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.76300000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.76500000000000001,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.82799999999999996,"15min":0.80900000000000005},"min":{"1min":0.56599999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.72899999999999998}]},{"osd":10,"last update":"Thu Mar 2 10:56:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":0.875,"15min":0.78300000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":9.0210000000000008,"5min":9.0210000000000008,"15min":9.0210000000000008},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":0.84599999999999997,"15min":0.79200000000000004},"min":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.3970000000000002,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":0.754}]},{"osd":11,"last update":"Thu Mar 2 10:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.63},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.77800000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6560,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738592,"statfs":{"total":95995035648,"available":95988318208,"internally_reserved":0,"allocated":942080,"data_stored":448279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65300000000000002,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":5.8860000000000001,"15min":5.8860000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64000000000000001,"15min":0.67400000000000004},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.95599999999999996,"5min":5.577,"15min":5.577},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38200000000000001,"15min":0.34999999999999998},"min":{"1min":0.30399999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.65700000000000003,"5min":0.872,"15min":0.872},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.35899999999999999},"min":{"1min":0.34300000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.47999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57699999999999996,"15min":0.54300000000000004},"min":{"1min":0.49199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.56399999999999995,"15min":0.53600000000000003},"min":{"1min":0.47199999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.55500000000000005},"min":{"1min":0.38700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Mar 2 10:56:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.55500000000000005},"min":{"1min":0.49099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79900000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59499999999999997,"15min":0.55800000000000005},"min":{"1min":0.51000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.745,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.61599999999999999},"min":{"1min":0.48199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82699999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Mar 2 10:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.52100000000000002},"min":{"1min":0.44500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":1.02,"15min":1.02},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Mar 2 10:56:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.70399999999999996},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.88700000000000001,"5min":1.087,"15min":1.087},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71999999999999997,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91300000000000003,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.85299999999999998}]},{"osd":9,"last update":"Thu Mar 2 10:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.751},"min":{"1min":0.50800000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1180000000000001,"5min":1.149,"15min":1.149},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.107,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.875}]},{"osd":10,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.58499999999999996,"5min":0.433,"15min":0.433},"max":{"1min":0.92800000000000005,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.51000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89500000000000002,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.629}]},{"osd":11,"last update":"Thu Mar 2 10:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.92000000000000004}]}]},{"osd":5,"up_from":39,"seq":167503724601,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6696,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738456,"statfs":{"total":95995035648,"available":95988178944,"internally_reserved":0,"allocated":1015808,"data_stored":1040511,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76900000000000002,"5min":1.51,"15min":1.51},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.41299999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84699999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56799999999999995,"15min":0.53600000000000003},"min":{"1min":0.47099999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.877,"15min":0.877},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.502,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71599999999999997,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.35699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67800000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.437},"min":{"1min":0.34100000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65300000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.56200000000000006},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76200000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.60799999999999998},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61599999999999999,"15min":0.57499999999999996},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.878,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Mar 2 10:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.54000000000000004,"5min":0.374,"15min":0.374},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.72899999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.45000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.92500000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.749,"15min":0.751},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.86399999999999999}]},{"osd":10,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.59799999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98899999999999999,"5min":1.01,"15min":1.01},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73599999999999999,"15min":0.72799999999999998},"min":{"1min":0.57499999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.82999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-02T10:56:47.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-02T10:56:48.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.042+0000 7fae1e9ff700 1 -- 172.21.15.57:0/2046427451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae180fddd0 msgr2=0x7fae180fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.042+0000 7fae1e9ff700 1 --2- 172.21.15.57:0/2046427451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae180fddd0 0x7fae180fe1e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fae08009990 tx=0x7fae08009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.042+0000 7fae1e9ff700 1 -- 172.21.15.57:0/2046427451 shutdown_connections 2023-03-02T10:56:48.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.042+0000 7fae1e9ff700 1 --2- 172.21.15.57:0/2046427451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae18101730 0x7fae18107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.042+0000 7fae1e9ff700 1 --2- 172.21.15.57:0/2046427451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae180fddd0 0x7fae180fe1e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.042+0000 7fae1e9ff700 1 --2- 172.21.15.57:0/2046427451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae18100da0 0x7fae181011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.042+0000 7fae1e9ff700 1 -- 172.21.15.57:0/2046427451 >> 172.21.15.57:0/2046427451 conn(0x7fae180f97d0 msgr2=0x7fae180fbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:48.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.042+0000 7fae1e9ff700 1 -- 172.21.15.57:0/2046427451 shutdown_connections 2023-03-02T10:56:48.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.043+0000 7fae1e9ff700 1 -- 172.21.15.57:0/2046427451 wait complete. 2023-03-02T10:56:48.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.043+0000 7fae1e9ff700 1 Processor -- start 2023-03-02T10:56:48.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.043+0000 7fae1e9ff700 1 -- start start 2023-03-02T10:56:48.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.043+0000 7fae1e9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae180fddd0 0x7fae18195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae1e9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae18100da0 0x7fae18195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae1e9ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae18101730 0x7fae1819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae1e9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1819d3f0 con 0x7fae18100da0 2023-03-02T10:56:48.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae1e9ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1819d530 con 0x7fae18101730 2023-03-02T10:56:48.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae1e9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1819d6c0 con 0x7fae180fddd0 2023-03-02T10:56:48.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae0f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae18100da0 0x7fae18195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae0f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae18100da0 0x7fae18195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53968/0 (socket says 172.21.15.57:53968) 2023-03-02T10:56:48.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae0f7fe700 1 -- 172.21.15.57:0/273880916 learned_addr learned my addr 172.21.15.57:0/273880916 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:48.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae1cf9c700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae18101730 0x7fae1819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae17fff700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae180fddd0 0x7fae18195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae0f7fe700 1 -- 172.21.15.57:0/273880916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae180fddd0 msgr2=0x7fae18195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae0f7fe700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae180fddd0 0x7fae18195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae0f7fe700 1 -- 172.21.15.57:0/273880916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae18101730 msgr2=0x7fae1819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae0f7fe700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae18101730 0x7fae1819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae0f7fe700 1 -- 172.21.15.57:0/273880916 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae080095f0 con 0x7fae18100da0 2023-03-02T10:56:48.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae0f7fe700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae18100da0 0x7fae18195db0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fae0000d950 tx=0x7fae0000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:48.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae15ffb700 1 -- 172.21.15.57:0/273880916 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0000f890 con 0x7fae18100da0 2023-03-02T10:56:48.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.044+0000 7fae15ffb700 1 -- 172.21.15.57:0/273880916 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae00010460 con 0x7fae18100da0 2023-03-02T10:56:48.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.045+0000 7fae15ffb700 1 -- 172.21.15.57:0/273880916 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0000e610 con 0x7fae18100da0 2023-03-02T10:56:48.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.045+0000 7fae1e9ff700 1 -- 172.21.15.57:0/273880916 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1810b490 con 0x7fae18100da0 2023-03-02T10:56:48.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.045+0000 7fae1e9ff700 1 -- 172.21.15.57:0/273880916 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1810b300 con 0x7fae18100da0 2023-03-02T10:56:48.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.045+0000 7fae1e9ff700 1 -- 172.21.15.57:0/273880916 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1819dd60 con 0x7fae18100da0 2023-03-02T10:56:48.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.047+0000 7fae15ffb700 1 -- 172.21.15.57:0/273880916 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fae00022070 con 0x7fae18100da0 2023-03-02T10:56:48.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.048+0000 7fae15ffb700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fae0409b3a0 0x7fae0409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.049+0000 7fae17fff700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fae0409b3a0 0x7fae0409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.049+0000 7fae15ffb700 1 -- 172.21.15.57:0/273880916 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fae000c4bf0 con 0x7fae18100da0 2023-03-02T10:56:48.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.049+0000 7fae17fff700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fae0409b3a0 0x7fae0409d850 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae0800b2e0 tx=0x7fae08005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:48.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.051+0000 7fae15ffb700 1 -- 172.21.15.57:0/273880916 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fae00090520 con 0x7fae18100da0 2023-03-02T10:56:48.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.242+0000 7fae1e9ff700 1 -- 172.21.15.57:0/273880916 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae180609d0 con 0x7fae0409b3a0 2023-03-02T10:56:48.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.253+0000 7fae15ffb700 1 -- 172.21.15.57:0/273880916 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344331 (secure 0 0 0) 0x7fae180609d0 con 0x7fae0409b3a0 2023-03-02T10:56:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.256+0000 7fae1e9ff700 1 -- 172.21.15.57:0/273880916 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fae0409b3a0 msgr2=0x7fae0409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.256+0000 7fae1e9ff700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fae0409b3a0 0x7fae0409d850 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae0800b2e0 tx=0x7fae08005fb0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.256+0000 7fae1e9ff700 1 -- 172.21.15.57:0/273880916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae18100da0 msgr2=0x7fae18195db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.256+0000 7fae1e9ff700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae18100da0 0x7fae18195db0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fae0000d950 tx=0x7fae0000dc60 comp rx=0 tx=0).stop 2023-03-02T10:56:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.256+0000 7fae1e9ff700 1 -- 172.21.15.57:0/273880916 shutdown_connections 2023-03-02T10:56:48.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.256+0000 7fae1e9ff700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fae0409b3a0 0x7fae0409d850 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.256+0000 7fae1e9ff700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae18101730 0x7fae1819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.256+0000 7fae1e9ff700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae180fddd0 0x7fae18195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.256+0000 7fae1e9ff700 1 --2- 172.21.15.57:0/273880916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae18100da0 0x7fae18195db0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.256+0000 7fae1e9ff700 1 -- 172.21.15.57:0/273880916 >> 172.21.15.57:0/273880916 conn(0x7fae180f97d0 msgr2=0x7fae180fbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:48.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.257+0000 7fae1e9ff700 1 -- 172.21.15.57:0/273880916 shutdown_connections 2023-03-02T10:56:48.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.257+0000 7fae1e9ff700 1 -- 172.21.15.57:0/273880916 wait complete. 2023-03-02T10:56:48.260 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-03-02T10:56:48.273 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2023-03-02T10:56:47.282349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659900,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1009,"num_read_kb":644,"num_write":427,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1181469,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":853,"ondisk_log_size":853,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":80528,"kb_used_data":11504,"kb_used_omap":0,"kb_used_meta":68928,"kb_avail":1124861296,"statfs":{"total":1151940427776,"available":1151857967104,"internally_reserved":0,"allocated":11780096,"data_stored":7337619,"data_compressed":110277,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":70582272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5664,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":56,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002910"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.303694+0000","last_change":"2023-03-02T10:55:10.630366+0000","last_active":"2023-03-02T10:56:19.303694+0000","last_peered":"2023-03-02T10:56:19.303694+0000","last_clean":"2023-03-02T10:56:19.303694+0000","last_became_active":"2023-03-02T10:55:10.630035+0000","last_became_peered":"2023-03-02T10:55:10.630035+0000","last_unstale":"2023-03-02T10:56:19.303694+0000","last_undegraded":"2023-03-02T10:56:19.303694+0000","last_fullsized":"2023-03-02T10:56:19.303694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:00:41.832233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298589+0000","last_change":"2023-03-02T10:55:10.628111+0000","last_active":"2023-03-02T10:56:19.298589+0000","last_peered":"2023-03-02T10:56:19.298589+0000","last_clean":"2023-03-02T10:56:19.298589+0000","last_became_active":"2023-03-02T10:55:10.626879+0000","last_became_peered":"2023-03-02T10:55:10.626879+0000","last_unstale":"2023-03-02T10:56:19.298589+0000","last_undegraded":"2023-03-02T10:56:19.298589+0000","last_fullsized":"2023-03-02T10:56:19.298589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:08:52.120684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302330+0000","last_change":"2023-03-02T10:55:10.624392+0000","last_active":"2023-03-02T10:56:19.302330+0000","last_peered":"2023-03-02T10:56:19.302330+0000","last_clean":"2023-03-02T10:56:19.302330+0000","last_became_active":"2023-03-02T10:55:10.624095+0000","last_became_peered":"2023-03-02T10:55:10.624095+0000","last_unstale":"2023-03-02T10:56:19.302330+0000","last_undegraded":"2023-03-02T10:56:19.302330+0000","last_fullsized":"2023-03-02T10:56:19.302330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:30:55.174383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.285450+0000","last_change":"2023-03-02T10:55:10.619950+0000","last_active":"2023-03-02T10:56:19.285450+0000","last_peered":"2023-03-02T10:56:19.285450+0000","last_clean":"2023-03-02T10:56:19.285450+0000","last_became_active":"2023-03-02T10:55:10.619543+0000","last_became_peered":"2023-03-02T10:55:10.619543+0000","last_unstale":"2023-03-02T10:56:19.285450+0000","last_undegraded":"2023-03-02T10:56:19.285450+0000","last_fullsized":"2023-03-02T10:56:19.285450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:08:02.321422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291593+0000","last_change":"2023-03-02T10:55:10.626403+0000","last_active":"2023-03-02T10:56:19.291593+0000","last_peered":"2023-03-02T10:56:19.291593+0000","last_clean":"2023-03-02T10:56:19.291593+0000","last_became_active":"2023-03-02T10:55:10.626062+0000","last_became_peered":"2023-03-02T10:55:10.626062+0000","last_unstale":"2023-03-02T10:56:19.291593+0000","last_undegraded":"2023-03-02T10:56:19.291593+0000","last_fullsized":"2023-03-02T10:56:19.291593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:35:06.798468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.299050+0000","last_change":"2023-03-02T10:55:10.623903+0000","last_active":"2023-03-02T10:56:19.299050+0000","last_peered":"2023-03-02T10:56:19.299050+0000","last_clean":"2023-03-02T10:56:19.299050+0000","last_became_active":"2023-03-02T10:55:10.623422+0000","last_became_peered":"2023-03-02T10:55:10.623422+0000","last_unstale":"2023-03-02T10:56:19.299050+0000","last_undegraded":"2023-03-02T10:56:19.299050+0000","last_fullsized":"2023-03-02T10:56:19.299050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:21.066552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.289681+0000","last_change":"2023-03-02T10:55:10.633210+0000","last_active":"2023-03-02T10:56:19.289681+0000","last_peered":"2023-03-02T10:56:19.289681+0000","last_clean":"2023-03-02T10:56:19.289681+0000","last_became_active":"2023-03-02T10:55:10.632898+0000","last_became_peered":"2023-03-02T10:55:10.632898+0000","last_unstale":"2023-03-02T10:56:19.289681+0000","last_undegraded":"2023-03-02T10:56:19.289681+0000","last_fullsized":"2023-03-02T10:56:19.289681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:04.043328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292969+0000","last_change":"2023-03-02T10:55:10.634427+0000","last_active":"2023-03-02T10:56:19.292969+0000","last_peered":"2023-03-02T10:56:19.292969+0000","last_clean":"2023-03-02T10:56:19.292969+0000","last_became_active":"2023-03-02T10:55:10.634159+0000","last_became_peered":"2023-03-02T10:55:10.634159+0000","last_unstale":"2023-03-02T10:56:19.292969+0000","last_undegraded":"2023-03-02T10:56:19.292969+0000","last_fullsized":"2023-03-02T10:56:19.292969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:59:09.344860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302795+0000","last_change":"2023-03-02T10:55:10.622775+0000","last_active":"2023-03-02T10:56:19.302795+0000","last_peered":"2023-03-02T10:56:19.302795+0000","last_clean":"2023-03-02T10:56:19.302795+0000","last_became_active":"2023-03-02T10:55:10.616254+0000","last_became_peered":"2023-03-02T10:55:10.616254+0000","last_unstale":"2023-03-02T10:56:19.302795+0000","last_undegraded":"2023-03-02T10:56:19.302795+0000","last_fullsized":"2023-03-02T10:56:19.302795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:01:56.832512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.301052+0000","last_change":"2023-03-02T10:55:10.620311+0000","last_active":"2023-03-02T10:56:19.301052+0000","last_peered":"2023-03-02T10:56:19.301052+0000","last_clean":"2023-03-02T10:56:19.301052+0000","last_became_active":"2023-03-02T10:55:10.620028+0000","last_became_peered":"2023-03-02T10:55:10.620028+0000","last_unstale":"2023-03-02T10:56:19.301052+0000","last_undegraded":"2023-03-02T10:56:19.301052+0000","last_fullsized":"2023-03-02T10:56:19.301052+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:16:13.770927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302566+0000","last_change":"2023-03-02T10:55:10.621316+0000","last_active":"2023-03-02T10:56:19.302566+0000","last_peered":"2023-03-02T10:56:19.302566+0000","last_clean":"2023-03-02T10:56:19.302566+0000","last_became_active":"2023-03-02T10:55:10.620803+0000","last_became_peered":"2023-03-02T10:55:10.620803+0000","last_unstale":"2023-03-02T10:56:19.302566+0000","last_undegraded":"2023-03-02T10:56:19.302566+0000","last_fullsized":"2023-03-02T10:56:19.302566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:20:18.434138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297665+0000","last_change":"2023-03-02T10:55:10.625305+0000","last_active":"2023-03-02T10:56:19.297665+0000","last_peered":"2023-03-02T10:56:19.297665+0000","last_clean":"2023-03-02T10:56:19.297665+0000","last_became_active":"2023-03-02T10:55:10.625025+0000","last_became_peered":"2023-03-02T10:55:10.625025+0000","last_unstale":"2023-03-02T10:56:19.297665+0000","last_undegraded":"2023-03-02T10:56:19.297665+0000","last_fullsized":"2023-03-02T10:56:19.297665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:35:40.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292434+0000","last_change":"2023-03-02T10:55:10.626408+0000","last_active":"2023-03-02T10:56:19.292434+0000","last_peered":"2023-03-02T10:56:19.292434+0000","last_clean":"2023-03-02T10:56:19.292434+0000","last_became_active":"2023-03-02T10:55:10.625510+0000","last_became_peered":"2023-03-02T10:55:10.625510+0000","last_unstale":"2023-03-02T10:56:19.292434+0000","last_undegraded":"2023-03-02T10:56:19.292434+0000","last_fullsized":"2023-03-02T10:56:19.292434+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:59:10.622871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291632+0000","last_change":"2023-03-02T10:55:10.629323+0000","last_active":"2023-03-02T10:56:19.291632+0000","last_peered":"2023-03-02T10:56:19.291632+0000","last_clean":"2023-03-02T10:56:19.291632+0000","last_became_active":"2023-03-02T10:55:10.627038+0000","last_became_peered":"2023-03-02T10:55:10.627038+0000","last_unstale":"2023-03-02T10:56:19.291632+0000","last_undegraded":"2023-03-02T10:56:19.291632+0000","last_fullsized":"2023-03-02T10:56:19.291632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:57:21.241810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297389+0000","last_change":"2023-03-02T10:55:10.624312+0000","last_active":"2023-03-02T10:56:19.297389+0000","last_peered":"2023-03-02T10:56:19.297389+0000","last_clean":"2023-03-02T10:56:19.297389+0000","last_became_active":"2023-03-02T10:55:10.623997+0000","last_became_peered":"2023-03-02T10:55:10.623997+0000","last_unstale":"2023-03-02T10:56:19.297389+0000","last_undegraded":"2023-03-02T10:56:19.297389+0000","last_fullsized":"2023-03-02T10:56:19.297389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:09:43.683852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302825+0000","last_change":"2023-03-02T10:55:10.622473+0000","last_active":"2023-03-02T10:56:19.302825+0000","last_peered":"2023-03-02T10:56:19.302825+0000","last_clean":"2023-03-02T10:56:19.302825+0000","last_became_active":"2023-03-02T10:55:10.622148+0000","last_became_peered":"2023-03-02T10:55:10.622148+0000","last_unstale":"2023-03-02T10:56:19.302825+0000","last_undegraded":"2023-03-02T10:56:19.302825+0000","last_fullsized":"2023-03-02T10:56:19.302825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:54:52.132792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.303973+0000","last_change":"2023-03-02T10:55:10.630380+0000","last_active":"2023-03-02T10:56:19.303973+0000","last_peered":"2023-03-02T10:56:19.303973+0000","last_clean":"2023-03-02T10:56:19.303973+0000","last_became_active":"2023-03-02T10:55:10.630088+0000","last_became_peered":"2023-03-02T10:55:10.630088+0000","last_unstale":"2023-03-02T10:56:19.303973+0000","last_undegraded":"2023-03-02T10:56:19.303973+0000","last_fullsized":"2023-03-02T10:56:19.303973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:08:58.983902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.293634+0000","last_change":"2023-03-02T10:55:10.620547+0000","last_active":"2023-03-02T10:56:19.293634+0000","last_peered":"2023-03-02T10:56:19.293634+0000","last_clean":"2023-03-02T10:56:19.293634+0000","last_became_active":"2023-03-02T10:55:10.620225+0000","last_became_peered":"2023-03-02T10:55:10.620225+0000","last_unstale":"2023-03-02T10:56:19.293634+0000","last_undegraded":"2023-03-02T10:56:19.293634+0000","last_fullsized":"2023-03-02T10:56:19.293634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:47:38.669432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.285943+0000","last_change":"2023-03-02T10:55:10.625108+0000","last_active":"2023-03-02T10:56:19.285943+0000","last_peered":"2023-03-02T10:56:19.285943+0000","last_clean":"2023-03-02T10:56:19.285943+0000","last_became_active":"2023-03-02T10:55:10.624797+0000","last_became_peered":"2023-03-02T10:55:10.624797+0000","last_unstale":"2023-03-02T10:56:19.285943+0000","last_undegraded":"2023-03-02T10:56:19.285943+0000","last_fullsized":"2023-03-02T10:56:19.285943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:06:57.777889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":116,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:44.641909+0000","last_change":"2023-03-02T10:55:10.146541+0000","last_active":"2023-03-02T10:56:44.641909+0000","last_peered":"2023-03-02T10:56:44.641909+0000","last_clean":"2023-03-02T10:56:44.641909+0000","last_became_active":"2023-03-02T10:55:10.146239+0000","last_became_peered":"2023-03-02T10:55:10.146239+0000","last_unstale":"2023-03-02T10:56:44.641909+0000","last_undegraded":"2023-03-02T10:56:44.641909+0000","last_fullsized":"2023-03-02T10:56:44.641909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:56:07.036002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.293417+0000","last_change":"2023-03-02T10:55:10.619811+0000","last_active":"2023-03-02T10:56:19.293417+0000","last_peered":"2023-03-02T10:56:19.293417+0000","last_clean":"2023-03-02T10:56:19.293417+0000","last_became_active":"2023-03-02T10:55:10.617190+0000","last_became_peered":"2023-03-02T10:55:10.617190+0000","last_unstale":"2023-03-02T10:56:19.293417+0000","last_undegraded":"2023-03-02T10:56:19.293417+0000","last_fullsized":"2023-03-02T10:56:19.293417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:20:52.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542992+0000","last_change":"2023-03-02T10:55:10.155970+0000","last_active":"2023-03-02T10:55:49.542992+0000","last_peered":"2023-03-02T10:55:49.542992+0000","last_clean":"2023-03-02T10:55:49.542992+0000","last_became_active":"2023-03-02T10:55:10.155667+0000","last_became_peered":"2023-03-02T10:55:10.155667+0000","last_unstale":"2023-03-02T10:55:49.542992+0000","last_undegraded":"2023-03-02T10:55:49.542992+0000","last_fullsized":"2023-03-02T10:55:49.542992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:46:36.366891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302580+0000","last_change":"2023-03-02T10:55:10.623738+0000","last_active":"2023-03-02T10:56:19.302580+0000","last_peered":"2023-03-02T10:56:19.302580+0000","last_clean":"2023-03-02T10:56:19.302580+0000","last_became_active":"2023-03-02T10:55:10.620543+0000","last_became_peered":"2023-03-02T10:55:10.620543+0000","last_unstale":"2023-03-02T10:56:19.302580+0000","last_undegraded":"2023-03-02T10:56:19.302580+0000","last_fullsized":"2023-03-02T10:56:19.302580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:44:46.238712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.148470+0000","last_change":"2023-03-02T10:55:51.148470+0000","last_active":"2023-03-02T10:55:51.148470+0000","last_peered":"2023-03-02T10:55:51.148470+0000","last_clean":"2023-03-02T10:55:51.148470+0000","last_became_active":"2023-03-02T10:55:50.544811+0000","last_became_peered":"2023-03-02T10:55:50.544811+0000","last_unstale":"2023-03-02T10:55:51.148470+0000","last_undegraded":"2023-03-02T10:55:51.148470+0000","last_fullsized":"2023-03-02T10:55:51.148470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:32:12.108148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.294276+0000","last_change":"2023-03-02T10:55:10.627844+0000","last_active":"2023-03-02T10:56:19.294276+0000","last_peered":"2023-03-02T10:56:19.294276+0000","last_clean":"2023-03-02T10:56:19.294276+0000","last_became_active":"2023-03-02T10:55:10.626972+0000","last_became_peered":"2023-03-02T10:55:10.626972+0000","last_unstale":"2023-03-02T10:56:19.294276+0000","last_undegraded":"2023-03-02T10:56:19.294276+0000","last_fullsized":"2023-03-02T10:56:19.294276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:36:58.650285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537357+0000","last_change":"2023-03-02T10:55:10.153277+0000","last_active":"2023-03-02T10:55:49.537357+0000","last_peered":"2023-03-02T10:55:49.537357+0000","last_clean":"2023-03-02T10:55:49.537357+0000","last_became_active":"2023-03-02T10:55:10.152983+0000","last_became_peered":"2023-03-02T10:55:10.152983+0000","last_unstale":"2023-03-02T10:55:49.537357+0000","last_undegraded":"2023-03-02T10:55:49.537357+0000","last_fullsized":"2023-03-02T10:55:49.537357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:15.045107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298653+0000","last_change":"2023-03-02T10:55:10.630295+0000","last_active":"2023-03-02T10:56:19.298653+0000","last_peered":"2023-03-02T10:56:19.298653+0000","last_clean":"2023-03-02T10:56:19.298653+0000","last_became_active":"2023-03-02T10:55:10.629004+0000","last_became_peered":"2023-03-02T10:55:10.629004+0000","last_unstale":"2023-03-02T10:56:19.298653+0000","last_undegraded":"2023-03-02T10:56:19.298653+0000","last_fullsized":"2023-03-02T10:56:19.298653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:05:51.414347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'7","reported_seq":110,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:41.687313+0000","last_change":"2023-03-02T10:55:10.153222+0000","last_active":"2023-03-02T10:56:41.687313+0000","last_peered":"2023-03-02T10:56:41.687313+0000","last_clean":"2023-03-02T10:56:41.687313+0000","last_became_active":"2023-03-02T10:55:10.152928+0000","last_became_peered":"2023-03-02T10:55:10.152928+0000","last_unstale":"2023-03-02T10:56:41.687313+0000","last_undegraded":"2023-03-02T10:56:41.687313+0000","last_fullsized":"2023-03-02T10:56:41.687313+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:12:56.648713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.281881+0000","last_change":"2023-03-02T10:55:10.617722+0000","last_active":"2023-03-02T10:56:19.281881+0000","last_peered":"2023-03-02T10:56:19.281881+0000","last_clean":"2023-03-02T10:56:19.281881+0000","last_became_active":"2023-03-02T10:55:10.617425+0000","last_became_peered":"2023-03-02T10:55:10.617425+0000","last_unstale":"2023-03-02T10:56:19.281881+0000","last_undegraded":"2023-03-02T10:56:19.281881+0000","last_fullsized":"2023-03-02T10:56:19.281881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:57:37.397568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:50.806747+0000","last_change":"2023-03-02T10:55:50.806747+0000","last_active":"2023-03-02T10:55:50.806747+0000","last_peered":"2023-03-02T10:55:50.806747+0000","last_clean":"2023-03-02T10:55:50.806747+0000","last_became_active":"2023-03-02T10:55:50.544008+0000","last_became_peered":"2023-03-02T10:55:50.544008+0000","last_unstale":"2023-03-02T10:55:50.806747+0000","last_undegraded":"2023-03-02T10:55:50.806747+0000","last_fullsized":"2023-03-02T10:55:50.806747+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:21:20.672207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298392+0000","last_change":"2023-03-02T10:55:10.628418+0000","last_active":"2023-03-02T10:56:19.298392+0000","last_peered":"2023-03-02T10:56:19.298392+0000","last_clean":"2023-03-02T10:56:19.298392+0000","last_became_active":"2023-03-02T10:55:10.627715+0000","last_became_peered":"2023-03-02T10:55:10.627715+0000","last_unstale":"2023-03-02T10:56:19.298392+0000","last_undegraded":"2023-03-02T10:56:19.298392+0000","last_fullsized":"2023-03-02T10:56:19.298392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:16:59.756440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539748+0000","last_change":"2023-03-02T10:55:10.158875+0000","last_active":"2023-03-02T10:55:49.539748+0000","last_peered":"2023-03-02T10:55:49.539748+0000","last_clean":"2023-03-02T10:55:49.539748+0000","last_became_active":"2023-03-02T10:55:10.157653+0000","last_became_peered":"2023-03-02T10:55:10.157653+0000","last_unstale":"2023-03-02T10:55:49.539748+0000","last_undegraded":"2023-03-02T10:55:49.539748+0000","last_fullsized":"2023-03-02T10:55:49.539748+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:50:03.808602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292893+0000","last_change":"2023-03-02T10:55:10.634280+0000","last_active":"2023-03-02T10:56:19.292893+0000","last_peered":"2023-03-02T10:56:19.292893+0000","last_clean":"2023-03-02T10:56:19.292893+0000","last_became_active":"2023-03-02T10:55:10.633764+0000","last_became_peered":"2023-03-02T10:55:10.633764+0000","last_unstale":"2023-03-02T10:56:19.292893+0000","last_undegraded":"2023-03-02T10:56:19.292893+0000","last_fullsized":"2023-03-02T10:56:19.292893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:17:25.110036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541628+0000","last_change":"2023-03-02T10:55:10.154532+0000","last_active":"2023-03-02T10:55:49.541628+0000","last_peered":"2023-03-02T10:55:49.541628+0000","last_clean":"2023-03-02T10:55:49.541628+0000","last_became_active":"2023-03-02T10:55:10.152116+0000","last_became_peered":"2023-03-02T10:55:10.152116+0000","last_unstale":"2023-03-02T10:55:49.541628+0000","last_undegraded":"2023-03-02T10:55:49.541628+0000","last_fullsized":"2023-03-02T10:55:49.541628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:19:50.439666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291548+0000","last_change":"2023-03-02T10:55:10.628790+0000","last_active":"2023-03-02T10:56:19.291548+0000","last_peered":"2023-03-02T10:56:19.291548+0000","last_clean":"2023-03-02T10:56:19.291548+0000","last_became_active":"2023-03-02T10:55:10.628452+0000","last_became_peered":"2023-03-02T10:55:10.628452+0000","last_unstale":"2023-03-02T10:56:19.291548+0000","last_undegraded":"2023-03-02T10:56:19.291548+0000","last_fullsized":"2023-03-02T10:56:19.291548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:08:30.061925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":193,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:43.689668+0000","last_change":"2023-03-02T10:55:10.152684+0000","last_active":"2023-03-02T10:56:43.689668+0000","last_peered":"2023-03-02T10:56:43.689668+0000","last_clean":"2023-03-02T10:56:43.689668+0000","last_became_active":"2023-03-02T10:55:10.152184+0000","last_became_peered":"2023-03-02T10:55:10.152184+0000","last_unstale":"2023-03-02T10:56:43.689668+0000","last_undegraded":"2023-03-02T10:56:43.689668+0000","last_fullsized":"2023-03-02T10:56:43.689668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:39:21.100760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296883+0000","last_change":"2023-03-02T10:55:10.625990+0000","last_active":"2023-03-02T10:56:19.296883+0000","last_peered":"2023-03-02T10:56:19.296883+0000","last_clean":"2023-03-02T10:56:19.296883+0000","last_became_active":"2023-03-02T10:55:10.625677+0000","last_became_peered":"2023-03-02T10:55:10.625677+0000","last_unstale":"2023-03-02T10:56:19.296883+0000","last_undegraded":"2023-03-02T10:56:19.296883+0000","last_fullsized":"2023-03-02T10:56:19.296883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:08.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539232+0000","last_change":"2023-03-02T10:55:10.151541+0000","last_active":"2023-03-02T10:55:49.539232+0000","last_peered":"2023-03-02T10:55:49.539232+0000","last_clean":"2023-03-02T10:55:49.539232+0000","last_became_active":"2023-03-02T10:55:10.151262+0000","last_became_peered":"2023-03-02T10:55:10.151262+0000","last_unstale":"2023-03-02T10:55:49.539232+0000","last_undegraded":"2023-03-02T10:55:49.539232+0000","last_fullsized":"2023-03-02T10:55:49.539232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:00:49.821191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298994+0000","last_change":"2023-03-02T10:55:10.629541+0000","last_active":"2023-03-02T10:56:19.298994+0000","last_peered":"2023-03-02T10:56:19.298994+0000","last_clean":"2023-03-02T10:56:19.298994+0000","last_became_active":"2023-03-02T10:55:10.627473+0000","last_became_peered":"2023-03-02T10:55:10.627473+0000","last_unstale":"2023-03-02T10:56:19.298994+0000","last_undegraded":"2023-03-02T10:56:19.298994+0000","last_fullsized":"2023-03-02T10:56:19.298994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:22:52.995113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542098+0000","last_change":"2023-03-02T10:55:10.152615+0000","last_active":"2023-03-02T10:55:49.542098+0000","last_peered":"2023-03-02T10:55:49.542098+0000","last_clean":"2023-03-02T10:55:49.542098+0000","last_became_active":"2023-03-02T10:55:10.152304+0000","last_became_peered":"2023-03-02T10:55:10.152304+0000","last_unstale":"2023-03-02T10:55:49.542098+0000","last_undegraded":"2023-03-02T10:55:49.542098+0000","last_fullsized":"2023-03-02T10:55:49.542098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:43:00.934520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.300447+0000","last_change":"2023-03-02T10:55:10.627653+0000","last_active":"2023-03-02T10:56:19.300447+0000","last_peered":"2023-03-02T10:56:19.300447+0000","last_clean":"2023-03-02T10:56:19.300447+0000","last_became_active":"2023-03-02T10:55:10.626570+0000","last_became_peered":"2023-03-02T10:55:10.626570+0000","last_unstale":"2023-03-02T10:56:19.300447+0000","last_undegraded":"2023-03-02T10:56:19.300447+0000","last_fullsized":"2023-03-02T10:56:19.300447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:40:39.311514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'35","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:43.690299+0000","last_change":"2023-03-02T10:55:10.149121+0000","last_active":"2023-03-02T10:56:43.690299+0000","last_peered":"2023-03-02T10:56:43.690299+0000","last_clean":"2023-03-02T10:56:43.690299+0000","last_became_active":"2023-03-02T10:55:10.148800+0000","last_became_peered":"2023-03-02T10:55:10.148800+0000","last_unstale":"2023-03-02T10:56:43.690299+0000","last_undegraded":"2023-03-02T10:56:43.690299+0000","last_fullsized":"2023-03-02T10:56:43.690299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:32:30.918248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61882,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":182,"num_read_kb":146,"num_write":37,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.294314+0000","last_change":"2023-03-02T10:55:10.625497+0000","last_active":"2023-03-02T10:56:19.294314+0000","last_peered":"2023-03-02T10:56:19.294314+0000","last_clean":"2023-03-02T10:56:19.294314+0000","last_became_active":"2023-03-02T10:55:10.625037+0000","last_became_peered":"2023-03-02T10:55:10.625037+0000","last_unstale":"2023-03-02T10:56:19.294314+0000","last_undegraded":"2023-03-02T10:56:19.294314+0000","last_fullsized":"2023-03-02T10:56:19.294314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:55:56.478111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534121+0000","last_change":"2023-03-02T10:55:10.148957+0000","last_active":"2023-03-02T10:55:49.534121+0000","last_peered":"2023-03-02T10:55:49.534121+0000","last_clean":"2023-03-02T10:55:49.534121+0000","last_became_active":"2023-03-02T10:55:10.148624+0000","last_became_peered":"2023-03-02T10:55:10.148624+0000","last_unstale":"2023-03-02T10:55:49.534121+0000","last_undegraded":"2023-03-02T10:55:49.534121+0000","last_fullsized":"2023-03-02T10:55:49.534121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:53:33.062648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296476+0000","last_change":"2023-03-02T10:55:10.633311+0000","last_active":"2023-03-02T10:56:19.296476+0000","last_peered":"2023-03-02T10:56:19.296476+0000","last_clean":"2023-03-02T10:56:19.296476+0000","last_became_active":"2023-03-02T10:55:10.632174+0000","last_became_peered":"2023-03-02T10:55:10.632174+0000","last_unstale":"2023-03-02T10:56:19.296476+0000","last_undegraded":"2023-03-02T10:56:19.296476+0000","last_fullsized":"2023-03-02T10:56:19.296476+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:50:47.536118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542053+0000","last_change":"2023-03-02T10:55:10.153392+0000","last_active":"2023-03-02T10:55:49.542053+0000","last_peered":"2023-03-02T10:55:49.542053+0000","last_clean":"2023-03-02T10:55:49.542053+0000","last_became_active":"2023-03-02T10:55:10.152513+0000","last_became_peered":"2023-03-02T10:55:10.152513+0000","last_unstale":"2023-03-02T10:55:49.542053+0000","last_undegraded":"2023-03-02T10:55:49.542053+0000","last_fullsized":"2023-03-02T10:55:49.542053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:26:40.675118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.299896+0000","last_change":"2023-03-02T10:55:10.631953+0000","last_active":"2023-03-02T10:56:19.299896+0000","last_peered":"2023-03-02T10:56:19.299896+0000","last_clean":"2023-03-02T10:56:19.299896+0000","last_became_active":"2023-03-02T10:55:10.631624+0000","last_became_peered":"2023-03-02T10:55:10.631624+0000","last_unstale":"2023-03-02T10:56:19.299896+0000","last_undegraded":"2023-03-02T10:56:19.299896+0000","last_fullsized":"2023-03-02T10:56:19.299896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:15:20.136421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":110,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:41.689782+0000","last_change":"2023-03-02T10:55:10.150597+0000","last_active":"2023-03-02T10:56:41.689782+0000","last_peered":"2023-03-02T10:56:41.689782+0000","last_clean":"2023-03-02T10:56:41.689782+0000","last_became_active":"2023-03-02T10:55:10.150024+0000","last_became_peered":"2023-03-02T10:55:10.150024+0000","last_unstale":"2023-03-02T10:56:41.689782+0000","last_undegraded":"2023-03-02T10:56:41.689782+0000","last_fullsized":"2023-03-02T10:56:41.689782+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:30.043240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291417+0000","last_change":"2023-03-02T10:55:10.633052+0000","last_active":"2023-03-02T10:56:19.291417+0000","last_peered":"2023-03-02T10:56:19.291417+0000","last_clean":"2023-03-02T10:56:19.291417+0000","last_became_active":"2023-03-02T10:55:10.632766+0000","last_became_peered":"2023-03-02T10:55:10.632766+0000","last_unstale":"2023-03-02T10:56:19.291417+0000","last_undegraded":"2023-03-02T10:56:19.291417+0000","last_fullsized":"2023-03-02T10:56:19.291417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:55.079556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.536268+0000","last_change":"2023-03-02T10:55:10.154559+0000","last_active":"2023-03-02T10:55:49.536268+0000","last_peered":"2023-03-02T10:55:49.536268+0000","last_clean":"2023-03-02T10:55:49.536268+0000","last_became_active":"2023-03-02T10:55:10.154058+0000","last_became_peered":"2023-03-02T10:55:10.154058+0000","last_unstale":"2023-03-02T10:55:49.536268+0000","last_undegraded":"2023-03-02T10:55:49.536268+0000","last_fullsized":"2023-03-02T10:55:49.536268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:23:26.823020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298189+0000","last_change":"2023-03-02T10:55:10.622951+0000","last_active":"2023-03-02T10:56:19.298189+0000","last_peered":"2023-03-02T10:56:19.298189+0000","last_clean":"2023-03-02T10:56:19.298189+0000","last_became_active":"2023-03-02T10:55:10.622643+0000","last_became_peered":"2023-03-02T10:55:10.622643+0000","last_unstale":"2023-03-02T10:56:19.298189+0000","last_undegraded":"2023-03-02T10:56:19.298189+0000","last_fullsized":"2023-03-02T10:56:19.298189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:53:05.459021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:50.547995+0000","last_change":"2023-03-02T10:55:50.547995+0000","last_active":"2023-03-02T10:55:50.547995+0000","last_peered":"2023-03-02T10:55:50.547995+0000","last_clean":"2023-03-02T10:55:50.547995+0000","last_became_active":"2023-03-02T10:55:50.541460+0000","last_became_peered":"2023-03-02T10:55:50.541460+0000","last_unstale":"2023-03-02T10:55:50.547995+0000","last_undegraded":"2023-03-02T10:55:50.547995+0000","last_fullsized":"2023-03-02T10:55:50.547995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:02:50.853731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.299636+0000","last_change":"2023-03-02T10:55:10.633149+0000","last_active":"2023-03-02T10:56:19.299636+0000","last_peered":"2023-03-02T10:56:19.299636+0000","last_clean":"2023-03-02T10:56:19.299636+0000","last_became_active":"2023-03-02T10:55:10.632816+0000","last_became_peered":"2023-03-02T10:55:10.632816+0000","last_unstale":"2023-03-02T10:56:19.299636+0000","last_undegraded":"2023-03-02T10:56:19.299636+0000","last_fullsized":"2023-03-02T10:56:19.299636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:25:41.585257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533012+0000","last_change":"2023-03-02T10:55:10.150486+0000","last_active":"2023-03-02T10:55:49.533012+0000","last_peered":"2023-03-02T10:55:49.533012+0000","last_clean":"2023-03-02T10:55:49.533012+0000","last_became_active":"2023-03-02T10:55:10.150186+0000","last_became_peered":"2023-03-02T10:55:10.150186+0000","last_unstale":"2023-03-02T10:55:49.533012+0000","last_undegraded":"2023-03-02T10:55:49.533012+0000","last_fullsized":"2023-03-02T10:55:49.533012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:06:18.637162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292486+0000","last_change":"2023-03-02T10:55:10.628622+0000","last_active":"2023-03-02T10:56:19.292486+0000","last_peered":"2023-03-02T10:56:19.292486+0000","last_clean":"2023-03-02T10:56:19.292486+0000","last_became_active":"2023-03-02T10:55:10.628258+0000","last_became_peered":"2023-03-02T10:55:10.628258+0000","last_unstale":"2023-03-02T10:56:19.292486+0000","last_undegraded":"2023-03-02T10:56:19.292486+0000","last_fullsized":"2023-03-02T10:56:19.292486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:46.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":72,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:43.640833+0000","last_change":"2023-03-02T10:55:51.151512+0000","last_active":"2023-03-02T10:56:43.640833+0000","last_peered":"2023-03-02T10:56:43.640833+0000","last_clean":"2023-03-02T10:56:43.640833+0000","last_became_active":"2023-03-02T10:55:50.544349+0000","last_became_peered":"2023-03-02T10:55:50.544349+0000","last_unstale":"2023-03-02T10:56:43.640833+0000","last_undegraded":"2023-03-02T10:56:43.640833+0000","last_fullsized":"2023-03-02T10:56:43.640833+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:13.679666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.290561+0000","last_change":"2023-03-02T10:55:51.092083+0000","last_active":"2023-03-02T10:56:19.290561+0000","last_peered":"2023-03-02T10:56:19.290561+0000","last_clean":"2023-03-02T10:56:19.290561+0000","last_became_active":"2023-03-02T10:55:51.091536+0000","last_became_peered":"2023-03-02T10:55:51.091536+0000","last_unstale":"2023-03-02T10:56:19.290561+0000","last_undegraded":"2023-03-02T10:56:19.290561+0000","last_fullsized":"2023-03-02T10:56:19.290561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:18:38.983021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298285+0000","last_change":"2023-03-02T10:55:10.613814+0000","last_active":"2023-03-02T10:56:19.298285+0000","last_peered":"2023-03-02T10:56:19.298285+0000","last_clean":"2023-03-02T10:56:19.298285+0000","last_became_active":"2023-03-02T10:55:10.613496+0000","last_became_peered":"2023-03-02T10:55:10.613496+0000","last_unstale":"2023-03-02T10:56:19.298285+0000","last_undegraded":"2023-03-02T10:56:19.298285+0000","last_fullsized":"2023-03-02T10:56:19.298285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:55:58.332549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:42.690391+0000","last_change":"2023-03-02T10:55:10.160751+0000","last_active":"2023-03-02T10:56:42.690391+0000","last_peered":"2023-03-02T10:56:42.690391+0000","last_clean":"2023-03-02T10:56:42.690391+0000","last_became_active":"2023-03-02T10:55:10.160433+0000","last_became_peered":"2023-03-02T10:55:10.160433+0000","last_unstale":"2023-03-02T10:56:42.690391+0000","last_undegraded":"2023-03-02T10:56:42.690391+0000","last_fullsized":"2023-03-02T10:56:42.690391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:11:23.326464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.301472+0000","last_change":"2023-03-02T10:55:10.619761+0000","last_active":"2023-03-02T10:56:19.301472+0000","last_peered":"2023-03-02T10:56:19.301472+0000","last_clean":"2023-03-02T10:56:19.301472+0000","last_became_active":"2023-03-02T10:55:10.617361+0000","last_became_peered":"2023-03-02T10:55:10.617361+0000","last_unstale":"2023-03-02T10:56:19.301472+0000","last_undegraded":"2023-03-02T10:56:19.301472+0000","last_fullsized":"2023-03-02T10:56:19.301472+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:26:55.492653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540413+0000","last_change":"2023-03-02T10:55:10.151553+0000","last_active":"2023-03-02T10:55:49.540413+0000","last_peered":"2023-03-02T10:55:49.540413+0000","last_clean":"2023-03-02T10:55:49.540413+0000","last_became_active":"2023-03-02T10:55:10.151369+0000","last_became_peered":"2023-03-02T10:55:10.151369+0000","last_unstale":"2023-03-02T10:55:49.540413+0000","last_undegraded":"2023-03-02T10:55:49.540413+0000","last_fullsized":"2023-03-02T10:55:49.540413+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:30:42.550362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":374,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539716+0000","last_change":"2023-03-02T10:54:06.270813+0000","last_active":"2023-03-02T10:55:49.539716+0000","last_peered":"2023-03-02T10:55:49.539716+0000","last_clean":"2023-03-02T10:55:49.539716+0000","last_became_active":"2023-03-02T10:54:06.270329+0000","last_became_peered":"2023-03-02T10:54:06.270329+0000","last_unstale":"2023-03-02T10:55:49.539716+0000","last_undegraded":"2023-03-02T10:55:49.539716+0000","last_fullsized":"2023-03-02T10:55:49.539716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_clean_scrub_stamp":"2023-03-02T10:51:04.207601+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:07.546806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.288665+0000","last_change":"2023-03-02T10:55:10.629032+0000","last_active":"2023-03-02T10:56:19.288665+0000","last_peered":"2023-03-02T10:56:19.288665+0000","last_clean":"2023-03-02T10:56:19.288665+0000","last_became_active":"2023-03-02T10:55:10.628696+0000","last_became_peered":"2023-03-02T10:55:10.628696+0000","last_unstale":"2023-03-02T10:56:19.288665+0000","last_undegraded":"2023-03-02T10:56:19.288665+0000","last_fullsized":"2023-03-02T10:56:19.288665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:32:58.399900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539930+0000","last_change":"2023-03-02T10:55:10.153240+0000","last_active":"2023-03-02T10:55:49.539930+0000","last_peered":"2023-03-02T10:55:49.539930+0000","last_clean":"2023-03-02T10:55:49.539930+0000","last_became_active":"2023-03-02T10:55:10.152977+0000","last_became_peered":"2023-03-02T10:55:10.152977+0000","last_unstale":"2023-03-02T10:55:49.539930+0000","last_undegraded":"2023-03-02T10:55:49.539930+0000","last_fullsized":"2023-03-02T10:55:49.539930+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:46:49.873113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537639+0000","last_change":"2023-03-02T10:55:10.154392+0000","last_active":"2023-03-02T10:55:49.537639+0000","last_peered":"2023-03-02T10:55:49.537639+0000","last_clean":"2023-03-02T10:55:49.537639+0000","last_became_active":"2023-03-02T10:55:10.154110+0000","last_became_peered":"2023-03-02T10:55:10.154110+0000","last_unstale":"2023-03-02T10:55:49.537639+0000","last_undegraded":"2023-03-02T10:55:49.537639+0000","last_fullsized":"2023-03-02T10:55:49.537639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:11:05.910487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291035+0000","last_change":"2023-03-02T10:55:10.627181+0000","last_active":"2023-03-02T10:56:19.291035+0000","last_peered":"2023-03-02T10:56:19.291035+0000","last_clean":"2023-03-02T10:56:19.291035+0000","last_became_active":"2023-03-02T10:55:10.626891+0000","last_became_peered":"2023-03-02T10:55:10.626891+0000","last_unstale":"2023-03-02T10:56:19.291035+0000","last_undegraded":"2023-03-02T10:56:19.291035+0000","last_fullsized":"2023-03-02T10:56:19.291035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:37.990553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:23.744621+0000","last_change":"2023-03-02T10:55:10.146146+0000","last_active":"2023-03-02T10:56:23.744621+0000","last_peered":"2023-03-02T10:56:23.744621+0000","last_clean":"2023-03-02T10:56:23.744621+0000","last_became_active":"2023-03-02T10:55:10.145824+0000","last_became_peered":"2023-03-02T10:55:10.145824+0000","last_unstale":"2023-03-02T10:56:23.744621+0000","last_undegraded":"2023-03-02T10:56:23.744621+0000","last_fullsized":"2023-03-02T10:56:23.744621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:05:35.846016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.287810+0000","last_change":"2023-03-02T10:55:10.636566+0000","last_active":"2023-03-02T10:56:19.287810+0000","last_peered":"2023-03-02T10:56:19.287810+0000","last_clean":"2023-03-02T10:56:19.287810+0000","last_became_active":"2023-03-02T10:55:10.636033+0000","last_became_peered":"2023-03-02T10:55:10.636033+0000","last_unstale":"2023-03-02T10:56:19.287810+0000","last_undegraded":"2023-03-02T10:56:19.287810+0000","last_fullsized":"2023-03-02T10:56:19.287810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:35:24.955628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540621+0000","last_change":"2023-03-02T10:55:10.156550+0000","last_active":"2023-03-02T10:55:49.540621+0000","last_peered":"2023-03-02T10:55:49.540621+0000","last_clean":"2023-03-02T10:55:49.540621+0000","last_became_active":"2023-03-02T10:55:10.156286+0000","last_became_peered":"2023-03-02T10:55:10.156286+0000","last_unstale":"2023-03-02T10:55:49.540621+0000","last_undegraded":"2023-03-02T10:55:49.540621+0000","last_fullsized":"2023-03-02T10:55:49.540621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:45:51.476117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297640+0000","last_change":"2023-03-02T10:55:10.631769+0000","last_active":"2023-03-02T10:56:19.297640+0000","last_peered":"2023-03-02T10:56:19.297640+0000","last_clean":"2023-03-02T10:56:19.297640+0000","last_became_active":"2023-03-02T10:55:10.631429+0000","last_became_peered":"2023-03-02T10:55:10.631429+0000","last_unstale":"2023-03-02T10:56:19.297640+0000","last_undegraded":"2023-03-02T10:56:19.297640+0000","last_fullsized":"2023-03-02T10:56:19.297640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:42:52.764994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534314+0000","last_change":"2023-03-02T10:55:10.152435+0000","last_active":"2023-03-02T10:55:49.534314+0000","last_peered":"2023-03-02T10:55:49.534314+0000","last_clean":"2023-03-02T10:55:49.534314+0000","last_became_active":"2023-03-02T10:55:10.152008+0000","last_became_peered":"2023-03-02T10:55:10.152008+0000","last_unstale":"2023-03-02T10:55:49.534314+0000","last_undegraded":"2023-03-02T10:55:49.534314+0000","last_fullsized":"2023-03-02T10:55:49.534314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:46:39.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.262937+0000","last_change":"2023-03-02T10:55:10.624337+0000","last_active":"2023-03-02T10:56:19.262937+0000","last_peered":"2023-03-02T10:56:19.262937+0000","last_clean":"2023-03-02T10:56:19.262937+0000","last_became_active":"2023-03-02T10:55:10.623979+0000","last_became_peered":"2023-03-02T10:55:10.623979+0000","last_unstale":"2023-03-02T10:56:19.262937+0000","last_undegraded":"2023-03-02T10:56:19.262937+0000","last_fullsized":"2023-03-02T10:56:19.262937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:14:39.173460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542638+0000","last_change":"2023-03-02T10:55:10.152406+0000","last_active":"2023-03-02T10:55:49.542638+0000","last_peered":"2023-03-02T10:55:49.542638+0000","last_clean":"2023-03-02T10:55:49.542638+0000","last_became_active":"2023-03-02T10:55:10.152026+0000","last_became_peered":"2023-03-02T10:55:10.152026+0000","last_unstale":"2023-03-02T10:55:49.542638+0000","last_undegraded":"2023-03-02T10:55:49.542638+0000","last_fullsized":"2023-03-02T10:55:49.542638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:49:17.617792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296326+0000","last_change":"2023-03-02T10:55:10.620061+0000","last_active":"2023-03-02T10:56:19.296326+0000","last_peered":"2023-03-02T10:56:19.296326+0000","last_clean":"2023-03-02T10:56:19.296326+0000","last_became_active":"2023-03-02T10:55:10.619753+0000","last_became_peered":"2023-03-02T10:55:10.619753+0000","last_unstale":"2023-03-02T10:56:19.296326+0000","last_undegraded":"2023-03-02T10:56:19.296326+0000","last_fullsized":"2023-03-02T10:56:19.296326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:40:02.479733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534006+0000","last_change":"2023-03-02T10:55:10.149827+0000","last_active":"2023-03-02T10:55:49.534006+0000","last_peered":"2023-03-02T10:55:49.534006+0000","last_clean":"2023-03-02T10:55:49.534006+0000","last_became_active":"2023-03-02T10:55:10.149522+0000","last_became_peered":"2023-03-02T10:55:10.149522+0000","last_unstale":"2023-03-02T10:55:49.534006+0000","last_undegraded":"2023-03-02T10:55:49.534006+0000","last_fullsized":"2023-03-02T10:55:49.534006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:23:27.072235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292559+0000","last_change":"2023-03-02T10:55:10.618992+0000","last_active":"2023-03-02T10:56:19.292559+0000","last_peered":"2023-03-02T10:56:19.292559+0000","last_clean":"2023-03-02T10:56:19.292559+0000","last_became_active":"2023-03-02T10:55:10.618678+0000","last_became_peered":"2023-03-02T10:55:10.618678+0000","last_unstale":"2023-03-02T10:56:19.292559+0000","last_undegraded":"2023-03-02T10:56:19.292559+0000","last_fullsized":"2023-03-02T10:56:19.292559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:33:26.966579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.321810+0000","last_change":"2023-03-02T10:55:51.321810+0000","last_active":"2023-03-02T10:55:51.321810+0000","last_peered":"2023-03-02T10:55:51.321810+0000","last_clean":"2023-03-02T10:55:51.321810+0000","last_became_active":"2023-03-02T10:55:50.544110+0000","last_became_peered":"2023-03-02T10:55:50.544110+0000","last_unstale":"2023-03-02T10:55:51.321810+0000","last_undegraded":"2023-03-02T10:55:51.321810+0000","last_fullsized":"2023-03-02T10:55:51.321810+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:59:33.358979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302786+0000","last_change":"2023-03-02T10:55:10.625524+0000","last_active":"2023-03-02T10:56:19.302786+0000","last_peered":"2023-03-02T10:56:19.302786+0000","last_clean":"2023-03-02T10:56:19.302786+0000","last_became_active":"2023-03-02T10:55:10.625249+0000","last_became_peered":"2023-03-02T10:55:10.625249+0000","last_unstale":"2023-03-02T10:56:19.302786+0000","last_undegraded":"2023-03-02T10:56:19.302786+0000","last_fullsized":"2023-03-02T10:56:19.302786+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:03:16.230549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:40.733254+0000","last_change":"2023-03-02T10:55:10.159691+0000","last_active":"2023-03-02T10:56:40.733254+0000","last_peered":"2023-03-02T10:56:40.733254+0000","last_clean":"2023-03-02T10:56:40.733254+0000","last_became_active":"2023-03-02T10:55:10.159360+0000","last_became_peered":"2023-03-02T10:55:10.159360+0000","last_unstale":"2023-03-02T10:56:40.733254+0000","last_undegraded":"2023-03-02T10:56:40.733254+0000","last_fullsized":"2023-03-02T10:56:40.733254+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:21:05.305932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302559+0000","last_change":"2023-03-02T10:55:10.621119+0000","last_active":"2023-03-02T10:56:19.302559+0000","last_peered":"2023-03-02T10:56:19.302559+0000","last_clean":"2023-03-02T10:56:19.302559+0000","last_became_active":"2023-03-02T10:55:10.620370+0000","last_became_peered":"2023-03-02T10:55:10.620370+0000","last_unstale":"2023-03-02T10:56:19.302559+0000","last_undegraded":"2023-03-02T10:56:19.302559+0000","last_fullsized":"2023-03-02T10:56:19.302559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:33:20.678615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541953+0000","last_change":"2023-03-02T10:55:10.155403+0000","last_active":"2023-03-02T10:55:49.541953+0000","last_peered":"2023-03-02T10:55:49.541953+0000","last_clean":"2023-03-02T10:55:49.541953+0000","last_became_active":"2023-03-02T10:55:10.152547+0000","last_became_peered":"2023-03-02T10:55:10.152547+0000","last_unstale":"2023-03-02T10:55:49.541953+0000","last_undegraded":"2023-03-02T10:55:49.541953+0000","last_fullsized":"2023-03-02T10:55:49.541953+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:18:30.564037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291964+0000","last_change":"2023-03-02T10:55:51.094932+0000","last_active":"2023-03-02T10:56:19.291964+0000","last_peered":"2023-03-02T10:56:19.291964+0000","last_clean":"2023-03-02T10:56:19.291964+0000","last_became_active":"2023-03-02T10:55:51.091808+0000","last_became_peered":"2023-03-02T10:55:51.091808+0000","last_unstale":"2023-03-02T10:56:19.291964+0000","last_undegraded":"2023-03-02T10:56:19.291964+0000","last_fullsized":"2023-03-02T10:56:19.291964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:26:42.737673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539999+0000","last_change":"2023-03-02T10:55:10.159307+0000","last_active":"2023-03-02T10:55:49.539999+0000","last_peered":"2023-03-02T10:55:49.539999+0000","last_clean":"2023-03-02T10:55:49.539999+0000","last_became_active":"2023-03-02T10:55:10.158979+0000","last_became_peered":"2023-03-02T10:55:10.158979+0000","last_unstale":"2023-03-02T10:55:49.539999+0000","last_undegraded":"2023-03-02T10:55:49.539999+0000","last_fullsized":"2023-03-02T10:55:49.539999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:13:54.984801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297738+0000","last_change":"2023-03-02T10:55:10.630995+0000","last_active":"2023-03-02T10:56:19.297738+0000","last_peered":"2023-03-02T10:56:19.297738+0000","last_clean":"2023-03-02T10:56:19.297738+0000","last_became_active":"2023-03-02T10:55:10.630654+0000","last_became_peered":"2023-03-02T10:55:10.630654+0000","last_unstale":"2023-03-02T10:56:19.297738+0000","last_undegraded":"2023-03-02T10:56:19.297738+0000","last_fullsized":"2023-03-02T10:56:19.297738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:25:50.945152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297504+0000","last_change":"2023-03-02T10:55:10.633263+0000","last_active":"2023-03-02T10:56:19.297504+0000","last_peered":"2023-03-02T10:56:19.297504+0000","last_clean":"2023-03-02T10:56:19.297504+0000","last_became_active":"2023-03-02T10:55:10.632796+0000","last_became_peered":"2023-03-02T10:55:10.632796+0000","last_unstale":"2023-03-02T10:56:19.297504+0000","last_undegraded":"2023-03-02T10:56:19.297504+0000","last_fullsized":"2023-03-02T10:56:19.297504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:04:02.060792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.286082+0000","last_change":"2023-03-02T10:55:10.620195+0000","last_active":"2023-03-02T10:56:19.286082+0000","last_peered":"2023-03-02T10:56:19.286082+0000","last_clean":"2023-03-02T10:56:19.286082+0000","last_became_active":"2023-03-02T10:55:10.619904+0000","last_became_peered":"2023-03-02T10:55:10.619904+0000","last_unstale":"2023-03-02T10:56:19.286082+0000","last_undegraded":"2023-03-02T10:56:19.286082+0000","last_fullsized":"2023-03-02T10:56:19.286082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:03:43.176587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.286504+0000","last_change":"2023-03-02T10:55:10.619427+0000","last_active":"2023-03-02T10:56:19.286504+0000","last_peered":"2023-03-02T10:56:19.286504+0000","last_clean":"2023-03-02T10:56:19.286504+0000","last_became_active":"2023-03-02T10:55:10.618184+0000","last_became_peered":"2023-03-02T10:55:10.618184+0000","last_unstale":"2023-03-02T10:56:19.286504+0000","last_undegraded":"2023-03-02T10:56:19.286504+0000","last_fullsized":"2023-03-02T10:56:19.286504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:00.907091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.295503+0000","last_change":"2023-03-02T10:55:10.630058+0000","last_active":"2023-03-02T10:56:19.295503+0000","last_peered":"2023-03-02T10:56:19.295503+0000","last_clean":"2023-03-02T10:56:19.295503+0000","last_became_active":"2023-03-02T10:55:10.626022+0000","last_became_peered":"2023-03-02T10:55:10.626022+0000","last_unstale":"2023-03-02T10:56:19.295503+0000","last_undegraded":"2023-03-02T10:56:19.295503+0000","last_fullsized":"2023-03-02T10:56:19.295503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:23:27.900984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.290432+0000","last_change":"2023-03-02T10:55:10.621984+0000","last_active":"2023-03-02T10:56:19.290432+0000","last_peered":"2023-03-02T10:56:19.290432+0000","last_clean":"2023-03-02T10:56:19.290432+0000","last_became_active":"2023-03-02T10:55:10.621636+0000","last_became_peered":"2023-03-02T10:55:10.621636+0000","last_unstale":"2023-03-02T10:56:19.290432+0000","last_undegraded":"2023-03-02T10:56:19.290432+0000","last_fullsized":"2023-03-02T10:56:19.290432+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:10:41.154358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.294292+0000","last_change":"2023-03-02T10:55:10.633194+0000","last_active":"2023-03-02T10:56:19.294292+0000","last_peered":"2023-03-02T10:56:19.294292+0000","last_clean":"2023-03-02T10:56:19.294292+0000","last_became_active":"2023-03-02T10:55:10.632860+0000","last_became_peered":"2023-03-02T10:55:10.632860+0000","last_unstale":"2023-03-02T10:56:19.294292+0000","last_undegraded":"2023-03-02T10:56:19.294292+0000","last_fullsized":"2023-03-02T10:56:19.294292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:34:58.071830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.300407+0000","last_change":"2023-03-02T10:55:10.613717+0000","last_active":"2023-03-02T10:56:19.300407+0000","last_peered":"2023-03-02T10:56:19.300407+0000","last_clean":"2023-03-02T10:56:19.300407+0000","last_became_active":"2023-03-02T10:55:10.613391+0000","last_became_peered":"2023-03-02T10:55:10.613391+0000","last_unstale":"2023-03-02T10:56:19.300407+0000","last_undegraded":"2023-03-02T10:56:19.300407+0000","last_fullsized":"2023-03-02T10:56:19.300407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:51:23.532086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297955+0000","last_change":"2023-03-02T10:55:10.637730+0000","last_active":"2023-03-02T10:56:19.297955+0000","last_peered":"2023-03-02T10:56:19.297955+0000","last_clean":"2023-03-02T10:56:19.297955+0000","last_became_active":"2023-03-02T10:55:10.637097+0000","last_became_peered":"2023-03-02T10:55:10.637097+0000","last_unstale":"2023-03-02T10:56:19.297955+0000","last_undegraded":"2023-03-02T10:56:19.297955+0000","last_fullsized":"2023-03-02T10:56:19.297955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:41:19.587933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292829+0000","last_change":"2023-03-02T10:55:10.617374+0000","last_active":"2023-03-02T10:56:19.292829+0000","last_peered":"2023-03-02T10:56:19.292829+0000","last_clean":"2023-03-02T10:56:19.292829+0000","last_became_active":"2023-03-02T10:55:10.617061+0000","last_became_peered":"2023-03-02T10:55:10.617061+0000","last_unstale":"2023-03-02T10:56:19.292829+0000","last_undegraded":"2023-03-02T10:56:19.292829+0000","last_fullsized":"2023-03-02T10:56:19.292829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:03:41.270487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.287281+0000","last_change":"2023-03-02T10:55:10.622246+0000","last_active":"2023-03-02T10:56:19.287281+0000","last_peered":"2023-03-02T10:56:19.287281+0000","last_clean":"2023-03-02T10:56:19.287281+0000","last_became_active":"2023-03-02T10:55:10.621938+0000","last_became_peered":"2023-03-02T10:55:10.621938+0000","last_unstale":"2023-03-02T10:56:19.287281+0000","last_undegraded":"2023-03-02T10:56:19.287281+0000","last_fullsized":"2023-03-02T10:56:19.287281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:39:35.605113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.301744+0000","last_change":"2023-03-02T10:55:10.623502+0000","last_active":"2023-03-02T10:56:19.301744+0000","last_peered":"2023-03-02T10:56:19.301744+0000","last_clean":"2023-03-02T10:56:19.301744+0000","last_became_active":"2023-03-02T10:55:10.623160+0000","last_became_peered":"2023-03-02T10:55:10.623160+0000","last_unstale":"2023-03-02T10:56:19.301744+0000","last_undegraded":"2023-03-02T10:56:19.301744+0000","last_fullsized":"2023-03-02T10:56:19.301744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:30:49.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296470+0000","last_change":"2023-03-02T10:55:10.636452+0000","last_active":"2023-03-02T10:56:19.296470+0000","last_peered":"2023-03-02T10:56:19.296470+0000","last_clean":"2023-03-02T10:56:19.296470+0000","last_became_active":"2023-03-02T10:55:10.636176+0000","last_became_peered":"2023-03-02T10:55:10.636176+0000","last_unstale":"2023-03-02T10:56:19.296470+0000","last_undegraded":"2023-03-02T10:56:19.296470+0000","last_fullsized":"2023-03-02T10:56:19.296470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:51.303295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297592+0000","last_change":"2023-03-02T10:55:51.092168+0000","last_active":"2023-03-02T10:56:19.297592+0000","last_peered":"2023-03-02T10:56:19.297592+0000","last_clean":"2023-03-02T10:56:19.297592+0000","last_became_active":"2023-03-02T10:55:51.091735+0000","last_became_peered":"2023-03-02T10:55:51.091735+0000","last_unstale":"2023-03-02T10:56:19.297592+0000","last_undegraded":"2023-03-02T10:56:19.297592+0000","last_fullsized":"2023-03-02T10:56:19.297592+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:25:46.235073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":254019,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69286,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":873,"num_read_kb":525,"num_write":244,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":610,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":202194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416416,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6112,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739040,"statfs":{"total":95995035648,"available":95988776960,"internally_reserved":0,"allocated":942080,"data_stored":448834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.8109999999999999,"5min":3.8109999999999999,"15min":3.8109999999999999},"last":0.495}]},{"osd":1,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.48699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.745,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.624}]},{"osd":2,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.37},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.55500000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90300000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80400000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80000000000000004,"5min":1.214,"15min":1.214},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95999999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97799999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98999999999999999,"5min":1.53,"15min":1.53},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.58699999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.032,"5min":1.125,"15min":1.125},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.70199999999999996},"min":{"1min":0.54900000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.89000000000000001,"5min":1.089,"15min":1.089},"last":0.71999999999999997}]},{"osd":8,"last update":"Thu Mar 2 10:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.69999999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78800000000000003,"15min":0.78900000000000003},"min":{"1min":0.65400000000000003,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94499999999999995,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78300000000000003,"15min":0.77900000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1439999999999999,"5min":1.194,"15min":1.194},"last":0.77500000000000002}]},{"osd":10,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.745},"min":{"1min":0.59199999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.92800000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.63800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":1.49,"15min":1.49},"last":0.753}]}]},{"osd":10,"up_from":71,"seq":304942678051,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6572,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738580,"statfs":{"total":95995035648,"available":95988305920,"internally_reserved":0,"allocated":1085440,"data_stored":1101341,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76600000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64600000000000002,"15min":0.64400000000000002},"min":{"1min":0.47199999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69599999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.099,"5min":2.121,"15min":2.121},"last":0.62}]},{"osd":4,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.52000000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.25,"5min":1.97,"15min":1.97},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.52000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0580000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.56799999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.998,"5min":1.097,"15min":1.097},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.53500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.67200000000000004}]},{"osd":9,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.81000000000000005,"15min":0.82099999999999995},"min":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.139,"5min":1.28,"15min":1.28},"last":0.752},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.86199999999999999,"15min":0.88800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96699999999999997,"5min":2.302,"15min":2.302},"last":0.63300000000000001}]},{"osd":11,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77500000000000002,"15min":0.77600000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97899999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69399999999999995}]}]},{"osd":9,"up_from":66,"seq":283467841576,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6260,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738892,"statfs":{"total":95995035648,"available":95988625408,"internally_reserved":0,"allocated":962560,"data_stored":448277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.55200000000000005,"5min":0.871,"15min":0.871},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.58799999999999997,"5min":1.823,"15min":1.823},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67900000000000005,"15min":0.69199999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85499999999999998,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.73599999999999999,"15min":0.76000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.747,"5min":0.999,"15min":0.999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.71899999999999997,"15min":0.73899999999999999},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79700000000000004,"5min":1.266,"15min":1.266},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.65900000000000003,"15min":0.68899999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63400000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.36099999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57799999999999996,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.442}]},{"osd":4,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.92700000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.85899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.83099999999999996,"15min":0.86099999999999999},"min":{"1min":0.53700000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.86899999999999999,"5min":1.956,"15min":1.956},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.84199999999999997,"15min":0.876},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.82999999999999996,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.82199999999999995,"15min":0.85699999999999998},"min":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2569999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.82799999999999996,"15min":0.85899999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89700000000000002,"5min":1.452,"15min":1.452},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.90000000000000002,"15min":0.93000000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.86899999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.89600000000000002,"15min":0.92700000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2130000000000001,"5min":1.522,"15min":1.522},"last":0.72499999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95999999999999996,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.93400000000000005,"15min":0.96499999999999997},"min":{"1min":0.63100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.90600000000000003,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.624}]},{"osd":10,"last update":"Thu Mar 2 10:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.83899999999999997,"15min":0.85299999999999998},"min":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.749}]}]},{"osd":8,"up_from":59,"seq":253403070508,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6440,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738712,"statfs":{"total":95995035648,"available":95988441088,"internally_reserved":0,"allocated":950272,"data_stored":448494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.60399999999999998,"15min":0.54000000000000004},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":5.7919999999999998,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.63400000000000001,"15min":0.58299999999999996},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.8049999999999997,"5min":5.8049999999999997,"15min":5.8049999999999997},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.61199999999999999,"15min":0.58199999999999996},"min":{"1min":0.52900000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81699999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61399999999999999,"15min":0.59799999999999998},"min":{"1min":0.56000000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47099999999999997,"15min":0.45700000000000002},"min":{"1min":0.42699999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.63},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.47999999999999998,"15min":0.46899999999999997},"min":{"1min":0.45400000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.502}]},{"osd":3,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":0.71499999999999997,"15min":0.64100000000000001},"min":{"1min":0.48499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.62},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.68899999999999995,"15min":0.63100000000000001},"min":{"1min":0.49399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.3940000000000001,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.60099999999999998,"15min":0.57899999999999996},"min":{"1min":0.53500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.64500000000000002,"15min":0.627},"min":{"1min":0.64300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84499999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.59599999999999997,"15min":0.57799999999999996},"min":{"1min":0.57499999999999996,"5min":0.312,"15min":0.312},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.46500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.71999999999999997,"15min":0.69699999999999995},"min":{"1min":0.63900000000000001,"5min":0.377,"15min":0.377},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":0.80300000000000005,"15min":0.747},"min":{"1min":0.64200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":3.9089999999999998,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.748}]},{"osd":7,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.71199999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.70899999999999996,"15min":0.68899999999999995},"min":{"1min":0.626,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90100000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.83399999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.71499999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.05,"5min":0.79700000000000004,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Mar 2 10:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.71699999999999997,"15min":0.69699999999999995},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.76900000000000002,"15min":0.753},"min":{"1min":0.77900000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.88500000000000001}]},{"osd":11,"last update":"Thu Mar 2 10:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.82699999999999996}]}]},{"osd":7,"up_from":52,"seq":223338299440,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6556,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738596,"statfs":{"total":95995035648,"available":95988322304,"internally_reserved":0,"allocated":1003520,"data_stored":1041123,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84499999999999997,"5min":1.034,"15min":1.034},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.41499999999999998},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60799999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.76100000000000001,"5min":1.129,"15min":1.129},"last":0.441},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.438,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80200000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81899999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70599999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.497}]},{"osd":5,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63}]},{"osd":6,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.46000000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84899999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90500000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58699999999999997}]},{"osd":8,"last update":"Thu Mar 2 10:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84899999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91500000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77700000000000002}]},{"osd":9,"last update":"Thu Mar 2 10:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.58899999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98199999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.66000000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.69399999999999995}]},{"osd":10,"last update":"Thu Mar 2 10:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.502,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66000000000000003}]},{"osd":11,"last update":"Thu Mar 2 10:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.748}]}]},{"osd":6,"up_from":47,"seq":201863462966,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6368,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738784,"statfs":{"total":95995035648,"available":95988514816,"internally_reserved":0,"allocated":942080,"data_stored":447893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42099999999999999,"15min":0.40400000000000003},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.44700000000000001,"15min":0.438},"min":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69699999999999995,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.748,"5min":0.999,"15min":0.999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.46300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73499999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.58999999999999997},"min":{"1min":0.48899999999999999,"5min":0.435,"15min":0.435},"max":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.499,"15min":0.495},"min":{"1min":0.35399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84099999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.93100000000000005,"5min":1.042,"15min":1.042},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.48399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86499999999999999,"5min":1.069,"15min":1.069},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68799999999999994,"15min":0.66700000000000004},"min":{"1min":0.502,"5min":0.439,"15min":0.439},"max":{"1min":0.81999999999999995,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70899999999999996,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":1.03},"last":0.85099999999999998}]},{"osd":7,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.51600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.89000000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.73499999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.82299999999999995}]},{"osd":8,"last update":"Thu Mar 2 10:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88100000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.81100000000000005},"min":{"1min":0.61499999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.99199999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.88800000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.84099999999999997,"15min":0.86199999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97099999999999997,"5min":1.234,"15min":1.234},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.018,"5min":1.163,"15min":1.163},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.61299999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.86299999999999999,"15min":0.88100000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":0.94599999999999995,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.97299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7516,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":93737636,"statfs":{"total":95995035648,"available":95987339264,"internally_reserved":0,"allocated":1003520,"data_stored":510650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51000000000000001,"15min":0.48799999999999999},"min":{"1min":0.36499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.75,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.505,"15min":0.502},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81100000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.52000000000000002},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76900000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.56999999999999995,"15min":0.53700000000000003},"min":{"1min":0.44600000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Mar 2 10:56:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57699999999999996,"15min":0.54200000000000004},"min":{"1min":0.432,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90600000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.55600000000000005},"min":{"1min":0.44600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91700000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Mar 2 10:55:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.443,"15min":0.40899999999999997},"min":{"1min":0.29199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.53000000000000003,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.65000000000000002,"15min":0.60999999999999999},"min":{"1min":0.60899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89000000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.65100000000000002,"15min":0.59699999999999998},"min":{"1min":0.57099999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.75}]},{"osd":6,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.629,"15min":0.60399999999999998},"min":{"1min":0.51900000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88600000000000001,"5min":1.097,"15min":1.097},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.68700000000000006,"15min":0.66100000000000003},"min":{"1min":0.52800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.38600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.628},{"interface":"front","average":{"1min":0.746,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.72699999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.73099999999999998,"15min":0.70299999999999996},"min":{"1min":0.67100000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98199999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.59999999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.018,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70599999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.76300000000000001},"min":{"1min":0.59999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.83299999999999996}]},{"osd":10,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.68999999999999995,"15min":0.67800000000000005},"min":{"1min":0.55000000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96299999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.61199999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.056,"5min":1.169,"15min":1.169},"last":0.77700000000000002}]},{"osd":11,"last update":"Thu Mar 2 10:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.85299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7284,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737868,"statfs":{"total":95995035648,"available":95987576832,"internally_reserved":0,"allocated":962560,"data_stored":449194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54700000000000004,"15min":0.48999999999999999},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.873,"15min":0.873},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.56200000000000006,"15min":0.50900000000000001},"min":{"1min":0.50800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.54300000000000004},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.65700000000000003,"15min":0.56799999999999995},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.782,"5min":4.782,"15min":4.782},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Mar 2 10:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.64800000000000002,"15min":0.57799999999999996},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.7569999999999997,"5min":4.7569999999999997,"15min":4.7569999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80500000000000005,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Mar 2 10:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78400000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.52100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Mar 2 10:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.36499999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.65100000000000002,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.372,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.871,"5min":1.171,"15min":1.171},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.47299999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.054,"5min":1.298,"15min":1.298},"last":0.745},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0740000000000001,"5min":1.23,"15min":1.23},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Mar 2 10:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.81299999999999994,"15min":0.82099999999999995},"min":{"1min":0.54200000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.8220000000000001,"5min":4.8220000000000001,"15min":4.8220000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76900000000000002,"15min":0.79300000000000004},"min":{"1min":0.52700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.752}]},{"osd":9,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.76400000000000001,"15min":0.78100000000000003},"min":{"1min":0.40500000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.093,"5min":1.149,"15min":1.149},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1950000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.63}]},{"osd":10,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.64200000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.91000000000000003,"5min":1.22,"15min":1.22},"last":0.47199999999999998}]},{"osd":11,"last update":"Thu Mar 2 10:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.63900000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77300000000000002,"15min":0.77100000000000002},"min":{"1min":0.66600000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.77100000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7532,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":93737620,"statfs":{"total":95995035648,"available":95987322880,"internally_reserved":0,"allocated":1019904,"data_stored":505753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.58699999999999997,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.60799999999999998,"15min":0.52800000000000002},"min":{"1min":0.39100000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":3.9239999999999999,"5min":3.9239999999999999,"15min":3.9239999999999999},"last":0.75}]},{"osd":1,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55400000000000005,"15min":0.51800000000000002},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.56799999999999995,"15min":0.51700000000000002},"min":{"1min":0.41899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.67700000000000005,"15min":0.59199999999999997},"min":{"1min":0.45700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.505},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.65900000000000003,"15min":0.60199999999999998},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.4500000000000002,"5min":4.4500000000000002,"15min":4.4500000000000002},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Mar 2 10:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Mar 2 10:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.48499999999999999,"15min":0.47499999999999998},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51100000000000001},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Mar 2 10:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":0.871,"15min":0.871},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.63400000000000001,"15min":0.61399999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":4.0490000000000004,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Mar 2 10:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.6639999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.39100000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.91500000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56200000000000006}]},{"osd":9,"last update":"Thu Mar 2 10:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.69899999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.73999999999999999,"15min":0.71899999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.1790000000000003,"5min":4.1790000000000003,"15min":4.1790000000000003},"last":0.71199999999999997}]},{"osd":10,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.51800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70299999999999996}]},{"osd":11,"last update":"Thu Mar 2 10:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.67500000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149763,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6632,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738520,"statfs":{"total":95995035648,"available":95988244480,"internally_reserved":0,"allocated":950272,"data_stored":447270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.57399999999999995,"15min":0.438},"min":{"1min":0.33300000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61699999999999999,"5min":14.122,"15min":14.122},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.54200000000000004,"15min":0.435},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59999999999999998,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61899999999999999,"15min":0.57499999999999996},"min":{"1min":0.433,"5min":0.316,"15min":0.316},"max":{"1min":0.84699999999999998,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.67600000000000005,"15min":0.59399999999999997},"min":{"1min":0.437,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65000000000000002,"5min":9.0719999999999992,"15min":9.0719999999999992},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64800000000000002,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69699999999999995,"5min":4.306,"15min":4.306},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.62},"min":{"1min":0.499,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83099999999999996,"5min":1.421,"15min":1.421},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Mar 2 10:56:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.67000000000000004,"15min":0.63300000000000001},"min":{"1min":0.51500000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.875},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.70999999999999996,"15min":0.65400000000000003},"min":{"1min":0.55600000000000005,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69999999999999996,"15min":0.65800000000000003},"min":{"1min":0.56100000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.155,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.68200000000000005,"15min":0.624},"min":{"1min":0.504,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.60499999999999998,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85599999999999998,"5min":5.0170000000000003,"15min":5.0170000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.68899999999999995,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73699999999999999,"5min":9.1270000000000007,"15min":9.1270000000000007},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Mar 2 10:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.81299999999999994,"15min":0.82699999999999996},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.748,"15min":0.71399999999999997},"min":{"1min":0.52800000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.84199999999999997}]},{"osd":8,"last update":"Thu Mar 2 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":6.9539999999999997,"5min":6.9539999999999997,"15min":6.9539999999999997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.76300000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.76500000000000001,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.82799999999999996,"15min":0.80900000000000005},"min":{"1min":0.56599999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.72899999999999998}]},{"osd":10,"last update":"Thu Mar 2 10:56:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":0.875,"15min":0.78300000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":9.0210000000000008,"5min":9.0210000000000008,"15min":9.0210000000000008},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":0.84599999999999997,"15min":0.79200000000000004},"min":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.3970000000000002,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":0.754}]},{"osd":11,"last update":"Thu Mar 2 10:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.63},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.77800000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6560,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738592,"statfs":{"total":95995035648,"available":95988318208,"internally_reserved":0,"allocated":942080,"data_stored":448279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65300000000000002,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":5.8860000000000001,"15min":5.8860000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64000000000000001,"15min":0.67400000000000004},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.95599999999999996,"5min":5.577,"15min":5.577},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38200000000000001,"15min":0.34999999999999998},"min":{"1min":0.30399999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.65700000000000003,"5min":0.872,"15min":0.872},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.35899999999999999},"min":{"1min":0.34300000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.47999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57699999999999996,"15min":0.54300000000000004},"min":{"1min":0.49199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.56399999999999995,"15min":0.53600000000000003},"min":{"1min":0.47199999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.55500000000000005},"min":{"1min":0.38700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Mar 2 10:56:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.55500000000000005},"min":{"1min":0.49099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79900000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59499999999999997,"15min":0.55800000000000005},"min":{"1min":0.51000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.745,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.61599999999999999},"min":{"1min":0.48199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82699999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Mar 2 10:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.52100000000000002},"min":{"1min":0.44500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":1.02,"15min":1.02},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Mar 2 10:56:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.70399999999999996},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.88700000000000001,"5min":1.087,"15min":1.087},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71999999999999997,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91300000000000003,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.85299999999999998}]},{"osd":9,"last update":"Thu Mar 2 10:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.751},"min":{"1min":0.50800000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1180000000000001,"5min":1.149,"15min":1.149},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.107,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.875}]},{"osd":10,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.58499999999999996,"5min":0.433,"15min":0.433},"max":{"1min":0.92800000000000005,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.51000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89500000000000002,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.629}]},{"osd":11,"last update":"Thu Mar 2 10:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.92000000000000004}]}]},{"osd":5,"up_from":39,"seq":167503724601,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6696,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738456,"statfs":{"total":95995035648,"available":95988178944,"internally_reserved":0,"allocated":1015808,"data_stored":1040511,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76900000000000002,"5min":1.51,"15min":1.51},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.41299999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84699999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56799999999999995,"15min":0.53600000000000003},"min":{"1min":0.47099999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.877,"15min":0.877},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.502,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71599999999999997,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.35699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67800000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.437},"min":{"1min":0.34100000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65300000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.56200000000000006},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76200000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.60799999999999998},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61599999999999999,"15min":0.57499999999999996},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.878,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Mar 2 10:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.54000000000000004,"5min":0.374,"15min":0.374},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.72899999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.45000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.92500000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.749,"15min":0.751},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.86399999999999999}]},{"osd":10,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.59799999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98899999999999999,"5min":1.01,"15min":1.01},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73599999999999999,"15min":0.72799999999999998},"min":{"1min":0.57499999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.82999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-02T10:56:48.281 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-03-02T10:56:48.282 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-02T10:56:48.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.467+0000 7f51b1bff700 1 -- 172.21.15.57:0/3073204974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ac103900 msgr2=0x7f51ac10a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.467+0000 7f51b1bff700 1 --2- 172.21.15.57:0/3073204974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ac103900 0x7f51ac10a1a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f51a400b0a0 tx=0x7f51a400b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.467+0000 7f51b1bff700 1 -- 172.21.15.57:0/3073204974 shutdown_connections 2023-03-02T10:56:48.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.467+0000 7f51b1bff700 1 --2- 172.21.15.57:0/3073204974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ac103900 0x7f51ac10a1a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.467+0000 7f51b1bff700 1 --2- 172.21.15.57:0/3073204974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51ac101cc0 0x7f51ac1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.467+0000 7f51b1bff700 1 --2- 172.21.15.57:0/3073204974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51ac102f50 0x7f51ac1033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.467+0000 7f51b1bff700 1 -- 172.21.15.57:0/3073204974 >> 172.21.15.57:0/3073204974 conn(0x7f51ac0fd2c0 msgr2=0x7f51ac0ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:48.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.467+0000 7f51b1bff700 1 -- 172.21.15.57:0/3073204974 shutdown_connections 2023-03-02T10:56:48.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.467+0000 7f51b1bff700 1 -- 172.21.15.57:0/3073204974 wait complete. 2023-03-02T10:56:48.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51b1bff700 1 Processor -- start 2023-03-02T10:56:48.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51b1bff700 1 -- start start 2023-03-02T10:56:48.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51b1bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51ac101cc0 0x7f51ac197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51b1bff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51ac102f50 0x7f51ac198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51b1bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ac103900 0x7f51ac19f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51b1bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac19f680 con 0x7f51ac103900 2023-03-02T10:56:48.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51b1bff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac19f7c0 con 0x7f51ac102f50 2023-03-02T10:56:48.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51b1bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac19f950 con 0x7f51ac101cc0 2023-03-02T10:56:48.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51aaffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51ac102f50 0x7f51ac198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ac103900 0x7f51ac19f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51aaffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51ac102f50 0x7f51ac198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:36976/0 (socket says 172.21.15.57:36976) 2023-03-02T10:56:48.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ac103900 0x7f51ac19f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53976/0 (socket says 172.21.15.57:53976) 2023-03-02T10:56:48.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51aaffd700 1 -- 172.21.15.57:0/2708860489 learned_addr learned my addr 172.21.15.57:0/2708860489 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:48.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51ab7fe700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51ac101cc0 0x7f51ac197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51abfff700 1 -- 172.21.15.57:0/2708860489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51ac101cc0 msgr2=0x7f51ac197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51abfff700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51ac101cc0 0x7f51ac197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51abfff700 1 -- 172.21.15.57:0/2708860489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51ac102f50 msgr2=0x7f51ac198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51abfff700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51ac102f50 0x7f51ac198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.468+0000 7f51abfff700 1 -- 172.21.15.57:0/2708860489 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a4009d00 con 0x7f51ac103900 2023-03-02T10:56:48.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.469+0000 7f51aaffd700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51ac102f50 0x7f51ac198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:48.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.469+0000 7f51abfff700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ac103900 0x7f51ac19f0b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f51a4007a60 tx=0x7f51a40078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:48.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.469+0000 7f51a8ff9700 1 -- 172.21.15.57:0/2708860489 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400e040 con 0x7f51ac103900 2023-03-02T10:56:48.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.469+0000 7f51b1bff700 1 -- 172.21.15.57:0/2708860489 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac10d620 con 0x7f51ac103900 2023-03-02T10:56:48.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.469+0000 7f51a8ff9700 1 -- 172.21.15.57:0/2708860489 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51a400be40 con 0x7f51ac103900 2023-03-02T10:56:48.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.469+0000 7f51a8ff9700 1 -- 172.21.15.57:0/2708860489 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a40052a0 con 0x7f51ac103900 2023-03-02T10:56:48.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.469+0000 7f51b1bff700 1 -- 172.21.15.57:0/2708860489 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac10d490 con 0x7f51ac103900 2023-03-02T10:56:48.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.470+0000 7f51b1bff700 1 -- 172.21.15.57:0/2708860489 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac108cb0 con 0x7f51ac103900 2023-03-02T10:56:48.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.471+0000 7f51a8ff9700 1 -- 172.21.15.57:0/2708860489 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f51a401d470 con 0x7f51ac103900 2023-03-02T10:56:48.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.472+0000 7f51a8ff9700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f519409b3a0 0x7f519409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.472+0000 7f51a8ff9700 1 -- 172.21.15.57:0/2708860489 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f51a40c6d00 con 0x7f51ac103900 2023-03-02T10:56:48.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.472+0000 7f51ab7fe700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f519409b3a0 0x7f519409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.473+0000 7f51ab7fe700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f519409b3a0 0x7f519409d850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f519c009c60 tx=0x7f519c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:48.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.475+0000 7f51a8ff9700 1 -- 172.21.15.57:0/2708860489 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f51a40926c0 con 0x7f51ac103900 2023-03-02T10:56:48.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.669+0000 7f51b1bff700 1 -- 172.21.15.57:0/2708860489 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51ac061480 con 0x7f519409b3a0 2023-03-02T10:56:48.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.679+0000 7f51a8ff9700 1 -- 172.21.15.57:0/2708860489 <== mgr.14152 v2:172.21.15.57:6800/1987811557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344331 (secure 0 0 0) 0x7f51ac061480 con 0x7f519409b3a0 2023-03-02T10:56:48.684 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:48.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:48 smithi057 ceph-mon[92072]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-02T10:56:48.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:48 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3198160912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:48.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.683+0000 7f51b1bff700 1 -- 172.21.15.57:0/2708860489 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f519409b3a0 msgr2=0x7f519409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.683+0000 7f51b1bff700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f519409b3a0 0x7f519409d850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f519c009c60 tx=0x7f519c009260 comp rx=0 tx=0).stop 2023-03-02T10:56:48.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.683+0000 7f51b1bff700 1 -- 172.21.15.57:0/2708860489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ac103900 msgr2=0x7f51ac19f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.683+0000 7f51b1bff700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ac103900 0x7f51ac19f0b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f51a4007a60 tx=0x7f51a40078e0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.683+0000 7f51b1bff700 1 -- 172.21.15.57:0/2708860489 shutdown_connections 2023-03-02T10:56:48.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.683+0000 7f51b1bff700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f519409b3a0 0x7f519409d850 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.683+0000 7f51b1bff700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ac103900 0x7f51ac19f0b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.683+0000 7f51b1bff700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51ac101cc0 0x7f51ac197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.683+0000 7f51b1bff700 1 --2- 172.21.15.57:0/2708860489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51ac102f50 0x7f51ac198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.683+0000 7f51b1bff700 1 -- 172.21.15.57:0/2708860489 >> 172.21.15.57:0/2708860489 conn(0x7f51ac0fd2c0 msgr2=0x7f51ac0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:48.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.683+0000 7f51b1bff700 1 -- 172.21.15.57:0/2708860489 shutdown_connections 2023-03-02T10:56:48.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.684+0000 7f51b1bff700 1 -- 172.21.15.57:0/2708860489 wait complete. 2023-03-02T10:56:48.688 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-03-02T10:56:48.700 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2023-03-02T10:56:47.282349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659900,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1009,"num_read_kb":644,"num_write":427,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1181469,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":853,"ondisk_log_size":853,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":80528,"kb_used_data":11504,"kb_used_omap":0,"kb_used_meta":68928,"kb_avail":1124861296,"statfs":{"total":1151940427776,"available":1151857967104,"internally_reserved":0,"allocated":11780096,"data_stored":7337619,"data_compressed":110277,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":70582272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5664,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":56,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002910"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.303694+0000","last_change":"2023-03-02T10:55:10.630366+0000","last_active":"2023-03-02T10:56:19.303694+0000","last_peered":"2023-03-02T10:56:19.303694+0000","last_clean":"2023-03-02T10:56:19.303694+0000","last_became_active":"2023-03-02T10:55:10.630035+0000","last_became_peered":"2023-03-02T10:55:10.630035+0000","last_unstale":"2023-03-02T10:56:19.303694+0000","last_undegraded":"2023-03-02T10:56:19.303694+0000","last_fullsized":"2023-03-02T10:56:19.303694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:00:41.832233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298589+0000","last_change":"2023-03-02T10:55:10.628111+0000","last_active":"2023-03-02T10:56:19.298589+0000","last_peered":"2023-03-02T10:56:19.298589+0000","last_clean":"2023-03-02T10:56:19.298589+0000","last_became_active":"2023-03-02T10:55:10.626879+0000","last_became_peered":"2023-03-02T10:55:10.626879+0000","last_unstale":"2023-03-02T10:56:19.298589+0000","last_undegraded":"2023-03-02T10:56:19.298589+0000","last_fullsized":"2023-03-02T10:56:19.298589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:08:52.120684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302330+0000","last_change":"2023-03-02T10:55:10.624392+0000","last_active":"2023-03-02T10:56:19.302330+0000","last_peered":"2023-03-02T10:56:19.302330+0000","last_clean":"2023-03-02T10:56:19.302330+0000","last_became_active":"2023-03-02T10:55:10.624095+0000","last_became_peered":"2023-03-02T10:55:10.624095+0000","last_unstale":"2023-03-02T10:56:19.302330+0000","last_undegraded":"2023-03-02T10:56:19.302330+0000","last_fullsized":"2023-03-02T10:56:19.302330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:30:55.174383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.285450+0000","last_change":"2023-03-02T10:55:10.619950+0000","last_active":"2023-03-02T10:56:19.285450+0000","last_peered":"2023-03-02T10:56:19.285450+0000","last_clean":"2023-03-02T10:56:19.285450+0000","last_became_active":"2023-03-02T10:55:10.619543+0000","last_became_peered":"2023-03-02T10:55:10.619543+0000","last_unstale":"2023-03-02T10:56:19.285450+0000","last_undegraded":"2023-03-02T10:56:19.285450+0000","last_fullsized":"2023-03-02T10:56:19.285450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:08:02.321422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291593+0000","last_change":"2023-03-02T10:55:10.626403+0000","last_active":"2023-03-02T10:56:19.291593+0000","last_peered":"2023-03-02T10:56:19.291593+0000","last_clean":"2023-03-02T10:56:19.291593+0000","last_became_active":"2023-03-02T10:55:10.626062+0000","last_became_peered":"2023-03-02T10:55:10.626062+0000","last_unstale":"2023-03-02T10:56:19.291593+0000","last_undegraded":"2023-03-02T10:56:19.291593+0000","last_fullsized":"2023-03-02T10:56:19.291593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:35:06.798468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.299050+0000","last_change":"2023-03-02T10:55:10.623903+0000","last_active":"2023-03-02T10:56:19.299050+0000","last_peered":"2023-03-02T10:56:19.299050+0000","last_clean":"2023-03-02T10:56:19.299050+0000","last_became_active":"2023-03-02T10:55:10.623422+0000","last_became_peered":"2023-03-02T10:55:10.623422+0000","last_unstale":"2023-03-02T10:56:19.299050+0000","last_undegraded":"2023-03-02T10:56:19.299050+0000","last_fullsized":"2023-03-02T10:56:19.299050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:21.066552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.289681+0000","last_change":"2023-03-02T10:55:10.633210+0000","last_active":"2023-03-02T10:56:19.289681+0000","last_peered":"2023-03-02T10:56:19.289681+0000","last_clean":"2023-03-02T10:56:19.289681+0000","last_became_active":"2023-03-02T10:55:10.632898+0000","last_became_peered":"2023-03-02T10:55:10.632898+0000","last_unstale":"2023-03-02T10:56:19.289681+0000","last_undegraded":"2023-03-02T10:56:19.289681+0000","last_fullsized":"2023-03-02T10:56:19.289681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:04.043328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292969+0000","last_change":"2023-03-02T10:55:10.634427+0000","last_active":"2023-03-02T10:56:19.292969+0000","last_peered":"2023-03-02T10:56:19.292969+0000","last_clean":"2023-03-02T10:56:19.292969+0000","last_became_active":"2023-03-02T10:55:10.634159+0000","last_became_peered":"2023-03-02T10:55:10.634159+0000","last_unstale":"2023-03-02T10:56:19.292969+0000","last_undegraded":"2023-03-02T10:56:19.292969+0000","last_fullsized":"2023-03-02T10:56:19.292969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:59:09.344860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302795+0000","last_change":"2023-03-02T10:55:10.622775+0000","last_active":"2023-03-02T10:56:19.302795+0000","last_peered":"2023-03-02T10:56:19.302795+0000","last_clean":"2023-03-02T10:56:19.302795+0000","last_became_active":"2023-03-02T10:55:10.616254+0000","last_became_peered":"2023-03-02T10:55:10.616254+0000","last_unstale":"2023-03-02T10:56:19.302795+0000","last_undegraded":"2023-03-02T10:56:19.302795+0000","last_fullsized":"2023-03-02T10:56:19.302795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:01:56.832512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.301052+0000","last_change":"2023-03-02T10:55:10.620311+0000","last_active":"2023-03-02T10:56:19.301052+0000","last_peered":"2023-03-02T10:56:19.301052+0000","last_clean":"2023-03-02T10:56:19.301052+0000","last_became_active":"2023-03-02T10:55:10.620028+0000","last_became_peered":"2023-03-02T10:55:10.620028+0000","last_unstale":"2023-03-02T10:56:19.301052+0000","last_undegraded":"2023-03-02T10:56:19.301052+0000","last_fullsized":"2023-03-02T10:56:19.301052+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:16:13.770927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302566+0000","last_change":"2023-03-02T10:55:10.621316+0000","last_active":"2023-03-02T10:56:19.302566+0000","last_peered":"2023-03-02T10:56:19.302566+0000","last_clean":"2023-03-02T10:56:19.302566+0000","last_became_active":"2023-03-02T10:55:10.620803+0000","last_became_peered":"2023-03-02T10:55:10.620803+0000","last_unstale":"2023-03-02T10:56:19.302566+0000","last_undegraded":"2023-03-02T10:56:19.302566+0000","last_fullsized":"2023-03-02T10:56:19.302566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:20:18.434138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297665+0000","last_change":"2023-03-02T10:55:10.625305+0000","last_active":"2023-03-02T10:56:19.297665+0000","last_peered":"2023-03-02T10:56:19.297665+0000","last_clean":"2023-03-02T10:56:19.297665+0000","last_became_active":"2023-03-02T10:55:10.625025+0000","last_became_peered":"2023-03-02T10:55:10.625025+0000","last_unstale":"2023-03-02T10:56:19.297665+0000","last_undegraded":"2023-03-02T10:56:19.297665+0000","last_fullsized":"2023-03-02T10:56:19.297665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:35:40.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292434+0000","last_change":"2023-03-02T10:55:10.626408+0000","last_active":"2023-03-02T10:56:19.292434+0000","last_peered":"2023-03-02T10:56:19.292434+0000","last_clean":"2023-03-02T10:56:19.292434+0000","last_became_active":"2023-03-02T10:55:10.625510+0000","last_became_peered":"2023-03-02T10:55:10.625510+0000","last_unstale":"2023-03-02T10:56:19.292434+0000","last_undegraded":"2023-03-02T10:56:19.292434+0000","last_fullsized":"2023-03-02T10:56:19.292434+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:59:10.622871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291632+0000","last_change":"2023-03-02T10:55:10.629323+0000","last_active":"2023-03-02T10:56:19.291632+0000","last_peered":"2023-03-02T10:56:19.291632+0000","last_clean":"2023-03-02T10:56:19.291632+0000","last_became_active":"2023-03-02T10:55:10.627038+0000","last_became_peered":"2023-03-02T10:55:10.627038+0000","last_unstale":"2023-03-02T10:56:19.291632+0000","last_undegraded":"2023-03-02T10:56:19.291632+0000","last_fullsized":"2023-03-02T10:56:19.291632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:57:21.241810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297389+0000","last_change":"2023-03-02T10:55:10.624312+0000","last_active":"2023-03-02T10:56:19.297389+0000","last_peered":"2023-03-02T10:56:19.297389+0000","last_clean":"2023-03-02T10:56:19.297389+0000","last_became_active":"2023-03-02T10:55:10.623997+0000","last_became_peered":"2023-03-02T10:55:10.623997+0000","last_unstale":"2023-03-02T10:56:19.297389+0000","last_undegraded":"2023-03-02T10:56:19.297389+0000","last_fullsized":"2023-03-02T10:56:19.297389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:09:43.683852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302825+0000","last_change":"2023-03-02T10:55:10.622473+0000","last_active":"2023-03-02T10:56:19.302825+0000","last_peered":"2023-03-02T10:56:19.302825+0000","last_clean":"2023-03-02T10:56:19.302825+0000","last_became_active":"2023-03-02T10:55:10.622148+0000","last_became_peered":"2023-03-02T10:55:10.622148+0000","last_unstale":"2023-03-02T10:56:19.302825+0000","last_undegraded":"2023-03-02T10:56:19.302825+0000","last_fullsized":"2023-03-02T10:56:19.302825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:54:52.132792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.303973+0000","last_change":"2023-03-02T10:55:10.630380+0000","last_active":"2023-03-02T10:56:19.303973+0000","last_peered":"2023-03-02T10:56:19.303973+0000","last_clean":"2023-03-02T10:56:19.303973+0000","last_became_active":"2023-03-02T10:55:10.630088+0000","last_became_peered":"2023-03-02T10:55:10.630088+0000","last_unstale":"2023-03-02T10:56:19.303973+0000","last_undegraded":"2023-03-02T10:56:19.303973+0000","last_fullsized":"2023-03-02T10:56:19.303973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:08:58.983902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.293634+0000","last_change":"2023-03-02T10:55:10.620547+0000","last_active":"2023-03-02T10:56:19.293634+0000","last_peered":"2023-03-02T10:56:19.293634+0000","last_clean":"2023-03-02T10:56:19.293634+0000","last_became_active":"2023-03-02T10:55:10.620225+0000","last_became_peered":"2023-03-02T10:55:10.620225+0000","last_unstale":"2023-03-02T10:56:19.293634+0000","last_undegraded":"2023-03-02T10:56:19.293634+0000","last_fullsized":"2023-03-02T10:56:19.293634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:47:38.669432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.285943+0000","last_change":"2023-03-02T10:55:10.625108+0000","last_active":"2023-03-02T10:56:19.285943+0000","last_peered":"2023-03-02T10:56:19.285943+0000","last_clean":"2023-03-02T10:56:19.285943+0000","last_became_active":"2023-03-02T10:55:10.624797+0000","last_became_peered":"2023-03-02T10:55:10.624797+0000","last_unstale":"2023-03-02T10:56:19.285943+0000","last_undegraded":"2023-03-02T10:56:19.285943+0000","last_fullsized":"2023-03-02T10:56:19.285943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:06:57.777889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":116,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:44.641909+0000","last_change":"2023-03-02T10:55:10.146541+0000","last_active":"2023-03-02T10:56:44.641909+0000","last_peered":"2023-03-02T10:56:44.641909+0000","last_clean":"2023-03-02T10:56:44.641909+0000","last_became_active":"2023-03-02T10:55:10.146239+0000","last_became_peered":"2023-03-02T10:55:10.146239+0000","last_unstale":"2023-03-02T10:56:44.641909+0000","last_undegraded":"2023-03-02T10:56:44.641909+0000","last_fullsized":"2023-03-02T10:56:44.641909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:56:07.036002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.293417+0000","last_change":"2023-03-02T10:55:10.619811+0000","last_active":"2023-03-02T10:56:19.293417+0000","last_peered":"2023-03-02T10:56:19.293417+0000","last_clean":"2023-03-02T10:56:19.293417+0000","last_became_active":"2023-03-02T10:55:10.617190+0000","last_became_peered":"2023-03-02T10:55:10.617190+0000","last_unstale":"2023-03-02T10:56:19.293417+0000","last_undegraded":"2023-03-02T10:56:19.293417+0000","last_fullsized":"2023-03-02T10:56:19.293417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:20:52.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542992+0000","last_change":"2023-03-02T10:55:10.155970+0000","last_active":"2023-03-02T10:55:49.542992+0000","last_peered":"2023-03-02T10:55:49.542992+0000","last_clean":"2023-03-02T10:55:49.542992+0000","last_became_active":"2023-03-02T10:55:10.155667+0000","last_became_peered":"2023-03-02T10:55:10.155667+0000","last_unstale":"2023-03-02T10:55:49.542992+0000","last_undegraded":"2023-03-02T10:55:49.542992+0000","last_fullsized":"2023-03-02T10:55:49.542992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:46:36.366891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302580+0000","last_change":"2023-03-02T10:55:10.623738+0000","last_active":"2023-03-02T10:56:19.302580+0000","last_peered":"2023-03-02T10:56:19.302580+0000","last_clean":"2023-03-02T10:56:19.302580+0000","last_became_active":"2023-03-02T10:55:10.620543+0000","last_became_peered":"2023-03-02T10:55:10.620543+0000","last_unstale":"2023-03-02T10:56:19.302580+0000","last_undegraded":"2023-03-02T10:56:19.302580+0000","last_fullsized":"2023-03-02T10:56:19.302580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:44:46.238712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.148470+0000","last_change":"2023-03-02T10:55:51.148470+0000","last_active":"2023-03-02T10:55:51.148470+0000","last_peered":"2023-03-02T10:55:51.148470+0000","last_clean":"2023-03-02T10:55:51.148470+0000","last_became_active":"2023-03-02T10:55:50.544811+0000","last_became_peered":"2023-03-02T10:55:50.544811+0000","last_unstale":"2023-03-02T10:55:51.148470+0000","last_undegraded":"2023-03-02T10:55:51.148470+0000","last_fullsized":"2023-03-02T10:55:51.148470+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:32:12.108148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.294276+0000","last_change":"2023-03-02T10:55:10.627844+0000","last_active":"2023-03-02T10:56:19.294276+0000","last_peered":"2023-03-02T10:56:19.294276+0000","last_clean":"2023-03-02T10:56:19.294276+0000","last_became_active":"2023-03-02T10:55:10.626972+0000","last_became_peered":"2023-03-02T10:55:10.626972+0000","last_unstale":"2023-03-02T10:56:19.294276+0000","last_undegraded":"2023-03-02T10:56:19.294276+0000","last_fullsized":"2023-03-02T10:56:19.294276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:36:58.650285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537357+0000","last_change":"2023-03-02T10:55:10.153277+0000","last_active":"2023-03-02T10:55:49.537357+0000","last_peered":"2023-03-02T10:55:49.537357+0000","last_clean":"2023-03-02T10:55:49.537357+0000","last_became_active":"2023-03-02T10:55:10.152983+0000","last_became_peered":"2023-03-02T10:55:10.152983+0000","last_unstale":"2023-03-02T10:55:49.537357+0000","last_undegraded":"2023-03-02T10:55:49.537357+0000","last_fullsized":"2023-03-02T10:55:49.537357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:15.045107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298653+0000","last_change":"2023-03-02T10:55:10.630295+0000","last_active":"2023-03-02T10:56:19.298653+0000","last_peered":"2023-03-02T10:56:19.298653+0000","last_clean":"2023-03-02T10:56:19.298653+0000","last_became_active":"2023-03-02T10:55:10.629004+0000","last_became_peered":"2023-03-02T10:55:10.629004+0000","last_unstale":"2023-03-02T10:56:19.298653+0000","last_undegraded":"2023-03-02T10:56:19.298653+0000","last_fullsized":"2023-03-02T10:56:19.298653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:05:51.414347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'7","reported_seq":110,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:41.687313+0000","last_change":"2023-03-02T10:55:10.153222+0000","last_active":"2023-03-02T10:56:41.687313+0000","last_peered":"2023-03-02T10:56:41.687313+0000","last_clean":"2023-03-02T10:56:41.687313+0000","last_became_active":"2023-03-02T10:55:10.152928+0000","last_became_peered":"2023-03-02T10:55:10.152928+0000","last_unstale":"2023-03-02T10:56:41.687313+0000","last_undegraded":"2023-03-02T10:56:41.687313+0000","last_fullsized":"2023-03-02T10:56:41.687313+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:12:56.648713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.281881+0000","last_change":"2023-03-02T10:55:10.617722+0000","last_active":"2023-03-02T10:56:19.281881+0000","last_peered":"2023-03-02T10:56:19.281881+0000","last_clean":"2023-03-02T10:56:19.281881+0000","last_became_active":"2023-03-02T10:55:10.617425+0000","last_became_peered":"2023-03-02T10:55:10.617425+0000","last_unstale":"2023-03-02T10:56:19.281881+0000","last_undegraded":"2023-03-02T10:56:19.281881+0000","last_fullsized":"2023-03-02T10:56:19.281881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:57:37.397568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:50.806747+0000","last_change":"2023-03-02T10:55:50.806747+0000","last_active":"2023-03-02T10:55:50.806747+0000","last_peered":"2023-03-02T10:55:50.806747+0000","last_clean":"2023-03-02T10:55:50.806747+0000","last_became_active":"2023-03-02T10:55:50.544008+0000","last_became_peered":"2023-03-02T10:55:50.544008+0000","last_unstale":"2023-03-02T10:55:50.806747+0000","last_undegraded":"2023-03-02T10:55:50.806747+0000","last_fullsized":"2023-03-02T10:55:50.806747+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:21:20.672207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298392+0000","last_change":"2023-03-02T10:55:10.628418+0000","last_active":"2023-03-02T10:56:19.298392+0000","last_peered":"2023-03-02T10:56:19.298392+0000","last_clean":"2023-03-02T10:56:19.298392+0000","last_became_active":"2023-03-02T10:55:10.627715+0000","last_became_peered":"2023-03-02T10:55:10.627715+0000","last_unstale":"2023-03-02T10:56:19.298392+0000","last_undegraded":"2023-03-02T10:56:19.298392+0000","last_fullsized":"2023-03-02T10:56:19.298392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:16:59.756440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539748+0000","last_change":"2023-03-02T10:55:10.158875+0000","last_active":"2023-03-02T10:55:49.539748+0000","last_peered":"2023-03-02T10:55:49.539748+0000","last_clean":"2023-03-02T10:55:49.539748+0000","last_became_active":"2023-03-02T10:55:10.157653+0000","last_became_peered":"2023-03-02T10:55:10.157653+0000","last_unstale":"2023-03-02T10:55:49.539748+0000","last_undegraded":"2023-03-02T10:55:49.539748+0000","last_fullsized":"2023-03-02T10:55:49.539748+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:50:03.808602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292893+0000","last_change":"2023-03-02T10:55:10.634280+0000","last_active":"2023-03-02T10:56:19.292893+0000","last_peered":"2023-03-02T10:56:19.292893+0000","last_clean":"2023-03-02T10:56:19.292893+0000","last_became_active":"2023-03-02T10:55:10.633764+0000","last_became_peered":"2023-03-02T10:55:10.633764+0000","last_unstale":"2023-03-02T10:56:19.292893+0000","last_undegraded":"2023-03-02T10:56:19.292893+0000","last_fullsized":"2023-03-02T10:56:19.292893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:17:25.110036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541628+0000","last_change":"2023-03-02T10:55:10.154532+0000","last_active":"2023-03-02T10:55:49.541628+0000","last_peered":"2023-03-02T10:55:49.541628+0000","last_clean":"2023-03-02T10:55:49.541628+0000","last_became_active":"2023-03-02T10:55:10.152116+0000","last_became_peered":"2023-03-02T10:55:10.152116+0000","last_unstale":"2023-03-02T10:55:49.541628+0000","last_undegraded":"2023-03-02T10:55:49.541628+0000","last_fullsized":"2023-03-02T10:55:49.541628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:19:50.439666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291548+0000","last_change":"2023-03-02T10:55:10.628790+0000","last_active":"2023-03-02T10:56:19.291548+0000","last_peered":"2023-03-02T10:56:19.291548+0000","last_clean":"2023-03-02T10:56:19.291548+0000","last_became_active":"2023-03-02T10:55:10.628452+0000","last_became_peered":"2023-03-02T10:55:10.628452+0000","last_unstale":"2023-03-02T10:56:19.291548+0000","last_undegraded":"2023-03-02T10:56:19.291548+0000","last_fullsized":"2023-03-02T10:56:19.291548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:08:30.061925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":193,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:43.689668+0000","last_change":"2023-03-02T10:55:10.152684+0000","last_active":"2023-03-02T10:56:43.689668+0000","last_peered":"2023-03-02T10:56:43.689668+0000","last_clean":"2023-03-02T10:56:43.689668+0000","last_became_active":"2023-03-02T10:55:10.152184+0000","last_became_peered":"2023-03-02T10:55:10.152184+0000","last_unstale":"2023-03-02T10:56:43.689668+0000","last_undegraded":"2023-03-02T10:56:43.689668+0000","last_fullsized":"2023-03-02T10:56:43.689668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:39:21.100760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296883+0000","last_change":"2023-03-02T10:55:10.625990+0000","last_active":"2023-03-02T10:56:19.296883+0000","last_peered":"2023-03-02T10:56:19.296883+0000","last_clean":"2023-03-02T10:56:19.296883+0000","last_became_active":"2023-03-02T10:55:10.625677+0000","last_became_peered":"2023-03-02T10:55:10.625677+0000","last_unstale":"2023-03-02T10:56:19.296883+0000","last_undegraded":"2023-03-02T10:56:19.296883+0000","last_fullsized":"2023-03-02T10:56:19.296883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:08.314083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539232+0000","last_change":"2023-03-02T10:55:10.151541+0000","last_active":"2023-03-02T10:55:49.539232+0000","last_peered":"2023-03-02T10:55:49.539232+0000","last_clean":"2023-03-02T10:55:49.539232+0000","last_became_active":"2023-03-02T10:55:10.151262+0000","last_became_peered":"2023-03-02T10:55:10.151262+0000","last_unstale":"2023-03-02T10:55:49.539232+0000","last_undegraded":"2023-03-02T10:55:49.539232+0000","last_fullsized":"2023-03-02T10:55:49.539232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:00:49.821191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298994+0000","last_change":"2023-03-02T10:55:10.629541+0000","last_active":"2023-03-02T10:56:19.298994+0000","last_peered":"2023-03-02T10:56:19.298994+0000","last_clean":"2023-03-02T10:56:19.298994+0000","last_became_active":"2023-03-02T10:55:10.627473+0000","last_became_peered":"2023-03-02T10:55:10.627473+0000","last_unstale":"2023-03-02T10:56:19.298994+0000","last_undegraded":"2023-03-02T10:56:19.298994+0000","last_fullsized":"2023-03-02T10:56:19.298994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:22:52.995113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542098+0000","last_change":"2023-03-02T10:55:10.152615+0000","last_active":"2023-03-02T10:55:49.542098+0000","last_peered":"2023-03-02T10:55:49.542098+0000","last_clean":"2023-03-02T10:55:49.542098+0000","last_became_active":"2023-03-02T10:55:10.152304+0000","last_became_peered":"2023-03-02T10:55:10.152304+0000","last_unstale":"2023-03-02T10:55:49.542098+0000","last_undegraded":"2023-03-02T10:55:49.542098+0000","last_fullsized":"2023-03-02T10:55:49.542098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:43:00.934520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.300447+0000","last_change":"2023-03-02T10:55:10.627653+0000","last_active":"2023-03-02T10:56:19.300447+0000","last_peered":"2023-03-02T10:56:19.300447+0000","last_clean":"2023-03-02T10:56:19.300447+0000","last_became_active":"2023-03-02T10:55:10.626570+0000","last_became_peered":"2023-03-02T10:55:10.626570+0000","last_unstale":"2023-03-02T10:56:19.300447+0000","last_undegraded":"2023-03-02T10:56:19.300447+0000","last_fullsized":"2023-03-02T10:56:19.300447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:40:39.311514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'35","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:43.690299+0000","last_change":"2023-03-02T10:55:10.149121+0000","last_active":"2023-03-02T10:56:43.690299+0000","last_peered":"2023-03-02T10:56:43.690299+0000","last_clean":"2023-03-02T10:56:43.690299+0000","last_became_active":"2023-03-02T10:55:10.148800+0000","last_became_peered":"2023-03-02T10:55:10.148800+0000","last_unstale":"2023-03-02T10:56:43.690299+0000","last_undegraded":"2023-03-02T10:56:43.690299+0000","last_fullsized":"2023-03-02T10:56:43.690299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:32:30.918248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61882,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":182,"num_read_kb":146,"num_write":37,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.294314+0000","last_change":"2023-03-02T10:55:10.625497+0000","last_active":"2023-03-02T10:56:19.294314+0000","last_peered":"2023-03-02T10:56:19.294314+0000","last_clean":"2023-03-02T10:56:19.294314+0000","last_became_active":"2023-03-02T10:55:10.625037+0000","last_became_peered":"2023-03-02T10:55:10.625037+0000","last_unstale":"2023-03-02T10:56:19.294314+0000","last_undegraded":"2023-03-02T10:56:19.294314+0000","last_fullsized":"2023-03-02T10:56:19.294314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:55:56.478111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534121+0000","last_change":"2023-03-02T10:55:10.148957+0000","last_active":"2023-03-02T10:55:49.534121+0000","last_peered":"2023-03-02T10:55:49.534121+0000","last_clean":"2023-03-02T10:55:49.534121+0000","last_became_active":"2023-03-02T10:55:10.148624+0000","last_became_peered":"2023-03-02T10:55:10.148624+0000","last_unstale":"2023-03-02T10:55:49.534121+0000","last_undegraded":"2023-03-02T10:55:49.534121+0000","last_fullsized":"2023-03-02T10:55:49.534121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T20:53:33.062648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296476+0000","last_change":"2023-03-02T10:55:10.633311+0000","last_active":"2023-03-02T10:56:19.296476+0000","last_peered":"2023-03-02T10:56:19.296476+0000","last_clean":"2023-03-02T10:56:19.296476+0000","last_became_active":"2023-03-02T10:55:10.632174+0000","last_became_peered":"2023-03-02T10:55:10.632174+0000","last_unstale":"2023-03-02T10:56:19.296476+0000","last_undegraded":"2023-03-02T10:56:19.296476+0000","last_fullsized":"2023-03-02T10:56:19.296476+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:50:47.536118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542053+0000","last_change":"2023-03-02T10:55:10.153392+0000","last_active":"2023-03-02T10:55:49.542053+0000","last_peered":"2023-03-02T10:55:49.542053+0000","last_clean":"2023-03-02T10:55:49.542053+0000","last_became_active":"2023-03-02T10:55:10.152513+0000","last_became_peered":"2023-03-02T10:55:10.152513+0000","last_unstale":"2023-03-02T10:55:49.542053+0000","last_undegraded":"2023-03-02T10:55:49.542053+0000","last_fullsized":"2023-03-02T10:55:49.542053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:26:40.675118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.299896+0000","last_change":"2023-03-02T10:55:10.631953+0000","last_active":"2023-03-02T10:56:19.299896+0000","last_peered":"2023-03-02T10:56:19.299896+0000","last_clean":"2023-03-02T10:56:19.299896+0000","last_became_active":"2023-03-02T10:55:10.631624+0000","last_became_peered":"2023-03-02T10:55:10.631624+0000","last_unstale":"2023-03-02T10:56:19.299896+0000","last_undegraded":"2023-03-02T10:56:19.299896+0000","last_fullsized":"2023-03-02T10:56:19.299896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:15:20.136421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":110,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:41.689782+0000","last_change":"2023-03-02T10:55:10.150597+0000","last_active":"2023-03-02T10:56:41.689782+0000","last_peered":"2023-03-02T10:56:41.689782+0000","last_clean":"2023-03-02T10:56:41.689782+0000","last_became_active":"2023-03-02T10:55:10.150024+0000","last_became_peered":"2023-03-02T10:55:10.150024+0000","last_unstale":"2023-03-02T10:56:41.689782+0000","last_undegraded":"2023-03-02T10:56:41.689782+0000","last_fullsized":"2023-03-02T10:56:41.689782+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:29:30.043240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291417+0000","last_change":"2023-03-02T10:55:10.633052+0000","last_active":"2023-03-02T10:56:19.291417+0000","last_peered":"2023-03-02T10:56:19.291417+0000","last_clean":"2023-03-02T10:56:19.291417+0000","last_became_active":"2023-03-02T10:55:10.632766+0000","last_became_peered":"2023-03-02T10:55:10.632766+0000","last_unstale":"2023-03-02T10:56:19.291417+0000","last_undegraded":"2023-03-02T10:56:19.291417+0000","last_fullsized":"2023-03-02T10:56:19.291417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:55.079556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.536268+0000","last_change":"2023-03-02T10:55:10.154559+0000","last_active":"2023-03-02T10:55:49.536268+0000","last_peered":"2023-03-02T10:55:49.536268+0000","last_clean":"2023-03-02T10:55:49.536268+0000","last_became_active":"2023-03-02T10:55:10.154058+0000","last_became_peered":"2023-03-02T10:55:10.154058+0000","last_unstale":"2023-03-02T10:55:49.536268+0000","last_undegraded":"2023-03-02T10:55:49.536268+0000","last_fullsized":"2023-03-02T10:55:49.536268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:23:26.823020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298189+0000","last_change":"2023-03-02T10:55:10.622951+0000","last_active":"2023-03-02T10:56:19.298189+0000","last_peered":"2023-03-02T10:56:19.298189+0000","last_clean":"2023-03-02T10:56:19.298189+0000","last_became_active":"2023-03-02T10:55:10.622643+0000","last_became_peered":"2023-03-02T10:55:10.622643+0000","last_unstale":"2023-03-02T10:56:19.298189+0000","last_undegraded":"2023-03-02T10:56:19.298189+0000","last_fullsized":"2023-03-02T10:56:19.298189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:53:05.459021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:50.547995+0000","last_change":"2023-03-02T10:55:50.547995+0000","last_active":"2023-03-02T10:55:50.547995+0000","last_peered":"2023-03-02T10:55:50.547995+0000","last_clean":"2023-03-02T10:55:50.547995+0000","last_became_active":"2023-03-02T10:55:50.541460+0000","last_became_peered":"2023-03-02T10:55:50.541460+0000","last_unstale":"2023-03-02T10:55:50.547995+0000","last_undegraded":"2023-03-02T10:55:50.547995+0000","last_fullsized":"2023-03-02T10:55:50.547995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:02:50.853731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.299636+0000","last_change":"2023-03-02T10:55:10.633149+0000","last_active":"2023-03-02T10:56:19.299636+0000","last_peered":"2023-03-02T10:56:19.299636+0000","last_clean":"2023-03-02T10:56:19.299636+0000","last_became_active":"2023-03-02T10:55:10.632816+0000","last_became_peered":"2023-03-02T10:55:10.632816+0000","last_unstale":"2023-03-02T10:56:19.299636+0000","last_undegraded":"2023-03-02T10:56:19.299636+0000","last_fullsized":"2023-03-02T10:56:19.299636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:25:41.585257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.533012+0000","last_change":"2023-03-02T10:55:10.150486+0000","last_active":"2023-03-02T10:55:49.533012+0000","last_peered":"2023-03-02T10:55:49.533012+0000","last_clean":"2023-03-02T10:55:49.533012+0000","last_became_active":"2023-03-02T10:55:10.150186+0000","last_became_peered":"2023-03-02T10:55:10.150186+0000","last_unstale":"2023-03-02T10:55:49.533012+0000","last_undegraded":"2023-03-02T10:55:49.533012+0000","last_fullsized":"2023-03-02T10:55:49.533012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:06:18.637162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292486+0000","last_change":"2023-03-02T10:55:10.628622+0000","last_active":"2023-03-02T10:56:19.292486+0000","last_peered":"2023-03-02T10:56:19.292486+0000","last_clean":"2023-03-02T10:56:19.292486+0000","last_became_active":"2023-03-02T10:55:10.628258+0000","last_became_peered":"2023-03-02T10:55:10.628258+0000","last_unstale":"2023-03-02T10:56:19.292486+0000","last_undegraded":"2023-03-02T10:56:19.292486+0000","last_fullsized":"2023-03-02T10:56:19.292486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:31:46.628211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":72,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:43.640833+0000","last_change":"2023-03-02T10:55:51.151512+0000","last_active":"2023-03-02T10:56:43.640833+0000","last_peered":"2023-03-02T10:56:43.640833+0000","last_clean":"2023-03-02T10:56:43.640833+0000","last_became_active":"2023-03-02T10:55:50.544349+0000","last_became_peered":"2023-03-02T10:55:50.544349+0000","last_unstale":"2023-03-02T10:56:43.640833+0000","last_undegraded":"2023-03-02T10:56:43.640833+0000","last_fullsized":"2023-03-02T10:56:43.640833+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:04:13.679666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.290561+0000","last_change":"2023-03-02T10:55:51.092083+0000","last_active":"2023-03-02T10:56:19.290561+0000","last_peered":"2023-03-02T10:56:19.290561+0000","last_clean":"2023-03-02T10:56:19.290561+0000","last_became_active":"2023-03-02T10:55:51.091536+0000","last_became_peered":"2023-03-02T10:55:51.091536+0000","last_unstale":"2023-03-02T10:56:19.290561+0000","last_undegraded":"2023-03-02T10:56:19.290561+0000","last_fullsized":"2023-03-02T10:56:19.290561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:18:38.983021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.298285+0000","last_change":"2023-03-02T10:55:10.613814+0000","last_active":"2023-03-02T10:56:19.298285+0000","last_peered":"2023-03-02T10:56:19.298285+0000","last_clean":"2023-03-02T10:56:19.298285+0000","last_became_active":"2023-03-02T10:55:10.613496+0000","last_became_peered":"2023-03-02T10:55:10.613496+0000","last_unstale":"2023-03-02T10:56:19.298285+0000","last_undegraded":"2023-03-02T10:56:19.298285+0000","last_fullsized":"2023-03-02T10:56:19.298285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:55:58.332549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:42.690391+0000","last_change":"2023-03-02T10:55:10.160751+0000","last_active":"2023-03-02T10:56:42.690391+0000","last_peered":"2023-03-02T10:56:42.690391+0000","last_clean":"2023-03-02T10:56:42.690391+0000","last_became_active":"2023-03-02T10:55:10.160433+0000","last_became_peered":"2023-03-02T10:55:10.160433+0000","last_unstale":"2023-03-02T10:56:42.690391+0000","last_undegraded":"2023-03-02T10:56:42.690391+0000","last_fullsized":"2023-03-02T10:56:42.690391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:11:23.326464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.301472+0000","last_change":"2023-03-02T10:55:10.619761+0000","last_active":"2023-03-02T10:56:19.301472+0000","last_peered":"2023-03-02T10:56:19.301472+0000","last_clean":"2023-03-02T10:56:19.301472+0000","last_became_active":"2023-03-02T10:55:10.617361+0000","last_became_peered":"2023-03-02T10:55:10.617361+0000","last_unstale":"2023-03-02T10:56:19.301472+0000","last_undegraded":"2023-03-02T10:56:19.301472+0000","last_fullsized":"2023-03-02T10:56:19.301472+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:26:55.492653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540413+0000","last_change":"2023-03-02T10:55:10.151553+0000","last_active":"2023-03-02T10:55:49.540413+0000","last_peered":"2023-03-02T10:55:49.540413+0000","last_clean":"2023-03-02T10:55:49.540413+0000","last_became_active":"2023-03-02T10:55:10.151369+0000","last_became_peered":"2023-03-02T10:55:10.151369+0000","last_unstale":"2023-03-02T10:55:49.540413+0000","last_undegraded":"2023-03-02T10:55:49.540413+0000","last_fullsized":"2023-03-02T10:55:49.540413+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:30:42.550362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":374,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539716+0000","last_change":"2023-03-02T10:54:06.270813+0000","last_active":"2023-03-02T10:55:49.539716+0000","last_peered":"2023-03-02T10:55:49.539716+0000","last_clean":"2023-03-02T10:55:49.539716+0000","last_became_active":"2023-03-02T10:54:06.270329+0000","last_became_peered":"2023-03-02T10:54:06.270329+0000","last_unstale":"2023-03-02T10:55:49.539716+0000","last_undegraded":"2023-03-02T10:55:49.539716+0000","last_fullsized":"2023-03-02T10:55:49.539716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:51:04.207601+0000","last_clean_scrub_stamp":"2023-03-02T10:51:04.207601+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:01:07.546806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.288665+0000","last_change":"2023-03-02T10:55:10.629032+0000","last_active":"2023-03-02T10:56:19.288665+0000","last_peered":"2023-03-02T10:56:19.288665+0000","last_clean":"2023-03-02T10:56:19.288665+0000","last_became_active":"2023-03-02T10:55:10.628696+0000","last_became_peered":"2023-03-02T10:55:10.628696+0000","last_unstale":"2023-03-02T10:56:19.288665+0000","last_undegraded":"2023-03-02T10:56:19.288665+0000","last_fullsized":"2023-03-02T10:56:19.288665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:32:58.399900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539930+0000","last_change":"2023-03-02T10:55:10.153240+0000","last_active":"2023-03-02T10:55:49.539930+0000","last_peered":"2023-03-02T10:55:49.539930+0000","last_clean":"2023-03-02T10:55:49.539930+0000","last_became_active":"2023-03-02T10:55:10.152977+0000","last_became_peered":"2023-03-02T10:55:10.152977+0000","last_unstale":"2023-03-02T10:55:49.539930+0000","last_undegraded":"2023-03-02T10:55:49.539930+0000","last_fullsized":"2023-03-02T10:55:49.539930+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:46:49.873113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.537639+0000","last_change":"2023-03-02T10:55:10.154392+0000","last_active":"2023-03-02T10:55:49.537639+0000","last_peered":"2023-03-02T10:55:49.537639+0000","last_clean":"2023-03-02T10:55:49.537639+0000","last_became_active":"2023-03-02T10:55:10.154110+0000","last_became_peered":"2023-03-02T10:55:10.154110+0000","last_unstale":"2023-03-02T10:55:49.537639+0000","last_undegraded":"2023-03-02T10:55:49.537639+0000","last_fullsized":"2023-03-02T10:55:49.537639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:11:05.910487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291035+0000","last_change":"2023-03-02T10:55:10.627181+0000","last_active":"2023-03-02T10:56:19.291035+0000","last_peered":"2023-03-02T10:56:19.291035+0000","last_clean":"2023-03-02T10:56:19.291035+0000","last_became_active":"2023-03-02T10:55:10.626891+0000","last_became_peered":"2023-03-02T10:55:10.626891+0000","last_unstale":"2023-03-02T10:56:19.291035+0000","last_undegraded":"2023-03-02T10:56:19.291035+0000","last_fullsized":"2023-03-02T10:56:19.291035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:37.990553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:23.744621+0000","last_change":"2023-03-02T10:55:10.146146+0000","last_active":"2023-03-02T10:56:23.744621+0000","last_peered":"2023-03-02T10:56:23.744621+0000","last_clean":"2023-03-02T10:56:23.744621+0000","last_became_active":"2023-03-02T10:55:10.145824+0000","last_became_peered":"2023-03-02T10:55:10.145824+0000","last_unstale":"2023-03-02T10:56:23.744621+0000","last_undegraded":"2023-03-02T10:56:23.744621+0000","last_fullsized":"2023-03-02T10:56:23.744621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:05:35.846016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.287810+0000","last_change":"2023-03-02T10:55:10.636566+0000","last_active":"2023-03-02T10:56:19.287810+0000","last_peered":"2023-03-02T10:56:19.287810+0000","last_clean":"2023-03-02T10:56:19.287810+0000","last_became_active":"2023-03-02T10:55:10.636033+0000","last_became_peered":"2023-03-02T10:55:10.636033+0000","last_unstale":"2023-03-02T10:56:19.287810+0000","last_undegraded":"2023-03-02T10:56:19.287810+0000","last_fullsized":"2023-03-02T10:56:19.287810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T11:35:24.955628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.540621+0000","last_change":"2023-03-02T10:55:10.156550+0000","last_active":"2023-03-02T10:55:49.540621+0000","last_peered":"2023-03-02T10:55:49.540621+0000","last_clean":"2023-03-02T10:55:49.540621+0000","last_became_active":"2023-03-02T10:55:10.156286+0000","last_became_peered":"2023-03-02T10:55:10.156286+0000","last_unstale":"2023-03-02T10:55:49.540621+0000","last_undegraded":"2023-03-02T10:55:49.540621+0000","last_fullsized":"2023-03-02T10:55:49.540621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:45:51.476117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297640+0000","last_change":"2023-03-02T10:55:10.631769+0000","last_active":"2023-03-02T10:56:19.297640+0000","last_peered":"2023-03-02T10:56:19.297640+0000","last_clean":"2023-03-02T10:56:19.297640+0000","last_became_active":"2023-03-02T10:55:10.631429+0000","last_became_peered":"2023-03-02T10:55:10.631429+0000","last_unstale":"2023-03-02T10:56:19.297640+0000","last_undegraded":"2023-03-02T10:56:19.297640+0000","last_fullsized":"2023-03-02T10:56:19.297640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:42:52.764994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534314+0000","last_change":"2023-03-02T10:55:10.152435+0000","last_active":"2023-03-02T10:55:49.534314+0000","last_peered":"2023-03-02T10:55:49.534314+0000","last_clean":"2023-03-02T10:55:49.534314+0000","last_became_active":"2023-03-02T10:55:10.152008+0000","last_became_peered":"2023-03-02T10:55:10.152008+0000","last_unstale":"2023-03-02T10:55:49.534314+0000","last_undegraded":"2023-03-02T10:55:49.534314+0000","last_fullsized":"2023-03-02T10:55:49.534314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:46:39.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.262937+0000","last_change":"2023-03-02T10:55:10.624337+0000","last_active":"2023-03-02T10:56:19.262937+0000","last_peered":"2023-03-02T10:56:19.262937+0000","last_clean":"2023-03-02T10:56:19.262937+0000","last_became_active":"2023-03-02T10:55:10.623979+0000","last_became_peered":"2023-03-02T10:55:10.623979+0000","last_unstale":"2023-03-02T10:56:19.262937+0000","last_undegraded":"2023-03-02T10:56:19.262937+0000","last_fullsized":"2023-03-02T10:56:19.262937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:14:39.173460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.542638+0000","last_change":"2023-03-02T10:55:10.152406+0000","last_active":"2023-03-02T10:55:49.542638+0000","last_peered":"2023-03-02T10:55:49.542638+0000","last_clean":"2023-03-02T10:55:49.542638+0000","last_became_active":"2023-03-02T10:55:10.152026+0000","last_became_peered":"2023-03-02T10:55:10.152026+0000","last_unstale":"2023-03-02T10:55:49.542638+0000","last_undegraded":"2023-03-02T10:55:49.542638+0000","last_fullsized":"2023-03-02T10:55:49.542638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:49:17.617792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296326+0000","last_change":"2023-03-02T10:55:10.620061+0000","last_active":"2023-03-02T10:56:19.296326+0000","last_peered":"2023-03-02T10:56:19.296326+0000","last_clean":"2023-03-02T10:56:19.296326+0000","last_became_active":"2023-03-02T10:55:10.619753+0000","last_became_peered":"2023-03-02T10:55:10.619753+0000","last_unstale":"2023-03-02T10:56:19.296326+0000","last_undegraded":"2023-03-02T10:56:19.296326+0000","last_fullsized":"2023-03-02T10:56:19.296326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:40:02.479733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.534006+0000","last_change":"2023-03-02T10:55:10.149827+0000","last_active":"2023-03-02T10:55:49.534006+0000","last_peered":"2023-03-02T10:55:49.534006+0000","last_clean":"2023-03-02T10:55:49.534006+0000","last_became_active":"2023-03-02T10:55:10.149522+0000","last_became_peered":"2023-03-02T10:55:10.149522+0000","last_unstale":"2023-03-02T10:55:49.534006+0000","last_undegraded":"2023-03-02T10:55:49.534006+0000","last_fullsized":"2023-03-02T10:55:49.534006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:23:27.072235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292559+0000","last_change":"2023-03-02T10:55:10.618992+0000","last_active":"2023-03-02T10:56:19.292559+0000","last_peered":"2023-03-02T10:56:19.292559+0000","last_clean":"2023-03-02T10:56:19.292559+0000","last_became_active":"2023-03-02T10:55:10.618678+0000","last_became_peered":"2023-03-02T10:55:10.618678+0000","last_unstale":"2023-03-02T10:56:19.292559+0000","last_undegraded":"2023-03-02T10:56:19.292559+0000","last_fullsized":"2023-03-02T10:56:19.292559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T22:33:26.966579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:55:51.321810+0000","last_change":"2023-03-02T10:55:51.321810+0000","last_active":"2023-03-02T10:55:51.321810+0000","last_peered":"2023-03-02T10:55:51.321810+0000","last_clean":"2023-03-02T10:55:51.321810+0000","last_became_active":"2023-03-02T10:55:50.544110+0000","last_became_peered":"2023-03-02T10:55:50.544110+0000","last_unstale":"2023-03-02T10:55:51.321810+0000","last_undegraded":"2023-03-02T10:55:51.321810+0000","last_fullsized":"2023-03-02T10:55:51.321810+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:59:33.358979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302786+0000","last_change":"2023-03-02T10:55:10.625524+0000","last_active":"2023-03-02T10:56:19.302786+0000","last_peered":"2023-03-02T10:56:19.302786+0000","last_clean":"2023-03-02T10:56:19.302786+0000","last_became_active":"2023-03-02T10:55:10.625249+0000","last_became_peered":"2023-03-02T10:55:10.625249+0000","last_unstale":"2023-03-02T10:56:19.302786+0000","last_undegraded":"2023-03-02T10:56:19.302786+0000","last_fullsized":"2023-03-02T10:56:19.302786+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:03:16.230549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:40.733254+0000","last_change":"2023-03-02T10:55:10.159691+0000","last_active":"2023-03-02T10:56:40.733254+0000","last_peered":"2023-03-02T10:56:40.733254+0000","last_clean":"2023-03-02T10:56:40.733254+0000","last_became_active":"2023-03-02T10:55:10.159360+0000","last_became_peered":"2023-03-02T10:55:10.159360+0000","last_unstale":"2023-03-02T10:56:40.733254+0000","last_undegraded":"2023-03-02T10:56:40.733254+0000","last_fullsized":"2023-03-02T10:56:40.733254+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T14:21:05.305932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.302559+0000","last_change":"2023-03-02T10:55:10.621119+0000","last_active":"2023-03-02T10:56:19.302559+0000","last_peered":"2023-03-02T10:56:19.302559+0000","last_clean":"2023-03-02T10:56:19.302559+0000","last_became_active":"2023-03-02T10:55:10.620370+0000","last_became_peered":"2023-03-02T10:55:10.620370+0000","last_unstale":"2023-03-02T10:56:19.302559+0000","last_undegraded":"2023-03-02T10:56:19.302559+0000","last_fullsized":"2023-03-02T10:56:19.302559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:33:20.678615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.541953+0000","last_change":"2023-03-02T10:55:10.155403+0000","last_active":"2023-03-02T10:55:49.541953+0000","last_peered":"2023-03-02T10:55:49.541953+0000","last_clean":"2023-03-02T10:55:49.541953+0000","last_became_active":"2023-03-02T10:55:10.152547+0000","last_became_peered":"2023-03-02T10:55:10.152547+0000","last_unstale":"2023-03-02T10:55:49.541953+0000","last_undegraded":"2023-03-02T10:55:49.541953+0000","last_fullsized":"2023-03-02T10:55:49.541953+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T18:18:30.564037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.291964+0000","last_change":"2023-03-02T10:55:51.094932+0000","last_active":"2023-03-02T10:56:19.291964+0000","last_peered":"2023-03-02T10:56:19.291964+0000","last_clean":"2023-03-02T10:56:19.291964+0000","last_became_active":"2023-03-02T10:55:51.091808+0000","last_became_peered":"2023-03-02T10:55:51.091808+0000","last_unstale":"2023-03-02T10:56:19.291964+0000","last_undegraded":"2023-03-02T10:56:19.291964+0000","last_fullsized":"2023-03-02T10:56:19.291964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T15:26:42.737673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-02T10:55:49.539999+0000","last_change":"2023-03-02T10:55:10.159307+0000","last_active":"2023-03-02T10:55:49.539999+0000","last_peered":"2023-03-02T10:55:49.539999+0000","last_clean":"2023-03-02T10:55:49.539999+0000","last_became_active":"2023-03-02T10:55:10.158979+0000","last_became_peered":"2023-03-02T10:55:10.158979+0000","last_unstale":"2023-03-02T10:55:49.539999+0000","last_undegraded":"2023-03-02T10:55:49.539999+0000","last_fullsized":"2023-03-02T10:55:49.539999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:09.124385+0000","last_clean_scrub_stamp":"2023-03-02T10:55:09.124385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:13:54.984801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297738+0000","last_change":"2023-03-02T10:55:10.630995+0000","last_active":"2023-03-02T10:56:19.297738+0000","last_peered":"2023-03-02T10:56:19.297738+0000","last_clean":"2023-03-02T10:56:19.297738+0000","last_became_active":"2023-03-02T10:55:10.630654+0000","last_became_peered":"2023-03-02T10:55:10.630654+0000","last_unstale":"2023-03-02T10:56:19.297738+0000","last_undegraded":"2023-03-02T10:56:19.297738+0000","last_fullsized":"2023-03-02T10:56:19.297738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:25:50.945152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297504+0000","last_change":"2023-03-02T10:55:10.633263+0000","last_active":"2023-03-02T10:56:19.297504+0000","last_peered":"2023-03-02T10:56:19.297504+0000","last_clean":"2023-03-02T10:56:19.297504+0000","last_became_active":"2023-03-02T10:55:10.632796+0000","last_became_peered":"2023-03-02T10:55:10.632796+0000","last_unstale":"2023-03-02T10:56:19.297504+0000","last_undegraded":"2023-03-02T10:56:19.297504+0000","last_fullsized":"2023-03-02T10:56:19.297504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:04:02.060792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.286082+0000","last_change":"2023-03-02T10:55:10.620195+0000","last_active":"2023-03-02T10:56:19.286082+0000","last_peered":"2023-03-02T10:56:19.286082+0000","last_clean":"2023-03-02T10:56:19.286082+0000","last_became_active":"2023-03-02T10:55:10.619904+0000","last_became_peered":"2023-03-02T10:55:10.619904+0000","last_unstale":"2023-03-02T10:56:19.286082+0000","last_undegraded":"2023-03-02T10:56:19.286082+0000","last_fullsized":"2023-03-02T10:56:19.286082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:03:43.176587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.286504+0000","last_change":"2023-03-02T10:55:10.619427+0000","last_active":"2023-03-02T10:56:19.286504+0000","last_peered":"2023-03-02T10:56:19.286504+0000","last_clean":"2023-03-02T10:56:19.286504+0000","last_became_active":"2023-03-02T10:55:10.618184+0000","last_became_peered":"2023-03-02T10:55:10.618184+0000","last_unstale":"2023-03-02T10:56:19.286504+0000","last_undegraded":"2023-03-02T10:56:19.286504+0000","last_fullsized":"2023-03-02T10:56:19.286504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T16:20:00.907091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.295503+0000","last_change":"2023-03-02T10:55:10.630058+0000","last_active":"2023-03-02T10:56:19.295503+0000","last_peered":"2023-03-02T10:56:19.295503+0000","last_clean":"2023-03-02T10:56:19.295503+0000","last_became_active":"2023-03-02T10:55:10.626022+0000","last_became_peered":"2023-03-02T10:55:10.626022+0000","last_unstale":"2023-03-02T10:56:19.295503+0000","last_undegraded":"2023-03-02T10:56:19.295503+0000","last_fullsized":"2023-03-02T10:56:19.295503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:23:27.900984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.290432+0000","last_change":"2023-03-02T10:55:10.621984+0000","last_active":"2023-03-02T10:56:19.290432+0000","last_peered":"2023-03-02T10:56:19.290432+0000","last_clean":"2023-03-02T10:56:19.290432+0000","last_became_active":"2023-03-02T10:55:10.621636+0000","last_became_peered":"2023-03-02T10:55:10.621636+0000","last_unstale":"2023-03-02T10:56:19.290432+0000","last_undegraded":"2023-03-02T10:56:19.290432+0000","last_fullsized":"2023-03-02T10:56:19.290432+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T13:10:41.154358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.294292+0000","last_change":"2023-03-02T10:55:10.633194+0000","last_active":"2023-03-02T10:56:19.294292+0000","last_peered":"2023-03-02T10:56:19.294292+0000","last_clean":"2023-03-02T10:56:19.294292+0000","last_became_active":"2023-03-02T10:55:10.632860+0000","last_became_peered":"2023-03-02T10:55:10.632860+0000","last_unstale":"2023-03-02T10:56:19.294292+0000","last_undegraded":"2023-03-02T10:56:19.294292+0000","last_fullsized":"2023-03-02T10:56:19.294292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:34:58.071830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.300407+0000","last_change":"2023-03-02T10:55:10.613717+0000","last_active":"2023-03-02T10:56:19.300407+0000","last_peered":"2023-03-02T10:56:19.300407+0000","last_clean":"2023-03-02T10:56:19.300407+0000","last_became_active":"2023-03-02T10:55:10.613391+0000","last_became_peered":"2023-03-02T10:55:10.613391+0000","last_unstale":"2023-03-02T10:56:19.300407+0000","last_undegraded":"2023-03-02T10:56:19.300407+0000","last_fullsized":"2023-03-02T10:56:19.300407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:51:23.532086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297955+0000","last_change":"2023-03-02T10:55:10.637730+0000","last_active":"2023-03-02T10:56:19.297955+0000","last_peered":"2023-03-02T10:56:19.297955+0000","last_clean":"2023-03-02T10:56:19.297955+0000","last_became_active":"2023-03-02T10:55:10.637097+0000","last_became_peered":"2023-03-02T10:55:10.637097+0000","last_unstale":"2023-03-02T10:56:19.297955+0000","last_undegraded":"2023-03-02T10:56:19.297955+0000","last_fullsized":"2023-03-02T10:56:19.297955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:41:19.587933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.292829+0000","last_change":"2023-03-02T10:55:10.617374+0000","last_active":"2023-03-02T10:56:19.292829+0000","last_peered":"2023-03-02T10:56:19.292829+0000","last_clean":"2023-03-02T10:56:19.292829+0000","last_became_active":"2023-03-02T10:55:10.617061+0000","last_became_peered":"2023-03-02T10:55:10.617061+0000","last_unstale":"2023-03-02T10:56:19.292829+0000","last_undegraded":"2023-03-02T10:56:19.292829+0000","last_fullsized":"2023-03-02T10:56:19.292829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:03:41.270487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.287281+0000","last_change":"2023-03-02T10:55:10.622246+0000","last_active":"2023-03-02T10:56:19.287281+0000","last_peered":"2023-03-02T10:56:19.287281+0000","last_clean":"2023-03-02T10:56:19.287281+0000","last_became_active":"2023-03-02T10:55:10.621938+0000","last_became_peered":"2023-03-02T10:55:10.621938+0000","last_unstale":"2023-03-02T10:56:19.287281+0000","last_undegraded":"2023-03-02T10:56:19.287281+0000","last_fullsized":"2023-03-02T10:56:19.287281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T17:39:35.605113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.301744+0000","last_change":"2023-03-02T10:55:10.623502+0000","last_active":"2023-03-02T10:56:19.301744+0000","last_peered":"2023-03-02T10:56:19.301744+0000","last_clean":"2023-03-02T10:56:19.301744+0000","last_became_active":"2023-03-02T10:55:10.623160+0000","last_became_peered":"2023-03-02T10:55:10.623160+0000","last_unstale":"2023-03-02T10:56:19.301744+0000","last_undegraded":"2023-03-02T10:56:19.301744+0000","last_fullsized":"2023-03-02T10:56:19.301744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T19:30:49.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.296470+0000","last_change":"2023-03-02T10:55:10.636452+0000","last_active":"2023-03-02T10:56:19.296470+0000","last_peered":"2023-03-02T10:56:19.296470+0000","last_clean":"2023-03-02T10:56:19.296470+0000","last_became_active":"2023-03-02T10:55:10.636176+0000","last_became_peered":"2023-03-02T10:55:10.636176+0000","last_unstale":"2023-03-02T10:56:19.296470+0000","last_undegraded":"2023-03-02T10:56:19.296470+0000","last_fullsized":"2023-03-02T10:56:19.296470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T12:45:51.303295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-03-02T10:56:19.297592+0000","last_change":"2023-03-02T10:55:51.092168+0000","last_active":"2023-03-02T10:56:19.297592+0000","last_peered":"2023-03-02T10:56:19.297592+0000","last_clean":"2023-03-02T10:56:19.297592+0000","last_became_active":"2023-03-02T10:55:51.091735+0000","last_became_peered":"2023-03-02T10:55:51.091735+0000","last_unstale":"2023-03-02T10:56:19.297592+0000","last_undegraded":"2023-03-02T10:56:19.297592+0000","last_fullsized":"2023-03-02T10:56:19.297592+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-02T10:55:10.130986+0000","last_clean_scrub_stamp":"2023-03-02T10:55:10.130986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-03T21:25:46.235073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":254019,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69286,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":873,"num_read_kb":525,"num_write":244,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":610,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":202194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416416,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6112,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739040,"statfs":{"total":95995035648,"available":95988776960,"internally_reserved":0,"allocated":942080,"data_stored":448834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.8109999999999999,"5min":3.8109999999999999,"15min":3.8109999999999999},"last":0.495}]},{"osd":1,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.48699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.745,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.624}]},{"osd":2,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.37},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.55500000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90300000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80400000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80000000000000004,"5min":1.214,"15min":1.214},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95999999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97799999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98999999999999999,"5min":1.53,"15min":1.53},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.58699999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.032,"5min":1.125,"15min":1.125},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.70199999999999996},"min":{"1min":0.54900000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.89000000000000001,"5min":1.089,"15min":1.089},"last":0.71999999999999997}]},{"osd":8,"last update":"Thu Mar 2 10:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.69999999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78800000000000003,"15min":0.78900000000000003},"min":{"1min":0.65400000000000003,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94499999999999995,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78300000000000003,"15min":0.77900000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1439999999999999,"5min":1.194,"15min":1.194},"last":0.77500000000000002}]},{"osd":10,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.745},"min":{"1min":0.59199999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.92800000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.63800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":1.49,"15min":1.49},"last":0.753}]}]},{"osd":10,"up_from":71,"seq":304942678051,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6572,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738580,"statfs":{"total":95995035648,"available":95988305920,"internally_reserved":0,"allocated":1085440,"data_stored":1101341,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76600000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64600000000000002,"15min":0.64400000000000002},"min":{"1min":0.47199999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69599999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.099,"5min":2.121,"15min":2.121},"last":0.62}]},{"osd":4,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.52000000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.25,"5min":1.97,"15min":1.97},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.52000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0580000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Mar 2 10:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.56799999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.998,"5min":1.097,"15min":1.097},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.53500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.67200000000000004}]},{"osd":9,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.81000000000000005,"15min":0.82099999999999995},"min":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.139,"5min":1.28,"15min":1.28},"last":0.752},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.86199999999999999,"15min":0.88800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96699999999999997,"5min":2.302,"15min":2.302},"last":0.63300000000000001}]},{"osd":11,"last update":"Thu Mar 2 10:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77500000000000002,"15min":0.77600000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97899999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69399999999999995}]}]},{"osd":9,"up_from":66,"seq":283467841576,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6260,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738892,"statfs":{"total":95995035648,"available":95988625408,"internally_reserved":0,"allocated":962560,"data_stored":448277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.53800000000000003,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.55200000000000005,"5min":0.871,"15min":0.871},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.60199999999999998,"15min":0.628},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.58799999999999997,"5min":1.823,"15min":1.823},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67900000000000005,"15min":0.69199999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85499999999999998,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.73599999999999999,"15min":0.76000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.747,"5min":0.999,"15min":0.999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.71899999999999997,"15min":0.73899999999999999},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79700000000000004,"5min":1.266,"15min":1.266},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.65900000000000003,"15min":0.68899999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63400000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.36099999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57799999999999996,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.442}]},{"osd":4,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.92700000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.85899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.83099999999999996,"15min":0.86099999999999999},"min":{"1min":0.53700000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.86899999999999999,"5min":1.956,"15min":1.956},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.84199999999999997,"15min":0.876},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.82999999999999996,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.82199999999999995,"15min":0.85699999999999998},"min":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2569999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.82799999999999996,"15min":0.85899999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89700000000000002,"5min":1.452,"15min":1.452},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.90000000000000002,"15min":0.93000000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.86899999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.89600000000000002,"15min":0.92700000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2130000000000001,"5min":1.522,"15min":1.522},"last":0.72499999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95999999999999996,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.93400000000000005,"15min":0.96499999999999997},"min":{"1min":0.63100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.90600000000000003,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.624}]},{"osd":10,"last update":"Thu Mar 2 10:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.83899999999999997,"15min":0.85299999999999998},"min":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.749}]}]},{"osd":8,"up_from":59,"seq":253403070508,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6440,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738712,"statfs":{"total":95995035648,"available":95988441088,"internally_reserved":0,"allocated":950272,"data_stored":448494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.60399999999999998,"15min":0.54000000000000004},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":5.7919999999999998,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.63400000000000001,"15min":0.58299999999999996},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.8049999999999997,"5min":5.8049999999999997,"15min":5.8049999999999997},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.61199999999999999,"15min":0.58199999999999996},"min":{"1min":0.52900000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81699999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61399999999999999,"15min":0.59799999999999998},"min":{"1min":0.56000000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47099999999999997,"15min":0.45700000000000002},"min":{"1min":0.42699999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.63},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.47999999999999998,"15min":0.46899999999999997},"min":{"1min":0.45400000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.502}]},{"osd":3,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":0.71499999999999997,"15min":0.64100000000000001},"min":{"1min":0.48499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.62},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.68899999999999995,"15min":0.63100000000000001},"min":{"1min":0.49399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.3940000000000001,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.60099999999999998,"15min":0.57899999999999996},"min":{"1min":0.53500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.64500000000000002,"15min":0.627},"min":{"1min":0.64300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84499999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.59599999999999997,"15min":0.57799999999999996},"min":{"1min":0.57499999999999996,"5min":0.312,"15min":0.312},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.46500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.71999999999999997,"15min":0.69699999999999995},"min":{"1min":0.63900000000000001,"5min":0.377,"15min":0.377},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":0.80300000000000005,"15min":0.747},"min":{"1min":0.64200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":3.9089999999999998,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.748}]},{"osd":7,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.71199999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.70899999999999996,"15min":0.68899999999999995},"min":{"1min":0.626,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90100000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.83399999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.72699999999999998,"15min":0.71499999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.05,"5min":0.79700000000000004,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Mar 2 10:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.71699999999999997,"15min":0.69699999999999995},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.76900000000000002,"15min":0.753},"min":{"1min":0.77900000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.88500000000000001}]},{"osd":11,"last update":"Thu Mar 2 10:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.82699999999999996}]}]},{"osd":7,"up_from":52,"seq":223338299440,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6556,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738596,"statfs":{"total":95995035648,"available":95988322304,"internally_reserved":0,"allocated":1003520,"data_stored":1041123,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84499999999999997,"5min":1.034,"15min":1.034},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.41499999999999998},"min":{"1min":0.29499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60799999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.76100000000000001,"5min":1.129,"15min":1.129},"last":0.441},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.438,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80200000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81899999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70599999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.497}]},{"osd":5,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63}]},{"osd":6,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.46000000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84899999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90500000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58699999999999997}]},{"osd":8,"last update":"Thu Mar 2 10:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84899999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91500000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77700000000000002}]},{"osd":9,"last update":"Thu Mar 2 10:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.58899999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98199999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.66000000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.69399999999999995}]},{"osd":10,"last update":"Thu Mar 2 10:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.502,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66000000000000003}]},{"osd":11,"last update":"Thu Mar 2 10:56:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.748}]}]},{"osd":6,"up_from":47,"seq":201863462966,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6368,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738784,"statfs":{"total":95995035648,"available":95988514816,"internally_reserved":0,"allocated":942080,"data_stored":447893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42099999999999999,"15min":0.40400000000000003},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.44700000000000001,"15min":0.438},"min":{"1min":0.309,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69699999999999995,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.748,"5min":0.999,"15min":0.999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.46300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73499999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.58999999999999997},"min":{"1min":0.48899999999999999,"5min":0.435,"15min":0.435},"max":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.499,"15min":0.495},"min":{"1min":0.35399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84099999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.93100000000000005,"5min":1.042,"15min":1.042},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.48399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86499999999999999,"5min":1.069,"15min":1.069},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Mar 2 10:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68799999999999994,"15min":0.66700000000000004},"min":{"1min":0.502,"5min":0.439,"15min":0.439},"max":{"1min":0.81999999999999995,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70899999999999996,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":1.03},"last":0.85099999999999998}]},{"osd":7,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.51600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.89000000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.73499999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.82299999999999995}]},{"osd":8,"last update":"Thu Mar 2 10:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88100000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.81100000000000005},"min":{"1min":0.61499999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.99199999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.88800000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.84099999999999997,"15min":0.86199999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97099999999999997,"5min":1.234,"15min":1.234},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.018,"5min":1.163,"15min":1.163},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.61299999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.86299999999999999,"15min":0.88100000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":0.94599999999999995,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.97299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7516,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":93737636,"statfs":{"total":95995035648,"available":95987339264,"internally_reserved":0,"allocated":1003520,"data_stored":510650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51000000000000001,"15min":0.48799999999999999},"min":{"1min":0.36499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.75,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.505,"15min":0.502},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81100000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.52000000000000002},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76900000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.56999999999999995,"15min":0.53700000000000003},"min":{"1min":0.44600000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Mar 2 10:56:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57699999999999996,"15min":0.54200000000000004},"min":{"1min":0.432,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90600000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.55600000000000005},"min":{"1min":0.44600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91700000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Mar 2 10:55:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.443,"15min":0.40899999999999997},"min":{"1min":0.29199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.53000000000000003,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Mar 2 10:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.65000000000000002,"15min":0.60999999999999999},"min":{"1min":0.60899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89000000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.65100000000000002,"15min":0.59699999999999998},"min":{"1min":0.57099999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.75}]},{"osd":6,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.629,"15min":0.60399999999999998},"min":{"1min":0.51900000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88600000000000001,"5min":1.097,"15min":1.097},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.68700000000000006,"15min":0.66100000000000003},"min":{"1min":0.52800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.38600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.628},{"interface":"front","average":{"1min":0.746,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.72699999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.73099999999999998,"15min":0.70299999999999996},"min":{"1min":0.67100000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98199999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.59999999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.018,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70599999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.76300000000000001},"min":{"1min":0.59999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.83299999999999996}]},{"osd":10,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.68999999999999995,"15min":0.67800000000000005},"min":{"1min":0.55000000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96299999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.61199999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.056,"5min":1.169,"15min":1.169},"last":0.77700000000000002}]},{"osd":11,"last update":"Thu Mar 2 10:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.85299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7284,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737868,"statfs":{"total":95995035648,"available":95987576832,"internally_reserved":0,"allocated":962560,"data_stored":449194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54700000000000004,"15min":0.48999999999999999},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.873,"15min":0.873},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.56200000000000006,"15min":0.50900000000000001},"min":{"1min":0.50800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.54300000000000004},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.65700000000000003,"15min":0.56799999999999995},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.782,"5min":4.782,"15min":4.782},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Mar 2 10:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Mar 2 10:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.64800000000000002,"15min":0.57799999999999996},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.7569999999999997,"5min":4.7569999999999997,"15min":4.7569999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80500000000000005,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Mar 2 10:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78400000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.52100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Mar 2 10:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.36499999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.65100000000000002,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.372,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.871,"5min":1.171,"15min":1.171},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Mar 2 10:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.47299999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.054,"5min":1.298,"15min":1.298},"last":0.745},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0740000000000001,"5min":1.23,"15min":1.23},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Mar 2 10:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.81299999999999994,"15min":0.82099999999999995},"min":{"1min":0.54200000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.8220000000000001,"5min":4.8220000000000001,"15min":4.8220000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76900000000000002,"15min":0.79300000000000004},"min":{"1min":0.52700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.752}]},{"osd":9,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.76400000000000001,"15min":0.78100000000000003},"min":{"1min":0.40500000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.093,"5min":1.149,"15min":1.149},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1950000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.63}]},{"osd":10,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.64200000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.91000000000000003,"5min":1.22,"15min":1.22},"last":0.47199999999999998}]},{"osd":11,"last update":"Thu Mar 2 10:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.63900000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77300000000000002,"15min":0.77100000000000002},"min":{"1min":0.66600000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.77100000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7532,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":93737620,"statfs":{"total":95995035648,"available":95987322880,"internally_reserved":0,"allocated":1019904,"data_stored":505753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.58699999999999997,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.60799999999999998,"15min":0.52800000000000002},"min":{"1min":0.39100000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":3.9239999999999999,"5min":3.9239999999999999,"15min":3.9239999999999999},"last":0.75}]},{"osd":1,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55400000000000005,"15min":0.51800000000000002},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.56799999999999995,"15min":0.51700000000000002},"min":{"1min":0.41899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.67700000000000005,"15min":0.59199999999999997},"min":{"1min":0.45700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":4.4009999999999998},"last":0.505},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.65900000000000003,"15min":0.60199999999999998},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.4500000000000002,"5min":4.4500000000000002,"15min":4.4500000000000002},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Mar 2 10:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Mar 2 10:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.48499999999999999,"15min":0.47499999999999998},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51100000000000001},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Mar 2 10:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":0.871,"15min":0.871},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.63400000000000001,"15min":0.61399999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":4.0490000000000004,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Mar 2 10:54:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.6639999999999999}]},{"osd":8,"last update":"Thu Mar 2 10:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.39100000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.39000000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.91500000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56200000000000006}]},{"osd":9,"last update":"Thu Mar 2 10:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.69899999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.73999999999999999,"15min":0.71899999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.1790000000000003,"5min":4.1790000000000003,"15min":4.1790000000000003},"last":0.71199999999999997}]},{"osd":10,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.51800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70299999999999996}]},{"osd":11,"last update":"Thu Mar 2 10:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.67500000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149763,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6632,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738520,"statfs":{"total":95995035648,"available":95988244480,"internally_reserved":0,"allocated":950272,"data_stored":447270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.57399999999999995,"15min":0.438},"min":{"1min":0.33300000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61699999999999999,"5min":14.122,"15min":14.122},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.54200000000000004,"15min":0.435},"min":{"1min":0.29799999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.59999999999999998,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61899999999999999,"15min":0.57499999999999996},"min":{"1min":0.433,"5min":0.316,"15min":0.316},"max":{"1min":0.84699999999999998,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.67600000000000005,"15min":0.59399999999999997},"min":{"1min":0.437,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65000000000000002,"5min":9.0719999999999992,"15min":9.0719999999999992},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Mar 2 10:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64800000000000002,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69699999999999995,"5min":4.306,"15min":4.306},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.62},"min":{"1min":0.499,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83099999999999996,"5min":1.421,"15min":1.421},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Mar 2 10:56:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.67000000000000004,"15min":0.63300000000000001},"min":{"1min":0.51500000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.875},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.70999999999999996,"15min":0.65400000000000003},"min":{"1min":0.55600000000000005,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69999999999999996,"15min":0.65800000000000003},"min":{"1min":0.56100000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.155,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.68200000000000005,"15min":0.624},"min":{"1min":0.504,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.60499999999999998,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85599999999999998,"5min":5.0170000000000003,"15min":5.0170000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.68899999999999995,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73699999999999999,"5min":9.1270000000000007,"15min":9.1270000000000007},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Mar 2 10:56:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.81299999999999994,"15min":0.82699999999999996},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.748,"15min":0.71399999999999997},"min":{"1min":0.52800000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.84199999999999997}]},{"osd":8,"last update":"Thu Mar 2 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":6.9539999999999997,"5min":6.9539999999999997,"15min":6.9539999999999997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.76300000000000001}]},{"osd":9,"last update":"Thu Mar 2 10:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.76500000000000001,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.82799999999999996,"15min":0.80900000000000005},"min":{"1min":0.56599999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.72899999999999998}]},{"osd":10,"last update":"Thu Mar 2 10:56:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":0.875,"15min":0.78300000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":9.0210000000000008,"5min":9.0210000000000008,"15min":9.0210000000000008},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":0.84599999999999997,"15min":0.79200000000000004},"min":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.3970000000000002,"5min":4.3970000000000002,"15min":4.3970000000000002},"last":0.754}]},{"osd":11,"last update":"Thu Mar 2 10:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.63},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.77800000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6560,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738592,"statfs":{"total":95995035648,"available":95988318208,"internally_reserved":0,"allocated":942080,"data_stored":448279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.65300000000000002,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81200000000000006,"5min":5.8860000000000001,"15min":5.8860000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64000000000000001,"15min":0.67400000000000004},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.95599999999999996,"5min":5.577,"15min":5.577},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38200000000000001,"15min":0.34999999999999998},"min":{"1min":0.30399999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.65700000000000003,"5min":0.872,"15min":0.872},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.35899999999999999},"min":{"1min":0.34300000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.55100000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.47999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57699999999999996,"15min":0.54300000000000004},"min":{"1min":0.49199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Mar 2 10:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.56399999999999995,"15min":0.53600000000000003},"min":{"1min":0.47199999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.55500000000000005},"min":{"1min":0.38700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Mar 2 10:56:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.55500000000000005},"min":{"1min":0.49099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79900000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59499999999999997,"15min":0.55800000000000005},"min":{"1min":0.51000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Mar 2 10:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.745,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.61599999999999999},"min":{"1min":0.48199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82699999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Mar 2 10:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.52100000000000002},"min":{"1min":0.44500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":1.02,"15min":1.02},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Mar 2 10:56:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.70399999999999996},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.88700000000000001,"5min":1.087,"15min":1.087},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71999999999999997,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91300000000000003,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.85299999999999998}]},{"osd":9,"last update":"Thu Mar 2 10:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.751},"min":{"1min":0.50800000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1180000000000001,"5min":1.149,"15min":1.149},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.107,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.875}]},{"osd":10,"last update":"Thu Mar 2 10:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.58499999999999996,"5min":0.433,"15min":0.433},"max":{"1min":0.92800000000000005,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.51000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89500000000000002,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.629}]},{"osd":11,"last update":"Thu Mar 2 10:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.92000000000000004}]}]},{"osd":5,"up_from":39,"seq":167503724601,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6696,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738456,"statfs":{"total":95995035648,"available":95988178944,"internally_reserved":0,"allocated":1015808,"data_stored":1040511,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76900000000000002,"5min":1.51,"15min":1.51},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.41299999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84699999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56799999999999995,"15min":0.53600000000000003},"min":{"1min":0.47099999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.877,"15min":0.877},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.502,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71599999999999997,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.35699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67800000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.437},"min":{"1min":0.34100000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65300000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.56200000000000006},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76200000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Mar 2 10:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.60799999999999998},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61599999999999999,"15min":0.57499999999999996},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Mar 2 10:55:43 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.878,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Mar 2 10:55:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.54000000000000004,"5min":0.374,"15min":0.374},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.72899999999999998}]},{"osd":8,"last update":"Thu Mar 2 10:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.45000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.92500000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Mar 2 10:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.749,"15min":0.751},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.86399999999999999}]},{"osd":10,"last update":"Thu Mar 2 10:56:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.59799999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98899999999999999,"5min":1.01,"15min":1.01},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73599999999999999,"15min":0.72799999999999998},"min":{"1min":0.57499999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.82999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35112,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36759,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-02T10:56:48.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:56:48.709 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:48 smithi122 ceph-mon[125440]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-02T10:56:48.709 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:48 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3198160912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:48 smithi136 ceph-mon[125702]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-02T10:56:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:48 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3198160912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:48.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.893+0000 7f8e883ff700 1 -- 172.21.15.57:0/2095089343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e801005d0 msgr2=0x7f8e80106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.893+0000 7f8e883ff700 1 --2- 172.21.15.57:0/2095089343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e801005d0 0x7f8e80106e70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009990 tx=0x7f8e78009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.894+0000 7f8e883ff700 1 -- 172.21.15.57:0/2095089343 shutdown_connections 2023-03-02T10:56:48.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.894+0000 7f8e883ff700 1 --2- 172.21.15.57:0/2095089343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e801005d0 0x7f8e80106e70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.894+0000 7f8e883ff700 1 --2- 172.21.15.57:0/2095089343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e800fe990 0x7f8e800feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.894+0000 7f8e883ff700 1 --2- 172.21.15.57:0/2095089343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e800ffc20 0x7f8e80100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.894+0000 7f8e883ff700 1 -- 172.21.15.57:0/2095089343 >> 172.21.15.57:0/2095089343 conn(0x7f8e800f9fd0 msgr2=0x7f8e800fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:48.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.894+0000 7f8e883ff700 1 -- 172.21.15.57:0/2095089343 shutdown_connections 2023-03-02T10:56:48.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.894+0000 7f8e883ff700 1 -- 172.21.15.57:0/2095089343 wait complete. 2023-03-02T10:56:48.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.894+0000 7f8e883ff700 1 Processor -- start 2023-03-02T10:56:48.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.894+0000 7f8e883ff700 1 -- start start 2023-03-02T10:56:48.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e883ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e800fe990 0x7f8e801029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e883ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e800ffc20 0x7f8e80101000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e883ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e801005d0 0x7f8e80101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e883ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e80101ce0 con 0x7f8e800fe990 2023-03-02T10:56:48.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e883ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e80101e50 con 0x7f8e800ffc20 2023-03-02T10:56:48.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e883ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8019f820 con 0x7f8e801005d0 2023-03-02T10:56:48.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e8619b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e800fe990 0x7f8e801029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e8619b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e800fe990 0x7f8e801029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53990/0 (socket says 172.21.15.57:53990) 2023-03-02T10:56:48.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e8619b700 1 -- 172.21.15.57:0/3770247334 learned_addr learned my addr 172.21.15.57:0/3770247334 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:48.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e8599a700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e800ffc20 0x7f8e80101000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e8699c700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e801005d0 0x7f8e80101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e8619b700 1 -- 172.21.15.57:0/3770247334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e801005d0 msgr2=0x7f8e80101540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e8619b700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e801005d0 0x7f8e80101540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e8619b700 1 -- 172.21.15.57:0/3770247334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e800ffc20 msgr2=0x7f8e80101000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:48.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e8619b700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e800ffc20 0x7f8e80101000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:48.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e8619b700 1 -- 172.21.15.57:0/3770247334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e780095f0 con 0x7f8e800fe990 2023-03-02T10:56:48.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.895+0000 7f8e8619b700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e800fe990 0x7f8e801029c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00ef10 tx=0x7f8e7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:48.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.896+0000 7f8e777fe700 1 -- 172.21.15.57:0/3770247334 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c00c9c0 con 0x7f8e800fe990 2023-03-02T10:56:48.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.896+0000 7f8e777fe700 1 -- 172.21.15.57:0/3770247334 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e7c00f040 con 0x7f8e800fe990 2023-03-02T10:56:48.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.896+0000 7f8e883ff700 1 -- 172.21.15.57:0/3770247334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8010a2f0 con 0x7f8e800fe990 2023-03-02T10:56:48.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.896+0000 7f8e777fe700 1 -- 172.21.15.57:0/3770247334 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c014480 con 0x7f8e800fe990 2023-03-02T10:56:48.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.896+0000 7f8e883ff700 1 -- 172.21.15.57:0/3770247334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8010a160 con 0x7f8e800fe990 2023-03-02T10:56:48.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.897+0000 7f8e883ff700 1 -- 172.21.15.57:0/3770247334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8019fe80 con 0x7f8e800fe990 2023-03-02T10:56:48.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.898+0000 7f8e777fe700 1 -- 172.21.15.57:0/3770247334 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f8e7c007690 con 0x7f8e800fe990 2023-03-02T10:56:48.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.899+0000 7f8e777fe700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e6c09b3a0 0x7f8e6c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:48.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.899+0000 7f8e777fe700 1 -- 172.21.15.57:0/3770247334 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8e7c0c5360 con 0x7f8e800fe990 2023-03-02T10:56:48.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.899+0000 7f8e8599a700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e6c09b3a0 0x7f8e6c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:48.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.900+0000 7f8e8599a700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e6c09b3a0 0x7f8e6c09d850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e70005950 tx=0x7f8e7000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:48.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:48.903+0000 7f8e777fe700 1 -- 172.21.15.57:0/3770247334 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f8e7c090c30 con 0x7f8e800fe990 2023-03-02T10:56:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.101+0000 7f8e883ff700 1 -- 172.21.15.57:0/3770247334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e801a0520 con 0x7f8e800fe990 2023-03-02T10:56:49.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.103+0000 7f8e777fe700 1 -- 172.21.15.57:0/3770247334 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22553 (secure 0 0 0) 0x7f8e7c094250 con 0x7f8e800fe990 2023-03-02T10:56:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:49.104 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":86,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:50.530934+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:56:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 -- 172.21.15.57:0/3770247334 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e6c09b3a0 msgr2=0x7f8e6c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e6c09b3a0 0x7f8e6c09d850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e70005950 tx=0x7f8e7000b410 comp rx=0 tx=0).stop 2023-03-02T10:56:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 -- 172.21.15.57:0/3770247334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e800fe990 msgr2=0x7f8e801029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e800fe990 0x7f8e801029c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00ef10 tx=0x7f8e7c00c3a0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 -- 172.21.15.57:0/3770247334 shutdown_connections 2023-03-02T10:56:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f8e6c09b3a0 0x7f8e6c09d850 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e801005d0 0x7f8e80101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e800fe990 0x7f8e801029c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 --2- 172.21.15.57:0/3770247334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e800ffc20 0x7f8e80101000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 -- 172.21.15.57:0/3770247334 >> 172.21.15.57:0/3770247334 conn(0x7f8e800f9fd0 msgr2=0x7f8e80067680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:49.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 -- 172.21.15.57:0/3770247334 shutdown_connections 2023-03-02T10:56:49.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.105+0000 7f8e883ff700 1 -- 172.21.15.57:0/3770247334 wait complete. 2023-03-02T10:56:49.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-02T10:51:03.600226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-02T10:55:08.504787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-02T10:55:09.909014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-02T10:56:49.122 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-02T10:56:49.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.279+0000 7f1687dff700 1 -- 172.21.15.57:0/1812057839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16801005d0 msgr2=0x7f1680106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.279+0000 7f1687dff700 1 --2- 172.21.15.57:0/1812057839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16801005d0 0x7f1680106e70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f167800b0a0 tx=0x7f167800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.279+0000 7f1687dff700 1 -- 172.21.15.57:0/1812057839 shutdown_connections 2023-03-02T10:56:49.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.279+0000 7f1687dff700 1 --2- 172.21.15.57:0/1812057839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16801005d0 0x7f1680106e70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.279+0000 7f1687dff700 1 --2- 172.21.15.57:0/1812057839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16800fe990 0x7f16800feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.279+0000 7f1687dff700 1 --2- 172.21.15.57:0/1812057839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16800ffc20 0x7f1680100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.279+0000 7f1687dff700 1 -- 172.21.15.57:0/1812057839 >> 172.21.15.57:0/1812057839 conn(0x7f16800f9fd0 msgr2=0x7f16800fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:49.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.279+0000 7f1687dff700 1 -- 172.21.15.57:0/1812057839 shutdown_connections 2023-03-02T10:56:49.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.279+0000 7f1687dff700 1 -- 172.21.15.57:0/1812057839 wait complete. 2023-03-02T10:56:49.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.280+0000 7f1687dff700 1 Processor -- start 2023-03-02T10:56:49.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.280+0000 7f1687dff700 1 -- start start 2023-03-02T10:56:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.280+0000 7f1687dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16800fe990 0x7f16801029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.280+0000 7f1687dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16800ffc20 0x7f1680101000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.280+0000 7f1687dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16801005d0 0x7f1680101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.280+0000 7f1687dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1680101ce0 con 0x7f16800ffc20 2023-03-02T10:56:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.280+0000 7f1687dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1680101e50 con 0x7f16801005d0 2023-03-02T10:56:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.280+0000 7f1687dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168019f960 con 0x7f16800fe990 2023-03-02T10:56:49.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.280+0000 7f168539a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16800ffc20 0x7f1680101000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:49.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f168539a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16800ffc20 0x7f1680101000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54010/0 (socket says 172.21.15.57:54010) 2023-03-02T10:56:49.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f168539a700 1 -- 172.21.15.57:0/14634423 learned_addr learned my addr 172.21.15.57:0/14634423 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:49.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f1685b9b700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16800fe990 0x7f16801029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:49.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f168639c700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16801005d0 0x7f1680101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:49.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f168539a700 1 -- 172.21.15.57:0/14634423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16800fe990 msgr2=0x7f16801029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f168539a700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16800fe990 0x7f16801029c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f168539a700 1 -- 172.21.15.57:0/14634423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16801005d0 msgr2=0x7f1680101540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f168539a700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16801005d0 0x7f1680101540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f168539a700 1 -- 172.21.15.57:0/14634423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678009d00 con 0x7f16800ffc20 2023-03-02T10:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f168539a700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16800ffc20 0x7f1680101000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f167000d950 tx=0x7f167000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f1676ffd700 1 -- 172.21.15.57:0/14634423 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167000f890 con 0x7f16800ffc20 2023-03-02T10:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f1687dff700 1 -- 172.21.15.57:0/14634423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168010a2f0 con 0x7f16800ffc20 2023-03-02T10:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f1676ffd700 1 -- 172.21.15.57:0/14634423 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1670010460 con 0x7f16800ffc20 2023-03-02T10:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f1676ffd700 1 -- 172.21.15.57:0/14634423 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167000e610 con 0x7f16800ffc20 2023-03-02T10:56:49.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.281+0000 7f1687dff700 1 -- 172.21.15.57:0/14634423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168010a160 con 0x7f16800ffc20 2023-03-02T10:56:49.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.282+0000 7f1687dff700 1 -- 172.21.15.57:0/14634423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16801a0050 con 0x7f16800ffc20 2023-03-02T10:56:49.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.284+0000 7f1676ffd700 1 -- 172.21.15.57:0/14634423 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f1670022070 con 0x7f16800ffc20 2023-03-02T10:56:49.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.285+0000 7f1676ffd700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f166c09b3a0 0x7f166c09d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:49.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.285+0000 7f1676ffd700 1 -- 172.21.15.57:0/14634423 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f16700c4bc0 con 0x7f16800ffc20 2023-03-02T10:56:49.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.285+0000 7f1685b9b700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f166c09b3a0 0x7f166c09d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:49.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.285+0000 7f1685b9b700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f166c09b3a0 0x7f166c09d850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f167c005950 tx=0x7f167c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:49.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.287+0000 7f1676ffd700 1 -- 172.21.15.57:0/14634423 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f16700904f0 con 0x7f16800ffc20 2023-03-02T10:56:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:49 smithi057 ceph-mon[92072]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:49 smithi057 ceph-mon[92072]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:49 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3770247334' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:49.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.485+0000 7f1687dff700 1 -- 172.21.15.57:0/14634423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16801a0600 con 0x7f16800ffc20 2023-03-02T10:56:49.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.485+0000 7f1676ffd700 1 -- 172.21.15.57:0/14634423 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1670020020 con 0x7f16800ffc20 2023-03-02T10:56:49.487 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-02T10:56:49.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.487+0000 7f1687dff700 1 -- 172.21.15.57:0/14634423 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f166c09b3a0 msgr2=0x7f166c09d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.487+0000 7f1687dff700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f166c09b3a0 0x7f166c09d850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f167c005950 tx=0x7f167c00b410 comp rx=0 tx=0).stop 2023-03-02T10:56:49.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.488+0000 7f1687dff700 1 -- 172.21.15.57:0/14634423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16800ffc20 msgr2=0x7f1680101000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.488+0000 7f1687dff700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16800ffc20 0x7f1680101000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f167000d950 tx=0x7f167000dc60 comp rx=0 tx=0).stop 2023-03-02T10:56:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.488+0000 7f1687dff700 1 -- 172.21.15.57:0/14634423 shutdown_connections 2023-03-02T10:56:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.488+0000 7f1687dff700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f166c09b3a0 0x7f166c09d850 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.488+0000 7f1687dff700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16801005d0 0x7f1680101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.488+0000 7f1687dff700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16800fe990 0x7f16801029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.488+0000 7f1687dff700 1 --2- 172.21.15.57:0/14634423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16800ffc20 0x7f1680101000 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.488+0000 7f1687dff700 1 -- 172.21.15.57:0/14634423 >> 172.21.15.57:0/14634423 conn(0x7f16800f9fd0 msgr2=0x7f1680067680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:49.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.488+0000 7f1687dff700 1 -- 172.21.15.57:0/14634423 shutdown_connections 2023-03-02T10:56:49.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.488+0000 7f1687dff700 1 -- 172.21.15.57:0/14634423 wait complete. 2023-03-02T10:56:49.504 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-02T10:56:49.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.660+0000 7f019fdff700 1 -- 172.21.15.57:0/1975418274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0198102ed0 msgr2=0x7f01981052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.660+0000 7f019fdff700 1 --2- 172.21.15.57:0/1975418274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0198102ed0 0x7f01981052b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0188009990 tx=0x7f0188009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.661+0000 7f019fdff700 1 -- 172.21.15.57:0/1975418274 shutdown_connections 2023-03-02T10:56:49.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.661+0000 7f019fdff700 1 --2- 172.21.15.57:0/1975418274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01981057f0 0x7f0198107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.661+0000 7f019fdff700 1 --2- 172.21.15.57:0/1975418274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01981005b0 0x7f0198102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.661+0000 7f019fdff700 1 --2- 172.21.15.57:0/1975418274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0198102ed0 0x7f01981052b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.661+0000 7f019fdff700 1 -- 172.21.15.57:0/1975418274 >> 172.21.15.57:0/1975418274 conn(0x7f01980f9fd0 msgr2=0x7f01980fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:49.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.661+0000 7f019fdff700 1 -- 172.21.15.57:0/1975418274 shutdown_connections 2023-03-02T10:56:49.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.661+0000 7f019fdff700 1 -- 172.21.15.57:0/1975418274 wait complete. 2023-03-02T10:56:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.661+0000 7f019fdff700 1 Processor -- start 2023-03-02T10:56:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.661+0000 7f019fdff700 1 -- start start 2023-03-02T10:56:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019fdff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01981005b0 0x7f0198195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019fdff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0198102ed0 0x7f0198195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019fdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01981057f0 0x7f019819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019fdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819d3e0 con 0x7f01981057f0 2023-03-02T10:56:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019fdff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819d520 con 0x7f01981005b0 2023-03-02T10:56:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019fdff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819d6b0 con 0x7f0198102ed0 2023-03-02T10:56:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019e39c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01981057f0 0x7f019819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019e39c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01981057f0 0x7f019819ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54016/0 (socket says 172.21.15.57:54016) 2023-03-02T10:56:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019e39c700 1 -- 172.21.15.57:0/3377685209 learned_addr learned my addr 172.21.15.57:0/3377685209 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019d39a700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0198102ed0 0x7f0198195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019db9b700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01981005b0 0x7f0198195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019e39c700 1 -- 172.21.15.57:0/3377685209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0198102ed0 msgr2=0x7f0198195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019e39c700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0198102ed0 0x7f0198195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019e39c700 1 -- 172.21.15.57:0/3377685209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01981005b0 msgr2=0x7f0198195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019e39c700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01981005b0 0x7f0198195860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019e39c700 1 -- 172.21.15.57:0/3377685209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880095f0 con 0x7f01981057f0 2023-03-02T10:56:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019db9b700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01981005b0 0x7f0198195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.662+0000 7f019e39c700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01981057f0 0x7f019819ce10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0190007f10 tx=0x7f019000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.663+0000 7f018effd700 1 -- 172.21.15.57:0/3377685209 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190017070 con 0x7f01981057f0 2023-03-02T10:56:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.663+0000 7f019fdff700 1 -- 172.21.15.57:0/3377685209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019810b470 con 0x7f01981057f0 2023-03-02T10:56:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.663+0000 7f018effd700 1 -- 172.21.15.57:0/3377685209 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f019000f040 con 0x7f01981057f0 2023-03-02T10:56:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.663+0000 7f018effd700 1 -- 172.21.15.57:0/3377685209 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190005740 con 0x7f01981057f0 2023-03-02T10:56:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.663+0000 7f019fdff700 1 -- 172.21.15.57:0/3377685209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019810b2e0 con 0x7f01981057f0 2023-03-02T10:56:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.664+0000 7f019fdff700 1 -- 172.21.15.57:0/3377685209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01980fbb40 con 0x7f01981057f0 2023-03-02T10:56:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.665+0000 7f018effd700 1 -- 172.21.15.57:0/3377685209 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f01900058a0 con 0x7f01981057f0 2023-03-02T10:56:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.666+0000 7f018effd700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f018409b3a0 0x7f018409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.667+0000 7f018effd700 1 -- 172.21.15.57:0/3377685209 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f01900c48b0 con 0x7f01981057f0 2023-03-02T10:56:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.667+0000 7f019db9b700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f018409b3a0 0x7f018409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.667+0000 7f019db9b700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f018409b3a0 0x7f018409d850 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0194005950 tx=0x7f01940058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:49.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.670+0000 7f018effd700 1 -- 172.21.15.57:0/3377685209 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f01900901e0 con 0x7f01981057f0 2023-03-02T10:56:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:49 smithi122 ceph-mon[125440]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:49 smithi122 ceph-mon[125440]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:49 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3770247334' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:49 smithi136 ceph-mon[125702]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:49 smithi136 ceph-mon[125702]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:49 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3770247334' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:49.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.869+0000 7f019fdff700 1 -- 172.21.15.57:0/3377685209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01980611d0 con 0x7f01981057f0 2023-03-02T10:56:49.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.869+0000 7f018effd700 1 -- 172.21.15.57:0/3377685209 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0190093800 con 0x7f01981057f0 2023-03-02T10:56:49.870 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-03-02T10:56:49.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.871+0000 7f019fdff700 1 -- 172.21.15.57:0/3377685209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f018409b3a0 msgr2=0x7f018409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.871+0000 7f019fdff700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f018409b3a0 0x7f018409d850 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0194005950 tx=0x7f01940058e0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.871+0000 7f019fdff700 1 -- 172.21.15.57:0/3377685209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01981057f0 msgr2=0x7f019819ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:49.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.871+0000 7f019fdff700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01981057f0 0x7f019819ce10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0190007f10 tx=0x7f019000d3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.872+0000 7f019fdff700 1 -- 172.21.15.57:0/3377685209 shutdown_connections 2023-03-02T10:56:49.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.872+0000 7f019fdff700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f018409b3a0 0x7f018409d850 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.872+0000 7f019fdff700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01981057f0 0x7f019819ce10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.872+0000 7f019fdff700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01981005b0 0x7f0198195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.872+0000 7f019fdff700 1 --2- 172.21.15.57:0/3377685209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0198102ed0 0x7f0198195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:49.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.872+0000 7f019fdff700 1 -- 172.21.15.57:0/3377685209 >> 172.21.15.57:0/3377685209 conn(0x7f01980f9fd0 msgr2=0x7f01981012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:49.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.872+0000 7f019fdff700 1 -- 172.21.15.57:0/3377685209 shutdown_connections 2023-03-02T10:56:49.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:49.872+0000 7f019fdff700 1 -- 172.21.15.57:0/3377685209 wait complete. 2023-03-02T10:56:49.888 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-02T10:56:50.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.045+0000 7fbea93ff700 1 -- 172.21.15.57:0/4244644460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea40ffc20 msgr2=0x7fbea4100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.045+0000 7fbea93ff700 1 --2- 172.21.15.57:0/4244644460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea40ffc20 0x7fbea4100090 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009990 tx=0x7fbe98009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.045+0000 7fbea93ff700 1 -- 172.21.15.57:0/4244644460 shutdown_connections 2023-03-02T10:56:50.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.045+0000 7fbea93ff700 1 --2- 172.21.15.57:0/4244644460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbea41005d0 0x7fbea4106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.045+0000 7fbea93ff700 1 --2- 172.21.15.57:0/4244644460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbea40fe990 0x7fbea40feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.045+0000 7fbea93ff700 1 --2- 172.21.15.57:0/4244644460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea40ffc20 0x7fbea4100090 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.045+0000 7fbea93ff700 1 -- 172.21.15.57:0/4244644460 >> 172.21.15.57:0/4244644460 conn(0x7fbea40f9fd0 msgr2=0x7fbea40fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:50.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.045+0000 7fbea93ff700 1 -- 172.21.15.57:0/4244644460 shutdown_connections 2023-03-02T10:56:50.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.045+0000 7fbea93ff700 1 -- 172.21.15.57:0/4244644460 wait complete. 2023-03-02T10:56:50.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea93ff700 1 Processor -- start 2023-03-02T10:56:50.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea93ff700 1 -- start start 2023-03-02T10:56:50.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea93ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbea40fe990 0x7fbea4197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea93ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbea40ffc20 0x7fbea4197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea93ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea41005d0 0x7fbea419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea93ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea419f5b0 con 0x7fbea41005d0 2023-03-02T10:56:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea93ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea419f6f0 con 0x7fbea40ffc20 2023-03-02T10:56:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea93ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea419f880 con 0x7fbea40fe990 2023-03-02T10:56:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea41005d0 0x7fbea419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea41005d0 0x7fbea419efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54042/0 (socket says 172.21.15.57:54042) 2023-03-02T10:56:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea37fe700 1 -- 172.21.15.57:0/3151610495 learned_addr learned my addr 172.21.15.57:0/3151610495 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea27fc700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbea40ffc20 0x7fbea4197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.046+0000 7fbea2ffd700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbea40fe990 0x7fbea4197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbea37fe700 1 -- 172.21.15.57:0/3151610495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbea40fe990 msgr2=0x7fbea4197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbea37fe700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbea40fe990 0x7fbea4197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbea37fe700 1 -- 172.21.15.57:0/3151610495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbea40ffc20 msgr2=0x7fbea4197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbea37fe700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbea40ffc20 0x7fbea4197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbea37fe700 1 -- 172.21.15.57:0/3151610495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe980095f0 con 0x7fbea41005d0 2023-03-02T10:56:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbea27fc700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbea40ffc20 0x7fbea4197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbea37fe700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea41005d0 0x7fbea419efe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00ef30 tx=0x7fbe9c00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbe8bfff700 1 -- 172.21.15.57:0/3151610495 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c018070 con 0x7fbea41005d0 2023-03-02T10:56:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbe8bfff700 1 -- 172.21.15.57:0/3151610495 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe9c00f040 con 0x7fbea41005d0 2023-03-02T10:56:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbea93ff700 1 -- 172.21.15.57:0/3151610495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea410a340 con 0x7fbea41005d0 2023-03-02T10:56:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbe8bfff700 1 -- 172.21.15.57:0/3151610495 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c003dc0 con 0x7fbea41005d0 2023-03-02T10:56:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.047+0000 7fbea93ff700 1 -- 172.21.15.57:0/3151610495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea410a1b0 con 0x7fbea41005d0 2023-03-02T10:56:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.048+0000 7fbea93ff700 1 -- 172.21.15.57:0/3151610495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea419ff10 con 0x7fbea41005d0 2023-03-02T10:56:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.049+0000 7fbe8bfff700 1 -- 172.21.15.57:0/3151610495 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fbe9c00caa0 con 0x7fbea41005d0 2023-03-02T10:56:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.050+0000 7fbe8bfff700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbe8c09b420 0x7fbe8c09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.050+0000 7fbe8bfff700 1 -- 172.21.15.57:0/3151610495 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbe9c0c4d00 con 0x7fbea41005d0 2023-03-02T10:56:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.050+0000 7fbea2ffd700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbe8c09b420 0x7fbe8c09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.051+0000 7fbea2ffd700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbe8c09b420 0x7fbe8c09d8d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009bf0 tx=0x7fbe94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:50.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.054+0000 7fbe8bfff700 1 -- 172.21.15.57:0/3151610495 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fbe9c0906c0 con 0x7fbea41005d0 2023-03-02T10:56:50.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.250+0000 7fbea93ff700 1 -- 172.21.15.57:0/3151610495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbea41a04c0 con 0x7fbea41005d0 2023-03-02T10:56:50.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.250+0000 7fbe8bfff700 1 -- 172.21.15.57:0/3151610495 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe9c093ce0 con 0x7fbea41005d0 2023-03-02T10:56:50.252 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-03-02T10:56:50.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.252+0000 7fbea93ff700 1 -- 172.21.15.57:0/3151610495 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbe8c09b420 msgr2=0x7fbe8c09d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.252+0000 7fbea93ff700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbe8c09b420 0x7fbe8c09d8d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009bf0 tx=0x7fbe94009260 comp rx=0 tx=0).stop 2023-03-02T10:56:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.252+0000 7fbea93ff700 1 -- 172.21.15.57:0/3151610495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea41005d0 msgr2=0x7fbea419efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.252+0000 7fbea93ff700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea41005d0 0x7fbea419efe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00ef30 tx=0x7fbe9c00c450 comp rx=0 tx=0).stop 2023-03-02T10:56:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.253+0000 7fbea93ff700 1 -- 172.21.15.57:0/3151610495 shutdown_connections 2023-03-02T10:56:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.253+0000 7fbea93ff700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbe8c09b420 0x7fbe8c09d8d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.253+0000 7fbea93ff700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea41005d0 0x7fbea419efe0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.253+0000 7fbea93ff700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbea40fe990 0x7fbea4197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.253+0000 7fbea93ff700 1 --2- 172.21.15.57:0/3151610495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbea40ffc20 0x7fbea4197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.253+0000 7fbea93ff700 1 -- 172.21.15.57:0/3151610495 >> 172.21.15.57:0/3151610495 conn(0x7fbea40f9fd0 msgr2=0x7fbea40676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.253+0000 7fbea93ff700 1 -- 172.21.15.57:0/3151610495 shutdown_connections 2023-03-02T10:56:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.253+0000 7fbea93ff700 1 -- 172.21.15.57:0/3151610495 wait complete. 2023-03-02T10:56:50.269 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:56:50.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.423+0000 7fc13f7ff700 1 -- 172.21.15.57:0/137511545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1380ffb20 msgr2=0x7fc1380fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.423+0000 7fc13f7ff700 1 --2- 172.21.15.57:0/137511545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1380ffb20 0x7fc1380fff30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc134009990 tx=0x7fc134009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.423+0000 7fc13f7ff700 1 -- 172.21.15.57:0/137511545 shutdown_connections 2023-03-02T10:56:50.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.423+0000 7fc13f7ff700 1 --2- 172.21.15.57:0/137511545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1381016a0 0x7fc138107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.423+0000 7fc13f7ff700 1 --2- 172.21.15.57:0/137511545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1380ffb20 0x7fc1380fff30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.423+0000 7fc13f7ff700 1 --2- 172.21.15.57:0/137511545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc138100d10 0x7fc138101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.423+0000 7fc13f7ff700 1 -- 172.21.15.57:0/137511545 >> 172.21.15.57:0/137511545 conn(0x7fc1380fb140 msgr2=0x7fc1380fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:50.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.424+0000 7fc13f7ff700 1 -- 172.21.15.57:0/137511545 shutdown_connections 2023-03-02T10:56:50.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.424+0000 7fc13f7ff700 1 -- 172.21.15.57:0/137511545 wait complete. 2023-03-02T10:56:50.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.424+0000 7fc13f7ff700 1 Processor -- start 2023-03-02T10:56:50.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.424+0000 7fc13f7ff700 1 -- start start 2023-03-02T10:56:50.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13f7ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1380ffb20 0x7fc138195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13f7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138100d10 0x7fc138195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13f7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1381016a0 0x7fc13819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13f7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13819d3c0 con 0x7fc138100d10 2023-03-02T10:56:50.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13f7ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13819d500 con 0x7fc1380ffb20 2023-03-02T10:56:50.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13f7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13819d690 con 0x7fc1381016a0 2023-03-02T10:56:50.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13cd9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138100d10 0x7fc138195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13cd9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138100d10 0x7fc138195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54074/0 (socket says 172.21.15.57:54074) 2023-03-02T10:56:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13cd9a700 1 -- 172.21.15.57:0/315731759 learned_addr learned my addr 172.21.15.57:0/315731759 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13d59b700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1380ffb20 0x7fc138195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13dd9c700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1381016a0 0x7fc13819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13cd9a700 1 -- 172.21.15.57:0/315731759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1381016a0 msgr2=0x7fc13819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13cd9a700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1381016a0 0x7fc13819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13cd9a700 1 -- 172.21.15.57:0/315731759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1380ffb20 msgr2=0x7fc138195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13cd9a700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1380ffb20 0x7fc138195840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13cd9a700 1 -- 172.21.15.57:0/315731759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1340095f0 con 0x7fc138100d10 2023-03-02T10:56:50.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.425+0000 7fc13cd9a700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138100d10 0x7fc138195d80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc12800e9a0 tx=0x7fc12800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:50.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.426+0000 7fc12e7fc700 1 -- 172.21.15.57:0/315731759 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc128009790 con 0x7fc138100d10 2023-03-02T10:56:50.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.426+0000 7fc12e7fc700 1 -- 172.21.15.57:0/315731759 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc128010430 con 0x7fc138100d10 2023-03-02T10:56:50.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.426+0000 7fc13f7ff700 1 -- 172.21.15.57:0/315731759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13810b480 con 0x7fc138100d10 2023-03-02T10:56:50.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.426+0000 7fc12e7fc700 1 -- 172.21.15.57:0/315731759 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc128018680 con 0x7fc138100d10 2023-03-02T10:56:50.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.426+0000 7fc13f7ff700 1 -- 172.21.15.57:0/315731759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13810b2f0 con 0x7fc138100d10 2023-03-02T10:56:50.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.427+0000 7fc13f7ff700 1 -- 172.21.15.57:0/315731759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc138106a50 con 0x7fc138100d10 2023-03-02T10:56:50.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.428+0000 7fc12e7fc700 1 -- 172.21.15.57:0/315731759 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7fc12800c040 con 0x7fc138100d10 2023-03-02T10:56:50.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.429+0000 7fc12e7fc700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc12409b3a0 0x7fc12409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.429+0000 7fc12e7fc700 1 -- 172.21.15.57:0/315731759 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc128014070 con 0x7fc138100d10 2023-03-02T10:56:50.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.429+0000 7fc13d59b700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc12409b3a0 0x7fc12409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.430+0000 7fc13d59b700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc12409b3a0 0x7fc12409d850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc134006010 tx=0x7fc134005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:50.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.432+0000 7fc12e7fc700 1 -- 172.21.15.57:0/315731759 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fc128090bd0 con 0x7fc138100d10 2023-03-02T10:56:50.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.675+0000 7fc13f7ff700 1 -- 172.21.15.57:0/315731759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc13802cd50 con 0x7fc138100d10 2023-03-02T10:56:50.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.675+0000 7fc12e7fc700 1 -- 172.21.15.57:0/315731759 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10828 (secure 0 0 0) 0x7fc128026070 con 0x7fc138100d10 2023-03-02T10:56:50.677 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:50.677 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-02T10:55:10.601054+0000","modified":"2023-03-02T10:55:17.554509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24520,"mds_2":24505,"mds_3":24493,"mds_4":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14634":{"gid":14634,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6841/3731858530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6840","nonce":3731858530},{"type":"v1","addr":"172.21.15.57:6841","nonce":3731858530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"e","rank":4,"incarnation":24,"state":"up:active","state_seq":9,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24505":{"gid":24505,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/316639764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":316639764},{"type":"v1","addr":"172.21.15.122:6839","nonce":316639764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-02T10:56:50.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 -- 172.21.15.57:0/315731759 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc12409b3a0 msgr2=0x7fc12409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc12409b3a0 0x7fc12409d850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc134006010 tx=0x7fc134005960 comp rx=0 tx=0).stop 2023-03-02T10:56:50.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 -- 172.21.15.57:0/315731759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138100d10 msgr2=0x7fc138195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138100d10 0x7fc138195d80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc12800e9a0 tx=0x7fc12800ecb0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 -- 172.21.15.57:0/315731759 shutdown_connections 2023-03-02T10:56:50.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fc12409b3a0 0x7fc12409d850 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1381016a0 0x7fc13819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1380ffb20 0x7fc138195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 --2- 172.21.15.57:0/315731759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138100d10 0x7fc138195d80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 -- 172.21.15.57:0/315731759 >> 172.21.15.57:0/315731759 conn(0x7fc1380fb140 msgr2=0x7fc1380fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:50.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 -- 172.21.15.57:0/315731759 shutdown_connections 2023-03-02T10:56:50.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.678+0000 7fc13f7ff700 1 -- 172.21.15.57:0/315731759 wait complete. 2023-03-02T10:56:50.681 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-03-02T10:56:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:50 smithi057 ceph-mon[92072]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:50 smithi057 ceph-mon[92072]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 12 op/s 2023-03-02T10:56:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:50 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/14634423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:50 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3377685209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:50 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3151610495' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:50.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-02T10:56:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:50 smithi122 ceph-mon[125440]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:50 smithi122 ceph-mon[125440]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 12 op/s 2023-03-02T10:56:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:50 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/14634423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:50 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3377685209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:50 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3151610495' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:50 smithi136 ceph-mon[125702]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-02T10:56:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:50 smithi136 ceph-mon[125702]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 12 op/s 2023-03-02T10:56:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:50 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/14634423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-02T10:56:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:50 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3377685209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-02T10:56:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:50 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3151610495' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-02T10:56:50.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.847+0000 7f37c11ff700 1 -- 172.21.15.57:0/2536534246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37bc0ffc20 msgr2=0x7f37bc100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.847+0000 7f37c11ff700 1 --2- 172.21.15.57:0/2536534246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37bc0ffc20 0x7f37bc100090 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009990 tx=0x7f37b0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.847+0000 7f37c11ff700 1 -- 172.21.15.57:0/2536534246 shutdown_connections 2023-03-02T10:56:50.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.847+0000 7f37c11ff700 1 --2- 172.21.15.57:0/2536534246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37bc1005d0 0x7f37bc106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.847+0000 7f37c11ff700 1 --2- 172.21.15.57:0/2536534246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37bc0fe990 0x7f37bc0feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.847+0000 7f37c11ff700 1 --2- 172.21.15.57:0/2536534246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37bc0ffc20 0x7f37bc100090 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.847+0000 7f37c11ff700 1 -- 172.21.15.57:0/2536534246 >> 172.21.15.57:0/2536534246 conn(0x7f37bc0f9fd0 msgr2=0x7f37bc0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:50.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.847+0000 7f37c11ff700 1 -- 172.21.15.57:0/2536534246 shutdown_connections 2023-03-02T10:56:50.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.847+0000 7f37c11ff700 1 -- 172.21.15.57:0/2536534246 wait complete. 2023-03-02T10:56:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37c11ff700 1 Processor -- start 2023-03-02T10:56:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37c11ff700 1 -- start start 2023-03-02T10:56:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37c11ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37bc0fe990 0x7f37bc195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37c11ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37bc0ffc20 0x7f37bc195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37c11ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37bc1005d0 0x7f37bc19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37c11ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc19d390 con 0x7f37bc0ffc20 2023-03-02T10:56:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37c11ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc19d4d0 con 0x7f37bc1005d0 2023-03-02T10:56:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37c11ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc19d660 con 0x7f37bc0fe990 2023-03-02T10:56:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37ba59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37bc0ffc20 0x7f37bc195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37ba59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37bc0ffc20 0x7f37bc195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54088/0 (socket says 172.21.15.57:54088) 2023-03-02T10:56:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37ba59c700 1 -- 172.21.15.57:0/4119578915 learned_addr learned my addr 172.21.15.57:0/4119578915 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37bad9d700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37bc0fe990 0x7f37bc195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.848+0000 7f37bb59e700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37bc1005d0 0x7f37bc19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.849+0000 7f37ba59c700 1 -- 172.21.15.57:0/4119578915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37bc0fe990 msgr2=0x7f37bc195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.849+0000 7f37ba59c700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37bc0fe990 0x7f37bc195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.849+0000 7f37ba59c700 1 -- 172.21.15.57:0/4119578915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37bc1005d0 msgr2=0x7f37bc19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:50.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.849+0000 7f37ba59c700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37bc1005d0 0x7f37bc19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:50.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.849+0000 7f37ba59c700 1 -- 172.21.15.57:0/4119578915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b00095f0 con 0x7f37bc0ffc20 2023-03-02T10:56:50.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.849+0000 7f37ba59c700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37bc0ffc20 0x7f37bc195d50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f37b00059d0 tx=0x7f37b00047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.849+0000 7f37a3fff700 1 -- 172.21.15.57:0/4119578915 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b001d070 con 0x7f37bc0ffc20 2023-03-02T10:56:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.849+0000 7f37a3fff700 1 -- 172.21.15.57:0/4119578915 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37b000fb90 con 0x7f37bc0ffc20 2023-03-02T10:56:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.849+0000 7f37a3fff700 1 -- 172.21.15.57:0/4119578915 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0017650 con 0x7f37bc0ffc20 2023-03-02T10:56:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.849+0000 7f37c11ff700 1 -- 172.21.15.57:0/4119578915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc10a2f0 con 0x7f37bc0ffc20 2023-03-02T10:56:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.849+0000 7f37c11ff700 1 -- 172.21.15.57:0/4119578915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc10a160 con 0x7f37bc0ffc20 2023-03-02T10:56:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.850+0000 7f37c11ff700 1 -- 172.21.15.57:0/4119578915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc19dbb0 con 0x7f37bc0ffc20 2023-03-02T10:56:50.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.852+0000 7f37a3fff700 1 -- 172.21.15.57:0/4119578915 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f37b0029030 con 0x7f37bc0ffc20 2023-03-02T10:56:50.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.853+0000 7f37a3fff700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f37a409b3a0 0x7f37a409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:50.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.853+0000 7f37a3fff700 1 -- 172.21.15.57:0/4119578915 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f37b00c69c0 con 0x7f37bc0ffc20 2023-03-02T10:56:50.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.853+0000 7f37bad9d700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f37a409b3a0 0x7f37a409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:50.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.854+0000 7f37bad9d700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f37a409b3a0 0x7f37a409d850 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f37ac005950 tx=0x7f37ac00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:50.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:50.856+0000 7f37a3fff700 1 -- 172.21.15.57:0/4119578915 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f37b0092380 con 0x7f37bc0ffc20 2023-03-02T10:56:51.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.056+0000 7f37c11ff700 1 -- 172.21.15.57:0/4119578915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37bc19e160 con 0x7f37bc0ffc20 2023-03-02T10:56:51.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.058+0000 7f37a3fff700 1 -- 172.21.15.57:0/4119578915 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22553 (secure 0 0 0) 0x7f37b0027070 con 0x7f37bc0ffc20 2023-03-02T10:56:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:56:51.059 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":86,"fsid":"886f029e-b8e7-11ed-9ae9-001a4aab830c","created":"2023-03-02T10:47:58.477515+0000","modified":"2023-03-02T10:55:50.530934+0000","last_up_change":"2023-03-02T10:54:24.416881+0000","last_in_change":"2023-03-02T10:54:06.619011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-02T10:51:03.600226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-02T10:55:08.504787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-02T10:55:09.909014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3cfc44e0-909d-44b5-8e46-9b49c6b752c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6803","nonce":3424789568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6805","nonce":3424789568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6809","nonce":3424789568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3424789568},{"type":"v1","addr":"172.21.15.57:6807","nonce":3424789568}]},"public_addr":"172.21.15.57:6803/3424789568","cluster_addr":"172.21.15.57:6805/3424789568","heartbeat_back_addr":"172.21.15.57:6809/3424789568","heartbeat_front_addr":"172.21.15.57:6807/3424789568","state":["exists","up"]},{"osd":1,"uuid":"ca0af291-6446-4019-a4cd-16a4998db8da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6801","nonce":3137030717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6803","nonce":3137030717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6807","nonce":3137030717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3137030717},{"type":"v1","addr":"172.21.15.122:6805","nonce":3137030717}]},"public_addr":"172.21.15.122:6801/3137030717","cluster_addr":"172.21.15.122:6803/3137030717","heartbeat_back_addr":"172.21.15.122:6807/3137030717","heartbeat_front_addr":"172.21.15.122:6805/3137030717","state":["exists","up"]},{"osd":2,"uuid":"b0882e69-9661-4006-9350-108c73b8cbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6801","nonce":3723258212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6803","nonce":3723258212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6807","nonce":3723258212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3723258212},{"type":"v1","addr":"172.21.15.136:6805","nonce":3723258212}]},"public_addr":"172.21.15.136:6801/3723258212","cluster_addr":"172.21.15.136:6803/3723258212","heartbeat_back_addr":"172.21.15.136:6807/3723258212","heartbeat_front_addr":"172.21.15.136:6805/3723258212","state":["exists","up"]},{"osd":3,"uuid":"6780f146-3f9c-486e-8c2c-415f2e8190e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6811","nonce":137683841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6813","nonce":137683841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6817","nonce":137683841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":137683841},{"type":"v1","addr":"172.21.15.57:6815","nonce":137683841}]},"public_addr":"172.21.15.57:6811/137683841","cluster_addr":"172.21.15.57:6813/137683841","heartbeat_back_addr":"172.21.15.57:6817/137683841","heartbeat_front_addr":"172.21.15.57:6815/137683841","state":["exists","up"]},{"osd":4,"uuid":"f79aa927-c257-4a89-a24a-d235a136cd70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6809","nonce":2152605996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6811","nonce":2152605996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6815","nonce":2152605996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2152605996},{"type":"v1","addr":"172.21.15.122:6813","nonce":2152605996}]},"public_addr":"172.21.15.122:6809/2152605996","cluster_addr":"172.21.15.122:6811/2152605996","heartbeat_back_addr":"172.21.15.122:6815/2152605996","heartbeat_front_addr":"172.21.15.122:6813/2152605996","state":["exists","up"]},{"osd":5,"uuid":"805a1c8d-9f65-42ac-b478-d085491724a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6809","nonce":3384464400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6811","nonce":3384464400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6815","nonce":3384464400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3384464400},{"type":"v1","addr":"172.21.15.136:6813","nonce":3384464400}]},"public_addr":"172.21.15.136:6809/3384464400","cluster_addr":"172.21.15.136:6811/3384464400","heartbeat_back_addr":"172.21.15.136:6815/3384464400","heartbeat_front_addr":"172.21.15.136:6813/3384464400","state":["exists","up"]},{"osd":6,"uuid":"818fc49e-7291-4275-82c8-ee8b86ae5676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6819","nonce":2002099280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6821","nonce":2002099280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6825","nonce":2002099280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2002099280},{"type":"v1","addr":"172.21.15.57:6823","nonce":2002099280}]},"public_addr":"172.21.15.57:6819/2002099280","cluster_addr":"172.21.15.57:6821/2002099280","heartbeat_back_addr":"172.21.15.57:6825/2002099280","heartbeat_front_addr":"172.21.15.57:6823/2002099280","state":["exists","up"]},{"osd":7,"uuid":"942b92f0-db14-4495-9b71-672ee373313c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6817","nonce":3795364822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6819","nonce":3795364822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6823","nonce":3795364822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3795364822},{"type":"v1","addr":"172.21.15.122:6821","nonce":3795364822}]},"public_addr":"172.21.15.122:6817/3795364822","cluster_addr":"172.21.15.122:6819/3795364822","heartbeat_back_addr":"172.21.15.122:6823/3795364822","heartbeat_front_addr":"172.21.15.122:6821/3795364822","state":["exists","up"]},{"osd":8,"uuid":"cfb28b1d-2458-4e6f-a849-6f14011393fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6817","nonce":4084154277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6819","nonce":4084154277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6823","nonce":4084154277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4084154277},{"type":"v1","addr":"172.21.15.136:6821","nonce":4084154277}]},"public_addr":"172.21.15.136:6817/4084154277","cluster_addr":"172.21.15.136:6819/4084154277","heartbeat_back_addr":"172.21.15.136:6823/4084154277","heartbeat_front_addr":"172.21.15.136:6821/4084154277","state":["exists","up"]},{"osd":9,"uuid":"6423cab2-6626-44c1-a9b3-109e1091a0ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6827","nonce":1053351718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6829","nonce":1053351718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6833","nonce":1053351718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1053351718},{"type":"v1","addr":"172.21.15.57:6831","nonce":1053351718}]},"public_addr":"172.21.15.57:6827/1053351718","cluster_addr":"172.21.15.57:6829/1053351718","heartbeat_back_addr":"172.21.15.57:6833/1053351718","heartbeat_front_addr":"172.21.15.57:6831/1053351718","state":["exists","up"]},{"osd":10,"uuid":"affb12a9-38b2-4b1e-a4e0-64269959428c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6825","nonce":2262114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6827","nonce":2262114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6831","nonce":2262114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2262114576},{"type":"v1","addr":"172.21.15.122:6829","nonce":2262114576}]},"public_addr":"172.21.15.122:6825/2262114576","cluster_addr":"172.21.15.122:6827/2262114576","heartbeat_back_addr":"172.21.15.122:6831/2262114576","heartbeat_front_addr":"172.21.15.122:6829/2262114576","state":["exists","up"]},{"osd":11,"uuid":"7a0e8a36-2be5-40ea-945a-289748a2cfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6825","nonce":3852616859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6827","nonce":3852616859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6831","nonce":3852616859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3852616859},{"type":"v1","addr":"172.21.15.136:6829","nonce":3852616859}]},"public_addr":"172.21.15.136:6825/3852616859","cluster_addr":"172.21.15.136:6827/3852616859","heartbeat_back_addr":"172.21.15.136:6831/3852616859","heartbeat_front_addr":"172.21.15.136:6829/3852616859","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:16.322265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:38.558760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:50:59.937841+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:23.895674+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:51:46.056216+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:07.274680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:31.288645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:52:53.720340+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:14.810250+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:53:38.883483+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:01.070821+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-02T10:54:22.549788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6801/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/126285177":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3958644270":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1960665779":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/1985055462":"2023-03-03T10:48:48.778597+0000","172.21.15.57:6800/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6801/3078589149":"2023-03-03T10:48:25.055116+0000","172.21.15.57:6800/3127649723":"2023-03-03T10:48:48.778597+0000","172.21.15.57:0/3996571687":"2023-03-03T10:48:25.055116+0000","172.21.15.57:0/3295199770":"2023-03-03T10:48:48.778597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-02T10:56:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 -- 172.21.15.57:0/4119578915 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f37a409b3a0 msgr2=0x7f37a409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f37a409b3a0 0x7f37a409d850 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f37ac005950 tx=0x7f37ac00b410 comp rx=0 tx=0).stop 2023-03-02T10:56:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 -- 172.21.15.57:0/4119578915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37bc0ffc20 msgr2=0x7f37bc195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37bc0ffc20 0x7f37bc195d50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f37b00059d0 tx=0x7f37b00047a0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 -- 172.21.15.57:0/4119578915 shutdown_connections 2023-03-02T10:56:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f37a409b3a0 0x7f37a409d850 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37bc1005d0 0x7f37bc19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37bc0fe990 0x7f37bc195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 --2- 172.21.15.57:0/4119578915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37bc0ffc20 0x7f37bc195d50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 -- 172.21.15.57:0/4119578915 >> 172.21.15.57:0/4119578915 conn(0x7f37bc0f9fd0 msgr2=0x7f37bc067680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 -- 172.21.15.57:0/4119578915 shutdown_connections 2023-03-02T10:56:51.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.060+0000 7f37c11ff700 1 -- 172.21.15.57:0/4119578915 wait complete. 2023-03-02T10:56:51.077 DEBUG:tasks.fwd_scrub:Yielding 2023-03-02T10:56:51.078 INFO:teuthology.run_tasks:Running task exec... 2023-03-02T10:56:51.088 INFO:teuthology.task.exec:Executing custom commands... 2023-03-02T10:56:51.089 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi057.front.sepia.ceph.com 2023-03-02T10:56:51.089 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-03-02T10:56:51.090 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-03-02T10:56:51.090 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-03-02T10:56:51.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-03-02T10:56:51.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.244+0000 7f53709ff700 1 -- 172.21.15.57:0/101626027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536c102f00 msgr2=0x7f536c1052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.244+0000 7f53709ff700 1 --2- 172.21.15.57:0/101626027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536c102f00 0x7f536c1052e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5360009990 tx=0x7f5360009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.244+0000 7f53709ff700 1 -- 172.21.15.57:0/101626027 shutdown_connections 2023-03-02T10:56:51.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.244+0000 7f53709ff700 1 --2- 172.21.15.57:0/101626027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f536c105820 0x7f536c107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.244+0000 7f53709ff700 1 --2- 172.21.15.57:0/101626027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c1005e0 0x7f536c1029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.244+0000 7f53709ff700 1 --2- 172.21.15.57:0/101626027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536c102f00 0x7f536c1052e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.244+0000 7f53709ff700 1 -- 172.21.15.57:0/101626027 >> 172.21.15.57:0/101626027 conn(0x7f536c0f9fa0 msgr2=0x7f536c0fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.244+0000 7f53709ff700 1 -- 172.21.15.57:0/101626027 shutdown_connections 2023-03-02T10:56:51.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.244+0000 7f53709ff700 1 -- 172.21.15.57:0/101626027 wait complete. 2023-03-02T10:56:51.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.245+0000 7f53709ff700 1 Processor -- start 2023-03-02T10:56:51.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.245+0000 7f53709ff700 1 -- start start 2023-03-02T10:56:51.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.245+0000 7f53709ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536c1005e0 0x7f536c1958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.245+0000 7f53709ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f536c102f00 0x7f536c195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.245+0000 7f53709ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c105820 0x7f536c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.245+0000 7f53709ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c19d450 con 0x7f536c1005e0 2023-03-02T10:56:51.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.245+0000 7f53709ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c19d590 con 0x7f536c105820 2023-03-02T10:56:51.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.245+0000 7f53709ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c19d720 con 0x7f536c102f00 2023-03-02T10:56:51.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f536a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536c1005e0 0x7f536c1958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f536a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536c1005e0 0x7f536c1958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54102/0 (socket says 172.21.15.57:54102) 2023-03-02T10:56:51.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f536a59c700 1 -- 172.21.15.57:0/419238626 learned_addr learned my addr 172.21.15.57:0/419238626 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:51.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f536ad9d700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c105820 0x7f536c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f5369d9b700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f536c102f00 0x7f536c195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f536a59c700 1 -- 172.21.15.57:0/419238626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f536c102f00 msgr2=0x7f536c195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f536a59c700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f536c102f00 0x7f536c195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f536a59c700 1 -- 172.21.15.57:0/419238626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c105820 msgr2=0x7f536c19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f536a59c700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c105820 0x7f536c19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f536a59c700 1 -- 172.21.15.57:0/419238626 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600095f0 con 0x7f536c1005e0 2023-03-02T10:56:51.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f536a59c700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536c1005e0 0x7f536c1958d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f535c00e970 tx=0x7f535c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f535b7fe700 1 -- 172.21.15.57:0/419238626 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c009790 con 0x7f536c1005e0 2023-03-02T10:56:51.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f535b7fe700 1 -- 172.21.15.57:0/419238626 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f535c00c7e0 con 0x7f536c1005e0 2023-03-02T10:56:51.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f53709ff700 1 -- 172.21.15.57:0/419238626 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536c10b4a0 con 0x7f536c1005e0 2023-03-02T10:56:51.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.246+0000 7f535b7fe700 1 -- 172.21.15.57:0/419238626 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c0054e0 con 0x7f536c1005e0 2023-03-02T10:56:51.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.247+0000 7f53709ff700 1 -- 172.21.15.57:0/419238626 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536c10b310 con 0x7f536c1005e0 2023-03-02T10:56:51.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.248+0000 7f53709ff700 1 -- 172.21.15.57:0/419238626 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536c0fbb10 con 0x7f536c1005e0 2023-03-02T10:56:51.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.249+0000 7f535b7fe700 1 -- 172.21.15.57:0/419238626 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f535c01e020 con 0x7f536c1005e0 2023-03-02T10:56:51.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.250+0000 7f3b93dff700 1 -- 172.21.15.57:0/3702030134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b8c100d50 msgr2=0x7f3b8c1011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.250+0000 7f3b93dff700 1 --2- 172.21.15.57:0/3702030134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b8c100d50 0x7f3b8c1011c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009990 tx=0x7f3b7c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.250+0000 7f3b93dff700 1 -- 172.21.15.57:0/3702030134 shutdown_connections 2023-03-02T10:56:51.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.250+0000 7f3b93dff700 1 --2- 172.21.15.57:0/3702030134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b8c101700 0x7f3b8c107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.250+0000 7f3b93dff700 1 --2- 172.21.15.57:0/3702030134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b8c0ffac0 0x7f3b8c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.250+0000 7f3b93dff700 1 --2- 172.21.15.57:0/3702030134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b8c100d50 0x7f3b8c1011c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.250+0000 7f3b93dff700 1 -- 172.21.15.57:0/3702030134 >> 172.21.15.57:0/3702030134 conn(0x7f3b8c0fb100 msgr2=0x7f3b8c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.250+0000 7f3b93dff700 1 -- 172.21.15.57:0/3702030134 shutdown_connections 2023-03-02T10:56:51.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.250+0000 7f3b93dff700 1 -- 172.21.15.57:0/3702030134 wait complete. 2023-03-02T10:56:51.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b93dff700 1 Processor -- start 2023-03-02T10:56:51.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f535b7fe700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f535409b3a0 0x7f535409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b93dff700 1 -- start start 2023-03-02T10:56:51.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f535b7fe700 1 -- 172.21.15.57:0/419238626 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f535c014070 con 0x7f536c1005e0 2023-03-02T10:56:51.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f5369d9b700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f535409b3a0 0x7f535409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b93dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b8c0ffac0 0x7f3b8c195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b93dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b8c100d50 0x7f3b8c195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b93dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b8c101700 0x7f3b8c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b93dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c19d3d0 con 0x7f3b8c101700 2023-03-02T10:56:51.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b93dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c19d510 con 0x7f3b8c0ffac0 2023-03-02T10:56:51.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b93dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c19d6a0 con 0x7f3b8c100d50 2023-03-02T10:56:51.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b9239c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b8c101700 0x7f3b8c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b9239c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b8c101700 0x7f3b8c19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54122/0 (socket says 172.21.15.57:54122) 2023-03-02T10:56:51.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b9239c700 1 -- 172.21.15.57:0/3108145485 learned_addr learned my addr 172.21.15.57:0/3108145485 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:51.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b91b9b700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b8c0ffac0 0x7f3b8c195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.251+0000 7f3b9139a700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b8c100d50 0x7f3b8c195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.252+0000 7f5369d9b700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f535409b3a0 0x7f535409d850 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f536000b2e0 tx=0x7f5360005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.252+0000 7f3b9239c700 1 -- 172.21.15.57:0/3108145485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b8c100d50 msgr2=0x7f3b8c195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.252+0000 7f3b9239c700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b8c100d50 0x7f3b8c195d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.252+0000 7f3b9239c700 1 -- 172.21.15.57:0/3108145485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b8c0ffac0 msgr2=0x7f3b8c195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.252+0000 7f3b9239c700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b8c0ffac0 0x7f3b8c195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.252+0000 7f3b9239c700 1 -- 172.21.15.57:0/3108145485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0095f0 con 0x7f3b8c101700 2023-03-02T10:56:51.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.252+0000 7f3b9239c700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b8c101700 0x7f3b8c19ce00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3b84007ee0 tx=0x7f3b8400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.255+0000 7f3b82ffd700 1 -- 172.21.15.57:0/3108145485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84017070 con 0x7f3b8c101700 2023-03-02T10:56:51.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.255+0000 7f3b82ffd700 1 -- 172.21.15.57:0/3108145485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b8400f040 con 0x7f3b8c101700 2023-03-02T10:56:51.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.255+0000 7f3b93dff700 1 -- 172.21.15.57:0/3108145485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8c10b470 con 0x7f3b8c101700 2023-03-02T10:56:51.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.255+0000 7f3b82ffd700 1 -- 172.21.15.57:0/3108145485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84005580 con 0x7f3b8c101700 2023-03-02T10:56:51.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.255+0000 7f535b7fe700 1 -- 172.21.15.57:0/419238626 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f535c090b00 con 0x7f536c1005e0 2023-03-02T10:56:51.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.255+0000 7f3b93dff700 1 -- 172.21.15.57:0/3108145485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8c10b2e0 con 0x7f3b8c101700 2023-03-02T10:56:51.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.258+0000 7f3b82ffd700 1 -- 172.21.15.57:0/3108145485 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f3b84004c40 con 0x7f3b8c101700 2023-03-02T10:56:51.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.259+0000 7f3b82ffd700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3b7809b420 0x7f3b7809d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.259+0000 7f3b82ffd700 1 -- 172.21.15.57:0/3108145485 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3b840c4790 con 0x7f3b8c101700 2023-03-02T10:56:51.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.259+0000 7f3b91b9b700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3b7809b420 0x7f3b7809d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.259+0000 7f3ba7678b80 1 Processor -- start 2023-03-02T10:56:51.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.259+0000 7f3ba7678b80 1 -- start start 2023-03-02T10:56:51.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e2314e0 0x55f05e2318f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 0x55f05e232410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2329f0 0x55f05e232e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e198ae0 con 0x55f05e231e30 2023-03-02T10:56:51.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e14b000 con 0x55f05e2314e0 2023-03-02T10:56:51.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e11b1e0 con 0x55f05e2329f0 2023-03-02T10:56:51.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3b91b9b700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3b7809b420 0x7f3b7809d8d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3b88007c60 tx=0x7f3b880073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3b9139a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 0x55f05e232410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3b9139a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 0x55f05e232410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54136/0 (socket says 172.21.15.57:54136) 2023-03-02T10:56:51.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3b9139a700 1 -- 172.21.15.57:0/373096813 learned_addr learned my addr 172.21.15.57:0/373096813 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3b91b9b700 1 --2- 172.21.15.57:0/373096813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e2314e0 0x55f05e2318f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3b9239c700 1 --2- 172.21.15.57:0/373096813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2329f0 0x55f05e232e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3b9139a700 1 -- 172.21.15.57:0/373096813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2329f0 msgr2=0x55f05e232e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3b9139a700 1 --2- 172.21.15.57:0/373096813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2329f0 0x55f05e232e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3b9139a700 1 -- 172.21.15.57:0/373096813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e2314e0 msgr2=0x55f05e2318f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3b9139a700 1 --2- 172.21.15.57:0/373096813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e2314e0 0x55f05e2318f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.260+0000 7f3b9139a700 1 -- 172.21.15.57:0/373096813 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f05e0056b0 con 0x55f05e231e30 2023-03-02T10:56:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.261+0000 7f3b9139a700 1 --2- 172.21.15.57:0/373096813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 0x55f05e232410 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009990 tx=0x7f3b7c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b379849312b458 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.261+0000 7f3b77fff700 1 -- 172.21.15.57:0/373096813 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c01d050 con 0x55f05e231e30 2023-03-02T10:56:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.261+0000 7f3b77fff700 1 -- 172.21.15.57:0/373096813 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b7c01e040 con 0x55f05e231e30 2023-03-02T10:56:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.261+0000 7f3b77fff700 1 -- 172.21.15.57:0/373096813 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c005330 con 0x55f05e231e30 2023-03-02T10:56:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.262+0000 7f3ba7678b80 1 -- 172.21.15.57:0/373096813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 msgr2=0x55f05e232410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.262+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/373096813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 0x55f05e232410 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009990 tx=0x7f3b7c009ee0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.262+0000 7f3ba7678b80 1 -- 172.21.15.57:0/373096813 shutdown_connections 2023-03-02T10:56:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.262+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/373096813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2329f0 0x55f05e232e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.262+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/373096813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e2314e0 0x55f05e2318f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.262+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/373096813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 0x55f05e232410 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.262+0000 7f3ba7678b80 1 -- 172.21.15.57:0/373096813 >> 172.21.15.57:0/373096813 conn(0x55f05e226cd0 msgr2=0x55f05e22c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.262+0000 7f3ba7678b80 1 -- 172.21.15.57:0/373096813 shutdown_connections 2023-03-02T10:56:51.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.262+0000 7f3ba7678b80 1 -- 172.21.15.57:0/373096813 wait complete. 2023-03-02T10:56:51.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.262+0000 7f3ba7678b80 1 -- start start 2023-03-02T10:56:51.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.262+0000 7f3ba7678b80 1 Processor -- start 2023-03-02T10:56:51.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 0x55f05e23b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 0x55f05e23b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e2329f0 0x55f05e242580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e189c40 con 0x55f05e231e30 2023-03-02T10:56:51.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e183170 con 0x55f05e2329f0 2023-03-02T10:56:51.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e0079a0 con 0x55f05e2314e0 2023-03-02T10:56:51.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3ba7678b80 10 client.0 _ll_register_callbacks cb 0x55f05e1295a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:51.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3b9139a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 0x55f05e23b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3b91b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 0x55f05e23b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3b91b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 0x55f05e23b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:58936/0 (socket says 172.21.15.57:58936) 2023-03-02T10:56:51.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3b91b9b700 1 -- 172.21.15.57:0/1758313347 learned_addr learned my addr 172.21.15.57:0/1758313347 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:51.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3b9239c700 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e2329f0 0x55f05e242580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3b9139a700 1 -- 172.21.15.57:0/1758313347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 msgr2=0x55f05e23b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3b9139a700 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 0x55f05e23b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3b9139a700 1 -- 172.21.15.57:0/1758313347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e2329f0 msgr2=0x55f05e242580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3b9139a700 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e2329f0 0x55f05e242580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3b9139a700 1 -- 172.21.15.57:0/1758313347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8c108810 con 0x55f05e231e30 2023-03-02T10:56:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.263+0000 7f3b91b9b700 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 0x55f05e23b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3b9139a700 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 0x55f05e23b540 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c026040 tx=0x7f3b7c005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfba170be5994372 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3b757fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3b757fa700 1 -- 172.21.15.57:0/1758313347 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0052d0 con 0x55f05e231e30 2023-03-02T10:56:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3b757fa700 1 -- 172.21.15.57:0/1758313347 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3b7c005430 con 0x55f05e231e30 2023-03-02T10:56:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1758313347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f05e154830 con 0x55f05e231e30 2023-03-02T10:56:51.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3b757fa700 1 -- 172.21.15.57:0/1758313347 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b7c0055f0 con 0x55f05e231e30 2023-03-02T10:56:51.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3ba7678b80 10 client.15411 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:51.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1758313347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f05dfb1e60 con 0x55f05e231e30 2023-03-02T10:56:51.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3b757fa700 1 -- 172.21.15.57:0/1758313347 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f05e154830 con 0x55f05e231e30 2023-03-02T10:56:51.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3b757fa700 1 -- 172.21.15.57:0/1758313347 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3b7c00f5d0 con 0x55f05e231e30 2023-03-02T10:56:51.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3ba7678b80 10 client.15411 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:51.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3ba7678b80 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:56:51.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3ba7678b80 20 client.15411 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:51.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f05e2468b0 0x55f05e248c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3ba7678b80 4 client.15411 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:51.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.264+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1758313347 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f05e17c1f0 con 0x55f05e2468b0 2023-03-02T10:56:51.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.265+0000 7f3b91b9b700 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f05e2468b0 0x55f05e248c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.265+0000 7f3b757fa700 10 client.15411 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:51.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.265+0000 7f3b91b9b700 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f05e2468b0 0x55f05e248c90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a22f859db31eeb94 server_cookie=636f35e8a6bd3cf2 in_seq=0 out_seq=0 2023-03-02T10:56:51.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3b757fa700 1 -- 172.21.15.57:0/1758313347 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55f05e17c1f0 con 0x55f05e2468b0 2023-03-02T10:56:51.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3b757fa700 10 client.15411 handle_command_reply: tid=0 2023-03-02T10:56:51.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3ba7678b80 1 client.15411 shutdown 2023-03-02T10:56:51.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1758313347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 msgr2=0x55f05e23b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 0x55f05e23b540 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c026040 tx=0x7f3b7c005950 comp rx=0 tx=0).stop 2023-03-02T10:56:51.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1758313347 shutdown_connections 2023-03-02T10:56:51.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f05e2468b0 0x55f05e248c90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e2329f0 0x55f05e242580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 0x55f05e23b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3b757fa700 0 client.15411 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:51.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1758313347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e231e30 0x55f05e23b540 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1758313347 >> 172.21.15.57:0/1758313347 conn(0x55f05e226cd0 msgr2=0x55f05e22b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1758313347 shutdown_connections 2023-03-02T10:56:51.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.266+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1758313347 wait complete. 2023-03-02T10:56:51.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.267+0000 7f3ba7678b80 20 client.15411 trim_cache size 0 max 16384 2023-03-02T10:56:51.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.283+0000 7f3ba7678b80 1 Processor -- start 2023-03-02T10:56:51.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.283+0000 7f3ba7678b80 1 -- start start 2023-03-02T10:56:51.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.283+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 0x55f05e23afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 0x55f05e23b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2329f0 0x55f05e22b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e23a4b0 con 0x55f05e2329f0 2023-03-02T10:56:51.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e2429d0 con 0x55f05e231e30 2023-03-02T10:56:51.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e23ab70 con 0x55f05e2314e0 2023-03-02T10:56:51.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b9239c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2329f0 0x55f05e22b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b9239c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2329f0 0x55f05e22b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54142/0 (socket says 172.21.15.57:54142) 2023-03-02T10:56:51.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b91b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 0x55f05e23afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b9239c700 1 -- 172.21.15.57:0/3223990908 learned_addr learned my addr 172.21.15.57:0/3223990908 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:51.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b9139a700 1 --2- 172.21.15.57:0/3223990908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 0x55f05e23b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b9239c700 1 -- 172.21.15.57:0/3223990908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 msgr2=0x55f05e23afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b9239c700 1 --2- 172.21.15.57:0/3223990908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 0x55f05e23afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b9239c700 1 -- 172.21.15.57:0/3223990908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 msgr2=0x55f05e23b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b9239c700 1 --2- 172.21.15.57:0/3223990908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 0x55f05e23b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b9239c700 1 -- 172.21.15.57:0/3223990908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f05e14a210 con 0x55f05e2329f0 2023-03-02T10:56:51.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b9139a700 1 --2- 172.21.15.57:0/3223990908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 0x55f05e23b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:51.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.284+0000 7f3b9239c700 1 --2- 172.21.15.57:0/3223990908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2329f0 0x55f05e22b720 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3b84090790 tx=0x7f3b8401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41fd2f53a290f5c server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3b80bff700 1 -- 172.21.15.57:0/3223990908 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8409b440 con 0x55f05e2329f0 2023-03-02T10:56:51.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3b80bff700 1 -- 172.21.15.57:0/3223990908 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b84022250 con 0x55f05e2329f0 2023-03-02T10:56:51.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3b80bff700 1 -- 172.21.15.57:0/3223990908 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b840934a0 con 0x55f05e2329f0 2023-03-02T10:56:51.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3ba7678b80 1 -- 172.21.15.57:0/3223990908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2329f0 msgr2=0x55f05e22b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/3223990908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2329f0 0x55f05e22b720 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3b84090790 tx=0x7f3b8401e040 comp rx=0 tx=0).stop 2023-03-02T10:56:51.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3ba7678b80 1 -- 172.21.15.57:0/3223990908 shutdown_connections 2023-03-02T10:56:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/3223990908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2329f0 0x55f05e22b720 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/3223990908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2314e0 0x55f05e23afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/3223990908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 0x55f05e23b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3ba7678b80 1 -- 172.21.15.57:0/3223990908 >> 172.21.15.57:0/3223990908 conn(0x55f05e226cd0 msgr2=0x55f05e235930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3ba7678b80 1 -- 172.21.15.57:0/3223990908 shutdown_connections 2023-03-02T10:56:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.285+0000 7f3ba7678b80 1 -- 172.21.15.57:0/3223990908 wait complete. 2023-03-02T10:56:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3ba7678b80 1 -- start start 2023-03-02T10:56:51.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3ba7678b80 1 Processor -- start 2023-03-02T10:56:51.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2314e0 0x55f05e23ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 0x55f05e23f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3ba7678b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2329f0 0x55f05e23f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e240860 con 0x55f05e2314e0 2023-03-02T10:56:51.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e2980e0 con 0x55f05e231e30 2023-03-02T10:56:51.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3ba7678b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05e2982a0 con 0x55f05e2329f0 2023-03-02T10:56:51.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3ba7678b80 10 client.0 _ll_register_callbacks cb 0x55f05e1295a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:51.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3b91b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2314e0 0x55f05e23ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3b91b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2314e0 0x55f05e23ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54158/0 (socket says 172.21.15.57:54158) 2023-03-02T10:56:51.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3b91b9b700 1 -- 172.21.15.57:0/1510781758 learned_addr learned my addr 172.21.15.57:0/1510781758 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:51.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.286+0000 7f3b9239c700 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2329f0 0x55f05e23f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b9139a700 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 0x55f05e23f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b91b9b700 1 -- 172.21.15.57:0/1510781758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2329f0 msgr2=0x55f05e23f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b91b9b700 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2329f0 0x55f05e23f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b91b9b700 1 -- 172.21.15.57:0/1510781758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 msgr2=0x55f05e23f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b91b9b700 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 0x55f05e23f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b91b9b700 1 -- 172.21.15.57:0/1510781758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8c10b2e0 con 0x55f05e2314e0 2023-03-02T10:56:51.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b9139a700 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 0x55f05e23f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:51.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b9239c700 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2329f0 0x55f05e23f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:51.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b91b9b700 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2314e0 0x55f05e23ec10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x55f05e2494d0 tx=0x7f3b880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73712fa44a1ab1b6 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b757fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:51.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b757fa700 1 -- 172.21.15.57:0/1510781758 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88024040 con 0x55f05e2314e0 2023-03-02T10:56:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b757fa700 1 -- 172.21.15.57:0/1510781758 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3b88017070 con 0x55f05e2314e0 2023-03-02T10:56:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1510781758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b7c01e040 con 0x55f05e2314e0 2023-03-02T10:56:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3b757fa700 1 -- 172.21.15.57:0/1510781758 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b88004260 con 0x55f05e2314e0 2023-03-02T10:56:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3ba7678b80 10 client.15417 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.287+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1510781758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f05dfd82d0 con 0x55f05e2314e0 2023-03-02T10:56:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.288+0000 7f3b757fa700 1 -- 172.21.15.57:0/1510781758 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b7c01e040 con 0x55f05e2314e0 2023-03-02T10:56:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.288+0000 7f3b757fa700 1 -- 172.21.15.57:0/1510781758 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3b88011560 con 0x55f05e2314e0 2023-03-02T10:56:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.288+0000 7f3ba7678b80 10 client.15417 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.288+0000 7f3ba7678b80 10 client.15417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:56:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.288+0000 7f3ba7678b80 20 client.15417 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.288+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f05e299d20 0x55f05e29c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.288+0000 7f3ba7678b80 4 client.15417 mds_command: new command op to 24560 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-03-02T10:56:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.288+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1510781758 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f05e17bf10 con 0x55f05e299d20 2023-03-02T10:56:51.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.288+0000 7f3b9139a700 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f05e299d20 0x55f05e29c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.289+0000 7f3b9139a700 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f05e299d20 0x55f05e29c130 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61aa545ae4685e15 server_cookie=b79dafe344990bcc in_seq=0 out_seq=0 2023-03-02T10:56:51.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.289+0000 7f3b757fa700 10 client.15417 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:51.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3b757fa700 1 -- 172.21.15.57:0/1510781758 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f05e17bf10 con 0x55f05e299d20 2023-03-02T10:56:51.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3b757fa700 10 client.15417 handle_command_reply: tid=0 2023-03-02T10:56:51.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 1 client.15417 shutdown 2023-03-02T10:56:51.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1510781758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2314e0 msgr2=0x55f05e23ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2314e0 0x55f05e23ec10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x55f05e2494d0 tx=0x7f3b880047c0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1510781758 shutdown_connections 2023-03-02T10:56:51.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f05e299d20 0x55f05e29c130 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f05e2329f0 0x55f05e23f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05e2314e0 0x55f05e23ec10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 1 --2- 172.21.15.57:0/1510781758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f05e231e30 0x55f05e23f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3b757fa700 0 client.15417 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:51.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1510781758 >> 172.21.15.57:0/1510781758 conn(0x55f05e226cd0 msgr2=0x55f05e235930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1510781758 shutdown_connections 2023-03-02T10:56:51.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 1 -- 172.21.15.57:0/1510781758 wait complete. 2023-03-02T10:56:51.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.290+0000 7f3ba7678b80 20 client.15417 trim_cache size 0 max 16384 2023-03-02T10:56:51.300 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:51.300 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": 0, 2023-03-02T10:56:51.300 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_tag": "6efa65df-e5f7-41fb-996b-dbaf6a6afad1", 2023-03-02T10:56:51.300 INFO:teuthology.orchestra.run.smithi057.stdout: "mode": "asynchronous" 2023-03-02T10:56:51.300 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 -- 172.21.15.57:0/3108145485 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3b7809b420 msgr2=0x7f3b7809d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3b7809b420 0x7f3b7809d8d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3b88007c60 tx=0x7f3b880073d0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 -- 172.21.15.57:0/3108145485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b8c101700 msgr2=0x7f3b8c19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b8c101700 0x7f3b8c19ce00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3b84007ee0 tx=0x7f3b8400d3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 -- 172.21.15.57:0/3108145485 shutdown_connections 2023-03-02T10:56:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f3b7809b420 0x7f3b7809d8d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b8c101700 0x7f3b8c19ce00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b8c0ffac0 0x7f3b8c195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 --2- 172.21.15.57:0/3108145485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b8c100d50 0x7f3b8c195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 -- 172.21.15.57:0/3108145485 >> 172.21.15.57:0/3108145485 conn(0x7f3b8c0fb100 msgr2=0x7f3b8c0fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 -- 172.21.15.57:0/3108145485 shutdown_connections 2023-03-02T10:56:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.291+0000 7f3b93dff700 1 -- 172.21.15.57:0/3108145485 wait complete. 2023-03-02T10:56:51.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T10:56:51.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.467+0000 7f58a65ff700 1 -- 172.21.15.57:0/2552995855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58a0105780 msgr2=0x7f58a0107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.467+0000 7f58a65ff700 1 --2- 172.21.15.57:0/2552995855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58a0105780 0x7f58a0107be0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f589800b0a0 tx=0x7f589800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.467+0000 7f58a65ff700 1 -- 172.21.15.57:0/2552995855 shutdown_connections 2023-03-02T10:56:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.467+0000 7f58a65ff700 1 --2- 172.21.15.57:0/2552995855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58a0105780 0x7f58a0107be0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.467+0000 7f58a65ff700 1 --2- 172.21.15.57:0/2552995855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0100540 0x7f58a0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.467+0000 7f58a65ff700 1 --2- 172.21.15.57:0/2552995855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58a0102e60 0x7f58a0105240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.467+0000 7f58a65ff700 1 -- 172.21.15.57:0/2552995855 >> 172.21.15.57:0/2552995855 conn(0x7f58a00f9fe0 msgr2=0x7f58a00fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.467+0000 7f58a65ff700 1 -- 172.21.15.57:0/2552995855 shutdown_connections 2023-03-02T10:56:51.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.467+0000 7f58a65ff700 1 -- 172.21.15.57:0/2552995855 wait complete. 2023-03-02T10:56:51.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.468+0000 7f58a65ff700 1 Processor -- start 2023-03-02T10:56:51.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.468+0000 7f58a65ff700 1 -- start start 2023-03-02T10:56:51.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.468+0000 7f58a65ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58a0100540 0x7f58a0197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.468+0000 7f58a65ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58a0102e60 0x7f58a0198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.468+0000 7f58a65ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0105780 0x7f58a019f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.468+0000 7f58a65ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a019f670 con 0x7f58a0102e60 2023-03-02T10:56:51.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.468+0000 7f58a65ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a019f7b0 con 0x7f58a0105780 2023-03-02T10:56:51.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.468+0000 7f58a65ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a019f940 con 0x7f58a0100540 2023-03-02T10:56:51.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58a0102e60 0x7f58a0198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58a0100540 0x7f58a0197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58a0100540 0x7f58a0197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:58960/0 (socket says 172.21.15.57:58960) 2023-03-02T10:56:51.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58a0102e60 0x7f58a0198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54174/0 (socket says 172.21.15.57:54174) 2023-03-02T10:56:51.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589ffff700 1 -- 172.21.15.57:0/99272593 learned_addr learned my addr 172.21.15.57:0/99272593 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:51.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f58a4b9c700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0105780 0x7f58a019f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589f7fe700 1 -- 172.21.15.57:0/99272593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58a0100540 msgr2=0x7f58a0197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589f7fe700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58a0100540 0x7f58a0197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589f7fe700 1 -- 172.21.15.57:0/99272593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0105780 msgr2=0x7f58a019f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589f7fe700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0105780 0x7f58a019f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589f7fe700 1 -- 172.21.15.57:0/99272593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009d00 con 0x7f58a0102e60 2023-03-02T10:56:51.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f58a4b9c700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0105780 0x7f58a019f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:51.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589f7fe700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58a0102e60 0x7f58a0198030 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f589400e9f0 tx=0x7f589400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589d7fa700 1 -- 172.21.15.57:0/99272593 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589400eee0 con 0x7f58a0102e60 2023-03-02T10:56:51.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f58a65ff700 1 -- 172.21.15.57:0/99272593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a010b400 con 0x7f58a0102e60 2023-03-02T10:56:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589d7fa700 1 -- 172.21.15.57:0/99272593 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f589400cbd0 con 0x7f58a0102e60 2023-03-02T10:56:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f589d7fa700 1 -- 172.21.15.57:0/99272593 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894018680 con 0x7f58a0102e60 2023-03-02T10:56:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.469+0000 7f58a65ff700 1 -- 172.21.15.57:0/99272593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a010b270 con 0x7f58a0102e60 2023-03-02T10:56:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.472+0000 7f589d7fa700 1 -- 172.21.15.57:0/99272593 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 129857+0+0 (secure 0 0 0) 0x7f589400c040 con 0x7f58a0102e60 2023-03-02T10:56:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.473+0000 7f589d7fa700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f588809b3a0 0x7f588809d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.473+0000 7f589d7fa700 1 -- 172.21.15.57:0/99272593 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5894014070 con 0x7f58a0102e60 2023-03-02T10:56:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.473+0000 7f589ffff700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f588809b3a0 0x7f588809d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.473+0000 7f58b9f95b80 1 Processor -- start 2023-03-02T10:56:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58b9f95b80 1 -- start start 2023-03-02T10:56:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f589ffff700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f588809b3a0 0x7f588809d850 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5890009d20 tx=0x7f5890009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247460 0x555965247870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247db0 0x555965248390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 0x555965248de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559651aea60 con 0x555965248970 2023-03-02T10:56:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555965160f80 con 0x555965247db0 2023-03-02T10:56:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x555965131160 con 0x555965247460 2023-03-02T10:56:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58a4b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 0x555965248de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58a4b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 0x555965248de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54178/0 (socket says 172.21.15.57:54178) 2023-03-02T10:56:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f589ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247460 0x555965247870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58a4b9c700 1 -- 172.21.15.57:0/31759500 learned_addr learned my addr 172.21.15.57:0/31759500 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f589f7fe700 1 --2- 172.21.15.57:0/31759500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247db0 0x555965248390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58a4b9c700 1 -- 172.21.15.57:0/31759500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247460 msgr2=0x555965247870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58a4b9c700 1 --2- 172.21.15.57:0/31759500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247460 0x555965247870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58a4b9c700 1 -- 172.21.15.57:0/31759500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247db0 msgr2=0x555965248390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58a4b9c700 1 --2- 172.21.15.57:0/31759500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247db0 0x555965248390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f58a4b9c700 1 -- 172.21.15.57:0/31759500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55596501b630 con 0x555965248970 2023-03-02T10:56:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.474+0000 7f589f7fe700 1 --2- 172.21.15.57:0/31759500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247db0 0x555965248390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.475+0000 7f58a4b9c700 1 --2- 172.21.15.57:0/31759500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 0x555965248de0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5898015000 tx=0x7f58980092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7962ca7c242e023f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.475+0000 7f58867fc700 1 -- 172.21.15.57:0/31759500 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589800e050 con 0x555965248970 2023-03-02T10:56:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.475+0000 7f58867fc700 1 -- 172.21.15.57:0/31759500 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58980094d0 con 0x555965248970 2023-03-02T10:56:51.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.475+0000 7f58867fc700 1 -- 172.21.15.57:0/31759500 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898005330 con 0x555965248970 2023-03-02T10:56:51.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.475+0000 7f58b9f95b80 1 -- 172.21.15.57:0/31759500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 msgr2=0x555965248de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.475+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/31759500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 0x555965248de0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5898015000 tx=0x7f58980092e0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.476+0000 7f58b9f95b80 1 -- 172.21.15.57:0/31759500 shutdown_connections 2023-03-02T10:56:51.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.476+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/31759500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 0x555965248de0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.476+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/31759500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247460 0x555965247870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.476+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/31759500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247db0 0x555965248390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.476+0000 7f58b9f95b80 1 -- 172.21.15.57:0/31759500 >> 172.21.15.57:0/31759500 conn(0x55596523cc50 msgr2=0x555965241f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.476+0000 7f58b9f95b80 1 -- 172.21.15.57:0/31759500 shutdown_connections 2023-03-02T10:56:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.476+0000 7f58b9f95b80 1 -- 172.21.15.57:0/31759500 wait complete. 2023-03-02T10:56:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.476+0000 7f58b9f95b80 1 -- start start 2023-03-02T10:56:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.476+0000 7f58b9f95b80 1 Processor -- start 2023-03-02T10:56:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.476+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 0x555965250ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247db0 0x555965251420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965248970 0x555965258460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55596519fbc0 con 0x555965247db0 2023-03-02T10:56:51.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559651990f0 con 0x555965247460 2023-03-02T10:56:51.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55596501d920 con 0x555965248970 2023-03-02T10:56:51.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f58b9f95b80 10 client.0 _ll_register_callbacks cb 0x55596513f520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:51.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f589f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247db0 0x555965251420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f589ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 0x555965250ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f589f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247db0 0x555965251420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54184/0 (socket says 172.21.15.57:54184) 2023-03-02T10:56:51.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f589f7fe700 1 -- 172.21.15.57:0/1447833351 learned_addr learned my addr 172.21.15.57:0/1447833351 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:51.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f58a4b9c700 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965248970 0x555965258460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f589f7fe700 1 -- 172.21.15.57:0/1447833351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965248970 msgr2=0x555965258460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f589f7fe700 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965248970 0x555965258460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f589f7fe700 1 -- 172.21.15.57:0/1447833351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 msgr2=0x555965250ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f589f7fe700 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 0x555965250ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f589f7fe700 1 -- 172.21.15.57:0/1447833351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a01087d0 con 0x555965247db0 2023-03-02T10:56:51.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f58a4b9c700 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965248970 0x555965258460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:56:51.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f589f7fe700 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247db0 0x555965251420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5894090bf0 tx=0x7f5894094c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c494ad9ee7d5a572 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f587f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:51.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.477+0000 7f587f7fe700 1 -- 172.21.15.57:0/1447833351 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589409bb80 con 0x555965247db0 2023-03-02T10:56:51.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f587f7fe700 1 -- 172.21.15.57:0/1447833351 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f58940946f0 con 0x555965247db0 2023-03-02T10:56:51.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f58b9f95b80 1 -- 172.21.15.57:0/1447833351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55596516a7b0 con 0x555965247db0 2023-03-02T10:56:51.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f587f7fe700 1 -- 172.21.15.57:0/1447833351 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58940980b0 con 0x555965247db0 2023-03-02T10:56:51.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f58b9f95b80 10 client.15429 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:51.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f58b9f95b80 1 -- 172.21.15.57:0/1447833351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555964fc7de0 con 0x555965247db0 2023-03-02T10:56:51.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f587f7fe700 1 -- 172.21.15.57:0/1447833351 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5894060020 con 0x555965247db0 2023-03-02T10:56:51.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f587f7fe700 1 -- 172.21.15.57:0/1447833351 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5894095080 con 0x555965247db0 2023-03-02T10:56:51.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f58b9f95b80 10 client.15429 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:51.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f58b9f95b80 10 client.15429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:56:51.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f58b9f95b80 20 client.15429 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:51.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55596525ccd0 0x55596525f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f58b9f95b80 4 client.15429 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:56:51.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.478+0000 7f58b9f95b80 1 -- 172.21.15.57:0/1447833351 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555965192170 con 0x55596525ccd0 2023-03-02T10:56:51.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.479+0000 7f589ffff700 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55596525ccd0 0x55596525f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.479+0000 7f587f7fe700 10 client.15429 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:51.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.479+0000 7f589ffff700 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55596525ccd0 0x55596525f0e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77150aaab08c58d3 server_cookie=f013e48793b52e10 in_seq=0 out_seq=0 2023-03-02T10:56:51.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f587f7fe700 1 -- 172.21.15.57:0/1447833351 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x555965192170 con 0x55596525ccd0 2023-03-02T10:56:51.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f587f7fe700 10 client.15429 handle_command_reply: tid=0 2023-03-02T10:56:51.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 1 client.15429 shutdown 2023-03-02T10:56:51.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 1 -- 172.21.15.57:0/1447833351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247db0 msgr2=0x555965251420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247db0 0x555965251420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5894090bf0 tx=0x7f5894094c30 comp rx=0 tx=0).stop 2023-03-02T10:56:51.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 1 -- 172.21.15.57:0/1447833351 shutdown_connections 2023-03-02T10:56:51.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55596525ccd0 0x55596525f0e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965248970 0x555965258460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f587f7fe700 0 client.15429 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:51.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 0x555965250ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/1447833351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247db0 0x555965251420 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 1 -- 172.21.15.57:0/1447833351 >> 172.21.15.57:0/1447833351 conn(0x55596523cc50 msgr2=0x5559652416a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 1 -- 172.21.15.57:0/1447833351 shutdown_connections 2023-03-02T10:56:51.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 1 -- 172.21.15.57:0/1447833351 wait complete. 2023-03-02T10:56:51.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.480+0000 7f58b9f95b80 20 client.15429 trim_cache size 0 max 16384 2023-03-02T10:56:51.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f58b9f95b80 1 Processor -- start 2023-03-02T10:56:51.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f58b9f95b80 1 -- start start 2023-03-02T10:56:51.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 0x5559652416a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247db0 0x55596524ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 0x55596524b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555965250a80 con 0x555965248970 2023-03-02T10:56:51.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555965251db0 con 0x555965247460 2023-03-02T10:56:51.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x555965239f50 con 0x555965247db0 2023-03-02T10:56:51.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f58a4b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 0x55596524b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f589ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 0x5559652416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f589ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 0x5559652416a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:37232/0 (socket says 172.21.15.57:37232) 2023-03-02T10:56:51.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f589ffff700 1 -- 172.21.15.57:0/2548488019 learned_addr learned my addr 172.21.15.57:0/2548488019 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:51.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f58a4b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 0x55596524b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54186/0 (socket says 172.21.15.57:54186) 2023-03-02T10:56:51.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.497+0000 7f589f7fe700 1 --2- 172.21.15.57:0/2548488019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247db0 0x55596524ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.498+0000 7f589ffff700 1 -- 172.21.15.57:0/2548488019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247db0 msgr2=0x55596524ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.498+0000 7f589ffff700 1 --2- 172.21.15.57:0/2548488019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247db0 0x55596524ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.498+0000 7f589ffff700 1 -- 172.21.15.57:0/2548488019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 msgr2=0x55596524b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.498+0000 7f589ffff700 1 --2- 172.21.15.57:0/2548488019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 0x55596524b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.498+0000 7f589ffff700 1 -- 172.21.15.57:0/2548488019 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555965160190 con 0x555965247460 2023-03-02T10:56:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.498+0000 7f589ffff700 1 --2- 172.21.15.57:0/2548488019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 0x5559652416a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55596525f9c0 tx=0x7f5890014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb4b69bc5aeb6702 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.498+0000 7f5886ffd700 1 -- 172.21.15.57:0/2548488019 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890022070 con 0x555965247460 2023-03-02T10:56:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.498+0000 7f5886ffd700 1 -- 172.21.15.57:0/2548488019 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5890023040 con 0x555965247460 2023-03-02T10:56:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.498+0000 7f5886ffd700 1 -- 172.21.15.57:0/2548488019 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000e770 con 0x555965247460 2023-03-02T10:56:51.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.499+0000 7f58b9f95b80 1 -- 172.21.15.57:0/2548488019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 msgr2=0x5559652416a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.499+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/2548488019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 0x5559652416a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55596525f9c0 tx=0x7f5890014000 comp rx=0 tx=0).stop 2023-03-02T10:56:51.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.499+0000 7f58b9f95b80 1 -- 172.21.15.57:0/2548488019 shutdown_connections 2023-03-02T10:56:51.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.499+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/2548488019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965248970 0x55596524b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.499+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/2548488019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965247460 0x5559652416a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.499+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/2548488019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247db0 0x55596524ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.499+0000 7f58b9f95b80 1 -- 172.21.15.57:0/2548488019 >> 172.21.15.57:0/2548488019 conn(0x55596523cc50 msgr2=0x55596524fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.499+0000 7f58b9f95b80 1 -- 172.21.15.57:0/2548488019 shutdown_connections 2023-03-02T10:56:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.499+0000 7f58b9f95b80 1 -- 172.21.15.57:0/2548488019 wait complete. 2023-03-02T10:56:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.499+0000 7f58b9f95b80 1 -- start start 2023-03-02T10:56:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.499+0000 7f58b9f95b80 1 Processor -- start 2023-03-02T10:56:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247460 0x5559652a6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247db0 0x5559652a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f58b9f95b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965248970 0x5559652add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559652ae2c0 con 0x555965247460 2023-03-02T10:56:51.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559652ae400 con 0x555965248970 2023-03-02T10:56:51.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f58b9f95b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559652ae590 con 0x555965247db0 2023-03-02T10:56:51.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f58b9f95b80 10 client.0 _ll_register_callbacks cb 0x55596513f520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:56:51.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f589ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247460 0x5559652a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f589ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247460 0x5559652a6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54188/0 (socket says 172.21.15.57:54188) 2023-03-02T10:56:51.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f589ffff700 1 -- 172.21.15.57:0/848295596 learned_addr learned my addr 172.21.15.57:0/848295596 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:51.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f58a4b9c700 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965248970 0x5559652add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f589f7fe700 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247db0 0x5559652a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f589ffff700 1 -- 172.21.15.57:0/848295596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247db0 msgr2=0x5559652a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f589ffff700 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247db0 0x5559652a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f589ffff700 1 -- 172.21.15.57:0/848295596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965248970 msgr2=0x5559652add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:56:51.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f589ffff700 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965248970 0x5559652add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f589ffff700 1 -- 172.21.15.57:0/848295596 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5890017070 con 0x555965247460 2023-03-02T10:56:51.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f589ffff700 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247460 0x5559652a6800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f58900094f0 tx=0x7f589002b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f325aaa18f37c2ba server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:51.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.500+0000 7f587f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:56:51.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f587f7fe700 1 -- 172.21.15.57:0/848295596 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890022050 con 0x555965247460 2023-03-02T10:56:51.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f58b9f95b80 1 -- 172.21.15.57:0/848295596 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58980094d0 con 0x555965247460 2023-03-02T10:56:51.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f587f7fe700 1 -- 172.21.15.57:0/848295596 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5890005040 con 0x555965247460 2023-03-02T10:56:51.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f587f7fe700 1 -- 172.21.15.57:0/848295596 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f589002b190 con 0x555965247460 2023-03-02T10:56:51.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f58b9f95b80 10 client.15435 fetch_fsmap learned FSMap version 26 2023-03-02T10:56:51.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f58b9f95b80 1 -- 172.21.15.57:0/848295596 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555964fee250 con 0x555965247460 2023-03-02T10:56:51.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f587f7fe700 1 -- 172.21.15.57:0/848295596 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5890045020 con 0x555965247460 2023-03-02T10:56:51.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f587f7fe700 1 -- 172.21.15.57:0/848295596 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5890041480 con 0x555965247460 2023-03-02T10:56:51.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f58b9f95b80 10 client.15435 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:56:51.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f58b9f95b80 10 client.15435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:56:51.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f58b9f95b80 20 client.15435 populate_metadata read hostname 'smithi057' 2023-03-02T10:56:51.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5559652aff50 0x5559652b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:51.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f58b9f95b80 4 client.15435 mds_command: new command op to 24560 tid=0[{"prefix": "scrub status"}] 2023-03-02T10:56:51.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.501+0000 7f58b9f95b80 1 -- 172.21.15.57:0/848295596 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555965191e90 con 0x5559652aff50 2023-03-02T10:56:51.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.502+0000 7f589f7fe700 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5559652aff50 0x5559652b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:51.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.502+0000 7f589f7fe700 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5559652aff50 0x5559652b2360 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b542db859bbf4b3 server_cookie=149de391c117d501 in_seq=0 out_seq=0 2023-03-02T10:56:51.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.502+0000 7f587f7fe700 10 client.15435 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:51.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.502+0000 7f587f7fe700 1 -- 172.21.15.57:0/848295596 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555965191e90 con 0x5559652aff50 2023-03-02T10:56:51.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.502+0000 7f587f7fe700 10 client.15435 handle_command_reply: tid=0 2023-03-02T10:56:51.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.502+0000 7f58b9f95b80 1 client.15435 shutdown 2023-03-02T10:56:51.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.502+0000 7f58b9f95b80 1 -- 172.21.15.57:0/848295596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247460 msgr2=0x5559652a6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.502+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247460 0x5559652a6800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f58900094f0 tx=0x7f589002b930 comp rx=0 tx=0).stop 2023-03-02T10:56:51.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58b9f95b80 1 -- 172.21.15.57:0/848295596 shutdown_connections 2023-03-02T10:56:51.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5559652aff50 0x5559652b2360 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555965248970 0x5559652add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555965247460 0x5559652a6800 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58b9f95b80 1 --2- 172.21.15.57:0/848295596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555965247db0 0x5559652a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f587f7fe700 0 client.15435 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:56:51.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58b9f95b80 1 -- 172.21.15.57:0/848295596 >> 172.21.15.57:0/848295596 conn(0x55596523cc50 msgr2=0x5559652416a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58b9f95b80 1 -- 172.21.15.57:0/848295596 shutdown_connections 2023-03-02T10:56:51.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58b9f95b80 1 -- 172.21.15.57:0/848295596 wait complete. 2023-03-02T10:56:51.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58b9f95b80 20 client.15435 trim_cache size 0 max 16384 2023-03-02T10:56:51.517 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:56:51.517 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "IDLE (waiting for more scrubs)", 2023-03-02T10:56:51.517 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T10:56:51.517 INFO:teuthology.orchestra.run.smithi057.stdout: "6efa65df-e5f7-41fb-996b-dbaf6a6afad1": { 2023-03-02T10:56:51.517 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T10:56:51.517 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "6efa65df-e5f7-41fb-996b-dbaf6a6afad1", 2023-03-02T10:56:51.518 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T10:56:51.518 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:56:51.518 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:56:51.518 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:56:51.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58a65ff700 1 -- 172.21.15.57:0/99272593 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f588809b3a0 msgr2=0x7f588809d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58a65ff700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f588809b3a0 0x7f588809d850 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5890009d20 tx=0x7f5890009260 comp rx=0 tx=0).stop 2023-03-02T10:56:51.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58a65ff700 1 -- 172.21.15.57:0/99272593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58a0102e60 msgr2=0x7f58a0198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:51.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.503+0000 7f58a65ff700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58a0102e60 0x7f58a0198030 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f589400e9f0 tx=0x7f589400ed00 comp rx=0 tx=0).stop 2023-03-02T10:56:51.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.504+0000 7f58a65ff700 1 -- 172.21.15.57:0/99272593 shutdown_connections 2023-03-02T10:56:51.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.504+0000 7f58a65ff700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f588809b3a0 0x7f588809d850 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.504+0000 7f58a65ff700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0105780 0x7f58a019f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.504+0000 7f58a65ff700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58a0100540 0x7f58a0197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.504+0000 7f58a65ff700 1 --2- 172.21.15.57:0/99272593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58a0102e60 0x7f58a0198030 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:51.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.504+0000 7f58a65ff700 1 -- 172.21.15.57:0/99272593 >> 172.21.15.57:0/99272593 conn(0x7f58a00f9fe0 msgr2=0x7f58a00feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:51.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.504+0000 7f58a65ff700 1 -- 172.21.15.57:0/99272593 shutdown_connections 2023-03-02T10:56:51.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.504+0000 7f58a65ff700 1 -- 172.21.15.57:0/99272593 wait complete. 2023-03-02T10:56:51.527 INFO:tasks.cephfs.filesystem:scrub status for tag:6efa65df-e5f7-41fb-996b-dbaf6a6afad1 - {'path': '/', 'tag': '6efa65df-e5f7-41fb-996b-dbaf6a6afad1', 'options': 'recursive,force'} 2023-03-02T10:56:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:51.535+0000 7f53709ff700 1 -- 172.21.15.57:0/419238626 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f536c0611a0 con 0x7f536c1005e0 2023-03-02T10:56:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:51 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/315731759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:51 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/4119578915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:51 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/315731759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:51 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/4119578915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:51 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/315731759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:56:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:51 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/4119578915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-02T10:56:52.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.396+0000 7f535b7fe700 1 -- 172.21.15.57:0/419238626 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 19) v1 ==== 129874+0+0 (secure 0 0 0) 0x7f535c00c040 con 0x7f536c1005e0 2023-03-02T10:56:52.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.397+0000 7f535b7fe700 1 -- 172.21.15.57:0/419238626 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7f535c04c3e0 con 0x7f536c1005e0 2023-03-02T10:56:52.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.400+0000 7f53709ff700 1 -- 172.21.15.57:0/419238626 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f535409b3a0 msgr2=0x7f535409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:52.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.400+0000 7f53709ff700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f535409b3a0 0x7f535409d850 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f536000b2e0 tx=0x7f5360005fb0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.400+0000 7f53709ff700 1 -- 172.21.15.57:0/419238626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536c1005e0 msgr2=0x7f536c1958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:52.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.400+0000 7f53709ff700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536c1005e0 0x7f536c1958d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f535c00e970 tx=0x7f535c00ec80 comp rx=0 tx=0).stop 2023-03-02T10:56:52.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.401+0000 7f53709ff700 1 -- 172.21.15.57:0/419238626 shutdown_connections 2023-03-02T10:56:52.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.401+0000 7f53709ff700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f535409b3a0 0x7f535409d850 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.401+0000 7f53709ff700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c105820 0x7f536c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.401+0000 7f53709ff700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536c1005e0 0x7f536c1958d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.401+0000 7f53709ff700 1 --2- 172.21.15.57:0/419238626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f536c102f00 0x7f536c195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.401+0000 7f53709ff700 1 -- 172.21.15.57:0/419238626 >> 172.21.15.57:0/419238626 conn(0x7f536c0f9fa0 msgr2=0x7f536c1012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:52.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.401+0000 7f53709ff700 1 -- 172.21.15.57:0/419238626 shutdown_connections 2023-03-02T10:56:52.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.401+0000 7f53709ff700 1 -- 172.21.15.57:0/419238626 wait complete. 2023-03-02T10:56:52.420 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-03-02T10:56:52.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.621+0000 7f131ffff700 1 -- 172.21.15.57:0/68698791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13180ffc50 msgr2=0x7f13181000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.621+0000 7f131ffff700 1 --2- 172.21.15.57:0/68698791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13180ffc50 0x7f13181000c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1308009990 tx=0x7f1308009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.621+0000 7f131ffff700 1 -- 172.21.15.57:0/68698791 shutdown_connections 2023-03-02T10:56:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.621+0000 7f131ffff700 1 --2- 172.21.15.57:0/68698791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1318100600 0x7f1318106ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.621+0000 7f131ffff700 1 --2- 172.21.15.57:0/68698791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13180fe9c0 0x7f13180fedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.621+0000 7f131ffff700 1 --2- 172.21.15.57:0/68698791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13180ffc50 0x7f13181000c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.621+0000 7f131ffff700 1 -- 172.21.15.57:0/68698791 >> 172.21.15.57:0/68698791 conn(0x7f13180f9fa0 msgr2=0x7f13180fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:52.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.621+0000 7f131ffff700 1 -- 172.21.15.57:0/68698791 shutdown_connections 2023-03-02T10:56:52.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.621+0000 7f131ffff700 1 -- 172.21.15.57:0/68698791 wait complete. 2023-03-02T10:56:52.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.622+0000 7f131ffff700 1 Processor -- start 2023-03-02T10:56:52.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.622+0000 7f131ffff700 1 -- start start 2023-03-02T10:56:52.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.622+0000 7f131ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13180fe9c0 0x7f13181958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:52.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.622+0000 7f131ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13180ffc50 0x7f1318195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:52.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.622+0000 7f131ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1318100600 0x7f131819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:52.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.622+0000 7f131ffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131819d420 con 0x7f1318100600 2023-03-02T10:56:52.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.622+0000 7f131ffff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131819d560 con 0x7f13180ffc50 2023-03-02T10:56:52.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.622+0000 7f131ffff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131819d6f0 con 0x7f13180fe9c0 2023-03-02T10:56:52.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13180fe9c0 0x7f13181958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:52.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131d59a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13180ffc50 0x7f1318195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:52.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131d59a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13180ffc50 0x7f1318195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:37264/0 (socket says 172.21.15.57:37264) 2023-03-02T10:56:52.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13180fe9c0 0x7f13181958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:59044/0 (socket says 172.21.15.57:59044) 2023-03-02T10:56:52.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131d59a700 1 -- 172.21.15.57:0/3284554209 learned_addr learned my addr 172.21.15.57:0/3284554209 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:52.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131e59c700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1318100600 0x7f131819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:52.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131d59a700 1 -- 172.21.15.57:0/3284554209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13180fe9c0 msgr2=0x7f13181958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:52.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131d59a700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13180fe9c0 0x7f13181958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131d59a700 1 -- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1318100600 msgr2=0x7f131819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131d59a700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1318100600 0x7f131819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131d59a700 1 -- 172.21.15.57:0/3284554209 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13080095f0 con 0x7f13180ffc50 2023-03-02T10:56:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131d59a700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13180ffc50 0x7f1318195de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f13080059d0 tx=0x7f1308004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f130effd700 1 -- 172.21.15.57:0/3284554209 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130801d070 con 0x7f13180ffc50 2023-03-02T10:56:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f130effd700 1 -- 172.21.15.57:0/3284554209 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f130800fb90 con 0x7f13180ffc50 2023-03-02T10:56:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.623+0000 7f131ffff700 1 -- 172.21.15.57:0/3284554209 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131810a320 con 0x7f13180ffc50 2023-03-02T10:56:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.624+0000 7f130effd700 1 -- 172.21.15.57:0/3284554209 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080173f0 con 0x7f13180ffc50 2023-03-02T10:56:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.624+0000 7f131ffff700 1 -- 172.21.15.57:0/3284554209 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131810a190 con 0x7f13180ffc50 2023-03-02T10:56:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.625+0000 7f131ffff700 1 -- 172.21.15.57:0/3284554209 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13181011f0 con 0x7f13180ffc50 2023-03-02T10:56:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.626+0000 7f130effd700 1 -- 172.21.15.57:0/3284554209 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) v1 ==== 129874+0+0 (secure 0 0 0) 0x7f1308029030 con 0x7f13180ffc50 2023-03-02T10:56:52.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.627+0000 7f130effd700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f130409b470 0x7f130409d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:52.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.627+0000 7f131dd9b700 1 -- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f130409b470 msgr2=0x7f130409d920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1987811557 2023-03-02T10:56:52.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.627+0000 7f130effd700 1 -- 172.21.15.57:0/3284554209 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f13080c61e0 con 0x7f13180ffc50 2023-03-02T10:56:52.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.627+0000 7f131dd9b700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f130409b470 0x7f130409d920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-02T10:56:52.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.631+0000 7f130effd700 1 -- 172.21.15.57:0/3284554209 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f130805b800 con 0x7f13180ffc50 2023-03-02T10:56:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-mon[92072]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-02T10:56:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-mon[92072]: scrub queued for path: / 2023-03-02T10:56:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:56:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-mon[92072]: scrub summary: active paths [/] 2023-03-02T10:56:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:56:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/419238626' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-03-02T10:56:52.683 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: ignoring --setuser ceph since I am not root 2023-03-02T10:56:52.684 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: ignoring --setgroup ceph since I am not root 2023-03-02T10:56:52.684 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-mgr[92342]: -- 172.21.15.57:0/1785591143 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560c86a60b60 con 0x560c86a35000 2023-03-02T10:56:52.684 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:52.619+0000 7f462ccdf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-02T10:56:52.701 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: ignoring --setuser ceph since I am not root 2023-03-02T10:56:52.701 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: ignoring --setgroup ceph since I am not root 2023-03-02T10:56:52.702 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-mgr[126918]: -- 172.21.15.122:0/1746281194 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560eda40eb60 con 0x560eda3e2800 2023-03-02T10:56:52.702 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:52.562+0000 7f8d308fd200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-02T10:56:52.702 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:52.641+0000 7f8d308fd200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-02T10:56:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-mon[125440]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-02T10:56:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-mon[125440]: scrub queued for path: / 2023-03-02T10:56:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:56:52.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-mon[125440]: scrub summary: active paths [/] 2023-03-02T10:56:52.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:56:52.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/419238626' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-03-02T10:56:52.732 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-mon[125702]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-02T10:56:52.732 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-mon[125702]: scrub queued for path: / 2023-03-02T10:56:52.732 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:56:52.732 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-mon[125702]: scrub summary: active paths [/] 2023-03-02T10:56:52.732 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:56:52.732 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/419238626' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-03-02T10:56:52.733 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: ignoring --setuser ceph since I am not root 2023-03-02T10:56:52.733 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: ignoring --setgroup ceph since I am not root 2023-03-02T10:56:52.733 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-mgr[127745]: -- 172.21.15.136:0/2745719029 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55eda193ab60 con 0x55eda190ec00 2023-03-02T10:56:52.733 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:52.563+0000 7fc3d346c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-02T10:56:52.733 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:52.641+0000 7fc3d346c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-02T10:56:52.733 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:52.730+0000 7fc3d346c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-02T10:56:52.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.828+0000 7f131dd9b700 1 -- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f130409b470 msgr2=0x7f130409d920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1987811557 2023-03-02T10:56:52.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.828+0000 7f131dd9b700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f130409b470 0x7f130409d920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-02T10:56:52.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.828+0000 7f131ffff700 1 -- 172.21.15.57:0/3284554209 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f13181017d0 con 0x7f13180ffc50 2023-03-02T10:56:52.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.835+0000 7f130effd700 1 -- 172.21.15.57:0/3284554209 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f13080270d0 con 0x7f13180ffc50 2023-03-02T10:56:52.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.837+0000 7f131ffff700 1 -- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f130409b470 msgr2=0x7f130409d920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-02T10:56:52.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.837+0000 7f131ffff700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f130409b470 0x7f130409d920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.837+0000 7f131ffff700 1 -- 172.21.15.57:0/3284554209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13180ffc50 msgr2=0x7f1318195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:52.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.837+0000 7f131ffff700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13180ffc50 0x7f1318195de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f13080059d0 tx=0x7f1308004730 comp rx=0 tx=0).stop 2023-03-02T10:56:52.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.837+0000 7f131ffff700 1 -- 172.21.15.57:0/3284554209 shutdown_connections 2023-03-02T10:56:52.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.837+0000 7f131ffff700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7f130409b470 0x7f130409d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.837+0000 7f131ffff700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1318100600 0x7f131819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.837+0000 7f131ffff700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13180fe9c0 0x7f13181958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.838+0000 7f131ffff700 1 --2- 172.21.15.57:0/3284554209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13180ffc50 0x7f1318195de0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:52.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.838+0000 7f131ffff700 1 -- 172.21.15.57:0/3284554209 >> 172.21.15.57:0/3284554209 conn(0x7f13180f9fa0 msgr2=0x7f1318067990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:52.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.838+0000 7f131ffff700 1 -- 172.21.15.57:0/3284554209 shutdown_connections 2023-03-02T10:56:52.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:52.838+0000 7f131ffff700 1 -- 172.21.15.57:0/3284554209 wait complete. 2023-03-02T10:56:52.854 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-03-02T10:56:52.990 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:52.823+0000 7fc3d346c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-02T10:56:52.992 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:52.731+0000 7f8d308fd200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-02T10:56:52.992 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:52.823+0000 7f8d308fd200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-02T10:56:53.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.012+0000 7efd0e1ff700 1 -- 172.21.15.57:0/2388289043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd08102f00 msgr2=0x7efd081052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:53.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.012+0000 7efd0e1ff700 1 --2- 172.21.15.57:0/2388289043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd08102f00 0x7efd081052e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009990 tx=0x7efcf0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.012+0000 7efd0e1ff700 1 -- 172.21.15.57:0/2388289043 shutdown_connections 2023-03-02T10:56:53.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.012+0000 7efd0e1ff700 1 --2- 172.21.15.57:0/2388289043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd08105820 0x7efd08107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.012+0000 7efd0e1ff700 1 --2- 172.21.15.57:0/2388289043 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd081005e0 0x7efd081029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.012+0000 7efd0e1ff700 1 --2- 172.21.15.57:0/2388289043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd08102f00 0x7efd081052e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.012+0000 7efd0e1ff700 1 -- 172.21.15.57:0/2388289043 >> 172.21.15.57:0/2388289043 conn(0x7efd080f9fa0 msgr2=0x7efd080fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:53.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.012+0000 7efd0e1ff700 1 -- 172.21.15.57:0/2388289043 shutdown_connections 2023-03-02T10:56:53.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.013+0000 7efd0e1ff700 1 -- 172.21.15.57:0/2388289043 wait complete. 2023-03-02T10:56:53.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.013+0000 7efd0e1ff700 1 Processor -- start 2023-03-02T10:56:53.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.013+0000 7efd0e1ff700 1 -- start start 2023-03-02T10:56:53.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd0e1ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd081005e0 0x7efd080fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:53.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd0e1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd08102f00 0x7efd080fe590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:53.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd0e1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd08105820 0x7efd080fead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:53.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd0e1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd080ff270 con 0x7efd08102f00 2023-03-02T10:56:53.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd0e1ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd080ff3e0 con 0x7efd081005e0 2023-03-02T10:56:53.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd0e1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0819f910 con 0x7efd08105820 2023-03-02T10:56:53.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd077fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd081005e0 0x7efd080fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:53.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efcfffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd08102f00 0x7efd080fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:53.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd07fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd08105820 0x7efd080fead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:53.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efcfffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd08102f00 0x7efd080fe590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54228/0 (socket says 172.21.15.57:54228) 2023-03-02T10:56:53.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd077fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd081005e0 0x7efd080fff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:37282/0 (socket says 172.21.15.57:37282) 2023-03-02T10:56:53.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efcfffff700 1 -- 172.21.15.57:0/3262508756 learned_addr learned my addr 172.21.15.57:0/3262508756 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:53.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd077fe700 1 -- 172.21.15.57:0/3262508756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd08105820 msgr2=0x7efd080fead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:53.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd077fe700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd08105820 0x7efd080fead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd077fe700 1 -- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd08102f00 msgr2=0x7efd080fe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:53.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd077fe700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd08102f00 0x7efd080fe590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd077fe700 1 -- 172.21.15.57:0/3262508756 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf00095f0 con 0x7efd081005e0 2023-03-02T10:56:53.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efcfffff700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd08102f00 0x7efd080fe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:53.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.014+0000 7efd077fe700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd081005e0 0x7efd080fff50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efcf800e9c0 tx=0x7efcf800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:53.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.015+0000 7efd057fa700 1 -- 172.21.15.57:0/3262508756 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf800c9c0 con 0x7efd081005e0 2023-03-02T10:56:53.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.015+0000 7efd0e1ff700 1 -- 172.21.15.57:0/3262508756 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0810b4a0 con 0x7efd081005e0 2023-03-02T10:56:53.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.015+0000 7efd057fa700 1 -- 172.21.15.57:0/3262508756 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efcf8010430 con 0x7efd081005e0 2023-03-02T10:56:53.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.015+0000 7efd057fa700 1 -- 172.21.15.57:0/3262508756 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8018680 con 0x7efd081005e0 2023-03-02T10:56:53.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.015+0000 7efd0e1ff700 1 -- 172.21.15.57:0/3262508756 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0810b310 con 0x7efd081005e0 2023-03-02T10:56:53.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.016+0000 7efd0e1ff700 1 -- 172.21.15.57:0/3262508756 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd080fbb10 con 0x7efd081005e0 2023-03-02T10:56:53.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.017+0000 7efd057fa700 1 -- 172.21.15.57:0/3262508756 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) v1 ==== 129874+0+0 (secure 0 0 0) 0x7efcf8045d70 con 0x7efd081005e0 2023-03-02T10:56:53.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.018+0000 7efd057fa700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efcf409b3f0 0x7efcf409d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:53.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.018+0000 7efcfffff700 1 -- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efcf409b3f0 msgr2=0x7efcf409d8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1987811557 2023-03-02T10:56:53.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.018+0000 7efd057fa700 1 -- 172.21.15.57:0/3262508756 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efcf8014070 con 0x7efd081005e0 2023-03-02T10:56:53.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.018+0000 7efcfffff700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efcf409b3f0 0x7efcf409d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-02T10:56:53.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.025+0000 7efd057fa700 1 -- 172.21.15.57:0/3262508756 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7efcf8090c90 con 0x7efd081005e0 2023-03-02T10:56:53.126 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:52.712+0000 7f462ccdf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-02T10:56:53.126 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:52.813+0000 7f462ccdf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-02T10:56:53.126 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:52 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:52.926+0000 7f462ccdf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-02T10:56:53.126 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:53 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:53.124+0000 7f462ccdf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-02T10:56:53.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.219+0000 7efcfffff700 1 -- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efcf409b3f0 msgr2=0x7efcf409d8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1987811557 2023-03-02T10:56:53.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.219+0000 7efcfffff700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efcf409b3f0 0x7efcf409d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-02T10:56:53.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.226+0000 7efd0e1ff700 1 -- 172.21.15.57:0/3262508756 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7efd0802cd50 con 0x7efd081005e0 2023-03-02T10:56:53.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.236+0000 7efd057fa700 1 -- 172.21.15.57:0/3262508756 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7efcf80942b0 con 0x7efd081005e0 2023-03-02T10:56:53.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.238+0000 7efd0e1ff700 1 -- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efcf409b3f0 msgr2=0x7efcf409d8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-02T10:56:53.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.238+0000 7efd0e1ff700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efcf409b3f0 0x7efcf409d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.238+0000 7efd0e1ff700 1 -- 172.21.15.57:0/3262508756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd081005e0 msgr2=0x7efd080fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:53.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.238+0000 7efd0e1ff700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd081005e0 0x7efd080fff50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efcf800e9c0 tx=0x7efcf800ecd0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.238+0000 7efd0e1ff700 1 -- 172.21.15.57:0/3262508756 shutdown_connections 2023-03-02T10:56:53.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.238+0000 7efd0e1ff700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7efcf409b3f0 0x7efcf409d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.238+0000 7efd0e1ff700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd08105820 0x7efd080fead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.238+0000 7efd0e1ff700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd081005e0 0x7efd080fff50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.238+0000 7efd0e1ff700 1 --2- 172.21.15.57:0/3262508756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd08102f00 0x7efd080fe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.238+0000 7efd0e1ff700 1 -- 172.21.15.57:0/3262508756 >> 172.21.15.57:0/3262508756 conn(0x7efd080f9fa0 msgr2=0x7efd08101220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:53.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.239+0000 7efd0e1ff700 1 -- 172.21.15.57:0/3262508756 shutdown_connections 2023-03-02T10:56:53.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.239+0000 7efd0e1ff700 1 -- 172.21.15.57:0/3262508756 wait complete. 2023-03-02T10:56:53.256 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M' 2023-03-02T10:56:53.299 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:52 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:52.988+0000 7fc3d346c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-02T10:56:53.304 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:52 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:52.991+0000 7f8d308fd200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-02T10:56:53.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.412+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/424978006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc8100ce0 msgr2=0x7fbdc8101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:53.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.412+0000 7fbdcc9ff700 1 --2- 172.21.15.57:0/424978006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc8100ce0 0x7fbdc8101130 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009990 tx=0x7fbdbc009ca0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.412+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/424978006 shutdown_connections 2023-03-02T10:56:53.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.412+0000 7fbdcc9ff700 1 --2- 172.21.15.57:0/424978006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdc8101670 0x7fbdc8107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.412+0000 7fbdcc9ff700 1 --2- 172.21.15.57:0/424978006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdc80ffaf0 0x7fbdc80fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.412+0000 7fbdcc9ff700 1 --2- 172.21.15.57:0/424978006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc8100ce0 0x7fbdc8101130 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.412+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/424978006 >> 172.21.15.57:0/424978006 conn(0x7fbdc80fb0f0 msgr2=0x7fbdc80fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:56:53.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.412+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/424978006 shutdown_connections 2023-03-02T10:56:53.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.412+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/424978006 wait complete. 2023-03-02T10:56:53.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdcc9ff700 1 Processor -- start 2023-03-02T10:56:53.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdcc9ff700 1 -- start start 2023-03-02T10:56:53.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdcc9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc80ffaf0 0x7fbdc8197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:53.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdcc9ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdc8100ce0 0x7fbdc8197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:53.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdcc9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdc8101670 0x7fbdc819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:53.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdcc9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc819f5e0 con 0x7fbdc80ffaf0 2023-03-02T10:56:53.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdcc9ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc819f720 con 0x7fbdc8100ce0 2023-03-02T10:56:53.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdcc9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc819f8b0 con 0x7fbdc8101670 2023-03-02T10:56:53.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdc659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc80ffaf0 0x7fbdc8197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:53.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdc659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc80ffaf0 0x7fbdc8197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54244/0 (socket says 172.21.15.57:54244) 2023-03-02T10:56:53.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdc659c700 1 -- 172.21.15.57:0/2993221653 learned_addr learned my addr 172.21.15.57:0/2993221653 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:56:53.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdc5d9b700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdc8100ce0 0x7fbdc8197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:53.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdc6d9d700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdc8101670 0x7fbdc819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:56:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdc659c700 1 -- 172.21.15.57:0/2993221653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdc8101670 msgr2=0x7fbdc819f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.413+0000 7fbdc659c700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdc8101670 0x7fbdc819f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.414+0000 7fbdc659c700 1 -- 172.21.15.57:0/2993221653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdc8100ce0 msgr2=0x7fbdc8197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:56:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.414+0000 7fbdc659c700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdc8100ce0 0x7fbdc8197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:56:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.414+0000 7fbdc659c700 1 -- 172.21.15.57:0/2993221653 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0095f0 con 0x7fbdc80ffaf0 2023-03-02T10:56:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.414+0000 7fbdc5d9b700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbdc8100ce0 0x7fbdc8197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:56:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.414+0000 7fbdc659c700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc80ffaf0 0x7fbdc8197a60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800e9c0 tx=0x7fbdb800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:56:53.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.414+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8009780 con 0x7fbdc80ffaf0 2023-03-02T10:56:53.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.414+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/2993221653 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc810b4a0 con 0x7fbdc80ffaf0 2023-03-02T10:56:53.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.414+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdb800ee60 con 0x7fbdc80ffaf0 2023-03-02T10:56:53.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.414+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8003c20 con 0x7fbdc80ffaf0 2023-03-02T10:56:53.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.414+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/2993221653 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc810b310 con 0x7fbdc80ffaf0 2023-03-02T10:56:53.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.415+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/2993221653 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc8192200 con 0x7fbdc80ffaf0 2023-03-02T10:56:53.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.416+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 19) v1 ==== 129874+0+0 (secure 0 0 0) 0x7fbdb801e020 con 0x7fbdc80ffaf0 2023-03-02T10:56:53.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.417+0000 7fbdb77fe700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 0x7fbdb009d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:56:53.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.417+0000 7fbdc5d9b700 1 -- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 msgr2=0x7fbdb009d8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1987811557 2023-03-02T10:56:53.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.417+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbdb8014070 con 0x7fbdc80ffaf0 2023-03-02T10:56:53.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.418+0000 7fbdc5d9b700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 0x7fbdb009d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-02T10:56:53.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.422+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fbdb8090b10 con 0x7fbdc80ffaf0 2023-03-02T10:56:53.590 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:53 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:53.297+0000 7fc3d346c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-02T10:56:53.590 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:53 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:53.383+0000 7fc3d346c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-02T10:56:53.590 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:53 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:53.513+0000 7fc3d346c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-02T10:56:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:53 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/419238626' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-03-02T10:56:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:53 smithi136 ceph-mon[125702]: mgrmap e19: x(active, since 8m), standbys: z, y 2023-03-02T10:56:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:53 smithi136 ceph-mon[125702]: from='client.? ' entity='client.admin' 2023-03-02T10:56:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:53 smithi136 ceph-mon[125702]: from='client.? ' entity='client.admin' 2023-03-02T10:56:53.614 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:53 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/419238626' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-03-02T10:56:53.614 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:53 smithi122 ceph-mon[125440]: mgrmap e19: x(active, since 8m), standbys: z, y 2023-03-02T10:56:53.615 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:53 smithi122 ceph-mon[125440]: from='client.? ' entity='client.admin' 2023-03-02T10:56:53.615 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:53 smithi122 ceph-mon[125440]: from='client.? ' entity='client.admin' 2023-03-02T10:56:53.615 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:53 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:53.304+0000 7f8d308fd200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-02T10:56:53.615 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:53 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:53.390+0000 7f8d308fd200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-02T10:56:53.615 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:53 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:53.519+0000 7f8d308fd200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-02T10:56:53.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.619+0000 7fbdc5d9b700 1 -- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 msgr2=0x7fbdb009d8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1987811557 2023-03-02T10:56:53.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.619+0000 7fbdc5d9b700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 0x7fbdb009d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-02T10:56:53.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:53.665+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/2993221653 --> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdc80614c0 con 0x7fbdb009b3f0 2023-03-02T10:56:53.682 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:53 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:53.502+0000 7f462ccdf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-02T10:56:53.682 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:53 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:53.605+0000 7f462ccdf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-02T10:56:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:53 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/419238626' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-03-02T10:56:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:53 smithi057 ceph-mon[92072]: mgrmap e19: x(active, since 8m), standbys: z, y 2023-03-02T10:56:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:53 smithi057 ceph-mon[92072]: from='client.? ' entity='client.admin' 2023-03-02T10:56:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:53 smithi057 ceph-mon[92072]: from='client.? ' entity='client.admin' 2023-03-02T10:56:53.951 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:53 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:53.613+0000 7f8d308fd200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-02T10:56:54.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:54.020+0000 7fbdc5d9b700 1 -- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 msgr2=0x7fbdb009d8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1987811557 2023-03-02T10:56:54.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:54.020+0000 7fbdc5d9b700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 0x7fbdb009d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-02T10:56:54.028 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:53 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:53.608+0000 7fc3d346c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-02T10:56:54.183 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:53 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:53.751+0000 7f462ccdf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-02T10:56:54.183 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:53 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:53.860+0000 7f462ccdf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-02T10:56:54.340 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:54 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:54.027+0000 7fc3d346c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-02T10:56:54.451 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:54 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:54.032+0000 7f8d308fd200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-02T10:56:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:54 smithi057 ceph-mon[92072]: scrub summary: idle 2023-03-02T10:56:54.683 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:54 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:54.345+0000 7f462ccdf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-02T10:56:54.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:54.825+0000 7fbdc5d9b700 1 -- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 msgr2=0x7fbdb009d8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1987811557 2023-03-02T10:56:54.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:54.825+0000 7fbdc5d9b700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 0x7fbdb009d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-03-02T10:56:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:54 smithi136 ceph-mon[125702]: scrub summary: idle 2023-03-02T10:56:54.840 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:54 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:54.594+0000 7fc3d346c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-02T10:56:54.840 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:54 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:54.766+0000 7fc3d346c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-02T10:56:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:54 smithi122 ceph-mon[125440]: scrub summary: idle 2023-03-02T10:56:54.952 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:54 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:54.598+0000 7f8d308fd200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-02T10:56:54.952 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:54 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:54.769+0000 7f8d308fd200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-02T10:56:55.432 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:55 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:55.010+0000 7f462ccdf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-02T10:56:55.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:55 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:55.196+0000 7f462ccdf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-02T10:56:55.778 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:55 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:55.521+0000 7f8d308fd200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:56:55.779 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:55 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:55.610+0000 7f8d308fd200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-02T10:56:55.780 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:55 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:55.522+0000 7fc3d346c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:56:55.780 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:55 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:55.612+0000 7fc3d346c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-02T10:56:56.090 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:55 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:55.779+0000 7fc3d346c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:56:56.090 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:55 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:55.963+0000 7fc3d346c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-02T10:56:56.108 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:55 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:55.777+0000 7f8d308fd200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:56:56.108 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:55 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:55.962+0000 7f8d308fd200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-02T10:56:56.374 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:56 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:56.065+0000 7f462ccdf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:56:56.375 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:56 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:56.173+0000 7f462ccdf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-02T10:56:56.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:56.426+0000 7fbdc5d9b700 1 -- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 msgr2=0x7fbdb009d8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1987811557 2023-03-02T10:56:56.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:56.426+0000 7fbdc5d9b700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 0x7fbdb009d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-03-02T10:56:56.451 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:56 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:56.107+0000 7f8d308fd200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-02T10:56:56.508 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:56 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:56.110+0000 7fc3d346c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-02T10:56:56.682 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:56 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:56.373+0000 7f462ccdf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-02T10:56:56.683 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:56 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:56.593+0000 7f462ccdf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-02T10:56:56.840 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:56 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:56.507+0000 7fc3d346c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-02T10:56:56.951 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:56 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:56.502+0000 7f8d308fd200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-02T10:56:57.182 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:56 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:56.766+0000 7f462ccdf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-02T10:56:57.327 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:57 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:57.025+0000 7f8d308fd200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-02T10:56:57.340 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:57 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:57.032+0000 7fc3d346c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-02T10:56:57.624 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:57 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:57.326+0000 7f8d308fd200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-02T10:56:57.624 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:57 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:57.511+0000 7f8d308fd200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-02T10:56:57.641 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:57 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:57.339+0000 7fc3d346c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-02T10:56:57.641 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:57 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:57.526+0000 7fc3d346c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-02T10:56:57.682 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:57 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:57.221+0000 7f462ccdf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-02T10:56:57.951 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:57 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:57.623+0000 7f8d308fd200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-02T10:56:57.952 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:57 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:57.834+0000 7f8d308fd200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-02T10:56:58.090 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:57 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:57.638+0000 7fc3d346c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-02T10:56:58.090 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:57 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:57.849+0000 7fc3d346c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-02T10:56:58.182 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:57 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:57.871+0000 7f462ccdf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-02T10:56:58.579 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:58 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:58.213+0000 7f462ccdf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-02T10:56:58.580 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:58 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:58.441+0000 7f462ccdf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-02T10:56:58.836 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:58 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:58.578+0000 7f462ccdf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-02T10:56:58.951 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 10:56:58 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: 2023-03-02T10:56:58.678+0000 7f8d308fd200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-02T10:56:59.090 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 10:56:58 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: 2023-03-02T10:56:58.697+0000 7fc3d346c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-02T10:56:59.182 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:58 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:58.835+0000 7f462ccdf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-02T10:56:59.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:59.559+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 20) v1 ==== 129874+0+0 (secure 0 0 0) 0x7fbdb800c040 con 0x7fbdc80ffaf0 2023-03-02T10:56:59.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:59.630+0000 7fbdc5d9b700 1 -- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 msgr2=0x7fbdb009d8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.57:6800/1987811557 2023-03-02T10:56:59.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:56:59.630+0000 7fbdc5d9b700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 0x7fbdb009d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-03-02T10:56:59.825 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: Standby manager daemon y restarted 2023-03-02T10:56:59.826 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: Standby manager daemon y started 2023-03-02T10:56:59.826 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-02T10:56:59.826 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:56:59.826 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-02T10:56:59.826 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:56:59.827 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: Standby manager daemon z restarted 2023-03-02T10:56:59.827 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: Standby manager daemon z started 2023-03-02T10:56:59.827 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-02T10:56:59.827 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:56:59.827 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-02T10:56:59.827 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-mon[92072]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:56:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: Standby manager daemon y restarted 2023-03-02T10:56:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: Standby manager daemon y started 2023-03-02T10:56:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-02T10:56:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:56:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-02T10:56:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:56:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: Standby manager daemon z restarted 2023-03-02T10:56:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: Standby manager daemon z started 2023-03-02T10:56:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-02T10:56:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:56:59.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-02T10:56:59.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:56:59 smithi136 ceph-mon[125702]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:56:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: Standby manager daemon y restarted 2023-03-02T10:56:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: Standby manager daemon y started 2023-03-02T10:56:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-02T10:56:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:56:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-02T10:56:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.122:0/1507244465' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:56:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: Standby manager daemon z restarted 2023-03-02T10:56:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: Standby manager daemon z started 2023-03-02T10:56:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-02T10:56:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-02T10:56:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-02T10:56:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:56:59 smithi122 ceph-mon[125440]: from='mgr.? 172.21.15.136:0/2117642809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-02T10:57:00.182 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:56:59 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:56:59.824+0000 7f462ccdf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-02T10:57:00.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:00.565+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mgrmap(e 21) v1 ==== 129601+0+0 (secure 0 0 0) 0x7fbdb800cc00 con 0x7fbdc80ffaf0 2023-03-02T10:57:00.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:00.565+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 msgr2=0x7fbdb009d8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-02T10:57:00.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:00.565+0000 7fbdb77fe700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1987811557,v1:172.21.15.57:6801/1987811557] conn(0x7fbdb009b3f0 0x7fbdb009d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:00.833 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:00 smithi136 ceph-mon[125702]: mgrmap e20: x(active, since 8m), standbys: y, z 2023-03-02T10:57:00.834 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:00 smithi136 ceph-mon[125702]: Active manager daemon x restarted 2023-03-02T10:57:00.834 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:00 smithi136 ceph-mon[125702]: Activating manager daemon x 2023-03-02T10:57:00.834 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:00 smithi136 ceph-mon[125702]: osdmap e87: 12 total, 12 up, 12 in 2023-03-02T10:57:00.882 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-mon[92072]: mgrmap e20: x(active, since 8m), standbys: y, z 2023-03-02T10:57:00.882 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-mon[92072]: Active manager daemon x restarted 2023-03-02T10:57:00.882 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-mon[92072]: Activating manager daemon x 2023-03-02T10:57:00.883 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-mon[92072]: osdmap e87: 12 total, 12 up, 12 in 2023-03-02T10:57:00.883 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:57:00.767+0000 7f4592c6c700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:57:00.883 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:57:00.767+0000 7f4592c6c700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:57:00.883 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:57:00.767+0000 7f4592c6c700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:57:00.883 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:57:00.767+0000 7f4592c6c700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:57:00.883 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:57:00.767+0000 7f4592c6c700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:57:00.884 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:57:00.767+0000 7f458ec64700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:57:00.884 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:57:00.767+0000 7f458ec64700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:57:00.884 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:57:00.767+0000 7f458ec64700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:57:00.884 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:57:00.767+0000 7f458ec64700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:57:00.884 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:57:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:57:00.767+0000 7f458ec64700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:57:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:00 smithi122 ceph-mon[125440]: mgrmap e20: x(active, since 8m), standbys: y, z 2023-03-02T10:57:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:00 smithi122 ceph-mon[125440]: Active manager daemon x restarted 2023-03-02T10:57:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:00 smithi122 ceph-mon[125440]: Activating manager daemon x 2023-03-02T10:57:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:00 smithi122 ceph-mon[125440]: osdmap e87: 12 total, 12 up, 12 in 2023-03-02T10:57:01.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.598+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 <== mon.0 v2:172.21.15.57:3300/0 9 ==== mgrmap(e 22) v1 ==== 129711+0+0 (secure 0 0 0) 0x7fbdb8090ee0 con 0x7fbdc80ffaf0 2023-03-02T10:57:01.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.599+0000 7fbdb77fe700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fbdb002f5b0 0x7fbdb002f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:01.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.599+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 --> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdc80614c0 con 0x7fbdb002f5b0 2023-03-02T10:57:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.601+0000 7fbdc5d9b700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fbdb002f5b0 0x7fbdb002f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:01.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.605+0000 7fbdc5d9b700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fbdb002f5b0 0x7fbdb002f9a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00b2e0 tx=0x7fbdbc005fb0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:01.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.671+0000 7fbdb77fe700 1 -- 172.21.15.57:0/2993221653 <== mgr.25273 v2:172.21.15.57:6800/1603975717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fbdc80614c0 con 0x7fbdb002f5b0 2023-03-02T10:57:01.674 INFO:teuthology.orchestra.run.smithi057.stdout:Schedule set for path / 2023-03-02T10:57:01.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.673+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fbdb002f5b0 msgr2=0x7fbdb002f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:01.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.673+0000 7fbdcc9ff700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fbdb002f5b0 0x7fbdb002f9a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00b2e0 tx=0x7fbdbc005fb0 comp rx=0 tx=0).stop 2023-03-02T10:57:01.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.673+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc80ffaf0 msgr2=0x7fbdc8197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:01.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.673+0000 7fbdcc9ff700 1 --2- 172.21.15.57:0/2993221653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc80ffaf0 0x7fbdc8197a60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800e9c0 tx=0x7fbdb800ecd0 comp rx=0 tx=0).stop 2023-03-02T10:57:01.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.673+0000 7fbdc6d9d700 1 -- 172.21.15.57:0/2993221653 reap_dead start 2023-03-02T10:57:01.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.673+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/2993221653 shutdown_connections 2023-03-02T10:57:01.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.673+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/2993221653 >> 172.21.15.57:0/2993221653 conn(0x7fbdc80fb0f0 msgr2=0x7fbdc81065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:01.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.673+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/2993221653 shutdown_connections 2023-03-02T10:57:01.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.673+0000 7fbdcc9ff700 1 -- 172.21.15.57:0/2993221653 wait complete. 2023-03-02T10:57:01.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h' 2023-03-02T10:57:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: mgrmap e21: x(active, starting, since 0.739799s), standbys: y, z 2023-03-02T10:57:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:57:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:57:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:57:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-02T10:57:01.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-02T10:57:01.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-02T10:57:01.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-02T10:57:01.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-02T10:57:01.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-02T10:57:01.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-02T10:57:01.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-02T10:57:01.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-02T10:57:01.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-02T10:57:01.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-02T10:57:01.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-02T10:57:01.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-02T10:57:01.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-02T10:57:01.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-02T10:57:01.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:57:01.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:57:01.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:57:01.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:57:01.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:57:01.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:57:01.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:57:01.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:57:01.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:57:01.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:57:01.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:57:01.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:57:01.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-02T10:57:01.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-02T10:57:01.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-02T10:57:01.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: Manager daemon x is now available 2023-03-02T10:57:01.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:57:01.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:57:01.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-02T10:57:01.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-02T10:57:01.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-02T10:57:01.847 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-02T10:57:01.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.855+0000 7f02a19ff700 1 -- 172.21.15.57:0/1548173701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c068630 msgr2=0x7f029c102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:01.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.855+0000 7f02a19ff700 1 --2- 172.21.15.57:0/1548173701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c068630 0x7f029c102670 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f028c009990 tx=0x7f028c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:01.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.855+0000 7f02a19ff700 1 -- 172.21.15.57:0/1548173701 shutdown_connections 2023-03-02T10:57:01.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.855+0000 7f02a19ff700 1 --2- 172.21.15.57:0/1548173701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c1056a0 0x7f029c107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:01.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.855+0000 7f02a19ff700 1 --2- 172.21.15.57:0/1548173701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c068630 0x7f029c102670 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:01.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.855+0000 7f02a19ff700 1 --2- 172.21.15.57:0/1548173701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f029c102bb0 0x7f029c105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:01.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.855+0000 7f02a19ff700 1 -- 172.21.15.57:0/1548173701 >> 172.21.15.57:0/1548173701 conn(0x7f029c0f9fa0 msgr2=0x7f029c0fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:01.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.855+0000 7f02a19ff700 1 -- 172.21.15.57:0/1548173701 shutdown_connections 2023-03-02T10:57:01.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.855+0000 7f02a19ff700 1 -- 172.21.15.57:0/1548173701 wait complete. 2023-03-02T10:57:01.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.856+0000 7f02a19ff700 1 Processor -- start 2023-03-02T10:57:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.856+0000 7f02a19ff700 1 -- start start 2023-03-02T10:57:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.856+0000 7f02a19ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c068630 0x7f029c0fffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.856+0000 7f02a19ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c102bb0 0x7f029c0fe610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.856+0000 7f02a19ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f029c1056a0 0x7f029c0feb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.856+0000 7f02a19ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0ff2f0 con 0x7f029c102bb0 2023-03-02T10:57:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.856+0000 7f02a19ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0ff460 con 0x7f029c1056a0 2023-03-02T10:57:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.856+0000 7f02a19ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c19f920 con 0x7f029c068630 2023-03-02T10:57:01.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c068630 0x7f029c0fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:01.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c068630 0x7f029c0fffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47188/0 (socket says 172.21.15.57:47188) 2023-03-02T10:57:01.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f029c1056a0 0x7f029c0feb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:01.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c102bb0 0x7f029c0fe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:01.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029affd700 1 -- 172.21.15.57:0/1769316508 learned_addr learned my addr 172.21.15.57:0/1769316508 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:01.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029affd700 1 -- 172.21.15.57:0/1769316508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f029c1056a0 msgr2=0x7f029c0feb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:01.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029affd700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f029c1056a0 0x7f029c0feb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:01.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029affd700 1 -- 172.21.15.57:0/1769316508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c102bb0 msgr2=0x7f029c0fe610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:01.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029affd700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c102bb0 0x7f029c0fe610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:01.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029affd700 1 -- 172.21.15.57:0/1769316508 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c0095f0 con 0x7f029c068630 2023-03-02T10:57:01.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029b7fe700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f029c1056a0 0x7f029c0feb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:01.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f029affd700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c068630 0x7f029c0fffd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f028c004710 tx=0x7f028c009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:01.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.857+0000 7f02a09fd700 1 -- 172.21.15.57:0/1769316508 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c01d070 con 0x7f029c068630 2023-03-02T10:57:01.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.858+0000 7f02a09fd700 1 -- 172.21.15.57:0/1769316508 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f028c021410 con 0x7f029c068630 2023-03-02T10:57:01.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.858+0000 7f02a19ff700 1 -- 172.21.15.57:0/1769316508 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c10b470 con 0x7f029c068630 2023-03-02T10:57:01.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.858+0000 7f02a09fd700 1 -- 172.21.15.57:0/1769316508 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c017650 con 0x7f029c068630 2023-03-02T10:57:01.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.858+0000 7f02a19ff700 1 -- 172.21.15.57:0/1769316508 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c10b2e0 con 0x7f029c068630 2023-03-02T10:57:01.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.859+0000 7f02a19ff700 1 -- 172.21.15.57:0/1769316508 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c0fbb10 con 0x7f029c068630 2023-03-02T10:57:01.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.860+0000 7f02a09fd700 1 -- 172.21.15.57:0/1769316508 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 22) v1 ==== 129711+0+0 (secure 0 0 0) 0x7f028c028030 con 0x7f029c068630 2023-03-02T10:57:01.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.861+0000 7f02a09fd700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f028409b2e0 0x7f028409d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:01.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.861+0000 7f02a09fd700 1 -- 172.21.15.57:0/1769316508 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f028c0c63b0 con 0x7f029c068630 2023-03-02T10:57:01.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.861+0000 7f029a7fc700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f028409b2e0 0x7f028409d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:01.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.862+0000 7f029a7fc700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f028409b2e0 0x7f028409d790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0290009c60 tx=0x7f0290009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:01.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:01.864+0000 7f02a09fd700 1 -- 172.21.15.57:0/1769316508 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f028c091cf0 con 0x7f029c068630 2023-03-02T10:57:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: mgrmap e21: x(active, starting, since 0.739799s), standbys: y, z 2023-03-02T10:57:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:57:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:57:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:57:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-02T10:57:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-02T10:57:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-02T10:57:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-02T10:57:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-02T10:57:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-02T10:57:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-02T10:57:01.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-02T10:57:01.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-02T10:57:01.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-02T10:57:01.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-02T10:57:01.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-02T10:57:01.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-02T10:57:01.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-02T10:57:01.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-02T10:57:01.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:57:01.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:57:01.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:57:01.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:57:01.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:57:01.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:57:01.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:57:01.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:57:01.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:57:01.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:57:01.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:57:01.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:57:01.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-02T10:57:01.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-02T10:57:01.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-02T10:57:01.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: Manager daemon x is now available 2023-03-02T10:57:01.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:57:01.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:57:01.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-02T10:57:01.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-02T10:57:01.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-02T10:57:01.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-02T10:57:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: mgrmap e21: x(active, starting, since 0.739799s), standbys: y, z 2023-03-02T10:57:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-02T10:57:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-02T10:57:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-02T10:57:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-02T10:57:01.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-02T10:57:01.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-02T10:57:01.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-02T10:57:01.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-02T10:57:01.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-02T10:57:01.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-02T10:57:01.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-02T10:57:01.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-02T10:57:01.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-02T10:57:01.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-02T10:57:01.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-02T10:57:01.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-02T10:57:01.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-02T10:57:01.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-02T10:57:01.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-02T10:57:01.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-02T10:57:01.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-02T10:57:01.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-02T10:57:01.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-02T10:57:01.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-02T10:57:01.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-02T10:57:01.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-02T10:57:01.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-02T10:57:01.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-02T10:57:01.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-02T10:57:01.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-02T10:57:01.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-02T10:57:01.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-02T10:57:01.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-02T10:57:01.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: Manager daemon x is now available 2023-03-02T10:57:01.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:57:01.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:57:01.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-02T10:57:01.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-02T10:57:01.958 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-02T10:57:01.958 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-02T10:57:02.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.093+0000 7f02a19ff700 1 -- 172.21.15.57:0/1769316508 --> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f029c0613e0 con 0x7f028409b2e0 2023-03-02T10:57:02.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.143+0000 7f02a09fd700 1 -- 172.21.15.57:0/1769316508 <== mgr.25273 v2:172.21.15.57:6800/1603975717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f029c0613e0 con 0x7f028409b2e0 2023-03-02T10:57:02.145 INFO:teuthology.orchestra.run.smithi057.stdout:Retention added to path / 2023-03-02T10:57:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 -- 172.21.15.57:0/1769316508 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f028409b2e0 msgr2=0x7f028409d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f028409b2e0 0x7f028409d790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0290009c60 tx=0x7f0290009260 comp rx=0 tx=0).stop 2023-03-02T10:57:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 -- 172.21.15.57:0/1769316508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c068630 msgr2=0x7f029c0fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c068630 0x7f029c0fffd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f028c004710 tx=0x7f028c009580 comp rx=0 tx=0).stop 2023-03-02T10:57:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 -- 172.21.15.57:0/1769316508 shutdown_connections 2023-03-02T10:57:02.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f028409b2e0 0x7f028409d790 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f029c1056a0 0x7f029c0feb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029c068630 0x7f029c0fffd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 --2- 172.21.15.57:0/1769316508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c102bb0 0x7f029c0fe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 -- 172.21.15.57:0/1769316508 >> 172.21.15.57:0/1769316508 conn(0x7f029c0f9fa0 msgr2=0x7f029c100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:02.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 -- 172.21.15.57:0/1769316508 shutdown_connections 2023-03-02T10:57:02.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.146+0000 7f02a19ff700 1 -- 172.21.15.57:0/1769316508 wait complete. 2023-03-02T10:57:02.166 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-03-02T10:57:02.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.327+0000 7f7a3edff700 1 -- 172.21.15.57:0/4175962023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a38068650 msgr2=0x7f7a38102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:02.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.327+0000 7f7a3edff700 1 --2- 172.21.15.57:0/4175962023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a38068650 0x7f7a38102650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009990 tx=0x7f7a2c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.327+0000 7f7a3edff700 1 -- 172.21.15.57:0/4175962023 shutdown_connections 2023-03-02T10:57:02.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.327+0000 7f7a3edff700 1 --2- 172.21.15.57:0/4175962023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a381056a0 0x7f7a38107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.327+0000 7f7a3edff700 1 --2- 172.21.15.57:0/4175962023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a38068650 0x7f7a38102650 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.327+0000 7f7a3edff700 1 --2- 172.21.15.57:0/4175962023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a38102b90 0x7f7a38105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.327+0000 7f7a3edff700 1 -- 172.21.15.57:0/4175962023 >> 172.21.15.57:0/4175962023 conn(0x7f7a380f9fa0 msgr2=0x7f7a380fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:02.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.327+0000 7f7a3edff700 1 -- 172.21.15.57:0/4175962023 shutdown_connections 2023-03-02T10:57:02.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.327+0000 7f7a3edff700 1 -- 172.21.15.57:0/4175962023 wait complete. 2023-03-02T10:57:02.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3edff700 1 Processor -- start 2023-03-02T10:57:02.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3edff700 1 -- start start 2023-03-02T10:57:02.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3edff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a38068650 0x7f7a380fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:02.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3edff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a38102b90 0x7f7a380fe5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3edff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a381056a0 0x7f7a380feb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3edff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380ff2d0 con 0x7f7a38068650 2023-03-02T10:57:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3edff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380ff440 con 0x7f7a381056a0 2023-03-02T10:57:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3edff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3819f8b0 con 0x7f7a38102b90 2023-03-02T10:57:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a38068650 0x7f7a380fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a38068650 0x7f7a380fffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55484/0 (socket says 172.21.15.57:55484) 2023-03-02T10:57:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3cb9b700 1 -- 172.21.15.57:0/3904759176 learned_addr learned my addr 172.21.15.57:0/3904759176 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a3d39c700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a381056a0 0x7f7a380feb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.328+0000 7f7a37fff700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a38102b90 0x7f7a380fe5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.329+0000 7f7a3cb9b700 1 -- 172.21.15.57:0/3904759176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a38102b90 msgr2=0x7f7a380fe5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.329+0000 7f7a3cb9b700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a38102b90 0x7f7a380fe5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.329+0000 7f7a3cb9b700 1 -- 172.21.15.57:0/3904759176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a381056a0 msgr2=0x7f7a380feb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.329+0000 7f7a3cb9b700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a381056a0 0x7f7a380feb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.329+0000 7f7a3cb9b700 1 -- 172.21.15.57:0/3904759176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c0095f0 con 0x7f7a38068650 2023-03-02T10:57:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.329+0000 7f7a3cb9b700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a38068650 0x7f7a380fffb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c000c00 tx=0x7f7a2c005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.329+0000 7f7a35ffb700 1 -- 172.21.15.57:0/3904759176 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c01d070 con 0x7f7a38068650 2023-03-02T10:57:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.329+0000 7f7a3edff700 1 -- 172.21.15.57:0/3904759176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3810b420 con 0x7f7a38068650 2023-03-02T10:57:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.329+0000 7f7a35ffb700 1 -- 172.21.15.57:0/3904759176 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a2c022470 con 0x7f7a38068650 2023-03-02T10:57:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.329+0000 7f7a35ffb700 1 -- 172.21.15.57:0/3904759176 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c017650 con 0x7f7a38068650 2023-03-02T10:57:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.329+0000 7f7a3edff700 1 -- 172.21.15.57:0/3904759176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3810b290 con 0x7f7a38068650 2023-03-02T10:57:02.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.331+0000 7f7a3edff700 1 -- 172.21.15.57:0/3904759176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a380fbb10 con 0x7f7a38068650 2023-03-02T10:57:02.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.333+0000 7f7a35ffb700 1 -- 172.21.15.57:0/3904759176 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 22) v1 ==== 129711+0+0 (secure 0 0 0) 0x7f7a2c029030 con 0x7f7a38068650 2023-03-02T10:57:02.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.335+0000 7f7a35ffb700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7a2809b260 0x7f7a2809d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:02.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.335+0000 7f7a35ffb700 1 -- 172.21.15.57:0/3904759176 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7a2c0c64f0 con 0x7f7a38068650 2023-03-02T10:57:02.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.335+0000 7f7a37fff700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7a2809b260 0x7f7a2809d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:02.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.335+0000 7f7a37fff700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7a2809b260 0x7f7a2809d710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7a24007c60 tx=0x7f7a240073d0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:02.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.337+0000 7f7a35ffb700 1 -- 172.21.15.57:0/3904759176 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f7a2c091e90 con 0x7f7a38068650 2023-03-02T10:57:02.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.574+0000 7f7a3edff700 1 -- 172.21.15.57:0/3904759176 --> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a38061600 con 0x7f7a2809b260 2023-03-02T10:57:02.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.581+0000 7f7a35ffb700 1 -- 172.21.15.57:0/3904759176 <== mgr.25273 v2:172.21.15.57:6800/1603975717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7f7a38061600 con 0x7f7a2809b260 2023-03-02T10:57:02.582 INFO:teuthology.orchestra.run.smithi057.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-03-02T00:00:00", "created": "2023-03-02T10:57:01", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-03-02T10:57:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 -- 172.21.15.57:0/3904759176 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7a2809b260 msgr2=0x7f7a2809d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7a2809b260 0x7f7a2809d710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7a24007c60 tx=0x7f7a240073d0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 -- 172.21.15.57:0/3904759176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a38068650 msgr2=0x7f7a380fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a38068650 0x7f7a380fffb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c000c00 tx=0x7f7a2c005720 comp rx=0 tx=0).stop 2023-03-02T10:57:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 -- 172.21.15.57:0/3904759176 shutdown_connections 2023-03-02T10:57:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7a2809b260 0x7f7a2809d710 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a381056a0 0x7f7a380feb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a38068650 0x7f7a380fffb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 --2- 172.21.15.57:0/3904759176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a38102b90 0x7f7a380fe5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 -- 172.21.15.57:0/3904759176 >> 172.21.15.57:0/3904759176 conn(0x7f7a380f9fa0 msgr2=0x7f7a38100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 -- 172.21.15.57:0/3904759176 shutdown_connections 2023-03-02T10:57:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.584+0000 7f7a3edff700 1 -- 172.21.15.57:0/3904759176 wait complete. 2023-03-02T10:57:02.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-03-02T10:57:02.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.769+0000 7f7392dff700 1 -- 172.21.15.57:0/866982795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f738c1056a0 msgr2=0x7f738c107b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:02.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.769+0000 7f7392dff700 1 --2- 172.21.15.57:0/866982795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f738c1056a0 0x7f738c107b50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f738400b0a0 tx=0x7f738400b3b0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.769+0000 7f7392dff700 1 -- 172.21.15.57:0/866982795 shutdown_connections 2023-03-02T10:57:02.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.769+0000 7f7392dff700 1 --2- 172.21.15.57:0/866982795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f738c1056a0 0x7f738c107b50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.769+0000 7f7392dff700 1 --2- 172.21.15.57:0/866982795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c068650 0x7f738c102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.769+0000 7f7392dff700 1 --2- 172.21.15.57:0/866982795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f738c102b90 0x7f738c105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.769+0000 7f7392dff700 1 -- 172.21.15.57:0/866982795 >> 172.21.15.57:0/866982795 conn(0x7f738c0f9fa0 msgr2=0x7f738c0fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:02.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.769+0000 7f7392dff700 1 -- 172.21.15.57:0/866982795 shutdown_connections 2023-03-02T10:57:02.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.769+0000 7f7392dff700 1 -- 172.21.15.57:0/866982795 wait complete. 2023-03-02T10:57:02.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.770+0000 7f7392dff700 1 Processor -- start 2023-03-02T10:57:02.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.770+0000 7f7392dff700 1 -- start start 2023-03-02T10:57:02.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.770+0000 7f7392dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f738c068650 0x7f738c0fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:02.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.770+0000 7f7392dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c102b90 0x7f738c0fe5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:02.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.770+0000 7f7392dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f738c1056a0 0x7f738c0feb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:02.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.770+0000 7f7392dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0ff2d0 con 0x7f738c068650 2023-03-02T10:57:02.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.770+0000 7f7392dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0ff440 con 0x7f738c102b90 2023-03-02T10:57:02.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.770+0000 7f7392dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c19f9e0 con 0x7f738c1056a0 2023-03-02T10:57:02.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.770+0000 7f7390b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f738c068650 0x7f738c0fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:02.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.770+0000 7f7390b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f738c068650 0x7f738c0fffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55502/0 (socket says 172.21.15.57:55502) 2023-03-02T10:57:02.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f739139c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f738c1056a0 0x7f738c0feb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f738bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c102b90 0x7f738c0fe5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f7390b9b700 1 -- 172.21.15.57:0/3002010605 learned_addr learned my addr 172.21.15.57:0/3002010605 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f738bfff700 1 -- 172.21.15.57:0/3002010605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f738c1056a0 msgr2=0x7f738c0feb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f738bfff700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f738c1056a0 0x7f738c0feb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f738bfff700 1 -- 172.21.15.57:0/3002010605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f738c068650 msgr2=0x7f738c0fffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f738bfff700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f738c068650 0x7f738c0fffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f738bfff700 1 -- 172.21.15.57:0/3002010605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7384009d00 con 0x7f738c102b90 2023-03-02T10:57:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f7390b9b700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f738c068650 0x7f738c0fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f738bfff700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c102b90 0x7f738c0fe5f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f737800e9f0 tx=0x7f737800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f7389ffb700 1 -- 172.21.15.57:0/3002010605 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737800c9c0 con 0x7f738c102b90 2023-03-02T10:57:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f7392dff700 1 -- 172.21.15.57:0/3002010605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c10b440 con 0x7f738c102b90 2023-03-02T10:57:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f7389ffb700 1 -- 172.21.15.57:0/3002010605 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7378010430 con 0x7f738c102b90 2023-03-02T10:57:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f7389ffb700 1 -- 172.21.15.57:0/3002010605 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7378018680 con 0x7f738c102b90 2023-03-02T10:57:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.771+0000 7f7392dff700 1 -- 172.21.15.57:0/3002010605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c10b2b0 con 0x7f738c102b90 2023-03-02T10:57:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.772+0000 7f7392dff700 1 -- 172.21.15.57:0/3002010605 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c0fbb10 con 0x7f738c102b90 2023-03-02T10:57:02.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.774+0000 7f7389ffb700 1 -- 172.21.15.57:0/3002010605 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f737800c040 con 0x7f738c102b90 2023-03-02T10:57:02.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.775+0000 7f7389ffb700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f737c09b4c0 0x7f737c09d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:02.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.775+0000 7f7389ffb700 1 -- 172.21.15.57:0/3002010605 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7378014070 con 0x7f738c102b90 2023-03-02T10:57:02.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.775+0000 7f7390b9b700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f737c09b4c0 0x7f737c09d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:02.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.775+0000 7f7390b9b700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f737c09b4c0 0x7f737c09d970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7380005950 tx=0x7f7380009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:02.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:02.777+0000 7f7389ffb700 1 -- 172.21.15.57:0/3002010605 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f7378090c20 con 0x7f738c102b90 2023-03-02T10:57:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:02 smithi057 ceph-mon[92072]: mgrmap e22: x(active, since 1.77022s), standbys: y, z 2023-03-02T10:57:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:02 smithi057 ceph-mon[92072]: [02/Mar/2023:10:57:02] ENGINE Bus STARTING 2023-03-02T10:57:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:02 smithi122 ceph-mon[125440]: mgrmap e22: x(active, since 1.77022s), standbys: y, z 2023-03-02T10:57:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:02 smithi122 ceph-mon[125440]: [02/Mar/2023:10:57:02] ENGINE Bus STARTING 2023-03-02T10:57:03.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.018+0000 7f7392dff700 1 -- 172.21.15.57:0/3002010605 --> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f738c0615c0 con 0x7f737c09b4c0 2023-03-02T10:57:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.025+0000 7f7389ffb700 1 -- 172.21.15.57:0/3002010605 <== mgr.25273 v2:172.21.15.57:6800/1603975717 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f738c0615c0 con 0x7f737c09b4c0 2023-03-02T10:57:03.026 INFO:teuthology.orchestra.run.smithi057.stdout:/ 1M 6M3h 2023-03-02T10:57:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.027+0000 7f7392dff700 1 -- 172.21.15.57:0/3002010605 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f737c09b4c0 msgr2=0x7f737c09d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.027+0000 7f7392dff700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f737c09b4c0 0x7f737c09d970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7380005950 tx=0x7f7380009260 comp rx=0 tx=0).stop 2023-03-02T10:57:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.027+0000 7f7392dff700 1 -- 172.21.15.57:0/3002010605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c102b90 msgr2=0x7f738c0fe5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.027+0000 7f7392dff700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c102b90 0x7f738c0fe5f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f737800e9f0 tx=0x7f737800ed00 comp rx=0 tx=0).stop 2023-03-02T10:57:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.027+0000 7f7392dff700 1 -- 172.21.15.57:0/3002010605 shutdown_connections 2023-03-02T10:57:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.027+0000 7f7392dff700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f737c09b4c0 0x7f737c09d970 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.027+0000 7f7392dff700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f738c1056a0 0x7f738c0feb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.027+0000 7f7392dff700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f738c068650 0x7f738c0fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.027+0000 7f7392dff700 1 --2- 172.21.15.57:0/3002010605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c102b90 0x7f738c0fe5f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.027+0000 7f7392dff700 1 -- 172.21.15.57:0/3002010605 >> 172.21.15.57:0/3002010605 conn(0x7f738c0f9fa0 msgr2=0x7f738c100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.027+0000 7f7392dff700 1 -- 172.21.15.57:0/3002010605 shutdown_connections 2023-03-02T10:57:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:03.028+0000 7f7392dff700 1 -- 172.21.15.57:0/3002010605 wait complete. 2023-03-02T10:57:03.043 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-03-02T10:57:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:02 smithi136 ceph-mon[125702]: mgrmap e22: x(active, since 1.77022s), standbys: y, z 2023-03-02T10:57:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:02 smithi136 ceph-mon[125702]: [02/Mar/2023:10:57:02] ENGINE Bus STARTING 2023-03-02T10:57:03.102 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-03-02T10:57:03.112 INFO:teuthology.run_tasks:Running task background_exec... 2023-03-02T10:57:03.143 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi057.front.sepia.ceph.com 2023-03-02T10:57:03.144 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-03-02T10:57:03.146 INFO:teuthology.run_tasks:Running task exec... 2023-03-02T10:57:03.197 INFO:teuthology.task.exec:Executing custom commands... 2023-03-02T10:57:03.197 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi057.front.sepia.ceph.com 2023-03-02T10:57:03.198 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-03-02T10:57:03.257 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:03.282 INFO:teuthology.orchestra.run.smithi057.stdout:Filesystem Size Used Avail Use% Mounted on 2023-03-02T10:57:03.282 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:3300,172.21.15.122:3300,172.21.15.136:3300:/volumes/_nogroup/sv_1/d0d9fb7b-a0b0-4a2e-aa06-576c9b7d593e 340G 0 340G 0% /tmp/cephfs 2023-03-02T10:57:03.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-03-02T10:57:03.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-03-02T10:57:03.439 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-03-02T10:57:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:03 smithi057 ceph-mon[92072]: [02/Mar/2023:10:57:02] ENGINE Serving on https://172.21.15.57:7150 2023-03-02T10:57:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:03 smithi057 ceph-mon[92072]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:57:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:03 smithi057 ceph-mon[92072]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:57:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:03 smithi057 ceph-mon[92072]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-03-02T10:57:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:03 smithi057 ceph-mon[92072]: [02/Mar/2023:10:57:02] ENGINE Serving on https://172.21.15.57:8765 2023-03-02T10:57:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:03 smithi057 ceph-mon[92072]: [02/Mar/2023:10:57:02] ENGINE Bus STARTED 2023-03-02T10:57:03.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:03 smithi057 ceph-mon[92072]: from='client.25397 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:57:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:03 smithi122 ceph-mon[125440]: [02/Mar/2023:10:57:02] ENGINE Serving on https://172.21.15.57:7150 2023-03-02T10:57:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:03 smithi122 ceph-mon[125440]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:57:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:03 smithi122 ceph-mon[125440]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:57:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:03 smithi122 ceph-mon[125440]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-03-02T10:57:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:03 smithi122 ceph-mon[125440]: [02/Mar/2023:10:57:02] ENGINE Serving on https://172.21.15.57:8765 2023-03-02T10:57:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:03 smithi122 ceph-mon[125440]: [02/Mar/2023:10:57:02] ENGINE Bus STARTED 2023-03-02T10:57:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:03 smithi122 ceph-mon[125440]: from='client.25397 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:57:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:03 smithi136 ceph-mon[125702]: [02/Mar/2023:10:57:02] ENGINE Serving on https://172.21.15.57:7150 2023-03-02T10:57:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:03 smithi136 ceph-mon[125702]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:57:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:03 smithi136 ceph-mon[125702]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:57:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:03 smithi136 ceph-mon[125702]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-03-02T10:57:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:03 smithi136 ceph-mon[125702]: [02/Mar/2023:10:57:02] ENGINE Serving on https://172.21.15.57:8765 2023-03-02T10:57:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:03 smithi136 ceph-mon[125702]: [02/Mar/2023:10:57:02] ENGINE Bus STARTED 2023-03-02T10:57:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:03 smithi136 ceph-mon[125702]: from='client.25397 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-02T10:57:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:04.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:57:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T10:57:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T10:57:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T10:57:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T10:57:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T10:57:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T10:57:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:57:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:57:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: Updating smithi057:/etc/ceph/ceph.conf 2023-03-02T10:57:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: Updating smithi122:/etc/ceph/ceph.conf 2023-03-02T10:57:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:05 smithi122 ceph-mon[125440]: Updating smithi136:/etc/ceph/ceph.conf 2023-03-02T10:57:05.972 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:57:05.972 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T10:57:05.972 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T10:57:05.972 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.972 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.972 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.973 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.973 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.973 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.973 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.973 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.973 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.973 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.974 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T10:57:05.974 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T10:57:05.974 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.974 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:05.974 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.974 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.974 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.975 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.975 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.975 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.975 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.975 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:05.976 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T10:57:05.976 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T10:57:05.976 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:57:05.976 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:57:05.976 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: Updating smithi057:/etc/ceph/ceph.conf 2023-03-02T10:57:05.976 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: Updating smithi122:/etc/ceph/ceph.conf 2023-03-02T10:57:05.976 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:05 smithi057 ceph-mon[92072]: Updating smithi136:/etc/ceph/ceph.conf 2023-03-02T10:57:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:57:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T10:57:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T10:57:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T10:57:06.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T10:57:06.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:06.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T10:57:06.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T10:57:06.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T10:57:06.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:57:06.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:57:06.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: Updating smithi057:/etc/ceph/ceph.conf 2023-03-02T10:57:06.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: Updating smithi122:/etc/ceph/ceph.conf 2023-03-02T10:57:06.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:05 smithi136 ceph-mon[125702]: Updating smithi136:/etc/ceph/ceph.conf 2023-03-02T10:57:06.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-03-02T10:57:06.579 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-03-02T10:57:06.583 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-03-02T10:57:06.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-03-02T10:57:06.711 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/: 2023-03-02T10:57:06.711 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:06.711 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 . 2023-03-02T10:57:06.711 INFO:teuthology.orchestra.run.smithi057.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 .. 2023-03-02T10:57:06.711 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 data 2023-03-02T10:57:06.712 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:06.712 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data: 2023-03-02T10:57:06.712 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:06.712 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:06.712 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 .. 2023-03-02T10:57:06.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-03-02T10:57:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:[Service] 2023-03-02T10:57:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-03-02T10:57:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-03-02T10:57:06.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-03-02T10:57:06.930 INFO:teuthology.orchestra.run.smithi057.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-03-02T10:57:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:57:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: Updating smithi122:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:57:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: Updating smithi057:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:57:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:57:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:57:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:57:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:57:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: Updating smithi122:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:57:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: Updating smithi057:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:57:07.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:57:07.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:57:07.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:57:07.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:57:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: Updating smithi122:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:57:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: Updating smithi057:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:57:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:57:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:57:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:57:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:57:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: Updating smithi122:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:57:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: Updating smithi057:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:57:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:57:07.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:57:07.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:57:07.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:57:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: Updating smithi122:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:57:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: Updating smithi057:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.conf 2023-03-02T10:57:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:57:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:57:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: Updating smithi136:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:57:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2023-03-02T10:57:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: Updating smithi122:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:57:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: Updating smithi057:/var/lib/ceph/886f029e-b8e7-11ed-9ae9-001a4aab830c/config/ceph.client.admin.keyring 2023-03-02T10:57:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:07.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:57:07.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:57:07.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:57:07.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:57:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:08 smithi057 ceph-mon[92072]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:57:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:08 smithi122 ceph-mon[125440]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:57:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:08 smithi136 ceph-mon[125702]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-02T10:57:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:09 smithi136 ceph-mon[125702]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 134 KiB/s wr, 55 op/s 2023-03-02T10:57:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:09 smithi057 ceph-mon[92072]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 134 KiB/s wr, 55 op/s 2023-03-02T10:57:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:09 smithi122 ceph-mon[125440]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 134 KiB/s wr, 55 op/s 2023-03-02T10:57:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:11 smithi057 ceph-mon[92072]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 104 KiB/s wr, 43 op/s 2023-03-02T10:57:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:11 smithi122 ceph-mon[125440]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 104 KiB/s wr, 43 op/s 2023-03-02T10:57:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:11 smithi136 ceph-mon[125702]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 104 KiB/s wr, 43 op/s 2023-03-02T10:57:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:13 smithi057 ceph-mon[92072]: pgmap v9: 97 pgs: 97 active+clean; 31 MiB data, 104 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 2.8 MiB/s wr, 84 op/s 2023-03-02T10:57:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:13 smithi122 ceph-mon[125440]: pgmap v9: 97 pgs: 97 active+clean; 31 MiB data, 104 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 2.8 MiB/s wr, 84 op/s 2023-03-02T10:57:14.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:13 smithi136 ceph-mon[125702]: pgmap v9: 97 pgs: 97 active+clean; 31 MiB data, 104 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 2.8 MiB/s wr, 84 op/s 2023-03-02T10:57:14.446 INFO:teuthology.orchestra.run.smithi057.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-03-02T10:57:14.450 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-03-02T10:57:14.518 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/: 2023-03-02T10:57:14.519 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.519 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 . 2023-03-02T10:57:14.519 INFO:teuthology.orchestra.run.smithi057.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 .. 2023-03-02T10:57:14.519 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 data 2023-03-02T10:57:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.519 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data: 2023-03-02T10:57:14.520 INFO:teuthology.orchestra.run.smithi057.stdout:total 30 2023-03-02T10:57:14.520 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 . 2023-03-02T10:57:14.520 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 .. 2023-03-02T10:57:14.520 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 base 2023-03-02T10:57:14.520 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Mar 2 10:57 global 2023-03-02T10:57:14.520 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 log 2023-03-02T10:57:14.520 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 pg_commit_ts 2023-03-02T10:57:14.520 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 pg_dynshmem 2023-03-02T10:57:14.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Mar 2 10:57 pg_hba.conf 2023-03-02T10:57:14.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Mar 2 10:57 pg_ident.conf 2023-03-02T10:57:14.521 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 pg_logical 2023-03-02T10:57:14.521 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Mar 2 10:57 pg_multixact 2023-03-02T10:57:14.521 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 pg_notify 2023-03-02T10:57:14.521 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 pg_replslot 2023-03-02T10:57:14.521 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 pg_serial 2023-03-02T10:57:14.522 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 pg_snapshots 2023-03-02T10:57:14.522 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 pg_stat 2023-03-02T10:57:14.522 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 pg_stat_tmp 2023-03-02T10:57:14.522 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 pg_subtrans 2023-03-02T10:57:14.522 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 pg_tblspc 2023-03-02T10:57:14.522 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 pg_twophase 2023-03-02T10:57:14.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 PG_VERSION 2023-03-02T10:57:14.522 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Mar 2 10:57 pg_wal 2023-03-02T10:57:14.523 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 pg_xact 2023-03-02T10:57:14.523 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Mar 2 10:57 postgresql.auto.conf 2023-03-02T10:57:14.523 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Mar 2 10:57 postgresql.conf 2023-03-02T10:57:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.523 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/base: 2023-03-02T10:57:14.523 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.523 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 . 2023-03-02T10:57:14.523 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.524 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Mar 2 10:57 1 2023-03-02T10:57:14.524 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Mar 2 10:57 12346 2023-03-02T10:57:14.524 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Mar 2 10:57 12347 2023-03-02T10:57:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.524 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/base/1: 2023-03-02T10:57:14.524 INFO:teuthology.orchestra.run.smithi057.stdout:total 7217 2023-03-02T10:57:14.524 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Mar 2 10:57 . 2023-03-02T10:57:14.524 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 .. 2023-03-02T10:57:14.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 112 2023-03-02T10:57:14.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 113 2023-03-02T10:57:14.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Mar 2 10:57 12182 2023-03-02T10:57:14.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12182_fsm 2023-03-02T10:57:14.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12182_vm 2023-03-02T10:57:14.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12184 2023-03-02T10:57:14.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12186 2023-03-02T10:57:14.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12187 2023-03-02T10:57:14.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12187_fsm 2023-03-02T10:57:14.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12187_vm 2023-03-02T10:57:14.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12189 2023-03-02T10:57:14.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12191 2023-03-02T10:57:14.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12192 2023-03-02T10:57:14.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12192_fsm 2023-03-02T10:57:14.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12192_vm 2023-03-02T10:57:14.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12194 2023-03-02T10:57:14.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12196 2023-03-02T10:57:14.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12197 2023-03-02T10:57:14.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12197_fsm 2023-03-02T10:57:14.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12197_vm 2023-03-02T10:57:14.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12199 2023-03-02T10:57:14.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12201 2023-03-02T10:57:14.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12202 2023-03-02T10:57:14.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12202_fsm 2023-03-02T10:57:14.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12202_vm 2023-03-02T10:57:14.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12204 2023-03-02T10:57:14.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12206 2023-03-02T10:57:14.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12207 2023-03-02T10:57:14.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12207_fsm 2023-03-02T10:57:14.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12207_vm 2023-03-02T10:57:14.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12209 2023-03-02T10:57:14.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12211 2023-03-02T10:57:14.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12212 2023-03-02T10:57:14.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12214 2023-03-02T10:57:14.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12216 2023-03-02T10:57:14.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Mar 2 10:57 1247 2023-03-02T10:57:14.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1247_fsm 2023-03-02T10:57:14.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1247_vm 2023-03-02T10:57:14.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Mar 2 10:57 1249 2023-03-02T10:57:14.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1249_fsm 2023-03-02T10:57:14.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1249_vm 2023-03-02T10:57:14.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Mar 2 10:57 1255 2023-03-02T10:57:14.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1255_fsm 2023-03-02T10:57:14.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1255_vm 2023-03-02T10:57:14.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Mar 2 10:57 1259 2023-03-02T10:57:14.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1259_fsm 2023-03-02T10:57:14.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1259_vm 2023-03-02T10:57:14.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1417 2023-03-02T10:57:14.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1417_vm 2023-03-02T10:57:14.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1418 2023-03-02T10:57:14.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1418_vm 2023-03-02T10:57:14.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 174 2023-03-02T10:57:14.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 175 2023-03-02T10:57:14.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2187 2023-03-02T10:57:14.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2224 2023-03-02T10:57:14.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2224_vm 2023-03-02T10:57:14.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2328 2023-03-02T10:57:14.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2328_vm 2023-03-02T10:57:14.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2336 2023-03-02T10:57:14.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2336_vm 2023-03-02T10:57:14.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2337 2023-03-02T10:57:14.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2600 2023-03-02T10:57:14.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2600_fsm 2023-03-02T10:57:14.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2600_vm 2023-03-02T10:57:14.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2601 2023-03-02T10:57:14.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2601_fsm 2023-03-02T10:57:14.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2601_vm 2023-03-02T10:57:14.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Mar 2 10:57 2602 2023-03-02T10:57:14.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2602_fsm 2023-03-02T10:57:14.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2602_vm 2023-03-02T10:57:14.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2603 2023-03-02T10:57:14.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2603_fsm 2023-03-02T10:57:14.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2603_vm 2023-03-02T10:57:14.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2604 2023-03-02T10:57:14.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2604_vm 2023-03-02T10:57:14.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2605 2023-03-02T10:57:14.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2605_fsm 2023-03-02T10:57:14.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2605_vm 2023-03-02T10:57:14.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2606 2023-03-02T10:57:14.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2606_fsm 2023-03-02T10:57:14.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2606_vm 2023-03-02T10:57:14.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2607 2023-03-02T10:57:14.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2607_fsm 2023-03-02T10:57:14.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2607_vm 2023-03-02T10:57:14.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Mar 2 10:57 2608 2023-03-02T10:57:14.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2608_fsm 2023-03-02T10:57:14.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2608_vm 2023-03-02T10:57:14.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Mar 2 10:57 2609 2023-03-02T10:57:14.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2609_fsm 2023-03-02T10:57:14.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2609_vm 2023-03-02T10:57:14.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2610 2023-03-02T10:57:14.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2610_fsm 2023-03-02T10:57:14.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2610_vm 2023-03-02T10:57:14.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2611 2023-03-02T10:57:14.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2611_vm 2023-03-02T10:57:14.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2612 2023-03-02T10:57:14.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2612_fsm 2023-03-02T10:57:14.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2612_vm 2023-03-02T10:57:14.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2613 2023-03-02T10:57:14.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2613_vm 2023-03-02T10:57:14.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2615 2023-03-02T10:57:14.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2615_fsm 2023-03-02T10:57:14.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2615_vm 2023-03-02T10:57:14.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2616 2023-03-02T10:57:14.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2616_fsm 2023-03-02T10:57:14.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2616_vm 2023-03-02T10:57:14.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Mar 2 10:57 2617 2023-03-02T10:57:14.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2617_fsm 2023-03-02T10:57:14.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2617_vm 2023-03-02T10:57:14.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Mar 2 10:57 2618 2023-03-02T10:57:14.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2618_fsm 2023-03-02T10:57:14.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2618_vm 2023-03-02T10:57:14.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Mar 2 10:57 2619 2023-03-02T10:57:14.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2619_fsm 2023-03-02T10:57:14.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2619_vm 2023-03-02T10:57:14.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2620 2023-03-02T10:57:14.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2620_vm 2023-03-02T10:57:14.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2650 2023-03-02T10:57:14.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2651 2023-03-02T10:57:14.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2652 2023-03-02T10:57:14.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2653 2023-03-02T10:57:14.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2654 2023-03-02T10:57:14.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2655 2023-03-02T10:57:14.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2656 2023-03-02T10:57:14.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2657 2023-03-02T10:57:14.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Mar 2 10:57 2658 2023-03-02T10:57:14.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Mar 2 10:57 2659 2023-03-02T10:57:14.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2660 2023-03-02T10:57:14.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2661 2023-03-02T10:57:14.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2662 2023-03-02T10:57:14.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Mar 2 10:57 2663 2023-03-02T10:57:14.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2664 2023-03-02T10:57:14.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2665 2023-03-02T10:57:14.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2666 2023-03-02T10:57:14.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2667 2023-03-02T10:57:14.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2668 2023-03-02T10:57:14.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2669 2023-03-02T10:57:14.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2670 2023-03-02T10:57:14.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Mar 2 10:57 2673 2023-03-02T10:57:14.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Mar 2 10:57 2674 2023-03-02T10:57:14.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Mar 2 10:57 2675 2023-03-02T10:57:14.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2678 2023-03-02T10:57:14.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2679 2023-03-02T10:57:14.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2680 2023-03-02T10:57:14.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2681 2023-03-02T10:57:14.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2682 2023-03-02T10:57:14.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2683 2023-03-02T10:57:14.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2684 2023-03-02T10:57:14.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2685 2023-03-02T10:57:14.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2686 2023-03-02T10:57:14.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2687 2023-03-02T10:57:14.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2688 2023-03-02T10:57:14.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Mar 2 10:57 2689 2023-03-02T10:57:14.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Mar 2 10:57 2690 2023-03-02T10:57:14.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Mar 2 10:57 2691 2023-03-02T10:57:14.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2692 2023-03-02T10:57:14.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2693 2023-03-02T10:57:14.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2696 2023-03-02T10:57:14.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2699 2023-03-02T10:57:14.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2701 2023-03-02T10:57:14.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2702 2023-03-02T10:57:14.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2703 2023-03-02T10:57:14.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2704 2023-03-02T10:57:14.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2753 2023-03-02T10:57:14.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2753_fsm 2023-03-02T10:57:14.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2753_vm 2023-03-02T10:57:14.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2754 2023-03-02T10:57:14.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2755 2023-03-02T10:57:14.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2756 2023-03-02T10:57:14.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2757 2023-03-02T10:57:14.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2830 2023-03-02T10:57:14.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2830_vm 2023-03-02T10:57:14.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2831 2023-03-02T10:57:14.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2832 2023-03-02T10:57:14.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2832_vm 2023-03-02T10:57:14.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2833 2023-03-02T10:57:14.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2834 2023-03-02T10:57:14.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2834_vm 2023-03-02T10:57:14.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2835 2023-03-02T10:57:14.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2836 2023-03-02T10:57:14.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2836_vm 2023-03-02T10:57:14.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2837 2023-03-02T10:57:14.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Mar 2 10:57 2838 2023-03-02T10:57:14.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2838_fsm 2023-03-02T10:57:14.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2838_vm 2023-03-02T10:57:14.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2839 2023-03-02T10:57:14.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2840 2023-03-02T10:57:14.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2840_fsm 2023-03-02T10:57:14.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2840_vm 2023-03-02T10:57:14.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2841 2023-03-02T10:57:14.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2995 2023-03-02T10:57:14.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2995_vm 2023-03-02T10:57:14.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2996 2023-03-02T10:57:14.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3079 2023-03-02T10:57:14.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3079_fsm 2023-03-02T10:57:14.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3079_vm 2023-03-02T10:57:14.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3080 2023-03-02T10:57:14.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3081 2023-03-02T10:57:14.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3085 2023-03-02T10:57:14.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3118 2023-03-02T10:57:14.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3118_vm 2023-03-02T10:57:14.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3119 2023-03-02T10:57:14.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3164 2023-03-02T10:57:14.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3256 2023-03-02T10:57:14.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3256_vm 2023-03-02T10:57:14.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3257 2023-03-02T10:57:14.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3258 2023-03-02T10:57:14.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3350 2023-03-02T10:57:14.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3350_vm 2023-03-02T10:57:14.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3351 2023-03-02T10:57:14.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3379 2023-03-02T10:57:14.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3380 2023-03-02T10:57:14.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3381 2023-03-02T10:57:14.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3381_vm 2023-03-02T10:57:14.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3394 2023-03-02T10:57:14.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3394_fsm 2023-03-02T10:57:14.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3394_vm 2023-03-02T10:57:14.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3395 2023-03-02T10:57:14.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3439 2023-03-02T10:57:14.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3439_vm 2023-03-02T10:57:14.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3440 2023-03-02T10:57:14.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 3455 2023-03-02T10:57:14.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3456 2023-03-02T10:57:14.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3456_fsm 2023-03-02T10:57:14.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3456_vm 2023-03-02T10:57:14.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3466 2023-03-02T10:57:14.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3466_vm 2023-03-02T10:57:14.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3467 2023-03-02T10:57:14.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3468 2023-03-02T10:57:14.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3501 2023-03-02T10:57:14.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3501_vm 2023-03-02T10:57:14.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3502 2023-03-02T10:57:14.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3503 2023-03-02T10:57:14.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3534 2023-03-02T10:57:14.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3541 2023-03-02T10:57:14.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3541_fsm 2023-03-02T10:57:14.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3541_vm 2023-03-02T10:57:14.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3542 2023-03-02T10:57:14.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3574 2023-03-02T10:57:14.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3575 2023-03-02T10:57:14.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3576 2023-03-02T10:57:14.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3576_vm 2023-03-02T10:57:14.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3596 2023-03-02T10:57:14.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3596_vm 2023-03-02T10:57:14.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3597 2023-03-02T10:57:14.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3598 2023-03-02T10:57:14.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3598_vm 2023-03-02T10:57:14.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3599 2023-03-02T10:57:14.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3600 2023-03-02T10:57:14.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3600_fsm 2023-03-02T10:57:14.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3600_vm 2023-03-02T10:57:14.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3601 2023-03-02T10:57:14.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3601_fsm 2023-03-02T10:57:14.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3601_vm 2023-03-02T10:57:14.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3602 2023-03-02T10:57:14.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3602_fsm 2023-03-02T10:57:14.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3602_vm 2023-03-02T10:57:14.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3603 2023-03-02T10:57:14.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3603_fsm 2023-03-02T10:57:14.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3603_vm 2023-03-02T10:57:14.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3604 2023-03-02T10:57:14.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3605 2023-03-02T10:57:14.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3606 2023-03-02T10:57:14.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3607 2023-03-02T10:57:14.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3608 2023-03-02T10:57:14.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 3609 2023-03-02T10:57:14.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3712 2023-03-02T10:57:14.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3764 2023-03-02T10:57:14.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3764_fsm 2023-03-02T10:57:14.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3764_vm 2023-03-02T10:57:14.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3766 2023-03-02T10:57:14.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3767 2023-03-02T10:57:14.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3997 2023-03-02T10:57:14.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 5002 2023-03-02T10:57:14.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 548 2023-03-02T10:57:14.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 549 2023-03-02T10:57:14.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6102 2023-03-02T10:57:14.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6102_vm 2023-03-02T10:57:14.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6104 2023-03-02T10:57:14.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6104_vm 2023-03-02T10:57:14.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6106 2023-03-02T10:57:14.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6106_vm 2023-03-02T10:57:14.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6110 2023-03-02T10:57:14.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6111 2023-03-02T10:57:14.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6112 2023-03-02T10:57:14.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6113 2023-03-02T10:57:14.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6117 2023-03-02T10:57:14.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 826 2023-03-02T10:57:14.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 826_vm 2023-03-02T10:57:14.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 827 2023-03-02T10:57:14.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 828 2023-03-02T10:57:14.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Mar 2 10:57 pg_filenode.map 2023-03-02T10:57:14.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 PG_VERSION 2023-03-02T10:57:14.565 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.566 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-03-02T10:57:14.566 INFO:teuthology.orchestra.run.smithi057.stdout:total 7217 2023-03-02T10:57:14.566 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Mar 2 10:57 . 2023-03-02T10:57:14.566 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 .. 2023-03-02T10:57:14.566 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 112 2023-03-02T10:57:14.566 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 113 2023-03-02T10:57:14.566 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Mar 2 10:57 12182 2023-03-02T10:57:14.566 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12182_fsm 2023-03-02T10:57:14.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12182_vm 2023-03-02T10:57:14.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12184 2023-03-02T10:57:14.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12186 2023-03-02T10:57:14.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12187 2023-03-02T10:57:14.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12187_fsm 2023-03-02T10:57:14.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12187_vm 2023-03-02T10:57:14.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12189 2023-03-02T10:57:14.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12191 2023-03-02T10:57:14.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12192 2023-03-02T10:57:14.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12192_fsm 2023-03-02T10:57:14.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12192_vm 2023-03-02T10:57:14.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12194 2023-03-02T10:57:14.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12196 2023-03-02T10:57:14.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12197 2023-03-02T10:57:14.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12197_fsm 2023-03-02T10:57:14.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12197_vm 2023-03-02T10:57:14.569 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12199 2023-03-02T10:57:14.569 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12201 2023-03-02T10:57:14.569 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12202 2023-03-02T10:57:14.569 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12202_fsm 2023-03-02T10:57:14.569 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12202_vm 2023-03-02T10:57:14.569 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12204 2023-03-02T10:57:14.569 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12206 2023-03-02T10:57:14.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12207 2023-03-02T10:57:14.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12207_fsm 2023-03-02T10:57:14.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12207_vm 2023-03-02T10:57:14.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12209 2023-03-02T10:57:14.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12211 2023-03-02T10:57:14.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12212 2023-03-02T10:57:14.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12214 2023-03-02T10:57:14.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12216 2023-03-02T10:57:14.571 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Mar 2 10:57 1247 2023-03-02T10:57:14.571 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1247_fsm 2023-03-02T10:57:14.571 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1247_vm 2023-03-02T10:57:14.571 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Mar 2 10:57 1249 2023-03-02T10:57:14.571 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1249_fsm 2023-03-02T10:57:14.571 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1249_vm 2023-03-02T10:57:14.571 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Mar 2 10:57 1255 2023-03-02T10:57:14.571 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1255_fsm 2023-03-02T10:57:14.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1255_vm 2023-03-02T10:57:14.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Mar 2 10:57 1259 2023-03-02T10:57:14.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1259_fsm 2023-03-02T10:57:14.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1259_vm 2023-03-02T10:57:14.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1417 2023-03-02T10:57:14.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1417_vm 2023-03-02T10:57:14.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1418 2023-03-02T10:57:14.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1418_vm 2023-03-02T10:57:14.573 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 174 2023-03-02T10:57:14.573 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 175 2023-03-02T10:57:14.573 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2187 2023-03-02T10:57:14.573 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2224 2023-03-02T10:57:14.573 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2224_vm 2023-03-02T10:57:14.573 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2328 2023-03-02T10:57:14.573 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2328_vm 2023-03-02T10:57:14.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2336 2023-03-02T10:57:14.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2336_vm 2023-03-02T10:57:14.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2337 2023-03-02T10:57:14.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2600 2023-03-02T10:57:14.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2600_fsm 2023-03-02T10:57:14.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2600_vm 2023-03-02T10:57:14.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2601 2023-03-02T10:57:14.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2601_fsm 2023-03-02T10:57:14.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2601_vm 2023-03-02T10:57:14.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Mar 2 10:57 2602 2023-03-02T10:57:14.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2602_fsm 2023-03-02T10:57:14.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2602_vm 2023-03-02T10:57:14.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2603 2023-03-02T10:57:14.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2603_fsm 2023-03-02T10:57:14.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2603_vm 2023-03-02T10:57:14.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2604 2023-03-02T10:57:14.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2604_vm 2023-03-02T10:57:14.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2605 2023-03-02T10:57:14.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2605_fsm 2023-03-02T10:57:14.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2605_vm 2023-03-02T10:57:14.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2606 2023-03-02T10:57:14.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2606_fsm 2023-03-02T10:57:14.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2606_vm 2023-03-02T10:57:14.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2607 2023-03-02T10:57:14.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2607_fsm 2023-03-02T10:57:14.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2607_vm 2023-03-02T10:57:14.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Mar 2 10:57 2608 2023-03-02T10:57:14.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2608_fsm 2023-03-02T10:57:14.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2608_vm 2023-03-02T10:57:14.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Mar 2 10:57 2609 2023-03-02T10:57:14.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2609_fsm 2023-03-02T10:57:14.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2609_vm 2023-03-02T10:57:14.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2610 2023-03-02T10:57:14.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2610_fsm 2023-03-02T10:57:14.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2610_vm 2023-03-02T10:57:14.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2611 2023-03-02T10:57:14.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2611_vm 2023-03-02T10:57:14.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2612 2023-03-02T10:57:14.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2612_fsm 2023-03-02T10:57:14.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2612_vm 2023-03-02T10:57:14.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2613 2023-03-02T10:57:14.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2613_vm 2023-03-02T10:57:14.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2615 2023-03-02T10:57:14.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2615_fsm 2023-03-02T10:57:14.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2615_vm 2023-03-02T10:57:14.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2616 2023-03-02T10:57:14.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2616_fsm 2023-03-02T10:57:14.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2616_vm 2023-03-02T10:57:14.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Mar 2 10:57 2617 2023-03-02T10:57:14.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2617_fsm 2023-03-02T10:57:14.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2617_vm 2023-03-02T10:57:14.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Mar 2 10:57 2618 2023-03-02T10:57:14.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2618_fsm 2023-03-02T10:57:14.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2618_vm 2023-03-02T10:57:14.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Mar 2 10:57 2619 2023-03-02T10:57:14.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2619_fsm 2023-03-02T10:57:14.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2619_vm 2023-03-02T10:57:14.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2620 2023-03-02T10:57:14.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2620_vm 2023-03-02T10:57:14.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2650 2023-03-02T10:57:14.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2651 2023-03-02T10:57:14.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2652 2023-03-02T10:57:14.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2653 2023-03-02T10:57:14.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2654 2023-03-02T10:57:14.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2655 2023-03-02T10:57:14.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2656 2023-03-02T10:57:14.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2657 2023-03-02T10:57:14.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Mar 2 10:57 2658 2023-03-02T10:57:14.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Mar 2 10:57 2659 2023-03-02T10:57:14.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2660 2023-03-02T10:57:14.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2661 2023-03-02T10:57:14.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2662 2023-03-02T10:57:14.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Mar 2 10:57 2663 2023-03-02T10:57:14.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2664 2023-03-02T10:57:14.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2665 2023-03-02T10:57:14.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2666 2023-03-02T10:57:14.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2667 2023-03-02T10:57:14.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2668 2023-03-02T10:57:14.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2669 2023-03-02T10:57:14.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2670 2023-03-02T10:57:14.584 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Mar 2 10:57 2673 2023-03-02T10:57:14.584 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Mar 2 10:57 2674 2023-03-02T10:57:14.584 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Mar 2 10:57 2675 2023-03-02T10:57:14.584 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2678 2023-03-02T10:57:14.584 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2679 2023-03-02T10:57:14.584 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2680 2023-03-02T10:57:14.584 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2681 2023-03-02T10:57:14.584 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2682 2023-03-02T10:57:14.585 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2683 2023-03-02T10:57:14.585 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2684 2023-03-02T10:57:14.585 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2685 2023-03-02T10:57:14.585 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2686 2023-03-02T10:57:14.585 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2687 2023-03-02T10:57:14.585 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2688 2023-03-02T10:57:14.585 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Mar 2 10:57 2689 2023-03-02T10:57:14.586 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Mar 2 10:57 2690 2023-03-02T10:57:14.586 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Mar 2 10:57 2691 2023-03-02T10:57:14.586 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2692 2023-03-02T10:57:14.586 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2693 2023-03-02T10:57:14.586 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2696 2023-03-02T10:57:14.586 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2699 2023-03-02T10:57:14.586 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2701 2023-03-02T10:57:14.586 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2702 2023-03-02T10:57:14.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2703 2023-03-02T10:57:14.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2704 2023-03-02T10:57:14.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2753 2023-03-02T10:57:14.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2753_fsm 2023-03-02T10:57:14.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2753_vm 2023-03-02T10:57:14.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2754 2023-03-02T10:57:14.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2755 2023-03-02T10:57:14.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2756 2023-03-02T10:57:14.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2757 2023-03-02T10:57:14.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2830 2023-03-02T10:57:14.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2830_vm 2023-03-02T10:57:14.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2831 2023-03-02T10:57:14.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2832 2023-03-02T10:57:14.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2832_vm 2023-03-02T10:57:14.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2833 2023-03-02T10:57:14.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2834 2023-03-02T10:57:14.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2834_vm 2023-03-02T10:57:14.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2835 2023-03-02T10:57:14.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2836 2023-03-02T10:57:14.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2836_vm 2023-03-02T10:57:14.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2837 2023-03-02T10:57:14.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Mar 2 10:57 2838 2023-03-02T10:57:14.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2838_fsm 2023-03-02T10:57:14.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2838_vm 2023-03-02T10:57:14.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2839 2023-03-02T10:57:14.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2840 2023-03-02T10:57:14.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2840_fsm 2023-03-02T10:57:14.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2840_vm 2023-03-02T10:57:14.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2841 2023-03-02T10:57:14.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2995 2023-03-02T10:57:14.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2995_vm 2023-03-02T10:57:14.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2996 2023-03-02T10:57:14.591 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3079 2023-03-02T10:57:14.591 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3079_fsm 2023-03-02T10:57:14.591 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3079_vm 2023-03-02T10:57:14.591 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3080 2023-03-02T10:57:14.591 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3081 2023-03-02T10:57:14.591 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3085 2023-03-02T10:57:14.591 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3118 2023-03-02T10:57:14.591 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3118_vm 2023-03-02T10:57:14.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3119 2023-03-02T10:57:14.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3164 2023-03-02T10:57:14.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3256 2023-03-02T10:57:14.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3256_vm 2023-03-02T10:57:14.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3257 2023-03-02T10:57:14.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3258 2023-03-02T10:57:14.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3350 2023-03-02T10:57:14.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3350_vm 2023-03-02T10:57:14.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3351 2023-03-02T10:57:14.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3379 2023-03-02T10:57:14.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3380 2023-03-02T10:57:14.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3381 2023-03-02T10:57:14.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3381_vm 2023-03-02T10:57:14.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3394 2023-03-02T10:57:14.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3394_fsm 2023-03-02T10:57:14.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3394_vm 2023-03-02T10:57:14.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3395 2023-03-02T10:57:14.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3439 2023-03-02T10:57:14.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3439_vm 2023-03-02T10:57:14.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3440 2023-03-02T10:57:14.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 3455 2023-03-02T10:57:14.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3456 2023-03-02T10:57:14.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3456_fsm 2023-03-02T10:57:14.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3456_vm 2023-03-02T10:57:14.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3466 2023-03-02T10:57:14.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3466_vm 2023-03-02T10:57:14.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3467 2023-03-02T10:57:14.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3468 2023-03-02T10:57:14.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3501 2023-03-02T10:57:14.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3501_vm 2023-03-02T10:57:14.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3502 2023-03-02T10:57:14.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3503 2023-03-02T10:57:14.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3534 2023-03-02T10:57:14.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3541 2023-03-02T10:57:14.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3541_fsm 2023-03-02T10:57:14.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3541_vm 2023-03-02T10:57:14.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3542 2023-03-02T10:57:14.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3574 2023-03-02T10:57:14.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3575 2023-03-02T10:57:14.597 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3576 2023-03-02T10:57:14.597 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3576_vm 2023-03-02T10:57:14.597 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3596 2023-03-02T10:57:14.597 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3596_vm 2023-03-02T10:57:14.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3597 2023-03-02T10:57:14.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3598 2023-03-02T10:57:14.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3598_vm 2023-03-02T10:57:14.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3599 2023-03-02T10:57:14.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3600 2023-03-02T10:57:14.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3600_fsm 2023-03-02T10:57:14.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3600_vm 2023-03-02T10:57:14.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3601 2023-03-02T10:57:14.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3601_fsm 2023-03-02T10:57:14.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3601_vm 2023-03-02T10:57:14.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3602 2023-03-02T10:57:14.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3602_fsm 2023-03-02T10:57:14.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3602_vm 2023-03-02T10:57:14.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3603 2023-03-02T10:57:14.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3603_fsm 2023-03-02T10:57:14.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3603_vm 2023-03-02T10:57:14.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3604 2023-03-02T10:57:14.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3605 2023-03-02T10:57:14.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3606 2023-03-02T10:57:14.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3607 2023-03-02T10:57:14.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3608 2023-03-02T10:57:14.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 3609 2023-03-02T10:57:14.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3712 2023-03-02T10:57:14.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3764 2023-03-02T10:57:14.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3764_fsm 2023-03-02T10:57:14.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3764_vm 2023-03-02T10:57:14.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3766 2023-03-02T10:57:14.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3767 2023-03-02T10:57:14.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3997 2023-03-02T10:57:14.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 5002 2023-03-02T10:57:14.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 548 2023-03-02T10:57:14.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 549 2023-03-02T10:57:14.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6102 2023-03-02T10:57:14.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6102_vm 2023-03-02T10:57:14.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6104 2023-03-02T10:57:14.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6104_vm 2023-03-02T10:57:14.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6106 2023-03-02T10:57:14.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6106_vm 2023-03-02T10:57:14.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6110 2023-03-02T10:57:14.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6111 2023-03-02T10:57:14.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6112 2023-03-02T10:57:14.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6113 2023-03-02T10:57:14.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6117 2023-03-02T10:57:14.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 826 2023-03-02T10:57:14.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 826_vm 2023-03-02T10:57:14.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 827 2023-03-02T10:57:14.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 828 2023-03-02T10:57:14.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Mar 2 10:57 pg_filenode.map 2023-03-02T10:57:14.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 PG_VERSION 2023-03-02T10:57:14.605 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.605 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-03-02T10:57:14.605 INFO:teuthology.orchestra.run.smithi057.stdout:total 7217 2023-03-02T10:57:14.605 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Mar 2 10:57 . 2023-03-02T10:57:14.605 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 .. 2023-03-02T10:57:14.605 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 112 2023-03-02T10:57:14.605 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 113 2023-03-02T10:57:14.606 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Mar 2 10:57 12182 2023-03-02T10:57:14.606 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12182_fsm 2023-03-02T10:57:14.606 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12182_vm 2023-03-02T10:57:14.606 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12184 2023-03-02T10:57:14.606 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12186 2023-03-02T10:57:14.606 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12187 2023-03-02T10:57:14.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12187_fsm 2023-03-02T10:57:14.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12187_vm 2023-03-02T10:57:14.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12189 2023-03-02T10:57:14.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12191 2023-03-02T10:57:14.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12192 2023-03-02T10:57:14.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12192_fsm 2023-03-02T10:57:14.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12192_vm 2023-03-02T10:57:14.608 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12194 2023-03-02T10:57:14.608 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12196 2023-03-02T10:57:14.608 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12197 2023-03-02T10:57:14.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12197_fsm 2023-03-02T10:57:14.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12197_vm 2023-03-02T10:57:14.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12199 2023-03-02T10:57:14.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12201 2023-03-02T10:57:14.610 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12202 2023-03-02T10:57:14.610 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12202_fsm 2023-03-02T10:57:14.610 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12202_vm 2023-03-02T10:57:14.610 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12204 2023-03-02T10:57:14.611 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12206 2023-03-02T10:57:14.611 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12207 2023-03-02T10:57:14.611 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 12207_fsm 2023-03-02T10:57:14.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12207_vm 2023-03-02T10:57:14.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12209 2023-03-02T10:57:14.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12211 2023-03-02T10:57:14.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12212 2023-03-02T10:57:14.613 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 12214 2023-03-02T10:57:14.613 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 12216 2023-03-02T10:57:14.613 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Mar 2 10:57 1247 2023-03-02T10:57:14.613 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1247_fsm 2023-03-02T10:57:14.614 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1247_vm 2023-03-02T10:57:14.614 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Mar 2 10:57 1249 2023-03-02T10:57:14.614 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1249_fsm 2023-03-02T10:57:14.614 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1249_vm 2023-03-02T10:57:14.615 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Mar 2 10:57 1255 2023-03-02T10:57:14.615 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1255_fsm 2023-03-02T10:57:14.615 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1255_vm 2023-03-02T10:57:14.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Mar 2 10:57 1259 2023-03-02T10:57:14.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1259_fsm 2023-03-02T10:57:14.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1259_vm 2023-03-02T10:57:14.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1417 2023-03-02T10:57:14.617 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1417_vm 2023-03-02T10:57:14.617 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1418 2023-03-02T10:57:14.617 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 1418_vm 2023-03-02T10:57:14.617 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 174 2023-03-02T10:57:14.618 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 175 2023-03-02T10:57:14.618 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2187 2023-03-02T10:57:14.618 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2224 2023-03-02T10:57:14.619 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2224_vm 2023-03-02T10:57:14.619 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2328 2023-03-02T10:57:14.619 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2328_vm 2023-03-02T10:57:14.619 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2336 2023-03-02T10:57:14.620 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2336_vm 2023-03-02T10:57:14.620 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2337 2023-03-02T10:57:14.620 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2600 2023-03-02T10:57:14.620 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2600_fsm 2023-03-02T10:57:14.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2600_vm 2023-03-02T10:57:14.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2601 2023-03-02T10:57:14.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2601_fsm 2023-03-02T10:57:14.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2601_vm 2023-03-02T10:57:14.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Mar 2 10:57 2602 2023-03-02T10:57:14.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2602_fsm 2023-03-02T10:57:14.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2602_vm 2023-03-02T10:57:14.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2603 2023-03-02T10:57:14.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2603_fsm 2023-03-02T10:57:14.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2603_vm 2023-03-02T10:57:14.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2604 2023-03-02T10:57:14.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2604_vm 2023-03-02T10:57:14.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2605 2023-03-02T10:57:14.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2605_fsm 2023-03-02T10:57:14.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2605_vm 2023-03-02T10:57:14.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2606 2023-03-02T10:57:14.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2606_fsm 2023-03-02T10:57:14.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2606_vm 2023-03-02T10:57:14.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2607 2023-03-02T10:57:14.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2607_fsm 2023-03-02T10:57:14.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2607_vm 2023-03-02T10:57:14.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Mar 2 10:57 2608 2023-03-02T10:57:14.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2608_fsm 2023-03-02T10:57:14.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2608_vm 2023-03-02T10:57:14.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Mar 2 10:57 2609 2023-03-02T10:57:14.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2609_fsm 2023-03-02T10:57:14.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2609_vm 2023-03-02T10:57:14.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2610 2023-03-02T10:57:14.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2610_fsm 2023-03-02T10:57:14.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2610_vm 2023-03-02T10:57:14.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2611 2023-03-02T10:57:14.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2611_vm 2023-03-02T10:57:14.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2612 2023-03-02T10:57:14.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2612_fsm 2023-03-02T10:57:14.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2612_vm 2023-03-02T10:57:14.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2613 2023-03-02T10:57:14.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2613_vm 2023-03-02T10:57:14.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2615 2023-03-02T10:57:14.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2615_fsm 2023-03-02T10:57:14.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2615_vm 2023-03-02T10:57:14.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2616 2023-03-02T10:57:14.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2616_fsm 2023-03-02T10:57:14.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2616_vm 2023-03-02T10:57:14.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Mar 2 10:57 2617 2023-03-02T10:57:14.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2617_fsm 2023-03-02T10:57:14.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2617_vm 2023-03-02T10:57:14.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Mar 2 10:57 2618 2023-03-02T10:57:14.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2618_fsm 2023-03-02T10:57:14.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2618_vm 2023-03-02T10:57:14.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Mar 2 10:57 2619 2023-03-02T10:57:14.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2619_fsm 2023-03-02T10:57:14.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2619_vm 2023-03-02T10:57:14.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2620 2023-03-02T10:57:14.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2620_vm 2023-03-02T10:57:14.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2650 2023-03-02T10:57:14.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2651 2023-03-02T10:57:14.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2652 2023-03-02T10:57:14.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2653 2023-03-02T10:57:14.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2654 2023-03-02T10:57:14.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2655 2023-03-02T10:57:14.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2656 2023-03-02T10:57:14.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2657 2023-03-02T10:57:14.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Mar 2 10:57 2658 2023-03-02T10:57:14.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Mar 2 10:57 2659 2023-03-02T10:57:14.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2660 2023-03-02T10:57:14.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2661 2023-03-02T10:57:14.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2662 2023-03-02T10:57:14.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Mar 2 10:57 2663 2023-03-02T10:57:14.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2664 2023-03-02T10:57:14.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2665 2023-03-02T10:57:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2666 2023-03-02T10:57:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2667 2023-03-02T10:57:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2668 2023-03-02T10:57:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2669 2023-03-02T10:57:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2670 2023-03-02T10:57:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Mar 2 10:57 2673 2023-03-02T10:57:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Mar 2 10:57 2674 2023-03-02T10:57:14.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Mar 2 10:57 2675 2023-03-02T10:57:14.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2678 2023-03-02T10:57:14.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2679 2023-03-02T10:57:14.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2680 2023-03-02T10:57:14.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2681 2023-03-02T10:57:14.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2682 2023-03-02T10:57:14.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2683 2023-03-02T10:57:14.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2684 2023-03-02T10:57:14.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2685 2023-03-02T10:57:14.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2686 2023-03-02T10:57:14.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2687 2023-03-02T10:57:14.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2688 2023-03-02T10:57:14.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Mar 2 10:57 2689 2023-03-02T10:57:14.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Mar 2 10:57 2690 2023-03-02T10:57:14.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Mar 2 10:57 2691 2023-03-02T10:57:14.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2692 2023-03-02T10:57:14.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2693 2023-03-02T10:57:14.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2696 2023-03-02T10:57:14.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2699 2023-03-02T10:57:14.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2701 2023-03-02T10:57:14.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2702 2023-03-02T10:57:14.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2703 2023-03-02T10:57:14.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 2704 2023-03-02T10:57:14.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2753 2023-03-02T10:57:14.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2753_fsm 2023-03-02T10:57:14.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2753_vm 2023-03-02T10:57:14.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2754 2023-03-02T10:57:14.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2755 2023-03-02T10:57:14.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2756 2023-03-02T10:57:14.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 2757 2023-03-02T10:57:14.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2830 2023-03-02T10:57:14.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2830_vm 2023-03-02T10:57:14.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2831 2023-03-02T10:57:14.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2832 2023-03-02T10:57:14.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2832_vm 2023-03-02T10:57:14.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2833 2023-03-02T10:57:14.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2834 2023-03-02T10:57:14.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2834_vm 2023-03-02T10:57:14.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2835 2023-03-02T10:57:14.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2836 2023-03-02T10:57:14.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2836_vm 2023-03-02T10:57:14.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2837 2023-03-02T10:57:14.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Mar 2 10:57 2838 2023-03-02T10:57:14.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2838_fsm 2023-03-02T10:57:14.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2838_vm 2023-03-02T10:57:14.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2839 2023-03-02T10:57:14.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2840 2023-03-02T10:57:14.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2840_fsm 2023-03-02T10:57:14.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2840_vm 2023-03-02T10:57:14.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2841 2023-03-02T10:57:14.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2995 2023-03-02T10:57:14.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2995_vm 2023-03-02T10:57:14.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2996 2023-03-02T10:57:14.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3079 2023-03-02T10:57:14.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3079_fsm 2023-03-02T10:57:14.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3079_vm 2023-03-02T10:57:14.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3080 2023-03-02T10:57:14.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3081 2023-03-02T10:57:14.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3085 2023-03-02T10:57:14.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3118 2023-03-02T10:57:14.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3118_vm 2023-03-02T10:57:14.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3119 2023-03-02T10:57:14.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3164 2023-03-02T10:57:14.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3256 2023-03-02T10:57:14.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3256_vm 2023-03-02T10:57:14.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3257 2023-03-02T10:57:14.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3258 2023-03-02T10:57:14.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3350 2023-03-02T10:57:14.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3350_vm 2023-03-02T10:57:14.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3351 2023-03-02T10:57:14.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3379 2023-03-02T10:57:14.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3380 2023-03-02T10:57:14.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3381 2023-03-02T10:57:14.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3381_vm 2023-03-02T10:57:14.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3394 2023-03-02T10:57:14.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3394_fsm 2023-03-02T10:57:14.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3394_vm 2023-03-02T10:57:14.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3395 2023-03-02T10:57:14.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3439 2023-03-02T10:57:14.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3439_vm 2023-03-02T10:57:14.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3440 2023-03-02T10:57:14.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Mar 2 10:57 3455 2023-03-02T10:57:14.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3456 2023-03-02T10:57:14.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3456_fsm 2023-03-02T10:57:14.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3456_vm 2023-03-02T10:57:14.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3466 2023-03-02T10:57:14.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3466_vm 2023-03-02T10:57:14.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3467 2023-03-02T10:57:14.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3468 2023-03-02T10:57:14.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3501 2023-03-02T10:57:14.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3501_vm 2023-03-02T10:57:14.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3502 2023-03-02T10:57:14.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3503 2023-03-02T10:57:14.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3534 2023-03-02T10:57:14.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3541 2023-03-02T10:57:14.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3541_fsm 2023-03-02T10:57:14.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3541_vm 2023-03-02T10:57:14.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3542 2023-03-02T10:57:14.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3574 2023-03-02T10:57:14.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3575 2023-03-02T10:57:14.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3576 2023-03-02T10:57:14.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3576_vm 2023-03-02T10:57:14.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3596 2023-03-02T10:57:14.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3596_vm 2023-03-02T10:57:14.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3597 2023-03-02T10:57:14.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3598 2023-03-02T10:57:14.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3598_vm 2023-03-02T10:57:14.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3599 2023-03-02T10:57:14.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3600 2023-03-02T10:57:14.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3600_fsm 2023-03-02T10:57:14.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3600_vm 2023-03-02T10:57:14.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3601 2023-03-02T10:57:14.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3601_fsm 2023-03-02T10:57:14.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3601_vm 2023-03-02T10:57:14.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3602 2023-03-02T10:57:14.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3602_fsm 2023-03-02T10:57:14.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3602_vm 2023-03-02T10:57:14.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3603 2023-03-02T10:57:14.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3603_fsm 2023-03-02T10:57:14.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3603_vm 2023-03-02T10:57:14.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3604 2023-03-02T10:57:14.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3605 2023-03-02T10:57:14.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3606 2023-03-02T10:57:14.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3607 2023-03-02T10:57:14.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3608 2023-03-02T10:57:14.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Mar 2 10:57 3609 2023-03-02T10:57:14.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3712 2023-03-02T10:57:14.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3764 2023-03-02T10:57:14.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 3764_fsm 2023-03-02T10:57:14.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3764_vm 2023-03-02T10:57:14.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3766 2023-03-02T10:57:14.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 3767 2023-03-02T10:57:14.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3997 2023-03-02T10:57:14.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 5002 2023-03-02T10:57:14.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 548 2023-03-02T10:57:14.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 549 2023-03-02T10:57:14.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6102 2023-03-02T10:57:14.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6102_vm 2023-03-02T10:57:14.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6104 2023-03-02T10:57:14.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6104_vm 2023-03-02T10:57:14.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6106 2023-03-02T10:57:14.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6106_vm 2023-03-02T10:57:14.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6110 2023-03-02T10:57:14.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6111 2023-03-02T10:57:14.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6112 2023-03-02T10:57:14.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6113 2023-03-02T10:57:14.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6117 2023-03-02T10:57:14.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 826 2023-03-02T10:57:14.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 826_vm 2023-03-02T10:57:14.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 827 2023-03-02T10:57:14.666 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 828 2023-03-02T10:57:14.666 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Mar 2 10:57 pg_filenode.map 2023-03-02T10:57:14.666 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 PG_VERSION 2023-03-02T10:57:14.666 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.666 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/global: 2023-03-02T10:57:14.666 INFO:teuthology.orchestra.run.smithi057.stdout:total 553 2023-03-02T10:57:14.666 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Mar 2 10:57 . 2023-03-02T10:57:14.667 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1136 2023-03-02T10:57:14.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1136_fsm 2023-03-02T10:57:14.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1136_vm 2023-03-02T10:57:14.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 1137 2023-03-02T10:57:14.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1213 2023-03-02T10:57:14.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1213_fsm 2023-03-02T10:57:14.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1213_vm 2023-03-02T10:57:14.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1214 2023-03-02T10:57:14.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1214_fsm 2023-03-02T10:57:14.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1214_vm 2023-03-02T10:57:14.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 1232 2023-03-02T10:57:14.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 1233 2023-03-02T10:57:14.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1260 2023-03-02T10:57:14.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1260_fsm 2023-03-02T10:57:14.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1260_vm 2023-03-02T10:57:14.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1261 2023-03-02T10:57:14.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1261_fsm 2023-03-02T10:57:14.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1261_vm 2023-03-02T10:57:14.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1262 2023-03-02T10:57:14.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 1262_fsm 2023-03-02T10:57:14.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 1262_vm 2023-03-02T10:57:14.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2396 2023-03-02T10:57:14.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Mar 2 10:57 2396_fsm 2023-03-02T10:57:14.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2396_vm 2023-03-02T10:57:14.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2397 2023-03-02T10:57:14.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2671 2023-03-02T10:57:14.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2672 2023-03-02T10:57:14.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2676 2023-03-02T10:57:14.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2677 2023-03-02T10:57:14.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2694 2023-03-02T10:57:14.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2695 2023-03-02T10:57:14.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2697 2023-03-02T10:57:14.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Mar 2 10:57 2698 2023-03-02T10:57:14.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2846 2023-03-02T10:57:14.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2846_vm 2023-03-02T10:57:14.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2847 2023-03-02T10:57:14.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2964 2023-03-02T10:57:14.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2964_vm 2023-03-02T10:57:14.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2965 2023-03-02T10:57:14.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2966 2023-03-02T10:57:14.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 2966_vm 2023-03-02T10:57:14.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 2967 2023-03-02T10:57:14.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3592 2023-03-02T10:57:14.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 3592_vm 2023-03-02T10:57:14.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 3593 2023-03-02T10:57:14.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 4060 2023-03-02T10:57:14.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 4060_vm 2023-03-02T10:57:14.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 4061 2023-03-02T10:57:14.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6000 2023-03-02T10:57:14.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6000_vm 2023-03-02T10:57:14.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6001 2023-03-02T10:57:14.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6002 2023-03-02T10:57:14.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6100 2023-03-02T10:57:14.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 6100_vm 2023-03-02T10:57:14.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6114 2023-03-02T10:57:14.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 6115 2023-03-02T10:57:14.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 pg_control 2023-03-02T10:57:14.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Mar 2 10:57 pg_filenode.map 2023-03-02T10:57:14.675 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.675 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/log: 2023-03-02T10:57:14.675 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.675 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.675 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.675 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.675 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-03-02T10:57:14.676 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.676 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.676 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.676 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.676 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-03-02T10:57:14.676 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.676 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.677 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.677 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.677 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-03-02T10:57:14.677 INFO:teuthology.orchestra.run.smithi057.stdout:total 1 2023-03-02T10:57:14.677 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 . 2023-03-02T10:57:14.677 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.677 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 mappings 2023-03-02T10:57:14.678 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Mar 2 10:57 replorigin_checkpoint 2023-03-02T10:57:14.678 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 snapshots 2023-03-02T10:57:14.678 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.678 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-03-02T10:57:14.678 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.678 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.678 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 .. 2023-03-02T10:57:14.679 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.679 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-03-02T10:57:14.679 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.679 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.679 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Mar 2 10:57 .. 2023-03-02T10:57:14.679 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.679 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-03-02T10:57:14.680 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.680 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Mar 2 10:57 . 2023-03-02T10:57:14.680 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.680 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 members 2023-03-02T10:57:14.680 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 offsets 2023-03-02T10:57:14.680 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.680 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-03-02T10:57:14.680 INFO:teuthology.orchestra.run.smithi057.stdout:total 8 2023-03-02T10:57:14.681 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 . 2023-03-02T10:57:14.681 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Mar 2 10:57 .. 2023-03-02T10:57:14.681 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 0000 2023-03-02T10:57:14.681 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.681 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-03-02T10:57:14.681 INFO:teuthology.orchestra.run.smithi057.stdout:total 8 2023-03-02T10:57:14.681 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 . 2023-03-02T10:57:14.682 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Mar 2 10:57 .. 2023-03-02T10:57:14.682 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 0000 2023-03-02T10:57:14.682 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.682 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-03-02T10:57:14.682 INFO:teuthology.orchestra.run.smithi057.stdout:total 8 2023-03-02T10:57:14.682 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 . 2023-03-02T10:57:14.682 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 0000 2023-03-02T10:57:14.683 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.683 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-03-02T10:57:14.683 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.683 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.683 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.683 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.683 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-03-02T10:57:14.684 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.684 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.684 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.684 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.684 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-03-02T10:57:14.684 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.684 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.685 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.685 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.685 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-03-02T10:57:14.685 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.685 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.685 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.685 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.686 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-03-02T10:57:14.686 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.686 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.686 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.686 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.686 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-03-02T10:57:14.686 INFO:teuthology.orchestra.run.smithi057.stdout:total 8 2023-03-02T10:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 . 2023-03-02T10:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 0000 2023-03-02T10:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-03-02T10:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-03-02T10:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-03-02T10:57:14.689 INFO:teuthology.orchestra.run.smithi057.stdout:total 16384 2023-03-02T10:57:14.689 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Mar 2 10:57 . 2023-03-02T10:57:14.689 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Mar 2 10:57 000000010000000000000001 2023-03-02T10:57:14.689 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 archive_status 2023-03-02T10:57:14.689 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.689 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-03-02T10:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout:total 0 2023-03-02T10:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Mar 2 10:57 . 2023-03-02T10:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Mar 2 10:57 .. 2023-03-02T10:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-03-02T10:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout:total 8 2023-03-02T10:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Mar 2 10:57 . 2023-03-02T10:57:14.691 INFO:teuthology.orchestra.run.smithi057.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Mar 2 10:57 .. 2023-03-02T10:57:14.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Mar 2 10:57 0000 2023-03-02T10:57:14.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-03-02T10:57:14.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 500 -i' 2023-03-02T10:57:14.926 INFO:teuthology.orchestra.run.smithi057.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-03-02T10:57:14.931 INFO:teuthology.orchestra.run.smithi057.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-03-02T10:57:14.935 INFO:teuthology.orchestra.run.smithi057.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-03-02T10:57:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-03-02T10:57:15.193 INFO:teuthology.orchestra.run.smithi057.stderr:creating tables... 2023-03-02T10:57:15.288 INFO:teuthology.orchestra.run.smithi057.stderr:100000 of 50000000 tuples (0%) done (elapsed 0.09 s, remaining 46.46 s) 2023-03-02T10:57:15.472 INFO:teuthology.orchestra.run.smithi057.stderr:200000 of 50000000 tuples (0%) done (elapsed 0.28 s, remaining 69.00 s) 2023-03-02T10:57:15.587 INFO:teuthology.orchestra.run.smithi057.stderr:300000 of 50000000 tuples (0%) done (elapsed 0.39 s, remaining 64.99 s) 2023-03-02T10:57:15.790 INFO:teuthology.orchestra.run.smithi057.stderr:400000 of 50000000 tuples (0%) done (elapsed 0.60 s, remaining 73.79 s) 2023-03-02T10:57:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:15 smithi057 ceph-mon[92072]: pgmap v10: 97 pgs: 97 active+clean; 31 MiB data, 104 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 2.6 MiB/s wr, 77 op/s 2023-03-02T10:57:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:15 smithi122 ceph-mon[125440]: pgmap v10: 97 pgs: 97 active+clean; 31 MiB data, 104 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 2.6 MiB/s wr, 77 op/s 2023-03-02T10:57:15.990 INFO:teuthology.orchestra.run.smithi057.stderr:500000 of 50000000 tuples (1%) done (elapsed 0.80 s, remaining 78.71 s) 2023-03-02T10:57:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:15 smithi136 ceph-mon[125702]: pgmap v10: 97 pgs: 97 active+clean; 31 MiB data, 104 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 2.6 MiB/s wr, 77 op/s 2023-03-02T10:57:16.114 INFO:teuthology.orchestra.run.smithi057.stderr:600000 of 50000000 tuples (1%) done (elapsed 0.92 s, remaining 75.70 s) 2023-03-02T10:57:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:700000 of 50000000 tuples (1%) done (elapsed 1.11 s, remaining 78.44 s) 2023-03-02T10:57:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.342+0000 7f80b85ff700 1 -- 172.21.15.57:0/913353091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80b00fe270 msgr2=0x7f80b00fe640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.342+0000 7f80b85ff700 1 --2- 172.21.15.57:0/913353091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80b00fe270 0x7f80b00fe640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0099c0 tx=0x7f80ac009cd0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.342+0000 7f80b85ff700 1 -- 172.21.15.57:0/913353091 shutdown_connections 2023-03-02T10:57:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.342+0000 7f80b85ff700 1 --2- 172.21.15.57:0/913353091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b0104e10 0x7f80b010c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.342+0000 7f80b85ff700 1 --2- 172.21.15.57:0/913353091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80b00fe270 0x7f80b00fe640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.342+0000 7f80b85ff700 1 --2- 172.21.15.57:0/913353091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b00fec10 0x7f80b01046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.342+0000 7f80b85ff700 1 -- 172.21.15.57:0/913353091 >> 172.21.15.57:0/913353091 conn(0x7f80b0075fd0 msgr2=0x7f80b00763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.342+0000 7f80b85ff700 1 -- 172.21.15.57:0/913353091 shutdown_connections 2023-03-02T10:57:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.342+0000 7f80b85ff700 1 -- 172.21.15.57:0/913353091 wait complete. 2023-03-02T10:57:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.343+0000 7f80b85ff700 1 Processor -- start 2023-03-02T10:57:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.343+0000 7f80b85ff700 1 -- start start 2023-03-02T10:57:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.343+0000 7f80b85ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b00fe270 0x7f80b0195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.343+0000 7f80b85ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80b00fec10 0x7f80b0196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.343+0000 7f80b85ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b0104e10 0x7f80b019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.343+0000 7f80b85ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b019adc0 con 0x7f80b0104e10 2023-03-02T10:57:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.343+0000 7f80b85ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b019af30 con 0x7f80b00fe270 2023-03-02T10:57:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.343+0000 7f80b85ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b019b0f0 con 0x7f80b00fec10 2023-03-02T10:57:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.343+0000 7f80b6b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b0104e10 0x7f80b019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80b6b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b0104e10 0x7f80b019a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60422/0 (socket says 172.21.15.57:60422) 2023-03-02T10:57:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80b6b9c700 1 -- 172.21.15.57:0/2724737290 learned_addr learned my addr 172.21.15.57:0/2724737290 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80b5b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80b00fec10 0x7f80b0196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80b639b700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b00fe270 0x7f80b0195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80b6b9c700 1 -- 172.21.15.57:0/2724737290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80b00fec10 msgr2=0x7f80b0196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80b6b9c700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80b00fec10 0x7f80b0196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80b6b9c700 1 -- 172.21.15.57:0/2724737290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b00fe270 msgr2=0x7f80b0195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80b6b9c700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b00fe270 0x7f80b0195de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80b6b9c700 1 -- 172.21.15.57:0/2724737290 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a0009520 con 0x7f80b0104e10 2023-03-02T10:57:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80b00fec10 0x7f80b0196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80b6b9c700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b0104e10 0x7f80b019a780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f80a800ef30 tx=0x7f80a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.344+0000 7f80a77fe700 1 -- 172.21.15.57:0/2724737290 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8018070 con 0x7f80b0104e10 2023-03-02T10:57:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.345+0000 7f80b85ff700 1 -- 172.21.15.57:0/2724737290 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ac0095f0 con 0x7f80b0104e10 2023-03-02T10:57:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.345+0000 7f80a77fe700 1 -- 172.21.15.57:0/2724737290 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80a800f040 con 0x7f80b0104e10 2023-03-02T10:57:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.345+0000 7f80a77fe700 1 -- 172.21.15.57:0/2724737290 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a800cdb0 con 0x7f80b0104e10 2023-03-02T10:57:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.345+0000 7f80b85ff700 1 -- 172.21.15.57:0/2724737290 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b010fbe0 con 0x7f80b0104e10 2023-03-02T10:57:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.349+0000 7f80a77fe700 1 -- 172.21.15.57:0/2724737290 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f80a8003a00 con 0x7f80b0104e10 2023-03-02T10:57:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.350+0000 7f80cc00ab80 1 Processor -- start 2023-03-02T10:57:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.351+0000 7f80cc00ab80 1 -- start start 2023-03-02T10:57:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.351+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51b316b0 0x563a51cd9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.351+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cd9fd0 0x563a51cd3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.351+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cda440 0x563a51cd44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.351+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51c3ba00 con 0x563a51cda440 2023-03-02T10:57:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.351+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51bedf20 con 0x563a51b316b0 2023-03-02T10:57:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.351+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51bbe100 con 0x563a51cd9fd0 2023-03-02T10:57:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.351+0000 7f80b5b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cda440 0x563a51cd44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.351+0000 7f80b5b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cda440 0x563a51cd44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60438/0 (socket says 172.21.15.57:60438) 2023-03-02T10:57:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.351+0000 7f80b5b9a700 1 -- 172.21.15.57:0/961894163 learned_addr learned my addr 172.21.15.57:0/961894163 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.351+0000 7f80b639b700 1 --2- 172.21.15.57:0/961894163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cd9fd0 0x563a51cd3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.352+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/961894163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51b316b0 0x563a51cd9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.352+0000 7f80a77fe700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f809c09b4c0 0x7f809c09d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.352+0000 7f80b5b9a700 1 -- 172.21.15.57:0/961894163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cd9fd0 msgr2=0x563a51cd3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.352+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/961894163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cd9fd0 0x563a51cd3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.352+0000 7f80b5b9a700 1 -- 172.21.15.57:0/961894163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51b316b0 msgr2=0x563a51cd9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.352+0000 7f80a77fe700 1 -- 172.21.15.57:0/2724737290 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f80a80c4ef0 con 0x7f80b0104e10 2023-03-02T10:57:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.352+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/961894163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51b316b0 0x563a51cd9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.352+0000 7f80b5b9a700 1 -- 172.21.15.57:0/961894163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a51aa85d0 con 0x563a51cda440 2023-03-02T10:57:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.352+0000 7f80b6b9c700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f809c09b4c0 0x7f809c09d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.352+0000 7f80b6b9c700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f809c09b4c0 0x7f809c09d970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009490 tx=0x7f80a8004dc0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.352+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/961894163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cda440 0x563a51cd44c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f80a0010df0 tx=0x7f80a0009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564726c9d96bf37d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.353+0000 7f80a4bfe700 1 -- 172.21.15.57:0/961894163 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0015050 con 0x563a51cda440 2023-03-02T10:57:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.353+0000 7f80a4bfe700 1 -- 172.21.15.57:0/961894163 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80a0016040 con 0x563a51cda440 2023-03-02T10:57:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.353+0000 7f80a4bfe700 1 -- 172.21.15.57:0/961894163 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0004d30 con 0x563a51cda440 2023-03-02T10:57:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.353+0000 7f80cc00ab80 1 -- 172.21.15.57:0/961894163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cda440 msgr2=0x563a51cd44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.353+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/961894163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cda440 0x563a51cd44c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f80a0010df0 tx=0x7f80a0009800 comp rx=0 tx=0).stop 2023-03-02T10:57:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.354+0000 7f80cc00ab80 1 -- 172.21.15.57:0/961894163 shutdown_connections 2023-03-02T10:57:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.354+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/961894163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cda440 0x563a51cd44c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.354+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/961894163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51b316b0 0x563a51cd9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.354+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/961894163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cd9fd0 0x563a51cd3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.354+0000 7f80cc00ab80 1 -- 172.21.15.57:0/961894163 >> 172.21.15.57:0/961894163 conn(0x563a51cc99a0 msgr2=0x563a51ccea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.354+0000 7f80cc00ab80 1 -- 172.21.15.57:0/961894163 shutdown_connections 2023-03-02T10:57:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.354+0000 7f80cc00ab80 1 -- 172.21.15.57:0/961894163 wait complete. 2023-03-02T10:57:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.354+0000 7f80cc00ab80 1 -- start start 2023-03-02T10:57:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.355+0000 7f80cc00ab80 1 Processor -- start 2023-03-02T10:57:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.355+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51b316b0 0x563a51ce0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.355+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 0x563a51cdd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.355+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cda440 0x563a51cddb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.355+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51c2cb60 con 0x563a51cd9fd0 2023-03-02T10:57:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.355+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51c26090 con 0x563a51b316b0 2023-03-02T10:57:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.355+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51aaa8c0 con 0x563a51cda440 2023-03-02T10:57:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.355+0000 7f80cc00ab80 10 client.0 _ll_register_callbacks cb 0x563a51bcc4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.356+0000 7f80b639b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 0x563a51cdd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.356+0000 7f80b5b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cda440 0x563a51cddb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.356+0000 7f80b639b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 0x563a51cdd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60454/0 (socket says 172.21.15.57:60454) 2023-03-02T10:57:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.356+0000 7f80b639b700 1 -- 172.21.15.57:0/323601975 learned_addr learned my addr 172.21.15.57:0/323601975 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.356+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51b316b0 0x563a51ce0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.356+0000 7f80b639b700 1 -- 172.21.15.57:0/323601975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cda440 msgr2=0x563a51cddb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.356+0000 7f80b639b700 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cda440 0x563a51cddb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.356+0000 7f80b639b700 1 -- 172.21.15.57:0/323601975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51b316b0 msgr2=0x563a51ce0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.356+0000 7f80b639b700 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51b316b0 0x563a51ce0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.356+0000 7f80b639b700 1 -- 172.21.15.57:0/323601975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a0010ad0 con 0x563a51cd9fd0 2023-03-02T10:57:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.356+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51b316b0 0x563a51ce0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.357+0000 7f80b639b700 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 0x563a51cdd570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005850 tx=0x7f80ac00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30cb7421373d29e3 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.357+0000 7f8099ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.357+0000 7f8099ffb700 1 -- 172.21.15.57:0/323601975 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac01d040 con 0x563a51cd9fd0 2023-03-02T10:57:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.357+0000 7f8099ffb700 1 -- 172.21.15.57:0/323601975 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f80ac0054e0 con 0x563a51cd9fd0 2023-03-02T10:57:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.357+0000 7f80cc00ab80 1 -- 172.21.15.57:0/323601975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a51bf7750 con 0x563a51cd9fd0 2023-03-02T10:57:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.357+0000 7f8099ffb700 1 -- 172.21.15.57:0/323601975 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80ac005a00 con 0x563a51cd9fd0 2023-03-02T10:57:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.357+0000 7f80cc00ab80 10 client.15540 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.357+0000 7f80cc00ab80 1 -- 172.21.15.57:0/323601975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563a51a54d80 con 0x563a51cd9fd0 2023-03-02T10:57:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.358+0000 7f8099ffb700 1 -- 172.21.15.57:0/323601975 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563a51bf7750 con 0x563a51cd9fd0 2023-03-02T10:57:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.358+0000 7f8099ffb700 1 -- 172.21.15.57:0/323601975 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f80ac0238e0 con 0x563a51cd9fd0 2023-03-02T10:57:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.358+0000 7f80cc00ab80 10 client.15540 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.358+0000 7f80cc00ab80 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.358+0000 7f80cc00ab80 20 client.15540 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.358+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x563a51ced8a0 0x563a51cefcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.358+0000 7f80cc00ab80 4 client.15540 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.358+0000 7f80cc00ab80 1 -- 172.21.15.57:0/323601975 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a51c1f110 con 0x563a51ced8a0 2023-03-02T10:57:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.359+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x563a51ced8a0 0x563a51cefcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.360+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x563a51ced8a0 0x563a51cefcb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d661e3d60ffeebd server_cookie=3776ca8dd1fdf33d in_seq=0 out_seq=0 2023-03-02T10:57:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.360+0000 7f8099ffb700 10 client.15540 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f8099ffb700 1 -- 172.21.15.57:0/323601975 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x563a51c1f110 con 0x563a51ced8a0 2023-03-02T10:57:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f8099ffb700 10 client.15540 handle_command_reply: tid=0 2023-03-02T10:57:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 1 client.15540 shutdown 2023-03-02T10:57:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 1 -- 172.21.15.57:0/323601975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 msgr2=0x563a51cdd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 0x563a51cdd570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005850 tx=0x7f80ac00bf50 comp rx=0 tx=0).stop 2023-03-02T10:57:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 1 -- 172.21.15.57:0/323601975 shutdown_connections 2023-03-02T10:57:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x563a51ced8a0 0x563a51cefcb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cda440 0x563a51cddb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51b316b0 0x563a51ce0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f8099ffb700 0 client.15540 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/323601975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 0x563a51cdd570 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 1 -- 172.21.15.57:0/323601975 >> 172.21.15.57:0/323601975 conn(0x563a51cc99a0 msgr2=0x563a51cce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 1 -- 172.21.15.57:0/323601975 shutdown_connections 2023-03-02T10:57:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 1 -- 172.21.15.57:0/323601975 wait complete. 2023-03-02T10:57:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.361+0000 7f80cc00ab80 20 client.15540 trim_cache size 0 max 16384 2023-03-02T10:57:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.377+0000 7f80cc00ab80 1 Processor -- start 2023-03-02T10:57:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.377+0000 7f80cc00ab80 1 -- start start 2023-03-02T10:57:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51b316b0 0x563a51cdaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cd9fd0 0x563a51cdfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51cda440 0x563a51cd3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51cd02a0 con 0x563a51b316b0 2023-03-02T10:57:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51cd4a90 con 0x563a51cda440 2023-03-02T10:57:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51ccfb90 con 0x563a51cd9fd0 2023-03-02T10:57:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80b5b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51b316b0 0x563a51cdaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80b5b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51b316b0 0x563a51cdaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60456/0 (socket says 172.21.15.57:60456) 2023-03-02T10:57:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80b5b9a700 1 -- 172.21.15.57:0/3248071568 learned_addr learned my addr 172.21.15.57:0/3248071568 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80b639b700 1 --2- 172.21.15.57:0/3248071568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cd9fd0 0x563a51cdfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/3248071568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51cda440 0x563a51cd3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80b5b9a700 1 -- 172.21.15.57:0/3248071568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cd9fd0 msgr2=0x563a51cdfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/3248071568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cd9fd0 0x563a51cdfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80b5b9a700 1 -- 172.21.15.57:0/3248071568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51cda440 msgr2=0x563a51cd3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/3248071568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51cda440 0x563a51cd3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80b5b9a700 1 -- 172.21.15.57:0/3248071568 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a51bed130 con 0x563a51b316b0 2023-03-02T10:57:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.378+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/3248071568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51b316b0 0x563a51cdaf50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009340 tx=0x7f80a00107b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be6a10c5515ba73 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.379+0000 7f80a53ff700 1 -- 172.21.15.57:0/3248071568 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0015070 con 0x563a51b316b0 2023-03-02T10:57:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.379+0000 7f80a53ff700 1 -- 172.21.15.57:0/3248071568 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80a0004510 con 0x563a51b316b0 2023-03-02T10:57:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.379+0000 7f80a53ff700 1 -- 172.21.15.57:0/3248071568 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a00038e0 con 0x563a51b316b0 2023-03-02T10:57:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.379+0000 7f80cc00ab80 1 -- 172.21.15.57:0/3248071568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51b316b0 msgr2=0x563a51cdaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.379+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/3248071568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51b316b0 0x563a51cdaf50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009340 tx=0x7f80a00107b0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.379+0000 7f80cc00ab80 1 -- 172.21.15.57:0/3248071568 shutdown_connections 2023-03-02T10:57:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.380+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/3248071568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51cda440 0x563a51cd3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.380+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/3248071568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51b316b0 0x563a51cdaf50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.380+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/3248071568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51cd9fd0 0x563a51cdfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.380+0000 7f80cc00ab80 1 -- 172.21.15.57:0/3248071568 >> 172.21.15.57:0/3248071568 conn(0x563a51cc99a0 msgr2=0x563a51cda840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.380+0000 7f80cc00ab80 1 -- 172.21.15.57:0/3248071568 shutdown_connections 2023-03-02T10:57:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.380+0000 7f80cc00ab80 1 -- 172.21.15.57:0/3248071568 wait complete. 2023-03-02T10:57:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.380+0000 7f80cc00ab80 1 -- start start 2023-03-02T10:57:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.380+0000 7f80cc00ab80 1 Processor -- start 2023-03-02T10:57:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51b316b0 0x563a51cd67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 0x563a51cd6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80cc00ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51cda440 0x563a51cd5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51cd5a50 con 0x563a51cd9fd0 2023-03-02T10:57:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51cd5bc0 con 0x563a51cda440 2023-03-02T10:57:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80cc00ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a51cd5d80 con 0x563a51b316b0 2023-03-02T10:57:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80cc00ab80 10 client.0 _ll_register_callbacks cb 0x563a51bcc4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b5b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51b316b0 0x563a51cd67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b5b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51b316b0 0x563a51cd67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:43970/0 (socket says 172.21.15.57:43970) 2023-03-02T10:57:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b5b9a700 1 -- 172.21.15.57:0/825387093 learned_addr learned my addr 172.21.15.57:0/825387093 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b639b700 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 0x563a51cd6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51cda440 0x563a51cd5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b639b700 1 -- 172.21.15.57:0/825387093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51b316b0 msgr2=0x563a51cd67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b639b700 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51b316b0 0x563a51cd67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b639b700 1 -- 172.21.15.57:0/825387093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51cda440 msgr2=0x563a51cd5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b639b700 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51cda440 0x563a51cd5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b639b700 1 -- 172.21.15.57:0/825387093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a0023040 con 0x563a51cd9fd0 2023-03-02T10:57:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51cda440 0x563a51cd5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:57:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f80b639b700 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 0x563a51cd6d30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0095c0 tx=0x7f80ac00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fd092ed4d82048 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.381+0000 7f8099ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f8099ffb700 1 -- 172.21.15.57:0/825387093 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac01d040 con 0x563a51cd9fd0 2023-03-02T10:57:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f8099ffb700 1 -- 172.21.15.57:0/825387093 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f80ac000e40 con 0x563a51cd9fd0 2023-03-02T10:57:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f80cc00ab80 1 -- 172.21.15.57:0/825387093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f80a0016040 con 0x563a51cd9fd0 2023-03-02T10:57:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f8099ffb700 1 -- 172.21.15.57:0/825387093 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80ac0056f0 con 0x563a51cd9fd0 2023-03-02T10:57:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f80cc00ab80 10 client.15546 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f80cc00ab80 1 -- 172.21.15.57:0/825387093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563a51a7b1f0 con 0x563a51cd9fd0 2023-03-02T10:57:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f8099ffb700 1 -- 172.21.15.57:0/825387093 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80a0016040 con 0x563a51cd9fd0 2023-03-02T10:57:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f8099ffb700 1 -- 172.21.15.57:0/825387093 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f80ac003c60 con 0x563a51cd9fd0 2023-03-02T10:57:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f80cc00ab80 10 client.15546 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f80cc00ab80 10 client.15546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f80cc00ab80 20 client.15546 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x563a51d3fc70 0x563a51d42080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f80cc00ab80 4 client.15546 mds_command: new command op to 24560 tid=0[{"prefix": "flush journal"}] 2023-03-02T10:57:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f80cc00ab80 1 -- 172.21.15.57:0/825387093 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563a51c1ee30 con 0x563a51d3fc70 2023-03-02T10:57:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.382+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x563a51d3fc70 0x563a51d42080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.383+0000 7f80b5b9a700 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x563a51d3fc70 0x563a51d42080 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6cfaf841edc10dd server_cookie=e9eb75d69b609595 in_seq=0 out_seq=0 2023-03-02T10:57:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.383+0000 7f8099ffb700 10 client.15546 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f8099ffb700 1 -- 172.21.15.57:0/825387093 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563a51c1ee30 con 0x563a51d3fc70 2023-03-02T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f8099ffb700 10 client.15546 handle_command_reply: tid=0 2023-03-02T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 1 client.15546 shutdown 2023-03-02T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 1 -- 172.21.15.57:0/825387093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 msgr2=0x563a51cd6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 0x563a51cd6d30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0095c0 tx=0x7f80ac00bbe0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 1 -- 172.21.15.57:0/825387093 shutdown_connections 2023-03-02T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x563a51d3fc70 0x563a51d42080 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563a51cda440 0x563a51cd5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563a51b316b0 0x563a51cd67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 1 --2- 172.21.15.57:0/825387093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563a51cd9fd0 0x563a51cd6d30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f8099ffb700 0 client.15546 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 1 -- 172.21.15.57:0/825387093 >> 172.21.15.57:0/825387093 conn(0x563a51cc99a0 msgr2=0x563a51cdb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 1 -- 172.21.15.57:0/825387093 shutdown_connections 2023-03-02T10:57:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 1 -- 172.21.15.57:0/825387093 wait complete. 2023-03-02T10:57:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.571+0000 7f80cc00ab80 20 client.15546 trim_cache size 0 max 16384 2023-03-02T10:57:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:{ 2023-03-02T10:57:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "message": "", 2023-03-02T10:57:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "return_code": 0 2023-03-02T10:57:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:} 2023-03-02T10:57:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 -- 172.21.15.57:0/2724737290 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f809c09b4c0 msgr2=0x7f809c09d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f809c09b4c0 0x7f809c09d970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009490 tx=0x7f80a8004dc0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 -- 172.21.15.57:0/2724737290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b0104e10 msgr2=0x7f80b019a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b0104e10 0x7f80b019a780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f80a800ef30 tx=0x7f80a800c3a0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 -- 172.21.15.57:0/2724737290 shutdown_connections 2023-03-02T10:57:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f809c09b4c0 0x7f809c09d970 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b0104e10 0x7f80b019a780 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b00fe270 0x7f80b0195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 --2- 172.21.15.57:0/2724737290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80b00fec10 0x7f80b0196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 -- 172.21.15.57:0/2724737290 >> 172.21.15.57:0/2724737290 conn(0x7f80b0075fd0 msgr2=0x7f80b00fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 -- 172.21.15.57:0/2724737290 shutdown_connections 2023-03-02T10:57:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:16.572+0000 7f80b85ff700 1 -- 172.21.15.57:0/2724737290 wait complete. 2023-03-02T10:57:16.648 INFO:teuthology.orchestra.run.smithi057.stderr:800000 of 50000000 tuples (1%) done (elapsed 1.45 s, remaining 89.38 s) 2023-03-02T10:57:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:900000 of 50000000 tuples (1%) done (elapsed 1.58 s, remaining 86.43 s) 2023-03-02T10:57:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:1000000 of 50000000 tuples (2%) done (elapsed 1.75 s, remaining 85.87 s) 2023-03-02T10:57:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:1100000 of 50000000 tuples (2%) done (elapsed 1.95 s, remaining 86.69 s) 2023-03-02T10:57:17.258 INFO:teuthology.orchestra.run.smithi057.stderr:1200000 of 50000000 tuples (2%) done (elapsed 2.06 s, remaining 83.88 s) 2023-03-02T10:57:17.422 INFO:teuthology.orchestra.run.smithi057.stderr:1300000 of 50000000 tuples (2%) done (elapsed 2.23 s, remaining 83.44 s) 2023-03-02T10:57:17.638 INFO:teuthology.orchestra.run.smithi057.stderr:1400000 of 50000000 tuples (2%) done (elapsed 2.44 s, remaining 84.81 s) 2023-03-02T10:57:17.742 INFO:teuthology.orchestra.run.smithi057.stderr:1500000 of 50000000 tuples (3%) done (elapsed 2.55 s, remaining 82.34 s) 2023-03-02T10:57:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:17 smithi057 ceph-mon[92072]: pgmap v11: 97 pgs: 97 active+clean; 31 MiB data, 104 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 2.6 MiB/s wr, 77 op/s 2023-03-02T10:57:17.941 INFO:teuthology.orchestra.run.smithi057.stderr:1600000 of 50000000 tuples (3%) done (elapsed 2.75 s, remaining 83.07 s) 2023-03-02T10:57:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:17 smithi122 ceph-mon[125440]: pgmap v11: 97 pgs: 97 active+clean; 31 MiB data, 104 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 2.6 MiB/s wr, 77 op/s 2023-03-02T10:57:18.051 INFO:teuthology.orchestra.run.smithi057.stderr:1700000 of 50000000 tuples (3%) done (elapsed 2.86 s, remaining 81.14 s) 2023-03-02T10:57:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:17 smithi136 ceph-mon[125702]: pgmap v11: 97 pgs: 97 active+clean; 31 MiB data, 104 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 2.6 MiB/s wr, 77 op/s 2023-03-02T10:57:18.233 INFO:teuthology.orchestra.run.smithi057.stderr:1800000 of 50000000 tuples (3%) done (elapsed 3.04 s, remaining 81.35 s) 2023-03-02T10:57:18.432 INFO:teuthology.orchestra.run.smithi057.stderr:1900000 of 50000000 tuples (3%) done (elapsed 3.24 s, remaining 81.95 s) 2023-03-02T10:57:18.564 INFO:teuthology.orchestra.run.smithi057.stderr:2000000 of 50000000 tuples (4%) done (elapsed 3.37 s, remaining 80.84 s) 2023-03-02T10:57:18.769 INFO:teuthology.orchestra.run.smithi057.stderr:2100000 of 50000000 tuples (4%) done (elapsed 3.57 s, remaining 81.52 s) 2023-03-02T10:57:18.947 INFO:teuthology.orchestra.run.smithi057.stderr:2200000 of 50000000 tuples (4%) done (elapsed 3.75 s, remaining 81.51 s) 2023-03-02T10:57:19.055 INFO:teuthology.orchestra.run.smithi057.stderr:2300000 of 50000000 tuples (4%) done (elapsed 3.86 s, remaining 80.06 s) 2023-03-02T10:57:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2400000 of 50000000 tuples (4%) done (elapsed 4.07 s, remaining 80.82 s) 2023-03-02T10:57:19.456 INFO:teuthology.orchestra.run.smithi057.stderr:2500000 of 50000000 tuples (5%) done (elapsed 4.26 s, remaining 80.96 s) 2023-03-02T10:57:19.554 INFO:teuthology.orchestra.run.smithi057.stderr:2600000 of 50000000 tuples (5%) done (elapsed 4.36 s, remaining 79.46 s) 2023-03-02T10:57:19.763 INFO:teuthology.orchestra.run.smithi057.stderr:2700000 of 50000000 tuples (5%) done (elapsed 4.57 s, remaining 80.03 s) 2023-03-02T10:57:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:19 smithi136 ceph-mon[125702]: pgmap v12: 97 pgs: 97 active+clean; 123 MiB data, 158 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 17 MiB/s wr, 336 op/s 2023-03-02T10:57:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:19 smithi057 ceph-mon[92072]: pgmap v12: 97 pgs: 97 active+clean; 123 MiB data, 158 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 17 MiB/s wr, 336 op/s 2023-03-02T10:57:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:19 smithi122 ceph-mon[125440]: pgmap v12: 97 pgs: 97 active+clean; 123 MiB data, 158 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 17 MiB/s wr, 336 op/s 2023-03-02T10:57:19.973 INFO:teuthology.orchestra.run.smithi057.stderr:2800000 of 50000000 tuples (5%) done (elapsed 4.78 s, remaining 80.54 s) 2023-03-02T10:57:20.091 INFO:teuthology.orchestra.run.smithi057.stderr:2900000 of 50000000 tuples (5%) done (elapsed 4.90 s, remaining 79.51 s) 2023-03-02T10:57:20.265 INFO:teuthology.orchestra.run.smithi057.stderr:3000000 of 50000000 tuples (6%) done (elapsed 5.07 s, remaining 79.43 s) 2023-03-02T10:57:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:3100000 of 50000000 tuples (6%) done (elapsed 5.19 s, remaining 78.45 s) 2023-03-02T10:57:20.569 INFO:teuthology.orchestra.run.smithi057.stderr:3200000 of 50000000 tuples (6%) done (elapsed 5.37 s, remaining 78.58 s) 2023-03-02T10:57:20.748 INFO:teuthology.orchestra.run.smithi057.stderr:3300000 of 50000000 tuples (6%) done (elapsed 5.55 s, remaining 78.58 s) 2023-03-02T10:57:20.852 INFO:teuthology.orchestra.run.smithi057.stderr:3400000 of 50000000 tuples (6%) done (elapsed 5.66 s, remaining 77.53 s) 2023-03-02T10:57:21.039 INFO:teuthology.orchestra.run.smithi057.stderr:3500000 of 50000000 tuples (7%) done (elapsed 5.84 s, remaining 77.64 s) 2023-03-02T10:57:21.236 INFO:teuthology.orchestra.run.smithi057.stderr:3600000 of 50000000 tuples (7%) done (elapsed 6.04 s, remaining 77.86 s) 2023-03-02T10:57:21.343 INFO:teuthology.orchestra.run.smithi057.stderr:3700000 of 50000000 tuples (7%) done (elapsed 6.15 s, remaining 76.94 s) 2023-03-02T10:57:21.525 INFO:teuthology.orchestra.run.smithi057.stderr:3800000 of 50000000 tuples (7%) done (elapsed 6.33 s, remaining 76.96 s) 2023-03-02T10:57:21.528 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T10:57:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.717+0000 7fc35efff700 1 -- 172.21.15.57:0/2622539227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc358100480 msgr2=0x7fc35810c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.717+0000 7fc35efff700 1 --2- 172.21.15.57:0/2622539227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc358100480 0x7fc35810c910 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc35000b0a0 tx=0x7fc35000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.717+0000 7fc35efff700 1 -- 172.21.15.57:0/2622539227 shutdown_connections 2023-03-02T10:57:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.717+0000 7fc35efff700 1 --2- 172.21.15.57:0/2622539227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc358100480 0x7fc35810c910 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.717+0000 7fc35efff700 1 --2- 172.21.15.57:0/2622539227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc358105ae0 0x7fc358105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.717+0000 7fc35efff700 1 --2- 172.21.15.57:0/2622539227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3580ffad0 0x7fc3580fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.717+0000 7fc35efff700 1 -- 172.21.15.57:0/2622539227 >> 172.21.15.57:0/2622539227 conn(0x7fc3580fb610 msgr2=0x7fc3580fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.717+0000 7fc35efff700 1 -- 172.21.15.57:0/2622539227 shutdown_connections 2023-03-02T10:57:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.717+0000 7fc35efff700 1 -- 172.21.15.57:0/2622539227 wait complete. 2023-03-02T10:57:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.718+0000 7fc35efff700 1 Processor -- start 2023-03-02T10:57:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.718+0000 7fc35efff700 1 -- start start 2023-03-02T10:57:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.718+0000 7fc35efff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3580ffad0 0x7fc358072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.718+0000 7fc35efff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc358100480 0x7fc358072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.718+0000 7fc35efff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc358105ae0 0x7fc358073310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.718+0000 7fc35efff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3581a40f0 con 0x7fc358105ae0 2023-03-02T10:57:21.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.718+0000 7fc35efff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3581a4260 con 0x7fc3580ffad0 2023-03-02T10:57:21.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.718+0000 7fc35efff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3581a4420 con 0x7fc358100480 2023-03-02T10:57:21.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.718+0000 7fc35cd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3580ffad0 0x7fc358072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.718+0000 7fc35d59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc358105ae0 0x7fc358073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.718+0000 7fc35cd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3580ffad0 0x7fc358072890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59260/0 (socket says 172.21.15.57:59260) 2023-03-02T10:57:21.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc35cd9b700 1 -- 172.21.15.57:0/243516363 learned_addr learned my addr 172.21.15.57:0/243516363 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:21.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc357fff700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc358100480 0x7fc358072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc35d59c700 1 -- 172.21.15.57:0/243516363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc358100480 msgr2=0x7fc358072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc35d59c700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc358100480 0x7fc358072dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc35d59c700 1 -- 172.21.15.57:0/243516363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3580ffad0 msgr2=0x7fc358072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc35d59c700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3580ffad0 0x7fc358072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc35d59c700 1 -- 172.21.15.57:0/243516363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350009d00 con 0x7fc358105ae0 2023-03-02T10:57:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3580ffad0 0x7fc358072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc357fff700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc358100480 0x7fc358072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc35d59c700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc358105ae0 0x7fc358073310 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc350009fd0 tx=0x7fc35000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc355ffb700 1 -- 172.21.15.57:0/243516363 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35000e040 con 0x7fc358105ae0 2023-03-02T10:57:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc35efff700 1 -- 172.21.15.57:0/243516363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35810fb60 con 0x7fc358105ae0 2023-03-02T10:57:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc355ffb700 1 -- 172.21.15.57:0/243516363 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc350004e60 con 0x7fc358105ae0 2023-03-02T10:57:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc355ffb700 1 -- 172.21.15.57:0/243516363 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500052a0 con 0x7fc358105ae0 2023-03-02T10:57:21.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.719+0000 7fc35efff700 1 -- 172.21.15.57:0/243516363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35810f9d0 con 0x7fc358105ae0 2023-03-02T10:57:21.726 INFO:teuthology.orchestra.run.smithi057.stderr:3900000 of 50000000 tuples (7%) done (elapsed 6.53 s, remaining 77.20 s) 2023-03-02T10:57:21.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.726+0000 7fc355ffb700 1 -- 172.21.15.57:0/243516363 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7fc35001d470 con 0x7fc358105ae0 2023-03-02T10:57:21.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.727+0000 7fc3728e7b80 1 Processor -- start 2023-03-02T10:57:21.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.727+0000 7fc355ffb700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc34809b540 0x7fc34809d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.727+0000 7fc3728e7b80 1 -- start start 2023-03-02T10:57:21.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc355ffb700 1 -- 172.21.15.57:0/243516363 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc3500c68b0 con 0x7fc358105ae0 2023-03-02T10:57:21.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 0x55759787c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc357fff700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc34809b540 0x7fc34809d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 0x557597880bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x557597881560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575977e3a60 con 0x55759787c3c0 2023-03-02T10:57:21.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x557597795f80 con 0x557597881110 2023-03-02T10:57:21.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x557597766160 con 0x55759787ccd0 2023-03-02T10:57:21.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc35cd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 0x55759787c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc357fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 0x557597880bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc35cd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 0x55759787c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60504/0 (socket says 172.21.15.57:60504) 2023-03-02T10:57:21.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc357fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 0x557597880bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:43992/0 (socket says 172.21.15.57:43992) 2023-03-02T10:57:21.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc35cd9b700 1 -- 172.21.15.57:0/1218941232 learned_addr learned my addr 172.21.15.57:0/1218941232 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:21.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc35d59c700 1 --2- 172.21.15.57:0/1218941232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x557597881560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc35cd9b700 1 -- 172.21.15.57:0/1218941232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 msgr2=0x557597880bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:21.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/1218941232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 0x557597880bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc35cd9b700 1 -- 172.21.15.57:0/1218941232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 msgr2=0x557597881560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:21.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/1218941232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x557597881560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc35cd9b700 1 -- 172.21.15.57:0/1218941232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557597650630 con 0x55759787c3c0 2023-03-02T10:57:21.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.728+0000 7fc35d59c700 1 --2- 172.21.15.57:0/1218941232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x557597881560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:21.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.729+0000 7fc357fff700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc34809b540 0x7fc34809d9f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc358073fc0 tx=0x7fc344009bb0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:21.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.729+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/1218941232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 0x55759787c790 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc34c010580 tx=0x7fc34c010890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e38e2f1b8ad651 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:21.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.729+0000 7fc342ffd700 1 -- 172.21.15.57:0/1218941232 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c011640 con 0x55759787c3c0 2023-03-02T10:57:21.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.729+0000 7fc342ffd700 1 -- 172.21.15.57:0/1218941232 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc34c015070 con 0x55759787c3c0 2023-03-02T10:57:21.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.729+0000 7fc342ffd700 1 -- 172.21.15.57:0/1218941232 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c019970 con 0x55759787c3c0 2023-03-02T10:57:21.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.729+0000 7fc3728e7b80 1 -- 172.21.15.57:0/1218941232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 msgr2=0x55759787c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.729+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/1218941232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 0x55759787c790 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc34c010580 tx=0x7fc34c010890 comp rx=0 tx=0).stop 2023-03-02T10:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.730+0000 7fc3728e7b80 1 -- 172.21.15.57:0/1218941232 shutdown_connections 2023-03-02T10:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.730+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/1218941232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x557597881560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.730+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/1218941232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 0x55759787c790 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.730+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/1218941232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 0x557597880bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.730+0000 7fc3728e7b80 1 -- 172.21.15.57:0/1218941232 >> 172.21.15.57:0/1218941232 conn(0x557597871c50 msgr2=0x557597877460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.730+0000 7fc3728e7b80 1 -- 172.21.15.57:0/1218941232 shutdown_connections 2023-03-02T10:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.730+0000 7fc3728e7b80 1 -- 172.21.15.57:0/1218941232 wait complete. 2023-03-02T10:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.730+0000 7fc3728e7b80 1 -- start start 2023-03-02T10:57:21.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.730+0000 7fc3728e7b80 1 Processor -- start 2023-03-02T10:57:21.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787c3c0 0x557597888900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 0x557597885b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x5575978862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575977d4bc0 con 0x55759787ccd0 2023-03-02T10:57:21.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575977ce0f0 con 0x557597881110 2023-03-02T10:57:21.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x557597652920 con 0x55759787c3c0 2023-03-02T10:57:21.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc3728e7b80 10 client.0 _ll_register_callbacks cb 0x557597774520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:21.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc357fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 0x557597885b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc357fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 0x557597885b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60518/0 (socket says 172.21.15.57:60518) 2023-03-02T10:57:21.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc357fff700 1 -- 172.21.15.57:0/3931956893 learned_addr learned my addr 172.21.15.57:0/3931956893 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:21.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787c3c0 0x557597888900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc35d59c700 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x5575978862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc357fff700 1 -- 172.21.15.57:0/3931956893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787c3c0 msgr2=0x557597888900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:21.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc357fff700 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787c3c0 0x557597888900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc357fff700 1 -- 172.21.15.57:0/3931956893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 msgr2=0x5575978862c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:21.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc357fff700 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x5575978862c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc357fff700 1 -- 172.21.15.57:0/3931956893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c007d40 con 0x55759787ccd0 2023-03-02T10:57:21.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc35d59c700 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x5575978862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:21.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc357fff700 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 0x557597885b80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc344013390 tx=0x7fc3440047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399aca4bdc441c5b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:21.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.731+0000 7fc337fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:21.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc337fff700 1 -- 172.21.15.57:0/3931956893 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344011650 con 0x55759787ccd0 2023-03-02T10:57:21.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3931956893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55759779f7b0 con 0x55759787ccd0 2023-03-02T10:57:21.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc337fff700 1 -- 172.21.15.57:0/3931956893 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc3440117b0 con 0x55759787ccd0 2023-03-02T10:57:21.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc337fff700 1 -- 172.21.15.57:0/3931956893 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc344011970 con 0x55759787ccd0 2023-03-02T10:57:21.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc3728e7b80 10 client.15558 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:21.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3931956893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5575975fcde0 con 0x55759787ccd0 2023-03-02T10:57:21.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc337fff700 1 -- 172.21.15.57:0/3931956893 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55759779f7b0 con 0x55759787ccd0 2023-03-02T10:57:21.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc337fff700 1 -- 172.21.15.57:0/3931956893 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc34401fb30 con 0x55759787ccd0 2023-03-02T10:57:21.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc3728e7b80 10 client.15558 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:21.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc3728e7b80 10 client.15558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:21.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc3728e7b80 20 client.15558 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:21.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x557597896330 0x557597898740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc3728e7b80 4 client.15558 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:21.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.732+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3931956893 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575977c7170 con 0x557597896330 2023-03-02T10:57:21.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.733+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x557597896330 0x557597898740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.733+0000 7fc337fff700 10 client.15558 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:21.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.733+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x557597896330 0x557597898740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a0aba2c245f0324 server_cookie=168e0fd4372aa9b7 in_seq=0 out_seq=0 2023-03-02T10:57:21.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc337fff700 1 -- 172.21.15.57:0/3931956893 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5575977c7170 con 0x557597896330 2023-03-02T10:57:21.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc337fff700 10 client.15558 handle_command_reply: tid=0 2023-03-02T10:57:21.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc3728e7b80 1 client.15558 shutdown 2023-03-02T10:57:21.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3931956893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 msgr2=0x557597885b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 0x557597885b80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc344013390 tx=0x7fc3440047c0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3931956893 shutdown_connections 2023-03-02T10:57:21.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x557597896330 0x557597898740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x5575978862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787c3c0 0x557597888900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3931956893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 0x557597885b80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc337fff700 0 client.15558 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:21.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3931956893 >> 172.21.15.57:0/3931956893 conn(0x557597871c50 msgr2=0x557597877050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:21.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3931956893 shutdown_connections 2023-03-02T10:57:21.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.734+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3931956893 wait complete. 2023-03-02T10:57:21.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.735+0000 7fc3728e7b80 20 client.15558 trim_cache size 0 max 16384 2023-03-02T10:57:21.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.751+0000 7fc3728e7b80 1 Processor -- start 2023-03-02T10:57:21.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.751+0000 7fc3728e7b80 1 -- start start 2023-03-02T10:57:21.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55759787c3c0 0x5575978917e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 0x557597891d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557597881110 0x557597880120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575978762a0 con 0x55759787ccd0 2023-03-02T10:57:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x557597892260 con 0x55759787c3c0 2023-03-02T10:57:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759787d420 con 0x557597881110 2023-03-02T10:57:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc357fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 0x557597891d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc35cd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55759787c3c0 0x5575978917e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc357fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 0x557597891d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60524/0 (socket says 172.21.15.57:60524) 2023-03-02T10:57:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc357fff700 1 -- 172.21.15.57:0/1938236350 learned_addr learned my addr 172.21.15.57:0/1938236350 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc35d59c700 1 --2- 172.21.15.57:0/1938236350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557597881110 0x557597880120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc35cd9b700 1 -- 172.21.15.57:0/1938236350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557597881110 msgr2=0x557597880120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/1938236350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557597881110 0x557597880120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc35cd9b700 1 -- 172.21.15.57:0/1938236350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 msgr2=0x557597891d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:21.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/1938236350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 0x557597891d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc35cd9b700 1 -- 172.21.15.57:0/1938236350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557597878aa0 con 0x55759787c3c0 2023-03-02T10:57:21.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.752+0000 7fc35d59c700 1 --2- 172.21.15.57:0/1938236350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557597881110 0x557597880120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:57:21.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.753+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/1938236350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55759787c3c0 0x5575978917e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc34c010550 tx=0x7fc34c005d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bfbbd30e8972eb5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:21.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.753+0000 7fc3437fe700 1 -- 172.21.15.57:0/1938236350 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c02a1e0 con 0x55759787c3c0 2023-03-02T10:57:21.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.753+0000 7fc3437fe700 1 -- 172.21.15.57:0/1938236350 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc34c02ade0 con 0x55759787c3c0 2023-03-02T10:57:21.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.753+0000 7fc3437fe700 1 -- 172.21.15.57:0/1938236350 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0038e0 con 0x55759787c3c0 2023-03-02T10:57:21.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.753+0000 7fc3728e7b80 1 -- 172.21.15.57:0/1938236350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55759787c3c0 msgr2=0x5575978917e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.753+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/1938236350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55759787c3c0 0x5575978917e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc34c010550 tx=0x7fc34c005d40 comp rx=0 tx=0).stop 2023-03-02T10:57:21.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.754+0000 7fc3728e7b80 1 -- 172.21.15.57:0/1938236350 shutdown_connections 2023-03-02T10:57:21.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.754+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/1938236350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557597881110 0x557597880120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.754+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/1938236350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55759787c3c0 0x5575978917e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.754+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/1938236350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787ccd0 0x557597891d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.754+0000 7fc3728e7b80 1 -- 172.21.15.57:0/1938236350 >> 172.21.15.57:0/1938236350 conn(0x557597871c50 msgr2=0x557597892610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:21.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.754+0000 7fc3728e7b80 1 -- 172.21.15.57:0/1938236350 shutdown_connections 2023-03-02T10:57:21.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.754+0000 7fc3728e7b80 1 -- 172.21.15.57:0/1938236350 wait complete. 2023-03-02T10:57:21.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.754+0000 7fc3728e7b80 1 -- start start 2023-03-02T10:57:21.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.754+0000 7fc3728e7b80 1 Processor -- start 2023-03-02T10:57:21.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 0x557597884780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 0x557597884cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc3728e7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x5575978e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x557597885560 con 0x55759787c3c0 2023-03-02T10:57:21.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575978e8120 con 0x557597881110 2023-03-02T10:57:21.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc3728e7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575978e8260 con 0x55759787ccd0 2023-03-02T10:57:21.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc3728e7b80 10 client.0 _ll_register_callbacks cb 0x557597774520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:21.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc35cd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 0x557597884780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc357fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 0x557597884cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc357fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 0x557597884cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:44030/0 (socket says 172.21.15.57:44030) 2023-03-02T10:57:21.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc357fff700 1 -- 172.21.15.57:0/3146190735 learned_addr learned my addr 172.21.15.57:0/3146190735 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:21.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc35d59c700 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x5575978e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc357fff700 1 -- 172.21.15.57:0/3146190735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 msgr2=0x5575978e7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:21.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc357fff700 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x5575978e7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc357fff700 1 -- 172.21.15.57:0/3146190735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 msgr2=0x557597884780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:21.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc357fff700 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 0x557597884780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.755+0000 7fc357fff700 1 -- 172.21.15.57:0/3146190735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c01e040 con 0x55759787ccd0 2023-03-02T10:57:21.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc357fff700 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 0x557597884cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc344013390 tx=0x7fc344011b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4adf863186497235 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:21.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc337fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:57:21.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc337fff700 1 -- 172.21.15.57:0/3146190735 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34400fe40 con 0x55759787ccd0 2023-03-02T10:57:21.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3146190735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc34c015070 con 0x55759787ccd0 2023-03-02T10:57:21.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc337fff700 1 -- 172.21.15.57:0/3146190735 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc3440136b0 con 0x55759787ccd0 2023-03-02T10:57:21.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc337fff700 1 -- 172.21.15.57:0/3146190735 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc34402b4b0 con 0x55759787ccd0 2023-03-02T10:57:21.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc3728e7b80 10 client.25381 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:21.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3146190735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5575975e5c60 con 0x55759787ccd0 2023-03-02T10:57:21.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc337fff700 1 -- 172.21.15.57:0/3146190735 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc34c015070 con 0x55759787ccd0 2023-03-02T10:57:21.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc337fff700 1 -- 172.21.15.57:0/3146190735 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc34401f420 con 0x55759787ccd0 2023-03-02T10:57:21.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc3728e7b80 10 client.25381 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:21.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc3728e7b80 10 client.25381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:21.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc3728e7b80 20 client.25381 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:21.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.756+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5575978e9680 0x5575978eba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.757+0000 7fc3728e7b80 4 client.25381 mds_command: new command op to 24560 tid=0[{"prefix": "scrub status"}] 2023-03-02T10:57:21.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.757+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3146190735 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5575977c6e90 con 0x5575978e9680 2023-03-02T10:57:21.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.757+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5575978e9680 0x5575978eba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.757+0000 7fc35cd9b700 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5575978e9680 0x5575978eba90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2cf1ccbabbe4ea server_cookie=a93e8845ebd1f107 in_seq=0 out_seq=0 2023-03-02T10:57:21.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.757+0000 7fc337fff700 10 client.25381 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:21.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.757+0000 7fc337fff700 1 -- 172.21.15.57:0/3146190735 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5575977c6e90 con 0x5575978e9680 2023-03-02T10:57:21.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.757+0000 7fc337fff700 10 client.25381 handle_command_reply: tid=0 2023-03-02T10:57:21.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.757+0000 7fc3728e7b80 1 client.25381 shutdown 2023-03-02T10:57:21.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.757+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3146190735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 msgr2=0x557597884cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.757+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 0x557597884cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc344013390 tx=0x7fc344011b20 comp rx=0 tx=0).stop 2023-03-02T10:57:21.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3146190735 shutdown_connections 2023-03-02T10:57:21.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5575978e9680 0x5575978eba90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557597881110 0x5575978e7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55759787c3c0 0x557597884780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc3728e7b80 1 --2- 172.21.15.57:0/3146190735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55759787ccd0 0x557597884cc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3146190735 >> 172.21.15.57:0/3146190735 conn(0x557597871c50 msgr2=0x55759787f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:21.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc337fff700 0 client.25381 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:21.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3146190735 shutdown_connections 2023-03-02T10:57:21.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc3728e7b80 1 -- 172.21.15.57:0/3146190735 wait complete. 2023-03-02T10:57:21.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc3728e7b80 20 client.25381 trim_cache size 0 max 16384 2023-03-02T10:57:21.770 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:57:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "no active scrubs running", 2023-03-02T10:57:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": {} 2023-03-02T10:57:21.771 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:57:21.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc35efff700 1 -- 172.21.15.57:0/243516363 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc34809b540 msgr2=0x7fc34809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc35efff700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc34809b540 0x7fc34809d9f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc358073fc0 tx=0x7fc344009bb0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc35efff700 1 -- 172.21.15.57:0/243516363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc358105ae0 msgr2=0x7fc358073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc35efff700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc358105ae0 0x7fc358073310 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc350009fd0 tx=0x7fc35000bce0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc35efff700 1 -- 172.21.15.57:0/243516363 shutdown_connections 2023-03-02T10:57:21.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc35efff700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc34809b540 0x7fc34809d9f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc35efff700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc358105ae0 0x7fc358073310 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc35efff700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3580ffad0 0x7fc358072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc35efff700 1 --2- 172.21.15.57:0/243516363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc358100480 0x7fc358072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc35efff700 1 -- 172.21.15.57:0/243516363 >> 172.21.15.57:0/243516363 conn(0x7fc3580fb610 msgr2=0x7fc3581035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:21.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.758+0000 7fc35efff700 1 -- 172.21.15.57:0/243516363 shutdown_connections 2023-03-02T10:57:21.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.759+0000 7fc35efff700 1 -- 172.21.15.57:0/243516363 wait complete. 2023-03-02T10:57:21.776 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-03-02T10:57:21.777 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:57:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:4000000 of 50000000 tuples (8%) done (elapsed 6.67 s, remaining 76.68 s) 2023-03-02T10:57:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:21 smithi057 ceph-mon[92072]: pgmap v13: 97 pgs: 97 active+clean; 123 MiB data, 158 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 17 MiB/s wr, 304 op/s 2023-03-02T10:57:21.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.940+0000 7f819a9ff700 1 -- 172.21.15.57:0/4220053013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8194101600 msgr2=0x7f8194109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.940+0000 7f819a9ff700 1 --2- 172.21.15.57:0/4220053013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8194101600 0x7f8194109af0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8188009990 tx=0x7f8188009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.940+0000 7f819a9ff700 1 -- 172.21.15.57:0/4220053013 shutdown_connections 2023-03-02T10:57:21.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.940+0000 7f819a9ff700 1 --2- 172.21.15.57:0/4220053013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819410a0c0 0x7f819410c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.940+0000 7f819a9ff700 1 --2- 172.21.15.57:0/4220053013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8194100cf0 0x7f81941010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.940+0000 7f819a9ff700 1 --2- 172.21.15.57:0/4220053013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8194101600 0x7f8194109af0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.940+0000 7f819a9ff700 1 -- 172.21.15.57:0/4220053013 >> 172.21.15.57:0/4220053013 conn(0x7f81940fa4c0 msgr2=0x7f81940fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:21.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.940+0000 7f819a9ff700 1 -- 172.21.15.57:0/4220053013 shutdown_connections 2023-03-02T10:57:21.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.940+0000 7f819a9ff700 1 -- 172.21.15.57:0/4220053013 wait complete. 2023-03-02T10:57:21.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f819a9ff700 1 Processor -- start 2023-03-02T10:57:21.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f819a9ff700 1 -- start start 2023-03-02T10:57:21.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f819a9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8194100cf0 0x7f8194197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f819a9ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8194101600 0x7f8194198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f819a9ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819410a0c0 0x7f819419c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f819a9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819419ce00 con 0x7f8194100cf0 2023-03-02T10:57:21.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f819a9ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819419cf70 con 0x7f819410a0c0 2023-03-02T10:57:21.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f819a9ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819419d130 con 0x7f8194101600 2023-03-02T10:57:21.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f8193fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8194100cf0 0x7f8194197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f8193fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8194100cf0 0x7f8194197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60544/0 (socket says 172.21.15.57:60544) 2023-03-02T10:57:21.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f8193fff700 1 -- 172.21.15.57:0/550458476 learned_addr learned my addr 172.21.15.57:0/550458476 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:21.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f81937fe700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8194101600 0x7f8194198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.941+0000 7f8198f9c700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819410a0c0 0x7f819419c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.942+0000 7f8193fff700 1 -- 172.21.15.57:0/550458476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8194101600 msgr2=0x7f8194198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.942+0000 7f8193fff700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8194101600 0x7f8194198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.942+0000 7f8193fff700 1 -- 172.21.15.57:0/550458476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819410a0c0 msgr2=0x7f819419c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:21.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.942+0000 7f8193fff700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819410a0c0 0x7f819419c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:21.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.942+0000 7f8193fff700 1 -- 172.21.15.57:0/550458476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81880095f0 con 0x7f8194100cf0 2023-03-02T10:57:21.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.942+0000 7f8193fff700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8194100cf0 0x7f8194197e20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f818400d980 tx=0x7f818400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:21.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.942+0000 7f81917fa700 1 -- 172.21.15.57:0/550458476 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184004220 con 0x7f8194100cf0 2023-03-02T10:57:21.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.942+0000 7f81917fa700 1 -- 172.21.15.57:0/550458476 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8184007640 con 0x7f8194100cf0 2023-03-02T10:57:21.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.942+0000 7f819a9ff700 1 -- 172.21.15.57:0/550458476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819410fb90 con 0x7f8194100cf0 2023-03-02T10:57:21.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.942+0000 7f81917fa700 1 -- 172.21.15.57:0/550458476 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184005690 con 0x7f8194100cf0 2023-03-02T10:57:21.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.942+0000 7f819a9ff700 1 -- 172.21.15.57:0/550458476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819410fa00 con 0x7f8194100cf0 2023-03-02T10:57:21.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.944+0000 7f819a9ff700 1 -- 172.21.15.57:0/550458476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819410fd20 con 0x7f8194100cf0 2023-03-02T10:57:21.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.946+0000 7f81917fa700 1 -- 172.21.15.57:0/550458476 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f8184021070 con 0x7f8194100cf0 2023-03-02T10:57:21.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.948+0000 7f81917fa700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f817c09b4c0 0x7f817c09d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:21.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.948+0000 7f81917fa700 1 -- 172.21.15.57:0/550458476 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f81840c4e60 con 0x7f8194100cf0 2023-03-02T10:57:21.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.949+0000 7f81937fe700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f817c09b4c0 0x7f817c09d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:21 smithi122 ceph-mon[125440]: pgmap v13: 97 pgs: 97 active+clean; 123 MiB data, 158 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 17 MiB/s wr, 304 op/s 2023-03-02T10:57:21.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.949+0000 7f81937fe700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f817c09b4c0 0x7f817c09d970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8194199430 tx=0x7f8188005fd0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:21.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:21.953+0000 7f81917fa700 1 -- 172.21.15.57:0/550458476 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7f81840905c0 con 0x7f8194100cf0 2023-03-02T10:57:22.044 INFO:teuthology.orchestra.run.smithi057.stderr:4100000 of 50000000 tuples (8%) done (elapsed 6.85 s, remaining 76.67 s) 2023-03-02T10:57:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:21 smithi136 ceph-mon[125702]: pgmap v13: 97 pgs: 97 active+clean; 123 MiB data, 158 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 17 MiB/s wr, 304 op/s 2023-03-02T10:57:22.168 INFO:teuthology.orchestra.run.smithi057.stderr:4200000 of 50000000 tuples (8%) done (elapsed 6.97 s, remaining 76.04 s) 2023-03-02T10:57:22.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.220+0000 7f819a9ff700 1 -- 172.21.15.57:0/550458476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8194067280 con 0x7f8194100cf0 2023-03-02T10:57:22.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.223+0000 7f81917fa700 1 -- 172.21.15.57:0/550458476 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10828 (secure 0 0 0) 0x7f8184016030 con 0x7f8194100cf0 2023-03-02T10:57:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:22.226 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-02T10:55:10.601054+0000","modified":"2023-03-02T10:55:17.554509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24520,"mds_2":24505,"mds_3":24493,"mds_4":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14634":{"gid":14634,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6841/3731858530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6840","nonce":3731858530},{"type":"v1","addr":"172.21.15.57:6841","nonce":3731858530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"e","rank":4,"incarnation":24,"state":"up:active","state_seq":9,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24505":{"gid":24505,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/316639764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":316639764},{"type":"v1","addr":"172.21.15.122:6839","nonce":316639764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-02T10:57:22.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.226+0000 7f819a9ff700 1 -- 172.21.15.57:0/550458476 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f817c09b4c0 msgr2=0x7f817c09d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.226+0000 7f819a9ff700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f817c09b4c0 0x7f817c09d970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8194199430 tx=0x7f8188005fd0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.226+0000 7f819a9ff700 1 -- 172.21.15.57:0/550458476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8194100cf0 msgr2=0x7f8194197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.226+0000 7f819a9ff700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8194100cf0 0x7f8194197e20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f818400d980 tx=0x7f818400dc90 comp rx=0 tx=0).stop 2023-03-02T10:57:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.226+0000 7f819a9ff700 1 -- 172.21.15.57:0/550458476 shutdown_connections 2023-03-02T10:57:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.226+0000 7f819a9ff700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f817c09b4c0 0x7f817c09d970 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.227+0000 7f819a9ff700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819410a0c0 0x7f819419c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.227+0000 7f819a9ff700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8194100cf0 0x7f8194197e20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.227+0000 7f819a9ff700 1 --2- 172.21.15.57:0/550458476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8194101600 0x7f8194198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.227+0000 7f819a9ff700 1 -- 172.21.15.57:0/550458476 >> 172.21.15.57:0/550458476 conn(0x7f81940fa4c0 msgr2=0x7f819410c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.227+0000 7f819a9ff700 1 -- 172.21.15.57:0/550458476 shutdown_connections 2023-03-02T10:57:22.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.227+0000 7f819a9ff700 1 -- 172.21.15.57:0/550458476 wait complete. 2023-03-02T10:57:22.231 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-03-02T10:57:22.248 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-03-02T10:57:22.378 INFO:teuthology.orchestra.run.smithi057.stderr:4300000 of 50000000 tuples (8%) done (elapsed 7.18 s, remaining 76.34 s) 2023-03-02T10:57:22.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.408+0000 7fb1b4dff700 1 -- 172.21.15.57:0/1466835815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0105ac0 msgr2=0x7fb1b0105e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.408+0000 7fb1b4dff700 1 --2- 172.21.15.57:0/1466835815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0105ac0 0x7fb1b0105e90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009990 tx=0x7fb1a0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.408+0000 7fb1b4dff700 1 -- 172.21.15.57:0/1466835815 shutdown_connections 2023-03-02T10:57:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.408+0000 7fb1b4dff700 1 --2- 172.21.15.57:0/1466835815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1b0100460 0x7fb1b010c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.409+0000 7fb1b4dff700 1 --2- 172.21.15.57:0/1466835815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0105ac0 0x7fb1b0105e90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.409+0000 7fb1b4dff700 1 --2- 172.21.15.57:0/1466835815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1b00ffab0 0x7fb1b00fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.409+0000 7fb1b4dff700 1 -- 172.21.15.57:0/1466835815 >> 172.21.15.57:0/1466835815 conn(0x7fb1b00fb610 msgr2=0x7fb1b00fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.409+0000 7fb1b4dff700 1 -- 172.21.15.57:0/1466835815 shutdown_connections 2023-03-02T10:57:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.409+0000 7fb1b4dff700 1 -- 172.21.15.57:0/1466835815 wait complete. 2023-03-02T10:57:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.409+0000 7fb1b4dff700 1 Processor -- start 2023-03-02T10:57:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.409+0000 7fb1b4dff700 1 -- start start 2023-03-02T10:57:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1b4dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1b00ffab0 0x7fb1b019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1b4dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1b0100460 0x7fb1b019bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1b4dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0105ac0 0x7fb1b0195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1b4dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0196080 con 0x7fb1b0105ac0 2023-03-02T10:57:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1b4dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b01961f0 con 0x7fb1b00ffab0 2023-03-02T10:57:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1b4dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b01963b0 con 0x7fb1b0100460 2023-03-02T10:57:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1aed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0105ac0 0x7fb1b0195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1b00ffab0 0x7fb1b019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1add9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1b0100460 0x7fb1b019bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1b00ffab0 0x7fb1b019b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59334/0 (socket says 172.21.15.57:59334) 2023-03-02T10:57:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1aed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0105ac0 0x7fb1b0195a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60562/0 (socket says 172.21.15.57:60562) 2023-03-02T10:57:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1ae59c700 1 -- 172.21.15.57:0/571680166 learned_addr learned my addr 172.21.15.57:0/571680166 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1ae59c700 1 -- 172.21.15.57:0/571680166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1b0100460 msgr2=0x7fb1b019bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1b0100460 0x7fb1b019bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1ae59c700 1 -- 172.21.15.57:0/571680166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0105ac0 msgr2=0x7fb1b0195a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0105ac0 0x7fb1b0195a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1ae59c700 1 -- 172.21.15.57:0/571680166 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00095f0 con 0x7fb1b00ffab0 2023-03-02T10:57:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.410+0000 7fb1aed9d700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0105ac0 0x7fb1b0195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.411+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1b00ffab0 0x7fb1b019b9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000b2e0 tx=0x7fb1a0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.411+0000 7fb19f7fe700 1 -- 172.21.15.57:0/571680166 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a001d070 con 0x7fb1b00ffab0 2023-03-02T10:57:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.411+0000 7fb1b4dff700 1 -- 172.21.15.57:0/571680166 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b010faf0 con 0x7fb1b00ffab0 2023-03-02T10:57:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.411+0000 7fb19f7fe700 1 -- 172.21.15.57:0/571680166 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1a0005030 con 0x7fb1b00ffab0 2023-03-02T10:57:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.411+0000 7fb19f7fe700 1 -- 172.21.15.57:0/571680166 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0004a40 con 0x7fb1b00ffab0 2023-03-02T10:57:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.411+0000 7fb1b4dff700 1 -- 172.21.15.57:0/571680166 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b010f960 con 0x7fb1b00ffab0 2023-03-02T10:57:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.413+0000 7fb19f7fe700 1 -- 172.21.15.57:0/571680166 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7fb1a0028030 con 0x7fb1b00ffab0 2023-03-02T10:57:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.414+0000 7fb19f7fe700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb19809b4c0 0x7fb19809d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.415+0000 7fb19f7fe700 1 -- 172.21.15.57:0/571680166 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb1a00c60c0 con 0x7fb1b00ffab0 2023-03-02T10:57:22.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.415+0000 7fb1add9b700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb19809b4c0 0x7fb19809d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.415+0000 7fb1c86c0b80 1 Processor -- start 2023-03-02T10:57:22.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.415+0000 7fb1c86c0b80 1 -- start start 2023-03-02T10:57:22.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.415+0000 7fb1add9b700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb19809b4c0 0x7fb19809d970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0105480 tx=0x7fb1a4009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.415+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 0x564e398de790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.415+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398decd0 0x564e398e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.415+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398e3110 0x564e398e3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e39845a60 con 0x564e398de3c0 2023-03-02T10:57:22.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e397f7f80 con 0x564e398e3110 2023-03-02T10:57:22.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e397c8160 con 0x564e398decd0 2023-03-02T10:57:22.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 0x564e398de790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 0x564e398de790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60568/0 (socket says 172.21.15.57:60568) 2023-03-02T10:57:22.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1ae59c700 1 -- 172.21.15.57:0/2388464109 learned_addr learned my addr 172.21.15.57:0/2388464109 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1add9b700 1 --2- 172.21.15.57:0/2388464109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398decd0 0x564e398e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1aed9d700 1 --2- 172.21.15.57:0/2388464109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398e3110 0x564e398e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1ae59c700 1 -- 172.21.15.57:0/2388464109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398decd0 msgr2=0x564e398e2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/2388464109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398decd0 0x564e398e2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1ae59c700 1 -- 172.21.15.57:0/2388464109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398e3110 msgr2=0x564e398e3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/2388464109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398e3110 0x564e398e3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1ae59c700 1 -- 172.21.15.57:0/2388464109 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e396b2630 con 0x564e398de3c0 2023-03-02T10:57:22.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1aed9d700 1 --2- 172.21.15.57:0/2388464109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398e3110 0x564e398e3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:22.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/2388464109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 0x564e398de790 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00954a0 tx=0x7fb1a0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447ecae12e7914e5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.416+0000 7fb19cff9700 1 -- 172.21.15.57:0/2388464109 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0095c10 con 0x564e398de3c0 2023-03-02T10:57:22.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.417+0000 7fb19cff9700 1 -- 172.21.15.57:0/2388464109 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1a0095510 con 0x564e398de3c0 2023-03-02T10:57:22.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.417+0000 7fb19cff9700 1 -- 172.21.15.57:0/2388464109 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a00959b0 con 0x564e398de3c0 2023-03-02T10:57:22.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.417+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/2388464109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 msgr2=0x564e398de790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.417+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/2388464109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 0x564e398de790 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00954a0 tx=0x7fb1a0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.417+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/2388464109 shutdown_connections 2023-03-02T10:57:22.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.417+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/2388464109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398e3110 0x564e398e3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.417+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/2388464109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 0x564e398de790 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.417+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/2388464109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398decd0 0x564e398e2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.417+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/2388464109 >> 172.21.15.57:0/2388464109 conn(0x564e398d3c50 msgr2=0x564e398d9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.417+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/2388464109 shutdown_connections 2023-03-02T10:57:22.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.417+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/2388464109 wait complete. 2023-03-02T10:57:22.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.418+0000 7fb1c86c0b80 1 -- start start 2023-03-02T10:57:22.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.418+0000 7fb1c86c0b80 1 Processor -- start 2023-03-02T10:57:22.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.418+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e398ea820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.418+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398decd0 0x564e398e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.418+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398e3110 0x564e398e80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.418+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e39836bc0 con 0x564e398e3110 2023-03-02T10:57:22.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.418+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e398300f0 con 0x564e398de3c0 2023-03-02T10:57:22.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.418+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e396b4920 con 0x564e398decd0 2023-03-02T10:57:22.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.418+0000 7fb1c86c0b80 10 client.0 _ll_register_callbacks cb 0x564e397d6520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:22.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e398ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e398ea820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59352/0 (socket says 172.21.15.57:59352) 2023-03-02T10:57:22.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1ae59c700 1 -- 172.21.15.57:0/3031702549 learned_addr learned my addr 172.21.15.57:0/3031702549 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1aed9d700 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398e3110 0x564e398e80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1add9b700 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398decd0 0x564e398e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1ae59c700 1 -- 172.21.15.57:0/3031702549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398decd0 msgr2=0x564e398e7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398decd0 0x564e398e7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1ae59c700 1 -- 172.21.15.57:0/3031702549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398e3110 msgr2=0x564e398e80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398e3110 0x564e398e80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1ae59c700 1 -- 172.21.15.57:0/3031702549 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b010f960 con 0x564e398de3c0 2023-03-02T10:57:22.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e398ea820 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0091a10 tx=0x7fb1a00c3d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e02536b755c52df3 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb195ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:22.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb195ffb700 1 -- 172.21.15.57:0/3031702549 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a009cba0 con 0x564e398de3c0 2023-03-02T10:57:22.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb195ffb700 1 -- 172.21.15.57:0/3031702549 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb1a0095770 con 0x564e398de3c0 2023-03-02T10:57:22.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.419+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3031702549 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e398017b0 con 0x564e398de3c0 2023-03-02T10:57:22.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb195ffb700 1 -- 172.21.15.57:0/3031702549 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1a0095930 con 0x564e398de3c0 2023-03-02T10:57:22.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb1c86c0b80 10 client.25448 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:22.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3031702549 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564e3965ede0 con 0x564e398de3c0 2023-03-02T10:57:22.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb195ffb700 1 -- 172.21.15.57:0/3031702549 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564e398017b0 con 0x564e398de3c0 2023-03-02T10:57:22.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb195ffb700 1 -- 172.21.15.57:0/3031702549 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb1a00aa070 con 0x564e398de3c0 2023-03-02T10:57:22.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb1c86c0b80 10 client.25448 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:22.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb1c86c0b80 10 client.25448 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-03-02T10:57:22.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb1c86c0b80 20 client.25448 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:22.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x564e398f7af0 0x564e398f9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb1c86c0b80 4 client.25448 mds_command: new command op to 24491 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:22.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3031702549 --> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e39829170 con 0x564e398f7af0 2023-03-02T10:57:22.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.420+0000 7fb1add9b700 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x564e398f7af0 0x564e398f9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.421+0000 7fb195ffb700 10 client.25448 ms_handle_connect on v2:172.21.15.122:6834/1841258715 2023-03-02T10:57:22.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.421+0000 7fb1add9b700 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x564e398f7af0 0x564e398f9ed0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7f3f8486c92f2ecb server_cookie=17596fc1040a6a64 in_seq=0 out_seq=0 2023-03-02T10:57:22.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.421+0000 7fb195ffb700 1 -- 172.21.15.57:0/3031702549 <== mds.4 v2:172.21.15.122:6834/1841258715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x564e39829170 con 0x564e398f7af0 2023-03-02T10:57:22.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.421+0000 7fb195ffb700 10 client.25448 handle_command_reply: tid=0 2023-03-02T10:57:22.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.421+0000 7fb1c86c0b80 1 client.25448 shutdown 2023-03-02T10:57:22.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3031702549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 msgr2=0x564e398ea820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e398ea820 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0091a10 tx=0x7fb1a00c3d10 comp rx=0 tx=0).stop 2023-03-02T10:57:22.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3031702549 shutdown_connections 2023-03-02T10:57:22.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x564e398f7af0 0x564e398f9ed0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398e3110 0x564e398e80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e398ea820 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3031702549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398decd0 0x564e398e7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb195ffb700 0 client.25448 ms_handle_reset on v2:172.21.15.122:6834/1841258715 2023-03-02T10:57:22.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3031702549 >> 172.21.15.57:0/3031702549 conn(0x564e398d3c50 msgr2=0x564e398d9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3031702549 shutdown_connections 2023-03-02T10:57:22.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3031702549 wait complete. 2023-03-02T10:57:22.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.422+0000 7fb1c86c0b80 20 client.25448 trim_cache size 0 max 16384 2023-03-02T10:57:22.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.435+0000 7fb1c86c0b80 1 Processor -- start 2023-03-02T10:57:22.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.435+0000 7fb1c86c0b80 1 -- start start 2023-03-02T10:57:22.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.435+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 0x564e398ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.435+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398decd0 0x564e398e2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.435+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398e3110 0x564e398e25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.435+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e398df420 con 0x564e398de3c0 2023-03-02T10:57:22.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.435+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e398e9080 con 0x564e398decd0 2023-03-02T10:57:22.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.435+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e398fea80 con 0x564e398e3110 2023-03-02T10:57:22.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 0x564e398ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb1add9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398decd0 0x564e398e2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 0x564e398ea3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60584/0 (socket says 172.21.15.57:60584) 2023-03-02T10:57:22.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb1ae59c700 1 -- 172.21.15.57:0/149964259 learned_addr learned my addr 172.21.15.57:0/149964259 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb1aed9d700 1 --2- 172.21.15.57:0/149964259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398e3110 0x564e398e25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb1add9b700 1 -- 172.21.15.57:0/149964259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398e3110 msgr2=0x564e398e25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb1add9b700 1 --2- 172.21.15.57:0/149964259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398e3110 0x564e398e25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb1add9b700 1 -- 172.21.15.57:0/149964259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 msgr2=0x564e398ea3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb1add9b700 1 --2- 172.21.15.57:0/149964259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 0x564e398ea3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb1add9b700 1 -- 172.21.15.57:0/149964259 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e397f7190 con 0x564e398decd0 2023-03-02T10:57:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb1add9b700 1 --2- 172.21.15.57:0/149964259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398decd0 0x564e398e2060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x564e398fa7b0 tx=0x7fb1a4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c19257dd5746d3ed server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb19d7fa700 1 -- 172.21.15.57:0/149964259 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40039c0 con 0x564e398decd0 2023-03-02T10:57:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb19d7fa700 1 -- 172.21.15.57:0/149964259 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1a4023040 con 0x564e398decd0 2023-03-02T10:57:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.436+0000 7fb19d7fa700 1 -- 172.21.15.57:0/149964259 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a401d670 con 0x564e398decd0 2023-03-02T10:57:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.437+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/149964259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398decd0 msgr2=0x564e398e2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.437+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/149964259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398decd0 0x564e398e2060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x564e398fa7b0 tx=0x7fb1a4014000 comp rx=0 tx=0).stop 2023-03-02T10:57:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.437+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/149964259 shutdown_connections 2023-03-02T10:57:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.437+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/149964259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398e3110 0x564e398e25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.437+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/149964259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398de3c0 0x564e398ea3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.437+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/149964259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398decd0 0x564e398e2060 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.437+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/149964259 >> 172.21.15.57:0/149964259 conn(0x564e398d3c50 msgr2=0x564e398f3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.437+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/149964259 shutdown_connections 2023-03-02T10:57:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.437+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/149964259 wait complete. 2023-03-02T10:57:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1c86c0b80 1 -- start start 2023-03-02T10:57:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1c86c0b80 1 Processor -- start 2023-03-02T10:57:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e39942cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398decd0 0x564e399431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1c86c0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398e3110 0x564e3993d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e3993d9a0 con 0x564e398decd0 2023-03-02T10:57:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e3993db10 con 0x564e398de3c0 2023-03-02T10:57:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1c86c0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e3993dcd0 con 0x564e398e3110 2023-03-02T10:57:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1c86c0b80 10 client.0 _ll_register_callbacks cb 0x564e397d6520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e39942cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e39942cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59380/0 (socket says 172.21.15.57:59380) 2023-03-02T10:57:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1add9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398decd0 0x564e399431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.438+0000 7fb1ae59c700 1 -- 172.21.15.57:0/3566884227 learned_addr learned my addr 172.21.15.57:0/3566884227 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb1aed9d700 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398e3110 0x564e3993d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb1ae59c700 1 -- 172.21.15.57:0/3566884227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398e3110 msgr2=0x564e3993d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398e3110 0x564e3993d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb1ae59c700 1 -- 172.21.15.57:0/3566884227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398decd0 msgr2=0x564e399431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398decd0 0x564e399431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb1ae59c700 1 -- 172.21.15.57:0/3566884227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a4017070 con 0x564e398de3c0 2023-03-02T10:57:22.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb1aed9d700 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398e3110 0x564e3993d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:22.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb1ae59c700 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e39942cb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00095c0 tx=0x7fb1a0094d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5efa490307b74d89 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb195ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:22.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb195ffb700 1 -- 172.21.15.57:0/3566884227 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0095050 con 0x564e398de3c0 2023-03-02T10:57:22.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3566884227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1a0095510 con 0x564e398de3c0 2023-03-02T10:57:22.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.439+0000 7fb195ffb700 1 -- 172.21.15.57:0/3566884227 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb1a009cba0 con 0x564e398de3c0 2023-03-02T10:57:22.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb195ffb700 1 -- 172.21.15.57:0/3566884227 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1a000fad0 con 0x564e398de3c0 2023-03-02T10:57:22.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb1c86c0b80 10 client.25454 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:22.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3566884227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564e39685250 con 0x564e398de3c0 2023-03-02T10:57:22.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb195ffb700 1 -- 172.21.15.57:0/3566884227 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1a0095510 con 0x564e398de3c0 2023-03-02T10:57:22.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb195ffb700 1 -- 172.21.15.57:0/3566884227 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb1a0004c20 con 0x564e398de3c0 2023-03-02T10:57:22.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb1c86c0b80 10 client.25454 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:22.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb1c86c0b80 10 client.25454 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-03-02T10:57:22.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb1c86c0b80 20 client.25454 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:22.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x564e3994a5a0 0x564e3994c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb1c86c0b80 4 client.25454 mds_command: new command op to 24491 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:57:22.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3566884227 --> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564e39828e90 con 0x564e3994a5a0 2023-03-02T10:57:22.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.440+0000 7fb1add9b700 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x564e3994a5a0 0x564e3994c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb195ffb700 10 client.25454 ms_handle_connect on v2:172.21.15.122:6834/1841258715 2023-03-02T10:57:22.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1add9b700 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x564e3994a5a0 0x564e3994c980 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cad97d7aee17971e server_cookie=26dcd23b3b69a137 in_seq=0 out_seq=0 2023-03-02T10:57:22.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb195ffb700 1 -- 172.21.15.57:0/3566884227 <== mds.4 v2:172.21.15.122:6834/1841258715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564e39828e90 con 0x564e3994a5a0 2023-03-02T10:57:22.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb195ffb700 10 client.25454 handle_command_reply: tid=0 2023-03-02T10:57:22.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 1 client.25454 shutdown 2023-03-02T10:57:22.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3566884227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 msgr2=0x564e39942cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e39942cb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00095c0 tx=0x7fb1a0094d10 comp rx=0 tx=0).stop 2023-03-02T10:57:22.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3566884227 shutdown_connections 2023-03-02T10:57:22.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x564e3994a5a0 0x564e3994c980 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564e398e3110 0x564e3993d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb195ffb700 0 client.25454 ms_handle_reset on v2:172.21.15.122:6834/1841258715 2023-03-02T10:57:22.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564e398de3c0 0x564e39942cb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 1 --2- 172.21.15.57:0/3566884227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564e398decd0 0x564e399431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3566884227 >> 172.21.15.57:0/3566884227 conn(0x564e398d3c50 msgr2=0x564e398e2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3566884227 shutdown_connections 2023-03-02T10:57:22.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 1 -- 172.21.15.57:0/3566884227 wait complete. 2023-03-02T10:57:22.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.441+0000 7fb1c86c0b80 20 client.25454 trim_cache size 0 max 16384 2023-03-02T10:57:22.452 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:57:22.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 -- 172.21.15.57:0/571680166 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb19809b4c0 msgr2=0x7fb19809d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb19809b4c0 0x7fb19809d970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0105480 tx=0x7fb1a4009260 comp rx=0 tx=0).stop 2023-03-02T10:57:22.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 -- 172.21.15.57:0/571680166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1b00ffab0 msgr2=0x7fb1b019b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1b00ffab0 0x7fb1b019b9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000b2e0 tx=0x7fb1a0004730 comp rx=0 tx=0).stop 2023-03-02T10:57:22.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 -- 172.21.15.57:0/571680166 shutdown_connections 2023-03-02T10:57:22.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb19809b4c0 0x7fb19809d970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0105ac0 0x7fb1b0195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1b00ffab0 0x7fb1b019b9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 --2- 172.21.15.57:0/571680166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1b0100460 0x7fb1b019bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 -- 172.21.15.57:0/571680166 >> 172.21.15.57:0/571680166 conn(0x7fb1b00fb610 msgr2=0x7fb1b00fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 -- 172.21.15.57:0/571680166 shutdown_connections 2023-03-02T10:57:22.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.442+0000 7fb1b4dff700 1 -- 172.21.15.57:0/571680166 wait complete. 2023-03-02T10:57:22.464 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-03-02T10:57:22.599 INFO:teuthology.orchestra.run.smithi057.stderr:4400000 of 50000000 tuples (8%) done (elapsed 7.40 s, remaining 76.73 s) 2023-03-02T10:57:22.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.634+0000 7fc8615ff700 1 -- 172.21.15.57:0/174067495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc85c0731e0 msgr2=0x7fc85c10be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.634+0000 7fc8615ff700 1 --2- 172.21.15.57:0/174067495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc85c0731e0 0x7fc85c10be10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc850009990 tx=0x7fc850009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.634+0000 7fc8615ff700 1 -- 172.21.15.57:0/174067495 shutdown_connections 2023-03-02T10:57:22.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.634+0000 7fc8615ff700 1 --2- 172.21.15.57:0/174067495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc85c10c350 0x7fc85c10e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.634+0000 7fc8615ff700 1 --2- 172.21.15.57:0/174067495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc85c0728d0 0x7fc85c072ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.634+0000 7fc8615ff700 1 --2- 172.21.15.57:0/174067495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc85c0731e0 0x7fc85c10be10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.634+0000 7fc8615ff700 1 -- 172.21.15.57:0/174067495 >> 172.21.15.57:0/174067495 conn(0x7fc85c0fb610 msgr2=0x7fc85c0fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.635+0000 7fc8615ff700 1 -- 172.21.15.57:0/174067495 shutdown_connections 2023-03-02T10:57:22.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.635+0000 7fc8615ff700 1 -- 172.21.15.57:0/174067495 wait complete. 2023-03-02T10:57:22.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc8615ff700 1 Processor -- start 2023-03-02T10:57:22.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc8615ff700 1 -- start start 2023-03-02T10:57:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc8615ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc85c0728d0 0x7fc85c197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc8615ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc85c0731e0 0x7fc85c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc8615ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc85c10c350 0x7fc85c19c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc8615ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c19ce20 con 0x7fc85c0731e0 2023-03-02T10:57:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc8615ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c19cf90 con 0x7fc85c10c350 2023-03-02T10:57:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc8615ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c19d150 con 0x7fc85c0728d0 2023-03-02T10:57:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc85a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc85c0731e0 0x7fc85c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc85a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc85c0731e0 0x7fc85c198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60620/0 (socket says 172.21.15.57:60620) 2023-03-02T10:57:22.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc85affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc85c0728d0 0x7fc85c197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.636+0000 7fc85a7fc700 1 -- 172.21.15.57:0/3957188390 learned_addr learned my addr 172.21.15.57:0/3957188390 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc85b7fe700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc85c10c350 0x7fc85c19c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc85affd700 1 -- 172.21.15.57:0/3957188390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc85c10c350 msgr2=0x7fc85c19c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc85affd700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc85c10c350 0x7fc85c19c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc85affd700 1 -- 172.21.15.57:0/3957188390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc85c0731e0 msgr2=0x7fc85c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc85affd700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc85c0731e0 0x7fc85c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc85affd700 1 -- 172.21.15.57:0/3957188390 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c009520 con 0x7fc85c0728d0 2023-03-02T10:57:22.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc85c0731e0 0x7fc85c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:22.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc85affd700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc85c0728d0 0x7fc85c197e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00e9f0 tx=0x7fc84c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc843fff700 1 -- 172.21.15.57:0/3957188390 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00cb70 con 0x7fc85c0728d0 2023-03-02T10:57:22.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc843fff700 1 -- 172.21.15.57:0/3957188390 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc84c00ee90 con 0x7fc85c0728d0 2023-03-02T10:57:22.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc8615ff700 1 -- 172.21.15.57:0/3957188390 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8500095f0 con 0x7fc85c0728d0 2023-03-02T10:57:22.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc843fff700 1 -- 172.21.15.57:0/3957188390 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c003cf0 con 0x7fc85c0728d0 2023-03-02T10:57:22.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.637+0000 7fc8615ff700 1 -- 172.21.15.57:0/3957188390 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c111d30 con 0x7fc85c0728d0 2023-03-02T10:57:22.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.640+0000 7fc843fff700 1 -- 172.21.15.57:0/3957188390 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7fc84c00c040 con 0x7fc85c0728d0 2023-03-02T10:57:22.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.642+0000 7fc843fff700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc84409b540 0x7fc84409d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.642+0000 7fc843fff700 1 -- 172.21.15.57:0/3957188390 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc84c014070 con 0x7fc85c0728d0 2023-03-02T10:57:22.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.642+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc84409b540 0x7fc84409d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.642+0000 7fc874f07b80 1 Processor -- start 2023-03-02T10:57:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.642+0000 7fc874f07b80 1 -- start start 2023-03-02T10:57:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc84409b540 0x7fc84409d9f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc85000b6f0 tx=0x7fc850005bc0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 0x55f56c712790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c716bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c717560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc874f07b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c679a60 con 0x55f56c717110 2023-03-02T10:57:22.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc874f07b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c62bf80 con 0x55f56c7123c0 2023-03-02T10:57:22.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc874f07b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c5fc160 con 0x55f56c712cd0 2023-03-02T10:57:22.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c717560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85affd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 0x55f56c712790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c717560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60628/0 (socket says 172.21.15.57:60628) 2023-03-02T10:57:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85b7fe700 1 -- 172.21.15.57:0/2762485155 learned_addr learned my addr 172.21.15.57:0/2762485155 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/2762485155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c716bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85affd700 1 -- 172.21.15.57:0/2762485155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 msgr2=0x55f56c716bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85affd700 1 --2- 172.21.15.57:0/2762485155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c716bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85affd700 1 -- 172.21.15.57:0/2762485155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 msgr2=0x55f56c717560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85affd700 1 --2- 172.21.15.57:0/2762485155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c717560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85affd700 1 -- 172.21.15.57:0/2762485155 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f56c4e6630 con 0x55f56c7123c0 2023-03-02T10:57:22.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85b7fe700 1 --2- 172.21.15.57:0/2762485155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c717560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:22.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.643+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/2762485155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c716bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:22.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.644+0000 7fc85affd700 1 --2- 172.21.15.57:0/2762485155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 0x55f56c712790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc84c090d20 tx=0x7fc84c094180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1c2a9095ec72ab7 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.644+0000 7fc8417fa700 1 -- 172.21.15.57:0/2762485155 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c094820 con 0x55f56c7123c0 2023-03-02T10:57:22.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.644+0000 7fc8417fa700 1 -- 172.21.15.57:0/2762485155 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc84c09bf40 con 0x55f56c7123c0 2023-03-02T10:57:22.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.644+0000 7fc8417fa700 1 -- 172.21.15.57:0/2762485155 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c093f70 con 0x55f56c7123c0 2023-03-02T10:57:22.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.645+0000 7fc874f07b80 1 -- 172.21.15.57:0/2762485155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 msgr2=0x55f56c712790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.645+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2762485155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 0x55f56c712790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc84c090d20 tx=0x7fc84c094180 comp rx=0 tx=0).stop 2023-03-02T10:57:22.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.645+0000 7fc874f07b80 1 -- 172.21.15.57:0/2762485155 shutdown_connections 2023-03-02T10:57:22.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.645+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2762485155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c717560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.645+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2762485155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 0x55f56c712790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.645+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2762485155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c716bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.645+0000 7fc874f07b80 1 -- 172.21.15.57:0/2762485155 >> 172.21.15.57:0/2762485155 conn(0x55f56c707c50 msgr2=0x55f56c70d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.645+0000 7fc874f07b80 1 -- 172.21.15.57:0/2762485155 shutdown_connections 2023-03-02T10:57:22.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.645+0000 7fc874f07b80 1 -- 172.21.15.57:0/2762485155 wait complete. 2023-03-02T10:57:22.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.645+0000 7fc874f07b80 1 -- start start 2023-03-02T10:57:22.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.645+0000 7fc874f07b80 1 Processor -- start 2023-03-02T10:57:22.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c7123c0 0x55f56c71e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c712cd0 0x55f56c71bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c71c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc874f07b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c66abc0 con 0x55f56c717110 2023-03-02T10:57:22.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc874f07b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c6640f0 con 0x55f56c712cd0 2023-03-02T10:57:22.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc874f07b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c4e8920 con 0x55f56c7123c0 2023-03-02T10:57:22.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc874f07b80 10 client.0 _ll_register_callbacks cb 0x55f56c60a520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:22.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc85affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c7123c0 0x55f56c71e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc85b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c71c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc85b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c71c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60642/0 (socket says 172.21.15.57:60642) 2023-03-02T10:57:22.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc85b7fe700 1 -- 172.21.15.57:0/2344108670 learned_addr learned my addr 172.21.15.57:0/2344108670 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.646+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c712cd0 0x55f56c71bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc85affd700 1 -- 172.21.15.57:0/2344108670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c712cd0 msgr2=0x55f56c71bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc85affd700 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c712cd0 0x55f56c71bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc85affd700 1 -- 172.21.15.57:0/2344108670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 msgr2=0x55f56c71c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc85affd700 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c71c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc85affd700 1 -- 172.21.15.57:0/2344108670 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c111d30 con 0x55f56c7123c0 2023-03-02T10:57:22.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc85affd700 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c7123c0 0x55f56c71e920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0942f0 tx=0x7fc84c005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c262b80ab8731a server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc83eff5700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:57:22.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc83eff5700 1 -- 172.21.15.57:0/2344108670 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c098210 con 0x55f56c7123c0 2023-03-02T10:57:22.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc83eff5700 1 -- 172.21.15.57:0/2344108670 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc84c093d10 con 0x55f56c7123c0 2023-03-02T10:57:22.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc874f07b80 1 -- 172.21.15.57:0/2344108670 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f56c6357b0 con 0x55f56c7123c0 2023-03-02T10:57:22.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc83eff5700 1 -- 172.21.15.57:0/2344108670 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc84c093ed0 con 0x55f56c7123c0 2023-03-02T10:57:22.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc874f07b80 10 client.25417 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:22.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc874f07b80 1 -- 172.21.15.57:0/2344108670 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f56c492de0 con 0x55f56c7123c0 2023-03-02T10:57:22.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.647+0000 7fc83eff5700 1 -- 172.21.15.57:0/2344108670 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f56c6357b0 con 0x55f56c7123c0 2023-03-02T10:57:22.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.648+0000 7fc83eff5700 1 -- 172.21.15.57:0/2344108670 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc84c07b080 con 0x55f56c7123c0 2023-03-02T10:57:22.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.648+0000 7fc874f07b80 10 client.25417 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:22.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.648+0000 7fc874f07b80 10 client.25417 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-02T10:57:22.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.648+0000 7fc874f07b80 20 client.25417 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:22.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.648+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55f56c72bf20 0x55f56c72e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.648+0000 7fc874f07b80 4 client.25417 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:22.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.648+0000 7fc874f07b80 1 -- 172.21.15.57:0/2344108670 --> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f56c65d170 con 0x55f56c72bf20 2023-03-02T10:57:22.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.648+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55f56c72bf20 0x55f56c72e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.648+0000 7fc83eff5700 10 client.25417 ms_handle_connect on v2:172.21.15.136:6834/2199127047 2023-03-02T10:57:22.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.648+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55f56c72bf20 0x55f56c72e300 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ed620edccbf72884 server_cookie=6aa0e69b2885af6c in_seq=0 out_seq=0 2023-03-02T10:57:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc83eff5700 1 -- 172.21.15.57:0/2344108670 <== mds.3 v2:172.21.15.136:6834/2199127047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55f56c65d170 con 0x55f56c72bf20 2023-03-02T10:57:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc83eff5700 10 client.25417 handle_command_reply: tid=0 2023-03-02T10:57:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc874f07b80 1 client.25417 shutdown 2023-03-02T10:57:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc874f07b80 1 -- 172.21.15.57:0/2344108670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c7123c0 msgr2=0x55f56c71e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c7123c0 0x55f56c71e920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0942f0 tx=0x7fc84c005800 comp rx=0 tx=0).stop 2023-03-02T10:57:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc874f07b80 1 -- 172.21.15.57:0/2344108670 shutdown_connections 2023-03-02T10:57:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55f56c72bf20 0x55f56c72e300 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c71c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc83eff5700 0 client.25417 ms_handle_reset on v2:172.21.15.136:6834/2199127047 2023-03-02T10:57:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c7123c0 0x55f56c71e920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2344108670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c712cd0 0x55f56c71bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc874f07b80 1 -- 172.21.15.57:0/2344108670 >> 172.21.15.57:0/2344108670 conn(0x55f56c707c50 msgr2=0x55f56c70d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc874f07b80 1 -- 172.21.15.57:0/2344108670 shutdown_connections 2023-03-02T10:57:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.649+0000 7fc874f07b80 1 -- 172.21.15.57:0/2344108670 wait complete. 2023-03-02T10:57:22.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.650+0000 7fc874f07b80 20 client.25417 trim_cache size 0 max 16384 2023-03-02T10:57:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.665+0000 7fc874f07b80 1 Processor -- start 2023-03-02T10:57:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc874f07b80 1 -- start start 2023-03-02T10:57:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c7123c0 0x55f56c71e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c71ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c717110 0x55f56c716180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc874f07b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c71cb20 con 0x55f56c7123c0 2023-03-02T10:57:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc874f07b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c70dff0 con 0x55f56c717110 2023-03-02T10:57:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc874f07b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c71d150 con 0x55f56c712cd0 2023-03-02T10:57:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c7123c0 0x55f56c71e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c7123c0 0x55f56c71e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60658/0 (socket says 172.21.15.57:60658) 2023-03-02T10:57:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85affd700 1 -- 172.21.15.57:0/2886884123 learned_addr learned my addr 172.21.15.57:0/2886884123 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/2886884123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c71ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85b7fe700 1 --2- 172.21.15.57:0/2886884123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c717110 0x55f56c716180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85affd700 1 -- 172.21.15.57:0/2886884123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 msgr2=0x55f56c71ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85affd700 1 --2- 172.21.15.57:0/2886884123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c71ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85affd700 1 -- 172.21.15.57:0/2886884123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c717110 msgr2=0x55f56c716180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85affd700 1 --2- 172.21.15.57:0/2886884123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c717110 0x55f56c716180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85affd700 1 -- 172.21.15.57:0/2886884123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f56c7093f0 con 0x55f56c7123c0 2023-03-02T10:57:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85b7fe700 1 --2- 172.21.15.57:0/2886884123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c717110 0x55f56c716180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.666+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/2886884123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c71ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.667+0000 7fc85affd700 1 --2- 172.21.15.57:0/2886884123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c7123c0 0x55f56c71e4c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00c5b0 tx=0x7fc84c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5928d49daac2ac5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.667+0000 7fc841ffb700 1 -- 172.21.15.57:0/2886884123 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c094180 con 0x55f56c7123c0 2023-03-02T10:57:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.667+0000 7fc841ffb700 1 -- 172.21.15.57:0/2886884123 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc84c098210 con 0x55f56c7123c0 2023-03-02T10:57:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.667+0000 7fc841ffb700 1 -- 172.21.15.57:0/2886884123 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c09bd10 con 0x55f56c7123c0 2023-03-02T10:57:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.668+0000 7fc874f07b80 1 -- 172.21.15.57:0/2886884123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c7123c0 msgr2=0x55f56c71e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.668+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2886884123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c7123c0 0x55f56c71e4c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00c5b0 tx=0x7fc84c005870 comp rx=0 tx=0).stop 2023-03-02T10:57:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.668+0000 7fc874f07b80 1 -- 172.21.15.57:0/2886884123 shutdown_connections 2023-03-02T10:57:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.668+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2886884123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c717110 0x55f56c716180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.668+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2886884123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c7123c0 0x55f56c71e4c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.668+0000 7fc874f07b80 1 --2- 172.21.15.57:0/2886884123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c71ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.668+0000 7fc874f07b80 1 -- 172.21.15.57:0/2886884123 >> 172.21.15.57:0/2886884123 conn(0x55f56c707c50 msgr2=0x55f56c7277e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.668+0000 7fc874f07b80 1 -- 172.21.15.57:0/2886884123 shutdown_connections 2023-03-02T10:57:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.668+0000 7fc874f07b80 1 -- 172.21.15.57:0/2886884123 wait complete. 2023-03-02T10:57:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.668+0000 7fc874f07b80 1 -- start start 2023-03-02T10:57:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.668+0000 7fc874f07b80 1 Processor -- start 2023-03-02T10:57:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 0x55f56c721510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c721a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc874f07b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c77c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc874f07b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c77cce0 con 0x55f56c717110 2023-03-02T10:57:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc874f07b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c77ce20 con 0x55f56c7123c0 2023-03-02T10:57:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc874f07b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c77cf60 con 0x55f56c712cd0 2023-03-02T10:57:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc874f07b80 10 client.0 _ll_register_callbacks cb 0x55f56c70c3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc85affd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 0x55f56c721510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc85affd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 0x55f56c721510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59430/0 (socket says 172.21.15.57:59430) 2023-03-02T10:57:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc85affd700 1 -- 172.21.15.57:0/3457241837 learned_addr learned my addr 172.21.15.57:0/3457241837 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc85b7fe700 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c77c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c721a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc85affd700 1 -- 172.21.15.57:0/3457241837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 msgr2=0x55f56c721a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc85affd700 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c721a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc85affd700 1 -- 172.21.15.57:0/3457241837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 msgr2=0x55f56c77c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc85affd700 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c77c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc85affd700 1 -- 172.21.15.57:0/3457241837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85002c040 con 0x55f56c7123c0 2023-03-02T10:57:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.669+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c721a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.670+0000 7fc85affd700 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 0x55f56c721510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc84c091290 tx=0x7fc84c003780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54e450515f1a49bc server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.670+0000 7fc83eff5700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.670+0000 7fc83eff5700 1 -- 172.21.15.57:0/3457241837 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c098210 con 0x55f56c7123c0 2023-03-02T10:57:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.670+0000 7fc874f07b80 1 -- 172.21.15.57:0/3457241837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f56c65ce90 con 0x55f56c7123c0 2023-03-02T10:57:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.670+0000 7fc83eff5700 1 -- 172.21.15.57:0/3457241837 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc84c09d070 con 0x55f56c7123c0 2023-03-02T10:57:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.670+0000 7fc83eff5700 1 -- 172.21.15.57:0/3457241837 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc84c094180 con 0x55f56c7123c0 2023-03-02T10:57:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.670+0000 7fc874f07b80 10 client.25472 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.670+0000 7fc874f07b80 1 -- 172.21.15.57:0/3457241837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f56c492de0 con 0x55f56c7123c0 2023-03-02T10:57:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.670+0000 7fc83eff5700 1 -- 172.21.15.57:0/3457241837 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f56c65ce90 con 0x55f56c7123c0 2023-03-02T10:57:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.671+0000 7fc83eff5700 1 -- 172.21.15.57:0/3457241837 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc84c090f30 con 0x55f56c7123c0 2023-03-02T10:57:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.671+0000 7fc874f07b80 10 client.25472 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.671+0000 7fc874f07b80 10 client.25472 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-02T10:57:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.671+0000 7fc874f07b80 20 client.25472 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.671+0000 7fc874f07b80 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55f56c77e160 0x55f56c780540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.671+0000 7fc874f07b80 4 client.25472 mds_command: new command op to 24493 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:57:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.671+0000 7fc874f07b80 1 -- 172.21.15.57:0/3457241837 --> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f56c4e8f60 con 0x55f56c77e160 2023-03-02T10:57:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.671+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55f56c77e160 0x55f56c780540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.671+0000 7fc85a7fc700 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55f56c77e160 0x55f56c780540 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3aa5dc95d3d344d1 server_cookie=387d7c7d8afaf205 in_seq=0 out_seq=0 2023-03-02T10:57:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.671+0000 7fc83eff5700 10 client.25472 ms_handle_connect on v2:172.21.15.136:6834/2199127047 2023-03-02T10:57:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc83eff5700 1 -- 172.21.15.57:0/3457241837 <== mds.3 v2:172.21.15.136:6834/2199127047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f56c4e8f60 con 0x55f56c77e160 2023-03-02T10:57:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc83eff5700 10 client.25472 handle_command_reply: tid=0 2023-03-02T10:57:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 1 client.25472 shutdown 2023-03-02T10:57:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 1 -- 172.21.15.57:0/3457241837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 msgr2=0x55f56c721510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 0x55f56c721510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc84c091290 tx=0x7fc84c003780 comp rx=0 tx=0).stop 2023-03-02T10:57:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 1 -- 172.21.15.57:0/3457241837 shutdown_connections 2023-03-02T10:57:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55f56c77e160 0x55f56c780540 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f56c717110 0x55f56c77c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc83eff5700 0 client.25472 ms_handle_reset on v2:172.21.15.136:6834/2199127047 2023-03-02T10:57:22.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f56c7123c0 0x55f56c721510 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 1 --2- 172.21.15.57:0/3457241837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f56c712cd0 0x55f56c721a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 1 -- 172.21.15.57:0/3457241837 >> 172.21.15.57:0/3457241837 conn(0x55f56c707c50 msgr2=0x55f56c716180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 1 -- 172.21.15.57:0/3457241837 shutdown_connections 2023-03-02T10:57:22.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 1 -- 172.21.15.57:0/3457241837 wait complete. 2023-03-02T10:57:22.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.672+0000 7fc874f07b80 20 client.25472 trim_cache size 0 max 16384 2023-03-02T10:57:22.684 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:57:22.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 -- 172.21.15.57:0/3957188390 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc84409b540 msgr2=0x7fc84409d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc84409b540 0x7fc84409d9f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc85000b6f0 tx=0x7fc850005bc0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 -- 172.21.15.57:0/3957188390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc85c0728d0 msgr2=0x7fc85c197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc85c0728d0 0x7fc85c197e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00e9f0 tx=0x7fc84c00ed00 comp rx=0 tx=0).stop 2023-03-02T10:57:22.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 -- 172.21.15.57:0/3957188390 shutdown_connections 2023-03-02T10:57:22.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc84409b540 0x7fc84409d9f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc85c10c350 0x7fc85c19c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc85c0728d0 0x7fc85c197e40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 --2- 172.21.15.57:0/3957188390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc85c0731e0 0x7fc85c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 -- 172.21.15.57:0/3957188390 >> 172.21.15.57:0/3957188390 conn(0x7fc85c0fb610 msgr2=0x7fc85c10e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 -- 172.21.15.57:0/3957188390 shutdown_connections 2023-03-02T10:57:22.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.673+0000 7fc8615ff700 1 -- 172.21.15.57:0/3957188390 wait complete. 2023-03-02T10:57:22.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-03-02T10:57:22.810 INFO:teuthology.orchestra.run.smithi057.stderr:4500000 of 50000000 tuples (9%) done (elapsed 7.62 s, remaining 77.00 s) 2023-03-02T10:57:22.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.858+0000 7f87391ff700 1 -- 172.21.15.57:0/62461592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8734100460 msgr2=0x7f873410c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.858+0000 7f87391ff700 1 --2- 172.21.15.57:0/62461592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8734100460 0x7f873410c8f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f872c00b0a0 tx=0x7f872c00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.858+0000 7f87391ff700 1 -- 172.21.15.57:0/62461592 shutdown_connections 2023-03-02T10:57:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.858+0000 7f87391ff700 1 --2- 172.21.15.57:0/62461592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8734100460 0x7f873410c8f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.858+0000 7f87391ff700 1 --2- 172.21.15.57:0/62461592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8734105ac0 0x7f8734105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.858+0000 7f87391ff700 1 --2- 172.21.15.57:0/62461592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87340ffab0 0x7f87340fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.858+0000 7f87391ff700 1 -- 172.21.15.57:0/62461592 >> 172.21.15.57:0/62461592 conn(0x7f87340fb5d0 msgr2=0x7f87340fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.858+0000 7f87391ff700 1 -- 172.21.15.57:0/62461592 shutdown_connections 2023-03-02T10:57:22.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.858+0000 7f87391ff700 1 -- 172.21.15.57:0/62461592 wait complete. 2023-03-02T10:57:22.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.859+0000 7f87391ff700 1 Processor -- start 2023-03-02T10:57:22.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f87391ff700 1 -- start start 2023-03-02T10:57:22.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f87391ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87340ffab0 0x7f8734195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f87391ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8734100460 0x7f87341962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f87391ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8734105ac0 0x7f873419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f87391ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873419ad60 con 0x7f8734100460 2023-03-02T10:57:22.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f87391ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873419aed0 con 0x7f87340ffab0 2023-03-02T10:57:22.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f87391ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873419b090 con 0x7f8734105ac0 2023-03-02T10:57:22.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f873259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8734100460 0x7f87341962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f873259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8734100460 0x7f87341962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60680/0 (socket says 172.21.15.57:60680) 2023-03-02T10:57:22.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f873259c700 1 -- 172.21.15.57:0/1175804877 learned_addr learned my addr 172.21.15.57:0/1175804877 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f8732d9d700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87340ffab0 0x7f8734195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f873359e700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8734105ac0 0x7f873419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f873259c700 1 -- 172.21.15.57:0/1175804877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8734105ac0 msgr2=0x7f873419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f873259c700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8734105ac0 0x7f873419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f873259c700 1 -- 172.21.15.57:0/1175804877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87340ffab0 msgr2=0x7f8734195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f873259c700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87340ffab0 0x7f8734195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.860+0000 7f873259c700 1 -- 172.21.15.57:0/1175804877 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c009d00 con 0x7f8734100460 2023-03-02T10:57:22.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.861+0000 7f873259c700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8734100460 0x7f87341962c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f872800e9a0 tx=0x7f872800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.861+0000 7f871bfff700 1 -- 172.21.15.57:0/1175804877 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728009790 con 0x7f8734100460 2023-03-02T10:57:22.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.861+0000 7f871bfff700 1 -- 172.21.15.57:0/1175804877 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8728010430 con 0x7f8734100460 2023-03-02T10:57:22.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.861+0000 7f87391ff700 1 -- 172.21.15.57:0/1175804877 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873410faf0 con 0x7f8734100460 2023-03-02T10:57:22.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.861+0000 7f871bfff700 1 -- 172.21.15.57:0/1175804877 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728018680 con 0x7f8734100460 2023-03-02T10:57:22.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.861+0000 7f87391ff700 1 -- 172.21.15.57:0/1175804877 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873410f960 con 0x7f8734100460 2023-03-02T10:57:22.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.864+0000 7f871bfff700 1 -- 172.21.15.57:0/1175804877 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f872800c040 con 0x7f8734100460 2023-03-02T10:57:22.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.865+0000 7f871bfff700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f871c09b540 0x7f871c09d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.865+0000 7f871bfff700 1 -- 172.21.15.57:0/1175804877 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8728014070 con 0x7f8734100460 2023-03-02T10:57:22.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.865+0000 7f874cb9bb80 1 Processor -- start 2023-03-02T10:57:22.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.865+0000 7f8732d9d700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f871c09b540 0x7f871c09d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.865+0000 7f874cb9bb80 1 -- start start 2023-03-02T10:57:22.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f8732d9d700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f871c09b540 0x7f871c09d9f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8734100bf0 tx=0x7f8724009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560926918a60 con 0x5609269b13c0 2023-03-02T10:57:22.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609268caf80 con 0x5609269b1cd0 2023-03-02T10:57:22.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092689b160 con 0x5609269b6110 2023-03-02T10:57:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f8732d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f873259c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f8732d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60682/0 (socket says 172.21.15.57:60682) 2023-03-02T10:57:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f8732d9d700 1 -- 172.21.15.57:0/1798792367 learned_addr learned my addr 172.21.15.57:0/1798792367 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f873359e700 1 --2- 172.21.15.57:0/1798792367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f873259c700 1 -- 172.21.15.57:0/1798792367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 msgr2=0x5609269b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f873259c700 1 --2- 172.21.15.57:0/1798792367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f873259c700 1 -- 172.21.15.57:0/1798792367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 msgr2=0x5609269b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f873259c700 1 --2- 172.21.15.57:0/1798792367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f873259c700 1 -- 172.21.15.57:0/1798792367 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560926785630 con 0x5609269b1cd0 2023-03-02T10:57:22.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.866+0000 7f873259c700 1 --2- 172.21.15.57:0/1798792367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269b5bd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8728010c30 tx=0x7f8728094340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e6bfcdb2d9bdb38 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.867+0000 7f87197fa700 1 -- 172.21.15.57:0/1798792367 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280ab070 con 0x5609269b1cd0 2023-03-02T10:57:22.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.867+0000 7f87197fa700 1 -- 172.21.15.57:0/1798792367 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8728094730 con 0x5609269b1cd0 2023-03-02T10:57:22.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.867+0000 7f87197fa700 1 -- 172.21.15.57:0/1798792367 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728093c20 con 0x5609269b1cd0 2023-03-02T10:57:22.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.867+0000 7f874cb9bb80 1 -- 172.21.15.57:0/1798792367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 msgr2=0x5609269b5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.867+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/1798792367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269b5bd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8728010c30 tx=0x7f8728094340 comp rx=0 tx=0).stop 2023-03-02T10:57:22.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.867+0000 7f874cb9bb80 1 -- 172.21.15.57:0/1798792367 shutdown_connections 2023-03-02T10:57:22.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.867+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/1798792367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.867+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/1798792367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.867+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/1798792367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269b5bd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.867+0000 7f874cb9bb80 1 -- 172.21.15.57:0/1798792367 >> 172.21.15.57:0/1798792367 conn(0x5609269a6c50 msgr2=0x5609269ac460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.867+0000 7f874cb9bb80 1 -- 172.21.15.57:0/1798792367 shutdown_connections 2023-03-02T10:57:22.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.868+0000 7f874cb9bb80 1 -- 172.21.15.57:0/1798792367 wait complete. 2023-03-02T10:57:22.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.868+0000 7f874cb9bb80 1 -- start start 2023-03-02T10:57:22.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.868+0000 7f874cb9bb80 1 Processor -- start 2023-03-02T10:57:22.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269bb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269bb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560926909bc0 con 0x5609269b13c0 2023-03-02T10:57:22.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609269030f0 con 0x5609269b1cd0 2023-03-02T10:57:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x560926787920 con 0x5609269b6110 2023-03-02T10:57:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f874cb9bb80 10 client.0 _ll_register_callbacks cb 0x5609268a9520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f8732d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f8732d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269bac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60690/0 (socket says 172.21.15.57:60690) 2023-03-02T10:57:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f8732d9d700 1 -- 172.21.15.57:0/3259430946 learned_addr learned my addr 172.21.15.57:0/3259430946 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f873259c700 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269bb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f873359e700 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269bb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f873259c700 1 -- 172.21.15.57:0/3259430946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 msgr2=0x5609269bb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f873259c700 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269bb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f873259c700 1 -- 172.21.15.57:0/3259430946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 msgr2=0x5609269bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f873259c700 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f873259c700 1 -- 172.21.15.57:0/3259430946 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873410f960 con 0x5609269b1cd0 2023-03-02T10:57:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f873359e700 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269bb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f8732d9d700 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.869+0000 7f873259c700 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269bb1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5609269bde80 tx=0x7f8728094ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3583cf73eb7af52 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f8716ff5700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f8716ff5700 1 -- 172.21.15.57:0/3259430946 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280ab070 con 0x5609269b1cd0 2023-03-02T10:57:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f8716ff5700 1 -- 172.21.15.57:0/3259430946 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8728010880 con 0x5609269b1cd0 2023-03-02T10:57:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3259430946 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609268d47b0 con 0x5609269b1cd0 2023-03-02T10:57:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f8716ff5700 1 -- 172.21.15.57:0/3259430946 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f872809b9c0 con 0x5609269b1cd0 2023-03-02T10:57:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f874cb9bb80 10 client.25484 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3259430946 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560926731de0 con 0x5609269b1cd0 2023-03-02T10:57:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f8716ff5700 1 -- 172.21.15.57:0/3259430946 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5609268d47b0 con 0x5609269b1cd0 2023-03-02T10:57:22.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f8716ff5700 1 -- 172.21.15.57:0/3259430946 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f872800ca10 con 0x5609269b1cd0 2023-03-02T10:57:22.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f874cb9bb80 10 client.25484 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:22.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f874cb9bb80 10 client.25484 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-02T10:57:22.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f874cb9bb80 20 client.25484 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:22.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5609269cae40 0x5609269cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f874cb9bb80 4 client.25484 mds_command: new command op to 24505 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:22.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.870+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3259430946 --> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609268fc170 con 0x5609269cae40 2023-03-02T10:57:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.871+0000 7f8732d9d700 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5609269cae40 0x5609269cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.871+0000 7f8716ff5700 10 client.25484 ms_handle_connect on v2:172.21.15.136:6836/2130761226 2023-03-02T10:57:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.871+0000 7f8732d9d700 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5609269cae40 0x5609269cd220 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=62d2793744dfdc82 server_cookie=48328881ba770a96 in_seq=0 out_seq=0 2023-03-02T10:57:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f8716ff5700 1 -- 172.21.15.57:0/3259430946 <== mds.2 v2:172.21.15.136:6836/2130761226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5609268fc170 con 0x5609269cae40 2023-03-02T10:57:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f8716ff5700 10 client.25484 handle_command_reply: tid=0 2023-03-02T10:57:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 1 client.25484 shutdown 2023-03-02T10:57:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3259430946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 msgr2=0x5609269bb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269bb1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5609269bde80 tx=0x7f8728094ef0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3259430946 shutdown_connections 2023-03-02T10:57:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5609269cae40 0x5609269cd220 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269bb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/3259430946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269bb1a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f8716ff5700 0 client.25484 ms_handle_reset on v2:172.21.15.136:6836/2130761226 2023-03-02T10:57:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3259430946 >> 172.21.15.57:0/3259430946 conn(0x5609269a6c50 msgr2=0x5609269ac050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3259430946 shutdown_connections 2023-03-02T10:57:22.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3259430946 wait complete. 2023-03-02T10:57:22.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.872+0000 7f874cb9bb80 20 client.25484 trim_cache size 0 max 16384 2023-03-02T10:57:22.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.885+0000 7f874cb9bb80 1 Processor -- start 2023-03-02T10:57:22.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.885+0000 7f874cb9bb80 1 -- start start 2023-03-02T10:57:22.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.885+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b13c0 0x5609269b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.885+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.885+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b6110 0x5609269b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.885+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609269d1d30 con 0x5609269b6110 2023-03-02T10:57:22.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.885+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609269b4aa0 con 0x5609269b1cd0 2023-03-02T10:57:22.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.885+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609269b7a30 con 0x5609269b13c0 2023-03-02T10:57:22.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f8732d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b13c0 0x5609269b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f8732d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b13c0 0x5609269b74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:44182/0 (socket says 172.21.15.57:44182) 2023-03-02T10:57:22.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f8732d9d700 1 -- 172.21.15.57:0/3465139470 learned_addr learned my addr 172.21.15.57:0/3465139470 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f873359e700 1 --2- 172.21.15.57:0/3465139470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b6110 0x5609269b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f873259c700 1 --2- 172.21.15.57:0/3465139470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f8732d9d700 1 -- 172.21.15.57:0/3465139470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 msgr2=0x5609269b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f8732d9d700 1 --2- 172.21.15.57:0/3465139470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f8732d9d700 1 -- 172.21.15.57:0/3465139470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b6110 msgr2=0x5609269b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f8732d9d700 1 --2- 172.21.15.57:0/3465139470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b6110 0x5609269b56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f8732d9d700 1 -- 172.21.15.57:0/3465139470 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609268ca190 con 0x5609269b13c0 2023-03-02T10:57:22.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f873259c700 1 --2- 172.21.15.57:0/3465139470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:22.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f873359e700 1 --2- 172.21.15.57:0/3465139470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b6110 0x5609269b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:22.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f8732d9d700 1 --2- 172.21.15.57:0/3465139470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b13c0 0x5609269b74f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8724005d90 tx=0x7f8724014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66a601341e9ba691 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.886+0000 7f8719ffb700 1 -- 172.21.15.57:0/3465139470 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724022030 con 0x5609269b13c0 2023-03-02T10:57:22.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.887+0000 7f8719ffb700 1 -- 172.21.15.57:0/3465139470 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8724023040 con 0x5609269b13c0 2023-03-02T10:57:22.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.887+0000 7f8719ffb700 1 -- 172.21.15.57:0/3465139470 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872402a780 con 0x5609269b13c0 2023-03-02T10:57:22.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.887+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3465139470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b13c0 msgr2=0x5609269b74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.887+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/3465139470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b13c0 0x5609269b74f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8724005d90 tx=0x7f8724014000 comp rx=0 tx=0).stop 2023-03-02T10:57:22.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.887+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3465139470 shutdown_connections 2023-03-02T10:57:22.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.887+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/3465139470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b6110 0x5609269b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.887+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/3465139470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b13c0 0x5609269b74f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.887+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/3465139470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.887+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3465139470 >> 172.21.15.57:0/3465139470 conn(0x5609269a6c50 msgr2=0x5609269c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.887+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3465139470 shutdown_connections 2023-03-02T10:57:22.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.887+0000 7f874cb9bb80 1 -- 172.21.15.57:0/3465139470 wait complete. 2023-03-02T10:57:22.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.888+0000 7f874cb9bb80 1 -- start start 2023-03-02T10:57:22.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.888+0000 7f874cb9bb80 1 Processor -- start 2023-03-02T10:57:22.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.888+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.888+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.888+0000 7f874cb9bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269c0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.888+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609269c0a40 con 0x5609269b13c0 2023-03-02T10:57:22.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.888+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609269c0bb0 con 0x5609269b1cd0 2023-03-02T10:57:22.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.888+0000 7f874cb9bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609269c0d70 con 0x5609269b6110 2023-03-02T10:57:22.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.888+0000 7f874cb9bb80 10 client.0 _ll_register_callbacks cb 0x5609268a9520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:22.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f8732d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f8732d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60718/0 (socket says 172.21.15.57:60718) 2023-03-02T10:57:22.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f8732d9d700 1 -- 172.21.15.57:0/2986804909 learned_addr learned my addr 172.21.15.57:0/2986804909 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:22.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f873259c700 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f873359e700 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269c0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f873259c700 1 -- 172.21.15.57:0/2986804909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 msgr2=0x5609269c0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f873259c700 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269c0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f873259c700 1 -- 172.21.15.57:0/2986804909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 msgr2=0x5609269c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:22.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f873259c700 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f873259c700 1 -- 172.21.15.57:0/2986804909 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8724017070 con 0x5609269b1cd0 2023-03-02T10:57:22.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f873259c700 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269c1fa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8728098270 tx=0x7f8728094d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b1048f7680d8485 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:22.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f8716ff5700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:22.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.889+0000 7f8716ff5700 1 -- 172.21.15.57:0/2986804909 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280ab070 con 0x5609269b1cd0 2023-03-02T10:57:22.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f874cb9bb80 1 -- 172.21.15.57:0/2986804909 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8728094730 con 0x5609269b1cd0 2023-03-02T10:57:22.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f8716ff5700 1 -- 172.21.15.57:0/2986804909 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f872800ca10 con 0x5609269b1cd0 2023-03-02T10:57:22.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f8716ff5700 1 -- 172.21.15.57:0/2986804909 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f872800cbd0 con 0x5609269b1cd0 2023-03-02T10:57:22.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f874cb9bb80 10 client.25490 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:22.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f874cb9bb80 1 -- 172.21.15.57:0/2986804909 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560926758250 con 0x5609269b1cd0 2023-03-02T10:57:22.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f8716ff5700 1 -- 172.21.15.57:0/2986804909 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8728094730 con 0x5609269b1cd0 2023-03-02T10:57:22.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f8716ff5700 1 -- 172.21.15.57:0/2986804909 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f87280a1080 con 0x5609269b1cd0 2023-03-02T10:57:22.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f874cb9bb80 10 client.25490 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:22.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f874cb9bb80 10 client.25490 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-02T10:57:22.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f874cb9bb80 20 client.25490 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:22.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x560926a1d2c0 0x560926a1f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:22.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f874cb9bb80 4 client.25490 mds_command: new command op to 24505 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:57:22.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f874cb9bb80 1 -- 172.21.15.57:0/2986804909 --> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5609268fbe90 con 0x560926a1d2c0 2023-03-02T10:57:22.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.890+0000 7f8732d9d700 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x560926a1d2c0 0x560926a1f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:22.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f8732d9d700 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x560926a1d2c0 0x560926a1f6d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=192fd464c1836faf server_cookie=31c1197c31de122 in_seq=0 out_seq=0 2023-03-02T10:57:22.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f8716ff5700 10 client.25490 ms_handle_connect on v2:172.21.15.136:6836/2130761226 2023-03-02T10:57:22.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f8716ff5700 1 -- 172.21.15.57:0/2986804909 <== mds.2 v2:172.21.15.136:6836/2130761226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5609268fbe90 con 0x560926a1d2c0 2023-03-02T10:57:22.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f8716ff5700 10 client.25490 handle_command_reply: tid=0 2023-03-02T10:57:22.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 1 client.25490 shutdown 2023-03-02T10:57:22.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 1 -- 172.21.15.57:0/2986804909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 msgr2=0x5609269c1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269c1fa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8728098270 tx=0x7f8728094d00 comp rx=0 tx=0).stop 2023-03-02T10:57:22.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 1 -- 172.21.15.57:0/2986804909 shutdown_connections 2023-03-02T10:57:22.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x560926a1d2c0 0x560926a1f6d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5609269b6110 0x5609269c0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609269b13c0 0x5609269c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 1 --2- 172.21.15.57:0/2986804909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5609269b1cd0 0x5609269c1fa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f8716ff5700 0 client.25490 ms_handle_reset on v2:172.21.15.136:6836/2130761226 2023-03-02T10:57:22.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 1 -- 172.21.15.57:0/2986804909 >> 172.21.15.57:0/2986804909 conn(0x5609269a6c50 msgr2=0x5609269b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 1 -- 172.21.15.57:0/2986804909 shutdown_connections 2023-03-02T10:57:22.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 1 -- 172.21.15.57:0/2986804909 wait complete. 2023-03-02T10:57:22.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.891+0000 7f874cb9bb80 20 client.25490 trim_cache size 0 max 16384 2023-03-02T10:57:22.903 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:57:22.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 -- 172.21.15.57:0/1175804877 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f871c09b540 msgr2=0x7f871c09d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f871c09b540 0x7f871c09d9f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8734100bf0 tx=0x7f8724009260 comp rx=0 tx=0).stop 2023-03-02T10:57:22.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 -- 172.21.15.57:0/1175804877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8734100460 msgr2=0x7f87341962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:22.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8734100460 0x7f87341962c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f872800e9a0 tx=0x7f872800ecb0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 -- 172.21.15.57:0/1175804877 shutdown_connections 2023-03-02T10:57:22.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f871c09b540 0x7f871c09d9f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8734105ac0 0x7f873419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87340ffab0 0x7f8734195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 --2- 172.21.15.57:0/1175804877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8734100460 0x7f87341962c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:22.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 -- 172.21.15.57:0/1175804877 >> 172.21.15.57:0/1175804877 conn(0x7f87340fb5d0 msgr2=0x7f87340fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:22.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 -- 172.21.15.57:0/1175804877 shutdown_connections 2023-03-02T10:57:22.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:22.892+0000 7f87391ff700 1 -- 172.21.15.57:0/1175804877 wait complete. 2023-03-02T10:57:22.905 INFO:teuthology.orchestra.run.smithi057.stderr:4600000 of 50000000 tuples (9%) done (elapsed 7.71 s, remaining 76.06 s) 2023-03-02T10:57:22.907 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:22 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/550458476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:57:22.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-03-02T10:57:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:22 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/550458476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:57:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:22 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/550458476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:57:23.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.089+0000 7f7d289ff700 1 -- 172.21.15.57:0/2423093351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d2410c430 msgr2=0x7f7d2410e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.089+0000 7f7d289ff700 1 --2- 172.21.15.57:0/2423093351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d2410c430 0x7f7d2410e810 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00b0a0 tx=0x7f7d1c00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.089+0000 7f7d289ff700 1 -- 172.21.15.57:0/2423093351 shutdown_connections 2023-03-02T10:57:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.089+0000 7f7d289ff700 1 --2- 172.21.15.57:0/2423093351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d2410c430 0x7f7d2410e810 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.089+0000 7f7d289ff700 1 --2- 172.21.15.57:0/2423093351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d240fe880 0x7f7d240fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.089+0000 7f7d289ff700 1 --2- 172.21.15.57:0/2423093351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d240ff190 0x7f7d2410bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.089+0000 7f7d289ff700 1 -- 172.21.15.57:0/2423093351 >> 172.21.15.57:0/2423093351 conn(0x7f7d240fa4b0 msgr2=0x7f7d240fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.090+0000 7f7d289ff700 1 -- 172.21.15.57:0/2423093351 shutdown_connections 2023-03-02T10:57:23.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.090+0000 7f7d289ff700 1 -- 172.21.15.57:0/2423093351 wait complete. 2023-03-02T10:57:23.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.090+0000 7f7d289ff700 1 Processor -- start 2023-03-02T10:57:23.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.090+0000 7f7d289ff700 1 -- start start 2023-03-02T10:57:23.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d289ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d240fe880 0x7f7d24197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d289ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d240ff190 0x7f7d24198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d289ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d2410c430 0x7f7d2419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d289ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2419cf20 con 0x7f7d2410c430 2023-03-02T10:57:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d289ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2419d090 con 0x7f7d240ff190 2023-03-02T10:57:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d289ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2419d250 con 0x7f7d240fe880 2023-03-02T10:57:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d22d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d2410c430 0x7f7d2419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d22d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d2410c430 0x7f7d2419c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60726/0 (socket says 172.21.15.57:60726) 2023-03-02T10:57:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d22d9d700 1 -- 172.21.15.57:0/1363532975 learned_addr learned my addr 172.21.15.57:0/1363532975 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d240fe880 0x7f7d24197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d21d9b700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d240ff190 0x7f7d24198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d2259c700 1 -- 172.21.15.57:0/1363532975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d240ff190 msgr2=0x7f7d24198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d240ff190 0x7f7d24198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d2259c700 1 -- 172.21.15.57:0/1363532975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d2410c430 msgr2=0x7f7d2419c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d2410c430 0x7f7d2419c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d2259c700 1 -- 172.21.15.57:0/1363532975 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c009d00 con 0x7f7d240fe880 2023-03-02T10:57:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.091+0000 7f7d22d9d700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d2410c430 0x7f7d2419c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.092+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d240fe880 0x7f7d24197f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400e9f0 tx=0x7f7d1400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.092+0000 7f7d137fe700 1 -- 172.21.15.57:0/1363532975 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400c9c0 con 0x7f7d240fe880 2023-03-02T10:57:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.092+0000 7f7d289ff700 1 -- 172.21.15.57:0/1363532975 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d24111cf0 con 0x7f7d240fe880 2023-03-02T10:57:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.092+0000 7f7d137fe700 1 -- 172.21.15.57:0/1363532975 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d14010430 con 0x7f7d240fe880 2023-03-02T10:57:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.092+0000 7f7d137fe700 1 -- 172.21.15.57:0/1363532975 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14018680 con 0x7f7d240fe880 2023-03-02T10:57:23.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.092+0000 7f7d289ff700 1 -- 172.21.15.57:0/1363532975 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d24111b60 con 0x7f7d240fe880 2023-03-02T10:57:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.094+0000 7f7d137fe700 1 -- 172.21.15.57:0/1363532975 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f7d1400c040 con 0x7f7d240fe880 2023-03-02T10:57:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.096+0000 7f7d137fe700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7d0c09b4c0 0x7f7d0c09d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.096+0000 7f7d137fe700 1 -- 172.21.15.57:0/1363532975 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7d14014070 con 0x7f7d240fe880 2023-03-02T10:57:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.096+0000 7f7d3c2a3b80 1 Processor -- start 2023-03-02T10:57:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.096+0000 7f7d21d9b700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7d0c09b4c0 0x7f7d0c09d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.096+0000 7f7d3c2a3b80 1 -- start start 2023-03-02T10:57:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de23c0 0x557a70de2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de2cd0 0x557a70de6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70de7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70d49a60 con 0x557a70de2cd0 2023-03-02T10:57:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70cfbf80 con 0x557a70de7110 2023-03-02T10:57:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70ccc160 con 0x557a70de23c0 2023-03-02T10:57:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d21d9b700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7d0c09b4c0 0x7f7d0c09d970 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d24199550 tx=0x7f7d180073d0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d2259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de23c0 0x557a70de2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d21d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de2cd0 0x557a70de6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d2259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de23c0 0x557a70de2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:44232/0 (socket says 172.21.15.57:44232) 2023-03-02T10:57:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d2259c700 1 -- 172.21.15.57:0/1680391939 learned_addr learned my addr 172.21.15.57:0/1680391939 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d22d9d700 1 --2- 172.21.15.57:0/1680391939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70de7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d2259c700 1 -- 172.21.15.57:0/1680391939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 msgr2=0x557a70de7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1680391939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70de7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d2259c700 1 -- 172.21.15.57:0/1680391939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de2cd0 msgr2=0x557a70de6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1680391939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de2cd0 0x557a70de6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.097+0000 7f7d2259c700 1 -- 172.21.15.57:0/1680391939 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a70bb6630 con 0x557a70de23c0 2023-03-02T10:57:23.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.098+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1680391939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de23c0 0x557a70de2790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7d140c2f90 tx=0x7f7d14094340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ea28d66e959ec08 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.098+0000 7f7d10ff9700 1 -- 172.21.15.57:0/1680391939 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d140ab070 con 0x557a70de23c0 2023-03-02T10:57:23.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.098+0000 7f7d10ff9700 1 -- 172.21.15.57:0/1680391939 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d14094700 con 0x557a70de23c0 2023-03-02T10:57:23.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.098+0000 7f7d10ff9700 1 -- 172.21.15.57:0/1680391939 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14093e50 con 0x557a70de23c0 2023-03-02T10:57:23.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.098+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1680391939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de23c0 msgr2=0x557a70de2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.098+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1680391939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de23c0 0x557a70de2790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7d140c2f90 tx=0x7f7d14094340 comp rx=0 tx=0).stop 2023-03-02T10:57:23.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.099+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1680391939 shutdown_connections 2023-03-02T10:57:23.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.099+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1680391939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70de7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.099+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1680391939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de23c0 0x557a70de2790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.099+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1680391939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de2cd0 0x557a70de6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.099+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1680391939 >> 172.21.15.57:0/1680391939 conn(0x557a70dd7c50 msgr2=0x557a70ddd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.099+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1680391939 shutdown_connections 2023-03-02T10:57:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.099+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1680391939 wait complete. 2023-03-02T10:57:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.099+0000 7f7d3c2a3b80 1 -- start start 2023-03-02T10:57:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.099+0000 7f7d3c2a3b80 1 Processor -- start 2023-03-02T10:57:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de23c0 0x557a70dee910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70debb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de7110 0x557a70dec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70d3abc0 con 0x557a70de7110 2023-03-02T10:57:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70d340f0 con 0x557a70de23c0 2023-03-02T10:57:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70bb8920 con 0x557a70de2cd0 2023-03-02T10:57:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d3c2a3b80 10 client.0 _ll_register_callbacks cb 0x557a70cda520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d2259c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de23c0 0x557a70dee910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d2259c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de23c0 0x557a70dee910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59524/0 (socket says 172.21.15.57:59524) 2023-03-02T10:57:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d2259c700 1 -- 172.21.15.57:0/1100384951 learned_addr learned my addr 172.21.15.57:0/1100384951 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d22d9d700 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de7110 0x557a70dec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d21d9b700 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70debb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d2259c700 1 -- 172.21.15.57:0/1100384951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 msgr2=0x557a70debb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70debb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d2259c700 1 -- 172.21.15.57:0/1100384951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de7110 msgr2=0x557a70dec2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de7110 0x557a70dec2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d2259c700 1 -- 172.21.15.57:0/1100384951 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d24111b60 con 0x557a70de23c0 2023-03-02T10:57:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de23c0 0x557a70dee910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7d14094d60 tx=0x7f7d140107d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3917a8fb9c508ab5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.100+0000 7f7d09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d09ffb700 1 -- 172.21.15.57:0/1100384951 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d140ab070 con 0x557a70de23c0 2023-03-02T10:57:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1100384951 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a70d057b0 con 0x557a70de23c0 2023-03-02T10:57:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d09ffb700 1 -- 172.21.15.57:0/1100384951 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7d1409be20 con 0x557a70de23c0 2023-03-02T10:57:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d09ffb700 1 -- 172.21.15.57:0/1100384951 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d1409b990 con 0x557a70de23c0 2023-03-02T10:57:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d3c2a3b80 10 client.25502 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1100384951 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557a70b62de0 con 0x557a70de23c0 2023-03-02T10:57:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d09ffb700 1 -- 172.21.15.57:0/1100384951 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d14078020 con 0x557a70de23c0 2023-03-02T10:57:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d09ffb700 1 -- 172.21.15.57:0/1100384951 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7d14093660 con 0x557a70de23c0 2023-03-02T10:57:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d3c2a3b80 10 client.25502 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d3c2a3b80 10 client.25502 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-02T10:57:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d3c2a3b80 20 client.25502 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x557a70dfbe00 0x557a70dfe210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d3c2a3b80 4 client.25502 mds_command: new command op to 24520 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:23.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.101+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1100384951 --> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a70d2d170 con 0x557a70dfbe00 2023-03-02T10:57:23.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.102+0000 7f7d21d9b700 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x557a70dfbe00 0x557a70dfe210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.102+0000 7f7d09ffb700 10 client.25502 ms_handle_connect on v2:172.21.15.136:6838/1702113579 2023-03-02T10:57:23.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.102+0000 7f7d21d9b700 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x557a70dfbe00 0x557a70dfe210 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f72f9476ccd0dac server_cookie=9d2b70f0a95c656d in_seq=0 out_seq=0 2023-03-02T10:57:23.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d09ffb700 1 -- 172.21.15.57:0/1100384951 <== mds.1 v2:172.21.15.136:6838/1702113579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x557a70d2d170 con 0x557a70dfbe00 2023-03-02T10:57:23.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d09ffb700 10 client.25502 handle_command_reply: tid=0 2023-03-02T10:57:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 1 client.25502 shutdown 2023-03-02T10:57:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1100384951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de23c0 msgr2=0x557a70dee910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de23c0 0x557a70dee910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7d14094d60 tx=0x7f7d140107d0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1100384951 shutdown_connections 2023-03-02T10:57:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x557a70dfbe00 0x557a70dfe210 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de7110 0x557a70dec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de23c0 0x557a70dee910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d09ffb700 0 client.25502 ms_handle_reset on v2:172.21.15.136:6838/1702113579 2023-03-02T10:57:23.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1100384951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70debb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1100384951 >> 172.21.15.57:0/1100384951 conn(0x557a70dd7c50 msgr2=0x557a70ddd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1100384951 shutdown_connections 2023-03-02T10:57:23.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1100384951 wait complete. 2023-03-02T10:57:23.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.103+0000 7f7d3c2a3b80 20 client.25502 trim_cache size 0 max 16384 2023-03-02T10:57:23.115 INFO:teuthology.orchestra.run.smithi057.stderr:4700000 of 50000000 tuples (9%) done (elapsed 7.91 s, remaining 76.28 s) 2023-03-02T10:57:23.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.119+0000 7f7d3c2a3b80 1 Processor -- start 2023-03-02T10:57:23.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.119+0000 7f7d3c2a3b80 1 -- start start 2023-03-02T10:57:23.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70de62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70de6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70df77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70ddd9e0 con 0x557a70de23c0 2023-03-02T10:57:23.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70dd7a60 con 0x557a70de7110 2023-03-02T10:57:23.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70decb40 con 0x557a70de2cd0 2023-03-02T10:57:23.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d2259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70de62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d2259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70de62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60764/0 (socket says 172.21.15.57:60764) 2023-03-02T10:57:23.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d2259c700 1 -- 172.21.15.57:0/1847794446 learned_addr learned my addr 172.21.15.57:0/1847794446 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:23.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d22d9d700 1 --2- 172.21.15.57:0/1847794446 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70df77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d21d9b700 1 --2- 172.21.15.57:0/1847794446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70de6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d2259c700 1 -- 172.21.15.57:0/1847794446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 msgr2=0x557a70de6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1847794446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70de6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d2259c700 1 -- 172.21.15.57:0/1847794446 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 msgr2=0x557a70df77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1847794446 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70df77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.120+0000 7f7d2259c700 1 -- 172.21.15.57:0/1847794446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a70cfb190 con 0x557a70de23c0 2023-03-02T10:57:23.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.121+0000 7f7d2259c700 1 --2- 172.21.15.57:0/1847794446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70de62d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400e9c0 tx=0x7f7d14010c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d9e5906579c1d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.121+0000 7f7d117fa700 1 -- 172.21.15.57:0/1847794446 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d140ab070 con 0x557a70de23c0 2023-03-02T10:57:23.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.121+0000 7f7d117fa700 1 -- 172.21.15.57:0/1847794446 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d14078070 con 0x557a70de23c0 2023-03-02T10:57:23.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.121+0000 7f7d117fa700 1 -- 172.21.15.57:0/1847794446 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1409b990 con 0x557a70de23c0 2023-03-02T10:57:23.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.122+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1847794446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 msgr2=0x557a70de62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.122+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1847794446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70de62d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400e9c0 tx=0x7f7d14010c60 comp rx=0 tx=0).stop 2023-03-02T10:57:23.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.122+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1847794446 shutdown_connections 2023-03-02T10:57:23.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.122+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1847794446 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70df77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.122+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1847794446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70de62d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.122+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/1847794446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70de6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.122+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1847794446 >> 172.21.15.57:0/1847794446 conn(0x557a70dd7c50 msgr2=0x557a70ddc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.122+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1847794446 shutdown_connections 2023-03-02T10:57:23.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.122+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/1847794446 wait complete. 2023-03-02T10:57:23.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.122+0000 7f7d3c2a3b80 1 -- start start 2023-03-02T10:57:23.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.122+0000 7f7d3c2a3b80 1 Processor -- start 2023-03-02T10:57:23.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70df2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70df1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d3c2a3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70df1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70df3670 con 0x557a70de23c0 2023-03-02T10:57:23.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70df1da0 con 0x557a70de7110 2023-03-02T10:57:23.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d3c2a3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a70df1f10 con 0x557a70de2cd0 2023-03-02T10:57:23.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d3c2a3b80 10 client.0 _ll_register_callbacks cb 0x557a70cda520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:23.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d2259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70df2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d2259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70df2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60776/0 (socket says 172.21.15.57:60776) 2023-03-02T10:57:23.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d2259c700 1 -- 172.21.15.57:0/973254535 learned_addr learned my addr 172.21.15.57:0/973254535 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:23.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d22d9d700 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70df1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d21d9b700 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70df1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d2259c700 1 -- 172.21.15.57:0/973254535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 msgr2=0x557a70df1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d2259c700 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70df1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d2259c700 1 -- 172.21.15.57:0/973254535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 msgr2=0x557a70df1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d2259c700 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70df1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d2259c700 1 -- 172.21.15.57:0/973254535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a70b62de0 con 0x557a70de23c0 2023-03-02T10:57:23.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.123+0000 7f7d21d9b700 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70df1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:23.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d2259c700 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70df2d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7d14092a50 tx=0x7f7d14093a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b5242799df0bf2 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:23.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d09ffb700 1 -- 172.21.15.57:0/973254535 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d140ab040 con 0x557a70de23c0 2023-03-02T10:57:23.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d09ffb700 1 -- 172.21.15.57:0/973254535 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7d14079080 con 0x557a70de23c0 2023-03-02T10:57:23.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/973254535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d14094700 con 0x557a70de23c0 2023-03-02T10:57:23.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d09ffb700 1 -- 172.21.15.57:0/973254535 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d1400cb20 con 0x557a70de23c0 2023-03-02T10:57:23.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d3c2a3b80 10 client.15642 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:23.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/973254535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557a70b89250 con 0x557a70de23c0 2023-03-02T10:57:23.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d09ffb700 1 -- 172.21.15.57:0/973254535 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d14094700 con 0x557a70de23c0 2023-03-02T10:57:23.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d09ffb700 1 -- 172.21.15.57:0/973254535 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7d140952f0 con 0x557a70de23c0 2023-03-02T10:57:23.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d3c2a3b80 10 client.15642 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:23.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d3c2a3b80 10 client.15642 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-02T10:57:23.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d3c2a3b80 20 client.15642 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:23.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x557a70e4e580 0x557a70e50960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d3c2a3b80 4 client.15642 mds_command: new command op to 24520 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:57:23.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.124+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/973254535 --> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557a70d2ce90 con 0x557a70e4e580 2023-03-02T10:57:23.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d21d9b700 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x557a70e4e580 0x557a70e50960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d21d9b700 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x557a70e4e580 0x557a70e50960 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=70ba9b799381d97f server_cookie=4f40a24e7bbe6e15 in_seq=0 out_seq=0 2023-03-02T10:57:23.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d09ffb700 10 client.15642 ms_handle_connect on v2:172.21.15.136:6838/1702113579 2023-03-02T10:57:23.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d09ffb700 1 -- 172.21.15.57:0/973254535 <== mds.1 v2:172.21.15.136:6838/1702113579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557a70d2ce90 con 0x557a70e4e580 2023-03-02T10:57:23.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d09ffb700 10 client.15642 handle_command_reply: tid=0 2023-03-02T10:57:23.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d3c2a3b80 1 client.15642 shutdown 2023-03-02T10:57:23.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/973254535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 msgr2=0x557a70df2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70df2d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7d14092a50 tx=0x7f7d14093a40 comp rx=0 tx=0).stop 2023-03-02T10:57:23.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/973254535 shutdown_connections 2023-03-02T10:57:23.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x557a70e4e580 0x557a70e50960 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557a70de7110 0x557a70df1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557a70de23c0 0x557a70df2d80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d3c2a3b80 1 --2- 172.21.15.57:0/973254535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557a70de2cd0 0x557a70df1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.125+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/973254535 >> 172.21.15.57:0/973254535 conn(0x557a70dd7c50 msgr2=0x557a70de62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d09ffb700 0 client.15642 ms_handle_reset on v2:172.21.15.136:6838/1702113579 2023-03-02T10:57:23.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/973254535 shutdown_connections 2023-03-02T10:57:23.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d3c2a3b80 1 -- 172.21.15.57:0/973254535 wait complete. 2023-03-02T10:57:23.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d3c2a3b80 20 client.15642 trim_cache size 0 max 16384 2023-03-02T10:57:23.136 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:57:23.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d289ff700 1 -- 172.21.15.57:0/1363532975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7d0c09b4c0 msgr2=0x7f7d0c09d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d289ff700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7d0c09b4c0 0x7f7d0c09d970 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d24199550 tx=0x7f7d180073d0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d289ff700 1 -- 172.21.15.57:0/1363532975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d240fe880 msgr2=0x7f7d24197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d289ff700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d240fe880 0x7f7d24197f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400e9f0 tx=0x7f7d1400ed00 comp rx=0 tx=0).stop 2023-03-02T10:57:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d289ff700 1 -- 172.21.15.57:0/1363532975 shutdown_connections 2023-03-02T10:57:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d289ff700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f7d0c09b4c0 0x7f7d0c09d970 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d289ff700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d2410c430 0x7f7d2419c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d289ff700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d240fe880 0x7f7d24197f40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d289ff700 1 --2- 172.21.15.57:0/1363532975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d240ff190 0x7f7d24198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d289ff700 1 -- 172.21.15.57:0/1363532975 >> 172.21.15.57:0/1363532975 conn(0x7f7d240fa4b0 msgr2=0x7f7d2410d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.126+0000 7f7d289ff700 1 -- 172.21.15.57:0/1363532975 shutdown_connections 2023-03-02T10:57:23.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.127+0000 7f7d289ff700 1 -- 172.21.15.57:0/1363532975 wait complete. 2023-03-02T10:57:23.143 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-03-02T10:57:23.236 INFO:teuthology.orchestra.run.smithi057.stderr:4800000 of 50000000 tuples (9%) done (elapsed 8.04 s, remaining 75.72 s) 2023-03-02T10:57:23.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.323+0000 7f70a75ff700 1 -- 172.21.15.57:0/1639771158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70a00ff360 msgr2=0x7f70a010b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.323+0000 7f70a75ff700 1 --2- 172.21.15.57:0/1639771158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70a00ff360 0x7f70a010b7f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f709800b0a0 tx=0x7f709800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.323+0000 7f70a75ff700 1 -- 172.21.15.57:0/1639771158 shutdown_connections 2023-03-02T10:57:23.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.323+0000 7f70a75ff700 1 --2- 172.21.15.57:0/1639771158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70a00ff360 0x7f70a010b7f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.323+0000 7f70a75ff700 1 --2- 172.21.15.57:0/1639771158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70a01049c0 0x7f70a0104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.323+0000 7f70a75ff700 1 --2- 172.21.15.57:0/1639771158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a00fe9b0 0x7f70a00fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.323+0000 7f70a75ff700 1 -- 172.21.15.57:0/1639771158 >> 172.21.15.57:0/1639771158 conn(0x7f70a00fa4b0 msgr2=0x7f70a00fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.323+0000 7f70a75ff700 1 -- 172.21.15.57:0/1639771158 shutdown_connections 2023-03-02T10:57:23.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.323+0000 7f70a75ff700 1 -- 172.21.15.57:0/1639771158 wait complete. 2023-03-02T10:57:23.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a75ff700 1 Processor -- start 2023-03-02T10:57:23.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a75ff700 1 -- start start 2023-03-02T10:57:23.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a75ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a00fe9b0 0x7f70a0195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a75ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70a00ff360 0x7f70a01962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a75ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70a01049c0 0x7f70a019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a75ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a019ad60 con 0x7f70a01049c0 2023-03-02T10:57:23.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a75ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a019aed0 con 0x7f70a00fe9b0 2023-03-02T10:57:23.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a75ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a019b090 con 0x7f70a00ff360 2023-03-02T10:57:23.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a5b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70a01049c0 0x7f70a019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a5b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70a01049c0 0x7f70a019a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60802/0 (socket says 172.21.15.57:60802) 2023-03-02T10:57:23.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a5b9c700 1 -- 172.21.15.57:0/1311381328 learned_addr learned my addr 172.21.15.57:0/1311381328 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:23.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a539b700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a00fe9b0 0x7f70a0195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.324+0000 7f70a4b9a700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70a00ff360 0x7f70a01962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.325+0000 7f70a5b9c700 1 -- 172.21.15.57:0/1311381328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70a00ff360 msgr2=0x7f70a01962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.325+0000 7f70a5b9c700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70a00ff360 0x7f70a01962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.325+0000 7f70a5b9c700 1 -- 172.21.15.57:0/1311381328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a00fe9b0 msgr2=0x7f70a0195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.325+0000 7f70a5b9c700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a00fe9b0 0x7f70a0195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.325+0000 7f70a5b9c700 1 -- 172.21.15.57:0/1311381328 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7098009d00 con 0x7f70a01049c0 2023-03-02T10:57:23.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.325+0000 7f70a5b9c700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70a01049c0 0x7f70a019a720 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7098009fd0 tx=0x7f709800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.325+0000 7f70967fc700 1 -- 172.21.15.57:0/1311381328 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800e040 con 0x7f70a01049c0 2023-03-02T10:57:23.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.325+0000 7f70a75ff700 1 -- 172.21.15.57:0/1311381328 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a010eaa0 con 0x7f70a01049c0 2023-03-02T10:57:23.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.325+0000 7f70967fc700 1 -- 172.21.15.57:0/1311381328 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70980094c0 con 0x7f70a01049c0 2023-03-02T10:57:23.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.325+0000 7f70967fc700 1 -- 172.21.15.57:0/1311381328 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980052a0 con 0x7f70a01049c0 2023-03-02T10:57:23.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.325+0000 7f70a75ff700 1 -- 172.21.15.57:0/1311381328 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a010e910 con 0x7f70a01049c0 2023-03-02T10:57:23.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.328+0000 7f70967fc700 1 -- 172.21.15.57:0/1311381328 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f709801d470 con 0x7f70a01049c0 2023-03-02T10:57:23.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.329+0000 7f70967fc700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f708c09b4c0 0x7f708c09d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.329+0000 7f70bb017b80 1 Processor -- start 2023-03-02T10:57:23.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.329+0000 7f70967fc700 1 -- 172.21.15.57:0/1311381328 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f70980c6800 con 0x7f70a01049c0 2023-03-02T10:57:23.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.329+0000 7f70a539b700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f708c09b4c0 0x7f708c09d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70bb017b80 1 -- start start 2023-03-02T10:57:23.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 0x5592382a2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a7110 0x5592382a7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70bb017b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559238209a60 con 0x5592382a2cd0 2023-03-02T10:57:23.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70bb017b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592381bbf80 con 0x5592382a23c0 2023-03-02T10:57:23.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70bb017b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923818c160 con 0x5592382a7110 2023-03-02T10:57:23.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70a539b700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f708c09b4c0 0x7f708c09d970 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f70a00ffaf0 tx=0x7f709c009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70a4b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70a4b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60804/0 (socket says 172.21.15.57:60804) 2023-03-02T10:57:23.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70a4b9a700 1 -- 172.21.15.57:0/2101634017 learned_addr learned my addr 172.21.15.57:0/2101634017 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:23.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70a539b700 1 --2- 172.21.15.57:0/2101634017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 0x5592382a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70a5b9c700 1 --2- 172.21.15.57:0/2101634017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a7110 0x5592382a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70a539b700 1 -- 172.21.15.57:0/2101634017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a7110 msgr2=0x5592382a7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70a539b700 1 --2- 172.21.15.57:0/2101634017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a7110 0x5592382a7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70a539b700 1 -- 172.21.15.57:0/2101634017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 msgr2=0x5592382a6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70a539b700 1 --2- 172.21.15.57:0/2101634017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.330+0000 7f70a539b700 1 -- 172.21.15.57:0/2101634017 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559238076630 con 0x5592382a23c0 2023-03-02T10:57:23.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.331+0000 7f70a4b9a700 1 --2- 172.21.15.57:0/2101634017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:23.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.331+0000 7f70a539b700 1 --2- 172.21.15.57:0/2101634017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 0x5592382a2790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f709c011bf0 tx=0x7f709c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c31bde9fa8ff1cd server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.331+0000 7f708b7fe700 1 -- 172.21.15.57:0/2101634017 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c00e840 con 0x5592382a23c0 2023-03-02T10:57:23.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.331+0000 7f708b7fe700 1 -- 172.21.15.57:0/2101634017 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f709c021070 con 0x5592382a23c0 2023-03-02T10:57:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.331+0000 7f708b7fe700 1 -- 172.21.15.57:0/2101634017 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c026da0 con 0x5592382a23c0 2023-03-02T10:57:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.332+0000 7f70bb017b80 1 -- 172.21.15.57:0/2101634017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 msgr2=0x5592382a2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.332+0000 7f70bb017b80 1 --2- 172.21.15.57:0/2101634017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 0x5592382a2790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f709c011bf0 tx=0x7f709c014000 comp rx=0 tx=0).stop 2023-03-02T10:57:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.332+0000 7f70bb017b80 1 -- 172.21.15.57:0/2101634017 shutdown_connections 2023-03-02T10:57:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.332+0000 7f70bb017b80 1 --2- 172.21.15.57:0/2101634017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a7110 0x5592382a7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.332+0000 7f70bb017b80 1 --2- 172.21.15.57:0/2101634017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 0x5592382a2790 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.332+0000 7f70bb017b80 1 --2- 172.21.15.57:0/2101634017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.332+0000 7f70bb017b80 1 -- 172.21.15.57:0/2101634017 >> 172.21.15.57:0/2101634017 conn(0x559238297c50 msgr2=0x55923829d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.332+0000 7f70bb017b80 1 -- 172.21.15.57:0/2101634017 shutdown_connections 2023-03-02T10:57:23.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.332+0000 7f70bb017b80 1 -- 172.21.15.57:0/2101634017 wait complete. 2023-03-02T10:57:23.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.332+0000 7f70bb017b80 1 -- start start 2023-03-02T10:57:23.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.332+0000 7f70bb017b80 1 Processor -- start 2023-03-02T10:57:23.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 0x5592382abc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382ac150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a7110 0x5592382ac690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70bb017b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592381fabc0 con 0x5592382a2cd0 2023-03-02T10:57:23.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70bb017b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592381f40f0 con 0x5592382a23c0 2023-03-02T10:57:23.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70bb017b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559238078920 con 0x5592382a7110 2023-03-02T10:57:23.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70bb017b80 10 client.0 _ll_register_callbacks cb 0x55923819a520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:23.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a4b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a5b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a7110 0x5592382ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a4b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60808/0 (socket says 172.21.15.57:60808) 2023-03-02T10:57:23.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a4b9a700 1 -- 172.21.15.57:0/466534613 learned_addr learned my addr 172.21.15.57:0/466534613 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:23.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a539b700 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 0x5592382abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a4b9a700 1 -- 172.21.15.57:0/466534613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a7110 msgr2=0x5592382ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a4b9a700 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a7110 0x5592382ac690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a4b9a700 1 -- 172.21.15.57:0/466534613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 msgr2=0x5592382abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a4b9a700 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 0x5592382abc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a4b9a700 1 -- 172.21.15.57:0/466534613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c017070 con 0x5592382a2cd0 2023-03-02T10:57:23.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a539b700 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 0x5592382abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:23.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f70a4b9a700 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382ac150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7090012840 tx=0x7f7090012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8bbc1e0ba962df server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.333+0000 7f7088ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:23.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f7088ff9700 1 -- 172.21.15.57:0/466534613 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090017070 con 0x5592382a2cd0 2023-03-02T10:57:23.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f7088ff9700 1 -- 172.21.15.57:0/466534613 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7090004020 con 0x5592382a2cd0 2023-03-02T10:57:23.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f70bb017b80 1 -- 172.21.15.57:0/466534613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5592381c57b0 con 0x5592382a2cd0 2023-03-02T10:57:23.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f7088ff9700 1 -- 172.21.15.57:0/466534613 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7090004220 con 0x5592382a2cd0 2023-03-02T10:57:23.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f70bb017b80 10 client.15654 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:23.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f70bb017b80 1 -- 172.21.15.57:0/466534613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559238022de0 con 0x5592382a2cd0 2023-03-02T10:57:23.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f7088ff9700 1 -- 172.21.15.57:0/466534613 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5592381c57b0 con 0x5592382a2cd0 2023-03-02T10:57:23.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f7088ff9700 1 -- 172.21.15.57:0/466534613 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f709000f5e0 con 0x5592382a2cd0 2023-03-02T10:57:23.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f70bb017b80 10 client.15654 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:23.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f70bb017b80 10 client.15654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:23.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f70bb017b80 20 client.15654 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:23.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f70bb017b80 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5592382bc330 0x5592382be740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f70bb017b80 4 client.15654 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:23.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.334+0000 7f70bb017b80 1 -- 172.21.15.57:0/466534613 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592381ed170 con 0x5592382bc330 2023-03-02T10:57:23.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.335+0000 7f70a539b700 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5592382bc330 0x5592382be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.335+0000 7f70a539b700 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5592382bc330 0x5592382be740 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd9bd7c38e7980ef server_cookie=a65b00df27c3154a in_seq=0 out_seq=0 2023-03-02T10:57:23.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.335+0000 7f7088ff9700 10 client.15654 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:23.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f7088ff9700 1 -- 172.21.15.57:0/466534613 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5592381ed170 con 0x5592382bc330 2023-03-02T10:57:23.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f7088ff9700 10 client.15654 handle_command_reply: tid=0 2023-03-02T10:57:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f70bb017b80 1 client.15654 shutdown 2023-03-02T10:57:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f70bb017b80 1 -- 172.21.15.57:0/466534613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 msgr2=0x5592382ac150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f70bb017b80 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382ac150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7090012840 tx=0x7f7090012c00 comp rx=0 tx=0).stop 2023-03-02T10:57:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f70bb017b80 1 -- 172.21.15.57:0/466534613 shutdown_connections 2023-03-02T10:57:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f70bb017b80 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5592382bc330 0x5592382be740 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f70bb017b80 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a7110 0x5592382ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f7088ff9700 0 client.15654 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:23.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f70bb017b80 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a23c0 0x5592382abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f70bb017b80 1 --2- 172.21.15.57:0/466534613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382ac150 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f70bb017b80 1 -- 172.21.15.57:0/466534613 >> 172.21.15.57:0/466534613 conn(0x559238297c50 msgr2=0x55923829d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f70bb017b80 1 -- 172.21.15.57:0/466534613 shutdown_connections 2023-03-02T10:57:23.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.336+0000 7f70bb017b80 1 -- 172.21.15.57:0/466534613 wait complete. 2023-03-02T10:57:23.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.337+0000 7f70bb017b80 20 client.15654 trim_cache size 0 max 16384 2023-03-02T10:57:23.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.349+0000 7f70bb017b80 1 Processor -- start 2023-03-02T10:57:23.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.349+0000 7f70bb017b80 1 -- start start 2023-03-02T10:57:23.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a23c0 0x5592382a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 0x5592382ac180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70bb017b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923829cdb0 con 0x5592382a2cd0 2023-03-02T10:57:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70bb017b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592382ad1f0 con 0x5592382a7110 2023-03-02T10:57:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70bb017b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923829dfa0 con 0x5592382a23c0 2023-03-02T10:57:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a4b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a4b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60810/0 (socket says 172.21.15.57:60810) 2023-03-02T10:57:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a4b9a700 1 -- 172.21.15.57:0/80247621 learned_addr learned my addr 172.21.15.57:0/80247621 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a5b9c700 1 --2- 172.21.15.57:0/80247621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 0x5592382ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a539b700 1 --2- 172.21.15.57:0/80247621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a23c0 0x5592382a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a4b9a700 1 -- 172.21.15.57:0/80247621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a23c0 msgr2=0x5592382a62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a4b9a700 1 --2- 172.21.15.57:0/80247621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a23c0 0x5592382a62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a4b9a700 1 -- 172.21.15.57:0/80247621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 msgr2=0x5592382ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a4b9a700 1 --2- 172.21.15.57:0/80247621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 0x5592382ac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a4b9a700 1 -- 172.21.15.57:0/80247621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55923829ecf0 con 0x5592382a2cd0 2023-03-02T10:57:23.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a5b9c700 1 --2- 172.21.15.57:0/80247621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 0x5592382ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:23.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a539b700 1 --2- 172.21.15.57:0/80247621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a23c0 0x5592382a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:23.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.350+0000 7f70a4b9a700 1 --2- 172.21.15.57:0/80247621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6810 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7090009960 tx=0x7f7090005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add5926c09ac56b8 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.351+0000 7f708bfff700 1 -- 172.21.15.57:0/80247621 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090017040 con 0x5592382a2cd0 2023-03-02T10:57:23.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.351+0000 7f708bfff700 1 -- 172.21.15.57:0/80247621 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f709000fb10 con 0x5592382a2cd0 2023-03-02T10:57:23.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.351+0000 7f708bfff700 1 -- 172.21.15.57:0/80247621 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090005290 con 0x5592382a2cd0 2023-03-02T10:57:23.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.351+0000 7f70bb017b80 1 -- 172.21.15.57:0/80247621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 msgr2=0x5592382a6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.351+0000 7f70bb017b80 1 --2- 172.21.15.57:0/80247621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6810 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7090009960 tx=0x7f7090005a40 comp rx=0 tx=0).stop 2023-03-02T10:57:23.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.351+0000 7f70bb017b80 1 -- 172.21.15.57:0/80247621 shutdown_connections 2023-03-02T10:57:23.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.351+0000 7f70bb017b80 1 --2- 172.21.15.57:0/80247621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 0x5592382ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.351+0000 7f70bb017b80 1 --2- 172.21.15.57:0/80247621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a23c0 0x5592382a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.351+0000 7f70bb017b80 1 --2- 172.21.15.57:0/80247621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592382a6810 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.351+0000 7f70bb017b80 1 -- 172.21.15.57:0/80247621 >> 172.21.15.57:0/80247621 conn(0x559238297c50 msgr2=0x55923829c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.352+0000 7f70bb017b80 1 -- 172.21.15.57:0/80247621 shutdown_connections 2023-03-02T10:57:23.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.352+0000 7f70bb017b80 1 -- 172.21.15.57:0/80247621 wait complete. 2023-03-02T10:57:23.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.352+0000 7f70bb017b80 1 -- start start 2023-03-02T10:57:23.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.352+0000 7f70bb017b80 1 Processor -- start 2023-03-02T10:57:23.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.352+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a23c0 0x559238307370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.352+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592383078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.352+0000 7f70bb017b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 0x559238301b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.352+0000 7f70bb017b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559238302180 con 0x5592382a2cd0 2023-03-02T10:57:23.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.352+0000 7f70bb017b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592383022f0 con 0x5592382a7110 2023-03-02T10:57:23.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.352+0000 7f70bb017b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592383024b0 con 0x5592382a23c0 2023-03-02T10:57:23.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.352+0000 7f70bb017b80 10 client.0 _ll_register_callbacks cb 0x55923819a520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:23.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a4b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592383078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a4b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592383078b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60822/0 (socket says 172.21.15.57:60822) 2023-03-02T10:57:23.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a4b9a700 1 -- 172.21.15.57:0/2024251167 learned_addr learned my addr 172.21.15.57:0/2024251167 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:23.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a5b9c700 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 0x559238301b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a539b700 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a23c0 0x559238307370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a4b9a700 1 -- 172.21.15.57:0/2024251167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a23c0 msgr2=0x559238307370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a4b9a700 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a23c0 0x559238307370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a4b9a700 1 -- 172.21.15.57:0/2024251167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 msgr2=0x559238301b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:23.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a4b9a700 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 0x559238301b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a4b9a700 1 -- 172.21.15.57:0/2024251167 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559238022de0 con 0x5592382a2cd0 2023-03-02T10:57:23.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a5b9c700 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 0x559238301b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:23.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70a4b9a700 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592383078b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7090009770 tx=0x7f709000fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423dcea8c69f40c0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:23.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f7088ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:23.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f7088ff9700 1 -- 172.21.15.57:0/2024251167 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090017040 con 0x5592382a2cd0 2023-03-02T10:57:23.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f70bb017b80 1 -- 172.21.15.57:0/2024251167 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f709c021070 con 0x5592382a2cd0 2023-03-02T10:57:23.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.353+0000 7f7088ff9700 1 -- 172.21.15.57:0/2024251167 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7090004ac0 con 0x5592382a2cd0 2023-03-02T10:57:23.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f7088ff9700 1 -- 172.21.15.57:0/2024251167 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f709001c470 con 0x5592382a2cd0 2023-03-02T10:57:23.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f70bb017b80 10 client.15660 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:23.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f70bb017b80 1 -- 172.21.15.57:0/2024251167 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55923800bc60 con 0x5592382a2cd0 2023-03-02T10:57:23.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f7088ff9700 1 -- 172.21.15.57:0/2024251167 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f709c021070 con 0x5592382a2cd0 2023-03-02T10:57:23.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f7088ff9700 1 -- 172.21.15.57:0/2024251167 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7090010730 con 0x5592382a2cd0 2023-03-02T10:57:23.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f70bb017b80 10 client.15660 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:23.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f70bb017b80 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:23.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f70bb017b80 20 client.15660 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:23.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f70bb017b80 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55923830ee60 0x559238311240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:23.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f70bb017b80 4 client.15660 mds_command: new command op to 24560 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:57:23.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f70bb017b80 1 -- 172.21.15.57:0/2024251167 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5592381ece90 con 0x55923830ee60 2023-03-02T10:57:23.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.354+0000 7f70a539b700 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55923830ee60 0x559238311240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:23.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70a539b700 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55923830ee60 0x559238311240 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27c2d867330feedb server_cookie=d7ecae0e077ee805 in_seq=0 out_seq=0 2023-03-02T10:57:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f7088ff9700 10 client.15660 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f7088ff9700 1 -- 172.21.15.57:0/2024251167 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5592381ece90 con 0x55923830ee60 2023-03-02T10:57:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f7088ff9700 10 client.15660 handle_command_reply: tid=0 2023-03-02T10:57:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 1 client.15660 shutdown 2023-03-02T10:57:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 1 -- 172.21.15.57:0/2024251167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 msgr2=0x5592383078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592383078b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7090009770 tx=0x7f709000fcf0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 1 -- 172.21.15.57:0/2024251167 shutdown_connections 2023-03-02T10:57:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55923830ee60 0x559238311240 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5592382a7110 0x559238301b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592382a23c0 0x559238307370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f7088ff9700 0 client.15660 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 1 --2- 172.21.15.57:0/2024251167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592382a2cd0 0x5592383078b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 1 -- 172.21.15.57:0/2024251167 >> 172.21.15.57:0/2024251167 conn(0x559238297c50 msgr2=0x5592382a62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 1 -- 172.21.15.57:0/2024251167 shutdown_connections 2023-03-02T10:57:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 1 -- 172.21.15.57:0/2024251167 wait complete. 2023-03-02T10:57:23.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.355+0000 7f70bb017b80 20 client.15660 trim_cache size 0 max 16384 2023-03-02T10:57:23.369 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:57:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 -- 172.21.15.57:0/1311381328 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f708c09b4c0 msgr2=0x7f708c09d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f708c09b4c0 0x7f708c09d970 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f70a00ffaf0 tx=0x7f709c009260 comp rx=0 tx=0).stop 2023-03-02T10:57:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 -- 172.21.15.57:0/1311381328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70a01049c0 msgr2=0x7f70a019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70a01049c0 0x7f70a019a720 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7098009fd0 tx=0x7f709800bce0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 -- 172.21.15.57:0/1311381328 shutdown_connections 2023-03-02T10:57:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f708c09b4c0 0x7f708c09d970 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70a01049c0 0x7f70a019a720 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a00fe9b0 0x7f70a0195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 --2- 172.21.15.57:0/1311381328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70a00ff360 0x7f70a01962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:23.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 -- 172.21.15.57:0/1311381328 >> 172.21.15.57:0/1311381328 conn(0x7f70a00fa4b0 msgr2=0x7f70a0067700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:23.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 -- 172.21.15.57:0/1311381328 shutdown_connections 2023-03-02T10:57:23.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:23.356+0000 7f70a75ff700 1 -- 172.21.15.57:0/1311381328 wait complete. 2023-03-02T10:57:23.410 INFO:teuthology.orchestra.run.smithi057.stderr:4900000 of 50000000 tuples (9%) done (elapsed 8.21 s, remaining 75.61 s) 2023-03-02T10:57:23.611 INFO:teuthology.orchestra.run.smithi057.stderr:5000000 of 50000000 tuples (10%) done (elapsed 8.42 s, remaining 75.74 s) 2023-03-02T10:57:23.724 INFO:teuthology.orchestra.run.smithi057.stderr:5100000 of 50000000 tuples (10%) done (elapsed 8.53 s, remaining 75.09 s) 2023-03-02T10:57:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:23 smithi057 ceph-mon[92072]: pgmap v14: 97 pgs: 97 active+clean; 427 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 68 MiB/s wr, 337 op/s 2023-03-02T10:57:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:23 smithi122 ceph-mon[125440]: pgmap v14: 97 pgs: 97 active+clean; 427 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 68 MiB/s wr, 337 op/s 2023-03-02T10:57:23.964 INFO:teuthology.orchestra.run.smithi057.stderr:5200000 of 50000000 tuples (10%) done (elapsed 8.77 s, remaining 75.54 s) 2023-03-02T10:57:24.040 INFO:teuthology.orchestra.run.smithi057.stderr:5300000 of 50000000 tuples (10%) done (elapsed 8.85 s, remaining 74.60 s) 2023-03-02T10:57:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:23 smithi136 ceph-mon[125702]: pgmap v14: 97 pgs: 97 active+clean; 427 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 68 MiB/s wr, 337 op/s 2023-03-02T10:57:24.250 INFO:teuthology.orchestra.run.smithi057.stderr:5400000 of 50000000 tuples (10%) done (elapsed 9.05 s, remaining 74.78 s) 2023-03-02T10:57:24.373 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-03-02T10:57:24.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-03-02T10:57:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:5500000 of 50000000 tuples (11%) done (elapsed 9.25 s, remaining 74.80 s) 2023-03-02T10:57:24.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.539+0000 7fa5111ff700 1 -- 172.21.15.57:0/1450309064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa50c10a020 msgr2=0x7fa50c10c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.539+0000 7fa5111ff700 1 --2- 172.21.15.57:0/1450309064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa50c10a020 0x7fa50c10c490 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b0a0 tx=0x7fa50400b3b0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.539+0000 7fa5111ff700 1 -- 172.21.15.57:0/1450309064 shutdown_connections 2023-03-02T10:57:24.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.539+0000 7fa5111ff700 1 --2- 172.21.15.57:0/1450309064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa50c10a020 0x7fa50c10c490 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.539+0000 7fa5111ff700 1 --2- 172.21.15.57:0/1450309064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa50c100ce0 0x7fa50c1010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.539+0000 7fa5111ff700 1 --2- 172.21.15.57:0/1450309064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa50c1015f0 0x7fa50c109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.539+0000 7fa5111ff700 1 -- 172.21.15.57:0/1450309064 >> 172.21.15.57:0/1450309064 conn(0x7fa50c0fa4b0 msgr2=0x7fa50c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.539+0000 7fa5111ff700 1 -- 172.21.15.57:0/1450309064 shutdown_connections 2023-03-02T10:57:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.539+0000 7fa5111ff700 1 -- 172.21.15.57:0/1450309064 wait complete. 2023-03-02T10:57:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.540+0000 7fa5111ff700 1 Processor -- start 2023-03-02T10:57:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.540+0000 7fa5111ff700 1 -- start start 2023-03-02T10:57:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa5111ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa50c100ce0 0x7fa50c0fe930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa5111ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa50c1015f0 0x7fa50c0fee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa5111ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa50c10a020 0x7fa50c1a3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa5111ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0ff6a0 con 0x7fa50c10a020 2023-03-02T10:57:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa5111ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c1a43d0 con 0x7fa50c100ce0 2023-03-02T10:57:24.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa5111ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c1a4510 con 0x7fa50c1015f0 2023-03-02T10:57:24.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa50b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa50c10a020 0x7fa50c1a3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa50b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa50c10a020 0x7fa50c1a3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60830/0 (socket says 172.21.15.57:60830) 2023-03-02T10:57:24.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa50b59e700 1 -- 172.21.15.57:0/64518676 learned_addr learned my addr 172.21.15.57:0/64518676 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:24.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa50a59c700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa50c1015f0 0x7fa50c0fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa50ad9d700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa50c100ce0 0x7fa50c0fe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa50b59e700 1 -- 172.21.15.57:0/64518676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa50c1015f0 msgr2=0x7fa50c0fee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa50b59e700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa50c1015f0 0x7fa50c0fee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa50b59e700 1 -- 172.21.15.57:0/64518676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa50c100ce0 msgr2=0x7fa50c0fe930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa50b59e700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa50c100ce0 0x7fa50c0fe930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.541+0000 7fa50b59e700 1 -- 172.21.15.57:0/64518676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504009d00 con 0x7fa50c10a020 2023-03-02T10:57:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.542+0000 7fa50b59e700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa50c10a020 0x7fa50c1a3e90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b780 tx=0x7fa504007990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.542+0000 7fa4f3fff700 1 -- 172.21.15.57:0/64518676 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400e040 con 0x7fa50c10a020 2023-03-02T10:57:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.542+0000 7fa5111ff700 1 -- 172.21.15.57:0/64518676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c10fad0 con 0x7fa50c10a020 2023-03-02T10:57:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.542+0000 7fa4f3fff700 1 -- 172.21.15.57:0/64518676 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa50401d470 con 0x7fa50c10a020 2023-03-02T10:57:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.542+0000 7fa4f3fff700 1 -- 172.21.15.57:0/64518676 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5040052a0 con 0x7fa50c10a020 2023-03-02T10:57:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.542+0000 7fa5111ff700 1 -- 172.21.15.57:0/64518676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c10f940 con 0x7fa50c10a020 2023-03-02T10:57:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.546+0000 7fa524be8b80 1 Processor -- start 2023-03-02T10:57:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.546+0000 7fa4f3fff700 1 -- 172.21.15.57:0/64518676 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7fa50401d8c0 con 0x7fa50c10a020 2023-03-02T10:57:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.546+0000 7fa524be8b80 1 -- start start 2023-03-02T10:57:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2fdd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b2fe1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fe25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa524be8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2f44ae0 con 0x5611b2fe2190 2023-03-02T10:57:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa524be8b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2ef7000 con 0x5611b2fddd50 2023-03-02T10:57:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa524be8b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2ec71e0 con 0x5611b2fdd440 2023-03-02T10:57:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50ad9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b2fe1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50ad9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b2fe1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59622/0 (socket says 172.21.15.57:59622) 2023-03-02T10:57:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fe25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50ad9d700 1 -- 172.21.15.57:0/3264982355 learned_addr learned my addr 172.21.15.57:0/3264982355 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50a59c700 1 --2- 172.21.15.57:0/3264982355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2fdd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50ad9d700 1 -- 172.21.15.57:0/3264982355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 msgr2=0x5611b2fdd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50ad9d700 1 --2- 172.21.15.57:0/3264982355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2fdd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50ad9d700 1 -- 172.21.15.57:0/3264982355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 msgr2=0x5611b2fe25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50ad9d700 1 --2- 172.21.15.57:0/3264982355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fe25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50ad9d700 1 -- 172.21.15.57:0/3264982355 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611b2db16b0 con 0x5611b2fddd50 2023-03-02T10:57:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50a59c700 1 --2- 172.21.15.57:0/3264982355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2fdd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.547+0000 7fa50ad9d700 1 --2- 172.21.15.57:0/3264982355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b2fe1c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009d80 tx=0x7fa4fc011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9fd0fdf22486f04 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.548+0000 7fa4f3fff700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fa4f409b4c0 0x7fa4f409d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.548+0000 7fa4f17fa700 1 -- 172.21.15.57:0/3264982355 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc004230 con 0x5611b2fddd50 2023-03-02T10:57:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.548+0000 7fa4f17fa700 1 -- 172.21.15.57:0/3264982355 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4fc004390 con 0x5611b2fddd50 2023-03-02T10:57:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.548+0000 7fa4f17fa700 1 -- 172.21.15.57:0/3264982355 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc019820 con 0x5611b2fddd50 2023-03-02T10:57:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.548+0000 7fa4f3fff700 1 -- 172.21.15.57:0/64518676 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa5040c66c0 con 0x7fa50c10a020 2023-03-02T10:57:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.548+0000 7fa50a59c700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fa4f409b4c0 0x7fa4f409d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.548+0000 7fa524be8b80 1 -- 172.21.15.57:0/3264982355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 msgr2=0x5611b2fe1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.548+0000 7fa50a59c700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fa4f409b4c0 0x7fa4f409d970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa5000097c0 tx=0x7fa500009750 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.548+0000 7fa524be8b80 1 --2- 172.21.15.57:0/3264982355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b2fe1c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009d80 tx=0x7fa4fc011720 comp rx=0 tx=0).stop 2023-03-02T10:57:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 -- 172.21.15.57:0/3264982355 shutdown_connections 2023-03-02T10:57:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 --2- 172.21.15.57:0/3264982355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fe25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 --2- 172.21.15.57:0/3264982355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2fdd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 --2- 172.21.15.57:0/3264982355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b2fe1c50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 -- 172.21.15.57:0/3264982355 >> 172.21.15.57:0/3264982355 conn(0x5611b2fd2cd0 msgr2=0x5611b2fd84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 -- 172.21.15.57:0/3264982355 shutdown_connections 2023-03-02T10:57:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 -- 172.21.15.57:0/3264982355 wait complete. 2023-03-02T10:57:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 -- start start 2023-03-02T10:57:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 Processor -- start 2023-03-02T10:57:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2fe98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b2fe6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.549+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fe7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa524be8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2f35c40 con 0x5611b2fe2190 2023-03-02T10:57:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa524be8b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2f2f170 con 0x5611b2fddd50 2023-03-02T10:57:24.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa524be8b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2db39a0 con 0x5611b2fdd440 2023-03-02T10:57:24.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa524be8b80 10 client.0 _ll_register_callbacks cb 0x5611b2ed55a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:24.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b2fe6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b2fe6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59630/0 (socket says 172.21.15.57:59630) 2023-03-02T10:57:24.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa50a59c700 1 -- 172.21.15.57:0/1033626424 learned_addr learned my addr 172.21.15.57:0/1033626424 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:24.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa50b59e700 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fe7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa50ad9d700 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2fe98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa50b59e700 1 -- 172.21.15.57:0/1033626424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 msgr2=0x5611b2fe98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa50b59e700 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2fe98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa50b59e700 1 -- 172.21.15.57:0/1033626424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 msgr2=0x5611b2fe6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa50b59e700 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b2fe6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa50b59e700 1 -- 172.21.15.57:0/1033626424 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc0099e0 con 0x5611b2fe2190 2023-03-02T10:57:24.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa50b59e700 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fe7150 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b9c0 tx=0x7fa504009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d811cac78fedede server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.550+0000 7fa4eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:24.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa4eeff5700 1 -- 172.21.15.57:0/1033626424 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa504096270 con 0x5611b2fe2190 2023-03-02T10:57:24.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa524be8b80 1 -- 172.21.15.57:0/1033626424 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611b2f00830 con 0x5611b2fe2190 2023-03-02T10:57:24.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa4eeff5700 1 -- 172.21.15.57:0/1033626424 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa504095b70 con 0x5611b2fe2190 2023-03-02T10:57:24.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa4eeff5700 1 -- 172.21.15.57:0/1033626424 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa50409d200 con 0x5611b2fe2190 2023-03-02T10:57:24.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa524be8b80 10 client.15672 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:24.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa524be8b80 1 -- 172.21.15.57:0/1033626424 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5611b2d5de60 con 0x5611b2fe2190 2023-03-02T10:57:24.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa4eeff5700 1 -- 172.21.15.57:0/1033626424 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5040c2080 con 0x5611b2fe2190 2023-03-02T10:57:24.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa4eeff5700 1 -- 172.21.15.57:0/1033626424 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa50409ce90 con 0x5611b2fe2190 2023-03-02T10:57:24.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa524be8b80 10 client.15672 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:24.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa524be8b80 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:24.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa524be8b80 20 client.15672 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:24.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa524be8b80 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5611b2ff70c0 0x5611b2ff94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa524be8b80 4 client.15672 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:24.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.551+0000 7fa524be8b80 1 -- 172.21.15.57:0/1033626424 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611b2f281f0 con 0x5611b2ff70c0 2023-03-02T10:57:24.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.552+0000 7fa50ad9d700 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5611b2ff70c0 0x5611b2ff94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.552+0000 7fa50ad9d700 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5611b2ff70c0 0x5611b2ff94d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5c62d34546e6adb server_cookie=274c954a0c88b100 in_seq=0 out_seq=0 2023-03-02T10:57:24.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.552+0000 7fa4eeff5700 10 client.15672 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:24.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa4eeff5700 1 -- 172.21.15.57:0/1033626424 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5611b2f281f0 con 0x5611b2ff70c0 2023-03-02T10:57:24.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa4eeff5700 10 client.15672 handle_command_reply: tid=0 2023-03-02T10:57:24.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 1 client.15672 shutdown 2023-03-02T10:57:24.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 1 -- 172.21.15.57:0/1033626424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 msgr2=0x5611b2fe7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fe7150 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b9c0 tx=0x7fa504009c70 comp rx=0 tx=0).stop 2023-03-02T10:57:24.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 1 -- 172.21.15.57:0/1033626424 shutdown_connections 2023-03-02T10:57:24.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5611b2ff70c0 0x5611b2ff94d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fe7150 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2fe98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa4eeff5700 0 client.15672 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:24.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 1 --2- 172.21.15.57:0/1033626424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b2fe6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 1 -- 172.21.15.57:0/1033626424 >> 172.21.15.57:0/1033626424 conn(0x5611b2fd2cd0 msgr2=0x5611b2fd7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 1 -- 172.21.15.57:0/1033626424 shutdown_connections 2023-03-02T10:57:24.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 1 -- 172.21.15.57:0/1033626424 wait complete. 2023-03-02T10:57:24.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.553+0000 7fa524be8b80 20 client.15672 trim_cache size 0 max 16384 2023-03-02T10:57:24.581 INFO:teuthology.orchestra.run.smithi057.stderr:5600000 of 50000000 tuples (11%) done (elapsed 9.37 s, remaining 74.28 s) 2023-03-02T10:57:24.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.570+0000 7fa524be8b80 1 Processor -- start 2023-03-02T10:57:24.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.570+0000 7fa524be8b80 1 -- start start 2023-03-02T10:57:24.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.570+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2ff2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.570+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fddd50 0x5611b2fe4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.570+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fe2190 0x5611b2fdc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.570+0000 7fa524be8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2fd8aa0 con 0x5611b2fddd50 2023-03-02T10:57:24.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.570+0000 7fa524be8b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2fde4d0 con 0x5611b2fe2190 2023-03-02T10:57:24.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.570+0000 7fa524be8b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2fd28d0 con 0x5611b2fdd440 2023-03-02T10:57:24.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fddd50 0x5611b2fe4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50ad9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2ff2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fddd50 0x5611b2fe4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60860/0 (socket says 172.21.15.57:60860) 2023-03-02T10:57:24.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50a59c700 1 -- 172.21.15.57:0/3917356953 learned_addr learned my addr 172.21.15.57:0/3917356953 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:24.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50b59e700 1 --2- 172.21.15.57:0/3917356953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fe2190 0x5611b2fdc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50a59c700 1 -- 172.21.15.57:0/3917356953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 msgr2=0x5611b2ff2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50a59c700 1 --2- 172.21.15.57:0/3917356953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2ff2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50a59c700 1 -- 172.21.15.57:0/3917356953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fe2190 msgr2=0x5611b2fdc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50a59c700 1 --2- 172.21.15.57:0/3917356953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fe2190 0x5611b2fdc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50a59c700 1 -- 172.21.15.57:0/3917356953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611b2ef6210 con 0x5611b2fddd50 2023-03-02T10:57:24.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50b59e700 1 --2- 172.21.15.57:0/3917356953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fe2190 0x5611b2fdc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:24.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa50a59c700 1 --2- 172.21.15.57:0/3917356953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fddd50 0x5611b2fe4700 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa5000041f0 tx=0x7fa500004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f5c15252fa2f25 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.571+0000 7fa4f1ffb700 1 -- 172.21.15.57:0/3917356953 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500003b10 con 0x5611b2fddd50 2023-03-02T10:57:24.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.572+0000 7fa4f1ffb700 1 -- 172.21.15.57:0/3917356953 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa500012e90 con 0x5611b2fddd50 2023-03-02T10:57:24.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.572+0000 7fa4f1ffb700 1 -- 172.21.15.57:0/3917356953 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500011df0 con 0x5611b2fddd50 2023-03-02T10:57:24.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.572+0000 7fa524be8b80 1 -- 172.21.15.57:0/3917356953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fddd50 msgr2=0x5611b2fe4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.572+0000 7fa524be8b80 1 --2- 172.21.15.57:0/3917356953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fddd50 0x5611b2fe4700 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa5000041f0 tx=0x7fa500004750 comp rx=0 tx=0).stop 2023-03-02T10:57:24.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.572+0000 7fa524be8b80 1 -- 172.21.15.57:0/3917356953 shutdown_connections 2023-03-02T10:57:24.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.572+0000 7fa524be8b80 1 --2- 172.21.15.57:0/3917356953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fe2190 0x5611b2fdc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.572+0000 7fa524be8b80 1 --2- 172.21.15.57:0/3917356953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b2ff2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.572+0000 7fa524be8b80 1 --2- 172.21.15.57:0/3917356953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fddd50 0x5611b2fe4700 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.572+0000 7fa524be8b80 1 -- 172.21.15.57:0/3917356953 >> 172.21.15.57:0/3917356953 conn(0x5611b2fd2cd0 msgr2=0x5611b2fdc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.572+0000 7fa524be8b80 1 -- 172.21.15.57:0/3917356953 shutdown_connections 2023-03-02T10:57:24.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.572+0000 7fa524be8b80 1 -- 172.21.15.57:0/3917356953 wait complete. 2023-03-02T10:57:24.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.573+0000 7fa524be8b80 1 -- start start 2023-03-02T10:57:24.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.573+0000 7fa524be8b80 1 Processor -- start 2023-03-02T10:57:24.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.573+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b3043230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.573+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b3043770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.573+0000 7fa524be8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fed480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.573+0000 7fa524be8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2feda60 con 0x5611b2fe2190 2023-03-02T10:57:24.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.573+0000 7fa524be8b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2fedbd0 con 0x5611b2fddd50 2023-03-02T10:57:24.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.573+0000 7fa524be8b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b2fedd90 con 0x5611b2fdd440 2023-03-02T10:57:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.573+0000 7fa524be8b80 10 client.0 _ll_register_callbacks cb 0x5611b2ed55a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa50b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b3043770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa50a59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b3043770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59654/0 (socket says 172.21.15.57:59654) 2023-03-02T10:57:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa50a59c700 1 -- 172.21.15.57:0/768160632 learned_addr learned my addr 172.21.15.57:0/768160632 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa50ad9d700 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b3043230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa50a59c700 1 -- 172.21.15.57:0/768160632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 msgr2=0x5611b3043230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa50a59c700 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b3043230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa50a59c700 1 -- 172.21.15.57:0/768160632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 msgr2=0x5611b2fed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa50a59c700 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa50a59c700 1 -- 172.21.15.57:0/768160632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611b2d5de60 con 0x5611b2fddd50 2023-03-02T10:57:24.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa50a59c700 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b3043770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa500009d20 tx=0x7fa500003d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c525474790438be1 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.574+0000 7fa4eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:24.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa4eeff5700 1 -- 172.21.15.57:0/768160632 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500011de0 con 0x5611b2fddd50 2023-03-02T10:57:24.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa524be8b80 1 -- 172.21.15.57:0/768160632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4fc004390 con 0x5611b2fddd50 2023-03-02T10:57:24.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa4eeff5700 1 -- 172.21.15.57:0/768160632 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa500005020 con 0x5611b2fddd50 2023-03-02T10:57:24.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa4eeff5700 1 -- 172.21.15.57:0/768160632 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa500005200 con 0x5611b2fddd50 2023-03-02T10:57:24.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa524be8b80 10 client.25544 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:24.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa524be8b80 1 -- 172.21.15.57:0/768160632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fa50001c070 con 0x5611b2fddd50 2023-03-02T10:57:24.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa4eeff5700 1 -- 172.21.15.57:0/768160632 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4fc004390 con 0x5611b2fddd50 2023-03-02T10:57:24.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa4eeff5700 1 -- 172.21.15.57:0/768160632 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa5000233f0 con 0x5611b2fddd50 2023-03-02T10:57:24.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa524be8b80 10 client.25544 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:24.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa524be8b80 10 client.25544 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:24.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa524be8b80 20 client.25544 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:24.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa524be8b80 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5611b304b110 0x5611b304d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa524be8b80 4 client.25544 mds_command: new command op to 24560 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-03-02T10:57:24.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.575+0000 7fa524be8b80 1 -- 172.21.15.57:0/768160632 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5611b2f27f10 con 0x5611b304b110 2023-03-02T10:57:24.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.576+0000 7fa50ad9d700 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5611b304b110 0x5611b304d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.576+0000 7fa4eeff5700 10 client.25544 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:24.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.576+0000 7fa50ad9d700 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5611b304b110 0x5611b304d520 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d36177287a299485 server_cookie=ba87c514e51b8398 in_seq=0 out_seq=0 2023-03-02T10:57:24.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa4eeff5700 1 -- 172.21.15.57:0/768160632 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5611b2f27f10 con 0x5611b304b110 2023-03-02T10:57:24.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa4eeff5700 10 client.25544 handle_command_reply: tid=0 2023-03-02T10:57:24.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa524be8b80 1 client.25544 shutdown 2023-03-02T10:57:24.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa524be8b80 1 -- 172.21.15.57:0/768160632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 msgr2=0x5611b3043770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa524be8b80 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b3043770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa500009d20 tx=0x7fa500003d40 comp rx=0 tx=0).stop 2023-03-02T10:57:24.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa524be8b80 1 -- 172.21.15.57:0/768160632 shutdown_connections 2023-03-02T10:57:24.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa524be8b80 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5611b304b110 0x5611b304d520 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa524be8b80 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5611b2fe2190 0x5611b2fed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa524be8b80 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5611b2fdd440 0x5611b3043230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa524be8b80 1 --2- 172.21.15.57:0/768160632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611b2fddd50 0x5611b3043770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa524be8b80 1 -- 172.21.15.57:0/768160632 >> 172.21.15.57:0/768160632 conn(0x5611b2fd2cd0 msgr2=0x5611b2fd7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.577+0000 7fa4eeff5700 0 client.25544 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:24.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.578+0000 7fa524be8b80 1 -- 172.21.15.57:0/768160632 shutdown_connections 2023-03-02T10:57:24.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.578+0000 7fa524be8b80 1 -- 172.21.15.57:0/768160632 wait complete. 2023-03-02T10:57:24.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.578+0000 7fa524be8b80 20 client.25544 trim_cache size 0 max 16384 2023-03-02T10:57:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:57:24.601 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": 0, 2023-03-02T10:57:24.601 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_tag": "03f70e35-b590-4c32-b447-5c2fabc0f3b9", 2023-03-02T10:57:24.601 INFO:teuthology.orchestra.run.smithi057.stdout: "mode": "asynchronous" 2023-03-02T10:57:24.601 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:57:24.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 -- 172.21.15.57:0/64518676 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fa4f409b4c0 msgr2=0x7fa4f409d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fa4f409b4c0 0x7fa4f409d970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa5000097c0 tx=0x7fa500009750 comp rx=0 tx=0).stop 2023-03-02T10:57:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 -- 172.21.15.57:0/64518676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa50c10a020 msgr2=0x7fa50c1a3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa50c10a020 0x7fa50c1a3e90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b780 tx=0x7fa504007990 comp rx=0 tx=0).stop 2023-03-02T10:57:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 -- 172.21.15.57:0/64518676 shutdown_connections 2023-03-02T10:57:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fa4f409b4c0 0x7fa4f409d970 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa50c10a020 0x7fa50c1a3e90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa50c100ce0 0x7fa50c0fe930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 --2- 172.21.15.57:0/64518676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa50c1015f0 0x7fa50c0fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 -- 172.21.15.57:0/64518676 >> 172.21.15.57:0/64518676 conn(0x7fa50c0fa4b0 msgr2=0x7fa50c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 -- 172.21.15.57:0/64518676 shutdown_connections 2023-03-02T10:57:24.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.579+0000 7fa5111ff700 1 -- 172.21.15.57:0/64518676 wait complete. 2023-03-02T10:57:24.604 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T10:57:24.792 INFO:teuthology.orchestra.run.smithi057.stderr:5700000 of 50000000 tuples (11%) done (elapsed 9.60 s, remaining 74.59 s) 2023-03-02T10:57:24.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.797+0000 7f5bc2bff700 1 -- 172.21.15.57:0/337764304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bbc100ce0 msgr2=0x7f5bbc1010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.797+0000 7f5bc2bff700 1 --2- 172.21.15.57:0/337764304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bbc100ce0 0x7f5bbc1010b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009990 tx=0x7f5bb0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.797+0000 7f5bc2bff700 1 -- 172.21.15.57:0/337764304 shutdown_connections 2023-03-02T10:57:24.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.797+0000 7f5bc2bff700 1 --2- 172.21.15.57:0/337764304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bbc10a020 0x7f5bbc10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.797+0000 7f5bc2bff700 1 --2- 172.21.15.57:0/337764304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bbc100ce0 0x7f5bbc1010b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.797+0000 7f5bc2bff700 1 --2- 172.21.15.57:0/337764304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc1015f0 0x7f5bbc109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.797+0000 7f5bc2bff700 1 -- 172.21.15.57:0/337764304 >> 172.21.15.57:0/337764304 conn(0x7f5bbc0fa4b0 msgr2=0x7f5bbc0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.797+0000 7f5bc2bff700 1 -- 172.21.15.57:0/337764304 shutdown_connections 2023-03-02T10:57:24.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.797+0000 7f5bc2bff700 1 -- 172.21.15.57:0/337764304 wait complete. 2023-03-02T10:57:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc2bff700 1 Processor -- start 2023-03-02T10:57:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc2bff700 1 -- start start 2023-03-02T10:57:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc2bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc100ce0 0x7f5bbc19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc2bff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bbc1015f0 0x7f5bbc19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc2bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bbc10a020 0x7f5bbc195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc2bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc196090 con 0x7f5bbc100ce0 2023-03-02T10:57:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc2bff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc196200 con 0x7f5bbc1015f0 2023-03-02T10:57:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc2bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1963c0 con 0x7f5bbc10a020 2023-03-02T10:57:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc099b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc100ce0 0x7f5bbc19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc099b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc100ce0 0x7f5bbc19b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60888/0 (socket says 172.21.15.57:60888) 2023-03-02T10:57:24.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc099b700 1 -- 172.21.15.57:0/2993610245 learned_addr learned my addr 172.21.15.57:0/2993610245 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:24.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bc119c700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bbc10a020 0x7f5bbc195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.798+0000 7f5bbbfff700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bbc1015f0 0x7f5bbc19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.799+0000 7f5bc099b700 1 -- 172.21.15.57:0/2993610245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bbc10a020 msgr2=0x7f5bbc195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.799+0000 7f5bc099b700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bbc10a020 0x7f5bbc195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.799+0000 7f5bc099b700 1 -- 172.21.15.57:0/2993610245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bbc1015f0 msgr2=0x7f5bbc19bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.799+0000 7f5bc099b700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bbc1015f0 0x7f5bbc19bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.799+0000 7f5bc099b700 1 -- 172.21.15.57:0/2993610245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb00095f0 con 0x7f5bbc100ce0 2023-03-02T10:57:24.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.799+0000 7f5bc099b700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc100ce0 0x7f5bbc19b9b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0000c00 tx=0x7f5bb000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.799+0000 7f5bb9ffb700 1 -- 172.21.15.57:0/2993610245 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb001d070 con 0x7f5bbc100ce0 2023-03-02T10:57:24.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.799+0000 7f5bc2bff700 1 -- 172.21.15.57:0/2993610245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc10fac0 con 0x7f5bbc100ce0 2023-03-02T10:57:24.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.799+0000 7f5bb9ffb700 1 -- 172.21.15.57:0/2993610245 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bb000be40 con 0x7f5bbc100ce0 2023-03-02T10:57:24.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.799+0000 7f5bb9ffb700 1 -- 172.21.15.57:0/2993610245 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb00173f0 con 0x7f5bbc100ce0 2023-03-02T10:57:24.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.799+0000 7f5bc2bff700 1 -- 172.21.15.57:0/2993610245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc10f930 con 0x7f5bbc100ce0 2023-03-02T10:57:24.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.802+0000 7f5bb9ffb700 1 -- 172.21.15.57:0/2993610245 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f5bb0029030 con 0x7f5bbc100ce0 2023-03-02T10:57:24.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.803+0000 7f5bb9ffb700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bac09b4c0 0x7f5bac09d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.803+0000 7f5bb9ffb700 1 -- 172.21.15.57:0/2993610245 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5bb00c63d0 con 0x7f5bbc100ce0 2023-03-02T10:57:24.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.803+0000 7f5bbbfff700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bac09b4c0 0x7f5bac09d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.803+0000 7f5bd64f5b80 1 Processor -- start 2023-03-02T10:57:24.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bd64f5b80 1 -- start start 2023-03-02T10:57:24.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bbbfff700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bac09b4c0 0x7f5bac09d970 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc10b390 tx=0x7f5ba8009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531d9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d9cd0 0x562e531ddbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531de110 0x562e531de560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e53140a60 con 0x562e531de110 2023-03-02T10:57:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e530f2f80 con 0x562e531d93c0 2023-03-02T10:57:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e530c3160 con 0x562e531d9cd0 2023-03-02T10:57:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bc099b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531d9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bc119c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531de110 0x562e531de560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bc099b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531d9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59686/0 (socket says 172.21.15.57:59686) 2023-03-02T10:57:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bc099b700 1 -- 172.21.15.57:0/3727603040 learned_addr learned my addr 172.21.15.57:0/3727603040 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.804+0000 7f5bbbfff700 1 --2- 172.21.15.57:0/3727603040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d9cd0 0x562e531ddbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.805+0000 7f5bc119c700 1 -- 172.21.15.57:0/3727603040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d9cd0 msgr2=0x562e531ddbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.805+0000 7f5bc119c700 1 --2- 172.21.15.57:0/3727603040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d9cd0 0x562e531ddbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.805+0000 7f5bc119c700 1 -- 172.21.15.57:0/3727603040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 msgr2=0x562e531d9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.805+0000 7f5bc119c700 1 --2- 172.21.15.57:0/3727603040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531d9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.805+0000 7f5bc119c700 1 -- 172.21.15.57:0/3727603040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e52fad630 con 0x562e531de110 2023-03-02T10:57:24.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.805+0000 7f5bc099b700 1 --2- 172.21.15.57:0/3727603040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531d9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:24.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.805+0000 7f5bc119c700 1 --2- 172.21.15.57:0/3727603040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531de110 0x562e531de560 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc19c6b0 tx=0x7f5bb4009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e39a4b57c0a962 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.805+0000 7f5ba6ffd700 1 -- 172.21.15.57:0/3727603040 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4019070 con 0x562e531de110 2023-03-02T10:57:24.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.805+0000 7f5ba6ffd700 1 -- 172.21.15.57:0/3727603040 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bb400f040 con 0x562e531de110 2023-03-02T10:57:24.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.805+0000 7f5ba6ffd700 1 -- 172.21.15.57:0/3727603040 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40078c0 con 0x562e531de110 2023-03-02T10:57:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.806+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3727603040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531de110 msgr2=0x562e531de560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.806+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/3727603040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531de110 0x562e531de560 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc19c6b0 tx=0x7f5bb4009ba0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.806+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3727603040 shutdown_connections 2023-03-02T10:57:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.806+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/3727603040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531de110 0x562e531de560 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.806+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/3727603040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531d9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.806+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/3727603040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d9cd0 0x562e531ddbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.806+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3727603040 >> 172.21.15.57:0/3727603040 conn(0x562e531cec50 msgr2=0x562e531d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.806+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3727603040 shutdown_connections 2023-03-02T10:57:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.806+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3727603040 wait complete. 2023-03-02T10:57:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.806+0000 7f5bd64f5b80 1 -- start start 2023-03-02T10:57:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bd64f5b80 1 Processor -- start 2023-03-02T10:57:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531e2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531e31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531de110 0x562e531e3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e53131bc0 con 0x562e531d9cd0 2023-03-02T10:57:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5312b0f0 con 0x562e531d93c0 2023-03-02T10:57:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e52faf920 con 0x562e531de110 2023-03-02T10:57:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bd64f5b80 10 client.0 _ll_register_callbacks cb 0x562e530d1520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531e31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531e31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60910/0 (socket says 172.21.15.57:60910) 2023-03-02T10:57:24.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bbbfff700 1 -- 172.21.15.57:0/1691292340 learned_addr learned my addr 172.21.15.57:0/1691292340 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:24.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.807+0000 7f5bc119c700 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531de110 0x562e531e3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5bc099b700 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531e2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5bbbfff700 1 -- 172.21.15.57:0/1691292340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531de110 msgr2=0x562e531e3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5bbbfff700 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531de110 0x562e531e3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5bbbfff700 1 -- 172.21.15.57:0/1691292340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 msgr2=0x562e531e2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5bbbfff700 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531e2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5bbbfff700 1 -- 172.21.15.57:0/1691292340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb4003ae0 con 0x562e531d9cd0 2023-03-02T10:57:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5bbbfff700 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531e31e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8011fa0 tx=0x7f5ba80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7861de28e0faf694 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5b9bfff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5b9bfff700 1 -- 172.21.15.57:0/1691292340 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8022070 con 0x562e531d9cd0 2023-03-02T10:57:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5b9bfff700 1 -- 172.21.15.57:0/1691292340 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5ba8003d40 con 0x562e531d9cd0 2023-03-02T10:57:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/1691292340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e530fc7b0 con 0x562e531d9cd0 2023-03-02T10:57:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.808+0000 7f5b9bfff700 1 -- 172.21.15.57:0/1691292340 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ba8004580 con 0x562e531d9cd0 2023-03-02T10:57:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.809+0000 7f5bd64f5b80 10 client.15690 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.809+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/1691292340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562e52f59de0 con 0x562e531d9cd0 2023-03-02T10:57:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.809+0000 7f5b9bfff700 1 -- 172.21.15.57:0/1691292340 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562e530fc7b0 con 0x562e531d9cd0 2023-03-02T10:57:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.809+0000 7f5b9bfff700 1 -- 172.21.15.57:0/1691292340 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5ba80275e0 con 0x562e531d9cd0 2023-03-02T10:57:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.809+0000 7f5bd64f5b80 10 client.15690 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.809+0000 7f5bd64f5b80 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.809+0000 7f5bd64f5b80 20 client.15690 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.809+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x562e531f76f0 0x562e531f9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.809+0000 7f5bd64f5b80 4 client.15690 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.809+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/1691292340 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e53124170 con 0x562e531f76f0 2023-03-02T10:57:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.809+0000 7f5bc099b700 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x562e531f76f0 0x562e531f9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.810+0000 7f5bc099b700 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x562e531f76f0 0x562e531f9b00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96491e7cdbbf2cd5 server_cookie=27535c02062e4a37 in_seq=0 out_seq=0 2023-03-02T10:57:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.810+0000 7f5b9bfff700 10 client.15690 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.810+0000 7f5b9bfff700 1 -- 172.21.15.57:0/1691292340 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x562e53124170 con 0x562e531f76f0 2023-03-02T10:57:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.810+0000 7f5b9bfff700 10 client.15690 handle_command_reply: tid=0 2023-03-02T10:57:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.810+0000 7f5bd64f5b80 1 client.15690 shutdown 2023-03-02T10:57:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.810+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/1691292340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 msgr2=0x562e531e31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.810+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531e31e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8011fa0 tx=0x7f5ba80047c0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.811+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/1691292340 shutdown_connections 2023-03-02T10:57:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.811+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x562e531f76f0 0x562e531f9b00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.811+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531de110 0x562e531e3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.811+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531e2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.811+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/1691292340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531e31e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.811+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/1691292340 >> 172.21.15.57:0/1691292340 conn(0x562e531cec50 msgr2=0x562e531d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.811+0000 7f5b9bfff700 0 client.15690 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.811+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/1691292340 shutdown_connections 2023-03-02T10:57:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.811+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/1691292340 wait complete. 2023-03-02T10:57:24.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.811+0000 7f5bd64f5b80 20 client.15690 trim_cache size 0 max 16384 2023-03-02T10:57:24.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.828+0000 7f5bd64f5b80 1 Processor -- start 2023-03-02T10:57:24.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.828+0000 7f5bd64f5b80 1 -- start start 2023-03-02T10:57:24.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.828+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d93c0 0x562e531dba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.828+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531dd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.828+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531de110 0x562e531dfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.828+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e531fe740 con 0x562e531d9cd0 2023-03-02T10:57:24.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.828+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e531f9ad0 con 0x562e531de110 2023-03-02T10:57:24.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.828+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e531dde40 con 0x562e531d93c0 2023-03-02T10:57:24.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bc099b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d93c0 0x562e531dba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bc099b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d93c0 0x562e531dba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:44424/0 (socket says 172.21.15.57:44424) 2023-03-02T10:57:24.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bc099b700 1 -- 172.21.15.57:0/4156751957 learned_addr learned my addr 172.21.15.57:0/4156751957 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:24.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bc119c700 1 --2- 172.21.15.57:0/4156751957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531de110 0x562e531dfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bbbfff700 1 --2- 172.21.15.57:0/4156751957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bc099b700 1 -- 172.21.15.57:0/4156751957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531de110 msgr2=0x562e531dfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bc099b700 1 --2- 172.21.15.57:0/4156751957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531de110 0x562e531dfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bc099b700 1 -- 172.21.15.57:0/4156751957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 msgr2=0x562e531dd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bc099b700 1 --2- 172.21.15.57:0/4156751957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531dd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bc099b700 1 -- 172.21.15.57:0/4156751957 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e530f2190 con 0x562e531d93c0 2023-03-02T10:57:24.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bbbfff700 1 --2- 172.21.15.57:0/4156751957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531dd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:24.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.829+0000 7f5bc099b700 1 --2- 172.21.15.57:0/4156751957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d93c0 0x562e531dba00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0091d20 tx=0x7f5bb001a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93044c58b251bd6d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.830+0000 7f5ba77fe700 1 -- 172.21.15.57:0/4156751957 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000fe20 con 0x562e531d93c0 2023-03-02T10:57:24.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.830+0000 7f5ba77fe700 1 -- 172.21.15.57:0/4156751957 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bb0095f20 con 0x562e531d93c0 2023-03-02T10:57:24.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.830+0000 7f5ba77fe700 1 -- 172.21.15.57:0/4156751957 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb00c30c0 con 0x562e531d93c0 2023-03-02T10:57:24.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.830+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/4156751957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d93c0 msgr2=0x562e531dba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.830+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/4156751957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d93c0 0x562e531dba00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0091d20 tx=0x7f5bb001a040 comp rx=0 tx=0).stop 2023-03-02T10:57:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.830+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/4156751957 shutdown_connections 2023-03-02T10:57:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.830+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/4156751957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531de110 0x562e531dfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/4156751957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531d93c0 0x562e531dba00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/4156751957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531dd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/4156751957 >> 172.21.15.57:0/4156751957 conn(0x562e531cec50 msgr2=0x562e531dd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/4156751957 shutdown_connections 2023-03-02T10:57:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/4156751957 wait complete. 2023-03-02T10:57:24.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 -- start start 2023-03-02T10:57:24.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 Processor -- start 2023-03-02T10:57:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531de110 0x562e531e6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e531ee780 con 0x562e531d9cd0 2023-03-02T10:57:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e531ee8f0 con 0x562e531d93c0 2023-03-02T10:57:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.831+0000 7f5bd64f5b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e531e6a70 con 0x562e531de110 2023-03-02T10:57:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bd64f5b80 10 client.0 _ll_register_callbacks cb 0x562e530d1520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bc099b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531e5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60924/0 (socket says 172.21.15.57:60924) 2023-03-02T10:57:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bbbfff700 1 -- 172.21.15.57:0/3751674265 learned_addr learned my addr 172.21.15.57:0/3751674265 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bc119c700 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531de110 0x562e531e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bc099b700 1 -- 172.21.15.57:0/3751674265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531de110 msgr2=0x562e531e6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bc099b700 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531de110 0x562e531e6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bc099b700 1 -- 172.21.15.57:0/3751674265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 msgr2=0x562e531e5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bc099b700 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531e5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bc099b700 1 -- 172.21.15.57:0/3751674265 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc10fac0 con 0x562e531d93c0 2023-03-02T10:57:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5bc099b700 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531e9b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00098e0 tx=0x7f5bb000ff60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ebad00d3a78d6a4 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5b9bfff700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.832+0000 7f5b9bfff700 1 -- 172.21.15.57:0/3751674265 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb009ceb0 con 0x562e531d93c0 2023-03-02T10:57:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5b9bfff700 1 -- 172.21.15.57:0/3751674265 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5bb00c30c0 con 0x562e531d93c0 2023-03-02T10:57:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3751674265 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5bb400f040 con 0x562e531d93c0 2023-03-02T10:57:24.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5b9bfff700 1 -- 172.21.15.57:0/3751674265 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bb00c3280 con 0x562e531d93c0 2023-03-02T10:57:24.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5bd64f5b80 10 client.25562 fetch_fsmap learned FSMap version 26 2023-03-02T10:57:24.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3751674265 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562e52f80250 con 0x562e531d93c0 2023-03-02T10:57:24.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5b9bfff700 1 -- 172.21.15.57:0/3751674265 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bb400f040 con 0x562e531d93c0 2023-03-02T10:57:24.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5b9bfff700 1 -- 172.21.15.57:0/3751674265 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5bb00bf070 con 0x562e531d93c0 2023-03-02T10:57:24.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5bd64f5b80 10 client.25562 fetch_fsmap finished waiting for FSMap version 26 2023-03-02T10:57:24.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5bd64f5b80 10 client.25562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:24.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5bd64f5b80 20 client.25562 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:24.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x562e53245ba0 0x562e53247f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:24.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5bd64f5b80 4 client.25562 mds_command: new command op to 24560 tid=0[{"prefix": "scrub status"}] 2023-03-02T10:57:24.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3751674265 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562e53123e90 con 0x562e53245ba0 2023-03-02T10:57:24.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.833+0000 7f5bbbfff700 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x562e53245ba0 0x562e53247f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:24.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5b9bfff700 10 client.25562 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:24.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bbbfff700 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x562e53245ba0 0x562e53247f80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f50777e7a687ece4 server_cookie=1b56f5d4e6ef6c44 in_seq=0 out_seq=0 2023-03-02T10:57:24.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5b9bfff700 1 -- 172.21.15.57:0/3751674265 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562e53123e90 con 0x562e53245ba0 2023-03-02T10:57:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5b9bfff700 10 client.25562 handle_command_reply: tid=0 2023-03-02T10:57:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bd64f5b80 1 client.25562 shutdown 2023-03-02T10:57:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3751674265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 msgr2=0x562e531e9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531e9b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00098e0 tx=0x7f5bb000ff60 comp rx=0 tx=0).stop 2023-03-02T10:57:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3751674265 shutdown_connections 2023-03-02T10:57:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x562e53245ba0 0x562e53247f80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e531de110 0x562e531e6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562e531d93c0 0x562e531e9b10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5b9bfff700 0 client.25562 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:24.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bd64f5b80 1 --2- 172.21.15.57:0/3751674265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562e531d9cd0 0x562e531e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3751674265 >> 172.21.15.57:0/3751674265 conn(0x562e531cec50 msgr2=0x562e531e3590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3751674265 shutdown_connections 2023-03-02T10:57:24.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.834+0000 7f5bd64f5b80 1 -- 172.21.15.57:0/3751674265 wait complete. 2023-03-02T10:57:24.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bd64f5b80 20 client.25562 trim_cache size 0 max 16384 2023-03-02T10:57:24.847 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:57:24.847 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "IDLE (waiting for more scrubs)", 2023-03-02T10:57:24.848 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T10:57:24.848 INFO:teuthology.orchestra.run.smithi057.stdout: "03f70e35-b590-4c32-b447-5c2fabc0f3b9": { 2023-03-02T10:57:24.848 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T10:57:24.848 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "03f70e35-b590-4c32-b447-5c2fabc0f3b9", 2023-03-02T10:57:24.848 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T10:57:24.848 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:57:24.848 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:57:24.849 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:57:24.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 -- 172.21.15.57:0/2993610245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bac09b4c0 msgr2=0x7f5bac09d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bac09b4c0 0x7f5bac09d970 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc10b390 tx=0x7f5ba8009260 comp rx=0 tx=0).stop 2023-03-02T10:57:24.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 -- 172.21.15.57:0/2993610245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc100ce0 msgr2=0x7f5bbc19b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:24.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc100ce0 0x7f5bbc19b9b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0000c00 tx=0x7f5bb000f690 comp rx=0 tx=0).stop 2023-03-02T10:57:24.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 -- 172.21.15.57:0/2993610245 shutdown_connections 2023-03-02T10:57:24.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bac09b4c0 0x7f5bac09d970 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bbc10a020 0x7f5bbc195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc100ce0 0x7f5bbc19b9b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 --2- 172.21.15.57:0/2993610245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bbc1015f0 0x7f5bbc19bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:24.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 -- 172.21.15.57:0/2993610245 >> 172.21.15.57:0/2993610245 conn(0x7f5bbc0fa4b0 msgr2=0x7f5bbc10c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:24.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 -- 172.21.15.57:0/2993610245 shutdown_connections 2023-03-02T10:57:24.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:24.835+0000 7f5bc2bff700 1 -- 172.21.15.57:0/2993610245 wait complete. 2023-03-02T10:57:24.861 INFO:tasks.cephfs.filesystem:scrub status for tag:03f70e35-b590-4c32-b447-5c2fabc0f3b9 - {'path': '/', 'tag': '03f70e35-b590-4c32-b447-5c2fabc0f3b9', 'options': 'recursive,force'} 2023-03-02T10:57:24.988 INFO:teuthology.orchestra.run.smithi057.stderr:5800000 of 50000000 tuples (11%) done (elapsed 9.79 s, remaining 74.63 s) 2023-03-02T10:57:25.625 INFO:teuthology.orchestra.run.smithi057.stderr:5900000 of 50000000 tuples (11%) done (elapsed 10.43 s, remaining 77.95 s) 2023-03-02T10:57:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:25 smithi057 ceph-mon[92072]: scrub queued for path: / 2023-03-02T10:57:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:25 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:25 smithi057 ceph-mon[92072]: scrub summary: active paths [/] 2023-03-02T10:57:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:25 smithi057 ceph-mon[92072]: pgmap v15: 97 pgs: 97 active+clean; 427 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 66 MiB/s wr, 292 op/s 2023-03-02T10:57:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:25 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:25 smithi122 ceph-mon[125440]: scrub queued for path: / 2023-03-02T10:57:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:25 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:25 smithi122 ceph-mon[125440]: scrub summary: active paths [/] 2023-03-02T10:57:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:25 smithi122 ceph-mon[125440]: pgmap v15: 97 pgs: 97 active+clean; 427 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 66 MiB/s wr, 292 op/s 2023-03-02T10:57:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:25 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:25 smithi136 ceph-mon[125702]: scrub queued for path: / 2023-03-02T10:57:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:25 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:25 smithi136 ceph-mon[125702]: scrub summary: active paths [/] 2023-03-02T10:57:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:25 smithi136 ceph-mon[125702]: pgmap v15: 97 pgs: 97 active+clean; 427 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 66 MiB/s wr, 292 op/s 2023-03-02T10:57:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:25 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:26.171 INFO:teuthology.orchestra.run.smithi057.stderr:6000000 of 50000000 tuples (12%) done (elapsed 10.98 s, remaining 80.49 s) 2023-03-02T10:57:26.368 INFO:teuthology.orchestra.run.smithi057.stderr:6100000 of 50000000 tuples (12%) done (elapsed 11.17 s, remaining 80.41 s) 2023-03-02T10:57:26.489 INFO:teuthology.orchestra.run.smithi057.stderr:6200000 of 50000000 tuples (12%) done (elapsed 11.29 s, remaining 79.79 s) 2023-03-02T10:57:26.680 INFO:teuthology.orchestra.run.smithi057.stderr:6300000 of 50000000 tuples (12%) done (elapsed 11.48 s, remaining 79.66 s) 2023-03-02T10:57:26.871 INFO:teuthology.orchestra.run.smithi057.stderr:6400000 of 50000000 tuples (12%) done (elapsed 11.68 s, remaining 79.55 s) 2023-03-02T10:57:26.987 INFO:teuthology.orchestra.run.smithi057.stderr:6500000 of 50000000 tuples (13%) done (elapsed 11.79 s, remaining 78.92 s) 2023-03-02T10:57:27.176 INFO:teuthology.orchestra.run.smithi057.stderr:6600000 of 50000000 tuples (13%) done (elapsed 11.98 s, remaining 78.79 s) 2023-03-02T10:57:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:6700000 of 50000000 tuples (13%) done (elapsed 12.19 s, remaining 78.79 s) 2023-03-02T10:57:27.516 INFO:teuthology.orchestra.run.smithi057.stderr:6800000 of 50000000 tuples (13%) done (elapsed 12.32 s, remaining 78.27 s) 2023-03-02T10:57:27.678 INFO:teuthology.orchestra.run.smithi057.stderr:6900000 of 50000000 tuples (13%) done (elapsed 12.48 s, remaining 77.97 s) 2023-03-02T10:57:27.799 INFO:teuthology.orchestra.run.smithi057.stderr:7000000 of 50000000 tuples (14%) done (elapsed 12.60 s, remaining 77.42 s) 2023-03-02T10:57:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:27 smithi057 ceph-mon[92072]: pgmap v16: 97 pgs: 97 active+clean; 427 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 66 MiB/s wr, 292 op/s 2023-03-02T10:57:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:27 smithi122 ceph-mon[125440]: pgmap v16: 97 pgs: 97 active+clean; 427 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 66 MiB/s wr, 292 op/s 2023-03-02T10:57:27.965 INFO:teuthology.orchestra.run.smithi057.stderr:7100000 of 50000000 tuples (14%) done (elapsed 12.77 s, remaining 77.16 s) 2023-03-02T10:57:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:27 smithi136 ceph-mon[125702]: pgmap v16: 97 pgs: 97 active+clean; 427 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 66 MiB/s wr, 292 op/s 2023-03-02T10:57:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:7200000 of 50000000 tuples (14%) done (elapsed 12.97 s, remaining 77.12 s) 2023-03-02T10:57:28.277 INFO:teuthology.orchestra.run.smithi057.stderr:7300000 of 50000000 tuples (14%) done (elapsed 13.08 s, remaining 76.52 s) 2023-03-02T10:57:28.480 INFO:teuthology.orchestra.run.smithi057.stderr:7400000 of 50000000 tuples (14%) done (elapsed 13.29 s, remaining 76.48 s) 2023-03-02T10:57:28.681 INFO:teuthology.orchestra.run.smithi057.stderr:7500000 of 50000000 tuples (15%) done (elapsed 13.49 s, remaining 76.42 s) 2023-03-02T10:57:28.779 INFO:teuthology.orchestra.run.smithi057.stderr:7600000 of 50000000 tuples (15%) done (elapsed 13.58 s, remaining 75.78 s) 2023-03-02T10:57:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:7700000 of 50000000 tuples (15%) done (elapsed 13.77 s, remaining 75.66 s) 2023-03-02T10:57:29.195 INFO:teuthology.orchestra.run.smithi057.stderr:7800000 of 50000000 tuples (15%) done (elapsed 14.00 s, remaining 75.74 s) 2023-03-02T10:57:29.276 INFO:teuthology.orchestra.run.smithi057.stderr:7900000 of 50000000 tuples (15%) done (elapsed 14.08 s, remaining 75.04 s) 2023-03-02T10:57:29.480 INFO:teuthology.orchestra.run.smithi057.stderr:8000000 of 50000000 tuples (16%) done (elapsed 14.28 s, remaining 74.99 s) 2023-03-02T10:57:29.606 INFO:teuthology.orchestra.run.smithi057.stderr:8100000 of 50000000 tuples (16%) done (elapsed 14.41 s, remaining 74.55 s) 2023-03-02T10:57:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.707+0000 7f966cbff700 1 -- 172.21.15.57:0/377330175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96681015f0 msgr2=0x7f9668109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.707+0000 7f966cbff700 1 --2- 172.21.15.57:0/377330175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96681015f0 0x7f9668109ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f96500098f0 tx=0x7f9650009c00 comp rx=0 tx=0).stop 2023-03-02T10:57:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.707+0000 7f966cbff700 1 -- 172.21.15.57:0/377330175 shutdown_connections 2023-03-02T10:57:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.707+0000 7f966cbff700 1 --2- 172.21.15.57:0/377330175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f966810a020 0x7f966810c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.707+0000 7f966cbff700 1 --2- 172.21.15.57:0/377330175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9668100ce0 0x7f96681010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.707+0000 7f966cbff700 1 --2- 172.21.15.57:0/377330175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96681015f0 0x7f9668109ae0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.707+0000 7f966cbff700 1 -- 172.21.15.57:0/377330175 >> 172.21.15.57:0/377330175 conn(0x7f96680fa4b0 msgr2=0x7f96680fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.707+0000 7f966cbff700 1 -- 172.21.15.57:0/377330175 shutdown_connections 2023-03-02T10:57:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.707+0000 7f966cbff700 1 -- 172.21.15.57:0/377330175 wait complete. 2023-03-02T10:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966cbff700 1 Processor -- start 2023-03-02T10:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966cbff700 1 -- start start 2023-03-02T10:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966cbff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9668100ce0 0x7f966819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966cbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96681015f0 0x7f966819bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966cbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f966810a020 0x7f9668195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966cbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96681960e0 con 0x7f966810a020 2023-03-02T10:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966cbff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9668196250 con 0x7f9668100ce0 2023-03-02T10:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966cbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9668196410 con 0x7f96681015f0 2023-03-02T10:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f965ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96681015f0 0x7f966819bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9668100ce0 0x7f966819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9668100ce0 0x7f966819ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:51832/0 (socket says 172.21.15.57:51832) 2023-03-02T10:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966659c700 1 -- 172.21.15.57:0/2026306793 learned_addr learned my addr 172.21.15.57:0/2026306793 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f965ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96681015f0 0x7f966819bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48704/0 (socket says 172.21.15.57:48704) 2023-03-02T10:57:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f9666d9d700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f966810a020 0x7f9668195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.708+0000 7f966659c700 1 -- 172.21.15.57:0/2026306793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96681015f0 msgr2=0x7f966819bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.709+0000 7f966659c700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96681015f0 0x7f966819bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.709+0000 7f966659c700 1 -- 172.21.15.57:0/2026306793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f966810a020 msgr2=0x7f9668195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.709+0000 7f966659c700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f966810a020 0x7f9668195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.709+0000 7f966659c700 1 -- 172.21.15.57:0/2026306793 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650009520 con 0x7f9668100ce0 2023-03-02T10:57:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.709+0000 7f966659c700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9668100ce0 0x7f966819ba00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f965800e9c0 tx=0x7f965800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.709+0000 7f965f7fe700 1 -- 172.21.15.57:0/2026306793 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658004a30 con 0x7f9668100ce0 2023-03-02T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.709+0000 7f966cbff700 1 -- 172.21.15.57:0/2026306793 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966810fac0 con 0x7f9668100ce0 2023-03-02T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.709+0000 7f965f7fe700 1 -- 172.21.15.57:0/2026306793 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f965800cc80 con 0x7f9668100ce0 2023-03-02T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.709+0000 7f965f7fe700 1 -- 172.21.15.57:0/2026306793 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96580054e0 con 0x7f9668100ce0 2023-03-02T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.709+0000 7f966cbff700 1 -- 172.21.15.57:0/2026306793 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966810f930 con 0x7f9668100ce0 2023-03-02T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.713+0000 7f965f7fe700 1 -- 172.21.15.57:0/2026306793 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f965801e020 con 0x7f9668100ce0 2023-03-02T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.714+0000 7f9680487b80 1 Processor -- start 2023-03-02T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.714+0000 7f9680487b80 1 -- start start 2023-03-02T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.714+0000 7f965f7fe700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f965409b4c0 0x7f965409d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.714+0000 7f9680487b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8a046b0 0x556cd8bab520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.714+0000 7f9680487b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8baba60 0x556cd8bafac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.714+0000 7f9680487b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8babed0 0x556cd8bb0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.714+0000 7f9680487b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd8b0ea00 con 0x556cd8babed0 2023-03-02T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.714+0000 7f9680487b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd8ac0f20 con 0x556cd8baba60 2023-03-02T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.714+0000 7f9680487b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd8a91100 con 0x556cd8a046b0 2023-03-02T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f965f7fe700 1 -- 172.21.15.57:0/2026306793 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9658014070 con 0x7f9668100ce0 2023-03-02T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f966659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8a046b0 0x556cd8bab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f966659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8a046b0 0x556cd8bab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48716/0 (socket says 172.21.15.57:48716) 2023-03-02T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f966659c700 1 -- 172.21.15.57:0/1745246697 learned_addr learned my addr 172.21.15.57:0/1745246697 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f9666d9d700 1 --2- 172.21.15.57:0/1745246697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8babed0 0x556cd8bb0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f965ffff700 1 --2- 172.21.15.57:0/1745246697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8baba60 0x556cd8bafac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f9666d9d700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f965409b4c0 0x7f965409d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f966659c700 1 -- 172.21.15.57:0/1745246697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8baba60 msgr2=0x556cd8bafac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f966659c700 1 --2- 172.21.15.57:0/1745246697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8baba60 0x556cd8bafac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f966659c700 1 -- 172.21.15.57:0/1745246697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8babed0 msgr2=0x556cd8bb0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f966659c700 1 --2- 172.21.15.57:0/1745246697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8babed0 0x556cd8bb0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f966659c700 1 -- 172.21.15.57:0/1745246697 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cd897b5d0 con 0x556cd8a046b0 2023-03-02T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.715+0000 7f966659c700 1 --2- 172.21.15.57:0/1745246697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8a046b0 0x556cd8bab520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f96580945d0 tx=0x7f9658094600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27ae190e0f26140c server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f965cff9700 1 -- 172.21.15.57:0/1745246697 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965800cdf0 con 0x556cd8a046b0 2023-03-02T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f9666d9d700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f965409b4c0 0x7f965409d970 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9660009ec0 tx=0x7f966000b040 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f965cff9700 1 -- 172.21.15.57:0/1745246697 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9658094e00 con 0x556cd8a046b0 2023-03-02T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f965cff9700 1 -- 172.21.15.57:0/1745246697 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658004b90 con 0x556cd8a046b0 2023-03-02T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f9680487b80 1 -- 172.21.15.57:0/1745246697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8a046b0 msgr2=0x556cd8bab520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f9680487b80 1 --2- 172.21.15.57:0/1745246697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8a046b0 0x556cd8bab520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f96580945d0 tx=0x7f9658094600 comp rx=0 tx=0).stop 2023-03-02T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f9680487b80 1 -- 172.21.15.57:0/1745246697 shutdown_connections 2023-03-02T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f9680487b80 1 --2- 172.21.15.57:0/1745246697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8babed0 0x556cd8bb0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f9680487b80 1 --2- 172.21.15.57:0/1745246697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8a046b0 0x556cd8bab520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f9680487b80 1 --2- 172.21.15.57:0/1745246697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8baba60 0x556cd8bafac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f9680487b80 1 -- 172.21.15.57:0/1745246697 >> 172.21.15.57:0/1745246697 conn(0x556cd8b9c9a0 msgr2=0x556cd8ba1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.716+0000 7f9680487b80 1 -- 172.21.15.57:0/1745246697 shutdown_connections 2023-03-02T10:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.717+0000 7f9680487b80 1 -- 172.21.15.57:0/1745246697 wait complete. 2023-03-02T10:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.717+0000 7f9680487b80 1 -- start start 2023-03-02T10:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.717+0000 7f9680487b80 1 Processor -- start 2023-03-02T10:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.717+0000 7f9680487b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8a046b0 0x556cd8bb77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.717+0000 7f9680487b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8bb4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.717+0000 7f9680487b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8babed0 0x556cd8bb5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.717+0000 7f9680487b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd8affb60 con 0x556cd8babed0 2023-03-02T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.717+0000 7f9680487b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd8af9090 con 0x556cd8a046b0 2023-03-02T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.717+0000 7f9680487b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd897d8c0 con 0x556cd8baba60 2023-03-02T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.717+0000 7f9680487b80 10 client.0 _ll_register_callbacks cb 0x556cd8a9f4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f965ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8bb4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f965ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8bb4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48730/0 (socket says 172.21.15.57:48730) 2023-03-02T10:57:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f965ffff700 1 -- 172.21.15.57:0/1041194531 learned_addr learned my addr 172.21.15.57:0/1041194531 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f966659c700 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8a046b0 0x556cd8bb77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f9666d9d700 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8babed0 0x556cd8bb5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f965ffff700 1 -- 172.21.15.57:0/1041194531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8a046b0 msgr2=0x556cd8bb77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f965ffff700 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8a046b0 0x556cd8bb77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f965ffff700 1 -- 172.21.15.57:0/1041194531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8babed0 msgr2=0x556cd8bb5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f965ffff700 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8babed0 0x556cd8bb5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f965ffff700 1 -- 172.21.15.57:0/1041194531 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966810f930 con 0x556cd8baba60 2023-03-02T10:57:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f9666d9d700 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8babed0 0x556cd8bb5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f965ffff700 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8bb4a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96500098f0 tx=0x7f965000b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5456fdbe64ff31ad server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f964dffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:57:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f964dffb700 1 -- 172.21.15.57:0/1041194531 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650026070 con 0x556cd8baba60 2023-03-02T10:57:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f964dffb700 1 -- 172.21.15.57:0/1041194531 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f965000bbc0 con 0x556cd8baba60 2023-03-02T10:57:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.718+0000 7f9680487b80 1 -- 172.21.15.57:0/1041194531 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556cd8aca750 con 0x556cd8baba60 2023-03-02T10:57:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f964dffb700 1 -- 172.21.15.57:0/1041194531 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f965001c070 con 0x556cd8baba60 2023-03-02T10:57:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f9680487b80 10 client.25525 fetch_fsmap learned FSMap version 27 2023-03-02T10:57:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f9680487b80 1 -- 172.21.15.57:0/1041194531 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556cd8927d80 con 0x556cd8baba60 2023-03-02T10:57:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f964dffb700 1 -- 172.21.15.57:0/1041194531 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556cd8aca750 con 0x556cd8baba60 2023-03-02T10:57:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f964dffb700 1 -- 172.21.15.57:0/1041194531 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 27) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f9650029020 con 0x556cd8baba60 2023-03-02T10:57:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f9680487b80 10 client.25525 fetch_fsmap finished waiting for FSMap version 27 2023-03-02T10:57:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f9680487b80 10 client.25525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f9680487b80 20 client.25525 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f9680487b80 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x556cd8bc4df0 0x556cd8bc7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f9680487b80 4 client.25525 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f9680487b80 1 -- 172.21.15.57:0/1041194531 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556cd8af2110 con 0x556cd8bc4df0 2023-03-02T10:57:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.719+0000 7f966659c700 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x556cd8bc4df0 0x556cd8bc7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.720+0000 7f966659c700 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x556cd8bc4df0 0x556cd8bc7200 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cf95d455ad1e2bd server_cookie=3a28c796adecb59b in_seq=0 out_seq=0 2023-03-02T10:57:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.720+0000 7f964dffb700 10 client.25525 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.721+0000 7f964dffb700 1 -- 172.21.15.57:0/1041194531 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x556cd8af2110 con 0x556cd8bc4df0 2023-03-02T10:57:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.721+0000 7f964dffb700 10 client.25525 handle_command_reply: tid=0 2023-03-02T10:57:29.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.721+0000 7f9680487b80 1 client.25525 shutdown 2023-03-02T10:57:29.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.721+0000 7f9680487b80 1 -- 172.21.15.57:0/1041194531 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 msgr2=0x556cd8bb4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:29.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.721+0000 7f9680487b80 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8bb4a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96500098f0 tx=0x7f965000b790 comp rx=0 tx=0).stop 2023-03-02T10:57:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.722+0000 7f9680487b80 1 -- 172.21.15.57:0/1041194531 shutdown_connections 2023-03-02T10:57:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.722+0000 7f9680487b80 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x556cd8bc4df0 0x556cd8bc7200 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.722+0000 7f9680487b80 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8babed0 0x556cd8bb5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.722+0000 7f9680487b80 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8a046b0 0x556cd8bb77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.722+0000 7f9680487b80 1 --2- 172.21.15.57:0/1041194531 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8bb4a60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.722+0000 7f964dffb700 0 client.25525 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.722+0000 7f9680487b80 1 -- 172.21.15.57:0/1041194531 >> 172.21.15.57:0/1041194531 conn(0x556cd8b9c9a0 msgr2=0x556cd8ba11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.722+0000 7f9680487b80 1 -- 172.21.15.57:0/1041194531 shutdown_connections 2023-03-02T10:57:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.722+0000 7f9680487b80 1 -- 172.21.15.57:0/1041194531 wait complete. 2023-03-02T10:57:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.722+0000 7f9680487b80 20 client.25525 trim_cache size 0 max 16384 2023-03-02T10:57:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f9680487b80 1 Processor -- start 2023-03-02T10:57:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f9680487b80 1 -- start start 2023-03-02T10:57:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f9680487b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 0x556cd8bc0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f9680487b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8baff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f9680487b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8babed0 0x556cd8ba1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f9680487b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd8bb5f30 con 0x556cd8a046b0 2023-03-02T10:57:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f9680487b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd8ba2b20 con 0x556cd8babed0 2023-03-02T10:57:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f9680487b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd8ba27a0 con 0x556cd8baba60 2023-03-02T10:57:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f966659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 0x556cd8bc0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f965ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8baff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f965ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8baff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48742/0 (socket says 172.21.15.57:48742) 2023-03-02T10:57:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f966659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 0x556cd8bc0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60246/0 (socket says 172.21.15.57:60246) 2023-03-02T10:57:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f965ffff700 1 -- 172.21.15.57:0/2809673524 learned_addr learned my addr 172.21.15.57:0/2809673524 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:29.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.737+0000 7f9666d9d700 1 --2- 172.21.15.57:0/2809673524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8babed0 0x556cd8ba1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.738+0000 7f965ffff700 1 -- 172.21.15.57:0/2809673524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8babed0 msgr2=0x556cd8ba1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.738+0000 7f965ffff700 1 --2- 172.21.15.57:0/2809673524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8babed0 0x556cd8ba1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.738+0000 7f965ffff700 1 -- 172.21.15.57:0/2809673524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 msgr2=0x556cd8bc0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.738+0000 7f965ffff700 1 --2- 172.21.15.57:0/2809673524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 0x556cd8bc0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.738+0000 7f965ffff700 1 -- 172.21.15.57:0/2809673524 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cd8ac0130 con 0x556cd8baba60 2023-03-02T10:57:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.738+0000 7f965ffff700 1 --2- 172.21.15.57:0/2809673524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8baff20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9650003a20 tx=0x7f9650009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b06b71d9fa7612d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.738+0000 7f965d7fa700 1 -- 172.21.15.57:0/2809673524 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650026070 con 0x556cd8baba60 2023-03-02T10:57:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.738+0000 7f965d7fa700 1 -- 172.21.15.57:0/2809673524 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f965001d040 con 0x556cd8baba60 2023-03-02T10:57:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.738+0000 7f965d7fa700 1 -- 172.21.15.57:0/2809673524 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965001c070 con 0x556cd8baba60 2023-03-02T10:57:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.739+0000 7f9680487b80 1 -- 172.21.15.57:0/2809673524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 msgr2=0x556cd8baff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.739+0000 7f9680487b80 1 --2- 172.21.15.57:0/2809673524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8baff20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9650003a20 tx=0x7f9650009c00 comp rx=0 tx=0).stop 2023-03-02T10:57:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.739+0000 7f9680487b80 1 -- 172.21.15.57:0/2809673524 shutdown_connections 2023-03-02T10:57:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.739+0000 7f9680487b80 1 --2- 172.21.15.57:0/2809673524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8babed0 0x556cd8ba1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.739+0000 7f9680487b80 1 --2- 172.21.15.57:0/2809673524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 0x556cd8bc0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.739+0000 7f9680487b80 1 --2- 172.21.15.57:0/2809673524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8baff20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.739+0000 7f9680487b80 1 -- 172.21.15.57:0/2809673524 >> 172.21.15.57:0/2809673524 conn(0x556cd8b9c9a0 msgr2=0x556cd8ba5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.739+0000 7f9680487b80 1 -- 172.21.15.57:0/2809673524 shutdown_connections 2023-03-02T10:57:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.739+0000 7f9680487b80 1 -- 172.21.15.57:0/2809673524 wait complete. 2023-03-02T10:57:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.739+0000 7f9680487b80 1 -- start start 2023-03-02T10:57:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.739+0000 7f9680487b80 1 Processor -- start 2023-03-02T10:57:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f9680487b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 0x556cd8bb31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f9680487b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8bb3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f9680487b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8babed0 0x556cd8bb3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f9680487b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd8bb4360 con 0x556cd8a046b0 2023-03-02T10:57:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f9680487b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd8bb44d0 con 0x556cd8babed0 2023-03-02T10:57:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f9680487b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cd8bb4690 con 0x556cd8baba60 2023-03-02T10:57:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f9680487b80 10 client.0 _ll_register_callbacks cb 0x556cd8a9f4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f966659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 0x556cd8bb31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f966659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 0x556cd8bb31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60260/0 (socket says 172.21.15.57:60260) 2023-03-02T10:57:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f966659c700 1 -- 172.21.15.57:0/3894015834 learned_addr learned my addr 172.21.15.57:0/3894015834 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f965ffff700 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8bb3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f9666d9d700 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8babed0 0x556cd8bb3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f966659c700 1 -- 172.21.15.57:0/3894015834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 msgr2=0x556cd8bb3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f966659c700 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8bb3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f966659c700 1 -- 172.21.15.57:0/3894015834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8babed0 msgr2=0x556cd8bb3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f966659c700 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8babed0 0x556cd8bb3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f966659c700 1 -- 172.21.15.57:0/3894015834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556cd8927d80 con 0x556cd8a046b0 2023-03-02T10:57:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.740+0000 7f965ffff700 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8bb3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f966659c700 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 0x556cd8bb31d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f96580b34b0 tx=0x7f9658009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c913f83b58aad4 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f964dffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f964dffb700 1 -- 172.21.15.57:0/3894015834 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965809be20 con 0x556cd8a046b0 2023-03-02T10:57:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f9680487b80 1 -- 172.21.15.57:0/3894015834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9658094e00 con 0x556cd8a046b0 2023-03-02T10:57:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f964dffb700 1 -- 172.21.15.57:0/3894015834 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9658004b90 con 0x556cd8a046b0 2023-03-02T10:57:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f964dffb700 1 -- 172.21.15.57:0/3894015834 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96580b3070 con 0x556cd8a046b0 2023-03-02T10:57:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f9680487b80 10 client.15714 fetch_fsmap learned FSMap version 27 2023-03-02T10:57:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f9680487b80 1 -- 172.21.15.57:0/3894015834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556cd894e1f0 con 0x556cd8a046b0 2023-03-02T10:57:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f964dffb700 1 -- 172.21.15.57:0/3894015834 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96580b7020 con 0x556cd8a046b0 2023-03-02T10:57:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f964dffb700 1 -- 172.21.15.57:0/3894015834 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 27) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f9658093bf0 con 0x556cd8a046b0 2023-03-02T10:57:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f9680487b80 10 client.15714 fetch_fsmap finished waiting for FSMap version 27 2023-03-02T10:57:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f9680487b80 10 client.15714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f9680487b80 20 client.15714 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f9680487b80 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x556cd8c17300 0x556cd8c19710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f9680487b80 4 client.15714 mds_command: new command op to 24560 tid=0[{"prefix": "flush journal"}] 2023-03-02T10:57:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.741+0000 7f9680487b80 1 -- 172.21.15.57:0/3894015834 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556cd8af1e30 con 0x556cd8c17300 2023-03-02T10:57:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.742+0000 7f965ffff700 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x556cd8c17300 0x556cd8c19710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.742+0000 7f964dffb700 10 client.15714 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.742+0000 7f965ffff700 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x556cd8c17300 0x556cd8c19710 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a6815c7e53c008d server_cookie=8c455a5c894bcfaa in_seq=0 out_seq=0 2023-03-02T10:57:29.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f964dffb700 1 -- 172.21.15.57:0/3894015834 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556cd8af1e30 con 0x556cd8c17300 2023-03-02T10:57:29.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f964dffb700 10 client.15714 handle_command_reply: tid=0 2023-03-02T10:57:29.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f9680487b80 1 client.15714 shutdown 2023-03-02T10:57:29.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f9680487b80 1 -- 172.21.15.57:0/3894015834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 msgr2=0x556cd8bb31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:29.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f9680487b80 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 0x556cd8bb31d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f96580b34b0 tx=0x7f9658009550 comp rx=0 tx=0).stop 2023-03-02T10:57:29.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f9680487b80 1 -- 172.21.15.57:0/3894015834 shutdown_connections 2023-03-02T10:57:29.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f9680487b80 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x556cd8c17300 0x556cd8c19710 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f9680487b80 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd8babed0 0x556cd8bb3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f964dffb700 0 client.15714 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f9680487b80 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556cd8a046b0 0x556cd8bb31d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f9680487b80 1 --2- 172.21.15.57:0/3894015834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556cd8baba60 0x556cd8bb3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f9680487b80 1 -- 172.21.15.57:0/3894015834 >> 172.21.15.57:0/3894015834 conn(0x556cd8b9c9a0 msgr2=0x556cd8ba6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.770+0000 7f9680487b80 1 -- 172.21.15.57:0/3894015834 shutdown_connections 2023-03-02T10:57:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f9680487b80 1 -- 172.21.15.57:0/3894015834 wait complete. 2023-03-02T10:57:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f9680487b80 20 client.15714 trim_cache size 0 max 16384 2023-03-02T10:57:29.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:{ 2023-03-02T10:57:29.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "message": "", 2023-03-02T10:57:29.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "return_code": 0 2023-03-02T10:57:29.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:} 2023-03-02T10:57:29.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f966cbff700 1 -- 172.21.15.57:0/2026306793 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f965409b4c0 msgr2=0x7f965409d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f966cbff700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f965409b4c0 0x7f965409d970 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9660009ec0 tx=0x7f966000b040 comp rx=0 tx=0).stop 2023-03-02T10:57:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f966cbff700 1 -- 172.21.15.57:0/2026306793 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9668100ce0 msgr2=0x7f966819ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f966cbff700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9668100ce0 0x7f966819ba00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f965800e9c0 tx=0x7f965800ecd0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f966cbff700 1 -- 172.21.15.57:0/2026306793 shutdown_connections 2023-03-02T10:57:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f966cbff700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f965409b4c0 0x7f965409d970 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f966cbff700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f966810a020 0x7f9668195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f966cbff700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9668100ce0 0x7f966819ba00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f966cbff700 1 --2- 172.21.15.57:0/2026306793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96681015f0 0x7f966819bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.771+0000 7f966cbff700 1 -- 172.21.15.57:0/2026306793 >> 172.21.15.57:0/2026306793 conn(0x7f96680fa4b0 msgr2=0x7f966810c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.772+0000 7f966cbff700 1 -- 172.21.15.57:0/2026306793 shutdown_connections 2023-03-02T10:57:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:29.772+0000 7f966cbff700 1 -- 172.21.15.57:0/2026306793 wait complete. 2023-03-02T10:57:29.816 INFO:teuthology.orchestra.run.smithi057.stderr:8200000 of 50000000 tuples (16%) done (elapsed 14.62 s, remaining 74.53 s) 2023-03-02T10:57:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:29 smithi136 ceph-mon[125702]: pgmap v17: 97 pgs: 97 active+clean; 1.4 GiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 170 MiB/s wr, 424 op/s 2023-03-02T10:57:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:29 smithi136 ceph-mon[125702]: scrub summary: idle 2023-03-02T10:57:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:29 smithi057 ceph-mon[92072]: pgmap v17: 97 pgs: 97 active+clean; 1.4 GiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 170 MiB/s wr, 424 op/s 2023-03-02T10:57:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:29 smithi057 ceph-mon[92072]: scrub summary: idle 2023-03-02T10:57:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:29 smithi122 ceph-mon[125440]: pgmap v17: 97 pgs: 97 active+clean; 1.4 GiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 170 MiB/s wr, 424 op/s 2023-03-02T10:57:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:29 smithi122 ceph-mon[125440]: scrub summary: idle 2023-03-02T10:57:30.015 INFO:teuthology.orchestra.run.smithi057.stderr:8300000 of 50000000 tuples (16%) done (elapsed 14.82 s, remaining 74.45 s) 2023-03-02T10:57:30.133 INFO:teuthology.orchestra.run.smithi057.stderr:8400000 of 50000000 tuples (16%) done (elapsed 14.94 s, remaining 73.98 s) 2023-03-02T10:57:30.312 INFO:teuthology.orchestra.run.smithi057.stderr:8500000 of 50000000 tuples (17%) done (elapsed 15.12 s, remaining 73.81 s) 2023-03-02T10:57:30.508 INFO:teuthology.orchestra.run.smithi057.stderr:8600000 of 50000000 tuples (17%) done (elapsed 15.31 s, remaining 73.72 s) 2023-03-02T10:57:30.628 INFO:teuthology.orchestra.run.smithi057.stderr:8700000 of 50000000 tuples (17%) done (elapsed 15.43 s, remaining 73.26 s) 2023-03-02T10:57:30.806 INFO:teuthology.orchestra.run.smithi057.stderr:8800000 of 50000000 tuples (17%) done (elapsed 15.61 s, remaining 73.09 s) 2023-03-02T10:57:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:30 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:57:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:30 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:57:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:30 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:57:30.994 INFO:teuthology.orchestra.run.smithi057.stderr:8900000 of 50000000 tuples (17%) done (elapsed 15.80 s, remaining 72.96 s) 2023-03-02T10:57:31.115 INFO:teuthology.orchestra.run.smithi057.stderr:9000000 of 50000000 tuples (18%) done (elapsed 15.92 s, remaining 72.53 s) 2023-03-02T10:57:31.315 INFO:teuthology.orchestra.run.smithi057.stderr:9100000 of 50000000 tuples (18%) done (elapsed 16.12 s, remaining 72.45 s) 2023-03-02T10:57:31.518 INFO:teuthology.orchestra.run.smithi057.stderr:9200000 of 50000000 tuples (18%) done (elapsed 16.32 s, remaining 72.39 s) 2023-03-02T10:57:31.642 INFO:teuthology.orchestra.run.smithi057.stderr:9300000 of 50000000 tuples (18%) done (elapsed 16.45 s, remaining 71.98 s) 2023-03-02T10:57:31.815 INFO:teuthology.orchestra.run.smithi057.stderr:9400000 of 50000000 tuples (18%) done (elapsed 16.62 s, remaining 71.79 s) 2023-03-02T10:57:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:31 smithi136 ceph-mon[125702]: pgmap v18: 97 pgs: 97 active+clean; 1.4 GiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 156 MiB/s wr, 165 op/s 2023-03-02T10:57:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:31 smithi057 ceph-mon[92072]: pgmap v18: 97 pgs: 97 active+clean; 1.4 GiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 156 MiB/s wr, 165 op/s 2023-03-02T10:57:31.938 INFO:teuthology.orchestra.run.smithi057.stderr:9500000 of 50000000 tuples (19%) done (elapsed 16.74 s, remaining 71.38 s) 2023-03-02T10:57:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:31 smithi122 ceph-mon[125440]: pgmap v18: 97 pgs: 97 active+clean; 1.4 GiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 156 MiB/s wr, 165 op/s 2023-03-02T10:57:32.135 INFO:teuthology.orchestra.run.smithi057.stderr:9600000 of 50000000 tuples (19%) done (elapsed 16.94 s, remaining 71.29 s) 2023-03-02T10:57:32.303 INFO:teuthology.orchestra.run.smithi057.stderr:9700000 of 50000000 tuples (19%) done (elapsed 17.11 s, remaining 71.08 s) 2023-03-02T10:57:32.425 INFO:teuthology.orchestra.run.smithi057.stderr:9800000 of 50000000 tuples (19%) done (elapsed 17.23 s, remaining 70.68 s) 2023-03-02T10:57:32.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:32 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:57:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:32 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:57:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:32 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:57:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:9900000 of 50000000 tuples (19%) done (elapsed 17.97 s, remaining 72.77 s) 2023-03-02T10:57:33.284 INFO:teuthology.orchestra.run.smithi057.stderr:10000000 of 50000000 tuples (20%) done (elapsed 18.09 s, remaining 72.35 s) 2023-03-02T10:57:33.404 INFO:teuthology.orchestra.run.smithi057.stderr:10100000 of 50000000 tuples (20%) done (elapsed 18.21 s, remaining 71.94 s) 2023-03-02T10:57:33.510 INFO:teuthology.orchestra.run.smithi057.stderr:10200000 of 50000000 tuples (20%) done (elapsed 18.31 s, remaining 71.46 s) 2023-03-02T10:57:33.643 INFO:teuthology.orchestra.run.smithi057.stderr:10300000 of 50000000 tuples (20%) done (elapsed 18.45 s, remaining 71.11 s) 2023-03-02T10:57:33.758 INFO:teuthology.orchestra.run.smithi057.stderr:10400000 of 50000000 tuples (20%) done (elapsed 18.56 s, remaining 70.68 s) 2023-03-02T10:57:33.860 INFO:teuthology.orchestra.run.smithi057.stderr:10500000 of 50000000 tuples (21%) done (elapsed 18.66 s, remaining 70.21 s) 2023-03-02T10:57:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:33 smithi057 ceph-mon[92072]: pgmap v19: 97 pgs: 97 active+clean; 1.7 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 207 MiB/s wr, 218 op/s 2023-03-02T10:57:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:33 smithi122 ceph-mon[125440]: pgmap v19: 97 pgs: 97 active+clean; 1.7 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 207 MiB/s wr, 218 op/s 2023-03-02T10:57:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:10600000 of 50000000 tuples (21%) done (elapsed 18.78 s, remaining 69.82 s) 2023-03-02T10:57:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:33 smithi136 ceph-mon[125702]: pgmap v19: 97 pgs: 97 active+clean; 1.7 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 207 MiB/s wr, 218 op/s 2023-03-02T10:57:34.094 INFO:teuthology.orchestra.run.smithi057.stderr:10700000 of 50000000 tuples (21%) done (elapsed 18.90 s, remaining 69.41 s) 2023-03-02T10:57:34.215 INFO:teuthology.orchestra.run.smithi057.stderr:10800000 of 50000000 tuples (21%) done (elapsed 19.02 s, remaining 69.03 s) 2023-03-02T10:57:34.326 INFO:teuthology.orchestra.run.smithi057.stderr:10900000 of 50000000 tuples (21%) done (elapsed 19.13 s, remaining 68.62 s) 2023-03-02T10:57:34.447 INFO:teuthology.orchestra.run.smithi057.stderr:11000000 of 50000000 tuples (22%) done (elapsed 19.25 s, remaining 68.26 s) 2023-03-02T10:57:34.589 INFO:teuthology.orchestra.run.smithi057.stderr:11100000 of 50000000 tuples (22%) done (elapsed 19.39 s, remaining 67.97 s) 2023-03-02T10:57:34.724 INFO:teuthology.orchestra.run.smithi057.stderr:11200000 of 50000000 tuples (22%) done (elapsed 19.53 s, remaining 67.65 s) 2023-03-02T10:57:34.851 INFO:teuthology.orchestra.run.smithi057.stderr:11300000 of 50000000 tuples (22%) done (elapsed 19.66 s, remaining 67.32 s) 2023-03-02T10:57:34.979 INFO:teuthology.orchestra.run.smithi057.stderr:11400000 of 50000000 tuples (22%) done (elapsed 19.78 s, remaining 66.99 s) 2023-03-02T10:57:35.096 INFO:teuthology.orchestra.run.smithi057.stderr:11500000 of 50000000 tuples (23%) done (elapsed 19.90 s, remaining 66.62 s) 2023-03-02T10:57:35.186 INFO:teuthology.orchestra.run.smithi057.stderr:11600000 of 50000000 tuples (23%) done (elapsed 19.99 s, remaining 66.18 s) 2023-03-02T10:57:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:11700000 of 50000000 tuples (23%) done (elapsed 20.14 s, remaining 65.92 s) 2023-03-02T10:57:35.452 INFO:teuthology.orchestra.run.smithi057.stderr:11800000 of 50000000 tuples (23%) done (elapsed 20.26 s, remaining 65.58 s) 2023-03-02T10:57:35.573 INFO:teuthology.orchestra.run.smithi057.stderr:11900000 of 50000000 tuples (23%) done (elapsed 20.38 s, remaining 65.24 s) 2023-03-02T10:57:35.684 INFO:teuthology.orchestra.run.smithi057.stderr:12000000 of 50000000 tuples (24%) done (elapsed 20.49 s, remaining 64.88 s) 2023-03-02T10:57:35.799 INFO:teuthology.orchestra.run.smithi057.stderr:12100000 of 50000000 tuples (24%) done (elapsed 20.60 s, remaining 64.54 s) 2023-03-02T10:57:35.919 INFO:teuthology.orchestra.run.smithi057.stderr:12200000 of 50000000 tuples (24%) done (elapsed 20.72 s, remaining 64.21 s) 2023-03-02T10:57:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:35 smithi057 ceph-mon[92072]: pgmap v20: 97 pgs: 97 active+clean; 1.7 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 155 MiB/s wr, 185 op/s 2023-03-02T10:57:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:35 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:57:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:35 smithi122 ceph-mon[125440]: pgmap v20: 97 pgs: 97 active+clean; 1.7 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 155 MiB/s wr, 185 op/s 2023-03-02T10:57:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:35 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:57:36.039 INFO:teuthology.orchestra.run.smithi057.stderr:12300000 of 50000000 tuples (24%) done (elapsed 20.84 s, remaining 63.89 s) 2023-03-02T10:57:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:35 smithi136 ceph-mon[125702]: pgmap v20: 97 pgs: 97 active+clean; 1.7 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 155 MiB/s wr, 185 op/s 2023-03-02T10:57:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:35 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:57:36.138 INFO:teuthology.orchestra.run.smithi057.stderr:12400000 of 50000000 tuples (24%) done (elapsed 20.94 s, remaining 63.50 s) 2023-03-02T10:57:36.274 INFO:teuthology.orchestra.run.smithi057.stderr:12500000 of 50000000 tuples (25%) done (elapsed 21.08 s, remaining 63.24 s) 2023-03-02T10:57:36.398 INFO:teuthology.orchestra.run.smithi057.stderr:12600000 of 50000000 tuples (25%) done (elapsed 21.20 s, remaining 62.94 s) 2023-03-02T10:57:36.501 INFO:teuthology.orchestra.run.smithi057.stderr:12700000 of 50000000 tuples (25%) done (elapsed 21.31 s, remaining 62.58 s) 2023-03-02T10:57:36.657 INFO:teuthology.orchestra.run.smithi057.stderr:12800000 of 50000000 tuples (25%) done (elapsed 21.46 s, remaining 62.37 s) 2023-03-02T10:57:36.735 INFO:teuthology.orchestra.run.smithi057.stderr:12900000 of 50000000 tuples (25%) done (elapsed 21.54 s, remaining 61.95 s) 2023-03-02T10:57:36.871 INFO:teuthology.orchestra.run.smithi057.stderr:13000000 of 50000000 tuples (26%) done (elapsed 21.68 s, remaining 61.69 s) 2023-03-02T10:57:36.995 INFO:teuthology.orchestra.run.smithi057.stderr:13100000 of 50000000 tuples (26%) done (elapsed 21.80 s, remaining 61.41 s) 2023-03-02T10:57:37.100 INFO:teuthology.orchestra.run.smithi057.stderr:13200000 of 50000000 tuples (26%) done (elapsed 21.91 s, remaining 61.07 s) 2023-03-02T10:57:37.210 INFO:teuthology.orchestra.run.smithi057.stderr:13300000 of 50000000 tuples (26%) done (elapsed 22.01 s, remaining 60.75 s) 2023-03-02T10:57:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:13400000 of 50000000 tuples (26%) done (elapsed 22.13 s, remaining 60.45 s) 2023-03-02T10:57:37.429 INFO:teuthology.orchestra.run.smithi057.stderr:13500000 of 50000000 tuples (27%) done (elapsed 22.23 s, remaining 60.12 s) 2023-03-02T10:57:37.560 INFO:teuthology.orchestra.run.smithi057.stderr:13600000 of 50000000 tuples (27%) done (elapsed 22.36 s, remaining 59.86 s) 2023-03-02T10:57:37.721 INFO:teuthology.orchestra.run.smithi057.stderr:13700000 of 50000000 tuples (27%) done (elapsed 22.53 s, remaining 59.68 s) 2023-03-02T10:57:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:37 smithi057 ceph-mon[92072]: pgmap v21: 97 pgs: 97 active+clean; 1.7 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 155 MiB/s wr, 185 op/s 2023-03-02T10:57:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:37 smithi122 ceph-mon[125440]: pgmap v21: 97 pgs: 97 active+clean; 1.7 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 155 MiB/s wr, 185 op/s 2023-03-02T10:57:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:37 smithi136 ceph-mon[125702]: pgmap v21: 97 pgs: 97 active+clean; 1.7 GiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 155 MiB/s wr, 185 op/s 2023-03-02T10:57:38.299 INFO:teuthology.orchestra.run.smithi057.stderr:13800000 of 50000000 tuples (27%) done (elapsed 23.10 s, remaining 60.61 s) 2023-03-02T10:57:38.425 INFO:teuthology.orchestra.run.smithi057.stderr:13900000 of 50000000 tuples (27%) done (elapsed 23.23 s, remaining 60.33 s) 2023-03-02T10:57:38.523 INFO:teuthology.orchestra.run.smithi057.stderr:14000000 of 50000000 tuples (28%) done (elapsed 23.33 s, remaining 59.99 s) 2023-03-02T10:57:38.651 INFO:teuthology.orchestra.run.smithi057.stderr:14100000 of 50000000 tuples (28%) done (elapsed 23.46 s, remaining 59.72 s) 2023-03-02T10:57:38.799 INFO:teuthology.orchestra.run.smithi057.stderr:14200000 of 50000000 tuples (28%) done (elapsed 23.60 s, remaining 59.51 s) 2023-03-02T10:57:38.914 INFO:teuthology.orchestra.run.smithi057.stderr:14300000 of 50000000 tuples (28%) done (elapsed 23.72 s, remaining 59.21 s) 2023-03-02T10:57:39.019 INFO:teuthology.orchestra.run.smithi057.stderr:14400000 of 50000000 tuples (28%) done (elapsed 23.82 s, remaining 58.90 s) 2023-03-02T10:57:39.162 INFO:teuthology.orchestra.run.smithi057.stderr:14500000 of 50000000 tuples (29%) done (elapsed 23.97 s, remaining 58.68 s) 2023-03-02T10:57:39.289 INFO:teuthology.orchestra.run.smithi057.stderr:14600000 of 50000000 tuples (29%) done (elapsed 24.09 s, remaining 58.42 s) 2023-03-02T10:57:39.401 INFO:teuthology.orchestra.run.smithi057.stderr:14700000 of 50000000 tuples (29%) done (elapsed 24.21 s, remaining 58.13 s) 2023-03-02T10:57:39.517 INFO:teuthology.orchestra.run.smithi057.stderr:14800000 of 50000000 tuples (29%) done (elapsed 24.32 s, remaining 57.85 s) 2023-03-02T10:57:39.625 INFO:teuthology.orchestra.run.smithi057.stderr:14900000 of 50000000 tuples (29%) done (elapsed 24.43 s, remaining 57.55 s) 2023-03-02T10:57:39.736 INFO:teuthology.orchestra.run.smithi057.stderr:15000000 of 50000000 tuples (30%) done (elapsed 24.54 s, remaining 57.26 s) 2023-03-02T10:57:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:39 smithi136 ceph-mon[125702]: pgmap v22: 97 pgs: 97 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 234 MiB/s wr, 231 op/s 2023-03-02T10:57:39.868 INFO:teuthology.orchestra.run.smithi057.stderr:15100000 of 50000000 tuples (30%) done (elapsed 24.67 s, remaining 57.03 s) 2023-03-02T10:57:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:39 smithi057 ceph-mon[92072]: pgmap v22: 97 pgs: 97 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 234 MiB/s wr, 231 op/s 2023-03-02T10:57:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:39 smithi122 ceph-mon[125440]: pgmap v22: 97 pgs: 97 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 234 MiB/s wr, 231 op/s 2023-03-02T10:57:39.968 INFO:teuthology.orchestra.run.smithi057.stderr:15200000 of 50000000 tuples (30%) done (elapsed 24.77 s, remaining 56.72 s) 2023-03-02T10:57:40.109 INFO:teuthology.orchestra.run.smithi057.stderr:15300000 of 50000000 tuples (30%) done (elapsed 24.91 s, remaining 56.50 s) 2023-03-02T10:57:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:15400000 of 50000000 tuples (30%) done (elapsed 25.03 s, remaining 56.24 s) 2023-03-02T10:57:40.341 INFO:teuthology.orchestra.run.smithi057.stderr:15500000 of 50000000 tuples (31%) done (elapsed 25.15 s, remaining 55.97 s) 2023-03-02T10:57:40.462 INFO:teuthology.orchestra.run.smithi057.stderr:15600000 of 50000000 tuples (31%) done (elapsed 25.27 s, remaining 55.72 s) 2023-03-02T10:57:40.575 INFO:teuthology.orchestra.run.smithi057.stderr:15700000 of 50000000 tuples (31%) done (elapsed 25.38 s, remaining 55.45 s) 2023-03-02T10:57:40.712 INFO:teuthology.orchestra.run.smithi057.stderr:15800000 of 50000000 tuples (31%) done (elapsed 25.52 s, remaining 55.23 s) 2023-03-02T10:57:40.839 INFO:teuthology.orchestra.run.smithi057.stderr:15900000 of 50000000 tuples (31%) done (elapsed 25.64 s, remaining 55.00 s) 2023-03-02T10:57:40.955 INFO:teuthology.orchestra.run.smithi057.stderr:16000000 of 50000000 tuples (32%) done (elapsed 25.76 s, remaining 54.74 s) 2023-03-02T10:57:41.059 INFO:teuthology.orchestra.run.smithi057.stderr:16100000 of 50000000 tuples (32%) done (elapsed 25.86 s, remaining 54.46 s) 2023-03-02T10:57:41.173 INFO:teuthology.orchestra.run.smithi057.stderr:16200000 of 50000000 tuples (32%) done (elapsed 25.98 s, remaining 54.20 s) 2023-03-02T10:57:41.271 INFO:teuthology.orchestra.run.smithi057.stderr:16300000 of 50000000 tuples (32%) done (elapsed 26.08 s, remaining 53.91 s) 2023-03-02T10:57:41.398 INFO:teuthology.orchestra.run.smithi057.stderr:16400000 of 50000000 tuples (32%) done (elapsed 26.20 s, remaining 53.68 s) 2023-03-02T10:57:41.515 INFO:teuthology.orchestra.run.smithi057.stderr:16500000 of 50000000 tuples (33%) done (elapsed 26.32 s, remaining 53.44 s) 2023-03-02T10:57:41.635 INFO:teuthology.orchestra.run.smithi057.stderr:16600000 of 50000000 tuples (33%) done (elapsed 26.44 s, remaining 53.20 s) 2023-03-02T10:57:41.765 INFO:teuthology.orchestra.run.smithi057.stderr:16700000 of 50000000 tuples (33%) done (elapsed 26.57 s, remaining 52.98 s) 2023-03-02T10:57:41.862 INFO:teuthology.orchestra.run.smithi057.stderr:16800000 of 50000000 tuples (33%) done (elapsed 26.67 s, remaining 52.70 s) 2023-03-02T10:57:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:41 smithi057 ceph-mon[92072]: pgmap v23: 97 pgs: 97 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 130 MiB/s wr, 98 op/s 2023-03-02T10:57:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:41 smithi122 ceph-mon[125440]: pgmap v23: 97 pgs: 97 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 130 MiB/s wr, 98 op/s 2023-03-02T10:57:41.981 INFO:teuthology.orchestra.run.smithi057.stderr:16900000 of 50000000 tuples (33%) done (elapsed 26.79 s, remaining 52.46 s) 2023-03-02T10:57:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:41 smithi136 ceph-mon[125702]: pgmap v23: 97 pgs: 97 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 130 MiB/s wr, 98 op/s 2023-03-02T10:57:42.096 INFO:teuthology.orchestra.run.smithi057.stderr:17000000 of 50000000 tuples (34%) done (elapsed 26.90 s, remaining 52.22 s) 2023-03-02T10:57:42.237 INFO:teuthology.orchestra.run.smithi057.stderr:17100000 of 50000000 tuples (34%) done (elapsed 27.04 s, remaining 52.03 s) 2023-03-02T10:57:42.358 INFO:teuthology.orchestra.run.smithi057.stderr:17200000 of 50000000 tuples (34%) done (elapsed 27.16 s, remaining 51.80 s) 2023-03-02T10:57:42.482 INFO:teuthology.orchestra.run.smithi057.stderr:17300000 of 50000000 tuples (34%) done (elapsed 27.29 s, remaining 51.58 s) 2023-03-02T10:57:42.584 INFO:teuthology.orchestra.run.smithi057.stderr:17400000 of 50000000 tuples (34%) done (elapsed 27.39 s, remaining 51.31 s) 2023-03-02T10:57:42.714 INFO:teuthology.orchestra.run.smithi057.stderr:17500000 of 50000000 tuples (35%) done (elapsed 27.52 s, remaining 51.11 s) 2023-03-02T10:57:42.979 INFO:teuthology.orchestra.run.smithi057.stderr:17600000 of 50000000 tuples (35%) done (elapsed 27.78 s, remaining 51.14 s) 2023-03-02T10:57:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.053+0000 7fb3c3bff700 1 -- 172.21.15.57:0/4085369764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3bc10c300 msgr2=0x7fb3bc10e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.053+0000 7fb3c3bff700 1 --2- 172.21.15.57:0/4085369764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3bc10c300 0x7fb3bc10e6e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400b0a0 tx=0x7fb3b400b3b0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.053+0000 7fb3c3bff700 1 -- 172.21.15.57:0/4085369764 shutdown_connections 2023-03-02T10:57:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.053+0000 7fb3c3bff700 1 --2- 172.21.15.57:0/4085369764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3bc10c300 0x7fb3bc10e6e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.053+0000 7fb3c3bff700 1 --2- 172.21.15.57:0/4085369764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3bc072930 0x7fb3bc072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.053+0000 7fb3c3bff700 1 --2- 172.21.15.57:0/4085369764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3bc073240 0x7fb3bc10bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.053+0000 7fb3c3bff700 1 -- 172.21.15.57:0/4085369764 >> 172.21.15.57:0/4085369764 conn(0x7fb3bc0fb600 msgr2=0x7fb3bc0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.053+0000 7fb3c3bff700 1 -- 172.21.15.57:0/4085369764 shutdown_connections 2023-03-02T10:57:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.054+0000 7fb3c3bff700 1 -- 172.21.15.57:0/4085369764 wait complete. 2023-03-02T10:57:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.055+0000 7fb3c3bff700 1 Processor -- start 2023-03-02T10:57:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.055+0000 7fb3c3bff700 1 -- start start 2023-03-02T10:57:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.055+0000 7fb3c3bff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3bc072930 0x7fb3bc10ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.055+0000 7fb3c3bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3bc073240 0x7fb3bc109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.055+0000 7fb3c3bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3bc10c300 0x7fb3bc109fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.055+0000 7fb3c3bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc10a610 con 0x7fb3bc073240 2023-03-02T10:57:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.055+0000 7fb3c3bff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc10a780 con 0x7fb3bc072930 2023-03-02T10:57:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.055+0000 7fb3c3bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc10a940 con 0x7fb3bc10c300 2023-03-02T10:57:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.055+0000 7fb3c119a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3bc073240 0x7fb3bc109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.056+0000 7fb3c119a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3bc073240 0x7fb3bc109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50362/0 (socket says 172.21.15.57:50362) 2023-03-02T10:57:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.056+0000 7fb3c119a700 1 -- 172.21.15.57:0/3224249812 learned_addr learned my addr 172.21.15.57:0/3224249812 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.056+0000 7fb3c119a700 1 -- 172.21.15.57:0/3224249812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3bc10c300 msgr2=0x7fb3bc109fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-02T10:57:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.056+0000 7fb3c119a700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3bc10c300 0x7fb3bc109fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.056+0000 7fb3c119a700 1 -- 172.21.15.57:0/3224249812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3bc072930 msgr2=0x7fb3bc10ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.056+0000 7fb3c119a700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3bc072930 0x7fb3bc10ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.056+0000 7fb3c119a700 1 -- 172.21.15.57:0/3224249812 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b4009d00 con 0x7fb3bc073240 2023-03-02T10:57:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.056+0000 7fb3c119a700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3bc073240 0x7fb3bc109a90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00e9a0 tx=0x7fb3ac00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.057+0000 7fb3b2ffd700 1 -- 172.21.15.57:0/3224249812 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac009790 con 0x7fb3bc073240 2023-03-02T10:57:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.057+0000 7fb3c3bff700 1 -- 172.21.15.57:0/3224249812 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc100240 con 0x7fb3bc073240 2023-03-02T10:57:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.057+0000 7fb3c3bff700 1 -- 172.21.15.57:0/3224249812 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc1000b0 con 0x7fb3bc073240 2023-03-02T10:57:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.057+0000 7fb3b2ffd700 1 -- 172.21.15.57:0/3224249812 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3ac00cbd0 con 0x7fb3bc073240 2023-03-02T10:57:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.057+0000 7fb3b2ffd700 1 -- 172.21.15.57:0/3224249812 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac018680 con 0x7fb3bc073240 2023-03-02T10:57:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.060+0000 7fb3b2ffd700 1 -- 172.21.15.57:0/3224249812 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7fb3ac00c040 con 0x7fb3bc073240 2023-03-02T10:57:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.061+0000 7fb3b2ffd700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb3a809b540 0x7fb3a809d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.061+0000 7fb3b2ffd700 1 -- 172.21.15.57:0/3224249812 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb3ac014070 con 0x7fb3bc073240 2023-03-02T10:57:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.062+0000 7fb3d7548b80 1 Processor -- start 2023-03-02T10:57:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.062+0000 7fb3c199b700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb3a809b540 0x7fb3a809d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.062+0000 7fb3d7548b80 1 -- start start 2023-03-02T10:57:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.062+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d71a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.062+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d6bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.062+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 0x55d542d6c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542cd3a00 con 0x55d542bc96b0 2023-03-02T10:57:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542c85f20 con 0x55d542d71fd0 2023-03-02T10:57:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542c56100 con 0x55d542d72440 2023-03-02T10:57:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3c199b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d71a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3c199b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d71a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50378/0 (socket says 172.21.15.57:50378) 2023-03-02T10:57:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3c199b700 1 -- 172.21.15.57:0/2432221873 learned_addr learned my addr 172.21.15.57:0/2432221873 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3c199b700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb3a809b540 0x7fb3a809d9f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8005950 tx=0x7fb3b80058e0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3c199b700 1 -- 172.21.15.57:0/2432221873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 msgr2=0x55d542d6c4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-02T10:57:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3c199b700 1 --2- 172.21.15.57:0/2432221873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 0x55d542d6c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3c199b700 1 -- 172.21.15.57:0/2432221873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 msgr2=0x55d542d6bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3c199b700 1 --2- 172.21.15.57:0/2432221873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d6bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.063+0000 7fb3c199b700 1 -- 172.21.15.57:0/2432221873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d542b405d0 con 0x55d542bc96b0 2023-03-02T10:57:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.064+0000 7fb3c199b700 1 --2- 172.21.15.57:0/2432221873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d71a90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800dbe0 tx=0x7fb3b8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db1ba11a7976fba server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.064+0000 7fb3a7fff700 1 -- 172.21.15.57:0/2432221873 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8010a70 con 0x55d542bc96b0 2023-03-02T10:57:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.064+0000 7fb3a7fff700 1 -- 172.21.15.57:0/2432221873 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3b8010bd0 con 0x55d542bc96b0 2023-03-02T10:57:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.064+0000 7fb3a7fff700 1 -- 172.21.15.57:0/2432221873 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800f620 con 0x55d542bc96b0 2023-03-02T10:57:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.065+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2432221873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 msgr2=0x55d542d71a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.065+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2432221873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d71a90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800dbe0 tx=0x7fb3b8010000 comp rx=0 tx=0).stop 2023-03-02T10:57:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.065+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2432221873 shutdown_connections 2023-03-02T10:57:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.065+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2432221873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 0x55d542d6c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.065+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2432221873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d71a90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.065+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2432221873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d6bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.065+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2432221873 >> 172.21.15.57:0/2432221873 conn(0x55d542d619a0 msgr2=0x55d542d66a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.065+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2432221873 shutdown_connections 2023-03-02T10:57:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.065+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2432221873 wait complete. 2023-03-02T10:57:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.066+0000 7fb3d7548b80 1 -- start start 2023-03-02T10:57:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.066+0000 7fb3d7548b80 1 Processor -- start 2023-03-02T10:57:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d78230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 0x55d542d75a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542cc4b60 con 0x55d542bc96b0 2023-03-02T10:57:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542cbe090 con 0x55d542d71fd0 2023-03-02T10:57:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542b428c0 con 0x55d542d72440 2023-03-02T10:57:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3d7548b80 10 client.0 _ll_register_callbacks cb 0x55d542c644c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3c199b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d78230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3c199b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d78230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50384/0 (socket says 172.21.15.57:50384) 2023-03-02T10:57:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3c199b700 1 -- 172.21.15.57:0/1425697984 learned_addr learned my addr 172.21.15.57:0/1425697984 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3c199b700 1 -- 172.21.15.57:0/1425697984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 msgr2=0x55d542d75a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-02T10:57:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.067+0000 7fb3c199b700 1 --2- 172.21.15.57:0/1425697984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 0x55d542d75a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.068+0000 7fb3c199b700 1 -- 172.21.15.57:0/1425697984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 msgr2=0x55d542d754b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-02T10:57:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.068+0000 7fb3c199b700 1 --2- 172.21.15.57:0/1425697984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d754b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.068+0000 7fb3c199b700 1 -- 172.21.15.57:0/1425697984 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b800d890 con 0x55d542bc96b0 2023-03-02T10:57:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.068+0000 7fb3c199b700 1 --2- 172.21.15.57:0/1425697984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d78230 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009f40 tx=0x7fb3b801dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bd72918e665c38 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.068+0000 7fb3a57fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.068+0000 7fb3a57fa700 1 -- 172.21.15.57:0/1425697984 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8010a70 con 0x55d542bc96b0 2023-03-02T10:57:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.068+0000 7fb3d7548b80 1 -- 172.21.15.57:0/1425697984 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d542c8f750 con 0x55d542bc96b0 2023-03-02T10:57:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.068+0000 7fb3a57fa700 1 -- 172.21.15.57:0/1425697984 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb3b802d070 con 0x55d542bc96b0 2023-03-02T10:57:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.069+0000 7fb3a57fa700 1 -- 172.21.15.57:0/1425697984 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3b801d440 con 0x55d542bc96b0 2023-03-02T10:57:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.069+0000 7fb3d7548b80 10 client.15726 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.069+0000 7fb3d7548b80 1 -- 172.21.15.57:0/1425697984 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d542aecd80 con 0x55d542bc96b0 2023-03-02T10:57:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.069+0000 7fb3a57fa700 1 -- 172.21.15.57:0/1425697984 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d542c8f750 con 0x55d542bc96b0 2023-03-02T10:57:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.069+0000 7fb3a57fa700 1 -- 172.21.15.57:0/1425697984 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fb3b8032cd0 con 0x55d542bc96b0 2023-03-02T10:57:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.069+0000 7fb3d7548b80 10 client.15726 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.069+0000 7fb3d7548b80 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.069+0000 7fb3d7548b80 20 client.15726 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.069+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/1425697984 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d542d858d0 0x55d542d87ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.069+0000 7fb3d7548b80 4 client.15726 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.069+0000 7fb3d7548b80 1 -- 172.21.15.57:0/1425697984 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d542cb7110 con 0x55d542d858d0 2023-03-02T10:57:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.070+0000 7fb3c119a700 1 --2- 172.21.15.57:0/1425697984 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d542d858d0 0x55d542d87ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.076+0000 7fb3a57fa700 10 client.15726 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:43.077 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.076+0000 7fb3c119a700 1 --2- 172.21.15.57:0/1425697984 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d542d858d0 0x55d542d87ce0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58a04720a2bbd40c server_cookie=841f67b6c328b152 in_seq=0 out_seq=0 2023-03-02T10:57:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.077+0000 7fb3a57fa700 1 -- 172.21.15.57:0/1425697984 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55d542cb7110 con 0x55d542d858d0 2023-03-02T10:57:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.077+0000 7fb3a57fa700 10 client.15726 handle_command_reply: tid=0 2023-03-02T10:57:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.077+0000 7fb3d7548b80 1 client.15726 shutdown 2023-03-02T10:57:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.077+0000 7fb3d7548b80 1 -- 172.21.15.57:0/1425697984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 msgr2=0x55d542d78230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.078+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/1425697984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d78230 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009f40 tx=0x7fb3b801dbe0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.078+0000 7fb3d7548b80 1 -- 172.21.15.57:0/1425697984 shutdown_connections 2023-03-02T10:57:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.078+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/1425697984 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d542d858d0 0x55d542d87ce0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.078+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/1425697984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 0x55d542d75a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.078+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/1425697984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d78230 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.078+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/1425697984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.078+0000 7fb3d7548b80 1 -- 172.21.15.57:0/1425697984 >> 172.21.15.57:0/1425697984 conn(0x55d542d619a0 msgr2=0x55d542d661e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.078+0000 7fb3a57fa700 0 client.15726 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.078+0000 7fb3d7548b80 1 -- 172.21.15.57:0/1425697984 shutdown_connections 2023-03-02T10:57:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.078+0000 7fb3d7548b80 1 -- 172.21.15.57:0/1425697984 wait complete. 2023-03-02T10:57:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.079+0000 7fb3d7548b80 20 client.15726 trim_cache size 0 max 16384 2023-03-02T10:57:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.101+0000 7fb3d7548b80 1 Processor -- start 2023-03-02T10:57:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.101+0000 7fb3d7548b80 1 -- start start 2023-03-02T10:57:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.101+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542bc96b0 0x55d542d66980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.101+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d77dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.101+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542d72440 0x55d542d80ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.101+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542d73a30 con 0x55d542d72440 2023-03-02T10:57:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.101+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542d8c870 con 0x55d542d71fd0 2023-03-02T10:57:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.101+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542d70140 con 0x55d542bc96b0 2023-03-02T10:57:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.101+0000 7fb3c219c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542d72440 0x55d542d80ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.101+0000 7fb3c219c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542d72440 0x55d542d80ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50386/0 (socket says 172.21.15.57:50386) 2023-03-02T10:57:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.102+0000 7fb3c219c700 1 -- 172.21.15.57:0/2141204645 learned_addr learned my addr 172.21.15.57:0/2141204645 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.102+0000 7fb3c199b700 1 --2- 172.21.15.57:0/2141204645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542bc96b0 0x55d542d66980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.102+0000 7fb3c219c700 1 -- 172.21.15.57:0/2141204645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542bc96b0 msgr2=0x55d542d66980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.102+0000 7fb3c219c700 1 --2- 172.21.15.57:0/2141204645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542bc96b0 0x55d542d66980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.102+0000 7fb3c219c700 1 -- 172.21.15.57:0/2141204645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 msgr2=0x55d542d77dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-02T10:57:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.102+0000 7fb3c219c700 1 --2- 172.21.15.57:0/2141204645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d77dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.102+0000 7fb3c219c700 1 -- 172.21.15.57:0/2141204645 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d542c85130 con 0x55d542d72440 2023-03-02T10:57:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.102+0000 7fb3c199b700 1 --2- 172.21.15.57:0/2141204645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542bc96b0 0x55d542d66980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:57:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.102+0000 7fb3c219c700 1 --2- 172.21.15.57:0/2141204645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542d72440 0x55d542d80ef0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4009fd0 tx=0x7fb3b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea452c121d8fb5a4 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.103+0000 7fb3b0bff700 1 -- 172.21.15.57:0/2141204645 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b400e040 con 0x55d542d72440 2023-03-02T10:57:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.103+0000 7fb3b0bff700 1 -- 172.21.15.57:0/2141204645 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3b400bcb0 con 0x55d542d72440 2023-03-02T10:57:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.103+0000 7fb3b0bff700 1 -- 172.21.15.57:0/2141204645 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40052a0 con 0x55d542d72440 2023-03-02T10:57:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.104+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2141204645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542d72440 msgr2=0x55d542d80ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.104+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2141204645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542d72440 0x55d542d80ef0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4009fd0 tx=0x7fb3b4009c00 comp rx=0 tx=0).stop 2023-03-02T10:57:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.104+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2141204645 shutdown_connections 2023-03-02T10:57:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.104+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2141204645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542d72440 0x55d542d80ef0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.104+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2141204645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542bc96b0 0x55d542d66980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.104+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2141204645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d77dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.104+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2141204645 >> 172.21.15.57:0/2141204645 conn(0x55d542d619a0 msgr2=0x55d542d6c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.104+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2141204645 shutdown_connections 2023-03-02T10:57:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.104+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2141204645 wait complete. 2023-03-02T10:57:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.105+0000 7fb3d7548b80 1 -- start start 2023-03-02T10:57:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.105+0000 7fb3d7548b80 1 Processor -- start 2023-03-02T10:57:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.105+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d6d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.106+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d6da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.106+0000 7fb3d7548b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 0x55d542d6df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.106+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542d6e4d0 con 0x55d542bc96b0 2023-03-02T10:57:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.106+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542d6e610 con 0x55d542d71fd0 2023-03-02T10:57:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.106+0000 7fb3d7548b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d542d6e7d0 con 0x55d542d72440 2023-03-02T10:57:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.106+0000 7fb3d7548b80 10 client.0 _ll_register_callbacks cb 0x55d542c644c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.106+0000 7fb3c199b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d6d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.106+0000 7fb3c199b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d6d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50396/0 (socket says 172.21.15.57:50396) 2023-03-02T10:57:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.106+0000 7fb3c199b700 1 -- 172.21.15.57:0/2265661323 learned_addr learned my addr 172.21.15.57:0/2265661323 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.106+0000 7fb3c219c700 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 0x55d542d6df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.107+0000 7fb3c199b700 1 -- 172.21.15.57:0/2265661323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 msgr2=0x55d542d6df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.107+0000 7fb3c199b700 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 0x55d542d6df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.107+0000 7fb3c199b700 1 -- 172.21.15.57:0/2265661323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 msgr2=0x55d542d6da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.107+0000 7fb3c199b700 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d6da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.107+0000 7fb3c199b700 1 -- 172.21.15.57:0/2265661323 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc10f380 con 0x55d542bc96b0 2023-03-02T10:57:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.107+0000 7fb3c199b700 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d6d510 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8011e90 tx=0x7fb3b8005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11511bcb82ab7ebd server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.107+0000 7fb3a57fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.108+0000 7fb3a57fa700 1 -- 172.21.15.57:0/2265661323 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8040070 con 0x55d542bc96b0 2023-03-02T10:57:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.108+0000 7fb3a57fa700 1 -- 172.21.15.57:0/2265661323 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb3b802d040 con 0x55d542bc96b0 2023-03-02T10:57:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.108+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2265661323 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3b8010bd0 con 0x55d542bc96b0 2023-03-02T10:57:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.109+0000 7fb3a57fa700 1 -- 172.21.15.57:0/2265661323 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3b803b770 con 0x55d542bc96b0 2023-03-02T10:57:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.109+0000 7fb3d7548b80 10 client.15732 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.109+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2265661323 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d542b131f0 con 0x55d542bc96b0 2023-03-02T10:57:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.109+0000 7fb3a57fa700 1 -- 172.21.15.57:0/2265661323 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3b8010bd0 con 0x55d542bc96b0 2023-03-02T10:57:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.109+0000 7fb3a57fa700 1 -- 172.21.15.57:0/2265661323 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fb3b8043020 con 0x55d542bc96b0 2023-03-02T10:57:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.109+0000 7fb3d7548b80 10 client.15732 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.109+0000 7fb3d7548b80 10 client.15732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.109+0000 7fb3d7548b80 20 client.15732 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.109+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d542dd7a40 0x55d542dd9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.109+0000 7fb3d7548b80 4 client.15732 mds_command: new command op to 24560 tid=0[{"prefix": "flush journal"}] 2023-03-02T10:57:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.109+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2265661323 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d542cb6e30 con 0x55d542dd7a40 2023-03-02T10:57:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.111+0000 7fb3c119a700 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d542dd7a40 0x55d542dd9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:43.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.114+0000 7fb3a57fa700 10 client.15732 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:43.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.114+0000 7fb3c119a700 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d542dd7a40 0x55d542dd9e50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cca432d2ad7bcabf server_cookie=a21b09c1b1d189e7 in_seq=0 out_seq=0 2023-03-02T10:57:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.170+0000 7fb3a57fa700 1 -- 172.21.15.57:0/2265661323 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d542cb6e30 con 0x55d542dd7a40 2023-03-02T10:57:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.170+0000 7fb3a57fa700 10 client.15732 handle_command_reply: tid=0 2023-03-02T10:57:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.170+0000 7fb3d7548b80 1 client.15732 shutdown 2023-03-02T10:57:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.170+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2265661323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 msgr2=0x55d542d6d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.170+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d6d510 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8011e90 tx=0x7fb3b8005d20 comp rx=0 tx=0).stop 2023-03-02T10:57:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.171+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2265661323 shutdown_connections 2023-03-02T10:57:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.171+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d542dd7a40 0x55d542dd9e50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.171+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d542d72440 0x55d542d6df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.171+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d542bc96b0 0x55d542d6d510 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.171+0000 7fb3d7548b80 1 --2- 172.21.15.57:0/2265661323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d542d71fd0 0x55d542d6da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.171+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2265661323 >> 172.21.15.57:0/2265661323 conn(0x55d542d619a0 msgr2=0x55d542d72810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.171+0000 7fb3a57fa700 0 client.15732 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.171+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2265661323 shutdown_connections 2023-03-02T10:57:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.171+0000 7fb3d7548b80 1 -- 172.21.15.57:0/2265661323 wait complete. 2023-03-02T10:57:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.172+0000 7fb3d7548b80 20 client.15732 trim_cache size 0 max 16384 2023-03-02T10:57:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:{ 2023-03-02T10:57:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "message": "", 2023-03-02T10:57:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "return_code": 0 2023-03-02T10:57:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:} 2023-03-02T10:57:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.172+0000 7fb3c3bff700 1 -- 172.21.15.57:0/3224249812 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb3a809b540 msgr2=0x7fb3a809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.172+0000 7fb3c3bff700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb3a809b540 0x7fb3a809d9f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8005950 tx=0x7fb3b80058e0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.172+0000 7fb3c3bff700 1 -- 172.21.15.57:0/3224249812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3bc073240 msgr2=0x7fb3bc109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.172+0000 7fb3c3bff700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3bc073240 0x7fb3bc109a90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00e9a0 tx=0x7fb3ac00ed60 comp rx=0 tx=0).stop 2023-03-02T10:57:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.173+0000 7fb3c3bff700 1 -- 172.21.15.57:0/3224249812 shutdown_connections 2023-03-02T10:57:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.173+0000 7fb3c3bff700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb3a809b540 0x7fb3a809d9f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.173+0000 7fb3c3bff700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3bc10c300 0x7fb3bc109fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.173+0000 7fb3c3bff700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3bc072930 0x7fb3bc10ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.173+0000 7fb3c3bff700 1 --2- 172.21.15.57:0/3224249812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3bc073240 0x7fb3bc109a90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.173+0000 7fb3c3bff700 1 -- 172.21.15.57:0/3224249812 >> 172.21.15.57:0/3224249812 conn(0x7fb3bc0fb600 msgr2=0x7fb3bc100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.173+0000 7fb3c3bff700 1 -- 172.21.15.57:0/3224249812 shutdown_connections 2023-03-02T10:57:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:43.173+0000 7fb3c3bff700 1 -- 172.21.15.57:0/3224249812 wait complete. 2023-03-02T10:57:43.233 INFO:teuthology.orchestra.run.smithi057.stderr:17700000 of 50000000 tuples (35%) done (elapsed 28.04 s, remaining 51.16 s) 2023-03-02T10:57:43.685 INFO:teuthology.orchestra.run.smithi057.stderr:17800000 of 50000000 tuples (35%) done (elapsed 28.49 s, remaining 51.54 s) 2023-03-02T10:57:43.813 INFO:teuthology.orchestra.run.smithi057.stderr:17900000 of 50000000 tuples (35%) done (elapsed 28.62 s, remaining 51.32 s) 2023-03-02T10:57:43.910 INFO:teuthology.orchestra.run.smithi057.stderr:18000000 of 50000000 tuples (36%) done (elapsed 28.71 s, remaining 51.05 s) 2023-03-02T10:57:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:43 smithi057 ceph-mon[92072]: pgmap v24: 97 pgs: 97 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 205 MiB/s wr, 134 op/s 2023-03-02T10:57:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:43 smithi122 ceph-mon[125440]: pgmap v24: 97 pgs: 97 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 205 MiB/s wr, 134 op/s 2023-03-02T10:57:44.040 INFO:teuthology.orchestra.run.smithi057.stderr:18100000 of 50000000 tuples (36%) done (elapsed 28.85 s, remaining 50.84 s) 2023-03-02T10:57:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:43 smithi136 ceph-mon[125702]: pgmap v24: 97 pgs: 97 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 205 MiB/s wr, 134 op/s 2023-03-02T10:57:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:18200000 of 50000000 tuples (36%) done (elapsed 28.96 s, remaining 50.59 s) 2023-03-02T10:57:44.278 INFO:teuthology.orchestra.run.smithi057.stderr:18300000 of 50000000 tuples (36%) done (elapsed 29.08 s, remaining 50.38 s) 2023-03-02T10:57:44.425 INFO:teuthology.orchestra.run.smithi057.stderr:18400000 of 50000000 tuples (36%) done (elapsed 29.23 s, remaining 50.20 s) 2023-03-02T10:57:44.542 INFO:teuthology.orchestra.run.smithi057.stderr:18500000 of 50000000 tuples (37%) done (elapsed 29.35 s, remaining 49.97 s) 2023-03-02T10:57:44.668 INFO:teuthology.orchestra.run.smithi057.stderr:18600000 of 50000000 tuples (37%) done (elapsed 29.47 s, remaining 49.76 s) 2023-03-02T10:57:44.793 INFO:teuthology.orchestra.run.smithi057.stderr:18700000 of 50000000 tuples (37%) done (elapsed 29.60 s, remaining 49.54 s) 2023-03-02T10:57:44.896 INFO:teuthology.orchestra.run.smithi057.stderr:18800000 of 50000000 tuples (37%) done (elapsed 29.70 s, remaining 49.29 s) 2023-03-02T10:57:45.035 INFO:teuthology.orchestra.run.smithi057.stderr:18900000 of 50000000 tuples (37%) done (elapsed 29.84 s, remaining 49.10 s) 2023-03-02T10:57:45.157 INFO:teuthology.orchestra.run.smithi057.stderr:19000000 of 50000000 tuples (38%) done (elapsed 29.96 s, remaining 48.89 s) 2023-03-02T10:57:45.260 INFO:teuthology.orchestra.run.smithi057.stderr:19100000 of 50000000 tuples (38%) done (elapsed 30.07 s, remaining 48.64 s) 2023-03-02T10:57:45.385 INFO:teuthology.orchestra.run.smithi057.stderr:19200000 of 50000000 tuples (38%) done (elapsed 30.19 s, remaining 48.43 s) 2023-03-02T10:57:45.503 INFO:teuthology.orchestra.run.smithi057.stderr:19300000 of 50000000 tuples (38%) done (elapsed 30.31 s, remaining 48.21 s) 2023-03-02T10:57:45.612 INFO:teuthology.orchestra.run.smithi057.stderr:19400000 of 50000000 tuples (38%) done (elapsed 30.42 s, remaining 47.98 s) 2023-03-02T10:57:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:19500000 of 50000000 tuples (39%) done (elapsed 30.54 s, remaining 47.77 s) 2023-03-02T10:57:45.845 INFO:teuthology.orchestra.run.smithi057.stderr:19600000 of 50000000 tuples (39%) done (elapsed 30.65 s, remaining 47.54 s) 2023-03-02T10:57:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:45 smithi057 ceph-mon[92072]: pgmap v25: 97 pgs: 97 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 154 MiB/s wr, 81 op/s 2023-03-02T10:57:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:45 smithi122 ceph-mon[125440]: pgmap v25: 97 pgs: 97 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 154 MiB/s wr, 81 op/s 2023-03-02T10:57:45.955 INFO:teuthology.orchestra.run.smithi057.stderr:19700000 of 50000000 tuples (39%) done (elapsed 30.76 s, remaining 47.31 s) 2023-03-02T10:57:46.077 INFO:teuthology.orchestra.run.smithi057.stderr:19800000 of 50000000 tuples (39%) done (elapsed 30.88 s, remaining 47.10 s) 2023-03-02T10:57:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:45 smithi136 ceph-mon[125702]: pgmap v25: 97 pgs: 97 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 154 MiB/s wr, 81 op/s 2023-03-02T10:57:46.180 INFO:teuthology.orchestra.run.smithi057.stderr:19900000 of 50000000 tuples (39%) done (elapsed 30.98 s, remaining 46.87 s) 2023-03-02T10:57:46.311 INFO:teuthology.orchestra.run.smithi057.stderr:20000000 of 50000000 tuples (40%) done (elapsed 31.12 s, remaining 46.67 s) 2023-03-02T10:57:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:20100000 of 50000000 tuples (40%) done (elapsed 31.24 s, remaining 46.47 s) 2023-03-02T10:57:46.533 INFO:teuthology.orchestra.run.smithi057.stderr:20200000 of 50000000 tuples (40%) done (elapsed 31.34 s, remaining 46.23 s) 2023-03-02T10:57:46.689 INFO:teuthology.orchestra.run.smithi057.stderr:20300000 of 50000000 tuples (40%) done (elapsed 31.49 s, remaining 46.08 s) 2023-03-02T10:57:46.775 INFO:teuthology.orchestra.run.smithi057.stderr:20400000 of 50000000 tuples (40%) done (elapsed 31.58 s, remaining 45.82 s) 2023-03-02T10:57:46.917 INFO:teuthology.orchestra.run.smithi057.stderr:20500000 of 50000000 tuples (41%) done (elapsed 31.72 s, remaining 45.65 s) 2023-03-02T10:57:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:20600000 of 50000000 tuples (41%) done (elapsed 31.86 s, remaining 45.47 s) 2023-03-02T10:57:47.163 INFO:teuthology.orchestra.run.smithi057.stderr:20700000 of 50000000 tuples (41%) done (elapsed 31.97 s, remaining 45.25 s) 2023-03-02T10:57:47.286 INFO:teuthology.orchestra.run.smithi057.stderr:20800000 of 50000000 tuples (41%) done (elapsed 32.09 s, remaining 45.05 s) 2023-03-02T10:57:47.392 INFO:teuthology.orchestra.run.smithi057.stderr:20900000 of 50000000 tuples (41%) done (elapsed 32.20 s, remaining 44.83 s) 2023-03-02T10:57:47.496 INFO:teuthology.orchestra.run.smithi057.stderr:21000000 of 50000000 tuples (42%) done (elapsed 32.30 s, remaining 44.61 s) 2023-03-02T10:57:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:21100000 of 50000000 tuples (42%) done (elapsed 32.43 s, remaining 44.42 s) 2023-03-02T10:57:47.743 INFO:teuthology.orchestra.run.smithi057.stderr:21200000 of 50000000 tuples (42%) done (elapsed 32.55 s, remaining 44.22 s) 2023-03-02T10:57:47.847 INFO:teuthology.orchestra.run.smithi057.stderr:21300000 of 50000000 tuples (42%) done (elapsed 32.65 s, remaining 44.00 s) 2023-03-02T10:57:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:47 smithi057 ceph-mon[92072]: pgmap v26: 97 pgs: 97 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 154 MiB/s wr, 81 op/s 2023-03-02T10:57:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:47 smithi122 ceph-mon[125440]: pgmap v26: 97 pgs: 97 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 154 MiB/s wr, 81 op/s 2023-03-02T10:57:47.972 INFO:teuthology.orchestra.run.smithi057.stderr:21400000 of 50000000 tuples (42%) done (elapsed 32.78 s, remaining 43.81 s) 2023-03-02T10:57:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:47 smithi136 ceph-mon[125702]: pgmap v26: 97 pgs: 97 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 154 MiB/s wr, 81 op/s 2023-03-02T10:57:48.118 INFO:teuthology.orchestra.run.smithi057.stderr:21500000 of 50000000 tuples (43%) done (elapsed 32.92 s, remaining 43.64 s) 2023-03-02T10:57:48.724 INFO:teuthology.orchestra.run.smithi057.stderr:21600000 of 50000000 tuples (43%) done (elapsed 33.53 s, remaining 44.08 s) 2023-03-02T10:57:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:21700000 of 50000000 tuples (43%) done (elapsed 33.66 s, remaining 43.90 s) 2023-03-02T10:57:48.964 INFO:teuthology.orchestra.run.smithi057.stderr:21800000 of 50000000 tuples (43%) done (elapsed 33.77 s, remaining 43.68 s) 2023-03-02T10:57:49.083 INFO:teuthology.orchestra.run.smithi057.stderr:21900000 of 50000000 tuples (43%) done (elapsed 33.89 s, remaining 43.48 s) 2023-03-02T10:57:49.197 INFO:teuthology.orchestra.run.smithi057.stderr:22000000 of 50000000 tuples (44%) done (elapsed 34.00 s, remaining 43.28 s) 2023-03-02T10:57:49.348 INFO:teuthology.orchestra.run.smithi057.stderr:22100000 of 50000000 tuples (44%) done (elapsed 34.15 s, remaining 43.12 s) 2023-03-02T10:57:49.465 INFO:teuthology.orchestra.run.smithi057.stderr:22200000 of 50000000 tuples (44%) done (elapsed 34.27 s, remaining 42.92 s) 2023-03-02T10:57:49.595 INFO:teuthology.orchestra.run.smithi057.stderr:22300000 of 50000000 tuples (44%) done (elapsed 34.40 s, remaining 42.73 s) 2023-03-02T10:57:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:22400000 of 50000000 tuples (44%) done (elapsed 34.50 s, remaining 42.51 s) 2023-03-02T10:57:49.825 INFO:teuthology.orchestra.run.smithi057.stderr:22500000 of 50000000 tuples (45%) done (elapsed 34.63 s, remaining 42.33 s) 2023-03-02T10:57:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:49 smithi136 ceph-mon[125702]: pgmap v27: 97 pgs: 97 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 230 MiB/s wr, 132 op/s 2023-03-02T10:57:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:49 smithi057 ceph-mon[92072]: pgmap v27: 97 pgs: 97 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 230 MiB/s wr, 132 op/s 2023-03-02T10:57:49.944 INFO:teuthology.orchestra.run.smithi057.stderr:22600000 of 50000000 tuples (45%) done (elapsed 34.75 s, remaining 42.13 s) 2023-03-02T10:57:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:49 smithi122 ceph-mon[125440]: pgmap v27: 97 pgs: 97 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 230 MiB/s wr, 132 op/s 2023-03-02T10:57:50.069 INFO:teuthology.orchestra.run.smithi057.stderr:22700000 of 50000000 tuples (45%) done (elapsed 34.87 s, remaining 41.94 s) 2023-03-02T10:57:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:22800000 of 50000000 tuples (45%) done (elapsed 35.00 s, remaining 41.76 s) 2023-03-02T10:57:50.297 INFO:teuthology.orchestra.run.smithi057.stderr:22900000 of 50000000 tuples (45%) done (elapsed 35.10 s, remaining 41.54 s) 2023-03-02T10:57:50.426 INFO:teuthology.orchestra.run.smithi057.stderr:23000000 of 50000000 tuples (46%) done (elapsed 35.23 s, remaining 41.36 s) 2023-03-02T10:57:50.537 INFO:teuthology.orchestra.run.smithi057.stderr:23100000 of 50000000 tuples (46%) done (elapsed 35.34 s, remaining 41.16 s) 2023-03-02T10:57:50.689 INFO:teuthology.orchestra.run.smithi057.stderr:23200000 of 50000000 tuples (46%) done (elapsed 35.49 s, remaining 41.00 s) 2023-03-02T10:57:50.788 INFO:teuthology.orchestra.run.smithi057.stderr:23300000 of 50000000 tuples (46%) done (elapsed 35.59 s, remaining 40.79 s) 2023-03-02T10:57:50.912 INFO:teuthology.orchestra.run.smithi057.stderr:23400000 of 50000000 tuples (46%) done (elapsed 35.72 s, remaining 40.60 s) 2023-03-02T10:57:51.032 INFO:teuthology.orchestra.run.smithi057.stderr:23500000 of 50000000 tuples (47%) done (elapsed 35.84 s, remaining 40.41 s) 2023-03-02T10:57:51.142 INFO:teuthology.orchestra.run.smithi057.stderr:23600000 of 50000000 tuples (47%) done (elapsed 35.95 s, remaining 40.21 s) 2023-03-02T10:57:51.264 INFO:teuthology.orchestra.run.smithi057.stderr:23700000 of 50000000 tuples (47%) done (elapsed 36.07 s, remaining 40.03 s) 2023-03-02T10:57:51.390 INFO:teuthology.orchestra.run.smithi057.stderr:23800000 of 50000000 tuples (47%) done (elapsed 36.20 s, remaining 39.85 s) 2023-03-02T10:57:51.518 INFO:teuthology.orchestra.run.smithi057.stderr:23900000 of 50000000 tuples (47%) done (elapsed 36.32 s, remaining 39.67 s) 2023-03-02T10:57:51.632 INFO:teuthology.orchestra.run.smithi057.stderr:24000000 of 50000000 tuples (48%) done (elapsed 36.44 s, remaining 39.47 s) 2023-03-02T10:57:51.740 INFO:teuthology.orchestra.run.smithi057.stderr:24100000 of 50000000 tuples (48%) done (elapsed 36.54 s, remaining 39.27 s) 2023-03-02T10:57:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:24200000 of 50000000 tuples (48%) done (elapsed 36.70 s, remaining 39.13 s) 2023-03-02T10:57:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:51 smithi057 ceph-mon[92072]: pgmap v28: 97 pgs: 97 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 151 MiB/s wr, 86 op/s 2023-03-02T10:57:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:51 smithi122 ceph-mon[125440]: pgmap v28: 97 pgs: 97 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 151 MiB/s wr, 86 op/s 2023-03-02T10:57:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:24300000 of 50000000 tuples (48%) done (elapsed 36.84 s, remaining 38.96 s) 2023-03-02T10:57:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:51 smithi136 ceph-mon[125702]: pgmap v28: 97 pgs: 97 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 151 MiB/s wr, 86 op/s 2023-03-02T10:57:52.151 INFO:teuthology.orchestra.run.smithi057.stderr:24400000 of 50000000 tuples (48%) done (elapsed 36.96 s, remaining 38.77 s) 2023-03-02T10:57:52.280 INFO:teuthology.orchestra.run.smithi057.stderr:24500000 of 50000000 tuples (49%) done (elapsed 37.09 s, remaining 38.60 s) 2023-03-02T10:57:52.419 INFO:teuthology.orchestra.run.smithi057.stderr:24600000 of 50000000 tuples (49%) done (elapsed 37.22 s, remaining 38.43 s) 2023-03-02T10:57:52.526 INFO:teuthology.orchestra.run.smithi057.stderr:24700000 of 50000000 tuples (49%) done (elapsed 37.33 s, remaining 38.24 s) 2023-03-02T10:57:52.663 INFO:teuthology.orchestra.run.smithi057.stderr:24800000 of 50000000 tuples (49%) done (elapsed 37.47 s, remaining 38.07 s) 2023-03-02T10:57:52.748 INFO:teuthology.orchestra.run.smithi057.stderr:24900000 of 50000000 tuples (49%) done (elapsed 37.55 s, remaining 37.85 s) 2023-03-02T10:57:52.906 INFO:teuthology.orchestra.run.smithi057.stderr:25000000 of 50000000 tuples (50%) done (elapsed 37.71 s, remaining 37.71 s) 2023-03-02T10:57:53.049 INFO:teuthology.orchestra.run.smithi057.stderr:25100000 of 50000000 tuples (50%) done (elapsed 37.85 s, remaining 37.55 s) 2023-03-02T10:57:53.139 INFO:teuthology.orchestra.run.smithi057.stderr:25200000 of 50000000 tuples (50%) done (elapsed 37.94 s, remaining 37.34 s) 2023-03-02T10:57:53.254 INFO:teuthology.orchestra.run.smithi057.stderr:25300000 of 50000000 tuples (50%) done (elapsed 38.06 s, remaining 37.16 s) 2023-03-02T10:57:53.361 INFO:teuthology.orchestra.run.smithi057.stderr:25400000 of 50000000 tuples (50%) done (elapsed 38.17 s, remaining 36.96 s) 2023-03-02T10:57:53.487 INFO:teuthology.orchestra.run.smithi057.stderr:25500000 of 50000000 tuples (51%) done (elapsed 38.29 s, remaining 36.79 s) 2023-03-02T10:57:53.910 INFO:teuthology.orchestra.run.smithi057.stderr:25600000 of 50000000 tuples (51%) done (elapsed 38.71 s, remaining 36.90 s) 2023-03-02T10:57:53.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:53 smithi057 ceph-mon[92072]: pgmap v29: 97 pgs: 97 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 224 MiB/s wr, 122 op/s 2023-03-02T10:57:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:53 smithi122 ceph-mon[125440]: pgmap v29: 97 pgs: 97 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 224 MiB/s wr, 122 op/s 2023-03-02T10:57:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:53 smithi136 ceph-mon[125702]: pgmap v29: 97 pgs: 97 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 224 MiB/s wr, 122 op/s 2023-03-02T10:57:54.361 INFO:teuthology.orchestra.run.smithi057.stderr:25700000 of 50000000 tuples (51%) done (elapsed 39.17 s, remaining 37.03 s) 2023-03-02T10:57:54.482 INFO:teuthology.orchestra.run.smithi057.stderr:25800000 of 50000000 tuples (51%) done (elapsed 39.29 s, remaining 36.85 s) 2023-03-02T10:57:54.594 INFO:teuthology.orchestra.run.smithi057.stderr:25900000 of 50000000 tuples (51%) done (elapsed 39.40 s, remaining 36.66 s) 2023-03-02T10:57:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:26000000 of 50000000 tuples (52%) done (elapsed 39.55 s, remaining 36.51 s) 2023-03-02T10:57:54.847 INFO:teuthology.orchestra.run.smithi057.stderr:26100000 of 50000000 tuples (52%) done (elapsed 39.65 s, remaining 36.31 s) 2023-03-02T10:57:54.863 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T10:57:54.974 INFO:teuthology.orchestra.run.smithi057.stderr:26200000 of 50000000 tuples (52%) done (elapsed 39.78 s, remaining 36.14 s) 2023-03-02T10:57:55.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.034+0000 7fd94cbff700 1 -- 172.21.15.57:0/2734805658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9480731e0 msgr2=0x7fd94810be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.034+0000 7fd94cbff700 1 --2- 172.21.15.57:0/2734805658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9480731e0 0x7fd94810be10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009990 tx=0x7fd93c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.034+0000 7fd94cbff700 1 -- 172.21.15.57:0/2734805658 shutdown_connections 2023-03-02T10:57:55.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.034+0000 7fd94cbff700 1 --2- 172.21.15.57:0/2734805658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd94810c350 0x7fd94810e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.034+0000 7fd94cbff700 1 --2- 172.21.15.57:0/2734805658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9480728d0 0x7fd948072ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.034+0000 7fd94cbff700 1 --2- 172.21.15.57:0/2734805658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9480731e0 0x7fd94810be10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.034+0000 7fd94cbff700 1 -- 172.21.15.57:0/2734805658 >> 172.21.15.57:0/2734805658 conn(0x7fd9480fb610 msgr2=0x7fd9480fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.034+0000 7fd94cbff700 1 -- 172.21.15.57:0/2734805658 shutdown_connections 2023-03-02T10:57:55.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.034+0000 7fd94cbff700 1 -- 172.21.15.57:0/2734805658 wait complete. 2023-03-02T10:57:55.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd94cbff700 1 Processor -- start 2023-03-02T10:57:55.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd94cbff700 1 -- start start 2023-03-02T10:57:55.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd94cbff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9480728d0 0x7fd948197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd94cbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9480731e0 0x7fd948198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd94cbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd94810c350 0x7fd94819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd94cbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94819ce10 con 0x7fd9480731e0 2023-03-02T10:57:55.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd94cbff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94819cf80 con 0x7fd9480728d0 2023-03-02T10:57:55.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd94cbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94819d140 con 0x7fd94810c350 2023-03-02T10:57:55.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd945d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9480731e0 0x7fd948198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd945d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9480731e0 0x7fd948198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49968/0 (socket says 172.21.15.57:49968) 2023-03-02T10:57:55.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd945d9b700 1 -- 172.21.15.57:0/567375274 learned_addr learned my addr 172.21.15.57:0/567375274 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd946d9d700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd94810c350 0x7fd94819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.035+0000 7fd94659c700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9480728d0 0x7fd948197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.036+0000 7fd945d9b700 1 -- 172.21.15.57:0/567375274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd94810c350 msgr2=0x7fd94819c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.036+0000 7fd945d9b700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd94810c350 0x7fd94819c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.036+0000 7fd945d9b700 1 -- 172.21.15.57:0/567375274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9480728d0 msgr2=0x7fd948197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.036+0000 7fd945d9b700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9480728d0 0x7fd948197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.036+0000 7fd945d9b700 1 -- 172.21.15.57:0/567375274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c0095f0 con 0x7fd9480731e0 2023-03-02T10:57:55.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.036+0000 7fd945d9b700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9480731e0 0x7fd948198370 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd93c005910 tx=0x7fd93c004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.036+0000 7fd9377fe700 1 -- 172.21.15.57:0/567375274 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c01d070 con 0x7fd9480731e0 2023-03-02T10:57:55.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.036+0000 7fd9377fe700 1 -- 172.21.15.57:0/567375274 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd93c022470 con 0x7fd9480731e0 2023-03-02T10:57:55.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.036+0000 7fd9377fe700 1 -- 172.21.15.57:0/567375274 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c017650 con 0x7fd9480731e0 2023-03-02T10:57:55.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.036+0000 7fd94cbff700 1 -- 172.21.15.57:0/567375274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd948111d80 con 0x7fd9480731e0 2023-03-02T10:57:55.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.036+0000 7fd94cbff700 1 -- 172.21.15.57:0/567375274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd948111bf0 con 0x7fd9480731e0 2023-03-02T10:57:55.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.039+0000 7fd9377fe700 1 -- 172.21.15.57:0/567375274 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7fd93c029030 con 0x7fd9480731e0 2023-03-02T10:57:55.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.040+0000 7fd9377fe700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd93009b4c0 0x7fd93009d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.040+0000 7fd9377fe700 1 -- 172.21.15.57:0/567375274 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd93c0c62c0 con 0x7fd9480731e0 2023-03-02T10:57:55.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.040+0000 7fd960430b80 1 Processor -- start 2023-03-02T10:57:55.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.040+0000 7fd94659c700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd93009b4c0 0x7fd93009d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.040+0000 7fd960430b80 1 -- start start 2023-03-02T10:57:55.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd960430b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 0x55e9902de790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd960430b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902decd0 0x55e9902e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd960430b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902e3110 0x55e9902e3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd960430b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e990245a60 con 0x55e9902de3c0 2023-03-02T10:57:55.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd960430b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9901f7f80 con 0x55e9902decd0 2023-03-02T10:57:55.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd960430b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9901c8160 con 0x55e9902e3110 2023-03-02T10:57:55.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd945d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902decd0 0x55e9902e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd94659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 0x55e9902de790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd945d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902decd0 0x55e9902e2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:34128/0 (socket says 172.21.15.57:34128) 2023-03-02T10:57:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd945d9b700 1 -- 172.21.15.57:0/2714806120 learned_addr learned my addr 172.21.15.57:0/2714806120 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd946d9d700 1 --2- 172.21.15.57:0/2714806120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902e3110 0x55e9902e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd94659c700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd93009b4c0 0x7fd93009d970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd938009c60 tx=0x7fd938009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd945d9b700 1 -- 172.21.15.57:0/2714806120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902e3110 msgr2=0x55e9902e3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd945d9b700 1 --2- 172.21.15.57:0/2714806120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902e3110 0x55e9902e3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd945d9b700 1 -- 172.21.15.57:0/2714806120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 msgr2=0x55e9902de790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd945d9b700 1 --2- 172.21.15.57:0/2714806120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 0x55e9902de790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd945d9b700 1 -- 172.21.15.57:0/2714806120 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9900b2630 con 0x55e9902decd0 2023-03-02T10:57:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd946d9d700 1 --2- 172.21.15.57:0/2714806120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902e3110 0x55e9902e3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.041+0000 7fd945d9b700 1 --2- 172.21.15.57:0/2714806120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902decd0 0x55e9902e2bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00b520 tx=0x7fd93c022cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e8e8ba106a9cb3f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.042+0000 7fd934ff9700 1 -- 172.21.15.57:0/2714806120 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0950d0 con 0x55e9902decd0 2023-03-02T10:57:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.042+0000 7fd934ff9700 1 -- 172.21.15.57:0/2714806120 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd93c095e70 con 0x55e9902decd0 2023-03-02T10:57:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.042+0000 7fd934ff9700 1 -- 172.21.15.57:0/2714806120 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c099180 con 0x55e9902decd0 2023-03-02T10:57:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.042+0000 7fd960430b80 1 -- 172.21.15.57:0/2714806120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902decd0 msgr2=0x55e9902e2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.042+0000 7fd960430b80 1 --2- 172.21.15.57:0/2714806120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902decd0 0x55e9902e2bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00b520 tx=0x7fd93c022cd0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.042+0000 7fd960430b80 1 -- 172.21.15.57:0/2714806120 shutdown_connections 2023-03-02T10:57:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.042+0000 7fd960430b80 1 --2- 172.21.15.57:0/2714806120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902e3110 0x55e9902e3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.042+0000 7fd960430b80 1 --2- 172.21.15.57:0/2714806120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 0x55e9902de790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.042+0000 7fd960430b80 1 --2- 172.21.15.57:0/2714806120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902decd0 0x55e9902e2bd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.043+0000 7fd960430b80 1 -- 172.21.15.57:0/2714806120 >> 172.21.15.57:0/2714806120 conn(0x55e9902d3c50 msgr2=0x55e9902d9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.043+0000 7fd960430b80 1 -- 172.21.15.57:0/2714806120 shutdown_connections 2023-03-02T10:57:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.043+0000 7fd960430b80 1 -- 172.21.15.57:0/2714806120 wait complete. 2023-03-02T10:57:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.043+0000 7fd960430b80 1 -- start start 2023-03-02T10:57:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.043+0000 7fd960430b80 1 Processor -- start 2023-03-02T10:57:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.043+0000 7fd960430b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902de3c0 0x55e9902ea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.043+0000 7fd960430b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 0x55e9902e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.043+0000 7fd960430b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 0x55e9902e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.043+0000 7fd960430b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e990236bc0 con 0x55e9902decd0 2023-03-02T10:57:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.043+0000 7fd960430b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9902300f0 con 0x55e9902e3110 2023-03-02T10:57:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.043+0000 7fd960430b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9900b4920 con 0x55e9902de3c0 2023-03-02T10:57:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd960430b80 10 client.0 _ll_register_callbacks cb 0x55e9901d6520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd945d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 0x55e9902e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd946d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 0x55e9902e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd945d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 0x55e9902e7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49972/0 (socket says 172.21.15.57:49972) 2023-03-02T10:57:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd945d9b700 1 -- 172.21.15.57:0/3721228541 learned_addr learned my addr 172.21.15.57:0/3721228541 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd94659c700 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902de3c0 0x55e9902ea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd946d9d700 1 -- 172.21.15.57:0/3721228541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902de3c0 msgr2=0x55e9902ea7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd946d9d700 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902de3c0 0x55e9902ea7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd946d9d700 1 -- 172.21.15.57:0/3721228541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 msgr2=0x55e9902e7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd946d9d700 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 0x55e9902e7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd946d9d700 1 -- 172.21.15.57:0/3721228541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd948111bf0 con 0x55e9902e3110 2023-03-02T10:57:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd946d9d700 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 0x55e9902e7ff0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd9480749a0 tx=0x7fd940007bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=239ab49c7524f28f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.044+0000 7fd92dffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.045+0000 7fd92dffb700 1 -- 172.21.15.57:0/3721228541 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94000e040 con 0x55e9902e3110 2023-03-02T10:57:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.045+0000 7fd960430b80 1 -- 172.21.15.57:0/3721228541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9902017b0 con 0x55e9902e3110 2023-03-02T10:57:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.045+0000 7fd92dffb700 1 -- 172.21.15.57:0/3721228541 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd940004db0 con 0x55e9902e3110 2023-03-02T10:57:55.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.045+0000 7fd92dffb700 1 -- 172.21.15.57:0/3721228541 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd940003a00 con 0x55e9902e3110 2023-03-02T10:57:55.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.045+0000 7fd960430b80 10 client.25595 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:55.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.045+0000 7fd960430b80 1 -- 172.21.15.57:0/3721228541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55e99005ede0 con 0x55e9902e3110 2023-03-02T10:57:55.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.045+0000 7fd92dffb700 1 -- 172.21.15.57:0/3721228541 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e9902017b0 con 0x55e9902e3110 2023-03-02T10:57:55.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.045+0000 7fd92dffb700 1 -- 172.21.15.57:0/3721228541 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fd94001e020 con 0x55e9902e3110 2023-03-02T10:57:55.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.046+0000 7fd960430b80 10 client.25595 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:55.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.046+0000 7fd960430b80 10 client.25595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:55.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.046+0000 7fd960430b80 20 client.25595 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:55.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.046+0000 7fd960430b80 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55e9902f7f50 0x55e9902fa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.046+0000 7fd960430b80 4 client.25595 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:55.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.046+0000 7fd960430b80 1 -- 172.21.15.57:0/3721228541 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e990229170 con 0x55e9902f7f50 2023-03-02T10:57:55.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.046+0000 7fd94659c700 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55e9902f7f50 0x55e9902fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.046+0000 7fd94659c700 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55e9902f7f50 0x55e9902fa360 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ddb33b86cd615c3 server_cookie=5a275f4ab5264fc1 in_seq=0 out_seq=0 2023-03-02T10:57:55.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.046+0000 7fd92dffb700 10 client.25595 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:55.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd92dffb700 1 -- 172.21.15.57:0/3721228541 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55e990229170 con 0x55e9902f7f50 2023-03-02T10:57:55.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd92dffb700 10 client.25595 handle_command_reply: tid=0 2023-03-02T10:57:55.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 1 client.25595 shutdown 2023-03-02T10:57:55.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 1 -- 172.21.15.57:0/3721228541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 msgr2=0x55e9902e7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 0x55e9902e7ff0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd9480749a0 tx=0x7fd940007bd0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 1 -- 172.21.15.57:0/3721228541 shutdown_connections 2023-03-02T10:57:55.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55e9902f7f50 0x55e9902fa360 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 0x55e9902e7ff0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902de3c0 0x55e9902ea7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd92dffb700 0 client.25595 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:55.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 1 --2- 172.21.15.57:0/3721228541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 0x55e9902e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 1 -- 172.21.15.57:0/3721228541 >> 172.21.15.57:0/3721228541 conn(0x55e9902d3c50 msgr2=0x55e9902d9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 1 -- 172.21.15.57:0/3721228541 shutdown_connections 2023-03-02T10:57:55.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 1 -- 172.21.15.57:0/3721228541 wait complete. 2023-03-02T10:57:55.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.047+0000 7fd960430b80 20 client.25595 trim_cache size 0 max 16384 2023-03-02T10:57:55.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.064+0000 7fd960430b80 1 Processor -- start 2023-03-02T10:57:55.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.064+0000 7fd960430b80 1 -- start start 2023-03-02T10:57:55.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.064+0000 7fd960430b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 0x55e9902e5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.064+0000 7fd960430b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902decd0 0x55e9902e44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.064+0000 7fd960430b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 0x55e9902dd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.064+0000 7fd960430b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9902d9fa0 con 0x55e9902de3c0 2023-03-02T10:57:55.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.064+0000 7fd960430b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9902df0e0 con 0x55e9902e3110 2023-03-02T10:57:55.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.064+0000 7fd960430b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9902da1d0 con 0x55e9902decd0 2023-03-02T10:57:55.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.064+0000 7fd94659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 0x55e9902e5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd94659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 0x55e9902e5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49974/0 (socket says 172.21.15.57:49974) 2023-03-02T10:57:55.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd94659c700 1 -- 172.21.15.57:0/3042132427 learned_addr learned my addr 172.21.15.57:0/3042132427 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd945d9b700 1 --2- 172.21.15.57:0/3042132427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902decd0 0x55e9902e44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd946d9d700 1 --2- 172.21.15.57:0/3042132427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 0x55e9902dd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd945d9b700 1 -- 172.21.15.57:0/3042132427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 msgr2=0x55e9902dd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd945d9b700 1 --2- 172.21.15.57:0/3042132427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 0x55e9902dd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd945d9b700 1 -- 172.21.15.57:0/3042132427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 msgr2=0x55e9902e5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd945d9b700 1 --2- 172.21.15.57:0/3042132427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 0x55e9902e5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd945d9b700 1 -- 172.21.15.57:0/3042132427 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9901f7190 con 0x55e9902decd0 2023-03-02T10:57:55.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd946d9d700 1 --2- 172.21.15.57:0/3042132427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 0x55e9902dd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:55.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd94659c700 1 --2- 172.21.15.57:0/3042132427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 0x55e9902e5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:55.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd945d9b700 1 --2- 172.21.15.57:0/3042132427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902decd0 0x55e9902e44f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009ce0 tx=0x7fd93c095fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc2d322dc5c17da2 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd9357fa700 1 -- 172.21.15.57:0/3042132427 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0950d0 con 0x55e9902decd0 2023-03-02T10:57:55.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd9357fa700 1 -- 172.21.15.57:0/3042132427 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd93c095770 con 0x55e9902decd0 2023-03-02T10:57:55.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.065+0000 7fd9357fa700 1 -- 172.21.15.57:0/3042132427 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0959d0 con 0x55e9902decd0 2023-03-02T10:57:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.066+0000 7fd960430b80 1 -- 172.21.15.57:0/3042132427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902decd0 msgr2=0x55e9902e44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.066+0000 7fd960430b80 1 --2- 172.21.15.57:0/3042132427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902decd0 0x55e9902e44f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009ce0 tx=0x7fd93c095fe0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.066+0000 7fd960430b80 1 -- 172.21.15.57:0/3042132427 shutdown_connections 2023-03-02T10:57:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.066+0000 7fd960430b80 1 --2- 172.21.15.57:0/3042132427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902e3110 0x55e9902dd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.066+0000 7fd960430b80 1 --2- 172.21.15.57:0/3042132427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902de3c0 0x55e9902e5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.066+0000 7fd960430b80 1 --2- 172.21.15.57:0/3042132427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902decd0 0x55e9902e44f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.066+0000 7fd960430b80 1 -- 172.21.15.57:0/3042132427 >> 172.21.15.57:0/3042132427 conn(0x55e9902d3c50 msgr2=0x55e9902dd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.066+0000 7fd960430b80 1 -- 172.21.15.57:0/3042132427 shutdown_connections 2023-03-02T10:57:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.066+0000 7fd960430b80 1 -- 172.21.15.57:0/3042132427 wait complete. 2023-03-02T10:57:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.066+0000 7fd960430b80 1 -- start start 2023-03-02T10:57:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd960430b80 1 Processor -- start 2023-03-02T10:57:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd960430b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902de3c0 0x55e9902eeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd960430b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 0x55e9902ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd960430b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902e3110 0x55e9902ed740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd960430b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9902ede10 con 0x55e9902decd0 2023-03-02T10:57:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd960430b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9902edf80 con 0x55e9902de3c0 2023-03-02T10:57:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd960430b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9903497d0 con 0x55e9902e3110 2023-03-02T10:57:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd960430b80 10 client.0 _ll_register_callbacks cb 0x55e9901d6520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd945d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 0x55e9902ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd945d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 0x55e9902ed1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49982/0 (socket says 172.21.15.57:49982) 2023-03-02T10:57:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd945d9b700 1 -- 172.21.15.57:0/1376262383 learned_addr learned my addr 172.21.15.57:0/1376262383 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd94659c700 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902de3c0 0x55e9902eeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.067+0000 7fd946d9d700 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902e3110 0x55e9902ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd945d9b700 1 -- 172.21.15.57:0/1376262383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902e3110 msgr2=0x55e9902ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd945d9b700 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902e3110 0x55e9902ed740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd945d9b700 1 -- 172.21.15.57:0/1376262383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902de3c0 msgr2=0x55e9902eeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd945d9b700 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902de3c0 0x55e9902eeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd945d9b700 1 -- 172.21.15.57:0/1376262383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd938017070 con 0x55e9902decd0 2023-03-02T10:57:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd94659c700 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902de3c0 0x55e9902eeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd945d9b700 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 0x55e9902ed1a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd93c093ac0 tx=0x7fd93c091b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab2f15de93e94dd server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd92dffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd92dffb700 1 -- 172.21.15.57:0/1376262383 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c079070 con 0x55e9902decd0 2023-03-02T10:57:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd960430b80 1 -- 172.21.15.57:0/1376262383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd93c095e70 con 0x55e9902decd0 2023-03-02T10:57:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd92dffb700 1 -- 172.21.15.57:0/1376262383 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd93c0ae070 con 0x55e9902decd0 2023-03-02T10:57:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd92dffb700 1 -- 172.21.15.57:0/1376262383 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd93c09ce00 con 0x55e9902decd0 2023-03-02T10:57:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd960430b80 10 client.15750 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.068+0000 7fd960430b80 1 -- 172.21.15.57:0/1376262383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fd93c0ac040 con 0x55e9902decd0 2023-03-02T10:57:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.069+0000 7fd92dffb700 1 -- 172.21.15.57:0/1376262383 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd93c095e70 con 0x55e9902decd0 2023-03-02T10:57:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.069+0000 7fd92dffb700 1 -- 172.21.15.57:0/1376262383 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fd93c091560 con 0x55e9902decd0 2023-03-02T10:57:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.069+0000 7fd960430b80 10 client.15750 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.069+0000 7fd960430b80 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:55.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.069+0000 7fd960430b80 20 client.15750 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:55.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.069+0000 7fd960430b80 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55e99034a9c0 0x55e99034cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.069+0000 7fd960430b80 4 client.15750 mds_command: new command op to 24560 tid=0[{"prefix": "scrub status"}] 2023-03-02T10:57:55.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.069+0000 7fd960430b80 1 -- 172.21.15.57:0/1376262383 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e990228e90 con 0x55e99034a9c0 2023-03-02T10:57:55.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.069+0000 7fd94659c700 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55e99034a9c0 0x55e99034cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.069+0000 7fd92dffb700 10 client.15750 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:55.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.069+0000 7fd94659c700 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55e99034a9c0 0x55e99034cdd0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75fedc640674a22f server_cookie=639169c431298d08 in_seq=0 out_seq=0 2023-03-02T10:57:55.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd92dffb700 1 -- 172.21.15.57:0/1376262383 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e990228e90 con 0x55e99034a9c0 2023-03-02T10:57:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd92dffb700 10 client.15750 handle_command_reply: tid=0 2023-03-02T10:57:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 1 client.15750 shutdown 2023-03-02T10:57:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 1 -- 172.21.15.57:0/1376262383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 msgr2=0x55e9902ed1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 0x55e9902ed1a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd93c093ac0 tx=0x7fd93c091b30 comp rx=0 tx=0).stop 2023-03-02T10:57:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 1 -- 172.21.15.57:0/1376262383 shutdown_connections 2023-03-02T10:57:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55e99034a9c0 0x55e99034cdd0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e9902e3110 0x55e9902ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9902de3c0 0x55e9902eeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 1 --2- 172.21.15.57:0/1376262383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e9902decd0 0x55e9902ed1a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd92dffb700 0 client.15750 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:55.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 1 -- 172.21.15.57:0/1376262383 >> 172.21.15.57:0/1376262383 conn(0x55e9902d3c50 msgr2=0x55e9902e1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 1 -- 172.21.15.57:0/1376262383 shutdown_connections 2023-03-02T10:57:55.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 1 -- 172.21.15.57:0/1376262383 wait complete. 2023-03-02T10:57:55.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.070+0000 7fd960430b80 20 client.15750 trim_cache size 0 max 16384 2023-03-02T10:57:55.082 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:57:55.082 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "no active scrubs running", 2023-03-02T10:57:55.082 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": {} 2023-03-02T10:57:55.082 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:57:55.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 -- 172.21.15.57:0/567375274 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd93009b4c0 msgr2=0x7fd93009d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd93009b4c0 0x7fd93009d970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd938009c60 tx=0x7fd938009260 comp rx=0 tx=0).stop 2023-03-02T10:57:55.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 -- 172.21.15.57:0/567375274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9480731e0 msgr2=0x7fd948198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9480731e0 0x7fd948198370 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd93c005910 tx=0x7fd93c004710 comp rx=0 tx=0).stop 2023-03-02T10:57:55.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 -- 172.21.15.57:0/567375274 shutdown_connections 2023-03-02T10:57:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd93009b4c0 0x7fd93009d970 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd94810c350 0x7fd94819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9480728d0 0x7fd948197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 --2- 172.21.15.57:0/567375274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9480731e0 0x7fd948198370 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 -- 172.21.15.57:0/567375274 >> 172.21.15.57:0/567375274 conn(0x7fd9480fb610 msgr2=0x7fd948103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 -- 172.21.15.57:0/567375274 shutdown_connections 2023-03-02T10:57:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.071+0000 7fd94cbff700 1 -- 172.21.15.57:0/567375274 wait complete. 2023-03-02T10:57:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:26300000 of 50000000 tuples (52%) done (elapsed 39.89 s, remaining 35.94 s) 2023-03-02T10:57:55.087 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-03-02T10:57:55.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:57:55.219 INFO:teuthology.orchestra.run.smithi057.stderr:26400000 of 50000000 tuples (52%) done (elapsed 40.02 s, remaining 35.78 s) 2023-03-02T10:57:55.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.270+0000 7fae045ff700 1 -- 172.21.15.57:0/534405029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadfc0ff1e0 msgr2=0x7fadfc10bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.270+0000 7fae045ff700 1 --2- 172.21.15.57:0/534405029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadfc0ff1e0 0x7fadfc10bf40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fadec0098f0 tx=0x7fadec009c00 comp rx=0 tx=0).stop 2023-03-02T10:57:55.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.270+0000 7fae045ff700 1 -- 172.21.15.57:0/534405029 shutdown_connections 2023-03-02T10:57:55.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.270+0000 7fae045ff700 1 --2- 172.21.15.57:0/534405029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fadfc10c480 0x7fadfc10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.270+0000 7fae045ff700 1 --2- 172.21.15.57:0/534405029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc0fe8d0 0x7fadfc0feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.270+0000 7fae045ff700 1 --2- 172.21.15.57:0/534405029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadfc0ff1e0 0x7fadfc10bf40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.270+0000 7fae045ff700 1 -- 172.21.15.57:0/534405029 >> 172.21.15.57:0/534405029 conn(0x7fadfc0fa4c0 msgr2=0x7fadfc0fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.270+0000 7fae045ff700 1 -- 172.21.15.57:0/534405029 shutdown_connections 2023-03-02T10:57:55.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.270+0000 7fae045ff700 1 -- 172.21.15.57:0/534405029 wait complete. 2023-03-02T10:57:55.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae045ff700 1 Processor -- start 2023-03-02T10:57:55.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae045ff700 1 -- start start 2023-03-02T10:57:55.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae045ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fadfc0fe8d0 0x7fadfc197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae045ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc0ff1e0 0x7fadfc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae045ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadfc10c480 0x7fadfc19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae045ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc19ce90 con 0x7fadfc0ff1e0 2023-03-02T10:57:55.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae045ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc19d000 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae045ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc19d1c0 con 0x7fadfc10c480 2023-03-02T10:57:55.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae01b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc0ff1e0 0x7fadfc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae0239b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fadfc0fe8d0 0x7fadfc197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae01b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc0ff1e0 0x7fadfc198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50008/0 (socket says 172.21.15.57:50008) 2023-03-02T10:57:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.271+0000 7fae01b9a700 1 -- 172.21.15.57:0/1259626179 learned_addr learned my addr 172.21.15.57:0/1259626179 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fae02b9c700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadfc10c480 0x7fadfc19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fae0239b700 1 -- 172.21.15.57:0/1259626179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadfc10c480 msgr2=0x7fadfc19c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fae0239b700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadfc10c480 0x7fadfc19c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fae0239b700 1 -- 172.21.15.57:0/1259626179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc0ff1e0 msgr2=0x7fadfc198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fae0239b700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc0ff1e0 0x7fadfc198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fae0239b700 1 -- 172.21.15.57:0/1259626179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec009520 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fae01b9a700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc0ff1e0 0x7fadfc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fae0239b700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fadfc0fe8d0 0x7fadfc197f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fadf800e9c0 tx=0x7fadf800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fadf37fe700 1 -- 172.21.15.57:0/1259626179 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800c9c0 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fadf37fe700 1 -- 172.21.15.57:0/1259626179 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadf8010430 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fae045ff700 1 -- 172.21.15.57:0/1259626179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc111de0 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fadf37fe700 1 -- 172.21.15.57:0/1259626179 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8018680 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.272+0000 7fae045ff700 1 -- 172.21.15.57:0/1259626179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc111c50 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.273+0000 7fae045ff700 1 -- 172.21.15.57:0/1259626179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc111f70 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.276+0000 7fadf37fe700 1 -- 172.21.15.57:0/1259626179 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7fadf800c040 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.277+0000 7fadf37fe700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fade809b4c0 0x7fade809d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.277+0000 7fadf37fe700 1 -- 172.21.15.57:0/1259626179 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fadf8014070 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.277+0000 7fae01b9a700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fade809b4c0 0x7fade809d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.278+0000 7fae01b9a700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fade809b4c0 0x7fade809d970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fadfc1994c0 tx=0x7fadec019040 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.279+0000 7fadf37fe700 1 -- 172.21.15.57:0/1259626179 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fadf8090c70 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.334 INFO:teuthology.orchestra.run.smithi057.stderr:26500000 of 50000000 tuples (53%) done (elapsed 40.14 s, remaining 35.60 s) 2023-03-02T10:57:55.433 INFO:teuthology.orchestra.run.smithi057.stderr:26600000 of 50000000 tuples (53%) done (elapsed 40.24 s, remaining 35.40 s) 2023-03-02T10:57:55.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.544+0000 7fae045ff700 1 -- 172.21.15.57:0/1259626179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadfc067280 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.545+0000 7fadf37fe700 1 -- 172.21.15.57:0/1259626179 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10836 (secure 0 0 0) 0x7fadf8094290 con 0x7fadfc0fe8d0 2023-03-02T10:57:55.546 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:57:55.546 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-02T10:55:10.601054+0000","modified":"2023-03-02T10:57:34.597921+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24520,"mds_2":24505,"mds_3":24493,"mds_4":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14634":{"gid":14634,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6841/3731858530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6840","nonce":3731858530},{"type":"v1","addr":"172.21.15.57:6841","nonce":3731858530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"e","rank":4,"incarnation":24,"state":"up:active","state_seq":9,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24505":{"gid":24505,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/316639764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":316639764},{"type":"v1","addr":"172.21.15.122:6839","nonce":316639764}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-02T10:57:55.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 -- 172.21.15.57:0/1259626179 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fade809b4c0 msgr2=0x7fade809d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fade809b4c0 0x7fade809d970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fadfc1994c0 tx=0x7fadec019040 comp rx=0 tx=0).stop 2023-03-02T10:57:55.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 -- 172.21.15.57:0/1259626179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fadfc0fe8d0 msgr2=0x7fadfc197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fadfc0fe8d0 0x7fadfc197f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fadf800e9c0 tx=0x7fadf800ecd0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 -- 172.21.15.57:0/1259626179 shutdown_connections 2023-03-02T10:57:55.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fade809b4c0 0x7fade809d970 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fadfc10c480 0x7fadfc19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fadfc0fe8d0 0x7fadfc197f20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 --2- 172.21.15.57:0/1259626179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc0ff1e0 0x7fadfc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 -- 172.21.15.57:0/1259626179 >> 172.21.15.57:0/1259626179 conn(0x7fadfc0fa4c0 msgr2=0x7fadfc10e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 -- 172.21.15.57:0/1259626179 shutdown_connections 2023-03-02T10:57:55.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.547+0000 7fae045ff700 1 -- 172.21.15.57:0/1259626179 wait complete. 2023-03-02T10:57:55.550 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 29 2023-03-02T10:57:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:26700000 of 50000000 tuples (53%) done (elapsed 40.37 s, remaining 35.23 s) 2023-03-02T10:57:55.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-03-02T10:57:55.669 INFO:teuthology.orchestra.run.smithi057.stderr:26800000 of 50000000 tuples (53%) done (elapsed 40.47 s, remaining 35.04 s) 2023-03-02T10:57:55.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.735+0000 7f85c59ff700 1 -- 172.21.15.57:0/3184140237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85c010a040 msgr2=0x7f85c010c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.735+0000 7f85c59ff700 1 --2- 172.21.15.57:0/3184140237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85c010a040 0x7f85c010c4a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f85b800b0a0 tx=0x7f85b800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.735+0000 7f85c59ff700 1 -- 172.21.15.57:0/3184140237 shutdown_connections 2023-03-02T10:57:55.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.735+0000 7f85c59ff700 1 --2- 172.21.15.57:0/3184140237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85c010a040 0x7f85c010c4a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.735+0000 7f85c59ff700 1 --2- 172.21.15.57:0/3184140237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85c0100d00 0x7f85c01010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.735+0000 7f85c59ff700 1 --2- 172.21.15.57:0/3184140237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c0101610 0x7f85c0109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.735+0000 7f85c59ff700 1 -- 172.21.15.57:0/3184140237 >> 172.21.15.57:0/3184140237 conn(0x7f85c00fa4b0 msgr2=0x7f85c00fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.735+0000 7f85c59ff700 1 -- 172.21.15.57:0/3184140237 shutdown_connections 2023-03-02T10:57:55.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.735+0000 7f85c59ff700 1 -- 172.21.15.57:0/3184140237 wait complete. 2023-03-02T10:57:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85c59ff700 1 Processor -- start 2023-03-02T10:57:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85c59ff700 1 -- start start 2023-03-02T10:57:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85c59ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85c0100d00 0x7f85c019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85c59ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85c0101610 0x7f85c019bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85c59ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c010a040 0x7f85c0195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85c59ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0196140 con 0x7f85c0101610 2023-03-02T10:57:55.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85c59ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c01962b0 con 0x7f85c010a040 2023-03-02T10:57:55.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85c59ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0196470 con 0x7f85c0100d00 2023-03-02T10:57:55.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85be7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85c0101610 0x7f85c019bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85beffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85c0100d00 0x7f85c019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85be7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85c0101610 0x7f85c019bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50014/0 (socket says 172.21.15.57:50014) 2023-03-02T10:57:55.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85be7fc700 1 -- 172.21.15.57:0/2917302049 learned_addr learned my addr 172.21.15.57:0/2917302049 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.736+0000 7f85bf7fe700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c010a040 0x7f85c0195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85be7fc700 1 -- 172.21.15.57:0/2917302049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85c0100d00 msgr2=0x7f85c019ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85be7fc700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85c0100d00 0x7f85c019ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85be7fc700 1 -- 172.21.15.57:0/2917302049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c010a040 msgr2=0x7f85c0195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85be7fc700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c010a040 0x7f85c0195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85be7fc700 1 -- 172.21.15.57:0/2917302049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b8009d00 con 0x7f85c0101610 2023-03-02T10:57:55.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85beffd700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85c0100d00 0x7f85c019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:55.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85be7fc700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85c0101610 0x7f85c019bf50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f85b400e9a0 tx=0x7f85b400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85c49fd700 1 -- 172.21.15.57:0/2917302049 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4009790 con 0x7f85c0101610 2023-03-02T10:57:55.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85c49fd700 1 -- 172.21.15.57:0/2917302049 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85b4010430 con 0x7f85c0101610 2023-03-02T10:57:55.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85c59ff700 1 -- 172.21.15.57:0/2917302049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c010fae0 con 0x7f85c0101610 2023-03-02T10:57:55.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85c49fd700 1 -- 172.21.15.57:0/2917302049 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4018680 con 0x7f85c0101610 2023-03-02T10:57:55.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.737+0000 7f85c59ff700 1 -- 172.21.15.57:0/2917302049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c010f950 con 0x7f85c0101610 2023-03-02T10:57:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.741+0000 7f85c49fd700 1 -- 172.21.15.57:0/2917302049 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f85b400c040 con 0x7f85c0101610 2023-03-02T10:57:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.742+0000 7f85c49fd700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f85a809b540 0x7f85a809d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.742+0000 7f85c49fd700 1 -- 172.21.15.57:0/2917302049 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f85b4014070 con 0x7f85c0101610 2023-03-02T10:57:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.742+0000 7f85d92b2b80 1 Processor -- start 2023-03-02T10:57:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.742+0000 7f85beffd700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f85a809b540 0x7f85a809d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.742+0000 7f85d92b2b80 1 -- start start 2023-03-02T10:57:55.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf76ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf770e0 0x559efdf7afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 0x559efdf7b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efded9a60 con 0x559efdf770e0 2023-03-02T10:57:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efde8bf80 con 0x559efdf767d0 2023-03-02T10:57:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efde5c160 con 0x559efdf7b520 2023-03-02T10:57:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85bf7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 0x559efdf7b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85bf7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 0x559efdf7b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48416/0 (socket says 172.21.15.57:48416) 2023-03-02T10:57:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85bf7fe700 1 -- 172.21.15.57:0/3461975049 learned_addr learned my addr 172.21.15.57:0/3461975049 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85beffd700 1 --2- 172.21.15.57:0/3461975049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf76ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85beffd700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f85a809b540 0x7f85a809d9f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f85b0005950 tx=0x7f85b000b410 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85be7fc700 1 --2- 172.21.15.57:0/3461975049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf770e0 0x559efdf7afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85bf7fe700 1 -- 172.21.15.57:0/3461975049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 msgr2=0x559efdf76ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85bf7fe700 1 --2- 172.21.15.57:0/3461975049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf76ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85bf7fe700 1 -- 172.21.15.57:0/3461975049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf770e0 msgr2=0x559efdf7afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85bf7fe700 1 --2- 172.21.15.57:0/3461975049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf770e0 0x559efdf7afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.743+0000 7f85bf7fe700 1 -- 172.21.15.57:0/3461975049 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559efdd46630 con 0x559efdf7b520 2023-03-02T10:57:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.744+0000 7f85bf7fe700 1 --2- 172.21.15.57:0/3461975049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 0x559efdf7b970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009310 tx=0x7f85b8009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bac0c9f0a336e2f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.744+0000 7f85a5ffb700 1 -- 172.21.15.57:0/3461975049 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b800e040 con 0x559efdf7b520 2023-03-02T10:57:55.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.744+0000 7f85a5ffb700 1 -- 172.21.15.57:0/3461975049 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85b800bcb0 con 0x559efdf7b520 2023-03-02T10:57:55.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.744+0000 7f85a5ffb700 1 -- 172.21.15.57:0/3461975049 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b801c6a0 con 0x559efdf7b520 2023-03-02T10:57:55.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.745+0000 7f85d92b2b80 1 -- 172.21.15.57:0/3461975049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 msgr2=0x559efdf7b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.745+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/3461975049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 0x559efdf7b970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009310 tx=0x7f85b8009340 comp rx=0 tx=0).stop 2023-03-02T10:57:55.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.745+0000 7f85d92b2b80 1 -- 172.21.15.57:0/3461975049 shutdown_connections 2023-03-02T10:57:55.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.745+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/3461975049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 0x559efdf7b970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.745+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/3461975049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf76ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.745+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/3461975049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf770e0 0x559efdf7afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.745+0000 7f85d92b2b80 1 -- 172.21.15.57:0/3461975049 >> 172.21.15.57:0/3461975049 conn(0x559efdf67c50 msgr2=0x559efdf6d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.745+0000 7f85d92b2b80 1 -- 172.21.15.57:0/3461975049 shutdown_connections 2023-03-02T10:57:55.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.745+0000 7f85d92b2b80 1 -- 172.21.15.57:0/3461975049 wait complete. 2023-03-02T10:57:55.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.745+0000 7f85d92b2b80 1 -- start start 2023-03-02T10:57:55.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.745+0000 7f85d92b2b80 1 Processor -- start 2023-03-02T10:57:55.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf82db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf770e0 0x559efdf80030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 0x559efdf80720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efdecabc0 con 0x559efdf770e0 2023-03-02T10:57:55.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efdec40f0 con 0x559efdf767d0 2023-03-02T10:57:55.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efdd48920 con 0x559efdf7b520 2023-03-02T10:57:55.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85d92b2b80 10 client.0 _ll_register_callbacks cb 0x559efde6a520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:55.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85beffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf82db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85be7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf770e0 0x559efdf80030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85beffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf82db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:34232/0 (socket says 172.21.15.57:34232) 2023-03-02T10:57:55.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85beffd700 1 -- 172.21.15.57:0/1760078251 learned_addr learned my addr 172.21.15.57:0/1760078251 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85bf7fe700 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 0x559efdf80720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85beffd700 1 -- 172.21.15.57:0/1760078251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 msgr2=0x559efdf80720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85beffd700 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 0x559efdf80720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85beffd700 1 -- 172.21.15.57:0/1760078251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf770e0 msgr2=0x559efdf80030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85beffd700 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf770e0 0x559efdf80030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85beffd700 1 -- 172.21.15.57:0/1760078251 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c010d160 con 0x559efdf767d0 2023-03-02T10:57:55.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f85beffd700 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf82db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85b0011910 tx=0x7f85b00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=617fa3007f500be6 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.746+0000 7f859effd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:55.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f859effd700 1 -- 172.21.15.57:0/1760078251 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b001f9c0 con 0x559efdf767d0 2023-03-02T10:57:55.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f859effd700 1 -- 172.21.15.57:0/1760078251 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f85b0017070 con 0x559efdf767d0 2023-03-02T10:57:55.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1760078251 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559efde957b0 con 0x559efdf767d0 2023-03-02T10:57:55.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f859effd700 1 -- 172.21.15.57:0/1760078251 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85b001fb20 con 0x559efdf767d0 2023-03-02T10:57:55.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f85d92b2b80 10 client.25619 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:55.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1760078251 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x559efdcf2de0 con 0x559efdf767d0 2023-03-02T10:57:55.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f859effd700 1 -- 172.21.15.57:0/1760078251 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559efde957b0 con 0x559efdf767d0 2023-03-02T10:57:55.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f859effd700 1 -- 172.21.15.57:0/1760078251 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f85b00273e0 con 0x559efdf767d0 2023-03-02T10:57:55.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f85d92b2b80 10 client.25619 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:55.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f85d92b2b80 10 client.25619 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-03-02T10:57:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f85d92b2b80 20 client.25619 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x559efdf906d0 0x559efdf92ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f85d92b2b80 4 client.25619 mds_command: new command op to 24491 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.747+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1760078251 --> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559efdebd170 con 0x559efdf906d0 2023-03-02T10:57:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.748+0000 7f85be7fc700 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x559efdf906d0 0x559efdf92ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.748+0000 7f859effd700 10 client.25619 ms_handle_connect on v2:172.21.15.122:6834/1841258715 2023-03-02T10:57:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.748+0000 7f85be7fc700 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x559efdf906d0 0x559efdf92ae0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3c405fe85bb073cf server_cookie=b4afe6b2bde90f46 in_seq=0 out_seq=0 2023-03-02T10:57:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f859effd700 1 -- 172.21.15.57:0/1760078251 <== mds.4 v2:172.21.15.122:6834/1841258715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x559efdebd170 con 0x559efdf906d0 2023-03-02T10:57:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f859effd700 10 client.25619 handle_command_reply: tid=0 2023-03-02T10:57:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 1 client.25619 shutdown 2023-03-02T10:57:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1760078251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 msgr2=0x559efdf82db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf82db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85b0011910 tx=0x7f85b00047c0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1760078251 shutdown_connections 2023-03-02T10:57:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x559efdf906d0 0x559efdf92ae0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf7b520 0x559efdf80720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf82db0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f859effd700 0 client.25619 ms_handle_reset on v2:172.21.15.122:6834/1841258715 2023-03-02T10:57:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1760078251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf770e0 0x559efdf80030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1760078251 >> 172.21.15.57:0/1760078251 conn(0x559efdf67c50 msgr2=0x559efdf6cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1760078251 shutdown_connections 2023-03-02T10:57:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1760078251 wait complete. 2023-03-02T10:57:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.749+0000 7f85d92b2b80 20 client.25619 trim_cache size 0 max 16384 2023-03-02T10:57:55.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.762+0000 7f85d92b2b80 1 Processor -- start 2023-03-02T10:57:55.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.762+0000 7f85d92b2b80 1 -- start start 2023-03-02T10:57:55.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.762+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf828e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.762+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf770e0 0x559efdf7a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf7b520 0x559efdf7aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efdf80d00 con 0x559efdf7b520 2023-03-02T10:57:55.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efdf6dfa0 con 0x559efdf767d0 2023-03-02T10:57:55.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efdf6e970 con 0x559efdf770e0 2023-03-02T10:57:55.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85be7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf770e0 0x559efdf7a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85bf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf7b520 0x559efdf7aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85be7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf770e0 0x559efdf7a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48426/0 (socket says 172.21.15.57:48426) 2023-03-02T10:57:55.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85be7fc700 1 -- 172.21.15.57:0/2333971550 learned_addr learned my addr 172.21.15.57:0/2333971550 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85beffd700 1 --2- 172.21.15.57:0/2333971550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf828e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85be7fc700 1 -- 172.21.15.57:0/2333971550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 msgr2=0x559efdf828e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85be7fc700 1 --2- 172.21.15.57:0/2333971550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf828e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85be7fc700 1 -- 172.21.15.57:0/2333971550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf7b520 msgr2=0x559efdf7aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85be7fc700 1 --2- 172.21.15.57:0/2333971550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf7b520 0x559efdf7aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85be7fc700 1 -- 172.21.15.57:0/2333971550 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559efde8b190 con 0x559efdf770e0 2023-03-02T10:57:55.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.763+0000 7f85be7fc700 1 --2- 172.21.15.57:0/2333971550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf770e0 0x559efdf7a590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85b40c5240 tx=0x7f85b4010c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baa21461e34ad6f5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85a67fc700 1 -- 172.21.15.57:0/2333971550 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4094d90 con 0x559efdf770e0 2023-03-02T10:57:55.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85a67fc700 1 -- 172.21.15.57:0/2333971550 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85b40ad020 con 0x559efdf770e0 2023-03-02T10:57:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85a67fc700 1 -- 172.21.15.57:0/2333971550 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40106c0 con 0x559efdf770e0 2023-03-02T10:57:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85d92b2b80 1 -- 172.21.15.57:0/2333971550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf770e0 msgr2=0x559efdf7a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/2333971550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf770e0 0x559efdf7a590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85b40c5240 tx=0x7f85b4010c80 comp rx=0 tx=0).stop 2023-03-02T10:57:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85d92b2b80 1 -- 172.21.15.57:0/2333971550 shutdown_connections 2023-03-02T10:57:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/2333971550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf7b520 0x559efdf7aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/2333971550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf767d0 0x559efdf828e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/2333971550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf770e0 0x559efdf7a590 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85d92b2b80 1 -- 172.21.15.57:0/2333971550 >> 172.21.15.57:0/2333971550 conn(0x559efdf67c50 msgr2=0x559efdf8bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85d92b2b80 1 -- 172.21.15.57:0/2333971550 shutdown_connections 2023-03-02T10:57:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.764+0000 7f85d92b2b80 1 -- 172.21.15.57:0/2333971550 wait complete. 2023-03-02T10:57:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.765+0000 7f85d92b2b80 1 -- start start 2023-03-02T10:57:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.765+0000 7f85d92b2b80 1 Processor -- start 2023-03-02T10:57:55.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.765+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf767d0 0x559efdf87400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.765+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf770e0 0x559efdf85730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.765+0000 7f85d92b2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf7b520 0x559efdf85c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.765+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efdf86350 con 0x559efdf7b520 2023-03-02T10:57:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.765+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efdf864c0 con 0x559efdf770e0 2023-03-02T10:57:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.765+0000 7f85d92b2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efdfe1f90 con 0x559efdf767d0 2023-03-02T10:57:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.765+0000 7f85d92b2b80 10 client.0 _ll_register_callbacks cb 0x559efde6a520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.765+0000 7f85beffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf767d0 0x559efdf87400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85beffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf767d0 0x559efdf87400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48440/0 (socket says 172.21.15.57:48440) 2023-03-02T10:57:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85beffd700 1 -- 172.21.15.57:0/1594622249 learned_addr learned my addr 172.21.15.57:0/1594622249 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85bf7fe700 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf7b520 0x559efdf85c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85be7fc700 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf770e0 0x559efdf85730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85beffd700 1 -- 172.21.15.57:0/1594622249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf770e0 msgr2=0x559efdf85730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85beffd700 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf770e0 0x559efdf85730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85beffd700 1 -- 172.21.15.57:0/1594622249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf7b520 msgr2=0x559efdf85c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85beffd700 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf7b520 0x559efdf85c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85beffd700 1 -- 172.21.15.57:0/1594622249 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c010f950 con 0x559efdf767d0 2023-03-02T10:57:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85be7fc700 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf770e0 0x559efdf85730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85beffd700 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf767d0 0x559efdf87400 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f85b0010c00 tx=0x7f85b0010e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5df8d922010c90d1 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f859effd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:57:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f859effd700 1 -- 172.21.15.57:0/1594622249 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b001f370 con 0x559efdf767d0 2023-03-02T10:57:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1594622249 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f85b800bcb0 con 0x559efdf767d0 2023-03-02T10:57:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.766+0000 7f859effd700 1 -- 172.21.15.57:0/1594622249 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f85b0017040 con 0x559efdf767d0 2023-03-02T10:57:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f859effd700 1 -- 172.21.15.57:0/1594622249 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85b0027960 con 0x559efdf767d0 2023-03-02T10:57:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f85d92b2b80 10 client.25579 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1594622249 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x559efdd19250 con 0x559efdf767d0 2023-03-02T10:57:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f859effd700 1 -- 172.21.15.57:0/1594622249 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85b800bcb0 con 0x559efdf767d0 2023-03-02T10:57:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f859effd700 1 -- 172.21.15.57:0/1594622249 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f85b001f7c0 con 0x559efdf767d0 2023-03-02T10:57:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f85d92b2b80 10 client.25579 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f85d92b2b80 10 client.25579 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-03-02T10:57:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f85d92b2b80 20 client.25579 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x559efdfe3580 0x559efdfe5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f85d92b2b80 4 client.25579 mds_command: new command op to 24491 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:57:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1594622249 --> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559efdebce90 con 0x559efdfe3580 2023-03-02T10:57:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.767+0000 7f85be7fc700 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x559efdfe3580 0x559efdfe5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85be7fc700 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x559efdfe3580 0x559efdfe5990 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fb07317b3e6a53d4 server_cookie=6d75b9a06206826b in_seq=0 out_seq=0 2023-03-02T10:57:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f859effd700 10 client.25579 ms_handle_connect on v2:172.21.15.122:6834/1841258715 2023-03-02T10:57:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f859effd700 1 -- 172.21.15.57:0/1594622249 <== mds.4 v2:172.21.15.122:6834/1841258715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559efdebce90 con 0x559efdfe3580 2023-03-02T10:57:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f859effd700 10 client.25579 handle_command_reply: tid=0 2023-03-02T10:57:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 1 client.25579 shutdown 2023-03-02T10:57:55.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1594622249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf767d0 msgr2=0x559efdf87400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf767d0 0x559efdf87400 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f85b0010c00 tx=0x7f85b0010e60 comp rx=0 tx=0).stop 2023-03-02T10:57:55.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1594622249 shutdown_connections 2023-03-02T10:57:55.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x559efdfe3580 0x559efdfe5990 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559efdf7b520 0x559efdf85c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559efdf767d0 0x559efdf87400 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 1 --2- 172.21.15.57:0/1594622249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559efdf770e0 0x559efdf85730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f859effd700 0 client.25579 ms_handle_reset on v2:172.21.15.122:6834/1841258715 2023-03-02T10:57:55.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1594622249 >> 172.21.15.57:0/1594622249 conn(0x559efdf67c50 msgr2=0x559efdf7a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1594622249 shutdown_connections 2023-03-02T10:57:55.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 1 -- 172.21.15.57:0/1594622249 wait complete. 2023-03-02T10:57:55.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.768+0000 7f85d92b2b80 20 client.25579 trim_cache size 0 max 16384 2023-03-02T10:57:55.781 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:57:55.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 -- 172.21.15.57:0/2917302049 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f85a809b540 msgr2=0x7f85a809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f85a809b540 0x7f85a809d9f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f85b0005950 tx=0x7f85b000b410 comp rx=0 tx=0).stop 2023-03-02T10:57:55.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 -- 172.21.15.57:0/2917302049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85c0101610 msgr2=0x7f85c019bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85c0101610 0x7f85c019bf50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f85b400e9a0 tx=0x7f85b400ecb0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 -- 172.21.15.57:0/2917302049 shutdown_connections 2023-03-02T10:57:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f85a809b540 0x7f85a809d9f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c010a040 0x7f85c0195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85c0100d00 0x7f85c019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 --2- 172.21.15.57:0/2917302049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85c0101610 0x7f85c019bf50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 -- 172.21.15.57:0/2917302049 >> 172.21.15.57:0/2917302049 conn(0x7f85c00fa4b0 msgr2=0x7f85c010c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 -- 172.21.15.57:0/2917302049 shutdown_connections 2023-03-02T10:57:55.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.769+0000 7f85c59ff700 1 -- 172.21.15.57:0/2917302049 wait complete. 2023-03-02T10:57:55.785 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-03-02T10:57:55.825 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:55 smithi057 ceph-mon[92072]: pgmap v30: 97 pgs: 97 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 149 MiB/s wr, 86 op/s 2023-03-02T10:57:55.825 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:55 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/1259626179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:57:55.834 INFO:teuthology.orchestra.run.smithi057.stderr:26900000 of 50000000 tuples (53%) done (elapsed 40.64 s, remaining 34.90 s) 2023-03-02T10:57:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:55 smithi122 ceph-mon[125440]: pgmap v30: 97 pgs: 97 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 149 MiB/s wr, 86 op/s 2023-03-02T10:57:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:55 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/1259626179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:57:55.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.963+0000 7f16041ff700 1 -- 172.21.15.57:0/1118283567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15fc101450 msgr2=0x7f15fc109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.963+0000 7f16041ff700 1 --2- 172.21.15.57:0/1118283567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15fc101450 0x7f15fc109b20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009990 tx=0x7f15ec009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.963+0000 7f16041ff700 1 -- 172.21.15.57:0/1118283567 shutdown_connections 2023-03-02T10:57:55.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.963+0000 7f16041ff700 1 --2- 172.21.15.57:0/1118283567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15fc10a060 0x7f15fc10c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.963+0000 7f16041ff700 1 --2- 172.21.15.57:0/1118283567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15fc100b40 0x7f15fc100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.963+0000 7f16041ff700 1 --2- 172.21.15.57:0/1118283567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15fc101450 0x7f15fc109b20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.963+0000 7f16041ff700 1 -- 172.21.15.57:0/1118283567 >> 172.21.15.57:0/1118283567 conn(0x7f15fc0fa4b0 msgr2=0x7f15fc0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.963+0000 7f16041ff700 1 -- 172.21.15.57:0/1118283567 shutdown_connections 2023-03-02T10:57:55.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.963+0000 7f16041ff700 1 -- 172.21.15.57:0/1118283567 wait complete. 2023-03-02T10:57:55.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f16041ff700 1 Processor -- start 2023-03-02T10:57:55.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f16041ff700 1 -- start start 2023-03-02T10:57:55.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f16041ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15fc100b40 0x7f15fc0fe970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f16041ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15fc101450 0x7f15fc0feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f16041ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15fc10a060 0x7f15fc1a3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f16041ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc0ff6e0 con 0x7f15fc100b40 2023-03-02T10:57:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f16041ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc1a4340 con 0x7f15fc101450 2023-03-02T10:57:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f16041ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc1a4480 con 0x7f15fc10a060 2023-03-02T10:57:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f1601f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15fc100b40 0x7f15fc0fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f1601f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15fc100b40 0x7f15fc0fe970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50066/0 (socket says 172.21.15.57:50066) 2023-03-02T10:57:55.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f1601f9b700 1 -- 172.21.15.57:0/3368289386 learned_addr learned my addr 172.21.15.57:0/3368289386 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.964+0000 7f160179a700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15fc101450 0x7f15fc0feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f160279c700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15fc10a060 0x7f15fc1a3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f1601f9b700 1 -- 172.21.15.57:0/3368289386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15fc10a060 msgr2=0x7f15fc1a3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f1601f9b700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15fc10a060 0x7f15fc1a3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f1601f9b700 1 -- 172.21.15.57:0/3368289386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15fc101450 msgr2=0x7f15fc0feeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f1601f9b700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15fc101450 0x7f15fc0feeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f1601f9b700 1 -- 172.21.15.57:0/3368289386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4009c40 con 0x7f15fc100b40 2023-03-02T10:57:55.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f160279c700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15fc10a060 0x7f15fc1a3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:55.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f1601f9b700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15fc100b40 0x7f15fc0fe970 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f15f800e9a0 tx=0x7f15f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f15f2ffd700 1 -- 172.21.15.57:0/3368289386 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8009790 con 0x7f15fc100b40 2023-03-02T10:57:55.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f15f2ffd700 1 -- 172.21.15.57:0/3368289386 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15f800cbd0 con 0x7f15fc100b40 2023-03-02T10:57:55.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f16041ff700 1 -- 172.21.15.57:0/3368289386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec0095f0 con 0x7f15fc100b40 2023-03-02T10:57:55.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f15f2ffd700 1 -- 172.21.15.57:0/3368289386 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8018680 con 0x7f15fc100b40 2023-03-02T10:57:55.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.965+0000 7f16041ff700 1 -- 172.21.15.57:0/3368289386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc10fb20 con 0x7f15fc100b40 2023-03-02T10:57:55.971 INFO:teuthology.orchestra.run.smithi057.stderr:27000000 of 50000000 tuples (54%) done (elapsed 40.77 s, remaining 34.73 s) 2023-03-02T10:57:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.969+0000 7f15f2ffd700 1 -- 172.21.15.57:0/3368289386 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f15f800c040 con 0x7f15fc100b40 2023-03-02T10:57:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.969+0000 7f1617b72b80 1 Processor -- start 2023-03-02T10:57:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.969+0000 7f1617b72b80 1 -- start start 2023-03-02T10:57:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f53c0 0x55b14e7f5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e7f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 0x55b14e7fa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f1617b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e75ca60 con 0x55b14e7fa110 2023-03-02T10:57:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f1617b72b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e70ef80 con 0x55b14e7f53c0 2023-03-02T10:57:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f1617b72b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e6df160 con 0x55b14e7f5cd0 2023-03-02T10:57:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f160179a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 0x55b14e7fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f160279c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f53c0 0x55b14e7f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f160279c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f53c0 0x55b14e7f5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:34284/0 (socket says 172.21.15.57:34284) 2023-03-02T10:57:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f160279c700 1 -- 172.21.15.57:0/3792339287 learned_addr learned my addr 172.21.15.57:0/3792339287 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f1601f9b700 1 --2- 172.21.15.57:0/3792339287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e7f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f160279c700 1 -- 172.21.15.57:0/3792339287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 msgr2=0x55b14e7f9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f160279c700 1 --2- 172.21.15.57:0/3792339287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e7f9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f160279c700 1 -- 172.21.15.57:0/3792339287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 msgr2=0x55b14e7fa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f160279c700 1 --2- 172.21.15.57:0/3792339287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 0x55b14e7fa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f160279c700 1 -- 172.21.15.57:0/3792339287 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b14e5c9630 con 0x55b14e7f53c0 2023-03-02T10:57:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.970+0000 7f160179a700 1 --2- 172.21.15.57:0/3792339287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 0x55b14e7fa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.971+0000 7f160279c700 1 --2- 172.21.15.57:0/3792339287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f53c0 0x55b14e7f5790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f15f4007550 tx=0x7f15f4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=751a540fd2a23cfd server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.971+0000 7f15f2ffd700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f15e809b540 0x7f15e809d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.971+0000 7f15e7fff700 1 -- 172.21.15.57:0/3792339287 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400e070 con 0x55b14e7f53c0 2023-03-02T10:57:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.971+0000 7f15e7fff700 1 -- 172.21.15.57:0/3792339287 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15f400f040 con 0x55b14e7f53c0 2023-03-02T10:57:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.971+0000 7f15e7fff700 1 -- 172.21.15.57:0/3792339287 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4014b90 con 0x55b14e7f53c0 2023-03-02T10:57:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.971+0000 7f1601f9b700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f15e809b540 0x7f15e809d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.971+0000 7f15f2ffd700 1 -- 172.21.15.57:0/3368289386 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f15f8014070 con 0x7f15fc100b40 2023-03-02T10:57:55.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1617b72b80 1 -- 172.21.15.57:0/3792339287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f53c0 msgr2=0x55b14e7f5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1601f9b700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f15e809b540 0x7f15e809d9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15f80944b0 tx=0x7f15f80c8a60 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1617b72b80 1 --2- 172.21.15.57:0/3792339287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f53c0 0x55b14e7f5790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f15f4007550 tx=0x7f15f4009920 comp rx=0 tx=0).stop 2023-03-02T10:57:55.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1617b72b80 1 -- 172.21.15.57:0/3792339287 shutdown_connections 2023-03-02T10:57:55.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1617b72b80 1 --2- 172.21.15.57:0/3792339287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 0x55b14e7fa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1617b72b80 1 --2- 172.21.15.57:0/3792339287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f53c0 0x55b14e7f5790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1617b72b80 1 --2- 172.21.15.57:0/3792339287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e7f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1617b72b80 1 -- 172.21.15.57:0/3792339287 >> 172.21.15.57:0/3792339287 conn(0x55b14e7eac50 msgr2=0x55b14e7f0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1617b72b80 1 -- 172.21.15.57:0/3792339287 shutdown_connections 2023-03-02T10:57:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1617b72b80 1 -- 172.21.15.57:0/3792339287 wait complete. 2023-03-02T10:57:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1617b72b80 1 -- start start 2023-03-02T10:57:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.972+0000 7f1617b72b80 1 Processor -- start 2023-03-02T10:57:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e801800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e7fea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7fa110 0x55b14e7ff060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f1617b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e74dbc0 con 0x55b14e7f53c0 2023-03-02T10:57:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f1617b72b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e7470f0 con 0x55b14e7fa110 2023-03-02T10:57:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f1617b72b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e5cb920 con 0x55b14e7f5cd0 2023-03-02T10:57:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f1617b72b80 10 client.0 _ll_register_callbacks cb 0x55b14e6ed520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f160279c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e801800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f160279c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e801800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50088/0 (socket says 172.21.15.57:50088) 2023-03-02T10:57:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f160279c700 1 -- 172.21.15.57:0/1153800720 learned_addr learned my addr 172.21.15.57:0/1153800720 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f160179a700 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e7fea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f160279c700 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7fa110 0x55b14e7ff060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f160279c700 1 -- 172.21.15.57:0/1153800720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 msgr2=0x55b14e7fea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f160279c700 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e7fea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f160279c700 1 -- 172.21.15.57:0/1153800720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7fa110 msgr2=0x55b14e7ff060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f160279c700 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7fa110 0x55b14e7ff060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.973+0000 7f160279c700 1 -- 172.21.15.57:0/1153800720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f4009280 con 0x55b14e7f53c0 2023-03-02T10:57:55.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f160279c700 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e801800 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f15f4014fa0 tx=0x7f15f40143e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181fcb95be5ef5c2 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f15e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:55.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f15e57fa700 1 -- 172.21.15.57:0/1153800720 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4027070 con 0x55b14e7f53c0 2023-03-02T10:57:55.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f1617b72b80 1 -- 172.21.15.57:0/1153800720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b14e7187b0 con 0x55b14e7f53c0 2023-03-02T10:57:55.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f15e57fa700 1 -- 172.21.15.57:0/1153800720 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f15f4003a00 con 0x55b14e7f53c0 2023-03-02T10:57:55.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f15e57fa700 1 -- 172.21.15.57:0/1153800720 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15f400e070 con 0x55b14e7f53c0 2023-03-02T10:57:55.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f1617b72b80 10 client.15786 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:55.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f1617b72b80 1 -- 172.21.15.57:0/1153800720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b14e575de0 con 0x55b14e7f53c0 2023-03-02T10:57:55.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f15e57fa700 1 -- 172.21.15.57:0/1153800720 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b14e7187b0 con 0x55b14e7f53c0 2023-03-02T10:57:55.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f15e57fa700 1 -- 172.21.15.57:0/1153800720 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f15f401e6b0 con 0x55b14e7f53c0 2023-03-02T10:57:55.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f1617b72b80 10 client.15786 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:55.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.974+0000 7f1617b72b80 10 client.15786 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-02T10:57:55.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.975+0000 7f1617b72b80 20 client.15786 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:55.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.975+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55b14e80f0b0 0x55b14e8114c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.975+0000 7f1617b72b80 4 client.15786 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:55.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.975+0000 7f1617b72b80 1 -- 172.21.15.57:0/1153800720 --> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b14e740170 con 0x55b14e80f0b0 2023-03-02T10:57:55.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.975+0000 7f160179a700 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55b14e80f0b0 0x55b14e8114c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.975+0000 7f160179a700 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55b14e80f0b0 0x55b14e8114c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ba20d0c11852288c server_cookie=8b203245b10a72d7 in_seq=0 out_seq=0 2023-03-02T10:57:55.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.975+0000 7f15e57fa700 10 client.15786 ms_handle_connect on v2:172.21.15.136:6834/2199127047 2023-03-02T10:57:55.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f15e57fa700 1 -- 172.21.15.57:0/1153800720 <== mds.3 v2:172.21.15.136:6834/2199127047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55b14e740170 con 0x55b14e80f0b0 2023-03-02T10:57:55.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f15e57fa700 10 client.15786 handle_command_reply: tid=0 2023-03-02T10:57:55.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f1617b72b80 1 client.15786 shutdown 2023-03-02T10:57:55.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f1617b72b80 1 -- 172.21.15.57:0/1153800720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 msgr2=0x55b14e801800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e801800 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f15f4014fa0 tx=0x7f15f40143e0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f1617b72b80 1 -- 172.21.15.57:0/1153800720 shutdown_connections 2023-03-02T10:57:55.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55b14e80f0b0 0x55b14e8114c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7fa110 0x55b14e7ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e801800 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f15e57fa700 0 client.15786 ms_handle_reset on v2:172.21.15.136:6834/2199127047 2023-03-02T10:57:55.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1153800720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e7fea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f1617b72b80 1 -- 172.21.15.57:0/1153800720 >> 172.21.15.57:0/1153800720 conn(0x55b14e7eac50 msgr2=0x55b14e7ef6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f1617b72b80 1 -- 172.21.15.57:0/1153800720 shutdown_connections 2023-03-02T10:57:55.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.976+0000 7f1617b72b80 1 -- 172.21.15.57:0/1153800720 wait complete. 2023-03-02T10:57:55.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.977+0000 7f1617b72b80 20 client.15786 trim_cache size 0 max 16384 2023-03-02T10:57:55.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.989+0000 7f1617b72b80 1 Processor -- start 2023-03-02T10:57:55.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.989+0000 7f1617b72b80 1 -- start start 2023-03-02T10:57:55.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e7f9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e8013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7fa110 0x55b14e7f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f1617b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e7f1a90 con 0x55b14e7f53c0 2023-03-02T10:57:55.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f1617b72b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e7f6420 con 0x55b14e7fa110 2023-03-02T10:57:55.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f1617b72b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e801de0 con 0x55b14e7f5cd0 2023-03-02T10:57:55.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f160279c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e7f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f160279c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e7f9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50096/0 (socket says 172.21.15.57:50096) 2023-03-02T10:57:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f160279c700 1 -- 172.21.15.57:0/61967792 learned_addr learned my addr 172.21.15.57:0/61967792 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f160179a700 1 --2- 172.21.15.57:0/61967792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e8013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f160279c700 1 --2- 172.21.15.57:0/61967792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7fa110 0x55b14e7f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f160279c700 1 -- 172.21.15.57:0/61967792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 msgr2=0x55b14e8013a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f160279c700 1 --2- 172.21.15.57:0/61967792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e8013a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f160279c700 1 -- 172.21.15.57:0/61967792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7fa110 msgr2=0x55b14e7f7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f160279c700 1 --2- 172.21.15.57:0/61967792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7fa110 0x55b14e7f7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.990+0000 7f160279c700 1 -- 172.21.15.57:0/61967792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b14e70e190 con 0x55b14e7f53c0 2023-03-02T10:57:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.991+0000 7f160279c700 1 --2- 172.21.15.57:0/61967792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e7f9280 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f15f40061e0 tx=0x7f15f40021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39350f15300f1ab2 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.991+0000 7f15f0ff9700 1 -- 172.21.15.57:0/61967792 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400e030 con 0x55b14e7f53c0 2023-03-02T10:57:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.991+0000 7f15f0ff9700 1 -- 172.21.15.57:0/61967792 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15f4028040 con 0x55b14e7f53c0 2023-03-02T10:57:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.991+0000 7f15f0ff9700 1 -- 172.21.15.57:0/61967792 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4027070 con 0x55b14e7f53c0 2023-03-02T10:57:55.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.992+0000 7f1617b72b80 1 -- 172.21.15.57:0/61967792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 msgr2=0x55b14e7f9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:55.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.992+0000 7f1617b72b80 1 --2- 172.21.15.57:0/61967792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e7f9280 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f15f40061e0 tx=0x7f15f40021d0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.992+0000 7f1617b72b80 1 -- 172.21.15.57:0/61967792 shutdown_connections 2023-03-02T10:57:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.992+0000 7f1617b72b80 1 --2- 172.21.15.57:0/61967792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7fa110 0x55b14e7f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.992+0000 7f1617b72b80 1 --2- 172.21.15.57:0/61967792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7f53c0 0x55b14e7f9280 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.992+0000 7f1617b72b80 1 --2- 172.21.15.57:0/61967792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f5cd0 0x55b14e8013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.992+0000 7f1617b72b80 1 -- 172.21.15.57:0/61967792 >> 172.21.15.57:0/61967792 conn(0x55b14e7eac50 msgr2=0x55b14e7f8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.992+0000 7f1617b72b80 1 -- 172.21.15.57:0/61967792 shutdown_connections 2023-03-02T10:57:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.992+0000 7f1617b72b80 1 -- 172.21.15.57:0/61967792 wait complete. 2023-03-02T10:57:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.992+0000 7f1617b72b80 1 -- start start 2023-03-02T10:57:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.992+0000 7f1617b72b80 1 Processor -- start 2023-03-02T10:57:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f53c0 0x55b14e7fe900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f5cd0 0x55b14e7fd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f1617b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 0x55b14e7fd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f1617b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e7fdd10 con 0x55b14e7fa110 2023-03-02T10:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f1617b72b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e7fde50 con 0x55b14e7f5cd0 2023-03-02T10:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f1617b72b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14e7fe010 con 0x55b14e7f53c0 2023-03-02T10:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f1617b72b80 10 client.0 _ll_register_callbacks cb 0x55b14e6ed520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160279c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 0x55b14e7fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160179a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f5cd0 0x55b14e7fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160279c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 0x55b14e7fd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50098/0 (socket says 172.21.15.57:50098) 2023-03-02T10:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160279c700 1 -- 172.21.15.57:0/1325009476 learned_addr learned my addr 172.21.15.57:0/1325009476 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160179a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f5cd0 0x55b14e7fd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:34306/0 (socket says 172.21.15.57:34306) 2023-03-02T10:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160279c700 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f53c0 0x55b14e7fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160179a700 1 -- 172.21.15.57:0/1325009476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f53c0 msgr2=0x55b14e7fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160179a700 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f53c0 0x55b14e7fe900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160179a700 1 -- 172.21.15.57:0/1325009476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 msgr2=0x55b14e7fd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160179a700 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 0x55b14e7fd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160179a700 1 -- 172.21.15.57:0/1325009476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b14e575de0 con 0x55b14e7f5cd0 2023-03-02T10:57:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160279c700 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 0x55b14e7fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f160179a700 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f5cd0 0x55b14e7fd250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00b2e0 tx=0x7f15ec00bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffd3117474f581b9 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.993+0000 7f15e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f15e57fa700 1 -- 172.21.15.57:0/1325009476 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec01d070 con 0x55b14e7f5cd0 2023-03-02T10:57:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f1617b72b80 1 -- 172.21.15.57:0/1325009476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15f400f040 con 0x55b14e7f5cd0 2023-03-02T10:57:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f15e57fa700 1 -- 172.21.15.57:0/1325009476 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f15ec0280d0 con 0x55b14e7f5cd0 2023-03-02T10:57:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f15e57fa700 1 -- 172.21.15.57:0/1325009476 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15ec028290 con 0x55b14e7f5cd0 2023-03-02T10:57:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f1617b72b80 10 client.25643 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f1617b72b80 1 -- 172.21.15.57:0/1325009476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b14e59c250 con 0x55b14e7f5cd0 2023-03-02T10:57:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f15e57fa700 1 -- 172.21.15.57:0/1325009476 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15f400f040 con 0x55b14e7f5cd0 2023-03-02T10:57:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f15e57fa700 1 -- 172.21.15.57:0/1325009476 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f15ec004500 con 0x55b14e7f5cd0 2023-03-02T10:57:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f1617b72b80 10 client.25643 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f1617b72b80 10 client.25643 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-02T10:57:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f1617b72b80 20 client.25643 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55b14e861eb0 0x55b14e8642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f1617b72b80 4 client.25643 mds_command: new command op to 24493 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:57:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.994+0000 7f1617b72b80 1 -- 172.21.15.57:0/1325009476 --> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b14e73fe90 con 0x55b14e861eb0 2023-03-02T10:57:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.995+0000 7f160279c700 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55b14e861eb0 0x55b14e8642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.995+0000 7f15e57fa700 10 client.25643 ms_handle_connect on v2:172.21.15.136:6834/2199127047 2023-03-02T10:57:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.995+0000 7f160279c700 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55b14e861eb0 0x55b14e8642c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a8d5ba6f2c316b75 server_cookie=cb6275792c964116 in_seq=0 out_seq=0 2023-03-02T10:57:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.995+0000 7f15e57fa700 1 -- 172.21.15.57:0/1325009476 <== mds.3 v2:172.21.15.136:6834/2199127047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b14e73fe90 con 0x55b14e861eb0 2023-03-02T10:57:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.995+0000 7f15e57fa700 10 client.25643 handle_command_reply: tid=0 2023-03-02T10:57:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.995+0000 7f1617b72b80 1 client.25643 shutdown 2023-03-02T10:57:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f1617b72b80 1 -- 172.21.15.57:0/1325009476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f5cd0 msgr2=0x55b14e7fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f5cd0 0x55b14e7fd250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00b2e0 tx=0x7f15ec00bc30 comp rx=0 tx=0).stop 2023-03-02T10:57:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f1617b72b80 1 -- 172.21.15.57:0/1325009476 shutdown_connections 2023-03-02T10:57:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55b14e861eb0 0x55b14e8642c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b14e7fa110 0x55b14e7fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b14e7f53c0 0x55b14e7fe900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f1617b72b80 1 --2- 172.21.15.57:0/1325009476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b14e7f5cd0 0x55b14e7fd250 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f15e57fa700 0 client.25643 ms_handle_reset on v2:172.21.15.136:6834/2199127047 2023-03-02T10:57:56.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f1617b72b80 1 -- 172.21.15.57:0/1325009476 >> 172.21.15.57:0/1325009476 conn(0x55b14e7eac50 msgr2=0x55b14e7f4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f1617b72b80 1 -- 172.21.15.57:0/1325009476 shutdown_connections 2023-03-02T10:57:56.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f1617b72b80 1 -- 172.21.15.57:0/1325009476 wait complete. 2023-03-02T10:57:56.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f1617b72b80 20 client.25643 trim_cache size 0 max 16384 2023-03-02T10:57:56.007 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:57:56.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f16041ff700 1 -- 172.21.15.57:0/3368289386 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f15e809b540 msgr2=0x7f15e809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f16041ff700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f15e809b540 0x7f15e809d9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15f80944b0 tx=0x7f15f80c8a60 comp rx=0 tx=0).stop 2023-03-02T10:57:56.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f16041ff700 1 -- 172.21.15.57:0/3368289386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15fc100b40 msgr2=0x7f15fc0fe970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f16041ff700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15fc100b40 0x7f15fc0fe970 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f15f800e9a0 tx=0x7f15f800ecb0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f16041ff700 1 -- 172.21.15.57:0/3368289386 shutdown_connections 2023-03-02T10:57:56.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.996+0000 7f16041ff700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f15e809b540 0x7f15e809d9f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.997+0000 7f16041ff700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15fc10a060 0x7f15fc1a3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.997+0000 7f16041ff700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15fc100b40 0x7f15fc0fe970 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.997+0000 7f16041ff700 1 --2- 172.21.15.57:0/3368289386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15fc101450 0x7f15fc0feeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.997+0000 7f16041ff700 1 -- 172.21.15.57:0/3368289386 >> 172.21.15.57:0/3368289386 conn(0x7f15fc0fa4b0 msgr2=0x7f15fc10c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.997+0000 7f16041ff700 1 -- 172.21.15.57:0/3368289386 shutdown_connections 2023-03-02T10:57:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:55.997+0000 7f16041ff700 1 -- 172.21.15.57:0/3368289386 wait complete. 2023-03-02T10:57:56.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-03-02T10:57:56.086 INFO:teuthology.orchestra.run.smithi057.stderr:27100000 of 50000000 tuples (54%) done (elapsed 40.89 s, remaining 34.55 s) 2023-03-02T10:57:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:55 smithi136 ceph-mon[125702]: pgmap v30: 97 pgs: 97 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 149 MiB/s wr, 86 op/s 2023-03-02T10:57:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:55 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/1259626179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:57:56.197 INFO:teuthology.orchestra.run.smithi057.stderr:27200000 of 50000000 tuples (54%) done (elapsed 41.00 s, remaining 34.37 s) 2023-03-02T10:57:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.216+0000 7f54bafff700 1 -- 172.21.15.57:0/3261973178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54b4100ce0 msgr2=0x7f54b41010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.216+0000 7f54bafff700 1 --2- 172.21.15.57:0/3261973178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54b4100ce0 0x7f54b41010b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009990 tx=0x7f54a8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.216+0000 7f54bafff700 1 -- 172.21.15.57:0/3261973178 shutdown_connections 2023-03-02T10:57:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.216+0000 7f54bafff700 1 --2- 172.21.15.57:0/3261973178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54b410a020 0x7f54b410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.216+0000 7f54bafff700 1 --2- 172.21.15.57:0/3261973178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54b4100ce0 0x7f54b41010b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.216+0000 7f54bafff700 1 --2- 172.21.15.57:0/3261973178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b41015f0 0x7f54b4109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.216+0000 7f54bafff700 1 -- 172.21.15.57:0/3261973178 >> 172.21.15.57:0/3261973178 conn(0x7f54b40fa4b0 msgr2=0x7f54b40fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.217+0000 7f54bafff700 1 -- 172.21.15.57:0/3261973178 shutdown_connections 2023-03-02T10:57:56.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.217+0000 7f54bafff700 1 -- 172.21.15.57:0/3261973178 wait complete. 2023-03-02T10:57:56.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.217+0000 7f54bafff700 1 Processor -- start 2023-03-02T10:57:56.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.217+0000 7f54bafff700 1 -- start start 2023-03-02T10:57:56.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54bafff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54b4100ce0 0x7f54b40fe930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54bafff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54b41015f0 0x7f54b40fee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54bafff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b410a020 0x7f54b41a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54bafff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40ff6a0 con 0x7f54b4100ce0 2023-03-02T10:57:56.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54bafff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b41a42e0 con 0x7f54b410a020 2023-03-02T10:57:56.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54bafff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b41a4420 con 0x7f54b41015f0 2023-03-02T10:57:56.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54b8d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54b4100ce0 0x7f54b40fe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54b8d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54b4100ce0 0x7f54b40fe930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43474/0 (socket says 172.21.15.57:43474) 2023-03-02T10:57:56.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54b8d9b700 1 -- 172.21.15.57:0/3908778104 learned_addr learned my addr 172.21.15.57:0/3908778104 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54b959c700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b410a020 0x7f54b41a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54b3fff700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54b41015f0 0x7f54b40fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54b8d9b700 1 -- 172.21.15.57:0/3908778104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54b41015f0 msgr2=0x7f54b40fee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54b41015f0 0x7f54b40fee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54b8d9b700 1 -- 172.21.15.57:0/3908778104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b410a020 msgr2=0x7f54b41a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b410a020 0x7f54b41a3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.218+0000 7f54b8d9b700 1 -- 172.21.15.57:0/3908778104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0009520 con 0x7f54b4100ce0 2023-03-02T10:57:56.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.219+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54b4100ce0 0x7f54b40fe930 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f54a8000c00 tx=0x7f54a8004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.219+0000 7f54b1ffb700 1 -- 172.21.15.57:0/3908778104 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a801d070 con 0x7f54b4100ce0 2023-03-02T10:57:56.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.219+0000 7f54bafff700 1 -- 172.21.15.57:0/3908778104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a80095f0 con 0x7f54b4100ce0 2023-03-02T10:57:56.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.219+0000 7f54b1ffb700 1 -- 172.21.15.57:0/3908778104 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54a8021410 con 0x7f54b4100ce0 2023-03-02T10:57:56.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.219+0000 7f54b1ffb700 1 -- 172.21.15.57:0/3908778104 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8017650 con 0x7f54b4100ce0 2023-03-02T10:57:56.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.219+0000 7f54bafff700 1 -- 172.21.15.57:0/3908778104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b410fac0 con 0x7f54b4100ce0 2023-03-02T10:57:56.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.223+0000 7f54b1ffb700 1 -- 172.21.15.57:0/3908778104 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f54a8028030 con 0x7f54b4100ce0 2023-03-02T10:57:56.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.224+0000 7f54b1ffb700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f54a409b4c0 0x7f54a409d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.224+0000 7f54ce831b80 1 Processor -- start 2023-03-02T10:57:56.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.225+0000 7f54b1ffb700 1 -- 172.21.15.57:0/3908778104 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f54a80c63f0 con 0x7f54b4100ce0 2023-03-02T10:57:56.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.225+0000 7f54b3fff700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f54a409b4c0 0x7f54a409d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.225+0000 7f54ce831b80 1 -- start start 2023-03-02T10:57:56.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.225+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82174c3c0 0x55a82174c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.225+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174ccd0 0x55a821750bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.225+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a821751110 0x55a821751560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.225+0000 7f54ce831b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8216b3a60 con 0x55a821751110 2023-03-02T10:57:56.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.225+0000 7f54ce831b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a821665f80 con 0x55a82174c3c0 2023-03-02T10:57:56.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.225+0000 7f54ce831b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a821636160 con 0x55a82174ccd0 2023-03-02T10:57:56.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.225+0000 7f54b3fff700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f54a409b4c0 0x7f54a409d970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54b4100120 tx=0x7f54a0009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.225+0000 7f54b959c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a821751110 0x55a821751560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b959c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a821751110 0x55a821751560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43488/0 (socket says 172.21.15.57:43488) 2023-03-02T10:57:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b959c700 1 -- 172.21.15.57:0/946311409 learned_addr learned my addr 172.21.15.57:0/946311409 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b3fff700 1 --2- 172.21.15.57:0/946311409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174ccd0 0x55a821750bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/946311409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82174c3c0 0x55a82174c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b959c700 1 -- 172.21.15.57:0/946311409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174ccd0 msgr2=0x55a821750bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b959c700 1 --2- 172.21.15.57:0/946311409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174ccd0 0x55a821750bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b959c700 1 -- 172.21.15.57:0/946311409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82174c3c0 msgr2=0x55a82174c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b959c700 1 --2- 172.21.15.57:0/946311409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82174c3c0 0x55a82174c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b959c700 1 -- 172.21.15.57:0/946311409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a821520630 con 0x55a821751110 2023-03-02T10:57:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b3fff700 1 --2- 172.21.15.57:0/946311409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174ccd0 0x55a821750bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/946311409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82174c3c0 0x55a82174c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f54b959c700 1 --2- 172.21.15.57:0/946311409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a821751110 0x55a821751560 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f54ac011600 tx=0x7f54ac009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bd2c0f143f728 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f549effd700 1 -- 172.21.15.57:0/946311409 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00e040 con 0x55a821751110 2023-03-02T10:57:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f549effd700 1 -- 172.21.15.57:0/946311409 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54ac00f040 con 0x55a821751110 2023-03-02T10:57:56.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.226+0000 7f549effd700 1 -- 172.21.15.57:0/946311409 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0047a0 con 0x55a821751110 2023-03-02T10:57:56.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.227+0000 7f54ce831b80 1 -- 172.21.15.57:0/946311409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a821751110 msgr2=0x55a821751560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.227+0000 7f54ce831b80 1 --2- 172.21.15.57:0/946311409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a821751110 0x55a821751560 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f54ac011600 tx=0x7f54ac009920 comp rx=0 tx=0).stop 2023-03-02T10:57:56.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.227+0000 7f54ce831b80 1 -- 172.21.15.57:0/946311409 shutdown_connections 2023-03-02T10:57:56.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.227+0000 7f54ce831b80 1 --2- 172.21.15.57:0/946311409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a821751110 0x55a821751560 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.227+0000 7f54ce831b80 1 --2- 172.21.15.57:0/946311409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82174c3c0 0x55a82174c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.227+0000 7f54ce831b80 1 --2- 172.21.15.57:0/946311409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174ccd0 0x55a821750bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.227+0000 7f54ce831b80 1 -- 172.21.15.57:0/946311409 >> 172.21.15.57:0/946311409 conn(0x55a821741c50 msgr2=0x55a821747460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.227+0000 7f54ce831b80 1 -- 172.21.15.57:0/946311409 shutdown_connections 2023-03-02T10:57:56.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.227+0000 7f54ce831b80 1 -- 172.21.15.57:0/946311409 wait complete. 2023-03-02T10:57:56.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.228+0000 7f54ce831b80 1 -- start start 2023-03-02T10:57:56.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.228+0000 7f54ce831b80 1 Processor -- start 2023-03-02T10:57:56.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82174c3c0 0x55a821755ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a8217561e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a821751110 0x55a821756720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54ce831b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8216a4bc0 con 0x55a82174ccd0 2023-03-02T10:57:56.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54ce831b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82169e0f0 con 0x55a82174c3c0 2023-03-02T10:57:56.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54ce831b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a821522920 con 0x55a821751110 2023-03-02T10:57:56.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54ce831b80 10 client.0 _ll_register_callbacks cb 0x55a821644520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:56.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54b3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a8217561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54b3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a8217561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43490/0 (socket says 172.21.15.57:43490) 2023-03-02T10:57:56.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54b8d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82174c3c0 0x55a821755ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54b3fff700 1 -- 172.21.15.57:0/631001495 learned_addr learned my addr 172.21.15.57:0/631001495 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54b959c700 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a821751110 0x55a821756720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54b3fff700 1 -- 172.21.15.57:0/631001495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a821751110 msgr2=0x55a821756720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54b3fff700 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a821751110 0x55a821756720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54b3fff700 1 -- 172.21.15.57:0/631001495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82174c3c0 msgr2=0x55a821755ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54b3fff700 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82174c3c0 0x55a821755ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.229+0000 7f54b3fff700 1 -- 172.21.15.57:0/631001495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ac0112b0 con 0x55a82174ccd0 2023-03-02T10:57:56.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.230+0000 7f54b3fff700 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a8217561e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f54a0003900 tx=0x7f54a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f9df36f9745213 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.230+0000 7f5493fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:56.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.230+0000 7f5493fff700 1 -- 172.21.15.57:0/631001495 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0022070 con 0x55a82174ccd0 2023-03-02T10:57:56.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.230+0000 7f5493fff700 1 -- 172.21.15.57:0/631001495 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f54a000e450 con 0x55a82174ccd0 2023-03-02T10:57:56.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.230+0000 7f54ce831b80 1 -- 172.21.15.57:0/631001495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a82166f7b0 con 0x55a82174ccd0 2023-03-02T10:57:56.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.230+0000 7f5493fff700 1 -- 172.21.15.57:0/631001495 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54a000e650 con 0x55a82174ccd0 2023-03-02T10:57:56.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.230+0000 7f54ce831b80 10 client.15804 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:56.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.230+0000 7f54ce831b80 1 -- 172.21.15.57:0/631001495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55a8214ccde0 con 0x55a82174ccd0 2023-03-02T10:57:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.230+0000 7f5493fff700 1 -- 172.21.15.57:0/631001495 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a82166f7b0 con 0x55a82174ccd0 2023-03-02T10:57:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.231+0000 7f5493fff700 1 -- 172.21.15.57:0/631001495 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f54a001ca60 con 0x55a82174ccd0 2023-03-02T10:57:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.231+0000 7f54ce831b80 10 client.15804 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.231+0000 7f54ce831b80 10 client.15804 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-02T10:57:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.231+0000 7f54ce831b80 20 client.15804 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.231+0000 7f54ce831b80 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55a8217662e0 0x55a8217686f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.231+0000 7f54ce831b80 4 client.15804 mds_command: new command op to 24505 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.231+0000 7f54ce831b80 1 -- 172.21.15.57:0/631001495 --> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a821697170 con 0x55a8217662e0 2023-03-02T10:57:56.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.231+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55a8217662e0 0x55a8217686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.232+0000 7f5493fff700 10 client.15804 ms_handle_connect on v2:172.21.15.136:6836/2130761226 2023-03-02T10:57:56.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.232+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55a8217662e0 0x55a8217686f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41cb9e38b6d3efeb server_cookie=37239988a7dc3876 in_seq=0 out_seq=0 2023-03-02T10:57:56.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.232+0000 7f5493fff700 1 -- 172.21.15.57:0/631001495 <== mds.2 v2:172.21.15.136:6836/2130761226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55a821697170 con 0x55a8217662e0 2023-03-02T10:57:56.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.232+0000 7f5493fff700 10 client.15804 handle_command_reply: tid=0 2023-03-02T10:57:56.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.232+0000 7f54ce831b80 1 client.15804 shutdown 2023-03-02T10:57:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.232+0000 7f54ce831b80 1 -- 172.21.15.57:0/631001495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 msgr2=0x55a8217561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.232+0000 7f54ce831b80 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a8217561e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f54a0003900 tx=0x7f54a00047c0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.232+0000 7f54ce831b80 1 -- 172.21.15.57:0/631001495 shutdown_connections 2023-03-02T10:57:56.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.233+0000 7f54ce831b80 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55a8217662e0 0x55a8217686f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.233+0000 7f54ce831b80 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a821751110 0x55a821756720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.233+0000 7f5493fff700 0 client.15804 ms_handle_reset on v2:172.21.15.136:6836/2130761226 2023-03-02T10:57:56.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.233+0000 7f54ce831b80 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82174c3c0 0x55a821755ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.233+0000 7f54ce831b80 1 --2- 172.21.15.57:0/631001495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a8217561e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.233+0000 7f54ce831b80 1 -- 172.21.15.57:0/631001495 >> 172.21.15.57:0/631001495 conn(0x55a821741c50 msgr2=0x55a821747050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.233+0000 7f54ce831b80 1 -- 172.21.15.57:0/631001495 shutdown_connections 2023-03-02T10:57:56.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.233+0000 7f54ce831b80 1 -- 172.21.15.57:0/631001495 wait complete. 2023-03-02T10:57:56.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.233+0000 7f54ce831b80 20 client.15804 trim_cache size 0 max 16384 2023-03-02T10:57:56.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54ce831b80 1 Processor -- start 2023-03-02T10:57:56.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54ce831b80 1 -- start start 2023-03-02T10:57:56.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174c3c0 0x55a82174ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174ccd0 0x55a8217524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 0x55a8217617e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54ce831b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8217476b0 con 0x55a82174c3c0 2023-03-02T10:57:56.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54ce831b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a821747820 con 0x55a821751110 2023-03-02T10:57:56.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54ce831b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a821752a60 con 0x55a82174ccd0 2023-03-02T10:57:56.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54b8d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174c3c0 0x55a82174ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54b8d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174c3c0 0x55a82174ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43492/0 (socket says 172.21.15.57:43492) 2023-03-02T10:57:56.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54b8d9b700 1 -- 172.21.15.57:0/337146427 learned_addr learned my addr 172.21.15.57:0/337146427 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.260+0000 7f54b959c700 1 --2- 172.21.15.57:0/337146427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 0x55a8217617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.261+0000 7f54b3fff700 1 --2- 172.21.15.57:0/337146427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174ccd0 0x55a8217524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.261+0000 7f54b8d9b700 1 -- 172.21.15.57:0/337146427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174ccd0 msgr2=0x55a8217524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.261+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/337146427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174ccd0 0x55a8217524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.261+0000 7f54b8d9b700 1 -- 172.21.15.57:0/337146427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 msgr2=0x55a8217617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.261+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/337146427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 0x55a8217617e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.261+0000 7f54b8d9b700 1 -- 172.21.15.57:0/337146427 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a821665190 con 0x55a82174c3c0 2023-03-02T10:57:56.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.261+0000 7f54b959c700 1 --2- 172.21.15.57:0/337146427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 0x55a8217617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.261+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/337146427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174c3c0 0x55a82174ea00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f54a8006010 tx=0x7f54a8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5987f4a873bb917 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.261+0000 7f549f7fe700 1 -- 172.21.15.57:0/337146427 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a80958a0 con 0x55a82174c3c0 2023-03-02T10:57:56.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.261+0000 7f549f7fe700 1 -- 172.21.15.57:0/337146427 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54a809cf30 con 0x55a82174c3c0 2023-03-02T10:57:56.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.261+0000 7f549f7fe700 1 -- 172.21.15.57:0/337146427 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8021860 con 0x55a82174c3c0 2023-03-02T10:57:56.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.262+0000 7f54ce831b80 1 -- 172.21.15.57:0/337146427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174c3c0 msgr2=0x55a82174ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.262+0000 7f54ce831b80 1 --2- 172.21.15.57:0/337146427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174c3c0 0x55a82174ea00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f54a8006010 tx=0x7f54a8009310 comp rx=0 tx=0).stop 2023-03-02T10:57:56.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.262+0000 7f54ce831b80 1 -- 172.21.15.57:0/337146427 shutdown_connections 2023-03-02T10:57:56.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.262+0000 7f54ce831b80 1 --2- 172.21.15.57:0/337146427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 0x55a8217617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.262+0000 7f54ce831b80 1 --2- 172.21.15.57:0/337146427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174c3c0 0x55a82174ea00 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.262+0000 7f54ce831b80 1 --2- 172.21.15.57:0/337146427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174ccd0 0x55a8217524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.262+0000 7f54ce831b80 1 -- 172.21.15.57:0/337146427 >> 172.21.15.57:0/337146427 conn(0x55a821741c50 msgr2=0x55a821756590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.262+0000 7f54ce831b80 1 -- 172.21.15.57:0/337146427 shutdown_connections 2023-03-02T10:57:56.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.262+0000 7f54ce831b80 1 -- 172.21.15.57:0/337146427 wait complete. 2023-03-02T10:57:56.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.262+0000 7f54ce831b80 1 -- start start 2023-03-02T10:57:56.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54ce831b80 1 Processor -- start 2023-03-02T10:57:56.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174c3c0 0x55a82175ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a82175b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54ce831b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 0x55a82175b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54ce831b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82175bda0 con 0x55a82174ccd0 2023-03-02T10:57:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54ce831b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82175bf10 con 0x55a821751110 2023-03-02T10:57:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54ce831b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82175c0d0 con 0x55a82174c3c0 2023-03-02T10:57:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54ce831b80 10 client.0 _ll_register_callbacks cb 0x55a821644520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54b3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a82175b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54b3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a82175b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43508/0 (socket says 172.21.15.57:43508) 2023-03-02T10:57:56.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54b3fff700 1 -- 172.21.15.57:0/1765688201 learned_addr learned my addr 172.21.15.57:0/1765688201 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54b959c700 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 0x55a82175b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.263+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174c3c0 0x55a82175ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f54b3fff700 1 -- 172.21.15.57:0/1765688201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174c3c0 msgr2=0x55a82175ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f54b3fff700 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174c3c0 0x55a82175ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f54b3fff700 1 -- 172.21.15.57:0/1765688201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 msgr2=0x55a82175b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f54b3fff700 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 0x55a82175b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f54b3fff700 1 -- 172.21.15.57:0/1765688201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a821520630 con 0x55a82174ccd0 2023-03-02T10:57:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f54b959c700 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 0x55a82175b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f54b3fff700 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a82175b320 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f54a001cdf0 tx=0x7f54a001dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e449c0f1bb2d4bf server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f5493fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f5493fff700 1 -- 172.21.15.57:0/1765688201 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0022040 con 0x55a82174ccd0 2023-03-02T10:57:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f54ce831b80 1 -- 172.21.15.57:0/1765688201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54ac00f040 con 0x55a82174ccd0 2023-03-02T10:57:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f5493fff700 1 -- 172.21.15.57:0/1765688201 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f54a00092d0 con 0x55a82174ccd0 2023-03-02T10:57:56.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f5493fff700 1 -- 172.21.15.57:0/1765688201 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54a0011ab0 con 0x55a82174ccd0 2023-03-02T10:57:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f54ce831b80 10 client.15810 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f54ce831b80 1 -- 172.21.15.57:0/1765688201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f54a80095f0 con 0x55a82174ccd0 2023-03-02T10:57:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.264+0000 7f5493fff700 1 -- 172.21.15.57:0/1765688201 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54ac00f040 con 0x55a82174ccd0 2023-03-02T10:57:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.265+0000 7f5493fff700 1 -- 172.21.15.57:0/1765688201 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f54a0027a70 con 0x55a82174ccd0 2023-03-02T10:57:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.265+0000 7f54ce831b80 10 client.15810 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.265+0000 7f54ce831b80 10 client.15810 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-02T10:57:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.265+0000 7f54ce831b80 20 client.15810 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.265+0000 7f54ce831b80 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55a8217b8f00 0x55a8217bb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.265+0000 7f54ce831b80 4 client.15810 mds_command: new command op to 24505 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:57:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.265+0000 7f54ce831b80 1 -- 172.21.15.57:0/1765688201 --> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a821696e90 con 0x55a8217b8f00 2023-03-02T10:57:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.265+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55a8217b8f00 0x55a8217bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f5493fff700 10 client.15810 ms_handle_connect on v2:172.21.15.136:6836/2130761226 2023-03-02T10:57:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54b8d9b700 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55a8217b8f00 0x55a8217bb310 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad34194239fed1ee server_cookie=9b9ff24e553ca15e in_seq=0 out_seq=0 2023-03-02T10:57:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f5493fff700 1 -- 172.21.15.57:0/1765688201 <== mds.2 v2:172.21.15.136:6836/2130761226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a821696e90 con 0x55a8217b8f00 2023-03-02T10:57:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f5493fff700 10 client.15810 handle_command_reply: tid=0 2023-03-02T10:57:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 1 client.15810 shutdown 2023-03-02T10:57:56.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 1 -- 172.21.15.57:0/1765688201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 msgr2=0x55a82175b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a82175b320 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f54a001cdf0 tx=0x7f54a001dc20 comp rx=0 tx=0).stop 2023-03-02T10:57:56.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 1 -- 172.21.15.57:0/1765688201 shutdown_connections 2023-03-02T10:57:56.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x55a8217b8f00 0x55a8217bb310 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a821751110 0x55a82175b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a82174c3c0 0x55a82175ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 1 --2- 172.21.15.57:0/1765688201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a82174ccd0 0x55a82175b320 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f5493fff700 0 client.15810 ms_handle_reset on v2:172.21.15.136:6836/2130761226 2023-03-02T10:57:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 1 -- 172.21.15.57:0/1765688201 >> 172.21.15.57:0/1765688201 conn(0x55a821741c50 msgr2=0x55a8217617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 1 -- 172.21.15.57:0/1765688201 shutdown_connections 2023-03-02T10:57:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 1 -- 172.21.15.57:0/1765688201 wait complete. 2023-03-02T10:57:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.266+0000 7f54ce831b80 20 client.15810 trim_cache size 0 max 16384 2023-03-02T10:57:56.276 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:57:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 -- 172.21.15.57:0/3908778104 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f54a409b4c0 msgr2=0x7f54a409d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f54a409b4c0 0x7f54a409d970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54b4100120 tx=0x7f54a0009260 comp rx=0 tx=0).stop 2023-03-02T10:57:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 -- 172.21.15.57:0/3908778104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54b4100ce0 msgr2=0x7f54b40fe930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54b4100ce0 0x7f54b40fe930 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f54a8000c00 tx=0x7f54a8004790 comp rx=0 tx=0).stop 2023-03-02T10:57:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 -- 172.21.15.57:0/3908778104 shutdown_connections 2023-03-02T10:57:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f54a409b4c0 0x7f54a409d970 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b410a020 0x7f54b41a3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54b4100ce0 0x7f54b40fe930 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 --2- 172.21.15.57:0/3908778104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54b41015f0 0x7f54b40fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 -- 172.21.15.57:0/3908778104 >> 172.21.15.57:0/3908778104 conn(0x7f54b40fa4b0 msgr2=0x7f54b40fb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 -- 172.21.15.57:0/3908778104 shutdown_connections 2023-03-02T10:57:56.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.267+0000 7f54bafff700 1 -- 172.21.15.57:0/3908778104 wait complete. 2023-03-02T10:57:56.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-03-02T10:57:56.320 INFO:teuthology.orchestra.run.smithi057.stderr:27300000 of 50000000 tuples (54%) done (elapsed 41.12 s, remaining 34.20 s) 2023-03-02T10:57:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.333+0000 7f1256bff700 1 -- 172.21.15.57:0/561904448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1250100da0 msgr2=0x7f1250101170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.333+0000 7f1256bff700 1 --2- 172.21.15.57:0/561904448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1250100da0 0x7f1250101170 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1244009990 tx=0x7f1244009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.333+0000 7f1256bff700 1 -- 172.21.15.57:0/561904448 shutdown_connections 2023-03-02T10:57:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.333+0000 7f1256bff700 1 --2- 172.21.15.57:0/561904448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125010a0e0 0x7f125010c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.333+0000 7f1256bff700 1 --2- 172.21.15.57:0/561904448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1250100da0 0x7f1250101170 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.333+0000 7f1256bff700 1 --2- 172.21.15.57:0/561904448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12501016b0 0x7f1250109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.333+0000 7f1256bff700 1 -- 172.21.15.57:0/561904448 >> 172.21.15.57:0/561904448 conn(0x7f12500767e0 msgr2=0x7f1250076be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.333+0000 7f1256bff700 1 -- 172.21.15.57:0/561904448 shutdown_connections 2023-03-02T10:57:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.333+0000 7f1256bff700 1 -- 172.21.15.57:0/561904448 wait complete. 2023-03-02T10:57:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.334+0000 7f1256bff700 1 Processor -- start 2023-03-02T10:57:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.334+0000 7f1256bff700 1 -- start start 2023-03-02T10:57:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.334+0000 7f1256bff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1250100da0 0x7f12500fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.334+0000 7f1256bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12501016b0 0x7f12500fef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.334+0000 7f1256bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f125010a0e0 0x7f12501a3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.334+0000 7f1256bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12500ff760 con 0x7f12501016b0 2023-03-02T10:57:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.334+0000 7f1256bff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12501a43d0 con 0x7f1250100da0 2023-03-02T10:57:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.334+0000 7f1256bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12501a4510 con 0x7f125010a0e0 2023-03-02T10:57:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.335+0000 7f125499b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1250100da0 0x7f12500fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.335+0000 7f125499b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1250100da0 0x7f12500fe9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48734/0 (socket says 172.21.15.57:48734) 2023-03-02T10:57:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.335+0000 7f125499b700 1 -- 172.21.15.57:0/2019129327 learned_addr learned my addr 172.21.15.57:0/2019129327 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.335+0000 7f124ffff700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12501016b0 0x7f12500fef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.335+0000 7f125519c700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f125010a0e0 0x7f12501a3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.335+0000 7f125499b700 1 -- 172.21.15.57:0/2019129327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f125010a0e0 msgr2=0x7f12501a3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.335+0000 7f125499b700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f125010a0e0 0x7f12501a3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.335+0000 7f125499b700 1 -- 172.21.15.57:0/2019129327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12501016b0 msgr2=0x7f12500fef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.335+0000 7f125499b700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12501016b0 0x7f12500fef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.335+0000 7f125499b700 1 -- 172.21.15.57:0/2019129327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248009c40 con 0x7f1250100da0 2023-03-02T10:57:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.335+0000 7f125499b700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1250100da0 0x7f12500fe9f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f124400b680 tx=0x7f1244009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.336+0000 7f124dffb700 1 -- 172.21.15.57:0/2019129327 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124401d070 con 0x7f1250100da0 2023-03-02T10:57:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.336+0000 7f1256bff700 1 -- 172.21.15.57:0/2019129327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12440095f0 con 0x7f1250100da0 2023-03-02T10:57:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.336+0000 7f124dffb700 1 -- 172.21.15.57:0/2019129327 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1244021410 con 0x7f1250100da0 2023-03-02T10:57:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.336+0000 7f124dffb700 1 -- 172.21.15.57:0/2019129327 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244017650 con 0x7f1250100da0 2023-03-02T10:57:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.336+0000 7f1256bff700 1 -- 172.21.15.57:0/2019129327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125010fbc0 con 0x7f1250100da0 2023-03-02T10:57:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.339+0000 7f124dffb700 1 -- 172.21.15.57:0/2019129327 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f1244028030 con 0x7f1250100da0 2023-03-02T10:57:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.340+0000 7f126a478b80 1 Processor -- start 2023-03-02T10:57:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f126a478b80 1 -- start start 2023-03-02T10:57:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f126a478b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 0x55748bd94a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f126a478b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd8ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f126a478b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 0x55748bd8f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f126a478b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bcf6a00 con 0x55748bd95440 2023-03-02T10:57:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f126a478b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bca8f20 con 0x55748bd94fd0 2023-03-02T10:57:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f126a478b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bc79100 con 0x55748bbec6b0 2023-03-02T10:57:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f124dffb700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f124009b4c0 0x7f124009d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f124ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 0x55748bd8f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f124ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 0x55748bd8f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43550/0 (socket says 172.21.15.57:43550) 2023-03-02T10:57:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f124ffff700 1 -- 172.21.15.57:0/3073643323 learned_addr learned my addr 172.21.15.57:0/3073643323 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.341+0000 7f125519c700 1 --2- 172.21.15.57:0/3073643323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 0x55748bd94a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.342+0000 7f124dffb700 1 -- 172.21.15.57:0/2019129327 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f12440c6320 con 0x7f1250100da0 2023-03-02T10:57:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.342+0000 7f125519c700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f124009b4c0 0x7f124009d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.342+0000 7f124ffff700 1 -- 172.21.15.57:0/3073643323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 msgr2=0x55748bd94a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.342+0000 7f124ffff700 1 --2- 172.21.15.57:0/3073643323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 0x55748bd94a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.342+0000 7f124ffff700 1 -- 172.21.15.57:0/3073643323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 msgr2=0x55748bd8ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.342+0000 7f125499b700 1 --2- 172.21.15.57:0/3073643323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd8ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.342+0000 7f124ffff700 1 --2- 172.21.15.57:0/3073643323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd8ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.342+0000 7f124ffff700 1 -- 172.21.15.57:0/3073643323 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55748bb635d0 con 0x55748bd95440 2023-03-02T10:57:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.342+0000 7f125499b700 1 --2- 172.21.15.57:0/3073643323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd8ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:57:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.342+0000 7f124ffff700 1 --2- 172.21.15.57:0/3073643323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 0x55748bd8f4c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f123c009d20 tx=0x7f123c011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ca24a1db304791 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.342+0000 7f125519c700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f124009b4c0 0x7f124009d970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1248004a60 tx=0x7f1248004b40 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.343+0000 7f123affd700 1 -- 172.21.15.57:0/3073643323 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c019630 con 0x55748bd95440 2023-03-02T10:57:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.343+0000 7f123affd700 1 -- 172.21.15.57:0/3073643323 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f123c019c50 con 0x55748bd95440 2023-03-02T10:57:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.343+0000 7f123affd700 1 -- 172.21.15.57:0/3073643323 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c00eb90 con 0x55748bd95440 2023-03-02T10:57:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.344+0000 7f126a478b80 1 -- 172.21.15.57:0/3073643323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 msgr2=0x55748bd8f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.344+0000 7f126a478b80 1 --2- 172.21.15.57:0/3073643323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 0x55748bd8f4c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f123c009d20 tx=0x7f123c011720 comp rx=0 tx=0).stop 2023-03-02T10:57:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.344+0000 7f126a478b80 1 -- 172.21.15.57:0/3073643323 shutdown_connections 2023-03-02T10:57:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.344+0000 7f126a478b80 1 --2- 172.21.15.57:0/3073643323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 0x55748bd8f4c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.344+0000 7f126a478b80 1 --2- 172.21.15.57:0/3073643323 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 0x55748bd94a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.344+0000 7f126a478b80 1 --2- 172.21.15.57:0/3073643323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd8ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.344+0000 7f126a478b80 1 -- 172.21.15.57:0/3073643323 >> 172.21.15.57:0/3073643323 conn(0x55748bd849a0 msgr2=0x55748bd89a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.344+0000 7f126a478b80 1 -- 172.21.15.57:0/3073643323 shutdown_connections 2023-03-02T10:57:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.344+0000 7f126a478b80 1 -- 172.21.15.57:0/3073643323 wait complete. 2023-03-02T10:57:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.345+0000 7f126a478b80 1 -- start start 2023-03-02T10:57:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.345+0000 7f126a478b80 1 Processor -- start 2023-03-02T10:57:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.345+0000 7f126a478b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bbec6b0 0x55748bd9b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.345+0000 7f126a478b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd94fd0 0x55748bd984e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.345+0000 7f126a478b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bd95440 0x55748bd98aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.345+0000 7f126a478b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bce7b60 con 0x55748bd94fd0 2023-03-02T10:57:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.345+0000 7f126a478b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bce1090 con 0x55748bbec6b0 2023-03-02T10:57:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.345+0000 7f126a478b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bb658c0 con 0x55748bd95440 2023-03-02T10:57:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.346+0000 7f126a478b80 10 client.0 _ll_register_callbacks cb 0x55748bc874c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.346+0000 7f124ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd94fd0 0x55748bd984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.346+0000 7f124ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd94fd0 0x55748bd984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43560/0 (socket says 172.21.15.57:43560) 2023-03-02T10:57:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.346+0000 7f124ffff700 1 -- 172.21.15.57:0/3982284343 learned_addr learned my addr 172.21.15.57:0/3982284343 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.346+0000 7f125499b700 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bbec6b0 0x55748bd9b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.346+0000 7f125519c700 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bd95440 0x55748bd98aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.346+0000 7f124ffff700 1 -- 172.21.15.57:0/3982284343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bd95440 msgr2=0x55748bd98aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.346+0000 7f124ffff700 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bd95440 0x55748bd98aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.346+0000 7f124ffff700 1 -- 172.21.15.57:0/3982284343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bbec6b0 msgr2=0x55748bd9b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.346+0000 7f124ffff700 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bbec6b0 0x55748bd9b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.346+0000 7f124ffff700 1 -- 172.21.15.57:0/3982284343 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c009980 con 0x55748bd94fd0 2023-03-02T10:57:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.347+0000 7f124ffff700 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd94fd0 0x55748bd984e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f123c005c50 tx=0x7f123c019ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7c1b0427b493b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.347+0000 7f122ffff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.347+0000 7f122ffff700 1 -- 172.21.15.57:0/3982284343 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c005450 con 0x55748bd94fd0 2023-03-02T10:57:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.347+0000 7f122ffff700 1 -- 172.21.15.57:0/3982284343 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f123c005ce0 con 0x55748bd94fd0 2023-03-02T10:57:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.347+0000 7f126a478b80 1 -- 172.21.15.57:0/3982284343 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55748bcb2750 con 0x55748bd94fd0 2023-03-02T10:57:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.347+0000 7f122ffff700 1 -- 172.21.15.57:0/3982284343 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f123c0055b0 con 0x55748bd94fd0 2023-03-02T10:57:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.347+0000 7f126a478b80 10 client.15822 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.348+0000 7f126a478b80 1 -- 172.21.15.57:0/3982284343 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55748bb0fd80 con 0x55748bd94fd0 2023-03-02T10:57:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.348+0000 7f122ffff700 1 -- 172.21.15.57:0/3982284343 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55748bcb2750 con 0x55748bd94fd0 2023-03-02T10:57:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.348+0000 7f122ffff700 1 -- 172.21.15.57:0/3982284343 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f123c029030 con 0x55748bd94fd0 2023-03-02T10:57:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.348+0000 7f126a478b80 10 client.15822 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.348+0000 7f126a478b80 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.348+0000 7f126a478b80 20 client.15822 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.348+0000 7f126a478b80 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55748bda86d0 0x55748bdaaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.348+0000 7f126a478b80 4 client.15822 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.348+0000 7f126a478b80 1 -- 172.21.15.57:0/3982284343 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55748bcda110 con 0x55748bda86d0 2023-03-02T10:57:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.349+0000 7f125499b700 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55748bda86d0 0x55748bdaaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.349+0000 7f125499b700 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55748bda86d0 0x55748bdaaae0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb55f0ecc1240aec server_cookie=717576ede7d1e76c in_seq=0 out_seq=0 2023-03-02T10:57:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.349+0000 7f122ffff700 10 client.15822 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f122ffff700 1 -- 172.21.15.57:0/3982284343 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55748bcda110 con 0x55748bda86d0 2023-03-02T10:57:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f122ffff700 10 client.15822 handle_command_reply: tid=0 2023-03-02T10:57:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f126a478b80 1 client.15822 shutdown 2023-03-02T10:57:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f126a478b80 1 -- 172.21.15.57:0/3982284343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd94fd0 msgr2=0x55748bd984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f126a478b80 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd94fd0 0x55748bd984e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f123c005c50 tx=0x7f123c019ae0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f126a478b80 1 -- 172.21.15.57:0/3982284343 shutdown_connections 2023-03-02T10:57:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f126a478b80 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55748bda86d0 0x55748bdaaae0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f126a478b80 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bd95440 0x55748bd98aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f126a478b80 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bbec6b0 0x55748bd9b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f126a478b80 1 --2- 172.21.15.57:0/3982284343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd94fd0 0x55748bd984e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f126a478b80 1 -- 172.21.15.57:0/3982284343 >> 172.21.15.57:0/3982284343 conn(0x55748bd849a0 msgr2=0x55748bd891e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f122ffff700 0 client.15822 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f126a478b80 1 -- 172.21.15.57:0/3982284343 shutdown_connections 2023-03-02T10:57:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.350+0000 7f126a478b80 1 -- 172.21.15.57:0/3982284343 wait complete. 2023-03-02T10:57:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.351+0000 7f126a478b80 20 client.15822 trim_cache size 0 max 16384 2023-03-02T10:57:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.379+0000 7f126a478b80 1 Processor -- start 2023-03-02T10:57:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.379+0000 7f126a478b80 1 -- start start 2023-03-02T10:57:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.379+0000 7f126a478b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 0x55748bd98490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.379+0000 7f126a478b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd89980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.379+0000 7f126a478b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 0x55748bd9acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.379+0000 7f126a478b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bd8b4f0 con 0x55748bd95440 2023-03-02T10:57:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.379+0000 7f126a478b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bd86a20 con 0x55748bd94fd0 2023-03-02T10:57:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.379+0000 7f126a478b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bd89ec0 con 0x55748bbec6b0 2023-03-02T10:57:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f125499b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 0x55748bd98490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f125519c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 0x55748bd9acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f125499b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 0x55748bd98490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:46984/0 (socket says 172.21.15.57:46984) 2023-03-02T10:57:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f125499b700 1 -- 172.21.15.57:0/3764737852 learned_addr learned my addr 172.21.15.57:0/3764737852 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f124ffff700 1 --2- 172.21.15.57:0/3764737852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd89980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f125499b700 1 -- 172.21.15.57:0/3764737852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 msgr2=0x55748bd89980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f125499b700 1 --2- 172.21.15.57:0/3764737852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd89980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f125499b700 1 -- 172.21.15.57:0/3764737852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 msgr2=0x55748bd9acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f125499b700 1 --2- 172.21.15.57:0/3764737852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 0x55748bd9acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f125499b700 1 -- 172.21.15.57:0/3764737852 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55748bca8130 con 0x55748bbec6b0 2023-03-02T10:57:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f125499b700 1 --2- 172.21.15.57:0/3764737852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 0x55748bd98490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f124400b360 tx=0x7f1244009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=868093f02ce0e8e2 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f123b7fe700 1 -- 172.21.15.57:0/3764737852 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440be050 con 0x55748bbec6b0 2023-03-02T10:57:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f123b7fe700 1 -- 172.21.15.57:0/3764737852 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1244095ed0 con 0x55748bbec6b0 2023-03-02T10:57:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.380+0000 7f123b7fe700 1 -- 172.21.15.57:0/3764737852 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244095a30 con 0x55748bbec6b0 2023-03-02T10:57:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.381+0000 7f126a478b80 1 -- 172.21.15.57:0/3764737852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 msgr2=0x55748bd98490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.381+0000 7f126a478b80 1 --2- 172.21.15.57:0/3764737852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 0x55748bd98490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f124400b360 tx=0x7f1244009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.381+0000 7f126a478b80 1 -- 172.21.15.57:0/3764737852 shutdown_connections 2023-03-02T10:57:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.381+0000 7f126a478b80 1 --2- 172.21.15.57:0/3764737852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bd95440 0x55748bd9acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.381+0000 7f126a478b80 1 --2- 172.21.15.57:0/3764737852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bbec6b0 0x55748bd98490 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.381+0000 7f126a478b80 1 --2- 172.21.15.57:0/3764737852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd89980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.381+0000 7f126a478b80 1 -- 172.21.15.57:0/3764737852 >> 172.21.15.57:0/3764737852 conn(0x55748bd849a0 msgr2=0x55748bd97d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.381+0000 7f126a478b80 1 -- 172.21.15.57:0/3764737852 shutdown_connections 2023-03-02T10:57:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.381+0000 7f126a478b80 1 -- 172.21.15.57:0/3764737852 wait complete. 2023-03-02T10:57:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.382+0000 7f126a478b80 1 -- start start 2023-03-02T10:57:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.382+0000 7f126a478b80 1 Processor -- start 2023-03-02T10:57:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.382+0000 7f126a478b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bbec6b0 0x55748bd91790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.382+0000 7f126a478b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd91cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.382+0000 7f126a478b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bd95440 0x55748bd904b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.382+0000 7f126a478b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bd90a30 con 0x55748bbec6b0 2023-03-02T10:57:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.382+0000 7f126a478b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bd90b70 con 0x55748bd94fd0 2023-03-02T10:57:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.382+0000 7f126a478b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55748bd90d30 con 0x55748bd95440 2023-03-02T10:57:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f126a478b80 10 client.0 _ll_register_callbacks cb 0x55748bc874c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f124ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd91cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f124ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd91cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48772/0 (socket says 172.21.15.57:48772) 2023-03-02T10:57:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f124ffff700 1 -- 172.21.15.57:0/2280247114 learned_addr learned my addr 172.21.15.57:0/2280247114 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f125499b700 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bbec6b0 0x55748bd91790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f125519c700 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bd95440 0x55748bd904b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f125499b700 1 -- 172.21.15.57:0/2280247114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bd95440 msgr2=0x55748bd904b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f125499b700 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bd95440 0x55748bd904b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f125499b700 1 -- 172.21.15.57:0/2280247114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 msgr2=0x55748bd91cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f125499b700 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd91cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f125499b700 1 -- 172.21.15.57:0/2280247114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125010fbc0 con 0x55748bbec6b0 2023-03-02T10:57:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f124ffff700 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd91cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f125499b700 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bbec6b0 0x55748bd91790 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1244005910 tx=0x7f1244095410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e6eb02670608b2 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.383+0000 7f122ffff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f122ffff700 1 -- 172.21.15.57:0/2280247114 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440957d0 con 0x55748bbec6b0 2023-03-02T10:57:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f122ffff700 1 -- 172.21.15.57:0/2280247114 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f12440218a0 con 0x55748bbec6b0 2023-03-02T10:57:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f126a478b80 1 -- 172.21.15.57:0/2280247114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f123c019c50 con 0x55748bbec6b0 2023-03-02T10:57:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f122ffff700 1 -- 172.21.15.57:0/2280247114 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1244021a60 con 0x55748bbec6b0 2023-03-02T10:57:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f126a478b80 10 client.15828 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f126a478b80 1 -- 172.21.15.57:0/2280247114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55748bb361f0 con 0x55748bbec6b0 2023-03-02T10:57:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f122ffff700 1 -- 172.21.15.57:0/2280247114 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f123c019c50 con 0x55748bbec6b0 2023-03-02T10:57:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f122ffff700 1 -- 172.21.15.57:0/2280247114 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f124409c9d0 con 0x55748bbec6b0 2023-03-02T10:57:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f126a478b80 10 client.15828 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f126a478b80 10 client.15828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f126a478b80 20 client.15828 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f126a478b80 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55748bdfac90 0x55748bdfd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f126a478b80 4 client.15828 mds_command: new command op to 24560 tid=0[{"prefix": "flush journal"}] 2023-03-02T10:57:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.384+0000 7f126a478b80 1 -- 172.21.15.57:0/2280247114 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55748bcd9e30 con 0x55748bdfac90 2023-03-02T10:57:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.385+0000 7f124ffff700 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55748bdfac90 0x55748bdfd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.385+0000 7f122ffff700 10 client.15828 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.385+0000 7f124ffff700 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55748bdfac90 0x55748bdfd0a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acc7be09a7fe89aa server_cookie=e421d030bf52bba9 in_seq=0 out_seq=0 2023-03-02T10:57:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.413+0000 7f122ffff700 1 -- 172.21.15.57:0/2280247114 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55748bcd9e30 con 0x55748bdfac90 2023-03-02T10:57:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.413+0000 7f122ffff700 10 client.15828 handle_command_reply: tid=0 2023-03-02T10:57:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.413+0000 7f126a478b80 1 client.15828 shutdown 2023-03-02T10:57:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.413+0000 7f126a478b80 1 -- 172.21.15.57:0/2280247114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bbec6b0 msgr2=0x55748bd91790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.413+0000 7f126a478b80 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bbec6b0 0x55748bd91790 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1244005910 tx=0x7f1244095410 comp rx=0 tx=0).stop 2023-03-02T10:57:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f126a478b80 1 -- 172.21.15.57:0/2280247114 shutdown_connections 2023-03-02T10:57:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f126a478b80 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55748bdfac90 0x55748bdfd0a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f126a478b80 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55748bd95440 0x55748bd904b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f126a478b80 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55748bbec6b0 0x55748bd91790 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f126a478b80 1 --2- 172.21.15.57:0/2280247114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55748bd94fd0 0x55748bd91cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f122ffff700 0 client.15828 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f126a478b80 1 -- 172.21.15.57:0/2280247114 >> 172.21.15.57:0/2280247114 conn(0x55748bd849a0 msgr2=0x55748bd95810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f126a478b80 1 -- 172.21.15.57:0/2280247114 shutdown_connections 2023-03-02T10:57:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f126a478b80 1 -- 172.21.15.57:0/2280247114 wait complete. 2023-03-02T10:57:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f126a478b80 20 client.15828 trim_cache size 0 max 16384 2023-03-02T10:57:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:{ 2023-03-02T10:57:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "message": "", 2023-03-02T10:57:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "return_code": 0 2023-03-02T10:57:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:} 2023-03-02T10:57:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f1256bff700 1 -- 172.21.15.57:0/2019129327 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f124009b4c0 msgr2=0x7f124009d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f1256bff700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f124009b4c0 0x7f124009d970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1248004a60 tx=0x7f1248004b40 comp rx=0 tx=0).stop 2023-03-02T10:57:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f1256bff700 1 -- 172.21.15.57:0/2019129327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1250100da0 msgr2=0x7f12500fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.414+0000 7f1256bff700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1250100da0 0x7f12500fe9f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f124400b680 tx=0x7f1244009580 comp rx=0 tx=0).stop 2023-03-02T10:57:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.415+0000 7f1256bff700 1 -- 172.21.15.57:0/2019129327 shutdown_connections 2023-03-02T10:57:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.415+0000 7f1256bff700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f124009b4c0 0x7f124009d970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.415+0000 7f1256bff700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f125010a0e0 0x7f12501a3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.415+0000 7f1256bff700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1250100da0 0x7f12500fe9f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.415+0000 7f1256bff700 1 --2- 172.21.15.57:0/2019129327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12501016b0 0x7f12500fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.415+0000 7f1256bff700 1 -- 172.21.15.57:0/2019129327 >> 172.21.15.57:0/2019129327 conn(0x7f12500767e0 msgr2=0x7f12500fb500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.415+0000 7f1256bff700 1 -- 172.21.15.57:0/2019129327 shutdown_connections 2023-03-02T10:57:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:57:56.415+0000 7f1256bff700 1 -- 172.21.15.57:0/2019129327 wait complete. 2023-03-02T10:57:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:27400000 of 50000000 tuples (54%) done (elapsed 41.25 s, remaining 34.03 s) 2023-03-02T10:57:56.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.516+0000 7efe79fff700 1 -- 172.21.15.57:0/1293335275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe74100b40 msgr2=0x7efe74100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.516+0000 7efe79fff700 1 --2- 172.21.15.57:0/1293335275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe74100b40 0x7efe74100f10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7efe64009990 tx=0x7efe64009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.516+0000 7efe79fff700 1 -- 172.21.15.57:0/1293335275 shutdown_connections 2023-03-02T10:57:56.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.516+0000 7efe79fff700 1 --2- 172.21.15.57:0/1293335275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe7410a060 0x7efe7410c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.516+0000 7efe79fff700 1 --2- 172.21.15.57:0/1293335275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe74100b40 0x7efe74100f10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.516+0000 7efe79fff700 1 --2- 172.21.15.57:0/1293335275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe74101450 0x7efe74109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.516+0000 7efe79fff700 1 -- 172.21.15.57:0/1293335275 >> 172.21.15.57:0/1293335275 conn(0x7efe740fa4b0 msgr2=0x7efe740fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.517+0000 7efe79fff700 1 -- 172.21.15.57:0/1293335275 shutdown_connections 2023-03-02T10:57:56.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.517+0000 7efe79fff700 1 -- 172.21.15.57:0/1293335275 wait complete. 2023-03-02T10:57:56.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.517+0000 7efe79fff700 1 Processor -- start 2023-03-02T10:57:56.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.517+0000 7efe79fff700 1 -- start start 2023-03-02T10:57:56.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe79fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe74100b40 0x7efe740fe970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe79fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe74101450 0x7efe740feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe79fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe7410a060 0x7efe741a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe79fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe740ff6e0 con 0x7efe74101450 2023-03-02T10:57:56.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe79fff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe741a4360 con 0x7efe7410a060 2023-03-02T10:57:56.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe79fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe741a44a0 con 0x7efe74100b40 2023-03-02T10:57:56.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe72ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe74101450 0x7efe740feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe72ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe74101450 0x7efe740feeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43600/0 (socket says 172.21.15.57:43600) 2023-03-02T10:57:56.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe72ffd700 1 -- 172.21.15.57:0/4092590452 learned_addr learned my addr 172.21.15.57:0/4092590452 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe73fff700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe7410a060 0x7efe741a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe737fe700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe74100b40 0x7efe740fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe72ffd700 1 -- 172.21.15.57:0/4092590452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe74100b40 msgr2=0x7efe740fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe72ffd700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe74100b40 0x7efe740fe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe72ffd700 1 -- 172.21.15.57:0/4092590452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe7410a060 msgr2=0x7efe741a3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe72ffd700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe7410a060 0x7efe741a3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe72ffd700 1 -- 172.21.15.57:0/4092590452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe640095f0 con 0x7efe74101450 2023-03-02T10:57:56.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.518+0000 7efe72ffd700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe74101450 0x7efe740feeb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7efe6800d950 tx=0x7efe6800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.519+0000 7efe70ff9700 1 -- 172.21.15.57:0/4092590452 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800f890 con 0x7efe74101450 2023-03-02T10:57:56.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.519+0000 7efe79fff700 1 -- 172.21.15.57:0/4092590452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7410fac0 con 0x7efe74101450 2023-03-02T10:57:56.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.519+0000 7efe70ff9700 1 -- 172.21.15.57:0/4092590452 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe68010460 con 0x7efe74101450 2023-03-02T10:57:56.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.519+0000 7efe70ff9700 1 -- 172.21.15.57:0/4092590452 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800e610 con 0x7efe74101450 2023-03-02T10:57:56.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.519+0000 7efe79fff700 1 -- 172.21.15.57:0/4092590452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7410f930 con 0x7efe74101450 2023-03-02T10:57:56.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.521+0000 7efe70ff9700 1 -- 172.21.15.57:0/4092590452 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7efe68022070 con 0x7efe74101450 2023-03-02T10:57:56.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.522+0000 7efe70ff9700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7efe5c09b4c0 0x7efe5c09d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.522+0000 7efe70ff9700 1 -- 172.21.15.57:0/4092590452 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7efe680c4ef0 con 0x7efe74101450 2023-03-02T10:57:56.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.522+0000 7efe737fe700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7efe5c09b4c0 0x7efe5c09d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe8d883b80 1 Processor -- start 2023-03-02T10:57:56.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe8d883b80 1 -- start start 2023-03-02T10:57:56.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe737fe700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7efe5c09b4c0 0x7efe5c09d970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efe6400b2e0 tx=0x7efe64005960 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaa3c0 0x56080faaa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaacd0 0x56080faaebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 0x56080faaf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe8d883b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080fa11a60 con 0x56080faaf110 2023-03-02T10:57:56.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe8d883b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080f9c3f80 con 0x56080faaa3c0 2023-03-02T10:57:56.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe8d883b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080f994160 con 0x56080faaacd0 2023-03-02T10:57:56.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe73fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 0x56080faaf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe73fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 0x56080faaf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43616/0 (socket says 172.21.15.57:43616) 2023-03-02T10:57:56.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe73fff700 1 -- 172.21.15.57:0/633989438 learned_addr learned my addr 172.21.15.57:0/633989438 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.523+0000 7efe737fe700 1 --2- 172.21.15.57:0/633989438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaa3c0 0x56080faaa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.524+0000 7efe72ffd700 1 --2- 172.21.15.57:0/633989438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaacd0 0x56080faaebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.524+0000 7efe73fff700 1 -- 172.21.15.57:0/633989438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaacd0 msgr2=0x56080faaebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.524+0000 7efe73fff700 1 --2- 172.21.15.57:0/633989438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaacd0 0x56080faaebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.524+0000 7efe73fff700 1 -- 172.21.15.57:0/633989438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaa3c0 msgr2=0x56080faaa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.524+0000 7efe73fff700 1 --2- 172.21.15.57:0/633989438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaa3c0 0x56080faaa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.524+0000 7efe73fff700 1 -- 172.21.15.57:0/633989438 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56080f87e630 con 0x56080faaf110 2023-03-02T10:57:56.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.524+0000 7efe73fff700 1 --2- 172.21.15.57:0/633989438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 0x56080faaf560 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efe6c011600 tx=0x7efe6c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9eb9451eb3a1cb server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.524+0000 7efe59ffb700 1 -- 172.21.15.57:0/633989438 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00e040 con 0x56080faaf110 2023-03-02T10:57:56.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.524+0000 7efe59ffb700 1 -- 172.21.15.57:0/633989438 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe6c00f040 con 0x56080faaf110 2023-03-02T10:57:56.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.524+0000 7efe59ffb700 1 -- 172.21.15.57:0/633989438 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c004760 con 0x56080faaf110 2023-03-02T10:57:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.525+0000 7efe8d883b80 1 -- 172.21.15.57:0/633989438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 msgr2=0x56080faaf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.525+0000 7efe8d883b80 1 --2- 172.21.15.57:0/633989438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 0x56080faaf560 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efe6c011600 tx=0x7efe6c009920 comp rx=0 tx=0).stop 2023-03-02T10:57:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.525+0000 7efe8d883b80 1 -- 172.21.15.57:0/633989438 shutdown_connections 2023-03-02T10:57:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.525+0000 7efe8d883b80 1 --2- 172.21.15.57:0/633989438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 0x56080faaf560 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.525+0000 7efe8d883b80 1 --2- 172.21.15.57:0/633989438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaa3c0 0x56080faaa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.525+0000 7efe8d883b80 1 --2- 172.21.15.57:0/633989438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaacd0 0x56080faaebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.525+0000 7efe8d883b80 1 -- 172.21.15.57:0/633989438 >> 172.21.15.57:0/633989438 conn(0x56080fa9fc50 msgr2=0x56080faa5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.525+0000 7efe8d883b80 1 -- 172.21.15.57:0/633989438 shutdown_connections 2023-03-02T10:57:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.525+0000 7efe8d883b80 1 -- 172.21.15.57:0/633989438 wait complete. 2023-03-02T10:57:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe8d883b80 1 -- start start 2023-03-02T10:57:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe8d883b80 1 Processor -- start 2023-03-02T10:57:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaa3c0 0x56080fab68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaacd0 0x56080fab3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaf110 0x56080fab41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe8d883b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080fa02bc0 con 0x56080faaa3c0 2023-03-02T10:57:56.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe8d883b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080f9fc0f0 con 0x56080faaacd0 2023-03-02T10:57:56.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe8d883b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080f880920 con 0x56080faaf110 2023-03-02T10:57:56.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe8d883b80 10 client.0 _ll_register_callbacks cb 0x56080f9a2520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:56.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe737fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaa3c0 0x56080fab68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe73fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaf110 0x56080fab41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe72ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaacd0 0x56080fab3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe737fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaa3c0 0x56080fab68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43630/0 (socket says 172.21.15.57:43630) 2023-03-02T10:57:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe737fe700 1 -- 172.21.15.57:0/2650334575 learned_addr learned my addr 172.21.15.57:0/2650334575 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe73fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaf110 0x56080fab41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47024/0 (socket says 172.21.15.57:47024) 2023-03-02T10:57:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.526+0000 7efe72ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaacd0 0x56080fab3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48810/0 (socket says 172.21.15.57:48810) 2023-03-02T10:57:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.527+0000 7efe73fff700 1 -- 172.21.15.57:0/2650334575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaacd0 msgr2=0x56080fab3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.527+0000 7efe73fff700 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaacd0 0x56080fab3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.527+0000 7efe73fff700 1 -- 172.21.15.57:0/2650334575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaa3c0 msgr2=0x56080fab68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.527+0000 7efe73fff700 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaa3c0 0x56080fab68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.527+0000 7efe73fff700 1 -- 172.21.15.57:0/2650334575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c0112b0 con 0x56080faaf110 2023-03-02T10:57:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.527+0000 7efe737fe700 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaa3c0 0x56080fab68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.527+0000 7efe73fff700 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaf110 0x56080fab41e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe6c000f80 tx=0x7efe6c005ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7589797d5316332 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.527+0000 7efe52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:57:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.527+0000 7efe52ffd700 1 -- 172.21.15.57:0/2650334575 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00e070 con 0x56080faaf110 2023-03-02T10:57:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.527+0000 7efe8d883b80 1 -- 172.21.15.57:0/2650334575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56080f9cd7b0 con 0x56080faaf110 2023-03-02T10:57:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.527+0000 7efe52ffd700 1 -- 172.21.15.57:0/2650334575 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7efe6c004510 con 0x56080faaf110 2023-03-02T10:57:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe52ffd700 1 -- 172.21.15.57:0/2650334575 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe6c0046d0 con 0x56080faaf110 2023-03-02T10:57:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe8d883b80 10 client.25645 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe8d883b80 1 -- 172.21.15.57:0/2650334575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x56080f82ade0 con 0x56080faaf110 2023-03-02T10:57:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe52ffd700 1 -- 172.21.15.57:0/2650334575 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56080f9cd7b0 con 0x56080faaf110 2023-03-02T10:57:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe52ffd700 1 -- 172.21.15.57:0/2650334575 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7efe6c027460 con 0x56080faaf110 2023-03-02T10:57:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe8d883b80 10 client.25645 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe8d883b80 10 client.25645 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-02T10:57:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe8d883b80 20 client.25645 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe8d883b80 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x56080fac4170 0x56080fac6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe8d883b80 4 client.25645 mds_command: new command op to 24520 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe8d883b80 1 -- 172.21.15.57:0/2650334575 --> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56080f9f5170 con 0x56080fac4170 2023-03-02T10:57:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.528+0000 7efe737fe700 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x56080fac4170 0x56080fac6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.529+0000 7efe52ffd700 10 client.25645 ms_handle_connect on v2:172.21.15.136:6838/1702113579 2023-03-02T10:57:56.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.529+0000 7efe737fe700 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x56080fac4170 0x56080fac6580 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5d1510f82fc77769 server_cookie=e455f661fdf15c6 in_seq=0 out_seq=0 2023-03-02T10:57:56.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe52ffd700 1 -- 172.21.15.57:0/2650334575 <== mds.1 v2:172.21.15.136:6838/1702113579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x56080f9f5170 con 0x56080fac4170 2023-03-02T10:57:56.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe52ffd700 10 client.25645 handle_command_reply: tid=0 2023-03-02T10:57:56.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 1 client.25645 shutdown 2023-03-02T10:57:56.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 1 -- 172.21.15.57:0/2650334575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaf110 msgr2=0x56080fab41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaf110 0x56080fab41e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe6c000f80 tx=0x7efe6c005ae0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 1 -- 172.21.15.57:0/2650334575 shutdown_connections 2023-03-02T10:57:56.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x56080fac4170 0x56080fac6580 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaf110 0x56080fab41e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe52ffd700 0 client.25645 ms_handle_reset on v2:172.21.15.136:6838/1702113579 2023-03-02T10:57:56.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaa3c0 0x56080fab68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 1 --2- 172.21.15.57:0/2650334575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaacd0 0x56080fab3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 1 -- 172.21.15.57:0/2650334575 >> 172.21.15.57:0/2650334575 conn(0x56080fa9fc50 msgr2=0x56080faa5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 1 -- 172.21.15.57:0/2650334575 shutdown_connections 2023-03-02T10:57:56.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 1 -- 172.21.15.57:0/2650334575 wait complete. 2023-03-02T10:57:56.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.530+0000 7efe8d883b80 20 client.25645 trim_cache size 0 max 16384 2023-03-02T10:57:56.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.556+0000 7efe8d883b80 1 Processor -- start 2023-03-02T10:57:56.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.556+0000 7efe8d883b80 1 -- start start 2023-03-02T10:57:56.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.556+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaa3c0 0x56080fac05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.556+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaacd0 0x56080fab6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.556+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 0x56080fab3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.556+0000 7efe8d883b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080faa5fa0 con 0x56080faaf110 2023-03-02T10:57:56.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.556+0000 7efe8d883b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080fa9f7d0 con 0x56080faaacd0 2023-03-02T10:57:56.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.556+0000 7efe8d883b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080faa56b0 con 0x56080faaa3c0 2023-03-02T10:57:56.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.556+0000 7efe737fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaa3c0 0x56080fac05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.556+0000 7efe737fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaa3c0 0x56080fac05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47032/0 (socket says 172.21.15.57:47032) 2023-03-02T10:57:56.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe737fe700 1 -- 172.21.15.57:0/2578473943 learned_addr learned my addr 172.21.15.57:0/2578473943 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe73fff700 1 --2- 172.21.15.57:0/2578473943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 0x56080fab3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe72ffd700 1 --2- 172.21.15.57:0/2578473943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaacd0 0x56080fab6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe73fff700 1 -- 172.21.15.57:0/2578473943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaa3c0 msgr2=0x56080fac05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe73fff700 1 --2- 172.21.15.57:0/2578473943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaa3c0 0x56080fac05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe73fff700 1 -- 172.21.15.57:0/2578473943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaacd0 msgr2=0x56080fab6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe73fff700 1 --2- 172.21.15.57:0/2578473943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaacd0 0x56080fab6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe73fff700 1 -- 172.21.15.57:0/2578473943 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56080f9c3190 con 0x56080faaf110 2023-03-02T10:57:56.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe737fe700 1 --2- 172.21.15.57:0/2578473943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaa3c0 0x56080fac05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe73fff700 1 --2- 172.21.15.57:0/2578473943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 0x56080fab3320 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009b30 tx=0x7efe6c011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341e7c91aa8f2f51 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe5a7fc700 1 -- 172.21.15.57:0/2578473943 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00e070 con 0x56080faaf110 2023-03-02T10:57:56.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe5a7fc700 1 -- 172.21.15.57:0/2578473943 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe6c0092e0 con 0x56080faaf110 2023-03-02T10:57:56.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.557+0000 7efe5a7fc700 1 -- 172.21.15.57:0/2578473943 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c030450 con 0x56080faaf110 2023-03-02T10:57:56.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.558+0000 7efe8d883b80 1 -- 172.21.15.57:0/2578473943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 msgr2=0x56080fab3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.558+0000 7efe8d883b80 1 --2- 172.21.15.57:0/2578473943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 0x56080fab3320 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009b30 tx=0x7efe6c011c70 comp rx=0 tx=0).stop 2023-03-02T10:57:56.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.558+0000 7efe8d883b80 1 -- 172.21.15.57:0/2578473943 shutdown_connections 2023-03-02T10:57:56.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.558+0000 7efe8d883b80 1 --2- 172.21.15.57:0/2578473943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaf110 0x56080fab3320 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.558+0000 7efe8d883b80 1 --2- 172.21.15.57:0/2578473943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaa3c0 0x56080fac05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.558+0000 7efe8d883b80 1 --2- 172.21.15.57:0/2578473943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaacd0 0x56080fab6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.558+0000 7efe8d883b80 1 -- 172.21.15.57:0/2578473943 >> 172.21.15.57:0/2578473943 conn(0x56080fa9fc50 msgr2=0x56080fab14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.558+0000 7efe8d883b80 1 -- 172.21.15.57:0/2578473943 shutdown_connections 2023-03-02T10:57:56.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.558+0000 7efe8d883b80 1 -- 172.21.15.57:0/2578473943 wait complete. 2023-03-02T10:57:56.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.559+0000 7efe8d883b80 1 -- start start 2023-03-02T10:57:56.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.559+0000 7efe8d883b80 1 Processor -- start 2023-03-02T10:57:56.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.559+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaa3c0 0x56080fab9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.559+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaacd0 0x56080fab9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.559+0000 7efe8d883b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaf110 0x56080fb149e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.559+0000 7efe8d883b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080fb14f20 con 0x56080faaacd0 2023-03-02T10:57:56.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.559+0000 7efe8d883b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080fb15060 con 0x56080faaa3c0 2023-03-02T10:57:56.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.559+0000 7efe8d883b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080fb151a0 con 0x56080faaf110 2023-03-02T10:57:56.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.559+0000 7efe8d883b80 10 client.0 _ll_register_callbacks cb 0x56080f9a2520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:56.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.559+0000 7efe72ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaacd0 0x56080fab9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe72ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaacd0 0x56080fab9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43644/0 (socket says 172.21.15.57:43644) 2023-03-02T10:57:56.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe72ffd700 1 -- 172.21.15.57:0/821042239 learned_addr learned my addr 172.21.15.57:0/821042239 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe737fe700 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaa3c0 0x56080fab9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe72ffd700 1 -- 172.21.15.57:0/821042239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaf110 msgr2=0x56080fb149e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-02T10:57:56.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe72ffd700 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaf110 0x56080fb149e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe72ffd700 1 -- 172.21.15.57:0/821042239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaa3c0 msgr2=0x56080fab9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe72ffd700 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaa3c0 0x56080fab9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe72ffd700 1 -- 172.21.15.57:0/821042239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7410d1b0 con 0x56080faaacd0 2023-03-02T10:57:56.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe72ffd700 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaacd0 0x56080fab9a50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efe68090d80 tx=0x7efe68094440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f07bc68cda78904 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:56.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe52ffd700 1 -- 172.21.15.57:0/821042239 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68010a10 con 0x56080faaacd0 2023-03-02T10:57:56.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe52ffd700 1 -- 172.21.15.57:0/821042239 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7efe68093800 con 0x56080faaacd0 2023-03-02T10:57:56.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.560+0000 7efe8d883b80 1 -- 172.21.15.57:0/821042239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe6c00f040 con 0x56080faaacd0 2023-03-02T10:57:56.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.561+0000 7efe52ffd700 1 -- 172.21.15.57:0/821042239 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe680939c0 con 0x56080faaacd0 2023-03-02T10:57:56.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.561+0000 7efe8d883b80 10 client.15846 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:56.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.561+0000 7efe8d883b80 1 -- 172.21.15.57:0/821042239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x56080f82ade0 con 0x56080faaacd0 2023-03-02T10:57:56.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.561+0000 7efe52ffd700 1 -- 172.21.15.57:0/821042239 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe6c00f040 con 0x56080faaacd0 2023-03-02T10:57:56.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.561+0000 7efe52ffd700 1 -- 172.21.15.57:0/821042239 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7efe68094ca0 con 0x56080faaacd0 2023-03-02T10:57:56.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.561+0000 7efe8d883b80 10 client.15846 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:56.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.561+0000 7efe8d883b80 10 client.15846 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-02T10:57:56.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.561+0000 7efe8d883b80 20 client.15846 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:56.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.561+0000 7efe8d883b80 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x56080fb16800 0x56080fb18be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.561+0000 7efe8d883b80 4 client.15846 mds_command: new command op to 24520 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:57:56.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.561+0000 7efe8d883b80 1 -- 172.21.15.57:0/821042239 --> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56080f9f4e90 con 0x56080fb16800 2023-03-02T10:57:56.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.562+0000 7efe737fe700 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x56080fb16800 0x56080fb18be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe737fe700 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x56080fb16800 0x56080fb18be0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=492b2c7ebe40e9b7 server_cookie=61f4bde00dea2f79 in_seq=0 out_seq=0 2023-03-02T10:57:56.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe52ffd700 10 client.15846 ms_handle_connect on v2:172.21.15.136:6838/1702113579 2023-03-02T10:57:56.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe52ffd700 1 -- 172.21.15.57:0/821042239 <== mds.1 v2:172.21.15.136:6838/1702113579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56080f9f4e90 con 0x56080fb16800 2023-03-02T10:57:56.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe52ffd700 10 client.15846 handle_command_reply: tid=0 2023-03-02T10:57:56.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe8d883b80 1 client.15846 shutdown 2023-03-02T10:57:56.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe8d883b80 1 -- 172.21.15.57:0/821042239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaacd0 msgr2=0x56080fab9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe8d883b80 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaacd0 0x56080fab9a50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efe68090d80 tx=0x7efe68094440 comp rx=0 tx=0).stop 2023-03-02T10:57:56.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe8d883b80 1 -- 172.21.15.57:0/821042239 shutdown_connections 2023-03-02T10:57:56.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe8d883b80 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x56080fb16800 0x56080fb18be0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe8d883b80 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56080faaf110 0x56080fb149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe8d883b80 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56080faaa3c0 0x56080fab9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe8d883b80 1 --2- 172.21.15.57:0/821042239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56080faaacd0 0x56080fab9a50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe8d883b80 1 -- 172.21.15.57:0/821042239 >> 172.21.15.57:0/821042239 conn(0x56080fa9fc50 msgr2=0x56080fabf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.564+0000 7efe52ffd700 0 client.15846 ms_handle_reset on v2:172.21.15.136:6838/1702113579 2023-03-02T10:57:56.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe8d883b80 1 -- 172.21.15.57:0/821042239 shutdown_connections 2023-03-02T10:57:56.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe8d883b80 1 -- 172.21.15.57:0/821042239 wait complete. 2023-03-02T10:57:56.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe8d883b80 20 client.15846 trim_cache size 0 max 16384 2023-03-02T10:57:56.572 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:57:56.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 -- 172.21.15.57:0/4092590452 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7efe5c09b4c0 msgr2=0x7efe5c09d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7efe5c09b4c0 0x7efe5c09d970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efe6400b2e0 tx=0x7efe64005960 comp rx=0 tx=0).stop 2023-03-02T10:57:56.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 -- 172.21.15.57:0/4092590452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe74101450 msgr2=0x7efe740feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe74101450 0x7efe740feeb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7efe6800d950 tx=0x7efe6800dc60 comp rx=0 tx=0).stop 2023-03-02T10:57:56.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 -- 172.21.15.57:0/4092590452 shutdown_connections 2023-03-02T10:57:56.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7efe5c09b4c0 0x7efe5c09d970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe7410a060 0x7efe741a3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe74100b40 0x7efe740fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 --2- 172.21.15.57:0/4092590452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe74101450 0x7efe740feeb0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 -- 172.21.15.57:0/4092590452 >> 172.21.15.57:0/4092590452 conn(0x7efe740fa4b0 msgr2=0x7efe7410c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 -- 172.21.15.57:0/4092590452 shutdown_connections 2023-03-02T10:57:56.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.565+0000 7efe79fff700 1 -- 172.21.15.57:0/4092590452 wait complete. 2023-03-02T10:57:56.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-03-02T10:57:56.587 INFO:teuthology.orchestra.run.smithi057.stderr:27500000 of 50000000 tuples (55%) done (elapsed 41.39 s, remaining 33.87 s) 2023-03-02T10:57:56.709 INFO:teuthology.orchestra.run.smithi057.stderr:27600000 of 50000000 tuples (55%) done (elapsed 41.51 s, remaining 33.69 s) 2023-03-02T10:57:56.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.767+0000 7f97c21ff700 1 -- 172.21.15.57:0/912025547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97bc101590 msgr2=0x7f97bc109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.767+0000 7f97c21ff700 1 --2- 172.21.15.57:0/912025547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97bc101590 0x7f97bc109a80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009990 tx=0x7f97b0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.767+0000 7f97c21ff700 1 -- 172.21.15.57:0/912025547 shutdown_connections 2023-03-02T10:57:56.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.767+0000 7f97c21ff700 1 --2- 172.21.15.57:0/912025547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc10a050 0x7f97bc10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.767+0000 7f97c21ff700 1 --2- 172.21.15.57:0/912025547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97bc100c80 0x7f97bc101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.767+0000 7f97c21ff700 1 --2- 172.21.15.57:0/912025547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97bc101590 0x7f97bc109a80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.767+0000 7f97c21ff700 1 -- 172.21.15.57:0/912025547 >> 172.21.15.57:0/912025547 conn(0x7f97bc0fa4b0 msgr2=0x7f97bc0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.767+0000 7f97c21ff700 1 -- 172.21.15.57:0/912025547 shutdown_connections 2023-03-02T10:57:56.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.767+0000 7f97c21ff700 1 -- 172.21.15.57:0/912025547 wait complete. 2023-03-02T10:57:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.767+0000 7f97c21ff700 1 Processor -- start 2023-03-02T10:57:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97c21ff700 1 -- start start 2023-03-02T10:57:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97c21ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97bc100c80 0x7f97bc0fe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97c21ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97bc101590 0x7f97bc0fee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97c21ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc10a050 0x7f97bc1a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97c21ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0ff640 con 0x7f97bc100c80 2023-03-02T10:57:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97c21ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc1a4300 con 0x7f97bc101590 2023-03-02T10:57:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97c21ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc1a4440 con 0x7f97bc10a050 2023-03-02T10:57:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97bc100c80 0x7f97bc0fe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97baffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97bc101590 0x7f97bc0fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97bc100c80 0x7f97bc0fe8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43654/0 (socket says 172.21.15.57:43654) 2023-03-02T10:57:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97bb7fe700 1 -- 172.21.15.57:0/3863685 learned_addr learned my addr 172.21.15.57:0/3863685 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97bbfff700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc10a050 0x7f97bc1a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97baffd700 1 -- 172.21.15.57:0/3863685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc10a050 msgr2=0x7f97bc1a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97baffd700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc10a050 0x7f97bc1a3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97baffd700 1 -- 172.21.15.57:0/3863685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97bc100c80 msgr2=0x7f97bc0fe8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97baffd700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97bc100c80 0x7f97bc0fe8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.768+0000 7f97baffd700 1 -- 172.21.15.57:0/3863685 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00095f0 con 0x7f97bc101590 2023-03-02T10:57:56.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.769+0000 7f97baffd700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97bc101590 0x7f97bc0fee10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97b0000c00 tx=0x7f97b0009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.769+0000 7f97b8ff9700 1 -- 172.21.15.57:0/3863685 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b001d070 con 0x7f97bc101590 2023-03-02T10:57:56.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.769+0000 7f97c21ff700 1 -- 172.21.15.57:0/3863685 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97bc10fad0 con 0x7f97bc101590 2023-03-02T10:57:56.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.769+0000 7f97b8ff9700 1 -- 172.21.15.57:0/3863685 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97b0022470 con 0x7f97bc101590 2023-03-02T10:57:56.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.769+0000 7f97b8ff9700 1 -- 172.21.15.57:0/3863685 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0017650 con 0x7f97bc101590 2023-03-02T10:57:56.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.769+0000 7f97c21ff700 1 -- 172.21.15.57:0/3863685 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97bc10f940 con 0x7f97bc101590 2023-03-02T10:57:56.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.773+0000 7f97b8ff9700 1 -- 172.21.15.57:0/3863685 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7f97b0029030 con 0x7f97bc101590 2023-03-02T10:57:56.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.773+0000 7f97d5b13b80 1 Processor -- start 2023-03-02T10:57:56.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.773+0000 7f97d5b13b80 1 -- start start 2023-03-02T10:57:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.773+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a9203c0 0x55808a920790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.773+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a920cd0 0x55808a924bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a925110 0x55808a925560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a887a60 con 0x55808a925110 2023-03-02T10:57:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a839f80 con 0x55808a9203c0 2023-03-02T10:57:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a80a160 con 0x55808a920cd0 2023-03-02T10:57:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97bbfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a9203c0 0x55808a920790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97baffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a925110 0x55808a925560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97bbfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a9203c0 0x55808a920790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48836/0 (socket says 172.21.15.57:48836) 2023-03-02T10:57:56.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97bbfff700 1 -- 172.21.15.57:0/4030134358 learned_addr learned my addr 172.21.15.57:0/4030134358 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97bb7fe700 1 --2- 172.21.15.57:0/4030134358 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a920cd0 0x55808a924bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97b8ff9700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f97a409b4c0 0x7f97a409d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97bbfff700 1 -- 172.21.15.57:0/4030134358 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a920cd0 msgr2=0x55808a924bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97bbfff700 1 --2- 172.21.15.57:0/4030134358 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a920cd0 0x55808a924bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97bbfff700 1 -- 172.21.15.57:0/4030134358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a925110 msgr2=0x55808a925560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97bbfff700 1 --2- 172.21.15.57:0/4030134358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a925110 0x55808a925560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97bbfff700 1 -- 172.21.15.57:0/4030134358 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55808a6f4630 con 0x55808a9203c0 2023-03-02T10:57:56.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.774+0000 7f97b8ff9700 1 -- 172.21.15.57:0/3863685 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f97b00c6240 con 0x7f97bc101590 2023-03-02T10:57:56.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.775+0000 7f97bbfff700 1 --2- 172.21.15.57:0/4030134358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a9203c0 0x55808a920790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f97b4011600 tx=0x7f97b4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ddb02f533d3e256 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.775+0000 7f97bbfff700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f97a409b4c0 0x7f97a409d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.775+0000 7f97a1ffb700 1 -- 172.21.15.57:0/4030134358 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b400e040 con 0x55808a9203c0 2023-03-02T10:57:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.775+0000 7f97a1ffb700 1 -- 172.21.15.57:0/4030134358 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97b400f040 con 0x55808a9203c0 2023-03-02T10:57:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.775+0000 7f97a1ffb700 1 -- 172.21.15.57:0/4030134358 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4015670 con 0x55808a9203c0 2023-03-02T10:57:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.776+0000 7f97bbfff700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f97a409b4c0 0x7f97a409d970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f97b4020000 tx=0x7f97b4023000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.776+0000 7f97d5b13b80 1 -- 172.21.15.57:0/4030134358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a9203c0 msgr2=0x55808a920790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.776+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/4030134358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a9203c0 0x55808a920790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f97b4011600 tx=0x7f97b4009920 comp rx=0 tx=0).stop 2023-03-02T10:57:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.776+0000 7f97d5b13b80 1 -- 172.21.15.57:0/4030134358 shutdown_connections 2023-03-02T10:57:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.776+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/4030134358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a925110 0x55808a925560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.776+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/4030134358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a9203c0 0x55808a920790 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.776+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/4030134358 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a920cd0 0x55808a924bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.776+0000 7f97d5b13b80 1 -- 172.21.15.57:0/4030134358 >> 172.21.15.57:0/4030134358 conn(0x55808a915c50 msgr2=0x55808a91b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.776+0000 7f97d5b13b80 1 -- 172.21.15.57:0/4030134358 shutdown_connections 2023-03-02T10:57:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.776+0000 7f97d5b13b80 1 -- 172.21.15.57:0/4030134358 wait complete. 2023-03-02T10:57:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.777+0000 7f97d5b13b80 1 -- start start 2023-03-02T10:57:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.777+0000 7f97d5b13b80 1 Processor -- start 2023-03-02T10:57:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.777+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a92c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.777+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a920cd0 0x55808a929ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.777+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a925110 0x55808a92a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.777+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a878bc0 con 0x55808a925110 2023-03-02T10:57:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.777+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a8720f0 con 0x55808a920cd0 2023-03-02T10:57:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.777+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a6f6920 con 0x55808a9203c0 2023-03-02T10:57:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97d5b13b80 10 client.0 _ll_register_callbacks cb 0x55808a818520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a92c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a925110 0x55808a92a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a92c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47072/0 (socket says 172.21.15.57:47072) 2023-03-02T10:57:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97bb7fe700 1 -- 172.21.15.57:0/1667791918 learned_addr learned my addr 172.21.15.57:0/1667791918 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97baffd700 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a920cd0 0x55808a929ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97baffd700 1 -- 172.21.15.57:0/1667791918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 msgr2=0x55808a92c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97baffd700 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a92c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97baffd700 1 -- 172.21.15.57:0/1667791918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a925110 msgr2=0x55808a92a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97baffd700 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a925110 0x55808a92a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97baffd700 1 -- 172.21.15.57:0/1667791918 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b40112b0 con 0x55808a920cd0 2023-03-02T10:57:56.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97bb7fe700 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a92c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97baffd700 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a920cd0 0x55808a929ae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f97b0095390 tx=0x7f97b0093c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b33eba3a69708976 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f979affd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:57:56.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f979affd700 1 -- 172.21.15.57:0/1667791918 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b00919d0 con 0x55808a920cd0 2023-03-02T10:57:56.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f979affd700 1 -- 172.21.15.57:0/1667791918 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f97b00c3d70 con 0x55808a920cd0 2023-03-02T10:57:56.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.778+0000 7f97d5b13b80 1 -- 172.21.15.57:0/1667791918 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55808a8437b0 con 0x55808a920cd0 2023-03-02T10:57:56.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f979affd700 1 -- 172.21.15.57:0/1667791918 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97b0095460 con 0x55808a920cd0 2023-03-02T10:57:56.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f97d5b13b80 10 client.25703 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:56.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f97d5b13b80 1 -- 172.21.15.57:0/1667791918 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55808a6a0de0 con 0x55808a920cd0 2023-03-02T10:57:56.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f979affd700 1 -- 172.21.15.57:0/1667791918 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55808a8437b0 con 0x55808a920cd0 2023-03-02T10:57:56.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f979affd700 1 -- 172.21.15.57:0/1667791918 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f97b0094b80 con 0x55808a920cd0 2023-03-02T10:57:56.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f97d5b13b80 10 client.25703 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:56.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f97d5b13b80 10 client.25703 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:56.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f97d5b13b80 20 client.25703 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:56.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55808a939e40 0x55808a93c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f97d5b13b80 4 client.25703 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:56.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f97d5b13b80 1 -- 172.21.15.57:0/1667791918 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55808a86b170 con 0x55808a939e40 2023-03-02T10:57:56.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.779+0000 7f97bb7fe700 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55808a939e40 0x55808a93c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.780+0000 7f97bb7fe700 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55808a939e40 0x55808a93c250 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e894f1f77305b5b server_cookie=b0e2e805be54e65e in_seq=0 out_seq=0 2023-03-02T10:57:56.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.780+0000 7f979affd700 10 client.25703 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:56.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.780+0000 7f979affd700 1 -- 172.21.15.57:0/1667791918 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55808a86b170 con 0x55808a939e40 2023-03-02T10:57:56.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.780+0000 7f979affd700 10 client.25703 handle_command_reply: tid=0 2023-03-02T10:57:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.780+0000 7f97d5b13b80 1 client.25703 shutdown 2023-03-02T10:57:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f97d5b13b80 1 -- 172.21.15.57:0/1667791918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a920cd0 msgr2=0x55808a929ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a920cd0 0x55808a929ae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f97b0095390 tx=0x7f97b0093c40 comp rx=0 tx=0).stop 2023-03-02T10:57:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f97d5b13b80 1 -- 172.21.15.57:0/1667791918 shutdown_connections 2023-03-02T10:57:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55808a939e40 0x55808a93c250 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a925110 0x55808a92a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a92c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/1667791918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a920cd0 0x55808a929ae0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f979affd700 0 client.25703 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f97d5b13b80 1 -- 172.21.15.57:0/1667791918 >> 172.21.15.57:0/1667791918 conn(0x55808a915c50 msgr2=0x55808a91b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f97d5b13b80 1 -- 172.21.15.57:0/1667791918 shutdown_connections 2023-03-02T10:57:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f97d5b13b80 1 -- 172.21.15.57:0/1667791918 wait complete. 2023-03-02T10:57:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.781+0000 7f97d5b13b80 20 client.25703 trim_cache size 0 max 16384 2023-03-02T10:57:56.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97d5b13b80 1 Processor -- start 2023-03-02T10:57:56.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97d5b13b80 1 -- start start 2023-03-02T10:57:56.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a9274e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a920cd0 0x55808a9264f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 0x55808a92c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a913020 con 0x55808a920cd0 2023-03-02T10:57:56.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a921420 con 0x55808a925110 2023-03-02T10:57:56.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a92b0c0 con 0x55808a9203c0 2023-03-02T10:57:56.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97baffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a920cd0 0x55808a9264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a9274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a9274e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47084/0 (socket says 172.21.15.57:47084) 2023-03-02T10:57:56.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97baffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a920cd0 0x55808a9264f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43680/0 (socket says 172.21.15.57:43680) 2023-03-02T10:57:56.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97bb7fe700 1 -- 172.21.15.57:0/2765629244 learned_addr learned my addr 172.21.15.57:0/2765629244 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.798+0000 7f97bbfff700 1 --2- 172.21.15.57:0/2765629244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 0x55808a92c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.799+0000 7f97bb7fe700 1 -- 172.21.15.57:0/2765629244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 msgr2=0x55808a92c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.799+0000 7f97bb7fe700 1 --2- 172.21.15.57:0/2765629244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 0x55808a92c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.799+0000 7f97bb7fe700 1 -- 172.21.15.57:0/2765629244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a920cd0 msgr2=0x55808a9264f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.799+0000 7f97bb7fe700 1 --2- 172.21.15.57:0/2765629244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a920cd0 0x55808a9264f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.799+0000 7f97bb7fe700 1 -- 172.21.15.57:0/2765629244 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55808a9173f0 con 0x55808a9203c0 2023-03-02T10:57:56.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.799+0000 7f97baffd700 1 --2- 172.21.15.57:0/2765629244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a920cd0 0x55808a9264f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.799+0000 7f97bbfff700 1 --2- 172.21.15.57:0/2765629244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 0x55808a92c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.799+0000 7f97bb7fe700 1 --2- 172.21.15.57:0/2765629244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a9274e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55808a93caf0 tx=0x7f97ac009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12fa5d1b9a065ed server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.799+0000 7f97a27fc700 1 -- 172.21.15.57:0/2765629244 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac017030 con 0x55808a9203c0 2023-03-02T10:57:56.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.799+0000 7f97a27fc700 1 -- 172.21.15.57:0/2765629244 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97ac018040 con 0x55808a9203c0 2023-03-02T10:57:56.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.799+0000 7f97a27fc700 1 -- 172.21.15.57:0/2765629244 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac004e30 con 0x55808a9203c0 2023-03-02T10:57:56.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.800+0000 7f97d5b13b80 1 -- 172.21.15.57:0/2765629244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 msgr2=0x55808a9274e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.800+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/2765629244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a9274e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55808a93caf0 tx=0x7f97ac009260 comp rx=0 tx=0).stop 2023-03-02T10:57:56.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.800+0000 7f97d5b13b80 1 -- 172.21.15.57:0/2765629244 shutdown_connections 2023-03-02T10:57:56.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.800+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/2765629244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 0x55808a92c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.800+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/2765629244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a9203c0 0x55808a9274e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.800+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/2765629244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a920cd0 0x55808a9264f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.800+0000 7f97d5b13b80 1 -- 172.21.15.57:0/2765629244 >> 172.21.15.57:0/2765629244 conn(0x55808a915c50 msgr2=0x55808a926dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.800+0000 7f97d5b13b80 1 -- 172.21.15.57:0/2765629244 shutdown_connections 2023-03-02T10:57:56.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.800+0000 7f97d5b13b80 1 -- 172.21.15.57:0/2765629244 wait complete. 2023-03-02T10:57:56.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.800+0000 7f97d5b13b80 1 -- start start 2023-03-02T10:57:56.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97d5b13b80 1 Processor -- start 2023-03-02T10:57:56.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a9203c0 0x55808a929720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a920cd0 0x55808a928290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97d5b13b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 0x55808a9287d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a929e40 con 0x55808a9203c0 2023-03-02T10:57:56.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a929fb0 con 0x55808a925110 2023-03-02T10:57:56.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97d5b13b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808a928d90 con 0x55808a920cd0 2023-03-02T10:57:56.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97d5b13b80 10 client.0 _ll_register_callbacks cb 0x55808a91a3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:56.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a9203c0 0x55808a929720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a9203c0 0x55808a929720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43682/0 (socket says 172.21.15.57:43682) 2023-03-02T10:57:56.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97bb7fe700 1 -- 172.21.15.57:0/3592670617 learned_addr learned my addr 172.21.15.57:0/3592670617 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:56.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97baffd700 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a920cd0 0x55808a928290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.801+0000 7f97bbfff700 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 0x55808a9287d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f97bb7fe700 1 -- 172.21.15.57:0/3592670617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a920cd0 msgr2=0x55808a928290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f97bb7fe700 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a920cd0 0x55808a928290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f97bb7fe700 1 -- 172.21.15.57:0/3592670617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 msgr2=0x55808a9287d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:56.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f97bb7fe700 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 0x55808a9287d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f97bb7fe700 1 -- 172.21.15.57:0/3592670617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55808a6f4630 con 0x55808a9203c0 2023-03-02T10:57:56.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f97baffd700 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a920cd0 0x55808a928290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f97bbfff700 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 0x55808a9287d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:56.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f97bb7fe700 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a9203c0 0x55808a929720 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009940 tx=0x7f97ac021190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9cdc91c039e9f6 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:56.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f979affd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:56.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f979affd700 1 -- 172.21.15.57:0/3592670617 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac017030 con 0x55808a9203c0 2023-03-02T10:57:56.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f979affd700 1 -- 172.21.15.57:0/3592670617 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f97ac004750 con 0x55808a9203c0 2023-03-02T10:57:56.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f97d5b13b80 1 -- 172.21.15.57:0/3592670617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97b400f040 con 0x55808a9203c0 2023-03-02T10:57:56.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f979affd700 1 -- 172.21.15.57:0/3592670617 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97ac0121f0 con 0x55808a9203c0 2023-03-02T10:57:56.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f97d5b13b80 10 client.15864 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.802+0000 7f97d5b13b80 1 -- 172.21.15.57:0/3592670617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f97ac012570 con 0x55808a9203c0 2023-03-02T10:57:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.803+0000 7f979affd700 1 -- 172.21.15.57:0/3592670617 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97b400f040 con 0x55808a9203c0 2023-03-02T10:57:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.803+0000 7f979affd700 1 -- 172.21.15.57:0/3592670617 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f97ac021750 con 0x55808a9203c0 2023-03-02T10:57:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.803+0000 7f97d5b13b80 10 client.15864 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.803+0000 7f97d5b13b80 10 client.15864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.803+0000 7f97d5b13b80 20 client.15864 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.803+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55808a98c860 0x55808a98ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.803+0000 7f97d5b13b80 4 client.15864 mds_command: new command op to 24560 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:57:56.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.803+0000 7f97d5b13b80 1 -- 172.21.15.57:0/3592670617 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55808a86ae90 con 0x55808a98c860 2023-03-02T10:57:56.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.803+0000 7f97baffd700 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55808a98c860 0x55808a98ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:56.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f979affd700 10 client.15864 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:56.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97baffd700 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55808a98c860 0x55808a98ec70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e87058d8adf438a4 server_cookie=890b69c2746d71d7 in_seq=0 out_seq=0 2023-03-02T10:57:56.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f979affd700 1 -- 172.21.15.57:0/3592670617 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55808a86ae90 con 0x55808a98c860 2023-03-02T10:57:56.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f979affd700 10 client.15864 handle_command_reply: tid=0 2023-03-02T10:57:56.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 1 client.15864 shutdown 2023-03-02T10:57:56.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 1 -- 172.21.15.57:0/3592670617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a9203c0 msgr2=0x55808a929720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a9203c0 0x55808a929720 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009940 tx=0x7f97ac021190 comp rx=0 tx=0).stop 2023-03-02T10:57:56.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 1 -- 172.21.15.57:0/3592670617 shutdown_connections 2023-03-02T10:57:56.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55808a98c860 0x55808a98ec70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55808a925110 0x55808a9287d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55808a9203c0 0x55808a929720 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f979affd700 0 client.15864 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:56.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 1 --2- 172.21.15.57:0/3592670617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55808a920cd0 0x55808a928290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 1 -- 172.21.15.57:0/3592670617 >> 172.21.15.57:0/3592670617 conn(0x55808a915c50 msgr2=0x55808a927640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 1 -- 172.21.15.57:0/3592670617 shutdown_connections 2023-03-02T10:57:56.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 1 -- 172.21.15.57:0/3592670617 wait complete. 2023-03-02T10:57:56.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.804+0000 7f97d5b13b80 20 client.15864 trim_cache size 0 max 16384 2023-03-02T10:57:56.814 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:57:56.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 -- 172.21.15.57:0/3863685 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f97a409b4c0 msgr2=0x7f97a409d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f97a409b4c0 0x7f97a409d970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f97b4020000 tx=0x7f97b4023000 comp rx=0 tx=0).stop 2023-03-02T10:57:56.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 -- 172.21.15.57:0/3863685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97bc101590 msgr2=0x7f97bc0fee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:56.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97bc101590 0x7f97bc0fee10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97b0000c00 tx=0x7f97b0009580 comp rx=0 tx=0).stop 2023-03-02T10:57:56.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 -- 172.21.15.57:0/3863685 shutdown_connections 2023-03-02T10:57:56.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f97a409b4c0 0x7f97a409d970 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97bc10a050 0x7f97bc1a3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97bc100c80 0x7f97bc0fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 --2- 172.21.15.57:0/3863685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97bc101590 0x7f97bc0fee10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:56.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 -- 172.21.15.57:0/3863685 >> 172.21.15.57:0/3863685 conn(0x7f97bc0fa4b0 msgr2=0x7f97bc10c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:56.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 -- 172.21.15.57:0/3863685 shutdown_connections 2023-03-02T10:57:56.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:56.805+0000 7f97c21ff700 1 -- 172.21.15.57:0/3863685 wait complete. 2023-03-02T10:57:56.818 INFO:teuthology.orchestra.run.smithi057.stderr:27700000 of 50000000 tuples (55%) done (elapsed 41.62 s, remaining 33.51 s) 2023-03-02T10:57:56.943 INFO:teuthology.orchestra.run.smithi057.stderr:27800000 of 50000000 tuples (55%) done (elapsed 41.75 s, remaining 33.34 s) 2023-03-02T10:57:57.061 INFO:teuthology.orchestra.run.smithi057.stderr:27900000 of 50000000 tuples (55%) done (elapsed 41.87 s, remaining 33.16 s) 2023-03-02T10:57:57.163 INFO:teuthology.orchestra.run.smithi057.stderr:28000000 of 50000000 tuples (56%) done (elapsed 41.97 s, remaining 32.98 s) 2023-03-02T10:57:57.277 INFO:teuthology.orchestra.run.smithi057.stderr:28100000 of 50000000 tuples (56%) done (elapsed 42.08 s, remaining 32.80 s) 2023-03-02T10:57:57.395 INFO:teuthology.orchestra.run.smithi057.stderr:28200000 of 50000000 tuples (56%) done (elapsed 42.20 s, remaining 32.62 s) 2023-03-02T10:57:57.522 INFO:teuthology.orchestra.run.smithi057.stderr:28300000 of 50000000 tuples (56%) done (elapsed 42.33 s, remaining 32.46 s) 2023-03-02T10:57:57.632 INFO:teuthology.orchestra.run.smithi057.stderr:28400000 of 50000000 tuples (56%) done (elapsed 42.44 s, remaining 32.28 s) 2023-03-02T10:57:57.784 INFO:teuthology.orchestra.run.smithi057.stderr:28500000 of 50000000 tuples (57%) done (elapsed 42.59 s, remaining 32.13 s) 2023-03-02T10:57:57.821 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-03-02T10:57:57.821 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-03-02T10:57:57.926 INFO:teuthology.orchestra.run.smithi057.stderr:28600000 of 50000000 tuples (57%) done (elapsed 42.73 s, remaining 31.97 s) 2023-03-02T10:57:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:57 smithi057 ceph-mon[92072]: pgmap v31: 97 pgs: 97 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 149 MiB/s wr, 86 op/s 2023-03-02T10:57:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:57 smithi122 ceph-mon[125440]: pgmap v31: 97 pgs: 97 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 149 MiB/s wr, 86 op/s 2023-03-02T10:57:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.000+0000 7fd43a3ff700 1 -- 172.21.15.57:0/3617147570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd434110ae0 msgr2=0x7fd434112ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.000+0000 7fd43a3ff700 1 --2- 172.21.15.57:0/3617147570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd434110ae0 0x7fd434112ec0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00b0a0 tx=0x7fd42c00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.000+0000 7fd43a3ff700 1 -- 172.21.15.57:0/3617147570 shutdown_connections 2023-03-02T10:57:58.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.000+0000 7fd43a3ff700 1 --2- 172.21.15.57:0/3617147570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd434110ae0 0x7fd434112ec0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.000+0000 7fd43a3ff700 1 --2- 172.21.15.57:0/3617147570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd434072930 0x7fd434072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.000+0000 7fd43a3ff700 1 --2- 172.21.15.57:0/3617147570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd434073240 0x7fd4341105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.000+0000 7fd43a3ff700 1 -- 172.21.15.57:0/3617147570 >> 172.21.15.57:0/3617147570 conn(0x7fd4340fb5b0 msgr2=0x7fd4340fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.000+0000 7fd43a3ff700 1 -- 172.21.15.57:0/3617147570 shutdown_connections 2023-03-02T10:57:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.000+0000 7fd43a3ff700 1 -- 172.21.15.57:0/3617147570 wait complete. 2023-03-02T10:57:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.002+0000 7fd43a3ff700 1 Processor -- start 2023-03-02T10:57:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.002+0000 7fd43a3ff700 1 -- start start 2023-03-02T10:57:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.002+0000 7fd43a3ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd434072930 0x7fd43419c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.002+0000 7fd43a3ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd434073240 0x7fd43419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.002+0000 7fd43a3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd434110ae0 0x7fd4341a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.002+0000 7fd43a3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341a1370 con 0x7fd434110ae0 2023-03-02T10:57:58.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.002+0000 7fd43a3ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341a14e0 con 0x7fd434072930 2023-03-02T10:57:58.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.002+0000 7fd43a3ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341a16a0 con 0x7fd434073240 2023-03-02T10:57:58.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.003+0000 7fd433fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd434072930 0x7fd43419c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.003+0000 7fd433fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd434072930 0x7fd43419c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48888/0 (socket says 172.21.15.57:48888) 2023-03-02T10:57:58.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.003+0000 7fd433fff700 1 -- 172.21.15.57:0/2173229672 learned_addr learned my addr 172.21.15.57:0/2173229672 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:58.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.003+0000 7fd4337fe700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd434073240 0x7fd43419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.003+0000 7fd43899c700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd434110ae0 0x7fd4341a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.003+0000 7fd433fff700 1 -- 172.21.15.57:0/2173229672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd434073240 msgr2=0x7fd43419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.003+0000 7fd433fff700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd434073240 0x7fd43419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.003+0000 7fd433fff700 1 -- 172.21.15.57:0/2173229672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd434110ae0 msgr2=0x7fd4341a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.003+0000 7fd433fff700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd434110ae0 0x7fd4341a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.004+0000 7fd433fff700 1 -- 172.21.15.57:0/2173229672 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c009d00 con 0x7fd434072930 2023-03-02T10:57:58.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.004+0000 7fd433fff700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd434072930 0x7fd43419c390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd42400e9a0 tx=0x7fd42400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.004+0000 7fd4317fa700 1 -- 172.21.15.57:0/2173229672 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424009790 con 0x7fd434072930 2023-03-02T10:57:58.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.004+0000 7fd4317fa700 1 -- 172.21.15.57:0/2173229672 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd424010430 con 0x7fd434072930 2023-03-02T10:57:58.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.004+0000 7fd43a3ff700 1 -- 172.21.15.57:0/2173229672 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd434116140 con 0x7fd434072930 2023-03-02T10:57:58.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.005+0000 7fd4317fa700 1 -- 172.21.15.57:0/2173229672 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424018680 con 0x7fd434072930 2023-03-02T10:57:58.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.005+0000 7fd43a3ff700 1 -- 172.21.15.57:0/2173229672 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd434115fb0 con 0x7fd434072930 2023-03-02T10:57:58.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.009+0000 7fd4317fa700 1 -- 172.21.15.57:0/2173229672 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7fd42400c040 con 0x7fd434072930 2023-03-02T10:57:58.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd44dde2b80 1 Processor -- start 2023-03-02T10:57:58.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd44dde2b80 1 -- start start 2023-03-02T10:57:58.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd4317fa700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd41c09b540 0x7fd41c09d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0440 0x5636e79c0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0d50 0x5636e79c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c5190 0x5636e79c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e7927ae0 con 0x5636e79c5190 2023-03-02T10:57:58.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e78da000 con 0x5636e79c0440 2023-03-02T10:57:58.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e78aa1e0 con 0x5636e79c0d50 2023-03-02T10:57:58.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd4317fa700 1 -- 172.21.15.57:0/2173229672 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd424014070 con 0x7fd434072930 2023-03-02T10:57:58.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd43899c700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd41c09b540 0x7fd41c09d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd433fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0440 0x5636e79c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.010+0000 7fd433fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0440 0x5636e79c0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48902/0 (socket says 172.21.15.57:48902) 2023-03-02T10:57:58.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd433fff700 1 -- 172.21.15.57:0/704991460 learned_addr learned my addr 172.21.15.57:0/704991460 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd4337fe700 1 --2- 172.21.15.57:0/704991460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0d50 0x5636e79c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd43899c700 1 --2- 172.21.15.57:0/704991460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c5190 0x5636e79c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd433fff700 1 -- 172.21.15.57:0/704991460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0d50 msgr2=0x5636e79c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd433fff700 1 --2- 172.21.15.57:0/704991460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0d50 0x5636e79c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd433fff700 1 -- 172.21.15.57:0/704991460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c5190 msgr2=0x5636e79c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd433fff700 1 --2- 172.21.15.57:0/704991460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c5190 0x5636e79c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd433fff700 1 -- 172.21.15.57:0/704991460 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636e77946b0 con 0x5636e79c0440 2023-03-02T10:57:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd433fff700 1 --2- 172.21.15.57:0/704991460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0440 0x5636e79c0810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd4240943f0 tx=0x7fd4240942e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc3d6b8277df0ff server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd43899c700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd41c09b540 0x7fd41c09d9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00b780 tx=0x7fd42c0094e0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd41a7fc700 1 -- 172.21.15.57:0/704991460 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424094df0 con 0x5636e79c0440 2023-03-02T10:57:58.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd41a7fc700 1 -- 172.21.15.57:0/704991460 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4240946f0 con 0x5636e79c0440 2023-03-02T10:57:58.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.011+0000 7fd41a7fc700 1 -- 172.21.15.57:0/704991460 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424010880 con 0x5636e79c0440 2023-03-02T10:57:58.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.012+0000 7fd44dde2b80 1 -- 172.21.15.57:0/704991460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0440 msgr2=0x5636e79c0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.012+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/704991460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0440 0x5636e79c0810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd4240943f0 tx=0x7fd4240942e0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.012+0000 7fd44dde2b80 1 -- 172.21.15.57:0/704991460 shutdown_connections 2023-03-02T10:57:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.012+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/704991460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c5190 0x5636e79c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.012+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/704991460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0440 0x5636e79c0810 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.012+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/704991460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0d50 0x5636e79c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.012+0000 7fd44dde2b80 1 -- 172.21.15.57:0/704991460 >> 172.21.15.57:0/704991460 conn(0x5636e79b5cd0 msgr2=0x5636e79bb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.012+0000 7fd44dde2b80 1 -- 172.21.15.57:0/704991460 shutdown_connections 2023-03-02T10:57:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.012+0000 7fd44dde2b80 1 -- 172.21.15.57:0/704991460 wait complete. 2023-03-02T10:57:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd44dde2b80 1 -- start start 2023-03-02T10:57:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd44dde2b80 1 Processor -- start 2023-03-02T10:57:58.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 0x5636e79cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c5190 0x5636e79ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e7918c40 con 0x5636e79c0440 2023-03-02T10:57:58.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e7912170 con 0x5636e79c0d50 2023-03-02T10:57:58.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e77969a0 con 0x5636e79c5190 2023-03-02T10:57:58.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd44dde2b80 10 client.0 _ll_register_callbacks cb 0x5636e78b85a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd4337fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd433fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 0x5636e79cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd4337fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48918/0 (socket says 172.21.15.57:48918) 2023-03-02T10:57:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd4337fe700 1 -- 172.21.15.57:0/2329226214 learned_addr learned my addr 172.21.15.57:0/2329226214 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.013+0000 7fd43899c700 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c5190 0x5636e79ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd433fff700 1 -- 172.21.15.57:0/2329226214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c5190 msgr2=0x5636e79ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd433fff700 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c5190 0x5636e79ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd433fff700 1 -- 172.21.15.57:0/2329226214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 msgr2=0x5636e79c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd433fff700 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd433fff700 1 -- 172.21.15.57:0/2329226214 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd434115fb0 con 0x5636e79c0440 2023-03-02T10:57:58.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd4337fe700 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:58.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd433fff700 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 0x5636e79cc980 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd42400e970 tx=0x7fd4240107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece5f046246f0b5e server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd4137fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:58.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd4137fe700 1 -- 172.21.15.57:0/2329226214 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42409be10 con 0x5636e79c0440 2023-03-02T10:57:58.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd4137fe700 1 -- 172.21.15.57:0/2329226214 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd424074310 con 0x5636e79c0440 2023-03-02T10:57:58.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd44dde2b80 1 -- 172.21.15.57:0/2329226214 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636e78e3830 con 0x5636e79c0440 2023-03-02T10:57:58.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd4137fe700 1 -- 172.21.15.57:0/2329226214 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd424092b30 con 0x5636e79c0440 2023-03-02T10:57:58.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd44dde2b80 10 client.15876 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:58.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.014+0000 7fd44dde2b80 1 -- 172.21.15.57:0/2329226214 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5636e7740e60 con 0x5636e79c0440 2023-03-02T10:57:58.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.015+0000 7fd4137fe700 1 -- 172.21.15.57:0/2329226214 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5636e78e3830 con 0x5636e79c0440 2023-03-02T10:57:58.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.015+0000 7fd4137fe700 1 -- 172.21.15.57:0/2329226214 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fd42409b980 con 0x5636e79c0440 2023-03-02T10:57:58.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.015+0000 7fd44dde2b80 10 client.15876 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:58.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.015+0000 7fd44dde2b80 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:58.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.015+0000 7fd44dde2b80 20 client.15876 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:58.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.015+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5636e79da120 0x5636e79dc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.015+0000 7fd44dde2b80 4 client.15876 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:58.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.015+0000 7fd44dde2b80 1 -- 172.21.15.57:0/2329226214 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636e790b1f0 con 0x5636e79da120 2023-03-02T10:57:58.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.015+0000 7fd4337fe700 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5636e79da120 0x5636e79dc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.015+0000 7fd4337fe700 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5636e79da120 0x5636e79dc530 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf9ff1e0bd04dfca server_cookie=e0518b8e91fffaec in_seq=0 out_seq=0 2023-03-02T10:57:58.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.015+0000 7fd4137fe700 10 client.15876 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:58.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd4137fe700 1 -- 172.21.15.57:0/2329226214 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5636e790b1f0 con 0x5636e79da120 2023-03-02T10:57:58.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd4137fe700 10 client.15876 handle_command_reply: tid=0 2023-03-02T10:57:58.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd44dde2b80 1 client.15876 shutdown 2023-03-02T10:57:58.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd44dde2b80 1 -- 172.21.15.57:0/2329226214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 msgr2=0x5636e79cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 0x5636e79cc980 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd42400e970 tx=0x7fd4240107d0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd44dde2b80 1 -- 172.21.15.57:0/2329226214 shutdown_connections 2023-03-02T10:57:58.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5636e79da120 0x5636e79dc530 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c5190 0x5636e79ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 0x5636e79cc980 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/2329226214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd44dde2b80 1 -- 172.21.15.57:0/2329226214 >> 172.21.15.57:0/2329226214 conn(0x5636e79b5cd0 msgr2=0x5636e79bb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd4137fe700 0 client.15876 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:58.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd44dde2b80 1 -- 172.21.15.57:0/2329226214 shutdown_connections 2023-03-02T10:57:58.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.016+0000 7fd44dde2b80 1 -- 172.21.15.57:0/2329226214 wait complete. 2023-03-02T10:57:58.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.017+0000 7fd44dde2b80 20 client.15876 trim_cache size 0 max 16384 2023-03-02T10:57:58.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd44dde2b80 1 Processor -- start 2023-03-02T10:57:58.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd44dde2b80 1 -- start start 2023-03-02T10:57:58.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0440 0x5636e79c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c5190 0x5636e79c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e79cb1e0 con 0x5636e79c5190 2023-03-02T10:57:58.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e79c7f80 con 0x5636e79c0d50 2023-03-02T10:57:58.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e79b5850 con 0x5636e79c0440 2023-03-02T10:57:58.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd43899c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c5190 0x5636e79c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd4337fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd43899c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c5190 0x5636e79c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43728/0 (socket says 172.21.15.57:43728) 2023-03-02T10:57:58.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd43899c700 1 -- 172.21.15.57:0/823295355 learned_addr learned my addr 172.21.15.57:0/823295355 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:58.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd4337fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48932/0 (socket says 172.21.15.57:48932) 2023-03-02T10:57:58.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.034+0000 7fd433fff700 1 --2- 172.21.15.57:0/823295355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0440 0x5636e79c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.035+0000 7fd4337fe700 1 -- 172.21.15.57:0/823295355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0440 msgr2=0x5636e79c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.035+0000 7fd4337fe700 1 --2- 172.21.15.57:0/823295355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0440 0x5636e79c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.035+0000 7fd4337fe700 1 -- 172.21.15.57:0/823295355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c5190 msgr2=0x5636e79c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.035+0000 7fd4337fe700 1 --2- 172.21.15.57:0/823295355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c5190 0x5636e79c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.035+0000 7fd4337fe700 1 -- 172.21.15.57:0/823295355 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636e79b9f70 con 0x5636e79c0d50 2023-03-02T10:57:58.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.035+0000 7fd4337fe700 1 --2- 172.21.15.57:0/823295355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79cc520 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5636e79dce10 tx=0x7fd42800b410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca453cd2e626edf6 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.035+0000 7fd41affd700 1 -- 172.21.15.57:0/823295355 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428016070 con 0x5636e79c0d50 2023-03-02T10:57:58.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.035+0000 7fd41affd700 1 -- 172.21.15.57:0/823295355 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd428017040 con 0x5636e79c0d50 2023-03-02T10:57:58.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.035+0000 7fd41affd700 1 -- 172.21.15.57:0/823295355 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428005020 con 0x5636e79c0d50 2023-03-02T10:57:58.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.036+0000 7fd44dde2b80 1 -- 172.21.15.57:0/823295355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 msgr2=0x5636e79cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.036+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/823295355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79cc520 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5636e79dce10 tx=0x7fd42800b410 comp rx=0 tx=0).stop 2023-03-02T10:57:58.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.036+0000 7fd44dde2b80 1 -- 172.21.15.57:0/823295355 shutdown_connections 2023-03-02T10:57:58.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.036+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/823295355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c5190 0x5636e79c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.036+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/823295355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0440 0x5636e79c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.036+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/823295355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c0d50 0x5636e79cc520 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.036+0000 7fd44dde2b80 1 -- 172.21.15.57:0/823295355 >> 172.21.15.57:0/823295355 conn(0x5636e79b5cd0 msgr2=0x5636e79c41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.036+0000 7fd44dde2b80 1 -- 172.21.15.57:0/823295355 shutdown_connections 2023-03-02T10:57:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.036+0000 7fd44dde2b80 1 -- 172.21.15.57:0/823295355 wait complete. 2023-03-02T10:57:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.036+0000 7fd44dde2b80 1 -- start start 2023-03-02T10:57:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.036+0000 7fd44dde2b80 1 Processor -- start 2023-03-02T10:57:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 0x5636e79cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0d50 0x5636e79cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd44dde2b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c5190 0x5636e7a2b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e79d06d0 con 0x5636e79c0440 2023-03-02T10:57:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e79d0840 con 0x5636e79c5190 2023-03-02T10:57:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd44dde2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636e7a2bf20 con 0x5636e79c0d50 2023-03-02T10:57:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd44dde2b80 10 client.0 _ll_register_callbacks cb 0x5636e78b85a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd433fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 0x5636e79cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd433fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 0x5636e79cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43742/0 (socket says 172.21.15.57:43742) 2023-03-02T10:57:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd433fff700 1 -- 172.21.15.57:0/329810694 learned_addr learned my addr 172.21.15.57:0/329810694 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd43899c700 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c5190 0x5636e7a2b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd4337fe700 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0d50 0x5636e79cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd433fff700 1 -- 172.21.15.57:0/329810694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0d50 msgr2=0x5636e79cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd433fff700 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0d50 0x5636e79cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd433fff700 1 -- 172.21.15.57:0/329810694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c5190 msgr2=0x5636e7a2b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd433fff700 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c5190 0x5636e7a2b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd433fff700 1 -- 172.21.15.57:0/329810694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42800bb70 con 0x5636e79c0440 2023-03-02T10:57:58.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd433fff700 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 0x5636e79cfa00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd424092a40 tx=0x7fd4240c2e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bece4a9ab7f3091 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.037+0000 7fd4137fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:58.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd4137fe700 1 -- 172.21.15.57:0/329810694 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424090a30 con 0x5636e79c0440 2023-03-02T10:57:58.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd44dde2b80 1 -- 172.21.15.57:0/329810694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd4240946f0 con 0x5636e79c0440 2023-03-02T10:57:58.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd4137fe700 1 -- 172.21.15.57:0/329810694 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd424074310 con 0x5636e79c0440 2023-03-02T10:57:58.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd4137fe700 1 -- 172.21.15.57:0/329810694 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd424094df0 con 0x5636e79c0440 2023-03-02T10:57:58.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd44dde2b80 10 client.15882 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:58.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd44dde2b80 1 -- 172.21.15.57:0/329810694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5636e7729ce0 con 0x5636e79c0440 2023-03-02T10:57:58.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd4137fe700 1 -- 172.21.15.57:0/329810694 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4240946f0 con 0x5636e79c0440 2023-03-02T10:57:58.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd4137fe700 1 -- 172.21.15.57:0/329810694 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fd4240936e0 con 0x5636e79c0440 2023-03-02T10:57:58.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd44dde2b80 10 client.15882 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:58.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd44dde2b80 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:58.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd44dde2b80 20 client.15882 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:58.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5636e7a2d250 0x5636e7a2f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd44dde2b80 4 client.15882 mds_command: new command op to 24560 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-03-02T10:57:58.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.038+0000 7fd44dde2b80 1 -- 172.21.15.57:0/329810694 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5636e790af10 con 0x5636e7a2d250 2023-03-02T10:57:58.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.039+0000 7fd4337fe700 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5636e7a2d250 0x5636e7a2f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.039+0000 7fd4137fe700 10 client.15882 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:58.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.039+0000 7fd4337fe700 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5636e7a2d250 0x5636e7a2f630 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50cfe0d9bc27a4dc server_cookie=df31cc9d001cf1d0 in_seq=0 out_seq=0 2023-03-02T10:57:58.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd4137fe700 1 -- 172.21.15.57:0/329810694 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5636e790af10 con 0x5636e7a2d250 2023-03-02T10:57:58.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd4137fe700 10 client.15882 handle_command_reply: tid=0 2023-03-02T10:57:58.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 1 client.15882 shutdown 2023-03-02T10:57:58.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 1 -- 172.21.15.57:0/329810694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 msgr2=0x5636e79cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 0x5636e79cfa00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd424092a40 tx=0x7fd4240c2e60 comp rx=0 tx=0).stop 2023-03-02T10:57:58.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 1 -- 172.21.15.57:0/329810694 shutdown_connections 2023-03-02T10:57:58.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5636e7a2d250 0x5636e7a2f630 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5636e79c5190 0x5636e7a2b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5636e79c0440 0x5636e79cfa00 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd4137fe700 0 client.15882 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:58.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 1 --2- 172.21.15.57:0/329810694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5636e79c0d50 0x5636e79cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 1 -- 172.21.15.57:0/329810694 >> 172.21.15.57:0/329810694 conn(0x5636e79b5cd0 msgr2=0x5636e79c4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 1 -- 172.21.15.57:0/329810694 shutdown_connections 2023-03-02T10:57:58.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 1 -- 172.21.15.57:0/329810694 wait complete. 2023-03-02T10:57:58.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.040+0000 7fd44dde2b80 20 client.15882 trim_cache size 0 max 16384 2023-03-02T10:57:58.050 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:57:58.050 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": 0, 2023-03-02T10:57:58.050 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_tag": "f1cfc471-e4e0-40ad-8523-43e51eef793a", 2023-03-02T10:57:58.051 INFO:teuthology.orchestra.run.smithi057.stdout: "mode": "asynchronous" 2023-03-02T10:57:58.051 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:57:58.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 -- 172.21.15.57:0/2173229672 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd41c09b540 msgr2=0x7fd41c09d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd41c09b540 0x7fd41c09d9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00b780 tx=0x7fd42c0094e0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 -- 172.21.15.57:0/2173229672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd434072930 msgr2=0x7fd43419c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd434072930 0x7fd43419c390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd42400e9a0 tx=0x7fd42400ecb0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 -- 172.21.15.57:0/2173229672 shutdown_connections 2023-03-02T10:57:58.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd41c09b540 0x7fd41c09d9f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd434110ae0 0x7fd4341a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd434072930 0x7fd43419c390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 --2- 172.21.15.57:0/2173229672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd434073240 0x7fd43419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 -- 172.21.15.57:0/2173229672 >> 172.21.15.57:0/2173229672 conn(0x7fd4340fb5b0 msgr2=0x7fd4340fc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 -- 172.21.15.57:0/2173229672 shutdown_connections 2023-03-02T10:57:58.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.041+0000 7fd43a3ff700 1 -- 172.21.15.57:0/2173229672 wait complete. 2023-03-02T10:57:58.053 INFO:teuthology.orchestra.run.smithi057.stderr:28700000 of 50000000 tuples (57%) done (elapsed 42.86 s, remaining 31.81 s) 2023-03-02T10:57:58.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T10:57:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:57 smithi136 ceph-mon[125702]: pgmap v31: 97 pgs: 97 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 149 MiB/s wr, 86 op/s 2023-03-02T10:57:58.204 INFO:teuthology.orchestra.run.smithi057.stderr:28800000 of 50000000 tuples (57%) done (elapsed 43.01 s, remaining 31.66 s) 2023-03-02T10:57:58.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.247+0000 7fd0b0dff700 1 -- 172.21.15.57:0/1200729850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0ac0fe840 msgr2=0x7fd0ac0fec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.247+0000 7fd0b0dff700 1 --2- 172.21.15.57:0/1200729850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0ac0fe840 0x7fd0ac0fec10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009990 tx=0x7fd09c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.247+0000 7fd0b0dff700 1 -- 172.21.15.57:0/1200729850 shutdown_connections 2023-03-02T10:57:58.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.247+0000 7fd0b0dff700 1 --2- 172.21.15.57:0/1200729850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0ac10c3f0 0x7fd0ac10e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.247+0000 7fd0b0dff700 1 --2- 172.21.15.57:0/1200729850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0ac0fe840 0x7fd0ac0fec10 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.247+0000 7fd0b0dff700 1 --2- 172.21.15.57:0/1200729850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0ac0ff150 0x7fd0ac10beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.247+0000 7fd0b0dff700 1 -- 172.21.15.57:0/1200729850 >> 172.21.15.57:0/1200729850 conn(0x7fd0ac0fa4b0 msgr2=0x7fd0ac0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.247+0000 7fd0b0dff700 1 -- 172.21.15.57:0/1200729850 shutdown_connections 2023-03-02T10:57:58.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.247+0000 7fd0b0dff700 1 -- 172.21.15.57:0/1200729850 wait complete. 2023-03-02T10:57:58.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.248+0000 7fd0b0dff700 1 Processor -- start 2023-03-02T10:57:58.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.248+0000 7fd0b0dff700 1 -- start start 2023-03-02T10:57:58.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0b0dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0ac0fe840 0x7fd0ac197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0b0dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0ac0ff150 0x7fd0ac198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0b0dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0ac10c3f0 0x7fd0ac19c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0b0dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac19ce10 con 0x7fd0ac10c3f0 2023-03-02T10:57:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0b0dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac19cf80 con 0x7fd0ac0fe840 2023-03-02T10:57:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0b0dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac19d140 con 0x7fd0ac0ff150 2023-03-02T10:57:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0a3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0ac0ff150 0x7fd0ac198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0aad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0ac10c3f0 0x7fd0ac19c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0a3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0ac0ff150 0x7fd0ac198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47174/0 (socket says 172.21.15.57:47174) 2023-03-02T10:57:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0a3fff700 1 -- 172.21.15.57:0/3435908151 learned_addr learned my addr 172.21.15.57:0/3435908151 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0aa59c700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0ac0fe840 0x7fd0ac197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0a3fff700 1 -- 172.21.15.57:0/3435908151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0ac0fe840 msgr2=0x7fd0ac197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0ac0fe840 0x7fd0ac197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0a3fff700 1 -- 172.21.15.57:0/3435908151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0ac10c3f0 msgr2=0x7fd0ac19c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0ac10c3f0 0x7fd0ac19c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0a3fff700 1 -- 172.21.15.57:0/3435908151 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c0095f0 con 0x7fd0ac0ff150 2023-03-02T10:57:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.249+0000 7fd0aad9d700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0ac10c3f0 0x7fd0ac19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.250+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0ac0ff150 0x7fd0ac198370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd09400e9a0 tx=0x7fd09400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.250+0000 7fd0a37fe700 1 -- 172.21.15.57:0/3435908151 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094009790 con 0x7fd0ac0ff150 2023-03-02T10:57:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.250+0000 7fd0b0dff700 1 -- 172.21.15.57:0/3435908151 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac111cd0 con 0x7fd0ac0ff150 2023-03-02T10:57:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.250+0000 7fd0a37fe700 1 -- 172.21.15.57:0/3435908151 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd094010430 con 0x7fd0ac0ff150 2023-03-02T10:57:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.250+0000 7fd0a37fe700 1 -- 172.21.15.57:0/3435908151 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094018680 con 0x7fd0ac0ff150 2023-03-02T10:57:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.250+0000 7fd0b0dff700 1 -- 172.21.15.57:0/3435908151 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac111b40 con 0x7fd0ac0ff150 2023-03-02T10:57:58.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.253+0000 7fd0a37fe700 1 -- 172.21.15.57:0/3435908151 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 23) v1 ==== 129994+0+0 (secure 0 0 0) 0x7fd09400c040 con 0x7fd0ac0ff150 2023-03-02T10:57:58.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.253+0000 7fd0a37fe700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09809b4c0 0x7fd09809d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.254+0000 7fd0a37fe700 1 -- 172.21.15.57:0/3435908151 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd094014070 con 0x7fd0ac0ff150 2023-03-02T10:57:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.254+0000 7fd0aa59c700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09809b4c0 0x7fd09809d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.254+0000 7fd0c469eb80 1 Processor -- start 2023-03-02T10:57:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.254+0000 7fd0c469eb80 1 -- start start 2023-03-02T10:57:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.254+0000 7fd0aa59c700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09809b4c0 0x7fd09809d970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00b2e0 tx=0x7fd09c005960 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.254+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb33c0 0x565373fb3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.254+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fb7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.254+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb8110 0x565373fb8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.254+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x565373f1aa60 con 0x565373fb8110 2023-03-02T10:57:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.254+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x565373eccf80 con 0x565373fb33c0 2023-03-02T10:57:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.254+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x565373e9d160 con 0x565373fb3cd0 2023-03-02T10:57:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fb7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0aa59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb33c0 0x565373fb3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fb7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47184/0 (socket says 172.21.15.57:47184) 2023-03-02T10:57:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a3fff700 1 -- 172.21.15.57:0/1413682478 learned_addr learned my addr 172.21.15.57:0/1413682478 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0aad9d700 1 --2- 172.21.15.57:0/1413682478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb8110 0x565373fb8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a3fff700 1 -- 172.21.15.57:0/1413682478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb33c0 msgr2=0x565373fb3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/1413682478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb33c0 0x565373fb3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a3fff700 1 -- 172.21.15.57:0/1413682478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb8110 msgr2=0x565373fb8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/1413682478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb8110 0x565373fb8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a3fff700 1 -- 172.21.15.57:0/1413682478 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565373d87630 con 0x565373fb3cd0 2023-03-02T10:57:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/1413682478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fb7bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd0940c3040 tx=0x7fd094094110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcaf3577f3054f8b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a0ff9700 1 -- 172.21.15.57:0/1413682478 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094098170 con 0x565373fb3cd0 2023-03-02T10:57:58.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a0ff9700 1 -- 172.21.15.57:0/1413682478 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0940947b0 con 0x565373fb3cd0 2023-03-02T10:57:58.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.255+0000 7fd0a0ff9700 1 -- 172.21.15.57:0/1413682478 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09409ba40 con 0x565373fb3cd0 2023-03-02T10:57:58.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.256+0000 7fd0c469eb80 1 -- 172.21.15.57:0/1413682478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 msgr2=0x565373fb7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.256+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/1413682478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fb7bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd0940c3040 tx=0x7fd094094110 comp rx=0 tx=0).stop 2023-03-02T10:57:58.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.256+0000 7fd0c469eb80 1 -- 172.21.15.57:0/1413682478 shutdown_connections 2023-03-02T10:57:58.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.256+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/1413682478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb8110 0x565373fb8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.256+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/1413682478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb33c0 0x565373fb3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.256+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/1413682478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fb7bd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.256+0000 7fd0c469eb80 1 -- 172.21.15.57:0/1413682478 >> 172.21.15.57:0/1413682478 conn(0x565373fa8c50 msgr2=0x565373fae460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.256+0000 7fd0c469eb80 1 -- 172.21.15.57:0/1413682478 shutdown_connections 2023-03-02T10:57:58.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.256+0000 7fd0c469eb80 1 -- 172.21.15.57:0/1413682478 wait complete. 2023-03-02T10:57:58.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0c469eb80 1 -- start start 2023-03-02T10:57:58.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0c469eb80 1 Processor -- start 2023-03-02T10:57:58.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb33c0 0x565373fbf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fbcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 0x565373fbd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x565373f0bbc0 con 0x565373fb33c0 2023-03-02T10:57:58.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x565373f050f0 con 0x565373fb8110 2023-03-02T10:57:58.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x565373d89920 con 0x565373fb3cd0 2023-03-02T10:57:58.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0c469eb80 10 client.0 _ll_register_callbacks cb 0x565373eab520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:58.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0a3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fbcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0aa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb33c0 0x565373fbf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.257+0000 7fd0a3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fbcb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47190/0 (socket says 172.21.15.57:47190) 2023-03-02T10:57:58.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd0a3fff700 1 -- 172.21.15.57:0/3205412190 learned_addr learned my addr 172.21.15.57:0/3205412190 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:58.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd0aad9d700 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 0x565373fbd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd0a3fff700 1 -- 172.21.15.57:0/3205412190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 msgr2=0x565373fbd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 0x565373fbd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd0a3fff700 1 -- 172.21.15.57:0/3205412190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb33c0 msgr2=0x565373fbf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb33c0 0x565373fbf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd0a3fff700 1 -- 172.21.15.57:0/3205412190 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac111b40 con 0x565373fb3cd0 2023-03-02T10:57:58.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd0aad9d700 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 0x565373fbd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:57:58.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fbcb20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd09400e970 tx=0x7fd0940982b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb5a11a05f119af9 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd091ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:57:58.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd091ffb700 1 -- 172.21.15.57:0/3205412190 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09409bc40 con 0x565373fb3cd0 2023-03-02T10:57:58.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd091ffb700 1 -- 172.21.15.57:0/3205412190 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd094090040 con 0x565373fb3cd0 2023-03-02T10:57:58.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.258+0000 7fd0c469eb80 1 -- 172.21.15.57:0/3205412190 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565373ed67b0 con 0x565373fb3cd0 2023-03-02T10:57:58.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd091ffb700 1 -- 172.21.15.57:0/3205412190 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd094092bd0 con 0x565373fb3cd0 2023-03-02T10:57:58.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd0c469eb80 10 client.25696 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:58.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd0c469eb80 1 -- 172.21.15.57:0/3205412190 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x565373d33de0 con 0x565373fb3cd0 2023-03-02T10:57:58.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd091ffb700 1 -- 172.21.15.57:0/3205412190 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x565373ed67b0 con 0x565373fb3cd0 2023-03-02T10:57:58.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd091ffb700 1 -- 172.21.15.57:0/3205412190 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fd09400ca10 con 0x565373fb3cd0 2023-03-02T10:57:58.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd0c469eb80 10 client.25696 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:58.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd0c469eb80 10 client.25696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:58.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd0c469eb80 20 client.25696 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:58.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x565373fccfa0 0x565373fcf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd0c469eb80 4 client.25696 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:57:58.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd0c469eb80 1 -- 172.21.15.57:0/3205412190 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565373efe170 con 0x565373fccfa0 2023-03-02T10:57:58.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.259+0000 7fd0aa59c700 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x565373fccfa0 0x565373fcf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.260+0000 7fd0aa59c700 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x565373fccfa0 0x565373fcf3b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=389e075fbb74ff20 server_cookie=d726ed5e1cbb245a in_seq=0 out_seq=0 2023-03-02T10:57:58.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.260+0000 7fd091ffb700 10 client.25696 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:58.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.260+0000 7fd091ffb700 1 -- 172.21.15.57:0/3205412190 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x565373efe170 con 0x565373fccfa0 2023-03-02T10:57:58.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.260+0000 7fd091ffb700 10 client.25696 handle_command_reply: tid=0 2023-03-02T10:57:58.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.260+0000 7fd0c469eb80 1 client.25696 shutdown 2023-03-02T10:57:58.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd0c469eb80 1 -- 172.21.15.57:0/3205412190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 msgr2=0x565373fbcb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fbcb20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd09400e970 tx=0x7fd0940982b0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd0c469eb80 1 -- 172.21.15.57:0/3205412190 shutdown_connections 2023-03-02T10:57:58.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x565373fccfa0 0x565373fcf3b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 0x565373fbd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb33c0 0x565373fbf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd091ffb700 0 client.25696 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:58.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/3205412190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fbcb20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd0c469eb80 1 -- 172.21.15.57:0/3205412190 >> 172.21.15.57:0/3205412190 conn(0x565373fa8c50 msgr2=0x565373fae050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd0c469eb80 1 -- 172.21.15.57:0/3205412190 shutdown_connections 2023-03-02T10:57:58.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd0c469eb80 1 -- 172.21.15.57:0/3205412190 wait complete. 2023-03-02T10:57:58.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.261+0000 7fd0c469eb80 20 client.25696 trim_cache size 0 max 16384 2023-03-02T10:57:58.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0c469eb80 1 Processor -- start 2023-03-02T10:57:58.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0c469eb80 1 -- start start 2023-03-02T10:57:58.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb33c0 0x565373fc87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fc8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 0x565373fb9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x565373fc9260 con 0x565373fb33c0 2023-03-02T10:57:58.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x565373fa6020 con 0x565373fb8110 2023-03-02T10:57:58.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x565373fb4420 con 0x565373fb3cd0 2023-03-02T10:57:58.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0a3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fc8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0aad9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 0x565373fb9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0aa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb33c0 0x565373fc87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0a3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fc8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47192/0 (socket says 172.21.15.57:47192) 2023-03-02T10:57:58.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0a3fff700 1 -- 172.21.15.57:0/2178326998 learned_addr learned my addr 172.21.15.57:0/2178326998 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:58.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.278+0000 7fd0aad9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 0x565373fb9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48998/0 (socket says 172.21.15.57:48998) 2023-03-02T10:57:58.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.279+0000 7fd0aa59c700 1 -- 172.21.15.57:0/2178326998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 msgr2=0x565373fc8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.279+0000 7fd0aa59c700 1 --2- 172.21.15.57:0/2178326998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fc8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.279+0000 7fd0aa59c700 1 -- 172.21.15.57:0/2178326998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 msgr2=0x565373fb9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.279+0000 7fd0aa59c700 1 --2- 172.21.15.57:0/2178326998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 0x565373fb9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.279+0000 7fd0aa59c700 1 -- 172.21.15.57:0/2178326998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565373ecc190 con 0x565373fb33c0 2023-03-02T10:57:58.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.279+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/2178326998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fc8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:58.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.279+0000 7fd0aad9d700 1 --2- 172.21.15.57:0/2178326998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 0x565373fb9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:57:58.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.279+0000 7fd0aa59c700 1 --2- 172.21.15.57:0/2178326998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb33c0 0x565373fc87e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0059d0 tx=0x7fd09c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2269f7922c51eccd server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.279+0000 7fd0a17fa700 1 -- 172.21.15.57:0/2178326998 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c02d040 con 0x565373fb33c0 2023-03-02T10:57:58.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.279+0000 7fd0a17fa700 1 -- 172.21.15.57:0/2178326998 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd09c02e040 con 0x565373fb33c0 2023-03-02T10:57:58.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.279+0000 7fd0a17fa700 1 -- 172.21.15.57:0/2178326998 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c034ab0 con 0x565373fb33c0 2023-03-02T10:57:58.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.280+0000 7fd0c469eb80 1 -- 172.21.15.57:0/2178326998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb33c0 msgr2=0x565373fc87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.280+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/2178326998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb33c0 0x565373fc87e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0059d0 tx=0x7fd09c020000 comp rx=0 tx=0).stop 2023-03-02T10:57:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.280+0000 7fd0c469eb80 1 -- 172.21.15.57:0/2178326998 shutdown_connections 2023-03-02T10:57:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.280+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/2178326998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb8110 0x565373fb9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.280+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/2178326998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb33c0 0x565373fc87e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.280+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/2178326998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb3cd0 0x565373fc8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.280+0000 7fd0c469eb80 1 -- 172.21.15.57:0/2178326998 >> 172.21.15.57:0/2178326998 conn(0x565373fa8c50 msgr2=0x565373fb6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.280+0000 7fd0c469eb80 1 -- 172.21.15.57:0/2178326998 shutdown_connections 2023-03-02T10:57:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.280+0000 7fd0c469eb80 1 -- 172.21.15.57:0/2178326998 wait complete. 2023-03-02T10:57:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.280+0000 7fd0c469eb80 1 -- start start 2023-03-02T10:57:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.280+0000 7fd0c469eb80 1 Processor -- start 2023-03-02T10:57:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb33c0 0x565373fc2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb3cd0 0x565373fc2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0c469eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb8110 0x565373fc3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x565373fc4660 con 0x565373fb3cd0 2023-03-02T10:57:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56537401e820 con 0x565373fb33c0 2023-03-02T10:57:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0c469eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56537401e990 con 0x565373fb8110 2023-03-02T10:57:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0c469eb80 10 client.0 _ll_register_callbacks cb 0x565373eab520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:57:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0a3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb3cd0 0x565373fc2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0a3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb3cd0 0x565373fc2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43780/0 (socket says 172.21.15.57:43780) 2023-03-02T10:57:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0a3fff700 1 -- 172.21.15.57:0/4086905207 learned_addr learned my addr 172.21.15.57:0/4086905207 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:57:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0aad9d700 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb8110 0x565373fc3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0aa59c700 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb33c0 0x565373fc2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0a3fff700 1 -- 172.21.15.57:0/4086905207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb8110 msgr2=0x565373fc3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb8110 0x565373fc3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0a3fff700 1 -- 172.21.15.57:0/4086905207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb33c0 msgr2=0x565373fc2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:57:58.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb33c0 0x565373fc2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0a3fff700 1 -- 172.21.15.57:0/4086905207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565373d33de0 con 0x565373fb3cd0 2023-03-02T10:57:58.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd0a3fff700 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb3cd0 0x565373fc2b50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd09400cdd0 tx=0x7fd094010bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50b5cba85bef3e5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:57:58.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.281+0000 7fd091ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:57:58.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd091ffb700 1 -- 172.21.15.57:0/4086905207 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094094110 con 0x565373fb3cd0 2023-03-02T10:57:58.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd091ffb700 1 -- 172.21.15.57:0/4086905207 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd09409ba40 con 0x565373fb3cd0 2023-03-02T10:57:58.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd0c469eb80 1 -- 172.21.15.57:0/4086905207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0940947b0 con 0x565373fb3cd0 2023-03-02T10:57:58.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd091ffb700 1 -- 172.21.15.57:0/4086905207 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd09409bc00 con 0x565373fb3cd0 2023-03-02T10:57:58.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd0c469eb80 10 client.15900 fetch_fsmap learned FSMap version 29 2023-03-02T10:57:58.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd0c469eb80 1 -- 172.21.15.57:0/4086905207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fd0a4009e20 con 0x565373fb3cd0 2023-03-02T10:57:58.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd091ffb700 1 -- 172.21.15.57:0/4086905207 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0940947b0 con 0x565373fb3cd0 2023-03-02T10:57:58.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd091ffb700 1 -- 172.21.15.57:0/4086905207 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fd094093710 con 0x565373fb3cd0 2023-03-02T10:57:58.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd0c469eb80 10 client.15900 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:57:58.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd0c469eb80 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:57:58.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd0c469eb80 20 client.15900 populate_metadata read hostname 'smithi057' 2023-03-02T10:57:58.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x56537401fd40 0x565374022150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:57:58.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd0c469eb80 4 client.15900 mds_command: new command op to 24560 tid=0[{"prefix": "scrub status"}] 2023-03-02T10:57:58.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.282+0000 7fd0c469eb80 1 -- 172.21.15.57:0/4086905207 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x565373efde90 con 0x56537401fd40 2023-03-02T10:57:58.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.283+0000 7fd0aa59c700 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x56537401fd40 0x565374022150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:57:58.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.283+0000 7fd0aa59c700 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x56537401fd40 0x565374022150 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eb3957125646395 server_cookie=bbd4ab211f0e6a0b in_seq=0 out_seq=0 2023-03-02T10:57:58.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.283+0000 7fd091ffb700 10 client.15900 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:58.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.283+0000 7fd091ffb700 1 -- 172.21.15.57:0/4086905207 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x565373efde90 con 0x56537401fd40 2023-03-02T10:57:58.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.283+0000 7fd091ffb700 10 client.15900 handle_command_reply: tid=0 2023-03-02T10:57:58.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.283+0000 7fd0c469eb80 1 client.15900 shutdown 2023-03-02T10:57:58.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0c469eb80 1 -- 172.21.15.57:0/4086905207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb3cd0 msgr2=0x565373fc2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb3cd0 0x565373fc2b50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd09400cdd0 tx=0x7fd094010bf0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0c469eb80 1 -- 172.21.15.57:0/4086905207 shutdown_connections 2023-03-02T10:57:58.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x56537401fd40 0x565374022150 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565373fb8110 0x565373fc3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565373fb33c0 0x565373fc2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0c469eb80 1 --2- 172.21.15.57:0/4086905207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565373fb3cd0 0x565373fc2b50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd091ffb700 0 client.15900 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:57:58.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0c469eb80 1 -- 172.21.15.57:0/4086905207 >> 172.21.15.57:0/4086905207 conn(0x565373fa8c50 msgr2=0x565373fb6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0c469eb80 1 -- 172.21.15.57:0/4086905207 shutdown_connections 2023-03-02T10:57:58.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0c469eb80 1 -- 172.21.15.57:0/4086905207 wait complete. 2023-03-02T10:57:58.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0c469eb80 20 client.15900 trim_cache size 0 max 16384 2023-03-02T10:57:58.302 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:57:58.302 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "IDLE (waiting for more scrubs)", 2023-03-02T10:57:58.302 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T10:57:58.302 INFO:teuthology.orchestra.run.smithi057.stdout: "f1cfc471-e4e0-40ad-8523-43e51eef793a": { 2023-03-02T10:57:58.303 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T10:57:58.303 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "f1cfc471-e4e0-40ad-8523-43e51eef793a", 2023-03-02T10:57:58.303 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T10:57:58.303 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:57:58.303 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:57:58.303 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:57:58.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0b0dff700 1 -- 172.21.15.57:0/3435908151 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09809b4c0 msgr2=0x7fd09809d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0b0dff700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09809b4c0 0x7fd09809d970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00b2e0 tx=0x7fd09c005960 comp rx=0 tx=0).stop 2023-03-02T10:57:58.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0b0dff700 1 -- 172.21.15.57:0/3435908151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0ac0ff150 msgr2=0x7fd0ac198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:57:58.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0b0dff700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0ac0ff150 0x7fd0ac198370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd09400e9a0 tx=0x7fd09400ecb0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0b0dff700 1 -- 172.21.15.57:0/3435908151 shutdown_connections 2023-03-02T10:57:58.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0b0dff700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09809b4c0 0x7fd09809d970 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0b0dff700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0ac10c3f0 0x7fd0ac19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.284+0000 7fd0b0dff700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0ac0fe840 0x7fd0ac197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.285+0000 7fd0b0dff700 1 --2- 172.21.15.57:0/3435908151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0ac0ff150 0x7fd0ac198370 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:57:58.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.285+0000 7fd0b0dff700 1 -- 172.21.15.57:0/3435908151 >> 172.21.15.57:0/3435908151 conn(0x7fd0ac0fa4b0 msgr2=0x7fd0ac10e670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:57:58.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.285+0000 7fd0b0dff700 1 -- 172.21.15.57:0/3435908151 shutdown_connections 2023-03-02T10:57:58.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:57:58.285+0000 7fd0b0dff700 1 -- 172.21.15.57:0/3435908151 wait complete. 2023-03-02T10:57:58.306 INFO:tasks.cephfs.filesystem:scrub status for tag:f1cfc471-e4e0-40ad-8523-43e51eef793a - {'path': '/', 'tag': 'f1cfc471-e4e0-40ad-8523-43e51eef793a', 'options': 'recursive,force'} 2023-03-02T10:57:58.351 INFO:teuthology.orchestra.run.smithi057.stderr:28900000 of 50000000 tuples (57%) done (elapsed 43.16 s, remaining 31.51 s) 2023-03-02T10:57:58.468 INFO:teuthology.orchestra.run.smithi057.stderr:29000000 of 50000000 tuples (58%) done (elapsed 43.27 s, remaining 31.34 s) 2023-03-02T10:57:58.559 INFO:teuthology.orchestra.run.smithi057.stderr:29100000 of 50000000 tuples (58%) done (elapsed 43.36 s, remaining 31.14 s) 2023-03-02T10:57:58.708 INFO:teuthology.orchestra.run.smithi057.stderr:29200000 of 50000000 tuples (58%) done (elapsed 43.51 s, remaining 31.00 s) 2023-03-02T10:57:58.839 INFO:teuthology.orchestra.run.smithi057.stderr:29300000 of 50000000 tuples (58%) done (elapsed 43.64 s, remaining 30.83 s) 2023-03-02T10:57:58.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:58 smithi057 ceph-mon[92072]: scrub summary: active paths [/] 2023-03-02T10:57:58.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:58 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:58 smithi122 ceph-mon[125440]: scrub summary: active paths [/] 2023-03-02T10:57:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:58 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:58 smithi136 ceph-mon[125702]: scrub summary: active paths [/] 2023-03-02T10:57:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:58 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:59.486 INFO:teuthology.orchestra.run.smithi057.stderr:29400000 of 50000000 tuples (58%) done (elapsed 44.29 s, remaining 31.03 s) 2023-03-02T10:57:59.570 INFO:teuthology.orchestra.run.smithi057.stderr:29500000 of 50000000 tuples (59%) done (elapsed 44.37 s, remaining 30.84 s) 2023-03-02T10:57:59.730 INFO:teuthology.orchestra.run.smithi057.stderr:29600000 of 50000000 tuples (59%) done (elapsed 44.54 s, remaining 30.69 s) 2023-03-02T10:57:59.831 INFO:teuthology.orchestra.run.smithi057.stderr:29700000 of 50000000 tuples (59%) done (elapsed 44.64 s, remaining 30.51 s) 2023-03-02T10:57:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:59 smithi057 ceph-mon[92072]: scrub queued for path: / 2023-03-02T10:57:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:59 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:59 smithi057 ceph-mon[92072]: scrub summary: active paths [/] 2023-03-02T10:57:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:59 smithi057 ceph-mon[92072]: scrub summary: active paths [/] 2023-03-02T10:57:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:59 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:57:59 smithi057 ceph-mon[92072]: pgmap v32: 97 pgs: 97 active+clean; 4.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 225 MiB/s wr, 138 op/s 2023-03-02T10:57:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:59 smithi122 ceph-mon[125440]: scrub queued for path: / 2023-03-02T10:57:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:59 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:59 smithi122 ceph-mon[125440]: scrub summary: active paths [/] 2023-03-02T10:57:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:59 smithi122 ceph-mon[125440]: scrub summary: active paths [/] 2023-03-02T10:57:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:59 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:57:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:57:59 smithi122 ceph-mon[125440]: pgmap v32: 97 pgs: 97 active+clean; 4.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 225 MiB/s wr, 138 op/s 2023-03-02T10:57:59.959 INFO:teuthology.orchestra.run.smithi057.stderr:29800000 of 50000000 tuples (59%) done (elapsed 44.76 s, remaining 30.34 s) 2023-03-02T10:58:00.062 INFO:teuthology.orchestra.run.smithi057.stderr:29900000 of 50000000 tuples (59%) done (elapsed 44.87 s, remaining 30.16 s) 2023-03-02T10:58:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:59 smithi136 ceph-mon[125702]: scrub queued for path: / 2023-03-02T10:58:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:59 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:58:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:59 smithi136 ceph-mon[125702]: scrub summary: active paths [/] 2023-03-02T10:58:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:59 smithi136 ceph-mon[125702]: scrub summary: active paths [/] 2023-03-02T10:58:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:59 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:58:00.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:57:59 smithi136 ceph-mon[125702]: pgmap v32: 97 pgs: 97 active+clean; 4.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 225 MiB/s wr, 138 op/s 2023-03-02T10:58:00.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:58:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:58:00.153+0000 7f457c980700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:58:00.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:58:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:58:00.153+0000 7f457c980700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:58:00.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:58:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:58:00.153+0000 7f457c980700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:58:00.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:58:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:58:00.153+0000 7f457c980700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:58:00.433 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 10:58:00 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T10:58:00.153+0000 7f457c980700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T10:58:01.375 INFO:teuthology.orchestra.run.smithi057.stderr:30000000 of 50000000 tuples (60%) done (elapsed 46.18 s, remaining 30.79 s) 2023-03-02T10:58:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:01 smithi057 ceph-mon[92072]: pgmap v33: 97 pgs: 97 active+clean; 4.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 149 MiB/s wr, 87 op/s 2023-03-02T10:58:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:01 smithi122 ceph-mon[125440]: pgmap v33: 97 pgs: 97 active+clean; 4.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 149 MiB/s wr, 87 op/s 2023-03-02T10:58:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:01 smithi136 ceph-mon[125702]: pgmap v33: 97 pgs: 97 active+clean; 4.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 149 MiB/s wr, 87 op/s 2023-03-02T10:58:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:03 smithi057 ceph-mon[92072]: pgmap v34: 97 pgs: 97 active+clean; 4.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 212 MiB/s wr, 304 op/s 2023-03-02T10:58:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:03 smithi057 ceph-mon[92072]: mgrmap e24: x(active, since 62s), standbys: y, z 2023-03-02T10:58:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:03 smithi122 ceph-mon[125440]: pgmap v34: 97 pgs: 97 active+clean; 4.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 212 MiB/s wr, 304 op/s 2023-03-02T10:58:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:03 smithi122 ceph-mon[125440]: mgrmap e24: x(active, since 62s), standbys: y, z 2023-03-02T10:58:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:03 smithi136 ceph-mon[125702]: pgmap v34: 97 pgs: 97 active+clean; 4.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 212 MiB/s wr, 304 op/s 2023-03-02T10:58:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:03 smithi136 ceph-mon[125702]: mgrmap e24: x(active, since 62s), standbys: y, z 2023-03-02T10:58:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:30100000 of 50000000 tuples (60%) done (elapsed 50.72 s, remaining 33.53 s) 2023-03-02T10:58:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:05 smithi057 ceph-mon[92072]: pgmap v35: 97 pgs: 97 active+clean; 4.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 140 MiB/s wr, 268 op/s 2023-03-02T10:58:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:05 smithi122 ceph-mon[125440]: pgmap v35: 97 pgs: 97 active+clean; 4.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 140 MiB/s wr, 268 op/s 2023-03-02T10:58:06.017 INFO:teuthology.orchestra.run.smithi057.stderr:30200000 of 50000000 tuples (60%) done (elapsed 50.82 s, remaining 33.32 s) 2023-03-02T10:58:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:05 smithi136 ceph-mon[125702]: pgmap v35: 97 pgs: 97 active+clean; 4.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 140 MiB/s wr, 268 op/s 2023-03-02T10:58:06.153 INFO:teuthology.orchestra.run.smithi057.stderr:30300000 of 50000000 tuples (60%) done (elapsed 50.96 s, remaining 33.13 s) 2023-03-02T10:58:06.276 INFO:teuthology.orchestra.run.smithi057.stderr:30400000 of 50000000 tuples (60%) done (elapsed 51.08 s, remaining 32.93 s) 2023-03-02T10:58:06.372 INFO:teuthology.orchestra.run.smithi057.stderr:30500000 of 50000000 tuples (61%) done (elapsed 51.18 s, remaining 32.72 s) 2023-03-02T10:58:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:30600000 of 50000000 tuples (61%) done (elapsed 51.32 s, remaining 32.54 s) 2023-03-02T10:58:06.660 INFO:teuthology.orchestra.run.smithi057.stderr:30700000 of 50000000 tuples (61%) done (elapsed 51.46 s, remaining 32.35 s) 2023-03-02T10:58:06.780 INFO:teuthology.orchestra.run.smithi057.stderr:30800000 of 50000000 tuples (61%) done (elapsed 51.59 s, remaining 32.16 s) 2023-03-02T10:58:06.919 INFO:teuthology.orchestra.run.smithi057.stderr:30900000 of 50000000 tuples (61%) done (elapsed 51.72 s, remaining 31.97 s) 2023-03-02T10:58:07.020 INFO:teuthology.orchestra.run.smithi057.stderr:31000000 of 50000000 tuples (62%) done (elapsed 51.83 s, remaining 31.76 s) 2023-03-02T10:58:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:31100000 of 50000000 tuples (62%) done (elapsed 51.95 s, remaining 31.57 s) 2023-03-02T10:58:07.272 INFO:teuthology.orchestra.run.smithi057.stderr:31200000 of 50000000 tuples (62%) done (elapsed 52.08 s, remaining 31.38 s) 2023-03-02T10:58:07.393 INFO:teuthology.orchestra.run.smithi057.stderr:31300000 of 50000000 tuples (62%) done (elapsed 52.20 s, remaining 31.19 s) 2023-03-02T10:58:07.546 INFO:teuthology.orchestra.run.smithi057.stderr:31400000 of 50000000 tuples (62%) done (elapsed 52.35 s, remaining 31.01 s) 2023-03-02T10:58:07.670 INFO:teuthology.orchestra.run.smithi057.stderr:31500000 of 50000000 tuples (63%) done (elapsed 52.47 s, remaining 30.82 s) 2023-03-02T10:58:07.775 INFO:teuthology.orchestra.run.smithi057.stderr:31600000 of 50000000 tuples (63%) done (elapsed 52.58 s, remaining 30.62 s) 2023-03-02T10:58:07.907 INFO:teuthology.orchestra.run.smithi057.stderr:31700000 of 50000000 tuples (63%) done (elapsed 52.71 s, remaining 30.43 s) 2023-03-02T10:58:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:07 smithi057 ceph-mon[92072]: pgmap v36: 97 pgs: 97 active+clean; 4.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 140 MiB/s wr, 268 op/s 2023-03-02T10:58:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:58:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:07 smithi122 ceph-mon[125440]: pgmap v36: 97 pgs: 97 active+clean; 4.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 140 MiB/s wr, 268 op/s 2023-03-02T10:58:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:58:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:31800000 of 50000000 tuples (63%) done (elapsed 52.84 s, remaining 30.24 s) 2023-03-02T10:58:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:07 smithi136 ceph-mon[125702]: pgmap v36: 97 pgs: 97 active+clean; 4.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 140 MiB/s wr, 268 op/s 2023-03-02T10:58:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:58:08.133 INFO:teuthology.orchestra.run.smithi057.stderr:31900000 of 50000000 tuples (63%) done (elapsed 52.94 s, remaining 30.04 s) 2023-03-02T10:58:08.249 INFO:teuthology.orchestra.run.smithi057.stderr:32000000 of 50000000 tuples (64%) done (elapsed 53.05 s, remaining 29.84 s) 2023-03-02T10:58:08.392 INFO:teuthology.orchestra.run.smithi057.stderr:32100000 of 50000000 tuples (64%) done (elapsed 53.20 s, remaining 29.66 s) 2023-03-02T10:58:08.535 INFO:teuthology.orchestra.run.smithi057.stderr:32200000 of 50000000 tuples (64%) done (elapsed 53.34 s, remaining 29.49 s) 2023-03-02T10:58:08.662 INFO:teuthology.orchestra.run.smithi057.stderr:32300000 of 50000000 tuples (64%) done (elapsed 53.47 s, remaining 29.30 s) 2023-03-02T10:58:08.770 INFO:teuthology.orchestra.run.smithi057.stderr:32400000 of 50000000 tuples (64%) done (elapsed 53.58 s, remaining 29.10 s) 2023-03-02T10:58:08.890 INFO:teuthology.orchestra.run.smithi057.stderr:32500000 of 50000000 tuples (65%) done (elapsed 53.69 s, remaining 28.91 s) 2023-03-02T10:58:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:58:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:58:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:58:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:58:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:58:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:58:09.014 INFO:teuthology.orchestra.run.smithi057.stderr:32600000 of 50000000 tuples (65%) done (elapsed 53.82 s, remaining 28.73 s) 2023-03-02T10:58:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:58:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:58:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:58:09.122 INFO:teuthology.orchestra.run.smithi057.stderr:32700000 of 50000000 tuples (65%) done (elapsed 53.93 s, remaining 28.53 s) 2023-03-02T10:58:09.276 INFO:teuthology.orchestra.run.smithi057.stderr:32800000 of 50000000 tuples (65%) done (elapsed 54.08 s, remaining 28.36 s) 2023-03-02T10:58:09.406 INFO:teuthology.orchestra.run.smithi057.stderr:32900000 of 50000000 tuples (65%) done (elapsed 54.21 s, remaining 28.18 s) 2023-03-02T10:58:09.504 INFO:teuthology.orchestra.run.smithi057.stderr:33000000 of 50000000 tuples (66%) done (elapsed 54.31 s, remaining 27.98 s) 2023-03-02T10:58:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.546+0000 7ff41f5ff700 1 -- 172.21.15.57:0/186678896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4180728b0 msgr2=0x7ff418072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.546+0000 7ff41f5ff700 1 --2- 172.21.15.57:0/186678896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4180728b0 0x7ff418072c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff414009990 tx=0x7ff414009ca0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.546+0000 7ff41f5ff700 1 -- 172.21.15.57:0/186678896 shutdown_connections 2023-03-02T10:58:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.546+0000 7ff41f5ff700 1 --2- 172.21.15.57:0/186678896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff41810c3b0 0x7ff41810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.546+0000 7ff41f5ff700 1 --2- 172.21.15.57:0/186678896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4180728b0 0x7ff418072c80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.546+0000 7ff41f5ff700 1 --2- 172.21.15.57:0/186678896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4180731c0 0x7ff41810be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.546+0000 7ff41f5ff700 1 -- 172.21.15.57:0/186678896 >> 172.21.15.57:0/186678896 conn(0x7ff4180fb610 msgr2=0x7ff4180fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.546+0000 7ff41f5ff700 1 -- 172.21.15.57:0/186678896 shutdown_connections 2023-03-02T10:58:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.546+0000 7ff41f5ff700 1 -- 172.21.15.57:0/186678896 wait complete. 2023-03-02T10:58:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41f5ff700 1 Processor -- start 2023-03-02T10:58:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41f5ff700 1 -- start start 2023-03-02T10:58:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41f5ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4180728b0 0x7ff418197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41f5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4180731c0 0x7ff418198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41f5ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff41810c3b0 0x7ff41819c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41f5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41819cdb0 con 0x7ff4180731c0 2023-03-02T10:58:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41f5ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41819cf20 con 0x7ff41810c3b0 2023-03-02T10:58:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41f5ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41819d0e0 con 0x7ff4180728b0 2023-03-02T10:58:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41d39b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4180728b0 0x7ff418197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41cb9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4180731c0 0x7ff418198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41d39b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4180728b0 0x7ff418197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:55342/0 (socket says 172.21.15.57:55342) 2023-03-02T10:58:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41d39b700 1 -- 172.21.15.57:0/2236040420 learned_addr learned my addr 172.21.15.57:0/2236040420 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41db9c700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff41810c3b0 0x7ff41819c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41cb9a700 1 -- 172.21.15.57:0/2236040420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4180728b0 msgr2=0x7ff418197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41cb9a700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4180728b0 0x7ff418197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41cb9a700 1 -- 172.21.15.57:0/2236040420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff41810c3b0 msgr2=0x7ff41819c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.547+0000 7ff41cb9a700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff41810c3b0 0x7ff41819c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.548+0000 7ff41cb9a700 1 -- 172.21.15.57:0/2236040420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff408009520 con 0x7ff4180731c0 2023-03-02T10:58:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.548+0000 7ff41cb9a700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4180731c0 0x7ff418198310 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff40800e9f0 tx=0x7ff40800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.548+0000 7ff40e7fc700 1 -- 172.21.15.57:0/2236040420 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40800cb70 con 0x7ff4180731c0 2023-03-02T10:58:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.548+0000 7ff40e7fc700 1 -- 172.21.15.57:0/2236040420 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4080044e0 con 0x7ff4180731c0 2023-03-02T10:58:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.548+0000 7ff41f5ff700 1 -- 172.21.15.57:0/2236040420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4140095f0 con 0x7ff4180731c0 2023-03-02T10:58:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.548+0000 7ff40e7fc700 1 -- 172.21.15.57:0/2236040420 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408003d50 con 0x7ff4180731c0 2023-03-02T10:58:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.548+0000 7ff41f5ff700 1 -- 172.21.15.57:0/2236040420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff418111d10 con 0x7ff4180731c0 2023-03-02T10:58:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.551+0000 7ff40e7fc700 1 -- 172.21.15.57:0/2236040420 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 24) v1 ==== 130034+0+0 (secure 0 0 0) 0x7ff40800c040 con 0x7ff4180731c0 2023-03-02T10:58:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.552+0000 7ff40e7fc700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff40409b510 0x7ff40409d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.552+0000 7ff40e7fc700 1 -- 172.21.15.57:0/2236040420 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff408014070 con 0x7ff4180731c0 2023-03-02T10:58:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.552+0000 7ff41d39b700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff40409b510 0x7ff40409d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.553+0000 7ff41d39b700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff40409b510 0x7ff40409d9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff414006010 tx=0x7ff414005960 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.555+0000 7ff432e40b80 1 Processor -- start 2023-03-02T10:58:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.555+0000 7ff432e40b80 1 -- start start 2023-03-02T10:58:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.555+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3e9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.555+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.555+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 0x55d5af3e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.555+0000 7ff432e40b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af34ba00 con 0x55d5af3e9fd0 2023-03-02T10:58:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.555+0000 7ff432e40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af2fdf20 con 0x55d5af2416b0 2023-03-02T10:58:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.555+0000 7ff432e40b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af2ce100 con 0x55d5af3ea440 2023-03-02T10:58:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.555+0000 7ff41cb9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.555+0000 7ff41cb9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3e3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44762/0 (socket says 172.21.15.57:44762) 2023-03-02T10:58:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff41cb9a700 1 -- 172.21.15.57:0/2523651309 learned_addr learned my addr 172.21.15.57:0/2523651309 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff41d39b700 1 --2- 172.21.15.57:0/2523651309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3e9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff41db9c700 1 --2- 172.21.15.57:0/2523651309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 0x55d5af3e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff41cb9a700 1 -- 172.21.15.57:0/2523651309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 msgr2=0x55d5af3e44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff41cb9a700 1 --2- 172.21.15.57:0/2523651309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 0x55d5af3e44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff41cb9a700 1 -- 172.21.15.57:0/2523651309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 msgr2=0x55d5af3e9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff41cb9a700 1 --2- 172.21.15.57:0/2523651309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3e9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff41cb9a700 1 -- 172.21.15.57:0/2523651309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5af1b85d0 con 0x55d5af3e9fd0 2023-03-02T10:58:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff41cb9a700 1 --2- 172.21.15.57:0/2523651309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3e3f20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff408094580 tx=0x7ff4080945b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8123c2cda107c7e9 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff4037fe700 1 -- 172.21.15.57:0/2523651309 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4080ac260 con 0x55d5af3e9fd0 2023-03-02T10:58:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff4037fe700 1 -- 172.21.15.57:0/2523651309 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4080949c0 con 0x55d5af3e9fd0 2023-03-02T10:58:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.556+0000 7ff4037fe700 1 -- 172.21.15.57:0/2523651309 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408093eb0 con 0x55d5af3e9fd0 2023-03-02T10:58:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.557+0000 7ff432e40b80 1 -- 172.21.15.57:0/2523651309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 msgr2=0x55d5af3e3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.557+0000 7ff432e40b80 1 --2- 172.21.15.57:0/2523651309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3e3f20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff408094580 tx=0x7ff4080945b0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.557+0000 7ff432e40b80 1 -- 172.21.15.57:0/2523651309 shutdown_connections 2023-03-02T10:58:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.557+0000 7ff432e40b80 1 --2- 172.21.15.57:0/2523651309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 0x55d5af3e44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.557+0000 7ff432e40b80 1 --2- 172.21.15.57:0/2523651309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3e9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.557+0000 7ff432e40b80 1 --2- 172.21.15.57:0/2523651309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3e3f20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.557+0000 7ff432e40b80 1 -- 172.21.15.57:0/2523651309 >> 172.21.15.57:0/2523651309 conn(0x55d5af3d99a0 msgr2=0x55d5af3dea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.557+0000 7ff432e40b80 1 -- 172.21.15.57:0/2523651309 shutdown_connections 2023-03-02T10:58:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.557+0000 7ff432e40b80 1 -- 172.21.15.57:0/2523651309 wait complete. 2023-03-02T10:58:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.558+0000 7ff432e40b80 1 -- start start 2023-03-02T10:58:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.558+0000 7ff432e40b80 1 Processor -- start 2023-03-02T10:58:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.558+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3f0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.558+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3e9fd0 0x55d5af3ed510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.558+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3ea440 0x55d5af3edb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.558+0000 7ff432e40b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af33cb60 con 0x55d5af3ea440 2023-03-02T10:58:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.558+0000 7ff432e40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af336090 con 0x55d5af2416b0 2023-03-02T10:58:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.558+0000 7ff432e40b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af1ba8c0 con 0x55d5af3e9fd0 2023-03-02T10:58:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff432e40b80 10 client.0 _ll_register_callbacks cb 0x55d5af2dc4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41d39b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41db9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3ea440 0x55d5af3edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41cb9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3e9fd0 0x55d5af3ed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41db9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3ea440 0x55d5af3edb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44772/0 (socket says 172.21.15.57:44772) 2023-03-02T10:58:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41cb9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3e9fd0 0x55d5af3ed510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:55358/0 (socket says 172.21.15.57:55358) 2023-03-02T10:58:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41db9c700 1 -- 172.21.15.57:0/2433536663 learned_addr learned my addr 172.21.15.57:0/2433536663 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41db9c700 1 -- 172.21.15.57:0/2433536663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3e9fd0 msgr2=0x55d5af3ed510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41db9c700 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3e9fd0 0x55d5af3ed510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41db9c700 1 -- 172.21.15.57:0/2433536663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 msgr2=0x55d5af3f0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41db9c700 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3f0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41db9c700 1 -- 172.21.15.57:0/2433536663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff418111d10 con 0x55d5af3ea440 2023-03-02T10:58:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.559+0000 7ff41d39b700 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.560+0000 7ff41db9c700 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3ea440 0x55d5af3edb00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff410007a80 tx=0x7ff410007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c01b1d2d68fa80 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.560+0000 7ff400ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:58:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.560+0000 7ff400ff9700 1 -- 172.21.15.57:0/2433536663 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000e070 con 0x55d5af3ea440 2023-03-02T10:58:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.560+0000 7ff432e40b80 1 -- 172.21.15.57:0/2433536663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5af307750 con 0x55d5af3ea440 2023-03-02T10:58:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.561+0000 7ff400ff9700 1 -- 172.21.15.57:0/2433536663 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff410003c00 con 0x55d5af3ea440 2023-03-02T10:58:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.561+0000 7ff400ff9700 1 -- 172.21.15.57:0/2433536663 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff410003e00 con 0x55d5af3ea440 2023-03-02T10:58:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.561+0000 7ff432e40b80 10 client.15918 fetch_fsmap learned FSMap version 29 2023-03-02T10:58:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.561+0000 7ff432e40b80 1 -- 172.21.15.57:0/2433536663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d5af164d80 con 0x55d5af3ea440 2023-03-02T10:58:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.562+0000 7ff400ff9700 1 -- 172.21.15.57:0/2433536663 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d5af307750 con 0x55d5af3ea440 2023-03-02T10:58:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.562+0000 7ff400ff9700 1 -- 172.21.15.57:0/2433536663 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7ff41001c020 con 0x55d5af3ea440 2023-03-02T10:58:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.562+0000 7ff432e40b80 10 client.15918 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:58:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.562+0000 7ff432e40b80 10 client.15918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.562+0000 7ff432e40b80 20 client.15918 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.562+0000 7ff432e40b80 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d5af3fda30 0x55d5af3ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.562+0000 7ff432e40b80 4 client.15918 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:58:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.562+0000 7ff432e40b80 1 -- 172.21.15.57:0/2433536663 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d5af32f110 con 0x55d5af3fda30 2023-03-02T10:58:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.563+0000 7ff41d39b700 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d5af3fda30 0x55d5af3ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.563+0000 7ff41d39b700 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d5af3fda30 0x55d5af3ffe40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=137fd5560d1f0283 server_cookie=6b2b351596a90ee3 in_seq=0 out_seq=0 2023-03-02T10:58:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.564+0000 7ff400ff9700 10 client.15918 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.564+0000 7ff400ff9700 1 -- 172.21.15.57:0/2433536663 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55d5af32f110 con 0x55d5af3fda30 2023-03-02T10:58:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.564+0000 7ff400ff9700 10 client.15918 handle_command_reply: tid=0 2023-03-02T10:58:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.564+0000 7ff432e40b80 1 client.15918 shutdown 2023-03-02T10:58:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.564+0000 7ff432e40b80 1 -- 172.21.15.57:0/2433536663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3ea440 msgr2=0x55d5af3edb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.564+0000 7ff432e40b80 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3ea440 0x55d5af3edb00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff410007a80 tx=0x7ff410007d90 comp rx=0 tx=0).stop 2023-03-02T10:58:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.565+0000 7ff432e40b80 1 -- 172.21.15.57:0/2433536663 shutdown_connections 2023-03-02T10:58:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.565+0000 7ff432e40b80 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d5af3fda30 0x55d5af3ffe40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.565+0000 7ff432e40b80 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3ea440 0x55d5af3edb00 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.565+0000 7ff432e40b80 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.565+0000 7ff400ff9700 0 client.15918 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.565+0000 7ff432e40b80 1 --2- 172.21.15.57:0/2433536663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3e9fd0 0x55d5af3ed510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.565+0000 7ff432e40b80 1 -- 172.21.15.57:0/2433536663 >> 172.21.15.57:0/2433536663 conn(0x55d5af3d99a0 msgr2=0x55d5af3de1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.565+0000 7ff432e40b80 1 -- 172.21.15.57:0/2433536663 shutdown_connections 2023-03-02T10:58:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.565+0000 7ff432e40b80 1 -- 172.21.15.57:0/2433536663 wait complete. 2023-03-02T10:58:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.565+0000 7ff432e40b80 20 client.15918 trim_cache size 0 max 16384 2023-03-02T10:58:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.580+0000 7ff432e40b80 1 Processor -- start 2023-03-02T10:58:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.580+0000 7ff432e40b80 1 -- start start 2023-03-02T10:58:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.580+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af2416b0 0x55d5af3eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.580+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3de980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.580+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af3ea440 0x55d5af3efe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.580+0000 7ff432e40b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af3e3f20 con 0x55d5af3e9fd0 2023-03-02T10:58:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.580+0000 7ff432e40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af3dfb90 con 0x55d5af3ea440 2023-03-02T10:58:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.580+0000 7ff432e40b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af3eba90 con 0x55d5af2416b0 2023-03-02T10:58:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41d39b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af2416b0 0x55d5af3eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41cb9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3de980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41d39b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af2416b0 0x55d5af3eaf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:55362/0 (socket says 172.21.15.57:55362) 2023-03-02T10:58:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41d39b700 1 -- 172.21.15.57:0/3835210516 learned_addr learned my addr 172.21.15.57:0/3835210516 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41cb9a700 1 --2- 172.21.15.57:0/3835210516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3de980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44782/0 (socket says 172.21.15.57:44782) 2023-03-02T10:58:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41db9c700 1 --2- 172.21.15.57:0/3835210516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af3ea440 0x55d5af3efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41db9c700 1 -- 172.21.15.57:0/3835210516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af2416b0 msgr2=0x55d5af3eaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41db9c700 1 --2- 172.21.15.57:0/3835210516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af2416b0 0x55d5af3eaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41db9c700 1 -- 172.21.15.57:0/3835210516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 msgr2=0x55d5af3de980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41db9c700 1 --2- 172.21.15.57:0/3835210516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3de980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41db9c700 1 -- 172.21.15.57:0/3835210516 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5af3e4430 con 0x55d5af3ea440 2023-03-02T10:58:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41d39b700 1 --2- 172.21.15.57:0/3835210516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af2416b0 0x55d5af3eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff41db9c700 1 --2- 172.21.15.57:0/3835210516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af3ea440 0x55d5af3efe30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff410000f80 tx=0x7ff410004890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62f54aa7a01cf8ab server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.581+0000 7ff403fff700 1 -- 172.21.15.57:0/3835210516 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000e040 con 0x55d5af3ea440 2023-03-02T10:58:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.582+0000 7ff403fff700 1 -- 172.21.15.57:0/3835210516 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff41000f040 con 0x55d5af3ea440 2023-03-02T10:58:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.582+0000 7ff403fff700 1 -- 172.21.15.57:0/3835210516 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41001f7f0 con 0x55d5af3ea440 2023-03-02T10:58:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.582+0000 7ff432e40b80 1 -- 172.21.15.57:0/3835210516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af3ea440 msgr2=0x55d5af3efe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.582+0000 7ff432e40b80 1 --2- 172.21.15.57:0/3835210516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af3ea440 0x55d5af3efe30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff410000f80 tx=0x7ff410004890 comp rx=0 tx=0).stop 2023-03-02T10:58:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.582+0000 7ff432e40b80 1 -- 172.21.15.57:0/3835210516 shutdown_connections 2023-03-02T10:58:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.582+0000 7ff432e40b80 1 --2- 172.21.15.57:0/3835210516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af3ea440 0x55d5af3efe30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.582+0000 7ff432e40b80 1 --2- 172.21.15.57:0/3835210516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af2416b0 0x55d5af3eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.582+0000 7ff432e40b80 1 --2- 172.21.15.57:0/3835210516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3de980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.582+0000 7ff432e40b80 1 -- 172.21.15.57:0/3835210516 >> 172.21.15.57:0/3835210516 conn(0x55d5af3d99a0 msgr2=0x55d5af3ea810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.582+0000 7ff432e40b80 1 -- 172.21.15.57:0/3835210516 shutdown_connections 2023-03-02T10:58:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.582+0000 7ff432e40b80 1 -- 172.21.15.57:0/3835210516 wait complete. 2023-03-02T10:58:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.583+0000 7ff432e40b80 1 -- start start 2023-03-02T10:58:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.583+0000 7ff432e40b80 1 Processor -- start 2023-03-02T10:58:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.583+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3f4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.583+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.583+0000 7ff432e40b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 0x55d5af3f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.583+0000 7ff432e40b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af3f3a00 con 0x55d5af3e9fd0 2023-03-02T10:58:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.583+0000 7ff432e40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af3f3b70 con 0x55d5af2416b0 2023-03-02T10:58:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.583+0000 7ff432e40b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5af44f330 con 0x55d5af3ea440 2023-03-02T10:58:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.583+0000 7ff432e40b80 10 client.0 _ll_register_callbacks cb 0x55d5af2dc4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.583+0000 7ff41db9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 0x55d5af3f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.583+0000 7ff41db9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 0x55d5af3f32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:55374/0 (socket says 172.21.15.57:55374) 2023-03-02T10:58:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff41db9c700 1 -- 172.21.15.57:0/1380789917 learned_addr learned my addr 172.21.15.57:0/1380789917 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff41cb9a700 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff41d39b700 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff41db9c700 1 -- 172.21.15.57:0/1380789917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 msgr2=0x55d5af3f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff41db9c700 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff41db9c700 1 -- 172.21.15.57:0/1380789917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 msgr2=0x55d5af3f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff41db9c700 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff41db9c700 1 -- 172.21.15.57:0/1380789917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41810f390 con 0x55d5af3ea440 2023-03-02T10:58:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff41cb9a700 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff41db9c700 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 0x55d5af3f32f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff410008fe0 tx=0x7ff410012590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ede0dc80d3df6c6 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff400ff9700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:58:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff400ff9700 1 -- 172.21.15.57:0/1380789917 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000e040 con 0x55d5af3ea440 2023-03-02T10:58:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff432e40b80 1 -- 172.21.15.57:0/1380789917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff4080949c0 con 0x55d5af3ea440 2023-03-02T10:58:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.584+0000 7ff400ff9700 1 -- 172.21.15.57:0/1380789917 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff4100128c0 con 0x55d5af3ea440 2023-03-02T10:58:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff400ff9700 1 -- 172.21.15.57:0/1380789917 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff410012ac0 con 0x55d5af3ea440 2023-03-02T10:58:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff432e40b80 10 client.25726 fetch_fsmap learned FSMap version 29 2023-03-02T10:58:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff432e40b80 1 -- 172.21.15.57:0/1380789917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d5af164d80 con 0x55d5af3ea440 2023-03-02T10:58:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff400ff9700 1 -- 172.21.15.57:0/1380789917 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4080949c0 con 0x55d5af3ea440 2023-03-02T10:58:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff400ff9700 1 -- 172.21.15.57:0/1380789917 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7ff41001c070 con 0x55d5af3ea440 2023-03-02T10:58:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff432e40b80 10 client.25726 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:58:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff432e40b80 10 client.25726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff432e40b80 20 client.25726 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff432e40b80 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d5af450690 0x55d5af452aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff432e40b80 4 client.25726 mds_command: new command op to 24560 tid=0[{"prefix": "flush journal"}] 2023-03-02T10:58:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff432e40b80 1 -- 172.21.15.57:0/1380789917 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d5af32ee30 con 0x55d5af450690 2023-03-02T10:58:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.585+0000 7ff41d39b700 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d5af450690 0x55d5af452aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.586+0000 7ff41d39b700 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d5af450690 0x55d5af452aa0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ffa265a5ff01a2c server_cookie=a46e51a2fbacb7f9 in_seq=0 out_seq=0 2023-03-02T10:58:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.586+0000 7ff400ff9700 10 client.25726 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff400ff9700 1 -- 172.21.15.57:0/1380789917 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d5af32ee30 con 0x55d5af450690 2023-03-02T10:58:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff400ff9700 10 client.25726 handle_command_reply: tid=0 2023-03-02T10:58:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 1 client.25726 shutdown 2023-03-02T10:58:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 1 -- 172.21.15.57:0/1380789917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 msgr2=0x55d5af3f32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 0x55d5af3f32f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff410008fe0 tx=0x7ff410012590 comp rx=0 tx=0).stop 2023-03-02T10:58:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 1 -- 172.21.15.57:0/1380789917 shutdown_connections 2023-03-02T10:58:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55d5af450690 0x55d5af452aa0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d5af3ea440 0x55d5af3f32f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5af2416b0 0x55d5af3f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 1 --2- 172.21.15.57:0/1380789917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d5af3e9fd0 0x55d5af3f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff400ff9700 0 client.25726 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 1 -- 172.21.15.57:0/1380789917 >> 172.21.15.57:0/1380789917 conn(0x55d5af3d99a0 msgr2=0x55d5af3eb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 1 -- 172.21.15.57:0/1380789917 shutdown_connections 2023-03-02T10:58:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 1 -- 172.21.15.57:0/1380789917 wait complete. 2023-03-02T10:58:09.608 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.605+0000 7ff432e40b80 20 client.25726 trim_cache size 0 max 16384 2023-03-02T10:58:09.608 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:{ 2023-03-02T10:58:09.608 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "message": "", 2023-03-02T10:58:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "return_code": 0 2023-03-02T10:58:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:} 2023-03-02T10:58:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 -- 172.21.15.57:0/2236040420 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff40409b510 msgr2=0x7ff40409d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff40409b510 0x7ff40409d9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff414006010 tx=0x7ff414005960 comp rx=0 tx=0).stop 2023-03-02T10:58:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 -- 172.21.15.57:0/2236040420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4180731c0 msgr2=0x7ff418198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4180731c0 0x7ff418198310 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff40800e9f0 tx=0x7ff40800ed00 comp rx=0 tx=0).stop 2023-03-02T10:58:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 -- 172.21.15.57:0/2236040420 shutdown_connections 2023-03-02T10:58:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff40409b510 0x7ff40409d9c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff41810c3b0 0x7ff41819c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4180728b0 0x7ff418197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 --2- 172.21.15.57:0/2236040420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4180731c0 0x7ff418198310 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 -- 172.21.15.57:0/2236040420 >> 172.21.15.57:0/2236040420 conn(0x7ff4180fb610 msgr2=0x7ff41810e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 -- 172.21.15.57:0/2236040420 shutdown_connections 2023-03-02T10:58:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:09.606+0000 7ff41f5ff700 1 -- 172.21.15.57:0/2236040420 wait complete. 2023-03-02T10:58:09.657 INFO:teuthology.orchestra.run.smithi057.stderr:33100000 of 50000000 tuples (66%) done (elapsed 54.46 s, remaining 27.81 s) 2023-03-02T10:58:09.835 INFO:teuthology.orchestra.run.smithi057.stderr:33200000 of 50000000 tuples (66%) done (elapsed 54.64 s, remaining 27.65 s) 2023-03-02T10:58:09.941 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:09 smithi057 ceph-mon[92072]: pgmap v37: 97 pgs: 97 active+clean; 4.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 145 MiB/s wr, 529 op/s 2023-03-02T10:58:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:09 smithi122 ceph-mon[125440]: pgmap v37: 97 pgs: 97 active+clean; 4.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 145 MiB/s wr, 529 op/s 2023-03-02T10:58:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:09 smithi136 ceph-mon[125702]: pgmap v37: 97 pgs: 97 active+clean; 4.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 145 MiB/s wr, 529 op/s 2023-03-02T10:58:10.399 INFO:teuthology.orchestra.run.smithi057.stderr:33300000 of 50000000 tuples (66%) done (elapsed 55.20 s, remaining 27.68 s) 2023-03-02T10:58:10.602 INFO:teuthology.orchestra.run.smithi057.stderr:33400000 of 50000000 tuples (66%) done (elapsed 55.41 s, remaining 27.54 s) 2023-03-02T10:58:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:33500000 of 50000000 tuples (67%) done (elapsed 55.53 s, remaining 27.35 s) 2023-03-02T10:58:10.864 INFO:teuthology.orchestra.run.smithi057.stderr:33600000 of 50000000 tuples (67%) done (elapsed 55.67 s, remaining 27.17 s) 2023-03-02T10:58:10.995 INFO:teuthology.orchestra.run.smithi057.stderr:33700000 of 50000000 tuples (67%) done (elapsed 55.80 s, remaining 26.99 s) 2023-03-02T10:58:11.103 INFO:teuthology.orchestra.run.smithi057.stderr:33800000 of 50000000 tuples (67%) done (elapsed 55.91 s, remaining 26.80 s) 2023-03-02T10:58:11.244 INFO:teuthology.orchestra.run.smithi057.stderr:33900000 of 50000000 tuples (67%) done (elapsed 56.05 s, remaining 26.62 s) 2023-03-02T10:58:11.364 INFO:teuthology.orchestra.run.smithi057.stderr:34000000 of 50000000 tuples (68%) done (elapsed 56.17 s, remaining 26.43 s) 2023-03-02T10:58:11.464 INFO:teuthology.orchestra.run.smithi057.stderr:34100000 of 50000000 tuples (68%) done (elapsed 56.27 s, remaining 26.24 s) 2023-03-02T10:58:11.621 INFO:teuthology.orchestra.run.smithi057.stderr:34200000 of 50000000 tuples (68%) done (elapsed 56.43 s, remaining 26.07 s) 2023-03-02T10:58:11.712 INFO:teuthology.orchestra.run.smithi057.stderr:34300000 of 50000000 tuples (68%) done (elapsed 56.52 s, remaining 25.87 s) 2023-03-02T10:58:11.861 INFO:teuthology.orchestra.run.smithi057.stderr:34400000 of 50000000 tuples (68%) done (elapsed 56.67 s, remaining 25.70 s) 2023-03-02T10:58:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:11 smithi057 ceph-mon[92072]: pgmap v38: 97 pgs: 97 active+clean; 4.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 69 MiB/s wr, 477 op/s 2023-03-02T10:58:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:11 smithi122 ceph-mon[125440]: pgmap v38: 97 pgs: 97 active+clean; 4.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 69 MiB/s wr, 477 op/s 2023-03-02T10:58:11.989 INFO:teuthology.orchestra.run.smithi057.stderr:34500000 of 50000000 tuples (69%) done (elapsed 56.79 s, remaining 25.52 s) 2023-03-02T10:58:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:11 smithi136 ceph-mon[125702]: pgmap v38: 97 pgs: 97 active+clean; 4.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 69 MiB/s wr, 477 op/s 2023-03-02T10:58:12.103 INFO:teuthology.orchestra.run.smithi057.stderr:34600000 of 50000000 tuples (69%) done (elapsed 56.91 s, remaining 25.33 s) 2023-03-02T10:58:12.217 INFO:teuthology.orchestra.run.smithi057.stderr:34700000 of 50000000 tuples (69%) done (elapsed 57.02 s, remaining 25.14 s) 2023-03-02T10:58:12.338 INFO:teuthology.orchestra.run.smithi057.stderr:34800000 of 50000000 tuples (69%) done (elapsed 57.14 s, remaining 24.96 s) 2023-03-02T10:58:12.445 INFO:teuthology.orchestra.run.smithi057.stderr:34900000 of 50000000 tuples (69%) done (elapsed 57.25 s, remaining 24.77 s) 2023-03-02T10:58:12.575 INFO:teuthology.orchestra.run.smithi057.stderr:35000000 of 50000000 tuples (70%) done (elapsed 57.38 s, remaining 24.59 s) 2023-03-02T10:58:12.696 INFO:teuthology.orchestra.run.smithi057.stderr:35100000 of 50000000 tuples (70%) done (elapsed 57.50 s, remaining 24.41 s) 2023-03-02T10:58:12.795 INFO:teuthology.orchestra.run.smithi057.stderr:35200000 of 50000000 tuples (70%) done (elapsed 57.60 s, remaining 24.22 s) 2023-03-02T10:58:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:35300000 of 50000000 tuples (70%) done (elapsed 57.77 s, remaining 24.06 s) 2023-03-02T10:58:13.046 INFO:teuthology.orchestra.run.smithi057.stderr:35400000 of 50000000 tuples (70%) done (elapsed 57.85 s, remaining 23.86 s) 2023-03-02T10:58:13.185 INFO:teuthology.orchestra.run.smithi057.stderr:35500000 of 50000000 tuples (71%) done (elapsed 57.99 s, remaining 23.69 s) 2023-03-02T10:58:13.314 INFO:teuthology.orchestra.run.smithi057.stderr:35600000 of 50000000 tuples (71%) done (elapsed 58.12 s, remaining 23.51 s) 2023-03-02T10:58:13.429 INFO:teuthology.orchestra.run.smithi057.stderr:35700000 of 50000000 tuples (71%) done (elapsed 58.23 s, remaining 23.33 s) 2023-03-02T10:58:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:35800000 of 50000000 tuples (71%) done (elapsed 58.34 s, remaining 23.14 s) 2023-03-02T10:58:13.674 INFO:teuthology.orchestra.run.smithi057.stderr:35900000 of 50000000 tuples (71%) done (elapsed 58.48 s, remaining 22.97 s) 2023-03-02T10:58:13.785 INFO:teuthology.orchestra.run.smithi057.stderr:36000000 of 50000000 tuples (72%) done (elapsed 58.59 s, remaining 22.79 s) 2023-03-02T10:58:13.913 INFO:teuthology.orchestra.run.smithi057.stderr:36100000 of 50000000 tuples (72%) done (elapsed 58.72 s, remaining 22.61 s) 2023-03-02T10:58:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:13 smithi057 ceph-mon[92072]: pgmap v39: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 143 MiB/s wr, 521 op/s 2023-03-02T10:58:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:13 smithi122 ceph-mon[125440]: pgmap v39: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 143 MiB/s wr, 521 op/s 2023-03-02T10:58:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:36200000 of 50000000 tuples (72%) done (elapsed 58.84 s, remaining 22.43 s) 2023-03-02T10:58:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:13 smithi136 ceph-mon[125702]: pgmap v39: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 143 MiB/s wr, 521 op/s 2023-03-02T10:58:14.135 INFO:teuthology.orchestra.run.smithi057.stderr:36300000 of 50000000 tuples (72%) done (elapsed 58.94 s, remaining 22.24 s) 2023-03-02T10:58:14.273 INFO:teuthology.orchestra.run.smithi057.stderr:36400000 of 50000000 tuples (72%) done (elapsed 59.08 s, remaining 22.07 s) 2023-03-02T10:58:14.397 INFO:teuthology.orchestra.run.smithi057.stderr:36500000 of 50000000 tuples (73%) done (elapsed 59.20 s, remaining 21.90 s) 2023-03-02T10:58:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:36600000 of 50000000 tuples (73%) done (elapsed 59.32 s, remaining 21.72 s) 2023-03-02T10:58:14.644 INFO:teuthology.orchestra.run.smithi057.stderr:36700000 of 50000000 tuples (73%) done (elapsed 59.45 s, remaining 21.54 s) 2023-03-02T10:58:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:36800000 of 50000000 tuples (73%) done (elapsed 59.57 s, remaining 21.37 s) 2023-03-02T10:58:14.925 INFO:teuthology.orchestra.run.smithi057.stderr:36900000 of 50000000 tuples (73%) done (elapsed 59.73 s, remaining 21.20 s) 2023-03-02T10:58:15.027 INFO:teuthology.orchestra.run.smithi057.stderr:37000000 of 50000000 tuples (74%) done (elapsed 59.83 s, remaining 21.02 s) 2023-03-02T10:58:15.334 INFO:teuthology.orchestra.run.smithi057.stderr:37100000 of 50000000 tuples (74%) done (elapsed 60.14 s, remaining 20.91 s) 2023-03-02T10:58:15.801 INFO:teuthology.orchestra.run.smithi057.stderr:37200000 of 50000000 tuples (74%) done (elapsed 60.61 s, remaining 20.85 s) 2023-03-02T10:58:15.912 INFO:teuthology.orchestra.run.smithi057.stderr:37300000 of 50000000 tuples (74%) done (elapsed 60.72 s, remaining 20.67 s) 2023-03-02T10:58:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:15 smithi122 ceph-mon[125440]: pgmap v40: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 79 MiB/s wr, 304 op/s 2023-03-02T10:58:16.029 INFO:teuthology.orchestra.run.smithi057.stderr:37400000 of 50000000 tuples (74%) done (elapsed 60.83 s, remaining 20.49 s) 2023-03-02T10:58:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:15 smithi136 ceph-mon[125702]: pgmap v40: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 79 MiB/s wr, 304 op/s 2023-03-02T10:58:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:15 smithi057 ceph-mon[92072]: pgmap v40: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 79 MiB/s wr, 304 op/s 2023-03-02T10:58:16.187 INFO:teuthology.orchestra.run.smithi057.stderr:37500000 of 50000000 tuples (75%) done (elapsed 60.99 s, remaining 20.33 s) 2023-03-02T10:58:16.317 INFO:teuthology.orchestra.run.smithi057.stderr:37600000 of 50000000 tuples (75%) done (elapsed 61.12 s, remaining 20.16 s) 2023-03-02T10:58:16.430 INFO:teuthology.orchestra.run.smithi057.stderr:37700000 of 50000000 tuples (75%) done (elapsed 61.24 s, remaining 19.98 s) 2023-03-02T10:58:16.541 INFO:teuthology.orchestra.run.smithi057.stderr:37800000 of 50000000 tuples (75%) done (elapsed 61.35 s, remaining 19.80 s) 2023-03-02T10:58:16.662 INFO:teuthology.orchestra.run.smithi057.stderr:37900000 of 50000000 tuples (75%) done (elapsed 61.47 s, remaining 19.62 s) 2023-03-02T10:58:16.771 INFO:teuthology.orchestra.run.smithi057.stderr:38000000 of 50000000 tuples (76%) done (elapsed 61.58 s, remaining 19.44 s) 2023-03-02T10:58:16.885 INFO:teuthology.orchestra.run.smithi057.stderr:38100000 of 50000000 tuples (76%) done (elapsed 61.69 s, remaining 19.27 s) 2023-03-02T10:58:17.021 INFO:teuthology.orchestra.run.smithi057.stderr:38200000 of 50000000 tuples (76%) done (elapsed 61.83 s, remaining 19.10 s) 2023-03-02T10:58:17.109 INFO:teuthology.orchestra.run.smithi057.stderr:38300000 of 50000000 tuples (76%) done (elapsed 61.91 s, remaining 18.91 s) 2023-03-02T10:58:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:38400000 of 50000000 tuples (76%) done (elapsed 62.03 s, remaining 18.74 s) 2023-03-02T10:58:17.345 INFO:teuthology.orchestra.run.smithi057.stderr:38500000 of 50000000 tuples (77%) done (elapsed 62.15 s, remaining 18.56 s) 2023-03-02T10:58:17.487 INFO:teuthology.orchestra.run.smithi057.stderr:38600000 of 50000000 tuples (77%) done (elapsed 62.29 s, remaining 18.40 s) 2023-03-02T10:58:17.609 INFO:teuthology.orchestra.run.smithi057.stderr:38700000 of 50000000 tuples (77%) done (elapsed 62.41 s, remaining 18.22 s) 2023-03-02T10:58:17.714 INFO:teuthology.orchestra.run.smithi057.stderr:38800000 of 50000000 tuples (77%) done (elapsed 62.52 s, remaining 18.05 s) 2023-03-02T10:58:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:38900000 of 50000000 tuples (77%) done (elapsed 62.64 s, remaining 17.87 s) 2023-03-02T10:58:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:17 smithi122 ceph-mon[125440]: pgmap v41: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 79 MiB/s wr, 304 op/s 2023-03-02T10:58:17.960 INFO:teuthology.orchestra.run.smithi057.stderr:39000000 of 50000000 tuples (78%) done (elapsed 62.77 s, remaining 17.70 s) 2023-03-02T10:58:18.081 INFO:teuthology.orchestra.run.smithi057.stderr:39100000 of 50000000 tuples (78%) done (elapsed 62.89 s, remaining 17.53 s) 2023-03-02T10:58:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:17 smithi136 ceph-mon[125702]: pgmap v41: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 79 MiB/s wr, 304 op/s 2023-03-02T10:58:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:17 smithi057 ceph-mon[92072]: pgmap v41: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 79 MiB/s wr, 304 op/s 2023-03-02T10:58:18.218 INFO:teuthology.orchestra.run.smithi057.stderr:39200000 of 50000000 tuples (78%) done (elapsed 63.02 s, remaining 17.36 s) 2023-03-02T10:58:18.338 INFO:teuthology.orchestra.run.smithi057.stderr:39300000 of 50000000 tuples (78%) done (elapsed 63.14 s, remaining 17.19 s) 2023-03-02T10:58:18.429 INFO:teuthology.orchestra.run.smithi057.stderr:39400000 of 50000000 tuples (78%) done (elapsed 63.23 s, remaining 17.01 s) 2023-03-02T10:58:18.546 INFO:teuthology.orchestra.run.smithi057.stderr:39500000 of 50000000 tuples (79%) done (elapsed 63.35 s, remaining 16.84 s) 2023-03-02T10:58:18.670 INFO:teuthology.orchestra.run.smithi057.stderr:39600000 of 50000000 tuples (79%) done (elapsed 63.47 s, remaining 16.67 s) 2023-03-02T10:58:18.807 INFO:teuthology.orchestra.run.smithi057.stderr:39700000 of 50000000 tuples (79%) done (elapsed 63.61 s, remaining 16.50 s) 2023-03-02T10:58:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:39800000 of 50000000 tuples (79%) done (elapsed 63.74 s, remaining 16.33 s) 2023-03-02T10:58:19.043 INFO:teuthology.orchestra.run.smithi057.stderr:39900000 of 50000000 tuples (79%) done (elapsed 63.85 s, remaining 16.16 s) 2023-03-02T10:58:19.156 INFO:teuthology.orchestra.run.smithi057.stderr:40000000 of 50000000 tuples (80%) done (elapsed 63.96 s, remaining 15.99 s) 2023-03-02T10:58:19.294 INFO:teuthology.orchestra.run.smithi057.stderr:40100000 of 50000000 tuples (80%) done (elapsed 64.10 s, remaining 15.82 s) 2023-03-02T10:58:19.396 INFO:teuthology.orchestra.run.smithi057.stderr:40200000 of 50000000 tuples (80%) done (elapsed 64.20 s, remaining 15.65 s) 2023-03-02T10:58:19.525 INFO:teuthology.orchestra.run.smithi057.stderr:40300000 of 50000000 tuples (80%) done (elapsed 64.33 s, remaining 15.48 s) 2023-03-02T10:58:19.667 INFO:teuthology.orchestra.run.smithi057.stderr:40400000 of 50000000 tuples (80%) done (elapsed 64.47 s, remaining 15.32 s) 2023-03-02T10:58:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:40500000 of 50000000 tuples (81%) done (elapsed 64.57 s, remaining 15.15 s) 2023-03-02T10:58:19.890 INFO:teuthology.orchestra.run.smithi057.stderr:40600000 of 50000000 tuples (81%) done (elapsed 64.70 s, remaining 14.98 s) 2023-03-02T10:58:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:19 smithi057 ceph-mon[92072]: pgmap v42: 97 pgs: 97 active+clean; 6.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 152 MiB/s wr, 338 op/s 2023-03-02T10:58:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:19 smithi122 ceph-mon[125440]: pgmap v42: 97 pgs: 97 active+clean; 6.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 152 MiB/s wr, 338 op/s 2023-03-02T10:58:20.022 INFO:teuthology.orchestra.run.smithi057.stderr:40700000 of 50000000 tuples (81%) done (elapsed 64.83 s, remaining 14.81 s) 2023-03-02T10:58:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:19 smithi136 ceph-mon[125702]: pgmap v42: 97 pgs: 97 active+clean; 6.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 152 MiB/s wr, 338 op/s 2023-03-02T10:58:20.170 INFO:teuthology.orchestra.run.smithi057.stderr:40800000 of 50000000 tuples (81%) done (elapsed 64.98 s, remaining 14.65 s) 2023-03-02T10:58:20.303 INFO:teuthology.orchestra.run.smithi057.stderr:40900000 of 50000000 tuples (81%) done (elapsed 65.11 s, remaining 14.49 s) 2023-03-02T10:58:20.415 INFO:teuthology.orchestra.run.smithi057.stderr:41000000 of 50000000 tuples (82%) done (elapsed 65.22 s, remaining 14.32 s) 2023-03-02T10:58:20.852 INFO:teuthology.orchestra.run.smithi057.stderr:41100000 of 50000000 tuples (82%) done (elapsed 65.66 s, remaining 14.22 s) 2023-03-02T10:58:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:21 smithi057 ceph-mon[92072]: pgmap v43: 97 pgs: 97 active+clean; 6.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 146 MiB/s wr, 78 op/s 2023-03-02T10:58:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:21 smithi122 ceph-mon[125440]: pgmap v43: 97 pgs: 97 active+clean; 6.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 146 MiB/s wr, 78 op/s 2023-03-02T10:58:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:21 smithi136 ceph-mon[125702]: pgmap v43: 97 pgs: 97 active+clean; 6.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 146 MiB/s wr, 78 op/s 2023-03-02T10:58:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.749+0000 7f4d457ff700 1 -- 172.21.15.57:0/2716047096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d40100d20 msgr2=0x7f4d401010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.749+0000 7f4d457ff700 1 --2- 172.21.15.57:0/2716047096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d40100d20 0x7f4d401010f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4d300098f0 tx=0x7f4d30009c00 comp rx=0 tx=0).stop 2023-03-02T10:58:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.750+0000 7f4d457ff700 1 -- 172.21.15.57:0/2716047096 shutdown_connections 2023-03-02T10:58:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.750+0000 7f4d457ff700 1 --2- 172.21.15.57:0/2716047096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d4010a0f0 0x7f4d4010c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.750+0000 7f4d457ff700 1 --2- 172.21.15.57:0/2716047096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d40100d20 0x7f4d401010f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.750+0000 7f4d457ff700 1 --2- 172.21.15.57:0/2716047096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d40101630 0x7f4d40109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.750+0000 7f4d457ff700 1 -- 172.21.15.57:0/2716047096 >> 172.21.15.57:0/2716047096 conn(0x7f4d400767e0 msgr2=0x7f4d40076be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.750+0000 7f4d457ff700 1 -- 172.21.15.57:0/2716047096 shutdown_connections 2023-03-02T10:58:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.750+0000 7f4d457ff700 1 -- 172.21.15.57:0/2716047096 wait complete. 2023-03-02T10:58:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.751+0000 7f4d457ff700 1 Processor -- start 2023-03-02T10:58:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.751+0000 7f4d457ff700 1 -- start start 2023-03-02T10:58:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.751+0000 7f4d457ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d40100d20 0x7f4d400fe970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d457ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d40101630 0x7f4d400feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d457ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d4010a0f0 0x7f4d401a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d457ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400ff6e0 con 0x7f4d40101630 2023-03-02T10:58:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d457ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d401a4380 con 0x7f4d40100d20 2023-03-02T10:58:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d457ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d401a44c0 con 0x7f4d4010a0f0 2023-03-02T10:58:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d367fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d40101630 0x7f4d400feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d3effd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d40100d20 0x7f4d400fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d3f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d4010a0f0 0x7f4d401a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d367fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d40101630 0x7f4d400feeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33038/0 (socket says 172.21.15.57:33038) 2023-03-02T10:58:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d367fc700 1 -- 172.21.15.57:0/3251099385 learned_addr learned my addr 172.21.15.57:0/3251099385 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d3f7fe700 1 -- 172.21.15.57:0/3251099385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d40100d20 msgr2=0x7f4d400fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d3f7fe700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d40100d20 0x7f4d400fe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d3f7fe700 1 -- 172.21.15.57:0/3251099385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d40101630 msgr2=0x7f4d400feeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d3f7fe700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d40101630 0x7f4d400feeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d3f7fe700 1 -- 172.21.15.57:0/3251099385 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30009520 con 0x7f4d4010a0f0 2023-03-02T10:58:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d367fc700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d40101630 0x7f4d400feeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d3f7fe700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d4010a0f0 0x7f4d401a3e40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d38007f10 tx=0x7f4d3800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.752+0000 7f4d3cff9700 1 -- 172.21.15.57:0/3251099385 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38009ea0 con 0x7f4d4010a0f0 2023-03-02T10:58:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.753+0000 7f4d3cff9700 1 -- 172.21.15.57:0/3251099385 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d3800f040 con 0x7f4d4010a0f0 2023-03-02T10:58:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.753+0000 7f4d457ff700 1 -- 172.21.15.57:0/3251099385 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4010fbd0 con 0x7f4d4010a0f0 2023-03-02T10:58:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.753+0000 7f4d3cff9700 1 -- 172.21.15.57:0/3251099385 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38004350 con 0x7f4d4010a0f0 2023-03-02T10:58:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.753+0000 7f4d457ff700 1 -- 172.21.15.57:0/3251099385 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4010fa40 con 0x7f4d4010a0f0 2023-03-02T10:58:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.755+0000 7f4d3cff9700 1 -- 172.21.15.57:0/3251099385 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 24) v1 ==== 130034+0+0 (secure 0 0 0) 0x7f4d38013070 con 0x7f4d4010a0f0 2023-03-02T10:58:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.756+0000 7f4d3cff9700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4d2c09b510 0x7f4d2c09d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.756+0000 7f4d3cff9700 1 -- 172.21.15.57:0/3251099385 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4d380c4a10 con 0x7f4d4010a0f0 2023-03-02T10:58:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.756+0000 7f4d3effd700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4d2c09b510 0x7f4d2c09d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d59200b80 1 Processor -- start 2023-03-02T10:58:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d59200b80 1 -- start start 2023-03-02T10:58:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d3effd700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4d2c09b510 0x7f4d2c09d9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d30005e90 tx=0x7f4d30019040 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f289a6b0 0x55f1f2a42a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a43440 0x55f1f2a3d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d59200b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f29a4a00 con 0x55f1f2a42fd0 2023-03-02T10:58:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d59200b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f2956f20 con 0x55f1f2a43440 2023-03-02T10:58:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d59200b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f2927100 con 0x55f1f289a6b0 2023-03-02T10:58:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d3effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f289a6b0 0x55f1f2a42a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d367fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d3effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f289a6b0 0x55f1f2a42a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:60830/0 (socket says 172.21.15.57:60830) 2023-03-02T10:58:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.757+0000 7f4d3effd700 1 -- 172.21.15.57:0/30050916 learned_addr learned my addr 172.21.15.57:0/30050916 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d3f7fe700 1 --2- 172.21.15.57:0/30050916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a43440 0x55f1f2a3d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d3effd700 1 -- 172.21.15.57:0/30050916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a43440 msgr2=0x55f1f2a3d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d3effd700 1 --2- 172.21.15.57:0/30050916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a43440 0x55f1f2a3d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d3effd700 1 -- 172.21.15.57:0/30050916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a42fd0 msgr2=0x55f1f2a3cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d3effd700 1 --2- 172.21.15.57:0/30050916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d3effd700 1 -- 172.21.15.57:0/30050916 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1f28115d0 con 0x55f1f289a6b0 2023-03-02T10:58:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d367fc700 1 --2- 172.21.15.57:0/30050916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d3f7fe700 1 --2- 172.21.15.57:0/30050916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a43440 0x55f1f2a3d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:58:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d3effd700 1 --2- 172.21.15.57:0/30050916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f289a6b0 0x55f1f2a42a90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4d300098c0 tx=0x7f4d3001e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=871cd50ccf5d513f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d357fa700 1 -- 172.21.15.57:0/30050916 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3000b760 con 0x55f1f289a6b0 2023-03-02T10:58:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d357fa700 1 -- 172.21.15.57:0/30050916 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d3001d040 con 0x55f1f289a6b0 2023-03-02T10:58:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.758+0000 7f4d357fa700 1 -- 172.21.15.57:0/30050916 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d300038c0 con 0x55f1f289a6b0 2023-03-02T10:58:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.759+0000 7f4d59200b80 1 -- 172.21.15.57:0/30050916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f289a6b0 msgr2=0x55f1f2a42a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.759+0000 7f4d59200b80 1 --2- 172.21.15.57:0/30050916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f289a6b0 0x55f1f2a42a90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4d300098c0 tx=0x7f4d3001e000 comp rx=0 tx=0).stop 2023-03-02T10:58:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.759+0000 7f4d59200b80 1 -- 172.21.15.57:0/30050916 shutdown_connections 2023-03-02T10:58:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.759+0000 7f4d59200b80 1 --2- 172.21.15.57:0/30050916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a43440 0x55f1f2a3d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.759+0000 7f4d59200b80 1 --2- 172.21.15.57:0/30050916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f289a6b0 0x55f1f2a42a90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.759+0000 7f4d59200b80 1 --2- 172.21.15.57:0/30050916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.759+0000 7f4d59200b80 1 -- 172.21.15.57:0/30050916 >> 172.21.15.57:0/30050916 conn(0x55f1f2a329a0 msgr2=0x55f1f2a37a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.759+0000 7f4d59200b80 1 -- 172.21.15.57:0/30050916 shutdown_connections 2023-03-02T10:58:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.759+0000 7f4d59200b80 1 -- 172.21.15.57:0/30050916 wait complete. 2023-03-02T10:58:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.759+0000 7f4d59200b80 1 -- start start 2023-03-02T10:58:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d59200b80 1 Processor -- start 2023-03-02T10:58:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f289a6b0 0x55f1f2a493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a465d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a43440 0x55f1f2a46d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d59200b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f2995b60 con 0x55f1f2a43440 2023-03-02T10:58:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d59200b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f298f090 con 0x55f1f289a6b0 2023-03-02T10:58:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d59200b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f28138c0 con 0x55f1f2a42fd0 2023-03-02T10:58:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d59200b80 10 client.0 _ll_register_callbacks cb 0x55f1f29354c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d3f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a43440 0x55f1f2a46d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d367fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d3f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a43440 0x55f1f2a46d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33052/0 (socket says 172.21.15.57:33052) 2023-03-02T10:58:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d3f7fe700 1 -- 172.21.15.57:0/1192337126 learned_addr learned my addr 172.21.15.57:0/1192337126 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d367fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a465d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:60840/0 (socket says 172.21.15.57:60840) 2023-03-02T10:58:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d3effd700 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f289a6b0 0x55f1f2a493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d3f7fe700 1 -- 172.21.15.57:0/1192337126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 msgr2=0x55f1f2a465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d3f7fe700 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d3f7fe700 1 -- 172.21.15.57:0/1192337126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f289a6b0 msgr2=0x55f1f2a493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d3f7fe700 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f289a6b0 0x55f1f2a493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.760+0000 7f4d3f7fe700 1 -- 172.21.15.57:0/1192337126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4010d1f0 con 0x55f1f2a43440 2023-03-02T10:58:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d3f7fe700 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a43440 0x55f1f2a46d10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4d380c2660 tx=0x7f4d380939b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4d06940ca2f9b2 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d267fc700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:58:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d267fc700 1 -- 172.21.15.57:0/1192337126 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38093470 con 0x55f1f2a43440 2023-03-02T10:58:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d59200b80 1 -- 172.21.15.57:0/1192337126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1f2960750 con 0x55f1f2a43440 2023-03-02T10:58:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d267fc700 1 -- 172.21.15.57:0/1192337126 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4d38094480 con 0x55f1f2a43440 2023-03-02T10:58:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d267fc700 1 -- 172.21.15.57:0/1192337126 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d38093d80 con 0x55f1f2a43440 2023-03-02T10:58:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d59200b80 10 client.15936 fetch_fsmap learned FSMap version 29 2023-03-02T10:58:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d59200b80 1 -- 172.21.15.57:0/1192337126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f1f27bdd80 con 0x55f1f2a43440 2023-03-02T10:58:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d267fc700 1 -- 172.21.15.57:0/1192337126 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d380af080 con 0x55f1f2a43440 2023-03-02T10:58:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d267fc700 1 -- 172.21.15.57:0/1192337126 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f4d380b0f90 con 0x55f1f2a43440 2023-03-02T10:58:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d59200b80 10 client.15936 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:58:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d59200b80 10 client.15936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d59200b80 20 client.15936 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d59200b80 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f1f2a56ad0 0x55f1f2a58ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d59200b80 4 client.15936 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:58:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.761+0000 7f4d59200b80 1 -- 172.21.15.57:0/1192337126 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1f2988110 con 0x55f1f2a56ad0 2023-03-02T10:58:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.762+0000 7f4d3effd700 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f1f2a56ad0 0x55f1f2a58ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.762+0000 7f4d3effd700 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f1f2a56ad0 0x55f1f2a58ee0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db1edc022184517a server_cookie=7aff1b8d18d925d0 in_seq=0 out_seq=0 2023-03-02T10:58:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.762+0000 7f4d267fc700 10 client.15936 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d267fc700 1 -- 172.21.15.57:0/1192337126 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55f1f2988110 con 0x55f1f2a56ad0 2023-03-02T10:58:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d267fc700 10 client.15936 handle_command_reply: tid=0 2023-03-02T10:58:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 1 client.15936 shutdown 2023-03-02T10:58:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 1 -- 172.21.15.57:0/1192337126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a43440 msgr2=0x55f1f2a46d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a43440 0x55f1f2a46d10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4d380c2660 tx=0x7f4d380939b0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 1 -- 172.21.15.57:0/1192337126 shutdown_connections 2023-03-02T10:58:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f1f2a56ad0 0x55f1f2a58ee0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a43440 0x55f1f2a46d10 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f289a6b0 0x55f1f2a493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d267fc700 0 client.15936 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 1 --2- 172.21.15.57:0/1192337126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 1 -- 172.21.15.57:0/1192337126 >> 172.21.15.57:0/1192337126 conn(0x55f1f2a329a0 msgr2=0x55f1f2a371e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 1 -- 172.21.15.57:0/1192337126 shutdown_connections 2023-03-02T10:58:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 1 -- 172.21.15.57:0/1192337126 wait complete. 2023-03-02T10:58:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.763+0000 7f4d59200b80 20 client.15936 trim_cache size 0 max 16384 2023-03-02T10:58:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d59200b80 1 Processor -- start 2023-03-02T10:58:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d59200b80 1 -- start start 2023-03-02T10:58:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a329a0 0x55f1f2a46580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f289a6b0 0x55f1f2a37980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d59200b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f2a37ec0 con 0x55f1f2a329a0 2023-03-02T10:58:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d59200b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f2a41260 con 0x55f1f289a6b0 2023-03-02T10:58:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d59200b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f2a2fab0 con 0x55f1f2a42fd0 2023-03-02T10:58:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d3effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a329a0 0x55f1f2a46580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d3effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a329a0 0x55f1f2a46580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33062/0 (socket says 172.21.15.57:33062) 2023-03-02T10:58:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d3effd700 1 -- 172.21.15.57:0/481560760 learned_addr learned my addr 172.21.15.57:0/481560760 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.778+0000 7f4d3f7fe700 1 --2- 172.21.15.57:0/481560760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.779+0000 7f4d367fc700 1 --2- 172.21.15.57:0/481560760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f289a6b0 0x55f1f2a37980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.779+0000 7f4d3effd700 1 -- 172.21.15.57:0/481560760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 msgr2=0x55f1f2a3cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.779+0000 7f4d3effd700 1 --2- 172.21.15.57:0/481560760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.779+0000 7f4d3effd700 1 -- 172.21.15.57:0/481560760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f289a6b0 msgr2=0x55f1f2a37980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.779+0000 7f4d3effd700 1 --2- 172.21.15.57:0/481560760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f289a6b0 0x55f1f2a37980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.779+0000 7f4d3effd700 1 -- 172.21.15.57:0/481560760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1f2956130 con 0x55f1f2a329a0 2023-03-02T10:58:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.779+0000 7f4d367fc700 1 --2- 172.21.15.57:0/481560760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f289a6b0 0x55f1f2a37980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:58:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.779+0000 7f4d3effd700 1 --2- 172.21.15.57:0/481560760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a329a0 0x55f1f2a46580 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4d30005690 tx=0x7f4d300056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a1c4f2008d76f0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.779+0000 7f4d35ffb700 1 -- 172.21.15.57:0/481560760 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30034040 con 0x55f1f2a329a0 2023-03-02T10:58:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.779+0000 7f4d35ffb700 1 -- 172.21.15.57:0/481560760 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d30005340 con 0x55f1f2a329a0 2023-03-02T10:58:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.779+0000 7f4d35ffb700 1 -- 172.21.15.57:0/481560760 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30003a80 con 0x55f1f2a329a0 2023-03-02T10:58:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.780+0000 7f4d59200b80 1 -- 172.21.15.57:0/481560760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a329a0 msgr2=0x55f1f2a46580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.780+0000 7f4d59200b80 1 --2- 172.21.15.57:0/481560760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a329a0 0x55f1f2a46580 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4d30005690 tx=0x7f4d300056c0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.780+0000 7f4d59200b80 1 -- 172.21.15.57:0/481560760 shutdown_connections 2023-03-02T10:58:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.780+0000 7f4d59200b80 1 --2- 172.21.15.57:0/481560760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.780+0000 7f4d59200b80 1 --2- 172.21.15.57:0/481560760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f2a329a0 0x55f1f2a46580 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.780+0000 7f4d59200b80 1 --2- 172.21.15.57:0/481560760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f289a6b0 0x55f1f2a37980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.780+0000 7f4d59200b80 1 -- 172.21.15.57:0/481560760 >> 172.21.15.57:0/481560760 conn(0x55f1f2a46e80 msgr2=0x55f1f2a45e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.780+0000 7f4d59200b80 1 -- 172.21.15.57:0/481560760 shutdown_connections 2023-03-02T10:58:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.780+0000 7f4d59200b80 1 -- 172.21.15.57:0/481560760 wait complete. 2023-03-02T10:58:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.780+0000 7f4d59200b80 1 -- start start 2023-03-02T10:58:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.780+0000 7f4d59200b80 1 Processor -- start 2023-03-02T10:58:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f289a6b0 0x55f1f2a3f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a329a0 0x55f1f2a3e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d59200b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d59200b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f2a400b0 con 0x55f1f289a6b0 2023-03-02T10:58:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d59200b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f2a40220 con 0x55f1f2a329a0 2023-03-02T10:58:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d59200b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1f2a3ef90 con 0x55f1f2a42fd0 2023-03-02T10:58:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d59200b80 10 client.0 _ll_register_callbacks cb 0x55f1f29354c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d3effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f289a6b0 0x55f1f2a3f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d367fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a329a0 0x55f1f2a3e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d367fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a329a0 0x55f1f2a3e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:46174/0 (socket says 172.21.15.57:46174) 2023-03-02T10:58:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d3f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d367fc700 1 -- 172.21.15.57:0/2476054950 learned_addr learned my addr 172.21.15.57:0/2476054950 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d3effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f289a6b0 0x55f1f2a3f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33068/0 (socket says 172.21.15.57:33068) 2023-03-02T10:58:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d367fc700 1 -- 172.21.15.57:0/2476054950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 msgr2=0x55f1f2a3ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d367fc700 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d367fc700 1 -- 172.21.15.57:0/2476054950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f289a6b0 msgr2=0x55f1f2a3f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d367fc700 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f289a6b0 0x55f1f2a3f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d367fc700 1 -- 172.21.15.57:0/2476054950 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1f28115d0 con 0x55f1f2a329a0 2023-03-02T10:58:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d3effd700 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f289a6b0 0x55f1f2a3f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d367fc700 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a329a0 0x55f1f2a3e510 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4d40100160 tx=0x7f4d28010f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e902d10f4bcedc7b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.781+0000 7f4d267fc700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T10:58:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d267fc700 1 -- 172.21.15.57:0/2476054950 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28004520 con 0x55f1f2a329a0 2023-03-02T10:58:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d267fc700 1 -- 172.21.15.57:0/2476054950 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4d2800f920 con 0x55f1f2a329a0 2023-03-02T10:58:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d59200b80 1 -- 172.21.15.57:0/2476054950 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d3001d040 con 0x55f1f2a329a0 2023-03-02T10:58:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d267fc700 1 -- 172.21.15.57:0/2476054950 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d2800fae0 con 0x55f1f2a329a0 2023-03-02T10:58:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d59200b80 10 client.25784 fetch_fsmap learned FSMap version 29 2023-03-02T10:58:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d59200b80 1 -- 172.21.15.57:0/2476054950 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f1f27e41f0 con 0x55f1f2a329a0 2023-03-02T10:58:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d267fc700 1 -- 172.21.15.57:0/2476054950 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d3001d040 con 0x55f1f2a329a0 2023-03-02T10:58:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d267fc700 1 -- 172.21.15.57:0/2476054950 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f4d28026380 con 0x55f1f2a329a0 2023-03-02T10:58:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d59200b80 10 client.25784 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:58:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d59200b80 10 client.25784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d59200b80 20 client.25784 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d59200b80 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f1f2a43440 0x55f1f2aab620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d59200b80 4 client.25784 mds_command: new command op to 24560 tid=0[{"prefix": "flush journal"}] 2023-03-02T10:58:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.782+0000 7f4d59200b80 1 -- 172.21.15.57:0/2476054950 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f1f2987e30 con 0x55f1f2a43440 2023-03-02T10:58:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.783+0000 7f4d3effd700 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f1f2a43440 0x55f1f2aab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.783+0000 7f4d3effd700 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f1f2a43440 0x55f1f2aab620 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7143671bbb40de85 server_cookie=f9a2f0860a31eaef in_seq=0 out_seq=0 2023-03-02T10:58:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:22.783+0000 7f4d267fc700 10 client.25784 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:23 smithi057 ceph-mon[92072]: pgmap v44: 97 pgs: 97 active+clean; 7.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 220 MiB/s wr, 107 op/s 2023-03-02T10:58:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:23 smithi122 ceph-mon[125440]: pgmap v44: 97 pgs: 97 active+clean; 7.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 220 MiB/s wr, 107 op/s 2023-03-02T10:58:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:23 smithi136 ceph-mon[125702]: pgmap v44: 97 pgs: 97 active+clean; 7.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 220 MiB/s wr, 107 op/s 2023-03-02T10:58:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:25 smithi057 ceph-mon[92072]: pgmap v45: 97 pgs: 97 active+clean; 7.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 147 MiB/s wr, 64 op/s 2023-03-02T10:58:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:25 smithi122 ceph-mon[125440]: pgmap v45: 97 pgs: 97 active+clean; 7.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 147 MiB/s wr, 64 op/s 2023-03-02T10:58:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:25 smithi136 ceph-mon[125702]: pgmap v45: 97 pgs: 97 active+clean; 7.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 147 MiB/s wr, 64 op/s 2023-03-02T10:58:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:27 smithi122 ceph-mon[125440]: pgmap v46: 97 pgs: 97 active+clean; 7.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 147 MiB/s wr, 64 op/s 2023-03-02T10:58:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:27 smithi136 ceph-mon[125702]: pgmap v46: 97 pgs: 97 active+clean; 7.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 147 MiB/s wr, 64 op/s 2023-03-02T10:58:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:27 smithi057 ceph-mon[92072]: pgmap v46: 97 pgs: 97 active+clean; 7.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 147 MiB/s wr, 64 op/s 2023-03-02T10:58:28.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T10:58:28.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.477+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1506734293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb41049c0 msgr2=0x7f3bb4104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.477+0000 7f3bbb7ff700 1 --2- 172.21.15.57:0/1506734293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb41049c0 0x7f3bb4104d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009990 tx=0x7f3bb0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.478+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1506734293 shutdown_connections 2023-03-02T10:58:28.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.478+0000 7f3bbb7ff700 1 --2- 172.21.15.57:0/1506734293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bb40ff360 0x7f3bb410b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.478+0000 7f3bbb7ff700 1 --2- 172.21.15.57:0/1506734293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb41049c0 0x7f3bb4104d90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.478+0000 7f3bbb7ff700 1 --2- 172.21.15.57:0/1506734293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bb40fe9b0 0x7f3bb40fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.478+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1506734293 >> 172.21.15.57:0/1506734293 conn(0x7f3bb40fa4b0 msgr2=0x7f3bb40fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:28.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.478+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1506734293 shutdown_connections 2023-03-02T10:58:28.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.478+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1506734293 wait complete. 2023-03-02T10:58:28.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.478+0000 7f3bbb7ff700 1 Processor -- start 2023-03-02T10:58:28.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.478+0000 7f3bbb7ff700 1 -- start start 2023-03-02T10:58:28.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bbb7ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bb40fe9b0 0x7f3bb41005c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bbb7ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb40ff360 0x7f3bb4100b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bbb7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bb41049c0 0x7f3bb41a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bbb7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb4101330 con 0x7f3bb41049c0 2023-03-02T10:58:28.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bbb7ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb41a4250 con 0x7f3bb40fe9b0 2023-03-02T10:58:28.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bbb7ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb41a4390 con 0x7f3bb40ff360 2023-03-02T10:58:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb9d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bb41049c0 0x7f3bb41a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb8d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb40ff360 0x7f3bb4100b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb8d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb40ff360 0x7f3bb4100b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47496/0 (socket says 172.21.15.57:47496) 2023-03-02T10:58:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb9d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bb41049c0 0x7f3bb41a3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51616/0 (socket says 172.21.15.57:51616) 2023-03-02T10:58:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb8d9a700 1 -- 172.21.15.57:0/1005270529 learned_addr learned my addr 172.21.15.57:0/1005270529 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb959b700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bb40fe9b0 0x7f3bb41005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb8d9a700 1 -- 172.21.15.57:0/1005270529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bb40fe9b0 msgr2=0x7f3bb41005c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bb40fe9b0 0x7f3bb41005c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb8d9a700 1 -- 172.21.15.57:0/1005270529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bb41049c0 msgr2=0x7f3bb41a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bb41049c0 0x7f3bb41a3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb8d9a700 1 -- 172.21.15.57:0/1005270529 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00095f0 con 0x7f3bb40ff360 2023-03-02T10:58:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.479+0000 7f3bb9d9c700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bb41049c0 0x7f3bb41a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.480+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb40ff360 0x7f3bb4100b00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400e9a0 tx=0x7f3ba400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.480+0000 7f3baa7fc700 1 -- 172.21.15.57:0/1005270529 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4009790 con 0x7f3bb40ff360 2023-03-02T10:58:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.480+0000 7f3baa7fc700 1 -- 172.21.15.57:0/1005270529 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ba4010430 con 0x7f3bb40ff360 2023-03-02T10:58:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.480+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1005270529 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb410e9f0 con 0x7f3bb40ff360 2023-03-02T10:58:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.480+0000 7f3baa7fc700 1 -- 172.21.15.57:0/1005270529 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4018680 con 0x7f3bb40ff360 2023-03-02T10:58:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.480+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1005270529 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb410e860 con 0x7f3bb40ff360 2023-03-02T10:58:28.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.482+0000 7f3baa7fc700 1 -- 172.21.15.57:0/1005270529 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 24) v1 ==== 130034+0+0 (secure 0 0 0) 0x7f3ba400c040 con 0x7f3bb40ff360 2023-03-02T10:58:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.484+0000 7f3baa7fc700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3ba009b510 0x7f3ba009d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.484+0000 7f3bb959b700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3ba009b510 0x7f3ba009d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.484+0000 7f3baa7fc700 1 -- 172.21.15.57:0/1005270529 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3ba4014070 con 0x7f3bb40ff360 2023-03-02T10:58:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.484+0000 7f3bcf18ab80 1 Processor -- start 2023-03-02T10:58:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.484+0000 7f3bcf18ab80 1 -- start start 2023-03-02T10:58:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf4703c0 0x5608cf470790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf474bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf475110 0x5608cf475560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf3d7a60 con 0x5608cf470cd0 2023-03-02T10:58:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf389f80 con 0x5608cf4703c0 2023-03-02T10:58:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf35a160 con 0x5608cf475110 2023-03-02T10:58:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb959b700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3ba009b510 0x7f3ba009d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000b2e0 tx=0x7f3bb0005fd0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb9d9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf475110 0x5608cf475560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb8d9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf474bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb9d9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf475110 0x5608cf475560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47506/0 (socket says 172.21.15.57:47506) 2023-03-02T10:58:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb9d9c700 1 -- 172.21.15.57:0/210068629 learned_addr learned my addr 172.21.15.57:0/210068629 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb959b700 1 --2- 172.21.15.57:0/210068629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf4703c0 0x5608cf470790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb9d9c700 1 -- 172.21.15.57:0/210068629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf4703c0 msgr2=0x5608cf470790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb9d9c700 1 --2- 172.21.15.57:0/210068629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf4703c0 0x5608cf470790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb9d9c700 1 -- 172.21.15.57:0/210068629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 msgr2=0x5608cf474bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb9d9c700 1 --2- 172.21.15.57:0/210068629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf474bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb9d9c700 1 -- 172.21.15.57:0/210068629 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608cf244630 con 0x5608cf475110 2023-03-02T10:58:28.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.485+0000 7f3bb9d9c700 1 --2- 172.21.15.57:0/210068629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf475110 0x5608cf475560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3bac003e40 tx=0x7f3bac009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14f751069e311ee server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:28.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3b9f7fe700 1 -- 172.21.15.57:0/210068629 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0092d0 con 0x5608cf475110 2023-03-02T10:58:28.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3b9f7fe700 1 -- 172.21.15.57:0/210068629 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bac00f040 con 0x5608cf475110 2023-03-02T10:58:28.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3b9f7fe700 1 -- 172.21.15.57:0/210068629 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00e750 con 0x5608cf475110 2023-03-02T10:58:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/210068629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf475110 msgr2=0x5608cf475560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/210068629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf475110 0x5608cf475560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3bac003e40 tx=0x7f3bac009920 comp rx=0 tx=0).stop 2023-03-02T10:58:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/210068629 shutdown_connections 2023-03-02T10:58:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/210068629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf475110 0x5608cf475560 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/210068629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf4703c0 0x5608cf470790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/210068629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf474bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/210068629 >> 172.21.15.57:0/210068629 conn(0x5608cf465c50 msgr2=0x5608cf46b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:28.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/210068629 shutdown_connections 2023-03-02T10:58:28.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.486+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/210068629 wait complete. 2023-03-02T10:58:28.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.487+0000 7f3bcf18ab80 1 -- start start 2023-03-02T10:58:28.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.487+0000 7f3bcf18ab80 1 Processor -- start 2023-03-02T10:58:28.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf47c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf479c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf475110 0x5608cf47a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf3c8bc0 con 0x5608cf470cd0 2023-03-02T10:58:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf3c20f0 con 0x5608cf475110 2023-03-02T10:58:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf246920 con 0x5608cf4703c0 2023-03-02T10:58:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bcf18ab80 10 client.0 _ll_register_callbacks cb 0x5608cf368520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb959b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf47c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb959b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf47c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47516/0 (socket says 172.21.15.57:47516) 2023-03-02T10:58:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb959b700 1 -- 172.21.15.57:0/2787790274 learned_addr learned my addr 172.21.15.57:0/2787790274 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf479c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb9d9c700 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf475110 0x5608cf47a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb959b700 1 -- 172.21.15.57:0/2787790274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf475110 msgr2=0x5608cf47a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb959b700 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf475110 0x5608cf47a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb959b700 1 -- 172.21.15.57:0/2787790274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 msgr2=0x5608cf479c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb959b700 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf479c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb959b700 1 -- 172.21.15.57:0/2787790274 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac003b20 con 0x5608cf4703c0 2023-03-02T10:58:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf479c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3bb959b700 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf47c9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0015000 tx=0x7f3bb0009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=830383272b233034 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.488+0000 7f3b9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:58:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3b9cff9700 1 -- 172.21.15.57:0/2787790274 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0004df0 con 0x5608cf4703c0 2023-03-02T10:58:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3b9cff9700 1 -- 172.21.15.57:0/2787790274 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3bb000f460 con 0x5608cf4703c0 2023-03-02T10:58:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2787790274 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608cf3937b0 con 0x5608cf4703c0 2023-03-02T10:58:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3b9cff9700 1 -- 172.21.15.57:0/2787790274 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bb00059c0 con 0x5608cf4703c0 2023-03-02T10:58:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3bcf18ab80 10 client.25756 fetch_fsmap learned FSMap version 29 2023-03-02T10:58:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2787790274 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5608cf1f0de0 con 0x5608cf4703c0 2023-03-02T10:58:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3b9cff9700 1 -- 172.21.15.57:0/2787790274 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5608cf3937b0 con 0x5608cf4703c0 2023-03-02T10:58:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3b9cff9700 1 -- 172.21.15.57:0/2787790274 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f3bb002f7f0 con 0x5608cf4703c0 2023-03-02T10:58:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3bcf18ab80 10 client.25756 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:58:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3bcf18ab80 10 client.25756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3bcf18ab80 20 client.25756 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5608cf48a350 0x5608cf48c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3bcf18ab80 4 client.25756 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:58:28.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.489+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2787790274 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608cf3bb170 con 0x5608cf48a350 2023-03-02T10:58:28.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.490+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5608cf48a350 0x5608cf48c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.490+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5608cf48a350 0x5608cf48c760 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4e0eff3a3d261bc server_cookie=4aae825e63295e05 in_seq=0 out_seq=0 2023-03-02T10:58:28.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.490+0000 7f3b9cff9700 10 client.25756 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d267fc700 1 -- 172.21.15.57:0/2476054950 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f1f2987e30 con 0x55f1f2a43440 2023-03-02T10:58:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d267fc700 10 client.25784 handle_command_reply: tid=0 2023-03-02T10:58:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d59200b80 1 client.25784 shutdown 2023-03-02T10:58:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d59200b80 1 -- 172.21.15.57:0/2476054950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a329a0 msgr2=0x55f1f2a3e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d59200b80 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a329a0 0x55f1f2a3e510 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4d40100160 tx=0x7f4d28010f80 comp rx=0 tx=0).stop 2023-03-02T10:58:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d59200b80 1 -- 172.21.15.57:0/2476054950 shutdown_connections 2023-03-02T10:58:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d59200b80 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x55f1f2a43440 0x55f1f2aab620 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d59200b80 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f1f2a42fd0 0x55f1f2a3ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d267fc700 0 client.25784 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d59200b80 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f1f289a6b0 0x55f1f2a3f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d59200b80 1 --2- 172.21.15.57:0/2476054950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f1f2a329a0 0x55f1f2a3e510 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d59200b80 1 -- 172.21.15.57:0/2476054950 >> 172.21.15.57:0/2476054950 conn(0x55f1f2a46e80 msgr2=0x55f1f2a41670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d59200b80 1 -- 172.21.15.57:0/2476054950 shutdown_connections 2023-03-02T10:58:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f4d59200b80 1 -- 172.21.15.57:0/2476054950 wait complete. 2023-03-02T10:58:28.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f3b9cff9700 1 -- 172.21.15.57:0/2787790274 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5608cf3bb170 con 0x5608cf48a350 2023-03-02T10:58:28.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f3b9cff9700 10 client.25756 handle_command_reply: tid=0 2023-03-02T10:58:28.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.797+0000 7f3bcf18ab80 1 client.25756 shutdown 2023-03-02T10:58:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f4d59200b80 20 client.25784 trim_cache size 0 max 16384 2023-03-02T10:58:28.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2787790274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 msgr2=0x5608cf47c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf47c9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0015000 tx=0x7f3bb0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2787790274 shutdown_connections 2023-03-02T10:58:28.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5608cf48a350 0x5608cf48c760 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:{ 2023-03-02T10:58:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "message": "", 2023-03-02T10:58:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "return_code": 0 2023-03-02T10:58:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:} 2023-03-02T10:58:28.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf475110 0x5608cf47a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf47c9c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3b9cff9700 0 client.25756 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:28.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/2787790274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf479c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2787790274 >> 172.21.15.57:0/2787790274 conn(0x5608cf465c50 msgr2=0x5608cf46aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:28.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2787790274 shutdown_connections 2023-03-02T10:58:28.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2787790274 wait complete. 2023-03-02T10:58:28.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f3bcf18ab80 20 client.25756 trim_cache size 0 max 16384 2023-03-02T10:58:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f4d457ff700 1 -- 172.21.15.57:0/3251099385 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4d2c09b510 msgr2=0x7f4d2c09d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f4d457ff700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4d2c09b510 0x7f4d2c09d9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d30005e90 tx=0x7f4d30019040 comp rx=0 tx=0).stop 2023-03-02T10:58:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f4d457ff700 1 -- 172.21.15.57:0/3251099385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d4010a0f0 msgr2=0x7f4d401a3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f4d457ff700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d4010a0f0 0x7f4d401a3e40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d38007f10 tx=0x7f4d3800d3b0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f4d457ff700 1 -- 172.21.15.57:0/3251099385 shutdown_connections 2023-03-02T10:58:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f4d457ff700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4d2c09b510 0x7f4d2c09d9c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f4d457ff700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d4010a0f0 0x7f4d401a3e40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f4d457ff700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d40100d20 0x7f4d400fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f4d457ff700 1 --2- 172.21.15.57:0/3251099385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d40101630 0x7f4d400feeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.798+0000 7f4d457ff700 1 -- 172.21.15.57:0/3251099385 >> 172.21.15.57:0/3251099385 conn(0x7f4d400767e0 msgr2=0x7f4d400fb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.799+0000 7f4d457ff700 1 -- 172.21.15.57:0/3251099385 shutdown_connections 2023-03-02T10:58:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:28.799+0000 7f4d457ff700 1 -- 172.21.15.57:0/3251099385 wait complete. 2023-03-02T10:58:28.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bcf18ab80 1 Processor -- start 2023-03-02T10:58:28.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bcf18ab80 1 -- start start 2023-03-02T10:58:28.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf479c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf470cd0 0x5608cf472a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf475110 0x5608cf4764f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf47b0d0 con 0x5608cf475110 2023-03-02T10:58:28.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf46cc90 con 0x5608cf470cd0 2023-03-02T10:58:28.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf4711b0 con 0x5608cf4703c0 2023-03-02T10:58:28.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bb9d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf475110 0x5608cf4764f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bb9d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf475110 0x5608cf4764f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51642/0 (socket says 172.21.15.57:51642) 2023-03-02T10:58:28.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bb9d9c700 1 -- 172.21.15.57:0/2379980564 learned_addr learned my addr 172.21.15.57:0/2379980564 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:28.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.816+0000 7f3bb959b700 1 --2- 172.21.15.57:0/2379980564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf479c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.817+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/2379980564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf470cd0 0x5608cf472a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.817+0000 7f3bb9d9c700 1 -- 172.21.15.57:0/2379980564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 msgr2=0x5608cf479c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:28.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.817+0000 7f3bb9d9c700 1 --2- 172.21.15.57:0/2379980564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf479c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.817+0000 7f3bb9d9c700 1 -- 172.21.15.57:0/2379980564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf470cd0 msgr2=0x5608cf472a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.817+0000 7f3bb9d9c700 1 --2- 172.21.15.57:0/2379980564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf470cd0 0x5608cf472a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.817+0000 7f3bb9d9c700 1 -- 172.21.15.57:0/2379980564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608cf4673f0 con 0x5608cf475110 2023-03-02T10:58:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.817+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/2379980564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf470cd0 0x5608cf472a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:58:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.817+0000 7f3bb9d9c700 1 --2- 172.21.15.57:0/2379980564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf475110 0x5608cf4764f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3bac007ec0 tx=0x7f3bac007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7219931611e09f8 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.817+0000 7f3b9ffff700 1 -- 172.21.15.57:0/2379980564 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac009350 con 0x5608cf475110 2023-03-02T10:58:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.818+0000 7f3b9ffff700 1 -- 172.21.15.57:0/2379980564 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bac004e60 con 0x5608cf475110 2023-03-02T10:58:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.818+0000 7f3b9ffff700 1 -- 172.21.15.57:0/2379980564 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00e750 con 0x5608cf475110 2023-03-02T10:58:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.819+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2379980564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf475110 msgr2=0x5608cf4764f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.819+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/2379980564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf475110 0x5608cf4764f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3bac007ec0 tx=0x7f3bac007e50 comp rx=0 tx=0).stop 2023-03-02T10:58:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.819+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2379980564 shutdown_connections 2023-03-02T10:58:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.819+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/2379980564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf475110 0x5608cf4764f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.819+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/2379980564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf479c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.819+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/2379980564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf470cd0 0x5608cf472a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.819+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2379980564 >> 172.21.15.57:0/2379980564 conn(0x5608cf465c50 msgr2=0x5608cf479500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.819+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2379980564 shutdown_connections 2023-03-02T10:58:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.819+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/2379980564 wait complete. 2023-03-02T10:58:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.820+0000 7f3bcf18ab80 1 -- start start 2023-03-02T10:58:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.820+0000 7f3bcf18ab80 1 Processor -- start 2023-03-02T10:58:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.821+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf480ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.821+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf481220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.821+0000 7f3bcf18ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf475110 0x5608cf47d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.821+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf47dc20 con 0x5608cf470cd0 2023-03-02T10:58:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.821+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf47dd90 con 0x5608cf475110 2023-03-02T10:58:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.821+0000 7f3bcf18ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608cf47df50 con 0x5608cf4703c0 2023-03-02T10:58:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.821+0000 7f3bcf18ab80 10 client.0 _ll_register_callbacks cb 0x5608cf368520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.821+0000 7f3bb8d9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf481220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.821+0000 7f3bb8d9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf481220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51652/0 (socket says 172.21.15.57:51652) 2023-03-02T10:58:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.821+0000 7f3bb8d9a700 1 -- 172.21.15.57:0/3317984789 learned_addr learned my addr 172.21.15.57:0/3317984789 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:28.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.822+0000 7f3bb9d9c700 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf475110 0x5608cf47d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.822+0000 7f3bb8d9a700 1 -- 172.21.15.57:0/3317984789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 msgr2=0x5608cf480ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.822+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf480ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.822+0000 7f3bb8d9a700 1 -- 172.21.15.57:0/3317984789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf475110 msgr2=0x5608cf47d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.822+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf475110 0x5608cf47d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.822+0000 7f3bb8d9a700 1 -- 172.21.15.57:0/3317984789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5608cf244630 con 0x5608cf470cd0 2023-03-02T10:58:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.822+0000 7f3bb8d9a700 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf481220 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009230 tx=0x7f3ba401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1884b208fd766c67 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:28.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.822+0000 7f3b9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:58:28.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.823+0000 7f3b9cff9700 1 -- 172.21.15.57:0/3317984789 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba409bf00 con 0x5608cf470cd0 2023-03-02T10:58:28.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.823+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/3317984789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3bac00f040 con 0x5608cf470cd0 2023-03-02T10:58:28.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.823+0000 7f3b9cff9700 1 -- 172.21.15.57:0/3317984789 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3ba40ac070 con 0x5608cf470cd0 2023-03-02T10:58:28.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.823+0000 7f3b9cff9700 1 -- 172.21.15.57:0/3317984789 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ba40105a0 con 0x5608cf470cd0 2023-03-02T10:58:28.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.823+0000 7f3bcf18ab80 10 client.15960 fetch_fsmap learned FSMap version 29 2023-03-02T10:58:28.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.823+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/3317984789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5608cf1d9c60 con 0x5608cf470cd0 2023-03-02T10:58:28.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.824+0000 7f3b9cff9700 1 -- 172.21.15.57:0/3317984789 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bac00f040 con 0x5608cf470cd0 2023-03-02T10:58:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.824+0000 7f3b9cff9700 1 -- 172.21.15.57:0/3317984789 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f3ba409ba70 con 0x5608cf470cd0 2023-03-02T10:58:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.824+0000 7f3bcf18ab80 10 client.15960 fetch_fsmap finished waiting for FSMap version 29 2023-03-02T10:58:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.824+0000 7f3bcf18ab80 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.824+0000 7f3bcf18ab80 20 client.15960 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.824+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5608cf4e57f0 0x5608cf4e7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.824+0000 7f3bcf18ab80 4 client.15960 mds_command: new command op to 24560 tid=0[{"prefix": "scrub status"}] 2023-03-02T10:58:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.824+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/3317984789 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5608cf3bae90 con 0x5608cf4e57f0 2023-03-02T10:58:28.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.825+0000 7f3bb959b700 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5608cf4e57f0 0x5608cf4e7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.827+0000 7f3bb959b700 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5608cf4e57f0 0x5608cf4e7c00 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=520ded4c58761861 server_cookie=95148cb31bf2a934 in_seq=0 out_seq=0 2023-03-02T10:58:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.827+0000 7f3b9cff9700 10 client.15960 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3b9cff9700 1 -- 172.21.15.57:0/3317984789 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5608cf3bae90 con 0x5608cf4e57f0 2023-03-02T10:58:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3b9cff9700 10 client.15960 handle_command_reply: tid=0 2023-03-02T10:58:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3bcf18ab80 1 client.15960 shutdown 2023-03-02T10:58:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/3317984789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 msgr2=0x5608cf481220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf481220 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009230 tx=0x7f3ba401a040 comp rx=0 tx=0).stop 2023-03-02T10:58:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/3317984789 shutdown_connections 2023-03-02T10:58:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5608cf4e57f0 0x5608cf4e7c00 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608cf475110 0x5608cf47d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608cf4703c0 0x5608cf480ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3bcf18ab80 1 --2- 172.21.15.57:0/3317984789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608cf470cd0 0x5608cf481220 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/3317984789 >> 172.21.15.57:0/3317984789 conn(0x5608cf465c50 msgr2=0x5608cf4774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.828+0000 7f3b9cff9700 0 client.15960 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:28.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.829+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/3317984789 shutdown_connections 2023-03-02T10:58:28.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.829+0000 7f3bcf18ab80 1 -- 172.21.15.57:0/3317984789 wait complete. 2023-03-02T10:58:28.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.829+0000 7f3bcf18ab80 20 client.15960 trim_cache size 0 max 16384 2023-03-02T10:58:28.834 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:58:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "IDLE (waiting for more scrubs)", 2023-03-02T10:58:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T10:58:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: "f1cfc471-e4e0-40ad-8523-43e51eef793a": { 2023-03-02T10:58:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T10:58:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "f1cfc471-e4e0-40ad-8523-43e51eef793a", 2023-03-02T10:58:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T10:58:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:58:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:58:28.835 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:58:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1005270529 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3ba009b510 msgr2=0x7f3ba009d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3ba009b510 0x7f3ba009d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000b2e0 tx=0x7f3bb0005fd0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1005270529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb40ff360 msgr2=0x7f3bb4100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb40ff360 0x7f3bb4100b00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400e9a0 tx=0x7f3ba400ecb0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1005270529 shutdown_connections 2023-03-02T10:58:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3ba009b510 0x7f3ba009d9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bb41049c0 0x7f3bb41a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bb40fe9b0 0x7f3bb41005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 --2- 172.21.15.57:0/1005270529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb40ff360 0x7f3bb4100b00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1005270529 >> 172.21.15.57:0/1005270529 conn(0x7f3bb40fa4b0 msgr2=0x7f3bb4102700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1005270529 shutdown_connections 2023-03-02T10:58:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:28.830+0000 7f3bbb7ff700 1 -- 172.21.15.57:0/1005270529 wait complete. 2023-03-02T10:58:28.849 INFO:tasks.cephfs.filesystem:scrub status for tag:f1cfc471-e4e0-40ad-8523-43e51eef793a - {'path': '/', 'tag': 'f1cfc471-e4e0-40ad-8523-43e51eef793a', 'options': 'recursive,force'} 2023-03-02T10:58:28.873 INFO:teuthology.orchestra.run.smithi057.stderr:41200000 of 50000000 tuples (82%) done (elapsed 73.68 s, remaining 15.74 s) 2023-03-02T10:58:28.962 INFO:teuthology.orchestra.run.smithi057.stderr:41300000 of 50000000 tuples (82%) done (elapsed 73.77 s, remaining 15.54 s) 2023-03-02T10:58:29.119 INFO:teuthology.orchestra.run.smithi057.stderr:41400000 of 50000000 tuples (82%) done (elapsed 73.92 s, remaining 15.36 s) 2023-03-02T10:58:29.199 INFO:teuthology.orchestra.run.smithi057.stderr:41500000 of 50000000 tuples (83%) done (elapsed 74.00 s, remaining 15.16 s) 2023-03-02T10:58:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:41600000 of 50000000 tuples (83%) done (elapsed 74.14 s, remaining 14.97 s) 2023-03-02T10:58:29.467 INFO:teuthology.orchestra.run.smithi057.stderr:41700000 of 50000000 tuples (83%) done (elapsed 74.27 s, remaining 14.78 s) 2023-03-02T10:58:29.577 INFO:teuthology.orchestra.run.smithi057.stderr:41800000 of 50000000 tuples (83%) done (elapsed 74.38 s, remaining 14.59 s) 2023-03-02T10:58:29.686 INFO:teuthology.orchestra.run.smithi057.stderr:41900000 of 50000000 tuples (83%) done (elapsed 74.49 s, remaining 14.40 s) 2023-03-02T10:58:29.816 INFO:teuthology.orchestra.run.smithi057.stderr:42000000 of 50000000 tuples (84%) done (elapsed 74.62 s, remaining 14.21 s) 2023-03-02T10:58:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:29 smithi136 ceph-mon[125702]: pgmap v47: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 147 MiB/s wr, 75 op/s 2023-03-02T10:58:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:29 smithi057 ceph-mon[92072]: pgmap v47: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 147 MiB/s wr, 75 op/s 2023-03-02T10:58:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:29 smithi122 ceph-mon[125440]: pgmap v47: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 147 MiB/s wr, 75 op/s 2023-03-02T10:58:29.963 INFO:teuthology.orchestra.run.smithi057.stderr:42100000 of 50000000 tuples (84%) done (elapsed 74.77 s, remaining 14.03 s) 2023-03-02T10:58:30.063 INFO:teuthology.orchestra.run.smithi057.stderr:42200000 of 50000000 tuples (84%) done (elapsed 74.87 s, remaining 13.84 s) 2023-03-02T10:58:30.192 INFO:teuthology.orchestra.run.smithi057.stderr:42300000 of 50000000 tuples (84%) done (elapsed 75.00 s, remaining 13.65 s) 2023-03-02T10:58:30.288 INFO:teuthology.orchestra.run.smithi057.stderr:42400000 of 50000000 tuples (84%) done (elapsed 75.09 s, remaining 13.46 s) 2023-03-02T10:58:30.430 INFO:teuthology.orchestra.run.smithi057.stderr:42500000 of 50000000 tuples (85%) done (elapsed 75.24 s, remaining 13.28 s) 2023-03-02T10:58:30.558 INFO:teuthology.orchestra.run.smithi057.stderr:42600000 of 50000000 tuples (85%) done (elapsed 75.36 s, remaining 13.09 s) 2023-03-02T10:58:30.677 INFO:teuthology.orchestra.run.smithi057.stderr:42700000 of 50000000 tuples (85%) done (elapsed 75.48 s, remaining 12.90 s) 2023-03-02T10:58:30.795 INFO:teuthology.orchestra.run.smithi057.stderr:42800000 of 50000000 tuples (85%) done (elapsed 75.60 s, remaining 12.72 s) 2023-03-02T10:58:30.898 INFO:teuthology.orchestra.run.smithi057.stderr:42900000 of 50000000 tuples (85%) done (elapsed 75.70 s, remaining 12.53 s) 2023-03-02T10:58:31.042 INFO:teuthology.orchestra.run.smithi057.stderr:43000000 of 50000000 tuples (86%) done (elapsed 75.85 s, remaining 12.35 s) 2023-03-02T10:58:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:43100000 of 50000000 tuples (86%) done (elapsed 75.98 s, remaining 12.16 s) 2023-03-02T10:58:31.280 INFO:teuthology.orchestra.run.smithi057.stderr:43200000 of 50000000 tuples (86%) done (elapsed 76.08 s, remaining 11.98 s) 2023-03-02T10:58:31.402 INFO:teuthology.orchestra.run.smithi057.stderr:43300000 of 50000000 tuples (86%) done (elapsed 76.21 s, remaining 11.79 s) 2023-03-02T10:58:31.512 INFO:teuthology.orchestra.run.smithi057.stderr:43400000 of 50000000 tuples (86%) done (elapsed 76.32 s, remaining 11.61 s) 2023-03-02T10:58:31.673 INFO:teuthology.orchestra.run.smithi057.stderr:43500000 of 50000000 tuples (87%) done (elapsed 76.48 s, remaining 11.43 s) 2023-03-02T10:58:31.806 INFO:teuthology.orchestra.run.smithi057.stderr:43600000 of 50000000 tuples (87%) done (elapsed 76.61 s, remaining 11.25 s) 2023-03-02T10:58:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:31 smithi057 ceph-mon[92072]: pgmap v48: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 74 MiB/s wr, 40 op/s 2023-03-02T10:58:31.935 INFO:teuthology.orchestra.run.smithi057.stderr:43700000 of 50000000 tuples (87%) done (elapsed 76.74 s, remaining 11.06 s) 2023-03-02T10:58:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:31 smithi122 ceph-mon[125440]: pgmap v48: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 74 MiB/s wr, 40 op/s 2023-03-02T10:58:32.039 INFO:teuthology.orchestra.run.smithi057.stderr:43800000 of 50000000 tuples (87%) done (elapsed 76.84 s, remaining 10.88 s) 2023-03-02T10:58:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:31 smithi136 ceph-mon[125702]: pgmap v48: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 74 MiB/s wr, 40 op/s 2023-03-02T10:58:32.164 INFO:teuthology.orchestra.run.smithi057.stderr:43900000 of 50000000 tuples (87%) done (elapsed 76.97 s, remaining 10.70 s) 2023-03-02T10:58:32.297 INFO:teuthology.orchestra.run.smithi057.stderr:44000000 of 50000000 tuples (88%) done (elapsed 77.10 s, remaining 10.51 s) 2023-03-02T10:58:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:44100000 of 50000000 tuples (88%) done (elapsed 77.20 s, remaining 10.33 s) 2023-03-02T10:58:32.539 INFO:teuthology.orchestra.run.smithi057.stderr:44200000 of 50000000 tuples (88%) done (elapsed 77.34 s, remaining 10.15 s) 2023-03-02T10:58:32.625 INFO:teuthology.orchestra.run.smithi057.stderr:44300000 of 50000000 tuples (88%) done (elapsed 77.43 s, remaining 9.96 s) 2023-03-02T10:58:32.787 INFO:teuthology.orchestra.run.smithi057.stderr:44400000 of 50000000 tuples (88%) done (elapsed 77.59 s, remaining 9.79 s) 2023-03-02T10:58:32.911 INFO:teuthology.orchestra.run.smithi057.stderr:44500000 of 50000000 tuples (89%) done (elapsed 77.72 s, remaining 9.61 s) 2023-03-02T10:58:33.021 INFO:teuthology.orchestra.run.smithi057.stderr:44600000 of 50000000 tuples (89%) done (elapsed 77.83 s, remaining 9.42 s) 2023-03-02T10:58:33.170 INFO:teuthology.orchestra.run.smithi057.stderr:44700000 of 50000000 tuples (89%) done (elapsed 77.97 s, remaining 9.25 s) 2023-03-02T10:58:33.286 INFO:teuthology.orchestra.run.smithi057.stderr:44800000 of 50000000 tuples (89%) done (elapsed 78.09 s, remaining 9.06 s) 2023-03-02T10:58:33.457 INFO:teuthology.orchestra.run.smithi057.stderr:44900000 of 50000000 tuples (89%) done (elapsed 78.26 s, remaining 8.89 s) 2023-03-02T10:58:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:33 smithi057 ceph-mon[92072]: pgmap v49: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 94 MiB/s wr, 71 op/s 2023-03-02T10:58:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:33 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:58:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:33 smithi057 ceph-mon[92072]: mgrmap e25: x(active, since 92s), standbys: y, z 2023-03-02T10:58:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:33 smithi122 ceph-mon[125440]: pgmap v49: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 94 MiB/s wr, 71 op/s 2023-03-02T10:58:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:33 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:58:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:33 smithi122 ceph-mon[125440]: mgrmap e25: x(active, since 92s), standbys: y, z 2023-03-02T10:58:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:33 smithi136 ceph-mon[125702]: pgmap v49: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 94 MiB/s wr, 71 op/s 2023-03-02T10:58:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:33 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:58:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:33 smithi136 ceph-mon[125702]: mgrmap e25: x(active, since 92s), standbys: y, z 2023-03-02T10:58:34.096 INFO:teuthology.orchestra.run.smithi057.stderr:45000000 of 50000000 tuples (90%) done (elapsed 78.90 s, remaining 8.77 s) 2023-03-02T10:58:34.211 INFO:teuthology.orchestra.run.smithi057.stderr:45100000 of 50000000 tuples (90%) done (elapsed 79.02 s, remaining 8.58 s) 2023-03-02T10:58:34.333 INFO:teuthology.orchestra.run.smithi057.stderr:45200000 of 50000000 tuples (90%) done (elapsed 79.14 s, remaining 8.40 s) 2023-03-02T10:58:34.491 INFO:teuthology.orchestra.run.smithi057.stderr:45300000 of 50000000 tuples (90%) done (elapsed 79.30 s, remaining 8.23 s) 2023-03-02T10:58:34.615 INFO:teuthology.orchestra.run.smithi057.stderr:45400000 of 50000000 tuples (90%) done (elapsed 79.42 s, remaining 8.05 s) 2023-03-02T10:58:34.720 INFO:teuthology.orchestra.run.smithi057.stderr:45500000 of 50000000 tuples (91%) done (elapsed 79.52 s, remaining 7.87 s) 2023-03-02T10:58:34.869 INFO:teuthology.orchestra.run.smithi057.stderr:45600000 of 50000000 tuples (91%) done (elapsed 79.67 s, remaining 7.69 s) 2023-03-02T10:58:35.022 INFO:teuthology.orchestra.run.smithi057.stderr:45700000 of 50000000 tuples (91%) done (elapsed 79.83 s, remaining 7.51 s) 2023-03-02T10:58:35.139 INFO:teuthology.orchestra.run.smithi057.stderr:45800000 of 50000000 tuples (91%) done (elapsed 79.94 s, remaining 7.33 s) 2023-03-02T10:58:35.276 INFO:teuthology.orchestra.run.smithi057.stderr:45900000 of 50000000 tuples (91%) done (elapsed 80.08 s, remaining 7.15 s) 2023-03-02T10:58:35.431 INFO:teuthology.orchestra.run.smithi057.stderr:46000000 of 50000000 tuples (92%) done (elapsed 80.24 s, remaining 6.98 s) 2023-03-02T10:58:35.531 INFO:teuthology.orchestra.run.smithi057.stderr:46100000 of 50000000 tuples (92%) done (elapsed 80.34 s, remaining 6.80 s) 2023-03-02T10:58:35.652 INFO:teuthology.orchestra.run.smithi057.stderr:46200000 of 50000000 tuples (92%) done (elapsed 80.46 s, remaining 6.62 s) 2023-03-02T10:58:35.731 INFO:teuthology.orchestra.run.smithi057.stderr:46300000 of 50000000 tuples (92%) done (elapsed 80.54 s, remaining 6.44 s) 2023-03-02T10:58:35.892 INFO:teuthology.orchestra.run.smithi057.stderr:46400000 of 50000000 tuples (92%) done (elapsed 80.70 s, remaining 6.26 s) 2023-03-02T10:58:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:35 smithi057 ceph-mon[92072]: pgmap v50: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 20 MiB/s wr, 42 op/s 2023-03-02T10:58:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:35 smithi122 ceph-mon[125440]: pgmap v50: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 20 MiB/s wr, 42 op/s 2023-03-02T10:58:35.979 INFO:teuthology.orchestra.run.smithi057.stderr:46500000 of 50000000 tuples (93%) done (elapsed 80.78 s, remaining 6.08 s) 2023-03-02T10:58:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:35 smithi136 ceph-mon[125702]: pgmap v50: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 20 MiB/s wr, 42 op/s 2023-03-02T10:58:36.117 INFO:teuthology.orchestra.run.smithi057.stderr:46600000 of 50000000 tuples (93%) done (elapsed 80.92 s, remaining 5.90 s) 2023-03-02T10:58:36.238 INFO:teuthology.orchestra.run.smithi057.stderr:46700000 of 50000000 tuples (93%) done (elapsed 81.04 s, remaining 5.73 s) 2023-03-02T10:58:36.353 INFO:teuthology.orchestra.run.smithi057.stderr:46800000 of 50000000 tuples (93%) done (elapsed 81.16 s, remaining 5.55 s) 2023-03-02T10:58:36.476 INFO:teuthology.orchestra.run.smithi057.stderr:46900000 of 50000000 tuples (93%) done (elapsed 81.28 s, remaining 5.37 s) 2023-03-02T10:58:36.600 INFO:teuthology.orchestra.run.smithi057.stderr:47000000 of 50000000 tuples (94%) done (elapsed 81.40 s, remaining 5.20 s) 2023-03-02T10:58:36.733 INFO:teuthology.orchestra.run.smithi057.stderr:47100000 of 50000000 tuples (94%) done (elapsed 81.54 s, remaining 5.02 s) 2023-03-02T10:58:36.829 INFO:teuthology.orchestra.run.smithi057.stderr:47200000 of 50000000 tuples (94%) done (elapsed 81.63 s, remaining 4.84 s) 2023-03-02T10:58:36.943 INFO:teuthology.orchestra.run.smithi057.stderr:47300000 of 50000000 tuples (94%) done (elapsed 81.75 s, remaining 4.67 s) 2023-03-02T10:58:37.061 INFO:teuthology.orchestra.run.smithi057.stderr:47400000 of 50000000 tuples (94%) done (elapsed 81.87 s, remaining 4.49 s) 2023-03-02T10:58:37.179 INFO:teuthology.orchestra.run.smithi057.stderr:47500000 of 50000000 tuples (95%) done (elapsed 81.98 s, remaining 4.31 s) 2023-03-02T10:58:37.317 INFO:teuthology.orchestra.run.smithi057.stderr:47600000 of 50000000 tuples (95%) done (elapsed 82.12 s, remaining 4.14 s) 2023-03-02T10:58:37.401 INFO:teuthology.orchestra.run.smithi057.stderr:47700000 of 50000000 tuples (95%) done (elapsed 82.21 s, remaining 3.96 s) 2023-03-02T10:58:37.545 INFO:teuthology.orchestra.run.smithi057.stderr:47800000 of 50000000 tuples (95%) done (elapsed 82.35 s, remaining 3.79 s) 2023-03-02T10:58:37.675 INFO:teuthology.orchestra.run.smithi057.stderr:47900000 of 50000000 tuples (95%) done (elapsed 82.48 s, remaining 3.62 s) 2023-03-02T10:58:37.775 INFO:teuthology.orchestra.run.smithi057.stderr:48000000 of 50000000 tuples (96%) done (elapsed 82.58 s, remaining 3.44 s) 2023-03-02T10:58:37.916 INFO:teuthology.orchestra.run.smithi057.stderr:48100000 of 50000000 tuples (96%) done (elapsed 82.72 s, remaining 3.27 s) 2023-03-02T10:58:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:37 smithi057 ceph-mon[92072]: pgmap v51: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 20 MiB/s wr, 42 op/s 2023-03-02T10:58:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:37 smithi122 ceph-mon[125440]: pgmap v51: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 20 MiB/s wr, 42 op/s 2023-03-02T10:58:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:48200000 of 50000000 tuples (96%) done (elapsed 82.84 s, remaining 3.09 s) 2023-03-02T10:58:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:37 smithi136 ceph-mon[125702]: pgmap v51: 97 pgs: 97 active+clean; 7.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 20 MiB/s wr, 42 op/s 2023-03-02T10:58:38.151 INFO:teuthology.orchestra.run.smithi057.stderr:48300000 of 50000000 tuples (96%) done (elapsed 82.96 s, remaining 2.92 s) 2023-03-02T10:58:38.265 INFO:teuthology.orchestra.run.smithi057.stderr:48400000 of 50000000 tuples (96%) done (elapsed 83.07 s, remaining 2.75 s) 2023-03-02T10:58:38.406 INFO:teuthology.orchestra.run.smithi057.stderr:48500000 of 50000000 tuples (97%) done (elapsed 83.21 s, remaining 2.57 s) 2023-03-02T10:58:38.527 INFO:teuthology.orchestra.run.smithi057.stderr:48600000 of 50000000 tuples (97%) done (elapsed 83.33 s, remaining 2.40 s) 2023-03-02T10:58:38.650 INFO:teuthology.orchestra.run.smithi057.stderr:48700000 of 50000000 tuples (97%) done (elapsed 83.46 s, remaining 2.23 s) 2023-03-02T10:58:38.770 INFO:teuthology.orchestra.run.smithi057.stderr:48800000 of 50000000 tuples (97%) done (elapsed 83.58 s, remaining 2.06 s) 2023-03-02T10:58:38.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:38 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:58:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:38 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:58:39.085 INFO:teuthology.orchestra.run.smithi057.stderr:48900000 of 50000000 tuples (97%) done (elapsed 83.89 s, remaining 1.89 s) 2023-03-02T10:58:39.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:38 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:58:39.200 INFO:teuthology.orchestra.run.smithi057.stderr:49000000 of 50000000 tuples (98%) done (elapsed 84.00 s, remaining 1.71 s) 2023-03-02T10:58:39.648 INFO:teuthology.orchestra.run.smithi057.stderr:49100000 of 50000000 tuples (98%) done (elapsed 84.45 s, remaining 1.55 s) 2023-03-02T10:58:39.777 INFO:teuthology.orchestra.run.smithi057.stderr:49200000 of 50000000 tuples (98%) done (elapsed 84.58 s, remaining 1.38 s) 2023-03-02T10:58:39.883 INFO:teuthology.orchestra.run.smithi057.stderr:49300000 of 50000000 tuples (98%) done (elapsed 84.69 s, remaining 1.20 s) 2023-03-02T10:58:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:39 smithi122 ceph-mon[125440]: pgmap v52: 97 pgs: 97 active+clean; 7.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 92 MiB/s wr, 77 op/s 2023-03-02T10:58:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:39 smithi136 ceph-mon[125702]: pgmap v52: 97 pgs: 97 active+clean; 7.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 92 MiB/s wr, 77 op/s 2023-03-02T10:58:40.091 INFO:teuthology.orchestra.run.smithi057.stderr:49400000 of 50000000 tuples (98%) done (elapsed 84.90 s, remaining 1.03 s) 2023-03-02T10:58:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:39 smithi057 ceph-mon[92072]: pgmap v52: 97 pgs: 97 active+clean; 7.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 92 MiB/s wr, 77 op/s 2023-03-02T10:58:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:49500000 of 50000000 tuples (99%) done (elapsed 85.02 s, remaining 0.86 s) 2023-03-02T10:58:40.326 INFO:teuthology.orchestra.run.smithi057.stderr:49600000 of 50000000 tuples (99%) done (elapsed 85.13 s, remaining 0.69 s) 2023-03-02T10:58:40.475 INFO:teuthology.orchestra.run.smithi057.stderr:49700000 of 50000000 tuples (99%) done (elapsed 85.28 s, remaining 0.51 s) 2023-03-02T10:58:40.559 INFO:teuthology.orchestra.run.smithi057.stderr:49800000 of 50000000 tuples (99%) done (elapsed 85.36 s, remaining 0.34 s) 2023-03-02T10:58:40.705 INFO:teuthology.orchestra.run.smithi057.stderr:49900000 of 50000000 tuples (99%) done (elapsed 85.51 s, remaining 0.17 s) 2023-03-02T10:58:40.818 INFO:teuthology.orchestra.run.smithi057.stderr:50000000 of 50000000 tuples (100%) done (elapsed 85.62 s, remaining 0.00 s) 2023-03-02T10:58:40.853 INFO:teuthology.orchestra.run.smithi057.stderr:vacuum... 2023-03-02T10:58:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.929+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/1314636824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e1810a0c0 msgr2=0x7f5e1810c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.929+0000 7f5e1f1ff700 1 --2- 172.21.15.57:0/1314636824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e1810a0c0 0x7f5e1810c530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000b0a0 tx=0x7f5e1000b3b0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.929+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/1314636824 shutdown_connections 2023-03-02T10:58:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.929+0000 7f5e1f1ff700 1 --2- 172.21.15.57:0/1314636824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e1810a0c0 0x7f5e1810c530 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.929+0000 7f5e1f1ff700 1 --2- 172.21.15.57:0/1314636824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e18100d80 0x7f5e18101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.929+0000 7f5e1f1ff700 1 --2- 172.21.15.57:0/1314636824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e18101690 0x7f5e18109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.929+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/1314636824 >> 172.21.15.57:0/1314636824 conn(0x7f5e180767e0 msgr2=0x7f5e18076be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.929+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/1314636824 shutdown_connections 2023-03-02T10:58:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.929+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/1314636824 wait complete. 2023-03-02T10:58:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.930+0000 7f5e1f1ff700 1 Processor -- start 2023-03-02T10:58:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.930+0000 7f5e1f1ff700 1 -- start start 2023-03-02T10:58:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e1f1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e18100d80 0x7f5e180fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e1f1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e18101690 0x7f5e180fef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e1f1ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e1810a0c0 0x7f5e181a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e1f1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180ff740 con 0x7f5e18101690 2023-03-02T10:58:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e1f1ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e181a4430 con 0x7f5e1810a0c0 2023-03-02T10:58:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e1f1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e181a4570 con 0x7f5e18100d80 2023-03-02T10:58:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e1cf9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e18100d80 0x7f5e180fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e0ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e18101690 0x7f5e180fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e1cf9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e18100d80 0x7f5e180fe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:45774/0 (socket says 172.21.15.57:45774) 2023-03-02T10:58:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e1cf9b700 1 -- 172.21.15.57:0/980894406 learned_addr learned my addr 172.21.15.57:0/980894406 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e1d79c700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e1810a0c0 0x7f5e181a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e0ffff700 1 -- 172.21.15.57:0/980894406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e18100d80 msgr2=0x7f5e180fe9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e0ffff700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e18100d80 0x7f5e180fe9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e0ffff700 1 -- 172.21.15.57:0/980894406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e1810a0c0 msgr2=0x7f5e181a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e0ffff700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e1810a0c0 0x7f5e181a3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e0ffff700 1 -- 172.21.15.57:0/980894406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e14009520 con 0x7f5e18101690 2023-03-02T10:58:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e18100d80 0x7f5e180fe9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.931+0000 7f5e0ffff700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e18101690 0x7f5e180fef10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800d950 tx=0x7f5e0800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.932+0000 7f5e0dffb700 1 -- 172.21.15.57:0/980894406 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0800f890 con 0x7f5e18101690 2023-03-02T10:58:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.932+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/980894406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e10009d00 con 0x7f5e18101690 2023-03-02T10:58:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.932+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/980894406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1810fbc0 con 0x7f5e18101690 2023-03-02T10:58:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.932+0000 7f5e0dffb700 1 -- 172.21.15.57:0/980894406 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e08010460 con 0x7f5e18101690 2023-03-02T10:58:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.932+0000 7f5e0dffb700 1 -- 172.21.15.57:0/980894406 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0800e610 con 0x7f5e18101690 2023-03-02T10:58:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.935+0000 7f5e0dffb700 1 -- 172.21.15.57:0/980894406 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f5e08022070 con 0x7f5e18101690 2023-03-02T10:58:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.936+0000 7f5e0dffb700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5e0009b480 0x7f5e0009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.936+0000 7f5e0dffb700 1 -- 172.21.15.57:0/980894406 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e080c4bd0 con 0x7f5e18101690 2023-03-02T10:58:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.936+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5e0009b480 0x7f5e0009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e32bdeb80 1 Processor -- start 2023-03-02T10:58:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e32bdeb80 1 -- start start 2023-03-02T10:58:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5e0009b480 0x7f5e0009d930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009fd0 tx=0x7f5e14009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a026da6b0 0x564a02882a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02882fd0 0x564a0287cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02883440 0x564a0287d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a027e4a00 con 0x564a026da6b0 2023-03-02T10:58:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a02796f20 con 0x564a02882fd0 2023-03-02T10:58:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a02767100 con 0x564a02883440 2023-03-02T10:58:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e1d79c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02883440 0x564a0287d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e1cf9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a026da6b0 0x564a02882a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e1d79c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02883440 0x564a0287d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:45786/0 (socket says 172.21.15.57:45786) 2023-03-02T10:58:41.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e1d79c700 1 -- 172.21.15.57:0/1107657196 learned_addr learned my addr 172.21.15.57:0/1107657196 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:41.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.937+0000 7f5e0ffff700 1 --2- 172.21.15.57:0/1107657196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02882fd0 0x564a0287cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.938+0000 7f5e1d79c700 1 -- 172.21.15.57:0/1107657196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02882fd0 msgr2=0x564a0287cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:41.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.938+0000 7f5e1d79c700 1 --2- 172.21.15.57:0/1107657196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02882fd0 0x564a0287cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.938+0000 7f5e1d79c700 1 -- 172.21.15.57:0/1107657196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a026da6b0 msgr2=0x564a02882a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:41.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.938+0000 7f5e1d79c700 1 --2- 172.21.15.57:0/1107657196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a026da6b0 0x564a02882a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.938+0000 7f5e1d79c700 1 -- 172.21.15.57:0/1107657196 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a026515d0 con 0x564a02883440 2023-03-02T10:58:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.938+0000 7f5e1d79c700 1 --2- 172.21.15.57:0/1107657196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02883440 0x564a0287d4c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000b0a0 tx=0x7f5e10009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16d5c3c0fcf6b1dd server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.938+0000 7f5dfeffd700 1 -- 172.21.15.57:0/1107657196 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1000e040 con 0x564a02883440 2023-03-02T10:58:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.938+0000 7f5dfeffd700 1 -- 172.21.15.57:0/1107657196 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e1000bcb0 con 0x564a02883440 2023-03-02T10:58:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.938+0000 7f5dfeffd700 1 -- 172.21.15.57:0/1107657196 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1001c6a0 con 0x564a02883440 2023-03-02T10:58:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.939+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1107657196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02883440 msgr2=0x564a0287d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.939+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/1107657196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02883440 0x564a0287d4c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000b0a0 tx=0x7f5e10009360 comp rx=0 tx=0).stop 2023-03-02T10:58:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.939+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1107657196 shutdown_connections 2023-03-02T10:58:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.939+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/1107657196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02883440 0x564a0287d4c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.939+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/1107657196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a026da6b0 0x564a02882a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.939+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/1107657196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02882fd0 0x564a0287cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.939+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1107657196 >> 172.21.15.57:0/1107657196 conn(0x564a028729a0 msgr2=0x564a02877a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.939+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1107657196 shutdown_connections 2023-03-02T10:58:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.939+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1107657196 wait complete. 2023-03-02T10:58:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.939+0000 7f5e32bdeb80 1 -- start start 2023-03-02T10:58:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e32bdeb80 1 Processor -- start 2023-03-02T10:58:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02889270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02882fd0 0x564a02886560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02883440 0x564a02886b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a027d5b60 con 0x564a02882fd0 2023-03-02T10:58:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a027cf090 con 0x564a02883440 2023-03-02T10:58:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a026538c0 con 0x564a026da6b0 2023-03-02T10:58:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e32bdeb80 10 client.0 _ll_register_callbacks cb 0x564a027754c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e1cf9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02889270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e1cf9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02889270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:45796/0 (socket says 172.21.15.57:45796) 2023-03-02T10:58:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e1cf9b700 1 -- 172.21.15.57:0/2477269547 learned_addr learned my addr 172.21.15.57:0/2477269547 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.940+0000 7f5e0ffff700 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02882fd0 0x564a02886560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5e1d79c700 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02883440 0x564a02886b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5e1cf9b700 1 -- 172.21.15.57:0/2477269547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02883440 msgr2=0x564a02886b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02883440 0x564a02886b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5e1cf9b700 1 -- 172.21.15.57:0/2477269547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02882fd0 msgr2=0x564a02886560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02882fd0 0x564a02886560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5e1cf9b700 1 -- 172.21.15.57:0/2477269547 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1810d1f0 con 0x564a026da6b0 2023-03-02T10:58:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02889270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400fcf0 tx=0x7f5e140047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f265108bc8c8036 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5df7fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:58:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5df7fff700 1 -- 172.21.15.57:0/2477269547 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14022070 con 0x564a026da6b0 2023-03-02T10:58:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/2477269547 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a027a0750 con 0x564a026da6b0 2023-03-02T10:58:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5df7fff700 1 -- 172.21.15.57:0/2477269547 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e1401d9a0 con 0x564a026da6b0 2023-03-02T10:58:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5df7fff700 1 -- 172.21.15.57:0/2477269547 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e1401db60 con 0x564a026da6b0 2023-03-02T10:58:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5e32bdeb80 10 client.25771 fetch_fsmap learned FSMap version 31 2023-03-02T10:58:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.941+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/2477269547 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x564a025fdd80 con 0x564a026da6b0 2023-03-02T10:58:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.942+0000 7f5df7fff700 1 -- 172.21.15.57:0/2477269547 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564a027a0750 con 0x564a026da6b0 2023-03-02T10:58:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.942+0000 7f5df7fff700 1 -- 172.21.15.57:0/2477269547 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f5e1401b400 con 0x564a026da6b0 2023-03-02T10:58:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.942+0000 7f5e32bdeb80 10 client.25771 fetch_fsmap finished waiting for FSMap version 31 2023-03-02T10:58:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.942+0000 7f5e32bdeb80 10 client.25771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.942+0000 7f5e32bdeb80 20 client.25771 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.942+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x564a02896a80 0x564a02898e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.942+0000 7f5e32bdeb80 4 client.25771 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:58:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.942+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/2477269547 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a027c8110 con 0x564a02896a80 2023-03-02T10:58:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.942+0000 7f5e0ffff700 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x564a02896a80 0x564a02898e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5e0ffff700 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x564a02896a80 0x564a02898e90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99a1c4ab30690535 server_cookie=a410bae87c7db630 in_seq=0 out_seq=0 2023-03-02T10:58:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5df7fff700 10 client.25771 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5df7fff700 1 -- 172.21.15.57:0/2477269547 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x564a027c8110 con 0x564a02896a80 2023-03-02T10:58:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5df7fff700 10 client.25771 handle_command_reply: tid=0 2023-03-02T10:58:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5e32bdeb80 1 client.25771 shutdown 2023-03-02T10:58:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/2477269547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 msgr2=0x564a02889270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02889270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400fcf0 tx=0x7f5e140047c0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/2477269547 shutdown_connections 2023-03-02T10:58:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x564a02896a80 0x564a02898e90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02883440 0x564a02886b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02889270 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/2477269547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02882fd0 0x564a02886560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5df7fff700 0 client.25771 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.943+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/2477269547 >> 172.21.15.57:0/2477269547 conn(0x564a028729a0 msgr2=0x564a028771e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.944+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/2477269547 shutdown_connections 2023-03-02T10:58:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.944+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/2477269547 wait complete. 2023-03-02T10:58:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.944+0000 7f5e32bdeb80 20 client.25771 trim_cache size 0 max 16384 2023-03-02T10:58:41.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:41 smithi122 ceph-mon[125440]: pgmap v53: 97 pgs: 97 active+clean; 7.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 92 MiB/s wr, 66 op/s 2023-03-02T10:58:41.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.958+0000 7f5e32bdeb80 1 Processor -- start 2023-03-02T10:58:41.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.958+0000 7f5e32bdeb80 1 -- start start 2023-03-02T10:58:41.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.958+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02883f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.958+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02882fd0 0x564a02888e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.958+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02883440 0x564a0287cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.958+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a02893f60 con 0x564a02882fd0 2023-03-02T10:58:41.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.958+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0287deb0 con 0x564a02883440 2023-03-02T10:58:41.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.958+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a02884ac0 con 0x564a026da6b0 2023-03-02T10:58:41.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5e1cf9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02883f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5e1cf9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02883f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:45802/0 (socket says 172.21.15.57:45802) 2023-03-02T10:58:41.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5e1cf9b700 1 -- 172.21.15.57:0/4204908373 learned_addr learned my addr 172.21.15.57:0/4204908373 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:41.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5e0ffff700 1 --2- 172.21.15.57:0/4204908373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02882fd0 0x564a02888e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5e1d79c700 1 --2- 172.21.15.57:0/4204908373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02883440 0x564a0287cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5e1cf9b700 1 -- 172.21.15.57:0/4204908373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02883440 msgr2=0x564a0287cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/4204908373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02883440 0x564a0287cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5e1cf9b700 1 -- 172.21.15.57:0/4204908373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02882fd0 msgr2=0x564a02888e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/4204908373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02882fd0 0x564a02888e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5e1cf9b700 1 -- 172.21.15.57:0/4204908373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a02796130 con 0x564a026da6b0 2023-03-02T10:58:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/4204908373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02883f50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e14005d60 tx=0x7f5e1401d7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d296d93210e93e4 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5dff7fe700 1 -- 172.21.15.57:0/4204908373 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14022070 con 0x564a026da6b0 2023-03-02T10:58:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.959+0000 7f5dff7fe700 1 -- 172.21.15.57:0/4204908373 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e1401de60 con 0x564a026da6b0 2023-03-02T10:58:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.960+0000 7f5dff7fe700 1 -- 172.21.15.57:0/4204908373 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1401be40 con 0x564a026da6b0 2023-03-02T10:58:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.960+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/4204908373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 msgr2=0x564a02883f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.960+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/4204908373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02883f50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e14005d60 tx=0x7f5e1401d7b0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.960+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/4204908373 shutdown_connections 2023-03-02T10:58:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.960+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/4204908373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a02883440 0x564a0287cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.960+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/4204908373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a026da6b0 0x564a02883f50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.960+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/4204908373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02882fd0 0x564a02888e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.960+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/4204908373 >> 172.21.15.57:0/4204908373 conn(0x564a028729a0 msgr2=0x564a02883840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.960+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/4204908373 shutdown_connections 2023-03-02T10:58:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.960+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/4204908373 wait complete. 2023-03-02T10:58:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e32bdeb80 1 -- start start 2023-03-02T10:58:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e32bdeb80 1 Processor -- start 2023-03-02T10:58:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a026da6b0 0x564a028862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02882fd0 0x564a02884d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e32bdeb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02883440 0x564a02885250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a02886a00 con 0x564a02883440 2023-03-02T10:58:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a02885790 con 0x564a026da6b0 2023-03-02T10:58:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e32bdeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a02885950 con 0x564a02882fd0 2023-03-02T10:58:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e32bdeb80 10 client.0 _ll_register_callbacks cb 0x564a027754c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e0ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02882fd0 0x564a02884d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.969 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e0ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02882fd0 0x564a02884d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:45812/0 (socket says 172.21.15.57:45812) 2023-03-02T10:58:41.969 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e1d79c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02883440 0x564a02885250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.969 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e0ffff700 1 -- 172.21.15.57:0/1437953797 learned_addr learned my addr 172.21.15.57:0/1437953797 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:41.969 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.961+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a026da6b0 0x564a028862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.969 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5e0ffff700 1 -- 172.21.15.57:0/1437953797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a026da6b0 msgr2=0x564a028862c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:41.969 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5e0ffff700 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a026da6b0 0x564a028862c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.969 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5e0ffff700 1 -- 172.21.15.57:0/1437953797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02883440 msgr2=0x564a02885250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5e0ffff700 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02883440 0x564a02885250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5e0ffff700 1 -- 172.21.15.57:0/1437953797 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a025fdd80 con 0x564a02882fd0 2023-03-02T10:58:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5e0ffff700 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02882fd0 0x564a02884d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e08094000 tx=0x7f5e080c27e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5c9bc22a798c0b8 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5df7fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:58:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5df7fff700 1 -- 172.21.15.57:0/1437953797 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08093760 con 0x564a02882fd0 2023-03-02T10:58:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1437953797 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e1000bcb0 con 0x564a02882fd0 2023-03-02T10:58:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5df7fff700 1 -- 172.21.15.57:0/1437953797 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e080a6e40 con 0x564a02882fd0 2023-03-02T10:58:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5df7fff700 1 -- 172.21.15.57:0/1437953797 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e0809b300 con 0x564a02882fd0 2023-03-02T10:58:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5e32bdeb80 10 client.25777 fetch_fsmap learned FSMap version 31 2023-03-02T10:58:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.962+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1437953797 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x564a026241f0 con 0x564a02882fd0 2023-03-02T10:58:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.963+0000 7f5df7fff700 1 -- 172.21.15.57:0/1437953797 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e1000bcb0 con 0x564a02882fd0 2023-03-02T10:58:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.963+0000 7f5df7fff700 1 -- 172.21.15.57:0/1437953797 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f5e080bcb90 con 0x564a02882fd0 2023-03-02T10:58:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.963+0000 7f5e32bdeb80 10 client.25777 fetch_fsmap finished waiting for FSMap version 31 2023-03-02T10:58:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.963+0000 7f5e32bdeb80 10 client.25777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.963+0000 7f5e32bdeb80 20 client.25777 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:41.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.963+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x564a028e95f0 0x564a028eba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:41.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.963+0000 7f5e32bdeb80 4 client.25777 mds_command: new command op to 24560 tid=0[{"prefix": "flush journal"}] 2023-03-02T10:58:41.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.963+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1437953797 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a027c7e30 con 0x564a028e95f0 2023-03-02T10:58:41.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.963+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x564a028e95f0 0x564a028eba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:41.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.963+0000 7f5df7fff700 10 client.25777 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:41.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.963+0000 7f5e1cf9b700 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x564a028e95f0 0x564a028eba00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b15fd8bf51a3b7e server_cookie=9accd21e0ebc8100 in_seq=0 out_seq=0 2023-03-02T10:58:41.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5df7fff700 1 -- 172.21.15.57:0/1437953797 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a027c7e30 con 0x564a028e95f0 2023-03-02T10:58:42.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5df7fff700 10 client.25777 handle_command_reply: tid=0 2023-03-02T10:58:42.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5e32bdeb80 1 client.25777 shutdown 2023-03-02T10:58:42.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1437953797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02882fd0 msgr2=0x564a02884d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:42.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02882fd0 0x564a02884d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e08094000 tx=0x7f5e080c27e0 comp rx=0 tx=0).stop 2023-03-02T10:58:42.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1437953797 shutdown_connections 2023-03-02T10:58:42.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x564a028e95f0 0x564a028eba00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564a02883440 0x564a02885250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5df7fff700 0 client.25777 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a026da6b0 0x564a028862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5e32bdeb80 1 --2- 172.21.15.57:0/1437953797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a02882fd0 0x564a02884d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1437953797 >> 172.21.15.57:0/1437953797 conn(0x564a028729a0 msgr2=0x564a028840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1437953797 shutdown_connections 2023-03-02T10:58:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.997+0000 7f5e32bdeb80 1 -- 172.21.15.57:0/1437953797 wait complete. 2023-03-02T10:58:42.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e32bdeb80 20 client.25777 trim_cache size 0 max 16384 2023-03-02T10:58:42.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:{ 2023-03-02T10:58:42.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "message": "", 2023-03-02T10:58:42.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "return_code": 0 2023-03-02T10:58:42.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:} 2023-03-02T10:58:42.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/980894406 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5e0009b480 msgr2=0x7f5e0009d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:42.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5e0009b480 0x7f5e0009d930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009fd0 tx=0x7f5e14009260 comp rx=0 tx=0).stop 2023-03-02T10:58:42.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/980894406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e18101690 msgr2=0x7f5e180fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:42.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e18101690 0x7f5e180fef10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800d950 tx=0x7f5e0800dc60 comp rx=0 tx=0).stop 2023-03-02T10:58:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/980894406 shutdown_connections 2023-03-02T10:58:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5e0009b480 0x7f5e0009d930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e1810a0c0 0x7f5e181a3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e18100d80 0x7f5e180fe9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 --2- 172.21.15.57:0/980894406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e18101690 0x7f5e180fef10 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/980894406 >> 172.21.15.57:0/980894406 conn(0x7f5e180767e0 msgr2=0x7f5e180fb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/980894406 shutdown_connections 2023-03-02T10:58:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:41.998+0000 7f5e1f1ff700 1 -- 172.21.15.57:0/980894406 wait complete. 2023-03-02T10:58:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:41 smithi136 ceph-mon[125702]: pgmap v53: 97 pgs: 97 active+clean; 7.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 92 MiB/s wr, 66 op/s 2023-03-02T10:58:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:41 smithi057 ceph-mon[92072]: pgmap v53: 97 pgs: 97 active+clean; 7.7 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 92 MiB/s wr, 66 op/s 2023-03-02T10:58:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:43 smithi122 ceph-mon[125440]: pgmap v54: 97 pgs: 97 active+clean; 8.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 164 MiB/s wr, 105 op/s 2023-03-02T10:58:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:43 smithi136 ceph-mon[125702]: pgmap v54: 97 pgs: 97 active+clean; 8.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 164 MiB/s wr, 105 op/s 2023-03-02T10:58:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:43 smithi057 ceph-mon[92072]: pgmap v54: 97 pgs: 97 active+clean; 8.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 164 MiB/s wr, 105 op/s 2023-03-02T10:58:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:45 smithi057 ceph-mon[92072]: pgmap v55: 97 pgs: 97 active+clean; 8.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 144 MiB/s wr, 74 op/s 2023-03-02T10:58:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:45 smithi122 ceph-mon[125440]: pgmap v55: 97 pgs: 97 active+clean; 8.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 144 MiB/s wr, 74 op/s 2023-03-02T10:58:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:45 smithi136 ceph-mon[125702]: pgmap v55: 97 pgs: 97 active+clean; 8.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 144 MiB/s wr, 74 op/s 2023-03-02T10:58:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:47 smithi122 ceph-mon[125440]: pgmap v56: 97 pgs: 97 active+clean; 8.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 144 MiB/s wr, 74 op/s 2023-03-02T10:58:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:47 smithi136 ceph-mon[125702]: pgmap v56: 97 pgs: 97 active+clean; 8.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 144 MiB/s wr, 74 op/s 2023-03-02T10:58:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:47 smithi057 ceph-mon[92072]: pgmap v56: 97 pgs: 97 active+clean; 8.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 144 MiB/s wr, 74 op/s 2023-03-02T10:58:49.943 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:49 smithi057 ceph-mon[92072]: pgmap v57: 97 pgs: 97 active+clean; 9.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 235 MiB/s wr, 126 op/s 2023-03-02T10:58:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:49 smithi122 ceph-mon[125440]: pgmap v57: 97 pgs: 97 active+clean; 9.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 235 MiB/s wr, 126 op/s 2023-03-02T10:58:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:49 smithi136 ceph-mon[125702]: pgmap v57: 97 pgs: 97 active+clean; 9.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 235 MiB/s wr, 126 op/s 2023-03-02T10:58:51.831 INFO:teuthology.orchestra.run.smithi057.stderr:set primary keys... 2023-03-02T10:58:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:51 smithi057 ceph-mon[92072]: pgmap v58: 97 pgs: 97 active+clean; 9.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 164 MiB/s wr, 91 op/s 2023-03-02T10:58:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:51 smithi122 ceph-mon[125440]: pgmap v58: 97 pgs: 97 active+clean; 9.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 164 MiB/s wr, 91 op/s 2023-03-02T10:58:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:51 smithi136 ceph-mon[125702]: pgmap v58: 97 pgs: 97 active+clean; 9.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 164 MiB/s wr, 91 op/s 2023-03-02T10:58:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:53 smithi057 ceph-mon[92072]: pgmap v59: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 396 MiB/s wr, 157 op/s 2023-03-02T10:58:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:53 smithi122 ceph-mon[125440]: pgmap v59: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 396 MiB/s wr, 157 op/s 2023-03-02T10:58:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:53 smithi136 ceph-mon[125702]: pgmap v59: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 396 MiB/s wr, 157 op/s 2023-03-02T10:58:55.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.129+0000 7f2d9edff700 1 -- 172.21.15.57:0/2338308320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d98100d80 msgr2=0x7f2d98101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:55.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.129+0000 7f2d9edff700 1 --2- 172.21.15.57:0/2338308320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d98100d80 0x7f2d98101150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009990 tx=0x7f2d8c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.129+0000 7f2d9edff700 1 -- 172.21.15.57:0/2338308320 shutdown_connections 2023-03-02T10:58:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.129+0000 7f2d9edff700 1 --2- 172.21.15.57:0/2338308320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d9810a0c0 0x7f2d9810c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.129+0000 7f2d9edff700 1 --2- 172.21.15.57:0/2338308320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d98100d80 0x7f2d98101150 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.129+0000 7f2d9edff700 1 --2- 172.21.15.57:0/2338308320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d98101690 0x7f2d98109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.129+0000 7f2d9edff700 1 -- 172.21.15.57:0/2338308320 >> 172.21.15.57:0/2338308320 conn(0x7f2d980767e0 msgr2=0x7f2d98076be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.129+0000 7f2d9edff700 1 -- 172.21.15.57:0/2338308320 shutdown_connections 2023-03-02T10:58:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.129+0000 7f2d9edff700 1 -- 172.21.15.57:0/2338308320 wait complete. 2023-03-02T10:58:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9edff700 1 Processor -- start 2023-03-02T10:58:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9edff700 1 -- start start 2023-03-02T10:58:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9edff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d98100d80 0x7f2d980fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9edff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d98101690 0x7f2d980fef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9edff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d9810a0c0 0x7f2d981a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9edff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980ff740 con 0x7f2d98100d80 2023-03-02T10:58:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9edff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d981a43a0 con 0x7f2d9810a0c0 2023-03-02T10:58:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9edff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d981a44e0 con 0x7f2d98101690 2023-03-02T10:58:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d98100d80 0x7f2d980fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d98100d80 0x7f2d980fe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45376/0 (socket says 172.21.15.57:45376) 2023-03-02T10:58:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d97fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d98101690 0x7f2d980fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/2605473875 learned_addr learned my addr 172.21.15.57:0/2605473875 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.130+0000 7f2d9d39c700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d9810a0c0 0x7f2d981a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/2605473875 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d98101690 msgr2=0x7f2d980fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d98101690 0x7f2d980fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/2605473875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d9810a0c0 msgr2=0x7f2d981a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d9810a0c0 0x7f2d981a3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/2605473875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d84009520 con 0x7f2d98100d80 2023-03-02T10:58:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d97fff700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d98101690 0x7f2d980fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d98100d80 0x7f2d980fe9d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c000c00 tx=0x7f2d8c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d95ffb700 1 -- 172.21.15.57:0/2605473875 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c01d070 con 0x7f2d98100d80 2023-03-02T10:58:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d9edff700 1 -- 172.21.15.57:0/2605473875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c0095f0 con 0x7f2d98100d80 2023-03-02T10:58:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d95ffb700 1 -- 172.21.15.57:0/2605473875 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d8c021410 con 0x7f2d98100d80 2023-03-02T10:58:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d95ffb700 1 -- 172.21.15.57:0/2605473875 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c017650 con 0x7f2d98100d80 2023-03-02T10:58:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.131+0000 7f2d9edff700 1 -- 172.21.15.57:0/2605473875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9810fb70 con 0x7f2d98100d80 2023-03-02T10:58:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.134+0000 7f2d95ffb700 1 -- 172.21.15.57:0/2605473875 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f2d8c028030 con 0x7f2d98100d80 2023-03-02T10:58:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.135+0000 7f2d95ffb700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f2d8809b480 0x7f2d8809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.135+0000 7f2d95ffb700 1 -- 172.21.15.57:0/2605473875 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2d8c0c6370 con 0x7f2d98100d80 2023-03-02T10:58:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.135+0000 7f2d97fff700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f2d8809b480 0x7f2d8809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.135+0000 7f2db2638b80 1 Processor -- start 2023-03-02T10:58:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2db2638b80 1 -- start start 2023-03-02T10:58:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2d97fff700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f2d8809b480 0x7f2d8809d930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009fd0 tx=0x7f2d84009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41bcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41bd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2db2638b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed4124a00 con 0x560ed401a6b0 2023-03-02T10:58:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2db2638b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed40d6f20 con 0x560ed41c2fd0 2023-03-02T10:58:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2db2638b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed40a7100 con 0x560ed41c3440 2023-03-02T10:58:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2d9cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2d9d39c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41bd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2d9cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41c2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45392/0 (socket says 172.21.15.57:45392) 2023-03-02T10:58:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/269572577 learned_addr learned my addr 172.21.15.57:0/269572577 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2d97fff700 1 --2- 172.21.15.57:0/269572577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41bcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2d9d39c700 1 -- 172.21.15.57:0/269572577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 msgr2=0x560ed41bcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2d9d39c700 1 --2- 172.21.15.57:0/269572577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41bcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2d9d39c700 1 -- 172.21.15.57:0/269572577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 msgr2=0x560ed41c2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.136+0000 7f2d9d39c700 1 --2- 172.21.15.57:0/269572577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41c2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.137+0000 7f2d9d39c700 1 -- 172.21.15.57:0/269572577 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ed3f915d0 con 0x560ed41c3440 2023-03-02T10:58:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.137+0000 7f2d9d39c700 1 --2- 172.21.15.57:0/269572577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41bd4c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d98100ae0 tx=0x7f2d90009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a0e42a1d45cadb server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.137+0000 7f2d82ffd700 1 -- 172.21.15.57:0/269572577 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90019070 con 0x560ed41c3440 2023-03-02T10:58:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.137+0000 7f2d82ffd700 1 -- 172.21.15.57:0/269572577 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d9000f040 con 0x560ed41c3440 2023-03-02T10:58:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.137+0000 7f2d82ffd700 1 -- 172.21.15.57:0/269572577 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d900078d0 con 0x560ed41c3440 2023-03-02T10:58:55.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.138+0000 7f2db2638b80 1 -- 172.21.15.57:0/269572577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 msgr2=0x560ed41bd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:55.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.138+0000 7f2db2638b80 1 --2- 172.21.15.57:0/269572577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41bd4c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d98100ae0 tx=0x7f2d90009ba0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.138+0000 7f2db2638b80 1 -- 172.21.15.57:0/269572577 shutdown_connections 2023-03-02T10:58:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.138+0000 7f2db2638b80 1 --2- 172.21.15.57:0/269572577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41bd4c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.138+0000 7f2db2638b80 1 --2- 172.21.15.57:0/269572577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41c2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.138+0000 7f2db2638b80 1 --2- 172.21.15.57:0/269572577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41bcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.138+0000 7f2db2638b80 1 -- 172.21.15.57:0/269572577 >> 172.21.15.57:0/269572577 conn(0x560ed41b29a0 msgr2=0x560ed41b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.138+0000 7f2db2638b80 1 -- 172.21.15.57:0/269572577 shutdown_connections 2023-03-02T10:58:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.138+0000 7f2db2638b80 1 -- 172.21.15.57:0/269572577 wait complete. 2023-03-02T10:58:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.138+0000 7f2db2638b80 1 -- start start 2023-03-02T10:58:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2db2638b80 1 Processor -- start 2023-03-02T10:58:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2db2638b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed4115b60 con 0x560ed401a6b0 2023-03-02T10:58:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2db2638b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed410f090 con 0x560ed41c2fd0 2023-03-02T10:58:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2db2638b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed3f938c0 con 0x560ed41c3440 2023-03-02T10:58:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2db2638b80 10 client.0 _ll_register_callbacks cb 0x560ed40b54c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2d9cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2d9d39c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2d9cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45394/0 (socket says 172.21.15.57:45394) 2023-03-02T10:58:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/688388551 learned_addr learned my addr 172.21.15.57:0/688388551 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.139+0000 7f2d97fff700 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/688388551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 msgr2=0x560ed41c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/688388551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 msgr2=0x560ed41c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/688388551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d90003ae0 con 0x560ed401a6b0 2023-03-02T10:58:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2d9d39c700 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41c92f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0955a0 tx=0x7f2d8c021ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee900302a72eed10 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2d77fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:58:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2d77fff700 1 -- 172.21.15.57:0/688388551 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c09b0d0 con 0x560ed401a6b0 2023-03-02T10:58:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2d77fff700 1 -- 172.21.15.57:0/688388551 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2d8c0958a0 con 0x560ed401a6b0 2023-03-02T10:58:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2db2638b80 1 -- 172.21.15.57:0/688388551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ed40e0750 con 0x560ed401a6b0 2023-03-02T10:58:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2d77fff700 1 -- 172.21.15.57:0/688388551 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d8c09cf30 con 0x560ed401a6b0 2023-03-02T10:58:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2db2638b80 10 client.15990 fetch_fsmap learned FSMap version 31 2023-03-02T10:58:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.140+0000 7f2db2638b80 1 -- 172.21.15.57:0/688388551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560ed3f3dd80 con 0x560ed401a6b0 2023-03-02T10:58:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.141+0000 7f2d77fff700 1 -- 172.21.15.57:0/688388551 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560ed40e0750 con 0x560ed401a6b0 2023-03-02T10:58:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.141+0000 7f2d77fff700 1 -- 172.21.15.57:0/688388551 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f2d8c09caa0 con 0x560ed401a6b0 2023-03-02T10:58:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.141+0000 7f2db2638b80 10 client.15990 fetch_fsmap finished waiting for FSMap version 31 2023-03-02T10:58:55.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.141+0000 7f2db2638b80 10 client.15990 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:55.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.141+0000 7f2db2638b80 20 client.15990 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:55.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.141+0000 7f2db2638b80 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x560ed41d6690 0x560ed41d8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.141+0000 7f2db2638b80 4 client.15990 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:58:55.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.141+0000 7f2db2638b80 1 -- 172.21.15.57:0/688388551 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ed4108110 con 0x560ed41d6690 2023-03-02T10:58:55.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.141+0000 7f2d97fff700 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x560ed41d6690 0x560ed41d8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2d77fff700 10 client.15990 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2d97fff700 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x560ed41d6690 0x560ed41d8aa0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f30099b08cd589ea server_cookie=f71b17744ad934c8 in_seq=0 out_seq=0 2023-03-02T10:58:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2d77fff700 1 -- 172.21.15.57:0/688388551 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x560ed4108110 con 0x560ed41d6690 2023-03-02T10:58:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2d77fff700 10 client.15990 handle_command_reply: tid=0 2023-03-02T10:58:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2db2638b80 1 client.15990 shutdown 2023-03-02T10:58:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2db2638b80 1 -- 172.21.15.57:0/688388551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 msgr2=0x560ed41c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2db2638b80 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41c92f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0955a0 tx=0x7f2d8c021ad0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2db2638b80 1 -- 172.21.15.57:0/688388551 shutdown_connections 2023-03-02T10:58:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2db2638b80 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x560ed41d6690 0x560ed41d8aa0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2db2638b80 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2db2638b80 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41c92f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2d77fff700 0 client.15990 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.142+0000 7f2db2638b80 1 --2- 172.21.15.57:0/688388551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.143+0000 7f2db2638b80 1 -- 172.21.15.57:0/688388551 >> 172.21.15.57:0/688388551 conn(0x560ed41b29a0 msgr2=0x560ed41b71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.143+0000 7f2db2638b80 1 -- 172.21.15.57:0/688388551 shutdown_connections 2023-03-02T10:58:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.143+0000 7f2db2638b80 1 -- 172.21.15.57:0/688388551 wait complete. 2023-03-02T10:58:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.143+0000 7f2db2638b80 20 client.15990 trim_cache size 0 max 16384 2023-03-02T10:58:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.170+0000 7f2db2638b80 1 Processor -- start 2023-03-02T10:58:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.170+0000 7f2db2638b80 1 -- start start 2023-03-02T10:58:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.170+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed401a6b0 0x560ed41c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.170+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.170+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed41c3440 0x560ed41c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.170+0000 7f2db2638b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed41bdf10 con 0x560ed41c3440 2023-03-02T10:58:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.170+0000 7f2db2638b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed41b9440 con 0x560ed41c2fd0 2023-03-02T10:58:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.170+0000 7f2db2638b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed41c2a90 con 0x560ed401a6b0 2023-03-02T10:58:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d9cb9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed401a6b0 0x560ed41c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d97fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d97fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:46276/0 (socket says 172.21.15.57:46276) 2023-03-02T10:58:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d9cb9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed401a6b0 0x560ed41c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:46226/0 (socket says 172.21.15.57:46226) 2023-03-02T10:58:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d97fff700 1 -- 172.21.15.57:0/2256700106 learned_addr learned my addr 172.21.15.57:0/2256700106 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d9d39c700 1 --2- 172.21.15.57:0/2256700106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed41c3440 0x560ed41c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/2256700106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 msgr2=0x560ed41c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/2256700106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/2256700106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed41c3440 msgr2=0x560ed41c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/2256700106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed41c3440 0x560ed41c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/2256700106 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ed40d6130 con 0x560ed401a6b0 2023-03-02T10:58:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d97fff700 1 --2- 172.21.15.57:0/2256700106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/2256700106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed401a6b0 0x560ed41c3f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c021b40 tx=0x7f2d8c091d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2983756b45165fcf server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:55.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.171+0000 7f2d837fe700 1 -- 172.21.15.57:0/2256700106 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c09b0d0 con 0x560ed401a6b0 2023-03-02T10:58:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.172+0000 7f2d837fe700 1 -- 172.21.15.57:0/2256700106 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d8c021e90 con 0x560ed401a6b0 2023-03-02T10:58:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.172+0000 7f2d837fe700 1 -- 172.21.15.57:0/2256700106 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c00fd10 con 0x560ed401a6b0 2023-03-02T10:58:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.172+0000 7f2db2638b80 1 -- 172.21.15.57:0/2256700106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed401a6b0 msgr2=0x560ed41c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.172+0000 7f2db2638b80 1 --2- 172.21.15.57:0/2256700106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed401a6b0 0x560ed41c3f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c021b40 tx=0x7f2d8c091d10 comp rx=0 tx=0).stop 2023-03-02T10:58:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.172+0000 7f2db2638b80 1 -- 172.21.15.57:0/2256700106 shutdown_connections 2023-03-02T10:58:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.172+0000 7f2db2638b80 1 --2- 172.21.15.57:0/2256700106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed41c3440 0x560ed41c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.172+0000 7f2db2638b80 1 --2- 172.21.15.57:0/2256700106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed401a6b0 0x560ed41c3f50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.172+0000 7f2db2638b80 1 --2- 172.21.15.57:0/2256700106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.172+0000 7f2db2638b80 1 -- 172.21.15.57:0/2256700106 >> 172.21.15.57:0/2256700106 conn(0x560ed41b29a0 msgr2=0x560ed41c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.172+0000 7f2db2638b80 1 -- 172.21.15.57:0/2256700106 shutdown_connections 2023-03-02T10:58:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.172+0000 7f2db2638b80 1 -- 172.21.15.57:0/2256700106 wait complete. 2023-03-02T10:58:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2db2638b80 1 -- start start 2023-03-02T10:58:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2db2638b80 1 Processor -- start 2023-03-02T10:58:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41be510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2db2638b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2db2638b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed41bf850 con 0x560ed401a6b0 2023-03-02T10:58:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2db2638b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed41bf9c0 con 0x560ed41c2fd0 2023-03-02T10:58:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2db2638b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed41bfb80 con 0x560ed41c3440 2023-03-02T10:58:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2db2638b80 10 client.0 _ll_register_callbacks cb 0x560ed40b54c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2d9cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41be510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2d9cb9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41be510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45416/0 (socket says 172.21.15.57:45416) 2023-03-02T10:58:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/339439231 learned_addr learned my addr 172.21.15.57:0/339439231 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.173+0000 7f2d9d39c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d97fff700 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/339439231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 msgr2=0x560ed41bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/339439231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 msgr2=0x560ed41bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41bea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d9cb9b700 1 -- 172.21.15.57:0/339439231 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d84017050 con 0x560ed401a6b0 2023-03-02T10:58:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d9d39c700 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d9cb9b700 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41be510 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c09cea0 tx=0x7f2d8c0952b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a50af2a24f7277f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d77fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:58:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d77fff700 1 -- 172.21.15.57:0/339439231 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0958a0 con 0x560ed401a6b0 2023-03-02T10:58:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d77fff700 1 -- 172.21.15.57:0/339439231 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2d8c09cf30 con 0x560ed401a6b0 2023-03-02T10:58:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2db2638b80 1 -- 172.21.15.57:0/339439231 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d9000f040 con 0x560ed401a6b0 2023-03-02T10:58:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2d77fff700 1 -- 172.21.15.57:0/339439231 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d8c09caa0 con 0x560ed401a6b0 2023-03-02T10:58:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2db2638b80 10 client.15996 fetch_fsmap learned FSMap version 31 2023-03-02T10:58:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.174+0000 7f2db2638b80 1 -- 172.21.15.57:0/339439231 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560ed3f3dd80 con 0x560ed401a6b0 2023-03-02T10:58:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.175+0000 7f2d77fff700 1 -- 172.21.15.57:0/339439231 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d9000f040 con 0x560ed401a6b0 2023-03-02T10:58:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.175+0000 7f2d77fff700 1 -- 172.21.15.57:0/339439231 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f2d8c094800 con 0x560ed401a6b0 2023-03-02T10:58:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.175+0000 7f2db2638b80 10 client.15996 fetch_fsmap finished waiting for FSMap version 31 2023-03-02T10:58:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.175+0000 7f2db2638b80 10 client.15996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.175+0000 7f2db2638b80 20 client.15996 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.175+0000 7f2db2638b80 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x560ed4228920 0x560ed422ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.175+0000 7f2db2638b80 4 client.15996 mds_command: new command op to 24560 tid=0[{"prefix": "flush journal"}] 2023-03-02T10:58:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.175+0000 7f2db2638b80 1 -- 172.21.15.57:0/339439231 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560ed4107e30 con 0x560ed4228920 2023-03-02T10:58:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.175+0000 7f2d97fff700 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x560ed4228920 0x560ed422ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.176+0000 7f2d97fff700 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x560ed4228920 0x560ed422ad00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e634b8bf85cb2420 server_cookie=aca9c66cc99f9f29 in_seq=0 out_seq=0 2023-03-02T10:58:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.176+0000 7f2d77fff700 10 client.15996 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2d77fff700 1 -- 172.21.15.57:0/339439231 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560ed4107e30 con 0x560ed4228920 2023-03-02T10:58:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2d77fff700 10 client.15996 handle_command_reply: tid=0 2023-03-02T10:58:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 1 client.15996 shutdown 2023-03-02T10:58:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 1 -- 172.21.15.57:0/339439231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 msgr2=0x560ed41be510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41be510 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c09cea0 tx=0x7f2d8c0952b0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 1 -- 172.21.15.57:0/339439231 shutdown_connections 2023-03-02T10:58:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x560ed4228920 0x560ed422ad00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560ed41c3440 0x560ed41bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2d77fff700 0 client.15996 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560ed401a6b0 0x560ed41be510 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 1 --2- 172.21.15.57:0/339439231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ed41c2fd0 0x560ed41bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 1 -- 172.21.15.57:0/339439231 >> 172.21.15.57:0/339439231 conn(0x560ed41b29a0 msgr2=0x560ed41c15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 1 -- 172.21.15.57:0/339439231 shutdown_connections 2023-03-02T10:58:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 1 -- 172.21.15.57:0/339439231 wait complete. 2023-03-02T10:58:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.189+0000 7f2db2638b80 20 client.15996 trim_cache size 0 max 16384 2023-03-02T10:58:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:{ 2023-03-02T10:58:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "message": "", 2023-03-02T10:58:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout: "return_code": 0 2023-03-02T10:58:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stdout:} 2023-03-02T10:58:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 -- 172.21.15.57:0/2605473875 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f2d8809b480 msgr2=0x7f2d8809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f2d8809b480 0x7f2d8809d930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009fd0 tx=0x7f2d84009260 comp rx=0 tx=0).stop 2023-03-02T10:58:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 -- 172.21.15.57:0/2605473875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d98100d80 msgr2=0x7f2d980fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d98100d80 0x7f2d980fe9d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c000c00 tx=0x7f2d8c0047b0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 -- 172.21.15.57:0/2605473875 shutdown_connections 2023-03-02T10:58:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f2d8809b480 0x7f2d8809d930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d9810a0c0 0x7f2d981a3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d98100d80 0x7f2d980fe9d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 --2- 172.21.15.57:0/2605473875 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d98101690 0x7f2d980fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 -- 172.21.15.57:0/2605473875 >> 172.21.15.57:0/2605473875 conn(0x7f2d980767e0 msgr2=0x7f2d98101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 -- 172.21.15.57:0/2605473875 shutdown_connections 2023-03-02T10:58:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:58:55.190+0000 7f2d9edff700 1 -- 172.21.15.57:0/2605473875 wait complete. 2023-03-02T10:58:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:55 smithi057 ceph-mon[92072]: pgmap v60: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 324 MiB/s wr, 117 op/s 2023-03-02T10:58:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:55 smithi122 ceph-mon[125440]: pgmap v60: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 324 MiB/s wr, 117 op/s 2023-03-02T10:58:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:55 smithi136 ceph-mon[125702]: pgmap v60: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 324 MiB/s wr, 117 op/s 2023-03-02T10:58:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:57 smithi057 ceph-mon[92072]: pgmap v61: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 324 MiB/s wr, 117 op/s 2023-03-02T10:58:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:57 smithi122 ceph-mon[125440]: pgmap v61: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 324 MiB/s wr, 117 op/s 2023-03-02T10:58:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:57 smithi136 ceph-mon[125702]: pgmap v61: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 324 MiB/s wr, 117 op/s 2023-03-02T10:58:58.850 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T10:58:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.142+0000 7f01c47ff700 1 -- 172.21.15.57:0/1838147649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01bc1049c0 msgr2=0x7f01bc104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.142+0000 7f01c47ff700 1 --2- 172.21.15.57:0/1838147649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01bc1049c0 0x7f01bc104d90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009990 tx=0x7f01b8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.142+0000 7f01c47ff700 1 -- 172.21.15.57:0/1838147649 shutdown_connections 2023-03-02T10:58:59.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.142+0000 7f01c47ff700 1 --2- 172.21.15.57:0/1838147649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01bc0ff360 0x7f01bc10b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.142+0000 7f01c47ff700 1 --2- 172.21.15.57:0/1838147649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01bc1049c0 0x7f01bc104d90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.142+0000 7f01c47ff700 1 --2- 172.21.15.57:0/1838147649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc0fe9b0 0x7f01bc0fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.142+0000 7f01c47ff700 1 -- 172.21.15.57:0/1838147649 >> 172.21.15.57:0/1838147649 conn(0x7f01bc0fa4b0 msgr2=0x7f01bc0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:59.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.142+0000 7f01c47ff700 1 -- 172.21.15.57:0/1838147649 shutdown_connections 2023-03-02T10:58:59.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.142+0000 7f01c47ff700 1 -- 172.21.15.57:0/1838147649 wait complete. 2023-03-02T10:58:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.143+0000 7f01c47ff700 1 Processor -- start 2023-03-02T10:58:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.143+0000 7f01c47ff700 1 -- start start 2023-03-02T10:58:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.143+0000 7f01c47ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01bc0fe9b0 0x7f01bc19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.143+0000 7f01c47ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc0ff360 0x7f01bc19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c47ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01bc1049c0 0x7f01bc1959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c47ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc196030 con 0x7f01bc1049c0 2023-03-02T10:58:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c47ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc1961a0 con 0x7f01bc0ff360 2023-03-02T10:58:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c47ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc196360 con 0x7f01bc0fe9b0 2023-03-02T10:58:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c259b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01bc0fe9b0 0x7f01bc19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c259b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01bc0fe9b0 0x7f01bc19b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48128/0 (socket says 172.21.15.57:48128) 2023-03-02T10:58:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c259b700 1 -- 172.21.15.57:0/2787158643 learned_addr learned my addr 172.21.15.57:0/2787158643 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c2d9c700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01bc1049c0 0x7f01bc1959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc0ff360 0x7f01bc19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c259b700 1 -- 172.21.15.57:0/2787158643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc0ff360 msgr2=0x7f01bc19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c259b700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc0ff360 0x7f01bc19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c259b700 1 -- 172.21.15.57:0/2787158643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01bc1049c0 msgr2=0x7f01bc1959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c259b700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01bc1049c0 0x7f01bc1959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c259b700 1 -- 172.21.15.57:0/2787158643 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac009520 con 0x7f01bc0fe9b0 2023-03-02T10:58:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01c259b700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01bc0fe9b0 0x7f01bc19b950 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f01b8000c00 tx=0x7f01b8005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.144+0000 7f01b37fe700 1 -- 172.21.15.57:0/2787158643 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b801d070 con 0x7f01bc0fe9b0 2023-03-02T10:58:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.145+0000 7f01c47ff700 1 -- 172.21.15.57:0/2787158643 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b80095f0 con 0x7f01bc0fe9b0 2023-03-02T10:58:59.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.145+0000 7f01b37fe700 1 -- 172.21.15.57:0/2787158643 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01b8022470 con 0x7f01bc0fe9b0 2023-03-02T10:58:59.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.145+0000 7f01b37fe700 1 -- 172.21.15.57:0/2787158643 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8017670 con 0x7f01bc0fe9b0 2023-03-02T10:58:59.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.145+0000 7f01c47ff700 1 -- 172.21.15.57:0/2787158643 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc10e9f0 con 0x7f01bc0fe9b0 2023-03-02T10:58:59.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.148+0000 7f01b37fe700 1 -- 172.21.15.57:0/2787158643 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f01b8029030 con 0x7f01bc0fe9b0 2023-03-02T10:58:59.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.149+0000 7f01b37fe700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01a809b480 0x7f01a809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.149+0000 7f01b37fe700 1 -- 172.21.15.57:0/2787158643 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f01b80c6250 con 0x7f01bc0fe9b0 2023-03-02T10:58:59.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.149+0000 7f01d8031b80 1 Processor -- start 2023-03-02T10:58:59.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.149+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01a809b480 0x7f01a809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.149+0000 7f01d8031b80 1 -- start start 2023-03-02T10:58:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd03c0 0x5565a1fd0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fd4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 0x5565a1fd5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01d8031b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a1f37a60 con 0x5565a1fd03c0 2023-03-02T10:58:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01d8031b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a1ee9f80 con 0x5565a1fd0cd0 2023-03-02T10:58:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01d8031b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a1eba160 con 0x5565a1fd5110 2023-03-02T10:58:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01c259b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd03c0 0x5565a1fd0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01c259b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd03c0 0x5565a1fd0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40770/0 (socket says 172.21.15.57:40770) 2023-03-02T10:58:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01c259b700 1 -- 172.21.15.57:0/573117046 learned_addr learned my addr 172.21.15.57:0/573117046 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01c2d9c700 1 --2- 172.21.15.57:0/573117046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 0x5565a1fd5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01a809b480 0x7f01a809d930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0fdf20 tx=0x7f01ac009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/573117046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fd4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01c259b700 1 -- 172.21.15.57:0/573117046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 msgr2=0x5565a1fd5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:59.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01c259b700 1 --2- 172.21.15.57:0/573117046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 0x5565a1fd5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01c259b700 1 -- 172.21.15.57:0/573117046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 msgr2=0x5565a1fd4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:59.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01c259b700 1 --2- 172.21.15.57:0/573117046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fd4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.150+0000 7f01c259b700 1 -- 172.21.15.57:0/573117046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565a1da4630 con 0x5565a1fd03c0 2023-03-02T10:58:59.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.151+0000 7f01c259b700 1 --2- 172.21.15.57:0/573117046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd03c0 0x5565a1fd0790 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009350 tx=0x7f01b8091480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e617ae08a3a90b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:59.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.151+0000 7f01b0ff9700 1 -- 172.21.15.57:0/573117046 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8095ee0 con 0x5565a1fd03c0 2023-03-02T10:58:59.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.151+0000 7f01b0ff9700 1 -- 172.21.15.57:0/573117046 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01b80957e0 con 0x5565a1fd03c0 2023-03-02T10:58:59.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.151+0000 7f01b0ff9700 1 -- 172.21.15.57:0/573117046 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8095ca0 con 0x5565a1fd03c0 2023-03-02T10:58:59.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.151+0000 7f01d8031b80 1 -- 172.21.15.57:0/573117046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd03c0 msgr2=0x5565a1fd0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:59.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.151+0000 7f01d8031b80 1 --2- 172.21.15.57:0/573117046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd03c0 0x5565a1fd0790 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009350 tx=0x7f01b8091480 comp rx=0 tx=0).stop 2023-03-02T10:58:59.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.152+0000 7f01d8031b80 1 -- 172.21.15.57:0/573117046 shutdown_connections 2023-03-02T10:58:59.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.152+0000 7f01d8031b80 1 --2- 172.21.15.57:0/573117046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 0x5565a1fd5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.152+0000 7f01d8031b80 1 --2- 172.21.15.57:0/573117046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd03c0 0x5565a1fd0790 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.152+0000 7f01d8031b80 1 --2- 172.21.15.57:0/573117046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fd4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.152+0000 7f01d8031b80 1 -- 172.21.15.57:0/573117046 >> 172.21.15.57:0/573117046 conn(0x5565a1fc5c50 msgr2=0x5565a1fcb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:59.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.152+0000 7f01d8031b80 1 -- 172.21.15.57:0/573117046 shutdown_connections 2023-03-02T10:58:59.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.152+0000 7f01d8031b80 1 -- 172.21.15.57:0/573117046 wait complete. 2023-03-02T10:58:59.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.152+0000 7f01d8031b80 1 -- start start 2023-03-02T10:58:59.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.152+0000 7f01d8031b80 1 Processor -- start 2023-03-02T10:58:59.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fdc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fd9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd5110 0x5565a1fda0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01d8031b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a1f28bc0 con 0x5565a1fd5110 2023-03-02T10:58:59.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01d8031b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a1f220f0 con 0x5565a1fd0cd0 2023-03-02T10:58:59.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01d8031b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a1da6920 con 0x5565a1fd03c0 2023-03-02T10:58:59.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01d8031b80 10 client.0 _ll_register_callbacks cb 0x5565a1ec8520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:59.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c259b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fdc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c2d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd5110 0x5565a1fda0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c259b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fdc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48144/0 (socket says 172.21.15.57:48144) 2023-03-02T10:58:59.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c259b700 1 -- 172.21.15.57:0/3098153955 learned_addr learned my addr 172.21.15.57:0/3098153955 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:59.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fd9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c259b700 1 -- 172.21.15.57:0/3098153955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 msgr2=0x5565a1fd9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:59.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c259b700 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fd9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c259b700 1 -- 172.21.15.57:0/3098153955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd5110 msgr2=0x5565a1fda0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:59.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c259b700 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd5110 0x5565a1fda0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c259b700 1 -- 172.21.15.57:0/3098153955 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc10e9f0 con 0x5565a1fd03c0 2023-03-02T10:58:59.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fd9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:58:59.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.153+0000 7f01c259b700 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fdc8a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f01b8095770 tx=0x7f01b8095fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc290e4786301913 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:59.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:58:59.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01a5ffb700 1 -- 172.21.15.57:0/3098153955 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8095a40 con 0x5565a1fd03c0 2023-03-02T10:58:59.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01d8031b80 1 -- 172.21.15.57:0/3098153955 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565a1ef37b0 con 0x5565a1fd03c0 2023-03-02T10:58:59.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01a5ffb700 1 -- 172.21.15.57:0/3098153955 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f01b80c6070 con 0x5565a1fd03c0 2023-03-02T10:58:59.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01a5ffb700 1 -- 172.21.15.57:0/3098153955 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01b8095ba0 con 0x5565a1fd03c0 2023-03-02T10:58:59.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01d8031b80 10 client.25807 fetch_fsmap learned FSMap version 31 2023-03-02T10:58:59.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01d8031b80 1 -- 172.21.15.57:0/3098153955 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5565a1d50de0 con 0x5565a1fd03c0 2023-03-02T10:58:59.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01a5ffb700 1 -- 172.21.15.57:0/3098153955 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01b80a2080 con 0x5565a1fd03c0 2023-03-02T10:58:59.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01a5ffb700 1 -- 172.21.15.57:0/3098153955 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f01b80948e0 con 0x5565a1fd03c0 2023-03-02T10:58:59.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01d8031b80 10 client.25807 fetch_fsmap finished waiting for FSMap version 31 2023-03-02T10:58:59.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01d8031b80 10 client.25807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:59.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01d8031b80 20 client.25807 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:59.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01d8031b80 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5565a1fedef0 0x5565a1ff0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01d8031b80 4 client.25807 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:58:59.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.154+0000 7f01d8031b80 1 -- 172.21.15.57:0/3098153955 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565a1f1b170 con 0x5565a1fedef0 2023-03-02T10:58:59.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.155+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5565a1fedef0 0x5565a1ff0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.155+0000 7f01a5ffb700 10 client.25807 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:59.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.155+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5565a1fedef0 0x5565a1ff0300 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88c7048560d973b server_cookie=3a1f6412dd496569 in_seq=0 out_seq=0 2023-03-02T10:58:59.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01a5ffb700 1 -- 172.21.15.57:0/3098153955 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5565a1f1b170 con 0x5565a1fedef0 2023-03-02T10:58:59.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01a5ffb700 10 client.25807 handle_command_reply: tid=0 2023-03-02T10:58:59.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 1 client.25807 shutdown 2023-03-02T10:58:59.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 1 -- 172.21.15.57:0/3098153955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 msgr2=0x5565a1fdc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:59.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fdc8a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f01b8095770 tx=0x7f01b8095fd0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 1 -- 172.21.15.57:0/3098153955 shutdown_connections 2023-03-02T10:58:59.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5565a1fedef0 0x5565a1ff0300 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd5110 0x5565a1fda0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01a5ffb700 0 client.25807 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:59.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fdc8a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 1 --2- 172.21.15.57:0/3098153955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fd9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 1 -- 172.21.15.57:0/3098153955 >> 172.21.15.57:0/3098153955 conn(0x5565a1fc5c50 msgr2=0x5565a1fcb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:59.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 1 -- 172.21.15.57:0/3098153955 shutdown_connections 2023-03-02T10:58:59.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 1 -- 172.21.15.57:0/3098153955 wait complete. 2023-03-02T10:58:59.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.156+0000 7f01d8031b80 20 client.25807 trim_cache size 0 max 16384 2023-03-02T10:58:59.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01d8031b80 1 Processor -- start 2023-03-02T10:58:59.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01d8031b80 1 -- start start 2023-03-02T10:58:59.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd03c0 0x5565a1fdc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd0cd0 0x5565a1fe9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 0x5565a1fe9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01d8031b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a1fdaf40 con 0x5565a1fd0cd0 2023-03-02T10:58:59.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01d8031b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a1ff0960 con 0x5565a1fd03c0 2023-03-02T10:58:59.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01d8031b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a1ff4e70 con 0x5565a1fd5110 2023-03-02T10:58:59.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01c2d9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 0x5565a1fe9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01c1d9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd0cd0 0x5565a1fe9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01c2d9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 0x5565a1fe9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48156/0 (socket says 172.21.15.57:48156) 2023-03-02T10:58:59.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.173+0000 7f01c2d9c700 1 -- 172.21.15.57:0/3191874993 learned_addr learned my addr 172.21.15.57:0/3191874993 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:59.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.174+0000 7f01c259b700 1 --2- 172.21.15.57:0/3191874993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd03c0 0x5565a1fdc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.174+0000 7f01c1d9a700 1 -- 172.21.15.57:0/3191874993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 msgr2=0x5565a1fe9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:59.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.174+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/3191874993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 0x5565a1fe9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.174+0000 7f01c1d9a700 1 -- 172.21.15.57:0/3191874993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd03c0 msgr2=0x5565a1fdc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:59.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.174+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/3191874993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd03c0 0x5565a1fdc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.174+0000 7f01c1d9a700 1 -- 172.21.15.57:0/3191874993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565a1ee9190 con 0x5565a1fd0cd0 2023-03-02T10:58:59.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.174+0000 7f01c2d9c700 1 --2- 172.21.15.57:0/3191874993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 0x5565a1fe9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:58:59.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.174+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/3191874993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd0cd0 0x5565a1fe9960 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x5565a1ff0ba0 tx=0x7f01ac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e7a364a7924358 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:59.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.174+0000 7f01b17fa700 1 -- 172.21.15.57:0/3191874993 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac023040 con 0x5565a1fd0cd0 2023-03-02T10:58:59.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.174+0000 7f01b17fa700 1 -- 172.21.15.57:0/3191874993 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01ac01e3d0 con 0x5565a1fd0cd0 2023-03-02T10:58:59.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.174+0000 7f01b17fa700 1 -- 172.21.15.57:0/3191874993 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac0038e0 con 0x5565a1fd0cd0 2023-03-02T10:58:59.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.175+0000 7f01d8031b80 1 -- 172.21.15.57:0/3191874993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd0cd0 msgr2=0x5565a1fe9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:59.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.175+0000 7f01d8031b80 1 --2- 172.21.15.57:0/3191874993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd0cd0 0x5565a1fe9960 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x5565a1ff0ba0 tx=0x7f01ac014000 comp rx=0 tx=0).stop 2023-03-02T10:58:59.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.175+0000 7f01d8031b80 1 -- 172.21.15.57:0/3191874993 shutdown_connections 2023-03-02T10:58:59.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.175+0000 7f01d8031b80 1 --2- 172.21.15.57:0/3191874993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd5110 0x5565a1fe9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.175+0000 7f01d8031b80 1 --2- 172.21.15.57:0/3191874993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd03c0 0x5565a1fdc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.175+0000 7f01d8031b80 1 --2- 172.21.15.57:0/3191874993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd0cd0 0x5565a1fe9960 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.175+0000 7f01d8031b80 1 -- 172.21.15.57:0/3191874993 >> 172.21.15.57:0/3191874993 conn(0x5565a1fc5c50 msgr2=0x5565a1fd41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.175+0000 7f01d8031b80 1 -- 172.21.15.57:0/3191874993 shutdown_connections 2023-03-02T10:58:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.175+0000 7f01d8031b80 1 -- 172.21.15.57:0/3191874993 wait complete. 2023-03-02T10:58:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.175+0000 7f01d8031b80 1 -- start start 2023-03-02T10:58:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01d8031b80 1 Processor -- start 2023-03-02T10:58:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fe3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fe4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01d8031b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd5110 0x5565a1fe4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01d8031b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a203f8f0 con 0x5565a1fd5110 2023-03-02T10:58:59.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01d8031b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a203fa60 con 0x5565a1fd0cd0 2023-03-02T10:58:59.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01d8031b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565a203fc20 con 0x5565a1fd03c0 2023-03-02T10:58:59.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01d8031b80 10 client.0 _ll_register_callbacks cb 0x5565a1ec8520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:58:59.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01c259b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fe3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01c259b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fe3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48166/0 (socket says 172.21.15.57:48166) 2023-03-02T10:58:59.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01c259b700 1 -- 172.21.15.57:0/1420176406 learned_addr learned my addr 172.21.15.57:0/1420176406 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:58:59.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01c2d9c700 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd5110 0x5565a1fe4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fe4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01c259b700 1 -- 172.21.15.57:0/1420176406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 msgr2=0x5565a1fe4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01c259b700 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fe4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01c259b700 1 -- 172.21.15.57:0/1420176406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd5110 msgr2=0x5565a1fe4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:58:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01c259b700 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd5110 0x5565a1fe4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.176+0000 7f01c259b700 1 -- 172.21.15.57:0/1420176406 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b4012540 con 0x5565a1fd03c0 2023-03-02T10:58:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01c259b700 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fe3ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f01b80a8f00 tx=0x7f01b80c3ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8abc074652189b9 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:58:59.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:58:59.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01a5ffb700 1 -- 172.21.15.57:0/1420176406 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8095320 con 0x5565a1fd03c0 2023-03-02T10:58:59.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01a5ffb700 1 -- 172.21.15.57:0/1420176406 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f01b80c6040 con 0x5565a1fd03c0 2023-03-02T10:58:59.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01d8031b80 1 -- 172.21.15.57:0/1420176406 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01b80957e0 con 0x5565a1fd03c0 2023-03-02T10:58:59.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01a5ffb700 1 -- 172.21.15.57:0/1420176406 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01b80955b0 con 0x5565a1fd03c0 2023-03-02T10:58:59.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01d8031b80 10 client.25813 fetch_fsmap learned FSMap version 31 2023-03-02T10:58:59.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01d8031b80 1 -- 172.21.15.57:0/1420176406 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f01ac017070 con 0x5565a1fd03c0 2023-03-02T10:58:59.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01a5ffb700 1 -- 172.21.15.57:0/1420176406 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01b80957e0 con 0x5565a1fd03c0 2023-03-02T10:58:59.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01a5ffb700 1 -- 172.21.15.57:0/1420176406 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f01b8094940 con 0x5565a1fd03c0 2023-03-02T10:58:59.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01d8031b80 10 client.25813 fetch_fsmap finished waiting for FSMap version 31 2023-03-02T10:58:59.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01d8031b80 10 client.25813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-02T10:58:59.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.177+0000 7f01d8031b80 20 client.25813 populate_metadata read hostname 'smithi057' 2023-03-02T10:58:59.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5565a2040fd0 0x5565a20433e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:58:59.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 4 client.25813 mds_command: new command op to 24560 tid=0[{"prefix": "scrub status"}] 2023-03-02T10:58:59.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 -- 172.21.15.57:0/1420176406 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5565a1f1ae90 con 0x5565a2040fd0 2023-03-02T10:58:59.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5565a2040fd0 0x5565a20433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:58:59.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01c1d9a700 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5565a2040fd0 0x5565a20433e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0eace2bcb62df62 server_cookie=121037608506b793 in_seq=0 out_seq=0 2023-03-02T10:58:59.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01a5ffb700 10 client.25813 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:59.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01a5ffb700 1 -- 172.21.15.57:0/1420176406 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5565a1f1ae90 con 0x5565a2040fd0 2023-03-02T10:58:59.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01a5ffb700 10 client.25813 handle_command_reply: tid=0 2023-03-02T10:58:59.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 client.25813 shutdown 2023-03-02T10:58:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 -- 172.21.15.57:0/1420176406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 msgr2=0x5565a1fe3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fe3ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f01b80a8f00 tx=0x7f01b80c3ea0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 -- 172.21.15.57:0/1420176406 shutdown_connections 2023-03-02T10:58:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x5565a2040fd0 0x5565a20433e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5565a1fd5110 0x5565a1fe4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01a5ffb700 0 client.25813 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:58:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5565a1fd03c0 0x5565a1fe3ad0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 --2- 172.21.15.57:0/1420176406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5565a1fd0cd0 0x5565a1fe4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 -- 172.21.15.57:0/1420176406 >> 172.21.15.57:0/1420176406 conn(0x5565a1fc5c50 msgr2=0x5565a1fe9960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:59.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.178+0000 7f01d8031b80 1 -- 172.21.15.57:0/1420176406 shutdown_connections 2023-03-02T10:58:59.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01d8031b80 1 -- 172.21.15.57:0/1420176406 wait complete. 2023-03-02T10:58:59.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01d8031b80 20 client.25813 trim_cache size 0 max 16384 2023-03-02T10:58:59.189 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:58:59.190 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "IDLE (waiting for more scrubs)", 2023-03-02T10:58:59.190 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T10:58:59.190 INFO:teuthology.orchestra.run.smithi057.stdout: "f1cfc471-e4e0-40ad-8523-43e51eef793a": { 2023-03-02T10:58:59.190 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T10:58:59.190 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "f1cfc471-e4e0-40ad-8523-43e51eef793a", 2023-03-02T10:58:59.190 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T10:58:59.190 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:58:59.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:58:59.191 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:58:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 -- 172.21.15.57:0/2787158643 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01a809b480 msgr2=0x7f01a809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01a809b480 0x7f01a809d930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0fdf20 tx=0x7f01ac009260 comp rx=0 tx=0).stop 2023-03-02T10:58:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 -- 172.21.15.57:0/2787158643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01bc0fe9b0 msgr2=0x7f01bc19b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:58:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01bc0fe9b0 0x7f01bc19b950 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f01b8000c00 tx=0x7f01b8005740 comp rx=0 tx=0).stop 2023-03-02T10:58:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 -- 172.21.15.57:0/2787158643 shutdown_connections 2023-03-02T10:58:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01a809b480 0x7f01a809d930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01bc1049c0 0x7f01bc1959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01bc0fe9b0 0x7f01bc19b950 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 --2- 172.21.15.57:0/2787158643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc0ff360 0x7f01bc19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:58:59.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 -- 172.21.15.57:0/2787158643 >> 172.21.15.57:0/2787158643 conn(0x7f01bc0fa4b0 msgr2=0x7f01bc102760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:58:59.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 -- 172.21.15.57:0/2787158643 shutdown_connections 2023-03-02T10:58:59.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:58:59.179+0000 7f01c47ff700 1 -- 172.21.15.57:0/2787158643 wait complete. 2023-03-02T10:58:59.195 INFO:tasks.cephfs.filesystem:scrub status for tag:f1cfc471-e4e0-40ad-8523-43e51eef793a - {'path': '/', 'tag': 'f1cfc471-e4e0-40ad-8523-43e51eef793a', 'options': 'recursive,force'} 2023-03-02T10:58:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:58:59 smithi057 ceph-mon[92072]: pgmap v62: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 361 MiB/s wr, 140 op/s 2023-03-02T10:58:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:58:59 smithi122 ceph-mon[125440]: pgmap v62: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 361 MiB/s wr, 140 op/s 2023-03-02T10:59:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:58:59 smithi136 ceph-mon[125702]: pgmap v62: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 361 MiB/s wr, 140 op/s 2023-03-02T10:59:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:01 smithi057 ceph-mon[92072]: pgmap v63: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 270 MiB/s wr, 89 op/s 2023-03-02T10:59:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:01 smithi122 ceph-mon[125440]: pgmap v63: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 270 MiB/s wr, 89 op/s 2023-03-02T10:59:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:01 smithi136 ceph-mon[125702]: pgmap v63: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 270 MiB/s wr, 89 op/s 2023-03-02T10:59:03.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:03 smithi057 ceph-mon[92072]: pgmap v64: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 285 MiB/s wr, 111 op/s 2023-03-02T10:59:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:03 smithi122 ceph-mon[125440]: pgmap v64: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 285 MiB/s wr, 111 op/s 2023-03-02T10:59:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:03 smithi136 ceph-mon[125702]: pgmap v64: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 285 MiB/s wr, 111 op/s 2023-03-02T10:59:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:05 smithi057 ceph-mon[92072]: pgmap v65: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 MiB/s wr, 45 op/s 2023-03-02T10:59:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:05 smithi122 ceph-mon[125440]: pgmap v65: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 MiB/s wr, 45 op/s 2023-03-02T10:59:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:05 smithi136 ceph-mon[125702]: pgmap v65: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 MiB/s wr, 45 op/s 2023-03-02T10:59:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:07 smithi057 ceph-mon[92072]: pgmap v66: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 MiB/s wr, 45 op/s 2023-03-02T10:59:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:07 smithi122 ceph-mon[125440]: pgmap v66: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 MiB/s wr, 45 op/s 2023-03-02T10:59:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:07 smithi136 ceph-mon[125702]: pgmap v66: 97 pgs: 97 active+clean; 12 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 MiB/s wr, 45 op/s 2023-03-02T10:59:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.357+0000 7f5886fff700 1 -- 172.21.15.57:0/3723208046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5880100480 msgr2=0x7f588010c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.357+0000 7f5886fff700 1 --2- 172.21.15.57:0/3723208046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5880100480 0x7f588010c910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f587800b0a0 tx=0x7f587800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.358+0000 7f5886fff700 1 -- 172.21.15.57:0/3723208046 shutdown_connections 2023-03-02T10:59:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.358+0000 7f5886fff700 1 --2- 172.21.15.57:0/3723208046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5880100480 0x7f588010c910 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.358+0000 7f5886fff700 1 --2- 172.21.15.57:0/3723208046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5880105ae0 0x7f5880105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.358+0000 7f5886fff700 1 --2- 172.21.15.57:0/3723208046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58800ffad0 0x7f58800fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.358+0000 7f5886fff700 1 -- 172.21.15.57:0/3723208046 >> 172.21.15.57:0/3723208046 conn(0x7f58800fb5d0 msgr2=0x7f58800fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.358+0000 7f5886fff700 1 -- 172.21.15.57:0/3723208046 shutdown_connections 2023-03-02T10:59:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.358+0000 7f5886fff700 1 -- 172.21.15.57:0/3723208046 wait complete. 2023-03-02T10:59:08.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.359+0000 7f5886fff700 1 Processor -- start 2023-03-02T10:59:08.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.359+0000 7f5886fff700 1 -- start start 2023-03-02T10:59:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.359+0000 7f5886fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58800ffad0 0x7f5880072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.359+0000 7f5886fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5880100480 0x7f5880072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.359+0000 7f5886fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5880105ae0 0x7f5880073310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.359+0000 7f5886fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58801a8680 con 0x7f58800ffad0 2023-03-02T10:59:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.359+0000 7f5886fff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5880199e40 con 0x7f5880100480 2023-03-02T10:59:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.359+0000 7f5886fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588019a000 con 0x7f5880105ae0 2023-03-02T10:59:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.359+0000 7f588559c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5880105ae0 0x7f5880073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.359+0000 7f588559c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5880105ae0 0x7f5880073310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:58318/0 (socket says 172.21.15.57:58318) 2023-03-02T10:59:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.359+0000 7f588559c700 1 -- 172.21.15.57:0/4000526380 learned_addr learned my addr 172.21.15.57:0/4000526380 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5880100480 0x7f5880072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.360+0000 7f588559c700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5880100480 msgr2=0x7f5880072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.360+0000 7f588559c700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5880100480 0x7f5880072dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.360+0000 7f588559c700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58800ffad0 msgr2=0x7f5880072890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-02T10:59:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.360+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58800ffad0 0x7f5880072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.360+0000 7f588559c700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58800ffad0 0x7f5880072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.360+0000 7f588559c700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878009d00 con 0x7f5880105ae0 2023-03-02T10:59:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.360+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58800ffad0 0x7f5880072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:59:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.361+0000 7f588559c700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5880105ae0 0x7f5880073310 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f587800b780 tx=0x7f587800bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.361+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587800e040 con 0x7f5880105ae0 2023-03-02T10:59:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.361+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5878004e60 con 0x7f5880105ae0 2023-03-02T10:59:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.361+0000 7f5886fff700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588010fb70 con 0x7f5880105ae0 2023-03-02T10:59:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.361+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58780052a0 con 0x7f5880105ae0 2023-03-02T10:59:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.361+0000 7f5886fff700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588010f9e0 con 0x7f5880105ae0 2023-03-02T10:59:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.365+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f5878005400 con 0x7f5880105ae0 2023-03-02T10:59:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.366+0000 7f589a948b80 1 Processor -- start 2023-03-02T10:59:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.366+0000 7f589a948b80 1 -- start start 2023-03-02T10:59:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.366+0000 7f589a948b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d17a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.366+0000 7f589a948b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 0x558558d11f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.366+0000 7f589a948b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d18440 0x558558d124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f587ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d17a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f587ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d17a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:58326/0 (socket says 172.21.15.57:58326) 2023-03-02T10:59:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f587ffff700 1 -- 172.21.15.57:0/432795456 learned_addr learned my addr 172.21.15.57:0/432795456 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f5884d9b700 1 --2- 172.21.15.57:0/432795456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 0x558558d11f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f589a948b80 1 -- 172.21.15.57:0/432795456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558c79a00 con 0x558558d17fd0 2023-03-02T10:59:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f589a948b80 1 -- 172.21.15.57:0/432795456 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558c2bf20 con 0x558558d18440 2023-03-02T10:59:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f589a948b80 1 -- 172.21.15.57:0/432795456 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558bfc100 con 0x558558b6f6b0 2023-03-02T10:59:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f587ffff700 1 --2- 172.21.15.57:0/432795456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d18440 0x558558d124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f587ffff700 1 -- 172.21.15.57:0/432795456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d18440 msgr2=0x558558d124c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f587ffff700 1 --2- 172.21.15.57:0/432795456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d18440 0x558558d124c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f587ffff700 1 -- 172.21.15.57:0/432795456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 msgr2=0x558558d11f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f587ffff700 1 --2- 172.21.15.57:0/432795456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 0x558558d11f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f587ffff700 1 -- 172.21.15.57:0/432795456 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558558ae65d0 con 0x558558b6f6b0 2023-03-02T10:59:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f587ffff700 1 --2- 172.21.15.57:0/432795456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d17a90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5874005d90 tx=0x7f5874005d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf60332e8c02aa15 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.367+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.368+0000 7f5866ffd700 1 -- 172.21.15.57:0/432795456 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874012e00 con 0x558558b6f6b0 2023-03-02T10:59:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.368+0000 7f5866ffd700 1 -- 172.21.15.57:0/432795456 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5874004cf0 con 0x558558b6f6b0 2023-03-02T10:59:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.368+0000 7f5866ffd700 1 -- 172.21.15.57:0/432795456 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400f3f0 con 0x558558b6f6b0 2023-03-02T10:59:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.368+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f58780c6750 con 0x7f5880105ae0 2023-03-02T10:59:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.368+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.368+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809d9b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58700044f0 tx=0x7f5870009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.368+0000 7f589a948b80 1 -- 172.21.15.57:0/432795456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 msgr2=0x558558d17a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.368+0000 7f589a948b80 1 --2- 172.21.15.57:0/432795456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d17a90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5874005d90 tx=0x7f5874005d20 comp rx=0 tx=0).stop 2023-03-02T10:59:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.369+0000 7f589a948b80 1 -- 172.21.15.57:0/432795456 shutdown_connections 2023-03-02T10:59:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.369+0000 7f589a948b80 1 --2- 172.21.15.57:0/432795456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d18440 0x558558d124c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.369+0000 7f589a948b80 1 --2- 172.21.15.57:0/432795456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d17a90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.369+0000 7f589a948b80 1 --2- 172.21.15.57:0/432795456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 0x558558d11f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.369+0000 7f589a948b80 1 -- 172.21.15.57:0/432795456 >> 172.21.15.57:0/432795456 conn(0x558558d079a0 msgr2=0x558558d0ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.369+0000 7f589a948b80 1 -- 172.21.15.57:0/432795456 shutdown_connections 2023-03-02T10:59:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.369+0000 7f589a948b80 1 -- 172.21.15.57:0/432795456 wait complete. 2023-03-02T10:59:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.369+0000 7f589a948b80 1 -- start start 2023-03-02T10:59:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.369+0000 7f589a948b80 1 Processor -- start 2023-03-02T10:59:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f589a948b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d1e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f589a948b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 0x558558d1b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f589a948b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d18440 0x558558d1bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f589a948b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558c6ab60 con 0x558558d17fd0 2023-03-02T10:59:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f589a948b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558c64090 con 0x558558d18440 2023-03-02T10:59:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f589a948b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558ae88c0 con 0x558558b6f6b0 2023-03-02T10:59:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f589a948b80 10 client.0 _ll_register_callbacks cb 0x558558c0a4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f5884d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d1e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f587ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 0x558558d1b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f5884d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d1e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:58330/0 (socket says 172.21.15.57:58330) 2023-03-02T10:59:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f5884d9b700 1 -- 172.21.15.57:0/996895600 learned_addr learned my addr 172.21.15.57:0/996895600 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f587ffff700 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 0x558558d1b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46902/0 (socket says 172.21.15.57:46902) 2023-03-02T10:59:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f588559c700 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d18440 0x558558d1bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f587ffff700 1 -- 172.21.15.57:0/996895600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 msgr2=0x558558d1e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f587ffff700 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d1e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f587ffff700 1 -- 172.21.15.57:0/996895600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d18440 msgr2=0x558558d1bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f587ffff700 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d18440 0x558558d1bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f587ffff700 1 -- 172.21.15.57:0/996895600 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587401a040 con 0x558558d17fd0 2023-03-02T10:59:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.370+0000 7f5884d9b700 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d1e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 0x558558d1b560 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5874005950 tx=0x7f5874005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdab8a1a1b7baf0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.371+0000 7f585ffff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.371+0000 7f585ffff700 1 -- 172.21.15.57:0/996895600 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874004e60 con 0x558558d17fd0 2023-03-02T10:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.371+0000 7f585ffff700 1 -- 172.21.15.57:0/996895600 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5874017040 con 0x558558d17fd0 2023-03-02T10:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.371+0000 7f589a948b80 1 -- 172.21.15.57:0/996895600 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558558c35750 con 0x558558d17fd0 2023-03-02T10:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.371+0000 7f585ffff700 1 -- 172.21.15.57:0/996895600 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5874012e00 con 0x558558d17fd0 2023-03-02T10:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.371+0000 7f589a948b80 10 client.16023 fetch_fsmap learned FSMap version 31 2023-03-02T10:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.371+0000 7f589a948b80 1 -- 172.21.15.57:0/996895600 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x558558a92d80 con 0x558558d17fd0 2023-03-02T10:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.372+0000 7f585ffff700 1 -- 172.21.15.57:0/996895600 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558558c35750 con 0x558558d17fd0 2023-03-02T10:59:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.372+0000 7f585ffff700 1 -- 172.21.15.57:0/996895600 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f5874003680 con 0x558558d17fd0 2023-03-02T10:59:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.372+0000 7f589a948b80 10 client.16023 fetch_fsmap finished waiting for FSMap version 31 2023-03-02T10:59:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.372+0000 7f589a948b80 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:59:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.372+0000 7f589a948b80 20 client.16023 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.372+0000 7f589a948b80 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d2b8d0 0x558558d2dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.372+0000 7f589a948b80 4 client.16023 mds_command: new command op to 24560 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:59:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.372+0000 7f589a948b80 1 -- 172.21.15.57:0/996895600 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558558c5d110 con 0x558558d2b8d0 2023-03-02T10:59:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.372+0000 7f5884d9b700 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d2b8d0 0x558558d2dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.373+0000 7f5884d9b700 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d2b8d0 0x558558d2dce0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=199de55bb402bc86 server_cookie=38f13253e27a45fd in_seq=0 out_seq=0 2023-03-02T10:59:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.373+0000 7f585ffff700 10 client.16023 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:59:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.373+0000 7f585ffff700 1 -- 172.21.15.57:0/996895600 <== mds.0 v2:172.21.15.122:6838/316639764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x558558c5d110 con 0x558558d2b8d0 2023-03-02T10:59:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.373+0000 7f585ffff700 10 client.16023 handle_command_reply: tid=0 2023-03-02T10:59:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.373+0000 7f589a948b80 1 client.16023 shutdown 2023-03-02T10:59:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.373+0000 7f589a948b80 1 -- 172.21.15.57:0/996895600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 msgr2=0x558558d1b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.373+0000 7f589a948b80 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 0x558558d1b560 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5874005950 tx=0x7f5874005770 comp rx=0 tx=0).stop 2023-03-02T10:59:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.374+0000 7f589a948b80 1 -- 172.21.15.57:0/996895600 shutdown_connections 2023-03-02T10:59:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.374+0000 7f589a948b80 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d2b8d0 0x558558d2dce0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.374+0000 7f589a948b80 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d18440 0x558558d1bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.374+0000 7f589a948b80 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d1e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.374+0000 7f585ffff700 0 client.16023 ms_handle_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:59:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.374+0000 7f589a948b80 1 --2- 172.21.15.57:0/996895600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d17fd0 0x558558d1b560 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.374+0000 7f589a948b80 1 -- 172.21.15.57:0/996895600 >> 172.21.15.57:0/996895600 conn(0x558558d079a0 msgr2=0x558558d0c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.374+0000 7f589a948b80 1 -- 172.21.15.57:0/996895600 shutdown_connections 2023-03-02T10:59:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.374+0000 7f589a948b80 1 -- 172.21.15.57:0/996895600 wait complete. 2023-03-02T10:59:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.374+0000 7f589a948b80 20 client.16023 trim_cache size 0 max 16384 2023-03-02T10:59:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.392+0000 7f589a948b80 1 Processor -- start 2023-03-02T10:59:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f589a948b80 1 -- start start 2023-03-02T10:59:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f589a948b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558b6f6b0 0x558558d1b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f589a948b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558d17fd0 0x558558d0c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f589a948b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d18440 0x558558d1de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f589a948b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558d09a20 con 0x558558d18440 2023-03-02T10:59:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f589a948b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558d12cc0 con 0x558558b6f6b0 2023-03-02T10:59:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f589a948b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558d0cec0 con 0x558558d17fd0 2023-03-02T10:59:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f587ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558d17fd0 0x558558d0c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f587ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558d17fd0 0x558558d0c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:58342/0 (socket says 172.21.15.57:58342) 2023-03-02T10:59:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f5884d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558b6f6b0 0x558558d1b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f587ffff700 1 -- 172.21.15.57:0/3123163763 learned_addr learned my addr 172.21.15.57:0/3123163763 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.393+0000 7f588559c700 1 --2- 172.21.15.57:0/3123163763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d18440 0x558558d1de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.394+0000 7f587ffff700 1 -- 172.21.15.57:0/3123163763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558b6f6b0 msgr2=0x558558d1b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/3123163763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558b6f6b0 0x558558d1b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.394+0000 7f587ffff700 1 -- 172.21.15.57:0/3123163763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d18440 msgr2=0x558558d1de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/3123163763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d18440 0x558558d1de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.394+0000 7f587ffff700 1 -- 172.21.15.57:0/3123163763 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558558c2b130 con 0x558558d17fd0 2023-03-02T10:59:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/3123163763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558d17fd0 0x558558d0c980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f587400b850 tx=0x7f5874005ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2adb978a42061b26 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.394+0000 7f58677fe700 1 -- 172.21.15.57:0/3123163763 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400bc50 con 0x558558d17fd0 2023-03-02T10:59:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.394+0000 7f58677fe700 1 -- 172.21.15.57:0/3123163763 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5874023070 con 0x558558d17fd0 2023-03-02T10:59:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.394+0000 7f58677fe700 1 -- 172.21.15.57:0/3123163763 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874003880 con 0x558558d17fd0 2023-03-02T10:59:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.395+0000 7f589a948b80 1 -- 172.21.15.57:0/3123163763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558d17fd0 msgr2=0x558558d0c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.395+0000 7f589a948b80 1 --2- 172.21.15.57:0/3123163763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558d17fd0 0x558558d0c980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f587400b850 tx=0x7f5874005ce0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.395+0000 7f589a948b80 1 -- 172.21.15.57:0/3123163763 shutdown_connections 2023-03-02T10:59:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.395+0000 7f589a948b80 1 --2- 172.21.15.57:0/3123163763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d18440 0x558558d1de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.395+0000 7f589a948b80 1 --2- 172.21.15.57:0/3123163763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558b6f6b0 0x558558d1b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.395+0000 7f589a948b80 1 --2- 172.21.15.57:0/3123163763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558d17fd0 0x558558d0c980 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.395+0000 7f589a948b80 1 -- 172.21.15.57:0/3123163763 >> 172.21.15.57:0/3123163763 conn(0x558558d079a0 msgr2=0x558558d1ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.395+0000 7f589a948b80 1 -- 172.21.15.57:0/3123163763 shutdown_connections 2023-03-02T10:59:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.395+0000 7f589a948b80 1 -- 172.21.15.57:0/3123163763 wait complete. 2023-03-02T10:59:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.395+0000 7f589a948b80 1 -- start start 2023-03-02T10:59:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f589a948b80 1 Processor -- start 2023-03-02T10:59:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f589a948b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d13510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f589a948b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d17fd0 0x558558d13a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f589a948b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d18440 0x558558d13f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f589a948b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558d144d0 con 0x558558d18440 2023-03-02T10:59:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f589a948b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558d14640 con 0x558558d17fd0 2023-03-02T10:59:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f589a948b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x558558d14800 con 0x558558b6f6b0 2023-03-02T10:59:08.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f589a948b80 10 client.0 _ll_register_callbacks cb 0x558558c0a4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:08.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f5884d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d13510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f5884d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d13510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:58358/0 (socket says 172.21.15.57:58358) 2023-03-02T10:59:08.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f5884d9b700 1 -- 172.21.15.57:0/783025844 learned_addr learned my addr 172.21.15.57:0/783025844 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:08.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.396+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d17fd0 0x558558d13a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.397+0000 7f588559c700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d18440 0x558558d13f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.397+0000 7f5884d9b700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d17fd0 msgr2=0x558558d13a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:08.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.397+0000 7f5884d9b700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558558d17fd0 0x558558d13a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.397+0000 7f5884d9b700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d18440 msgr2=0x558558d13f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.397+0000 7f5884d9b700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558558d18440 0x558558d13f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.397+0000 7f5884d9b700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558558a92d80 con 0x558558b6f6b0 2023-03-02T10:59:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.397+0000 7f5884d9b700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558558b6f6b0 0x558558d13510 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x558558d2e590 tx=0x7f5870004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3440633010a59 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.397+0000 7f585ffff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:59:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.397+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870022040 con 0x558558b6f6b0 2023-03-02T10:59:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.397+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5870012c40 con 0x558558b6f6b0 2023-03-02T10:59:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.397+0000 7f589a948b80 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5874004cf0 con 0x558558b6f6b0 2023-03-02T10:59:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5870012e00 con 0x558558b6f6b0 2023-03-02T10:59:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f589a948b80 10 client.25831 fetch_fsmap learned FSMap version 31 2023-03-02T10:59:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f589a948b80 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x558558ab91f0 con 0x558558b6f6b0 2023-03-02T10:59:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5874004cf0 con 0x558558b6f6b0 2023-03-02T10:59:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f587002d020 con 0x558558b6f6b0 2023-03-02T10:59:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f589a948b80 10 client.25831 fetch_fsmap finished waiting for FSMap version 31 2023-03-02T10:59:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f589a948b80 10 client.25831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-02T10:59:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f589a948b80 20 client.25831 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f589a948b80 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f589a948b80 4 client.25831 mds_command: new command op to 24560 tid=0[{"prefix": "flush journal"}] 2023-03-02T10:59:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f589a948b80 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558558c5ce30 con 0x558558d7dd00 2023-03-02T10:59:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.398+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dca378ea6e246618 server_cookie=d80e6180d010a066 in_seq=0 out_seq=0 2023-03-02T10:59:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.399+0000 7f585ffff700 10 client.25831 ms_handle_connect on v2:172.21.15.122:6838/316639764 2023-03-02T10:59:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.424+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T10:59:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.424+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T10:59:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T10:59:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2023-03-02T10:59:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.424+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:6838/316639764 2023-03-02T10:59:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.424+0000 7f585ffff700 1 client.25831 ms_handle_refused on v2:172.21.15.122:6838/316639764 2023-03-02T10:59:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=83 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-02T10:59:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.625+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:6838/316639764 2023-03-02T10:59:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.625+0000 7f585ffff700 1 client.25831 ms_handle_refused on v2:172.21.15.122:6838/316639764 2023-03-02T10:59:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:08.625+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=83 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-02T10:59:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:59:08.703 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-2462-g802de851/rpm/el8/BUILD/ceph-18.0.0-2462-g802de851/src/include/elist.h: In function 'elist::~elist() [with T = CInode*]' thread 7f8db2fcb700 time 2023-03-02T10:59:08.387976+0000 2023-03-02T10:59:08.703 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-2462-g802de851/rpm/el8/BUILD/ceph-18.0.0-2462-g802de851/src/include/elist.h: 91: FAILED ceph_assert(_head.empty()) 2023-03-02T10:59:08.703 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev) 2023-03-02T10:59:08.703 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8dbecafdbb] 2023-03-02T10:59:08.704 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a7f81) [0x7f8dbecaff81] 2023-03-02T10:59:08.704 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 3: /usr/bin/ceph-mds(+0x2c2263) [0x56112cdf3263] 2023-03-02T10:59:08.704 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 4: (Server::handle_peer_rename_prep(boost::intrusive_ptr&)+0x1ccf) [0x56112cdd65df] 2023-03-02T10:59:08.704 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 5: (MDSContext::complete(int)+0x5f) [0x56112d06f42f] 2023-03-02T10:59:08.704 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 6: (MDSRank::_advance_queues()+0xaa) [0x56112ccf413a] 2023-03-02T10:59:08.704 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 7: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x1ce) [0x56112ccf4c2e] 2023-03-02T10:59:08.704 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 8: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56112ccf561c] 2023-03-02T10:59:08.705 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 9: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56112ccdf95f] 2023-03-02T10:59:08.705 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 10: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8dbef25398] 2023-03-02T10:59:08.705 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 11: (DispatchQueue::entry()+0x50f) [0x7f8dbef2253f] 2023-03-02T10:59:08.705 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8dbefe7281] 2023-03-02T10:59:08.705 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 13: /lib64/libpthread.so.0(+0x81ca) [0x7f8dbda591ca] 2023-03-02T10:59:08.706 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 14: clone() 2023-03-02T10:59:08.706 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.389+0000 7f8db2fcb700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-2462-g802de851/rpm/el8/BUILD/ceph-18.0.0-2462-g802de851/src/include/elist.h: In function 'elist::~elist() [with T = CInode*]' thread 7f8db2fcb700 time 2023-03-02T10:59:08.387976+0000 2023-03-02T10:59:08.706 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-2462-g802de851/rpm/el8/BUILD/ceph-18.0.0-2462-g802de851/src/include/elist.h: 91: FAILED ceph_assert(_head.empty()) 2023-03-02T10:59:08.706 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.706 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev) 2023-03-02T10:59:08.706 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8dbecafdbb] 2023-03-02T10:59:08.706 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a7f81) [0x7f8dbecaff81] 2023-03-02T10:59:08.707 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 3: /usr/bin/ceph-mds(+0x2c2263) [0x56112cdf3263] 2023-03-02T10:59:08.707 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 4: (Server::handle_peer_rename_prep(boost::intrusive_ptr&)+0x1ccf) [0x56112cdd65df] 2023-03-02T10:59:08.707 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 5: (MDSContext::complete(int)+0x5f) [0x56112d06f42f] 2023-03-02T10:59:08.707 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 6: (MDSRank::_advance_queues()+0xaa) [0x56112ccf413a] 2023-03-02T10:59:08.707 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 7: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x1ce) [0x56112ccf4c2e] 2023-03-02T10:59:08.707 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 8: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56112ccf561c] 2023-03-02T10:59:08.707 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 9: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56112ccdf95f] 2023-03-02T10:59:08.708 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 10: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8dbef25398] 2023-03-02T10:59:08.708 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 11: (DispatchQueue::entry()+0x50f) [0x7f8dbef2253f] 2023-03-02T10:59:08.708 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8dbefe7281] 2023-03-02T10:59:08.708 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 13: /lib64/libpthread.so.0(+0x81ca) [0x7f8dbda591ca] 2023-03-02T10:59:08.708 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 14: clone() 2023-03-02T10:59:08.708 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.708 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: *** Caught signal (Aborted) ** 2023-03-02T10:59:08.709 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: in thread 7f8db2fcb700 thread_name:ms_dispatch 2023-03-02T10:59:08.709 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev) 2023-03-02T10:59:08.709 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f8dbda63cf0] 2023-03-02T10:59:08.709 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2: gsignal() 2023-03-02T10:59:08.709 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 3: abort() 2023-03-02T10:59:08.709 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8dbecafe15] 2023-03-02T10:59:08.709 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a7f81) [0x7f8dbecaff81] 2023-03-02T10:59:08.710 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 6: /usr/bin/ceph-mds(+0x2c2263) [0x56112cdf3263] 2023-03-02T10:59:08.710 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 7: (Server::handle_peer_rename_prep(boost::intrusive_ptr&)+0x1ccf) [0x56112cdd65df] 2023-03-02T10:59:08.710 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 8: (MDSContext::complete(int)+0x5f) [0x56112d06f42f] 2023-03-02T10:59:08.710 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 9: (MDSRank::_advance_queues()+0xaa) [0x56112ccf413a] 2023-03-02T10:59:08.710 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 10: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x1ce) [0x56112ccf4c2e] 2023-03-02T10:59:08.710 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 11: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56112ccf561c] 2023-03-02T10:59:08.710 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 12: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56112ccdf95f] 2023-03-02T10:59:08.711 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 13: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8dbef25398] 2023-03-02T10:59:08.711 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 14: (DispatchQueue::entry()+0x50f) [0x7f8dbef2253f] 2023-03-02T10:59:08.711 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8dbefe7281] 2023-03-02T10:59:08.711 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 16: /lib64/libpthread.so.0(+0x81ca) [0x7f8dbda591ca] 2023-03-02T10:59:08.711 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 17: clone() 2023-03-02T10:59:08.711 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.390+0000 7f8db2fcb700 -1 *** Caught signal (Aborted) ** 2023-03-02T10:59:08.711 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: in thread 7f8db2fcb700 thread_name:ms_dispatch 2023-03-02T10:59:08.712 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.712 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev) 2023-03-02T10:59:08.712 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f8dbda63cf0] 2023-03-02T10:59:08.712 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2: gsignal() 2023-03-02T10:59:08.712 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 3: abort() 2023-03-02T10:59:08.712 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8dbecafe15] 2023-03-02T10:59:08.713 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a7f81) [0x7f8dbecaff81] 2023-03-02T10:59:08.713 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 6: /usr/bin/ceph-mds(+0x2c2263) [0x56112cdf3263] 2023-03-02T10:59:08.713 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 7: (Server::handle_peer_rename_prep(boost::intrusive_ptr&)+0x1ccf) [0x56112cdd65df] 2023-03-02T10:59:08.713 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 8: (MDSContext::complete(int)+0x5f) [0x56112d06f42f] 2023-03-02T10:59:08.713 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 9: (MDSRank::_advance_queues()+0xaa) [0x56112ccf413a] 2023-03-02T10:59:08.714 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 10: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x1ce) [0x56112ccf4c2e] 2023-03-02T10:59:08.714 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 11: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56112ccf561c] 2023-03-02T10:59:08.714 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 12: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56112ccdf95f] 2023-03-02T10:59:08.714 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 13: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8dbef25398] 2023-03-02T10:59:08.714 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 14: (DispatchQueue::entry()+0x50f) [0x7f8dbef2253f] 2023-03-02T10:59:08.714 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8dbefe7281] 2023-03-02T10:59:08.714 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 16: /lib64/libpthread.so.0(+0x81ca) [0x7f8dbda591ca] 2023-03-02T10:59:08.715 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 17: clone() 2023-03-02T10:59:08.715 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-02T10:59:08.715 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.715 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: -1> 2023-03-02T10:59:08.389+0000 7f8db2fcb700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-2462-g802de851/rpm/el8/BUILD/ceph-18.0.0-2462-g802de851/src/include/elist.h: In function 'elist::~elist() [with T = CInode*]' thread 7f8db2fcb700 time 2023-03-02T10:59:08.387976+0000 2023-03-02T10:59:08.715 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-2462-g802de851/rpm/el8/BUILD/ceph-18.0.0-2462-g802de851/src/include/elist.h: 91: FAILED ceph_assert(_head.empty()) 2023-03-02T10:59:08.715 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.716 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev) 2023-03-02T10:59:08.716 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8dbecafdbb] 2023-03-02T10:59:08.716 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a7f81) [0x7f8dbecaff81] 2023-03-02T10:59:08.716 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 3: /usr/bin/ceph-mds(+0x2c2263) [0x56112cdf3263] 2023-03-02T10:59:08.716 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 4: (Server::handle_peer_rename_prep(boost::intrusive_ptr&)+0x1ccf) [0x56112cdd65df] 2023-03-02T10:59:08.716 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 5: (MDSContext::complete(int)+0x5f) [0x56112d06f42f] 2023-03-02T10:59:08.716 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 6: (MDSRank::_advance_queues()+0xaa) [0x56112ccf413a] 2023-03-02T10:59:08.717 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 7: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x1ce) [0x56112ccf4c2e] 2023-03-02T10:59:08.717 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 8: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56112ccf561c] 2023-03-02T10:59:08.717 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 9: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56112ccdf95f] 2023-03-02T10:59:08.717 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 10: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8dbef25398] 2023-03-02T10:59:08.717 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 11: (DispatchQueue::entry()+0x50f) [0x7f8dbef2253f] 2023-03-02T10:59:08.717 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8dbefe7281] 2023-03-02T10:59:08.718 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 13: /lib64/libpthread.so.0(+0x81ca) [0x7f8dbda591ca] 2023-03-02T10:59:08.718 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 14: clone() 2023-03-02T10:59:08.718 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.718 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 0> 2023-03-02T10:59:08.390+0000 7f8db2fcb700 -1 *** Caught signal (Aborted) ** 2023-03-02T10:59:08.718 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: in thread 7f8db2fcb700 thread_name:ms_dispatch 2023-03-02T10:59:08.718 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.718 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev) 2023-03-02T10:59:08.719 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f8dbda63cf0] 2023-03-02T10:59:08.719 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2: gsignal() 2023-03-02T10:59:08.719 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 3: abort() 2023-03-02T10:59:08.719 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8dbecafe15] 2023-03-02T10:59:08.719 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a7f81) [0x7f8dbecaff81] 2023-03-02T10:59:08.719 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 6: /usr/bin/ceph-mds(+0x2c2263) [0x56112cdf3263] 2023-03-02T10:59:08.719 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 7: (Server::handle_peer_rename_prep(boost::intrusive_ptr&)+0x1ccf) [0x56112cdd65df] 2023-03-02T10:59:08.720 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 8: (MDSContext::complete(int)+0x5f) [0x56112d06f42f] 2023-03-02T10:59:08.720 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 9: (MDSRank::_advance_queues()+0xaa) [0x56112ccf413a] 2023-03-02T10:59:08.720 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 10: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x1ce) [0x56112ccf4c2e] 2023-03-02T10:59:08.720 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 11: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56112ccf561c] 2023-03-02T10:59:08.720 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 12: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56112ccdf95f] 2023-03-02T10:59:08.720 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 13: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8dbef25398] 2023-03-02T10:59:08.720 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 14: (DispatchQueue::entry()+0x50f) [0x7f8dbef2253f] 2023-03-02T10:59:08.721 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8dbefe7281] 2023-03-02T10:59:08.721 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 16: /lib64/libpthread.so.0(+0x81ca) [0x7f8dbda591ca] 2023-03-02T10:59:08.721 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 17: clone() 2023-03-02T10:59:08.721 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-02T10:59:08.721 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.722 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: -6> 2023-03-02T10:59:08.389+0000 7f8db2fcb700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-2462-g802de851/rpm/el8/BUILD/ceph-18.0.0-2462-g802de851/src/include/elist.h: In function 'elist::~elist() [with T = CInode*]' thread 7f8db2fcb700 time 2023-03-02T10:59:08.387976+0000 2023-03-02T10:59:08.722 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-2462-g802de851/rpm/el8/BUILD/ceph-18.0.0-2462-g802de851/src/include/elist.h: 91: FAILED ceph_assert(_head.empty()) 2023-03-02T10:59:08.722 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.722 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev) 2023-03-02T10:59:08.722 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8dbecafdbb] 2023-03-02T10:59:08.722 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a7f81) [0x7f8dbecaff81] 2023-03-02T10:59:08.723 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 3: /usr/bin/ceph-mds(+0x2c2263) [0x56112cdf3263] 2023-03-02T10:59:08.723 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 4: (Server::handle_peer_rename_prep(boost::intrusive_ptr&)+0x1ccf) [0x56112cdd65df] 2023-03-02T10:59:08.723 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 5: (MDSContext::complete(int)+0x5f) [0x56112d06f42f] 2023-03-02T10:59:08.723 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 6: (MDSRank::_advance_queues()+0xaa) [0x56112ccf413a] 2023-03-02T10:59:08.723 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 7: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x1ce) [0x56112ccf4c2e] 2023-03-02T10:59:08.723 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 8: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56112ccf561c] 2023-03-02T10:59:08.723 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 9: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56112ccdf95f] 2023-03-02T10:59:08.724 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 10: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8dbef25398] 2023-03-02T10:59:08.724 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 11: (DispatchQueue::entry()+0x50f) [0x7f8dbef2253f] 2023-03-02T10:59:08.724 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8dbefe7281] 2023-03-02T10:59:08.724 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 13: /lib64/libpthread.so.0(+0x81ca) [0x7f8dbda591ca] 2023-03-02T10:59:08.724 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 14: clone() 2023-03-02T10:59:08.724 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.724 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: -5> 2023-03-02T10:59:08.390+0000 7f8db2fcb700 -1 *** Caught signal (Aborted) ** 2023-03-02T10:59:08.724 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: in thread 7f8db2fcb700 thread_name:ms_dispatch 2023-03-02T10:59:08.725 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.725 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: ceph version 18.0.0-2462-g802de851 (802de851643c97960b33dacc1e3ce8486e6d7d3c) reef (dev) 2023-03-02T10:59:08.725 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f8dbda63cf0] 2023-03-02T10:59:08.725 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2: gsignal() 2023-03-02T10:59:08.725 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 3: abort() 2023-03-02T10:59:08.725 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8dbecafe15] 2023-03-02T10:59:08.725 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a7f81) [0x7f8dbecaff81] 2023-03-02T10:59:08.726 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 6: /usr/bin/ceph-mds(+0x2c2263) [0x56112cdf3263] 2023-03-02T10:59:08.726 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 7: (Server::handle_peer_rename_prep(boost::intrusive_ptr&)+0x1ccf) [0x56112cdd65df] 2023-03-02T10:59:08.726 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 8: (MDSContext::complete(int)+0x5f) [0x56112d06f42f] 2023-03-02T10:59:08.726 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 9: (MDSRank::_advance_queues()+0xaa) [0x56112ccf413a] 2023-03-02T10:59:08.726 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 10: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x1ce) [0x56112ccf4c2e] 2023-03-02T10:59:08.726 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 11: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56112ccf561c] 2023-03-02T10:59:08.726 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 12: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56112ccdf95f] 2023-03-02T10:59:08.726 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 13: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8dbef25398] 2023-03-02T10:59:08.727 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 14: (DispatchQueue::entry()+0x50f) [0x7f8dbef2253f] 2023-03-02T10:59:08.727 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 15: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8dbefe7281] 2023-03-02T10:59:08.727 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 16: /lib64/libpthread.so.0(+0x81ca) [0x7f8dbda591ca] 2023-03-02T10:59:08.727 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 17: clone() 2023-03-02T10:59:08.727 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-02T10:59:08.727 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:08 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[150925]: 2023-03-02T10:59:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:59:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:09.026+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:6838/316639764 2023-03-02T10:59:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:09.026+0000 7f585ffff700 1 client.25831 ms_handle_refused on v2:172.21.15.122:6838/316639764 2023-03-02T10:59:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:09.026+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=83 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-02T10:59:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T10:59:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:09.827+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:6838/316639764 2023-03-02T10:59:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:09.827+0000 7f585ffff700 1 client.25831 ms_handle_refused on v2:172.21.15.122:6838/316639764 2023-03-02T10:59:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:09.827+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=83 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-03-02T10:59:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:09 smithi057 ceph-mon[92072]: pgmap v67: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 179 MiB/s wr, 101 op/s 2023-03-02T10:59:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:59:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:59:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:59:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:59:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:59:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:09 smithi122 ceph-mon[125440]: pgmap v67: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 179 MiB/s wr, 101 op/s 2023-03-02T10:59:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:59:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:59:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:59:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:59:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:59:09.952 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:09 smithi122 systemd[1]: ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.b.service: Main process exited, code=exited, status=134/n/a 2023-03-02T10:59:09.953 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:09 smithi122 systemd[1]: ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.b.service: Failed with result 'exit-code'. 2023-03-02T10:59:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:09 smithi136 ceph-mon[125702]: pgmap v67: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 179 MiB/s wr, 101 op/s 2023-03-02T10:59:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:59:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:59:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T10:59:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T10:59:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T10:59:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:11.429+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:6838/316639764 2023-03-02T10:59:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:11.429+0000 7f585ffff700 1 client.25831 ms_handle_refused on v2:172.21.15.122:6838/316639764 2023-03-02T10:59:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:11.429+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=83 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-03-02T10:59:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:11 smithi057 ceph-mon[92072]: pgmap v68: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 142 MiB/s wr, 78 op/s 2023-03-02T10:59:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:11 smithi122 ceph-mon[125440]: pgmap v68: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 142 MiB/s wr, 78 op/s 2023-03-02T10:59:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:11 smithi136 ceph-mon[125702]: pgmap v68: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 142 MiB/s wr, 78 op/s 2023-03-02T10:59:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:13 smithi057 ceph-mon[92072]: pgmap v69: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 241 MiB/s wr, 119 op/s 2023-03-02T10:59:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:13 smithi122 ceph-mon[125440]: pgmap v69: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 241 MiB/s wr, 119 op/s 2023-03-02T10:59:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:13 smithi136 ceph-mon[125702]: pgmap v69: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 241 MiB/s wr, 119 op/s 2023-03-02T10:59:14.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:14.632+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:6838/316639764 2023-03-02T10:59:14.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:14.632+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=83 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-03-02T10:59:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:14.632+0000 7f585ffff700 1 client.25831 ms_handle_refused on v2:172.21.15.122:6838/316639764 2023-03-02T10:59:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:15 smithi057 ceph-mon[92072]: pgmap v70: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 226 MiB/s wr, 96 op/s 2023-03-02T10:59:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:15 smithi122 ceph-mon[125440]: pgmap v70: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 226 MiB/s wr, 96 op/s 2023-03-02T10:59:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:15 smithi136 ceph-mon[125702]: pgmap v70: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 226 MiB/s wr, 96 op/s 2023-03-02T10:59:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:17 smithi122 ceph-mon[125440]: pgmap v71: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 226 MiB/s wr, 96 op/s 2023-03-02T10:59:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:17 smithi136 ceph-mon[125702]: pgmap v71: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 226 MiB/s wr, 96 op/s 2023-03-02T10:59:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:17 smithi057 ceph-mon[92072]: pgmap v71: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 226 MiB/s wr, 96 op/s 2023-03-02T10:59:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:19 smithi057 ceph-mon[92072]: pgmap v72: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 242 MiB/s wr, 106 op/s 2023-03-02T10:59:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:19 smithi122 ceph-mon[125440]: pgmap v72: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 242 MiB/s wr, 106 op/s 2023-03-02T10:59:19.952 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:19 smithi122 systemd[1]: ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.b.service: Service RestartSec=10s expired, scheduling restart. 2023-03-02T10:59:19.952 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:19 smithi122 systemd[1]: ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c@mds.b.service: Scheduled restart job, restart counter is at 1. 2023-03-02T10:59:19.952 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:19 smithi122 systemd[1]: Stopped Ceph mds.b for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:59:19.952 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:19 smithi122 systemd[1]: Starting Ceph mds.b for 886f029e-b8e7-11ed-9ae9-001a4aab830c... 2023-03-02T10:59:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:19 smithi136 ceph-mon[125702]: pgmap v72: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 242 MiB/s wr, 106 op/s 2023-03-02T10:59:20.239 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:19 smithi122 podman[154290]: 2023-03-02T10:59:20.619 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:20 smithi122 bash[154290]: e15a74a6a872ba5cc6544fb0ee38bb18ebf6315f5b378aca7c97d83934ee915f 2023-03-02T10:59:20.620 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:20 smithi122 ceph-mds[154328]: -- 172.21.15.122:0/3226085691 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560c092aeb60 con 0x560c09282800 2023-03-02T10:59:20.620 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:20 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[154306]: starting mds.b at 2023-03-02T10:59:20.620 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 10:59:20 smithi122 systemd[1]: Started Ceph mds.b for 886f029e-b8e7-11ed-9ae9-001a4aab830c. 2023-03-02T10:59:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:20 smithi057 ceph-mon[92072]: daemon mds.b restarted 2023-03-02T10:59:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:20 smithi057 ceph-mon[92072]: osdmap e88: 12 total, 12 up, 12 in 2023-03-02T10:59:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:20 smithi122 ceph-mon[125440]: daemon mds.b restarted 2023-03-02T10:59:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:20 smithi122 ceph-mon[125440]: osdmap e88: 12 total, 12 up, 12 in 2023-03-02T10:59:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:21.039+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=83 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:21.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_RECONNECTING pgs=83 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2023-03-02T10:59:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:21.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_RECONNECTING pgs=83 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2023-03-02T10:59:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:21.040+0000 7f585ffff700 0 client.25831 ms_handle_remote_reset on v2:172.21.15.122:6838/316639764 2023-03-02T10:59:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:21.040+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T10:59:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:21.040+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T10:59:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:21.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T10:59:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:21.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2023-03-02T10:59:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:20 smithi136 ceph-mon[125702]: daemon mds.b restarted 2023-03-02T10:59:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:20 smithi136 ceph-mon[125702]: osdmap e88: 12 total, 12 up, 12 in 2023-03-02T10:59:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:21 smithi057 ceph-mon[92072]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-03-02T10:59:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:21 smithi057 ceph-mon[92072]: pgmap v74: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 138 MiB/s wr, 61 op/s 2023-03-02T10:59:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:21 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:21.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-02T10:59:21.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:21 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.122:6838/4100786550,v1:172.21.15.122:6839/4100786550] up:boot 2023-03-02T10:59:21.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:21 smithi057 ceph-mon[92072]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2023-03-02T10:59:21.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:21 smithi057 ceph-mon[92072]: fsmap cephfs:4/5 {1=i=up:active,2=c=up:active,3=f=up:active,4=e=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2023-03-02T10:59:21.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:21 smithi057 ceph-mon[92072]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2023-03-02T10:59:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:21 smithi122 ceph-mon[125440]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-03-02T10:59:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:21 smithi122 ceph-mon[125440]: pgmap v74: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 138 MiB/s wr, 61 op/s 2023-03-02T10:59:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:21 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:21.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-02T10:59:21.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:21 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.122:6838/4100786550,v1:172.21.15.122:6839/4100786550] up:boot 2023-03-02T10:59:21.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:21 smithi122 ceph-mon[125440]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2023-03-02T10:59:21.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:21 smithi122 ceph-mon[125440]: fsmap cephfs:4/5 {1=i=up:active,2=c=up:active,3=f=up:active,4=e=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2023-03-02T10:59:21.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:21 smithi122 ceph-mon[125440]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2023-03-02T10:59:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:21 smithi136 ceph-mon[125702]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-03-02T10:59:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:21 smithi136 ceph-mon[125702]: pgmap v74: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 138 MiB/s wr, 61 op/s 2023-03-02T10:59:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:21 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-02T10:59:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:21 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.122:6838/4100786550,v1:172.21.15.122:6839/4100786550] up:boot 2023-03-02T10:59:22.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:21 smithi136 ceph-mon[125702]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2023-03-02T10:59:22.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:21 smithi136 ceph-mon[125702]: fsmap cephfs:4/5 {1=i=up:active,2=c=up:active,3=f=up:active,4=e=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2023-03-02T10:59:22.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:21 smithi136 ceph-mon[125702]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2023-03-02T10:59:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:22 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:resolve 2023-03-02T10:59:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:22 smithi057 ceph-mon[92072]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:resolve 4 up:active 2023-03-02T10:59:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:22 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:resolve 2023-03-02T10:59:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:22 smithi122 ceph-mon[125440]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:resolve 4 up:active 2023-03-02T10:59:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:22 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:resolve 2023-03-02T10:59:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:22 smithi136 ceph-mon[125702]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:resolve 4 up:active 2023-03-02T10:59:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:23 smithi057 ceph-mon[92072]: pgmap v75: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 126 MiB/s wr, 50 op/s 2023-03-02T10:59:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:23 smithi057 ceph-mon[92072]: reconnect by client.15906 172.21.15.57:0/2930417718 after 0.000999976 2023-03-02T10:59:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:23 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:reconnect 2023-03-02T10:59:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:23 smithi057 ceph-mon[92072]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:reconnect 4 up:active 2023-03-02T10:59:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:23 smithi057 ceph-mon[92072]: reconnect by client.15285 192.168.0.1:0/3184288185 after 0.0159996 2023-03-02T10:59:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:23 smithi122 ceph-mon[125440]: pgmap v75: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 126 MiB/s wr, 50 op/s 2023-03-02T10:59:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:23 smithi122 ceph-mon[125440]: reconnect by client.15906 172.21.15.57:0/2930417718 after 0.000999976 2023-03-02T10:59:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:23 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:reconnect 2023-03-02T10:59:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:23 smithi122 ceph-mon[125440]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:reconnect 4 up:active 2023-03-02T10:59:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:23 smithi122 ceph-mon[125440]: reconnect by client.15285 192.168.0.1:0/3184288185 after 0.0159996 2023-03-02T10:59:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:23 smithi136 ceph-mon[125702]: pgmap v75: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 126 MiB/s wr, 50 op/s 2023-03-02T10:59:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:23 smithi136 ceph-mon[125702]: reconnect by client.15906 172.21.15.57:0/2930417718 after 0.000999976 2023-03-02T10:59:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:23 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:reconnect 2023-03-02T10:59:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:23 smithi136 ceph-mon[125702]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:reconnect 4 up:active 2023-03-02T10:59:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:23 smithi136 ceph-mon[125702]: reconnect by client.15285 192.168.0.1:0/3184288185 after 0.0159996 2023-03-02T10:59:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:24 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:rejoin 2023-03-02T10:59:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:24 smithi057 ceph-mon[92072]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:rejoin 4 up:active 2023-03-02T10:59:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:24 smithi057 ceph-mon[92072]: daemon mds.k is now active in filesystem cephfs as rank 0 2023-03-02T10:59:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:24 smithi057 ceph-mon[92072]: from='client.15285 192.168.0.1:0/3184288185' entity='client.0' cmd=[{ "prefix": "osd blocklist", "blocklistop": "add", "addr": "192.168.0.1:0/3184288185" }]: dispatch 2023-03-02T10:59:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:24 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:rejoin 2023-03-02T10:59:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:24 smithi122 ceph-mon[125440]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:rejoin 4 up:active 2023-03-02T10:59:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:24 smithi122 ceph-mon[125440]: daemon mds.k is now active in filesystem cephfs as rank 0 2023-03-02T10:59:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:24 smithi122 ceph-mon[125440]: from='client.15285 192.168.0.1:0/3184288185' entity='client.0' cmd=[{ "prefix": "osd blocklist", "blocklistop": "add", "addr": "192.168.0.1:0/3184288185" }]: dispatch 2023-03-02T10:59:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:24 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:rejoin 2023-03-02T10:59:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:24 smithi136 ceph-mon[125702]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:rejoin 4 up:active 2023-03-02T10:59:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:24 smithi136 ceph-mon[125702]: daemon mds.k is now active in filesystem cephfs as rank 0 2023-03-02T10:59:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:24 smithi136 ceph-mon[125702]: from='client.15285 192.168.0.1:0/3184288185' entity='client.0' cmd=[{ "prefix": "osd blocklist", "blocklistop": "add", "addr": "192.168.0.1:0/3184288185" }]: dispatch 2023-03-02T10:59:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:25 smithi057 ceph-mon[92072]: pgmap v76: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 126 MiB/s wr, 50 op/s 2023-03-02T10:59:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:25 smithi057 ceph-mon[92072]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-03-02T10:59:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:25 smithi057 ceph-mon[92072]: Cluster is now healthy 2023-03-02T10:59:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:25 smithi057 ceph-mon[92072]: from='client.15285 192.168.0.1:0/3184288185' entity='client.0' cmd='[{ "prefix": "osd blocklist", "blocklistop": "add", "addr": "192.168.0.1:0/3184288185" }]': finished 2023-03-02T10:59:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:25 smithi057 ceph-mon[92072]: osdmap e89: 12 total, 12 up, 12 in 2023-03-02T10:59:25.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:25 smithi057 ceph-mon[92072]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:active 2023-03-02T10:59:25.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:25 smithi057 ceph-mon[92072]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-03-02T10:59:25.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:25 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:59:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:25 smithi122 ceph-mon[125440]: pgmap v76: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 126 MiB/s wr, 50 op/s 2023-03-02T10:59:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:25 smithi122 ceph-mon[125440]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-03-02T10:59:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:25 smithi122 ceph-mon[125440]: Cluster is now healthy 2023-03-02T10:59:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:25 smithi122 ceph-mon[125440]: from='client.15285 192.168.0.1:0/3184288185' entity='client.0' cmd='[{ "prefix": "osd blocklist", "blocklistop": "add", "addr": "192.168.0.1:0/3184288185" }]': finished 2023-03-02T10:59:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:25 smithi122 ceph-mon[125440]: osdmap e89: 12 total, 12 up, 12 in 2023-03-02T10:59:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:25 smithi122 ceph-mon[125440]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:active 2023-03-02T10:59:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:25 smithi122 ceph-mon[125440]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-03-02T10:59:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:25 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:59:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:25 smithi136 ceph-mon[125702]: pgmap v76: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 126 MiB/s wr, 50 op/s 2023-03-02T10:59:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:25 smithi136 ceph-mon[125702]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-03-02T10:59:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:25 smithi136 ceph-mon[125702]: Cluster is now healthy 2023-03-02T10:59:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:25 smithi136 ceph-mon[125702]: from='client.15285 192.168.0.1:0/3184288185' entity='client.0' cmd='[{ "prefix": "osd blocklist", "blocklistop": "add", "addr": "192.168.0.1:0/3184288185" }]': finished 2023-03-02T10:59:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:25 smithi136 ceph-mon[125702]: osdmap e89: 12 total, 12 up, 12 in 2023-03-02T10:59:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:25 smithi136 ceph-mon[125702]: mds.? [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] up:active 2023-03-02T10:59:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:25 smithi136 ceph-mon[125702]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-03-02T10:59:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:25 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:59:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:27 smithi057 ceph-mon[92072]: pgmap v78: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 134 MiB/s wr, 73 op/s 2023-03-02T10:59:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:27 smithi122 ceph-mon[125440]: pgmap v78: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 134 MiB/s wr, 73 op/s 2023-03-02T10:59:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:27 smithi136 ceph-mon[125702]: pgmap v78: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 134 MiB/s wr, 73 op/s 2023-03-02T10:59:29.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T10:59:29.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.368+0000 7f4ad83ff700 1 -- 172.21.15.57:0/2901837111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ad00fe9b0 msgr2=0x7f4ad00fee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.368+0000 7f4ad83ff700 1 --2- 172.21.15.57:0/2901837111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ad00fe9b0 0x7f4ad00fee20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009990 tx=0x7f4ac0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.368+0000 7f4ad83ff700 1 -- 172.21.15.57:0/2901837111 shutdown_connections 2023-03-02T10:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.368+0000 7f4ad83ff700 1 --2- 172.21.15.57:0/2901837111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ad00ff360 0x7f4ad010b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.368+0000 7f4ad83ff700 1 --2- 172.21.15.57:0/2901837111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad01049c0 0x7f4ad0104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.368+0000 7f4ad83ff700 1 --2- 172.21.15.57:0/2901837111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ad00fe9b0 0x7f4ad00fee20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.368+0000 7f4ad83ff700 1 -- 172.21.15.57:0/2901837111 >> 172.21.15.57:0/2901837111 conn(0x7f4ad00fa4b0 msgr2=0x7f4ad00fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.368+0000 7f4ad83ff700 1 -- 172.21.15.57:0/2901837111 shutdown_connections 2023-03-02T10:59:29.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.368+0000 7f4ad83ff700 1 -- 172.21.15.57:0/2901837111 wait complete. 2023-03-02T10:59:29.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.368+0000 7f4ad83ff700 1 Processor -- start 2023-03-02T10:59:29.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad83ff700 1 -- start start 2023-03-02T10:59:29.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad83ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ad00fe9b0 0x7f4ad01947f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad83ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ad00ff360 0x7f4ad0194d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad83ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad01049c0 0x7f4ad0195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad83ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01a4030 con 0x7f4ad00fe9b0 2023-03-02T10:59:29.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad83ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01a41a0 con 0x7f4ad01049c0 2023-03-02T10:59:29.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad83ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01a4360 con 0x7f4ad00ff360 2023-03-02T10:59:29.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad619b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ad00fe9b0 0x7f4ad01947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad619b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ad00fe9b0 0x7f4ad01947f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57142/0 (socket says 172.21.15.57:57142) 2023-03-02T10:59:29.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad619b700 1 -- 172.21.15.57:0/4086663227 learned_addr learned my addr 172.21.15.57:0/4086663227 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:29.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad599a700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ad00ff360 0x7f4ad0194d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad699c700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad01049c0 0x7f4ad0195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad619b700 1 -- 172.21.15.57:0/4086663227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ad00ff360 msgr2=0x7f4ad0194d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad619b700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ad00ff360 0x7f4ad0194d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad619b700 1 -- 172.21.15.57:0/4086663227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad01049c0 msgr2=0x7f4ad0195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad619b700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad01049c0 0x7f4ad0195270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad619b700 1 -- 172.21.15.57:0/4086663227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac00095f0 con 0x7f4ad00fe9b0 2023-03-02T10:59:29.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.369+0000 7f4ad599a700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ad00ff360 0x7f4ad0194d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:29.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.370+0000 7f4ad619b700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ad00fe9b0 0x7f4ad01947f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00efc0 tx=0x7f4acc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:29.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.370+0000 7f4ac77fe700 1 -- 172.21.15.57:0/4086663227 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc018070 con 0x7f4ad00fe9b0 2023-03-02T10:59:29.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.370+0000 7f4ac77fe700 1 -- 172.21.15.57:0/4086663227 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4acc00f040 con 0x7f4ad00fe9b0 2023-03-02T10:59:29.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.370+0000 7f4ad83ff700 1 -- 172.21.15.57:0/4086663227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad010e9f0 con 0x7f4ad00fe9b0 2023-03-02T10:59:29.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.370+0000 7f4ac77fe700 1 -- 172.21.15.57:0/4086663227 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc004310 con 0x7f4ad00fe9b0 2023-03-02T10:59:29.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.370+0000 7f4ad83ff700 1 -- 172.21.15.57:0/4086663227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad010e860 con 0x7f4ad00fe9b0 2023-03-02T10:59:29.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.373+0000 7f4ac77fe700 1 -- 172.21.15.57:0/4086663227 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f4acc00cad0 con 0x7f4ad00fe9b0 2023-03-02T10:59:29.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.374+0000 7f4ac77fe700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4abc09b500 0x7f4abc09d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.374+0000 7f4ac77fe700 1 -- 172.21.15.57:0/4086663227 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f4acc0c52a0 con 0x7f4ad00fe9b0 2023-03-02T10:59:29.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.374+0000 7f4ad599a700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4abc09b500 0x7f4abc09d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4aebc32b80 1 Processor -- start 2023-03-02T10:59:29.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4aebc32b80 1 -- start start 2023-03-02T10:59:29.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f2d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4ad599a700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4abc09b500 0x7f4abc09d9b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000b2e0 tx=0x7f4ac0005fb0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:29.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2dcd0 0x556fb7f31bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f32560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7e94a60 con 0x556fb7f32110 2023-03-02T10:59:29.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7e46f80 con 0x556fb7f2dcd0 2023-03-02T10:59:29.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7e17160 con 0x556fb7f2d3c0 2023-03-02T10:59:29.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4ad699c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f32560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4ad699c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f32560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57158/0 (socket says 172.21.15.57:57158) 2023-03-02T10:59:29.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4ad699c700 1 -- 172.21.15.57:0/1492627601 learned_addr learned my addr 172.21.15.57:0/1492627601 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:29.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4ad619b700 1 --2- 172.21.15.57:0/1492627601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f2d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.375+0000 7f4ad599a700 1 --2- 172.21.15.57:0/1492627601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2dcd0 0x556fb7f31bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.376+0000 7f4ad699c700 1 -- 172.21.15.57:0/1492627601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 msgr2=0x556fb7f2d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:29.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.376+0000 7f4ad699c700 1 --2- 172.21.15.57:0/1492627601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f2d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.376+0000 7f4ad699c700 1 -- 172.21.15.57:0/1492627601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2dcd0 msgr2=0x556fb7f31bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:29.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.376+0000 7f4ad699c700 1 --2- 172.21.15.57:0/1492627601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2dcd0 0x556fb7f31bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.376+0000 7f4ad699c700 1 -- 172.21.15.57:0/1492627601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb7d01630 con 0x556fb7f32110 2023-03-02T10:59:29.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.376+0000 7f4ad599a700 1 --2- 172.21.15.57:0/1492627601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2dcd0 0x556fb7f31bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:29.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.376+0000 7f4ad699c700 1 --2- 172.21.15.57:0/1492627601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f32560 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009ca0 tx=0x7f4ac80113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84b4a550cd069ec server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:29.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.376+0000 7f4ac4bfe700 1 -- 172.21.15.57:0/1492627601 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80097f0 con 0x556fb7f32110 2023-03-02T10:59:29.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.376+0000 7f4ac4bfe700 1 -- 172.21.15.57:0/1492627601 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ac8011c60 con 0x556fb7f32110 2023-03-02T10:59:29.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.376+0000 7f4ac4bfe700 1 -- 172.21.15.57:0/1492627601 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800f6a0 con 0x556fb7f32110 2023-03-02T10:59:29.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.377+0000 7f4aebc32b80 1 -- 172.21.15.57:0/1492627601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 msgr2=0x556fb7f32560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.377+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/1492627601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f32560 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009ca0 tx=0x7f4ac80113e0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.377+0000 7f4aebc32b80 1 -- 172.21.15.57:0/1492627601 shutdown_connections 2023-03-02T10:59:29.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.377+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/1492627601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f32560 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.377+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/1492627601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f2d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.377+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/1492627601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2dcd0 0x556fb7f31bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.377+0000 7f4aebc32b80 1 -- 172.21.15.57:0/1492627601 >> 172.21.15.57:0/1492627601 conn(0x556fb7f22c50 msgr2=0x556fb7f28460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:29.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.377+0000 7f4aebc32b80 1 -- 172.21.15.57:0/1492627601 shutdown_connections 2023-03-02T10:59:29.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.377+0000 7f4aebc32b80 1 -- 172.21.15.57:0/1492627601 wait complete. 2023-03-02T10:59:29.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.377+0000 7f4aebc32b80 1 -- start start 2023-03-02T10:59:29.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.377+0000 7f4aebc32b80 1 Processor -- start 2023-03-02T10:59:29.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2d3c0 0x556fb7f39960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2dcd0 0x556fb7f36b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f372b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7e85bc0 con 0x556fb7f32110 2023-03-02T10:59:29.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7e7f0f0 con 0x556fb7f2d3c0 2023-03-02T10:59:29.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7d03920 con 0x556fb7f2dcd0 2023-03-02T10:59:29.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4aebc32b80 10 client.0 _ll_register_callbacks cb 0x556fb7e25520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:29.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4ad699c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f372b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4ad699c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f372b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57166/0 (socket says 172.21.15.57:57166) 2023-03-02T10:59:29.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4ad699c700 1 -- 172.21.15.57:0/2452965817 learned_addr learned my addr 172.21.15.57:0/2452965817 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:29.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4ad599a700 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2dcd0 0x556fb7f36b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4ad619b700 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2d3c0 0x556fb7f39960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4ad699c700 1 -- 172.21.15.57:0/2452965817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2dcd0 msgr2=0x556fb7f36b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:29.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4ad699c700 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2dcd0 0x556fb7f36b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4ad699c700 1 -- 172.21.15.57:0/2452965817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2d3c0 msgr2=0x556fb7f39960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:29.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4ad699c700 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2d3c0 0x556fb7f39960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.378+0000 7f4ad699c700 1 -- 172.21.15.57:0/2452965817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac8009950 con 0x556fb7f32110 2023-03-02T10:59:29.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4ad699c700 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f372b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8012dd0 tx=0x7f4ac8004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a88cd25acacd4d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:29.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4ab9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:29.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/2452965817 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8012450 con 0x556fb7f32110 2023-03-02T10:59:29.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4aebc32b80 1 -- 172.21.15.57:0/2452965817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556fb7e507b0 con 0x556fb7f32110 2023-03-02T10:59:29.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/2452965817 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f4ac80125b0 con 0x556fb7f32110 2023-03-02T10:59:29.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/2452965817 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ac8012770 con 0x556fb7f32110 2023-03-02T10:59:29.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4aebc32b80 10 client.16047 fetch_fsmap learned FSMap version 38 2023-03-02T10:59:29.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4aebc32b80 1 -- 172.21.15.57:0/2452965817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x556fb7cadde0 con 0x556fb7f32110 2023-03-02T10:59:29.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/2452965817 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556fb7e507b0 con 0x556fb7f32110 2023-03-02T10:59:29.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/2452965817 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 38) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f4ac8023440 con 0x556fb7f32110 2023-03-02T10:59:29.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4aebc32b80 10 client.16047 fetch_fsmap finished waiting for FSMap version 38 2023-03-02T10:59:29.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4aebc32b80 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T10:59:29.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4aebc32b80 20 client.16047 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:29.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556fb7f47220 0x556fb7f49630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4aebc32b80 4 client.16047 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:59:29.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.379+0000 7f4aebc32b80 1 -- 172.21.15.57:0/2452965817 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556fb7e78170 con 0x556fb7f47220 2023-03-02T10:59:29.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.380+0000 7f4ad619b700 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556fb7f47220 0x556fb7f49630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.380+0000 7f4ad619b700 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556fb7f47220 0x556fb7f49630 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c14a216f4e8ccdd7 server_cookie=6388796c9b974d34 in_seq=0 out_seq=0 2023-03-02T10:59:29.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.380+0000 7f4ab9ffb700 10 client.16047 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:29.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/2452965817 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x556fb7e78170 con 0x556fb7f47220 2023-03-02T10:59:29.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4ab9ffb700 10 client.16047 handle_command_reply: tid=0 2023-03-02T10:59:29.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4aebc32b80 1 client.16047 shutdown 2023-03-02T10:59:29.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4aebc32b80 1 -- 172.21.15.57:0/2452965817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 msgr2=0x556fb7f372b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f372b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8012dd0 tx=0x7f4ac8004560 comp rx=0 tx=0).stop 2023-03-02T10:59:29.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4aebc32b80 1 -- 172.21.15.57:0/2452965817 shutdown_connections 2023-03-02T10:59:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556fb7f47220 0x556fb7f49630 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f372b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2d3c0 0x556fb7f39960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/2452965817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2dcd0 0x556fb7f36b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4ab9ffb700 0 client.16047 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4aebc32b80 1 -- 172.21.15.57:0/2452965817 >> 172.21.15.57:0/2452965817 conn(0x556fb7f22c50 msgr2=0x556fb7f28050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4aebc32b80 1 -- 172.21.15.57:0/2452965817 shutdown_connections 2023-03-02T10:59:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.381+0000 7f4aebc32b80 1 -- 172.21.15.57:0/2452965817 wait complete. 2023-03-02T10:59:29.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.382+0000 7f4aebc32b80 20 client.16047 trim_cache size 0 max 16384 2023-03-02T10:59:29.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.398+0000 7f4aebc32b80 1 Processor -- start 2023-03-02T10:59:29.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.398+0000 7f4aebc32b80 1 -- start start 2023-03-02T10:59:29.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.398+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f39490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.398+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2dcd0 0x556fb7f399d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.398+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f310d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.398+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7f37170 con 0x556fb7f32110 2023-03-02T10:59:29.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.398+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7f372e0 con 0x556fb7f2dcd0 2023-03-02T10:59:29.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.398+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7f37f60 con 0x556fb7f2d3c0 2023-03-02T10:59:29.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.398+0000 7f4ad699c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ad699c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f310d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57182/0 (socket says 172.21.15.57:57182) 2023-03-02T10:59:29.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ad699c700 1 -- 172.21.15.57:0/4196303271 learned_addr learned my addr 172.21.15.57:0/4196303271 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:29.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ad599a700 1 --2- 172.21.15.57:0/4196303271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2dcd0 0x556fb7f399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ad619b700 1 --2- 172.21.15.57:0/4196303271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f39490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ad699c700 1 -- 172.21.15.57:0/4196303271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 msgr2=0x556fb7f39490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:29.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ad699c700 1 --2- 172.21.15.57:0/4196303271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f39490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ad699c700 1 -- 172.21.15.57:0/4196303271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2dcd0 msgr2=0x556fb7f399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:29.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ad699c700 1 --2- 172.21.15.57:0/4196303271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2dcd0 0x556fb7f399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ad699c700 1 -- 172.21.15.57:0/4196303271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb7e46190 con 0x556fb7f32110 2023-03-02T10:59:29.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ad699c700 1 --2- 172.21.15.57:0/4196303271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f310d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8023820 tx=0x7f4ac8009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47f23d7bc1bb15e server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:29.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ac53ff700 1 -- 172.21.15.57:0/4196303271 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80097f0 con 0x556fb7f32110 2023-03-02T10:59:29.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ac53ff700 1 -- 172.21.15.57:0/4196303271 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ac8023b10 con 0x556fb7f32110 2023-03-02T10:59:29.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.399+0000 7f4ac53ff700 1 -- 172.21.15.57:0/4196303271 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8023d50 con 0x556fb7f32110 2023-03-02T10:59:29.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.400+0000 7f4aebc32b80 1 -- 172.21.15.57:0/4196303271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 msgr2=0x556fb7f310d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.400+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/4196303271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f310d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8023820 tx=0x7f4ac8009350 comp rx=0 tx=0).stop 2023-03-02T10:59:29.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.400+0000 7f4aebc32b80 1 -- 172.21.15.57:0/4196303271 shutdown_connections 2023-03-02T10:59:29.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.400+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/4196303271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f32110 0x556fb7f310d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.400+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/4196303271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f39490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.400+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/4196303271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f2dcd0 0x556fb7f399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.400+0000 7f4aebc32b80 1 -- 172.21.15.57:0/4196303271 >> 172.21.15.57:0/4196303271 conn(0x556fb7f22c50 msgr2=0x556fb7f427e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:29.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.400+0000 7f4aebc32b80 1 -- 172.21.15.57:0/4196303271 shutdown_connections 2023-03-02T10:59:29.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.400+0000 7f4aebc32b80 1 -- 172.21.15.57:0/4196303271 wait complete. 2023-03-02T10:59:29.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.400+0000 7f4aebc32b80 1 -- start start 2023-03-02T10:59:29.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.400+0000 7f4aebc32b80 1 Processor -- start 2023-03-02T10:59:29.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f3e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f2dcd0 0x556fb7f3c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4aebc32b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f32110 0x556fb7f3cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7f3d240 con 0x556fb7f2dcd0 2023-03-02T10:59:29.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7f3d3b0 con 0x556fb7f32110 2023-03-02T10:59:29.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4aebc32b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb7f98b20 con 0x556fb7f2d3c0 2023-03-02T10:59:29.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4aebc32b80 10 client.0 _ll_register_callbacks cb 0x556fb7e25520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:29.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4ad599a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f2dcd0 0x556fb7f3c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4ad599a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f2dcd0 0x556fb7f3c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57190/0 (socket says 172.21.15.57:57190) 2023-03-02T10:59:29.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4ad599a700 1 -- 172.21.15.57:0/144277091 learned_addr learned my addr 172.21.15.57:0/144277091 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:29.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4ad699c700 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f32110 0x556fb7f3cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4ad619b700 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f3e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4ad599a700 1 -- 172.21.15.57:0/144277091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 msgr2=0x556fb7f3e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:29.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4ad599a700 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f3e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4ad599a700 1 -- 172.21.15.57:0/144277091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f32110 msgr2=0x556fb7f3cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:29.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4ad599a700 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f32110 0x556fb7f3cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4ad599a700 1 -- 172.21.15.57:0/144277091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fb7cadde0 con 0x556fb7f2dcd0 2023-03-02T10:59:29.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.401+0000 7f4ad619b700 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f3e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:29.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4ad599a700 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f2dcd0 0x556fb7f3c500 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009990 tx=0x7f4ac0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8de392aa78158d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:29.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4ab9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:29.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/144277091 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0033660 con 0x556fb7f2dcd0 2023-03-02T10:59:29.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4aebc32b80 1 -- 172.21.15.57:0/144277091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ac8011c60 con 0x556fb7f2dcd0 2023-03-02T10:59:29.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/144277091 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f4ac00337c0 con 0x556fb7f2dcd0 2023-03-02T10:59:29.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/144277091 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ac0033980 con 0x556fb7f2dcd0 2023-03-02T10:59:29.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4aebc32b80 10 client.16053 fetch_fsmap learned FSMap version 38 2023-03-02T10:59:29.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4aebc32b80 1 -- 172.21.15.57:0/144277091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x556fb7cd4250 con 0x556fb7f2dcd0 2023-03-02T10:59:29.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/144277091 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ac8011c60 con 0x556fb7f2dcd0 2023-03-02T10:59:29.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/144277091 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 38) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f4ac0031040 con 0x556fb7f2dcd0 2023-03-02T10:59:29.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4aebc32b80 10 client.16053 fetch_fsmap finished waiting for FSMap version 38 2023-03-02T10:59:29.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4aebc32b80 10 client.16053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T10:59:29.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4aebc32b80 20 client.16053 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:29.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.402+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556fb7f9a2b0 0x556fb7f9c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4aebc32b80 4 client.16053 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T10:59:29.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4aebc32b80 1 -- 172.21.15.57:0/144277091 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556fb7e77e90 con 0x556fb7f9a2b0 2023-03-02T10:59:29.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4ad619b700 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556fb7f9a2b0 0x556fb7f9c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4ab9ffb700 10 client.16053 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:29.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4ad619b700 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556fb7f9a2b0 0x556fb7f9c6c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6249416865a6cd1f server_cookie=89d3b1ac2b1eb8a3 in_seq=0 out_seq=0 2023-03-02T10:59:29.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4ab9ffb700 1 -- 172.21.15.57:0/144277091 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556fb7e77e90 con 0x556fb7f9a2b0 2023-03-02T10:59:29.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4ab9ffb700 10 client.16053 handle_command_reply: tid=0 2023-03-02T10:59:29.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4aebc32b80 1 client.16053 shutdown 2023-03-02T10:59:29.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4aebc32b80 1 -- 172.21.15.57:0/144277091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f2dcd0 msgr2=0x556fb7f3c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f2dcd0 0x556fb7f3c500 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009990 tx=0x7f4ac0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4aebc32b80 1 -- 172.21.15.57:0/144277091 shutdown_connections 2023-03-02T10:59:29.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.403+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556fb7f9a2b0 0x556fb7f9c6c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fb7f32110 0x556fb7f3cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556fb7f2d3c0 0x556fb7f3e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ab9ffb700 0 client.16053 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:29.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4aebc32b80 1 --2- 172.21.15.57:0/144277091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556fb7f2dcd0 0x556fb7f3c500 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4aebc32b80 1 -- 172.21.15.57:0/144277091 >> 172.21.15.57:0/144277091 conn(0x556fb7f22c50 msgr2=0x556fb7f2c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:29.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4aebc32b80 1 -- 172.21.15.57:0/144277091 shutdown_connections 2023-03-02T10:59:29.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4aebc32b80 1 -- 172.21.15.57:0/144277091 wait complete. 2023-03-02T10:59:29.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4aebc32b80 20 client.16053 trim_cache size 0 max 16384 2023-03-02T10:59:29.415 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:59:29.415 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "no active scrubs running", 2023-03-02T10:59:29.415 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": {} 2023-03-02T10:59:29.416 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:59:29.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 -- 172.21.15.57:0/4086663227 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4abc09b500 msgr2=0x7f4abc09d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4abc09b500 0x7f4abc09d9b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000b2e0 tx=0x7f4ac0005fb0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 -- 172.21.15.57:0/4086663227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ad00fe9b0 msgr2=0x7f4ad01947f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ad00fe9b0 0x7f4ad01947f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00efc0 tx=0x7f4acc00c3a0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 -- 172.21.15.57:0/4086663227 shutdown_connections 2023-03-02T10:59:29.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4abc09b500 0x7f4abc09d9b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad01049c0 0x7f4ad0195270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ad00fe9b0 0x7f4ad01947f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 --2- 172.21.15.57:0/4086663227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ad00ff360 0x7f4ad0194d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 -- 172.21.15.57:0/4086663227 >> 172.21.15.57:0/4086663227 conn(0x7f4ad00fa4b0 msgr2=0x7f4ad00fbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:29.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 -- 172.21.15.57:0/4086663227 shutdown_connections 2023-03-02T10:59:29.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.404+0000 7f4ad83ff700 1 -- 172.21.15.57:0/4086663227 wait complete. 2023-03-02T10:59:29.420 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-03-02T10:59:29.420 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-02T10:59:29.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.573+0000 7fd7165ff700 1 -- 172.21.15.57:0/2378311479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd710100cf0 msgr2=0x7fd7101010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.573+0000 7fd7165ff700 1 --2- 172.21.15.57:0/2378311479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd710100cf0 0x7fd7101010c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd700009990 tx=0x7fd700009ca0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.573+0000 7fd7165ff700 1 -- 172.21.15.57:0/2378311479 shutdown_connections 2023-03-02T10:59:29.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.574+0000 7fd7165ff700 1 --2- 172.21.15.57:0/2378311479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd71010a0c0 0x7fd71010c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.574+0000 7fd7165ff700 1 --2- 172.21.15.57:0/2378311479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd710100cf0 0x7fd7101010c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.574+0000 7fd7165ff700 1 --2- 172.21.15.57:0/2378311479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd710101600 0x7fd710109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.574+0000 7fd7165ff700 1 -- 172.21.15.57:0/2378311479 >> 172.21.15.57:0/2378311479 conn(0x7fd7100fa4c0 msgr2=0x7fd7100fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.574+0000 7fd7165ff700 1 -- 172.21.15.57:0/2378311479 shutdown_connections 2023-03-02T10:59:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.574+0000 7fd7165ff700 1 -- 172.21.15.57:0/2378311479 wait complete. 2023-03-02T10:59:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.574+0000 7fd7165ff700 1 Processor -- start 2023-03-02T10:59:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.574+0000 7fd7165ff700 1 -- start start 2023-03-02T10:59:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd7165ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd710100cf0 0x7fd71019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd7165ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd710101600 0x7fd71019bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd7165ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd71010a0c0 0x7fd710195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd7165ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101960b0 con 0x7fd710100cf0 2023-03-02T10:59:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd7165ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710196220 con 0x7fd710101600 2023-03-02T10:59:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd7165ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101963e0 con 0x7fd71010a0c0 2023-03-02T10:59:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd70ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd710100cf0 0x7fd71019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd70ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd710100cf0 0x7fd71019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57210/0 (socket says 172.21.15.57:57210) 2023-03-02T10:59:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd70ffff700 1 -- 172.21.15.57:0/3895294346 learned_addr learned my addr 172.21.15.57:0/3895294346 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd714b9c700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd71010a0c0 0x7fd710195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd7077fe700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd710101600 0x7fd71019bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd70ffff700 1 -- 172.21.15.57:0/3895294346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd71010a0c0 msgr2=0x7fd710195a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd70ffff700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd71010a0c0 0x7fd710195a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd70ffff700 1 -- 172.21.15.57:0/3895294346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd710101600 msgr2=0x7fd71019bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd70ffff700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd710101600 0x7fd71019bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd70ffff700 1 -- 172.21.15.57:0/3895294346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000095f0 con 0x7fd710100cf0 2023-03-02T10:59:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.575+0000 7fd7077fe700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd710101600 0x7fd71019bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.576+0000 7fd70ffff700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd710100cf0 0x7fd71019b9d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd7000095c0 tx=0x7fd70000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.576+0000 7fd70dffb700 1 -- 172.21.15.57:0/3895294346 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70001d070 con 0x7fd710100cf0 2023-03-02T10:59:29.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.576+0000 7fd7165ff700 1 -- 172.21.15.57:0/3895294346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71010fb90 con 0x7fd710100cf0 2023-03-02T10:59:29.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.576+0000 7fd70dffb700 1 -- 172.21.15.57:0/3895294346 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7000054f0 con 0x7fd710100cf0 2023-03-02T10:59:29.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.576+0000 7fd70dffb700 1 -- 172.21.15.57:0/3895294346 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700004b30 con 0x7fd710100cf0 2023-03-02T10:59:29.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.576+0000 7fd7165ff700 1 -- 172.21.15.57:0/3895294346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71010fa00 con 0x7fd710100cf0 2023-03-02T10:59:29.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.577+0000 7fd7165ff700 1 -- 172.21.15.57:0/3895294346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71010fd20 con 0x7fd710100cf0 2023-03-02T10:59:29.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.578+0000 7fd70dffb700 1 -- 172.21.15.57:0/3895294346 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fd700028030 con 0x7fd710100cf0 2023-03-02T10:59:29.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.579+0000 7fd70dffb700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd6fc09b480 0x7fd6fc09d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:29.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.580+0000 7fd7077fe700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd6fc09b480 0x7fd6fc09d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:29.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.580+0000 7fd70dffb700 1 -- 172.21.15.57:0/3895294346 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fd7000c5f90 con 0x7fd710100cf0 2023-03-02T10:59:29.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.580+0000 7fd7077fe700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd6fc09b480 0x7fd6fc09d930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd71010b710 tx=0x7fd6f800b5f0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:29.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.584+0000 7fd70dffb700 1 -- 172.21.15.57:0/3895294346 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174050 (secure 0 0 0) 0x7fd700091780 con 0x7fd710100cf0 2023-03-02T10:59:29.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.835+0000 7fd7165ff700 1 -- 172.21.15.57:0/3895294346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd710067280 con 0x7fd710100cf0 2023-03-02T10:59:29.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.836+0000 7fd70dffb700 1 -- 172.21.15.57:0/3895294346 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+10841 (secure 0 0 0) 0x7fd700026090 con 0x7fd710100cf0 2023-03-02T10:59:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-02T10:59:29.837 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4011698957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4011698957},{"type":"v1","addr":"172.21.15.57:6835","nonce":4011698957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/3098678156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3098678156},{"type":"v1","addr":"172.21.15.57:6837","nonce":3098678156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-02T10:55:10.601054+0000","modified":"2023-03-02T10:59:24.673405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24458,"mds_1":24520,"mds_2":24505,"mds_3":24493,"mds_4":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6837/2380932917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":2380932917},{"type":"v1","addr":"172.21.15.122:6837","nonce":2380932917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6839/1832653465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":1832653465},{"type":"v1","addr":"172.21.15.57:6839","nonce":1832653465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14634":{"gid":14634,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6841/3731858530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6840","nonce":3731858530},{"type":"v1","addr":"172.21.15.57:6841","nonce":3731858530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/2838612280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2838612280},{"type":"v1","addr":"172.21.15.136:6833","nonce":2838612280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"k","rank":0,"incarnation":33,"state":"up:active","state_seq":75,"addr":"172.21.15.122:6833/953074371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":953074371},{"type":"v1","addr":"172.21.15.122:6833","nonce":953074371}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"e","rank":4,"incarnation":24,"state":"up:active","state_seq":9,"addr":"172.21.15.122:6835/1841258715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1841258715},{"type":"v1","addr":"172.21.15.122:6835","nonce":1841258715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.136:6835/2199127047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2199127047},{"type":"v1","addr":"172.21.15.136:6835","nonce":2199127047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24505":{"gid":24505,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.136:6837/2130761226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2130761226},{"type":"v1","addr":"172.21.15.136:6837","nonce":2130761226}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24520":{"gid":24520,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/1702113579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":1702113579},{"type":"v1","addr":"172.21.15.136:6839","nonce":1702113579}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25880":{"gid":25880,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6839/4100786550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4100786550},{"type":"v1","addr":"172.21.15.122:6839","nonce":4100786550}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-02T10:59:29.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 -- 172.21.15.57:0/3895294346 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd6fc09b480 msgr2=0x7fd6fc09d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd6fc09b480 0x7fd6fc09d930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd71010b710 tx=0x7fd6f800b5f0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 -- 172.21.15.57:0/3895294346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd710100cf0 msgr2=0x7fd71019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:29.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd710100cf0 0x7fd71019b9d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd7000095c0 tx=0x7fd70000f690 comp rx=0 tx=0).stop 2023-03-02T10:59:29.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 -- 172.21.15.57:0/3895294346 shutdown_connections 2023-03-02T10:59:29.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd6fc09b480 0x7fd6fc09d930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd71010a0c0 0x7fd710195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd710100cf0 0x7fd71019b9d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 --2- 172.21.15.57:0/3895294346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd710101600 0x7fd71019bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:29.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 -- 172.21.15.57:0/3895294346 >> 172.21.15.57:0/3895294346 conn(0x7fd7100fa4c0 msgr2=0x7fd71010c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:29.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 -- 172.21.15.57:0/3895294346 shutdown_connections 2023-03-02T10:59:29.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:29.838+0000 7fd7165ff700 1 -- 172.21.15.57:0/3895294346 wait complete. 2023-03-02T10:59:29.841 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-03-02T10:59:29.854 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-03-02T10:59:29.891 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:29 smithi057 ceph-mon[92072]: pgmap v79: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 128 MiB/s wr, 318 op/s 2023-03-02T10:59:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:29 smithi122 ceph-mon[125440]: pgmap v79: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 128 MiB/s wr, 318 op/s 2023-03-02T10:59:30.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.010+0000 7ff3c37ff700 1 -- 172.21.15.57:0/2425127229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3bc100ce0 msgr2=0x7ff3bc1010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.010+0000 7ff3c37ff700 1 --2- 172.21.15.57:0/2425127229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3bc100ce0 0x7ff3bc1010b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009990 tx=0x7ff3b8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.010+0000 7ff3c37ff700 1 -- 172.21.15.57:0/2425127229 shutdown_connections 2023-03-02T10:59:30.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.010+0000 7ff3c37ff700 1 --2- 172.21.15.57:0/2425127229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3bc10a020 0x7ff3bc10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.010+0000 7ff3c37ff700 1 --2- 172.21.15.57:0/2425127229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3bc100ce0 0x7ff3bc1010b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.010+0000 7ff3c37ff700 1 --2- 172.21.15.57:0/2425127229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3bc1015f0 0x7ff3bc109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.010+0000 7ff3c37ff700 1 -- 172.21.15.57:0/2425127229 >> 172.21.15.57:0/2425127229 conn(0x7ff3bc0fa4b0 msgr2=0x7ff3bc0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.010+0000 7ff3c37ff700 1 -- 172.21.15.57:0/2425127229 shutdown_connections 2023-03-02T10:59:30.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.010+0000 7ff3c37ff700 1 -- 172.21.15.57:0/2425127229 wait complete. 2023-03-02T10:59:30.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.011+0000 7ff3c37ff700 1 Processor -- start 2023-03-02T10:59:30.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c37ff700 1 -- start start 2023-03-02T10:59:30.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c37ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3bc100ce0 0x7ff3bc19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c37ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3bc1015f0 0x7ff3bc19bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c37ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3bc10a020 0x7ff3bc195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c37ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc196260 con 0x7ff3bc1015f0 2023-03-02T10:59:30.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c37ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc1963d0 con 0x7ff3bc100ce0 2023-03-02T10:59:30.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c37ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc196590 con 0x7ff3bc10a020 2023-03-02T10:59:30.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c159b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3bc100ce0 0x7ff3bc19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c159b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3bc100ce0 0x7ff3bc19bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:57908/0 (socket says 172.21.15.57:57908) 2023-03-02T10:59:30.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c0d9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3bc1015f0 0x7ff3bc19bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c159b700 1 -- 172.21.15.57:0/3600127299 learned_addr learned my addr 172.21.15.57:0/3600127299 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.012+0000 7ff3c1d9c700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3bc10a020 0x7ff3bc195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3c159b700 1 -- 172.21.15.57:0/3600127299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3bc10a020 msgr2=0x7ff3bc195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3c159b700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3bc10a020 0x7ff3bc195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3c159b700 1 -- 172.21.15.57:0/3600127299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3bc1015f0 msgr2=0x7ff3bc19bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3c159b700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3bc1015f0 0x7ff3bc19bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3c159b700 1 -- 172.21.15.57:0/3600127299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b80095f0 con 0x7ff3bc100ce0 2023-03-02T10:59:30.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3c0d9a700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3bc1015f0 0x7ff3bc19bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:30.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3c159b700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3bc100ce0 0x7ff3bc19bab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8000c00 tx=0x7ff3b80047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3b27fc700 1 -- 172.21.15.57:0/3600127299 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b801d070 con 0x7ff3bc100ce0 2023-03-02T10:59:30.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3c37ff700 1 -- 172.21.15.57:0/3600127299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc10fac0 con 0x7ff3bc100ce0 2023-03-02T10:59:30.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3b27fc700 1 -- 172.21.15.57:0/3600127299 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3b8021410 con 0x7ff3bc100ce0 2023-03-02T10:59:30.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3c37ff700 1 -- 172.21.15.57:0/3600127299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc10f930 con 0x7ff3bc100ce0 2023-03-02T10:59:30.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.013+0000 7ff3b27fc700 1 -- 172.21.15.57:0/3600127299 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80175f0 con 0x7ff3bc100ce0 2023-03-02T10:59:30.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.016+0000 7ff3b27fc700 1 -- 172.21.15.57:0/3600127299 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7ff3b8028030 con 0x7ff3bc100ce0 2023-03-02T10:59:30.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.017+0000 7ff3d71acb80 1 Processor -- start 2023-03-02T10:59:30.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.017+0000 7ff3b27fc700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff3a809b480 0x7ff3a809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.017+0000 7ff3d71acb80 1 -- start start 2023-03-02T10:59:30.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3c1d9c700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff3a809b480 0x7ff3a809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3b27fc700 1 -- 172.21.15.57:0/3600127299 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7ff3b80c61c0 con 0x7ff3bc100ce0 2023-03-02T10:59:30.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471801ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718020e0 0x55a471805fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a471806520 0x55a471806970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a471764a60 con 0x55a4718017d0 2023-03-02T10:59:30.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a471716f80 con 0x55a4718020e0 2023-03-02T10:59:30.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4716e7160 con 0x55a471806520 2023-03-02T10:59:30.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3c159b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471801ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3c159b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471801ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57222/0 (socket says 172.21.15.57:57222) 2023-03-02T10:59:30.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3c159b700 1 -- 172.21.15.57:0/194067965 learned_addr learned my addr 172.21.15.57:0/194067965 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3c1d9c700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff3a809b480 0x7ff3a809d930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc19c740 tx=0x7ff3b4009100 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3c0d9a700 1 --2- 172.21.15.57:0/194067965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718020e0 0x55a471805fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3c159b700 1 -- 172.21.15.57:0/194067965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a471806520 msgr2=0x55a471806970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3c159b700 1 --2- 172.21.15.57:0/194067965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a471806520 0x55a471806970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3c159b700 1 -- 172.21.15.57:0/194067965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718020e0 msgr2=0x55a471805fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3c159b700 1 --2- 172.21.15.57:0/194067965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718020e0 0x55a471805fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.018+0000 7ff3c159b700 1 -- 172.21.15.57:0/194067965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4715d1630 con 0x55a4718017d0 2023-03-02T10:59:30.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.019+0000 7ff3c159b700 1 --2- 172.21.15.57:0/194067965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471801ba0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8006010 tx=0x7ff3b80c3db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49d1b165a49c295 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.019+0000 7ff3a77fe700 1 -- 172.21.15.57:0/194067965 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8095dd0 con 0x55a4718017d0 2023-03-02T10:59:30.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.019+0000 7ff3a77fe700 1 -- 172.21.15.57:0/194067965 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3b80956d0 con 0x55a4718017d0 2023-03-02T10:59:30.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.019+0000 7ff3a77fe700 1 -- 172.21.15.57:0/194067965 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8095b30 con 0x55a4718017d0 2023-03-02T10:59:30.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.019+0000 7ff3d71acb80 1 -- 172.21.15.57:0/194067965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 msgr2=0x55a471801ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.019+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/194067965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471801ba0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8006010 tx=0x7ff3b80c3db0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.019+0000 7ff3d71acb80 1 -- 172.21.15.57:0/194067965 shutdown_connections 2023-03-02T10:59:30.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.019+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/194067965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a471806520 0x55a471806970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.019+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/194067965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471801ba0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.019+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/194067965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718020e0 0x55a471805fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.019+0000 7ff3d71acb80 1 -- 172.21.15.57:0/194067965 >> 172.21.15.57:0/194067965 conn(0x55a4717f2c50 msgr2=0x55a4717f8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.020+0000 7ff3d71acb80 1 -- 172.21.15.57:0/194067965 shutdown_connections 2023-03-02T10:59:30.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.020+0000 7ff3d71acb80 1 -- 172.21.15.57:0/194067965 wait complete. 2023-03-02T10:59:30.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.020+0000 7ff3d71acb80 1 -- start start 2023-03-02T10:59:30.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.020+0000 7ff3d71acb80 1 Processor -- start 2023-03-02T10:59:30.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.020+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718017d0 0x55a47180dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.020+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718020e0 0x55a47180ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.020+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a471806520 0x55a47180b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.020+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a471755bc0 con 0x55a4718020e0 2023-03-02T10:59:30.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.020+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47174f0f0 con 0x55a4718017d0 2023-03-02T10:59:30.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.020+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4715d3920 con 0x55a471806520 2023-03-02T10:59:30.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3d71acb80 10 client.0 _ll_register_callbacks cb 0x55a4716f5520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:30.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c159b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718017d0 0x55a47180dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c0d9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718020e0 0x55a47180ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c159b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718017d0 0x55a47180dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:57932/0 (socket says 172.21.15.57:57932) 2023-03-02T10:59:30.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c159b700 1 -- 172.21.15.57:0/1525462410 learned_addr learned my addr 172.21.15.57:0/1525462410 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c1d9c700 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a471806520 0x55a47180b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c0d9a700 1 -- 172.21.15.57:0/1525462410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a471806520 msgr2=0x55a47180b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c0d9a700 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a471806520 0x55a47180b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c0d9a700 1 -- 172.21.15.57:0/1525462410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718017d0 msgr2=0x55a47180dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c0d9a700 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718017d0 0x55a47180dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c0d9a700 1 -- 172.21.15.57:0/1525462410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc10f930 con 0x55a4718020e0 2023-03-02T10:59:30.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c159b700 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718017d0 0x55a47180dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:30.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3c0d9a700 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718020e0 0x55a47180ae80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc197350 tx=0x7ff3ac009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c30f92335e0053 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:30.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/1525462410 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac017070 con 0x55a4718020e0 2023-03-02T10:59:30.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/1525462410 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7ff3ac004050 con 0x55a4718020e0 2023-03-02T10:59:30.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.021+0000 7ff3d71acb80 1 -- 172.21.15.57:0/1525462410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4717207b0 con 0x55a4718020e0 2023-03-02T10:59:30.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.022+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/1525462410 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3ac004210 con 0x55a4718020e0 2023-03-02T10:59:30.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.022+0000 7ff3d71acb80 10 client.16071 fetch_fsmap learned FSMap version 38 2023-03-02T10:59:30.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.022+0000 7ff3d71acb80 1 -- 172.21.15.57:0/1525462410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55a47157dde0 con 0x55a4718020e0 2023-03-02T10:59:30.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.022+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/1525462410 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3ac028080 con 0x55a4718020e0 2023-03-02T10:59:30.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.022+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/1525462410 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 38) v1 ==== 7482+0+0 (secure 0 0 0) 0x7ff3ac022030 con 0x55a4718020e0 2023-03-02T10:59:30.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.022+0000 7ff3d71acb80 10 client.16071 fetch_fsmap finished waiting for FSMap version 38 2023-03-02T10:59:30.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.022+0000 7ff3d71acb80 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T10:59:30.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.022+0000 7ff3d71acb80 20 client.16071 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:30.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.022+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a47181b280 0x55a47181d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.022+0000 7ff3d71acb80 4 client.16071 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:59:30.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.022+0000 7ff3d71acb80 1 -- 172.21.15.57:0/1525462410 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a471748170 con 0x55a47181b280 2023-03-02T10:59:30.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.023+0000 7ff3c159b700 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a47181b280 0x55a47181d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.023+0000 7ff3c159b700 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a47181b280 0x55a47181d690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c45cab702ed4ab server_cookie=c6c93cda705304c in_seq=0 out_seq=0 2023-03-02T10:59:30.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.023+0000 7ff3a4ff9700 10 client.16071 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:30.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/1525462410 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55a471748170 con 0x55a47181b280 2023-03-02T10:59:30.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3a4ff9700 10 client.16071 handle_command_reply: tid=0 2023-03-02T10:59:30.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 1 client.16071 shutdown 2023-03-02T10:59:30.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 1 -- 172.21.15.57:0/1525462410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718020e0 msgr2=0x55a47180ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718020e0 0x55a47180ae80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc197350 tx=0x7ff3ac009d40 comp rx=0 tx=0).stop 2023-03-02T10:59:30.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 1 -- 172.21.15.57:0/1525462410 shutdown_connections 2023-03-02T10:59:30.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a47181b280 0x55a47181d690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a471806520 0x55a47180b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718017d0 0x55a47180dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3a4ff9700 0 client.16071 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:30.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/1525462410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718020e0 0x55a47180ae80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 1 -- 172.21.15.57:0/1525462410 >> 172.21.15.57:0/1525462410 conn(0x55a4717f2c50 msgr2=0x55a4717f8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 1 -- 172.21.15.57:0/1525462410 shutdown_connections 2023-03-02T10:59:30.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 1 -- 172.21.15.57:0/1525462410 wait complete. 2023-03-02T10:59:30.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.024+0000 7ff3d71acb80 20 client.16071 trim_cache size 0 max 16384 2023-03-02T10:59:30.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3d71acb80 1 Processor -- start 2023-03-02T10:59:30.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3d71acb80 1 -- start start 2023-03-02T10:59:30.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4718017d0 0x55a47180a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718020e0 0x55a47180d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a471806520 0x55a471816960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4717f97d0 con 0x55a471806520 2023-03-02T10:59:30.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a471802830 con 0x55a4718020e0 2023-03-02T10:59:30.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4717f27d0 con 0x55a4718017d0 2023-03-02T10:59:30.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3c1d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a471806520 0x55a471816960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3c1d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a471806520 0x55a471816960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57246/0 (socket says 172.21.15.57:57246) 2023-03-02T10:59:30.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3c1d9c700 1 -- 172.21.15.57:0/3769277044 learned_addr learned my addr 172.21.15.57:0/3769277044 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.037+0000 7ff3c0d9a700 1 --2- 172.21.15.57:0/3769277044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718020e0 0x55a47180d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.038+0000 7ff3c159b700 1 --2- 172.21.15.57:0/3769277044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4718017d0 0x55a47180a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.038+0000 7ff3c1d9c700 1 -- 172.21.15.57:0/3769277044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4718017d0 msgr2=0x55a47180a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.038+0000 7ff3c1d9c700 1 --2- 172.21.15.57:0/3769277044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4718017d0 0x55a47180a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.038+0000 7ff3c1d9c700 1 -- 172.21.15.57:0/3769277044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718020e0 msgr2=0x55a47180d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.038+0000 7ff3c1d9c700 1 --2- 172.21.15.57:0/3769277044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718020e0 0x55a47180d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.038+0000 7ff3c1d9c700 1 -- 172.21.15.57:0/3769277044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a471716190 con 0x55a471806520 2023-03-02T10:59:30.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.038+0000 7ff3c0d9a700 1 --2- 172.21.15.57:0/3769277044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718020e0 0x55a47180d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:30.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.038+0000 7ff3c1d9c700 1 --2- 172.21.15.57:0/3769277044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a471806520 0x55a471816960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4004790 tx=0x7ff3b4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada227aaab2e7614 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.038+0000 7ff3a7fff700 1 -- 172.21.15.57:0/3769277044 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4015640 con 0x55a471806520 2023-03-02T10:59:30.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.038+0000 7ff3a7fff700 1 -- 172.21.15.57:0/3769277044 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3b401c070 con 0x55a471806520 2023-03-02T10:59:30.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.038+0000 7ff3a7fff700 1 -- 172.21.15.57:0/3769277044 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4021bc0 con 0x55a471806520 2023-03-02T10:59:30.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.039+0000 7ff3d71acb80 1 -- 172.21.15.57:0/3769277044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a471806520 msgr2=0x55a471816960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.039+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/3769277044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a471806520 0x55a471816960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4004790 tx=0x7ff3b4013000 comp rx=0 tx=0).stop 2023-03-02T10:59:30.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.039+0000 7ff3d71acb80 1 -- 172.21.15.57:0/3769277044 shutdown_connections 2023-03-02T10:59:30.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.039+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/3769277044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a471806520 0x55a471816960 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.039+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/3769277044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4718017d0 0x55a47180a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.039+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/3769277044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4718020e0 0x55a47180d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.039+0000 7ff3d71acb80 1 -- 172.21.15.57:0/3769277044 >> 172.21.15.57:0/3769277044 conn(0x55a4717f2c50 msgr2=0x55a4718055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.039+0000 7ff3d71acb80 1 -- 172.21.15.57:0/3769277044 shutdown_connections 2023-03-02T10:59:30.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.039+0000 7ff3d71acb80 1 -- 172.21.15.57:0/3769277044 wait complete. 2023-03-02T10:59:30.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.039+0000 7ff3d71acb80 1 -- start start 2023-03-02T10:59:30.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.039+0000 7ff3d71acb80 1 Processor -- start 2023-03-02T10:59:30.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471812080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4718020e0 0x55a4718103b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3d71acb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a471806520 0x55a4718108f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a471810e80 con 0x55a4718017d0 2023-03-02T10:59:30.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a471810ff0 con 0x55a471806520 2023-03-02T10:59:30.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3d71acb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4718111b0 con 0x55a4718020e0 2023-03-02T10:59:30.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3d71acb80 10 client.0 _ll_register_callbacks cb 0x55a4716f5520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:30.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c159b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471812080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c159b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471812080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57252/0 (socket says 172.21.15.57:57252) 2023-03-02T10:59:30.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c159b700 1 -- 172.21.15.57:0/2114681228 learned_addr learned my addr 172.21.15.57:0/2114681228 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c1d9c700 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a471806520 0x55a4718108f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c0d9a700 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4718020e0 0x55a4718103b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c159b700 1 -- 172.21.15.57:0/2114681228 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4718020e0 msgr2=0x55a4718103b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c159b700 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4718020e0 0x55a4718103b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c159b700 1 -- 172.21.15.57:0/2114681228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a471806520 msgr2=0x55a4718108f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c159b700 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a471806520 0x55a4718108f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c159b700 1 -- 172.21.15.57:0/2114681228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a47157dde0 con 0x55a4718017d0 2023-03-02T10:59:30.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c1d9c700 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a471806520 0x55a4718108f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:30.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3c159b700 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471812080 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8005910 tx=0x7ff3b8005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a024e73d2d07646 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:30.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/2114681228 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8021580 con 0x55a4718017d0 2023-03-02T10:59:30.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.040+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/2114681228 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7ff3b8094bc0 con 0x55a4718017d0 2023-03-02T10:59:30.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3d71acb80 1 -- 172.21.15.57:0/2114681228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff3b80956d0 con 0x55a4718017d0 2023-03-02T10:59:30.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/2114681228 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3b8094d80 con 0x55a4718017d0 2023-03-02T10:59:30.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3d71acb80 10 client.16077 fetch_fsmap learned FSMap version 38 2023-03-02T10:59:30.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3d71acb80 1 -- 172.21.15.57:0/2114681228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7ff3b4004440 con 0x55a4718017d0 2023-03-02T10:59:30.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/2114681228 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3b80956d0 con 0x55a4718017d0 2023-03-02T10:59:30.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/2114681228 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 38) v1 ==== 7482+0+0 (secure 0 0 0) 0x7ff3b809c960 con 0x55a4718017d0 2023-03-02T10:59:30.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3d71acb80 10 client.16077 fetch_fsmap finished waiting for FSMap version 38 2023-03-02T10:59:30.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3d71acb80 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T10:59:30.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3d71acb80 20 client.16077 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:30.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a47186db80 0x55a47186ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3d71acb80 4 client.16077 mds_command: new command op to 24458 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:59:30.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3d71acb80 1 -- 172.21.15.57:0/2114681228 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a471747e90 con 0x55a47186db80 2023-03-02T10:59:30.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.041+0000 7ff3c0d9a700 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a47186db80 0x55a47186ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3c0d9a700 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a47186db80 0x55a47186ff60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e027cf1d2a816d72 server_cookie=75d7d27e811b5530 in_seq=0 out_seq=0 2023-03-02T10:59:30.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3a4ff9700 10 client.16077 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:30.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3a4ff9700 1 -- 172.21.15.57:0/2114681228 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a471747e90 con 0x55a47186db80 2023-03-02T10:59:30.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3a4ff9700 10 client.16077 handle_command_reply: tid=0 2023-03-02T10:59:30.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3d71acb80 1 client.16077 shutdown 2023-03-02T10:59:30.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3d71acb80 1 -- 172.21.15.57:0/2114681228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 msgr2=0x55a471812080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471812080 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8005910 tx=0x7ff3b8005ad0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3d71acb80 1 -- 172.21.15.57:0/2114681228 shutdown_connections 2023-03-02T10:59:30.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a47186db80 0x55a47186ff60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a471806520 0x55a4718108f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a4718017d0 0x55a471812080 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3d71acb80 1 --2- 172.21.15.57:0/2114681228 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a4718020e0 0x55a4718103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3a4ff9700 0 client.16077 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:30.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3d71acb80 1 -- 172.21.15.57:0/2114681228 >> 172.21.15.57:0/2114681228 conn(0x55a4717f2c50 msgr2=0x55a471816960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3d71acb80 1 -- 172.21.15.57:0/2114681228 shutdown_connections 2023-03-02T10:59:30.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.042+0000 7ff3d71acb80 1 -- 172.21.15.57:0/2114681228 wait complete. 2023-03-02T10:59:30.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3d71acb80 20 client.16077 trim_cache size 0 max 16384 2023-03-02T10:59:30.056 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:59:30.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 -- 172.21.15.57:0/3600127299 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff3a809b480 msgr2=0x7ff3a809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff3a809b480 0x7ff3a809d930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc19c740 tx=0x7ff3b4009100 comp rx=0 tx=0).stop 2023-03-02T10:59:30.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 -- 172.21.15.57:0/3600127299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3bc100ce0 msgr2=0x7ff3bc19bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3bc100ce0 0x7ff3bc19bab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8000c00 tx=0x7ff3b80047b0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 -- 172.21.15.57:0/3600127299 shutdown_connections 2023-03-02T10:59:30.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff3a809b480 0x7ff3a809d930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3bc10a020 0x7ff3bc195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3bc100ce0 0x7ff3bc19bab0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 --2- 172.21.15.57:0/3600127299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3bc1015f0 0x7ff3bc19bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 -- 172.21.15.57:0/3600127299 >> 172.21.15.57:0/3600127299 conn(0x7ff3bc0fa4b0 msgr2=0x7ff3bc10c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 -- 172.21.15.57:0/3600127299 shutdown_connections 2023-03-02T10:59:30.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.043+0000 7ff3c37ff700 1 -- 172.21.15.57:0/3600127299 wait complete. 2023-03-02T10:59:30.060 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-03-02T10:59:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:29 smithi136 ceph-mon[125702]: pgmap v79: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 128 MiB/s wr, 318 op/s 2023-03-02T10:59:30.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.255+0000 7faec63ff700 1 -- 172.21.15.57:0/3685418676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faec0105ae0 msgr2=0x7faec0105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.255+0000 7faec63ff700 1 --2- 172.21.15.57:0/3685418676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faec0105ae0 0x7faec0105eb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009990 tx=0x7faeb0009ca0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.255+0000 7faec63ff700 1 -- 172.21.15.57:0/3685418676 shutdown_connections 2023-03-02T10:59:30.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.255+0000 7faec63ff700 1 --2- 172.21.15.57:0/3685418676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faec0100480 0x7faec010c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.255+0000 7faec63ff700 1 --2- 172.21.15.57:0/3685418676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faec0105ae0 0x7faec0105eb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.255+0000 7faec63ff700 1 --2- 172.21.15.57:0/3685418676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faec00ffad0 0x7faec00fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.255+0000 7faec63ff700 1 -- 172.21.15.57:0/3685418676 >> 172.21.15.57:0/3685418676 conn(0x7faec00fb610 msgr2=0x7faec00fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.255+0000 7faec63ff700 1 -- 172.21.15.57:0/3685418676 shutdown_connections 2023-03-02T10:59:30.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.255+0000 7faec63ff700 1 -- 172.21.15.57:0/3685418676 wait complete. 2023-03-02T10:59:30.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faec63ff700 1 Processor -- start 2023-03-02T10:59:30.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faec63ff700 1 -- start start 2023-03-02T10:59:30.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faec63ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faec00ffad0 0x7faec019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faec63ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faec0100480 0x7faec019bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faec63ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faec0105ae0 0x7faec0195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faec63ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec01960d0 con 0x7faec0100480 2023-03-02T10:59:30.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faec63ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec0196240 con 0x7faec0105ae0 2023-03-02T10:59:30.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faec63ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec0196400 con 0x7faec00ffad0 2023-03-02T10:59:30.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faebf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faec0100480 0x7faec019bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faebf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faec0100480 0x7faec019bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57272/0 (socket says 172.21.15.57:57272) 2023-03-02T10:59:30.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faebf7fe700 1 -- 172.21.15.57:0/3845959020 learned_addr learned my addr 172.21.15.57:0/3845959020 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faec499c700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faec0105ae0 0x7faec0195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.256+0000 7faebffff700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faec00ffad0 0x7faec019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.257+0000 7faebf7fe700 1 -- 172.21.15.57:0/3845959020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faec00ffad0 msgr2=0x7faec019b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.257+0000 7faebf7fe700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faec00ffad0 0x7faec019b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.257+0000 7faebf7fe700 1 -- 172.21.15.57:0/3845959020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faec0105ae0 msgr2=0x7faec0195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.257+0000 7faebf7fe700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faec0105ae0 0x7faec0195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.257+0000 7faebf7fe700 1 -- 172.21.15.57:0/3845959020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb00095f0 con 0x7faec0100480 2023-03-02T10:59:30.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.257+0000 7faebf7fe700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faec0100480 0x7faec019bf30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faeb400e9a0 tx=0x7faeb400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.257+0000 7faebd7fa700 1 -- 172.21.15.57:0/3845959020 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4009790 con 0x7faec0100480 2023-03-02T10:59:30.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.257+0000 7faebd7fa700 1 -- 172.21.15.57:0/3845959020 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeb4010430 con 0x7faec0100480 2023-03-02T10:59:30.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.257+0000 7faec63ff700 1 -- 172.21.15.57:0/3845959020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec010fb10 con 0x7faec0100480 2023-03-02T10:59:30.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.257+0000 7faebd7fa700 1 -- 172.21.15.57:0/3845959020 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4018680 con 0x7faec0100480 2023-03-02T10:59:30.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.257+0000 7faec63ff700 1 -- 172.21.15.57:0/3845959020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec010f980 con 0x7faec0100480 2023-03-02T10:59:30.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.259+0000 7faebd7fa700 1 -- 172.21.15.57:0/3845959020 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7faeb400c040 con 0x7faec0100480 2023-03-02T10:59:30.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.260+0000 7faebd7fa700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7faea809b480 0x7faea809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.260+0000 7faebd7fa700 1 -- 172.21.15.57:0/3845959020 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7faeb4014070 con 0x7faec0100480 2023-03-02T10:59:30.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.260+0000 7faebffff700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7faea809b480 0x7faea809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.261+0000 7faed9d2db80 1 Processor -- start 2023-03-02T10:59:30.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.261+0000 7faebffff700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7faea809b480 0x7faea809d930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faeb000b2e0 tx=0x7faeb0005fd0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.261+0000 7faed9d2db80 1 -- start start 2023-03-02T10:59:30.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.261+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a63c0 0x55cfe14a6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.261+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.261+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14ab110 0x55cfe14ab560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faed9d2db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe140da60 con 0x55cfe14a6cd0 2023-03-02T10:59:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faed9d2db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe13bff80 con 0x55cfe14ab110 2023-03-02T10:59:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faed9d2db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe1390160 con 0x55cfe14a63c0 2023-03-02T10:59:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faebf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faebf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57286/0 (socket says 172.21.15.57:57286) 2023-03-02T10:59:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faebf7fe700 1 -- 172.21.15.57:0/2702216211 learned_addr learned my addr 172.21.15.57:0/2702216211 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faec499c700 1 --2- 172.21.15.57:0/2702216211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14ab110 0x55cfe14ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faebffff700 1 --2- 172.21.15.57:0/2702216211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a63c0 0x55cfe14a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faebf7fe700 1 -- 172.21.15.57:0/2702216211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a63c0 msgr2=0x55cfe14a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faebf7fe700 1 --2- 172.21.15.57:0/2702216211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a63c0 0x55cfe14a6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faebf7fe700 1 -- 172.21.15.57:0/2702216211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14ab110 msgr2=0x55cfe14ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faebf7fe700 1 --2- 172.21.15.57:0/2702216211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14ab110 0x55cfe14ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faebf7fe700 1 -- 172.21.15.57:0/2702216211 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfe127a630 con 0x55cfe14a6cd0 2023-03-02T10:59:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faec499c700 1 --2- 172.21.15.57:0/2702216211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14ab110 0x55cfe14ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faebf7fe700 1 --2- 172.21.15.57:0/2702216211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aabd0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c510 tx=0x7faeb4094350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ac935b7d4b15eb server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.262+0000 7faea67fc700 1 -- 172.21.15.57:0/2702216211 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4098170 con 0x55cfe14a6cd0 2023-03-02T10:59:30.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.263+0000 7faea67fc700 1 -- 172.21.15.57:0/2702216211 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeb4094e90 con 0x55cfe14a6cd0 2023-03-02T10:59:30.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.263+0000 7faea67fc700 1 -- 172.21.15.57:0/2702216211 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4093c80 con 0x55cfe14a6cd0 2023-03-02T10:59:30.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.263+0000 7faed9d2db80 1 -- 172.21.15.57:0/2702216211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 msgr2=0x55cfe14aabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.263+0000 7faed9d2db80 1 --2- 172.21.15.57:0/2702216211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aabd0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c510 tx=0x7faeb4094350 comp rx=0 tx=0).stop 2023-03-02T10:59:30.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.263+0000 7faed9d2db80 1 -- 172.21.15.57:0/2702216211 shutdown_connections 2023-03-02T10:59:30.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.263+0000 7faed9d2db80 1 --2- 172.21.15.57:0/2702216211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14ab110 0x55cfe14ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.263+0000 7faed9d2db80 1 --2- 172.21.15.57:0/2702216211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a63c0 0x55cfe14a6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.263+0000 7faed9d2db80 1 --2- 172.21.15.57:0/2702216211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aabd0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.263+0000 7faed9d2db80 1 -- 172.21.15.57:0/2702216211 >> 172.21.15.57:0/2702216211 conn(0x55cfe149bc50 msgr2=0x55cfe14a1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.263+0000 7faed9d2db80 1 -- 172.21.15.57:0/2702216211 shutdown_connections 2023-03-02T10:59:30.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.263+0000 7faed9d2db80 1 -- 172.21.15.57:0/2702216211 wait complete. 2023-03-02T10:59:30.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faed9d2db80 1 -- start start 2023-03-02T10:59:30.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faed9d2db80 1 Processor -- start 2023-03-02T10:59:30.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 0x55cfe14afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a6cd0 0x55cfe14b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faed9d2db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe13febc0 con 0x55cfe14ab110 2023-03-02T10:59:30.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faed9d2db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe13f80f0 con 0x55cfe14a63c0 2023-03-02T10:59:30.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faed9d2db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe127c920 con 0x55cfe14a6cd0 2023-03-02T10:59:30.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faed9d2db80 10 client.0 _ll_register_callbacks cb 0x55cfe139e520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:30.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faec499c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faec499c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57292/0 (socket says 172.21.15.57:57292) 2023-03-02T10:59:30.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faec499c700 1 -- 172.21.15.57:0/2619210553 learned_addr learned my addr 172.21.15.57:0/2619210553 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faebffff700 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 0x55cfe14afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.264+0000 7faebf7fe700 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a6cd0 0x55cfe14b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7faec499c700 1 -- 172.21.15.57:0/2619210553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a6cd0 msgr2=0x55cfe14b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7faec499c700 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a6cd0 0x55cfe14b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7faec499c700 1 -- 172.21.15.57:0/2619210553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 msgr2=0x55cfe14afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7faec499c700 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 0x55cfe14afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7faec499c700 1 -- 172.21.15.57:0/2619210553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb40c4040 con 0x55cfe14ab110 2023-03-02T10:59:30.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7faebffff700 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 0x55cfe14afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:30.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7faebf7fe700 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a6cd0 0x55cfe14b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:30.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7faec499c700 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14b0620 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009f70 tx=0x7faeb80040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1e34dcf5c9b38f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7fae9f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:30.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7fae9f7fe700 1 -- 172.21.15.57:0/2619210553 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8007700 con 0x55cfe14ab110 2023-03-02T10:59:30.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7faed9d2db80 1 -- 172.21.15.57:0/2619210553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cfe13c97b0 con 0x55cfe14ab110 2023-03-02T10:59:30.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7fae9f7fe700 1 -- 172.21.15.57:0/2619210553 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7faeb8007860 con 0x55cfe14ab110 2023-03-02T10:59:30.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7fae9f7fe700 1 -- 172.21.15.57:0/2619210553 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeb8007a20 con 0x55cfe14ab110 2023-03-02T10:59:30.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7faed9d2db80 10 client.16089 fetch_fsmap learned FSMap version 38 2023-03-02T10:59:30.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7faed9d2db80 1 -- 172.21.15.57:0/2619210553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55cfe1226de0 con 0x55cfe14ab110 2023-03-02T10:59:30.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.265+0000 7fae9f7fe700 1 -- 172.21.15.57:0/2619210553 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cfe13c97b0 con 0x55cfe14ab110 2023-03-02T10:59:30.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.266+0000 7fae9f7fe700 1 -- 172.21.15.57:0/2619210553 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 38) v1 ==== 7482+0+0 (secure 0 0 0) 0x7faeb8016cd0 con 0x55cfe14ab110 2023-03-02T10:59:30.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.266+0000 7faed9d2db80 10 client.16089 fetch_fsmap finished waiting for FSMap version 38 2023-03-02T10:59:30.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.266+0000 7faed9d2db80 10 client.16089 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-03-02T10:59:30.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.266+0000 7faed9d2db80 20 client.16089 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.266+0000 7faed9d2db80 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55cfe14c0320 0x55cfe14c2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.266+0000 7faed9d2db80 4 client.16089 mds_command: new command op to 24491 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:59:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.266+0000 7faed9d2db80 1 -- 172.21.15.57:0/2619210553 --> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cfe13f1170 con 0x55cfe14c0320 2023-03-02T10:59:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.266+0000 7faebffff700 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55cfe14c0320 0x55cfe14c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.267+0000 7faebffff700 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55cfe14c0320 0x55cfe14c2730 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=93b607a2d889012d server_cookie=44f89149a233e917 in_seq=0 out_seq=0 2023-03-02T10:59:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.267+0000 7fae9f7fe700 10 client.16089 ms_handle_connect on v2:172.21.15.122:6834/1841258715 2023-03-02T10:59:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.267+0000 7fae9f7fe700 1 -- 172.21.15.57:0/2619210553 <== mds.4 v2:172.21.15.122:6834/1841258715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55cfe13f1170 con 0x55cfe14c0320 2023-03-02T10:59:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.267+0000 7fae9f7fe700 10 client.16089 handle_command_reply: tid=0 2023-03-02T10:59:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.267+0000 7faed9d2db80 1 client.16089 shutdown 2023-03-02T10:59:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7faed9d2db80 1 -- 172.21.15.57:0/2619210553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 msgr2=0x55cfe14b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7faed9d2db80 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14b0620 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009f70 tx=0x7faeb80040f0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7faed9d2db80 1 -- 172.21.15.57:0/2619210553 shutdown_connections 2023-03-02T10:59:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7faed9d2db80 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55cfe14c0320 0x55cfe14c2730 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7faed9d2db80 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14b0620 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7faed9d2db80 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 0x55cfe14afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7faed9d2db80 1 --2- 172.21.15.57:0/2619210553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a6cd0 0x55cfe14b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7fae9f7fe700 0 client.16089 ms_handle_reset on v2:172.21.15.122:6834/1841258715 2023-03-02T10:59:30.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7faed9d2db80 1 -- 172.21.15.57:0/2619210553 >> 172.21.15.57:0/2619210553 conn(0x55cfe149bc50 msgr2=0x55cfe14a0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7faed9d2db80 1 -- 172.21.15.57:0/2619210553 shutdown_connections 2023-03-02T10:59:30.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7faed9d2db80 1 -- 172.21.15.57:0/2619210553 wait complete. 2023-03-02T10:59:30.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.268+0000 7faed9d2db80 20 client.16089 trim_cache size 0 max 16384 2023-03-02T10:59:30.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faed9d2db80 1 Processor -- start 2023-03-02T10:59:30.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faed9d2db80 1 -- start start 2023-03-02T10:59:30.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a63c0 0x55cfe14af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14aa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faed9d2db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe14a7420 con 0x55cfe14ab110 2023-03-02T10:59:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faed9d2db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe14bcc90 con 0x55cfe14a6cd0 2023-03-02T10:59:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faed9d2db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe14c72e0 con 0x55cfe14a63c0 2023-03-02T10:59:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faec499c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faebf7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faebffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a63c0 0x55cfe14af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faebf7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aa0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:58014/0 (socket says 172.21.15.57:58014) 2023-03-02T10:59:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faec499c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14aa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57308/0 (socket says 172.21.15.57:57308) 2023-03-02T10:59:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.281+0000 7faebf7fe700 1 -- 172.21.15.57:0/1136835308 learned_addr learned my addr 172.21.15.57:0/1136835308 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.282+0000 7faebf7fe700 1 -- 172.21.15.57:0/1136835308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a63c0 msgr2=0x55cfe14af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.282+0000 7faebf7fe700 1 --2- 172.21.15.57:0/1136835308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a63c0 0x55cfe14af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.282+0000 7faebf7fe700 1 -- 172.21.15.57:0/1136835308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 msgr2=0x55cfe14aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.282+0000 7faebf7fe700 1 --2- 172.21.15.57:0/1136835308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.282+0000 7faebf7fe700 1 -- 172.21.15.57:0/1136835308 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfe14ab7b0 con 0x55cfe14a6cd0 2023-03-02T10:59:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.282+0000 7faec499c700 1 --2- 172.21.15.57:0/1136835308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.282+0000 7faebffff700 1 --2- 172.21.15.57:0/1136835308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a63c0 0x55cfe14af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.282+0000 7faebf7fe700 1 --2- 172.21.15.57:0/1136835308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aa0e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faeb400e970 tx=0x7faeb4090b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef681d067af67f16 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.282+0000 7faea6ffd700 1 -- 172.21.15.57:0/1136835308 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4094790 con 0x55cfe14a6cd0 2023-03-02T10:59:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.282+0000 7faea6ffd700 1 -- 172.21.15.57:0/1136835308 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeb409beb0 con 0x55cfe14a6cd0 2023-03-02T10:59:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.282+0000 7faea6ffd700 1 -- 172.21.15.57:0/1136835308 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4093ee0 con 0x55cfe14a6cd0 2023-03-02T10:59:30.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.283+0000 7faed9d2db80 1 -- 172.21.15.57:0/1136835308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a6cd0 msgr2=0x55cfe14aa0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.283+0000 7faed9d2db80 1 --2- 172.21.15.57:0/1136835308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aa0e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faeb400e970 tx=0x7faeb4090b60 comp rx=0 tx=0).stop 2023-03-02T10:59:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.283+0000 7faed9d2db80 1 -- 172.21.15.57:0/1136835308 shutdown_connections 2023-03-02T10:59:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.283+0000 7faed9d2db80 1 --2- 172.21.15.57:0/1136835308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14ab110 0x55cfe14aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.283+0000 7faed9d2db80 1 --2- 172.21.15.57:0/1136835308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14a63c0 0x55cfe14af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.283+0000 7faed9d2db80 1 --2- 172.21.15.57:0/1136835308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a6cd0 0x55cfe14aa0e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.283+0000 7faed9d2db80 1 -- 172.21.15.57:0/1136835308 >> 172.21.15.57:0/1136835308 conn(0x55cfe149bc50 msgr2=0x55cfe14bb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.283+0000 7faed9d2db80 1 -- 172.21.15.57:0/1136835308 shutdown_connections 2023-03-02T10:59:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.283+0000 7faed9d2db80 1 -- 172.21.15.57:0/1136835308 wait complete. 2023-03-02T10:59:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.283+0000 7faed9d2db80 1 -- start start 2023-03-02T10:59:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.283+0000 7faed9d2db80 1 Processor -- start 2023-03-02T10:59:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 0x55cfe14b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faed9d2db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14ab110 0x55cfe14b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faed9d2db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe14b58f0 con 0x55cfe14a6cd0 2023-03-02T10:59:30.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faed9d2db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe14b5a60 con 0x55cfe14a63c0 2023-03-02T10:59:30.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faed9d2db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfe14b5c20 con 0x55cfe14ab110 2023-03-02T10:59:30.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faed9d2db80 10 client.0 _ll_register_callbacks cb 0x55cfe139e520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:30.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faebf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faebf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14b6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57310/0 (socket says 172.21.15.57:57310) 2023-03-02T10:59:30.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faebf7fe700 1 -- 172.21.15.57:0/3972737380 learned_addr learned my addr 172.21.15.57:0/3972737380 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faebffff700 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 0x55cfe14b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faec499c700 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14ab110 0x55cfe14b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faebf7fe700 1 -- 172.21.15.57:0/3972737380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14ab110 msgr2=0x55cfe14b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faebf7fe700 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14ab110 0x55cfe14b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faebf7fe700 1 -- 172.21.15.57:0/3972737380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 msgr2=0x55cfe14b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faebf7fe700 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 0x55cfe14b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faebf7fe700 1 -- 172.21.15.57:0/3972737380 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cfe1226de0 con 0x55cfe14a6cd0 2023-03-02T10:59:30.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faec499c700 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14ab110 0x55cfe14b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:59:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faebffff700 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 0x55cfe14b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7faebf7fe700 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14b6f90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c2d0 tx=0x7faeb4094350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9894945ca2e0e1f0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.284+0000 7fae9f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7fae9f7fe700 1 -- 172.21.15.57:0/3972737380 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb409ba20 con 0x55cfe14a6cd0 2023-03-02T10:59:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7fae9f7fe700 1 -- 172.21.15.57:0/3972737380 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7faeb40ac020 con 0x55cfe14a6cd0 2023-03-02T10:59:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7faed9d2db80 1 -- 172.21.15.57:0/3972737380 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faeb4094e90 con 0x55cfe14a6cd0 2023-03-02T10:59:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7fae9f7fe700 1 -- 172.21.15.57:0/3972737380 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeb409bb80 con 0x55cfe14a6cd0 2023-03-02T10:59:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7faed9d2db80 10 client.16095 fetch_fsmap learned FSMap version 38 2023-03-02T10:59:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7faed9d2db80 1 -- 172.21.15.57:0/3972737380 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55cfe127a630 con 0x55cfe14a6cd0 2023-03-02T10:59:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7fae9f7fe700 1 -- 172.21.15.57:0/3972737380 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeb4094e90 con 0x55cfe14a6cd0 2023-03-02T10:59:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7fae9f7fe700 1 -- 172.21.15.57:0/3972737380 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 38) v1 ==== 7482+0+0 (secure 0 0 0) 0x7faeb40be070 con 0x55cfe14a6cd0 2023-03-02T10:59:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7faed9d2db80 10 client.16095 fetch_fsmap finished waiting for FSMap version 38 2023-03-02T10:59:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7faed9d2db80 10 client.16095 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-03-02T10:59:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7faed9d2db80 20 client.16095 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7faed9d2db80 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55cfe1512930 0x55cfe1514d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7faed9d2db80 4 client.16095 mds_command: new command op to 24491 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:59:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.285+0000 7faed9d2db80 1 -- 172.21.15.57:0/3972737380 --> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cfe13f0e90 con 0x55cfe1512930 2023-03-02T10:59:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.286+0000 7faebffff700 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55cfe1512930 0x55cfe1514d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.286+0000 7fae9f7fe700 10 client.16095 ms_handle_connect on v2:172.21.15.122:6834/1841258715 2023-03-02T10:59:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.286+0000 7faebffff700 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55cfe1512930 0x55cfe1514d10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=acf87dbca82e8c9a server_cookie=f8491808ac715e6b in_seq=0 out_seq=0 2023-03-02T10:59:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.286+0000 7fae9f7fe700 1 -- 172.21.15.57:0/3972737380 <== mds.4 v2:172.21.15.122:6834/1841258715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cfe13f0e90 con 0x55cfe1512930 2023-03-02T10:59:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.286+0000 7fae9f7fe700 10 client.16095 handle_command_reply: tid=0 2023-03-02T10:59:30.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.286+0000 7faed9d2db80 1 client.16095 shutdown 2023-03-02T10:59:30.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.286+0000 7faed9d2db80 1 -- 172.21.15.57:0/3972737380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 msgr2=0x55cfe14b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.286+0000 7faed9d2db80 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14b6f90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c2d0 tx=0x7faeb4094350 comp rx=0 tx=0).stop 2023-03-02T10:59:30.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faed9d2db80 1 -- 172.21.15.57:0/3972737380 shutdown_connections 2023-03-02T10:59:30.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faed9d2db80 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.122:6834/1841258715,v1:172.21.15.122:6835/1841258715] conn(0x55cfe1512930 0x55cfe1514d10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faed9d2db80 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cfe14ab110 0x55cfe14b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faed9d2db80 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfe14a63c0 0x55cfe14b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7fae9f7fe700 0 client.16095 ms_handle_reset on v2:172.21.15.122:6834/1841258715 2023-03-02T10:59:30.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faed9d2db80 1 --2- 172.21.15.57:0/3972737380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cfe14a6cd0 0x55cfe14b6f90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faed9d2db80 1 -- 172.21.15.57:0/3972737380 >> 172.21.15.57:0/3972737380 conn(0x55cfe149bc50 msgr2=0x55cfe14aa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faed9d2db80 1 -- 172.21.15.57:0/3972737380 shutdown_connections 2023-03-02T10:59:30.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faed9d2db80 1 -- 172.21.15.57:0/3972737380 wait complete. 2023-03-02T10:59:30.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faed9d2db80 20 client.16095 trim_cache size 0 max 16384 2023-03-02T10:59:30.300 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:59:30.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 -- 172.21.15.57:0/3845959020 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7faea809b480 msgr2=0x7faea809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7faea809b480 0x7faea809d930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faeb000b2e0 tx=0x7faeb0005fd0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 -- 172.21.15.57:0/3845959020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faec0100480 msgr2=0x7faec019bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faec0100480 0x7faec019bf30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faeb400e9a0 tx=0x7faeb400ecb0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 -- 172.21.15.57:0/3845959020 shutdown_connections 2023-03-02T10:59:30.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7faea809b480 0x7faea809d930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faec0105ae0 0x7faec0195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faec00ffad0 0x7faec019b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 --2- 172.21.15.57:0/3845959020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faec0100480 0x7faec019bf30 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 -- 172.21.15.57:0/3845959020 >> 172.21.15.57:0/3845959020 conn(0x7faec00fb610 msgr2=0x7faec00fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 -- 172.21.15.57:0/3845959020 shutdown_connections 2023-03-02T10:59:30.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.287+0000 7faec63ff700 1 -- 172.21.15.57:0/3845959020 wait complete. 2023-03-02T10:59:30.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-03-02T10:59:30.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.458+0000 7f02095ff700 1 -- 172.21.15.57:0/4046606039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0204105ac0 msgr2=0x7f0204105e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.458+0000 7f02095ff700 1 --2- 172.21.15.57:0/4046606039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0204105ac0 0x7f0204105e90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009990 tx=0x7f01f4009ca0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.458+0000 7f02095ff700 1 -- 172.21.15.57:0/4046606039 shutdown_connections 2023-03-02T10:59:30.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.458+0000 7f02095ff700 1 --2- 172.21.15.57:0/4046606039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0204100460 0x7f020410c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.458+0000 7f02095ff700 1 --2- 172.21.15.57:0/4046606039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0204105ac0 0x7f0204105e90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.458+0000 7f02095ff700 1 --2- 172.21.15.57:0/4046606039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02040ffab0 0x7f02040fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.458+0000 7f02095ff700 1 -- 172.21.15.57:0/4046606039 >> 172.21.15.57:0/4046606039 conn(0x7f02040fb5d0 msgr2=0x7f02040fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.458+0000 7f02095ff700 1 -- 172.21.15.57:0/4046606039 shutdown_connections 2023-03-02T10:59:30.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.458+0000 7f02095ff700 1 -- 172.21.15.57:0/4046606039 wait complete. 2023-03-02T10:59:30.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.459+0000 7f02095ff700 1 Processor -- start 2023-03-02T10:59:30.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.459+0000 7f02095ff700 1 -- start start 2023-03-02T10:59:30.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.459+0000 7f02095ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02040ffab0 0x7f0204072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.459+0000 7f02095ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0204100460 0x7f0204072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.459+0000 7f02095ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0204105ac0 0x7f02041a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.459+0000 7f02095ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0204073600 con 0x7f02040ffab0 2023-03-02T10:59:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.459+0000 7f02095ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02041a4280 con 0x7f0204105ac0 2023-03-02T10:59:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.459+0000 7f02095ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02041a43c0 con 0x7f0204100460 2023-03-02T10:59:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.459+0000 7f0202ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02040ffab0 0x7f0204072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.459+0000 7f0202ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02040ffab0 0x7f0204072890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57318/0 (socket says 172.21.15.57:57318) 2023-03-02T10:59:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.459+0000 7f0202ffd700 1 -- 172.21.15.57:0/1825617975 learned_addr learned my addr 172.21.15.57:0/1825617975 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f02027fc700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0204100460 0x7f0204072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f02037fe700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0204105ac0 0x7f02041a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f0202ffd700 1 -- 172.21.15.57:0/1825617975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0204100460 msgr2=0x7f0204072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f0202ffd700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0204100460 0x7f0204072dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f0202ffd700 1 -- 172.21.15.57:0/1825617975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0204105ac0 msgr2=0x7f02041a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f0202ffd700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0204105ac0 0x7f02041a3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f0202ffd700 1 -- 172.21.15.57:0/1825617975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40095f0 con 0x7f02040ffab0 2023-03-02T10:59:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f0202ffd700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02040ffab0 0x7f0204072890 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f01f4000c00 tx=0x7f01f4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f01ebfff700 1 -- 172.21.15.57:0/1825617975 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f401d070 con 0x7f02040ffab0 2023-03-02T10:59:30.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f01ebfff700 1 -- 172.21.15.57:0/1825617975 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01f4022470 con 0x7f02040ffab0 2023-03-02T10:59:30.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f02095ff700 1 -- 172.21.15.57:0/1825617975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020410fb10 con 0x7f02040ffab0 2023-03-02T10:59:30.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f01ebfff700 1 -- 172.21.15.57:0/1825617975 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f4017670 con 0x7f02040ffab0 2023-03-02T10:59:30.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.460+0000 7f02095ff700 1 -- 172.21.15.57:0/1825617975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020410f980 con 0x7f02040ffab0 2023-03-02T10:59:30.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.463+0000 7f01ebfff700 1 -- 172.21.15.57:0/1825617975 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f01f4029030 con 0x7f02040ffab0 2023-03-02T10:59:30.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.464+0000 7f01ebfff700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01ec09b500 0x7f01ec09d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.464+0000 7f01ebfff700 1 -- 172.21.15.57:0/1825617975 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f01f40c62b0 con 0x7f02040ffab0 2023-03-02T10:59:30.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.464+0000 7f02027fc700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01ec09b500 0x7f01ec09d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.464+0000 7f021cf34b80 1 Processor -- start 2023-03-02T10:59:30.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.464+0000 7f021cf34b80 1 -- start start 2023-03-02T10:59:30.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.464+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c03c0 0x55e83d3c0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.464+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c0cd0 0x55e83d3c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.464+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c5110 0x55e83d3c5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.464+0000 7f021cf34b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d327a60 con 0x55e83d3c03c0 2023-03-02T10:59:30.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.464+0000 7f021cf34b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d2d9f80 con 0x55e83d3c5110 2023-03-02T10:59:30.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.464+0000 7f021cf34b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d2aa160 con 0x55e83d3c0cd0 2023-03-02T10:59:30.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f02027fc700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01ec09b500 0x7f01ec09d9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0204074080 tx=0x7f01f8009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f0202ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c03c0 0x55e83d3c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f0202ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c03c0 0x55e83d3c0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57332/0 (socket says 172.21.15.57:57332) 2023-03-02T10:59:30.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f0202ffd700 1 -- 172.21.15.57:0/3965875155 learned_addr learned my addr 172.21.15.57:0/3965875155 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f02027fc700 1 --2- 172.21.15.57:0/3965875155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c0cd0 0x55e83d3c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f02037fe700 1 --2- 172.21.15.57:0/3965875155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c5110 0x55e83d3c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f0202ffd700 1 -- 172.21.15.57:0/3965875155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c0cd0 msgr2=0x55e83d3c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f0202ffd700 1 --2- 172.21.15.57:0/3965875155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c0cd0 0x55e83d3c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f0202ffd700 1 -- 172.21.15.57:0/3965875155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c5110 msgr2=0x55e83d3c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f0202ffd700 1 --2- 172.21.15.57:0/3965875155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c5110 0x55e83d3c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f0202ffd700 1 -- 172.21.15.57:0/3965875155 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e83d194630 con 0x55e83d3c03c0 2023-03-02T10:59:30.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f0202ffd700 1 --2- 172.21.15.57:0/3965875155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c03c0 0x55e83d3c0790 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005d90 tx=0x7f01f4091400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9da5dc7f720463c server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f01e97fa700 1 -- 172.21.15.57:0/3965875155 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f40c6070 con 0x55e83d3c03c0 2023-03-02T10:59:30.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f01e97fa700 1 -- 172.21.15.57:0/3965875155 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01f4095760 con 0x55e83d3c03c0 2023-03-02T10:59:30.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.465+0000 7f01e97fa700 1 -- 172.21.15.57:0/3965875155 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f40959c0 con 0x55e83d3c03c0 2023-03-02T10:59:30.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.466+0000 7f021cf34b80 1 -- 172.21.15.57:0/3965875155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c03c0 msgr2=0x55e83d3c0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.466+0000 7f021cf34b80 1 --2- 172.21.15.57:0/3965875155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c03c0 0x55e83d3c0790 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005d90 tx=0x7f01f4091400 comp rx=0 tx=0).stop 2023-03-02T10:59:30.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.466+0000 7f021cf34b80 1 -- 172.21.15.57:0/3965875155 shutdown_connections 2023-03-02T10:59:30.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.466+0000 7f021cf34b80 1 --2- 172.21.15.57:0/3965875155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c5110 0x55e83d3c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.466+0000 7f021cf34b80 1 --2- 172.21.15.57:0/3965875155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c03c0 0x55e83d3c0790 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.466+0000 7f021cf34b80 1 --2- 172.21.15.57:0/3965875155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c0cd0 0x55e83d3c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.466+0000 7f021cf34b80 1 -- 172.21.15.57:0/3965875155 >> 172.21.15.57:0/3965875155 conn(0x55e83d3b5c50 msgr2=0x55e83d3bb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.466+0000 7f021cf34b80 1 -- 172.21.15.57:0/3965875155 shutdown_connections 2023-03-02T10:59:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.466+0000 7f021cf34b80 1 -- 172.21.15.57:0/3965875155 wait complete. 2023-03-02T10:59:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.466+0000 7f021cf34b80 1 -- start start 2023-03-02T10:59:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f021cf34b80 1 Processor -- start 2023-03-02T10:59:30.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c03c0 0x55e83d3cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c0cd0 0x55e83d3c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f021cf34b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d318bc0 con 0x55e83d3c5110 2023-03-02T10:59:30.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f021cf34b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d3120f0 con 0x55e83d3c03c0 2023-03-02T10:59:30.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f021cf34b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d196920 con 0x55e83d3c0cd0 2023-03-02T10:59:30.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f021cf34b80 10 client.0 _ll_register_callbacks cb 0x55e83d2b8520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:30.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f02037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f02037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3ca0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57342/0 (socket says 172.21.15.57:57342) 2023-03-02T10:59:30.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f02037fe700 1 -- 172.21.15.57:0/4224946011 learned_addr learned my addr 172.21.15.57:0/4224946011 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f02027fc700 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c0cd0 0x55e83d3c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.467+0000 7f0202ffd700 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c03c0 0x55e83d3cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f02037fe700 1 -- 172.21.15.57:0/4224946011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c0cd0 msgr2=0x55e83d3c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f02037fe700 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c0cd0 0x55e83d3c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f02037fe700 1 -- 172.21.15.57:0/4224946011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c03c0 msgr2=0x55e83d3cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f02037fe700 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c03c0 0x55e83d3cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f02037fe700 1 -- 172.21.15.57:0/4224946011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020410f980 con 0x55e83d3c5110 2023-03-02T10:59:30.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f0202ffd700 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c03c0 0x55e83d3cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:30.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f02037fe700 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3ca0e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f01fc012e20 tx=0x7f01fc014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab91ea154329df8 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f01e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:30.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f01e6ff5700 1 -- 172.21.15.57:0/4224946011 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc00e040 con 0x55e83d3c5110 2023-03-02T10:59:30.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f021cf34b80 1 -- 172.21.15.57:0/4224946011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e83d2e37b0 con 0x55e83d3c5110 2023-03-02T10:59:30.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f01e6ff5700 1 -- 172.21.15.57:0/4224946011 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f01fc014b90 con 0x55e83d3c5110 2023-03-02T10:59:30.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f01e6ff5700 1 -- 172.21.15.57:0/4224946011 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01fc014d50 con 0x55e83d3c5110 2023-03-02T10:59:30.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f021cf34b80 10 client.16107 fetch_fsmap learned FSMap version 38 2023-03-02T10:59:30.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f021cf34b80 1 -- 172.21.15.57:0/4224946011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55e83d140de0 con 0x55e83d3c5110 2023-03-02T10:59:30.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f01e6ff5700 1 -- 172.21.15.57:0/4224946011 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01fc02a080 con 0x55e83d3c5110 2023-03-02T10:59:30.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.468+0000 7f01e6ff5700 1 -- 172.21.15.57:0/4224946011 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 38) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f01fc024030 con 0x55e83d3c5110 2023-03-02T10:59:30.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.469+0000 7f021cf34b80 10 client.16107 fetch_fsmap finished waiting for FSMap version 38 2023-03-02T10:59:30.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.469+0000 7f021cf34b80 10 client.16107 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-02T10:59:30.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.469+0000 7f021cf34b80 20 client.16107 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:30.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.469+0000 7f021cf34b80 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55e83d3d9fb0 0x55e83d3dc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.469+0000 7f021cf34b80 4 client.16107 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:59:30.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.469+0000 7f021cf34b80 1 -- 172.21.15.57:0/4224946011 --> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e83d30b170 con 0x55e83d3d9fb0 2023-03-02T10:59:30.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.469+0000 7f0202ffd700 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55e83d3d9fb0 0x55e83d3dc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.469+0000 7f0202ffd700 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55e83d3d9fb0 0x55e83d3dc3c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5bd063212cf830f6 server_cookie=e039a5da508c3726 in_seq=0 out_seq=0 2023-03-02T10:59:30.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.469+0000 7f01e6ff5700 10 client.16107 ms_handle_connect on v2:172.21.15.136:6834/2199127047 2023-03-02T10:59:30.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f01e6ff5700 1 -- 172.21.15.57:0/4224946011 <== mds.3 v2:172.21.15.136:6834/2199127047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55e83d30b170 con 0x55e83d3d9fb0 2023-03-02T10:59:30.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f01e6ff5700 10 client.16107 handle_command_reply: tid=0 2023-03-02T10:59:30.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f021cf34b80 1 client.16107 shutdown 2023-03-02T10:59:30.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f021cf34b80 1 -- 172.21.15.57:0/4224946011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 msgr2=0x55e83d3ca0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f021cf34b80 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3ca0e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f01fc012e20 tx=0x7f01fc014600 comp rx=0 tx=0).stop 2023-03-02T10:59:30.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f021cf34b80 1 -- 172.21.15.57:0/4224946011 shutdown_connections 2023-03-02T10:59:30.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f021cf34b80 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55e83d3d9fb0 0x55e83d3dc3c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f021cf34b80 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3ca0e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f021cf34b80 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c03c0 0x55e83d3cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f01e6ff5700 0 client.16107 ms_handle_reset on v2:172.21.15.136:6834/2199127047 2023-03-02T10:59:30.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f021cf34b80 1 --2- 172.21.15.57:0/4224946011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c0cd0 0x55e83d3c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.470+0000 7f021cf34b80 1 -- 172.21.15.57:0/4224946011 >> 172.21.15.57:0/4224946011 conn(0x55e83d3b5c50 msgr2=0x55e83d3bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.471+0000 7f021cf34b80 1 -- 172.21.15.57:0/4224946011 shutdown_connections 2023-03-02T10:59:30.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.471+0000 7f021cf34b80 1 -- 172.21.15.57:0/4224946011 wait complete. 2023-03-02T10:59:30.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.471+0000 7f021cf34b80 20 client.16107 trim_cache size 0 max 16384 2023-03-02T10:59:30.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.483+0000 7f021cf34b80 1 Processor -- start 2023-03-02T10:59:30.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.483+0000 7f021cf34b80 1 -- start start 2023-03-02T10:59:30.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c03c0 0x55e83d3c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c0cd0 0x55e83d3cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c5110 0x55e83d3c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f021cf34b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d3c8060 con 0x55e83d3c0cd0 2023-03-02T10:59:30.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f021cf34b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d3dc390 con 0x55e83d3c03c0 2023-03-02T10:59:30.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f021cf34b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d3c09e0 con 0x55e83d3c5110 2023-03-02T10:59:30.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f02027fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c0cd0 0x55e83d3cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f02027fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c0cd0 0x55e83d3cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57344/0 (socket says 172.21.15.57:57344) 2023-03-02T10:59:30.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f02027fc700 1 -- 172.21.15.57:0/3455383108 learned_addr learned my addr 172.21.15.57:0/3455383108 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f0202ffd700 1 --2- 172.21.15.57:0/3455383108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c03c0 0x55e83d3c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f02037fe700 1 --2- 172.21.15.57:0/3455383108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c5110 0x55e83d3c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f02027fc700 1 -- 172.21.15.57:0/3455383108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c5110 msgr2=0x55e83d3c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f02027fc700 1 --2- 172.21.15.57:0/3455383108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c5110 0x55e83d3c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f02027fc700 1 -- 172.21.15.57:0/3455383108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c03c0 msgr2=0x55e83d3c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f02027fc700 1 --2- 172.21.15.57:0/3455383108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c03c0 0x55e83d3c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f02027fc700 1 -- 172.21.15.57:0/3455383108 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e83d3e0fb0 con 0x55e83d3c0cd0 2023-03-02T10:59:30.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.484+0000 7f02027fc700 1 --2- 172.21.15.57:0/3455383108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c0cd0 0x55e83d3cc3b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f01f8011f60 tx=0x7f01f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81c192399003f65 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f01e9ffb700 1 -- 172.21.15.57:0/3455383108 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8022030 con 0x55e83d3c0cd0 2023-03-02T10:59:30.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f01e9ffb700 1 -- 172.21.15.57:0/3455383108 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01f8023040 con 0x55e83d3c0cd0 2023-03-02T10:59:30.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f01e9ffb700 1 -- 172.21.15.57:0/3455383108 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f801dc20 con 0x55e83d3c0cd0 2023-03-02T10:59:30.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f021cf34b80 1 -- 172.21.15.57:0/3455383108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c0cd0 msgr2=0x55e83d3cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f021cf34b80 1 --2- 172.21.15.57:0/3455383108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c0cd0 0x55e83d3cc3b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f01f8011f60 tx=0x7f01f8014000 comp rx=0 tx=0).stop 2023-03-02T10:59:30.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f021cf34b80 1 -- 172.21.15.57:0/3455383108 shutdown_connections 2023-03-02T10:59:30.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f021cf34b80 1 --2- 172.21.15.57:0/3455383108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c5110 0x55e83d3c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f021cf34b80 1 --2- 172.21.15.57:0/3455383108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c03c0 0x55e83d3c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f021cf34b80 1 --2- 172.21.15.57:0/3455383108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c0cd0 0x55e83d3cc3b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f021cf34b80 1 -- 172.21.15.57:0/3455383108 >> 172.21.15.57:0/3455383108 conn(0x55e83d3b5c50 msgr2=0x55e83d3d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f021cf34b80 1 -- 172.21.15.57:0/3455383108 shutdown_connections 2023-03-02T10:59:30.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.485+0000 7f021cf34b80 1 -- 172.21.15.57:0/3455383108 wait complete. 2023-03-02T10:59:30.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f021cf34b80 1 -- start start 2023-03-02T10:59:30.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f021cf34b80 1 Processor -- start 2023-03-02T10:59:30.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c03c0 0x55e83d3d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c0cd0 0x55e83d3cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f021cf34b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f021cf34b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d3cfb10 con 0x55e83d3c5110 2023-03-02T10:59:30.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f021cf34b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d3cfc80 con 0x55e83d3c0cd0 2023-03-02T10:59:30.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f021cf34b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83d3cfe40 con 0x55e83d3c03c0 2023-03-02T10:59:30.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f021cf34b80 10 client.0 _ll_register_callbacks cb 0x55e83d2b8520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:30.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f02037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f02037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57360/0 (socket says 172.21.15.57:57360) 2023-03-02T10:59:30.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.486+0000 7f02037fe700 1 -- 172.21.15.57:0/2825995609 learned_addr learned my addr 172.21.15.57:0/2825995609 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f0202ffd700 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c03c0 0x55e83d3d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f02027fc700 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c0cd0 0x55e83d3cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f02037fe700 1 -- 172.21.15.57:0/2825995609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c03c0 msgr2=0x55e83d3d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f02037fe700 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c03c0 0x55e83d3d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f02037fe700 1 -- 172.21.15.57:0/2825995609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c0cd0 msgr2=0x55e83d3cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f02037fe700 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c0cd0 0x55e83d3cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f02037fe700 1 -- 172.21.15.57:0/2825995609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f8017070 con 0x55e83d3c5110 2023-03-02T10:59:30.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f02027fc700 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c0cd0 0x55e83d3cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-02T10:59:30.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f02037fe700 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3cf5d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0045d0 tx=0x7f01fc009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d100a78b3ff037b3 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f01e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:30.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f01e6ff5700 1 -- 172.21.15.57:0/2825995609 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc00e070 con 0x55e83d3c5110 2023-03-02T10:59:30.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f01e6ff5700 1 -- 172.21.15.57:0/2825995609 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f01fc004c00 con 0x55e83d3c5110 2023-03-02T10:59:30.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f021cf34b80 1 -- 172.21.15.57:0/2825995609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01f4095760 con 0x55e83d3c5110 2023-03-02T10:59:30.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f01e6ff5700 1 -- 172.21.15.57:0/2825995609 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01fc004dc0 con 0x55e83d3c5110 2023-03-02T10:59:30.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f021cf34b80 10 client.16113 fetch_fsmap learned FSMap version 38 2023-03-02T10:59:30.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.487+0000 7f021cf34b80 1 -- 172.21.15.57:0/2825995609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55e83d129c60 con 0x55e83d3c5110 2023-03-02T10:59:30.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.488+0000 7f01e6ff5700 1 -- 172.21.15.57:0/2825995609 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01f4095760 con 0x55e83d3c5110 2023-03-02T10:59:30.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.488+0000 7f01e6ff5700 1 -- 172.21.15.57:0/2825995609 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 38) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f01fc014320 con 0x55e83d3c5110 2023-03-02T10:59:30.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.488+0000 7f021cf34b80 10 client.16113 fetch_fsmap finished waiting for FSMap version 38 2023-03-02T10:59:30.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.488+0000 7f021cf34b80 10 client.16113 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-02T10:59:30.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.488+0000 7f021cf34b80 20 client.16113 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:30.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.488+0000 7f021cf34b80 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55e83d42cb20 0x55e83d42ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.488+0000 7f021cf34b80 4 client.16113 mds_command: new command op to 24493 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:59:30.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.488+0000 7f021cf34b80 1 -- 172.21.15.57:0/2825995609 --> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e83d30ae90 con 0x55e83d42cb20 2023-03-02T10:59:30.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.488+0000 7f0202ffd700 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55e83d42cb20 0x55e83d42ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f01e6ff5700 10 client.16113 ms_handle_connect on v2:172.21.15.136:6834/2199127047 2023-03-02T10:59:30.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f0202ffd700 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55e83d42cb20 0x55e83d42ef00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fce68e93159e037 server_cookie=9881420c3a2be517 in_seq=0 out_seq=0 2023-03-02T10:59:30.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f01e6ff5700 1 -- 172.21.15.57:0/2825995609 <== mds.3 v2:172.21.15.136:6834/2199127047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e83d30ae90 con 0x55e83d42cb20 2023-03-02T10:59:30.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f01e6ff5700 10 client.16113 handle_command_reply: tid=0 2023-03-02T10:59:30.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 1 client.16113 shutdown 2023-03-02T10:59:30.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 1 -- 172.21.15.57:0/2825995609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 msgr2=0x55e83d3cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3cf5d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0045d0 tx=0x7f01fc009e70 comp rx=0 tx=0).stop 2023-03-02T10:59:30.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 1 -- 172.21.15.57:0/2825995609 shutdown_connections 2023-03-02T10:59:30.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.136:6834/2199127047,v1:172.21.15.136:6835/2199127047] conn(0x55e83d42cb20 0x55e83d42ef00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e83d3c5110 0x55e83d3cf5d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e83d3c03c0 0x55e83d3d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f01e6ff5700 0 client.16113 ms_handle_reset on v2:172.21.15.136:6834/2199127047 2023-03-02T10:59:30.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 1 --2- 172.21.15.57:0/2825995609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e83d3c0cd0 0x55e83d3cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 1 -- 172.21.15.57:0/2825995609 >> 172.21.15.57:0/2825995609 conn(0x55e83d3b5c50 msgr2=0x55e83d3c6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 1 -- 172.21.15.57:0/2825995609 shutdown_connections 2023-03-02T10:59:30.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 1 -- 172.21.15.57:0/2825995609 wait complete. 2023-03-02T10:59:30.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.489+0000 7f021cf34b80 20 client.16113 trim_cache size 0 max 16384 2023-03-02T10:59:30.500 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:59:30.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 -- 172.21.15.57:0/1825617975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01ec09b500 msgr2=0x7f01ec09d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01ec09b500 0x7f01ec09d9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0204074080 tx=0x7f01f8009260 comp rx=0 tx=0).stop 2023-03-02T10:59:30.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 -- 172.21.15.57:0/1825617975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02040ffab0 msgr2=0x7f0204072890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02040ffab0 0x7f0204072890 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f01f4000c00 tx=0x7f01f4005740 comp rx=0 tx=0).stop 2023-03-02T10:59:30.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 -- 172.21.15.57:0/1825617975 shutdown_connections 2023-03-02T10:59:30.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f01ec09b500 0x7f01ec09d9b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0204105ac0 0x7f02041a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02040ffab0 0x7f0204072890 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 --2- 172.21.15.57:0/1825617975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0204100460 0x7f0204072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 -- 172.21.15.57:0/1825617975 >> 172.21.15.57:0/1825617975 conn(0x7f02040fb5d0 msgr2=0x7f02041037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 -- 172.21.15.57:0/1825617975 shutdown_connections 2023-03-02T10:59:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.490+0000 7f02095ff700 1 -- 172.21.15.57:0/1825617975 wait complete. 2023-03-02T10:59:30.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-03-02T10:59:30.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.662+0000 7fceaa1ff700 1 -- 172.21.15.57:0/1407386299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcea40ffad0 msgr2=0x7fcea40fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.662+0000 7fceaa1ff700 1 --2- 172.21.15.57:0/1407386299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcea40ffad0 0x7fcea40fff40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009990 tx=0x7fce8c009ca0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.662+0000 7fceaa1ff700 1 -- 172.21.15.57:0/1407386299 shutdown_connections 2023-03-02T10:59:30.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.662+0000 7fceaa1ff700 1 --2- 172.21.15.57:0/1407386299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea4100480 0x7fcea410c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.662+0000 7fceaa1ff700 1 --2- 172.21.15.57:0/1407386299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcea4105ae0 0x7fcea4105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.662+0000 7fceaa1ff700 1 --2- 172.21.15.57:0/1407386299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcea40ffad0 0x7fcea40fff40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.662+0000 7fceaa1ff700 1 -- 172.21.15.57:0/1407386299 >> 172.21.15.57:0/1407386299 conn(0x7fcea40fb610 msgr2=0x7fcea40fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.662+0000 7fceaa1ff700 1 -- 172.21.15.57:0/1407386299 shutdown_connections 2023-03-02T10:59:30.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.662+0000 7fceaa1ff700 1 -- 172.21.15.57:0/1407386299 wait complete. 2023-03-02T10:59:30.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fceaa1ff700 1 Processor -- start 2023-03-02T10:59:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fceaa1ff700 1 -- start start 2023-03-02T10:59:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fceaa1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcea40ffad0 0x7fcea419baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fceaa1ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcea4100480 0x7fcea419bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fceaa1ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea4105ae0 0x7fcea4195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fceaa1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4196250 con 0x7fcea40ffad0 2023-03-02T10:59:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fceaa1ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea41963c0 con 0x7fcea4105ae0 2023-03-02T10:59:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fceaa1ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4196580 con 0x7fcea4100480 2023-03-02T10:59:30.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fcea37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcea40ffad0 0x7fcea419baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fcea37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcea40ffad0 0x7fcea419baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57386/0 (socket says 172.21.15.57:57386) 2023-03-02T10:59:30.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fcea37fe700 1 -- 172.21.15.57:0/3381622181 learned_addr learned my addr 172.21.15.57:0/3381622181 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fcea3fff700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea4105ae0 0x7fcea4195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.663+0000 7fce9bfff700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcea4100480 0x7fcea419bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.664+0000 7fcea37fe700 1 -- 172.21.15.57:0/3381622181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcea4100480 msgr2=0x7fcea419bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.664+0000 7fcea37fe700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcea4100480 0x7fcea419bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.664+0000 7fcea37fe700 1 -- 172.21.15.57:0/3381622181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea4105ae0 msgr2=0x7fcea4195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.664+0000 7fcea37fe700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea4105ae0 0x7fcea4195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.664+0000 7fcea37fe700 1 -- 172.21.15.57:0/3381622181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c0095f0 con 0x7fcea40ffad0 2023-03-02T10:59:30.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.664+0000 7fcea37fe700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcea40ffad0 0x7fcea419baa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fce9400e9a0 tx=0x7fce9400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.664+0000 7fcea17fa700 1 -- 172.21.15.57:0/3381622181 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94009790 con 0x7fcea40ffad0 2023-03-02T10:59:30.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.664+0000 7fceaa1ff700 1 -- 172.21.15.57:0/3381622181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea410fbc0 con 0x7fcea40ffad0 2023-03-02T10:59:30.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.664+0000 7fcea17fa700 1 -- 172.21.15.57:0/3381622181 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce94010430 con 0x7fcea40ffad0 2023-03-02T10:59:30.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.664+0000 7fcea17fa700 1 -- 172.21.15.57:0/3381622181 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94018680 con 0x7fcea40ffad0 2023-03-02T10:59:30.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.664+0000 7fceaa1ff700 1 -- 172.21.15.57:0/3381622181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea410fa30 con 0x7fcea40ffad0 2023-03-02T10:59:30.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.668+0000 7fcea17fa700 1 -- 172.21.15.57:0/3381622181 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fce9400c040 con 0x7fcea40ffad0 2023-03-02T10:59:30.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.669+0000 7fcea17fa700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fce9009b480 0x7fce9009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.669+0000 7fcea17fa700 1 -- 172.21.15.57:0/3381622181 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fce94014070 con 0x7fcea40ffad0 2023-03-02T10:59:30.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.669+0000 7fcebda80b80 1 Processor -- start 2023-03-02T10:59:30.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.669+0000 7fce9bfff700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fce9009b480 0x7fce9009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.669+0000 7fcebda80b80 1 -- start start 2023-03-02T10:59:30.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.669+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 0x5582b2a9dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.669+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aa1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.669+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 0x5582b2aa2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.669+0000 7fcebda80b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b2a00a60 con 0x5582b2aa2520 2023-03-02T10:59:30.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.669+0000 7fcebda80b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b29b2f80 con 0x5582b2a9e0e0 2023-03-02T10:59:30.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.669+0000 7fcebda80b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b2983160 con 0x5582b2a9d7d0 2023-03-02T10:59:30.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fce9bfff700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fce9009b480 0x7fce9009d930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcea41972b0 tx=0x7fce8c005fb0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fcea3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 0x5582b2aa2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fcea37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 0x5582b2a9dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fce9bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aa1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fcea37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 0x5582b2a9dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:39216/0 (socket says 172.21.15.57:39216) 2023-03-02T10:59:30.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fcea37fe700 1 -- 172.21.15.57:0/1363659909 learned_addr learned my addr 172.21.15.57:0/1363659909 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fcea3fff700 1 -- 172.21.15.57:0/1363659909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 msgr2=0x5582b2a9dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fcea3fff700 1 --2- 172.21.15.57:0/1363659909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 0x5582b2a9dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fcea3fff700 1 -- 172.21.15.57:0/1363659909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 msgr2=0x5582b2aa1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fcea3fff700 1 --2- 172.21.15.57:0/1363659909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aa1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fcea3fff700 1 -- 172.21.15.57:0/1363659909 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582b286d630 con 0x5582b2aa2520 2023-03-02T10:59:30.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fcea3fff700 1 --2- 172.21.15.57:0/1363659909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 0x5582b2aa2970 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fce9c011550 tx=0x7fce9c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ad8e0767d9a114 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fce99ffb700 1 -- 172.21.15.57:0/1363659909 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c00e040 con 0x5582b2aa2520 2023-03-02T10:59:30.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fce99ffb700 1 -- 172.21.15.57:0/1363659909 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce9c00f040 con 0x5582b2aa2520 2023-03-02T10:59:30.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.670+0000 7fce99ffb700 1 -- 172.21.15.57:0/1363659909 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c004360 con 0x5582b2aa2520 2023-03-02T10:59:30.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.671+0000 7fcebda80b80 1 -- 172.21.15.57:0/1363659909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 msgr2=0x5582b2aa2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.671+0000 7fcebda80b80 1 --2- 172.21.15.57:0/1363659909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 0x5582b2aa2970 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fce9c011550 tx=0x7fce9c009920 comp rx=0 tx=0).stop 2023-03-02T10:59:30.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.671+0000 7fcebda80b80 1 -- 172.21.15.57:0/1363659909 shutdown_connections 2023-03-02T10:59:30.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.671+0000 7fcebda80b80 1 --2- 172.21.15.57:0/1363659909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 0x5582b2aa2970 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.671+0000 7fcebda80b80 1 --2- 172.21.15.57:0/1363659909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 0x5582b2a9dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.671+0000 7fcebda80b80 1 --2- 172.21.15.57:0/1363659909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aa1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.671+0000 7fcebda80b80 1 -- 172.21.15.57:0/1363659909 >> 172.21.15.57:0/1363659909 conn(0x5582b2a8ec50 msgr2=0x5582b2a94460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.671+0000 7fcebda80b80 1 -- 172.21.15.57:0/1363659909 shutdown_connections 2023-03-02T10:59:30.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.671+0000 7fcebda80b80 1 -- 172.21.15.57:0/1363659909 wait complete. 2023-03-02T10:59:30.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcebda80b80 1 -- start start 2023-03-02T10:59:30.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcebda80b80 1 Processor -- start 2023-03-02T10:59:30.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 0x5582b2aa9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aa6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 0x5582b2aa76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcebda80b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b29f1bc0 con 0x5582b2aa2520 2023-03-02T10:59:30.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcebda80b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b29eb0f0 con 0x5582b2a9e0e0 2023-03-02T10:59:30.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcebda80b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b286f920 con 0x5582b2a9d7d0 2023-03-02T10:59:30.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcebda80b80 10 client.0 _ll_register_callbacks cb 0x5582b2991520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:30.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcea3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 0x5582b2aa76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcea37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 0x5582b2aa9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcea3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 0x5582b2aa76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57396/0 (socket says 172.21.15.57:57396) 2023-03-02T10:59:30.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fcea3fff700 1 -- 172.21.15.57:0/2050616764 learned_addr learned my addr 172.21.15.57:0/2050616764 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.672+0000 7fce9bfff700 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aa6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fcea37fe700 1 -- 172.21.15.57:0/2050616764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 msgr2=0x5582b2aa6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fcea37fe700 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aa6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fcea37fe700 1 -- 172.21.15.57:0/2050616764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 msgr2=0x5582b2aa76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fcea37fe700 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 0x5582b2aa76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fcea37fe700 1 -- 172.21.15.57:0/2050616764 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c011230 con 0x5582b2a9d7d0 2023-03-02T10:59:30.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fcea3fff700 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 0x5582b2aa76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:30.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fce9bfff700 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aa6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:30.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fcea37fe700 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 0x5582b2aa9d70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce940c5240 tx=0x7fce94094c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27f2bdc5c34797dd server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fce82ffd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:59:30.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fce82ffd700 1 -- 172.21.15.57:0/2050616764 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce940946f0 con 0x5582b2a9d7d0 2023-03-02T10:59:30.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fce82ffd700 1 -- 172.21.15.57:0/2050616764 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fce9409be10 con 0x5582b2a9d7d0 2023-03-02T10:59:30.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fcebda80b80 1 -- 172.21.15.57:0/2050616764 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582b29bc7b0 con 0x5582b2a9d7d0 2023-03-02T10:59:30.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fce82ffd700 1 -- 172.21.15.57:0/2050616764 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce9409b980 con 0x5582b2a9d7d0 2023-03-02T10:59:30.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fcebda80b80 10 client.25921 fetch_fsmap learned FSMap version 39 2023-03-02T10:59:30.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fcebda80b80 1 -- 172.21.15.57:0/2050616764 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5582b2819de0 con 0x5582b2a9d7d0 2023-03-02T10:59:30.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.673+0000 7fce82ffd700 1 -- 172.21.15.57:0/2050616764 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce94060080 con 0x5582b2a9d7d0 2023-03-02T10:59:30.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.674+0000 7fce82ffd700 1 -- 172.21.15.57:0/2050616764 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fce940938a0 con 0x5582b2a9d7d0 2023-03-02T10:59:30.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.674+0000 7fcebda80b80 10 client.25921 fetch_fsmap finished waiting for FSMap version 39 2023-03-02T10:59:30.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.674+0000 7fcebda80b80 10 client.25921 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-02T10:59:30.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.674+0000 7fcebda80b80 20 client.25921 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:30.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.674+0000 7fcebda80b80 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5582b2ab77c0 0x5582b2ab9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.674+0000 7fcebda80b80 4 client.25921 mds_command: new command op to 24505 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:59:30.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.674+0000 7fcebda80b80 1 -- 172.21.15.57:0/2050616764 --> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582b29e4170 con 0x5582b2ab77c0 2023-03-02T10:59:30.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.674+0000 7fce9bfff700 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5582b2ab77c0 0x5582b2ab9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.674+0000 7fce82ffd700 10 client.25921 ms_handle_connect on v2:172.21.15.136:6836/2130761226 2023-03-02T10:59:30.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.674+0000 7fce9bfff700 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5582b2ab77c0 0x5582b2ab9bd0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3b8873040885f98 server_cookie=45604555514fd754 in_seq=0 out_seq=0 2023-03-02T10:59:30.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fce82ffd700 1 -- 172.21.15.57:0/2050616764 <== mds.2 v2:172.21.15.136:6836/2130761226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5582b29e4170 con 0x5582b2ab77c0 2023-03-02T10:59:30.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fce82ffd700 10 client.25921 handle_command_reply: tid=0 2023-03-02T10:59:30.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fcebda80b80 1 client.25921 shutdown 2023-03-02T10:59:30.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fcebda80b80 1 -- 172.21.15.57:0/2050616764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 msgr2=0x5582b2aa9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fcebda80b80 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 0x5582b2aa9d70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce940c5240 tx=0x7fce94094c30 comp rx=0 tx=0).stop 2023-03-02T10:59:30.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fcebda80b80 1 -- 172.21.15.57:0/2050616764 shutdown_connections 2023-03-02T10:59:30.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fcebda80b80 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5582b2ab77c0 0x5582b2ab9bd0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fcebda80b80 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2aa2520 0x5582b2aa76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fcebda80b80 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9d7d0 0x5582b2aa9d70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fcebda80b80 1 --2- 172.21.15.57:0/2050616764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aa6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fce82ffd700 0 client.25921 ms_handle_reset on v2:172.21.15.136:6836/2130761226 2023-03-02T10:59:30.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fcebda80b80 1 -- 172.21.15.57:0/2050616764 >> 172.21.15.57:0/2050616764 conn(0x5582b2a8ec50 msgr2=0x5582b2a94050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fcebda80b80 1 -- 172.21.15.57:0/2050616764 shutdown_connections 2023-03-02T10:59:30.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.675+0000 7fcebda80b80 1 -- 172.21.15.57:0/2050616764 wait complete. 2023-03-02T10:59:30.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.676+0000 7fcebda80b80 20 client.25921 trim_cache size 0 max 16384 2023-03-02T10:59:30.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.688+0000 7fcebda80b80 1 Processor -- start 2023-03-02T10:59:30.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.688+0000 7fcebda80b80 1 -- start start 2023-03-02T10:59:30.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.688+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aa98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.688+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9e0e0 0x5582b2ab2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.688+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2aa2520 0x5582b2ab3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.688+0000 7fcebda80b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b2a9e570 con 0x5582b2a9d7d0 2023-03-02T10:59:30.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.688+0000 7fcebda80b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b2aa64f0 con 0x5582b2aa2520 2023-03-02T10:59:30.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fcebda80b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b2aa66b0 con 0x5582b2a9e0e0 2023-03-02T10:59:30.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fcea37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aa98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fcea37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aa98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57400/0 (socket says 172.21.15.57:57400) 2023-03-02T10:59:30.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fcea37fe700 1 -- 172.21.15.57:0/1045658258 learned_addr learned my addr 172.21.15.57:0/1045658258 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fcea3fff700 1 --2- 172.21.15.57:0/1045658258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2aa2520 0x5582b2ab3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fce9bfff700 1 --2- 172.21.15.57:0/1045658258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9e0e0 0x5582b2ab2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fcea37fe700 1 -- 172.21.15.57:0/1045658258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9e0e0 msgr2=0x5582b2ab2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fcea37fe700 1 --2- 172.21.15.57:0/1045658258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9e0e0 0x5582b2ab2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fcea37fe700 1 -- 172.21.15.57:0/1045658258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2aa2520 msgr2=0x5582b2ab3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fcea37fe700 1 --2- 172.21.15.57:0/1045658258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2aa2520 0x5582b2ab3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fcea37fe700 1 -- 172.21.15.57:0/1045658258 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582b29b2190 con 0x5582b2a9d7d0 2023-03-02T10:59:30.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fcea37fe700 1 --2- 172.21.15.57:0/1045658258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aa98a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c2d0 tx=0x7fce94090b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca589397d1589f0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fce9a7fc700 1 -- 172.21.15.57:0/1045658258 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9409be10 con 0x5582b2a9d7d0 2023-03-02T10:59:30.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fce9a7fc700 1 -- 172.21.15.57:0/1045658258 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5582b29bc7b0 con 0x5582b2a9d7d0 2023-03-02T10:59:30.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.689+0000 7fce9a7fc700 1 -- 172.21.15.57:0/1045658258 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9409bbe0 con 0x5582b2a9d7d0 2023-03-02T10:59:30.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.690+0000 7fcebda80b80 1 -- 172.21.15.57:0/1045658258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 msgr2=0x5582b2aa98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.690+0000 7fcebda80b80 1 --2- 172.21.15.57:0/1045658258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aa98a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c2d0 tx=0x7fce94090b20 comp rx=0 tx=0).stop 2023-03-02T10:59:30.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.690+0000 7fcebda80b80 1 -- 172.21.15.57:0/1045658258 shutdown_connections 2023-03-02T10:59:30.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.690+0000 7fcebda80b80 1 --2- 172.21.15.57:0/1045658258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2aa2520 0x5582b2ab3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.690+0000 7fcebda80b80 1 --2- 172.21.15.57:0/1045658258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aa98a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.690+0000 7fcebda80b80 1 --2- 172.21.15.57:0/1045658258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2a9e0e0 0x5582b2ab2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.690+0000 7fcebda80b80 1 -- 172.21.15.57:0/1045658258 >> 172.21.15.57:0/1045658258 conn(0x5582b2a8ec50 msgr2=0x5582b2aa4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.690+0000 7fcebda80b80 1 -- 172.21.15.57:0/1045658258 shutdown_connections 2023-03-02T10:59:30.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.690+0000 7fcebda80b80 1 -- 172.21.15.57:0/1045658258 wait complete. 2023-03-02T10:59:30.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.690+0000 7fcebda80b80 1 -- start start 2023-03-02T10:59:30.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.690+0000 7fcebda80b80 1 Processor -- start 2023-03-02T10:59:30.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aadf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aae460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcebda80b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2aa2520 0x5582b2aac730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcebda80b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b2aace10 con 0x5582b2a9d7d0 2023-03-02T10:59:30.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcebda80b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b2aacf80 con 0x5582b2a9e0e0 2023-03-02T10:59:30.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcebda80b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b2aad140 con 0x5582b2aa2520 2023-03-02T10:59:30.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcebda80b80 10 client.0 _ll_register_callbacks cb 0x5582b2991520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:30.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcea37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aadf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcea37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aadf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57402/0 (socket says 172.21.15.57:57402) 2023-03-02T10:59:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcea37fe700 1 -- 172.21.15.57:0/3072569222 learned_addr learned my addr 172.21.15.57:0/3072569222 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fce9bfff700 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcea3fff700 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2aa2520 0x5582b2aac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcea37fe700 1 -- 172.21.15.57:0/3072569222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2aa2520 msgr2=0x5582b2aac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcea37fe700 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2aa2520 0x5582b2aac730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcea37fe700 1 -- 172.21.15.57:0/3072569222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 msgr2=0x5582b2aae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcea37fe700 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcea37fe700 1 -- 172.21.15.57:0/3072569222 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582b2819de0 con 0x5582b2a9d7d0 2023-03-02T10:59:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcea3fff700 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2aa2520 0x5582b2aac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fcea37fe700 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aadf20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fce94094680 tx=0x7fce940107b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c3e8149e67013c server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.691+0000 7fce82ffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fce82ffd700 1 -- 172.21.15.57:0/3072569222 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce940906e0 con 0x5582b2a9d7d0 2023-03-02T10:59:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fce82ffd700 1 -- 172.21.15.57:0/3072569222 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fce940946f0 con 0x5582b2a9d7d0 2023-03-02T10:59:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fcebda80b80 1 -- 172.21.15.57:0/3072569222 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce9c00f040 con 0x5582b2a9d7d0 2023-03-02T10:59:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fce82ffd700 1 -- 172.21.15.57:0/3072569222 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce9400ca60 con 0x5582b2a9d7d0 2023-03-02T10:59:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fcebda80b80 10 client.16131 fetch_fsmap learned FSMap version 39 2023-03-02T10:59:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fcebda80b80 1 -- 172.21.15.57:0/3072569222 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5582b2840250 con 0x5582b2a9d7d0 2023-03-02T10:59:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fce82ffd700 1 -- 172.21.15.57:0/3072569222 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce9c00f040 con 0x5582b2a9d7d0 2023-03-02T10:59:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fce82ffd700 1 -- 172.21.15.57:0/3072569222 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fce940187e0 con 0x5582b2a9d7d0 2023-03-02T10:59:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fcebda80b80 10 client.16131 fetch_fsmap finished waiting for FSMap version 39 2023-03-02T10:59:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fcebda80b80 10 client.16131 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-02T10:59:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fcebda80b80 20 client.16131 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:30.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fcebda80b80 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5582b2b09e20 0x5582b2b0c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fcebda80b80 4 client.16131 mds_command: new command op to 24505 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:59:30.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fcebda80b80 1 -- 172.21.15.57:0/3072569222 --> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5582b29e3e90 con 0x5582b2b09e20 2023-03-02T10:59:30.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.692+0000 7fce9bfff700 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5582b2b09e20 0x5582b2b0c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fce82ffd700 10 client.16131 ms_handle_connect on v2:172.21.15.136:6836/2130761226 2023-03-02T10:59:30.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fce9bfff700 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5582b2b09e20 0x5582b2b0c200 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=826ac03c533c96a9 server_cookie=62cdfc0f77887893 in_seq=0 out_seq=0 2023-03-02T10:59:30.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fce82ffd700 1 -- 172.21.15.57:0/3072569222 <== mds.2 v2:172.21.15.136:6836/2130761226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5582b29e3e90 con 0x5582b2b09e20 2023-03-02T10:59:30.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fce82ffd700 10 client.16131 handle_command_reply: tid=0 2023-03-02T10:59:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fcebda80b80 1 client.16131 shutdown 2023-03-02T10:59:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fcebda80b80 1 -- 172.21.15.57:0/3072569222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 msgr2=0x5582b2aadf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fcebda80b80 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aadf20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fce94094680 tx=0x7fce940107b0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fcebda80b80 1 -- 172.21.15.57:0/3072569222 shutdown_connections 2023-03-02T10:59:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fcebda80b80 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.136:6836/2130761226,v1:172.21.15.136:6837/2130761226] conn(0x5582b2b09e20 0x5582b2b0c200 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fcebda80b80 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5582b2aa2520 0x5582b2aac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fcebda80b80 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5582b2a9d7d0 0x5582b2aadf20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fce82ffd700 0 client.16131 ms_handle_reset on v2:172.21.15.136:6836/2130761226 2023-03-02T10:59:30.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fcebda80b80 1 --2- 172.21.15.57:0/3072569222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5582b2a9e0e0 0x5582b2aae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fcebda80b80 1 -- 172.21.15.57:0/3072569222 >> 172.21.15.57:0/3072569222 conn(0x5582b2a8ec50 msgr2=0x5582b2aa4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fcebda80b80 1 -- 172.21.15.57:0/3072569222 shutdown_connections 2023-03-02T10:59:30.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.693+0000 7fcebda80b80 1 -- 172.21.15.57:0/3072569222 wait complete. 2023-03-02T10:59:30.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fcebda80b80 20 client.16131 trim_cache size 0 max 16384 2023-03-02T10:59:30.706 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:59:30.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 -- 172.21.15.57:0/3381622181 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fce9009b480 msgr2=0x7fce9009d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fce9009b480 0x7fce9009d930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcea41972b0 tx=0x7fce8c005fb0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 -- 172.21.15.57:0/3381622181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcea40ffad0 msgr2=0x7fcea419baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcea40ffad0 0x7fcea419baa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fce9400e9a0 tx=0x7fce9400ecb0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 -- 172.21.15.57:0/3381622181 shutdown_connections 2023-03-02T10:59:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fce9009b480 0x7fce9009d930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea4105ae0 0x7fcea4195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcea40ffad0 0x7fcea419baa0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 --2- 172.21.15.57:0/3381622181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcea4100480 0x7fcea419bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 -- 172.21.15.57:0/3381622181 >> 172.21.15.57:0/3381622181 conn(0x7fcea40fb610 msgr2=0x7fcea40fbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 -- 172.21.15.57:0/3381622181 shutdown_connections 2023-03-02T10:59:30.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.694+0000 7fceaa1ff700 1 -- 172.21.15.57:0/3381622181 wait complete. 2023-03-02T10:59:30.710 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-03-02T10:59:30.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.865+0000 7f4225fff700 1 -- 172.21.15.57:0/1583699359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4220100480 msgr2=0x7f422010c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.865+0000 7f4225fff700 1 --2- 172.21.15.57:0/1583699359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4220100480 0x7f422010c910 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f421800b0a0 tx=0x7f421800b3b0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.866+0000 7f4225fff700 1 -- 172.21.15.57:0/1583699359 shutdown_connections 2023-03-02T10:59:30.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.866+0000 7f4225fff700 1 --2- 172.21.15.57:0/1583699359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4220100480 0x7f422010c910 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.866+0000 7f4225fff700 1 --2- 172.21.15.57:0/1583699359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4220105ae0 0x7f4220105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.866+0000 7f4225fff700 1 --2- 172.21.15.57:0/1583699359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42200ffad0 0x7f42200fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.866+0000 7f4225fff700 1 -- 172.21.15.57:0/1583699359 >> 172.21.15.57:0/1583699359 conn(0x7f42200fb610 msgr2=0x7f42200fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.866+0000 7f4225fff700 1 -- 172.21.15.57:0/1583699359 shutdown_connections 2023-03-02T10:59:30.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.866+0000 7f4225fff700 1 -- 172.21.15.57:0/1583699359 wait complete. 2023-03-02T10:59:30.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.866+0000 7f4225fff700 1 Processor -- start 2023-03-02T10:59:30.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.866+0000 7f4225fff700 1 -- start start 2023-03-02T10:59:30.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f4225fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42200ffad0 0x7f4220197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f4225fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4220100480 0x7f4220198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f4225fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4220105ae0 0x7f422019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f4225fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422019cee0 con 0x7f42200ffad0 2023-03-02T10:59:30.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f4225fff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422019d050 con 0x7f4220105ae0 2023-03-02T10:59:30.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f4225fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422019d210 con 0x7f4220100480 2023-03-02T10:59:30.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f421f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42200ffad0 0x7f4220197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f421f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42200ffad0 0x7f4220197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57426/0 (socket says 172.21.15.57:57426) 2023-03-02T10:59:30.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f421f7fe700 1 -- 172.21.15.57:0/687879267 learned_addr learned my addr 172.21.15.57:0/687879267 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f421ffff700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4220105ae0 0x7f422019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f4216ffd700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4220100480 0x7f4220198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f421f7fe700 1 -- 172.21.15.57:0/687879267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4220100480 msgr2=0x7f4220198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f421f7fe700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4220100480 0x7f4220198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f421f7fe700 1 -- 172.21.15.57:0/687879267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4220105ae0 msgr2=0x7f422019c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f421f7fe700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4220105ae0 0x7f422019c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f421f7fe700 1 -- 172.21.15.57:0/687879267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218009d00 con 0x7f42200ffad0 2023-03-02T10:59:30.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.867+0000 7f421f7fe700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42200ffad0 0x7f4220197f00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f421000d950 tx=0x7f421000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.868+0000 7f421d7fa700 1 -- 172.21.15.57:0/687879267 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210009940 con 0x7f42200ffad0 2023-03-02T10:59:30.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.868+0000 7f421d7fa700 1 -- 172.21.15.57:0/687879267 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4210010460 con 0x7f42200ffad0 2023-03-02T10:59:30.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.868+0000 7f4225fff700 1 -- 172.21.15.57:0/687879267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422010fb10 con 0x7f42200ffad0 2023-03-02T10:59:30.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.868+0000 7f421d7fa700 1 -- 172.21.15.57:0/687879267 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421000f620 con 0x7f42200ffad0 2023-03-02T10:59:30.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.868+0000 7f4225fff700 1 -- 172.21.15.57:0/687879267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422010f980 con 0x7f42200ffad0 2023-03-02T10:59:30.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.870+0000 7f421d7fa700 1 -- 172.21.15.57:0/687879267 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f4210022070 con 0x7f42200ffad0 2023-03-02T10:59:30.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.871+0000 7f421d7fa700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f420c09b480 0x7f420c09d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.871+0000 7f421d7fa700 1 -- 172.21.15.57:0/687879267 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f42100c4e80 con 0x7f42200ffad0 2023-03-02T10:59:30.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.871+0000 7f4216ffd700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f420c09b480 0x7f420c09d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f4239861b80 1 Processor -- start 2023-03-02T10:59:30.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f4239861b80 1 -- start start 2023-03-02T10:59:30.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f4239861b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b523c0 0x555c79b52790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f4216ffd700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f420c09b480 0x7f420c09d930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4208005950 tx=0x7f42080058e0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f4239861b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b52cd0 0x555c79b56bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f4239861b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b57110 0x555c79b57560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f4239861b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79ab9a60 con 0x555c79b57110 2023-03-02T10:59:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f4239861b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79a6bf80 con 0x555c79b52cd0 2023-03-02T10:59:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f4239861b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79a3c160 con 0x555c79b523c0 2023-03-02T10:59:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f421ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b57110 0x555c79b57560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f421ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b57110 0x555c79b57560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57442/0 (socket says 172.21.15.57:57442) 2023-03-02T10:59:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f421ffff700 1 -- 172.21.15.57:0/1358086455 learned_addr learned my addr 172.21.15.57:0/1358086455 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f4216ffd700 1 --2- 172.21.15.57:0/1358086455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b52cd0 0x555c79b56bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f421f7fe700 1 --2- 172.21.15.57:0/1358086455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b523c0 0x555c79b52790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f421ffff700 1 -- 172.21.15.57:0/1358086455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b523c0 msgr2=0x555c79b52790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.872+0000 7f421ffff700 1 --2- 172.21.15.57:0/1358086455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b523c0 0x555c79b52790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.873+0000 7f421ffff700 1 -- 172.21.15.57:0/1358086455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b52cd0 msgr2=0x555c79b56bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.873+0000 7f421ffff700 1 --2- 172.21.15.57:0/1358086455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b52cd0 0x555c79b56bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.873+0000 7f421ffff700 1 -- 172.21.15.57:0/1358086455 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c79926630 con 0x555c79b57110 2023-03-02T10:59:30.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.873+0000 7f421ffff700 1 --2- 172.21.15.57:0/1358086455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b57110 0x555c79b57560 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4218009100 tx=0x7f4218009130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca14f5d123e8b05 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.873+0000 7f4215ffb700 1 -- 172.21.15.57:0/1358086455 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421800e040 con 0x555c79b57110 2023-03-02T10:59:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.873+0000 7f4215ffb700 1 -- 172.21.15.57:0/1358086455 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42180060e0 con 0x555c79b57110 2023-03-02T10:59:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.873+0000 7f4215ffb700 1 -- 172.21.15.57:0/1358086455 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421801c800 con 0x555c79b57110 2023-03-02T10:59:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.874+0000 7f4239861b80 1 -- 172.21.15.57:0/1358086455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b57110 msgr2=0x555c79b57560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.874+0000 7f4239861b80 1 --2- 172.21.15.57:0/1358086455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b57110 0x555c79b57560 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4218009100 tx=0x7f4218009130 comp rx=0 tx=0).stop 2023-03-02T10:59:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.874+0000 7f4239861b80 1 -- 172.21.15.57:0/1358086455 shutdown_connections 2023-03-02T10:59:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.874+0000 7f4239861b80 1 --2- 172.21.15.57:0/1358086455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b57110 0x555c79b57560 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.874+0000 7f4239861b80 1 --2- 172.21.15.57:0/1358086455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b523c0 0x555c79b52790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.874+0000 7f4239861b80 1 --2- 172.21.15.57:0/1358086455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b52cd0 0x555c79b56bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.874+0000 7f4239861b80 1 -- 172.21.15.57:0/1358086455 >> 172.21.15.57:0/1358086455 conn(0x555c79b47c50 msgr2=0x555c79b4d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.874+0000 7f4239861b80 1 -- 172.21.15.57:0/1358086455 shutdown_connections 2023-03-02T10:59:30.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.874+0000 7f4239861b80 1 -- 172.21.15.57:0/1358086455 wait complete. 2023-03-02T10:59:30.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.874+0000 7f4239861b80 1 -- start start 2023-03-02T10:59:30.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.874+0000 7f4239861b80 1 Processor -- start 2023-03-02T10:59:30.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4239861b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b523c0 0x555c79b5e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4239861b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b52cd0 0x555c79b5bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4239861b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b57110 0x555c79b5c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4239861b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79aaabc0 con 0x555c79b52cd0 2023-03-02T10:59:30.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4239861b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79aa40f0 con 0x555c79b523c0 2023-03-02T10:59:30.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4239861b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79928920 con 0x555c79b57110 2023-03-02T10:59:30.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4239861b80 10 client.0 _ll_register_callbacks cb 0x555c79a4a520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:30.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4216ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b52cd0 0x555c79b5bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4216ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b52cd0 0x555c79b5bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57444/0 (socket says 172.21.15.57:57444) 2023-03-02T10:59:30.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4216ffd700 1 -- 172.21.15.57:0/726912370 learned_addr learned my addr 172.21.15.57:0/726912370 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f421ffff700 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b57110 0x555c79b5c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f421f7fe700 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b523c0 0x555c79b5e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4216ffd700 1 -- 172.21.15.57:0/726912370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b57110 msgr2=0x555c79b5c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4216ffd700 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b57110 0x555c79b5c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4216ffd700 1 -- 172.21.15.57:0/726912370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b523c0 msgr2=0x555c79b5e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4216ffd700 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b523c0 0x555c79b5e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4216ffd700 1 -- 172.21.15.57:0/726912370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422010d210 con 0x555c79b52cd0 2023-03-02T10:59:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f4216ffd700 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b52cd0 0x555c79b5bad0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f420800fee0 tx=0x7f4208004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b092e9ae3821d5f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f41feffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.875+0000 7f41feffd700 1 -- 172.21.15.57:0/726912370 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208028470 con 0x555c79b52cd0 2023-03-02T10:59:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f4239861b80 1 -- 172.21.15.57:0/726912370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c79a757b0 con 0x555c79b52cd0 2023-03-02T10:59:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f41feffd700 1 -- 172.21.15.57:0/726912370 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f42080285d0 con 0x555c79b52cd0 2023-03-02T10:59:30.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f41feffd700 1 -- 172.21.15.57:0/726912370 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4208028790 con 0x555c79b52cd0 2023-03-02T10:59:30.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f4239861b80 10 client.16143 fetch_fsmap learned FSMap version 39 2023-03-02T10:59:30.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f4239861b80 1 -- 172.21.15.57:0/726912370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x555c798d2de0 con 0x555c79b52cd0 2023-03-02T10:59:30.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f41feffd700 1 -- 172.21.15.57:0/726912370 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4208034080 con 0x555c79b52cd0 2023-03-02T10:59:30.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f41feffd700 1 -- 172.21.15.57:0/726912370 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f420802e030 con 0x555c79b52cd0 2023-03-02T10:59:30.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f4239861b80 10 client.16143 fetch_fsmap finished waiting for FSMap version 39 2023-03-02T10:59:30.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f4239861b80 10 client.16143 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-02T10:59:30.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f4239861b80 20 client.16143 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:30.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f4239861b80 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x555c79b6c220 0x555c79b6e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f4239861b80 4 client.16143 mds_command: new command op to 24520 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:59:30.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.876+0000 7f4239861b80 1 -- 172.21.15.57:0/726912370 --> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c79a9d170 con 0x555c79b6c220 2023-03-02T10:59:30.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.877+0000 7f421f7fe700 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x555c79b6c220 0x555c79b6e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.877+0000 7f421f7fe700 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x555c79b6c220 0x555c79b6e630 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=30e37f918c0b0a01 server_cookie=2974522681aa2073 in_seq=0 out_seq=0 2023-03-02T10:59:30.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.877+0000 7f41feffd700 10 client.16143 ms_handle_connect on v2:172.21.15.136:6838/1702113579 2023-03-02T10:59:30.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f41feffd700 1 -- 172.21.15.57:0/726912370 <== mds.1 v2:172.21.15.136:6838/1702113579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x555c79a9d170 con 0x555c79b6c220 2023-03-02T10:59:30.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f41feffd700 10 client.16143 handle_command_reply: tid=0 2023-03-02T10:59:30.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 1 client.16143 shutdown 2023-03-02T10:59:30.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 1 -- 172.21.15.57:0/726912370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b52cd0 msgr2=0x555c79b5bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b52cd0 0x555c79b5bad0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f420800fee0 tx=0x7f4208004750 comp rx=0 tx=0).stop 2023-03-02T10:59:30.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 1 -- 172.21.15.57:0/726912370 shutdown_connections 2023-03-02T10:59:30.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x555c79b6c220 0x555c79b6e630 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b57110 0x555c79b5c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b523c0 0x555c79b5e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f41feffd700 0 client.16143 ms_handle_reset on v2:172.21.15.136:6838/1702113579 2023-03-02T10:59:30.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 1 --2- 172.21.15.57:0/726912370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b52cd0 0x555c79b5bad0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 1 -- 172.21.15.57:0/726912370 >> 172.21.15.57:0/726912370 conn(0x555c79b47c50 msgr2=0x555c79b4d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 1 -- 172.21.15.57:0/726912370 shutdown_connections 2023-03-02T10:59:30.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 1 -- 172.21.15.57:0/726912370 wait complete. 2023-03-02T10:59:30.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.878+0000 7f4239861b80 20 client.16143 trim_cache size 0 max 16384 2023-03-02T10:59:30.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.891+0000 7f4239861b80 1 Processor -- start 2023-03-02T10:59:30.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.891+0000 7f4239861b80 1 -- start start 2023-03-02T10:59:30.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.891+0000 7f4239861b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b5e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.891+0000 7f4239861b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b52cd0 0x555c79b677b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.891+0000 7f4239861b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b57110 0x555c79b67cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.891+0000 7f4239861b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79b5c6e0 con 0x555c79b523c0 2023-03-02T10:59:30.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.891+0000 7f4239861b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79b4ea20 con 0x555c79b57110 2023-03-02T10:59:30.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.891+0000 7f4239861b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79b5a030 con 0x555c79b52cd0 2023-03-02T10:59:30.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.891+0000 7f421f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b5e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.891+0000 7f421f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b5e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57446/0 (socket says 172.21.15.57:57446) 2023-03-02T10:59:30.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.891+0000 7f421f7fe700 1 -- 172.21.15.57:0/541526559 learned_addr learned my addr 172.21.15.57:0/541526559 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f4216ffd700 1 --2- 172.21.15.57:0/541526559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b52cd0 0x555c79b677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f421ffff700 1 --2- 172.21.15.57:0/541526559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b57110 0x555c79b67cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f421f7fe700 1 -- 172.21.15.57:0/541526559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b52cd0 msgr2=0x555c79b677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f421f7fe700 1 --2- 172.21.15.57:0/541526559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b52cd0 0x555c79b677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f421f7fe700 1 -- 172.21.15.57:0/541526559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b57110 msgr2=0x555c79b67cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f421f7fe700 1 --2- 172.21.15.57:0/541526559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b57110 0x555c79b67cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f421f7fe700 1 -- 172.21.15.57:0/541526559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c79a6b190 con 0x555c79b523c0 2023-03-02T10:59:30.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f421ffff700 1 --2- 172.21.15.57:0/541526559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b57110 0x555c79b67cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:30.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f421f7fe700 1 --2- 172.21.15.57:0/541526559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b5e3f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4210009520 tx=0x7f42100c4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba81cd9055b929c5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f42167fc700 1 -- 172.21.15.57:0/541526559 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210092440 con 0x555c79b523c0 2023-03-02T10:59:30.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f42167fc700 1 -- 172.21.15.57:0/541526559 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42100c0070 con 0x555c79b523c0 2023-03-02T10:59:30.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.892+0000 7f42167fc700 1 -- 172.21.15.57:0/541526559 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42100937f0 con 0x555c79b523c0 2023-03-02T10:59:30.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.893+0000 7f4239861b80 1 -- 172.21.15.57:0/541526559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 msgr2=0x555c79b5e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.893+0000 7f4239861b80 1 --2- 172.21.15.57:0/541526559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b5e3f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4210009520 tx=0x7f42100c4040 comp rx=0 tx=0).stop 2023-03-02T10:59:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.893+0000 7f4239861b80 1 -- 172.21.15.57:0/541526559 shutdown_connections 2023-03-02T10:59:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.893+0000 7f4239861b80 1 --2- 172.21.15.57:0/541526559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b57110 0x555c79b67cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.893+0000 7f4239861b80 1 --2- 172.21.15.57:0/541526559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b5e3f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.893+0000 7f4239861b80 1 --2- 172.21.15.57:0/541526559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b52cd0 0x555c79b677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.893+0000 7f4239861b80 1 -- 172.21.15.57:0/541526559 >> 172.21.15.57:0/541526559 conn(0x555c79b47c50 msgr2=0x555c79b4bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.893+0000 7f4239861b80 1 -- 172.21.15.57:0/541526559 shutdown_connections 2023-03-02T10:59:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.893+0000 7f4239861b80 1 -- 172.21.15.57:0/541526559 wait complete. 2023-03-02T10:59:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.893+0000 7f4239861b80 1 -- start start 2023-03-02T10:59:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.893+0000 7f4239861b80 1 Processor -- start 2023-03-02T10:59:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f4239861b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b61740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f4239861b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b52cd0 0x555c79b61c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f4239861b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b57110 0x555c79b621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f4239861b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79bbdae0 con 0x555c79b523c0 2023-03-02T10:59:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f4239861b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79bbdc20 con 0x555c79b52cd0 2023-03-02T10:59:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f4239861b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c79bbdd60 con 0x555c79b57110 2023-03-02T10:59:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f4239861b80 10 client.0 _ll_register_callbacks cb 0x555c79a4a520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f421f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b61740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f421f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b61740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57460/0 (socket says 172.21.15.57:57460) 2023-03-02T10:59:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f421f7fe700 1 -- 172.21.15.57:0/1147420810 learned_addr learned my addr 172.21.15.57:0/1147420810 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f421ffff700 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b57110 0x555c79b621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f4216ffd700 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b52cd0 0x555c79b61c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f421f7fe700 1 -- 172.21.15.57:0/1147420810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b57110 msgr2=0x555c79b621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f421f7fe700 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b57110 0x555c79b621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f421f7fe700 1 -- 172.21.15.57:0/1147420810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b52cd0 msgr2=0x555c79b61c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:30.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f421f7fe700 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b52cd0 0x555c79b61c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f421f7fe700 1 -- 172.21.15.57:0/1147420810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422010f980 con 0x555c79b523c0 2023-03-02T10:59:30.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f421ffff700 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b57110 0x555c79b621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:30.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f4216ffd700 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b52cd0 0x555c79b61c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:30.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f421f7fe700 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b61740 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4210094290 tx=0x7f4210092560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a477a2bbc2ddb297 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:30.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f41feffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:30.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f41feffd700 1 -- 172.21.15.57:0/1147420810 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210093a00 con 0x555c79b523c0 2023-03-02T10:59:30.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f41feffd700 1 -- 172.21.15.57:0/1147420810 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f4210094560 con 0x555c79b523c0 2023-03-02T10:59:30.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.894+0000 7f4239861b80 1 -- 172.21.15.57:0/1147420810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42180060e0 con 0x555c79b523c0 2023-03-02T10:59:30.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f41feffd700 1 -- 172.21.15.57:0/1147420810 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4210094720 con 0x555c79b523c0 2023-03-02T10:59:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f4239861b80 10 client.16149 fetch_fsmap learned FSMap version 39 2023-03-02T10:59:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f4239861b80 1 -- 172.21.15.57:0/1147420810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x555c798f9250 con 0x555c79b523c0 2023-03-02T10:59:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f41feffd700 1 -- 172.21.15.57:0/1147420810 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42180060e0 con 0x555c79b523c0 2023-03-02T10:59:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f41feffd700 1 -- 172.21.15.57:0/1147420810 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4210009aa0 con 0x555c79b523c0 2023-03-02T10:59:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f4239861b80 10 client.16149 fetch_fsmap finished waiting for FSMap version 39 2023-03-02T10:59:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f4239861b80 10 client.16149 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-02T10:59:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f4239861b80 20 client.16149 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:30.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f4239861b80 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x555c79bbef90 0x555c79bc1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:30.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f4239861b80 4 client.16149 mds_command: new command op to 24520 tid=0[{"prefix": "damage ls"}] 2023-03-02T10:59:30.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f4239861b80 1 -- 172.21.15.57:0/1147420810 --> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555c79a9ce90 con 0x555c79bbef90 2023-03-02T10:59:30.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.895+0000 7f4216ffd700 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x555c79bbef90 0x555c79bc1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:30.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f41feffd700 10 client.16149 ms_handle_connect on v2:172.21.15.136:6838/1702113579 2023-03-02T10:59:30.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4216ffd700 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x555c79bbef90 0x555c79bc1370 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c4fa2382f07da768 server_cookie=345b675fe852bac1 in_seq=0 out_seq=0 2023-03-02T10:59:30.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f41feffd700 1 -- 172.21.15.57:0/1147420810 <== mds.1 v2:172.21.15.136:6838/1702113579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555c79a9ce90 con 0x555c79bbef90 2023-03-02T10:59:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f41feffd700 10 client.16149 handle_command_reply: tid=0 2023-03-02T10:59:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 1 client.16149 shutdown 2023-03-02T10:59:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 1 -- 172.21.15.57:0/1147420810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 msgr2=0x555c79b61740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b61740 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4210094290 tx=0x7f4210092560 comp rx=0 tx=0).stop 2023-03-02T10:59:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 1 -- 172.21.15.57:0/1147420810 shutdown_connections 2023-03-02T10:59:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.136:6838/1702113579,v1:172.21.15.136:6839/1702113579] conn(0x555c79bbef90 0x555c79bc1370 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555c79b57110 0x555c79b621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c79b523c0 0x555c79b61740 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f41feffd700 0 client.16149 ms_handle_reset on v2:172.21.15.136:6838/1702113579 2023-03-02T10:59:30.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 1 --2- 172.21.15.57:0/1147420810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c79b52cd0 0x555c79b61c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 1 -- 172.21.15.57:0/1147420810 >> 172.21.15.57:0/1147420810 conn(0x555c79b47c50 msgr2=0x555c79b677b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 1 -- 172.21.15.57:0/1147420810 shutdown_connections 2023-03-02T10:59:30.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 1 -- 172.21.15.57:0/1147420810 wait complete. 2023-03-02T10:59:30.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.896+0000 7f4239861b80 20 client.16149 trim_cache size 0 max 16384 2023-03-02T10:59:30.909 INFO:teuthology.orchestra.run.smithi057.stdout:[] 2023-03-02T10:59:30.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 -- 172.21.15.57:0/687879267 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f420c09b480 msgr2=0x7f420c09d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f420c09b480 0x7f420c09d930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4208005950 tx=0x7f42080058e0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 -- 172.21.15.57:0/687879267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42200ffad0 msgr2=0x7f4220197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42200ffad0 0x7f4220197f00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f421000d950 tx=0x7f421000dc60 comp rx=0 tx=0).stop 2023-03-02T10:59:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 -- 172.21.15.57:0/687879267 shutdown_connections 2023-03-02T10:59:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f420c09b480 0x7f420c09d930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4220105ae0 0x7f422019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42200ffad0 0x7f4220197f00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 --2- 172.21.15.57:0/687879267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4220100480 0x7f4220198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:30.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 -- 172.21.15.57:0/687879267 >> 172.21.15.57:0/687879267 conn(0x7f42200fb610 msgr2=0x7f422010ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:30.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 -- 172.21.15.57:0/687879267 shutdown_connections 2023-03-02T10:59:30.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:30.897+0000 7f4225fff700 1 -- 172.21.15.57:0/687879267 wait complete. 2023-03-02T10:59:30.911 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:30 smithi057 ceph-mon[92072]: from='client.? 172.21.15.57:0/3895294346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:59:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:30 smithi122 ceph-mon[125440]: from='client.? 172.21.15.57:0/3895294346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:59:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:30 smithi136 ceph-mon[125702]: from='client.? 172.21.15.57:0/3895294346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-02T10:59:31.914 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-03-02T10:59:31.914 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-03-02T10:59:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:31 smithi057 ceph-mon[92072]: pgmap v80: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 107 MiB/s wr, 266 op/s 2023-03-02T10:59:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:31 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:59:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:31 smithi122 ceph-mon[125440]: pgmap v80: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 107 MiB/s wr, 266 op/s 2023-03-02T10:59:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:31 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:59:32.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.085+0000 7f16f35ff700 1 -- 172.21.15.57:0/3297631779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16ec100d00 msgr2=0x7f16ec1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.085+0000 7f16f35ff700 1 --2- 172.21.15.57:0/3297631779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16ec100d00 0x7f16ec1010d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009990 tx=0x7f16e8009ca0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.085+0000 7f16f35ff700 1 -- 172.21.15.57:0/3297631779 shutdown_connections 2023-03-02T10:59:32.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.085+0000 7f16f35ff700 1 --2- 172.21.15.57:0/3297631779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16ec10a040 0x7f16ec10c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.085+0000 7f16f35ff700 1 --2- 172.21.15.57:0/3297631779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16ec100d00 0x7f16ec1010d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.085+0000 7f16f35ff700 1 --2- 172.21.15.57:0/3297631779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16ec101610 0x7f16ec109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.085+0000 7f16f35ff700 1 -- 172.21.15.57:0/3297631779 >> 172.21.15.57:0/3297631779 conn(0x7f16ec0fa4b0 msgr2=0x7f16ec0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.085+0000 7f16f35ff700 1 -- 172.21.15.57:0/3297631779 shutdown_connections 2023-03-02T10:59:32.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.085+0000 7f16f35ff700 1 -- 172.21.15.57:0/3297631779 wait complete. 2023-03-02T10:59:32.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.086+0000 7f16f35ff700 1 Processor -- start 2023-03-02T10:59:32.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f35ff700 1 -- start start 2023-03-02T10:59:32.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f35ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16ec100d00 0x7f16ec19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f35ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16ec101610 0x7f16ec19bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f35ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16ec10a040 0x7f16ec195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f35ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec196230 con 0x7f16ec100d00 2023-03-02T10:59:32.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f35ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec1963a0 con 0x7f16ec101610 2023-03-02T10:59:32.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f35ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec196560 con 0x7f16ec10a040 2023-03-02T10:59:32.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f139b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16ec100d00 0x7f16ec19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f139b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16ec100d00 0x7f16ec19ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57488/0 (socket says 172.21.15.57:57488) 2023-03-02T10:59:32.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f139b700 1 -- 172.21.15.57:0/1208256664 learned_addr learned my addr 172.21.15.57:0/1208256664 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:32.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16ec101610 0x7f16ec19bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.087+0000 7f16f1b9c700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16ec10a040 0x7f16ec195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.088+0000 7f16f139b700 1 -- 172.21.15.57:0/1208256664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16ec10a040 msgr2=0x7f16ec195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.088+0000 7f16f139b700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16ec10a040 0x7f16ec195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.088+0000 7f16f139b700 1 -- 172.21.15.57:0/1208256664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16ec101610 msgr2=0x7f16ec19bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.088+0000 7f16f139b700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16ec101610 0x7f16ec19bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.088+0000 7f16f139b700 1 -- 172.21.15.57:0/1208256664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e80095f0 con 0x7f16ec100d00 2023-03-02T10:59:32.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.088+0000 7f16f139b700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16ec100d00 0x7f16ec19ba80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f16e80095c0 tx=0x7f16e800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.088+0000 7f16e27fc700 1 -- 172.21.15.57:0/1208256664 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e801d070 con 0x7f16ec100d00 2023-03-02T10:59:32.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.088+0000 7f16e27fc700 1 -- 172.21.15.57:0/1208256664 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16e8005050 con 0x7f16ec100d00 2023-03-02T10:59:32.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.088+0000 7f16f35ff700 1 -- 172.21.15.57:0/1208256664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec10fb20 con 0x7f16ec100d00 2023-03-02T10:59:32.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.088+0000 7f16e27fc700 1 -- 172.21.15.57:0/1208256664 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8004b30 con 0x7f16ec100d00 2023-03-02T10:59:32.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.088+0000 7f16f35ff700 1 -- 172.21.15.57:0/1208256664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec10f990 con 0x7f16ec100d00 2023-03-02T10:59:32.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:31 smithi136 ceph-mon[125702]: pgmap v80: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 107 MiB/s wr, 266 op/s 2023-03-02T10:59:32.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:31 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:59:32.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.090+0000 7f16e27fc700 1 -- 172.21.15.57:0/1208256664 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f16e8028030 con 0x7f16ec100d00 2023-03-02T10:59:32.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.091+0000 7f16e27fc700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f16d809b500 0x7f16d809d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f16e27fc700 1 -- 172.21.15.57:0/1208256664 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f16e80c5f50 con 0x7f16ec100d00 2023-03-02T10:59:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f16d809b500 0x7f16d809d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f1706ecbb80 1 Processor -- start 2023-03-02T10:59:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f1706ecbb80 1 -- start start 2023-03-02T10:59:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce2e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f16d809b500 0x7f16d809d9b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16ec197290 tx=0x7f16dc0073d0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce2ed50 0x56139ce32c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce33190 0x56139ce335e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139cd95ae0 con 0x56139ce2e440 2023-03-02T10:59:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139cd48000 con 0x56139ce33190 2023-03-02T10:59:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139cd181e0 con 0x56139ce2ed50 2023-03-02T10:59:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f16f139b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce2e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f16f139b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce2e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57500/0 (socket says 172.21.15.57:57500) 2023-03-02T10:59:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.092+0000 7f16f139b700 1 -- 172.21.15.57:0/2212802779 learned_addr learned my addr 172.21.15.57:0/2212802779 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.093+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/2212802779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce2ed50 0x56139ce32c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.093+0000 7f16f1b9c700 1 --2- 172.21.15.57:0/2212802779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce33190 0x56139ce335e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.093+0000 7f16f139b700 1 -- 172.21.15.57:0/2212802779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce2ed50 msgr2=0x56139ce32c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.093+0000 7f16f139b700 1 --2- 172.21.15.57:0/2212802779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce2ed50 0x56139ce32c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.093+0000 7f16f139b700 1 -- 172.21.15.57:0/2212802779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce33190 msgr2=0x56139ce335e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.093+0000 7f16f139b700 1 --2- 172.21.15.57:0/2212802779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce33190 0x56139ce335e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.093+0000 7f16f139b700 1 -- 172.21.15.57:0/2212802779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56139cc026b0 con 0x56139ce2e440 2023-03-02T10:59:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.093+0000 7f16f139b700 1 --2- 172.21.15.57:0/2212802779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce2e810 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f16e8094e10 tx=0x7f16e8094e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89efc9ee93a7c379 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.093+0000 7f16d77fe700 1 -- 172.21.15.57:0/2212802779 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8095480 con 0x56139ce2e440 2023-03-02T10:59:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.093+0000 7f16d77fe700 1 -- 172.21.15.57:0/2212802779 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16e80bde90 con 0x56139ce2e440 2023-03-02T10:59:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.093+0000 7f16d77fe700 1 -- 172.21.15.57:0/2212802779 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80948f0 con 0x56139ce2e440 2023-03-02T10:59:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.094+0000 7f1706ecbb80 1 -- 172.21.15.57:0/2212802779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 msgr2=0x56139ce2e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.094+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/2212802779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce2e810 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f16e8094e10 tx=0x7f16e8094e40 comp rx=0 tx=0).stop 2023-03-02T10:59:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.094+0000 7f1706ecbb80 1 -- 172.21.15.57:0/2212802779 shutdown_connections 2023-03-02T10:59:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.094+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/2212802779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce33190 0x56139ce335e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.094+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/2212802779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce2e810 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.094+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/2212802779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce2ed50 0x56139ce32c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.094+0000 7f1706ecbb80 1 -- 172.21.15.57:0/2212802779 >> 172.21.15.57:0/2212802779 conn(0x56139ce23cd0 msgr2=0x56139ce294e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.094+0000 7f1706ecbb80 1 -- 172.21.15.57:0/2212802779 shutdown_connections 2023-03-02T10:59:32.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.094+0000 7f1706ecbb80 1 -- 172.21.15.57:0/2212802779 wait complete. 2023-03-02T10:59:32.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.094+0000 7f1706ecbb80 1 -- start start 2023-03-02T10:59:32.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.094+0000 7f1706ecbb80 1 Processor -- start 2023-03-02T10:59:32.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2e440 0x56139ce3a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2ed50 0x56139ce37c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce33190 0x56139ce38380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139cd86c40 con 0x56139ce2ed50 2023-03-02T10:59:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139cd80170 con 0x56139ce2e440 2023-03-02T10:59:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139cc049a0 con 0x56139ce33190 2023-03-02T10:59:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f1706ecbb80 10 client.0 _ll_register_callbacks cb 0x56139cd265a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f16f0b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2ed50 0x56139ce37c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f16f0b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2ed50 0x56139ce37c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57516/0 (socket says 172.21.15.57:57516) 2023-03-02T10:59:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f16f0b9a700 1 -- 172.21.15.57:0/1054677868 learned_addr learned my addr 172.21.15.57:0/1054677868 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f16f1b9c700 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce33190 0x56139ce38380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f16f139b700 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2e440 0x56139ce3a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f16f0b9a700 1 -- 172.21.15.57:0/1054677868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce33190 msgr2=0x56139ce38380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce33190 0x56139ce38380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f16f0b9a700 1 -- 172.21.15.57:0/1054677868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2e440 msgr2=0x56139ce3a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2e440 0x56139ce3a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.095+0000 7f16f0b9a700 1 -- 172.21.15.57:0/1054677868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec10f990 con 0x56139ce2ed50 2023-03-02T10:59:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2ed50 0x56139ce37c40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f16dc010990 tx=0x7f16dc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe678e3a07bae381 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f16d4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1054677868 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc003a90 con 0x56139ce2ed50 2023-03-02T10:59:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1054677868 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f16dc017070 con 0x56139ce2ed50 2023-03-02T10:59:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1054677868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56139cd51830 con 0x56139ce2ed50 2023-03-02T10:59:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1054677868 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16dc010e50 con 0x56139ce2ed50 2023-03-02T10:59:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f1706ecbb80 10 client.16161 fetch_fsmap learned FSMap version 39 2023-03-02T10:59:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1054677868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56139cbaee60 con 0x56139ce2ed50 2023-03-02T10:59:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1054677868 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56139cd51830 con 0x56139ce2ed50 2023-03-02T10:59:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1054677868 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f16dc020410 con 0x56139ce2ed50 2023-03-02T10:59:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f1706ecbb80 10 client.16161 fetch_fsmap finished waiting for FSMap version 39 2023-03-02T10:59:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f1706ecbb80 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T10:59:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f1706ecbb80 20 client.16161 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.096+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56139ce48000 0x56139ce4a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.097+0000 7f1706ecbb80 4 client.16161 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:59:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.097+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1054677868 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56139cd791f0 con 0x56139ce48000 2023-03-02T10:59:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.097+0000 7f16f139b700 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56139ce48000 0x56139ce4a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.097+0000 7f16d4ff9700 10 client.16161 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:32.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.097+0000 7f16f139b700 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56139ce48000 0x56139ce4a410 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c72db037f464f4fc server_cookie=d8a212e48e87d240 in_seq=0 out_seq=0 2023-03-02T10:59:32.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1054677868 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x56139cd791f0 con 0x56139ce48000 2023-03-02T10:59:32.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f16d4ff9700 10 client.16161 handle_command_reply: tid=0 2023-03-02T10:59:32.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 1 client.16161 shutdown 2023-03-02T10:59:32.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1054677868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2ed50 msgr2=0x56139ce37c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2ed50 0x56139ce37c40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f16dc010990 tx=0x7f16dc0047c0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1054677868 shutdown_connections 2023-03-02T10:59:32.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56139ce48000 0x56139ce4a410 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce33190 0x56139ce38380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2e440 0x56139ce3a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f16d4ff9700 0 client.16161 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:32.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1054677868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2ed50 0x56139ce37c40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1054677868 >> 172.21.15.57:0/1054677868 conn(0x56139ce23cd0 msgr2=0x56139ce290d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1054677868 shutdown_connections 2023-03-02T10:59:32.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1054677868 wait complete. 2023-03-02T10:59:32.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.098+0000 7f1706ecbb80 20 client.16161 trim_cache size 0 max 16384 2023-03-02T10:59:32.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.115+0000 7f1706ecbb80 1 Processor -- start 2023-03-02T10:59:32.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.115+0000 7f1706ecbb80 1 -- start start 2023-03-02T10:59:32.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.115+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce43c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.115+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2ed50 0x56139ce32a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.115+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce33190 0x56139ce34570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.115+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139ce20fd0 con 0x56139ce2e440 2023-03-02T10:59:32.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.115+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139ce361c0 con 0x56139ce2ed50 2023-03-02T10:59:32.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.115+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139ce4efc0 con 0x56139ce33190 2023-03-02T10:59:32.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f139b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce43c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f139b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce43c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57526/0 (socket says 172.21.15.57:57526) 2023-03-02T10:59:32.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f139b700 1 -- 172.21.15.57:0/3138897019 learned_addr learned my addr 172.21.15.57:0/3138897019 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:32.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f1b9c700 1 --2- 172.21.15.57:0/3138897019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce33190 0x56139ce34570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/3138897019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2ed50 0x56139ce32a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f139b700 1 -- 172.21.15.57:0/3138897019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce33190 msgr2=0x56139ce34570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f139b700 1 --2- 172.21.15.57:0/3138897019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce33190 0x56139ce34570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f139b700 1 -- 172.21.15.57:0/3138897019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2ed50 msgr2=0x56139ce32a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f139b700 1 --2- 172.21.15.57:0/3138897019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2ed50 0x56139ce32a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f139b700 1 -- 172.21.15.57:0/3138897019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56139cd47210 con 0x56139ce2e440 2023-03-02T10:59:32.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/3138897019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2ed50 0x56139ce32a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T10:59:32.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16f139b700 1 --2- 172.21.15.57:0/3138897019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce43c50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005f50 tx=0x7f16e809a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd04ac32a7b7c79 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16d7fff700 1 -- 172.21.15.57:0/3138897019 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8005240 con 0x56139ce2e440 2023-03-02T10:59:32.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16d7fff700 1 -- 172.21.15.57:0/3138897019 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16e80a9020 con 0x56139ce2e440 2023-03-02T10:59:32.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.116+0000 7f16d7fff700 1 -- 172.21.15.57:0/3138897019 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8094b50 con 0x56139ce2e440 2023-03-02T10:59:32.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.117+0000 7f1706ecbb80 1 -- 172.21.15.57:0/3138897019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 msgr2=0x56139ce43c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.117+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/3138897019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce43c50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005f50 tx=0x7f16e809a040 comp rx=0 tx=0).stop 2023-03-02T10:59:32.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.117+0000 7f1706ecbb80 1 -- 172.21.15.57:0/3138897019 shutdown_connections 2023-03-02T10:59:32.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.117+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/3138897019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce33190 0x56139ce34570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.117+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/3138897019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce2e440 0x56139ce43c50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.117+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/3138897019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2ed50 0x56139ce32a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.117+0000 7f1706ecbb80 1 -- 172.21.15.57:0/3138897019 >> 172.21.15.57:0/3138897019 conn(0x56139ce23cd0 msgr2=0x56139ce2d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.117+0000 7f1706ecbb80 1 -- 172.21.15.57:0/3138897019 shutdown_connections 2023-03-02T10:59:32.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.117+0000 7f1706ecbb80 1 -- 172.21.15.57:0/3138897019 wait complete. 2023-03-02T10:59:32.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.117+0000 7f1706ecbb80 1 -- start start 2023-03-02T10:59:32.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.117+0000 7f1706ecbb80 1 Processor -- start 2023-03-02T10:59:32.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce2e440 0x56139ce36860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2ed50 0x56139ce36da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f1706ecbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce33190 0x56139ce998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139ce375f0 con 0x56139ce33190 2023-03-02T10:59:32.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139ce99df0 con 0x56139ce2ed50 2023-03-02T10:59:32.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f1706ecbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139ce99f30 con 0x56139ce2e440 2023-03-02T10:59:32.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f1706ecbb80 10 client.0 _ll_register_callbacks cb 0x56139cd265a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:32.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f16f1b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce33190 0x56139ce998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f16f139b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce2e440 0x56139ce36860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f16f1b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce33190 0x56139ce998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57542/0 (socket says 172.21.15.57:57542) 2023-03-02T10:59:32.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f16f1b9c700 1 -- 172.21.15.57:0/1814392616 learned_addr learned my addr 172.21.15.57:0/1814392616 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:32.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2ed50 0x56139ce36da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f16f139b700 1 -- 172.21.15.57:0/1814392616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2ed50 msgr2=0x56139ce36da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f16f139b700 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2ed50 0x56139ce36da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f16f139b700 1 -- 172.21.15.57:0/1814392616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce33190 msgr2=0x56139ce998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f16f139b700 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce33190 0x56139ce998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f16f139b700 1 -- 172.21.15.57:0/1814392616 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e80c3040 con 0x56139ce2e440 2023-03-02T10:59:32.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.118+0000 7f16f1b9c700 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce33190 0x56139ce998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:32.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.119+0000 7f16f139b700 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce2e440 0x56139ce36860 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f16e8095390 tx=0x7f16e809cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=167ab144c82de5a8 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.119+0000 7f16d4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:59:32.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.119+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1814392616 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8005430 con 0x56139ce2e440 2023-03-02T10:59:32.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.119+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1814392616 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16e80bde90 con 0x56139ce2e440 2023-03-02T10:59:32.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.119+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1814392616 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f16e80aa030 con 0x56139ce2e440 2023-03-02T10:59:32.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.119+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1814392616 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e8005590 con 0x56139ce2e440 2023-03-02T10:59:32.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.119+0000 7f1706ecbb80 10 client.25960 fetch_fsmap learned FSMap version 39 2023-03-02T10:59:32.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.119+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1814392616 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56139cbd52d0 con 0x56139ce2e440 2023-03-02T10:59:32.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.119+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1814392616 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16e80bde90 con 0x56139ce2e440 2023-03-02T10:59:32.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.119+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1814392616 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f16e809c690 con 0x56139ce2e440 2023-03-02T10:59:32.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.120+0000 7f1706ecbb80 10 client.25960 fetch_fsmap finished waiting for FSMap version 39 2023-03-02T10:59:32.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.120+0000 7f1706ecbb80 10 client.25960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T10:59:32.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.120+0000 7f1706ecbb80 20 client.25960 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:32.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.120+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56139ce9b140 0x56139ce9d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.120+0000 7f1706ecbb80 4 client.25960 mds_command: new command op to 24458 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-03-02T10:59:32.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.120+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1814392616 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56139cd78f10 con 0x56139ce9b140 2023-03-02T10:59:32.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.120+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56139ce9b140 0x56139ce9d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.120+0000 7f16f0b9a700 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56139ce9b140 0x56139ce9d520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fab4302d2cc108f3 server_cookie=feb1d4561f137be5 in_seq=0 out_seq=0 2023-03-02T10:59:32.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.120+0000 7f16d4ff9700 10 client.25960 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:32.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f16d4ff9700 1 -- 172.21.15.57:0/1814392616 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56139cd78f10 con 0x56139ce9b140 2023-03-02T10:59:32.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f16d4ff9700 10 client.25960 handle_command_reply: tid=0 2023-03-02T10:59:32.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 1 client.25960 shutdown 2023-03-02T10:59:32.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1814392616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce2e440 msgr2=0x56139ce36860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce2e440 0x56139ce36860 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f16e8095390 tx=0x7f16e809cc10 comp rx=0 tx=0).stop 2023-03-02T10:59:32.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1814392616 shutdown_connections 2023-03-02T10:59:32.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56139ce9b140 0x56139ce9d520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56139ce33190 0x56139ce998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56139ce2e440 0x56139ce36860 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 1 --2- 172.21.15.57:0/1814392616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139ce2ed50 0x56139ce36da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f16d4ff9700 0 client.25960 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:32.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1814392616 >> 172.21.15.57:0/1814392616 conn(0x56139ce23cd0 msgr2=0x56139ce32900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1814392616 shutdown_connections 2023-03-02T10:59:32.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 1 -- 172.21.15.57:0/1814392616 wait complete. 2023-03-02T10:59:32.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.122+0000 7f1706ecbb80 20 client.25960 trim_cache size 0 max 16384 2023-03-02T10:59:32.132 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:59:32.133 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": 0, 2023-03-02T10:59:32.133 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T10:59:32.133 INFO:teuthology.orchestra.run.smithi057.stdout: "mode": "asynchronous" 2023-03-02T10:59:32.133 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:59:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 -- 172.21.15.57:0/1208256664 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f16d809b500 msgr2=0x7f16d809d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f16d809b500 0x7f16d809d9b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16ec197290 tx=0x7f16dc0073d0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 -- 172.21.15.57:0/1208256664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16ec100d00 msgr2=0x7f16ec19ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16ec100d00 0x7f16ec19ba80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f16e80095c0 tx=0x7f16e800f690 comp rx=0 tx=0).stop 2023-03-02T10:59:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 -- 172.21.15.57:0/1208256664 shutdown_connections 2023-03-02T10:59:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f16d809b500 0x7f16d809d9b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16ec10a040 0x7f16ec195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16ec100d00 0x7f16ec19ba80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 --2- 172.21.15.57:0/1208256664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16ec101610 0x7f16ec19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 -- 172.21.15.57:0/1208256664 >> 172.21.15.57:0/1208256664 conn(0x7f16ec0fa4b0 msgr2=0x7f16ec10c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 -- 172.21.15.57:0/1208256664 shutdown_connections 2023-03-02T10:59:32.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.123+0000 7f16f35ff700 1 -- 172.21.15.57:0/1208256664 wait complete. 2023-03-02T10:59:32.140 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T10:59:32.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.342+0000 7f3db85ff700 1 -- 172.21.15.57:0/1313348963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3db0100c80 msgr2=0x7f3db0101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.342+0000 7f3db85ff700 1 --2- 172.21.15.57:0/1313348963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3db0100c80 0x7f3db0101050 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00b0a0 tx=0x7f3dac00b3b0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.342+0000 7f3db85ff700 1 -- 172.21.15.57:0/1313348963 shutdown_connections 2023-03-02T10:59:32.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.342+0000 7f3db85ff700 1 --2- 172.21.15.57:0/1313348963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3db010a050 0x7f3db010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.342+0000 7f3db85ff700 1 --2- 172.21.15.57:0/1313348963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3db0100c80 0x7f3db0101050 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.342+0000 7f3db85ff700 1 --2- 172.21.15.57:0/1313348963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0101590 0x7f3db0109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.342+0000 7f3db85ff700 1 -- 172.21.15.57:0/1313348963 >> 172.21.15.57:0/1313348963 conn(0x7f3db00fa4b0 msgr2=0x7f3db00fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.342+0000 7f3db85ff700 1 -- 172.21.15.57:0/1313348963 shutdown_connections 2023-03-02T10:59:32.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.342+0000 7f3db85ff700 1 -- 172.21.15.57:0/1313348963 wait complete. 2023-03-02T10:59:32.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.343+0000 7f3db85ff700 1 Processor -- start 2023-03-02T10:59:32.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.343+0000 7f3db85ff700 1 -- start start 2023-03-02T10:59:32.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.343+0000 7f3db85ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0100c80 0x7f3db0197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.343+0000 7f3db85ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3db0101590 0x7f3db01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.343+0000 7f3db85ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3db010a050 0x7f3db019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.343+0000 7f3db85ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db019cf60 con 0x7f3db0101590 2023-03-02T10:59:32.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.343+0000 7f3db85ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db019d0d0 con 0x7f3db010a050 2023-03-02T10:59:32.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.343+0000 7f3db85ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db019d290 con 0x7f3db0100c80 2023-03-02T10:59:32.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db5b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3db0101590 0x7f3db01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db6b9c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3db010a050 0x7f3db019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db639b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0100c80 0x7f3db0197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db6b9c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3db010a050 0x7f3db019c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:58252/0 (socket says 172.21.15.57:58252) 2023-03-02T10:59:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db6b9c700 1 -- 172.21.15.57:0/3835565893 learned_addr learned my addr 172.21.15.57:0/3835565893 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db5b9a700 1 -- 172.21.15.57:0/3835565893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0100c80 msgr2=0x7f3db0197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0100c80 0x7f3db0197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db5b9a700 1 -- 172.21.15.57:0/3835565893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3db010a050 msgr2=0x7f3db019c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3db010a050 0x7f3db019c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db5b9a700 1 -- 172.21.15.57:0/3835565893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac009d00 con 0x7f3db0101590 2023-03-02T10:59:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db6b9c700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3db010a050 0x7f3db019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:32.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3db0101590 0x7f3db01984c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3da000e9f0 tx=0x7f3da000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3da77fe700 1 -- 172.21.15.57:0/3835565893 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da000c9c0 con 0x7f3db0101590 2023-03-02T10:59:32.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db85ff700 1 -- 172.21.15.57:0/3835565893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db010fb20 con 0x7f3db0101590 2023-03-02T10:59:32.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3da77fe700 1 -- 172.21.15.57:0/3835565893 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3da0010430 con 0x7f3db0101590 2023-03-02T10:59:32.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3da77fe700 1 -- 172.21.15.57:0/3835565893 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0018680 con 0x7f3db0101590 2023-03-02T10:59:32.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.344+0000 7f3db85ff700 1 -- 172.21.15.57:0/3835565893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db010f990 con 0x7f3db0101590 2023-03-02T10:59:32.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.347+0000 7f3da77fe700 1 -- 172.21.15.57:0/3835565893 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f3da000c040 con 0x7f3db0101590 2023-03-02T10:59:32.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.348+0000 7f3da77fe700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3d9c09b480 0x7f3d9c09d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3da77fe700 1 -- 172.21.15.57:0/3835565893 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f3da0014070 con 0x7f3db0101590 2023-03-02T10:59:32.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3db639b700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3d9c09b480 0x7f3d9c09d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3dcbf03b80 1 Processor -- start 2023-03-02T10:59:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3dcbf03b80 1 -- start start 2023-03-02T10:59:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 0x5608e6a61790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3db639b700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3d9c09b480 0x7f3d9c09d930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009fd0 tx=0x7f3dac006210 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a61cd0 0x5608e6a65bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a66110 0x5608e6a66560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e69c8a60 con 0x5608e6a66110 2023-03-02T10:59:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e697af80 con 0x5608e6a613c0 2023-03-02T10:59:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e694b160 con 0x5608e6a61cd0 2023-03-02T10:59:32.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3db639b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 0x5608e6a61790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3db639b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 0x5608e6a61790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:58258/0 (socket says 172.21.15.57:58258) 2023-03-02T10:59:32.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3db6b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a66110 0x5608e6a66560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3db639b700 1 -- 172.21.15.57:0/3837219579 learned_addr learned my addr 172.21.15.57:0/3837219579 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:32.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.349+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/3837219579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a61cd0 0x5608e6a65bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.350+0000 7f3db5b9a700 1 -- 172.21.15.57:0/3837219579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 msgr2=0x5608e6a61790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.350+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/3837219579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 0x5608e6a61790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.350+0000 7f3db5b9a700 1 -- 172.21.15.57:0/3837219579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a66110 msgr2=0x5608e6a66560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.350+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/3837219579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a66110 0x5608e6a66560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.350+0000 7f3db5b9a700 1 -- 172.21.15.57:0/3837219579 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608e6835630 con 0x5608e6a61cd0 2023-03-02T10:59:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.350+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/3837219579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a61cd0 0x5608e6a65bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3da0091150 tx=0x7f3da0094220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f647db44f5fd7fb4 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.350+0000 7f3da4bfe700 1 -- 172.21.15.57:0/3837219579 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0094de0 con 0x5608e6a61cd0 2023-03-02T10:59:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.350+0000 7f3da4bfe700 1 -- 172.21.15.57:0/3837219579 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3da00946e0 con 0x5608e6a61cd0 2023-03-02T10:59:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.350+0000 7f3da4bfe700 1 -- 172.21.15.57:0/3837219579 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0093df0 con 0x5608e6a61cd0 2023-03-02T10:59:32.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.351+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/3837219579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a61cd0 msgr2=0x5608e6a65bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.351+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/3837219579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a61cd0 0x5608e6a65bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3da0091150 tx=0x7f3da0094220 comp rx=0 tx=0).stop 2023-03-02T10:59:32.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.351+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/3837219579 shutdown_connections 2023-03-02T10:59:32.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.351+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/3837219579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a66110 0x5608e6a66560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.351+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/3837219579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 0x5608e6a61790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.351+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/3837219579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a61cd0 0x5608e6a65bd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.351+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/3837219579 >> 172.21.15.57:0/3837219579 conn(0x5608e6a56c50 msgr2=0x5608e6a5c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.351+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/3837219579 shutdown_connections 2023-03-02T10:59:32.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.351+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/3837219579 wait complete. 2023-03-02T10:59:32.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.351+0000 7f3dcbf03b80 1 -- start start 2023-03-02T10:59:32.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.351+0000 7f3dcbf03b80 1 Processor -- start 2023-03-02T10:59:32.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a61cd0 0x5608e6a6aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a66110 0x5608e6a6b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e69b9bc0 con 0x5608e6a613c0 2023-03-02T10:59:32.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e69b30f0 con 0x5608e6a61cd0 2023-03-02T10:59:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e6837920 con 0x5608e6a66110 2023-03-02T10:59:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3dcbf03b80 10 client.0 _ll_register_callbacks cb 0x5608e6959520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3db639b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3db639b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57584/0 (socket says 172.21.15.57:57584) 2023-03-02T10:59:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3db639b700 1 -- 172.21.15.57:0/550015432 learned_addr learned my addr 172.21.15.57:0/550015432 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a61cd0 0x5608e6a6aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3db6b9c700 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a66110 0x5608e6a6b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3db639b700 1 -- 172.21.15.57:0/550015432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a66110 msgr2=0x5608e6a6b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3db639b700 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a66110 0x5608e6a6b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3db639b700 1 -- 172.21.15.57:0/550015432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a61cd0 msgr2=0x5608e6a6aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3db639b700 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a61cd0 0x5608e6a6aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3db639b700 1 -- 172.21.15.57:0/550015432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db010f990 con 0x5608e6a613c0 2023-03-02T10:59:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.352+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a61cd0 0x5608e6a6aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.353+0000 7f3db639b700 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d830 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00b780 tx=0x7f3dac0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f135f7b45782a9 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.353+0000 7f3d99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T10:59:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.353+0000 7f3d99ffb700 1 -- 172.21.15.57:0/550015432 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac00e040 con 0x5608e6a613c0 2023-03-02T10:59:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.353+0000 7f3d99ffb700 1 -- 172.21.15.57:0/550015432 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f3dac029710 con 0x5608e6a613c0 2023-03-02T10:59:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.353+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/550015432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608e69847b0 con 0x5608e6a613c0 2023-03-02T10:59:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.353+0000 7f3d99ffb700 1 -- 172.21.15.57:0/550015432 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3dac0298d0 con 0x5608e6a613c0 2023-03-02T10:59:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.353+0000 7f3dcbf03b80 10 client.16179 fetch_fsmap learned FSMap version 39 2023-03-02T10:59:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.353+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/550015432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5608e67e1de0 con 0x5608e6a613c0 2023-03-02T10:59:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.353+0000 7f3d99ffb700 1 -- 172.21.15.57:0/550015432 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5608e69847b0 con 0x5608e6a613c0 2023-03-02T10:59:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.353+0000 7f3d99ffb700 1 -- 172.21.15.57:0/550015432 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3dac01cba0 con 0x5608e6a613c0 2023-03-02T10:59:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.354+0000 7f3dcbf03b80 10 client.16179 fetch_fsmap finished waiting for FSMap version 39 2023-03-02T10:59:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.354+0000 7f3dcbf03b80 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T10:59:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.354+0000 7f3dcbf03b80 20 client.16179 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.354+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5608e6a7b1a0 0x5608e6a7d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.354+0000 7f3dcbf03b80 4 client.16179 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T10:59:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.354+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/550015432 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608e69ac170 con 0x5608e6a7b1a0 2023-03-02T10:59:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.354+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5608e6a7b1a0 0x5608e6a7d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.354+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5608e6a7b1a0 0x5608e6a7d5b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a435c7cefcf0c80 server_cookie=526900bf8dbd90fc in_seq=0 out_seq=0 2023-03-02T10:59:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.354+0000 7f3d99ffb700 10 client.16179 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.355+0000 7f3d99ffb700 1 -- 172.21.15.57:0/550015432 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5608e69ac170 con 0x5608e6a7b1a0 2023-03-02T10:59:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.355+0000 7f3d99ffb700 10 client.16179 handle_command_reply: tid=0 2023-03-02T10:59:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.355+0000 7f3dcbf03b80 1 client.16179 shutdown 2023-03-02T10:59:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.355+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/550015432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 msgr2=0x5608e6a6d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.355+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d830 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00b780 tx=0x7f3dac0099e0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.355+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/550015432 shutdown_connections 2023-03-02T10:59:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.355+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5608e6a7b1a0 0x5608e6a7d5b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.355+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a66110 0x5608e6a6b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.355+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d830 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.355+0000 7f3d99ffb700 0 client.16179 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.356+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/550015432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a61cd0 0x5608e6a6aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.356+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/550015432 >> 172.21.15.57:0/550015432 conn(0x5608e6a56c50 msgr2=0x5608e6a5bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.356+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/550015432 shutdown_connections 2023-03-02T10:59:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.356+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/550015432 wait complete. 2023-03-02T10:59:32.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.356+0000 7f3dcbf03b80 20 client.16179 trim_cache size 0 max 16384 2023-03-02T10:59:32.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.372+0000 7f3dcbf03b80 1 Processor -- start 2023-03-02T10:59:32.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.372+0000 7f3dcbf03b80 1 -- start start 2023-03-02T10:59:32.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.372+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.372+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a61cd0 0x5608e6a67dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.372+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a66110 0x5608e6a68310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.372+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e6a62420 con 0x5608e6a613c0 2023-03-02T10:59:32.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.372+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e6a567d0 con 0x5608e6a66110 2023-03-02T10:59:32.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.372+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e6a6c060 con 0x5608e6a61cd0 2023-03-02T10:59:32.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.372+0000 7f3db639b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3db6b9c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a66110 0x5608e6a68310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3db639b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57596/0 (socket says 172.21.15.57:57596) 2023-03-02T10:59:32.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3db639b700 1 -- 172.21.15.57:0/327592552 learned_addr learned my addr 172.21.15.57:0/327592552 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:32.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/327592552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a61cd0 0x5608e6a67dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3db639b700 1 -- 172.21.15.57:0/327592552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a61cd0 msgr2=0x5608e6a67dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3db639b700 1 --2- 172.21.15.57:0/327592552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a61cd0 0x5608e6a67dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3db639b700 1 -- 172.21.15.57:0/327592552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a66110 msgr2=0x5608e6a68310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3db639b700 1 --2- 172.21.15.57:0/327592552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a66110 0x5608e6a68310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3db639b700 1 -- 172.21.15.57:0/327592552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608e6a667b0 con 0x5608e6a613c0 2023-03-02T10:59:32.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3db6b9c700 1 --2- 172.21.15.57:0/327592552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a66110 0x5608e6a68310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:32.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3db639b700 1 --2- 172.21.15.57:0/327592552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d3d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0050e0 tx=0x7f3dac00b010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886c2a74c9003aa7 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3da53ff700 1 -- 172.21.15.57:0/327592552 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac00e040 con 0x5608e6a613c0 2023-03-02T10:59:32.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3da53ff700 1 -- 172.21.15.57:0/327592552 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dac026e70 con 0x5608e6a613c0 2023-03-02T10:59:32.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.373+0000 7f3da53ff700 1 -- 172.21.15.57:0/327592552 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac005750 con 0x5608e6a613c0 2023-03-02T10:59:32.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.374+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/327592552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 msgr2=0x5608e6a6d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.374+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/327592552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d3d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0050e0 tx=0x7f3dac00b010 comp rx=0 tx=0).stop 2023-03-02T10:59:32.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.374+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/327592552 shutdown_connections 2023-03-02T10:59:32.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.374+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/327592552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a66110 0x5608e6a68310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.374+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/327592552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a613c0 0x5608e6a6d3d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.374+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/327592552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a61cd0 0x5608e6a67dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.374+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/327592552 >> 172.21.15.57:0/327592552 conn(0x5608e6a56c50 msgr2=0x5608e6a767e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.374+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/327592552 shutdown_connections 2023-03-02T10:59:32.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.374+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/327592552 wait complete. 2023-03-02T10:59:32.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.374+0000 7f3dcbf03b80 1 -- start start 2023-03-02T10:59:32.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.374+0000 7f3dcbf03b80 1 Processor -- start 2023-03-02T10:59:32.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 0x5608e6a6a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a61cd0 0x5608e6a692b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3dcbf03b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a66110 0x5608e6a697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e6a6af30 con 0x5608e6a61cd0 2023-03-02T10:59:32.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e6a69d30 con 0x5608e6a613c0 2023-03-02T10:59:32.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3dcbf03b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608e6a69ef0 con 0x5608e6a66110 2023-03-02T10:59:32.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3dcbf03b80 10 client.0 _ll_register_callbacks cb 0x5608e6959520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T10:59:32.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db5b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a61cd0 0x5608e6a692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db6b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a66110 0x5608e6a697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db639b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 0x5608e6a6a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db5b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a61cd0 0x5608e6a692b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57606/0 (socket says 172.21.15.57:57606) 2023-03-02T10:59:32.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db5b9a700 1 -- 172.21.15.57:0/577718732 learned_addr learned my addr 172.21.15.57:0/577718732 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T10:59:32.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db6b9c700 1 -- 172.21.15.57:0/577718732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 msgr2=0x5608e6a6a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db6b9c700 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 0x5608e6a6a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db6b9c700 1 -- 172.21.15.57:0/577718732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a61cd0 msgr2=0x5608e6a692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T10:59:32.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db6b9c700 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a61cd0 0x5608e6a692b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db6b9c700 1 -- 172.21.15.57:0/577718732 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da8010430 con 0x5608e6a66110 2023-03-02T10:59:32.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db5b9a700 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a61cd0 0x5608e6a692b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:32.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.375+0000 7f3db639b700 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 0x5608e6a6a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T10:59:32.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3db6b9c700 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a66110 0x5608e6a697f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3da8010e60 tx=0x7f3da800f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a0a848928de71ad server_cookie=0 in_seq=0 out_seq=0 2023-03-02T10:59:32.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3d99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T10:59:32.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3d99ffb700 1 -- 172.21.15.57:0/577718732 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8016040 con 0x5608e6a66110 2023-03-02T10:59:32.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/577718732 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3da00946e0 con 0x5608e6a66110 2023-03-02T10:59:32.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3d99ffb700 1 -- 172.21.15.57:0/577718732 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f3da800fdd0 con 0x5608e6a66110 2023-03-02T10:59:32.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3d99ffb700 1 -- 172.21.15.57:0/577718732 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3da8004830 con 0x5608e6a66110 2023-03-02T10:59:32.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3dcbf03b80 10 client.25978 fetch_fsmap learned FSMap version 39 2023-03-02T10:59:32.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/577718732 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5608e67e1de0 con 0x5608e6a66110 2023-03-02T10:59:32.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3d99ffb700 1 -- 172.21.15.57:0/577718732 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3da00946e0 con 0x5608e6a66110 2023-03-02T10:59:32.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3d99ffb700 1 -- 172.21.15.57:0/577718732 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3da801d440 con 0x5608e6a66110 2023-03-02T10:59:32.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3dcbf03b80 10 client.25978 fetch_fsmap finished waiting for FSMap version 39 2023-03-02T10:59:32.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3dcbf03b80 10 client.25978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T10:59:32.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3dcbf03b80 20 client.25978 populate_metadata read hostname 'smithi057' 2023-03-02T10:59:32.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5608e6acdda0 0x5608e6ad0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T10:59:32.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3dcbf03b80 4 client.25978 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T10:59:32.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.376+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/577718732 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5608e69abe90 con 0x5608e6acdda0 2023-03-02T10:59:32.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3db639b700 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5608e6acdda0 0x5608e6ad0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:32.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3db639b700 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5608e6acdda0 0x5608e6ad0180 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad5a554455c1724f server_cookie=801b27faed510cdb in_seq=0 out_seq=0 2023-03-02T10:59:32.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3d99ffb700 10 client.25978 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:32.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3d99ffb700 1 -- 172.21.15.57:0/577718732 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5608e69abe90 con 0x5608e6acdda0 2023-03-02T10:59:32.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3d99ffb700 10 client.25978 handle_command_reply: tid=0 2023-03-02T10:59:32.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3dcbf03b80 1 client.25978 shutdown 2023-03-02T10:59:32.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/577718732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a66110 msgr2=0x5608e6a697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a66110 0x5608e6a697f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3da8010e60 tx=0x7f3da800f6a0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/577718732 shutdown_connections 2023-03-02T10:59:32.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5608e6acdda0 0x5608e6ad0180 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5608e6a66110 0x5608e6a697f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3d99ffb700 0 client.25978 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T10:59:32.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608e6a613c0 0x5608e6a6a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3dcbf03b80 1 --2- 172.21.15.57:0/577718732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608e6a61cd0 0x5608e6a692b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.377+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/577718732 >> 172.21.15.57:0/577718732 conn(0x5608e6a56c50 msgr2=0x5608e6a67dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/577718732 shutdown_connections 2023-03-02T10:59:32.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3dcbf03b80 1 -- 172.21.15.57:0/577718732 wait complete. 2023-03-02T10:59:32.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3dcbf03b80 20 client.25978 trim_cache size 0 max 16384 2023-03-02T10:59:32.388 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T10:59:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T10:59:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T10:59:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T10:59:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T10:59:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T10:59:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T10:59:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:59:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T10:59:32.390 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T10:59:32.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 -- 172.21.15.57:0/3835565893 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3d9c09b480 msgr2=0x7f3d9c09d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3d9c09b480 0x7f3d9c09d930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009fd0 tx=0x7f3dac006210 comp rx=0 tx=0).stop 2023-03-02T10:59:32.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 -- 172.21.15.57:0/3835565893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3db0101590 msgr2=0x7f3db01984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T10:59:32.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3db0101590 0x7f3db01984c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3da000e9f0 tx=0x7f3da000ed00 comp rx=0 tx=0).stop 2023-03-02T10:59:32.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 -- 172.21.15.57:0/3835565893 shutdown_connections 2023-03-02T10:59:32.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3d9c09b480 0x7f3d9c09d930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3db010a050 0x7f3db019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3db0100c80 0x7f3db0197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 --2- 172.21.15.57:0/3835565893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3db0101590 0x7f3db01984c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T10:59:32.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 -- 172.21.15.57:0/3835565893 >> 172.21.15.57:0/3835565893 conn(0x7f3db00fa4b0 msgr2=0x7f3db010c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T10:59:32.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 -- 172.21.15.57:0/3835565893 shutdown_connections 2023-03-02T10:59:32.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T10:59:32.378+0000 7f3db85ff700 1 -- 172.21.15.57:0/3835565893 wait complete. 2023-03-02T10:59:32.394 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T10:59:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:32 smithi057 ceph-mon[92072]: scrub summary: active paths [/,/] 2023-03-02T10:59:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:32 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/,/] 2023-03-02T10:59:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:32 smithi057 ceph-mon[92072]: scrub summary: active paths [/,/] 2023-03-02T10:59:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:32 smithi057 ceph-mon[92072]: scrub summary: active paths [/] 2023-03-02T10:59:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:32 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:32 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/,/] 2023-03-02T10:59:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:32 smithi122 ceph-mon[125440]: scrub summary: active paths [/,/] 2023-03-02T10:59:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:32 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/,/] 2023-03-02T10:59:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:32 smithi122 ceph-mon[125440]: scrub summary: active paths [/,/] 2023-03-02T10:59:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:32 smithi122 ceph-mon[125440]: scrub summary: active paths [/] 2023-03-02T10:59:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:32 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:32 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/,/] 2023-03-02T10:59:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:32 smithi136 ceph-mon[125702]: scrub summary: active paths [/,/] 2023-03-02T10:59:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:32 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/,/] 2023-03-02T10:59:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:32 smithi136 ceph-mon[125702]: scrub summary: active paths [/,/] 2023-03-02T10:59:33.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:32 smithi136 ceph-mon[125702]: scrub summary: active paths [/] 2023-03-02T10:59:33.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:32 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:33.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:32 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/,/] 2023-03-02T10:59:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:33.853+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:33.853+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T10:59:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:33.853+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T10:59:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:33.853+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T10:59:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:33.854+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T10:59:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:33 smithi057 ceph-mon[92072]: scrub queued for path: / 2023-03-02T10:59:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:33 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:33 smithi057 ceph-mon[92072]: scrub summary: active paths [/] 2023-03-02T10:59:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:33 smithi057 ceph-mon[92072]: scrub summary: active paths [/,/] 2023-03-02T10:59:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:33 smithi057 ceph-mon[92072]: scrub summary: active paths [/] 2023-03-02T10:59:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:33 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:33.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:33 smithi057 ceph-mon[92072]: pgmap v81: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 61 KiB/s wr, 235 op/s 2023-03-02T10:59:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:33 smithi122 ceph-mon[125440]: scrub queued for path: / 2023-03-02T10:59:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:33 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:33 smithi122 ceph-mon[125440]: scrub summary: active paths [/] 2023-03-02T10:59:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:33 smithi122 ceph-mon[125440]: scrub summary: active paths [/,/] 2023-03-02T10:59:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:33 smithi122 ceph-mon[125440]: scrub summary: active paths [/] 2023-03-02T10:59:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:33 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:33 smithi122 ceph-mon[125440]: pgmap v81: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 61 KiB/s wr, 235 op/s 2023-03-02T10:59:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:33 smithi136 ceph-mon[125702]: scrub queued for path: / 2023-03-02T10:59:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:33 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:33 smithi136 ceph-mon[125702]: scrub summary: active paths [/] 2023-03-02T10:59:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:33 smithi136 ceph-mon[125702]: scrub summary: active paths [/,/] 2023-03-02T10:59:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:33 smithi136 ceph-mon[125702]: scrub summary: active paths [/] 2023-03-02T10:59:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:33 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:33 smithi136 ceph-mon[125702]: pgmap v81: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 61 KiB/s wr, 235 op/s 2023-03-02T10:59:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:35 smithi057 ceph-mon[92072]: pgmap v82: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 61 KiB/s wr, 235 op/s 2023-03-02T10:59:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:35 smithi057 ceph-mon[92072]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:35 smithi122 ceph-mon[125440]: pgmap v82: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 61 KiB/s wr, 235 op/s 2023-03-02T10:59:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:35 smithi122 ceph-mon[125440]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:35 smithi136 ceph-mon[125702]: pgmap v82: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 61 KiB/s wr, 235 op/s 2023-03-02T10:59:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:35 smithi136 ceph-mon[125702]: scrub summary: idle+waiting paths [/] 2023-03-02T10:59:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:36 smithi057 ceph-mon[92072]: scrub summary: active paths [/] 2023-03-02T10:59:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:36 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:59:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:36 smithi122 ceph-mon[125440]: scrub summary: active paths [/] 2023-03-02T10:59:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:36 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:59:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:36 smithi136 ceph-mon[125702]: scrub summary: active paths [/] 2023-03-02T10:59:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:36 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T10:59:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:37 smithi057 ceph-mon[92072]: pgmap v83: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 51 KiB/s wr, 214 op/s 2023-03-02T10:59:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:37 smithi122 ceph-mon[125440]: pgmap v83: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 51 KiB/s wr, 214 op/s 2023-03-02T10:59:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:37 smithi136 ceph-mon[125702]: pgmap v83: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 51 KiB/s wr, 214 op/s 2023-03-02T10:59:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:39 smithi057 ceph-mon[92072]: pgmap v84: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 53 KiB/s wr, 258 op/s 2023-03-02T10:59:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:39 smithi122 ceph-mon[125440]: pgmap v84: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 53 KiB/s wr, 258 op/s 2023-03-02T10:59:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:39 smithi136 ceph-mon[125702]: pgmap v84: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 53 KiB/s wr, 258 op/s 2023-03-02T10:59:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:41 smithi122 ceph-mon[125440]: pgmap v85: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 16 KiB/s wr, 85 op/s 2023-03-02T10:59:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:41 smithi136 ceph-mon[125702]: pgmap v85: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 16 KiB/s wr, 85 op/s 2023-03-02T10:59:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:41 smithi057 ceph-mon[92072]: pgmap v85: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 16 KiB/s wr, 85 op/s 2023-03-02T10:59:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:43 smithi122 ceph-mon[125440]: pgmap v86: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 16 KiB/s wr, 90 op/s 2023-03-02T10:59:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:43 smithi136 ceph-mon[125702]: pgmap v86: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 16 KiB/s wr, 90 op/s 2023-03-02T10:59:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:43 smithi057 ceph-mon[92072]: pgmap v86: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 16 KiB/s wr, 90 op/s 2023-03-02T10:59:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:45 smithi122 ceph-mon[125440]: pgmap v87: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 2.7 KiB/s wr, 84 op/s 2023-03-02T10:59:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:45 smithi136 ceph-mon[125702]: pgmap v87: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 2.7 KiB/s wr, 84 op/s 2023-03-02T10:59:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:45 smithi057 ceph-mon[92072]: pgmap v87: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 2.7 KiB/s wr, 84 op/s 2023-03-02T10:59:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:47 smithi122 ceph-mon[125440]: pgmap v88: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 2.7 KiB/s wr, 84 op/s 2023-03-02T10:59:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:47 smithi136 ceph-mon[125702]: pgmap v88: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 2.7 KiB/s wr, 84 op/s 2023-03-02T10:59:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:47 smithi057 ceph-mon[92072]: pgmap v88: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 2.7 KiB/s wr, 84 op/s 2023-03-02T10:59:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:48.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T10:59:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:48.867+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T10:59:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:48.867+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T10:59:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:48.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T10:59:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T10:59:48.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T10:59:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:49 smithi057 ceph-mon[92072]: pgmap v89: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 3.3 KiB/s wr, 70 op/s 2023-03-02T10:59:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:49 smithi122 ceph-mon[125440]: pgmap v89: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 3.3 KiB/s wr, 70 op/s 2023-03-02T10:59:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:49 smithi136 ceph-mon[125702]: pgmap v89: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 3.3 KiB/s wr, 70 op/s 2023-03-02T10:59:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:51 smithi122 ceph-mon[125440]: pgmap v90: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 8 op/s 2023-03-02T10:59:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:51 smithi136 ceph-mon[125702]: pgmap v90: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 8 op/s 2023-03-02T10:59:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:51 smithi057 ceph-mon[92072]: pgmap v90: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 8 op/s 2023-03-02T10:59:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:53 smithi122 ceph-mon[125440]: pgmap v91: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-02T10:59:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:53 smithi136 ceph-mon[125702]: pgmap v91: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-02T10:59:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:53 smithi057 ceph-mon[92072]: pgmap v91: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-02T10:59:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:55 smithi122 ceph-mon[125440]: pgmap v92: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-03-02T10:59:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:55 smithi136 ceph-mon[125702]: pgmap v92: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-03-02T10:59:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:55 smithi057 ceph-mon[92072]: pgmap v92: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-03-02T10:59:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:57 smithi122 ceph-mon[125440]: pgmap v93: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-02T10:59:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:57 smithi136 ceph-mon[125702]: pgmap v93: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-02T10:59:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:57 smithi057 ceph-mon[92072]: pgmap v93: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-02T10:59:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 10:59:59 smithi057 ceph-mon[92072]: pgmap v94: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 11 op/s 2023-03-02T10:59:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 10:59:59 smithi122 ceph-mon[125440]: pgmap v94: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 11 op/s 2023-03-02T11:00:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 10:59:59 smithi136 ceph-mon[125702]: pgmap v94: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 11 op/s 2023-03-02T11:00:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T11:00:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T11:00:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T11:00:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:01 smithi057 ceph-mon[92072]: pgmap v95: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:01 smithi122 ceph-mon[125440]: pgmap v95: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:01 smithi136 ceph-mon[125702]: pgmap v95: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:02.394 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:00:02.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.567+0000 7f93279ff700 1 -- 172.21.15.57:0/2879553357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f932010a050 msgr2=0x7f932010c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:02.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.567+0000 7f93279ff700 1 --2- 172.21.15.57:0/2879553357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f932010a050 0x7f932010c490 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9318009f90 tx=0x7f931800b330 comp rx=0 tx=0).stop 2023-03-02T11:00:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.567+0000 7f93279ff700 1 -- 172.21.15.57:0/2879553357 shutdown_connections 2023-03-02T11:00:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.567+0000 7f93279ff700 1 --2- 172.21.15.57:0/2879553357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f932010a050 0x7f932010c490 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.567+0000 7f93279ff700 1 --2- 172.21.15.57:0/2879553357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9320100c80 0x7f9320101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.567+0000 7f93279ff700 1 --2- 172.21.15.57:0/2879553357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9320101590 0x7f9320109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.567+0000 7f93279ff700 1 -- 172.21.15.57:0/2879553357 >> 172.21.15.57:0/2879553357 conn(0x7f93200fa4b0 msgr2=0x7f93200fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.567+0000 7f93279ff700 1 -- 172.21.15.57:0/2879553357 shutdown_connections 2023-03-02T11:00:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.567+0000 7f93279ff700 1 -- 172.21.15.57:0/2879553357 wait complete. 2023-03-02T11:00:02.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f93279ff700 1 Processor -- start 2023-03-02T11:00:02.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f93279ff700 1 -- start start 2023-03-02T11:00:02.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f93279ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9320100c80 0x7f93200fe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f93279ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9320101590 0x7f93200fee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f93279ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f932010a050 0x7f93201a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f93279ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93200ff640 con 0x7f9320101590 2023-03-02T11:00:02.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f93279ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93201a4480 con 0x7f9320100c80 2023-03-02T11:00:02.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f93279ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93201a45c0 con 0x7f932010a050 2023-03-02T11:00:02.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f932579b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9320100c80 0x7f93200fe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f932579b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9320100c80 0x7f93200fe8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:56662/0 (socket says 172.21.15.57:56662) 2023-03-02T11:00:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f932579b700 1 -- 172.21.15.57:0/1679581309 learned_addr learned my addr 172.21.15.57:0/1679581309 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:00:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.568+0000 7f9325f9c700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f932010a050 0x7f93201a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f9324f9a700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9320101590 0x7f93200fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f932579b700 1 -- 172.21.15.57:0/1679581309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f932010a050 msgr2=0x7f93201a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f932579b700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f932010a050 0x7f93201a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f932579b700 1 -- 172.21.15.57:0/1679581309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9320101590 msgr2=0x7f93200fee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:02.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f932579b700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9320101590 0x7f93200fee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f932579b700 1 -- 172.21.15.57:0/1679581309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9318009c40 con 0x7f9320100c80 2023-03-02T11:00:02.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f932579b700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9320100c80 0x7f93200fe8d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f931c00e9c0 tx=0x7f931c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:02.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f93167fc700 1 -- 172.21.15.57:0/1679581309 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c004a30 con 0x7f9320100c80 2023-03-02T11:00:02.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f93279ff700 1 -- 172.21.15.57:0/1679581309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932010fb20 con 0x7f9320100c80 2023-03-02T11:00:02.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f93167fc700 1 -- 172.21.15.57:0/1679581309 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f931c00cc80 con 0x7f9320100c80 2023-03-02T11:00:02.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f93167fc700 1 -- 172.21.15.57:0/1679581309 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c0054e0 con 0x7f9320100c80 2023-03-02T11:00:02.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.569+0000 7f93279ff700 1 -- 172.21.15.57:0/1679581309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932010f990 con 0x7f9320100c80 2023-03-02T11:00:02.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.573+0000 7f93167fc700 1 -- 172.21.15.57:0/1679581309 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f931c01e020 con 0x7f9320100c80 2023-03-02T11:00:02.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.574+0000 7f933b2b0b80 1 Processor -- start 2023-03-02T11:00:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.574+0000 7f93167fc700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f930c09b480 0x7f930c09d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.574+0000 7f933b2b0b80 1 -- start start 2023-03-02T11:00:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.574+0000 7f93167fc700 1 -- 172.21.15.57:0/1679581309 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f931c014070 con 0x7f9320100c80 2023-03-02T11:00:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.574+0000 7f9325f9c700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f930c09b480 0x7f930c09d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.574+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7ad790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.574+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.574+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.574+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d714a60 con 0x55ce3d7b2110 2023-03-02T11:00:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.574+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d6c6f80 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.574+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d697160 con 0x55ce3d7adcd0 2023-03-02T11:00:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f932579b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f9324f9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f9324f9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:57400/0 (socket says 172.21.15.57:57400) 2023-03-02T11:00:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f932579b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7ad790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:56664/0 (socket says 172.21.15.57:56664) 2023-03-02T11:00:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f9324f9a700 1 -- 172.21.15.57:0/1256687344 learned_addr learned my addr 172.21.15.57:0/1256687344 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:00:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f9325f9c700 1 --2- 172.21.15.57:0/1256687344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f9324f9a700 1 -- 172.21.15.57:0/1256687344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 msgr2=0x55ce3d7ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f9324f9a700 1 --2- 172.21.15.57:0/1256687344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7ad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f9324f9a700 1 -- 172.21.15.57:0/1256687344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7b2110 msgr2=0x55ce3d7b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f9324f9a700 1 --2- 172.21.15.57:0/1256687344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f9324f9a700 1 -- 172.21.15.57:0/1256687344 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce3d581630 con 0x55ce3d7adcd0 2023-03-02T11:00:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f932579b700 1 --2- 172.21.15.57:0/1256687344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:00:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f9325f9c700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f930c09b480 0x7f930c09d930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9318009550 tx=0x7f9318007e50 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f9324f9a700 1 --2- 172.21.15.57:0/1256687344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b1bd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9310009ca0 tx=0x7f9310011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3477b6756cf99795 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f930b7fe700 1 -- 172.21.15.57:0/1256687344 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310011d00 con 0x55ce3d7adcd0 2023-03-02T11:00:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f930b7fe700 1 -- 172.21.15.57:0/1256687344 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9310011e60 con 0x55ce3d7adcd0 2023-03-02T11:00:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.575+0000 7f930b7fe700 1 -- 172.21.15.57:0/1256687344 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310019430 con 0x55ce3d7adcd0 2023-03-02T11:00:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.576+0000 7f933b2b0b80 1 -- 172.21.15.57:0/1256687344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 msgr2=0x55ce3d7b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.576+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/1256687344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b1bd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9310009ca0 tx=0x7f9310011440 comp rx=0 tx=0).stop 2023-03-02T11:00:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.576+0000 7f933b2b0b80 1 -- 172.21.15.57:0/1256687344 shutdown_connections 2023-03-02T11:00:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.576+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/1256687344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.576+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/1256687344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.576+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/1256687344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b1bd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.576+0000 7f933b2b0b80 1 -- 172.21.15.57:0/1256687344 >> 172.21.15.57:0/1256687344 conn(0x55ce3d7a2c50 msgr2=0x55ce3d7a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.576+0000 7f933b2b0b80 1 -- 172.21.15.57:0/1256687344 shutdown_connections 2023-03-02T11:00:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.576+0000 7f933b2b0b80 1 -- 172.21.15.57:0/1256687344 wait complete. 2023-03-02T11:00:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.576+0000 7f933b2b0b80 1 -- start start 2023-03-02T11:00:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f933b2b0b80 1 Processor -- start 2023-03-02T11:00:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d705bc0 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d6ff0f0 con 0x55ce3d7b2110 2023-03-02T11:00:02.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d583920 con 0x55ce3d7adcd0 2023-03-02T11:00:02.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f933b2b0b80 10 client.0 _ll_register_callbacks cb 0x55ce3d6a5520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:00:02.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f9325f9c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f932579b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f9324f9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f9325f9c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:56676/0 (socket says 172.21.15.57:56676) 2023-03-02T11:00:02.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f9325f9c700 1 -- 172.21.15.57:0/370018534 learned_addr learned my addr 172.21.15.57:0/370018534 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:00:02.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f932579b700 1 -- 172.21.15.57:0/370018534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 msgr2=0x55ce3d7b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:02.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.577+0000 7f932579b700 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f932579b700 1 -- 172.21.15.57:0/370018534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 msgr2=0x55ce3d7b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:02.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f932579b700 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f932579b700 1 -- 172.21.15.57:0/370018534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9310009900 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f9325f9c700 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:00:02.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f932579b700 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7b6d10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f931c0943b0 tx=0x7f931c094270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5317fc4b4b0aec28 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:02.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f9308ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:00:02.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f9308ff9700 1 -- 172.21.15.57:0/370018534 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c00cdf0 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f933b2b0b80 1 -- 172.21.15.57:0/370018534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce3d6d07b0 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f9308ff9700 1 -- 172.21.15.57:0/370018534 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f931c094db0 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f9308ff9700 1 -- 172.21.15.57:0/370018534 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f931c0946b0 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f933b2b0b80 10 client.16197 fetch_fsmap learned FSMap version 40 2023-03-02T11:00:02.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f933b2b0b80 1 -- 172.21.15.57:0/370018534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55ce3d52dde0 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f9308ff9700 1 -- 172.21.15.57:0/370018534 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ce3d6d07b0 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.578+0000 7f9308ff9700 1 -- 172.21.15.57:0/370018534 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 40) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f931c09b940 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.579+0000 7f933b2b0b80 10 client.16197 fetch_fsmap finished waiting for FSMap version 40 2023-03-02T11:00:02.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.579+0000 7f933b2b0b80 10 client.16197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:00:02.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.579+0000 7f933b2b0b80 20 client.16197 populate_metadata read hostname 'smithi057' 2023-03-02T11:00:02.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.579+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55ce3d7c7370 0x55ce3d7c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.579+0000 7f933b2b0b80 4 client.16197 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:00:02.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.579+0000 7f933b2b0b80 1 -- 172.21.15.57:0/370018534 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce3d6f8170 con 0x55ce3d7c7370 2023-03-02T11:00:02.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.579+0000 7f9324f9a700 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55ce3d7c7370 0x55ce3d7c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.579+0000 7f9308ff9700 10 client.16197 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:00:02.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.579+0000 7f9324f9a700 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55ce3d7c7370 0x55ce3d7c9750 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ed004ee7aa82bc2 server_cookie=8d41c0197a50f04f in_seq=0 out_seq=0 2023-03-02T11:00:02.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f9308ff9700 1 -- 172.21.15.57:0/370018534 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55ce3d6f8170 con 0x55ce3d7c7370 2023-03-02T11:00:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f9308ff9700 10 client.16197 handle_command_reply: tid=0 2023-03-02T11:00:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 1 client.16197 shutdown 2023-03-02T11:00:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 1 -- 172.21.15.57:0/370018534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 msgr2=0x55ce3d7b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7b6d10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f931c0943b0 tx=0x7f931c094270 comp rx=0 tx=0).stop 2023-03-02T11:00:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 1 -- 172.21.15.57:0/370018534 shutdown_connections 2023-03-02T11:00:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55ce3d7c7370 0x55ce3d7c9750 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7b6d10 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/370018534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f9308ff9700 0 client.16197 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:00:02.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 1 -- 172.21.15.57:0/370018534 >> 172.21.15.57:0/370018534 conn(0x55ce3d7a2c50 msgr2=0x55ce3d7a8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:02.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 1 -- 172.21.15.57:0/370018534 shutdown_connections 2023-03-02T11:00:02.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 1 -- 172.21.15.57:0/370018534 wait complete. 2023-03-02T11:00:02.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.580+0000 7f933b2b0b80 20 client.16197 trim_cache size 0 max 16384 2023-03-02T11:00:02.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.597+0000 7f933b2b0b80 1 Processor -- start 2023-03-02T11:00:02.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.597+0000 7f933b2b0b80 1 -- start start 2023-03-02T11:00:02.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.597+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.597+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.597+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.597+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d7c3d20 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.597+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d7ce300 con 0x55ce3d7b2110 2023-03-02T11:00:02.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.597+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d7b0b40 con 0x55ce3d7adcd0 2023-03-02T11:00:02.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f9324f9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f932579b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f9325f9c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f932579b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44478/0 (socket says 172.21.15.57:44478) 2023-03-02T11:00:02.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f932579b700 1 -- 172.21.15.57:0/2629608165 learned_addr learned my addr 172.21.15.57:0/2629608165 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:00:02.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f9324f9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:57428/0 (socket says 172.21.15.57:57428) 2023-03-02T11:00:02.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f9325f9c700 1 -- 172.21.15.57:0/2629608165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 msgr2=0x55ce3d7b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:02.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f9325f9c700 1 --2- 172.21.15.57:0/2629608165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f9325f9c700 1 -- 172.21.15.57:0/2629608165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 msgr2=0x55ce3d7b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:02.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f9325f9c700 1 --2- 172.21.15.57:0/2629608165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f9325f9c700 1 -- 172.21.15.57:0/2629608165 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce3d7a43f0 con 0x55ce3d7b2110 2023-03-02T11:00:02.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f932579b700 1 --2- 172.21.15.57:0/2629608165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:00:02.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f9325f9c700 1 --2- 172.21.15.57:0/2629608165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b1790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9318015000 tx=0x7f9318023000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0843d2db18bc07f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:02.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f930bfff700 1 -- 172.21.15.57:0/2629608165 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800e040 con 0x55ce3d7b2110 2023-03-02T11:00:02.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f930bfff700 1 -- 172.21.15.57:0/2629608165 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9318003cc0 con 0x55ce3d7b2110 2023-03-02T11:00:02.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.598+0000 7f930bfff700 1 -- 172.21.15.57:0/2629608165 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318005670 con 0x55ce3d7b2110 2023-03-02T11:00:02.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.599+0000 7f933b2b0b80 1 -- 172.21.15.57:0/2629608165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 msgr2=0x55ce3d7b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:02.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.599+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/2629608165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b1790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9318015000 tx=0x7f9318023000 comp rx=0 tx=0).stop 2023-03-02T11:00:02.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.599+0000 7f933b2b0b80 1 -- 172.21.15.57:0/2629608165 shutdown_connections 2023-03-02T11:00:02.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.599+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/2629608165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7b2110 0x55ce3d7b1790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.599+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/2629608165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.599+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/2629608165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.599+0000 7f933b2b0b80 1 -- 172.21.15.57:0/2629608165 >> 172.21.15.57:0/2629608165 conn(0x55ce3d7a2c50 msgr2=0x55ce3d7c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:02.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.599+0000 7f933b2b0b80 1 -- 172.21.15.57:0/2629608165 shutdown_connections 2023-03-02T11:00:02.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.599+0000 7f933b2b0b80 1 -- 172.21.15.57:0/2629608165 wait complete. 2023-03-02T11:00:02.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.599+0000 7f933b2b0b80 1 -- start start 2023-03-02T11:00:02.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.599+0000 7f933b2b0b80 1 Processor -- start 2023-03-02T11:00:02.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7bde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7bc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f933b2b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7b2110 0x55ce3d7bc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d7bcda0 con 0x55ce3d7adcd0 2023-03-02T11:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d7bcf10 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f933b2b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d7bd0d0 con 0x55ce3d7b2110 2023-03-02T11:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f933b2b0b80 10 client.0 _ll_register_callbacks cb 0x55ce3d6a5520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f932579b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7bde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f9324f9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7bc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f932579b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7bde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:56686/0 (socket says 172.21.15.57:56686) 2023-03-02T11:00:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f932579b700 1 -- 172.21.15.57:0/3209841942 learned_addr learned my addr 172.21.15.57:0/3209841942 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:00:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f9324f9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7bc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44484/0 (socket says 172.21.15.57:44484) 2023-03-02T11:00:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f9325f9c700 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7b2110 0x55ce3d7bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f932579b700 1 -- 172.21.15.57:0/3209841942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7b2110 msgr2=0x55ce3d7bc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f932579b700 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7b2110 0x55ce3d7bc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f932579b700 1 -- 172.21.15.57:0/3209841942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7adcd0 msgr2=0x55ce3d7bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:02.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f932579b700 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7bc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f932579b700 1 -- 172.21.15.57:0/3209841942 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce3d52dde0 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.600+0000 7f9324f9a700 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7bc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:00:02.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f932579b700 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7bde00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c5b0 tx=0x7f931c005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7812abc4c34d395b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:02.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f9308ff9700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:00:02.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f9308ff9700 1 -- 172.21.15.57:0/3209841942 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c093e20 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f9308ff9700 1 -- 172.21.15.57:0/3209841942 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f931c00cdf0 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f933b2b0b80 1 -- 172.21.15.57:0/3209841942 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9310011e60 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f9308ff9700 1 -- 172.21.15.57:0/3209841942 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f931c094db0 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f933b2b0b80 10 client.26045 fetch_fsmap learned FSMap version 40 2023-03-02T11:00:02.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f933b2b0b80 1 -- 172.21.15.57:0/3209841942 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x7f9318026070 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f9308ff9700 1 -- 172.21.15.57:0/3209841942 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9310011e60 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f9308ff9700 1 -- 172.21.15.57:0/3209841942 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 40) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f931c0936a0 con 0x55ce3d7ad3c0 2023-03-02T11:00:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f933b2b0b80 10 client.26045 fetch_fsmap finished waiting for FSMap version 40 2023-03-02T11:00:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f933b2b0b80 10 client.26045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:00:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f933b2b0b80 20 client.26045 populate_metadata read hostname 'smithi057' 2023-03-02T11:00:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55ce3d819d00 0x55ce3d81c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f933b2b0b80 4 client.26045 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:00:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f933b2b0b80 1 -- 172.21.15.57:0/3209841942 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ce3d6f7e90 con 0x55ce3d819d00 2023-03-02T11:00:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.601+0000 7f9324f9a700 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55ce3d819d00 0x55ce3d81c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f9324f9a700 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55ce3d819d00 0x55ce3d81c110 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=357c76b0a6b75aae server_cookie=89465767ad1192c5 in_seq=0 out_seq=0 2023-03-02T11:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f9308ff9700 10 client.26045 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f9308ff9700 1 -- 172.21.15.57:0/3209841942 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ce3d6f7e90 con 0x55ce3d819d00 2023-03-02T11:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f9308ff9700 10 client.26045 handle_command_reply: tid=0 2023-03-02T11:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f933b2b0b80 1 client.26045 shutdown 2023-03-02T11:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f933b2b0b80 1 -- 172.21.15.57:0/3209841942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 msgr2=0x55ce3d7bde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7bde00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c5b0 tx=0x7f931c005850 comp rx=0 tx=0).stop 2023-03-02T11:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f933b2b0b80 1 -- 172.21.15.57:0/3209841942 shutdown_connections 2023-03-02T11:00:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55ce3d819d00 0x55ce3d81c110 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ce3d7b2110 0x55ce3d7bc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f9308ff9700 0 client.26045 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:00:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce3d7ad3c0 0x55ce3d7bde00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f933b2b0b80 1 --2- 172.21.15.57:0/3209841942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce3d7adcd0 0x55ce3d7bc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f933b2b0b80 1 -- 172.21.15.57:0/3209841942 >> 172.21.15.57:0/3209841942 conn(0x55ce3d7a2c50 msgr2=0x55ce3d7b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f933b2b0b80 1 -- 172.21.15.57:0/3209841942 shutdown_connections 2023-03-02T11:00:02.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.602+0000 7f933b2b0b80 1 -- 172.21.15.57:0/3209841942 wait complete. 2023-03-02T11:00:02.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f933b2b0b80 20 client.26045 trim_cache size 0 max 16384 2023-03-02T11:00:02.616 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:00:02.616 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:00:02.616 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:00:02.616 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:00:02.617 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:00:02.617 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:00:02.617 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:00:02.617 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:00:02.617 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:00:02.617 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:00:02.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 -- 172.21.15.57:0/1679581309 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f930c09b480 msgr2=0x7f930c09d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f930c09b480 0x7f930c09d930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9318009550 tx=0x7f9318007e50 comp rx=0 tx=0).stop 2023-03-02T11:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 -- 172.21.15.57:0/1679581309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9320100c80 msgr2=0x7f93200fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9320100c80 0x7f93200fe8d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f931c00e9c0 tx=0x7f931c00ecd0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 -- 172.21.15.57:0/1679581309 shutdown_connections 2023-03-02T11:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f930c09b480 0x7f930c09d930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f932010a050 0x7f93201a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9320100c80 0x7f93200fe8d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 --2- 172.21.15.57:0/1679581309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9320101590 0x7f93200fee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:02.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 -- 172.21.15.57:0/1679581309 >> 172.21.15.57:0/1679581309 conn(0x7f93200fa4b0 msgr2=0x7f932010c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:02.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 -- 172.21.15.57:0/1679581309 shutdown_connections 2023-03-02T11:00:02.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:02.603+0000 7f93279ff700 1 -- 172.21.15.57:0/1679581309 wait complete. 2023-03-02T11:00:02.620 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:00:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:03.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:03.876+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:00:03.877 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:03.876+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:00:03.877 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:03.876+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:00:03.877 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:03.876+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:00:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:03 smithi057 ceph-mon[92072]: pgmap v96: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:00:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:03 smithi122 ceph-mon[125440]: pgmap v96: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:00:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:03 smithi136 ceph-mon[125702]: pgmap v96: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:00:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:05 smithi057 ceph-mon[92072]: pgmap v97: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:00:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:05 smithi122 ceph-mon[125440]: pgmap v97: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:00:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:05 smithi136 ceph-mon[125702]: pgmap v97: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:00:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:07 smithi057 ceph-mon[92072]: pgmap v98: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-03-02T11:00:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:07 smithi122 ceph-mon[125440]: pgmap v98: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-03-02T11:00:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:07 smithi136 ceph-mon[125702]: pgmap v98: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-03-02T11:00:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:09 smithi057 ceph-mon[92072]: pgmap v99: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-03-02T11:00:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:00:09.946 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:09 smithi136 ceph-mon[125702]: pgmap v99: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-03-02T11:00:09.946 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:00:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:09 smithi122 ceph-mon[125440]: pgmap v99: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-03-02T11:00:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:00:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:00:11.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:00:11.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:00:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:00:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:11.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:00:11.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:00:11.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:00:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:12 smithi057 ceph-mon[92072]: pgmap v100: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:00:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:12 smithi122 ceph-mon[125440]: pgmap v100: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:00:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:12 smithi136 ceph-mon[125702]: pgmap v100: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:00:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:14 smithi057 ceph-mon[92072]: pgmap v101: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:00:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:14 smithi122 ceph-mon[125440]: pgmap v101: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:00:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:14 smithi136 ceph-mon[125702]: pgmap v101: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:00:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:16 smithi057 ceph-mon[92072]: pgmap v102: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:00:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:16 smithi122 ceph-mon[125440]: pgmap v102: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:00:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:16 smithi136 ceph-mon[125702]: pgmap v102: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:00:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:18 smithi057 ceph-mon[92072]: pgmap v103: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-03-02T11:00:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:18 smithi122 ceph-mon[125440]: pgmap v103: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-03-02T11:00:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:18 smithi136 ceph-mon[125702]: pgmap v103: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-03-02T11:00:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:18.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:18.889+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:00:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:18.889+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:00:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:18.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:00:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:18.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:00:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:19 smithi057 ceph-mon[92072]: pgmap v104: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-03-02T11:00:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:19 smithi122 ceph-mon[125440]: pgmap v104: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-03-02T11:00:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:19 smithi136 ceph-mon[125702]: pgmap v104: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-03-02T11:00:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:21 smithi122 ceph-mon[125440]: pgmap v105: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:00:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:21 smithi136 ceph-mon[125702]: pgmap v105: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:00:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:21 smithi057 ceph-mon[92072]: pgmap v105: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:00:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:22 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:00:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:22 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:00:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:22 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:00:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:23 smithi136 ceph-mon[125702]: pgmap v106: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:00:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:23 smithi057 ceph-mon[92072]: pgmap v106: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:00:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:23 smithi122 ceph-mon[125440]: pgmap v106: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:00:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:25 smithi136 ceph-mon[125702]: pgmap v107: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:25 smithi057 ceph-mon[92072]: pgmap v107: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:25 smithi122 ceph-mon[125440]: pgmap v107: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:27 smithi136 ceph-mon[125702]: pgmap v108: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:00:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:27 smithi057 ceph-mon[92072]: pgmap v108: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:00:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:27 smithi122 ceph-mon[125440]: pgmap v108: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:00:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:29 smithi136 ceph-mon[125702]: pgmap v109: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T11:00:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:29 smithi057 ceph-mon[92072]: pgmap v109: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T11:00:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:29 smithi122 ceph-mon[125440]: pgmap v109: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T11:00:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:31 smithi136 ceph-mon[125702]: pgmap v110: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:31 smithi057 ceph-mon[92072]: pgmap v110: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:31 smithi122 ceph-mon[125440]: pgmap v110: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:32.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:00:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.794+0000 7f0fbcbff700 1 -- 172.21.15.57:0/1326169091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fb80fe9b0 msgr2=0x7f0fb80fee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.794+0000 7f0fbcbff700 1 --2- 172.21.15.57:0/1326169091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fb80fe9b0 0x7f0fb80fee20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009990 tx=0x7f0fac009ca0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.794+0000 7f0fbcbff700 1 -- 172.21.15.57:0/1326169091 shutdown_connections 2023-03-02T11:00:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.794+0000 7f0fbcbff700 1 --2- 172.21.15.57:0/1326169091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fb80ff360 0x7f0fb810b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.794+0000 7f0fbcbff700 1 --2- 172.21.15.57:0/1326169091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb81049c0 0x7f0fb8104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.794+0000 7f0fbcbff700 1 --2- 172.21.15.57:0/1326169091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fb80fe9b0 0x7f0fb80fee20 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.794+0000 7f0fbcbff700 1 -- 172.21.15.57:0/1326169091 >> 172.21.15.57:0/1326169091 conn(0x7f0fb80fa4b0 msgr2=0x7f0fb80fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.794+0000 7f0fbcbff700 1 -- 172.21.15.57:0/1326169091 shutdown_connections 2023-03-02T11:00:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.794+0000 7f0fbcbff700 1 -- 172.21.15.57:0/1326169091 wait complete. 2023-03-02T11:00:32.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.795+0000 7f0fbcbff700 1 Processor -- start 2023-03-02T11:00:32.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.795+0000 7f0fbcbff700 1 -- start start 2023-03-02T11:00:32.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.795+0000 7f0fbcbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fb80fe9b0 0x7f0fb819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.795+0000 7f0fbcbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb80ff360 0x7f0fb819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.795+0000 7f0fbcbff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fb81049c0 0x7f0fb81959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.795+0000 7f0fbcbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8196040 con 0x7f0fb80fe9b0 2023-03-02T11:00:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.795+0000 7f0fbcbff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb81961b0 con 0x7f0fb81049c0 2023-03-02T11:00:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.795+0000 7f0fbcbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8196370 con 0x7f0fb80ff360 2023-03-02T11:00:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fb80fe9b0 0x7f0fb819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fb5d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb80ff360 0x7f0fb819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fb6d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fb81049c0 0x7f0fb81959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fb80fe9b0 0x7f0fb819b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52466/0 (socket says 172.21.15.57:52466) 2023-03-02T11:00:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fb659c700 1 -- 172.21.15.57:0/4200627285 learned_addr learned my addr 172.21.15.57:0/4200627285 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:00:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fb659c700 1 -- 172.21.15.57:0/4200627285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb80ff360 msgr2=0x7f0fb819bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fb659c700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb80ff360 0x7f0fb819bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fb659c700 1 -- 172.21.15.57:0/4200627285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fb81049c0 msgr2=0x7f0fb81959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fb659c700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fb81049c0 0x7f0fb81959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fb659c700 1 -- 172.21.15.57:0/4200627285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0095f0 con 0x7f0fb80fe9b0 2023-03-02T11:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fb659c700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fb80fe9b0 0x7f0fb819b960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800e970 tx=0x7f0fa800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fa77fe700 1 -- 172.21.15.57:0/4200627285 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8009790 con 0x7f0fb80fe9b0 2023-03-02T11:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fa77fe700 1 -- 172.21.15.57:0/4200627285 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0fa800c760 con 0x7f0fb80fe9b0 2023-03-02T11:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fbcbff700 1 -- 172.21.15.57:0/4200627285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb810eaa0 con 0x7f0fb80fe9b0 2023-03-02T11:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fa77fe700 1 -- 172.21.15.57:0/4200627285 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8003bb0 con 0x7f0fb80fe9b0 2023-03-02T11:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.796+0000 7f0fbcbff700 1 -- 172.21.15.57:0/4200627285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb810e910 con 0x7f0fb80fe9b0 2023-03-02T11:00:32.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.800+0000 7f0fa77fe700 1 -- 172.21.15.57:0/4200627285 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f0fa801e020 con 0x7f0fb80fe9b0 2023-03-02T11:00:32.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.801+0000 7f0fa77fe700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f0fa009b480 0x7f0fa009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.801+0000 7f0fd049db80 1 Processor -- start 2023-03-02T11:00:32.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.801+0000 7f0fa77fe700 1 -- 172.21.15.57:0/4200627285 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f0fa8014070 con 0x7f0fb80fe9b0 2023-03-02T11:00:32.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.801+0000 7f0fb5d9b700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f0fa009b480 0x7f0fa009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.801+0000 7f0fd049db80 1 -- start start 2023-03-02T11:00:32.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.801+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 0x55fd8d271790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.801+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d275bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.801+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d276110 0x55fd8d276560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.801+0000 7f0fd049db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d1d8a60 con 0x55fd8d271cd0 2023-03-02T11:00:32.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fd049db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d18af80 con 0x55fd8d276110 2023-03-02T11:00:32.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fd049db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d15b160 con 0x55fd8d2713c0 2023-03-02T11:00:32.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 0x55fd8d271790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 0x55fd8d271790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:45960/0 (socket says 172.21.15.57:45960) 2023-03-02T11:00:32.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb659c700 1 -- 172.21.15.57:0/967463326 learned_addr learned my addr 172.21.15.57:0/967463326 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:00:32.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb6d9d700 1 --2- 172.21.15.57:0/967463326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d276110 0x55fd8d276560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb5d9b700 1 --2- 172.21.15.57:0/967463326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d275bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb5d9b700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f0fa009b480 0x7f0fa009d930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8104370 tx=0x7f0fac005fd0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:32.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb659c700 1 -- 172.21.15.57:0/967463326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d276110 msgr2=0x55fd8d276560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:32.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb659c700 1 --2- 172.21.15.57:0/967463326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d276110 0x55fd8d276560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb659c700 1 -- 172.21.15.57:0/967463326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 msgr2=0x55fd8d275bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:32.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb659c700 1 --2- 172.21.15.57:0/967463326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d275bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb659c700 1 -- 172.21.15.57:0/967463326 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd8d045630 con 0x55fd8d2713c0 2023-03-02T11:00:32.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb6d9d700 1 --2- 172.21.15.57:0/967463326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d276110 0x55fd8d276560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:00:32.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fb659c700 1 --2- 172.21.15.57:0/967463326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 0x55fd8d271790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8094330 tx=0x7f0fa8094360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7d31cd18ac84265 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:32.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.802+0000 7f0fa4ff9700 1 -- 172.21.15.57:0/967463326 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa809be10 con 0x55fd8d2713c0 2023-03-02T11:00:32.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.803+0000 7f0fa4ff9700 1 -- 172.21.15.57:0/967463326 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0fa8092a90 con 0x55fd8d2713c0 2023-03-02T11:00:32.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.803+0000 7f0fa4ff9700 1 -- 172.21.15.57:0/967463326 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8094bb0 con 0x55fd8d2713c0 2023-03-02T11:00:32.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.803+0000 7f0fd049db80 1 -- 172.21.15.57:0/967463326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 msgr2=0x55fd8d271790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:32.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.803+0000 7f0fd049db80 1 --2- 172.21.15.57:0/967463326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 0x55fd8d271790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8094330 tx=0x7f0fa8094360 comp rx=0 tx=0).stop 2023-03-02T11:00:32.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.803+0000 7f0fd049db80 1 -- 172.21.15.57:0/967463326 shutdown_connections 2023-03-02T11:00:32.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.803+0000 7f0fd049db80 1 --2- 172.21.15.57:0/967463326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d276110 0x55fd8d276560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.803+0000 7f0fd049db80 1 --2- 172.21.15.57:0/967463326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 0x55fd8d271790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.803+0000 7f0fd049db80 1 --2- 172.21.15.57:0/967463326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d275bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.803+0000 7f0fd049db80 1 -- 172.21.15.57:0/967463326 >> 172.21.15.57:0/967463326 conn(0x55fd8d266c50 msgr2=0x55fd8d26c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:32.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.803+0000 7f0fd049db80 1 -- 172.21.15.57:0/967463326 shutdown_connections 2023-03-02T11:00:32.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.803+0000 7f0fd049db80 1 -- 172.21.15.57:0/967463326 wait complete. 2023-03-02T11:00:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fd049db80 1 -- start start 2023-03-02T11:00:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fd049db80 1 Processor -- start 2023-03-02T11:00:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 0x55fd8d27ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d27b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d276110 0x55fd8d27b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fd049db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d1c9bc0 con 0x55fd8d271cd0 2023-03-02T11:00:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fd049db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d1c30f0 con 0x55fd8d2713c0 2023-03-02T11:00:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fd049db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d047920 con 0x55fd8d276110 2023-03-02T11:00:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fd049db80 10 client.0 _ll_register_callbacks cb 0x55fd8d169520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:00:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 0x55fd8d27ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 0x55fd8d27ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:55546/0 (socket says 172.21.15.57:55546) 2023-03-02T11:00:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fb5d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d27b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fb659c700 1 -- 172.21.15.57:0/1332463216 learned_addr learned my addr 172.21.15.57:0/1332463216 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:00:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.804+0000 7f0fb6d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d276110 0x55fd8d27b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0fb659c700 1 -- 172.21.15.57:0/1332463216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d276110 msgr2=0x55fd8d27b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0fb659c700 1 --2- 172.21.15.57:0/1332463216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d276110 0x55fd8d27b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0fb659c700 1 -- 172.21.15.57:0/1332463216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 msgr2=0x55fd8d27b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0fb659c700 1 --2- 172.21.15.57:0/1332463216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d27b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0fb659c700 1 -- 172.21.15.57:0/1332463216 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb810e910 con 0x55fd8d2713c0 2023-03-02T11:00:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0fb659c700 1 --2- 172.21.15.57:0/1332463216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 0x55fd8d27ad20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8090bf0 tx=0x7f0fa80947b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6563c17ddadad705 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0f9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:00:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0f9dffb700 1 -- 172.21.15.57:0/1332463216 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8060070 con 0x55fd8d2713c0 2023-03-02T11:00:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0f9dffb700 1 -- 172.21.15.57:0/1332463216 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f0fa809be10 con 0x55fd8d2713c0 2023-03-02T11:00:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0fd049db80 1 -- 172.21.15.57:0/1332463216 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd8d1947b0 con 0x55fd8d2713c0 2023-03-02T11:00:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0f9dffb700 1 -- 172.21.15.57:0/1332463216 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fa8003d30 con 0x55fd8d2713c0 2023-03-02T11:00:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0fd049db80 10 client.26057 fetch_fsmap learned FSMap version 41 2023-03-02T11:00:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.805+0000 7f0fd049db80 1 -- 172.21.15.57:0/1332463216 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55fd8cff1de0 con 0x55fd8d2713c0 2023-03-02T11:00:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.806+0000 7f0f9dffb700 1 -- 172.21.15.57:0/1332463216 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0fa807a080 con 0x55fd8d2713c0 2023-03-02T11:00:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.806+0000 7f0f9dffb700 1 -- 172.21.15.57:0/1332463216 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0fa80904e0 con 0x55fd8d2713c0 2023-03-02T11:00:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.806+0000 7f0fd049db80 10 client.26057 fetch_fsmap finished waiting for FSMap version 41 2023-03-02T11:00:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.806+0000 7f0fd049db80 10 client.26057 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:00:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.806+0000 7f0fd049db80 20 client.26057 populate_metadata read hostname 'smithi057' 2023-03-02T11:00:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.806+0000 7f0fd049db80 1 --2- 172.21.15.57:0/1332463216 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fd8d28af40 0x55fd8d28d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.806+0000 7f0fd049db80 4 client.26057 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:00:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.806+0000 7f0fd049db80 1 -- 172.21.15.57:0/1332463216 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd8d1bc170 con 0x55fd8d28af40 2023-03-02T11:00:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.806+0000 7f0fb5d9b700 1 --2- 172.21.15.57:0/1332463216 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fd8d28af40 0x55fd8d28d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.806+0000 7f0fb5d9b700 1 --2- 172.21.15.57:0/1332463216 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fd8d28af40 0x55fd8d28d320 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65573b4bee90b82a server_cookie=2492bb332835de8e in_seq=0 out_seq=0 2023-03-02T11:00:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.806+0000 7f0f9dffb700 10 client.26057 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:00:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0f9dffb700 1 -- 172.21.15.57:0/1332463216 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55fd8d1bc170 con 0x55fd8d28af40 2023-03-02T11:00:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0f9dffb700 10 client.26057 handle_command_reply: tid=0 2023-03-02T11:00:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 1 client.26057 shutdown 2023-03-02T11:00:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 1 -- 172.21.15.57:0/1332463216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 msgr2=0x55fd8d27ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 1 --2- 172.21.15.57:0/1332463216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 0x55fd8d27ad20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8090bf0 tx=0x7f0fa80947b0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 1 -- 172.21.15.57:0/1332463216 shutdown_connections 2023-03-02T11:00:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 1 --2- 172.21.15.57:0/1332463216 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fd8d28af40 0x55fd8d28d320 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 1 --2- 172.21.15.57:0/1332463216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d276110 0x55fd8d27b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 1 --2- 172.21.15.57:0/1332463216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 0x55fd8d27ad20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0f9dffb700 0 client.26057 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:00:32.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 1 --2- 172.21.15.57:0/1332463216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d27b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 1 -- 172.21.15.57:0/1332463216 >> 172.21.15.57:0/1332463216 conn(0x55fd8d266c50 msgr2=0x55fd8d26c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:32.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 1 -- 172.21.15.57:0/1332463216 shutdown_connections 2023-03-02T11:00:32.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 1 -- 172.21.15.57:0/1332463216 wait complete. 2023-03-02T11:00:32.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.807+0000 7f0fd049db80 20 client.26057 trim_cache size 0 max 16384 2023-03-02T11:00:32.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fd049db80 1 Processor -- start 2023-03-02T11:00:32.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fd049db80 1 -- start start 2023-03-02T11:00:32.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d266c50 0x55fd8d273a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 0x55fd8d275330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d275870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fd049db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d26b350 con 0x55fd8d271cd0 2023-03-02T11:00:32.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fd049db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d263f50 con 0x55fd8d266c50 2023-03-02T11:00:32.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fd049db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d278cb0 con 0x55fd8d2713c0 2023-03-02T11:00:32.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d266c50 0x55fd8d273a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d266c50 0x55fd8d273a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:55548/0 (socket says 172.21.15.57:55548) 2023-03-02T11:00:32.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fb659c700 1 -- 172.21.15.57:0/2897970991 learned_addr learned my addr 172.21.15.57:0/2897970991 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:00:32.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fb6d9d700 1 --2- 172.21.15.57:0/2897970991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d275870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.824+0000 7f0fb5d9b700 1 --2- 172.21.15.57:0/2897970991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 0x55fd8d275330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.825+0000 7f0fb659c700 1 -- 172.21.15.57:0/2897970991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 msgr2=0x55fd8d275330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:32.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.825+0000 7f0fb659c700 1 --2- 172.21.15.57:0/2897970991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 0x55fd8d275330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.825+0000 7f0fb659c700 1 -- 172.21.15.57:0/2897970991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 msgr2=0x55fd8d275870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:32.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.825+0000 7f0fb659c700 1 --2- 172.21.15.57:0/2897970991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d275870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.825+0000 7f0fb659c700 1 -- 172.21.15.57:0/2897970991 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd8d2683f0 con 0x55fd8d266c50 2023-03-02T11:00:32.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.825+0000 7f0fb659c700 1 --2- 172.21.15.57:0/2897970991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d266c50 0x55fd8d273a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800efd0 tx=0x7f0fa80903f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e96c4d3be4ff06 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.825+0000 7f0fa57fa700 1 -- 172.21.15.57:0/2897970991 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8060030 con 0x55fd8d266c50 2023-03-02T11:00:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.825+0000 7f0fa57fa700 1 -- 172.21.15.57:0/2897970991 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fd8d1947b0 con 0x55fd8d266c50 2023-03-02T11:00:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.825+0000 7f0fa57fa700 1 -- 172.21.15.57:0/2897970991 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa80c5050 con 0x55fd8d266c50 2023-03-02T11:00:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 -- 172.21.15.57:0/2897970991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d266c50 msgr2=0x55fd8d273a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 --2- 172.21.15.57:0/2897970991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d266c50 0x55fd8d273a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800efd0 tx=0x7f0fa80903f0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 -- 172.21.15.57:0/2897970991 shutdown_connections 2023-03-02T11:00:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 --2- 172.21.15.57:0/2897970991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d275870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 --2- 172.21.15.57:0/2897970991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d266c50 0x55fd8d273a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 --2- 172.21.15.57:0/2897970991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d2713c0 0x55fd8d275330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 -- 172.21.15.57:0/2897970991 >> 172.21.15.57:0/2897970991 conn(0x55fd8d26af80 msgr2=0x55fd8d2867e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:32.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 -- 172.21.15.57:0/2897970991 shutdown_connections 2023-03-02T11:00:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 -- 172.21.15.57:0/2897970991 wait complete. 2023-03-02T11:00:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 -- start start 2023-03-02T11:00:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 Processor -- start 2023-03-02T11:00:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d266c50 0x55fd8d2d6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 0x55fd8d2d6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d2d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d2d0e20 con 0x55fd8d271cd0 2023-03-02T11:00:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d2d0f90 con 0x55fd8d2713c0 2023-03-02T11:00:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.826+0000 7f0fd049db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8d2d1150 con 0x55fd8d266c50 2023-03-02T11:00:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fd049db80 10 client.0 _ll_register_callbacks cb 0x55fd8d169520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:00:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fb6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d2d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d266c50 0x55fd8d2d6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d266c50 0x55fd8d2d6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:45976/0 (socket says 172.21.15.57:45976) 2023-03-02T11:00:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fb5d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 0x55fd8d2d6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fb659c700 1 -- 172.21.15.57:0/2265071689 learned_addr learned my addr 172.21.15.57:0/2265071689 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:00:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fb6d9d700 1 -- 172.21.15.57:0/2265071689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d266c50 msgr2=0x55fd8d2d6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fb6d9d700 1 --2- 172.21.15.57:0/2265071689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d266c50 0x55fd8d2d6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fb6d9d700 1 -- 172.21.15.57:0/2265071689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 msgr2=0x55fd8d2d6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:00:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fb6d9d700 1 --2- 172.21.15.57:0/2265071689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 0x55fd8d2d6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fb6d9d700 1 -- 172.21.15.57:0/2265071689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd8cff1de0 con 0x55fd8d271cd0 2023-03-02T11:00:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fb6d9d700 1 --2- 172.21.15.57:0/2265071689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d2d0740 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0fb819c660 tx=0x7f0fb0007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebcb4b07303f44b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:00:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0f9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:00:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0f9dffb700 1 -- 172.21.15.57:0/2265071689 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0015040 con 0x55fd8d271cd0 2023-03-02T11:00:32.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0f9dffb700 1 -- 172.21.15.57:0/2265071689 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f0fb0010e10 con 0x55fd8d271cd0 2023-03-02T11:00:32.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.827+0000 7f0fd049db80 1 -- 172.21.15.57:0/2265071689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0fa8092a90 con 0x55fd8d271cd0 2023-03-02T11:00:32.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0f9dffb700 1 -- 172.21.15.57:0/2265071689 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fb0004bb0 con 0x55fd8d271cd0 2023-03-02T11:00:32.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0fd049db80 10 client.16221 fetch_fsmap learned FSMap version 41 2023-03-02T11:00:32.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0fd049db80 1 -- 172.21.15.57:0/2265071689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55fd8cfdac60 con 0x55fd8d271cd0 2023-03-02T11:00:32.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0f9dffb700 1 -- 172.21.15.57:0/2265071689 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0fa8092a90 con 0x55fd8d271cd0 2023-03-02T11:00:32.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0f9dffb700 1 -- 172.21.15.57:0/2265071689 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0fb0024070 con 0x55fd8d271cd0 2023-03-02T11:00:32.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0fd049db80 10 client.16221 fetch_fsmap finished waiting for FSMap version 41 2023-03-02T11:00:32.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0fd049db80 10 client.16221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:00:32.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0fd049db80 20 client.16221 populate_metadata read hostname 'smithi057' 2023-03-02T11:00:32.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0fd049db80 1 --2- 172.21.15.57:0/2265071689 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fd8d276110 0x55fd8d2e0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:00:32.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0fd049db80 4 client.16221 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:00:32.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0fd049db80 1 -- 172.21.15.57:0/2265071689 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fd8d1bbe90 con 0x55fd8d276110 2023-03-02T11:00:32.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.828+0000 7f0fb659c700 1 --2- 172.21.15.57:0/2265071689 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fd8d276110 0x55fd8d2e0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:32.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0f9dffb700 10 client.16221 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:00:32.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fb659c700 1 --2- 172.21.15.57:0/2265071689 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fd8d276110 0x55fd8d2e0370 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1aab5f196931b4 server_cookie=c3f6269f9aee221a in_seq=0 out_seq=0 2023-03-02T11:00:32.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0f9dffb700 1 -- 172.21.15.57:0/2265071689 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55fd8d1bbe90 con 0x55fd8d276110 2023-03-02T11:00:32.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0f9dffb700 10 client.16221 handle_command_reply: tid=0 2023-03-02T11:00:32.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 1 client.16221 shutdown 2023-03-02T11:00:32.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 1 -- 172.21.15.57:0/2265071689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 msgr2=0x55fd8d2d0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:32.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 1 --2- 172.21.15.57:0/2265071689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d2d0740 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0fb819c660 tx=0x7f0fb0007ed0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 1 -- 172.21.15.57:0/2265071689 shutdown_connections 2023-03-02T11:00:32.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 1 --2- 172.21.15.57:0/2265071689 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fd8d276110 0x55fd8d2e0370 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 1 --2- 172.21.15.57:0/2265071689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fd8d271cd0 0x55fd8d2d0740 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 1 --2- 172.21.15.57:0/2265071689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd8d266c50 0x55fd8d2d6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 1 --2- 172.21.15.57:0/2265071689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd8d2713c0 0x55fd8d2d6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0f9dffb700 0 client.16221 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:00:32.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 1 -- 172.21.15.57:0/2265071689 >> 172.21.15.57:0/2265071689 conn(0x55fd8d26af80 msgr2=0x55fd8d275330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:32.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 1 -- 172.21.15.57:0/2265071689 shutdown_connections 2023-03-02T11:00:32.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 1 -- 172.21.15.57:0/2265071689 wait complete. 2023-03-02T11:00:32.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.829+0000 7f0fd049db80 20 client.16221 trim_cache size 0 max 16384 2023-03-02T11:00:32.844 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:00:32.844 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:00:32.845 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:00:32.845 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:00:32.845 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:00:32.845 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:00:32.845 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:00:32.846 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:00:32.846 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:00:32.846 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:00:32.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 -- 172.21.15.57:0/4200627285 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f0fa009b480 msgr2=0x7f0fa009d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:32.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f0fa009b480 0x7f0fa009d930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8104370 tx=0x7f0fac005fd0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 -- 172.21.15.57:0/4200627285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fb80fe9b0 msgr2=0x7f0fb819b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:00:32.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fb80fe9b0 0x7f0fb819b960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800e970 tx=0x7f0fa800ec80 comp rx=0 tx=0).stop 2023-03-02T11:00:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 -- 172.21.15.57:0/4200627285 shutdown_connections 2023-03-02T11:00:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f0fa009b480 0x7f0fa009d930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fb81049c0 0x7f0fb81959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fb80fe9b0 0x7f0fb819b960 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 --2- 172.21.15.57:0/4200627285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fb80ff360 0x7f0fb819bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:00:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 -- 172.21.15.57:0/4200627285 >> 172.21.15.57:0/4200627285 conn(0x7f0fb80fa4b0 msgr2=0x7f0fb80fc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:00:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 -- 172.21.15.57:0/4200627285 shutdown_connections 2023-03-02T11:00:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:00:32.830+0000 7f0fbcbff700 1 -- 172.21.15.57:0/4200627285 wait complete. 2023-03-02T11:00:32.850 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:00:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:33.904+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:33.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:33.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:00:33.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:33.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:00:33.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:33.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:00:33.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:33.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:00:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:33 smithi136 ceph-mon[125702]: pgmap v111: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:00:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:33 smithi057 ceph-mon[92072]: pgmap v111: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:00:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:33 smithi122 ceph-mon[125440]: pgmap v111: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:00:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:35 smithi136 ceph-mon[125702]: pgmap v112: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:35 smithi057 ceph-mon[92072]: pgmap v112: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:35 smithi122 ceph-mon[125440]: pgmap v112: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:37 smithi136 ceph-mon[125702]: pgmap v113: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:00:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:37 smithi057 ceph-mon[92072]: pgmap v113: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:00:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:37 smithi122 ceph-mon[125440]: pgmap v113: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:00:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:39 smithi136 ceph-mon[125702]: pgmap v114: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:00:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:39 smithi057 ceph-mon[92072]: pgmap v114: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:00:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:39 smithi122 ceph-mon[125440]: pgmap v114: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:00:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:41 smithi136 ceph-mon[125702]: pgmap v115: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:41 smithi057 ceph-mon[92072]: pgmap v115: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:41 smithi122 ceph-mon[125440]: pgmap v115: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:43 smithi136 ceph-mon[125702]: pgmap v116: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:00:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:43 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:00:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:43 smithi057 ceph-mon[92072]: pgmap v116: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:00:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:43 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:00:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:43 smithi122 ceph-mon[125440]: pgmap v116: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:00:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:43 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:00:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:45 smithi136 ceph-mon[125702]: pgmap v117: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:45 smithi057 ceph-mon[92072]: pgmap v117: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:45 smithi122 ceph-mon[125440]: pgmap v117: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:47 smithi136 ceph-mon[125702]: pgmap v118: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:00:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:47 smithi057 ceph-mon[92072]: pgmap v118: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:00:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:47 smithi122 ceph-mon[125440]: pgmap v118: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:00:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:48.911+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:00:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:48.912+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:00:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:48.912+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:00:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:48.912+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:00:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:00:48.912+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:00:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:48 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:00:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:48 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:00:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:48 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:00:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:49 smithi057 ceph-mon[92072]: pgmap v119: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:00:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:49 smithi122 ceph-mon[125440]: pgmap v119: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:00:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:49 smithi136 ceph-mon[125702]: pgmap v119: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:00:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:51 smithi057 ceph-mon[92072]: pgmap v120: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:51 smithi122 ceph-mon[125440]: pgmap v120: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:51 smithi136 ceph-mon[125702]: pgmap v120: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:53 smithi057 ceph-mon[92072]: pgmap v121: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:00:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:53 smithi122 ceph-mon[125440]: pgmap v121: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:00:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:53 smithi136 ceph-mon[125702]: pgmap v121: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:00:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:55 smithi057 ceph-mon[92072]: pgmap v122: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:55 smithi122 ceph-mon[125440]: pgmap v122: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:55 smithi136 ceph-mon[125702]: pgmap v122: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:00:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:57 smithi057 ceph-mon[92072]: pgmap v123: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:00:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:57 smithi122 ceph-mon[125440]: pgmap v123: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:00:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:57 smithi136 ceph-mon[125702]: pgmap v123: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:00:59 smithi057 ceph-mon[92072]: pgmap v124: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:00:59 smithi122 ceph-mon[125440]: pgmap v124: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:00:59 smithi136 ceph-mon[125702]: pgmap v124: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:01 smithi057 ceph-mon[92072]: pgmap v125: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:01 smithi122 ceph-mon[125440]: pgmap v125: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:01 smithi136 ceph-mon[125702]: pgmap v125: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:02.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:01:03.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.023+0000 7f46f97ff700 1 -- 172.21.15.57:0/2636134163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4100480 msgr2=0x7f46f410c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:03.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.023+0000 7f46f97ff700 1 --2- 172.21.15.57:0/2636134163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4100480 0x7f46f410c910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00b0a0 tx=0x7f46ec00b3b0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.024+0000 7f46f97ff700 1 -- 172.21.15.57:0/2636134163 shutdown_connections 2023-03-02T11:01:03.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.024+0000 7f46f97ff700 1 --2- 172.21.15.57:0/2636134163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4100480 0x7f46f410c910 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.024+0000 7f46f97ff700 1 --2- 172.21.15.57:0/2636134163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f4105ae0 0x7f46f4105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.024+0000 7f46f97ff700 1 --2- 172.21.15.57:0/2636134163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f40ffad0 0x7f46f40fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.024+0000 7f46f97ff700 1 -- 172.21.15.57:0/2636134163 >> 172.21.15.57:0/2636134163 conn(0x7f46f40fb610 msgr2=0x7f46f40fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.024+0000 7f46f97ff700 1 -- 172.21.15.57:0/2636134163 shutdown_connections 2023-03-02T11:01:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.024+0000 7f46f97ff700 1 -- 172.21.15.57:0/2636134163 wait complete. 2023-03-02T11:01:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.024+0000 7f46f97ff700 1 Processor -- start 2023-03-02T11:01:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.024+0000 7f46f97ff700 1 -- start start 2023-03-02T11:01:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f97ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40ffad0 0x7f46f4072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f97ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f4100480 0x7f46f4072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f97ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4105ae0 0x7f46f41a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f97ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f4073600 con 0x7f46f40ffad0 2023-03-02T11:01:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f97ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f41a43f0 con 0x7f46f4105ae0 2023-03-02T11:01:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f97ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f41a4530 con 0x7f46f4100480 2023-03-02T11:01:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40ffad0 0x7f46f4072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46ea7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f4100480 0x7f46f4072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40ffad0 0x7f46f4072890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43628/0 (socket says 172.21.15.57:43628) 2023-03-02T11:01:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f2ffd700 1 -- 172.21.15.57:0/4018047747 learned_addr learned my addr 172.21.15.57:0/4018047747 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:01:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46ea7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f4100480 0x7f46f4072dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:44056/0 (socket says 172.21.15.57:44056) 2023-03-02T11:01:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f37fe700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4105ae0 0x7f46f41a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46ea7fc700 1 -- 172.21.15.57:0/4018047747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4105ae0 msgr2=0x7f46f41a3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4105ae0 0x7f46f41a3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46ea7fc700 1 -- 172.21.15.57:0/4018047747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40ffad0 msgr2=0x7f46f4072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40ffad0 0x7f46f4072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46ea7fc700 1 -- 172.21.15.57:0/4018047747 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec009d00 con 0x7f46f4100480 2023-03-02T11:01:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f2ffd700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40ffad0 0x7f46f4072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:01:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.025+0000 7f46f37fe700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4105ae0 0x7f46f41a3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:01:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.026+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f4100480 0x7f46f4072dd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e9f0 tx=0x7f46dc00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.026+0000 7f46f0ff9700 1 -- 172.21.15.57:0/4018047747 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00c9c0 con 0x7f46f4100480 2023-03-02T11:01:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.026+0000 7f46f97ff700 1 -- 172.21.15.57:0/4018047747 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f410fbc0 con 0x7f46f4100480 2023-03-02T11:01:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.026+0000 7f46f0ff9700 1 -- 172.21.15.57:0/4018047747 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46dc010430 con 0x7f46f4100480 2023-03-02T11:01:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.026+0000 7f46f0ff9700 1 -- 172.21.15.57:0/4018047747 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc018680 con 0x7f46f4100480 2023-03-02T11:01:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.026+0000 7f46f97ff700 1 -- 172.21.15.57:0/4018047747 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f410fa30 con 0x7f46f4100480 2023-03-02T11:01:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.029+0000 7f46f0ff9700 1 -- 172.21.15.57:0/4018047747 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f46dc00c040 con 0x7f46f4100480 2023-03-02T11:01:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f470d0b1b80 1 Processor -- start 2023-03-02T11:01:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f470d0b1b80 1 -- start start 2023-03-02T11:01:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f46f0ff9700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f46e009b480 0x7f46e009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d09c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d0a1110 0x56269d0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269d003a60 con 0x56269d0a1110 2023-03-02T11:01:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269cfb5f80 con 0x56269d09ccd0 2023-03-02T11:01:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269cf86160 con 0x56269d09c3c0 2023-03-02T11:01:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f46f0ff9700 1 -- 172.21.15.57:0/4018047747 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f46dc014070 con 0x7f46f4100480 2023-03-02T11:01:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d09c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f46f37fe700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f46e009b480 0x7f46e009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f46ea7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d09c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:44058/0 (socket says 172.21.15.57:44058) 2023-03-02T11:01:03.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f46ea7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:57046/0 (socket says 172.21.15.57:57046) 2023-03-02T11:01:03.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.030+0000 7f46f2ffd700 1 -- 172.21.15.57:0/3317952460 learned_addr learned my addr 172.21.15.57:0/3317952460 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:01:03.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46f37fe700 1 --2- 172.21.15.57:0/3317952460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d0a1110 0x56269d0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46ea7fc700 1 -- 172.21.15.57:0/3317952460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 msgr2=0x56269d09c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:03.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/3317952460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d09c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46ea7fc700 1 -- 172.21.15.57:0/3317952460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d0a1110 msgr2=0x56269d0a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:03.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/3317952460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d0a1110 0x56269d0a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46ea7fc700 1 -- 172.21.15.57:0/3317952460 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56269ce70630 con 0x56269d09ccd0 2023-03-02T11:01:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46f37fe700 1 --2- 172.21.15.57:0/3317952460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d0a1110 0x56269d0a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T11:01:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/3317952460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a0bd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f46dc091150 tx=0x7f46dc0945e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600389e39096f0fe server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46f37fe700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f46e009b480 0x7f46e009d930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46f40749a0 tx=0x7f46ec0093a0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46e97fa700 1 -- 172.21.15.57:0/3317952460 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc094de0 con 0x56269d09ccd0 2023-03-02T11:01:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46e97fa700 1 -- 172.21.15.57:0/3317952460 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46dc0946e0 con 0x56269d09ccd0 2023-03-02T11:01:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.031+0000 7f46e97fa700 1 -- 172.21.15.57:0/3317952460 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0806b0 con 0x56269d09ccd0 2023-03-02T11:01:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.032+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3317952460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 msgr2=0x56269d0a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.032+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/3317952460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a0bd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f46dc091150 tx=0x7f46dc0945e0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.032+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3317952460 shutdown_connections 2023-03-02T11:01:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.032+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/3317952460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d0a1110 0x56269d0a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.032+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/3317952460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d09c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.032+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/3317952460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a0bd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.032+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3317952460 >> 172.21.15.57:0/3317952460 conn(0x56269d091c50 msgr2=0x56269d097460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.032+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3317952460 shutdown_connections 2023-03-02T11:01:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.032+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3317952460 wait complete. 2023-03-02T11:01:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.032+0000 7f470d0b1b80 1 -- start start 2023-03-02T11:01:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.032+0000 7f470d0b1b80 1 Processor -- start 2023-03-02T11:01:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09c3c0 0x56269d0a8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d0a1110 0x56269d0a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269cff4bc0 con 0x56269d09c3c0 2023-03-02T11:01:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269cfee0f0 con 0x56269d09ccd0 2023-03-02T11:01:03.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269ce72920 con 0x56269d0a1110 2023-03-02T11:01:03.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f470d0b1b80 10 client.0 _ll_register_callbacks cb 0x56269cf94520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:01:03.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46ea7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09c3c0 0x56269d0a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46ea7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:57060/0 (socket says 172.21.15.57:57060) 2023-03-02T11:01:03.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46f37fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d0a1110 0x56269d0a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46ea7fc700 1 -- 172.21.15.57:0/498266168 learned_addr learned my addr 172.21.15.57:0/498266168 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:01:03.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46ea7fc700 1 -- 172.21.15.57:0/498266168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d0a1110 msgr2=0x56269d0a60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:03.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/498266168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d0a1110 0x56269d0a60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46ea7fc700 1 -- 172.21.15.57:0/498266168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09c3c0 msgr2=0x56269d0a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:03.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/498266168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09c3c0 0x56269d0a8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46ea7fc700 1 -- 172.21.15.57:0/498266168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f410fa30 con 0x56269d09ccd0 2023-03-02T11:01:03.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/498266168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a5ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46dc010ca0 tx=0x7f46dc094de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=434816ac5671dd54 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:03.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.033+0000 7f46da7fc700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:01:03.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f46da7fc700 1 -- 172.21.15.57:0/498266168 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc094940 con 0x56269d09ccd0 2023-03-02T11:01:03.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f46da7fc700 1 -- 172.21.15.57:0/498266168 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f46dc080040 con 0x56269d09ccd0 2023-03-02T11:01:03.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f470d0b1b80 1 -- 172.21.15.57:0/498266168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56269cfbf7b0 con 0x56269d09ccd0 2023-03-02T11:01:03.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f46da7fc700 1 -- 172.21.15.57:0/498266168 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46dc094aa0 con 0x56269d09ccd0 2023-03-02T11:01:03.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f470d0b1b80 10 client.26075 fetch_fsmap learned FSMap version 43 2023-03-02T11:01:03.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f470d0b1b80 1 -- 172.21.15.57:0/498266168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56269ce1cde0 con 0x56269d09ccd0 2023-03-02T11:01:03.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f46da7fc700 1 -- 172.21.15.57:0/498266168 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56269cfbf7b0 con 0x56269d09ccd0 2023-03-02T11:01:03.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f46da7fc700 1 -- 172.21.15.57:0/498266168 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 43) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f46dc080610 con 0x56269d09ccd0 2023-03-02T11:01:03.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f470d0b1b80 10 client.26075 fetch_fsmap finished waiting for FSMap version 43 2023-03-02T11:01:03.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f470d0b1b80 10 client.26075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:01:03.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f470d0b1b80 20 client.26075 populate_metadata read hostname 'smithi057' 2023-03-02T11:01:03.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/498266168 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56269d0b6010 0x56269d0b8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f470d0b1b80 4 client.26075 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:01:03.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f470d0b1b80 1 -- 172.21.15.57:0/498266168 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56269cfe7170 con 0x56269d0b6010 2023-03-02T11:01:03.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.034+0000 7f46f2ffd700 1 --2- 172.21.15.57:0/498266168 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56269d0b6010 0x56269d0b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.035+0000 7f46da7fc700 10 client.26075 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:01:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.035+0000 7f46f2ffd700 1 --2- 172.21.15.57:0/498266168 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56269d0b6010 0x56269d0b8420 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c5e0bad332a3bf0 server_cookie=e14696f03da82a96 in_seq=0 out_seq=0 2023-03-02T11:01:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.035+0000 7f46da7fc700 1 -- 172.21.15.57:0/498266168 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x56269cfe7170 con 0x56269d0b6010 2023-03-02T11:01:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.035+0000 7f46da7fc700 10 client.26075 handle_command_reply: tid=0 2023-03-02T11:01:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 1 client.26075 shutdown 2023-03-02T11:01:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 1 -- 172.21.15.57:0/498266168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 msgr2=0x56269d0a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/498266168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a5ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46dc010ca0 tx=0x7f46dc094de0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 1 -- 172.21.15.57:0/498266168 shutdown_connections 2023-03-02T11:01:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/498266168 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56269d0b6010 0x56269d0b8420 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/498266168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d0a1110 0x56269d0a60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f46da7fc700 0 client.26075 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:01:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/498266168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09c3c0 0x56269d0a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/498266168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d09ccd0 0x56269d0a5ab0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 1 -- 172.21.15.57:0/498266168 >> 172.21.15.57:0/498266168 conn(0x56269d091c50 msgr2=0x56269d0966a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 1 -- 172.21.15.57:0/498266168 shutdown_connections 2023-03-02T11:01:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 1 -- 172.21.15.57:0/498266168 wait complete. 2023-03-02T11:01:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.036+0000 7f470d0b1b80 20 client.26075 trim_cache size 0 max 16384 2023-03-02T11:01:03.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f470d0b1b80 1 Processor -- start 2023-03-02T11:01:03.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f470d0b1b80 1 -- start start 2023-03-02T11:01:03.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d09b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 0x56269d09b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d0a1110 0x56269d09bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269d09d420 con 0x56269d09ccd0 2023-03-02T11:01:03.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269d0917d0 con 0x56269d0a1110 2023-03-02T11:01:03.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269d0bcf90 con 0x56269d09c3c0 2023-03-02T11:01:03.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d09b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46ea7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 0x56269d09b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d09b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:44080/0 (socket says 172.21.15.57:44080) 2023-03-02T11:01:03.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46f2ffd700 1 -- 172.21.15.57:0/1358278993 learned_addr learned my addr 172.21.15.57:0/1358278993 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:01:03.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46ea7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 0x56269d09b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43646/0 (socket says 172.21.15.57:43646) 2023-03-02T11:01:03.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46f37fe700 1 --2- 172.21.15.57:0/1358278993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d0a1110 0x56269d09bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46ea7fc700 1 -- 172.21.15.57:0/1358278993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 msgr2=0x56269d09b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:03.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/1358278993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d09b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46ea7fc700 1 -- 172.21.15.57:0/1358278993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d0a1110 msgr2=0x56269d09bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:03.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/1358278993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d0a1110 0x56269d09bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46ea7fc700 1 -- 172.21.15.57:0/1358278993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56269cfb5190 con 0x56269d09ccd0 2023-03-02T11:01:03.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.053+0000 7f46f2ffd700 1 --2- 172.21.15.57:0/1358278993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d09b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:01:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/1358278993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 0x56269d09b700 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f46dc090be0 tx=0x7f46dc00c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927143424a2ada7b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f46e9ffb700 1 -- 172.21.15.57:0/1358278993 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc080040 con 0x56269d09ccd0 2023-03-02T11:01:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f46e9ffb700 1 -- 172.21.15.57:0/1358278993 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46dc09be00 con 0x56269d09ccd0 2023-03-02T11:01:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f46e9ffb700 1 -- 172.21.15.57:0/1358278993 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc09b970 con 0x56269d09ccd0 2023-03-02T11:01:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f470d0b1b80 1 -- 172.21.15.57:0/1358278993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 msgr2=0x56269d09b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/1358278993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 0x56269d09b700 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f46dc090be0 tx=0x7f46dc00c6e0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f470d0b1b80 1 -- 172.21.15.57:0/1358278993 shutdown_connections 2023-03-02T11:01:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/1358278993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d0a1110 0x56269d09bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/1358278993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d09b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/1358278993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 0x56269d09b700 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f470d0b1b80 1 -- 172.21.15.57:0/1358278993 >> 172.21.15.57:0/1358278993 conn(0x56269d091c50 msgr2=0x56269d0b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:03.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f470d0b1b80 1 -- 172.21.15.57:0/1358278993 shutdown_connections 2023-03-02T11:01:03.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.054+0000 7f470d0b1b80 1 -- 172.21.15.57:0/1358278993 wait complete. 2023-03-02T11:01:03.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f470d0b1b80 1 -- start start 2023-03-02T11:01:03.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f470d0b1b80 1 Processor -- start 2023-03-02T11:01:03.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d0acab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 0x56269d0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f470d0b1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d0a1110 0x56269d0ab320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269d0ab9b0 con 0x56269d09ccd0 2023-03-02T11:01:03.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269d0abb20 con 0x56269d0a1110 2023-03-02T11:01:03.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f470d0b1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269d0abce0 con 0x56269d09c3c0 2023-03-02T11:01:03.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f470d0b1b80 10 client.0 _ll_register_callbacks cb 0x56269cf94520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:01:03.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d0acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f46ea7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 0x56269d0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d0acab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:44088/0 (socket says 172.21.15.57:44088) 2023-03-02T11:01:03.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f46f37fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d0a1110 0x56269d0ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.055+0000 7f46f2ffd700 1 -- 172.21.15.57:0/3586423670 learned_addr learned my addr 172.21.15.57:0/3586423670 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:01:03.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f46ea7fc700 1 -- 172.21.15.57:0/3586423670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 msgr2=0x56269d0acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:03.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/3586423670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d0acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f46ea7fc700 1 -- 172.21.15.57:0/3586423670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d0a1110 msgr2=0x56269d0ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:03.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/3586423670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d0a1110 0x56269d0ab320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f46ea7fc700 1 -- 172.21.15.57:0/3586423670 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e4028750 con 0x56269d09ccd0 2023-03-02T11:01:03.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f46ea7fc700 1 --2- 172.21.15.57:0/3586423670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 0x56269d0acff0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f46dc010c10 tx=0x7f46dc00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc658b3d0bc2c63 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:03.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f46da7fc700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:01:03.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f46da7fc700 1 -- 172.21.15.57:0/3586423670 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc093bd0 con 0x56269d09ccd0 2023-03-02T11:01:03.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f46da7fc700 1 -- 172.21.15.57:0/3586423670 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f46dc0ad070 con 0x56269d09ccd0 2023-03-02T11:01:03.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3586423670 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46dc0946e0 con 0x56269d09ccd0 2023-03-02T11:01:03.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f46da7fc700 1 -- 172.21.15.57:0/3586423670 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46dc093d30 con 0x56269d09ccd0 2023-03-02T11:01:03.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f470d0b1b80 10 client.16239 fetch_fsmap learned FSMap version 43 2023-03-02T11:01:03.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3586423670 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56269ce1cde0 con 0x56269d09ccd0 2023-03-02T11:01:03.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.056+0000 7f46da7fc700 1 -- 172.21.15.57:0/3586423670 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46dc0946e0 con 0x56269d09ccd0 2023-03-02T11:01:03.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f46da7fc700 1 -- 172.21.15.57:0/3586423670 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 43) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f46dc094940 con 0x56269d09ccd0 2023-03-02T11:01:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f470d0b1b80 10 client.16239 fetch_fsmap finished waiting for FSMap version 43 2023-03-02T11:01:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f470d0b1b80 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:01:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f470d0b1b80 20 client.16239 populate_metadata read hostname 'smithi057' 2023-03-02T11:01:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/3586423670 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56269d1085e0 0x56269d10a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f470d0b1b80 4 client.16239 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:01:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3586423670 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56269cfe6e90 con 0x56269d1085e0 2023-03-02T11:01:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f46f2ffd700 1 --2- 172.21.15.57:0/3586423670 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56269d1085e0 0x56269d10a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f46da7fc700 10 client.16239 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:01:03.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f46f2ffd700 1 --2- 172.21.15.57:0/3586423670 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56269d1085e0 0x56269d10a9f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15bf7662c2ed3994 server_cookie=2ec4a75aa67c62ee in_seq=0 out_seq=0 2023-03-02T11:01:03.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f46da7fc700 1 -- 172.21.15.57:0/3586423670 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56269cfe6e90 con 0x56269d1085e0 2023-03-02T11:01:03.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f46da7fc700 10 client.16239 handle_command_reply: tid=0 2023-03-02T11:01:03.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.057+0000 7f470d0b1b80 1 client.16239 shutdown 2023-03-02T11:01:03.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3586423670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 msgr2=0x56269d0acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:03.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/3586423670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 0x56269d0acff0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f46dc010c10 tx=0x7f46dc00c750 comp rx=0 tx=0).stop 2023-03-02T11:01:03.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3586423670 shutdown_connections 2023-03-02T11:01:03.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/3586423670 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x56269d1085e0 0x56269d10a9f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/3586423670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56269d0a1110 0x56269d0ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/3586423670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56269d09c3c0 0x56269d0acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f470d0b1b80 1 --2- 172.21.15.57:0/3586423670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56269d09ccd0 0x56269d0acff0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f46da7fc700 0 client.16239 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:01:03.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3586423670 >> 172.21.15.57:0/3586423670 conn(0x56269d091c50 msgr2=0x56269d09b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:03.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3586423670 shutdown_connections 2023-03-02T11:01:03.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f470d0b1b80 1 -- 172.21.15.57:0/3586423670 wait complete. 2023-03-02T11:01:03.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f470d0b1b80 20 client.16239 trim_cache size 0 max 16384 2023-03-02T11:01:03.069 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:01:03.069 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:01:03.069 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:01:03.069 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:01:03.070 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:01:03.070 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:01:03.070 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:01:03.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:01:03.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:01:03.070 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:01:03.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f46f97ff700 1 -- 172.21.15.57:0/4018047747 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f46e009b480 msgr2=0x7f46e009d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:03.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f46f97ff700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f46e009b480 0x7f46e009d930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46f40749a0 tx=0x7f46ec0093a0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f46f97ff700 1 -- 172.21.15.57:0/4018047747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f4100480 msgr2=0x7f46f4072dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:03.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f46f97ff700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f4100480 0x7f46f4072dd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e9f0 tx=0x7f46dc00ed00 comp rx=0 tx=0).stop 2023-03-02T11:01:03.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f46f97ff700 1 -- 172.21.15.57:0/4018047747 shutdown_connections 2023-03-02T11:01:03.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f46f97ff700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f46e009b480 0x7f46e009d930 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f46f97ff700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46f4105ae0 0x7f46f41a3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f46f97ff700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40ffad0 0x7f46f4072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f46f97ff700 1 --2- 172.21.15.57:0/4018047747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46f4100480 0x7f46f4072dd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:03.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.058+0000 7f46f97ff700 1 -- 172.21.15.57:0/4018047747 >> 172.21.15.57:0/4018047747 conn(0x7f46f40fb610 msgr2=0x7f46f40fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:03.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.059+0000 7f46f97ff700 1 -- 172.21.15.57:0/4018047747 shutdown_connections 2023-03-02T11:01:03.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:03.059+0000 7f46f97ff700 1 -- 172.21.15.57:0/4018047747 wait complete. 2023-03-02T11:01:03.074 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:01:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:03.926+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:03.927+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:01:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:03.927+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:01:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:03.927+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:01:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:03.927+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:01:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:03 smithi057 ceph-mon[92072]: pgmap v126: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:01:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:03 smithi122 ceph-mon[125440]: pgmap v126: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:01:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:03 smithi136 ceph-mon[125702]: pgmap v126: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:01:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:05 smithi057 ceph-mon[92072]: pgmap v127: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:01:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:05 smithi122 ceph-mon[125440]: pgmap v127: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:01:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:05 smithi136 ceph-mon[125702]: pgmap v127: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:01:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:07 smithi057 ceph-mon[92072]: pgmap v128: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:01:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:07 smithi122 ceph-mon[125440]: pgmap v128: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:01:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:07 smithi136 ceph-mon[125702]: pgmap v128: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:01:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:09 smithi057 ceph-mon[92072]: pgmap v129: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:01:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:09 smithi122 ceph-mon[125440]: pgmap v129: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:01:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:09 smithi136 ceph-mon[125702]: pgmap v129: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:01:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:11 smithi057 ceph-mon[92072]: pgmap v130: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:01:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:01:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:01:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:01:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:01:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:11 smithi122 ceph-mon[125440]: pgmap v130: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:01:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:01:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:01:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:01:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:01:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:11 smithi136 ceph-mon[125702]: pgmap v130: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:01:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:01:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:01:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:01:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:01:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:13 smithi136 ceph-mon[125702]: pgmap v131: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:01:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:13 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:01:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:13 smithi057 ceph-mon[92072]: pgmap v131: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:01:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:13 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:01:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:13 smithi122 ceph-mon[125440]: pgmap v131: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:01:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:13 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:01:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:15 smithi136 ceph-mon[125702]: pgmap v132: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:01:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:15 smithi057 ceph-mon[92072]: pgmap v132: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:01:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:15 smithi122 ceph-mon[125440]: pgmap v132: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:01:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:17 smithi136 ceph-mon[125702]: pgmap v133: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:01:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:17 smithi057 ceph-mon[92072]: pgmap v133: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:01:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:17 smithi122 ceph-mon[125440]: pgmap v133: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:01:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:18.936+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:18.936+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:01:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:18.936+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:01:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:18.936+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:01:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:18.936+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:01:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:19 smithi136 ceph-mon[125702]: pgmap v134: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:01:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:19 smithi057 ceph-mon[92072]: pgmap v134: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:01:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:19 smithi122 ceph-mon[125440]: pgmap v134: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:01:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:21 smithi136 ceph-mon[125702]: pgmap v135: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:01:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:21 smithi057 ceph-mon[92072]: pgmap v135: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:01:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:21 smithi122 ceph-mon[125440]: pgmap v135: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:01:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:23 smithi136 ceph-mon[125702]: pgmap v136: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:01:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:23 smithi057 ceph-mon[92072]: pgmap v136: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:01:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:23 smithi122 ceph-mon[125440]: pgmap v136: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:01:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:25 smithi136 ceph-mon[125702]: pgmap v137: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:25 smithi057 ceph-mon[92072]: pgmap v137: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:25 smithi122 ceph-mon[125440]: pgmap v137: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:26 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:01:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:26 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:01:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:26 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:01:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:27 smithi136 ceph-mon[125702]: pgmap v138: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:27 smithi057 ceph-mon[92072]: pgmap v138: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:27 smithi122 ceph-mon[125440]: pgmap v138: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:29 smithi136 ceph-mon[125702]: pgmap v139: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:29 smithi057 ceph-mon[92072]: pgmap v139: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:29 smithi122 ceph-mon[125440]: pgmap v139: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:31 smithi136 ceph-mon[125702]: pgmap v140: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:31 smithi057 ceph-mon[92072]: pgmap v140: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:31 smithi122 ceph-mon[125440]: pgmap v140: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:33.074 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:01:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.246+0000 7f94999ff700 1 -- 172.21.15.57:0/3302389721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94940728b0 msgr2=0x7f9494072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.246+0000 7f94999ff700 1 --2- 172.21.15.57:0/3302389721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94940728b0 0x7f9494072c80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9484009990 tx=0x7f9484009ca0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.246+0000 7f94999ff700 1 -- 172.21.15.57:0/3302389721 shutdown_connections 2023-03-02T11:01:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.246+0000 7f94999ff700 1 --2- 172.21.15.57:0/3302389721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f949410c390 0x7f949410e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.246+0000 7f94999ff700 1 --2- 172.21.15.57:0/3302389721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94940728b0 0x7f9494072c80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.246+0000 7f94999ff700 1 --2- 172.21.15.57:0/3302389721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94940731c0 0x7f949410be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.246+0000 7f94999ff700 1 -- 172.21.15.57:0/3302389721 >> 172.21.15.57:0/3302389721 conn(0x7f94940fb610 msgr2=0x7f94940fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.246+0000 7f94999ff700 1 -- 172.21.15.57:0/3302389721 shutdown_connections 2023-03-02T11:01:33.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.246+0000 7f94999ff700 1 -- 172.21.15.57:0/3302389721 wait complete. 2023-03-02T11:01:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.247+0000 7f94999ff700 1 Processor -- start 2023-03-02T11:01:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.247+0000 7f94999ff700 1 -- start start 2023-03-02T11:01:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.247+0000 7f94999ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94940728b0 0x7f9494197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.247+0000 7f94999ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94940731c0 0x7f94941982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.247+0000 7f94999ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f949410c390 0x7f949419c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.247+0000 7f94999ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949419cd90 con 0x7f94940731c0 2023-03-02T11:01:33.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.247+0000 7f94999ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949419cf00 con 0x7f949410c390 2023-03-02T11:01:33.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.247+0000 7f94999ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949419d0c0 con 0x7f94940728b0 2023-03-02T11:01:33.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.247+0000 7f9492ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94940728b0 0x7f9494197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f9492ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94940728b0 0x7f9494197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:46230/0 (socket says 172.21.15.57:46230) 2023-03-02T11:01:33.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f9492ffd700 1 -- 172.21.15.57:0/262653209 learned_addr learned my addr 172.21.15.57:0/262653209 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94937fe700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f949410c390 0x7f949419c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f948a7fc700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94940731c0 0x7f94941982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94937fe700 1 -- 172.21.15.57:0/262653209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94940728b0 msgr2=0x7f9494197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94937fe700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94940728b0 0x7f9494197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94937fe700 1 -- 172.21.15.57:0/262653209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94940731c0 msgr2=0x7f94941982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94937fe700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94940731c0 0x7f94941982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94937fe700 1 -- 172.21.15.57:0/262653209 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94840095f0 con 0x7f949410c390 2023-03-02T11:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f9492ffd700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94940728b0 0x7f9494197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f948a7fc700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94940731c0 0x7f94941982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94937fe700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f949410c390 0x7f949419c750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f948c00efc0 tx=0x7f948c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94989fd700 1 -- 172.21.15.57:0/262653209 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c018070 con 0x7f949410c390 2023-03-02T11:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94999ff700 1 -- 172.21.15.57:0/262653209 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9494111ce0 con 0x7f949410c390 2023-03-02T11:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94989fd700 1 -- 172.21.15.57:0/262653209 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f948c00f040 con 0x7f949410c390 2023-03-02T11:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94989fd700 1 -- 172.21.15.57:0/262653209 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00cd40 con 0x7f949410c390 2023-03-02T11:01:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.248+0000 7f94999ff700 1 -- 172.21.15.57:0/262653209 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9494111b50 con 0x7f949410c390 2023-03-02T11:01:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.251+0000 7f94989fd700 1 -- 172.21.15.57:0/262653209 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f948c003a00 con 0x7f949410c390 2023-03-02T11:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.252+0000 7f94989fd700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f948009b480 0x7f948009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.252+0000 7f94ad35eb80 1 Processor -- start 2023-03-02T11:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.252+0000 7f94ad35eb80 1 -- start start 2023-03-02T11:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.252+0000 7f9492ffd700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f948009b480 0x7f948009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.252+0000 7f94989fd700 1 -- 172.21.15.57:0/262653209 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f948c0c4e80 con 0x7f949410c390 2023-03-02T11:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bee790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110beecd0 0x55a110bf2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 0x55a110bf3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a110b55a60 con 0x55a110beecd0 2023-03-02T11:01:33.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a110b07f80 con 0x55a110bee3c0 2023-03-02T11:01:33.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a110ad8160 con 0x55a110bf3110 2023-03-02T11:01:33.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f9492ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94937fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 0x55a110bf3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f948a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110beecd0 0x55a110bf2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94937fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 0x55a110bf3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:46244/0 (socket says 172.21.15.57:46244) 2023-03-02T11:01:33.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94937fe700 1 -- 172.21.15.57:0/3753799370 learned_addr learned my addr 172.21.15.57:0/3753799370 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:01:33.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f9492ffd700 1 --2- 172.21.15.57:0/3753799370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bee790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:50360/0 (socket says 172.21.15.57:50360) 2023-03-02T11:01:33.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f9492ffd700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f948009b480 0x7f948009d930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94840098e0 tx=0x7f948400b260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:33.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94937fe700 1 -- 172.21.15.57:0/3753799370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 msgr2=0x55a110bee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:33.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94937fe700 1 --2- 172.21.15.57:0/3753799370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94937fe700 1 -- 172.21.15.57:0/3753799370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110beecd0 msgr2=0x55a110bf2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94937fe700 1 --2- 172.21.15.57:0/3753799370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110beecd0 0x55a110bf2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94937fe700 1 -- 172.21.15.57:0/3753799370 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1109c2630 con 0x55a110bf3110 2023-03-02T11:01:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.253+0000 7f94937fe700 1 --2- 172.21.15.57:0/3753799370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 0x55a110bf3560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f948c009490 tx=0x7f948c0c2a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=614f436230664c63 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f9489ffb700 1 -- 172.21.15.57:0/3753799370 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c093c90 con 0x55a110bf3110 2023-03-02T11:01:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f9489ffb700 1 -- 172.21.15.57:0/3753799370 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f948c01b320 con 0x55a110bf3110 2023-03-02T11:01:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f9489ffb700 1 -- 172.21.15.57:0/3753799370 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c094590 con 0x55a110bf3110 2023-03-02T11:01:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3753799370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 msgr2=0x55a110bf3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:33.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/3753799370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 0x55a110bf3560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f948c009490 tx=0x7f948c0c2a10 comp rx=0 tx=0).stop 2023-03-02T11:01:33.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3753799370 shutdown_connections 2023-03-02T11:01:33.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/3753799370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 0x55a110bf3560 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/3753799370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/3753799370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110beecd0 0x55a110bf2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3753799370 >> 172.21.15.57:0/3753799370 conn(0x55a110be3c50 msgr2=0x55a110be9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:33.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3753799370 shutdown_connections 2023-03-02T11:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.254+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3753799370 wait complete. 2023-03-02T11:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f94ad35eb80 1 -- start start 2023-03-02T11:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f94ad35eb80 1 Processor -- start 2023-03-02T11:01:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bfa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110beecd0 0x55a110bf7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 0x55a110bf81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a110b46bc0 con 0x55a110beecd0 2023-03-02T11:01:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a110b400f0 con 0x55a110bee3c0 2023-03-02T11:01:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1109c4920 con 0x55a110bf3110 2023-03-02T11:01:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f94ad35eb80 10 client.0 _ll_register_callbacks cb 0x55a110ae6520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:01:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f9492ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bfa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f948a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110beecd0 0x55a110bf7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f94937fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 0x55a110bf81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f9492ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bfa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:50372/0 (socket says 172.21.15.57:50372) 2023-03-02T11:01:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.255+0000 7f9492ffd700 1 -- 172.21.15.57:0/2962497011 learned_addr learned my addr 172.21.15.57:0/2962497011 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:01:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f9492ffd700 1 -- 172.21.15.57:0/2962497011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 msgr2=0x55a110bf81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f9492ffd700 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 0x55a110bf81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f9492ffd700 1 -- 172.21.15.57:0/2962497011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110beecd0 msgr2=0x55a110bf7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f9492ffd700 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110beecd0 0x55a110bf7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f9492ffd700 1 -- 172.21.15.57:0/2962497011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9494111b50 con 0x55a110bee3c0 2023-03-02T11:01:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f94937fe700 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 0x55a110bf81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:01:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f948a7fc700 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110beecd0 0x55a110bf7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:01:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f9492ffd700 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bfa8b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9484004670 tx=0x7f9484009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c43cde2adf4b5190 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f9472ffd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:01:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f9472ffd700 1 -- 172.21.15.57:0/2962497011 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948400f660 con 0x55a110bee3c0 2023-03-02T11:01:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f94ad35eb80 1 -- 172.21.15.57:0/2962497011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a110b117b0 con 0x55a110bee3c0 2023-03-02T11:01:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.256+0000 7f9472ffd700 1 -- 172.21.15.57:0/2962497011 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f948400f7c0 con 0x55a110bee3c0 2023-03-02T11:01:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f9472ffd700 1 -- 172.21.15.57:0/2962497011 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f948400f980 con 0x55a110bee3c0 2023-03-02T11:01:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f94ad35eb80 10 client.26093 fetch_fsmap learned FSMap version 45 2023-03-02T11:01:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f94ad35eb80 1 -- 172.21.15.57:0/2962497011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55a11096ede0 con 0x55a110bee3c0 2023-03-02T11:01:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f9472ffd700 1 -- 172.21.15.57:0/2962497011 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a110b117b0 con 0x55a110bee3c0 2023-03-02T11:01:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f9472ffd700 1 -- 172.21.15.57:0/2962497011 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 45) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f948402ec30 con 0x55a110bee3c0 2023-03-02T11:01:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f94ad35eb80 10 client.26093 fetch_fsmap finished waiting for FSMap version 45 2023-03-02T11:01:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f94ad35eb80 10 client.26093 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:01:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f94ad35eb80 20 client.26093 populate_metadata read hostname 'smithi057' 2023-03-02T11:01:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a110c082f0 0x55a110c0a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f94ad35eb80 4 client.26093 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:01:33.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f94ad35eb80 1 -- 172.21.15.57:0/2962497011 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a110b39170 con 0x55a110c082f0 2023-03-02T11:01:33.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.257+0000 7f948a7fc700 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a110c082f0 0x55a110c0a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f9472ffd700 10 client.26093 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:01:33.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f948a7fc700 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a110c082f0 0x55a110c0a700 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8849135eca40a31 server_cookie=2ed8834655c3faf in_seq=0 out_seq=0 2023-03-02T11:01:33.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f9472ffd700 1 -- 172.21.15.57:0/2962497011 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55a110b39170 con 0x55a110c082f0 2023-03-02T11:01:33.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f9472ffd700 10 client.26093 handle_command_reply: tid=0 2023-03-02T11:01:33.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f94ad35eb80 1 client.26093 shutdown 2023-03-02T11:01:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f94ad35eb80 1 -- 172.21.15.57:0/2962497011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 msgr2=0x55a110bfa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bfa8b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9484004670 tx=0x7f9484009ca0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f94ad35eb80 1 -- 172.21.15.57:0/2962497011 shutdown_connections 2023-03-02T11:01:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a110c082f0 0x55a110c0a700 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110bf3110 0x55a110bf81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bfa8b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f9472ffd700 0 client.26093 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:01:33.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/2962497011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110beecd0 0x55a110bf7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.258+0000 7f94ad35eb80 1 -- 172.21.15.57:0/2962497011 >> 172.21.15.57:0/2962497011 conn(0x55a110be3c50 msgr2=0x55a110be9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:33.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.259+0000 7f94ad35eb80 1 -- 172.21.15.57:0/2962497011 shutdown_connections 2023-03-02T11:01:33.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.259+0000 7f94ad35eb80 1 -- 172.21.15.57:0/2962497011 wait complete. 2023-03-02T11:01:33.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.259+0000 7f94ad35eb80 20 client.26093 trim_cache size 0 max 16384 2023-03-02T11:01:33.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f94ad35eb80 1 Processor -- start 2023-03-02T11:01:33.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f94ad35eb80 1 -- start start 2023-03-02T11:01:33.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bee3c0 0x55a110bfa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110beecd0 0x55a110bf7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bf3110 0x55a110bf78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a110bf6140 con 0x55a110bee3c0 2023-03-02T11:01:33.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a110c0f2b0 con 0x55a110bf3110 2023-03-02T11:01:33.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a110bef160 con 0x55a110beecd0 2023-03-02T11:01:33.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f9492ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bee3c0 0x55a110bfa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f9492ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bee3c0 0x55a110bfa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52550/0 (socket says 172.21.15.57:52550) 2023-03-02T11:01:33.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f9492ffd700 1 -- 172.21.15.57:0/138741018 learned_addr learned my addr 172.21.15.57:0/138741018 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:01:33.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f948a7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110beecd0 0x55a110bf7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f94937fe700 1 --2- 172.21.15.57:0/138741018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bf3110 0x55a110bf78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f9492ffd700 1 -- 172.21.15.57:0/138741018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110beecd0 msgr2=0x55a110bf7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:33.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f9492ffd700 1 --2- 172.21.15.57:0/138741018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110beecd0 0x55a110bf7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f9492ffd700 1 -- 172.21.15.57:0/138741018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bf3110 msgr2=0x55a110bf78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:33.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f9492ffd700 1 --2- 172.21.15.57:0/138741018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bf3110 0x55a110bf78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.276+0000 7f9492ffd700 1 -- 172.21.15.57:0/138741018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a110b07190 con 0x55a110bee3c0 2023-03-02T11:01:33.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.277+0000 7f9492ffd700 1 --2- 172.21.15.57:0/138741018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bee3c0 0x55a110bfa450 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f948400be20 tx=0x7f9484004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e9a81e88938ff6 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:33.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.277+0000 7f948affd700 1 -- 172.21.15.57:0/138741018 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484045070 con 0x55a110bee3c0 2023-03-02T11:01:33.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.277+0000 7f948affd700 1 -- 172.21.15.57:0/138741018 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f948401e040 con 0x55a110bee3c0 2023-03-02T11:01:33.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.277+0000 7f948affd700 1 -- 172.21.15.57:0/138741018 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948402ecc0 con 0x55a110bee3c0 2023-03-02T11:01:33.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.277+0000 7f94ad35eb80 1 -- 172.21.15.57:0/138741018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bee3c0 msgr2=0x55a110bfa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:33.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.277+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/138741018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bee3c0 0x55a110bfa450 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f948400be20 tx=0x7f9484004ca0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 -- 172.21.15.57:0/138741018 shutdown_connections 2023-03-02T11:01:33.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/138741018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bf3110 0x55a110bf78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/138741018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bee3c0 0x55a110bfa450 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/138741018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110beecd0 0x55a110bf7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 -- 172.21.15.57:0/138741018 >> 172.21.15.57:0/138741018 conn(0x55a110be3c50 msgr2=0x55a110c03780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:33.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 -- 172.21.15.57:0/138741018 shutdown_connections 2023-03-02T11:01:33.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 -- 172.21.15.57:0/138741018 wait complete. 2023-03-02T11:01:33.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 -- start start 2023-03-02T11:01:33.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 Processor -- start 2023-03-02T11:01:33.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bfd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110beecd0 0x55a110bfd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bf3110 0x55a110c58ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a110c590e0 con 0x55a110bf3110 2023-03-02T11:01:33.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a110c59220 con 0x55a110bee3c0 2023-03-02T11:01:33.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.278+0000 7f94ad35eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a110c593b0 con 0x55a110beecd0 2023-03-02T11:01:33.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94ad35eb80 10 client.0 _ll_register_callbacks cb 0x55a110ae6520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:01:33.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94937fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bf3110 0x55a110c58ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f948a7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110beecd0 0x55a110bfd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f9492ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bfd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f948a7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110beecd0 0x55a110bfd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:46258/0 (socket says 172.21.15.57:46258) 2023-03-02T11:01:33.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94937fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bf3110 0x55a110c58ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52554/0 (socket says 172.21.15.57:52554) 2023-03-02T11:01:33.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f948a7fc700 1 -- 172.21.15.57:0/3880737050 learned_addr learned my addr 172.21.15.57:0/3880737050 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:01:33.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94937fe700 1 -- 172.21.15.57:0/3880737050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110beecd0 msgr2=0x55a110bfd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:33.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94937fe700 1 --2- 172.21.15.57:0/3880737050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110beecd0 0x55a110bfd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94937fe700 1 -- 172.21.15.57:0/3880737050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 msgr2=0x55a110bfd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:01:33.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94937fe700 1 --2- 172.21.15.57:0/3880737050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bfd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94937fe700 1 -- 172.21.15.57:0/3880737050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a11096ede0 con 0x55a110bf3110 2023-03-02T11:01:33.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94937fe700 1 --2- 172.21.15.57:0/3880737050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bf3110 0x55a110c58ba0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f948c0c2ad0 tx=0x7f948c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfc4896ba161649 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:01:33.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f9472ffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:01:33.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f9472ffd700 1 -- 172.21.15.57:0/3880737050 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c004ad0 con 0x55a110bf3110 2023-03-02T11:01:33.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f9472ffd700 1 -- 172.21.15.57:0/3880737050 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f948c094a30 con 0x55a110bf3110 2023-03-02T11:01:33.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3880737050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f948c01b320 con 0x55a110bf3110 2023-03-02T11:01:33.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f9472ffd700 1 -- 172.21.15.57:0/3880737050 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f948c094330 con 0x55a110bf3110 2023-03-02T11:01:33.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94ad35eb80 10 client.16257 fetch_fsmap learned FSMap version 45 2023-03-02T11:01:33.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.279+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3880737050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55a110995250 con 0x55a110bf3110 2023-03-02T11:01:33.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.280+0000 7f9472ffd700 1 -- 172.21.15.57:0/3880737050 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f948c01b320 con 0x55a110bf3110 2023-03-02T11:01:33.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.280+0000 7f9472ffd700 1 -- 172.21.15.57:0/3880737050 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 45) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f948c090300 con 0x55a110bf3110 2023-03-02T11:01:33.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.280+0000 7f94ad35eb80 10 client.16257 fetch_fsmap finished waiting for FSMap version 45 2023-03-02T11:01:33.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.280+0000 7f94ad35eb80 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:01:33.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.280+0000 7f94ad35eb80 20 client.16257 populate_metadata read hostname 'smithi057' 2023-03-02T11:01:33.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.280+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/3880737050 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a110c5a6a0 0x55a110c5cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:01:33.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.280+0000 7f94ad35eb80 4 client.16257 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:01:33.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.280+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3880737050 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a110b38e90 con 0x55a110c5a6a0 2023-03-02T11:01:33.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.280+0000 7f9492ffd700 1 --2- 172.21.15.57:0/3880737050 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a110c5a6a0 0x55a110c5cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.280+0000 7f9472ffd700 10 client.16257 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:01:33.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.280+0000 7f9492ffd700 1 --2- 172.21.15.57:0/3880737050 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a110c5a6a0 0x55a110c5cab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90a193d1fd5b909a server_cookie=4e9885a3447a6155 in_seq=0 out_seq=0 2023-03-02T11:01:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f9472ffd700 1 -- 172.21.15.57:0/3880737050 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a110b38e90 con 0x55a110c5a6a0 2023-03-02T11:01:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f9472ffd700 10 client.16257 handle_command_reply: tid=0 2023-03-02T11:01:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 1 client.16257 shutdown 2023-03-02T11:01:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3880737050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bf3110 msgr2=0x55a110c58ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/3880737050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bf3110 0x55a110c58ba0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f948c0c2ad0 tx=0x7f948c00cf30 comp rx=0 tx=0).stop 2023-03-02T11:01:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3880737050 shutdown_connections 2023-03-02T11:01:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/3880737050 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55a110c5a6a0 0x55a110c5cab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/3880737050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a110bf3110 0x55a110c58ba0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f9472ffd700 0 client.16257 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:01:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/3880737050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a110bee3c0 0x55a110bfd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 1 --2- 172.21.15.57:0/3880737050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a110beecd0 0x55a110bfd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3880737050 >> 172.21.15.57:0/3880737050 conn(0x55a110be3c50 msgr2=0x55a110bf2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3880737050 shutdown_connections 2023-03-02T11:01:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 1 -- 172.21.15.57:0/3880737050 wait complete. 2023-03-02T11:01:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.281+0000 7f94ad35eb80 20 client.16257 trim_cache size 0 max 16384 2023-03-02T11:01:33.292 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:01:33.292 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:01:33.292 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:01:33.292 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:01:33.292 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:01:33.293 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:01:33.293 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:01:33.293 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:01:33.293 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:01:33.293 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:01:33.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 -- 172.21.15.57:0/262653209 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f948009b480 msgr2=0x7f948009d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:33.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f948009b480 0x7f948009d930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94840098e0 tx=0x7f948400b260 comp rx=0 tx=0).stop 2023-03-02T11:01:33.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 -- 172.21.15.57:0/262653209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f949410c390 msgr2=0x7f949419c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:01:33.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f949410c390 0x7f949419c750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f948c00efc0 tx=0x7f948c00c3a0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 -- 172.21.15.57:0/262653209 shutdown_connections 2023-03-02T11:01:33.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f948009b480 0x7f948009d930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f949410c390 0x7f949419c750 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94940728b0 0x7f9494197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 --2- 172.21.15.57:0/262653209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94940731c0 0x7f94941982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:01:33.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 -- 172.21.15.57:0/262653209 >> 172.21.15.57:0/262653209 conn(0x7f94940fb610 msgr2=0x7f949410e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:01:33.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 -- 172.21.15.57:0/262653209 shutdown_connections 2023-03-02T11:01:33.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:01:33.282+0000 7f94999ff700 1 -- 172.21.15.57:0/262653209 wait complete. 2023-03-02T11:01:33.297 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:01:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:33.952+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:33.952+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:01:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:33.952+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:01:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:33.952+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:01:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:33.952+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:01:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:33 smithi136 ceph-mon[125702]: pgmap v141: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:01:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:33 smithi057 ceph-mon[92072]: pgmap v141: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:01:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:33 smithi122 ceph-mon[125440]: pgmap v141: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:01:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:35 smithi136 ceph-mon[125702]: pgmap v142: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:35 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:01:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:35 smithi057 ceph-mon[92072]: pgmap v142: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:35 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:01:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:35 smithi122 ceph-mon[125440]: pgmap v142: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:35 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:01:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:37 smithi136 ceph-mon[125702]: pgmap v143: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:37 smithi057 ceph-mon[92072]: pgmap v143: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:37 smithi122 ceph-mon[125440]: pgmap v143: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:39 smithi136 ceph-mon[125702]: pgmap v144: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:39 smithi057 ceph-mon[92072]: pgmap v144: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:39 smithi122 ceph-mon[125440]: pgmap v144: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:41 smithi136 ceph-mon[125702]: pgmap v145: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:41 smithi057 ceph-mon[92072]: pgmap v145: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:41 smithi122 ceph-mon[125440]: pgmap v145: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:43 smithi136 ceph-mon[125702]: pgmap v146: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:01:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:43 smithi057 ceph-mon[92072]: pgmap v146: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:01:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:43 smithi122 ceph-mon[125440]: pgmap v146: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:01:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:45 smithi136 ceph-mon[125702]: pgmap v147: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:46.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:45 smithi057 ceph-mon[92072]: pgmap v147: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:45 smithi122 ceph-mon[125440]: pgmap v147: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:47 smithi136 ceph-mon[125702]: pgmap v148: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:47 smithi057 ceph-mon[92072]: pgmap v148: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:47 smithi122 ceph-mon[125440]: pgmap v148: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:48.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:48.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:01:48.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:48.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:01:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:48.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:01:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:48.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:01:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:01:48.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:01:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:49 smithi136 ceph-mon[125702]: pgmap v149: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:49 smithi057 ceph-mon[92072]: pgmap v149: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:49 smithi122 ceph-mon[125440]: pgmap v149: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:01:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:51 smithi136 ceph-mon[125702]: pgmap v150: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:51 smithi057 ceph-mon[92072]: pgmap v150: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:51 smithi122 ceph-mon[125440]: pgmap v150: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:53 smithi136 ceph-mon[125702]: pgmap v151: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:01:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:53 smithi057 ceph-mon[92072]: pgmap v151: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:01:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:53 smithi122 ceph-mon[125440]: pgmap v151: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:01:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:55 smithi057 ceph-mon[92072]: pgmap v152: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:55 smithi122 ceph-mon[125440]: pgmap v152: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:55 smithi136 ceph-mon[125702]: pgmap v152: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:01:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:57 smithi057 ceph-mon[92072]: pgmap v153: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:57 smithi122 ceph-mon[125440]: pgmap v153: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:01:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:57 smithi136 ceph-mon[125702]: pgmap v153: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:01:59 smithi057 ceph-mon[92072]: pgmap v154: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:01:59 smithi122 ceph-mon[125440]: pgmap v154: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:01:59 smithi136 ceph-mon[125702]: pgmap v154: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:01 smithi057 ceph-mon[92072]: pgmap v155: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:01 smithi122 ceph-mon[125440]: pgmap v155: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:01 smithi136 ceph-mon[125702]: pgmap v155: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:03.299 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:02:03.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.468+0000 7f45f03ff700 1 -- 172.21.15.57:0/2479742556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45e80fe9b0 msgr2=0x7f45e80fee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:03.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.468+0000 7f45f03ff700 1 --2- 172.21.15.57:0/2479742556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45e80fe9b0 0x7f45e80fee20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009990 tx=0x7f45d8009ca0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.468+0000 7f45f03ff700 1 -- 172.21.15.57:0/2479742556 shutdown_connections 2023-03-02T11:02:03.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.468+0000 7f45f03ff700 1 --2- 172.21.15.57:0/2479742556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45e80ff360 0x7f45e810b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.468+0000 7f45f03ff700 1 --2- 172.21.15.57:0/2479742556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45e81049c0 0x7f45e8104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.468+0000 7f45f03ff700 1 --2- 172.21.15.57:0/2479742556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45e80fe9b0 0x7f45e80fee20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.468+0000 7f45f03ff700 1 -- 172.21.15.57:0/2479742556 >> 172.21.15.57:0/2479742556 conn(0x7f45e80fa4b0 msgr2=0x7f45e80fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:03.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.468+0000 7f45f03ff700 1 -- 172.21.15.57:0/2479742556 shutdown_connections 2023-03-02T11:02:03.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.468+0000 7f45f03ff700 1 -- 172.21.15.57:0/2479742556 wait complete. 2023-03-02T11:02:03.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.468+0000 7f45f03ff700 1 Processor -- start 2023-03-02T11:02:03.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45f03ff700 1 -- start start 2023-03-02T11:02:03.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45f03ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45e80fe9b0 0x7f45e8197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45f03ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45e80ff360 0x7f45e81982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45f03ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45e81049c0 0x7f45e819c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45f03ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e819cd60 con 0x7f45e80ff360 2023-03-02T11:02:03.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45f03ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e819ced0 con 0x7f45e80fe9b0 2023-03-02T11:02:03.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45f03ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e819d090 con 0x7f45e81049c0 2023-03-02T11:02:03.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ee19b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45e80fe9b0 0x7f45e8197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ed99a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45e80ff360 0x7f45e81982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ee19b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45e80fe9b0 0x7f45e8197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33928/0 (socket says 172.21.15.57:33928) 2023-03-02T11:02:03.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ee19b700 1 -- 172.21.15.57:0/133149939 learned_addr learned my addr 172.21.15.57:0/133149939 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:02:03.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ed99a700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45e80ff360 0x7f45e81982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49992/0 (socket says 172.21.15.57:49992) 2023-03-02T11:02:03.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ee99c700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45e81049c0 0x7f45e819c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ee19b700 1 -- 172.21.15.57:0/133149939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45e81049c0 msgr2=0x7f45e819c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:03.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ee19b700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45e81049c0 0x7f45e819c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ee19b700 1 -- 172.21.15.57:0/133149939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45e80ff360 msgr2=0x7f45e81982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:03.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ee19b700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45e80ff360 0x7f45e81982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ee19b700 1 -- 172.21.15.57:0/133149939 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80095f0 con 0x7f45e80fe9b0 2023-03-02T11:02:03.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.469+0000 7f45ed99a700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45e80ff360 0x7f45e81982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:02:03.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.470+0000 7f45ee19b700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45e80fe9b0 0x7f45e8197d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f45e400e970 tx=0x7f45e400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:03.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.470+0000 7f45df7fe700 1 -- 172.21.15.57:0/133149939 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4009790 con 0x7f45e80fe9b0 2023-03-02T11:02:03.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.470+0000 7f45df7fe700 1 -- 172.21.15.57:0/133149939 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45e400c7e0 con 0x7f45e80fe9b0 2023-03-02T11:02:03.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.470+0000 7f45df7fe700 1 -- 172.21.15.57:0/133149939 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4003c70 con 0x7f45e80fe9b0 2023-03-02T11:02:03.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.470+0000 7f45f03ff700 1 -- 172.21.15.57:0/133149939 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e810e9f0 con 0x7f45e80fe9b0 2023-03-02T11:02:03.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.470+0000 7f45f03ff700 1 -- 172.21.15.57:0/133149939 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e810e860 con 0x7f45e80fe9b0 2023-03-02T11:02:03.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.473+0000 7f45df7fe700 1 -- 172.21.15.57:0/133149939 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f45e401e020 con 0x7f45e80fe9b0 2023-03-02T11:02:03.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f45df7fe700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f45d409b500 0x7f45d409d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f4603d78b80 1 Processor -- start 2023-03-02T11:02:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f45df7fe700 1 -- 172.21.15.57:0/133149939 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f45e4014070 con 0x7f45e80fe9b0 2023-03-02T11:02:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f45ed99a700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f45d409b500 0x7f45d409d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f4603d78b80 1 -- start start 2023-03-02T11:02:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b93c0 0x55e69f3b9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b9cd0 0x55e69f3bdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3be560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f4603d78b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f320a60 con 0x55e69f3be110 2023-03-02T11:02:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f4603d78b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f2d2f80 con 0x55e69f3b9cd0 2023-03-02T11:02:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f4603d78b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f2a3160 con 0x55e69f3b93c0 2023-03-02T11:02:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f45ee99c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3be560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f45ee19b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b93c0 0x55e69f3b9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f45ee19b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b93c0 0x55e69f3b9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:36198/0 (socket says 172.21.15.57:36198) 2023-03-02T11:02:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f45ee19b700 1 -- 172.21.15.57:0/1927475511 learned_addr learned my addr 172.21.15.57:0/1927475511 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:02:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45ed99a700 1 --2- 172.21.15.57:0/1927475511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b9cd0 0x55e69f3bdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.474+0000 7f45ee99c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3be560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49996/0 (socket says 172.21.15.57:49996) 2023-03-02T11:02:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45ed99a700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f45d409b500 0x7f45d409d9b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f45e8199390 tx=0x7f45d8005fd0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45ee99c700 1 -- 172.21.15.57:0/1927475511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b93c0 msgr2=0x55e69f3b9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45ee99c700 1 --2- 172.21.15.57:0/1927475511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b93c0 0x55e69f3b9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45ee99c700 1 -- 172.21.15.57:0/1927475511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b9cd0 msgr2=0x55e69f3bdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45ee99c700 1 --2- 172.21.15.57:0/1927475511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b9cd0 0x55e69f3bdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45ee99c700 1 -- 172.21.15.57:0/1927475511 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e69f18d630 con 0x55e69f3be110 2023-03-02T11:02:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45ee19b700 1 --2- 172.21.15.57:0/1927475511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b93c0 0x55e69f3b9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:02:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45ee99c700 1 --2- 172.21.15.57:0/1927475511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3be560 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f45e0011580 tx=0x7f45e0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ed3f105fdb07ee server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45dcbfe700 1 -- 172.21.15.57:0/1927475511 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000e040 con 0x55e69f3be110 2023-03-02T11:02:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45dcbfe700 1 -- 172.21.15.57:0/1927475511 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45e000f040 con 0x55e69f3be110 2023-03-02T11:02:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.475+0000 7f45dcbfe700 1 -- 172.21.15.57:0/1927475511 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00044f0 con 0x55e69f3be110 2023-03-02T11:02:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.476+0000 7f4603d78b80 1 -- 172.21.15.57:0/1927475511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 msgr2=0x55e69f3be560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.476+0000 7f4603d78b80 1 --2- 172.21.15.57:0/1927475511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3be560 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f45e0011580 tx=0x7f45e0009920 comp rx=0 tx=0).stop 2023-03-02T11:02:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.476+0000 7f4603d78b80 1 -- 172.21.15.57:0/1927475511 shutdown_connections 2023-03-02T11:02:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.476+0000 7f4603d78b80 1 --2- 172.21.15.57:0/1927475511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3be560 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.476+0000 7f4603d78b80 1 --2- 172.21.15.57:0/1927475511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b93c0 0x55e69f3b9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.476+0000 7f4603d78b80 1 --2- 172.21.15.57:0/1927475511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b9cd0 0x55e69f3bdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.476+0000 7f4603d78b80 1 -- 172.21.15.57:0/1927475511 >> 172.21.15.57:0/1927475511 conn(0x55e69f3aec50 msgr2=0x55e69f3b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.476+0000 7f4603d78b80 1 -- 172.21.15.57:0/1927475511 shutdown_connections 2023-03-02T11:02:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.476+0000 7f4603d78b80 1 -- 172.21.15.57:0/1927475511 wait complete. 2023-03-02T11:02:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.476+0000 7f4603d78b80 1 -- start start 2023-03-02T11:02:03.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.476+0000 7f4603d78b80 1 Processor -- start 2023-03-02T11:02:03.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 0x55e69f3c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3c3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f4603d78b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f311bc0 con 0x55e69f3be110 2023-03-02T11:02:03.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f4603d78b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f30b0f0 con 0x55e69f3b93c0 2023-03-02T11:02:03.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f4603d78b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f18f920 con 0x55e69f3b9cd0 2023-03-02T11:02:03.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ee19b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 0x55e69f3c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f4603d78b80 10 client.0 _ll_register_callbacks cb 0x55e69f2b1520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:02:03.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ed99a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ee19b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 0x55e69f3c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33934/0 (socket says 172.21.15.57:33934) 2023-03-02T11:02:03.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ee19b700 1 -- 172.21.15.57:0/2005141571 learned_addr learned my addr 172.21.15.57:0/2005141571 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:02:03.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ee99c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ee19b700 1 -- 172.21.15.57:0/2005141571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 msgr2=0x55e69f3c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:03.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ee19b700 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3c30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ee19b700 1 -- 172.21.15.57:0/2005141571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 msgr2=0x55e69f3c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:03.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ee19b700 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ee19b700 1 -- 172.21.15.57:0/2005141571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e0011230 con 0x55e69f3b93c0 2023-03-02T11:02:03.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ed99a700 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:02:03.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.477+0000 7f45ee99c700 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:02:03.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f45ee19b700 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 0x55e69f3c2bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45e4005880 tx=0x7f45e4094750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66e9f759f9363fd3 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:03.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f45d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:02:03.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f45d1ffb700 1 -- 172.21.15.57:0/2005141571 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4098130 con 0x55e69f3b93c0 2023-03-02T11:02:03.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f45d1ffb700 1 -- 172.21.15.57:0/2005141571 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f45e401f340 con 0x55e69f3b93c0 2023-03-02T11:02:03.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f4603d78b80 1 -- 172.21.15.57:0/2005141571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e69f2dc7b0 con 0x55e69f3b93c0 2023-03-02T11:02:03.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f45d1ffb700 1 -- 172.21.15.57:0/2005141571 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45e401f500 con 0x55e69f3b93c0 2023-03-02T11:02:03.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f4603d78b80 10 client.26111 fetch_fsmap learned FSMap version 46 2023-03-02T11:02:03.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f4603d78b80 1 -- 172.21.15.57:0/2005141571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55e69f139de0 con 0x55e69f3b93c0 2023-03-02T11:02:03.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f45d1ffb700 1 -- 172.21.15.57:0/2005141571 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e69f2dc7b0 con 0x55e69f3b93c0 2023-03-02T11:02:03.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f45d1ffb700 1 -- 172.21.15.57:0/2005141571 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 46) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f45e409b9e0 con 0x55e69f3b93c0 2023-03-02T11:02:03.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f4603d78b80 10 client.26111 fetch_fsmap finished waiting for FSMap version 46 2023-03-02T11:02:03.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f4603d78b80 10 client.26111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:02:03.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f4603d78b80 20 client.26111 populate_metadata read hostname 'smithi057' 2023-03-02T11:02:03.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f4603d78b80 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55e69f3d3310 0x55e69f3d56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f4603d78b80 4 client.26111 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:02:03.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.478+0000 7f4603d78b80 1 -- 172.21.15.57:0/2005141571 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e69f304170 con 0x55e69f3d3310 2023-03-02T11:02:03.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.479+0000 7f45ed99a700 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55e69f3d3310 0x55e69f3d56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.479+0000 7f45ed99a700 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55e69f3d3310 0x55e69f3d56f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db2657caf805b2f6 server_cookie=bd6a5144a8549c6e in_seq=0 out_seq=0 2023-03-02T11:02:03.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.479+0000 7f45d1ffb700 10 client.26111 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:02:03.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f45d1ffb700 1 -- 172.21.15.57:0/2005141571 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55e69f304170 con 0x55e69f3d3310 2023-03-02T11:02:03.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f45d1ffb700 10 client.26111 handle_command_reply: tid=0 2023-03-02T11:02:03.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 1 client.26111 shutdown 2023-03-02T11:02:03.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 1 -- 172.21.15.57:0/2005141571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 msgr2=0x55e69f3c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:03.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 0x55e69f3c2bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45e4005880 tx=0x7f45e4094750 comp rx=0 tx=0).stop 2023-03-02T11:02:03.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 1 -- 172.21.15.57:0/2005141571 shutdown_connections 2023-03-02T11:02:03.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55e69f3d3310 0x55e69f3d56f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 0x55e69f3c2bb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 1 --2- 172.21.15.57:0/2005141571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 1 -- 172.21.15.57:0/2005141571 >> 172.21.15.57:0/2005141571 conn(0x55e69f3aec50 msgr2=0x55e69f3b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:03.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f45d1ffb700 0 client.26111 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:02:03.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 1 -- 172.21.15.57:0/2005141571 shutdown_connections 2023-03-02T11:02:03.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 1 -- 172.21.15.57:0/2005141571 wait complete. 2023-03-02T11:02:03.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.480+0000 7f4603d78b80 20 client.26111 trim_cache size 0 max 16384 2023-03-02T11:02:03.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f4603d78b80 1 Processor -- start 2023-03-02T11:02:03.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f4603d78b80 1 -- start start 2023-03-02T11:02:03.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 0x55e69f3cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3bd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f4603d78b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f3b3350 con 0x55e69f3be110 2023-03-02T11:02:03.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f4603d78b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f3da2a0 con 0x55e69f3b93c0 2023-03-02T11:02:03.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f4603d78b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f3bdd60 con 0x55e69f3b9cd0 2023-03-02T11:02:03.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f45ee99c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f45ee19b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 0x55e69f3cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f45ed99a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3bd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f45ee99c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50014/0 (socket says 172.21.15.57:50014) 2023-03-02T11:02:03.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f45ee19b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 0x55e69f3cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33940/0 (socket says 172.21.15.57:33940) 2023-03-02T11:02:03.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f45ee99c700 1 -- 172.21.15.57:0/3200720341 learned_addr learned my addr 172.21.15.57:0/3200720341 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:02:03.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f45ee99c700 1 -- 172.21.15.57:0/3200720341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 msgr2=0x55e69f3bd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:03.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f45ee99c700 1 --2- 172.21.15.57:0/3200720341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3bd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f45ee99c700 1 -- 172.21.15.57:0/3200720341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 msgr2=0x55e69f3cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:03.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f45ee99c700 1 --2- 172.21.15.57:0/3200720341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 0x55e69f3cee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.497+0000 7f45ee99c700 1 -- 172.21.15.57:0/3200720341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e69f2d2190 con 0x55e69f3be110 2023-03-02T11:02:03.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.498+0000 7f45ee99c700 1 --2- 172.21.15.57:0/3200720341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3c34b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f45e000b010 tx=0x7f45e0009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcf0fb8a6e8a5f2 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:03.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.498+0000 7f45dd3ff700 1 -- 172.21.15.57:0/3200720341 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000e040 con 0x55e69f3be110 2023-03-02T11:02:03.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.498+0000 7f45dd3ff700 1 -- 172.21.15.57:0/3200720341 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45e0011e80 con 0x55e69f3be110 2023-03-02T11:02:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.498+0000 7f45dd3ff700 1 -- 172.21.15.57:0/3200720341 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00048f0 con 0x55e69f3be110 2023-03-02T11:02:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.498+0000 7f4603d78b80 1 -- 172.21.15.57:0/3200720341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 msgr2=0x55e69f3c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.498+0000 7f4603d78b80 1 --2- 172.21.15.57:0/3200720341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3c34b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f45e000b010 tx=0x7f45e0009ba0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.498+0000 7f4603d78b80 1 -- 172.21.15.57:0/3200720341 shutdown_connections 2023-03-02T11:02:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.498+0000 7f4603d78b80 1 --2- 172.21.15.57:0/3200720341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3be110 0x55e69f3c34b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.498+0000 7f4603d78b80 1 --2- 172.21.15.57:0/3200720341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3b93c0 0x55e69f3cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.498+0000 7f4603d78b80 1 --2- 172.21.15.57:0/3200720341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3bd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.498+0000 7f4603d78b80 1 -- 172.21.15.57:0/3200720341 >> 172.21.15.57:0/3200720341 conn(0x55e69f3aec50 msgr2=0x55e69f3bd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:03.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.499+0000 7f4603d78b80 1 -- 172.21.15.57:0/3200720341 shutdown_connections 2023-03-02T11:02:03.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.499+0000 7f4603d78b80 1 -- 172.21.15.57:0/3200720341 wait complete. 2023-03-02T11:02:03.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.499+0000 7f4603d78b80 1 -- start start 2023-03-02T11:02:03.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.499+0000 7f4603d78b80 1 Processor -- start 2023-03-02T11:02:03.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.499+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3b93c0 0x55e69f3ca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.499+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.499+0000 7f4603d78b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3be110 0x55e69f3c8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.499+0000 7f4603d78b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f3c8fa0 con 0x55e69f3b93c0 2023-03-02T11:02:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.499+0000 7f4603d78b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f3c9110 con 0x55e69f3be110 2023-03-02T11:02:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.499+0000 7f4603d78b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69f424ba0 con 0x55e69f3b9cd0 2023-03-02T11:02:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.499+0000 7f4603d78b80 10 client.0 _ll_register_callbacks cb 0x55e69f2b1520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:02:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45ee19b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3b93c0 0x55e69f3ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45ee19b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3b93c0 0x55e69f3ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50016/0 (socket says 172.21.15.57:50016) 2023-03-02T11:02:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45ee19b700 1 -- 172.21.15.57:0/3114361865 learned_addr learned my addr 172.21.15.57:0/3114361865 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:02:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45ee99c700 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3be110 0x55e69f3c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45ed99a700 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45ee19b700 1 -- 172.21.15.57:0/3114361865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 msgr2=0x55e69f3c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45ee19b700 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45ee19b700 1 -- 172.21.15.57:0/3114361865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3be110 msgr2=0x55e69f3c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45ee19b700 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3be110 0x55e69f3c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45ee19b700 1 -- 172.21.15.57:0/3114361865 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e69f18d630 con 0x55e69f3b93c0 2023-03-02T11:02:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45ee19b700 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3b93c0 0x55e69f3ca020 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f45e4090c50 tx=0x7f45e4003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b4867d330492d6 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:03.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:02:03.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45d1ffb700 1 -- 172.21.15.57:0/3114361865 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4090900 con 0x55e69f3b93c0 2023-03-02T11:02:03.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45d1ffb700 1 -- 172.21.15.57:0/3114361865 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f45e40c5040 con 0x55e69f3b93c0 2023-03-02T11:02:03.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f4603d78b80 1 -- 172.21.15.57:0/3114361865 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45e000f040 con 0x55e69f3b93c0 2023-03-02T11:02:03.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f45d1ffb700 1 -- 172.21.15.57:0/3114361865 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45e4090540 con 0x55e69f3b93c0 2023-03-02T11:02:03.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f4603d78b80 10 client.16275 fetch_fsmap learned FSMap version 46 2023-03-02T11:02:03.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.500+0000 7f4603d78b80 1 -- 172.21.15.57:0/3114361865 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55e69f160250 con 0x55e69f3b93c0 2023-03-02T11:02:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.501+0000 7f45d1ffb700 1 -- 172.21.15.57:0/3114361865 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45e000f040 con 0x55e69f3b93c0 2023-03-02T11:02:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.501+0000 7f45d1ffb700 1 -- 172.21.15.57:0/3114361865 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 46) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f45e40a2020 con 0x55e69f3b93c0 2023-03-02T11:02:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.501+0000 7f4603d78b80 10 client.16275 fetch_fsmap finished waiting for FSMap version 46 2023-03-02T11:02:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.501+0000 7f4603d78b80 10 client.16275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:02:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.501+0000 7f4603d78b80 20 client.16275 populate_metadata read hostname 'smithi057' 2023-03-02T11:02:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.501+0000 7f4603d78b80 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55e69f425d90 0x55e69f428170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.501+0000 7f4603d78b80 4 client.16275 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:02:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.501+0000 7f4603d78b80 1 -- 172.21.15.57:0/3114361865 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e69f303e90 con 0x55e69f425d90 2023-03-02T11:02:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.501+0000 7f45ed99a700 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55e69f425d90 0x55e69f428170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.501+0000 7f45d1ffb700 10 client.16275 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:02:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.501+0000 7f45ed99a700 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55e69f425d90 0x55e69f428170 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d300f66a7cbfb7 server_cookie=80a7da0b151bbcb in_seq=0 out_seq=0 2023-03-02T11:02:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f45d1ffb700 1 -- 172.21.15.57:0/3114361865 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55e69f303e90 con 0x55e69f425d90 2023-03-02T11:02:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f45d1ffb700 10 client.16275 handle_command_reply: tid=0 2023-03-02T11:02:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 1 client.16275 shutdown 2023-03-02T11:02:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 1 -- 172.21.15.57:0/3114361865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3b93c0 msgr2=0x55e69f3ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3b93c0 0x55e69f3ca020 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f45e4090c50 tx=0x7f45e4003710 comp rx=0 tx=0).stop 2023-03-02T11:02:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 1 -- 172.21.15.57:0/3114361865 shutdown_connections 2023-03-02T11:02:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55e69f425d90 0x55e69f428170 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e69f3be110 0x55e69f3c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e69f3b93c0 0x55e69f3ca020 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f45d1ffb700 0 client.16275 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:02:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 1 --2- 172.21.15.57:0/3114361865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e69f3b9cd0 0x55e69f3c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 1 -- 172.21.15.57:0/3114361865 >> 172.21.15.57:0/3114361865 conn(0x55e69f3aec50 msgr2=0x55e69f3c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 1 -- 172.21.15.57:0/3114361865 shutdown_connections 2023-03-02T11:02:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 1 -- 172.21.15.57:0/3114361865 wait complete. 2023-03-02T11:02:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f4603d78b80 20 client.16275 trim_cache size 0 max 16384 2023-03-02T11:02:03.514 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:02:03.514 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:02:03.515 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:02:03.515 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:02:03.515 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:02:03.515 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:02:03.515 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:02:03.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:02:03.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:02:03.515 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:02:03.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f45f03ff700 1 -- 172.21.15.57:0/133149939 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f45d409b500 msgr2=0x7f45d409d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:03.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f45f03ff700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f45d409b500 0x7f45d409d9b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f45e8199390 tx=0x7f45d8005fd0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f45f03ff700 1 -- 172.21.15.57:0/133149939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45e80fe9b0 msgr2=0x7f45e8197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.502+0000 7f45f03ff700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45e80fe9b0 0x7f45e8197d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f45e400e970 tx=0x7f45e400ec80 comp rx=0 tx=0).stop 2023-03-02T11:02:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.503+0000 7f45f03ff700 1 -- 172.21.15.57:0/133149939 shutdown_connections 2023-03-02T11:02:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.503+0000 7f45f03ff700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f45d409b500 0x7f45d409d9b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.503+0000 7f45f03ff700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45e81049c0 0x7f45e819c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.503+0000 7f45f03ff700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45e80fe9b0 0x7f45e8197d80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.503+0000 7f45f03ff700 1 --2- 172.21.15.57:0/133149939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45e80ff360 0x7f45e81982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.503+0000 7f45f03ff700 1 -- 172.21.15.57:0/133149939 >> 172.21.15.57:0/133149939 conn(0x7f45e80fa4b0 msgr2=0x7f45e8067680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:03.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.503+0000 7f45f03ff700 1 -- 172.21.15.57:0/133149939 shutdown_connections 2023-03-02T11:02:03.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:03.503+0000 7f45f03ff700 1 -- 172.21.15.57:0/133149939 wait complete. 2023-03-02T11:02:03.519 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:02:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:03.969+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:03.969+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:02:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:03.969+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:02:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:03.969+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:02:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:03.969+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:02:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:03 smithi057 ceph-mon[92072]: pgmap v156: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:02:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:03 smithi122 ceph-mon[125440]: pgmap v156: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:02:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:03 smithi136 ceph-mon[125702]: pgmap v156: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:02:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:05 smithi057 ceph-mon[92072]: pgmap v157: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:02:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:05 smithi122 ceph-mon[125440]: pgmap v157: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:02:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:05 smithi136 ceph-mon[125702]: pgmap v157: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:02:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:07 smithi057 ceph-mon[92072]: pgmap v158: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:02:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:07 smithi122 ceph-mon[125440]: pgmap v158: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:02:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:07 smithi136 ceph-mon[125702]: pgmap v158: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:02:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:08.385+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858003550 con 0x7f5880105ae0 2023-03-02T11:02:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:08.385+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858003550 con 0x7f5880105ae0 2023-03-02T11:02:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:08.420+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850003550 con 0x558558b6f6b0 2023-03-02T11:02:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:08.420+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850003550 con 0x558558b6f6b0 2023-03-02T11:02:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:09 smithi057 ceph-mon[92072]: pgmap v159: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:02:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:09 smithi122 ceph-mon[125440]: pgmap v159: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:02:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:09 smithi136 ceph-mon[125702]: pgmap v159: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:02:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:11 smithi057 ceph-mon[92072]: pgmap v160: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:02:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:02:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:11 smithi122 ceph-mon[125440]: pgmap v160: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:02:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:02:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:11 smithi136 ceph-mon[125702]: pgmap v160: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:02:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:02:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:02:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:02:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:02:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:02:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:02:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:02:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:02:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:02:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:02:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:13 smithi057 ceph-mon[92072]: pgmap v161: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:02:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:13 smithi122 ceph-mon[125440]: pgmap v161: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:02:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:13 smithi136 ceph-mon[125702]: pgmap v161: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:02:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:15 smithi057 ceph-mon[92072]: pgmap v162: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:02:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:15 smithi057 ceph-mon[92072]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:02:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:15 smithi122 ceph-mon[125440]: pgmap v162: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:02:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:15 smithi122 ceph-mon[125440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:02:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:15 smithi136 ceph-mon[125702]: pgmap v162: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:02:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:15 smithi136 ceph-mon[125702]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-02T11:02:18.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:17 smithi057 ceph-mon[92072]: pgmap v163: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:02:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:17 smithi122 ceph-mon[125440]: pgmap v163: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:02:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:17 smithi136 ceph-mon[125702]: pgmap v163: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:02:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:18.985+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:18.986+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:02:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:18.986+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:02:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:18.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:02:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:18.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:02:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:19 smithi057 ceph-mon[92072]: pgmap v164: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:02:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:19 smithi122 ceph-mon[125440]: pgmap v164: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:02:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:19 smithi136 ceph-mon[125702]: pgmap v164: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:02:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:21 smithi057 ceph-mon[92072]: pgmap v165: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:02:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:21 smithi122 ceph-mon[125440]: pgmap v165: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:02:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:21 smithi136 ceph-mon[125702]: pgmap v165: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:02:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:23 smithi057 ceph-mon[92072]: pgmap v166: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:02:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:23 smithi122 ceph-mon[125440]: pgmap v166: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:02:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:23 smithi136 ceph-mon[125702]: pgmap v166: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:02:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:25 smithi057 ceph-mon[92072]: pgmap v167: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:25 smithi122 ceph-mon[125440]: pgmap v167: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:25 smithi136 ceph-mon[125702]: pgmap v167: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:27 smithi057 ceph-mon[92072]: pgmap v168: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:27 smithi122 ceph-mon[125440]: pgmap v168: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:27 smithi136 ceph-mon[125702]: pgmap v168: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:29 smithi122 ceph-mon[125440]: pgmap v169: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:29 smithi136 ceph-mon[125702]: pgmap v169: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:29 smithi057 ceph-mon[92072]: pgmap v169: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:31 smithi122 ceph-mon[125440]: pgmap v170: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:31 smithi136 ceph-mon[125702]: pgmap v170: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:31 smithi057 ceph-mon[92072]: pgmap v170: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:33.520 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:02:33.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.709+0000 7f4f429ff700 1 -- 172.21.15.57:0/3932901948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c100c80 msgr2=0x7f4f3c101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:33.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.709+0000 7f4f429ff700 1 --2- 172.21.15.57:0/3932901948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c100c80 0x7f4f3c101050 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009990 tx=0x7f4f2c009ca0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.709+0000 7f4f429ff700 1 -- 172.21.15.57:0/3932901948 shutdown_connections 2023-03-02T11:02:33.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.709+0000 7f4f429ff700 1 --2- 172.21.15.57:0/3932901948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c10a050 0x7f4f3c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.709+0000 7f4f429ff700 1 --2- 172.21.15.57:0/3932901948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c100c80 0x7f4f3c101050 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.709+0000 7f4f429ff700 1 --2- 172.21.15.57:0/3932901948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c101590 0x7f4f3c109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.709+0000 7f4f429ff700 1 -- 172.21.15.57:0/3932901948 >> 172.21.15.57:0/3932901948 conn(0x7f4f3c0fa4b0 msgr2=0x7f4f3c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:33.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.709+0000 7f4f429ff700 1 -- 172.21.15.57:0/3932901948 shutdown_connections 2023-03-02T11:02:33.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.709+0000 7f4f429ff700 1 -- 172.21.15.57:0/3932901948 wait complete. 2023-03-02T11:02:33.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f429ff700 1 Processor -- start 2023-03-02T11:02:33.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f429ff700 1 -- start start 2023-03-02T11:02:33.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f429ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c100c80 0x7f4f3c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f429ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c101590 0x7f4f3c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f429ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c10a050 0x7f4f3c19c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f429ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c19cdb0 con 0x7f4f3c10a050 2023-03-02T11:02:33.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f429ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c19cf20 con 0x7f4f3c101590 2023-03-02T11:02:33.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f429ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c19d0e0 con 0x7f4f3c100c80 2023-03-02T11:02:33.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f33fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c101590 0x7f4f3c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f3bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c100c80 0x7f4f3c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f40f9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c10a050 0x7f4f3c19c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f3bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c100c80 0x7f4f3c197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:56178/0 (socket says 172.21.15.57:56178) 2023-03-02T11:02:33.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f33fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c101590 0x7f4f3c198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:43606/0 (socket says 172.21.15.57:43606) 2023-03-02T11:02:33.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.710+0000 7f4f3bfff700 1 -- 172.21.15.57:0/324295 learned_addr learned my addr 172.21.15.57:0/324295 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:02:33.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f40f9c700 1 -- 172.21.15.57:0/324295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c100c80 msgr2=0x7f4f3c197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:33.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f40f9c700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c100c80 0x7f4f3c197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f40f9c700 1 -- 172.21.15.57:0/324295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c101590 msgr2=0x7f4f3c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:33.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f40f9c700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c101590 0x7f4f3c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f40f9c700 1 -- 172.21.15.57:0/324295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24009520 con 0x7f4f3c10a050 2023-03-02T11:02:33.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c100c80 0x7f4f3c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:02:33.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f40f9c700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c10a050 0x7f4f3c19c770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400efc0 tx=0x7f4f3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:33.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f39ffb700 1 -- 172.21.15.57:0/324295 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34018070 con 0x7f4f3c10a050 2023-03-02T11:02:33.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f39ffb700 1 -- 172.21.15.57:0/324295 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f3400f040 con 0x7f4f3c10a050 2023-03-02T11:02:33.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f429ff700 1 -- 172.21.15.57:0/324295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c0095f0 con 0x7f4f3c10a050 2023-03-02T11:02:33.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f39ffb700 1 -- 172.21.15.57:0/324295 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400cd40 con 0x7f4f3c10a050 2023-03-02T11:02:33.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.711+0000 7f4f429ff700 1 -- 172.21.15.57:0/324295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c10fac0 con 0x7f4f3c10a050 2023-03-02T11:02:33.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.714+0000 7f4f39ffb700 1 -- 172.21.15.57:0/324295 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f4f34003a00 con 0x7f4f3c10a050 2023-03-02T11:02:33.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.714+0000 7f4f39ffb700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4f2809b480 0x7f4f2809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f39ffb700 1 -- 172.21.15.57:0/324295 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f4f340c4e20 con 0x7f4f3c10a050 2023-03-02T11:02:33.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4f2809b480 0x7f4f2809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f56408b80 1 Processor -- start 2023-03-02T11:02:33.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f56408b80 1 -- start start 2023-03-02T11:02:33.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 0x559e727fc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fccd0 0x559e72800bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e72801110 0x559e72801560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f56408b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e72763a60 con 0x559e727fccd0 2023-03-02T11:02:33.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f56408b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e72715f80 con 0x559e727fc3c0 2023-03-02T11:02:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f56408b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e726e6160 con 0x559e72801110 2023-03-02T11:02:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4f2809b480 0x7f4f2809d930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c006010 tx=0x7f4f2c005960 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f3bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 0x559e727fc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f40f9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e72801110 0x559e72801560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f33fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fccd0 0x559e72800bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f3bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 0x559e727fc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:43622/0 (socket says 172.21.15.57:43622) 2023-03-02T11:02:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.715+0000 7f4f3bfff700 1 -- 172.21.15.57:0/4212641921 learned_addr learned my addr 172.21.15.57:0/4212641921 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:02:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.716+0000 7f4f40f9c700 1 -- 172.21.15.57:0/4212641921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 msgr2=0x559e727fc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.716+0000 7f4f40f9c700 1 --2- 172.21.15.57:0/4212641921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 0x559e727fc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.716+0000 7f4f40f9c700 1 -- 172.21.15.57:0/4212641921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fccd0 msgr2=0x559e72800bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.716+0000 7f4f40f9c700 1 --2- 172.21.15.57:0/4212641921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fccd0 0x559e72800bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.716+0000 7f4f40f9c700 1 -- 172.21.15.57:0/4212641921 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e725d0630 con 0x559e72801110 2023-03-02T11:02:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.716+0000 7f4f40f9c700 1 --2- 172.21.15.57:0/4212641921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e72801110 0x559e72801560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4f340942c0 tx=0x7f4f340c2a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e95c98add6fba63 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.716+0000 7f4f327fc700 1 -- 172.21.15.57:0/4212641921 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3401b320 con 0x559e72801110 2023-03-02T11:02:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.716+0000 7f4f327fc700 1 -- 172.21.15.57:0/4212641921 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f34004ad0 con 0x559e72801110 2023-03-02T11:02:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.716+0000 7f4f327fc700 1 -- 172.21.15.57:0/4212641921 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34093a20 con 0x559e72801110 2023-03-02T11:02:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.717+0000 7f4f56408b80 1 -- 172.21.15.57:0/4212641921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e72801110 msgr2=0x559e72801560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.717+0000 7f4f56408b80 1 --2- 172.21.15.57:0/4212641921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e72801110 0x559e72801560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4f340942c0 tx=0x7f4f340c2a10 comp rx=0 tx=0).stop 2023-03-02T11:02:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.717+0000 7f4f56408b80 1 -- 172.21.15.57:0/4212641921 shutdown_connections 2023-03-02T11:02:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.717+0000 7f4f56408b80 1 --2- 172.21.15.57:0/4212641921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e72801110 0x559e72801560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.717+0000 7f4f56408b80 1 --2- 172.21.15.57:0/4212641921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 0x559e727fc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.717+0000 7f4f56408b80 1 --2- 172.21.15.57:0/4212641921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fccd0 0x559e72800bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.717+0000 7f4f56408b80 1 -- 172.21.15.57:0/4212641921 >> 172.21.15.57:0/4212641921 conn(0x559e727f1c50 msgr2=0x559e727f7460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:33.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.717+0000 7f4f56408b80 1 -- 172.21.15.57:0/4212641921 shutdown_connections 2023-03-02T11:02:33.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.717+0000 7f4f56408b80 1 -- 172.21.15.57:0/4212641921 wait complete. 2023-03-02T11:02:33.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.717+0000 7f4f56408b80 1 -- start start 2023-03-02T11:02:33.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.717+0000 7f4f56408b80 1 Processor -- start 2023-03-02T11:02:33.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fc3c0 0x559e72805c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fccd0 0x559e72806190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e72801110 0x559e728066d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f56408b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e72754bc0 con 0x559e727fccd0 2023-03-02T11:02:33.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f56408b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7274e0f0 con 0x559e72801110 2023-03-02T11:02:33.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f56408b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e725d2920 con 0x559e727fc3c0 2023-03-02T11:02:33.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f56408b80 10 client.0 _ll_register_callbacks cb 0x559e726f4520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:02:33.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f3bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fc3c0 0x559e72805c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f3bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fc3c0 0x559e72805c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:56194/0 (socket says 172.21.15.57:56194) 2023-03-02T11:02:33.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f3bfff700 1 -- 172.21.15.57:0/3597956121 learned_addr learned my addr 172.21.15.57:0/3597956121 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:02:33.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f33fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fccd0 0x559e72806190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f40f9c700 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e72801110 0x559e728066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f3bfff700 1 -- 172.21.15.57:0/3597956121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e72801110 msgr2=0x559e728066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:33.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e72801110 0x559e728066d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f3bfff700 1 -- 172.21.15.57:0/3597956121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fccd0 msgr2=0x559e72806190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:33.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fccd0 0x559e72806190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f3bfff700 1 -- 172.21.15.57:0/3597956121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c10fac0 con 0x559e727fc3c0 2023-03-02T11:02:33.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f33fff700 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fccd0 0x559e72806190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:02:33.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.718+0000 7f4f40f9c700 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e72801110 0x559e728066d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:02:33.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.719+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fc3c0 0x559e72805c50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c005930 tx=0x7f4f2c01a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc283285157c0b59 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:33.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.719+0000 7f4f1b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:02:33.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.719+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3597956121 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c028030 con 0x559e727fc3c0 2023-03-02T11:02:33.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.719+0000 7f4f56408b80 1 -- 172.21.15.57:0/3597956121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e7271f7b0 con 0x559e727fc3c0 2023-03-02T11:02:33.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.719+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3597956121 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f4f2c019a70 con 0x559e727fc3c0 2023-03-02T11:02:33.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.719+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3597956121 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f2c019c30 con 0x559e727fc3c0 2023-03-02T11:02:33.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.719+0000 7f4f56408b80 10 client.26080 fetch_fsmap learned FSMap version 47 2023-03-02T11:02:33.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.719+0000 7f4f56408b80 1 -- 172.21.15.57:0/3597956121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x559e7257cde0 con 0x559e727fc3c0 2023-03-02T11:02:33.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.719+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3597956121 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559e7271f7b0 con 0x559e727fc3c0 2023-03-02T11:02:33.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.719+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3597956121 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4f2c024410 con 0x559e727fc3c0 2023-03-02T11:02:33.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.720+0000 7f4f56408b80 10 client.26080 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:02:33.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.720+0000 7f4f56408b80 10 client.26080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:02:33.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.720+0000 7f4f56408b80 20 client.26080 populate_metadata read hostname 'smithi057' 2023-03-02T11:02:33.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.720+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559e72816340 0x559e72818750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.720+0000 7f4f56408b80 4 client.26080 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:02:33.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.720+0000 7f4f56408b80 1 -- 172.21.15.57:0/3597956121 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e72747170 con 0x559e72816340 2023-03-02T11:02:33.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.720+0000 7f4f33fff700 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559e72816340 0x559e72818750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.720+0000 7f4f33fff700 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559e72816340 0x559e72818750 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f93c2363d18238b2 server_cookie=1177118c7a664bae in_seq=0 out_seq=0 2023-03-02T11:02:33.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.720+0000 7f4f1b7fe700 10 client.26080 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:02:33.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3597956121 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x559e72747170 con 0x559e72816340 2023-03-02T11:02:33.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f1b7fe700 10 client.26080 handle_command_reply: tid=0 2023-03-02T11:02:33.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f56408b80 1 client.26080 shutdown 2023-03-02T11:02:33.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f56408b80 1 -- 172.21.15.57:0/3597956121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fc3c0 msgr2=0x559e72805c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:33.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fc3c0 0x559e72805c50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c005930 tx=0x7f4f2c01a050 comp rx=0 tx=0).stop 2023-03-02T11:02:33.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f56408b80 1 -- 172.21.15.57:0/3597956121 shutdown_connections 2023-03-02T11:02:33.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559e72816340 0x559e72818750 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e72801110 0x559e728066d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f1b7fe700 0 client.26080 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:02:33.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fc3c0 0x559e72805c50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3597956121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fccd0 0x559e72806190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f56408b80 1 -- 172.21.15.57:0/3597956121 >> 172.21.15.57:0/3597956121 conn(0x559e727f1c50 msgr2=0x559e727f7050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:33.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f56408b80 1 -- 172.21.15.57:0/3597956121 shutdown_connections 2023-03-02T11:02:33.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.721+0000 7f4f56408b80 1 -- 172.21.15.57:0/3597956121 wait complete. 2023-03-02T11:02:33.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.722+0000 7f4f56408b80 20 client.26080 trim_cache size 0 max 16384 2023-03-02T11:02:33.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f56408b80 1 Processor -- start 2023-03-02T11:02:33.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f56408b80 1 -- start start 2023-03-02T11:02:33.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727f1c50 0x559e728008c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fc3c0 0x559e72806550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fccd0 0x559e72804450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f56408b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e727f6350 con 0x559e727fc3c0 2023-03-02T11:02:33.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f56408b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7281d300 con 0x559e727f1c50 2023-03-02T11:02:33.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f56408b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e72803cb0 con 0x559e727fccd0 2023-03-02T11:02:33.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f33fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fc3c0 0x559e72806550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f3bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727f1c50 0x559e728008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f33fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fc3c0 0x559e72806550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36798/0 (socket says 172.21.15.57:36798) 2023-03-02T11:02:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.738+0000 7f4f33fff700 1 -- 172.21.15.57:0/63083766 learned_addr learned my addr 172.21.15.57:0/63083766 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:02:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.739+0000 7f4f40f9c700 1 --2- 172.21.15.57:0/63083766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fccd0 0x559e72804450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.739+0000 7f4f3bfff700 1 -- 172.21.15.57:0/63083766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fccd0 msgr2=0x559e72804450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.739+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/63083766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fccd0 0x559e72804450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.739+0000 7f4f3bfff700 1 -- 172.21.15.57:0/63083766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fc3c0 msgr2=0x559e72806550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.739+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/63083766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fc3c0 0x559e72806550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.739+0000 7f4f3bfff700 1 -- 172.21.15.57:0/63083766 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e728017b0 con 0x559e727f1c50 2023-03-02T11:02:33.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.739+0000 7f4f33fff700 1 --2- 172.21.15.57:0/63083766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fc3c0 0x559e72806550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:02:33.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.739+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/63083766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727f1c50 0x559e728008c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c024770 tx=0x7f4f2c0059d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee60b9ace6fcf9a9 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:33.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.739+0000 7f4f32ffd700 1 -- 172.21.15.57:0/63083766 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c028070 con 0x559e727f1c50 2023-03-02T11:02:33.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.739+0000 7f4f32ffd700 1 -- 172.21.15.57:0/63083766 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f2c01e040 con 0x559e727f1c50 2023-03-02T11:02:33.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.739+0000 7f4f32ffd700 1 -- 172.21.15.57:0/63083766 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c02f670 con 0x559e727f1c50 2023-03-02T11:02:33.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 -- 172.21.15.57:0/63083766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727f1c50 msgr2=0x559e728008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 --2- 172.21.15.57:0/63083766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727f1c50 0x559e728008c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c024770 tx=0x7f4f2c0059d0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 -- 172.21.15.57:0/63083766 shutdown_connections 2023-03-02T11:02:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 --2- 172.21.15.57:0/63083766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fccd0 0x559e72804450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 --2- 172.21.15.57:0/63083766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727f1c50 0x559e728008c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 --2- 172.21.15.57:0/63083766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727fc3c0 0x559e72806550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 -- 172.21.15.57:0/63083766 >> 172.21.15.57:0/63083766 conn(0x559e727f5f80 msgr2=0x559e728001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 -- 172.21.15.57:0/63083766 shutdown_connections 2023-03-02T11:02:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 -- 172.21.15.57:0/63083766 wait complete. 2023-03-02T11:02:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 -- start start 2023-03-02T11:02:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 Processor -- start 2023-03-02T11:02:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.740+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727f1c50 0x559e7280d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 0x559e7280b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f56408b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fccd0 0x559e7280b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f56408b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7280c090 con 0x559e727f1c50 2023-03-02T11:02:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f56408b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7280c200 con 0x559e727fc3c0 2023-03-02T11:02:33.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f56408b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e72867c00 con 0x559e727fccd0 2023-03-02T11:02:33.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f56408b80 10 client.0 _ll_register_callbacks cb 0x559e726f4520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:02:33.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f3bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727f1c50 0x559e7280d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f33fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 0x559e7280b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f3bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727f1c50 0x559e7280d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36808/0 (socket says 172.21.15.57:36808) 2023-03-02T11:02:33.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f3bfff700 1 -- 172.21.15.57:0/3590251767 learned_addr learned my addr 172.21.15.57:0/3590251767 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:02:33.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f40f9c700 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fccd0 0x559e7280b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f33fff700 1 -- 172.21.15.57:0/3590251767 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fccd0 msgr2=0x559e7280b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f33fff700 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fccd0 0x559e7280b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f33fff700 1 -- 172.21.15.57:0/3590251767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727f1c50 msgr2=0x559e7280d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:02:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f33fff700 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727f1c50 0x559e7280d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f33fff700 1 -- 172.21.15.57:0/3590251767 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e7257cde0 con 0x559e727fc3c0 2023-03-02T11:02:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727f1c50 0x559e7280d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:02:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f33fff700 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 0x559e7280b460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4f24004790 tx=0x7f4f24021750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcb00f12a29ee9d3 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:02:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.741+0000 7f4f1b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:02:33.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3590251767 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24017040 con 0x559e727fc3c0 2023-03-02T11:02:33.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f56408b80 1 -- 172.21.15.57:0/3590251767 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f34004ad0 con 0x559e727fc3c0 2023-03-02T11:02:33.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3590251767 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7f4f24021ba0 con 0x559e727fc3c0 2023-03-02T11:02:33.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3590251767 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f24021d60 con 0x559e727fc3c0 2023-03-02T11:02:33.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f56408b80 10 client.26135 fetch_fsmap learned FSMap version 47 2023-03-02T11:02:33.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f56408b80 1 -- 172.21.15.57:0/3590251767 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x559e72565c60 con 0x559e727fc3c0 2023-03-02T11:02:33.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3590251767 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f34004ad0 con 0x559e727fc3c0 2023-03-02T11:02:33.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3590251767 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4f24003bd0 con 0x559e727fc3c0 2023-03-02T11:02:33.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f56408b80 10 client.26135 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:02:33.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f56408b80 10 client.26135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:02:33.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f56408b80 20 client.26135 populate_metadata read hostname 'smithi057' 2023-03-02T11:02:33.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559e72801110 0x559e7286b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:02:33.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f56408b80 4 client.26135 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:02:33.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f56408b80 1 -- 172.21.15.57:0/3590251767 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559e72746e90 con 0x559e72801110 2023-03-02T11:02:33.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.742+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559e72801110 0x559e7286b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f3bfff700 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559e72801110 0x559e7286b300 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae1401080e522410 server_cookie=c6b5f9790f46644b in_seq=0 out_seq=0 2023-03-02T11:02:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f1b7fe700 10 client.26135 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:02:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f1b7fe700 1 -- 172.21.15.57:0/3590251767 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x559e72746e90 con 0x559e72801110 2023-03-02T11:02:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f1b7fe700 10 client.26135 handle_command_reply: tid=0 2023-03-02T11:02:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 1 client.26135 shutdown 2023-03-02T11:02:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 1 -- 172.21.15.57:0/3590251767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 msgr2=0x559e7280b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 0x559e7280b460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4f24004790 tx=0x7f4f24021750 comp rx=0 tx=0).stop 2023-03-02T11:02:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 1 -- 172.21.15.57:0/3590251767 shutdown_connections 2023-03-02T11:02:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559e72801110 0x559e7286b300 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e727fccd0 0x559e7280b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f1b7fe700 0 client.26135 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:02:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e727f1c50 0x559e7280d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 1 --2- 172.21.15.57:0/3590251767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e727fc3c0 0x559e7280b460 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 1 -- 172.21.15.57:0/3590251767 >> 172.21.15.57:0/3590251767 conn(0x559e727f5f80 msgr2=0x559e72804450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:33.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 1 -- 172.21.15.57:0/3590251767 shutdown_connections 2023-03-02T11:02:33.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 1 -- 172.21.15.57:0/3590251767 wait complete. 2023-03-02T11:02:33.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.743+0000 7f4f56408b80 20 client.26135 trim_cache size 0 max 16384 2023-03-02T11:02:33.758 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:02:33.758 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:02:33.758 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:02:33.759 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:02:33.759 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:02:33.759 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:02:33.759 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:02:33.760 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:02:33.760 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:02:33.760 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:02:33.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 -- 172.21.15.57:0/324295 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4f2809b480 msgr2=0x7f4f2809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:33.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4f2809b480 0x7f4f2809d930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c006010 tx=0x7f4f2c005960 comp rx=0 tx=0).stop 2023-03-02T11:02:33.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 -- 172.21.15.57:0/324295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c10a050 msgr2=0x7f4f3c19c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:02:33.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c10a050 0x7f4f3c19c770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400efc0 tx=0x7f4f3400c3a0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 -- 172.21.15.57:0/324295 shutdown_connections 2023-03-02T11:02:33.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f4f2809b480 0x7f4f2809d930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f3c10a050 0x7f4f3c19c770 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f3c100c80 0x7f4f3c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 --2- 172.21.15.57:0/324295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f3c101590 0x7f4f3c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:02:33.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 -- 172.21.15.57:0/324295 >> 172.21.15.57:0/324295 conn(0x7f4f3c0fa4b0 msgr2=0x7f4f3c10c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:02:33.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 -- 172.21.15.57:0/324295 shutdown_connections 2023-03-02T11:02:33.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:02:33.744+0000 7f4f429ff700 1 -- 172.21.15.57:0/324295 wait complete. 2023-03-02T11:02:33.766 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:02:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:33.996+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:33.996+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:02:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:33.996+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:02:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:33.996+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:02:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:33.996+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:02:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:33 smithi122 ceph-mon[125440]: pgmap v171: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:02:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:33 smithi136 ceph-mon[125702]: pgmap v171: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:02:34.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:33 smithi057 ceph-mon[92072]: pgmap v171: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:02:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:35 smithi136 ceph-mon[125702]: pgmap v172: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:35 smithi057 ceph-mon[92072]: pgmap v172: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:35 smithi122 ceph-mon[125440]: pgmap v172: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:37 smithi136 ceph-mon[125702]: pgmap v173: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:37 smithi057 ceph-mon[92072]: pgmap v173: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:37 smithi122 ceph-mon[125440]: pgmap v173: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:39 smithi136 ceph-mon[125702]: pgmap v174: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:39 smithi057 ceph-mon[92072]: pgmap v174: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:39 smithi122 ceph-mon[125440]: pgmap v174: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:41 smithi136 ceph-mon[125702]: pgmap v175: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:41 smithi057 ceph-mon[92072]: pgmap v175: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:41 smithi122 ceph-mon[125440]: pgmap v175: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:43 smithi136 ceph-mon[125702]: pgmap v176: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:02:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:43 smithi057 ceph-mon[92072]: pgmap v176: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:02:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:43 smithi122 ceph-mon[125440]: pgmap v176: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:02:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:45 smithi136 ceph-mon[125702]: pgmap v177: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:45 smithi057 ceph-mon[92072]: pgmap v177: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:45 smithi122 ceph-mon[125440]: pgmap v177: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:47 smithi136 ceph-mon[125702]: pgmap v178: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:47 smithi057 ceph-mon[92072]: pgmap v178: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:47 smithi122 ceph-mon[125440]: pgmap v178: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:49.008 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:49.007+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:02:49.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:49.008+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:02:49.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:49.008+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:02:49.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:49.008+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:02:49.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:02:49.008+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:02:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:49 smithi136 ceph-mon[125702]: pgmap v179: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:49 smithi057 ceph-mon[92072]: pgmap v179: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:49 smithi122 ceph-mon[125440]: pgmap v179: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:02:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:52 smithi136 ceph-mon[125702]: pgmap v180: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:52 smithi057 ceph-mon[92072]: pgmap v180: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:52 smithi122 ceph-mon[125440]: pgmap v180: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:54 smithi136 ceph-mon[125702]: pgmap v181: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:02:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:54 smithi057 ceph-mon[92072]: pgmap v181: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:02:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:54 smithi122 ceph-mon[125440]: pgmap v181: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:02:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:56 smithi136 ceph-mon[125702]: pgmap v182: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:56 smithi057 ceph-mon[92072]: pgmap v182: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:56 smithi122 ceph-mon[125440]: pgmap v182: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:02:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:02:58 smithi136 ceph-mon[125702]: pgmap v183: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:02:58 smithi057 ceph-mon[92072]: pgmap v183: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:02:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:02:58 smithi122 ceph-mon[125440]: pgmap v183: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:00 smithi136 ceph-mon[125702]: pgmap v184: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:00 smithi057 ceph-mon[92072]: pgmap v184: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:00 smithi122 ceph-mon[125440]: pgmap v184: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:02 smithi136 ceph-mon[125702]: pgmap v185: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:02 smithi057 ceph-mon[92072]: pgmap v185: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:02 smithi122 ceph-mon[125440]: pgmap v185: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:03.767 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:03:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.936+0000 7fed67fff700 1 -- 172.21.15.57:0/4067799078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed60101590 msgr2=0x7fed60109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.936+0000 7fed67fff700 1 --2- 172.21.15.57:0/4067799078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed60101590 0x7fed60109a80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fed50009990 tx=0x7fed50009ca0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.936+0000 7fed67fff700 1 -- 172.21.15.57:0/4067799078 shutdown_connections 2023-03-02T11:03:03.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.936+0000 7fed67fff700 1 --2- 172.21.15.57:0/4067799078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed6010a050 0x7fed6010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.936+0000 7fed67fff700 1 --2- 172.21.15.57:0/4067799078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed60100c80 0x7fed60101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.936+0000 7fed67fff700 1 --2- 172.21.15.57:0/4067799078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed60101590 0x7fed60109a80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.936+0000 7fed67fff700 1 -- 172.21.15.57:0/4067799078 >> 172.21.15.57:0/4067799078 conn(0x7fed600fa4b0 msgr2=0x7fed600fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:03.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.936+0000 7fed67fff700 1 -- 172.21.15.57:0/4067799078 shutdown_connections 2023-03-02T11:03:03.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.936+0000 7fed67fff700 1 -- 172.21.15.57:0/4067799078 wait complete. 2023-03-02T11:03:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.937+0000 7fed67fff700 1 Processor -- start 2023-03-02T11:03:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed67fff700 1 -- start start 2023-03-02T11:03:03.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed67fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed60100c80 0x7fed6019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed67fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed60101590 0x7fed6019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed67fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed6010a050 0x7fed60195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed67fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed60196090 con 0x7fed60101590 2023-03-02T11:03:03.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed67fff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed60196200 con 0x7fed6010a050 2023-03-02T11:03:03.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed67fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed601963c0 con 0x7fed60100c80 2023-03-02T11:03:03.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed60100c80 0x7fed6019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed6659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed6010a050 0x7fed60195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed60100c80 0x7fed6019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48556/0 (socket says 172.21.15.57:48556) 2023-03-02T11:03:03.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed65d9b700 1 -- 172.21.15.57:0/146661519 learned_addr learned my addr 172.21.15.57:0/146661519 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:03:03.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed6559a700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed60101590 0x7fed6019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed6659c700 1 -- 172.21.15.57:0/146661519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed60100c80 msgr2=0x7fed6019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:03.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed6659c700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed60100c80 0x7fed6019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed6659c700 1 -- 172.21.15.57:0/146661519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed60101590 msgr2=0x7fed6019bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.938+0000 7fed6659c700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed60101590 0x7fed6019bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.939+0000 7fed6659c700 1 -- 172.21.15.57:0/146661519 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed500095f0 con 0x7fed6010a050 2023-03-02T11:03:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.939+0000 7fed65d9b700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed60100c80 0x7fed6019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:03:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.939+0000 7fed6659c700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed6010a050 0x7fed60195a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fed5800efc0 tx=0x7fed5800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.939+0000 7fed56ffd700 1 -- 172.21.15.57:0/146661519 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58018070 con 0x7fed6010a050 2023-03-02T11:03:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.939+0000 7fed67fff700 1 -- 172.21.15.57:0/146661519 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6010fb20 con 0x7fed6010a050 2023-03-02T11:03:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.939+0000 7fed56ffd700 1 -- 172.21.15.57:0/146661519 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed5800f040 con 0x7fed6010a050 2023-03-02T11:03:03.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.939+0000 7fed56ffd700 1 -- 172.21.15.57:0/146661519 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5800cd40 con 0x7fed6010a050 2023-03-02T11:03:03.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.939+0000 7fed67fff700 1 -- 172.21.15.57:0/146661519 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6010f990 con 0x7fed6010a050 2023-03-02T11:03:03.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.943+0000 7fed56ffd700 1 -- 172.21.15.57:0/146661519 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fed58003a00 con 0x7fed6010a050 2023-03-02T11:03:03.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.944+0000 7fed7b8c0b80 1 Processor -- start 2023-03-02T11:03:03.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.944+0000 7fed7b8c0b80 1 -- start start 2023-03-02T11:03:03.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.944+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf4197d0 0x55fbcf419ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.944+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41a0e0 0x55fbcf41dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.944+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41e520 0x55fbcf41e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.944+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf37ca60 con 0x55fbcf41a0e0 2023-03-02T11:03:03.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.944+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf32ef80 con 0x55fbcf4197d0 2023-03-02T11:03:03.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.944+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf2ff160 con 0x55fbcf41e520 2023-03-02T11:03:03.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.944+0000 7fed56ffd700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fed4c09b480 0x7fed4c09d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed6559a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf4197d0 0x55fbcf419ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41a0e0 0x55fbcf41dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed6559a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf4197d0 0x55fbcf419ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:50854/0 (socket says 172.21.15.57:50854) 2023-03-02T11:03:03.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed6559a700 1 -- 172.21.15.57:0/893418417 learned_addr learned my addr 172.21.15.57:0/893418417 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:03:03.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed6559a700 1 --2- 172.21.15.57:0/893418417 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41e520 0x55fbcf41e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed56ffd700 1 -- 172.21.15.57:0/146661519 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fed580c4e80 con 0x7fed6010a050 2023-03-02T11:03:03.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed6659c700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fed4c09b480 0x7fed4c09d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed65d9b700 1 -- 172.21.15.57:0/893418417 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41e520 msgr2=0x55fbcf41e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:03.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed65d9b700 1 --2- 172.21.15.57:0/893418417 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41e520 0x55fbcf41e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed65d9b700 1 -- 172.21.15.57:0/893418417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf4197d0 msgr2=0x55fbcf419ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:03.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed65d9b700 1 --2- 172.21.15.57:0/893418417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf4197d0 0x55fbcf419ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed65d9b700 1 -- 172.21.15.57:0/893418417 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbcf1e9630 con 0x55fbcf41a0e0 2023-03-02T11:03:03.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed65d9b700 1 --2- 172.21.15.57:0/893418417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41a0e0 0x55fbcf41dfe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fed5c011570 tx=0x7fed5c011880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5551398f3ddbf server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:03.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed6659c700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fed4c09b480 0x7fed4c09d930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed58009490 tx=0x7fed58090050 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:03.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.945+0000 7fed4bfff700 1 -- 172.21.15.57:0/893418417 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c004230 con 0x55fbcf41a0e0 2023-03-02T11:03:03.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.946+0000 7fed4bfff700 1 -- 172.21.15.57:0/893418417 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed5c004390 con 0x55fbcf41a0e0 2023-03-02T11:03:03.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.946+0000 7fed4bfff700 1 -- 172.21.15.57:0/893418417 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c019860 con 0x55fbcf41a0e0 2023-03-02T11:03:03.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.946+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/893418417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41a0e0 msgr2=0x55fbcf41dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:03.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.946+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/893418417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41a0e0 0x55fbcf41dfe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fed5c011570 tx=0x7fed5c011880 comp rx=0 tx=0).stop 2023-03-02T11:03:03.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.946+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/893418417 shutdown_connections 2023-03-02T11:03:03.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.946+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/893418417 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41e520 0x55fbcf41e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.946+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/893418417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf4197d0 0x55fbcf419ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.946+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/893418417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41a0e0 0x55fbcf41dfe0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.946+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/893418417 >> 172.21.15.57:0/893418417 conn(0x55fbcf40ac50 msgr2=0x55fbcf410460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:03.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.946+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/893418417 shutdown_connections 2023-03-02T11:03:03.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.946+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/893418417 wait complete. 2023-03-02T11:03:03.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.947+0000 7fed7b8c0b80 1 -- start start 2023-03-02T11:03:03.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.947+0000 7fed7b8c0b80 1 Processor -- start 2023-03-02T11:03:03.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.947+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf4197d0 0x55fbcf425d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.947+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 0x55fbcf422f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.947+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41e520 0x55fbcf423670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.947+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf36dbc0 con 0x55fbcf4197d0 2023-03-02T11:03:03.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.947+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf3670f0 con 0x55fbcf41e520 2023-03-02T11:03:03.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.947+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf1eb920 con 0x55fbcf41a0e0 2023-03-02T11:03:03.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed7b8c0b80 10 client.0 _ll_register_callbacks cb 0x55fbcf30d520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:03:03.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed6559a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf4197d0 0x55fbcf425d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed6559a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf4197d0 0x55fbcf425d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57668/0 (socket says 172.21.15.57:57668) 2023-03-02T11:03:03.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 0x55fbcf422f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed6559a700 1 -- 172.21.15.57:0/2263952297 learned_addr learned my addr 172.21.15.57:0/2263952297 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:03:03.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed6559a700 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41e520 0x55fbcf423670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed6559a700 1 -- 172.21.15.57:0/2263952297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 msgr2=0x55fbcf422f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:03.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed6559a700 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 0x55fbcf422f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed6559a700 1 -- 172.21.15.57:0/2263952297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41e520 msgr2=0x55fbcf423670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:03.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed6559a700 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41e520 0x55fbcf423670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed6559a700 1 -- 172.21.15.57:0/2263952297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c009d60 con 0x55fbcf4197d0 2023-03-02T11:03:03.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed6559a700 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf4197d0 0x55fbcf425d20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fed5000b2e0 tx=0x7fed50009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9b0de5a6f28cc2 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:03.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed497fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:03:03.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed497fa700 1 -- 172.21.15.57:0/2263952297 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50005020 con 0x55fbcf4197d0 2023-03-02T11:03:03.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed497fa700 1 -- 172.21.15.57:0/2263952297 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fed50005180 con 0x55fbcf4197d0 2023-03-02T11:03:03.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2263952297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fbcf3387b0 con 0x55fbcf4197d0 2023-03-02T11:03:03.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed497fa700 1 -- 172.21.15.57:0/2263952297 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed50005340 con 0x55fbcf4197d0 2023-03-02T11:03:03.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed7b8c0b80 10 client.16305 fetch_fsmap learned FSMap version 47 2023-03-02T11:03:03.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.948+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2263952297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55fbcf195de0 con 0x55fbcf4197d0 2023-03-02T11:03:03.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.949+0000 7fed497fa700 1 -- 172.21.15.57:0/2263952297 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed50036020 con 0x55fbcf4197d0 2023-03-02T11:03:03.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.949+0000 7fed497fa700 1 -- 172.21.15.57:0/2263952297 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fed50004980 con 0x55fbcf4197d0 2023-03-02T11:03:03.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.949+0000 7fed7b8c0b80 10 client.16305 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:03:03.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.949+0000 7fed7b8c0b80 10 client.16305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:03:03.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.949+0000 7fed7b8c0b80 20 client.16305 populate_metadata read hostname 'smithi057' 2023-03-02T11:03:03.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.949+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fbcf433660 0x55fbcf435a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.949+0000 7fed7b8c0b80 4 client.16305 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:03:03.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.949+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2263952297 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fbcf360170 con 0x55fbcf433660 2023-03-02T11:03:03.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.949+0000 7fed65d9b700 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fbcf433660 0x55fbcf435a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.950+0000 7fed497fa700 10 client.16305 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:03:03.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.950+0000 7fed65d9b700 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fbcf433660 0x55fbcf435a70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0b5af4d0d3cdc4d server_cookie=6318c36ad129aa2d in_seq=0 out_seq=0 2023-03-02T11:03:03.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.950+0000 7fed497fa700 1 -- 172.21.15.57:0/2263952297 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55fbcf360170 con 0x55fbcf433660 2023-03-02T11:03:03.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.950+0000 7fed497fa700 10 client.16305 handle_command_reply: tid=0 2023-03-02T11:03:03.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.950+0000 7fed7b8c0b80 1 client.16305 shutdown 2023-03-02T11:03:03.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2263952297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf4197d0 msgr2=0x55fbcf425d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:03.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf4197d0 0x55fbcf425d20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fed5000b2e0 tx=0x7fed50009ca0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2263952297 shutdown_connections 2023-03-02T11:03:03.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fbcf433660 0x55fbcf435a70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41e520 0x55fbcf423670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed497fa700 0 client.16305 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:03:03.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf4197d0 0x55fbcf425d20 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2263952297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 0x55fbcf422f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2263952297 >> 172.21.15.57:0/2263952297 conn(0x55fbcf40ac50 msgr2=0x55fbcf410050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:03.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2263952297 shutdown_connections 2023-03-02T11:03:03.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2263952297 wait complete. 2023-03-02T11:03:03.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.951+0000 7fed7b8c0b80 20 client.16305 trim_cache size 0 max 16384 2023-03-02T11:03:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.967+0000 7fed7b8c0b80 1 Processor -- start 2023-03-02T11:03:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.967+0000 7fed7b8c0b80 1 -- start start 2023-03-02T11:03:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf4197d0 0x55fbcf425850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 0x55fbcf4224a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41e520 0x55fbcf4229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf41ce50 con 0x55fbcf41e520 2023-03-02T11:03:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf423c50 con 0x55fbcf4197d0 2023-03-02T11:03:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf43a620 con 0x55fbcf41a0e0 2023-03-02T11:03:03.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 0x55fbcf4224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 0x55fbcf4224a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:48590/0 (socket says 172.21.15.57:48590) 2023-03-02T11:03:03.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed65d9b700 1 -- 172.21.15.57:0/3311537025 learned_addr learned my addr 172.21.15.57:0/3311537025 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:03:03.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed6559a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf4197d0 0x55fbcf425850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed6559a700 1 --2- 172.21.15.57:0/3311537025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41e520 0x55fbcf4229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed65d9b700 1 -- 172.21.15.57:0/3311537025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf4197d0 msgr2=0x55fbcf425850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:03.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed65d9b700 1 --2- 172.21.15.57:0/3311537025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf4197d0 0x55fbcf425850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed65d9b700 1 -- 172.21.15.57:0/3311537025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41e520 msgr2=0x55fbcf4229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:03.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed65d9b700 1 --2- 172.21.15.57:0/3311537025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41e520 0x55fbcf4229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed65d9b700 1 -- 172.21.15.57:0/3311537025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbcf420bd0 con 0x55fbcf41a0e0 2023-03-02T11:03:03.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.968+0000 7fed65d9b700 1 --2- 172.21.15.57:0/3311537025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 0x55fbcf4224a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009880 tx=0x7fed5c019420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5be0dbbd1f72e21f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:03.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed54ff9700 1 -- 172.21.15.57:0/3311537025 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c029070 con 0x55fbcf41a0e0 2023-03-02T11:03:03.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed54ff9700 1 -- 172.21.15.57:0/3311537025 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed5c02e070 con 0x55fbcf41a0e0 2023-03-02T11:03:03.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed54ff9700 1 -- 172.21.15.57:0/3311537025 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0038e0 con 0x55fbcf41a0e0 2023-03-02T11:03:03.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/3311537025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 msgr2=0x55fbcf4224a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:03.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/3311537025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 0x55fbcf4224a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009880 tx=0x7fed5c019420 comp rx=0 tx=0).stop 2023-03-02T11:03:03.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/3311537025 shutdown_connections 2023-03-02T11:03:03.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/3311537025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41e520 0x55fbcf4229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/3311537025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf4197d0 0x55fbcf425850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/3311537025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf41a0e0 0x55fbcf4224a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/3311537025 >> 172.21.15.57:0/3311537025 conn(0x55fbcf40ac50 msgr2=0x55fbcf42ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:03.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/3311537025 shutdown_connections 2023-03-02T11:03:03.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.969+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/3311537025 wait complete. 2023-03-02T11:03:03.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.970+0000 7fed7b8c0b80 1 -- start start 2023-03-02T11:03:03.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.970+0000 7fed7b8c0b80 1 Processor -- start 2023-03-02T11:03:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.970+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf4197d0 0x55fbcf42a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.970+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41a0e0 0x55fbcf428910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.970+0000 7fed7b8c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41e520 0x55fbcf428f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf429600 con 0x55fbcf41e520 2023-03-02T11:03:03.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf429770 con 0x55fbcf41a0e0 2023-03-02T11:03:03.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed7b8c0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcf484f50 con 0x55fbcf4197d0 2023-03-02T11:03:03.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed7b8c0b80 10 client.0 _ll_register_callbacks cb 0x55fbcf30d520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:03:03.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed6559a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf4197d0 0x55fbcf42a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41a0e0 0x55fbcf428910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed65d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41a0e0 0x55fbcf428910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:50870/0 (socket says 172.21.15.57:50870) 2023-03-02T11:03:03.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed65d9b700 1 -- 172.21.15.57:0/2297144342 learned_addr learned my addr 172.21.15.57:0/2297144342 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:03:03.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed6559a700 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41e520 0x55fbcf428f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed65d9b700 1 -- 172.21.15.57:0/2297144342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf4197d0 msgr2=0x55fbcf42a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:03.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed65d9b700 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf4197d0 0x55fbcf42a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed65d9b700 1 -- 172.21.15.57:0/2297144342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41e520 msgr2=0x55fbcf428f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:03.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed65d9b700 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41e520 0x55fbcf428f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed65d9b700 1 -- 172.21.15.57:0/2297144342 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbcf1e9630 con 0x55fbcf41a0e0 2023-03-02T11:03:03.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed65d9b700 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41a0e0 0x55fbcf428910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009850 tx=0x7fed5c005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f67dc4159bbe35c server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:03.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed497fa700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:03:03.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed497fa700 1 -- 172.21.15.57:0/2297144342 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c029050 con 0x55fbcf41a0e0 2023-03-02T11:03:03.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed497fa700 1 -- 172.21.15.57:0/2297144342 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fed5c005240 con 0x55fbcf41a0e0 2023-03-02T11:03:03.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.971+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2297144342 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed5c004390 con 0x55fbcf41a0e0 2023-03-02T11:03:03.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed497fa700 1 -- 172.21.15.57:0/2297144342 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed5c005400 con 0x55fbcf41a0e0 2023-03-02T11:03:03.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed7b8c0b80 10 client.26153 fetch_fsmap learned FSMap version 47 2023-03-02T11:03:03.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2297144342 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55fbcf32e190 con 0x55fbcf41a0e0 2023-03-02T11:03:03.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed497fa700 1 -- 172.21.15.57:0/2297144342 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed5c004390 con 0x55fbcf41a0e0 2023-03-02T11:03:03.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed497fa700 1 -- 172.21.15.57:0/2297144342 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fed5c0115a0 con 0x55fbcf41a0e0 2023-03-02T11:03:03.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed7b8c0b80 10 client.26153 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:03:03.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed7b8c0b80 10 client.26153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:03:03.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed7b8c0b80 20 client.26153 populate_metadata read hostname 'smithi057' 2023-03-02T11:03:03.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fbcf486350 0x55fbcf488760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:03.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed7b8c0b80 4 client.26153 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:03:03.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2297144342 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fbcf35fe90 con 0x55fbcf486350 2023-03-02T11:03:03.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.972+0000 7fed6559a700 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fbcf486350 0x55fbcf488760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:03.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed497fa700 10 client.26153 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:03:03.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed6559a700 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fbcf486350 0x55fbcf488760 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be492628efaed33a server_cookie=8116a92be9207907 in_seq=0 out_seq=0 2023-03-02T11:03:03.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed497fa700 1 -- 172.21.15.57:0/2297144342 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55fbcf35fe90 con 0x55fbcf486350 2023-03-02T11:03:03.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed497fa700 10 client.26153 handle_command_reply: tid=0 2023-03-02T11:03:03.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 1 client.26153 shutdown 2023-03-02T11:03:03.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2297144342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41a0e0 msgr2=0x55fbcf428910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:03.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41a0e0 0x55fbcf428910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009850 tx=0x7fed5c005dc0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2297144342 shutdown_connections 2023-03-02T11:03:03.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55fbcf486350 0x55fbcf488760 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fbcf41e520 0x55fbcf428f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed497fa700 0 client.26153 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:03:03.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fbcf4197d0 0x55fbcf42a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 1 --2- 172.21.15.57:0/2297144342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fbcf41a0e0 0x55fbcf428910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2297144342 >> 172.21.15.57:0/2297144342 conn(0x55fbcf40ac50 msgr2=0x55fbcf4141c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:03.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2297144342 shutdown_connections 2023-03-02T11:03:03.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 1 -- 172.21.15.57:0/2297144342 wait complete. 2023-03-02T11:03:03.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.973+0000 7fed7b8c0b80 20 client.26153 trim_cache size 0 max 16384 2023-03-02T11:03:03.985 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:03:03.985 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:03:03.985 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:03:03.985 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:03:03.985 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:03:03.985 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:03:03.986 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:03:03.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:03:03.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:03:03.986 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:03:03.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 -- 172.21.15.57:0/146661519 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fed4c09b480 msgr2=0x7fed4c09d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:03.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fed4c09b480 0x7fed4c09d930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed58009490 tx=0x7fed58090050 comp rx=0 tx=0).stop 2023-03-02T11:03:03.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 -- 172.21.15.57:0/146661519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed6010a050 msgr2=0x7fed60195a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:03.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed6010a050 0x7fed60195a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fed5800efc0 tx=0x7fed5800c3a0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 -- 172.21.15.57:0/146661519 shutdown_connections 2023-03-02T11:03:03.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fed4c09b480 0x7fed4c09d930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed6010a050 0x7fed60195a20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed60100c80 0x7fed6019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 --2- 172.21.15.57:0/146661519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed60101590 0x7fed6019bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:03.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 -- 172.21.15.57:0/146661519 >> 172.21.15.57:0/146661519 conn(0x7fed600fa4b0 msgr2=0x7fed6010c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:03.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 -- 172.21.15.57:0/146661519 shutdown_connections 2023-03-02T11:03:03.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:03.974+0000 7fed67fff700 1 -- 172.21.15.57:0/146661519 wait complete. 2023-03-02T11:03:03.991 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:03:04.023 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:04.021+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:04.023 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:04.021+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:03:04.023 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:04.021+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:03:04.024 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:04.021+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:03:04.024 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:04.021+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:03:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:04 smithi057 ceph-mon[92072]: pgmap v186: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:03:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:04 smithi136 ceph-mon[125702]: pgmap v186: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:03:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:04 smithi122 ceph-mon[125440]: pgmap v186: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:03:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:06 smithi136 ceph-mon[125702]: pgmap v187: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:03:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:06 smithi057 ceph-mon[92072]: pgmap v187: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:03:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:06 smithi122 ceph-mon[125440]: pgmap v187: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:03:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:08 smithi136 ceph-mon[125702]: pgmap v188: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:03:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:08 smithi057 ceph-mon[92072]: pgmap v188: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:03:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:08 smithi122 ceph-mon[125440]: pgmap v188: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:03:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:10 smithi136 ceph-mon[125702]: pgmap v189: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:03:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:10 smithi057 ceph-mon[92072]: pgmap v189: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:03:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:10 smithi122 ceph-mon[125440]: pgmap v189: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:03:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:12 smithi136 ceph-mon[125702]: pgmap v190: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:03:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:12 smithi057 ceph-mon[92072]: pgmap v190: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:03:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:12 smithi122 ceph-mon[125440]: pgmap v190: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:03:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:03:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:03:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:03:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:14 smithi136 ceph-mon[125702]: pgmap v191: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:03:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:03:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:03:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:03:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:14 smithi057 ceph-mon[92072]: pgmap v191: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:03:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:03:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:03:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:03:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:14 smithi122 ceph-mon[125440]: pgmap v191: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:03:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:03:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:03:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:03:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:16 smithi136 ceph-mon[125702]: pgmap v192: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:03:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:16 smithi057 ceph-mon[92072]: pgmap v192: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:03:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:16 smithi122 ceph-mon[125440]: pgmap v192: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:03:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:18 smithi136 ceph-mon[125702]: pgmap v193: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:03:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:18 smithi057 ceph-mon[92072]: pgmap v193: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:03:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:18 smithi122 ceph-mon[125440]: pgmap v193: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:03:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:19.030+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:19.030+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:03:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:19.030+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:03:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:19.030+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:03:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:19.031+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:03:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:20 smithi136 ceph-mon[125702]: pgmap v194: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:03:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:20 smithi057 ceph-mon[92072]: pgmap v194: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:03:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:20 smithi122 ceph-mon[125440]: pgmap v194: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:03:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:22 smithi136 ceph-mon[125702]: pgmap v195: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:03:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:22 smithi057 ceph-mon[92072]: pgmap v195: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:03:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:22 smithi122 ceph-mon[125440]: pgmap v195: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:03:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:24 smithi057 ceph-mon[92072]: pgmap v196: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:03:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:24 smithi122 ceph-mon[125440]: pgmap v196: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:03:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:24 smithi136 ceph-mon[125702]: pgmap v196: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:03:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:26 smithi057 ceph-mon[92072]: pgmap v197: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:26 smithi122 ceph-mon[125440]: pgmap v197: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:26 smithi136 ceph-mon[125702]: pgmap v197: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:28 smithi057 ceph-mon[92072]: pgmap v198: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:28 smithi122 ceph-mon[125440]: pgmap v198: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:28 smithi136 ceph-mon[125702]: pgmap v198: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:30 smithi057 ceph-mon[92072]: pgmap v199: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:30 smithi122 ceph-mon[125440]: pgmap v199: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:30 smithi136 ceph-mon[125702]: pgmap v199: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:32 smithi057 ceph-mon[92072]: pgmap v200: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:32 smithi122 ceph-mon[125440]: pgmap v200: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:32 smithi136 ceph-mon[125702]: pgmap v200: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:33.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:03:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:34.046+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:34.046+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:03:34.048 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:34.046+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:03:34.048 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:34.046+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:03:34.048 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:34.046+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:03:34.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.163+0000 7fd0b93ff700 1 -- 172.21.15.57:0/2875102072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0b40ffad0 msgr2=0x7fd0b40fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:34.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.163+0000 7fd0b93ff700 1 --2- 172.21.15.57:0/2875102072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0b40ffad0 0x7fd0b40fff40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009990 tx=0x7fd0a8009ca0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.163+0000 7fd0b93ff700 1 -- 172.21.15.57:0/2875102072 shutdown_connections 2023-03-02T11:03:34.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.163+0000 7fd0b93ff700 1 --2- 172.21.15.57:0/2875102072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0b4100480 0x7fd0b410c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.163+0000 7fd0b93ff700 1 --2- 172.21.15.57:0/2875102072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0b4105ae0 0x7fd0b4105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.163+0000 7fd0b93ff700 1 --2- 172.21.15.57:0/2875102072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0b40ffad0 0x7fd0b40fff40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.163+0000 7fd0b93ff700 1 -- 172.21.15.57:0/2875102072 >> 172.21.15.57:0/2875102072 conn(0x7fd0b40fb610 msgr2=0x7fd0b40fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:34.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.164+0000 7fd0b93ff700 1 -- 172.21.15.57:0/2875102072 shutdown_connections 2023-03-02T11:03:34.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.164+0000 7fd0b93ff700 1 -- 172.21.15.57:0/2875102072 wait complete. 2023-03-02T11:03:34.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.164+0000 7fd0b93ff700 1 Processor -- start 2023-03-02T11:03:34.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b93ff700 1 -- start start 2023-03-02T11:03:34.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b93ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0b40ffad0 0x7fd0b4072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b93ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0b4100480 0x7fd0b4072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b93ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0b4105ae0 0x7fd0b41a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b93ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b4073600 con 0x7fd0b4100480 2023-03-02T11:03:34.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b93ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b41a4360 con 0x7fd0b4105ae0 2023-03-02T11:03:34.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b93ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b41a44a0 con 0x7fd0b40ffad0 2023-03-02T11:03:34.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0b4100480 0x7fd0b4072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b2ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0b40ffad0 0x7fd0b4072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0b4100480 0x7fd0b4072dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39568/0 (socket says 172.21.15.57:39568) 2023-03-02T11:03:34.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b27fc700 1 -- 172.21.15.57:0/3359531474 learned_addr learned my addr 172.21.15.57:0/3359531474 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:03:34.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b37fe700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0b4105ae0 0x7fd0b41a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b27fc700 1 -- 172.21.15.57:0/3359531474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0b40ffad0 msgr2=0x7fd0b4072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0b40ffad0 0x7fd0b4072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b27fc700 1 -- 172.21.15.57:0/3359531474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0b4105ae0 msgr2=0x7fd0b41a3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0b4105ae0 0x7fd0b41a3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.165+0000 7fd0b27fc700 1 -- 172.21.15.57:0/3359531474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80095f0 con 0x7fd0b4100480 2023-03-02T11:03:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.166+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0b4100480 0x7fd0b4072dd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8000c00 tx=0x7fd0a8004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.166+0000 7fd09bfff700 1 -- 172.21.15.57:0/3359531474 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a801d070 con 0x7fd0b4100480 2023-03-02T11:03:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.166+0000 7fd09bfff700 1 -- 172.21.15.57:0/3359531474 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0a8021410 con 0x7fd0b4100480 2023-03-02T11:03:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.166+0000 7fd0b93ff700 1 -- 172.21.15.57:0/3359531474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b410fb70 con 0x7fd0b4100480 2023-03-02T11:03:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.166+0000 7fd09bfff700 1 -- 172.21.15.57:0/3359531474 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8017650 con 0x7fd0b4100480 2023-03-02T11:03:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.166+0000 7fd0b93ff700 1 -- 172.21.15.57:0/3359531474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b410f9e0 con 0x7fd0b4100480 2023-03-02T11:03:34.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.169+0000 7fd09bfff700 1 -- 172.21.15.57:0/3359531474 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fd0a8028030 con 0x7fd0b4100480 2023-03-02T11:03:34.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.170+0000 7fd09bfff700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09c09b500 0x7fd09c09d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.170+0000 7fd09bfff700 1 -- 172.21.15.57:0/3359531474 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fd0a80c62b0 con 0x7fd0b4100480 2023-03-02T11:03:34.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.170+0000 7fd0b2ffd700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09c09b500 0x7fd09c09d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.170+0000 7fd0cccefb80 1 Processor -- start 2023-03-02T11:03:34.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0cccefb80 1 -- start start 2023-03-02T11:03:34.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 0x558d2f193790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f198560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2f0faa60 con 0x558d2f198110 2023-03-02T11:03:34.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2f0acf80 con 0x558d2f1933c0 2023-03-02T11:03:34.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2f07d160 con 0x558d2f193cd0 2023-03-02T11:03:34.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b27fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b2ffd700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09c09b500 0x7fd09c09d9b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009be0 tx=0x7fd0a4009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:34.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39572/0 (socket says 172.21.15.57:39572) 2023-03-02T11:03:34.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b37fe700 1 -- 172.21.15.57:0/4135441138 learned_addr learned my addr 172.21.15.57:0/4135441138 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:03:34.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b2ffd700 1 --2- 172.21.15.57:0/4135441138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 0x558d2f193790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b27fc700 1 -- 172.21.15.57:0/4135441138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 msgr2=0x558d2f193790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:34.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/4135441138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 0x558d2f193790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b27fc700 1 -- 172.21.15.57:0/4135441138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 msgr2=0x558d2f198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:34.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/4135441138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b27fc700 1 -- 172.21.15.57:0/4135441138 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d2ef67630 con 0x558d2f193cd0 2023-03-02T11:03:34.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.171+0000 7fd0b37fe700 1 --2- 172.21.15.57:0/4135441138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:03:34.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.172+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/4135441138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f197bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8091cc0 tx=0x7fd0a80c6240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f54bcc62b1838b5e server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:34.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.172+0000 7fd0997fa700 1 -- 172.21.15.57:0/4135441138 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8095ec0 con 0x558d2f193cd0 2023-03-02T11:03:34.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.172+0000 7fd0997fa700 1 -- 172.21.15.57:0/4135441138 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0a8099150 con 0x558d2f193cd0 2023-03-02T11:03:34.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.172+0000 7fd0997fa700 1 -- 172.21.15.57:0/4135441138 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8095c40 con 0x558d2f193cd0 2023-03-02T11:03:34.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.173+0000 7fd0cccefb80 1 -- 172.21.15.57:0/4135441138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 msgr2=0x558d2f197bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:34.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.173+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/4135441138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f197bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8091cc0 tx=0x7fd0a80c6240 comp rx=0 tx=0).stop 2023-03-02T11:03:34.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.173+0000 7fd0cccefb80 1 -- 172.21.15.57:0/4135441138 shutdown_connections 2023-03-02T11:03:34.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.173+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/4135441138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.173+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/4135441138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 0x558d2f193790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.173+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/4135441138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f197bd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.173+0000 7fd0cccefb80 1 -- 172.21.15.57:0/4135441138 >> 172.21.15.57:0/4135441138 conn(0x558d2f188c50 msgr2=0x558d2f18e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:34.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.173+0000 7fd0cccefb80 1 -- 172.21.15.57:0/4135441138 shutdown_connections 2023-03-02T11:03:34.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.173+0000 7fd0cccefb80 1 -- 172.21.15.57:0/4135441138 wait complete. 2023-03-02T11:03:34.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.173+0000 7fd0cccefb80 1 -- start start 2023-03-02T11:03:34.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.173+0000 7fd0cccefb80 1 Processor -- start 2023-03-02T11:03:34.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f1933c0 0x558d2f19f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f19caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f198110 0x558d2f19d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2f0ebbc0 con 0x558d2f1933c0 2023-03-02T11:03:34.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2f0e50f0 con 0x558d2f198110 2023-03-02T11:03:34.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2ef69920 con 0x558d2f193cd0 2023-03-02T11:03:34.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0cccefb80 10 client.0 _ll_register_callbacks cb 0x558d2f08b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:03:34.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0b2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f1933c0 0x558d2f19f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0b2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f1933c0 0x558d2f19f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39574/0 (socket says 172.21.15.57:39574) 2023-03-02T11:03:34.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0b2ffd700 1 -- 172.21.15.57:0/104413792 learned_addr learned my addr 172.21.15.57:0/104413792 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:03:34.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0b37fe700 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f198110 0x558d2f19d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f19caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0b2ffd700 1 -- 172.21.15.57:0/104413792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 msgr2=0x558d2f19caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:34.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0b2ffd700 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f19caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0b2ffd700 1 -- 172.21.15.57:0/104413792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f198110 msgr2=0x558d2f19d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:34.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0b2ffd700 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f198110 0x558d2f19d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0b2ffd700 1 -- 172.21.15.57:0/104413792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b410f9e0 con 0x558d2f1933c0 2023-03-02T11:03:34.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd0b2ffd700 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f1933c0 0x558d2f19f870 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd0a401f8e0 tx=0x7fd0a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f268d07fb50a063 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:34.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.174+0000 7fd096ff5700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:03:34.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd096ff5700 1 -- 172.21.15.57:0/104413792 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4004260 con 0x558d2f1933c0 2023-03-02T11:03:34.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd0cccefb80 1 -- 172.21.15.57:0/104413792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d2f0b67b0 con 0x558d2f1933c0 2023-03-02T11:03:34.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd096ff5700 1 -- 172.21.15.57:0/104413792 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fd0a40043c0 con 0x558d2f1933c0 2023-03-02T11:03:34.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd096ff5700 1 -- 172.21.15.57:0/104413792 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0a4004580 con 0x558d2f1933c0 2023-03-02T11:03:34.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd0cccefb80 10 client.16323 fetch_fsmap learned FSMap version 47 2023-03-02T11:03:34.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd0cccefb80 1 -- 172.21.15.57:0/104413792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x558d2ef13de0 con 0x558d2f1933c0 2023-03-02T11:03:34.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd096ff5700 1 -- 172.21.15.57:0/104413792 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558d2f0b67b0 con 0x558d2f1933c0 2023-03-02T11:03:34.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd096ff5700 1 -- 172.21.15.57:0/104413792 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd0a4028930 con 0x558d2f1933c0 2023-03-02T11:03:34.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd0cccefb80 10 client.16323 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:03:34.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd0cccefb80 10 client.16323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:03:34.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd0cccefb80 20 client.16323 populate_metadata read hostname 'smithi057' 2023-03-02T11:03:34.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x558d2f1acef0 0x558d2f1af300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd0cccefb80 4 client.16323 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:03:34.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd0cccefb80 1 -- 172.21.15.57:0/104413792 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d2f0de170 con 0x558d2f1acef0 2023-03-02T11:03:34.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.175+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x558d2f1acef0 0x558d2f1af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.176+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x558d2f1acef0 0x558d2f1af300 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d7166288a10ae3f server_cookie=5804386f9a1abf9c in_seq=0 out_seq=0 2023-03-02T11:03:34.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.176+0000 7fd096ff5700 10 client.16323 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:03:34.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.176+0000 7fd096ff5700 1 -- 172.21.15.57:0/104413792 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x558d2f0de170 con 0x558d2f1acef0 2023-03-02T11:03:34.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.176+0000 7fd096ff5700 10 client.16323 handle_command_reply: tid=0 2023-03-02T11:03:34.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.176+0000 7fd0cccefb80 1 client.16323 shutdown 2023-03-02T11:03:34.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd0cccefb80 1 -- 172.21.15.57:0/104413792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f1933c0 msgr2=0x558d2f19f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:34.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f1933c0 0x558d2f19f870 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd0a401f8e0 tx=0x7fd0a40047c0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd0cccefb80 1 -- 172.21.15.57:0/104413792 shutdown_connections 2023-03-02T11:03:34.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x558d2f1acef0 0x558d2f1af300 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f198110 0x558d2f19d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f1933c0 0x558d2f19f870 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd096ff5700 0 client.16323 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:03:34.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/104413792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f19caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd0cccefb80 1 -- 172.21.15.57:0/104413792 >> 172.21.15.57:0/104413792 conn(0x558d2f188c50 msgr2=0x558d2f18e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:34.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd0cccefb80 1 -- 172.21.15.57:0/104413792 shutdown_connections 2023-03-02T11:03:34.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd0cccefb80 1 -- 172.21.15.57:0/104413792 wait complete. 2023-03-02T11:03:34.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.177+0000 7fd0cccefb80 20 client.16323 trim_cache size 0 max 16384 2023-03-02T11:03:34.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.193+0000 7fd0cccefb80 1 Processor -- start 2023-03-02T11:03:34.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.193+0000 7fd0cccefb80 1 -- start start 2023-03-02T11:03:34.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f1933c0 0x558d2f19a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f193cd0 0x558d2f198c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f199190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2f1887d0 con 0x558d2f198110 2023-03-02T11:03:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2f19d630 con 0x558d2f193cd0 2023-03-02T11:03:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2f18f1d0 con 0x558d2f1933c0 2023-03-02T11:03:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b27fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f193cd0 0x558d2f198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39580/0 (socket says 172.21.15.57:39580) 2023-03-02T11:03:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b37fe700 1 -- 172.21.15.57:0/676383117 learned_addr learned my addr 172.21.15.57:0/676383117 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:03:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b27fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f193cd0 0x558d2f198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:35340/0 (socket says 172.21.15.57:35340) 2023-03-02T11:03:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b2ffd700 1 --2- 172.21.15.57:0/676383117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f1933c0 0x558d2f19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b37fe700 1 -- 172.21.15.57:0/676383117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f1933c0 msgr2=0x558d2f19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:34.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b37fe700 1 --2- 172.21.15.57:0/676383117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f1933c0 0x558d2f19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b37fe700 1 -- 172.21.15.57:0/676383117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f193cd0 msgr2=0x558d2f198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:34.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b37fe700 1 --2- 172.21.15.57:0/676383117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f193cd0 0x558d2f198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b37fe700 1 -- 172.21.15.57:0/676383117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d2f18a3f0 con 0x558d2f198110 2023-03-02T11:03:34.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/676383117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f193cd0 0x558d2f198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:03:34.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd0b37fe700 1 --2- 172.21.15.57:0/676383117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f199190 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0158d0 tx=0x7fd0ac009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3607f8e3b51351 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:34.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.194+0000 7fd099ffb700 1 -- 172.21.15.57:0/676383117 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac00e040 con 0x558d2f198110 2023-03-02T11:03:34.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.195+0000 7fd099ffb700 1 -- 172.21.15.57:0/676383117 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0ac00f040 con 0x558d2f198110 2023-03-02T11:03:34.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.195+0000 7fd099ffb700 1 -- 172.21.15.57:0/676383117 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac017590 con 0x558d2f198110 2023-03-02T11:03:34.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.195+0000 7fd0cccefb80 1 -- 172.21.15.57:0/676383117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 msgr2=0x558d2f199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:34.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.195+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/676383117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f199190 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0158d0 tx=0x7fd0ac009920 comp rx=0 tx=0).stop 2023-03-02T11:03:34.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.195+0000 7fd0cccefb80 1 -- 172.21.15.57:0/676383117 shutdown_connections 2023-03-02T11:03:34.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.195+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/676383117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f199190 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.195+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/676383117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f1933c0 0x558d2f19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.195+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/676383117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f193cd0 0x558d2f198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.195+0000 7fd0cccefb80 1 -- 172.21.15.57:0/676383117 >> 172.21.15.57:0/676383117 conn(0x558d2f188c50 msgr2=0x558d2f192a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:34.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.195+0000 7fd0cccefb80 1 -- 172.21.15.57:0/676383117 shutdown_connections 2023-03-02T11:03:34.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.195+0000 7fd0cccefb80 1 -- 172.21.15.57:0/676383117 wait complete. 2023-03-02T11:03:34.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0cccefb80 1 -- start start 2023-03-02T11:03:34.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0cccefb80 1 Processor -- start 2023-03-02T11:03:34.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 0x558d2f19e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0cccefb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f19ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2f19fbf0 con 0x558d2f198110 2023-03-02T11:03:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2f1fe7a0 con 0x558d2f1933c0 2023-03-02T11:03:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0cccefb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2f1fe910 con 0x558d2f193cd0 2023-03-02T11:03:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0cccefb80 10 client.0 _ll_register_callbacks cb 0x558d2f08b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:03:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f19ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b2ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 0x558d2f19e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b2ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 0x558d2f19e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:35348/0 (socket says 172.21.15.57:35348) 2023-03-02T11:03:34.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f19ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39582/0 (socket says 172.21.15.57:39582) 2023-03-02T11:03:34.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b2ffd700 1 -- 172.21.15.57:0/2727388514 learned_addr learned my addr 172.21.15.57:0/2727388514 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:03:34.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b27fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b2ffd700 1 -- 172.21.15.57:0/2727388514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 msgr2=0x558d2f19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:34.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b2ffd700 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b2ffd700 1 -- 172.21.15.57:0/2727388514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 msgr2=0x558d2f19ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:03:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b2ffd700 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f19ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b2ffd700 1 -- 172.21.15.57:0/2727388514 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d2ef67630 con 0x558d2f1933c0 2023-03-02T11:03:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.196+0000 7fd0b37fe700 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f19ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:03:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.197+0000 7fd0b2ffd700 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 0x558d2f19e390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40117d0 tx=0x7fd0a4004ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab6c71990b7cde41 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:03:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.197+0000 7fd096ff5700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:03:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.197+0000 7fd096ff5700 1 -- 172.21.15.57:0/2727388514 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a401d470 con 0x558d2f1933c0 2023-03-02T11:03:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.197+0000 7fd0cccefb80 1 -- 172.21.15.57:0/2727388514 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0a8099150 con 0x558d2f1933c0 2023-03-02T11:03:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.197+0000 7fd096ff5700 1 -- 172.21.15.57:0/2727388514 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fd0a4028440 con 0x558d2f1933c0 2023-03-02T11:03:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.197+0000 7fd096ff5700 1 -- 172.21.15.57:0/2727388514 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0a4028600 con 0x558d2f1933c0 2023-03-02T11:03:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.197+0000 7fd0cccefb80 10 client.26171 fetch_fsmap learned FSMap version 47 2023-03-02T11:03:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.197+0000 7fd0cccefb80 1 -- 172.21.15.57:0/2727388514 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7fd0ac015580 con 0x558d2f1933c0 2023-03-02T11:03:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.197+0000 7fd096ff5700 1 -- 172.21.15.57:0/2727388514 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0a4044080 con 0x558d2f1933c0 2023-03-02T11:03:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd096ff5700 1 -- 172.21.15.57:0/2727388514 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd0a4003680 con 0x558d2f1933c0 2023-03-02T11:03:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd0cccefb80 10 client.26171 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:03:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd0cccefb80 10 client.26171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:03:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd0cccefb80 20 client.26171 populate_metadata read hostname 'smithi057' 2023-03-02T11:03:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x558d2f200040 0x558d2f202450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:03:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd0cccefb80 4 client.26171 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:03:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd0cccefb80 1 -- 172.21.15.57:0/2727388514 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558d2f0dde90 con 0x558d2f200040 2023-03-02T11:03:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x558d2f200040 0x558d2f202450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:34.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd0b27fc700 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x558d2f200040 0x558d2f202450 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35272192e37ea750 server_cookie=9d241169e158b35f in_seq=0 out_seq=0 2023-03-02T11:03:34.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd096ff5700 10 client.26171 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:03:34.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd096ff5700 1 -- 172.21.15.57:0/2727388514 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558d2f0dde90 con 0x558d2f200040 2023-03-02T11:03:34.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd096ff5700 10 client.26171 handle_command_reply: tid=0 2023-03-02T11:03:34.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.198+0000 7fd0cccefb80 1 client.26171 shutdown 2023-03-02T11:03:34.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd0cccefb80 1 -- 172.21.15.57:0/2727388514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 msgr2=0x558d2f19e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:34.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 0x558d2f19e390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40117d0 tx=0x7fd0a4004ae0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd0cccefb80 1 -- 172.21.15.57:0/2727388514 shutdown_connections 2023-03-02T11:03:34.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x558d2f200040 0x558d2f202450 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d2f198110 0x558d2f19ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d2f1933c0 0x558d2f19e390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd096ff5700 0 client.26171 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:03:34.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd0cccefb80 1 --2- 172.21.15.57:0/2727388514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558d2f193cd0 0x558d2f19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd0cccefb80 1 -- 172.21.15.57:0/2727388514 >> 172.21.15.57:0/2727388514 conn(0x558d2f188c50 msgr2=0x558d2f192a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:34.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd0cccefb80 1 -- 172.21.15.57:0/2727388514 shutdown_connections 2023-03-02T11:03:34.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd0cccefb80 1 -- 172.21.15.57:0/2727388514 wait complete. 2023-03-02T11:03:34.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.199+0000 7fd0cccefb80 20 client.26171 trim_cache size 0 max 16384 2023-03-02T11:03:34.211 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:03:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:03:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:03:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:03:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:03:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:03:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:03:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:03:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:03:34.213 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:03:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 -- 172.21.15.57:0/3359531474 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09c09b500 msgr2=0x7fd09c09d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09c09b500 0x7fd09c09d9b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009be0 tx=0x7fd0a4009260 comp rx=0 tx=0).stop 2023-03-02T11:03:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 -- 172.21.15.57:0/3359531474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0b4100480 msgr2=0x7fd0b4072dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:03:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0b4100480 0x7fd0b4072dd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8000c00 tx=0x7fd0a8004790 comp rx=0 tx=0).stop 2023-03-02T11:03:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 -- 172.21.15.57:0/3359531474 shutdown_connections 2023-03-02T11:03:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd09c09b500 0x7fd09c09d9b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0b4105ae0 0x7fd0b41a3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0b40ffad0 0x7fd0b4072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 --2- 172.21.15.57:0/3359531474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0b4100480 0x7fd0b4072dd0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:03:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 -- 172.21.15.57:0/3359531474 >> 172.21.15.57:0/3359531474 conn(0x7fd0b40fb610 msgr2=0x7fd0b40fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:03:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 -- 172.21.15.57:0/3359531474 shutdown_connections 2023-03-02T11:03:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:03:34.200+0000 7fd0b93ff700 1 -- 172.21.15.57:0/3359531474 wait complete. 2023-03-02T11:03:34.217 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:03:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:34 smithi057 ceph-mon[92072]: pgmap v201: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:03:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:34 smithi122 ceph-mon[125440]: pgmap v201: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:03:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:34 smithi136 ceph-mon[125702]: pgmap v201: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:03:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:36 smithi057 ceph-mon[92072]: pgmap v202: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:36 smithi122 ceph-mon[125440]: pgmap v202: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:36 smithi136 ceph-mon[125702]: pgmap v202: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:38 smithi057 ceph-mon[92072]: pgmap v203: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:38 smithi122 ceph-mon[125440]: pgmap v203: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:38 smithi136 ceph-mon[125702]: pgmap v203: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:40 smithi057 ceph-mon[92072]: pgmap v204: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:40 smithi122 ceph-mon[125440]: pgmap v204: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:40 smithi136 ceph-mon[125702]: pgmap v204: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:42 smithi057 ceph-mon[92072]: pgmap v205: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:42 smithi122 ceph-mon[125440]: pgmap v205: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:42 smithi136 ceph-mon[125702]: pgmap v205: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:44 smithi057 ceph-mon[92072]: pgmap v206: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:03:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:44 smithi122 ceph-mon[125440]: pgmap v206: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:03:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:44 smithi136 ceph-mon[125702]: pgmap v206: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:03:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:46 smithi057 ceph-mon[92072]: pgmap v207: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:46 smithi122 ceph-mon[125440]: pgmap v207: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:46 smithi136 ceph-mon[125702]: pgmap v207: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:48 smithi057 ceph-mon[92072]: pgmap v208: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:48 smithi122 ceph-mon[125440]: pgmap v208: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:48 smithi136 ceph-mon[125702]: pgmap v208: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:49.051+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:03:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:49.052+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:03:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:49.052+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:03:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:49.052+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:03:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:03:49.052+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:03:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:50 smithi057 ceph-mon[92072]: pgmap v209: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:50 smithi122 ceph-mon[125440]: pgmap v209: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:50 smithi136 ceph-mon[125702]: pgmap v209: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:03:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:52 smithi057 ceph-mon[92072]: pgmap v210: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:52 smithi122 ceph-mon[125440]: pgmap v210: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:52 smithi136 ceph-mon[125702]: pgmap v210: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:54 smithi057 ceph-mon[92072]: pgmap v211: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:03:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:54 smithi122 ceph-mon[125440]: pgmap v211: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:03:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:54 smithi136 ceph-mon[125702]: pgmap v211: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:03:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:56 smithi122 ceph-mon[125440]: pgmap v212: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:56 smithi136 ceph-mon[125702]: pgmap v212: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:56 smithi057 ceph-mon[92072]: pgmap v212: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:03:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:03:58 smithi122 ceph-mon[125440]: pgmap v213: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:03:58 smithi136 ceph-mon[125702]: pgmap v213: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:03:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:03:58 smithi057 ceph-mon[92072]: pgmap v213: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:04:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:00 smithi122 ceph-mon[125440]: pgmap v214: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:04:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:00 smithi136 ceph-mon[125702]: pgmap v214: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:04:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:00 smithi057 ceph-mon[92072]: pgmap v214: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:04:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:02 smithi122 ceph-mon[125440]: pgmap v215: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:02 smithi136 ceph-mon[125702]: pgmap v215: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:02 smithi057 ceph-mon[92072]: pgmap v215: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:04.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:04.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:04:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:04.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:04:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:04.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:04:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:04.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:04:04.218 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:04:04.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.388+0000 7fc90ebff700 1 -- 172.21.15.57:0/106795513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9080fe9b0 msgr2=0x7fc9080fee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:04.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.388+0000 7fc90ebff700 1 --2- 172.21.15.57:0/106795513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9080fe9b0 0x7fc9080fee20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009990 tx=0x7fc8f4009ca0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.388+0000 7fc90ebff700 1 -- 172.21.15.57:0/106795513 shutdown_connections 2023-03-02T11:04:04.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.388+0000 7fc90ebff700 1 --2- 172.21.15.57:0/106795513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9080ff360 0x7fc90810b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.388+0000 7fc90ebff700 1 --2- 172.21.15.57:0/106795513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9081049c0 0x7fc908104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.388+0000 7fc90ebff700 1 --2- 172.21.15.57:0/106795513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9080fe9b0 0x7fc9080fee20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.388+0000 7fc90ebff700 1 -- 172.21.15.57:0/106795513 >> 172.21.15.57:0/106795513 conn(0x7fc9080fa4b0 msgr2=0x7fc9080fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:04.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.388+0000 7fc90ebff700 1 -- 172.21.15.57:0/106795513 shutdown_connections 2023-03-02T11:04:04.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.388+0000 7fc90ebff700 1 -- 172.21.15.57:0/106795513 wait complete. 2023-03-02T11:04:04.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90ebff700 1 Processor -- start 2023-03-02T11:04:04.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90ebff700 1 -- start start 2023-03-02T11:04:04.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90ebff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9080fe9b0 0x7fc9081005c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90ebff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9080ff360 0x7fc908100b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90ebff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9081049c0 0x7fc9081a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90ebff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc908101330 con 0x7fc9081049c0 2023-03-02T11:04:04.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90ebff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9081a42c0 con 0x7fc9080fe9b0 2023-03-02T11:04:04.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90ebff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9081a4400 con 0x7fc9080ff360 2023-03-02T11:04:04.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90c99b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9080fe9b0 0x7fc9081005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90c99b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9080fe9b0 0x7fc9081005c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33008/0 (socket says 172.21.15.57:33008) 2023-03-02T11:04:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90c99b700 1 -- 172.21.15.57:0/544910110 learned_addr learned my addr 172.21.15.57:0/544910110 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:04:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc907fff700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9080ff360 0x7fc908100b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.389+0000 7fc90d19c700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9081049c0 0x7fc9081a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc90c99b700 1 -- 172.21.15.57:0/544910110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9080ff360 msgr2=0x7fc908100b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc90c99b700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9080ff360 0x7fc908100b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc90c99b700 1 -- 172.21.15.57:0/544910110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9081049c0 msgr2=0x7fc9081a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:04.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc90c99b700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9081049c0 0x7fc9081a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc90c99b700 1 -- 172.21.15.57:0/544910110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc009520 con 0x7fc9080fe9b0 2023-03-02T11:04:04.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc907fff700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9080ff360 0x7fc908100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:04:04.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc90c99b700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9080fe9b0 0x7fc9081005c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00ea50 tx=0x7fc8fc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:04.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc905ffb700 1 -- 172.21.15.57:0/544910110 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc00cbd0 con 0x7fc9080fe9b0 2023-03-02T11:04:04.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc90ebff700 1 -- 172.21.15.57:0/544910110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f40095f0 con 0x7fc9080fe9b0 2023-03-02T11:04:04.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc905ffb700 1 -- 172.21.15.57:0/544910110 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8fc00cd30 con 0x7fc9080fe9b0 2023-03-02T11:04:04.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc905ffb700 1 -- 172.21.15.57:0/544910110 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc018680 con 0x7fc9080fe9b0 2023-03-02T11:04:04.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.390+0000 7fc90ebff700 1 -- 172.21.15.57:0/544910110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90810e9f0 con 0x7fc9080fe9b0 2023-03-02T11:04:04.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.394+0000 7fc905ffb700 1 -- 172.21.15.57:0/544910110 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fc8fc00c040 con 0x7fc9080fe9b0 2023-03-02T11:04:04.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc9225a4b80 1 Processor -- start 2023-03-02T11:04:04.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc905ffb700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc8f809b480 0x7fc8f809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc9225a4b80 1 -- start start 2023-03-02T11:04:04.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc905ffb700 1 -- 172.21.15.57:0/544910110 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fc8fc014070 con 0x7fc9080fe9b0 2023-03-02T11:04:04.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc90d19c700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc8f809b480 0x7fc8f809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff2e3c0 0x55d6bff2e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2ecd0 0x55d6bff32bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff33110 0x55d6bff33560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bfe95a60 con 0x55d6bff33110 2023-03-02T11:04:04.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bfe47f80 con 0x55d6bff2ecd0 2023-03-02T11:04:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bfe18160 con 0x55d6bff2e3c0 2023-03-02T11:04:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc90c99b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff2e3c0 0x55d6bff2e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc90c99b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff2e3c0 0x55d6bff2e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:35484/0 (socket says 172.21.15.57:35484) 2023-03-02T11:04:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc90c99b700 1 -- 172.21.15.57:0/3985236553 learned_addr learned my addr 172.21.15.57:0/3985236553 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:04:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc90d19c700 1 --2- 172.21.15.57:0/3985236553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff33110 0x55d6bff33560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.395+0000 7fc907fff700 1 --2- 172.21.15.57:0/3985236553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2ecd0 0x55d6bff32bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.396+0000 7fc90c99b700 1 -- 172.21.15.57:0/3985236553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2ecd0 msgr2=0x55d6bff32bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.396+0000 7fc90c99b700 1 --2- 172.21.15.57:0/3985236553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2ecd0 0x55d6bff32bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.396+0000 7fc90c99b700 1 -- 172.21.15.57:0/3985236553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff33110 msgr2=0x55d6bff33560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.396+0000 7fc90c99b700 1 --2- 172.21.15.57:0/3985236553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff33110 0x55d6bff33560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.396+0000 7fc90c99b700 1 -- 172.21.15.57:0/3985236553 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6bfd02630 con 0x55d6bff2e3c0 2023-03-02T11:04:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.396+0000 7fc90d19c700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc8f809b480 0x7fc8f809d930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc9081026d0 tx=0x7fc90000fc00 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.396+0000 7fc90c99b700 1 --2- 172.21.15.57:0/3985236553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff2e3c0 0x55d6bff2e790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00f010 tx=0x7fc8fc005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e658b714fb58697c server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.396+0000 7fc8f2ffd700 1 -- 172.21.15.57:0/3985236553 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0ab070 con 0x55d6bff2e3c0 2023-03-02T11:04:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.396+0000 7fc8f2ffd700 1 -- 172.21.15.57:0/3985236553 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8fc094ae0 con 0x55d6bff2e3c0 2023-03-02T11:04:04.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.396+0000 7fc8f2ffd700 1 -- 172.21.15.57:0/3985236553 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc093fd0 con 0x55d6bff2e3c0 2023-03-02T11:04:04.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.397+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3985236553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff2e3c0 msgr2=0x55d6bff2e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:04.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.397+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/3985236553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff2e3c0 0x55d6bff2e790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00f010 tx=0x7fc8fc005760 comp rx=0 tx=0).stop 2023-03-02T11:04:04.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.397+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3985236553 shutdown_connections 2023-03-02T11:04:04.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.397+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/3985236553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff33110 0x55d6bff33560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.397+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/3985236553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff2e3c0 0x55d6bff2e790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.397+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/3985236553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2ecd0 0x55d6bff32bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.397+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3985236553 >> 172.21.15.57:0/3985236553 conn(0x55d6bff23c50 msgr2=0x55d6bff29460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:04.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.397+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3985236553 shutdown_connections 2023-03-02T11:04:04.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.397+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3985236553 wait complete. 2023-03-02T11:04:04.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.397+0000 7fc9225a4b80 1 -- start start 2023-03-02T11:04:04.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.397+0000 7fc9225a4b80 1 Processor -- start 2023-03-02T11:04:04.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 0x55d6bff37cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2ecd0 0x55d6bff381f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff33110 0x55d6bff38730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bfe86bc0 con 0x55d6bff2e3c0 2023-03-02T11:04:04.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bfe800f0 con 0x55d6bff2ecd0 2023-03-02T11:04:04.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bfd04920 con 0x55d6bff33110 2023-03-02T11:04:04.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc9225a4b80 10 client.0 _ll_register_callbacks cb 0x55d6bfe26520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:04:04.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc90c99b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 0x55d6bff37cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc90c99b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 0x55d6bff37cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41388/0 (socket says 172.21.15.57:41388) 2023-03-02T11:04:04.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc90c99b700 1 -- 172.21.15.57:0/1354133024 learned_addr learned my addr 172.21.15.57:0/1354133024 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:04:04.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc90d19c700 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff33110 0x55d6bff38730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc907fff700 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2ecd0 0x55d6bff381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc90c99b700 1 -- 172.21.15.57:0/1354133024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff33110 msgr2=0x55d6bff38730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:04.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc90c99b700 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff33110 0x55d6bff38730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc90c99b700 1 -- 172.21.15.57:0/1354133024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2ecd0 msgr2=0x55d6bff381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:04.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc90c99b700 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2ecd0 0x55d6bff381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc90c99b700 1 -- 172.21.15.57:0/1354133024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90810e9f0 con 0x55d6bff2e3c0 2023-03-02T11:04:04.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc90c99b700 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 0x55d6bff37cb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00c5b0 tx=0x7fc8fc094340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7889e28166c581d2 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:04.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.398+0000 7fc8e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:04:04.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc8e7fff700 1 -- 172.21.15.57:0/1354133024 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0ab070 con 0x55d6bff2e3c0 2023-03-02T11:04:04.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc8e7fff700 1 -- 172.21.15.57:0/1354133024 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fc8fc09c200 con 0x55d6bff2e3c0 2023-03-02T11:04:04.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc9225a4b80 1 -- 172.21.15.57:0/1354133024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6bfe517b0 con 0x55d6bff2e3c0 2023-03-02T11:04:04.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc8e7fff700 1 -- 172.21.15.57:0/1354133024 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8fc0ac270 con 0x55d6bff2e3c0 2023-03-02T11:04:04.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc9225a4b80 10 client.16341 fetch_fsmap learned FSMap version 47 2023-03-02T11:04:04.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc9225a4b80 1 -- 172.21.15.57:0/1354133024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55d6bfcaede0 con 0x55d6bff2e3c0 2023-03-02T11:04:04.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc8e7fff700 1 -- 172.21.15.57:0/1354133024 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d6bfe517b0 con 0x55d6bff2e3c0 2023-03-02T11:04:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc8e7fff700 1 -- 172.21.15.57:0/1354133024 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc8fc095b80 con 0x55d6bff2e3c0 2023-03-02T11:04:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc9225a4b80 10 client.16341 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:04:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc9225a4b80 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:04:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc9225a4b80 20 client.16341 populate_metadata read hostname 'smithi057' 2023-03-02T11:04:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d6bff47f80 0x55d6bff4a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc9225a4b80 4 client.16341 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:04:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc9225a4b80 1 -- 172.21.15.57:0/1354133024 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6bfe79170 con 0x55d6bff47f80 2023-03-02T11:04:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.399+0000 7fc907fff700 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d6bff47f80 0x55d6bff4a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.400+0000 7fc8e7fff700 10 client.16341 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:04:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.400+0000 7fc907fff700 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d6bff47f80 0x55d6bff4a390 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5357daed0c6deb98 server_cookie=6b4b62a51746a8ff in_seq=0 out_seq=0 2023-03-02T11:04:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc8e7fff700 1 -- 172.21.15.57:0/1354133024 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55d6bfe79170 con 0x55d6bff47f80 2023-03-02T11:04:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc8e7fff700 10 client.16341 handle_command_reply: tid=0 2023-03-02T11:04:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 1 client.16341 shutdown 2023-03-02T11:04:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 1 -- 172.21.15.57:0/1354133024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 msgr2=0x55d6bff37cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 0x55d6bff37cb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00c5b0 tx=0x7fc8fc094340 comp rx=0 tx=0).stop 2023-03-02T11:04:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 1 -- 172.21.15.57:0/1354133024 shutdown_connections 2023-03-02T11:04:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d6bff47f80 0x55d6bff4a390 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff33110 0x55d6bff38730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc8e7fff700 0 client.16341 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:04:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 0x55d6bff37cb0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/1354133024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2ecd0 0x55d6bff381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 1 -- 172.21.15.57:0/1354133024 >> 172.21.15.57:0/1354133024 conn(0x55d6bff23c50 msgr2=0x55d6bff29050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:04.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 1 -- 172.21.15.57:0/1354133024 shutdown_connections 2023-03-02T11:04:04.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 1 -- 172.21.15.57:0/1354133024 wait complete. 2023-03-02T11:04:04.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.401+0000 7fc9225a4b80 20 client.16341 trim_cache size 0 max 16384 2023-03-02T11:04:04.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc9225a4b80 1 Processor -- start 2023-03-02T11:04:04.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc9225a4b80 1 -- start start 2023-03-02T11:04:04.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff28a00 0x55d6bff30a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 0x55d6bff38560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2e3c0 0x55d6bff32250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bff237d0 con 0x55d6bff28a00 2023-03-02T11:04:04.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bff29fa0 con 0x55d6bff2e3c0 2023-03-02T11:04:04.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bff31b80 con 0x55d6bff23c50 2023-03-02T11:04:04.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc90c99b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff28a00 0x55d6bff30a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc907fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 0x55d6bff38560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc907fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 0x55d6bff38560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:35510/0 (socket says 172.21.15.57:35510) 2023-03-02T11:04:04.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc907fff700 1 -- 172.21.15.57:0/201877989 learned_addr learned my addr 172.21.15.57:0/201877989 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:04:04.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc90d19c700 1 --2- 172.21.15.57:0/201877989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2e3c0 0x55d6bff32250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc90c99b700 1 -- 172.21.15.57:0/201877989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 msgr2=0x55d6bff38560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:04.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc90c99b700 1 --2- 172.21.15.57:0/201877989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 0x55d6bff38560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc90c99b700 1 -- 172.21.15.57:0/201877989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2e3c0 msgr2=0x55d6bff32250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:04.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.418+0000 7fc90c99b700 1 --2- 172.21.15.57:0/201877989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2e3c0 0x55d6bff32250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc90c99b700 1 -- 172.21.15.57:0/201877989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6bfe47190 con 0x55d6bff28a00 2023-03-02T11:04:04.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc90c99b700 1 --2- 172.21.15.57:0/201877989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff28a00 0x55d6bff30a00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc091550 tx=0x7fc8fc093090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f019fd23b4101f2e server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:04.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc8f37fe700 1 -- 172.21.15.57:0/201877989 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0ab020 con 0x55d6bff28a00 2023-03-02T11:04:04.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc8f37fe700 1 -- 172.21.15.57:0/201877989 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8fc0c31a0 con 0x55d6bff28a00 2023-03-02T11:04:04.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc8f37fe700 1 -- 172.21.15.57:0/201877989 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0909f0 con 0x55d6bff28a00 2023-03-02T11:04:04.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc9225a4b80 1 -- 172.21.15.57:0/201877989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff28a00 msgr2=0x55d6bff30a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:04.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/201877989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff28a00 0x55d6bff30a00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc091550 tx=0x7fc8fc093090 comp rx=0 tx=0).stop 2023-03-02T11:04:04.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc9225a4b80 1 -- 172.21.15.57:0/201877989 shutdown_connections 2023-03-02T11:04:04.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/201877989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff2e3c0 0x55d6bff32250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/201877989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff28a00 0x55d6bff30a00 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/201877989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 0x55d6bff38560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc9225a4b80 1 -- 172.21.15.57:0/201877989 >> 172.21.15.57:0/201877989 conn(0x55d6bff35850 msgr2=0x55d6bff437e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:04.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.419+0000 7fc9225a4b80 1 -- 172.21.15.57:0/201877989 shutdown_connections 2023-03-02T11:04:04.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.420+0000 7fc9225a4b80 1 -- 172.21.15.57:0/201877989 wait complete. 2023-03-02T11:04:04.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.420+0000 7fc9225a4b80 1 -- start start 2023-03-02T11:04:04.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.420+0000 7fc9225a4b80 1 Processor -- start 2023-03-02T11:04:04.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.420+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 0x55d6bff3d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff28a00 0x55d6bff3dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc9225a4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 0x55d6bff3e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bff99970 con 0x55d6bff2e3c0 2023-03-02T11:04:04.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bff99ae0 con 0x55d6bff28a00 2023-03-02T11:04:04.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc9225a4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6bff99ca0 con 0x55d6bff23c50 2023-03-02T11:04:04.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc9225a4b80 10 client.0 _ll_register_callbacks cb 0x55d6bfe26520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:04:04.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc90c99b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 0x55d6bff3d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc907fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff28a00 0x55d6bff3dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc907fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff28a00 0x55d6bff3dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33038/0 (socket says 172.21.15.57:33038) 2023-03-02T11:04:04.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc90c99b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 0x55d6bff3d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:35524/0 (socket says 172.21.15.57:35524) 2023-03-02T11:04:04.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc90d19c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 0x55d6bff3e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc907fff700 1 -- 172.21.15.57:0/3929933953 learned_addr learned my addr 172.21.15.57:0/3929933953 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:04:04.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc907fff700 1 -- 172.21.15.57:0/3929933953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 msgr2=0x55d6bff3d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:04.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc907fff700 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 0x55d6bff3d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc907fff700 1 -- 172.21.15.57:0/3929933953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 msgr2=0x55d6bff3e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:04.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc907fff700 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 0x55d6bff3e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc907fff700 1 -- 172.21.15.57:0/3929933953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6bfcaede0 con 0x55d6bff28a00 2023-03-02T11:04:04.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc90c99b700 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 0x55d6bff3d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:04:04.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc907fff700 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff28a00 0x55d6bff3dea0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4000c00 tx=0x7fc8f400be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84aa8c311f0becca server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:04.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.421+0000 7fc8e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:04:04.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc8e7fff700 1 -- 172.21.15.57:0/3929933953 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f401d040 con 0x55d6bff28a00 2023-03-02T11:04:04.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3929933953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6bff28dd0 con 0x55d6bff28a00 2023-03-02T11:04:04.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc8e7fff700 1 -- 172.21.15.57:0/3929933953 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8598+0+0 (secure 0 0 0) 0x7fc8f40292c0 con 0x55d6bff28a00 2023-03-02T11:04:04.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc8e7fff700 1 -- 172.21.15.57:0/3929933953 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8f4029a40 con 0x55d6bff28a00 2023-03-02T11:04:04.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc9225a4b80 10 client.26189 fetch_fsmap learned FSMap version 47 2023-03-02T11:04:04.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3929933953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55d6bfcd5250 con 0x55d6bff28a00 2023-03-02T11:04:04.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc8e7fff700 1 -- 172.21.15.57:0/3929933953 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d6bff28dd0 con 0x55d6bff28a00 2023-03-02T11:04:04.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc8e7fff700 1 -- 172.21.15.57:0/3929933953 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc8f4004620 con 0x55d6bff28a00 2023-03-02T11:04:04.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc9225a4b80 10 client.26189 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:04:04.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc9225a4b80 10 client.26189 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:04:04.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc9225a4b80 20 client.26189 populate_metadata read hostname 'smithi057' 2023-03-02T11:04:04.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d6bff2ecd0 0x55d6bff9d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:04.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc9225a4b80 4 client.26189 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:04:04.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3929933953 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7fc8fc094ae0 con 0x55d6bff2ecd0 2023-03-02T11:04:04.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.422+0000 7fc90c99b700 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d6bff2ecd0 0x55d6bff9d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:04.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc8e7fff700 10 client.26189 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:04:04.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc90c99b700 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d6bff2ecd0 0x55d6bff9d310 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d759c0cf2db8bb1 server_cookie=7ffe2aa00f4a3f6e in_seq=0 out_seq=0 2023-03-02T11:04:04.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc8e7fff700 1 -- 172.21.15.57:0/3929933953 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x7fc8fc094ae0 con 0x55d6bff2ecd0 2023-03-02T11:04:04.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc8e7fff700 10 client.26189 handle_command_reply: tid=0 2023-03-02T11:04:04.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 1 client.26189 shutdown 2023-03-02T11:04:04.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3929933953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff28a00 msgr2=0x55d6bff3dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:04.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff28a00 0x55d6bff3dea0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4000c00 tx=0x7fc8f400be60 comp rx=0 tx=0).stop 2023-03-02T11:04:04.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3929933953 shutdown_connections 2023-03-02T11:04:04.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d6bff2ecd0 0x55d6bff9d310 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d6bff2e3c0 0x55d6bff3e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc8e7fff700 0 client.26189 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:04:04.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6bff23c50 0x55d6bff3d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 1 --2- 172.21.15.57:0/3929933953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d6bff28a00 0x55d6bff3dea0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3929933953 >> 172.21.15.57:0/3929933953 conn(0x55d6bff35850 msgr2=0x55d6bff32250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:04.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3929933953 shutdown_connections 2023-03-02T11:04:04.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 1 -- 172.21.15.57:0/3929933953 wait complete. 2023-03-02T11:04:04.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.423+0000 7fc9225a4b80 20 client.26189 trim_cache size 0 max 16384 2023-03-02T11:04:04.434 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:04:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:04:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:04:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:04:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:04:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:04:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:04:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:04:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:04:04.436 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:04:04.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 -- 172.21.15.57:0/544910110 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc8f809b480 msgr2=0x7fc8f809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:04.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc8f809b480 0x7fc8f809d930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc9081026d0 tx=0x7fc90000fc00 comp rx=0 tx=0).stop 2023-03-02T11:04:04.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 -- 172.21.15.57:0/544910110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9080fe9b0 msgr2=0x7fc9081005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:04.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9080fe9b0 0x7fc9081005c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00ea50 tx=0x7fc8fc00ed60 comp rx=0 tx=0).stop 2023-03-02T11:04:04.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 -- 172.21.15.57:0/544910110 shutdown_connections 2023-03-02T11:04:04.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc8f809b480 0x7fc8f809d930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9081049c0 0x7fc9081a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9080fe9b0 0x7fc9081005c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 --2- 172.21.15.57:0/544910110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9080ff360 0x7fc908100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:04.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 -- 172.21.15.57:0/544910110 >> 172.21.15.57:0/544910110 conn(0x7fc9080fa4b0 msgr2=0x7fc9080fbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:04.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 -- 172.21.15.57:0/544910110 shutdown_connections 2023-03-02T11:04:04.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:04.424+0000 7fc90ebff700 1 -- 172.21.15.57:0/544910110 wait complete. 2023-03-02T11:04:04.439 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:04:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:04 smithi122 ceph-mon[125440]: pgmap v216: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:04:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:04 smithi136 ceph-mon[125702]: pgmap v216: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:04:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:04 smithi057 ceph-mon[92072]: pgmap v216: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:04:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:06 smithi136 ceph-mon[125702]: pgmap v217: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:04:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:06 smithi057 ceph-mon[92072]: pgmap v217: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:04:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:06 smithi122 ceph-mon[125440]: pgmap v217: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:04:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:08 smithi136 ceph-mon[125702]: pgmap v218: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:04:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:08 smithi057 ceph-mon[92072]: pgmap v218: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:04:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:08 smithi122 ceph-mon[125440]: pgmap v218: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:04:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:10 smithi136 ceph-mon[125702]: pgmap v219: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:04:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:10 smithi057 ceph-mon[92072]: pgmap v219: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:04:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:10 smithi122 ceph-mon[125440]: pgmap v219: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:04:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:11 smithi136 ceph-mon[125702]: osdmap e90: 12 total, 12 up, 12 in 2023-03-02T11:04:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:11 smithi057 ceph-mon[92072]: osdmap e90: 12 total, 12 up, 12 in 2023-03-02T11:04:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:11 smithi122 ceph-mon[125440]: osdmap e90: 12 total, 12 up, 12 in 2023-03-02T11:04:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:12 smithi136 ceph-mon[125702]: pgmap v221: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:04:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:12 smithi057 ceph-mon[92072]: pgmap v221: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:04:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:12 smithi122 ceph-mon[125440]: pgmap v221: 97 pgs: 97 active+clean; 14 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:04:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:14 smithi136 ceph-mon[125702]: pgmap v222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:04:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:04:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:14 smithi136 ceph-mon[125702]: osdmap e91: 12 total, 12 up, 12 in 2023-03-02T11:04:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:14 smithi057 ceph-mon[92072]: pgmap v222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:04:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:04:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:14 smithi057 ceph-mon[92072]: osdmap e91: 12 total, 12 up, 12 in 2023-03-02T11:04:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:14 smithi122 ceph-mon[125440]: pgmap v222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:04:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:04:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:14 smithi122 ceph-mon[125440]: osdmap e91: 12 total, 12 up, 12 in 2023-03-02T11:04:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:04:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:04:15.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:04:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:04:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:04:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:04:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:04:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:04:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:04:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:16 smithi136 ceph-mon[125702]: pgmap v224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:04:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:16 smithi057 ceph-mon[92072]: pgmap v224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:04:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:16 smithi122 ceph-mon[125440]: pgmap v224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:04:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:18 smithi136 ceph-mon[125702]: pgmap v225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:04:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:18 smithi057 ceph-mon[92072]: pgmap v225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:04:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:18 smithi122 ceph-mon[125440]: pgmap v225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:04:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:19.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:19.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:04:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:19.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:04:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:19.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:04:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:19.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:04:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:20 smithi136 ceph-mon[125702]: pgmap v226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T11:04:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:20 smithi057 ceph-mon[92072]: pgmap v226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T11:04:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:20 smithi122 ceph-mon[125440]: pgmap v226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T11:04:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:22 smithi136 ceph-mon[125702]: pgmap v227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:04:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:22 smithi057 ceph-mon[92072]: pgmap v227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:04:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:22 smithi122 ceph-mon[125440]: pgmap v227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:04:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:24 smithi136 ceph-mon[125702]: pgmap v228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:04:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:24 smithi057 ceph-mon[92072]: pgmap v228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:04:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:24 smithi122 ceph-mon[125440]: pgmap v228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:04:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:26 smithi136 ceph-mon[125702]: pgmap v229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:04:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:26 smithi057 ceph-mon[92072]: pgmap v229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:04:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:26 smithi122 ceph-mon[125440]: pgmap v229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:04:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:28 smithi136 ceph-mon[125702]: pgmap v230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:04:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:28 smithi057 ceph-mon[92072]: pgmap v230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:04:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:28 smithi122 ceph-mon[125440]: pgmap v230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:04:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:30 smithi136 ceph-mon[125702]: pgmap v231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:04:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:30 smithi057 ceph-mon[92072]: pgmap v231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:04:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:30 smithi122 ceph-mon[125440]: pgmap v231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:04:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:32 smithi136 ceph-mon[125702]: pgmap v232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:32 smithi057 ceph-mon[92072]: pgmap v232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:32 smithi122 ceph-mon[125440]: pgmap v232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:34.068+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:34.068+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:04:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:34.068+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:04:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:34.068+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:04:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:34.068+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:04:34.441 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:04:34.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.614+0000 7f1cb15ff700 1 -- 172.21.15.57:0/2344070504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cac1049c0 msgr2=0x7f1cac104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:34.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.614+0000 7f1cb15ff700 1 --2- 172.21.15.57:0/2344070504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cac1049c0 0x7f1cac104d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009990 tx=0x7f1c9c009ca0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.614+0000 7f1cb15ff700 1 -- 172.21.15.57:0/2344070504 shutdown_connections 2023-03-02T11:04:34.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.614+0000 7f1cb15ff700 1 --2- 172.21.15.57:0/2344070504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cac0ff360 0x7f1cac10b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.614+0000 7f1cb15ff700 1 --2- 172.21.15.57:0/2344070504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cac1049c0 0x7f1cac104d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.614+0000 7f1cb15ff700 1 --2- 172.21.15.57:0/2344070504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cac0fe9b0 0x7f1cac0fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.614+0000 7f1cb15ff700 1 -- 172.21.15.57:0/2344070504 >> 172.21.15.57:0/2344070504 conn(0x7f1cac0fa4b0 msgr2=0x7f1cac0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:34.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.614+0000 7f1cb15ff700 1 -- 172.21.15.57:0/2344070504 shutdown_connections 2023-03-02T11:04:34.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.614+0000 7f1cb15ff700 1 -- 172.21.15.57:0/2344070504 wait complete. 2023-03-02T11:04:34.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.614+0000 7f1cb15ff700 1 Processor -- start 2023-03-02T11:04:34.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1cb15ff700 1 -- start start 2023-03-02T11:04:34.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1cb15ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cac0fe9b0 0x7f1cac19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1cb15ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cac0ff360 0x7f1cac19bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1cb15ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cac1049c0 0x7f1cac195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1cb15ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac196080 con 0x7f1cac0ff360 2023-03-02T11:04:34.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1cb15ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac1961f0 con 0x7f1cac0fe9b0 2023-03-02T11:04:34.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1cb15ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac1963b0 con 0x7f1cac1049c0 2023-03-02T11:04:34.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1ca27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cac0ff360 0x7f1cac19bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1caaffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cac0fe9b0 0x7f1cac19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1caaffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cac0fe9b0 0x7f1cac19b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:58626/0 (socket says 172.21.15.57:58626) 2023-03-02T11:04:34.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1caaffd700 1 -- 172.21.15.57:0/1114174093 learned_addr learned my addr 172.21.15.57:0/1114174093 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:04:34.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1cab7fe700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cac1049c0 0x7f1cac195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1ca27fc700 1 -- 172.21.15.57:0/1114174093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cac1049c0 msgr2=0x7f1cac195a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:34.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cac1049c0 0x7f1cac195a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1ca27fc700 1 -- 172.21.15.57:0/1114174093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cac0fe9b0 msgr2=0x7f1cac19b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:34.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cac0fe9b0 0x7f1cac19b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1ca27fc700 1 -- 172.21.15.57:0/1114174093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c0095f0 con 0x7f1cac0ff360 2023-03-02T11:04:34.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.615+0000 7f1caaffd700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cac0fe9b0 0x7f1cac19b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:04:34.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.616+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cac0ff360 0x7f1cac19bee0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400e9f0 tx=0x7f1c9400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:34.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.616+0000 7f1ca8ff9700 1 -- 172.21.15.57:0/1114174093 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400c9c0 con 0x7f1cac0ff360 2023-03-02T11:04:34.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.616+0000 7f1ca8ff9700 1 -- 172.21.15.57:0/1114174093 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c94010430 con 0x7f1cac0ff360 2023-03-02T11:04:34.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.616+0000 7f1cb15ff700 1 -- 172.21.15.57:0/1114174093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac10e9f0 con 0x7f1cac0ff360 2023-03-02T11:04:34.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.616+0000 7f1ca8ff9700 1 -- 172.21.15.57:0/1114174093 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94018680 con 0x7f1cac0ff360 2023-03-02T11:04:34.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.616+0000 7f1cb15ff700 1 -- 172.21.15.57:0/1114174093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac10e860 con 0x7f1cac0ff360 2023-03-02T11:04:34.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.618+0000 7f1ca8ff9700 1 -- 172.21.15.57:0/1114174093 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f1c9400c040 con 0x7f1cac0ff360 2023-03-02T11:04:34.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.619+0000 7f1ca8ff9700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f1c9809b480 0x7f1c9809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.619+0000 7f1ca8ff9700 1 -- 172.21.15.57:0/1114174093 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f1c94014070 con 0x7f1cac0ff360 2023-03-02T11:04:34.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.619+0000 7f1caaffd700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f1c9809b480 0x7f1c9809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1cc4e41b80 1 Processor -- start 2023-03-02T11:04:34.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1cc4e41b80 1 -- start start 2023-03-02T11:04:34.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1caaffd700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f1c9809b480 0x7f1c9809d930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00b6f0 tx=0x7f1c9c005bc0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:34.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f43c0 0x559eaa9f4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f4cd0 0x559eaa9f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f9110 0x559eaa9f9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaa95ba60 con 0x559eaa9f4cd0 2023-03-02T11:04:34.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaa90df80 con 0x559eaa9f9110 2023-03-02T11:04:34.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaa8de160 con 0x559eaa9f43c0 2023-03-02T11:04:34.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1caaffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f43c0 0x559eaa9f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1ca27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f4cd0 0x559eaa9f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1cab7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f9110 0x559eaa9f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1caaffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f43c0 0x559eaa9f4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:41180/0 (socket says 172.21.15.57:41180) 2023-03-02T11:04:34.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.620+0000 7f1caaffd700 1 -- 172.21.15.57:0/548150931 learned_addr learned my addr 172.21.15.57:0/548150931 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:04:34.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.621+0000 7f1caaffd700 1 -- 172.21.15.57:0/548150931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f9110 msgr2=0x559eaa9f9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:34.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.621+0000 7f1caaffd700 1 --2- 172.21.15.57:0/548150931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f9110 0x559eaa9f9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.621+0000 7f1caaffd700 1 -- 172.21.15.57:0/548150931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f4cd0 msgr2=0x559eaa9f8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:34.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.621+0000 7f1caaffd700 1 --2- 172.21.15.57:0/548150931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f4cd0 0x559eaa9f8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.621+0000 7f1caaffd700 1 -- 172.21.15.57:0/548150931 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559eaa7c8630 con 0x559eaa9f43c0 2023-03-02T11:04:34.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.621+0000 7f1cab7fe700 1 --2- 172.21.15.57:0/548150931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f9110 0x559eaa9f9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:04:34.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.621+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/548150931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f4cd0 0x559eaa9f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:04:34.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.621+0000 7f1caaffd700 1 --2- 172.21.15.57:0/548150931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f43c0 0x559eaa9f4790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c005910 tx=0x7f1c9c020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3682a1bf9a887b11 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:34.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.621+0000 7f1ca17fa700 1 -- 172.21.15.57:0/548150931 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c004960 con 0x559eaa9f43c0 2023-03-02T11:04:34.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.621+0000 7f1ca17fa700 1 -- 172.21.15.57:0/548150931 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c9c01e040 con 0x559eaa9f43c0 2023-03-02T11:04:34.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.621+0000 7f1ca17fa700 1 -- 172.21.15.57:0/548150931 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c00fe20 con 0x559eaa9f43c0 2023-03-02T11:04:34.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.622+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/548150931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f43c0 msgr2=0x559eaa9f4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:34.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.622+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/548150931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f43c0 0x559eaa9f4790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c005910 tx=0x7f1c9c020000 comp rx=0 tx=0).stop 2023-03-02T11:04:34.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.622+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/548150931 shutdown_connections 2023-03-02T11:04:34.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.622+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/548150931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f9110 0x559eaa9f9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.622+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/548150931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f43c0 0x559eaa9f4790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.622+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/548150931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f4cd0 0x559eaa9f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.622+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/548150931 >> 172.21.15.57:0/548150931 conn(0x559eaa9e9c50 msgr2=0x559eaa9ef460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.622+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/548150931 shutdown_connections 2023-03-02T11:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.622+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/548150931 wait complete. 2023-03-02T11:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.623+0000 7f1cc4e41b80 1 -- start start 2023-03-02T11:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.623+0000 7f1cc4e41b80 1 Processor -- start 2023-03-02T11:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.623+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaaa008f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.623+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f4cd0 0x559eaa9fdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.623+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f9110 0x559eaa9fe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.623+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaa94cbc0 con 0x559eaa9f43c0 2023-03-02T11:04:34.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.623+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaa9460f0 con 0x559eaa9f9110 2023-03-02T11:04:34.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.623+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaa7ca920 con 0x559eaa9f4cd0 2023-03-02T11:04:34.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.623+0000 7f1cc4e41b80 10 client.0 _ll_register_callbacks cb 0x559eaa8ec520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:04:34.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.623+0000 7f1caaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaaa008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.623+0000 7f1ca27fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f4cd0 0x559eaa9fdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1cab7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f9110 0x559eaa9fe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1caaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaaa008f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45162/0 (socket says 172.21.15.57:45162) 2023-03-02T11:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1caaffd700 1 -- 172.21.15.57:0/4288901014 learned_addr learned my addr 172.21.15.57:0/4288901014 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1caaffd700 1 -- 172.21.15.57:0/4288901014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f4cd0 msgr2=0x559eaa9fdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1caaffd700 1 --2- 172.21.15.57:0/4288901014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f4cd0 0x559eaa9fdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1caaffd700 1 -- 172.21.15.57:0/4288901014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f9110 msgr2=0x559eaa9fe2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1caaffd700 1 --2- 172.21.15.57:0/4288901014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f9110 0x559eaa9fe2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1caaffd700 1 -- 172.21.15.57:0/4288901014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac10c0f0 con 0x559eaa9f43c0 2023-03-02T11:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1caaffd700 1 --2- 172.21.15.57:0/4288901014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaaa008f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c000c00 tx=0x7f1c9c00fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383eca0fe38d559e server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1c927fc700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1c927fc700 1 -- 172.21.15.57:0/4288901014 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c004b70 con 0x559eaa9f43c0 2023-03-02T11:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/4288901014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559eaa9177b0 con 0x559eaa9f43c0 2023-03-02T11:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1c927fc700 1 -- 172.21.15.57:0/4288901014 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f1c9c004cd0 con 0x559eaa9f43c0 2023-03-02T11:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1c927fc700 1 -- 172.21.15.57:0/4288901014 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c9c004e90 con 0x559eaa9f43c0 2023-03-02T11:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1cc4e41b80 10 client.16359 fetch_fsmap learned FSMap version 47 2023-03-02T11:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.624+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/4288901014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x559eaa774de0 con 0x559eaa9f43c0 2023-03-02T11:04:34.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.625+0000 7f1c927fc700 1 -- 172.21.15.57:0/4288901014 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559eaa9177b0 con 0x559eaa9f43c0 2023-03-02T11:04:34.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.625+0000 7f1c927fc700 1 -- 172.21.15.57:0/4288901014 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1c9c024650 con 0x559eaa9f43c0 2023-03-02T11:04:34.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.625+0000 7f1cc4e41b80 10 client.16359 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:04:34.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.625+0000 7f1cc4e41b80 10 client.16359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:04:34.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.625+0000 7f1cc4e41b80 20 client.16359 populate_metadata read hostname 'smithi057' 2023-03-02T11:04:34.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.625+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/4288901014 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559eaaa0dd30 0x559eaaa10110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.625+0000 7f1cc4e41b80 4 client.16359 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:04:34.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.625+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/4288901014 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559eaa93f170 con 0x559eaaa0dd30 2023-03-02T11:04:34.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.625+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/4288901014 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559eaaa0dd30 0x559eaaa10110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/4288901014 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559eaaa0dd30 0x559eaaa10110 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58467bd595bf6d5c server_cookie=a74edc463786370a in_seq=0 out_seq=0 2023-03-02T11:04:34.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1c927fc700 10 client.16359 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:04:34.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1c927fc700 1 -- 172.21.15.57:0/4288901014 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x559eaa93f170 con 0x559eaaa0dd30 2023-03-02T11:04:34.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1c927fc700 10 client.16359 handle_command_reply: tid=0 2023-03-02T11:04:34.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1cc4e41b80 1 client.16359 shutdown 2023-03-02T11:04:34.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/4288901014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 msgr2=0x559eaaa008f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:34.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/4288901014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaaa008f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c000c00 tx=0x7f1c9c00fc70 comp rx=0 tx=0).stop 2023-03-02T11:04:34.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/4288901014 shutdown_connections 2023-03-02T11:04:34.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/4288901014 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559eaaa0dd30 0x559eaaa10110 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/4288901014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f9110 0x559eaa9fe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1c927fc700 0 client.16359 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:04:34.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/4288901014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaaa008f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/4288901014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f4cd0 0x559eaa9fdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.626+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/4288901014 >> 172.21.15.57:0/4288901014 conn(0x559eaa9e9c50 msgr2=0x559eaa9ef050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:34.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.627+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/4288901014 shutdown_connections 2023-03-02T11:04:34.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.627+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/4288901014 wait complete. 2023-03-02T11:04:34.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.627+0000 7f1cc4e41b80 20 client.16359 trim_cache size 0 max 16384 2023-03-02T11:04:34.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.643+0000 7f1cc4e41b80 1 Processor -- start 2023-03-02T11:04:34.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.643+0000 7f1cc4e41b80 1 -- start start 2023-03-02T11:04:34.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaa9f8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaa9f8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f9110 0x559eaaa09780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaa9e7020 con 0x559eaa9f43c0 2023-03-02T11:04:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaa9eedb0 con 0x559eaa9f4cd0 2023-03-02T11:04:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaa9f5420 con 0x559eaa9f9110 2023-03-02T11:04:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1ca27fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaa9f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1caaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaa9f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1ca27fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaa9f8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:58658/0 (socket says 172.21.15.57:58658) 2023-03-02T11:04:34.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1ca27fc700 1 -- 172.21.15.57:0/3223144058 learned_addr learned my addr 172.21.15.57:0/3223144058 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:04:34.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1cab7fe700 1 --2- 172.21.15.57:0/3223144058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f9110 0x559eaaa09780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1ca27fc700 1 -- 172.21.15.57:0/3223144058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f9110 msgr2=0x559eaaa09780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:34.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/3223144058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f9110 0x559eaaa09780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1ca27fc700 1 -- 172.21.15.57:0/3223144058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 msgr2=0x559eaa9f8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:34.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/3223144058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaa9f8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1ca27fc700 1 -- 172.21.15.57:0/3223144058 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559eaa90d190 con 0x559eaa9f4cd0 2023-03-02T11:04:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1caaffd700 1 --2- 172.21.15.57:0/3223144058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaa9f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:04:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/3223144058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaa9f8770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1c94010c10 tx=0x7f1c940c2e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48e768a07d6fb146 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:34.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.644+0000 7f1ca1ffb700 1 -- 172.21.15.57:0/3223144058 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94094040 con 0x559eaa9f4cd0 2023-03-02T11:04:34.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1ca1ffb700 1 -- 172.21.15.57:0/3223144058 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c94090a20 con 0x559eaa9f4cd0 2023-03-02T11:04:34.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1ca1ffb700 1 -- 172.21.15.57:0/3223144058 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94010860 con 0x559eaa9f4cd0 2023-03-02T11:04:34.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/3223144058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 msgr2=0x559eaa9f8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:34.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/3223144058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaa9f8770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1c94010c10 tx=0x7f1c940c2e20 comp rx=0 tx=0).stop 2023-03-02T11:04:34.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/3223144058 shutdown_connections 2023-03-02T11:04:34.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/3223144058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f9110 0x559eaaa09780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/3223144058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaa9f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/3223144058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaa9f8770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/3223144058 >> 172.21.15.57:0/3223144058 conn(0x559eaa9e9c50 msgr2=0x559eaa9ee6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:34.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/3223144058 shutdown_connections 2023-03-02T11:04:34.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/3223144058 wait complete. 2023-03-02T11:04:34.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.645+0000 7f1cc4e41b80 1 -- start start 2023-03-02T11:04:34.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1cc4e41b80 1 Processor -- start 2023-03-02T11:04:34.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaaa03920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaaa03e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1cc4e41b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f9110 0x559eaaa043a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaaa63960 con 0x559eaa9f43c0 2023-03-02T11:04:34.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaaa63ad0 con 0x559eaa9f4cd0 2023-03-02T11:04:34.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1cc4e41b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eaaa63c90 con 0x559eaa9f9110 2023-03-02T11:04:34.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1cc4e41b80 10 client.0 _ll_register_callbacks cb 0x559eaa8ec520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:04:34.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1ca27fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaaa03e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1caaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaaa03920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1ca27fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaaa03e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:58674/0 (socket says 172.21.15.57:58674) 2023-03-02T11:04:34.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1ca27fc700 1 -- 172.21.15.57:0/1506822512 learned_addr learned my addr 172.21.15.57:0/1506822512 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:04:34.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1cab7fe700 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f9110 0x559eaaa043a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1ca27fc700 1 -- 172.21.15.57:0/1506822512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f9110 msgr2=0x559eaaa043a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:34.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f9110 0x559eaaa043a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1ca27fc700 1 -- 172.21.15.57:0/1506822512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 msgr2=0x559eaaa03920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:04:34.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaaa03920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.646+0000 7f1ca27fc700 1 -- 172.21.15.57:0/1506822512 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559eaa774de0 con 0x559eaa9f4cd0 2023-03-02T11:04:34.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1ca27fc700 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaaa03e60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1c940c5260 tx=0x7f1c940940c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0fb911243f7de1d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:04:34.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1c927fc700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:04:34.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1c927fc700 1 -- 172.21.15.57:0/1506822512 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94094de0 con 0x559eaa9f4cd0 2023-03-02T11:04:34.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/1506822512 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c9c01e040 con 0x559eaa9f4cd0 2023-03-02T11:04:34.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1c927fc700 1 -- 172.21.15.57:0/1506822512 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f1c940ad030 con 0x559eaa9f4cd0 2023-03-02T11:04:34.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1c927fc700 1 -- 172.21.15.57:0/1506822512 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c9409be00 con 0x559eaa9f4cd0 2023-03-02T11:04:34.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1cc4e41b80 10 client.26207 fetch_fsmap learned FSMap version 47 2023-03-02T11:04:34.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/1506822512 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f1cac10e9f0 con 0x559eaa9f4cd0 2023-03-02T11:04:34.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1c927fc700 1 -- 172.21.15.57:0/1506822512 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c9c01e040 con 0x559eaa9f4cd0 2023-03-02T11:04:34.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1c927fc700 1 -- 172.21.15.57:0/1506822512 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1c94093cf0 con 0x559eaa9f4cd0 2023-03-02T11:04:34.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1cc4e41b80 10 client.26207 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:04:34.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1cc4e41b80 10 client.26207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:04:34.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1cc4e41b80 20 client.26207 populate_metadata read hostname 'smithi057' 2023-03-02T11:04:34.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559eaaa650a0 0x559eaaa674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:04:34.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1cc4e41b80 4 client.26207 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:04:34.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.647+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/1506822512 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559eaa93ee90 con 0x559eaaa650a0 2023-03-02T11:04:34.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1caaffd700 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559eaaa650a0 0x559eaaa674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:34.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1caaffd700 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559eaaa650a0 0x559eaaa674b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9e00d29c182c5ef server_cookie=3a0be08c5b578cf4 in_seq=0 out_seq=0 2023-03-02T11:04:34.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1c927fc700 10 client.26207 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:04:34.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1c927fc700 1 -- 172.21.15.57:0/1506822512 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x559eaa93ee90 con 0x559eaaa650a0 2023-03-02T11:04:34.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1c927fc700 10 client.26207 handle_command_reply: tid=0 2023-03-02T11:04:34.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1cc4e41b80 1 client.26207 shutdown 2023-03-02T11:04:34.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/1506822512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 msgr2=0x559eaaa03e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:34.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaaa03e60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1c940c5260 tx=0x7f1c940940c0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/1506822512 shutdown_connections 2023-03-02T11:04:34.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x559eaaa650a0 0x559eaaa674b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eaa9f9110 0x559eaaa043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559eaa9f43c0 0x559eaaa03920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1c927fc700 0 client.26207 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:04:34.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1cc4e41b80 1 --2- 172.21.15.57:0/1506822512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559eaa9f4cd0 0x559eaaa03e60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/1506822512 >> 172.21.15.57:0/1506822512 conn(0x559eaa9e9c50 msgr2=0x559eaa9f8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:34.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/1506822512 shutdown_connections 2023-03-02T11:04:34.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.648+0000 7f1cc4e41b80 1 -- 172.21.15.57:0/1506822512 wait complete. 2023-03-02T11:04:34.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cc4e41b80 20 client.26207 trim_cache size 0 max 16384 2023-03-02T11:04:34.660 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:04:34.661 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:04:34.661 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:04:34.661 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:04:34.661 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:04:34.661 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:04:34.661 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:04:34.661 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:04:34.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:04:34.662 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:04:34.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 -- 172.21.15.57:0/1114174093 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f1c9809b480 msgr2=0x7f1c9809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:34.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f1c9809b480 0x7f1c9809d930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00b6f0 tx=0x7f1c9c005bc0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 -- 172.21.15.57:0/1114174093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cac0ff360 msgr2=0x7f1cac19bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:04:34.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cac0ff360 0x7f1cac19bee0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400e9f0 tx=0x7f1c9400ed00 comp rx=0 tx=0).stop 2023-03-02T11:04:34.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 -- 172.21.15.57:0/1114174093 shutdown_connections 2023-03-02T11:04:34.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f1c9809b480 0x7f1c9809d930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cac1049c0 0x7f1cac195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cac0fe9b0 0x7f1cac19b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 --2- 172.21.15.57:0/1114174093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cac0ff360 0x7f1cac19bee0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:04:34.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 -- 172.21.15.57:0/1114174093 >> 172.21.15.57:0/1114174093 conn(0x7f1cac0fa4b0 msgr2=0x7f1cac067720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:04:34.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 -- 172.21.15.57:0/1114174093 shutdown_connections 2023-03-02T11:04:34.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:04:34.649+0000 7f1cb15ff700 1 -- 172.21.15.57:0/1114174093 wait complete. 2023-03-02T11:04:34.664 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:34 smithi057 ceph-mon[92072]: pgmap v233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:04:34.665 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:04:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:34 smithi122 ceph-mon[125440]: pgmap v233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:04:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:34 smithi136 ceph-mon[125702]: pgmap v233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:04:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:36 smithi057 ceph-mon[92072]: pgmap v234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:04:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:36 smithi122 ceph-mon[125440]: pgmap v234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:04:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:36 smithi136 ceph-mon[125702]: pgmap v234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:04:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:38 smithi057 ceph-mon[92072]: pgmap v235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T11:04:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:38 smithi122 ceph-mon[125440]: pgmap v235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T11:04:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:38 smithi136 ceph-mon[125702]: pgmap v235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T11:04:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:40 smithi057 ceph-mon[92072]: pgmap v236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:04:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:40 smithi122 ceph-mon[125440]: pgmap v236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:04:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:40 smithi136 ceph-mon[125702]: pgmap v236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:04:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:42 smithi057 ceph-mon[92072]: pgmap v237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:04:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:42 smithi122 ceph-mon[125440]: pgmap v237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:04:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:42 smithi136 ceph-mon[125702]: pgmap v237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:04:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:44 smithi057 ceph-mon[92072]: pgmap v238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:04:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:44 smithi122 ceph-mon[125440]: pgmap v238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:04:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:44 smithi136 ceph-mon[125702]: pgmap v238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:04:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:46 smithi057 ceph-mon[92072]: pgmap v239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:46 smithi122 ceph-mon[125440]: pgmap v239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:46 smithi136 ceph-mon[125702]: pgmap v239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:48 smithi057 ceph-mon[92072]: pgmap v240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T11:04:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:48 smithi122 ceph-mon[125440]: pgmap v240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T11:04:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:48 smithi136 ceph-mon[125702]: pgmap v240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T11:04:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:49.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:04:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:49.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:04:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:49.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:04:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:49.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:04:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:04:49.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:04:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:50 smithi057 ceph-mon[92072]: pgmap v241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:04:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:50 smithi122 ceph-mon[125440]: pgmap v241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:04:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:50 smithi136 ceph-mon[125702]: pgmap v241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:04:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:52 smithi057 ceph-mon[92072]: pgmap v242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:52 smithi122 ceph-mon[125440]: pgmap v242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:52 smithi136 ceph-mon[125702]: pgmap v242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:54 smithi057 ceph-mon[92072]: pgmap v243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:04:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:54 smithi122 ceph-mon[125440]: pgmap v243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:04:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:54 smithi136 ceph-mon[125702]: pgmap v243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:04:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:56 smithi057 ceph-mon[92072]: pgmap v244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:56 smithi122 ceph-mon[125440]: pgmap v244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:56 smithi136 ceph-mon[125702]: pgmap v244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:04:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:04:58 smithi057 ceph-mon[92072]: pgmap v245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T11:04:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:04:58 smithi122 ceph-mon[125440]: pgmap v245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T11:04:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:04:58 smithi136 ceph-mon[125702]: pgmap v245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T11:05:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:00 smithi057 ceph-mon[92072]: pgmap v246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:00 smithi122 ceph-mon[125440]: pgmap v246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:00 smithi136 ceph-mon[125702]: pgmap v246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:02 smithi057 ceph-mon[92072]: pgmap v247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:02 smithi122 ceph-mon[125440]: pgmap v247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:02 smithi136 ceph-mon[125702]: pgmap v247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:04.084 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:04.083+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:04.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:05:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:04.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:05:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:04.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:05:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:04.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:05:04.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:05:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:04 smithi122 ceph-mon[125440]: pgmap v248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:05:04.711 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:04 smithi057 ceph-mon[92072]: pgmap v248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:05:04.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.835+0000 7ff7c33ff700 1 -- 172.21.15.57:0/3449233245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc1049c0 msgr2=0x7ff7bc104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:04.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.835+0000 7ff7c33ff700 1 --2- 172.21.15.57:0/3449233245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc1049c0 0x7ff7bc104d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009990 tx=0x7ff7b8009ca0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.835+0000 7ff7c33ff700 1 -- 172.21.15.57:0/3449233245 shutdown_connections 2023-03-02T11:05:04.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.835+0000 7ff7c33ff700 1 --2- 172.21.15.57:0/3449233245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7bc0ff360 0x7ff7bc10b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.835+0000 7ff7c33ff700 1 --2- 172.21.15.57:0/3449233245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc1049c0 0x7ff7bc104d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.835+0000 7ff7c33ff700 1 --2- 172.21.15.57:0/3449233245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0fe9b0 0x7ff7bc0fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.835+0000 7ff7c33ff700 1 -- 172.21.15.57:0/3449233245 >> 172.21.15.57:0/3449233245 conn(0x7ff7bc0fa4b0 msgr2=0x7ff7bc0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:04.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.835+0000 7ff7c33ff700 1 -- 172.21.15.57:0/3449233245 shutdown_connections 2023-03-02T11:05:04.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.835+0000 7ff7c33ff700 1 -- 172.21.15.57:0/3449233245 wait complete. 2023-03-02T11:05:04.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.836+0000 7ff7c33ff700 1 Processor -- start 2023-03-02T11:05:04.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.836+0000 7ff7c33ff700 1 -- start start 2023-03-02T11:05:04.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.836+0000 7ff7c33ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0fe9b0 0x7ff7bc197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c33ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0ff360 0x7ff7bc198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c33ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7bc1049c0 0x7ff7bc19c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c33ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc19cda0 con 0x7ff7bc0fe9b0 2023-03-02T11:05:04.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c33ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc19cf10 con 0x7ff7bc0ff360 2023-03-02T11:05:04.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c33ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc19d0d0 con 0x7ff7bc1049c0 2023-03-02T11:05:04.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c099a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0ff360 0x7ff7bc198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c119b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0fe9b0 0x7ff7bc197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c099a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0ff360 0x7ff7bc198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33206/0 (socket says 172.21.15.57:33206) 2023-03-02T11:05:04.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c119b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0fe9b0 0x7ff7bc197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52322/0 (socket says 172.21.15.57:52322) 2023-03-02T11:05:04.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c099a700 1 -- 172.21.15.57:0/2844041073 learned_addr learned my addr 172.21.15.57:0/2844041073 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:05:04.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c199c700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7bc1049c0 0x7ff7bc19c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c099a700 1 -- 172.21.15.57:0/2844041073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7bc1049c0 msgr2=0x7ff7bc19c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:04.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c099a700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7bc1049c0 0x7ff7bc19c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c099a700 1 -- 172.21.15.57:0/2844041073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0fe9b0 msgr2=0x7ff7bc197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:04.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c099a700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0fe9b0 0x7ff7bc197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c099a700 1 -- 172.21.15.57:0/2844041073 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b80095f0 con 0x7ff7bc0ff360 2023-03-02T11:05:04.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c119b700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0fe9b0 0x7ff7bc197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:05:04.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7c099a700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0ff360 0x7ff7bc198300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00e9a0 tx=0x7ff7ac00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:04.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.837+0000 7ff7b27fc700 1 -- 172.21.15.57:0/2844041073 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac009790 con 0x7ff7bc0ff360 2023-03-02T11:05:04.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.838+0000 7ff7b27fc700 1 -- 172.21.15.57:0/2844041073 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7ac010430 con 0x7ff7bc0ff360 2023-03-02T11:05:04.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.838+0000 7ff7c33ff700 1 -- 172.21.15.57:0/2844041073 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc10e9f0 con 0x7ff7bc0ff360 2023-03-02T11:05:04.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.838+0000 7ff7b27fc700 1 -- 172.21.15.57:0/2844041073 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac018680 con 0x7ff7bc0ff360 2023-03-02T11:05:04.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.838+0000 7ff7c33ff700 1 -- 172.21.15.57:0/2844041073 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc10e860 con 0x7ff7bc0ff360 2023-03-02T11:05:04.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:04 smithi136 ceph-mon[125702]: pgmap v248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:05:04.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.841+0000 7ff7b27fc700 1 -- 172.21.15.57:0/2844041073 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7ff7ac00c040 con 0x7ff7bc0ff360 2023-03-02T11:05:04.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.841+0000 7ff7b27fc700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff7a809b500 0x7ff7a809d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7b27fc700 1 -- 172.21.15.57:0/2844041073 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff7ac014070 con 0x7ff7bc0ff360 2023-03-02T11:05:04.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7c119b700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff7a809b500 0x7ff7a809d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7d6d4eb80 1 Processor -- start 2023-03-02T11:05:04.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7d6d4eb80 1 -- start start 2023-03-02T11:05:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7c119b700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff7a809b500 0x7ff7a809d9b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8006010 tx=0x7ff7b8005960 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 0x556b6f34e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f352bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f353110 0x556b6f353560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f2b5a60 con 0x556b6f34e3c0 2023-03-02T11:05:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f267f80 con 0x556b6f353110 2023-03-02T11:05:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f238160 con 0x556b6f34ecd0 2023-03-02T11:05:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.842+0000 7ff7c119b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 0x556b6f34e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7c199c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f353110 0x556b6f353560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7c119b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 0x556b6f34e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52338/0 (socket says 172.21.15.57:52338) 2023-03-02T11:05:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7c119b700 1 -- 172.21.15.57:0/2239144742 learned_addr learned my addr 172.21.15.57:0/2239144742 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:05:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7c099a700 1 --2- 172.21.15.57:0/2239144742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f352bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7c199c700 1 -- 172.21.15.57:0/2239144742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 msgr2=0x556b6f352bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7c199c700 1 --2- 172.21.15.57:0/2239144742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f352bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7c199c700 1 -- 172.21.15.57:0/2239144742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 msgr2=0x556b6f34e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:04.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7c199c700 1 --2- 172.21.15.57:0/2239144742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 0x556b6f34e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7c199c700 1 -- 172.21.15.57:0/2239144742 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b6f122630 con 0x556b6f353110 2023-03-02T11:05:04.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7c099a700 1 --2- 172.21.15.57:0/2239144742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f352bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:05:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7c199c700 1 --2- 172.21.15.57:0/2239144742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f353110 0x556b6f353560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4011580 tx=0x7ff7b4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ff73adbc095fa09 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7a77fe700 1 -- 172.21.15.57:0/2239144742 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400e040 con 0x556b6f353110 2023-03-02T11:05:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7a77fe700 1 -- 172.21.15.57:0/2239144742 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7b400f040 con 0x556b6f353110 2023-03-02T11:05:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.843+0000 7ff7a77fe700 1 -- 172.21.15.57:0/2239144742 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40044f0 con 0x556b6f353110 2023-03-02T11:05:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.844+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/2239144742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f353110 msgr2=0x556b6f353560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.844+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/2239144742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f353110 0x556b6f353560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4011580 tx=0x7ff7b4009920 comp rx=0 tx=0).stop 2023-03-02T11:05:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.844+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/2239144742 shutdown_connections 2023-03-02T11:05:04.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.844+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/2239144742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f353110 0x556b6f353560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.844+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/2239144742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 0x556b6f34e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.844+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/2239144742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f352bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.844+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/2239144742 >> 172.21.15.57:0/2239144742 conn(0x556b6f343c50 msgr2=0x556b6f349460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:04.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.844+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/2239144742 shutdown_connections 2023-03-02T11:05:04.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.844+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/2239144742 wait complete. 2023-03-02T11:05:04.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.844+0000 7ff7d6d4eb80 1 -- start start 2023-03-02T11:05:04.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7d6d4eb80 1 Processor -- start 2023-03-02T11:05:04.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 0x556b6f357ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34ecd0 0x556b6f3581e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f353110 0x556b6f358720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f2a6bc0 con 0x556b6f34ecd0 2023-03-02T11:05:04.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f2a00f0 con 0x556b6f34e3c0 2023-03-02T11:05:04.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f124920 con 0x556b6f353110 2023-03-02T11:05:04.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7d6d4eb80 10 client.0 _ll_register_callbacks cb 0x556b6f246520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:05:04.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7c119b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 0x556b6f357ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7c099a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34ecd0 0x556b6f3581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7c199c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f353110 0x556b6f358720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7c099a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34ecd0 0x556b6f3581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52346/0 (socket says 172.21.15.57:52346) 2023-03-02T11:05:04.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7c099a700 1 -- 172.21.15.57:0/1902981293 learned_addr learned my addr 172.21.15.57:0/1902981293 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:05:04.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7c099a700 1 -- 172.21.15.57:0/1902981293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f353110 msgr2=0x556b6f358720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:04.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7c099a700 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f353110 0x556b6f358720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7c099a700 1 -- 172.21.15.57:0/1902981293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 msgr2=0x556b6f357ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:04.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7c099a700 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 0x556b6f357ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7c099a700 1 -- 172.21.15.57:0/1902981293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b4011230 con 0x556b6f34ecd0 2023-03-02T11:05:04.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.845+0000 7ff7c119b700 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 0x556b6f357ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:05:04.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7c099a700 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34ecd0 0x556b6f3581e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0c5290 tx=0x7ff7ac094c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbfd8999b4ce0aa server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:04.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:05:04.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/1902981293 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac094710 con 0x556b6f34ecd0 2023-03-02T11:05:04.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/1902981293 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff7ac09be30 con 0x556b6f34ecd0 2023-03-02T11:05:04.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/1902981293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b6f2717b0 con 0x556b6f34ecd0 2023-03-02T11:05:04.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/1902981293 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7ac09b9a0 con 0x556b6f34ecd0 2023-03-02T11:05:04.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7d6d4eb80 10 client.16377 fetch_fsmap learned FSMap version 47 2023-03-02T11:05:04.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/1902981293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x556b6f0cede0 con 0x556b6f34ecd0 2023-03-02T11:05:04.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/1902981293 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556b6f2717b0 con 0x556b6f34ecd0 2023-03-02T11:05:04.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/1902981293 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff7ac00ca10 con 0x556b6f34ecd0 2023-03-02T11:05:04.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7d6d4eb80 10 client.16377 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:05:04.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7d6d4eb80 10 client.16377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:05:04.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.846+0000 7ff7d6d4eb80 20 client.16377 populate_metadata read hostname 'smithi057' 2023-03-02T11:05:04.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.847+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556b6f368360 0x556b6f36a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.847+0000 7ff7d6d4eb80 4 client.16377 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:05:04.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.847+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/1902981293 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b6f299170 con 0x556b6f368360 2023-03-02T11:05:04.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.847+0000 7ff7c119b700 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556b6f368360 0x556b6f36a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.847+0000 7ff7c119b700 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556b6f368360 0x556b6f36a770 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d07fe5cb3792b409 server_cookie=eff31db1c47c73b8 in_seq=0 out_seq=0 2023-03-02T11:05:04.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.847+0000 7ff7a4ff9700 10 client.16377 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:05:04.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/1902981293 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x556b6f299170 con 0x556b6f368360 2023-03-02T11:05:04.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7a4ff9700 10 client.16377 handle_command_reply: tid=0 2023-03-02T11:05:04.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 1 client.16377 shutdown 2023-03-02T11:05:04.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/1902981293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34ecd0 msgr2=0x556b6f3581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:04.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34ecd0 0x556b6f3581e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0c5290 tx=0x7ff7ac094c50 comp rx=0 tx=0).stop 2023-03-02T11:05:04.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/1902981293 shutdown_connections 2023-03-02T11:05:04.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556b6f368360 0x556b6f36a770 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f353110 0x556b6f358720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 0x556b6f357ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7a4ff9700 0 client.16377 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:05:04.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/1902981293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34ecd0 0x556b6f3581e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/1902981293 >> 172.21.15.57:0/1902981293 conn(0x556b6f343c50 msgr2=0x556b6f349050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:04.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/1902981293 shutdown_connections 2023-03-02T11:05:04.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/1902981293 wait complete. 2023-03-02T11:05:04.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.848+0000 7ff7d6d4eb80 20 client.16377 trim_cache size 0 max 16384 2023-03-02T11:05:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7d6d4eb80 1 Processor -- start 2023-03-02T11:05:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7d6d4eb80 1 -- start start 2023-03-02T11:05:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 0x556b6f350a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f3637e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f353110 0x556b6f363d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f364290 con 0x556b6f34e3c0 2023-03-02T11:05:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f359240 con 0x556b6f353110 2023-03-02T11:05:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f36f3a0 con 0x556b6f34ecd0 2023-03-02T11:05:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7c119b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 0x556b6f350a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7c099a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f3637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7c119b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 0x556b6f350a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52354/0 (socket says 172.21.15.57:52354) 2023-03-02T11:05:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7c119b700 1 -- 172.21.15.57:0/2409571871 learned_addr learned my addr 172.21.15.57:0/2409571871 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:05:04.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7c199c700 1 --2- 172.21.15.57:0/2409571871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f353110 0x556b6f363d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7c119b700 1 -- 172.21.15.57:0/2409571871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 msgr2=0x556b6f3637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:04.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7c119b700 1 --2- 172.21.15.57:0/2409571871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f3637e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7c119b700 1 -- 172.21.15.57:0/2409571871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f353110 msgr2=0x556b6f363d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:04.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7c119b700 1 --2- 172.21.15.57:0/2409571871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f353110 0x556b6f363d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.865+0000 7ff7c119b700 1 -- 172.21.15.57:0/2409571871 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b6f267190 con 0x556b6f34e3c0 2023-03-02T11:05:04.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.866+0000 7ff7c119b700 1 --2- 172.21.15.57:0/2409571871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 0x556b6f350a00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800b2e0 tx=0x7ff7b8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9557dfc32367c6 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.866+0000 7ff7a7fff700 1 -- 172.21.15.57:0/2409571871 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8036150 con 0x556b6f34e3c0 2023-03-02T11:05:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.866+0000 7ff7a7fff700 1 -- 172.21.15.57:0/2409571871 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7b801e040 con 0x556b6f34e3c0 2023-03-02T11:05:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.866+0000 7ff7a7fff700 1 -- 172.21.15.57:0/2409571871 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b800f460 con 0x556b6f34e3c0 2023-03-02T11:05:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.866+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/2409571871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 msgr2=0x556b6f350a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.866+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/2409571871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 0x556b6f350a00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800b2e0 tx=0x7ff7b8020000 comp rx=0 tx=0).stop 2023-03-02T11:05:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.866+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/2409571871 shutdown_connections 2023-03-02T11:05:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.866+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/2409571871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f353110 0x556b6f363d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.866+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/2409571871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f34e3c0 0x556b6f350a00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.866+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/2409571871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f3637e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.866+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/2409571871 >> 172.21.15.57:0/2409571871 conn(0x556b6f343c50 msgr2=0x556b6f3512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.867+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/2409571871 shutdown_connections 2023-03-02T11:05:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.867+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/2409571871 wait complete. 2023-03-02T11:05:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.867+0000 7ff7d6d4eb80 1 -- start start 2023-03-02T11:05:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.867+0000 7ff7d6d4eb80 1 Processor -- start 2023-03-02T11:05:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.867+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 0x556b6f35f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.867+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f35d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.867+0000 7ff7d6d4eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f353110 0x556b6f35d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.867+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f35df90 con 0x556b6f353110 2023-03-02T11:05:04.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.867+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f35e100 con 0x556b6f34e3c0 2023-03-02T11:05:04.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.867+0000 7ff7d6d4eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b6f3b9c20 con 0x556b6f34ecd0 2023-03-02T11:05:04.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.867+0000 7ff7d6d4eb80 10 client.0 _ll_register_callbacks cb 0x556b6f246520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:05:04.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7c119b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 0x556b6f35f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7c199c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f353110 0x556b6f35d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7c099a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f35d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7c119b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 0x556b6f35f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33232/0 (socket says 172.21.15.57:33232) 2023-03-02T11:05:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7c119b700 1 -- 172.21.15.57:0/3446634400 learned_addr learned my addr 172.21.15.57:0/3446634400 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:05:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7c199c700 1 -- 172.21.15.57:0/3446634400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 msgr2=0x556b6f35d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7c199c700 1 --2- 172.21.15.57:0/3446634400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f35d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7c199c700 1 -- 172.21.15.57:0/3446634400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 msgr2=0x556b6f35f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7c199c700 1 --2- 172.21.15.57:0/3446634400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 0x556b6f35f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7c199c700 1 -- 172.21.15.57:0/3446634400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc10c0f0 con 0x556b6f353110 2023-03-02T11:05:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7c199c700 1 --2- 172.21.15.57:0/3446634400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f353110 0x556b6f35d8c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009690 tx=0x7ff7b4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbd817b660d78a9 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:05:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/3446634400 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400e040 con 0x556b6f353110 2023-03-02T11:05:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/3446634400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7b400f040 con 0x556b6f353110 2023-03-02T11:05:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/3446634400 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff7b4007910 con 0x556b6f353110 2023-03-02T11:05:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/3446634400 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7b4007af0 con 0x556b6f353110 2023-03-02T11:05:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7d6d4eb80 10 client.16383 fetch_fsmap learned FSMap version 47 2023-03-02T11:05:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.868+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/3446634400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x556b6f0f5250 con 0x556b6f353110 2023-03-02T11:05:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.869+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/3446634400 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7b4032020 con 0x556b6f353110 2023-03-02T11:05:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.869+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/3446634400 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff7b401b020 con 0x556b6f353110 2023-03-02T11:05:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.869+0000 7ff7d6d4eb80 10 client.16383 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:05:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.869+0000 7ff7d6d4eb80 10 client.16383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:05:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.869+0000 7ff7d6d4eb80 20 client.16383 populate_metadata read hostname 'smithi057' 2023-03-02T11:05:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.869+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/3446634400 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556b6f3bb150 0x556b6f3bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.869+0000 7ff7d6d4eb80 4 client.16383 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:05:04.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.869+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/3446634400 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556b6f298e90 con 0x556b6f3bb150 2023-03-02T11:05:04.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.869+0000 7ff7c119b700 1 --2- 172.21.15.57:0/3446634400 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556b6f3bb150 0x556b6f3bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:04.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7c119b700 1 --2- 172.21.15.57:0/3446634400 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556b6f3bb150 0x556b6f3bd560 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=757722dfeb4a757c server_cookie=c086a26a0c0a869d in_seq=0 out_seq=0 2023-03-02T11:05:04.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7a4ff9700 10 client.16383 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:05:04.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7a4ff9700 1 -- 172.21.15.57:0/3446634400 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x556b6f298e90 con 0x556b6f3bb150 2023-03-02T11:05:04.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7a4ff9700 10 client.16383 handle_command_reply: tid=0 2023-03-02T11:05:04.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 1 client.16383 shutdown 2023-03-02T11:05:04.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/3446634400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f353110 msgr2=0x556b6f35d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:04.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/3446634400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f353110 0x556b6f35d8c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009690 tx=0x7ff7b4003f90 comp rx=0 tx=0).stop 2023-03-02T11:05:04.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/3446634400 shutdown_connections 2023-03-02T11:05:04.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/3446634400 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x556b6f3bb150 0x556b6f3bd560 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/3446634400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556b6f353110 0x556b6f35d8c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/3446634400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556b6f34e3c0 0x556b6f35f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 1 --2- 172.21.15.57:0/3446634400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b6f34ecd0 0x556b6f35d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7a4ff9700 0 client.16383 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:05:04.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/3446634400 >> 172.21.15.57:0/3446634400 conn(0x556b6f343c50 msgr2=0x556b6f3512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:04.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/3446634400 shutdown_connections 2023-03-02T11:05:04.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 1 -- 172.21.15.57:0/3446634400 wait complete. 2023-03-02T11:05:04.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.870+0000 7ff7d6d4eb80 20 client.16383 trim_cache size 0 max 16384 2023-03-02T11:05:04.890 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:05:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:05:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:05:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:05:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:05:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:05:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:05:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:05:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:05:04.892 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:05:04.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 -- 172.21.15.57:0/2844041073 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff7a809b500 msgr2=0x7ff7a809d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:04.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff7a809b500 0x7ff7a809d9b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8006010 tx=0x7ff7b8005960 comp rx=0 tx=0).stop 2023-03-02T11:05:04.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 -- 172.21.15.57:0/2844041073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0ff360 msgr2=0x7ff7bc198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:04.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0ff360 0x7ff7bc198300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00e9a0 tx=0x7ff7ac00ecb0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 -- 172.21.15.57:0/2844041073 shutdown_connections 2023-03-02T11:05:04.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff7a809b500 0x7ff7a809d9b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7bc1049c0 0x7ff7bc19c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0fe9b0 0x7ff7bc197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 --2- 172.21.15.57:0/2844041073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0ff360 0x7ff7bc198300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:04.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 -- 172.21.15.57:0/2844041073 >> 172.21.15.57:0/2844041073 conn(0x7ff7bc0fa4b0 msgr2=0x7ff7bc067680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:04.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 -- 172.21.15.57:0/2844041073 shutdown_connections 2023-03-02T11:05:04.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:04.871+0000 7ff7c33ff700 1 -- 172.21.15.57:0/2844041073 wait complete. 2023-03-02T11:05:04.895 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:05:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:06 smithi122 ceph-mon[125440]: pgmap v249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:05:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:06 smithi136 ceph-mon[125702]: pgmap v249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:05:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:06 smithi057 ceph-mon[92072]: pgmap v249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:05:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:08.412+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858005870 con 0x7f5880105ae0 2023-03-02T11:05:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:08.412+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858005870 con 0x7f5880105ae0 2023-03-02T11:05:08.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:08.443+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500058a0 con 0x558558b6f6b0 2023-03-02T11:05:08.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:08.446+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500058a0 con 0x558558b6f6b0 2023-03-02T11:05:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:08 smithi122 ceph-mon[125440]: pgmap v250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:05:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:08 smithi136 ceph-mon[125702]: pgmap v250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:05:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:08 smithi057 ceph-mon[92072]: pgmap v250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T11:05:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:10 smithi122 ceph-mon[125440]: pgmap v251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:05:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:10 smithi136 ceph-mon[125702]: pgmap v251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:05:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:10 smithi057 ceph-mon[92072]: pgmap v251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-03-02T11:05:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:12 smithi136 ceph-mon[125702]: pgmap v252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:05:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:12 smithi057 ceph-mon[92072]: pgmap v252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:05:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:12 smithi122 ceph-mon[125440]: pgmap v252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T11:05:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:14 smithi136 ceph-mon[125702]: pgmap v253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:05:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:05:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:14 smithi057 ceph-mon[92072]: pgmap v253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:05:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:05:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:14 smithi122 ceph-mon[125440]: pgmap v253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T11:05:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:05:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:05:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:05:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:05:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:05:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:05:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:05:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:05:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:05:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:05:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:16 smithi136 ceph-mon[125702]: pgmap v254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:05:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:16 smithi057 ceph-mon[92072]: pgmap v254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:05:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:16 smithi122 ceph-mon[125440]: pgmap v254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T11:05:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:18 smithi136 ceph-mon[125702]: pgmap v255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:05:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:18 smithi057 ceph-mon[92072]: pgmap v255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:05:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:18 smithi122 ceph-mon[125440]: pgmap v255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:05:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:19.098+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:19.098+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:05:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:19.098+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:05:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:19.098+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:05:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:19.098+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:05:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:20 smithi136 ceph-mon[125702]: pgmap v256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:05:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:20 smithi057 ceph-mon[92072]: pgmap v256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:05:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:20 smithi122 ceph-mon[125440]: pgmap v256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:05:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:22 smithi136 ceph-mon[125702]: pgmap v257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:05:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:22 smithi057 ceph-mon[92072]: pgmap v257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:05:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:22 smithi122 ceph-mon[125440]: pgmap v257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T11:05:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:24 smithi136 ceph-mon[125702]: pgmap v258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:05:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:24 smithi057 ceph-mon[92072]: pgmap v258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:05:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:24 smithi122 ceph-mon[125440]: pgmap v258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:05:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:26 smithi136 ceph-mon[125702]: pgmap v259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:26 smithi057 ceph-mon[92072]: pgmap v259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:26 smithi122 ceph-mon[125440]: pgmap v259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:28 smithi136 ceph-mon[125702]: pgmap v260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:05:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:28 smithi057 ceph-mon[92072]: pgmap v260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:05:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:28 smithi122 ceph-mon[125440]: pgmap v260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:05:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:30 smithi136 ceph-mon[125702]: pgmap v261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:30 smithi057 ceph-mon[92072]: pgmap v261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:30 smithi122 ceph-mon[125440]: pgmap v261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:32 smithi136 ceph-mon[125702]: pgmap v262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:32 smithi057 ceph-mon[92072]: pgmap v262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:32 smithi122 ceph-mon[125440]: pgmap v262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:34.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:34.108+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:05:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:34.108+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:05:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:34.108+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:05:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:34.108+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:05:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:34 smithi136 ceph-mon[125702]: pgmap v263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:05:34.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:05:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:34 smithi057 ceph-mon[92072]: pgmap v263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:05:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:34 smithi122 ceph-mon[125440]: pgmap v263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:05:35.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.067+0000 7ff4323ff700 1 -- 172.21.15.57:0/3448254341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42c100c80 msgr2=0x7ff42c101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:35.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.067+0000 7ff4323ff700 1 --2- 172.21.15.57:0/3448254341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42c100c80 0x7ff42c101050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009990 tx=0x7ff41c009ca0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.067+0000 7ff4323ff700 1 -- 172.21.15.57:0/3448254341 shutdown_connections 2023-03-02T11:05:35.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.067+0000 7ff4323ff700 1 --2- 172.21.15.57:0/3448254341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff42c10a050 0x7ff42c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.067+0000 7ff4323ff700 1 --2- 172.21.15.57:0/3448254341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42c100c80 0x7ff42c101050 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.067+0000 7ff4323ff700 1 --2- 172.21.15.57:0/3448254341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff42c101590 0x7ff42c109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.067+0000 7ff4323ff700 1 -- 172.21.15.57:0/3448254341 >> 172.21.15.57:0/3448254341 conn(0x7ff42c0fa4b0 msgr2=0x7ff42c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:35.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.067+0000 7ff4323ff700 1 -- 172.21.15.57:0/3448254341 shutdown_connections 2023-03-02T11:05:35.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.067+0000 7ff4323ff700 1 -- 172.21.15.57:0/3448254341 wait complete. 2023-03-02T11:05:35.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.067+0000 7ff4323ff700 1 Processor -- start 2023-03-02T11:05:35.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff4323ff700 1 -- start start 2023-03-02T11:05:35.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff4323ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42c100c80 0x7ff42c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff4323ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff42c101590 0x7ff42c19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff4323ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff42c10a050 0x7ff42c195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff4323ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c196090 con 0x7ff42c10a050 2023-03-02T11:05:35.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff4323ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c196200 con 0x7ff42c100c80 2023-03-02T11:05:35.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff4323ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c1963c0 con 0x7ff42c101590 2023-03-02T11:05:35.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42c100c80 0x7ff42c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42c100c80 0x7ff42c19b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:46450/0 (socket says 172.21.15.57:46450) 2023-03-02T11:05:35.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff42bfff700 1 -- 172.21.15.57:0/3786555839 learned_addr learned my addr 172.21.15.57:0/3786555839 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:05:35.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff4237fe700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff42c101590 0x7ff42c19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff43099c700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff42c10a050 0x7ff42c195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff42bfff700 1 -- 172.21.15.57:0/3786555839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff42c101590 msgr2=0x7ff42c19bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff42bfff700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff42c101590 0x7ff42c19bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff42bfff700 1 -- 172.21.15.57:0/3786555839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff42c10a050 msgr2=0x7ff42c195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff42bfff700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff42c10a050 0x7ff42c195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.068+0000 7ff42bfff700 1 -- 172.21.15.57:0/3786555839 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0095f0 con 0x7ff42c100c80 2023-03-02T11:05:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.069+0000 7ff42bfff700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42c100c80 0x7ff42c19b9b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff41c000c00 tx=0x7ff41c004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.069+0000 7ff429ffb700 1 -- 172.21.15.57:0/3786555839 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c01d070 con 0x7ff42c100c80 2023-03-02T11:05:35.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.069+0000 7ff429ffb700 1 -- 172.21.15.57:0/3786555839 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff41c021410 con 0x7ff42c100c80 2023-03-02T11:05:35.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.069+0000 7ff429ffb700 1 -- 172.21.15.57:0/3786555839 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c017650 con 0x7ff42c100c80 2023-03-02T11:05:35.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.069+0000 7ff4323ff700 1 -- 172.21.15.57:0/3786555839 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c10fac0 con 0x7ff42c100c80 2023-03-02T11:05:35.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.069+0000 7ff4323ff700 1 -- 172.21.15.57:0/3786555839 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c10f930 con 0x7ff42c100c80 2023-03-02T11:05:35.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.072+0000 7ff429ffb700 1 -- 172.21.15.57:0/3786555839 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 25) v1 ==== 129954+0+0 (secure 0 0 0) 0x7ff41c028030 con 0x7ff42c100c80 2023-03-02T11:05:35.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.072+0000 7ff429ffb700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff41809b480 0x7ff41809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff429ffb700 1 -- 172.21.15.57:0/3786555839 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff41c0c6360 con 0x7ff42c100c80 2023-03-02T11:05:35.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff4237fe700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff41809b480 0x7ff41809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff445deab80 1 Processor -- start 2023-03-02T11:05:35.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff445deab80 1 -- start start 2023-03-02T11:05:35.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff445deab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 0x564d6fdc5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff445deab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdc9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff445deab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdca110 0x564d6fdca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff445deab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fd2ca60 con 0x564d6fdc5cd0 2023-03-02T11:05:35.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff445deab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fcdef80 con 0x564d6fdca110 2023-03-02T11:05:35.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff445deab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fcaf160 con 0x564d6fdc53c0 2023-03-02T11:05:35.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff4237fe700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff41809b480 0x7ff41809d930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff42c10b390 tx=0x7ff414009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:35.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff4237fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdc9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 0x564d6fdc5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff43099c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdca110 0x564d6fdca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff4237fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdc9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60800/0 (socket says 172.21.15.57:60800) 2023-03-02T11:05:35.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff4237fe700 1 -- 172.21.15.57:0/1954482509 learned_addr learned my addr 172.21.15.57:0/1954482509 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:05:35.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.073+0000 7ff42bfff700 1 --2- 172.21.15.57:0/1954482509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 0x564d6fdc5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:51392/0 (socket says 172.21.15.57:51392) 2023-03-02T11:05:35.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.074+0000 7ff43099c700 1 -- 172.21.15.57:0/1954482509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 msgr2=0x564d6fdc5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:35.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.074+0000 7ff43099c700 1 --2- 172.21.15.57:0/1954482509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 0x564d6fdc5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.074+0000 7ff43099c700 1 -- 172.21.15.57:0/1954482509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 msgr2=0x564d6fdc9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:35.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.074+0000 7ff43099c700 1 --2- 172.21.15.57:0/1954482509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdc9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.074+0000 7ff43099c700 1 -- 172.21.15.57:0/1954482509 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d6fb99630 con 0x564d6fdca110 2023-03-02T11:05:35.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.074+0000 7ff4237fe700 1 --2- 172.21.15.57:0/1954482509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdc9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:05:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.074+0000 7ff43099c700 1 --2- 172.21.15.57:0/1954482509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdca110 0x564d6fdca560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff424011550 tx=0x7ff424009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d616853b68b361ca server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.074+0000 7ff4227fc700 1 -- 172.21.15.57:0/1954482509 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400e040 con 0x564d6fdca110 2023-03-02T11:05:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.074+0000 7ff4227fc700 1 -- 172.21.15.57:0/1954482509 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff42400f040 con 0x564d6fdca110 2023-03-02T11:05:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.074+0000 7ff4227fc700 1 -- 172.21.15.57:0/1954482509 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424004430 con 0x564d6fdca110 2023-03-02T11:05:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.075+0000 7ff445deab80 1 -- 172.21.15.57:0/1954482509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdca110 msgr2=0x564d6fdca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.075+0000 7ff445deab80 1 --2- 172.21.15.57:0/1954482509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdca110 0x564d6fdca560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff424011550 tx=0x7ff424009920 comp rx=0 tx=0).stop 2023-03-02T11:05:35.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.075+0000 7ff445deab80 1 -- 172.21.15.57:0/1954482509 shutdown_connections 2023-03-02T11:05:35.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.075+0000 7ff445deab80 1 --2- 172.21.15.57:0/1954482509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdca110 0x564d6fdca560 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.075+0000 7ff445deab80 1 --2- 172.21.15.57:0/1954482509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 0x564d6fdc5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.075+0000 7ff445deab80 1 --2- 172.21.15.57:0/1954482509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdc9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.075+0000 7ff445deab80 1 -- 172.21.15.57:0/1954482509 >> 172.21.15.57:0/1954482509 conn(0x564d6fdbac50 msgr2=0x564d6fdc0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:35.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.075+0000 7ff445deab80 1 -- 172.21.15.57:0/1954482509 shutdown_connections 2023-03-02T11:05:35.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.075+0000 7ff445deab80 1 -- 172.21.15.57:0/1954482509 wait complete. 2023-03-02T11:05:35.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.075+0000 7ff445deab80 1 -- start start 2023-03-02T11:05:35.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.075+0000 7ff445deab80 1 Processor -- start 2023-03-02T11:05:35.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff445deab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 0x564d6fdcec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff445deab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdcf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff445deab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdca110 0x564d6fdcf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff445deab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fd1dbc0 con 0x564d6fdc5cd0 2023-03-02T11:05:35.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff445deab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fd170f0 con 0x564d6fdca110 2023-03-02T11:05:35.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff445deab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fb9b920 con 0x564d6fdc53c0 2023-03-02T11:05:35.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff445deab80 10 client.0 _ll_register_callbacks cb 0x564d6fcbd520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:05:35.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 0x564d6fdcec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff4237fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdcf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 0x564d6fdcec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:51396/0 (socket says 172.21.15.57:51396) 2023-03-02T11:05:35.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff42bfff700 1 -- 172.21.15.57:0/3014787867 learned_addr learned my addr 172.21.15.57:0/3014787867 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:05:35.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff43099c700 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdca110 0x564d6fdcf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff42bfff700 1 -- 172.21.15.57:0/3014787867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdca110 msgr2=0x564d6fdcf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:35.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff42bfff700 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdca110 0x564d6fdcf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff42bfff700 1 -- 172.21.15.57:0/3014787867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 msgr2=0x564d6fdcf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:35.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff42bfff700 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdcf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff42bfff700 1 -- 172.21.15.57:0/3014787867 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff424011230 con 0x564d6fdc53c0 2023-03-02T11:05:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.076+0000 7ff4237fe700 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdcf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:05:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff42bfff700 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 0x564d6fdcec10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff41c091ce0 tx=0x7ff41c021b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a368621da677e8d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff40b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:05:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff40b7fe700 1 -- 172.21.15.57:0/3014787867 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0957e0 con 0x564d6fdc53c0 2023-03-02T11:05:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff40b7fe700 1 -- 172.21.15.57:0/3014787867 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff41c0c6040 con 0x564d6fdc53c0 2023-03-02T11:05:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff445deab80 1 -- 172.21.15.57:0/3014787867 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d6fce87b0 con 0x564d6fdc53c0 2023-03-02T11:05:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff40b7fe700 1 -- 172.21.15.57:0/3014787867 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff41c09ce70 con 0x564d6fdc53c0 2023-03-02T11:05:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff445deab80 10 client.26188 fetch_fsmap learned FSMap version 47 2023-03-02T11:05:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff445deab80 1 -- 172.21.15.57:0/3014787867 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x564d6fb45de0 con 0x564d6fdc53c0 2023-03-02T11:05:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff40b7fe700 1 -- 172.21.15.57:0/3014787867 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564d6fce87b0 con 0x564d6fdc53c0 2023-03-02T11:05:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff40b7fe700 1 -- 172.21.15.57:0/3014787867 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff41c09c9e0 con 0x564d6fdc53c0 2023-03-02T11:05:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff445deab80 10 client.26188 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:05:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff445deab80 10 client.26188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:05:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff445deab80 20 client.26188 populate_metadata read hostname 'smithi057' 2023-03-02T11:05:35.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff445deab80 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564d6fddef20 0x564d6fde1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff445deab80 4 client.26188 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:05:35.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.077+0000 7ff445deab80 1 -- 172.21.15.57:0/3014787867 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d6fd10170 con 0x564d6fddef20 2023-03-02T11:05:35.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.078+0000 7ff4237fe700 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564d6fddef20 0x564d6fde1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.078+0000 7ff4237fe700 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564d6fddef20 0x564d6fde1330 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5945a0fe6fb0012 server_cookie=7614825fa0a64f78 in_seq=0 out_seq=0 2023-03-02T11:05:35.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.078+0000 7ff40b7fe700 10 client.26188 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:05:35.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff40b7fe700 1 -- 172.21.15.57:0/3014787867 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x564d6fd10170 con 0x564d6fddef20 2023-03-02T11:05:35.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff40b7fe700 10 client.26188 handle_command_reply: tid=0 2023-03-02T11:05:35.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 1 client.26188 shutdown 2023-03-02T11:05:35.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 1 -- 172.21.15.57:0/3014787867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 msgr2=0x564d6fdcec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:35.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 0x564d6fdcec10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff41c091ce0 tx=0x7ff41c021b40 comp rx=0 tx=0).stop 2023-03-02T11:05:35.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 1 -- 172.21.15.57:0/3014787867 shutdown_connections 2023-03-02T11:05:35.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564d6fddef20 0x564d6fde1330 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdca110 0x564d6fdcf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdc53c0 0x564d6fdcec10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff40b7fe700 0 client.26188 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:05:35.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 1 --2- 172.21.15.57:0/3014787867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdcf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 1 -- 172.21.15.57:0/3014787867 >> 172.21.15.57:0/3014787867 conn(0x564d6fdbac50 msgr2=0x564d6fdbfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:35.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 1 -- 172.21.15.57:0/3014787867 shutdown_connections 2023-03-02T11:05:35.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 1 -- 172.21.15.57:0/3014787867 wait complete. 2023-03-02T11:05:35.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.079+0000 7ff445deab80 20 client.26188 trim_cache size 0 max 16384 2023-03-02T11:05:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff445deab80 1 Processor -- start 2023-03-02T11:05:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff445deab80 1 -- start start 2023-03-02T11:05:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff445deab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 0x564d6fdcded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff445deab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdc9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff445deab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdca110 0x564d6fdcf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff445deab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fde5ee0 con 0x564d6fdc5cd0 2023-03-02T11:05:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff445deab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fdc9da0 con 0x564d6fdc53c0 2023-03-02T11:05:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff445deab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fddb050 con 0x564d6fdca110 2023-03-02T11:05:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 0x564d6fdcded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff4237fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdc9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 0x564d6fdcded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:46460/0 (socket says 172.21.15.57:46460) 2023-03-02T11:05:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff42bfff700 1 -- 172.21.15.57:0/1179761820 learned_addr learned my addr 172.21.15.57:0/1179761820 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:05:35.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.096+0000 7ff43099c700 1 --2- 172.21.15.57:0/1179761820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdca110 0x564d6fdcf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff42bfff700 1 -- 172.21.15.57:0/1179761820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdca110 msgr2=0x564d6fdcf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:35.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff42bfff700 1 --2- 172.21.15.57:0/1179761820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdca110 0x564d6fdcf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff42bfff700 1 -- 172.21.15.57:0/1179761820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 msgr2=0x564d6fdc9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:35.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff42bfff700 1 --2- 172.21.15.57:0/1179761820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdc9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff42bfff700 1 -- 172.21.15.57:0/1179761820 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d6fcde190 con 0x564d6fdc53c0 2023-03-02T11:05:35.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff42bfff700 1 --2- 172.21.15.57:0/1179761820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 0x564d6fdcded0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff41c093b30 tx=0x7ff41c0c3eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4deb5adc75886fc3 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:35.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff422ffd700 1 -- 172.21.15.57:0/1179761820 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c091960 con 0x564d6fdc53c0 2023-03-02T11:05:35.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff422ffd700 1 -- 172.21.15.57:0/1179761820 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff41c0c6040 con 0x564d6fdc53c0 2023-03-02T11:05:35.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff422ffd700 1 -- 172.21.15.57:0/1179761820 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0957e0 con 0x564d6fdc53c0 2023-03-02T11:05:35.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff445deab80 1 -- 172.21.15.57:0/1179761820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 msgr2=0x564d6fdcded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:35.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff445deab80 1 --2- 172.21.15.57:0/1179761820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 0x564d6fdcded0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff41c093b30 tx=0x7ff41c0c3eb0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff445deab80 1 -- 172.21.15.57:0/1179761820 shutdown_connections 2023-03-02T11:05:35.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff445deab80 1 --2- 172.21.15.57:0/1179761820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdca110 0x564d6fdcf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff445deab80 1 --2- 172.21.15.57:0/1179761820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 0x564d6fdcded0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff445deab80 1 --2- 172.21.15.57:0/1179761820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdc9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.097+0000 7ff445deab80 1 -- 172.21.15.57:0/1179761820 >> 172.21.15.57:0/1179761820 conn(0x564d6fdbac50 msgr2=0x564d6fdc9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:35.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff445deab80 1 -- 172.21.15.57:0/1179761820 shutdown_connections 2023-03-02T11:05:35.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff445deab80 1 -- 172.21.15.57:0/1179761820 wait complete. 2023-03-02T11:05:35.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff445deab80 1 -- start start 2023-03-02T11:05:35.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff445deab80 1 Processor -- start 2023-03-02T11:05:35.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff445deab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 0x564d6fdd4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff445deab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdd4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff445deab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdca110 0x564d6fdd51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff445deab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fe307e0 con 0x564d6fdc5cd0 2023-03-02T11:05:35.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff445deab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fe30920 con 0x564d6fdc53c0 2023-03-02T11:05:35.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff445deab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6fe30a60 con 0x564d6fdca110 2023-03-02T11:05:35.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff445deab80 10 client.0 _ll_register_callbacks cb 0x564d6fcbd520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:05:35.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 0x564d6fdd4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff4237fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdd4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff43099c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdca110 0x564d6fdd51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.098+0000 7ff4237fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdd4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60836/0 (socket says 172.21.15.57:60836) 2023-03-02T11:05:35.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff4237fe700 1 -- 172.21.15.57:0/1199252750 learned_addr learned my addr 172.21.15.57:0/1199252750 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:05:35.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff42bfff700 1 -- 172.21.15.57:0/1199252750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdca110 msgr2=0x564d6fdd51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:35.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff42bfff700 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdca110 0x564d6fdd51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff42bfff700 1 -- 172.21.15.57:0/1199252750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 msgr2=0x564d6fdd4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:05:35.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff42bfff700 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdd4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff42bfff700 1 -- 172.21.15.57:0/1199252750 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d6fb45de0 con 0x564d6fdc53c0 2023-03-02T11:05:35.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff4237fe700 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdd4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:05:35.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff42bfff700 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 0x564d6fdd4770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0b1000 tx=0x7ff41c091c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12a40975d44272e2 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:05:35.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff40b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:05:35.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff40b7fe700 1 -- 172.21.15.57:0/1199252750 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c094ed0 con 0x564d6fdc53c0 2023-03-02T11:05:35.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff445deab80 1 -- 172.21.15.57:0/1199252750 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff42400f040 con 0x564d6fdc53c0 2023-03-02T11:05:35.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff40b7fe700 1 -- 172.21.15.57:0/1199252750 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff41c09ce70 con 0x564d6fdc53c0 2023-03-02T11:05:35.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff40b7fe700 1 -- 172.21.15.57:0/1199252750 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff41c0957e0 con 0x564d6fdc53c0 2023-03-02T11:05:35.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff445deab80 10 client.26243 fetch_fsmap learned FSMap version 47 2023-03-02T11:05:35.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.099+0000 7ff445deab80 1 -- 172.21.15.57:0/1199252750 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x564d6fb6c250 con 0x564d6fdc53c0 2023-03-02T11:05:35.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.100+0000 7ff40b7fe700 1 -- 172.21.15.57:0/1199252750 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff41c0a6080 con 0x564d6fdc53c0 2023-03-02T11:05:35.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.100+0000 7ff40b7fe700 1 -- 172.21.15.57:0/1199252750 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff41c07c030 con 0x564d6fdc53c0 2023-03-02T11:05:35.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.100+0000 7ff445deab80 10 client.26243 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:05:35.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.100+0000 7ff445deab80 10 client.26243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:05:35.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.100+0000 7ff445deab80 20 client.26243 populate_metadata read hostname 'smithi057' 2023-03-02T11:05:35.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.100+0000 7ff445deab80 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564d6fe31ca0 0x564d6fe34080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:05:35.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.100+0000 7ff445deab80 4 client.26243 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:05:35.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.100+0000 7ff445deab80 1 -- 172.21.15.57:0/1199252750 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564d6fd0fe90 con 0x564d6fe31ca0 2023-03-02T11:05:35.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.100+0000 7ff4237fe700 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564d6fe31ca0 0x564d6fe34080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:35.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.100+0000 7ff40b7fe700 10 client.26243 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:05:35.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.100+0000 7ff4237fe700 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564d6fe31ca0 0x564d6fe34080 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6b1e6695858662e server_cookie=db490624c144271e in_seq=0 out_seq=0 2023-03-02T11:05:35.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff40b7fe700 1 -- 172.21.15.57:0/1199252750 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564d6fd0fe90 con 0x564d6fe31ca0 2023-03-02T11:05:35.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff40b7fe700 10 client.26243 handle_command_reply: tid=0 2023-03-02T11:05:35.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 1 client.26243 shutdown 2023-03-02T11:05:35.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 1 -- 172.21.15.57:0/1199252750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 msgr2=0x564d6fdd4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:35.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 0x564d6fdd4770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0b1000 tx=0x7ff41c091c40 comp rx=0 tx=0).stop 2023-03-02T11:05:35.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 1 -- 172.21.15.57:0/1199252750 shutdown_connections 2023-03-02T11:05:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564d6fe31ca0 0x564d6fe34080 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d6fdca110 0x564d6fdd51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d6fdc53c0 0x564d6fdd4770 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 1 --2- 172.21.15.57:0/1199252750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564d6fdc5cd0 0x564d6fdd4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff40b7fe700 0 client.26243 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:05:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 1 -- 172.21.15.57:0/1199252750 >> 172.21.15.57:0/1199252750 conn(0x564d6fdbac50 msgr2=0x564d6fdc41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 1 -- 172.21.15.57:0/1199252750 shutdown_connections 2023-03-02T11:05:35.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 1 -- 172.21.15.57:0/1199252750 wait complete. 2023-03-02T11:05:35.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.101+0000 7ff445deab80 20 client.26243 trim_cache size 0 max 16384 2023-03-02T11:05:35.112 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:05:35.112 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:05:35.112 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:05:35.112 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:05:35.113 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:05:35.113 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:05:35.113 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:05:35.113 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:05:35.113 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:05:35.113 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:05:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 -- 172.21.15.57:0/3786555839 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff41809b480 msgr2=0x7ff41809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff41809b480 0x7ff41809d930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff42c10b390 tx=0x7ff414009260 comp rx=0 tx=0).stop 2023-03-02T11:05:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 -- 172.21.15.57:0/3786555839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42c100c80 msgr2=0x7ff42c19b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:05:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42c100c80 0x7ff42c19b9b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff41c000c00 tx=0x7ff41c004790 comp rx=0 tx=0).stop 2023-03-02T11:05:35.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 -- 172.21.15.57:0/3786555839 shutdown_connections 2023-03-02T11:05:35.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff41809b480 0x7ff41809d930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff42c10a050 0x7ff42c195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff42c100c80 0x7ff42c19b9b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 --2- 172.21.15.57:0/3786555839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff42c101590 0x7ff42c19bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:05:35.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 -- 172.21.15.57:0/3786555839 >> 172.21.15.57:0/3786555839 conn(0x7ff42c0fa4b0 msgr2=0x7ff42c10c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:05:35.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 -- 172.21.15.57:0/3786555839 shutdown_connections 2023-03-02T11:05:35.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:05:35.102+0000 7ff4323ff700 1 -- 172.21.15.57:0/3786555839 wait complete. 2023-03-02T11:05:35.117 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:05:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:36 smithi136 ceph-mon[125702]: pgmap v264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:36 smithi057 ceph-mon[92072]: pgmap v264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:36 smithi122 ceph-mon[125440]: pgmap v264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:38 smithi136 ceph-mon[125702]: pgmap v265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:05:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:38 smithi057 ceph-mon[92072]: pgmap v265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:05:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:38 smithi122 ceph-mon[125440]: pgmap v265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:05:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:40 smithi136 ceph-mon[125702]: pgmap v266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:40 smithi057 ceph-mon[92072]: pgmap v266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:40 smithi122 ceph-mon[125440]: pgmap v266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:42 smithi136 ceph-mon[125702]: pgmap v267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:42 smithi057 ceph-mon[92072]: pgmap v267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:42 smithi122 ceph-mon[125440]: pgmap v267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:44 smithi136 ceph-mon[125702]: pgmap v268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:05:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:44 smithi057 ceph-mon[92072]: pgmap v268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:05:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:44 smithi122 ceph-mon[125440]: pgmap v268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:05:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:46 smithi136 ceph-mon[125702]: pgmap v269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:46 smithi057 ceph-mon[92072]: pgmap v269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:46 smithi122 ceph-mon[125440]: pgmap v269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:48 smithi136 ceph-mon[125702]: pgmap v270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:05:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:48 smithi057 ceph-mon[92072]: pgmap v270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:05:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:48 smithi122 ceph-mon[125440]: pgmap v270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:05:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:49.120+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:05:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:49.120+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:05:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:49.120+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:05:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:49.120+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:05:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:05:49.120+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:05:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:50 smithi136 ceph-mon[125702]: pgmap v271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:50 smithi057 ceph-mon[92072]: pgmap v271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:50 smithi122 ceph-mon[125440]: pgmap v271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:05:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:52 smithi136 ceph-mon[125702]: pgmap v272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:52 smithi057 ceph-mon[92072]: pgmap v272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:52 smithi122 ceph-mon[125440]: pgmap v272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:54 smithi057 ceph-mon[92072]: pgmap v273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:05:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:54 smithi122 ceph-mon[125440]: pgmap v273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:05:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:54 smithi136 ceph-mon[125702]: pgmap v273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:05:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:56 smithi057 ceph-mon[92072]: pgmap v274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:56 smithi122 ceph-mon[125440]: pgmap v274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:56 smithi136 ceph-mon[125702]: pgmap v274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:05:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:05:58 smithi057 ceph-mon[92072]: pgmap v275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:05:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:05:58 smithi122 ceph-mon[125440]: pgmap v275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:05:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:05:58 smithi136 ceph-mon[125702]: pgmap v275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:06:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:00 smithi057 ceph-mon[92072]: pgmap v276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:06:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:00 smithi122 ceph-mon[125440]: pgmap v276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:06:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:00 smithi136 ceph-mon[125702]: pgmap v276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:06:01.682 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 11:06:01 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T11:06:01.277+0000 7f458b45d700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T11:06:01.683 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 11:06:01 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T11:06:01.277+0000 7f458b45d700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T11:06:01.683 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 11:06:01 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T11:06:01.277+0000 7f458b45d700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T11:06:01.683 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 11:06:01 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T11:06:01.277+0000 7f458b45d700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T11:06:01.683 INFO:journalctl@ceph.mgr.x.smithi057.stdout:Mar 02 11:06:01 smithi057 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-x[92319]: 2023-03-02T11:06:01.277+0000 7f458b45d700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-02T11:06:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:02.628+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 8 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f5878095ee0 con 0x7f5880105ae0 2023-03-02T11:06:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:02 smithi057 ceph-mon[92072]: pgmap v277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:02 smithi122 ceph-mon[125440]: pgmap v277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:02 smithi136 ceph-mon[125702]: pgmap v277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:03 smithi057 ceph-mon[92072]: mgrmap e26: x(active, since 9m), standbys: y, z 2023-03-02T11:06:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:03 smithi057 ceph-mon[92072]: pgmap v278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-02T11:06:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:03 smithi122 ceph-mon[125440]: mgrmap e26: x(active, since 9m), standbys: y, z 2023-03-02T11:06:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:03 smithi122 ceph-mon[125440]: pgmap v278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-02T11:06:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:03 smithi136 ceph-mon[125702]: mgrmap e26: x(active, since 9m), standbys: y, z 2023-03-02T11:06:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:03 smithi136 ceph-mon[125702]: pgmap v278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-02T11:06:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:04.126+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:04.126+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:06:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:04.126+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:06:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:04.126+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:06:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:04.126+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:06:05.119 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:06:05.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.290+0000 7fd78bbff700 1 -- 172.21.15.57:0/3831793873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd78410a050 msgr2=0x7fd78410c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:05.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.290+0000 7fd78bbff700 1 --2- 172.21.15.57:0/3831793873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd78410a050 0x7fd78410c490 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00b0a0 tx=0x7fd77c00b3b0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.290+0000 7fd78bbff700 1 -- 172.21.15.57:0/3831793873 shutdown_connections 2023-03-02T11:06:05.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.290+0000 7fd78bbff700 1 --2- 172.21.15.57:0/3831793873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd78410a050 0x7fd78410c490 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.290+0000 7fd78bbff700 1 --2- 172.21.15.57:0/3831793873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd784100c80 0x7fd784101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.290+0000 7fd78bbff700 1 --2- 172.21.15.57:0/3831793873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd784101590 0x7fd784109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.290+0000 7fd78bbff700 1 -- 172.21.15.57:0/3831793873 >> 172.21.15.57:0/3831793873 conn(0x7fd7840fa4b0 msgr2=0x7fd7840fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:05.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.290+0000 7fd78bbff700 1 -- 172.21.15.57:0/3831793873 shutdown_connections 2023-03-02T11:06:05.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.290+0000 7fd78bbff700 1 -- 172.21.15.57:0/3831793873 wait complete. 2023-03-02T11:06:05.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.291+0000 7fd78bbff700 1 Processor -- start 2023-03-02T11:06:05.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.291+0000 7fd78bbff700 1 -- start start 2023-03-02T11:06:05.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.291+0000 7fd78bbff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd784100c80 0x7fd784197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.291+0000 7fd78bbff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd784101590 0x7fd784198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.291+0000 7fd78bbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd78410a050 0x7fd78419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.291+0000 7fd78bbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78419ce70 con 0x7fd78410a050 2023-03-02T11:06:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.291+0000 7fd78bbff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78419cfe0 con 0x7fd784101590 2023-03-02T11:06:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.291+0000 7fd78bbff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78419d1a0 con 0x7fd784100c80 2023-03-02T11:06:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78999b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd784100c80 0x7fd784197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78919a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd784101590 0x7fd784198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78999b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd784100c80 0x7fd784197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:35404/0 (socket says 172.21.15.57:35404) 2023-03-02T11:06:05.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78999b700 1 -- 172.21.15.57:0/1940109907 learned_addr learned my addr 172.21.15.57:0/1940109907 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:06:05.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78a19c700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd78410a050 0x7fd78419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78999b700 1 -- 172.21.15.57:0/1940109907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd784101590 msgr2=0x7fd784198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:05.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78999b700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd784101590 0x7fd784198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78999b700 1 -- 172.21.15.57:0/1940109907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd78410a050 msgr2=0x7fd78419c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:05.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78999b700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd78410a050 0x7fd78419c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78999b700 1 -- 172.21.15.57:0/1940109907 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c009d00 con 0x7fd784100c80 2023-03-02T11:06:05.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78919a700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd784101590 0x7fd784198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:06:05.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78a19c700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd78410a050 0x7fd78419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:06:05.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78999b700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd784100c80 0x7fd784197f00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd78000e9a0 tx=0x7fd78000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:05.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd77affd700 1 -- 172.21.15.57:0/1940109907 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780009790 con 0x7fd784100c80 2023-03-02T11:06:05.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.292+0000 7fd78bbff700 1 -- 172.21.15.57:0/1940109907 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78410fad0 con 0x7fd784100c80 2023-03-02T11:06:05.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.293+0000 7fd77affd700 1 -- 172.21.15.57:0/1940109907 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd780010430 con 0x7fd784100c80 2023-03-02T11:06:05.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.293+0000 7fd77affd700 1 -- 172.21.15.57:0/1940109907 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780018680 con 0x7fd784100c80 2023-03-02T11:06:05.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.293+0000 7fd78bbff700 1 -- 172.21.15.57:0/1940109907 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78410f940 con 0x7fd784100c80 2023-03-02T11:06:05.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.295+0000 7fd77affd700 1 -- 172.21.15.57:0/1940109907 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fd78000c040 con 0x7fd784100c80 2023-03-02T11:06:05.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.297+0000 7fd77affd700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd77009b480 0x7fd77009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.297+0000 7fd79f443b80 1 Processor -- start 2023-03-02T11:06:05.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.297+0000 7fd79f443b80 1 -- start start 2023-03-02T11:06:05.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.297+0000 7fd78919a700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd77009b480 0x7fd77009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.297+0000 7fd77affd700 1 -- 172.21.15.57:0/1940109907 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fd780014070 con 0x7fd784100c80 2023-03-02T11:06:05.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.297+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a393c0 0x5584a7a39790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.297+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a39cd0 0x5584a7a3dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.297+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a3e110 0x5584a7a3e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.297+0000 7fd79f443b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a79a0a60 con 0x5584a7a393c0 2023-03-02T11:06:05.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.297+0000 7fd79f443b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a7952f80 con 0x5584a7a3e110 2023-03-02T11:06:05.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.297+0000 7fd79f443b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a7923160 con 0x5584a7a39cd0 2023-03-02T11:06:05.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78999b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a393c0 0x5584a7a39790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78999b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a393c0 0x5584a7a39790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50336/0 (socket says 172.21.15.57:50336) 2023-03-02T11:06:05.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78a19c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a3e110 0x5584a7a3e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78999b700 1 -- 172.21.15.57:0/3570708412 learned_addr learned my addr 172.21.15.57:0/3570708412 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:06:05.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78919a700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd77009b480 0x7fd77009d930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd7841994a0 tx=0x7fd774009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:05.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78919a700 1 --2- 172.21.15.57:0/3570708412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a39cd0 0x5584a7a3dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78999b700 1 -- 172.21.15.57:0/3570708412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a39cd0 msgr2=0x5584a7a3dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:05.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78999b700 1 --2- 172.21.15.57:0/3570708412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a39cd0 0x5584a7a3dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78999b700 1 -- 172.21.15.57:0/3570708412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a3e110 msgr2=0x5584a7a3e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:05.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78999b700 1 --2- 172.21.15.57:0/3570708412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a3e110 0x5584a7a3e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78999b700 1 -- 172.21.15.57:0/3570708412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584a780d630 con 0x5584a7a393c0 2023-03-02T11:06:05.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78919a700 1 --2- 172.21.15.57:0/3570708412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a39cd0 0x5584a7a3dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T11:06:05.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd78999b700 1 --2- 172.21.15.57:0/3570708412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a393c0 0x5584a7a39790 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd780010c30 tx=0x7fd7800943d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd33c3224dd47273 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:05.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd76ffff700 1 -- 172.21.15.57:0/3570708412 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780098170 con 0x5584a7a393c0 2023-03-02T11:06:05.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd76ffff700 1 -- 172.21.15.57:0/3570708412 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd780094790 con 0x5584a7a393c0 2023-03-02T11:06:05.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.298+0000 7fd76ffff700 1 -- 172.21.15.57:0/3570708412 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780093ee0 con 0x5584a7a393c0 2023-03-02T11:06:05.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.299+0000 7fd79f443b80 1 -- 172.21.15.57:0/3570708412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a393c0 msgr2=0x5584a7a39790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:05.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.299+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3570708412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a393c0 0x5584a7a39790 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd780010c30 tx=0x7fd7800943d0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.299+0000 7fd79f443b80 1 -- 172.21.15.57:0/3570708412 shutdown_connections 2023-03-02T11:06:05.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.299+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3570708412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a3e110 0x5584a7a3e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.299+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3570708412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a393c0 0x5584a7a39790 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.299+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3570708412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a39cd0 0x5584a7a3dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.299+0000 7fd79f443b80 1 -- 172.21.15.57:0/3570708412 >> 172.21.15.57:0/3570708412 conn(0x5584a7a2ec50 msgr2=0x5584a7a34460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:05.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.299+0000 7fd79f443b80 1 -- 172.21.15.57:0/3570708412 shutdown_connections 2023-03-02T11:06:05.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.299+0000 7fd79f443b80 1 -- 172.21.15.57:0/3570708412 wait complete. 2023-03-02T11:06:05.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.299+0000 7fd79f443b80 1 -- start start 2023-03-02T11:06:05.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.299+0000 7fd79f443b80 1 Processor -- start 2023-03-02T11:06:05.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 0x5584a7a42ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 0x5584a7a43290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd79f443b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a7991bc0 con 0x5584a7a3e110 2023-03-02T11:06:05.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd79f443b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a798b0f0 con 0x5584a7a39cd0 2023-03-02T11:06:05.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd79f443b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a780f920 con 0x5584a7a393c0 2023-03-02T11:06:05.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd79f443b80 10 client.0 _ll_register_callbacks cb 0x5584a7931520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:06:05.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78a19c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 0x5584a7a43290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78999b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78919a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 0x5584a7a42ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78999b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:35422/0 (socket says 172.21.15.57:35422) 2023-03-02T11:06:05.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78999b700 1 -- 172.21.15.57:0/3299099863 learned_addr learned my addr 172.21.15.57:0/3299099863 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:06:05.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78a19c700 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 0x5584a7a43290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50352/0 (socket says 172.21.15.57:50352) 2023-03-02T11:06:05.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78999b700 1 -- 172.21.15.57:0/3299099863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 msgr2=0x5584a7a42ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:05.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78999b700 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 0x5584a7a42ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78999b700 1 -- 172.21.15.57:0/3299099863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 msgr2=0x5584a7a43290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:05.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78999b700 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 0x5584a7a43290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78999b700 1 -- 172.21.15.57:0/3299099863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7800c4040 con 0x5584a7a393c0 2023-03-02T11:06:05.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.300+0000 7fd78a19c700 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 0x5584a7a43290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:06:05.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd78999b700 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd780094df0 tx=0x7fd78000c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ddb7a6bd1190446 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:05.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd76d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:06:05.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3299099863 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780092b30 con 0x5584a7a393c0 2023-03-02T11:06:05.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3299099863 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fd78009ba20 con 0x5584a7a393c0 2023-03-02T11:06:05.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd79f443b80 1 -- 172.21.15.57:0/3299099863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584a795c7b0 con 0x5584a7a393c0 2023-03-02T11:06:05.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3299099863 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd78009bbe0 con 0x5584a7a393c0 2023-03-02T11:06:05.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd79f443b80 10 client.26212 fetch_fsmap learned FSMap version 47 2023-03-02T11:06:05.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd79f443b80 1 -- 172.21.15.57:0/3299099863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5584a77b9de0 con 0x5584a7a393c0 2023-03-02T11:06:05.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3299099863 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5584a795c7b0 con 0x5584a7a393c0 2023-03-02T11:06:05.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3299099863 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd7800be030 con 0x5584a7a393c0 2023-03-02T11:06:05.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd79f443b80 10 client.26212 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:06:05.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd79f443b80 10 client.26212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:06:05.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd79f443b80 20 client.26212 populate_metadata read hostname 'smithi057' 2023-03-02T11:06:05.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.301+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5584a7a52e90 0x5584a7a552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.302+0000 7fd79f443b80 4 client.26212 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:06:05.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.302+0000 7fd79f443b80 1 -- 172.21.15.57:0/3299099863 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584a7984170 con 0x5584a7a52e90 2023-03-02T11:06:05.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.302+0000 7fd78919a700 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5584a7a52e90 0x5584a7a552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.302+0000 7fd78919a700 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5584a7a52e90 0x5584a7a552a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=975e510f04c08225 server_cookie=6d4c4c61a325b10a in_seq=0 out_seq=0 2023-03-02T11:06:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.302+0000 7fd76d7fa700 10 client.26212 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:06:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3299099863 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5584a7984170 con 0x5584a7a52e90 2023-03-02T11:06:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd76d7fa700 10 client.26212 handle_command_reply: tid=0 2023-03-02T11:06:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 1 client.26212 shutdown 2023-03-02T11:06:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 1 -- 172.21.15.57:0/3299099863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 msgr2=0x5584a7a45920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd780094df0 tx=0x7fd78000c4d0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 1 -- 172.21.15.57:0/3299099863 shutdown_connections 2023-03-02T11:06:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5584a7a52e90 0x5584a7a552a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 0x5584a7a43290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd76d7fa700 0 client.26212 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:06:05.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45920 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3299099863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 0x5584a7a42ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 1 -- 172.21.15.57:0/3299099863 >> 172.21.15.57:0/3299099863 conn(0x5584a7a2ec50 msgr2=0x5584a7a33ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:05.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 1 -- 172.21.15.57:0/3299099863 shutdown_connections 2023-03-02T11:06:05.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 1 -- 172.21.15.57:0/3299099863 wait complete. 2023-03-02T11:06:05.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.303+0000 7fd79f443b80 20 client.26212 trim_cache size 0 max 16384 2023-03-02T11:06:05.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.320+0000 7fd79f443b80 1 Processor -- start 2023-03-02T11:06:05.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.320+0000 7fd79f443b80 1 -- start start 2023-03-02T11:06:05.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.320+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.320+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a39cd0 0x5584a7a42440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.320+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a3e110 0x5584a7a42980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.320+0000 7fd79f443b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a7a351d0 con 0x5584a7a39cd0 2023-03-02T11:06:05.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.320+0000 7fd79f443b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a7a34f50 con 0x5584a7a3e110 2023-03-02T11:06:05.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.320+0000 7fd79f443b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a7a59e50 con 0x5584a7a393c0 2023-03-02T11:06:05.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78999b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78a19c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a3e110 0x5584a7a42980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78919a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a39cd0 0x5584a7a42440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78999b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:35428/0 (socket says 172.21.15.57:35428) 2023-03-02T11:06:05.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78999b700 1 -- 172.21.15.57:0/815295942 learned_addr learned my addr 172.21.15.57:0/815295942 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:06:05.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78919a700 1 -- 172.21.15.57:0/815295942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 msgr2=0x5584a7a45450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:05.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78919a700 1 --2- 172.21.15.57:0/815295942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78919a700 1 -- 172.21.15.57:0/815295942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a3e110 msgr2=0x5584a7a42980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:05.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78919a700 1 --2- 172.21.15.57:0/815295942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a3e110 0x5584a7a42980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78919a700 1 -- 172.21.15.57:0/815295942 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584a7952190 con 0x5584a7a39cd0 2023-03-02T11:06:05.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78999b700 1 --2- 172.21.15.57:0/815295942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:06:05.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78a19c700 1 --2- 172.21.15.57:0/815295942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a3e110 0x5584a7a42980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:06:05.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd78919a700 1 --2- 172.21.15.57:0/815295942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a39cd0 0x5584a7a42440 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x5584a7a55b80 tx=0x7fd774014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204cd45426dd00b6 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:05.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd778bff700 1 -- 172.21.15.57:0/815295942 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774024040 con 0x5584a7a39cd0 2023-03-02T11:06:05.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd778bff700 1 -- 172.21.15.57:0/815295942 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd77401f840 con 0x5584a7a39cd0 2023-03-02T11:06:05.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.321+0000 7fd778bff700 1 -- 172.21.15.57:0/815295942 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77402a940 con 0x5584a7a39cd0 2023-03-02T11:06:05.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.322+0000 7fd79f443b80 1 -- 172.21.15.57:0/815295942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a39cd0 msgr2=0x5584a7a42440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:05.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.322+0000 7fd79f443b80 1 --2- 172.21.15.57:0/815295942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a39cd0 0x5584a7a42440 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x5584a7a55b80 tx=0x7fd774014000 comp rx=0 tx=0).stop 2023-03-02T11:06:05.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.322+0000 7fd79f443b80 1 -- 172.21.15.57:0/815295942 shutdown_connections 2023-03-02T11:06:05.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.322+0000 7fd79f443b80 1 --2- 172.21.15.57:0/815295942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a3e110 0x5584a7a42980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.322+0000 7fd79f443b80 1 --2- 172.21.15.57:0/815295942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a45450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.322+0000 7fd79f443b80 1 --2- 172.21.15.57:0/815295942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a39cd0 0x5584a7a42440 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.322+0000 7fd79f443b80 1 -- 172.21.15.57:0/815295942 >> 172.21.15.57:0/815295942 conn(0x5584a7a2ec50 msgr2=0x5584a7a4e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:05.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.322+0000 7fd79f443b80 1 -- 172.21.15.57:0/815295942 shutdown_connections 2023-03-02T11:06:05.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.322+0000 7fd79f443b80 1 -- 172.21.15.57:0/815295942 wait complete. 2023-03-02T11:06:05.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.322+0000 7fd79f443b80 1 -- start start 2023-03-02T11:06:05.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd79f443b80 1 Processor -- start 2023-03-02T11:06:05.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a4a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 0x5584a7a48460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd79f443b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 0x5584a7a489a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd79f443b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a7a49090 con 0x5584a7a3e110 2023-03-02T11:06:05.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd79f443b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a7a49200 con 0x5584a7a39cd0 2023-03-02T11:06:05.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd79f443b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a7aa4750 con 0x5584a7a393c0 2023-03-02T11:06:05.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd79f443b80 10 client.0 _ll_register_callbacks cb 0x5584a7931520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:06:05.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd78919a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 0x5584a7a48460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd78999b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a4a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd78919a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 0x5584a7a48460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48454/0 (socket says 172.21.15.57:48454) 2023-03-02T11:06:05.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd78919a700 1 -- 172.21.15.57:0/3066611981 learned_addr learned my addr 172.21.15.57:0/3066611981 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:06:05.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd78a19c700 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 0x5584a7a489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd78919a700 1 -- 172.21.15.57:0/3066611981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 msgr2=0x5584a7a4a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:05.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd78919a700 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a4a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd78919a700 1 -- 172.21.15.57:0/3066611981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 msgr2=0x5584a7a489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:05.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd78919a700 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 0x5584a7a489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.323+0000 7fd78919a700 1 -- 172.21.15.57:0/3066611981 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584a77b9de0 con 0x5584a7a39cd0 2023-03-02T11:06:05.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd78919a700 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 0x5584a7a48460 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd77400a010 tx=0x7fd774020ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5e6cda42ff566d4 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:05.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd76d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:06:05.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3066611981 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774024050 con 0x5584a7a39cd0 2023-03-02T11:06:05.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd79f443b80 1 -- 172.21.15.57:0/3066611981 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd780094790 con 0x5584a7a39cd0 2023-03-02T11:06:05.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3066611981 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fd774021190 con 0x5584a7a39cd0 2023-03-02T11:06:05.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3066611981 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd774021350 con 0x5584a7a39cd0 2023-03-02T11:06:05.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd79f443b80 10 client.26267 fetch_fsmap learned FSMap version 47 2023-03-02T11:06:05.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd79f443b80 1 -- 172.21.15.57:0/3066611981 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7fd78410d150 con 0x5584a7a39cd0 2023-03-02T11:06:05.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3066611981 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd780094790 con 0x5584a7a39cd0 2023-03-02T11:06:05.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3066611981 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd774004870 con 0x5584a7a39cd0 2023-03-02T11:06:05.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd79f443b80 10 client.26267 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:06:05.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd79f443b80 10 client.26267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:06:05.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd79f443b80 20 client.26267 populate_metadata read hostname 'smithi057' 2023-03-02T11:06:05.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5584a7aa5de0 0x5584a7aa81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:05.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd79f443b80 4 client.26267 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:06:05.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.324+0000 7fd79f443b80 1 -- 172.21.15.57:0/3066611981 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5584a7983e90 con 0x5584a7aa5de0 2023-03-02T11:06:05.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd78999b700 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5584a7aa5de0 0x5584a7aa81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:05.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd78999b700 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5584a7aa5de0 0x5584a7aa81f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=791efcf9de6ad2c0 server_cookie=571200b9e194c3ad in_seq=0 out_seq=0 2023-03-02T11:06:05.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd76d7fa700 10 client.26267 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:06:05.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd76d7fa700 1 -- 172.21.15.57:0/3066611981 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5584a7983e90 con 0x5584a7aa5de0 2023-03-02T11:06:05.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd76d7fa700 10 client.26267 handle_command_reply: tid=0 2023-03-02T11:06:05.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd79f443b80 1 client.26267 shutdown 2023-03-02T11:06:05.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd79f443b80 1 -- 172.21.15.57:0/3066611981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 msgr2=0x5584a7a48460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 0x5584a7a48460 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd77400a010 tx=0x7fd774020ec0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd79f443b80 1 -- 172.21.15.57:0/3066611981 shutdown_connections 2023-03-02T11:06:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5584a7aa5de0 0x5584a7aa81f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5584a7a3e110 0x5584a7a489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a7a393c0 0x5584a7a4a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd79f443b80 1 --2- 172.21.15.57:0/3066611981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a7a39cd0 0x5584a7a48460 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd76d7fa700 0 client.26267 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:06:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd79f443b80 1 -- 172.21.15.57:0/3066611981 >> 172.21.15.57:0/3066611981 conn(0x5584a7a2ec50 msgr2=0x5584a7a3d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:05.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd79f443b80 1 -- 172.21.15.57:0/3066611981 shutdown_connections 2023-03-02T11:06:05.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.325+0000 7fd79f443b80 1 -- 172.21.15.57:0/3066611981 wait complete. 2023-03-02T11:06:05.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd79f443b80 20 client.26267 trim_cache size 0 max 16384 2023-03-02T11:06:05.336 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:06:05.336 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:06:05.337 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:06:05.337 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:06:05.337 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:06:05.337 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:06:05.337 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:06:05.337 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:06:05.337 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:06:05.337 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:06:05.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 -- 172.21.15.57:0/1940109907 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd77009b480 msgr2=0x7fd77009d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:05.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd77009b480 0x7fd77009d930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd7841994a0 tx=0x7fd774009260 comp rx=0 tx=0).stop 2023-03-02T11:06:05.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 -- 172.21.15.57:0/1940109907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd784100c80 msgr2=0x7fd784197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:05.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd784100c80 0x7fd784197f00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd78000e9a0 tx=0x7fd78000ecb0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 -- 172.21.15.57:0/1940109907 shutdown_connections 2023-03-02T11:06:05.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd77009b480 0x7fd77009d930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd78410a050 0x7fd78419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd784100c80 0x7fd784197f00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 --2- 172.21.15.57:0/1940109907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd784101590 0x7fd784198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:05.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 -- 172.21.15.57:0/1940109907 >> 172.21.15.57:0/1940109907 conn(0x7fd7840fa4b0 msgr2=0x7fd7840fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:05.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 -- 172.21.15.57:0/1940109907 shutdown_connections 2023-03-02T11:06:05.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:05.326+0000 7fd78bbff700 1 -- 172.21.15.57:0/1940109907 wait complete. 2023-03-02T11:06:05.341 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:06:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:05 smithi136 ceph-mon[125702]: pgmap v279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-03-02T11:06:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:05 smithi057 ceph-mon[92072]: pgmap v279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-03-02T11:06:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:05 smithi122 ceph-mon[125440]: pgmap v279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-03-02T11:06:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:07 smithi136 ceph-mon[125702]: pgmap v280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-02T11:06:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:07 smithi057 ceph-mon[92072]: pgmap v280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-02T11:06:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:07 smithi122 ceph-mon[125440]: pgmap v280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-02T11:06:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:09 smithi136 ceph-mon[125702]: pgmap v281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-03-02T11:06:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:09 smithi057 ceph-mon[92072]: pgmap v281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-03-02T11:06:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:09 smithi122 ceph-mon[125440]: pgmap v281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-03-02T11:06:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:11 smithi136 ceph-mon[125702]: pgmap v282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-03-02T11:06:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:11 smithi136 ceph-mon[125702]: osdmap e92: 12 total, 12 up, 12 in 2023-03-02T11:06:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:11 smithi057 ceph-mon[92072]: pgmap v282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-03-02T11:06:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:11 smithi057 ceph-mon[92072]: osdmap e92: 12 total, 12 up, 12 in 2023-03-02T11:06:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:11 smithi122 ceph-mon[125440]: pgmap v282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-03-02T11:06:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:11 smithi122 ceph-mon[125440]: osdmap e92: 12 total, 12 up, 12 in 2023-03-02T11:06:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:13 smithi136 ceph-mon[125702]: pgmap v284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:06:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:13 smithi136 ceph-mon[125702]: osdmap e93: 12 total, 12 up, 12 in 2023-03-02T11:06:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:13 smithi057 ceph-mon[92072]: pgmap v284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:06:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:13 smithi057 ceph-mon[92072]: osdmap e93: 12 total, 12 up, 12 in 2023-03-02T11:06:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:13 smithi122 ceph-mon[125440]: pgmap v284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:06:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:13 smithi122 ceph-mon[125440]: osdmap e93: 12 total, 12 up, 12 in 2023-03-02T11:06:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:15 smithi136 ceph-mon[125702]: pgmap v286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:06:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:06:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:15 smithi057 ceph-mon[92072]: pgmap v286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:06:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:06:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:15 smithi122 ceph-mon[125440]: pgmap v286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:06:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:06:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:06:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:06:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:06:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:06:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:06:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:06:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:06:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:06:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:06:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:18 smithi136 ceph-mon[125702]: pgmap v287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:06:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:18 smithi057 ceph-mon[92072]: pgmap v287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:06:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:18 smithi122 ceph-mon[125440]: pgmap v287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:06:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:19.141+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:19.141+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:06:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:19.141+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:06:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:19.141+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:06:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:19.141+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:06:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:20 smithi136 ceph-mon[125702]: pgmap v288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:06:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:20 smithi057 ceph-mon[92072]: pgmap v288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:06:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:20 smithi122 ceph-mon[125440]: pgmap v288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:06:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:22 smithi136 ceph-mon[125702]: pgmap v289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 10 op/s 2023-03-02T11:06:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:22 smithi057 ceph-mon[92072]: pgmap v289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 10 op/s 2023-03-02T11:06:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:22 smithi122 ceph-mon[125440]: pgmap v289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 10 op/s 2023-03-02T11:06:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:24 smithi136 ceph-mon[125702]: pgmap v290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:06:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:24 smithi057 ceph-mon[92072]: pgmap v290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:06:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:24 smithi122 ceph-mon[125440]: pgmap v290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:06:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:26 smithi136 ceph-mon[125702]: pgmap v291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:06:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:26 smithi057 ceph-mon[92072]: pgmap v291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:06:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:26 smithi122 ceph-mon[125440]: pgmap v291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:06:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:28 smithi136 ceph-mon[125702]: pgmap v292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:06:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:28 smithi057 ceph-mon[92072]: pgmap v292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:06:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:28 smithi122 ceph-mon[125440]: pgmap v292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:06:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:30 smithi136 ceph-mon[125702]: pgmap v293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:06:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:30 smithi057 ceph-mon[92072]: pgmap v293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:06:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:30 smithi122 ceph-mon[125440]: pgmap v293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:06:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:32 smithi136 ceph-mon[125702]: pgmap v294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:32 smithi057 ceph-mon[92072]: pgmap v294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:32 smithi122 ceph-mon[125440]: pgmap v294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:34.156+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:34.156+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:06:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:34.156+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:06:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:34.156+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:06:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:34.157+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:06:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:34 smithi136 ceph-mon[125702]: pgmap v295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:06:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:34 smithi057 ceph-mon[92072]: pgmap v295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:06:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:34 smithi122 ceph-mon[125440]: pgmap v295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:06:35.342 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:06:35.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.511+0000 7f5be6fff700 1 -- 172.21.15.57:0/3117145930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be01015f0 msgr2=0x7f5be0109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:35.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.511+0000 7f5be6fff700 1 --2- 172.21.15.57:0/3117145930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be01015f0 0x7f5be0109ae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009990 tx=0x7f5bd0009ca0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.512+0000 7f5be6fff700 1 -- 172.21.15.57:0/3117145930 shutdown_connections 2023-03-02T11:06:35.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.512+0000 7f5be6fff700 1 --2- 172.21.15.57:0/3117145930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be010a020 0x7f5be010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.512+0000 7f5be6fff700 1 --2- 172.21.15.57:0/3117145930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be0100ce0 0x7f5be01010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.512+0000 7f5be6fff700 1 --2- 172.21.15.57:0/3117145930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be01015f0 0x7f5be0109ae0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.512+0000 7f5be6fff700 1 -- 172.21.15.57:0/3117145930 >> 172.21.15.57:0/3117145930 conn(0x7f5be00fa4b0 msgr2=0x7f5be00fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:35.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.512+0000 7f5be6fff700 1 -- 172.21.15.57:0/3117145930 shutdown_connections 2023-03-02T11:06:35.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.512+0000 7f5be6fff700 1 -- 172.21.15.57:0/3117145930 wait complete. 2023-03-02T11:06:35.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.512+0000 7f5be6fff700 1 Processor -- start 2023-03-02T11:06:35.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be6fff700 1 -- start start 2023-03-02T11:06:35.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be6fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be0100ce0 0x7f5be00fe930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be6fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be01015f0 0x7f5be00fee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be6fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be010a020 0x7f5be01a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be6fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00ff710 con 0x7f5be01015f0 2023-03-02T11:06:35.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be6fff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be01a42f0 con 0x7f5be0100ce0 2023-03-02T11:06:35.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be6fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be01a4430 con 0x7f5be010a020 2023-03-02T11:06:35.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be4d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be0100ce0 0x7f5be00fe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be4d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be0100ce0 0x7f5be00fe930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:40354/0 (socket says 172.21.15.57:40354) 2023-03-02T11:06:35.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be4d9b700 1 -- 172.21.15.57:0/3601118199 learned_addr learned my addr 172.21.15.57:0/3601118199 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:06:35.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5bd7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be01015f0 0x7f5be00fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be559c700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be010a020 0x7f5be01a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be4d9b700 1 -- 172.21.15.57:0/3601118199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be010a020 msgr2=0x7f5be01a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:35.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be010a020 0x7f5be01a3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be4d9b700 1 -- 172.21.15.57:0/3601118199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be01015f0 msgr2=0x7f5be00fee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:35.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be01015f0 0x7f5be00fee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.513+0000 7f5be4d9b700 1 -- 172.21.15.57:0/3601118199 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8009520 con 0x7f5be0100ce0 2023-03-02T11:06:35.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.514+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be0100ce0 0x7f5be00fe930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00ef40 tx=0x7f5bdc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:35.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.514+0000 7f5bd5ffb700 1 -- 172.21.15.57:0/3601118199 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00c9b0 con 0x7f5be0100ce0 2023-03-02T11:06:35.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.514+0000 7f5be6fff700 1 -- 172.21.15.57:0/3601118199 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd00095f0 con 0x7f5be0100ce0 2023-03-02T11:06:35.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.514+0000 7f5bd5ffb700 1 -- 172.21.15.57:0/3601118199 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bdc00f040 con 0x7f5be0100ce0 2023-03-02T11:06:35.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.514+0000 7f5bd5ffb700 1 -- 172.21.15.57:0/3601118199 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc014480 con 0x7f5be0100ce0 2023-03-02T11:06:35.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.514+0000 7f5be6fff700 1 -- 172.21.15.57:0/3601118199 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be010fac0 con 0x7f5be0100ce0 2023-03-02T11:06:35.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.517+0000 7f5bd5ffb700 1 -- 172.21.15.57:0/3601118199 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f5bdc007600 con 0x7f5be0100ce0 2023-03-02T11:06:35.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.517+0000 7f5bd5ffb700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bc809b480 0x7f5bc809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5bfa878b80 1 Processor -- start 2023-03-02T11:06:35.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5bfa878b80 1 -- start start 2023-03-02T11:06:35.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5bd5ffb700 1 -- 172.21.15.57:0/3601118199 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f5bdc0c55d0 con 0x7f5be0100ce0 2023-03-02T11:06:35.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5bd7fff700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bc809b480 0x7f5bc809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d3243c0 0x55cd8d324790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d324cd0 0x55cd8d328bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d329110 0x55cd8d329560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d28ba60 con 0x55cd8d329110 2023-03-02T11:06:35.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d23df80 con 0x55cd8d324cd0 2023-03-02T11:06:35.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d20e160 con 0x55cd8d3243c0 2023-03-02T11:06:35.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5be559c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d329110 0x55cd8d329560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5be559c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d329110 0x55cd8d329560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49042/0 (socket says 172.21.15.57:49042) 2023-03-02T11:06:35.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5be559c700 1 -- 172.21.15.57:0/3637408745 learned_addr learned my addr 172.21.15.57:0/3637408745 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:06:35.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/3637408745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d3243c0 0x55cd8d324790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5bd7fff700 1 --2- 172.21.15.57:0/3637408745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d324cd0 0x55cd8d328bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5be559c700 1 -- 172.21.15.57:0/3637408745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d3243c0 msgr2=0x55cd8d324790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:35.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5be559c700 1 --2- 172.21.15.57:0/3637408745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d3243c0 0x55cd8d324790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5be559c700 1 -- 172.21.15.57:0/3637408745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d324cd0 msgr2=0x55cd8d328bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:35.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5be559c700 1 --2- 172.21.15.57:0/3637408745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d324cd0 0x55cd8d328bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.518+0000 7f5be559c700 1 -- 172.21.15.57:0/3637408745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd8d0f8630 con 0x55cd8d329110 2023-03-02T11:06:35.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.519+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/3637408745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d3243c0 0x55cd8d324790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:06:35.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.519+0000 7f5bd7fff700 1 --2- 172.21.15.57:0/3637408745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d324cd0 0x55cd8d328bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T11:06:35.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.519+0000 7f5bd7fff700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bc809b480 0x7f5bc809d930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5be0100120 tx=0x7f5bd000bb70 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:35.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.519+0000 7f5be559c700 1 --2- 172.21.15.57:0/3637408745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d329110 0x55cd8d329560 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009e30 tx=0x7f5bd8011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f434b47f8f9fc88 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:35.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.519+0000 7f5bc6ffd700 1 -- 172.21.15.57:0/3637408745 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8004310 con 0x55cd8d329110 2023-03-02T11:06:35.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.519+0000 7f5bc6ffd700 1 -- 172.21.15.57:0/3637408745 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bd8004470 con 0x55cd8d329110 2023-03-02T11:06:35.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.519+0000 7f5bc6ffd700 1 -- 172.21.15.57:0/3637408745 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8019820 con 0x55cd8d329110 2023-03-02T11:06:35.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3637408745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d329110 msgr2=0x55cd8d329560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:35.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/3637408745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d329110 0x55cd8d329560 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009e30 tx=0x7f5bd8011720 comp rx=0 tx=0).stop 2023-03-02T11:06:35.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3637408745 shutdown_connections 2023-03-02T11:06:35.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/3637408745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d329110 0x55cd8d329560 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/3637408745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d3243c0 0x55cd8d324790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/3637408745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d324cd0 0x55cd8d328bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3637408745 >> 172.21.15.57:0/3637408745 conn(0x55cd8d319c50 msgr2=0x55cd8d31f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:35.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3637408745 shutdown_connections 2023-03-02T11:06:35.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3637408745 wait complete. 2023-03-02T11:06:35.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 -- start start 2023-03-02T11:06:35.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 Processor -- start 2023-03-02T11:06:35.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d330840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.520+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d32dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d32e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d27cbc0 con 0x55cd8d3243c0 2023-03-02T11:06:35.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d2760f0 con 0x55cd8d329110 2023-03-02T11:06:35.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d0fa920 con 0x55cd8d324cd0 2023-03-02T11:06:35.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bfa878b80 10 client.0 _ll_register_callbacks cb 0x55cd8d21c520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:06:35.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bd7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d32dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5be559c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d32e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5be4d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d330840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bd7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d32dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:49330/0 (socket says 172.21.15.57:49330) 2023-03-02T11:06:35.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5be559c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d32e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:40372/0 (socket says 172.21.15.57:40372) 2023-03-02T11:06:35.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bd7fff700 1 -- 172.21.15.57:0/3647147015 learned_addr learned my addr 172.21.15.57:0/3647147015 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:06:35.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5be4d9b700 1 -- 172.21.15.57:0/3647147015 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 msgr2=0x55cd8d32dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:35.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/3647147015 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d32dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5be4d9b700 1 -- 172.21.15.57:0/3647147015 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 msgr2=0x55cd8d32e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:35.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/3647147015 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d32e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5be4d9b700 1 -- 172.21.15.57:0/3647147015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd8009ae0 con 0x55cd8d3243c0 2023-03-02T11:06:35.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/3647147015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d330840 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc094950 tx=0x7f5bdc094f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2009819720105ecf server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:35.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bbffff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:06:35.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bbffff700 1 -- 172.21.15.57:0/3647147015 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc09be50 con 0x55cd8d3243c0 2023-03-02T11:06:35.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bbffff700 1 -- 172.21.15.57:0/3647147015 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f5bdc098370 con 0x55cd8d3243c0 2023-03-02T11:06:35.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.521+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3647147015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd8d2477b0 con 0x55cd8d3243c0 2023-03-02T11:06:35.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bbffff700 1 -- 172.21.15.57:0/3647147015 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bdc0950c0 con 0x55cd8d3243c0 2023-03-02T11:06:35.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bfa878b80 10 client.16437 fetch_fsmap learned FSMap version 47 2023-03-02T11:06:35.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3647147015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55cd8d0a4de0 con 0x55cd8d3243c0 2023-03-02T11:06:35.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bbffff700 1 -- 172.21.15.57:0/3647147015 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cd8d2477b0 con 0x55cd8d3243c0 2023-03-02T11:06:35.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bbffff700 1 -- 172.21.15.57:0/3647147015 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5bdc012bf0 con 0x55cd8d3243c0 2023-03-02T11:06:35.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bfa878b80 10 client.16437 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:06:35.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bfa878b80 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:06:35.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bfa878b80 20 client.16437 populate_metadata read hostname 'smithi057' 2023-03-02T11:06:35.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/3647147015 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55cd8d33e1b0 0x55cd8d3405c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bfa878b80 4 client.16437 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:06:35.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3647147015 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd8d26f170 con 0x55cd8d33e1b0 2023-03-02T11:06:35.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.522+0000 7f5bd7fff700 1 --2- 172.21.15.57:0/3647147015 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55cd8d33e1b0 0x55cd8d3405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.523+0000 7f5bbffff700 10 client.16437 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:06:35.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.523+0000 7f5bd7fff700 1 --2- 172.21.15.57:0/3647147015 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55cd8d33e1b0 0x55cd8d3405c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e5e1eff71121528 server_cookie=980a258fa429f320 in_seq=0 out_seq=0 2023-03-02T11:06:35.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.523+0000 7f5bbffff700 1 -- 172.21.15.57:0/3647147015 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55cd8d26f170 con 0x55cd8d33e1b0 2023-03-02T11:06:35.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.523+0000 7f5bbffff700 10 client.16437 handle_command_reply: tid=0 2023-03-02T11:06:35.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.523+0000 7f5bfa878b80 1 client.16437 shutdown 2023-03-02T11:06:35.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3647147015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 msgr2=0x55cd8d330840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:35.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/3647147015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d330840 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc094950 tx=0x7f5bdc094f00 comp rx=0 tx=0).stop 2023-03-02T11:06:35.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3647147015 shutdown_connections 2023-03-02T11:06:35.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/3647147015 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55cd8d33e1b0 0x55cd8d3405c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/3647147015 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d32e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/3647147015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d330840 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bbffff700 0 client.16437 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:06:35.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/3647147015 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d32dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3647147015 >> 172.21.15.57:0/3647147015 conn(0x55cd8d319c50 msgr2=0x55cd8d31f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:35.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3647147015 shutdown_connections 2023-03-02T11:06:35.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bfa878b80 1 -- 172.21.15.57:0/3647147015 wait complete. 2023-03-02T11:06:35.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.524+0000 7f5bfa878b80 20 client.16437 trim_cache size 0 max 16384 2023-03-02T11:06:35.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.540+0000 7f5bfa878b80 1 Processor -- start 2023-03-02T11:06:35.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5bfa878b80 1 -- start start 2023-03-02T11:06:35.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3303e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d32d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d32d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d3197d0 con 0x55cd8d3243c0 2023-03-02T11:06:35.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d345170 con 0x55cd8d329110 2023-03-02T11:06:35.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d3279c0 con 0x55cd8d324cd0 2023-03-02T11:06:35.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5be4d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5bd7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d32d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5be4d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3303e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49074/0 (socket says 172.21.15.57:49074) 2023-03-02T11:06:35.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5be4d9b700 1 -- 172.21.15.57:0/2731692684 learned_addr learned my addr 172.21.15.57:0/2731692684 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:06:35.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5be559c700 1 --2- 172.21.15.57:0/2731692684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d32d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5be4d9b700 1 -- 172.21.15.57:0/2731692684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 msgr2=0x55cd8d32d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:35.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/2731692684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d32d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5be4d9b700 1 -- 172.21.15.57:0/2731692684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 msgr2=0x55cd8d32d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:35.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/2731692684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d32d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.541+0000 7f5be4d9b700 1 -- 172.21.15.57:0/2731692684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd8d23d190 con 0x55cd8d3243c0 2023-03-02T11:06:35.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/2731692684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3303e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc091430 tx=0x7f5bdc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505c7a4b0d5113b5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:35.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bc77fe700 1 -- 172.21.15.57:0/2731692684 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0c5410 con 0x55cd8d3243c0 2023-03-02T11:06:35.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bc77fe700 1 -- 172.21.15.57:0/2731692684 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bdc004ba0 con 0x55cd8d3243c0 2023-03-02T11:06:35.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bc77fe700 1 -- 172.21.15.57:0/2731692684 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0ac220 con 0x55cd8d3243c0 2023-03-02T11:06:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2731692684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 msgr2=0x55cd8d3303e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/2731692684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3303e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc091430 tx=0x7f5bdc00ef70 comp rx=0 tx=0).stop 2023-03-02T11:06:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2731692684 shutdown_connections 2023-03-02T11:06:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/2731692684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d32d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/2731692684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3303e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/2731692684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d32d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2731692684 >> 172.21.15.57:0/2731692684 conn(0x55cd8d319c50 msgr2=0x55cd8d3397e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:35.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2731692684 shutdown_connections 2023-03-02T11:06:35.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.542+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2731692684 wait complete. 2023-03-02T11:06:35.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.543+0000 7f5bfa878b80 1 -- start start 2023-03-02T11:06:35.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.543+0000 7f5bfa878b80 1 Processor -- start 2023-03-02T11:06:35.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.543+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.543+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d333500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.543+0000 7f5bfa878b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d333b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.543+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d3341f0 con 0x55cd8d3243c0 2023-03-02T11:06:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.543+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d334360 con 0x55cd8d329110 2023-03-02T11:06:35.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.543+0000 7f5bfa878b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8d38faa0 con 0x55cd8d324cd0 2023-03-02T11:06:35.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5bfa878b80 10 client.0 _ll_register_callbacks cb 0x55cd8d21c520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:06:35.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5be4d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5be559c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d333b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5bd7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d333500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5be4d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49090/0 (socket says 172.21.15.57:49090) 2023-03-02T11:06:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5be4d9b700 1 -- 172.21.15.57:0/2834628049 learned_addr learned my addr 172.21.15.57:0/2834628049 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:06:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5be4d9b700 1 -- 172.21.15.57:0/2834628049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 msgr2=0x55cd8d333500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d333500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5be4d9b700 1 -- 172.21.15.57:0/2834628049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 msgr2=0x55cd8d333b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:06:35.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d333b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5be4d9b700 1 -- 172.21.15.57:0/2834628049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd8d0a4de0 con 0x55cd8d3243c0 2023-03-02T11:06:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5be559c700 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d333b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:06:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5be4d9b700 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3351a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc000f80 tx=0x7f5bdc007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cba6928f1ed9a5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:06:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5bbffff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:06:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5bbffff700 1 -- 172.21.15.57:0/2834628049 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0909b0 con 0x55cd8d3243c0 2023-03-02T11:06:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5bbffff700 1 -- 172.21.15.57:0/2834628049 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f5bdc098370 con 0x55cd8d3243c0 2023-03-02T11:06:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.544+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2834628049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5bd8004470 con 0x55cd8d3243c0 2023-03-02T11:06:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bbffff700 1 -- 172.21.15.57:0/2834628049 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bdc0950c0 con 0x55cd8d3243c0 2023-03-02T11:06:35.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bfa878b80 10 client.16443 fetch_fsmap learned FSMap version 47 2023-03-02T11:06:35.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2834628049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55cd8d0cb250 con 0x55cd8d3243c0 2023-03-02T11:06:35.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bbffff700 1 -- 172.21.15.57:0/2834628049 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bd8004470 con 0x55cd8d3243c0 2023-03-02T11:06:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bbffff700 1 -- 172.21.15.57:0/2834628049 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5bdc095350 con 0x55cd8d3243c0 2023-03-02T11:06:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bfa878b80 10 client.16443 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:06:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bfa878b80 10 client.16443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:06:35.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bfa878b80 20 client.16443 populate_metadata read hostname 'smithi057' 2023-03-02T11:06:35.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55cd8d390ce0 0x55cd8d3930c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:06:35.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bfa878b80 4 client.16443 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:06:35.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2834628049 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cd8d26ee90 con 0x55cd8d390ce0 2023-03-02T11:06:35.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.545+0000 7f5bd7fff700 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55cd8d390ce0 0x55cd8d3930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:35.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bbffff700 10 client.16443 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:06:35.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bd7fff700 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55cd8d390ce0 0x55cd8d3930c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bf40bb7b68b4bfc server_cookie=912b3c03963783f6 in_seq=0 out_seq=0 2023-03-02T11:06:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bbffff700 1 -- 172.21.15.57:0/2834628049 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55cd8d26ee90 con 0x55cd8d390ce0 2023-03-02T11:06:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bbffff700 10 client.16443 handle_command_reply: tid=0 2023-03-02T11:06:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 1 client.16443 shutdown 2023-03-02T11:06:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2834628049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 msgr2=0x55cd8d3351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3351a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc000f80 tx=0x7f5bdc007f70 comp rx=0 tx=0).stop 2023-03-02T11:06:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2834628049 shutdown_connections 2023-03-02T11:06:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55cd8d390ce0 0x55cd8d3930c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd8d329110 0x55cd8d333b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cd8d3243c0 0x55cd8d3351a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bbffff700 0 client.16443 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:06:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 1 --2- 172.21.15.57:0/2834628049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd8d324cd0 0x55cd8d333500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2834628049 >> 172.21.15.57:0/2834628049 conn(0x55cd8d319c50 msgr2=0x55cd8d3231c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2834628049 shutdown_connections 2023-03-02T11:06:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 1 -- 172.21.15.57:0/2834628049 wait complete. 2023-03-02T11:06:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.546+0000 7f5bfa878b80 20 client.16443 trim_cache size 0 max 16384 2023-03-02T11:06:35.566 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:06:35.567 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:06:35.567 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:06:35.567 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:06:35.567 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:06:35.567 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:06:35.567 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:06:35.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:06:35.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:06:35.568 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:06:35.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 -- 172.21.15.57:0/3601118199 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bc809b480 msgr2=0x7f5bc809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:35.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bc809b480 0x7f5bc809d930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5be0100120 tx=0x7f5bd000bb70 comp rx=0 tx=0).stop 2023-03-02T11:06:35.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 -- 172.21.15.57:0/3601118199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be0100ce0 msgr2=0x7f5be00fe930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:06:35.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be0100ce0 0x7f5be00fe930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00ef40 tx=0x7f5bdc00c3a0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 -- 172.21.15.57:0/3601118199 shutdown_connections 2023-03-02T11:06:35.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f5bc809b480 0x7f5bc809d930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be010a020 0x7f5be01a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be0100ce0 0x7f5be00fe930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 --2- 172.21.15.57:0/3601118199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be01015f0 0x7f5be00fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:06:35.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 -- 172.21.15.57:0/3601118199 >> 172.21.15.57:0/3601118199 conn(0x7f5be00fa4b0 msgr2=0x7f5be010c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:06:35.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 -- 172.21.15.57:0/3601118199 shutdown_connections 2023-03-02T11:06:35.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:06:35.547+0000 7f5be6fff700 1 -- 172.21.15.57:0/3601118199 wait complete. 2023-03-02T11:06:35.573 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:06:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:36 smithi136 ceph-mon[125702]: pgmap v296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:36 smithi057 ceph-mon[92072]: pgmap v296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:36 smithi122 ceph-mon[125440]: pgmap v296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:38 smithi136 ceph-mon[125702]: pgmap v297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:06:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:38 smithi057 ceph-mon[92072]: pgmap v297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:06:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:38 smithi122 ceph-mon[125440]: pgmap v297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:06:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:40 smithi136 ceph-mon[125702]: pgmap v298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:06:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:40 smithi057 ceph-mon[92072]: pgmap v298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:06:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:40 smithi122 ceph-mon[125440]: pgmap v298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:06:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:42 smithi136 ceph-mon[125702]: pgmap v299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:42 smithi057 ceph-mon[92072]: pgmap v299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:42 smithi122 ceph-mon[125440]: pgmap v299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:44 smithi057 ceph-mon[92072]: pgmap v300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:06:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:44 smithi122 ceph-mon[125440]: pgmap v300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:06:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:44 smithi136 ceph-mon[125702]: pgmap v300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:06:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:46 smithi057 ceph-mon[92072]: pgmap v301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:06:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:46 smithi122 ceph-mon[125440]: pgmap v301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:06:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:46 smithi136 ceph-mon[125702]: pgmap v301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:06:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:48 smithi057 ceph-mon[92072]: pgmap v302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T11:06:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:48 smithi122 ceph-mon[125440]: pgmap v302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T11:06:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:48 smithi136 ceph-mon[125702]: pgmap v302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T11:06:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:49.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:06:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:49.172+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:06:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:49.172+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:06:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:49.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:06:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:06:49.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:06:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:50 smithi057 ceph-mon[92072]: pgmap v303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:06:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:50 smithi122 ceph-mon[125440]: pgmap v303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:06:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:50 smithi136 ceph-mon[125702]: pgmap v303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:06:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:52 smithi057 ceph-mon[92072]: pgmap v304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:06:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:52 smithi122 ceph-mon[125440]: pgmap v304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:06:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:52 smithi136 ceph-mon[125702]: pgmap v304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:06:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:54 smithi057 ceph-mon[92072]: pgmap v305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:06:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:54 smithi122 ceph-mon[125440]: pgmap v305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:06:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:54 smithi136 ceph-mon[125702]: pgmap v305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:06:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:56 smithi057 ceph-mon[92072]: pgmap v306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:56 smithi122 ceph-mon[125440]: pgmap v306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:56 smithi136 ceph-mon[125702]: pgmap v306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:06:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:06:58 smithi057 ceph-mon[92072]: pgmap v307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:06:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:06:58 smithi122 ceph-mon[125440]: pgmap v307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:06:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:06:58 smithi136 ceph-mon[125702]: pgmap v307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:07:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:00 smithi057 ceph-mon[92072]: pgmap v308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:00 smithi122 ceph-mon[125440]: pgmap v308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:00 smithi136 ceph-mon[125702]: pgmap v308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:02 smithi057 ceph-mon[92072]: pgmap v309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:02 smithi122 ceph-mon[125440]: pgmap v309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:02 smithi136 ceph-mon[125702]: pgmap v309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:04.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:04.188+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:07:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:04.188+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:07:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:04.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:07:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:04.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:07:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:04 smithi057 ceph-mon[92072]: pgmap v310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:07:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:04 smithi122 ceph-mon[125440]: pgmap v310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:07:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:04 smithi136 ceph-mon[125702]: pgmap v310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:07:05.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:07:05.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.745+0000 7f921afff700 1 -- 172.21.15.57:0/972349618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92140ff360 msgr2=0x7f921410b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:05.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.745+0000 7f921afff700 1 --2- 172.21.15.57:0/972349618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92140ff360 0x7f921410b7f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f920c009990 tx=0x7f920c009ca0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.745+0000 7f921afff700 1 -- 172.21.15.57:0/972349618 shutdown_connections 2023-03-02T11:07:05.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.745+0000 7f921afff700 1 --2- 172.21.15.57:0/972349618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92140ff360 0x7f921410b7f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.745+0000 7f921afff700 1 --2- 172.21.15.57:0/972349618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92141049c0 0x7f9214104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.745+0000 7f921afff700 1 --2- 172.21.15.57:0/972349618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92140fe9b0 0x7f92140fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.745+0000 7f921afff700 1 -- 172.21.15.57:0/972349618 >> 172.21.15.57:0/972349618 conn(0x7f92140fa4b0 msgr2=0x7f92140fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:05.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.745+0000 7f921afff700 1 -- 172.21.15.57:0/972349618 shutdown_connections 2023-03-02T11:07:05.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.745+0000 7f921afff700 1 -- 172.21.15.57:0/972349618 wait complete. 2023-03-02T11:07:05.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f921afff700 1 Processor -- start 2023-03-02T11:07:05.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f921afff700 1 -- start start 2023-03-02T11:07:05.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f921afff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92140fe9b0 0x7f921419b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f921afff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92140ff360 0x7f921419be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f921afff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92141049c0 0x7f9214195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f921afff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9214195fc0 con 0x7f92140fe9b0 2023-03-02T11:07:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f921afff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9214196130 con 0x7f92141049c0 2023-03-02T11:07:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f921afff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92141962f0 con 0x7f92140ff360 2023-03-02T11:07:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f9218d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92140fe9b0 0x7f921419b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f921959c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92141049c0 0x7f9214195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f9218d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92140fe9b0 0x7f921419b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50374/0 (socket says 172.21.15.57:50374) 2023-03-02T11:07:05.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f920bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92140ff360 0x7f921419be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.746+0000 7f9218d9b700 1 -- 172.21.15.57:0/3472654733 learned_addr learned my addr 172.21.15.57:0/3472654733 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:07:05.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f921959c700 1 -- 172.21.15.57:0/3472654733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92140ff360 msgr2=0x7f921419be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:05.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f921959c700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92140ff360 0x7f921419be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f921959c700 1 -- 172.21.15.57:0/3472654733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92140fe9b0 msgr2=0x7f921419b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:05.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f921959c700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92140fe9b0 0x7f921419b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f921959c700 1 -- 172.21.15.57:0/3472654733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c0095f0 con 0x7f92141049c0 2023-03-02T11:07:05.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f9218d9b700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92140fe9b0 0x7f921419b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:07:05.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f921959c700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92141049c0 0x7f9214195950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f920c005b40 tx=0x7f920c005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:05.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f9209ffb700 1 -- 172.21.15.57:0/3472654733 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c01d070 con 0x7f92141049c0 2023-03-02T11:07:05.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f9209ffb700 1 -- 172.21.15.57:0/3472654733 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f920c021410 con 0x7f92141049c0 2023-03-02T11:07:05.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f9209ffb700 1 -- 172.21.15.57:0/3472654733 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c017650 con 0x7f92141049c0 2023-03-02T11:07:05.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f921afff700 1 -- 172.21.15.57:0/3472654733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921410e9f0 con 0x7f92141049c0 2023-03-02T11:07:05.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.747+0000 7f921afff700 1 -- 172.21.15.57:0/3472654733 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921410e860 con 0x7f92141049c0 2023-03-02T11:07:05.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.750+0000 7f9209ffb700 1 -- 172.21.15.57:0/3472654733 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f920c028030 con 0x7f92141049c0 2023-03-02T11:07:05.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f9209ffb700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f91fc09b480 0x7f91fc09d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f9209ffb700 1 -- 172.21.15.57:0/3472654733 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f920c0c6330 con 0x7f92141049c0 2023-03-02T11:07:05.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f9218d9b700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f91fc09b480 0x7f91fc09d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f922e9ddb80 1 Processor -- start 2023-03-02T11:07:05.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f922e9ddb80 1 -- start start 2023-03-02T11:07:05.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x5642526d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526d7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d8110 0x5642526d8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425263aa60 con 0x5642526d8110 2023-03-02T11:07:05.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642525ecf80 con 0x5642526d3cd0 2023-03-02T11:07:05.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642525bd160 con 0x5642526d33c0 2023-03-02T11:07:05.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f9218d9b700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f91fc09b480 0x7f91fc09d930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9210003ef0 tx=0x7f921000b040 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:05.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.751+0000 7f9218d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x5642526d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f9218d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x5642526d3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:33050/0 (socket says 172.21.15.57:33050) 2023-03-02T11:07:05.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f9218d9b700 1 -- 172.21.15.57:0/619326707 learned_addr learned my addr 172.21.15.57:0/619326707 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:07:05.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f920bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526d7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f921959c700 1 --2- 172.21.15.57:0/619326707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d8110 0x5642526d8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f920bfff700 1 -- 172.21.15.57:0/619326707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 msgr2=0x5642526d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:05.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f920bfff700 1 --2- 172.21.15.57:0/619326707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x5642526d3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f920bfff700 1 -- 172.21.15.57:0/619326707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d8110 msgr2=0x5642526d8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:05.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f920bfff700 1 --2- 172.21.15.57:0/619326707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d8110 0x5642526d8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f920bfff700 1 -- 172.21.15.57:0/619326707 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642524a7630 con 0x5642526d3cd0 2023-03-02T11:07:05.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f9218d9b700 1 --2- 172.21.15.57:0/619326707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x5642526d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:07:05.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f920bfff700 1 --2- 172.21.15.57:0/619326707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526d7bd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9204009c80 tx=0x7f9204009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efa927f0565964fd server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:05.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f91faffd700 1 -- 172.21.15.57:0/619326707 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204011cb0 con 0x5642526d3cd0 2023-03-02T11:07:05.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f91faffd700 1 -- 172.21.15.57:0/619326707 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9204011e10 con 0x5642526d3cd0 2023-03-02T11:07:05.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.752+0000 7f91faffd700 1 -- 172.21.15.57:0/619326707 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204005280 con 0x5642526d3cd0 2023-03-02T11:07:05.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.753+0000 7f922e9ddb80 1 -- 172.21.15.57:0/619326707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 msgr2=0x5642526d7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:05.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.753+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/619326707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526d7bd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9204009c80 tx=0x7f9204009f90 comp rx=0 tx=0).stop 2023-03-02T11:07:05.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.753+0000 7f922e9ddb80 1 -- 172.21.15.57:0/619326707 shutdown_connections 2023-03-02T11:07:05.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.753+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/619326707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d8110 0x5642526d8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.753+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/619326707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x5642526d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.753+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/619326707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526d7bd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.753+0000 7f922e9ddb80 1 -- 172.21.15.57:0/619326707 >> 172.21.15.57:0/619326707 conn(0x5642526c8c50 msgr2=0x5642526ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:05.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.753+0000 7f922e9ddb80 1 -- 172.21.15.57:0/619326707 shutdown_connections 2023-03-02T11:07:05.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.753+0000 7f922e9ddb80 1 -- 172.21.15.57:0/619326707 wait complete. 2023-03-02T11:07:05.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.753+0000 7f922e9ddb80 1 -- start start 2023-03-02T11:07:05.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f922e9ddb80 1 Processor -- start 2023-03-02T11:07:05.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 0x5642526df920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526dcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d8110 0x5642526dd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425262bbc0 con 0x5642526d33c0 2023-03-02T11:07:05.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642526250f0 con 0x5642526d3cd0 2023-03-02T11:07:05.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642524a9920 con 0x5642526d8110 2023-03-02T11:07:05.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f922e9ddb80 10 client.0 _ll_register_callbacks cb 0x5642525cb520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:07:05.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f9218d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 0x5642526df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f921959c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d8110 0x5642526dd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f9218d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 0x5642526df920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50392/0 (socket says 172.21.15.57:50392) 2023-03-02T11:07:05.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f9218d9b700 1 -- 172.21.15.57:0/3120491339 learned_addr learned my addr 172.21.15.57:0/3120491339 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:07:05.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f920bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526dcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f9218d9b700 1 -- 172.21.15.57:0/3120491339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d8110 msgr2=0x5642526dd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:05.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f9218d9b700 1 --2- 172.21.15.57:0/3120491339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d8110 0x5642526dd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f9218d9b700 1 -- 172.21.15.57:0/3120491339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 msgr2=0x5642526dcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:05.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f9218d9b700 1 --2- 172.21.15.57:0/3120491339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526dcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.754+0000 7f9218d9b700 1 -- 172.21.15.57:0/3120491339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92040098e0 con 0x5642526d33c0 2023-03-02T11:07:05.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.755+0000 7f9218d9b700 1 --2- 172.21.15.57:0/3120491339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 0x5642526df920 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9210017470 tx=0x7f9210004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c97f6700734c54 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:05.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.755+0000 7f91f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:07:05.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.755+0000 7f91f3fff700 1 -- 172.21.15.57:0/3120491339 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210009220 con 0x5642526d33c0 2023-03-02T11:07:05.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.755+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3120491339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642525f67b0 con 0x5642526d33c0 2023-03-02T11:07:05.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.755+0000 7f91f3fff700 1 -- 172.21.15.57:0/3120491339 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f921001c040 con 0x5642526d33c0 2023-03-02T11:07:05.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.755+0000 7f91f3fff700 1 -- 172.21.15.57:0/3120491339 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9210009380 con 0x5642526d33c0 2023-03-02T11:07:05.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.755+0000 7f922e9ddb80 10 client.16455 fetch_fsmap learned FSMap version 47 2023-03-02T11:07:05.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.755+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3120491339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x564252453de0 con 0x5642526d33c0 2023-03-02T11:07:05.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.755+0000 7f91f3fff700 1 -- 172.21.15.57:0/3120491339 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5642525f67b0 con 0x5642526d33c0 2023-03-02T11:07:05.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.756+0000 7f91f3fff700 1 -- 172.21.15.57:0/3120491339 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9210022530 con 0x5642526d33c0 2023-03-02T11:07:05.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.756+0000 7f922e9ddb80 10 client.16455 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:07:05.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.756+0000 7f922e9ddb80 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:07:05.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.756+0000 7f922e9ddb80 20 client.16455 populate_metadata read hostname 'smithi057' 2023-03-02T11:07:05.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.756+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/3120491339 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5642526ed350 0x5642526ef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.756+0000 7f922e9ddb80 4 client.16455 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:07:05.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.756+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3120491339 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56425261e170 con 0x5642526ed350 2023-03-02T11:07:05.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.756+0000 7f920bfff700 1 --2- 172.21.15.57:0/3120491339 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5642526ed350 0x5642526ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.756+0000 7f920bfff700 1 --2- 172.21.15.57:0/3120491339 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5642526ed350 0x5642526ef760 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=946c8a79f23ed90e server_cookie=90ac52c8802ee766 in_seq=0 out_seq=0 2023-03-02T11:07:05.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.756+0000 7f91f3fff700 10 client.16455 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:07:05.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f91f3fff700 1 -- 172.21.15.57:0/3120491339 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x56425261e170 con 0x5642526ed350 2023-03-02T11:07:05.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f91f3fff700 10 client.16455 handle_command_reply: tid=0 2023-03-02T11:07:05.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 1 client.16455 shutdown 2023-03-02T11:07:05.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3120491339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 msgr2=0x5642526df920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:05.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/3120491339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 0x5642526df920 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9210017470 tx=0x7f9210004ad0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3120491339 shutdown_connections 2023-03-02T11:07:05.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/3120491339 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5642526ed350 0x5642526ef760 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/3120491339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d8110 0x5642526dd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/3120491339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 0x5642526df920 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f91f3fff700 0 client.16455 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:07:05.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/3120491339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526dcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3120491339 >> 172.21.15.57:0/3120491339 conn(0x5642526c8c50 msgr2=0x5642526cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:05.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3120491339 shutdown_connections 2023-03-02T11:07:05.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3120491339 wait complete. 2023-03-02T11:07:05.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.757+0000 7f922e9ddb80 20 client.16455 trim_cache size 0 max 16384 2023-03-02T11:07:05.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.774+0000 7f922e9ddb80 1 Processor -- start 2023-03-02T11:07:05.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.774+0000 7f922e9ddb80 1 -- start start 2023-03-02T11:07:05.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.774+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 0x5642526df4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.774+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526e87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.774+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d8110 0x5642526e8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.774+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642526eaa80 con 0x5642526d33c0 2023-03-02T11:07:05.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.774+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642526e9290 con 0x5642526d3cd0 2023-03-02T11:07:05.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.774+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642526db170 con 0x5642526d8110 2023-03-02T11:07:05.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.774+0000 7f9218d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 0x5642526df4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.774+0000 7f920bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526e87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.774+0000 7f920bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526e87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:60582/0 (socket says 172.21.15.57:60582) 2023-03-02T11:07:05.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.775+0000 7f921959c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d8110 0x5642526e8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.775+0000 7f920bfff700 1 -- 172.21.15.57:0/3268943635 learned_addr learned my addr 172.21.15.57:0/3268943635 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:07:05.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.775+0000 7f920bfff700 1 -- 172.21.15.57:0/3268943635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d8110 msgr2=0x5642526e8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:05.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.775+0000 7f920bfff700 1 --2- 172.21.15.57:0/3268943635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d8110 0x5642526e8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.775+0000 7f920bfff700 1 -- 172.21.15.57:0/3268943635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 msgr2=0x5642526df4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:05.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.775+0000 7f920bfff700 1 --2- 172.21.15.57:0/3268943635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 0x5642526df4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.775+0000 7f920bfff700 1 -- 172.21.15.57:0/3268943635 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642525ec190 con 0x5642526d3cd0 2023-03-02T11:07:05.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.775+0000 7f920bfff700 1 --2- 172.21.15.57:0/3268943635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526e87e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9204014040 tx=0x7f9204004a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc2bc21948fbf614 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:05.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.775+0000 7f91fb7fe700 1 -- 172.21.15.57:0/3268943635 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204004870 con 0x5642526d3cd0 2023-03-02T11:07:05.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.775+0000 7f91fb7fe700 1 -- 172.21.15.57:0/3268943635 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f920402d070 con 0x5642526d3cd0 2023-03-02T11:07:05.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.775+0000 7f91fb7fe700 1 -- 172.21.15.57:0/3268943635 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204024420 con 0x5642526d3cd0 2023-03-02T11:07:05.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.776+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3268943635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 msgr2=0x5642526e87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:05.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.776+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/3268943635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526e87e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9204014040 tx=0x7f9204004a20 comp rx=0 tx=0).stop 2023-03-02T11:07:05.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.776+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3268943635 shutdown_connections 2023-03-02T11:07:05.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.776+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/3268943635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d8110 0x5642526e8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.776+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/3268943635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d33c0 0x5642526df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.776+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/3268943635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642526e87e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.776+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3268943635 >> 172.21.15.57:0/3268943635 conn(0x5642526c8c50 msgr2=0x5642526da4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:05.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.776+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3268943635 shutdown_connections 2023-03-02T11:07:05.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.776+0000 7f922e9ddb80 1 -- 172.21.15.57:0/3268943635 wait complete. 2023-03-02T11:07:05.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.776+0000 7f922e9ddb80 1 -- start start 2023-03-02T11:07:05.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.776+0000 7f922e9ddb80 1 Processor -- start 2023-03-02T11:07:05.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x564252736da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642527372e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f922e9ddb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d8110 0x56425273b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425273b860 con 0x5642526d8110 2023-03-02T11:07:05.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425273b9d0 con 0x5642526d3cd0 2023-03-02T11:07:05.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f922e9ddb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425273bb90 con 0x5642526d33c0 2023-03-02T11:07:05.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f922e9ddb80 10 client.0 _ll_register_callbacks cb 0x7f921000e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:07:05.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f9218d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x564252736da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f9218d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x564252736da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:33080/0 (socket says 172.21.15.57:33080) 2023-03-02T11:07:05.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f9218d9b700 1 -- 172.21.15.57:0/2207497579 learned_addr learned my addr 172.21.15.57:0/2207497579 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:07:05.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f921959c700 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d8110 0x56425273b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f920bfff700 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642527372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f9218d9b700 1 -- 172.21.15.57:0/2207497579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 msgr2=0x5642527372e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:05.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f9218d9b700 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642527372e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f9218d9b700 1 -- 172.21.15.57:0/2207497579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d8110 msgr2=0x56425273b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:05.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f9218d9b700 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d8110 0x56425273b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f9218d9b700 1 -- 172.21.15.57:0/2207497579 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920401d040 con 0x5642526d33c0 2023-03-02T11:07:05.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.777+0000 7f921959c700 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d8110 0x56425273b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:07:05.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f9218d9b700 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x564252736da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9210017440 tx=0x7f9210017b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37725c5b8c7b074 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:05.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f91f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:07:05.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f91f3fff700 1 -- 172.21.15.57:0/2207497579 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921003a070 con 0x5642526d33c0 2023-03-02T11:07:05.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f922e9ddb80 1 -- 172.21.15.57:0/2207497579 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9204011e10 con 0x5642526d33c0 2023-03-02T11:07:05.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f91f3fff700 1 -- 172.21.15.57:0/2207497579 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f9210022410 con 0x5642526d33c0 2023-03-02T11:07:05.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f91f3fff700 1 -- 172.21.15.57:0/2207497579 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92100225d0 con 0x5642526d33c0 2023-03-02T11:07:05.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f922e9ddb80 10 client.26254 fetch_fsmap learned FSMap version 47 2023-03-02T11:07:05.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f922e9ddb80 1 -- 172.21.15.57:0/2207497579 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x56425247a250 con 0x5642526d33c0 2023-03-02T11:07:05.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f91f3fff700 1 -- 172.21.15.57:0/2207497579 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9210042020 con 0x5642526d33c0 2023-03-02T11:07:05.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f91f3fff700 1 -- 172.21.15.57:0/2207497579 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f921003d020 con 0x5642526d33c0 2023-03-02T11:07:05.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f922e9ddb80 10 client.26254 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:07:05.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f922e9ddb80 10 client.26254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:07:05.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f922e9ddb80 20 client.26254 populate_metadata read hostname 'smithi057' 2023-03-02T11:07:05.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564252744440 0x564252746850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:05.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f922e9ddb80 4 client.26254 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:07:05.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.778+0000 7f922e9ddb80 1 -- 172.21.15.57:0/2207497579 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56425261de90 con 0x564252744440 2023-03-02T11:07:05.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f920bfff700 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564252744440 0x564252746850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:05.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f91f3fff700 10 client.26254 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:07:05.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f920bfff700 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564252744440 0x564252746850 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a5f3e293c5845bc server_cookie=6d816c08e1b5dd1 in_seq=0 out_seq=0 2023-03-02T11:07:05.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f91f3fff700 1 -- 172.21.15.57:0/2207497579 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56425261de90 con 0x564252744440 2023-03-02T11:07:05.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f91f3fff700 10 client.26254 handle_command_reply: tid=0 2023-03-02T11:07:05.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f922e9ddb80 1 client.26254 shutdown 2023-03-02T11:07:05.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f922e9ddb80 1 -- 172.21.15.57:0/2207497579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 msgr2=0x564252736da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:05.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x564252736da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9210017440 tx=0x7f9210017b90 comp rx=0 tx=0).stop 2023-03-02T11:07:05.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f922e9ddb80 1 -- 172.21.15.57:0/2207497579 shutdown_connections 2023-03-02T11:07:05.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x564252744440 0x564252746850 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642526d8110 0x56425273b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5642526d33c0 0x564252736da0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f922e9ddb80 1 --2- 172.21.15.57:0/2207497579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5642526d3cd0 0x5642527372e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f91f3fff700 0 client.26254 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:07:05.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f922e9ddb80 1 -- 172.21.15.57:0/2207497579 >> 172.21.15.57:0/2207497579 conn(0x5642526c8c50 msgr2=0x5642526da4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:05.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.779+0000 7f922e9ddb80 1 -- 172.21.15.57:0/2207497579 shutdown_connections 2023-03-02T11:07:05.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f922e9ddb80 1 -- 172.21.15.57:0/2207497579 wait complete. 2023-03-02T11:07:05.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f922e9ddb80 20 client.26254 trim_cache size 0 max 16384 2023-03-02T11:07:05.792 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:07:05.792 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:07:05.792 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:07:05.792 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:07:05.792 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:07:05.793 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:07:05.793 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:07:05.793 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:07:05.793 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:07:05.793 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:07:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 -- 172.21.15.57:0/3472654733 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f91fc09b480 msgr2=0x7f91fc09d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f91fc09b480 0x7f91fc09d930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9210003ef0 tx=0x7f921000b040 comp rx=0 tx=0).stop 2023-03-02T11:07:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 -- 172.21.15.57:0/3472654733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92141049c0 msgr2=0x7f9214195950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92141049c0 0x7f9214195950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f920c005b40 tx=0x7f920c005f10 comp rx=0 tx=0).stop 2023-03-02T11:07:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 -- 172.21.15.57:0/3472654733 shutdown_connections 2023-03-02T11:07:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f91fc09b480 0x7f91fc09d930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92141049c0 0x7f9214195950 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92140fe9b0 0x7f921419b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 --2- 172.21.15.57:0/3472654733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92140ff360 0x7f921419be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 -- 172.21.15.57:0/3472654733 >> 172.21.15.57:0/3472654733 conn(0x7f92140fa4b0 msgr2=0x7f9214067680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 -- 172.21.15.57:0/3472654733 shutdown_connections 2023-03-02T11:07:05.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:05.780+0000 7f921afff700 1 -- 172.21.15.57:0/3472654733 wait complete. 2023-03-02T11:07:05.796 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:07:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:06 smithi057 ceph-mon[92072]: pgmap v311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:07:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:06 smithi122 ceph-mon[125440]: pgmap v311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:07:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:06 smithi136 ceph-mon[125702]: pgmap v311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:07:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:08 smithi057 ceph-mon[92072]: pgmap v312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:07:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:08 smithi122 ceph-mon[125440]: pgmap v312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:07:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:08 smithi136 ceph-mon[125702]: pgmap v312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:07:10.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:10 smithi057 ceph-mon[92072]: pgmap v313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:07:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:10 smithi122 ceph-mon[125440]: pgmap v313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:07:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:10 smithi136 ceph-mon[125702]: pgmap v313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:07:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:11 smithi057 ceph-mon[92072]: osdmap e94: 12 total, 12 up, 12 in 2023-03-02T11:07:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:11 smithi122 ceph-mon[125440]: osdmap e94: 12 total, 12 up, 12 in 2023-03-02T11:07:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:11 smithi136 ceph-mon[125702]: osdmap e94: 12 total, 12 up, 12 in 2023-03-02T11:07:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:12 smithi057 ceph-mon[92072]: pgmap v315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:07:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:12 smithi122 ceph-mon[125440]: pgmap v315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:07:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:12 smithi136 ceph-mon[125702]: pgmap v315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:07:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:14 smithi057 ceph-mon[92072]: pgmap v316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:07:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:14 smithi057 ceph-mon[92072]: osdmap e95: 12 total, 12 up, 12 in 2023-03-02T11:07:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:14 smithi122 ceph-mon[125440]: pgmap v316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:07:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:14 smithi122 ceph-mon[125440]: osdmap e95: 12 total, 12 up, 12 in 2023-03-02T11:07:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:14 smithi136 ceph-mon[125702]: pgmap v316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:07:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:14 smithi136 ceph-mon[125702]: osdmap e95: 12 total, 12 up, 12 in 2023-03-02T11:07:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:16 smithi057 ceph-mon[92072]: pgmap v318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:07:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:07:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:16 smithi122 ceph-mon[125440]: pgmap v318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:07:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:07:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:16 smithi136 ceph-mon[125702]: pgmap v318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:07:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:07:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:18 smithi122 ceph-mon[125440]: pgmap v319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:07:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:18 smithi136 ceph-mon[125702]: pgmap v319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:07:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:18 smithi057 ceph-mon[92072]: pgmap v319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:07:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:19.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:19.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:07:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:19.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:07:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:19.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:07:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:19.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:07:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: pgmap v320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T11:07:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: pgmap v320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T11:07:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: pgmap v320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T11:07:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:20.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:21.074 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:21 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:07:21.074 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:21 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:07:21.075 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:21 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:07:21.075 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:21 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:07:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:21 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:07:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:21 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:07:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:21 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:07:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:21 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:07:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:21 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:07:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:21 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:07:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:21 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:07:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:21 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:07:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:22 smithi136 ceph-mon[125702]: pgmap v321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:07:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:22 smithi057 ceph-mon[92072]: pgmap v321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:07:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:22 smithi122 ceph-mon[125440]: pgmap v321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:07:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:23.431+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858005b50 con 0x7f5880105ae0 2023-03-02T11:07:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:23.435+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858005b50 con 0x7f5880105ae0 2023-03-02T11:07:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:23.459+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850005b60 con 0x558558b6f6b0 2023-03-02T11:07:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:23.459+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 8 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850005b60 con 0x558558b6f6b0 2023-03-02T11:07:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:07:23.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:07:23.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:07:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:07:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:07:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:07:23.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:07:23.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:07:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:24 smithi122 ceph-mon[125440]: pgmap v322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:07:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:24 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:07:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:24 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:07:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:24 smithi136 ceph-mon[125702]: pgmap v322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:07:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:24 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:07:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:24 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:07:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:24 smithi057 ceph-mon[92072]: pgmap v322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:07:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:24 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:07:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:24 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:07:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:26 smithi122 ceph-mon[125440]: pgmap v323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:07:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:26 smithi136 ceph-mon[125702]: pgmap v323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:07:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:26 smithi057 ceph-mon[92072]: pgmap v323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:07:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:28 smithi122 ceph-mon[125440]: pgmap v324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:07:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:28 smithi136 ceph-mon[125702]: pgmap v324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:07:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:28 smithi057 ceph-mon[92072]: pgmap v324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:07:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:30 smithi136 ceph-mon[125702]: pgmap v325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:30 smithi057 ceph-mon[92072]: pgmap v325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:30 smithi122 ceph-mon[125440]: pgmap v325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:32 smithi136 ceph-mon[125702]: pgmap v326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:32 smithi057 ceph-mon[92072]: pgmap v326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:32 smithi122 ceph-mon[125440]: pgmap v326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:34.213+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:34.213+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:07:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:34.213+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:07:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:34.213+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:07:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:34.213+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:07:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:34 smithi136 ceph-mon[125702]: pgmap v327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:07:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:34 smithi057 ceph-mon[92072]: pgmap v327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:07:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:34 smithi122 ceph-mon[125440]: pgmap v327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:07:35.798 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:07:35.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.984+0000 7f50387ff700 1 -- 172.21.15.57:0/1817276324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5030105ae0 msgr2=0x7f5030105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:35.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.984+0000 7f50387ff700 1 --2- 172.21.15.57:0/1817276324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5030105ae0 0x7f5030105eb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f502c009990 tx=0x7f502c009ca0 comp rx=0 tx=0).stop 2023-03-02T11:07:35.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.984+0000 7f50387ff700 1 -- 172.21.15.57:0/1817276324 shutdown_connections 2023-03-02T11:07:35.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.984+0000 7f50387ff700 1 --2- 172.21.15.57:0/1817276324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5030100480 0x7f503010c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:35.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.984+0000 7f50387ff700 1 --2- 172.21.15.57:0/1817276324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5030105ae0 0x7f5030105eb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:35.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.984+0000 7f50387ff700 1 --2- 172.21.15.57:0/1817276324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50300ffad0 0x7f50300fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:35.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.984+0000 7f50387ff700 1 -- 172.21.15.57:0/1817276324 >> 172.21.15.57:0/1817276324 conn(0x7f50300fb610 msgr2=0x7f50300fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:35.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.984+0000 7f50387ff700 1 -- 172.21.15.57:0/1817276324 shutdown_connections 2023-03-02T11:07:35.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.984+0000 7f50387ff700 1 -- 172.21.15.57:0/1817276324 wait complete. 2023-03-02T11:07:35.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.985+0000 7f50387ff700 1 Processor -- start 2023-03-02T11:07:35.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.985+0000 7f50387ff700 1 -- start start 2023-03-02T11:07:35.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.985+0000 7f50387ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50300ffad0 0x7f5030197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:35.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.985+0000 7f50387ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5030100480 0x7f5030198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:35.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.985+0000 7f50387ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5030105ae0 0x7f503019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:35.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.985+0000 7f50387ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503019cde0 con 0x7f5030105ae0 2023-03-02T11:07:35.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.985+0000 7f50387ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503019cf50 con 0x7f50300ffad0 2023-03-02T11:07:35.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.985+0000 7f50387ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503019d110 con 0x7f5030100480 2023-03-02T11:07:35.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.985+0000 7f5035d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5030100480 0x7f5030198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:35.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.985+0000 7f5036d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5030105ae0 0x7f503019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:35.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.985+0000 7f503659b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50300ffad0 0x7f5030197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:35.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f5035d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5030100480 0x7f5030198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:34882/0 (socket says 172.21.15.57:34882) 2023-03-02T11:07:35.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f5035d9a700 1 -- 172.21.15.57:0/100093418 learned_addr learned my addr 172.21.15.57:0/100093418 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:07:35.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f503659b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50300ffad0 0x7f5030197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:54784/0 (socket says 172.21.15.57:54784) 2023-03-02T11:07:35.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f5035d9a700 1 -- 172.21.15.57:0/100093418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50300ffad0 msgr2=0x7f5030197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:35.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f5035d9a700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50300ffad0 0x7f5030197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:35.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f5035d9a700 1 -- 172.21.15.57:0/100093418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5030105ae0 msgr2=0x7f503019c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:35.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f5035d9a700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5030105ae0 0x7f503019c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:35.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f5035d9a700 1 -- 172.21.15.57:0/100093418 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028009c40 con 0x7f5030100480 2023-03-02T11:07:35.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f5036d9c700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5030105ae0 0x7f503019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:07:35.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f5035d9a700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5030100480 0x7f5030198340 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f502000e9a0 tx=0x7f502000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:35.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f50277fe700 1 -- 172.21.15.57:0/100093418 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020009790 con 0x7f5030100480 2023-03-02T11:07:35.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f50387ff700 1 -- 172.21.15.57:0/100093418 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502c0095f0 con 0x7f5030100480 2023-03-02T11:07:35.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f50277fe700 1 -- 172.21.15.57:0/100093418 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f502000ce80 con 0x7f5030100480 2023-03-02T11:07:35.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f50277fe700 1 -- 172.21.15.57:0/100093418 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020018680 con 0x7f5030100480 2023-03-02T11:07:35.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.986+0000 7f50387ff700 1 -- 172.21.15.57:0/100093418 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503010fb10 con 0x7f5030100480 2023-03-02T11:07:35.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.990+0000 7f50277fe700 1 -- 172.21.15.57:0/100093418 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f502000c040 con 0x7f5030100480 2023-03-02T11:07:35.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.991+0000 7f504c0cbb80 1 Processor -- start 2023-03-02T11:07:35.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.991+0000 7f504c0cbb80 1 -- start start 2023-03-02T11:07:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.991+0000 7f50277fe700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f501c09b480 0x7f501c09d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.991+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 0x55565a4de790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.991+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 0x55565a4e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.991+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a4e3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.991+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a445a60 con 0x55565a4e3110 2023-03-02T11:07:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.991+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a3f7f80 con 0x55565a4decd0 2023-03-02T11:07:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.991+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a3c8160 con 0x55565a4de3c0 2023-03-02T11:07:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f503659b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 0x55565a4de790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5035d9a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 0x55565a4e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5036d9c700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f501c09b480 0x7f501c09d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f50277fe700 1 -- 172.21.15.57:0/100093418 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f5020014070 con 0x7f5030100480 2023-03-02T11:07:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f503659b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 0x55565a4de790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:34890/0 (socket says 172.21.15.57:34890) 2023-03-02T11:07:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f503659b700 1 -- 172.21.15.57:0/1582456135 learned_addr learned my addr 172.21.15.57:0/1582456135 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:07:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5036d9c700 1 --2- 172.21.15.57:0/1582456135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a4e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5035d9a700 1 -- 172.21.15.57:0/1582456135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 msgr2=0x55565a4de790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:35.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5035d9a700 1 --2- 172.21.15.57:0/1582456135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 0x55565a4de790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:35.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5035d9a700 1 -- 172.21.15.57:0/1582456135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 msgr2=0x55565a4e3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:35.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5035d9a700 1 --2- 172.21.15.57:0/1582456135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a4e3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:35.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5035d9a700 1 -- 172.21.15.57:0/1582456135 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55565a2b2630 con 0x55565a4decd0 2023-03-02T11:07:35.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5036d9c700 1 --2- 172.21.15.57:0/1582456135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a4e3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T11:07:35.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5035d9a700 1 --2- 172.21.15.57:0/1582456135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 0x55565a4e2bd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5020090ca0 tx=0x7f5020094180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c839e2dd7fe04ab server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:35.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5036d9c700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f501c09b480 0x7f501c09d930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5028009fd0 tx=0x7f5028009920 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:35.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5024ff9700 1 -- 172.21.15.57:0/1582456135 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200620d0 con 0x55565a4decd0 2023-03-02T11:07:35.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5024ff9700 1 -- 172.21.15.57:0/1582456135 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f502005f4d0 con 0x55565a4decd0 2023-03-02T11:07:35.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.992+0000 7f5024ff9700 1 -- 172.21.15.57:0/1582456135 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200947a0 con 0x55565a4decd0 2023-03-02T11:07:36.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.993+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1582456135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 msgr2=0x55565a4e2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:36.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.993+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/1582456135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 0x55565a4e2bd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5020090ca0 tx=0x7f5020094180 comp rx=0 tx=0).stop 2023-03-02T11:07:36.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.993+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1582456135 shutdown_connections 2023-03-02T11:07:36.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.993+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/1582456135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a4e3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.993+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/1582456135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 0x55565a4de790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.993+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/1582456135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 0x55565a4e2bd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.993+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1582456135 >> 172.21.15.57:0/1582456135 conn(0x55565a4d3c50 msgr2=0x55565a4d9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:36.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.993+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1582456135 shutdown_connections 2023-03-02T11:07:36.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.993+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1582456135 wait complete. 2023-03-02T11:07:36.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.993+0000 7f504c0cbb80 1 -- start start 2023-03-02T11:07:36.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f504c0cbb80 1 Processor -- start 2023-03-02T11:07:36.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ea930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:36.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4decd0 0x55565a4e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:36.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4e3110 0x55565a4e82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:36.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a436bc0 con 0x55565a4decd0 2023-03-02T11:07:36.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a4300f0 con 0x55565a4de3c0 2023-03-02T11:07:36.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a2b4920 con 0x55565a4e3110 2023-03-02T11:07:36.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f504c0cbb80 10 client.0 _ll_register_callbacks cb 0x55565a3d6520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:07:36.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f503659b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:36.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f5035d9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4decd0 0x55565a4e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:36.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f5036d9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4e3110 0x55565a4e82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:36.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f503659b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ea930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:54808/0 (socket says 172.21.15.57:54808) 2023-03-02T11:07:36.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f503659b700 1 -- 172.21.15.57:0/2652080795 learned_addr learned my addr 172.21.15.57:0/2652080795 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:07:36.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f503659b700 1 -- 172.21.15.57:0/2652080795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4e3110 msgr2=0x55565a4e82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:36.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f503659b700 1 --2- 172.21.15.57:0/2652080795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4e3110 0x55565a4e82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f503659b700 1 -- 172.21.15.57:0/2652080795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4decd0 msgr2=0x55565a4e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:36.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f503659b700 1 --2- 172.21.15.57:0/2652080795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4decd0 0x55565a4e7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.994+0000 7f503659b700 1 -- 172.21.15.57:0/2652080795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503010fb10 con 0x55565a4de3c0 2023-03-02T11:07:36.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.995+0000 7f503659b700 1 --2- 172.21.15.57:0/2652080795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ea930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f502c00c010 tx=0x7f502c00b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8287b2522b7bd323 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:36.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.995+0000 7f5019ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:07:36.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.995+0000 7f5019ffb700 1 -- 172.21.15.57:0/2652080795 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c01d070 con 0x55565a4de3c0 2023-03-02T11:07:36.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.995+0000 7f5019ffb700 1 -- 172.21.15.57:0/2652080795 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f502c004500 con 0x55565a4de3c0 2023-03-02T11:07:36.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.995+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2652080795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55565a4017b0 con 0x55565a4de3c0 2023-03-02T11:07:36.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.995+0000 7f5019ffb700 1 -- 172.21.15.57:0/2652080795 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f502c0046c0 con 0x55565a4de3c0 2023-03-02T11:07:36.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.995+0000 7f504c0cbb80 10 client.26315 fetch_fsmap learned FSMap version 47 2023-03-02T11:07:36.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.995+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2652080795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55565a25ede0 con 0x55565a4de3c0 2023-03-02T11:07:36.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.995+0000 7f5019ffb700 1 -- 172.21.15.57:0/2652080795 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55565a4017b0 con 0x55565a4de3c0 2023-03-02T11:07:36.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.995+0000 7f5019ffb700 1 -- 172.21.15.57:0/2652080795 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f502c00f850 con 0x55565a4de3c0 2023-03-02T11:07:36.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.996+0000 7f504c0cbb80 10 client.26315 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:07:36.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.996+0000 7f504c0cbb80 10 client.26315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:07:36.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.996+0000 7f504c0cbb80 20 client.26315 populate_metadata read hostname 'smithi057' 2023-03-02T11:07:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.996+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/2652080795 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55565a4f8270 0x55565a4fa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.996+0000 7f504c0cbb80 4 client.26315 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:07:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.996+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2652080795 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55565a429170 con 0x55565a4f8270 2023-03-02T11:07:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.996+0000 7f5035d9a700 1 --2- 172.21.15.57:0/2652080795 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55565a4f8270 0x55565a4fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.996+0000 7f5019ffb700 10 client.26315 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:07:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.996+0000 7f5035d9a700 1 --2- 172.21.15.57:0/2652080795 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55565a4f8270 0x55565a4fa680 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e46501b3b519b28 server_cookie=5495f99e3217a0ae in_seq=0 out_seq=0 2023-03-02T11:07:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f5019ffb700 1 -- 172.21.15.57:0/2652080795 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55565a429170 con 0x55565a4f8270 2023-03-02T11:07:36.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f5019ffb700 10 client.26315 handle_command_reply: tid=0 2023-03-02T11:07:36.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f504c0cbb80 1 client.26315 shutdown 2023-03-02T11:07:36.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2652080795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 msgr2=0x55565a4ea930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:36.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/2652080795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ea930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f502c00c010 tx=0x7f502c00b610 comp rx=0 tx=0).stop 2023-03-02T11:07:36.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2652080795 shutdown_connections 2023-03-02T11:07:36.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/2652080795 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55565a4f8270 0x55565a4fa680 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/2652080795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4e3110 0x55565a4e82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/2652080795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ea930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/2652080795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4decd0 0x55565a4e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f5019ffb700 0 client.26315 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:07:36.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2652080795 >> 172.21.15.57:0/2652080795 conn(0x55565a4d3c50 msgr2=0x55565a4d9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:36.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2652080795 shutdown_connections 2023-03-02T11:07:36.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.997+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2652080795 wait complete. 2023-03-02T11:07:36.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:35.998+0000 7f504c0cbb80 20 client.26315 trim_cache size 0 max 16384 2023-03-02T11:07:36.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.014+0000 7f504c0cbb80 1 Processor -- start 2023-03-02T11:07:36.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.014+0000 7f504c0cbb80 1 -- start start 2023-03-02T11:07:36.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.014+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 0x55565a4ea460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.014+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 0x55565a4e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.014+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a4e79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.014+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a4e7f20 con 0x55565a4e3110 2023-03-02T11:07:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.014+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a4d9f50 con 0x55565a4decd0 2023-03-02T11:07:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.014+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a4ff230 con 0x55565a4de3c0 2023-03-02T11:07:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.014+0000 7f503659b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 0x55565a4ea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f5035d9a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 0x55565a4e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f503659b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 0x55565a4ea460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:44858/0 (socket says 172.21.15.57:44858) 2023-03-02T11:07:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f5036d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a4e79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f503659b700 1 -- 172.21.15.57:0/2752164209 learned_addr learned my addr 172.21.15.57:0/2752164209 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:07:36.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f503659b700 1 -- 172.21.15.57:0/2752164209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 msgr2=0x55565a4e74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:36.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f503659b700 1 --2- 172.21.15.57:0/2752164209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 0x55565a4e74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f503659b700 1 -- 172.21.15.57:0/2752164209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 msgr2=0x55565a4e79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:36.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f503659b700 1 --2- 172.21.15.57:0/2752164209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a4e79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f503659b700 1 -- 172.21.15.57:0/2752164209 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55565a4d53f0 con 0x55565a4de3c0 2023-03-02T11:07:36.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f5035d9a700 1 --2- 172.21.15.57:0/2752164209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 0x55565a4e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:07:36.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f503659b700 1 --2- 172.21.15.57:0/2752164209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 0x55565a4ea460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f502c000c00 tx=0x7f502c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec75ce3f229b9fe5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:36.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f50257fa700 1 -- 172.21.15.57:0/2752164209 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c01d070 con 0x55565a4de3c0 2023-03-02T11:07:36.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f50257fa700 1 -- 172.21.15.57:0/2752164209 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f502c01e040 con 0x55565a4de3c0 2023-03-02T11:07:36.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.015+0000 7f50257fa700 1 -- 172.21.15.57:0/2752164209 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c024a90 con 0x55565a4de3c0 2023-03-02T11:07:36.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.016+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2752164209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 msgr2=0x55565a4ea460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:36.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.016+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/2752164209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 0x55565a4ea460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f502c000c00 tx=0x7f502c009310 comp rx=0 tx=0).stop 2023-03-02T11:07:36.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.016+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2752164209 shutdown_connections 2023-03-02T11:07:36.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.016+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/2752164209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a4e79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.016+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/2752164209 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4de3c0 0x55565a4ea460 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.016+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/2752164209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4decd0 0x55565a4e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.016+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2752164209 >> 172.21.15.57:0/2752164209 conn(0x55565a4d3c50 msgr2=0x55565a4f3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:36.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.016+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2752164209 shutdown_connections 2023-03-02T11:07:36.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.016+0000 7f504c0cbb80 1 -- 172.21.15.57:0/2752164209 wait complete. 2023-03-02T11:07:36.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.016+0000 7f504c0cbb80 1 -- start start 2023-03-02T11:07:36.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.016+0000 7f504c0cbb80 1 Processor -- start 2023-03-02T11:07:36.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ed480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:36.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4decd0 0x55565a4ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f504c0cbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a548b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a549060 con 0x55565a4e3110 2023-03-02T11:07:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a5491a0 con 0x55565a4de3c0 2023-03-02T11:07:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f504c0cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565a5492e0 con 0x55565a4decd0 2023-03-02T11:07:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f504c0cbb80 10 client.0 _ll_register_callbacks cb 0x55565a3d6520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:07:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f503659b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f5036d9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a548b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f5035d9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4decd0 0x55565a4ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f503659b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ed480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:52028/0 (socket says 172.21.15.57:52028) 2023-03-02T11:07:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f503659b700 1 -- 172.21.15.57:0/1161797113 learned_addr learned my addr 172.21.15.57:0/1161797113 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:07:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f5035d9a700 1 -- 172.21.15.57:0/1161797113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 msgr2=0x55565a4ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f5035d9a700 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f5035d9a700 1 -- 172.21.15.57:0/1161797113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 msgr2=0x55565a548b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:07:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f5035d9a700 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a548b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f5035d9a700 1 -- 172.21.15.57:0/1161797113 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55565a2b2630 con 0x55565a4decd0 2023-03-02T11:07:36.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f503659b700 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:07:36.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f5035d9a700 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4decd0 0x55565a4ed9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5020090ca0 tx=0x7f50200946a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3547371ad7fcc28 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:07:36.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.017+0000 7f5019ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:07:36.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f5019ffb700 1 -- 172.21.15.57:0/1161797113 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020098170 con 0x55565a4decd0 2023-03-02T11:07:36.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1161797113 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f502005f4d0 con 0x55565a4decd0 2023-03-02T11:07:36.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f5019ffb700 1 -- 172.21.15.57:0/1161797113 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f5020094ea0 con 0x55565a4decd0 2023-03-02T11:07:36.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f5019ffb700 1 -- 172.21.15.57:0/1161797113 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f502009bec0 con 0x55565a4decd0 2023-03-02T11:07:36.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f504c0cbb80 10 client.26272 fetch_fsmap learned FSMap version 47 2023-03-02T11:07:36.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1161797113 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55565a25ede0 con 0x55565a4decd0 2023-03-02T11:07:36.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f5019ffb700 1 -- 172.21.15.57:0/1161797113 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f502005f4d0 con 0x55565a4decd0 2023-03-02T11:07:36.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f5019ffb700 1 -- 172.21.15.57:0/1161797113 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f502005f670 con 0x55565a4decd0 2023-03-02T11:07:36.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f504c0cbb80 10 client.26272 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:07:36.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f504c0cbb80 10 client.26272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:07:36.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f504c0cbb80 20 client.26272 populate_metadata read hostname 'smithi057' 2023-03-02T11:07:36.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55565a54a850 0x55565a54cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:07:36.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f504c0cbb80 4 client.26272 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:07:36.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1161797113 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55565a428e90 con 0x55565a54a850 2023-03-02T11:07:36.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.018+0000 7f503659b700 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55565a54a850 0x55565a54cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:36.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f5019ffb700 10 client.26272 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:07:36.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f503659b700 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55565a54a850 0x55565a54cc60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27efd445c4f398da server_cookie=987dcae47331fb83 in_seq=0 out_seq=0 2023-03-02T11:07:36.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f5019ffb700 1 -- 172.21.15.57:0/1161797113 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55565a428e90 con 0x55565a54a850 2023-03-02T11:07:36.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f5019ffb700 10 client.26272 handle_command_reply: tid=0 2023-03-02T11:07:36.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f504c0cbb80 1 client.26272 shutdown 2023-03-02T11:07:36.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1161797113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4decd0 msgr2=0x55565a4ed9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:36.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4decd0 0x55565a4ed9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5020090ca0 tx=0x7f50200946a0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1161797113 shutdown_connections 2023-03-02T11:07:36.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55565a54a850 0x55565a54cc60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55565a4e3110 0x55565a548b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55565a4de3c0 0x55565a4ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f504c0cbb80 1 --2- 172.21.15.57:0/1161797113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55565a4decd0 0x55565a4ed9c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f5019ffb700 0 client.26272 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:07:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1161797113 >> 172.21.15.57:0/1161797113 conn(0x55565a4d3c50 msgr2=0x55565a4e21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1161797113 shutdown_connections 2023-03-02T11:07:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.019+0000 7f504c0cbb80 1 -- 172.21.15.57:0/1161797113 wait complete. 2023-03-02T11:07:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f504c0cbb80 20 client.26272 trim_cache size 0 max 16384 2023-03-02T11:07:36.032 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:07:36.032 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:07:36.032 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:07:36.032 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:07:36.032 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:07:36.032 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:07:36.032 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:07:36.033 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:07:36.033 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:07:36.033 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:07:36.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 -- 172.21.15.57:0/100093418 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f501c09b480 msgr2=0x7f501c09d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:36.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f501c09b480 0x7f501c09d930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5028009fd0 tx=0x7f5028009920 comp rx=0 tx=0).stop 2023-03-02T11:07:36.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 -- 172.21.15.57:0/100093418 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5030100480 msgr2=0x7f5030198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:07:36.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5030100480 0x7f5030198340 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f502000e9a0 tx=0x7f502000ecb0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 -- 172.21.15.57:0/100093418 shutdown_connections 2023-03-02T11:07:36.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f501c09b480 0x7f501c09d930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5030105ae0 0x7f503019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50300ffad0 0x7f5030197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 --2- 172.21.15.57:0/100093418 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5030100480 0x7f5030198340 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:07:36.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 -- 172.21.15.57:0/100093418 >> 172.21.15.57:0/100093418 conn(0x7f50300fb610 msgr2=0x7f503010ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:07:36.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 -- 172.21.15.57:0/100093418 shutdown_connections 2023-03-02T11:07:36.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:07:36.020+0000 7f50387ff700 1 -- 172.21.15.57:0/100093418 wait complete. 2023-03-02T11:07:36.036 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:07:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:36 smithi136 ceph-mon[125702]: pgmap v328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:36 smithi057 ceph-mon[92072]: pgmap v328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:36 smithi122 ceph-mon[125440]: pgmap v328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:38 smithi136 ceph-mon[125702]: pgmap v329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:07:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:38 smithi057 ceph-mon[92072]: pgmap v329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:07:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:38 smithi122 ceph-mon[125440]: pgmap v329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:07:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:40 smithi136 ceph-mon[125702]: pgmap v330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:40 smithi057 ceph-mon[92072]: pgmap v330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:40 smithi122 ceph-mon[125440]: pgmap v330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:42 smithi136 ceph-mon[125702]: pgmap v331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:42 smithi057 ceph-mon[92072]: pgmap v331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:42 smithi122 ceph-mon[125440]: pgmap v331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:44 smithi136 ceph-mon[125702]: pgmap v332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:07:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:44 smithi057 ceph-mon[92072]: pgmap v332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:07:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:44 smithi122 ceph-mon[125440]: pgmap v332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:07:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:46 smithi136 ceph-mon[125702]: pgmap v333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:46 smithi057 ceph-mon[92072]: pgmap v333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:46 smithi122 ceph-mon[125440]: pgmap v333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:48 smithi136 ceph-mon[125702]: pgmap v334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:07:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:48 smithi057 ceph-mon[92072]: pgmap v334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:07:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:48 smithi122 ceph-mon[125440]: pgmap v334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:07:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:49.224+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:07:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:49.225+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:07:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:49.225+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:07:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:49.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:07:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:07:49.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:07:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:50 smithi136 ceph-mon[125702]: pgmap v335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:50 smithi057 ceph-mon[92072]: pgmap v335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:50 smithi122 ceph-mon[125440]: pgmap v335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:07:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:52 smithi136 ceph-mon[125702]: pgmap v336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:52 smithi057 ceph-mon[92072]: pgmap v336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:52 smithi122 ceph-mon[125440]: pgmap v336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:54 smithi136 ceph-mon[125702]: pgmap v337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:07:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:54 smithi057 ceph-mon[92072]: pgmap v337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:07:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:54 smithi122 ceph-mon[125440]: pgmap v337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:07:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:56 smithi136 ceph-mon[125702]: pgmap v338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:56 smithi057 ceph-mon[92072]: pgmap v338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:56 smithi122 ceph-mon[125440]: pgmap v338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:07:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:07:58 smithi136 ceph-mon[125702]: pgmap v339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T11:07:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:07:58 smithi057 ceph-mon[92072]: pgmap v339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T11:07:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:07:58 smithi122 ceph-mon[125440]: pgmap v339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T11:08:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:00 smithi136 ceph-mon[125702]: pgmap v340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:08:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:00 smithi057 ceph-mon[92072]: pgmap v340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:08:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:00 smithi122 ceph-mon[125440]: pgmap v340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:08:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:02 smithi136 ceph-mon[125702]: pgmap v341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:08:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:02 smithi057 ceph-mon[92072]: pgmap v341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:08:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:02 smithi122 ceph-mon[125440]: pgmap v341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:08:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:04.231+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:04.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:04.232+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:08:04.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:04.232+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:08:04.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:04.232+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:08:04.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:04.232+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:08:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:04 smithi136 ceph-mon[125702]: pgmap v342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:08:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:04 smithi057 ceph-mon[92072]: pgmap v342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:08:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:04 smithi122 ceph-mon[125440]: pgmap v342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:08:06.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:08:06.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.210+0000 7fc733dff700 1 -- 172.21.15.57:0/748518270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc72c0ff360 msgr2=0x7fc72c10b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:06.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.210+0000 7fc733dff700 1 --2- 172.21.15.57:0/748518270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc72c0ff360 0x7fc72c10b7f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc72400b0a0 tx=0x7fc72400b3b0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.210+0000 7fc733dff700 1 -- 172.21.15.57:0/748518270 shutdown_connections 2023-03-02T11:08:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.210+0000 7fc733dff700 1 --2- 172.21.15.57:0/748518270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc72c0ff360 0x7fc72c10b7f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.210+0000 7fc733dff700 1 --2- 172.21.15.57:0/748518270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72c1049c0 0x7fc72c104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.210+0000 7fc733dff700 1 --2- 172.21.15.57:0/748518270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc72c0fe9b0 0x7fc72c0fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.210+0000 7fc733dff700 1 -- 172.21.15.57:0/748518270 >> 172.21.15.57:0/748518270 conn(0x7fc72c0fa4b0 msgr2=0x7fc72c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:06.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.210+0000 7fc733dff700 1 -- 172.21.15.57:0/748518270 shutdown_connections 2023-03-02T11:08:06.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.210+0000 7fc733dff700 1 -- 172.21.15.57:0/748518270 wait complete. 2023-03-02T11:08:06.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc733dff700 1 Processor -- start 2023-03-02T11:08:06.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc733dff700 1 -- start start 2023-03-02T11:08:06.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc733dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc72c0fe9b0 0x7fc72c195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc733dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72c0ff360 0x7fc72c196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc733dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc72c1049c0 0x7fc72c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc733dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c19ad30 con 0x7fc72c0ff360 2023-03-02T11:08:06.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc733dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c19aea0 con 0x7fc72c0fe9b0 2023-03-02T11:08:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc733dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c19b060 con 0x7fc72c1049c0 2023-03-02T11:08:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc731b9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc72c0fe9b0 0x7fc72c195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc73139a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72c0ff360 0x7fc72c196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc731b9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc72c0fe9b0 0x7fc72c195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33562/0 (socket says 172.21.15.57:33562) 2023-03-02T11:08:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc731b9b700 1 -- 172.21.15.57:0/2428944710 learned_addr learned my addr 172.21.15.57:0/2428944710 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:08:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.211+0000 7fc73239c700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc72c1049c0 0x7fc72c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc73139a700 1 -- 172.21.15.57:0/2428944710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc72c1049c0 msgr2=0x7fc72c19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc73139a700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc72c1049c0 0x7fc72c19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc73139a700 1 -- 172.21.15.57:0/2428944710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc72c0fe9b0 msgr2=0x7fc72c195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc73139a700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc72c0fe9b0 0x7fc72c195d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc73139a700 1 -- 172.21.15.57:0/2428944710 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc724009d00 con 0x7fc72c0ff360 2023-03-02T11:08:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc731b9b700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc72c0fe9b0 0x7fc72c195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:08:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc73139a700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72c0ff360 0x7fc72c196290 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00e9f0 tx=0x7fc71c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc722ffd700 1 -- 172.21.15.57:0/2428944710 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00c9c0 con 0x7fc72c0ff360 2023-03-02T11:08:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc733dff700 1 -- 172.21.15.57:0/2428944710 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72c10ea50 con 0x7fc72c0ff360 2023-03-02T11:08:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc722ffd700 1 -- 172.21.15.57:0/2428944710 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc71c010430 con 0x7fc72c0ff360 2023-03-02T11:08:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc722ffd700 1 -- 172.21.15.57:0/2428944710 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c018680 con 0x7fc72c0ff360 2023-03-02T11:08:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.212+0000 7fc733dff700 1 -- 172.21.15.57:0/2428944710 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c10e8c0 con 0x7fc72c0ff360 2023-03-02T11:08:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.215+0000 7fc722ffd700 1 -- 172.21.15.57:0/2428944710 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fc71c00c040 con 0x7fc72c0ff360 2023-03-02T11:08:06.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.216+0000 7fc722ffd700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc71809b480 0x7fc71809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.216+0000 7fc722ffd700 1 -- 172.21.15.57:0/2428944710 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fc71c014070 con 0x7fc72c0ff360 2023-03-02T11:08:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.216+0000 7fc731b9b700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc71809b480 0x7fc71809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.216+0000 7fc747812b80 1 Processor -- start 2023-03-02T11:08:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.216+0000 7fc747812b80 1 -- start start 2023-03-02T11:08:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.216+0000 7fc731b9b700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc71809b480 0x7fc71809d930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc728005950 tx=0x7fc728009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc747812b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed23c0 0x5562b5ed2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc747812b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 0x5562b5ed6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc747812b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 0x5562b5ed7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc747812b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5e39a60 con 0x5562b5ed7110 2023-03-02T11:08:06.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc747812b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5debf80 con 0x5562b5ed23c0 2023-03-02T11:08:06.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc747812b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5dbc160 con 0x5562b5ed2cd0 2023-03-02T11:08:06.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc731b9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed23c0 0x5562b5ed2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc731b9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed23c0 0x5562b5ed2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33570/0 (socket says 172.21.15.57:33570) 2023-03-02T11:08:06.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc731b9b700 1 -- 172.21.15.57:0/3779384716 learned_addr learned my addr 172.21.15.57:0/3779384716 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:08:06.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc73139a700 1 --2- 172.21.15.57:0/3779384716 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 0x5562b5ed6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc73239c700 1 --2- 172.21.15.57:0/3779384716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 0x5562b5ed7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc731b9b700 1 -- 172.21.15.57:0/3779384716 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 msgr2=0x5562b5ed6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:06.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc731b9b700 1 --2- 172.21.15.57:0/3779384716 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 0x5562b5ed6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc731b9b700 1 -- 172.21.15.57:0/3779384716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 msgr2=0x5562b5ed7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:06.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc731b9b700 1 --2- 172.21.15.57:0/3779384716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 0x5562b5ed7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc731b9b700 1 -- 172.21.15.57:0/3779384716 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562b5ca6630 con 0x5562b5ed23c0 2023-03-02T11:08:06.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.217+0000 7fc731b9b700 1 --2- 172.21.15.57:0/3779384716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed23c0 0x5562b5ed2790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc72800e730 tx=0x7fc728014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cb7d764c05f0c6f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:06.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc717fff700 1 -- 172.21.15.57:0/3779384716 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728004830 con 0x5562b5ed23c0 2023-03-02T11:08:06.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc717fff700 1 -- 172.21.15.57:0/3779384716 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc728004e50 con 0x5562b5ed23c0 2023-03-02T11:08:06.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc717fff700 1 -- 172.21.15.57:0/3779384716 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72801e660 con 0x5562b5ed23c0 2023-03-02T11:08:06.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc747812b80 1 -- 172.21.15.57:0/3779384716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed23c0 msgr2=0x5562b5ed2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:06.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc747812b80 1 --2- 172.21.15.57:0/3779384716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed23c0 0x5562b5ed2790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc72800e730 tx=0x7fc728014000 comp rx=0 tx=0).stop 2023-03-02T11:08:06.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc747812b80 1 -- 172.21.15.57:0/3779384716 shutdown_connections 2023-03-02T11:08:06.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc747812b80 1 --2- 172.21.15.57:0/3779384716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 0x5562b5ed7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc747812b80 1 --2- 172.21.15.57:0/3779384716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed23c0 0x5562b5ed2790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc747812b80 1 --2- 172.21.15.57:0/3779384716 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 0x5562b5ed6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc747812b80 1 -- 172.21.15.57:0/3779384716 >> 172.21.15.57:0/3779384716 conn(0x5562b5ec7c50 msgr2=0x5562b5ecd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:06.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc747812b80 1 -- 172.21.15.57:0/3779384716 shutdown_connections 2023-03-02T11:08:06.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.218+0000 7fc747812b80 1 -- 172.21.15.57:0/3779384716 wait complete. 2023-03-02T11:08:06.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.219+0000 7fc747812b80 1 -- start start 2023-03-02T11:08:06.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.219+0000 7fc747812b80 1 Processor -- start 2023-03-02T11:08:06.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.219+0000 7fc747812b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 0x5562b5ede820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.219+0000 7fc747812b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 0x5562b5edbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc747812b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed7110 0x5562b5edc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc747812b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5e2abc0 con 0x5562b5ed23c0 2023-03-02T11:08:06.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc747812b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5e240f0 con 0x5562b5ed7110 2023-03-02T11:08:06.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc747812b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5ca8920 con 0x5562b5ed2cd0 2023-03-02T11:08:06.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc747812b80 10 client.0 _ll_register_callbacks cb 0x5562b5dca520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:08:06.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc731b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 0x5562b5ede820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc73139a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 0x5562b5edbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc73139a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 0x5562b5edbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:39038/0 (socket says 172.21.15.57:39038) 2023-03-02T11:08:06.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc73139a700 1 -- 172.21.15.57:0/3289354570 learned_addr learned my addr 172.21.15.57:0/3289354570 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:08:06.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc73239c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed7110 0x5562b5edc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc73139a700 1 -- 172.21.15.57:0/3289354570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed7110 msgr2=0x5562b5edc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:06.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc73139a700 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed7110 0x5562b5edc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc73139a700 1 -- 172.21.15.57:0/3289354570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 msgr2=0x5562b5ede820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:06.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc73139a700 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 0x5562b5ede820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc73139a700 1 -- 172.21.15.57:0/3289354570 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc728017070 con 0x5562b5ed2cd0 2023-03-02T11:08:06.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc73239c700 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed7110 0x5562b5edc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:08:06.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc731b9b700 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 0x5562b5ede820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:08:06.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc73139a700 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 0x5562b5edbaa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00c5b0 tx=0x7fc71c094c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3c85408faecb1cc server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:06.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.220+0000 7fc7157fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:08:06.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc7157fa700 1 -- 172.21.15.57:0/3289354570 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c094de0 con 0x5562b5ed2cd0 2023-03-02T11:08:06.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc7157fa700 1 -- 172.21.15.57:0/3289354570 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fc71c0ad060 con 0x5562b5ed2cd0 2023-03-02T11:08:06.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc747812b80 1 -- 172.21.15.57:0/3289354570 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562b5df57b0 con 0x5562b5ed2cd0 2023-03-02T11:08:06.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc7157fa700 1 -- 172.21.15.57:0/3289354570 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc71c0946e0 con 0x5562b5ed2cd0 2023-03-02T11:08:06.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc747812b80 10 client.26284 fetch_fsmap learned FSMap version 47 2023-03-02T11:08:06.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc747812b80 1 -- 172.21.15.57:0/3289354570 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5562b5c52de0 con 0x5562b5ed2cd0 2023-03-02T11:08:06.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc7157fa700 1 -- 172.21.15.57:0/3289354570 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5562b5df57b0 con 0x5562b5ed2cd0 2023-03-02T11:08:06.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc7157fa700 1 -- 172.21.15.57:0/3289354570 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc71c0904d0 con 0x5562b5ed2cd0 2023-03-02T11:08:06.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc747812b80 10 client.26284 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:08:06.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc747812b80 10 client.26284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:08:06.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc747812b80 20 client.26284 populate_metadata read hostname 'smithi057' 2023-03-02T11:08:06.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc747812b80 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5562b5eec250 0x5562b5eee660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc747812b80 4 client.26284 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:08:06.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.221+0000 7fc747812b80 1 -- 172.21.15.57:0/3289354570 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562b5e1d170 con 0x5562b5eec250 2023-03-02T11:08:06.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.222+0000 7fc731b9b700 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5562b5eec250 0x5562b5eee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.222+0000 7fc7157fa700 10 client.26284 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:08:06.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.222+0000 7fc731b9b700 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5562b5eec250 0x5562b5eee660 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84e99819f45ee1b server_cookie=606089a54259258 in_seq=0 out_seq=0 2023-03-02T11:08:06.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc7157fa700 1 -- 172.21.15.57:0/3289354570 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5562b5e1d170 con 0x5562b5eec250 2023-03-02T11:08:06.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc7157fa700 10 client.26284 handle_command_reply: tid=0 2023-03-02T11:08:06.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 1 client.26284 shutdown 2023-03-02T11:08:06.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 1 -- 172.21.15.57:0/3289354570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 msgr2=0x5562b5edbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:06.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 0x5562b5edbaa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00c5b0 tx=0x7fc71c094c20 comp rx=0 tx=0).stop 2023-03-02T11:08:06.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 1 -- 172.21.15.57:0/3289354570 shutdown_connections 2023-03-02T11:08:06.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5562b5eec250 0x5562b5eee660 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed7110 0x5562b5edc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 0x5562b5ede820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 1 --2- 172.21.15.57:0/3289354570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed2cd0 0x5562b5edbaa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc7157fa700 0 client.26284 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:08:06.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 1 -- 172.21.15.57:0/3289354570 >> 172.21.15.57:0/3289354570 conn(0x5562b5ec7c50 msgr2=0x5562b5ecc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:06.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 1 -- 172.21.15.57:0/3289354570 shutdown_connections 2023-03-02T11:08:06.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 1 -- 172.21.15.57:0/3289354570 wait complete. 2023-03-02T11:08:06.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.223+0000 7fc747812b80 20 client.26284 trim_cache size 0 max 16384 2023-03-02T11:08:06.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.239+0000 7fc747812b80 1 Processor -- start 2023-03-02T11:08:06.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.239+0000 7fc747812b80 1 -- start start 2023-03-02T11:08:06.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc747812b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 0x5562b5ede3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc747812b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 0x5562b5ed74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc747812b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed7110 0x5562b5ed7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc747812b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5edd080 con 0x5562b5ed23c0 2023-03-02T11:08:06.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc747812b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5edca60 con 0x5562b5ed2cd0 2023-03-02T11:08:06.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc747812b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5ec77d0 con 0x5562b5ed7110 2023-03-02T11:08:06.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc731b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 0x5562b5ede3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc73239c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed7110 0x5562b5ed7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc73139a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 0x5562b5ed74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc73239c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed7110 0x5562b5ed7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:39054/0 (socket says 172.21.15.57:39054) 2023-03-02T11:08:06.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc731b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 0x5562b5ede3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40298/0 (socket says 172.21.15.57:40298) 2023-03-02T11:08:06.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc73239c700 1 -- 172.21.15.57:0/884202799 learned_addr learned my addr 172.21.15.57:0/884202799 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:08:06.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc731b9b700 1 -- 172.21.15.57:0/884202799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed7110 msgr2=0x5562b5ed7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:06.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc731b9b700 1 --2- 172.21.15.57:0/884202799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed7110 0x5562b5ed7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc731b9b700 1 -- 172.21.15.57:0/884202799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 msgr2=0x5562b5ed74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:06.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc731b9b700 1 --2- 172.21.15.57:0/884202799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 0x5562b5ed74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc731b9b700 1 -- 172.21.15.57:0/884202799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562b5ec93f0 con 0x5562b5ed23c0 2023-03-02T11:08:06.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.240+0000 7fc731b9b700 1 --2- 172.21.15.57:0/884202799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 0x5562b5ede3c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc72800ed20 tx=0x7fc728017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efe4502d2d24660 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:06.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc720bff700 1 -- 172.21.15.57:0/884202799 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72802b070 con 0x5562b5ed23c0 2023-03-02T11:08:06.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc720bff700 1 -- 172.21.15.57:0/884202799 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc72802c040 con 0x5562b5ed23c0 2023-03-02T11:08:06.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc720bff700 1 -- 172.21.15.57:0/884202799 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728033740 con 0x5562b5ed23c0 2023-03-02T11:08:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc747812b80 1 -- 172.21.15.57:0/884202799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 msgr2=0x5562b5ede3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc747812b80 1 --2- 172.21.15.57:0/884202799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 0x5562b5ede3c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc72800ed20 tx=0x7fc728017000 comp rx=0 tx=0).stop 2023-03-02T11:08:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc747812b80 1 -- 172.21.15.57:0/884202799 shutdown_connections 2023-03-02T11:08:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc747812b80 1 --2- 172.21.15.57:0/884202799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed7110 0x5562b5ed7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc747812b80 1 --2- 172.21.15.57:0/884202799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed23c0 0x5562b5ede3c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc747812b80 1 --2- 172.21.15.57:0/884202799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 0x5562b5ed74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc747812b80 1 -- 172.21.15.57:0/884202799 >> 172.21.15.57:0/884202799 conn(0x5562b5ec7c50 msgr2=0x5562b5ee77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc747812b80 1 -- 172.21.15.57:0/884202799 shutdown_connections 2023-03-02T11:08:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.241+0000 7fc747812b80 1 -- 172.21.15.57:0/884202799 wait complete. 2023-03-02T11:08:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc747812b80 1 -- start start 2023-03-02T11:08:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc747812b80 1 Processor -- start 2023-03-02T11:08:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc747812b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed23c0 0x5562b5edb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc747812b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 0x5562b5eda250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc747812b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 0x5562b5eda790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc747812b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5edbf20 con 0x5562b5ed7110 2023-03-02T11:08:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc747812b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5edacd0 con 0x5562b5ed2cd0 2023-03-02T11:08:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc747812b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b5edae90 con 0x5562b5ed23c0 2023-03-02T11:08:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc747812b80 10 client.0 _ll_register_callbacks cb 0x5562b5ecc3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:08:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc731b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed23c0 0x5562b5edb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc73239c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 0x5562b5eda790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc73139a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 0x5562b5eda250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc73239c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 0x5562b5eda790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40312/0 (socket says 172.21.15.57:40312) 2023-03-02T11:08:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc73139a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 0x5562b5eda250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:33610/0 (socket says 172.21.15.57:33610) 2023-03-02T11:08:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc731b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed23c0 0x5562b5edb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:39070/0 (socket says 172.21.15.57:39070) 2023-03-02T11:08:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.242+0000 7fc73239c700 1 -- 172.21.15.57:0/1148706084 learned_addr learned my addr 172.21.15.57:0/1148706084 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:08:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc73239c700 1 -- 172.21.15.57:0/1148706084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed23c0 msgr2=0x5562b5edb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc73239c700 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed23c0 0x5562b5edb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc73239c700 1 -- 172.21.15.57:0/1148706084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 msgr2=0x5562b5eda250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc73239c700 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 0x5562b5eda250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc73239c700 1 -- 172.21.15.57:0/1148706084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562b5ca6630 con 0x5562b5ed7110 2023-03-02T11:08:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc73139a700 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 0x5562b5eda250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:08:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc73239c700 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 0x5562b5eda790 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc724003c60 tx=0x7fc724003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c2bd9ba751b865 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc7157fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:08:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc7157fa700 1 -- 172.21.15.57:0/1148706084 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72400e040 con 0x5562b5ed7110 2023-03-02T11:08:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc7157fa700 1 -- 172.21.15.57:0/1148706084 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fc724005240 con 0x5562b5ed7110 2023-03-02T11:08:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc747812b80 1 -- 172.21.15.57:0/1148706084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc728004e50 con 0x5562b5ed7110 2023-03-02T11:08:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc7157fa700 1 -- 172.21.15.57:0/1148706084 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc724005440 con 0x5562b5ed7110 2023-03-02T11:08:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc747812b80 10 client.16497 fetch_fsmap learned FSMap version 47 2023-03-02T11:08:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc747812b80 1 -- 172.21.15.57:0/1148706084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5562b5c3bc60 con 0x5562b5ed7110 2023-03-02T11:08:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.243+0000 7fc7157fa700 1 -- 172.21.15.57:0/1148706084 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc728004e50 con 0x5562b5ed7110 2023-03-02T11:08:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc7157fa700 1 -- 172.21.15.57:0/1148706084 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc72400b0d0 con 0x5562b5ed7110 2023-03-02T11:08:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc747812b80 10 client.16497 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:08:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc747812b80 10 client.16497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:08:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc747812b80 20 client.16497 populate_metadata read hostname 'smithi057' 2023-03-02T11:08:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc747812b80 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5562b5f43220 0x5562b5f45630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc747812b80 4 client.16497 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:08:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc747812b80 1 -- 172.21.15.57:0/1148706084 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5562b5e1ce90 con 0x5562b5f43220 2023-03-02T11:08:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc731b9b700 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5562b5f43220 0x5562b5f45630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc7157fa700 10 client.16497 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:08:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc731b9b700 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5562b5f43220 0x5562b5f45630 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d15c07599c60539c server_cookie=83e3c428ad39c009 in_seq=0 out_seq=0 2023-03-02T11:08:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc7157fa700 1 -- 172.21.15.57:0/1148706084 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5562b5e1ce90 con 0x5562b5f43220 2023-03-02T11:08:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc7157fa700 10 client.16497 handle_command_reply: tid=0 2023-03-02T11:08:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.244+0000 7fc747812b80 1 client.16497 shutdown 2023-03-02T11:08:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc747812b80 1 -- 172.21.15.57:0/1148706084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 msgr2=0x5562b5eda790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc747812b80 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 0x5562b5eda790 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc724003c60 tx=0x7fc724003c90 comp rx=0 tx=0).stop 2023-03-02T11:08:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc747812b80 1 -- 172.21.15.57:0/1148706084 shutdown_connections 2023-03-02T11:08:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc747812b80 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5562b5f43220 0x5562b5f45630 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc747812b80 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5562b5ed7110 0x5562b5eda790 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc747812b80 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5562b5ed23c0 0x5562b5edb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc7157fa700 0 client.16497 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:08:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc747812b80 1 --2- 172.21.15.57:0/1148706084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562b5ed2cd0 0x5562b5eda250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc747812b80 1 -- 172.21.15.57:0/1148706084 >> 172.21.15.57:0/1148706084 conn(0x5562b5ec7c50 msgr2=0x5562b5ed74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc747812b80 1 -- 172.21.15.57:0/1148706084 shutdown_connections 2023-03-02T11:08:06.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc747812b80 1 -- 172.21.15.57:0/1148706084 wait complete. 2023-03-02T11:08:06.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc747812b80 20 client.16497 trim_cache size 0 max 16384 2023-03-02T11:08:06.264 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:08:06.264 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:08:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:08:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:08:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:08:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:08:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:08:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:08:06.265 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:08:06.266 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:08:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc733dff700 1 -- 172.21.15.57:0/2428944710 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc71809b480 msgr2=0x7fc71809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc733dff700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc71809b480 0x7fc71809d930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc728005950 tx=0x7fc728009260 comp rx=0 tx=0).stop 2023-03-02T11:08:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc733dff700 1 -- 172.21.15.57:0/2428944710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72c0ff360 msgr2=0x7fc72c196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc733dff700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72c0ff360 0x7fc72c196290 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00e9f0 tx=0x7fc71c00ed00 comp rx=0 tx=0).stop 2023-03-02T11:08:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc733dff700 1 -- 172.21.15.57:0/2428944710 shutdown_connections 2023-03-02T11:08:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc733dff700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fc71809b480 0x7fc71809d930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc733dff700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc72c1049c0 0x7fc72c19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc733dff700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc72c0fe9b0 0x7fc72c195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc733dff700 1 --2- 172.21.15.57:0/2428944710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72c0ff360 0x7fc72c196290 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc733dff700 1 -- 172.21.15.57:0/2428944710 >> 172.21.15.57:0/2428944710 conn(0x7fc72c0fa4b0 msgr2=0x7fc72c102700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.245+0000 7fc733dff700 1 -- 172.21.15.57:0/2428944710 shutdown_connections 2023-03-02T11:08:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:06.246+0000 7fc733dff700 1 -- 172.21.15.57:0/2428944710 wait complete. 2023-03-02T11:08:06.269 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:08:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:06 smithi136 ceph-mon[125702]: pgmap v343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:08:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:06 smithi057 ceph-mon[92072]: pgmap v343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:08:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:06 smithi122 ceph-mon[125440]: pgmap v343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:08:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:08.438+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858005ea0 con 0x7f5880105ae0 2023-03-02T11:08:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:08.438+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858005ea0 con 0x7f5880105ae0 2023-03-02T11:08:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:08.465+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850005e20 con 0x558558b6f6b0 2023-03-02T11:08:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:08.465+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850005e20 con 0x558558b6f6b0 2023-03-02T11:08:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:08 smithi136 ceph-mon[125702]: pgmap v344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:08:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:08 smithi057 ceph-mon[92072]: pgmap v344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:08:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:08 smithi122 ceph-mon[125440]: pgmap v344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:08:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:10 smithi136 ceph-mon[125702]: pgmap v345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:08:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:10 smithi057 ceph-mon[92072]: pgmap v345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:08:10.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:10 smithi122 ceph-mon[125440]: pgmap v345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:08:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:11 smithi136 ceph-mon[125702]: osdmap e96: 12 total, 12 up, 12 in 2023-03-02T11:08:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:11 smithi057 ceph-mon[92072]: osdmap e96: 12 total, 12 up, 12 in 2023-03-02T11:08:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:11 smithi122 ceph-mon[125440]: osdmap e96: 12 total, 12 up, 12 in 2023-03-02T11:08:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:12 smithi136 ceph-mon[125702]: pgmap v347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:08:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:12 smithi057 ceph-mon[92072]: pgmap v347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:08:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:12 smithi122 ceph-mon[125440]: pgmap v347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:08:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:14 smithi136 ceph-mon[125702]: pgmap v348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:08:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:14 smithi136 ceph-mon[125702]: osdmap e97: 12 total, 12 up, 12 in 2023-03-02T11:08:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:14 smithi057 ceph-mon[92072]: pgmap v348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:08:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:14 smithi057 ceph-mon[92072]: osdmap e97: 12 total, 12 up, 12 in 2023-03-02T11:08:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:14 smithi122 ceph-mon[125440]: pgmap v348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:08:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:14 smithi122 ceph-mon[125440]: osdmap e97: 12 total, 12 up, 12 in 2023-03-02T11:08:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:16 smithi136 ceph-mon[125702]: pgmap v350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:08:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:16 smithi057 ceph-mon[92072]: pgmap v350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:08:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:16 smithi122 ceph-mon[125440]: pgmap v350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:08:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:18 smithi057 ceph-mon[92072]: pgmap v351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:08:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:18 smithi122 ceph-mon[125440]: pgmap v351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:08:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:18 smithi136 ceph-mon[125702]: pgmap v351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:08:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:19.242+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:19.242+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:08:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:19.242+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:08:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:19.242+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:08:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:19.242+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:08:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:20 smithi057 ceph-mon[92072]: pgmap v352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T11:08:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:20 smithi122 ceph-mon[125440]: pgmap v352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T11:08:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:20 smithi136 ceph-mon[125702]: pgmap v352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T11:08:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:22 smithi057 ceph-mon[92072]: pgmap v353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:08:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:22 smithi122 ceph-mon[125440]: pgmap v353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:08:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:22 smithi136 ceph-mon[125702]: pgmap v353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:08:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:08:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:08:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:08:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:24 smithi057 ceph-mon[92072]: pgmap v354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T11:08:24.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:08:24.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:08:24.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:08:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:24 smithi122 ceph-mon[125440]: pgmap v354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T11:08:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:08:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:08:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:08:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:24 smithi136 ceph-mon[125702]: pgmap v354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T11:08:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:08:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:08:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:08:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:26 smithi057 ceph-mon[92072]: pgmap v355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:08:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:26 smithi122 ceph-mon[125440]: pgmap v355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:08:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:26 smithi136 ceph-mon[125702]: pgmap v355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:08:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:28 smithi057 ceph-mon[92072]: pgmap v356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:08:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:28 smithi122 ceph-mon[125440]: pgmap v356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:08:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:28 smithi136 ceph-mon[125702]: pgmap v356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:08:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:30 smithi057 ceph-mon[92072]: pgmap v357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:08:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:30 smithi122 ceph-mon[125440]: pgmap v357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:08:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:30 smithi136 ceph-mon[125702]: pgmap v357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T11:08:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:32 smithi057 ceph-mon[92072]: pgmap v358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:08:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:32 smithi122 ceph-mon[125440]: pgmap v358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:08:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:32 smithi136 ceph-mon[125702]: pgmap v358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:08:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:34.257+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:34.258+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:08:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:34.258+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:08:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:34.258+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:08:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:34.258+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:08:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:34 smithi057 ceph-mon[92072]: pgmap v359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:08:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:34 smithi122 ceph-mon[125440]: pgmap v359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:08:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:34 smithi136 ceph-mon[125702]: pgmap v359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:08:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:35 smithi057 ceph-mon[92072]: pgmap v360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:35 smithi122 ceph-mon[125440]: pgmap v360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:35 smithi136 ceph-mon[125702]: pgmap v360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:36.270 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:08:36.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.442+0000 7f3e233ff700 1 -- 172.21.15.57:0/2316152983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e1c1049c0 msgr2=0x7f3e1c104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:36.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.442+0000 7f3e233ff700 1 --2- 172.21.15.57:0/2316152983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c104d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009990 tx=0x7f3e18009ca0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.442+0000 7f3e233ff700 1 -- 172.21.15.57:0/2316152983 shutdown_connections 2023-03-02T11:08:36.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.442+0000 7f3e233ff700 1 --2- 172.21.15.57:0/2316152983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c0ff360 0x7f3e1c10b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.442+0000 7f3e233ff700 1 --2- 172.21.15.57:0/2316152983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c104d90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.442+0000 7f3e233ff700 1 --2- 172.21.15.57:0/2316152983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0fe9b0 0x7f3e1c0fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.442+0000 7f3e233ff700 1 -- 172.21.15.57:0/2316152983 >> 172.21.15.57:0/2316152983 conn(0x7f3e1c0fa4b0 msgr2=0x7f3e1c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:36.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.442+0000 7f3e233ff700 1 -- 172.21.15.57:0/2316152983 shutdown_connections 2023-03-02T11:08:36.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.442+0000 7f3e233ff700 1 -- 172.21.15.57:0/2316152983 wait complete. 2023-03-02T11:08:36.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.443+0000 7f3e233ff700 1 Processor -- start 2023-03-02T11:08:36.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.443+0000 7f3e233ff700 1 -- start start 2023-03-02T11:08:36.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.443+0000 7f3e233ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c0fe9b0 0x7f3e1c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.443+0000 7f3e233ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0ff360 0x7f3e1c19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.443+0000 7f3e233ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.443+0000 7f3e233ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c196090 con 0x7f3e1c0ff360 2023-03-02T11:08:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.443+0000 7f3e233ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c196200 con 0x7f3e1c1049c0 2023-03-02T11:08:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.443+0000 7f3e233ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c1963c0 con 0x7f3e1c0fe9b0 2023-03-02T11:08:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.443+0000 7f3e2119b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c0fe9b0 0x7f3e1c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e2099a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0ff360 0x7f3e1c19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e2119b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c0fe9b0 0x7f3e1c19b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:41532/0 (socket says 172.21.15.57:41532) 2023-03-02T11:08:36.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e2119b700 1 -- 172.21.15.57:0/1515879400 learned_addr learned my addr 172.21.15.57:0/1515879400 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:08:36.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e2199c700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e2099a700 1 -- 172.21.15.57:0/1515879400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c0fe9b0 msgr2=0x7f3e1c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:36.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e2099a700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c0fe9b0 0x7f3e1c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e2099a700 1 -- 172.21.15.57:0/1515879400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e1c1049c0 msgr2=0x7f3e1c195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:36.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e2099a700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e2099a700 1 -- 172.21.15.57:0/1515879400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180095f0 con 0x7f3e1c0ff360 2023-03-02T11:08:36.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e2099a700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0ff360 0x7f3e1c19bef0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00e9f0 tx=0x7f3e0c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:36.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e127fc700 1 -- 172.21.15.57:0/1515879400 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00c9c0 con 0x7f3e1c0ff360 2023-03-02T11:08:36.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e233ff700 1 -- 172.21.15.57:0/1515879400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1c10ea50 con 0x7f3e1c0ff360 2023-03-02T11:08:36.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e127fc700 1 -- 172.21.15.57:0/1515879400 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e0c010430 con 0x7f3e1c0ff360 2023-03-02T11:08:36.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e127fc700 1 -- 172.21.15.57:0/1515879400 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c018680 con 0x7f3e1c0ff360 2023-03-02T11:08:36.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.444+0000 7f3e233ff700 1 -- 172.21.15.57:0/1515879400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c10e8c0 con 0x7f3e1c0ff360 2023-03-02T11:08:36.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.448+0000 7f3e127fc700 1 -- 172.21.15.57:0/1515879400 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f3e0c00c040 con 0x7f3e1c0ff360 2023-03-02T11:08:36.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.449+0000 7f3e127fc700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3e0809b480 0x7f3e0809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.449+0000 7f3e36d00b80 1 Processor -- start 2023-03-02T11:08:36.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.449+0000 7f3e127fc700 1 -- 172.21.15.57:0/1515879400 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f3e0c014070 con 0x7f3e1c0ff360 2023-03-02T11:08:36.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.449+0000 7f3e2119b700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3e0809b480 0x7f3e0809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.449+0000 7f3e36d00b80 1 -- start start 2023-03-02T11:08:36.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.449+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54d97d0 0x5566f54d9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.449+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54da0e0 0x5566f54ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.449+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 0x5566f54de970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.449+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f543ca60 con 0x5566f54da0e0 2023-03-02T11:08:36.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.449+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f53eef80 con 0x5566f54de520 2023-03-02T11:08:36.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.449+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f53bf160 con 0x5566f54d97d0 2023-03-02T11:08:36.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2099a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54da0e0 0x5566f54ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2099a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54da0e0 0x5566f54ddfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58838/0 (socket says 172.21.15.57:58838) 2023-03-02T11:08:36.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2099a700 1 -- 172.21.15.57:0/1315797769 learned_addr learned my addr 172.21.15.57:0/1315797769 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:08:36.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2199c700 1 --2- 172.21.15.57:0/1315797769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 0x5566f54de970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2119b700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3e0809b480 0x7f3e0809d930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b2e0 tx=0x7f3e18005fd0 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:36.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2119b700 1 --2- 172.21.15.57:0/1315797769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54d97d0 0x5566f54d9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2099a700 1 -- 172.21.15.57:0/1315797769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54d97d0 msgr2=0x5566f54d9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:36.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2099a700 1 --2- 172.21.15.57:0/1315797769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54d97d0 0x5566f54d9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2099a700 1 -- 172.21.15.57:0/1315797769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 msgr2=0x5566f54de970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:36.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2099a700 1 --2- 172.21.15.57:0/1315797769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 0x5566f54de970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2099a700 1 -- 172.21.15.57:0/1315797769 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566f52a9630 con 0x5566f54da0e0 2023-03-02T11:08:36.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2199c700 1 --2- 172.21.15.57:0/1315797769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 0x5566f54de970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:08:36.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e2099a700 1 --2- 172.21.15.57:0/1315797769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54da0e0 0x5566f54ddfe0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0943e0 tx=0x7f3e0c094320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2858ac8f89effcaa server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:36.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e077fe700 1 -- 172.21.15.57:0/1315797769 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0946e0 con 0x5566f54da0e0 2023-03-02T11:08:36.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e077fe700 1 -- 172.21.15.57:0/1315797769 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e0c09be00 con 0x5566f54da0e0 2023-03-02T11:08:36.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.450+0000 7f3e077fe700 1 -- 172.21.15.57:0/1315797769 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c093e30 con 0x5566f54da0e0 2023-03-02T11:08:36.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.451+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1315797769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54da0e0 msgr2=0x5566f54ddfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:36.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.451+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/1315797769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54da0e0 0x5566f54ddfe0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0943e0 tx=0x7f3e0c094320 comp rx=0 tx=0).stop 2023-03-02T11:08:36.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.451+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1315797769 shutdown_connections 2023-03-02T11:08:36.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.451+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/1315797769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 0x5566f54de970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.451+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/1315797769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54d97d0 0x5566f54d9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.451+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/1315797769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54da0e0 0x5566f54ddfe0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.451+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1315797769 >> 172.21.15.57:0/1315797769 conn(0x5566f54cac50 msgr2=0x5566f54d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:36.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.451+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1315797769 shutdown_connections 2023-03-02T11:08:36.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.451+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1315797769 wait complete. 2023-03-02T11:08:36.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.451+0000 7f3e36d00b80 1 -- start start 2023-03-02T11:08:36.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e36d00b80 1 Processor -- start 2023-03-02T11:08:36.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54da0e0 0x5566f54e2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 0x5566f54e36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f542dbc0 con 0x5566f54d97d0 2023-03-02T11:08:36.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f54270f0 con 0x5566f54de520 2023-03-02T11:08:36.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f52ab920 con 0x5566f54da0e0 2023-03-02T11:08:36.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e36d00b80 10 client.0 _ll_register_callbacks cb 0x5566f53cd520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:08:36.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2119b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2099a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54da0e0 0x5566f54e2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2199c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 0x5566f54e36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2119b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58846/0 (socket says 172.21.15.57:58846) 2023-03-02T11:08:36.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2119b700 1 -- 172.21.15.57:0/1310558580 learned_addr learned my addr 172.21.15.57:0/1310558580 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:08:36.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2199c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 0x5566f54e36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48414/0 (socket says 172.21.15.57:48414) 2023-03-02T11:08:36.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2099a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54da0e0 0x5566f54e2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:41548/0 (socket says 172.21.15.57:41548) 2023-03-02T11:08:36.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2119b700 1 -- 172.21.15.57:0/1310558580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54da0e0 msgr2=0x5566f54e2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:36.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2119b700 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54da0e0 0x5566f54e2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2119b700 1 -- 172.21.15.57:0/1310558580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 msgr2=0x5566f54e36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:36.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2119b700 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 0x5566f54e36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.452+0000 7f3e2119b700 1 -- 172.21.15.57:0/1310558580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c10e8c0 con 0x5566f54d97d0 2023-03-02T11:08:36.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.453+0000 7f3e2199c700 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 0x5566f54e36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:08:36.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.453+0000 7f3e2119b700 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5d30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3e18024850 tx=0x7f3e1801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b2add3be9a76b0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:36.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.453+0000 7f3e04ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:08:36.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.453+0000 7f3e04ff9700 1 -- 172.21.15.57:0/1310558580 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18004500 con 0x5566f54d97d0 2023-03-02T11:08:36.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.453+0000 7f3e04ff9700 1 -- 172.21.15.57:0/1310558580 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f3e18004660 con 0x5566f54d97d0 2023-03-02T11:08:36.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.453+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1310558580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566f53f87b0 con 0x5566f54d97d0 2023-03-02T11:08:36.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.453+0000 7f3e04ff9700 1 -- 172.21.15.57:0/1310558580 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e18004860 con 0x5566f54d97d0 2023-03-02T11:08:36.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.453+0000 7f3e36d00b80 10 client.16509 fetch_fsmap learned FSMap version 47 2023-03-02T11:08:36.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.453+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1310558580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5566f5255de0 con 0x5566f54d97d0 2023-03-02T11:08:36.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.453+0000 7f3e04ff9700 1 -- 172.21.15.57:0/1310558580 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5566f53f87b0 con 0x5566f54d97d0 2023-03-02T11:08:36.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.454+0000 7f3e04ff9700 1 -- 172.21.15.57:0/1310558580 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3e1800f9d0 con 0x5566f54d97d0 2023-03-02T11:08:36.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.454+0000 7f3e36d00b80 10 client.16509 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:08:36.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.454+0000 7f3e36d00b80 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:08:36.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.454+0000 7f3e36d00b80 20 client.16509 populate_metadata read hostname 'smithi057' 2023-03-02T11:08:36.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.454+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5566f54f3630 0x5566f54f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.454+0000 7f3e36d00b80 4 client.16509 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:08:36.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.454+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1310558580 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5566f5420170 con 0x5566f54f3630 2023-03-02T11:08:36.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.454+0000 7f3e2099a700 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5566f54f3630 0x5566f54f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.454+0000 7f3e2099a700 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5566f54f3630 0x5566f54f5a40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa726cbcd2baa003 server_cookie=72faee26a46848d0 in_seq=0 out_seq=0 2023-03-02T11:08:36.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.454+0000 7f3e04ff9700 10 client.16509 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:08:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e04ff9700 1 -- 172.21.15.57:0/1310558580 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5566f5420170 con 0x5566f54f3630 2023-03-02T11:08:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e04ff9700 10 client.16509 handle_command_reply: tid=0 2023-03-02T11:08:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e36d00b80 1 client.16509 shutdown 2023-03-02T11:08:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1310558580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 msgr2=0x5566f54e5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5d30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3e18024850 tx=0x7f3e1801a050 comp rx=0 tx=0).stop 2023-03-02T11:08:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1310558580 shutdown_connections 2023-03-02T11:08:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5566f54f3630 0x5566f54f5a40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54de520 0x5566f54e36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5d30 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e04ff9700 0 client.16509 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:08:36.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/1310558580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54da0e0 0x5566f54e2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1310558580 >> 172.21.15.57:0/1310558580 conn(0x5566f54cac50 msgr2=0x5566f54cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:36.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1310558580 shutdown_connections 2023-03-02T11:08:36.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.455+0000 7f3e36d00b80 1 -- 172.21.15.57:0/1310558580 wait complete. 2023-03-02T11:08:36.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.456+0000 7f3e36d00b80 20 client.16509 trim_cache size 0 max 16384 2023-03-02T11:08:36.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.472+0000 7f3e36d00b80 1 Processor -- start 2023-03-02T11:08:36.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.472+0000 7f3e36d00b80 1 -- start start 2023-03-02T11:08:36.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.472+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.472+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 0x5566f54e2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.472+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54de520 0x5566f54e2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.472+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f54d1ce0 con 0x5566f54d97d0 2023-03-02T11:08:36.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.472+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f54da830 con 0x5566f54da0e0 2023-03-02T11:08:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.472+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f54e3ca0 con 0x5566f54de520 2023-03-02T11:08:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2119b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2119b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58856/0 (socket says 172.21.15.57:58856) 2023-03-02T11:08:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2099a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 0x5566f54e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2119b700 1 -- 172.21.15.57:0/3880777779 learned_addr learned my addr 172.21.15.57:0/3880777779 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:08:36.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2199c700 1 --2- 172.21.15.57:0/3880777779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54de520 0x5566f54e2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2119b700 1 -- 172.21.15.57:0/3880777779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54de520 msgr2=0x5566f54e2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:36.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2119b700 1 --2- 172.21.15.57:0/3880777779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54de520 0x5566f54e2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2119b700 1 -- 172.21.15.57:0/3880777779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 msgr2=0x5566f54e2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:36.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2119b700 1 --2- 172.21.15.57:0/3880777779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 0x5566f54e2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2119b700 1 -- 172.21.15.57:0/3880777779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566f54cc3f0 con 0x5566f54d97d0 2023-03-02T11:08:36.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2099a700 1 --2- 172.21.15.57:0/3880777779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 0x5566f54e2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:08:36.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e2119b700 1 --2- 172.21.15.57:0/3880777779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5860 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800c010 tx=0x7f3e1800bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00fe30b25c997ad server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:36.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e07fff700 1 -- 172.21.15.57:0/3880777779 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18005240 con 0x5566f54d97d0 2023-03-02T11:08:36.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e07fff700 1 -- 172.21.15.57:0/3880777779 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e1801e040 con 0x5566f54d97d0 2023-03-02T11:08:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.473+0000 7f3e07fff700 1 -- 172.21.15.57:0/3880777779 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18037c70 con 0x5566f54d97d0 2023-03-02T11:08:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.474+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3880777779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 msgr2=0x5566f54e5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.474+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/3880777779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5860 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800c010 tx=0x7f3e1800bbf0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.474+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3880777779 shutdown_connections 2023-03-02T11:08:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.474+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/3880777779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54de520 0x5566f54e2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.474+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/3880777779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54d97d0 0x5566f54e5860 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.474+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/3880777779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 0x5566f54e2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.474+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3880777779 >> 172.21.15.57:0/3880777779 conn(0x5566f54cac50 msgr2=0x5566f54eeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:36.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.474+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3880777779 shutdown_connections 2023-03-02T11:08:36.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.474+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3880777779 wait complete. 2023-03-02T11:08:36.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.474+0000 7f3e36d00b80 1 -- start start 2023-03-02T11:08:36.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.474+0000 7f3e36d00b80 1 Processor -- start 2023-03-02T11:08:36.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54d97d0 0x5566f54e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 0x5566f54ea040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e36d00b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54de520 0x5566f553deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f553e420 con 0x5566f54de520 2023-03-02T11:08:36.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f553e590 con 0x5566f54da0e0 2023-03-02T11:08:36.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e36d00b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f553e750 con 0x5566f54d97d0 2023-03-02T11:08:36.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e36d00b80 10 client.0 _ll_register_callbacks cb 0x5566f53cd520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:08:36.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e2199c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54de520 0x5566f553deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e2119b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54d97d0 0x5566f54e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e2099a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 0x5566f54ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e2099a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 0x5566f54ea040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:48420/0 (socket says 172.21.15.57:48420) 2023-03-02T11:08:36.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e2099a700 1 -- 172.21.15.57:0/3433811570 learned_addr learned my addr 172.21.15.57:0/3433811570 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:08:36.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e2199c700 1 -- 172.21.15.57:0/3433811570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54d97d0 msgr2=0x5566f54e9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:36.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.475+0000 7f3e2199c700 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54d97d0 0x5566f54e9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e2199c700 1 -- 172.21.15.57:0/3433811570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 msgr2=0x5566f54ea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:08:36.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e2199c700 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 0x5566f54ea040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e2199c700 1 -- 172.21.15.57:0/3433811570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5566f52a9630 con 0x5566f54de520 2023-03-02T11:08:36.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e2099a700 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 0x5566f54ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:08:36.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e2199c700 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54de520 0x5566f553deb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3e14012e90 tx=0x7f3e140077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32476ba514bb4391 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:08:36.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e04ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:08:36.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e04ff9700 1 -- 172.21.15.57:0/3433811570 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1401c070 con 0x5566f54de520 2023-03-02T11:08:36.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e04ff9700 1 -- 172.21.15.57:0/3433811570 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f3e14003a00 con 0x5566f54de520 2023-03-02T11:08:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3433811570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e0c09be00 con 0x5566f54de520 2023-03-02T11:08:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e04ff9700 1 -- 172.21.15.57:0/3433811570 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e1400e040 con 0x5566f54de520 2023-03-02T11:08:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e36d00b80 10 client.16515 fetch_fsmap learned FSMap version 47 2023-03-02T11:08:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3433811570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5566f5255de0 con 0x5566f54de520 2023-03-02T11:08:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.476+0000 7f3e04ff9700 1 -- 172.21.15.57:0/3433811570 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e1402b020 con 0x5566f54de520 2023-03-02T11:08:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e04ff9700 1 -- 172.21.15.57:0/3433811570 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3e14020410 con 0x5566f54de520 2023-03-02T11:08:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e36d00b80 10 client.16515 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:08:36.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e36d00b80 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:08:36.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e36d00b80 20 client.16515 populate_metadata read hostname 'smithi057' 2023-03-02T11:08:36.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5566f5545f60 0x5566f5548370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:08:36.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e36d00b80 4 client.16515 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:08:36.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3433811570 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5566f541fe90 con 0x5566f5545f60 2023-03-02T11:08:36.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e2119b700 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5566f5545f60 0x5566f5548370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:36.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e04ff9700 10 client.16515 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:08:36.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e2119b700 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5566f5545f60 0x5566f5548370 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b95bceb98f6c4c3 server_cookie=44e79d62707e3340 in_seq=0 out_seq=0 2023-03-02T11:08:36.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e04ff9700 1 -- 172.21.15.57:0/3433811570 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5566f541fe90 con 0x5566f5545f60 2023-03-02T11:08:36.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e04ff9700 10 client.16515 handle_command_reply: tid=0 2023-03-02T11:08:36.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e36d00b80 1 client.16515 shutdown 2023-03-02T11:08:36.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3433811570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54de520 msgr2=0x5566f553deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:36.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.477+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54de520 0x5566f553deb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3e14012e90 tx=0x7f3e140077e0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3433811570 shutdown_connections 2023-03-02T11:08:36.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5566f5545f60 0x5566f5548370 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5566f54de520 0x5566f553deb0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566f54d97d0 0x5566f54e9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e04ff9700 0 client.16515 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:08:36.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e36d00b80 1 --2- 172.21.15.57:0/3433811570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566f54da0e0 0x5566f54ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3433811570 >> 172.21.15.57:0/3433811570 conn(0x5566f54cac50 msgr2=0x5566f54d41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:36.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3433811570 shutdown_connections 2023-03-02T11:08:36.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e36d00b80 1 -- 172.21.15.57:0/3433811570 wait complete. 2023-03-02T11:08:36.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e36d00b80 20 client.16515 trim_cache size 0 max 16384 2023-03-02T11:08:36.499 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:08:36.499 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:08:36.499 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:08:36.500 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:08:36.500 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:08:36.500 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:08:36.500 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:08:36.500 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:08:36.500 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:08:36.500 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:08:36.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 -- 172.21.15.57:0/1515879400 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3e0809b480 msgr2=0x7f3e0809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:36.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3e0809b480 0x7f3e0809d930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b2e0 tx=0x7f3e18005fd0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 -- 172.21.15.57:0/1515879400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0ff360 msgr2=0x7f3e1c19bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:08:36.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0ff360 0x7f3e1c19bef0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00e9f0 tx=0x7f3e0c00ed00 comp rx=0 tx=0).stop 2023-03-02T11:08:36.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 -- 172.21.15.57:0/1515879400 shutdown_connections 2023-03-02T11:08:36.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f3e0809b480 0x7f3e0809d930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e1c1049c0 0x7f3e1c195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c0fe9b0 0x7f3e1c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 --2- 172.21.15.57:0/1515879400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0ff360 0x7f3e1c19bef0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:08:36.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 -- 172.21.15.57:0/1515879400 >> 172.21.15.57:0/1515879400 conn(0x7f3e1c0fa4b0 msgr2=0x7f3e1c0fc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:08:36.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 -- 172.21.15.57:0/1515879400 shutdown_connections 2023-03-02T11:08:36.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:08:36.478+0000 7f3e233ff700 1 -- 172.21.15.57:0/1515879400 wait complete. 2023-03-02T11:08:36.504 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:08:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:37 smithi057 ceph-mon[92072]: pgmap v361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:08:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:37 smithi122 ceph-mon[125440]: pgmap v361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:08:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:37 smithi136 ceph-mon[125702]: pgmap v361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:08:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:39 smithi057 ceph-mon[92072]: pgmap v362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:08:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:39 smithi122 ceph-mon[125440]: pgmap v362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:08:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:39 smithi136 ceph-mon[125702]: pgmap v362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:08:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:41 smithi057 ceph-mon[92072]: pgmap v363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:41 smithi122 ceph-mon[125440]: pgmap v363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:41 smithi136 ceph-mon[125702]: pgmap v363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:43 smithi057 ceph-mon[92072]: pgmap v364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:08:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:43 smithi122 ceph-mon[125440]: pgmap v364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:08:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:43 smithi136 ceph-mon[125702]: pgmap v364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:08:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:45 smithi057 ceph-mon[92072]: pgmap v365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:45 smithi122 ceph-mon[125440]: pgmap v365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:45 smithi136 ceph-mon[125702]: pgmap v365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:47 smithi057 ceph-mon[92072]: pgmap v366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:08:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:47 smithi122 ceph-mon[125440]: pgmap v366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:08:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:47 smithi136 ceph-mon[125702]: pgmap v366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:08:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:49.271+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:08:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:49.271+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:08:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:49.271+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:08:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:49.271+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:08:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:08:49.271+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:08:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:49 smithi057 ceph-mon[92072]: pgmap v367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:08:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:49 smithi122 ceph-mon[125440]: pgmap v367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:08:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:49 smithi136 ceph-mon[125702]: pgmap v367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:08:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:51 smithi057 ceph-mon[92072]: pgmap v368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:51 smithi122 ceph-mon[125440]: pgmap v368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:51 smithi136 ceph-mon[125702]: pgmap v368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:53 smithi057 ceph-mon[92072]: pgmap v369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:08:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:53 smithi122 ceph-mon[125440]: pgmap v369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:08:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:53 smithi136 ceph-mon[125702]: pgmap v369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:08:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:55 smithi057 ceph-mon[92072]: pgmap v370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:55 smithi122 ceph-mon[125440]: pgmap v370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:55 smithi136 ceph-mon[125702]: pgmap v370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:08:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:57 smithi057 ceph-mon[92072]: pgmap v371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:08:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:57 smithi122 ceph-mon[125440]: pgmap v371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:08:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:57 smithi136 ceph-mon[125702]: pgmap v371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T11:09:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:08:59 smithi057 ceph-mon[92072]: pgmap v372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:09:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:08:59 smithi122 ceph-mon[125440]: pgmap v372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:09:00.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:08:59 smithi136 ceph-mon[125702]: pgmap v372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:09:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:01 smithi057 ceph-mon[92072]: pgmap v373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:01 smithi122 ceph-mon[125440]: pgmap v373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:01 smithi136 ceph-mon[125702]: pgmap v373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:03 smithi057 ceph-mon[92072]: pgmap v374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:09:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:03 smithi122 ceph-mon[125440]: pgmap v374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:09:04.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:04.280+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:04.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:04.280+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:09:04.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:04.280+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:09:04.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:04.280+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:09:04.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:04.280+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:09:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:03 smithi136 ceph-mon[125702]: pgmap v374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:09:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:05 smithi057 ceph-mon[92072]: pgmap v375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:09:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:05 smithi122 ceph-mon[125440]: pgmap v375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:09:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:05 smithi136 ceph-mon[125702]: pgmap v375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:09:06.504 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:09:06.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.674+0000 7ff7397ff700 1 -- 172.21.15.57:0/2461600585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff734101590 msgr2=0x7ff734109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:06.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.674+0000 7ff7397ff700 1 --2- 172.21.15.57:0/2461600585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff734101590 0x7ff734109a80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009990 tx=0x7ff71c009ca0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.674+0000 7ff7397ff700 1 -- 172.21.15.57:0/2461600585 shutdown_connections 2023-03-02T11:09:06.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.674+0000 7ff7397ff700 1 --2- 172.21.15.57:0/2461600585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff73410a050 0x7ff73410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.674+0000 7ff7397ff700 1 --2- 172.21.15.57:0/2461600585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff734100c80 0x7ff734101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.674+0000 7ff7397ff700 1 --2- 172.21.15.57:0/2461600585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff734101590 0x7ff734109a80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.674+0000 7ff7397ff700 1 -- 172.21.15.57:0/2461600585 >> 172.21.15.57:0/2461600585 conn(0x7ff7340fa4b0 msgr2=0x7ff7340fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:06.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.674+0000 7ff7397ff700 1 -- 172.21.15.57:0/2461600585 shutdown_connections 2023-03-02T11:09:06.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.674+0000 7ff7397ff700 1 -- 172.21.15.57:0/2461600585 wait complete. 2023-03-02T11:09:06.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.675+0000 7ff7397ff700 1 Processor -- start 2023-03-02T11:09:06.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.675+0000 7ff7397ff700 1 -- start start 2023-03-02T11:09:06.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.675+0000 7ff7397ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff734100c80 0x7ff7340fe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.675+0000 7ff7397ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff734101590 0x7ff7340fee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.675+0000 7ff7397ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff73410a050 0x7ff7341a3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.675+0000 7ff7397ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340ff640 con 0x7ff73410a050 2023-03-02T11:09:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.675+0000 7ff7397ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7341a42a0 con 0x7ff734100c80 2023-03-02T11:09:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.675+0000 7ff7397ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7341a43e0 con 0x7ff734101590 2023-03-02T11:09:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff734100c80 0x7ff7340fe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff73410a050 0x7ff7341a3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff734100c80 0x7ff7340fe8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:58910/0 (socket says 172.21.15.57:58910) 2023-03-02T11:09:06.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff732ffd700 1 -- 172.21.15.57:0/1311630076 learned_addr learned my addr 172.21.15.57:0/1311630076 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:09:06.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff72a7fc700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff734101590 0x7ff7340fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff732ffd700 1 -- 172.21.15.57:0/1311630076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff734101590 msgr2=0x7ff7340fee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:06.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff732ffd700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff734101590 0x7ff7340fee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff732ffd700 1 -- 172.21.15.57:0/1311630076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff73410a050 msgr2=0x7ff7341a3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:06.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff732ffd700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff73410a050 0x7ff7341a3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff732ffd700 1 -- 172.21.15.57:0/1311630076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c0095f0 con 0x7ff734100c80 2023-03-02T11:09:06.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff7337fe700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff73410a050 0x7ff7341a3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:09:06.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff732ffd700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff734100c80 0x7ff7340fe8d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff72400ef10 tx=0x7ff72400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:06.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff730ff9700 1 -- 172.21.15.57:0/1311630076 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72400c9c0 con 0x7ff734100c80 2023-03-02T11:09:06.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff7397ff700 1 -- 172.21.15.57:0/1311630076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73410fad0 con 0x7ff734100c80 2023-03-02T11:09:06.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff730ff9700 1 -- 172.21.15.57:0/1311630076 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff72400f040 con 0x7ff734100c80 2023-03-02T11:09:06.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff730ff9700 1 -- 172.21.15.57:0/1311630076 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724014480 con 0x7ff734100c80 2023-03-02T11:09:06.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.676+0000 7ff7397ff700 1 -- 172.21.15.57:0/1311630076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73410f940 con 0x7ff734100c80 2023-03-02T11:09:06.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.679+0000 7ff730ff9700 1 -- 172.21.15.57:0/1311630076 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7ff724007690 con 0x7ff734100c80 2023-03-02T11:09:06.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.680+0000 7ff730ff9700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff72009b480 0x7ff72009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.680+0000 7ff730ff9700 1 -- 172.21.15.57:0/1311630076 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff7240c55b0 con 0x7ff734100c80 2023-03-02T11:09:06.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.680+0000 7ff72a7fc700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff72009b480 0x7ff72009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff74d136b80 1 Processor -- start 2023-03-02T11:09:06.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff72a7fc700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff72009b480 0x7ff72009d930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00b2e0 tx=0x7ff71c005960 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:06.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff74d136b80 1 -- start start 2023-03-02T11:09:06.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba2ff790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba303bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 0x55d2ba304560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff74d136b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba266a60 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff74d136b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba218f80 con 0x55d2ba2ffcd0 2023-03-02T11:09:06.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff74d136b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba1e9160 con 0x55d2ba304110 2023-03-02T11:09:06.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba2ff790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff72a7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba303bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba2ff790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33354/0 (socket says 172.21.15.57:33354) 2023-03-02T11:09:06.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff732ffd700 1 -- 172.21.15.57:0/3849359606 learned_addr learned my addr 172.21.15.57:0/3849359606 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:09:06.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff7337fe700 1 --2- 172.21.15.57:0/3849359606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 0x55d2ba304560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff732ffd700 1 -- 172.21.15.57:0/3849359606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 msgr2=0x55d2ba304560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:06.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff732ffd700 1 --2- 172.21.15.57:0/3849359606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 0x55d2ba304560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff732ffd700 1 -- 172.21.15.57:0/3849359606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ffcd0 msgr2=0x55d2ba303bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:06.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff732ffd700 1 --2- 172.21.15.57:0/3849359606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba303bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff732ffd700 1 -- 172.21.15.57:0/3849359606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2ba0d3630 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.681+0000 7ff72a7fc700 1 --2- 172.21.15.57:0/3849359606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba303bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:09:06.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.682+0000 7ff732ffd700 1 --2- 172.21.15.57:0/3849359606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba2ff790 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff7240946a0 tx=0x7ff724090d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ebfb18c1b77b1d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:06.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.682+0000 7ff7297fa700 1 -- 172.21.15.57:0/3849359606 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7240ac260 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.682+0000 7ff7297fa700 1 -- 172.21.15.57:0/3849359606 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7240944e0 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.682+0000 7ff7297fa700 1 -- 172.21.15.57:0/3849359606 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724093e90 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.682+0000 7ff74d136b80 1 -- 172.21.15.57:0/3849359606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 msgr2=0x55d2ba2ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:06.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.682+0000 7ff74d136b80 1 --2- 172.21.15.57:0/3849359606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba2ff790 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff7240946a0 tx=0x7ff724090d60 comp rx=0 tx=0).stop 2023-03-02T11:09:06.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.683+0000 7ff74d136b80 1 -- 172.21.15.57:0/3849359606 shutdown_connections 2023-03-02T11:09:06.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.683+0000 7ff74d136b80 1 --2- 172.21.15.57:0/3849359606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 0x55d2ba304560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.683+0000 7ff74d136b80 1 --2- 172.21.15.57:0/3849359606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba2ff790 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.683+0000 7ff74d136b80 1 --2- 172.21.15.57:0/3849359606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba303bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.683+0000 7ff74d136b80 1 -- 172.21.15.57:0/3849359606 >> 172.21.15.57:0/3849359606 conn(0x55d2ba2f4c50 msgr2=0x55d2ba2fa460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:06.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.683+0000 7ff74d136b80 1 -- 172.21.15.57:0/3849359606 shutdown_connections 2023-03-02T11:09:06.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.683+0000 7ff74d136b80 1 -- 172.21.15.57:0/3849359606 wait complete. 2023-03-02T11:09:06.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.683+0000 7ff74d136b80 1 -- start start 2023-03-02T11:09:06.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.683+0000 7ff74d136b80 1 Processor -- start 2023-03-02T11:09:06.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.683+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba308be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 0x55d2ba309320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff74d136b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba257bc0 con 0x55d2ba2ffcd0 2023-03-02T11:09:06.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff74d136b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba2510f0 con 0x55d2ba304110 2023-03-02T11:09:06.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff74d136b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba0d5920 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff74d136b80 10 client.0 _ll_register_callbacks cb 0x55d2ba1f7520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:09:06.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff72a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba308be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 0x55d2ba309320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47800/0 (socket says 172.21.15.57:47800) 2023-03-02T11:09:06.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff732ffd700 1 -- 172.21.15.57:0/1506265058 learned_addr learned my addr 172.21.15.57:0/1506265058 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:09:06.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff732ffd700 1 -- 172.21.15.57:0/1506265058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 msgr2=0x55d2ba309320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:06.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff732ffd700 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 0x55d2ba309320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff732ffd700 1 -- 172.21.15.57:0/1506265058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 msgr2=0x55d2ba308be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:06.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff732ffd700 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba308be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff732ffd700 1 -- 172.21.15.57:0/1506265058 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73410f940 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff7337fe700 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 0x55d2ba309320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:09:06.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff732ffd700 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30b960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff724094650 tx=0x7ff7240940c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2472940a2ae09193 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:06.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.684+0000 7ff71a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:09:06.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff71a7fc700 1 -- 172.21.15.57:0/1506265058 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7240ac260 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff74d136b80 1 -- 172.21.15.57:0/1506265058 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2ba2227b0 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff71a7fc700 1 -- 172.21.15.57:0/1506265058 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff7240949a0 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff71a7fc700 1 -- 172.21.15.57:0/1506265058 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff724094300 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff74d136b80 10 client.26320 fetch_fsmap learned FSMap version 47 2023-03-02T11:09:06.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff74d136b80 1 -- 172.21.15.57:0/1506265058 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55d2ba07fde0 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff71a7fc700 1 -- 172.21.15.57:0/1506265058 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d2ba2227b0 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff71a7fc700 1 -- 172.21.15.57:0/1506265058 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff724090790 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff74d136b80 10 client.26320 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:09:06.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff74d136b80 10 client.26320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:09:06.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff74d136b80 20 client.26320 populate_metadata read hostname 'smithi057' 2023-03-02T11:09:06.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff74d136b80 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d2ba318e10 0x55d2ba31b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff74d136b80 4 client.26320 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:09:06.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.685+0000 7ff74d136b80 1 -- 172.21.15.57:0/1506265058 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2ba24a170 con 0x55d2ba318e10 2023-03-02T11:09:06.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.686+0000 7ff72a7fc700 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d2ba318e10 0x55d2ba31b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.686+0000 7ff72a7fc700 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d2ba318e10 0x55d2ba31b1f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d103f5b171e305b server_cookie=46131397848b7ec5 in_seq=0 out_seq=0 2023-03-02T11:09:06.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.686+0000 7ff71a7fc700 10 client.26320 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:09:06.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff71a7fc700 1 -- 172.21.15.57:0/1506265058 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55d2ba24a170 con 0x55d2ba318e10 2023-03-02T11:09:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff71a7fc700 10 client.26320 handle_command_reply: tid=0 2023-03-02T11:09:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 1 client.26320 shutdown 2023-03-02T11:09:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 1 -- 172.21.15.57:0/1506265058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ff3c0 msgr2=0x55d2ba30b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30b960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff724094650 tx=0x7ff7240940c0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 1 -- 172.21.15.57:0/1506265058 shutdown_connections 2023-03-02T11:09:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d2ba318e10 0x55d2ba31b1f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 0x55d2ba309320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff71a7fc700 0 client.26320 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:09:06.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30b960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 1 --2- 172.21.15.57:0/1506265058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba308be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 1 -- 172.21.15.57:0/1506265058 >> 172.21.15.57:0/1506265058 conn(0x55d2ba2f4c50 msgr2=0x55d2ba2fa050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:06.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 1 -- 172.21.15.57:0/1506265058 shutdown_connections 2023-03-02T11:09:06.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 1 -- 172.21.15.57:0/1506265058 wait complete. 2023-03-02T11:09:06.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.687+0000 7ff74d136b80 20 client.26320 trim_cache size 0 max 16384 2023-03-02T11:09:06.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff74d136b80 1 Processor -- start 2023-03-02T11:09:06.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff74d136b80 1 -- start start 2023-03-02T11:09:06.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba3147e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 0x55d2ba314d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff74d136b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba2f47d0 con 0x55d2ba2ffcd0 2023-03-02T11:09:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff74d136b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba303b00 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff74d136b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba302c50 con 0x55d2ba304110 2023-03-02T11:09:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff72a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba3147e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 0x55d2ba314d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff72a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba3147e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33366/0 (socket says 172.21.15.57:33366) 2023-03-02T11:09:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.704+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 0x55d2ba314d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47806/0 (socket says 172.21.15.57:47806) 2023-03-02T11:09:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff72a7fc700 1 -- 172.21.15.57:0/4091293916 learned_addr learned my addr 172.21.15.57:0/4091293916 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:09:06.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff732ffd700 1 -- 172.21.15.57:0/4091293916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 msgr2=0x55d2ba314d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:06.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff732ffd700 1 --2- 172.21.15.57:0/4091293916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 0x55d2ba314d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff732ffd700 1 -- 172.21.15.57:0/4091293916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 msgr2=0x55d2ba3147e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:06.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff732ffd700 1 --2- 172.21.15.57:0/4091293916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba3147e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff732ffd700 1 -- 172.21.15.57:0/4091293916 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2ba218190 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff7337fe700 1 --2- 172.21.15.57:0/4091293916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 0x55d2ba314d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:09:06.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff72a7fc700 1 --2- 172.21.15.57:0/4091293916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba3147e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:09:06.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff732ffd700 1 --2- 172.21.15.57:0/4091293916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30b500 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff724009c10 tx=0x7ff7240c3160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96e3ecf3c025c0da server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:06.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff729ffb700 1 -- 172.21.15.57:0/4091293916 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7240ac260 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff729ffb700 1 -- 172.21.15.57:0/4091293916 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff724094300 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.705+0000 7ff729ffb700 1 -- 172.21.15.57:0/4091293916 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72409be40 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.706+0000 7ff74d136b80 1 -- 172.21.15.57:0/4091293916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ff3c0 msgr2=0x55d2ba30b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:06.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.706+0000 7ff74d136b80 1 --2- 172.21.15.57:0/4091293916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30b500 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff724009c10 tx=0x7ff7240c3160 comp rx=0 tx=0).stop 2023-03-02T11:09:06.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.706+0000 7ff74d136b80 1 -- 172.21.15.57:0/4091293916 shutdown_connections 2023-03-02T11:09:06.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.706+0000 7ff74d136b80 1 --2- 172.21.15.57:0/4091293916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba304110 0x55d2ba314d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.706+0000 7ff74d136b80 1 --2- 172.21.15.57:0/4091293916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30b500 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.706+0000 7ff74d136b80 1 --2- 172.21.15.57:0/4091293916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba3147e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.706+0000 7ff74d136b80 1 -- 172.21.15.57:0/4091293916 >> 172.21.15.57:0/4091293916 conn(0x55d2ba2f4c50 msgr2=0x55d2ba2f8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:06.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.706+0000 7ff74d136b80 1 -- 172.21.15.57:0/4091293916 shutdown_connections 2023-03-02T11:09:06.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.706+0000 7ff74d136b80 1 -- 172.21.15.57:0/4091293916 wait complete. 2023-03-02T11:09:06.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.706+0000 7ff74d136b80 1 -- start start 2023-03-02T11:09:06.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.706+0000 7ff74d136b80 1 Processor -- start 2023-03-02T11:09:06.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba30fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff74d136b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 0x55d2ba3695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff74d136b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba369af0 con 0x55d2ba2ff3c0 2023-03-02T11:09:06.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff74d136b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba369c30 con 0x55d2ba304110 2023-03-02T11:09:06.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff74d136b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ba369df0 con 0x55d2ba2ffcd0 2023-03-02T11:09:06.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff74d136b80 10 client.0 _ll_register_callbacks cb 0x55d2ba1f7520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:09:06.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff72a7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba30fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 0x55d2ba3695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff72a7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba30fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:47818/0 (socket says 172.21.15.57:47818) 2023-03-02T11:09:06.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33382/0 (socket says 172.21.15.57:33382) 2023-03-02T11:09:06.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff72a7fc700 1 -- 172.21.15.57:0/2801439574 learned_addr learned my addr 172.21.15.57:0/2801439574 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:09:06.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff7337fe700 1 -- 172.21.15.57:0/2801439574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ffcd0 msgr2=0x55d2ba30fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:06.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff7337fe700 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba30fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff7337fe700 1 -- 172.21.15.57:0/2801439574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 msgr2=0x55d2ba30f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:06.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff7337fe700 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff7337fe700 1 -- 172.21.15.57:0/2801439574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71c005300 con 0x55d2ba304110 2023-03-02T11:09:06.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff72a7fc700 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba30fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:09:06.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff732ffd700 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:09:06.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff7337fe700 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 0x55d2ba3695b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff7341009e0 tx=0x7ff72c010710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e084a5bcc72e2a4 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:06.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.707+0000 7ff71a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:09:06.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff71a7fc700 1 -- 172.21.15.57:0/2801439574 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c017070 con 0x55d2ba304110 2023-03-02T11:09:06.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff74d136b80 1 -- 172.21.15.57:0/2801439574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7240944e0 con 0x55d2ba304110 2023-03-02T11:09:06.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff71a7fc700 1 -- 172.21.15.57:0/2801439574 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff72c004230 con 0x55d2ba304110 2023-03-02T11:09:06.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff71a7fc700 1 -- 172.21.15.57:0/2801439574 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff72c010e60 con 0x55d2ba304110 2023-03-02T11:09:06.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff74d136b80 10 client.26375 fetch_fsmap learned FSMap version 47 2023-03-02T11:09:06.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff74d136b80 1 -- 172.21.15.57:0/2801439574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7ff72c012760 con 0x55d2ba304110 2023-03-02T11:09:06.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff71a7fc700 1 -- 172.21.15.57:0/2801439574 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7240944e0 con 0x55d2ba304110 2023-03-02T11:09:06.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff71a7fc700 1 -- 172.21.15.57:0/2801439574 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff72c0052c0 con 0x55d2ba304110 2023-03-02T11:09:06.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff74d136b80 10 client.26375 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:09:06.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff74d136b80 10 client.26375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:09:06.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff74d136b80 20 client.26375 populate_metadata read hostname 'smithi057' 2023-03-02T11:09:06.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff74d136b80 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d2ba36b5f0 0x55d2ba36da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:06.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff74d136b80 4 client.26375 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:09:06.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff74d136b80 1 -- 172.21.15.57:0/2801439574 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d2ba249e90 con 0x55d2ba36b5f0 2023-03-02T11:09:06.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.708+0000 7ff732ffd700 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d2ba36b5f0 0x55d2ba36da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:06.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff732ffd700 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d2ba36b5f0 0x55d2ba36da00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe4e73cda7f3ba8a server_cookie=7f041bb3d15ee890 in_seq=0 out_seq=0 2023-03-02T11:09:06.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff71a7fc700 10 client.26375 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:09:06.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff71a7fc700 1 -- 172.21.15.57:0/2801439574 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55d2ba249e90 con 0x55d2ba36b5f0 2023-03-02T11:09:06.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff71a7fc700 10 client.26375 handle_command_reply: tid=0 2023-03-02T11:09:06.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 1 client.26375 shutdown 2023-03-02T11:09:06.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 1 -- 172.21.15.57:0/2801439574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 msgr2=0x55d2ba3695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:06.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 0x55d2ba3695b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff7341009e0 tx=0x7ff72c010710 comp rx=0 tx=0).stop 2023-03-02T11:09:06.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 1 -- 172.21.15.57:0/2801439574 shutdown_connections 2023-03-02T11:09:06.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55d2ba36b5f0 0x55d2ba36da00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2ba304110 0x55d2ba3695b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff71a7fc700 0 client.26375 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:09:06.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2ba2ff3c0 0x55d2ba30f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 1 --2- 172.21.15.57:0/2801439574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d2ba2ffcd0 0x55d2ba30fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 1 -- 172.21.15.57:0/2801439574 >> 172.21.15.57:0/2801439574 conn(0x55d2ba2f4c50 msgr2=0x55d2ba3147e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:06.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 1 -- 172.21.15.57:0/2801439574 shutdown_connections 2023-03-02T11:09:06.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 1 -- 172.21.15.57:0/2801439574 wait complete. 2023-03-02T11:09:06.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.709+0000 7ff74d136b80 20 client.26375 trim_cache size 0 max 16384 2023-03-02T11:09:06.721 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:09:06.721 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:09:06.721 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:09:06.721 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:09:06.721 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:09:06.721 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:09:06.722 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:09:06.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:09:06.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:09:06.722 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:09:06.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 -- 172.21.15.57:0/1311630076 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff72009b480 msgr2=0x7ff72009d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:06.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff72009b480 0x7ff72009d930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00b2e0 tx=0x7ff71c005960 comp rx=0 tx=0).stop 2023-03-02T11:09:06.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 -- 172.21.15.57:0/1311630076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff734100c80 msgr2=0x7ff7340fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:06.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff734100c80 0x7ff7340fe8d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff72400ef10 tx=0x7ff72400c3a0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 -- 172.21.15.57:0/1311630076 shutdown_connections 2023-03-02T11:09:06.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff72009b480 0x7ff72009d930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff73410a050 0x7ff7341a3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff734100c80 0x7ff7340fe8d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 --2- 172.21.15.57:0/1311630076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff734101590 0x7ff7340fee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:06.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 -- 172.21.15.57:0/1311630076 >> 172.21.15.57:0/1311630076 conn(0x7ff7340fa4b0 msgr2=0x7ff73410c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:06.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 -- 172.21.15.57:0/1311630076 shutdown_connections 2023-03-02T11:09:06.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:06.710+0000 7ff7397ff700 1 -- 172.21.15.57:0/1311630076 wait complete. 2023-03-02T11:09:06.725 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:09:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:07 smithi057 ceph-mon[92072]: pgmap v376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:09:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:07 smithi122 ceph-mon[125440]: pgmap v376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:09:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:07 smithi136 ceph-mon[125702]: pgmap v376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:09:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:09 smithi057 ceph-mon[92072]: pgmap v377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:09:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:09 smithi122 ceph-mon[125440]: pgmap v377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:09:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:09 smithi136 ceph-mon[125702]: pgmap v377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:09:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:11 smithi057 ceph-mon[92072]: pgmap v378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:09:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:11 smithi057 ceph-mon[92072]: osdmap e98: 12 total, 12 up, 12 in 2023-03-02T11:09:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:11 smithi122 ceph-mon[125440]: pgmap v378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:09:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:11 smithi122 ceph-mon[125440]: osdmap e98: 12 total, 12 up, 12 in 2023-03-02T11:09:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:11 smithi136 ceph-mon[125702]: pgmap v378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:09:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:11 smithi136 ceph-mon[125702]: osdmap e98: 12 total, 12 up, 12 in 2023-03-02T11:09:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:13 smithi057 ceph-mon[92072]: pgmap v380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:09:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:13 smithi057 ceph-mon[92072]: osdmap e99: 12 total, 12 up, 12 in 2023-03-02T11:09:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:13 smithi122 ceph-mon[125440]: pgmap v380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:09:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:13 smithi122 ceph-mon[125440]: osdmap e99: 12 total, 12 up, 12 in 2023-03-02T11:09:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:13 smithi136 ceph-mon[125702]: pgmap v380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:09:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:13 smithi136 ceph-mon[125702]: osdmap e99: 12 total, 12 up, 12 in 2023-03-02T11:09:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:15 smithi122 ceph-mon[125440]: pgmap v382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:09:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:15 smithi136 ceph-mon[125702]: pgmap v382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:09:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:15 smithi057 ceph-mon[92072]: pgmap v382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-03-02T11:09:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:17 smithi122 ceph-mon[125440]: pgmap v383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:09:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:17 smithi136 ceph-mon[125702]: pgmap v383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:09:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:17 smithi057 ceph-mon[92072]: pgmap v383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:19.285+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:19.285+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:09:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:19.285+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:09:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:19.285+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:09:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:19.285+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:09:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:19 smithi122 ceph-mon[125440]: pgmap v384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:09:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:19 smithi136 ceph-mon[125702]: pgmap v384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:09:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:19 smithi057 ceph-mon[92072]: pgmap v384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:09:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:21 smithi122 ceph-mon[125440]: pgmap v385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T11:09:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:21 smithi136 ceph-mon[125702]: pgmap v385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T11:09:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:21 smithi057 ceph-mon[92072]: pgmap v385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T11:09:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:23 smithi136 ceph-mon[125702]: pgmap v386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:09:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:23 smithi057 ceph-mon[92072]: pgmap v386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:09:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:23 smithi122 ceph-mon[125440]: pgmap v386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:09:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:09:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:09:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:09:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:09:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:09:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:09:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:09:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:09:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:09:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:25 smithi136 ceph-mon[125702]: pgmap v387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:09:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:09:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:09:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:09:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:25 smithi057 ceph-mon[92072]: pgmap v387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:09:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:09:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:09:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:09:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:25 smithi122 ceph-mon[125440]: pgmap v387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:09:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:09:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:09:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:09:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:27 smithi136 ceph-mon[125702]: pgmap v388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:09:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:27 smithi057 ceph-mon[92072]: pgmap v388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:09:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:27 smithi122 ceph-mon[125440]: pgmap v388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:09:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:29 smithi136 ceph-mon[125702]: pgmap v389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:09:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:29 smithi057 ceph-mon[92072]: pgmap v389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:09:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:29 smithi122 ceph-mon[125440]: pgmap v389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:09:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:31 smithi136 ceph-mon[125702]: pgmap v390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:31 smithi057 ceph-mon[92072]: pgmap v390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:31 smithi122 ceph-mon[125440]: pgmap v390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:34.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:34.287+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:09:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:34.287+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:09:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:34.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:09:34.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:34.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:09:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:33 smithi136 ceph-mon[125702]: pgmap v391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:33 smithi057 ceph-mon[92072]: pgmap v391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:33 smithi122 ceph-mon[125440]: pgmap v391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:35 smithi136 ceph-mon[125702]: pgmap v392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:35 smithi057 ceph-mon[92072]: pgmap v392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:35 smithi122 ceph-mon[125440]: pgmap v392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:36.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:09:36.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.898+0000 7f71519ff700 1 -- 172.21.15.57:0/2193703924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c100c80 msgr2=0x7f714c101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:36.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.898+0000 7f71519ff700 1 --2- 172.21.15.57:0/2193703924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c100c80 0x7f714c101050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f713c009990 tx=0x7f713c009ca0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.898+0000 7f71519ff700 1 -- 172.21.15.57:0/2193703924 shutdown_connections 2023-03-02T11:09:36.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.898+0000 7f71519ff700 1 --2- 172.21.15.57:0/2193703924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f714c10a050 0x7f714c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.898+0000 7f71519ff700 1 --2- 172.21.15.57:0/2193703924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c100c80 0x7f714c101050 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.898+0000 7f71519ff700 1 --2- 172.21.15.57:0/2193703924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f714c101590 0x7f714c109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.898+0000 7f71519ff700 1 -- 172.21.15.57:0/2193703924 >> 172.21.15.57:0/2193703924 conn(0x7f714c0fa4b0 msgr2=0x7f714c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:36.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.898+0000 7f71519ff700 1 -- 172.21.15.57:0/2193703924 shutdown_connections 2023-03-02T11:09:36.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.898+0000 7f71519ff700 1 -- 172.21.15.57:0/2193703924 wait complete. 2023-03-02T11:09:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.899+0000 7f71519ff700 1 Processor -- start 2023-03-02T11:09:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f71519ff700 1 -- start start 2023-03-02T11:09:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f71519ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f714c100c80 0x7f714c19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f71519ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f714c101590 0x7f714c19bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f71519ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10a050 0x7f714c195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f71519ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c196130 con 0x7f714c101590 2023-03-02T11:09:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f71519ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c1962a0 con 0x7f714c100c80 2023-03-02T11:09:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f71519ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c196460 con 0x7f714c10a050 2023-03-02T11:09:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f71427fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f714c101590 0x7f714c19bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f714affd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f714c100c80 0x7f714c19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f71427fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f714c101590 0x7f714c19bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59888/0 (socket says 172.21.15.57:59888) 2023-03-02T11:09:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f71427fc700 1 -- 172.21.15.57:0/2347439718 learned_addr learned my addr 172.21.15.57:0/2347439718 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:09:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.900+0000 7f714b7fe700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10a050 0x7f714c195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f71427fc700 1 -- 172.21.15.57:0/2347439718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10a050 msgr2=0x7f714c195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f71427fc700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10a050 0x7f714c195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f71427fc700 1 -- 172.21.15.57:0/2347439718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f714c100c80 msgr2=0x7f714c19ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f71427fc700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f714c100c80 0x7f714c19ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f71427fc700 1 -- 172.21.15.57:0/2347439718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134009520 con 0x7f714c101590 2023-03-02T11:09:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f714affd700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f714c100c80 0x7f714c19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:09:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f71427fc700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f714c101590 0x7f714c19bf90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f713400eb30 tx=0x7f713400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f71509fd700 1 -- 172.21.15.57:0/2347439718 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134009880 con 0x7f714c101590 2023-03-02T11:09:36.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f71519ff700 1 -- 172.21.15.57:0/2347439718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7144009c40 con 0x7f714c101590 2023-03-02T11:09:36.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f71509fd700 1 -- 172.21.15.57:0/2347439718 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71340044e0 con 0x7f714c101590 2023-03-02T11:09:36.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f71509fd700 1 -- 172.21.15.57:0/2347439718 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134003d80 con 0x7f714c101590 2023-03-02T11:09:36.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.901+0000 7f71519ff700 1 -- 172.21.15.57:0/2347439718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c0095f0 con 0x7f714c101590 2023-03-02T11:09:36.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.904+0000 7f71509fd700 1 -- 172.21.15.57:0/2347439718 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f713401e020 con 0x7f714c101590 2023-03-02T11:09:36.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.904+0000 7f71509fd700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f713809b480 0x7f713809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.905+0000 7f71509fd700 1 -- 172.21.15.57:0/2347439718 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f7134014070 con 0x7f714c101590 2023-03-02T11:09:36.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.905+0000 7f714affd700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f713809b480 0x7f713809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.905+0000 7f7165399b80 1 Processor -- start 2023-03-02T11:09:36.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.905+0000 7f7165399b80 1 -- start start 2023-03-02T11:09:36.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.905+0000 7f714affd700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f713809b480 0x7f713809d930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f713c00b2e0 tx=0x7f713c005960 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:36.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.905+0000 7f7165399b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00b3c0 0x55779b00b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.905+0000 7f7165399b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 0x55779b00fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.905+0000 7f7165399b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b010560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.905+0000 7f7165399b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779af72a60 con 0x55779b00b3c0 2023-03-02T11:09:36.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.905+0000 7f7165399b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779af24f80 con 0x55779b010110 2023-03-02T11:09:36.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.905+0000 7f7165399b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779aef5160 con 0x55779b00bcd0 2023-03-02T11:09:36.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f71427fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 0x55779b00fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f714affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00b3c0 0x55779b00b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f71427fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 0x55779b00fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:40692/0 (socket says 172.21.15.57:40692) 2023-03-02T11:09:36.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f71427fc700 1 -- 172.21.15.57:0/3983428534 learned_addr learned my addr 172.21.15.57:0/3983428534 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:09:36.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f714b7fe700 1 --2- 172.21.15.57:0/3983428534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b010560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f71427fc700 1 -- 172.21.15.57:0/3983428534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 msgr2=0x55779b010560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f71427fc700 1 --2- 172.21.15.57:0/3983428534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b010560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f71427fc700 1 -- 172.21.15.57:0/3983428534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00b3c0 msgr2=0x55779b00b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f71427fc700 1 --2- 172.21.15.57:0/3983428534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00b3c0 0x55779b00b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f71427fc700 1 -- 172.21.15.57:0/3983428534 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55779addf630 con 0x55779b00bcd0 2023-03-02T11:09:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f71427fc700 1 --2- 172.21.15.57:0/3983428534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 0x55779b00fbd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71340945e0 tx=0x7f7134094610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3dd5fe2a611543f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f7141ffb700 1 -- 172.21.15.57:0/3983428534 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71340ac260 con 0x55779b00bcd0 2023-03-02T11:09:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f7141ffb700 1 -- 172.21.15.57:0/3983428534 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71340949d0 con 0x55779b00bcd0 2023-03-02T11:09:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.906+0000 7f7141ffb700 1 -- 172.21.15.57:0/3983428534 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134093ec0 con 0x55779b00bcd0 2023-03-02T11:09:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.907+0000 7f7165399b80 1 -- 172.21.15.57:0/3983428534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 msgr2=0x55779b00fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.907+0000 7f7165399b80 1 --2- 172.21.15.57:0/3983428534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 0x55779b00fbd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71340945e0 tx=0x7f7134094610 comp rx=0 tx=0).stop 2023-03-02T11:09:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.907+0000 7f7165399b80 1 -- 172.21.15.57:0/3983428534 shutdown_connections 2023-03-02T11:09:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.907+0000 7f7165399b80 1 --2- 172.21.15.57:0/3983428534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b010560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.907+0000 7f7165399b80 1 --2- 172.21.15.57:0/3983428534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00b3c0 0x55779b00b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.907+0000 7f7165399b80 1 --2- 172.21.15.57:0/3983428534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 0x55779b00fbd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.907+0000 7f7165399b80 1 -- 172.21.15.57:0/3983428534 >> 172.21.15.57:0/3983428534 conn(0x55779b000c50 msgr2=0x55779b006460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.907+0000 7f7165399b80 1 -- 172.21.15.57:0/3983428534 shutdown_connections 2023-03-02T11:09:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.907+0000 7f7165399b80 1 -- 172.21.15.57:0/3983428534 wait complete. 2023-03-02T11:09:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.907+0000 7f7165399b80 1 -- start start 2023-03-02T11:09:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f7165399b80 1 Processor -- start 2023-03-02T11:09:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f7165399b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b00b3c0 0x55779b014bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f7165399b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 0x55779b0150f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f7165399b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b010110 0x55779b015630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f7165399b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779af63bc0 con 0x55779b010110 2023-03-02T11:09:36.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f7165399b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779af5d0f0 con 0x55779b00b3c0 2023-03-02T11:09:36.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f7165399b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779ade1920 con 0x55779b00bcd0 2023-03-02T11:09:36.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f7165399b80 10 client.0 _ll_register_callbacks cb 0x55779af03520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:09:36.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f714affd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b00b3c0 0x55779b014bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f71427fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 0x55779b0150f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f714affd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b00b3c0 0x55779b014bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:40978/0 (socket says 172.21.15.57:40978) 2023-03-02T11:09:36.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f714affd700 1 -- 172.21.15.57:0/1780513683 learned_addr learned my addr 172.21.15.57:0/1780513683 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:09:36.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f714b7fe700 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b010110 0x55779b015630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f714affd700 1 -- 172.21.15.57:0/1780513683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 msgr2=0x55779b0150f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:36.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f714affd700 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 0x55779b0150f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f714affd700 1 -- 172.21.15.57:0/1780513683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b010110 msgr2=0x55779b015630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:36.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f714affd700 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b010110 0x55779b015630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.908+0000 7f714affd700 1 -- 172.21.15.57:0/1780513683 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c0095f0 con 0x55779b00b3c0 2023-03-02T11:09:36.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.909+0000 7f714affd700 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b00b3c0 0x55779b014bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f713c000c00 tx=0x7f713c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=344d9108cfa4408d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:36.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.909+0000 7f712affd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:09:36.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.909+0000 7f712affd700 1 -- 172.21.15.57:0/1780513683 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c004e70 con 0x55779b00b3c0 2023-03-02T11:09:36.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.909+0000 7f712affd700 1 -- 172.21.15.57:0/1780513683 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f713c00f670 con 0x55779b00b3c0 2023-03-02T11:09:36.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.909+0000 7f7165399b80 1 -- 172.21.15.57:0/1780513683 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55779af2e7b0 con 0x55779b00b3c0 2023-03-02T11:09:36.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.909+0000 7f712affd700 1 -- 172.21.15.57:0/1780513683 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f713c00f830 con 0x55779b00b3c0 2023-03-02T11:09:36.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.909+0000 7f7165399b80 10 client.26387 fetch_fsmap learned FSMap version 47 2023-03-02T11:09:36.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.909+0000 7f7165399b80 1 -- 172.21.15.57:0/1780513683 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55779ad8bde0 con 0x55779b00b3c0 2023-03-02T11:09:36.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.909+0000 7f712affd700 1 -- 172.21.15.57:0/1780513683 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55779af2e7b0 con 0x55779b00b3c0 2023-03-02T11:09:36.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.910+0000 7f712affd700 1 -- 172.21.15.57:0/1780513683 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f713c02f070 con 0x55779b00b3c0 2023-03-02T11:09:36.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.910+0000 7f7165399b80 10 client.26387 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:09:36.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.910+0000 7f7165399b80 10 client.26387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:09:36.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.910+0000 7f7165399b80 20 client.26387 populate_metadata read hostname 'smithi057' 2023-03-02T11:09:36.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.910+0000 7f7165399b80 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55779b0252a0 0x55779b0276b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.910+0000 7f7165399b80 4 client.26387 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:09:36.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.910+0000 7f7165399b80 1 -- 172.21.15.57:0/1780513683 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55779af56170 con 0x55779b0252a0 2023-03-02T11:09:36.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.910+0000 7f71427fc700 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55779b0252a0 0x55779b0276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.910+0000 7f71427fc700 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55779b0252a0 0x55779b0276b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1e5687f30cbe4f7 server_cookie=8c88f3dc34626d4a in_seq=0 out_seq=0 2023-03-02T11:09:36.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.910+0000 7f712affd700 10 client.26387 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:09:36.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f712affd700 1 -- 172.21.15.57:0/1780513683 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55779af56170 con 0x55779b0252a0 2023-03-02T11:09:36.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f712affd700 10 client.26387 handle_command_reply: tid=0 2023-03-02T11:09:36.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f7165399b80 1 client.26387 shutdown 2023-03-02T11:09:36.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f7165399b80 1 -- 172.21.15.57:0/1780513683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b00b3c0 msgr2=0x55779b014bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:36.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f7165399b80 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b00b3c0 0x55779b014bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f713c000c00 tx=0x7f713c009ca0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f7165399b80 1 -- 172.21.15.57:0/1780513683 shutdown_connections 2023-03-02T11:09:36.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f7165399b80 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55779b0252a0 0x55779b0276b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f7165399b80 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b010110 0x55779b015630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f7165399b80 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b00b3c0 0x55779b014bb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f712affd700 0 client.26387 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:09:36.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f7165399b80 1 --2- 172.21.15.57:0/1780513683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00bcd0 0x55779b0150f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f7165399b80 1 -- 172.21.15.57:0/1780513683 >> 172.21.15.57:0/1780513683 conn(0x55779b000c50 msgr2=0x55779b006050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:36.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f7165399b80 1 -- 172.21.15.57:0/1780513683 shutdown_connections 2023-03-02T11:09:36.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.911+0000 7f7165399b80 1 -- 172.21.15.57:0/1780513683 wait complete. 2023-03-02T11:09:36.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.912+0000 7f7165399b80 20 client.26387 trim_cache size 0 max 16384 2023-03-02T11:09:36.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f7165399b80 1 Processor -- start 2023-03-02T11:09:36.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f7165399b80 1 -- start start 2023-03-02T11:09:36.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f7165399b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b0154b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f7165399b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00bcd0 0x55779b00f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f7165399b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b00f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f7165399b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779b007b00 con 0x55779b00bcd0 2023-03-02T11:09:36.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f7165399b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779b0066b0 con 0x55779b010110 2023-03-02T11:09:36.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f7165399b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779b00c220 con 0x55779b00b3c0 2023-03-02T11:09:36.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f714affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b0154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f714affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b0154b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:40696/0 (socket says 172.21.15.57:40696) 2023-03-02T11:09:36.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f714affd700 1 -- 172.21.15.57:0/3970835326 learned_addr learned my addr 172.21.15.57:0/3970835326 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:09:36.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f71427fc700 1 --2- 172.21.15.57:0/3970835326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00bcd0 0x55779b00f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.928+0000 7f714b7fe700 1 --2- 172.21.15.57:0/3970835326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b00f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.929+0000 7f714affd700 1 -- 172.21.15.57:0/3970835326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 msgr2=0x55779b00f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:36.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.929+0000 7f714affd700 1 --2- 172.21.15.57:0/3970835326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b00f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.929+0000 7f714affd700 1 -- 172.21.15.57:0/3970835326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00bcd0 msgr2=0x55779b00f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:36.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.929+0000 7f714affd700 1 --2- 172.21.15.57:0/3970835326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00bcd0 0x55779b00f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.929+0000 7f714affd700 1 -- 172.21.15.57:0/3970835326 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55779b010a00 con 0x55779b00b3c0 2023-03-02T11:09:36.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.929+0000 7f71427fc700 1 --2- 172.21.15.57:0/3970835326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00bcd0 0x55779b00f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:09:36.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.929+0000 7f714affd700 1 --2- 172.21.15.57:0/3970835326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b0154b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f713c024a60 tx=0x7f713c009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2e3e9f7d69e4e60 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:36.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.929+0000 7f7142ffd700 1 -- 172.21.15.57:0/3970835326 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c004cf0 con 0x55779b00b3c0 2023-03-02T11:09:36.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.929+0000 7f7142ffd700 1 -- 172.21.15.57:0/3970835326 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f713c028070 con 0x55779b00b3c0 2023-03-02T11:09:36.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.929+0000 7f7142ffd700 1 -- 172.21.15.57:0/3970835326 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c00fd00 con 0x55779b00b3c0 2023-03-02T11:09:36.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.930+0000 7f7165399b80 1 -- 172.21.15.57:0/3970835326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 msgr2=0x55779b0154b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:36.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.930+0000 7f7165399b80 1 --2- 172.21.15.57:0/3970835326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b0154b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f713c024a60 tx=0x7f713c009290 comp rx=0 tx=0).stop 2023-03-02T11:09:36.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.930+0000 7f7165399b80 1 -- 172.21.15.57:0/3970835326 shutdown_connections 2023-03-02T11:09:36.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.930+0000 7f7165399b80 1 --2- 172.21.15.57:0/3970835326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b00f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.930+0000 7f7165399b80 1 --2- 172.21.15.57:0/3970835326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b0154b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.930+0000 7f7165399b80 1 --2- 172.21.15.57:0/3970835326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00bcd0 0x55779b00f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.930+0000 7f7165399b80 1 -- 172.21.15.57:0/3970835326 >> 172.21.15.57:0/3970835326 conn(0x55779b000c50 msgr2=0x55779b0207e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.930+0000 7f7165399b80 1 -- 172.21.15.57:0/3970835326 shutdown_connections 2023-03-02T11:09:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.930+0000 7f7165399b80 1 -- 172.21.15.57:0/3970835326 wait complete. 2023-03-02T11:09:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.930+0000 7f7165399b80 1 -- start start 2023-03-02T11:09:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.930+0000 7f7165399b80 1 Processor -- start 2023-03-02T11:09:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f7165399b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b01bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f7165399b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00bcd0 0x55779b01a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f7165399b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b01a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f7165399b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779b01adf0 con 0x55779b00bcd0 2023-03-02T11:09:36.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f7165399b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779b01af30 con 0x55779b010110 2023-03-02T11:09:36.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f7165399b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779b01b0f0 con 0x55779b00b3c0 2023-03-02T11:09:36.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f7165399b80 10 client.0 _ll_register_callbacks cb 0x55779af03520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:09:36.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f714affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b01bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f714affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b01bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:40710/0 (socket says 172.21.15.57:40710) 2023-03-02T11:09:36.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f714affd700 1 -- 172.21.15.57:0/3476419196 learned_addr learned my addr 172.21.15.57:0/3476419196 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:09:36.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f714b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b01a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f71427fc700 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00bcd0 0x55779b01a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f714affd700 1 -- 172.21.15.57:0/3476419196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 msgr2=0x55779b01a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:36.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f714affd700 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b01a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f714affd700 1 -- 172.21.15.57:0/3476419196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00bcd0 msgr2=0x55779b01a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:09:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f714affd700 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00bcd0 0x55779b01a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f714affd700 1 -- 172.21.15.57:0/3476419196 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55779addf630 con 0x55779b00b3c0 2023-03-02T11:09:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f714affd700 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b01bf50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f713c009ce0 tx=0x7f713c004cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1393ef085c405ff server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:09:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.931+0000 7f712affd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:09:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f712affd700 1 -- 172.21.15.57:0/3476419196 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c024610 con 0x55779b00b3c0 2023-03-02T11:09:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f7165399b80 1 -- 172.21.15.57:0/3476419196 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71340949d0 con 0x55779b00b3c0 2023-03-02T11:09:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f712affd700 1 -- 172.21.15.57:0/3476419196 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f713c024770 con 0x55779b00b3c0 2023-03-02T11:09:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f712affd700 1 -- 172.21.15.57:0/3476419196 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f713c00f860 con 0x55779b00b3c0 2023-03-02T11:09:36.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f7165399b80 10 client.26344 fetch_fsmap learned FSMap version 47 2023-03-02T11:09:36.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f7165399b80 1 -- 172.21.15.57:0/3476419196 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55779ad8bde0 con 0x55779b00b3c0 2023-03-02T11:09:36.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f712affd700 1 -- 172.21.15.57:0/3476419196 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71340949d0 con 0x55779b00b3c0 2023-03-02T11:09:36.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f712affd700 1 -- 172.21.15.57:0/3476419196 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f713c02f050 con 0x55779b00b3c0 2023-03-02T11:09:36.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f7165399b80 10 client.26344 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:09:36.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f7165399b80 10 client.26344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:09:36.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f7165399b80 20 client.26344 populate_metadata read hostname 'smithi057' 2023-03-02T11:09:36.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f7165399b80 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55779b077b80 0x55779b079f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:09:36.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f7165399b80 4 client.26344 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:09:36.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f7165399b80 1 -- 172.21.15.57:0/3476419196 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55779af55e90 con 0x55779b077b80 2023-03-02T11:09:36.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.932+0000 7f71427fc700 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55779b077b80 0x55779b079f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:36.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f712affd700 10 client.26344 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:09:36.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f71427fc700 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55779b077b80 0x55779b079f60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a18d1ec8698df0b6 server_cookie=1a8773757b3cdd54 in_seq=0 out_seq=0 2023-03-02T11:09:36.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f712affd700 1 -- 172.21.15.57:0/3476419196 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55779af55e90 con 0x55779b077b80 2023-03-02T11:09:36.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f712affd700 10 client.26344 handle_command_reply: tid=0 2023-03-02T11:09:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 1 client.26344 shutdown 2023-03-02T11:09:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 1 -- 172.21.15.57:0/3476419196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 msgr2=0x55779b01bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b01bf50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f713c009ce0 tx=0x7f713c004cf0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 1 -- 172.21.15.57:0/3476419196 shutdown_connections 2023-03-02T11:09:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55779b077b80 0x55779b079f60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55779b010110 0x55779b01a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f712affd700 0 client.26344 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:09:36.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55779b00b3c0 0x55779b01bf50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 1 --2- 172.21.15.57:0/3476419196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55779b00bcd0 0x55779b01a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 1 -- 172.21.15.57:0/3476419196 >> 172.21.15.57:0/3476419196 conn(0x55779b000c50 msgr2=0x55779b00f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:36.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 1 -- 172.21.15.57:0/3476419196 shutdown_connections 2023-03-02T11:09:36.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 1 -- 172.21.15.57:0/3476419196 wait complete. 2023-03-02T11:09:36.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.933+0000 7f7165399b80 20 client.26344 trim_cache size 0 max 16384 2023-03-02T11:09:36.946 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:09:36.946 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:09:36.946 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:09:36.946 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:09:36.946 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:09:36.947 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:09:36.947 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:09:36.947 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:09:36.947 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:09:36.947 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:09:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 -- 172.21.15.57:0/2347439718 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f713809b480 msgr2=0x7f713809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f713809b480 0x7f713809d930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f713c00b2e0 tx=0x7f713c005960 comp rx=0 tx=0).stop 2023-03-02T11:09:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 -- 172.21.15.57:0/2347439718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f714c101590 msgr2=0x7f714c19bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:09:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f714c101590 0x7f714c19bf90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f713400eb30 tx=0x7f713400ee40 comp rx=0 tx=0).stop 2023-03-02T11:09:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 -- 172.21.15.57:0/2347439718 shutdown_connections 2023-03-02T11:09:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f713809b480 0x7f713809d930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10a050 0x7f714c195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f714c100c80 0x7f714c19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 --2- 172.21.15.57:0/2347439718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f714c101590 0x7f714c19bf90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:09:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 -- 172.21.15.57:0/2347439718 >> 172.21.15.57:0/2347439718 conn(0x7f714c0fa4b0 msgr2=0x7f714c0fb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:09:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 -- 172.21.15.57:0/2347439718 shutdown_connections 2023-03-02T11:09:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:09:36.934+0000 7f71519ff700 1 -- 172.21.15.57:0/2347439718 wait complete. 2023-03-02T11:09:36.950 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:09:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:37 smithi136 ceph-mon[125702]: pgmap v393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:37 smithi057 ceph-mon[92072]: pgmap v393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:37 smithi122 ceph-mon[125440]: pgmap v393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:39 smithi136 ceph-mon[125702]: pgmap v394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:09:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:39 smithi057 ceph-mon[92072]: pgmap v394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:09:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:39 smithi122 ceph-mon[125440]: pgmap v394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T11:09:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:42 smithi136 ceph-mon[125702]: pgmap v395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:42 smithi057 ceph-mon[92072]: pgmap v395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:42 smithi122 ceph-mon[125440]: pgmap v395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:44 smithi136 ceph-mon[125702]: pgmap v396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:44 smithi057 ceph-mon[92072]: pgmap v396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:44 smithi122 ceph-mon[125440]: pgmap v396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:46 smithi136 ceph-mon[125702]: pgmap v397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:46 smithi057 ceph-mon[92072]: pgmap v397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:46 smithi122 ceph-mon[125440]: pgmap v397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:48 smithi136 ceph-mon[125702]: pgmap v398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:48 smithi057 ceph-mon[92072]: pgmap v398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:48 smithi122 ceph-mon[125440]: pgmap v398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:49.294+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:09:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:49.294+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:09:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:49.294+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:09:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:49.294+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:09:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:09:49.294+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:09:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:50 smithi136 ceph-mon[125702]: pgmap v399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:50 smithi057 ceph-mon[92072]: pgmap v399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:50 smithi122 ceph-mon[125440]: pgmap v399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:52 smithi136 ceph-mon[125702]: pgmap v400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:52 smithi057 ceph-mon[92072]: pgmap v400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:52 smithi122 ceph-mon[125440]: pgmap v400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:54 smithi136 ceph-mon[125702]: pgmap v401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:54 smithi057 ceph-mon[92072]: pgmap v401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:54 smithi122 ceph-mon[125440]: pgmap v401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:56 smithi136 ceph-mon[125702]: pgmap v402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:56 smithi057 ceph-mon[92072]: pgmap v402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:56 smithi122 ceph-mon[125440]: pgmap v402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:09:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:09:58 smithi136 ceph-mon[125702]: pgmap v403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:09:58 smithi057 ceph-mon[92072]: pgmap v403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:09:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:09:58 smithi122 ceph-mon[125440]: pgmap v403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:00 smithi136 ceph-mon[125702]: pgmap v404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T11:10:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:00 smithi057 ceph-mon[92072]: pgmap v404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T11:10:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:00 smithi122 ceph-mon[125440]: pgmap v404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T11:10:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:02 smithi057 ceph-mon[92072]: pgmap v405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:02 smithi136 ceph-mon[125702]: pgmap v405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:02 smithi122 ceph-mon[125440]: pgmap v405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:04.300 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:04.299+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:04.300+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:10:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:04.300+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:10:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:04.300+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:10:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:04.300+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:10:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:04 smithi136 ceph-mon[125702]: pgmap v406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:10:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:04 smithi057 ceph-mon[92072]: pgmap v406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:10:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:04 smithi122 ceph-mon[125440]: pgmap v406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:10:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:06 smithi136 ceph-mon[125702]: pgmap v407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:10:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:06 smithi057 ceph-mon[92072]: pgmap v407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:10:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:06 smithi122 ceph-mon[125440]: pgmap v407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:10:06.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:10:07.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.137+0000 7fefeffff700 1 -- 172.21.15.57:0/3322107376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe80ffad0 msgr2=0x7fefe80fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:07.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.137+0000 7fefeffff700 1 --2- 172.21.15.57:0/3322107376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe80ffad0 0x7fefe80fff40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009990 tx=0x7fefd8009ca0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.137+0000 7fefeffff700 1 -- 172.21.15.57:0/3322107376 shutdown_connections 2023-03-02T11:10:07.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.137+0000 7fefeffff700 1 --2- 172.21.15.57:0/3322107376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe8100480 0x7fefe810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.137+0000 7fefeffff700 1 --2- 172.21.15.57:0/3322107376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefe8105ae0 0x7fefe8105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.137+0000 7fefeffff700 1 --2- 172.21.15.57:0/3322107376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe80ffad0 0x7fefe80fff40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.137+0000 7fefeffff700 1 -- 172.21.15.57:0/3322107376 >> 172.21.15.57:0/3322107376 conn(0x7fefe80fb610 msgr2=0x7fefe80fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:07.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.137+0000 7fefeffff700 1 -- 172.21.15.57:0/3322107376 shutdown_connections 2023-03-02T11:10:07.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.137+0000 7fefeffff700 1 -- 172.21.15.57:0/3322107376 wait complete. 2023-03-02T11:10:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefeffff700 1 Processor -- start 2023-03-02T11:10:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefeffff700 1 -- start start 2023-03-02T11:10:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefeffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefe80ffad0 0x7fefe8072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefeffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe8100480 0x7fefe8072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefeffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe8105ae0 0x7fefe8073310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefeffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe81a40c0 con 0x7fefe8100480 2023-03-02T11:10:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefeffff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe81a4230 con 0x7fefe80ffad0 2023-03-02T11:10:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefeffff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe81a43f0 con 0x7fefe8105ae0 2023-03-02T11:10:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefed59a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe8100480 0x7fefe8072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefedd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefe80ffad0 0x7fefe8072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefedd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefe80ffad0 0x7fefe8072890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59174/0 (socket says 172.21.15.57:59174) 2023-03-02T11:10:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefedd9b700 1 -- 172.21.15.57:0/2376409613 learned_addr learned my addr 172.21.15.57:0/2376409613 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:10:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefed59a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe8100480 0x7fefe8072dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43588/0 (socket says 172.21.15.57:43588) 2023-03-02T11:10:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.138+0000 7fefee59c700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe8105ae0 0x7fefe8073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefed59a700 1 -- 172.21.15.57:0/2376409613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe8105ae0 msgr2=0x7fefe8073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefed59a700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe8105ae0 0x7fefe8073310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefed59a700 1 -- 172.21.15.57:0/2376409613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefe80ffad0 msgr2=0x7fefe8072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefed59a700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefe80ffad0 0x7fefe8072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefed59a700 1 -- 172.21.15.57:0/2376409613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80095f0 con 0x7fefe8100480 2023-03-02T11:10:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefee59c700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe8105ae0 0x7fefe8073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:10:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefedd9b700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefe80ffad0 0x7fefe8072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:10:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefed59a700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe8100480 0x7fefe8072dd0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009990 tx=0x7fefd8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefdeffd700 1 -- 172.21.15.57:0/2376409613 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd801d070 con 0x7fefe8100480 2023-03-02T11:10:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefeffff700 1 -- 172.21.15.57:0/2376409613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe810fb60 con 0x7fefe8100480 2023-03-02T11:10:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefdeffd700 1 -- 172.21.15.57:0/2376409613 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefd8021410 con 0x7fefe8100480 2023-03-02T11:10:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefdeffd700 1 -- 172.21.15.57:0/2376409613 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8017650 con 0x7fefe8100480 2023-03-02T11:10:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.139+0000 7fefeffff700 1 -- 172.21.15.57:0/2376409613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe810f9d0 con 0x7fefe8100480 2023-03-02T11:10:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.141+0000 7fefdeffd700 1 -- 172.21.15.57:0/2376409613 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fefd8028030 con 0x7fefe8100480 2023-03-02T11:10:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.142+0000 7fefdeffd700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fefd409b480 0x7fefd409d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.143+0000 7fefdeffd700 1 -- 172.21.15.57:0/2376409613 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fefd80c6300 con 0x7fefe8100480 2023-03-02T11:10:07.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.143+0000 7fefedd9b700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fefd409b480 0x7fefd409d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.143+0000 7ff003844b80 1 Processor -- start 2023-03-02T11:10:07.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.143+0000 7ff003844b80 1 -- start start 2023-03-02T11:10:07.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.143+0000 7fefedd9b700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fefd409b480 0x7fefd409d930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fefe4011550 tx=0x7fefe4009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:07.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.143+0000 7ff003844b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96c3c0 0x561a7d96c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.143+0000 7ff003844b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96ccd0 0x561a7d970bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.143+0000 7ff003844b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d971110 0x561a7d971560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.143+0000 7ff003844b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d8d3a60 con 0x561a7d971110 2023-03-02T11:10:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.143+0000 7ff003844b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d885f80 con 0x561a7d96ccd0 2023-03-02T11:10:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.143+0000 7ff003844b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d856160 con 0x561a7d96c3c0 2023-03-02T11:10:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefedd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96c3c0 0x561a7d96c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefed59a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96ccd0 0x561a7d970bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefedd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96c3c0 0x561a7d96c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:54184/0 (socket says 172.21.15.57:54184) 2023-03-02T11:10:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefedd9b700 1 -- 172.21.15.57:0/190427936 learned_addr learned my addr 172.21.15.57:0/190427936 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:10:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefee59c700 1 --2- 172.21.15.57:0/190427936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d971110 0x561a7d971560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefed59a700 1 -- 172.21.15.57:0/190427936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96c3c0 msgr2=0x561a7d96c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefed59a700 1 --2- 172.21.15.57:0/190427936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96c3c0 0x561a7d96c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefed59a700 1 -- 172.21.15.57:0/190427936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d971110 msgr2=0x561a7d971560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:07.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefed59a700 1 --2- 172.21.15.57:0/190427936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d971110 0x561a7d971560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefed59a700 1 -- 172.21.15.57:0/190427936 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a7d740630 con 0x561a7d96ccd0 2023-03-02T11:10:07.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefed59a700 1 --2- 172.21.15.57:0/190427936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96ccd0 0x561a7d970bd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fefd8092250 tx=0x7fefd8091c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=445671767d0dbc73 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:07.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefd3fff700 1 -- 172.21.15.57:0/190427936 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80c6040 con 0x561a7d96ccd0 2023-03-02T11:10:07.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefd3fff700 1 -- 172.21.15.57:0/190427936 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefd8095ee0 con 0x561a7d96ccd0 2023-03-02T11:10:07.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.144+0000 7fefd3fff700 1 -- 172.21.15.57:0/190427936 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8095a40 con 0x561a7d96ccd0 2023-03-02T11:10:07.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.145+0000 7ff003844b80 1 -- 172.21.15.57:0/190427936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96ccd0 msgr2=0x561a7d970bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:07.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.145+0000 7ff003844b80 1 --2- 172.21.15.57:0/190427936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96ccd0 0x561a7d970bd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fefd8092250 tx=0x7fefd8091c50 comp rx=0 tx=0).stop 2023-03-02T11:10:07.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.145+0000 7ff003844b80 1 -- 172.21.15.57:0/190427936 shutdown_connections 2023-03-02T11:10:07.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.145+0000 7ff003844b80 1 --2- 172.21.15.57:0/190427936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d971110 0x561a7d971560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.145+0000 7ff003844b80 1 --2- 172.21.15.57:0/190427936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96c3c0 0x561a7d96c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.145+0000 7ff003844b80 1 --2- 172.21.15.57:0/190427936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96ccd0 0x561a7d970bd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.145+0000 7ff003844b80 1 -- 172.21.15.57:0/190427936 >> 172.21.15.57:0/190427936 conn(0x561a7d961c50 msgr2=0x561a7d967460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:07.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.145+0000 7ff003844b80 1 -- 172.21.15.57:0/190427936 shutdown_connections 2023-03-02T11:10:07.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.145+0000 7ff003844b80 1 -- 172.21.15.57:0/190427936 wait complete. 2023-03-02T11:10:07.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.146+0000 7ff003844b80 1 -- start start 2023-03-02T11:10:07.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.146+0000 7ff003844b80 1 Processor -- start 2023-03-02T11:10:07.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.146+0000 7ff003844b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d978840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.146+0000 7ff003844b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 0x561a7d975ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.146+0000 7ff003844b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d971110 0x561a7d9760d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.146+0000 7ff003844b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d8c4bc0 con 0x561a7d96ccd0 2023-03-02T11:10:07.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.146+0000 7ff003844b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d8be0f0 con 0x561a7d96c3c0 2023-03-02T11:10:07.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.146+0000 7ff003844b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d742920 con 0x561a7d971110 2023-03-02T11:10:07.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7ff003844b80 10 client.0 _ll_register_callbacks cb 0x561a7d864520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:10:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefedd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d978840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefed59a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 0x561a7d975ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefedd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d978840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59194/0 (socket says 172.21.15.57:59194) 2023-03-02T11:10:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefedd9b700 1 -- 172.21.15.57:0/4144815340 learned_addr learned my addr 172.21.15.57:0/4144815340 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:10:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefee59c700 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d971110 0x561a7d9760d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefedd9b700 1 -- 172.21.15.57:0/4144815340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d971110 msgr2=0x561a7d9760d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefedd9b700 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d971110 0x561a7d9760d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefedd9b700 1 -- 172.21.15.57:0/4144815340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 msgr2=0x561a7d975ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefedd9b700 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 0x561a7d975ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefedd9b700 1 -- 172.21.15.57:0/4144815340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe810f9d0 con 0x561a7d96c3c0 2023-03-02T11:10:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefee59c700 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d971110 0x561a7d9760d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:10:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefed59a700 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 0x561a7d975ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:10:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefedd9b700 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d978840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fefe4009880 tx=0x7fefe40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b75e665c4fc2fe6 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:10:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefd17fa700 1 -- 172.21.15.57:0/4144815340 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe400ee20 con 0x561a7d96c3c0 2023-03-02T11:10:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7fefd17fa700 1 -- 172.21.15.57:0/4144815340 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fefe401fdb0 con 0x561a7d96c3c0 2023-03-02T11:10:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.147+0000 7ff003844b80 1 -- 172.21.15.57:0/4144815340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a7d88f7b0 con 0x561a7d96c3c0 2023-03-02T11:10:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7fefd17fa700 1 -- 172.21.15.57:0/4144815340 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefe4028440 con 0x561a7d96c3c0 2023-03-02T11:10:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7ff003844b80 10 client.26405 fetch_fsmap learned FSMap version 47 2023-03-02T11:10:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7ff003844b80 1 -- 172.21.15.57:0/4144815340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x561a7d6ecde0 con 0x561a7d96c3c0 2023-03-02T11:10:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7fefd17fa700 1 -- 172.21.15.57:0/4144815340 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561a7d88f7b0 con 0x561a7d96c3c0 2023-03-02T11:10:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7fefd17fa700 1 -- 172.21.15.57:0/4144815340 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fefe40276b0 con 0x561a7d96c3c0 2023-03-02T11:10:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7ff003844b80 10 client.26405 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:10:07.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7ff003844b80 10 client.26405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:10:07.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7ff003844b80 20 client.26405 populate_metadata read hostname 'smithi057' 2023-03-02T11:10:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7ff003844b80 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561a7d985f20 0x561a7d988330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7ff003844b80 4 client.26405 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:10:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7ff003844b80 1 -- 172.21.15.57:0/4144815340 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a7d8b7170 con 0x561a7d985f20 2023-03-02T11:10:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.148+0000 7fefed59a700 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561a7d985f20 0x561a7d988330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.149+0000 7fefed59a700 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561a7d985f20 0x561a7d988330 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5f2d4ccbb18e006 server_cookie=5bc9cf15cd4f831c in_seq=0 out_seq=0 2023-03-02T11:10:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.149+0000 7fefd17fa700 10 client.26405 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:10:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7fefd17fa700 1 -- 172.21.15.57:0/4144815340 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x561a7d8b7170 con 0x561a7d985f20 2023-03-02T11:10:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7fefd17fa700 10 client.26405 handle_command_reply: tid=0 2023-03-02T11:10:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 1 client.26405 shutdown 2023-03-02T11:10:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 1 -- 172.21.15.57:0/4144815340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 msgr2=0x561a7d978840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d978840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fefe4009880 tx=0x7fefe40047c0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 1 -- 172.21.15.57:0/4144815340 shutdown_connections 2023-03-02T11:10:07.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561a7d985f20 0x561a7d988330 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d971110 0x561a7d9760d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d978840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 1 --2- 172.21.15.57:0/4144815340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 0x561a7d975ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7fefd17fa700 0 client.26405 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:10:07.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 1 -- 172.21.15.57:0/4144815340 >> 172.21.15.57:0/4144815340 conn(0x561a7d961c50 msgr2=0x561a7d967050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:07.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 1 -- 172.21.15.57:0/4144815340 shutdown_connections 2023-03-02T11:10:07.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 1 -- 172.21.15.57:0/4144815340 wait complete. 2023-03-02T11:10:07.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.150+0000 7ff003844b80 20 client.26405 trim_cache size 0 max 16384 2023-03-02T11:10:07.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7ff003844b80 1 Processor -- start 2023-03-02T11:10:07.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7ff003844b80 1 -- start start 2023-03-02T11:10:07.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7ff003844b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96c3c0 0x561a7d970770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7ff003844b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 0x561a7d9783e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7ff003844b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d971110 0x561a7d96d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7ff003844b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d96d1f0 con 0x561a7d96ccd0 2023-03-02T11:10:07.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7ff003844b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d983610 con 0x561a7d971110 2023-03-02T11:10:07.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7ff003844b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d95ef50 con 0x561a7d96c3c0 2023-03-02T11:10:07.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7fefed59a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 0x561a7d9783e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7fefedd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96c3c0 0x561a7d970770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7fefee59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d971110 0x561a7d96d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7fefed59a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 0x561a7d9783e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43610/0 (socket says 172.21.15.57:43610) 2023-03-02T11:10:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.167+0000 7fefed59a700 1 -- 172.21.15.57:0/2904154519 learned_addr learned my addr 172.21.15.57:0/2904154519 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:10:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.168+0000 7fefed59a700 1 -- 172.21.15.57:0/2904154519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96c3c0 msgr2=0x561a7d970770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.168+0000 7fefed59a700 1 --2- 172.21.15.57:0/2904154519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96c3c0 0x561a7d970770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.168+0000 7fefed59a700 1 -- 172.21.15.57:0/2904154519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d971110 msgr2=0x561a7d96d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.168+0000 7fefed59a700 1 --2- 172.21.15.57:0/2904154519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d971110 0x561a7d96d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.168+0000 7fefed59a700 1 -- 172.21.15.57:0/2904154519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a7d9633f0 con 0x561a7d96ccd0 2023-03-02T11:10:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.168+0000 7fefed59a700 1 --2- 172.21.15.57:0/2904154519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 0x561a7d9783e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fefd8093b30 tx=0x7fefd8004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e28d1759afd554b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.168+0000 7fefdcff9700 1 -- 172.21.15.57:0/2904154519 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd809ce70 con 0x561a7d96ccd0 2023-03-02T11:10:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.168+0000 7fefdcff9700 1 -- 172.21.15.57:0/2904154519 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefd8099160 con 0x561a7d96ccd0 2023-03-02T11:10:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.168+0000 7fefdcff9700 1 -- 172.21.15.57:0/2904154519 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd809c9e0 con 0x561a7d96ccd0 2023-03-02T11:10:07.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 -- 172.21.15.57:0/2904154519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 msgr2=0x561a7d9783e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:07.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 --2- 172.21.15.57:0/2904154519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 0x561a7d9783e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fefd8093b30 tx=0x7fefd8004790 comp rx=0 tx=0).stop 2023-03-02T11:10:07.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 -- 172.21.15.57:0/2904154519 shutdown_connections 2023-03-02T11:10:07.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 --2- 172.21.15.57:0/2904154519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d971110 0x561a7d96d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 --2- 172.21.15.57:0/2904154519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96c3c0 0x561a7d970770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 --2- 172.21.15.57:0/2904154519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d96ccd0 0x561a7d9783e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 -- 172.21.15.57:0/2904154519 >> 172.21.15.57:0/2904154519 conn(0x561a7d961c50 msgr2=0x561a7d970060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:07.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 -- 172.21.15.57:0/2904154519 shutdown_connections 2023-03-02T11:10:07.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 -- 172.21.15.57:0/2904154519 wait complete. 2023-03-02T11:10:07.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 -- start start 2023-03-02T11:10:07.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 Processor -- start 2023-03-02T11:10:07.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d9cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96ccd0 0x561a7d9cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d971110 0x561a7d9d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d9d0d60 con 0x561a7d971110 2023-03-02T11:10:07.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d9d0ed0 con 0x561a7d96c3c0 2023-03-02T11:10:07.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.169+0000 7ff003844b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7d9d1090 con 0x561a7d96ccd0 2023-03-02T11:10:07.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7ff003844b80 10 client.0 _ll_register_callbacks cb 0x561a7d864520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:10:07.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefedd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d9cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefed59a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96ccd0 0x561a7d9cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefee59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d971110 0x561a7d9d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefedd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d9cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:59206/0 (socket says 172.21.15.57:59206) 2023-03-02T11:10:07.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefedd9b700 1 -- 172.21.15.57:0/1501256248 learned_addr learned my addr 172.21.15.57:0/1501256248 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:10:07.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefed59a700 1 -- 172.21.15.57:0/1501256248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 msgr2=0x561a7d9cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:07.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefed59a700 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d9cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefed59a700 1 -- 172.21.15.57:0/1501256248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d971110 msgr2=0x561a7d9d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:07.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefed59a700 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d971110 0x561a7d9d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefed59a700 1 -- 172.21.15.57:0/1501256248 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a7d740630 con 0x561a7d96ccd0 2023-03-02T11:10:07.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefedd9b700 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d9cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:10:07.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefee59c700 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d971110 0x561a7d9d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:10:07.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefed59a700 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96ccd0 0x561a7d9cbe90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x561a7d88f8f0 tx=0x7fefd8091bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efb1ce65460761d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:07.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:10:07.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefd17fa700 1 -- 172.21.15.57:0/1501256248 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd809ce70 con 0x561a7d96ccd0 2023-03-02T11:10:07.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7ff003844b80 1 -- 172.21.15.57:0/1501256248 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefd8095ee0 con 0x561a7d96ccd0 2023-03-02T11:10:07.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.170+0000 7fefd17fa700 1 -- 172.21.15.57:0/1501256248 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fefd8095a40 con 0x561a7d96ccd0 2023-03-02T11:10:07.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7fefd17fa700 1 -- 172.21.15.57:0/1501256248 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefd8095c00 con 0x561a7d96ccd0 2023-03-02T11:10:07.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7ff003844b80 10 client.26362 fetch_fsmap learned FSMap version 47 2023-03-02T11:10:07.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7ff003844b80 1 -- 172.21.15.57:0/1501256248 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x561a7d6d5c60 con 0x561a7d96ccd0 2023-03-02T11:10:07.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7fefd17fa700 1 -- 172.21.15.57:0/1501256248 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefd8095ee0 con 0x561a7d96ccd0 2023-03-02T11:10:07.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7fefd17fa700 1 -- 172.21.15.57:0/1501256248 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fefd80b2120 con 0x561a7d96ccd0 2023-03-02T11:10:07.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7ff003844b80 10 client.26362 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:10:07.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7ff003844b80 10 client.26362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:10:07.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7ff003844b80 20 client.26362 populate_metadata read hostname 'smithi057' 2023-03-02T11:10:07.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7ff003844b80 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561a7d9d8540 0x561a7d9da950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:07.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7ff003844b80 4 client.26362 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:10:07.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7ff003844b80 1 -- 172.21.15.57:0/1501256248 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561a7d8b6e90 con 0x561a7d9d8540 2023-03-02T11:10:07.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.171+0000 7fefedd9b700 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561a7d9d8540 0x561a7d9da950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:07.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7fefd17fa700 10 client.26362 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:10:07.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7fefedd9b700 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561a7d9d8540 0x561a7d9da950 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6d1d53b18c78c5c server_cookie=34b7bd21c2e5cb34 in_seq=0 out_seq=0 2023-03-02T11:10:07.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7fefd17fa700 1 -- 172.21.15.57:0/1501256248 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561a7d8b6e90 con 0x561a7d9d8540 2023-03-02T11:10:07.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7fefd17fa700 10 client.26362 handle_command_reply: tid=0 2023-03-02T11:10:07.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 1 client.26362 shutdown 2023-03-02T11:10:07.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 1 -- 172.21.15.57:0/1501256248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96ccd0 msgr2=0x561a7d9cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:07.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96ccd0 0x561a7d9cbe90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x561a7d88f8f0 tx=0x7fefd8091bd0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 1 -- 172.21.15.57:0/1501256248 shutdown_connections 2023-03-02T11:10:07.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561a7d9d8540 0x561a7d9da950 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561a7d971110 0x561a7d9d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7fefd17fa700 0 client.26362 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:10:07.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a7d96c3c0 0x561a7d9cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 1 --2- 172.21.15.57:0/1501256248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a7d96ccd0 0x561a7d9cbe90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 1 -- 172.21.15.57:0/1501256248 >> 172.21.15.57:0/1501256248 conn(0x561a7d961c50 msgr2=0x561a7d96ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:07.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 1 -- 172.21.15.57:0/1501256248 shutdown_connections 2023-03-02T11:10:07.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 1 -- 172.21.15.57:0/1501256248 wait complete. 2023-03-02T11:10:07.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.172+0000 7ff003844b80 20 client.26362 trim_cache size 0 max 16384 2023-03-02T11:10:07.183 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:10:07.183 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:10:07.183 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:10:07.183 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:10:07.184 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:10:07.184 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:10:07.184 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:10:07.184 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:10:07.184 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:10:07.184 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:10:07.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 -- 172.21.15.57:0/2376409613 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fefd409b480 msgr2=0x7fefd409d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:07.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fefd409b480 0x7fefd409d930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fefe4011550 tx=0x7fefe4009260 comp rx=0 tx=0).stop 2023-03-02T11:10:07.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 -- 172.21.15.57:0/2376409613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe8100480 msgr2=0x7fefe8072dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:07.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe8100480 0x7fefe8072dd0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009990 tx=0x7fefd8009580 comp rx=0 tx=0).stop 2023-03-02T11:10:07.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 -- 172.21.15.57:0/2376409613 shutdown_connections 2023-03-02T11:10:07.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fefd409b480 0x7fefd409d930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefe8105ae0 0x7fefe8073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefe80ffad0 0x7fefe8072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 --2- 172.21.15.57:0/2376409613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe8100480 0x7fefe8072dd0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:07.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 -- 172.21.15.57:0/2376409613 >> 172.21.15.57:0/2376409613 conn(0x7fefe80fb610 msgr2=0x7fefe80fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:07.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 -- 172.21.15.57:0/2376409613 shutdown_connections 2023-03-02T11:10:07.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:07.173+0000 7fefeffff700 1 -- 172.21.15.57:0/2376409613 wait complete. 2023-03-02T11:10:07.188 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:10:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:08 smithi136 ceph-mon[125702]: pgmap v408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:10:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:08 smithi057 ceph-mon[92072]: pgmap v408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:10:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:08 smithi122 ceph-mon[125440]: pgmap v408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:10:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:10 smithi136 ceph-mon[125702]: pgmap v409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:10:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:10 smithi057 ceph-mon[92072]: pgmap v409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:10:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:10 smithi122 ceph-mon[125440]: pgmap v409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:10:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:11 smithi136 ceph-mon[125702]: osdmap e100: 12 total, 12 up, 12 in 2023-03-02T11:10:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:11 smithi057 ceph-mon[92072]: osdmap e100: 12 total, 12 up, 12 in 2023-03-02T11:10:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:11 smithi122 ceph-mon[125440]: osdmap e100: 12 total, 12 up, 12 in 2023-03-02T11:10:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:12 smithi136 ceph-mon[125702]: pgmap v411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:10:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:12 smithi057 ceph-mon[92072]: pgmap v411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:10:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:12 smithi122 ceph-mon[125440]: pgmap v411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:10:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:14 smithi136 ceph-mon[125702]: pgmap v412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:10:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:14 smithi136 ceph-mon[125702]: osdmap e101: 12 total, 12 up, 12 in 2023-03-02T11:10:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:14 smithi057 ceph-mon[92072]: pgmap v412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:10:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:14 smithi057 ceph-mon[92072]: osdmap e101: 12 total, 12 up, 12 in 2023-03-02T11:10:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:14 smithi122 ceph-mon[125440]: pgmap v412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:10:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:14 smithi122 ceph-mon[125440]: osdmap e101: 12 total, 12 up, 12 in 2023-03-02T11:10:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:16 smithi136 ceph-mon[125702]: pgmap v414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:10:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:16 smithi057 ceph-mon[92072]: pgmap v414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:10:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:16 smithi122 ceph-mon[125440]: pgmap v414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:10:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:18 smithi136 ceph-mon[125702]: pgmap v415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:10:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:18 smithi057 ceph-mon[92072]: pgmap v415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:10:18.728 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:18 smithi122 ceph-mon[125440]: pgmap v415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:10:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:19.315+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:19.316+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:10:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:19.316+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:10:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:19.316+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:10:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:19.316+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:10:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:20 smithi136 ceph-mon[125702]: pgmap v416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T11:10:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:20 smithi057 ceph-mon[92072]: pgmap v416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T11:10:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:20 smithi122 ceph-mon[125440]: pgmap v416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T11:10:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:22 smithi136 ceph-mon[125702]: pgmap v417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:10:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:22 smithi057 ceph-mon[92072]: pgmap v417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:10:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:22 smithi122 ceph-mon[125440]: pgmap v417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:10:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:24 smithi136 ceph-mon[125702]: pgmap v418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:10:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:24 smithi057 ceph-mon[92072]: pgmap v418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:10:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:24 smithi122 ceph-mon[125440]: pgmap v418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:10:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:26 smithi136 ceph-mon[125702]: pgmap v419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:10:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:10:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:26 smithi057 ceph-mon[92072]: pgmap v419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:10:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:10:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:26 smithi122 ceph-mon[125440]: pgmap v419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:10:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:10:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:28 smithi057 ceph-mon[92072]: pgmap v420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:10:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:10:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:10:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:28 smithi122 ceph-mon[125440]: pgmap v420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:10:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:10:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:10:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:28 smithi136 ceph-mon[125702]: pgmap v420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:10:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:10:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:10:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:10:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:30 smithi057 ceph-mon[92072]: pgmap v421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:30 smithi122 ceph-mon[125440]: pgmap v421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:31.102 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:30 smithi136 ceph-mon[125702]: pgmap v421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:32 smithi057 ceph-mon[92072]: pgmap v422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:32 smithi122 ceph-mon[125440]: pgmap v422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:33.109 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:32 smithi136 ceph-mon[125702]: pgmap v422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:34.331+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:34.332+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:10:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:34.332+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:10:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:34.332+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:10:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:34.332+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:10:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:34 smithi057 ceph-mon[92072]: pgmap v423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:34 smithi122 ceph-mon[125440]: pgmap v423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:34 smithi136 ceph-mon[125702]: pgmap v423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:36 smithi057 ceph-mon[92072]: pgmap v424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:36 smithi122 ceph-mon[125440]: pgmap v424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:36 smithi136 ceph-mon[125702]: pgmap v424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:37.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:10:37.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.363+0000 7ff37cdff700 1 -- 172.21.15.57:0/2075244030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff378100c80 msgr2=0x7ff378101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.363+0000 7ff37cdff700 1 --2- 172.21.15.57:0/2075244030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff378100c80 0x7ff378101050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff368009990 tx=0x7ff368009ca0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.363+0000 7ff37cdff700 1 -- 172.21.15.57:0/2075244030 shutdown_connections 2023-03-02T11:10:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.363+0000 7ff37cdff700 1 --2- 172.21.15.57:0/2075244030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff37810a050 0x7ff37810c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.363+0000 7ff37cdff700 1 --2- 172.21.15.57:0/2075244030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff378100c80 0x7ff378101050 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.363+0000 7ff37cdff700 1 --2- 172.21.15.57:0/2075244030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff378101590 0x7ff378109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.363+0000 7ff37cdff700 1 -- 172.21.15.57:0/2075244030 >> 172.21.15.57:0/2075244030 conn(0x7ff3780fa4b0 msgr2=0x7ff3780fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.363+0000 7ff37cdff700 1 -- 172.21.15.57:0/2075244030 shutdown_connections 2023-03-02T11:10:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.363+0000 7ff37cdff700 1 -- 172.21.15.57:0/2075244030 wait complete. 2023-03-02T11:10:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.364+0000 7ff37cdff700 1 Processor -- start 2023-03-02T11:10:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff37cdff700 1 -- start start 2023-03-02T11:10:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff37cdff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff378100c80 0x7ff37819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff37cdff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff378101590 0x7ff37819bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff37cdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff37810a050 0x7ff378195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff37cdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781960c0 con 0x7ff37810a050 2023-03-02T11:10:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff37cdff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff378196230 con 0x7ff378101590 2023-03-02T11:10:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff37cdff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781963f0 con 0x7ff378100c80 2023-03-02T11:10:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff37659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff378100c80 0x7ff37819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff376d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff37810a050 0x7ff378195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff36dd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff378101590 0x7ff37819bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff376d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff37810a050 0x7ff378195a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55442/0 (socket says 172.21.15.57:55442) 2023-03-02T11:10:37.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff376d9d700 1 -- 172.21.15.57:0/2980357843 learned_addr learned my addr 172.21.15.57:0/2980357843 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:10:37.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.365+0000 7ff37659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff378100c80 0x7ff37819b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:57802/0 (socket says 172.21.15.57:57802) 2023-03-02T11:10:37.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.366+0000 7ff376d9d700 1 -- 172.21.15.57:0/2980357843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff378100c80 msgr2=0x7ff37819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:37.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.366+0000 7ff376d9d700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff378100c80 0x7ff37819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.366+0000 7ff376d9d700 1 -- 172.21.15.57:0/2980357843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff378101590 msgr2=0x7ff37819bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:37.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.366+0000 7ff376d9d700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff378101590 0x7ff37819bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.366+0000 7ff376d9d700 1 -- 172.21.15.57:0/2980357843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff370009c40 con 0x7ff37810a050 2023-03-02T11:10:37.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.366+0000 7ff376d9d700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff37810a050 0x7ff378195a50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff37000c370 tx=0x7ff37000c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:37.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.366+0000 7ff36ffff700 1 -- 172.21.15.57:0/2980357843 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370017070 con 0x7ff37810a050 2023-03-02T11:10:37.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.366+0000 7ff37cdff700 1 -- 172.21.15.57:0/2980357843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3680095f0 con 0x7ff37810a050 2023-03-02T11:10:37.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.366+0000 7ff36ffff700 1 -- 172.21.15.57:0/2980357843 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff37000f040 con 0x7ff37810a050 2023-03-02T11:10:37.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.366+0000 7ff36ffff700 1 -- 172.21.15.57:0/2980357843 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37000e050 con 0x7ff37810a050 2023-03-02T11:10:37.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.366+0000 7ff37cdff700 1 -- 172.21.15.57:0/2980357843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37810fac0 con 0x7ff37810a050 2023-03-02T11:10:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.369+0000 7ff36ffff700 1 -- 172.21.15.57:0/2980357843 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7ff370003a00 con 0x7ff37810a050 2023-03-02T11:10:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.370+0000 7ff36ffff700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff36409b480 0x7ff36409d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.370+0000 7ff36ffff700 1 -- 172.21.15.57:0/2980357843 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff3700c4c70 con 0x7ff37810a050 2023-03-02T11:10:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.370+0000 7ff37659c700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff36409b480 0x7ff36409d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.370+0000 7ff390754b80 1 Processor -- start 2023-03-02T11:10:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.370+0000 7ff390754b80 1 -- start start 2023-03-02T11:10:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.370+0000 7ff37659c700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff36409b480 0x7ff36409d930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff36800b2e0 tx=0x7ff368005960 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff390754b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed5ff3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff390754b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ff7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff390754b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ff8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff390754b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed5f56a60 con 0x55eed5ff37d0 2023-03-02T11:10:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff390754b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed5f08f80 con 0x55eed5ff8520 2023-03-02T11:10:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff390754b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed5ed9160 con 0x55eed5ff40e0 2023-03-02T11:10:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff376d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ff8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff37659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed5ff3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff36dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ff7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff376d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ff8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:37414/0 (socket says 172.21.15.57:37414) 2023-03-02T11:10:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff376d9d700 1 -- 172.21.15.57:0/857768279 learned_addr learned my addr 172.21.15.57:0/857768279 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:10:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff376d9d700 1 -- 172.21.15.57:0/857768279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 msgr2=0x55eed5ff7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff376d9d700 1 --2- 172.21.15.57:0/857768279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ff7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff376d9d700 1 -- 172.21.15.57:0/857768279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 msgr2=0x55eed5ff3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff376d9d700 1 --2- 172.21.15.57:0/857768279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed5ff3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff376d9d700 1 -- 172.21.15.57:0/857768279 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eed5dc3630 con 0x55eed5ff8520 2023-03-02T11:10:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.371+0000 7ff376d9d700 1 --2- 172.21.15.57:0/857768279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ff8970 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff370093dc0 tx=0x7ff370093aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c755b7ee7be99366 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff36cd99700 1 -- 172.21.15.57:0/857768279 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700947c0 con 0x55eed5ff8520 2023-03-02T11:10:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff36cd99700 1 -- 172.21.15.57:0/857768279 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3700a6e90 con 0x55eed5ff8520 2023-03-02T11:10:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff36cd99700 1 -- 172.21.15.57:0/857768279 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370004e10 con 0x55eed5ff8520 2023-03-02T11:10:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff390754b80 1 -- 172.21.15.57:0/857768279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 msgr2=0x55eed5ff8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff390754b80 1 --2- 172.21.15.57:0/857768279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ff8970 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff370093dc0 tx=0x7ff370093aa0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff390754b80 1 -- 172.21.15.57:0/857768279 shutdown_connections 2023-03-02T11:10:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff390754b80 1 --2- 172.21.15.57:0/857768279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ff8970 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff390754b80 1 --2- 172.21.15.57:0/857768279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed5ff3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff390754b80 1 --2- 172.21.15.57:0/857768279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ff7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff390754b80 1 -- 172.21.15.57:0/857768279 >> 172.21.15.57:0/857768279 conn(0x55eed5fe4c50 msgr2=0x55eed5fea460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff390754b80 1 -- 172.21.15.57:0/857768279 shutdown_connections 2023-03-02T11:10:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.372+0000 7ff390754b80 1 -- 172.21.15.57:0/857768279 wait complete. 2023-03-02T11:10:37.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.373+0000 7ff390754b80 1 -- start start 2023-03-02T11:10:37.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.373+0000 7ff390754b80 1 Processor -- start 2023-03-02T11:10:37.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.373+0000 7ff390754b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed5fffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.373+0000 7ff390754b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ffcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.373+0000 7ff390754b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ffd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.373+0000 7ff390754b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed5f47bc0 con 0x55eed5ff37d0 2023-03-02T11:10:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.373+0000 7ff390754b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed5f410f0 con 0x55eed5ff8520 2023-03-02T11:10:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.373+0000 7ff390754b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed5dc5920 con 0x55eed5ff40e0 2023-03-02T11:10:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.373+0000 7ff390754b80 10 client.0 _ll_register_callbacks cb 0x55eed5ee7520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:10:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff376d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ffd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff37659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed5fffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff36dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ffcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff376d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ffd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:37426/0 (socket says 172.21.15.57:37426) 2023-03-02T11:10:37.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff376d9d700 1 -- 172.21.15.57:0/2291083371 learned_addr learned my addr 172.21.15.57:0/2291083371 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:10:37.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff376d9d700 1 -- 172.21.15.57:0/2291083371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 msgr2=0x55eed5ffcf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:37.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff376d9d700 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ffcf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff376d9d700 1 -- 172.21.15.57:0/2291083371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 msgr2=0x55eed5fffc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:37.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff376d9d700 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed5fffc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff376d9d700 1 -- 172.21.15.57:0/2291083371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37810fac0 con 0x55eed5ff8520 2023-03-02T11:10:37.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff37659c700 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed5fffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:10:37.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff376d9d700 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ffd590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff370094050 tx=0x7ff3700937c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56f77e30c91eecf8 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:37.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff35dffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:10:37.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff35dffb700 1 -- 172.21.15.57:0/2291083371 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37009b7e0 con 0x55eed5ff8520 2023-03-02T11:10:37.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff35dffb700 1 -- 172.21.15.57:0/2291083371 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff370092460 con 0x55eed5ff8520 2023-03-02T11:10:37.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff390754b80 1 -- 172.21.15.57:0/2291083371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eed5f127b0 con 0x55eed5ff8520 2023-03-02T11:10:37.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.374+0000 7ff35dffb700 1 -- 172.21.15.57:0/2291083371 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3700bcdf0 con 0x55eed5ff8520 2023-03-02T11:10:37.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.375+0000 7ff390754b80 10 client.26423 fetch_fsmap learned FSMap version 47 2023-03-02T11:10:37.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.375+0000 7ff390754b80 1 -- 172.21.15.57:0/2291083371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55eed5d6fde0 con 0x55eed5ff8520 2023-03-02T11:10:37.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.375+0000 7ff35dffb700 1 -- 172.21.15.57:0/2291083371 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55eed5f127b0 con 0x55eed5ff8520 2023-03-02T11:10:37.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.375+0000 7ff35dffb700 1 -- 172.21.15.57:0/2291083371 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff37008feb0 con 0x55eed5ff8520 2023-03-02T11:10:37.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.375+0000 7ff390754b80 10 client.26423 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:10:37.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.375+0000 7ff390754b80 10 client.26423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:10:37.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.375+0000 7ff390754b80 20 client.26423 populate_metadata read hostname 'smithi057' 2023-03-02T11:10:37.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.375+0000 7ff390754b80 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55eed600d270 0x55eed600f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.375+0000 7ff390754b80 4 client.26423 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:10:37.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.375+0000 7ff390754b80 1 -- 172.21.15.57:0/2291083371 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eed5f3a170 con 0x55eed600d270 2023-03-02T11:10:37.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.375+0000 7ff37659c700 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55eed600d270 0x55eed600f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.376+0000 7ff37659c700 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55eed600d270 0x55eed600f680 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6b25f129638bb70 server_cookie=5ead4a630b29d2fa in_seq=0 out_seq=0 2023-03-02T11:10:37.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.376+0000 7ff35dffb700 10 client.26423 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:10:37.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.376+0000 7ff35dffb700 1 -- 172.21.15.57:0/2291083371 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55eed5f3a170 con 0x55eed600d270 2023-03-02T11:10:37.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.376+0000 7ff35dffb700 10 client.26423 handle_command_reply: tid=0 2023-03-02T11:10:37.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.376+0000 7ff390754b80 1 client.26423 shutdown 2023-03-02T11:10:37.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.376+0000 7ff390754b80 1 -- 172.21.15.57:0/2291083371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 msgr2=0x55eed5ffd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:37.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.376+0000 7ff390754b80 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ffd590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff370094050 tx=0x7ff3700937c0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.377+0000 7ff390754b80 1 -- 172.21.15.57:0/2291083371 shutdown_connections 2023-03-02T11:10:37.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.377+0000 7ff390754b80 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55eed600d270 0x55eed600f680 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.377+0000 7ff390754b80 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff8520 0x55eed5ffd590 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.377+0000 7ff390754b80 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed5fffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.377+0000 7ff390754b80 1 --2- 172.21.15.57:0/2291083371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ffcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.377+0000 7ff35dffb700 0 client.26423 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:10:37.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.377+0000 7ff390754b80 1 -- 172.21.15.57:0/2291083371 >> 172.21.15.57:0/2291083371 conn(0x55eed5fe4c50 msgr2=0x55eed5fe9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:37.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.377+0000 7ff390754b80 1 -- 172.21.15.57:0/2291083371 shutdown_connections 2023-03-02T11:10:37.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.377+0000 7ff390754b80 1 -- 172.21.15.57:0/2291083371 wait complete. 2023-03-02T11:10:37.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.377+0000 7ff390754b80 20 client.26423 trim_cache size 0 max 16384 2023-03-02T11:10:37.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.393+0000 7ff390754b80 1 Processor -- start 2023-03-02T11:10:37.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.393+0000 7ff390754b80 1 -- start start 2023-03-02T11:10:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff390754b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff37d0 0x55eed5fff830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff390754b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ffc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff390754b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff8520 0x55eed5ff74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff390754b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed5feafa0 con 0x55eed5ff8520 2023-03-02T11:10:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff390754b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed5fe47d0 con 0x55eed5ff37d0 2023-03-02T11:10:37.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff390754b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed5fe92a0 con 0x55eed5ff40e0 2023-03-02T11:10:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff37659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff37d0 0x55eed5fff830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff376d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff8520 0x55eed5ff74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff36dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ffc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff36dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ffc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:57832/0 (socket says 172.21.15.57:57832) 2023-03-02T11:10:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff37659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff37d0 0x55eed5fff830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:37436/0 (socket says 172.21.15.57:37436) 2023-03-02T11:10:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff36dd9b700 1 -- 172.21.15.57:0/2596151397 learned_addr learned my addr 172.21.15.57:0/2596151397 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:10:37.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff376d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff8520 0x55eed5ff74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55466/0 (socket says 172.21.15.57:55466) 2023-03-02T11:10:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff376d9d700 1 -- 172.21.15.57:0/2596151397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 msgr2=0x55eed5ffc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff376d9d700 1 --2- 172.21.15.57:0/2596151397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ffc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff376d9d700 1 -- 172.21.15.57:0/2596151397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff37d0 msgr2=0x55eed5fff830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff376d9d700 1 --2- 172.21.15.57:0/2596151397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff37d0 0x55eed5fff830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff376d9d700 1 -- 172.21.15.57:0/2596151397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eed5fe63f0 con 0x55eed5ff8520 2023-03-02T11:10:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff37659c700 1 --2- 172.21.15.57:0/2596151397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff37d0 0x55eed5fff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:10:37.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff376d9d700 1 --2- 172.21.15.57:0/2596151397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff8520 0x55eed5ff74b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff370093dc0 tx=0x7ff37000e1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da7e7f2be3c2e61 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff36d59a700 1 -- 172.21.15.57:0/2596151397 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700940c0 con 0x55eed5ff8520 2023-03-02T11:10:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff36d59a700 1 -- 172.21.15.57:0/2596151397 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff370094830 con 0x55eed5ff8520 2023-03-02T11:10:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.394+0000 7ff36d59a700 1 -- 172.21.15.57:0/2596151397 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37008feb0 con 0x55eed5ff8520 2023-03-02T11:10:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.395+0000 7ff390754b80 1 -- 172.21.15.57:0/2596151397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff8520 msgr2=0x55eed5ff74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.395+0000 7ff390754b80 1 --2- 172.21.15.57:0/2596151397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff8520 0x55eed5ff74b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff370093dc0 tx=0x7ff37000e1b0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.395+0000 7ff390754b80 1 -- 172.21.15.57:0/2596151397 shutdown_connections 2023-03-02T11:10:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.395+0000 7ff390754b80 1 --2- 172.21.15.57:0/2596151397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff8520 0x55eed5ff74b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.395+0000 7ff390754b80 1 --2- 172.21.15.57:0/2596151397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff37d0 0x55eed5fff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.395+0000 7ff390754b80 1 --2- 172.21.15.57:0/2596151397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff40e0 0x55eed5ffc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.395+0000 7ff390754b80 1 -- 172.21.15.57:0/2596151397 >> 172.21.15.57:0/2596151397 conn(0x55eed5fe4c50 msgr2=0x55eed6008bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.395+0000 7ff390754b80 1 -- 172.21.15.57:0/2596151397 shutdown_connections 2023-03-02T11:10:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.395+0000 7ff390754b80 1 -- 172.21.15.57:0/2596151397 wait complete. 2023-03-02T11:10:37.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.395+0000 7ff390754b80 1 -- start start 2023-03-02T11:10:37.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff390754b80 1 Processor -- start 2023-03-02T11:10:37.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff390754b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed6004270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff390754b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff40e0 0x55eed6000720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff390754b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff8520 0x55eed6000c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff390754b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed60011a0 con 0x55eed5ff37d0 2023-03-02T11:10:37.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff390754b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed6001310 con 0x55eed5ff40e0 2023-03-02T11:10:37.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff390754b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed6001480 con 0x55eed5ff8520 2023-03-02T11:10:37.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff390754b80 10 client.0 _ll_register_callbacks cb 0x55eed5ee7520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:10:37.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff37659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed6004270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff36dd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff40e0 0x55eed6000720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff37659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed6004270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55478/0 (socket says 172.21.15.57:55478) 2023-03-02T11:10:37.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff37659c700 1 -- 172.21.15.57:0/614309119 learned_addr learned my addr 172.21.15.57:0/614309119 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:10:37.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff36dd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff40e0 0x55eed6000720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:37452/0 (socket says 172.21.15.57:37452) 2023-03-02T11:10:37.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff376d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff8520 0x55eed6000c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff37659c700 1 -- 172.21.15.57:0/614309119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff8520 msgr2=0x55eed6000c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:37.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff37659c700 1 --2- 172.21.15.57:0/614309119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff8520 0x55eed6000c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff37659c700 1 -- 172.21.15.57:0/614309119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff40e0 msgr2=0x55eed6000720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:10:37.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff37659c700 1 --2- 172.21.15.57:0/614309119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff40e0 0x55eed6000720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.396+0000 7ff37659c700 1 -- 172.21.15.57:0/614309119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37810d150 con 0x55eed5ff37d0 2023-03-02T11:10:37.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff37659c700 1 --2- 172.21.15.57:0/614309119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed6004270 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff36800b8c0 tx=0x7ff368009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9a76581937ec4a server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:10:37.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff35dffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:10:37.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff35dffb700 1 -- 172.21.15.57:0/614309119 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36802d040 con 0x55eed5ff37d0 2023-03-02T11:10:37.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff35dffb700 1 -- 172.21.15.57:0/614309119 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8642+0+0 (secure 0 0 0) 0x7ff36802b050 con 0x55eed5ff37d0 2023-03-02T11:10:37.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff390754b80 1 -- 172.21.15.57:0/614309119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff3700a6e90 con 0x55eed5ff37d0 2023-03-02T11:10:37.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff35dffb700 1 -- 172.21.15.57:0/614309119 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff36800be50 con 0x55eed5ff37d0 2023-03-02T11:10:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff390754b80 10 client.16587 fetch_fsmap learned FSMap version 47 2023-03-02T11:10:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff390754b80 1 -- 172.21.15.57:0/614309119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55eed5d6fde0 con 0x55eed5ff37d0 2023-03-02T11:10:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff35dffb700 1 -- 172.21.15.57:0/614309119 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3700a6e90 con 0x55eed5ff37d0 2023-03-02T11:10:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff35dffb700 1 -- 172.21.15.57:0/614309119 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff36800f460 con 0x55eed5ff37d0 2023-03-02T11:10:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff390754b80 10 client.16587 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:10:37.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.397+0000 7ff390754b80 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:10:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 20 client.16587 populate_metadata read hostname 'smithi057' 2023-03-02T11:10:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 1 --2- 172.21.15.57:0/614309119 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55eed605fd90 0x55eed60621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:10:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 4 client.16587 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:10:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 1 -- 172.21.15.57:0/614309119 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55eed5f39e90 con 0x55eed605fd90 2023-03-02T11:10:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff36dd9b700 1 --2- 172.21.15.57:0/614309119 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55eed605fd90 0x55eed60621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff35dffb700 10 client.16587 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:10:37.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff36dd9b700 1 --2- 172.21.15.57:0/614309119 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55eed605fd90 0x55eed60621a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39ea73c1b7027ac9 server_cookie=da0cab9d037e6289 in_seq=0 out_seq=0 2023-03-02T11:10:37.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff35dffb700 1 -- 172.21.15.57:0/614309119 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55eed5f39e90 con 0x55eed605fd90 2023-03-02T11:10:37.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff35dffb700 10 client.16587 handle_command_reply: tid=0 2023-03-02T11:10:37.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 1 client.16587 shutdown 2023-03-02T11:10:37.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 1 -- 172.21.15.57:0/614309119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 msgr2=0x55eed6004270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:37.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 1 --2- 172.21.15.57:0/614309119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed6004270 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff36800b8c0 tx=0x7ff368009ca0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 1 -- 172.21.15.57:0/614309119 shutdown_connections 2023-03-02T11:10:37.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 1 --2- 172.21.15.57:0/614309119 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55eed605fd90 0x55eed60621a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 1 --2- 172.21.15.57:0/614309119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eed5ff8520 0x55eed6000c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff35dffb700 0 client.16587 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:10:37.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 1 --2- 172.21.15.57:0/614309119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eed5ff37d0 0x55eed6004270 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.398+0000 7ff390754b80 1 --2- 172.21.15.57:0/614309119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eed5ff40e0 0x55eed6000720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff390754b80 1 -- 172.21.15.57:0/614309119 >> 172.21.15.57:0/614309119 conn(0x55eed5fe4c50 msgr2=0x55eed5fe9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:37.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff390754b80 1 -- 172.21.15.57:0/614309119 shutdown_connections 2023-03-02T11:10:37.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff390754b80 1 -- 172.21.15.57:0/614309119 wait complete. 2023-03-02T11:10:37.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff390754b80 20 client.16587 trim_cache size 0 max 16384 2023-03-02T11:10:37.413 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:10:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:10:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:10:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:10:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:10:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:10:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:10:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:10:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:10:37.414 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:10:37.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 -- 172.21.15.57:0/2980357843 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff36409b480 msgr2=0x7ff36409d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:37.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff36409b480 0x7ff36409d930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff36800b2e0 tx=0x7ff368005960 comp rx=0 tx=0).stop 2023-03-02T11:10:37.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 -- 172.21.15.57:0/2980357843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff37810a050 msgr2=0x7ff378195a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:10:37.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff37810a050 0x7ff378195a50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff37000c370 tx=0x7ff37000c680 comp rx=0 tx=0).stop 2023-03-02T11:10:37.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 -- 172.21.15.57:0/2980357843 shutdown_connections 2023-03-02T11:10:37.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7ff36409b480 0x7ff36409d930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff37810a050 0x7ff378195a50 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff378100c80 0x7ff37819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 --2- 172.21.15.57:0/2980357843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff378101590 0x7ff37819bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:10:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 -- 172.21.15.57:0/2980357843 >> 172.21.15.57:0/2980357843 conn(0x7ff3780fa4b0 msgr2=0x7ff37810c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:10:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 -- 172.21.15.57:0/2980357843 shutdown_connections 2023-03-02T11:10:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:10:37.399+0000 7ff37cdff700 1 -- 172.21.15.57:0/2980357843 wait complete. 2023-03-02T11:10:37.417 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:10:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:38 smithi057 ceph-mon[92072]: pgmap v425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:38 smithi122 ceph-mon[125440]: pgmap v425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:38 smithi136 ceph-mon[125702]: pgmap v425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:40 smithi057 ceph-mon[92072]: pgmap v426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:40 smithi122 ceph-mon[125440]: pgmap v426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:40 smithi136 ceph-mon[125702]: pgmap v426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:42 smithi057 ceph-mon[92072]: pgmap v427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:42 smithi122 ceph-mon[125440]: pgmap v427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:42 smithi136 ceph-mon[125702]: pgmap v427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:44 smithi057 ceph-mon[92072]: pgmap v428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:44 smithi122 ceph-mon[125440]: pgmap v428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:44 smithi136 ceph-mon[125702]: pgmap v428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:45 smithi057 ceph-mon[92072]: pgmap v429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:45 smithi122 ceph-mon[125440]: pgmap v429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:45 smithi136 ceph-mon[125702]: pgmap v429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:47 smithi057 ceph-mon[92072]: pgmap v430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:47 smithi122 ceph-mon[125440]: pgmap v430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:47 smithi136 ceph-mon[125702]: pgmap v430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:49.343+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:10:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:49.343+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:10:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:49.343+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:10:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:49.343+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:10:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:10:49.343+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:10:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:49 smithi057 ceph-mon[92072]: pgmap v431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:49 smithi122 ceph-mon[125440]: pgmap v431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:49 smithi136 ceph-mon[125702]: pgmap v431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:51 smithi057 ceph-mon[92072]: pgmap v432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:51 smithi122 ceph-mon[125440]: pgmap v432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:51 smithi136 ceph-mon[125702]: pgmap v432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:53 smithi057 ceph-mon[92072]: pgmap v433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:53 smithi122 ceph-mon[125440]: pgmap v433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:53 smithi136 ceph-mon[125702]: pgmap v433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:55 smithi057 ceph-mon[92072]: pgmap v434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:55 smithi122 ceph-mon[125440]: pgmap v434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:55 smithi136 ceph-mon[125702]: pgmap v434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:10:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:57 smithi057 ceph-mon[92072]: pgmap v435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:57 smithi122 ceph-mon[125440]: pgmap v435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:10:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:57 smithi136 ceph-mon[125702]: pgmap v435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:10:59 smithi057 ceph-mon[92072]: pgmap v436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:10:59 smithi122 ceph-mon[125440]: pgmap v436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:10:59 smithi136 ceph-mon[125702]: pgmap v436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:01 smithi057 ceph-mon[92072]: pgmap v437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:01 smithi122 ceph-mon[125440]: pgmap v437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:01 smithi136 ceph-mon[125702]: pgmap v437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:03 smithi057 ceph-mon[92072]: pgmap v438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:11:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:03 smithi122 ceph-mon[125440]: pgmap v438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:11:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:03 smithi136 ceph-mon[125702]: pgmap v438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:11:04.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:04.351+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:04.351+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:11:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:04.351+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:11:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:04.351+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:11:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:04.351+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:11:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:05 smithi057 ceph-mon[92072]: pgmap v439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:11:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:05 smithi122 ceph-mon[125440]: pgmap v439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:11:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:05 smithi136 ceph-mon[125702]: pgmap v439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:11:07.419 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:11:07.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.590+0000 7fda00bff700 1 -- 172.21.15.57:0/65790943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9fc0ffad0 msgr2=0x7fd9fc0fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:07.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.590+0000 7fda00bff700 1 --2- 172.21.15.57:0/65790943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9fc0ffad0 0x7fd9fc0fff40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009990 tx=0x7fd9f0009ca0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.590+0000 7fda00bff700 1 -- 172.21.15.57:0/65790943 shutdown_connections 2023-03-02T11:11:07.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.590+0000 7fda00bff700 1 --2- 172.21.15.57:0/65790943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc100480 0x7fd9fc10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.590+0000 7fda00bff700 1 --2- 172.21.15.57:0/65790943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9fc105ae0 0x7fd9fc105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.590+0000 7fda00bff700 1 --2- 172.21.15.57:0/65790943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9fc0ffad0 0x7fd9fc0fff40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.590+0000 7fda00bff700 1 -- 172.21.15.57:0/65790943 >> 172.21.15.57:0/65790943 conn(0x7fd9fc0fb610 msgr2=0x7fd9fc0fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.590+0000 7fda00bff700 1 -- 172.21.15.57:0/65790943 shutdown_connections 2023-03-02T11:11:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.590+0000 7fda00bff700 1 -- 172.21.15.57:0/65790943 wait complete. 2023-03-02T11:11:07.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fda00bff700 1 Processor -- start 2023-03-02T11:11:07.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fda00bff700 1 -- start start 2023-03-02T11:11:07.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fda00bff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9fc0ffad0 0x7fd9fc19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fda00bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9fc100480 0x7fd9fc19bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fda00bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc105ae0 0x7fd9fc195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fda00bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1960b0 con 0x7fd9fc105ae0 2023-03-02T11:11:07.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fda00bff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc196220 con 0x7fd9fc0ffad0 2023-03-02T11:11:07.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fda00bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1963e0 con 0x7fd9fc100480 2023-03-02T11:11:07.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fd9fa59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9fc0ffad0 0x7fd9fc19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fd9f9d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9fc100480 0x7fd9fc19bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fd9fa59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9fc0ffad0 0x7fd9fc19b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:44218/0 (socket says 172.21.15.57:44218) 2023-03-02T11:11:07.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3994665081 learned_addr learned my addr 172.21.15.57:0/3994665081 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:11:07.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.591+0000 7fd9fad9d700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc105ae0 0x7fd9fc195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3994665081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9fc100480 msgr2=0x7fd9fc19bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:07.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9fc100480 0x7fd9fc19bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3994665081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc105ae0 msgr2=0x7fd9fc195a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:07.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc105ae0 0x7fd9fc195a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3994665081 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f00095f0 con 0x7fd9fc0ffad0 2023-03-02T11:11:07.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fd9fad9d700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc105ae0 0x7fd9fc195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:11:07.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9fc0ffad0 0x7fd9fc19b9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00e9a0 tx=0x7fd9ec00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:07.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fd9eb7fe700 1 -- 172.21.15.57:0/3994665081 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec009790 con 0x7fd9fc0ffad0 2023-03-02T11:11:07.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fda00bff700 1 -- 172.21.15.57:0/3994665081 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc10fbc0 con 0x7fd9fc0ffad0 2023-03-02T11:11:07.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fd9eb7fe700 1 -- 172.21.15.57:0/3994665081 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9ec010430 con 0x7fd9fc0ffad0 2023-03-02T11:11:07.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fd9eb7fe700 1 -- 172.21.15.57:0/3994665081 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec018680 con 0x7fd9fc0ffad0 2023-03-02T11:11:07.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.592+0000 7fda00bff700 1 -- 172.21.15.57:0/3994665081 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc10fa30 con 0x7fd9fc0ffad0 2023-03-02T11:11:07.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.596+0000 7fd9eb7fe700 1 -- 172.21.15.57:0/3994665081 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fd9ec00c040 con 0x7fd9fc0ffad0 2023-03-02T11:11:07.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fda1453ab80 1 Processor -- start 2023-03-02T11:11:07.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fda1453ab80 1 -- start start 2023-03-02T11:11:07.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fd9eb7fe700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd9e409f890 0x7fd9e40a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fd9eb7fe700 1 -- 172.21.15.57:0/3994665081 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fd9ec014070 con 0x7fd9fc0ffad0 2023-03-02T11:11:07.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60d6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 0x55c2a60db3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60db920 0x55c2a60dbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fda1453ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a6035a60 con 0x55c2a60d6bd0 2023-03-02T11:11:07.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fda1453ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a5fe7f80 con 0x55c2a60d74e0 2023-03-02T11:11:07.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fda1453ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a5fb8160 con 0x55c2a60db920 2023-03-02T11:11:07.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fd9fad9d700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd9e409f890 0x7fd9e40a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fd9fa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60d6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fd9f9d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 0x55c2a60db3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fd9f9d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 0x55c2a60db3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:44222/0 (socket says 172.21.15.57:44222) 2023-03-02T11:11:07.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.597+0000 7fd9f9d9b700 1 -- 172.21.15.57:0/2057362548 learned_addr learned my addr 172.21.15.57:0/2057362548 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:11:07.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.598+0000 7fd9f9d9b700 1 -- 172.21.15.57:0/2057362548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60db920 msgr2=0x55c2a60dbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:07.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.598+0000 7fd9f9d9b700 1 --2- 172.21.15.57:0/2057362548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60db920 0x55c2a60dbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.598+0000 7fd9f9d9b700 1 -- 172.21.15.57:0/2057362548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 msgr2=0x55c2a60d6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:07.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.598+0000 7fd9f9d9b700 1 --2- 172.21.15.57:0/2057362548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60d6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.598+0000 7fd9f9d9b700 1 -- 172.21.15.57:0/2057362548 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2a5ea2630 con 0x55c2a60d74e0 2023-03-02T11:11:07.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.598+0000 7fd9fad9d700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd9e409f890 0x7fd9e40a1d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc19c6d0 tx=0x7fd9f4009920 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:07.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.598+0000 7fd9f9d9b700 1 --2- 172.21.15.57:0/2057362548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 0x55c2a60db3e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0015000 tx=0x7fd9f0005ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec1eb277f636c306 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:07.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.598+0000 7fd9e8ff9700 1 -- 172.21.15.57:0/2057362548 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f001d070 con 0x55c2a60d74e0 2023-03-02T11:11:07.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.598+0000 7fd9e8ff9700 1 -- 172.21.15.57:0/2057362548 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9f001e040 con 0x55c2a60d74e0 2023-03-02T11:11:07.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.598+0000 7fd9e8ff9700 1 -- 172.21.15.57:0/2057362548 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0004760 con 0x55c2a60d74e0 2023-03-02T11:11:07.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.599+0000 7fda1453ab80 1 -- 172.21.15.57:0/2057362548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 msgr2=0x55c2a60db3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:07.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.599+0000 7fda1453ab80 1 --2- 172.21.15.57:0/2057362548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 0x55c2a60db3e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0015000 tx=0x7fd9f0005ea0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.599+0000 7fda1453ab80 1 -- 172.21.15.57:0/2057362548 shutdown_connections 2023-03-02T11:11:07.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.599+0000 7fda1453ab80 1 --2- 172.21.15.57:0/2057362548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60db920 0x55c2a60dbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.599+0000 7fda1453ab80 1 --2- 172.21.15.57:0/2057362548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60d6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.599+0000 7fda1453ab80 1 --2- 172.21.15.57:0/2057362548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 0x55c2a60db3e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.599+0000 7fda1453ab80 1 -- 172.21.15.57:0/2057362548 >> 172.21.15.57:0/2057362548 conn(0x55c2a60c3c50 msgr2=0x55c2a60c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:07.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.599+0000 7fda1453ab80 1 -- 172.21.15.57:0/2057362548 shutdown_connections 2023-03-02T11:11:07.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.599+0000 7fda1453ab80 1 -- 172.21.15.57:0/2057362548 wait complete. 2023-03-02T11:11:07.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.599+0000 7fda1453ab80 1 -- start start 2023-03-02T11:11:07.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.599+0000 7fda1453ab80 1 Processor -- start 2023-03-02T11:11:07.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d74e0 0x55c2a60e03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60db920 0x55c2a60e0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fda1453ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a6026bc0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fda1453ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a60200f0 con 0x55c2a60db920 2023-03-02T11:11:07.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fda1453ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a5ea4920 con 0x55c2a60d74e0 2023-03-02T11:11:07.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fda1453ab80 10 client.0 _ll_register_callbacks cb 0x55c2a5fc6520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:11:07.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fd9fa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fd9f9d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d74e0 0x55c2a60e03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fd9fa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56276/0 (socket says 172.21.15.57:56276) 2023-03-02T11:11:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3424119882 learned_addr learned my addr 172.21.15.57:0/3424119882 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:11:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fd9fad9d700 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60db920 0x55c2a60e0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3424119882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d74e0 msgr2=0x55c2a60e03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d74e0 0x55c2a60e03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3424119882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60db920 msgr2=0x55c2a60e0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60db920 0x55c2a60e0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.600+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3424119882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc10d210 con 0x55c2a60d6bd0 2023-03-02T11:11:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e3130 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec091160 tx=0x7fd9ec094c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0a8a6969e382b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fd9e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:11:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3424119882 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec094df0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3424119882 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fd9ec0946f0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fda1453ab80 1 -- 172.21.15.57:0/3424119882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2a5ff17b0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3424119882 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9ec09be10 con 0x55c2a60d6bd0 2023-03-02T11:11:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fda1453ab80 10 client.16599 fetch_fsmap learned FSMap version 47 2023-03-02T11:11:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fda1453ab80 1 -- 172.21.15.57:0/3424119882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55c2a5e4ede0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3424119882 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c2a5ff17b0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3424119882 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd9ec0bf020 con 0x55c2a60d6bd0 2023-03-02T11:11:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fda1453ab80 10 client.16599 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:11:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fda1453ab80 10 client.16599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:11:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fda1453ab80 20 client.16599 populate_metadata read hostname 'smithi057' 2023-03-02T11:11:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55c2a60f0a50 0x55c2a60f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fda1453ab80 4 client.16599 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:11:07.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.601+0000 7fda1453ab80 1 -- 172.21.15.57:0/3424119882 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2a6019170 con 0x55c2a60f0a50 2023-03-02T11:11:07.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.602+0000 7fd9f9d9b700 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55c2a60f0a50 0x55c2a60f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.602+0000 7fd9e1ffb700 10 client.16599 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:11:07.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.602+0000 7fd9f9d9b700 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55c2a60f0a50 0x55c2a60f2e60 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=789ead1a10741b7c server_cookie=ad9eb99768dceb93 in_seq=0 out_seq=0 2023-03-02T11:11:07.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3424119882 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55c2a6019170 con 0x55c2a60f0a50 2023-03-02T11:11:07.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fd9e1ffb700 10 client.16599 handle_command_reply: tid=0 2023-03-02T11:11:07.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fda1453ab80 1 client.16599 shutdown 2023-03-02T11:11:07.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fda1453ab80 1 -- 172.21.15.57:0/3424119882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 msgr2=0x55c2a60e3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:07.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e3130 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec091160 tx=0x7fd9ec094c30 comp rx=0 tx=0).stop 2023-03-02T11:11:07.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fda1453ab80 1 -- 172.21.15.57:0/3424119882 shutdown_connections 2023-03-02T11:11:07.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55c2a60f0a50 0x55c2a60f2e60 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60db920 0x55c2a60e0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fd9e1ffb700 0 client.16599 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:11:07.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e3130 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3424119882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d74e0 0x55c2a60e03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fda1453ab80 1 -- 172.21.15.57:0/3424119882 >> 172.21.15.57:0/3424119882 conn(0x55c2a60c3c50 msgr2=0x55c2a60c9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:07.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fda1453ab80 1 -- 172.21.15.57:0/3424119882 shutdown_connections 2023-03-02T11:11:07.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.603+0000 7fda1453ab80 1 -- 172.21.15.57:0/3424119882 wait complete. 2023-03-02T11:11:07.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.604+0000 7fda1453ab80 20 client.16599 trim_cache size 0 max 16384 2023-03-02T11:11:07.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fda1453ab80 1 Processor -- start 2023-03-02T11:11:07.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fda1453ab80 1 -- start start 2023-03-02T11:11:07.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d74e0 0x55c2a60dfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60db920 0x55c2a60e0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fda1453ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a60f7a50 con 0x55c2a60d6bd0 2023-03-02T11:11:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fda1453ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a60e06d0 con 0x55c2a60db920 2023-03-02T11:11:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fda1453ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a60e10a0 con 0x55c2a60d74e0 2023-03-02T11:11:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fd9fa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fd9f9d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d74e0 0x55c2a60dfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fd9fa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56280/0 (socket says 172.21.15.57:56280) 2023-03-02T11:11:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fd9f9d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d74e0 0x55c2a60dfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:57816/0 (socket says 172.21.15.57:57816) 2023-03-02T11:11:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fd9fa59c700 1 -- 172.21.15.57:0/2446836915 learned_addr learned my addr 172.21.15.57:0/2446836915 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:11:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.620+0000 7fd9fad9d700 1 --2- 172.21.15.57:0/2446836915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60db920 0x55c2a60e0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fd9fa59c700 1 -- 172.21.15.57:0/2446836915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d74e0 msgr2=0x55c2a60dfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/2446836915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d74e0 0x55c2a60dfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fd9fa59c700 1 -- 172.21.15.57:0/2446836915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60db920 msgr2=0x55c2a60e0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/2446836915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60db920 0x55c2a60e0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fd9fa59c700 1 -- 172.21.15.57:0/2446836915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2a5fe7190 con 0x55c2a60d6bd0 2023-03-02T11:11:07.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/2446836915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e2c60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec009230 tx=0x7fd9ec093ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a416f8592fcf044 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:07.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fd9e97fa700 1 -- 172.21.15.57:0/2446836915 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec094df0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fd9e97fa700 1 -- 172.21.15.57:0/2446836915 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9ec0946f0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fd9e97fa700 1 -- 172.21.15.57:0/2446836915 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec09bbe0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fda1453ab80 1 -- 172.21.15.57:0/2446836915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 msgr2=0x55c2a60e2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:07.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fda1453ab80 1 --2- 172.21.15.57:0/2446836915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e2c60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec009230 tx=0x7fd9ec093ec0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fda1453ab80 1 -- 172.21.15.57:0/2446836915 shutdown_connections 2023-03-02T11:11:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fda1453ab80 1 --2- 172.21.15.57:0/2446836915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60db920 0x55c2a60e0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fda1453ab80 1 --2- 172.21.15.57:0/2446836915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e2c60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fda1453ab80 1 --2- 172.21.15.57:0/2446836915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d74e0 0x55c2a60dfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.621+0000 7fda1453ab80 1 -- 172.21.15.57:0/2446836915 >> 172.21.15.57:0/2446836915 conn(0x55c2a60c3c50 msgr2=0x55c2a60ebf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fda1453ab80 1 -- 172.21.15.57:0/2446836915 shutdown_connections 2023-03-02T11:11:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fda1453ab80 1 -- 172.21.15.57:0/2446836915 wait complete. 2023-03-02T11:11:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fda1453ab80 1 -- start start 2023-03-02T11:11:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fda1453ab80 1 Processor -- start 2023-03-02T11:11:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 0x55c2a60e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fda1453ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60db920 0x55c2a60e60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fda1453ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a60e67a0 con 0x55c2a60db920 2023-03-02T11:11:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fda1453ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a60e6910 con 0x55c2a60d74e0 2023-03-02T11:11:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fda1453ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a6142310 con 0x55c2a60d6bd0 2023-03-02T11:11:07.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fda1453ab80 10 client.0 _ll_register_callbacks cb 0x55c2a5fc6520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:11:07.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fd9fa59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fd9fad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60db920 0x55c2a60e60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fd9fa59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:57824/0 (socket says 172.21.15.57:57824) 2023-03-02T11:11:07.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fd9f9d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 0x55c2a60e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.622+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3259224021 learned_addr learned my addr 172.21.15.57:0/3259224021 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:11:07.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3259224021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 msgr2=0x55c2a60e5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:07.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 0x55c2a60e5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3259224021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60db920 msgr2=0x55c2a60e60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:07.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60db920 0x55c2a60e60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fd9fa59c700 1 -- 172.21.15.57:0/3259224021 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2a5e4ede0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fd9f9d9b700 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 0x55c2a60e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:11:07.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fd9fa59c700 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e7860 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00e970 tx=0x7fd9ec0944c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf08aa91a7ccd559 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:07.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fd9e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:11:07.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3259224021 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec0906e0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3259224021 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fd9ec090840 con 0x55c2a60d6bd0 2023-03-02T11:11:07.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fda1453ab80 1 -- 172.21.15.57:0/3259224021 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9f001e040 con 0x55c2a60d6bd0 2023-03-02T11:11:07.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3259224021 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9ec094df0 con 0x55c2a60d6bd0 2023-03-02T11:11:07.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.623+0000 7fda1453ab80 10 client.26395 fetch_fsmap learned FSMap version 47 2023-03-02T11:11:07.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.624+0000 7fda1453ab80 1 -- 172.21.15.57:0/3259224021 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55c2a5e75250 con 0x55c2a60d6bd0 2023-03-02T11:11:07.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.624+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3259224021 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9f001e040 con 0x55c2a60d6bd0 2023-03-02T11:11:07.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.624+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3259224021 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd9ec07b030 con 0x55c2a60d6bd0 2023-03-02T11:11:07.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.624+0000 7fda1453ab80 10 client.26395 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:11:07.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.624+0000 7fda1453ab80 10 client.26395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:11:07.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.624+0000 7fda1453ab80 20 client.26395 populate_metadata read hostname 'smithi057' 2023-03-02T11:11:07.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.624+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55c2a61434a0 0x55c2a6145880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:07.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.624+0000 7fda1453ab80 4 client.26395 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:11:07.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.624+0000 7fda1453ab80 1 -- 172.21.15.57:0/3259224021 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c2a6018e90 con 0x55c2a61434a0 2023-03-02T11:11:07.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.624+0000 7fd9f9d9b700 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55c2a61434a0 0x55c2a6145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:07.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fd9e1ffb700 10 client.26395 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:11:07.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fd9f9d9b700 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55c2a61434a0 0x55c2a6145880 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a4cd00a08a9ef94 server_cookie=91987d619e3f8392 in_seq=0 out_seq=0 2023-03-02T11:11:07.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fd9e1ffb700 1 -- 172.21.15.57:0/3259224021 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c2a6018e90 con 0x55c2a61434a0 2023-03-02T11:11:07.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fd9e1ffb700 10 client.26395 handle_command_reply: tid=0 2023-03-02T11:11:07.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 1 client.26395 shutdown 2023-03-02T11:11:07.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 1 -- 172.21.15.57:0/3259224021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d6bd0 msgr2=0x55c2a60e7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:07.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e7860 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00e970 tx=0x7fd9ec0944c0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 1 -- 172.21.15.57:0/3259224021 shutdown_connections 2023-03-02T11:11:07.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55c2a61434a0 0x55c2a6145880 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c2a60db920 0x55c2a60e60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2a60d6bd0 0x55c2a60e7860 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 1 --2- 172.21.15.57:0/3259224021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c2a60d74e0 0x55c2a60e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fd9e1ffb700 0 client.26395 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:11:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 1 -- 172.21.15.57:0/3259224021 >> 172.21.15.57:0/3259224021 conn(0x55c2a60c3c50 msgr2=0x55c2a60cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 1 -- 172.21.15.57:0/3259224021 shutdown_connections 2023-03-02T11:11:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 1 -- 172.21.15.57:0/3259224021 wait complete. 2023-03-02T11:11:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.625+0000 7fda1453ab80 20 client.26395 trim_cache size 0 max 16384 2023-03-02T11:11:07.642 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:11:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:11:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:11:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:11:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:11:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:11:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:11:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:11:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:11:07.645 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:11:07.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 -- 172.21.15.57:0/3994665081 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd9e409f890 msgr2=0x7fd9e40a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:07.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd9e409f890 0x7fd9e40a1d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc19c6d0 tx=0x7fd9f4009920 comp rx=0 tx=0).stop 2023-03-02T11:11:07.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 -- 172.21.15.57:0/3994665081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9fc0ffad0 msgr2=0x7fd9fc19b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9fc0ffad0 0x7fd9fc19b9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00e9a0 tx=0x7fd9ec00ecb0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 -- 172.21.15.57:0/3994665081 shutdown_connections 2023-03-02T11:11:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fd9e409f890 0x7fd9e40a1d40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc105ae0 0x7fd9fc195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9fc0ffad0 0x7fd9fc19b9d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 --2- 172.21.15.57:0/3994665081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9fc100480 0x7fd9fc19bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:07.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 -- 172.21.15.57:0/3994665081 >> 172.21.15.57:0/3994665081 conn(0x7fd9fc0fb610 msgr2=0x7fd9fc1035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:07.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 -- 172.21.15.57:0/3994665081 shutdown_connections 2023-03-02T11:11:07.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:07.626+0000 7fda00bff700 1 -- 172.21.15.57:0/3994665081 wait complete. 2023-03-02T11:11:07.654 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:11:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:07 smithi057 ceph-mon[92072]: pgmap v440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:11:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:07 smithi122 ceph-mon[125440]: pgmap v440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:11:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:07 smithi136 ceph-mon[125702]: pgmap v440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:11:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:08.464+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006080 con 0x7f5880105ae0 2023-03-02T11:11:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:08.464+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006080 con 0x7f5880105ae0 2023-03-02T11:11:08.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:08.488+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850005fb0 con 0x558558b6f6b0 2023-03-02T11:11:08.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:08.488+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850005fb0 con 0x558558b6f6b0 2023-03-02T11:11:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:09 smithi122 ceph-mon[125440]: pgmap v441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:11:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:09 smithi136 ceph-mon[125702]: pgmap v441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:11:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:09 smithi057 ceph-mon[92072]: pgmap v441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:11:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:11 smithi122 ceph-mon[125440]: pgmap v442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:11:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:11 smithi122 ceph-mon[125440]: osdmap e102: 12 total, 12 up, 12 in 2023-03-02T11:11:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:11 smithi136 ceph-mon[125702]: pgmap v442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:11:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:11 smithi136 ceph-mon[125702]: osdmap e102: 12 total, 12 up, 12 in 2023-03-02T11:11:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:11 smithi057 ceph-mon[92072]: pgmap v442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:11:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:11 smithi057 ceph-mon[92072]: osdmap e102: 12 total, 12 up, 12 in 2023-03-02T11:11:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:13 smithi122 ceph-mon[125440]: pgmap v444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:11:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:13 smithi122 ceph-mon[125440]: osdmap e103: 12 total, 12 up, 12 in 2023-03-02T11:11:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:13 smithi136 ceph-mon[125702]: pgmap v444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:11:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:13 smithi136 ceph-mon[125702]: osdmap e103: 12 total, 12 up, 12 in 2023-03-02T11:11:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:13 smithi057 ceph-mon[92072]: pgmap v444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:11:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:13 smithi057 ceph-mon[92072]: osdmap e103: 12 total, 12 up, 12 in 2023-03-02T11:11:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:15 smithi136 ceph-mon[125702]: pgmap v446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:11:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:15 smithi057 ceph-mon[92072]: pgmap v446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:11:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:15 smithi122 ceph-mon[125440]: pgmap v446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:11:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:17 smithi136 ceph-mon[125702]: pgmap v447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:11:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:17 smithi057 ceph-mon[92072]: pgmap v447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:11:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:17 smithi122 ceph-mon[125440]: pgmap v447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:11:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:19.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:19.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:11:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:19.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:11:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:19.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:11:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:19.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:11:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:19 smithi136 ceph-mon[125702]: pgmap v448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:11:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:19 smithi057 ceph-mon[92072]: pgmap v448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:11:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:19 smithi122 ceph-mon[125440]: pgmap v448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:11:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:21 smithi136 ceph-mon[125702]: pgmap v449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T11:11:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:21 smithi057 ceph-mon[92072]: pgmap v449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T11:11:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:21 smithi122 ceph-mon[125440]: pgmap v449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T11:11:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:23 smithi136 ceph-mon[125702]: pgmap v450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:11:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:23 smithi057 ceph-mon[92072]: pgmap v450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:11:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:23 smithi122 ceph-mon[125440]: pgmap v450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:11:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:25 smithi136 ceph-mon[125702]: pgmap v451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:11:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:25 smithi057 ceph-mon[92072]: pgmap v451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:11:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:25 smithi122 ceph-mon[125440]: pgmap v451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:11:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:28 smithi136 ceph-mon[125702]: pgmap v452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:11:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:28 smithi057 ceph-mon[92072]: pgmap v452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:11:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:28 smithi122 ceph-mon[125440]: pgmap v452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:11:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:11:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:11:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:11:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:30 smithi136 ceph-mon[125702]: pgmap v453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:11:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:11:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:11:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:30 smithi057 ceph-mon[92072]: pgmap v453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:11:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:11:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:11:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:30 smithi122 ceph-mon[125440]: pgmap v453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:11:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:11:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:11:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:32 smithi136 ceph-mon[125702]: pgmap v454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:32 smithi057 ceph-mon[92072]: pgmap v454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:32 smithi122 ceph-mon[125440]: pgmap v454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:34 smithi136 ceph-mon[125702]: pgmap v455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:34.375+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:34.375+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:11:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:34.375+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:11:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:34.375+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:11:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:34.375+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:11:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:34 smithi057 ceph-mon[92072]: pgmap v455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:34 smithi122 ceph-mon[125440]: pgmap v455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:36 smithi136 ceph-mon[125702]: pgmap v456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:36 smithi057 ceph-mon[92072]: pgmap v456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:36 smithi122 ceph-mon[125440]: pgmap v456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:37.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:11:37.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.826+0000 7fae93dff700 1 -- 172.21.15.57:0/482699682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae8c0ff360 msgr2=0x7fae8c10b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:37.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.826+0000 7fae93dff700 1 --2- 172.21.15.57:0/482699682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae8c0ff360 0x7fae8c10b7f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fae84009f90 tx=0x7fae8400b330 comp rx=0 tx=0).stop 2023-03-02T11:11:37.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.826+0000 7fae93dff700 1 -- 172.21.15.57:0/482699682 shutdown_connections 2023-03-02T11:11:37.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.826+0000 7fae93dff700 1 --2- 172.21.15.57:0/482699682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae8c0ff360 0x7fae8c10b7f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.826+0000 7fae93dff700 1 --2- 172.21.15.57:0/482699682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae8c1049c0 0x7fae8c104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.826+0000 7fae93dff700 1 --2- 172.21.15.57:0/482699682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae8c0fe9b0 0x7fae8c0fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.826+0000 7fae93dff700 1 -- 172.21.15.57:0/482699682 >> 172.21.15.57:0/482699682 conn(0x7fae8c0fa4b0 msgr2=0x7fae8c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:37.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.826+0000 7fae93dff700 1 -- 172.21.15.57:0/482699682 shutdown_connections 2023-03-02T11:11:37.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.826+0000 7fae93dff700 1 -- 172.21.15.57:0/482699682 wait complete. 2023-03-02T11:11:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.827+0000 7fae93dff700 1 Processor -- start 2023-03-02T11:11:37.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.827+0000 7fae93dff700 1 -- start start 2023-03-02T11:11:37.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.827+0000 7fae93dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae8c0fe9b0 0x7fae8c19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.827+0000 7fae93dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae8c0ff360 0x7fae8c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.827+0000 7fae93dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae8c1049c0 0x7fae8c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.827+0000 7fae93dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c196140 con 0x7fae8c1049c0 2023-03-02T11:11:37.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.827+0000 7fae93dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c1962b0 con 0x7fae8c0ff360 2023-03-02T11:11:37.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.827+0000 7fae93dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c196470 con 0x7fae8c0fe9b0 2023-03-02T11:11:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae91b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae8c0fe9b0 0x7fae8c19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae91b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae8c0fe9b0 0x7fae8c19ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:50230/0 (socket says 172.21.15.57:50230) 2023-03-02T11:11:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae91b9b700 1 -- 172.21.15.57:0/445427083 learned_addr learned my addr 172.21.15.57:0/445427083 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:11:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae9139a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae8c0ff360 0x7fae8c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae9239c700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae8c1049c0 0x7fae8c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae91b9b700 1 -- 172.21.15.57:0/445427083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae8c0ff360 msgr2=0x7fae8c19bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae91b9b700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae8c0ff360 0x7fae8c19bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae91b9b700 1 -- 172.21.15.57:0/445427083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae8c1049c0 msgr2=0x7fae8c195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:37.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae91b9b700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae8c1049c0 0x7fae8c195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae91b9b700 1 -- 172.21.15.57:0/445427083 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae84009c40 con 0x7fae8c0fe9b0 2023-03-02T11:11:37.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae9139a700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae8c0ff360 0x7fae8c19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:11:37.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae91b9b700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae8c0fe9b0 0x7fae8c19ba60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae8800e9f0 tx=0x7fae8800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:37.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae82ffd700 1 -- 172.21.15.57:0/445427083 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88004220 con 0x7fae8c0fe9b0 2023-03-02T11:11:37.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.828+0000 7fae93dff700 1 -- 172.21.15.57:0/445427083 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c10e9f0 con 0x7fae8c0fe9b0 2023-03-02T11:11:37.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.829+0000 7fae82ffd700 1 -- 172.21.15.57:0/445427083 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae88004380 con 0x7fae8c0fe9b0 2023-03-02T11:11:37.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.829+0000 7fae82ffd700 1 -- 172.21.15.57:0/445427083 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88003be0 con 0x7fae8c0fe9b0 2023-03-02T11:11:37.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.829+0000 7fae93dff700 1 -- 172.21.15.57:0/445427083 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c10e860 con 0x7fae8c0fe9b0 2023-03-02T11:11:37.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.831+0000 7fae82ffd700 1 -- 172.21.15.57:0/445427083 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fae8801e020 con 0x7fae8c0fe9b0 2023-03-02T11:11:37.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.832+0000 7faea7709b80 1 Processor -- start 2023-03-02T11:11:37.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.832+0000 7fae82ffd700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fae7809b480 0x7fae7809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.832+0000 7faea7709b80 1 -- start start 2023-03-02T11:11:37.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.832+0000 7fae82ffd700 1 -- 172.21.15.57:0/445427083 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fae88014070 con 0x7fae8c0fe9b0 2023-03-02T11:11:37.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.832+0000 7fae9139a700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fae7809b480 0x7fae7809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7faea7709b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 0x55b21ebd3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7faea7709b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd40e0 0x55b21ebd7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7faea7709b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd8520 0x55b21ebd8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7faea7709b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21eb36a60 con 0x55b21ebd40e0 2023-03-02T11:11:37.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7faea7709b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21eae8f80 con 0x55b21ebd8520 2023-03-02T11:11:37.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7faea7709b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21eab9160 con 0x55b21ebd37d0 2023-03-02T11:11:37.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae91b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 0x55b21ebd3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae91b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 0x55b21ebd3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:50236/0 (socket says 172.21.15.57:50236) 2023-03-02T11:11:37.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae91b9b700 1 -- 172.21.15.57:0/2473917218 learned_addr learned my addr 172.21.15.57:0/2473917218 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:11:37.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae9239c700 1 --2- 172.21.15.57:0/2473917218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd8520 0x55b21ebd8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae9139a700 1 --2- 172.21.15.57:0/2473917218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd40e0 0x55b21ebd7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae91b9b700 1 -- 172.21.15.57:0/2473917218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd8520 msgr2=0x55b21ebd8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:37.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae91b9b700 1 --2- 172.21.15.57:0/2473917218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd8520 0x55b21ebd8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae91b9b700 1 -- 172.21.15.57:0/2473917218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd40e0 msgr2=0x55b21ebd7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:37.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae91b9b700 1 --2- 172.21.15.57:0/2473917218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd40e0 0x55b21ebd7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae9139a700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fae7809b480 0x7fae7809d930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0fde80 tx=0x7fae7c009f90 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:37.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae91b9b700 1 -- 172.21.15.57:0/2473917218 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b21e9a3630 con 0x55b21ebd37d0 2023-03-02T11:11:37.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae9239c700 1 --2- 172.21.15.57:0/2473917218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd8520 0x55b21ebd8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:11:37.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.833+0000 7fae91b9b700 1 --2- 172.21.15.57:0/2473917218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 0x55b21ebd3ba0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fae88090b30 tx=0x7fae880942a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46c77b9409e7c3fb server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:37.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7fae77fff700 1 -- 172.21.15.57:0/2473917218 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae880044f0 con 0x55b21ebd37d0 2023-03-02T11:11:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7fae77fff700 1 -- 172.21.15.57:0/2473917218 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae88094d30 con 0x55b21ebd37d0 2023-03-02T11:11:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7fae77fff700 1 -- 172.21.15.57:0/2473917218 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88094ad0 con 0x55b21ebd37d0 2023-03-02T11:11:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7faea7709b80 1 -- 172.21.15.57:0/2473917218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 msgr2=0x55b21ebd3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7faea7709b80 1 --2- 172.21.15.57:0/2473917218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 0x55b21ebd3ba0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fae88090b30 tx=0x7fae880942a0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7faea7709b80 1 -- 172.21.15.57:0/2473917218 shutdown_connections 2023-03-02T11:11:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7faea7709b80 1 --2- 172.21.15.57:0/2473917218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd8520 0x55b21ebd8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7faea7709b80 1 --2- 172.21.15.57:0/2473917218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 0x55b21ebd3ba0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7faea7709b80 1 --2- 172.21.15.57:0/2473917218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd40e0 0x55b21ebd7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7faea7709b80 1 -- 172.21.15.57:0/2473917218 >> 172.21.15.57:0/2473917218 conn(0x55b21ebc4c50 msgr2=0x55b21ebca460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:37.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7faea7709b80 1 -- 172.21.15.57:0/2473917218 shutdown_connections 2023-03-02T11:11:37.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.834+0000 7faea7709b80 1 -- 172.21.15.57:0/2473917218 wait complete. 2023-03-02T11:11:37.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7faea7709b80 1 -- start start 2023-03-02T11:11:37.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7faea7709b80 1 Processor -- start 2023-03-02T11:11:37.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7faea7709b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd37d0 0x55b21ebdfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7faea7709b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 0x55b21ebdcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7faea7709b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd8520 0x55b21ebdd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7faea7709b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21eb27bc0 con 0x55b21ebd37d0 2023-03-02T11:11:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7faea7709b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21eb210f0 con 0x55b21ebd40e0 2023-03-02T11:11:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7faea7709b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21e9a5920 con 0x55b21ebd8520 2023-03-02T11:11:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7faea7709b80 10 client.0 _ll_register_callbacks cb 0x55b21eac7520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:11:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7fae91b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd37d0 0x55b21ebdfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7fae9139a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 0x55b21ebdcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7fae91b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd37d0 0x55b21ebdfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56346/0 (socket says 172.21.15.57:56346) 2023-03-02T11:11:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7fae9239c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd8520 0x55b21ebdd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.835+0000 7fae91b9b700 1 -- 172.21.15.57:0/1620759003 learned_addr learned my addr 172.21.15.57:0/1620759003 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:11:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7fae91b9b700 1 -- 172.21.15.57:0/1620759003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd8520 msgr2=0x55b21ebdd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7fae91b9b700 1 --2- 172.21.15.57:0/1620759003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd8520 0x55b21ebdd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7fae91b9b700 1 -- 172.21.15.57:0/1620759003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 msgr2=0x55b21ebdcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7fae91b9b700 1 --2- 172.21.15.57:0/1620759003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 0x55b21ebdcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7fae91b9b700 1 -- 172.21.15.57:0/1620759003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c10e860 con 0x55b21ebd37d0 2023-03-02T11:11:37.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7fae91b9b700 1 --2- 172.21.15.57:0/1620759003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd37d0 0x55b21ebdfd70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fae8800e9c0 tx=0x7fae88093dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c819b6867fd8f41f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:37.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7fae757fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:11:37.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7fae757fa700 1 -- 172.21.15.57:0/1620759003 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88060070 con 0x55b21ebd37d0 2023-03-02T11:11:37.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7fae757fa700 1 -- 172.21.15.57:0/1620759003 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fae880b0070 con 0x55b21ebd37d0 2023-03-02T11:11:37.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7faea7709b80 1 -- 172.21.15.57:0/1620759003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b21eaf27b0 con 0x55b21ebd37d0 2023-03-02T11:11:37.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7fae757fa700 1 -- 172.21.15.57:0/1620759003 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae88094630 con 0x55b21ebd37d0 2023-03-02T11:11:37.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7faea7709b80 10 client.16617 fetch_fsmap learned FSMap version 47 2023-03-02T11:11:37.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7faea7709b80 1 -- 172.21.15.57:0/1620759003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55b21e94fde0 con 0x55b21ebd37d0 2023-03-02T11:11:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.836+0000 7fae757fa700 1 -- 172.21.15.57:0/1620759003 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b21eaf27b0 con 0x55b21ebd37d0 2023-03-02T11:11:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.837+0000 7fae757fa700 1 -- 172.21.15.57:0/1620759003 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fae88093590 con 0x55b21ebd37d0 2023-03-02T11:11:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.837+0000 7faea7709b80 10 client.16617 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:11:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.837+0000 7faea7709b80 10 client.16617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:11:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.837+0000 7faea7709b80 20 client.16617 populate_metadata read hostname 'smithi057' 2023-03-02T11:11:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.837+0000 7faea7709b80 1 --2- 172.21.15.57:0/1620759003 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55b21ebed180 0x55b21ebef560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.837+0000 7faea7709b80 4 client.16617 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:11:37.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.837+0000 7faea7709b80 1 -- 172.21.15.57:0/1620759003 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b21eb1a170 con 0x55b21ebed180 2023-03-02T11:11:37.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.837+0000 7fae9139a700 1 --2- 172.21.15.57:0/1620759003 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55b21ebed180 0x55b21ebef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.837+0000 7fae757fa700 10 client.16617 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:11:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.837+0000 7fae9139a700 1 --2- 172.21.15.57:0/1620759003 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55b21ebed180 0x55b21ebef560 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab486823903b01a5 server_cookie=4fb87145ed48e89b in_seq=0 out_seq=0 2023-03-02T11:11:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7fae757fa700 1 -- 172.21.15.57:0/1620759003 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55b21eb1a170 con 0x55b21ebed180 2023-03-02T11:11:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7fae757fa700 10 client.16617 handle_command_reply: tid=0 2023-03-02T11:11:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 1 client.16617 shutdown 2023-03-02T11:11:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 1 -- 172.21.15.57:0/1620759003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd37d0 msgr2=0x55b21ebdfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 1 --2- 172.21.15.57:0/1620759003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd37d0 0x55b21ebdfd70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fae8800e9c0 tx=0x7fae88093dd0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 1 -- 172.21.15.57:0/1620759003 shutdown_connections 2023-03-02T11:11:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 1 --2- 172.21.15.57:0/1620759003 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55b21ebed180 0x55b21ebef560 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 1 --2- 172.21.15.57:0/1620759003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd8520 0x55b21ebdd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 1 --2- 172.21.15.57:0/1620759003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd37d0 0x55b21ebdfd70 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7fae757fa700 0 client.16617 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:11:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 1 --2- 172.21.15.57:0/1620759003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 0x55b21ebdcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 1 -- 172.21.15.57:0/1620759003 >> 172.21.15.57:0/1620759003 conn(0x55b21ebc4c50 msgr2=0x55b21ebca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 1 -- 172.21.15.57:0/1620759003 shutdown_connections 2023-03-02T11:11:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 1 -- 172.21.15.57:0/1620759003 wait complete. 2023-03-02T11:11:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.838+0000 7faea7709b80 20 client.16617 trim_cache size 0 max 16384 2023-03-02T11:11:37.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7faea7709b80 1 Processor -- start 2023-03-02T11:11:37.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7faea7709b80 1 -- start start 2023-03-02T11:11:37.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7faea7709b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 0x55b21ebd5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7faea7709b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 0x55b21ebdf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7faea7709b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd8520 0x55b21ebdc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7faea7709b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21ebc4860 con 0x55b21ebd8520 2023-03-02T11:11:37.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7faea7709b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21ebf4070 con 0x55b21ebd40e0 2023-03-02T11:11:37.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7faea7709b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21ebd6ef0 con 0x55b21ebd37d0 2023-03-02T11:11:37.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7fae91b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 0x55b21ebd5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7fae9139a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 0x55b21ebdf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7fae9239c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd8520 0x55b21ebdc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7fae91b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 0x55b21ebd5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:50258/0 (socket says 172.21.15.57:50258) 2023-03-02T11:11:37.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7fae91b9b700 1 -- 172.21.15.57:0/2996813127 learned_addr learned my addr 172.21.15.57:0/2996813127 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:11:37.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.855+0000 7fae9139a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 0x55b21ebdf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:38890/0 (socket says 172.21.15.57:38890) 2023-03-02T11:11:37.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.856+0000 7fae9139a700 1 -- 172.21.15.57:0/2996813127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 msgr2=0x55b21ebd5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:37.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.856+0000 7fae9139a700 1 --2- 172.21.15.57:0/2996813127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 0x55b21ebd5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.856+0000 7fae9139a700 1 -- 172.21.15.57:0/2996813127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd8520 msgr2=0x55b21ebdc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.856+0000 7fae9139a700 1 --2- 172.21.15.57:0/2996813127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd8520 0x55b21ebdc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.856+0000 7fae9139a700 1 -- 172.21.15.57:0/2996813127 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b21eae8190 con 0x55b21ebd40e0 2023-03-02T11:11:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.856+0000 7fae9239c700 1 --2- 172.21.15.57:0/2996813127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd8520 0x55b21ebdc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:11:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.856+0000 7fae9139a700 1 --2- 172.21.15.57:0/2996813127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 0x55b21ebdf8a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fae88091050 tx=0x7fae7c01c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21b104cbd2a02b2e server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.856+0000 7fae80bff700 1 -- 172.21.15.57:0/2996813127 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c023040 con 0x55b21ebd40e0 2023-03-02T11:11:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.856+0000 7fae80bff700 1 -- 172.21.15.57:0/2996813127 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae7c00fc50 con 0x55b21ebd40e0 2023-03-02T11:11:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.856+0000 7fae80bff700 1 -- 172.21.15.57:0/2996813127 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0288b0 con 0x55b21ebd40e0 2023-03-02T11:11:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 -- 172.21.15.57:0/2996813127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 msgr2=0x55b21ebdf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 --2- 172.21.15.57:0/2996813127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 0x55b21ebdf8a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fae88091050 tx=0x7fae7c01c000 comp rx=0 tx=0).stop 2023-03-02T11:11:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 -- 172.21.15.57:0/2996813127 shutdown_connections 2023-03-02T11:11:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 --2- 172.21.15.57:0/2996813127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd8520 0x55b21ebdc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 --2- 172.21.15.57:0/2996813127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd37d0 0x55b21ebd5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 --2- 172.21.15.57:0/2996813127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd40e0 0x55b21ebdf8a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 -- 172.21.15.57:0/2996813127 >> 172.21.15.57:0/2996813127 conn(0x55b21ebc4c50 msgr2=0x55b21ebe8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 -- 172.21.15.57:0/2996813127 shutdown_connections 2023-03-02T11:11:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 -- 172.21.15.57:0/2996813127 wait complete. 2023-03-02T11:11:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 -- start start 2023-03-02T11:11:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 Processor -- start 2023-03-02T11:11:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd37d0 0x55b21ebe2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.857+0000 7faea7709b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd40e0 0x55b21ebe3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7faea7709b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd8520 0x55b21ebe35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7faea7709b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21ec3e940 con 0x55b21ebd40e0 2023-03-02T11:11:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7faea7709b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21ec3ea80 con 0x55b21ebd37d0 2023-03-02T11:11:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7faea7709b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b21ec3ebf0 con 0x55b21ebd8520 2023-03-02T11:11:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7faea7709b80 10 client.0 _ll_register_callbacks cb 0x55b21eac7520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:11:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae91b9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd37d0 0x55b21ebe2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae9139a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd40e0 0x55b21ebe3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae91b9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd37d0 0x55b21ebe2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:38904/0 (socket says 172.21.15.57:38904) 2023-03-02T11:11:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae91b9b700 1 -- 172.21.15.57:0/4024232713 learned_addr learned my addr 172.21.15.57:0/4024232713 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:11:37.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae9239c700 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd8520 0x55b21ebe35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae91b9b700 1 -- 172.21.15.57:0/4024232713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd8520 msgr2=0x55b21ebe35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:37.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae91b9b700 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd8520 0x55b21ebe35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae91b9b700 1 -- 172.21.15.57:0/4024232713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd40e0 msgr2=0x55b21ebe3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:11:37.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae91b9b700 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd40e0 0x55b21ebe3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae91b9b700 1 -- 172.21.15.57:0/4024232713 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae84007ad0 con 0x55b21ebd37d0 2023-03-02T11:11:37.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae9139a700 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd40e0 0x55b21ebe3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:11:37.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae91b9b700 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd37d0 0x55b21ebe2b30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fae880095c0 tx=0x7fae88003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82965457ac9f7949 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:11:37.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae757fa700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:11:37.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae757fa700 1 -- 172.21.15.57:0/4024232713 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88093f90 con 0x55b21ebd37d0 2023-03-02T11:11:37.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7fae757fa700 1 -- 172.21.15.57:0/4024232713 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fae88094630 con 0x55b21ebd37d0 2023-03-02T11:11:37.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.858+0000 7faea7709b80 1 -- 172.21.15.57:0/4024232713 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae88094d30 con 0x55b21ebd37d0 2023-03-02T11:11:37.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7fae757fa700 1 -- 172.21.15.57:0/4024232713 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae8809bd50 con 0x55b21ebd37d0 2023-03-02T11:11:37.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7faea7709b80 10 client.26465 fetch_fsmap learned FSMap version 47 2023-03-02T11:11:37.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7faea7709b80 1 -- 172.21.15.57:0/4024232713 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7fae7c004040 con 0x55b21ebd37d0 2023-03-02T11:11:37.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7fae757fa700 1 -- 172.21.15.57:0/4024232713 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae88094d30 con 0x55b21ebd37d0 2023-03-02T11:11:37.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7fae757fa700 1 -- 172.21.15.57:0/4024232713 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fae88004870 con 0x55b21ebd37d0 2023-03-02T11:11:37.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7faea7709b80 10 client.26465 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:11:37.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7faea7709b80 10 client.26465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:11:37.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7faea7709b80 20 client.26465 populate_metadata read hostname 'smithi057' 2023-03-02T11:11:37.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7faea7709b80 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55b21ec3fe50 0x55b21ec42230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:11:37.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7faea7709b80 4 client.26465 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:11:37.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7faea7709b80 1 -- 172.21.15.57:0/4024232713 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b21eb19e90 con 0x55b21ec3fe50 2023-03-02T11:11:37.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.859+0000 7fae9139a700 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55b21ec3fe50 0x55b21ec42230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:37.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7fae9139a700 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55b21ec3fe50 0x55b21ec42230 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b9babf2e3fdcdaf server_cookie=76292053b37015bb in_seq=0 out_seq=0 2023-03-02T11:11:37.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7fae757fa700 10 client.26465 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:11:37.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7fae757fa700 1 -- 172.21.15.57:0/4024232713 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b21eb19e90 con 0x55b21ec3fe50 2023-03-02T11:11:37.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7fae757fa700 10 client.26465 handle_command_reply: tid=0 2023-03-02T11:11:37.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7faea7709b80 1 client.26465 shutdown 2023-03-02T11:11:37.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7faea7709b80 1 -- 172.21.15.57:0/4024232713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd37d0 msgr2=0x55b21ebe2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:37.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7faea7709b80 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd37d0 0x55b21ebe2b30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fae880095c0 tx=0x7fae88003680 comp rx=0 tx=0).stop 2023-03-02T11:11:37.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7faea7709b80 1 -- 172.21.15.57:0/4024232713 shutdown_connections 2023-03-02T11:11:37.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7faea7709b80 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55b21ec3fe50 0x55b21ec42230 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7faea7709b80 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b21ebd8520 0x55b21ebe35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7fae757fa700 0 client.26465 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:11:37.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7faea7709b80 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21ebd37d0 0x55b21ebe2b30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7faea7709b80 1 --2- 172.21.15.57:0/4024232713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b21ebd40e0 0x55b21ebe3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7faea7709b80 1 -- 172.21.15.57:0/4024232713 >> 172.21.15.57:0/4024232713 conn(0x55b21ebc4c50 msgr2=0x55b21ebdc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:37.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7faea7709b80 1 -- 172.21.15.57:0/4024232713 shutdown_connections 2023-03-02T11:11:37.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.860+0000 7faea7709b80 1 -- 172.21.15.57:0/4024232713 wait complete. 2023-03-02T11:11:37.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7faea7709b80 20 client.26465 trim_cache size 0 max 16384 2023-03-02T11:11:37.871 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:11:37.871 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:11:37.872 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:11:37.872 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:11:37.872 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:11:37.872 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:11:37.872 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:11:37.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:11:37.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:11:37.872 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:11:37.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 -- 172.21.15.57:0/445427083 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fae7809b480 msgr2=0x7fae7809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:37.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fae7809b480 0x7fae7809d930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0fde80 tx=0x7fae7c009f90 comp rx=0 tx=0).stop 2023-03-02T11:11:37.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 -- 172.21.15.57:0/445427083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae8c0fe9b0 msgr2=0x7fae8c19ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:11:37.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae8c0fe9b0 0x7fae8c19ba60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae8800e9f0 tx=0x7fae8800ed00 comp rx=0 tx=0).stop 2023-03-02T11:11:37.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 -- 172.21.15.57:0/445427083 shutdown_connections 2023-03-02T11:11:37.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fae7809b480 0x7fae7809d930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae8c1049c0 0x7fae8c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae8c0fe9b0 0x7fae8c19ba60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 --2- 172.21.15.57:0/445427083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae8c0ff360 0x7fae8c19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:11:37.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 -- 172.21.15.57:0/445427083 >> 172.21.15.57:0/445427083 conn(0x7fae8c0fa4b0 msgr2=0x7fae8c0fbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:11:37.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 -- 172.21.15.57:0/445427083 shutdown_connections 2023-03-02T11:11:37.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:11:37.861+0000 7fae93dff700 1 -- 172.21.15.57:0/445427083 wait complete. 2023-03-02T11:11:37.877 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:11:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:38 smithi136 ceph-mon[125702]: pgmap v457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:38 smithi057 ceph-mon[92072]: pgmap v457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:38 smithi122 ceph-mon[125440]: pgmap v457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:40 smithi136 ceph-mon[125702]: pgmap v458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:40 smithi057 ceph-mon[92072]: pgmap v458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:40 smithi122 ceph-mon[125440]: pgmap v458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:42 smithi136 ceph-mon[125702]: pgmap v459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:42 smithi057 ceph-mon[92072]: pgmap v459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:42 smithi122 ceph-mon[125440]: pgmap v459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:44 smithi136 ceph-mon[125702]: pgmap v460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:44 smithi057 ceph-mon[92072]: pgmap v460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:44 smithi122 ceph-mon[125440]: pgmap v460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:46 smithi136 ceph-mon[125702]: pgmap v461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:46 smithi057 ceph-mon[92072]: pgmap v461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:46 smithi122 ceph-mon[125440]: pgmap v461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:48 smithi136 ceph-mon[125702]: pgmap v462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:48 smithi057 ceph-mon[92072]: pgmap v462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:48 smithi122 ceph-mon[125440]: pgmap v462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:49.387+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:11:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:49.387+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:11:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:49.387+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:11:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:49.387+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:11:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:11:49.387+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:11:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:50 smithi136 ceph-mon[125702]: pgmap v463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:50 smithi057 ceph-mon[92072]: pgmap v463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:50 smithi122 ceph-mon[125440]: pgmap v463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:52 smithi136 ceph-mon[125702]: pgmap v464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:52 smithi057 ceph-mon[92072]: pgmap v464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:52 smithi122 ceph-mon[125440]: pgmap v464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:54 smithi057 ceph-mon[92072]: pgmap v465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:54 smithi122 ceph-mon[125440]: pgmap v465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:54 smithi136 ceph-mon[125702]: pgmap v465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:56 smithi057 ceph-mon[92072]: pgmap v466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:56 smithi122 ceph-mon[125440]: pgmap v466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:56 smithi136 ceph-mon[125702]: pgmap v466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:11:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:11:58 smithi057 ceph-mon[92072]: pgmap v467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:11:58 smithi122 ceph-mon[125440]: pgmap v467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:11:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:11:58 smithi136 ceph-mon[125702]: pgmap v467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:00 smithi057 ceph-mon[92072]: pgmap v468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:00 smithi122 ceph-mon[125440]: pgmap v468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:00.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:00 smithi136 ceph-mon[125702]: pgmap v468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:02.350 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:02 smithi057 ceph-mon[92072]: pgmap v469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:02 smithi122 ceph-mon[125440]: pgmap v469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:02 smithi136 ceph-mon[125702]: pgmap v469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:04.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:04.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:04.399+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:12:04.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:04.399+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:12:04.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:04.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:12:04.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:04.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:12:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:04 smithi057 ceph-mon[92072]: pgmap v470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:12:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:04 smithi122 ceph-mon[125440]: pgmap v470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:12:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:04 smithi136 ceph-mon[125702]: pgmap v470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:12:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:06 smithi057 ceph-mon[92072]: pgmap v471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:12:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:06 smithi122 ceph-mon[125440]: pgmap v471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:12:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:06 smithi136 ceph-mon[125702]: pgmap v471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:12:07.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:12:08.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.041+0000 7f2762bff700 1 -- 172.21.15.57:0/881649908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f275c1049c0 msgr2=0x7f275c104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:08.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.041+0000 7f2762bff700 1 --2- 172.21.15.57:0/881649908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f275c1049c0 0x7f275c104d90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2750009990 tx=0x7f2750009ca0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.041+0000 7f2762bff700 1 -- 172.21.15.57:0/881649908 shutdown_connections 2023-03-02T11:12:08.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.042+0000 7f2762bff700 1 --2- 172.21.15.57:0/881649908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0ff360 0x7f275c10b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.042+0000 7f2762bff700 1 --2- 172.21.15.57:0/881649908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f275c1049c0 0x7f275c104d90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.042+0000 7f2762bff700 1 --2- 172.21.15.57:0/881649908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f275c0fe9b0 0x7f275c0fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.042+0000 7f2762bff700 1 -- 172.21.15.57:0/881649908 >> 172.21.15.57:0/881649908 conn(0x7f275c0fa4b0 msgr2=0x7f275c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:08.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.042+0000 7f2762bff700 1 -- 172.21.15.57:0/881649908 shutdown_connections 2023-03-02T11:12:08.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.042+0000 7f2762bff700 1 -- 172.21.15.57:0/881649908 wait complete. 2023-03-02T11:12:08.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.042+0000 7f2762bff700 1 Processor -- start 2023-03-02T11:12:08.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.042+0000 7f2762bff700 1 -- start start 2023-03-02T11:12:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f2762bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f275c0fe9b0 0x7f275c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f2762bff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0ff360 0x7f275c19e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f2762bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f275c1049c0 0x7f275c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f2762bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c198a60 con 0x7f275c0fe9b0 2023-03-02T11:12:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f2762bff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c198bd0 con 0x7f275c0ff360 2023-03-02T11:12:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f2762bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c198d90 con 0x7f275c1049c0 2023-03-02T11:12:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f276099b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f275c0fe9b0 0x7f275c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f275bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0ff360 0x7f275c19e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f276099b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f275c0fe9b0 0x7f275c19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60446/0 (socket says 172.21.15.57:60446) 2023-03-02T11:12:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f276099b700 1 -- 172.21.15.57:0/2189434303 learned_addr learned my addr 172.21.15.57:0/2189434303 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:12:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f276119c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f275c1049c0 0x7f275c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f276099b700 1 -- 172.21.15.57:0/2189434303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f275c1049c0 msgr2=0x7f275c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f276099b700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f275c1049c0 0x7f275c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f276099b700 1 -- 172.21.15.57:0/2189434303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0ff360 msgr2=0x7f275c19e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f276099b700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0ff360 0x7f275c19e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.043+0000 7f276099b700 1 -- 172.21.15.57:0/2189434303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500095f0 con 0x7f275c0fe9b0 2023-03-02T11:12:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.044+0000 7f276099b700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f275c0fe9b0 0x7f275c19db80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2750000c00 tx=0x7f2750005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.044+0000 7f2759ffb700 1 -- 172.21.15.57:0/2189434303 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275001d070 con 0x7f275c0fe9b0 2023-03-02T11:12:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.044+0000 7f2762bff700 1 -- 172.21.15.57:0/2189434303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c10e9f0 con 0x7f275c0fe9b0 2023-03-02T11:12:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.044+0000 7f2759ffb700 1 -- 172.21.15.57:0/2189434303 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2750022470 con 0x7f275c0fe9b0 2023-03-02T11:12:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.044+0000 7f2759ffb700 1 -- 172.21.15.57:0/2189434303 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750017670 con 0x7f275c0fe9b0 2023-03-02T11:12:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.044+0000 7f2762bff700 1 -- 172.21.15.57:0/2189434303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c10e860 con 0x7f275c0fe9b0 2023-03-02T11:12:08.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.046+0000 7f2759ffb700 1 -- 172.21.15.57:0/2189434303 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f2750029030 con 0x7f275c0fe9b0 2023-03-02T11:12:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.047+0000 7f2759ffb700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f274c09b480 0x7f274c09d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.047+0000 7f2759ffb700 1 -- 172.21.15.57:0/2189434303 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f27500c6300 con 0x7f275c0fe9b0 2023-03-02T11:12:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f275bfff700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f274c09b480 0x7f274c09d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f2776515b80 1 Processor -- start 2023-03-02T11:12:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f2776515b80 1 -- start start 2023-03-02T11:12:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f275bfff700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f274c09b480 0x7f274c09d930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f275c0fdac0 tx=0x7f2748009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f2776515b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f8760790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f2776515b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8760cd0 0x5589f8764bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f2776515b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8765110 0x5589f8765560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f2776515b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f86c7a60 con 0x5589f87603c0 2023-03-02T11:12:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f2776515b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f8679f80 con 0x5589f8765110 2023-03-02T11:12:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f2776515b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f864a160 con 0x5589f8760cd0 2023-03-02T11:12:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f276099b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f8760790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f276119c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8765110 0x5589f8765560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.048+0000 7f275bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8760cd0 0x5589f8764bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f276099b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f8760790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60458/0 (socket says 172.21.15.57:60458) 2023-03-02T11:12:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f276099b700 1 -- 172.21.15.57:0/2608573792 learned_addr learned my addr 172.21.15.57:0/2608573792 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:12:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f276099b700 1 -- 172.21.15.57:0/2608573792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8760cd0 msgr2=0x5589f8764bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f276099b700 1 --2- 172.21.15.57:0/2608573792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8760cd0 0x5589f8764bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f276099b700 1 -- 172.21.15.57:0/2608573792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8765110 msgr2=0x5589f8765560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f276099b700 1 --2- 172.21.15.57:0/2608573792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8765110 0x5589f8765560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f276099b700 1 -- 172.21.15.57:0/2608573792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589f8534630 con 0x5589f87603c0 2023-03-02T11:12:08.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f275bfff700 1 --2- 172.21.15.57:0/2608573792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8760cd0 0x5589f8764bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:12:08.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f276099b700 1 --2- 172.21.15.57:0/2608573792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f8760790 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f27500954e0 tx=0x7f2750091480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1732180f56cb3c6d server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:08.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f2746ffd700 1 -- 172.21.15.57:0/2608573792 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750095ee0 con 0x5589f87603c0 2023-03-02T11:12:08.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f2746ffd700 1 -- 172.21.15.57:0/2608573792 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27500957e0 con 0x5589f87603c0 2023-03-02T11:12:08.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.049+0000 7f2746ffd700 1 -- 172.21.15.57:0/2608573792 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750095c60 con 0x5589f87603c0 2023-03-02T11:12:08.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.050+0000 7f2776515b80 1 -- 172.21.15.57:0/2608573792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 msgr2=0x5589f8760790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:08.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.050+0000 7f2776515b80 1 --2- 172.21.15.57:0/2608573792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f8760790 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f27500954e0 tx=0x7f2750091480 comp rx=0 tx=0).stop 2023-03-02T11:12:08.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.050+0000 7f2776515b80 1 -- 172.21.15.57:0/2608573792 shutdown_connections 2023-03-02T11:12:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.050+0000 7f2776515b80 1 --2- 172.21.15.57:0/2608573792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8765110 0x5589f8765560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.050+0000 7f2776515b80 1 --2- 172.21.15.57:0/2608573792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f8760790 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.050+0000 7f2776515b80 1 --2- 172.21.15.57:0/2608573792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8760cd0 0x5589f8764bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.050+0000 7f2776515b80 1 -- 172.21.15.57:0/2608573792 >> 172.21.15.57:0/2608573792 conn(0x5589f8755c50 msgr2=0x5589f875b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.050+0000 7f2776515b80 1 -- 172.21.15.57:0/2608573792 shutdown_connections 2023-03-02T11:12:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.050+0000 7f2776515b80 1 -- 172.21.15.57:0/2608573792 wait complete. 2023-03-02T11:12:08.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.050+0000 7f2776515b80 1 -- start start 2023-03-02T11:12:08.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.050+0000 7f2776515b80 1 Processor -- start 2023-03-02T11:12:08.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f2776515b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f876c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f2776515b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f8769b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f2776515b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f876a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f2776515b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f86b8bc0 con 0x5589f87603c0 2023-03-02T11:12:08.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f2776515b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f86b20f0 con 0x5589f8760cd0 2023-03-02T11:12:08.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f2776515b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f8536920 con 0x5589f8765110 2023-03-02T11:12:08.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f2776515b80 10 client.0 _ll_register_callbacks cb 0x5589f8658520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:12:08.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f275bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f8769b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f276119c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f876a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f275bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f8769b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:57838/0 (socket says 172.21.15.57:57838) 2023-03-02T11:12:08.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f276099b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f876c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f275bfff700 1 -- 172.21.15.57:0/1187608088 learned_addr learned my addr 172.21.15.57:0/1187608088 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:12:08.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f275bfff700 1 -- 172.21.15.57:0/1187608088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 msgr2=0x5589f876a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:08.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f275bfff700 1 --2- 172.21.15.57:0/1187608088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f876a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f275bfff700 1 -- 172.21.15.57:0/1187608088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 msgr2=0x5589f876c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:08.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f275bfff700 1 --2- 172.21.15.57:0/1187608088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f876c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.051+0000 7f275bfff700 1 -- 172.21.15.57:0/1187608088 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c10e860 con 0x5589f8760cd0 2023-03-02T11:12:08.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.052+0000 7f275bfff700 1 --2- 172.21.15.57:0/1187608088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f8769b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2748009b20 tx=0x7f27480047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=753c2e95af3df9dc server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:08.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.052+0000 7f273bfff700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:12:08.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.052+0000 7f273bfff700 1 -- 172.21.15.57:0/1187608088 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748022070 con 0x5589f8760cd0 2023-03-02T11:12:08.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.052+0000 7f2776515b80 1 -- 172.21.15.57:0/1187608088 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589f86837b0 con 0x5589f8760cd0 2023-03-02T11:12:08.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.052+0000 7f273bfff700 1 -- 172.21.15.57:0/1187608088 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f274801c620 con 0x5589f8760cd0 2023-03-02T11:12:08.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.052+0000 7f273bfff700 1 -- 172.21.15.57:0/1187608088 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f274801c7e0 con 0x5589f8760cd0 2023-03-02T11:12:08.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.052+0000 7f2776515b80 10 client.26477 fetch_fsmap learned FSMap version 47 2023-03-02T11:12:08.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.052+0000 7f2776515b80 1 -- 172.21.15.57:0/1187608088 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5589f84e0de0 con 0x5589f8760cd0 2023-03-02T11:12:08.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.052+0000 7f273bfff700 1 -- 172.21.15.57:0/1187608088 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2748032020 con 0x5589f8760cd0 2023-03-02T11:12:08.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.052+0000 7f273bfff700 1 -- 172.21.15.57:0/1187608088 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f274802e9c0 con 0x5589f8760cd0 2023-03-02T11:12:08.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.053+0000 7f2776515b80 10 client.26477 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:12:08.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.053+0000 7f2776515b80 10 client.26477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:12:08.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.053+0000 7f2776515b80 20 client.26477 populate_metadata read hostname 'smithi057' 2023-03-02T11:12:08.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.053+0000 7f2776515b80 1 --2- 172.21.15.57:0/1187608088 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5589f8779f60 0x5589f877c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.053+0000 7f2776515b80 4 client.26477 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:12:08.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.053+0000 7f2776515b80 1 -- 172.21.15.57:0/1187608088 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589f86ab170 con 0x5589f8779f60 2023-03-02T11:12:08.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.053+0000 7f276099b700 1 --2- 172.21.15.57:0/1187608088 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5589f8779f60 0x5589f877c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.053+0000 7f273bfff700 10 client.26477 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:12:08.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.053+0000 7f276099b700 1 --2- 172.21.15.57:0/1187608088 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5589f8779f60 0x5589f877c370 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=325fc824131afd60 server_cookie=71b46decb26988bd in_seq=0 out_seq=0 2023-03-02T11:12:08.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f273bfff700 1 -- 172.21.15.57:0/1187608088 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5589f86ab170 con 0x5589f8779f60 2023-03-02T11:12:08.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f273bfff700 10 client.26477 handle_command_reply: tid=0 2023-03-02T11:12:08.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f2776515b80 1 client.26477 shutdown 2023-03-02T11:12:08.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f2776515b80 1 -- 172.21.15.57:0/1187608088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 msgr2=0x5589f8769b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:08.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f2776515b80 1 --2- 172.21.15.57:0/1187608088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f8769b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2748009b20 tx=0x7f27480047c0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f2776515b80 1 -- 172.21.15.57:0/1187608088 shutdown_connections 2023-03-02T11:12:08.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f2776515b80 1 --2- 172.21.15.57:0/1187608088 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5589f8779f60 0x5589f877c370 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f2776515b80 1 --2- 172.21.15.57:0/1187608088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f876a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f2776515b80 1 --2- 172.21.15.57:0/1187608088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f876c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f2776515b80 1 --2- 172.21.15.57:0/1187608088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f8769b00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f273bfff700 0 client.26477 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:12:08.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f2776515b80 1 -- 172.21.15.57:0/1187608088 >> 172.21.15.57:0/1187608088 conn(0x5589f8755c50 msgr2=0x5589f875b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:08.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f2776515b80 1 -- 172.21.15.57:0/1187608088 shutdown_connections 2023-03-02T11:12:08.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.054+0000 7f2776515b80 1 -- 172.21.15.57:0/1187608088 wait complete. 2023-03-02T11:12:08.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.055+0000 7f2776515b80 20 client.26477 trim_cache size 0 max 16384 2023-03-02T11:12:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f2776515b80 1 Processor -- start 2023-03-02T11:12:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f2776515b80 1 -- start start 2023-03-02T11:12:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f2776515b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f87603c0 0x5589f87664f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f2776515b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f8760cd0 0x5589f876c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f2776515b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f8766dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f2776515b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f8777650 con 0x5589f8760cd0 2023-03-02T11:12:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f2776515b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f876ae80 con 0x5589f87603c0 2023-03-02T11:12:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f2776515b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f875b6b0 con 0x5589f8765110 2023-03-02T11:12:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f276099b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f87603c0 0x5589f87664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f275bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f8760cd0 0x5589f876c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f276099b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f87603c0 0x5589f87664f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:57854/0 (socket says 172.21.15.57:57854) 2023-03-02T11:12:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f276099b700 1 -- 172.21.15.57:0/3571284274 learned_addr learned my addr 172.21.15.57:0/3571284274 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:12:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.071+0000 7f276119c700 1 --2- 172.21.15.57:0/3571284274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f8766dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f276099b700 1 -- 172.21.15.57:0/3571284274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 msgr2=0x5589f8766dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:08.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f276099b700 1 --2- 172.21.15.57:0/3571284274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f8766dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f276099b700 1 -- 172.21.15.57:0/3571284274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f8760cd0 msgr2=0x5589f876c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:08.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f276099b700 1 --2- 172.21.15.57:0/3571284274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f8760cd0 0x5589f876c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f276099b700 1 -- 172.21.15.57:0/3571284274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589f8679190 con 0x5589f87603c0 2023-03-02T11:12:08.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f275bfff700 1 --2- 172.21.15.57:0/3571284274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f8760cd0 0x5589f876c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:12:08.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f276099b700 1 --2- 172.21.15.57:0/3571284274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f87603c0 0x5589f87664f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2750005f50 tx=0x7f275001a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3329854609341003 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:08.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f27477fe700 1 -- 172.21.15.57:0/3571284274 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275009ce70 con 0x5589f87603c0 2023-03-02T11:12:08.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f27477fe700 1 -- 172.21.15.57:0/3571284274 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27500225e0 con 0x5589f87603c0 2023-03-02T11:12:08.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f27477fe700 1 -- 172.21.15.57:0/3571284274 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750095c40 con 0x5589f87603c0 2023-03-02T11:12:08.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f2776515b80 1 -- 172.21.15.57:0/3571284274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f87603c0 msgr2=0x5589f87664f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:08.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.072+0000 7f2776515b80 1 --2- 172.21.15.57:0/3571284274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f87603c0 0x5589f87664f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2750005f50 tx=0x7f275001a040 comp rx=0 tx=0).stop 2023-03-02T11:12:08.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 -- 172.21.15.57:0/3571284274 shutdown_connections 2023-03-02T11:12:08.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 --2- 172.21.15.57:0/3571284274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f8766dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 --2- 172.21.15.57:0/3571284274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f87603c0 0x5589f87664f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 --2- 172.21.15.57:0/3571284274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f8760cd0 0x5589f876c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 -- 172.21.15.57:0/3571284274 >> 172.21.15.57:0/3571284274 conn(0x5589f8755c50 msgr2=0x5589f8775550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:08.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 -- 172.21.15.57:0/3571284274 shutdown_connections 2023-03-02T11:12:08.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 -- 172.21.15.57:0/3571284274 wait complete. 2023-03-02T11:12:08.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 -- start start 2023-03-02T11:12:08.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 Processor -- start 2023-03-02T11:12:08.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f87698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f87682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f87687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f8768d30 con 0x5589f87603c0 2023-03-02T11:12:08.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f8768ea0 con 0x5589f8760cd0 2023-03-02T11:12:08.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589f8769060 con 0x5589f8765110 2023-03-02T11:12:08.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.073+0000 7f2776515b80 10 client.0 _ll_register_callbacks cb 0x5589f8658520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:12:08.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f275bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f87682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f276099b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f87698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f276119c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f87687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f275bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f87682b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:57856/0 (socket says 172.21.15.57:57856) 2023-03-02T11:12:08.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f275bfff700 1 -- 172.21.15.57:0/2612603000 learned_addr learned my addr 172.21.15.57:0/2612603000 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:12:08.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f276119c700 1 -- 172.21.15.57:0/2612603000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 msgr2=0x5589f87682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:08.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f276119c700 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f87682b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f276119c700 1 -- 172.21.15.57:0/2612603000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 msgr2=0x5589f87698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:08.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f276119c700 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f87698c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f276119c700 1 -- 172.21.15.57:0/2612603000 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589f84e0de0 con 0x5589f8765110 2023-03-02T11:12:08.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f275bfff700 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f87682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:12:08.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f276119c700 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f87687f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2754011c50 tx=0x7f2754011f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad023f48290ae177 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f273bfff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:12:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.074+0000 7f273bfff700 1 -- 172.21.15.57:0/2612603000 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275401c070 con 0x5589f8765110 2023-03-02T11:12:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f2776515b80 1 -- 172.21.15.57:0/2612603000 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27500957e0 con 0x5589f8765110 2023-03-02T11:12:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f273bfff700 1 -- 172.21.15.57:0/2612603000 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f2754007bc0 con 0x5589f8765110 2023-03-02T11:12:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f273bfff700 1 -- 172.21.15.57:0/2612603000 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f275400e040 con 0x5589f8765110 2023-03-02T11:12:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f2776515b80 10 client.26431 fetch_fsmap learned FSMap version 47 2023-03-02T11:12:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f2776515b80 1 -- 172.21.15.57:0/2612603000 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5589f8534630 con 0x5589f8765110 2023-03-02T11:12:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f273bfff700 1 -- 172.21.15.57:0/2612603000 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f275402c020 con 0x5589f8765110 2023-03-02T11:12:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f273bfff700 1 -- 172.21.15.57:0/2612603000 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2754020ad0 con 0x5589f8765110 2023-03-02T11:12:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f2776515b80 10 client.26431 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:12:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f2776515b80 10 client.26431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:12:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f2776515b80 20 client.26431 populate_metadata read hostname 'smithi057' 2023-03-02T11:12:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f2776515b80 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5589f87ccce0 0x5589f87cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f2776515b80 4 client.26431 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:12:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f2776515b80 1 -- 172.21.15.57:0/2612603000 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5589f86aae90 con 0x5589f87ccce0 2023-03-02T11:12:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.075+0000 7f276099b700 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5589f87ccce0 0x5589f87cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f276099b700 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5589f87ccce0 0x5589f87cf0f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82cc6800685061b5 server_cookie=67913f884380a7ca in_seq=0 out_seq=0 2023-03-02T11:12:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f273bfff700 10 client.26431 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:12:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f273bfff700 1 -- 172.21.15.57:0/2612603000 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5589f86aae90 con 0x5589f87ccce0 2023-03-02T11:12:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f273bfff700 10 client.26431 handle_command_reply: tid=0 2023-03-02T11:12:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 1 client.26431 shutdown 2023-03-02T11:12:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 1 -- 172.21.15.57:0/2612603000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 msgr2=0x5589f87687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f87687f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2754011c50 tx=0x7f2754011f60 comp rx=0 tx=0).stop 2023-03-02T11:12:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 1 -- 172.21.15.57:0/2612603000 shutdown_connections 2023-03-02T11:12:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x5589f87ccce0 0x5589f87cf0f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589f8765110 0x5589f87687f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5589f87603c0 0x5589f87698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 1 --2- 172.21.15.57:0/2612603000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589f8760cd0 0x5589f87682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f273bfff700 0 client.26431 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:12:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 1 -- 172.21.15.57:0/2612603000 >> 172.21.15.57:0/2612603000 conn(0x5589f8755c50 msgr2=0x5589f8766dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:08.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 1 -- 172.21.15.57:0/2612603000 shutdown_connections 2023-03-02T11:12:08.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 1 -- 172.21.15.57:0/2612603000 wait complete. 2023-03-02T11:12:08.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.076+0000 7f2776515b80 20 client.26431 trim_cache size 0 max 16384 2023-03-02T11:12:08.089 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:12:08.089 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:12:08.089 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:12:08.090 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:12:08.090 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:12:08.090 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:12:08.090 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:12:08.090 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:12:08.090 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:12:08.090 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:12:08.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 -- 172.21.15.57:0/2189434303 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f274c09b480 msgr2=0x7f274c09d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:08.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f274c09b480 0x7f274c09d930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f275c0fdac0 tx=0x7f2748009260 comp rx=0 tx=0).stop 2023-03-02T11:12:08.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 -- 172.21.15.57:0/2189434303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f275c0fe9b0 msgr2=0x7f275c19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:08.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f275c0fe9b0 0x7f275c19db80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2750000c00 tx=0x7f2750005740 comp rx=0 tx=0).stop 2023-03-02T11:12:08.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 -- 172.21.15.57:0/2189434303 shutdown_connections 2023-03-02T11:12:08.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f274c09b480 0x7f274c09d930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f275c1049c0 0x7f275c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f275c0fe9b0 0x7f275c19db80 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 --2- 172.21.15.57:0/2189434303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f275c0ff360 0x7f275c19e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:08.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 -- 172.21.15.57:0/2189434303 >> 172.21.15.57:0/2189434303 conn(0x7f275c0fa4b0 msgr2=0x7f275c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:08.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 -- 172.21.15.57:0/2189434303 shutdown_connections 2023-03-02T11:12:08.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:08.077+0000 7f2762bff700 1 -- 172.21.15.57:0/2189434303 wait complete. 2023-03-02T11:12:08.094 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:12:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:08 smithi057 ceph-mon[92072]: pgmap v472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:12:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:08 smithi122 ceph-mon[125440]: pgmap v472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:12:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:08 smithi136 ceph-mon[125702]: pgmap v472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:12:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:10 smithi057 ceph-mon[92072]: pgmap v473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:12:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:10 smithi122 ceph-mon[125440]: pgmap v473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:12:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:10 smithi136 ceph-mon[125702]: pgmap v473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:12:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:11 smithi057 ceph-mon[92072]: osdmap e104: 12 total, 12 up, 12 in 2023-03-02T11:12:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:11 smithi122 ceph-mon[125440]: osdmap e104: 12 total, 12 up, 12 in 2023-03-02T11:12:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:11 smithi136 ceph-mon[125702]: osdmap e104: 12 total, 12 up, 12 in 2023-03-02T11:12:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:12 smithi057 ceph-mon[92072]: pgmap v475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:12:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:12 smithi122 ceph-mon[125440]: pgmap v475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:12:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:12 smithi136 ceph-mon[125702]: pgmap v475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:12:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:14 smithi057 ceph-mon[92072]: pgmap v476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:12:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:14 smithi057 ceph-mon[92072]: osdmap e105: 12 total, 12 up, 12 in 2023-03-02T11:12:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:14 smithi122 ceph-mon[125440]: pgmap v476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:12:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:14 smithi122 ceph-mon[125440]: osdmap e105: 12 total, 12 up, 12 in 2023-03-02T11:12:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:14 smithi136 ceph-mon[125702]: pgmap v476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:12:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:14 smithi136 ceph-mon[125702]: osdmap e105: 12 total, 12 up, 12 in 2023-03-02T11:12:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:16 smithi057 ceph-mon[92072]: pgmap v478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:12:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:16 smithi122 ceph-mon[125440]: pgmap v478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:12:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:16 smithi136 ceph-mon[125702]: pgmap v478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:12:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:18 smithi057 ceph-mon[92072]: pgmap v479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:12:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:18 smithi122 ceph-mon[125440]: pgmap v479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:12:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:18 smithi136 ceph-mon[125702]: pgmap v479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:12:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:19.416+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:19.416+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:12:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:19.416+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:12:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:19.416+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:12:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:19.416+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:12:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:20 smithi057 ceph-mon[92072]: pgmap v480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:12:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:20 smithi122 ceph-mon[125440]: pgmap v480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:12:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:20 smithi136 ceph-mon[125702]: pgmap v480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:12:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:22 smithi122 ceph-mon[125440]: pgmap v481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:12:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:22 smithi136 ceph-mon[125702]: pgmap v481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:12:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:22 smithi057 ceph-mon[92072]: pgmap v481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:12:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:24 smithi122 ceph-mon[125440]: pgmap v482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:12:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:24 smithi136 ceph-mon[125702]: pgmap v482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:12:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:24 smithi057 ceph-mon[92072]: pgmap v482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:12:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:26 smithi122 ceph-mon[125440]: pgmap v483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:12:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:26 smithi136 ceph-mon[125702]: pgmap v483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:12:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:26 smithi057 ceph-mon[92072]: pgmap v483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:12:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:28 smithi136 ceph-mon[125702]: pgmap v484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:12:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:28 smithi057 ceph-mon[92072]: pgmap v484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:12:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:28 smithi122 ceph-mon[125440]: pgmap v484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:12:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:30 smithi136 ceph-mon[125702]: pgmap v485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:30 smithi057 ceph-mon[92072]: pgmap v485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:30 smithi122 ceph-mon[125440]: pgmap v485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:12:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:12:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:12:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:32 smithi136 ceph-mon[125702]: pgmap v486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:32 smithi057 ceph-mon[92072]: pgmap v486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:32 smithi122 ceph-mon[125440]: pgmap v486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:12:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:12:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:12:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:12:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:12:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:12:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:12:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:12:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:34.429+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:34.429+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:34.429+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:34.429+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:34.429+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:12:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:34 smithi136 ceph-mon[125702]: pgmap v487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:34 smithi057 ceph-mon[92072]: pgmap v487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:34 smithi122 ceph-mon[125440]: pgmap v487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:36 smithi136 ceph-mon[125702]: pgmap v488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:36 smithi057 ceph-mon[92072]: pgmap v488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:36 smithi122 ceph-mon[125440]: pgmap v488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:38.094 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:12:38.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.282+0000 7f54a1bff700 1 -- 172.21.15.57:0/921068994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f549c1015f0 msgr2=0x7f549c109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:38.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.282+0000 7f54a1bff700 1 --2- 172.21.15.57:0/921068994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f549c1015f0 0x7f549c109ae0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f54840098f0 tx=0x7f5484009c00 comp rx=0 tx=0).stop 2023-03-02T11:12:38.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.282+0000 7f54a1bff700 1 -- 172.21.15.57:0/921068994 shutdown_connections 2023-03-02T11:12:38.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.282+0000 7f54a1bff700 1 --2- 172.21.15.57:0/921068994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f549c10a020 0x7f549c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.282+0000 7f54a1bff700 1 --2- 172.21.15.57:0/921068994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f549c100ce0 0x7f549c1010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.282+0000 7f54a1bff700 1 --2- 172.21.15.57:0/921068994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f549c1015f0 0x7f549c109ae0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.282+0000 7f54a1bff700 1 -- 172.21.15.57:0/921068994 >> 172.21.15.57:0/921068994 conn(0x7f549c0fa4b0 msgr2=0x7f549c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:38.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.282+0000 7f54a1bff700 1 -- 172.21.15.57:0/921068994 shutdown_connections 2023-03-02T11:12:38.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.282+0000 7f54a1bff700 1 -- 172.21.15.57:0/921068994 wait complete. 2023-03-02T11:12:38.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.283+0000 7f54a1bff700 1 Processor -- start 2023-03-02T11:12:38.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.283+0000 7f54a1bff700 1 -- start start 2023-03-02T11:12:38.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.283+0000 7f54a1bff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f549c100ce0 0x7f549c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.283+0000 7f54a1bff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f549c1015f0 0x7f549c19bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.283+0000 7f54a1bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f549c10a020 0x7f549c195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.283+0000 7f54a1bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c1960c0 con 0x7f549c10a020 2023-03-02T11:12:38.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.283+0000 7f54a1bff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c196230 con 0x7f549c1015f0 2023-03-02T11:12:38.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.283+0000 7f54a1bff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c1963f0 con 0x7f549c100ce0 2023-03-02T11:12:38.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.283+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f549c100ce0 0x7f549c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.283+0000 7f5492ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f549c1015f0 0x7f549c19bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.283+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f549c100ce0 0x7f549c19b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:59464/0 (socket says 172.21.15.57:59464) 2023-03-02T11:12:38.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f549b7fe700 1 -- 172.21.15.57:0/375331245 learned_addr learned my addr 172.21.15.57:0/375331245 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:12:38.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f549bfff700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f549c10a020 0x7f549c195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f549b7fe700 1 -- 172.21.15.57:0/375331245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f549c1015f0 msgr2=0x7f549c19bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:38.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f549b7fe700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f549c1015f0 0x7f549c19bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f549b7fe700 1 -- 172.21.15.57:0/375331245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f549c10a020 msgr2=0x7f549c195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:38.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f549b7fe700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f549c10a020 0x7f549c195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f549b7fe700 1 -- 172.21.15.57:0/375331245 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5494009d00 con 0x7f549c100ce0 2023-03-02T11:12:38.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f549bfff700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f549c10a020 0x7f549c195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:12:38.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f5492ffd700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f549c1015f0 0x7f549c19bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:12:38.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f549b7fe700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f549c100ce0 0x7f549c19b9e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f548c00e9a0 tx=0x7f548c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:38.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f54997fa700 1 -- 172.21.15.57:0/375331245 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c009790 con 0x7f549c100ce0 2023-03-02T11:12:38.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f54a1bff700 1 -- 172.21.15.57:0/375331245 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5484009520 con 0x7f549c100ce0 2023-03-02T11:12:38.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f54a1bff700 1 -- 172.21.15.57:0/375331245 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c10fac0 con 0x7f549c100ce0 2023-03-02T11:12:38.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f54997fa700 1 -- 172.21.15.57:0/375331245 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f548c010430 con 0x7f549c100ce0 2023-03-02T11:12:38.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.284+0000 7f54997fa700 1 -- 172.21.15.57:0/375331245 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c018680 con 0x7f549c100ce0 2023-03-02T11:12:38.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.288+0000 7f54997fa700 1 -- 172.21.15.57:0/375331245 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f548c00c040 con 0x7f549c100ce0 2023-03-02T11:12:38.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.289+0000 7f54997fa700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f548809b480 0x7f548809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.289+0000 7f54b5501b80 1 Processor -- start 2023-03-02T11:12:38.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.289+0000 7f54997fa700 1 -- 172.21.15.57:0/375331245 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f548c014070 con 0x7f549c100ce0 2023-03-02T11:12:38.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.289+0000 7f54b5501b80 1 -- start start 2023-03-02T11:12:38.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.289+0000 7f5492ffd700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f548809b480 0x7f548809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 0x55770e2601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e260710 0x55770e260b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e272e30 0x55770e275210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f54b5501b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e1c7a60 con 0x55770e264020 2023-03-02T11:12:38.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f54b5501b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e179f80 con 0x55770e260710 2023-03-02T11:12:38.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f54b5501b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e14a160 con 0x55770e272e30 2023-03-02T11:12:38.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 0x55770e2601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 0x55770e2601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47356/0 (socket says 172.21.15.57:47356) 2023-03-02T11:12:38.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f549b7fe700 1 -- 172.21.15.57:0/2221673851 learned_addr learned my addr 172.21.15.57:0/2221673851 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:12:38.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f549bfff700 1 --2- 172.21.15.57:0/2221673851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e272e30 0x55770e275210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f5492ffd700 1 --2- 172.21.15.57:0/2221673851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e260710 0x55770e260b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f549b7fe700 1 -- 172.21.15.57:0/2221673851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e272e30 msgr2=0x55770e275210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:38.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f549b7fe700 1 --2- 172.21.15.57:0/2221673851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e272e30 0x55770e275210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f549b7fe700 1 -- 172.21.15.57:0/2221673851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e260710 msgr2=0x55770e260b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:38.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f549b7fe700 1 --2- 172.21.15.57:0/2221673851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e260710 0x55770e260b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f5492ffd700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f548809b480 0x7f548809d930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5484009fd0 tx=0x7f5484019040 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:38.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f549b7fe700 1 -- 172.21.15.57:0/2221673851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55770e034630 con 0x55770e264020 2023-03-02T11:12:38.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.290+0000 7f549b7fe700 1 --2- 172.21.15.57:0/2221673851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 0x55770e2601d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f548c00cfd0 tx=0x7f548c094430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76a8b6dea29574f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:38.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f5491ffb700 1 -- 172.21.15.57:0/2221673851 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0981b0 con 0x55770e264020 2023-03-02T11:12:38.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f5491ffb700 1 -- 172.21.15.57:0/2221673851 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f548c090b30 con 0x55770e264020 2023-03-02T11:12:38.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f5491ffb700 1 -- 172.21.15.57:0/2221673851 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c093f40 con 0x55770e264020 2023-03-02T11:12:38.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f54b5501b80 1 -- 172.21.15.57:0/2221673851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 msgr2=0x55770e2601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:38.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f54b5501b80 1 --2- 172.21.15.57:0/2221673851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 0x55770e2601d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f548c00cfd0 tx=0x7f548c094430 comp rx=0 tx=0).stop 2023-03-02T11:12:38.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f54b5501b80 1 -- 172.21.15.57:0/2221673851 shutdown_connections 2023-03-02T11:12:38.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f54b5501b80 1 --2- 172.21.15.57:0/2221673851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e272e30 0x55770e275210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f54b5501b80 1 --2- 172.21.15.57:0/2221673851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 0x55770e2601d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f54b5501b80 1 --2- 172.21.15.57:0/2221673851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e260710 0x55770e260b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f54b5501b80 1 -- 172.21.15.57:0/2221673851 >> 172.21.15.57:0/2221673851 conn(0x55770e255c50 msgr2=0x55770e25b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:38.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f54b5501b80 1 -- 172.21.15.57:0/2221673851 shutdown_connections 2023-03-02T11:12:38.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.291+0000 7f54b5501b80 1 -- 172.21.15.57:0/2221673851 wait complete. 2023-03-02T11:12:38.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f54b5501b80 1 -- start start 2023-03-02T11:12:38.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f54b5501b80 1 Processor -- start 2023-03-02T11:12:38.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e260710 0x55770e272840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e264020 0x55770e26fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e272e30 0x55770e270160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f54b5501b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e1b8bc0 con 0x55770e272e30 2023-03-02T11:12:38.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f54b5501b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e1b20f0 con 0x55770e260710 2023-03-02T11:12:38.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f54b5501b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e036920 con 0x55770e264020 2023-03-02T11:12:38.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f54b5501b80 10 client.0 _ll_register_callbacks cb 0x55770e158520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:12:38.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e260710 0x55770e272840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f5492ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e264020 0x55770e26fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f549bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e272e30 0x55770e270160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f5492ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e264020 0x55770e26fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:59480/0 (socket says 172.21.15.57:59480) 2023-03-02T11:12:38.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e260710 0x55770e272840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:51400/0 (socket says 172.21.15.57:51400) 2023-03-02T11:12:38.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.292+0000 7f5492ffd700 1 -- 172.21.15.57:0/3190998783 learned_addr learned my addr 172.21.15.57:0/3190998783 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:12:38.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f549bfff700 1 -- 172.21.15.57:0/3190998783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e264020 msgr2=0x55770e26fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:38.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f549bfff700 1 --2- 172.21.15.57:0/3190998783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e264020 0x55770e26fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f549bfff700 1 -- 172.21.15.57:0/3190998783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e260710 msgr2=0x55770e272840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:38.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f549bfff700 1 --2- 172.21.15.57:0/3190998783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e260710 0x55770e272840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f549bfff700 1 -- 172.21.15.57:0/3190998783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c10fac0 con 0x55770e272e30 2023-03-02T11:12:38.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f549bfff700 1 --2- 172.21.15.57:0/3190998783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e272e30 0x55770e270160 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5494009fd0 tx=0x7f5494014880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb9a28dcc127f server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:38.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f547affd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:12:38.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f547affd700 1 -- 172.21.15.57:0/3190998783 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549400e040 con 0x55770e272e30 2023-03-02T11:12:38.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f54b5501b80 1 -- 172.21.15.57:0/3190998783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55770e1837b0 con 0x55770e272e30 2023-03-02T11:12:38.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f547affd700 1 -- 172.21.15.57:0/3190998783 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f549401a070 con 0x55770e272e30 2023-03-02T11:12:38.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f547affd700 1 -- 172.21.15.57:0/3190998783 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54940094e0 con 0x55770e272e30 2023-03-02T11:12:38.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f54b5501b80 10 client.16653 fetch_fsmap learned FSMap version 47 2023-03-02T11:12:38.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.293+0000 7f54b5501b80 1 -- 172.21.15.57:0/3190998783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55770dfe0de0 con 0x55770e272e30 2023-03-02T11:12:38.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.294+0000 7f547affd700 1 -- 172.21.15.57:0/3190998783 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f549402a080 con 0x55770e272e30 2023-03-02T11:12:38.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.294+0000 7f547affd700 1 -- 172.21.15.57:0/3190998783 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5494026640 con 0x55770e272e30 2023-03-02T11:12:38.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.294+0000 7f54b5501b80 10 client.16653 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:12:38.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.294+0000 7f54b5501b80 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:12:38.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.294+0000 7f54b5501b80 20 client.16653 populate_metadata read hostname 'smithi057' 2023-03-02T11:12:38.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.294+0000 7f54b5501b80 1 --2- 172.21.15.57:0/3190998783 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55770e282b80 0x55770e284f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.294+0000 7f54b5501b80 4 client.16653 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:12:38.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.294+0000 7f54b5501b80 1 -- 172.21.15.57:0/3190998783 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55770e1ab170 con 0x55770e282b80 2023-03-02T11:12:38.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.294+0000 7f549b7fe700 1 --2- 172.21.15.57:0/3190998783 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55770e282b80 0x55770e284f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.294+0000 7f547affd700 10 client.16653 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:12:38.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.294+0000 7f549b7fe700 1 --2- 172.21.15.57:0/3190998783 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55770e282b80 0x55770e284f90 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f5e00462b5089b5 server_cookie=16de29ab4b8b272f in_seq=0 out_seq=0 2023-03-02T11:12:38.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f547affd700 1 -- 172.21.15.57:0/3190998783 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55770e1ab170 con 0x55770e282b80 2023-03-02T11:12:38.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f547affd700 10 client.16653 handle_command_reply: tid=0 2023-03-02T11:12:38.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f54b5501b80 1 client.16653 shutdown 2023-03-02T11:12:38.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f54b5501b80 1 -- 172.21.15.57:0/3190998783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e272e30 msgr2=0x55770e270160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:38.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f54b5501b80 1 --2- 172.21.15.57:0/3190998783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e272e30 0x55770e270160 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5494009fd0 tx=0x7f5494014880 comp rx=0 tx=0).stop 2023-03-02T11:12:38.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f54b5501b80 1 -- 172.21.15.57:0/3190998783 shutdown_connections 2023-03-02T11:12:38.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f54b5501b80 1 --2- 172.21.15.57:0/3190998783 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55770e282b80 0x55770e284f90 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f54b5501b80 1 --2- 172.21.15.57:0/3190998783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e272e30 0x55770e270160 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f54b5501b80 1 --2- 172.21.15.57:0/3190998783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e260710 0x55770e272840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f547affd700 0 client.16653 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:12:38.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f54b5501b80 1 --2- 172.21.15.57:0/3190998783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e264020 0x55770e26fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f54b5501b80 1 -- 172.21.15.57:0/3190998783 >> 172.21.15.57:0/3190998783 conn(0x55770e255c50 msgr2=0x55770e25af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:38.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.295+0000 7f54b5501b80 1 -- 172.21.15.57:0/3190998783 shutdown_connections 2023-03-02T11:12:38.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.296+0000 7f54b5501b80 1 -- 172.21.15.57:0/3190998783 wait complete. 2023-03-02T11:12:38.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.296+0000 7f54b5501b80 20 client.16653 trim_cache size 0 max 16384 2023-03-02T11:12:38.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f54b5501b80 1 Processor -- start 2023-03-02T11:12:38.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f54b5501b80 1 -- start start 2023-03-02T11:12:38.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e260710 0x55770e26f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e264020 0x55770e2723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e272e30 0x55770e26cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f54b5501b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e26e090 con 0x55770e260710 2023-03-02T11:12:38.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f54b5501b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e289b00 con 0x55770e264020 2023-03-02T11:12:38.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f54b5501b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e25c1a0 con 0x55770e272e30 2023-03-02T11:12:38.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e260710 0x55770e26f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f5492ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e264020 0x55770e2723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f549bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e272e30 0x55770e26cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f5492ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e264020 0x55770e2723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:51412/0 (socket says 172.21.15.57:51412) 2023-03-02T11:12:38.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e260710 0x55770e26f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47378/0 (socket says 172.21.15.57:47378) 2023-03-02T11:12:38.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.312+0000 7f5492ffd700 1 -- 172.21.15.57:0/2713209576 learned_addr learned my addr 172.21.15.57:0/2713209576 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:12:38.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.313+0000 7f549b7fe700 1 -- 172.21.15.57:0/2713209576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e272e30 msgr2=0x55770e26cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:38.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.313+0000 7f549b7fe700 1 --2- 172.21.15.57:0/2713209576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e272e30 0x55770e26cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.313+0000 7f549b7fe700 1 -- 172.21.15.57:0/2713209576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e264020 msgr2=0x55770e2723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:38.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.313+0000 7f549b7fe700 1 --2- 172.21.15.57:0/2713209576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e264020 0x55770e2723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.313+0000 7f549b7fe700 1 -- 172.21.15.57:0/2713209576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55770e179190 con 0x55770e260710 2023-03-02T11:12:38.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.313+0000 7f549b7fe700 1 --2- 172.21.15.57:0/2713209576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e260710 0x55770e26f280 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f548c091260 tx=0x7f548c010bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a34eb87a7d51709 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:38.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.313+0000 7f54927fc700 1 -- 172.21.15.57:0/2713209576 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0981b0 con 0x55770e260710 2023-03-02T11:12:38.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.313+0000 7f54927fc700 1 -- 172.21.15.57:0/2713209576 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f548c0947f0 con 0x55770e260710 2023-03-02T11:12:38.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.313+0000 7f54927fc700 1 -- 172.21.15.57:0/2713209576 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c094a50 con 0x55770e260710 2023-03-02T11:12:38.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.314+0000 7f54b5501b80 1 -- 172.21.15.57:0/2713209576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e260710 msgr2=0x55770e26f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:38.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.314+0000 7f54b5501b80 1 --2- 172.21.15.57:0/2713209576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e260710 0x55770e26f280 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f548c091260 tx=0x7f548c010bb0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.314+0000 7f54b5501b80 1 -- 172.21.15.57:0/2713209576 shutdown_connections 2023-03-02T11:12:38.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.314+0000 7f54b5501b80 1 --2- 172.21.15.57:0/2713209576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e272e30 0x55770e26cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.314+0000 7f54b5501b80 1 --2- 172.21.15.57:0/2713209576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e260710 0x55770e26f280 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.314+0000 7f54b5501b80 1 --2- 172.21.15.57:0/2713209576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e264020 0x55770e2723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.314+0000 7f54b5501b80 1 -- 172.21.15.57:0/2713209576 >> 172.21.15.57:0/2713209576 conn(0x55770e255c50 msgr2=0x55770e27e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:38.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.314+0000 7f54b5501b80 1 -- 172.21.15.57:0/2713209576 shutdown_connections 2023-03-02T11:12:38.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.314+0000 7f54b5501b80 1 -- 172.21.15.57:0/2713209576 wait complete. 2023-03-02T11:12:38.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.314+0000 7f54b5501b80 1 -- start start 2023-03-02T11:12:38.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.314+0000 7f54b5501b80 1 Processor -- start 2023-03-02T11:12:38.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e260710 0x55770e279960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 0x55770e277c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f54b5501b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e272e30 0x55770e2781f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f54b5501b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e278950 con 0x55770e264020 2023-03-02T11:12:38.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f54b5501b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e278ac0 con 0x55770e272e30 2023-03-02T11:12:38.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f54b5501b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770e2d4400 con 0x55770e260710 2023-03-02T11:12:38.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f54b5501b80 10 client.0 _ll_register_callbacks cb 0x55770e158520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:12:38.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e272e30 0x55770e2781f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f5492ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 0x55770e277c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e260710 0x55770e279960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e272e30 0x55770e2781f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:51426/0 (socket says 172.21.15.57:51426) 2023-03-02T11:12:38.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549bfff700 1 -- 172.21.15.57:0/4043875604 learned_addr learned my addr 172.21.15.57:0/4043875604 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:12:38.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e260710 0x55770e279960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:59490/0 (socket says 172.21.15.57:59490) 2023-03-02T11:12:38.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f5492ffd700 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 0x55770e277c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47380/0 (socket says 172.21.15.57:47380) 2023-03-02T11:12:38.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549bfff700 1 -- 172.21.15.57:0/4043875604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e260710 msgr2=0x55770e279960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:38.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549bfff700 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e260710 0x55770e279960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549bfff700 1 -- 172.21.15.57:0/4043875604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 msgr2=0x55770e277c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:12:38.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549bfff700 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 0x55770e277c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549bfff700 1 -- 172.21.15.57:0/4043875604 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55770e034630 con 0x55770e272e30 2023-03-02T11:12:38.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549b7fe700 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e260710 0x55770e279960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:12:38.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f549bfff700 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e272e30 0x55770e2781f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5494026a20 tx=0x7f5494026df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6c9035652dc0d5 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:12:38.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.315+0000 7f547affd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:12:38.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f547affd700 1 -- 172.21.15.57:0/4043875604 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549400e040 con 0x55770e272e30 2023-03-02T11:12:38.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f54b5501b80 1 -- 172.21.15.57:0/4043875604 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f548c090b30 con 0x55770e272e30 2023-03-02T11:12:38.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f547affd700 1 -- 172.21.15.57:0/4043875604 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f549401a040 con 0x55770e272e30 2023-03-02T11:12:38.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f547affd700 1 -- 172.21.15.57:0/4043875604 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5494026630 con 0x55770e272e30 2023-03-02T11:12:38.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f54b5501b80 10 client.26501 fetch_fsmap learned FSMap version 47 2023-03-02T11:12:38.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f54b5501b80 1 -- 172.21.15.57:0/4043875604 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55770e007250 con 0x55770e272e30 2023-03-02T11:12:38.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f547affd700 1 -- 172.21.15.57:0/4043875604 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f548c090b30 con 0x55770e272e30 2023-03-02T11:12:38.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f547affd700 1 -- 172.21.15.57:0/4043875604 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5494003d00 con 0x55770e272e30 2023-03-02T11:12:38.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f54b5501b80 10 client.26501 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:12:38.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f54b5501b80 10 client.26501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:12:38.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f54b5501b80 20 client.26501 populate_metadata read hostname 'smithi057' 2023-03-02T11:12:38.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f54b5501b80 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55770e2d5a80 0x55770e2d7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:12:38.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f54b5501b80 4 client.26501 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:12:38.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f54b5501b80 1 -- 172.21.15.57:0/4043875604 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55770e1aae90 con 0x55770e2d5a80 2023-03-02T11:12:38.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.316+0000 7f549b7fe700 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55770e2d5a80 0x55770e2d7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:38.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f549b7fe700 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55770e2d5a80 0x55770e2d7e90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72f5a58d6ebb0191 server_cookie=a2b6054b2d559cc5 in_seq=0 out_seq=0 2023-03-02T11:12:38.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f547affd700 10 client.26501 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:12:38.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f547affd700 1 -- 172.21.15.57:0/4043875604 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55770e1aae90 con 0x55770e2d5a80 2023-03-02T11:12:38.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f547affd700 10 client.26501 handle_command_reply: tid=0 2023-03-02T11:12:38.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 1 client.26501 shutdown 2023-03-02T11:12:38.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 1 -- 172.21.15.57:0/4043875604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e272e30 msgr2=0x55770e2781f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:38.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e272e30 0x55770e2781f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5494026a20 tx=0x7f5494026df0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 1 -- 172.21.15.57:0/4043875604 shutdown_connections 2023-03-02T11:12:38.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55770e2d5a80 0x55770e2d7e90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55770e272e30 0x55770e2781f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f547affd700 0 client.26501 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:12:38.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55770e260710 0x55770e279960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 1 --2- 172.21.15.57:0/4043875604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55770e264020 0x55770e277c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 1 -- 172.21.15.57:0/4043875604 >> 172.21.15.57:0/4043875604 conn(0x55770e255c50 msgr2=0x55770e26cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:38.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 1 -- 172.21.15.57:0/4043875604 shutdown_connections 2023-03-02T11:12:38.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 1 -- 172.21.15.57:0/4043875604 wait complete. 2023-03-02T11:12:38.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.317+0000 7f54b5501b80 20 client.26501 trim_cache size 0 max 16384 2023-03-02T11:12:38.332 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:12:38.333 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:12:38.333 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:12:38.333 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:12:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:12:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:12:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:12:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:12:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:12:38.335 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:12:38.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 -- 172.21.15.57:0/375331245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f548809b480 msgr2=0x7f548809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:38.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f548809b480 0x7f548809d930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5484009fd0 tx=0x7f5484019040 comp rx=0 tx=0).stop 2023-03-02T11:12:38.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 -- 172.21.15.57:0/375331245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f549c100ce0 msgr2=0x7f549c19b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:12:38.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f549c100ce0 0x7f549c19b9e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f548c00e9a0 tx=0x7f548c00ecb0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 -- 172.21.15.57:0/375331245 shutdown_connections 2023-03-02T11:12:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f548809b480 0x7f548809d930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f549c10a020 0x7f549c195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f549c100ce0 0x7f549c19b9e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 --2- 172.21.15.57:0/375331245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f549c1015f0 0x7f549c19bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:12:38.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 -- 172.21.15.57:0/375331245 >> 172.21.15.57:0/375331245 conn(0x7f549c0fa4b0 msgr2=0x7f549c10c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:12:38.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 -- 172.21.15.57:0/375331245 shutdown_connections 2023-03-02T11:12:38.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:12:38.318+0000 7f54a1bff700 1 -- 172.21.15.57:0/375331245 wait complete. 2023-03-02T11:12:38.340 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:12:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:38 smithi057 ceph-mon[92072]: pgmap v489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:38 smithi136 ceph-mon[125702]: pgmap v489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:38 smithi122 ceph-mon[125440]: pgmap v489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:40 smithi136 ceph-mon[125702]: pgmap v490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:40 smithi057 ceph-mon[92072]: pgmap v490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:40 smithi122 ceph-mon[125440]: pgmap v490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:42 smithi057 ceph-mon[92072]: pgmap v491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:42 smithi122 ceph-mon[125440]: pgmap v491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:42 smithi136 ceph-mon[125702]: pgmap v491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:44 smithi057 ceph-mon[92072]: pgmap v492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:44 smithi122 ceph-mon[125440]: pgmap v492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:44 smithi136 ceph-mon[125702]: pgmap v492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:46 smithi057 ceph-mon[92072]: pgmap v493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:46 smithi122 ceph-mon[125440]: pgmap v493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:46 smithi136 ceph-mon[125702]: pgmap v493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:48 smithi057 ceph-mon[92072]: pgmap v494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:48 smithi122 ceph-mon[125440]: pgmap v494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:48 smithi136 ceph-mon[125702]: pgmap v494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:49.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:12:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:49.435+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:12:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:49.435+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:12:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:49.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:12:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:12:49.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:12:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:50 smithi057 ceph-mon[92072]: pgmap v495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:50 smithi122 ceph-mon[125440]: pgmap v495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:50 smithi136 ceph-mon[125702]: pgmap v495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:52 smithi057 ceph-mon[92072]: pgmap v496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:52 smithi122 ceph-mon[125440]: pgmap v496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:52 smithi136 ceph-mon[125702]: pgmap v496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:54 smithi057 ceph-mon[92072]: pgmap v497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:54 smithi122 ceph-mon[125440]: pgmap v497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:54 smithi136 ceph-mon[125702]: pgmap v497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:56 smithi057 ceph-mon[92072]: pgmap v498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:56 smithi122 ceph-mon[125440]: pgmap v498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:56 smithi136 ceph-mon[125702]: pgmap v498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:12:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:12:58 smithi057 ceph-mon[92072]: pgmap v499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:12:58 smithi122 ceph-mon[125440]: pgmap v499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:12:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:12:58 smithi136 ceph-mon[125702]: pgmap v499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:00 smithi057 ceph-mon[92072]: pgmap v500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:00 smithi122 ceph-mon[125440]: pgmap v500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:00 smithi136 ceph-mon[125702]: pgmap v500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:02 smithi057 ceph-mon[92072]: pgmap v501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:02 smithi122 ceph-mon[125440]: pgmap v501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:02 smithi136 ceph-mon[125702]: pgmap v501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:04.449+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:04.449+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:13:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:04.449+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:13:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:04.449+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:13:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:04.449+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:13:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:04 smithi057 ceph-mon[92072]: pgmap v502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:13:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:04 smithi122 ceph-mon[125440]: pgmap v502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:13:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:04 smithi136 ceph-mon[125702]: pgmap v502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:13:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:06 smithi057 ceph-mon[92072]: pgmap v503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:13:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:06 smithi122 ceph-mon[125440]: pgmap v503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:13:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:06 smithi136 ceph-mon[125702]: pgmap v503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:13:08.341 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:13:08.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.512+0000 7f6a61fff700 1 -- 172.21.15.57:0/3806673701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5c100c80 msgr2=0x7f6a5c101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:08.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.512+0000 7f6a61fff700 1 --2- 172.21.15.57:0/3806673701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5c100c80 0x7f6a5c101050 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00b0a0 tx=0x7f6a4c00b3b0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.512+0000 7f6a61fff700 1 -- 172.21.15.57:0/3806673701 shutdown_connections 2023-03-02T11:13:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.512+0000 7f6a61fff700 1 --2- 172.21.15.57:0/3806673701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c10a050 0x7f6a5c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.512+0000 7f6a61fff700 1 --2- 172.21.15.57:0/3806673701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5c100c80 0x7f6a5c101050 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.512+0000 7f6a61fff700 1 --2- 172.21.15.57:0/3806673701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a5c101590 0x7f6a5c109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.512+0000 7f6a61fff700 1 -- 172.21.15.57:0/3806673701 >> 172.21.15.57:0/3806673701 conn(0x7f6a5c0fa4b0 msgr2=0x7f6a5c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.512+0000 7f6a61fff700 1 -- 172.21.15.57:0/3806673701 shutdown_connections 2023-03-02T11:13:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.512+0000 7f6a61fff700 1 -- 172.21.15.57:0/3806673701 wait complete. 2023-03-02T11:13:08.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.513+0000 7f6a61fff700 1 Processor -- start 2023-03-02T11:13:08.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.513+0000 7f6a61fff700 1 -- start start 2023-03-02T11:13:08.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.513+0000 7f6a61fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a5c100c80 0x7f6a5c0fe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.513+0000 7f6a61fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c101590 0x7f6a5c0fee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.513+0000 7f6a61fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5c10a050 0x7f6a5c1a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.513+0000 7f6a61fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0ff6b0 con 0x7f6a5c10a050 2023-03-02T11:13:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.513+0000 7f6a61fff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1a4470 con 0x7f6a5c101590 2023-03-02T11:13:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.513+0000 7f6a61fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1a45b0 con 0x7f6a5c100c80 2023-03-02T11:13:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.513+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a5c100c80 0x7f6a5c0fe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.513+0000 7f6a52ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c101590 0x7f6a5c0fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a5c100c80 0x7f6a5c0fe8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:56216/0 (socket says 172.21.15.57:56216) 2023-03-02T11:13:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a5b7fe700 1 -- 172.21.15.57:0/2198606724 learned_addr learned my addr 172.21.15.57:0/2198606724 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:13:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a5bfff700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5c10a050 0x7f6a5c1a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2198606724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a5c100c80 msgr2=0x7f6a5c0fe8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a5c100c80 0x7f6a5c0fe8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2198606724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5c10a050 msgr2=0x7f6a5c1a3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5c10a050 0x7f6a5c1a3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2198606724 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c009d00 con 0x7f6a5c101590 2023-03-02T11:13:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a5bfff700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5c10a050 0x7f6a5c1a3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:13:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c101590 0x7f6a5c0fee10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400ea20 tx=0x7f6a4400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a597fa700 1 -- 172.21.15.57:0/2198606724 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400cbd0 con 0x7f6a5c101590 2023-03-02T11:13:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a61fff700 1 -- 172.21.15.57:0/2198606724 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c10fac0 con 0x7f6a5c101590 2023-03-02T11:13:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a597fa700 1 -- 172.21.15.57:0/2198606724 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a4400ee60 con 0x7f6a5c101590 2023-03-02T11:13:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a597fa700 1 -- 172.21.15.57:0/2198606724 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44018680 con 0x7f6a5c101590 2023-03-02T11:13:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.514+0000 7f6a61fff700 1 -- 172.21.15.57:0/2198606724 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c10f930 con 0x7f6a5c101590 2023-03-02T11:13:08.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.517+0000 7f6a597fa700 1 -- 172.21.15.57:0/2198606724 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7f6a4400c040 con 0x7f6a5c101590 2023-03-02T11:13:08.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.518+0000 7f6a597fa700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f6a4809b480 0x7f6a4809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.518+0000 7f6a758c1b80 1 Processor -- start 2023-03-02T11:13:08.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.518+0000 7f6a597fa700 1 -- 172.21.15.57:0/2198606724 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f6a44014070 con 0x7f6a5c101590 2023-03-02T11:13:08.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.518+0000 7f6a5b7fe700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f6a4809b480 0x7f6a4809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.518+0000 7f6a758c1b80 1 -- start start 2023-03-02T11:13:08.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3022853c0 0x55f302285790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f302285cd0 0x55f302289bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f30228a110 0x55f30228a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3021eca60 con 0x55f302285cd0 2023-03-02T11:13:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f30219ef80 con 0x55f3022853c0 2023-03-02T11:13:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f30216f160 con 0x55f30228a110 2023-03-02T11:13:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a5b7fe700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f6a4809b480 0x7f6a4809d930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009fd0 tx=0x7f6a4c006210 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3022853c0 0x55f302285790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3022853c0 0x55f302285790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:58534/0 (socket says 172.21.15.57:58534) 2023-03-02T11:13:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a5b7fe700 1 -- 172.21.15.57:0/3075534718 learned_addr learned my addr 172.21.15.57:0/3075534718 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:13:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/3075534718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f302285cd0 0x55f302289bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a5bfff700 1 --2- 172.21.15.57:0/3075534718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f30228a110 0x55f30228a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a5b7fe700 1 -- 172.21.15.57:0/3075534718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f30228a110 msgr2=0x55f30228a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a5b7fe700 1 --2- 172.21.15.57:0/3075534718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f30228a110 0x55f30228a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a5b7fe700 1 -- 172.21.15.57:0/3075534718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f302285cd0 msgr2=0x55f302289bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a5b7fe700 1 --2- 172.21.15.57:0/3075534718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f302285cd0 0x55f302289bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a5b7fe700 1 -- 172.21.15.57:0/3075534718 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f302059630 con 0x55f3022853c0 2023-03-02T11:13:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.519+0000 7f6a5b7fe700 1 --2- 172.21.15.57:0/3075534718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3022853c0 0x55f302285790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00be20 tx=0x7f6a4c01c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=264245b4f8d46fdd server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a51ffb700 1 -- 172.21.15.57:0/3075534718 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c00e040 con 0x55f3022853c0 2023-03-02T11:13:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a51ffb700 1 -- 172.21.15.57:0/3075534718 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a4c0050c0 con 0x55f3022853c0 2023-03-02T11:13:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a51ffb700 1 -- 172.21.15.57:0/3075534718 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0079a0 con 0x55f3022853c0 2023-03-02T11:13:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a758c1b80 1 -- 172.21.15.57:0/3075534718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3022853c0 msgr2=0x55f302285790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/3075534718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3022853c0 0x55f302285790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00be20 tx=0x7f6a4c01c000 comp rx=0 tx=0).stop 2023-03-02T11:13:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a758c1b80 1 -- 172.21.15.57:0/3075534718 shutdown_connections 2023-03-02T11:13:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/3075534718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f30228a110 0x55f30228a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/3075534718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f3022853c0 0x55f302285790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/3075534718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f302285cd0 0x55f302289bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a758c1b80 1 -- 172.21.15.57:0/3075534718 >> 172.21.15.57:0/3075534718 conn(0x55f30227ac50 msgr2=0x55f302280460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a758c1b80 1 -- 172.21.15.57:0/3075534718 shutdown_connections 2023-03-02T11:13:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.520+0000 7f6a758c1b80 1 -- 172.21.15.57:0/3075534718 wait complete. 2023-03-02T11:13:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.521+0000 7f6a758c1b80 1 -- start start 2023-03-02T11:13:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.521+0000 7f6a758c1b80 1 Processor -- start 2023-03-02T11:13:08.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.521+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30228ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.521+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f30228f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30228a110 0x55f30228f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3021ddbc0 con 0x55f3022853c0 2023-03-02T11:13:08.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3021d70f0 con 0x55f30228a110 2023-03-02T11:13:08.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f30205b920 con 0x55f302285cd0 2023-03-02T11:13:08.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a758c1b80 10 client.0 _ll_register_callbacks cb 0x55f30217d520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:13:08.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30228ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30228ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60284/0 (socket says 172.21.15.57:60284) 2023-03-02T11:13:08.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a52ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f30228f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a5bfff700 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30228a110 0x55f30228f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a5b7fe700 1 -- 172.21.15.57:0/2587163990 learned_addr learned my addr 172.21.15.57:0/2587163990 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:13:08.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2587163990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30228a110 msgr2=0x55f30228f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:08.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30228a110 0x55f30228f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2587163990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 msgr2=0x55f30228ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:08.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30228ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2587163990 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c10d150 con 0x55f302285cd0 2023-03-02T11:13:08.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a5b7fe700 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30228ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:13:08.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f30228f220 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6a440943e0 tx=0x7f6a44094c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c481e93dc7eb3e55 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:08.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.522+0000 7f6a3affd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:13:08.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a3affd700 1 -- 172.21.15.57:0/2587163990 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44094040 con 0x55f302285cd0 2023-03-02T11:13:08.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2587163990 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3021a87b0 con 0x55f302285cd0 2023-03-02T11:13:08.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a3affd700 1 -- 172.21.15.57:0/2587163990 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f6a44010e40 con 0x55f302285cd0 2023-03-02T11:13:08.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a3affd700 1 -- 172.21.15.57:0/2587163990 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a440980b0 con 0x55f302285cd0 2023-03-02T11:13:08.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a758c1b80 10 client.26461 fetch_fsmap learned FSMap version 47 2023-03-02T11:13:08.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2587163990 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55f302005de0 con 0x55f302285cd0 2023-03-02T11:13:08.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a3affd700 1 -- 172.21.15.57:0/2587163990 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a44060080 con 0x55f302285cd0 2023-03-02T11:13:08.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a3affd700 1 -- 172.21.15.57:0/2587163990 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6a440937d0 con 0x55f302285cd0 2023-03-02T11:13:08.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a758c1b80 10 client.26461 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:13:08.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a758c1b80 10 client.26461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:13:08.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a758c1b80 20 client.26461 populate_metadata read hostname 'smithi057' 2023-03-02T11:13:08.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55f30229f2b0 0x55f3022a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a758c1b80 4 client.26461 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:13:08.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.523+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2587163990 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3021d0170 con 0x55f30229f2b0 2023-03-02T11:13:08.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.524+0000 7f6a5b7fe700 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55f30229f2b0 0x55f3022a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.524+0000 7f6a3affd700 10 client.26461 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:13:08.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.524+0000 7f6a5b7fe700 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55f30229f2b0 0x55f3022a16c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=716072bca0995c87 server_cookie=9e4693e25e1614de in_seq=0 out_seq=0 2023-03-02T11:13:08.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a3affd700 1 -- 172.21.15.57:0/2587163990 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55f3021d0170 con 0x55f30229f2b0 2023-03-02T11:13:08.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a3affd700 10 client.26461 handle_command_reply: tid=0 2023-03-02T11:13:08.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 1 client.26461 shutdown 2023-03-02T11:13:08.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2587163990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 msgr2=0x55f30228f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:08.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f30228f220 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6a440943e0 tx=0x7f6a44094c20 comp rx=0 tx=0).stop 2023-03-02T11:13:08.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2587163990 shutdown_connections 2023-03-02T11:13:08.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55f30229f2b0 0x55f3022a16c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30228a110 0x55f30228f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30228ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2587163990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f30228f220 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a3affd700 0 client.26461 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:13:08.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2587163990 >> 172.21.15.57:0/2587163990 conn(0x55f30227ac50 msgr2=0x55f30227fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:08.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2587163990 shutdown_connections 2023-03-02T11:13:08.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2587163990 wait complete. 2023-03-02T11:13:08.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.525+0000 7f6a758c1b80 20 client.26461 trim_cache size 0 max 16384 2023-03-02T11:13:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a758c1b80 1 Processor -- start 2023-03-02T11:13:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a758c1b80 1 -- start start 2023-03-02T11:13:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 0x55f30229a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30229acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f30228c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f30228d240 con 0x55f3022853c0 2023-03-02T11:13:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3022a6290 con 0x55f30227ac50 2023-03-02T11:13:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f302289ab0 con 0x55f302285cd0 2023-03-02T11:13:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a52ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30229acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a5bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f30228c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 0x55f30229a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a52ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30229acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60292/0 (socket says 172.21.15.57:60292) 2023-03-02T11:13:08.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a5bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f30228c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:56246/0 (socket says 172.21.15.57:56246) 2023-03-02T11:13:08.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2079884642 learned_addr learned my addr 172.21.15.57:0/2079884642 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:13:08.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2079884642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 msgr2=0x55f30228c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:08.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2079884642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f30228c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2079884642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 msgr2=0x55f30229a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:08.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2079884642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 0x55f30229a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.542+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2079884642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f30219e190 con 0x55f3022853c0 2023-03-02T11:13:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2079884642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30229acc0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6a44090be0 tx=0x7f6a44010b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb6cded4c3a6d16 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a527fc700 1 -- 172.21.15.57:0/2079884642 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44095070 con 0x55f3022853c0 2023-03-02T11:13:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a527fc700 1 -- 172.21.15.57:0/2079884642 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f3021a87b0 con 0x55f3022853c0 2023-03-02T11:13:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a527fc700 1 -- 172.21.15.57:0/2079884642 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44095490 con 0x55f3022853c0 2023-03-02T11:13:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2079884642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 msgr2=0x55f30229acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2079884642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30229acc0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6a44090be0 tx=0x7f6a44010b40 comp rx=0 tx=0).stop 2023-03-02T11:13:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2079884642 shutdown_connections 2023-03-02T11:13:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2079884642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f30228c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2079884642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 0x55f30229a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2079884642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f30229acc0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2079884642 >> 172.21.15.57:0/2079884642 conn(0x55f302288cd0 msgr2=0x55f3022893a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2079884642 shutdown_connections 2023-03-02T11:13:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.543+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2079884642 wait complete. 2023-03-02T11:13:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a758c1b80 1 -- start start 2023-03-02T11:13:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a758c1b80 1 Processor -- start 2023-03-02T11:13:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 0x55f3022e9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f3022e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a758c1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f3022e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3022e5250 con 0x55f3022853c0 2023-03-02T11:13:08.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3022e53c0 con 0x55f30227ac50 2023-03-02T11:13:08.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a758c1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3022e5580 con 0x55f302285cd0 2023-03-02T11:13:08.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a758c1b80 10 client.0 _ll_register_callbacks cb 0x55f30217d520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:13:08.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 0x55f3022e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a52ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f3022e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 0x55f3022e9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:58560/0 (socket says 172.21.15.57:58560) 2023-03-02T11:13:08.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a5bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f3022e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.544+0000 7f6a5b7fe700 1 -- 172.21.15.57:0/2754894491 learned_addr learned my addr 172.21.15.57:0/2754894491 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:13:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2754894491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 msgr2=0x55f3022e4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f3022e4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2754894491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 msgr2=0x55f3022e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 0x55f3022e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a52ffd700 1 -- 172.21.15.57:0/2754894491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f302005de0 con 0x55f3022853c0 2023-03-02T11:13:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a5b7fe700 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 0x55f3022e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:13:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a52ffd700 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f3022e9ba0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6a440943e0 tx=0x7f6a44093b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b915bfcf21736b86 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a3affd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:13:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a3affd700 1 -- 172.21.15.57:0/2754894491 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440906d0 con 0x55f3022853c0 2023-03-02T11:13:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a3affd700 1 -- 172.21.15.57:0/2754894491 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8642+0+0 (secure 0 0 0) 0x7f6a44010e40 con 0x55f3022853c0 2023-03-02T11:13:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2754894491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a4c0050c0 con 0x55f3022853c0 2023-03-02T11:13:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a3affd700 1 -- 172.21.15.57:0/2754894491 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a44094040 con 0x55f3022853c0 2023-03-02T11:13:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a758c1b80 10 client.16677 fetch_fsmap learned FSMap version 47 2023-03-02T11:13:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.545+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2754894491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55f30202c250 con 0x55f3022853c0 2023-03-02T11:13:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.546+0000 7f6a3affd700 1 -- 172.21.15.57:0/2754894491 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a440a6020 con 0x55f3022853c0 2023-03-02T11:13:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.546+0000 7f6a3affd700 1 -- 172.21.15.57:0/2754894491 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6a44095280 con 0x55f3022853c0 2023-03-02T11:13:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.546+0000 7f6a758c1b80 10 client.16677 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:13:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.546+0000 7f6a758c1b80 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:13:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.546+0000 7f6a758c1b80 20 client.16677 populate_metadata read hostname 'smithi057' 2023-03-02T11:13:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.546+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55f30228a110 0x55f3022f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.546+0000 7f6a758c1b80 4 client.16677 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:13:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.546+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2754894491 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f3021cfe90 con 0x55f30228a110 2023-03-02T11:13:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.546+0000 7f6a5b7fe700 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55f30228a110 0x55f3022f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.546+0000 7f6a3affd700 10 client.16677 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:13:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.546+0000 7f6a5b7fe700 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55f30228a110 0x55f3022f40e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c4a790ee97b62a9 server_cookie=4633f383e0a1fd1e in_seq=0 out_seq=0 2023-03-02T11:13:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a3affd700 1 -- 172.21.15.57:0/2754894491 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f3021cfe90 con 0x55f30228a110 2023-03-02T11:13:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a3affd700 10 client.16677 handle_command_reply: tid=0 2023-03-02T11:13:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 1 client.16677 shutdown 2023-03-02T11:13:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2754894491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 msgr2=0x55f3022e9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:08.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f3022e9ba0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6a440943e0 tx=0x7f6a44093b00 comp rx=0 tx=0).stop 2023-03-02T11:13:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2754894491 shutdown_connections 2023-03-02T11:13:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55f30228a110 0x55f3022f40e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f302285cd0 0x55f3022e4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a3affd700 0 client.16677 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:13:08.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f30227ac50 0x55f3022e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 1 --2- 172.21.15.57:0/2754894491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3022853c0 0x55f3022e9ba0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2754894491 >> 172.21.15.57:0/2754894491 conn(0x55f302288cd0 msgr2=0x55f30229a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:08.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2754894491 shutdown_connections 2023-03-02T11:13:08.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 1 -- 172.21.15.57:0/2754894491 wait complete. 2023-03-02T11:13:08.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a758c1b80 20 client.16677 trim_cache size 0 max 16384 2023-03-02T11:13:08.560 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:13:08.560 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:13:08.561 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:13:08.561 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:13:08.561 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:13:08.561 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:13:08.561 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:13:08.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:13:08.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:13:08.562 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:13:08.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a61fff700 1 -- 172.21.15.57:0/2198606724 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f6a4809b480 msgr2=0x7f6a4809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:08.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a61fff700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f6a4809b480 0x7f6a4809d930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009fd0 tx=0x7f6a4c006210 comp rx=0 tx=0).stop 2023-03-02T11:13:08.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a61fff700 1 -- 172.21.15.57:0/2198606724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c101590 msgr2=0x7f6a5c0fee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:08.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.547+0000 7f6a61fff700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c101590 0x7f6a5c0fee10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400ea20 tx=0x7f6a4400ed30 comp rx=0 tx=0).stop 2023-03-02T11:13:08.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.548+0000 7f6a61fff700 1 -- 172.21.15.57:0/2198606724 shutdown_connections 2023-03-02T11:13:08.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.548+0000 7f6a61fff700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f6a4809b480 0x7f6a4809d930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.548+0000 7f6a61fff700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5c10a050 0x7f6a5c1a3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.548+0000 7f6a61fff700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a5c100c80 0x7f6a5c0fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.548+0000 7f6a61fff700 1 --2- 172.21.15.57:0/2198606724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c101590 0x7f6a5c0fee10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:08.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.548+0000 7f6a61fff700 1 -- 172.21.15.57:0/2198606724 >> 172.21.15.57:0/2198606724 conn(0x7f6a5c0fa4b0 msgr2=0x7f6a5c10b370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:08.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.548+0000 7f6a61fff700 1 -- 172.21.15.57:0/2198606724 shutdown_connections 2023-03-02T11:13:08.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:08.548+0000 7f6a61fff700 1 -- 172.21.15.57:0/2198606724 wait complete. 2023-03-02T11:13:08.566 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:13:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:08 smithi057 ceph-mon[92072]: pgmap v504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:13:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:08 smithi122 ceph-mon[125440]: pgmap v504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:13:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:08 smithi136 ceph-mon[125702]: pgmap v504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:13:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:10 smithi122 ceph-mon[125440]: pgmap v505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:13:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:10 smithi136 ceph-mon[125702]: pgmap v505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:13:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:10 smithi057 ceph-mon[92072]: pgmap v505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:13:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:11 smithi136 ceph-mon[125702]: osdmap e106: 12 total, 12 up, 12 in 2023-03-02T11:13:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:11 smithi057 ceph-mon[92072]: osdmap e106: 12 total, 12 up, 12 in 2023-03-02T11:13:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:11 smithi122 ceph-mon[125440]: osdmap e106: 12 total, 12 up, 12 in 2023-03-02T11:13:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:12 smithi136 ceph-mon[125702]: pgmap v507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:13:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:12 smithi057 ceph-mon[92072]: pgmap v507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:13:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:12 smithi122 ceph-mon[125440]: pgmap v507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:13:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:14 smithi136 ceph-mon[125702]: pgmap v508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:13:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:14 smithi136 ceph-mon[125702]: osdmap e107: 12 total, 12 up, 12 in 2023-03-02T11:13:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:14 smithi057 ceph-mon[92072]: pgmap v508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:13:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:14 smithi057 ceph-mon[92072]: osdmap e107: 12 total, 12 up, 12 in 2023-03-02T11:13:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:14 smithi122 ceph-mon[125440]: pgmap v508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:13:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:14 smithi122 ceph-mon[125440]: osdmap e107: 12 total, 12 up, 12 in 2023-03-02T11:13:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:16 smithi136 ceph-mon[125702]: pgmap v510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:13:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:16 smithi057 ceph-mon[92072]: pgmap v510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:13:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:16 smithi122 ceph-mon[125440]: pgmap v510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:13:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:18 smithi136 ceph-mon[125702]: pgmap v511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:13:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:18 smithi057 ceph-mon[92072]: pgmap v511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:13:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:18 smithi122 ceph-mon[125440]: pgmap v511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:13:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:19.460+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:19.461+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:13:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:19.461+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:13:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:19.461+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:13:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:19.461+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:13:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:20 smithi136 ceph-mon[125702]: pgmap v512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T11:13:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:20 smithi057 ceph-mon[92072]: pgmap v512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T11:13:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:20 smithi122 ceph-mon[125440]: pgmap v512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T11:13:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:22 smithi136 ceph-mon[125702]: pgmap v513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:13:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:22 smithi057 ceph-mon[92072]: pgmap v513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:13:22.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:22 smithi122 ceph-mon[125440]: pgmap v513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:13:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:24 smithi136 ceph-mon[125702]: pgmap v514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:13:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:24 smithi057 ceph-mon[92072]: pgmap v514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:13:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:24 smithi122 ceph-mon[125440]: pgmap v514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:13:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:26 smithi136 ceph-mon[125702]: pgmap v515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:13:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:26 smithi057 ceph-mon[92072]: pgmap v515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:13:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:26 smithi122 ceph-mon[125440]: pgmap v515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:13:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:28 smithi136 ceph-mon[125702]: pgmap v516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:13:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:28 smithi057 ceph-mon[92072]: pgmap v516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:13:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:28 smithi122 ceph-mon[125440]: pgmap v516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:13:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:30 smithi136 ceph-mon[125702]: pgmap v517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:30 smithi057 ceph-mon[92072]: pgmap v517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:30 smithi122 ceph-mon[125440]: pgmap v517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:32 smithi136 ceph-mon[125702]: pgmap v518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:13:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:32 smithi057 ceph-mon[92072]: pgmap v518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:13:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:32 smithi122 ceph-mon[125440]: pgmap v518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:13:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:34.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:34.471+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:13:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:34.471+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:13:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:34.471+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:13:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:34.471+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:13:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:34 smithi136 ceph-mon[125702]: pgmap v519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:13:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:13:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:13:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:34 smithi057 ceph-mon[92072]: pgmap v519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:13:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:13:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:13:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:34 smithi122 ceph-mon[125440]: pgmap v519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:13:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:13:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:13:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:36 smithi136 ceph-mon[125702]: pgmap v520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:36 smithi057 ceph-mon[92072]: pgmap v520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:36 smithi122 ceph-mon[125440]: pgmap v520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:38.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:13:38.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.739+0000 7fb202dff700 1 -- 172.21.15.57:0/1279434215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1fc105ae0 msgr2=0x7fb1fc105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:38.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.739+0000 7fb202dff700 1 --2- 172.21.15.57:0/1279434215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1fc105ae0 0x7fb1fc105eb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009990 tx=0x7fb1f0009ca0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.739+0000 7fb202dff700 1 -- 172.21.15.57:0/1279434215 shutdown_connections 2023-03-02T11:13:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.739+0000 7fb202dff700 1 --2- 172.21.15.57:0/1279434215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1fc100480 0x7fb1fc10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.739+0000 7fb202dff700 1 --2- 172.21.15.57:0/1279434215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1fc105ae0 0x7fb1fc105eb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.739+0000 7fb202dff700 1 --2- 172.21.15.57:0/1279434215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc0ffad0 0x7fb1fc0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.739+0000 7fb202dff700 1 -- 172.21.15.57:0/1279434215 >> 172.21.15.57:0/1279434215 conn(0x7fb1fc0fb610 msgr2=0x7fb1fc0fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.739+0000 7fb202dff700 1 -- 172.21.15.57:0/1279434215 shutdown_connections 2023-03-02T11:13:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.739+0000 7fb202dff700 1 -- 172.21.15.57:0/1279434215 wait complete. 2023-03-02T11:13:38.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb202dff700 1 Processor -- start 2023-03-02T11:13:38.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb202dff700 1 -- start start 2023-03-02T11:13:38.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb202dff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1fc0ffad0 0x7fb1fc19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb202dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc100480 0x7fb1fc19bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb202dff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1fc105ae0 0x7fb1fc195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb202dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc1960e0 con 0x7fb1fc100480 2023-03-02T11:13:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb202dff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc196250 con 0x7fb1fc105ae0 2023-03-02T11:13:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb202dff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc196410 con 0x7fb1fc0ffad0 2023-03-02T11:13:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb200b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1fc0ffad0 0x7fb1fc19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb200b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1fc0ffad0 0x7fb1fc19ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:59558/0 (socket says 172.21.15.57:59558) 2023-03-02T11:13:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb200b9b700 1 -- 172.21.15.57:0/237560835 learned_addr learned my addr 172.21.15.57:0/237560835 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:13:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.740+0000 7fb1fbfff700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc100480 0x7fb1fc19bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb20139c700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1fc105ae0 0x7fb1fc195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb200b9b700 1 -- 172.21.15.57:0/237560835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1fc105ae0 msgr2=0x7fb1fc195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb200b9b700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1fc105ae0 0x7fb1fc195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb200b9b700 1 -- 172.21.15.57:0/237560835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc100480 msgr2=0x7fb1fc19bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb200b9b700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc100480 0x7fb1fc19bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb200b9b700 1 -- 172.21.15.57:0/237560835 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e8009520 con 0x7fb1fc0ffad0 2023-03-02T11:13:38.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb200b9b700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1fc0ffad0 0x7fb1fc19ba00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0000c00 tx=0x7fb1f0004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:38.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb1f9ffb700 1 -- 172.21.15.57:0/237560835 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f001d070 con 0x7fb1fc0ffad0 2023-03-02T11:13:38.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb202dff700 1 -- 172.21.15.57:0/237560835 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f00095f0 con 0x7fb1fc0ffad0 2023-03-02T11:13:38.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb1f9ffb700 1 -- 172.21.15.57:0/237560835 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1f0021410 con 0x7fb1fc0ffad0 2023-03-02T11:13:38.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb1f9ffb700 1 -- 172.21.15.57:0/237560835 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0017650 con 0x7fb1fc0ffad0 2023-03-02T11:13:38.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.741+0000 7fb202dff700 1 -- 172.21.15.57:0/237560835 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc10fb10 con 0x7fb1fc0ffad0 2023-03-02T11:13:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.744+0000 7fb1f9ffb700 1 -- 172.21.15.57:0/237560835 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fb1f0028030 con 0x7fb1fc0ffad0 2023-03-02T11:13:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb1f9ffb700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb1ec09b480 0x7fb1ec09d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb21662bb80 1 Processor -- start 2023-03-02T11:13:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb21662bb80 1 -- start start 2023-03-02T11:13:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb1fbfff700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb1ec09b480 0x7fb1ec09d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb1f9ffb700 1 -- 172.21.15.57:0/237560835 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fb1f00c6380 con 0x7fb1fc0ffad0 2023-03-02T11:13:38.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 0x55bc3d79a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 0x55bc3d79ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d79f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb21662bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d701a60 con 0x55bc3d79f110 2023-03-02T11:13:38.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb21662bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d6b3f80 con 0x55bc3d79acd0 2023-03-02T11:13:38.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb21662bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d684160 con 0x55bc3d79a3c0 2023-03-02T11:13:38.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb20139c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d79f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb200b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 0x55bc3d79a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb1fbfff700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb1ec09b480 0x7fb1ec09d930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0fdf00 tx=0x7fb1e8009260 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.746+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 0x55bc3d79ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb200b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 0x55bc3d79a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:59574/0 (socket says 172.21.15.57:59574) 2023-03-02T11:13:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb200b9b700 1 -- 172.21.15.57:0/2018660197 learned_addr learned my addr 172.21.15.57:0/2018660197 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:13:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb1fbfff700 1 -- 172.21.15.57:0/2018660197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 msgr2=0x55bc3d79a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb1fbfff700 1 --2- 172.21.15.57:0/2018660197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 0x55bc3d79a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb1fbfff700 1 -- 172.21.15.57:0/2018660197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 msgr2=0x55bc3d79f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb1fbfff700 1 --2- 172.21.15.57:0/2018660197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d79f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb1fbfff700 1 -- 172.21.15.57:0/2018660197 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc3d56e630 con 0x55bc3d79acd0 2023-03-02T11:13:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb20139c700 1 --2- 172.21.15.57:0/2018660197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d79f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:13:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb1fbfff700 1 --2- 172.21.15.57:0/2018660197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 0x55bc3d79ebd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800e540 tx=0x7fb1e8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f3d8110a10e6f3 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb1e6ffd700 1 -- 172.21.15.57:0/2018660197 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8026430 con 0x55bc3d79acd0 2023-03-02T11:13:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb1e6ffd700 1 -- 172.21.15.57:0/2018660197 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1e8021070 con 0x55bc3d79acd0 2023-03-02T11:13:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.747+0000 7fb1e6ffd700 1 -- 172.21.15.57:0/2018660197 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8025730 con 0x55bc3d79acd0 2023-03-02T11:13:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.748+0000 7fb21662bb80 1 -- 172.21.15.57:0/2018660197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 msgr2=0x55bc3d79ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.748+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2018660197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 0x55bc3d79ebd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800e540 tx=0x7fb1e8014000 comp rx=0 tx=0).stop 2023-03-02T11:13:38.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.748+0000 7fb21662bb80 1 -- 172.21.15.57:0/2018660197 shutdown_connections 2023-03-02T11:13:38.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.748+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2018660197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d79f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.748+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2018660197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 0x55bc3d79a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.748+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2018660197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 0x55bc3d79ebd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.748+0000 7fb21662bb80 1 -- 172.21.15.57:0/2018660197 >> 172.21.15.57:0/2018660197 conn(0x55bc3d78fc50 msgr2=0x55bc3d795460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:38.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.748+0000 7fb21662bb80 1 -- 172.21.15.57:0/2018660197 shutdown_connections 2023-03-02T11:13:38.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.748+0000 7fb21662bb80 1 -- 172.21.15.57:0/2018660197 wait complete. 2023-03-02T11:13:38.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.748+0000 7fb21662bb80 1 -- start start 2023-03-02T11:13:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb21662bb80 1 Processor -- start 2023-03-02T11:13:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79f110 0x55bc3d7a4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb21662bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d6f2bc0 con 0x55bc3d79acd0 2023-03-02T11:13:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb21662bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d6ec0f0 con 0x55bc3d79a3c0 2023-03-02T11:13:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb21662bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d570920 con 0x55bc3d79f110 2023-03-02T11:13:38.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb21662bb80 10 client.0 _ll_register_callbacks cb 0x55bc3d692520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:13:38.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb200b9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb200b9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:39630/0 (socket says 172.21.15.57:39630) 2023-03-02T11:13:38.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb200b9b700 1 -- 172.21.15.57:0/2625072020 learned_addr learned my addr 172.21.15.57:0/2625072020 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:13:38.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb20139c700 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79f110 0x55bc3d7a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb200b9b700 1 -- 172.21.15.57:0/2625072020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79f110 msgr2=0x55bc3d7a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb200b9b700 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79f110 0x55bc3d7a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb200b9b700 1 -- 172.21.15.57:0/2625072020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79acd0 msgr2=0x55bc3d7a3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb200b9b700 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.749+0000 7fb200b9b700 1 -- 172.21.15.57:0/2625072020 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e8017070 con 0x55bc3d79a3c0 2023-03-02T11:13:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb200b9b700 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a6940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0092220 tx=0x7fb1f0021b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c36e40f3e93402b server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb1dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:13:38.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2625072020 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0095f00 con 0x55bc3d79a3c0 2023-03-02T11:13:38.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb21662bb80 1 -- 172.21.15.57:0/2625072020 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc3d6bd7b0 con 0x55bc3d79a3c0 2023-03-02T11:13:38.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2625072020 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fb1f0095800 con 0x55bc3d79a3c0 2023-03-02T11:13:38.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2625072020 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1f009ce90 con 0x55bc3d79a3c0 2023-03-02T11:13:38.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb21662bb80 10 client.26531 fetch_fsmap learned FSMap version 47 2023-03-02T11:13:38.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb21662bb80 1 -- 172.21.15.57:0/2625072020 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55bc3d51ade0 con 0x55bc3d79a3c0 2023-03-02T11:13:38.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2625072020 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bc3d6bd7b0 con 0x55bc3d79a3c0 2023-03-02T11:13:38.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2625072020 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb1f009cb00 con 0x55bc3d79a3c0 2023-03-02T11:13:38.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb21662bb80 10 client.26531 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:13:38.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb21662bb80 10 client.26531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:13:38.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.750+0000 7fb21662bb80 20 client.26531 populate_metadata read hostname 'smithi057' 2023-03-02T11:13:38.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.751+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55bc3d7b3f80 0x55bc3d7b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.751+0000 7fb21662bb80 4 client.26531 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:13:38.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.751+0000 7fb21662bb80 1 -- 172.21.15.57:0/2625072020 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc3d6e5170 con 0x55bc3d7b3f80 2023-03-02T11:13:38.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.751+0000 7fb1fbfff700 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55bc3d7b3f80 0x55bc3d7b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.751+0000 7fb1fbfff700 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55bc3d7b3f80 0x55bc3d7b6390 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd9cb0011d5ec6af server_cookie=432151de7487d146 in_seq=0 out_seq=0 2023-03-02T11:13:38.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.751+0000 7fb1dbfff700 10 client.26531 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:13:38.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2625072020 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55bc3d6e5170 con 0x55bc3d7b3f80 2023-03-02T11:13:38.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb1dbfff700 10 client.26531 handle_command_reply: tid=0 2023-03-02T11:13:38.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 1 client.26531 shutdown 2023-03-02T11:13:38.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 1 -- 172.21.15.57:0/2625072020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 msgr2=0x55bc3d7a6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:38.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a6940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0092220 tx=0x7fb1f0021b40 comp rx=0 tx=0).stop 2023-03-02T11:13:38.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 1 -- 172.21.15.57:0/2625072020 shutdown_connections 2023-03-02T11:13:38.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55bc3d7b3f80 0x55bc3d7b6390 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79f110 0x55bc3d7a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb1dbfff700 0 client.26531 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:13:38.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a6940 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2625072020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 1 -- 172.21.15.57:0/2625072020 >> 172.21.15.57:0/2625072020 conn(0x55bc3d78fc50 msgr2=0x55bc3d7946a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:38.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 1 -- 172.21.15.57:0/2625072020 shutdown_connections 2023-03-02T11:13:38.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 1 -- 172.21.15.57:0/2625072020 wait complete. 2023-03-02T11:13:38.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.752+0000 7fb21662bb80 20 client.26531 trim_cache size 0 max 16384 2023-03-02T11:13:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb21662bb80 1 Processor -- start 2023-03-02T11:13:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb21662bb80 1 -- start start 2023-03-02T11:13:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d79e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d7a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb21662bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d7baf40 con 0x55bc3d79f110 2023-03-02T11:13:38.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb21662bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d7b0c80 con 0x55bc3d79a3c0 2023-03-02T11:13:38.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb21662bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d7a4950 con 0x55bc3d79acd0 2023-03-02T11:13:38.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb200b9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d79e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb200b9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d79e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:39642/0 (socket says 172.21.15.57:39642) 2023-03-02T11:13:38.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb200b9b700 1 -- 172.21.15.57:0/1983490589 learned_addr learned my addr 172.21.15.57:0/1983490589 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:13:38.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.769+0000 7fb20139c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d7a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.770+0000 7fb200b9b700 1 -- 172.21.15.57:0/1983490589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79acd0 msgr2=0x55bc3d7a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:38.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.770+0000 7fb200b9b700 1 --2- 172.21.15.57:0/1983490589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.770+0000 7fb200b9b700 1 -- 172.21.15.57:0/1983490589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 msgr2=0x55bc3d7a64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:38.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.770+0000 7fb200b9b700 1 --2- 172.21.15.57:0/1983490589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d7a64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.770+0000 7fb200b9b700 1 -- 172.21.15.57:0/1983490589 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc3d7913f0 con 0x55bc3d79a3c0 2023-03-02T11:13:38.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.770+0000 7fb20139c700 1 --2- 172.21.15.57:0/1983490589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d7a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:13:38.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.770+0000 7fb200b9b700 1 --2- 172.21.15.57:0/1983490589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d79e8c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0091d00 tx=0x7fb1f0021790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb306bd4634540a server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:38.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.770+0000 7fb1e77fe700 1 -- 172.21.15.57:0/1983490589 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0095340 con 0x55bc3d79a3c0 2023-03-02T11:13:38.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.770+0000 7fb1e77fe700 1 -- 172.21.15.57:0/1983490589 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1f00c5040 con 0x55bc3d79a3c0 2023-03-02T11:13:38.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.770+0000 7fb1e77fe700 1 -- 172.21.15.57:0/1983490589 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f009cc60 con 0x55bc3d79a3c0 2023-03-02T11:13:38.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.771+0000 7fb21662bb80 1 -- 172.21.15.57:0/1983490589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 msgr2=0x55bc3d79e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:38.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.771+0000 7fb21662bb80 1 --2- 172.21.15.57:0/1983490589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d79e8c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0091d00 tx=0x7fb1f0021790 comp rx=0 tx=0).stop 2023-03-02T11:13:38.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.771+0000 7fb21662bb80 1 -- 172.21.15.57:0/1983490589 shutdown_connections 2023-03-02T11:13:38.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.771+0000 7fb21662bb80 1 --2- 172.21.15.57:0/1983490589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d7a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.771+0000 7fb21662bb80 1 --2- 172.21.15.57:0/1983490589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79a3c0 0x55bc3d79e8c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.771+0000 7fb21662bb80 1 --2- 172.21.15.57:0/1983490589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.771+0000 7fb21662bb80 1 -- 172.21.15.57:0/1983490589 >> 172.21.15.57:0/1983490589 conn(0x55bc3d78fc50 msgr2=0x55bc3d79e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.771+0000 7fb21662bb80 1 -- 172.21.15.57:0/1983490589 shutdown_connections 2023-03-02T11:13:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.771+0000 7fb21662bb80 1 -- 172.21.15.57:0/1983490589 wait complete. 2023-03-02T11:13:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.771+0000 7fb21662bb80 1 -- start start 2023-03-02T11:13:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.771+0000 7fb21662bb80 1 Processor -- start 2023-03-02T11:13:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb21662bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d7a2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb21662bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d7a2ed0 con 0x55bc3d79f110 2023-03-02T11:13:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb21662bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d7a3040 con 0x55bc3d79acd0 2023-03-02T11:13:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb21662bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3d7a31b0 con 0x55bc3d79a3c0 2023-03-02T11:13:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb21662bb80 10 client.0 _ll_register_callbacks cb 0x55bc3d692520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:13:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb200b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb200b9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:59604/0 (socket says 172.21.15.57:59604) 2023-03-02T11:13:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb200b9b700 1 -- 172.21.15.57:0/2658759558 learned_addr learned my addr 172.21.15.57:0/2658759558 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:13:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb20139c700 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d7a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb200b9b700 1 -- 172.21.15.57:0/2658759558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 msgr2=0x55bc3d7a2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb200b9b700 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb200b9b700 1 -- 172.21.15.57:0/2658759558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 msgr2=0x55bc3d7a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:13:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb200b9b700 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d7a2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb200b9b700 1 -- 172.21.15.57:0/2658759558 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f4017470 con 0x55bc3d79a3c0 2023-03-02T11:13:38.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb20139c700 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d7a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:13:38.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb1fbfff700 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:13:38.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb200b9b700 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a3810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0091690 tx=0x7fb1f00956a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e70da205c3dd653a server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:13:38.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.772+0000 7fb1dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2023-03-02T11:13:38.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2658759558 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0095800 con 0x55bc3d79a3c0 2023-03-02T11:13:38.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2658759558 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fb1f0095f00 con 0x55bc3d79a3c0 2023-03-02T11:13:38.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb21662bb80 1 -- 172.21.15.57:0/2658759558 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1e8021070 con 0x55bc3d79a3c0 2023-03-02T11:13:38.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2658759558 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1f009ce90 con 0x55bc3d79a3c0 2023-03-02T11:13:38.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb21662bb80 10 client.26485 fetch_fsmap learned FSMap version 47 2023-03-02T11:13:38.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb21662bb80 1 -- 172.21.15.57:0/2658759558 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55bc3d51ade0 con 0x55bc3d79a3c0 2023-03-02T11:13:38.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2658759558 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1e8021070 con 0x55bc3d79a3c0 2023-03-02T11:13:38.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2658759558 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb1f0096190 con 0x55bc3d79a3c0 2023-03-02T11:13:38.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb21662bb80 10 client.26485 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:13:38.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb21662bb80 10 client.26485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:13:38.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb21662bb80 20 client.26485 populate_metadata read hostname 'smithi057' 2023-03-02T11:13:38.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55bc3d8067c0 0x55bc3d808ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:13:38.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb21662bb80 4 client.26485 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:13:38.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb21662bb80 1 -- 172.21.15.57:0/2658759558 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bc3d6e4e90 con 0x55bc3d8067c0 2023-03-02T11:13:38.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.773+0000 7fb1fbfff700 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55bc3d8067c0 0x55bc3d808ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:38.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb1dbfff700 10 client.26485 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:13:38.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb1fbfff700 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55bc3d8067c0 0x55bc3d808ba0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39b11536cb0c0560 server_cookie=34760efd93ccc6e3 in_seq=0 out_seq=0 2023-03-02T11:13:38.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb1dbfff700 1 -- 172.21.15.57:0/2658759558 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55bc3d6e4e90 con 0x55bc3d8067c0 2023-03-02T11:13:38.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb1dbfff700 10 client.26485 handle_command_reply: tid=0 2023-03-02T11:13:38.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb21662bb80 1 client.26485 shutdown 2023-03-02T11:13:38.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb21662bb80 1 -- 172.21.15.57:0/2658759558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 msgr2=0x55bc3d7a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:38.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a3810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0091690 tx=0x7fb1f00956a0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb21662bb80 1 -- 172.21.15.57:0/2658759558 shutdown_connections 2023-03-02T11:13:38.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x55bc3d8067c0 0x55bc3d808ba0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc3d79f110 0x55bc3d7a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3d79a3c0 0x55bc3d7a3810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb21662bb80 1 --2- 172.21.15.57:0/2658759558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc3d79acd0 0x55bc3d7a2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb1dbfff700 0 client.26485 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:13:38.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb21662bb80 1 -- 172.21.15.57:0/2658759558 >> 172.21.15.57:0/2658759558 conn(0x55bc3d78fc50 msgr2=0x55bc3d79f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:38.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb21662bb80 1 -- 172.21.15.57:0/2658759558 shutdown_connections 2023-03-02T11:13:38.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.774+0000 7fb21662bb80 1 -- 172.21.15.57:0/2658759558 wait complete. 2023-03-02T11:13:38.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb21662bb80 20 client.26485 trim_cache size 0 max 16384 2023-03-02T11:13:38.787 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:13:38.787 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:13:38.787 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:13:38.787 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:13:38.787 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:13:38.787 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:13:38.788 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:13:38.788 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:13:38.788 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:13:38.788 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:13:38.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 -- 172.21.15.57:0/237560835 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb1ec09b480 msgr2=0x7fb1ec09d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:38.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb1ec09b480 0x7fb1ec09d930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0fdf00 tx=0x7fb1e8009260 comp rx=0 tx=0).stop 2023-03-02T11:13:38.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 -- 172.21.15.57:0/237560835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1fc0ffad0 msgr2=0x7fb1fc19ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:13:38.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1fc0ffad0 0x7fb1fc19ba00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0000c00 tx=0x7fb1f0004790 comp rx=0 tx=0).stop 2023-03-02T11:13:38.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 -- 172.21.15.57:0/237560835 shutdown_connections 2023-03-02T11:13:38.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fb1ec09b480 0x7fb1ec09d930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1fc105ae0 0x7fb1fc195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1fc0ffad0 0x7fb1fc19ba00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 --2- 172.21.15.57:0/237560835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1fc100480 0x7fb1fc19bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:13:38.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 -- 172.21.15.57:0/237560835 >> 172.21.15.57:0/237560835 conn(0x7fb1fc0fb610 msgr2=0x7fb1fc0fbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:13:38.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 -- 172.21.15.57:0/237560835 shutdown_connections 2023-03-02T11:13:38.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:13:38.775+0000 7fb202dff700 1 -- 172.21.15.57:0/237560835 wait complete. 2023-03-02T11:13:38.791 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:38 smithi057 ceph-mon[92072]: pgmap v521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:38.791 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:13:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:38 smithi136 ceph-mon[125702]: pgmap v521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:38 smithi122 ceph-mon[125440]: pgmap v521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:40 smithi136 ceph-mon[125702]: pgmap v522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:40 smithi057 ceph-mon[92072]: pgmap v522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:40 smithi122 ceph-mon[125440]: pgmap v522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:42 smithi136 ceph-mon[125702]: pgmap v523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:42 smithi057 ceph-mon[92072]: pgmap v523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:42 smithi122 ceph-mon[125440]: pgmap v523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:44 smithi136 ceph-mon[125702]: pgmap v524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:44 smithi057 ceph-mon[92072]: pgmap v524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:44 smithi122 ceph-mon[125440]: pgmap v524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:46 smithi136 ceph-mon[125702]: pgmap v525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:46 smithi057 ceph-mon[92072]: pgmap v525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:46 smithi122 ceph-mon[125440]: pgmap v525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:48 smithi136 ceph-mon[125702]: pgmap v526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:48 smithi057 ceph-mon[92072]: pgmap v526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:48 smithi122 ceph-mon[125440]: pgmap v526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:49.483+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:13:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:49.483+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:13:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:49.483+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:13:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:49.483+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:13:49.485 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:13:49.483+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:13:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:50 smithi136 ceph-mon[125702]: pgmap v527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:50 smithi057 ceph-mon[92072]: pgmap v527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:50 smithi122 ceph-mon[125440]: pgmap v527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:52 smithi136 ceph-mon[125702]: pgmap v528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:52 smithi057 ceph-mon[92072]: pgmap v528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:52 smithi122 ceph-mon[125440]: pgmap v528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:54 smithi136 ceph-mon[125702]: pgmap v529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:54 smithi057 ceph-mon[92072]: pgmap v529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:54 smithi122 ceph-mon[125440]: pgmap v529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:56 smithi136 ceph-mon[125702]: pgmap v530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:56 smithi057 ceph-mon[92072]: pgmap v530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:56 smithi122 ceph-mon[125440]: pgmap v530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:13:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:13:58 smithi057 ceph-mon[92072]: pgmap v531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:13:58 smithi122 ceph-mon[125440]: pgmap v531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:13:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:13:58 smithi136 ceph-mon[125702]: pgmap v531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:00 smithi057 ceph-mon[92072]: pgmap v532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:00 smithi122 ceph-mon[125440]: pgmap v532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:00 smithi136 ceph-mon[125702]: pgmap v532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:02 smithi057 ceph-mon[92072]: pgmap v533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:02 smithi122 ceph-mon[125440]: pgmap v533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:02 smithi136 ceph-mon[125702]: pgmap v533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:04.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:04.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:04.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:14:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:04.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:14:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:04.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:14:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:04.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:14:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:04 smithi057 ceph-mon[92072]: pgmap v534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:14:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:04 smithi122 ceph-mon[125440]: pgmap v534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:14:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:04 smithi136 ceph-mon[125702]: pgmap v534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:14:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:06 smithi057 ceph-mon[92072]: pgmap v535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:14:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:06 smithi122 ceph-mon[125440]: pgmap v535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:14:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:06 smithi136 ceph-mon[125702]: pgmap v535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.369+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T11:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.369+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T11:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.369+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809d9b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58700044f0 tx=0x7f5870009260 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.369+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809d9b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58700044f0 tx=0x7f5870009260 comp rx=0 tx=0).stop 2023-03-02T11:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.369+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809d9b0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T11:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.369+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809d9b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T11:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.369+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809d9b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.369+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a50b0 0x7f58680a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.369+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a50b0 0x7f58680a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.369+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a50b0 0x7f58680a7490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5870029040 tx=0x7f5870040000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:14:08.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.488+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006300 con 0x7f5880105ae0 2023-03-02T11:14:08.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.489+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006300 con 0x7f5880105ae0 2023-03-02T11:14:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.510+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500061e0 con 0x558558b6f6b0 2023-03-02T11:14:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:08.511+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500061e0 con 0x558558b6f6b0 2023-03-02T11:14:08.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-02T11:14:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:08 smithi057 ceph-mon[92072]: pgmap v536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:14:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:08 smithi122 ceph-mon[125440]: pgmap v536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:14:08.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.964+0000 7fafd71ff700 1 -- 172.21.15.57:0/1768934266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafd0101590 msgr2=0x7fafd0109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:14:08.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.964+0000 7fafd71ff700 1 --2- 172.21.15.57:0/1768934266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafd0101590 0x7fafd0109a80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fafc00098f0 tx=0x7fafc0009c00 comp rx=0 tx=0).stop 2023-03-02T11:14:08.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.964+0000 7fafd71ff700 1 -- 172.21.15.57:0/1768934266 shutdown_connections 2023-03-02T11:14:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.964+0000 7fafd71ff700 1 --2- 172.21.15.57:0/1768934266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafd010a050 0x7fafd010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.964+0000 7fafd71ff700 1 --2- 172.21.15.57:0/1768934266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafd0100c80 0x7fafd0101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.964+0000 7fafd71ff700 1 --2- 172.21.15.57:0/1768934266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafd0101590 0x7fafd0109a80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.964+0000 7fafd71ff700 1 -- 172.21.15.57:0/1768934266 >> 172.21.15.57:0/1768934266 conn(0x7fafd00fa4b0 msgr2=0x7fafd00fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:14:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.964+0000 7fafd71ff700 1 -- 172.21.15.57:0/1768934266 shutdown_connections 2023-03-02T11:14:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.964+0000 7fafd71ff700 1 -- 172.21.15.57:0/1768934266 wait complete. 2023-03-02T11:14:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.965+0000 7fafd71ff700 1 Processor -- start 2023-03-02T11:14:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.965+0000 7fafd71ff700 1 -- start start 2023-03-02T11:14:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.965+0000 7fafd71ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafd0100c80 0x7fafd019b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.965+0000 7fafd71ff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafd0101590 0x7fafd019bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.965+0000 7fafd71ff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafd010a050 0x7fafd0195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.965+0000 7fafd71ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd01960c0 con 0x7fafd0100c80 2023-03-02T11:14:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.965+0000 7fafd71ff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd0196230 con 0x7fafd0101590 2023-03-02T11:14:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.965+0000 7fafd71ff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd01963f0 con 0x7fafd010a050 2023-03-02T11:14:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafd4f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafd0100c80 0x7fafd019b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc7fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafd0101590 0x7fafd019bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc7fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafd0101590 0x7fafd019bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:53648/0 (socket says 172.21.15.57:53648) 2023-03-02T11:14:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc7fff700 1 -- 172.21.15.57:0/1580437681 learned_addr learned my addr 172.21.15.57:0/1580437681 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:14:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafd4f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafd0100c80 0x7fafd019b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56750/0 (socket says 172.21.15.57:56750) 2023-03-02T11:14:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafd579c700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafd010a050 0x7fafd0195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc7fff700 1 -- 172.21.15.57:0/1580437681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafd010a050 msgr2=0x7fafd0195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:14:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc7fff700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafd010a050 0x7fafd0195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc7fff700 1 -- 172.21.15.57:0/1580437681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafd0100c80 msgr2=0x7fafd019b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:14:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc7fff700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafd0100c80 0x7fafd019b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc7fff700 1 -- 172.21.15.57:0/1580437681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc0095f0 con 0x7fafd0101590 2023-03-02T11:14:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafd0100c80 0x7fafd019b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:14:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc7fff700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafd0101590 0x7fafd019bf20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009230 tx=0x7fafc000fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:14:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc5ffb700 1 -- 172.21.15.57:0/1580437681 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc001c070 con 0x7fafd0101590 2023-03-02T11:14:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc5ffb700 1 -- 172.21.15.57:0/1580437681 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafc000bba0 con 0x7fafd0101590 2023-03-02T11:14:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafd71ff700 1 -- 172.21.15.57:0/1580437681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc0009520 con 0x7fafd0101590 2023-03-02T11:14:08.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.966+0000 7fafc5ffb700 1 -- 172.21.15.57:0/1580437681 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00038e0 con 0x7fafd0101590 2023-03-02T11:14:08.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.967+0000 7fafd71ff700 1 -- 172.21.15.57:0/1580437681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd010fad0 con 0x7fafd0101590 2023-03-02T11:14:08.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.969+0000 7fafc5ffb700 1 -- 172.21.15.57:0/1580437681 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) v1 ==== 129954+0+0 (secure 0 0 0) 0x7fafc0029020 con 0x7fafd0101590 2023-03-02T11:14:08.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.970+0000 7fafc5ffb700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fafb809b480 0x7fafb809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.970+0000 7fafc5ffb700 1 -- 172.21.15.57:0/1580437681 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fafc00c61a0 con 0x7fafd0101590 2023-03-02T11:14:08.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.970+0000 7fafeabacb80 1 Processor -- start 2023-03-02T11:14:08.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.970+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fafb809b480 0x7fafb809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.970+0000 7fafeabacb80 1 -- start start 2023-03-02T11:14:08.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 0x561003c1c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 0x561003c20bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 0x561003c21560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafeabacb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561003b83a60 con 0x561003c1ccd0 2023-03-02T11:14:08.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafeabacb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x561003b35f80 con 0x561003c21110 2023-03-02T11:14:08.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafeabacb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561003b06160 con 0x561003c1c3c0 2023-03-02T11:14:08.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafc7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 0x561003c20bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd579c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 0x561003c21560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd579c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 0x561003c21560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:53654/0 (socket says 172.21.15.57:53654) 2023-03-02T11:14:08.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafc7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 0x561003c20bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56756/0 (socket says 172.21.15.57:56756) 2023-03-02T11:14:08.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd579c700 1 -- 172.21.15.57:0/1879059872 learned_addr learned my addr 172.21.15.57:0/1879059872 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:14:08.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/1879059872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 0x561003c1c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fafb809b480 0x7fafb809d930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fafcc005fd0 tx=0x7fafcc009310 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:14:08.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd579c700 1 -- 172.21.15.57:0/1879059872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 msgr2=0x561003c1c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:14:08.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd579c700 1 --2- 172.21.15.57:0/1879059872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 0x561003c1c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd579c700 1 -- 172.21.15.57:0/1879059872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 msgr2=0x561003c20bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:14:08.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd579c700 1 --2- 172.21.15.57:0/1879059872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 0x561003c20bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd579c700 1 -- 172.21.15.57:0/1879059872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610039f0630 con 0x561003c21110 2023-03-02T11:14:08.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/1879059872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 0x561003c1c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-02T11:14:08.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.971+0000 7fafd579c700 1 --2- 172.21.15.57:0/1879059872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 0x561003c21560 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fafc8011600 tx=0x7fafc8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3dad3de77aedf7e server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:14:08.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.972+0000 7fafb6ffd700 1 -- 172.21.15.57:0/1879059872 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc800e040 con 0x561003c21110 2023-03-02T11:14:08.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.972+0000 7fafb6ffd700 1 -- 172.21.15.57:0/1879059872 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafc800f040 con 0x561003c21110 2023-03-02T11:14:08.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.972+0000 7fafb6ffd700 1 -- 172.21.15.57:0/1879059872 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8004700 con 0x561003c21110 2023-03-02T11:14:08.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.972+0000 7fafeabacb80 1 -- 172.21.15.57:0/1879059872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 msgr2=0x561003c21560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:14:08.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.972+0000 7fafeabacb80 1 --2- 172.21.15.57:0/1879059872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 0x561003c21560 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fafc8011600 tx=0x7fafc8009920 comp rx=0 tx=0).stop 2023-03-02T11:14:08.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.972+0000 7fafeabacb80 1 -- 172.21.15.57:0/1879059872 shutdown_connections 2023-03-02T11:14:08.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.972+0000 7fafeabacb80 1 --2- 172.21.15.57:0/1879059872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 0x561003c21560 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.972+0000 7fafeabacb80 1 --2- 172.21.15.57:0/1879059872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 0x561003c1c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.972+0000 7fafeabacb80 1 --2- 172.21.15.57:0/1879059872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 0x561003c20bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.972+0000 7fafeabacb80 1 -- 172.21.15.57:0/1879059872 >> 172.21.15.57:0/1879059872 conn(0x561003c11c50 msgr2=0x561003c17460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:14:08.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.972+0000 7fafeabacb80 1 -- 172.21.15.57:0/1879059872 shutdown_connections 2023-03-02T11:14:08.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.973+0000 7fafeabacb80 1 -- 172.21.15.57:0/1879059872 wait complete. 2023-03-02T11:14:08.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.973+0000 7fafeabacb80 1 -- start start 2023-03-02T11:14:08.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.973+0000 7fafeabacb80 1 Processor -- start 2023-03-02T11:14:08.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1c3c0 0x561003c28910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1ccd0 0x561003c25b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c21110 0x561003c26260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafeabacb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561003b74bc0 con 0x561003c1c3c0 2023-03-02T11:14:08.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafeabacb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x561003b6e0f0 con 0x561003c1ccd0 2023-03-02T11:14:08.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafeabacb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610039f2920 con 0x561003c21110 2023-03-02T11:14:08.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafeabacb80 10 client.0 _ll_register_callbacks cb 0x561003b14520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:14:08.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafd4f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1c3c0 0x561003c28910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafc7fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1ccd0 0x561003c25b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafd4f9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1c3c0 0x561003c28910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56764/0 (socket says 172.21.15.57:56764) 2023-03-02T11:14:08.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafd4f9b700 1 -- 172.21.15.57:0/1539918957 learned_addr learned my addr 172.21.15.57:0/1539918957 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:14:08.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafd579c700 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c21110 0x561003c26260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafc7fff700 1 -- 172.21.15.57:0/1539918957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c21110 msgr2=0x561003c26260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:14:08.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafc7fff700 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c21110 0x561003c26260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafc7fff700 1 -- 172.21.15.57:0/1539918957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1c3c0 msgr2=0x561003c28910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:14:08.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafc7fff700 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1c3c0 0x561003c28910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafc7fff700 1 -- 172.21.15.57:0/1539918957 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc80112b0 con 0x561003c1ccd0 2023-03-02T11:14:08.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafc7fff700 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1ccd0 0x561003c25b20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009810 tx=0x7fafc0005480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6b2d50d12baa979 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:14:08.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafaffff700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2023-03-02T11:14:08.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafaffff700 1 -- 172.21.15.57:0/1539918957 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0095d80 con 0x561003c1ccd0 2023-03-02T11:14:08.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.974+0000 7fafaffff700 1 -- 172.21.15.57:0/1539918957 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fafc0095680 con 0x561003c1ccd0 2023-03-02T11:14:08.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafeabacb80 1 -- 172.21.15.57:0/1539918957 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561003b3f7b0 con 0x561003c1ccd0 2023-03-02T11:14:08.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafaffff700 1 -- 172.21.15.57:0/1539918957 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafc009cd10 con 0x561003c1ccd0 2023-03-02T11:14:08.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafeabacb80 10 client.26549 fetch_fsmap learned FSMap version 47 2023-03-02T11:14:08.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafeabacb80 1 -- 172.21.15.57:0/1539918957 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x56100399cde0 con 0x561003c1ccd0 2023-03-02T11:14:08.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafaffff700 1 -- 172.21.15.57:0/1539918957 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561003b3f7b0 con 0x561003c1ccd0 2023-03-02T11:14:08.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafaffff700 1 -- 172.21.15.57:0/1539918957 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fafc00959c0 con 0x561003c1ccd0 2023-03-02T11:14:08.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafeabacb80 10 client.26549 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:14:08.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafeabacb80 10 client.26549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:14:08.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafeabacb80 20 client.26549 populate_metadata read hostname 'smithi057' 2023-03-02T11:14:08.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafeabacb80 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561003c35e80 0x561003c38290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:08.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafeabacb80 4 client.26549 mds_command: new command op to 24458 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-02T11:14:08.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafeabacb80 1 -- 172.21.15.57:0/1539918957 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561003b67170 con 0x561003c35e80 2023-03-02T11:14:08.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.975+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561003c35e80 0x561003c38290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:08.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.976+0000 7fafaffff700 10 client.26549 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:14:08.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.976+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561003c35e80 0x561003c38290 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56eb7d63a13ed15 server_cookie=99b7069617491293 in_seq=0 out_seq=0 2023-03-02T11:14:08.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.976+0000 7fafaffff700 1 -- 172.21.15.57:0/1539918957 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x561003b67170 con 0x561003c35e80 2023-03-02T11:14:08.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.976+0000 7fafaffff700 10 client.26549 handle_command_reply: tid=0 2023-03-02T11:14:08.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.976+0000 7fafeabacb80 1 client.26549 shutdown 2023-03-02T11:14:08.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafeabacb80 1 -- 172.21.15.57:0/1539918957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1ccd0 msgr2=0x561003c25b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:14:08.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafeabacb80 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1ccd0 0x561003c25b20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009810 tx=0x7fafc0005480 comp rx=0 tx=0).stop 2023-03-02T11:14:08.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafeabacb80 1 -- 172.21.15.57:0/1539918957 shutdown_connections 2023-03-02T11:14:08.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafeabacb80 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561003c35e80 0x561003c38290 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafeabacb80 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c21110 0x561003c26260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafeabacb80 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1c3c0 0x561003c28910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafeabacb80 1 --2- 172.21.15.57:0/1539918957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1ccd0 0x561003c25b20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:08.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafaffff700 0 client.26549 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:14:08.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafeabacb80 1 -- 172.21.15.57:0/1539918957 >> 172.21.15.57:0/1539918957 conn(0x561003c11c50 msgr2=0x561003c17050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:14:08.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafeabacb80 1 -- 172.21.15.57:0/1539918957 shutdown_connections 2023-03-02T11:14:08.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafeabacb80 1 -- 172.21.15.57:0/1539918957 wait complete. 2023-03-02T11:14:08.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.977+0000 7fafeabacb80 20 client.26549 trim_cache size 0 max 16384 2023-03-02T11:14:08.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.993+0000 7fafeabacb80 1 Processor -- start 2023-03-02T11:14:08.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.993+0000 7fafeabacb80 1 -- start start 2023-03-02T11:14:08.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1c3c0 0x561003c28440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:09.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1ccd0 0x561003c253c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:09.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c21110 0x561003c25900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:09.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafeabacb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561003c26840 con 0x561003c21110 2023-03-02T11:14:09.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafeabacb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x561003c18110 con 0x561003c1c3c0 2023-03-02T11:14:09.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafeabacb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561003c3ce40 con 0x561003c1ccd0 2023-03-02T11:14:09.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafd4f9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1c3c0 0x561003c28440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:09.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafd579c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c21110 0x561003c25900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:09.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafd4f9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1c3c0 0x561003c28440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.57:53676/0 (socket says 172.21.15.57:53676) 2023-03-02T11:14:09.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafd4f9b700 1 -- 172.21.15.57:0/2645370511 learned_addr learned my addr 172.21.15.57:0/2645370511 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:14:09.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafc7fff700 1 --2- 172.21.15.57:0/2645370511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1ccd0 0x561003c253c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:09.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafd4f9b700 1 -- 172.21.15.57:0/2645370511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1ccd0 msgr2=0x561003c253c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:14:09.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/2645370511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1ccd0 0x561003c253c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafd4f9b700 1 -- 172.21.15.57:0/2645370511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c21110 msgr2=0x561003c25900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:14:09.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/2645370511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c21110 0x561003c25900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafd4f9b700 1 -- 172.21.15.57:0/2645370511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561003c133f0 con 0x561003c1c3c0 2023-03-02T11:14:09.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafd579c700 1 --2- 172.21.15.57:0/2645370511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c21110 0x561003c25900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:14:09.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/2645370511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1c3c0 0x561003c28440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009a40 tx=0x7fafcc014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d43cb42069cdcee server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:14:09.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafb77fe700 1 -- 172.21.15.57:0/2645370511 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc025040 con 0x561003c1c3c0 2023-03-02T11:14:09.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafb77fe700 1 -- 172.21.15.57:0/2645370511 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafcc026040 con 0x561003c1c3c0 2023-03-02T11:14:09.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.994+0000 7fafb77fe700 1 -- 172.21.15.57:0/2645370511 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc003a00 con 0x561003c1c3c0 2023-03-02T11:14:09.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.995+0000 7fafeabacb80 1 -- 172.21.15.57:0/2645370511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1c3c0 msgr2=0x561003c28440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:14:09.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.995+0000 7fafeabacb80 1 --2- 172.21.15.57:0/2645370511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1c3c0 0x561003c28440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009a40 tx=0x7fafcc014000 comp rx=0 tx=0).stop 2023-03-02T11:14:09.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.995+0000 7fafeabacb80 1 -- 172.21.15.57:0/2645370511 shutdown_connections 2023-03-02T11:14:09.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.995+0000 7fafeabacb80 1 --2- 172.21.15.57:0/2645370511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c21110 0x561003c25900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.995+0000 7fafeabacb80 1 --2- 172.21.15.57:0/2645370511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c1c3c0 0x561003c28440 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.995+0000 7fafeabacb80 1 --2- 172.21.15.57:0/2645370511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1ccd0 0x561003c253c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.995+0000 7fafeabacb80 1 -- 172.21.15.57:0/2645370511 >> 172.21.15.57:0/2645370511 conn(0x561003c11c50 msgr2=0x561003c317e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:14:09.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.995+0000 7fafeabacb80 1 -- 172.21.15.57:0/2645370511 shutdown_connections 2023-03-02T11:14:09.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.995+0000 7fafeabacb80 1 -- 172.21.15.57:0/2645370511 wait complete. 2023-03-02T11:14:09.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.995+0000 7fafeabacb80 1 -- start start 2023-03-02T11:14:09.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafeabacb80 1 Processor -- start 2023-03-02T11:14:09.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 0x561003c2d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:09.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 0x561003c2b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:09.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafeabacb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 0x561003c2b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:09.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafeabacb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561003c2bf70 con 0x561003c1ccd0 2023-03-02T11:14:09.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafeabacb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x561003c2c0e0 con 0x561003c21110 2023-03-02T11:14:09.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafeabacb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561003c87740 con 0x561003c1c3c0 2023-03-02T11:14:09.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafeabacb80 10 client.0 _ll_register_callbacks cb 0x561003b14520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-02T11:14:09.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafd4f9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 0x561003c2d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:09.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafc7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 0x561003c2b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:09.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafd4f9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 0x561003c2d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.57:34250/0 (socket says 172.21.15.57:34250) 2023-03-02T11:14:09.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafd4f9b700 1 -- 172.21.15.57:0/2051523035 learned_addr learned my addr 172.21.15.57:0/2051523035 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-02T11:14:09.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafd579c700 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 0x561003c2b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:09.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafc7fff700 1 -- 172.21.15.57:0/2051523035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 msgr2=0x561003c2d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:14:09.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafc7fff700 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 0x561003c2d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafc7fff700 1 -- 172.21.15.57:0/2051523035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 msgr2=0x561003c2b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-02T11:14:09.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafc7fff700 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 0x561003c2b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafc7fff700 1 -- 172.21.15.57:0/2051523035 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610039f0630 con 0x561003c1ccd0 2023-03-02T11:14:09.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.996+0000 7fafd579c700 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 0x561003c2b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-02T11:14:09.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafc7fff700 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 0x561003c2b380 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fafc0091b30 tx=0x7fafc0021590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c722d4da630071c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:14:09.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafaffff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-02T11:14:09.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafaffff700 1 -- 172.21.15.57:0/2051523035 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0095d80 con 0x561003c1ccd0 2023-03-02T11:14:09.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafeabacb80 1 -- 172.21.15.57:0/2051523035 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fafc800f040 con 0x561003c1ccd0 2023-03-02T11:14:09.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafaffff700 1 -- 172.21.15.57:0/2051523035 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8642+0+0 (secure 0 0 0) 0x7fafc0095680 con 0x561003c1ccd0 2023-03-02T11:14:09.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafaffff700 1 -- 172.21.15.57:0/2051523035 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafc009cd10 con 0x561003c1ccd0 2023-03-02T11:14:09.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafeabacb80 10 client.16713 fetch_fsmap learned FSMap version 47 2023-03-02T11:14:09.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafeabacb80 1 -- 172.21.15.57:0/2051523035 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7fafcc017070 con 0x561003c1ccd0 2023-03-02T11:14:09.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafaffff700 1 -- 172.21.15.57:0/2051523035 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafc800f040 con 0x561003c1ccd0 2023-03-02T11:14:09.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafaffff700 1 -- 172.21.15.57:0/2051523035 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 47) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fafc0091470 con 0x561003c1ccd0 2023-03-02T11:14:09.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafeabacb80 10 client.16713 fetch_fsmap finished waiting for FSMap version 47 2023-03-02T11:14:09.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafeabacb80 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.k 2023-03-02T11:14:09.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafeabacb80 20 client.16713 populate_metadata read hostname 'smithi057' 2023-03-02T11:14:09.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafeabacb80 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561003c88830 0x561003c8ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:14:09.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafeabacb80 4 client.16713 mds_command: new command op to 24458 tid=0[{"prefix": "scrub status"}] 2023-03-02T11:14:09.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.997+0000 7fafeabacb80 1 -- 172.21.15.57:0/2051523035 --> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561003b66e90 con 0x561003c88830 2023-03-02T11:14:09.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561003c88830 0x561003c8ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:09.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafd4f9b700 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561003c88830 0x561003c8ac10 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c91acd1cd8cd041 server_cookie=8074124b06ebf9fc in_seq=0 out_seq=0 2023-03-02T11:14:09.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafaffff700 10 client.16713 ms_handle_connect on v2:172.21.15.122:6832/953074371 2023-03-02T11:14:09.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafaffff700 1 -- 172.21.15.57:0/2051523035 <== mds.0 v2:172.21.15.122:6832/953074371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561003b66e90 con 0x561003c88830 2023-03-02T11:14:09.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafaffff700 10 client.16713 handle_command_reply: tid=0 2023-03-02T11:14:09.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafeabacb80 1 client.16713 shutdown 2023-03-02T11:14:09.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafeabacb80 1 -- 172.21.15.57:0/2051523035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 msgr2=0x561003c2b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:14:09.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafeabacb80 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 0x561003c2b380 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fafc0091b30 tx=0x7fafc0021590 comp rx=0 tx=0).stop 2023-03-02T11:14:09.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafeabacb80 1 -- 172.21.15.57:0/2051523035 shutdown_connections 2023-03-02T11:14:09.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafeabacb80 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.122:6832/953074371,v1:172.21.15.122:6833/953074371] conn(0x561003c88830 0x561003c8ac10 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafeabacb80 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561003c21110 0x561003c2b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafeabacb80 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561003c1c3c0 0x561003c2d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafaffff700 0 client.16713 ms_handle_reset on v2:172.21.15.122:6832/953074371 2023-03-02T11:14:09.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafeabacb80 1 --2- 172.21.15.57:0/2051523035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561003c1ccd0 0x561003c2b380 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.998+0000 7fafeabacb80 1 -- 172.21.15.57:0/2051523035 >> 172.21.15.57:0/2051523035 conn(0x561003c11c50 msgr2=0x561003c317e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:14:09.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafeabacb80 1 -- 172.21.15.57:0/2051523035 shutdown_connections 2023-03-02T11:14:09.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafeabacb80 1 -- 172.21.15.57:0/2051523035 wait complete. 2023-03-02T11:14:09.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafeabacb80 20 client.16713 trim_cache size 0 max 16384 2023-03-02T11:14:09.014 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-02T11:14:09.014 INFO:teuthology.orchestra.run.smithi057.stdout: "status": "scrub active (2 inodes in the stack)", 2023-03-02T11:14:09.014 INFO:teuthology.orchestra.run.smithi057.stdout: "scrubs": { 2023-03-02T11:14:09.014 INFO:teuthology.orchestra.run.smithi057.stdout: "989d3179-2dd4-45e7-8929-d32291365553": { 2023-03-02T11:14:09.015 INFO:teuthology.orchestra.run.smithi057.stdout: "path": "/", 2023-03-02T11:14:09.015 INFO:teuthology.orchestra.run.smithi057.stdout: "tag": "989d3179-2dd4-45e7-8929-d32291365553", 2023-03-02T11:14:09.015 INFO:teuthology.orchestra.run.smithi057.stdout: "options": "recursive,force" 2023-03-02T11:14:09.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:14:09.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-02T11:14:09.015 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-02T11:14:09.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 -- 172.21.15.57:0/1580437681 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fafb809b480 msgr2=0x7fafb809d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:14:09.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fafb809b480 0x7fafb809d930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fafcc005fd0 tx=0x7fafcc009310 comp rx=0 tx=0).stop 2023-03-02T11:14:09.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 -- 172.21.15.57:0/1580437681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafd0101590 msgr2=0x7fafd019bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-02T11:14:09.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafd0101590 0x7fafd019bf20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009230 tx=0x7fafc000fa00 comp rx=0 tx=0).stop 2023-03-02T11:14:09.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 -- 172.21.15.57:0/1580437681 shutdown_connections 2023-03-02T11:14:09.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7fafb809b480 0x7fafb809d930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafd010a050 0x7fafd0195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafd0100c80 0x7fafd019b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 --2- 172.21.15.57:0/1580437681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafd0101590 0x7fafd019bf20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:14:09.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 -- 172.21.15.57:0/1580437681 >> 172.21.15.57:0/1580437681 conn(0x7fafd00fa4b0 msgr2=0x7fafd010c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-02T11:14:09.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 -- 172.21.15.57:0/1580437681 shutdown_connections 2023-03-02T11:14:09.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-02T11:14:08.999+0000 7fafd71ff700 1 -- 172.21.15.57:0/1580437681 wait complete. 2023-03-02T11:14:09.018 INFO:tasks.cephfs.filesystem:scrub status for tag:989d3179-2dd4-45e7-8929-d32291365553 - {'path': '/', 'tag': '989d3179-2dd4-45e7-8929-d32291365553', 'options': 'recursive,force'} 2023-03-02T11:14:09.018 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_802de851643c97960b33dacc1e3ce8486e6d7d3c/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_802de851643c97960b33dacc1e3ce8486e6d7d3c/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_802de851643c97960b33dacc1e3ce8486e6d7d3c/qa/tasks/fwd_scrub.py", line 76, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_802de851643c97960b33dacc1e3ce8486e6d7d3c/qa/tasks/cephfs/filesystem.py", line 1654, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/contextutil.py", line 135, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (30) after waiting for 900 seconds 2023-03-02T11:14:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:08 smithi136 ceph-mon[125702]: pgmap v536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:14:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:10 smithi057 ceph-mon[92072]: pgmap v537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:14:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:10 smithi122 ceph-mon[125440]: pgmap v537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:14:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:10 smithi136 ceph-mon[125702]: pgmap v537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:14:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:11 smithi057 ceph-mon[92072]: osdmap e108: 12 total, 12 up, 12 in 2023-03-02T11:14:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:11 smithi122 ceph-mon[125440]: osdmap e108: 12 total, 12 up, 12 in 2023-03-02T11:14:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:11 smithi136 ceph-mon[125702]: osdmap e108: 12 total, 12 up, 12 in 2023-03-02T11:14:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:12 smithi057 ceph-mon[92072]: pgmap v539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:14:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:12 smithi122 ceph-mon[125440]: pgmap v539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:14:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:12 smithi136 ceph-mon[125702]: pgmap v539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:14:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:14 smithi057 ceph-mon[92072]: pgmap v540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:14:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:14 smithi057 ceph-mon[92072]: osdmap e109: 12 total, 12 up, 12 in 2023-03-02T11:14:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:14 smithi122 ceph-mon[125440]: pgmap v540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:14:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:14 smithi122 ceph-mon[125440]: osdmap e109: 12 total, 12 up, 12 in 2023-03-02T11:14:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:14 smithi136 ceph-mon[125702]: pgmap v540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:14:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:14 smithi136 ceph-mon[125702]: osdmap e109: 12 total, 12 up, 12 in 2023-03-02T11:14:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:16 smithi057 ceph-mon[92072]: pgmap v542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:14:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:16 smithi122 ceph-mon[125440]: pgmap v542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:14:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:16 smithi136 ceph-mon[125702]: pgmap v542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:14:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:18 smithi057 ceph-mon[92072]: pgmap v543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:14:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:18 smithi122 ceph-mon[125440]: pgmap v543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:14:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:18 smithi136 ceph-mon[125702]: pgmap v543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:14:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:19.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:19.502+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:14:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:19.502+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:14:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:19.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:14:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:19.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:14:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:20 smithi057 ceph-mon[92072]: pgmap v544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T11:14:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:20 smithi122 ceph-mon[125440]: pgmap v544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T11:14:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:20 smithi136 ceph-mon[125702]: pgmap v544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T11:14:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:22 smithi057 ceph-mon[92072]: pgmap v545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:14:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:22 smithi122 ceph-mon[125440]: pgmap v545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:14:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:22 smithi136 ceph-mon[125702]: pgmap v545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:14:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:24 smithi057 ceph-mon[92072]: pgmap v546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:14:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:24 smithi122 ceph-mon[125440]: pgmap v546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:14:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:24 smithi136 ceph-mon[125702]: pgmap v546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:14:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:26 smithi057 ceph-mon[92072]: pgmap v547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:14:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:26 smithi122 ceph-mon[125440]: pgmap v547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:14:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:26 smithi136 ceph-mon[125702]: pgmap v547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:14:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:28 smithi122 ceph-mon[125440]: pgmap v548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:14:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:28 smithi136 ceph-mon[125702]: pgmap v548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:14:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:28 smithi057 ceph-mon[92072]: pgmap v548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:14:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:30 smithi122 ceph-mon[125440]: pgmap v549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:30 smithi136 ceph-mon[125702]: pgmap v549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:30 smithi057 ceph-mon[92072]: pgmap v549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:32 smithi136 ceph-mon[125702]: pgmap v550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:32 smithi057 ceph-mon[92072]: pgmap v550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:32 smithi122 ceph-mon[125440]: pgmap v550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:34.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:34.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:14:34.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:34.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:14:34.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:34.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:14:34.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:34.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:14:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:34 smithi136 ceph-mon[125702]: pgmap v551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:14:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:14:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:14:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:14:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:34 smithi057 ceph-mon[92072]: pgmap v551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:14:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:14:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:14:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:14:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:34 smithi122 ceph-mon[125440]: pgmap v551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:14:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:14:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:14:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:14:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:35 smithi136 ceph-mon[125702]: pgmap v552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:35 smithi057 ceph-mon[92072]: pgmap v552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:35 smithi122 ceph-mon[125440]: pgmap v552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:37 smithi122 ceph-mon[125440]: pgmap v553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:37 smithi136 ceph-mon[125702]: pgmap v553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:37 smithi057 ceph-mon[92072]: pgmap v553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:39 smithi136 ceph-mon[125702]: pgmap v554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:39 smithi057 ceph-mon[92072]: pgmap v554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:39 smithi122 ceph-mon[125440]: pgmap v554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:41 smithi136 ceph-mon[125702]: pgmap v555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:41 smithi057 ceph-mon[92072]: pgmap v555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:41 smithi122 ceph-mon[125440]: pgmap v555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:43 smithi136 ceph-mon[125702]: pgmap v556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:43 smithi057 ceph-mon[92072]: pgmap v556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:43 smithi122 ceph-mon[125440]: pgmap v556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:45 smithi136 ceph-mon[125702]: pgmap v557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:45 smithi057 ceph-mon[92072]: pgmap v557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:45 smithi122 ceph-mon[125440]: pgmap v557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:47 smithi136 ceph-mon[125702]: pgmap v558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:47 smithi057 ceph-mon[92072]: pgmap v558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:47 smithi122 ceph-mon[125440]: pgmap v558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:49.526+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:14:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:49.526+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:14:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:49.526+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:14:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:49.526+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:14:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:14:49.526+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:14:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:49 smithi136 ceph-mon[125702]: pgmap v559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:49 smithi057 ceph-mon[92072]: pgmap v559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:49 smithi122 ceph-mon[125440]: pgmap v559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:51 smithi136 ceph-mon[125702]: pgmap v560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:51 smithi057 ceph-mon[92072]: pgmap v560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:51 smithi122 ceph-mon[125440]: pgmap v560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:53 smithi136 ceph-mon[125702]: pgmap v561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:53 smithi057 ceph-mon[92072]: pgmap v561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:53 smithi122 ceph-mon[125440]: pgmap v561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:55 smithi136 ceph-mon[125702]: pgmap v562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:55 smithi057 ceph-mon[92072]: pgmap v562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:55 smithi122 ceph-mon[125440]: pgmap v562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:14:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:57 smithi136 ceph-mon[125702]: pgmap v563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:57 smithi057 ceph-mon[92072]: pgmap v563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:14:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:57 smithi122 ceph-mon[125440]: pgmap v563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:14:59 smithi136 ceph-mon[125702]: pgmap v564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:14:59 smithi057 ceph-mon[92072]: pgmap v564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:14:59 smithi122 ceph-mon[125440]: pgmap v564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:01 smithi136 ceph-mon[125702]: pgmap v565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:01 smithi057 ceph-mon[92072]: pgmap v565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:01 smithi122 ceph-mon[125440]: pgmap v565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:03 smithi136 ceph-mon[125702]: pgmap v566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:15:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:03 smithi057 ceph-mon[92072]: pgmap v566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:15:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:03 smithi122 ceph-mon[125440]: pgmap v566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:15:04.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:04.540+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:15:04.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:04.541+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:15:04.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:04.541+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:15:04.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:04.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:15:04.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:04.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:15:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:06 smithi136 ceph-mon[125702]: pgmap v567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:15:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:06 smithi057 ceph-mon[92072]: pgmap v567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:15:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:06 smithi122 ceph-mon[125440]: pgmap v567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:15:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:08 smithi136 ceph-mon[125702]: pgmap v568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:15:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:08 smithi057 ceph-mon[92072]: pgmap v568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:15:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:08 smithi122 ceph-mon[125440]: pgmap v568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:15:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:10 smithi136 ceph-mon[125702]: pgmap v569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:15:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:10 smithi057 ceph-mon[92072]: pgmap v569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:15:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:10 smithi122 ceph-mon[125440]: pgmap v569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:15:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:12 smithi136 ceph-mon[125702]: pgmap v570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:15:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:12 smithi136 ceph-mon[125702]: osdmap e110: 12 total, 12 up, 12 in 2023-03-02T11:15:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:12 smithi057 ceph-mon[92072]: pgmap v570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:15:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:12 smithi057 ceph-mon[92072]: osdmap e110: 12 total, 12 up, 12 in 2023-03-02T11:15:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:12 smithi122 ceph-mon[125440]: pgmap v570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:15:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:12 smithi122 ceph-mon[125440]: osdmap e110: 12 total, 12 up, 12 in 2023-03-02T11:15:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:14 smithi136 ceph-mon[125702]: pgmap v572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:15:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:14 smithi136 ceph-mon[125702]: osdmap e111: 12 total, 12 up, 12 in 2023-03-02T11:15:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:14 smithi057 ceph-mon[92072]: pgmap v572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:15:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:14 smithi057 ceph-mon[92072]: osdmap e111: 12 total, 12 up, 12 in 2023-03-02T11:15:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:14 smithi122 ceph-mon[125440]: pgmap v572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:15:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:14 smithi122 ceph-mon[125440]: osdmap e111: 12 total, 12 up, 12 in 2023-03-02T11:15:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:16 smithi136 ceph-mon[125702]: pgmap v574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:15:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:16 smithi057 ceph-mon[92072]: pgmap v574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:15:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:16 smithi122 ceph-mon[125440]: pgmap v574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:15:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:18 smithi136 ceph-mon[125702]: pgmap v575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:15:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:18 smithi057 ceph-mon[92072]: pgmap v575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:15:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:18 smithi122 ceph-mon[125440]: pgmap v575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:15:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:19.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:15:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:19.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:15:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:19.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:15:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:19.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:15:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:19.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:15:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:20 smithi136 ceph-mon[125702]: pgmap v576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:15:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:20 smithi057 ceph-mon[92072]: pgmap v576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:15:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:20 smithi122 ceph-mon[125440]: pgmap v576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:15:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:22 smithi136 ceph-mon[125702]: pgmap v577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T11:15:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:22 smithi057 ceph-mon[92072]: pgmap v577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T11:15:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:22 smithi122 ceph-mon[125440]: pgmap v577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T11:15:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:24 smithi136 ceph-mon[125702]: pgmap v578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:15:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:24 smithi057 ceph-mon[92072]: pgmap v578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:15:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:24 smithi122 ceph-mon[125440]: pgmap v578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:15:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:26 smithi136 ceph-mon[125702]: pgmap v579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:15:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:26 smithi057 ceph-mon[92072]: pgmap v579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:15:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:26 smithi122 ceph-mon[125440]: pgmap v579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:15:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:28 smithi136 ceph-mon[125702]: pgmap v580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:15:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:28 smithi057 ceph-mon[92072]: pgmap v580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:15:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:28 smithi122 ceph-mon[125440]: pgmap v580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:15:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:30 smithi136 ceph-mon[125702]: pgmap v581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:30 smithi057 ceph-mon[92072]: pgmap v581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:30 smithi122 ceph-mon[125440]: pgmap v581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:32 smithi136 ceph-mon[125702]: pgmap v582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:32 smithi057 ceph-mon[92072]: pgmap v582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:32 smithi122 ceph-mon[125440]: pgmap v582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:34 smithi136 ceph-mon[125702]: pgmap v583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:34 smithi057 ceph-mon[92072]: pgmap v583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:34 smithi122 ceph-mon[125440]: pgmap v583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:34.558+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:15:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:34.559+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:15:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:34.559+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:15:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:34.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:15:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:34.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:15:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:15:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:15:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:15:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:36 smithi136 ceph-mon[125702]: pgmap v584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:15:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:15:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:15:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:36 smithi057 ceph-mon[92072]: pgmap v584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:15:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:15:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:15:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:36 smithi122 ceph-mon[125440]: pgmap v584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:15:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:15:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:15:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:38 smithi136 ceph-mon[125702]: pgmap v585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:38 smithi057 ceph-mon[92072]: pgmap v585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:38 smithi122 ceph-mon[125440]: pgmap v585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:38.502+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:15:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:38.502+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 13 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:15:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:38.523+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:15:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:38.523+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:15:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:40 smithi136 ceph-mon[125702]: pgmap v586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:40 smithi057 ceph-mon[92072]: pgmap v586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:40 smithi122 ceph-mon[125440]: pgmap v586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:42 smithi057 ceph-mon[92072]: pgmap v587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:42 smithi122 ceph-mon[125440]: pgmap v587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:42 smithi136 ceph-mon[125702]: pgmap v587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:44 smithi057 ceph-mon[92072]: pgmap v588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:44 smithi122 ceph-mon[125440]: pgmap v588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:44 smithi136 ceph-mon[125702]: pgmap v588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:46 smithi057 ceph-mon[92072]: pgmap v589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:46 smithi122 ceph-mon[125440]: pgmap v589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:46 smithi136 ceph-mon[125702]: pgmap v589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:48 smithi057 ceph-mon[92072]: pgmap v590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:48 smithi122 ceph-mon[125440]: pgmap v590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:48 smithi136 ceph-mon[125702]: pgmap v590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:49.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:49.574+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:15:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:49.575+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:15:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:49.575+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:15:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:49.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:15:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:15:49.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:15:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:50 smithi057 ceph-mon[92072]: pgmap v591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:50 smithi122 ceph-mon[125440]: pgmap v591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:50 smithi136 ceph-mon[125702]: pgmap v591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:52 smithi057 ceph-mon[92072]: pgmap v592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:52 smithi122 ceph-mon[125440]: pgmap v592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:52 smithi136 ceph-mon[125702]: pgmap v592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:54 smithi057 ceph-mon[92072]: pgmap v593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:54 smithi122 ceph-mon[125440]: pgmap v593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:54 smithi136 ceph-mon[125702]: pgmap v593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:56 smithi057 ceph-mon[92072]: pgmap v594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:56 smithi122 ceph-mon[125440]: pgmap v594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:56 smithi136 ceph-mon[125702]: pgmap v594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:15:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:15:58 smithi057 ceph-mon[92072]: pgmap v595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:15:58 smithi122 ceph-mon[125440]: pgmap v595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:15:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:15:58 smithi136 ceph-mon[125702]: pgmap v595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:00 smithi057 ceph-mon[92072]: pgmap v596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:00 smithi122 ceph-mon[125440]: pgmap v596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:00 smithi136 ceph-mon[125702]: pgmap v596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:02 smithi057 ceph-mon[92072]: pgmap v597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:02 smithi122 ceph-mon[125440]: pgmap v597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:02 smithi136 ceph-mon[125702]: pgmap v597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:04 smithi057 ceph-mon[92072]: pgmap v598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:16:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:04 smithi122 ceph-mon[125440]: pgmap v598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:16:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:04 smithi136 ceph-mon[125702]: pgmap v598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:16:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:04.590+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:16:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:04.591+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:16:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:04.591+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:16:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:04.591+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:16:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:04.591+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:16:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:06 smithi057 ceph-mon[92072]: pgmap v599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:16:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:06 smithi122 ceph-mon[125440]: pgmap v599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:16:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:06 smithi136 ceph-mon[125702]: pgmap v599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:16:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:08 smithi122 ceph-mon[125440]: pgmap v600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:16:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:08 smithi136 ceph-mon[125702]: pgmap v600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:16:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:08 smithi057 ceph-mon[92072]: pgmap v600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:16:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:10 smithi122 ceph-mon[125440]: pgmap v601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:16:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:10 smithi136 ceph-mon[125702]: pgmap v601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:16:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:10 smithi057 ceph-mon[92072]: pgmap v601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:16:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:11 smithi136 ceph-mon[125702]: osdmap e112: 12 total, 12 up, 12 in 2023-03-02T11:16:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:11 smithi057 ceph-mon[92072]: osdmap e112: 12 total, 12 up, 12 in 2023-03-02T11:16:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:11 smithi122 ceph-mon[125440]: osdmap e112: 12 total, 12 up, 12 in 2023-03-02T11:16:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:12 smithi136 ceph-mon[125702]: pgmap v603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:16:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:12 smithi057 ceph-mon[92072]: pgmap v603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:16:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:12 smithi122 ceph-mon[125440]: pgmap v603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:16:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:14 smithi136 ceph-mon[125702]: pgmap v604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:16:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:14 smithi136 ceph-mon[125702]: osdmap e113: 12 total, 12 up, 12 in 2023-03-02T11:16:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:14 smithi057 ceph-mon[92072]: pgmap v604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:16:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:14 smithi057 ceph-mon[92072]: osdmap e113: 12 total, 12 up, 12 in 2023-03-02T11:16:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:14 smithi122 ceph-mon[125440]: pgmap v604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:16:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:14 smithi122 ceph-mon[125440]: osdmap e113: 12 total, 12 up, 12 in 2023-03-02T11:16:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:16 smithi136 ceph-mon[125702]: pgmap v606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:16:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:16 smithi057 ceph-mon[92072]: pgmap v606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:16:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:16 smithi122 ceph-mon[125440]: pgmap v606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:16:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:18 smithi136 ceph-mon[125702]: pgmap v607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:16:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:18 smithi057 ceph-mon[92072]: pgmap v607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:16:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:18 smithi122 ceph-mon[125440]: pgmap v607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:16:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:19.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:16:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:19.599+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:16:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:19.599+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:16:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:19.599+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:16:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:19.599+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:16:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:20 smithi136 ceph-mon[125702]: pgmap v608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T11:16:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:20 smithi057 ceph-mon[92072]: pgmap v608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T11:16:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:20 smithi122 ceph-mon[125440]: pgmap v608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T11:16:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:22 smithi136 ceph-mon[125702]: pgmap v609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:16:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:22 smithi057 ceph-mon[92072]: pgmap v609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:16:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:22 smithi122 ceph-mon[125440]: pgmap v609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:16:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:24 smithi136 ceph-mon[125702]: pgmap v610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:16:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:24 smithi057 ceph-mon[92072]: pgmap v610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:16:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:24 smithi122 ceph-mon[125440]: pgmap v610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:16:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:26 smithi136 ceph-mon[125702]: pgmap v611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:16:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:26 smithi057 ceph-mon[92072]: pgmap v611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:16:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:26 smithi122 ceph-mon[125440]: pgmap v611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:16:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:28 smithi136 ceph-mon[125702]: pgmap v612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:16:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:28 smithi057 ceph-mon[92072]: pgmap v612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:16:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:28 smithi122 ceph-mon[125440]: pgmap v612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:16:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:30 smithi136 ceph-mon[125702]: pgmap v613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:30 smithi057 ceph-mon[92072]: pgmap v613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:30 smithi122 ceph-mon[125440]: pgmap v613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:32 smithi136 ceph-mon[125702]: pgmap v614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:32 smithi057 ceph-mon[92072]: pgmap v614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:32 smithi122 ceph-mon[125440]: pgmap v614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:34 smithi136 ceph-mon[125702]: pgmap v615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:34.615+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:16:34.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:34.615+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:16:34.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:34.615+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:16:34.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:34.615+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:16:34.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:34.615+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:16:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:34 smithi057 ceph-mon[92072]: pgmap v615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:34 smithi122 ceph-mon[125440]: pgmap v615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:36 smithi136 ceph-mon[125702]: pgmap v616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:16:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:36 smithi057 ceph-mon[92072]: pgmap v616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:16:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:36 smithi122 ceph-mon[125440]: pgmap v616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:16:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:16:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:16:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:16:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:16:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:16:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:16:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:16:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:16:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:16:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:38 smithi057 ceph-mon[92072]: pgmap v617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:38 smithi122 ceph-mon[125440]: pgmap v617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:38 smithi136 ceph-mon[125702]: pgmap v617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:40 smithi057 ceph-mon[92072]: pgmap v618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:40 smithi122 ceph-mon[125440]: pgmap v618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:40 smithi136 ceph-mon[125702]: pgmap v618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:42 smithi057 ceph-mon[92072]: pgmap v619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:42 smithi122 ceph-mon[125440]: pgmap v619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:42 smithi136 ceph-mon[125702]: pgmap v619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:44 smithi057 ceph-mon[92072]: pgmap v620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:44 smithi122 ceph-mon[125440]: pgmap v620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:44 smithi136 ceph-mon[125702]: pgmap v620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:46 smithi057 ceph-mon[92072]: pgmap v621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:46 smithi122 ceph-mon[125440]: pgmap v621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:46 smithi136 ceph-mon[125702]: pgmap v621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:48 smithi057 ceph-mon[92072]: pgmap v622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:48 smithi122 ceph-mon[125440]: pgmap v622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:48 smithi136 ceph-mon[125702]: pgmap v622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:49.630+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:16:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:49.631+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:16:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:49.631+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:16:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:49.631+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:16:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:16:49.631+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:16:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:50 smithi057 ceph-mon[92072]: pgmap v623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:50 smithi122 ceph-mon[125440]: pgmap v623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:50 smithi136 ceph-mon[125702]: pgmap v623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:52 smithi057 ceph-mon[92072]: pgmap v624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:52 smithi122 ceph-mon[125440]: pgmap v624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:52 smithi136 ceph-mon[125702]: pgmap v624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:54 smithi057 ceph-mon[92072]: pgmap v625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:54 smithi122 ceph-mon[125440]: pgmap v625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:54 smithi136 ceph-mon[125702]: pgmap v625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:56 smithi057 ceph-mon[92072]: pgmap v626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:56 smithi122 ceph-mon[125440]: pgmap v626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:56 smithi136 ceph-mon[125702]: pgmap v626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:16:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:16:58 smithi057 ceph-mon[92072]: pgmap v627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:16:58 smithi122 ceph-mon[125440]: pgmap v627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:16:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:16:58 smithi136 ceph-mon[125702]: pgmap v627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:00 smithi057 ceph-mon[92072]: pgmap v628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:00 smithi122 ceph-mon[125440]: pgmap v628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:00 smithi136 ceph-mon[125702]: pgmap v628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:02 smithi122 ceph-mon[125440]: pgmap v629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:02 smithi136 ceph-mon[125702]: pgmap v629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:02 smithi057 ceph-mon[92072]: pgmap v629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:04.647 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:04.646+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:17:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:04.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:17:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:04.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:17:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:04.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:17:04.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:04.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:17:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:04 smithi122 ceph-mon[125440]: pgmap v630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:17:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:04 smithi136 ceph-mon[125702]: pgmap v630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:17:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:04 smithi057 ceph-mon[92072]: pgmap v630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:17:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:06 smithi136 ceph-mon[125702]: pgmap v631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:17:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:06 smithi057 ceph-mon[92072]: pgmap v631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:17:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:06 smithi122 ceph-mon[125440]: pgmap v631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:17:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:08.515+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580036e0 con 0x7f5880105ae0 2023-03-02T11:17:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:08.516+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 14 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580036e0 con 0x7f5880105ae0 2023-03-02T11:17:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:08.535+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:17:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:08.535+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 13 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:17:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:08 smithi136 ceph-mon[125702]: pgmap v632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:17:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:08 smithi057 ceph-mon[92072]: pgmap v632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:17:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:08 smithi122 ceph-mon[125440]: pgmap v632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:17:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:10 smithi136 ceph-mon[125702]: pgmap v633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:17:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:10 smithi057 ceph-mon[92072]: pgmap v633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:17:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:10 smithi122 ceph-mon[125440]: pgmap v633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:17:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:11 smithi136 ceph-mon[125702]: osdmap e114: 12 total, 12 up, 12 in 2023-03-02T11:17:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:11 smithi057 ceph-mon[92072]: osdmap e114: 12 total, 12 up, 12 in 2023-03-02T11:17:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:11 smithi122 ceph-mon[125440]: osdmap e114: 12 total, 12 up, 12 in 2023-03-02T11:17:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:12 smithi136 ceph-mon[125702]: pgmap v635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:17:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:12 smithi057 ceph-mon[92072]: pgmap v635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:17:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:12 smithi122 ceph-mon[125440]: pgmap v635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:17:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:14 smithi136 ceph-mon[125702]: pgmap v636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:17:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:14 smithi136 ceph-mon[125702]: osdmap e115: 12 total, 12 up, 12 in 2023-03-02T11:17:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:14 smithi057 ceph-mon[92072]: pgmap v636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:17:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:14 smithi057 ceph-mon[92072]: osdmap e115: 12 total, 12 up, 12 in 2023-03-02T11:17:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:14 smithi122 ceph-mon[125440]: pgmap v636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:17:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:14 smithi122 ceph-mon[125440]: osdmap e115: 12 total, 12 up, 12 in 2023-03-02T11:17:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:16 smithi136 ceph-mon[125702]: pgmap v638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:17:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:16 smithi057 ceph-mon[92072]: pgmap v638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:17:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:16 smithi122 ceph-mon[125440]: pgmap v638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:17:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:18 smithi136 ceph-mon[125702]: pgmap v639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:17:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:18 smithi057 ceph-mon[92072]: pgmap v639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:17:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:18 smithi122 ceph-mon[125440]: pgmap v639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:17:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:19.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:17:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:19.662+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:17:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:19.662+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:17:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:19.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:17:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:19.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:17:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:20 smithi136 ceph-mon[125702]: pgmap v640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T11:17:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:20 smithi057 ceph-mon[92072]: pgmap v640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T11:17:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:20 smithi122 ceph-mon[125440]: pgmap v640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T11:17:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:22 smithi136 ceph-mon[125702]: pgmap v641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:17:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:22 smithi057 ceph-mon[92072]: pgmap v641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:17:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:22 smithi122 ceph-mon[125440]: pgmap v641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:17:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:24 smithi136 ceph-mon[125702]: pgmap v642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:17:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:24 smithi057 ceph-mon[92072]: pgmap v642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:17:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:24 smithi122 ceph-mon[125440]: pgmap v642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:17:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:26 smithi136 ceph-mon[125702]: pgmap v643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:17:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:26 smithi057 ceph-mon[92072]: pgmap v643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:17:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:26 smithi122 ceph-mon[125440]: pgmap v643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:17:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:28 smithi136 ceph-mon[125702]: pgmap v644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:17:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:28 smithi057 ceph-mon[92072]: pgmap v644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:17:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:28 smithi122 ceph-mon[125440]: pgmap v644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:17:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:30 smithi136 ceph-mon[125702]: pgmap v645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:30 smithi057 ceph-mon[92072]: pgmap v645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:30 smithi122 ceph-mon[125440]: pgmap v645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:32 smithi136 ceph-mon[125702]: pgmap v646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:32 smithi057 ceph-mon[92072]: pgmap v646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:32 smithi122 ceph-mon[125440]: pgmap v646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:34.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:34.672+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:17:34.675 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:34.673+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:17:34.675 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:34.673+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:17:34.675 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:34.673+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:17:34.675 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:34.673+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:17:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:34 smithi136 ceph-mon[125702]: pgmap v647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:34 smithi057 ceph-mon[92072]: pgmap v647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:34 smithi122 ceph-mon[125440]: pgmap v647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:36 smithi136 ceph-mon[125702]: pgmap v648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:17:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:36 smithi057 ceph-mon[92072]: pgmap v648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:17:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:36 smithi122 ceph-mon[125440]: pgmap v648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:17:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:38 smithi136 ceph-mon[125702]: pgmap v649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:38 smithi057 ceph-mon[92072]: pgmap v649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:38 smithi122 ceph-mon[125440]: pgmap v649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: pgmap v650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: pgmap v650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: pgmap v650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:40.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:41 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:17:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:41 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:17:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:41 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:17:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:41 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:17:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:41 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:17:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:41 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:17:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:41 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:17:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:41 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:17:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:41 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:17:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:41 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:17:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:41 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:17:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:41 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:17:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: pgmap v651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:17:42.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:17:42.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: pgmap v651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:17:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:17:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: pgmap v651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:17:42.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:17:42.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:17:42.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:17:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:43 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:17:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:43 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:17:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:43 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:17:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:43 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:17:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:43 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:17:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:43 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:17:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:44 smithi136 ceph-mon[125702]: pgmap v652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:44 smithi057 ceph-mon[92072]: pgmap v652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:44 smithi122 ceph-mon[125440]: pgmap v652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:46 smithi136 ceph-mon[125702]: pgmap v653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:46 smithi057 ceph-mon[92072]: pgmap v653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:46 smithi122 ceph-mon[125440]: pgmap v653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:48 smithi136 ceph-mon[125702]: pgmap v654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:48 smithi057 ceph-mon[92072]: pgmap v654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:48 smithi122 ceph-mon[125440]: pgmap v654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:49.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:17:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:49.688+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:17:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:49.688+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:17:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:49.688+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:17:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:17:49.688+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:17:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:50 smithi136 ceph-mon[125702]: pgmap v655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:50 smithi057 ceph-mon[92072]: pgmap v655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:50 smithi122 ceph-mon[125440]: pgmap v655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:52 smithi136 ceph-mon[125702]: pgmap v656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:52 smithi057 ceph-mon[92072]: pgmap v656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:52 smithi122 ceph-mon[125440]: pgmap v656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:54 smithi136 ceph-mon[125702]: pgmap v657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:54 smithi057 ceph-mon[92072]: pgmap v657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:54 smithi122 ceph-mon[125440]: pgmap v657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:56 smithi136 ceph-mon[125702]: pgmap v658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:56 smithi057 ceph-mon[92072]: pgmap v658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:56 smithi122 ceph-mon[125440]: pgmap v658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:17:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:17:58 smithi136 ceph-mon[125702]: pgmap v659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:17:58 smithi057 ceph-mon[92072]: pgmap v659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:17:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:17:58 smithi122 ceph-mon[125440]: pgmap v659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:00 smithi136 ceph-mon[125702]: pgmap v660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:00 smithi057 ceph-mon[92072]: pgmap v660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:00 smithi122 ceph-mon[125440]: pgmap v660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:02 smithi136 ceph-mon[125702]: pgmap v661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:02 smithi057 ceph-mon[92072]: pgmap v661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:02 smithi122 ceph-mon[125440]: pgmap v661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:04.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:18:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:04.701+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:18:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:04.701+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:18:04.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:04.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:18:04.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:04.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:18:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:04 smithi136 ceph-mon[125702]: pgmap v662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:18:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:04 smithi057 ceph-mon[92072]: pgmap v662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:18:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:04 smithi122 ceph-mon[125440]: pgmap v662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:18:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:06 smithi136 ceph-mon[125702]: pgmap v663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:18:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:06 smithi057 ceph-mon[92072]: pgmap v663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:18:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:06 smithi122 ceph-mon[125440]: pgmap v663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:18:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:08 smithi136 ceph-mon[125702]: pgmap v664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:18:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:08 smithi057 ceph-mon[92072]: pgmap v664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:18:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:08 smithi122 ceph-mon[125440]: pgmap v664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:18:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:10 smithi136 ceph-mon[125702]: pgmap v665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:18:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:10 smithi057 ceph-mon[92072]: pgmap v665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:18:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:10 smithi122 ceph-mon[125440]: pgmap v665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:18:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:11 smithi136 ceph-mon[125702]: osdmap e116: 12 total, 12 up, 12 in 2023-03-02T11:18:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:11 smithi057 ceph-mon[92072]: osdmap e116: 12 total, 12 up, 12 in 2023-03-02T11:18:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:11 smithi122 ceph-mon[125440]: osdmap e116: 12 total, 12 up, 12 in 2023-03-02T11:18:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:12 smithi136 ceph-mon[125702]: pgmap v667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:18:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:12 smithi057 ceph-mon[92072]: pgmap v667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:18:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:12 smithi122 ceph-mon[125440]: pgmap v667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:18:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:14 smithi136 ceph-mon[125702]: pgmap v668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:18:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:14 smithi136 ceph-mon[125702]: osdmap e117: 12 total, 12 up, 12 in 2023-03-02T11:18:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:14 smithi057 ceph-mon[92072]: pgmap v668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:18:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:14 smithi057 ceph-mon[92072]: osdmap e117: 12 total, 12 up, 12 in 2023-03-02T11:18:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:14 smithi122 ceph-mon[125440]: pgmap v668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:18:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:14 smithi122 ceph-mon[125440]: osdmap e117: 12 total, 12 up, 12 in 2023-03-02T11:18:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:16 smithi136 ceph-mon[125702]: pgmap v670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:18:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:16 smithi057 ceph-mon[92072]: pgmap v670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:18:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:16 smithi122 ceph-mon[125440]: pgmap v670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:18:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:18 smithi136 ceph-mon[125702]: pgmap v671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:18:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:18 smithi057 ceph-mon[92072]: pgmap v671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:18:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:18 smithi122 ceph-mon[125440]: pgmap v671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:18:19.706 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:19.705+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:18:19.706 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:19.705+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:18:19.706 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:19.705+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:18:19.707 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:19.705+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:18:19.707 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:19.705+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:18:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:20 smithi136 ceph-mon[125702]: pgmap v672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T11:18:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:20 smithi057 ceph-mon[92072]: pgmap v672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T11:18:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:20 smithi122 ceph-mon[125440]: pgmap v672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T11:18:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:22 smithi136 ceph-mon[125702]: pgmap v673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:18:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:22 smithi057 ceph-mon[92072]: pgmap v673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:18:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:22 smithi122 ceph-mon[125440]: pgmap v673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:18:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:24 smithi057 ceph-mon[92072]: pgmap v674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:18:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:24 smithi122 ceph-mon[125440]: pgmap v674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:18:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:24 smithi136 ceph-mon[125702]: pgmap v674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:18:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:26 smithi057 ceph-mon[92072]: pgmap v675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:18:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:26 smithi122 ceph-mon[125440]: pgmap v675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:18:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:26 smithi136 ceph-mon[125702]: pgmap v675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:18:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:28 smithi057 ceph-mon[92072]: pgmap v676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:18:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:28 smithi122 ceph-mon[125440]: pgmap v676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:18:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:28 smithi136 ceph-mon[125702]: pgmap v676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:18:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:30 smithi057 ceph-mon[92072]: pgmap v677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:30 smithi122 ceph-mon[125440]: pgmap v677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:30 smithi136 ceph-mon[125702]: pgmap v677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:32 smithi057 ceph-mon[92072]: pgmap v678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:32 smithi122 ceph-mon[125440]: pgmap v678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:32 smithi136 ceph-mon[125702]: pgmap v678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:34.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:18:34.723 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:34.720+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:18:34.723 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:34.720+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:18:34.723 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:34.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:18:34.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:34.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:18:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:34 smithi057 ceph-mon[92072]: pgmap v679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:34 smithi122 ceph-mon[125440]: pgmap v679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:34 smithi136 ceph-mon[125702]: pgmap v679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:36 smithi057 ceph-mon[92072]: pgmap v680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:36 smithi122 ceph-mon[125440]: pgmap v680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:36 smithi136 ceph-mon[125702]: pgmap v680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:38 smithi057 ceph-mon[92072]: pgmap v681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:38 smithi122 ceph-mon[125440]: pgmap v681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:38 smithi136 ceph-mon[125702]: pgmap v681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:40 smithi057 ceph-mon[92072]: pgmap v682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:40 smithi122 ceph-mon[125440]: pgmap v682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:40 smithi136 ceph-mon[125702]: pgmap v682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:42 smithi057 ceph-mon[92072]: pgmap v683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:18:42.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:42 smithi122 ceph-mon[125440]: pgmap v683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:42.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:18:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:42 smithi136 ceph-mon[125702]: pgmap v683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:18:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:18:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:18:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:18:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:18:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:18:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:18:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:18:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:18:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:18:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:44 smithi057 ceph-mon[92072]: pgmap v684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:44 smithi122 ceph-mon[125440]: pgmap v684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:44 smithi136 ceph-mon[125702]: pgmap v684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:46 smithi057 ceph-mon[92072]: pgmap v685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:46 smithi122 ceph-mon[125440]: pgmap v685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:46 smithi136 ceph-mon[125702]: pgmap v685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:48 smithi057 ceph-mon[92072]: pgmap v686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:48 smithi136 ceph-mon[125702]: pgmap v686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:49.412 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:48 smithi122 ceph-mon[125440]: pgmap v686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:49.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:18:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:49.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:18:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:49.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:18:49.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:49.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:18:49.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:18:49.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:18:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:50 smithi057 ceph-mon[92072]: pgmap v687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:50 smithi122 ceph-mon[125440]: pgmap v687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:50 smithi136 ceph-mon[125702]: pgmap v687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:52 smithi057 ceph-mon[92072]: pgmap v688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:52 smithi122 ceph-mon[125440]: pgmap v688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:52 smithi136 ceph-mon[125702]: pgmap v688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:54 smithi122 ceph-mon[125440]: pgmap v689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:54 smithi136 ceph-mon[125702]: pgmap v689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:54 smithi057 ceph-mon[92072]: pgmap v689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:56 smithi122 ceph-mon[125440]: pgmap v690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:56 smithi136 ceph-mon[125702]: pgmap v690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:56 smithi057 ceph-mon[92072]: pgmap v690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:18:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:18:58 smithi122 ceph-mon[125440]: pgmap v691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:18:58 smithi136 ceph-mon[125702]: pgmap v691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:18:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:18:58 smithi057 ceph-mon[92072]: pgmap v691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:00 smithi136 ceph-mon[125702]: pgmap v692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:00 smithi057 ceph-mon[92072]: pgmap v692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:00 smithi122 ceph-mon[125440]: pgmap v692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:02 smithi136 ceph-mon[125702]: pgmap v693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:02 smithi057 ceph-mon[92072]: pgmap v693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:02 smithi122 ceph-mon[125440]: pgmap v693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:04.742+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:19:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:04.743+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:19:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:04.743+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:19:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:04.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:19:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:04.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:19:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:04 smithi136 ceph-mon[125702]: pgmap v694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:19:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:04 smithi057 ceph-mon[92072]: pgmap v694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:19:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:04 smithi122 ceph-mon[125440]: pgmap v694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:19:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:06 smithi136 ceph-mon[125702]: pgmap v695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:19:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:06 smithi057 ceph-mon[92072]: pgmap v695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:19:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:06 smithi122 ceph-mon[125440]: pgmap v695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:19:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:08 smithi136 ceph-mon[125702]: pgmap v696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:19:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:08 smithi057 ceph-mon[92072]: pgmap v696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:19:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:08 smithi122 ceph-mon[125440]: pgmap v696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:19:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:10 smithi136 ceph-mon[125702]: pgmap v697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:19:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:10 smithi057 ceph-mon[92072]: pgmap v697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:19:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:10 smithi122 ceph-mon[125440]: pgmap v697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:19:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:11 smithi136 ceph-mon[125702]: osdmap e118: 12 total, 12 up, 12 in 2023-03-02T11:19:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:11 smithi057 ceph-mon[92072]: osdmap e118: 12 total, 12 up, 12 in 2023-03-02T11:19:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:11 smithi122 ceph-mon[125440]: osdmap e118: 12 total, 12 up, 12 in 2023-03-02T11:19:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:12 smithi136 ceph-mon[125702]: pgmap v699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:19:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:12 smithi057 ceph-mon[92072]: pgmap v699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:19:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:12 smithi122 ceph-mon[125440]: pgmap v699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:19:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:14 smithi136 ceph-mon[125702]: pgmap v700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:19:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:14 smithi136 ceph-mon[125702]: osdmap e119: 12 total, 12 up, 12 in 2023-03-02T11:19:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:14 smithi057 ceph-mon[92072]: pgmap v700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:19:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:14 smithi057 ceph-mon[92072]: osdmap e119: 12 total, 12 up, 12 in 2023-03-02T11:19:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:14 smithi122 ceph-mon[125440]: pgmap v700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:19:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:14 smithi122 ceph-mon[125440]: osdmap e119: 12 total, 12 up, 12 in 2023-03-02T11:19:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:16 smithi136 ceph-mon[125702]: pgmap v702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:19:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:16 smithi057 ceph-mon[92072]: pgmap v702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:19:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:16 smithi122 ceph-mon[125440]: pgmap v702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:19:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:18 smithi136 ceph-mon[125702]: pgmap v703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:19:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:18 smithi057 ceph-mon[92072]: pgmap v703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:19:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:18 smithi122 ceph-mon[125440]: pgmap v703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:19:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:19.758+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:19:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:19.758+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:19:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:19.758+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:19:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:19.758+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:19:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:19.759+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:19:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:20 smithi136 ceph-mon[125702]: pgmap v704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T11:19:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:20 smithi057 ceph-mon[92072]: pgmap v704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T11:19:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:20 smithi122 ceph-mon[125440]: pgmap v704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T11:19:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:22 smithi136 ceph-mon[125702]: pgmap v705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:19:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:22 smithi057 ceph-mon[92072]: pgmap v705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:19:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:22 smithi122 ceph-mon[125440]: pgmap v705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:19:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:24 smithi136 ceph-mon[125702]: pgmap v706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:19:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:24 smithi057 ceph-mon[92072]: pgmap v706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:19:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:24 smithi122 ceph-mon[125440]: pgmap v706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:19:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:26 smithi136 ceph-mon[125702]: pgmap v707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:19:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:26 smithi057 ceph-mon[92072]: pgmap v707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:19:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:26 smithi122 ceph-mon[125440]: pgmap v707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:19:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:28 smithi136 ceph-mon[125702]: pgmap v708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:19:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:28 smithi057 ceph-mon[92072]: pgmap v708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:19:28.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:28 smithi122 ceph-mon[125440]: pgmap v708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:19:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:30 smithi136 ceph-mon[125702]: pgmap v709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:30 smithi057 ceph-mon[92072]: pgmap v709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:30 smithi122 ceph-mon[125440]: pgmap v709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:32 smithi136 ceph-mon[125702]: pgmap v710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:32 smithi057 ceph-mon[92072]: pgmap v710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:32 smithi122 ceph-mon[125440]: pgmap v710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:34 smithi136 ceph-mon[125702]: pgmap v711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:34 smithi057 ceph-mon[92072]: pgmap v711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:34 smithi122 ceph-mon[125440]: pgmap v711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:34.773+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:19:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:34.774+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:19:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:34.774+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:19:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:34.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:19:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:34.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:19:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:36 smithi136 ceph-mon[125702]: pgmap v712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:36 smithi057 ceph-mon[92072]: pgmap v712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:36 smithi122 ceph-mon[125440]: pgmap v712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:38 smithi136 ceph-mon[125702]: pgmap v713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:38 smithi057 ceph-mon[92072]: pgmap v713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:38 smithi122 ceph-mon[125440]: pgmap v713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:40 smithi057 ceph-mon[92072]: pgmap v714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:40 smithi122 ceph-mon[125440]: pgmap v714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:40 smithi136 ceph-mon[125702]: pgmap v714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:42 smithi057 ceph-mon[92072]: pgmap v715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:42 smithi122 ceph-mon[125440]: pgmap v715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:42 smithi136 ceph-mon[125702]: pgmap v715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:44 smithi057 ceph-mon[92072]: pgmap v716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:19:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:19:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:19:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:44 smithi122 ceph-mon[125440]: pgmap v716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:19:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:19:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:19:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:44 smithi136 ceph-mon[125702]: pgmap v716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:19:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:19:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:19:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:19:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:19:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:19:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:19:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:19:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:19:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:19:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:19:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:19:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:46 smithi136 ceph-mon[125702]: pgmap v717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:46 smithi057 ceph-mon[92072]: pgmap v717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:46 smithi122 ceph-mon[125440]: pgmap v717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:48 smithi136 ceph-mon[125702]: pgmap v718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:48 smithi057 ceph-mon[92072]: pgmap v718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:48 smithi122 ceph-mon[125440]: pgmap v718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:49.784+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:19:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:49.784+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:19:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:49.784+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:19:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:49.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:19:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:19:49.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:19:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:50 smithi136 ceph-mon[125702]: pgmap v719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:50 smithi057 ceph-mon[92072]: pgmap v719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:50 smithi122 ceph-mon[125440]: pgmap v719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:52 smithi136 ceph-mon[125702]: pgmap v720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:52 smithi057 ceph-mon[92072]: pgmap v720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:52 smithi122 ceph-mon[125440]: pgmap v720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:54 smithi136 ceph-mon[125702]: pgmap v721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:54 smithi057 ceph-mon[92072]: pgmap v721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:54 smithi122 ceph-mon[125440]: pgmap v721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:56 smithi136 ceph-mon[125702]: pgmap v722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:56 smithi057 ceph-mon[92072]: pgmap v722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:56 smithi122 ceph-mon[125440]: pgmap v722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:19:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:19:58 smithi136 ceph-mon[125702]: pgmap v723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:19:58 smithi057 ceph-mon[92072]: pgmap v723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:19:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:19:58 smithi122 ceph-mon[125440]: pgmap v723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:00 smithi136 ceph-mon[125702]: pgmap v724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:20:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T11:20:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:00 smithi057 ceph-mon[92072]: pgmap v724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:20:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T11:20:00.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:00 smithi122 ceph-mon[125440]: pgmap v724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:20:00.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T11:20:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:02 smithi136 ceph-mon[125702]: pgmap v725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:20:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:02 smithi057 ceph-mon[92072]: pgmap v725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:20:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:02 smithi122 ceph-mon[125440]: pgmap v725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:20:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:04.799+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:20:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:04.800+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:20:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:04.800+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:20:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:04.800+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:20:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:04.800+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:20:05.034 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:04 smithi122 ceph-mon[125440]: pgmap v726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:20:05.034 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:04 smithi136 ceph-mon[125702]: pgmap v726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:20:05.034 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:04 smithi057 ceph-mon[92072]: pgmap v726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:20:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:06 smithi136 ceph-mon[125702]: pgmap v727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:20:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:06 smithi057 ceph-mon[92072]: pgmap v727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:20:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:06 smithi122 ceph-mon[125440]: pgmap v727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:20:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:08.541+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580036e0 con 0x7f5880105ae0 2023-03-02T11:20:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:08.547+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 15 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580036e0 con 0x7f5880105ae0 2023-03-02T11:20:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:08.558+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:20:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:08.558+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 14 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:20:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:08 smithi136 ceph-mon[125702]: pgmap v728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:20:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:08 smithi057 ceph-mon[92072]: pgmap v728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:20:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:08 smithi122 ceph-mon[125440]: pgmap v728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:20:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:10 smithi122 ceph-mon[125440]: pgmap v729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:20:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:10 smithi136 ceph-mon[125702]: pgmap v729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:20:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:10 smithi057 ceph-mon[92072]: pgmap v729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:20:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:11 smithi136 ceph-mon[125702]: osdmap e120: 12 total, 12 up, 12 in 2023-03-02T11:20:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:11 smithi057 ceph-mon[92072]: osdmap e120: 12 total, 12 up, 12 in 2023-03-02T11:20:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:11 smithi122 ceph-mon[125440]: osdmap e120: 12 total, 12 up, 12 in 2023-03-02T11:20:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:12 smithi136 ceph-mon[125702]: pgmap v731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:20:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:12 smithi057 ceph-mon[92072]: pgmap v731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:20:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:12 smithi122 ceph-mon[125440]: pgmap v731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:20:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:14 smithi136 ceph-mon[125702]: pgmap v732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:20:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:14 smithi136 ceph-mon[125702]: osdmap e121: 12 total, 12 up, 12 in 2023-03-02T11:20:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:14 smithi057 ceph-mon[92072]: pgmap v732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:20:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:14 smithi057 ceph-mon[92072]: osdmap e121: 12 total, 12 up, 12 in 2023-03-02T11:20:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:14 smithi122 ceph-mon[125440]: pgmap v732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:20:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:14 smithi122 ceph-mon[125440]: osdmap e121: 12 total, 12 up, 12 in 2023-03-02T11:20:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:16 smithi136 ceph-mon[125702]: pgmap v734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:20:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:16 smithi057 ceph-mon[92072]: pgmap v734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:20:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:16 smithi122 ceph-mon[125440]: pgmap v734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:20:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:18 smithi136 ceph-mon[125702]: pgmap v735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:20:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:18 smithi057 ceph-mon[92072]: pgmap v735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:20:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:18 smithi122 ceph-mon[125440]: pgmap v735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:20:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:19.814+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:20:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:19.815+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:20:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:19.815+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:20:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:19.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:20:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:19.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:20:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:20 smithi136 ceph-mon[125702]: pgmap v736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T11:20:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:20 smithi057 ceph-mon[92072]: pgmap v736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T11:20:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:20 smithi122 ceph-mon[125440]: pgmap v736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T11:20:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:22 smithi136 ceph-mon[125702]: pgmap v737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:20:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:22 smithi057 ceph-mon[92072]: pgmap v737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:20:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:22 smithi122 ceph-mon[125440]: pgmap v737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:20:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:24 smithi136 ceph-mon[125702]: pgmap v738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:20:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:24 smithi057 ceph-mon[92072]: pgmap v738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:20:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:24 smithi122 ceph-mon[125440]: pgmap v738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:20:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:26 smithi136 ceph-mon[125702]: pgmap v739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:20:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:26 smithi057 ceph-mon[92072]: pgmap v739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:20:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:26 smithi122 ceph-mon[125440]: pgmap v739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:20:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:28 smithi057 ceph-mon[92072]: pgmap v740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:20:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:28 smithi122 ceph-mon[125440]: pgmap v740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:20:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:28 smithi136 ceph-mon[125702]: pgmap v740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:20:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:30 smithi057 ceph-mon[92072]: pgmap v741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:30 smithi122 ceph-mon[125440]: pgmap v741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:30 smithi136 ceph-mon[125702]: pgmap v741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:32 smithi057 ceph-mon[92072]: pgmap v742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:32 smithi122 ceph-mon[125440]: pgmap v742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:32 smithi136 ceph-mon[125702]: pgmap v742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:34.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:34.821+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:20:34.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:34.821+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:20:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:34.821+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:20:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:34.821+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:20:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:34.821+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:20:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:34 smithi057 ceph-mon[92072]: pgmap v743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:34 smithi122 ceph-mon[125440]: pgmap v743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:34 smithi136 ceph-mon[125702]: pgmap v743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:36 smithi057 ceph-mon[92072]: pgmap v744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:36 smithi122 ceph-mon[125440]: pgmap v744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:37.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:36 smithi136 ceph-mon[125702]: pgmap v744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:38 smithi057 ceph-mon[92072]: pgmap v745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:38 smithi122 ceph-mon[125440]: pgmap v745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:38 smithi136 ceph-mon[125702]: pgmap v745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:40 smithi057 ceph-mon[92072]: pgmap v746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:40 smithi122 ceph-mon[125440]: pgmap v746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:40 smithi136 ceph-mon[125702]: pgmap v746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:42 smithi057 ceph-mon[92072]: pgmap v747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:42 smithi122 ceph-mon[125440]: pgmap v747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:42 smithi136 ceph-mon[125702]: pgmap v747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:44 smithi057 ceph-mon[92072]: pgmap v748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:20:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:44 smithi122 ceph-mon[125440]: pgmap v748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:20:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:44 smithi136 ceph-mon[125702]: pgmap v748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:45.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:20:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:46 smithi057 ceph-mon[92072]: pgmap v749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:20:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:20:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:46 smithi122 ceph-mon[125440]: pgmap v749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:20:46.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:20:46.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:46 smithi136 ceph-mon[125702]: pgmap v749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:46.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:20:46.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:20:46.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:20:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:48 smithi057 ceph-mon[92072]: pgmap v750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:48 smithi122 ceph-mon[125440]: pgmap v750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:48 smithi136 ceph-mon[125702]: pgmap v750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:49.836+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:20:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:49.836+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:20:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:49.836+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:20:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:49.836+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:20:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:20:49.836+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:20:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:50 smithi057 ceph-mon[92072]: pgmap v751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:50 smithi122 ceph-mon[125440]: pgmap v751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:50 smithi136 ceph-mon[125702]: pgmap v751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:52.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:52 smithi122 ceph-mon[125440]: pgmap v752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:52 smithi136 ceph-mon[125702]: pgmap v752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:52 smithi057 ceph-mon[92072]: pgmap v752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:54 smithi122 ceph-mon[125440]: pgmap v753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:54 smithi136 ceph-mon[125702]: pgmap v753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:54 smithi057 ceph-mon[92072]: pgmap v753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:56 smithi122 ceph-mon[125440]: pgmap v754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:56 smithi136 ceph-mon[125702]: pgmap v754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:56 smithi057 ceph-mon[92072]: pgmap v754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:20:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:20:58 smithi122 ceph-mon[125440]: pgmap v755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:20:58 smithi136 ceph-mon[125702]: pgmap v755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:20:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:20:58 smithi057 ceph-mon[92072]: pgmap v755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:00 smithi136 ceph-mon[125702]: pgmap v756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:00 smithi057 ceph-mon[92072]: pgmap v756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:00 smithi122 ceph-mon[125440]: pgmap v756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:02 smithi136 ceph-mon[125702]: pgmap v757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:02 smithi057 ceph-mon[92072]: pgmap v757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:02 smithi122 ceph-mon[125440]: pgmap v757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:04 smithi136 ceph-mon[125702]: pgmap v758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:21:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:04 smithi057 ceph-mon[92072]: pgmap v758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:21:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:04 smithi122 ceph-mon[125440]: pgmap v758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:21:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:04.843+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:21:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:04.844+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:21:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:04.844+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:21:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:04.844+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:21:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:04.844+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:21:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:06 smithi136 ceph-mon[125702]: pgmap v759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:21:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:06 smithi057 ceph-mon[92072]: pgmap v759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:21:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:06 smithi122 ceph-mon[125440]: pgmap v759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:21:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:08 smithi136 ceph-mon[125702]: pgmap v760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:21:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:08 smithi057 ceph-mon[92072]: pgmap v760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:21:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:08 smithi122 ceph-mon[125440]: pgmap v760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:21:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:10 smithi136 ceph-mon[125702]: pgmap v761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:21:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:10 smithi057 ceph-mon[92072]: pgmap v761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:21:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:10 smithi122 ceph-mon[125440]: pgmap v761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:21:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:11 smithi136 ceph-mon[125702]: osdmap e122: 12 total, 12 up, 12 in 2023-03-02T11:21:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:11 smithi057 ceph-mon[92072]: osdmap e122: 12 total, 12 up, 12 in 2023-03-02T11:21:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:11 smithi122 ceph-mon[125440]: osdmap e122: 12 total, 12 up, 12 in 2023-03-02T11:21:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:12 smithi136 ceph-mon[125702]: pgmap v763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:21:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:12 smithi057 ceph-mon[92072]: pgmap v763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:21:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:12 smithi122 ceph-mon[125440]: pgmap v763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:21:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:14 smithi136 ceph-mon[125702]: pgmap v764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:21:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:14 smithi136 ceph-mon[125702]: osdmap e123: 12 total, 12 up, 12 in 2023-03-02T11:21:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:14 smithi057 ceph-mon[92072]: pgmap v764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:21:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:14 smithi057 ceph-mon[92072]: osdmap e123: 12 total, 12 up, 12 in 2023-03-02T11:21:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:14 smithi122 ceph-mon[125440]: pgmap v764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:21:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:14 smithi122 ceph-mon[125440]: osdmap e123: 12 total, 12 up, 12 in 2023-03-02T11:21:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:16 smithi136 ceph-mon[125702]: pgmap v766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:21:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:16 smithi057 ceph-mon[92072]: pgmap v766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:21:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:16 smithi122 ceph-mon[125440]: pgmap v766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:21:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:18 smithi136 ceph-mon[125702]: pgmap v767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:21:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:18 smithi057 ceph-mon[92072]: pgmap v767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:21:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:18 smithi122 ceph-mon[125440]: pgmap v767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:21:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:19.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:21:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:19.856+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:21:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:19.856+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:21:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:19.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:21:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:19.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:21:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:20 smithi136 ceph-mon[125702]: pgmap v768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T11:21:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:20 smithi057 ceph-mon[92072]: pgmap v768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T11:21:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:20 smithi122 ceph-mon[125440]: pgmap v768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T11:21:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:22 smithi136 ceph-mon[125702]: pgmap v769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:21:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:22 smithi057 ceph-mon[92072]: pgmap v769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:21:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:22 smithi122 ceph-mon[125440]: pgmap v769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:21:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:24 smithi136 ceph-mon[125702]: pgmap v770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:21:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:24 smithi057 ceph-mon[92072]: pgmap v770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:21:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:24 smithi122 ceph-mon[125440]: pgmap v770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:21:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:26 smithi136 ceph-mon[125702]: pgmap v771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:21:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:26 smithi057 ceph-mon[92072]: pgmap v771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:21:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:26 smithi122 ceph-mon[125440]: pgmap v771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:21:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:28 smithi136 ceph-mon[125702]: pgmap v772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:21:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:28 smithi057 ceph-mon[92072]: pgmap v772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:21:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:28 smithi122 ceph-mon[125440]: pgmap v772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:21:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:30 smithi136 ceph-mon[125702]: pgmap v773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:30 smithi057 ceph-mon[92072]: pgmap v773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:30 smithi122 ceph-mon[125440]: pgmap v773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:32 smithi136 ceph-mon[125702]: pgmap v774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:32 smithi057 ceph-mon[92072]: pgmap v774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:32 smithi122 ceph-mon[125440]: pgmap v774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:34 smithi136 ceph-mon[125702]: pgmap v775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:34.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:34 smithi057 ceph-mon[92072]: pgmap v775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:34 smithi122 ceph-mon[125440]: pgmap v775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:34.872+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:21:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:34.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:21:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:34.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:21:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:34.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:21:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:34.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:21:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:36 smithi136 ceph-mon[125702]: pgmap v776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:36 smithi057 ceph-mon[92072]: pgmap v776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:36 smithi122 ceph-mon[125440]: pgmap v776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:38 smithi057 ceph-mon[92072]: pgmap v777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:38 smithi122 ceph-mon[125440]: pgmap v777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:38 smithi136 ceph-mon[125702]: pgmap v777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:40 smithi057 ceph-mon[92072]: pgmap v778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:40 smithi122 ceph-mon[125440]: pgmap v778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:40 smithi136 ceph-mon[125702]: pgmap v778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:42 smithi057 ceph-mon[92072]: pgmap v779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:42 smithi122 ceph-mon[125440]: pgmap v779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:42 smithi136 ceph-mon[125702]: pgmap v779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:44 smithi057 ceph-mon[92072]: pgmap v780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:44 smithi122 ceph-mon[125440]: pgmap v780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:44 smithi136 ceph-mon[125702]: pgmap v780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:46 smithi057 ceph-mon[92072]: pgmap v781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:21:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:46 smithi122 ceph-mon[125440]: pgmap v781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:21:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:46 smithi136 ceph-mon[125702]: pgmap v781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:21:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:21:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:21:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:21:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:21:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:21:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:21:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:21:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:21:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:21:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:48 smithi057 ceph-mon[92072]: pgmap v782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:48 smithi122 ceph-mon[125440]: pgmap v782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:48 smithi136 ceph-mon[125702]: pgmap v782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:49.883+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:21:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:49.883+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:21:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:49.883+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:21:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:49.883+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:21:49.887 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:21:49.883+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:21:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:50 smithi057 ceph-mon[92072]: pgmap v783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:50 smithi122 ceph-mon[125440]: pgmap v783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:50 smithi136 ceph-mon[125702]: pgmap v783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:52 smithi057 ceph-mon[92072]: pgmap v784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:52 smithi122 ceph-mon[125440]: pgmap v784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:52 smithi136 ceph-mon[125702]: pgmap v784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:54 smithi057 ceph-mon[92072]: pgmap v785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:54 smithi122 ceph-mon[125440]: pgmap v785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:54 smithi136 ceph-mon[125702]: pgmap v785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:56 smithi057 ceph-mon[92072]: pgmap v786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:56 smithi122 ceph-mon[125440]: pgmap v786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:56 smithi136 ceph-mon[125702]: pgmap v786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:21:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:21:58 smithi057 ceph-mon[92072]: pgmap v787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:21:58 smithi122 ceph-mon[125440]: pgmap v787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:21:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:21:58 smithi136 ceph-mon[125702]: pgmap v787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:00 smithi057 ceph-mon[92072]: pgmap v788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:00 smithi122 ceph-mon[125440]: pgmap v788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:00 smithi136 ceph-mon[125702]: pgmap v788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:02 smithi057 ceph-mon[92072]: pgmap v789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:02 smithi122 ceph-mon[125440]: pgmap v789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:02 smithi136 ceph-mon[125702]: pgmap v789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:04 smithi057 ceph-mon[92072]: pgmap v790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:22:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:04 smithi122 ceph-mon[125440]: pgmap v790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:22:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:04 smithi136 ceph-mon[125702]: pgmap v790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:22:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:04.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:22:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:04.891+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:22:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:04.891+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:22:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:04.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:22:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:04.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:22:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:06 smithi057 ceph-mon[92072]: pgmap v791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:22:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:06 smithi122 ceph-mon[125440]: pgmap v791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:22:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:06 smithi136 ceph-mon[125702]: pgmap v791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:22:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:08 smithi057 ceph-mon[92072]: pgmap v792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:22:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:08 smithi122 ceph-mon[125440]: pgmap v792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:22:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:08 smithi136 ceph-mon[125702]: pgmap v792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:22:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:10 smithi122 ceph-mon[125440]: pgmap v793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:22:10.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:10 smithi136 ceph-mon[125702]: pgmap v793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:22:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:10 smithi057 ceph-mon[92072]: pgmap v793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:22:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:11 smithi122 ceph-mon[125440]: osdmap e124: 12 total, 12 up, 12 in 2023-03-02T11:22:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:11 smithi136 ceph-mon[125702]: osdmap e124: 12 total, 12 up, 12 in 2023-03-02T11:22:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:11 smithi057 ceph-mon[92072]: osdmap e124: 12 total, 12 up, 12 in 2023-03-02T11:22:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:12 smithi122 ceph-mon[125440]: pgmap v795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:22:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:12 smithi136 ceph-mon[125702]: pgmap v795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:22:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:12 smithi057 ceph-mon[92072]: pgmap v795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:22:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:14 smithi136 ceph-mon[125702]: pgmap v796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:22:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:14 smithi136 ceph-mon[125702]: osdmap e125: 12 total, 12 up, 12 in 2023-03-02T11:22:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:14 smithi057 ceph-mon[92072]: pgmap v796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:22:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:14 smithi057 ceph-mon[92072]: osdmap e125: 12 total, 12 up, 12 in 2023-03-02T11:22:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:14 smithi122 ceph-mon[125440]: pgmap v796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:22:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:14 smithi122 ceph-mon[125440]: osdmap e125: 12 total, 12 up, 12 in 2023-03-02T11:22:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:16 smithi136 ceph-mon[125702]: pgmap v798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:22:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:16 smithi057 ceph-mon[92072]: pgmap v798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:22:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:16 smithi122 ceph-mon[125440]: pgmap v798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:22:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:18 smithi136 ceph-mon[125702]: pgmap v799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:22:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:18 smithi057 ceph-mon[92072]: pgmap v799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:22:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:18 smithi122 ceph-mon[125440]: pgmap v799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:22:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:19.906+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:22:19.907 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:19.906+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:22:19.907 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:19.906+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:22:19.907 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:19.906+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:22:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:19.906+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:22:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:20 smithi136 ceph-mon[125702]: pgmap v800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T11:22:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:20 smithi057 ceph-mon[92072]: pgmap v800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T11:22:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:20 smithi122 ceph-mon[125440]: pgmap v800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T11:22:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:22 smithi136 ceph-mon[125702]: pgmap v801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:22:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:22 smithi057 ceph-mon[92072]: pgmap v801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:22:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:22 smithi122 ceph-mon[125440]: pgmap v801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:22:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:24 smithi136 ceph-mon[125702]: pgmap v802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T11:22:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:24 smithi057 ceph-mon[92072]: pgmap v802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T11:22:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:24 smithi122 ceph-mon[125440]: pgmap v802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T11:22:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:26 smithi136 ceph-mon[125702]: pgmap v803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:22:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:26 smithi057 ceph-mon[92072]: pgmap v803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:22:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:26 smithi122 ceph-mon[125440]: pgmap v803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:22:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:28 smithi136 ceph-mon[125702]: pgmap v804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:22:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:28 smithi057 ceph-mon[92072]: pgmap v804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:22:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:28 smithi122 ceph-mon[125440]: pgmap v804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:22:30.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:30 smithi136 ceph-mon[125702]: pgmap v805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:22:31.054 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:30 smithi122 ceph-mon[125440]: pgmap v805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:22:31.055 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:30 smithi057 ceph-mon[92072]: pgmap v805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:22:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:32 smithi136 ceph-mon[125702]: pgmap v806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:22:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:32 smithi057 ceph-mon[92072]: pgmap v806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:22:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:32 smithi122 ceph-mon[125440]: pgmap v806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:22:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:34 smithi136 ceph-mon[125702]: pgmap v807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:34.916+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:22:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:34.916+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:22:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:34.916+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:22:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:34.916+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:22:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:34.916+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:22:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:34 smithi057 ceph-mon[92072]: pgmap v807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:34 smithi122 ceph-mon[125440]: pgmap v807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:36 smithi136 ceph-mon[125702]: pgmap v808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:36 smithi057 ceph-mon[92072]: pgmap v808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:36 smithi122 ceph-mon[125440]: pgmap v808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:38 smithi136 ceph-mon[125702]: pgmap v809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:38 smithi057 ceph-mon[92072]: pgmap v809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:38 smithi122 ceph-mon[125440]: pgmap v809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:40 smithi136 ceph-mon[125702]: pgmap v810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:40 smithi057 ceph-mon[92072]: pgmap v810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:40.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:40 smithi122 ceph-mon[125440]: pgmap v810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:42 smithi136 ceph-mon[125702]: pgmap v811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:42 smithi057 ceph-mon[92072]: pgmap v811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:42 smithi122 ceph-mon[125440]: pgmap v811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:44 smithi136 ceph-mon[125702]: pgmap v812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:44 smithi057 ceph-mon[92072]: pgmap v812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:44 smithi122 ceph-mon[125440]: pgmap v812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:46 smithi136 ceph-mon[125702]: pgmap v813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:46 smithi057 ceph-mon[92072]: pgmap v813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:46 smithi122 ceph-mon[125440]: pgmap v813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:22:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:22:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:22:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:48 smithi136 ceph-mon[125702]: pgmap v814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:48 smithi057 ceph-mon[92072]: pgmap v814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:48 smithi122 ceph-mon[125440]: pgmap v814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:49.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:49.928+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:22:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:49.929+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:22:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:49.929+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:22:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:49.929+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:22:49.934 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:22:49.929+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:22:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:50 smithi136 ceph-mon[125702]: pgmap v815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:50 smithi057 ceph-mon[92072]: pgmap v815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:50 smithi122 ceph-mon[125440]: pgmap v815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:22:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:22:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:22:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:22:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:22:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:22:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:22:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:22:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:22:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:52 smithi136 ceph-mon[125702]: pgmap v816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:52 smithi057 ceph-mon[92072]: pgmap v816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:52 smithi122 ceph-mon[125440]: pgmap v816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:54 smithi057 ceph-mon[92072]: pgmap v817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:54 smithi122 ceph-mon[125440]: pgmap v817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:54 smithi136 ceph-mon[125702]: pgmap v817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:56 smithi057 ceph-mon[92072]: pgmap v818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:56 smithi122 ceph-mon[125440]: pgmap v818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:56 smithi136 ceph-mon[125702]: pgmap v818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:22:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:22:58 smithi057 ceph-mon[92072]: pgmap v819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:22:58 smithi122 ceph-mon[125440]: pgmap v819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:22:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:22:58 smithi136 ceph-mon[125702]: pgmap v819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:00 smithi057 ceph-mon[92072]: pgmap v820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:00 smithi122 ceph-mon[125440]: pgmap v820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:00 smithi136 ceph-mon[125702]: pgmap v820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:02 smithi057 ceph-mon[92072]: pgmap v821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:02 smithi122 ceph-mon[125440]: pgmap v821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:02 smithi136 ceph-mon[125702]: pgmap v821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:04 smithi057 ceph-mon[92072]: pgmap v822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:23:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:04.945+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:23:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:04.946+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:23:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:04.946+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:23:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:04.946+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:23:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:04.946+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:23:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:04 smithi122 ceph-mon[125440]: pgmap v822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:23:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:04 smithi136 ceph-mon[125702]: pgmap v822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:23:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:06 smithi057 ceph-mon[92072]: pgmap v823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:23:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:06 smithi122 ceph-mon[125440]: pgmap v823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:23:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:06 smithi136 ceph-mon[125702]: pgmap v823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:23:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:08.567+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580036e0 con 0x7f5880105ae0 2023-03-02T11:23:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:08.567+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 16 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580036e0 con 0x7f5880105ae0 2023-03-02T11:23:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:08.580+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:23:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:08.581+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 15 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:23:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:08 smithi057 ceph-mon[92072]: pgmap v824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:23:08.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:08 smithi122 ceph-mon[125440]: pgmap v824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:23:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:08 smithi136 ceph-mon[125702]: pgmap v824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:23:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:10 smithi057 ceph-mon[92072]: pgmap v825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:23:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:10 smithi122 ceph-mon[125440]: pgmap v825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:23:11.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:10 smithi136 ceph-mon[125702]: pgmap v825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:23:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:11 smithi057 ceph-mon[92072]: osdmap e126: 12 total, 12 up, 12 in 2023-03-02T11:23:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:11 smithi122 ceph-mon[125440]: osdmap e126: 12 total, 12 up, 12 in 2023-03-02T11:23:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:11 smithi136 ceph-mon[125702]: osdmap e126: 12 total, 12 up, 12 in 2023-03-02T11:23:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:12 smithi057 ceph-mon[92072]: pgmap v827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:23:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:12 smithi122 ceph-mon[125440]: pgmap v827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:23:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:12 smithi136 ceph-mon[125702]: pgmap v827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:23:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:14 smithi057 ceph-mon[92072]: pgmap v828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:23:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:14 smithi057 ceph-mon[92072]: osdmap e127: 12 total, 12 up, 12 in 2023-03-02T11:23:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:14 smithi122 ceph-mon[125440]: pgmap v828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:23:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:14 smithi122 ceph-mon[125440]: osdmap e127: 12 total, 12 up, 12 in 2023-03-02T11:23:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:14 smithi136 ceph-mon[125702]: pgmap v828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:23:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:14 smithi136 ceph-mon[125702]: osdmap e127: 12 total, 12 up, 12 in 2023-03-02T11:23:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:16 smithi057 ceph-mon[92072]: pgmap v830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:23:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:16 smithi122 ceph-mon[125440]: pgmap v830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:23:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:16 smithi136 ceph-mon[125702]: pgmap v830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:23:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:18 smithi122 ceph-mon[125440]: pgmap v831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:23:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:18 smithi136 ceph-mon[125702]: pgmap v831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:23:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:18 smithi057 ceph-mon[92072]: pgmap v831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:23:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:19.961+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:23:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:19.962+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:23:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:19.962+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:23:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:19.962+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:23:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:19.962+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:23:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:20 smithi122 ceph-mon[125440]: pgmap v832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T11:23:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:20 smithi136 ceph-mon[125702]: pgmap v832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T11:23:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:20 smithi057 ceph-mon[92072]: pgmap v832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T11:23:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:22 smithi122 ceph-mon[125440]: pgmap v833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:23:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:22 smithi136 ceph-mon[125702]: pgmap v833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:23:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:22 smithi057 ceph-mon[92072]: pgmap v833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:23:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:24 smithi136 ceph-mon[125702]: pgmap v834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:23:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:24 smithi057 ceph-mon[92072]: pgmap v834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:23:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:24 smithi122 ceph-mon[125440]: pgmap v834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:23:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:26 smithi136 ceph-mon[125702]: pgmap v835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:23:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:26 smithi057 ceph-mon[92072]: pgmap v835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:23:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:26 smithi122 ceph-mon[125440]: pgmap v835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:23:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:28 smithi136 ceph-mon[125702]: pgmap v836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:23:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:28 smithi057 ceph-mon[92072]: pgmap v836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:23:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:28 smithi122 ceph-mon[125440]: pgmap v836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:23:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:30 smithi136 ceph-mon[125702]: pgmap v837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:30 smithi057 ceph-mon[92072]: pgmap v837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:30 smithi122 ceph-mon[125440]: pgmap v837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:32 smithi136 ceph-mon[125702]: pgmap v838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:32 smithi057 ceph-mon[92072]: pgmap v838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:32 smithi122 ceph-mon[125440]: pgmap v838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:34.973+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:23:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:34.973+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:23:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:34.973+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:23:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:34.973+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:23:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:34.973+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:23:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:34 smithi136 ceph-mon[125702]: pgmap v839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:34 smithi057 ceph-mon[92072]: pgmap v839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:34 smithi122 ceph-mon[125440]: pgmap v839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:36 smithi136 ceph-mon[125702]: pgmap v840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:36 smithi057 ceph-mon[92072]: pgmap v840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:36 smithi122 ceph-mon[125440]: pgmap v840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:38 smithi136 ceph-mon[125702]: pgmap v841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:38 smithi057 ceph-mon[92072]: pgmap v841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:38 smithi122 ceph-mon[125440]: pgmap v841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:40 smithi136 ceph-mon[125702]: pgmap v842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:40 smithi057 ceph-mon[92072]: pgmap v842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:40 smithi122 ceph-mon[125440]: pgmap v842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:42 smithi136 ceph-mon[125702]: pgmap v843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:42 smithi057 ceph-mon[92072]: pgmap v843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:42 smithi122 ceph-mon[125440]: pgmap v843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:44 smithi136 ceph-mon[125702]: pgmap v844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:44 smithi057 ceph-mon[92072]: pgmap v844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:44 smithi122 ceph-mon[125440]: pgmap v844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:46 smithi136 ceph-mon[125702]: pgmap v845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:46 smithi057 ceph-mon[92072]: pgmap v845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:46 smithi122 ceph-mon[125440]: pgmap v845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:48 smithi136 ceph-mon[125702]: pgmap v846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:48 smithi057 ceph-mon[92072]: pgmap v846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:48 smithi122 ceph-mon[125440]: pgmap v846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:49.980+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:23:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:49.980+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:23:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:49.980+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:23:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:49.980+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:23:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:49.980+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:23:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:50 smithi136 ceph-mon[125702]: pgmap v847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:50 smithi057 ceph-mon[92072]: pgmap v847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:50 smithi122 ceph-mon[125440]: pgmap v847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:23:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:23:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:23:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:52 smithi136 ceph-mon[125702]: pgmap v848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:52 smithi057 ceph-mon[92072]: pgmap v848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:52 smithi122 ceph-mon[125440]: pgmap v848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:53.572+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580036e0 con 0x7f5880105ae0 2023-03-02T11:23:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:53.573+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 17 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580036e0 con 0x7f5880105ae0 2023-03-02T11:23:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:53.585+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:23:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:23:53.586+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 16 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:23:55.035 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:54 smithi057 ceph-mon[92072]: pgmap v849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:54 smithi136 ceph-mon[125702]: pgmap v849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:54 smithi122 ceph-mon[125440]: pgmap v849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:56 smithi136 ceph-mon[125702]: pgmap v850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:23:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:23:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:23:56.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:23:56.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:23:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:56 smithi057 ceph-mon[92072]: pgmap v850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:23:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:23:56.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:23:56.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:23:56.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:23:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:56 smithi122 ceph-mon[125440]: pgmap v850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:23:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:23:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:23:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:23:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:23:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:23:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:23:58 smithi136 ceph-mon[125702]: pgmap v851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:23:58 smithi057 ceph-mon[92072]: pgmap v851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:23:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:23:58 smithi122 ceph-mon[125440]: pgmap v851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:00 smithi136 ceph-mon[125702]: pgmap v852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:00 smithi057 ceph-mon[92072]: pgmap v852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:00 smithi122 ceph-mon[125440]: pgmap v852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:02 smithi136 ceph-mon[125702]: pgmap v853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:02 smithi057 ceph-mon[92072]: pgmap v853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:02 smithi122 ceph-mon[125440]: pgmap v853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:04 smithi136 ceph-mon[125702]: pgmap v854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:24:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:04 smithi057 ceph-mon[92072]: pgmap v854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:24:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:04 smithi122 ceph-mon[125440]: pgmap v854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:24:04.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:04.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:24:04.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:04.990+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:24:04.993 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:04.990+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:24:04.993 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:04.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:24:04.993 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:04.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:24:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:06 smithi136 ceph-mon[125702]: pgmap v855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:24:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:06 smithi057 ceph-mon[92072]: pgmap v855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:24:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:06 smithi122 ceph-mon[125440]: pgmap v855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:24:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:08 smithi136 ceph-mon[125702]: pgmap v856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:24:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:08 smithi057 ceph-mon[92072]: pgmap v856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:24:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:08 smithi122 ceph-mon[125440]: pgmap v856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:24:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:10 smithi136 ceph-mon[125702]: pgmap v857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:24:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:10 smithi057 ceph-mon[92072]: pgmap v857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:24:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:10 smithi122 ceph-mon[125440]: pgmap v857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:24:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:11 smithi136 ceph-mon[125702]: osdmap e128: 12 total, 12 up, 12 in 2023-03-02T11:24:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:11 smithi057 ceph-mon[92072]: osdmap e128: 12 total, 12 up, 12 in 2023-03-02T11:24:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:11 smithi122 ceph-mon[125440]: osdmap e128: 12 total, 12 up, 12 in 2023-03-02T11:24:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:12 smithi136 ceph-mon[125702]: pgmap v859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:24:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:12 smithi057 ceph-mon[92072]: pgmap v859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:24:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:12 smithi122 ceph-mon[125440]: pgmap v859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:24:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:14 smithi136 ceph-mon[125702]: pgmap v860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:24:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:14 smithi136 ceph-mon[125702]: osdmap e129: 12 total, 12 up, 12 in 2023-03-02T11:24:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:14 smithi057 ceph-mon[92072]: pgmap v860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:24:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:14 smithi057 ceph-mon[92072]: osdmap e129: 12 total, 12 up, 12 in 2023-03-02T11:24:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:14 smithi122 ceph-mon[125440]: pgmap v860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:24:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:14 smithi122 ceph-mon[125440]: osdmap e129: 12 total, 12 up, 12 in 2023-03-02T11:24:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:16 smithi136 ceph-mon[125702]: pgmap v862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:24:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:16 smithi057 ceph-mon[92072]: pgmap v862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:24:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:16 smithi122 ceph-mon[125440]: pgmap v862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:24:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:18 smithi136 ceph-mon[125702]: pgmap v863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:24:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:18 smithi057 ceph-mon[92072]: pgmap v863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:24:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:18 smithi122 ceph-mon[125440]: pgmap v863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:24:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:19.994+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:24:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:19.995+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:24:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:19.995+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:24:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:19.995+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:24:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:19.995+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:24:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:20 smithi136 ceph-mon[125702]: pgmap v864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T11:24:20.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:20 smithi057 ceph-mon[92072]: pgmap v864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T11:24:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:20 smithi122 ceph-mon[125440]: pgmap v864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T11:24:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:22 smithi136 ceph-mon[125702]: pgmap v865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:24:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:22 smithi057 ceph-mon[92072]: pgmap v865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:24:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:22 smithi122 ceph-mon[125440]: pgmap v865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:24:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:24 smithi136 ceph-mon[125702]: pgmap v866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:24:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:24 smithi057 ceph-mon[92072]: pgmap v866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:24:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:24 smithi122 ceph-mon[125440]: pgmap v866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:24:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:26 smithi136 ceph-mon[125702]: pgmap v867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:24:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:26 smithi057 ceph-mon[92072]: pgmap v867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:24:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:26 smithi122 ceph-mon[125440]: pgmap v867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:24:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:28 smithi136 ceph-mon[125702]: pgmap v868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:24:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:28 smithi057 ceph-mon[92072]: pgmap v868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:24:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:28 smithi122 ceph-mon[125440]: pgmap v868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:24:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:30 smithi136 ceph-mon[125702]: pgmap v869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:30 smithi057 ceph-mon[92072]: pgmap v869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:30 smithi122 ceph-mon[125440]: pgmap v869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:32 smithi136 ceph-mon[125702]: pgmap v870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:32 smithi057 ceph-mon[92072]: pgmap v870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:32 smithi122 ceph-mon[125440]: pgmap v870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:34 smithi136 ceph-mon[125702]: pgmap v871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:34 smithi057 ceph-mon[92072]: pgmap v871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:34 smithi122 ceph-mon[125440]: pgmap v871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:35.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:35.004+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:24:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:35.005+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:24:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:35.005+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:24:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:35.005+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:24:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:35.005+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:24:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:36 smithi136 ceph-mon[125702]: pgmap v872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:36 smithi057 ceph-mon[92072]: pgmap v872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:36 smithi122 ceph-mon[125440]: pgmap v872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:38 smithi136 ceph-mon[125702]: pgmap v873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:38.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:38 smithi057 ceph-mon[92072]: pgmap v873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:38 smithi122 ceph-mon[125440]: pgmap v873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:40 smithi136 ceph-mon[125702]: pgmap v874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:40 smithi057 ceph-mon[92072]: pgmap v874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:40 smithi122 ceph-mon[125440]: pgmap v874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:42 smithi136 ceph-mon[125702]: pgmap v875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:42 smithi057 ceph-mon[92072]: pgmap v875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:42 smithi122 ceph-mon[125440]: pgmap v875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:44 smithi136 ceph-mon[125702]: pgmap v876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:44 smithi057 ceph-mon[92072]: pgmap v876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:44 smithi122 ceph-mon[125440]: pgmap v876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:46 smithi136 ceph-mon[125702]: pgmap v877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:46 smithi057 ceph-mon[92072]: pgmap v877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:46 smithi122 ceph-mon[125440]: pgmap v877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:48 smithi136 ceph-mon[125702]: pgmap v878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:48 smithi057 ceph-mon[92072]: pgmap v878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:48 smithi122 ceph-mon[125440]: pgmap v878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:50.016+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:24:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:50.017+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:24:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:50.017+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:24:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:50.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:24:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:24:50.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:24:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:50 smithi057 ceph-mon[92072]: pgmap v879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:50 smithi122 ceph-mon[125440]: pgmap v879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:50 smithi136 ceph-mon[125702]: pgmap v879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:52 smithi057 ceph-mon[92072]: pgmap v880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:52 smithi122 ceph-mon[125440]: pgmap v880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:52 smithi136 ceph-mon[125702]: pgmap v880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:54 smithi057 ceph-mon[92072]: pgmap v881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:54.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:54 smithi122 ceph-mon[125440]: pgmap v881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:54 smithi136 ceph-mon[125702]: pgmap v881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:56 smithi057 ceph-mon[92072]: pgmap v882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:24:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:56 smithi122 ceph-mon[125440]: pgmap v882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:24:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:56 smithi136 ceph-mon[125702]: pgmap v882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:24:57.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:24:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:24:58 smithi057 ceph-mon[92072]: pgmap v883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:24:58 smithi122 ceph-mon[125440]: pgmap v883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:24:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:24:58 smithi136 ceph-mon[125702]: pgmap v883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:00 smithi057 ceph-mon[92072]: pgmap v884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:00 smithi122 ceph-mon[125440]: pgmap v884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:01.019 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:00 smithi136 ceph-mon[125702]: pgmap v884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:01.019 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:01.020 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:02 smithi057 ceph-mon[92072]: pgmap v885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:02 smithi122 ceph-mon[125440]: pgmap v885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:03.034 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:02 smithi136 ceph-mon[125702]: pgmap v885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:04 smithi057 ceph-mon[92072]: pgmap v886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:25:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:04 smithi122 ceph-mon[125440]: pgmap v886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:25:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:05.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:25:05.037 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:05.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:25:05.037 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:05.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:25:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:05.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:25:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:05.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:25:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:04 smithi136 ceph-mon[125702]: pgmap v886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:25:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:06 smithi136 ceph-mon[125702]: pgmap v887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:25:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:25:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:25:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:06 smithi057 ceph-mon[92072]: pgmap v887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:25:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:25:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:25:07.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:06 smithi122 ceph-mon[125440]: pgmap v887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:25:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:07.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:25:07.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:25:07.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:25:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:08 smithi136 ceph-mon[125702]: pgmap v888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:25:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:08 smithi057 ceph-mon[92072]: pgmap v888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:25:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:08 smithi122 ceph-mon[125440]: pgmap v888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:25:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:10 smithi136 ceph-mon[125702]: pgmap v889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:25:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:10 smithi057 ceph-mon[92072]: pgmap v889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:25:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:10 smithi122 ceph-mon[125440]: pgmap v889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:25:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:11 smithi136 ceph-mon[125702]: osdmap e130: 12 total, 12 up, 12 in 2023-03-02T11:25:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:11 smithi057 ceph-mon[92072]: osdmap e130: 12 total, 12 up, 12 in 2023-03-02T11:25:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:11 smithi122 ceph-mon[125440]: osdmap e130: 12 total, 12 up, 12 in 2023-03-02T11:25:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:12 smithi136 ceph-mon[125702]: pgmap v891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:25:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:12 smithi057 ceph-mon[92072]: pgmap v891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:25:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:12 smithi122 ceph-mon[125440]: pgmap v891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:25:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:14 smithi136 ceph-mon[125702]: pgmap v892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:25:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:14 smithi136 ceph-mon[125702]: osdmap e131: 12 total, 12 up, 12 in 2023-03-02T11:25:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:14 smithi057 ceph-mon[92072]: pgmap v892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:25:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:14 smithi057 ceph-mon[92072]: osdmap e131: 12 total, 12 up, 12 in 2023-03-02T11:25:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:14 smithi122 ceph-mon[125440]: pgmap v892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:25:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:14 smithi122 ceph-mon[125440]: osdmap e131: 12 total, 12 up, 12 in 2023-03-02T11:25:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:16 smithi136 ceph-mon[125702]: pgmap v894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:25:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:16 smithi057 ceph-mon[92072]: pgmap v894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:25:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:16 smithi122 ceph-mon[125440]: pgmap v894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:25:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:18 smithi136 ceph-mon[125702]: pgmap v895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:25:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:18 smithi057 ceph-mon[92072]: pgmap v895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:25:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:18 smithi122 ceph-mon[125440]: pgmap v895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:25:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:20.048+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:25:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:20.049+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:25:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:20.049+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:25:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:20.049+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:25:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:20.049+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:25:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:20 smithi057 ceph-mon[92072]: pgmap v896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T11:25:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:20 smithi122 ceph-mon[125440]: pgmap v896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T11:25:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:20 smithi136 ceph-mon[125702]: pgmap v896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T11:25:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:22 smithi057 ceph-mon[92072]: pgmap v897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:25:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:22 smithi122 ceph-mon[125440]: pgmap v897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:25:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:22 smithi136 ceph-mon[125702]: pgmap v897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:25:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:24 smithi057 ceph-mon[92072]: pgmap v898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:25:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:24 smithi122 ceph-mon[125440]: pgmap v898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:25:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:24 smithi136 ceph-mon[125702]: pgmap v898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:25:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:26 smithi057 ceph-mon[92072]: pgmap v899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:25:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:26 smithi122 ceph-mon[125440]: pgmap v899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:25:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:26 smithi136 ceph-mon[125702]: pgmap v899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:25:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:28 smithi057 ceph-mon[92072]: pgmap v900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:25:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:28 smithi122 ceph-mon[125440]: pgmap v900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:25:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:28 smithi136 ceph-mon[125702]: pgmap v900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:25:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:30 smithi057 ceph-mon[92072]: pgmap v901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:30 smithi122 ceph-mon[125440]: pgmap v901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:30 smithi136 ceph-mon[125702]: pgmap v901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:32 smithi057 ceph-mon[92072]: pgmap v902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:32 smithi122 ceph-mon[125440]: pgmap v902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:32 smithi136 ceph-mon[125702]: pgmap v902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:34 smithi057 ceph-mon[92072]: pgmap v903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:34 smithi122 ceph-mon[125440]: pgmap v903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:34 smithi136 ceph-mon[125702]: pgmap v903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:35.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:35.061+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:35.061+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:35.061+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:35.061+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:25:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:36 smithi057 ceph-mon[92072]: pgmap v904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:36 smithi122 ceph-mon[125440]: pgmap v904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:36 smithi136 ceph-mon[125702]: pgmap v904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:38 smithi057 ceph-mon[92072]: pgmap v905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:38 smithi122 ceph-mon[125440]: pgmap v905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:38 smithi136 ceph-mon[125702]: pgmap v905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:40 smithi057 ceph-mon[92072]: pgmap v906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:40 smithi122 ceph-mon[125440]: pgmap v906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:40 smithi136 ceph-mon[125702]: pgmap v906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:42 smithi057 ceph-mon[92072]: pgmap v907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:42 smithi122 ceph-mon[125440]: pgmap v907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:42 smithi136 ceph-mon[125702]: pgmap v907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:44 smithi057 ceph-mon[92072]: pgmap v908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:44 smithi122 ceph-mon[125440]: pgmap v908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:44 smithi136 ceph-mon[125702]: pgmap v908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:46 smithi057 ceph-mon[92072]: pgmap v909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:46 smithi122 ceph-mon[125440]: pgmap v909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:46 smithi136 ceph-mon[125702]: pgmap v909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:48 smithi122 ceph-mon[125440]: pgmap v910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:48 smithi136 ceph-mon[125702]: pgmap v910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:48 smithi057 ceph-mon[92072]: pgmap v910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:50.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:25:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:50.077+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:25:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:50.077+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:25:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:50.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:25:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:25:50.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:25:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:50 smithi122 ceph-mon[125440]: pgmap v911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:50 smithi136 ceph-mon[125702]: pgmap v911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:50 smithi057 ceph-mon[92072]: pgmap v911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:52 smithi122 ceph-mon[125440]: pgmap v912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:52 smithi136 ceph-mon[125702]: pgmap v912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:52 smithi057 ceph-mon[92072]: pgmap v912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:54 smithi122 ceph-mon[125440]: pgmap v913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:54 smithi136 ceph-mon[125702]: pgmap v913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:54 smithi057 ceph-mon[92072]: pgmap v913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:56 smithi122 ceph-mon[125440]: pgmap v914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:56 smithi136 ceph-mon[125702]: pgmap v914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:56 smithi057 ceph-mon[92072]: pgmap v914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:25:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:25:58 smithi136 ceph-mon[125702]: pgmap v915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:25:58 smithi057 ceph-mon[92072]: pgmap v915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:25:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:25:58 smithi122 ceph-mon[125440]: pgmap v915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:00 smithi136 ceph-mon[125702]: pgmap v916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:00 smithi057 ceph-mon[92072]: pgmap v916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:00 smithi122 ceph-mon[125440]: pgmap v916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:02 smithi136 ceph-mon[125702]: pgmap v917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:02 smithi057 ceph-mon[92072]: pgmap v917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:02 smithi122 ceph-mon[125440]: pgmap v917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:04 smithi136 ceph-mon[125702]: pgmap v918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:26:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:04 smithi057 ceph-mon[92072]: pgmap v918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:26:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:04 smithi122 ceph-mon[125440]: pgmap v918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:26:05.088 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:05.086+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:26:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:05.087+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:26:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:05.087+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:26:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:05.087+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:26:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:05.087+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:26:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:06 smithi136 ceph-mon[125702]: pgmap v919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:26:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:26:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:06 smithi057 ceph-mon[92072]: pgmap v919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:26:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:26:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:06 smithi122 ceph-mon[125440]: pgmap v919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:26:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:26:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:26:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:26:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:26:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:26:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:26:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:26:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:26:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:26:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:26:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:08 smithi136 ceph-mon[125702]: pgmap v920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:26:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:08.591+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T11:26:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:08.592+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 18 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T11:26:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:08.603+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:26:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:08.603+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 17 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:26:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:08 smithi057 ceph-mon[92072]: pgmap v920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:26:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:08 smithi122 ceph-mon[125440]: pgmap v920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:26:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:10 smithi136 ceph-mon[125702]: pgmap v921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:26:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:10 smithi057 ceph-mon[92072]: pgmap v921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:26:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:10 smithi122 ceph-mon[125440]: pgmap v921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:26:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:11 smithi136 ceph-mon[125702]: osdmap e132: 12 total, 12 up, 12 in 2023-03-02T11:26:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:11 smithi057 ceph-mon[92072]: osdmap e132: 12 total, 12 up, 12 in 2023-03-02T11:26:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:11 smithi122 ceph-mon[125440]: osdmap e132: 12 total, 12 up, 12 in 2023-03-02T11:26:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:12 smithi136 ceph-mon[125702]: pgmap v923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:26:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:12 smithi057 ceph-mon[92072]: pgmap v923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:26:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:12 smithi122 ceph-mon[125440]: pgmap v923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:26:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:14 smithi136 ceph-mon[125702]: pgmap v924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:26:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:14 smithi136 ceph-mon[125702]: osdmap e133: 12 total, 12 up, 12 in 2023-03-02T11:26:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:14 smithi057 ceph-mon[92072]: pgmap v924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:26:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:14 smithi057 ceph-mon[92072]: osdmap e133: 12 total, 12 up, 12 in 2023-03-02T11:26:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:14 smithi122 ceph-mon[125440]: pgmap v924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:26:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:14 smithi122 ceph-mon[125440]: osdmap e133: 12 total, 12 up, 12 in 2023-03-02T11:26:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:16 smithi136 ceph-mon[125702]: pgmap v926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:26:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:16 smithi057 ceph-mon[92072]: pgmap v926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:26:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:16 smithi122 ceph-mon[125440]: pgmap v926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:26:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:18 smithi136 ceph-mon[125702]: pgmap v927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:26:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:18 smithi057 ceph-mon[92072]: pgmap v927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:26:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:18 smithi122 ceph-mon[125440]: pgmap v927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:26:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:20.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:26:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:20.100+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:26:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:20.100+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:26:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:20.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:26:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:20.101+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:26:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:20 smithi136 ceph-mon[125702]: pgmap v928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:26:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:20 smithi057 ceph-mon[92072]: pgmap v928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:26:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:20 smithi122 ceph-mon[125440]: pgmap v928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:26:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:22 smithi136 ceph-mon[125702]: pgmap v929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:26:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:22 smithi057 ceph-mon[92072]: pgmap v929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:26:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:22 smithi122 ceph-mon[125440]: pgmap v929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:26:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:24 smithi136 ceph-mon[125702]: pgmap v930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:26:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:24 smithi057 ceph-mon[92072]: pgmap v930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:26:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:24 smithi122 ceph-mon[125440]: pgmap v930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:26:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:26 smithi136 ceph-mon[125702]: pgmap v931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:26:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:26 smithi057 ceph-mon[92072]: pgmap v931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:26:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:26 smithi122 ceph-mon[125440]: pgmap v931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:26:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:28 smithi136 ceph-mon[125702]: pgmap v932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:26:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:28 smithi057 ceph-mon[92072]: pgmap v932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:26:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:28 smithi122 ceph-mon[125440]: pgmap v932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:26:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:30 smithi136 ceph-mon[125702]: pgmap v933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:30 smithi057 ceph-mon[92072]: pgmap v933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:30 smithi122 ceph-mon[125440]: pgmap v933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:32 smithi136 ceph-mon[125702]: pgmap v934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:32 smithi057 ceph-mon[92072]: pgmap v934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:32 smithi122 ceph-mon[125440]: pgmap v934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:34 smithi136 ceph-mon[125702]: pgmap v935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:34 smithi057 ceph-mon[92072]: pgmap v935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:34 smithi122 ceph-mon[125440]: pgmap v935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:35.111+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:26:35.113 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:35.112+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:26:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:35.112+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:26:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:35.112+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:26:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:35.112+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:26:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:36 smithi136 ceph-mon[125702]: pgmap v936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:36 smithi057 ceph-mon[92072]: pgmap v936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:36 smithi122 ceph-mon[125440]: pgmap v936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:38 smithi136 ceph-mon[125702]: pgmap v937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:38 smithi057 ceph-mon[92072]: pgmap v937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:38 smithi122 ceph-mon[125440]: pgmap v937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:40 smithi136 ceph-mon[125702]: pgmap v938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:40 smithi057 ceph-mon[92072]: pgmap v938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:40 smithi122 ceph-mon[125440]: pgmap v938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:42 smithi136 ceph-mon[125702]: pgmap v939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:42 smithi057 ceph-mon[92072]: pgmap v939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:42 smithi122 ceph-mon[125440]: pgmap v939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:44 smithi136 ceph-mon[125702]: pgmap v940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:44 smithi057 ceph-mon[92072]: pgmap v940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:44 smithi122 ceph-mon[125440]: pgmap v940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:46 smithi136 ceph-mon[125702]: pgmap v941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:46 smithi057 ceph-mon[92072]: pgmap v941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:46 smithi122 ceph-mon[125440]: pgmap v941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:48 smithi136 ceph-mon[125702]: pgmap v942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:48 smithi057 ceph-mon[92072]: pgmap v942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:48 smithi122 ceph-mon[125440]: pgmap v942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:50.124+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:26:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:50.124+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:26:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:50.124+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:26:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:50.124+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:26:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:26:50.124+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:26:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:50 smithi136 ceph-mon[125702]: pgmap v943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:50 smithi057 ceph-mon[92072]: pgmap v943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:50 smithi122 ceph-mon[125440]: pgmap v943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:52 smithi057 ceph-mon[92072]: pgmap v944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:52 smithi122 ceph-mon[125440]: pgmap v944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:52 smithi136 ceph-mon[125702]: pgmap v944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:54 smithi057 ceph-mon[92072]: pgmap v945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:54 smithi122 ceph-mon[125440]: pgmap v945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:54 smithi136 ceph-mon[125702]: pgmap v945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:56 smithi057 ceph-mon[92072]: pgmap v946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:56 smithi122 ceph-mon[125440]: pgmap v946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:56 smithi136 ceph-mon[125702]: pgmap v946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:26:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:26:58 smithi057 ceph-mon[92072]: pgmap v947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:26:58 smithi122 ceph-mon[125440]: pgmap v947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:26:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:26:58 smithi136 ceph-mon[125702]: pgmap v947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:00 smithi057 ceph-mon[92072]: pgmap v948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:00 smithi122 ceph-mon[125440]: pgmap v948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:00 smithi136 ceph-mon[125702]: pgmap v948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:02 smithi057 ceph-mon[92072]: pgmap v949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:02.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:02 smithi122 ceph-mon[125440]: pgmap v949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:02 smithi136 ceph-mon[125702]: pgmap v949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:04 smithi057 ceph-mon[92072]: pgmap v950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:27:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:04 smithi122 ceph-mon[125440]: pgmap v950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:27:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:04 smithi136 ceph-mon[125702]: pgmap v950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:27:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:05.130+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:27:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:05.130+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:27:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:05.130+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:27:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:05.130+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:27:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:05.130+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:27:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:06 smithi057 ceph-mon[92072]: pgmap v951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:27:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:06 smithi122 ceph-mon[125440]: pgmap v951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:27:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:06 smithi136 ceph-mon[125702]: pgmap v951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:27:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:27:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:27:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:27:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:08 smithi057 ceph-mon[92072]: pgmap v952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:27:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:08 smithi122 ceph-mon[125440]: pgmap v952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:27:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:08 smithi136 ceph-mon[125702]: pgmap v952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:27:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:27:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:27:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:10 smithi136 ceph-mon[125702]: pgmap v953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:27:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:27:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:27:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:10 smithi057 ceph-mon[92072]: pgmap v953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:27:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:27:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:27:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:27:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:10 smithi122 ceph-mon[125440]: pgmap v953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:27:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:12 smithi136 ceph-mon[125702]: osdmap e134: 12 total, 12 up, 12 in 2023-03-02T11:27:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:12 smithi136 ceph-mon[125702]: pgmap v955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:27:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:12 smithi057 ceph-mon[92072]: osdmap e134: 12 total, 12 up, 12 in 2023-03-02T11:27:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:12 smithi057 ceph-mon[92072]: pgmap v955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:27:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:12 smithi122 ceph-mon[125440]: osdmap e134: 12 total, 12 up, 12 in 2023-03-02T11:27:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:12 smithi122 ceph-mon[125440]: pgmap v955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:27:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:14 smithi057 ceph-mon[92072]: pgmap v956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:14 smithi122 ceph-mon[125440]: pgmap v956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:14 smithi136 ceph-mon[125702]: pgmap v956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:16 smithi057 ceph-mon[92072]: pgmap v957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:16 smithi122 ceph-mon[125440]: pgmap v957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:16 smithi136 ceph-mon[125702]: pgmap v957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:18 smithi057 ceph-mon[92072]: pgmap v958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:18 smithi122 ceph-mon[125440]: pgmap v958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:18 smithi136 ceph-mon[125702]: pgmap v958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:20.140+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:27:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:20.141+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:27:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:20.141+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:27:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:20.141+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:27:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:20.141+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:27:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:20 smithi057 ceph-mon[92072]: pgmap v959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:20 smithi057 ceph-mon[92072]: osdmap e135: 12 total, 12 up, 12 in 2023-03-02T11:27:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:20 smithi122 ceph-mon[125440]: pgmap v959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:20 smithi122 ceph-mon[125440]: osdmap e135: 12 total, 12 up, 12 in 2023-03-02T11:27:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:20 smithi136 ceph-mon[125702]: pgmap v959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:20 smithi136 ceph-mon[125702]: osdmap e135: 12 total, 12 up, 12 in 2023-03-02T11:27:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:22 smithi057 ceph-mon[92072]: pgmap v961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:22 smithi122 ceph-mon[125440]: pgmap v961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:22 smithi136 ceph-mon[125702]: pgmap v961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:27:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:24 smithi057 ceph-mon[92072]: pgmap v962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:27:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:24 smithi122 ceph-mon[125440]: pgmap v962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:27:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:24 smithi136 ceph-mon[125702]: pgmap v962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:27:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:26 smithi057 ceph-mon[92072]: pgmap v963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:27:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:26 smithi122 ceph-mon[125440]: pgmap v963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:27:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:26 smithi136 ceph-mon[125702]: pgmap v963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:27:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:28 smithi057 ceph-mon[92072]: pgmap v964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:27:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:28 smithi122 ceph-mon[125440]: pgmap v964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:27:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:28 smithi136 ceph-mon[125702]: pgmap v964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:27:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:30 smithi122 ceph-mon[125440]: pgmap v965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:27:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:30 smithi136 ceph-mon[125702]: pgmap v965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:27:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:30 smithi057 ceph-mon[92072]: pgmap v965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:27:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:32 smithi122 ceph-mon[125440]: pgmap v966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:32 smithi136 ceph-mon[125702]: pgmap v966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:32 smithi057 ceph-mon[92072]: pgmap v966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:34 smithi122 ceph-mon[125440]: pgmap v967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:34 smithi136 ceph-mon[125702]: pgmap v967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:34 smithi057 ceph-mon[92072]: pgmap v967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:35.156+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:27:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:35.156+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:27:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:35.156+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:27:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:35.156+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:27:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:35.156+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:27:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:36 smithi122 ceph-mon[125440]: pgmap v968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:36 smithi136 ceph-mon[125702]: pgmap v968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:36 smithi057 ceph-mon[92072]: pgmap v968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:38 smithi136 ceph-mon[125702]: pgmap v969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:38 smithi057 ceph-mon[92072]: pgmap v969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:38 smithi122 ceph-mon[125440]: pgmap v969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:40 smithi136 ceph-mon[125702]: pgmap v970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:40 smithi057 ceph-mon[92072]: pgmap v970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:40 smithi122 ceph-mon[125440]: pgmap v970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:42 smithi136 ceph-mon[125702]: pgmap v971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:42 smithi057 ceph-mon[92072]: pgmap v971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:42 smithi122 ceph-mon[125440]: pgmap v971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:44 smithi136 ceph-mon[125702]: pgmap v972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:44 smithi057 ceph-mon[92072]: pgmap v972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:44 smithi122 ceph-mon[125440]: pgmap v972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:46 smithi136 ceph-mon[125702]: pgmap v973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:46 smithi057 ceph-mon[92072]: pgmap v973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:46 smithi122 ceph-mon[125440]: pgmap v973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:48 smithi136 ceph-mon[125702]: pgmap v974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:48 smithi057 ceph-mon[92072]: pgmap v974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:48 smithi122 ceph-mon[125440]: pgmap v974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:50.165+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:27:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:50.165+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:27:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:50.165+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:27:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:50.165+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:27:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:27:50.165+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:27:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:50 smithi136 ceph-mon[125702]: pgmap v975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:50 smithi057 ceph-mon[92072]: pgmap v975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:50 smithi122 ceph-mon[125440]: pgmap v975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:52 smithi136 ceph-mon[125702]: pgmap v976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:52 smithi057 ceph-mon[92072]: pgmap v976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:52 smithi122 ceph-mon[125440]: pgmap v976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:54 smithi136 ceph-mon[125702]: pgmap v977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:54 smithi057 ceph-mon[92072]: pgmap v977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:54 smithi122 ceph-mon[125440]: pgmap v977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:56 smithi136 ceph-mon[125702]: pgmap v978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:56 smithi057 ceph-mon[92072]: pgmap v978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:56 smithi122 ceph-mon[125440]: pgmap v978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:27:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:27:58 smithi136 ceph-mon[125702]: pgmap v979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:27:58 smithi057 ceph-mon[92072]: pgmap v979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:27:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:27:58 smithi122 ceph-mon[125440]: pgmap v979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:00 smithi136 ceph-mon[125702]: pgmap v980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:00 smithi057 ceph-mon[92072]: pgmap v980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:00 smithi122 ceph-mon[125440]: pgmap v980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:02 smithi136 ceph-mon[125702]: pgmap v981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:02 smithi057 ceph-mon[92072]: pgmap v981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:02 smithi122 ceph-mon[125440]: pgmap v981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:04 smithi136 ceph-mon[125702]: pgmap v982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:28:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:04 smithi057 ceph-mon[92072]: pgmap v982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:28:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:04 smithi122 ceph-mon[125440]: pgmap v982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:28:05.178 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:05.176+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:28:05.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:05.176+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:28:05.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:05.177+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:28:05.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:05.177+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:28:05.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:05.177+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:28:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:06 smithi136 ceph-mon[125702]: pgmap v983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:28:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:06 smithi057 ceph-mon[92072]: pgmap v983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:28:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:06 smithi122 ceph-mon[125440]: pgmap v983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:28:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:08 smithi136 ceph-mon[125702]: pgmap v984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:28:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:08 smithi057 ceph-mon[92072]: pgmap v984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:28:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:08 smithi122 ceph-mon[125440]: pgmap v984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:28:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:10 smithi136 ceph-mon[125702]: pgmap v985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:28:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:28:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:10 smithi057 ceph-mon[92072]: pgmap v985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:28:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:28:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:10 smithi122 ceph-mon[125440]: pgmap v985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:28:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:28:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:11 smithi136 ceph-mon[125702]: osdmap e136: 12 total, 12 up, 12 in 2023-03-02T11:28:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:11 smithi057 ceph-mon[92072]: osdmap e136: 12 total, 12 up, 12 in 2023-03-02T11:28:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:11 smithi122 ceph-mon[125440]: osdmap e136: 12 total, 12 up, 12 in 2023-03-02T11:28:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:12 smithi136 ceph-mon[125702]: pgmap v987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:28:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:12 smithi057 ceph-mon[92072]: pgmap v987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:28:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:12 smithi122 ceph-mon[125440]: pgmap v987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:28:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: pgmap v988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:28:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:28:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:28:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:14.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: osdmap e137: 12 total, 12 up, 12 in 2023-03-02T11:28:14.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:14.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:14.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:14.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:14.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:14.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:14.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:14.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: pgmap v988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:28:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:28:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:28:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: osdmap e137: 12 total, 12 up, 12 in 2023-03-02T11:28:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: pgmap v988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:28:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:28:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:28:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: osdmap e137: 12 total, 12 up, 12 in 2023-03-02T11:28:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:28:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:28:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:15.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:28:15.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:28:15.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:28:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:28:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:28:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:28:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:28:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:28:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:28:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:28:16.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:28:16.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:28:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:16 smithi122 ceph-mon[125440]: pgmap v990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:28:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:16 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:28:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:16 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:28:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:16 smithi136 ceph-mon[125702]: pgmap v990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:28:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:16 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:28:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:16 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:28:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:16 smithi057 ceph-mon[92072]: pgmap v990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:28:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:16 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:28:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:16 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:28:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:18 smithi122 ceph-mon[125440]: pgmap v991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:28:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:18 smithi136 ceph-mon[125702]: pgmap v991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:28:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:18 smithi057 ceph-mon[92072]: pgmap v991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:28:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:20.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:28:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:20.191+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:28:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:20.191+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:28:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:20.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:28:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:20.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:28:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:20 smithi122 ceph-mon[125440]: pgmap v992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:28:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:20 smithi136 ceph-mon[125702]: pgmap v992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:28:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:20 smithi057 ceph-mon[92072]: pgmap v992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:28:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:22 smithi122 ceph-mon[125440]: pgmap v993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:28:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:22 smithi136 ceph-mon[125702]: pgmap v993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:28:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:22 smithi057 ceph-mon[92072]: pgmap v993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:28:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:24 smithi136 ceph-mon[125702]: pgmap v994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:28:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:24 smithi057 ceph-mon[92072]: pgmap v994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:28:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:24 smithi122 ceph-mon[125440]: pgmap v994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:28:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:26 smithi136 ceph-mon[125702]: pgmap v995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:28:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:26 smithi057 ceph-mon[92072]: pgmap v995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:28:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:26 smithi122 ceph-mon[125440]: pgmap v995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:28:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:28 smithi136 ceph-mon[125702]: pgmap v996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:28:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:28 smithi057 ceph-mon[92072]: pgmap v996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:28:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:28 smithi122 ceph-mon[125440]: pgmap v996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:28:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:30 smithi136 ceph-mon[125702]: pgmap v997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:30 smithi057 ceph-mon[92072]: pgmap v997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:30 smithi122 ceph-mon[125440]: pgmap v997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:32 smithi136 ceph-mon[125702]: pgmap v998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:32 smithi057 ceph-mon[92072]: pgmap v998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:32 smithi122 ceph-mon[125440]: pgmap v998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:34 smithi136 ceph-mon[125702]: pgmap v999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:34 smithi057 ceph-mon[92072]: pgmap v999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:34 smithi122 ceph-mon[125440]: pgmap v999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:35.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:28:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:35.202+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:28:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:35.202+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:28:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:35.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:28:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:35.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:28:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:36 smithi136 ceph-mon[125702]: pgmap v1000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:36 smithi057 ceph-mon[92072]: pgmap v1000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:36 smithi122 ceph-mon[125440]: pgmap v1000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:38 smithi136 ceph-mon[125702]: pgmap v1001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:38 smithi057 ceph-mon[92072]: pgmap v1001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:38 smithi122 ceph-mon[125440]: pgmap v1001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:40 smithi136 ceph-mon[125702]: pgmap v1002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:40 smithi057 ceph-mon[92072]: pgmap v1002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:40 smithi122 ceph-mon[125440]: pgmap v1002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:42 smithi136 ceph-mon[125702]: pgmap v1003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:42 smithi057 ceph-mon[92072]: pgmap v1003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:42 smithi122 ceph-mon[125440]: pgmap v1003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:44 smithi136 ceph-mon[125702]: pgmap v1004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:44 smithi057 ceph-mon[92072]: pgmap v1004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:44 smithi122 ceph-mon[125440]: pgmap v1004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:46 smithi136 ceph-mon[125702]: pgmap v1005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:46 smithi057 ceph-mon[92072]: pgmap v1005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:46 smithi122 ceph-mon[125440]: pgmap v1005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:48 smithi136 ceph-mon[125702]: pgmap v1006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:48 smithi057 ceph-mon[92072]: pgmap v1006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:48 smithi122 ceph-mon[125440]: pgmap v1006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:50.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:28:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:50.218+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:28:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:50.218+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:28:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:50.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:28:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:28:50.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:28:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:50 smithi136 ceph-mon[125702]: pgmap v1007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:50 smithi057 ceph-mon[92072]: pgmap v1007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:50 smithi122 ceph-mon[125440]: pgmap v1007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:52 smithi136 ceph-mon[125702]: pgmap v1008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:52 smithi057 ceph-mon[92072]: pgmap v1008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:52 smithi122 ceph-mon[125440]: pgmap v1008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:28:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:54 smithi136 ceph-mon[125702]: pgmap v1009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:54 smithi057 ceph-mon[92072]: pgmap v1009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:54 smithi122 ceph-mon[125440]: pgmap v1009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:56 smithi136 ceph-mon[125702]: pgmap v1010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:28:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:56 smithi057 ceph-mon[92072]: pgmap v1010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:28:57.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:56 smithi122 ceph-mon[125440]: pgmap v1010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:28:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:28:58 smithi136 ceph-mon[125702]: pgmap v1011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:28:58 smithi057 ceph-mon[92072]: pgmap v1011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:28:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:28:58 smithi122 ceph-mon[125440]: pgmap v1011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:00 smithi136 ceph-mon[125702]: pgmap v1012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:29:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:00 smithi057 ceph-mon[92072]: pgmap v1012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:29:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:00 smithi122 ceph-mon[125440]: pgmap v1012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:29:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:02 smithi136 ceph-mon[125702]: pgmap v1013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:29:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:02 smithi057 ceph-mon[92072]: pgmap v1013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:29:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:02 smithi122 ceph-mon[125440]: pgmap v1013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:29:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:04 smithi136 ceph-mon[125702]: pgmap v1014: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:29:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:04 smithi057 ceph-mon[92072]: pgmap v1014: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:29:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:04 smithi122 ceph-mon[125440]: pgmap v1014: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:29:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:05.232+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:05.232+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:05.232+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:05.232+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:29:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:05.232+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:29:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:06 smithi136 ceph-mon[125702]: pgmap v1015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:29:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:06 smithi057 ceph-mon[92072]: pgmap v1015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:29:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:06 smithi122 ceph-mon[125440]: pgmap v1015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:29:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.370+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a50b0 msgr2=0x7f58680a7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T11:29:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.370+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a50b0 msgr2=0x7f58680a7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T11:29:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.370+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a50b0 0x7f58680a7490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5870029040 tx=0x7f5870040000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:29:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.370+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a50b0 0x7f58680a7490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5870029040 tx=0x7f5870040000 comp rx=0 tx=0).stop 2023-03-02T11:29:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.370+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a50b0 msgr2=0x7f58680a7490 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T11:29:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.370+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a50b0 msgr2=0x7f58680a7490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T11:29:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.370+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a50b0 0x7f58680a7490 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:29:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.370+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:29:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.370+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:29:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.371+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a79d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f587808a0d0 tx=0x7f5870044000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:29:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.616+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T11:29:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.616+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 19 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T11:29:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.624+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:29:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:08.624+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 18 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:29:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:08 smithi136 ceph-mon[125702]: pgmap v1016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:29:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:08 smithi057 ceph-mon[92072]: pgmap v1016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:29:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:08 smithi122 ceph-mon[125440]: pgmap v1016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:29:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:10 smithi136 ceph-mon[125702]: pgmap v1017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:29:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:10 smithi057 ceph-mon[92072]: pgmap v1017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:29:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:10 smithi122 ceph-mon[125440]: pgmap v1017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:29:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:11 smithi136 ceph-mon[125702]: osdmap e138: 12 total, 12 up, 12 in 2023-03-02T11:29:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:11 smithi057 ceph-mon[92072]: osdmap e138: 12 total, 12 up, 12 in 2023-03-02T11:29:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:11 smithi122 ceph-mon[125440]: osdmap e138: 12 total, 12 up, 12 in 2023-03-02T11:29:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:12 smithi136 ceph-mon[125702]: pgmap v1019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:29:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:12 smithi057 ceph-mon[92072]: pgmap v1019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:29:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:12 smithi122 ceph-mon[125440]: pgmap v1019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:29:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:14 smithi136 ceph-mon[125702]: pgmap v1020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:29:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:14 smithi136 ceph-mon[125702]: osdmap e139: 12 total, 12 up, 12 in 2023-03-02T11:29:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:14 smithi057 ceph-mon[92072]: pgmap v1020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:29:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:14 smithi057 ceph-mon[92072]: osdmap e139: 12 total, 12 up, 12 in 2023-03-02T11:29:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:14 smithi122 ceph-mon[125440]: pgmap v1020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:29:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:14 smithi122 ceph-mon[125440]: osdmap e139: 12 total, 12 up, 12 in 2023-03-02T11:29:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:29:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:29:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:29:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:16 smithi136 ceph-mon[125702]: pgmap v1022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:29:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:29:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:29:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:29:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:16 smithi057 ceph-mon[92072]: pgmap v1022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:29:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:29:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:29:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:29:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:16 smithi122 ceph-mon[125440]: pgmap v1022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:29:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:29:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:29:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:29:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:18 smithi136 ceph-mon[125702]: pgmap v1023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:29:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:18 smithi057 ceph-mon[92072]: pgmap v1023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:29:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:18 smithi122 ceph-mon[125440]: pgmap v1023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:29:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:20.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:29:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:20.235+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:29:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:20.235+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:29:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:20.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:29:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:20.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:29:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:20 smithi057 ceph-mon[92072]: pgmap v1024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T11:29:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:20 smithi122 ceph-mon[125440]: pgmap v1024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T11:29:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:20 smithi136 ceph-mon[125702]: pgmap v1024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T11:29:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:22 smithi057 ceph-mon[92072]: pgmap v1025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:29:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:22 smithi122 ceph-mon[125440]: pgmap v1025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:29:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:22 smithi136 ceph-mon[125702]: pgmap v1025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:29:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:24 smithi057 ceph-mon[92072]: pgmap v1026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:29:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:24 smithi122 ceph-mon[125440]: pgmap v1026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:29:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:24 smithi136 ceph-mon[125702]: pgmap v1026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:29:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:25 smithi057 ceph-mon[92072]: pgmap v1027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:29:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:25 smithi122 ceph-mon[125440]: pgmap v1027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:29:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:25 smithi136 ceph-mon[125702]: pgmap v1027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:29:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:28 smithi136 ceph-mon[125702]: pgmap v1028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:29:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:28 smithi057 ceph-mon[92072]: pgmap v1028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:29:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:28 smithi122 ceph-mon[125440]: pgmap v1028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:29:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:30 smithi136 ceph-mon[125702]: pgmap v1029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:30 smithi057 ceph-mon[92072]: pgmap v1029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:30 smithi122 ceph-mon[125440]: pgmap v1029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:32 smithi136 ceph-mon[125702]: pgmap v1030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:32 smithi057 ceph-mon[92072]: pgmap v1030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:32 smithi122 ceph-mon[125440]: pgmap v1030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:34 smithi136 ceph-mon[125702]: pgmap v1031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:34 smithi057 ceph-mon[92072]: pgmap v1031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:34 smithi122 ceph-mon[125440]: pgmap v1031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:35.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:29:35.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:35.251+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:29:35.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:35.251+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:29:35.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:35.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:29:35.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:35.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:29:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:36 smithi136 ceph-mon[125702]: pgmap v1032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:36 smithi057 ceph-mon[92072]: pgmap v1032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:36 smithi122 ceph-mon[125440]: pgmap v1032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:38 smithi136 ceph-mon[125702]: pgmap v1033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:38 smithi057 ceph-mon[92072]: pgmap v1033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:38 smithi122 ceph-mon[125440]: pgmap v1033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:40 smithi136 ceph-mon[125702]: pgmap v1034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:40 smithi057 ceph-mon[92072]: pgmap v1034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:40 smithi122 ceph-mon[125440]: pgmap v1034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:42 smithi136 ceph-mon[125702]: pgmap v1035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:42 smithi057 ceph-mon[92072]: pgmap v1035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:42 smithi122 ceph-mon[125440]: pgmap v1035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:44 smithi136 ceph-mon[125702]: pgmap v1036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:44 smithi057 ceph-mon[92072]: pgmap v1036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:44 smithi122 ceph-mon[125440]: pgmap v1036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:46 smithi136 ceph-mon[125702]: pgmap v1037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:46 smithi057 ceph-mon[92072]: pgmap v1037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:46 smithi122 ceph-mon[125440]: pgmap v1037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:48 smithi136 ceph-mon[125702]: pgmap v1038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:48 smithi057 ceph-mon[92072]: pgmap v1038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:48 smithi122 ceph-mon[125440]: pgmap v1038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:50.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:29:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:50.266+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:29:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:50.266+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:29:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:50.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:29:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:29:50.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:29:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:50 smithi136 ceph-mon[125702]: pgmap v1039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:50 smithi057 ceph-mon[92072]: pgmap v1039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:50 smithi122 ceph-mon[125440]: pgmap v1039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:52 smithi136 ceph-mon[125702]: pgmap v1040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:52 smithi057 ceph-mon[92072]: pgmap v1040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:52 smithi122 ceph-mon[125440]: pgmap v1040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:54 smithi136 ceph-mon[125702]: pgmap v1041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:54 smithi057 ceph-mon[92072]: pgmap v1041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:54 smithi122 ceph-mon[125440]: pgmap v1041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:56 smithi136 ceph-mon[125702]: pgmap v1042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:56 smithi057 ceph-mon[92072]: pgmap v1042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:56 smithi122 ceph-mon[125440]: pgmap v1042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:29:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:29:58 smithi136 ceph-mon[125702]: pgmap v1043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:29:58 smithi057 ceph-mon[92072]: pgmap v1043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:29:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:29:58 smithi122 ceph-mon[125440]: pgmap v1043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:00 smithi136 ceph-mon[125702]: pgmap v1044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T11:30:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:00 smithi057 ceph-mon[92072]: pgmap v1044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T11:30:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:00 smithi122 ceph-mon[125440]: pgmap v1044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T11:30:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:02 smithi136 ceph-mon[125702]: pgmap v1045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:02 smithi057 ceph-mon[92072]: pgmap v1045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:02 smithi122 ceph-mon[125440]: pgmap v1045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:04 smithi136 ceph-mon[125702]: pgmap v1046: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:30:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:04 smithi057 ceph-mon[92072]: pgmap v1046: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:30:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:04 smithi122 ceph-mon[125440]: pgmap v1046: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:30:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:05.281+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:30:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:05.281+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:30:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:05.281+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:30:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:05.281+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:30:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:05.281+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:30:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:06 smithi136 ceph-mon[125702]: pgmap v1047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:30:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:06 smithi057 ceph-mon[92072]: pgmap v1047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:30:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:06 smithi122 ceph-mon[125440]: pgmap v1047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:30:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:08 smithi136 ceph-mon[125702]: pgmap v1048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:30:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:08 smithi057 ceph-mon[92072]: pgmap v1048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:30:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:08 smithi122 ceph-mon[125440]: pgmap v1048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:30:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:10 smithi136 ceph-mon[125702]: pgmap v1049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:30:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:10 smithi057 ceph-mon[92072]: pgmap v1049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:30:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:10 smithi122 ceph-mon[125440]: pgmap v1049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:30:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:11 smithi136 ceph-mon[125702]: osdmap e140: 12 total, 12 up, 12 in 2023-03-02T11:30:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:11 smithi057 ceph-mon[92072]: osdmap e140: 12 total, 12 up, 12 in 2023-03-02T11:30:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:11 smithi122 ceph-mon[125440]: osdmap e140: 12 total, 12 up, 12 in 2023-03-02T11:30:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:12 smithi057 ceph-mon[92072]: pgmap v1051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:30:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:12 smithi136 ceph-mon[125702]: pgmap v1051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:30:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:12 smithi122 ceph-mon[125440]: pgmap v1051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:30:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:14 smithi136 ceph-mon[125702]: pgmap v1052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:30:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:14 smithi136 ceph-mon[125702]: osdmap e141: 12 total, 12 up, 12 in 2023-03-02T11:30:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:14 smithi057 ceph-mon[92072]: pgmap v1052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:30:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:14 smithi057 ceph-mon[92072]: osdmap e141: 12 total, 12 up, 12 in 2023-03-02T11:30:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:14 smithi122 ceph-mon[125440]: pgmap v1052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:30:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:14 smithi122 ceph-mon[125440]: osdmap e141: 12 total, 12 up, 12 in 2023-03-02T11:30:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:16 smithi136 ceph-mon[125702]: pgmap v1054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:30:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:30:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:16 smithi057 ceph-mon[92072]: pgmap v1054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:30:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:30:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:16 smithi122 ceph-mon[125440]: pgmap v1054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:30:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:30:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:30:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:30:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:17 smithi057 ceph-mon[92072]: pgmap v1055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:30:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:30:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:30:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:30:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:30:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:30:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:17 smithi122 ceph-mon[125440]: pgmap v1055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:30:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:30:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:30:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:30:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:30:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:30:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:17 smithi136 ceph-mon[125702]: pgmap v1055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:30:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:30:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:30:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:30:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:20.296+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:30:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:20.296+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:30:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:20.296+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:30:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:20.296+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:30:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:20.296+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:30:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:20 smithi136 ceph-mon[125702]: pgmap v1056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:30:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:20 smithi057 ceph-mon[92072]: pgmap v1056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:30:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:20 smithi122 ceph-mon[125440]: pgmap v1056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:30:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:22 smithi136 ceph-mon[125702]: pgmap v1057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:30:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:22 smithi057 ceph-mon[92072]: pgmap v1057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:30:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:22 smithi122 ceph-mon[125440]: pgmap v1057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:30:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:24 smithi136 ceph-mon[125702]: pgmap v1058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:30:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:24 smithi057 ceph-mon[92072]: pgmap v1058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:30:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:24 smithi122 ceph-mon[125440]: pgmap v1058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:30:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:26 smithi136 ceph-mon[125702]: pgmap v1059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:30:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:26 smithi057 ceph-mon[92072]: pgmap v1059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:30:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:26 smithi122 ceph-mon[125440]: pgmap v1059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:30:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:28 smithi136 ceph-mon[125702]: pgmap v1060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:30:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:28 smithi057 ceph-mon[92072]: pgmap v1060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:30:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:28 smithi122 ceph-mon[125440]: pgmap v1060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:30:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:30 smithi136 ceph-mon[125702]: pgmap v1061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:30 smithi057 ceph-mon[92072]: pgmap v1061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:30 smithi122 ceph-mon[125440]: pgmap v1061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:32 smithi136 ceph-mon[125702]: pgmap v1062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:32 smithi057 ceph-mon[92072]: pgmap v1062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:32 smithi122 ceph-mon[125440]: pgmap v1062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:34 smithi136 ceph-mon[125702]: pgmap v1063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:34 smithi057 ceph-mon[92072]: pgmap v1063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:34 smithi122 ceph-mon[125440]: pgmap v1063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:35.303+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:30:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:35.303+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:30:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:35.303+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:30:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:35.303+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:30:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:35.303+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:30:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:36 smithi136 ceph-mon[125702]: pgmap v1064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:36 smithi057 ceph-mon[92072]: pgmap v1064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:36.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:36 smithi122 ceph-mon[125440]: pgmap v1064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:38 smithi136 ceph-mon[125702]: pgmap v1065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:38 smithi057 ceph-mon[92072]: pgmap v1065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:38 smithi122 ceph-mon[125440]: pgmap v1065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:40 smithi136 ceph-mon[125702]: pgmap v1066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:40 smithi057 ceph-mon[92072]: pgmap v1066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:40 smithi122 ceph-mon[125440]: pgmap v1066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:42 smithi136 ceph-mon[125702]: pgmap v1067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:42 smithi057 ceph-mon[92072]: pgmap v1067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:42 smithi122 ceph-mon[125440]: pgmap v1067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:44 smithi136 ceph-mon[125702]: pgmap v1068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:44 smithi057 ceph-mon[92072]: pgmap v1068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:44 smithi122 ceph-mon[125440]: pgmap v1068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:46 smithi136 ceph-mon[125702]: pgmap v1069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:46 smithi057 ceph-mon[92072]: pgmap v1069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:46 smithi122 ceph-mon[125440]: pgmap v1069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:48 smithi136 ceph-mon[125702]: pgmap v1070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:48 smithi057 ceph-mon[92072]: pgmap v1070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:48 smithi122 ceph-mon[125440]: pgmap v1070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:50.311+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:30:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:50.312+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:30:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:50.312+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:30:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:50.312+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:30:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:30:50.312+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:30:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:50 smithi136 ceph-mon[125702]: pgmap v1071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:50 smithi057 ceph-mon[92072]: pgmap v1071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:50 smithi122 ceph-mon[125440]: pgmap v1071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:52 smithi136 ceph-mon[125702]: pgmap v1072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:52 smithi057 ceph-mon[92072]: pgmap v1072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:52 smithi122 ceph-mon[125440]: pgmap v1072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:54 smithi136 ceph-mon[125702]: pgmap v1073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:54 smithi057 ceph-mon[92072]: pgmap v1073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:54 smithi122 ceph-mon[125440]: pgmap v1073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:56 smithi136 ceph-mon[125702]: pgmap v1074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:56 smithi057 ceph-mon[92072]: pgmap v1074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:56 smithi122 ceph-mon[125440]: pgmap v1074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:30:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:30:58 smithi136 ceph-mon[125702]: pgmap v1075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:30:58 smithi057 ceph-mon[92072]: pgmap v1075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:30:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:30:58 smithi122 ceph-mon[125440]: pgmap v1075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:00 smithi136 ceph-mon[125702]: pgmap v1076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:00 smithi057 ceph-mon[92072]: pgmap v1076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:00 smithi122 ceph-mon[125440]: pgmap v1076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:02 smithi136 ceph-mon[125702]: pgmap v1077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:02 smithi057 ceph-mon[92072]: pgmap v1077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:02 smithi122 ceph-mon[125440]: pgmap v1077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:04 smithi122 ceph-mon[125440]: pgmap v1078: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:31:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:04 smithi057 ceph-mon[92072]: pgmap v1078: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:31:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:04 smithi136 ceph-mon[125702]: pgmap v1078: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:31:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:05.327+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:31:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:05.327+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:31:05.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:05.327+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:31:05.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:05.327+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:31:05.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:05.327+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:31:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:06 smithi057 ceph-mon[92072]: pgmap v1079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:31:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:06 smithi122 ceph-mon[125440]: pgmap v1079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:31:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:06 smithi136 ceph-mon[125702]: pgmap v1079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:31:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:08 smithi057 ceph-mon[92072]: pgmap v1080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:31:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:08 smithi122 ceph-mon[125440]: pgmap v1080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:31:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:08 smithi136 ceph-mon[125702]: pgmap v1080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:31:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:10 smithi057 ceph-mon[92072]: pgmap v1081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:31:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:10 smithi122 ceph-mon[125440]: pgmap v1081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:31:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:10 smithi136 ceph-mon[125702]: pgmap v1081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:31:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:11 smithi057 ceph-mon[92072]: osdmap e142: 12 total, 12 up, 12 in 2023-03-02T11:31:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:11 smithi122 ceph-mon[125440]: osdmap e142: 12 total, 12 up, 12 in 2023-03-02T11:31:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:11 smithi136 ceph-mon[125702]: osdmap e142: 12 total, 12 up, 12 in 2023-03-02T11:31:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:12 smithi057 ceph-mon[92072]: pgmap v1083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:31:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:12 smithi122 ceph-mon[125440]: pgmap v1083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:31:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:12 smithi136 ceph-mon[125702]: pgmap v1083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:31:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:14 smithi057 ceph-mon[92072]: pgmap v1084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:31:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:14 smithi057 ceph-mon[92072]: osdmap e143: 12 total, 12 up, 12 in 2023-03-02T11:31:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:14 smithi122 ceph-mon[125440]: pgmap v1084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:31:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:14 smithi122 ceph-mon[125440]: osdmap e143: 12 total, 12 up, 12 in 2023-03-02T11:31:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:14 smithi136 ceph-mon[125702]: pgmap v1084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:31:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:14 smithi136 ceph-mon[125702]: osdmap e143: 12 total, 12 up, 12 in 2023-03-02T11:31:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:16 smithi057 ceph-mon[92072]: pgmap v1086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:31:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:16 smithi122 ceph-mon[125440]: pgmap v1086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:31:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:16 smithi136 ceph-mon[125702]: pgmap v1086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:31:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:18 smithi057 ceph-mon[92072]: pgmap v1087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:31:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:31:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:18 smithi122 ceph-mon[125440]: pgmap v1087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:31:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:31:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:18 smithi136 ceph-mon[125702]: pgmap v1087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:31:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:31:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:31:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:31:19.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:31:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:31:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:31:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:31:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:31:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:20.331+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:31:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:20.331+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:31:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:20.331+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:31:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:20.331+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:31:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:20.331+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:31:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:20 smithi057 ceph-mon[92072]: pgmap v1088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:31:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:20 smithi122 ceph-mon[125440]: pgmap v1088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:31:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:20 smithi136 ceph-mon[125702]: pgmap v1088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:31:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:22 smithi057 ceph-mon[92072]: pgmap v1089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:31:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:22 smithi122 ceph-mon[125440]: pgmap v1089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:31:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:22 smithi136 ceph-mon[125702]: pgmap v1089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:31:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:24 smithi057 ceph-mon[92072]: pgmap v1090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:31:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:24 smithi122 ceph-mon[125440]: pgmap v1090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:31:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:24 smithi136 ceph-mon[125702]: pgmap v1090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:31:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:26 smithi122 ceph-mon[125440]: pgmap v1091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:31:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:26 smithi136 ceph-mon[125702]: pgmap v1091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:31:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:26 smithi057 ceph-mon[92072]: pgmap v1091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:31:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:28 smithi122 ceph-mon[125440]: pgmap v1092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:31:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:28 smithi136 ceph-mon[125702]: pgmap v1092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:31:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:28 smithi057 ceph-mon[92072]: pgmap v1092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:31:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:30 smithi136 ceph-mon[125702]: pgmap v1093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:30 smithi057 ceph-mon[92072]: pgmap v1093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:30 smithi122 ceph-mon[125440]: pgmap v1093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:32 smithi136 ceph-mon[125702]: pgmap v1094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:32 smithi057 ceph-mon[92072]: pgmap v1094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:32 smithi122 ceph-mon[125440]: pgmap v1094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:34 smithi136 ceph-mon[125702]: pgmap v1095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:34 smithi057 ceph-mon[92072]: pgmap v1095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:34 smithi122 ceph-mon[125440]: pgmap v1095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:35.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:35.347+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:31:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:35.347+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:31:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:35.347+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:31:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:35.347+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:31:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:35.347+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:31:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:36 smithi136 ceph-mon[125702]: pgmap v1096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:36 smithi057 ceph-mon[92072]: pgmap v1096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:36 smithi122 ceph-mon[125440]: pgmap v1096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:38 smithi136 ceph-mon[125702]: pgmap v1097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:38 smithi057 ceph-mon[92072]: pgmap v1097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:38 smithi122 ceph-mon[125440]: pgmap v1097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:40 smithi136 ceph-mon[125702]: pgmap v1098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:40 smithi057 ceph-mon[92072]: pgmap v1098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:40 smithi122 ceph-mon[125440]: pgmap v1098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:42 smithi136 ceph-mon[125702]: pgmap v1099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:42 smithi057 ceph-mon[92072]: pgmap v1099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:42 smithi122 ceph-mon[125440]: pgmap v1099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:44 smithi136 ceph-mon[125702]: pgmap v1100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:44 smithi057 ceph-mon[92072]: pgmap v1100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:44 smithi122 ceph-mon[125440]: pgmap v1100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:46 smithi136 ceph-mon[125702]: pgmap v1101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:46 smithi057 ceph-mon[92072]: pgmap v1101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:46 smithi122 ceph-mon[125440]: pgmap v1101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:48 smithi136 ceph-mon[125702]: pgmap v1102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:48 smithi057 ceph-mon[92072]: pgmap v1102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:48 smithi122 ceph-mon[125440]: pgmap v1102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:50.363+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:31:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:50.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:31:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:50.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:31:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:50.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:31:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:31:50.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:31:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:50 smithi136 ceph-mon[125702]: pgmap v1103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:50 smithi057 ceph-mon[92072]: pgmap v1103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:50 smithi122 ceph-mon[125440]: pgmap v1103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:52 smithi136 ceph-mon[125702]: pgmap v1104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:52 smithi057 ceph-mon[92072]: pgmap v1104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:52 smithi122 ceph-mon[125440]: pgmap v1104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:54 smithi136 ceph-mon[125702]: pgmap v1105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:54 smithi057 ceph-mon[92072]: pgmap v1105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:54 smithi122 ceph-mon[125440]: pgmap v1105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:56 smithi136 ceph-mon[125702]: pgmap v1106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:56 smithi057 ceph-mon[92072]: pgmap v1106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:56 smithi122 ceph-mon[125440]: pgmap v1106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:31:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:31:58 smithi136 ceph-mon[125702]: pgmap v1107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:31:58 smithi057 ceph-mon[92072]: pgmap v1107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:31:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:31:58 smithi122 ceph-mon[125440]: pgmap v1107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:00 smithi136 ceph-mon[125702]: pgmap v1108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:00 smithi057 ceph-mon[92072]: pgmap v1108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:00 smithi122 ceph-mon[125440]: pgmap v1108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:02 smithi136 ceph-mon[125702]: pgmap v1109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:02 smithi057 ceph-mon[92072]: pgmap v1109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:02 smithi122 ceph-mon[125440]: pgmap v1109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:04 smithi136 ceph-mon[125702]: pgmap v1110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:32:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:04 smithi057 ceph-mon[92072]: pgmap v1110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:32:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:04 smithi122 ceph-mon[125440]: pgmap v1110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:32:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:05.379+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:32:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:05.380+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:32:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:05.380+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:32:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:05.380+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:32:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:05.380+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:32:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:06 smithi136 ceph-mon[125702]: pgmap v1111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:32:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:06 smithi057 ceph-mon[92072]: pgmap v1111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:32:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:06 smithi122 ceph-mon[125440]: pgmap v1111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:32:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:08.642+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T11:32:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:08.642+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 20 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T11:32:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:08.642+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:32:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:08.643+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 21 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:32:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:08.648+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:32:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:08.648+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 19 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T11:32:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:08.648+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:32:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:08.649+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 20 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:32:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:08 smithi136 ceph-mon[125702]: pgmap v1112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:32:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:08 smithi057 ceph-mon[92072]: pgmap v1112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:32:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:08 smithi122 ceph-mon[125440]: pgmap v1112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:32:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:10 smithi136 ceph-mon[125702]: pgmap v1113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:32:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:10 smithi057 ceph-mon[92072]: pgmap v1113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:32:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:10 smithi122 ceph-mon[125440]: pgmap v1113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:32:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:11 smithi136 ceph-mon[125702]: osdmap e144: 12 total, 12 up, 12 in 2023-03-02T11:32:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:11 smithi057 ceph-mon[92072]: osdmap e144: 12 total, 12 up, 12 in 2023-03-02T11:32:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:11 smithi122 ceph-mon[125440]: osdmap e144: 12 total, 12 up, 12 in 2023-03-02T11:32:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:12 smithi136 ceph-mon[125702]: pgmap v1115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:32:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:12 smithi057 ceph-mon[92072]: pgmap v1115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:32:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:12 smithi122 ceph-mon[125440]: pgmap v1115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:32:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:14 smithi136 ceph-mon[125702]: pgmap v1116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:32:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:14 smithi136 ceph-mon[125702]: osdmap e145: 12 total, 12 up, 12 in 2023-03-02T11:32:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:14 smithi057 ceph-mon[92072]: pgmap v1116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:32:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:14 smithi057 ceph-mon[92072]: osdmap e145: 12 total, 12 up, 12 in 2023-03-02T11:32:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:14 smithi122 ceph-mon[125440]: pgmap v1116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:32:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:14 smithi122 ceph-mon[125440]: osdmap e145: 12 total, 12 up, 12 in 2023-03-02T11:32:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:16 smithi136 ceph-mon[125702]: pgmap v1118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:32:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:16 smithi057 ceph-mon[92072]: pgmap v1118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:32:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:16 smithi122 ceph-mon[125440]: pgmap v1118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:32:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:18 smithi136 ceph-mon[125702]: pgmap v1119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:32:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:18 smithi057 ceph-mon[92072]: pgmap v1119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:32:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:18 smithi122 ceph-mon[125440]: pgmap v1119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:32:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:20.393+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:32:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:20.394+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:32:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:20.394+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:32:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:20.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:32:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:20.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:32:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:20 smithi136 ceph-mon[125702]: pgmap v1120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T11:32:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:32:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:20 smithi057 ceph-mon[92072]: pgmap v1120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T11:32:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:32:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:20 smithi122 ceph-mon[125440]: pgmap v1120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T11:32:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:32:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:32:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:32:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:32:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:32:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:32:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:32:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:32:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:32:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:32:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:22 smithi122 ceph-mon[125440]: pgmap v1121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:32:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:22 smithi136 ceph-mon[125702]: pgmap v1121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:32:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:22 smithi057 ceph-mon[92072]: pgmap v1121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:32:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:24 smithi136 ceph-mon[125702]: pgmap v1122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:32:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:24 smithi057 ceph-mon[92072]: pgmap v1122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:32:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:24 smithi122 ceph-mon[125440]: pgmap v1122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:32:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:26 smithi136 ceph-mon[125702]: pgmap v1123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:32:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:26 smithi057 ceph-mon[92072]: pgmap v1123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:32:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:26 smithi122 ceph-mon[125440]: pgmap v1123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:32:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:28 smithi136 ceph-mon[125702]: pgmap v1124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:32:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:28 smithi057 ceph-mon[92072]: pgmap v1124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:32:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:28 smithi122 ceph-mon[125440]: pgmap v1124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:32:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:30 smithi136 ceph-mon[125702]: pgmap v1125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:30 smithi057 ceph-mon[92072]: pgmap v1125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:30 smithi122 ceph-mon[125440]: pgmap v1125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:32 smithi136 ceph-mon[125702]: pgmap v1126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:32 smithi057 ceph-mon[92072]: pgmap v1126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:32 smithi122 ceph-mon[125440]: pgmap v1126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:34 smithi136 ceph-mon[125702]: pgmap v1127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:34 smithi057 ceph-mon[92072]: pgmap v1127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:34 smithi122 ceph-mon[125440]: pgmap v1127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:35.409+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:32:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:35.409+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:32:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:35.409+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:32:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:35.409+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:32:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:35.409+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:32:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:36 smithi136 ceph-mon[125702]: pgmap v1128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:36 smithi057 ceph-mon[92072]: pgmap v1128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:36 smithi122 ceph-mon[125440]: pgmap v1128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:38 smithi136 ceph-mon[125702]: pgmap v1129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:38 smithi057 ceph-mon[92072]: pgmap v1129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:38 smithi122 ceph-mon[125440]: pgmap v1129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:40 smithi136 ceph-mon[125702]: pgmap v1130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:40 smithi057 ceph-mon[92072]: pgmap v1130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:40 smithi122 ceph-mon[125440]: pgmap v1130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:43.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:42 smithi136 ceph-mon[125702]: pgmap v1131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:42 smithi057 ceph-mon[92072]: pgmap v1131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:42 smithi122 ceph-mon[125440]: pgmap v1131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:44 smithi136 ceph-mon[125702]: pgmap v1132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:44 smithi057 ceph-mon[92072]: pgmap v1132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:44 smithi122 ceph-mon[125440]: pgmap v1132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:46 smithi136 ceph-mon[125702]: pgmap v1133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:46 smithi057 ceph-mon[92072]: pgmap v1133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:46 smithi122 ceph-mon[125440]: pgmap v1133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:48 smithi136 ceph-mon[125702]: pgmap v1134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:48 smithi057 ceph-mon[92072]: pgmap v1134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:48 smithi122 ceph-mon[125440]: pgmap v1134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:50.415+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:32:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:50.416+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:32:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:50.416+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:32:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:50.416+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:32:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:32:50.416+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:32:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:50 smithi136 ceph-mon[125702]: pgmap v1135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:50 smithi057 ceph-mon[92072]: pgmap v1135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:50 smithi122 ceph-mon[125440]: pgmap v1135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:52 smithi136 ceph-mon[125702]: pgmap v1136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:52 smithi057 ceph-mon[92072]: pgmap v1136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:52 smithi122 ceph-mon[125440]: pgmap v1136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:54 smithi136 ceph-mon[125702]: pgmap v1137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:54 smithi057 ceph-mon[92072]: pgmap v1137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:55.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:54 smithi122 ceph-mon[125440]: pgmap v1137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:56 smithi136 ceph-mon[125702]: pgmap v1138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:56 smithi057 ceph-mon[92072]: pgmap v1138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:56 smithi122 ceph-mon[125440]: pgmap v1138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:32:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:32:58 smithi136 ceph-mon[125702]: pgmap v1139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:32:58 smithi057 ceph-mon[92072]: pgmap v1139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:32:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:32:58 smithi122 ceph-mon[125440]: pgmap v1139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:00 smithi136 ceph-mon[125702]: pgmap v1140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:00 smithi057 ceph-mon[92072]: pgmap v1140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:00 smithi122 ceph-mon[125440]: pgmap v1140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:02 smithi136 ceph-mon[125702]: pgmap v1141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:02 smithi057 ceph-mon[92072]: pgmap v1141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:02 smithi122 ceph-mon[125440]: pgmap v1141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:04 smithi136 ceph-mon[125702]: pgmap v1142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:33:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:04 smithi057 ceph-mon[92072]: pgmap v1142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:33:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:04 smithi122 ceph-mon[125440]: pgmap v1142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:33:05.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:05.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:33:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:05.431+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:33:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:05.431+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:33:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:05.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:33:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:05.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:33:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:06 smithi136 ceph-mon[125702]: pgmap v1143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:33:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:06 smithi057 ceph-mon[92072]: pgmap v1143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:33:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:06 smithi122 ceph-mon[125440]: pgmap v1143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:33:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:08 smithi136 ceph-mon[125702]: pgmap v1144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:33:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:08 smithi057 ceph-mon[92072]: pgmap v1144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:33:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:08 smithi122 ceph-mon[125440]: pgmap v1144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:33:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:10 smithi136 ceph-mon[125702]: pgmap v1145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:33:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:10 smithi057 ceph-mon[92072]: pgmap v1145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:33:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:10 smithi122 ceph-mon[125440]: pgmap v1145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:33:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:11 smithi136 ceph-mon[125702]: osdmap e146: 12 total, 12 up, 12 in 2023-03-02T11:33:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:11 smithi057 ceph-mon[92072]: osdmap e146: 12 total, 12 up, 12 in 2023-03-02T11:33:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:11 smithi122 ceph-mon[125440]: osdmap e146: 12 total, 12 up, 12 in 2023-03-02T11:33:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:12 smithi136 ceph-mon[125702]: pgmap v1147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:33:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:12 smithi057 ceph-mon[92072]: pgmap v1147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:33:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:12 smithi122 ceph-mon[125440]: pgmap v1147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:33:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:14 smithi136 ceph-mon[125702]: pgmap v1148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:33:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:14 smithi136 ceph-mon[125702]: osdmap e147: 12 total, 12 up, 12 in 2023-03-02T11:33:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:14 smithi057 ceph-mon[92072]: pgmap v1148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:33:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:14 smithi057 ceph-mon[92072]: osdmap e147: 12 total, 12 up, 12 in 2023-03-02T11:33:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:14 smithi122 ceph-mon[125440]: pgmap v1148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:33:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:14 smithi122 ceph-mon[125440]: osdmap e147: 12 total, 12 up, 12 in 2023-03-02T11:33:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:16 smithi057 ceph-mon[92072]: pgmap v1150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:33:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:16 smithi122 ceph-mon[125440]: pgmap v1150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:33:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:16 smithi136 ceph-mon[125702]: pgmap v1150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:33:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:18 smithi057 ceph-mon[92072]: pgmap v1151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:33:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:18 smithi122 ceph-mon[125440]: pgmap v1151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:33:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:18 smithi136 ceph-mon[125702]: pgmap v1151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:33:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:20.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:33:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:20.442+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:33:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:20.442+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:33:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:20.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:33:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:20.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:33:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:20 smithi057 ceph-mon[92072]: pgmap v1152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T11:33:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:33:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:20 smithi122 ceph-mon[125440]: pgmap v1152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T11:33:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:33:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:20 smithi136 ceph-mon[125702]: pgmap v1152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T11:33:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:33:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:22 smithi057 ceph-mon[92072]: pgmap v1153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:33:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:33:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:33:23.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:33:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:22 smithi122 ceph-mon[125440]: pgmap v1153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:33:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:33:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:33:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:33:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:22 smithi136 ceph-mon[125702]: pgmap v1153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:33:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:33:23.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:33:23.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:33:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:24 smithi057 ceph-mon[92072]: pgmap v1154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:33:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:24 smithi122 ceph-mon[125440]: pgmap v1154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:33:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:24 smithi136 ceph-mon[125702]: pgmap v1154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:33:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:26 smithi057 ceph-mon[92072]: pgmap v1155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:33:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:26 smithi122 ceph-mon[125440]: pgmap v1155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:33:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:26 smithi136 ceph-mon[125702]: pgmap v1155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:33:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:28 smithi057 ceph-mon[92072]: pgmap v1156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:33:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:28 smithi122 ceph-mon[125440]: pgmap v1156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:33:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:28 smithi136 ceph-mon[125702]: pgmap v1156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:33:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:30 smithi057 ceph-mon[92072]: pgmap v1157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:30 smithi122 ceph-mon[125440]: pgmap v1157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:30 smithi136 ceph-mon[125702]: pgmap v1157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:32 smithi057 ceph-mon[92072]: pgmap v1158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:32 smithi122 ceph-mon[125440]: pgmap v1158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:32 smithi136 ceph-mon[125702]: pgmap v1158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:34 smithi057 ceph-mon[92072]: pgmap v1159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:34 smithi122 ceph-mon[125440]: pgmap v1159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:34 smithi136 ceph-mon[125702]: pgmap v1159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:35.445+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:33:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:35.445+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:33:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:35.445+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:33:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:35.445+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:33:35.448 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:35.445+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:33:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:36 smithi057 ceph-mon[92072]: pgmap v1160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:36 smithi122 ceph-mon[125440]: pgmap v1160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:36 smithi136 ceph-mon[125702]: pgmap v1160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:38 smithi057 ceph-mon[92072]: pgmap v1161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:38 smithi122 ceph-mon[125440]: pgmap v1161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:38 smithi136 ceph-mon[125702]: pgmap v1161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:40 smithi057 ceph-mon[92072]: pgmap v1162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:40 smithi122 ceph-mon[125440]: pgmap v1162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:40 smithi136 ceph-mon[125702]: pgmap v1162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:42 smithi057 ceph-mon[92072]: pgmap v1163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:42 smithi122 ceph-mon[125440]: pgmap v1163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:42 smithi136 ceph-mon[125702]: pgmap v1163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:44 smithi057 ceph-mon[92072]: pgmap v1164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:44 smithi122 ceph-mon[125440]: pgmap v1164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:44 smithi136 ceph-mon[125702]: pgmap v1164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:46 smithi057 ceph-mon[92072]: pgmap v1165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:46 smithi122 ceph-mon[125440]: pgmap v1165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:46 smithi136 ceph-mon[125702]: pgmap v1165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:48 smithi057 ceph-mon[92072]: pgmap v1166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:48 smithi122 ceph-mon[125440]: pgmap v1166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:48 smithi136 ceph-mon[125702]: pgmap v1166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:50.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:33:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:50.458+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:33:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:50.458+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:33:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:50.458+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:33:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:33:50.458+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:33:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:50 smithi057 ceph-mon[92072]: pgmap v1167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:50 smithi122 ceph-mon[125440]: pgmap v1167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:50 smithi136 ceph-mon[125702]: pgmap v1167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:51 smithi057 ceph-mon[92072]: pgmap v1168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:51 smithi122 ceph-mon[125440]: pgmap v1168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:51 smithi136 ceph-mon[125702]: pgmap v1168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:54 smithi136 ceph-mon[125702]: pgmap v1169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:54 smithi057 ceph-mon[92072]: pgmap v1169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:54.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:54 smithi122 ceph-mon[125440]: pgmap v1169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:56 smithi136 ceph-mon[125702]: pgmap v1170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:56 smithi057 ceph-mon[92072]: pgmap v1170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:56 smithi122 ceph-mon[125440]: pgmap v1170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:33:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:33:58 smithi136 ceph-mon[125702]: pgmap v1171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:33:58 smithi057 ceph-mon[92072]: pgmap v1171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:33:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:33:58 smithi122 ceph-mon[125440]: pgmap v1171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:00 smithi136 ceph-mon[125702]: pgmap v1172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:00 smithi057 ceph-mon[92072]: pgmap v1172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:00 smithi122 ceph-mon[125440]: pgmap v1172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:02 smithi136 ceph-mon[125702]: pgmap v1173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:02 smithi057 ceph-mon[92072]: pgmap v1173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:02 smithi122 ceph-mon[125440]: pgmap v1173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:04 smithi136 ceph-mon[125702]: pgmap v1174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:34:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:04 smithi057 ceph-mon[92072]: pgmap v1174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:34:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:04 smithi122 ceph-mon[125440]: pgmap v1174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:34:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:05.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:34:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:05.473+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:34:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:05.473+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:34:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:05.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:34:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:05.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:34:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:06 smithi136 ceph-mon[125702]: pgmap v1175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:34:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:06 smithi057 ceph-mon[92072]: pgmap v1175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:34:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:06 smithi122 ceph-mon[125440]: pgmap v1175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:34:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:08 smithi136 ceph-mon[125702]: pgmap v1176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:34:08.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:08 smithi057 ceph-mon[92072]: pgmap v1176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:34:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:08 smithi122 ceph-mon[125440]: pgmap v1176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:34:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:10 smithi136 ceph-mon[125702]: pgmap v1177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:34:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:10 smithi057 ceph-mon[92072]: pgmap v1177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:34:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:10 smithi122 ceph-mon[125440]: pgmap v1177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:34:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:11 smithi136 ceph-mon[125702]: osdmap e148: 12 total, 12 up, 12 in 2023-03-02T11:34:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:11 smithi057 ceph-mon[92072]: osdmap e148: 12 total, 12 up, 12 in 2023-03-02T11:34:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:11 smithi122 ceph-mon[125440]: osdmap e148: 12 total, 12 up, 12 in 2023-03-02T11:34:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:12 smithi136 ceph-mon[125702]: pgmap v1179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:34:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:12 smithi057 ceph-mon[92072]: pgmap v1179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:34:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:12 smithi122 ceph-mon[125440]: pgmap v1179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:34:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:14 smithi136 ceph-mon[125702]: pgmap v1180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T11:34:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:14 smithi136 ceph-mon[125702]: osdmap e149: 12 total, 12 up, 12 in 2023-03-02T11:34:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:14 smithi057 ceph-mon[92072]: pgmap v1180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T11:34:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:14 smithi057 ceph-mon[92072]: osdmap e149: 12 total, 12 up, 12 in 2023-03-02T11:34:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:14 smithi122 ceph-mon[125440]: pgmap v1180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T11:34:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:14 smithi122 ceph-mon[125440]: osdmap e149: 12 total, 12 up, 12 in 2023-03-02T11:34:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:16 smithi136 ceph-mon[125702]: pgmap v1182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:34:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:16 smithi057 ceph-mon[92072]: pgmap v1182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:34:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:16 smithi122 ceph-mon[125440]: pgmap v1182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:34:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:18 smithi136 ceph-mon[125702]: pgmap v1183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:34:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:18 smithi057 ceph-mon[92072]: pgmap v1183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:34:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:18 smithi122 ceph-mon[125440]: pgmap v1183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:34:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:20.489+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:34:20.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:20.489+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:34:20.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:20.489+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:34:20.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:20.489+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:34:20.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:20.489+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:34:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:20 smithi136 ceph-mon[125702]: pgmap v1184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:34:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:20 smithi057 ceph-mon[92072]: pgmap v1184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:34:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:20 smithi122 ceph-mon[125440]: pgmap v1184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:34:22.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:22 smithi057 ceph-mon[92072]: pgmap v1185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:34:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:22 smithi122 ceph-mon[125440]: pgmap v1185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:34:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:22 smithi136 ceph-mon[125702]: pgmap v1185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:34:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:34:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:34:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:34:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:34:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:34:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:34:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:34:23.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:34:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:34:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:34:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:34:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:34:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:24 smithi057 ceph-mon[92072]: pgmap v1186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:34:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:24 smithi122 ceph-mon[125440]: pgmap v1186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:34:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:24 smithi136 ceph-mon[125702]: pgmap v1186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:34:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:26 smithi057 ceph-mon[92072]: pgmap v1187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:34:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:26 smithi122 ceph-mon[125440]: pgmap v1187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:34:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:26 smithi136 ceph-mon[125702]: pgmap v1187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:34:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:28 smithi057 ceph-mon[92072]: pgmap v1188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:34:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:28 smithi122 ceph-mon[125440]: pgmap v1188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:34:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:28 smithi136 ceph-mon[125702]: pgmap v1188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:34:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:30 smithi057 ceph-mon[92072]: pgmap v1189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:30 smithi122 ceph-mon[125440]: pgmap v1189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:30 smithi136 ceph-mon[125702]: pgmap v1189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:32 smithi057 ceph-mon[92072]: pgmap v1190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:32 smithi122 ceph-mon[125440]: pgmap v1190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:32 smithi136 ceph-mon[125702]: pgmap v1190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:34 smithi057 ceph-mon[92072]: pgmap v1191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:34 smithi122 ceph-mon[125440]: pgmap v1191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:34 smithi136 ceph-mon[125702]: pgmap v1191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:35.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:35.489+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:34:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:35.490+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:34:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:35.490+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:34:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:35.490+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:34:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:35.490+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:34:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:36 smithi057 ceph-mon[92072]: pgmap v1192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:36 smithi122 ceph-mon[125440]: pgmap v1192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:36 smithi136 ceph-mon[125702]: pgmap v1192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:38 smithi057 ceph-mon[92072]: pgmap v1193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:38 smithi122 ceph-mon[125440]: pgmap v1193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:38 smithi136 ceph-mon[125702]: pgmap v1193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:40 smithi057 ceph-mon[92072]: pgmap v1194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:40 smithi122 ceph-mon[125440]: pgmap v1194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:40 smithi136 ceph-mon[125702]: pgmap v1194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:42 smithi057 ceph-mon[92072]: pgmap v1195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:42 smithi122 ceph-mon[125440]: pgmap v1195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:42 smithi136 ceph-mon[125702]: pgmap v1195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:44 smithi057 ceph-mon[92072]: pgmap v1196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:44 smithi122 ceph-mon[125440]: pgmap v1196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:44 smithi136 ceph-mon[125702]: pgmap v1196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:46 smithi057 ceph-mon[92072]: pgmap v1197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:46 smithi122 ceph-mon[125440]: pgmap v1197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:46 smithi136 ceph-mon[125702]: pgmap v1197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:48 smithi057 ceph-mon[92072]: pgmap v1198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:48 smithi122 ceph-mon[125440]: pgmap v1198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:48 smithi136 ceph-mon[125702]: pgmap v1198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:50.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:34:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:50.507+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:34:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:50.507+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:34:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:50.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:34:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:34:50.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:34:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:50 smithi057 ceph-mon[92072]: pgmap v1199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:50 smithi122 ceph-mon[125440]: pgmap v1199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:50 smithi136 ceph-mon[125702]: pgmap v1199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:52 smithi057 ceph-mon[92072]: pgmap v1200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:52 smithi122 ceph-mon[125440]: pgmap v1200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:52 smithi136 ceph-mon[125702]: pgmap v1200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:54 smithi057 ceph-mon[92072]: pgmap v1201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:54 smithi122 ceph-mon[125440]: pgmap v1201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:54 smithi136 ceph-mon[125702]: pgmap v1201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:56 smithi057 ceph-mon[92072]: pgmap v1202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:56 smithi122 ceph-mon[125440]: pgmap v1202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:56 smithi136 ceph-mon[125702]: pgmap v1202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:34:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:34:58 smithi057 ceph-mon[92072]: pgmap v1203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:34:58 smithi122 ceph-mon[125440]: pgmap v1203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:34:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:34:58 smithi136 ceph-mon[125702]: pgmap v1203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:00 smithi057 ceph-mon[92072]: pgmap v1204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:00 smithi122 ceph-mon[125440]: pgmap v1204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:00 smithi136 ceph-mon[125702]: pgmap v1204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:02 smithi057 ceph-mon[92072]: pgmap v1205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:02 smithi122 ceph-mon[125440]: pgmap v1205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:02 smithi136 ceph-mon[125702]: pgmap v1205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:04 smithi057 ceph-mon[92072]: pgmap v1206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:35:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:04 smithi122 ceph-mon[125440]: pgmap v1206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:35:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:04 smithi136 ceph-mon[125702]: pgmap v1206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:35:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:05.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:35:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:05.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:35:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:05.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:35:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:05.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:35:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:05.519+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:35:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:06 smithi122 ceph-mon[125440]: pgmap v1207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:35:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:06 smithi136 ceph-mon[125702]: pgmap v1207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:35:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:06 smithi057 ceph-mon[92072]: pgmap v1207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:35:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:08.668+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:35:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:08.668+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 22 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:08.671+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:08.671+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 21 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:35:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:08 smithi122 ceph-mon[125440]: pgmap v1208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:35:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:08 smithi136 ceph-mon[125702]: pgmap v1208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:35:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:08 smithi057 ceph-mon[92072]: pgmap v1208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:35:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:10 smithi122 ceph-mon[125440]: pgmap v1209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:35:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:10 smithi136 ceph-mon[125702]: pgmap v1209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:35:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:10 smithi057 ceph-mon[92072]: pgmap v1209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:35:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:11 smithi136 ceph-mon[125702]: osdmap e150: 12 total, 12 up, 12 in 2023-03-02T11:35:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:11 smithi057 ceph-mon[92072]: osdmap e150: 12 total, 12 up, 12 in 2023-03-02T11:35:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:11 smithi122 ceph-mon[125440]: osdmap e150: 12 total, 12 up, 12 in 2023-03-02T11:35:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:12 smithi136 ceph-mon[125702]: pgmap v1211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:35:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:12 smithi057 ceph-mon[92072]: pgmap v1211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:35:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:12 smithi122 ceph-mon[125440]: pgmap v1211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:35:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:14 smithi136 ceph-mon[125702]: pgmap v1212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:35:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:14 smithi136 ceph-mon[125702]: osdmap e151: 12 total, 12 up, 12 in 2023-03-02T11:35:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:14 smithi057 ceph-mon[92072]: pgmap v1212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:35:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:14 smithi057 ceph-mon[92072]: osdmap e151: 12 total, 12 up, 12 in 2023-03-02T11:35:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:14 smithi122 ceph-mon[125440]: pgmap v1212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:35:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:14 smithi122 ceph-mon[125440]: osdmap e151: 12 total, 12 up, 12 in 2023-03-02T11:35:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:16 smithi136 ceph-mon[125702]: pgmap v1214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:35:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:16 smithi057 ceph-mon[92072]: pgmap v1214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:35:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:16 smithi122 ceph-mon[125440]: pgmap v1214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:35:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:18 smithi136 ceph-mon[125702]: pgmap v1215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:35:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:18 smithi057 ceph-mon[92072]: pgmap v1215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:35:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:18 smithi122 ceph-mon[125440]: pgmap v1215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:35:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:20.534+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:35:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:20.535+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:35:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:20.535+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:35:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:20.535+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:35:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:20.535+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:35:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:20 smithi136 ceph-mon[125702]: pgmap v1216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:35:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:20 smithi057 ceph-mon[92072]: pgmap v1216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:35:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:20 smithi122 ceph-mon[125440]: pgmap v1216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:35:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:22 smithi136 ceph-mon[125702]: pgmap v1217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:35:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:22 smithi057 ceph-mon[92072]: pgmap v1217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:35:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:22 smithi122 ceph-mon[125440]: pgmap v1217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:35:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:35:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:35:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:35:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:24 smithi136 ceph-mon[125702]: pgmap v1218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:35:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:35:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:35:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:35:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:24 smithi057 ceph-mon[92072]: pgmap v1218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:35:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:35:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:35:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:35:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:24 smithi122 ceph-mon[125440]: pgmap v1218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:35:24.977 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:35:24.977 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:35:24.977 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:35:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:26 smithi136 ceph-mon[125702]: pgmap v1219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:35:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:26 smithi057 ceph-mon[92072]: pgmap v1219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:35:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:26 smithi122 ceph-mon[125440]: pgmap v1219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:35:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:28 smithi136 ceph-mon[125702]: pgmap v1220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:35:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:28 smithi057 ceph-mon[92072]: pgmap v1220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:35:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:28 smithi122 ceph-mon[125440]: pgmap v1220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:35:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:30 smithi136 ceph-mon[125702]: pgmap v1221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:30 smithi057 ceph-mon[92072]: pgmap v1221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:30 smithi122 ceph-mon[125440]: pgmap v1221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:32 smithi136 ceph-mon[125702]: pgmap v1222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:32 smithi057 ceph-mon[92072]: pgmap v1222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:32 smithi122 ceph-mon[125440]: pgmap v1222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:34 smithi136 ceph-mon[125702]: pgmap v1223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:34 smithi057 ceph-mon[92072]: pgmap v1223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:34 smithi122 ceph-mon[125440]: pgmap v1223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:35.537+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:35:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:35.537+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:35:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:35.537+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:35:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:35.537+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:35:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:35.537+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:35:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:36 smithi136 ceph-mon[125702]: pgmap v1224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:36 smithi057 ceph-mon[92072]: pgmap v1224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:36 smithi122 ceph-mon[125440]: pgmap v1224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:38 smithi136 ceph-mon[125702]: pgmap v1225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:38 smithi057 ceph-mon[92072]: pgmap v1225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:38 smithi122 ceph-mon[125440]: pgmap v1225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:40 smithi136 ceph-mon[125702]: pgmap v1226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:40 smithi057 ceph-mon[92072]: pgmap v1226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:40 smithi122 ceph-mon[125440]: pgmap v1226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:42 smithi136 ceph-mon[125702]: pgmap v1227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:42 smithi057 ceph-mon[92072]: pgmap v1227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:42 smithi122 ceph-mon[125440]: pgmap v1227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:44 smithi136 ceph-mon[125702]: pgmap v1228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:44 smithi057 ceph-mon[92072]: pgmap v1228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:44 smithi122 ceph-mon[125440]: pgmap v1228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:46 smithi136 ceph-mon[125702]: pgmap v1229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:46 smithi057 ceph-mon[92072]: pgmap v1229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:46 smithi122 ceph-mon[125440]: pgmap v1229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:48 smithi136 ceph-mon[125702]: pgmap v1230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:48 smithi057 ceph-mon[92072]: pgmap v1230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:48 smithi122 ceph-mon[125440]: pgmap v1230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:50.538+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:35:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:50.539+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:35:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:50.539+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:35:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:50.539+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:35:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:35:50.539+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:35:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:50 smithi136 ceph-mon[125702]: pgmap v1231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:50 smithi057 ceph-mon[92072]: pgmap v1231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:50 smithi122 ceph-mon[125440]: pgmap v1231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:52 smithi136 ceph-mon[125702]: pgmap v1232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:52 smithi057 ceph-mon[92072]: pgmap v1232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:52 smithi122 ceph-mon[125440]: pgmap v1232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:54 smithi136 ceph-mon[125702]: pgmap v1233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:54 smithi057 ceph-mon[92072]: pgmap v1233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:54 smithi122 ceph-mon[125440]: pgmap v1233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:56 smithi136 ceph-mon[125702]: pgmap v1234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:56 smithi057 ceph-mon[92072]: pgmap v1234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:56 smithi122 ceph-mon[125440]: pgmap v1234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:35:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:35:58 smithi136 ceph-mon[125702]: pgmap v1235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:58.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:35:58 smithi057 ceph-mon[92072]: pgmap v1235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:35:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:35:58 smithi122 ceph-mon[125440]: pgmap v1235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:00 smithi136 ceph-mon[125702]: pgmap v1236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:00 smithi057 ceph-mon[92072]: pgmap v1236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:00 smithi122 ceph-mon[125440]: pgmap v1236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:02 smithi136 ceph-mon[125702]: pgmap v1237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:02 smithi057 ceph-mon[92072]: pgmap v1237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:02 smithi122 ceph-mon[125440]: pgmap v1237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:04 smithi136 ceph-mon[125702]: pgmap v1238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:36:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:04 smithi057 ceph-mon[92072]: pgmap v1238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:36:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:04 smithi122 ceph-mon[125440]: pgmap v1238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:36:05.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:05.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:36:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:05.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:36:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:05.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:36:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:05.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:36:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:05.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:36:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:06 smithi136 ceph-mon[125702]: pgmap v1239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:36:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:06 smithi057 ceph-mon[92072]: pgmap v1239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:36:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:06 smithi122 ceph-mon[125440]: pgmap v1239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:36:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:08 smithi136 ceph-mon[125702]: pgmap v1240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:36:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:08 smithi057 ceph-mon[92072]: pgmap v1240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:36:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:08 smithi122 ceph-mon[125440]: pgmap v1240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:36:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:10 smithi136 ceph-mon[125702]: pgmap v1241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:36:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:10 smithi057 ceph-mon[92072]: pgmap v1241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:36:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:10 smithi122 ceph-mon[125440]: pgmap v1241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:36:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:11 smithi136 ceph-mon[125702]: osdmap e152: 12 total, 12 up, 12 in 2023-03-02T11:36:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:11 smithi057 ceph-mon[92072]: osdmap e152: 12 total, 12 up, 12 in 2023-03-02T11:36:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:11 smithi122 ceph-mon[125440]: osdmap e152: 12 total, 12 up, 12 in 2023-03-02T11:36:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:12 smithi057 ceph-mon[92072]: pgmap v1243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:36:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:12 smithi122 ceph-mon[125440]: pgmap v1243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:36:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:12 smithi136 ceph-mon[125702]: pgmap v1243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:36:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:14 smithi057 ceph-mon[92072]: pgmap v1244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:36:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:14 smithi057 ceph-mon[92072]: osdmap e153: 12 total, 12 up, 12 in 2023-03-02T11:36:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:14 smithi122 ceph-mon[125440]: pgmap v1244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:36:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:14 smithi122 ceph-mon[125440]: osdmap e153: 12 total, 12 up, 12 in 2023-03-02T11:36:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:14 smithi136 ceph-mon[125702]: pgmap v1244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:36:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:14 smithi136 ceph-mon[125702]: osdmap e153: 12 total, 12 up, 12 in 2023-03-02T11:36:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:16 smithi057 ceph-mon[92072]: pgmap v1246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:36:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:16 smithi122 ceph-mon[125440]: pgmap v1246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:36:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:16 smithi136 ceph-mon[125702]: pgmap v1246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:36:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:18 smithi057 ceph-mon[92072]: pgmap v1247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:36:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:18 smithi122 ceph-mon[125440]: pgmap v1247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:36:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:18 smithi136 ceph-mon[125702]: pgmap v1247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:36:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:20.557+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:36:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:20.558+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:36:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:20.558+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:36:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:20.558+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:36:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:20.558+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:36:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:20 smithi057 ceph-mon[92072]: pgmap v1248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:36:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:20 smithi122 ceph-mon[125440]: pgmap v1248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:36:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:20 smithi136 ceph-mon[125702]: pgmap v1248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:36:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:22 smithi057 ceph-mon[92072]: pgmap v1249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:36:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:22 smithi122 ceph-mon[125440]: pgmap v1249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:36:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:22 smithi136 ceph-mon[125702]: pgmap v1249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:36:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:24 smithi057 ceph-mon[92072]: pgmap v1250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:36:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:36:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:24 smithi122 ceph-mon[125440]: pgmap v1250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:36:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:36:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:24 smithi136 ceph-mon[125702]: pgmap v1250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:36:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:36:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:36:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:36:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:36:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:36:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:36:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:36:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:36:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:36:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:36:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:26 smithi057 ceph-mon[92072]: pgmap v1251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:36:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:26 smithi122 ceph-mon[125440]: pgmap v1251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:36:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:26 smithi136 ceph-mon[125702]: pgmap v1251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:36:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:28 smithi057 ceph-mon[92072]: pgmap v1252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:36:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:28 smithi122 ceph-mon[125440]: pgmap v1252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:36:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:28 smithi136 ceph-mon[125702]: pgmap v1252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:36:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:30 smithi057 ceph-mon[92072]: pgmap v1253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:30 smithi122 ceph-mon[125440]: pgmap v1253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:30 smithi136 ceph-mon[125702]: pgmap v1253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:32 smithi057 ceph-mon[92072]: pgmap v1254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:32 smithi122 ceph-mon[125440]: pgmap v1254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:32 smithi136 ceph-mon[125702]: pgmap v1254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:34 smithi057 ceph-mon[92072]: pgmap v1255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:34 smithi122 ceph-mon[125440]: pgmap v1255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:34 smithi136 ceph-mon[125702]: pgmap v1255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:35.574+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:36:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:35.574+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:36:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:35.574+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:36:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:35.574+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:36:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:35.574+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:36:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:36 smithi057 ceph-mon[92072]: pgmap v1256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:36 smithi122 ceph-mon[125440]: pgmap v1256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:36 smithi136 ceph-mon[125702]: pgmap v1256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:38 smithi057 ceph-mon[92072]: pgmap v1257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:38 smithi122 ceph-mon[125440]: pgmap v1257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:38 smithi136 ceph-mon[125702]: pgmap v1257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:40 smithi057 ceph-mon[92072]: pgmap v1258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:40 smithi122 ceph-mon[125440]: pgmap v1258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:40 smithi136 ceph-mon[125702]: pgmap v1258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:42 smithi057 ceph-mon[92072]: pgmap v1259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:42 smithi122 ceph-mon[125440]: pgmap v1259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:42 smithi136 ceph-mon[125702]: pgmap v1259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:44 smithi057 ceph-mon[92072]: pgmap v1260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:44 smithi122 ceph-mon[125440]: pgmap v1260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:44 smithi136 ceph-mon[125702]: pgmap v1260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:46 smithi057 ceph-mon[92072]: pgmap v1261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:46 smithi122 ceph-mon[125440]: pgmap v1261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:46 smithi136 ceph-mon[125702]: pgmap v1261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:48 smithi057 ceph-mon[92072]: pgmap v1262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:48 smithi122 ceph-mon[125440]: pgmap v1262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:48 smithi136 ceph-mon[125702]: pgmap v1262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:50.588+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:36:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:50.588+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:36:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:50.588+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:36:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:50.588+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:36:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:36:50.588+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:36:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:50 smithi057 ceph-mon[92072]: pgmap v1263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:50 smithi122 ceph-mon[125440]: pgmap v1263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:50 smithi136 ceph-mon[125702]: pgmap v1263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:52 smithi122 ceph-mon[125440]: pgmap v1264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:52 smithi136 ceph-mon[125702]: pgmap v1264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:52 smithi057 ceph-mon[92072]: pgmap v1264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:54 smithi122 ceph-mon[125440]: pgmap v1265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:54 smithi136 ceph-mon[125702]: pgmap v1265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:54 smithi057 ceph-mon[92072]: pgmap v1265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:57.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:56 smithi122 ceph-mon[125440]: pgmap v1266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:56 smithi136 ceph-mon[125702]: pgmap v1266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:56 smithi057 ceph-mon[92072]: pgmap v1266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:36:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:36:57 smithi136 ceph-mon[125702]: pgmap v1267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:36:57 smithi057 ceph-mon[92072]: pgmap v1267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:36:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:36:57 smithi122 ceph-mon[125440]: pgmap v1267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:00 smithi136 ceph-mon[125702]: pgmap v1268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:00 smithi057 ceph-mon[92072]: pgmap v1268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:00 smithi122 ceph-mon[125440]: pgmap v1268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:02 smithi057 ceph-mon[92072]: pgmap v1269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:02 smithi122 ceph-mon[125440]: pgmap v1269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:02 smithi136 ceph-mon[125702]: pgmap v1269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:04 smithi057 ceph-mon[92072]: pgmap v1270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:37:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:04 smithi122 ceph-mon[125440]: pgmap v1270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:37:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:04 smithi136 ceph-mon[125702]: pgmap v1270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:37:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:05.596+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:37:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:05.596+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:37:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:05.596+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:37:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:05.596+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:37:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:05.596+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:37:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:06 smithi057 ceph-mon[92072]: pgmap v1271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:37:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:06 smithi122 ceph-mon[125440]: pgmap v1271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:37:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:06 smithi136 ceph-mon[125702]: pgmap v1271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:37:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:08 smithi057 ceph-mon[92072]: pgmap v1272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:37:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:08 smithi122 ceph-mon[125440]: pgmap v1272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:37:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:08 smithi136 ceph-mon[125702]: pgmap v1272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:37:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:10 smithi057 ceph-mon[92072]: pgmap v1273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:37:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:10 smithi122 ceph-mon[125440]: pgmap v1273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:37:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:10 smithi136 ceph-mon[125702]: pgmap v1273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:37:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:11 smithi057 ceph-mon[92072]: osdmap e154: 12 total, 12 up, 12 in 2023-03-02T11:37:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:11 smithi122 ceph-mon[125440]: osdmap e154: 12 total, 12 up, 12 in 2023-03-02T11:37:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:11 smithi136 ceph-mon[125702]: osdmap e154: 12 total, 12 up, 12 in 2023-03-02T11:37:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:12 smithi057 ceph-mon[92072]: pgmap v1275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:37:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:12 smithi122 ceph-mon[125440]: pgmap v1275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:37:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:12 smithi136 ceph-mon[125702]: pgmap v1275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:37:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:14 smithi057 ceph-mon[92072]: pgmap v1276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:37:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:14 smithi057 ceph-mon[92072]: osdmap e155: 12 total, 12 up, 12 in 2023-03-02T11:37:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:14 smithi122 ceph-mon[125440]: pgmap v1276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:37:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:14 smithi122 ceph-mon[125440]: osdmap e155: 12 total, 12 up, 12 in 2023-03-02T11:37:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:14 smithi136 ceph-mon[125702]: pgmap v1276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:37:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:14 smithi136 ceph-mon[125702]: osdmap e155: 12 total, 12 up, 12 in 2023-03-02T11:37:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:16 smithi057 ceph-mon[92072]: pgmap v1278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:37:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:16 smithi122 ceph-mon[125440]: pgmap v1278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:37:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:16 smithi136 ceph-mon[125702]: pgmap v1278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:37:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:18 smithi057 ceph-mon[92072]: pgmap v1279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:37:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:18 smithi122 ceph-mon[125440]: pgmap v1279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:37:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:18 smithi136 ceph-mon[125702]: pgmap v1279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:37:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:20.606+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:37:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:20.607+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:37:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:20.607+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:37:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:20.607+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:37:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:20.607+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:37:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:20 smithi057 ceph-mon[92072]: pgmap v1280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:37:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:20 smithi122 ceph-mon[125440]: pgmap v1280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:37:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:20 smithi136 ceph-mon[125702]: pgmap v1280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:37:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:22 smithi057 ceph-mon[92072]: pgmap v1281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:37:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:22 smithi122 ceph-mon[125440]: pgmap v1281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:37:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:22 smithi136 ceph-mon[125702]: pgmap v1281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:37:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:24 smithi057 ceph-mon[92072]: pgmap v1282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:37:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:24 smithi122 ceph-mon[125440]: pgmap v1282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:37:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:24 smithi136 ceph-mon[125702]: pgmap v1282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:37:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:37:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:37:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:37:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:26 smithi057 ceph-mon[92072]: pgmap v1283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:37:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:37:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:37:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:37:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:26 smithi122 ceph-mon[125440]: pgmap v1283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:37:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:37:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:37:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:37:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:26 smithi136 ceph-mon[125702]: pgmap v1283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:37:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:37:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:37:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:37:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:28 smithi122 ceph-mon[125440]: pgmap v1284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:37:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:28 smithi136 ceph-mon[125702]: pgmap v1284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:37:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:28 smithi057 ceph-mon[92072]: pgmap v1284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:37:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:30 smithi122 ceph-mon[125440]: pgmap v1285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:30 smithi136 ceph-mon[125702]: pgmap v1285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:30 smithi057 ceph-mon[92072]: pgmap v1285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:32 smithi122 ceph-mon[125440]: pgmap v1286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:32 smithi136 ceph-mon[125702]: pgmap v1286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:32 smithi057 ceph-mon[92072]: pgmap v1286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:34 smithi136 ceph-mon[125702]: pgmap v1287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:34 smithi057 ceph-mon[92072]: pgmap v1287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:34 smithi122 ceph-mon[125440]: pgmap v1287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:35.609+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:37:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:35.609+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:37:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:35.609+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:37:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:35.609+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:37:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:35.609+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:37:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:36 smithi136 ceph-mon[125702]: pgmap v1288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:36 smithi057 ceph-mon[92072]: pgmap v1288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:36 smithi122 ceph-mon[125440]: pgmap v1288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:38 smithi136 ceph-mon[125702]: pgmap v1289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:38 smithi057 ceph-mon[92072]: pgmap v1289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:38 smithi122 ceph-mon[125440]: pgmap v1289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:40 smithi136 ceph-mon[125702]: pgmap v1290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:40 smithi057 ceph-mon[92072]: pgmap v1290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:40 smithi122 ceph-mon[125440]: pgmap v1290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:42 smithi136 ceph-mon[125702]: pgmap v1291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:42 smithi057 ceph-mon[92072]: pgmap v1291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:42 smithi122 ceph-mon[125440]: pgmap v1291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:44 smithi136 ceph-mon[125702]: pgmap v1292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:44 smithi057 ceph-mon[92072]: pgmap v1292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:44 smithi122 ceph-mon[125440]: pgmap v1292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:46 smithi136 ceph-mon[125702]: pgmap v1293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:46 smithi057 ceph-mon[92072]: pgmap v1293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:46 smithi122 ceph-mon[125440]: pgmap v1293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:48 smithi136 ceph-mon[125702]: pgmap v1294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:48 smithi057 ceph-mon[92072]: pgmap v1294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:48 smithi122 ceph-mon[125440]: pgmap v1294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:50.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:50.619+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:37:50.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:50.619+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:37:50.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:50.619+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:37:50.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:50.619+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:37:50.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:37:50.619+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:37:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:50 smithi136 ceph-mon[125702]: pgmap v1295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:50 smithi057 ceph-mon[92072]: pgmap v1295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:50 smithi122 ceph-mon[125440]: pgmap v1295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:52 smithi136 ceph-mon[125702]: pgmap v1296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:52 smithi057 ceph-mon[92072]: pgmap v1296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:52 smithi122 ceph-mon[125440]: pgmap v1296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:37:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:54 smithi136 ceph-mon[125702]: pgmap v1297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:54 smithi057 ceph-mon[92072]: pgmap v1297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:54 smithi122 ceph-mon[125440]: pgmap v1297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:56 smithi136 ceph-mon[125702]: pgmap v1298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:56 smithi057 ceph-mon[92072]: pgmap v1298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:56 smithi122 ceph-mon[125440]: pgmap v1298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:37:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:37:58 smithi136 ceph-mon[125702]: pgmap v1299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:37:58 smithi057 ceph-mon[92072]: pgmap v1299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:37:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:37:58 smithi122 ceph-mon[125440]: pgmap v1299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:00 smithi136 ceph-mon[125702]: pgmap v1300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:38:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:00 smithi057 ceph-mon[92072]: pgmap v1300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:38:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:00 smithi122 ceph-mon[125440]: pgmap v1300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:38:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:02 smithi136 ceph-mon[125702]: pgmap v1301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:38:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:02 smithi057 ceph-mon[92072]: pgmap v1301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:38:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:02 smithi122 ceph-mon[125440]: pgmap v1301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:38:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:04 smithi136 ceph-mon[125702]: pgmap v1302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:38:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:04 smithi057 ceph-mon[92072]: pgmap v1302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:38:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:04 smithi122 ceph-mon[125440]: pgmap v1302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T11:38:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:05.635+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:38:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:05.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:38:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:05.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:38:05.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:05.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:38:05.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:05.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:38:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:06 smithi136 ceph-mon[125702]: pgmap v1303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:38:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:06 smithi057 ceph-mon[92072]: pgmap v1303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:38:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:06 smithi122 ceph-mon[125440]: pgmap v1303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:38:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:08.693+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:38:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:08.693+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:38:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:08.693+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 23 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:38:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:08.693+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 22 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:38:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:08 smithi136 ceph-mon[125702]: pgmap v1304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:38:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:08 smithi057 ceph-mon[92072]: pgmap v1304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:38:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:08 smithi122 ceph-mon[125440]: pgmap v1304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:38:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:10 smithi136 ceph-mon[125702]: pgmap v1305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:38:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:10 smithi057 ceph-mon[92072]: pgmap v1305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:38:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:10 smithi122 ceph-mon[125440]: pgmap v1305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:38:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:11 smithi136 ceph-mon[125702]: osdmap e156: 12 total, 12 up, 12 in 2023-03-02T11:38:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:11 smithi057 ceph-mon[92072]: osdmap e156: 12 total, 12 up, 12 in 2023-03-02T11:38:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:11 smithi122 ceph-mon[125440]: osdmap e156: 12 total, 12 up, 12 in 2023-03-02T11:38:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:12 smithi136 ceph-mon[125702]: pgmap v1307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:38:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:12 smithi057 ceph-mon[92072]: pgmap v1307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:38:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:12 smithi122 ceph-mon[125440]: pgmap v1307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:38:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:14 smithi136 ceph-mon[125702]: pgmap v1308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:38:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:14 smithi136 ceph-mon[125702]: osdmap e157: 12 total, 12 up, 12 in 2023-03-02T11:38:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:14 smithi057 ceph-mon[92072]: pgmap v1308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:38:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:14 smithi057 ceph-mon[92072]: osdmap e157: 12 total, 12 up, 12 in 2023-03-02T11:38:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:14 smithi122 ceph-mon[125440]: pgmap v1308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:38:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:14 smithi122 ceph-mon[125440]: osdmap e157: 12 total, 12 up, 12 in 2023-03-02T11:38:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:16 smithi136 ceph-mon[125702]: pgmap v1310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:38:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:16 smithi057 ceph-mon[92072]: pgmap v1310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:38:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:16 smithi122 ceph-mon[125440]: pgmap v1310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:38:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:18 smithi136 ceph-mon[125702]: pgmap v1311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:38:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:18 smithi057 ceph-mon[92072]: pgmap v1311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:38:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:18 smithi122 ceph-mon[125440]: pgmap v1311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:38:20.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:20.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:38:20.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:20.648+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:38:20.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:20.648+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:38:20.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:20.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:38:20.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:20.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:38:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:20 smithi136 ceph-mon[125702]: pgmap v1312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T11:38:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:20 smithi057 ceph-mon[92072]: pgmap v1312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T11:38:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:20 smithi122 ceph-mon[125440]: pgmap v1312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T11:38:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:22 smithi136 ceph-mon[125702]: pgmap v1313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:38:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:22 smithi057 ceph-mon[92072]: pgmap v1313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:38:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:22 smithi122 ceph-mon[125440]: pgmap v1313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:38:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:24 smithi057 ceph-mon[92072]: pgmap v1314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:38:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:24 smithi122 ceph-mon[125440]: pgmap v1314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:38:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:24 smithi136 ceph-mon[125702]: pgmap v1314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:38:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:26 smithi057 ceph-mon[92072]: pgmap v1315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:38:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:38:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:26 smithi122 ceph-mon[125440]: pgmap v1315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:38:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:38:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:26 smithi136 ceph-mon[125702]: pgmap v1315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:38:27.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:38:28.870 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:28 smithi136 ceph-mon[125702]: pgmap v1316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:38:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:28 smithi057 ceph-mon[92072]: pgmap v1316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:38:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:28 smithi122 ceph-mon[125440]: pgmap v1316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:38:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:29 smithi136 ceph-mon[125702]: pgmap v1317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:30.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:38:30.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:30 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:38:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:29 smithi057 ceph-mon[92072]: pgmap v1317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:30 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:38:30.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:30 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:38:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: pgmap v1317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:30.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:38:30.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:30 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:38:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:31 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:38:31.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:31 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:38:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:31 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:38:31.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:31 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:38:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:31 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:38:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:31 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:38:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: pgmap v1318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:38:32.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:38:32.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: pgmap v1318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:38:32.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:38:32.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: pgmap v1318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:38:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:38:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:38:32.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:38:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:33 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:38:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:33 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:38:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:33 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:38:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:33 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:38:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:33 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:38:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:33 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:38:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:34 smithi136 ceph-mon[125702]: pgmap v1319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:34 smithi057 ceph-mon[92072]: pgmap v1319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:34 smithi122 ceph-mon[125440]: pgmap v1319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:35.664 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:35.663+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:38:35.664 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:35.663+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:38:35.665 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:35.663+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:38:35.665 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:35.663+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:38:35.665 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:35.663+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:38:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:36 smithi057 ceph-mon[92072]: pgmap v1320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:36 smithi122 ceph-mon[125440]: pgmap v1320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:36 smithi136 ceph-mon[125702]: pgmap v1320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:38 smithi057 ceph-mon[92072]: pgmap v1321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:38 smithi122 ceph-mon[125440]: pgmap v1321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:38 smithi136 ceph-mon[125702]: pgmap v1321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:40 smithi057 ceph-mon[92072]: pgmap v1322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:40 smithi122 ceph-mon[125440]: pgmap v1322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:40 smithi136 ceph-mon[125702]: pgmap v1322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:42 smithi057 ceph-mon[92072]: pgmap v1323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:42 smithi122 ceph-mon[125440]: pgmap v1323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:42 smithi136 ceph-mon[125702]: pgmap v1323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:44 smithi057 ceph-mon[92072]: pgmap v1324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:44 smithi122 ceph-mon[125440]: pgmap v1324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:44 smithi136 ceph-mon[125702]: pgmap v1324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:46 smithi057 ceph-mon[92072]: pgmap v1325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:46 smithi122 ceph-mon[125440]: pgmap v1325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:46 smithi136 ceph-mon[125702]: pgmap v1325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:48 smithi057 ceph-mon[92072]: pgmap v1326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:48 smithi122 ceph-mon[125440]: pgmap v1326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:48 smithi136 ceph-mon[125702]: pgmap v1326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:50.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:38:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:50.678+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:38:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:50.678+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:38:50.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:50.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:38:50.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:38:50.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:38:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:50 smithi057 ceph-mon[92072]: pgmap v1327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:50 smithi122 ceph-mon[125440]: pgmap v1327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:50 smithi136 ceph-mon[125702]: pgmap v1327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:52 smithi057 ceph-mon[92072]: pgmap v1328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:52 smithi122 ceph-mon[125440]: pgmap v1328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:52 smithi136 ceph-mon[125702]: pgmap v1328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:54 smithi057 ceph-mon[92072]: pgmap v1329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:54 smithi122 ceph-mon[125440]: pgmap v1329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:54 smithi136 ceph-mon[125702]: pgmap v1329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:56 smithi057 ceph-mon[92072]: pgmap v1330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:56 smithi122 ceph-mon[125440]: pgmap v1330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:56 smithi136 ceph-mon[125702]: pgmap v1330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:38:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:38:58 smithi057 ceph-mon[92072]: pgmap v1331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:38:58 smithi122 ceph-mon[125440]: pgmap v1331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:38:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:38:58 smithi136 ceph-mon[125702]: pgmap v1331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:00 smithi057 ceph-mon[92072]: pgmap v1332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:00 smithi122 ceph-mon[125440]: pgmap v1332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:00 smithi136 ceph-mon[125702]: pgmap v1332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:02 smithi057 ceph-mon[92072]: pgmap v1333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:02 smithi122 ceph-mon[125440]: pgmap v1333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:02 smithi136 ceph-mon[125702]: pgmap v1333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:04 smithi057 ceph-mon[92072]: pgmap v1334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:39:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:04 smithi122 ceph-mon[125440]: pgmap v1334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:39:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:04 smithi136 ceph-mon[125702]: pgmap v1334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:39:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:05.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:39:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:05.687+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:39:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:05.687+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:39:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:05.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:39:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:05.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:39:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:06 smithi057 ceph-mon[92072]: pgmap v1335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:39:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:06 smithi122 ceph-mon[125440]: pgmap v1335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:39:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:06 smithi136 ceph-mon[125702]: pgmap v1335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:39:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:08 smithi057 ceph-mon[92072]: pgmap v1336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:39:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:08 smithi122 ceph-mon[125440]: pgmap v1336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:39:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:08 smithi136 ceph-mon[125702]: pgmap v1336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:39:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:10 smithi057 ceph-mon[92072]: pgmap v1337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:39:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:10 smithi122 ceph-mon[125440]: pgmap v1337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:39:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:10 smithi136 ceph-mon[125702]: pgmap v1337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:39:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:11 smithi122 ceph-mon[125440]: osdmap e158: 12 total, 12 up, 12 in 2023-03-02T11:39:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:11 smithi136 ceph-mon[125702]: osdmap e158: 12 total, 12 up, 12 in 2023-03-02T11:39:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:11 smithi057 ceph-mon[92072]: osdmap e158: 12 total, 12 up, 12 in 2023-03-02T11:39:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:12 smithi122 ceph-mon[125440]: pgmap v1339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:39:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:12 smithi136 ceph-mon[125702]: pgmap v1339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:39:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:12 smithi057 ceph-mon[92072]: pgmap v1339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:39:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:14 smithi122 ceph-mon[125440]: pgmap v1340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:39:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:14 smithi122 ceph-mon[125440]: osdmap e159: 12 total, 12 up, 12 in 2023-03-02T11:39:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:14 smithi136 ceph-mon[125702]: pgmap v1340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:39:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:14 smithi136 ceph-mon[125702]: osdmap e159: 12 total, 12 up, 12 in 2023-03-02T11:39:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:14 smithi057 ceph-mon[92072]: pgmap v1340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:39:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:14 smithi057 ceph-mon[92072]: osdmap e159: 12 total, 12 up, 12 in 2023-03-02T11:39:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:16 smithi136 ceph-mon[125702]: pgmap v1342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:39:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:16 smithi057 ceph-mon[92072]: pgmap v1342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:39:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:16 smithi122 ceph-mon[125440]: pgmap v1342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:39:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:18 smithi136 ceph-mon[125702]: pgmap v1343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:39:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:18 smithi057 ceph-mon[92072]: pgmap v1343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:39:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:18 smithi122 ceph-mon[125440]: pgmap v1343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:39:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:20.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:39:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:20.702+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:39:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:20.702+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:39:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:20.702+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:39:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:20.702+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:39:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:20 smithi136 ceph-mon[125702]: pgmap v1344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T11:39:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:20 smithi057 ceph-mon[92072]: pgmap v1344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T11:39:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:20 smithi122 ceph-mon[125440]: pgmap v1344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T11:39:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:22 smithi136 ceph-mon[125702]: pgmap v1345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:39:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:22 smithi057 ceph-mon[92072]: pgmap v1345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:39:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:22 smithi122 ceph-mon[125440]: pgmap v1345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:39:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:24 smithi136 ceph-mon[125702]: pgmap v1346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:39:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:24 smithi057 ceph-mon[92072]: pgmap v1346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:39:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:24 smithi122 ceph-mon[125440]: pgmap v1346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:39:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:26 smithi136 ceph-mon[125702]: pgmap v1347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:39:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:26 smithi057 ceph-mon[92072]: pgmap v1347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:39:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:26 smithi122 ceph-mon[125440]: pgmap v1347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:39:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:28 smithi136 ceph-mon[125702]: pgmap v1348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:39:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:28 smithi057 ceph-mon[92072]: pgmap v1348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:39:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:28 smithi122 ceph-mon[125440]: pgmap v1348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:39:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:30 smithi136 ceph-mon[125702]: pgmap v1349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:30 smithi057 ceph-mon[92072]: pgmap v1349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:30 smithi122 ceph-mon[125440]: pgmap v1349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:32 smithi136 ceph-mon[125702]: pgmap v1350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:39:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:32 smithi057 ceph-mon[92072]: pgmap v1350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:39:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:32 smithi122 ceph-mon[125440]: pgmap v1350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:39:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:39:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:39:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:39:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:39:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:39:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:39:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:39:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:39:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:39:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:34 smithi057 ceph-mon[92072]: pgmap v1351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:35.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:34 smithi122 ceph-mon[125440]: pgmap v1351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:34 smithi136 ceph-mon[125702]: pgmap v1351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:35.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:35.715+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:39:35.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:35.715+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:39:35.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:35.715+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:39:35.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:35.715+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:39:35.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:35.715+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:39:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:36 smithi057 ceph-mon[92072]: pgmap v1352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:37.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:36 smithi122 ceph-mon[125440]: pgmap v1352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:36 smithi136 ceph-mon[125702]: pgmap v1352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:38 smithi057 ceph-mon[92072]: pgmap v1353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:39.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:38 smithi122 ceph-mon[125440]: pgmap v1353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:38 smithi136 ceph-mon[125702]: pgmap v1353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:40 smithi057 ceph-mon[92072]: pgmap v1354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:40 smithi122 ceph-mon[125440]: pgmap v1354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:40 smithi136 ceph-mon[125702]: pgmap v1354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:42 smithi057 ceph-mon[92072]: pgmap v1355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:42 smithi122 ceph-mon[125440]: pgmap v1355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:42 smithi136 ceph-mon[125702]: pgmap v1355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:44 smithi057 ceph-mon[92072]: pgmap v1356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:44 smithi122 ceph-mon[125440]: pgmap v1356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:44 smithi136 ceph-mon[125702]: pgmap v1356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:46 smithi057 ceph-mon[92072]: pgmap v1357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:46 smithi122 ceph-mon[125440]: pgmap v1357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:46 smithi136 ceph-mon[125702]: pgmap v1357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:48 smithi122 ceph-mon[125440]: pgmap v1358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:48 smithi136 ceph-mon[125702]: pgmap v1358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:48 smithi057 ceph-mon[92072]: pgmap v1358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:50.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:39:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:50.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:39:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:50.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:39:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:50.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:39:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:39:50.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:39:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:50 smithi122 ceph-mon[125440]: pgmap v1359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:50 smithi136 ceph-mon[125702]: pgmap v1359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:50 smithi057 ceph-mon[92072]: pgmap v1359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:52 smithi122 ceph-mon[125440]: pgmap v1360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:52 smithi136 ceph-mon[125702]: pgmap v1360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:52 smithi057 ceph-mon[92072]: pgmap v1360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:54 smithi136 ceph-mon[125702]: pgmap v1361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:54 smithi057 ceph-mon[92072]: pgmap v1361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:54 smithi122 ceph-mon[125440]: pgmap v1361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:56 smithi136 ceph-mon[125702]: pgmap v1362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:56 smithi057 ceph-mon[92072]: pgmap v1362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:56 smithi122 ceph-mon[125440]: pgmap v1362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:39:59.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:39:58 smithi136 ceph-mon[125702]: pgmap v1363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:39:58 smithi057 ceph-mon[92072]: pgmap v1363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:39:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:39:58 smithi122 ceph-mon[125440]: pgmap v1363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:00 smithi136 ceph-mon[125702]: pgmap v1364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T11:40:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:00 smithi057 ceph-mon[92072]: pgmap v1364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T11:40:01.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:00 smithi122 ceph-mon[125440]: pgmap v1364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:01.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T11:40:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:02 smithi136 ceph-mon[125702]: pgmap v1365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:02 smithi057 ceph-mon[92072]: pgmap v1365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:02 smithi122 ceph-mon[125440]: pgmap v1365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:04 smithi136 ceph-mon[125702]: pgmap v1366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:40:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:04 smithi057 ceph-mon[92072]: pgmap v1366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:40:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:04 smithi122 ceph-mon[125440]: pgmap v1366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:40:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:05.744+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:40:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:05.744+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:40:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:05.744+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:40:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:05.744+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:40:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:05.744+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:40:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:06 smithi136 ceph-mon[125702]: pgmap v1367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:40:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:06 smithi057 ceph-mon[92072]: pgmap v1367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:40:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:06 smithi122 ceph-mon[125440]: pgmap v1367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:40:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:07 smithi136 ceph-mon[125702]: pgmap v1368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:40:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:07 smithi057 ceph-mon[92072]: pgmap v1368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:40:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:07 smithi122 ceph-mon[125440]: pgmap v1368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:40:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:10 smithi057 ceph-mon[92072]: pgmap v1369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:40:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:10 smithi122 ceph-mon[125440]: pgmap v1369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:40:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:10 smithi136 ceph-mon[125702]: pgmap v1369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:40:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:11 smithi057 ceph-mon[92072]: osdmap e160: 12 total, 12 up, 12 in 2023-03-02T11:40:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:11 smithi122 ceph-mon[125440]: osdmap e160: 12 total, 12 up, 12 in 2023-03-02T11:40:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:11 smithi136 ceph-mon[125702]: osdmap e160: 12 total, 12 up, 12 in 2023-03-02T11:40:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:12 smithi057 ceph-mon[92072]: pgmap v1371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:40:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:12 smithi122 ceph-mon[125440]: pgmap v1371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:40:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:12 smithi136 ceph-mon[125702]: pgmap v1371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:40:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:14 smithi057 ceph-mon[92072]: pgmap v1372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:40:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:14 smithi057 ceph-mon[92072]: osdmap e161: 12 total, 12 up, 12 in 2023-03-02T11:40:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:14 smithi122 ceph-mon[125440]: pgmap v1372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:40:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:14 smithi122 ceph-mon[125440]: osdmap e161: 12 total, 12 up, 12 in 2023-03-02T11:40:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:14 smithi136 ceph-mon[125702]: pgmap v1372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:40:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:14 smithi136 ceph-mon[125702]: osdmap e161: 12 total, 12 up, 12 in 2023-03-02T11:40:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:16 smithi057 ceph-mon[92072]: pgmap v1374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:40:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:16 smithi122 ceph-mon[125440]: pgmap v1374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:40:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:16 smithi136 ceph-mon[125702]: pgmap v1374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:40:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:18 smithi057 ceph-mon[92072]: pgmap v1375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:40:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:18 smithi122 ceph-mon[125440]: pgmap v1375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:40:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:18 smithi136 ceph-mon[125702]: pgmap v1375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:40:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:20 smithi057 ceph-mon[92072]: pgmap v1376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:40:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:20 smithi122 ceph-mon[125440]: pgmap v1376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:40:20.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:20.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:40:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:20.755+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:40:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:20.755+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:40:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:20.755+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:40:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:20.755+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:40:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:20 smithi136 ceph-mon[125702]: pgmap v1376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:40:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:22 smithi122 ceph-mon[125440]: pgmap v1377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:40:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:22 smithi136 ceph-mon[125702]: pgmap v1377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:40:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:22 smithi057 ceph-mon[92072]: pgmap v1377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:40:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:23.710+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:40:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:23.710+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:40:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:23.711+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 23 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:40:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:23.711+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 24 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:40:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:24 smithi122 ceph-mon[125440]: pgmap v1378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:40:24.722 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:24 smithi136 ceph-mon[125702]: pgmap v1378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:40:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:24 smithi057 ceph-mon[92072]: pgmap v1378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:40:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:26 smithi122 ceph-mon[125440]: pgmap v1379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:40:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:26 smithi136 ceph-mon[125702]: pgmap v1379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:40:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:26 smithi057 ceph-mon[92072]: pgmap v1379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:40:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:28 smithi136 ceph-mon[125702]: pgmap v1380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:40:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:28 smithi057 ceph-mon[92072]: pgmap v1380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:40:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:28 smithi122 ceph-mon[125440]: pgmap v1380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:40:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:30 smithi136 ceph-mon[125702]: pgmap v1381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:30 smithi057 ceph-mon[92072]: pgmap v1381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:30 smithi122 ceph-mon[125440]: pgmap v1381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:32 smithi136 ceph-mon[125702]: pgmap v1382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:32 smithi057 ceph-mon[92072]: pgmap v1382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:32 smithi122 ceph-mon[125440]: pgmap v1382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:40:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:40:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:40:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:34 smithi057 ceph-mon[92072]: pgmap v1383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:40:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:40:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:40:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:40:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:40:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:34 smithi122 ceph-mon[125440]: pgmap v1383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:40:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:40:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:40:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:40:34.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:40:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:34 smithi136 ceph-mon[125702]: pgmap v1383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:40:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:40:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:40:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:40:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:40:35.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:35.770+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:40:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:35.771+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:40:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:35.771+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:40:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:35.771+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:40:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:35.771+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:40:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:36 smithi057 ceph-mon[92072]: pgmap v1384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:36 smithi122 ceph-mon[125440]: pgmap v1384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:36 smithi136 ceph-mon[125702]: pgmap v1384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:38 smithi057 ceph-mon[92072]: pgmap v1385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:38 smithi122 ceph-mon[125440]: pgmap v1385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:38 smithi136 ceph-mon[125702]: pgmap v1385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:40 smithi057 ceph-mon[92072]: pgmap v1386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:40 smithi122 ceph-mon[125440]: pgmap v1386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:40 smithi136 ceph-mon[125702]: pgmap v1386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:42 smithi057 ceph-mon[92072]: pgmap v1387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:42 smithi122 ceph-mon[125440]: pgmap v1387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:42 smithi136 ceph-mon[125702]: pgmap v1387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:44 smithi057 ceph-mon[92072]: pgmap v1388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:44 smithi122 ceph-mon[125440]: pgmap v1388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:44 smithi136 ceph-mon[125702]: pgmap v1388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:46 smithi057 ceph-mon[92072]: pgmap v1389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:46 smithi122 ceph-mon[125440]: pgmap v1389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:46 smithi136 ceph-mon[125702]: pgmap v1389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:48 smithi057 ceph-mon[92072]: pgmap v1390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:48 smithi122 ceph-mon[125440]: pgmap v1390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:48 smithi136 ceph-mon[125702]: pgmap v1390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:50.786+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:40:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:50.787+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:40:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:50.787+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:40:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:50.787+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:40:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:40:50.787+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:40:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:50 smithi057 ceph-mon[92072]: pgmap v1391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:50 smithi122 ceph-mon[125440]: pgmap v1391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:50 smithi136 ceph-mon[125702]: pgmap v1391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:52 smithi057 ceph-mon[92072]: pgmap v1392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:52 smithi122 ceph-mon[125440]: pgmap v1392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:52 smithi136 ceph-mon[125702]: pgmap v1392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:54 smithi057 ceph-mon[92072]: pgmap v1393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:54 smithi122 ceph-mon[125440]: pgmap v1393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:54 smithi136 ceph-mon[125702]: pgmap v1393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:56 smithi057 ceph-mon[92072]: pgmap v1394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:56 smithi122 ceph-mon[125440]: pgmap v1394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:56 smithi136 ceph-mon[125702]: pgmap v1394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:40:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:40:58 smithi057 ceph-mon[92072]: pgmap v1395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:40:58 smithi122 ceph-mon[125440]: pgmap v1395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:40:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:40:58 smithi136 ceph-mon[125702]: pgmap v1395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:00 smithi057 ceph-mon[92072]: pgmap v1396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:00 smithi122 ceph-mon[125440]: pgmap v1396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:00 smithi136 ceph-mon[125702]: pgmap v1396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:02 smithi057 ceph-mon[92072]: pgmap v1397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:02 smithi122 ceph-mon[125440]: pgmap v1397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:02 smithi136 ceph-mon[125702]: pgmap v1397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:04 smithi057 ceph-mon[92072]: pgmap v1398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:41:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:04 smithi122 ceph-mon[125440]: pgmap v1398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:41:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:04 smithi136 ceph-mon[125702]: pgmap v1398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:41:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:05.793+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:41:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:05.793+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:41:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:05.793+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:41:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:05.793+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:41:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:05.793+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:41:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:06 smithi057 ceph-mon[92072]: pgmap v1399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:41:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:06 smithi122 ceph-mon[125440]: pgmap v1399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:41:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:06 smithi136 ceph-mon[125702]: pgmap v1399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:41:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:08.717+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:41:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:08.717+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:41:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:08.717+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 24 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:41:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:08.717+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 25 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:41:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:08 smithi122 ceph-mon[125440]: pgmap v1400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:41:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:08 smithi136 ceph-mon[125702]: pgmap v1400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:41:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:08 smithi057 ceph-mon[92072]: pgmap v1400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:41:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:10 smithi122 ceph-mon[125440]: pgmap v1401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:41:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:10 smithi136 ceph-mon[125702]: pgmap v1401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:41:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:10 smithi057 ceph-mon[92072]: pgmap v1401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:41:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:11 smithi136 ceph-mon[125702]: osdmap e162: 12 total, 12 up, 12 in 2023-03-02T11:41:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:11 smithi057 ceph-mon[92072]: osdmap e162: 12 total, 12 up, 12 in 2023-03-02T11:41:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:11 smithi122 ceph-mon[125440]: osdmap e162: 12 total, 12 up, 12 in 2023-03-02T11:41:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:12 smithi136 ceph-mon[125702]: pgmap v1403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:41:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:12 smithi057 ceph-mon[92072]: pgmap v1403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:41:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:12 smithi122 ceph-mon[125440]: pgmap v1403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:41:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:14 smithi136 ceph-mon[125702]: pgmap v1404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:41:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:14 smithi136 ceph-mon[125702]: osdmap e163: 12 total, 12 up, 12 in 2023-03-02T11:41:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:14 smithi057 ceph-mon[92072]: pgmap v1404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:41:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:14 smithi057 ceph-mon[92072]: osdmap e163: 12 total, 12 up, 12 in 2023-03-02T11:41:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:14 smithi122 ceph-mon[125440]: pgmap v1404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:41:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:14 smithi122 ceph-mon[125440]: osdmap e163: 12 total, 12 up, 12 in 2023-03-02T11:41:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:16 smithi136 ceph-mon[125702]: pgmap v1406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:41:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:16 smithi057 ceph-mon[92072]: pgmap v1406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:41:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:16 smithi122 ceph-mon[125440]: pgmap v1406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:41:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:18 smithi136 ceph-mon[125702]: pgmap v1407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:41:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:18 smithi057 ceph-mon[92072]: pgmap v1407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:41:19.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:18 smithi122 ceph-mon[125440]: pgmap v1407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:41:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:20.804+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:41:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:20.805+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:41:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:20.805+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:41:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:20.805+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:41:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:20.805+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:41:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:20 smithi136 ceph-mon[125702]: pgmap v1408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T11:41:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:20 smithi057 ceph-mon[92072]: pgmap v1408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T11:41:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:20 smithi122 ceph-mon[125440]: pgmap v1408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T11:41:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:22 smithi136 ceph-mon[125702]: pgmap v1409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:41:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:22 smithi057 ceph-mon[92072]: pgmap v1409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:41:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:22 smithi122 ceph-mon[125440]: pgmap v1409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:41:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:24 smithi136 ceph-mon[125702]: pgmap v1410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:41:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:24 smithi057 ceph-mon[92072]: pgmap v1410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:41:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:24 smithi122 ceph-mon[125440]: pgmap v1410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:41:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:26 smithi136 ceph-mon[125702]: pgmap v1411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:41:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:26 smithi057 ceph-mon[92072]: pgmap v1411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:41:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:26 smithi122 ceph-mon[125440]: pgmap v1411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:41:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:28 smithi136 ceph-mon[125702]: pgmap v1412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:41:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:28 smithi057 ceph-mon[92072]: pgmap v1412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:41:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:28 smithi122 ceph-mon[125440]: pgmap v1412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:41:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:30 smithi136 ceph-mon[125702]: pgmap v1413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:30 smithi057 ceph-mon[92072]: pgmap v1413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:30 smithi122 ceph-mon[125440]: pgmap v1413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:32 smithi136 ceph-mon[125702]: pgmap v1414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:32 smithi057 ceph-mon[92072]: pgmap v1414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:32 smithi122 ceph-mon[125440]: pgmap v1414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:34 smithi136 ceph-mon[125702]: pgmap v1415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:41:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:34 smithi057 ceph-mon[92072]: pgmap v1415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:41:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:34 smithi122 ceph-mon[125440]: pgmap v1415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:35.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:41:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:35.820+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:41:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:35.821+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:41:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:35.821+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:41:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:35.821+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:41:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:35.821+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:41:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:36 smithi136 ceph-mon[125702]: pgmap v1416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:36 smithi057 ceph-mon[92072]: pgmap v1416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:36 smithi122 ceph-mon[125440]: pgmap v1416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:41:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:41:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:41:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:41:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:41:37.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:41:37.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:41:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:38 smithi057 ceph-mon[92072]: pgmap v1417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:38 smithi122 ceph-mon[125440]: pgmap v1417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:38 smithi136 ceph-mon[125702]: pgmap v1417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:40 smithi057 ceph-mon[92072]: pgmap v1418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:40 smithi122 ceph-mon[125440]: pgmap v1418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:40 smithi136 ceph-mon[125702]: pgmap v1418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:42 smithi057 ceph-mon[92072]: pgmap v1419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:42.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:42 smithi122 ceph-mon[125440]: pgmap v1419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:42 smithi136 ceph-mon[125702]: pgmap v1419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:44 smithi122 ceph-mon[125440]: pgmap v1420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:44 smithi136 ceph-mon[125702]: pgmap v1420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:44 smithi057 ceph-mon[92072]: pgmap v1420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:46 smithi122 ceph-mon[125440]: pgmap v1421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:46 smithi136 ceph-mon[125702]: pgmap v1421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:46 smithi057 ceph-mon[92072]: pgmap v1421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:48 smithi122 ceph-mon[125440]: pgmap v1422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:48 smithi136 ceph-mon[125702]: pgmap v1422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:48 smithi057 ceph-mon[92072]: pgmap v1422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:50.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:50.833+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:50.833+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:50.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:41:50.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:41:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:50 smithi136 ceph-mon[125702]: pgmap v1423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:50 smithi057 ceph-mon[92072]: pgmap v1423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:50 smithi122 ceph-mon[125440]: pgmap v1423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:52 smithi136 ceph-mon[125702]: pgmap v1424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:52 smithi057 ceph-mon[92072]: pgmap v1424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:52 smithi122 ceph-mon[125440]: pgmap v1424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:41:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:54 smithi136 ceph-mon[125702]: pgmap v1425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:54 smithi057 ceph-mon[92072]: pgmap v1425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:54 smithi122 ceph-mon[125440]: pgmap v1425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:56 smithi136 ceph-mon[125702]: pgmap v1426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:41:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:56 smithi057 ceph-mon[92072]: pgmap v1426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:41:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:56 smithi122 ceph-mon[125440]: pgmap v1426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:41:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:41:58 smithi136 ceph-mon[125702]: pgmap v1427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:41:58 smithi057 ceph-mon[92072]: pgmap v1427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:41:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:41:58 smithi122 ceph-mon[125440]: pgmap v1427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:00 smithi136 ceph-mon[125702]: pgmap v1428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:42:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:00 smithi057 ceph-mon[92072]: pgmap v1428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:42:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:00 smithi122 ceph-mon[125440]: pgmap v1428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:42:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:02 smithi136 ceph-mon[125702]: pgmap v1429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:42:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:02 smithi057 ceph-mon[92072]: pgmap v1429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:42:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:02 smithi122 ceph-mon[125440]: pgmap v1429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:42:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:04 smithi136 ceph-mon[125702]: pgmap v1430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:42:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:04 smithi057 ceph-mon[92072]: pgmap v1430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:42:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:04 smithi122 ceph-mon[125440]: pgmap v1430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:42:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:05.848+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:42:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:05.848+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:42:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:05.848+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:42:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:05.848+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:42:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:05.848+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:42:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:06 smithi136 ceph-mon[125702]: pgmap v1431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:42:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:06 smithi057 ceph-mon[92072]: pgmap v1431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:42:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:06 smithi122 ceph-mon[125440]: pgmap v1431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:42:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:08 smithi136 ceph-mon[125702]: pgmap v1432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:42:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:08 smithi057 ceph-mon[92072]: pgmap v1432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:42:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:08 smithi122 ceph-mon[125440]: pgmap v1432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:42:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:10 smithi136 ceph-mon[125702]: pgmap v1433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:42:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:10 smithi057 ceph-mon[92072]: pgmap v1433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:42:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:10 smithi122 ceph-mon[125440]: pgmap v1433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:42:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:11 smithi136 ceph-mon[125702]: osdmap e164: 12 total, 12 up, 12 in 2023-03-02T11:42:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:11 smithi057 ceph-mon[92072]: osdmap e164: 12 total, 12 up, 12 in 2023-03-02T11:42:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:11 smithi122 ceph-mon[125440]: osdmap e164: 12 total, 12 up, 12 in 2023-03-02T11:42:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:12 smithi136 ceph-mon[125702]: pgmap v1435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:42:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:12 smithi057 ceph-mon[92072]: pgmap v1435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:42:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:12 smithi122 ceph-mon[125440]: pgmap v1435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:42:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:14 smithi136 ceph-mon[125702]: pgmap v1436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:42:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:14 smithi136 ceph-mon[125702]: osdmap e165: 12 total, 12 up, 12 in 2023-03-02T11:42:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:14 smithi057 ceph-mon[92072]: pgmap v1436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:42:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:14 smithi057 ceph-mon[92072]: osdmap e165: 12 total, 12 up, 12 in 2023-03-02T11:42:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:14 smithi122 ceph-mon[125440]: pgmap v1436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:42:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:14 smithi122 ceph-mon[125440]: osdmap e165: 12 total, 12 up, 12 in 2023-03-02T11:42:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:16 smithi136 ceph-mon[125702]: pgmap v1438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:42:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:16 smithi057 ceph-mon[92072]: pgmap v1438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:42:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:16 smithi122 ceph-mon[125440]: pgmap v1438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:42:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:18 smithi136 ceph-mon[125702]: pgmap v1439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:42:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:18 smithi057 ceph-mon[92072]: pgmap v1439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:42:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:18 smithi122 ceph-mon[125440]: pgmap v1439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:42:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:20 smithi136 ceph-mon[125702]: pgmap v1440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T11:42:20.861 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:20.860+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:42:20.861 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:20.860+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:42:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:20.860+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:42:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:20.860+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:42:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:20.860+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:42:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:20 smithi057 ceph-mon[92072]: pgmap v1440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T11:42:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:20 smithi122 ceph-mon[125440]: pgmap v1440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T11:42:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:22 smithi136 ceph-mon[125702]: pgmap v1441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:42:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:22 smithi057 ceph-mon[92072]: pgmap v1441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:42:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:22 smithi122 ceph-mon[125440]: pgmap v1441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:42:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:24 smithi136 ceph-mon[125702]: pgmap v1442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:42:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:24 smithi057 ceph-mon[92072]: pgmap v1442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:42:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:24 smithi122 ceph-mon[125440]: pgmap v1442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:42:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:26 smithi136 ceph-mon[125702]: pgmap v1443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:42:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:26 smithi057 ceph-mon[92072]: pgmap v1443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:42:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:26 smithi122 ceph-mon[125440]: pgmap v1443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:42:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:28 smithi136 ceph-mon[125702]: pgmap v1444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:42:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:28 smithi057 ceph-mon[92072]: pgmap v1444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:42:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:28 smithi122 ceph-mon[125440]: pgmap v1444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:42:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:30 smithi136 ceph-mon[125702]: pgmap v1445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:30 smithi057 ceph-mon[92072]: pgmap v1445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:30 smithi122 ceph-mon[125440]: pgmap v1445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:32 smithi136 ceph-mon[125702]: pgmap v1446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:32 smithi057 ceph-mon[92072]: pgmap v1446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:32 smithi122 ceph-mon[125440]: pgmap v1446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:34 smithi136 ceph-mon[125702]: pgmap v1447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:34 smithi057 ceph-mon[92072]: pgmap v1447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:34 smithi122 ceph-mon[125440]: pgmap v1447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:35.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:42:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:35.866+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:42:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:35.866+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:42:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:35.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:42:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:35.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:42:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:36 smithi136 ceph-mon[125702]: pgmap v1448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:36 smithi057 ceph-mon[92072]: pgmap v1448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:36 smithi122 ceph-mon[125440]: pgmap v1448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:42:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:42:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:42:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:38 smithi136 ceph-mon[125702]: pgmap v1449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:42:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:42:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:42:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:38 smithi057 ceph-mon[92072]: pgmap v1449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:42:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:42:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:42:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:38 smithi122 ceph-mon[125440]: pgmap v1449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:42:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:42:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:42:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:40 smithi136 ceph-mon[125702]: pgmap v1450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:40 smithi057 ceph-mon[92072]: pgmap v1450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:40 smithi122 ceph-mon[125440]: pgmap v1450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:42 smithi136 ceph-mon[125702]: pgmap v1451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:42 smithi057 ceph-mon[92072]: pgmap v1451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:42 smithi122 ceph-mon[125440]: pgmap v1451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:44 smithi057 ceph-mon[92072]: pgmap v1452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:44 smithi122 ceph-mon[125440]: pgmap v1452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:44 smithi136 ceph-mon[125702]: pgmap v1452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:46 smithi057 ceph-mon[92072]: pgmap v1453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:46 smithi122 ceph-mon[125440]: pgmap v1453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:46 smithi136 ceph-mon[125702]: pgmap v1453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:48 smithi057 ceph-mon[92072]: pgmap v1454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:48 smithi122 ceph-mon[125440]: pgmap v1454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:48 smithi136 ceph-mon[125702]: pgmap v1454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:50.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:50.879+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:42:50.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:50.879+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:42:50.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:50.879+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:42:50.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:50.879+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:42:50.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:42:50.879+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:42:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:50 smithi057 ceph-mon[92072]: pgmap v1455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:50 smithi122 ceph-mon[125440]: pgmap v1455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:50 smithi136 ceph-mon[125702]: pgmap v1455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:52 smithi057 ceph-mon[92072]: pgmap v1456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:52 smithi122 ceph-mon[125440]: pgmap v1456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:52 smithi136 ceph-mon[125702]: pgmap v1456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:54 smithi057 ceph-mon[92072]: pgmap v1457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:54 smithi122 ceph-mon[125440]: pgmap v1457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:54 smithi136 ceph-mon[125702]: pgmap v1457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:56 smithi057 ceph-mon[92072]: pgmap v1458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:56 smithi122 ceph-mon[125440]: pgmap v1458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:56 smithi136 ceph-mon[125702]: pgmap v1458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:42:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:42:58 smithi057 ceph-mon[92072]: pgmap v1459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:42:58 smithi122 ceph-mon[125440]: pgmap v1459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:42:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:42:58 smithi136 ceph-mon[125702]: pgmap v1459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:00 smithi057 ceph-mon[92072]: pgmap v1460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:00 smithi122 ceph-mon[125440]: pgmap v1460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:00 smithi136 ceph-mon[125702]: pgmap v1460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:02 smithi057 ceph-mon[92072]: pgmap v1461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:02 smithi122 ceph-mon[125440]: pgmap v1461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:02 smithi136 ceph-mon[125702]: pgmap v1461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:04 smithi057 ceph-mon[92072]: pgmap v1462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:43:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:04 smithi122 ceph-mon[125440]: pgmap v1462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:43:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:04 smithi136 ceph-mon[125702]: pgmap v1462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:43:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:05.892+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:43:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:05.893+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:43:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:05.893+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:43:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:05.893+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:43:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:05.893+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:43:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:06 smithi057 ceph-mon[92072]: pgmap v1463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:43:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:06 smithi122 ceph-mon[125440]: pgmap v1463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:43:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:06 smithi136 ceph-mon[125702]: pgmap v1463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:43:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:08 smithi057 ceph-mon[92072]: pgmap v1464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:43:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:08 smithi122 ceph-mon[125440]: pgmap v1464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:43:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:08 smithi136 ceph-mon[125702]: pgmap v1464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:43:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:10 smithi057 ceph-mon[92072]: pgmap v1465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:43:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:10 smithi122 ceph-mon[125440]: pgmap v1465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:43:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:10 smithi136 ceph-mon[125702]: pgmap v1465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:43:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:11 smithi122 ceph-mon[125440]: osdmap e166: 12 total, 12 up, 12 in 2023-03-02T11:43:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:11 smithi136 ceph-mon[125702]: osdmap e166: 12 total, 12 up, 12 in 2023-03-02T11:43:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:11 smithi057 ceph-mon[92072]: osdmap e166: 12 total, 12 up, 12 in 2023-03-02T11:43:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:12 smithi122 ceph-mon[125440]: pgmap v1467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:43:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:12 smithi136 ceph-mon[125702]: pgmap v1467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:43:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:12 smithi057 ceph-mon[92072]: pgmap v1467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:43:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:14 smithi122 ceph-mon[125440]: pgmap v1468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:43:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:14 smithi122 ceph-mon[125440]: osdmap e167: 12 total, 12 up, 12 in 2023-03-02T11:43:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:14 smithi136 ceph-mon[125702]: pgmap v1468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:43:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:14 smithi136 ceph-mon[125702]: osdmap e167: 12 total, 12 up, 12 in 2023-03-02T11:43:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:14 smithi057 ceph-mon[92072]: pgmap v1468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:43:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:14 smithi057 ceph-mon[92072]: osdmap e167: 12 total, 12 up, 12 in 2023-03-02T11:43:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:16 smithi122 ceph-mon[125440]: pgmap v1470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:43:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:16 smithi136 ceph-mon[125702]: pgmap v1470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:43:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:16 smithi057 ceph-mon[92072]: pgmap v1470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:43:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:18 smithi122 ceph-mon[125440]: pgmap v1471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:43:19.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:18 smithi136 ceph-mon[125702]: pgmap v1471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:43:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:18 smithi057 ceph-mon[92072]: pgmap v1471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:43:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:20.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:43:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:20.897+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:43:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:20.897+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:43:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:20.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:43:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:20.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:43:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:20 smithi136 ceph-mon[125702]: pgmap v1472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T11:43:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:20 smithi057 ceph-mon[92072]: pgmap v1472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T11:43:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:20 smithi122 ceph-mon[125440]: pgmap v1472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T11:43:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:22 smithi136 ceph-mon[125702]: pgmap v1473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:43:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:22 smithi057 ceph-mon[92072]: pgmap v1473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:43:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:22 smithi122 ceph-mon[125440]: pgmap v1473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:43:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:24 smithi136 ceph-mon[125702]: pgmap v1474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:43:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:24 smithi057 ceph-mon[92072]: pgmap v1474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:43:25.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:24 smithi122 ceph-mon[125440]: pgmap v1474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:43:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:26 smithi136 ceph-mon[125702]: pgmap v1475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:43:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:26 smithi057 ceph-mon[92072]: pgmap v1475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:43:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:26 smithi122 ceph-mon[125440]: pgmap v1475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:43:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:28 smithi136 ceph-mon[125702]: pgmap v1476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:43:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:28 smithi057 ceph-mon[92072]: pgmap v1476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:43:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:28 smithi122 ceph-mon[125440]: pgmap v1476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:43:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:30 smithi136 ceph-mon[125702]: pgmap v1477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:30 smithi057 ceph-mon[92072]: pgmap v1477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:30 smithi122 ceph-mon[125440]: pgmap v1477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:32 smithi136 ceph-mon[125702]: pgmap v1478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:32 smithi057 ceph-mon[92072]: pgmap v1478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:32 smithi122 ceph-mon[125440]: pgmap v1478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:34 smithi136 ceph-mon[125702]: pgmap v1479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:34 smithi057 ceph-mon[92072]: pgmap v1479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:34 smithi122 ceph-mon[125440]: pgmap v1479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:35.912+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:43:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:35.912+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:43:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:35.912+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:43:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:35.912+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:43:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:35.913+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:43:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:36 smithi136 ceph-mon[125702]: pgmap v1480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:36 smithi057 ceph-mon[92072]: pgmap v1480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:36 smithi122 ceph-mon[125440]: pgmap v1480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:38 smithi136 ceph-mon[125702]: pgmap v1481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:39.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:43:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:38 smithi057 ceph-mon[92072]: pgmap v1481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:43:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:38 smithi122 ceph-mon[125440]: pgmap v1481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:39.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:43:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:43:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:43:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:43:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:43:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:43:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:43:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:43:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:43:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:43:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:40 smithi136 ceph-mon[125702]: pgmap v1482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:40 smithi057 ceph-mon[92072]: pgmap v1482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:40 smithi122 ceph-mon[125440]: pgmap v1482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:42 smithi136 ceph-mon[125702]: pgmap v1483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:42 smithi057 ceph-mon[92072]: pgmap v1483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:42 smithi122 ceph-mon[125440]: pgmap v1483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:44 smithi136 ceph-mon[125702]: pgmap v1484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:44 smithi057 ceph-mon[92072]: pgmap v1484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:44 smithi122 ceph-mon[125440]: pgmap v1484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:46 smithi136 ceph-mon[125702]: pgmap v1485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:46 smithi057 ceph-mon[92072]: pgmap v1485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:46 smithi122 ceph-mon[125440]: pgmap v1485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:48 smithi136 ceph-mon[125702]: pgmap v1486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:48 smithi057 ceph-mon[92072]: pgmap v1486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:48 smithi122 ceph-mon[125440]: pgmap v1486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:50.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:50.928+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:43:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:50.929+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:43:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:50.929+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:43:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:50.929+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:43:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:43:50.929+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:43:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:50 smithi136 ceph-mon[125702]: pgmap v1487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:50 smithi057 ceph-mon[92072]: pgmap v1487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:50 smithi122 ceph-mon[125440]: pgmap v1487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:52 smithi136 ceph-mon[125702]: pgmap v1488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:52 smithi057 ceph-mon[92072]: pgmap v1488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:52 smithi122 ceph-mon[125440]: pgmap v1488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:55.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:54 smithi136 ceph-mon[125702]: pgmap v1489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:54 smithi057 ceph-mon[92072]: pgmap v1489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:55.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:54 smithi122 ceph-mon[125440]: pgmap v1489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:56 smithi136 ceph-mon[125702]: pgmap v1490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:56 smithi057 ceph-mon[92072]: pgmap v1490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:56 smithi122 ceph-mon[125440]: pgmap v1490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:43:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:43:58 smithi136 ceph-mon[125702]: pgmap v1491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:43:58 smithi057 ceph-mon[92072]: pgmap v1491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:43:59.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:43:58 smithi122 ceph-mon[125440]: pgmap v1491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:00 smithi136 ceph-mon[125702]: pgmap v1492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:00 smithi057 ceph-mon[92072]: pgmap v1492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:00 smithi122 ceph-mon[125440]: pgmap v1492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:02 smithi136 ceph-mon[125702]: pgmap v1493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:02 smithi057 ceph-mon[92072]: pgmap v1493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:02 smithi122 ceph-mon[125440]: pgmap v1493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:04 smithi136 ceph-mon[125702]: pgmap v1494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:44:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:04 smithi057 ceph-mon[92072]: pgmap v1494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:44:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:04 smithi122 ceph-mon[125440]: pgmap v1494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:44:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:05.933+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:44:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:05.933+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:44:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:05.933+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:44:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:05.933+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:44:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:05.933+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:44:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:06 smithi136 ceph-mon[125702]: pgmap v1495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:44:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:06 smithi057 ceph-mon[92072]: pgmap v1495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:44:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:06 smithi122 ceph-mon[125440]: pgmap v1495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:44:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.373+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f58680a79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T11:44:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.373+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f58680a79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T11:44:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.373+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a79d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f587808a0d0 tx=0x7f5870044000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:44:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.373+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a79d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f587808a0d0 tx=0x7f5870044000 comp rx=0 tx=0).stop 2023-03-02T11:44:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.373+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f58680a79d0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T11:44:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.373+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f58680a79d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T11:44:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.373+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a79d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:44:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.373+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:44:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.373+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:44:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.373+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7f10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f58700195d0 tx=0x7f5870066000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:44:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.742+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:44:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.742+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:44:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.742+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 26 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:44:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:08.742+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 25 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:44:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:08 smithi136 ceph-mon[125702]: pgmap v1496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:44:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:08 smithi057 ceph-mon[92072]: pgmap v1496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:44:09.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:08 smithi122 ceph-mon[125440]: pgmap v1496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:44:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:10 smithi057 ceph-mon[92072]: pgmap v1497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:44:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:10 smithi122 ceph-mon[125440]: pgmap v1497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:44:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:10 smithi136 ceph-mon[125702]: pgmap v1497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:44:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:11 smithi057 ceph-mon[92072]: osdmap e168: 12 total, 12 up, 12 in 2023-03-02T11:44:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:11 smithi122 ceph-mon[125440]: osdmap e168: 12 total, 12 up, 12 in 2023-03-02T11:44:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:11 smithi136 ceph-mon[125702]: osdmap e168: 12 total, 12 up, 12 in 2023-03-02T11:44:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:12 smithi057 ceph-mon[92072]: pgmap v1499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:44:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:12 smithi122 ceph-mon[125440]: pgmap v1499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:44:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:12 smithi136 ceph-mon[125702]: pgmap v1499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:44:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:14 smithi057 ceph-mon[92072]: pgmap v1500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:14 smithi122 ceph-mon[125440]: pgmap v1500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:14 smithi136 ceph-mon[125702]: pgmap v1500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:16 smithi057 ceph-mon[92072]: pgmap v1501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:16 smithi122 ceph-mon[125440]: pgmap v1501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:16 smithi136 ceph-mon[125702]: pgmap v1501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:18 smithi057 ceph-mon[92072]: pgmap v1502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:18 smithi122 ceph-mon[125440]: pgmap v1502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:18 smithi136 ceph-mon[125702]: pgmap v1502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:20 smithi136 ceph-mon[125702]: pgmap v1503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:20 smithi136 ceph-mon[125702]: osdmap e169: 12 total, 12 up, 12 in 2023-03-02T11:44:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:20 smithi057 ceph-mon[92072]: pgmap v1503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:20 smithi057 ceph-mon[92072]: osdmap e169: 12 total, 12 up, 12 in 2023-03-02T11:44:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:20.948+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:44:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:20.948+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:44:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:20.948+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:44:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:20.948+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:44:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:20.948+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:44:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:20 smithi122 ceph-mon[125440]: pgmap v1503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:20 smithi122 ceph-mon[125440]: osdmap e169: 12 total, 12 up, 12 in 2023-03-02T11:44:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:22 smithi136 ceph-mon[125702]: pgmap v1505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:22 smithi057 ceph-mon[92072]: pgmap v1505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:22 smithi122 ceph-mon[125440]: pgmap v1505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:44:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:24 smithi136 ceph-mon[125702]: pgmap v1506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:44:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:24 smithi057 ceph-mon[92072]: pgmap v1506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:44:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:24 smithi122 ceph-mon[125440]: pgmap v1506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:44:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:26 smithi136 ceph-mon[125702]: pgmap v1507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:44:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:26 smithi057 ceph-mon[92072]: pgmap v1507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:44:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:26 smithi122 ceph-mon[125440]: pgmap v1507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:44:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:28 smithi136 ceph-mon[125702]: pgmap v1508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:44:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:28 smithi057 ceph-mon[92072]: pgmap v1508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:44:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:28 smithi122 ceph-mon[125440]: pgmap v1508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:44:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:30 smithi136 ceph-mon[125702]: pgmap v1509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:44:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:30 smithi057 ceph-mon[92072]: pgmap v1509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:44:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:30 smithi122 ceph-mon[125440]: pgmap v1509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:44:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:32 smithi136 ceph-mon[125702]: pgmap v1510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:32 smithi057 ceph-mon[92072]: pgmap v1510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:32 smithi122 ceph-mon[125440]: pgmap v1510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:34 smithi136 ceph-mon[125702]: pgmap v1511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:34 smithi057 ceph-mon[92072]: pgmap v1511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:34 smithi122 ceph-mon[125440]: pgmap v1511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:35.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:35.964+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:44:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:35.965+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:44:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:35.965+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:44:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:35.965+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:44:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:35.965+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:44:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:36 smithi136 ceph-mon[125702]: pgmap v1512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:36 smithi057 ceph-mon[92072]: pgmap v1512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:36 smithi122 ceph-mon[125440]: pgmap v1512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:38 smithi136 ceph-mon[125702]: pgmap v1513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:38 smithi057 ceph-mon[92072]: pgmap v1513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:38 smithi122 ceph-mon[125440]: pgmap v1513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:44:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:44:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:44:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:40 smithi136 ceph-mon[125702]: pgmap v1514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:44:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:44:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:44:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:40 smithi057 ceph-mon[92072]: pgmap v1514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:44:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:44:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:44:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:40 smithi122 ceph-mon[125440]: pgmap v1514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:44:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:44:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:44:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:42 smithi136 ceph-mon[125702]: pgmap v1515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:42 smithi057 ceph-mon[92072]: pgmap v1515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:42 smithi122 ceph-mon[125440]: pgmap v1515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:44 smithi136 ceph-mon[125702]: pgmap v1516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:44 smithi057 ceph-mon[92072]: pgmap v1516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:44 smithi122 ceph-mon[125440]: pgmap v1516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:46 smithi136 ceph-mon[125702]: pgmap v1517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:46 smithi057 ceph-mon[92072]: pgmap v1517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:46 smithi122 ceph-mon[125440]: pgmap v1517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:48 smithi136 ceph-mon[125702]: pgmap v1518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:48 smithi057 ceph-mon[92072]: pgmap v1518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:48 smithi122 ceph-mon[125440]: pgmap v1518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:50 smithi136 ceph-mon[125702]: pgmap v1519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:50 smithi057 ceph-mon[92072]: pgmap v1519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:50 smithi122 ceph-mon[125440]: pgmap v1519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:50.970+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:44:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:50.971+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:44:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:50.971+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:44:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:50.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:44:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:44:50.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:44:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:52 smithi136 ceph-mon[125702]: pgmap v1520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:52 smithi057 ceph-mon[92072]: pgmap v1520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:52 smithi122 ceph-mon[125440]: pgmap v1520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:54 smithi136 ceph-mon[125702]: pgmap v1521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:54 smithi057 ceph-mon[92072]: pgmap v1521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:54 smithi122 ceph-mon[125440]: pgmap v1521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:56 smithi136 ceph-mon[125702]: pgmap v1522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:56 smithi057 ceph-mon[92072]: pgmap v1522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:56 smithi122 ceph-mon[125440]: pgmap v1522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:44:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:44:58 smithi136 ceph-mon[125702]: pgmap v1523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:44:58 smithi057 ceph-mon[92072]: pgmap v1523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:44:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:44:58 smithi122 ceph-mon[125440]: pgmap v1523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:00 smithi136 ceph-mon[125702]: pgmap v1524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:00 smithi057 ceph-mon[92072]: pgmap v1524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:00 smithi122 ceph-mon[125440]: pgmap v1524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:02 smithi136 ceph-mon[125702]: pgmap v1525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:02 smithi057 ceph-mon[92072]: pgmap v1525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:02 smithi122 ceph-mon[125440]: pgmap v1525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:04 smithi136 ceph-mon[125702]: pgmap v1526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:45:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:04 smithi057 ceph-mon[92072]: pgmap v1526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:45:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:04 smithi122 ceph-mon[125440]: pgmap v1526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:45:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:05.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:45:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:05.987+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:45:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:05.987+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:45:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:05.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:45:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:05.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:45:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:06 smithi136 ceph-mon[125702]: pgmap v1527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:45:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:06 smithi057 ceph-mon[92072]: pgmap v1527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:45:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:06 smithi122 ceph-mon[125440]: pgmap v1527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:45:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:08 smithi136 ceph-mon[125702]: pgmap v1528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:45:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:08 smithi057 ceph-mon[92072]: pgmap v1528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:45:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:08 smithi122 ceph-mon[125440]: pgmap v1528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:45:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:10 smithi136 ceph-mon[125702]: pgmap v1529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:45:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:10 smithi057 ceph-mon[92072]: pgmap v1529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:45:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:10 smithi122 ceph-mon[125440]: pgmap v1529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:45:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:11 smithi057 ceph-mon[92072]: osdmap e170: 12 total, 12 up, 12 in 2023-03-02T11:45:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:11 smithi122 ceph-mon[125440]: osdmap e170: 12 total, 12 up, 12 in 2023-03-02T11:45:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:11 smithi136 ceph-mon[125702]: osdmap e170: 12 total, 12 up, 12 in 2023-03-02T11:45:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:12 smithi057 ceph-mon[92072]: pgmap v1531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:45:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:12 smithi122 ceph-mon[125440]: pgmap v1531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:45:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:12 smithi136 ceph-mon[125702]: pgmap v1531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:45:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:14 smithi057 ceph-mon[92072]: pgmap v1532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:45:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:14 smithi057 ceph-mon[92072]: osdmap e171: 12 total, 12 up, 12 in 2023-03-02T11:45:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:14 smithi122 ceph-mon[125440]: pgmap v1532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:45:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:14 smithi122 ceph-mon[125440]: osdmap e171: 12 total, 12 up, 12 in 2023-03-02T11:45:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:14 smithi136 ceph-mon[125702]: pgmap v1532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:45:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:14 smithi136 ceph-mon[125702]: osdmap e171: 12 total, 12 up, 12 in 2023-03-02T11:45:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:16 smithi057 ceph-mon[92072]: pgmap v1534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:45:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:16 smithi122 ceph-mon[125440]: pgmap v1534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:45:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:16 smithi136 ceph-mon[125702]: pgmap v1534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:45:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:18 smithi057 ceph-mon[92072]: pgmap v1535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:45:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:18 smithi122 ceph-mon[125440]: pgmap v1535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:45:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:18 smithi136 ceph-mon[125702]: pgmap v1535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:45:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:20 smithi057 ceph-mon[92072]: pgmap v1536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:45:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:20 smithi122 ceph-mon[125440]: pgmap v1536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:45:21.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:21.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:45:21.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:21.001+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:45:21.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:21.001+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:45:21.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:21.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:45:21.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:21.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:45:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:20 smithi136 ceph-mon[125702]: pgmap v1536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:45:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:22 smithi057 ceph-mon[92072]: pgmap v1537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:45:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:22 smithi122 ceph-mon[125440]: pgmap v1537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:45:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:22 smithi136 ceph-mon[125702]: pgmap v1537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:45:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:24 smithi057 ceph-mon[92072]: pgmap v1538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:45:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:24 smithi122 ceph-mon[125440]: pgmap v1538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:45:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:24 smithi136 ceph-mon[125702]: pgmap v1538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:45:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:26 smithi057 ceph-mon[92072]: pgmap v1539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:45:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:26 smithi122 ceph-mon[125440]: pgmap v1539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:45:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:26 smithi136 ceph-mon[125702]: pgmap v1539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:45:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:28 smithi057 ceph-mon[92072]: pgmap v1540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:45:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:28 smithi122 ceph-mon[125440]: pgmap v1540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:45:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:28 smithi136 ceph-mon[125702]: pgmap v1540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:45:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:30 smithi057 ceph-mon[92072]: pgmap v1541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:30 smithi122 ceph-mon[125440]: pgmap v1541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:30 smithi136 ceph-mon[125702]: pgmap v1541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:32 smithi057 ceph-mon[92072]: pgmap v1542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:32 smithi122 ceph-mon[125440]: pgmap v1542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:32 smithi136 ceph-mon[125702]: pgmap v1542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:34 smithi122 ceph-mon[125440]: pgmap v1543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:34 smithi136 ceph-mon[125702]: pgmap v1543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:34 smithi057 ceph-mon[92072]: pgmap v1543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:36.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:45:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:36.015+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:45:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:36.015+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:45:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:36.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:45:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:36.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:45:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:36 smithi122 ceph-mon[125440]: pgmap v1544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:37.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:36 smithi136 ceph-mon[125702]: pgmap v1544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:36 smithi057 ceph-mon[92072]: pgmap v1544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:38 smithi122 ceph-mon[125440]: pgmap v1545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:38 smithi136 ceph-mon[125702]: pgmap v1545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:38 smithi057 ceph-mon[92072]: pgmap v1545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:40 smithi122 ceph-mon[125440]: pgmap v1546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:45:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:40 smithi136 ceph-mon[125702]: pgmap v1546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:41.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:45:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:40 smithi057 ceph-mon[92072]: pgmap v1546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:45:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:42 smithi136 ceph-mon[125702]: pgmap v1547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:43.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:45:43.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:45:43.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:45:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:42 smithi057 ceph-mon[92072]: pgmap v1547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:45:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:45:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:45:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:42 smithi122 ceph-mon[125440]: pgmap v1547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:45:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:45:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:45:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:44 smithi136 ceph-mon[125702]: pgmap v1548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:44 smithi057 ceph-mon[92072]: pgmap v1548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:44 smithi122 ceph-mon[125440]: pgmap v1548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:46 smithi136 ceph-mon[125702]: pgmap v1549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:46 smithi057 ceph-mon[92072]: pgmap v1549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:46 smithi122 ceph-mon[125440]: pgmap v1549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:48 smithi136 ceph-mon[125702]: pgmap v1550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:48 smithi057 ceph-mon[92072]: pgmap v1550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:48 smithi122 ceph-mon[125440]: pgmap v1550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:51.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:45:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:51.029+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:45:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:51.029+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:45:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:51.029+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:45:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:45:51.029+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:45:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:50 smithi136 ceph-mon[125702]: pgmap v1551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:50 smithi057 ceph-mon[92072]: pgmap v1551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:50 smithi122 ceph-mon[125440]: pgmap v1551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:52 smithi136 ceph-mon[125702]: pgmap v1552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:52 smithi057 ceph-mon[92072]: pgmap v1552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:52 smithi122 ceph-mon[125440]: pgmap v1552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:54 smithi136 ceph-mon[125702]: pgmap v1553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:54 smithi057 ceph-mon[92072]: pgmap v1553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:54 smithi122 ceph-mon[125440]: pgmap v1553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:56 smithi136 ceph-mon[125702]: pgmap v1554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:56 smithi057 ceph-mon[92072]: pgmap v1554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:56 smithi122 ceph-mon[125440]: pgmap v1554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:45:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:45:58 smithi136 ceph-mon[125702]: pgmap v1555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:45:58 smithi057 ceph-mon[92072]: pgmap v1555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:45:59.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:45:58 smithi122 ceph-mon[125440]: pgmap v1555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:00 smithi136 ceph-mon[125702]: pgmap v1556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:00 smithi057 ceph-mon[92072]: pgmap v1556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:00 smithi122 ceph-mon[125440]: pgmap v1556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:02 smithi136 ceph-mon[125702]: pgmap v1557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:02 smithi057 ceph-mon[92072]: pgmap v1557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:02 smithi122 ceph-mon[125440]: pgmap v1557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:04 smithi136 ceph-mon[125702]: pgmap v1558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:46:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:04 smithi057 ceph-mon[92072]: pgmap v1558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:46:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:04 smithi122 ceph-mon[125440]: pgmap v1558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:46:06.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:06.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:46:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:06.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:46:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:06.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:46:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:06.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:46:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:06.044+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:46:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:06 smithi136 ceph-mon[125702]: pgmap v1559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:46:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:06 smithi057 ceph-mon[92072]: pgmap v1559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:46:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:06 smithi122 ceph-mon[125440]: pgmap v1559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:46:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:08 smithi136 ceph-mon[125702]: pgmap v1560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:46:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:08 smithi057 ceph-mon[92072]: pgmap v1560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:46:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:08 smithi122 ceph-mon[125440]: pgmap v1560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:46:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:10 smithi136 ceph-mon[125702]: pgmap v1561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:46:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:10 smithi057 ceph-mon[92072]: pgmap v1561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:46:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:10 smithi122 ceph-mon[125440]: pgmap v1561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:46:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:11 smithi136 ceph-mon[125702]: osdmap e172: 12 total, 12 up, 12 in 2023-03-02T11:46:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:11 smithi057 ceph-mon[92072]: osdmap e172: 12 total, 12 up, 12 in 2023-03-02T11:46:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:11 smithi122 ceph-mon[125440]: osdmap e172: 12 total, 12 up, 12 in 2023-03-02T11:46:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:12 smithi136 ceph-mon[125702]: pgmap v1563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:46:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:12 smithi057 ceph-mon[92072]: pgmap v1563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:46:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:12 smithi122 ceph-mon[125440]: pgmap v1563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:46:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:14 smithi136 ceph-mon[125702]: pgmap v1564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:46:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:14 smithi136 ceph-mon[125702]: osdmap e173: 12 total, 12 up, 12 in 2023-03-02T11:46:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:14 smithi057 ceph-mon[92072]: pgmap v1564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:46:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:14 smithi057 ceph-mon[92072]: osdmap e173: 12 total, 12 up, 12 in 2023-03-02T11:46:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:14 smithi122 ceph-mon[125440]: pgmap v1564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:46:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:14 smithi122 ceph-mon[125440]: osdmap e173: 12 total, 12 up, 12 in 2023-03-02T11:46:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:16 smithi136 ceph-mon[125702]: pgmap v1566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:46:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:16 smithi057 ceph-mon[92072]: pgmap v1566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:46:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:16 smithi122 ceph-mon[125440]: pgmap v1566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:46:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:18 smithi136 ceph-mon[125702]: pgmap v1567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:46:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:18 smithi057 ceph-mon[92072]: pgmap v1567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:46:19.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:18 smithi122 ceph-mon[125440]: pgmap v1567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:46:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:21.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:46:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:21.058+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:46:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:21.058+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:46:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:21.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:46:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:21.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:46:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:20 smithi136 ceph-mon[125702]: pgmap v1568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T11:46:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:20 smithi057 ceph-mon[92072]: pgmap v1568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T11:46:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:20 smithi122 ceph-mon[125440]: pgmap v1568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T11:46:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:22 smithi136 ceph-mon[125702]: pgmap v1569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:46:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:22 smithi057 ceph-mon[92072]: pgmap v1569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:46:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:22 smithi122 ceph-mon[125440]: pgmap v1569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:46:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:24 smithi136 ceph-mon[125702]: pgmap v1570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:46:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:24 smithi057 ceph-mon[92072]: pgmap v1570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:46:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:24 smithi122 ceph-mon[125440]: pgmap v1570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:46:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:26 smithi136 ceph-mon[125702]: pgmap v1571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:46:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:26 smithi057 ceph-mon[92072]: pgmap v1571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:46:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:26 smithi122 ceph-mon[125440]: pgmap v1571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:46:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:28 smithi136 ceph-mon[125702]: pgmap v1572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:46:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:28 smithi057 ceph-mon[92072]: pgmap v1572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:46:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:28 smithi122 ceph-mon[125440]: pgmap v1572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:46:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:30 smithi136 ceph-mon[125702]: pgmap v1573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:30 smithi057 ceph-mon[92072]: pgmap v1573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:30 smithi122 ceph-mon[125440]: pgmap v1573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:32 smithi136 ceph-mon[125702]: pgmap v1574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:32 smithi057 ceph-mon[92072]: pgmap v1574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:32 smithi122 ceph-mon[125440]: pgmap v1574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:34 smithi057 ceph-mon[92072]: pgmap v1575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:34 smithi122 ceph-mon[125440]: pgmap v1575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:34 smithi136 ceph-mon[125702]: pgmap v1575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:36.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:46:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:36.069+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:46:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:36.069+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:46:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:36.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:46:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:36.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:46:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:36 smithi057 ceph-mon[92072]: pgmap v1576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:36 smithi122 ceph-mon[125440]: pgmap v1576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:36 smithi136 ceph-mon[125702]: pgmap v1576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:38 smithi057 ceph-mon[92072]: pgmap v1577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:38 smithi122 ceph-mon[125440]: pgmap v1577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:38 smithi136 ceph-mon[125702]: pgmap v1577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:40 smithi057 ceph-mon[92072]: pgmap v1578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:40 smithi122 ceph-mon[125440]: pgmap v1578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:40 smithi136 ceph-mon[125702]: pgmap v1578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:42 smithi057 ceph-mon[92072]: pgmap v1579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:43.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:46:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:42 smithi122 ceph-mon[125440]: pgmap v1579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:46:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:42 smithi136 ceph-mon[125702]: pgmap v1579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:43.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:46:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:46:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:46:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:46:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:46:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:46:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:46:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:46:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:46:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:46:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:44 smithi057 ceph-mon[92072]: pgmap v1580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:44 smithi122 ceph-mon[125440]: pgmap v1580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:44 smithi136 ceph-mon[125702]: pgmap v1580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:46 smithi057 ceph-mon[92072]: pgmap v1581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:46 smithi122 ceph-mon[125440]: pgmap v1581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:46 smithi136 ceph-mon[125702]: pgmap v1581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:48 smithi057 ceph-mon[92072]: pgmap v1582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:48 smithi122 ceph-mon[125440]: pgmap v1582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:48 smithi136 ceph-mon[125702]: pgmap v1582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:51.083+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:46:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:51.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:46:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:51.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:46:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:51.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:46:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:46:51.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:46:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:50 smithi057 ceph-mon[92072]: pgmap v1583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:50 smithi122 ceph-mon[125440]: pgmap v1583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:50 smithi136 ceph-mon[125702]: pgmap v1583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:52 smithi057 ceph-mon[92072]: pgmap v1584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:52 smithi122 ceph-mon[125440]: pgmap v1584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:52 smithi136 ceph-mon[125702]: pgmap v1584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:54 smithi057 ceph-mon[92072]: pgmap v1585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:54 smithi122 ceph-mon[125440]: pgmap v1585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:54 smithi136 ceph-mon[125702]: pgmap v1585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:56 smithi057 ceph-mon[92072]: pgmap v1586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:57.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:56 smithi122 ceph-mon[125440]: pgmap v1586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:56 smithi136 ceph-mon[125702]: pgmap v1586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:46:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:46:58 smithi057 ceph-mon[92072]: pgmap v1587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:46:58 smithi122 ceph-mon[125440]: pgmap v1587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:46:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:46:58 smithi136 ceph-mon[125702]: pgmap v1587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:00 smithi057 ceph-mon[92072]: pgmap v1588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:00 smithi122 ceph-mon[125440]: pgmap v1588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:00 smithi136 ceph-mon[125702]: pgmap v1588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:02 smithi057 ceph-mon[92072]: pgmap v1589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:02 smithi122 ceph-mon[125440]: pgmap v1589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:02 smithi136 ceph-mon[125702]: pgmap v1589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:04 smithi057 ceph-mon[92072]: pgmap v1590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:47:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:04 smithi122 ceph-mon[125440]: pgmap v1590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:47:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:04 smithi136 ceph-mon[125702]: pgmap v1590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:47:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:06.095+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:47:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:06.096+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:47:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:06.096+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:47:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:06.096+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:47:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:06.096+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:47:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:06 smithi057 ceph-mon[92072]: pgmap v1591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:47:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:06 smithi122 ceph-mon[125440]: pgmap v1591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:47:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:06 smithi136 ceph-mon[125702]: pgmap v1591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:47:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:08.769+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:47:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:08.769+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:47:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:08.769+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 27 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:47:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:08.769+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 26 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:47:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:08 smithi057 ceph-mon[92072]: pgmap v1592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:47:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:08 smithi122 ceph-mon[125440]: pgmap v1592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:47:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:08 smithi136 ceph-mon[125702]: pgmap v1592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:47:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:10 smithi057 ceph-mon[92072]: pgmap v1593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:47:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:10 smithi122 ceph-mon[125440]: pgmap v1593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:47:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:10 smithi136 ceph-mon[125702]: pgmap v1593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:47:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:11 smithi122 ceph-mon[125440]: osdmap e174: 12 total, 12 up, 12 in 2023-03-02T11:47:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:11 smithi136 ceph-mon[125702]: osdmap e174: 12 total, 12 up, 12 in 2023-03-02T11:47:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:11 smithi057 ceph-mon[92072]: osdmap e174: 12 total, 12 up, 12 in 2023-03-02T11:47:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:12 smithi136 ceph-mon[125702]: pgmap v1595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:47:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:12 smithi057 ceph-mon[92072]: pgmap v1595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:47:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:12 smithi122 ceph-mon[125440]: pgmap v1595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:47:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:14 smithi136 ceph-mon[125702]: pgmap v1596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:47:15.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:14 smithi136 ceph-mon[125702]: osdmap e175: 12 total, 12 up, 12 in 2023-03-02T11:47:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:14 smithi057 ceph-mon[92072]: pgmap v1596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:47:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:14 smithi057 ceph-mon[92072]: osdmap e175: 12 total, 12 up, 12 in 2023-03-02T11:47:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:14 smithi122 ceph-mon[125440]: pgmap v1596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:47:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:14 smithi122 ceph-mon[125440]: osdmap e175: 12 total, 12 up, 12 in 2023-03-02T11:47:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:16 smithi136 ceph-mon[125702]: pgmap v1598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:47:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:16 smithi057 ceph-mon[92072]: pgmap v1598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:47:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:16 smithi122 ceph-mon[125440]: pgmap v1598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:47:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:18 smithi136 ceph-mon[125702]: pgmap v1599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:47:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:18 smithi057 ceph-mon[92072]: pgmap v1599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:47:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:18 smithi122 ceph-mon[125440]: pgmap v1599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:47:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:21.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:47:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:21.100+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:47:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:21.100+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:47:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:21.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:47:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:21.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:47:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:20 smithi136 ceph-mon[125702]: pgmap v1600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T11:47:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:20 smithi057 ceph-mon[92072]: pgmap v1600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T11:47:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:20 smithi122 ceph-mon[125440]: pgmap v1600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T11:47:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:22 smithi136 ceph-mon[125702]: pgmap v1601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:47:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:22 smithi057 ceph-mon[92072]: pgmap v1601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:47:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:22 smithi122 ceph-mon[125440]: pgmap v1601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:47:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:24 smithi136 ceph-mon[125702]: pgmap v1602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:47:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:24 smithi057 ceph-mon[92072]: pgmap v1602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:47:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:24 smithi122 ceph-mon[125440]: pgmap v1602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:47:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:26 smithi136 ceph-mon[125702]: pgmap v1603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:47:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:26 smithi057 ceph-mon[92072]: pgmap v1603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:47:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:26 smithi122 ceph-mon[125440]: pgmap v1603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:47:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:28 smithi136 ceph-mon[125702]: pgmap v1604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:47:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:28 smithi057 ceph-mon[92072]: pgmap v1604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:47:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:28 smithi122 ceph-mon[125440]: pgmap v1604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:47:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:30 smithi136 ceph-mon[125702]: pgmap v1605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:30 smithi057 ceph-mon[92072]: pgmap v1605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:30 smithi122 ceph-mon[125440]: pgmap v1605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:32 smithi136 ceph-mon[125702]: pgmap v1606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:32 smithi057 ceph-mon[92072]: pgmap v1606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:32 smithi122 ceph-mon[125440]: pgmap v1606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:35 smithi136 ceph-mon[125702]: pgmap v1607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:35 smithi057 ceph-mon[92072]: pgmap v1607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:35 smithi122 ceph-mon[125440]: pgmap v1607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:36.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:47:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:36.114+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:47:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:36.114+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:47:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:36.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:47:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:36.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:47:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:37 smithi136 ceph-mon[125702]: pgmap v1608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:37 smithi057 ceph-mon[92072]: pgmap v1608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:37 smithi122 ceph-mon[125440]: pgmap v1608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:39 smithi136 ceph-mon[125702]: pgmap v1609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:39 smithi057 ceph-mon[92072]: pgmap v1609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:39.475 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:39 smithi122 ceph-mon[125440]: pgmap v1609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:41 smithi136 ceph-mon[125702]: pgmap v1610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:41 smithi057 ceph-mon[92072]: pgmap v1610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:41 smithi122 ceph-mon[125440]: pgmap v1610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:43 smithi136 ceph-mon[125702]: pgmap v1611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:43 smithi057 ceph-mon[92072]: pgmap v1611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:43 smithi122 ceph-mon[125440]: pgmap v1611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:47:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:47:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:47:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:45 smithi136 ceph-mon[125702]: pgmap v1612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:47:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:47:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:47:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:45 smithi057 ceph-mon[92072]: pgmap v1612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:47:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:47:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:47:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:45 smithi122 ceph-mon[125440]: pgmap v1612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:47:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:47:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:47:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:47 smithi136 ceph-mon[125702]: pgmap v1613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:47 smithi057 ceph-mon[92072]: pgmap v1613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:47 smithi122 ceph-mon[125440]: pgmap v1613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:48 smithi057 ceph-mon[92072]: pgmap v1614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:48 smithi122 ceph-mon[125440]: pgmap v1614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:48 smithi136 ceph-mon[125702]: pgmap v1614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:50 smithi136 ceph-mon[125702]: pgmap v1615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:50 smithi057 ceph-mon[92072]: pgmap v1615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:50 smithi122 ceph-mon[125440]: pgmap v1615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:51.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:51.127+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:47:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:51.128+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:47:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:51.128+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:47:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:51.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:47:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:47:51.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:47:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:52 smithi136 ceph-mon[125702]: pgmap v1616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:52 smithi057 ceph-mon[92072]: pgmap v1616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:52 smithi122 ceph-mon[125440]: pgmap v1616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:54 smithi136 ceph-mon[125702]: pgmap v1617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:54 smithi057 ceph-mon[92072]: pgmap v1617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:54 smithi122 ceph-mon[125440]: pgmap v1617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:56 smithi136 ceph-mon[125702]: pgmap v1618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:56 smithi057 ceph-mon[92072]: pgmap v1618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:56 smithi122 ceph-mon[125440]: pgmap v1618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:47:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:47:58 smithi136 ceph-mon[125702]: pgmap v1619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:47:58 smithi057 ceph-mon[92072]: pgmap v1619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:47:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:47:58 smithi122 ceph-mon[125440]: pgmap v1619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:00 smithi136 ceph-mon[125702]: pgmap v1620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:00 smithi057 ceph-mon[92072]: pgmap v1620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:00 smithi122 ceph-mon[125440]: pgmap v1620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:02 smithi136 ceph-mon[125702]: pgmap v1621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:02 smithi057 ceph-mon[92072]: pgmap v1621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:02 smithi122 ceph-mon[125440]: pgmap v1621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:04 smithi136 ceph-mon[125702]: pgmap v1622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:48:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:04 smithi057 ceph-mon[92072]: pgmap v1622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:48:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:04 smithi122 ceph-mon[125440]: pgmap v1622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:48:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:06.133+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:48:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:06.134+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:48:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:06.134+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:48:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:06.134+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:48:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:06.134+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:48:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:06 smithi136 ceph-mon[125702]: pgmap v1623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:48:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:06 smithi057 ceph-mon[92072]: pgmap v1623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:48:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:06 smithi122 ceph-mon[125440]: pgmap v1623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:48:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:08 smithi136 ceph-mon[125702]: pgmap v1624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:48:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:08 smithi057 ceph-mon[92072]: pgmap v1624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:48:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:08 smithi122 ceph-mon[125440]: pgmap v1624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:48:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:10 smithi136 ceph-mon[125702]: pgmap v1625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:48:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:10 smithi057 ceph-mon[92072]: pgmap v1625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:48:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:10 smithi122 ceph-mon[125440]: pgmap v1625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:48:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:11 smithi136 ceph-mon[125702]: osdmap e176: 12 total, 12 up, 12 in 2023-03-02T11:48:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:11 smithi057 ceph-mon[92072]: osdmap e176: 12 total, 12 up, 12 in 2023-03-02T11:48:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:11 smithi122 ceph-mon[125440]: osdmap e176: 12 total, 12 up, 12 in 2023-03-02T11:48:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:12 smithi136 ceph-mon[125702]: pgmap v1627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:48:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:12 smithi057 ceph-mon[92072]: pgmap v1627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:48:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:12 smithi122 ceph-mon[125440]: pgmap v1627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:48:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:14 smithi057 ceph-mon[92072]: pgmap v1628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:48:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:14 smithi057 ceph-mon[92072]: osdmap e177: 12 total, 12 up, 12 in 2023-03-02T11:48:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:14 smithi122 ceph-mon[125440]: pgmap v1628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:48:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:14 smithi122 ceph-mon[125440]: osdmap e177: 12 total, 12 up, 12 in 2023-03-02T11:48:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:14 smithi136 ceph-mon[125702]: pgmap v1628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:48:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:14 smithi136 ceph-mon[125702]: osdmap e177: 12 total, 12 up, 12 in 2023-03-02T11:48:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:16 smithi057 ceph-mon[92072]: pgmap v1630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:48:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:16 smithi122 ceph-mon[125440]: pgmap v1630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:48:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:16 smithi136 ceph-mon[125702]: pgmap v1630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:48:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:18 smithi057 ceph-mon[92072]: pgmap v1631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:48:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:18 smithi122 ceph-mon[125440]: pgmap v1631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:48:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:18 smithi136 ceph-mon[125702]: pgmap v1631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:48:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:20 smithi057 ceph-mon[92072]: pgmap v1632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:48:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:20 smithi122 ceph-mon[125440]: pgmap v1632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:48:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:20 smithi136 ceph-mon[125702]: pgmap v1632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:48:21.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:21.141+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:48:21.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:21.141+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:48:21.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:21.141+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:48:21.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:21.141+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:48:21.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:21.141+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:48:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:22 smithi057 ceph-mon[92072]: pgmap v1633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:48:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:22 smithi122 ceph-mon[125440]: pgmap v1633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:48:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:22 smithi136 ceph-mon[125702]: pgmap v1633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:48:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:24 smithi057 ceph-mon[92072]: pgmap v1634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:48:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:24 smithi122 ceph-mon[125440]: pgmap v1634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:48:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:24 smithi136 ceph-mon[125702]: pgmap v1634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:48:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:26 smithi057 ceph-mon[92072]: pgmap v1635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:48:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:26 smithi122 ceph-mon[125440]: pgmap v1635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:48:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:26 smithi136 ceph-mon[125702]: pgmap v1635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:48:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:28 smithi057 ceph-mon[92072]: pgmap v1636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:48:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:28 smithi122 ceph-mon[125440]: pgmap v1636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:48:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:28 smithi136 ceph-mon[125702]: pgmap v1636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:48:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:30 smithi057 ceph-mon[92072]: pgmap v1637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:30 smithi122 ceph-mon[125440]: pgmap v1637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:30 smithi136 ceph-mon[125702]: pgmap v1637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:32 smithi057 ceph-mon[92072]: pgmap v1638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:32 smithi122 ceph-mon[125440]: pgmap v1638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:32 smithi136 ceph-mon[125702]: pgmap v1638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:34 smithi057 ceph-mon[92072]: pgmap v1639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:34 smithi122 ceph-mon[125440]: pgmap v1639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:34 smithi136 ceph-mon[125702]: pgmap v1639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:36.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:48:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:36.155+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:48:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:36.155+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:48:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:36.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:48:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:36.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:48:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:36 smithi057 ceph-mon[92072]: pgmap v1640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:36 smithi122 ceph-mon[125440]: pgmap v1640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:36 smithi136 ceph-mon[125702]: pgmap v1640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:38.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:38.781+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:48:38.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:38.781+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:48:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:38.781+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 27 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:48:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:38.781+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 28 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:48:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:38 smithi057 ceph-mon[92072]: pgmap v1641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:38 smithi122 ceph-mon[125440]: pgmap v1641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:38 smithi136 ceph-mon[125702]: pgmap v1641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:40 smithi057 ceph-mon[92072]: pgmap v1642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:40 smithi122 ceph-mon[125440]: pgmap v1642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:40 smithi136 ceph-mon[125702]: pgmap v1642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:42 smithi057 ceph-mon[92072]: pgmap v1643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:42 smithi122 ceph-mon[125440]: pgmap v1643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:42 smithi136 ceph-mon[125702]: pgmap v1643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:44 smithi057 ceph-mon[92072]: pgmap v1644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:48:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:44 smithi122 ceph-mon[125440]: pgmap v1644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:48:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:44 smithi136 ceph-mon[125702]: pgmap v1644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:45.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:48:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:46 smithi057 ceph-mon[92072]: pgmap v1645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:46 smithi122 ceph-mon[125440]: pgmap v1645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:46 smithi136 ceph-mon[125702]: pgmap v1645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: pgmap v1646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: pgmap v1646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:48.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:48.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: pgmap v1646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:49.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:49.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:49.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:49.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:49.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:48:49.981 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:48:49.982 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:48:49.982 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:48:49.982 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.982 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.982 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.982 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.983 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.983 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.983 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.983 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.984 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:48:49.984 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:48:49.984 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:48:49.984 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:48:49.984 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:49.985 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:48:49.985 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:48:49.985 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:48:49.985 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:48:49.985 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.985 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.986 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.986 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.986 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.986 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.986 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.986 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:49.987 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:48:49.987 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:48:49.987 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:48:49.987 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:48:49.987 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:48:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:48:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:48:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:48:50.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:50.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:50.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:50.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:50.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:50.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:50.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:50.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:48:50.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:48:50.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:48:50.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:48:50.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:48:50.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:48:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:50 smithi136 ceph-mon[125702]: pgmap v1647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:51.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:48:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:51.172+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:48:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:51.172+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:48:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:51.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:48:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:48:51.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:48:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:50 smithi057 ceph-mon[92072]: pgmap v1647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:50 smithi122 ceph-mon[125440]: pgmap v1647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:52 smithi136 ceph-mon[125702]: pgmap v1648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:52 smithi057 ceph-mon[92072]: pgmap v1648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:52 smithi122 ceph-mon[125440]: pgmap v1648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:54 smithi136 ceph-mon[125702]: pgmap v1649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:54 smithi057 ceph-mon[92072]: pgmap v1649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:55.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:54 smithi122 ceph-mon[125440]: pgmap v1649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:56 smithi136 ceph-mon[125702]: pgmap v1650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:56 smithi057 ceph-mon[92072]: pgmap v1650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:56 smithi122 ceph-mon[125440]: pgmap v1650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:48:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:48:58 smithi136 ceph-mon[125702]: pgmap v1651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:48:58 smithi057 ceph-mon[92072]: pgmap v1651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:48:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:48:58 smithi122 ceph-mon[125440]: pgmap v1651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:00 smithi136 ceph-mon[125702]: pgmap v1652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:00 smithi057 ceph-mon[92072]: pgmap v1652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:00 smithi122 ceph-mon[125440]: pgmap v1652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:02 smithi136 ceph-mon[125702]: pgmap v1653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:02 smithi057 ceph-mon[92072]: pgmap v1653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:02 smithi122 ceph-mon[125440]: pgmap v1653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:04 smithi136 ceph-mon[125702]: pgmap v1654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:49:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:04 smithi057 ceph-mon[92072]: pgmap v1654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:49:05.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:04 smithi122 ceph-mon[125440]: pgmap v1654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:49:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:06.187+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:49:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:06.187+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:49:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:06.187+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:49:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:06.187+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:49:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:06.187+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:49:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:06 smithi136 ceph-mon[125702]: pgmap v1655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:49:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:06 smithi057 ceph-mon[92072]: pgmap v1655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:49:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:06 smithi122 ceph-mon[125440]: pgmap v1655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:49:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:08 smithi136 ceph-mon[125702]: pgmap v1656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:49:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:08 smithi057 ceph-mon[92072]: pgmap v1656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:49:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:08 smithi122 ceph-mon[125440]: pgmap v1656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:49:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:10 smithi136 ceph-mon[125702]: pgmap v1657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:49:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:10 smithi057 ceph-mon[92072]: pgmap v1657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:49:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:10 smithi122 ceph-mon[125440]: pgmap v1657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:49:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:11 smithi136 ceph-mon[125702]: osdmap e178: 12 total, 12 up, 12 in 2023-03-02T11:49:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:11 smithi057 ceph-mon[92072]: osdmap e178: 12 total, 12 up, 12 in 2023-03-02T11:49:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:11 smithi122 ceph-mon[125440]: osdmap e178: 12 total, 12 up, 12 in 2023-03-02T11:49:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:12 smithi136 ceph-mon[125702]: pgmap v1659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:49:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:12 smithi057 ceph-mon[92072]: pgmap v1659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:49:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:12 smithi122 ceph-mon[125440]: pgmap v1659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:49:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:14 smithi136 ceph-mon[125702]: pgmap v1660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:49:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:14 smithi136 ceph-mon[125702]: osdmap e179: 12 total, 12 up, 12 in 2023-03-02T11:49:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:14 smithi057 ceph-mon[92072]: pgmap v1660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:49:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:14 smithi057 ceph-mon[92072]: osdmap e179: 12 total, 12 up, 12 in 2023-03-02T11:49:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:14 smithi122 ceph-mon[125440]: pgmap v1660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:49:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:14 smithi122 ceph-mon[125440]: osdmap e179: 12 total, 12 up, 12 in 2023-03-02T11:49:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:16 smithi136 ceph-mon[125702]: pgmap v1662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:49:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:16 smithi057 ceph-mon[92072]: pgmap v1662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:49:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:16 smithi122 ceph-mon[125440]: pgmap v1662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:49:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:18 smithi136 ceph-mon[125702]: pgmap v1663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:49:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:18 smithi057 ceph-mon[92072]: pgmap v1663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:49:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:18 smithi122 ceph-mon[125440]: pgmap v1663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:49:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:20 smithi136 ceph-mon[125702]: pgmap v1664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:49:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:20 smithi057 ceph-mon[92072]: pgmap v1664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:49:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:20 smithi122 ceph-mon[125440]: pgmap v1664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:49:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:21.203+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:49:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:21.203+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:49:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:21.203+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:49:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:21.203+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:49:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:21.203+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:49:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:22 smithi136 ceph-mon[125702]: pgmap v1665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:49:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:22 smithi057 ceph-mon[92072]: pgmap v1665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:49:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:22 smithi122 ceph-mon[125440]: pgmap v1665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:49:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:24 smithi136 ceph-mon[125702]: pgmap v1666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:49:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:24 smithi057 ceph-mon[92072]: pgmap v1666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:49:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:24 smithi122 ceph-mon[125440]: pgmap v1666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:49:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:26 smithi057 ceph-mon[92072]: pgmap v1667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:49:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:26 smithi122 ceph-mon[125440]: pgmap v1667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:49:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:26 smithi136 ceph-mon[125702]: pgmap v1667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:49:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:28 smithi057 ceph-mon[92072]: pgmap v1668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:49:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:28 smithi122 ceph-mon[125440]: pgmap v1668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:49:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:28 smithi136 ceph-mon[125702]: pgmap v1668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:49:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:30 smithi057 ceph-mon[92072]: pgmap v1669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:30 smithi122 ceph-mon[125440]: pgmap v1669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:30 smithi136 ceph-mon[125702]: pgmap v1669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:32 smithi057 ceph-mon[92072]: pgmap v1670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:32 smithi122 ceph-mon[125440]: pgmap v1670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:32 smithi136 ceph-mon[125702]: pgmap v1670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:34 smithi057 ceph-mon[92072]: pgmap v1671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:34 smithi122 ceph-mon[125440]: pgmap v1671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:34 smithi136 ceph-mon[125702]: pgmap v1671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:36.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:49:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:36.218+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:49:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:36.218+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:49:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:36.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:49:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:36.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:49:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:36 smithi057 ceph-mon[92072]: pgmap v1672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:36 smithi122 ceph-mon[125440]: pgmap v1672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:36 smithi136 ceph-mon[125702]: pgmap v1672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:38 smithi057 ceph-mon[92072]: pgmap v1673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:39.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:38 smithi122 ceph-mon[125440]: pgmap v1673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:38 smithi136 ceph-mon[125702]: pgmap v1673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:40 smithi057 ceph-mon[92072]: pgmap v1674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:40 smithi122 ceph-mon[125440]: pgmap v1674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:40 smithi136 ceph-mon[125702]: pgmap v1674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:42 smithi057 ceph-mon[92072]: pgmap v1675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:42 smithi122 ceph-mon[125440]: pgmap v1675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:42 smithi136 ceph-mon[125702]: pgmap v1675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:44 smithi057 ceph-mon[92072]: pgmap v1676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:44 smithi122 ceph-mon[125440]: pgmap v1676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:44 smithi136 ceph-mon[125702]: pgmap v1676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:46 smithi057 ceph-mon[92072]: pgmap v1677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:46 smithi122 ceph-mon[125440]: pgmap v1677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:46 smithi136 ceph-mon[125702]: pgmap v1677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:48 smithi057 ceph-mon[92072]: pgmap v1678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:49:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:48 smithi122 ceph-mon[125440]: pgmap v1678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:49:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:48 smithi136 ceph-mon[125702]: pgmap v1678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:49:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:50 smithi136 ceph-mon[125702]: pgmap v1679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:49:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:49:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:49:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:50 smithi057 ceph-mon[92072]: pgmap v1679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:49:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:49:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:49:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:50 smithi122 ceph-mon[125440]: pgmap v1679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:49:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:49:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:49:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:51.231+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:49:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:51.231+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:49:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:51.231+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:49:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:51.231+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:49:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:49:51.231+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:49:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:52 smithi136 ceph-mon[125702]: pgmap v1680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:52 smithi057 ceph-mon[92072]: pgmap v1680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:52 smithi122 ceph-mon[125440]: pgmap v1680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:54 smithi136 ceph-mon[125702]: pgmap v1681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:54 smithi057 ceph-mon[92072]: pgmap v1681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:54 smithi122 ceph-mon[125440]: pgmap v1681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:56 smithi136 ceph-mon[125702]: pgmap v1682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:56 smithi057 ceph-mon[92072]: pgmap v1682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:56 smithi122 ceph-mon[125440]: pgmap v1682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:49:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:49:58 smithi136 ceph-mon[125702]: pgmap v1683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:49:58 smithi057 ceph-mon[92072]: pgmap v1683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:49:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:49:58 smithi122 ceph-mon[125440]: pgmap v1683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:00 smithi136 ceph-mon[125702]: pgmap v1684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T11:50:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:00 smithi057 ceph-mon[92072]: pgmap v1684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T11:50:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:00 smithi122 ceph-mon[125440]: pgmap v1684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T11:50:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:02 smithi136 ceph-mon[125702]: pgmap v1685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:02 smithi057 ceph-mon[92072]: pgmap v1685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:02.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:02 smithi122 ceph-mon[125440]: pgmap v1685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:04 smithi136 ceph-mon[125702]: pgmap v1686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:50:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:04 smithi057 ceph-mon[92072]: pgmap v1686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:50:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:04 smithi122 ceph-mon[125440]: pgmap v1686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:50:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:06.247+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:50:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:06.248+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:50:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:06.248+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:50:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:06.248+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:50:06.250 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:06.248+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:50:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:06 smithi057 ceph-mon[92072]: pgmap v1687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:50:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:06 smithi122 ceph-mon[125440]: pgmap v1687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:50:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:06 smithi136 ceph-mon[125702]: pgmap v1687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:50:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:08.794+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:50:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:08.794+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:50:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:08.794+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 29 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:50:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:08.795+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 28 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:50:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:08 smithi057 ceph-mon[92072]: pgmap v1688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:50:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:08 smithi122 ceph-mon[125440]: pgmap v1688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:50:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:08 smithi136 ceph-mon[125702]: pgmap v1688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:50:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:10 smithi057 ceph-mon[92072]: pgmap v1689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:50:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:10 smithi122 ceph-mon[125440]: pgmap v1689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:50:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:10 smithi136 ceph-mon[125702]: pgmap v1689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:50:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:11 smithi057 ceph-mon[92072]: osdmap e180: 12 total, 12 up, 12 in 2023-03-02T11:50:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:11 smithi122 ceph-mon[125440]: osdmap e180: 12 total, 12 up, 12 in 2023-03-02T11:50:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:11 smithi136 ceph-mon[125702]: osdmap e180: 12 total, 12 up, 12 in 2023-03-02T11:50:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:12 smithi057 ceph-mon[92072]: pgmap v1691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:50:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:12 smithi122 ceph-mon[125440]: pgmap v1691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:50:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:12 smithi136 ceph-mon[125702]: pgmap v1691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:50:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:14 smithi057 ceph-mon[92072]: pgmap v1692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:50:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:14 smithi057 ceph-mon[92072]: osdmap e181: 12 total, 12 up, 12 in 2023-03-02T11:50:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:14 smithi122 ceph-mon[125440]: pgmap v1692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:50:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:14 smithi122 ceph-mon[125440]: osdmap e181: 12 total, 12 up, 12 in 2023-03-02T11:50:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:14 smithi136 ceph-mon[125702]: pgmap v1692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:50:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:14 smithi136 ceph-mon[125702]: osdmap e181: 12 total, 12 up, 12 in 2023-03-02T11:50:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:16 smithi057 ceph-mon[92072]: pgmap v1694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:50:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:16 smithi122 ceph-mon[125440]: pgmap v1694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:50:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:16 smithi136 ceph-mon[125702]: pgmap v1694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:50:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:18 smithi057 ceph-mon[92072]: pgmap v1695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:50:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:18 smithi122 ceph-mon[125440]: pgmap v1695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:50:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:18 smithi136 ceph-mon[125702]: pgmap v1695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:50:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:20 smithi057 ceph-mon[92072]: pgmap v1696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:50:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:20 smithi122 ceph-mon[125440]: pgmap v1696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:50:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:20 smithi136 ceph-mon[125702]: pgmap v1696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:50:21.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:21.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:50:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:21.263+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:50:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:21.263+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:50:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:21.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:50:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:21.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:50:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:22 smithi057 ceph-mon[92072]: pgmap v1697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:50:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:22 smithi122 ceph-mon[125440]: pgmap v1697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:50:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:22 smithi136 ceph-mon[125702]: pgmap v1697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:50:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:24 smithi057 ceph-mon[92072]: pgmap v1698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:50:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:24 smithi122 ceph-mon[125440]: pgmap v1698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:50:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:24 smithi136 ceph-mon[125702]: pgmap v1698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:50:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:26 smithi057 ceph-mon[92072]: pgmap v1699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:50:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:26 smithi122 ceph-mon[125440]: pgmap v1699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:50:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:26 smithi136 ceph-mon[125702]: pgmap v1699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:50:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:28 smithi057 ceph-mon[92072]: pgmap v1700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:50:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:28 smithi122 ceph-mon[125440]: pgmap v1700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:50:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:28 smithi136 ceph-mon[125702]: pgmap v1700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:50:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:30 smithi057 ceph-mon[92072]: pgmap v1701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:30 smithi122 ceph-mon[125440]: pgmap v1701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:30 smithi136 ceph-mon[125702]: pgmap v1701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:32 smithi057 ceph-mon[92072]: pgmap v1702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:32 smithi122 ceph-mon[125440]: pgmap v1702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:32 smithi136 ceph-mon[125702]: pgmap v1702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:34 smithi057 ceph-mon[92072]: pgmap v1703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:34 smithi122 ceph-mon[125440]: pgmap v1703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:34 smithi136 ceph-mon[125702]: pgmap v1703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:36.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:50:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:36.279+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:50:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:36.279+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:50:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:36.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:50:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:36.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:50:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:36 smithi057 ceph-mon[92072]: pgmap v1704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:36 smithi122 ceph-mon[125440]: pgmap v1704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:36 smithi136 ceph-mon[125702]: pgmap v1704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:38 smithi057 ceph-mon[92072]: pgmap v1705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:38 smithi122 ceph-mon[125440]: pgmap v1705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:38 smithi136 ceph-mon[125702]: pgmap v1705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:40 smithi057 ceph-mon[92072]: pgmap v1706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:40 smithi122 ceph-mon[125440]: pgmap v1706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:40 smithi136 ceph-mon[125702]: pgmap v1706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:42 smithi057 ceph-mon[92072]: pgmap v1707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:42 smithi122 ceph-mon[125440]: pgmap v1707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:42 smithi136 ceph-mon[125702]: pgmap v1707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:44 smithi122 ceph-mon[125440]: pgmap v1708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:44 smithi136 ceph-mon[125702]: pgmap v1708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:44 smithi057 ceph-mon[92072]: pgmap v1708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:46 smithi122 ceph-mon[125440]: pgmap v1709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:47.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:46 smithi136 ceph-mon[125702]: pgmap v1709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:46 smithi057 ceph-mon[92072]: pgmap v1709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:48 smithi136 ceph-mon[125702]: pgmap v1710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:48 smithi057 ceph-mon[92072]: pgmap v1710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:48 smithi122 ceph-mon[125440]: pgmap v1710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:50 smithi136 ceph-mon[125702]: pgmap v1711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:51.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:50:51.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:50:51.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:50:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:50 smithi057 ceph-mon[92072]: pgmap v1711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:50:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:50:51.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:50:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:50 smithi122 ceph-mon[125440]: pgmap v1711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:50:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:50:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:50:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:51.294+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:50:51.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:51.294+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:50:51.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:51.294+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:50:51.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:51.294+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:50:51.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:50:51.294+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:50:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:50:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:50:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:50:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:50:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:50:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:50:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:50:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:50:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:50:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:53 smithi136 ceph-mon[125702]: pgmap v1712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:53 smithi057 ceph-mon[92072]: pgmap v1712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:53 smithi122 ceph-mon[125440]: pgmap v1712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:55 smithi136 ceph-mon[125702]: pgmap v1713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:55 smithi057 ceph-mon[92072]: pgmap v1713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:55 smithi122 ceph-mon[125440]: pgmap v1713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:56 smithi057 ceph-mon[92072]: pgmap v1714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:56 smithi122 ceph-mon[125440]: pgmap v1714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:56 smithi136 ceph-mon[125702]: pgmap v1714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:50:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:50:58 smithi136 ceph-mon[125702]: pgmap v1715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:50:58 smithi057 ceph-mon[92072]: pgmap v1715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:50:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:50:58 smithi122 ceph-mon[125440]: pgmap v1715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:00 smithi136 ceph-mon[125702]: pgmap v1716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:00 smithi057 ceph-mon[92072]: pgmap v1716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:00 smithi122 ceph-mon[125440]: pgmap v1716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:02 smithi057 ceph-mon[92072]: pgmap v1717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:02 smithi122 ceph-mon[125440]: pgmap v1717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:02 smithi136 ceph-mon[125702]: pgmap v1717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:04 smithi057 ceph-mon[92072]: pgmap v1718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:51:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:04 smithi122 ceph-mon[125440]: pgmap v1718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:51:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:04 smithi136 ceph-mon[125702]: pgmap v1718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:51:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:06.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:51:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:06.297+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:51:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:06.297+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:51:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:06.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:51:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:06.298+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:51:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:06 smithi057 ceph-mon[92072]: pgmap v1719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:51:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:06 smithi122 ceph-mon[125440]: pgmap v1719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:51:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:06 smithi136 ceph-mon[125702]: pgmap v1719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:51:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:08 smithi057 ceph-mon[92072]: pgmap v1720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:51:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:08 smithi122 ceph-mon[125440]: pgmap v1720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:51:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:08 smithi136 ceph-mon[125702]: pgmap v1720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:51:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:10 smithi057 ceph-mon[92072]: pgmap v1721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:51:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:10 smithi122 ceph-mon[125440]: pgmap v1721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:51:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:10 smithi136 ceph-mon[125702]: pgmap v1721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:51:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:11 smithi057 ceph-mon[92072]: osdmap e182: 12 total, 12 up, 12 in 2023-03-02T11:51:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:11 smithi122 ceph-mon[125440]: osdmap e182: 12 total, 12 up, 12 in 2023-03-02T11:51:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:11 smithi136 ceph-mon[125702]: osdmap e182: 12 total, 12 up, 12 in 2023-03-02T11:51:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:12 smithi057 ceph-mon[92072]: pgmap v1723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:51:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:12 smithi122 ceph-mon[125440]: pgmap v1723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:51:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:12 smithi136 ceph-mon[125702]: pgmap v1723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:51:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:14 smithi057 ceph-mon[92072]: pgmap v1724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:51:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:14 smithi057 ceph-mon[92072]: osdmap e183: 12 total, 12 up, 12 in 2023-03-02T11:51:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:14 smithi122 ceph-mon[125440]: pgmap v1724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:51:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:14 smithi122 ceph-mon[125440]: osdmap e183: 12 total, 12 up, 12 in 2023-03-02T11:51:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:14 smithi136 ceph-mon[125702]: pgmap v1724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:51:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:14 smithi136 ceph-mon[125702]: osdmap e183: 12 total, 12 up, 12 in 2023-03-02T11:51:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:16 smithi057 ceph-mon[92072]: pgmap v1726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:51:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:16 smithi122 ceph-mon[125440]: pgmap v1726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:51:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:16 smithi136 ceph-mon[125702]: pgmap v1726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:51:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:18 smithi057 ceph-mon[92072]: pgmap v1727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:51:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:18 smithi122 ceph-mon[125440]: pgmap v1727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:51:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:18 smithi136 ceph-mon[125702]: pgmap v1727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:51:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:20 smithi057 ceph-mon[92072]: pgmap v1728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:51:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:20 smithi122 ceph-mon[125440]: pgmap v1728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:51:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:20 smithi136 ceph-mon[125702]: pgmap v1728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:51:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:21.304+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:51:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:21.305+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:51:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:21.305+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:51:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:21.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:51:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:21.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:51:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:22 smithi057 ceph-mon[92072]: pgmap v1729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:51:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:22 smithi122 ceph-mon[125440]: pgmap v1729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:51:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:22 smithi136 ceph-mon[125702]: pgmap v1729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:51:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:24 smithi057 ceph-mon[92072]: pgmap v1730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:51:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:24 smithi122 ceph-mon[125440]: pgmap v1730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:51:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:24 smithi136 ceph-mon[125702]: pgmap v1730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:51:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:26 smithi057 ceph-mon[92072]: pgmap v1731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:51:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:26 smithi122 ceph-mon[125440]: pgmap v1731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:51:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:26 smithi136 ceph-mon[125702]: pgmap v1731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:51:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:28 smithi057 ceph-mon[92072]: pgmap v1732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:51:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:28 smithi122 ceph-mon[125440]: pgmap v1732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:51:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:28 smithi136 ceph-mon[125702]: pgmap v1732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:51:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:30 smithi057 ceph-mon[92072]: pgmap v1733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:51:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:30 smithi122 ceph-mon[125440]: pgmap v1733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:51:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:30 smithi136 ceph-mon[125702]: pgmap v1733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:51:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:32 smithi057 ceph-mon[92072]: pgmap v1734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:51:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:32 smithi122 ceph-mon[125440]: pgmap v1734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:51:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:32 smithi136 ceph-mon[125702]: pgmap v1734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:51:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:34 smithi057 ceph-mon[92072]: pgmap v1735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:34 smithi122 ceph-mon[125440]: pgmap v1735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:34 smithi136 ceph-mon[125702]: pgmap v1735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:36.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:51:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:36.318+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:51:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:36.318+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:51:36.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:36.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:51:36.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:36.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:51:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:36 smithi057 ceph-mon[92072]: pgmap v1736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:51:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:36 smithi122 ceph-mon[125440]: pgmap v1736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:51:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:36 smithi136 ceph-mon[125702]: pgmap v1736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:51:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:38 smithi057 ceph-mon[92072]: pgmap v1737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:38 smithi122 ceph-mon[125440]: pgmap v1737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:38 smithi136 ceph-mon[125702]: pgmap v1737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:40 smithi122 ceph-mon[125440]: pgmap v1738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:40 smithi136 ceph-mon[125702]: pgmap v1738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:40 smithi057 ceph-mon[92072]: pgmap v1738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:42 smithi122 ceph-mon[125440]: pgmap v1739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:42 smithi136 ceph-mon[125702]: pgmap v1739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:42 smithi057 ceph-mon[92072]: pgmap v1739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:44 smithi122 ceph-mon[125440]: pgmap v1740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:44 smithi136 ceph-mon[125702]: pgmap v1740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:44 smithi057 ceph-mon[92072]: pgmap v1740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:46 smithi122 ceph-mon[125440]: pgmap v1741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:46 smithi136 ceph-mon[125702]: pgmap v1741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:46 smithi057 ceph-mon[92072]: pgmap v1741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:48 smithi136 ceph-mon[125702]: pgmap v1742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:48 smithi057 ceph-mon[92072]: pgmap v1742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:48 smithi122 ceph-mon[125440]: pgmap v1742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:50 smithi136 ceph-mon[125702]: pgmap v1743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:50 smithi057 ceph-mon[92072]: pgmap v1743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:50 smithi122 ceph-mon[125440]: pgmap v1743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:51.332+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:51:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:51.333+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:51:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:51.333+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:51:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:51.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:51:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:51:51.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:51:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:51:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:51:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:51:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:52 smithi136 ceph-mon[125702]: pgmap v1744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:52 smithi057 ceph-mon[92072]: pgmap v1744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:52 smithi122 ceph-mon[125440]: pgmap v1744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:51:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:51:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:51:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:51:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:51:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:51:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:51:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:54 smithi136 ceph-mon[125702]: pgmap v1745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:54 smithi057 ceph-mon[92072]: pgmap v1745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:54 smithi122 ceph-mon[125440]: pgmap v1745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:56 smithi136 ceph-mon[125702]: pgmap v1746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:56 smithi057 ceph-mon[92072]: pgmap v1746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:57.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:56 smithi122 ceph-mon[125440]: pgmap v1746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:51:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:51:58 smithi136 ceph-mon[125702]: pgmap v1747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:51:58 smithi057 ceph-mon[92072]: pgmap v1747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:51:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:51:58 smithi122 ceph-mon[125440]: pgmap v1747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:00 smithi136 ceph-mon[125702]: pgmap v1748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:00 smithi057 ceph-mon[92072]: pgmap v1748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:00 smithi122 ceph-mon[125440]: pgmap v1748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:02 smithi057 ceph-mon[92072]: pgmap v1749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:02 smithi122 ceph-mon[125440]: pgmap v1749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:02 smithi136 ceph-mon[125702]: pgmap v1749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:04 smithi057 ceph-mon[92072]: pgmap v1750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:52:05.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:04 smithi122 ceph-mon[125440]: pgmap v1750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:52:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:04 smithi136 ceph-mon[125702]: pgmap v1750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:52:06.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:06.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:52:06.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:06.341+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:52:06.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:06.341+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:52:06.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:06.341+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:52:06.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:06.341+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:52:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:06 smithi057 ceph-mon[92072]: pgmap v1751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:52:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:06 smithi122 ceph-mon[125440]: pgmap v1751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:52:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:06 smithi136 ceph-mon[125702]: pgmap v1751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:52:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:08 smithi057 ceph-mon[92072]: pgmap v1752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:52:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:08 smithi122 ceph-mon[125440]: pgmap v1752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:52:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:08 smithi136 ceph-mon[125702]: pgmap v1752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:52:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:10 smithi057 ceph-mon[92072]: pgmap v1753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:52:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:10 smithi122 ceph-mon[125440]: pgmap v1753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:52:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:10 smithi136 ceph-mon[125702]: pgmap v1753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:52:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:11 smithi057 ceph-mon[92072]: osdmap e184: 12 total, 12 up, 12 in 2023-03-02T11:52:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:11 smithi122 ceph-mon[125440]: osdmap e184: 12 total, 12 up, 12 in 2023-03-02T11:52:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:11 smithi136 ceph-mon[125702]: osdmap e184: 12 total, 12 up, 12 in 2023-03-02T11:52:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:12 smithi057 ceph-mon[92072]: pgmap v1755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:52:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:12 smithi122 ceph-mon[125440]: pgmap v1755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:52:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:12 smithi136 ceph-mon[125702]: pgmap v1755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:52:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:14 smithi057 ceph-mon[92072]: pgmap v1756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:52:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:14 smithi057 ceph-mon[92072]: osdmap e185: 12 total, 12 up, 12 in 2023-03-02T11:52:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:14 smithi122 ceph-mon[125440]: pgmap v1756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:52:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:14 smithi122 ceph-mon[125440]: osdmap e185: 12 total, 12 up, 12 in 2023-03-02T11:52:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:14 smithi136 ceph-mon[125702]: pgmap v1756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:52:15.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:14 smithi136 ceph-mon[125702]: osdmap e185: 12 total, 12 up, 12 in 2023-03-02T11:52:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:16 smithi057 ceph-mon[92072]: pgmap v1758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:52:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:16 smithi122 ceph-mon[125440]: pgmap v1758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:52:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:16 smithi136 ceph-mon[125702]: pgmap v1758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:52:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:18 smithi057 ceph-mon[92072]: pgmap v1759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:52:19.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:18 smithi122 ceph-mon[125440]: pgmap v1759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:52:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:18 smithi136 ceph-mon[125702]: pgmap v1759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:52:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:20 smithi057 ceph-mon[92072]: pgmap v1760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:52:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:20 smithi122 ceph-mon[125440]: pgmap v1760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:52:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:20 smithi136 ceph-mon[125702]: pgmap v1760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T11:52:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:21.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:52:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:21.349+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:52:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:21.349+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:52:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:21.349+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:52:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:21.349+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:52:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:22 smithi057 ceph-mon[92072]: pgmap v1761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:52:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:22 smithi122 ceph-mon[125440]: pgmap v1761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:52:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:22 smithi136 ceph-mon[125702]: pgmap v1761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:52:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:24 smithi057 ceph-mon[92072]: pgmap v1762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:52:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:24 smithi122 ceph-mon[125440]: pgmap v1762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:52:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:24 smithi136 ceph-mon[125702]: pgmap v1762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:52:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:26 smithi057 ceph-mon[92072]: pgmap v1763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:52:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:26 smithi122 ceph-mon[125440]: pgmap v1763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:52:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:26 smithi136 ceph-mon[125702]: pgmap v1763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:52:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:28 smithi057 ceph-mon[92072]: pgmap v1764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:52:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:28 smithi122 ceph-mon[125440]: pgmap v1764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:52:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:28 smithi136 ceph-mon[125702]: pgmap v1764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:52:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:30 smithi057 ceph-mon[92072]: pgmap v1765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:30 smithi122 ceph-mon[125440]: pgmap v1765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:30 smithi136 ceph-mon[125702]: pgmap v1765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:32 smithi057 ceph-mon[92072]: pgmap v1766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:32 smithi122 ceph-mon[125440]: pgmap v1766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:32 smithi136 ceph-mon[125702]: pgmap v1766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:34 smithi057 ceph-mon[92072]: pgmap v1767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:34 smithi122 ceph-mon[125440]: pgmap v1767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:34 smithi136 ceph-mon[125702]: pgmap v1767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:36.363+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:52:36.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:36.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:52:36.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:36.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:52:36.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:36.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:52:36.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:36.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:52:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:36 smithi057 ceph-mon[92072]: pgmap v1768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:37.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:36 smithi122 ceph-mon[125440]: pgmap v1768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:36 smithi136 ceph-mon[125702]: pgmap v1768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:38 smithi057 ceph-mon[92072]: pgmap v1769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:38 smithi122 ceph-mon[125440]: pgmap v1769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:38 smithi136 ceph-mon[125702]: pgmap v1769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:40 smithi122 ceph-mon[125440]: pgmap v1770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:40 smithi136 ceph-mon[125702]: pgmap v1770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:40 smithi057 ceph-mon[92072]: pgmap v1770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:42 smithi122 ceph-mon[125440]: pgmap v1771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:42 smithi136 ceph-mon[125702]: pgmap v1771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:42 smithi057 ceph-mon[92072]: pgmap v1771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:44 smithi136 ceph-mon[125702]: pgmap v1772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:44 smithi057 ceph-mon[92072]: pgmap v1772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:44 smithi122 ceph-mon[125440]: pgmap v1772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:46 smithi136 ceph-mon[125702]: pgmap v1773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:46 smithi057 ceph-mon[92072]: pgmap v1773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:47.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:46 smithi122 ceph-mon[125440]: pgmap v1773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:49.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:48 smithi136 ceph-mon[125702]: pgmap v1774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:48 smithi057 ceph-mon[92072]: pgmap v1774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:48 smithi122 ceph-mon[125440]: pgmap v1774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:50 smithi136 ceph-mon[125702]: pgmap v1775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:51.367+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:52:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:51.368+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:52:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:51.368+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:52:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:51.368+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:52:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:52:51.368+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:52:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:50 smithi057 ceph-mon[92072]: pgmap v1775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:50 smithi122 ceph-mon[125440]: pgmap v1775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:52 smithi136 ceph-mon[125702]: pgmap v1776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:52 smithi057 ceph-mon[92072]: pgmap v1776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:53.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:52 smithi122 ceph-mon[125440]: pgmap v1776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:52:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:52:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:52:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:55 smithi136 ceph-mon[125702]: pgmap v1777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:55.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:52:55.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:52:55.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:52:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:55 smithi057 ceph-mon[92072]: pgmap v1777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:52:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:52:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:52:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:55 smithi122 ceph-mon[125440]: pgmap v1777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:52:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:52:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:52:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:57 smithi136 ceph-mon[125702]: pgmap v1778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:57 smithi057 ceph-mon[92072]: pgmap v1778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:57.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:57 smithi122 ceph-mon[125440]: pgmap v1778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:52:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:52:59 smithi136 ceph-mon[125702]: pgmap v1779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:52:59 smithi057 ceph-mon[92072]: pgmap v1779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:52:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:52:59 smithi122 ceph-mon[125440]: pgmap v1779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:01 smithi136 ceph-mon[125702]: pgmap v1780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:01 smithi057 ceph-mon[92072]: pgmap v1780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:01 smithi122 ceph-mon[125440]: pgmap v1780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:03 smithi136 ceph-mon[125702]: pgmap v1781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:03 smithi057 ceph-mon[92072]: pgmap v1781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:03.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:03 smithi122 ceph-mon[125440]: pgmap v1781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:05 smithi136 ceph-mon[125702]: pgmap v1782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:53:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:05 smithi057 ceph-mon[92072]: pgmap v1782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:53:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:05 smithi122 ceph-mon[125440]: pgmap v1782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:53:06.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:06.380+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:53:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:06.381+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:53:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:06.381+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:53:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:06.381+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:53:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:06.381+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:53:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:07 smithi136 ceph-mon[125702]: pgmap v1783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:53:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:07 smithi057 ceph-mon[92072]: pgmap v1783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:53:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:07 smithi122 ceph-mon[125440]: pgmap v1783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:53:08.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:08.820+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:53:08.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:08.820+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:53:08.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:08.820+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 29 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:53:08.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:08.820+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 30 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:53:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:09 smithi136 ceph-mon[125702]: pgmap v1784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:53:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:09 smithi057 ceph-mon[92072]: pgmap v1784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:53:09.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:09 smithi122 ceph-mon[125440]: pgmap v1784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:53:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:11 smithi136 ceph-mon[125702]: pgmap v1785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:53:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:11 smithi057 ceph-mon[92072]: pgmap v1785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:53:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:11 smithi122 ceph-mon[125440]: pgmap v1785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:53:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:12 smithi136 ceph-mon[125702]: osdmap e186: 12 total, 12 up, 12 in 2023-03-02T11:53:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:12 smithi057 ceph-mon[92072]: osdmap e186: 12 total, 12 up, 12 in 2023-03-02T11:53:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:12 smithi122 ceph-mon[125440]: osdmap e186: 12 total, 12 up, 12 in 2023-03-02T11:53:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:13 smithi136 ceph-mon[125702]: pgmap v1787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:53:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:13 smithi057 ceph-mon[92072]: pgmap v1787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:53:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:13 smithi122 ceph-mon[125440]: pgmap v1787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:53:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:15 smithi136 ceph-mon[125702]: pgmap v1788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:53:15.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:15 smithi136 ceph-mon[125702]: osdmap e187: 12 total, 12 up, 12 in 2023-03-02T11:53:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:15 smithi057 ceph-mon[92072]: pgmap v1788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:53:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:15 smithi057 ceph-mon[92072]: osdmap e187: 12 total, 12 up, 12 in 2023-03-02T11:53:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:15 smithi122 ceph-mon[125440]: pgmap v1788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:53:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:15 smithi122 ceph-mon[125440]: osdmap e187: 12 total, 12 up, 12 in 2023-03-02T11:53:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:17 smithi136 ceph-mon[125702]: pgmap v1790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:53:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:17 smithi057 ceph-mon[92072]: pgmap v1790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:53:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:17 smithi122 ceph-mon[125440]: pgmap v1790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:53:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:19 smithi136 ceph-mon[125702]: pgmap v1791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:53:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:19 smithi057 ceph-mon[92072]: pgmap v1791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:53:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:19 smithi122 ceph-mon[125440]: pgmap v1791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:53:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:21 smithi136 ceph-mon[125702]: pgmap v1792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T11:53:21.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:21.390+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:53:21.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:21.390+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:53:21.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:21.390+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:53:21.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:21.390+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:53:21.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:21.390+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:53:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:21 smithi057 ceph-mon[92072]: pgmap v1792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T11:53:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:21 smithi122 ceph-mon[125440]: pgmap v1792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T11:53:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:23 smithi136 ceph-mon[125702]: pgmap v1793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:53:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:23 smithi057 ceph-mon[92072]: pgmap v1793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:53:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:23 smithi122 ceph-mon[125440]: pgmap v1793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:53:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:25 smithi136 ceph-mon[125702]: pgmap v1794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:53:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:25 smithi057 ceph-mon[92072]: pgmap v1794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:53:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:25 smithi122 ceph-mon[125440]: pgmap v1794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:53:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:27 smithi136 ceph-mon[125702]: pgmap v1795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:53:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:27 smithi057 ceph-mon[92072]: pgmap v1795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:53:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:27 smithi122 ceph-mon[125440]: pgmap v1795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:53:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:29 smithi057 ceph-mon[92072]: pgmap v1796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:53:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:29 smithi122 ceph-mon[125440]: pgmap v1796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:53:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:29 smithi136 ceph-mon[125702]: pgmap v1796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:53:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:31 smithi057 ceph-mon[92072]: pgmap v1797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:31 smithi122 ceph-mon[125440]: pgmap v1797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:31 smithi136 ceph-mon[125702]: pgmap v1797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:33 smithi057 ceph-mon[92072]: pgmap v1798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:33 smithi122 ceph-mon[125440]: pgmap v1798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:33 smithi136 ceph-mon[125702]: pgmap v1798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:34 smithi057 ceph-mon[92072]: pgmap v1799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:34 smithi122 ceph-mon[125440]: pgmap v1799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:34 smithi136 ceph-mon[125702]: pgmap v1799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:36.401+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:53:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:36.401+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:53:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:36.401+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:53:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:36.401+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:53:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:36.401+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:53:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:36 smithi057 ceph-mon[92072]: pgmap v1800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:36 smithi122 ceph-mon[125440]: pgmap v1800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:37.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:36 smithi136 ceph-mon[125702]: pgmap v1800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:38 smithi057 ceph-mon[92072]: pgmap v1801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:38 smithi122 ceph-mon[125440]: pgmap v1801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:38 smithi136 ceph-mon[125702]: pgmap v1801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:40 smithi057 ceph-mon[92072]: pgmap v1802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:40 smithi122 ceph-mon[125440]: pgmap v1802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:40 smithi136 ceph-mon[125702]: pgmap v1802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:42 smithi057 ceph-mon[92072]: pgmap v1803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:42 smithi122 ceph-mon[125440]: pgmap v1803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:42 smithi136 ceph-mon[125702]: pgmap v1803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:44 smithi057 ceph-mon[92072]: pgmap v1804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:44 smithi122 ceph-mon[125440]: pgmap v1804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:44 smithi136 ceph-mon[125702]: pgmap v1804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:46 smithi057 ceph-mon[92072]: pgmap v1805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:46 smithi122 ceph-mon[125440]: pgmap v1805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:46 smithi136 ceph-mon[125702]: pgmap v1805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:48 smithi057 ceph-mon[92072]: pgmap v1806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:48 smithi122 ceph-mon[125440]: pgmap v1806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:48 smithi136 ceph-mon[125702]: pgmap v1806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:50 smithi057 ceph-mon[92072]: pgmap v1807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:50 smithi122 ceph-mon[125440]: pgmap v1807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:50 smithi136 ceph-mon[125702]: pgmap v1807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:51.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:51.415+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:53:51.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:51.415+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:53:51.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:51.415+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:53:51.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:51.415+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:53:51.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:53:51.415+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:53:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:52 smithi057 ceph-mon[92072]: pgmap v1808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:52 smithi122 ceph-mon[125440]: pgmap v1808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:52 smithi136 ceph-mon[125702]: pgmap v1808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:54 smithi057 ceph-mon[92072]: pgmap v1809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:53:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:54 smithi122 ceph-mon[125440]: pgmap v1809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:53:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:54 smithi136 ceph-mon[125702]: pgmap v1809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:53:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:53:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:53:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:53:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:53:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:53:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:53:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:53:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:53:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:53:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:56 smithi057 ceph-mon[92072]: pgmap v1810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:56 smithi122 ceph-mon[125440]: pgmap v1810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:56 smithi136 ceph-mon[125702]: pgmap v1810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:53:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:53:58 smithi122 ceph-mon[125440]: pgmap v1811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:53:58 smithi136 ceph-mon[125702]: pgmap v1811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:53:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:53:58 smithi057 ceph-mon[92072]: pgmap v1811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:00 smithi122 ceph-mon[125440]: pgmap v1812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:00 smithi136 ceph-mon[125702]: pgmap v1812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:00 smithi057 ceph-mon[92072]: pgmap v1812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:02 smithi122 ceph-mon[125440]: pgmap v1813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:02 smithi136 ceph-mon[125702]: pgmap v1813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:02 smithi057 ceph-mon[92072]: pgmap v1813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:04 smithi122 ceph-mon[125440]: pgmap v1814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:54:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:04 smithi136 ceph-mon[125702]: pgmap v1814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:54:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:04 smithi057 ceph-mon[92072]: pgmap v1814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:54:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:06.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:54:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:06.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:54:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:06.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:54:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:06.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:54:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:06.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:54:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:06 smithi136 ceph-mon[125702]: pgmap v1815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:54:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:06 smithi057 ceph-mon[92072]: pgmap v1815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:54:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:06 smithi122 ceph-mon[125440]: pgmap v1815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:54:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:08 smithi136 ceph-mon[125702]: pgmap v1816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:54:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:08 smithi057 ceph-mon[92072]: pgmap v1816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:54:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:08 smithi122 ceph-mon[125440]: pgmap v1816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:54:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:10 smithi136 ceph-mon[125702]: pgmap v1817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:54:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:10 smithi057 ceph-mon[92072]: pgmap v1817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:54:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:10 smithi122 ceph-mon[125440]: pgmap v1817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:54:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:11 smithi136 ceph-mon[125702]: osdmap e188: 12 total, 12 up, 12 in 2023-03-02T11:54:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:11 smithi057 ceph-mon[92072]: osdmap e188: 12 total, 12 up, 12 in 2023-03-02T11:54:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:11 smithi122 ceph-mon[125440]: osdmap e188: 12 total, 12 up, 12 in 2023-03-02T11:54:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:12 smithi136 ceph-mon[125702]: pgmap v1819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:54:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:12 smithi057 ceph-mon[92072]: pgmap v1819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:54:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:12 smithi122 ceph-mon[125440]: pgmap v1819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:54:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:14 smithi136 ceph-mon[125702]: pgmap v1820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:54:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:14 smithi136 ceph-mon[125702]: osdmap e189: 12 total, 12 up, 12 in 2023-03-02T11:54:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:14 smithi057 ceph-mon[92072]: pgmap v1820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:54:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:14 smithi057 ceph-mon[92072]: osdmap e189: 12 total, 12 up, 12 in 2023-03-02T11:54:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:14 smithi122 ceph-mon[125440]: pgmap v1820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:54:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:14 smithi122 ceph-mon[125440]: osdmap e189: 12 total, 12 up, 12 in 2023-03-02T11:54:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:16 smithi136 ceph-mon[125702]: pgmap v1822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:54:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:16 smithi057 ceph-mon[92072]: pgmap v1822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:54:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:16 smithi122 ceph-mon[125440]: pgmap v1822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:54:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:18 smithi136 ceph-mon[125702]: pgmap v1823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:54:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:18 smithi057 ceph-mon[92072]: pgmap v1823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:54:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:18 smithi122 ceph-mon[125440]: pgmap v1823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:54:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:20 smithi136 ceph-mon[125702]: pgmap v1824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:54:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:20 smithi057 ceph-mon[92072]: pgmap v1824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:54:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:20 smithi122 ceph-mon[125440]: pgmap v1824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T11:54:21.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:21.437+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:54:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:21.437+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:54:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:21.437+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:54:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:21.437+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:54:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:21.437+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:54:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:22 smithi136 ceph-mon[125702]: pgmap v1825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:54:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:22 smithi057 ceph-mon[92072]: pgmap v1825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:54:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:22 smithi122 ceph-mon[125440]: pgmap v1825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:54:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:24 smithi136 ceph-mon[125702]: pgmap v1826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:54:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:24 smithi057 ceph-mon[92072]: pgmap v1826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:54:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:24 smithi122 ceph-mon[125440]: pgmap v1826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:54:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:26 smithi136 ceph-mon[125702]: pgmap v1827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:54:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:26 smithi057 ceph-mon[92072]: pgmap v1827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:54:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:26 smithi122 ceph-mon[125440]: pgmap v1827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:54:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:28 smithi136 ceph-mon[125702]: pgmap v1828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:54:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:28 smithi057 ceph-mon[92072]: pgmap v1828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:54:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:28 smithi122 ceph-mon[125440]: pgmap v1828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:54:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:30 smithi136 ceph-mon[125702]: pgmap v1829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:30 smithi057 ceph-mon[92072]: pgmap v1829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:30 smithi122 ceph-mon[125440]: pgmap v1829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:32 smithi136 ceph-mon[125702]: pgmap v1830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:32 smithi057 ceph-mon[92072]: pgmap v1830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:32 smithi122 ceph-mon[125440]: pgmap v1830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:34 smithi136 ceph-mon[125702]: pgmap v1831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:34 smithi057 ceph-mon[92072]: pgmap v1831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:34 smithi122 ceph-mon[125440]: pgmap v1831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:36.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:54:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:36.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:54:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:36.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:54:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:36.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:54:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:36.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:54:37.065 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:36 smithi136 ceph-mon[125702]: pgmap v1832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:36 smithi057 ceph-mon[92072]: pgmap v1832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:37.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:36 smithi122 ceph-mon[125440]: pgmap v1832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:38.790 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:38 smithi136 ceph-mon[125702]: pgmap v1833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:38 smithi057 ceph-mon[92072]: pgmap v1833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:38 smithi122 ceph-mon[125440]: pgmap v1833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:40 smithi136 ceph-mon[125702]: pgmap v1834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:40 smithi057 ceph-mon[92072]: pgmap v1834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:40 smithi122 ceph-mon[125440]: pgmap v1834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:42 smithi136 ceph-mon[125702]: pgmap v1835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:42 smithi057 ceph-mon[92072]: pgmap v1835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:42 smithi122 ceph-mon[125440]: pgmap v1835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:44 smithi136 ceph-mon[125702]: pgmap v1836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:44 smithi057 ceph-mon[92072]: pgmap v1836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:44 smithi122 ceph-mon[125440]: pgmap v1836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:46 smithi136 ceph-mon[125702]: pgmap v1837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:46 smithi057 ceph-mon[92072]: pgmap v1837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:46 smithi122 ceph-mon[125440]: pgmap v1837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:54:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:48 smithi136 ceph-mon[125702]: pgmap v1838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:48 smithi057 ceph-mon[92072]: pgmap v1838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:48 smithi122 ceph-mon[125440]: pgmap v1838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:50 smithi136 ceph-mon[125702]: pgmap v1839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:54:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:50 smithi057 ceph-mon[92072]: pgmap v1839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:54:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:50 smithi122 ceph-mon[125440]: pgmap v1839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:54:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:51.466+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:54:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:51.466+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:54:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:51.466+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:54:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:51.466+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:54:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:54:51.466+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:54:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:52 smithi136 ceph-mon[125702]: pgmap v1840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:54:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:52 smithi057 ceph-mon[92072]: pgmap v1840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:54:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:52 smithi122 ceph-mon[125440]: pgmap v1840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:54:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:54 smithi136 ceph-mon[125702]: pgmap v1841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:54 smithi057 ceph-mon[92072]: pgmap v1841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:54 smithi122 ceph-mon[125440]: pgmap v1841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:54:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:54:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:54:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:56 smithi136 ceph-mon[125702]: pgmap v1842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:54:57.094 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:56 smithi057 ceph-mon[92072]: pgmap v1842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:54:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:56 smithi122 ceph-mon[125440]: pgmap v1842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T11:54:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:54:58 smithi136 ceph-mon[125702]: pgmap v1843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:54:58 smithi057 ceph-mon[92072]: pgmap v1843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:54:59.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:54:58 smithi122 ceph-mon[125440]: pgmap v1843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:00 smithi136 ceph-mon[125702]: pgmap v1844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:55:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:55:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:55:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:55:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:55:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:00 smithi057 ceph-mon[92072]: pgmap v1844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:55:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:55:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:55:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:55:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:55:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:00 smithi122 ceph-mon[125440]: pgmap v1844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:02 smithi057 ceph-mon[92072]: pgmap v1845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:02 smithi122 ceph-mon[125440]: pgmap v1845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:02 smithi136 ceph-mon[125702]: pgmap v1845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:04 smithi057 ceph-mon[92072]: pgmap v1846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:55:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:04 smithi122 ceph-mon[125440]: pgmap v1846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:55:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:04 smithi136 ceph-mon[125702]: pgmap v1846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:55:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:06.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:55:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:06.481+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:55:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:06.481+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:55:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:06.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:55:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:06.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:55:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:06 smithi057 ceph-mon[92072]: pgmap v1847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:55:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:06 smithi122 ceph-mon[125440]: pgmap v1847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:55:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:06 smithi136 ceph-mon[125702]: pgmap v1847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:55:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:08 smithi057 ceph-mon[92072]: pgmap v1848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:55:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:08 smithi122 ceph-mon[125440]: pgmap v1848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:55:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:08 smithi136 ceph-mon[125702]: pgmap v1848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:55:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:10 smithi057 ceph-mon[92072]: pgmap v1849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:55:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:10 smithi122 ceph-mon[125440]: pgmap v1849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:55:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:10 smithi136 ceph-mon[125702]: pgmap v1849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:55:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:11 smithi122 ceph-mon[125440]: osdmap e190: 12 total, 12 up, 12 in 2023-03-02T11:55:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:11 smithi136 ceph-mon[125702]: osdmap e190: 12 total, 12 up, 12 in 2023-03-02T11:55:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:11 smithi057 ceph-mon[92072]: osdmap e190: 12 total, 12 up, 12 in 2023-03-02T11:55:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:12 smithi122 ceph-mon[125440]: pgmap v1851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:55:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:12 smithi136 ceph-mon[125702]: pgmap v1851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:55:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:12 smithi057 ceph-mon[92072]: pgmap v1851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:55:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:14 smithi122 ceph-mon[125440]: pgmap v1852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:55:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:14 smithi122 ceph-mon[125440]: osdmap e191: 12 total, 12 up, 12 in 2023-03-02T11:55:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:14 smithi136 ceph-mon[125702]: pgmap v1852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:55:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:14 smithi136 ceph-mon[125702]: osdmap e191: 12 total, 12 up, 12 in 2023-03-02T11:55:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:14 smithi057 ceph-mon[92072]: pgmap v1852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:55:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:14 smithi057 ceph-mon[92072]: osdmap e191: 12 total, 12 up, 12 in 2023-03-02T11:55:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:16 smithi136 ceph-mon[125702]: pgmap v1854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:55:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:16 smithi057 ceph-mon[92072]: pgmap v1854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:55:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:16 smithi122 ceph-mon[125440]: pgmap v1854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:55:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:18 smithi136 ceph-mon[125702]: pgmap v1855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:55:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:18 smithi057 ceph-mon[92072]: pgmap v1855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:55:19.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:18 smithi122 ceph-mon[125440]: pgmap v1855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:55:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:20 smithi136 ceph-mon[125702]: pgmap v1856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:55:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:20 smithi057 ceph-mon[92072]: pgmap v1856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:55:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:20 smithi122 ceph-mon[125440]: pgmap v1856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:55:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:21.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:55:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:21.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:55:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:21.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:55:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:21.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:55:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:21.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:55:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:22 smithi136 ceph-mon[125702]: pgmap v1857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:55:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:22 smithi057 ceph-mon[92072]: pgmap v1857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:55:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:22 smithi122 ceph-mon[125440]: pgmap v1857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:55:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:24 smithi136 ceph-mon[125702]: pgmap v1858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:55:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:24 smithi057 ceph-mon[92072]: pgmap v1858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:55:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:24 smithi122 ceph-mon[125440]: pgmap v1858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:55:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:26 smithi136 ceph-mon[125702]: pgmap v1859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:55:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:26 smithi057 ceph-mon[92072]: pgmap v1859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:55:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:26 smithi122 ceph-mon[125440]: pgmap v1859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:55:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:28 smithi136 ceph-mon[125702]: pgmap v1860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:55:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:28 smithi057 ceph-mon[92072]: pgmap v1860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:55:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:28 smithi122 ceph-mon[125440]: pgmap v1860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:55:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:30 smithi136 ceph-mon[125702]: pgmap v1861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:30 smithi057 ceph-mon[92072]: pgmap v1861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:30 smithi122 ceph-mon[125440]: pgmap v1861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:32 smithi136 ceph-mon[125702]: pgmap v1862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:32 smithi057 ceph-mon[92072]: pgmap v1862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:32 smithi122 ceph-mon[125440]: pgmap v1862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:34 smithi136 ceph-mon[125702]: pgmap v1863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:34 smithi057 ceph-mon[92072]: pgmap v1863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:34 smithi122 ceph-mon[125440]: pgmap v1863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:36.512+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:55:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:36.512+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:55:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:36.512+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:55:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:36.512+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:55:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:36.512+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:55:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:36 smithi136 ceph-mon[125702]: pgmap v1864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:36 smithi057 ceph-mon[92072]: pgmap v1864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:37.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:36 smithi122 ceph-mon[125440]: pgmap v1864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:38 smithi136 ceph-mon[125702]: pgmap v1865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:38 smithi057 ceph-mon[92072]: pgmap v1865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:38 smithi122 ceph-mon[125440]: pgmap v1865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:40 smithi136 ceph-mon[125702]: pgmap v1866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:40 smithi057 ceph-mon[92072]: pgmap v1866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:40 smithi122 ceph-mon[125440]: pgmap v1866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:42 smithi136 ceph-mon[125702]: pgmap v1867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:42 smithi057 ceph-mon[92072]: pgmap v1867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:42 smithi122 ceph-mon[125440]: pgmap v1867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:44 smithi136 ceph-mon[125702]: pgmap v1868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:44 smithi057 ceph-mon[92072]: pgmap v1868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:44 smithi122 ceph-mon[125440]: pgmap v1868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:46 smithi136 ceph-mon[125702]: pgmap v1869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:46 smithi057 ceph-mon[92072]: pgmap v1869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:46 smithi122 ceph-mon[125440]: pgmap v1869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:48 smithi136 ceph-mon[125702]: pgmap v1870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:48 smithi057 ceph-mon[92072]: pgmap v1870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:48 smithi122 ceph-mon[125440]: pgmap v1870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:50 smithi136 ceph-mon[125702]: pgmap v1871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:50 smithi057 ceph-mon[92072]: pgmap v1871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:50 smithi122 ceph-mon[125440]: pgmap v1871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:51.525 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:51.523+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:55:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:51.524+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:55:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:51.524+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:55:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:51.524+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:55:51.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:55:51.524+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:55:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:52 smithi136 ceph-mon[125702]: pgmap v1872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:52 smithi057 ceph-mon[92072]: pgmap v1872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:52 smithi122 ceph-mon[125440]: pgmap v1872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:54 smithi136 ceph-mon[125702]: pgmap v1873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:54 smithi057 ceph-mon[92072]: pgmap v1873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:54 smithi122 ceph-mon[125440]: pgmap v1873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:56 smithi136 ceph-mon[125702]: pgmap v1874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:56 smithi057 ceph-mon[92072]: pgmap v1874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:57.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:56 smithi122 ceph-mon[125440]: pgmap v1874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:55:59.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:58 smithi136 ceph-mon[125702]: pgmap v1875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:58 smithi057 ceph-mon[92072]: pgmap v1875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:55:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:58 smithi122 ceph-mon[125440]: pgmap v1875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:55:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:56:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:55:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:56:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:55:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:56:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:00 smithi136 ceph-mon[125702]: pgmap v1876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:01.115 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:00 smithi122 ceph-mon[125440]: pgmap v1876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:00 smithi057 ceph-mon[92072]: pgmap v1876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:02 smithi136 ceph-mon[125702]: pgmap v1877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:03.170 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:02 smithi122 ceph-mon[125440]: pgmap v1877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:02 smithi057 ceph-mon[92072]: pgmap v1877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:04 smithi136 ceph-mon[125702]: pgmap v1878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:56:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:04 smithi057 ceph-mon[92072]: pgmap v1878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:56:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:04 smithi122 ceph-mon[125440]: pgmap v1878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:56:06.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:06.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:56:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:06.529+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:56:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:06.529+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:56:06.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:06.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:56:06.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:06.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:56:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:06 smithi057 ceph-mon[92072]: pgmap v1879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:56:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:56:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:56:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:06 smithi122 ceph-mon[125440]: pgmap v1879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:56:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:56:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:56:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:06 smithi136 ceph-mon[125702]: pgmap v1879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:56:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:56:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:56:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:56:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:08.844+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:56:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:08.844+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:56:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:08.844+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 31 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:56:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:08.844+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 30 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:56:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:08 smithi057 ceph-mon[92072]: pgmap v1880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:56:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:08 smithi122 ceph-mon[125440]: pgmap v1880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:56:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:08 smithi136 ceph-mon[125702]: pgmap v1880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:56:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:10 smithi057 ceph-mon[92072]: pgmap v1881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:56:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:10 smithi122 ceph-mon[125440]: pgmap v1881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:56:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:10 smithi136 ceph-mon[125702]: pgmap v1881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:56:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:11 smithi057 ceph-mon[92072]: osdmap e192: 12 total, 12 up, 12 in 2023-03-02T11:56:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:11 smithi122 ceph-mon[125440]: osdmap e192: 12 total, 12 up, 12 in 2023-03-02T11:56:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:11 smithi136 ceph-mon[125702]: osdmap e192: 12 total, 12 up, 12 in 2023-03-02T11:56:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:12 smithi122 ceph-mon[125440]: pgmap v1883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:56:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:12 smithi136 ceph-mon[125702]: pgmap v1883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:56:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:12 smithi057 ceph-mon[92072]: pgmap v1883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T11:56:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:14 smithi122 ceph-mon[125440]: pgmap v1884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:56:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:14 smithi122 ceph-mon[125440]: osdmap e193: 12 total, 12 up, 12 in 2023-03-02T11:56:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:14 smithi136 ceph-mon[125702]: pgmap v1884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:56:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:14 smithi136 ceph-mon[125702]: osdmap e193: 12 total, 12 up, 12 in 2023-03-02T11:56:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:14 smithi057 ceph-mon[92072]: pgmap v1884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:56:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:14 smithi057 ceph-mon[92072]: osdmap e193: 12 total, 12 up, 12 in 2023-03-02T11:56:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:16 smithi136 ceph-mon[125702]: pgmap v1886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:56:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:16 smithi057 ceph-mon[92072]: pgmap v1886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:56:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:16 smithi122 ceph-mon[125440]: pgmap v1886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:56:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:18 smithi136 ceph-mon[125702]: pgmap v1887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:56:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:18 smithi057 ceph-mon[92072]: pgmap v1887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:56:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:18 smithi122 ceph-mon[125440]: pgmap v1887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:56:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:20 smithi136 ceph-mon[125702]: pgmap v1888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:56:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:20 smithi057 ceph-mon[92072]: pgmap v1888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:56:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:20 smithi122 ceph-mon[125440]: pgmap v1888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T11:56:21.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:21.544+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:56:21.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:21.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:56:21.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:21.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:56:21.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:21.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:56:21.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:21.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:56:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:22 smithi136 ceph-mon[125702]: pgmap v1889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:56:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:22 smithi057 ceph-mon[92072]: pgmap v1889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:56:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:22 smithi122 ceph-mon[125440]: pgmap v1889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:56:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:24 smithi136 ceph-mon[125702]: pgmap v1890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:56:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:24 smithi057 ceph-mon[92072]: pgmap v1890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:56:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:24 smithi122 ceph-mon[125440]: pgmap v1890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:56:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:26 smithi136 ceph-mon[125702]: pgmap v1891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:56:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:26 smithi057 ceph-mon[92072]: pgmap v1891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:56:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:26 smithi122 ceph-mon[125440]: pgmap v1891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:56:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:28 smithi136 ceph-mon[125702]: pgmap v1892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:56:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:28 smithi057 ceph-mon[92072]: pgmap v1892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:56:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:28 smithi122 ceph-mon[125440]: pgmap v1892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:56:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:30 smithi136 ceph-mon[125702]: pgmap v1893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:30 smithi057 ceph-mon[92072]: pgmap v1893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:30 smithi122 ceph-mon[125440]: pgmap v1893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:32 smithi136 ceph-mon[125702]: pgmap v1894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:32 smithi057 ceph-mon[92072]: pgmap v1894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:32 smithi122 ceph-mon[125440]: pgmap v1894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:34 smithi136 ceph-mon[125702]: pgmap v1895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:34 smithi057 ceph-mon[92072]: pgmap v1895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:34 smithi122 ceph-mon[125440]: pgmap v1895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:36.561+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:56:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:36.562+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:56:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:36.562+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:56:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:36.562+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:56:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:36.562+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:56:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:36 smithi136 ceph-mon[125702]: pgmap v1896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:36 smithi057 ceph-mon[92072]: pgmap v1896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:36 smithi122 ceph-mon[125440]: pgmap v1896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:38 smithi136 ceph-mon[125702]: pgmap v1897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:38 smithi057 ceph-mon[92072]: pgmap v1897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:39.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:38 smithi122 ceph-mon[125440]: pgmap v1897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:40 smithi136 ceph-mon[125702]: pgmap v1898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:40 smithi057 ceph-mon[92072]: pgmap v1898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:40 smithi122 ceph-mon[125440]: pgmap v1898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:42 smithi136 ceph-mon[125702]: pgmap v1899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:42 smithi057 ceph-mon[92072]: pgmap v1899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:42 smithi122 ceph-mon[125440]: pgmap v1899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:44 smithi136 ceph-mon[125702]: pgmap v1900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:44 smithi057 ceph-mon[92072]: pgmap v1900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:44 smithi122 ceph-mon[125440]: pgmap v1900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:47.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:46 smithi136 ceph-mon[125702]: pgmap v1901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:46 smithi057 ceph-mon[92072]: pgmap v1901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:46 smithi122 ceph-mon[125440]: pgmap v1901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:48 smithi136 ceph-mon[125702]: pgmap v1902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:48 smithi057 ceph-mon[92072]: pgmap v1902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:48 smithi122 ceph-mon[125440]: pgmap v1902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:50 smithi136 ceph-mon[125702]: pgmap v1903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:50 smithi057 ceph-mon[92072]: pgmap v1903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:50 smithi122 ceph-mon[125440]: pgmap v1903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:51.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:51.576+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:56:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:51.576+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:56:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:51.576+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:56:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:51.576+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:56:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:51.576+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:56:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:52 smithi136 ceph-mon[125702]: pgmap v1904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:52 smithi057 ceph-mon[92072]: pgmap v1904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:52 smithi122 ceph-mon[125440]: pgmap v1904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:53.851+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:56:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:53.851+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:56:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:53.851+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 31 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:56:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:56:53.851+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 32 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:56:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:54 smithi136 ceph-mon[125702]: pgmap v1905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:54 smithi057 ceph-mon[92072]: pgmap v1905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:54 smithi122 ceph-mon[125440]: pgmap v1905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:56 smithi136 ceph-mon[125702]: pgmap v1906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:56 smithi057 ceph-mon[92072]: pgmap v1906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:57.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:56 smithi122 ceph-mon[125440]: pgmap v1906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:56:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:56:58 smithi136 ceph-mon[125702]: pgmap v1907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:56:58 smithi057 ceph-mon[92072]: pgmap v1907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:56:59.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:56:58 smithi122 ceph-mon[125440]: pgmap v1907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:00 smithi136 ceph-mon[125702]: pgmap v1908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:00 smithi057 ceph-mon[92072]: pgmap v1908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:00 smithi122 ceph-mon[125440]: pgmap v1908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:02 smithi136 ceph-mon[125702]: pgmap v1909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:57:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:02 smithi057 ceph-mon[92072]: pgmap v1909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:57:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:02 smithi122 ceph-mon[125440]: pgmap v1909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:57:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:04 smithi136 ceph-mon[125702]: pgmap v1910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:57:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:04 smithi057 ceph-mon[92072]: pgmap v1910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:57:05.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:04 smithi122 ceph-mon[125440]: pgmap v1910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:57:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:57:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:57:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:57:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:06.591+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:57:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:06.591+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:57:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:06.591+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:57:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:06.591+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:57:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:06.591+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:57:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:06 smithi136 ceph-mon[125702]: pgmap v1911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:57:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:57:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:57:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:57:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:06 smithi057 ceph-mon[92072]: pgmap v1911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:57:07.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:57:07.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:57:07.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:57:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:06 smithi122 ceph-mon[125440]: pgmap v1911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:57:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:57:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:57:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:57:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:08 smithi136 ceph-mon[125702]: pgmap v1912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:57:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:08 smithi057 ceph-mon[92072]: pgmap v1912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:57:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:08 smithi122 ceph-mon[125440]: pgmap v1912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:57:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:10 smithi136 ceph-mon[125702]: pgmap v1913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:57:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:10 smithi057 ceph-mon[92072]: pgmap v1913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:57:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:10 smithi122 ceph-mon[125440]: pgmap v1913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:57:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:11 smithi057 ceph-mon[92072]: osdmap e194: 12 total, 12 up, 12 in 2023-03-02T11:57:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:11 smithi122 ceph-mon[125440]: osdmap e194: 12 total, 12 up, 12 in 2023-03-02T11:57:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:11 smithi136 ceph-mon[125702]: osdmap e194: 12 total, 12 up, 12 in 2023-03-02T11:57:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:12 smithi057 ceph-mon[92072]: pgmap v1915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:57:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:12 smithi122 ceph-mon[125440]: pgmap v1915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:57:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:12 smithi136 ceph-mon[125702]: pgmap v1915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:57:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:14 smithi057 ceph-mon[92072]: pgmap v1916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:57:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:14 smithi057 ceph-mon[92072]: osdmap e195: 12 total, 12 up, 12 in 2023-03-02T11:57:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:14 smithi122 ceph-mon[125440]: pgmap v1916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:57:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:14 smithi122 ceph-mon[125440]: osdmap e195: 12 total, 12 up, 12 in 2023-03-02T11:57:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:14 smithi136 ceph-mon[125702]: pgmap v1916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:57:15.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:14 smithi136 ceph-mon[125702]: osdmap e195: 12 total, 12 up, 12 in 2023-03-02T11:57:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:16 smithi057 ceph-mon[92072]: pgmap v1918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:57:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:16 smithi122 ceph-mon[125440]: pgmap v1918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:57:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:16 smithi136 ceph-mon[125702]: pgmap v1918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:57:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:18 smithi057 ceph-mon[92072]: pgmap v1919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:57:19.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:18 smithi122 ceph-mon[125440]: pgmap v1919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:57:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:18 smithi136 ceph-mon[125702]: pgmap v1919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:57:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:20 smithi057 ceph-mon[92072]: pgmap v1920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:57:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:20 smithi122 ceph-mon[125440]: pgmap v1920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:57:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:20 smithi136 ceph-mon[125702]: pgmap v1920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T11:57:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:21.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:57:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:21.605+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:57:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:21.605+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:57:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:21.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:57:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:21.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:57:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:22 smithi057 ceph-mon[92072]: pgmap v1921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:57:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:22 smithi122 ceph-mon[125440]: pgmap v1921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:57:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:22 smithi136 ceph-mon[125702]: pgmap v1921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:57:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:24 smithi057 ceph-mon[92072]: pgmap v1922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:57:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:24 smithi122 ceph-mon[125440]: pgmap v1922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:57:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:24 smithi136 ceph-mon[125702]: pgmap v1922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:57:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:26 smithi057 ceph-mon[92072]: pgmap v1923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:57:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:26 smithi122 ceph-mon[125440]: pgmap v1923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:57:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:26 smithi136 ceph-mon[125702]: pgmap v1923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T11:57:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:28 smithi057 ceph-mon[92072]: pgmap v1924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:57:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:28 smithi122 ceph-mon[125440]: pgmap v1924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:57:29.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:28 smithi136 ceph-mon[125702]: pgmap v1924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T11:57:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:30 smithi057 ceph-mon[92072]: pgmap v1925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:30 smithi122 ceph-mon[125440]: pgmap v1925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:30 smithi136 ceph-mon[125702]: pgmap v1925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:32 smithi057 ceph-mon[92072]: pgmap v1926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:32 smithi122 ceph-mon[125440]: pgmap v1926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:32 smithi136 ceph-mon[125702]: pgmap v1926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:34 smithi057 ceph-mon[92072]: pgmap v1927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:34 smithi122 ceph-mon[125440]: pgmap v1927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:34 smithi136 ceph-mon[125702]: pgmap v1927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:36.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:57:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:36.620+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:57:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:36.620+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:57:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:36.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:57:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:36.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:57:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:36 smithi057 ceph-mon[92072]: pgmap v1928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:37.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:36 smithi122 ceph-mon[125440]: pgmap v1928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:37.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:36 smithi136 ceph-mon[125702]: pgmap v1928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:39.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:38 smithi122 ceph-mon[125440]: pgmap v1929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:38 smithi136 ceph-mon[125702]: pgmap v1929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:38 smithi057 ceph-mon[92072]: pgmap v1929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:40 smithi122 ceph-mon[125440]: pgmap v1930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:40 smithi136 ceph-mon[125702]: pgmap v1930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:40 smithi057 ceph-mon[92072]: pgmap v1930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:42 smithi136 ceph-mon[125702]: pgmap v1931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:42 smithi057 ceph-mon[92072]: pgmap v1931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:42 smithi122 ceph-mon[125440]: pgmap v1931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:44 smithi136 ceph-mon[125702]: pgmap v1932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:44 smithi057 ceph-mon[92072]: pgmap v1932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:44 smithi122 ceph-mon[125440]: pgmap v1932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:46 smithi136 ceph-mon[125702]: pgmap v1933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:46 smithi057 ceph-mon[92072]: pgmap v1933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:47.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:46 smithi122 ceph-mon[125440]: pgmap v1933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:48 smithi136 ceph-mon[125702]: pgmap v1934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:48 smithi057 ceph-mon[92072]: pgmap v1934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:48 smithi122 ceph-mon[125440]: pgmap v1934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:50 smithi136 ceph-mon[125702]: pgmap v1935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:50 smithi057 ceph-mon[92072]: pgmap v1935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:50 smithi122 ceph-mon[125440]: pgmap v1935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:51.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:51.625+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:57:51.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:51.626+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:57:51.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:51.626+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:57:51.628 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:51.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:57:51.628 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:57:51.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:57:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:52 smithi136 ceph-mon[125702]: pgmap v1936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:52 smithi057 ceph-mon[92072]: pgmap v1936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:52 smithi122 ceph-mon[125440]: pgmap v1936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:54 smithi136 ceph-mon[125702]: pgmap v1937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:54 smithi057 ceph-mon[92072]: pgmap v1937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:54 smithi122 ceph-mon[125440]: pgmap v1937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:56 smithi136 ceph-mon[125702]: pgmap v1938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:56 smithi057 ceph-mon[92072]: pgmap v1938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:56 smithi122 ceph-mon[125440]: pgmap v1938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:57:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:57:58 smithi136 ceph-mon[125702]: pgmap v1939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:57:58 smithi057 ceph-mon[92072]: pgmap v1939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:57:59.495 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:57:58 smithi122 ceph-mon[125440]: pgmap v1939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:00 smithi136 ceph-mon[125702]: pgmap v1940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:00 smithi057 ceph-mon[92072]: pgmap v1940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:00 smithi122 ceph-mon[125440]: pgmap v1940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:02 smithi136 ceph-mon[125702]: pgmap v1941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:58:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:02 smithi057 ceph-mon[92072]: pgmap v1941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:58:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:02 smithi122 ceph-mon[125440]: pgmap v1941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:58:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:04 smithi136 ceph-mon[125702]: pgmap v1942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:58:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:04 smithi057 ceph-mon[92072]: pgmap v1942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:58:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:04 smithi122 ceph-mon[125440]: pgmap v1942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:58:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:06.633+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:58:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:06.633+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:58:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:06.633+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:58:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:06.633+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:58:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:06.633+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:58:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:06 smithi136 ceph-mon[125702]: pgmap v1943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:58:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:58:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:06 smithi057 ceph-mon[92072]: pgmap v1943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:58:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:58:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:06 smithi122 ceph-mon[125440]: pgmap v1943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:58:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:58:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:08 smithi057 ceph-mon[92072]: pgmap v1944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:58:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:08 smithi122 ceph-mon[125440]: pgmap v1944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:58:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:09.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:08 smithi136 ceph-mon[125702]: pgmap v1944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:58:09.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:09.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:09.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:09.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:10 smithi122 ceph-mon[125440]: pgmap v1945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:58:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:10 smithi136 ceph-mon[125702]: pgmap v1945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:58:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:10 smithi057 ceph-mon[92072]: pgmap v1945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:58:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:11 smithi136 ceph-mon[125702]: osdmap e196: 12 total, 12 up, 12 in 2023-03-02T11:58:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:11 smithi057 ceph-mon[92072]: osdmap e196: 12 total, 12 up, 12 in 2023-03-02T11:58:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:11 smithi122 ceph-mon[125440]: osdmap e196: 12 total, 12 up, 12 in 2023-03-02T11:58:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:13 smithi136 ceph-mon[125702]: pgmap v1947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:13.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:13.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:13.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:58:13.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:58:13.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:13 smithi057 ceph-mon[92072]: pgmap v1947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:58:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:58:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:13 smithi122 ceph-mon[125440]: pgmap v1947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:58:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:58:13.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:58:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:15 smithi136 ceph-mon[125702]: pgmap v1948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:15.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:15 smithi136 ceph-mon[125702]: osdmap e197: 12 total, 12 up, 12 in 2023-03-02T11:58:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:15 smithi057 ceph-mon[92072]: pgmap v1948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:15 smithi057 ceph-mon[92072]: osdmap e197: 12 total, 12 up, 12 in 2023-03-02T11:58:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:15 smithi122 ceph-mon[125440]: pgmap v1948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:15 smithi122 ceph-mon[125440]: osdmap e197: 12 total, 12 up, 12 in 2023-03-02T11:58:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:17 smithi136 ceph-mon[125702]: pgmap v1950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:58:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:17 smithi057 ceph-mon[92072]: pgmap v1950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:58:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:17 smithi122 ceph-mon[125440]: pgmap v1950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:58:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:19 smithi136 ceph-mon[125702]: pgmap v1951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T11:58:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:19 smithi057 ceph-mon[92072]: pgmap v1951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T11:58:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:19 smithi122 ceph-mon[125440]: pgmap v1951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T11:58:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:21 smithi136 ceph-mon[125702]: pgmap v1952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 352 B/s wr, 12 op/s 2023-03-02T11:58:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:21 smithi057 ceph-mon[92072]: pgmap v1952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 352 B/s wr, 12 op/s 2023-03-02T11:58:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:21 smithi122 ceph-mon[125440]: pgmap v1952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 352 B/s wr, 12 op/s 2023-03-02T11:58:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:21.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:58:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:21.648+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:58:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:21.648+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:58:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:21.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:58:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:21.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:58:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:23 smithi057 ceph-mon[92072]: pgmap v1953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:23.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:23 smithi122 ceph-mon[125440]: pgmap v1953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:23 smithi136 ceph-mon[125702]: pgmap v1953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:25 smithi057 ceph-mon[92072]: pgmap v1954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:25 smithi122 ceph-mon[125440]: pgmap v1954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:25 smithi136 ceph-mon[125702]: pgmap v1954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:58:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:27 smithi057 ceph-mon[92072]: pgmap v1955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 186 B/s wr, 9 op/s 2023-03-02T11:58:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:27 smithi122 ceph-mon[125440]: pgmap v1955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 186 B/s wr, 9 op/s 2023-03-02T11:58:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:27 smithi136 ceph-mon[125702]: pgmap v1955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 186 B/s wr, 9 op/s 2023-03-02T11:58:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:29 smithi057 ceph-mon[92072]: pgmap v1956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:58:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:29 smithi122 ceph-mon[125440]: pgmap v1956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:58:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:29 smithi136 ceph-mon[125702]: pgmap v1956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T11:58:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:31 smithi057 ceph-mon[92072]: pgmap v1957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:31 smithi122 ceph-mon[125440]: pgmap v1957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:31 smithi136 ceph-mon[125702]: pgmap v1957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:33 smithi057 ceph-mon[92072]: pgmap v1958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:33 smithi122 ceph-mon[125440]: pgmap v1958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:33 smithi136 ceph-mon[125702]: pgmap v1958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:35 smithi057 ceph-mon[92072]: pgmap v1959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:35 smithi122 ceph-mon[125440]: pgmap v1959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:35 smithi136 ceph-mon[125702]: pgmap v1959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:36.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:36.661+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:58:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:36.661+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:58:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:36.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:58:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:36.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:58:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:37 smithi057 ceph-mon[92072]: pgmap v1960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:37 smithi122 ceph-mon[125440]: pgmap v1960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:37 smithi136 ceph-mon[125702]: pgmap v1960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:39 smithi057 ceph-mon[92072]: pgmap v1961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:39 smithi122 ceph-mon[125440]: pgmap v1961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:39 smithi136 ceph-mon[125702]: pgmap v1961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:41 smithi057 ceph-mon[92072]: pgmap v1962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:41 smithi122 ceph-mon[125440]: pgmap v1962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:41 smithi136 ceph-mon[125702]: pgmap v1962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:43 smithi057 ceph-mon[92072]: pgmap v1963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:43 smithi122 ceph-mon[125440]: pgmap v1963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:43 smithi136 ceph-mon[125702]: pgmap v1963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:45 smithi057 ceph-mon[92072]: pgmap v1964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:45 smithi122 ceph-mon[125440]: pgmap v1964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:45 smithi136 ceph-mon[125702]: pgmap v1964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:46 smithi057 ceph-mon[92072]: pgmap v1965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:46.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:46 smithi122 ceph-mon[125440]: pgmap v1965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:46 smithi136 ceph-mon[125702]: pgmap v1965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:48 smithi136 ceph-mon[125702]: pgmap v1966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:48 smithi057 ceph-mon[92072]: pgmap v1966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:48 smithi122 ceph-mon[125440]: pgmap v1966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:50 smithi136 ceph-mon[125702]: pgmap v1967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:50 smithi057 ceph-mon[92072]: pgmap v1967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:50 smithi122 ceph-mon[125440]: pgmap v1967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:51.677+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:58:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:51.677+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:58:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:51.677+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:58:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:51.677+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:58:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:58:51.677+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:58:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:52 smithi136 ceph-mon[125702]: pgmap v1968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:52 smithi057 ceph-mon[92072]: pgmap v1968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:52 smithi122 ceph-mon[125440]: pgmap v1968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:54 smithi136 ceph-mon[125702]: pgmap v1969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:54 smithi057 ceph-mon[92072]: pgmap v1969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:54 smithi122 ceph-mon[125440]: pgmap v1969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:56 smithi136 ceph-mon[125702]: pgmap v1970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:56 smithi057 ceph-mon[92072]: pgmap v1970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:56 smithi122 ceph-mon[125440]: pgmap v1970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:58:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:58:58 smithi136 ceph-mon[125702]: pgmap v1971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:58:58 smithi057 ceph-mon[92072]: pgmap v1971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:58:59.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:58:58 smithi122 ceph-mon[125440]: pgmap v1971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:00 smithi136 ceph-mon[125702]: pgmap v1972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:00 smithi057 ceph-mon[92072]: pgmap v1972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:00 smithi122 ceph-mon[125440]: pgmap v1972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:02 smithi136 ceph-mon[125702]: pgmap v1973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:59:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:02 smithi057 ceph-mon[92072]: pgmap v1973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:59:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:02 smithi122 ceph-mon[125440]: pgmap v1973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:59:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:04 smithi136 ceph-mon[125702]: pgmap v1974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:59:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:04 smithi057 ceph-mon[92072]: pgmap v1974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:59:05.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:04 smithi122 ceph-mon[125440]: pgmap v1974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:59:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:06.691+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:59:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:06.691+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:59:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:06.691+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:59:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:06.691+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:59:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:06.691+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:59:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:06 smithi136 ceph-mon[125702]: pgmap v1975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:59:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:06 smithi057 ceph-mon[92072]: pgmap v1975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:59:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:06 smithi122 ceph-mon[125440]: pgmap v1975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T11:59:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.376+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f58680a7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T11:59:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.376+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f58680a7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T11:59:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.376+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7f10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f58700195d0 tx=0x7f5870066000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.376+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7f10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f58700195d0 tx=0x7f5870066000 comp rx=0 tx=0).stop 2023-03-02T11:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.376+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f58680a7f10 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T11:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.376+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f58680a7f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T11:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.376+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7f10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T11:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.376+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T11:59:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.376+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:59:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.376+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a8450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58700387f0 tx=0x7f587006b000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T11:59:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.870+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:59:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.870+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:59:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.870+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 32 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T11:59:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:08.870+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 33 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T11:59:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:08 smithi136 ceph-mon[125702]: pgmap v1976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:59:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:08 smithi057 ceph-mon[92072]: pgmap v1976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:59:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:08 smithi122 ceph-mon[125440]: pgmap v1976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T11:59:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:10 smithi136 ceph-mon[125702]: pgmap v1977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:59:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:10 smithi057 ceph-mon[92072]: pgmap v1977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:59:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:10 smithi122 ceph-mon[125440]: pgmap v1977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T11:59:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:11 smithi136 ceph-mon[125702]: osdmap e198: 12 total, 12 up, 12 in 2023-03-02T11:59:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:11 smithi057 ceph-mon[92072]: osdmap e198: 12 total, 12 up, 12 in 2023-03-02T11:59:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:11 smithi122 ceph-mon[125440]: osdmap e198: 12 total, 12 up, 12 in 2023-03-02T11:59:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:12 smithi136 ceph-mon[125702]: pgmap v1979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:59:13.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:59:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:12 smithi057 ceph-mon[92072]: pgmap v1979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:59:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:59:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:12 smithi122 ceph-mon[125440]: pgmap v1979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:59:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T11:59:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:14 smithi136 ceph-mon[125702]: pgmap v1980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:59:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:14 smithi136 ceph-mon[125702]: osdmap e199: 12 total, 12 up, 12 in 2023-03-02T11:59:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:14 smithi057 ceph-mon[92072]: pgmap v1980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:59:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:14 smithi057 ceph-mon[92072]: osdmap e199: 12 total, 12 up, 12 in 2023-03-02T11:59:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:14 smithi122 ceph-mon[125440]: pgmap v1980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T11:59:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:14 smithi122 ceph-mon[125440]: osdmap e199: 12 total, 12 up, 12 in 2023-03-02T11:59:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: pgmap v1982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:59:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.940 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: pgmap v1982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:59:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:16.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: pgmap v1982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T11:59:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:17.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:17.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:17.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:59:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:59:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:59:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:59:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:59:17.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:59:17.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:59:17.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:59:17.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:59:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:59:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:59:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:59:17.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:17.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:59:17.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:59:17.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:59:17.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:59:17.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T11:59:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T11:59:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T11:59:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T11:59:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T11:59:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T11:59:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T11:59:18.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T11:59:18.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T11:59:18.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T11:59:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:18 smithi057 ceph-mon[92072]: pgmap v1983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:59:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:18 smithi122 ceph-mon[125440]: pgmap v1983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:59:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:18 smithi136 ceph-mon[125702]: pgmap v1983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T11:59:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:20 smithi136 ceph-mon[125702]: pgmap v1984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T11:59:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:20 smithi057 ceph-mon[92072]: pgmap v1984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T11:59:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:20 smithi122 ceph-mon[125440]: pgmap v1984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T11:59:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:21.698+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:59:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:21.698+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:59:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:21.698+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:59:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:21.698+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:59:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:21.698+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:59:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:22 smithi136 ceph-mon[125702]: pgmap v1985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:59:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:22 smithi057 ceph-mon[92072]: pgmap v1985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:59:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:22 smithi122 ceph-mon[125440]: pgmap v1985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:59:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:24 smithi136 ceph-mon[125702]: pgmap v1986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:59:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:24 smithi136 ceph-mon[125702]: osdmap e200: 12 total, 12 up, 12 in 2023-03-02T11:59:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:24 smithi057 ceph-mon[92072]: pgmap v1986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:59:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:24 smithi057 ceph-mon[92072]: osdmap e200: 12 total, 12 up, 12 in 2023-03-02T11:59:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:24 smithi122 ceph-mon[125440]: pgmap v1986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:59:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:24 smithi122 ceph-mon[125440]: osdmap e200: 12 total, 12 up, 12 in 2023-03-02T11:59:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:26 smithi136 ceph-mon[125702]: pgmap v1988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:59:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:26 smithi057 ceph-mon[92072]: pgmap v1988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:59:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:26 smithi122 ceph-mon[125440]: pgmap v1988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T11:59:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:28 smithi136 ceph-mon[125702]: pgmap v1989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:28 smithi057 ceph-mon[92072]: pgmap v1989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:28 smithi122 ceph-mon[125440]: pgmap v1989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:30 smithi136 ceph-mon[125702]: pgmap v1990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:30 smithi057 ceph-mon[92072]: pgmap v1990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:30 smithi122 ceph-mon[125440]: pgmap v1990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:32 smithi136 ceph-mon[125702]: pgmap v1991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:32 smithi057 ceph-mon[92072]: pgmap v1991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:32 smithi122 ceph-mon[125440]: pgmap v1991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:34 smithi136 ceph-mon[125702]: pgmap v1992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:34 smithi057 ceph-mon[92072]: pgmap v1992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:34 smithi122 ceph-mon[125440]: pgmap v1992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T11:59:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:36.712+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:59:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:36.713+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:59:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:36.713+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:59:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:36.713+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:59:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:36.713+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:59:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:36 smithi136 ceph-mon[125702]: pgmap v1993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T11:59:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:36 smithi057 ceph-mon[92072]: pgmap v1993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T11:59:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:36 smithi122 ceph-mon[125440]: pgmap v1993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T11:59:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:38 smithi136 ceph-mon[125702]: pgmap v1994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:38 smithi057 ceph-mon[92072]: pgmap v1994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:38 smithi122 ceph-mon[125440]: pgmap v1994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:40 smithi136 ceph-mon[125702]: pgmap v1995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:40 smithi057 ceph-mon[92072]: pgmap v1995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:40 smithi122 ceph-mon[125440]: pgmap v1995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:42 smithi136 ceph-mon[125702]: pgmap v1996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:42 smithi057 ceph-mon[92072]: pgmap v1996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:42 smithi122 ceph-mon[125440]: pgmap v1996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:44 smithi136 ceph-mon[125702]: pgmap v1997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:44 smithi057 ceph-mon[92072]: pgmap v1997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:44 smithi122 ceph-mon[125440]: pgmap v1997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:46 smithi136 ceph-mon[125702]: pgmap v1998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:46 smithi057 ceph-mon[92072]: pgmap v1998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:46 smithi122 ceph-mon[125440]: pgmap v1998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:48 smithi136 ceph-mon[125702]: pgmap v1999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:48 smithi057 ceph-mon[92072]: pgmap v1999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:48 smithi122 ceph-mon[125440]: pgmap v1999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:50 smithi136 ceph-mon[125702]: pgmap v2000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:50 smithi057 ceph-mon[92072]: pgmap v2000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:50 smithi122 ceph-mon[125440]: pgmap v2000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:51.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T11:59:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:51.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T11:59:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:51.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T11:59:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:51.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T11:59:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T11:59:51.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T11:59:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:52 smithi136 ceph-mon[125702]: pgmap v2001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:52 smithi057 ceph-mon[92072]: pgmap v2001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:52 smithi122 ceph-mon[125440]: pgmap v2001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:54 smithi136 ceph-mon[125702]: pgmap v2002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:54 smithi057 ceph-mon[92072]: pgmap v2002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:54 smithi122 ceph-mon[125440]: pgmap v2002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:56 smithi136 ceph-mon[125702]: pgmap v2003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:56 smithi057 ceph-mon[92072]: pgmap v2003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:57.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:56 smithi122 ceph-mon[125440]: pgmap v2003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T11:59:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 11:59:58 smithi136 ceph-mon[125702]: pgmap v2004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 11:59:58 smithi057 ceph-mon[92072]: pgmap v2004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T11:59:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 11:59:58 smithi122 ceph-mon[125440]: pgmap v2004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:00 smithi136 ceph-mon[125702]: pgmap v2005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:01.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T12:00:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:00 smithi057 ceph-mon[92072]: pgmap v2005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T12:00:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:00 smithi122 ceph-mon[125440]: pgmap v2005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T12:00:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:02 smithi136 ceph-mon[125702]: pgmap v2006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:00:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:02 smithi057 ceph-mon[92072]: pgmap v2006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:00:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:02 smithi122 ceph-mon[125440]: pgmap v2006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:00:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:04 smithi057 ceph-mon[92072]: pgmap v2007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:00:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:04 smithi122 ceph-mon[125440]: pgmap v2007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:00:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:04 smithi136 ceph-mon[125702]: pgmap v2007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:00:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:06.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:00:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:06.744+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:00:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:06.744+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:00:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:06.744+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:00:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:06.744+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:00:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:06 smithi057 ceph-mon[92072]: pgmap v2008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:00:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:06 smithi122 ceph-mon[125440]: pgmap v2008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:00:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:06 smithi136 ceph-mon[125702]: pgmap v2008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:00:09.121 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:08 smithi122 ceph-mon[125440]: pgmap v2009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:00:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:08 smithi057 ceph-mon[92072]: pgmap v2009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:00:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:08 smithi136 ceph-mon[125702]: pgmap v2009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:00:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:10 smithi057 ceph-mon[92072]: pgmap v2010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:00:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:10 smithi122 ceph-mon[125440]: pgmap v2010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:00:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:10 smithi136 ceph-mon[125702]: pgmap v2010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:00:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:11 smithi057 ceph-mon[92072]: osdmap e201: 12 total, 12 up, 12 in 2023-03-02T12:00:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:11 smithi122 ceph-mon[125440]: osdmap e201: 12 total, 12 up, 12 in 2023-03-02T12:00:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:11 smithi136 ceph-mon[125702]: osdmap e201: 12 total, 12 up, 12 in 2023-03-02T12:00:13.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:12 smithi057 ceph-mon[92072]: pgmap v2012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:00:13.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:12 smithi122 ceph-mon[125440]: pgmap v2012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:00:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:12 smithi136 ceph-mon[125702]: pgmap v2012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:00:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:14 smithi057 ceph-mon[92072]: pgmap v2013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:00:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:14 smithi057 ceph-mon[92072]: osdmap e202: 12 total, 12 up, 12 in 2023-03-02T12:00:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:14 smithi122 ceph-mon[125440]: pgmap v2013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:00:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:14 smithi122 ceph-mon[125440]: osdmap e202: 12 total, 12 up, 12 in 2023-03-02T12:00:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:14 smithi136 ceph-mon[125702]: pgmap v2013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:00:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:14 smithi136 ceph-mon[125702]: osdmap e202: 12 total, 12 up, 12 in 2023-03-02T12:00:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:16 smithi057 ceph-mon[92072]: pgmap v2015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:00:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:16 smithi122 ceph-mon[125440]: pgmap v2015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:00:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:16 smithi136 ceph-mon[125702]: pgmap v2015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:00:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:00:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:00:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:00:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:18 smithi057 ceph-mon[92072]: pgmap v2016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:00:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:18 smithi122 ceph-mon[125440]: pgmap v2016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:00:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:18 smithi136 ceph-mon[125702]: pgmap v2016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:00:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:00:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:00:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:00:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:00:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:00:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:00:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:00:20.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:00:20.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:00:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:20 smithi057 ceph-mon[92072]: pgmap v2017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T12:00:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:20 smithi122 ceph-mon[125440]: pgmap v2017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T12:00:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:20 smithi136 ceph-mon[125702]: pgmap v2017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T12:00:21.761 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:21.760+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:00:21.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:21.760+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:00:21.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:21.761+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:00:21.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:21.761+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:00:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:21.761+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:00:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:22 smithi057 ceph-mon[92072]: pgmap v2018: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T12:00:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:22 smithi122 ceph-mon[125440]: pgmap v2018: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T12:00:23.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:22 smithi136 ceph-mon[125702]: pgmap v2018: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T12:00:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:24 smithi057 ceph-mon[92072]: pgmap v2019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T12:00:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:24 smithi122 ceph-mon[125440]: pgmap v2019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T12:00:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:24 smithi136 ceph-mon[125702]: pgmap v2019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T12:00:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:26 smithi057 ceph-mon[92072]: pgmap v2020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:00:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:26 smithi122 ceph-mon[125440]: pgmap v2020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:00:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:26 smithi136 ceph-mon[125702]: pgmap v2020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:00:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:28 smithi122 ceph-mon[125440]: pgmap v2021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:00:29.252 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:28 smithi136 ceph-mon[125702]: pgmap v2021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:00:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:28 smithi057 ceph-mon[92072]: pgmap v2021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:00:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:30 smithi122 ceph-mon[125440]: pgmap v2022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:31.271 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:30 smithi136 ceph-mon[125702]: pgmap v2022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:30 smithi057 ceph-mon[92072]: pgmap v2022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:32 smithi136 ceph-mon[125702]: pgmap v2023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:32 smithi057 ceph-mon[92072]: pgmap v2023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:32 smithi122 ceph-mon[125440]: pgmap v2023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:34 smithi136 ceph-mon[125702]: pgmap v2024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:34 smithi057 ceph-mon[92072]: pgmap v2024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:34 smithi122 ceph-mon[125440]: pgmap v2024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:36.765+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:00:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:36.766+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:00:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:36.766+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:00:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:36.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:00:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:36.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:00:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:36 smithi136 ceph-mon[125702]: pgmap v2025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:36 smithi057 ceph-mon[92072]: pgmap v2025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:36 smithi122 ceph-mon[125440]: pgmap v2025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:38 smithi136 ceph-mon[125702]: pgmap v2026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:00:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:38 smithi057 ceph-mon[92072]: pgmap v2026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:00:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:38 smithi122 ceph-mon[125440]: pgmap v2026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:00:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:40 smithi136 ceph-mon[125702]: pgmap v2027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:40 smithi057 ceph-mon[92072]: pgmap v2027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:40 smithi122 ceph-mon[125440]: pgmap v2027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:42 smithi136 ceph-mon[125702]: pgmap v2028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:42 smithi057 ceph-mon[92072]: pgmap v2028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:42 smithi122 ceph-mon[125440]: pgmap v2028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:44 smithi136 ceph-mon[125702]: pgmap v2029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:44 smithi057 ceph-mon[92072]: pgmap v2029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:44 smithi122 ceph-mon[125440]: pgmap v2029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:46 smithi136 ceph-mon[125702]: pgmap v2030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:46 smithi057 ceph-mon[92072]: pgmap v2030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:47.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:46 smithi122 ceph-mon[125440]: pgmap v2030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:00:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:48 smithi136 ceph-mon[125702]: pgmap v2031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:48 smithi057 ceph-mon[92072]: pgmap v2031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:48 smithi122 ceph-mon[125440]: pgmap v2031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:50 smithi136 ceph-mon[125702]: pgmap v2032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:50 smithi057 ceph-mon[92072]: pgmap v2032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:50 smithi122 ceph-mon[125440]: pgmap v2032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:51.773+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:00:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:51.774+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:00:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:51.774+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:00:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:51.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:00:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:00:51.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:00:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:52 smithi136 ceph-mon[125702]: pgmap v2033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:52 smithi057 ceph-mon[92072]: pgmap v2033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:52 smithi122 ceph-mon[125440]: pgmap v2033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:55 smithi136 ceph-mon[125702]: pgmap v2034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:55 smithi057 ceph-mon[92072]: pgmap v2034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:55 smithi122 ceph-mon[125440]: pgmap v2034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:57 smithi136 ceph-mon[125702]: pgmap v2035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:57 smithi057 ceph-mon[92072]: pgmap v2035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:57 smithi122 ceph-mon[125440]: pgmap v2035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:00:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:00:59 smithi136 ceph-mon[125702]: pgmap v2036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:00:59 smithi057 ceph-mon[92072]: pgmap v2036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:00:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:00:59 smithi122 ceph-mon[125440]: pgmap v2036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:01 smithi136 ceph-mon[125702]: pgmap v2037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:01 smithi057 ceph-mon[92072]: pgmap v2037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:01.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:01 smithi122 ceph-mon[125440]: pgmap v2037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:03 smithi136 ceph-mon[125702]: pgmap v2038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:01:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:03 smithi057 ceph-mon[92072]: pgmap v2038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:01:03.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:03 smithi122 ceph-mon[125440]: pgmap v2038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:01:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:05 smithi136 ceph-mon[125702]: pgmap v2039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:01:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:05 smithi057 ceph-mon[92072]: pgmap v2039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:01:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:05 smithi122 ceph-mon[125440]: pgmap v2039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:01:06.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:06.775+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:01:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:06.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:01:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:06.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:01:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:06.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:01:06.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:06.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:01:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:07 smithi136 ceph-mon[125702]: pgmap v2040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:01:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:07 smithi057 ceph-mon[92072]: pgmap v2040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:01:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:07 smithi122 ceph-mon[125440]: pgmap v2040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:01:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:09 smithi136 ceph-mon[125702]: pgmap v2041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:01:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:09 smithi057 ceph-mon[92072]: pgmap v2041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:01:09.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:09 smithi122 ceph-mon[125440]: pgmap v2041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:01:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:11 smithi136 ceph-mon[125702]: pgmap v2042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:01:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:11 smithi057 ceph-mon[92072]: pgmap v2042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:01:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:11 smithi122 ceph-mon[125440]: pgmap v2042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:01:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:12 smithi136 ceph-mon[125702]: osdmap e203: 12 total, 12 up, 12 in 2023-03-02T12:01:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:12 smithi057 ceph-mon[92072]: osdmap e203: 12 total, 12 up, 12 in 2023-03-02T12:01:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:12 smithi122 ceph-mon[125440]: osdmap e203: 12 total, 12 up, 12 in 2023-03-02T12:01:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:13 smithi136 ceph-mon[125702]: pgmap v2044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:01:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:13 smithi057 ceph-mon[92072]: pgmap v2044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:01:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:13 smithi122 ceph-mon[125440]: pgmap v2044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:01:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:15 smithi136 ceph-mon[125702]: pgmap v2045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:01:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:15 smithi136 ceph-mon[125702]: osdmap e204: 12 total, 12 up, 12 in 2023-03-02T12:01:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:15 smithi057 ceph-mon[92072]: pgmap v2045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:01:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:15 smithi057 ceph-mon[92072]: osdmap e204: 12 total, 12 up, 12 in 2023-03-02T12:01:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:15 smithi122 ceph-mon[125440]: pgmap v2045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:01:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:15 smithi122 ceph-mon[125440]: osdmap e204: 12 total, 12 up, 12 in 2023-03-02T12:01:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:17 smithi136 ceph-mon[125702]: pgmap v2047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:01:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:17 smithi057 ceph-mon[92072]: pgmap v2047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:01:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:17 smithi122 ceph-mon[125440]: pgmap v2047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:01:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:19 smithi136 ceph-mon[125702]: pgmap v2048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:01:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:19 smithi057 ceph-mon[92072]: pgmap v2048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:01:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:19 smithi122 ceph-mon[125440]: pgmap v2048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:01:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:01:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:01:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:01:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:21 smithi057 ceph-mon[92072]: pgmap v2049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T12:01:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:01:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:01:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:01:21.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:01:21.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:01:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:21 smithi122 ceph-mon[125440]: pgmap v2049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T12:01:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:01:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:01:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:01:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:01:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:01:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:21 smithi136 ceph-mon[125702]: pgmap v2049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T12:01:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:01:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:01:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:01:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:01:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:01:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:21.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:01:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:21.785+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:01:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:21.785+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:01:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:21.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:01:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:21.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:01:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:23 smithi057 ceph-mon[92072]: pgmap v2050: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:01:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:23 smithi122 ceph-mon[125440]: pgmap v2050: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:01:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:23 smithi136 ceph-mon[125702]: pgmap v2050: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:01:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:25 smithi057 ceph-mon[92072]: pgmap v2051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:01:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:25 smithi122 ceph-mon[125440]: pgmap v2051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:01:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:25 smithi136 ceph-mon[125702]: pgmap v2051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:01:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:27 smithi057 ceph-mon[92072]: pgmap v2052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:01:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:27 smithi122 ceph-mon[125440]: pgmap v2052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:01:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:27 smithi136 ceph-mon[125702]: pgmap v2052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:01:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:29 smithi057 ceph-mon[92072]: pgmap v2053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:01:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:29 smithi122 ceph-mon[125440]: pgmap v2053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:01:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:29 smithi136 ceph-mon[125702]: pgmap v2053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:01:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:31 smithi057 ceph-mon[92072]: pgmap v2054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:31 smithi122 ceph-mon[125440]: pgmap v2054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:31 smithi136 ceph-mon[125702]: pgmap v2054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:33 smithi057 ceph-mon[92072]: pgmap v2055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:33 smithi122 ceph-mon[125440]: pgmap v2055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:33 smithi136 ceph-mon[125702]: pgmap v2055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:35 smithi057 ceph-mon[92072]: pgmap v2056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:35 smithi122 ceph-mon[125440]: pgmap v2056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:35 smithi136 ceph-mon[125702]: pgmap v2056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:36.795+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:01:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:36.796+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:01:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:36.796+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:01:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:36.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:01:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:36.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:01:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:37 smithi057 ceph-mon[92072]: pgmap v2057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:37 smithi122 ceph-mon[125440]: pgmap v2057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:37 smithi136 ceph-mon[125702]: pgmap v2057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:39 smithi057 ceph-mon[92072]: pgmap v2058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:39 smithi122 ceph-mon[125440]: pgmap v2058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:39 smithi136 ceph-mon[125702]: pgmap v2058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:41 smithi057 ceph-mon[92072]: pgmap v2059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:41 smithi122 ceph-mon[125440]: pgmap v2059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:41 smithi136 ceph-mon[125702]: pgmap v2059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:43 smithi122 ceph-mon[125440]: pgmap v2060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:43 smithi136 ceph-mon[125702]: pgmap v2060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:43 smithi057 ceph-mon[92072]: pgmap v2060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:45 smithi122 ceph-mon[125440]: pgmap v2061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:45 smithi136 ceph-mon[125702]: pgmap v2061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:45 smithi057 ceph-mon[92072]: pgmap v2061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:46 smithi136 ceph-mon[125702]: pgmap v2062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:46 smithi057 ceph-mon[92072]: pgmap v2062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:46 smithi122 ceph-mon[125440]: pgmap v2062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:48 smithi136 ceph-mon[125702]: pgmap v2063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:48 smithi057 ceph-mon[92072]: pgmap v2063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:48 smithi122 ceph-mon[125440]: pgmap v2063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:50 smithi136 ceph-mon[125702]: pgmap v2064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:50 smithi057 ceph-mon[92072]: pgmap v2064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:50 smithi122 ceph-mon[125440]: pgmap v2064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:51.807+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:01:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:51.808+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:01:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:51.808+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:01:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:51.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:01:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:01:51.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:01:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:52 smithi136 ceph-mon[125702]: pgmap v2065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:52 smithi057 ceph-mon[92072]: pgmap v2065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:52 smithi122 ceph-mon[125440]: pgmap v2065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:54 smithi136 ceph-mon[125702]: pgmap v2066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:54 smithi057 ceph-mon[92072]: pgmap v2066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:54 smithi122 ceph-mon[125440]: pgmap v2066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:56 smithi136 ceph-mon[125702]: pgmap v2067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:56 smithi057 ceph-mon[92072]: pgmap v2067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:57.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:56 smithi122 ceph-mon[125440]: pgmap v2067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:01:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:01:58 smithi136 ceph-mon[125702]: pgmap v2068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:01:58 smithi057 ceph-mon[92072]: pgmap v2068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:01:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:01:58 smithi122 ceph-mon[125440]: pgmap v2068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:00 smithi136 ceph-mon[125702]: pgmap v2069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:00 smithi057 ceph-mon[92072]: pgmap v2069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:00 smithi122 ceph-mon[125440]: pgmap v2069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:02 smithi136 ceph-mon[125702]: pgmap v2070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:02:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:02 smithi057 ceph-mon[92072]: pgmap v2070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:02:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:02 smithi122 ceph-mon[125440]: pgmap v2070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:02:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:04 smithi136 ceph-mon[125702]: pgmap v2071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:02:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:04 smithi057 ceph-mon[92072]: pgmap v2071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:02:05.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:04 smithi122 ceph-mon[125440]: pgmap v2071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:02:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:06.823+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:02:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:06.823+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:02:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:06.823+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:02:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:06.823+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:02:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:06.823+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:02:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:06 smithi136 ceph-mon[125702]: pgmap v2072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:02:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:06 smithi057 ceph-mon[92072]: pgmap v2072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:02:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:06 smithi122 ceph-mon[125440]: pgmap v2072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:02:08.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:08.896+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:02:08.898 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:08.896+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:02:08.898 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:08.896+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 34 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:02:08.898 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:08.896+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 33 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:02:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:08 smithi136 ceph-mon[125702]: pgmap v2073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:02:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:08 smithi057 ceph-mon[92072]: pgmap v2073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:02:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:08 smithi122 ceph-mon[125440]: pgmap v2073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:02:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:10 smithi136 ceph-mon[125702]: pgmap v2074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:02:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:10 smithi057 ceph-mon[92072]: pgmap v2074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:02:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:10 smithi122 ceph-mon[125440]: pgmap v2074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:02:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:11 smithi136 ceph-mon[125702]: osdmap e205: 12 total, 12 up, 12 in 2023-03-02T12:02:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:11 smithi057 ceph-mon[92072]: osdmap e205: 12 total, 12 up, 12 in 2023-03-02T12:02:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:11 smithi122 ceph-mon[125440]: osdmap e205: 12 total, 12 up, 12 in 2023-03-02T12:02:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:12 smithi136 ceph-mon[125702]: pgmap v2076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:02:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:12 smithi057 ceph-mon[92072]: pgmap v2076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:02:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:12 smithi122 ceph-mon[125440]: pgmap v2076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:02:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:14 smithi136 ceph-mon[125702]: pgmap v2077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:02:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:14 smithi136 ceph-mon[125702]: osdmap e206: 12 total, 12 up, 12 in 2023-03-02T12:02:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:14 smithi057 ceph-mon[92072]: pgmap v2077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:02:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:14 smithi057 ceph-mon[92072]: osdmap e206: 12 total, 12 up, 12 in 2023-03-02T12:02:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:14 smithi122 ceph-mon[125440]: pgmap v2077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:02:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:14 smithi122 ceph-mon[125440]: osdmap e206: 12 total, 12 up, 12 in 2023-03-02T12:02:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:16 smithi057 ceph-mon[92072]: pgmap v2079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:02:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:16 smithi122 ceph-mon[125440]: pgmap v2079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:02:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:16 smithi136 ceph-mon[125702]: pgmap v2079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:02:19.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:18 smithi057 ceph-mon[92072]: pgmap v2080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:02:19.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:18 smithi122 ceph-mon[125440]: pgmap v2080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:02:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:18 smithi136 ceph-mon[125702]: pgmap v2080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:02:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:20 smithi057 ceph-mon[92072]: pgmap v2081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T12:02:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:20 smithi122 ceph-mon[125440]: pgmap v2081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T12:02:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:20 smithi136 ceph-mon[125702]: pgmap v2081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T12:02:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:21.835+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:02:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:21.835+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:02:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:21.835+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:02:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:21.835+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:02:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:21.835+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:02:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:02:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:02:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:02:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:22 smithi057 ceph-mon[92072]: pgmap v2082: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:02:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:02:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:02:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:22 smithi122 ceph-mon[125440]: pgmap v2082: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:02:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:02:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:02:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:22 smithi136 ceph-mon[125702]: pgmap v2082: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:02:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:02:23.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:02:23.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:02:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:24 smithi057 ceph-mon[92072]: pgmap v2083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:02:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:24 smithi122 ceph-mon[125440]: pgmap v2083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:02:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:24 smithi136 ceph-mon[125702]: pgmap v2083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:02:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:26 smithi057 ceph-mon[92072]: pgmap v2084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:02:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:26 smithi122 ceph-mon[125440]: pgmap v2084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:02:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:26 smithi136 ceph-mon[125702]: pgmap v2084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:02:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:28 smithi057 ceph-mon[92072]: pgmap v2085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:02:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:28 smithi122 ceph-mon[125440]: pgmap v2085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:02:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:28 smithi136 ceph-mon[125702]: pgmap v2085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:02:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:30 smithi057 ceph-mon[92072]: pgmap v2086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:30 smithi122 ceph-mon[125440]: pgmap v2086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:30 smithi136 ceph-mon[125702]: pgmap v2086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:32 smithi057 ceph-mon[92072]: pgmap v2087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:32 smithi122 ceph-mon[125440]: pgmap v2087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:32 smithi136 ceph-mon[125702]: pgmap v2087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:34 smithi057 ceph-mon[92072]: pgmap v2088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:34 smithi122 ceph-mon[125440]: pgmap v2088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:34 smithi136 ceph-mon[125702]: pgmap v2088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:36.845+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:02:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:36.846+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:02:36.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:36.846+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:02:36.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:36.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:02:36.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:36.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:02:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:36 smithi057 ceph-mon[92072]: pgmap v2089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:37.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:36 smithi122 ceph-mon[125440]: pgmap v2089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:36 smithi136 ceph-mon[125702]: pgmap v2089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:38 smithi057 ceph-mon[92072]: pgmap v2090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:39.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:38 smithi122 ceph-mon[125440]: pgmap v2090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:38 smithi136 ceph-mon[125702]: pgmap v2090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:40 smithi057 ceph-mon[92072]: pgmap v2091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:40 smithi122 ceph-mon[125440]: pgmap v2091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:40 smithi136 ceph-mon[125702]: pgmap v2091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:42 smithi057 ceph-mon[92072]: pgmap v2092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:42 smithi122 ceph-mon[125440]: pgmap v2092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:42 smithi136 ceph-mon[125702]: pgmap v2092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:44 smithi057 ceph-mon[92072]: pgmap v2093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:44 smithi122 ceph-mon[125440]: pgmap v2093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:44 smithi136 ceph-mon[125702]: pgmap v2093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:46 smithi057 ceph-mon[92072]: pgmap v2094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:46 smithi122 ceph-mon[125440]: pgmap v2094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:46 smithi136 ceph-mon[125702]: pgmap v2094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:48 smithi057 ceph-mon[92072]: pgmap v2095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:48 smithi122 ceph-mon[125440]: pgmap v2095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:48 smithi136 ceph-mon[125702]: pgmap v2095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:50 smithi122 ceph-mon[125440]: pgmap v2096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:50 smithi136 ceph-mon[125702]: pgmap v2096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:51.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:50 smithi057 ceph-mon[92072]: pgmap v2096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:51.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:02:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:51.855+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:02:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:51.855+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:02:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:51.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:02:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:02:51.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:02:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:52 smithi122 ceph-mon[125440]: pgmap v2097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:53.348 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:52 smithi136 ceph-mon[125702]: pgmap v2097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:52 smithi057 ceph-mon[92072]: pgmap v2097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:55.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:54 smithi122 ceph-mon[125440]: pgmap v2098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:54 smithi136 ceph-mon[125702]: pgmap v2098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:54 smithi057 ceph-mon[92072]: pgmap v2098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:57.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:56 smithi136 ceph-mon[125702]: pgmap v2099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:57.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:56 smithi057 ceph-mon[92072]: pgmap v2099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:57.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:56 smithi122 ceph-mon[125440]: pgmap v2099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:02:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:02:58 smithi136 ceph-mon[125702]: pgmap v2100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:02:58 smithi057 ceph-mon[92072]: pgmap v2100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:02:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:02:58 smithi122 ceph-mon[125440]: pgmap v2100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:00 smithi136 ceph-mon[125702]: pgmap v2101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:00 smithi057 ceph-mon[92072]: pgmap v2101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:01.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:00 smithi122 ceph-mon[125440]: pgmap v2101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:02 smithi136 ceph-mon[125702]: pgmap v2102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:03:03.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:02 smithi057 ceph-mon[92072]: pgmap v2102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:03:03.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:02 smithi122 ceph-mon[125440]: pgmap v2102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:03:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:04 smithi136 ceph-mon[125702]: pgmap v2103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:03:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:04 smithi057 ceph-mon[92072]: pgmap v2103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:03:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:04 smithi122 ceph-mon[125440]: pgmap v2103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:03:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:06.861+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:03:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:06.862+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:03:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:06.862+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:03:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:06.862+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:03:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:06.862+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:03:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:06 smithi136 ceph-mon[125702]: pgmap v2104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:03:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:06 smithi057 ceph-mon[92072]: pgmap v2104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:03:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:06 smithi122 ceph-mon[125440]: pgmap v2104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:03:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:08 smithi136 ceph-mon[125702]: pgmap v2105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:03:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:08 smithi057 ceph-mon[92072]: pgmap v2105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:03:09.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:08 smithi122 ceph-mon[125440]: pgmap v2105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:03:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:10 smithi136 ceph-mon[125702]: pgmap v2106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:03:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:10 smithi057 ceph-mon[92072]: pgmap v2106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:03:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:10 smithi122 ceph-mon[125440]: pgmap v2106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:03:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:12 smithi136 ceph-mon[125702]: osdmap e207: 12 total, 12 up, 12 in 2023-03-02T12:03:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:12 smithi057 ceph-mon[92072]: osdmap e207: 12 total, 12 up, 12 in 2023-03-02T12:03:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:12 smithi122 ceph-mon[125440]: osdmap e207: 12 total, 12 up, 12 in 2023-03-02T12:03:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:13 smithi136 ceph-mon[125702]: pgmap v2108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:13 smithi057 ceph-mon[92072]: pgmap v2108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:13 smithi122 ceph-mon[125440]: pgmap v2108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:15 smithi136 ceph-mon[125702]: pgmap v2109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:15 smithi057 ceph-mon[92072]: pgmap v2109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:15 smithi122 ceph-mon[125440]: pgmap v2109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:17 smithi136 ceph-mon[125702]: pgmap v2110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:17 smithi057 ceph-mon[92072]: pgmap v2110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:17 smithi122 ceph-mon[125440]: pgmap v2110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:19 smithi136 ceph-mon[125702]: pgmap v2111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:19 smithi057 ceph-mon[92072]: pgmap v2111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:19.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:19 smithi122 ceph-mon[125440]: pgmap v2111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:20 smithi136 ceph-mon[125702]: pgmap v2112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:20 smithi136 ceph-mon[125702]: osdmap e208: 12 total, 12 up, 12 in 2023-03-02T12:03:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:20 smithi057 ceph-mon[92072]: pgmap v2112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:20 smithi057 ceph-mon[92072]: osdmap e208: 12 total, 12 up, 12 in 2023-03-02T12:03:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:20 smithi122 ceph-mon[125440]: pgmap v2112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:03:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:20 smithi122 ceph-mon[125440]: osdmap e208: 12 total, 12 up, 12 in 2023-03-02T12:03:21.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:21.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:21.874+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:21.874+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:21.874+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:03:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:21.874+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:03:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:22 smithi136 ceph-mon[125702]: pgmap v2114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:03:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:03:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:22 smithi057 ceph-mon[92072]: pgmap v2114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:03:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:03:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:22 smithi122 ceph-mon[125440]: pgmap v2114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:03:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:03:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:03:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:03:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:03:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:03:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:03:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:03:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:03:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:03:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:03:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:24 smithi136 ceph-mon[125702]: pgmap v2115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:03:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:24 smithi057 ceph-mon[92072]: pgmap v2115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:03:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:24 smithi122 ceph-mon[125440]: pgmap v2115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:03:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:26 smithi136 ceph-mon[125702]: pgmap v2116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:03:27.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:26 smithi057 ceph-mon[92072]: pgmap v2116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:03:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:26 smithi122 ceph-mon[125440]: pgmap v2116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:03:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:28 smithi136 ceph-mon[125702]: pgmap v2117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:03:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:28 smithi057 ceph-mon[92072]: pgmap v2117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:03:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:28 smithi122 ceph-mon[125440]: pgmap v2117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:03:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:30 smithi136 ceph-mon[125702]: pgmap v2118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:03:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:30 smithi057 ceph-mon[92072]: pgmap v2118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:03:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:30 smithi122 ceph-mon[125440]: pgmap v2118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:03:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:32 smithi136 ceph-mon[125702]: pgmap v2119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T12:03:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:32 smithi057 ceph-mon[92072]: pgmap v2119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T12:03:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:32 smithi122 ceph-mon[125440]: pgmap v2119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T12:03:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:34 smithi136 ceph-mon[125702]: pgmap v2120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:34 smithi057 ceph-mon[92072]: pgmap v2120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:34 smithi122 ceph-mon[125440]: pgmap v2120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:36.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:03:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:36.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:03:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:36.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:03:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:36.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:03:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:36.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:03:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:36 smithi136 ceph-mon[125702]: pgmap v2121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:36 smithi057 ceph-mon[92072]: pgmap v2121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:36 smithi122 ceph-mon[125440]: pgmap v2121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:38 smithi136 ceph-mon[125702]: pgmap v2122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:38 smithi057 ceph-mon[92072]: pgmap v2122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:39.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:38 smithi122 ceph-mon[125440]: pgmap v2122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:40 smithi057 ceph-mon[92072]: pgmap v2123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:40 smithi122 ceph-mon[125440]: pgmap v2123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:40 smithi136 ceph-mon[125702]: pgmap v2123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:42 smithi057 ceph-mon[92072]: pgmap v2124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:42 smithi122 ceph-mon[125440]: pgmap v2124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:42 smithi136 ceph-mon[125702]: pgmap v2124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:44 smithi057 ceph-mon[92072]: pgmap v2125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:03:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:44 smithi122 ceph-mon[125440]: pgmap v2125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:03:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:44 smithi136 ceph-mon[125702]: pgmap v2125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:03:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:46 smithi057 ceph-mon[92072]: pgmap v2126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:03:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:46 smithi122 ceph-mon[125440]: pgmap v2126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:03:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:46 smithi136 ceph-mon[125702]: pgmap v2126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:03:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:48 smithi057 ceph-mon[92072]: pgmap v2127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:48 smithi122 ceph-mon[125440]: pgmap v2127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:48 smithi136 ceph-mon[125702]: pgmap v2127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:50 smithi057 ceph-mon[92072]: pgmap v2128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:03:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:50 smithi122 ceph-mon[125440]: pgmap v2128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:03:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:50 smithi136 ceph-mon[125702]: pgmap v2128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:03:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:51.903+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:03:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:51.903+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:03:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:51.903+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:03:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:51.903+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:03:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:03:51.903+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:03:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:52 smithi057 ceph-mon[92072]: pgmap v2129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:52 smithi122 ceph-mon[125440]: pgmap v2129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:52 smithi136 ceph-mon[125702]: pgmap v2129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:54 smithi057 ceph-mon[92072]: pgmap v2130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:54 smithi122 ceph-mon[125440]: pgmap v2130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:54 smithi136 ceph-mon[125702]: pgmap v2130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:56 smithi057 ceph-mon[92072]: pgmap v2131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:56 smithi122 ceph-mon[125440]: pgmap v2131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:56 smithi136 ceph-mon[125702]: pgmap v2131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:03:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:03:58 smithi057 ceph-mon[92072]: pgmap v2132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:03:58 smithi122 ceph-mon[125440]: pgmap v2132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:03:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:03:58 smithi136 ceph-mon[125702]: pgmap v2132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:00 smithi057 ceph-mon[92072]: pgmap v2133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:00 smithi122 ceph-mon[125440]: pgmap v2133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:00 smithi136 ceph-mon[125702]: pgmap v2133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:02 smithi057 ceph-mon[92072]: pgmap v2134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:04:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:02 smithi122 ceph-mon[125440]: pgmap v2134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:04:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:02 smithi136 ceph-mon[125702]: pgmap v2134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:04:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:04 smithi057 ceph-mon[92072]: pgmap v2135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:04:05.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:04 smithi122 ceph-mon[125440]: pgmap v2135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:04:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:04 smithi136 ceph-mon[125702]: pgmap v2135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:04:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:06.919+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:04:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:06.920+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:04:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:06.920+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:04:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:06.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:04:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:06.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:04:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:06 smithi057 ceph-mon[92072]: pgmap v2136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:04:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:06 smithi122 ceph-mon[125440]: pgmap v2136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:04:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:06 smithi136 ceph-mon[125702]: pgmap v2136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:04:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:08 smithi057 ceph-mon[92072]: pgmap v2137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:04:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:08 smithi122 ceph-mon[125440]: pgmap v2137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:04:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:08 smithi136 ceph-mon[125702]: pgmap v2137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:04:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:10 smithi057 ceph-mon[92072]: pgmap v2138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:04:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:10 smithi122 ceph-mon[125440]: pgmap v2138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:04:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:10 smithi136 ceph-mon[125702]: pgmap v2138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:04:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:11 smithi057 ceph-mon[92072]: osdmap e209: 12 total, 12 up, 12 in 2023-03-02T12:04:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:11 smithi122 ceph-mon[125440]: osdmap e209: 12 total, 12 up, 12 in 2023-03-02T12:04:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:11 smithi136 ceph-mon[125702]: osdmap e209: 12 total, 12 up, 12 in 2023-03-02T12:04:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:12 smithi057 ceph-mon[92072]: pgmap v2140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:12 smithi122 ceph-mon[125440]: pgmap v2140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:12 smithi136 ceph-mon[125702]: pgmap v2140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:14 smithi057 ceph-mon[92072]: pgmap v2141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:14 smithi122 ceph-mon[125440]: pgmap v2141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:14 smithi136 ceph-mon[125702]: pgmap v2141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:16 smithi122 ceph-mon[125440]: pgmap v2142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:16 smithi136 ceph-mon[125702]: pgmap v2142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:16 smithi057 ceph-mon[92072]: pgmap v2142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:19.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:18 smithi122 ceph-mon[125440]: pgmap v2143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:18 smithi136 ceph-mon[125702]: pgmap v2143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:18 smithi057 ceph-mon[92072]: pgmap v2143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:20 smithi136 ceph-mon[125702]: pgmap v2144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:20 smithi136 ceph-mon[125702]: osdmap e210: 12 total, 12 up, 12 in 2023-03-02T12:04:21.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:20 smithi057 ceph-mon[92072]: pgmap v2144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:21.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:20 smithi057 ceph-mon[92072]: osdmap e210: 12 total, 12 up, 12 in 2023-03-02T12:04:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:20 smithi122 ceph-mon[125440]: pgmap v2144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:04:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:20 smithi122 ceph-mon[125440]: osdmap e210: 12 total, 12 up, 12 in 2023-03-02T12:04:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:21.926+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:04:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:21.927+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:04:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:21.927+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:04:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:21.927+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:04:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:21.927+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:04:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:22 smithi136 ceph-mon[125702]: pgmap v2146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:04:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:22 smithi057 ceph-mon[92072]: pgmap v2146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:04:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:22 smithi122 ceph-mon[125440]: pgmap v2146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:04:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:04:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:04:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:04:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:24 smithi057 ceph-mon[92072]: pgmap v2147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:04:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:04:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:04:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:04:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:24 smithi122 ceph-mon[125440]: pgmap v2147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:04:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:04:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:04:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:04:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:24 smithi136 ceph-mon[125702]: pgmap v2147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:04:25.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:04:25.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:04:25.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:04:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:26 smithi057 ceph-mon[92072]: pgmap v2148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:04:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:26 smithi122 ceph-mon[125440]: pgmap v2148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:04:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:26 smithi136 ceph-mon[125702]: pgmap v2148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:04:29.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:28 smithi057 ceph-mon[92072]: pgmap v2149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:04:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:28 smithi122 ceph-mon[125440]: pgmap v2149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:04:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:28 smithi136 ceph-mon[125702]: pgmap v2149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:04:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:30 smithi057 ceph-mon[92072]: pgmap v2150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:04:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:30 smithi122 ceph-mon[125440]: pgmap v2150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:04:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:30 smithi136 ceph-mon[125702]: pgmap v2150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T12:04:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:32 smithi057 ceph-mon[92072]: pgmap v2151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T12:04:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:32 smithi122 ceph-mon[125440]: pgmap v2151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T12:04:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:32 smithi136 ceph-mon[125702]: pgmap v2151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T12:04:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:34 smithi057 ceph-mon[92072]: pgmap v2152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:34 smithi122 ceph-mon[125440]: pgmap v2152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:34 smithi136 ceph-mon[125702]: pgmap v2152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:36.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:04:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:36.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:04:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:36.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:04:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:36.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:04:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:36.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:04:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:36 smithi057 ceph-mon[92072]: pgmap v2153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:36 smithi122 ceph-mon[125440]: pgmap v2153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:36 smithi136 ceph-mon[125702]: pgmap v2153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:38 smithi057 ceph-mon[92072]: pgmap v2154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:39.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:38 smithi122 ceph-mon[125440]: pgmap v2154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:38 smithi136 ceph-mon[125702]: pgmap v2154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:40 smithi057 ceph-mon[92072]: pgmap v2155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:40 smithi122 ceph-mon[125440]: pgmap v2155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:40 smithi136 ceph-mon[125702]: pgmap v2155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:42 smithi057 ceph-mon[92072]: pgmap v2156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:42 smithi122 ceph-mon[125440]: pgmap v2156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:42 smithi136 ceph-mon[125702]: pgmap v2156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:44 smithi057 ceph-mon[92072]: pgmap v2157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:44 smithi122 ceph-mon[125440]: pgmap v2157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:44 smithi136 ceph-mon[125702]: pgmap v2157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:46 smithi057 ceph-mon[92072]: pgmap v2158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:46 smithi122 ceph-mon[125440]: pgmap v2158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:46 smithi136 ceph-mon[125702]: pgmap v2158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:48 smithi057 ceph-mon[92072]: pgmap v2159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:48 smithi122 ceph-mon[125440]: pgmap v2159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:48 smithi136 ceph-mon[125702]: pgmap v2159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:50 smithi057 ceph-mon[92072]: pgmap v2160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:50 smithi122 ceph-mon[125440]: pgmap v2160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:50 smithi136 ceph-mon[125702]: pgmap v2160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:51.956+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:04:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:51.956+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:04:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:51.956+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:04:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:51.956+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:04:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:04:51.956+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:04:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:52 smithi057 ceph-mon[92072]: pgmap v2161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:52 smithi122 ceph-mon[125440]: pgmap v2161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:52 smithi136 ceph-mon[125702]: pgmap v2161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:54 smithi057 ceph-mon[92072]: pgmap v2162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:55.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:54 smithi122 ceph-mon[125440]: pgmap v2162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:54 smithi136 ceph-mon[125702]: pgmap v2162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:56 smithi057 ceph-mon[92072]: pgmap v2163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:57.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:56 smithi122 ceph-mon[125440]: pgmap v2163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:56 smithi136 ceph-mon[125702]: pgmap v2163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:04:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:04:58 smithi057 ceph-mon[92072]: pgmap v2164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:04:58 smithi122 ceph-mon[125440]: pgmap v2164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:04:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:04:58 smithi136 ceph-mon[125702]: pgmap v2164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:00 smithi057 ceph-mon[92072]: pgmap v2165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:00 smithi122 ceph-mon[125440]: pgmap v2165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:00 smithi136 ceph-mon[125702]: pgmap v2165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:02 smithi057 ceph-mon[92072]: pgmap v2166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T12:05:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:02 smithi122 ceph-mon[125440]: pgmap v2166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T12:05:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:02 smithi136 ceph-mon[125702]: pgmap v2166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T12:05:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:04 smithi057 ceph-mon[92072]: pgmap v2167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T12:05:05.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:04 smithi122 ceph-mon[125440]: pgmap v2167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T12:05:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:04 smithi136 ceph-mon[125702]: pgmap v2167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T12:05:06.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:06.960+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:05:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:06.960+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:05:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:06.960+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:05:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:06.960+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:05:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:06.960+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:05:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:06 smithi057 ceph-mon[92072]: pgmap v2168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T12:05:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:06 smithi122 ceph-mon[125440]: pgmap v2168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T12:05:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:06 smithi136 ceph-mon[125702]: pgmap v2168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T12:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:08.921+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:05:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:08.921+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:08.922+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 35 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:08.922+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:08.922+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 34 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:08.922+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:08.922+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 36 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:05:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:08.922+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 35 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:05:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:08 smithi057 ceph-mon[92072]: pgmap v2169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T12:05:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:08 smithi122 ceph-mon[125440]: pgmap v2169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T12:05:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:08 smithi136 ceph-mon[125702]: pgmap v2169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T12:05:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:10 smithi122 ceph-mon[125440]: pgmap v2170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T12:05:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:10 smithi136 ceph-mon[125702]: pgmap v2170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T12:05:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:10 smithi057 ceph-mon[92072]: pgmap v2170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T12:05:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:12 smithi122 ceph-mon[125440]: pgmap v2171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T12:05:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:12 smithi136 ceph-mon[125702]: pgmap v2171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T12:05:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:12 smithi057 ceph-mon[92072]: pgmap v2171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T12:05:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:14 smithi136 ceph-mon[125702]: pgmap v2172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T12:05:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:14 smithi057 ceph-mon[92072]: pgmap v2172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T12:05:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:14 smithi122 ceph-mon[125440]: pgmap v2172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T12:05:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:16 smithi136 ceph-mon[125702]: pgmap v2173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T12:05:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:16 smithi057 ceph-mon[92072]: pgmap v2173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T12:05:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:16 smithi122 ceph-mon[125440]: pgmap v2173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T12:05:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:18 smithi136 ceph-mon[125702]: pgmap v2174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:05:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:18 smithi057 ceph-mon[92072]: pgmap v2174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:05:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:18 smithi122 ceph-mon[125440]: pgmap v2174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:05:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:20 smithi136 ceph-mon[125702]: pgmap v2175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T12:05:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:20 smithi057 ceph-mon[92072]: pgmap v2175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T12:05:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:20 smithi122 ceph-mon[125440]: pgmap v2175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T12:05:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:21.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:05:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:21.975+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:05:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:21.975+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:05:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:21.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:05:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:21.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:05:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:22 smithi136 ceph-mon[125702]: pgmap v2176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:05:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:22 smithi057 ceph-mon[92072]: pgmap v2176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:05:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:22 smithi122 ceph-mon[125440]: pgmap v2176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:05:25.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:24 smithi136 ceph-mon[125702]: pgmap v2177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:25.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:05:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:24 smithi057 ceph-mon[92072]: pgmap v2177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:25.492 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:05:25.492 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:24 smithi122 ceph-mon[125440]: pgmap v2177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:25.493 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:05:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:05:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:05:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:05:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:05:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:05:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:05:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:05:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:05:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:05:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:26 smithi136 ceph-mon[125702]: pgmap v2178: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:26 smithi057 ceph-mon[92072]: pgmap v2178: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:26 smithi122 ceph-mon[125440]: pgmap v2178: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:28 smithi136 ceph-mon[125702]: pgmap v2179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:28 smithi057 ceph-mon[92072]: pgmap v2179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:28 smithi122 ceph-mon[125440]: pgmap v2179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:31 smithi136 ceph-mon[125702]: pgmap v2180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:31 smithi057 ceph-mon[92072]: pgmap v2180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:31 smithi122 ceph-mon[125440]: pgmap v2180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:33 smithi136 ceph-mon[125702]: pgmap v2181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:33 smithi057 ceph-mon[92072]: pgmap v2181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:33 smithi122 ceph-mon[125440]: pgmap v2181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:35 smithi136 ceph-mon[125702]: pgmap v2182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:35 smithi057 ceph-mon[92072]: pgmap v2182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:35 smithi122 ceph-mon[125440]: pgmap v2182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:36.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:05:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:36.990+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:05:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:36.990+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:05:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:36.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:05:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:36.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:05:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:37 smithi136 ceph-mon[125702]: pgmap v2183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:37 smithi057 ceph-mon[92072]: pgmap v2183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:37 smithi122 ceph-mon[125440]: pgmap v2183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:39 smithi136 ceph-mon[125702]: pgmap v2184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:39 smithi057 ceph-mon[92072]: pgmap v2184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:39.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:39 smithi122 ceph-mon[125440]: pgmap v2184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:41 smithi136 ceph-mon[125702]: pgmap v2185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:41 smithi057 ceph-mon[92072]: pgmap v2185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:41 smithi122 ceph-mon[125440]: pgmap v2185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:43 smithi136 ceph-mon[125702]: pgmap v2186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:43 smithi057 ceph-mon[92072]: pgmap v2186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:43 smithi122 ceph-mon[125440]: pgmap v2186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:45 smithi136 ceph-mon[125702]: pgmap v2187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:45 smithi057 ceph-mon[92072]: pgmap v2187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:45 smithi122 ceph-mon[125440]: pgmap v2187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:47.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:47 smithi136 ceph-mon[125702]: pgmap v2188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:47 smithi057 ceph-mon[92072]: pgmap v2188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:47 smithi122 ceph-mon[125440]: pgmap v2188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:49 smithi136 ceph-mon[125702]: pgmap v2189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:49 smithi057 ceph-mon[92072]: pgmap v2189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:49 smithi122 ceph-mon[125440]: pgmap v2189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:51 smithi136 ceph-mon[125702]: pgmap v2190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:51 smithi057 ceph-mon[92072]: pgmap v2190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:51 smithi122 ceph-mon[125440]: pgmap v2190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:52.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:52.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:05:52.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:52.002+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:05:52.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:52.002+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:05:52.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:52.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:05:52.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:05:52.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:05:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:53 smithi136 ceph-mon[125702]: pgmap v2191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:53 smithi057 ceph-mon[92072]: pgmap v2191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:53 smithi122 ceph-mon[125440]: pgmap v2191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:55 smithi136 ceph-mon[125702]: pgmap v2192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:55 smithi057 ceph-mon[92072]: pgmap v2192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:55 smithi122 ceph-mon[125440]: pgmap v2192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:57 smithi136 ceph-mon[125702]: pgmap v2193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:57 smithi057 ceph-mon[92072]: pgmap v2193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:57 smithi122 ceph-mon[125440]: pgmap v2193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:05:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:05:59 smithi136 ceph-mon[125702]: pgmap v2194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:05:59 smithi057 ceph-mon[92072]: pgmap v2194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:05:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:05:59 smithi122 ceph-mon[125440]: pgmap v2194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:01 smithi136 ceph-mon[125702]: pgmap v2195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:01.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:01 smithi057 ceph-mon[92072]: pgmap v2195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:01 smithi122 ceph-mon[125440]: pgmap v2195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:03 smithi136 ceph-mon[125702]: pgmap v2196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:06:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:03 smithi057 ceph-mon[92072]: pgmap v2196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:06:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:03 smithi122 ceph-mon[125440]: pgmap v2196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:06:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:05 smithi136 ceph-mon[125702]: pgmap v2197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:06:05.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:05 smithi057 ceph-mon[92072]: pgmap v2197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:06:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:05 smithi122 ceph-mon[125440]: pgmap v2197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:06:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:07.016+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:06:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:07.017+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:06:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:07.017+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:06:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:07.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:06:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:07.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:06:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:07 smithi136 ceph-mon[125702]: pgmap v2198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:06:07.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:07 smithi057 ceph-mon[92072]: pgmap v2198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:06:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:07 smithi122 ceph-mon[125440]: pgmap v2198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:06:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:09 smithi057 ceph-mon[92072]: pgmap v2199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:06:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:09 smithi122 ceph-mon[125440]: pgmap v2199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:06:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:09 smithi136 ceph-mon[125702]: pgmap v2199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:06:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:11 smithi057 ceph-mon[92072]: pgmap v2200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:06:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:11 smithi057 ceph-mon[92072]: osdmap e211: 12 total, 12 up, 12 in 2023-03-02T12:06:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:11 smithi122 ceph-mon[125440]: pgmap v2200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:06:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:11 smithi122 ceph-mon[125440]: osdmap e211: 12 total, 12 up, 12 in 2023-03-02T12:06:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:11 smithi136 ceph-mon[125702]: pgmap v2200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:06:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:11 smithi136 ceph-mon[125702]: osdmap e211: 12 total, 12 up, 12 in 2023-03-02T12:06:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:13 smithi057 ceph-mon[92072]: pgmap v2202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:06:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:13 smithi122 ceph-mon[125440]: pgmap v2202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:06:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:13 smithi136 ceph-mon[125702]: pgmap v2202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:06:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:15 smithi057 ceph-mon[92072]: pgmap v2203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:06:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:15 smithi057 ceph-mon[92072]: osdmap e212: 12 total, 12 up, 12 in 2023-03-02T12:06:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:15 smithi122 ceph-mon[125440]: pgmap v2203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:06:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:15 smithi122 ceph-mon[125440]: osdmap e212: 12 total, 12 up, 12 in 2023-03-02T12:06:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:15 smithi136 ceph-mon[125702]: pgmap v2203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:06:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:15 smithi136 ceph-mon[125702]: osdmap e212: 12 total, 12 up, 12 in 2023-03-02T12:06:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:17 smithi057 ceph-mon[92072]: pgmap v2205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:06:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:17 smithi122 ceph-mon[125440]: pgmap v2205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:06:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:17 smithi136 ceph-mon[125702]: pgmap v2205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:06:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:19 smithi057 ceph-mon[92072]: pgmap v2206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:06:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:19 smithi122 ceph-mon[125440]: pgmap v2206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:06:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:19 smithi136 ceph-mon[125702]: pgmap v2206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:06:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:21 smithi057 ceph-mon[92072]: pgmap v2207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:06:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:21 smithi122 ceph-mon[125440]: pgmap v2207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:06:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:21 smithi136 ceph-mon[125702]: pgmap v2207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:06:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:22.033+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:06:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:22.033+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:06:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:22.033+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:06:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:22.033+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:06:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:22.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:06:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:23 smithi057 ceph-mon[92072]: pgmap v2208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:06:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:23 smithi122 ceph-mon[125440]: pgmap v2208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:06:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:23 smithi136 ceph-mon[125702]: pgmap v2208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:06:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:25 smithi057 ceph-mon[92072]: pgmap v2209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:06:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:25 smithi122 ceph-mon[125440]: pgmap v2209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:06:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:25 smithi136 ceph-mon[125702]: pgmap v2209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:06:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:06:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:06:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:06:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:27 smithi057 ceph-mon[92072]: pgmap v2210: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:06:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:06:27.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:06:27.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:06:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:27 smithi122 ceph-mon[125440]: pgmap v2210: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:06:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:06:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:06:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:06:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:27 smithi136 ceph-mon[125702]: pgmap v2210: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:06:27.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:06:27.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:06:27.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:06:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:29 smithi057 ceph-mon[92072]: pgmap v2211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:06:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:29 smithi122 ceph-mon[125440]: pgmap v2211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:06:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:29 smithi136 ceph-mon[125702]: pgmap v2211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:06:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:31 smithi057 ceph-mon[92072]: pgmap v2212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:31 smithi122 ceph-mon[125440]: pgmap v2212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:31 smithi136 ceph-mon[125702]: pgmap v2212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:33 smithi057 ceph-mon[92072]: pgmap v2213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:33 smithi122 ceph-mon[125440]: pgmap v2213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:33 smithi136 ceph-mon[125702]: pgmap v2213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:35 smithi057 ceph-mon[92072]: pgmap v2214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:35 smithi122 ceph-mon[125440]: pgmap v2214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:35 smithi136 ceph-mon[125702]: pgmap v2214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:37.049+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:06:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:37.049+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:06:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:37.049+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:06:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:37.049+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:06:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:37.049+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:06:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:37 smithi057 ceph-mon[92072]: pgmap v2215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:37 smithi122 ceph-mon[125440]: pgmap v2215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:37 smithi136 ceph-mon[125702]: pgmap v2215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:39 smithi057 ceph-mon[92072]: pgmap v2216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:39 smithi122 ceph-mon[125440]: pgmap v2216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:39 smithi136 ceph-mon[125702]: pgmap v2216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:41 smithi057 ceph-mon[92072]: pgmap v2217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:41 smithi122 ceph-mon[125440]: pgmap v2217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:41 smithi136 ceph-mon[125702]: pgmap v2217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:43 smithi057 ceph-mon[92072]: pgmap v2218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:43 smithi122 ceph-mon[125440]: pgmap v2218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:43 smithi136 ceph-mon[125702]: pgmap v2218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:45 smithi057 ceph-mon[92072]: pgmap v2219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:45 smithi122 ceph-mon[125440]: pgmap v2219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:45 smithi136 ceph-mon[125702]: pgmap v2219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:47 smithi057 ceph-mon[92072]: pgmap v2220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:47 smithi122 ceph-mon[125440]: pgmap v2220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:47 smithi136 ceph-mon[125702]: pgmap v2220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:49 smithi057 ceph-mon[92072]: pgmap v2221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:49 smithi122 ceph-mon[125440]: pgmap v2221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:49 smithi136 ceph-mon[125702]: pgmap v2221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:51 smithi122 ceph-mon[125440]: pgmap v2222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:51 smithi136 ceph-mon[125702]: pgmap v2222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:51 smithi057 ceph-mon[92072]: pgmap v2222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:52.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:06:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:52.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:06:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:52.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:06:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:52.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:06:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:06:52.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:06:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:53 smithi122 ceph-mon[125440]: pgmap v2223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:53 smithi136 ceph-mon[125702]: pgmap v2223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:53 smithi057 ceph-mon[92072]: pgmap v2223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:55 smithi122 ceph-mon[125440]: pgmap v2224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:55 smithi136 ceph-mon[125702]: pgmap v2224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:55 smithi057 ceph-mon[92072]: pgmap v2224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:57 smithi122 ceph-mon[125440]: pgmap v2225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:57 smithi136 ceph-mon[125702]: pgmap v2225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:57 smithi057 ceph-mon[92072]: pgmap v2225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:06:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:06:59 smithi136 ceph-mon[125702]: pgmap v2226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:06:59 smithi057 ceph-mon[92072]: pgmap v2226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:06:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:06:59 smithi122 ceph-mon[125440]: pgmap v2226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:01 smithi136 ceph-mon[125702]: pgmap v2227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:01 smithi057 ceph-mon[92072]: pgmap v2227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:01 smithi122 ceph-mon[125440]: pgmap v2227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:03 smithi136 ceph-mon[125702]: pgmap v2228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:07:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:03 smithi057 ceph-mon[92072]: pgmap v2228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:07:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:03 smithi122 ceph-mon[125440]: pgmap v2228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:07:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:05 smithi136 ceph-mon[125702]: pgmap v2229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:07:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:05 smithi057 ceph-mon[92072]: pgmap v2229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:07:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:05 smithi122 ceph-mon[125440]: pgmap v2229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:07:07.076 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:07.074+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:07:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:07.074+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:07:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:07.074+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:07:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:07.074+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:07:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:07.074+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:07:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:07 smithi136 ceph-mon[125702]: pgmap v2230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:07:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:07 smithi057 ceph-mon[92072]: pgmap v2230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:07:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:07 smithi122 ceph-mon[125440]: pgmap v2230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:07:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:09 smithi136 ceph-mon[125702]: pgmap v2231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:07:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:09 smithi057 ceph-mon[92072]: pgmap v2231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:07:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:09 smithi122 ceph-mon[125440]: pgmap v2231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:07:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:11 smithi136 ceph-mon[125702]: pgmap v2232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:07:11.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:11 smithi136 ceph-mon[125702]: osdmap e213: 12 total, 12 up, 12 in 2023-03-02T12:07:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:11 smithi057 ceph-mon[92072]: pgmap v2232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:07:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:11 smithi057 ceph-mon[92072]: osdmap e213: 12 total, 12 up, 12 in 2023-03-02T12:07:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:11 smithi122 ceph-mon[125440]: pgmap v2232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:07:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:11 smithi122 ceph-mon[125440]: osdmap e213: 12 total, 12 up, 12 in 2023-03-02T12:07:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:13 smithi136 ceph-mon[125702]: pgmap v2234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:07:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:13 smithi057 ceph-mon[92072]: pgmap v2234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:07:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:13 smithi122 ceph-mon[125440]: pgmap v2234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:07:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:15 smithi136 ceph-mon[125702]: pgmap v2235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:07:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:15 smithi136 ceph-mon[125702]: osdmap e214: 12 total, 12 up, 12 in 2023-03-02T12:07:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:15 smithi057 ceph-mon[92072]: pgmap v2235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:07:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:15 smithi057 ceph-mon[92072]: osdmap e214: 12 total, 12 up, 12 in 2023-03-02T12:07:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:15 smithi122 ceph-mon[125440]: pgmap v2235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:07:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:15 smithi122 ceph-mon[125440]: osdmap e214: 12 total, 12 up, 12 in 2023-03-02T12:07:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:17 smithi136 ceph-mon[125702]: pgmap v2237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:07:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:17 smithi057 ceph-mon[92072]: pgmap v2237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:07:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:17 smithi122 ceph-mon[125440]: pgmap v2237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:07:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:19 smithi136 ceph-mon[125702]: pgmap v2238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:07:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:19 smithi057 ceph-mon[92072]: pgmap v2238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:07:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:19 smithi122 ceph-mon[125440]: pgmap v2238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:07:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:21 smithi136 ceph-mon[125702]: pgmap v2239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-02T12:07:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:21 smithi057 ceph-mon[92072]: pgmap v2239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-02T12:07:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:21 smithi122 ceph-mon[125440]: pgmap v2239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-02T12:07:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:22.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:07:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:22.079+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:07:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:22.079+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:07:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:22.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:07:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:22.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:07:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:22 smithi136 ceph-mon[125702]: pgmap v2240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:07:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:22 smithi057 ceph-mon[92072]: pgmap v2240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:07:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:22 smithi122 ceph-mon[125440]: pgmap v2240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:07:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:24 smithi057 ceph-mon[92072]: pgmap v2241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:07:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:24 smithi122 ceph-mon[125440]: pgmap v2241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:07:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:24 smithi136 ceph-mon[125702]: pgmap v2241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:07:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:26 smithi057 ceph-mon[92072]: pgmap v2242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:07:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:07:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:26 smithi122 ceph-mon[125440]: pgmap v2242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:07:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:07:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:26 smithi136 ceph-mon[125702]: pgmap v2242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:07:27.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:07:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:28 smithi057 ceph-mon[92072]: pgmap v2243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:07:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:07:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:07:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:07:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:28 smithi122 ceph-mon[125440]: pgmap v2243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:07:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:07:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:07:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:07:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:28 smithi136 ceph-mon[125702]: pgmap v2243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:07:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:07:29.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:07:29.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:07:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:30 smithi057 ceph-mon[92072]: pgmap v2244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:30 smithi122 ceph-mon[125440]: pgmap v2244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:30 smithi136 ceph-mon[125702]: pgmap v2244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:32 smithi057 ceph-mon[92072]: pgmap v2245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:32 smithi122 ceph-mon[125440]: pgmap v2245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:32 smithi136 ceph-mon[125702]: pgmap v2245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:34 smithi057 ceph-mon[92072]: pgmap v2246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:34 smithi122 ceph-mon[125440]: pgmap v2246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:34 smithi136 ceph-mon[125702]: pgmap v2246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:37.094+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:07:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:37.094+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:07:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:37.094+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:07:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:37.094+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:07:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:37.094+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:07:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:36 smithi057 ceph-mon[92072]: pgmap v2247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:36 smithi122 ceph-mon[125440]: pgmap v2247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:36 smithi136 ceph-mon[125702]: pgmap v2247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:38 smithi057 ceph-mon[92072]: pgmap v2248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:39.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:38 smithi122 ceph-mon[125440]: pgmap v2248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:38 smithi136 ceph-mon[125702]: pgmap v2248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:40 smithi057 ceph-mon[92072]: pgmap v2249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:40 smithi122 ceph-mon[125440]: pgmap v2249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:40 smithi136 ceph-mon[125702]: pgmap v2249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:42 smithi057 ceph-mon[92072]: pgmap v2250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:42 smithi122 ceph-mon[125440]: pgmap v2250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:42 smithi136 ceph-mon[125702]: pgmap v2250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:44 smithi057 ceph-mon[92072]: pgmap v2251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:44 smithi122 ceph-mon[125440]: pgmap v2251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:44 smithi136 ceph-mon[125702]: pgmap v2251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:46 smithi122 ceph-mon[125440]: pgmap v2252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:46 smithi136 ceph-mon[125702]: pgmap v2252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:46 smithi057 ceph-mon[92072]: pgmap v2252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:48 smithi122 ceph-mon[125440]: pgmap v2253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:48 smithi136 ceph-mon[125702]: pgmap v2253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:48 smithi057 ceph-mon[92072]: pgmap v2253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:50 smithi122 ceph-mon[125440]: pgmap v2254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:50 smithi136 ceph-mon[125702]: pgmap v2254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:50 smithi057 ceph-mon[92072]: pgmap v2254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:52.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:52.110+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:07:52.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:52.110+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:07:52.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:52.110+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:07:52.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:52.110+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:07:52.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:07:52.110+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:07:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:52 smithi122 ceph-mon[125440]: pgmap v2255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:52 smithi136 ceph-mon[125702]: pgmap v2255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:52 smithi057 ceph-mon[92072]: pgmap v2255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:55.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:54 smithi122 ceph-mon[125440]: pgmap v2256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:54 smithi136 ceph-mon[125702]: pgmap v2256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:54 smithi057 ceph-mon[92072]: pgmap v2256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:56 smithi122 ceph-mon[125440]: pgmap v2257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:56 smithi136 ceph-mon[125702]: pgmap v2257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:56 smithi057 ceph-mon[92072]: pgmap v2257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:07:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:07:58 smithi136 ceph-mon[125702]: pgmap v2258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:07:58 smithi057 ceph-mon[92072]: pgmap v2258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:07:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:07:58 smithi122 ceph-mon[125440]: pgmap v2258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:00 smithi136 ceph-mon[125702]: pgmap v2259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:00 smithi057 ceph-mon[92072]: pgmap v2259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:00 smithi122 ceph-mon[125440]: pgmap v2259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:02 smithi136 ceph-mon[125702]: pgmap v2260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:08:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:02 smithi057 ceph-mon[92072]: pgmap v2260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:08:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:02 smithi122 ceph-mon[125440]: pgmap v2260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:08:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:04 smithi136 ceph-mon[125702]: pgmap v2261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:08:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:04 smithi057 ceph-mon[92072]: pgmap v2261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:08:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:04 smithi122 ceph-mon[125440]: pgmap v2261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:08:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:07.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:07.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:07.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:07.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:07.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:08:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:06 smithi136 ceph-mon[125702]: pgmap v2262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:08:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:06 smithi057 ceph-mon[92072]: pgmap v2262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:08:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:06 smithi122 ceph-mon[125440]: pgmap v2262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:08:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:08.947+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:08.947+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:08:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:08.947+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 36 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:08:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:08.947+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 37 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:08:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:08 smithi136 ceph-mon[125702]: pgmap v2263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:08:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:08 smithi057 ceph-mon[92072]: pgmap v2263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:08:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:08 smithi122 ceph-mon[125440]: pgmap v2263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:08:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:11 smithi136 ceph-mon[125702]: pgmap v2264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:08:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:11 smithi057 ceph-mon[92072]: pgmap v2264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:08:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:11 smithi122 ceph-mon[125440]: pgmap v2264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:08:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:12 smithi136 ceph-mon[125702]: osdmap e215: 12 total, 12 up, 12 in 2023-03-02T12:08:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:12 smithi057 ceph-mon[92072]: osdmap e215: 12 total, 12 up, 12 in 2023-03-02T12:08:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:12 smithi122 ceph-mon[125440]: osdmap e215: 12 total, 12 up, 12 in 2023-03-02T12:08:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:13 smithi136 ceph-mon[125702]: pgmap v2266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:08:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:13 smithi057 ceph-mon[92072]: pgmap v2266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:08:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:13 smithi122 ceph-mon[125440]: pgmap v2266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:08:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:15 smithi136 ceph-mon[125702]: pgmap v2267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:08:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:15 smithi136 ceph-mon[125702]: osdmap e216: 12 total, 12 up, 12 in 2023-03-02T12:08:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:15 smithi057 ceph-mon[92072]: pgmap v2267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:08:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:15 smithi057 ceph-mon[92072]: osdmap e216: 12 total, 12 up, 12 in 2023-03-02T12:08:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:15 smithi122 ceph-mon[125440]: pgmap v2267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:08:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:15 smithi122 ceph-mon[125440]: osdmap e216: 12 total, 12 up, 12 in 2023-03-02T12:08:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:17 smithi136 ceph-mon[125702]: pgmap v2269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:08:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:17 smithi057 ceph-mon[92072]: pgmap v2269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:08:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:17 smithi122 ceph-mon[125440]: pgmap v2269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:08:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:19 smithi136 ceph-mon[125702]: pgmap v2270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:08:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:19 smithi057 ceph-mon[92072]: pgmap v2270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:08:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:19 smithi122 ceph-mon[125440]: pgmap v2270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:08:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:21 smithi136 ceph-mon[125702]: pgmap v2271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T12:08:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:21 smithi057 ceph-mon[92072]: pgmap v2271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T12:08:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:21 smithi122 ceph-mon[125440]: pgmap v2271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T12:08:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:22.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:22.139+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:22.139+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:22.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:08:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:22.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:08:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:23 smithi136 ceph-mon[125702]: pgmap v2272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:08:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:23 smithi057 ceph-mon[92072]: pgmap v2272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:08:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:23 smithi122 ceph-mon[125440]: pgmap v2272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:08:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:25 smithi136 ceph-mon[125702]: pgmap v2273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:08:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:25 smithi057 ceph-mon[92072]: pgmap v2273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:08:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:25 smithi122 ceph-mon[125440]: pgmap v2273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:08:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:27 smithi136 ceph-mon[125702]: pgmap v2274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:08:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:27 smithi057 ceph-mon[92072]: pgmap v2274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:08:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:27 smithi122 ceph-mon[125440]: pgmap v2274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:08:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:29 smithi136 ceph-mon[125702]: pgmap v2275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:08:29.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:08:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:29 smithi057 ceph-mon[92072]: pgmap v2275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:08:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:08:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:29 smithi122 ceph-mon[125440]: pgmap v2275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:08:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:08:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:08:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:08:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:08:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:08:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:08:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:08:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:08:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:08:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:08:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:31 smithi057 ceph-mon[92072]: pgmap v2276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:31 smithi122 ceph-mon[125440]: pgmap v2276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:31 smithi136 ceph-mon[125702]: pgmap v2276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:33 smithi057 ceph-mon[92072]: pgmap v2277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:33 smithi122 ceph-mon[125440]: pgmap v2277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:33 smithi136 ceph-mon[125702]: pgmap v2277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:35 smithi057 ceph-mon[92072]: pgmap v2278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:35 smithi122 ceph-mon[125440]: pgmap v2278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:35 smithi136 ceph-mon[125702]: pgmap v2278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:37.152+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:08:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:37.152+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:08:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:37.152+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:08:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:37.152+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:08:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:37.152+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:08:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:37 smithi057 ceph-mon[92072]: pgmap v2279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:37 smithi122 ceph-mon[125440]: pgmap v2279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:37 smithi136 ceph-mon[125702]: pgmap v2279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:39 smithi057 ceph-mon[92072]: pgmap v2280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:39 smithi122 ceph-mon[125440]: pgmap v2280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:39 smithi136 ceph-mon[125702]: pgmap v2280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:41 smithi122 ceph-mon[125440]: pgmap v2281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:41 smithi136 ceph-mon[125702]: pgmap v2281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:41 smithi057 ceph-mon[92072]: pgmap v2281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:43 smithi122 ceph-mon[125440]: pgmap v2282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:43 smithi136 ceph-mon[125702]: pgmap v2282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:43 smithi057 ceph-mon[92072]: pgmap v2282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:45 smithi122 ceph-mon[125440]: pgmap v2283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:45 smithi136 ceph-mon[125702]: pgmap v2283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:45 smithi057 ceph-mon[92072]: pgmap v2283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:47 smithi136 ceph-mon[125702]: pgmap v2284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:47 smithi057 ceph-mon[92072]: pgmap v2284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:47 smithi122 ceph-mon[125440]: pgmap v2284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:49 smithi136 ceph-mon[125702]: pgmap v2285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:49 smithi057 ceph-mon[92072]: pgmap v2285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:49 smithi122 ceph-mon[125440]: pgmap v2285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:51 smithi136 ceph-mon[125702]: pgmap v2286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:51 smithi057 ceph-mon[92072]: pgmap v2286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:51 smithi122 ceph-mon[125440]: pgmap v2286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:52.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:52.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:08:52.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:52.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:08:52.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:52.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:08:52.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:52.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:08:52.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:08:52.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:08:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:53 smithi136 ceph-mon[125702]: pgmap v2287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:53 smithi057 ceph-mon[92072]: pgmap v2287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:53 smithi122 ceph-mon[125440]: pgmap v2287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:55 smithi136 ceph-mon[125702]: pgmap v2288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:55 smithi057 ceph-mon[92072]: pgmap v2288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:55 smithi122 ceph-mon[125440]: pgmap v2288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:57 smithi136 ceph-mon[125702]: pgmap v2289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:57 smithi057 ceph-mon[92072]: pgmap v2289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:57 smithi122 ceph-mon[125440]: pgmap v2289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:08:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:08:59 smithi136 ceph-mon[125702]: pgmap v2290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:08:59 smithi057 ceph-mon[92072]: pgmap v2290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:08:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:08:59 smithi122 ceph-mon[125440]: pgmap v2290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:01 smithi136 ceph-mon[125702]: pgmap v2291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:01 smithi057 ceph-mon[92072]: pgmap v2291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:01 smithi122 ceph-mon[125440]: pgmap v2291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:03 smithi136 ceph-mon[125702]: pgmap v2292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:09:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:03 smithi057 ceph-mon[92072]: pgmap v2292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:09:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:03 smithi122 ceph-mon[125440]: pgmap v2292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:09:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:05 smithi136 ceph-mon[125702]: pgmap v2293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:09:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:05 smithi057 ceph-mon[92072]: pgmap v2293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:09:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:05 smithi122 ceph-mon[125440]: pgmap v2293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:09:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:07.175+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:09:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:07.176+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:09:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:07.176+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:09:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:07.176+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:09:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:07.176+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:09:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:07 smithi136 ceph-mon[125702]: pgmap v2294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:09:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:07 smithi057 ceph-mon[92072]: pgmap v2294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:09:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:07 smithi122 ceph-mon[125440]: pgmap v2294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:09:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:09 smithi136 ceph-mon[125702]: pgmap v2295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:09:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:09 smithi057 ceph-mon[92072]: pgmap v2295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:09:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:09 smithi122 ceph-mon[125440]: pgmap v2295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:09:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:11 smithi136 ceph-mon[125702]: pgmap v2296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:09:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:11 smithi136 ceph-mon[125702]: osdmap e217: 12 total, 12 up, 12 in 2023-03-02T12:09:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:11 smithi057 ceph-mon[92072]: pgmap v2296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:09:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:11 smithi057 ceph-mon[92072]: osdmap e217: 12 total, 12 up, 12 in 2023-03-02T12:09:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:11 smithi122 ceph-mon[125440]: pgmap v2296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:09:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:11 smithi122 ceph-mon[125440]: osdmap e217: 12 total, 12 up, 12 in 2023-03-02T12:09:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:13 smithi136 ceph-mon[125702]: pgmap v2298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:09:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:13 smithi057 ceph-mon[92072]: pgmap v2298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:09:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:13 smithi122 ceph-mon[125440]: pgmap v2298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:09:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:15 smithi136 ceph-mon[125702]: pgmap v2299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:09:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:15 smithi136 ceph-mon[125702]: osdmap e218: 12 total, 12 up, 12 in 2023-03-02T12:09:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:15 smithi057 ceph-mon[92072]: pgmap v2299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:09:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:15 smithi057 ceph-mon[92072]: osdmap e218: 12 total, 12 up, 12 in 2023-03-02T12:09:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:15 smithi122 ceph-mon[125440]: pgmap v2299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:09:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:15 smithi122 ceph-mon[125440]: osdmap e218: 12 total, 12 up, 12 in 2023-03-02T12:09:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:17 smithi136 ceph-mon[125702]: pgmap v2301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:09:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:17 smithi057 ceph-mon[92072]: pgmap v2301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:09:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:17 smithi122 ceph-mon[125440]: pgmap v2301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:09:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:18 smithi136 ceph-mon[125702]: pgmap v2302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:09:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:18 smithi057 ceph-mon[92072]: pgmap v2302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:09:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:18 smithi122 ceph-mon[125440]: pgmap v2302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:09:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:20 smithi057 ceph-mon[92072]: pgmap v2303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:09:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:20 smithi122 ceph-mon[125440]: pgmap v2303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:09:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:20 smithi136 ceph-mon[125702]: pgmap v2303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:09:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:22.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:09:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:22.183+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:09:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:22.183+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:09:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:22.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:09:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:22.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:09:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:22 smithi057 ceph-mon[92072]: pgmap v2304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:09:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:22 smithi122 ceph-mon[125440]: pgmap v2304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:09:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:22 smithi136 ceph-mon[125702]: pgmap v2304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:09:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:24 smithi057 ceph-mon[92072]: pgmap v2305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:09:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:24 smithi122 ceph-mon[125440]: pgmap v2305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:09:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:24 smithi136 ceph-mon[125702]: pgmap v2305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:09:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:26 smithi122 ceph-mon[125440]: pgmap v2306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:09:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:26 smithi136 ceph-mon[125702]: pgmap v2306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:09:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:26 smithi057 ceph-mon[92072]: pgmap v2306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:09:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:28 smithi122 ceph-mon[125440]: pgmap v2307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:09:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:28 smithi136 ceph-mon[125702]: pgmap v2307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:09:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:28 smithi057 ceph-mon[92072]: pgmap v2307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:09:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:09:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:09:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:09:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:30 smithi122 ceph-mon[125440]: pgmap v2308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:30 smithi136 ceph-mon[125702]: pgmap v2308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:30 smithi057 ceph-mon[92072]: pgmap v2308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:32 smithi136 ceph-mon[125702]: pgmap v2309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:32 smithi057 ceph-mon[92072]: pgmap v2309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:33.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:32 smithi122 ceph-mon[125440]: pgmap v2309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:33.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:09:34.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:09:34.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:09:34.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:09:34.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:09:34.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:09:34.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:09:34.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:09:34.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:09:34.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:09:34.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:09:34.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:09:34.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:09:34.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:09:34.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:09:34.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:09:34.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:09:34.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:09:34.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:09:34.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:09:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:34 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:09:35.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:34 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:09:35.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:34 smithi136 ceph-mon[125702]: pgmap v2310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:34 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:09:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:34 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:09:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:34 smithi057 ceph-mon[92072]: pgmap v2310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:34 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:09:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:34 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:09:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:34 smithi122 ceph-mon[125440]: pgmap v2310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:37.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:09:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:37.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:09:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:37.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:09:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:37.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:09:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:37.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:09:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:36 smithi136 ceph-mon[125702]: pgmap v2311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:36 smithi057 ceph-mon[92072]: pgmap v2311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:36 smithi122 ceph-mon[125440]: pgmap v2311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:38 smithi136 ceph-mon[125702]: pgmap v2312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:38 smithi057 ceph-mon[92072]: pgmap v2312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:38 smithi122 ceph-mon[125440]: pgmap v2312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:40 smithi136 ceph-mon[125702]: pgmap v2313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:40 smithi057 ceph-mon[92072]: pgmap v2313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:40 smithi122 ceph-mon[125440]: pgmap v2313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:42 smithi136 ceph-mon[125702]: pgmap v2314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:42 smithi057 ceph-mon[92072]: pgmap v2314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:42 smithi122 ceph-mon[125440]: pgmap v2314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:44 smithi136 ceph-mon[125702]: pgmap v2315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:44 smithi057 ceph-mon[92072]: pgmap v2315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:44 smithi122 ceph-mon[125440]: pgmap v2315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:46 smithi136 ceph-mon[125702]: pgmap v2316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:46 smithi057 ceph-mon[92072]: pgmap v2316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:47.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:46 smithi122 ceph-mon[125440]: pgmap v2316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:48 smithi136 ceph-mon[125702]: pgmap v2317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:48 smithi057 ceph-mon[92072]: pgmap v2317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:48 smithi122 ceph-mon[125440]: pgmap v2317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:50 smithi136 ceph-mon[125702]: pgmap v2318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:50 smithi057 ceph-mon[92072]: pgmap v2318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:50 smithi122 ceph-mon[125440]: pgmap v2318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:52.211+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:09:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:52.211+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:09:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:52.211+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:09:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:52.211+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:09:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:09:52.211+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:09:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:53 smithi136 ceph-mon[125702]: pgmap v2319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:52 smithi057 ceph-mon[92072]: pgmap v2319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:52 smithi122 ceph-mon[125440]: pgmap v2319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:55 smithi136 ceph-mon[125702]: pgmap v2320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:55 smithi057 ceph-mon[92072]: pgmap v2320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:55 smithi122 ceph-mon[125440]: pgmap v2320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:57 smithi136 ceph-mon[125702]: pgmap v2321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:57 smithi057 ceph-mon[92072]: pgmap v2321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:57 smithi122 ceph-mon[125440]: pgmap v2321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:09:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:09:59 smithi136 ceph-mon[125702]: pgmap v2322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:09:59 smithi057 ceph-mon[92072]: pgmap v2322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:09:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:09:59 smithi122 ceph-mon[125440]: pgmap v2322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:00 smithi057 ceph-mon[92072]: pgmap v2323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T12:10:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:00 smithi122 ceph-mon[125440]: pgmap v2323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T12:10:01.209 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:00 smithi136 ceph-mon[125702]: pgmap v2323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:01.210 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T12:10:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:02 smithi057 ceph-mon[92072]: pgmap v2324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:10:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:02 smithi122 ceph-mon[125440]: pgmap v2324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:10:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:02 smithi136 ceph-mon[125702]: pgmap v2324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:10:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:04 smithi057 ceph-mon[92072]: pgmap v2325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:10:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:04 smithi122 ceph-mon[125440]: pgmap v2325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:10:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:04 smithi136 ceph-mon[125702]: pgmap v2325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:10:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:06 smithi122 ceph-mon[125440]: pgmap v2326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:10:07.228 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:07.227+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:10:07.228 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:07.227+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:10:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:07.227+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:10:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:07.227+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:10:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:07.227+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:10:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:06 smithi136 ceph-mon[125702]: pgmap v2326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:10:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:06 smithi057 ceph-mon[92072]: pgmap v2326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:10:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:08 smithi122 ceph-mon[125440]: pgmap v2327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:10:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:08 smithi136 ceph-mon[125702]: pgmap v2327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:10:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:08 smithi057 ceph-mon[92072]: pgmap v2327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:10:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:10 smithi136 ceph-mon[125702]: pgmap v2328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:10:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:10 smithi057 ceph-mon[92072]: pgmap v2328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:10:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:10 smithi122 ceph-mon[125440]: pgmap v2328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:10:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:11 smithi136 ceph-mon[125702]: osdmap e219: 12 total, 12 up, 12 in 2023-03-02T12:10:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:11 smithi057 ceph-mon[92072]: osdmap e219: 12 total, 12 up, 12 in 2023-03-02T12:10:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:11 smithi122 ceph-mon[125440]: osdmap e219: 12 total, 12 up, 12 in 2023-03-02T12:10:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:12 smithi136 ceph-mon[125702]: pgmap v2330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:10:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:12 smithi057 ceph-mon[92072]: pgmap v2330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:10:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:12 smithi122 ceph-mon[125440]: pgmap v2330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:10:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:14 smithi136 ceph-mon[125702]: pgmap v2331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:10:15.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:14 smithi136 ceph-mon[125702]: osdmap e220: 12 total, 12 up, 12 in 2023-03-02T12:10:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:14 smithi057 ceph-mon[92072]: pgmap v2331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:10:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:14 smithi057 ceph-mon[92072]: osdmap e220: 12 total, 12 up, 12 in 2023-03-02T12:10:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:14 smithi122 ceph-mon[125440]: pgmap v2331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:10:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:14 smithi122 ceph-mon[125440]: osdmap e220: 12 total, 12 up, 12 in 2023-03-02T12:10:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:16 smithi136 ceph-mon[125702]: pgmap v2333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:10:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:16 smithi057 ceph-mon[92072]: pgmap v2333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:10:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:16 smithi122 ceph-mon[125440]: pgmap v2333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:10:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:18 smithi136 ceph-mon[125702]: pgmap v2334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:10:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:18 smithi057 ceph-mon[92072]: pgmap v2334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:10:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:18 smithi122 ceph-mon[125440]: pgmap v2334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:10:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:20 smithi136 ceph-mon[125702]: pgmap v2335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:10:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:20 smithi057 ceph-mon[92072]: pgmap v2335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:10:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:20 smithi122 ceph-mon[125440]: pgmap v2335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:10:22.242 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:22.240+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:10:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:22.240+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:10:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:22.240+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:10:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:22.240+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:10:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:22.240+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:10:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:22 smithi136 ceph-mon[125702]: pgmap v2336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:10:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:22 smithi057 ceph-mon[92072]: pgmap v2336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:10:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:22 smithi122 ceph-mon[125440]: pgmap v2336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:10:25.297 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:24 smithi136 ceph-mon[125702]: pgmap v2337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:10:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:24 smithi057 ceph-mon[92072]: pgmap v2337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:10:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:24 smithi122 ceph-mon[125440]: pgmap v2337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:10:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:26 smithi136 ceph-mon[125702]: pgmap v2338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:10:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:26 smithi057 ceph-mon[92072]: pgmap v2338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:10:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:26 smithi122 ceph-mon[125440]: pgmap v2338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:10:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:28 smithi136 ceph-mon[125702]: pgmap v2339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:10:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:28 smithi057 ceph-mon[92072]: pgmap v2339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:10:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:28 smithi122 ceph-mon[125440]: pgmap v2339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:10:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:31 smithi136 ceph-mon[125702]: pgmap v2340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:30 smithi057 ceph-mon[92072]: pgmap v2340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:31 smithi122 ceph-mon[125440]: pgmap v2340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:33 smithi136 ceph-mon[125702]: pgmap v2341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:33 smithi057 ceph-mon[92072]: pgmap v2341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:33 smithi122 ceph-mon[125440]: pgmap v2341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:10:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:10:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:10:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:35 smithi136 ceph-mon[125702]: pgmap v2342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:10:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:10:35.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:10:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:35 smithi057 ceph-mon[92072]: pgmap v2342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:10:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:10:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:10:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:35 smithi122 ceph-mon[125440]: pgmap v2342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:10:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:10:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:10:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:37.255+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:10:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:37.255+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:10:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:37.255+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:10:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:37.255+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:10:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:37.255+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:10:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:37 smithi136 ceph-mon[125702]: pgmap v2343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:37 smithi057 ceph-mon[92072]: pgmap v2343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:37 smithi122 ceph-mon[125440]: pgmap v2343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:39 smithi136 ceph-mon[125702]: pgmap v2344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:39 smithi057 ceph-mon[92072]: pgmap v2344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:39 smithi122 ceph-mon[125440]: pgmap v2344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:41 smithi136 ceph-mon[125702]: pgmap v2345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:41 smithi057 ceph-mon[92072]: pgmap v2345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:41 smithi122 ceph-mon[125440]: pgmap v2345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:43 smithi136 ceph-mon[125702]: pgmap v2346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:43 smithi057 ceph-mon[92072]: pgmap v2346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:43 smithi122 ceph-mon[125440]: pgmap v2346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:45 smithi136 ceph-mon[125702]: pgmap v2347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:45 smithi057 ceph-mon[92072]: pgmap v2347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:45 smithi122 ceph-mon[125440]: pgmap v2347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:47 smithi136 ceph-mon[125702]: pgmap v2348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:47 smithi057 ceph-mon[92072]: pgmap v2348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:47 smithi122 ceph-mon[125440]: pgmap v2348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:49 smithi136 ceph-mon[125702]: pgmap v2349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:49 smithi057 ceph-mon[92072]: pgmap v2349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:49 smithi122 ceph-mon[125440]: pgmap v2349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:51 smithi136 ceph-mon[125702]: pgmap v2350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:51 smithi057 ceph-mon[92072]: pgmap v2350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:51 smithi122 ceph-mon[125440]: pgmap v2350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:52.269+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:10:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:52.270+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:10:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:52.270+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:10:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:52.270+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:10:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:10:52.270+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:10:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:53 smithi136 ceph-mon[125702]: pgmap v2351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:53 smithi057 ceph-mon[92072]: pgmap v2351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:53 smithi122 ceph-mon[125440]: pgmap v2351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:55 smithi136 ceph-mon[125702]: pgmap v2352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:55 smithi057 ceph-mon[92072]: pgmap v2352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:55 smithi122 ceph-mon[125440]: pgmap v2352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:57 smithi136 ceph-mon[125702]: pgmap v2353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:57 smithi057 ceph-mon[92072]: pgmap v2353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:57 smithi122 ceph-mon[125440]: pgmap v2353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:10:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:10:59 smithi136 ceph-mon[125702]: pgmap v2354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:10:59 smithi057 ceph-mon[92072]: pgmap v2354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:10:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:10:59 smithi122 ceph-mon[125440]: pgmap v2354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:01 smithi136 ceph-mon[125702]: pgmap v2355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:01 smithi057 ceph-mon[92072]: pgmap v2355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:01 smithi122 ceph-mon[125440]: pgmap v2355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:03 smithi057 ceph-mon[92072]: pgmap v2356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:11:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:03 smithi122 ceph-mon[125440]: pgmap v2356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:11:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:03 smithi136 ceph-mon[125702]: pgmap v2356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:11:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:05 smithi057 ceph-mon[92072]: pgmap v2357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:11:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:05 smithi122 ceph-mon[125440]: pgmap v2357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:11:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:05 smithi136 ceph-mon[125702]: pgmap v2357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:11:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:07.285+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:11:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:07.286+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:11:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:07.286+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:11:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:07.286+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:11:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:07.286+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:11:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:07 smithi057 ceph-mon[92072]: pgmap v2358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:11:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:07 smithi122 ceph-mon[125440]: pgmap v2358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:11:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:07 smithi136 ceph-mon[125702]: pgmap v2358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:11:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:08.974+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:11:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:08.974+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:11:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:08.974+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 37 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:11:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:08.974+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 38 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:11:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:09 smithi057 ceph-mon[92072]: pgmap v2359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:11:09.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:09 smithi122 ceph-mon[125440]: pgmap v2359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:11:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:09 smithi136 ceph-mon[125702]: pgmap v2359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:11:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:11 smithi057 ceph-mon[92072]: pgmap v2360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:11:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:11 smithi057 ceph-mon[92072]: osdmap e221: 12 total, 12 up, 12 in 2023-03-02T12:11:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:11 smithi122 ceph-mon[125440]: pgmap v2360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:11:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:11 smithi122 ceph-mon[125440]: osdmap e221: 12 total, 12 up, 12 in 2023-03-02T12:11:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:11 smithi136 ceph-mon[125702]: pgmap v2360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:11:11.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:11 smithi136 ceph-mon[125702]: osdmap e221: 12 total, 12 up, 12 in 2023-03-02T12:11:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:13 smithi057 ceph-mon[92072]: pgmap v2362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:11:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:13 smithi122 ceph-mon[125440]: pgmap v2362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:11:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:13 smithi136 ceph-mon[125702]: pgmap v2362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:11:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:15 smithi057 ceph-mon[92072]: pgmap v2363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:11:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:15 smithi057 ceph-mon[92072]: osdmap e222: 12 total, 12 up, 12 in 2023-03-02T12:11:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:15 smithi122 ceph-mon[125440]: pgmap v2363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:11:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:15 smithi122 ceph-mon[125440]: osdmap e222: 12 total, 12 up, 12 in 2023-03-02T12:11:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:15 smithi136 ceph-mon[125702]: pgmap v2363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:11:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:15 smithi136 ceph-mon[125702]: osdmap e222: 12 total, 12 up, 12 in 2023-03-02T12:11:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:17 smithi057 ceph-mon[92072]: pgmap v2365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:11:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:17 smithi122 ceph-mon[125440]: pgmap v2365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:11:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:17 smithi136 ceph-mon[125702]: pgmap v2365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:11:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:19 smithi057 ceph-mon[92072]: pgmap v2366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:11:19.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:19 smithi122 ceph-mon[125440]: pgmap v2366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:11:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:19 smithi136 ceph-mon[125702]: pgmap v2366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:11:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:21 smithi057 ceph-mon[92072]: pgmap v2367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:11:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:21 smithi122 ceph-mon[125440]: pgmap v2367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:11:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:21 smithi136 ceph-mon[125702]: pgmap v2367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:11:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:22.291+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:11:22.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:22.292+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:11:22.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:22.292+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:11:22.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:22.292+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:11:22.295 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:22.292+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:11:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:23 smithi057 ceph-mon[92072]: pgmap v2368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:11:23.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:23 smithi122 ceph-mon[125440]: pgmap v2368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:11:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:23 smithi136 ceph-mon[125702]: pgmap v2368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:11:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:25 smithi057 ceph-mon[92072]: pgmap v2369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:11:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:25 smithi122 ceph-mon[125440]: pgmap v2369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:11:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:25 smithi136 ceph-mon[125702]: pgmap v2369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:11:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:27 smithi057 ceph-mon[92072]: pgmap v2370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:11:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:27 smithi122 ceph-mon[125440]: pgmap v2370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:11:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:27 smithi136 ceph-mon[125702]: pgmap v2370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:11:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:29 smithi057 ceph-mon[92072]: pgmap v2371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:11:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:29 smithi122 ceph-mon[125440]: pgmap v2371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:11:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:29 smithi136 ceph-mon[125702]: pgmap v2371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:11:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:31 smithi057 ceph-mon[92072]: pgmap v2372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:31 smithi122 ceph-mon[125440]: pgmap v2372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:31 smithi136 ceph-mon[125702]: pgmap v2372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:33 smithi057 ceph-mon[92072]: pgmap v2373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:33 smithi122 ceph-mon[125440]: pgmap v2373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:33 smithi136 ceph-mon[125702]: pgmap v2373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:35 smithi057 ceph-mon[92072]: pgmap v2374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:11:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:35 smithi122 ceph-mon[125440]: pgmap v2374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:11:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:35 smithi136 ceph-mon[125702]: pgmap v2374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:11:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:11:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:11:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:36 smithi057 ceph-mon[92072]: pgmap v2375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:11:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:11:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:11:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:11:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:11:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:36 smithi122 ceph-mon[125440]: pgmap v2375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:11:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:11:36.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:11:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:11:37.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:11:37.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:36 smithi136 ceph-mon[125702]: pgmap v2375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:37.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:11:37.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:11:37.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:11:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:37.300+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:11:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:37.300+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:11:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:37.300+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:11:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:37.300+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:11:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:37.300+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:11:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:38 smithi122 ceph-mon[125440]: pgmap v2376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:38 smithi136 ceph-mon[125702]: pgmap v2376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:38 smithi057 ceph-mon[92072]: pgmap v2376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:40 smithi136 ceph-mon[125702]: pgmap v2377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:40 smithi057 ceph-mon[92072]: pgmap v2377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:40 smithi122 ceph-mon[125440]: pgmap v2377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:43.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:42 smithi136 ceph-mon[125702]: pgmap v2378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:42 smithi057 ceph-mon[92072]: pgmap v2378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:42 smithi122 ceph-mon[125440]: pgmap v2378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:44 smithi136 ceph-mon[125702]: pgmap v2379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:44 smithi057 ceph-mon[92072]: pgmap v2379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:44 smithi122 ceph-mon[125440]: pgmap v2379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:46 smithi136 ceph-mon[125702]: pgmap v2380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:46 smithi057 ceph-mon[92072]: pgmap v2380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:46 smithi122 ceph-mon[125440]: pgmap v2380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:49.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:48 smithi136 ceph-mon[125702]: pgmap v2381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:48 smithi057 ceph-mon[92072]: pgmap v2381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:48 smithi122 ceph-mon[125440]: pgmap v2381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:50 smithi136 ceph-mon[125702]: pgmap v2382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:50 smithi057 ceph-mon[92072]: pgmap v2382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:50 smithi122 ceph-mon[125440]: pgmap v2382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:52.309+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:11:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:52.309+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:11:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:52.309+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:11:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:52.309+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:11:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:11:52.309+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:11:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:52 smithi136 ceph-mon[125702]: pgmap v2383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:52 smithi057 ceph-mon[92072]: pgmap v2383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:53.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:52 smithi122 ceph-mon[125440]: pgmap v2383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:54 smithi136 ceph-mon[125702]: pgmap v2384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:54 smithi057 ceph-mon[92072]: pgmap v2384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:54 smithi122 ceph-mon[125440]: pgmap v2384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:56 smithi136 ceph-mon[125702]: pgmap v2385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:56 smithi057 ceph-mon[92072]: pgmap v2385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:57.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:56 smithi122 ceph-mon[125440]: pgmap v2385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:11:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:11:58 smithi136 ceph-mon[125702]: pgmap v2386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:11:58 smithi057 ceph-mon[92072]: pgmap v2386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:11:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:11:58 smithi122 ceph-mon[125440]: pgmap v2386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:00 smithi136 ceph-mon[125702]: pgmap v2387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:00 smithi057 ceph-mon[92072]: pgmap v2387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:00 smithi122 ceph-mon[125440]: pgmap v2387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:03 smithi136 ceph-mon[125702]: pgmap v2388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:12:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:03 smithi057 ceph-mon[92072]: pgmap v2388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:12:03.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:03 smithi122 ceph-mon[125440]: pgmap v2388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:12:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:05 smithi136 ceph-mon[125702]: pgmap v2389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:12:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:05 smithi057 ceph-mon[92072]: pgmap v2389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:12:05.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:05 smithi122 ceph-mon[125440]: pgmap v2389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:12:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:07.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:12:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:07.321+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:12:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:07.321+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:12:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:07.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:12:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:07.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:12:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:07 smithi136 ceph-mon[125702]: pgmap v2390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:12:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:07 smithi057 ceph-mon[92072]: pgmap v2390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:12:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:07 smithi122 ceph-mon[125440]: pgmap v2390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:12:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:09 smithi136 ceph-mon[125702]: pgmap v2391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:12:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:09 smithi057 ceph-mon[92072]: pgmap v2391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:12:09.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:09 smithi122 ceph-mon[125440]: pgmap v2391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:12:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:11 smithi136 ceph-mon[125702]: pgmap v2392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:12:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:11 smithi057 ceph-mon[92072]: pgmap v2392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:12:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:11 smithi122 ceph-mon[125440]: pgmap v2392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:12:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:12 smithi136 ceph-mon[125702]: osdmap e223: 12 total, 12 up, 12 in 2023-03-02T12:12:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:12 smithi057 ceph-mon[92072]: osdmap e223: 12 total, 12 up, 12 in 2023-03-02T12:12:12.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:12 smithi122 ceph-mon[125440]: osdmap e223: 12 total, 12 up, 12 in 2023-03-02T12:12:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:13 smithi136 ceph-mon[125702]: pgmap v2394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:13 smithi057 ceph-mon[92072]: pgmap v2394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:13 smithi122 ceph-mon[125440]: pgmap v2394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:15 smithi136 ceph-mon[125702]: pgmap v2395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:15 smithi136 ceph-mon[125702]: osdmap e224: 12 total, 12 up, 12 in 2023-03-02T12:12:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:15 smithi057 ceph-mon[92072]: pgmap v2395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:15 smithi057 ceph-mon[92072]: osdmap e224: 12 total, 12 up, 12 in 2023-03-02T12:12:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:15 smithi122 ceph-mon[125440]: pgmap v2395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:15 smithi122 ceph-mon[125440]: osdmap e224: 12 total, 12 up, 12 in 2023-03-02T12:12:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:17 smithi136 ceph-mon[125702]: pgmap v2397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:12:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:17 smithi057 ceph-mon[92072]: pgmap v2397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:12:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:17 smithi122 ceph-mon[125440]: pgmap v2397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:12:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:19 smithi136 ceph-mon[125702]: pgmap v2398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:12:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:19 smithi057 ceph-mon[92072]: pgmap v2398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:12:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:19 smithi122 ceph-mon[125440]: pgmap v2398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:12:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:21 smithi136 ceph-mon[125702]: pgmap v2399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 346 B/s wr, 11 op/s 2023-03-02T12:12:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:21 smithi057 ceph-mon[92072]: pgmap v2399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 346 B/s wr, 11 op/s 2023-03-02T12:12:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:21 smithi122 ceph-mon[125440]: pgmap v2399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 346 B/s wr, 11 op/s 2023-03-02T12:12:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:22.331+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:12:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:22.331+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:12:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:22.331+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:12:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:22.331+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:12:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:22.331+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:12:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:23 smithi136 ceph-mon[125702]: pgmap v2400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:23 smithi057 ceph-mon[92072]: pgmap v2400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:23 smithi122 ceph-mon[125440]: pgmap v2400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:25 smithi136 ceph-mon[125702]: pgmap v2401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:25 smithi057 ceph-mon[92072]: pgmap v2401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:25 smithi122 ceph-mon[125440]: pgmap v2401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:12:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:27 smithi057 ceph-mon[92072]: pgmap v2402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:12:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:27 smithi122 ceph-mon[125440]: pgmap v2402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:12:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:27 smithi136 ceph-mon[125702]: pgmap v2402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:12:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:29 smithi057 ceph-mon[92072]: pgmap v2403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:12:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:29 smithi122 ceph-mon[125440]: pgmap v2403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:12:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:29 smithi136 ceph-mon[125702]: pgmap v2403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:12:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:31 smithi057 ceph-mon[92072]: pgmap v2404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:31 smithi122 ceph-mon[125440]: pgmap v2404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:31 smithi136 ceph-mon[125702]: pgmap v2404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:33 smithi057 ceph-mon[92072]: pgmap v2405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:33 smithi122 ceph-mon[125440]: pgmap v2405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:33 smithi136 ceph-mon[125702]: pgmap v2405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:35 smithi057 ceph-mon[92072]: pgmap v2406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:35 smithi122 ceph-mon[125440]: pgmap v2406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:35 smithi136 ceph-mon[125702]: pgmap v2406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:37.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:12:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:37.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:12:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:37.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:12:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:37.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:12:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:37.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:12:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:37 smithi057 ceph-mon[92072]: pgmap v2407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:12:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:37 smithi122 ceph-mon[125440]: pgmap v2407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:12:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:37 smithi136 ceph-mon[125702]: pgmap v2407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:37.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:12:37.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:37.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:38 smithi136 ceph-mon[125702]: pgmap v2408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:38 smithi057 ceph-mon[92072]: pgmap v2408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:38 smithi122 ceph-mon[125440]: pgmap v2408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:12:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:12:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:12:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:12:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:12:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:12:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:12:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:40 smithi136 ceph-mon[125702]: pgmap v2409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:40 smithi057 ceph-mon[92072]: pgmap v2409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:40 smithi122 ceph-mon[125440]: pgmap v2409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:42 smithi136 ceph-mon[125702]: pgmap v2410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:42 smithi057 ceph-mon[92072]: pgmap v2410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:43.493 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:42 smithi122 ceph-mon[125440]: pgmap v2410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:44 smithi136 ceph-mon[125702]: pgmap v2411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:44 smithi057 ceph-mon[92072]: pgmap v2411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:44 smithi122 ceph-mon[125440]: pgmap v2411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:46 smithi136 ceph-mon[125702]: pgmap v2412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:46 smithi057 ceph-mon[92072]: pgmap v2412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:46 smithi122 ceph-mon[125440]: pgmap v2412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:48 smithi136 ceph-mon[125702]: pgmap v2413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:48 smithi057 ceph-mon[92072]: pgmap v2413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:48 smithi122 ceph-mon[125440]: pgmap v2413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:50 smithi136 ceph-mon[125702]: pgmap v2414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:50 smithi057 ceph-mon[92072]: pgmap v2414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:50 smithi122 ceph-mon[125440]: pgmap v2414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:12:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:52.362+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:12:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:52.362+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:12:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:52.362+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:12:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:52.362+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:12:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:12:52.362+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:12:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:52 smithi136 ceph-mon[125702]: pgmap v2415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:52 smithi057 ceph-mon[92072]: pgmap v2415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:53.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:52 smithi122 ceph-mon[125440]: pgmap v2415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:55.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:55 smithi136 ceph-mon[125702]: pgmap v2416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:12:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:55 smithi057 ceph-mon[92072]: pgmap v2416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:12:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:55 smithi122 ceph-mon[125440]: pgmap v2416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:12:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:57 smithi136 ceph-mon[125702]: pgmap v2417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:12:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:57 smithi057 ceph-mon[92072]: pgmap v2417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:12:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:57 smithi122 ceph-mon[125440]: pgmap v2417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:12:59.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:12:59 smithi136 ceph-mon[125702]: pgmap v2418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:12:59 smithi057 ceph-mon[92072]: pgmap v2418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:12:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:12:59 smithi122 ceph-mon[125440]: pgmap v2418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:01 smithi136 ceph-mon[125702]: pgmap v2419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:01 smithi057 ceph-mon[92072]: pgmap v2419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:01.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:01 smithi122 ceph-mon[125440]: pgmap v2419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:03 smithi136 ceph-mon[125702]: pgmap v2420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:13:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:03 smithi057 ceph-mon[92072]: pgmap v2420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:13:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:03 smithi122 ceph-mon[125440]: pgmap v2420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:13:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:05 smithi136 ceph-mon[125702]: pgmap v2421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:13:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:05 smithi057 ceph-mon[92072]: pgmap v2421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:13:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:05 smithi122 ceph-mon[125440]: pgmap v2421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:13:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:07 smithi136 ceph-mon[125702]: pgmap v2422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:13:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:07.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:13:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:07.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:13:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:07.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:13:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:07.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:13:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:07.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:13:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:07 smithi057 ceph-mon[92072]: pgmap v2422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:13:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:07 smithi122 ceph-mon[125440]: pgmap v2422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:13:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:09 smithi136 ceph-mon[125702]: pgmap v2423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:13:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:09 smithi057 ceph-mon[92072]: pgmap v2423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:13:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:09 smithi122 ceph-mon[125440]: pgmap v2423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:13:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:11 smithi136 ceph-mon[125702]: pgmap v2424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:13:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:11 smithi057 ceph-mon[92072]: pgmap v2424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:13:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:11 smithi122 ceph-mon[125440]: pgmap v2424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:13:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:12 smithi136 ceph-mon[125702]: osdmap e225: 12 total, 12 up, 12 in 2023-03-02T12:13:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:12 smithi057 ceph-mon[92072]: osdmap e225: 12 total, 12 up, 12 in 2023-03-02T12:13:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:12 smithi122 ceph-mon[125440]: osdmap e225: 12 total, 12 up, 12 in 2023-03-02T12:13:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:13 smithi136 ceph-mon[125702]: pgmap v2426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:13:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:13 smithi057 ceph-mon[92072]: pgmap v2426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:13:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:13 smithi122 ceph-mon[125440]: pgmap v2426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:13:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:15 smithi136 ceph-mon[125702]: pgmap v2427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:13:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:15 smithi136 ceph-mon[125702]: osdmap e226: 12 total, 12 up, 12 in 2023-03-02T12:13:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:15 smithi057 ceph-mon[92072]: pgmap v2427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:13:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:15 smithi057 ceph-mon[92072]: osdmap e226: 12 total, 12 up, 12 in 2023-03-02T12:13:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:15 smithi122 ceph-mon[125440]: pgmap v2427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:13:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:15 smithi122 ceph-mon[125440]: osdmap e226: 12 total, 12 up, 12 in 2023-03-02T12:13:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:17 smithi136 ceph-mon[125702]: pgmap v2429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:13:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:17 smithi057 ceph-mon[92072]: pgmap v2429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:13:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:17 smithi122 ceph-mon[125440]: pgmap v2429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:13:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:19 smithi136 ceph-mon[125702]: pgmap v2430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:13:19.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:19 smithi057 ceph-mon[92072]: pgmap v2430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:13:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:19 smithi122 ceph-mon[125440]: pgmap v2430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:13:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:21 smithi136 ceph-mon[125702]: pgmap v2431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T12:13:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:21 smithi057 ceph-mon[92072]: pgmap v2431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T12:13:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:21 smithi122 ceph-mon[125440]: pgmap v2431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T12:13:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:22.380+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:13:22.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:22.380+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:13:22.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:22.380+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:13:22.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:22.380+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:13:22.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:22.380+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:13:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:23 smithi136 ceph-mon[125702]: pgmap v2432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:13:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:23 smithi057 ceph-mon[92072]: pgmap v2432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:13:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:23 smithi122 ceph-mon[125440]: pgmap v2432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:13:23.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:23.993+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:13:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:23.993+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:13:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:23.993+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 38 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:13:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:23.993+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 39 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:13:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:25 smithi136 ceph-mon[125702]: pgmap v2433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:13:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:25 smithi057 ceph-mon[92072]: pgmap v2433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:13:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:25 smithi122 ceph-mon[125440]: pgmap v2433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:13:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:27 smithi136 ceph-mon[125702]: pgmap v2434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:13:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:27 smithi057 ceph-mon[92072]: pgmap v2434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:13:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:27 smithi122 ceph-mon[125440]: pgmap v2434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:13:29.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:29 smithi136 ceph-mon[125702]: pgmap v2435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:13:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:29 smithi057 ceph-mon[92072]: pgmap v2435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:13:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:29 smithi122 ceph-mon[125440]: pgmap v2435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:13:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:31 smithi057 ceph-mon[92072]: pgmap v2436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:31 smithi122 ceph-mon[125440]: pgmap v2436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:31 smithi136 ceph-mon[125702]: pgmap v2436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:33 smithi057 ceph-mon[92072]: pgmap v2437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:33 smithi122 ceph-mon[125440]: pgmap v2437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:33 smithi136 ceph-mon[125702]: pgmap v2437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:35 smithi057 ceph-mon[92072]: pgmap v2438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:35 smithi122 ceph-mon[125440]: pgmap v2438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:35 smithi136 ceph-mon[125702]: pgmap v2438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:37.381+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:13:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:37.381+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:13:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:37.381+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:13:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:37.381+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:13:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:37.381+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:13:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:37 smithi057 ceph-mon[92072]: pgmap v2439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:37 smithi122 ceph-mon[125440]: pgmap v2439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:37.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:37 smithi136 ceph-mon[125702]: pgmap v2439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:39 smithi057 ceph-mon[92072]: pgmap v2440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:13:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:39 smithi122 ceph-mon[125440]: pgmap v2440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:13:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:39 smithi136 ceph-mon[125702]: pgmap v2440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:39.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:13:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:13:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:13:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:13:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:13:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:13:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:13:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:13:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:13:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:13:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:41 smithi057 ceph-mon[92072]: pgmap v2441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:41.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:41 smithi122 ceph-mon[125440]: pgmap v2441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:41 smithi136 ceph-mon[125702]: pgmap v2441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:13:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:43 smithi057 ceph-mon[92072]: pgmap v2442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:43 smithi122 ceph-mon[125440]: pgmap v2442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:43 smithi136 ceph-mon[125702]: pgmap v2442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:45.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:45 smithi057 ceph-mon[92072]: pgmap v2443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:45 smithi122 ceph-mon[125440]: pgmap v2443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:45 smithi136 ceph-mon[125702]: pgmap v2443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:47 smithi057 ceph-mon[92072]: pgmap v2444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:47 smithi122 ceph-mon[125440]: pgmap v2444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:47 smithi136 ceph-mon[125702]: pgmap v2444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:49 smithi057 ceph-mon[92072]: pgmap v2445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:49.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:49 smithi122 ceph-mon[125440]: pgmap v2445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:49 smithi136 ceph-mon[125702]: pgmap v2445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:51 smithi057 ceph-mon[92072]: pgmap v2446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:51 smithi122 ceph-mon[125440]: pgmap v2446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:51 smithi136 ceph-mon[125702]: pgmap v2446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:52.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:13:52.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:52.389+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:13:52.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:52.389+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:13:52.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:52.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:13:52.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:13:52.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:13:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:53 smithi057 ceph-mon[92072]: pgmap v2447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:53 smithi122 ceph-mon[125440]: pgmap v2447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:53 smithi136 ceph-mon[125702]: pgmap v2447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:55 smithi057 ceph-mon[92072]: pgmap v2448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:55 smithi122 ceph-mon[125440]: pgmap v2448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:55.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:55 smithi136 ceph-mon[125702]: pgmap v2448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:57 smithi057 ceph-mon[92072]: pgmap v2449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:57 smithi122 ceph-mon[125440]: pgmap v2449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:57.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:57 smithi136 ceph-mon[125702]: pgmap v2449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:13:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:13:59 smithi057 ceph-mon[92072]: pgmap v2450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:13:59 smithi122 ceph-mon[125440]: pgmap v2450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:13:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:13:59 smithi136 ceph-mon[125702]: pgmap v2450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:01 smithi057 ceph-mon[92072]: pgmap v2451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:01 smithi122 ceph-mon[125440]: pgmap v2451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:01 smithi136 ceph-mon[125702]: pgmap v2451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:03 smithi057 ceph-mon[92072]: pgmap v2452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:14:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:03 smithi122 ceph-mon[125440]: pgmap v2452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:14:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:03 smithi136 ceph-mon[125702]: pgmap v2452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:14:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:05 smithi057 ceph-mon[92072]: pgmap v2453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:14:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:05 smithi122 ceph-mon[125440]: pgmap v2453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:14:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:05 smithi136 ceph-mon[125702]: pgmap v2453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:14:07.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:07.396+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:14:07.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:07.397+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:14:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:07.397+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:14:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:07.397+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:14:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:07.397+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:14:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:07 smithi057 ceph-mon[92072]: pgmap v2454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:14:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:07 smithi122 ceph-mon[125440]: pgmap v2454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:14:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:07 smithi136 ceph-mon[125702]: pgmap v2454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:14:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.377+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f58680a8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T12:14:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.377+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f58680a8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T12:14:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.377+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a8450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58700387f0 tx=0x7f587006b000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:14:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.377+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a8450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58700387f0 tx=0x7f587006b000 comp rx=0 tx=0).stop 2023-03-02T12:14:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.377+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f58680a8450 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T12:14:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.377+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f58680a8450 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T12:14:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.377+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f58680a8450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T12:14:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.377+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T12:14:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.377+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:14:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.378+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f587008e000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T12:14:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.999+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:14:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:08.999+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:14:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:09.000+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 39 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:14:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:09.000+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 40 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:14:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:09 smithi057 ceph-mon[92072]: pgmap v2455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:14:09.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:09 smithi122 ceph-mon[125440]: pgmap v2455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:14:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:09 smithi136 ceph-mon[125702]: pgmap v2455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:14:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:11 smithi057 ceph-mon[92072]: pgmap v2456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:14:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:11 smithi057 ceph-mon[92072]: osdmap e227: 12 total, 12 up, 12 in 2023-03-02T12:14:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:11 smithi122 ceph-mon[125440]: pgmap v2456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:14:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:11 smithi122 ceph-mon[125440]: osdmap e227: 12 total, 12 up, 12 in 2023-03-02T12:14:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:11 smithi136 ceph-mon[125702]: pgmap v2456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:14:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:11 smithi136 ceph-mon[125702]: osdmap e227: 12 total, 12 up, 12 in 2023-03-02T12:14:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:13 smithi057 ceph-mon[92072]: pgmap v2458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:14:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:13 smithi122 ceph-mon[125440]: pgmap v2458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:14:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:13 smithi136 ceph-mon[125702]: pgmap v2458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:14:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:15 smithi122 ceph-mon[125440]: pgmap v2459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:14:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:15 smithi122 ceph-mon[125440]: osdmap e228: 12 total, 12 up, 12 in 2023-03-02T12:14:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:15 smithi136 ceph-mon[125702]: pgmap v2459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:14:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:15 smithi136 ceph-mon[125702]: osdmap e228: 12 total, 12 up, 12 in 2023-03-02T12:14:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:15 smithi057 ceph-mon[92072]: pgmap v2459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:14:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:15 smithi057 ceph-mon[92072]: osdmap e228: 12 total, 12 up, 12 in 2023-03-02T12:14:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:17 smithi122 ceph-mon[125440]: pgmap v2461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:14:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:17 smithi136 ceph-mon[125702]: pgmap v2461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:14:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:17 smithi057 ceph-mon[92072]: pgmap v2461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:14:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:19 smithi136 ceph-mon[125702]: pgmap v2462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:14:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:19 smithi057 ceph-mon[92072]: pgmap v2462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:14:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:19 smithi122 ceph-mon[125440]: pgmap v2462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:14:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:21 smithi136 ceph-mon[125702]: pgmap v2463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:14:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:21 smithi057 ceph-mon[92072]: pgmap v2463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:14:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:21 smithi122 ceph-mon[125440]: pgmap v2463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:14:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:22.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:14:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:22.413+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:14:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:22.413+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:14:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:22.413+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:14:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:22.413+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:14:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:23 smithi136 ceph-mon[125702]: pgmap v2464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:14:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:23 smithi057 ceph-mon[92072]: pgmap v2464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:14:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:23 smithi122 ceph-mon[125440]: pgmap v2464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:14:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:25 smithi136 ceph-mon[125702]: pgmap v2465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:14:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:25 smithi057 ceph-mon[92072]: pgmap v2465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:14:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:25 smithi122 ceph-mon[125440]: pgmap v2465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:14:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:27 smithi136 ceph-mon[125702]: pgmap v2466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:14:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:27 smithi057 ceph-mon[92072]: pgmap v2466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:14:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:27 smithi122 ceph-mon[125440]: pgmap v2466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:14:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:29 smithi136 ceph-mon[125702]: pgmap v2467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:14:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:29 smithi057 ceph-mon[92072]: pgmap v2467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:14:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:29 smithi122 ceph-mon[125440]: pgmap v2467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:14:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:31 smithi136 ceph-mon[125702]: pgmap v2468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:31 smithi057 ceph-mon[92072]: pgmap v2468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:31 smithi122 ceph-mon[125440]: pgmap v2468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:33 smithi136 ceph-mon[125702]: pgmap v2469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:33 smithi057 ceph-mon[92072]: pgmap v2469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:33 smithi122 ceph-mon[125440]: pgmap v2469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:35 smithi136 ceph-mon[125702]: pgmap v2470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:35 smithi057 ceph-mon[92072]: pgmap v2470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:35 smithi122 ceph-mon[125440]: pgmap v2470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:37.423+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:14:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:37.424+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:14:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:37.424+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:14:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:37.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:14:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:37.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:14:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:37 smithi136 ceph-mon[125702]: pgmap v2471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:37 smithi057 ceph-mon[92072]: pgmap v2471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:37 smithi122 ceph-mon[125440]: pgmap v2471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:39 smithi136 ceph-mon[125702]: pgmap v2472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:39 smithi057 ceph-mon[92072]: pgmap v2472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:39 smithi122 ceph-mon[125440]: pgmap v2472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:14:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:14:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:14:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:41 smithi136 ceph-mon[125702]: pgmap v2473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:14:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:14:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:14:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:14:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:41 smithi057 ceph-mon[92072]: pgmap v2473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:14:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:14:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:14:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:14:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:41 smithi122 ceph-mon[125440]: pgmap v2473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:14:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:14:41.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:14:41.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:14:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:43 smithi136 ceph-mon[125702]: pgmap v2474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:43 smithi057 ceph-mon[92072]: pgmap v2474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:43 smithi122 ceph-mon[125440]: pgmap v2474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:45 smithi136 ceph-mon[125702]: pgmap v2475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:14:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:45 smithi057 ceph-mon[92072]: pgmap v2475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:14:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:45 smithi122 ceph-mon[125440]: pgmap v2475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:14:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:47 smithi136 ceph-mon[125702]: pgmap v2476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:14:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:47 smithi057 ceph-mon[92072]: pgmap v2476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:14:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:47 smithi122 ceph-mon[125440]: pgmap v2476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:14:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:49 smithi136 ceph-mon[125702]: pgmap v2477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:49 smithi057 ceph-mon[92072]: pgmap v2477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:49 smithi122 ceph-mon[125440]: pgmap v2477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:51 smithi136 ceph-mon[125702]: pgmap v2478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:51 smithi057 ceph-mon[92072]: pgmap v2478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:51 smithi122 ceph-mon[125440]: pgmap v2478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:52.438+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:14:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:52.438+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:14:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:52.438+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:14:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:52.438+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:14:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:14:52.438+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:14:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:53 smithi136 ceph-mon[125702]: pgmap v2479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:53 smithi057 ceph-mon[92072]: pgmap v2479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:53 smithi122 ceph-mon[125440]: pgmap v2479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:55 smithi136 ceph-mon[125702]: pgmap v2480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:55 smithi057 ceph-mon[92072]: pgmap v2480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:55 smithi122 ceph-mon[125440]: pgmap v2480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:57 smithi136 ceph-mon[125702]: pgmap v2481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:57 smithi057 ceph-mon[92072]: pgmap v2481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:57 smithi122 ceph-mon[125440]: pgmap v2481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:14:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:14:59 smithi136 ceph-mon[125702]: pgmap v2482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:14:59 smithi057 ceph-mon[92072]: pgmap v2482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:14:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:14:59 smithi122 ceph-mon[125440]: pgmap v2482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:01 smithi136 ceph-mon[125702]: pgmap v2483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:01 smithi057 ceph-mon[92072]: pgmap v2483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:01 smithi122 ceph-mon[125440]: pgmap v2483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:03 smithi136 ceph-mon[125702]: pgmap v2484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:15:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:03 smithi057 ceph-mon[92072]: pgmap v2484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:15:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:03 smithi122 ceph-mon[125440]: pgmap v2484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:15:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:05 smithi136 ceph-mon[125702]: pgmap v2485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:15:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:05 smithi057 ceph-mon[92072]: pgmap v2485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:15:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:05 smithi122 ceph-mon[125440]: pgmap v2485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:15:07.442 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:07.440+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:15:07.442 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:07.441+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:15:07.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:07.441+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:15:07.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:07.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:15:07.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:07.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:15:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:07 smithi136 ceph-mon[125702]: pgmap v2486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:15:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:07 smithi057 ceph-mon[92072]: pgmap v2486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:15:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:07 smithi122 ceph-mon[125440]: pgmap v2486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:15:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:09 smithi136 ceph-mon[125702]: pgmap v2487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:15:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:09 smithi057 ceph-mon[92072]: pgmap v2487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:15:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:09 smithi122 ceph-mon[125440]: pgmap v2487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:15:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:11 smithi136 ceph-mon[125702]: pgmap v2488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:15:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:11 smithi136 ceph-mon[125702]: osdmap e229: 12 total, 12 up, 12 in 2023-03-02T12:15:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:11 smithi057 ceph-mon[92072]: pgmap v2488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:15:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:11 smithi057 ceph-mon[92072]: osdmap e229: 12 total, 12 up, 12 in 2023-03-02T12:15:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:11 smithi122 ceph-mon[125440]: pgmap v2488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:15:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:11 smithi122 ceph-mon[125440]: osdmap e229: 12 total, 12 up, 12 in 2023-03-02T12:15:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:13 smithi136 ceph-mon[125702]: pgmap v2490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:15:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:13 smithi057 ceph-mon[92072]: pgmap v2490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:15:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:13 smithi122 ceph-mon[125440]: pgmap v2490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:15:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:14 smithi136 ceph-mon[125702]: pgmap v2491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:15:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:14 smithi057 ceph-mon[92072]: pgmap v2491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:15:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:14 smithi122 ceph-mon[125440]: pgmap v2491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:15:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:16 smithi136 ceph-mon[125702]: osdmap e230: 12 total, 12 up, 12 in 2023-03-02T12:15:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:16 smithi057 ceph-mon[92072]: osdmap e230: 12 total, 12 up, 12 in 2023-03-02T12:15:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:16 smithi122 ceph-mon[125440]: osdmap e230: 12 total, 12 up, 12 in 2023-03-02T12:15:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:17 smithi136 ceph-mon[125702]: pgmap v2493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:15:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:17 smithi057 ceph-mon[92072]: pgmap v2493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:15:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:17 smithi122 ceph-mon[125440]: pgmap v2493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:15:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:19 smithi136 ceph-mon[125702]: pgmap v2494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:15:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:19 smithi057 ceph-mon[92072]: pgmap v2494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:15:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:19 smithi122 ceph-mon[125440]: pgmap v2494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:15:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:21 smithi136 ceph-mon[125702]: pgmap v2495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:15:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:21 smithi057 ceph-mon[92072]: pgmap v2495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:15:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:21 smithi122 ceph-mon[125440]: pgmap v2495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:15:22.455 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:22.454+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:15:22.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:22.454+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:15:22.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:22.454+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:15:22.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:22.454+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:15:22.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:22.454+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:15:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:23 smithi136 ceph-mon[125702]: pgmap v2496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:15:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:23 smithi057 ceph-mon[92072]: pgmap v2496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:15:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:23 smithi122 ceph-mon[125440]: pgmap v2496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:15:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:25 smithi136 ceph-mon[125702]: pgmap v2497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:15:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:25 smithi057 ceph-mon[92072]: pgmap v2497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:15:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:25 smithi122 ceph-mon[125440]: pgmap v2497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:15:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:27 smithi136 ceph-mon[125702]: pgmap v2498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:15:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:27 smithi057 ceph-mon[92072]: pgmap v2498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:15:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:27 smithi122 ceph-mon[125440]: pgmap v2498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:15:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:29 smithi136 ceph-mon[125702]: pgmap v2499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:15:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:29 smithi057 ceph-mon[92072]: pgmap v2499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:15:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:29 smithi122 ceph-mon[125440]: pgmap v2499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:15:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:31 smithi136 ceph-mon[125702]: pgmap v2500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:31 smithi057 ceph-mon[92072]: pgmap v2500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:31 smithi122 ceph-mon[125440]: pgmap v2500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:33 smithi136 ceph-mon[125702]: pgmap v2501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:33.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:33 smithi057 ceph-mon[92072]: pgmap v2501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:33 smithi122 ceph-mon[125440]: pgmap v2501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:35 smithi136 ceph-mon[125702]: pgmap v2502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:35 smithi057 ceph-mon[92072]: pgmap v2502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:35 smithi122 ceph-mon[125440]: pgmap v2502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:37.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:37 smithi136 ceph-mon[125702]: pgmap v2503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:37 smithi057 ceph-mon[92072]: pgmap v2503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:37 smithi122 ceph-mon[125440]: pgmap v2503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:37.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:15:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:37.470+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:15:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:37.470+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:15:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:37.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:15:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:37.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:15:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:39 smithi136 ceph-mon[125702]: pgmap v2504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:39 smithi057 ceph-mon[92072]: pgmap v2504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:39 smithi122 ceph-mon[125440]: pgmap v2504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:41 smithi136 ceph-mon[125702]: pgmap v2505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:15:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:41 smithi057 ceph-mon[92072]: pgmap v2505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:15:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:41 smithi122 ceph-mon[125440]: pgmap v2505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:15:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:15:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:15:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:15:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:15:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:15:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:15:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:15:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:15:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:15:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:43 smithi057 ceph-mon[92072]: pgmap v2506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:43 smithi122 ceph-mon[125440]: pgmap v2506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:43 smithi136 ceph-mon[125702]: pgmap v2506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:45 smithi057 ceph-mon[92072]: pgmap v2507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:45 smithi122 ceph-mon[125440]: pgmap v2507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:45 smithi136 ceph-mon[125702]: pgmap v2507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:47 smithi057 ceph-mon[92072]: pgmap v2508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:47 smithi122 ceph-mon[125440]: pgmap v2508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:47 smithi136 ceph-mon[125702]: pgmap v2508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:49 smithi057 ceph-mon[92072]: pgmap v2509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:49 smithi122 ceph-mon[125440]: pgmap v2509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:49 smithi136 ceph-mon[125702]: pgmap v2509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:51 smithi057 ceph-mon[92072]: pgmap v2510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:51 smithi122 ceph-mon[125440]: pgmap v2510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:51 smithi136 ceph-mon[125702]: pgmap v2510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:52.479+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:15:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:52.479+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:15:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:52.479+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:15:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:52.479+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:15:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:15:52.479+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:15:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:53 smithi057 ceph-mon[92072]: pgmap v2511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:53.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:53 smithi122 ceph-mon[125440]: pgmap v2511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:53 smithi136 ceph-mon[125702]: pgmap v2511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:55 smithi057 ceph-mon[92072]: pgmap v2512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:55 smithi122 ceph-mon[125440]: pgmap v2512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:55 smithi136 ceph-mon[125702]: pgmap v2512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:57 smithi057 ceph-mon[92072]: pgmap v2513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:57.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:57 smithi122 ceph-mon[125440]: pgmap v2513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:57 smithi136 ceph-mon[125702]: pgmap v2513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:15:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:15:59 smithi057 ceph-mon[92072]: pgmap v2514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:15:59 smithi122 ceph-mon[125440]: pgmap v2514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:15:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:15:59 smithi136 ceph-mon[125702]: pgmap v2514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:01 smithi057 ceph-mon[92072]: pgmap v2515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:01 smithi122 ceph-mon[125440]: pgmap v2515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:01 smithi136 ceph-mon[125702]: pgmap v2515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:03 smithi057 ceph-mon[92072]: pgmap v2516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:16:03.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:03 smithi122 ceph-mon[125440]: pgmap v2516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:16:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:03 smithi136 ceph-mon[125702]: pgmap v2516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:16:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:05 smithi057 ceph-mon[92072]: pgmap v2517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:16:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:05 smithi122 ceph-mon[125440]: pgmap v2517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:16:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:05 smithi136 ceph-mon[125702]: pgmap v2517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:16:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:07 smithi057 ceph-mon[92072]: pgmap v2518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:16:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:07 smithi122 ceph-mon[125440]: pgmap v2518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:16:07.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:07.492+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:16:07.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:07.492+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:16:07.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:07.492+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:16:07.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:07.492+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:16:07.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:07.492+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:16:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:07 smithi136 ceph-mon[125702]: pgmap v2518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:16:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:09 smithi057 ceph-mon[92072]: pgmap v2519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:16:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:09 smithi122 ceph-mon[125440]: pgmap v2519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:16:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:09 smithi136 ceph-mon[125702]: pgmap v2519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:16:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:11 smithi057 ceph-mon[92072]: pgmap v2520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:16:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:11 smithi057 ceph-mon[92072]: osdmap e231: 12 total, 12 up, 12 in 2023-03-02T12:16:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:11 smithi122 ceph-mon[125440]: pgmap v2520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:16:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:11 smithi122 ceph-mon[125440]: osdmap e231: 12 total, 12 up, 12 in 2023-03-02T12:16:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:11 smithi136 ceph-mon[125702]: pgmap v2520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:16:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:11 smithi136 ceph-mon[125702]: osdmap e231: 12 total, 12 up, 12 in 2023-03-02T12:16:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:13 smithi057 ceph-mon[92072]: pgmap v2522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:16:13.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:13 smithi122 ceph-mon[125440]: pgmap v2522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:16:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:13 smithi136 ceph-mon[125702]: pgmap v2522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:16:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:15 smithi057 ceph-mon[92072]: pgmap v2523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:16:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:15 smithi057 ceph-mon[92072]: osdmap e232: 12 total, 12 up, 12 in 2023-03-02T12:16:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:15 smithi122 ceph-mon[125440]: pgmap v2523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:16:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:15 smithi122 ceph-mon[125440]: osdmap e232: 12 total, 12 up, 12 in 2023-03-02T12:16:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:15 smithi136 ceph-mon[125702]: pgmap v2523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:16:15.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:15 smithi136 ceph-mon[125702]: osdmap e232: 12 total, 12 up, 12 in 2023-03-02T12:16:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:17 smithi057 ceph-mon[92072]: pgmap v2525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:16:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:17 smithi122 ceph-mon[125440]: pgmap v2525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:16:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:17 smithi136 ceph-mon[125702]: pgmap v2525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:16:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:19 smithi057 ceph-mon[92072]: pgmap v2526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:16:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:19 smithi122 ceph-mon[125440]: pgmap v2526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:16:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:19 smithi136 ceph-mon[125702]: pgmap v2526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:16:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:21 smithi057 ceph-mon[92072]: pgmap v2527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:16:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:21 smithi122 ceph-mon[125440]: pgmap v2527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:16:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:21 smithi136 ceph-mon[125702]: pgmap v2527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:16:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:22.495+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:16:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:22.495+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:16:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:22.495+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:16:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:22.495+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:16:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:22.495+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:16:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:23 smithi057 ceph-mon[92072]: pgmap v2528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:16:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:23 smithi122 ceph-mon[125440]: pgmap v2528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:16:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:23 smithi136 ceph-mon[125702]: pgmap v2528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:16:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:25 smithi057 ceph-mon[92072]: pgmap v2529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:16:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:25 smithi122 ceph-mon[125440]: pgmap v2529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:16:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:25 smithi136 ceph-mon[125702]: pgmap v2529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:16:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:27 smithi057 ceph-mon[92072]: pgmap v2530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:16:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:27 smithi122 ceph-mon[125440]: pgmap v2530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:16:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:27 smithi136 ceph-mon[125702]: pgmap v2530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:16:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:29 smithi122 ceph-mon[125440]: pgmap v2531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:16:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:29 smithi136 ceph-mon[125702]: pgmap v2531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:16:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:29 smithi057 ceph-mon[92072]: pgmap v2531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:16:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:31 smithi122 ceph-mon[125440]: pgmap v2532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:31 smithi136 ceph-mon[125702]: pgmap v2532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:31 smithi057 ceph-mon[92072]: pgmap v2532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:33 smithi122 ceph-mon[125440]: pgmap v2533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:33 smithi136 ceph-mon[125702]: pgmap v2533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:33 smithi057 ceph-mon[92072]: pgmap v2533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:35 smithi122 ceph-mon[125440]: pgmap v2534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:35 smithi136 ceph-mon[125702]: pgmap v2534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:35 smithi057 ceph-mon[92072]: pgmap v2534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:37.510 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:37.509+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:16:37.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:37.509+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:16:37.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:37.509+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:16:37.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:37.509+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:16:37.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:37.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:16:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:37 smithi136 ceph-mon[125702]: pgmap v2535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:37 smithi057 ceph-mon[92072]: pgmap v2535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:37 smithi122 ceph-mon[125440]: pgmap v2535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:39 smithi136 ceph-mon[125702]: pgmap v2536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:39 smithi057 ceph-mon[92072]: pgmap v2536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:39 smithi122 ceph-mon[125440]: pgmap v2536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:41 smithi136 ceph-mon[125702]: pgmap v2537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:41 smithi057 ceph-mon[92072]: pgmap v2537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:41 smithi122 ceph-mon[125440]: pgmap v2537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:16:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:16:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:16:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:43 smithi136 ceph-mon[125702]: pgmap v2538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:16:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:16:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:16:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:43 smithi057 ceph-mon[92072]: pgmap v2538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:16:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:16:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:16:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:43 smithi122 ceph-mon[125440]: pgmap v2538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:16:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:16:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:16:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:45 smithi136 ceph-mon[125702]: pgmap v2539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:45 smithi057 ceph-mon[92072]: pgmap v2539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:45 smithi122 ceph-mon[125440]: pgmap v2539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:47 smithi136 ceph-mon[125702]: pgmap v2540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:47 smithi057 ceph-mon[92072]: pgmap v2540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:47 smithi122 ceph-mon[125440]: pgmap v2540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:49 smithi136 ceph-mon[125702]: pgmap v2541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:49 smithi057 ceph-mon[92072]: pgmap v2541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:49 smithi122 ceph-mon[125440]: pgmap v2541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:51 smithi136 ceph-mon[125702]: pgmap v2542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:51 smithi057 ceph-mon[92072]: pgmap v2542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:51 smithi122 ceph-mon[125440]: pgmap v2542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:52.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:52.521+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:16:52.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:52.522+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:16:52.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:52.522+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:16:52.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:52.522+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:16:52.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:16:52.522+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:16:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:53 smithi136 ceph-mon[125702]: pgmap v2543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:53 smithi057 ceph-mon[92072]: pgmap v2543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:53 smithi122 ceph-mon[125440]: pgmap v2543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:55 smithi136 ceph-mon[125702]: pgmap v2544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:55 smithi057 ceph-mon[92072]: pgmap v2544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:55 smithi122 ceph-mon[125440]: pgmap v2544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:57 smithi136 ceph-mon[125702]: pgmap v2545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:57 smithi057 ceph-mon[92072]: pgmap v2545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:57 smithi122 ceph-mon[125440]: pgmap v2545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:16:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:16:59 smithi136 ceph-mon[125702]: pgmap v2546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:16:59 smithi057 ceph-mon[92072]: pgmap v2546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:16:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:16:59 smithi122 ceph-mon[125440]: pgmap v2546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:01 smithi136 ceph-mon[125702]: pgmap v2547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:01 smithi057 ceph-mon[92072]: pgmap v2547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:01 smithi122 ceph-mon[125440]: pgmap v2547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:03 smithi136 ceph-mon[125702]: pgmap v2548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:17:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:03 smithi057 ceph-mon[92072]: pgmap v2548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:17:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:03 smithi122 ceph-mon[125440]: pgmap v2548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:17:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:05 smithi136 ceph-mon[125702]: pgmap v2549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:17:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:05 smithi057 ceph-mon[92072]: pgmap v2549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:17:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:05 smithi122 ceph-mon[125440]: pgmap v2549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:17:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:07.538+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:17:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:07.538+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:17:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:07.538+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:17:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:07.538+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:17:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:07.538+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:17:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:07 smithi136 ceph-mon[125702]: pgmap v2550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:17:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:07 smithi057 ceph-mon[92072]: pgmap v2550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:17:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:07 smithi122 ceph-mon[125440]: pgmap v2550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:17:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:09.025+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:17:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:09.025+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:17:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:09.026+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 41 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:17:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:09.026+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 40 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:17:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:09 smithi136 ceph-mon[125702]: pgmap v2551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:17:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:09 smithi057 ceph-mon[92072]: pgmap v2551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:17:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:09 smithi122 ceph-mon[125440]: pgmap v2551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:17:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:11 smithi136 ceph-mon[125702]: pgmap v2552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:17:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:11 smithi136 ceph-mon[125702]: osdmap e233: 12 total, 12 up, 12 in 2023-03-02T12:17:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:11 smithi057 ceph-mon[92072]: pgmap v2552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:17:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:11 smithi057 ceph-mon[92072]: osdmap e233: 12 total, 12 up, 12 in 2023-03-02T12:17:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:11 smithi122 ceph-mon[125440]: pgmap v2552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:17:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:11 smithi122 ceph-mon[125440]: osdmap e233: 12 total, 12 up, 12 in 2023-03-02T12:17:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:13 smithi136 ceph-mon[125702]: pgmap v2554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:17:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:13 smithi057 ceph-mon[92072]: pgmap v2554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:17:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:13 smithi122 ceph-mon[125440]: pgmap v2554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:17:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:15 smithi136 ceph-mon[125702]: pgmap v2555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:17:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:15 smithi136 ceph-mon[125702]: osdmap e234: 12 total, 12 up, 12 in 2023-03-02T12:17:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:15 smithi057 ceph-mon[92072]: pgmap v2555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:17:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:15 smithi057 ceph-mon[92072]: osdmap e234: 12 total, 12 up, 12 in 2023-03-02T12:17:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:15 smithi122 ceph-mon[125440]: pgmap v2555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:17:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:15 smithi122 ceph-mon[125440]: osdmap e234: 12 total, 12 up, 12 in 2023-03-02T12:17:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:17 smithi136 ceph-mon[125702]: pgmap v2557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:17:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:17 smithi057 ceph-mon[92072]: pgmap v2557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:17:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:17 smithi122 ceph-mon[125440]: pgmap v2557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:17:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:19 smithi136 ceph-mon[125702]: pgmap v2558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:17:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:19 smithi057 ceph-mon[92072]: pgmap v2558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:17:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:19 smithi122 ceph-mon[125440]: pgmap v2558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:17:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:21 smithi136 ceph-mon[125702]: pgmap v2559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:17:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:21 smithi057 ceph-mon[92072]: pgmap v2559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:17:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:21 smithi122 ceph-mon[125440]: pgmap v2559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:17:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:22.554+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:17:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:22.554+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:17:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:22.554+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:17:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:22.554+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:17:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:22.554+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:17:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:23 smithi136 ceph-mon[125702]: pgmap v2560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:17:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:23 smithi057 ceph-mon[92072]: pgmap v2560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:17:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:23 smithi122 ceph-mon[125440]: pgmap v2560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:17:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:25 smithi136 ceph-mon[125702]: pgmap v2561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:17:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:25 smithi057 ceph-mon[92072]: pgmap v2561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:17:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:25 smithi122 ceph-mon[125440]: pgmap v2561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:17:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:27 smithi136 ceph-mon[125702]: pgmap v2562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:17:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:27 smithi057 ceph-mon[92072]: pgmap v2562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:17:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:27 smithi122 ceph-mon[125440]: pgmap v2562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:17:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:29 smithi136 ceph-mon[125702]: pgmap v2563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:17:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:29 smithi057 ceph-mon[92072]: pgmap v2563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:17:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:29 smithi122 ceph-mon[125440]: pgmap v2563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:17:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:31 smithi057 ceph-mon[92072]: pgmap v2564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:31 smithi122 ceph-mon[125440]: pgmap v2564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:31 smithi136 ceph-mon[125702]: pgmap v2564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:32 smithi057 ceph-mon[92072]: pgmap v2565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:32 smithi122 ceph-mon[125440]: pgmap v2565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:32 smithi136 ceph-mon[125702]: pgmap v2565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:35 smithi136 ceph-mon[125702]: pgmap v2566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:35 smithi057 ceph-mon[92072]: pgmap v2566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:35 smithi122 ceph-mon[125440]: pgmap v2566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:37 smithi136 ceph-mon[125702]: pgmap v2567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:37 smithi057 ceph-mon[92072]: pgmap v2567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:37 smithi122 ceph-mon[125440]: pgmap v2567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:37.570+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:17:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:37.570+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:17:37.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:37.570+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:17:37.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:37.570+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:17:37.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:37.570+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:17:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:39 smithi136 ceph-mon[125702]: pgmap v2568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:39 smithi057 ceph-mon[92072]: pgmap v2568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:39 smithi122 ceph-mon[125440]: pgmap v2568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:41 smithi136 ceph-mon[125702]: pgmap v2569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:41 smithi057 ceph-mon[92072]: pgmap v2569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:41 smithi122 ceph-mon[125440]: pgmap v2569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:43 smithi136 ceph-mon[125702]: pgmap v2570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:43.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:17:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:43 smithi057 ceph-mon[92072]: pgmap v2570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:17:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:43 smithi122 ceph-mon[125440]: pgmap v2570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:17:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:17:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:17:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:17:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:17:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:17:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:17:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:17:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:17:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:17:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:45 smithi136 ceph-mon[125702]: pgmap v2571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:45.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:45 smithi057 ceph-mon[92072]: pgmap v2571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:45 smithi122 ceph-mon[125440]: pgmap v2571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:47 smithi136 ceph-mon[125702]: pgmap v2572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:47 smithi057 ceph-mon[92072]: pgmap v2572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:47 smithi122 ceph-mon[125440]: pgmap v2572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:49 smithi136 ceph-mon[125702]: pgmap v2573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:49 smithi057 ceph-mon[92072]: pgmap v2573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:49 smithi122 ceph-mon[125440]: pgmap v2573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:51 smithi136 ceph-mon[125702]: pgmap v2574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:51 smithi057 ceph-mon[92072]: pgmap v2574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:51 smithi122 ceph-mon[125440]: pgmap v2574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:52.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:17:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:52.583+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:17:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:52.583+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:17:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:52.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:17:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:17:52.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:17:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:53 smithi057 ceph-mon[92072]: pgmap v2575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:53 smithi122 ceph-mon[125440]: pgmap v2575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:53 smithi136 ceph-mon[125702]: pgmap v2575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:55 smithi057 ceph-mon[92072]: pgmap v2576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:55 smithi122 ceph-mon[125440]: pgmap v2576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:55 smithi136 ceph-mon[125702]: pgmap v2576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:57 smithi057 ceph-mon[92072]: pgmap v2577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:57.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:57 smithi122 ceph-mon[125440]: pgmap v2577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:57 smithi136 ceph-mon[125702]: pgmap v2577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:17:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:17:59 smithi057 ceph-mon[92072]: pgmap v2578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:17:59 smithi122 ceph-mon[125440]: pgmap v2578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:17:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:17:59 smithi136 ceph-mon[125702]: pgmap v2578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:01 smithi057 ceph-mon[92072]: pgmap v2579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:01 smithi122 ceph-mon[125440]: pgmap v2579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:01 smithi136 ceph-mon[125702]: pgmap v2579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:03.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:03 smithi057 ceph-mon[92072]: pgmap v2580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:18:03.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:03 smithi122 ceph-mon[125440]: pgmap v2580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:18:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:03 smithi136 ceph-mon[125702]: pgmap v2580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:18:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:05 smithi057 ceph-mon[92072]: pgmap v2581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:18:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:05 smithi122 ceph-mon[125440]: pgmap v2581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:18:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:05 smithi136 ceph-mon[125702]: pgmap v2581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:18:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:07 smithi057 ceph-mon[92072]: pgmap v2582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:18:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:07 smithi122 ceph-mon[125440]: pgmap v2582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:18:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:07 smithi136 ceph-mon[125702]: pgmap v2582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:18:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:07.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:18:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:07.598+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:18:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:07.598+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:18:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:07.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:18:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:07.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:18:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:09 smithi057 ceph-mon[92072]: pgmap v2583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:18:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:09 smithi122 ceph-mon[125440]: pgmap v2583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:18:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:09 smithi136 ceph-mon[125702]: pgmap v2583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:18:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:11 smithi057 ceph-mon[92072]: pgmap v2584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:18:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:11 smithi057 ceph-mon[92072]: osdmap e235: 12 total, 12 up, 12 in 2023-03-02T12:18:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:11 smithi122 ceph-mon[125440]: pgmap v2584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:18:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:11 smithi122 ceph-mon[125440]: osdmap e235: 12 total, 12 up, 12 in 2023-03-02T12:18:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:11 smithi136 ceph-mon[125702]: pgmap v2584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:18:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:11 smithi136 ceph-mon[125702]: osdmap e235: 12 total, 12 up, 12 in 2023-03-02T12:18:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:13 smithi057 ceph-mon[92072]: pgmap v2586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:18:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:13 smithi122 ceph-mon[125440]: pgmap v2586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:18:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:13 smithi136 ceph-mon[125702]: pgmap v2586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:18:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:15 smithi057 ceph-mon[92072]: pgmap v2587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:18:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:15 smithi057 ceph-mon[92072]: osdmap e236: 12 total, 12 up, 12 in 2023-03-02T12:18:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:15 smithi122 ceph-mon[125440]: pgmap v2587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:18:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:15 smithi122 ceph-mon[125440]: osdmap e236: 12 total, 12 up, 12 in 2023-03-02T12:18:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:15 smithi136 ceph-mon[125702]: pgmap v2587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:18:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:15 smithi136 ceph-mon[125702]: osdmap e236: 12 total, 12 up, 12 in 2023-03-02T12:18:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:17 smithi057 ceph-mon[92072]: pgmap v2589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:18:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:17 smithi122 ceph-mon[125440]: pgmap v2589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:18:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:17 smithi136 ceph-mon[125702]: pgmap v2589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:18:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:19 smithi057 ceph-mon[92072]: pgmap v2590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:18:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:19 smithi122 ceph-mon[125440]: pgmap v2590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:18:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:19 smithi136 ceph-mon[125702]: pgmap v2590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:18:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:21 smithi057 ceph-mon[92072]: pgmap v2591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:18:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:21 smithi122 ceph-mon[125440]: pgmap v2591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:18:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:21 smithi136 ceph-mon[125702]: pgmap v2591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:18:22.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:22.614+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:18:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:22.615+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:18:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:22.615+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:18:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:22.615+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:18:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:22.615+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:18:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:23 smithi057 ceph-mon[92072]: pgmap v2592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:18:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:23 smithi122 ceph-mon[125440]: pgmap v2592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:18:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:23 smithi136 ceph-mon[125702]: pgmap v2592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:18:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:25 smithi057 ceph-mon[92072]: pgmap v2593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:18:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:25 smithi122 ceph-mon[125440]: pgmap v2593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:18:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:25 smithi136 ceph-mon[125702]: pgmap v2593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:18:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:27 smithi057 ceph-mon[92072]: pgmap v2594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:18:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:27 smithi122 ceph-mon[125440]: pgmap v2594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:18:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:27 smithi136 ceph-mon[125702]: pgmap v2594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:18:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:29 smithi057 ceph-mon[92072]: pgmap v2595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:18:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:29 smithi122 ceph-mon[125440]: pgmap v2595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:18:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:29 smithi136 ceph-mon[125702]: pgmap v2595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:18:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:31 smithi122 ceph-mon[125440]: pgmap v2596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:31 smithi136 ceph-mon[125702]: pgmap v2596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:31 smithi057 ceph-mon[92072]: pgmap v2596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:33 smithi122 ceph-mon[125440]: pgmap v2597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:33 smithi136 ceph-mon[125702]: pgmap v2597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:33 smithi057 ceph-mon[92072]: pgmap v2597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:35 smithi122 ceph-mon[125440]: pgmap v2598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:35 smithi136 ceph-mon[125702]: pgmap v2598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:35 smithi057 ceph-mon[92072]: pgmap v2598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:37 smithi136 ceph-mon[125702]: pgmap v2599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:37.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:37.630+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:18:37.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:37.631+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:18:37.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:37.631+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:18:37.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:37.631+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:18:37.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:37.631+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:18:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:37 smithi057 ceph-mon[92072]: pgmap v2599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:37 smithi122 ceph-mon[125440]: pgmap v2599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:39 smithi136 ceph-mon[125702]: pgmap v2600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:39 smithi057 ceph-mon[92072]: pgmap v2600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:39 smithi122 ceph-mon[125440]: pgmap v2600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:41 smithi136 ceph-mon[125702]: pgmap v2601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:41 smithi057 ceph-mon[92072]: pgmap v2601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:41 smithi122 ceph-mon[125440]: pgmap v2601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:43 smithi136 ceph-mon[125702]: pgmap v2602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:43 smithi057 ceph-mon[92072]: pgmap v2602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:43 smithi122 ceph-mon[125440]: pgmap v2602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:18:44.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:18:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:18:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:45 smithi136 ceph-mon[125702]: pgmap v2603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:45 smithi057 ceph-mon[92072]: pgmap v2603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:45 smithi122 ceph-mon[125440]: pgmap v2603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:18:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:18:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:18:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:18:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:18:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:18:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:18:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:18:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:18:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:47 smithi136 ceph-mon[125702]: pgmap v2604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:47 smithi057 ceph-mon[92072]: pgmap v2604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:47 smithi122 ceph-mon[125440]: pgmap v2604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:49 smithi136 ceph-mon[125702]: pgmap v2605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:49 smithi057 ceph-mon[92072]: pgmap v2605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:49 smithi122 ceph-mon[125440]: pgmap v2605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:51 smithi136 ceph-mon[125702]: pgmap v2606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:51 smithi057 ceph-mon[92072]: pgmap v2606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:51 smithi122 ceph-mon[125440]: pgmap v2606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:52.643+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:18:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:52.643+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:18:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:52.643+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:18:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:52.643+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:18:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:18:52.643+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:18:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:53 smithi136 ceph-mon[125702]: pgmap v2607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:53 smithi057 ceph-mon[92072]: pgmap v2607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:53 smithi122 ceph-mon[125440]: pgmap v2607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:55 smithi136 ceph-mon[125702]: pgmap v2608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:55 smithi057 ceph-mon[92072]: pgmap v2608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:55 smithi122 ceph-mon[125440]: pgmap v2608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:57 smithi136 ceph-mon[125702]: pgmap v2609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:57 smithi057 ceph-mon[92072]: pgmap v2609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:57 smithi122 ceph-mon[125440]: pgmap v2609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:18:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:18:59 smithi136 ceph-mon[125702]: pgmap v2610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:18:59 smithi057 ceph-mon[92072]: pgmap v2610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:18:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:18:59 smithi122 ceph-mon[125440]: pgmap v2610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:01 smithi136 ceph-mon[125702]: pgmap v2611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:01 smithi057 ceph-mon[92072]: pgmap v2611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:01 smithi122 ceph-mon[125440]: pgmap v2611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:03 smithi136 ceph-mon[125702]: pgmap v2612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:19:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:03 smithi057 ceph-mon[92072]: pgmap v2612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:19:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:03 smithi122 ceph-mon[125440]: pgmap v2612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:19:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:05 smithi136 ceph-mon[125702]: pgmap v2613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:19:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:05 smithi057 ceph-mon[92072]: pgmap v2613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:19:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:05 smithi122 ceph-mon[125440]: pgmap v2613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:19:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:07 smithi136 ceph-mon[125702]: pgmap v2614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:19:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:07.646+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:19:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:07.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:19:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:07.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:19:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:07.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:19:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:07.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:19:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:07 smithi057 ceph-mon[92072]: pgmap v2614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:19:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:07 smithi122 ceph-mon[125440]: pgmap v2614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:19:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:09 smithi136 ceph-mon[125702]: pgmap v2615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:19:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:09 smithi057 ceph-mon[92072]: pgmap v2615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:19:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:09 smithi122 ceph-mon[125440]: pgmap v2615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:19:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:11 smithi136 ceph-mon[125702]: pgmap v2616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:19:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:11 smithi136 ceph-mon[125702]: osdmap e237: 12 total, 12 up, 12 in 2023-03-02T12:19:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:11 smithi057 ceph-mon[92072]: pgmap v2616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:19:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:11 smithi057 ceph-mon[92072]: osdmap e237: 12 total, 12 up, 12 in 2023-03-02T12:19:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:11 smithi122 ceph-mon[125440]: pgmap v2616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:19:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:11 smithi122 ceph-mon[125440]: osdmap e237: 12 total, 12 up, 12 in 2023-03-02T12:19:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:13 smithi136 ceph-mon[125702]: pgmap v2618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:19:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:13 smithi057 ceph-mon[92072]: pgmap v2618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:19:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:13 smithi122 ceph-mon[125440]: pgmap v2618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:19:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:15 smithi136 ceph-mon[125702]: pgmap v2619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:19:15.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:15 smithi136 ceph-mon[125702]: osdmap e238: 12 total, 12 up, 12 in 2023-03-02T12:19:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:15 smithi057 ceph-mon[92072]: pgmap v2619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:19:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:15 smithi057 ceph-mon[92072]: osdmap e238: 12 total, 12 up, 12 in 2023-03-02T12:19:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:15 smithi122 ceph-mon[125440]: pgmap v2619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:19:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:15 smithi122 ceph-mon[125440]: osdmap e238: 12 total, 12 up, 12 in 2023-03-02T12:19:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:17 smithi136 ceph-mon[125702]: pgmap v2621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:19:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:17 smithi057 ceph-mon[92072]: pgmap v2621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:19:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:17 smithi122 ceph-mon[125440]: pgmap v2621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:19:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:19 smithi136 ceph-mon[125702]: pgmap v2622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:19:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:19 smithi057 ceph-mon[92072]: pgmap v2622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:19:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:19 smithi122 ceph-mon[125440]: pgmap v2622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:19:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:21 smithi136 ceph-mon[125702]: pgmap v2623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T12:19:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:21 smithi057 ceph-mon[92072]: pgmap v2623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T12:19:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:21 smithi122 ceph-mon[125440]: pgmap v2623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T12:19:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:22.659+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:19:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:22.659+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:19:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:22.659+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:19:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:22.659+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:19:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:22.659+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:19:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:23 smithi136 ceph-mon[125702]: pgmap v2624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:19:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:23 smithi057 ceph-mon[92072]: pgmap v2624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:19:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:23 smithi122 ceph-mon[125440]: pgmap v2624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:19:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:25 smithi136 ceph-mon[125702]: pgmap v2625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:19:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:25 smithi057 ceph-mon[92072]: pgmap v2625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:19:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:25 smithi122 ceph-mon[125440]: pgmap v2625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:19:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:27 smithi136 ceph-mon[125702]: pgmap v2626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:19:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:27 smithi057 ceph-mon[92072]: pgmap v2626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:19:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:27 smithi122 ceph-mon[125440]: pgmap v2626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:19:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:29 smithi136 ceph-mon[125702]: pgmap v2627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:19:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:29 smithi057 ceph-mon[92072]: pgmap v2627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:19:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:29 smithi122 ceph-mon[125440]: pgmap v2627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:19:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:31 smithi057 ceph-mon[92072]: pgmap v2628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:31 smithi122 ceph-mon[125440]: pgmap v2628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:31 smithi136 ceph-mon[125702]: pgmap v2628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:33 smithi057 ceph-mon[92072]: pgmap v2629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:33 smithi122 ceph-mon[125440]: pgmap v2629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:33 smithi136 ceph-mon[125702]: pgmap v2629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:35 smithi057 ceph-mon[92072]: pgmap v2630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:35 smithi122 ceph-mon[125440]: pgmap v2630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:35 smithi136 ceph-mon[125702]: pgmap v2630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:37.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:19:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:37.675+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:19:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:37.675+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:19:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:37.675+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:19:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:37.675+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:19:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:37 smithi057 ceph-mon[92072]: pgmap v2631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:37.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:37 smithi122 ceph-mon[125440]: pgmap v2631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:37 smithi136 ceph-mon[125702]: pgmap v2631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:38 smithi057 ceph-mon[92072]: pgmap v2632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:38 smithi122 ceph-mon[125440]: pgmap v2632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:38 smithi136 ceph-mon[125702]: pgmap v2632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:41 smithi057 ceph-mon[92072]: pgmap v2633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:41 smithi122 ceph-mon[125440]: pgmap v2633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:41 smithi136 ceph-mon[125702]: pgmap v2633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:43 smithi057 ceph-mon[92072]: pgmap v2634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:43 smithi122 ceph-mon[125440]: pgmap v2634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:43 smithi136 ceph-mon[125702]: pgmap v2634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:45 smithi057 ceph-mon[92072]: pgmap v2635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:45 smithi122 ceph-mon[125440]: pgmap v2635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:45 smithi136 ceph-mon[125702]: pgmap v2635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:19:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:19:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:19:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:47 smithi057 ceph-mon[92072]: pgmap v2636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:47.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:47 smithi122 ceph-mon[125440]: pgmap v2636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:47 smithi136 ceph-mon[125702]: pgmap v2636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:49 smithi057 ceph-mon[92072]: pgmap v2637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:49 smithi122 ceph-mon[125440]: pgmap v2637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:49 smithi136 ceph-mon[125702]: pgmap v2637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:49.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:49.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:49.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:49.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:50.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:50.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.599 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.599 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.599 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.599 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.600 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.600 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.600 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.600 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.601 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.601 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:19:50.601 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:19:50.602 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.689 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.689 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.689 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.689 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.690 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:19:50.690 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:19:50.690 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:50.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.708 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.708 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.708 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.708 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.708 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.709 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.709 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:19:50.709 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:19:50.709 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:19:50.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:19:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:51 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:19:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:51 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:19:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:51 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:19:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:51 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:19:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:51 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:19:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:51 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:19:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:51 smithi136 ceph-mon[125702]: pgmap v2638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:51 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:19:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:51 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:19:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:51 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:19:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:51 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:19:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:51 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:19:51.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:51 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:19:51.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:51 smithi057 ceph-mon[92072]: pgmap v2638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:51 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:19:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:51 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:19:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:51 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:19:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:51 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:19:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:51 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:19:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:51 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:19:51.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:51 smithi122 ceph-mon[125440]: pgmap v2638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:52.691 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:52.690+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:19:52.692 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:52.690+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:19:52.692 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:52.690+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:19:52.692 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:52.690+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:19:52.692 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:19:52.690+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:19:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:53 smithi136 ceph-mon[125702]: pgmap v2639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:53 smithi057 ceph-mon[92072]: pgmap v2639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:53 smithi122 ceph-mon[125440]: pgmap v2639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:55 smithi136 ceph-mon[125702]: pgmap v2640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:55 smithi057 ceph-mon[92072]: pgmap v2640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:55 smithi122 ceph-mon[125440]: pgmap v2640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:57 smithi136 ceph-mon[125702]: pgmap v2641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:57 smithi057 ceph-mon[92072]: pgmap v2641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:57 smithi122 ceph-mon[125440]: pgmap v2641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:19:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:19:59 smithi136 ceph-mon[125702]: pgmap v2642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:19:59 smithi057 ceph-mon[92072]: pgmap v2642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:19:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:19:59 smithi122 ceph-mon[125440]: pgmap v2642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T12:20:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T12:20:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T12:20:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:01 smithi136 ceph-mon[125702]: pgmap v2643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:01 smithi057 ceph-mon[92072]: pgmap v2643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:01 smithi122 ceph-mon[125440]: pgmap v2643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:03 smithi136 ceph-mon[125702]: pgmap v2644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:20:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:03 smithi057 ceph-mon[92072]: pgmap v2644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:20:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:03 smithi122 ceph-mon[125440]: pgmap v2644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:20:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:05 smithi136 ceph-mon[125702]: pgmap v2645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:20:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:05 smithi057 ceph-mon[92072]: pgmap v2645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:20:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:05 smithi122 ceph-mon[125440]: pgmap v2645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:20:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:07 smithi136 ceph-mon[125702]: pgmap v2646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:20:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:07 smithi057 ceph-mon[92072]: pgmap v2646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:20:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:07.697+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:20:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:07.698+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:20:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:07.698+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:20:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:07.698+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:20:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:07.698+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:20:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:07 smithi122 ceph-mon[125440]: pgmap v2646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:20:09.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:09.051+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:20:09.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:09.051+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:20:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:09.051+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 41 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:20:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:09.051+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 42 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:20:09.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:09 smithi122 ceph-mon[125440]: pgmap v2647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:20:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:09 smithi136 ceph-mon[125702]: pgmap v2647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:20:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:09 smithi057 ceph-mon[92072]: pgmap v2647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:20:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:11 smithi057 ceph-mon[92072]: pgmap v2648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:20:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:11 smithi057 ceph-mon[92072]: osdmap e239: 12 total, 12 up, 12 in 2023-03-02T12:20:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:11 smithi122 ceph-mon[125440]: pgmap v2648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:20:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:11 smithi122 ceph-mon[125440]: osdmap e239: 12 total, 12 up, 12 in 2023-03-02T12:20:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:11 smithi136 ceph-mon[125702]: pgmap v2648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:20:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:11 smithi136 ceph-mon[125702]: osdmap e239: 12 total, 12 up, 12 in 2023-03-02T12:20:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:13 smithi057 ceph-mon[92072]: pgmap v2650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:20:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:13 smithi122 ceph-mon[125440]: pgmap v2650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:20:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:13 smithi136 ceph-mon[125702]: pgmap v2650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:20:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:15 smithi057 ceph-mon[92072]: pgmap v2651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:20:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:15 smithi057 ceph-mon[92072]: osdmap e240: 12 total, 12 up, 12 in 2023-03-02T12:20:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:15 smithi122 ceph-mon[125440]: pgmap v2651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:20:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:15 smithi122 ceph-mon[125440]: osdmap e240: 12 total, 12 up, 12 in 2023-03-02T12:20:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:15 smithi136 ceph-mon[125702]: pgmap v2651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:20:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:15 smithi136 ceph-mon[125702]: osdmap e240: 12 total, 12 up, 12 in 2023-03-02T12:20:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:17 smithi057 ceph-mon[92072]: pgmap v2653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:20:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:17 smithi122 ceph-mon[125440]: pgmap v2653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:20:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:17 smithi136 ceph-mon[125702]: pgmap v2653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:20:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:19 smithi057 ceph-mon[92072]: pgmap v2654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:20:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:19 smithi122 ceph-mon[125440]: pgmap v2654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:20:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:19 smithi136 ceph-mon[125702]: pgmap v2654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:20:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:21 smithi057 ceph-mon[92072]: pgmap v2655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T12:20:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:21 smithi122 ceph-mon[125440]: pgmap v2655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T12:20:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:21 smithi136 ceph-mon[125702]: pgmap v2655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T12:20:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:22 smithi057 ceph-mon[92072]: pgmap v2656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:20:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:22 smithi122 ceph-mon[125440]: pgmap v2656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:20:22.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:22.707+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:20:22.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:22.708+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:20:22.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:22.708+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:20:22.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:22.708+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:20:22.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:22.708+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:20:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:22 smithi136 ceph-mon[125702]: pgmap v2656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:20:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:25 smithi057 ceph-mon[92072]: pgmap v2657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:20:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:25 smithi122 ceph-mon[125440]: pgmap v2657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:20:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:25 smithi136 ceph-mon[125702]: pgmap v2657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:20:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:27 smithi057 ceph-mon[92072]: pgmap v2658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:20:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:27 smithi122 ceph-mon[125440]: pgmap v2658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:20:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:27 smithi136 ceph-mon[125702]: pgmap v2658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:20:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:29 smithi057 ceph-mon[92072]: pgmap v2659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:20:29.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:29 smithi122 ceph-mon[125440]: pgmap v2659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:20:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:29 smithi136 ceph-mon[125702]: pgmap v2659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:20:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:31 smithi057 ceph-mon[92072]: pgmap v2660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:31 smithi122 ceph-mon[125440]: pgmap v2660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:31 smithi136 ceph-mon[125702]: pgmap v2660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:33 smithi057 ceph-mon[92072]: pgmap v2661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:33 smithi122 ceph-mon[125440]: pgmap v2661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:33 smithi136 ceph-mon[125702]: pgmap v2661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:35 smithi057 ceph-mon[92072]: pgmap v2662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:35 smithi122 ceph-mon[125440]: pgmap v2662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:35 smithi136 ceph-mon[125702]: pgmap v2662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:37 smithi057 ceph-mon[92072]: pgmap v2663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:37 smithi122 ceph-mon[125440]: pgmap v2663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:37 smithi136 ceph-mon[125702]: pgmap v2663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:37.719+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:20:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:37.720+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:20:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:37.720+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:20:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:37.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:20:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:37.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:20:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:39 smithi057 ceph-mon[92072]: pgmap v2664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:39 smithi122 ceph-mon[125440]: pgmap v2664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:39.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:39 smithi136 ceph-mon[125702]: pgmap v2664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:41 smithi057 ceph-mon[92072]: pgmap v2665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:41 smithi122 ceph-mon[125440]: pgmap v2665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:41 smithi136 ceph-mon[125702]: pgmap v2665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:43 smithi057 ceph-mon[92072]: pgmap v2666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:43 smithi122 ceph-mon[125440]: pgmap v2666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:43 smithi136 ceph-mon[125702]: pgmap v2666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:45 smithi057 ceph-mon[92072]: pgmap v2667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:45 smithi122 ceph-mon[125440]: pgmap v2667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:45 smithi136 ceph-mon[125702]: pgmap v2667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:47 smithi057 ceph-mon[92072]: pgmap v2668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:47 smithi122 ceph-mon[125440]: pgmap v2668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:47 smithi136 ceph-mon[125702]: pgmap v2668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:49 smithi057 ceph-mon[92072]: pgmap v2669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:49 smithi122 ceph-mon[125440]: pgmap v2669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:49 smithi136 ceph-mon[125702]: pgmap v2669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:51 smithi057 ceph-mon[92072]: pgmap v2670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:20:51.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:20:51.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:20:51.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:20:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:51 smithi122 ceph-mon[125440]: pgmap v2670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:20:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:20:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:20:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:20:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:51 smithi136 ceph-mon[125702]: pgmap v2670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:20:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:20:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:20:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:20:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:52.734+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:20:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:52.734+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:20:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:52.734+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:20:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:52.734+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:20:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:20:52.734+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:20:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:53 smithi057 ceph-mon[92072]: pgmap v2671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:53 smithi122 ceph-mon[125440]: pgmap v2671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:53 smithi136 ceph-mon[125702]: pgmap v2671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:55 smithi057 ceph-mon[92072]: pgmap v2672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:55 smithi122 ceph-mon[125440]: pgmap v2672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:55 smithi136 ceph-mon[125702]: pgmap v2672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:57 smithi057 ceph-mon[92072]: pgmap v2673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:57 smithi122 ceph-mon[125440]: pgmap v2673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:57 smithi136 ceph-mon[125702]: pgmap v2673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:20:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:20:59 smithi057 ceph-mon[92072]: pgmap v2674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:20:59 smithi122 ceph-mon[125440]: pgmap v2674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:20:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:20:59 smithi136 ceph-mon[125702]: pgmap v2674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:01 smithi057 ceph-mon[92072]: pgmap v2675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:01 smithi122 ceph-mon[125440]: pgmap v2675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:01 smithi136 ceph-mon[125702]: pgmap v2675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:03 smithi057 ceph-mon[92072]: pgmap v2676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:21:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:03 smithi122 ceph-mon[125440]: pgmap v2676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:21:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:03 smithi136 ceph-mon[125702]: pgmap v2676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:21:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:05 smithi057 ceph-mon[92072]: pgmap v2677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:21:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:05 smithi122 ceph-mon[125440]: pgmap v2677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:21:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:05 smithi136 ceph-mon[125702]: pgmap v2677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:21:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:07 smithi057 ceph-mon[92072]: pgmap v2678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:21:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:07 smithi122 ceph-mon[125440]: pgmap v2678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:21:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:07 smithi136 ceph-mon[125702]: pgmap v2678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:21:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:07.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:21:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:07.750+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:21:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:07.750+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:21:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:07.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:21:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:07.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:21:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:09 smithi057 ceph-mon[92072]: pgmap v2679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:21:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:09 smithi122 ceph-mon[125440]: pgmap v2679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:21:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:09 smithi136 ceph-mon[125702]: pgmap v2679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:21:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:11 smithi057 ceph-mon[92072]: pgmap v2680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:21:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:11 smithi057 ceph-mon[92072]: osdmap e241: 12 total, 12 up, 12 in 2023-03-02T12:21:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:11 smithi122 ceph-mon[125440]: pgmap v2680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:21:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:11 smithi122 ceph-mon[125440]: osdmap e241: 12 total, 12 up, 12 in 2023-03-02T12:21:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:11 smithi136 ceph-mon[125702]: pgmap v2680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:21:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:11 smithi136 ceph-mon[125702]: osdmap e241: 12 total, 12 up, 12 in 2023-03-02T12:21:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:13 smithi057 ceph-mon[92072]: pgmap v2682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:21:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:13 smithi122 ceph-mon[125440]: pgmap v2682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:21:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:13 smithi136 ceph-mon[125702]: pgmap v2682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:21:15.181 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:15 smithi122 ceph-mon[125440]: pgmap v2683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:21:15.182 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:15 smithi122 ceph-mon[125440]: osdmap e242: 12 total, 12 up, 12 in 2023-03-02T12:21:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:15 smithi057 ceph-mon[92072]: pgmap v2683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:21:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:15 smithi057 ceph-mon[92072]: osdmap e242: 12 total, 12 up, 12 in 2023-03-02T12:21:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:15 smithi136 ceph-mon[125702]: pgmap v2683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:21:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:15 smithi136 ceph-mon[125702]: osdmap e242: 12 total, 12 up, 12 in 2023-03-02T12:21:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:17 smithi057 ceph-mon[92072]: pgmap v2685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:21:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:17 smithi122 ceph-mon[125440]: pgmap v2685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:21:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:17 smithi136 ceph-mon[125702]: pgmap v2685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:21:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:19 smithi122 ceph-mon[125440]: pgmap v2686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:21:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:19 smithi136 ceph-mon[125702]: pgmap v2686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:21:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:19 smithi057 ceph-mon[92072]: pgmap v2686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:21:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:21 smithi122 ceph-mon[125440]: pgmap v2687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:21:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:21 smithi136 ceph-mon[125702]: pgmap v2687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:21:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:21 smithi057 ceph-mon[92072]: pgmap v2687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:21:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:22.765+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:21:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:22.765+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:21:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:22.765+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:21:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:22.765+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:21:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:22.765+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:21:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:23 smithi122 ceph-mon[125440]: pgmap v2688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:21:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:23 smithi136 ceph-mon[125702]: pgmap v2688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:21:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:23 smithi057 ceph-mon[92072]: pgmap v2688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:21:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:25 smithi136 ceph-mon[125702]: pgmap v2689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:21:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:25 smithi057 ceph-mon[92072]: pgmap v2689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:21:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:25 smithi122 ceph-mon[125440]: pgmap v2689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:21:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:27 smithi136 ceph-mon[125702]: pgmap v2690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:21:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:27 smithi057 ceph-mon[92072]: pgmap v2690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:21:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:27 smithi122 ceph-mon[125440]: pgmap v2690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:29 smithi136 ceph-mon[125702]: pgmap v2691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:21:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:29 smithi057 ceph-mon[92072]: pgmap v2691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:21:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:29 smithi122 ceph-mon[125440]: pgmap v2691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:21:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:31 smithi136 ceph-mon[125702]: pgmap v2692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:31 smithi057 ceph-mon[92072]: pgmap v2692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:31 smithi122 ceph-mon[125440]: pgmap v2692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:33 smithi136 ceph-mon[125702]: pgmap v2693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:33 smithi057 ceph-mon[92072]: pgmap v2693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:33 smithi122 ceph-mon[125440]: pgmap v2693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:35 smithi136 ceph-mon[125702]: pgmap v2694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:35 smithi057 ceph-mon[92072]: pgmap v2694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:35 smithi122 ceph-mon[125440]: pgmap v2694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:37 smithi136 ceph-mon[125702]: pgmap v2695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:37 smithi057 ceph-mon[92072]: pgmap v2695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:37 smithi122 ceph-mon[125440]: pgmap v2695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:37.771+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:21:37.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:37.772+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:21:37.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:37.772+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:21:37.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:37.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:21:37.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:37.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:21:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:39.063+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:21:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:39.063+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:21:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:39.064+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 43 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:21:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:39.064+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 42 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:21:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:39 smithi136 ceph-mon[125702]: pgmap v2696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:39 smithi057 ceph-mon[92072]: pgmap v2696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:39 smithi122 ceph-mon[125440]: pgmap v2696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:41 smithi136 ceph-mon[125702]: pgmap v2697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:41 smithi057 ceph-mon[92072]: pgmap v2697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:41 smithi122 ceph-mon[125440]: pgmap v2697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:43 smithi136 ceph-mon[125702]: pgmap v2698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:43 smithi057 ceph-mon[92072]: pgmap v2698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:43 smithi122 ceph-mon[125440]: pgmap v2698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:45 smithi136 ceph-mon[125702]: pgmap v2699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:45 smithi057 ceph-mon[92072]: pgmap v2699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:45 smithi122 ceph-mon[125440]: pgmap v2699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:47 smithi136 ceph-mon[125702]: pgmap v2700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:47 smithi057 ceph-mon[92072]: pgmap v2700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:47 smithi122 ceph-mon[125440]: pgmap v2700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:49 smithi136 ceph-mon[125702]: pgmap v2701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:49 smithi057 ceph-mon[92072]: pgmap v2701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:49 smithi122 ceph-mon[125440]: pgmap v2701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:51 smithi136 ceph-mon[125702]: pgmap v2702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:21:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:51 smithi057 ceph-mon[92072]: pgmap v2702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:21:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:51 smithi122 ceph-mon[125440]: pgmap v2702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:21:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:52.777+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:21:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:52.777+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:21:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:52.777+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:21:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:52.777+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:21:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:21:52.778+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:21:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:21:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:21:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:52 smithi136 ceph-mon[125702]: pgmap v2703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:21:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:21:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:21:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:21:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:21:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:52 smithi057 ceph-mon[92072]: pgmap v2703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:21:52.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:21:52.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:21:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:21:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:21:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:52 smithi122 ceph-mon[125440]: pgmap v2703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:21:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:21:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:21:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:55 smithi057 ceph-mon[92072]: pgmap v2704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:55 smithi122 ceph-mon[125440]: pgmap v2704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:55 smithi136 ceph-mon[125702]: pgmap v2704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:57 smithi057 ceph-mon[92072]: pgmap v2705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:57 smithi122 ceph-mon[125440]: pgmap v2705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:57 smithi136 ceph-mon[125702]: pgmap v2705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:21:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:21:59 smithi057 ceph-mon[92072]: pgmap v2706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:21:59 smithi122 ceph-mon[125440]: pgmap v2706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:21:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:21:59 smithi136 ceph-mon[125702]: pgmap v2706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:01 smithi057 ceph-mon[92072]: pgmap v2707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:01 smithi122 ceph-mon[125440]: pgmap v2707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:01 smithi136 ceph-mon[125702]: pgmap v2707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:03 smithi057 ceph-mon[92072]: pgmap v2708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:22:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:03 smithi122 ceph-mon[125440]: pgmap v2708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:22:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:03 smithi136 ceph-mon[125702]: pgmap v2708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:22:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:05 smithi057 ceph-mon[92072]: pgmap v2709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:22:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:05 smithi122 ceph-mon[125440]: pgmap v2709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:22:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:05 smithi136 ceph-mon[125702]: pgmap v2709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:22:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:07 smithi057 ceph-mon[92072]: pgmap v2710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:22:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:07 smithi122 ceph-mon[125440]: pgmap v2710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:22:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:07 smithi136 ceph-mon[125702]: pgmap v2710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:22:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:07.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:22:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:07.785+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:22:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:07.785+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:22:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:07.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:22:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:07.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:22:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:09 smithi057 ceph-mon[92072]: pgmap v2711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:22:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:09 smithi122 ceph-mon[125440]: pgmap v2711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:22:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:09 smithi136 ceph-mon[125702]: pgmap v2711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:22:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:11 smithi057 ceph-mon[92072]: pgmap v2712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:22:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:11 smithi057 ceph-mon[92072]: osdmap e243: 12 total, 12 up, 12 in 2023-03-02T12:22:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:11 smithi122 ceph-mon[125440]: pgmap v2712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:22:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:11 smithi122 ceph-mon[125440]: osdmap e243: 12 total, 12 up, 12 in 2023-03-02T12:22:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:11 smithi136 ceph-mon[125702]: pgmap v2712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:22:11.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:11 smithi136 ceph-mon[125702]: osdmap e243: 12 total, 12 up, 12 in 2023-03-02T12:22:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:13 smithi122 ceph-mon[125440]: pgmap v2714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:22:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:13 smithi136 ceph-mon[125702]: pgmap v2714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:22:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:13 smithi057 ceph-mon[92072]: pgmap v2714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:22:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:15 smithi122 ceph-mon[125440]: pgmap v2715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:22:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:15 smithi122 ceph-mon[125440]: osdmap e244: 12 total, 12 up, 12 in 2023-03-02T12:22:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:15 smithi136 ceph-mon[125702]: pgmap v2715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:22:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:15 smithi136 ceph-mon[125702]: osdmap e244: 12 total, 12 up, 12 in 2023-03-02T12:22:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:15 smithi057 ceph-mon[92072]: pgmap v2715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:22:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:15 smithi057 ceph-mon[92072]: osdmap e244: 12 total, 12 up, 12 in 2023-03-02T12:22:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:17 smithi122 ceph-mon[125440]: pgmap v2717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:22:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:17 smithi136 ceph-mon[125702]: pgmap v2717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:22:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:17 smithi057 ceph-mon[92072]: pgmap v2717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:22:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:19 smithi122 ceph-mon[125440]: pgmap v2718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:19 smithi136 ceph-mon[125702]: pgmap v2718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:22:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:19 smithi057 ceph-mon[92072]: pgmap v2718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:22:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:21 smithi122 ceph-mon[125440]: pgmap v2719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:22:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:21 smithi136 ceph-mon[125702]: pgmap v2719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:22:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:21 smithi057 ceph-mon[92072]: pgmap v2719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:22:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:22.800+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:22:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:22.800+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:22:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:22.800+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:22:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:22.800+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:22:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:22.800+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:22:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:23 smithi136 ceph-mon[125702]: pgmap v2720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:22:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:23 smithi057 ceph-mon[92072]: pgmap v2720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:22:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:23 smithi122 ceph-mon[125440]: pgmap v2720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:22:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:25 smithi136 ceph-mon[125702]: pgmap v2721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:22:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:25 smithi057 ceph-mon[92072]: pgmap v2721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:22:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:25 smithi122 ceph-mon[125440]: pgmap v2721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:22:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:27 smithi136 ceph-mon[125702]: pgmap v2722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:22:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:27 smithi057 ceph-mon[92072]: pgmap v2722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:22:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:27 smithi122 ceph-mon[125440]: pgmap v2722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:22:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:29 smithi136 ceph-mon[125702]: pgmap v2723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:22:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:29 smithi057 ceph-mon[92072]: pgmap v2723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:22:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:29 smithi122 ceph-mon[125440]: pgmap v2723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:22:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:31 smithi136 ceph-mon[125702]: pgmap v2724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:31 smithi057 ceph-mon[92072]: pgmap v2724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:31 smithi122 ceph-mon[125440]: pgmap v2724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:33 smithi136 ceph-mon[125702]: pgmap v2725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:33 smithi057 ceph-mon[92072]: pgmap v2725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:33 smithi122 ceph-mon[125440]: pgmap v2725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:35 smithi136 ceph-mon[125702]: pgmap v2726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:35 smithi057 ceph-mon[92072]: pgmap v2726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:35 smithi122 ceph-mon[125440]: pgmap v2726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:37 smithi136 ceph-mon[125702]: pgmap v2727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:37 smithi057 ceph-mon[92072]: pgmap v2727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:37 smithi122 ceph-mon[125440]: pgmap v2727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:37.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:22:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:37.803+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:22:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:37.803+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:22:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:37.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:22:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:37.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:22:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:39 smithi136 ceph-mon[125702]: pgmap v2728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:39 smithi057 ceph-mon[92072]: pgmap v2728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:39 smithi122 ceph-mon[125440]: pgmap v2728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:41 smithi136 ceph-mon[125702]: pgmap v2729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:41 smithi057 ceph-mon[92072]: pgmap v2729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:41 smithi122 ceph-mon[125440]: pgmap v2729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:43 smithi136 ceph-mon[125702]: pgmap v2730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:43 smithi057 ceph-mon[92072]: pgmap v2730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:43 smithi122 ceph-mon[125440]: pgmap v2730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:45 smithi136 ceph-mon[125702]: pgmap v2731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:45 smithi057 ceph-mon[92072]: pgmap v2731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:45 smithi122 ceph-mon[125440]: pgmap v2731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:47 smithi136 ceph-mon[125702]: pgmap v2732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:47 smithi057 ceph-mon[92072]: pgmap v2732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:47 smithi122 ceph-mon[125440]: pgmap v2732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:49.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:49 smithi136 ceph-mon[125702]: pgmap v2733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:49 smithi057 ceph-mon[92072]: pgmap v2733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:49 smithi122 ceph-mon[125440]: pgmap v2733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:51 smithi136 ceph-mon[125702]: pgmap v2734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:51 smithi057 ceph-mon[92072]: pgmap v2734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:51 smithi122 ceph-mon[125440]: pgmap v2734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:52.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:22:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:52.818+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:22:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:52.818+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:22:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:52.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:22:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:22:52.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:22:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:53 smithi136 ceph-mon[125702]: pgmap v2735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:22:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:53 smithi057 ceph-mon[92072]: pgmap v2735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:22:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:53 smithi122 ceph-mon[125440]: pgmap v2735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:22:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:53.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:53.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:22:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:22:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:22:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:22:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:22:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:22:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:22:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:55 smithi136 ceph-mon[125702]: pgmap v2736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:55 smithi057 ceph-mon[92072]: pgmap v2736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:55 smithi122 ceph-mon[125440]: pgmap v2736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:57 smithi136 ceph-mon[125702]: pgmap v2737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:57 smithi057 ceph-mon[92072]: pgmap v2737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:57 smithi122 ceph-mon[125440]: pgmap v2737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:22:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:22:59 smithi136 ceph-mon[125702]: pgmap v2738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:22:59 smithi057 ceph-mon[92072]: pgmap v2738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:22:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:22:59 smithi122 ceph-mon[125440]: pgmap v2738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:01 smithi136 ceph-mon[125702]: pgmap v2739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:01 smithi057 ceph-mon[92072]: pgmap v2739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:01 smithi122 ceph-mon[125440]: pgmap v2739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:03 smithi136 ceph-mon[125702]: pgmap v2740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:23:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:03 smithi057 ceph-mon[92072]: pgmap v2740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:23:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:03 smithi122 ceph-mon[125440]: pgmap v2740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:23:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:05 smithi136 ceph-mon[125702]: pgmap v2741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:23:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:05 smithi057 ceph-mon[92072]: pgmap v2741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:23:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:05 smithi122 ceph-mon[125440]: pgmap v2741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:23:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:07 smithi136 ceph-mon[125702]: pgmap v2742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:23:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:07 smithi057 ceph-mon[92072]: pgmap v2742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:23:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:07 smithi122 ceph-mon[125440]: pgmap v2742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:23:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:07.831+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:23:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:07.832+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:07.832+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:07.832+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:07.832+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:23:09.077 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:09.076+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:23:09.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:09.076+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:23:09.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:09.076+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 44 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:23:09.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:09.077+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 43 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:23:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:09 smithi136 ceph-mon[125702]: pgmap v2743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:23:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:09 smithi057 ceph-mon[92072]: pgmap v2743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:23:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:09 smithi122 ceph-mon[125440]: pgmap v2743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:23:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:11 smithi136 ceph-mon[125702]: pgmap v2744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:23:11.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:11 smithi136 ceph-mon[125702]: osdmap e245: 12 total, 12 up, 12 in 2023-03-02T12:23:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:11 smithi057 ceph-mon[92072]: pgmap v2744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:23:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:11 smithi057 ceph-mon[92072]: osdmap e245: 12 total, 12 up, 12 in 2023-03-02T12:23:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:11 smithi122 ceph-mon[125440]: pgmap v2744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:23:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:11 smithi122 ceph-mon[125440]: osdmap e245: 12 total, 12 up, 12 in 2023-03-02T12:23:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:13 smithi136 ceph-mon[125702]: pgmap v2746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:23:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:13 smithi057 ceph-mon[92072]: pgmap v2746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:23:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:13 smithi122 ceph-mon[125440]: pgmap v2746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:23:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:15 smithi136 ceph-mon[125702]: pgmap v2747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:23:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:15 smithi136 ceph-mon[125702]: osdmap e246: 12 total, 12 up, 12 in 2023-03-02T12:23:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:15 smithi057 ceph-mon[92072]: pgmap v2747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:23:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:15 smithi057 ceph-mon[92072]: osdmap e246: 12 total, 12 up, 12 in 2023-03-02T12:23:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:15 smithi122 ceph-mon[125440]: pgmap v2747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:23:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:15 smithi122 ceph-mon[125440]: osdmap e246: 12 total, 12 up, 12 in 2023-03-02T12:23:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:17 smithi057 ceph-mon[92072]: pgmap v2749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:23:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:17 smithi122 ceph-mon[125440]: pgmap v2749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:23:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:17 smithi136 ceph-mon[125702]: pgmap v2749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:23:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:19 smithi057 ceph-mon[92072]: pgmap v2750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:23:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:19 smithi122 ceph-mon[125440]: pgmap v2750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:23:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:19 smithi136 ceph-mon[125702]: pgmap v2750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:23:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:21 smithi057 ceph-mon[92072]: pgmap v2751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T12:23:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:21 smithi122 ceph-mon[125440]: pgmap v2751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T12:23:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:21 smithi136 ceph-mon[125702]: pgmap v2751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T12:23:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:22.845+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:23:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:22.845+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:23:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:22.845+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:23:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:22.845+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:23:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:22.845+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:23:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:23 smithi057 ceph-mon[92072]: pgmap v2752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:23:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:23 smithi122 ceph-mon[125440]: pgmap v2752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:23:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:23 smithi136 ceph-mon[125702]: pgmap v2752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:23:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:25 smithi057 ceph-mon[92072]: pgmap v2753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:23:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:25 smithi122 ceph-mon[125440]: pgmap v2753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:23:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:25 smithi136 ceph-mon[125702]: pgmap v2753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:23:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:27 smithi057 ceph-mon[92072]: pgmap v2754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:23:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:27 smithi122 ceph-mon[125440]: pgmap v2754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:23:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:27 smithi136 ceph-mon[125702]: pgmap v2754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:23:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:29 smithi057 ceph-mon[92072]: pgmap v2755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:23:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:29 smithi122 ceph-mon[125440]: pgmap v2755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:23:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:29 smithi136 ceph-mon[125702]: pgmap v2755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:23:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:31 smithi057 ceph-mon[92072]: pgmap v2756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:31 smithi122 ceph-mon[125440]: pgmap v2756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:31 smithi136 ceph-mon[125702]: pgmap v2756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:33 smithi057 ceph-mon[92072]: pgmap v2757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:33 smithi122 ceph-mon[125440]: pgmap v2757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:33 smithi136 ceph-mon[125702]: pgmap v2757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:35 smithi057 ceph-mon[92072]: pgmap v2758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:35 smithi122 ceph-mon[125440]: pgmap v2758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:35 smithi136 ceph-mon[125702]: pgmap v2758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:37 smithi057 ceph-mon[92072]: pgmap v2759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:37 smithi122 ceph-mon[125440]: pgmap v2759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:37 smithi136 ceph-mon[125702]: pgmap v2759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:37.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:23:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:37.847+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:23:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:37.847+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:23:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:37.847+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:23:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:37.847+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:23:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:39 smithi057 ceph-mon[92072]: pgmap v2760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:39 smithi122 ceph-mon[125440]: pgmap v2760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:39 smithi136 ceph-mon[125702]: pgmap v2760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:41 smithi057 ceph-mon[92072]: pgmap v2761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:41 smithi122 ceph-mon[125440]: pgmap v2761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:41 smithi136 ceph-mon[125702]: pgmap v2761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:43 smithi057 ceph-mon[92072]: pgmap v2762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:43 smithi122 ceph-mon[125440]: pgmap v2762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:43 smithi136 ceph-mon[125702]: pgmap v2762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:45 smithi057 ceph-mon[92072]: pgmap v2763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:45 smithi122 ceph-mon[125440]: pgmap v2763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:45 smithi136 ceph-mon[125702]: pgmap v2763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:46 smithi057 ceph-mon[92072]: pgmap v2764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:46 smithi122 ceph-mon[125440]: pgmap v2764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:46 smithi136 ceph-mon[125702]: pgmap v2764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:49 smithi057 ceph-mon[92072]: pgmap v2765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:49 smithi122 ceph-mon[125440]: pgmap v2765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:49.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:49 smithi136 ceph-mon[125702]: pgmap v2765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:51 smithi057 ceph-mon[92072]: pgmap v2766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:51 smithi122 ceph-mon[125440]: pgmap v2766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:51 smithi136 ceph-mon[125702]: pgmap v2766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:52.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:23:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:52.857+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:23:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:52.857+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:23:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:52.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:23:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:23:52.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:23:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:53 smithi057 ceph-mon[92072]: pgmap v2767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:53 smithi122 ceph-mon[125440]: pgmap v2767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:53 smithi136 ceph-mon[125702]: pgmap v2767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:23:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:23:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:23:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:55 smithi057 ceph-mon[92072]: pgmap v2768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:23:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:23:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:23:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:55 smithi122 ceph-mon[125440]: pgmap v2768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:23:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:23:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:23:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:55 smithi136 ceph-mon[125702]: pgmap v2768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:23:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:23:55.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:23:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:57 smithi122 ceph-mon[125440]: pgmap v2769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:57 smithi136 ceph-mon[125702]: pgmap v2769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:57 smithi057 ceph-mon[92072]: pgmap v2769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:23:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:23:59 smithi122 ceph-mon[125440]: pgmap v2770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:23:59 smithi136 ceph-mon[125702]: pgmap v2770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:23:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:23:59 smithi057 ceph-mon[92072]: pgmap v2770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:01 smithi122 ceph-mon[125440]: pgmap v2771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:01 smithi136 ceph-mon[125702]: pgmap v2771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:01 smithi057 ceph-mon[92072]: pgmap v2771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:03 smithi136 ceph-mon[125702]: pgmap v2772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:24:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:03 smithi057 ceph-mon[92072]: pgmap v2772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:24:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:03 smithi122 ceph-mon[125440]: pgmap v2772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:24:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:05 smithi136 ceph-mon[125702]: pgmap v2773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:24:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:05 smithi057 ceph-mon[92072]: pgmap v2773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:24:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:05 smithi122 ceph-mon[125440]: pgmap v2773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:24:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:07 smithi136 ceph-mon[125702]: pgmap v2774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:24:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:07 smithi057 ceph-mon[92072]: pgmap v2774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:24:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:07 smithi122 ceph-mon[125440]: pgmap v2774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:24:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:07.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:24:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:07.867+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:24:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:07.867+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:24:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:07.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:24:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:07.868+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:24:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:09 smithi136 ceph-mon[125702]: pgmap v2775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:24:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:09 smithi057 ceph-mon[92072]: pgmap v2775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:24:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:09 smithi122 ceph-mon[125440]: pgmap v2775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:24:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:11 smithi136 ceph-mon[125702]: pgmap v2776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:24:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:11 smithi136 ceph-mon[125702]: osdmap e247: 12 total, 12 up, 12 in 2023-03-02T12:24:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:11 smithi057 ceph-mon[92072]: pgmap v2776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:24:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:11 smithi057 ceph-mon[92072]: osdmap e247: 12 total, 12 up, 12 in 2023-03-02T12:24:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:11 smithi122 ceph-mon[125440]: pgmap v2776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:24:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:11 smithi122 ceph-mon[125440]: osdmap e247: 12 total, 12 up, 12 in 2023-03-02T12:24:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:13 smithi136 ceph-mon[125702]: pgmap v2778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:24:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:13 smithi057 ceph-mon[92072]: pgmap v2778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:24:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:13 smithi122 ceph-mon[125440]: pgmap v2778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:24:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:15 smithi136 ceph-mon[125702]: pgmap v2779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:24:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:15 smithi136 ceph-mon[125702]: osdmap e248: 12 total, 12 up, 12 in 2023-03-02T12:24:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:15 smithi057 ceph-mon[92072]: pgmap v2779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:24:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:15 smithi057 ceph-mon[92072]: osdmap e248: 12 total, 12 up, 12 in 2023-03-02T12:24:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:15 smithi122 ceph-mon[125440]: pgmap v2779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:24:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:15 smithi122 ceph-mon[125440]: osdmap e248: 12 total, 12 up, 12 in 2023-03-02T12:24:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:17 smithi136 ceph-mon[125702]: pgmap v2781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:24:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:17 smithi057 ceph-mon[92072]: pgmap v2781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:24:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:17 smithi122 ceph-mon[125440]: pgmap v2781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:24:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:19 smithi136 ceph-mon[125702]: pgmap v2782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:24:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:19 smithi057 ceph-mon[92072]: pgmap v2782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:24:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:19 smithi122 ceph-mon[125440]: pgmap v2782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:24:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:21 smithi136 ceph-mon[125702]: pgmap v2783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:24:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:21 smithi057 ceph-mon[92072]: pgmap v2783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:24:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:21 smithi122 ceph-mon[125440]: pgmap v2783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:24:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:22.883+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:24:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:22.883+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:24:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:22.883+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:24:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:22.883+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:24:22.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:22.883+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:24:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:23 smithi136 ceph-mon[125702]: pgmap v2784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:24:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:23 smithi057 ceph-mon[92072]: pgmap v2784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:24:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:23 smithi122 ceph-mon[125440]: pgmap v2784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:24:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:25 smithi136 ceph-mon[125702]: pgmap v2785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:24:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:25 smithi057 ceph-mon[92072]: pgmap v2785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:24:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:25 smithi122 ceph-mon[125440]: pgmap v2785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:24:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:27 smithi136 ceph-mon[125702]: pgmap v2786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:24:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:27 smithi057 ceph-mon[92072]: pgmap v2786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:24:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:27 smithi122 ceph-mon[125440]: pgmap v2786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:24:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:29 smithi136 ceph-mon[125702]: pgmap v2787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:24:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:29 smithi057 ceph-mon[92072]: pgmap v2787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:24:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:29 smithi122 ceph-mon[125440]: pgmap v2787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:24:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:31 smithi136 ceph-mon[125702]: pgmap v2788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:31 smithi057 ceph-mon[92072]: pgmap v2788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:31 smithi122 ceph-mon[125440]: pgmap v2788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:33 smithi136 ceph-mon[125702]: pgmap v2789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:33 smithi057 ceph-mon[92072]: pgmap v2789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:33 smithi122 ceph-mon[125440]: pgmap v2789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:35 smithi136 ceph-mon[125702]: pgmap v2790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:24:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:35 smithi057 ceph-mon[92072]: pgmap v2790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:24:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:35 smithi122 ceph-mon[125440]: pgmap v2790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:24:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:37 smithi136 ceph-mon[125702]: pgmap v2791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:24:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:37 smithi057 ceph-mon[92072]: pgmap v2791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:24:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:37 smithi122 ceph-mon[125440]: pgmap v2791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:24:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:37.896+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:24:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:37.896+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:24:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:37.896+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:24:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:37.896+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:24:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:37.896+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:24:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:39 smithi136 ceph-mon[125702]: pgmap v2792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:39 smithi057 ceph-mon[92072]: pgmap v2792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:39 smithi122 ceph-mon[125440]: pgmap v2792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:41 smithi136 ceph-mon[125702]: pgmap v2793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:24:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:41 smithi057 ceph-mon[92072]: pgmap v2793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:24:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:41 smithi122 ceph-mon[125440]: pgmap v2793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:24:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:43 smithi136 ceph-mon[125702]: pgmap v2794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:43 smithi057 ceph-mon[92072]: pgmap v2794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:43 smithi122 ceph-mon[125440]: pgmap v2794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:45 smithi136 ceph-mon[125702]: pgmap v2795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:45 smithi057 ceph-mon[92072]: pgmap v2795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:45 smithi122 ceph-mon[125440]: pgmap v2795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:47 smithi136 ceph-mon[125702]: pgmap v2796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:47 smithi057 ceph-mon[92072]: pgmap v2796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:47 smithi122 ceph-mon[125440]: pgmap v2796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:49 smithi057 ceph-mon[92072]: pgmap v2797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:49 smithi122 ceph-mon[125440]: pgmap v2797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:49 smithi136 ceph-mon[125702]: pgmap v2797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:51 smithi057 ceph-mon[92072]: pgmap v2798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:51 smithi122 ceph-mon[125440]: pgmap v2798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:51 smithi136 ceph-mon[125702]: pgmap v2798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:52.907+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:24:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:52.907+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:24:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:52.907+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:24:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:52.907+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:24:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:24:52.907+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:24:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:53 smithi057 ceph-mon[92072]: pgmap v2799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:53 smithi122 ceph-mon[125440]: pgmap v2799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:53 smithi136 ceph-mon[125702]: pgmap v2799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:55 smithi057 ceph-mon[92072]: pgmap v2800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:24:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:55 smithi122 ceph-mon[125440]: pgmap v2800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:24:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:55 smithi136 ceph-mon[125702]: pgmap v2800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:24:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:24:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:24:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:24:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:24:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:24:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:24:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:24:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:24:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:24:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:57 smithi057 ceph-mon[92072]: pgmap v2801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:57 smithi122 ceph-mon[125440]: pgmap v2801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:57 smithi136 ceph-mon[125702]: pgmap v2801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:24:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:24:59 smithi057 ceph-mon[92072]: pgmap v2802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:24:59 smithi122 ceph-mon[125440]: pgmap v2802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:24:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:24:59 smithi136 ceph-mon[125702]: pgmap v2802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:01 smithi057 ceph-mon[92072]: pgmap v2803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:01 smithi122 ceph-mon[125440]: pgmap v2803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:01 smithi136 ceph-mon[125702]: pgmap v2803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:03 smithi057 ceph-mon[92072]: pgmap v2804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:25:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:03 smithi122 ceph-mon[125440]: pgmap v2804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:25:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:03 smithi136 ceph-mon[125702]: pgmap v2804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:25:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:05 smithi057 ceph-mon[92072]: pgmap v2805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:25:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:05 smithi122 ceph-mon[125440]: pgmap v2805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:25:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:05 smithi136 ceph-mon[125702]: pgmap v2805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:25:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:07 smithi057 ceph-mon[92072]: pgmap v2806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:25:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:07 smithi122 ceph-mon[125440]: pgmap v2806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:25:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:07 smithi136 ceph-mon[125702]: pgmap v2806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:25:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:07.909+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:25:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:07.909+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:25:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:07.909+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:25:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:07.909+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:25:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:07.909+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:25:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:09 smithi057 ceph-mon[92072]: pgmap v2807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:25:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:09 smithi122 ceph-mon[125440]: pgmap v2807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:25:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:09 smithi136 ceph-mon[125702]: pgmap v2807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:25:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:11 smithi057 ceph-mon[92072]: pgmap v2808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:25:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:11 smithi057 ceph-mon[92072]: osdmap e249: 12 total, 12 up, 12 in 2023-03-02T12:25:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:11 smithi122 ceph-mon[125440]: pgmap v2808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:25:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:11 smithi122 ceph-mon[125440]: osdmap e249: 12 total, 12 up, 12 in 2023-03-02T12:25:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:11 smithi136 ceph-mon[125702]: pgmap v2808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:25:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:11 smithi136 ceph-mon[125702]: osdmap e249: 12 total, 12 up, 12 in 2023-03-02T12:25:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:13 smithi057 ceph-mon[92072]: pgmap v2810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:13 smithi122 ceph-mon[125440]: pgmap v2810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:13 smithi136 ceph-mon[125702]: pgmap v2810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:14 smithi057 ceph-mon[92072]: pgmap v2811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:14 smithi122 ceph-mon[125440]: pgmap v2811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:14 smithi136 ceph-mon[125702]: pgmap v2811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:16 smithi122 ceph-mon[125440]: osdmap e250: 12 total, 12 up, 12 in 2023-03-02T12:25:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:16 smithi136 ceph-mon[125702]: osdmap e250: 12 total, 12 up, 12 in 2023-03-02T12:25:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:16 smithi057 ceph-mon[92072]: osdmap e250: 12 total, 12 up, 12 in 2023-03-02T12:25:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:17 smithi136 ceph-mon[125702]: pgmap v2813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:25:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:17 smithi057 ceph-mon[92072]: pgmap v2813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:25:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:17 smithi122 ceph-mon[125440]: pgmap v2813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:25:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:19 smithi136 ceph-mon[125702]: pgmap v2814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:25:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:19 smithi057 ceph-mon[92072]: pgmap v2814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:25:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:19 smithi122 ceph-mon[125440]: pgmap v2814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:25:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:21 smithi136 ceph-mon[125702]: pgmap v2815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 316 B/s wr, 10 op/s 2023-03-02T12:25:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:21 smithi057 ceph-mon[92072]: pgmap v2815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 316 B/s wr, 10 op/s 2023-03-02T12:25:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:21 smithi122 ceph-mon[125440]: pgmap v2815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 316 B/s wr, 10 op/s 2023-03-02T12:25:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:22.918+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:25:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:22.919+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:25:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:22.919+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:25:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:22.919+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:25:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:22.919+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:25:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:23 smithi136 ceph-mon[125702]: pgmap v2816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:23 smithi057 ceph-mon[92072]: pgmap v2816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:23 smithi122 ceph-mon[125440]: pgmap v2816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:25 smithi136 ceph-mon[125702]: pgmap v2817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:25 smithi057 ceph-mon[92072]: pgmap v2817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:25 smithi122 ceph-mon[125440]: pgmap v2817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:25:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:27 smithi136 ceph-mon[125702]: pgmap v2818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:25:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:27 smithi057 ceph-mon[92072]: pgmap v2818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:25:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:27 smithi122 ceph-mon[125440]: pgmap v2818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:25:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:29 smithi136 ceph-mon[125702]: pgmap v2819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:25:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:29 smithi057 ceph-mon[92072]: pgmap v2819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:25:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:29 smithi122 ceph-mon[125440]: pgmap v2819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:25:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:31 smithi136 ceph-mon[125702]: pgmap v2820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:31 smithi057 ceph-mon[92072]: pgmap v2820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:31 smithi122 ceph-mon[125440]: pgmap v2820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:33 smithi136 ceph-mon[125702]: pgmap v2821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:33 smithi057 ceph-mon[92072]: pgmap v2821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:33 smithi122 ceph-mon[125440]: pgmap v2821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:35 smithi136 ceph-mon[125702]: pgmap v2822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:35 smithi057 ceph-mon[92072]: pgmap v2822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:35 smithi122 ceph-mon[125440]: pgmap v2822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:37 smithi136 ceph-mon[125702]: pgmap v2823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:37 smithi057 ceph-mon[92072]: pgmap v2823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:37 smithi122 ceph-mon[125440]: pgmap v2823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:37.934+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:25:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:37.934+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:25:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:37.934+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:25:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:37.934+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:25:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:37.934+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:25:39.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:39 smithi136 ceph-mon[125702]: pgmap v2824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:39 smithi057 ceph-mon[92072]: pgmap v2824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:39 smithi122 ceph-mon[125440]: pgmap v2824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:41 smithi136 ceph-mon[125702]: pgmap v2825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:41 smithi057 ceph-mon[92072]: pgmap v2825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:41 smithi122 ceph-mon[125440]: pgmap v2825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:43 smithi136 ceph-mon[125702]: pgmap v2826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:43 smithi057 ceph-mon[92072]: pgmap v2826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:43 smithi122 ceph-mon[125440]: pgmap v2826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:45 smithi136 ceph-mon[125702]: pgmap v2827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:45 smithi057 ceph-mon[92072]: pgmap v2827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:45 smithi122 ceph-mon[125440]: pgmap v2827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:47 smithi136 ceph-mon[125702]: pgmap v2828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:47 smithi057 ceph-mon[92072]: pgmap v2828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:47 smithi122 ceph-mon[125440]: pgmap v2828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:49 smithi136 ceph-mon[125702]: pgmap v2829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:49 smithi057 ceph-mon[92072]: pgmap v2829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:49 smithi122 ceph-mon[125440]: pgmap v2829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:51 smithi136 ceph-mon[125702]: pgmap v2830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:51 smithi057 ceph-mon[92072]: pgmap v2830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:51 smithi122 ceph-mon[125440]: pgmap v2830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:52.950+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:25:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:52.951+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:25:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:52.951+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:25:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:52.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:25:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:25:52.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:25:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:53 smithi136 ceph-mon[125702]: pgmap v2831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:53 smithi057 ceph-mon[92072]: pgmap v2831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:53 smithi122 ceph-mon[125440]: pgmap v2831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:55 smithi136 ceph-mon[125702]: pgmap v2832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:55 smithi057 ceph-mon[92072]: pgmap v2832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:55 smithi122 ceph-mon[125440]: pgmap v2832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:25:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:25:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:25:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:57 smithi136 ceph-mon[125702]: pgmap v2833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:57.634 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:57 smithi057 ceph-mon[92072]: pgmap v2833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:57 smithi122 ceph-mon[125440]: pgmap v2833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:25:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:59 smithi057 ceph-mon[92072]: pgmap v2834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:25:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:25:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:25:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:59 smithi122 ceph-mon[125440]: pgmap v2834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:25:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:25:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:25:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:59 smithi136 ceph-mon[125702]: pgmap v2834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:25:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:25:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:25:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:26:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:26:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:26:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:26:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:26:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:26:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:26:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:26:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:26:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:26:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:01 smithi057 ceph-mon[92072]: pgmap v2835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:01 smithi122 ceph-mon[125440]: pgmap v2835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:01 smithi136 ceph-mon[125702]: pgmap v2835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:03 smithi057 ceph-mon[92072]: pgmap v2836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:26:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:03 smithi122 ceph-mon[125440]: pgmap v2836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:26:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:03 smithi136 ceph-mon[125702]: pgmap v2836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:26:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:05 smithi057 ceph-mon[92072]: pgmap v2837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:26:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:05 smithi122 ceph-mon[125440]: pgmap v2837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:26:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:05 smithi136 ceph-mon[125702]: pgmap v2837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:26:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:07 smithi057 ceph-mon[92072]: pgmap v2838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:26:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:07 smithi122 ceph-mon[125440]: pgmap v2838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:26:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:07 smithi136 ceph-mon[125702]: pgmap v2838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:26:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:07.966+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:26:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:07.967+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:26:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:07.967+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:26:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:07.967+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:26:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:07.967+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:26:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:09.102+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:26:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:09.102+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:26:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:09.103+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 44 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:26:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:09.103+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 45 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:26:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:09 smithi057 ceph-mon[92072]: pgmap v2839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:26:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:09 smithi122 ceph-mon[125440]: pgmap v2839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:26:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:09 smithi136 ceph-mon[125702]: pgmap v2839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:26:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:11 smithi057 ceph-mon[92072]: pgmap v2840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:26:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:11 smithi057 ceph-mon[92072]: osdmap e251: 12 total, 12 up, 12 in 2023-03-02T12:26:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:11 smithi122 ceph-mon[125440]: pgmap v2840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:26:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:11 smithi122 ceph-mon[125440]: osdmap e251: 12 total, 12 up, 12 in 2023-03-02T12:26:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:11 smithi136 ceph-mon[125702]: pgmap v2840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:26:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:11 smithi136 ceph-mon[125702]: osdmap e251: 12 total, 12 up, 12 in 2023-03-02T12:26:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:13 smithi057 ceph-mon[92072]: pgmap v2842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:26:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:13 smithi122 ceph-mon[125440]: pgmap v2842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:26:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:13 smithi136 ceph-mon[125702]: pgmap v2842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:26:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:15 smithi057 ceph-mon[92072]: pgmap v2843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:26:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:15 smithi057 ceph-mon[92072]: osdmap e252: 12 total, 12 up, 12 in 2023-03-02T12:26:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:15 smithi122 ceph-mon[125440]: pgmap v2843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:26:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:15 smithi122 ceph-mon[125440]: osdmap e252: 12 total, 12 up, 12 in 2023-03-02T12:26:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:15 smithi136 ceph-mon[125702]: pgmap v2843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:26:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:15 smithi136 ceph-mon[125702]: osdmap e252: 12 total, 12 up, 12 in 2023-03-02T12:26:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:17 smithi057 ceph-mon[92072]: pgmap v2845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:26:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:17 smithi122 ceph-mon[125440]: pgmap v2845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:26:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:17 smithi136 ceph-mon[125702]: pgmap v2845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:26:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:19 smithi057 ceph-mon[92072]: pgmap v2846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:26:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:19 smithi122 ceph-mon[125440]: pgmap v2846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:26:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:19 smithi136 ceph-mon[125702]: pgmap v2846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:26:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:21 smithi057 ceph-mon[92072]: pgmap v2847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T12:26:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:21 smithi122 ceph-mon[125440]: pgmap v2847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T12:26:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:21 smithi136 ceph-mon[125702]: pgmap v2847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T12:26:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:22.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:26:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:22.982+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:26:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:22.982+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:26:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:22.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:26:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:22.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:26:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:23 smithi057 ceph-mon[92072]: pgmap v2848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:26:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:23 smithi122 ceph-mon[125440]: pgmap v2848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:26:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:23 smithi136 ceph-mon[125702]: pgmap v2848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:26:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:25 smithi057 ceph-mon[92072]: pgmap v2849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:26:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:25 smithi122 ceph-mon[125440]: pgmap v2849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:26:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:25 smithi136 ceph-mon[125702]: pgmap v2849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:26:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:26 smithi057 ceph-mon[92072]: pgmap v2850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:26:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:26 smithi122 ceph-mon[125440]: pgmap v2850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:26:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:26 smithi136 ceph-mon[125702]: pgmap v2850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:26:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:29 smithi122 ceph-mon[125440]: pgmap v2851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:26:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:29 smithi136 ceph-mon[125702]: pgmap v2851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:26:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:29 smithi057 ceph-mon[92072]: pgmap v2851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:26:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:31 smithi136 ceph-mon[125702]: pgmap v2852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:31 smithi057 ceph-mon[92072]: pgmap v2852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:31 smithi122 ceph-mon[125440]: pgmap v2852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:33 smithi136 ceph-mon[125702]: pgmap v2853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:33 smithi057 ceph-mon[92072]: pgmap v2853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:33 smithi122 ceph-mon[125440]: pgmap v2853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:35 smithi136 ceph-mon[125702]: pgmap v2854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:35 smithi057 ceph-mon[92072]: pgmap v2854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:35 smithi122 ceph-mon[125440]: pgmap v2854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:37 smithi136 ceph-mon[125702]: pgmap v2855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:37 smithi057 ceph-mon[92072]: pgmap v2855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:37 smithi122 ceph-mon[125440]: pgmap v2855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:37.997+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:26:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:37.997+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:26:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:37.997+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:26:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:37.997+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:26:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:37.998+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:26:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:39 smithi136 ceph-mon[125702]: pgmap v2856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:39 smithi057 ceph-mon[92072]: pgmap v2856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:39 smithi122 ceph-mon[125440]: pgmap v2856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:41 smithi136 ceph-mon[125702]: pgmap v2857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:41 smithi057 ceph-mon[92072]: pgmap v2857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:41 smithi122 ceph-mon[125440]: pgmap v2857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:43 smithi136 ceph-mon[125702]: pgmap v2858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:43 smithi057 ceph-mon[92072]: pgmap v2858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:43 smithi122 ceph-mon[125440]: pgmap v2858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:45 smithi136 ceph-mon[125702]: pgmap v2859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:45 smithi057 ceph-mon[92072]: pgmap v2859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:45 smithi122 ceph-mon[125440]: pgmap v2859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:47 smithi136 ceph-mon[125702]: pgmap v2860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:47 smithi057 ceph-mon[92072]: pgmap v2860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:47 smithi122 ceph-mon[125440]: pgmap v2860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:49 smithi136 ceph-mon[125702]: pgmap v2861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:49 smithi057 ceph-mon[92072]: pgmap v2861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:49 smithi122 ceph-mon[125440]: pgmap v2861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:51 smithi136 ceph-mon[125702]: pgmap v2862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:51 smithi057 ceph-mon[92072]: pgmap v2862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:51 smithi122 ceph-mon[125440]: pgmap v2862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:53.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:26:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:53.000+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:26:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:53.000+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:26:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:53.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:26:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:26:53.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:26:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:53 smithi136 ceph-mon[125702]: pgmap v2863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:53 smithi057 ceph-mon[92072]: pgmap v2863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:53 smithi122 ceph-mon[125440]: pgmap v2863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:55 smithi136 ceph-mon[125702]: pgmap v2864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:55 smithi057 ceph-mon[92072]: pgmap v2864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:55 smithi122 ceph-mon[125440]: pgmap v2864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:57 smithi136 ceph-mon[125702]: pgmap v2865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:57 smithi057 ceph-mon[92072]: pgmap v2865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:57 smithi122 ceph-mon[125440]: pgmap v2865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:26:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:26:59 smithi136 ceph-mon[125702]: pgmap v2866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:26:59 smithi057 ceph-mon[92072]: pgmap v2866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:26:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:26:59 smithi122 ceph-mon[125440]: pgmap v2866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:27:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:27:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:27:01.397 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:01 smithi122 ceph-mon[125440]: pgmap v2867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:01 smithi136 ceph-mon[125702]: pgmap v2867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:01 smithi057 ceph-mon[92072]: pgmap v2867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:03.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:03 smithi122 ceph-mon[125440]: pgmap v2868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:27:03.584 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:03 smithi136 ceph-mon[125702]: pgmap v2868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:27:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:03 smithi057 ceph-mon[92072]: pgmap v2868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:27:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:27:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:27:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:04 smithi136 ceph-mon[125702]: pgmap v2869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:27:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:27:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:27:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:04 smithi057 ceph-mon[92072]: pgmap v2869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:27:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:27:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:27:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:27:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:04 smithi122 ceph-mon[125440]: pgmap v2869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:27:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:07 smithi136 ceph-mon[125702]: pgmap v2870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:27:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:07 smithi057 ceph-mon[92072]: pgmap v2870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:27:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:07 smithi122 ceph-mon[125440]: pgmap v2870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:27:08.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:08.014+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:27:08.016 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:08.015+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:27:08.016 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:08.015+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:27:08.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:08.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:27:08.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:08.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:27:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:09 smithi136 ceph-mon[125702]: pgmap v2871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:27:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:09 smithi057 ceph-mon[92072]: pgmap v2871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:27:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:09 smithi122 ceph-mon[125440]: pgmap v2871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:27:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:11 smithi136 ceph-mon[125702]: pgmap v2872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:27:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:11 smithi136 ceph-mon[125702]: osdmap e253: 12 total, 12 up, 12 in 2023-03-02T12:27:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:11 smithi057 ceph-mon[92072]: pgmap v2872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:27:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:11 smithi057 ceph-mon[92072]: osdmap e253: 12 total, 12 up, 12 in 2023-03-02T12:27:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:11 smithi122 ceph-mon[125440]: pgmap v2872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:27:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:11 smithi122 ceph-mon[125440]: osdmap e253: 12 total, 12 up, 12 in 2023-03-02T12:27:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:13 smithi136 ceph-mon[125702]: pgmap v2874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:27:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:13 smithi057 ceph-mon[92072]: pgmap v2874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:27:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:13 smithi122 ceph-mon[125440]: pgmap v2874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:27:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:15 smithi136 ceph-mon[125702]: pgmap v2875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:27:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:15 smithi136 ceph-mon[125702]: osdmap e254: 12 total, 12 up, 12 in 2023-03-02T12:27:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:15 smithi057 ceph-mon[92072]: pgmap v2875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:27:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:15 smithi057 ceph-mon[92072]: osdmap e254: 12 total, 12 up, 12 in 2023-03-02T12:27:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:15 smithi122 ceph-mon[125440]: pgmap v2875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:27:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:15 smithi122 ceph-mon[125440]: osdmap e254: 12 total, 12 up, 12 in 2023-03-02T12:27:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:17 smithi136 ceph-mon[125702]: pgmap v2877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:27:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:17 smithi057 ceph-mon[92072]: pgmap v2877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:27:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:17 smithi122 ceph-mon[125440]: pgmap v2877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:27:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:19 smithi136 ceph-mon[125702]: pgmap v2878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:27:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:19 smithi057 ceph-mon[92072]: pgmap v2878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:27:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:19 smithi122 ceph-mon[125440]: pgmap v2878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:27:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:21 smithi136 ceph-mon[125702]: pgmap v2879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:27:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:21 smithi057 ceph-mon[92072]: pgmap v2879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:27:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:21 smithi122 ceph-mon[125440]: pgmap v2879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:27:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:23.030+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:27:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:23.031+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:27:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:23.031+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:27:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:23.031+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:27:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:23.031+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:27:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:23 smithi136 ceph-mon[125702]: pgmap v2880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:27:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:23 smithi057 ceph-mon[92072]: pgmap v2880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:27:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:23 smithi122 ceph-mon[125440]: pgmap v2880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:27:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:25 smithi136 ceph-mon[125702]: pgmap v2881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:27:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:25 smithi057 ceph-mon[92072]: pgmap v2881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:27:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:25 smithi122 ceph-mon[125440]: pgmap v2881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:27:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:27 smithi136 ceph-mon[125702]: pgmap v2882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:27:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:27 smithi057 ceph-mon[92072]: pgmap v2882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:27:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:27 smithi122 ceph-mon[125440]: pgmap v2882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:27:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:29 smithi136 ceph-mon[125702]: pgmap v2883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:27:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:29 smithi057 ceph-mon[92072]: pgmap v2883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:27:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:29 smithi122 ceph-mon[125440]: pgmap v2883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:27:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:31 smithi136 ceph-mon[125702]: pgmap v2884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:31 smithi057 ceph-mon[92072]: pgmap v2884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:31 smithi122 ceph-mon[125440]: pgmap v2884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:33 smithi136 ceph-mon[125702]: pgmap v2885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:33 smithi057 ceph-mon[92072]: pgmap v2885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:33 smithi122 ceph-mon[125440]: pgmap v2885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:35 smithi136 ceph-mon[125702]: pgmap v2886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:35 smithi057 ceph-mon[92072]: pgmap v2886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:35 smithi122 ceph-mon[125440]: pgmap v2886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:37 smithi136 ceph-mon[125702]: pgmap v2887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:37 smithi057 ceph-mon[92072]: pgmap v2887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:37 smithi122 ceph-mon[125440]: pgmap v2887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:38.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:27:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:38.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:27:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:38.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:27:38.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:38.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:27:38.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:38.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:27:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:39 smithi136 ceph-mon[125702]: pgmap v2888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:39 smithi057 ceph-mon[92072]: pgmap v2888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:39.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:39 smithi122 ceph-mon[125440]: pgmap v2888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:41 smithi136 ceph-mon[125702]: pgmap v2889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:41 smithi057 ceph-mon[92072]: pgmap v2889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:41 smithi122 ceph-mon[125440]: pgmap v2889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:43 smithi136 ceph-mon[125702]: pgmap v2890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:43 smithi057 ceph-mon[92072]: pgmap v2890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:43 smithi122 ceph-mon[125440]: pgmap v2890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:45 smithi057 ceph-mon[92072]: pgmap v2891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:45 smithi122 ceph-mon[125440]: pgmap v2891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:45 smithi136 ceph-mon[125702]: pgmap v2891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:47 smithi057 ceph-mon[92072]: pgmap v2892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:47 smithi122 ceph-mon[125440]: pgmap v2892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:47 smithi136 ceph-mon[125702]: pgmap v2892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:49 smithi057 ceph-mon[92072]: pgmap v2893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:49 smithi122 ceph-mon[125440]: pgmap v2893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:49 smithi136 ceph-mon[125702]: pgmap v2893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:51 smithi057 ceph-mon[92072]: pgmap v2894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:51 smithi122 ceph-mon[125440]: pgmap v2894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:51 smithi136 ceph-mon[125702]: pgmap v2894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:53.056+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:27:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:53.056+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:27:53.059 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:53.056+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:27:53.059 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:53.056+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:27:53.059 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:27:53.056+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:27:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:53 smithi057 ceph-mon[92072]: pgmap v2895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:53 smithi122 ceph-mon[125440]: pgmap v2895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:53 smithi136 ceph-mon[125702]: pgmap v2895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:55 smithi057 ceph-mon[92072]: pgmap v2896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:55 smithi122 ceph-mon[125440]: pgmap v2896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:55 smithi136 ceph-mon[125702]: pgmap v2896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:57 smithi057 ceph-mon[92072]: pgmap v2897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:57 smithi122 ceph-mon[125440]: pgmap v2897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:57 smithi136 ceph-mon[125702]: pgmap v2897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:27:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:27:59 smithi057 ceph-mon[92072]: pgmap v2898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:27:59 smithi122 ceph-mon[125440]: pgmap v2898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:27:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:27:59 smithi136 ceph-mon[125702]: pgmap v2898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:01 smithi057 ceph-mon[92072]: pgmap v2899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:01 smithi122 ceph-mon[125440]: pgmap v2899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:01 smithi136 ceph-mon[125702]: pgmap v2899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:03 smithi057 ceph-mon[92072]: pgmap v2900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:28:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:03 smithi122 ceph-mon[125440]: pgmap v2900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:28:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:03 smithi136 ceph-mon[125702]: pgmap v2900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:28:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:28:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:28:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:28:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:05 smithi057 ceph-mon[92072]: pgmap v2901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:28:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:28:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:28:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:28:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:05 smithi122 ceph-mon[125440]: pgmap v2901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:28:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:28:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:28:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:28:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:05 smithi136 ceph-mon[125702]: pgmap v2901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:28:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:28:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:28:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:28:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:07 smithi057 ceph-mon[92072]: pgmap v2902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:28:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:07 smithi122 ceph-mon[125440]: pgmap v2902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:28:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:07 smithi136 ceph-mon[125702]: pgmap v2902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:28:08.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:08.063+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:28:08.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:08.064+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:28:08.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:08.064+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:28:08.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:08.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:28:08.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:08.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:28:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:09 smithi057 ceph-mon[92072]: pgmap v2903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:28:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:09 smithi122 ceph-mon[125440]: pgmap v2903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:28:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:09 smithi136 ceph-mon[125702]: pgmap v2903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:28:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:11 smithi057 ceph-mon[92072]: pgmap v2904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:28:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:11 smithi057 ceph-mon[92072]: osdmap e255: 12 total, 12 up, 12 in 2023-03-02T12:28:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:11 smithi122 ceph-mon[125440]: pgmap v2904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:28:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:11 smithi122 ceph-mon[125440]: osdmap e255: 12 total, 12 up, 12 in 2023-03-02T12:28:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:11 smithi136 ceph-mon[125702]: pgmap v2904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:28:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:11 smithi136 ceph-mon[125702]: osdmap e255: 12 total, 12 up, 12 in 2023-03-02T12:28:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:13 smithi057 ceph-mon[92072]: pgmap v2906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:28:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:13 smithi122 ceph-mon[125440]: pgmap v2906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:28:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:13 smithi136 ceph-mon[125702]: pgmap v2906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:28:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:15 smithi057 ceph-mon[92072]: pgmap v2907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:28:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:15 smithi057 ceph-mon[92072]: osdmap e256: 12 total, 12 up, 12 in 2023-03-02T12:28:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:15 smithi122 ceph-mon[125440]: pgmap v2907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:28:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:15 smithi122 ceph-mon[125440]: osdmap e256: 12 total, 12 up, 12 in 2023-03-02T12:28:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:15 smithi136 ceph-mon[125702]: pgmap v2907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:28:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:15 smithi136 ceph-mon[125702]: osdmap e256: 12 total, 12 up, 12 in 2023-03-02T12:28:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:17 smithi057 ceph-mon[92072]: pgmap v2909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:28:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:17 smithi122 ceph-mon[125440]: pgmap v2909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:28:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:17 smithi136 ceph-mon[125702]: pgmap v2909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:28:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:19 smithi057 ceph-mon[92072]: pgmap v2910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:28:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:19 smithi122 ceph-mon[125440]: pgmap v2910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:28:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:19 smithi136 ceph-mon[125702]: pgmap v2910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:28:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:21 smithi122 ceph-mon[125440]: pgmap v2911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T12:28:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:21 smithi136 ceph-mon[125702]: pgmap v2911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T12:28:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:21 smithi057 ceph-mon[92072]: pgmap v2911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T12:28:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:23.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:28:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:23.066+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:28:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:23.066+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:28:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:23.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:28:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:23.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:28:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:23 smithi122 ceph-mon[125440]: pgmap v2912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:28:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:23 smithi136 ceph-mon[125702]: pgmap v2912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:28:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:23 smithi057 ceph-mon[92072]: pgmap v2912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:28:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:24 smithi136 ceph-mon[125702]: pgmap v2913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:28:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:24 smithi057 ceph-mon[92072]: pgmap v2913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:28:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:24 smithi122 ceph-mon[125440]: pgmap v2913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:28:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:27 smithi136 ceph-mon[125702]: pgmap v2914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:28:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:27 smithi057 ceph-mon[92072]: pgmap v2914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:28:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:27 smithi122 ceph-mon[125440]: pgmap v2914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:28:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:29 smithi136 ceph-mon[125702]: pgmap v2915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:28:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:29 smithi057 ceph-mon[92072]: pgmap v2915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:28:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:29 smithi122 ceph-mon[125440]: pgmap v2915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:28:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:31 smithi136 ceph-mon[125702]: pgmap v2916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:31 smithi057 ceph-mon[92072]: pgmap v2916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:31 smithi122 ceph-mon[125440]: pgmap v2916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:33 smithi136 ceph-mon[125702]: pgmap v2917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:33 smithi057 ceph-mon[92072]: pgmap v2917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:33 smithi122 ceph-mon[125440]: pgmap v2917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:35 smithi136 ceph-mon[125702]: pgmap v2918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:35 smithi057 ceph-mon[92072]: pgmap v2918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:35 smithi122 ceph-mon[125440]: pgmap v2918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:37 smithi136 ceph-mon[125702]: pgmap v2919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:37 smithi057 ceph-mon[92072]: pgmap v2919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:37 smithi122 ceph-mon[125440]: pgmap v2919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:38.076+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:28:38.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:38.077+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:28:38.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:38.077+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:28:38.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:38.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:28:38.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:38.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:28:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:39 smithi136 ceph-mon[125702]: pgmap v2920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:39 smithi057 ceph-mon[92072]: pgmap v2920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:39 smithi122 ceph-mon[125440]: pgmap v2920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:41.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:41 smithi136 ceph-mon[125702]: pgmap v2921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:41 smithi057 ceph-mon[92072]: pgmap v2921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:41 smithi122 ceph-mon[125440]: pgmap v2921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:43 smithi136 ceph-mon[125702]: pgmap v2922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:43 smithi057 ceph-mon[92072]: pgmap v2922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:43 smithi122 ceph-mon[125440]: pgmap v2922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:45 smithi136 ceph-mon[125702]: pgmap v2923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:45 smithi057 ceph-mon[92072]: pgmap v2923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:45 smithi122 ceph-mon[125440]: pgmap v2923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:47 smithi136 ceph-mon[125702]: pgmap v2924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:47 smithi057 ceph-mon[92072]: pgmap v2924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:47 smithi122 ceph-mon[125440]: pgmap v2924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:49 smithi136 ceph-mon[125702]: pgmap v2925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:49 smithi057 ceph-mon[92072]: pgmap v2925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:49 smithi122 ceph-mon[125440]: pgmap v2925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:51 smithi136 ceph-mon[125702]: pgmap v2926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:51 smithi057 ceph-mon[92072]: pgmap v2926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:51 smithi122 ceph-mon[125440]: pgmap v2926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:53.088 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:53.086+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:28:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:53.087+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:28:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:53.087+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:28:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:53.087+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:28:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:28:53.087+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:28:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:53 smithi136 ceph-mon[125702]: pgmap v2927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:53 smithi057 ceph-mon[92072]: pgmap v2927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:53 smithi122 ceph-mon[125440]: pgmap v2927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:55 smithi136 ceph-mon[125702]: pgmap v2928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:55 smithi057 ceph-mon[92072]: pgmap v2928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:55 smithi122 ceph-mon[125440]: pgmap v2928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:57 smithi136 ceph-mon[125702]: pgmap v2929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:57 smithi057 ceph-mon[92072]: pgmap v2929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:57 smithi122 ceph-mon[125440]: pgmap v2929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:28:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:28:59 smithi136 ceph-mon[125702]: pgmap v2930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:28:59 smithi057 ceph-mon[92072]: pgmap v2930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:28:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:28:59 smithi122 ceph-mon[125440]: pgmap v2930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:01 smithi136 ceph-mon[125702]: pgmap v2931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:01 smithi057 ceph-mon[92072]: pgmap v2931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:01 smithi122 ceph-mon[125440]: pgmap v2931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:03 smithi057 ceph-mon[92072]: pgmap v2932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:29:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:03 smithi122 ceph-mon[125440]: pgmap v2932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:29:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:03 smithi136 ceph-mon[125702]: pgmap v2932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:29:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:05 smithi057 ceph-mon[92072]: pgmap v2933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:29:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:29:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:05 smithi122 ceph-mon[125440]: pgmap v2933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:29:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:29:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:05 smithi136 ceph-mon[125702]: pgmap v2933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:29:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:29:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:29:07.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:29:07.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:06 smithi136 ceph-mon[125702]: pgmap v2934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:29:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:29:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:29:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:06 smithi057 ceph-mon[92072]: pgmap v2934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:29:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:29:07.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:29:07.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:29:07.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:06 smithi122 ceph-mon[125440]: pgmap v2934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:29:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.096+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:29:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.096+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:29:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.096+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:29:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.096+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:29:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.096+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:29:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.379+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f58680a7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T12:29:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.379+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f58680a7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T12:29:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.379+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f587008e000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:29:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.379+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f587008e000 comp rx=0 tx=0).stop 2023-03-02T12:29:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.379+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f58680a7c80 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T12:29:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.379+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f58680a7c80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T12:29:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.379+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f58680a7c80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T12:29:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.379+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T12:29:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.379+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:29:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:08.379+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f58700196d0 tx=0x7f58700aa000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T12:29:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:09.128+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:29:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:09.128+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:29:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:09.129+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 46 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:29:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:09.129+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 45 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006550 con 0x558558b6f6b0 2023-03-02T12:29:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:09 smithi136 ceph-mon[125702]: pgmap v2935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:29:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:09 smithi057 ceph-mon[92072]: pgmap v2935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:29:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:09 smithi122 ceph-mon[125440]: pgmap v2935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:29:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:11 smithi136 ceph-mon[125702]: pgmap v2936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:29:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:11 smithi136 ceph-mon[125702]: osdmap e257: 12 total, 12 up, 12 in 2023-03-02T12:29:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:11 smithi057 ceph-mon[92072]: pgmap v2936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:29:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:11 smithi057 ceph-mon[92072]: osdmap e257: 12 total, 12 up, 12 in 2023-03-02T12:29:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:11 smithi122 ceph-mon[125440]: pgmap v2936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:29:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:11 smithi122 ceph-mon[125440]: osdmap e257: 12 total, 12 up, 12 in 2023-03-02T12:29:13.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:13 smithi136 ceph-mon[125702]: pgmap v2938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:29:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:13 smithi057 ceph-mon[92072]: pgmap v2938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:29:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:13 smithi122 ceph-mon[125440]: pgmap v2938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:29:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:15 smithi136 ceph-mon[125702]: pgmap v2939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:29:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:15 smithi057 ceph-mon[92072]: pgmap v2939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:29:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:15 smithi122 ceph-mon[125440]: pgmap v2939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:29:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:16 smithi136 ceph-mon[125702]: osdmap e258: 12 total, 12 up, 12 in 2023-03-02T12:29:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:16 smithi057 ceph-mon[92072]: osdmap e258: 12 total, 12 up, 12 in 2023-03-02T12:29:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:16 smithi122 ceph-mon[125440]: osdmap e258: 12 total, 12 up, 12 in 2023-03-02T12:29:17.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:17 smithi136 ceph-mon[125702]: pgmap v2941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:29:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:17 smithi057 ceph-mon[92072]: pgmap v2941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:29:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:17 smithi122 ceph-mon[125440]: pgmap v2941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:29:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:19 smithi136 ceph-mon[125702]: pgmap v2942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:29:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:19 smithi057 ceph-mon[92072]: pgmap v2942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:29:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:19 smithi122 ceph-mon[125440]: pgmap v2942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:29:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:21 smithi136 ceph-mon[125702]: pgmap v2943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:29:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:21 smithi057 ceph-mon[92072]: pgmap v2943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:29:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:21 smithi122 ceph-mon[125440]: pgmap v2943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:29:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:23.113+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:29:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:23.113+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:29:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:23.113+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:29:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:23.113+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:29:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:23.113+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:29:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:23 smithi136 ceph-mon[125702]: pgmap v2944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:29:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:23 smithi057 ceph-mon[92072]: pgmap v2944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:29:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:23 smithi122 ceph-mon[125440]: pgmap v2944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:29:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:25 smithi136 ceph-mon[125702]: pgmap v2945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:29:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:25 smithi057 ceph-mon[92072]: pgmap v2945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:29:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:25 smithi122 ceph-mon[125440]: pgmap v2945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:29:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:27 smithi136 ceph-mon[125702]: pgmap v2946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:29:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:27 smithi057 ceph-mon[92072]: pgmap v2946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:29:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:27 smithi122 ceph-mon[125440]: pgmap v2946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:29:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:29 smithi136 ceph-mon[125702]: pgmap v2947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:29:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:29 smithi057 ceph-mon[92072]: pgmap v2947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:29:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:29 smithi122 ceph-mon[125440]: pgmap v2947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:29:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:31 smithi136 ceph-mon[125702]: pgmap v2948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:31 smithi057 ceph-mon[92072]: pgmap v2948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:31 smithi122 ceph-mon[125440]: pgmap v2948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:33 smithi136 ceph-mon[125702]: pgmap v2949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:33 smithi057 ceph-mon[92072]: pgmap v2949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:33 smithi122 ceph-mon[125440]: pgmap v2949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:35 smithi136 ceph-mon[125702]: pgmap v2950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:35 smithi057 ceph-mon[92072]: pgmap v2950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:35 smithi122 ceph-mon[125440]: pgmap v2950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:37 smithi136 ceph-mon[125702]: pgmap v2951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:37 smithi057 ceph-mon[92072]: pgmap v2951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:37 smithi122 ceph-mon[125440]: pgmap v2951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:38.127+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:29:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:38.128+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:29:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:38.128+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:29:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:38.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:29:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:38.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:29:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:39 smithi057 ceph-mon[92072]: pgmap v2952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:39 smithi122 ceph-mon[125440]: pgmap v2952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:39 smithi136 ceph-mon[125702]: pgmap v2952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:41 smithi057 ceph-mon[92072]: pgmap v2953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:41 smithi122 ceph-mon[125440]: pgmap v2953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:41 smithi136 ceph-mon[125702]: pgmap v2953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:43 smithi057 ceph-mon[92072]: pgmap v2954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:43 smithi122 ceph-mon[125440]: pgmap v2954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:43 smithi136 ceph-mon[125702]: pgmap v2954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:45 smithi057 ceph-mon[92072]: pgmap v2955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:45 smithi122 ceph-mon[125440]: pgmap v2955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:45 smithi136 ceph-mon[125702]: pgmap v2955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:47 smithi057 ceph-mon[92072]: pgmap v2956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:47 smithi122 ceph-mon[125440]: pgmap v2956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:47 smithi136 ceph-mon[125702]: pgmap v2956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:49 smithi057 ceph-mon[92072]: pgmap v2957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:49 smithi122 ceph-mon[125440]: pgmap v2957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:49 smithi136 ceph-mon[125702]: pgmap v2957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:51 smithi057 ceph-mon[92072]: pgmap v2958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:51 smithi122 ceph-mon[125440]: pgmap v2958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:51 smithi136 ceph-mon[125702]: pgmap v2958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:53.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:29:53.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:53.138+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:29:53.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:53.138+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:29:53.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:53.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:29:53.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:53.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:29:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:53 smithi057 ceph-mon[92072]: pgmap v2959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:53 smithi122 ceph-mon[125440]: pgmap v2959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:53 smithi136 ceph-mon[125702]: pgmap v2959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:54.135+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:29:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:54.135+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T12:29:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:54.135+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 47 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:29:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:29:54.136+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 46 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T12:29:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:55 smithi057 ceph-mon[92072]: pgmap v2960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:55 smithi122 ceph-mon[125440]: pgmap v2960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:55 smithi136 ceph-mon[125702]: pgmap v2960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:57 smithi057 ceph-mon[92072]: pgmap v2961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:57 smithi122 ceph-mon[125440]: pgmap v2961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:57 smithi136 ceph-mon[125702]: pgmap v2961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:29:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:29:59 smithi057 ceph-mon[92072]: pgmap v2962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:29:59 smithi122 ceph-mon[125440]: pgmap v2962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:29:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:29:59 smithi136 ceph-mon[125702]: pgmap v2962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T12:30:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T12:30:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T12:30:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:01 smithi136 ceph-mon[125702]: pgmap v2963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:01 smithi057 ceph-mon[92072]: pgmap v2963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:01 smithi122 ceph-mon[125440]: pgmap v2963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:03 smithi057 ceph-mon[92072]: pgmap v2964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:30:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:03 smithi122 ceph-mon[125440]: pgmap v2964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:30:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:03 smithi136 ceph-mon[125702]: pgmap v2964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:30:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:05 smithi057 ceph-mon[92072]: pgmap v2965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:30:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:05 smithi122 ceph-mon[125440]: pgmap v2965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:30:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:05 smithi136 ceph-mon[125702]: pgmap v2965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:30:06.673 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:30:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:30:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:30:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:07 smithi057 ceph-mon[92072]: pgmap v2966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:30:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:07 smithi122 ceph-mon[125440]: pgmap v2966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:30:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:07 smithi136 ceph-mon[125702]: pgmap v2966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:30:08.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:08.145+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:30:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:08.145+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:30:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:08.145+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:30:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:08.145+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:30:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:08.145+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:30:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:09 smithi057 ceph-mon[92072]: pgmap v2967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:30:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:09 smithi122 ceph-mon[125440]: pgmap v2967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:30:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:09 smithi136 ceph-mon[125702]: pgmap v2967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:30:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: pgmap v2968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:30:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:30:10.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:30:10.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:30:10.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:10 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:30:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: pgmap v2968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:30:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:30:10.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:30:10.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:30:10.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:10 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:30:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: pgmap v2968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:30:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:30:10.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:30:10.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:10.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:30:10.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:10 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:30:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: osdmap e259: 12 total, 12 up, 12 in 2023-03-02T12:30:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:30:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:30:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:30:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:30:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: osdmap e259: 12 total, 12 up, 12 in 2023-03-02T12:30:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:30:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:30:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:30:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:30:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: osdmap e259: 12 total, 12 up, 12 in 2023-03-02T12:30:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:30:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:30:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:30:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:30:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:30:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:30:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:12 smithi057 ceph-mon[92072]: pgmap v2970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:30:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:12 smithi122 ceph-mon[125440]: pgmap v2970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:30:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:12 smithi136 ceph-mon[125702]: pgmap v2970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:30:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:15 smithi136 ceph-mon[125702]: pgmap v2971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:30:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:15 smithi057 ceph-mon[92072]: pgmap v2971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:30:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:15 smithi122 ceph-mon[125440]: pgmap v2971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:30:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:16 smithi136 ceph-mon[125702]: osdmap e260: 12 total, 12 up, 12 in 2023-03-02T12:30:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:16 smithi057 ceph-mon[92072]: osdmap e260: 12 total, 12 up, 12 in 2023-03-02T12:30:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:16 smithi122 ceph-mon[125440]: osdmap e260: 12 total, 12 up, 12 in 2023-03-02T12:30:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:17 smithi136 ceph-mon[125702]: pgmap v2973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:30:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:17 smithi057 ceph-mon[92072]: pgmap v2973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:30:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:17 smithi122 ceph-mon[125440]: pgmap v2973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:30:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:19 smithi136 ceph-mon[125702]: pgmap v2974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:30:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:19 smithi057 ceph-mon[92072]: pgmap v2974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:30:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:19 smithi122 ceph-mon[125440]: pgmap v2974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:30:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:21 smithi136 ceph-mon[125702]: pgmap v2975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T12:30:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:21 smithi057 ceph-mon[92072]: pgmap v2975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T12:30:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:21 smithi122 ceph-mon[125440]: pgmap v2975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T12:30:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:23.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:30:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:23.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:30:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:23.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:30:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:23.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:30:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:23.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:30:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:23 smithi136 ceph-mon[125702]: pgmap v2976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:30:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:23 smithi057 ceph-mon[92072]: pgmap v2976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:30:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:23 smithi122 ceph-mon[125440]: pgmap v2976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:30:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:25 smithi136 ceph-mon[125702]: pgmap v2977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:30:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:25 smithi057 ceph-mon[92072]: pgmap v2977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:30:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:25 smithi122 ceph-mon[125440]: pgmap v2977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:30:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:27 smithi057 ceph-mon[92072]: pgmap v2978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:30:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:27 smithi122 ceph-mon[125440]: pgmap v2978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:30:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:27 smithi136 ceph-mon[125702]: pgmap v2978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:30:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:29 smithi057 ceph-mon[92072]: pgmap v2979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:30:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:29 smithi122 ceph-mon[125440]: pgmap v2979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:30:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:29 smithi136 ceph-mon[125702]: pgmap v2979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:30:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:31 smithi057 ceph-mon[92072]: pgmap v2980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:31 smithi122 ceph-mon[125440]: pgmap v2980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:31 smithi136 ceph-mon[125702]: pgmap v2980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:33 smithi057 ceph-mon[92072]: pgmap v2981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:33 smithi122 ceph-mon[125440]: pgmap v2981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:33 smithi136 ceph-mon[125702]: pgmap v2981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:35 smithi057 ceph-mon[92072]: pgmap v2982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:35 smithi122 ceph-mon[125440]: pgmap v2982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:35 smithi136 ceph-mon[125702]: pgmap v2982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:37 smithi057 ceph-mon[92072]: pgmap v2983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:37 smithi122 ceph-mon[125440]: pgmap v2983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:37 smithi136 ceph-mon[125702]: pgmap v2983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:38.170+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:30:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:38.170+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:30:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:38.170+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:30:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:38.170+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:30:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:38.170+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:30:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:39 smithi057 ceph-mon[92072]: pgmap v2984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:39 smithi122 ceph-mon[125440]: pgmap v2984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:39 smithi136 ceph-mon[125702]: pgmap v2984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:41 smithi057 ceph-mon[92072]: pgmap v2985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:41 smithi122 ceph-mon[125440]: pgmap v2985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:41 smithi136 ceph-mon[125702]: pgmap v2985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:43 smithi057 ceph-mon[92072]: pgmap v2986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:43 smithi122 ceph-mon[125440]: pgmap v2986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:43 smithi136 ceph-mon[125702]: pgmap v2986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:45 smithi057 ceph-mon[92072]: pgmap v2987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:45 smithi122 ceph-mon[125440]: pgmap v2987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:45 smithi136 ceph-mon[125702]: pgmap v2987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:47 smithi057 ceph-mon[92072]: pgmap v2988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:47 smithi122 ceph-mon[125440]: pgmap v2988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:47 smithi136 ceph-mon[125702]: pgmap v2988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:49 smithi057 ceph-mon[92072]: pgmap v2989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:49 smithi122 ceph-mon[125440]: pgmap v2989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:49 smithi136 ceph-mon[125702]: pgmap v2989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:51 smithi057 ceph-mon[92072]: pgmap v2990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:51 smithi122 ceph-mon[125440]: pgmap v2990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:51 smithi136 ceph-mon[125702]: pgmap v2990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:53.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:30:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:53.183+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:30:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:53.183+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:30:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:53.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:30:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:30:53.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:30:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:53 smithi057 ceph-mon[92072]: pgmap v2991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:53 smithi122 ceph-mon[125440]: pgmap v2991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:53 smithi136 ceph-mon[125702]: pgmap v2991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:55 smithi057 ceph-mon[92072]: pgmap v2992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:55 smithi122 ceph-mon[125440]: pgmap v2992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:55 smithi136 ceph-mon[125702]: pgmap v2992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:57 smithi057 ceph-mon[92072]: pgmap v2993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:57 smithi122 ceph-mon[125440]: pgmap v2993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:57 smithi136 ceph-mon[125702]: pgmap v2993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:30:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:30:59 smithi057 ceph-mon[92072]: pgmap v2994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:30:59 smithi122 ceph-mon[125440]: pgmap v2994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:30:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:30:59 smithi136 ceph-mon[125702]: pgmap v2994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:01 smithi057 ceph-mon[92072]: pgmap v2995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:01 smithi122 ceph-mon[125440]: pgmap v2995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:01 smithi136 ceph-mon[125702]: pgmap v2995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:03 smithi057 ceph-mon[92072]: pgmap v2996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:31:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:03 smithi122 ceph-mon[125440]: pgmap v2996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:31:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:03 smithi136 ceph-mon[125702]: pgmap v2996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:31:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:05 smithi057 ceph-mon[92072]: pgmap v2997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:31:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:05 smithi122 ceph-mon[125440]: pgmap v2997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:31:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:05 smithi136 ceph-mon[125702]: pgmap v2997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:31:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:07 smithi057 ceph-mon[92072]: pgmap v2998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:31:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:07 smithi122 ceph-mon[125440]: pgmap v2998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:31:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:07 smithi136 ceph-mon[125702]: pgmap v2998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:31:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:08.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:31:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:08.191+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:31:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:08.191+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:31:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:08.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:31:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:08.192+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:31:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:09 smithi057 ceph-mon[92072]: pgmap v2999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:31:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:09 smithi122 ceph-mon[125440]: pgmap v2999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:31:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:09 smithi136 ceph-mon[125702]: pgmap v2999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:31:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:11 smithi057 ceph-mon[92072]: pgmap v3000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:31:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:11 smithi057 ceph-mon[92072]: osdmap e261: 12 total, 12 up, 12 in 2023-03-02T12:31:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:11 smithi122 ceph-mon[125440]: pgmap v3000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:31:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:11 smithi122 ceph-mon[125440]: osdmap e261: 12 total, 12 up, 12 in 2023-03-02T12:31:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:11 smithi136 ceph-mon[125702]: pgmap v3000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:31:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:11 smithi136 ceph-mon[125702]: osdmap e261: 12 total, 12 up, 12 in 2023-03-02T12:31:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:31:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:31:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:31:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:31:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:31:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:31:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:31:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:31:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:31:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:31:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:31:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:31:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:13 smithi122 ceph-mon[125440]: pgmap v3002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:31:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:13 smithi136 ceph-mon[125702]: pgmap v3002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:31:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:13 smithi057 ceph-mon[92072]: pgmap v3002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:31:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:15 smithi122 ceph-mon[125440]: pgmap v3003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:31:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:15 smithi122 ceph-mon[125440]: osdmap e262: 12 total, 12 up, 12 in 2023-03-02T12:31:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:15 smithi136 ceph-mon[125702]: pgmap v3003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:31:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:15 smithi136 ceph-mon[125702]: osdmap e262: 12 total, 12 up, 12 in 2023-03-02T12:31:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:15 smithi057 ceph-mon[92072]: pgmap v3003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:31:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:15 smithi057 ceph-mon[92072]: osdmap e262: 12 total, 12 up, 12 in 2023-03-02T12:31:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:17 smithi122 ceph-mon[125440]: pgmap v3005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:31:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:17 smithi136 ceph-mon[125702]: pgmap v3005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:31:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:17 smithi057 ceph-mon[92072]: pgmap v3005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:31:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:19 smithi122 ceph-mon[125440]: pgmap v3006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:31:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:19 smithi136 ceph-mon[125702]: pgmap v3006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:31:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:19 smithi057 ceph-mon[92072]: pgmap v3006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:31:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:21 smithi136 ceph-mon[125702]: pgmap v3007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T12:31:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:21 smithi057 ceph-mon[92072]: pgmap v3007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T12:31:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:21 smithi122 ceph-mon[125440]: pgmap v3007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T12:31:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:23.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:31:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:23.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:31:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:23.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:31:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:23.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:31:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:23.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:31:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:23 smithi136 ceph-mon[125702]: pgmap v3008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:31:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:23 smithi057 ceph-mon[92072]: pgmap v3008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:31:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:23 smithi122 ceph-mon[125440]: pgmap v3008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:31:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:25 smithi136 ceph-mon[125702]: pgmap v3009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:31:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:25 smithi057 ceph-mon[92072]: pgmap v3009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:31:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:25 smithi122 ceph-mon[125440]: pgmap v3009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:31:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:27 smithi136 ceph-mon[125702]: pgmap v3010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:31:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:27 smithi057 ceph-mon[92072]: pgmap v3010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:31:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:27 smithi122 ceph-mon[125440]: pgmap v3010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:31:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:29 smithi136 ceph-mon[125702]: pgmap v3011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:31:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:29 smithi057 ceph-mon[92072]: pgmap v3011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:31:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:29 smithi122 ceph-mon[125440]: pgmap v3011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:31:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:31 smithi136 ceph-mon[125702]: pgmap v3012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:31 smithi057 ceph-mon[92072]: pgmap v3012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:31 smithi122 ceph-mon[125440]: pgmap v3012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:33 smithi136 ceph-mon[125702]: pgmap v3013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:33 smithi057 ceph-mon[92072]: pgmap v3013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:33 smithi122 ceph-mon[125440]: pgmap v3013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:35 smithi136 ceph-mon[125702]: pgmap v3014: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:35 smithi057 ceph-mon[92072]: pgmap v3014: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:35 smithi122 ceph-mon[125440]: pgmap v3014: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:37 smithi136 ceph-mon[125702]: pgmap v3015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:37 smithi057 ceph-mon[92072]: pgmap v3015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:37 smithi122 ceph-mon[125440]: pgmap v3015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:38.211+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:31:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:38.211+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:31:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:38.211+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:31:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:38.211+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:31:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:38.211+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:31:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:39 smithi136 ceph-mon[125702]: pgmap v3016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:39 smithi057 ceph-mon[92072]: pgmap v3016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:39 smithi122 ceph-mon[125440]: pgmap v3016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:41 smithi136 ceph-mon[125702]: pgmap v3017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:41 smithi057 ceph-mon[92072]: pgmap v3017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:41 smithi122 ceph-mon[125440]: pgmap v3017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:43 smithi136 ceph-mon[125702]: pgmap v3018: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:43 smithi057 ceph-mon[92072]: pgmap v3018: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:43 smithi122 ceph-mon[125440]: pgmap v3018: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:45 smithi057 ceph-mon[92072]: pgmap v3019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:45 smithi122 ceph-mon[125440]: pgmap v3019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:45 smithi136 ceph-mon[125702]: pgmap v3019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:47 smithi057 ceph-mon[92072]: pgmap v3020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:47 smithi122 ceph-mon[125440]: pgmap v3020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:47 smithi136 ceph-mon[125702]: pgmap v3020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:49 smithi057 ceph-mon[92072]: pgmap v3021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:49 smithi122 ceph-mon[125440]: pgmap v3021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:49 smithi136 ceph-mon[125702]: pgmap v3021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:51 smithi057 ceph-mon[92072]: pgmap v3022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:51 smithi122 ceph-mon[125440]: pgmap v3022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:51 smithi136 ceph-mon[125702]: pgmap v3022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:53.228 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:53.227+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:31:53.228 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:53.227+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:31:53.228 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:53.227+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:31:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:53.227+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:31:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:31:53.227+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:31:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:53 smithi057 ceph-mon[92072]: pgmap v3023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:53 smithi122 ceph-mon[125440]: pgmap v3023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:53 smithi136 ceph-mon[125702]: pgmap v3023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:55 smithi057 ceph-mon[92072]: pgmap v3024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:55 smithi122 ceph-mon[125440]: pgmap v3024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:55 smithi136 ceph-mon[125702]: pgmap v3024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:57 smithi057 ceph-mon[92072]: pgmap v3025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:57 smithi122 ceph-mon[125440]: pgmap v3025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:57 smithi136 ceph-mon[125702]: pgmap v3025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:31:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:31:59 smithi057 ceph-mon[92072]: pgmap v3026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:31:59 smithi122 ceph-mon[125440]: pgmap v3026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:31:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:31:59 smithi136 ceph-mon[125702]: pgmap v3026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:01 smithi057 ceph-mon[92072]: pgmap v3027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:01 smithi122 ceph-mon[125440]: pgmap v3027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:01 smithi136 ceph-mon[125702]: pgmap v3027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:03 smithi057 ceph-mon[92072]: pgmap v3028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:32:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:03 smithi122 ceph-mon[125440]: pgmap v3028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:32:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:03 smithi136 ceph-mon[125702]: pgmap v3028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:32:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:05 smithi057 ceph-mon[92072]: pgmap v3029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:32:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:05 smithi122 ceph-mon[125440]: pgmap v3029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:32:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:05 smithi136 ceph-mon[125702]: pgmap v3029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:32:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:07 smithi057 ceph-mon[92072]: pgmap v3030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:32:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:07 smithi122 ceph-mon[125440]: pgmap v3030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:32:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:07 smithi136 ceph-mon[125702]: pgmap v3030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:32:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:08.236+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:32:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:08.236+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:32:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:08.236+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:32:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:08.236+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:32:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:08.236+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:32:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:09.155+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:32:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:09.155+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T12:32:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:09.155+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 48 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:32:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:09.155+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 47 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T12:32:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:09 smithi057 ceph-mon[92072]: pgmap v3031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:32:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:09 smithi122 ceph-mon[125440]: pgmap v3031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:32:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:09 smithi136 ceph-mon[125702]: pgmap v3031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:32:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:11 smithi057 ceph-mon[92072]: pgmap v3032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:32:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:11 smithi057 ceph-mon[92072]: osdmap e263: 12 total, 12 up, 12 in 2023-03-02T12:32:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:11 smithi122 ceph-mon[125440]: pgmap v3032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:32:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:11 smithi122 ceph-mon[125440]: osdmap e263: 12 total, 12 up, 12 in 2023-03-02T12:32:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:11 smithi136 ceph-mon[125702]: pgmap v3032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:32:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:11 smithi136 ceph-mon[125702]: osdmap e263: 12 total, 12 up, 12 in 2023-03-02T12:32:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:13 smithi057 ceph-mon[92072]: pgmap v3034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:32:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:32:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:32:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:32:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:13 smithi122 ceph-mon[125440]: pgmap v3034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:32:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:32:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:32:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:32:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:13 smithi136 ceph-mon[125702]: pgmap v3034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:32:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:32:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:32:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:32:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:32:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:32:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:32:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:32:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:32:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:32:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:32:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:32:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:32:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:15 smithi057 ceph-mon[92072]: pgmap v3035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:32:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:15 smithi057 ceph-mon[92072]: osdmap e264: 12 total, 12 up, 12 in 2023-03-02T12:32:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:15 smithi122 ceph-mon[125440]: pgmap v3035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:32:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:15 smithi122 ceph-mon[125440]: osdmap e264: 12 total, 12 up, 12 in 2023-03-02T12:32:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:15 smithi136 ceph-mon[125702]: pgmap v3035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:32:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:15 smithi136 ceph-mon[125702]: osdmap e264: 12 total, 12 up, 12 in 2023-03-02T12:32:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:17 smithi057 ceph-mon[92072]: pgmap v3037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:32:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:17 smithi122 ceph-mon[125440]: pgmap v3037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:32:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:17 smithi136 ceph-mon[125702]: pgmap v3037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:32:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:19 smithi057 ceph-mon[92072]: pgmap v3038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:32:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:19 smithi122 ceph-mon[125440]: pgmap v3038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:32:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:19 smithi136 ceph-mon[125702]: pgmap v3038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:32:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:21 smithi122 ceph-mon[125440]: pgmap v3039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:32:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:21 smithi136 ceph-mon[125702]: pgmap v3039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:32:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:21 smithi057 ceph-mon[92072]: pgmap v3039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:32:23.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:23.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:32:23.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:23.251+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:32:23.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:23.251+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:32:23.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:23.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:32:23.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:23.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:32:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:23 smithi122 ceph-mon[125440]: pgmap v3040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:32:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:23 smithi136 ceph-mon[125702]: pgmap v3040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:32:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:23 smithi057 ceph-mon[92072]: pgmap v3040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:32:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:25 smithi122 ceph-mon[125440]: pgmap v3041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:32:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:25 smithi136 ceph-mon[125702]: pgmap v3041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:32:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:25 smithi057 ceph-mon[92072]: pgmap v3041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:32:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:27 smithi136 ceph-mon[125702]: pgmap v3042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:32:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:27 smithi057 ceph-mon[92072]: pgmap v3042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:32:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:27 smithi122 ceph-mon[125440]: pgmap v3042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:32:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:29 smithi136 ceph-mon[125702]: pgmap v3043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:32:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:29 smithi057 ceph-mon[92072]: pgmap v3043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:32:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:29 smithi122 ceph-mon[125440]: pgmap v3043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:32:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:31 smithi136 ceph-mon[125702]: pgmap v3044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:31 smithi057 ceph-mon[92072]: pgmap v3044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:31 smithi122 ceph-mon[125440]: pgmap v3044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:33 smithi136 ceph-mon[125702]: pgmap v3045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:33 smithi057 ceph-mon[92072]: pgmap v3045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:33 smithi122 ceph-mon[125440]: pgmap v3045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:35 smithi136 ceph-mon[125702]: pgmap v3046: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:35 smithi057 ceph-mon[92072]: pgmap v3046: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:35 smithi122 ceph-mon[125440]: pgmap v3046: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:37 smithi136 ceph-mon[125702]: pgmap v3047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:37 smithi057 ceph-mon[92072]: pgmap v3047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:37 smithi122 ceph-mon[125440]: pgmap v3047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:38.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:38.259+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:32:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:38.259+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:32:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:38.259+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:32:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:38.259+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:32:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:38.259+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:32:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:39 smithi136 ceph-mon[125702]: pgmap v3048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:39 smithi057 ceph-mon[92072]: pgmap v3048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:39 smithi122 ceph-mon[125440]: pgmap v3048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:41 smithi136 ceph-mon[125702]: pgmap v3049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:41 smithi057 ceph-mon[92072]: pgmap v3049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:41 smithi122 ceph-mon[125440]: pgmap v3049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:42 smithi136 ceph-mon[125702]: pgmap v3050: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:42 smithi057 ceph-mon[92072]: pgmap v3050: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:42 smithi122 ceph-mon[125440]: pgmap v3050: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:45 smithi136 ceph-mon[125702]: pgmap v3051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:45 smithi057 ceph-mon[92072]: pgmap v3051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:45 smithi122 ceph-mon[125440]: pgmap v3051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:47 smithi136 ceph-mon[125702]: pgmap v3052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:47 smithi057 ceph-mon[92072]: pgmap v3052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:47 smithi122 ceph-mon[125440]: pgmap v3052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:49 smithi136 ceph-mon[125702]: pgmap v3053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:49 smithi057 ceph-mon[92072]: pgmap v3053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:49 smithi122 ceph-mon[125440]: pgmap v3053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:51 smithi057 ceph-mon[92072]: pgmap v3054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:51 smithi122 ceph-mon[125440]: pgmap v3054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:51 smithi136 ceph-mon[125702]: pgmap v3054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:53.273+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:32:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:53.273+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:32:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:53.273+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:32:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:53.273+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:32:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:32:53.273+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:32:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:53 smithi057 ceph-mon[92072]: pgmap v3055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:53 smithi122 ceph-mon[125440]: pgmap v3055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:53 smithi136 ceph-mon[125702]: pgmap v3055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:55 smithi057 ceph-mon[92072]: pgmap v3056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:55 smithi122 ceph-mon[125440]: pgmap v3056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:55 smithi136 ceph-mon[125702]: pgmap v3056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:57 smithi057 ceph-mon[92072]: pgmap v3057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:57 smithi122 ceph-mon[125440]: pgmap v3057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:57 smithi136 ceph-mon[125702]: pgmap v3057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:32:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:32:59 smithi057 ceph-mon[92072]: pgmap v3058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:32:59 smithi122 ceph-mon[125440]: pgmap v3058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:32:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:32:59 smithi136 ceph-mon[125702]: pgmap v3058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:01 smithi057 ceph-mon[92072]: pgmap v3059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:01 smithi122 ceph-mon[125440]: pgmap v3059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:01 smithi136 ceph-mon[125702]: pgmap v3059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:03 smithi057 ceph-mon[92072]: pgmap v3060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:33:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:03 smithi122 ceph-mon[125440]: pgmap v3060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:33:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:03 smithi136 ceph-mon[125702]: pgmap v3060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:33:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:05 smithi057 ceph-mon[92072]: pgmap v3061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:33:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:05 smithi122 ceph-mon[125440]: pgmap v3061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:33:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:05 smithi136 ceph-mon[125702]: pgmap v3061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:33:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:07 smithi057 ceph-mon[92072]: pgmap v3062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:33:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:07 smithi122 ceph-mon[125440]: pgmap v3062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:33:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:07 smithi136 ceph-mon[125702]: pgmap v3062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:33:08.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:08.275+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:33:08.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:08.275+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:33:08.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:08.275+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:33:08.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:08.275+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:33:08.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:08.275+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:33:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:09 smithi057 ceph-mon[92072]: pgmap v3063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:33:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:09 smithi122 ceph-mon[125440]: pgmap v3063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:33:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:09 smithi136 ceph-mon[125702]: pgmap v3063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:33:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:11 smithi057 ceph-mon[92072]: pgmap v3064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:33:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:11 smithi057 ceph-mon[92072]: osdmap e265: 12 total, 12 up, 12 in 2023-03-02T12:33:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:11 smithi122 ceph-mon[125440]: pgmap v3064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:33:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:11 smithi122 ceph-mon[125440]: osdmap e265: 12 total, 12 up, 12 in 2023-03-02T12:33:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:11 smithi136 ceph-mon[125702]: pgmap v3064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:33:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:11 smithi136 ceph-mon[125702]: osdmap e265: 12 total, 12 up, 12 in 2023-03-02T12:33:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:13 smithi057 ceph-mon[92072]: pgmap v3066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:33:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:13 smithi122 ceph-mon[125440]: pgmap v3066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:33:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:13 smithi136 ceph-mon[125702]: pgmap v3066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:33:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:33:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:33:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:33:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:15 smithi057 ceph-mon[92072]: pgmap v3067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:33:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:33:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:33:15.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:15.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:15 smithi057 ceph-mon[92072]: osdmap e266: 12 total, 12 up, 12 in 2023-03-02T12:33:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:15 smithi122 ceph-mon[125440]: pgmap v3067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:33:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:15.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:33:15.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:33:15.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:15.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:15 smithi122 ceph-mon[125440]: osdmap e266: 12 total, 12 up, 12 in 2023-03-02T12:33:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:15 smithi136 ceph-mon[125702]: pgmap v3067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:33:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:33:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:33:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:33:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:15 smithi136 ceph-mon[125702]: osdmap e266: 12 total, 12 up, 12 in 2023-03-02T12:33:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:17 smithi122 ceph-mon[125440]: pgmap v3069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:33:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:17 smithi136 ceph-mon[125702]: pgmap v3069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:33:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:17 smithi057 ceph-mon[92072]: pgmap v3069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:33:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:19 smithi122 ceph-mon[125440]: pgmap v3070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:33:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:19 smithi136 ceph-mon[125702]: pgmap v3070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:33:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:19 smithi057 ceph-mon[92072]: pgmap v3070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:33:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:21 smithi122 ceph-mon[125440]: pgmap v3071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:33:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:21 smithi136 ceph-mon[125702]: pgmap v3071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:33:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:21 smithi057 ceph-mon[92072]: pgmap v3071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:33:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:23.290+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:33:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:23.290+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:33:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:23.290+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:33:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:23.290+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:33:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:23.290+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:33:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:23 smithi136 ceph-mon[125702]: pgmap v3072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:33:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:23 smithi057 ceph-mon[92072]: pgmap v3072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:33:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:23 smithi122 ceph-mon[125440]: pgmap v3072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:33:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:25 smithi136 ceph-mon[125702]: pgmap v3073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:33:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:25 smithi057 ceph-mon[92072]: pgmap v3073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:33:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:25 smithi122 ceph-mon[125440]: pgmap v3073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:33:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:27 smithi136 ceph-mon[125702]: pgmap v3074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:33:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:27 smithi057 ceph-mon[92072]: pgmap v3074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:33:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:27 smithi122 ceph-mon[125440]: pgmap v3074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:33:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:29 smithi136 ceph-mon[125702]: pgmap v3075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:33:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:29 smithi057 ceph-mon[92072]: pgmap v3075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:33:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:29 smithi122 ceph-mon[125440]: pgmap v3075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:33:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:31 smithi136 ceph-mon[125702]: pgmap v3076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:31 smithi057 ceph-mon[92072]: pgmap v3076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:31 smithi122 ceph-mon[125440]: pgmap v3076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:33 smithi136 ceph-mon[125702]: pgmap v3077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:33 smithi057 ceph-mon[92072]: pgmap v3077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:33 smithi122 ceph-mon[125440]: pgmap v3077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:35 smithi136 ceph-mon[125702]: pgmap v3078: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:35 smithi057 ceph-mon[92072]: pgmap v3078: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:35 smithi122 ceph-mon[125440]: pgmap v3078: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:37 smithi136 ceph-mon[125702]: pgmap v3079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:37 smithi057 ceph-mon[92072]: pgmap v3079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:37 smithi122 ceph-mon[125440]: pgmap v3079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:38.301+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:33:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:38.301+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:33:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:38.301+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:33:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:38.301+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:33:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:38.301+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:33:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:39 smithi136 ceph-mon[125702]: pgmap v3080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:39 smithi057 ceph-mon[92072]: pgmap v3080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:39 smithi122 ceph-mon[125440]: pgmap v3080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:41 smithi057 ceph-mon[92072]: pgmap v3081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:41 smithi122 ceph-mon[125440]: pgmap v3081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:41 smithi136 ceph-mon[125702]: pgmap v3081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:43 smithi057 ceph-mon[92072]: pgmap v3082: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:43 smithi122 ceph-mon[125440]: pgmap v3082: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:43 smithi136 ceph-mon[125702]: pgmap v3082: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:45 smithi057 ceph-mon[92072]: pgmap v3083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:45 smithi122 ceph-mon[125440]: pgmap v3083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:45 smithi136 ceph-mon[125702]: pgmap v3083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:47 smithi057 ceph-mon[92072]: pgmap v3084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:47 smithi122 ceph-mon[125440]: pgmap v3084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:47 smithi136 ceph-mon[125702]: pgmap v3084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:49 smithi057 ceph-mon[92072]: pgmap v3085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:49 smithi122 ceph-mon[125440]: pgmap v3085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:49 smithi136 ceph-mon[125702]: pgmap v3085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:51 smithi057 ceph-mon[92072]: pgmap v3086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:51 smithi122 ceph-mon[125440]: pgmap v3086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:51 smithi136 ceph-mon[125702]: pgmap v3086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:53.316+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:33:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:53.316+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:33:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:53.316+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:33:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:53.316+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:33:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:33:53.316+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:33:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:53 smithi057 ceph-mon[92072]: pgmap v3087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:53 smithi122 ceph-mon[125440]: pgmap v3087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:53 smithi136 ceph-mon[125702]: pgmap v3087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:55 smithi057 ceph-mon[92072]: pgmap v3088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:55 smithi122 ceph-mon[125440]: pgmap v3088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:55 smithi136 ceph-mon[125702]: pgmap v3088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:57 smithi057 ceph-mon[92072]: pgmap v3089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:57 smithi122 ceph-mon[125440]: pgmap v3089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:57 smithi136 ceph-mon[125702]: pgmap v3089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:33:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:33:59 smithi057 ceph-mon[92072]: pgmap v3090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:33:59 smithi122 ceph-mon[125440]: pgmap v3090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:33:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:33:59 smithi136 ceph-mon[125702]: pgmap v3090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:01 smithi057 ceph-mon[92072]: pgmap v3091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:01 smithi122 ceph-mon[125440]: pgmap v3091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:01 smithi136 ceph-mon[125702]: pgmap v3091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:03 smithi057 ceph-mon[92072]: pgmap v3092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:34:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:03 smithi122 ceph-mon[125440]: pgmap v3092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:34:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:03 smithi136 ceph-mon[125702]: pgmap v3092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:34:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:05 smithi057 ceph-mon[92072]: pgmap v3093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:34:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:05 smithi122 ceph-mon[125440]: pgmap v3093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:34:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:05 smithi136 ceph-mon[125702]: pgmap v3093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:34:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:07 smithi057 ceph-mon[92072]: pgmap v3094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:34:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:07 smithi122 ceph-mon[125440]: pgmap v3094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:34:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:07 smithi136 ceph-mon[125702]: pgmap v3094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:34:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:08.327+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:34:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:08.327+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:34:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:08.327+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:34:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:08.327+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:34:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:08.327+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:34:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:09 smithi057 ceph-mon[92072]: pgmap v3095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:34:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:09 smithi122 ceph-mon[125440]: pgmap v3095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:34:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:09 smithi136 ceph-mon[125702]: pgmap v3095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:34:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:11 smithi122 ceph-mon[125440]: pgmap v3096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:34:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:11 smithi122 ceph-mon[125440]: osdmap e267: 12 total, 12 up, 12 in 2023-03-02T12:34:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:11 smithi136 ceph-mon[125702]: pgmap v3096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:34:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:11 smithi136 ceph-mon[125702]: osdmap e267: 12 total, 12 up, 12 in 2023-03-02T12:34:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:11 smithi057 ceph-mon[92072]: pgmap v3096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:34:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:11 smithi057 ceph-mon[92072]: osdmap e267: 12 total, 12 up, 12 in 2023-03-02T12:34:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:13 smithi122 ceph-mon[125440]: pgmap v3098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:34:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:13 smithi136 ceph-mon[125702]: pgmap v3098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:34:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:13 smithi057 ceph-mon[92072]: pgmap v3098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:34:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:15 smithi122 ceph-mon[125440]: pgmap v3099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:34:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:34:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:15 smithi122 ceph-mon[125440]: osdmap e268: 12 total, 12 up, 12 in 2023-03-02T12:34:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:15 smithi136 ceph-mon[125702]: pgmap v3099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:34:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:34:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:15 smithi136 ceph-mon[125702]: osdmap e268: 12 total, 12 up, 12 in 2023-03-02T12:34:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:15 smithi057 ceph-mon[92072]: pgmap v3099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:34:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:34:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:15 smithi057 ceph-mon[92072]: osdmap e268: 12 total, 12 up, 12 in 2023-03-02T12:34:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:34:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:34:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:34:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:34:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:34:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:34:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:34:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:34:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:34:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:17 smithi122 ceph-mon[125440]: pgmap v3101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:34:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:17 smithi136 ceph-mon[125702]: pgmap v3101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:34:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:17 smithi057 ceph-mon[92072]: pgmap v3101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:34:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:19 smithi136 ceph-mon[125702]: pgmap v3102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:34:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:19 smithi057 ceph-mon[92072]: pgmap v3102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:34:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:19 smithi122 ceph-mon[125440]: pgmap v3102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:34:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:21 smithi136 ceph-mon[125702]: pgmap v3103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:34:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:21 smithi057 ceph-mon[92072]: pgmap v3103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:34:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:21 smithi122 ceph-mon[125440]: pgmap v3103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:34:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:23.338+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:34:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:23.339+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:34:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:23.339+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:34:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:23.339+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:34:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:23.339+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:34:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:23 smithi136 ceph-mon[125702]: pgmap v3104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:34:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:23 smithi057 ceph-mon[92072]: pgmap v3104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:34:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:23 smithi122 ceph-mon[125440]: pgmap v3104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:34:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:25 smithi136 ceph-mon[125702]: pgmap v3105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:34:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:25 smithi057 ceph-mon[92072]: pgmap v3105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:34:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:25 smithi122 ceph-mon[125440]: pgmap v3105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:34:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:27 smithi136 ceph-mon[125702]: pgmap v3106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:34:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:27 smithi057 ceph-mon[92072]: pgmap v3106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:34:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:27 smithi122 ceph-mon[125440]: pgmap v3106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:34:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:29 smithi136 ceph-mon[125702]: pgmap v3107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:34:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:29 smithi057 ceph-mon[92072]: pgmap v3107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:34:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:29 smithi122 ceph-mon[125440]: pgmap v3107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:34:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:31 smithi057 ceph-mon[92072]: pgmap v3108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:34:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:31 smithi122 ceph-mon[125440]: pgmap v3108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:34:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:31 smithi136 ceph-mon[125702]: pgmap v3108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:34:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:33 smithi057 ceph-mon[92072]: pgmap v3109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:33 smithi122 ceph-mon[125440]: pgmap v3109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:33 smithi136 ceph-mon[125702]: pgmap v3109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:35 smithi057 ceph-mon[92072]: pgmap v3110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:34:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:35 smithi122 ceph-mon[125440]: pgmap v3110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:34:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:35 smithi136 ceph-mon[125702]: pgmap v3110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:34:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:37 smithi057 ceph-mon[92072]: pgmap v3111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:34:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:37 smithi122 ceph-mon[125440]: pgmap v3111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:34:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:37 smithi136 ceph-mon[125702]: pgmap v3111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:34:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:38.355+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:34:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:38.355+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:34:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:38.355+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:34:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:38.355+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:34:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:38.355+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:34:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:39 smithi057 ceph-mon[92072]: pgmap v3112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:39 smithi122 ceph-mon[125440]: pgmap v3112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:39 smithi136 ceph-mon[125702]: pgmap v3112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:41 smithi057 ceph-mon[92072]: pgmap v3113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:41 smithi122 ceph-mon[125440]: pgmap v3113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:41 smithi136 ceph-mon[125702]: pgmap v3113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:43 smithi057 ceph-mon[92072]: pgmap v3114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:43 smithi122 ceph-mon[125440]: pgmap v3114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:43 smithi136 ceph-mon[125702]: pgmap v3114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:45 smithi057 ceph-mon[92072]: pgmap v3115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:45 smithi122 ceph-mon[125440]: pgmap v3115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:45 smithi136 ceph-mon[125702]: pgmap v3115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:47 smithi057 ceph-mon[92072]: pgmap v3116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:47 smithi122 ceph-mon[125440]: pgmap v3116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:47 smithi136 ceph-mon[125702]: pgmap v3116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:49 smithi057 ceph-mon[92072]: pgmap v3117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:49 smithi122 ceph-mon[125440]: pgmap v3117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:49 smithi136 ceph-mon[125702]: pgmap v3117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:51 smithi057 ceph-mon[92072]: pgmap v3118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:51 smithi122 ceph-mon[125440]: pgmap v3118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:51 smithi136 ceph-mon[125702]: pgmap v3118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:53.368 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:53.367+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:34:53.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:53.367+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:34:53.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:53.367+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:34:53.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:53.367+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:34:53.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:34:53.367+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:34:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:53 smithi057 ceph-mon[92072]: pgmap v3119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:53 smithi122 ceph-mon[125440]: pgmap v3119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:53 smithi136 ceph-mon[125702]: pgmap v3119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:55 smithi057 ceph-mon[92072]: pgmap v3120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:55 smithi122 ceph-mon[125440]: pgmap v3120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:55 smithi136 ceph-mon[125702]: pgmap v3120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:57 smithi057 ceph-mon[92072]: pgmap v3121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:57 smithi122 ceph-mon[125440]: pgmap v3121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:57 smithi136 ceph-mon[125702]: pgmap v3121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:34:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:34:59 smithi057 ceph-mon[92072]: pgmap v3122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:34:59 smithi122 ceph-mon[125440]: pgmap v3122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:34:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:34:59 smithi136 ceph-mon[125702]: pgmap v3122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:01 smithi057 ceph-mon[92072]: pgmap v3123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:01 smithi122 ceph-mon[125440]: pgmap v3123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:01 smithi136 ceph-mon[125702]: pgmap v3123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:03 smithi122 ceph-mon[125440]: pgmap v3124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:35:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:03 smithi136 ceph-mon[125702]: pgmap v3124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:35:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:03 smithi057 ceph-mon[92072]: pgmap v3124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:35:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:05 smithi122 ceph-mon[125440]: pgmap v3125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:35:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:05 smithi136 ceph-mon[125702]: pgmap v3125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:35:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:05 smithi057 ceph-mon[92072]: pgmap v3125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:35:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:07 smithi122 ceph-mon[125440]: pgmap v3126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:35:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:07 smithi136 ceph-mon[125702]: pgmap v3126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:35:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:07 smithi057 ceph-mon[92072]: pgmap v3126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:35:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:08.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:35:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:08.378+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:35:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:08.378+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:35:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:08.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:35:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:08.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:35:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:09.179+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T12:35:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:09.179+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:35:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:09.180+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 48 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T12:35:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:09.180+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 49 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:35:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:09 smithi122 ceph-mon[125440]: pgmap v3127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:35:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:09 smithi136 ceph-mon[125702]: pgmap v3127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:35:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:09 smithi057 ceph-mon[92072]: pgmap v3127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:35:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:11 smithi136 ceph-mon[125702]: pgmap v3128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:35:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:11 smithi136 ceph-mon[125702]: osdmap e269: 12 total, 12 up, 12 in 2023-03-02T12:35:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:11 smithi057 ceph-mon[92072]: pgmap v3128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:35:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:11 smithi057 ceph-mon[92072]: osdmap e269: 12 total, 12 up, 12 in 2023-03-02T12:35:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:11 smithi122 ceph-mon[125440]: pgmap v3128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:35:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:11 smithi122 ceph-mon[125440]: osdmap e269: 12 total, 12 up, 12 in 2023-03-02T12:35:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:13 smithi136 ceph-mon[125702]: pgmap v3130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:35:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:13 smithi057 ceph-mon[92072]: pgmap v3130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:35:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:13 smithi122 ceph-mon[125440]: pgmap v3130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:35:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:15 smithi136 ceph-mon[125702]: pgmap v3131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:35:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:15 smithi136 ceph-mon[125702]: osdmap e270: 12 total, 12 up, 12 in 2023-03-02T12:35:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:15 smithi057 ceph-mon[92072]: pgmap v3131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:35:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:15 smithi057 ceph-mon[92072]: osdmap e270: 12 total, 12 up, 12 in 2023-03-02T12:35:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:15 smithi122 ceph-mon[125440]: pgmap v3131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:35:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:15 smithi122 ceph-mon[125440]: osdmap e270: 12 total, 12 up, 12 in 2023-03-02T12:35:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:35:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:35:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:35:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:17 smithi136 ceph-mon[125702]: pgmap v3133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:35:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:17 smithi057 ceph-mon[92072]: pgmap v3133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:35:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:17 smithi122 ceph-mon[125440]: pgmap v3133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:35:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:35:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:35:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:35:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:35:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:35:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:35:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:35:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:35:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:35:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:19 smithi136 ceph-mon[125702]: pgmap v3134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:35:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:19 smithi057 ceph-mon[92072]: pgmap v3134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:35:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:19 smithi122 ceph-mon[125440]: pgmap v3134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:35:21.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:21 smithi136 ceph-mon[125702]: pgmap v3135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:35:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:21 smithi057 ceph-mon[92072]: pgmap v3135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:35:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:21 smithi122 ceph-mon[125440]: pgmap v3135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:35:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:23.384+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:35:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:23.384+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:35:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:23.384+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:35:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:23.384+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:35:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:23.384+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:35:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:23 smithi136 ceph-mon[125702]: pgmap v3136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:35:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:23 smithi057 ceph-mon[92072]: pgmap v3136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:35:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:23 smithi122 ceph-mon[125440]: pgmap v3136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:35:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:25 smithi136 ceph-mon[125702]: pgmap v3137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:35:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:25 smithi057 ceph-mon[92072]: pgmap v3137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:35:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:25 smithi122 ceph-mon[125440]: pgmap v3137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:35:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:27 smithi136 ceph-mon[125702]: pgmap v3138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:35:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:27 smithi057 ceph-mon[92072]: pgmap v3138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:35:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:27 smithi122 ceph-mon[125440]: pgmap v3138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:35:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:28 smithi136 ceph-mon[125702]: pgmap v3139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:35:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:28 smithi057 ceph-mon[92072]: pgmap v3139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:35:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:28 smithi122 ceph-mon[125440]: pgmap v3139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:35:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:31 smithi057 ceph-mon[92072]: pgmap v3140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:31 smithi122 ceph-mon[125440]: pgmap v3140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:31 smithi136 ceph-mon[125702]: pgmap v3140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:33 smithi057 ceph-mon[92072]: pgmap v3141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:33 smithi122 ceph-mon[125440]: pgmap v3141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:33 smithi136 ceph-mon[125702]: pgmap v3141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:35 smithi057 ceph-mon[92072]: pgmap v3142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:35 smithi122 ceph-mon[125440]: pgmap v3142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:35 smithi136 ceph-mon[125702]: pgmap v3142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:37 smithi057 ceph-mon[92072]: pgmap v3143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:37 smithi122 ceph-mon[125440]: pgmap v3143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:37 smithi136 ceph-mon[125702]: pgmap v3143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:38.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:35:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:38.394+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:35:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:38.394+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:35:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:38.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:35:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:38.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:35:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:39 smithi057 ceph-mon[92072]: pgmap v3144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:39 smithi122 ceph-mon[125440]: pgmap v3144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:39 smithi136 ceph-mon[125702]: pgmap v3144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:41 smithi057 ceph-mon[92072]: pgmap v3145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:41 smithi122 ceph-mon[125440]: pgmap v3145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:41 smithi136 ceph-mon[125702]: pgmap v3145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:43 smithi057 ceph-mon[92072]: pgmap v3146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:43 smithi122 ceph-mon[125440]: pgmap v3146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:43 smithi136 ceph-mon[125702]: pgmap v3146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:45 smithi057 ceph-mon[92072]: pgmap v3147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:45 smithi122 ceph-mon[125440]: pgmap v3147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:45 smithi136 ceph-mon[125702]: pgmap v3147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:47 smithi057 ceph-mon[92072]: pgmap v3148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:47 smithi122 ceph-mon[125440]: pgmap v3148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:47 smithi136 ceph-mon[125702]: pgmap v3148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:49 smithi057 ceph-mon[92072]: pgmap v3149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:49 smithi122 ceph-mon[125440]: pgmap v3149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:49 smithi136 ceph-mon[125702]: pgmap v3149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:51 smithi122 ceph-mon[125440]: pgmap v3150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:51 smithi136 ceph-mon[125702]: pgmap v3150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:51 smithi057 ceph-mon[92072]: pgmap v3150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:53.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:53.406+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:35:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:53.406+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:35:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:53.406+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:35:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:53.406+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:35:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:35:53.406+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:35:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:53 smithi122 ceph-mon[125440]: pgmap v3151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:53 smithi136 ceph-mon[125702]: pgmap v3151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:53 smithi057 ceph-mon[92072]: pgmap v3151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:55 smithi122 ceph-mon[125440]: pgmap v3152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:55 smithi136 ceph-mon[125702]: pgmap v3152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:55 smithi057 ceph-mon[92072]: pgmap v3152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:57 smithi136 ceph-mon[125702]: pgmap v3153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:57 smithi057 ceph-mon[92072]: pgmap v3153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:57 smithi122 ceph-mon[125440]: pgmap v3153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:35:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:35:59 smithi136 ceph-mon[125702]: pgmap v3154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:35:59 smithi057 ceph-mon[92072]: pgmap v3154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:35:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:35:59 smithi122 ceph-mon[125440]: pgmap v3154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:01 smithi136 ceph-mon[125702]: pgmap v3155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:01 smithi057 ceph-mon[92072]: pgmap v3155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:01 smithi122 ceph-mon[125440]: pgmap v3155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:03 smithi136 ceph-mon[125702]: pgmap v3156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:36:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:03 smithi057 ceph-mon[92072]: pgmap v3156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:36:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:03 smithi122 ceph-mon[125440]: pgmap v3156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:36:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:05 smithi136 ceph-mon[125702]: pgmap v3157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:36:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:05 smithi057 ceph-mon[92072]: pgmap v3157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:36:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:05 smithi122 ceph-mon[125440]: pgmap v3157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:36:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:07 smithi136 ceph-mon[125702]: pgmap v3158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:36:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:07 smithi057 ceph-mon[92072]: pgmap v3158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:36:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:07 smithi122 ceph-mon[125440]: pgmap v3158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:36:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:08.421+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:36:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:08.422+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:36:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:08.422+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:36:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:08.422+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:36:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:08.422+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:36:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:09 smithi136 ceph-mon[125702]: pgmap v3159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:36:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:09 smithi057 ceph-mon[92072]: pgmap v3159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:36:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:09 smithi122 ceph-mon[125440]: pgmap v3159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:36:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:11 smithi136 ceph-mon[125702]: pgmap v3160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:36:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:11 smithi136 ceph-mon[125702]: osdmap e271: 12 total, 12 up, 12 in 2023-03-02T12:36:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:11 smithi057 ceph-mon[92072]: pgmap v3160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:36:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:11 smithi057 ceph-mon[92072]: osdmap e271: 12 total, 12 up, 12 in 2023-03-02T12:36:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:11 smithi122 ceph-mon[125440]: pgmap v3160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:36:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:11 smithi122 ceph-mon[125440]: osdmap e271: 12 total, 12 up, 12 in 2023-03-02T12:36:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:13 smithi136 ceph-mon[125702]: pgmap v3162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:36:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:13 smithi057 ceph-mon[92072]: pgmap v3162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:36:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:13 smithi122 ceph-mon[125440]: pgmap v3162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:36:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:15 smithi136 ceph-mon[125702]: pgmap v3163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:36:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:15 smithi136 ceph-mon[125702]: osdmap e272: 12 total, 12 up, 12 in 2023-03-02T12:36:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:15 smithi057 ceph-mon[92072]: pgmap v3163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:36:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:15 smithi057 ceph-mon[92072]: osdmap e272: 12 total, 12 up, 12 in 2023-03-02T12:36:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:15 smithi122 ceph-mon[125440]: pgmap v3163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:36:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:15 smithi122 ceph-mon[125440]: osdmap e272: 12 total, 12 up, 12 in 2023-03-02T12:36:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:17 smithi136 ceph-mon[125702]: pgmap v3165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:36:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:17 smithi057 ceph-mon[92072]: pgmap v3165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:36:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:17 smithi122 ceph-mon[125440]: pgmap v3165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:36:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:36:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:36:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:36:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:19 smithi136 ceph-mon[125702]: pgmap v3166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:36:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:36:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:36:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:36:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:19 smithi057 ceph-mon[92072]: pgmap v3166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:36:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:36:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:36:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:36:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:19 smithi122 ceph-mon[125440]: pgmap v3166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:36:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:36:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:36:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:36:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:21 smithi057 ceph-mon[92072]: pgmap v3167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:36:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:21 smithi122 ceph-mon[125440]: pgmap v3167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:36:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:21 smithi136 ceph-mon[125702]: pgmap v3167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:36:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:23.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:36:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:23.436+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:36:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:23.436+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:36:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:23.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:36:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:23.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:36:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:23 smithi057 ceph-mon[92072]: pgmap v3168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:36:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:23 smithi122 ceph-mon[125440]: pgmap v3168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:36:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:23 smithi136 ceph-mon[125702]: pgmap v3168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:36:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:25 smithi057 ceph-mon[92072]: pgmap v3169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:36:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:25 smithi122 ceph-mon[125440]: pgmap v3169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:36:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:25 smithi136 ceph-mon[125702]: pgmap v3169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:36:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:27 smithi057 ceph-mon[92072]: pgmap v3170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:36:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:27 smithi122 ceph-mon[125440]: pgmap v3170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:36:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:27 smithi136 ceph-mon[125702]: pgmap v3170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:36:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:29 smithi057 ceph-mon[92072]: pgmap v3171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:36:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:29 smithi122 ceph-mon[125440]: pgmap v3171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:36:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:29 smithi136 ceph-mon[125702]: pgmap v3171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:36:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:31 smithi057 ceph-mon[92072]: pgmap v3172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:31 smithi122 ceph-mon[125440]: pgmap v3172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:31 smithi136 ceph-mon[125702]: pgmap v3172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:33 smithi122 ceph-mon[125440]: pgmap v3173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:33 smithi136 ceph-mon[125702]: pgmap v3173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:33 smithi057 ceph-mon[92072]: pgmap v3173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:35 smithi122 ceph-mon[125440]: pgmap v3174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:35 smithi136 ceph-mon[125702]: pgmap v3174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:35 smithi057 ceph-mon[92072]: pgmap v3174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:37 smithi122 ceph-mon[125440]: pgmap v3175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:37 smithi136 ceph-mon[125702]: pgmap v3175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:37 smithi057 ceph-mon[92072]: pgmap v3175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:38.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:36:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:38.442+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:36:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:38.442+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:36:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:38.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:36:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:38.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:36:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:39 smithi122 ceph-mon[125440]: pgmap v3176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:39 smithi136 ceph-mon[125702]: pgmap v3176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:39 smithi057 ceph-mon[92072]: pgmap v3176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:41 smithi136 ceph-mon[125702]: pgmap v3177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:41 smithi057 ceph-mon[92072]: pgmap v3177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:41 smithi122 ceph-mon[125440]: pgmap v3177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:43 smithi136 ceph-mon[125702]: pgmap v3178: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:43 smithi057 ceph-mon[92072]: pgmap v3178: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:43 smithi122 ceph-mon[125440]: pgmap v3178: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:45 smithi136 ceph-mon[125702]: pgmap v3179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:45 smithi057 ceph-mon[92072]: pgmap v3179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:45 smithi122 ceph-mon[125440]: pgmap v3179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:47 smithi136 ceph-mon[125702]: pgmap v3180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:47 smithi057 ceph-mon[92072]: pgmap v3180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:47 smithi122 ceph-mon[125440]: pgmap v3180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:49 smithi136 ceph-mon[125702]: pgmap v3181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:49 smithi057 ceph-mon[92072]: pgmap v3181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:49 smithi122 ceph-mon[125440]: pgmap v3181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:51 smithi136 ceph-mon[125702]: pgmap v3182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:51 smithi057 ceph-mon[92072]: pgmap v3182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:51 smithi122 ceph-mon[125440]: pgmap v3182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:53.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:36:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:53.448+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:36:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:53.448+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:36:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:53.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:36:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:36:53.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:36:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:53 smithi136 ceph-mon[125702]: pgmap v3183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:53 smithi057 ceph-mon[92072]: pgmap v3183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:53 smithi122 ceph-mon[125440]: pgmap v3183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:55 smithi136 ceph-mon[125702]: pgmap v3184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:55 smithi057 ceph-mon[92072]: pgmap v3184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:55 smithi122 ceph-mon[125440]: pgmap v3184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:57 smithi136 ceph-mon[125702]: pgmap v3185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:57 smithi057 ceph-mon[92072]: pgmap v3185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:57 smithi122 ceph-mon[125440]: pgmap v3185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:36:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:36:59 smithi136 ceph-mon[125702]: pgmap v3186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:36:59 smithi057 ceph-mon[92072]: pgmap v3186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:36:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:36:59 smithi122 ceph-mon[125440]: pgmap v3186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:01 smithi136 ceph-mon[125702]: pgmap v3187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:01 smithi057 ceph-mon[92072]: pgmap v3187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:01 smithi122 ceph-mon[125440]: pgmap v3187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:03 smithi136 ceph-mon[125702]: pgmap v3188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:37:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:03 smithi057 ceph-mon[92072]: pgmap v3188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:37:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:03 smithi122 ceph-mon[125440]: pgmap v3188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:37:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:04 smithi136 ceph-mon[125702]: pgmap v3189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:37:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:04 smithi057 ceph-mon[92072]: pgmap v3189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:37:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:04 smithi122 ceph-mon[125440]: pgmap v3189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:37:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:06 smithi136 ceph-mon[125702]: osdmap e273: 12 total, 12 up, 12 in 2023-03-02T12:37:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:06 smithi136 ceph-mon[125702]: pgmap v3191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:37:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:06 smithi057 ceph-mon[92072]: osdmap e273: 12 total, 12 up, 12 in 2023-03-02T12:37:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:06 smithi057 ceph-mon[92072]: pgmap v3191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:37:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:06 smithi122 ceph-mon[125440]: osdmap e273: 12 total, 12 up, 12 in 2023-03-02T12:37:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:06 smithi122 ceph-mon[125440]: pgmap v3191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:37:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:08.463+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:37:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:08.463+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:37:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:08.463+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:37:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:08.463+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:37:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:08.463+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:37:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:09 smithi057 ceph-mon[92072]: pgmap v3192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:37:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:09 smithi122 ceph-mon[125440]: pgmap v3192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:37:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:09 smithi136 ceph-mon[125702]: pgmap v3192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:37:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:11 smithi057 ceph-mon[92072]: pgmap v3193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:37:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:11 smithi057 ceph-mon[92072]: osdmap e274: 12 total, 12 up, 12 in 2023-03-02T12:37:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:11 smithi122 ceph-mon[125440]: pgmap v3193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:37:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:11 smithi122 ceph-mon[125440]: osdmap e274: 12 total, 12 up, 12 in 2023-03-02T12:37:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:11 smithi136 ceph-mon[125702]: pgmap v3193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:37:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:11 smithi136 ceph-mon[125702]: osdmap e274: 12 total, 12 up, 12 in 2023-03-02T12:37:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:13 smithi057 ceph-mon[92072]: pgmap v3195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:37:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:13 smithi122 ceph-mon[125440]: pgmap v3195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:37:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:13 smithi136 ceph-mon[125702]: pgmap v3195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:37:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:15 smithi057 ceph-mon[92072]: pgmap v3196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T12:37:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:15 smithi122 ceph-mon[125440]: pgmap v3196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T12:37:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:15 smithi136 ceph-mon[125702]: pgmap v3196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T12:37:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:17 smithi057 ceph-mon[92072]: pgmap v3197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:37:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:17 smithi122 ceph-mon[125440]: pgmap v3197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:37:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:17 smithi136 ceph-mon[125702]: pgmap v3197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:37:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:19 smithi122 ceph-mon[125440]: pgmap v3198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:37:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:37:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:19 smithi136 ceph-mon[125702]: pgmap v3198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:37:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:37:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:19 smithi057 ceph-mon[92072]: pgmap v3198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:37:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:37:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:37:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:37:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:37:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:37:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:37:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:37:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:37:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:37:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:37:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:21 smithi122 ceph-mon[125440]: pgmap v3199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:37:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:21 smithi136 ceph-mon[125702]: pgmap v3199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:37:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:21 smithi057 ceph-mon[92072]: pgmap v3199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:37:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:23.477+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:37:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:23.477+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:37:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:23.477+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:37:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:23.477+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:37:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:23.477+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:37:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:23 smithi122 ceph-mon[125440]: pgmap v3200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:37:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:23 smithi136 ceph-mon[125702]: pgmap v3200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:37:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:23 smithi057 ceph-mon[92072]: pgmap v3200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:37:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:25 smithi122 ceph-mon[125440]: pgmap v3201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:25 smithi136 ceph-mon[125702]: pgmap v3201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:25 smithi057 ceph-mon[92072]: pgmap v3201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:27 smithi136 ceph-mon[125702]: pgmap v3202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:27 smithi057 ceph-mon[92072]: pgmap v3202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:27 smithi122 ceph-mon[125440]: pgmap v3202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:29 smithi136 ceph-mon[125702]: pgmap v3203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:29 smithi057 ceph-mon[92072]: pgmap v3203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:29 smithi122 ceph-mon[125440]: pgmap v3203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:31 smithi136 ceph-mon[125702]: pgmap v3204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:31 smithi057 ceph-mon[92072]: pgmap v3204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:31 smithi122 ceph-mon[125440]: pgmap v3204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:33 smithi136 ceph-mon[125702]: pgmap v3205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:33 smithi057 ceph-mon[92072]: pgmap v3205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:33 smithi122 ceph-mon[125440]: pgmap v3205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:35 smithi136 ceph-mon[125702]: pgmap v3206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:35 smithi057 ceph-mon[92072]: pgmap v3206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:35 smithi122 ceph-mon[125440]: pgmap v3206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:37 smithi136 ceph-mon[125702]: pgmap v3207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:37 smithi057 ceph-mon[92072]: pgmap v3207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:37 smithi122 ceph-mon[125440]: pgmap v3207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:38.478+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:37:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:38.478+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:37:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:38.478+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:37:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:38.478+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:37:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:38.478+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:37:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:39 smithi136 ceph-mon[125702]: pgmap v3208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:39 smithi057 ceph-mon[92072]: pgmap v3208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:39 smithi122 ceph-mon[125440]: pgmap v3208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:41 smithi136 ceph-mon[125702]: pgmap v3209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:41 smithi057 ceph-mon[92072]: pgmap v3209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:41 smithi122 ceph-mon[125440]: pgmap v3209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:43 smithi136 ceph-mon[125702]: pgmap v3210: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:43 smithi057 ceph-mon[92072]: pgmap v3210: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:43 smithi122 ceph-mon[125440]: pgmap v3210: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:45 smithi136 ceph-mon[125702]: pgmap v3211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:45 smithi057 ceph-mon[92072]: pgmap v3211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:45 smithi122 ceph-mon[125440]: pgmap v3211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:47 smithi136 ceph-mon[125702]: pgmap v3212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:47 smithi057 ceph-mon[92072]: pgmap v3212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:47 smithi122 ceph-mon[125440]: pgmap v3212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:49 smithi136 ceph-mon[125702]: pgmap v3213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:49 smithi057 ceph-mon[92072]: pgmap v3213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:49 smithi122 ceph-mon[125440]: pgmap v3213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:51 smithi136 ceph-mon[125702]: pgmap v3214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:51 smithi057 ceph-mon[92072]: pgmap v3214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:51 smithi122 ceph-mon[125440]: pgmap v3214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:53.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:37:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:53.493+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:37:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:53.493+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:37:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:53.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:37:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:37:53.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:37:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:53 smithi136 ceph-mon[125702]: pgmap v3215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:53 smithi057 ceph-mon[92072]: pgmap v3215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:53 smithi122 ceph-mon[125440]: pgmap v3215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:55 smithi136 ceph-mon[125702]: pgmap v3216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:55 smithi057 ceph-mon[92072]: pgmap v3216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:55 smithi122 ceph-mon[125440]: pgmap v3216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:57 smithi136 ceph-mon[125702]: pgmap v3217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:57 smithi057 ceph-mon[92072]: pgmap v3217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:57 smithi122 ceph-mon[125440]: pgmap v3217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:37:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:37:58 smithi136 ceph-mon[125702]: pgmap v3218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:37:58 smithi057 ceph-mon[92072]: pgmap v3218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:37:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:37:58 smithi122 ceph-mon[125440]: pgmap v3218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:01 smithi122 ceph-mon[125440]: pgmap v3219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:01 smithi136 ceph-mon[125702]: pgmap v3219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:01 smithi057 ceph-mon[92072]: pgmap v3219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:03 smithi122 ceph-mon[125440]: pgmap v3220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:38:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:03 smithi136 ceph-mon[125702]: pgmap v3220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:38:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:03 smithi057 ceph-mon[92072]: pgmap v3220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:38:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:05 smithi122 ceph-mon[125440]: pgmap v3221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:38:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:05 smithi136 ceph-mon[125702]: pgmap v3221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:38:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:05 smithi057 ceph-mon[92072]: pgmap v3221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:38:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:07 smithi122 ceph-mon[125440]: pgmap v3222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:38:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:07 smithi136 ceph-mon[125702]: pgmap v3222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:38:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:07 smithi057 ceph-mon[92072]: pgmap v3222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:38:08.510 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:08.509+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:38:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:08.510+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:38:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:08.510+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:38:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:08.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:38:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:08.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:38:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:09.202+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T12:38:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:09.202+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:38:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:09.202+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 50 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T12:38:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:09.202+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:38:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:09.202+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 49 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T12:38:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:09.202+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:38:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:09.203+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 51 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:38:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:09.203+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 50 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:38:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:09 smithi122 ceph-mon[125440]: pgmap v3223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:38:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:09 smithi136 ceph-mon[125702]: pgmap v3223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:38:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:09 smithi057 ceph-mon[92072]: pgmap v3223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:38:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:11 smithi136 ceph-mon[125702]: pgmap v3224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:38:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:11 smithi136 ceph-mon[125702]: osdmap e275: 12 total, 12 up, 12 in 2023-03-02T12:38:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:11 smithi057 ceph-mon[92072]: pgmap v3224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:38:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:11 smithi057 ceph-mon[92072]: osdmap e275: 12 total, 12 up, 12 in 2023-03-02T12:38:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:11 smithi122 ceph-mon[125440]: pgmap v3224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:38:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:11 smithi122 ceph-mon[125440]: osdmap e275: 12 total, 12 up, 12 in 2023-03-02T12:38:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:13 smithi136 ceph-mon[125702]: pgmap v3226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:13 smithi057 ceph-mon[92072]: pgmap v3226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:13 smithi122 ceph-mon[125440]: pgmap v3226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:15 smithi136 ceph-mon[125702]: pgmap v3227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:15 smithi136 ceph-mon[125702]: osdmap e276: 12 total, 12 up, 12 in 2023-03-02T12:38:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:15 smithi057 ceph-mon[92072]: pgmap v3227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:15 smithi057 ceph-mon[92072]: osdmap e276: 12 total, 12 up, 12 in 2023-03-02T12:38:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:15 smithi122 ceph-mon[125440]: pgmap v3227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:15 smithi122 ceph-mon[125440]: osdmap e276: 12 total, 12 up, 12 in 2023-03-02T12:38:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:17 smithi136 ceph-mon[125702]: pgmap v3229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:38:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:17 smithi057 ceph-mon[92072]: pgmap v3229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:38:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:17 smithi122 ceph-mon[125440]: pgmap v3229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:38:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:19 smithi136 ceph-mon[125702]: pgmap v3230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:38:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:19 smithi057 ceph-mon[92072]: pgmap v3230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:38:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:19 smithi122 ceph-mon[125440]: pgmap v3230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:38:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:38:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:38:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:38:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:21 smithi136 ceph-mon[125702]: pgmap v3231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 310 B/s wr, 10 op/s 2023-03-02T12:38:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:38:21.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:38:21.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:38:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:21 smithi057 ceph-mon[92072]: pgmap v3231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 310 B/s wr, 10 op/s 2023-03-02T12:38:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:38:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:38:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:38:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:21 smithi122 ceph-mon[125440]: pgmap v3231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 310 B/s wr, 10 op/s 2023-03-02T12:38:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:38:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:38:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:38:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:23.525+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:38:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:23.525+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:38:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:23.525+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:38:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:23.525+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:38:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:23.525+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:38:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:23 smithi136 ceph-mon[125702]: pgmap v3232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:23 smithi057 ceph-mon[92072]: pgmap v3232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:23 smithi122 ceph-mon[125440]: pgmap v3232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:25 smithi136 ceph-mon[125702]: pgmap v3233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:25 smithi057 ceph-mon[92072]: pgmap v3233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:25 smithi122 ceph-mon[125440]: pgmap v3233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:38:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:27 smithi136 ceph-mon[125702]: pgmap v3234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:38:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:27 smithi057 ceph-mon[92072]: pgmap v3234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:38:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:27 smithi122 ceph-mon[125440]: pgmap v3234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:38:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:29 smithi136 ceph-mon[125702]: pgmap v3235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:38:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:29 smithi057 ceph-mon[92072]: pgmap v3235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:38:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:29 smithi122 ceph-mon[125440]: pgmap v3235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:38:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:31 smithi136 ceph-mon[125702]: pgmap v3236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:31 smithi057 ceph-mon[92072]: pgmap v3236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:31 smithi122 ceph-mon[125440]: pgmap v3236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:33 smithi136 ceph-mon[125702]: pgmap v3237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:33 smithi057 ceph-mon[92072]: pgmap v3237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:33 smithi122 ceph-mon[125440]: pgmap v3237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:34 smithi136 ceph-mon[125702]: pgmap v3238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:34 smithi057 ceph-mon[92072]: pgmap v3238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:34 smithi122 ceph-mon[125440]: pgmap v3238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:37 smithi122 ceph-mon[125440]: pgmap v3239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:37 smithi136 ceph-mon[125702]: pgmap v3239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:37 smithi057 ceph-mon[92072]: pgmap v3239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:38.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:38:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:38.541+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:38:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:38.541+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:38:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:38.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:38:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:38.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:38:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:39 smithi122 ceph-mon[125440]: pgmap v3240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:39 smithi136 ceph-mon[125702]: pgmap v3240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:39 smithi057 ceph-mon[92072]: pgmap v3240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:41 smithi122 ceph-mon[125440]: pgmap v3241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:41 smithi136 ceph-mon[125702]: pgmap v3241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:41 smithi057 ceph-mon[92072]: pgmap v3241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:43 smithi136 ceph-mon[125702]: pgmap v3242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:43 smithi057 ceph-mon[92072]: pgmap v3242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:43 smithi122 ceph-mon[125440]: pgmap v3242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:45 smithi136 ceph-mon[125702]: pgmap v3243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:45 smithi057 ceph-mon[92072]: pgmap v3243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:45 smithi122 ceph-mon[125440]: pgmap v3243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:47 smithi136 ceph-mon[125702]: pgmap v3244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:47 smithi057 ceph-mon[92072]: pgmap v3244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:47 smithi122 ceph-mon[125440]: pgmap v3244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:49 smithi136 ceph-mon[125702]: pgmap v3245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:49 smithi057 ceph-mon[92072]: pgmap v3245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:49 smithi122 ceph-mon[125440]: pgmap v3245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:51 smithi136 ceph-mon[125702]: pgmap v3246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:51 smithi057 ceph-mon[92072]: pgmap v3246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:51 smithi122 ceph-mon[125440]: pgmap v3246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:53.547+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:38:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:53.547+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:38:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:53.547+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:38:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:53.547+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:38:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:38:53.547+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:38:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:53 smithi136 ceph-mon[125702]: pgmap v3247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:53 smithi057 ceph-mon[92072]: pgmap v3247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:53 smithi122 ceph-mon[125440]: pgmap v3247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:55 smithi136 ceph-mon[125702]: pgmap v3248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:55 smithi057 ceph-mon[92072]: pgmap v3248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:55 smithi122 ceph-mon[125440]: pgmap v3248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:57 smithi136 ceph-mon[125702]: pgmap v3249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:57 smithi057 ceph-mon[92072]: pgmap v3249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:57 smithi122 ceph-mon[125440]: pgmap v3249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:38:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:38:59 smithi136 ceph-mon[125702]: pgmap v3250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:38:59 smithi057 ceph-mon[92072]: pgmap v3250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:38:59.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:38:59 smithi122 ceph-mon[125440]: pgmap v3250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:01 smithi136 ceph-mon[125702]: pgmap v3251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:01 smithi057 ceph-mon[92072]: pgmap v3251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:01 smithi122 ceph-mon[125440]: pgmap v3251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:03 smithi136 ceph-mon[125702]: pgmap v3252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:39:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:03 smithi057 ceph-mon[92072]: pgmap v3252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:39:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:03 smithi122 ceph-mon[125440]: pgmap v3252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:39:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:05 smithi136 ceph-mon[125702]: pgmap v3253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:39:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:05 smithi057 ceph-mon[92072]: pgmap v3253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:39:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:05 smithi122 ceph-mon[125440]: pgmap v3253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:39:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:07 smithi136 ceph-mon[125702]: pgmap v3254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:39:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:07 smithi057 ceph-mon[92072]: pgmap v3254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:39:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:07 smithi122 ceph-mon[125440]: pgmap v3254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:39:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:08.551+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:39:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:08.551+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:39:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:08.551+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:39:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:08.551+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:39:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:08.551+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:39:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:09 smithi136 ceph-mon[125702]: pgmap v3255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:39:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:09 smithi057 ceph-mon[92072]: pgmap v3255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:39:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:09 smithi122 ceph-mon[125440]: pgmap v3255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:39:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:11 smithi136 ceph-mon[125702]: pgmap v3256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:39:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:11 smithi136 ceph-mon[125702]: osdmap e277: 12 total, 12 up, 12 in 2023-03-02T12:39:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:11 smithi057 ceph-mon[92072]: pgmap v3256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:39:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:11 smithi057 ceph-mon[92072]: osdmap e277: 12 total, 12 up, 12 in 2023-03-02T12:39:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:11 smithi122 ceph-mon[125440]: pgmap v3256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:39:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:11 smithi122 ceph-mon[125440]: osdmap e277: 12 total, 12 up, 12 in 2023-03-02T12:39:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:13 smithi136 ceph-mon[125702]: pgmap v3258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:39:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:13 smithi057 ceph-mon[92072]: pgmap v3258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:39:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:13 smithi122 ceph-mon[125440]: pgmap v3258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:39:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:15 smithi136 ceph-mon[125702]: pgmap v3259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:39:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:15 smithi136 ceph-mon[125702]: osdmap e278: 12 total, 12 up, 12 in 2023-03-02T12:39:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:15 smithi057 ceph-mon[92072]: pgmap v3259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:39:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:15 smithi057 ceph-mon[92072]: osdmap e278: 12 total, 12 up, 12 in 2023-03-02T12:39:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:15 smithi122 ceph-mon[125440]: pgmap v3259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:39:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:15 smithi122 ceph-mon[125440]: osdmap e278: 12 total, 12 up, 12 in 2023-03-02T12:39:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:17 smithi136 ceph-mon[125702]: pgmap v3261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:39:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:17 smithi057 ceph-mon[92072]: pgmap v3261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:39:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:17 smithi122 ceph-mon[125440]: pgmap v3261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:39:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:19 smithi136 ceph-mon[125702]: pgmap v3262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:39:19.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:19 smithi057 ceph-mon[92072]: pgmap v3262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:39:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:19 smithi122 ceph-mon[125440]: pgmap v3262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:39:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:21 smithi136 ceph-mon[125702]: pgmap v3263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:39:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:39:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:21 smithi057 ceph-mon[92072]: pgmap v3263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:39:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:39:21.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:21 smithi122 ceph-mon[125440]: pgmap v3263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:39:21.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:39:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:39:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:39:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:39:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:22 smithi136 ceph-mon[125702]: pgmap v3264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:39:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:39:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:39:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:39:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:22 smithi057 ceph-mon[92072]: pgmap v3264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:39:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:39:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:39:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:39:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:22 smithi122 ceph-mon[125440]: pgmap v3264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:39:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:23.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:39:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:23.560+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:39:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:23.560+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:39:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:23.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:39:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:23.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:39:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:25 smithi057 ceph-mon[92072]: pgmap v3265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:39:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:25 smithi122 ceph-mon[125440]: pgmap v3265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:39:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:25 smithi136 ceph-mon[125702]: pgmap v3265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:39:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:27 smithi136 ceph-mon[125702]: pgmap v3266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:39:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:27 smithi057 ceph-mon[92072]: pgmap v3266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:39:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:27 smithi122 ceph-mon[125440]: pgmap v3266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:39:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:29 smithi136 ceph-mon[125702]: pgmap v3267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:39:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:29 smithi057 ceph-mon[92072]: pgmap v3267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:39:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:29 smithi122 ceph-mon[125440]: pgmap v3267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:39:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:31 smithi136 ceph-mon[125702]: pgmap v3268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:31 smithi057 ceph-mon[92072]: pgmap v3268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:31 smithi122 ceph-mon[125440]: pgmap v3268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:33 smithi136 ceph-mon[125702]: pgmap v3269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:33 smithi057 ceph-mon[92072]: pgmap v3269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:33 smithi122 ceph-mon[125440]: pgmap v3269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:35 smithi136 ceph-mon[125702]: pgmap v3270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:35 smithi057 ceph-mon[92072]: pgmap v3270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:35 smithi122 ceph-mon[125440]: pgmap v3270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:37 smithi136 ceph-mon[125702]: pgmap v3271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:37 smithi057 ceph-mon[92072]: pgmap v3271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:37 smithi122 ceph-mon[125440]: pgmap v3271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:38.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:39:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:38.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:39:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:38.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:39:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:38.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:39:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:38.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:39:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:39 smithi136 ceph-mon[125702]: pgmap v3272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:39 smithi057 ceph-mon[92072]: pgmap v3272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:39 smithi122 ceph-mon[125440]: pgmap v3272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:41 smithi136 ceph-mon[125702]: pgmap v3273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:41 smithi057 ceph-mon[92072]: pgmap v3273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:41 smithi122 ceph-mon[125440]: pgmap v3273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:43 smithi136 ceph-mon[125702]: pgmap v3274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:43 smithi057 ceph-mon[92072]: pgmap v3274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:43 smithi122 ceph-mon[125440]: pgmap v3274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:45 smithi136 ceph-mon[125702]: pgmap v3275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:45 smithi057 ceph-mon[92072]: pgmap v3275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:45 smithi122 ceph-mon[125440]: pgmap v3275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:47 smithi136 ceph-mon[125702]: pgmap v3276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:47 smithi057 ceph-mon[92072]: pgmap v3276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:47 smithi122 ceph-mon[125440]: pgmap v3276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:49 smithi136 ceph-mon[125702]: pgmap v3277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:49 smithi057 ceph-mon[92072]: pgmap v3277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:49 smithi122 ceph-mon[125440]: pgmap v3277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:51 smithi136 ceph-mon[125702]: pgmap v3278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:51 smithi057 ceph-mon[92072]: pgmap v3278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:51 smithi122 ceph-mon[125440]: pgmap v3278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:53.572+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:39:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:53.573+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:39:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:53.573+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:39:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:53.573+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:39:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:39:53.573+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:39:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:53 smithi136 ceph-mon[125702]: pgmap v3279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:53 smithi057 ceph-mon[92072]: pgmap v3279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:53 smithi122 ceph-mon[125440]: pgmap v3279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:55 smithi136 ceph-mon[125702]: pgmap v3280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:55 smithi057 ceph-mon[92072]: pgmap v3280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:55 smithi122 ceph-mon[125440]: pgmap v3280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:57 smithi136 ceph-mon[125702]: pgmap v3281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:57 smithi057 ceph-mon[92072]: pgmap v3281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:57 smithi122 ceph-mon[125440]: pgmap v3281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:39:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:39:59 smithi136 ceph-mon[125702]: pgmap v3282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:39:59 smithi057 ceph-mon[92072]: pgmap v3282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:39:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:39:59 smithi122 ceph-mon[125440]: pgmap v3282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T12:40:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T12:40:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T12:40:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:01 smithi136 ceph-mon[125702]: pgmap v3283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:01 smithi057 ceph-mon[92072]: pgmap v3283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:01 smithi122 ceph-mon[125440]: pgmap v3283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:03 smithi136 ceph-mon[125702]: pgmap v3284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:40:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:03 smithi057 ceph-mon[92072]: pgmap v3284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:40:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:03 smithi122 ceph-mon[125440]: pgmap v3284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:40:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:05 smithi136 ceph-mon[125702]: pgmap v3285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:40:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:05 smithi057 ceph-mon[92072]: pgmap v3285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:40:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:05 smithi122 ceph-mon[125440]: pgmap v3285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:40:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:07 smithi136 ceph-mon[125702]: pgmap v3286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:40:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:07 smithi057 ceph-mon[92072]: pgmap v3286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:40:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:07 smithi122 ceph-mon[125440]: pgmap v3286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:40:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:08.589+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:40:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:08.590+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:40:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:08.590+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:40:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:08.590+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:40:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:08.590+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:40:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:08 smithi136 ceph-mon[125702]: pgmap v3287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:40:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:08 smithi057 ceph-mon[92072]: pgmap v3287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:40:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:08 smithi122 ceph-mon[125440]: pgmap v3287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:40:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:11 smithi122 ceph-mon[125440]: osdmap e279: 12 total, 12 up, 12 in 2023-03-02T12:40:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:11 smithi122 ceph-mon[125440]: pgmap v3289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:40:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:11 smithi136 ceph-mon[125702]: osdmap e279: 12 total, 12 up, 12 in 2023-03-02T12:40:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:11 smithi136 ceph-mon[125702]: pgmap v3289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:40:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:11 smithi057 ceph-mon[92072]: osdmap e279: 12 total, 12 up, 12 in 2023-03-02T12:40:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:11 smithi057 ceph-mon[92072]: pgmap v3289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:40:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:13 smithi122 ceph-mon[125440]: pgmap v3290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:40:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:13 smithi136 ceph-mon[125702]: pgmap v3290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:40:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:13 smithi057 ceph-mon[92072]: pgmap v3290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:40:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:15 smithi122 ceph-mon[125440]: pgmap v3291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:40:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:15 smithi136 ceph-mon[125702]: pgmap v3291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:40:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:15 smithi057 ceph-mon[92072]: pgmap v3291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:40:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:16 smithi136 ceph-mon[125702]: osdmap e280: 12 total, 12 up, 12 in 2023-03-02T12:40:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:16 smithi057 ceph-mon[92072]: osdmap e280: 12 total, 12 up, 12 in 2023-03-02T12:40:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:16 smithi122 ceph-mon[125440]: osdmap e280: 12 total, 12 up, 12 in 2023-03-02T12:40:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:17 smithi136 ceph-mon[125702]: pgmap v3293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:40:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:17 smithi057 ceph-mon[92072]: pgmap v3293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:40:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:17 smithi122 ceph-mon[125440]: pgmap v3293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:40:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:19 smithi136 ceph-mon[125702]: pgmap v3294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T12:40:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:19 smithi057 ceph-mon[92072]: pgmap v3294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T12:40:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:19 smithi122 ceph-mon[125440]: pgmap v3294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T12:40:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:21 smithi136 ceph-mon[125702]: pgmap v3295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:40:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:21 smithi057 ceph-mon[92072]: pgmap v3295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:40:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:21 smithi122 ceph-mon[125440]: pgmap v3295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:40:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:40:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:40:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:40:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:23 smithi136 ceph-mon[125702]: pgmap v3296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:40:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:23.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:40:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:23.606+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:40:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:23.606+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:40:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:23.606+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:40:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:23.606+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:40:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:23 smithi057 ceph-mon[92072]: pgmap v3296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:40:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:23 smithi122 ceph-mon[125440]: pgmap v3296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:40:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:25 smithi136 ceph-mon[125702]: pgmap v3297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:40:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:25 smithi057 ceph-mon[92072]: pgmap v3297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:40:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:25.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:25 smithi122 ceph-mon[125440]: pgmap v3297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:40:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:26.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:27 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:40:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:27 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:40:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:27 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:40:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:27 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:40:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:27 smithi136 ceph-mon[125702]: pgmap v3298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:40:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:27.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:27 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:40:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:27 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:40:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:27 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:40:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:27 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:40:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:27 smithi057 ceph-mon[92072]: pgmap v3298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:40:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:27.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:27 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:40:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:27 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:40:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:27 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:40:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:27 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:40:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:27 smithi122 ceph-mon[125440]: pgmap v3298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:40:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:40:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:40:28.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:40:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:40:28.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:40:28.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:40:28.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:40:28.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:40:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:29 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:40:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:29 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:40:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:29 smithi136 ceph-mon[125702]: pgmap v3299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:40:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:29 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:40:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:29 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:40:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:29 smithi057 ceph-mon[92072]: pgmap v3299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:40:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:29 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:40:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:29 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:40:29.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:29 smithi122 ceph-mon[125440]: pgmap v3299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:40:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:31 smithi136 ceph-mon[125702]: pgmap v3300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:40:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:31 smithi057 ceph-mon[92072]: pgmap v3300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:40:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:31 smithi122 ceph-mon[125440]: pgmap v3300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:40:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:33 smithi136 ceph-mon[125702]: pgmap v3301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:40:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:33 smithi057 ceph-mon[92072]: pgmap v3301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:40:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:33 smithi122 ceph-mon[125440]: pgmap v3301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:40:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:35 smithi136 ceph-mon[125702]: pgmap v3302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T12:40:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:35 smithi057 ceph-mon[92072]: pgmap v3302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T12:40:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:35 smithi122 ceph-mon[125440]: pgmap v3302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T12:40:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:37 smithi136 ceph-mon[125702]: pgmap v3303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T12:40:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:37 smithi057 ceph-mon[92072]: pgmap v3303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T12:40:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:37 smithi122 ceph-mon[125440]: pgmap v3303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T12:40:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:38.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:40:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:38.622+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:40:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:38.622+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:40:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:38.622+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:40:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:38.622+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:40:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:39 smithi136 ceph-mon[125702]: pgmap v3304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:40:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:39 smithi057 ceph-mon[92072]: pgmap v3304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:40:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:39 smithi122 ceph-mon[125440]: pgmap v3304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:40:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:41 smithi136 ceph-mon[125702]: pgmap v3305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:40:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:41 smithi057 ceph-mon[92072]: pgmap v3305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:40:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:41 smithi122 ceph-mon[125440]: pgmap v3305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:40:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:43 smithi136 ceph-mon[125702]: pgmap v3306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:43 smithi057 ceph-mon[92072]: pgmap v3306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:43 smithi122 ceph-mon[125440]: pgmap v3306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:44 smithi057 ceph-mon[92072]: pgmap v3307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:44 smithi122 ceph-mon[125440]: pgmap v3307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:44 smithi136 ceph-mon[125702]: pgmap v3307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:47 smithi136 ceph-mon[125702]: pgmap v3308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:47 smithi057 ceph-mon[92072]: pgmap v3308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:47 smithi122 ceph-mon[125440]: pgmap v3308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:49 smithi136 ceph-mon[125702]: pgmap v3309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:49 smithi057 ceph-mon[92072]: pgmap v3309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:49 smithi122 ceph-mon[125440]: pgmap v3309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:51 smithi136 ceph-mon[125702]: pgmap v3310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:51 smithi057 ceph-mon[92072]: pgmap v3310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:51 smithi122 ceph-mon[125440]: pgmap v3310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:53.634+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:40:53.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:53.634+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:40:53.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:53.634+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:40:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:53.634+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:40:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:40:53.634+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:40:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:53 smithi136 ceph-mon[125702]: pgmap v3311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:53 smithi057 ceph-mon[92072]: pgmap v3311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:53 smithi122 ceph-mon[125440]: pgmap v3311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:55 smithi136 ceph-mon[125702]: pgmap v3312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:55 smithi057 ceph-mon[92072]: pgmap v3312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:55 smithi122 ceph-mon[125440]: pgmap v3312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:57 smithi136 ceph-mon[125702]: pgmap v3313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:57 smithi057 ceph-mon[92072]: pgmap v3313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:57 smithi122 ceph-mon[125440]: pgmap v3313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:40:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:40:59 smithi136 ceph-mon[125702]: pgmap v3314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:40:59 smithi057 ceph-mon[92072]: pgmap v3314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:40:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:40:59 smithi122 ceph-mon[125440]: pgmap v3314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:01 smithi136 ceph-mon[125702]: pgmap v3315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:01 smithi057 ceph-mon[92072]: pgmap v3315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:01 smithi122 ceph-mon[125440]: pgmap v3315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:03 smithi136 ceph-mon[125702]: pgmap v3316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:41:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:03 smithi057 ceph-mon[92072]: pgmap v3316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:41:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:03 smithi122 ceph-mon[125440]: pgmap v3316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:41:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:05 smithi136 ceph-mon[125702]: pgmap v3317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:41:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:05 smithi057 ceph-mon[92072]: pgmap v3317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:41:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:05 smithi122 ceph-mon[125440]: pgmap v3317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:41:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:07 smithi136 ceph-mon[125702]: pgmap v3318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:41:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:07 smithi057 ceph-mon[92072]: pgmap v3318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:41:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:07 smithi122 ceph-mon[125440]: pgmap v3318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:41:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:08.643+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:41:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:08.644+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:41:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:08.644+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:41:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:08.644+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:41:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:08.644+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:41:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:09.227+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:41:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:09.227+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:41:09.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:09.227+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 52 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:41:09.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:09.227+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 51 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:41:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:09 smithi136 ceph-mon[125702]: pgmap v3319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:41:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:09 smithi057 ceph-mon[92072]: pgmap v3319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:41:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:09 smithi122 ceph-mon[125440]: pgmap v3319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:41:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:11 smithi136 ceph-mon[125702]: pgmap v3320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:41:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:11 smithi136 ceph-mon[125702]: osdmap e281: 12 total, 12 up, 12 in 2023-03-02T12:41:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:11 smithi057 ceph-mon[92072]: pgmap v3320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:41:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:11 smithi057 ceph-mon[92072]: osdmap e281: 12 total, 12 up, 12 in 2023-03-02T12:41:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:11 smithi122 ceph-mon[125440]: pgmap v3320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:41:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:11 smithi122 ceph-mon[125440]: osdmap e281: 12 total, 12 up, 12 in 2023-03-02T12:41:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:13 smithi136 ceph-mon[125702]: pgmap v3322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:41:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:13 smithi057 ceph-mon[92072]: pgmap v3322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:41:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:13 smithi122 ceph-mon[125440]: pgmap v3322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:41:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:15 smithi136 ceph-mon[125702]: pgmap v3323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:41:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:15 smithi136 ceph-mon[125702]: osdmap e282: 12 total, 12 up, 12 in 2023-03-02T12:41:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:15 smithi057 ceph-mon[92072]: pgmap v3323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:41:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:15 smithi057 ceph-mon[92072]: osdmap e282: 12 total, 12 up, 12 in 2023-03-02T12:41:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:15 smithi122 ceph-mon[125440]: pgmap v3323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:41:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:15 smithi122 ceph-mon[125440]: osdmap e282: 12 total, 12 up, 12 in 2023-03-02T12:41:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:16 smithi136 ceph-mon[125702]: pgmap v3325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:41:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:16 smithi057 ceph-mon[92072]: pgmap v3325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:41:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:16 smithi122 ceph-mon[125440]: pgmap v3325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:41:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:19 smithi136 ceph-mon[125702]: pgmap v3326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:41:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:19 smithi057 ceph-mon[92072]: pgmap v3326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:41:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:19 smithi122 ceph-mon[125440]: pgmap v3326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:41:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:21 smithi136 ceph-mon[125702]: pgmap v3327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:41:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:21 smithi057 ceph-mon[92072]: pgmap v3327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:41:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:21 smithi122 ceph-mon[125440]: pgmap v3327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T12:41:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:23.660+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:41:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:23.661+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:41:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:23.661+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:41:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:23.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:41:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:23.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:41:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:23 smithi136 ceph-mon[125702]: pgmap v3328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:41:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:23 smithi057 ceph-mon[92072]: pgmap v3328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:41:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:23 smithi122 ceph-mon[125440]: pgmap v3328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:41:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:25 smithi136 ceph-mon[125702]: pgmap v3329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:41:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:25 smithi057 ceph-mon[92072]: pgmap v3329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:41:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:25 smithi122 ceph-mon[125440]: pgmap v3329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:41:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:27 smithi136 ceph-mon[125702]: pgmap v3330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:41:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:27 smithi057 ceph-mon[92072]: pgmap v3330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:41:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:27 smithi122 ceph-mon[125440]: pgmap v3330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:41:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:41:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:41:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:41:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:29 smithi136 ceph-mon[125702]: pgmap v3331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:41:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:41:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:41:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:41:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:29 smithi057 ceph-mon[92072]: pgmap v3331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:41:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:41:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:41:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:41:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:29 smithi122 ceph-mon[125440]: pgmap v3331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:41:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:41:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:41:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:41:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:31 smithi136 ceph-mon[125702]: pgmap v3332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:31 smithi057 ceph-mon[92072]: pgmap v3332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:31 smithi122 ceph-mon[125440]: pgmap v3332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:33 smithi136 ceph-mon[125702]: pgmap v3333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:33 smithi057 ceph-mon[92072]: pgmap v3333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:33 smithi122 ceph-mon[125440]: pgmap v3333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:35 smithi136 ceph-mon[125702]: pgmap v3334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:35 smithi057 ceph-mon[92072]: pgmap v3334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:35 smithi122 ceph-mon[125440]: pgmap v3334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:37 smithi136 ceph-mon[125702]: pgmap v3335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:37 smithi057 ceph-mon[92072]: pgmap v3335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:37 smithi122 ceph-mon[125440]: pgmap v3335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:38.668 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:38.667+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:41:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:38.668+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:41:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:38.668+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:41:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:38.668+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:41:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:38.668+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:41:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:39 smithi136 ceph-mon[125702]: pgmap v3336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:39 smithi057 ceph-mon[92072]: pgmap v3336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:39 smithi122 ceph-mon[125440]: pgmap v3336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:41 smithi136 ceph-mon[125702]: pgmap v3337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:41 smithi057 ceph-mon[92072]: pgmap v3337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:41 smithi122 ceph-mon[125440]: pgmap v3337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:43 smithi136 ceph-mon[125702]: pgmap v3338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:43 smithi057 ceph-mon[92072]: pgmap v3338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:43 smithi122 ceph-mon[125440]: pgmap v3338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:45 smithi136 ceph-mon[125702]: pgmap v3339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:45 smithi057 ceph-mon[92072]: pgmap v3339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:45 smithi122 ceph-mon[125440]: pgmap v3339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:47 smithi136 ceph-mon[125702]: pgmap v3340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:47 smithi057 ceph-mon[92072]: pgmap v3340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:47 smithi122 ceph-mon[125440]: pgmap v3340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:49 smithi136 ceph-mon[125702]: pgmap v3341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:49 smithi057 ceph-mon[92072]: pgmap v3341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:49 smithi122 ceph-mon[125440]: pgmap v3341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:51 smithi136 ceph-mon[125702]: pgmap v3342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:51 smithi057 ceph-mon[92072]: pgmap v3342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:51 smithi122 ceph-mon[125440]: pgmap v3342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:52 smithi136 ceph-mon[125702]: pgmap v3343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:52 smithi057 ceph-mon[92072]: pgmap v3343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:52 smithi122 ceph-mon[125440]: pgmap v3343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:53.673+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:41:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:53.674+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:41:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:53.674+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:41:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:53.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:41:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:41:53.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:41:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:55 smithi136 ceph-mon[125702]: pgmap v3344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:55 smithi057 ceph-mon[92072]: pgmap v3344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:55 smithi122 ceph-mon[125440]: pgmap v3344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:57 smithi136 ceph-mon[125702]: pgmap v3345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:57 smithi057 ceph-mon[92072]: pgmap v3345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:57 smithi122 ceph-mon[125440]: pgmap v3345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:41:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:41:59 smithi136 ceph-mon[125702]: pgmap v3346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:41:59 smithi057 ceph-mon[92072]: pgmap v3346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:41:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:41:59 smithi122 ceph-mon[125440]: pgmap v3346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:01 smithi136 ceph-mon[125702]: pgmap v3347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:01 smithi057 ceph-mon[92072]: pgmap v3347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:01.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:01 smithi122 ceph-mon[125440]: pgmap v3347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:03 smithi136 ceph-mon[125702]: pgmap v3348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:42:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:03 smithi057 ceph-mon[92072]: pgmap v3348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:42:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:03 smithi122 ceph-mon[125440]: pgmap v3348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:42:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:05 smithi136 ceph-mon[125702]: pgmap v3349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:42:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:05 smithi057 ceph-mon[92072]: pgmap v3349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:42:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:05 smithi122 ceph-mon[125440]: pgmap v3349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:42:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:07 smithi136 ceph-mon[125702]: pgmap v3350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:42:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:07 smithi057 ceph-mon[92072]: pgmap v3350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:42:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:07 smithi122 ceph-mon[125440]: pgmap v3350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:42:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:08.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:42:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:08.687+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:42:08.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:08.687+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:42:08.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:08.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:42:08.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:08.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:42:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:09 smithi136 ceph-mon[125702]: pgmap v3351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:42:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:09 smithi057 ceph-mon[92072]: pgmap v3351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:42:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:09 smithi122 ceph-mon[125440]: pgmap v3351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:42:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:11 smithi136 ceph-mon[125702]: pgmap v3352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:42:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:11 smithi136 ceph-mon[125702]: osdmap e283: 12 total, 12 up, 12 in 2023-03-02T12:42:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:11 smithi057 ceph-mon[92072]: pgmap v3352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:42:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:11 smithi057 ceph-mon[92072]: osdmap e283: 12 total, 12 up, 12 in 2023-03-02T12:42:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:11 smithi122 ceph-mon[125440]: pgmap v3352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:42:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:11 smithi122 ceph-mon[125440]: osdmap e283: 12 total, 12 up, 12 in 2023-03-02T12:42:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:13 smithi136 ceph-mon[125702]: pgmap v3354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:42:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:13 smithi057 ceph-mon[92072]: pgmap v3354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:42:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:13 smithi122 ceph-mon[125440]: pgmap v3354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:42:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:15 smithi136 ceph-mon[125702]: pgmap v3355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:42:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:15 smithi136 ceph-mon[125702]: osdmap e284: 12 total, 12 up, 12 in 2023-03-02T12:42:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:15 smithi057 ceph-mon[92072]: pgmap v3355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:42:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:15 smithi057 ceph-mon[92072]: osdmap e284: 12 total, 12 up, 12 in 2023-03-02T12:42:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:15 smithi122 ceph-mon[125440]: pgmap v3355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:42:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:15 smithi122 ceph-mon[125440]: osdmap e284: 12 total, 12 up, 12 in 2023-03-02T12:42:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:17 smithi136 ceph-mon[125702]: pgmap v3357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:42:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:17 smithi057 ceph-mon[92072]: pgmap v3357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:42:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:17 smithi122 ceph-mon[125440]: pgmap v3357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:42:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:19 smithi136 ceph-mon[125702]: pgmap v3358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:42:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:19 smithi057 ceph-mon[92072]: pgmap v3358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:42:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:19 smithi122 ceph-mon[125440]: pgmap v3358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:42:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:21 smithi136 ceph-mon[125702]: pgmap v3359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:42:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:21 smithi057 ceph-mon[92072]: pgmap v3359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:42:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:21 smithi122 ceph-mon[125440]: pgmap v3359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:23.692+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:23.692+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:23.692+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:23.692+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:23.692+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:42:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:23 smithi136 ceph-mon[125702]: pgmap v3360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:42:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:23 smithi057 ceph-mon[92072]: pgmap v3360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:42:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:23 smithi122 ceph-mon[125440]: pgmap v3360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:42:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:25 smithi136 ceph-mon[125702]: pgmap v3361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:42:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:25 smithi057 ceph-mon[92072]: pgmap v3361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:42:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:25 smithi122 ceph-mon[125440]: pgmap v3361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:42:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:27 smithi136 ceph-mon[125702]: pgmap v3362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:42:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:27 smithi057 ceph-mon[92072]: pgmap v3362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:42:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:27 smithi122 ceph-mon[125440]: pgmap v3362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:42:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:29 smithi136 ceph-mon[125702]: pgmap v3363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:42:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:42:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:42:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:42:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:29 smithi057 ceph-mon[92072]: pgmap v3363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:42:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:42:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:42:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:42:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:29 smithi122 ceph-mon[125440]: pgmap v3363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:42:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:42:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:42:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:42:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:42:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:42:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:42:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:42:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:42:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:42:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:42:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:42:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:42:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:31 smithi136 ceph-mon[125702]: pgmap v3364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:31 smithi057 ceph-mon[92072]: pgmap v3364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:31 smithi122 ceph-mon[125440]: pgmap v3364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:32 smithi136 ceph-mon[125702]: pgmap v3365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:32 smithi057 ceph-mon[92072]: pgmap v3365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:32 smithi122 ceph-mon[125440]: pgmap v3365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:35 smithi136 ceph-mon[125702]: pgmap v3366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:35 smithi057 ceph-mon[92072]: pgmap v3366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:35 smithi122 ceph-mon[125440]: pgmap v3366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:37 smithi136 ceph-mon[125702]: pgmap v3367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:37 smithi057 ceph-mon[92072]: pgmap v3367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:37 smithi122 ceph-mon[125440]: pgmap v3367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:38.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:42:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:38.700+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:42:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:38.700+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:42:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:38.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:42:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:38.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:42:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:39 smithi136 ceph-mon[125702]: pgmap v3368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:39 smithi057 ceph-mon[92072]: pgmap v3368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:39 smithi122 ceph-mon[125440]: pgmap v3368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:41 smithi136 ceph-mon[125702]: pgmap v3369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:41 smithi057 ceph-mon[92072]: pgmap v3369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:41 smithi122 ceph-mon[125440]: pgmap v3369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:43 smithi136 ceph-mon[125702]: pgmap v3370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:43 smithi057 ceph-mon[92072]: pgmap v3370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:43 smithi122 ceph-mon[125440]: pgmap v3370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:45 smithi136 ceph-mon[125702]: pgmap v3371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:45 smithi057 ceph-mon[92072]: pgmap v3371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:45 smithi122 ceph-mon[125440]: pgmap v3371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:47 smithi136 ceph-mon[125702]: pgmap v3372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:47 smithi057 ceph-mon[92072]: pgmap v3372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:47 smithi122 ceph-mon[125440]: pgmap v3372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:49 smithi136 ceph-mon[125702]: pgmap v3373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:49 smithi057 ceph-mon[92072]: pgmap v3373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:49 smithi122 ceph-mon[125440]: pgmap v3373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:51 smithi136 ceph-mon[125702]: pgmap v3374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:51 smithi057 ceph-mon[92072]: pgmap v3374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:51 smithi122 ceph-mon[125440]: pgmap v3374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:53.715+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:42:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:53.716+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:42:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:53.716+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:42:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:53.716+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:42:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:42:53.716+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:42:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:53 smithi136 ceph-mon[125702]: pgmap v3375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:53 smithi057 ceph-mon[92072]: pgmap v3375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:53 smithi122 ceph-mon[125440]: pgmap v3375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:55 smithi136 ceph-mon[125702]: pgmap v3376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:55 smithi057 ceph-mon[92072]: pgmap v3376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:55 smithi122 ceph-mon[125440]: pgmap v3376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:57 smithi136 ceph-mon[125702]: pgmap v3377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:57 smithi057 ceph-mon[92072]: pgmap v3377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:57 smithi122 ceph-mon[125440]: pgmap v3377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:42:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:42:59 smithi136 ceph-mon[125702]: pgmap v3378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:42:59 smithi057 ceph-mon[92072]: pgmap v3378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:42:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:42:59 smithi122 ceph-mon[125440]: pgmap v3378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:01 smithi136 ceph-mon[125702]: pgmap v3379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:01 smithi057 ceph-mon[92072]: pgmap v3379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:01 smithi122 ceph-mon[125440]: pgmap v3379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:03 smithi136 ceph-mon[125702]: pgmap v3380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:43:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:03 smithi057 ceph-mon[92072]: pgmap v3380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:43:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:03 smithi122 ceph-mon[125440]: pgmap v3380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:43:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:05 smithi136 ceph-mon[125702]: pgmap v3381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:43:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:05 smithi057 ceph-mon[92072]: pgmap v3381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:43:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:05 smithi122 ceph-mon[125440]: pgmap v3381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:43:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:07 smithi136 ceph-mon[125702]: pgmap v3382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:43:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:07 smithi057 ceph-mon[92072]: pgmap v3382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:43:08.068 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:07 smithi122 ceph-mon[125440]: pgmap v3382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:43:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:08.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:43:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:08.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:43:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:08.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:43:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:08.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:43:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:08.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:43:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:08 smithi136 ceph-mon[125702]: pgmap v3383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:43:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:08 smithi057 ceph-mon[92072]: pgmap v3383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:43:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:08 smithi122 ceph-mon[125440]: pgmap v3383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:43:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:11 smithi122 ceph-mon[125440]: osdmap e285: 12 total, 12 up, 12 in 2023-03-02T12:43:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:11 smithi122 ceph-mon[125440]: pgmap v3385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:43:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:11 smithi136 ceph-mon[125702]: osdmap e285: 12 total, 12 up, 12 in 2023-03-02T12:43:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:11 smithi136 ceph-mon[125702]: pgmap v3385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:43:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:11 smithi057 ceph-mon[92072]: osdmap e285: 12 total, 12 up, 12 in 2023-03-02T12:43:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:11 smithi057 ceph-mon[92072]: pgmap v3385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:43:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:13 smithi136 ceph-mon[125702]: pgmap v3386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:43:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:13 smithi057 ceph-mon[92072]: pgmap v3386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:43:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:13 smithi122 ceph-mon[125440]: pgmap v3386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:43:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:15 smithi136 ceph-mon[125702]: pgmap v3387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:43:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:15 smithi057 ceph-mon[92072]: pgmap v3387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:43:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:15 smithi122 ceph-mon[125440]: pgmap v3387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:43:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:16 smithi136 ceph-mon[125702]: osdmap e286: 12 total, 12 up, 12 in 2023-03-02T12:43:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:16 smithi057 ceph-mon[92072]: osdmap e286: 12 total, 12 up, 12 in 2023-03-02T12:43:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:16 smithi122 ceph-mon[125440]: osdmap e286: 12 total, 12 up, 12 in 2023-03-02T12:43:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:17 smithi136 ceph-mon[125702]: pgmap v3389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:43:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:17 smithi057 ceph-mon[92072]: pgmap v3389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:43:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:17 smithi122 ceph-mon[125440]: pgmap v3389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:43:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:19 smithi136 ceph-mon[125702]: pgmap v3390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T12:43:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:19 smithi057 ceph-mon[92072]: pgmap v3390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T12:43:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:19 smithi122 ceph-mon[125440]: pgmap v3390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T12:43:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:21 smithi136 ceph-mon[125702]: pgmap v3391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:43:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:21 smithi057 ceph-mon[92072]: pgmap v3391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:43:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:21 smithi122 ceph-mon[125440]: pgmap v3391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:43:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:23.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:43:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:23.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:43:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:23.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:43:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:23.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:43:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:23.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:43:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:23 smithi136 ceph-mon[125702]: pgmap v3392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:43:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:23 smithi057 ceph-mon[92072]: pgmap v3392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:43:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:23 smithi122 ceph-mon[125440]: pgmap v3392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:43:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:25 smithi136 ceph-mon[125702]: pgmap v3393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:43:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:25 smithi057 ceph-mon[92072]: pgmap v3393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:43:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:25 smithi122 ceph-mon[125440]: pgmap v3393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:43:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:27 smithi136 ceph-mon[125702]: pgmap v3394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:43:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:27 smithi057 ceph-mon[92072]: pgmap v3394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:43:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:27 smithi122 ceph-mon[125440]: pgmap v3394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:43:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:29 smithi136 ceph-mon[125702]: pgmap v3395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:43:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:29 smithi057 ceph-mon[92072]: pgmap v3395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:43:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:29 smithi122 ceph-mon[125440]: pgmap v3395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:43:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:43:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:43:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:43:31.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:31 smithi136 ceph-mon[125702]: pgmap v3396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:43:31.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:43:31.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:43:31.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:31 smithi057 ceph-mon[92072]: pgmap v3396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:43:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:43:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:43:31.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:31 smithi122 ceph-mon[125440]: pgmap v3396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:43:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:31.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:43:31.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:43:31.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:43:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:33 smithi136 ceph-mon[125702]: pgmap v3397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:33 smithi057 ceph-mon[92072]: pgmap v3397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:33 smithi122 ceph-mon[125440]: pgmap v3397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:35 smithi136 ceph-mon[125702]: pgmap v3398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:35 smithi057 ceph-mon[92072]: pgmap v3398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:35 smithi122 ceph-mon[125440]: pgmap v3398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:36 smithi057 ceph-mon[92072]: pgmap v3399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:36 smithi122 ceph-mon[125440]: pgmap v3399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:36 smithi136 ceph-mon[125702]: pgmap v3399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:38.757+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:43:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:38.757+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:43:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:38.757+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:43:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:38.757+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:43:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:38.757+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:43:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:39 smithi136 ceph-mon[125702]: pgmap v3400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:39 smithi057 ceph-mon[92072]: pgmap v3400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:39 smithi122 ceph-mon[125440]: pgmap v3400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:41 smithi136 ceph-mon[125702]: pgmap v3401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:41 smithi057 ceph-mon[92072]: pgmap v3401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:41 smithi122 ceph-mon[125440]: pgmap v3401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:43 smithi136 ceph-mon[125702]: pgmap v3402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:43 smithi057 ceph-mon[92072]: pgmap v3402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:43 smithi122 ceph-mon[125440]: pgmap v3402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:45 smithi136 ceph-mon[125702]: pgmap v3403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:45 smithi057 ceph-mon[92072]: pgmap v3403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:45 smithi122 ceph-mon[125440]: pgmap v3403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:47 smithi136 ceph-mon[125702]: pgmap v3404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:47 smithi057 ceph-mon[92072]: pgmap v3404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:47 smithi122 ceph-mon[125440]: pgmap v3404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:49 smithi136 ceph-mon[125702]: pgmap v3405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:49 smithi057 ceph-mon[92072]: pgmap v3405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:49 smithi122 ceph-mon[125440]: pgmap v3405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:51 smithi136 ceph-mon[125702]: pgmap v3406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:51 smithi057 ceph-mon[92072]: pgmap v3406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:51 smithi122 ceph-mon[125440]: pgmap v3406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:53.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:43:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:53.772+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:43:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:53.772+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:43:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:53.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:43:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:43:53.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:43:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:53 smithi136 ceph-mon[125702]: pgmap v3407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:53 smithi057 ceph-mon[92072]: pgmap v3407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:53 smithi122 ceph-mon[125440]: pgmap v3407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:55 smithi136 ceph-mon[125702]: pgmap v3408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:55 smithi057 ceph-mon[92072]: pgmap v3408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:55 smithi122 ceph-mon[125440]: pgmap v3408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:57 smithi136 ceph-mon[125702]: pgmap v3409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:57 smithi057 ceph-mon[92072]: pgmap v3409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:57 smithi122 ceph-mon[125440]: pgmap v3409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:43:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:43:59 smithi057 ceph-mon[92072]: pgmap v3410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:43:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:43:59 smithi122 ceph-mon[125440]: pgmap v3410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:43:59 smithi136 ceph-mon[125702]: pgmap v3410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:01 smithi136 ceph-mon[125702]: pgmap v3411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:44:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:01 smithi057 ceph-mon[92072]: pgmap v3411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:44:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:01 smithi122 ceph-mon[125440]: pgmap v3411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:44:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:03 smithi136 ceph-mon[125702]: pgmap v3412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:44:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:03 smithi057 ceph-mon[92072]: pgmap v3412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:44:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:03 smithi122 ceph-mon[125440]: pgmap v3412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:44:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:05 smithi136 ceph-mon[125702]: pgmap v3413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:44:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:05 smithi057 ceph-mon[92072]: pgmap v3413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:44:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:05 smithi122 ceph-mon[125440]: pgmap v3413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:44:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:07 smithi136 ceph-mon[125702]: pgmap v3414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:44:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:07 smithi057 ceph-mon[92072]: pgmap v3414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:44:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:07 smithi122 ceph-mon[125440]: pgmap v3414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:44:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.381+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T12:44:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.381+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T12:44:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.381+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f58700196d0 tx=0x7f58700aa000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:44:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.381+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f58700196d0 tx=0x7f58700aa000 comp rx=0 tx=0).stop 2023-03-02T12:44:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.381+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T12:44:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.381+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T12:44:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.381+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T12:44:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.381+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f586809c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T12:44:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.381+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f586809c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:44:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.382+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f586809c360 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5870097040 tx=0x7f58700ac000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T12:44:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.788+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:44:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.788+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:44:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.788+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:44:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.788+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:44:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:08.788+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:44:09.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:09.254+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:44:09.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:09.254+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:44:09.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:09.254+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 52 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:44:09.256 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:09.254+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 53 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:44:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:09 smithi136 ceph-mon[125702]: pgmap v3415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:44:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:09 smithi057 ceph-mon[92072]: pgmap v3415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:44:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:09 smithi122 ceph-mon[125440]: pgmap v3415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:44:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:11 smithi136 ceph-mon[125702]: pgmap v3416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:44:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:11 smithi136 ceph-mon[125702]: osdmap e287: 12 total, 12 up, 12 in 2023-03-02T12:44:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:11 smithi057 ceph-mon[92072]: pgmap v3416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:44:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:11 smithi057 ceph-mon[92072]: osdmap e287: 12 total, 12 up, 12 in 2023-03-02T12:44:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:11 smithi122 ceph-mon[125440]: pgmap v3416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:44:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:11 smithi122 ceph-mon[125440]: osdmap e287: 12 total, 12 up, 12 in 2023-03-02T12:44:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:13 smithi136 ceph-mon[125702]: pgmap v3418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:44:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:13 smithi057 ceph-mon[92072]: pgmap v3418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:44:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:13 smithi122 ceph-mon[125440]: pgmap v3418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:44:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:15 smithi136 ceph-mon[125702]: pgmap v3419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:44:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:15 smithi136 ceph-mon[125702]: osdmap e288: 12 total, 12 up, 12 in 2023-03-02T12:44:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:15 smithi057 ceph-mon[92072]: pgmap v3419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:44:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:15 smithi057 ceph-mon[92072]: osdmap e288: 12 total, 12 up, 12 in 2023-03-02T12:44:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:15 smithi122 ceph-mon[125440]: pgmap v3419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:44:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:15 smithi122 ceph-mon[125440]: osdmap e288: 12 total, 12 up, 12 in 2023-03-02T12:44:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:17 smithi057 ceph-mon[92072]: pgmap v3421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:44:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:17 smithi122 ceph-mon[125440]: pgmap v3421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:44:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:17 smithi136 ceph-mon[125702]: pgmap v3421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:44:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:18 smithi057 ceph-mon[92072]: pgmap v3422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:44:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:18 smithi122 ceph-mon[125440]: pgmap v3422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:44:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:18 smithi136 ceph-mon[125702]: pgmap v3422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:44:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:21 smithi136 ceph-mon[125702]: pgmap v3423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:44:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:21 smithi057 ceph-mon[92072]: pgmap v3423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:44:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:21 smithi122 ceph-mon[125440]: pgmap v3423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:44:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:23.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:44:23.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:23.801+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:44:23.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:23.801+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:44:23.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:23.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:44:23.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:23.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:44:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:23 smithi136 ceph-mon[125702]: pgmap v3424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:44:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:23 smithi057 ceph-mon[92072]: pgmap v3424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:44:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:23 smithi122 ceph-mon[125440]: pgmap v3424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:44:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:25 smithi136 ceph-mon[125702]: pgmap v3425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:44:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:25 smithi057 ceph-mon[92072]: pgmap v3425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:44:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:25 smithi122 ceph-mon[125440]: pgmap v3425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:44:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:27 smithi136 ceph-mon[125702]: pgmap v3426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:44:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:27 smithi057 ceph-mon[92072]: pgmap v3426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:44:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:27 smithi122 ceph-mon[125440]: pgmap v3426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:44:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:29 smithi136 ceph-mon[125702]: pgmap v3427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:44:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:29 smithi057 ceph-mon[92072]: pgmap v3427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:44:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:29 smithi122 ceph-mon[125440]: pgmap v3427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:44:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:31 smithi136 ceph-mon[125702]: pgmap v3428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:44:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:31 smithi057 ceph-mon[92072]: pgmap v3428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:44:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:31 smithi122 ceph-mon[125440]: pgmap v3428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:44:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:44:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:44:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:44:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:44:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:44:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:44:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:44:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:44:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:44:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:33 smithi136 ceph-mon[125702]: pgmap v3429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:33 smithi057 ceph-mon[92072]: pgmap v3429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:33 smithi122 ceph-mon[125440]: pgmap v3429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:35 smithi136 ceph-mon[125702]: pgmap v3430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:35 smithi057 ceph-mon[92072]: pgmap v3430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:35 smithi122 ceph-mon[125440]: pgmap v3430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:37 smithi136 ceph-mon[125702]: pgmap v3431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:37 smithi057 ceph-mon[92072]: pgmap v3431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:37 smithi122 ceph-mon[125440]: pgmap v3431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:38.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:44:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:38.818+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:44:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:38.818+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:44:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:38.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:44:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:38.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:44:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:39 smithi057 ceph-mon[92072]: pgmap v3432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:39 smithi122 ceph-mon[125440]: pgmap v3432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:39 smithi136 ceph-mon[125702]: pgmap v3432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:41 smithi057 ceph-mon[92072]: pgmap v3433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:41 smithi122 ceph-mon[125440]: pgmap v3433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:41 smithi136 ceph-mon[125702]: pgmap v3433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:42 smithi057 ceph-mon[92072]: pgmap v3434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:42 smithi122 ceph-mon[125440]: pgmap v3434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:42 smithi136 ceph-mon[125702]: pgmap v3434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:45 smithi136 ceph-mon[125702]: pgmap v3435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:45 smithi057 ceph-mon[92072]: pgmap v3435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:45 smithi122 ceph-mon[125440]: pgmap v3435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:47 smithi136 ceph-mon[125702]: pgmap v3436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:47 smithi057 ceph-mon[92072]: pgmap v3436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:47 smithi122 ceph-mon[125440]: pgmap v3436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:49 smithi136 ceph-mon[125702]: pgmap v3437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:49 smithi057 ceph-mon[92072]: pgmap v3437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:49 smithi122 ceph-mon[125440]: pgmap v3437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:51 smithi136 ceph-mon[125702]: pgmap v3438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:51 smithi057 ceph-mon[92072]: pgmap v3438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:51 smithi122 ceph-mon[125440]: pgmap v3438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:53.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:44:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:53.834+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:44:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:53.834+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:44:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:53.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:44:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:44:53.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:44:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:53 smithi136 ceph-mon[125702]: pgmap v3439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:53 smithi057 ceph-mon[92072]: pgmap v3439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:53 smithi122 ceph-mon[125440]: pgmap v3439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:55 smithi136 ceph-mon[125702]: pgmap v3440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:55 smithi057 ceph-mon[92072]: pgmap v3440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:55 smithi122 ceph-mon[125440]: pgmap v3440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:57 smithi136 ceph-mon[125702]: pgmap v3441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:57 smithi057 ceph-mon[92072]: pgmap v3441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:57 smithi122 ceph-mon[125440]: pgmap v3441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:44:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:44:59 smithi136 ceph-mon[125702]: pgmap v3442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:44:59 smithi057 ceph-mon[92072]: pgmap v3442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:44:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:44:59 smithi122 ceph-mon[125440]: pgmap v3442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:01 smithi136 ceph-mon[125702]: pgmap v3443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:01 smithi057 ceph-mon[92072]: pgmap v3443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:01 smithi122 ceph-mon[125440]: pgmap v3443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:03 smithi057 ceph-mon[92072]: pgmap v3444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:45:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:03 smithi122 ceph-mon[125440]: pgmap v3444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:45:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:03 smithi136 ceph-mon[125702]: pgmap v3444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:45:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:05 smithi057 ceph-mon[92072]: pgmap v3445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:45:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:05 smithi122 ceph-mon[125440]: pgmap v3445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:45:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:05 smithi136 ceph-mon[125702]: pgmap v3445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:45:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:07 smithi057 ceph-mon[92072]: pgmap v3446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:45:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:07 smithi122 ceph-mon[125440]: pgmap v3446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:45:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:07 smithi136 ceph-mon[125702]: pgmap v3446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:45:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:08.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:45:08.843 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:08.842+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:45:08.843 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:08.842+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:45:08.843 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:08.842+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:45:08.843 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:08.842+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:45:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:08 smithi057 ceph-mon[92072]: pgmap v3447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:45:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:08 smithi122 ceph-mon[125440]: pgmap v3447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:45:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:08 smithi136 ceph-mon[125702]: pgmap v3447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:45:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:11 smithi122 ceph-mon[125440]: osdmap e289: 12 total, 12 up, 12 in 2023-03-02T12:45:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:11 smithi122 ceph-mon[125440]: pgmap v3449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:45:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:11 smithi136 ceph-mon[125702]: osdmap e289: 12 total, 12 up, 12 in 2023-03-02T12:45:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:11 smithi136 ceph-mon[125702]: pgmap v3449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:45:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:11 smithi057 ceph-mon[92072]: osdmap e289: 12 total, 12 up, 12 in 2023-03-02T12:45:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:11 smithi057 ceph-mon[92072]: pgmap v3449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:45:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:13 smithi136 ceph-mon[125702]: pgmap v3450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:45:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:13 smithi057 ceph-mon[92072]: pgmap v3450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:45:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:13 smithi122 ceph-mon[125440]: pgmap v3450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:45:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:15 smithi136 ceph-mon[125702]: pgmap v3451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:45:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:15 smithi057 ceph-mon[92072]: pgmap v3451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:45:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:15 smithi122 ceph-mon[125440]: pgmap v3451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:45:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:16 smithi136 ceph-mon[125702]: osdmap e290: 12 total, 12 up, 12 in 2023-03-02T12:45:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:16 smithi057 ceph-mon[92072]: osdmap e290: 12 total, 12 up, 12 in 2023-03-02T12:45:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:16 smithi122 ceph-mon[125440]: osdmap e290: 12 total, 12 up, 12 in 2023-03-02T12:45:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:17 smithi136 ceph-mon[125702]: pgmap v3453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:45:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:17 smithi057 ceph-mon[92072]: pgmap v3453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:45:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:17 smithi122 ceph-mon[125440]: pgmap v3453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:45:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:19 smithi136 ceph-mon[125702]: pgmap v3454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T12:45:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:19 smithi057 ceph-mon[92072]: pgmap v3454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T12:45:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:19 smithi122 ceph-mon[125440]: pgmap v3454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T12:45:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:21 smithi136 ceph-mon[125702]: pgmap v3455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:45:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:21 smithi057 ceph-mon[92072]: pgmap v3455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:45:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:21 smithi122 ceph-mon[125440]: pgmap v3455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:45:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:23 smithi136 ceph-mon[125702]: pgmap v3456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:45:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:23.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:45:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:23.857+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:45:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:23.857+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:45:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:23.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:45:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:23.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:45:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:23 smithi057 ceph-mon[92072]: pgmap v3456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:45:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:23 smithi122 ceph-mon[125440]: pgmap v3456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:45:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:25 smithi136 ceph-mon[125702]: pgmap v3457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:45:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:25 smithi057 ceph-mon[92072]: pgmap v3457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:45:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:25 smithi122 ceph-mon[125440]: pgmap v3457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:45:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:27 smithi057 ceph-mon[92072]: pgmap v3458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:45:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:27 smithi122 ceph-mon[125440]: pgmap v3458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:45:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:27 smithi136 ceph-mon[125702]: pgmap v3458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:45:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:29 smithi057 ceph-mon[92072]: pgmap v3459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:45:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:29 smithi122 ceph-mon[125440]: pgmap v3459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:45:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:29 smithi136 ceph-mon[125702]: pgmap v3459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:45:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:31 smithi057 ceph-mon[92072]: pgmap v3460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:31 smithi122 ceph-mon[125440]: pgmap v3460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:31 smithi136 ceph-mon[125702]: pgmap v3460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:45:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:45:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:45:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:33 smithi057 ceph-mon[92072]: pgmap v3461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:45:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:45:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:45:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:33 smithi122 ceph-mon[125440]: pgmap v3461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:45:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:45:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:45:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:33 smithi136 ceph-mon[125702]: pgmap v3461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:45:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:45:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:45:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:34 smithi057 ceph-mon[92072]: pgmap v3462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:34 smithi122 ceph-mon[125440]: pgmap v3462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:34 smithi136 ceph-mon[125702]: pgmap v3462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:37 smithi136 ceph-mon[125702]: pgmap v3463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:37 smithi057 ceph-mon[92072]: pgmap v3463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:37 smithi122 ceph-mon[125440]: pgmap v3463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:38.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:45:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:38.866+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:45:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:38.866+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:45:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:38.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:45:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:38.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:45:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:39 smithi136 ceph-mon[125702]: pgmap v3464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:39 smithi057 ceph-mon[92072]: pgmap v3464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:39.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:39 smithi122 ceph-mon[125440]: pgmap v3464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:41 smithi136 ceph-mon[125702]: pgmap v3465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:41 smithi057 ceph-mon[92072]: pgmap v3465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:41 smithi122 ceph-mon[125440]: pgmap v3465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:43 smithi136 ceph-mon[125702]: pgmap v3466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:43 smithi057 ceph-mon[92072]: pgmap v3466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:43 smithi122 ceph-mon[125440]: pgmap v3466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:45 smithi136 ceph-mon[125702]: pgmap v3467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:45 smithi057 ceph-mon[92072]: pgmap v3467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:45 smithi122 ceph-mon[125440]: pgmap v3467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:47 smithi057 ceph-mon[92072]: pgmap v3468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:47 smithi122 ceph-mon[125440]: pgmap v3468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:47 smithi136 ceph-mon[125702]: pgmap v3468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:49 smithi057 ceph-mon[92072]: pgmap v3469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:49 smithi122 ceph-mon[125440]: pgmap v3469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:49 smithi136 ceph-mon[125702]: pgmap v3469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:51 smithi057 ceph-mon[92072]: pgmap v3470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:51 smithi122 ceph-mon[125440]: pgmap v3470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:51 smithi136 ceph-mon[125702]: pgmap v3470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:53.881+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:45:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:53.882+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:45:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:53.882+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:45:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:53.882+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:45:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:45:53.882+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:45:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:53 smithi057 ceph-mon[92072]: pgmap v3471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:53 smithi122 ceph-mon[125440]: pgmap v3471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:53 smithi136 ceph-mon[125702]: pgmap v3471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:55 smithi057 ceph-mon[92072]: pgmap v3472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:55 smithi122 ceph-mon[125440]: pgmap v3472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:55 smithi136 ceph-mon[125702]: pgmap v3472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:56 smithi057 ceph-mon[92072]: pgmap v3473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:56 smithi122 ceph-mon[125440]: pgmap v3473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:56 smithi136 ceph-mon[125702]: pgmap v3473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:45:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:45:59 smithi136 ceph-mon[125702]: pgmap v3474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:45:59 smithi057 ceph-mon[92072]: pgmap v3474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:45:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:45:59 smithi122 ceph-mon[125440]: pgmap v3474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:01 smithi136 ceph-mon[125702]: pgmap v3475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:01 smithi057 ceph-mon[92072]: pgmap v3475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:01 smithi122 ceph-mon[125440]: pgmap v3475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:03 smithi136 ceph-mon[125702]: pgmap v3476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:46:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:03 smithi057 ceph-mon[92072]: pgmap v3476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:46:03.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:03 smithi122 ceph-mon[125440]: pgmap v3476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:46:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:05 smithi136 ceph-mon[125702]: pgmap v3477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:46:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:05 smithi057 ceph-mon[92072]: pgmap v3477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:46:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:05 smithi122 ceph-mon[125440]: pgmap v3477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:46:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:07 smithi057 ceph-mon[92072]: pgmap v3478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:46:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:07 smithi122 ceph-mon[125440]: pgmap v3478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:46:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:07 smithi136 ceph-mon[125702]: pgmap v3478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:46:08.898 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:08.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:46:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:08.898+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:46:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:08.898+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:46:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:08.898+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:46:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:08.898+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:46:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:09 smithi057 ceph-mon[92072]: pgmap v3479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:46:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:09 smithi122 ceph-mon[125440]: pgmap v3479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:46:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:09 smithi136 ceph-mon[125702]: pgmap v3479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:46:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:11 smithi057 ceph-mon[92072]: pgmap v3480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:46:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:11 smithi057 ceph-mon[92072]: osdmap e291: 12 total, 12 up, 12 in 2023-03-02T12:46:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:11 smithi122 ceph-mon[125440]: pgmap v3480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:46:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:11 smithi122 ceph-mon[125440]: osdmap e291: 12 total, 12 up, 12 in 2023-03-02T12:46:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:11 smithi136 ceph-mon[125702]: pgmap v3480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:46:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:11 smithi136 ceph-mon[125702]: osdmap e291: 12 total, 12 up, 12 in 2023-03-02T12:46:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:13 smithi057 ceph-mon[92072]: pgmap v3482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:46:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:13 smithi122 ceph-mon[125440]: pgmap v3482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:46:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:13 smithi136 ceph-mon[125702]: pgmap v3482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:46:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:14 smithi057 ceph-mon[92072]: pgmap v3483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:46:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:14 smithi122 ceph-mon[125440]: pgmap v3483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:46:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:14 smithi136 ceph-mon[125702]: pgmap v3483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:46:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:16 smithi136 ceph-mon[125702]: osdmap e292: 12 total, 12 up, 12 in 2023-03-02T12:46:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:16 smithi057 ceph-mon[92072]: osdmap e292: 12 total, 12 up, 12 in 2023-03-02T12:46:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:16 smithi122 ceph-mon[125440]: osdmap e292: 12 total, 12 up, 12 in 2023-03-02T12:46:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:17 smithi136 ceph-mon[125702]: pgmap v3485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:46:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:17 smithi057 ceph-mon[92072]: pgmap v3485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:46:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:17 smithi122 ceph-mon[125440]: pgmap v3485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:46:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:19 smithi136 ceph-mon[125702]: pgmap v3486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:46:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:19 smithi057 ceph-mon[92072]: pgmap v3486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:46:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:19 smithi122 ceph-mon[125440]: pgmap v3486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:46:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:21 smithi057 ceph-mon[92072]: pgmap v3487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:46:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:21 smithi122 ceph-mon[125440]: pgmap v3487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:46:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:21 smithi136 ceph-mon[125702]: pgmap v3487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:46:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:23.912+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:46:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:23.913+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:46:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:23.913+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:46:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:23.913+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:46:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:23.913+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:46:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:23 smithi057 ceph-mon[92072]: pgmap v3488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:46:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:23 smithi122 ceph-mon[125440]: pgmap v3488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:46:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:23 smithi136 ceph-mon[125702]: pgmap v3488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:46:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:24.272+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:46:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:24.272+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:46:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:24.273+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 53 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:46:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:24.273+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 54 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:46:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:25 smithi057 ceph-mon[92072]: pgmap v3489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:46:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:25 smithi122 ceph-mon[125440]: pgmap v3489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:46:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:25 smithi136 ceph-mon[125702]: pgmap v3489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:46:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:27 smithi057 ceph-mon[92072]: pgmap v3490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:46:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:27 smithi122 ceph-mon[125440]: pgmap v3490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:46:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:27 smithi136 ceph-mon[125702]: pgmap v3490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:46:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:28 smithi057 ceph-mon[92072]: pgmap v3491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:46:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:28 smithi122 ceph-mon[125440]: pgmap v3491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:46:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:28 smithi136 ceph-mon[125702]: pgmap v3491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:46:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:31 smithi136 ceph-mon[125702]: pgmap v3492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:31 smithi057 ceph-mon[92072]: pgmap v3492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:31 smithi122 ceph-mon[125440]: pgmap v3492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:33.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:33 smithi057 ceph-mon[92072]: pgmap v3493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:33.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:46:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:33 smithi122 ceph-mon[125440]: pgmap v3493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:46:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:33 smithi136 ceph-mon[125702]: pgmap v3493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:46:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:46:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:46:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:46:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:46:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:46:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:46:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:46:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:46:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:46:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:35 smithi057 ceph-mon[92072]: pgmap v3494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:35 smithi122 ceph-mon[125440]: pgmap v3494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:35 smithi136 ceph-mon[125702]: pgmap v3494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:37 smithi057 ceph-mon[92072]: pgmap v3495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:37 smithi122 ceph-mon[125440]: pgmap v3495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:37 smithi136 ceph-mon[125702]: pgmap v3495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:38.927+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:46:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:38.927+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:46:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:38.927+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:46:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:38.927+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:46:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:38.927+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:46:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:39 smithi057 ceph-mon[92072]: pgmap v3496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:39 smithi122 ceph-mon[125440]: pgmap v3496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:39 smithi136 ceph-mon[125702]: pgmap v3496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:41 smithi057 ceph-mon[92072]: pgmap v3497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:41 smithi122 ceph-mon[125440]: pgmap v3497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:41 smithi136 ceph-mon[125702]: pgmap v3497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:42 smithi057 ceph-mon[92072]: pgmap v3498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:42 smithi122 ceph-mon[125440]: pgmap v3498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:42 smithi136 ceph-mon[125702]: pgmap v3498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:45 smithi136 ceph-mon[125702]: pgmap v3499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:45 smithi057 ceph-mon[92072]: pgmap v3499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:45 smithi122 ceph-mon[125440]: pgmap v3499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:47 smithi136 ceph-mon[125702]: pgmap v3500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:47 smithi057 ceph-mon[92072]: pgmap v3500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:47 smithi122 ceph-mon[125440]: pgmap v3500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:49 smithi136 ceph-mon[125702]: pgmap v3501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:49 smithi057 ceph-mon[92072]: pgmap v3501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:49 smithi122 ceph-mon[125440]: pgmap v3501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:51 smithi057 ceph-mon[92072]: pgmap v3502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:51 smithi122 ceph-mon[125440]: pgmap v3502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:51 smithi136 ceph-mon[125702]: pgmap v3502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:53 smithi057 ceph-mon[92072]: pgmap v3503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:53.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:46:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:53.943+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:46:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:53.943+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:46:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:53.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:46:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:46:53.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:46:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:53 smithi122 ceph-mon[125440]: pgmap v3503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:53 smithi136 ceph-mon[125702]: pgmap v3503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:55 smithi057 ceph-mon[92072]: pgmap v3504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:55 smithi122 ceph-mon[125440]: pgmap v3504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:55 smithi136 ceph-mon[125702]: pgmap v3504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:57 smithi057 ceph-mon[92072]: pgmap v3505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:57 smithi122 ceph-mon[125440]: pgmap v3505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:57 smithi136 ceph-mon[125702]: pgmap v3505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:46:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:46:59 smithi057 ceph-mon[92072]: pgmap v3506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:46:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:46:59 smithi122 ceph-mon[125440]: pgmap v3506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:46:59 smithi136 ceph-mon[125702]: pgmap v3506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:01 smithi057 ceph-mon[92072]: pgmap v3507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:01 smithi122 ceph-mon[125440]: pgmap v3507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:01 smithi136 ceph-mon[125702]: pgmap v3507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:02 smithi057 ceph-mon[92072]: pgmap v3508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:47:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:02 smithi122 ceph-mon[125440]: pgmap v3508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:47:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:02 smithi136 ceph-mon[125702]: pgmap v3508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:47:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:05 smithi136 ceph-mon[125702]: pgmap v3509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:47:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:05 smithi057 ceph-mon[92072]: pgmap v3509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:47:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:05 smithi122 ceph-mon[125440]: pgmap v3509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:47:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:07 smithi057 ceph-mon[92072]: pgmap v3510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:47:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:07 smithi122 ceph-mon[125440]: pgmap v3510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:47:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:07 smithi136 ceph-mon[125702]: pgmap v3510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:47:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:08.956+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:47:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:08.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:47:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:08.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:47:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:08.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:47:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:08.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:47:09.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:09.281+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:47:09.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:09.281+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:47:09.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:09.281+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 54 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:47:09.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:09.281+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 55 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:47:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:09 smithi057 ceph-mon[92072]: pgmap v3511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:47:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:09 smithi122 ceph-mon[125440]: pgmap v3511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:47:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:09 smithi136 ceph-mon[125702]: pgmap v3511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:47:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:11 smithi057 ceph-mon[92072]: pgmap v3512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:47:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:11 smithi057 ceph-mon[92072]: osdmap e293: 12 total, 12 up, 12 in 2023-03-02T12:47:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:11 smithi122 ceph-mon[125440]: pgmap v3512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:47:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:11 smithi122 ceph-mon[125440]: osdmap e293: 12 total, 12 up, 12 in 2023-03-02T12:47:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:11 smithi136 ceph-mon[125702]: pgmap v3512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:47:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:11 smithi136 ceph-mon[125702]: osdmap e293: 12 total, 12 up, 12 in 2023-03-02T12:47:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:13 smithi057 ceph-mon[92072]: pgmap v3514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:47:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:13 smithi122 ceph-mon[125440]: pgmap v3514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:47:14.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:13 smithi136 ceph-mon[125702]: pgmap v3514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:47:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:14 smithi057 ceph-mon[92072]: pgmap v3515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:47:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:14 smithi122 ceph-mon[125440]: pgmap v3515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:47:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:14 smithi136 ceph-mon[125702]: pgmap v3515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:47:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:16 smithi057 ceph-mon[92072]: osdmap e294: 12 total, 12 up, 12 in 2023-03-02T12:47:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:16 smithi122 ceph-mon[125440]: osdmap e294: 12 total, 12 up, 12 in 2023-03-02T12:47:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:16 smithi136 ceph-mon[125702]: osdmap e294: 12 total, 12 up, 12 in 2023-03-02T12:47:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:17 smithi057 ceph-mon[92072]: pgmap v3517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:47:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:17 smithi122 ceph-mon[125440]: pgmap v3517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:47:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:17 smithi136 ceph-mon[125702]: pgmap v3517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:47:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:19 smithi057 ceph-mon[92072]: pgmap v3518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:47:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:19 smithi122 ceph-mon[125440]: pgmap v3518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:47:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:19 smithi136 ceph-mon[125702]: pgmap v3518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:47:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:21 smithi057 ceph-mon[92072]: pgmap v3519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:47:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:21 smithi122 ceph-mon[125440]: pgmap v3519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:47:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:21 smithi136 ceph-mon[125702]: pgmap v3519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:47:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:23 smithi057 ceph-mon[92072]: pgmap v3520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:47:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:23 smithi122 ceph-mon[125440]: pgmap v3520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:47:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:23.972+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:47:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:23.972+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:47:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:23.972+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:47:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:23.972+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:47:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:23.972+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:47:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:23 smithi136 ceph-mon[125702]: pgmap v3520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:47:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:24 smithi057 ceph-mon[92072]: pgmap v3521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:47:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:24 smithi122 ceph-mon[125440]: pgmap v3521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:47:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:24 smithi136 ceph-mon[125702]: pgmap v3521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:47:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:27 smithi057 ceph-mon[92072]: pgmap v3522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:47:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:27 smithi122 ceph-mon[125440]: pgmap v3522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:47:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:27 smithi136 ceph-mon[125702]: pgmap v3522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:47:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:29 smithi057 ceph-mon[92072]: pgmap v3523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:47:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:29 smithi122 ceph-mon[125440]: pgmap v3523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:47:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:29 smithi136 ceph-mon[125702]: pgmap v3523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:47:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:31 smithi057 ceph-mon[92072]: pgmap v3524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:31 smithi122 ceph-mon[125440]: pgmap v3524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:31 smithi136 ceph-mon[125702]: pgmap v3524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:33 smithi057 ceph-mon[92072]: pgmap v3525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:33 smithi122 ceph-mon[125440]: pgmap v3525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:33 smithi136 ceph-mon[125702]: pgmap v3525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:47:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:34 smithi057 ceph-mon[92072]: pgmap v3526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:47:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:34 smithi122 ceph-mon[125440]: pgmap v3526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:47:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:34 smithi136 ceph-mon[125702]: pgmap v3526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:47:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:47:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:47:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:47:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:47:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:47:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:47:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:47:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:47:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:36 smithi057 ceph-mon[92072]: pgmap v3527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:36 smithi122 ceph-mon[125440]: pgmap v3527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:36 smithi136 ceph-mon[125702]: pgmap v3527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:38.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:47:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:38.987+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:47:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:38.987+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:47:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:38.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:47:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:38.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:47:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:39 smithi136 ceph-mon[125702]: pgmap v3528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:39 smithi057 ceph-mon[92072]: pgmap v3528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:39 smithi122 ceph-mon[125440]: pgmap v3528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:41 smithi057 ceph-mon[92072]: pgmap v3529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:41 smithi122 ceph-mon[125440]: pgmap v3529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:41 smithi136 ceph-mon[125702]: pgmap v3529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:43 smithi057 ceph-mon[92072]: pgmap v3530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:43 smithi122 ceph-mon[125440]: pgmap v3530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:43 smithi136 ceph-mon[125702]: pgmap v3530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:45 smithi057 ceph-mon[92072]: pgmap v3531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:45 smithi122 ceph-mon[125440]: pgmap v3531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:45 smithi136 ceph-mon[125702]: pgmap v3531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:47 smithi057 ceph-mon[92072]: pgmap v3532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:47 smithi122 ceph-mon[125440]: pgmap v3532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:47 smithi136 ceph-mon[125702]: pgmap v3532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:49 smithi057 ceph-mon[92072]: pgmap v3533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:49 smithi122 ceph-mon[125440]: pgmap v3533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:49 smithi136 ceph-mon[125702]: pgmap v3533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:51 smithi057 ceph-mon[92072]: pgmap v3534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:51 smithi122 ceph-mon[125440]: pgmap v3534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:51 smithi136 ceph-mon[125702]: pgmap v3534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:53 smithi057 ceph-mon[92072]: pgmap v3535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:53 smithi122 ceph-mon[125440]: pgmap v3535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:54.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:47:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:54.000+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:47:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:54.000+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:47:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:54.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:47:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:47:54.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:47:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:53 smithi136 ceph-mon[125702]: pgmap v3535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:55 smithi057 ceph-mon[92072]: pgmap v3536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:55 smithi122 ceph-mon[125440]: pgmap v3536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:55 smithi136 ceph-mon[125702]: pgmap v3536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:56 smithi057 ceph-mon[92072]: pgmap v3537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:56 smithi122 ceph-mon[125440]: pgmap v3537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:56 smithi136 ceph-mon[125702]: pgmap v3537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:47:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:47:59 smithi136 ceph-mon[125702]: pgmap v3538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:47:59 smithi057 ceph-mon[92072]: pgmap v3538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:47:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:47:59 smithi122 ceph-mon[125440]: pgmap v3538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:01 smithi057 ceph-mon[92072]: pgmap v3539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:01 smithi122 ceph-mon[125440]: pgmap v3539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:01 smithi136 ceph-mon[125702]: pgmap v3539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:03 smithi057 ceph-mon[92072]: pgmap v3540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:48:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:03 smithi122 ceph-mon[125440]: pgmap v3540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:48:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:03 smithi136 ceph-mon[125702]: pgmap v3540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:48:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:05 smithi057 ceph-mon[92072]: pgmap v3541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:48:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:05 smithi122 ceph-mon[125440]: pgmap v3541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:48:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:05 smithi136 ceph-mon[125702]: pgmap v3541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:48:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:07 smithi057 ceph-mon[92072]: pgmap v3542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:48:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:07 smithi122 ceph-mon[125440]: pgmap v3542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:48:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:07 smithi136 ceph-mon[125702]: pgmap v3542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:48:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:09.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:48:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:09.015+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:48:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:09.015+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:48:09.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:09.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:48:09.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:09.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:48:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:09 smithi057 ceph-mon[92072]: pgmap v3543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:48:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:09 smithi122 ceph-mon[125440]: pgmap v3543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:48:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:09 smithi136 ceph-mon[125702]: pgmap v3543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:48:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:11 smithi057 ceph-mon[92072]: pgmap v3544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:48:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:11 smithi057 ceph-mon[92072]: osdmap e295: 12 total, 12 up, 12 in 2023-03-02T12:48:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:11 smithi122 ceph-mon[125440]: pgmap v3544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:48:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:11 smithi122 ceph-mon[125440]: osdmap e295: 12 total, 12 up, 12 in 2023-03-02T12:48:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:11 smithi136 ceph-mon[125702]: pgmap v3544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:48:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:11 smithi136 ceph-mon[125702]: osdmap e295: 12 total, 12 up, 12 in 2023-03-02T12:48:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:13 smithi057 ceph-mon[92072]: pgmap v3546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:48:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:13 smithi122 ceph-mon[125440]: pgmap v3546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:48:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:13 smithi136 ceph-mon[125702]: pgmap v3546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:48:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:15 smithi057 ceph-mon[92072]: pgmap v3547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:48:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:15 smithi122 ceph-mon[125440]: pgmap v3547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:48:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:15 smithi136 ceph-mon[125702]: pgmap v3547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:48:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:16 smithi057 ceph-mon[92072]: osdmap e296: 12 total, 12 up, 12 in 2023-03-02T12:48:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:16 smithi057 ceph-mon[92072]: pgmap v3549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:48:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:16 smithi122 ceph-mon[125440]: osdmap e296: 12 total, 12 up, 12 in 2023-03-02T12:48:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:16 smithi122 ceph-mon[125440]: pgmap v3549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:48:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:16 smithi136 ceph-mon[125702]: osdmap e296: 12 total, 12 up, 12 in 2023-03-02T12:48:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:16 smithi136 ceph-mon[125702]: pgmap v3549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:48:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:19 smithi136 ceph-mon[125702]: pgmap v3550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:48:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:19 smithi057 ceph-mon[92072]: pgmap v3550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:48:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:19 smithi122 ceph-mon[125440]: pgmap v3550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:48:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:21 smithi057 ceph-mon[92072]: pgmap v3551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:48:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:21 smithi122 ceph-mon[125440]: pgmap v3551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:48:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:21 smithi136 ceph-mon[125702]: pgmap v3551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-02T12:48:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:23 smithi057 ceph-mon[92072]: pgmap v3552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:48:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:23 smithi122 ceph-mon[125440]: pgmap v3552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:48:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:24.030+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:48:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:24.031+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:48:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:24.031+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:48:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:24.031+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:48:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:24.031+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:48:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:23 smithi136 ceph-mon[125702]: pgmap v3552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:48:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:25 smithi057 ceph-mon[92072]: pgmap v3553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:48:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:25 smithi122 ceph-mon[125440]: pgmap v3553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:48:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:25 smithi136 ceph-mon[125702]: pgmap v3553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:48:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:27 smithi057 ceph-mon[92072]: pgmap v3554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:48:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:27 smithi122 ceph-mon[125440]: pgmap v3554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:48:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:27 smithi136 ceph-mon[125702]: pgmap v3554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:48:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:28 smithi122 ceph-mon[125440]: pgmap v3555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:48:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:28 smithi136 ceph-mon[125702]: pgmap v3555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:48:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:28 smithi057 ceph-mon[92072]: pgmap v3555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:48:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:31 smithi057 ceph-mon[92072]: pgmap v3556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:31 smithi122 ceph-mon[125440]: pgmap v3556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:31 smithi136 ceph-mon[125702]: pgmap v3556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:33 smithi057 ceph-mon[92072]: pgmap v3557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:33 smithi122 ceph-mon[125440]: pgmap v3557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:33 smithi136 ceph-mon[125702]: pgmap v3557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:35 smithi057 ceph-mon[92072]: pgmap v3558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:48:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:35 smithi122 ceph-mon[125440]: pgmap v3558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:48:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:35 smithi136 ceph-mon[125702]: pgmap v3558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:48:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:48:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:48:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:48:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:48:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:48:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:48:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:48:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:48:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:48:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:37 smithi057 ceph-mon[92072]: pgmap v3559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:37 smithi122 ceph-mon[125440]: pgmap v3559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:37 smithi136 ceph-mon[125702]: pgmap v3559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:39.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:48:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:39.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:48:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:39.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:48:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:39.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:48:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:39.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:48:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:39 smithi057 ceph-mon[92072]: pgmap v3560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:39 smithi122 ceph-mon[125440]: pgmap v3560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:39 smithi136 ceph-mon[125702]: pgmap v3560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:41 smithi057 ceph-mon[92072]: pgmap v3561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:41 smithi122 ceph-mon[125440]: pgmap v3561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:41 smithi136 ceph-mon[125702]: pgmap v3561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:42 smithi057 ceph-mon[92072]: pgmap v3562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:42 smithi122 ceph-mon[125440]: pgmap v3562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:42 smithi136 ceph-mon[125702]: pgmap v3562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:45 smithi136 ceph-mon[125702]: pgmap v3563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:45 smithi057 ceph-mon[92072]: pgmap v3563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:45 smithi122 ceph-mon[125440]: pgmap v3563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:47 smithi057 ceph-mon[92072]: pgmap v3564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:47 smithi122 ceph-mon[125440]: pgmap v3564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:47 smithi136 ceph-mon[125702]: pgmap v3564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:49 smithi057 ceph-mon[92072]: pgmap v3565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:49 smithi122 ceph-mon[125440]: pgmap v3565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:49 smithi136 ceph-mon[125702]: pgmap v3565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:51 smithi057 ceph-mon[92072]: pgmap v3566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:51 smithi122 ceph-mon[125440]: pgmap v3566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:51 smithi136 ceph-mon[125702]: pgmap v3566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:53 smithi057 ceph-mon[92072]: pgmap v3567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:53 smithi122 ceph-mon[125440]: pgmap v3567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:54.059+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:48:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:54.059+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:48:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:54.059+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:48:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:54.059+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:48:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:48:54.059+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:48:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:53 smithi136 ceph-mon[125702]: pgmap v3567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:55 smithi057 ceph-mon[92072]: pgmap v3568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:55 smithi122 ceph-mon[125440]: pgmap v3568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:55 smithi136 ceph-mon[125702]: pgmap v3568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:56 smithi057 ceph-mon[92072]: pgmap v3569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:56 smithi122 ceph-mon[125440]: pgmap v3569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:56 smithi136 ceph-mon[125702]: pgmap v3569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:48:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:48:59 smithi136 ceph-mon[125702]: pgmap v3570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:48:59 smithi057 ceph-mon[92072]: pgmap v3570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:48:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:48:59 smithi122 ceph-mon[125440]: pgmap v3570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:01 smithi057 ceph-mon[92072]: pgmap v3571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:01 smithi122 ceph-mon[125440]: pgmap v3571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:01 smithi136 ceph-mon[125702]: pgmap v3571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:03 smithi057 ceph-mon[92072]: pgmap v3572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:49:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:03 smithi122 ceph-mon[125440]: pgmap v3572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:49:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:03 smithi136 ceph-mon[125702]: pgmap v3572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:49:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:05 smithi057 ceph-mon[92072]: pgmap v3573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:49:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:05 smithi122 ceph-mon[125440]: pgmap v3573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:49:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:05 smithi136 ceph-mon[125702]: pgmap v3573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:49:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:06 smithi057 ceph-mon[92072]: pgmap v3574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:49:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:06 smithi122 ceph-mon[125440]: pgmap v3574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:49:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:06 smithi136 ceph-mon[125702]: pgmap v3574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:49:09.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:09.072+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:49:09.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:09.072+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:49:09.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:09.072+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:49:09.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:09.072+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:49:09.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:09.072+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:49:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:09 smithi057 ceph-mon[92072]: pgmap v3575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:49:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:09 smithi122 ceph-mon[125440]: pgmap v3575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:49:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:09 smithi136 ceph-mon[125702]: pgmap v3575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:49:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:11 smithi057 ceph-mon[92072]: pgmap v3576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:49:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:11 smithi057 ceph-mon[92072]: osdmap e297: 12 total, 12 up, 12 in 2023-03-02T12:49:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:11 smithi122 ceph-mon[125440]: pgmap v3576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:49:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:11 smithi122 ceph-mon[125440]: osdmap e297: 12 total, 12 up, 12 in 2023-03-02T12:49:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:11 smithi136 ceph-mon[125702]: pgmap v3576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:49:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:11 smithi136 ceph-mon[125702]: osdmap e297: 12 total, 12 up, 12 in 2023-03-02T12:49:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:13 smithi057 ceph-mon[92072]: pgmap v3578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:49:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:13 smithi122 ceph-mon[125440]: pgmap v3578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:49:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:13 smithi136 ceph-mon[125702]: pgmap v3578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:49:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:15 smithi057 ceph-mon[92072]: pgmap v3579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:49:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:15 smithi122 ceph-mon[125440]: pgmap v3579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:49:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:15 smithi136 ceph-mon[125702]: pgmap v3579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:49:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:16 smithi057 ceph-mon[92072]: osdmap e298: 12 total, 12 up, 12 in 2023-03-02T12:49:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:16 smithi122 ceph-mon[125440]: osdmap e298: 12 total, 12 up, 12 in 2023-03-02T12:49:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:16 smithi136 ceph-mon[125702]: osdmap e298: 12 total, 12 up, 12 in 2023-03-02T12:49:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:17 smithi057 ceph-mon[92072]: pgmap v3581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:49:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:17 smithi122 ceph-mon[125440]: pgmap v3581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:49:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:17 smithi136 ceph-mon[125702]: pgmap v3581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:49:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:18 smithi057 ceph-mon[92072]: pgmap v3582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:49:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:18 smithi122 ceph-mon[125440]: pgmap v3582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:49:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:18 smithi136 ceph-mon[125702]: pgmap v3582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:49:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:21 smithi057 ceph-mon[92072]: pgmap v3583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:49:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:21 smithi122 ceph-mon[125440]: pgmap v3583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:49:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:21 smithi136 ceph-mon[125702]: pgmap v3583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:49:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:23 smithi057 ceph-mon[92072]: pgmap v3584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:49:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:23 smithi122 ceph-mon[125440]: pgmap v3584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:49:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:24.078+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:49:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:24.078+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:49:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:24.078+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:49:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:24.078+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:49:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:24.078+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:49:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:23 smithi136 ceph-mon[125702]: pgmap v3584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:49:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:25 smithi057 ceph-mon[92072]: pgmap v3585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:49:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:25 smithi122 ceph-mon[125440]: pgmap v3585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:49:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:25 smithi136 ceph-mon[125702]: pgmap v3585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:49:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:27 smithi057 ceph-mon[92072]: pgmap v3586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:49:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:27 smithi122 ceph-mon[125440]: pgmap v3586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:49:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:27 smithi136 ceph-mon[125702]: pgmap v3586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:49:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:28 smithi057 ceph-mon[92072]: pgmap v3587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:49:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:28 smithi122 ceph-mon[125440]: pgmap v3587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:49:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:28 smithi136 ceph-mon[125702]: pgmap v3587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:49:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:31 smithi057 ceph-mon[92072]: pgmap v3588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:31 smithi122 ceph-mon[125440]: pgmap v3588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:31 smithi136 ceph-mon[125702]: pgmap v3588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:33 smithi057 ceph-mon[92072]: pgmap v3589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:33 smithi122 ceph-mon[125440]: pgmap v3589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:33 smithi136 ceph-mon[125702]: pgmap v3589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:34 smithi057 ceph-mon[92072]: pgmap v3590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:34 smithi122 ceph-mon[125440]: pgmap v3590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:34 smithi136 ceph-mon[125702]: pgmap v3590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:49:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:49:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:49:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:37 smithi057 ceph-mon[92072]: pgmap v3591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:49:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:49:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:49:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:37 smithi122 ceph-mon[125440]: pgmap v3591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:49:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:49:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:49:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:37 smithi136 ceph-mon[125702]: pgmap v3591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:49:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:49:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:49:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:38 smithi057 ceph-mon[92072]: pgmap v3592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:38 smithi122 ceph-mon[125440]: pgmap v3592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:39.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:49:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:39.079+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:49:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:39.079+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:49:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:39.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:49:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:39.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:49:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:38 smithi136 ceph-mon[125702]: pgmap v3592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:41 smithi057 ceph-mon[92072]: pgmap v3593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:41 smithi122 ceph-mon[125440]: pgmap v3593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:41 smithi136 ceph-mon[125702]: pgmap v3593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:42 smithi122 ceph-mon[125440]: pgmap v3594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:42 smithi136 ceph-mon[125702]: pgmap v3594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:42 smithi057 ceph-mon[92072]: pgmap v3594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:45 smithi057 ceph-mon[92072]: pgmap v3595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:45 smithi122 ceph-mon[125440]: pgmap v3595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:45 smithi136 ceph-mon[125702]: pgmap v3595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:47 smithi057 ceph-mon[92072]: pgmap v3596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:47 smithi122 ceph-mon[125440]: pgmap v3596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:47 smithi136 ceph-mon[125702]: pgmap v3596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:48 smithi057 ceph-mon[92072]: pgmap v3597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:48 smithi122 ceph-mon[125440]: pgmap v3597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:48 smithi136 ceph-mon[125702]: pgmap v3597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:51 smithi057 ceph-mon[92072]: pgmap v3598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:51 smithi122 ceph-mon[125440]: pgmap v3598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:51 smithi136 ceph-mon[125702]: pgmap v3598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:53 smithi057 ceph-mon[92072]: pgmap v3599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:53 smithi122 ceph-mon[125440]: pgmap v3599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:54.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:49:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:54.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:49:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:54.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:49:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:54.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:49:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:49:54.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:49:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:53 smithi136 ceph-mon[125702]: pgmap v3599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:54 smithi122 ceph-mon[125440]: pgmap v3600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:54 smithi136 ceph-mon[125702]: pgmap v3600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:54 smithi057 ceph-mon[92072]: pgmap v3600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:57 smithi057 ceph-mon[92072]: pgmap v3601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:57 smithi122 ceph-mon[125440]: pgmap v3601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:57 smithi136 ceph-mon[125702]: pgmap v3601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:49:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:49:59 smithi057 ceph-mon[92072]: pgmap v3602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:49:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:49:59 smithi122 ceph-mon[125440]: pgmap v3602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:49:59 smithi136 ceph-mon[125702]: pgmap v3602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T12:50:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:00 smithi057 ceph-mon[92072]: pgmap v3603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T12:50:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:00 smithi122 ceph-mon[125440]: pgmap v3603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T12:50:01.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:00 smithi136 ceph-mon[125702]: pgmap v3603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:03 smithi057 ceph-mon[92072]: pgmap v3604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:50:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:03 smithi122 ceph-mon[125440]: pgmap v3604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:50:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:03 smithi136 ceph-mon[125702]: pgmap v3604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:50:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:05 smithi057 ceph-mon[92072]: pgmap v3605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:50:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:05 smithi122 ceph-mon[125440]: pgmap v3605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:50:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:05 smithi136 ceph-mon[125702]: pgmap v3605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:50:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:06 smithi057 ceph-mon[92072]: osdmap e299: 12 total, 12 up, 12 in 2023-03-02T12:50:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:06 smithi122 ceph-mon[125440]: osdmap e299: 12 total, 12 up, 12 in 2023-03-02T12:50:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:06 smithi136 ceph-mon[125702]: osdmap e299: 12 total, 12 up, 12 in 2023-03-02T12:50:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:07 smithi057 ceph-mon[92072]: pgmap v3607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:50:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:07 smithi122 ceph-mon[125440]: pgmap v3607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:50:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:07 smithi136 ceph-mon[125702]: pgmap v3607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:50:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:08 smithi122 ceph-mon[125440]: pgmap v3608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:50:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:08 smithi136 ceph-mon[125702]: pgmap v3608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:50:09.098 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:09.097+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:50:09.098 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:09.097+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:50:09.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:09.097+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:50:09.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:09.097+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:50:09.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:09.097+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:50:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:08 smithi057 ceph-mon[92072]: pgmap v3608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:50:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:09.307+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:50:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:09.307+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:50:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:09.307+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 55 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:50:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:09.307+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 56 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:50:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:11 smithi057 ceph-mon[92072]: pgmap v3609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:50:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:11 smithi057 ceph-mon[92072]: osdmap e300: 12 total, 12 up, 12 in 2023-03-02T12:50:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:11 smithi122 ceph-mon[125440]: pgmap v3609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:50:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:11 smithi122 ceph-mon[125440]: osdmap e300: 12 total, 12 up, 12 in 2023-03-02T12:50:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:11 smithi136 ceph-mon[125702]: pgmap v3609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:50:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:11 smithi136 ceph-mon[125702]: osdmap e300: 12 total, 12 up, 12 in 2023-03-02T12:50:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:13 smithi057 ceph-mon[92072]: pgmap v3611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:50:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:13 smithi122 ceph-mon[125440]: pgmap v3611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:50:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:13 smithi136 ceph-mon[125702]: pgmap v3611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:50:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:14 smithi057 ceph-mon[92072]: pgmap v3612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:50:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:14 smithi122 ceph-mon[125440]: pgmap v3612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:50:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:14 smithi136 ceph-mon[125702]: pgmap v3612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T12:50:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:17 smithi057 ceph-mon[92072]: pgmap v3613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:50:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:17 smithi122 ceph-mon[125440]: pgmap v3613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:50:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:17 smithi136 ceph-mon[125702]: pgmap v3613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:50:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:18 smithi057 ceph-mon[92072]: pgmap v3614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:50:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:18 smithi122 ceph-mon[125440]: pgmap v3614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:50:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:18 smithi136 ceph-mon[125702]: pgmap v3614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:50:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:21 smithi057 ceph-mon[92072]: pgmap v3615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:50:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:21 smithi122 ceph-mon[125440]: pgmap v3615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:50:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:21 smithi136 ceph-mon[125702]: pgmap v3615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:50:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:22 smithi057 ceph-mon[92072]: pgmap v3616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:50:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:22 smithi122 ceph-mon[125440]: pgmap v3616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:50:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:22 smithi136 ceph-mon[125702]: pgmap v3616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:50:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:24.113+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:50:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:24.113+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:50:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:24.113+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:50:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:24.113+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:50:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:24.113+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:50:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:25 smithi057 ceph-mon[92072]: pgmap v3617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:25 smithi122 ceph-mon[125440]: pgmap v3617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:25 smithi136 ceph-mon[125702]: pgmap v3617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:26 smithi136 ceph-mon[125702]: pgmap v3618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:26 smithi057 ceph-mon[92072]: pgmap v3618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:26 smithi122 ceph-mon[125440]: pgmap v3618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:29 smithi057 ceph-mon[92072]: pgmap v3619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:29 smithi122 ceph-mon[125440]: pgmap v3619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:29 smithi136 ceph-mon[125702]: pgmap v3619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:31 smithi057 ceph-mon[92072]: pgmap v3620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:31 smithi122 ceph-mon[125440]: pgmap v3620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:31 smithi136 ceph-mon[125702]: pgmap v3620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:32 smithi136 ceph-mon[125702]: pgmap v3621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:32 smithi057 ceph-mon[92072]: pgmap v3621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:32 smithi122 ceph-mon[125440]: pgmap v3621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:35 smithi057 ceph-mon[92072]: pgmap v3622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:35 smithi122 ceph-mon[125440]: pgmap v3622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:35 smithi136 ceph-mon[125702]: pgmap v3622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:37 smithi057 ceph-mon[92072]: pgmap v3623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:50:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:37 smithi122 ceph-mon[125440]: pgmap v3623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:37.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:50:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:37 smithi136 ceph-mon[125702]: pgmap v3623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:50:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:38 smithi136 ceph-mon[125702]: pgmap v3624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:39.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:50:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:39.122+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:50:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:39.122+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:50:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:39.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:50:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:39.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:50:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:38 smithi057 ceph-mon[92072]: pgmap v3624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:38 smithi122 ceph-mon[125440]: pgmap v3624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:41 smithi136 ceph-mon[125702]: pgmap v3625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:41 smithi057 ceph-mon[92072]: pgmap v3625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:41 smithi122 ceph-mon[125440]: pgmap v3625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:41.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:50:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:50:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:50:42.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:50:42.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:50:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:50:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:50:42.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:50:42.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T12:50:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T12:50:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T12:50:42.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:50:42.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:50:42.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:50:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:43 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:50:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:43 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:50:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:43 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:50:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:43 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:50:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:43 smithi057 ceph-mon[92072]: pgmap v3626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:43 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:50:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:43 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:50:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:43 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:50:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:43 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:50:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:43 smithi122 ceph-mon[125440]: pgmap v3626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:43 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T12:50:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:43 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T12:50:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:43 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T12:50:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:43 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T12:50:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:43 smithi136 ceph-mon[125702]: pgmap v3626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:45 smithi057 ceph-mon[92072]: pgmap v3627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:45 smithi122 ceph-mon[125440]: pgmap v3627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:45 smithi136 ceph-mon[125702]: pgmap v3627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:47 smithi057 ceph-mon[92072]: pgmap v3628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:47 smithi122 ceph-mon[125440]: pgmap v3628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:47 smithi136 ceph-mon[125702]: pgmap v3628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:48 smithi057 ceph-mon[92072]: pgmap v3629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:48 smithi122 ceph-mon[125440]: pgmap v3629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:48 smithi136 ceph-mon[125702]: pgmap v3629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:51 smithi057 ceph-mon[92072]: pgmap v3630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:51 smithi122 ceph-mon[125440]: pgmap v3630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:51 smithi136 ceph-mon[125702]: pgmap v3630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:52 smithi057 ceph-mon[92072]: pgmap v3631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:52 smithi122 ceph-mon[125440]: pgmap v3631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:52 smithi136 ceph-mon[125702]: pgmap v3631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:54.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:50:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:54.135+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:50:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:54.135+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:50:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:54.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:50:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:50:54.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:50:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:55 smithi057 ceph-mon[92072]: pgmap v3632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:55 smithi122 ceph-mon[125440]: pgmap v3632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:55 smithi136 ceph-mon[125702]: pgmap v3632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:57.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:56 smithi136 ceph-mon[125702]: pgmap v3633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:56 smithi057 ceph-mon[92072]: pgmap v3633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:56 smithi122 ceph-mon[125440]: pgmap v3633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:50:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:50:59 smithi057 ceph-mon[92072]: pgmap v3634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:50:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:50:59 smithi122 ceph-mon[125440]: pgmap v3634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:50:59 smithi136 ceph-mon[125702]: pgmap v3634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:01 smithi057 ceph-mon[92072]: pgmap v3635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:01 smithi122 ceph-mon[125440]: pgmap v3635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:01 smithi136 ceph-mon[125702]: pgmap v3635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:02 smithi057 ceph-mon[92072]: pgmap v3636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:51:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:02 smithi122 ceph-mon[125440]: pgmap v3636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:51:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:02 smithi136 ceph-mon[125702]: pgmap v3636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:51:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:05 smithi057 ceph-mon[92072]: pgmap v3637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:51:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:05 smithi122 ceph-mon[125440]: pgmap v3637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:51:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:05 smithi136 ceph-mon[125702]: pgmap v3637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:51:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:06 smithi057 ceph-mon[92072]: pgmap v3638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:51:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:06 smithi122 ceph-mon[125440]: pgmap v3638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:51:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:06 smithi136 ceph-mon[125702]: pgmap v3638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:51:09.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:09.152+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:51:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:09.152+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:51:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:09.152+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:51:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:09.152+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:51:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:09.152+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:51:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:09 smithi057 ceph-mon[92072]: pgmap v3639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:51:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:09 smithi122 ceph-mon[125440]: pgmap v3639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:51:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:09 smithi136 ceph-mon[125702]: pgmap v3639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:51:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:11 smithi057 ceph-mon[92072]: pgmap v3640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:51:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:11 smithi057 ceph-mon[92072]: osdmap e301: 12 total, 12 up, 12 in 2023-03-02T12:51:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:11 smithi122 ceph-mon[125440]: pgmap v3640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:51:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:11 smithi122 ceph-mon[125440]: osdmap e301: 12 total, 12 up, 12 in 2023-03-02T12:51:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:11 smithi136 ceph-mon[125702]: pgmap v3640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:51:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:11 smithi136 ceph-mon[125702]: osdmap e301: 12 total, 12 up, 12 in 2023-03-02T12:51:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:13 smithi057 ceph-mon[92072]: pgmap v3642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:13 smithi122 ceph-mon[125440]: pgmap v3642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:13 smithi136 ceph-mon[125702]: pgmap v3642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:15 smithi057 ceph-mon[92072]: pgmap v3643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:15 smithi122 ceph-mon[125440]: pgmap v3643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:15.977 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:15 smithi136 ceph-mon[125702]: pgmap v3643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:16 smithi057 ceph-mon[92072]: osdmap e302: 12 total, 12 up, 12 in 2023-03-02T12:51:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:16 smithi057 ceph-mon[92072]: pgmap v3645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:51:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:16 smithi122 ceph-mon[125440]: osdmap e302: 12 total, 12 up, 12 in 2023-03-02T12:51:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:16 smithi122 ceph-mon[125440]: pgmap v3645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:51:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:16 smithi136 ceph-mon[125702]: osdmap e302: 12 total, 12 up, 12 in 2023-03-02T12:51:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:16 smithi136 ceph-mon[125702]: pgmap v3645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:51:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:19 smithi057 ceph-mon[92072]: pgmap v3646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:51:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:19 smithi122 ceph-mon[125440]: pgmap v3646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:51:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:19 smithi136 ceph-mon[125702]: pgmap v3646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T12:51:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:21 smithi057 ceph-mon[92072]: pgmap v3647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T12:51:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:21 smithi122 ceph-mon[125440]: pgmap v3647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T12:51:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:21 smithi136 ceph-mon[125702]: pgmap v3647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T12:51:23.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:23 smithi057 ceph-mon[92072]: pgmap v3648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:23 smithi122 ceph-mon[125440]: pgmap v3648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:23 smithi136 ceph-mon[125702]: pgmap v3648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:24.160+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:51:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:24.160+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:51:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:24.160+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:51:24.162 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:24.160+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:51:24.162 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:24.160+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:51:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:25 smithi057 ceph-mon[92072]: pgmap v3649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:25 smithi122 ceph-mon[125440]: pgmap v3649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:25 smithi136 ceph-mon[125702]: pgmap v3649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:51:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:26 smithi057 ceph-mon[92072]: pgmap v3650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:51:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:26 smithi122 ceph-mon[125440]: pgmap v3650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:51:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:26 smithi136 ceph-mon[125702]: pgmap v3650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s 2023-03-02T12:51:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:29 smithi057 ceph-mon[92072]: pgmap v3651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:51:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:29 smithi122 ceph-mon[125440]: pgmap v3651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:51:30.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:29 smithi136 ceph-mon[125702]: pgmap v3651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T12:51:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:31 smithi057 ceph-mon[92072]: pgmap v3652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:31 smithi122 ceph-mon[125440]: pgmap v3652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:31 smithi136 ceph-mon[125702]: pgmap v3652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:33 smithi057 ceph-mon[92072]: pgmap v3653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:33 smithi122 ceph-mon[125440]: pgmap v3653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:33 smithi136 ceph-mon[125702]: pgmap v3653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:35 smithi057 ceph-mon[92072]: pgmap v3654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:35 smithi122 ceph-mon[125440]: pgmap v3654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:35 smithi136 ceph-mon[125702]: pgmap v3654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:36 smithi057 ceph-mon[92072]: pgmap v3655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:36 smithi122 ceph-mon[125440]: pgmap v3655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:36 smithi136 ceph-mon[125702]: pgmap v3655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:39.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:39.174+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:51:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:39.175+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:51:39.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:39.175+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:51:39.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:39.175+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:51:39.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:39.175+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:51:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:39 smithi057 ceph-mon[92072]: pgmap v3656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:39 smithi122 ceph-mon[125440]: pgmap v3656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:39 smithi136 ceph-mon[125702]: pgmap v3656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:41 smithi057 ceph-mon[92072]: pgmap v3657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:41 smithi122 ceph-mon[125440]: pgmap v3657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:41 smithi136 ceph-mon[125702]: pgmap v3657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:51:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:51:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:51:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:43 smithi057 ceph-mon[92072]: pgmap v3658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:51:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:51:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:51:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:43 smithi122 ceph-mon[125440]: pgmap v3658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:51:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:51:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:51:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:43 smithi136 ceph-mon[125702]: pgmap v3658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:51:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:51:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:51:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:45 smithi057 ceph-mon[92072]: pgmap v3659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:45 smithi122 ceph-mon[125440]: pgmap v3659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:45 smithi136 ceph-mon[125702]: pgmap v3659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:46 smithi057 ceph-mon[92072]: pgmap v3660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:46 smithi122 ceph-mon[125440]: pgmap v3660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:46 smithi136 ceph-mon[125702]: pgmap v3660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:49 smithi057 ceph-mon[92072]: pgmap v3661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:49 smithi122 ceph-mon[125440]: pgmap v3661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:49 smithi136 ceph-mon[125702]: pgmap v3661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:51 smithi057 ceph-mon[92072]: pgmap v3662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:51 smithi122 ceph-mon[125440]: pgmap v3662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:51 smithi136 ceph-mon[125702]: pgmap v3662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:53 smithi057 ceph-mon[92072]: pgmap v3663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:53 smithi122 ceph-mon[125440]: pgmap v3663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:53 smithi136 ceph-mon[125702]: pgmap v3663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:54.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:51:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:54.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:51:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:54.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:51:54.188 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:54.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:51:54.188 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:51:54.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:51:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:55 smithi057 ceph-mon[92072]: pgmap v3664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:55 smithi122 ceph-mon[125440]: pgmap v3664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:55 smithi136 ceph-mon[125702]: pgmap v3664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:56 smithi057 ceph-mon[92072]: pgmap v3665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:56 smithi122 ceph-mon[125440]: pgmap v3665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:56 smithi136 ceph-mon[125702]: pgmap v3665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:51:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:51:59 smithi057 ceph-mon[92072]: pgmap v3666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:51:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:51:59 smithi122 ceph-mon[125440]: pgmap v3666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:51:59 smithi136 ceph-mon[125702]: pgmap v3666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:01 smithi057 ceph-mon[92072]: pgmap v3667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:01 smithi122 ceph-mon[125440]: pgmap v3667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:01 smithi136 ceph-mon[125702]: pgmap v3667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:03 smithi057 ceph-mon[92072]: pgmap v3668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:52:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:03 smithi122 ceph-mon[125440]: pgmap v3668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:52:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:03 smithi136 ceph-mon[125702]: pgmap v3668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:52:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:05 smithi057 ceph-mon[92072]: pgmap v3669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:52:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:05 smithi122 ceph-mon[125440]: pgmap v3669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:52:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:05 smithi136 ceph-mon[125702]: pgmap v3669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:52:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:06 smithi122 ceph-mon[125440]: pgmap v3670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:52:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:06 smithi136 ceph-mon[125702]: pgmap v3670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:52:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:06 smithi057 ceph-mon[92072]: pgmap v3670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:52:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:09.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:52:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:09.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:52:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:09.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:52:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:09.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:52:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:09.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:52:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:09 smithi057 ceph-mon[92072]: pgmap v3671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:52:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:09 smithi122 ceph-mon[125440]: pgmap v3671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:52:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:09 smithi136 ceph-mon[125702]: pgmap v3671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:52:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:11 smithi057 ceph-mon[92072]: pgmap v3672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:52:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:11 smithi057 ceph-mon[92072]: osdmap e303: 12 total, 12 up, 12 in 2023-03-02T12:52:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:11 smithi122 ceph-mon[125440]: pgmap v3672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:52:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:11 smithi122 ceph-mon[125440]: osdmap e303: 12 total, 12 up, 12 in 2023-03-02T12:52:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:11 smithi136 ceph-mon[125702]: pgmap v3672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:52:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:11 smithi136 ceph-mon[125702]: osdmap e303: 12 total, 12 up, 12 in 2023-03-02T12:52:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:13 smithi057 ceph-mon[92072]: pgmap v3674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:52:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:13 smithi122 ceph-mon[125440]: pgmap v3674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:52:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:13 smithi136 ceph-mon[125702]: pgmap v3674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:52:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:15 smithi057 ceph-mon[92072]: pgmap v3675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:52:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:15 smithi122 ceph-mon[125440]: pgmap v3675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:52:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:15 smithi136 ceph-mon[125702]: pgmap v3675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:52:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:16 smithi057 ceph-mon[92072]: osdmap e304: 12 total, 12 up, 12 in 2023-03-02T12:52:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:16 smithi057 ceph-mon[92072]: pgmap v3677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:52:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:16 smithi122 ceph-mon[125440]: osdmap e304: 12 total, 12 up, 12 in 2023-03-02T12:52:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:16 smithi122 ceph-mon[125440]: pgmap v3677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:52:17.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:16 smithi136 ceph-mon[125702]: osdmap e304: 12 total, 12 up, 12 in 2023-03-02T12:52:17.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:16 smithi136 ceph-mon[125702]: pgmap v3677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:52:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:19 smithi057 ceph-mon[92072]: pgmap v3678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:52:19.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:19 smithi122 ceph-mon[125440]: pgmap v3678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:52:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:19 smithi136 ceph-mon[125702]: pgmap v3678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:52:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:21 smithi057 ceph-mon[92072]: pgmap v3679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:52:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:21 smithi122 ceph-mon[125440]: pgmap v3679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:52:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:21 smithi136 ceph-mon[125702]: pgmap v3679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:52:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:23 smithi057 ceph-mon[92072]: pgmap v3680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:52:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:23 smithi122 ceph-mon[125440]: pgmap v3680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:52:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:23 smithi136 ceph-mon[125702]: pgmap v3680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:52:24.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:24.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:52:24.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:24.204+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:52:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:24.204+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:52:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:24.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:52:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:24.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:52:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:25 smithi057 ceph-mon[92072]: pgmap v3681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:52:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:25 smithi122 ceph-mon[125440]: pgmap v3681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:52:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:25 smithi136 ceph-mon[125702]: pgmap v3681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:52:26.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:26 smithi122 ceph-mon[125440]: pgmap v3682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:52:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:26 smithi136 ceph-mon[125702]: pgmap v3682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:52:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:26 smithi057 ceph-mon[92072]: pgmap v3682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:52:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:29 smithi057 ceph-mon[92072]: pgmap v3683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:52:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:29 smithi122 ceph-mon[125440]: pgmap v3683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:52:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:29 smithi136 ceph-mon[125702]: pgmap v3683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:52:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:31 smithi057 ceph-mon[92072]: pgmap v3684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:31 smithi122 ceph-mon[125440]: pgmap v3684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:31 smithi136 ceph-mon[125702]: pgmap v3684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:33 smithi057 ceph-mon[92072]: pgmap v3685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:33 smithi122 ceph-mon[125440]: pgmap v3685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:33 smithi136 ceph-mon[125702]: pgmap v3685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:35 smithi057 ceph-mon[92072]: pgmap v3686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:35 smithi122 ceph-mon[125440]: pgmap v3686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:35 smithi136 ceph-mon[125702]: pgmap v3686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:36 smithi122 ceph-mon[125440]: pgmap v3687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:36 smithi136 ceph-mon[125702]: pgmap v3687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:36 smithi057 ceph-mon[92072]: pgmap v3687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:39.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:52:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:39.220+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:52:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:39.220+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:52:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:39.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:52:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:39.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:52:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:39 smithi057 ceph-mon[92072]: pgmap v3688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:39 smithi122 ceph-mon[125440]: pgmap v3688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:39 smithi136 ceph-mon[125702]: pgmap v3688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:41 smithi057 ceph-mon[92072]: pgmap v3689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:41.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:41 smithi122 ceph-mon[125440]: pgmap v3689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:41 smithi136 ceph-mon[125702]: pgmap v3689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:43 smithi057 ceph-mon[92072]: pgmap v3690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:52:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:43 smithi122 ceph-mon[125440]: pgmap v3690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:52:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:43 smithi136 ceph-mon[125702]: pgmap v3690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:52:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:52:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:52:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:52:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:52:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:52:44.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:44 smithi057 ceph-mon[92072]: pgmap v3691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:52:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:52:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:52:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:52:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:52:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:44 smithi122 ceph-mon[125440]: pgmap v3691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:52:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:52:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:52:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:52:45.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:52:45.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:44 smithi136 ceph-mon[125702]: pgmap v3691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:46 smithi122 ceph-mon[125440]: pgmap v3692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:46 smithi136 ceph-mon[125702]: pgmap v3692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:46 smithi057 ceph-mon[92072]: pgmap v3692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:49 smithi057 ceph-mon[92072]: pgmap v3693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:49 smithi122 ceph-mon[125440]: pgmap v3693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:49 smithi136 ceph-mon[125702]: pgmap v3693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:51 smithi057 ceph-mon[92072]: pgmap v3694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:51 smithi122 ceph-mon[125440]: pgmap v3694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:52.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:51 smithi136 ceph-mon[125702]: pgmap v3694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:53 smithi057 ceph-mon[92072]: pgmap v3695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:53 smithi122 ceph-mon[125440]: pgmap v3695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:53 smithi136 ceph-mon[125702]: pgmap v3695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:54.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:54.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:52:54.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:54.235+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:52:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:54.235+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:52:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:54.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:52:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:52:54.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:52:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:55 smithi057 ceph-mon[92072]: pgmap v3696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:55 smithi122 ceph-mon[125440]: pgmap v3696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:55 smithi136 ceph-mon[125702]: pgmap v3696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:56 smithi122 ceph-mon[125440]: pgmap v3697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:56 smithi136 ceph-mon[125702]: pgmap v3697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:56 smithi057 ceph-mon[92072]: pgmap v3697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:52:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:52:59 smithi057 ceph-mon[92072]: pgmap v3698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:52:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:52:59 smithi122 ceph-mon[125440]: pgmap v3698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:52:59 smithi136 ceph-mon[125702]: pgmap v3698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:01 smithi057 ceph-mon[92072]: pgmap v3699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:01 smithi122 ceph-mon[125440]: pgmap v3699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:01 smithi136 ceph-mon[125702]: pgmap v3699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:03 smithi057 ceph-mon[92072]: pgmap v3700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:53:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:03 smithi122 ceph-mon[125440]: pgmap v3700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:53:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:03 smithi136 ceph-mon[125702]: pgmap v3700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:53:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:05 smithi057 ceph-mon[92072]: pgmap v3701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:53:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:05 smithi122 ceph-mon[125440]: pgmap v3701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:53:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:05 smithi136 ceph-mon[125702]: pgmap v3701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:53:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:06 smithi122 ceph-mon[125440]: pgmap v3702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:53:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:06 smithi136 ceph-mon[125702]: pgmap v3702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:53:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:06 smithi057 ceph-mon[92072]: pgmap v3702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:53:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:09.250+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:53:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:09.250+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:53:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:09.250+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:53:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:09.250+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:53:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:09.250+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:53:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:09.331+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:53:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:09.332+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:53:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:09.332+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 57 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:53:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:09.332+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 56 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:53:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:09 smithi057 ceph-mon[92072]: pgmap v3703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:53:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:09 smithi122 ceph-mon[125440]: pgmap v3703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:53:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:09 smithi136 ceph-mon[125702]: pgmap v3703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:53:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:11 smithi057 ceph-mon[92072]: pgmap v3704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:53:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:11 smithi057 ceph-mon[92072]: osdmap e305: 12 total, 12 up, 12 in 2023-03-02T12:53:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:11 smithi122 ceph-mon[125440]: pgmap v3704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:53:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:11 smithi122 ceph-mon[125440]: osdmap e305: 12 total, 12 up, 12 in 2023-03-02T12:53:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:11 smithi136 ceph-mon[125702]: pgmap v3704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:53:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:11 smithi136 ceph-mon[125702]: osdmap e305: 12 total, 12 up, 12 in 2023-03-02T12:53:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:12 smithi122 ceph-mon[125440]: pgmap v3706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:53:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:12 smithi136 ceph-mon[125702]: pgmap v3706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:53:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:12 smithi057 ceph-mon[92072]: pgmap v3706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:53:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:15 smithi057 ceph-mon[92072]: pgmap v3707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:53:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:15 smithi122 ceph-mon[125440]: pgmap v3707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:53:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:15 smithi136 ceph-mon[125702]: pgmap v3707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:53:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:16 smithi122 ceph-mon[125440]: osdmap e306: 12 total, 12 up, 12 in 2023-03-02T12:53:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:16 smithi122 ceph-mon[125440]: pgmap v3709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:53:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:16 smithi136 ceph-mon[125702]: osdmap e306: 12 total, 12 up, 12 in 2023-03-02T12:53:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:16 smithi136 ceph-mon[125702]: pgmap v3709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:53:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:16 smithi057 ceph-mon[92072]: osdmap e306: 12 total, 12 up, 12 in 2023-03-02T12:53:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:16 smithi057 ceph-mon[92072]: pgmap v3709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:53:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:19 smithi057 ceph-mon[92072]: pgmap v3710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:53:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:19 smithi122 ceph-mon[125440]: pgmap v3710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:53:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:19 smithi136 ceph-mon[125702]: pgmap v3710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:53:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:21 smithi057 ceph-mon[92072]: pgmap v3711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:53:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:21 smithi122 ceph-mon[125440]: pgmap v3711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:53:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:21 smithi136 ceph-mon[125702]: pgmap v3711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:53:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:22 smithi122 ceph-mon[125440]: pgmap v3712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:53:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:22 smithi136 ceph-mon[125702]: pgmap v3712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:53:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:22 smithi057 ceph-mon[92072]: pgmap v3712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:53:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:24.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:53:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:24.267+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:53:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:24.267+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:53:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:24.267+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:53:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:24.267+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:53:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:25 smithi057 ceph-mon[92072]: pgmap v3713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:53:25.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:25 smithi122 ceph-mon[125440]: pgmap v3713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:53:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:25 smithi136 ceph-mon[125702]: pgmap v3713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:53:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:26 smithi136 ceph-mon[125702]: pgmap v3714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:53:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:26 smithi057 ceph-mon[92072]: pgmap v3714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:53:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:26 smithi122 ceph-mon[125440]: pgmap v3714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:53:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:29 smithi057 ceph-mon[92072]: pgmap v3715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:53:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:29 smithi122 ceph-mon[125440]: pgmap v3715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:53:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:29 smithi136 ceph-mon[125702]: pgmap v3715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:53:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:31 smithi057 ceph-mon[92072]: pgmap v3716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:31 smithi122 ceph-mon[125440]: pgmap v3716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:31 smithi136 ceph-mon[125702]: pgmap v3716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:33 smithi057 ceph-mon[92072]: pgmap v3717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:33 smithi122 ceph-mon[125440]: pgmap v3717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:33 smithi136 ceph-mon[125702]: pgmap v3717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:35 smithi057 ceph-mon[92072]: pgmap v3718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:35 smithi122 ceph-mon[125440]: pgmap v3718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:35 smithi136 ceph-mon[125702]: pgmap v3718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:36 smithi136 ceph-mon[125702]: pgmap v3719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:36 smithi057 ceph-mon[92072]: pgmap v3719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:36 smithi122 ceph-mon[125440]: pgmap v3719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:39.278+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:53:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:39.278+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:53:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:39.278+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:53:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:39.278+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:53:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:39.278+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:53:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:39 smithi057 ceph-mon[92072]: pgmap v3720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:39 smithi122 ceph-mon[125440]: pgmap v3720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:39 smithi136 ceph-mon[125702]: pgmap v3720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:41 smithi057 ceph-mon[92072]: pgmap v3721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:41.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:41 smithi122 ceph-mon[125440]: pgmap v3721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:41 smithi136 ceph-mon[125702]: pgmap v3721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:43 smithi057 ceph-mon[92072]: pgmap v3722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:43 smithi122 ceph-mon[125440]: pgmap v3722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:43 smithi136 ceph-mon[125702]: pgmap v3722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:53:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:53:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:53:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:45 smithi122 ceph-mon[125440]: pgmap v3723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:45 smithi136 ceph-mon[125702]: pgmap v3723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:45 smithi057 ceph-mon[92072]: pgmap v3723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:53:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:53:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:46 smithi136 ceph-mon[125702]: pgmap v3724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:53:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:53:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:46 smithi057 ceph-mon[92072]: pgmap v3724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:53:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:53:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:53:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:46 smithi122 ceph-mon[125440]: pgmap v3724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:49 smithi057 ceph-mon[92072]: pgmap v3725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:49 smithi122 ceph-mon[125440]: pgmap v3725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:49 smithi136 ceph-mon[125702]: pgmap v3725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:51 smithi057 ceph-mon[92072]: pgmap v3726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:51 smithi122 ceph-mon[125440]: pgmap v3726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:51 smithi136 ceph-mon[125702]: pgmap v3726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:53:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:53 smithi122 ceph-mon[125440]: pgmap v3727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:53 smithi136 ceph-mon[125702]: pgmap v3727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:53 smithi057 ceph-mon[92072]: pgmap v3727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:53:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:54.292+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:53:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:54.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:53:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:54.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:53:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:54.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:53:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:53:54.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:53:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:54 smithi122 ceph-mon[125440]: pgmap v3728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:53:55.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:54 smithi136 ceph-mon[125702]: pgmap v3728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:53:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:54 smithi057 ceph-mon[92072]: pgmap v3728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:53:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:56 smithi136 ceph-mon[125702]: pgmap v3729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:53:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:56 smithi057 ceph-mon[92072]: pgmap v3729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:53:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:56 smithi122 ceph-mon[125440]: pgmap v3729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T12:53:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:53:59 smithi057 ceph-mon[92072]: pgmap v3730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:53:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:53:59 smithi122 ceph-mon[125440]: pgmap v3730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:54:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:53:59 smithi136 ceph-mon[125702]: pgmap v3730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T12:54:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:01 smithi122 ceph-mon[125440]: pgmap v3731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T12:54:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:01 smithi136 ceph-mon[125702]: pgmap v3731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T12:54:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:01 smithi057 ceph-mon[92072]: pgmap v3731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T12:54:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:02 smithi136 ceph-mon[125702]: pgmap v3732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:54:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:02 smithi057 ceph-mon[92072]: pgmap v3732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:54:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:02 smithi122 ceph-mon[125440]: pgmap v3732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:54:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:05 smithi057 ceph-mon[92072]: pgmap v3733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:54:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:05 smithi122 ceph-mon[125440]: pgmap v3733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:54:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:05 smithi136 ceph-mon[125702]: pgmap v3733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:54:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:06 smithi136 ceph-mon[125702]: pgmap v3734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:54:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:06 smithi057 ceph-mon[92072]: pgmap v3734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:54:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:06 smithi122 ceph-mon[125440]: pgmap v3734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:54:09.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:09.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:54:09.295 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:09.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:54:09.295 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:09.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:54:09.295 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:09.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:54:09.295 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:09.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:54:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:09 smithi057 ceph-mon[92072]: pgmap v3735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:54:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:09 smithi122 ceph-mon[125440]: pgmap v3735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:54:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:09 smithi136 ceph-mon[125702]: pgmap v3735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:54:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:11 smithi122 ceph-mon[125440]: pgmap v3736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:54:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:11 smithi122 ceph-mon[125440]: osdmap e307: 12 total, 12 up, 12 in 2023-03-02T12:54:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:11 smithi136 ceph-mon[125702]: pgmap v3736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:54:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:11 smithi136 ceph-mon[125702]: osdmap e307: 12 total, 12 up, 12 in 2023-03-02T12:54:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:11 smithi057 ceph-mon[92072]: pgmap v3736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:54:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:11 smithi057 ceph-mon[92072]: osdmap e307: 12 total, 12 up, 12 in 2023-03-02T12:54:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:13 smithi122 ceph-mon[125440]: pgmap v3738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:54:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:13 smithi136 ceph-mon[125702]: pgmap v3738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:54:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:13 smithi057 ceph-mon[92072]: pgmap v3738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:54:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:14 smithi122 ceph-mon[125440]: pgmap v3739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:54:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:14 smithi136 ceph-mon[125702]: pgmap v3739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:54:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:14 smithi057 ceph-mon[92072]: pgmap v3739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:54:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:16 smithi136 ceph-mon[125702]: osdmap e308: 12 total, 12 up, 12 in 2023-03-02T12:54:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:16 smithi136 ceph-mon[125702]: pgmap v3741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:54:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:16 smithi057 ceph-mon[92072]: osdmap e308: 12 total, 12 up, 12 in 2023-03-02T12:54:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:16 smithi057 ceph-mon[92072]: pgmap v3741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:54:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:16 smithi122 ceph-mon[125440]: osdmap e308: 12 total, 12 up, 12 in 2023-03-02T12:54:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:16 smithi122 ceph-mon[125440]: pgmap v3741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:54:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:19 smithi122 ceph-mon[125440]: pgmap v3742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:54:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:19 smithi136 ceph-mon[125702]: pgmap v3742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:54:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:19 smithi057 ceph-mon[92072]: pgmap v3742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:54:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:21 smithi122 ceph-mon[125440]: pgmap v3743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:54:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:21 smithi136 ceph-mon[125702]: pgmap v3743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:54:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:21 smithi057 ceph-mon[92072]: pgmap v3743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-02T12:54:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:22 smithi122 ceph-mon[125440]: pgmap v3744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:54:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:22 smithi136 ceph-mon[125702]: pgmap v3744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:54:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:22 smithi057 ceph-mon[92072]: pgmap v3744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:54:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:24.309+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:54:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:24.309+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:54:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:24.309+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:54:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:24.309+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:54:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:24.309+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:54:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:25 smithi122 ceph-mon[125440]: pgmap v3745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:54:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:25 smithi136 ceph-mon[125702]: pgmap v3745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:54:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:25 smithi057 ceph-mon[92072]: pgmap v3745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:54:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:26 smithi136 ceph-mon[125702]: pgmap v3746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:54:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:26 smithi057 ceph-mon[92072]: pgmap v3746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:54:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:26 smithi122 ceph-mon[125440]: pgmap v3746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:54:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:29 smithi122 ceph-mon[125440]: pgmap v3747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:54:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:29 smithi136 ceph-mon[125702]: pgmap v3747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:54:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:29 smithi057 ceph-mon[92072]: pgmap v3747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:54:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:31 smithi122 ceph-mon[125440]: pgmap v3748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:31 smithi136 ceph-mon[125702]: pgmap v3748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:31 smithi057 ceph-mon[92072]: pgmap v3748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:32 smithi136 ceph-mon[125702]: pgmap v3749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:32 smithi057 ceph-mon[92072]: pgmap v3749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:32 smithi122 ceph-mon[125440]: pgmap v3749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:35 smithi122 ceph-mon[125440]: pgmap v3750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:35 smithi136 ceph-mon[125702]: pgmap v3750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:35 smithi057 ceph-mon[92072]: pgmap v3750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:36 smithi136 ceph-mon[125702]: pgmap v3751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:36 smithi057 ceph-mon[92072]: pgmap v3751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:36 smithi122 ceph-mon[125440]: pgmap v3751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:39.325+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:54:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:39.325+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:54:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:39.325+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:54:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:39.325+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:54:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:39.325+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:54:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:39.345+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:54:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:39.345+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:54:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:39.346+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 57 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:54:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:39.346+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 58 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:54:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:39 smithi122 ceph-mon[125440]: pgmap v3752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:39 smithi136 ceph-mon[125702]: pgmap v3752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:39 smithi057 ceph-mon[92072]: pgmap v3752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:40 smithi136 ceph-mon[125702]: pgmap v3753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:40 smithi057 ceph-mon[92072]: pgmap v3753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:40 smithi122 ceph-mon[125440]: pgmap v3753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:43 smithi122 ceph-mon[125440]: pgmap v3754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:43 smithi136 ceph-mon[125702]: pgmap v3754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:43 smithi057 ceph-mon[92072]: pgmap v3754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:44 smithi136 ceph-mon[125702]: pgmap v3755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:44 smithi057 ceph-mon[92072]: pgmap v3755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:44 smithi122 ceph-mon[125440]: pgmap v3755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:54:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:46 smithi136 ceph-mon[125702]: pgmap v3756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:54:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:54:47.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:54:47.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:54:47.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:46 smithi057 ceph-mon[92072]: pgmap v3756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:47.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:54:47.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:54:47.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:54:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:54:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:46 smithi122 ceph-mon[125440]: pgmap v3756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:54:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:54:47.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:54:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:49 smithi122 ceph-mon[125440]: pgmap v3757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:50.099 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:49 smithi136 ceph-mon[125702]: pgmap v3757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:49 smithi057 ceph-mon[92072]: pgmap v3757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:50 smithi122 ceph-mon[125440]: pgmap v3758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:50 smithi136 ceph-mon[125702]: pgmap v3758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:50 smithi057 ceph-mon[92072]: pgmap v3758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:53 smithi122 ceph-mon[125440]: pgmap v3759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:53 smithi136 ceph-mon[125702]: pgmap v3759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:53 smithi057 ceph-mon[92072]: pgmap v3759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:54.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:54:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:54.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:54:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:54.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:54:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:54.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:54:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:54:54.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:54:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:54 smithi136 ceph-mon[125702]: pgmap v3760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:54 smithi057 ceph-mon[92072]: pgmap v3760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:54 smithi122 ceph-mon[125440]: pgmap v3760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:56 smithi136 ceph-mon[125702]: pgmap v3761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:56 smithi057 ceph-mon[92072]: pgmap v3761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:56 smithi122 ceph-mon[125440]: pgmap v3761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:54:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:54:58 smithi136 ceph-mon[125702]: pgmap v3762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:54:58 smithi057 ceph-mon[92072]: pgmap v3762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:54:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:54:58 smithi122 ceph-mon[125440]: pgmap v3762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:00 smithi136 ceph-mon[125702]: pgmap v3763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:00 smithi057 ceph-mon[92072]: pgmap v3763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:00 smithi122 ceph-mon[125440]: pgmap v3763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:02 smithi136 ceph-mon[125702]: pgmap v3764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:55:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:02 smithi057 ceph-mon[92072]: pgmap v3764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:55:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:02 smithi122 ceph-mon[125440]: pgmap v3764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:55:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:04 smithi136 ceph-mon[125702]: pgmap v3765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:55:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:04 smithi057 ceph-mon[92072]: pgmap v3765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:55:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:04 smithi122 ceph-mon[125440]: pgmap v3765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:55:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:06 smithi136 ceph-mon[125702]: pgmap v3766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:55:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:06 smithi057 ceph-mon[92072]: pgmap v3766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:55:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:06 smithi122 ceph-mon[125440]: pgmap v3766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:55:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:08 smithi136 ceph-mon[125702]: pgmap v3767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:55:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:08 smithi057 ceph-mon[92072]: pgmap v3767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:55:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:08 smithi122 ceph-mon[125440]: pgmap v3767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:55:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:09.343+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:55:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:09.343+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:55:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:09.344+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:55:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:09.344+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:55:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:09.344+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:55:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:11 smithi136 ceph-mon[125702]: osdmap e309: 12 total, 12 up, 12 in 2023-03-02T12:55:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:11 smithi136 ceph-mon[125702]: pgmap v3769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:55:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:11 smithi057 ceph-mon[92072]: osdmap e309: 12 total, 12 up, 12 in 2023-03-02T12:55:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:11 smithi057 ceph-mon[92072]: pgmap v3769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:55:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:11 smithi122 ceph-mon[125440]: osdmap e309: 12 total, 12 up, 12 in 2023-03-02T12:55:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:11 smithi122 ceph-mon[125440]: pgmap v3769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:55:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:12 smithi136 ceph-mon[125702]: pgmap v3770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:55:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:12 smithi057 ceph-mon[92072]: pgmap v3770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:55:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:12 smithi122 ceph-mon[125440]: pgmap v3770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:55:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:14 smithi136 ceph-mon[125702]: pgmap v3771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:55:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:14 smithi057 ceph-mon[92072]: pgmap v3771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:55:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:14 smithi122 ceph-mon[125440]: pgmap v3771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:55:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:16 smithi136 ceph-mon[125702]: osdmap e310: 12 total, 12 up, 12 in 2023-03-02T12:55:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:16 smithi136 ceph-mon[125702]: pgmap v3773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:55:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:16 smithi057 ceph-mon[92072]: osdmap e310: 12 total, 12 up, 12 in 2023-03-02T12:55:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:16 smithi057 ceph-mon[92072]: pgmap v3773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:55:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:16 smithi122 ceph-mon[125440]: osdmap e310: 12 total, 12 up, 12 in 2023-03-02T12:55:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:16 smithi122 ceph-mon[125440]: pgmap v3773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:55:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:18 smithi136 ceph-mon[125702]: pgmap v3774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T12:55:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:18 smithi057 ceph-mon[92072]: pgmap v3774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T12:55:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:18 smithi122 ceph-mon[125440]: pgmap v3774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T12:55:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:20 smithi136 ceph-mon[125702]: pgmap v3775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:55:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:20 smithi057 ceph-mon[92072]: pgmap v3775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:55:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:20 smithi122 ceph-mon[125440]: pgmap v3775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:55:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:22 smithi136 ceph-mon[125702]: pgmap v3776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:55:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:22 smithi057 ceph-mon[92072]: pgmap v3776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:55:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:22 smithi122 ceph-mon[125440]: pgmap v3776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:55:24.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:24.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:55:24.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:24.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:55:24.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:24.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:55:24.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:24.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:55:24.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:24.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:55:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:24 smithi136 ceph-mon[125702]: pgmap v3777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:55:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:24 smithi057 ceph-mon[92072]: pgmap v3777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:55:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:24 smithi122 ceph-mon[125440]: pgmap v3777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:55:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:26 smithi136 ceph-mon[125702]: pgmap v3778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:55:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:26 smithi057 ceph-mon[92072]: pgmap v3778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:55:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:26 smithi122 ceph-mon[125440]: pgmap v3778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:55:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:28 smithi136 ceph-mon[125702]: pgmap v3779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:55:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:28 smithi057 ceph-mon[92072]: pgmap v3779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:55:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:28 smithi122 ceph-mon[125440]: pgmap v3779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:55:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:30 smithi136 ceph-mon[125702]: pgmap v3780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:30 smithi057 ceph-mon[92072]: pgmap v3780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:30 smithi122 ceph-mon[125440]: pgmap v3780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:32 smithi136 ceph-mon[125702]: pgmap v3781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:32 smithi057 ceph-mon[92072]: pgmap v3781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:32 smithi122 ceph-mon[125440]: pgmap v3781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:34 smithi136 ceph-mon[125702]: pgmap v3782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:34 smithi057 ceph-mon[92072]: pgmap v3782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:34 smithi122 ceph-mon[125440]: pgmap v3782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:36 smithi136 ceph-mon[125702]: pgmap v3783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:36 smithi057 ceph-mon[92072]: pgmap v3783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:36 smithi122 ceph-mon[125440]: pgmap v3783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:38 smithi136 ceph-mon[125702]: pgmap v3784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:38 smithi057 ceph-mon[92072]: pgmap v3784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:38 smithi122 ceph-mon[125440]: pgmap v3784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:39.374+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:55:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:39.375+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:55:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:39.375+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:55:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:39.375+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:55:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:39.375+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:55:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:40 smithi136 ceph-mon[125702]: pgmap v3785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:40 smithi057 ceph-mon[92072]: pgmap v3785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:40 smithi122 ceph-mon[125440]: pgmap v3785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:42 smithi136 ceph-mon[125702]: pgmap v3786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:42 smithi057 ceph-mon[92072]: pgmap v3786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:42 smithi122 ceph-mon[125440]: pgmap v3786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:44 smithi136 ceph-mon[125702]: pgmap v3787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:44 smithi057 ceph-mon[92072]: pgmap v3787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:44 smithi122 ceph-mon[125440]: pgmap v3787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:46 smithi136 ceph-mon[125702]: pgmap v3788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:46 smithi057 ceph-mon[92072]: pgmap v3788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:46 smithi122 ceph-mon[125440]: pgmap v3788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:55:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:55:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:55:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:55:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:55:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:55:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:55:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:55:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:55:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:55:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:55:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:55:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:48 smithi136 ceph-mon[125702]: pgmap v3789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:48 smithi057 ceph-mon[92072]: pgmap v3789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:48 smithi122 ceph-mon[125440]: pgmap v3789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:50 smithi136 ceph-mon[125702]: pgmap v3790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:50 smithi057 ceph-mon[92072]: pgmap v3790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:50 smithi122 ceph-mon[125440]: pgmap v3790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:52 smithi136 ceph-mon[125702]: pgmap v3791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:52 smithi057 ceph-mon[92072]: pgmap v3791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:52 smithi122 ceph-mon[125440]: pgmap v3791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:54.390+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:55:54.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:54.391+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:55:54.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:54.391+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:55:54.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:54.391+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:55:54.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:55:54.391+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:55:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:54 smithi136 ceph-mon[125702]: pgmap v3792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:54 smithi057 ceph-mon[92072]: pgmap v3792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:54 smithi122 ceph-mon[125440]: pgmap v3792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:56 smithi136 ceph-mon[125702]: pgmap v3793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:56 smithi057 ceph-mon[92072]: pgmap v3793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:56 smithi122 ceph-mon[125440]: pgmap v3793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:55:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:55:58 smithi136 ceph-mon[125702]: pgmap v3794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:55:58 smithi057 ceph-mon[92072]: pgmap v3794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:55:59.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:55:58 smithi122 ceph-mon[125440]: pgmap v3794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:00 smithi136 ceph-mon[125702]: pgmap v3795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:00 smithi057 ceph-mon[92072]: pgmap v3795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:00 smithi122 ceph-mon[125440]: pgmap v3795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:03.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:02 smithi136 ceph-mon[125702]: pgmap v3796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:56:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:02 smithi057 ceph-mon[92072]: pgmap v3796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:56:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:02 smithi122 ceph-mon[125440]: pgmap v3796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:56:05.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:04 smithi136 ceph-mon[125702]: pgmap v3797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:56:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:04 smithi057 ceph-mon[92072]: pgmap v3797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:56:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:04 smithi122 ceph-mon[125440]: pgmap v3797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:56:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:06 smithi136 ceph-mon[125702]: pgmap v3798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:56:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:06 smithi057 ceph-mon[92072]: pgmap v3798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:56:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:06 smithi122 ceph-mon[125440]: pgmap v3798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:56:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:08 smithi136 ceph-mon[125702]: pgmap v3799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:56:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:08 smithi057 ceph-mon[92072]: pgmap v3799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:56:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:08 smithi122 ceph-mon[125440]: pgmap v3799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:56:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:09.359+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:56:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:09.359+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:56:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:09.359+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 59 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:56:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:09.359+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 58 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:56:09.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:09.407+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:56:09.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:09.407+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:56:09.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:09.407+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:56:09.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:09.407+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:56:09.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:09.407+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:56:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:11 smithi136 ceph-mon[125702]: osdmap e311: 12 total, 12 up, 12 in 2023-03-02T12:56:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:11 smithi136 ceph-mon[125702]: pgmap v3801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:56:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:11 smithi057 ceph-mon[92072]: osdmap e311: 12 total, 12 up, 12 in 2023-03-02T12:56:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:11 smithi057 ceph-mon[92072]: pgmap v3801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:56:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:11 smithi122 ceph-mon[125440]: osdmap e311: 12 total, 12 up, 12 in 2023-03-02T12:56:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:11 smithi122 ceph-mon[125440]: pgmap v3801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:56:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:12 smithi136 ceph-mon[125702]: pgmap v3802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:56:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:12 smithi057 ceph-mon[92072]: pgmap v3802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:56:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:12 smithi122 ceph-mon[125440]: pgmap v3802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:56:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:14 smithi136 ceph-mon[125702]: pgmap v3803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:56:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:14 smithi057 ceph-mon[92072]: pgmap v3803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:56:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:14 smithi122 ceph-mon[125440]: pgmap v3803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:56:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:16 smithi136 ceph-mon[125702]: osdmap e312: 12 total, 12 up, 12 in 2023-03-02T12:56:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:16 smithi136 ceph-mon[125702]: pgmap v3805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:56:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:16 smithi057 ceph-mon[92072]: osdmap e312: 12 total, 12 up, 12 in 2023-03-02T12:56:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:16 smithi057 ceph-mon[92072]: pgmap v3805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:56:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:16 smithi122 ceph-mon[125440]: osdmap e312: 12 total, 12 up, 12 in 2023-03-02T12:56:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:16 smithi122 ceph-mon[125440]: pgmap v3805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T12:56:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:18 smithi136 ceph-mon[125702]: pgmap v3806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T12:56:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:18 smithi057 ceph-mon[92072]: pgmap v3806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T12:56:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:18 smithi122 ceph-mon[125440]: pgmap v3806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T12:56:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:20 smithi136 ceph-mon[125702]: pgmap v3807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:56:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:20 smithi057 ceph-mon[92072]: pgmap v3807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:56:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:20 smithi122 ceph-mon[125440]: pgmap v3807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:56:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:22 smithi136 ceph-mon[125702]: pgmap v3808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:56:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:22 smithi057 ceph-mon[92072]: pgmap v3808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:56:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:22 smithi122 ceph-mon[125440]: pgmap v3808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:56:24.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:24.421+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:56:24.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:24.421+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:56:24.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:24.421+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:56:24.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:24.421+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:56:24.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:24.421+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:56:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:24 smithi136 ceph-mon[125702]: pgmap v3809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:56:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:24 smithi057 ceph-mon[92072]: pgmap v3809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:56:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:24 smithi122 ceph-mon[125440]: pgmap v3809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:56:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:26 smithi136 ceph-mon[125702]: pgmap v3810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:56:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:26 smithi057 ceph-mon[92072]: pgmap v3810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:56:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:26 smithi122 ceph-mon[125440]: pgmap v3810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-02T12:56:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:28 smithi136 ceph-mon[125702]: pgmap v3811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:56:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:28 smithi057 ceph-mon[92072]: pgmap v3811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:56:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:28 smithi122 ceph-mon[125440]: pgmap v3811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T12:56:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:30 smithi136 ceph-mon[125702]: pgmap v3812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:30 smithi057 ceph-mon[92072]: pgmap v3812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:30 smithi122 ceph-mon[125440]: pgmap v3812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:32 smithi136 ceph-mon[125702]: pgmap v3813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:32 smithi057 ceph-mon[92072]: pgmap v3813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:32 smithi122 ceph-mon[125440]: pgmap v3813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:34 smithi136 ceph-mon[125702]: pgmap v3814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:34 smithi057 ceph-mon[92072]: pgmap v3814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:34 smithi122 ceph-mon[125440]: pgmap v3814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:36 smithi136 ceph-mon[125702]: pgmap v3815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:36 smithi057 ceph-mon[92072]: pgmap v3815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:36 smithi122 ceph-mon[125440]: pgmap v3815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:38 smithi136 ceph-mon[125702]: pgmap v3816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:38 smithi057 ceph-mon[92072]: pgmap v3816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:38 smithi122 ceph-mon[125440]: pgmap v3816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:39.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:39.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:56:39.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:39.435+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:56:39.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:39.435+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:56:39.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:39.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:56:39.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:39.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:56:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:40 smithi136 ceph-mon[125702]: pgmap v3817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:40 smithi057 ceph-mon[92072]: pgmap v3817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:40 smithi122 ceph-mon[125440]: pgmap v3817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:42 smithi136 ceph-mon[125702]: pgmap v3818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:42 smithi057 ceph-mon[92072]: pgmap v3818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:42 smithi122 ceph-mon[125440]: pgmap v3818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:44 smithi136 ceph-mon[125702]: pgmap v3819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:44 smithi057 ceph-mon[92072]: pgmap v3819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:44 smithi122 ceph-mon[125440]: pgmap v3819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:46 smithi136 ceph-mon[125702]: pgmap v3820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:46 smithi057 ceph-mon[92072]: pgmap v3820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:46 smithi122 ceph-mon[125440]: pgmap v3820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:56:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:56:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:56:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:48 smithi136 ceph-mon[125702]: pgmap v3821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:48 smithi057 ceph-mon[92072]: pgmap v3821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:48 smithi122 ceph-mon[125440]: pgmap v3821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:50 smithi136 ceph-mon[125702]: pgmap v3822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:51.108 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:50 smithi057 ceph-mon[92072]: pgmap v3822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:50 smithi122 ceph-mon[125440]: pgmap v3822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:56:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:56:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:56:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:56:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:56:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:56:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:56:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:56:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:56:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:56:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:56:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:56:52.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:56:52.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:56:52.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:56:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:53 smithi057 ceph-mon[92072]: pgmap v3823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:53 smithi122 ceph-mon[125440]: pgmap v3823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:53 smithi136 ceph-mon[125702]: pgmap v3823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:54.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:56:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:54.451+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:56:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:54.451+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:56:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:54.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:56:54.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:56:54.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:56:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:54 smithi136 ceph-mon[125702]: pgmap v3824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:54 smithi057 ceph-mon[92072]: pgmap v3824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:55.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:54 smithi122 ceph-mon[125440]: pgmap v3824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:57.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:56 smithi136 ceph-mon[125702]: pgmap v3825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:56 smithi057 ceph-mon[92072]: pgmap v3825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:56 smithi122 ceph-mon[125440]: pgmap v3825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:56:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:56:58 smithi136 ceph-mon[125702]: pgmap v3826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:56:58 smithi057 ceph-mon[92072]: pgmap v3826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:56:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:56:58 smithi122 ceph-mon[125440]: pgmap v3826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:57:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:00 smithi136 ceph-mon[125702]: pgmap v3827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:00 smithi057 ceph-mon[92072]: pgmap v3827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:00 smithi122 ceph-mon[125440]: pgmap v3827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:02 smithi136 ceph-mon[125702]: pgmap v3828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:57:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:02 smithi057 ceph-mon[92072]: pgmap v3828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:57:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:02 smithi122 ceph-mon[125440]: pgmap v3828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:57:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:04 smithi136 ceph-mon[125702]: pgmap v3829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:57:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:04 smithi057 ceph-mon[92072]: pgmap v3829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:57:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:04 smithi122 ceph-mon[125440]: pgmap v3829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:57:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:06 smithi136 ceph-mon[125702]: pgmap v3830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:57:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:06 smithi057 ceph-mon[92072]: pgmap v3830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:57:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:06 smithi122 ceph-mon[125440]: pgmap v3830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:57:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:08 smithi136 ceph-mon[125702]: pgmap v3831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:57:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:08 smithi057 ceph-mon[92072]: pgmap v3831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:57:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:08 smithi122 ceph-mon[125440]: pgmap v3831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:57:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:09.458+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:57:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:09.458+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:57:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:09.458+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:57:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:09.458+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:57:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:09.458+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:57:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:11 smithi136 ceph-mon[125702]: osdmap e313: 12 total, 12 up, 12 in 2023-03-02T12:57:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:11 smithi136 ceph-mon[125702]: pgmap v3833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:57:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:11 smithi057 ceph-mon[92072]: osdmap e313: 12 total, 12 up, 12 in 2023-03-02T12:57:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:11 smithi057 ceph-mon[92072]: pgmap v3833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:57:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:11 smithi122 ceph-mon[125440]: osdmap e313: 12 total, 12 up, 12 in 2023-03-02T12:57:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:11 smithi122 ceph-mon[125440]: pgmap v3833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:57:13.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:12 smithi136 ceph-mon[125702]: pgmap v3834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:57:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:12 smithi057 ceph-mon[92072]: pgmap v3834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:57:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:12 smithi122 ceph-mon[125440]: pgmap v3834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:57:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:14 smithi136 ceph-mon[125702]: pgmap v3835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:57:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:14 smithi057 ceph-mon[92072]: pgmap v3835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:57:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:14 smithi122 ceph-mon[125440]: pgmap v3835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:57:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:16 smithi136 ceph-mon[125702]: osdmap e314: 12 total, 12 up, 12 in 2023-03-02T12:57:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:16 smithi136 ceph-mon[125702]: pgmap v3837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:57:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:16 smithi057 ceph-mon[92072]: osdmap e314: 12 total, 12 up, 12 in 2023-03-02T12:57:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:16 smithi057 ceph-mon[92072]: pgmap v3837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:57:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:16 smithi122 ceph-mon[125440]: osdmap e314: 12 total, 12 up, 12 in 2023-03-02T12:57:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:16 smithi122 ceph-mon[125440]: pgmap v3837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:57:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:18 smithi136 ceph-mon[125702]: pgmap v3838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T12:57:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:18 smithi057 ceph-mon[92072]: pgmap v3838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T12:57:19.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:18 smithi122 ceph-mon[125440]: pgmap v3838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T12:57:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:20 smithi136 ceph-mon[125702]: pgmap v3839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:57:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:20 smithi057 ceph-mon[92072]: pgmap v3839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:57:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:20 smithi122 ceph-mon[125440]: pgmap v3839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:57:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:22 smithi136 ceph-mon[125702]: pgmap v3840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:57:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:22 smithi057 ceph-mon[92072]: pgmap v3840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:57:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:22 smithi122 ceph-mon[125440]: pgmap v3840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:57:24.467 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:24.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:57:24.467 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:24.465+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:57:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:24.465+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:57:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:24.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:57:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:24.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:57:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:24 smithi136 ceph-mon[125702]: pgmap v3841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:57:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:24 smithi057 ceph-mon[92072]: pgmap v3841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:57:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:24 smithi122 ceph-mon[125440]: pgmap v3841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:57:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:26 smithi136 ceph-mon[125702]: pgmap v3842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T12:57:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:26 smithi057 ceph-mon[92072]: pgmap v3842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T12:57:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:26 smithi122 ceph-mon[125440]: pgmap v3842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T12:57:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:28 smithi136 ceph-mon[125702]: pgmap v3843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:57:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:28 smithi057 ceph-mon[92072]: pgmap v3843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:57:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:28 smithi122 ceph-mon[125440]: pgmap v3843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:57:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:30 smithi136 ceph-mon[125702]: pgmap v3844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:30 smithi057 ceph-mon[92072]: pgmap v3844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:30 smithi122 ceph-mon[125440]: pgmap v3844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:32 smithi136 ceph-mon[125702]: pgmap v3845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:57:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:32 smithi057 ceph-mon[92072]: pgmap v3845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:57:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:32 smithi122 ceph-mon[125440]: pgmap v3845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:57:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:34 smithi136 ceph-mon[125702]: pgmap v3846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:34 smithi057 ceph-mon[92072]: pgmap v3846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:34 smithi122 ceph-mon[125440]: pgmap v3846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:36 smithi136 ceph-mon[125702]: pgmap v3847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:57:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:36 smithi057 ceph-mon[92072]: pgmap v3847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:57:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:36 smithi122 ceph-mon[125440]: pgmap v3847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:57:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:38 smithi136 ceph-mon[125702]: pgmap v3848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:57:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:38 smithi057 ceph-mon[92072]: pgmap v3848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:57:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:38 smithi122 ceph-mon[125440]: pgmap v3848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:57:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:39.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:57:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:39.482+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:57:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:39.482+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:57:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:39.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:57:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:39.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:57:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:40 smithi136 ceph-mon[125702]: pgmap v3849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:40 smithi057 ceph-mon[92072]: pgmap v3849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:40 smithi122 ceph-mon[125440]: pgmap v3849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:42 smithi136 ceph-mon[125702]: pgmap v3850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:57:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:42 smithi057 ceph-mon[92072]: pgmap v3850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:57:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:42 smithi122 ceph-mon[125440]: pgmap v3850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:57:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:44 smithi136 ceph-mon[125702]: pgmap v3851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:44 smithi057 ceph-mon[92072]: pgmap v3851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:44 smithi122 ceph-mon[125440]: pgmap v3851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:46 smithi136 ceph-mon[125702]: pgmap v3852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:57:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:46 smithi057 ceph-mon[92072]: pgmap v3852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:57:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:46 smithi122 ceph-mon[125440]: pgmap v3852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:57:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:48 smithi136 ceph-mon[125702]: pgmap v3853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:57:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:48 smithi057 ceph-mon[92072]: pgmap v3853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:57:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:48 smithi122 ceph-mon[125440]: pgmap v3853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:57:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:50 smithi136 ceph-mon[125702]: pgmap v3854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:50 smithi057 ceph-mon[92072]: pgmap v3854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:50 smithi122 ceph-mon[125440]: pgmap v3854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:57:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:57:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:57:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:52 smithi136 ceph-mon[125702]: pgmap v3855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:57:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:52 smithi057 ceph-mon[92072]: pgmap v3855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:57:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:52 smithi122 ceph-mon[125440]: pgmap v3855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:57:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:54.488+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:57:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:54.488+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:57:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:54.488+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:57:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:54.488+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:57:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:57:54.489+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:57:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:54 smithi136 ceph-mon[125702]: pgmap v3856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:54 smithi057 ceph-mon[92072]: pgmap v3856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:54 smithi122 ceph-mon[125440]: pgmap v3856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:57:56.829 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:56 smithi122 ceph-mon[125440]: pgmap v3857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:57:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:56 smithi136 ceph-mon[125702]: pgmap v3857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:57:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:56 smithi057 ceph-mon[92072]: pgmap v3857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:57:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:57:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:57:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:57:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:57:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:59.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:57:59.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:57:59.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:57:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:57:59 smithi057 ceph-mon[92072]: pgmap v3858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:57:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:57:59 smithi122 ceph-mon[125440]: pgmap v3858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:57:59 smithi136 ceph-mon[125702]: pgmap v3858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:00 smithi136 ceph-mon[125702]: pgmap v3859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:00 smithi057 ceph-mon[92072]: pgmap v3859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:00 smithi122 ceph-mon[125440]: pgmap v3859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:02 smithi136 ceph-mon[125702]: pgmap v3860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:58:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:02 smithi057 ceph-mon[92072]: pgmap v3860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:58:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:02 smithi122 ceph-mon[125440]: pgmap v3860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:58:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:04 smithi136 ceph-mon[125702]: pgmap v3861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:58:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:04 smithi057 ceph-mon[92072]: pgmap v3861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:58:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:04 smithi122 ceph-mon[125440]: pgmap v3861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:58:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:06 smithi136 ceph-mon[125702]: pgmap v3862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:58:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:06 smithi057 ceph-mon[92072]: pgmap v3862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:58:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:06 smithi122 ceph-mon[125440]: pgmap v3862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:58:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:08 smithi136 ceph-mon[125702]: pgmap v3863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:58:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:08 smithi057 ceph-mon[92072]: pgmap v3863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:58:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:08 smithi122 ceph-mon[125440]: pgmap v3863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:58:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:09.501+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:58:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:09.501+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:58:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:09.501+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:58:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:09.501+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:58:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:09.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:58:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:11 smithi136 ceph-mon[125702]: osdmap e315: 12 total, 12 up, 12 in 2023-03-02T12:58:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:11 smithi136 ceph-mon[125702]: pgmap v3865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:58:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:11 smithi057 ceph-mon[92072]: osdmap e315: 12 total, 12 up, 12 in 2023-03-02T12:58:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:11 smithi057 ceph-mon[92072]: pgmap v3865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:58:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:11 smithi122 ceph-mon[125440]: osdmap e315: 12 total, 12 up, 12 in 2023-03-02T12:58:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:11 smithi122 ceph-mon[125440]: pgmap v3865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:58:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:12 smithi136 ceph-mon[125702]: pgmap v3866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:58:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:12 smithi057 ceph-mon[92072]: pgmap v3866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:58:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:12 smithi122 ceph-mon[125440]: pgmap v3866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:58:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:14 smithi136 ceph-mon[125702]: pgmap v3867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:58:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:14 smithi057 ceph-mon[92072]: pgmap v3867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:58:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:14 smithi122 ceph-mon[125440]: pgmap v3867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:58:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:16 smithi136 ceph-mon[125702]: osdmap e316: 12 total, 12 up, 12 in 2023-03-02T12:58:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:16 smithi136 ceph-mon[125702]: pgmap v3869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:58:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:16 smithi057 ceph-mon[92072]: osdmap e316: 12 total, 12 up, 12 in 2023-03-02T12:58:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:16 smithi057 ceph-mon[92072]: pgmap v3869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:58:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:16 smithi122 ceph-mon[125440]: osdmap e316: 12 total, 12 up, 12 in 2023-03-02T12:58:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:16 smithi122 ceph-mon[125440]: pgmap v3869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:58:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:18 smithi136 ceph-mon[125702]: pgmap v3870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T12:58:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:18 smithi057 ceph-mon[92072]: pgmap v3870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T12:58:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:18 smithi122 ceph-mon[125440]: pgmap v3870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T12:58:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:20 smithi136 ceph-mon[125702]: pgmap v3871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:58:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:20 smithi057 ceph-mon[92072]: pgmap v3871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:58:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:20 smithi122 ceph-mon[125440]: pgmap v3871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:58:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:22 smithi136 ceph-mon[125702]: pgmap v3872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:58:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:22 smithi057 ceph-mon[92072]: pgmap v3872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:58:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:22 smithi122 ceph-mon[125440]: pgmap v3872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:58:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:24.516+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:58:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:24.516+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:58:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:24.516+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:58:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:24.516+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:58:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:24.516+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:58:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:24 smithi136 ceph-mon[125702]: pgmap v3873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:58:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:24 smithi057 ceph-mon[92072]: pgmap v3873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:58:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:24 smithi122 ceph-mon[125440]: pgmap v3873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:58:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:26 smithi136 ceph-mon[125702]: pgmap v3874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T12:58:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:26 smithi057 ceph-mon[92072]: pgmap v3874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T12:58:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:26 smithi122 ceph-mon[125440]: pgmap v3874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T12:58:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:28 smithi136 ceph-mon[125702]: pgmap v3875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:28 smithi057 ceph-mon[92072]: pgmap v3875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:28 smithi122 ceph-mon[125440]: pgmap v3875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:30 smithi136 ceph-mon[125702]: pgmap v3876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:30 smithi057 ceph-mon[92072]: pgmap v3876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:30 smithi122 ceph-mon[125440]: pgmap v3876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:32 smithi136 ceph-mon[125702]: pgmap v3877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:58:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:32 smithi057 ceph-mon[92072]: pgmap v3877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:58:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:32 smithi122 ceph-mon[125440]: pgmap v3877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:58:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:34 smithi136 ceph-mon[125702]: pgmap v3878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:34 smithi057 ceph-mon[92072]: pgmap v3878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:34 smithi122 ceph-mon[125440]: pgmap v3878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:36 smithi136 ceph-mon[125702]: pgmap v3879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:58:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:36 smithi057 ceph-mon[92072]: pgmap v3879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:58:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:36 smithi122 ceph-mon[125440]: pgmap v3879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:58:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:38 smithi136 ceph-mon[125702]: pgmap v3880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:39.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:38 smithi057 ceph-mon[92072]: pgmap v3880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:38 smithi122 ceph-mon[125440]: pgmap v3880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:39.525+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:58:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:39.525+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:58:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:39.525+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:58:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:39.525+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:58:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:39.525+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:58:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:40 smithi136 ceph-mon[125702]: pgmap v3881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:40 smithi057 ceph-mon[92072]: pgmap v3881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:40 smithi122 ceph-mon[125440]: pgmap v3881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:42 smithi136 ceph-mon[125702]: pgmap v3882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:58:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:42 smithi057 ceph-mon[92072]: pgmap v3882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:58:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:42 smithi122 ceph-mon[125440]: pgmap v3882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:58:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:44 smithi136 ceph-mon[125702]: pgmap v3883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:44 smithi057 ceph-mon[92072]: pgmap v3883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:44 smithi122 ceph-mon[125440]: pgmap v3883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:46 smithi136 ceph-mon[125702]: pgmap v3884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:58:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:46 smithi057 ceph-mon[92072]: pgmap v3884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:58:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:46 smithi122 ceph-mon[125440]: pgmap v3884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:58:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:48 smithi136 ceph-mon[125702]: pgmap v3885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:48 smithi057 ceph-mon[92072]: pgmap v3885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:48 smithi122 ceph-mon[125440]: pgmap v3885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:50 smithi136 ceph-mon[125702]: pgmap v3886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:50 smithi057 ceph-mon[92072]: pgmap v3886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:50 smithi122 ceph-mon[125440]: pgmap v3886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:52 smithi136 ceph-mon[125702]: pgmap v3887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:58:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:52 smithi057 ceph-mon[92072]: pgmap v3887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:58:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:52 smithi122 ceph-mon[125440]: pgmap v3887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:58:54.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:54.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:58:54.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:54.542+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:58:54.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:54.542+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:58:54.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:54.542+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:58:54.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:58:54.542+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:58:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:54 smithi136 ceph-mon[125702]: pgmap v3888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:54 smithi057 ceph-mon[92072]: pgmap v3888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:54 smithi122 ceph-mon[125440]: pgmap v3888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:58:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:56 smithi136 ceph-mon[125702]: pgmap v3889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:58:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:56 smithi057 ceph-mon[92072]: pgmap v3889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:58:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:56 smithi122 ceph-mon[125440]: pgmap v3889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:58:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:58:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:58:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T12:58:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:59 smithi057 ceph-mon[92072]: pgmap v3890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:58:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:58:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:58:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:58:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:59 smithi122 ceph-mon[125440]: pgmap v3890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:58:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:58:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:58:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:58:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:59 smithi136 ceph-mon[125702]: pgmap v3890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:58:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T12:58:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T12:58:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:58:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T12:59:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:00 smithi136 ceph-mon[125702]: pgmap v3891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:00 smithi057 ceph-mon[92072]: pgmap v3891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:00 smithi122 ceph-mon[125440]: pgmap v3891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:02 smithi136 ceph-mon[125702]: pgmap v3892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:59:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:02 smithi057 ceph-mon[92072]: pgmap v3892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:59:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:02 smithi122 ceph-mon[125440]: pgmap v3892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T12:59:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:04 smithi136 ceph-mon[125702]: pgmap v3893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:59:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:04 smithi057 ceph-mon[92072]: pgmap v3893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:59:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:04 smithi122 ceph-mon[125440]: pgmap v3893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T12:59:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:06 smithi136 ceph-mon[125702]: pgmap v3894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:59:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:06 smithi057 ceph-mon[92072]: pgmap v3894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:59:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:06 smithi122 ceph-mon[125440]: pgmap v3894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T12:59:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:08.384+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f586809c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T12:59:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:08.384+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f586809c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T12:59:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:08.384+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f586809c360 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5870097040 tx=0x7f58700ac000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:59:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:08.384+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f586809c360 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5870097040 tx=0x7f58700ac000 comp rx=0 tx=0).stop 2023-03-02T12:59:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:08.384+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f586809c360 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T12:59:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:08.384+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 msgr2=0x7f586809c360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T12:59:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:08.384+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f58680a5480 0x7f586809c360 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T12:59:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:08.384+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T12:59:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:08.384+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:59:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:08.384+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f58500067d0 tx=0x7f5870082000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T12:59:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:08 smithi136 ceph-mon[125702]: pgmap v3895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:59:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:08 smithi057 ceph-mon[92072]: pgmap v3895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:59:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:08 smithi122 ceph-mon[125440]: pgmap v3895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T12:59:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:09.385+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:59:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:09.385+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:59:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:09.385+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 60 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T12:59:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:09.385+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 59 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T12:59:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:09.557+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:59:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:09.558+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:59:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:09.558+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:59:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:09.558+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:59:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:09.558+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:59:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:11 smithi136 ceph-mon[125702]: osdmap e317: 12 total, 12 up, 12 in 2023-03-02T12:59:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:11 smithi136 ceph-mon[125702]: pgmap v3897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:59:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:11 smithi057 ceph-mon[92072]: osdmap e317: 12 total, 12 up, 12 in 2023-03-02T12:59:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:11 smithi057 ceph-mon[92072]: pgmap v3897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:59:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:11 smithi122 ceph-mon[125440]: osdmap e317: 12 total, 12 up, 12 in 2023-03-02T12:59:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:11 smithi122 ceph-mon[125440]: pgmap v3897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T12:59:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:12 smithi136 ceph-mon[125702]: pgmap v3898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:59:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:12 smithi057 ceph-mon[92072]: pgmap v3898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:59:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:12 smithi122 ceph-mon[125440]: pgmap v3898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:59:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:14 smithi136 ceph-mon[125702]: pgmap v3899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:59:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:14 smithi057 ceph-mon[92072]: pgmap v3899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:59:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:14 smithi122 ceph-mon[125440]: pgmap v3899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:59:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:16 smithi136 ceph-mon[125702]: osdmap e318: 12 total, 12 up, 12 in 2023-03-02T12:59:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:16 smithi136 ceph-mon[125702]: pgmap v3901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:59:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:16 smithi057 ceph-mon[92072]: osdmap e318: 12 total, 12 up, 12 in 2023-03-02T12:59:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:16 smithi057 ceph-mon[92072]: pgmap v3901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:59:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:16 smithi122 ceph-mon[125440]: osdmap e318: 12 total, 12 up, 12 in 2023-03-02T12:59:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:16 smithi122 ceph-mon[125440]: pgmap v3901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T12:59:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:18 smithi136 ceph-mon[125702]: pgmap v3902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T12:59:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:18 smithi057 ceph-mon[92072]: pgmap v3902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T12:59:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:18 smithi122 ceph-mon[125440]: pgmap v3902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T12:59:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:20 smithi136 ceph-mon[125702]: pgmap v3903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:59:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:20 smithi057 ceph-mon[92072]: pgmap v3903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:59:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:20 smithi122 ceph-mon[125440]: pgmap v3903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T12:59:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:22 smithi136 ceph-mon[125702]: pgmap v3904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:59:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:22 smithi057 ceph-mon[92072]: pgmap v3904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:59:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:22 smithi122 ceph-mon[125440]: pgmap v3904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:59:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:24.573+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:59:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:24.574+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:59:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:24.574+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:59:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:24.574+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:59:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:24.574+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:59:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:24 smithi136 ceph-mon[125702]: pgmap v3905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:59:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:24 smithi057 ceph-mon[92072]: pgmap v3905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:59:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:24 smithi122 ceph-mon[125440]: pgmap v3905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T12:59:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:26 smithi136 ceph-mon[125702]: pgmap v3906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T12:59:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:26 smithi057 ceph-mon[92072]: pgmap v3906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T12:59:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:26 smithi122 ceph-mon[125440]: pgmap v3906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T12:59:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:28 smithi136 ceph-mon[125702]: pgmap v3907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:59:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:28 smithi057 ceph-mon[92072]: pgmap v3907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:59:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:28 smithi122 ceph-mon[125440]: pgmap v3907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:59:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:30 smithi136 ceph-mon[125702]: pgmap v3908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:30 smithi057 ceph-mon[92072]: pgmap v3908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:30 smithi122 ceph-mon[125440]: pgmap v3908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:32 smithi136 ceph-mon[125702]: pgmap v3909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:32 smithi057 ceph-mon[92072]: pgmap v3909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:32 smithi122 ceph-mon[125440]: pgmap v3909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:34 smithi136 ceph-mon[125702]: pgmap v3910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:34 smithi057 ceph-mon[92072]: pgmap v3910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:34 smithi122 ceph-mon[125440]: pgmap v3910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:36 smithi136 ceph-mon[125702]: pgmap v3911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:59:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:36 smithi057 ceph-mon[92072]: pgmap v3911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:59:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:36 smithi122 ceph-mon[125440]: pgmap v3911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:59:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:38 smithi136 ceph-mon[125702]: pgmap v3912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:59:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:38 smithi057 ceph-mon[92072]: pgmap v3912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:59:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:38 smithi122 ceph-mon[125440]: pgmap v3912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:39.588+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:39.588+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:59:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:39.588+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:59:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:39.588+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:59:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:39.589+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:59:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:40 smithi136 ceph-mon[125702]: pgmap v3913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:40 smithi057 ceph-mon[92072]: pgmap v3913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:40 smithi122 ceph-mon[125440]: pgmap v3913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:42 smithi136 ceph-mon[125702]: pgmap v3914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:42 smithi057 ceph-mon[92072]: pgmap v3914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:42 smithi122 ceph-mon[125440]: pgmap v3914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:44 smithi136 ceph-mon[125702]: pgmap v3915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:44 smithi057 ceph-mon[92072]: pgmap v3915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:44 smithi122 ceph-mon[125440]: pgmap v3915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:46 smithi136 ceph-mon[125702]: pgmap v3916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:59:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:46 smithi057 ceph-mon[92072]: pgmap v3916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:59:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:46 smithi122 ceph-mon[125440]: pgmap v3916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T12:59:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:48 smithi136 ceph-mon[125702]: pgmap v3917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:59:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:48 smithi057 ceph-mon[92072]: pgmap v3917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:59:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:48 smithi122 ceph-mon[125440]: pgmap v3917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:59:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:50 smithi136 ceph-mon[125702]: pgmap v3918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:50 smithi057 ceph-mon[92072]: pgmap v3918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:50 smithi122 ceph-mon[125440]: pgmap v3918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:52 smithi136 ceph-mon[125702]: pgmap v3919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:52 smithi057 ceph-mon[92072]: pgmap v3919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:52 smithi122 ceph-mon[125440]: pgmap v3919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:54.604+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T12:59:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:54.605+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T12:59:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:54.605+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T12:59:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:54.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T12:59:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T12:59:54.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T12:59:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:54 smithi136 ceph-mon[125702]: pgmap v3920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:54 smithi057 ceph-mon[92072]: pgmap v3920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:54 smithi122 ceph-mon[125440]: pgmap v3920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T12:59:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:56 smithi136 ceph-mon[125702]: pgmap v3921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:56 smithi057 ceph-mon[92072]: pgmap v3921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:56 smithi122 ceph-mon[125440]: pgmap v3921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T12:59:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:58 smithi136 ceph-mon[125702]: pgmap v3922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:59:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:58 smithi057 ceph-mon[92072]: pgmap v3922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T12:59:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:58 smithi122 ceph-mon[125440]: pgmap v3922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T13:00:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 12:59:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:00:00.155 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 12:59:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:00:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 12:59:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:00:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T13:00:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:00 smithi136 ceph-mon[125702]: pgmap v3923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T13:00:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:00 smithi057 ceph-mon[92072]: pgmap v3923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T13:00:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:00 smithi122 ceph-mon[125440]: pgmap v3923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:00:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:00:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:00:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:00:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:00:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:00:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:00:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:03 smithi136 ceph-mon[125702]: pgmap v3924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:00:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:03 smithi057 ceph-mon[92072]: pgmap v3924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:00:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:03 smithi122 ceph-mon[125440]: pgmap v3924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:00:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:04 smithi136 ceph-mon[125702]: pgmap v3925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:00:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:04 smithi057 ceph-mon[92072]: pgmap v3925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:00:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:04 smithi122 ceph-mon[125440]: pgmap v3925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:00:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:06 smithi136 ceph-mon[125702]: pgmap v3926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:00:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:06 smithi057 ceph-mon[92072]: pgmap v3926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:00:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:06 smithi122 ceph-mon[125440]: pgmap v3926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:00:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:08 smithi136 ceph-mon[125702]: pgmap v3927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:00:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:08 smithi057 ceph-mon[92072]: pgmap v3927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:00:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:08 smithi122 ceph-mon[125440]: pgmap v3927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:00:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:09.615+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:00:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:09.616+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:00:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:09.616+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:00:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:09.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:00:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:09.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:00:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:11 smithi136 ceph-mon[125702]: osdmap e319: 12 total, 12 up, 12 in 2023-03-02T13:00:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:11 smithi136 ceph-mon[125702]: pgmap v3929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:00:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:11 smithi057 ceph-mon[92072]: osdmap e319: 12 total, 12 up, 12 in 2023-03-02T13:00:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:11 smithi057 ceph-mon[92072]: pgmap v3929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:00:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:11 smithi122 ceph-mon[125440]: osdmap e319: 12 total, 12 up, 12 in 2023-03-02T13:00:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:11 smithi122 ceph-mon[125440]: pgmap v3929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:00:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:12 smithi136 ceph-mon[125702]: pgmap v3930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:00:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:12 smithi057 ceph-mon[92072]: pgmap v3930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:00:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:12 smithi122 ceph-mon[125440]: pgmap v3930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:00:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:14 smithi136 ceph-mon[125702]: pgmap v3931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:00:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:14 smithi057 ceph-mon[92072]: pgmap v3931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:00:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:14 smithi122 ceph-mon[125440]: pgmap v3931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:00:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:16 smithi136 ceph-mon[125702]: osdmap e320: 12 total, 12 up, 12 in 2023-03-02T13:00:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:16 smithi136 ceph-mon[125702]: pgmap v3933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:00:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:16 smithi057 ceph-mon[92072]: osdmap e320: 12 total, 12 up, 12 in 2023-03-02T13:00:17.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:16 smithi057 ceph-mon[92072]: pgmap v3933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:00:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:16 smithi122 ceph-mon[125440]: osdmap e320: 12 total, 12 up, 12 in 2023-03-02T13:00:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:16 smithi122 ceph-mon[125440]: pgmap v3933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:00:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:18 smithi136 ceph-mon[125702]: pgmap v3934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:00:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:18 smithi057 ceph-mon[92072]: pgmap v3934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:00:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:18 smithi122 ceph-mon[125440]: pgmap v3934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:00:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:20 smithi136 ceph-mon[125702]: pgmap v3935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:00:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:20 smithi057 ceph-mon[92072]: pgmap v3935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:00:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:20 smithi122 ceph-mon[125440]: pgmap v3935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:00:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:22 smithi136 ceph-mon[125702]: pgmap v3936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:00:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:22 smithi057 ceph-mon[92072]: pgmap v3936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:00:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:22 smithi122 ceph-mon[125440]: pgmap v3936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:00:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:24.631+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:00:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:24.632+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:00:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:24.632+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:00:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:24.632+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:00:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:24.632+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:00:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:24 smithi136 ceph-mon[125702]: pgmap v3937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:00:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:24 smithi057 ceph-mon[92072]: pgmap v3937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:00:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:24 smithi122 ceph-mon[125440]: pgmap v3937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:00:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:26 smithi136 ceph-mon[125702]: pgmap v3938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:00:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:26 smithi057 ceph-mon[92072]: pgmap v3938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:00:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:26 smithi122 ceph-mon[125440]: pgmap v3938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:00:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:28 smithi136 ceph-mon[125702]: pgmap v3939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:28 smithi057 ceph-mon[92072]: pgmap v3939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:28 smithi122 ceph-mon[125440]: pgmap v3939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:30 smithi136 ceph-mon[125702]: pgmap v3940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:30 smithi057 ceph-mon[92072]: pgmap v3940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:30 smithi122 ceph-mon[125440]: pgmap v3940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:32 smithi136 ceph-mon[125702]: pgmap v3941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:32 smithi057 ceph-mon[92072]: pgmap v3941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:32 smithi122 ceph-mon[125440]: pgmap v3941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:34 smithi136 ceph-mon[125702]: pgmap v3942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:34 smithi057 ceph-mon[92072]: pgmap v3942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:34 smithi122 ceph-mon[125440]: pgmap v3942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:36 smithi136 ceph-mon[125702]: pgmap v3943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:36 smithi057 ceph-mon[92072]: pgmap v3943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:36 smithi122 ceph-mon[125440]: pgmap v3943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:38 smithi136 ceph-mon[125702]: pgmap v3944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:38 smithi057 ceph-mon[92072]: pgmap v3944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:38 smithi122 ceph-mon[125440]: pgmap v3944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:39.646+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:00:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:39.646+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:00:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:39.646+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:00:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:39.646+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:00:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:39.646+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:00:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:40 smithi136 ceph-mon[125702]: pgmap v3945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:40 smithi057 ceph-mon[92072]: pgmap v3945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:40 smithi122 ceph-mon[125440]: pgmap v3945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:43.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:42 smithi136 ceph-mon[125702]: pgmap v3946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:42 smithi057 ceph-mon[92072]: pgmap v3946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:42 smithi122 ceph-mon[125440]: pgmap v3946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:44 smithi136 ceph-mon[125702]: pgmap v3947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:44 smithi057 ceph-mon[92072]: pgmap v3947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:44 smithi122 ceph-mon[125440]: pgmap v3947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:46 smithi136 ceph-mon[125702]: pgmap v3948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:46 smithi057 ceph-mon[92072]: pgmap v3948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:46 smithi122 ceph-mon[125440]: pgmap v3948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:48 smithi136 ceph-mon[125702]: pgmap v3949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:48 smithi057 ceph-mon[92072]: pgmap v3949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:48 smithi122 ceph-mon[125440]: pgmap v3949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:50 smithi136 ceph-mon[125702]: pgmap v3950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:50 smithi057 ceph-mon[92072]: pgmap v3950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:50 smithi122 ceph-mon[125440]: pgmap v3950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:52 smithi136 ceph-mon[125702]: pgmap v3951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:52 smithi057 ceph-mon[92072]: pgmap v3951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:52 smithi122 ceph-mon[125440]: pgmap v3951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:54.653+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:00:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:54.654+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:00:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:54.654+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:00:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:54.654+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:00:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:00:54.654+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:00:55.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:54 smithi136 ceph-mon[125702]: pgmap v3952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:54 smithi057 ceph-mon[92072]: pgmap v3952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:54 smithi122 ceph-mon[125440]: pgmap v3952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:56 smithi057 ceph-mon[92072]: pgmap v3953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:56 smithi122 ceph-mon[125440]: pgmap v3953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:56 smithi136 ceph-mon[125702]: pgmap v3953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:00:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:00:58 smithi136 ceph-mon[125702]: pgmap v3954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:00:58 smithi057 ceph-mon[92072]: pgmap v3954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:00:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:00:58 smithi122 ceph-mon[125440]: pgmap v3954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:00 smithi136 ceph-mon[125702]: pgmap v3955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:01.126 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:00 smithi122 ceph-mon[125440]: pgmap v3955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:00 smithi057 ceph-mon[92072]: pgmap v3955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:01:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:01:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:01:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:02 smithi136 ceph-mon[125702]: pgmap v3956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:01:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:02 smithi057 ceph-mon[92072]: pgmap v3956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:01:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:02 smithi122 ceph-mon[125440]: pgmap v3956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:01:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: pgmap v3957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:01:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: pgmap v3957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:01:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:05.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: pgmap v3957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:01:06.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:06.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:06.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:01:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:01:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:01:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:01:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:01:06.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:01:06.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:01:06.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:01:06.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:01:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:01:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:01:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:01:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:06.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:01:06.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:01:06.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:01:06.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:01:06.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:01:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:01:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:01:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:01:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:07.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:01:07.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:01:07.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:01:07.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:01:07.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:01:07.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:01:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:07 smithi057 ceph-mon[92072]: pgmap v3958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:01:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:07 smithi122 ceph-mon[125440]: pgmap v3958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:01:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:07 smithi136 ceph-mon[125702]: pgmap v3958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:01:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:08 smithi136 ceph-mon[125702]: pgmap v3959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:01:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:08 smithi057 ceph-mon[92072]: pgmap v3959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:01:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:08 smithi122 ceph-mon[125440]: pgmap v3959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:01:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:09.669+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:01:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:09.670+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:01:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:09.670+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:01:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:09.670+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:01:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:09.670+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:01:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:11 smithi136 ceph-mon[125702]: osdmap e321: 12 total, 12 up, 12 in 2023-03-02T13:01:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:11 smithi136 ceph-mon[125702]: pgmap v3961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:01:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:11 smithi057 ceph-mon[92072]: osdmap e321: 12 total, 12 up, 12 in 2023-03-02T13:01:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:11 smithi057 ceph-mon[92072]: pgmap v3961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:01:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:11 smithi122 ceph-mon[125440]: osdmap e321: 12 total, 12 up, 12 in 2023-03-02T13:01:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:11 smithi122 ceph-mon[125440]: pgmap v3961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:01:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:12 smithi136 ceph-mon[125702]: pgmap v3962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:01:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:12 smithi057 ceph-mon[92072]: pgmap v3962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:01:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:12 smithi122 ceph-mon[125440]: pgmap v3962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:01:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:14 smithi136 ceph-mon[125702]: pgmap v3963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:01:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:14 smithi057 ceph-mon[92072]: pgmap v3963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:01:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:14 smithi122 ceph-mon[125440]: pgmap v3963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:01:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:16 smithi136 ceph-mon[125702]: osdmap e322: 12 total, 12 up, 12 in 2023-03-02T13:01:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:16 smithi136 ceph-mon[125702]: pgmap v3965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:01:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:16 smithi057 ceph-mon[92072]: osdmap e322: 12 total, 12 up, 12 in 2023-03-02T13:01:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:16 smithi057 ceph-mon[92072]: pgmap v3965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:01:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:16 smithi122 ceph-mon[125440]: osdmap e322: 12 total, 12 up, 12 in 2023-03-02T13:01:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:16 smithi122 ceph-mon[125440]: pgmap v3965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:01:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:18 smithi136 ceph-mon[125702]: pgmap v3966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:01:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:18 smithi057 ceph-mon[92072]: pgmap v3966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:01:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:18 smithi122 ceph-mon[125440]: pgmap v3966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:01:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:20 smithi136 ceph-mon[125702]: pgmap v3967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:01:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:20 smithi057 ceph-mon[92072]: pgmap v3967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:01:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:20 smithi122 ceph-mon[125440]: pgmap v3967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:01:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:22 smithi136 ceph-mon[125702]: pgmap v3968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:01:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:22 smithi057 ceph-mon[92072]: pgmap v3968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:01:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:22 smithi122 ceph-mon[125440]: pgmap v3968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:01:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:24.672+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:01:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:24.672+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:01:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:24.672+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:01:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:24.672+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:01:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:24.672+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:01:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:24 smithi136 ceph-mon[125702]: pgmap v3969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:01:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:24 smithi057 ceph-mon[92072]: pgmap v3969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:01:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:24 smithi122 ceph-mon[125440]: pgmap v3969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:01:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:26 smithi057 ceph-mon[92072]: pgmap v3970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:01:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:26 smithi122 ceph-mon[125440]: pgmap v3970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:01:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:26 smithi136 ceph-mon[125702]: pgmap v3970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:01:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:28 smithi136 ceph-mon[125702]: pgmap v3971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:28 smithi057 ceph-mon[92072]: pgmap v3971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:28 smithi122 ceph-mon[125440]: pgmap v3971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:30 smithi136 ceph-mon[125702]: pgmap v3972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:30 smithi057 ceph-mon[92072]: pgmap v3972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:30 smithi122 ceph-mon[125440]: pgmap v3972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:32 smithi136 ceph-mon[125702]: pgmap v3973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:32 smithi057 ceph-mon[92072]: pgmap v3973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:32 smithi122 ceph-mon[125440]: pgmap v3973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:34 smithi136 ceph-mon[125702]: pgmap v3974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:34 smithi057 ceph-mon[92072]: pgmap v3974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:34 smithi122 ceph-mon[125440]: pgmap v3974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:36 smithi057 ceph-mon[92072]: pgmap v3975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:36 smithi122 ceph-mon[125440]: pgmap v3975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:36 smithi136 ceph-mon[125702]: pgmap v3975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:38 smithi136 ceph-mon[125702]: pgmap v3976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:38 smithi057 ceph-mon[92072]: pgmap v3976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:38 smithi122 ceph-mon[125440]: pgmap v3976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:39.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:01:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:39.674+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:01:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:39.674+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:01:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:39.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:01:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:39.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:01:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:40 smithi136 ceph-mon[125702]: pgmap v3977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:40 smithi057 ceph-mon[92072]: pgmap v3977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:40 smithi122 ceph-mon[125440]: pgmap v3977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:42 smithi136 ceph-mon[125702]: pgmap v3978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:42 smithi057 ceph-mon[92072]: pgmap v3978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:42 smithi122 ceph-mon[125440]: pgmap v3978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:44 smithi136 ceph-mon[125702]: pgmap v3979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:44 smithi057 ceph-mon[92072]: pgmap v3979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:44 smithi122 ceph-mon[125440]: pgmap v3979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:46 smithi057 ceph-mon[92072]: pgmap v3980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:46 smithi122 ceph-mon[125440]: pgmap v3980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:46 smithi136 ceph-mon[125702]: pgmap v3980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:48 smithi136 ceph-mon[125702]: pgmap v3981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:48 smithi057 ceph-mon[92072]: pgmap v3981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:48 smithi122 ceph-mon[125440]: pgmap v3981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:50 smithi136 ceph-mon[125702]: pgmap v3982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:51.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:50 smithi057 ceph-mon[92072]: pgmap v3982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:50 smithi122 ceph-mon[125440]: pgmap v3982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:52 smithi136 ceph-mon[125702]: pgmap v3983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:52 smithi057 ceph-mon[92072]: pgmap v3983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:52 smithi122 ceph-mon[125440]: pgmap v3983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:54.688+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:01:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:54.688+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:01:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:54.688+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:01:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:54.688+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:01:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:01:54.689+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:01:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:54 smithi136 ceph-mon[125702]: pgmap v3984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:55.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:54 smithi057 ceph-mon[92072]: pgmap v3984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:54 smithi122 ceph-mon[125440]: pgmap v3984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:56 smithi057 ceph-mon[92072]: pgmap v3985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:56 smithi122 ceph-mon[125440]: pgmap v3985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:56 smithi136 ceph-mon[125702]: pgmap v3985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:01:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:01:58 smithi136 ceph-mon[125702]: pgmap v3986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:01:58 smithi057 ceph-mon[92072]: pgmap v3986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:01:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:01:58 smithi122 ceph-mon[125440]: pgmap v3986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:00 smithi136 ceph-mon[125702]: pgmap v3987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:00 smithi057 ceph-mon[92072]: pgmap v3987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:00 smithi122 ceph-mon[125440]: pgmap v3987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:02 smithi136 ceph-mon[125702]: pgmap v3988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:02:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:02 smithi057 ceph-mon[92072]: pgmap v3988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:02:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:02 smithi122 ceph-mon[125440]: pgmap v3988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:02:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:04 smithi136 ceph-mon[125702]: pgmap v3989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:02:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:04 smithi057 ceph-mon[92072]: pgmap v3989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:02:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:04 smithi122 ceph-mon[125440]: pgmap v3989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:02:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:02:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:02:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:02:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:06 smithi136 ceph-mon[125702]: osdmap e323: 12 total, 12 up, 12 in 2023-03-02T13:02:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:06 smithi136 ceph-mon[125702]: pgmap v3991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:02:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:06 smithi057 ceph-mon[92072]: osdmap e323: 12 total, 12 up, 12 in 2023-03-02T13:02:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:06 smithi057 ceph-mon[92072]: pgmap v3991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:02:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:06 smithi122 ceph-mon[125440]: osdmap e323: 12 total, 12 up, 12 in 2023-03-02T13:02:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:06 smithi122 ceph-mon[125440]: pgmap v3991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:02:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:02:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:02:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:02:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:02:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:02:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:02:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:02:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:02:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:02:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:08 smithi057 ceph-mon[92072]: pgmap v3992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:02:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:08 smithi122 ceph-mon[125440]: pgmap v3992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:02:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:08 smithi136 ceph-mon[125702]: pgmap v3992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:02:09.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:09.411+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:02:09.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:09.411+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:02:09.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:09.411+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 61 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:02:09.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:09.411+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 60 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:02:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:09.697+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:02:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:09.698+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:02:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:09.698+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:02:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:09.698+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:02:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:09.698+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:02:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:10 smithi136 ceph-mon[125702]: pgmap v3993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:02:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:10 smithi057 ceph-mon[92072]: pgmap v3993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:02:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:10 smithi122 ceph-mon[125440]: pgmap v3993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:02:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:11 smithi057 ceph-mon[92072]: osdmap e324: 12 total, 12 up, 12 in 2023-03-02T13:02:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:11 smithi122 ceph-mon[125440]: osdmap e324: 12 total, 12 up, 12 in 2023-03-02T13:02:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:11 smithi136 ceph-mon[125702]: osdmap e324: 12 total, 12 up, 12 in 2023-03-02T13:02:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:12 smithi057 ceph-mon[92072]: pgmap v3995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:02:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:12 smithi122 ceph-mon[125440]: pgmap v3995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:02:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:12 smithi136 ceph-mon[125702]: pgmap v3995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:02:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:14 smithi136 ceph-mon[125702]: pgmap v3996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T13:02:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:14 smithi057 ceph-mon[92072]: pgmap v3996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T13:02:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:14 smithi122 ceph-mon[125440]: pgmap v3996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T13:02:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:16 smithi057 ceph-mon[92072]: pgmap v3997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:02:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:16 smithi122 ceph-mon[125440]: pgmap v3997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:02:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:16 smithi136 ceph-mon[125702]: pgmap v3997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:02:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:18 smithi136 ceph-mon[125702]: pgmap v3998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:02:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:18 smithi057 ceph-mon[92072]: pgmap v3998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:02:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:18 smithi122 ceph-mon[125440]: pgmap v3998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:02:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:20 smithi136 ceph-mon[125702]: pgmap v3999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:02:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:20 smithi057 ceph-mon[92072]: pgmap v3999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:02:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:20 smithi122 ceph-mon[125440]: pgmap v3999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:02:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:22 smithi136 ceph-mon[125702]: pgmap v4000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T13:02:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:22 smithi057 ceph-mon[92072]: pgmap v4000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T13:02:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:22 smithi122 ceph-mon[125440]: pgmap v4000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T13:02:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:24.713+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:02:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:24.714+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:02:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:24.714+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:02:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:24.714+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:02:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:24.714+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:02:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:24 smithi136 ceph-mon[125702]: pgmap v4001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:24 smithi057 ceph-mon[92072]: pgmap v4001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:24 smithi122 ceph-mon[125440]: pgmap v4001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:26 smithi057 ceph-mon[92072]: pgmap v4002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:26 smithi122 ceph-mon[125440]: pgmap v4002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:26 smithi136 ceph-mon[125702]: pgmap v4002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:28 smithi136 ceph-mon[125702]: pgmap v4003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:28 smithi057 ceph-mon[92072]: pgmap v4003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:28 smithi122 ceph-mon[125440]: pgmap v4003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:30 smithi136 ceph-mon[125702]: pgmap v4004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:30 smithi057 ceph-mon[92072]: pgmap v4004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:30 smithi122 ceph-mon[125440]: pgmap v4004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:32 smithi136 ceph-mon[125702]: pgmap v4005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:32 smithi057 ceph-mon[92072]: pgmap v4005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:32 smithi122 ceph-mon[125440]: pgmap v4005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:34 smithi136 ceph-mon[125702]: pgmap v4006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:34 smithi057 ceph-mon[92072]: pgmap v4006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:34 smithi122 ceph-mon[125440]: pgmap v4006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:37 smithi057 ceph-mon[92072]: pgmap v4007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:37 smithi122 ceph-mon[125440]: pgmap v4007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:37 smithi136 ceph-mon[125702]: pgmap v4007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:39.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:02:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:39.721+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:02:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:39.721+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:02:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:39.721+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:02:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:39.721+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:02:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:39 smithi057 ceph-mon[92072]: pgmap v4008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:39 smithi122 ceph-mon[125440]: pgmap v4008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:39 smithi136 ceph-mon[125702]: pgmap v4008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:41 smithi057 ceph-mon[92072]: pgmap v4009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:41 smithi122 ceph-mon[125440]: pgmap v4009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:41 smithi136 ceph-mon[125702]: pgmap v4009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:43 smithi057 ceph-mon[92072]: pgmap v4010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:43 smithi122 ceph-mon[125440]: pgmap v4010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:43 smithi136 ceph-mon[125702]: pgmap v4010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:45 smithi057 ceph-mon[92072]: pgmap v4011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:45 smithi122 ceph-mon[125440]: pgmap v4011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:45 smithi136 ceph-mon[125702]: pgmap v4011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:47 smithi057 ceph-mon[92072]: pgmap v4012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:47 smithi122 ceph-mon[125440]: pgmap v4012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:47 smithi136 ceph-mon[125702]: pgmap v4012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:49 smithi057 ceph-mon[92072]: pgmap v4013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:49 smithi122 ceph-mon[125440]: pgmap v4013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:49 smithi136 ceph-mon[125702]: pgmap v4013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:51 smithi057 ceph-mon[92072]: pgmap v4014: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:51 smithi122 ceph-mon[125440]: pgmap v4014: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:51 smithi136 ceph-mon[125702]: pgmap v4014: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:53 smithi057 ceph-mon[92072]: pgmap v4015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:53 smithi122 ceph-mon[125440]: pgmap v4015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:53 smithi136 ceph-mon[125702]: pgmap v4015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:54.417+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:02:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:54.417+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:02:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:54.417+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 62 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:02:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:54.417+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 61 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:02:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:54.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:02:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:54.736+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:02:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:54.736+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:02:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:54.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:02:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:02:54.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:02:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:55 smithi057 ceph-mon[92072]: pgmap v4016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:55 smithi122 ceph-mon[125440]: pgmap v4016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:55 smithi136 ceph-mon[125702]: pgmap v4016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:02:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:57 smithi057 ceph-mon[92072]: pgmap v4017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:57 smithi122 ceph-mon[125440]: pgmap v4017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:02:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:57 smithi136 ceph-mon[125702]: pgmap v4017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:02:59 smithi057 ceph-mon[92072]: pgmap v4018: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:02:59 smithi122 ceph-mon[125440]: pgmap v4018: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:02:59 smithi136 ceph-mon[125702]: pgmap v4018: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:01 smithi057 ceph-mon[92072]: pgmap v4019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:01 smithi122 ceph-mon[125440]: pgmap v4019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:01 smithi136 ceph-mon[125702]: pgmap v4019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:03 smithi057 ceph-mon[92072]: pgmap v4020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:03:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:03 smithi122 ceph-mon[125440]: pgmap v4020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:03:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:03 smithi136 ceph-mon[125702]: pgmap v4020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:03:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:05 smithi057 ceph-mon[92072]: pgmap v4021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:03:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:05 smithi122 ceph-mon[125440]: pgmap v4021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:03:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:05 smithi136 ceph-mon[125702]: pgmap v4021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:03:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:06 smithi122 ceph-mon[125440]: osdmap e325: 12 total, 12 up, 12 in 2023-03-02T13:03:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:06 smithi136 ceph-mon[125702]: osdmap e325: 12 total, 12 up, 12 in 2023-03-02T13:03:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:06 smithi057 ceph-mon[92072]: osdmap e325: 12 total, 12 up, 12 in 2023-03-02T13:03:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:07 smithi122 ceph-mon[125440]: pgmap v4023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:03:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:03:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:03:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:03:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:07 smithi136 ceph-mon[125702]: pgmap v4023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:03:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:03:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:03:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:03:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:07 smithi057 ceph-mon[92072]: pgmap v4023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:03:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:03:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:03:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:03:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:03:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:03:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:03:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:03:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:03:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:03:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:03:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:03:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:03:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:09.746+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:03:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:09.746+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:03:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:09.746+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:03:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:09.746+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:03:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:09.746+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:03:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:10 smithi057 ceph-mon[92072]: pgmap v4024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:03:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:10 smithi122 ceph-mon[125440]: pgmap v4024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:03:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:10 smithi136 ceph-mon[125702]: pgmap v4024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:03:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:11 smithi057 ceph-mon[92072]: pgmap v4025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:03:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:11 smithi057 ceph-mon[92072]: osdmap e326: 12 total, 12 up, 12 in 2023-03-02T13:03:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:11 smithi122 ceph-mon[125440]: pgmap v4025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:03:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:11 smithi122 ceph-mon[125440]: osdmap e326: 12 total, 12 up, 12 in 2023-03-02T13:03:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:11 smithi136 ceph-mon[125702]: pgmap v4025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:03:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:11 smithi136 ceph-mon[125702]: osdmap e326: 12 total, 12 up, 12 in 2023-03-02T13:03:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:13 smithi057 ceph-mon[92072]: pgmap v4027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:03:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:13 smithi122 ceph-mon[125440]: pgmap v4027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:03:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:13 smithi136 ceph-mon[125702]: pgmap v4027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:03:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:15 smithi057 ceph-mon[92072]: pgmap v4028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:03:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:15 smithi122 ceph-mon[125440]: pgmap v4028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:03:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:15 smithi136 ceph-mon[125702]: pgmap v4028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:03:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:17 smithi057 ceph-mon[92072]: pgmap v4029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:03:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:17 smithi122 ceph-mon[125440]: pgmap v4029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:03:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:17 smithi136 ceph-mon[125702]: pgmap v4029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:03:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:19 smithi057 ceph-mon[92072]: pgmap v4030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:03:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:19 smithi122 ceph-mon[125440]: pgmap v4030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:03:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:19 smithi136 ceph-mon[125702]: pgmap v4030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:03:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:21 smithi057 ceph-mon[92072]: pgmap v4031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:03:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:21 smithi122 ceph-mon[125440]: pgmap v4031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:03:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:21 smithi136 ceph-mon[125702]: pgmap v4031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:03:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:23 smithi057 ceph-mon[92072]: pgmap v4032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:03:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:23 smithi122 ceph-mon[125440]: pgmap v4032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:03:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:23 smithi136 ceph-mon[125702]: pgmap v4032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:03:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:24.753+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:03:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:24.754+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:03:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:24.754+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:03:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:24.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:03:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:24.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:03:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:25 smithi057 ceph-mon[92072]: pgmap v4033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:25 smithi122 ceph-mon[125440]: pgmap v4033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:25 smithi136 ceph-mon[125702]: pgmap v4033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:27 smithi057 ceph-mon[92072]: pgmap v4034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:27 smithi122 ceph-mon[125440]: pgmap v4034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:27 smithi136 ceph-mon[125702]: pgmap v4034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:29 smithi057 ceph-mon[92072]: pgmap v4035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:29 smithi122 ceph-mon[125440]: pgmap v4035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:29 smithi136 ceph-mon[125702]: pgmap v4035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:31 smithi057 ceph-mon[92072]: pgmap v4036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:31 smithi122 ceph-mon[125440]: pgmap v4036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:31 smithi136 ceph-mon[125702]: pgmap v4036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:33 smithi122 ceph-mon[125440]: pgmap v4037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:33 smithi136 ceph-mon[125702]: pgmap v4037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:33 smithi057 ceph-mon[92072]: pgmap v4037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:35 smithi122 ceph-mon[125440]: pgmap v4038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:35 smithi136 ceph-mon[125702]: pgmap v4038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:35 smithi057 ceph-mon[92072]: pgmap v4038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:37 smithi122 ceph-mon[125440]: pgmap v4039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:37 smithi136 ceph-mon[125702]: pgmap v4039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:37 smithi057 ceph-mon[92072]: pgmap v4039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:39.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:39.767+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:03:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:39.767+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:03:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:39.767+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:03:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:39.767+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:03:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:39.767+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:03:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:39 smithi136 ceph-mon[125702]: pgmap v4040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:39 smithi057 ceph-mon[92072]: pgmap v4040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:39 smithi122 ceph-mon[125440]: pgmap v4040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:41 smithi136 ceph-mon[125702]: pgmap v4041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:41 smithi057 ceph-mon[92072]: pgmap v4041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:41 smithi122 ceph-mon[125440]: pgmap v4041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:43 smithi136 ceph-mon[125702]: pgmap v4042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:43 smithi057 ceph-mon[92072]: pgmap v4042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:43 smithi122 ceph-mon[125440]: pgmap v4042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:45 smithi136 ceph-mon[125702]: pgmap v4043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:45 smithi057 ceph-mon[92072]: pgmap v4043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:45 smithi122 ceph-mon[125440]: pgmap v4043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:47 smithi136 ceph-mon[125702]: pgmap v4044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:47 smithi057 ceph-mon[92072]: pgmap v4044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:47 smithi122 ceph-mon[125440]: pgmap v4044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:49 smithi136 ceph-mon[125702]: pgmap v4045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:49 smithi057 ceph-mon[92072]: pgmap v4045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:49 smithi122 ceph-mon[125440]: pgmap v4045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:51 smithi136 ceph-mon[125702]: pgmap v4046: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:51 smithi057 ceph-mon[92072]: pgmap v4046: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:51 smithi122 ceph-mon[125440]: pgmap v4046: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:53 smithi136 ceph-mon[125702]: pgmap v4047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:53 smithi057 ceph-mon[92072]: pgmap v4047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:53 smithi122 ceph-mon[125440]: pgmap v4047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:54.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:03:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:54.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:03:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:54.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:03:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:54.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:03:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:03:54.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:03:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:55 smithi136 ceph-mon[125702]: pgmap v4048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:55 smithi057 ceph-mon[92072]: pgmap v4048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:55 smithi122 ceph-mon[125440]: pgmap v4048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:03:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:57 smithi136 ceph-mon[125702]: pgmap v4049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:57 smithi057 ceph-mon[92072]: pgmap v4049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:03:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:57 smithi122 ceph-mon[125440]: pgmap v4049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:03:59 smithi136 ceph-mon[125702]: pgmap v4050: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:03:59 smithi057 ceph-mon[92072]: pgmap v4050: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:03:59 smithi122 ceph-mon[125440]: pgmap v4050: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:01 smithi136 ceph-mon[125702]: pgmap v4051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:01 smithi057 ceph-mon[92072]: pgmap v4051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:01 smithi122 ceph-mon[125440]: pgmap v4051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:04 smithi136 ceph-mon[125702]: pgmap v4052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:04:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:04 smithi057 ceph-mon[92072]: pgmap v4052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:04:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:04 smithi122 ceph-mon[125440]: pgmap v4052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:04:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:06 smithi136 ceph-mon[125702]: pgmap v4053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:04:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:06 smithi057 ceph-mon[92072]: pgmap v4053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:04:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:06 smithi122 ceph-mon[125440]: pgmap v4053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:04:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:08 smithi136 ceph-mon[125702]: pgmap v4054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:04:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:08 smithi057 ceph-mon[92072]: pgmap v4054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:04:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:08 smithi122 ceph-mon[125440]: pgmap v4054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:04:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:04:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:04:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:04:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:09.793+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:04:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:09.793+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:04:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:09.793+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:04:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:09.793+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:04:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:09.793+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:04:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:10 smithi136 ceph-mon[125702]: pgmap v4055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:04:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:04:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:04:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:10 smithi057 ceph-mon[92072]: pgmap v4055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:04:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:04:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:04:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:10 smithi122 ceph-mon[125440]: pgmap v4055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:04:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:04:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:04:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:04:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:12 smithi136 ceph-mon[125702]: pgmap v4056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:04:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:12 smithi136 ceph-mon[125702]: osdmap e327: 12 total, 12 up, 12 in 2023-03-02T13:04:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:12 smithi057 ceph-mon[92072]: pgmap v4056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:04:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:12 smithi057 ceph-mon[92072]: osdmap e327: 12 total, 12 up, 12 in 2023-03-02T13:04:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:12 smithi122 ceph-mon[125440]: pgmap v4056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:04:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:12 smithi122 ceph-mon[125440]: osdmap e327: 12 total, 12 up, 12 in 2023-03-02T13:04:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:14 smithi136 ceph-mon[125702]: pgmap v4058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:14 smithi057 ceph-mon[92072]: pgmap v4058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:14 smithi122 ceph-mon[125440]: pgmap v4058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:16 smithi136 ceph-mon[125702]: pgmap v4059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:16 smithi136 ceph-mon[125702]: osdmap e328: 12 total, 12 up, 12 in 2023-03-02T13:04:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:16 smithi057 ceph-mon[92072]: pgmap v4059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:16 smithi057 ceph-mon[92072]: osdmap e328: 12 total, 12 up, 12 in 2023-03-02T13:04:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:16 smithi122 ceph-mon[125440]: pgmap v4059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:16 smithi122 ceph-mon[125440]: osdmap e328: 12 total, 12 up, 12 in 2023-03-02T13:04:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:18 smithi136 ceph-mon[125702]: pgmap v4061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:04:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:18 smithi057 ceph-mon[92072]: pgmap v4061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:04:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:18 smithi122 ceph-mon[125440]: pgmap v4061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:04:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:20 smithi136 ceph-mon[125702]: pgmap v4062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:04:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:20 smithi057 ceph-mon[92072]: pgmap v4062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:04:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:20 smithi122 ceph-mon[125440]: pgmap v4062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:04:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:22 smithi136 ceph-mon[125702]: pgmap v4063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T13:04:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:22 smithi057 ceph-mon[92072]: pgmap v4063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T13:04:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:22 smithi122 ceph-mon[125440]: pgmap v4063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T13:04:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:24 smithi057 ceph-mon[92072]: pgmap v4064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:24 smithi122 ceph-mon[125440]: pgmap v4064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:24 smithi136 ceph-mon[125702]: pgmap v4064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:24.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:04:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:24.797+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:04:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:24.797+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:04:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:24.797+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:04:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:24.797+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:04:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:26 smithi057 ceph-mon[92072]: pgmap v4065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:26 smithi122 ceph-mon[125440]: pgmap v4065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:26 smithi136 ceph-mon[125702]: pgmap v4065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:04:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:28 smithi057 ceph-mon[92072]: pgmap v4066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T13:04:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:28 smithi122 ceph-mon[125440]: pgmap v4066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T13:04:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:28 smithi136 ceph-mon[125702]: pgmap v4066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T13:04:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:30 smithi057 ceph-mon[92072]: pgmap v4067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:30 smithi122 ceph-mon[125440]: pgmap v4067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:30 smithi136 ceph-mon[125702]: pgmap v4067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:32 smithi057 ceph-mon[92072]: pgmap v4068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:32 smithi122 ceph-mon[125440]: pgmap v4068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:32 smithi136 ceph-mon[125702]: pgmap v4068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:34 smithi057 ceph-mon[92072]: pgmap v4069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:34 smithi122 ceph-mon[125440]: pgmap v4069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:34 smithi136 ceph-mon[125702]: pgmap v4069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:36 smithi057 ceph-mon[92072]: pgmap v4070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:36 smithi122 ceph-mon[125440]: pgmap v4070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:36 smithi136 ceph-mon[125702]: pgmap v4070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:38 smithi057 ceph-mon[92072]: pgmap v4071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:38 smithi122 ceph-mon[125440]: pgmap v4071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:38 smithi136 ceph-mon[125702]: pgmap v4071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:39.812+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:04:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:39.813+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:04:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:39.813+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:04:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:39.813+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:04:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:39.813+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:04:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:40 smithi057 ceph-mon[92072]: pgmap v4072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:40 smithi122 ceph-mon[125440]: pgmap v4072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:40 smithi136 ceph-mon[125702]: pgmap v4072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:42 smithi057 ceph-mon[92072]: pgmap v4073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:42 smithi122 ceph-mon[125440]: pgmap v4073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:42 smithi136 ceph-mon[125702]: pgmap v4073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:44 smithi057 ceph-mon[92072]: pgmap v4074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:44 smithi122 ceph-mon[125440]: pgmap v4074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:44 smithi136 ceph-mon[125702]: pgmap v4074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:46 smithi057 ceph-mon[92072]: pgmap v4075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:46 smithi122 ceph-mon[125440]: pgmap v4075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:46 smithi136 ceph-mon[125702]: pgmap v4075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:48 smithi057 ceph-mon[92072]: pgmap v4076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:48 smithi122 ceph-mon[125440]: pgmap v4076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:48 smithi136 ceph-mon[125702]: pgmap v4076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:50 smithi057 ceph-mon[92072]: pgmap v4077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:50 smithi122 ceph-mon[125440]: pgmap v4077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:50 smithi136 ceph-mon[125702]: pgmap v4077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:52 smithi057 ceph-mon[92072]: pgmap v4078: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:52 smithi122 ceph-mon[125440]: pgmap v4078: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:52 smithi136 ceph-mon[125702]: pgmap v4078: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:54 smithi122 ceph-mon[125440]: pgmap v4079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:54 smithi136 ceph-mon[125702]: pgmap v4079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:54 smithi057 ceph-mon[92072]: pgmap v4079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:54.828+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:04:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:54.828+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:04:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:54.828+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:04:54.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:54.828+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:04:54.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:04:54.828+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:04:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:56 smithi122 ceph-mon[125440]: pgmap v4080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:56 smithi136 ceph-mon[125702]: pgmap v4080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:56 smithi057 ceph-mon[92072]: pgmap v4080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:04:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:04:58 smithi122 ceph-mon[125440]: pgmap v4081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:04:58 smithi136 ceph-mon[125702]: pgmap v4081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:04:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:04:58 smithi057 ceph-mon[92072]: pgmap v4081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:00 smithi136 ceph-mon[125702]: pgmap v4082: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:00 smithi057 ceph-mon[92072]: pgmap v4082: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:00 smithi122 ceph-mon[125440]: pgmap v4082: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:02 smithi136 ceph-mon[125702]: pgmap v4083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:02 smithi057 ceph-mon[92072]: pgmap v4083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:02 smithi122 ceph-mon[125440]: pgmap v4083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:04 smithi136 ceph-mon[125702]: pgmap v4084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T13:05:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:04 smithi057 ceph-mon[92072]: pgmap v4084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T13:05:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:04 smithi122 ceph-mon[125440]: pgmap v4084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-02T13:05:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:06 smithi136 ceph-mon[125702]: pgmap v4085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T13:05:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:06 smithi057 ceph-mon[92072]: pgmap v4085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T13:05:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:06 smithi122 ceph-mon[125440]: pgmap v4085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T13:05:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:08 smithi136 ceph-mon[125702]: pgmap v4086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T13:05:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:08 smithi057 ceph-mon[92072]: pgmap v4086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T13:05:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:08 smithi122 ceph-mon[125440]: pgmap v4086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T13:05:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:09.437+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:05:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:09.437+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:05:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:09.437+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 63 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:05:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:09.437+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 62 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:05:09.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:09.831+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:05:09.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:09.831+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:05:09.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:09.831+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:05:09.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:09.831+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:05:09.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:09.831+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:05:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:10 smithi136 ceph-mon[125702]: pgmap v4087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T13:05:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:05:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:10 smithi057 ceph-mon[92072]: pgmap v4087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T13:05:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:05:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:10 smithi122 ceph-mon[125440]: pgmap v4087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T13:05:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:05:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:11 smithi057 ceph-mon[92072]: pgmap v4088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T13:05:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:05:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:05:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:05:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:11 smithi122 ceph-mon[125440]: pgmap v4088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T13:05:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:05:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:05:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:05:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:11 smithi136 ceph-mon[125702]: pgmap v4088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-02T13:05:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:05:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:05:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:05:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:13 smithi057 ceph-mon[92072]: pgmap v4089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T13:05:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:13 smithi122 ceph-mon[125440]: pgmap v4089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T13:05:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:13 smithi136 ceph-mon[125702]: pgmap v4089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-02T13:05:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:15 smithi057 ceph-mon[92072]: pgmap v4090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T13:05:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:15 smithi122 ceph-mon[125440]: pgmap v4090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T13:05:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:15 smithi136 ceph-mon[125702]: pgmap v4090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T13:05:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:17 smithi057 ceph-mon[92072]: pgmap v4091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T13:05:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:17 smithi122 ceph-mon[125440]: pgmap v4091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T13:05:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:17 smithi136 ceph-mon[125702]: pgmap v4091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T13:05:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:19 smithi057 ceph-mon[92072]: pgmap v4092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T13:05:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:19 smithi122 ceph-mon[125440]: pgmap v4092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T13:05:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:19 smithi136 ceph-mon[125702]: pgmap v4092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T13:05:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:21 smithi057 ceph-mon[92072]: pgmap v4093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T13:05:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:21 smithi122 ceph-mon[125440]: pgmap v4093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T13:05:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:21 smithi136 ceph-mon[125702]: pgmap v4093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T13:05:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:23 smithi057 ceph-mon[92072]: pgmap v4094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T13:05:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:23 smithi122 ceph-mon[125440]: pgmap v4094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T13:05:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:23 smithi136 ceph-mon[125702]: pgmap v4094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T13:05:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:24.847+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:05:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:24.848+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:05:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:24.848+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:05:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:24.848+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:05:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:24.848+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:05:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:25 smithi122 ceph-mon[125440]: pgmap v4095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:25 smithi136 ceph-mon[125702]: pgmap v4095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:25 smithi057 ceph-mon[92072]: pgmap v4095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:27 smithi122 ceph-mon[125440]: pgmap v4096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:27 smithi136 ceph-mon[125702]: pgmap v4096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:27 smithi057 ceph-mon[92072]: pgmap v4096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:29 smithi136 ceph-mon[125702]: pgmap v4097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:29 smithi057 ceph-mon[92072]: pgmap v4097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:29 smithi122 ceph-mon[125440]: pgmap v4097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:31 smithi136 ceph-mon[125702]: pgmap v4098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:31 smithi057 ceph-mon[92072]: pgmap v4098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:31 smithi122 ceph-mon[125440]: pgmap v4098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:33 smithi136 ceph-mon[125702]: pgmap v4099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:33 smithi057 ceph-mon[92072]: pgmap v4099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:33 smithi122 ceph-mon[125440]: pgmap v4099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:35 smithi136 ceph-mon[125702]: pgmap v4100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:35 smithi057 ceph-mon[92072]: pgmap v4100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:35 smithi122 ceph-mon[125440]: pgmap v4100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:37 smithi136 ceph-mon[125702]: pgmap v4101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:37 smithi057 ceph-mon[92072]: pgmap v4101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:37 smithi122 ceph-mon[125440]: pgmap v4101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:39.860+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:05:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:39.860+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:05:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:39.860+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:05:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:39.860+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:05:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:39.860+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:05:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:39 smithi136 ceph-mon[125702]: pgmap v4102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:39 smithi057 ceph-mon[92072]: pgmap v4102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:39 smithi122 ceph-mon[125440]: pgmap v4102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:41 smithi136 ceph-mon[125702]: pgmap v4103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:41 smithi057 ceph-mon[92072]: pgmap v4103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:41 smithi122 ceph-mon[125440]: pgmap v4103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:44 smithi136 ceph-mon[125702]: pgmap v4104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:43 smithi057 ceph-mon[92072]: pgmap v4104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:43 smithi122 ceph-mon[125440]: pgmap v4104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:46 smithi136 ceph-mon[125702]: pgmap v4105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:46 smithi057 ceph-mon[92072]: pgmap v4105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:46 smithi122 ceph-mon[125440]: pgmap v4105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:48 smithi136 ceph-mon[125702]: pgmap v4106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:48 smithi057 ceph-mon[92072]: pgmap v4106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:48 smithi122 ceph-mon[125440]: pgmap v4106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:50 smithi136 ceph-mon[125702]: pgmap v4107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:50 smithi057 ceph-mon[92072]: pgmap v4107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:50 smithi122 ceph-mon[125440]: pgmap v4107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:52 smithi136 ceph-mon[125702]: pgmap v4108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:52 smithi057 ceph-mon[92072]: pgmap v4108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:52 smithi122 ceph-mon[125440]: pgmap v4108: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:54 smithi136 ceph-mon[125702]: pgmap v4109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:54 smithi057 ceph-mon[92072]: pgmap v4109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:54 smithi122 ceph-mon[125440]: pgmap v4109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:54.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:54.876+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:54.876+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:54.876+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:05:54.876+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:05:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:56 smithi136 ceph-mon[125702]: pgmap v4110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:56 smithi057 ceph-mon[92072]: pgmap v4110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:56 smithi122 ceph-mon[125440]: pgmap v4110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:05:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:05:58 smithi136 ceph-mon[125702]: pgmap v4111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:05:58 smithi057 ceph-mon[92072]: pgmap v4111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:05:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:05:58 smithi122 ceph-mon[125440]: pgmap v4111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:00 smithi136 ceph-mon[125702]: pgmap v4112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:00 smithi057 ceph-mon[92072]: pgmap v4112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:00 smithi122 ceph-mon[125440]: pgmap v4112: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:02 smithi136 ceph-mon[125702]: pgmap v4113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:02 smithi057 ceph-mon[92072]: pgmap v4113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:02 smithi122 ceph-mon[125440]: pgmap v4113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:04 smithi136 ceph-mon[125702]: pgmap v4114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:06:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:04 smithi057 ceph-mon[92072]: pgmap v4114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:06:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:04 smithi122 ceph-mon[125440]: pgmap v4114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:06:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:06 smithi136 ceph-mon[125702]: pgmap v4115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:06:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:06 smithi057 ceph-mon[92072]: pgmap v4115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:06:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:06 smithi122 ceph-mon[125440]: pgmap v4115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:06:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:08 smithi136 ceph-mon[125702]: pgmap v4116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:06:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:08 smithi057 ceph-mon[92072]: pgmap v4116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:06:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:08 smithi122 ceph-mon[125440]: pgmap v4116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:06:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:09.890+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:06:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:09.890+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:06:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:09.890+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:06:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:09.890+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:06:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:09.890+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:06:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:10 smithi136 ceph-mon[125702]: pgmap v4117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:06:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:10 smithi057 ceph-mon[92072]: pgmap v4117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:06:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:10 smithi122 ceph-mon[125440]: pgmap v4117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:06:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:12 smithi136 ceph-mon[125702]: pgmap v4118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:06:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:06:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:12 smithi136 ceph-mon[125702]: osdmap e329: 12 total, 12 up, 12 in 2023-03-02T13:06:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:06:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:06:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:06:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:12 smithi057 ceph-mon[92072]: pgmap v4118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:06:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:06:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:12 smithi057 ceph-mon[92072]: osdmap e329: 12 total, 12 up, 12 in 2023-03-02T13:06:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:06:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:06:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:06:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:12 smithi122 ceph-mon[125440]: pgmap v4118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:06:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:06:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:12 smithi122 ceph-mon[125440]: osdmap e329: 12 total, 12 up, 12 in 2023-03-02T13:06:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:06:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:06:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:06:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:14 smithi136 ceph-mon[125702]: pgmap v4120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:06:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:14 smithi057 ceph-mon[92072]: pgmap v4120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:06:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:14 smithi122 ceph-mon[125440]: pgmap v4120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:06:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:16 smithi136 ceph-mon[125702]: pgmap v4121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:06:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:16 smithi136 ceph-mon[125702]: osdmap e330: 12 total, 12 up, 12 in 2023-03-02T13:06:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:16 smithi057 ceph-mon[92072]: pgmap v4121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:06:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:16 smithi057 ceph-mon[92072]: osdmap e330: 12 total, 12 up, 12 in 2023-03-02T13:06:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:16 smithi122 ceph-mon[125440]: pgmap v4121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:06:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:16 smithi122 ceph-mon[125440]: osdmap e330: 12 total, 12 up, 12 in 2023-03-02T13:06:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:18 smithi136 ceph-mon[125702]: pgmap v4123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:06:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:18 smithi057 ceph-mon[92072]: pgmap v4123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:06:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:18 smithi122 ceph-mon[125440]: pgmap v4123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:06:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:20 smithi136 ceph-mon[125702]: pgmap v4124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:06:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:20 smithi057 ceph-mon[92072]: pgmap v4124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:06:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:20 smithi122 ceph-mon[125440]: pgmap v4124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:06:22.103 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:22 smithi057 ceph-mon[92072]: pgmap v4125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:06:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:22 smithi122 ceph-mon[125440]: pgmap v4125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:06:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:22 smithi136 ceph-mon[125702]: pgmap v4125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:06:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:24 smithi057 ceph-mon[92072]: pgmap v4126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:06:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:24 smithi122 ceph-mon[125440]: pgmap v4126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:06:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:24 smithi136 ceph-mon[125702]: pgmap v4126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:06:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:24.896+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:06:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:24.896+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:06:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:24.896+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:06:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:24.896+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:06:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:24.896+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:06:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:26 smithi057 ceph-mon[92072]: pgmap v4127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:06:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:26 smithi122 ceph-mon[125440]: pgmap v4127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:06:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:26 smithi136 ceph-mon[125702]: pgmap v4127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:06:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:28 smithi057 ceph-mon[92072]: pgmap v4128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:06:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:28 smithi122 ceph-mon[125440]: pgmap v4128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:06:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:28 smithi136 ceph-mon[125702]: pgmap v4128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:06:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:30 smithi057 ceph-mon[92072]: pgmap v4129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:30 smithi122 ceph-mon[125440]: pgmap v4129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:30 smithi136 ceph-mon[125702]: pgmap v4129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:32 smithi057 ceph-mon[92072]: pgmap v4130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:32 smithi122 ceph-mon[125440]: pgmap v4130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:32 smithi136 ceph-mon[125702]: pgmap v4130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:34 smithi057 ceph-mon[92072]: pgmap v4131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:34 smithi122 ceph-mon[125440]: pgmap v4131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:34 smithi136 ceph-mon[125702]: pgmap v4131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:36 smithi057 ceph-mon[92072]: pgmap v4132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:36 smithi122 ceph-mon[125440]: pgmap v4132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:36 smithi136 ceph-mon[125702]: pgmap v4132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:38 smithi057 ceph-mon[92072]: pgmap v4133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:38 smithi122 ceph-mon[125440]: pgmap v4133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:38 smithi136 ceph-mon[125702]: pgmap v4133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:39.899+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:06:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:39.900+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:06:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:39.900+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:06:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:39.900+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:06:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:39.900+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:06:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:40 smithi057 ceph-mon[92072]: pgmap v4134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:40 smithi122 ceph-mon[125440]: pgmap v4134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:40 smithi136 ceph-mon[125702]: pgmap v4134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:42 smithi057 ceph-mon[92072]: pgmap v4135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:42 smithi122 ceph-mon[125440]: pgmap v4135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:42 smithi136 ceph-mon[125702]: pgmap v4135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:44 smithi057 ceph-mon[92072]: pgmap v4136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:44 smithi122 ceph-mon[125440]: pgmap v4136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:44 smithi136 ceph-mon[125702]: pgmap v4136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:46 smithi057 ceph-mon[92072]: pgmap v4137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:06:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:46 smithi122 ceph-mon[125440]: pgmap v4137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:06:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:46 smithi136 ceph-mon[125702]: pgmap v4137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:06:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:48 smithi057 ceph-mon[92072]: pgmap v4138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:48 smithi122 ceph-mon[125440]: pgmap v4138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:48 smithi136 ceph-mon[125702]: pgmap v4138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:50 smithi057 ceph-mon[92072]: pgmap v4139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:06:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:50 smithi122 ceph-mon[125440]: pgmap v4139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:06:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:50 smithi136 ceph-mon[125702]: pgmap v4139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:06:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:52 smithi057 ceph-mon[92072]: pgmap v4140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:06:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:52 smithi122 ceph-mon[125440]: pgmap v4140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:06:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:52 smithi136 ceph-mon[125702]: pgmap v4140: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:06:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:54 smithi057 ceph-mon[92072]: pgmap v4141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:54 smithi122 ceph-mon[125440]: pgmap v4141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:54 smithi136 ceph-mon[125702]: pgmap v4141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:54.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:06:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:54.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:06:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:54.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:06:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:54.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:06:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:06:54.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:06:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:56 smithi122 ceph-mon[125440]: pgmap v4142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:56 smithi136 ceph-mon[125702]: pgmap v4142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:56 smithi057 ceph-mon[92072]: pgmap v4142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:06:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:06:58 smithi122 ceph-mon[125440]: pgmap v4143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:06:58 smithi136 ceph-mon[125702]: pgmap v4143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:06:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:06:58 smithi057 ceph-mon[92072]: pgmap v4143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:00 smithi136 ceph-mon[125702]: pgmap v4144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:00 smithi057 ceph-mon[92072]: pgmap v4144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:00 smithi122 ceph-mon[125440]: pgmap v4144: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:02 smithi136 ceph-mon[125702]: pgmap v4145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:02 smithi057 ceph-mon[92072]: pgmap v4145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:02 smithi122 ceph-mon[125440]: pgmap v4145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:04 smithi136 ceph-mon[125702]: pgmap v4146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:07:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:04 smithi057 ceph-mon[92072]: pgmap v4146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:07:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:04 smithi122 ceph-mon[125440]: pgmap v4146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:07:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:06 smithi136 ceph-mon[125702]: pgmap v4147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:07:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:06 smithi057 ceph-mon[92072]: pgmap v4147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:07:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:06 smithi122 ceph-mon[125440]: pgmap v4147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:07:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:08 smithi136 ceph-mon[125702]: pgmap v4148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:07:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:08 smithi057 ceph-mon[92072]: pgmap v4148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:07:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:08 smithi122 ceph-mon[125440]: pgmap v4148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:07:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:09.930+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:07:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:09.930+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:07:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:09.930+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:07:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:09.930+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:07:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:09.930+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:07:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:10 smithi136 ceph-mon[125702]: pgmap v4149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:07:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:10 smithi057 ceph-mon[92072]: pgmap v4149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:07:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:10 smithi122 ceph-mon[125440]: pgmap v4149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:07:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:11 smithi136 ceph-mon[125702]: osdmap e331: 12 total, 12 up, 12 in 2023-03-02T13:07:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:11 smithi057 ceph-mon[92072]: osdmap e331: 12 total, 12 up, 12 in 2023-03-02T13:07:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:11 smithi122 ceph-mon[125440]: osdmap e331: 12 total, 12 up, 12 in 2023-03-02T13:07:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:12 smithi136 ceph-mon[125702]: pgmap v4151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:07:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:07:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:12 smithi057 ceph-mon[92072]: pgmap v4151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:07:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:07:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:12 smithi122 ceph-mon[125440]: pgmap v4151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:07:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:07:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:07:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:07:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:07:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:07:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:07:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:07:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:07:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:07:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:07:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:14 smithi136 ceph-mon[125702]: pgmap v4152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:07:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:14 smithi057 ceph-mon[92072]: pgmap v4152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:07:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:14 smithi122 ceph-mon[125440]: pgmap v4152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:07:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:16 smithi136 ceph-mon[125702]: pgmap v4153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:07:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:16 smithi136 ceph-mon[125702]: osdmap e332: 12 total, 12 up, 12 in 2023-03-02T13:07:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:16 smithi057 ceph-mon[92072]: pgmap v4153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:07:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:16 smithi057 ceph-mon[92072]: osdmap e332: 12 total, 12 up, 12 in 2023-03-02T13:07:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:16 smithi122 ceph-mon[125440]: pgmap v4153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:07:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:16 smithi122 ceph-mon[125440]: osdmap e332: 12 total, 12 up, 12 in 2023-03-02T13:07:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:18 smithi136 ceph-mon[125702]: pgmap v4155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:07:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:18 smithi057 ceph-mon[92072]: pgmap v4155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:07:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:18 smithi122 ceph-mon[125440]: pgmap v4155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:07:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:20 smithi136 ceph-mon[125702]: pgmap v4156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T13:07:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:20 smithi057 ceph-mon[92072]: pgmap v4156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T13:07:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:20 smithi122 ceph-mon[125440]: pgmap v4156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T13:07:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:22 smithi136 ceph-mon[125702]: pgmap v4157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:07:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:22 smithi057 ceph-mon[92072]: pgmap v4157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:07:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:22 smithi122 ceph-mon[125440]: pgmap v4157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:07:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:24 smithi136 ceph-mon[125702]: pgmap v4158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:07:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:24 smithi057 ceph-mon[92072]: pgmap v4158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:07:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:24 smithi122 ceph-mon[125440]: pgmap v4158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:07:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:24.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:07:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:24.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:07:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:24.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:07:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:24.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:07:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:24.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:07:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:26 smithi136 ceph-mon[125702]: pgmap v4159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:07:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:26 smithi057 ceph-mon[92072]: pgmap v4159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:07:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:26 smithi122 ceph-mon[125440]: pgmap v4159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:07:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:28 smithi136 ceph-mon[125702]: pgmap v4160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:07:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:28 smithi057 ceph-mon[92072]: pgmap v4160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:07:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:28 smithi122 ceph-mon[125440]: pgmap v4160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:07:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:30 smithi136 ceph-mon[125702]: pgmap v4161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:30 smithi057 ceph-mon[92072]: pgmap v4161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:30 smithi122 ceph-mon[125440]: pgmap v4161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:32 smithi136 ceph-mon[125702]: pgmap v4162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:32 smithi057 ceph-mon[92072]: pgmap v4162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:32 smithi122 ceph-mon[125440]: pgmap v4162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:34 smithi136 ceph-mon[125702]: pgmap v4163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:34 smithi057 ceph-mon[92072]: pgmap v4163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:34 smithi122 ceph-mon[125440]: pgmap v4163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:36 smithi136 ceph-mon[125702]: pgmap v4164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:36 smithi057 ceph-mon[92072]: pgmap v4164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:36 smithi122 ceph-mon[125440]: pgmap v4164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:38 smithi136 ceph-mon[125702]: pgmap v4165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:38 smithi057 ceph-mon[92072]: pgmap v4165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:38 smithi122 ceph-mon[125440]: pgmap v4165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:39.955 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:39.954+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:07:39.955 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:39.954+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:07:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:39.954+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:07:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:39.954+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:07:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:39.955+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:07:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:40 smithi057 ceph-mon[92072]: pgmap v4166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:40 smithi122 ceph-mon[125440]: pgmap v4166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:40 smithi136 ceph-mon[125702]: pgmap v4166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:42 smithi057 ceph-mon[92072]: pgmap v4167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:42 smithi122 ceph-mon[125440]: pgmap v4167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:42 smithi136 ceph-mon[125702]: pgmap v4167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:44 smithi057 ceph-mon[92072]: pgmap v4168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:44 smithi122 ceph-mon[125440]: pgmap v4168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:44 smithi136 ceph-mon[125702]: pgmap v4168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:46 smithi057 ceph-mon[92072]: pgmap v4169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:46 smithi122 ceph-mon[125440]: pgmap v4169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:46 smithi136 ceph-mon[125702]: pgmap v4169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:48 smithi057 ceph-mon[92072]: pgmap v4170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:48 smithi122 ceph-mon[125440]: pgmap v4170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:48 smithi136 ceph-mon[125702]: pgmap v4170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:50 smithi057 ceph-mon[92072]: pgmap v4171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:50 smithi122 ceph-mon[125440]: pgmap v4171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:50 smithi136 ceph-mon[125702]: pgmap v4171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:52 smithi057 ceph-mon[92072]: pgmap v4172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:52 smithi122 ceph-mon[125440]: pgmap v4172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:52 smithi136 ceph-mon[125702]: pgmap v4172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:54 smithi057 ceph-mon[92072]: pgmap v4173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:54 smithi122 ceph-mon[125440]: pgmap v4173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:54 smithi136 ceph-mon[125702]: pgmap v4173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:54.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:54.970+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:07:54.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:54.971+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:07:54.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:54.971+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:07:54.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:54.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:07:54.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:07:54.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:07:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:56 smithi057 ceph-mon[92072]: pgmap v4174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:56 smithi122 ceph-mon[125440]: pgmap v4174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:56 smithi136 ceph-mon[125702]: pgmap v4174: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:07:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:07:58 smithi057 ceph-mon[92072]: pgmap v4175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:07:58 smithi122 ceph-mon[125440]: pgmap v4175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:07:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:07:58 smithi136 ceph-mon[125702]: pgmap v4175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:00 smithi057 ceph-mon[92072]: pgmap v4176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:00 smithi122 ceph-mon[125440]: pgmap v4176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:00 smithi136 ceph-mon[125702]: pgmap v4176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:02 smithi057 ceph-mon[92072]: pgmap v4177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:02 smithi122 ceph-mon[125440]: pgmap v4177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:02 smithi136 ceph-mon[125702]: pgmap v4177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:04 smithi057 ceph-mon[92072]: pgmap v4178: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:08:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:04 smithi122 ceph-mon[125440]: pgmap v4178: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:08:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:04 smithi136 ceph-mon[125702]: pgmap v4178: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:08:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:06 smithi057 ceph-mon[92072]: pgmap v4179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:08:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:06 smithi122 ceph-mon[125440]: pgmap v4179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:08:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:06 smithi136 ceph-mon[125702]: pgmap v4179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:08:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:08 smithi057 ceph-mon[92072]: pgmap v4180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:08:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:08 smithi122 ceph-mon[125440]: pgmap v4180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:08:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:08 smithi136 ceph-mon[125702]: pgmap v4180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:08:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:09.463+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:08:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:09.463+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:08:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:09.464+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 64 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:08:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:09.464+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 63 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:08:09.986 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:09.985+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:08:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:09.985+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:08:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:09.985+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:08:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:09.985+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:08:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:09.985+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:08:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:10 smithi057 ceph-mon[92072]: pgmap v4181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:08:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:10 smithi122 ceph-mon[125440]: pgmap v4181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:08:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:10 smithi136 ceph-mon[125702]: pgmap v4181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:08:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:11 smithi057 ceph-mon[92072]: osdmap e333: 12 total, 12 up, 12 in 2023-03-02T13:08:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:11 smithi122 ceph-mon[125440]: osdmap e333: 12 total, 12 up, 12 in 2023-03-02T13:08:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:11 smithi136 ceph-mon[125702]: osdmap e333: 12 total, 12 up, 12 in 2023-03-02T13:08:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:12 smithi057 ceph-mon[92072]: pgmap v4183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:08:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:12 smithi122 ceph-mon[125440]: pgmap v4183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:08:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:12 smithi136 ceph-mon[125702]: pgmap v4183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:08:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:08:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:08:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:08:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:14 smithi122 ceph-mon[125440]: pgmap v4184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:08:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:08:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:08:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:08:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:14 smithi136 ceph-mon[125702]: pgmap v4184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:08:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:08:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:08:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:08:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:14 smithi057 ceph-mon[92072]: pgmap v4184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:08:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:08:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:08:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:08:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:16 smithi122 ceph-mon[125440]: pgmap v4185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:08:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:16 smithi122 ceph-mon[125440]: osdmap e334: 12 total, 12 up, 12 in 2023-03-02T13:08:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:16 smithi136 ceph-mon[125702]: pgmap v4185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:08:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:16 smithi136 ceph-mon[125702]: osdmap e334: 12 total, 12 up, 12 in 2023-03-02T13:08:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:16 smithi057 ceph-mon[92072]: pgmap v4185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:08:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:16 smithi057 ceph-mon[92072]: osdmap e334: 12 total, 12 up, 12 in 2023-03-02T13:08:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:18 smithi122 ceph-mon[125440]: pgmap v4187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:08:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:18 smithi136 ceph-mon[125702]: pgmap v4187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:08:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:18 smithi057 ceph-mon[92072]: pgmap v4187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:08:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:20 smithi136 ceph-mon[125702]: pgmap v4188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T13:08:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:20 smithi057 ceph-mon[92072]: pgmap v4188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T13:08:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:20 smithi122 ceph-mon[125440]: pgmap v4188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T13:08:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:22 smithi136 ceph-mon[125702]: pgmap v4189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:08:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:22 smithi057 ceph-mon[92072]: pgmap v4189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:08:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:22 smithi122 ceph-mon[125440]: pgmap v4189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:08:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:24 smithi136 ceph-mon[125702]: pgmap v4190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:08:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:24 smithi057 ceph-mon[92072]: pgmap v4190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:08:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:24 smithi122 ceph-mon[125440]: pgmap v4190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:08:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:24.999+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:08:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:24.999+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:08:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:24.999+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:08:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:24.999+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:08:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:24.999+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:08:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:26 smithi136 ceph-mon[125702]: pgmap v4191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:08:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:26 smithi057 ceph-mon[92072]: pgmap v4191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:08:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:26 smithi122 ceph-mon[125440]: pgmap v4191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:08:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:28 smithi136 ceph-mon[125702]: pgmap v4192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:08:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:28 smithi057 ceph-mon[92072]: pgmap v4192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:08:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:28 smithi122 ceph-mon[125440]: pgmap v4192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:08:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:30 smithi136 ceph-mon[125702]: pgmap v4193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:30 smithi057 ceph-mon[92072]: pgmap v4193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:30 smithi122 ceph-mon[125440]: pgmap v4193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:32 smithi136 ceph-mon[125702]: pgmap v4194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:32 smithi057 ceph-mon[92072]: pgmap v4194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:32 smithi122 ceph-mon[125440]: pgmap v4194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:34 smithi136 ceph-mon[125702]: pgmap v4195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:34 smithi057 ceph-mon[92072]: pgmap v4195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:34 smithi122 ceph-mon[125440]: pgmap v4195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:36 smithi136 ceph-mon[125702]: pgmap v4196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:36 smithi057 ceph-mon[92072]: pgmap v4196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:36 smithi122 ceph-mon[125440]: pgmap v4196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:38 smithi136 ceph-mon[125702]: pgmap v4197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:38 smithi057 ceph-mon[92072]: pgmap v4197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:38 smithi122 ceph-mon[125440]: pgmap v4197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:40.012+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:08:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:40.013+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:08:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:40.013+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:08:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:40.013+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:08:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:40.013+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:08:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:40 smithi136 ceph-mon[125702]: pgmap v4198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:40 smithi057 ceph-mon[92072]: pgmap v4198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:40 smithi122 ceph-mon[125440]: pgmap v4198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:42 smithi136 ceph-mon[125702]: pgmap v4199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:42 smithi057 ceph-mon[92072]: pgmap v4199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:42 smithi122 ceph-mon[125440]: pgmap v4199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:44 smithi136 ceph-mon[125702]: pgmap v4200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:44 smithi057 ceph-mon[92072]: pgmap v4200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:44 smithi122 ceph-mon[125440]: pgmap v4200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:46 smithi136 ceph-mon[125702]: pgmap v4201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:46 smithi057 ceph-mon[92072]: pgmap v4201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:46 smithi122 ceph-mon[125440]: pgmap v4201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:48 smithi136 ceph-mon[125702]: pgmap v4202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:48 smithi057 ceph-mon[92072]: pgmap v4202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:48 smithi122 ceph-mon[125440]: pgmap v4202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:50 smithi136 ceph-mon[125702]: pgmap v4203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:50 smithi057 ceph-mon[92072]: pgmap v4203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:50 smithi122 ceph-mon[125440]: pgmap v4203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:52 smithi136 ceph-mon[125702]: pgmap v4204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:52 smithi057 ceph-mon[92072]: pgmap v4204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:52 smithi122 ceph-mon[125440]: pgmap v4204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:54 smithi136 ceph-mon[125702]: pgmap v4205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:54 smithi057 ceph-mon[92072]: pgmap v4205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:54 smithi122 ceph-mon[125440]: pgmap v4205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:55.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:08:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:55.029+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:08:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:55.029+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:08:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:55.029+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:08:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:08:55.029+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:08:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:56 smithi136 ceph-mon[125702]: pgmap v4206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:56 smithi057 ceph-mon[92072]: pgmap v4206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:56 smithi122 ceph-mon[125440]: pgmap v4206: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:08:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:08:58 smithi136 ceph-mon[125702]: pgmap v4207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:08:58 smithi057 ceph-mon[92072]: pgmap v4207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:08:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:08:58 smithi122 ceph-mon[125440]: pgmap v4207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:00 smithi136 ceph-mon[125702]: pgmap v4208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:09:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:00 smithi057 ceph-mon[92072]: pgmap v4208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:09:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:00 smithi122 ceph-mon[125440]: pgmap v4208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:09:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:02 smithi136 ceph-mon[125702]: pgmap v4209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:09:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:02 smithi057 ceph-mon[92072]: pgmap v4209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:09:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:02 smithi122 ceph-mon[125440]: pgmap v4209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:09:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:04 smithi136 ceph-mon[125702]: pgmap v4210: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T13:09:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:04 smithi057 ceph-mon[92072]: pgmap v4210: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T13:09:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:04 smithi122 ceph-mon[125440]: pgmap v4210: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T13:09:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:06 smithi136 ceph-mon[125702]: pgmap v4211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:09:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:06 smithi057 ceph-mon[92072]: pgmap v4211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:09:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:06 smithi122 ceph-mon[125440]: pgmap v4211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:09:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:08 smithi057 ceph-mon[92072]: pgmap v4212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:09:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:08 smithi122 ceph-mon[125440]: pgmap v4212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:09:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:08 smithi136 ceph-mon[125702]: pgmap v4212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:09:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:10.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:09:10.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:10.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:09:10.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:10.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:09:10.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:10.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:09:10.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:10.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:09:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:10 smithi057 ceph-mon[92072]: pgmap v4213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:09:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:10 smithi122 ceph-mon[125440]: pgmap v4213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:09:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:10 smithi136 ceph-mon[125702]: pgmap v4213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:09:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:11 smithi057 ceph-mon[92072]: osdmap e335: 12 total, 12 up, 12 in 2023-03-02T13:09:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:11 smithi122 ceph-mon[125440]: osdmap e335: 12 total, 12 up, 12 in 2023-03-02T13:09:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:11 smithi136 ceph-mon[125702]: osdmap e335: 12 total, 12 up, 12 in 2023-03-02T13:09:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:12 smithi057 ceph-mon[92072]: pgmap v4215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:09:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:12 smithi122 ceph-mon[125440]: pgmap v4215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:09:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:12 smithi136 ceph-mon[125702]: pgmap v4215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:09:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:14 smithi057 ceph-mon[92072]: pgmap v4216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:09:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:09:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:14 smithi122 ceph-mon[125440]: pgmap v4216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:09:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:09:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:14 smithi136 ceph-mon[125702]: pgmap v4216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:09:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:09:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:09:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:09:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:09:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:09:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:09:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:09:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:09:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:09:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:09:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:16 smithi057 ceph-mon[92072]: pgmap v4217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:09:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:16 smithi057 ceph-mon[92072]: osdmap e336: 12 total, 12 up, 12 in 2023-03-02T13:09:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:16 smithi122 ceph-mon[125440]: pgmap v4217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:09:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:16 smithi122 ceph-mon[125440]: osdmap e336: 12 total, 12 up, 12 in 2023-03-02T13:09:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:16 smithi136 ceph-mon[125702]: pgmap v4217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:09:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:16 smithi136 ceph-mon[125702]: osdmap e336: 12 total, 12 up, 12 in 2023-03-02T13:09:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:18 smithi057 ceph-mon[92072]: pgmap v4219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:09:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:18 smithi122 ceph-mon[125440]: pgmap v4219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:09:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:18 smithi136 ceph-mon[125702]: pgmap v4219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:09:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:20 smithi057 ceph-mon[92072]: pgmap v4220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T13:09:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:20 smithi122 ceph-mon[125440]: pgmap v4220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T13:09:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:20 smithi136 ceph-mon[125702]: pgmap v4220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T13:09:22.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:22 smithi057 ceph-mon[92072]: pgmap v4221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:09:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:22 smithi122 ceph-mon[125440]: pgmap v4221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:09:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:22 smithi136 ceph-mon[125702]: pgmap v4221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:09:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:24 smithi057 ceph-mon[92072]: pgmap v4222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:09:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:24 smithi122 ceph-mon[125440]: pgmap v4222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:09:25.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:25.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:09:25.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:25.034+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:09:25.037 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:25.034+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:09:25.037 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:25.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:09:25.037 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:25.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:09:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:24 smithi136 ceph-mon[125702]: pgmap v4222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:09:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:26 smithi057 ceph-mon[92072]: pgmap v4223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:09:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:26 smithi122 ceph-mon[125440]: pgmap v4223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:09:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:26 smithi136 ceph-mon[125702]: pgmap v4223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:09:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:28 smithi057 ceph-mon[92072]: pgmap v4224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:09:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:28 smithi122 ceph-mon[125440]: pgmap v4224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:09:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:28 smithi136 ceph-mon[125702]: pgmap v4224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:09:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:30 smithi057 ceph-mon[92072]: pgmap v4225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:30 smithi122 ceph-mon[125440]: pgmap v4225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:30 smithi136 ceph-mon[125702]: pgmap v4225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:32 smithi057 ceph-mon[92072]: pgmap v4226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:32 smithi122 ceph-mon[125440]: pgmap v4226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:32 smithi136 ceph-mon[125702]: pgmap v4226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:34 smithi122 ceph-mon[125440]: pgmap v4227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:34 smithi136 ceph-mon[125702]: pgmap v4227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:34 smithi057 ceph-mon[92072]: pgmap v4227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:36 smithi122 ceph-mon[125440]: pgmap v4228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:36 smithi136 ceph-mon[125702]: pgmap v4228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:36 smithi057 ceph-mon[92072]: pgmap v4228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:38 smithi122 ceph-mon[125440]: pgmap v4229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:38 smithi136 ceph-mon[125702]: pgmap v4229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:38 smithi057 ceph-mon[92072]: pgmap v4229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:40.051+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:09:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:40.051+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:09:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:40.051+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:09:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:40.051+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:09:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:40.051+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:09:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:40 smithi122 ceph-mon[125440]: pgmap v4230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:40 smithi136 ceph-mon[125702]: pgmap v4230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:40 smithi057 ceph-mon[92072]: pgmap v4230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:42 smithi122 ceph-mon[125440]: pgmap v4231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:42 smithi136 ceph-mon[125702]: pgmap v4231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:42 smithi057 ceph-mon[92072]: pgmap v4231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:45.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:44 smithi136 ceph-mon[125702]: pgmap v4232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:44 smithi057 ceph-mon[92072]: pgmap v4232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:44 smithi122 ceph-mon[125440]: pgmap v4232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:46 smithi136 ceph-mon[125702]: pgmap v4233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:46 smithi057 ceph-mon[92072]: pgmap v4233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:46 smithi122 ceph-mon[125440]: pgmap v4233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:48 smithi136 ceph-mon[125702]: pgmap v4234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:48 smithi057 ceph-mon[92072]: pgmap v4234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:48 smithi122 ceph-mon[125440]: pgmap v4234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:50 smithi136 ceph-mon[125702]: pgmap v4235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:50 smithi057 ceph-mon[92072]: pgmap v4235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:50 smithi122 ceph-mon[125440]: pgmap v4235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:52 smithi136 ceph-mon[125702]: pgmap v4236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:52 smithi057 ceph-mon[92072]: pgmap v4236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:52 smithi122 ceph-mon[125440]: pgmap v4236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:55.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:09:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:55.064+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:09:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:55.065+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:09:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:55.065+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:09:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:09:55.065+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:09:55.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:54 smithi136 ceph-mon[125702]: pgmap v4237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:54 smithi057 ceph-mon[92072]: pgmap v4237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:54 smithi122 ceph-mon[125440]: pgmap v4237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:56 smithi136 ceph-mon[125702]: pgmap v4238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:56 smithi057 ceph-mon[92072]: pgmap v4238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:56 smithi122 ceph-mon[125440]: pgmap v4238: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:09:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:09:58 smithi136 ceph-mon[125702]: pgmap v4239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:09:58 smithi057 ceph-mon[92072]: pgmap v4239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:09:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:09:58 smithi122 ceph-mon[125440]: pgmap v4239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:00 smithi136 ceph-mon[125702]: pgmap v4240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T13:10:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:00 smithi057 ceph-mon[92072]: pgmap v4240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T13:10:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:00 smithi122 ceph-mon[125440]: pgmap v4240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T13:10:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:02 smithi136 ceph-mon[125702]: pgmap v4241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:02 smithi057 ceph-mon[92072]: pgmap v4241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:02 smithi122 ceph-mon[125440]: pgmap v4241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:04 smithi136 ceph-mon[125702]: pgmap v4242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:10:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:04 smithi057 ceph-mon[92072]: pgmap v4242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:10:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:04 smithi122 ceph-mon[125440]: pgmap v4242: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:10:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:06 smithi136 ceph-mon[125702]: pgmap v4243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:10:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:06 smithi057 ceph-mon[92072]: pgmap v4243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:10:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:06 smithi122 ceph-mon[125440]: pgmap v4243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:10:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:08 smithi136 ceph-mon[125702]: pgmap v4244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:10:09.122 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:08 smithi122 ceph-mon[125440]: pgmap v4244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:10:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:08 smithi057 ceph-mon[92072]: pgmap v4244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:10:10.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:10.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:10:10.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:10.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:10:10.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:10.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:10:10.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:10.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:10:10.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:10.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:10:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:10 smithi136 ceph-mon[125702]: pgmap v4245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:10:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:10 smithi057 ceph-mon[92072]: pgmap v4245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:10:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:10 smithi122 ceph-mon[125440]: pgmap v4245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:10:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:11 smithi136 ceph-mon[125702]: osdmap e337: 12 total, 12 up, 12 in 2023-03-02T13:10:12.097 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:11 smithi057 ceph-mon[92072]: osdmap e337: 12 total, 12 up, 12 in 2023-03-02T13:10:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:11 smithi122 ceph-mon[125440]: osdmap e337: 12 total, 12 up, 12 in 2023-03-02T13:10:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:12 smithi136 ceph-mon[125702]: pgmap v4247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:10:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:12 smithi057 ceph-mon[92072]: pgmap v4247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:10:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:12 smithi122 ceph-mon[125440]: pgmap v4247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:10:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:14 smithi136 ceph-mon[125702]: pgmap v4248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:10:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:14 smithi057 ceph-mon[92072]: pgmap v4248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:10:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:14 smithi122 ceph-mon[125440]: pgmap v4248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:10:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:10:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:10:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:10:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:16 smithi136 ceph-mon[125702]: pgmap v4249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:10:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:10:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:10:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:10:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:16 smithi136 ceph-mon[125702]: osdmap e338: 12 total, 12 up, 12 in 2023-03-02T13:10:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:16 smithi057 ceph-mon[92072]: pgmap v4249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:10:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:10:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:10:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:10:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:16 smithi057 ceph-mon[92072]: osdmap e338: 12 total, 12 up, 12 in 2023-03-02T13:10:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:16 smithi122 ceph-mon[125440]: pgmap v4249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:10:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:10:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:10:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:10:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:16 smithi122 ceph-mon[125440]: osdmap e338: 12 total, 12 up, 12 in 2023-03-02T13:10:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:18 smithi136 ceph-mon[125702]: pgmap v4251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:10:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:18 smithi057 ceph-mon[92072]: pgmap v4251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:10:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:18 smithi122 ceph-mon[125440]: pgmap v4251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:10:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:20 smithi136 ceph-mon[125702]: pgmap v4252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 252 B/s wr, 12 op/s 2023-03-02T13:10:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:20 smithi057 ceph-mon[92072]: pgmap v4252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 252 B/s wr, 12 op/s 2023-03-02T13:10:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:20 smithi122 ceph-mon[125440]: pgmap v4252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 252 B/s wr, 12 op/s 2023-03-02T13:10:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:22 smithi136 ceph-mon[125702]: pgmap v4253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:10:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:22 smithi057 ceph-mon[92072]: pgmap v4253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:10:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:22 smithi122 ceph-mon[125440]: pgmap v4253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:10:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:25.083+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:10:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:25.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:10:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:25.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:10:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:25.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:10:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:25.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:10:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:24 smithi136 ceph-mon[125702]: pgmap v4254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:10:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:24 smithi057 ceph-mon[92072]: pgmap v4254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:10:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:24 smithi122 ceph-mon[125440]: pgmap v4254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:10:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:26 smithi136 ceph-mon[125702]: pgmap v4255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:10:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:26 smithi057 ceph-mon[92072]: pgmap v4255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:10:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:26 smithi122 ceph-mon[125440]: pgmap v4255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:10:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:28 smithi136 ceph-mon[125702]: pgmap v4256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:10:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:28 smithi057 ceph-mon[92072]: pgmap v4256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:10:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:28 smithi122 ceph-mon[125440]: pgmap v4256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:10:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:30 smithi057 ceph-mon[92072]: pgmap v4257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:30 smithi122 ceph-mon[125440]: pgmap v4257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:31.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:30 smithi136 ceph-mon[125702]: pgmap v4257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:32 smithi057 ceph-mon[92072]: pgmap v4258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:32 smithi122 ceph-mon[125440]: pgmap v4258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:32 smithi136 ceph-mon[125702]: pgmap v4258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:33 smithi057 ceph-mon[92072]: pgmap v4259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:33 smithi122 ceph-mon[125440]: pgmap v4259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:33 smithi136 ceph-mon[125702]: pgmap v4259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:35 smithi136 ceph-mon[125702]: pgmap v4260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:10:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:35 smithi057 ceph-mon[92072]: pgmap v4260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:10:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:35 smithi122 ceph-mon[125440]: pgmap v4260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:10:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:38 smithi136 ceph-mon[125702]: pgmap v4261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:38 smithi057 ceph-mon[92072]: pgmap v4261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:38 smithi122 ceph-mon[125440]: pgmap v4261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:40.098+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:10:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:40.099+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:10:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:40.099+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:10:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:40.099+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:10:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:40.099+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:10:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:40 smithi136 ceph-mon[125702]: pgmap v4262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:10:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:40 smithi057 ceph-mon[92072]: pgmap v4262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:10:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:40 smithi122 ceph-mon[125440]: pgmap v4262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:10:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:42 smithi136 ceph-mon[125702]: pgmap v4263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:10:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:42 smithi057 ceph-mon[92072]: pgmap v4263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:10:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:42 smithi122 ceph-mon[125440]: pgmap v4263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:10:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:44 smithi136 ceph-mon[125702]: pgmap v4264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:44 smithi057 ceph-mon[92072]: pgmap v4264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:44 smithi122 ceph-mon[125440]: pgmap v4264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:46 smithi136 ceph-mon[125702]: pgmap v4265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:46 smithi057 ceph-mon[92072]: pgmap v4265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:46 smithi122 ceph-mon[125440]: pgmap v4265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:48 smithi136 ceph-mon[125702]: pgmap v4266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:48 smithi057 ceph-mon[92072]: pgmap v4266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:48 smithi122 ceph-mon[125440]: pgmap v4266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:50 smithi136 ceph-mon[125702]: pgmap v4267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:50 smithi057 ceph-mon[92072]: pgmap v4267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:50 smithi122 ceph-mon[125440]: pgmap v4267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:52 smithi136 ceph-mon[125702]: pgmap v4268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:52 smithi057 ceph-mon[92072]: pgmap v4268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:52 smithi122 ceph-mon[125440]: pgmap v4268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:54 smithi136 ceph-mon[125702]: pgmap v4269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:54 smithi057 ceph-mon[92072]: pgmap v4269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:54 smithi122 ceph-mon[125440]: pgmap v4269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:55.110+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:10:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:55.110+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:10:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:55.110+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:10:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:55.110+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:10:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:10:55.110+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:10:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:56 smithi136 ceph-mon[125702]: pgmap v4270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:56 smithi057 ceph-mon[92072]: pgmap v4270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:56 smithi122 ceph-mon[125440]: pgmap v4270: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:10:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:10:58 smithi136 ceph-mon[125702]: pgmap v4271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:10:58 smithi057 ceph-mon[92072]: pgmap v4271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:10:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:10:58 smithi122 ceph-mon[125440]: pgmap v4271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:00 smithi136 ceph-mon[125702]: pgmap v4272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:00 smithi057 ceph-mon[92072]: pgmap v4272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:00 smithi122 ceph-mon[125440]: pgmap v4272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:02 smithi136 ceph-mon[125702]: pgmap v4273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:02 smithi057 ceph-mon[92072]: pgmap v4273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:02 smithi122 ceph-mon[125440]: pgmap v4273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:04 smithi136 ceph-mon[125702]: pgmap v4274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:11:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:04 smithi057 ceph-mon[92072]: pgmap v4274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:11:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:04 smithi122 ceph-mon[125440]: pgmap v4274: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:11:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:06 smithi136 ceph-mon[125702]: pgmap v4275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:11:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:06 smithi057 ceph-mon[92072]: pgmap v4275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:11:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:06 smithi122 ceph-mon[125440]: pgmap v4275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:11:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:08 smithi136 ceph-mon[125702]: pgmap v4276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:11:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:08 smithi057 ceph-mon[92072]: pgmap v4276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:11:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:08 smithi122 ceph-mon[125440]: pgmap v4276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:11:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:09.490+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:11:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:09.490+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:11:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:09.491+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 65 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:11:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:09.491+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 64 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:11:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:09.491+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:11:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:09.491+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:11:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:09.491+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 65 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:11:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:09.491+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 66 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:11:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:10.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:11:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:10.121+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:11:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:10.121+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:11:10.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:10.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:11:10.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:10.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:11:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:10 smithi136 ceph-mon[125702]: pgmap v4277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:11:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:10 smithi057 ceph-mon[92072]: pgmap v4277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:11:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:10 smithi122 ceph-mon[125440]: pgmap v4277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:11:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:12 smithi057 ceph-mon[92072]: pgmap v4278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:11:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:12 smithi057 ceph-mon[92072]: osdmap e339: 12 total, 12 up, 12 in 2023-03-02T13:11:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:12 smithi122 ceph-mon[125440]: pgmap v4278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:11:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:12 smithi122 ceph-mon[125440]: osdmap e339: 12 total, 12 up, 12 in 2023-03-02T13:11:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:12 smithi136 ceph-mon[125702]: pgmap v4278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:11:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:12 smithi136 ceph-mon[125702]: osdmap e339: 12 total, 12 up, 12 in 2023-03-02T13:11:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:14 smithi057 ceph-mon[92072]: pgmap v4280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:11:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:14 smithi122 ceph-mon[125440]: pgmap v4280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:11:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:14 smithi136 ceph-mon[125702]: pgmap v4280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:11:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:16 smithi057 ceph-mon[92072]: pgmap v4281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:11:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:16 smithi057 ceph-mon[92072]: osdmap e340: 12 total, 12 up, 12 in 2023-03-02T13:11:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:16 smithi122 ceph-mon[125440]: pgmap v4281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:11:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:16 smithi122 ceph-mon[125440]: osdmap e340: 12 total, 12 up, 12 in 2023-03-02T13:11:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:16 smithi136 ceph-mon[125702]: pgmap v4281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:11:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:16 smithi136 ceph-mon[125702]: osdmap e340: 12 total, 12 up, 12 in 2023-03-02T13:11:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:11:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:11:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:11:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:18 smithi057 ceph-mon[92072]: pgmap v4283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:11:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:18 smithi122 ceph-mon[125440]: pgmap v4283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:11:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:18 smithi136 ceph-mon[125702]: pgmap v4283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:11:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: pgmap v4284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:11:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: pgmap v4284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:11:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: pgmap v4284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:11:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:20.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:11:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:11:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:11:21.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:11:21.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:11:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:11:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:11:21.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:11:21.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:11:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:11:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:11:21.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:11:21.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:11:21.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:11:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:22 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:11:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:22 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:11:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:22 smithi122 ceph-mon[125440]: pgmap v4285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T13:11:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:22 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:11:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:22 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:11:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:22 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:11:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:22 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:11:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:22 smithi136 ceph-mon[125702]: pgmap v4285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T13:11:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:22 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:11:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:22 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:11:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:22 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:11:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:22 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:11:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:22 smithi057 ceph-mon[92072]: pgmap v4285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-02T13:11:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:22 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:11:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:22 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:11:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:24 smithi122 ceph-mon[125440]: pgmap v4286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:11:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:24 smithi136 ceph-mon[125702]: pgmap v4286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:11:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:24 smithi057 ceph-mon[92072]: pgmap v4286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:11:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:25.131+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:11:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:25.131+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:11:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:25.131+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:11:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:25.131+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:11:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:25.131+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:11:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:26 smithi122 ceph-mon[125440]: pgmap v4287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:11:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:26 smithi136 ceph-mon[125702]: pgmap v4287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:11:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:26 smithi057 ceph-mon[92072]: pgmap v4287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:11:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:28 smithi136 ceph-mon[125702]: pgmap v4288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:11:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:28 smithi057 ceph-mon[92072]: pgmap v4288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:11:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:28 smithi122 ceph-mon[125440]: pgmap v4288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:11:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:30 smithi136 ceph-mon[125702]: pgmap v4289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:30 smithi057 ceph-mon[92072]: pgmap v4289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:30 smithi122 ceph-mon[125440]: pgmap v4289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:32 smithi136 ceph-mon[125702]: pgmap v4290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:32 smithi057 ceph-mon[92072]: pgmap v4290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:32 smithi122 ceph-mon[125440]: pgmap v4290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:34 smithi136 ceph-mon[125702]: pgmap v4291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:34 smithi057 ceph-mon[92072]: pgmap v4291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:34 smithi122 ceph-mon[125440]: pgmap v4291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:36 smithi136 ceph-mon[125702]: pgmap v4292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:36 smithi057 ceph-mon[92072]: pgmap v4292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:36 smithi122 ceph-mon[125440]: pgmap v4292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:38 smithi136 ceph-mon[125702]: pgmap v4293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:38 smithi057 ceph-mon[92072]: pgmap v4293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:38 smithi122 ceph-mon[125440]: pgmap v4293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:40.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:11:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:40.139+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:11:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:40.139+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:11:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:40.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:11:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:40.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:11:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:40 smithi136 ceph-mon[125702]: pgmap v4294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:40 smithi057 ceph-mon[92072]: pgmap v4294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:40 smithi122 ceph-mon[125440]: pgmap v4294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:42 smithi136 ceph-mon[125702]: pgmap v4295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:42 smithi057 ceph-mon[92072]: pgmap v4295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:42 smithi122 ceph-mon[125440]: pgmap v4295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:44 smithi136 ceph-mon[125702]: pgmap v4296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:44 smithi057 ceph-mon[92072]: pgmap v4296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:44 smithi122 ceph-mon[125440]: pgmap v4296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:46 smithi136 ceph-mon[125702]: pgmap v4297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:46 smithi057 ceph-mon[92072]: pgmap v4297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:46 smithi122 ceph-mon[125440]: pgmap v4297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:48 smithi136 ceph-mon[125702]: pgmap v4298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:48 smithi057 ceph-mon[92072]: pgmap v4298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:48 smithi122 ceph-mon[125440]: pgmap v4298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:50 smithi136 ceph-mon[125702]: pgmap v4299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:50 smithi057 ceph-mon[92072]: pgmap v4299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:50 smithi122 ceph-mon[125440]: pgmap v4299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:52 smithi136 ceph-mon[125702]: pgmap v4300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:52 smithi057 ceph-mon[92072]: pgmap v4300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:52 smithi122 ceph-mon[125440]: pgmap v4300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:54 smithi136 ceph-mon[125702]: pgmap v4301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:54 smithi057 ceph-mon[92072]: pgmap v4301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:54 smithi122 ceph-mon[125440]: pgmap v4301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:55.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:11:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:55.156+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:11:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:55.156+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:11:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:55.156+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:11:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:11:55.156+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:11:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:56 smithi136 ceph-mon[125702]: pgmap v4302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:56 smithi057 ceph-mon[92072]: pgmap v4302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:56 smithi122 ceph-mon[125440]: pgmap v4302: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:11:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:11:58 smithi136 ceph-mon[125702]: pgmap v4303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:11:58 smithi057 ceph-mon[92072]: pgmap v4303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:11:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:11:58 smithi122 ceph-mon[125440]: pgmap v4303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:00 smithi136 ceph-mon[125702]: pgmap v4304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:00 smithi057 ceph-mon[92072]: pgmap v4304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:00 smithi122 ceph-mon[125440]: pgmap v4304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:02 smithi136 ceph-mon[125702]: pgmap v4305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:02 smithi057 ceph-mon[92072]: pgmap v4305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:02 smithi122 ceph-mon[125440]: pgmap v4305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:04 smithi136 ceph-mon[125702]: pgmap v4306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:12:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:04 smithi057 ceph-mon[92072]: pgmap v4306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:12:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:04 smithi122 ceph-mon[125440]: pgmap v4306: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:12:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:06 smithi136 ceph-mon[125702]: pgmap v4307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:12:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:06 smithi057 ceph-mon[92072]: pgmap v4307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:12:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:06 smithi122 ceph-mon[125440]: pgmap v4307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:12:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:08 smithi136 ceph-mon[125702]: pgmap v4308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:12:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:08 smithi057 ceph-mon[92072]: pgmap v4308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:12:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:08 smithi122 ceph-mon[125440]: pgmap v4308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:12:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:10.162+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:12:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:10.162+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:12:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:10.162+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:12:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:10.162+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:12:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:10.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:12:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:10 smithi057 ceph-mon[92072]: pgmap v4309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:12:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:10 smithi122 ceph-mon[125440]: pgmap v4309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:12:11.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:10 smithi136 ceph-mon[125702]: pgmap v4309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:12:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:11 smithi057 ceph-mon[92072]: osdmap e341: 12 total, 12 up, 12 in 2023-03-02T13:12:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:11 smithi122 ceph-mon[125440]: osdmap e341: 12 total, 12 up, 12 in 2023-03-02T13:12:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:11 smithi136 ceph-mon[125702]: osdmap e341: 12 total, 12 up, 12 in 2023-03-02T13:12:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:12 smithi057 ceph-mon[92072]: pgmap v4311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:12:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:12 smithi122 ceph-mon[125440]: pgmap v4311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:12:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:12 smithi136 ceph-mon[125702]: pgmap v4311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:12:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:14 smithi057 ceph-mon[92072]: pgmap v4312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:12:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:14 smithi122 ceph-mon[125440]: pgmap v4312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:12:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:14 smithi136 ceph-mon[125702]: pgmap v4312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:12:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:16 smithi057 ceph-mon[92072]: pgmap v4313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:12:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:16 smithi057 ceph-mon[92072]: osdmap e342: 12 total, 12 up, 12 in 2023-03-02T13:12:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:16 smithi122 ceph-mon[125440]: pgmap v4313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:12:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:16 smithi122 ceph-mon[125440]: osdmap e342: 12 total, 12 up, 12 in 2023-03-02T13:12:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:16 smithi136 ceph-mon[125702]: pgmap v4313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:12:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:16 smithi136 ceph-mon[125702]: osdmap e342: 12 total, 12 up, 12 in 2023-03-02T13:12:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:18 smithi057 ceph-mon[92072]: pgmap v4315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:12:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:18 smithi122 ceph-mon[125440]: pgmap v4315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:12:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:18 smithi136 ceph-mon[125702]: pgmap v4315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:12:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:20 smithi057 ceph-mon[92072]: pgmap v4316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:12:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:20 smithi122 ceph-mon[125440]: pgmap v4316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:12:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:20 smithi136 ceph-mon[125702]: pgmap v4316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:12:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:22 smithi136 ceph-mon[125702]: pgmap v4317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:12:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:12:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:12:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:12:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:12:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:22 smithi057 ceph-mon[92072]: pgmap v4317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:12:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:12:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:12:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:12:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:12:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:22 smithi122 ceph-mon[125440]: pgmap v4317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:12:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:12:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:12:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:12:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:12:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:24 smithi136 ceph-mon[125702]: pgmap v4318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:12:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:24 smithi057 ceph-mon[92072]: pgmap v4318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:12:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:24 smithi122 ceph-mon[125440]: pgmap v4318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:12:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:25.178+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:12:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:25.178+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:12:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:25.178+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:12:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:25.178+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:12:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:25.178+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:12:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:26 smithi136 ceph-mon[125702]: pgmap v4319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:12:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:26 smithi057 ceph-mon[92072]: pgmap v4319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:12:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:26 smithi122 ceph-mon[125440]: pgmap v4319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:12:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:28 smithi136 ceph-mon[125702]: pgmap v4320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:12:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:28 smithi057 ceph-mon[92072]: pgmap v4320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:12:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:28 smithi122 ceph-mon[125440]: pgmap v4320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:12:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:30 smithi136 ceph-mon[125702]: pgmap v4321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:30 smithi057 ceph-mon[92072]: pgmap v4321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:30 smithi122 ceph-mon[125440]: pgmap v4321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:32 smithi136 ceph-mon[125702]: pgmap v4322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:32 smithi057 ceph-mon[92072]: pgmap v4322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:32 smithi122 ceph-mon[125440]: pgmap v4322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:34 smithi136 ceph-mon[125702]: pgmap v4323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:34 smithi057 ceph-mon[92072]: pgmap v4323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:34 smithi122 ceph-mon[125440]: pgmap v4323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:36 smithi136 ceph-mon[125702]: pgmap v4324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:36 smithi057 ceph-mon[92072]: pgmap v4324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:36 smithi122 ceph-mon[125440]: pgmap v4324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:38 smithi136 ceph-mon[125702]: pgmap v4325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:38 smithi057 ceph-mon[92072]: pgmap v4325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:38 smithi122 ceph-mon[125440]: pgmap v4325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:40.187+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:12:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:40.187+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:12:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:40.187+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:12:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:40.187+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:12:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:40.187+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:12:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:40 smithi136 ceph-mon[125702]: pgmap v4326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:40 smithi057 ceph-mon[92072]: pgmap v4326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:40 smithi122 ceph-mon[125440]: pgmap v4326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:42 smithi057 ceph-mon[92072]: pgmap v4327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:42 smithi122 ceph-mon[125440]: pgmap v4327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:42 smithi136 ceph-mon[125702]: pgmap v4327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:44 smithi057 ceph-mon[92072]: pgmap v4328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:44 smithi122 ceph-mon[125440]: pgmap v4328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:44 smithi136 ceph-mon[125702]: pgmap v4328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:46 smithi057 ceph-mon[92072]: pgmap v4329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:46 smithi122 ceph-mon[125440]: pgmap v4329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:46 smithi136 ceph-mon[125702]: pgmap v4329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:48 smithi057 ceph-mon[92072]: pgmap v4330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:48 smithi122 ceph-mon[125440]: pgmap v4330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:48 smithi136 ceph-mon[125702]: pgmap v4330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:50 smithi057 ceph-mon[92072]: pgmap v4331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:50 smithi122 ceph-mon[125440]: pgmap v4331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:50 smithi136 ceph-mon[125702]: pgmap v4331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:52 smithi057 ceph-mon[92072]: pgmap v4332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:52 smithi122 ceph-mon[125440]: pgmap v4332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:52 smithi136 ceph-mon[125702]: pgmap v4332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:54 smithi057 ceph-mon[92072]: pgmap v4333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:54 smithi122 ceph-mon[125440]: pgmap v4333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:54 smithi136 ceph-mon[125702]: pgmap v4333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:55.201+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:12:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:55.201+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:12:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:55.201+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:12:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:55.201+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:12:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:12:55.201+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:12:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:56 smithi057 ceph-mon[92072]: pgmap v4334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:56 smithi122 ceph-mon[125440]: pgmap v4334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:56 smithi136 ceph-mon[125702]: pgmap v4334: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:12:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:12:58 smithi057 ceph-mon[92072]: pgmap v4335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:12:58 smithi122 ceph-mon[125440]: pgmap v4335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:12:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:12:58 smithi136 ceph-mon[125702]: pgmap v4335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:00 smithi057 ceph-mon[92072]: pgmap v4336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:00 smithi122 ceph-mon[125440]: pgmap v4336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:00 smithi136 ceph-mon[125702]: pgmap v4336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:02 smithi057 ceph-mon[92072]: pgmap v4337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:02 smithi122 ceph-mon[125440]: pgmap v4337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:02 smithi136 ceph-mon[125702]: pgmap v4337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:04 smithi057 ceph-mon[92072]: pgmap v4338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:13:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:04 smithi122 ceph-mon[125440]: pgmap v4338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:13:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:04 smithi136 ceph-mon[125702]: pgmap v4338: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:13:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:06 smithi057 ceph-mon[92072]: pgmap v4339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:13:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:06 smithi122 ceph-mon[125440]: pgmap v4339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:13:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:06 smithi136 ceph-mon[125702]: pgmap v4339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:13:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:08 smithi057 ceph-mon[92072]: pgmap v4340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:13:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:08 smithi122 ceph-mon[125440]: pgmap v4340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:13:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:08 smithi136 ceph-mon[125702]: pgmap v4340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:13:10.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:10.217+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:13:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:10.218+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:13:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:10.218+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:13:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:10.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:13:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:10.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:13:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:10 smithi057 ceph-mon[92072]: pgmap v4341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:13:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:10 smithi122 ceph-mon[125440]: pgmap v4341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:13:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:10 smithi136 ceph-mon[125702]: pgmap v4341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:13:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:12 smithi057 ceph-mon[92072]: pgmap v4342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:13:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:12 smithi057 ceph-mon[92072]: osdmap e343: 12 total, 12 up, 12 in 2023-03-02T13:13:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:12 smithi122 ceph-mon[125440]: pgmap v4342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:13:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:12 smithi122 ceph-mon[125440]: osdmap e343: 12 total, 12 up, 12 in 2023-03-02T13:13:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:12 smithi136 ceph-mon[125702]: pgmap v4342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:13:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:12 smithi136 ceph-mon[125702]: osdmap e343: 12 total, 12 up, 12 in 2023-03-02T13:13:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:14 smithi122 ceph-mon[125440]: pgmap v4344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:13:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:14 smithi136 ceph-mon[125702]: pgmap v4344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:13:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:14 smithi057 ceph-mon[92072]: pgmap v4344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:13:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:16 smithi122 ceph-mon[125440]: pgmap v4345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:13:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:16 smithi122 ceph-mon[125440]: osdmap e344: 12 total, 12 up, 12 in 2023-03-02T13:13:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:16 smithi136 ceph-mon[125702]: pgmap v4345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:13:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:16 smithi136 ceph-mon[125702]: osdmap e344: 12 total, 12 up, 12 in 2023-03-02T13:13:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:16 smithi057 ceph-mon[92072]: pgmap v4345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:13:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:16 smithi057 ceph-mon[92072]: osdmap e344: 12 total, 12 up, 12 in 2023-03-02T13:13:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:18 smithi122 ceph-mon[125440]: pgmap v4347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:13:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:18 smithi136 ceph-mon[125702]: pgmap v4347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:13:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:18 smithi057 ceph-mon[92072]: pgmap v4347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:13:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:20 smithi136 ceph-mon[125702]: pgmap v4348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:13:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:20 smithi057 ceph-mon[92072]: pgmap v4348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:13:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:20 smithi122 ceph-mon[125440]: pgmap v4348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:13:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:22 smithi136 ceph-mon[125702]: pgmap v4349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:13:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:13:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:22 smithi057 ceph-mon[92072]: pgmap v4349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:13:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:13:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:22 smithi122 ceph-mon[125440]: pgmap v4349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:13:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:13:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:13:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:13:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:13:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:13:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:13:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:13:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:24 smithi136 ceph-mon[125702]: pgmap v4350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:13:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:13:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:13:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:13:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:24 smithi057 ceph-mon[92072]: pgmap v4350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:13:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:13:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:13:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:13:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:24 smithi122 ceph-mon[125440]: pgmap v4350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:13:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:13:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:13:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:13:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:25.224+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:13:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:25.224+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:13:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:25.224+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:13:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:25.224+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:13:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:25.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:13:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:26 smithi136 ceph-mon[125702]: pgmap v4351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:13:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:26 smithi057 ceph-mon[92072]: pgmap v4351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:13:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:26 smithi122 ceph-mon[125440]: pgmap v4351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:13:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:28 smithi136 ceph-mon[125702]: pgmap v4352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:13:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:28 smithi057 ceph-mon[92072]: pgmap v4352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:13:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:28 smithi122 ceph-mon[125440]: pgmap v4352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 93 B/s wr, 13 op/s 2023-03-02T13:13:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:30 smithi136 ceph-mon[125702]: pgmap v4353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:30 smithi057 ceph-mon[92072]: pgmap v4353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:30 smithi122 ceph-mon[125440]: pgmap v4353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:32 smithi136 ceph-mon[125702]: pgmap v4354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:32 smithi057 ceph-mon[92072]: pgmap v4354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:32 smithi122 ceph-mon[125440]: pgmap v4354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:34 smithi136 ceph-mon[125702]: pgmap v4355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:34 smithi057 ceph-mon[92072]: pgmap v4355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:34 smithi122 ceph-mon[125440]: pgmap v4355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:36 smithi136 ceph-mon[125702]: pgmap v4356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:36 smithi057 ceph-mon[92072]: pgmap v4356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:36 smithi122 ceph-mon[125440]: pgmap v4356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:38 smithi136 ceph-mon[125702]: pgmap v4357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:38 smithi057 ceph-mon[92072]: pgmap v4357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:38 smithi122 ceph-mon[125440]: pgmap v4357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:40.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:40.236+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:13:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:40.237+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:13:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:40.237+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:13:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:40.237+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:13:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:40.237+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:13:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:40 smithi136 ceph-mon[125702]: pgmap v4358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:40 smithi057 ceph-mon[92072]: pgmap v4358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:40 smithi122 ceph-mon[125440]: pgmap v4358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:42 smithi136 ceph-mon[125702]: pgmap v4359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:42 smithi057 ceph-mon[92072]: pgmap v4359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:42 smithi122 ceph-mon[125440]: pgmap v4359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:44 smithi136 ceph-mon[125702]: pgmap v4360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:44 smithi057 ceph-mon[92072]: pgmap v4360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:44 smithi122 ceph-mon[125440]: pgmap v4360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:46 smithi136 ceph-mon[125702]: pgmap v4361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:46 smithi057 ceph-mon[92072]: pgmap v4361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:46 smithi122 ceph-mon[125440]: pgmap v4361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:48 smithi136 ceph-mon[125702]: pgmap v4362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:48 smithi057 ceph-mon[92072]: pgmap v4362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:48 smithi122 ceph-mon[125440]: pgmap v4362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:50 smithi136 ceph-mon[125702]: pgmap v4363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:50 smithi057 ceph-mon[92072]: pgmap v4363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:50 smithi122 ceph-mon[125440]: pgmap v4363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:52 smithi136 ceph-mon[125702]: pgmap v4364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:52 smithi057 ceph-mon[92072]: pgmap v4364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:52 smithi122 ceph-mon[125440]: pgmap v4364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:54 smithi136 ceph-mon[125702]: pgmap v4365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:54 smithi057 ceph-mon[92072]: pgmap v4365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:54 smithi122 ceph-mon[125440]: pgmap v4365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:55.247+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:13:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:55.247+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:13:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:55.247+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:13:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:55.247+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:13:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:13:55.247+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:13:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:56 smithi136 ceph-mon[125702]: pgmap v4366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:56 smithi057 ceph-mon[92072]: pgmap v4366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:56 smithi122 ceph-mon[125440]: pgmap v4366: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:13:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:13:58 smithi136 ceph-mon[125702]: pgmap v4367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:13:58 smithi057 ceph-mon[92072]: pgmap v4367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:13:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:13:58 smithi122 ceph-mon[125440]: pgmap v4367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:00 smithi136 ceph-mon[125702]: pgmap v4368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:00 smithi057 ceph-mon[92072]: pgmap v4368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:00 smithi122 ceph-mon[125440]: pgmap v4368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:02 smithi136 ceph-mon[125702]: pgmap v4369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:02 smithi057 ceph-mon[92072]: pgmap v4369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:02 smithi122 ceph-mon[125440]: pgmap v4369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:04 smithi136 ceph-mon[125702]: pgmap v4370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:14:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:04 smithi057 ceph-mon[92072]: pgmap v4370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:14:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:04 smithi122 ceph-mon[125440]: pgmap v4370: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:14:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:06 smithi057 ceph-mon[92072]: pgmap v4371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:14:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:06 smithi057 ceph-mon[92072]: osdmap e345: 12 total, 12 up, 12 in 2023-03-02T13:14:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:06 smithi122 ceph-mon[125440]: pgmap v4371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:14:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:06 smithi122 ceph-mon[125440]: osdmap e345: 12 total, 12 up, 12 in 2023-03-02T13:14:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:06 smithi136 ceph-mon[125702]: pgmap v4371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:14:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:06 smithi136 ceph-mon[125702]: osdmap e345: 12 total, 12 up, 12 in 2023-03-02T13:14:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:08.385+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T13:14:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:08.385+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T13:14:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:08.385+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f58500067d0 tx=0x7f5870082000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:14:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:08.385+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f58500067d0 tx=0x7f5870082000 comp rx=0 tx=0).stop 2023-03-02T13:14:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:08.385+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T13:14:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:08.385+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T13:14:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:08.385+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T13:14:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:08.385+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T13:14:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:08.385+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:14:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:08.386+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870063000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T13:14:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:08 smithi057 ceph-mon[92072]: pgmap v4373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:14:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:08 smithi122 ceph-mon[125440]: pgmap v4373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:14:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:08 smithi136 ceph-mon[125702]: pgmap v4373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:14:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:09.517+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:14:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:09.517+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:14:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:09.517+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 66 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:14:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:09.517+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 67 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:14:10.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:10.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:14:10.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:10.261+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:14:10.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:10.261+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:14:10.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:10.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:14:10.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:10.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:14:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:10 smithi057 ceph-mon[92072]: pgmap v4374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:14:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:10 smithi122 ceph-mon[125440]: pgmap v4374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:14:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:10 smithi136 ceph-mon[125702]: pgmap v4374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:14:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:12 smithi136 ceph-mon[125702]: pgmap v4375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:14:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:12 smithi136 ceph-mon[125702]: osdmap e346: 12 total, 12 up, 12 in 2023-03-02T13:14:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:12 smithi057 ceph-mon[92072]: pgmap v4375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:14:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:12 smithi057 ceph-mon[92072]: osdmap e346: 12 total, 12 up, 12 in 2023-03-02T13:14:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:12 smithi122 ceph-mon[125440]: pgmap v4375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:14:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:12 smithi122 ceph-mon[125440]: osdmap e346: 12 total, 12 up, 12 in 2023-03-02T13:14:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:14 smithi136 ceph-mon[125702]: pgmap v4377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:14:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:14 smithi057 ceph-mon[92072]: pgmap v4377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:14:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:14 smithi122 ceph-mon[125440]: pgmap v4377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:14:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:16 smithi057 ceph-mon[92072]: pgmap v4378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 224 B/s wr, 11 op/s 2023-03-02T13:14:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:16 smithi122 ceph-mon[125440]: pgmap v4378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 224 B/s wr, 11 op/s 2023-03-02T13:14:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:16 smithi136 ceph-mon[125702]: pgmap v4378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 224 B/s wr, 11 op/s 2023-03-02T13:14:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:18 smithi057 ceph-mon[92072]: pgmap v4379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:14:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:18 smithi122 ceph-mon[125440]: pgmap v4379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:14:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:18 smithi136 ceph-mon[125702]: pgmap v4379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:14:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:20 smithi057 ceph-mon[92072]: pgmap v4380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:14:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:20 smithi122 ceph-mon[125440]: pgmap v4380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:14:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:20 smithi136 ceph-mon[125702]: pgmap v4380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:14:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:22 smithi057 ceph-mon[92072]: pgmap v4381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:14:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:22 smithi122 ceph-mon[125440]: pgmap v4381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:14:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:22 smithi136 ceph-mon[125702]: pgmap v4381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:14:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:24 smithi057 ceph-mon[92072]: pgmap v4382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:14:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:24 smithi122 ceph-mon[125440]: pgmap v4382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:14:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:24 smithi136 ceph-mon[125702]: pgmap v4382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:14:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:25.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:14:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:25.263+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:14:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:25.263+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:14:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:25.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:14:25.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:25.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:14:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:14:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:14:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:14:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:26 smithi136 ceph-mon[125702]: pgmap v4383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:14:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:14:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:26 smithi057 ceph-mon[92072]: pgmap v4383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:14:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:14:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:26 smithi122 ceph-mon[125440]: pgmap v4383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:14:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:14:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:14:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:28 smithi136 ceph-mon[125702]: pgmap v4384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:28 smithi057 ceph-mon[92072]: pgmap v4384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:28 smithi122 ceph-mon[125440]: pgmap v4384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:30 smithi136 ceph-mon[125702]: pgmap v4385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:30 smithi057 ceph-mon[92072]: pgmap v4385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:30 smithi122 ceph-mon[125440]: pgmap v4385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:32 smithi136 ceph-mon[125702]: pgmap v4386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:32 smithi057 ceph-mon[92072]: pgmap v4386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:32 smithi122 ceph-mon[125440]: pgmap v4386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:34 smithi136 ceph-mon[125702]: pgmap v4387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:34 smithi057 ceph-mon[92072]: pgmap v4387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:34 smithi122 ceph-mon[125440]: pgmap v4387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:36 smithi136 ceph-mon[125702]: pgmap v4388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:36 smithi057 ceph-mon[92072]: pgmap v4388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:36 smithi122 ceph-mon[125440]: pgmap v4388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:38.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:38 smithi136 ceph-mon[125702]: pgmap v4389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:38 smithi057 ceph-mon[92072]: pgmap v4389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:38 smithi122 ceph-mon[125440]: pgmap v4389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:40.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:14:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:40.279+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:14:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:40.279+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:14:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:40.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:14:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:40.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:14:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:40 smithi136 ceph-mon[125702]: pgmap v4390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:40 smithi057 ceph-mon[92072]: pgmap v4390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:40 smithi122 ceph-mon[125440]: pgmap v4390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:42 smithi136 ceph-mon[125702]: pgmap v4391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:42 smithi057 ceph-mon[92072]: pgmap v4391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:42 smithi122 ceph-mon[125440]: pgmap v4391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:44 smithi136 ceph-mon[125702]: pgmap v4392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:44 smithi057 ceph-mon[92072]: pgmap v4392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:44 smithi122 ceph-mon[125440]: pgmap v4392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:46 smithi136 ceph-mon[125702]: pgmap v4393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:46 smithi057 ceph-mon[92072]: pgmap v4393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:46 smithi122 ceph-mon[125440]: pgmap v4393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:48 smithi136 ceph-mon[125702]: pgmap v4394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:48 smithi057 ceph-mon[92072]: pgmap v4394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:48 smithi122 ceph-mon[125440]: pgmap v4394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:50 smithi136 ceph-mon[125702]: pgmap v4395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:50 smithi057 ceph-mon[92072]: pgmap v4395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:50 smithi122 ceph-mon[125440]: pgmap v4395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:52 smithi136 ceph-mon[125702]: pgmap v4396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:52 smithi057 ceph-mon[92072]: pgmap v4396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:52 smithi122 ceph-mon[125440]: pgmap v4396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:54 smithi136 ceph-mon[125702]: pgmap v4397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:54 smithi057 ceph-mon[92072]: pgmap v4397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:54 smithi122 ceph-mon[125440]: pgmap v4397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:55.288+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:14:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:55.288+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:14:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:55.288+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:14:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:55.288+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:14:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:14:55.288+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:14:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:56 smithi136 ceph-mon[125702]: pgmap v4398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:56 smithi057 ceph-mon[92072]: pgmap v4398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:56 smithi122 ceph-mon[125440]: pgmap v4398: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:14:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:14:58 smithi136 ceph-mon[125702]: pgmap v4399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:14:58 smithi057 ceph-mon[92072]: pgmap v4399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:14:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:14:58 smithi122 ceph-mon[125440]: pgmap v4399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:00 smithi136 ceph-mon[125702]: pgmap v4400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:00 smithi057 ceph-mon[92072]: pgmap v4400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:00 smithi122 ceph-mon[125440]: pgmap v4400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:02 smithi136 ceph-mon[125702]: pgmap v4401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:02 smithi057 ceph-mon[92072]: pgmap v4401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:02 smithi122 ceph-mon[125440]: pgmap v4401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:04 smithi136 ceph-mon[125702]: pgmap v4402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:15:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:04 smithi057 ceph-mon[92072]: pgmap v4402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:15:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:04 smithi122 ceph-mon[125440]: pgmap v4402: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:15:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:06 smithi136 ceph-mon[125702]: pgmap v4403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:15:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:06 smithi136 ceph-mon[125702]: osdmap e347: 12 total, 12 up, 12 in 2023-03-02T13:15:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:06 smithi057 ceph-mon[92072]: pgmap v4403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:15:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:06 smithi057 ceph-mon[92072]: osdmap e347: 12 total, 12 up, 12 in 2023-03-02T13:15:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:06 smithi122 ceph-mon[125440]: pgmap v4403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:15:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:06 smithi122 ceph-mon[125440]: osdmap e347: 12 total, 12 up, 12 in 2023-03-02T13:15:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:08 smithi136 ceph-mon[125702]: pgmap v4405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:15:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:08 smithi057 ceph-mon[92072]: pgmap v4405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:15:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:08 smithi122 ceph-mon[125440]: pgmap v4405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:15:10.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:10.296+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:15:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:10.297+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:15:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:10.297+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:15:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:10.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:15:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:10.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:15:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:10 smithi057 ceph-mon[92072]: pgmap v4406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:15:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:10 smithi122 ceph-mon[125440]: pgmap v4406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:15:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:10 smithi136 ceph-mon[125702]: pgmap v4406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:15:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:12 smithi057 ceph-mon[92072]: pgmap v4407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:15:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:12 smithi057 ceph-mon[92072]: osdmap e348: 12 total, 12 up, 12 in 2023-03-02T13:15:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:12 smithi122 ceph-mon[125440]: pgmap v4407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:15:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:12 smithi122 ceph-mon[125440]: osdmap e348: 12 total, 12 up, 12 in 2023-03-02T13:15:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:12 smithi136 ceph-mon[125702]: pgmap v4407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:15:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:12 smithi136 ceph-mon[125702]: osdmap e348: 12 total, 12 up, 12 in 2023-03-02T13:15:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:14 smithi057 ceph-mon[92072]: pgmap v4409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:15:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:14 smithi122 ceph-mon[125440]: pgmap v4409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:15:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:14 smithi136 ceph-mon[125702]: pgmap v4409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:15:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:16 smithi057 ceph-mon[92072]: pgmap v4410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T13:15:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:16 smithi122 ceph-mon[125440]: pgmap v4410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T13:15:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:16 smithi136 ceph-mon[125702]: pgmap v4410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T13:15:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:18 smithi057 ceph-mon[92072]: pgmap v4411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:15:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:18 smithi122 ceph-mon[125440]: pgmap v4411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:15:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:18 smithi136 ceph-mon[125702]: pgmap v4411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:15:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:20 smithi057 ceph-mon[92072]: pgmap v4412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:15:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:20 smithi122 ceph-mon[125440]: pgmap v4412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:15:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:20 smithi136 ceph-mon[125702]: pgmap v4412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:15:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:22 smithi057 ceph-mon[92072]: pgmap v4413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:15:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:22 smithi122 ceph-mon[125440]: pgmap v4413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:15:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:22 smithi136 ceph-mon[125702]: pgmap v4413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:15:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:24 smithi057 ceph-mon[92072]: pgmap v4414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:15:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:24 smithi122 ceph-mon[125440]: pgmap v4414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:15:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:24 smithi136 ceph-mon[125702]: pgmap v4414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:15:25.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:25.303+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:15:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:25.304+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:15:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:25.304+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:15:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:25.304+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:15:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:25.304+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:15:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:26 smithi057 ceph-mon[92072]: pgmap v4415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:26 smithi122 ceph-mon[125440]: pgmap v4415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:26 smithi136 ceph-mon[125702]: pgmap v4415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:15:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:15:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:15:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:28 smithi057 ceph-mon[92072]: pgmap v4416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:15:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:15:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:15:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:28 smithi122 ceph-mon[125440]: pgmap v4416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:15:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:15:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:15:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:28 smithi136 ceph-mon[125702]: pgmap v4416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:15:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:15:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:15:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:30 smithi057 ceph-mon[92072]: pgmap v4417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:30 smithi122 ceph-mon[125440]: pgmap v4417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:30 smithi136 ceph-mon[125702]: pgmap v4417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:32 smithi057 ceph-mon[92072]: pgmap v4418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:32 smithi122 ceph-mon[125440]: pgmap v4418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:32 smithi136 ceph-mon[125702]: pgmap v4418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:34 smithi057 ceph-mon[92072]: pgmap v4419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:34 smithi122 ceph-mon[125440]: pgmap v4419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:34 smithi136 ceph-mon[125702]: pgmap v4419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:36 smithi057 ceph-mon[92072]: pgmap v4420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:36 smithi122 ceph-mon[125440]: pgmap v4420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:36 smithi136 ceph-mon[125702]: pgmap v4420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:38 smithi057 ceph-mon[92072]: pgmap v4421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:38 smithi122 ceph-mon[125440]: pgmap v4421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:38 smithi136 ceph-mon[125702]: pgmap v4421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:40.319+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:15:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:40.320+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:15:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:40.320+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:15:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:40.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:15:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:40.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:40 smithi057 ceph-mon[92072]: pgmap v4422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:40 smithi122 ceph-mon[125440]: pgmap v4422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:40 smithi136 ceph-mon[125702]: pgmap v4422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:42 smithi057 ceph-mon[92072]: pgmap v4423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:42 smithi122 ceph-mon[125440]: pgmap v4423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:42 smithi136 ceph-mon[125702]: pgmap v4423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:44 smithi057 ceph-mon[92072]: pgmap v4424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:44 smithi122 ceph-mon[125440]: pgmap v4424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:44 smithi136 ceph-mon[125702]: pgmap v4424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:46 smithi122 ceph-mon[125440]: pgmap v4425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:46 smithi136 ceph-mon[125702]: pgmap v4425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:46 smithi057 ceph-mon[92072]: pgmap v4425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:48 smithi122 ceph-mon[125440]: pgmap v4426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:48 smithi136 ceph-mon[125702]: pgmap v4426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:48 smithi057 ceph-mon[92072]: pgmap v4426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:50 smithi122 ceph-mon[125440]: pgmap v4427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:50 smithi136 ceph-mon[125702]: pgmap v4427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:50 smithi057 ceph-mon[92072]: pgmap v4427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:52 smithi122 ceph-mon[125440]: pgmap v4428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:52 smithi136 ceph-mon[125702]: pgmap v4428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:52 smithi057 ceph-mon[92072]: pgmap v4428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:54 smithi136 ceph-mon[125702]: pgmap v4429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:54 smithi057 ceph-mon[92072]: pgmap v4429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:54 smithi122 ceph-mon[125440]: pgmap v4429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:55.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:15:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:55.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:15:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:55.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:15:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:55.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:15:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:15:55.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:15:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:56 smithi136 ceph-mon[125702]: pgmap v4430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:56 smithi057 ceph-mon[92072]: pgmap v4430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:56 smithi122 ceph-mon[125440]: pgmap v4430: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:15:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:15:58 smithi136 ceph-mon[125702]: pgmap v4431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:15:58 smithi057 ceph-mon[92072]: pgmap v4431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:15:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:15:58 smithi122 ceph-mon[125440]: pgmap v4431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:00 smithi136 ceph-mon[125702]: pgmap v4432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:00 smithi057 ceph-mon[92072]: pgmap v4432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:00 smithi122 ceph-mon[125440]: pgmap v4432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:02 smithi136 ceph-mon[125702]: pgmap v4433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:02 smithi057 ceph-mon[92072]: pgmap v4433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:02 smithi122 ceph-mon[125440]: pgmap v4433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:04 smithi136 ceph-mon[125702]: pgmap v4434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:16:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:04 smithi057 ceph-mon[92072]: pgmap v4434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:16:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:04 smithi122 ceph-mon[125440]: pgmap v4434: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:16:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:06 smithi136 ceph-mon[125702]: pgmap v4435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:16:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:06 smithi057 ceph-mon[92072]: pgmap v4435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:16:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:06 smithi122 ceph-mon[125440]: pgmap v4435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:16:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:08 smithi136 ceph-mon[125702]: pgmap v4436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:16:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:08 smithi057 ceph-mon[92072]: pgmap v4436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:16:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:08 smithi122 ceph-mon[125440]: pgmap v4436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:16:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:10.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:16:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:10.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:16:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:10.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:16:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:10.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:16:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:10.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:16:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:10 smithi136 ceph-mon[125702]: pgmap v4437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:16:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:10 smithi057 ceph-mon[92072]: pgmap v4437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:16:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:10 smithi122 ceph-mon[125440]: pgmap v4437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:16:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:12 smithi136 ceph-mon[125702]: pgmap v4438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:16:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:12 smithi136 ceph-mon[125702]: osdmap e349: 12 total, 12 up, 12 in 2023-03-02T13:16:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:12 smithi057 ceph-mon[92072]: pgmap v4438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:16:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:12 smithi057 ceph-mon[92072]: osdmap e349: 12 total, 12 up, 12 in 2023-03-02T13:16:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:12 smithi122 ceph-mon[125440]: pgmap v4438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:16:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:12 smithi122 ceph-mon[125440]: osdmap e349: 12 total, 12 up, 12 in 2023-03-02T13:16:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:14 smithi136 ceph-mon[125702]: pgmap v4440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:14 smithi057 ceph-mon[92072]: pgmap v4440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:14 smithi122 ceph-mon[125440]: pgmap v4440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:16 smithi136 ceph-mon[125702]: pgmap v4441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:16 smithi136 ceph-mon[125702]: osdmap e350: 12 total, 12 up, 12 in 2023-03-02T13:16:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:16 smithi057 ceph-mon[92072]: pgmap v4441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:16 smithi057 ceph-mon[92072]: osdmap e350: 12 total, 12 up, 12 in 2023-03-02T13:16:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:16 smithi122 ceph-mon[125440]: pgmap v4441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:16 smithi122 ceph-mon[125440]: osdmap e350: 12 total, 12 up, 12 in 2023-03-02T13:16:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:18 smithi136 ceph-mon[125702]: pgmap v4443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:16:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:18 smithi057 ceph-mon[92072]: pgmap v4443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:16:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:18 smithi122 ceph-mon[125440]: pgmap v4443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:16:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:20 smithi136 ceph-mon[125702]: pgmap v4444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:16:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:20 smithi057 ceph-mon[92072]: pgmap v4444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:16:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:20 smithi122 ceph-mon[125440]: pgmap v4444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:16:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:22 smithi136 ceph-mon[125702]: pgmap v4445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T13:16:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:22 smithi057 ceph-mon[92072]: pgmap v4445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T13:16:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:22 smithi122 ceph-mon[125440]: pgmap v4445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T13:16:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:24 smithi136 ceph-mon[125702]: pgmap v4446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:24 smithi057 ceph-mon[92072]: pgmap v4446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:24 smithi122 ceph-mon[125440]: pgmap v4446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:25.358+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:16:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:25.358+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:16:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:25.358+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:16:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:25.358+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:16:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:25.358+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:16:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:26 smithi136 ceph-mon[125702]: pgmap v4447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:26 smithi057 ceph-mon[92072]: pgmap v4447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:26 smithi122 ceph-mon[125440]: pgmap v4447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:16:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:28 smithi136 ceph-mon[125702]: pgmap v4448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 188 B/s wr, 14 op/s 2023-03-02T13:16:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:16:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:16:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:16:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:28 smithi057 ceph-mon[92072]: pgmap v4448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 188 B/s wr, 14 op/s 2023-03-02T13:16:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:16:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:16:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:16:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:28 smithi122 ceph-mon[125440]: pgmap v4448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 188 B/s wr, 14 op/s 2023-03-02T13:16:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:16:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:16:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:16:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:16:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:16:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:16:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:30 smithi136 ceph-mon[125702]: pgmap v4449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:30 smithi057 ceph-mon[92072]: pgmap v4449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:30 smithi122 ceph-mon[125440]: pgmap v4449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:32 smithi136 ceph-mon[125702]: pgmap v4450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:32 smithi057 ceph-mon[92072]: pgmap v4450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:32 smithi122 ceph-mon[125440]: pgmap v4450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:34 smithi057 ceph-mon[92072]: pgmap v4451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:34 smithi122 ceph-mon[125440]: pgmap v4451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:34 smithi136 ceph-mon[125702]: pgmap v4451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:36 smithi057 ceph-mon[92072]: pgmap v4452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:36 smithi122 ceph-mon[125440]: pgmap v4452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:36 smithi136 ceph-mon[125702]: pgmap v4452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:38 smithi057 ceph-mon[92072]: pgmap v4453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:38 smithi122 ceph-mon[125440]: pgmap v4453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:38 smithi136 ceph-mon[125702]: pgmap v4453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:40.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:16:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:40.371+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:16:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:40.371+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:16:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:40.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:16:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:40.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:16:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:40 smithi057 ceph-mon[92072]: pgmap v4454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:40 smithi122 ceph-mon[125440]: pgmap v4454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:40 smithi136 ceph-mon[125702]: pgmap v4454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:42 smithi057 ceph-mon[92072]: pgmap v4455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:42 smithi122 ceph-mon[125440]: pgmap v4455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:42 smithi136 ceph-mon[125702]: pgmap v4455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:44 smithi057 ceph-mon[92072]: pgmap v4456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:44 smithi122 ceph-mon[125440]: pgmap v4456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:44 smithi136 ceph-mon[125702]: pgmap v4456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:46 smithi057 ceph-mon[92072]: pgmap v4457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:46 smithi122 ceph-mon[125440]: pgmap v4457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:46 smithi136 ceph-mon[125702]: pgmap v4457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:48 smithi057 ceph-mon[92072]: pgmap v4458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:48 smithi122 ceph-mon[125440]: pgmap v4458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:48 smithi136 ceph-mon[125702]: pgmap v4458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:50 smithi057 ceph-mon[92072]: pgmap v4459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:50 smithi122 ceph-mon[125440]: pgmap v4459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:50 smithi136 ceph-mon[125702]: pgmap v4459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:52 smithi057 ceph-mon[92072]: pgmap v4460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:52 smithi122 ceph-mon[125440]: pgmap v4460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:52 smithi136 ceph-mon[125702]: pgmap v4460: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:54 smithi057 ceph-mon[92072]: pgmap v4461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:54 smithi122 ceph-mon[125440]: pgmap v4461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:54 smithi136 ceph-mon[125702]: pgmap v4461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:55.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:55.383+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:16:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:55.383+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:16:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:55.383+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:16:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:55.383+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:16:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:16:55.383+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:16:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:56 smithi057 ceph-mon[92072]: pgmap v4462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:56 smithi122 ceph-mon[125440]: pgmap v4462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:56 smithi136 ceph-mon[125702]: pgmap v4462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:16:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:16:58 smithi057 ceph-mon[92072]: pgmap v4463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:16:58 smithi122 ceph-mon[125440]: pgmap v4463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:16:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:16:58 smithi136 ceph-mon[125702]: pgmap v4463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:00 smithi057 ceph-mon[92072]: pgmap v4464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:00 smithi122 ceph-mon[125440]: pgmap v4464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:00 smithi136 ceph-mon[125702]: pgmap v4464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:02 smithi057 ceph-mon[92072]: pgmap v4465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:02 smithi122 ceph-mon[125440]: pgmap v4465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:02 smithi136 ceph-mon[125702]: pgmap v4465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:04 smithi057 ceph-mon[92072]: pgmap v4466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:17:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:04 smithi122 ceph-mon[125440]: pgmap v4466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:17:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:04 smithi136 ceph-mon[125702]: pgmap v4466: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:17:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:06 smithi057 ceph-mon[92072]: pgmap v4467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:17:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:06 smithi122 ceph-mon[125440]: pgmap v4467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:17:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:06 smithi136 ceph-mon[125702]: pgmap v4467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:17:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:08 smithi122 ceph-mon[125440]: pgmap v4468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:17:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:08 smithi136 ceph-mon[125702]: pgmap v4468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:17:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:08 smithi057 ceph-mon[92072]: pgmap v4468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:17:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:09.543+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:17:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:09.543+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:17:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:09.543+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 68 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:17:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:09.543+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 67 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:17:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:10.398+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:17:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:10.398+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:17:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:10.398+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:17:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:10.398+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:17:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:10.398+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:17:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:10 smithi136 ceph-mon[125702]: pgmap v4469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:17:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:10 smithi057 ceph-mon[92072]: pgmap v4469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:17:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:10 smithi122 ceph-mon[125440]: pgmap v4469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:17:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:11 smithi136 ceph-mon[125702]: osdmap e351: 12 total, 12 up, 12 in 2023-03-02T13:17:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:11 smithi057 ceph-mon[92072]: osdmap e351: 12 total, 12 up, 12 in 2023-03-02T13:17:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:11 smithi122 ceph-mon[125440]: osdmap e351: 12 total, 12 up, 12 in 2023-03-02T13:17:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:12 smithi136 ceph-mon[125702]: pgmap v4471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:17:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:12 smithi057 ceph-mon[92072]: pgmap v4471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:17:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:12 smithi122 ceph-mon[125440]: pgmap v4471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:17:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:14 smithi136 ceph-mon[125702]: pgmap v4472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:17:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:14 smithi057 ceph-mon[92072]: pgmap v4472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:17:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:14 smithi122 ceph-mon[125440]: pgmap v4472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:17:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:16 smithi136 ceph-mon[125702]: pgmap v4473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:17:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:16 smithi136 ceph-mon[125702]: osdmap e352: 12 total, 12 up, 12 in 2023-03-02T13:17:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:16 smithi057 ceph-mon[92072]: pgmap v4473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:17:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:16 smithi057 ceph-mon[92072]: osdmap e352: 12 total, 12 up, 12 in 2023-03-02T13:17:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:16 smithi122 ceph-mon[125440]: pgmap v4473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:17:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:16 smithi122 ceph-mon[125440]: osdmap e352: 12 total, 12 up, 12 in 2023-03-02T13:17:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:18 smithi136 ceph-mon[125702]: pgmap v4475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:17:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:18 smithi057 ceph-mon[92072]: pgmap v4475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:17:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:18 smithi122 ceph-mon[125440]: pgmap v4475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:17:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:20 smithi136 ceph-mon[125702]: pgmap v4476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T13:17:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:20 smithi057 ceph-mon[92072]: pgmap v4476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T13:17:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:20 smithi122 ceph-mon[125440]: pgmap v4476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T13:17:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:22 smithi136 ceph-mon[125702]: pgmap v4477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:17:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:22 smithi057 ceph-mon[92072]: pgmap v4477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:17:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:22 smithi122 ceph-mon[125440]: pgmap v4477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:17:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:24 smithi136 ceph-mon[125702]: pgmap v4478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:17:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:24 smithi057 ceph-mon[92072]: pgmap v4478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:17:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:24 smithi122 ceph-mon[125440]: pgmap v4478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:17:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:25.414+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:17:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:25.414+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:17:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:25.414+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:17:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:25.414+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:17:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:25.414+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:17:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:26 smithi136 ceph-mon[125702]: pgmap v4479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:17:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:26 smithi057 ceph-mon[92072]: pgmap v4479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:17:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:26 smithi122 ceph-mon[125440]: pgmap v4479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:17:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:28 smithi136 ceph-mon[125702]: pgmap v4480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:17:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:17:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:28 smithi057 ceph-mon[92072]: pgmap v4480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:17:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:17:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:28 smithi122 ceph-mon[125440]: pgmap v4480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:17:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:17:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:30 smithi136 ceph-mon[125702]: pgmap v4481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:17:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:17:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:17:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:30 smithi057 ceph-mon[92072]: pgmap v4481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:17:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:17:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:17:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:30 smithi122 ceph-mon[125440]: pgmap v4481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:17:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:17:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:17:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:32 smithi136 ceph-mon[125702]: pgmap v4482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:32 smithi057 ceph-mon[92072]: pgmap v4482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:32 smithi122 ceph-mon[125440]: pgmap v4482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:34 smithi136 ceph-mon[125702]: pgmap v4483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:34 smithi057 ceph-mon[92072]: pgmap v4483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:34 smithi122 ceph-mon[125440]: pgmap v4483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:36 smithi136 ceph-mon[125702]: pgmap v4484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:36 smithi057 ceph-mon[92072]: pgmap v4484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:36 smithi122 ceph-mon[125440]: pgmap v4484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:38 smithi136 ceph-mon[125702]: pgmap v4485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:38 smithi057 ceph-mon[92072]: pgmap v4485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:38 smithi122 ceph-mon[125440]: pgmap v4485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:40.427+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:17:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:40.427+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:17:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:40.427+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:17:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:40.427+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:17:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:40.427+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:17:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:40 smithi136 ceph-mon[125702]: pgmap v4486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:40 smithi057 ceph-mon[92072]: pgmap v4486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:40 smithi122 ceph-mon[125440]: pgmap v4486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:42 smithi136 ceph-mon[125702]: pgmap v4487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:42 smithi057 ceph-mon[92072]: pgmap v4487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:42 smithi122 ceph-mon[125440]: pgmap v4487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:44 smithi136 ceph-mon[125702]: pgmap v4488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:44 smithi057 ceph-mon[92072]: pgmap v4488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:44 smithi122 ceph-mon[125440]: pgmap v4488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:46 smithi136 ceph-mon[125702]: pgmap v4489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:46 smithi057 ceph-mon[92072]: pgmap v4489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:46 smithi122 ceph-mon[125440]: pgmap v4489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:48 smithi136 ceph-mon[125702]: pgmap v4490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:48 smithi057 ceph-mon[92072]: pgmap v4490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:48 smithi122 ceph-mon[125440]: pgmap v4490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:50 smithi136 ceph-mon[125702]: pgmap v4491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:50 smithi057 ceph-mon[92072]: pgmap v4491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:50 smithi122 ceph-mon[125440]: pgmap v4491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:52 smithi136 ceph-mon[125702]: pgmap v4492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:52 smithi057 ceph-mon[92072]: pgmap v4492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:52 smithi122 ceph-mon[125440]: pgmap v4492: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:54 smithi057 ceph-mon[92072]: pgmap v4493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:54 smithi122 ceph-mon[125440]: pgmap v4493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:54 smithi136 ceph-mon[125702]: pgmap v4493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:55.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:17:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:55.436+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:17:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:55.436+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:17:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:55.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:17:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:17:55.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:17:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:56 smithi057 ceph-mon[92072]: pgmap v4494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:56 smithi122 ceph-mon[125440]: pgmap v4494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:56 smithi136 ceph-mon[125702]: pgmap v4494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:17:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:17:58 smithi057 ceph-mon[92072]: pgmap v4495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:17:58 smithi122 ceph-mon[125440]: pgmap v4495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:17:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:17:58 smithi136 ceph-mon[125702]: pgmap v4495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:00 smithi057 ceph-mon[92072]: pgmap v4496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:00 smithi122 ceph-mon[125440]: pgmap v4496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:00 smithi136 ceph-mon[125702]: pgmap v4496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:02 smithi057 ceph-mon[92072]: pgmap v4497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:02 smithi122 ceph-mon[125440]: pgmap v4497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:02 smithi136 ceph-mon[125702]: pgmap v4497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:04 smithi057 ceph-mon[92072]: pgmap v4498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:18:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:04 smithi122 ceph-mon[125440]: pgmap v4498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:18:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:04 smithi136 ceph-mon[125702]: pgmap v4498: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:18:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:06 smithi057 ceph-mon[92072]: pgmap v4499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:18:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:06 smithi122 ceph-mon[125440]: pgmap v4499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:18:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:06 smithi136 ceph-mon[125702]: pgmap v4499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:18:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:08 smithi057 ceph-mon[92072]: pgmap v4500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:18:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:08 smithi122 ceph-mon[125440]: pgmap v4500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:18:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:08 smithi136 ceph-mon[125702]: pgmap v4500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:18:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:10.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:18:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:10.448+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:18:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:10.448+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:18:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:10.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:18:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:10.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:18:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:10 smithi057 ceph-mon[92072]: pgmap v4501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:18:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:10 smithi122 ceph-mon[125440]: pgmap v4501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:18:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:10 smithi136 ceph-mon[125702]: pgmap v4501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:18:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:11 smithi057 ceph-mon[92072]: osdmap e353: 12 total, 12 up, 12 in 2023-03-02T13:18:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:11 smithi122 ceph-mon[125440]: osdmap e353: 12 total, 12 up, 12 in 2023-03-02T13:18:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:11 smithi136 ceph-mon[125702]: osdmap e353: 12 total, 12 up, 12 in 2023-03-02T13:18:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:12 smithi057 ceph-mon[92072]: pgmap v4503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:18:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:12 smithi122 ceph-mon[125440]: pgmap v4503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:18:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:12 smithi136 ceph-mon[125702]: pgmap v4503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:18:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:14 smithi057 ceph-mon[92072]: pgmap v4504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:18:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:14 smithi122 ceph-mon[125440]: pgmap v4504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:18:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:14 smithi136 ceph-mon[125702]: pgmap v4504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:18:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:16 smithi057 ceph-mon[92072]: pgmap v4505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:18:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:16 smithi057 ceph-mon[92072]: osdmap e354: 12 total, 12 up, 12 in 2023-03-02T13:18:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:16 smithi122 ceph-mon[125440]: pgmap v4505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:18:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:16 smithi122 ceph-mon[125440]: osdmap e354: 12 total, 12 up, 12 in 2023-03-02T13:18:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:16 smithi136 ceph-mon[125702]: pgmap v4505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:18:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:16 smithi136 ceph-mon[125702]: osdmap e354: 12 total, 12 up, 12 in 2023-03-02T13:18:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:18 smithi122 ceph-mon[125440]: pgmap v4507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:18:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:18 smithi136 ceph-mon[125702]: pgmap v4507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:18:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:18 smithi057 ceph-mon[92072]: pgmap v4507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:18:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:20 smithi122 ceph-mon[125440]: pgmap v4508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T13:18:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:20 smithi136 ceph-mon[125702]: pgmap v4508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T13:18:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:20 smithi057 ceph-mon[92072]: pgmap v4508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T13:18:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:22 smithi122 ceph-mon[125440]: pgmap v4509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:18:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:22 smithi136 ceph-mon[125702]: pgmap v4509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:18:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:22 smithi057 ceph-mon[92072]: pgmap v4509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:18:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:24 smithi136 ceph-mon[125702]: pgmap v4510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:18:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:24 smithi057 ceph-mon[92072]: pgmap v4510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:18:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:24 smithi122 ceph-mon[125440]: pgmap v4510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:18:25.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:25.464+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:18:25.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:25.464+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:18:25.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:25.464+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:18:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:25.464+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:18:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:25.464+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:18:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:26 smithi136 ceph-mon[125702]: pgmap v4511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:18:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:26 smithi057 ceph-mon[92072]: pgmap v4511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:18:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:26 smithi122 ceph-mon[125440]: pgmap v4511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:18:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:28 smithi136 ceph-mon[125702]: pgmap v4512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:18:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:28 smithi057 ceph-mon[92072]: pgmap v4512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:18:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:28 smithi122 ceph-mon[125440]: pgmap v4512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:18:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:30 smithi136 ceph-mon[125702]: pgmap v4513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:18:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:18:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:18:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:18:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:30 smithi057 ceph-mon[92072]: pgmap v4513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:18:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:18:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:18:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:18:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:30 smithi122 ceph-mon[125440]: pgmap v4513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:18:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:18:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:18:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:18:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:32 smithi136 ceph-mon[125702]: pgmap v4514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:32 smithi057 ceph-mon[92072]: pgmap v4514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:32 smithi122 ceph-mon[125440]: pgmap v4514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:34 smithi136 ceph-mon[125702]: pgmap v4515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:34 smithi057 ceph-mon[92072]: pgmap v4515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:34 smithi122 ceph-mon[125440]: pgmap v4515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:36 smithi136 ceph-mon[125702]: pgmap v4516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:36 smithi057 ceph-mon[92072]: pgmap v4516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:36 smithi122 ceph-mon[125440]: pgmap v4516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:38 smithi136 ceph-mon[125702]: pgmap v4517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:38 smithi057 ceph-mon[92072]: pgmap v4517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:38 smithi122 ceph-mon[125440]: pgmap v4517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:40.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:18:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:40.470+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:18:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:40.470+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:18:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:40.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:18:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:40.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:18:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:40 smithi136 ceph-mon[125702]: pgmap v4518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:40 smithi057 ceph-mon[92072]: pgmap v4518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:40 smithi122 ceph-mon[125440]: pgmap v4518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:42 smithi136 ceph-mon[125702]: pgmap v4519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:42 smithi057 ceph-mon[92072]: pgmap v4519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:42 smithi122 ceph-mon[125440]: pgmap v4519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:44 smithi136 ceph-mon[125702]: pgmap v4520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:44 smithi057 ceph-mon[92072]: pgmap v4520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:44 smithi122 ceph-mon[125440]: pgmap v4520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:46 smithi136 ceph-mon[125702]: pgmap v4521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:46 smithi057 ceph-mon[92072]: pgmap v4521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:46 smithi122 ceph-mon[125440]: pgmap v4521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:48 smithi136 ceph-mon[125702]: pgmap v4522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:48 smithi057 ceph-mon[92072]: pgmap v4522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:48 smithi122 ceph-mon[125440]: pgmap v4522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:50 smithi136 ceph-mon[125702]: pgmap v4523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:50 smithi057 ceph-mon[92072]: pgmap v4523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:50 smithi122 ceph-mon[125440]: pgmap v4523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:52 smithi136 ceph-mon[125702]: pgmap v4524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:52 smithi057 ceph-mon[92072]: pgmap v4524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:52 smithi122 ceph-mon[125440]: pgmap v4524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:54 smithi136 ceph-mon[125702]: pgmap v4525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:54 smithi057 ceph-mon[92072]: pgmap v4525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:54 smithi122 ceph-mon[125440]: pgmap v4525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:55.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:18:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:55.482+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:18:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:55.482+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:18:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:55.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:18:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:18:55.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:18:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:56 smithi136 ceph-mon[125702]: pgmap v4526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:56 smithi057 ceph-mon[92072]: pgmap v4526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:56 smithi122 ceph-mon[125440]: pgmap v4526: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:18:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:18:58 smithi136 ceph-mon[125702]: pgmap v4527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:18:58 smithi057 ceph-mon[92072]: pgmap v4527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:18:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:18:58 smithi122 ceph-mon[125440]: pgmap v4527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:00 smithi136 ceph-mon[125702]: pgmap v4528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:00 smithi057 ceph-mon[92072]: pgmap v4528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:00 smithi122 ceph-mon[125440]: pgmap v4528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:02 smithi136 ceph-mon[125702]: pgmap v4529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:02 smithi057 ceph-mon[92072]: pgmap v4529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:02 smithi122 ceph-mon[125440]: pgmap v4529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:04 smithi136 ceph-mon[125702]: pgmap v4530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:19:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:04 smithi057 ceph-mon[92072]: pgmap v4530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:19:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:04 smithi122 ceph-mon[125440]: pgmap v4530: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:19:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:06 smithi136 ceph-mon[125702]: pgmap v4531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:19:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:06 smithi057 ceph-mon[92072]: pgmap v4531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:19:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:06 smithi122 ceph-mon[125440]: pgmap v4531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:19:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:08 smithi136 ceph-mon[125702]: pgmap v4532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:19:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:08 smithi057 ceph-mon[92072]: pgmap v4532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:19:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:08 smithi122 ceph-mon[125440]: pgmap v4532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:19:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:10.497+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:19:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:10.497+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:19:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:10.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:19:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:10.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:19:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:10.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:19:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:10 smithi057 ceph-mon[92072]: pgmap v4533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:19:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:10 smithi122 ceph-mon[125440]: pgmap v4533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:19:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:10 smithi136 ceph-mon[125702]: pgmap v4533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:19:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:11 smithi057 ceph-mon[92072]: osdmap e355: 12 total, 12 up, 12 in 2023-03-02T13:19:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:11 smithi122 ceph-mon[125440]: osdmap e355: 12 total, 12 up, 12 in 2023-03-02T13:19:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:11 smithi136 ceph-mon[125702]: osdmap e355: 12 total, 12 up, 12 in 2023-03-02T13:19:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:12 smithi057 ceph-mon[92072]: pgmap v4535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:19:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:12 smithi122 ceph-mon[125440]: pgmap v4535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:19:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:12 smithi136 ceph-mon[125702]: pgmap v4535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:19:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:14 smithi057 ceph-mon[92072]: pgmap v4536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:19:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:14 smithi122 ceph-mon[125440]: pgmap v4536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:19:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:14 smithi136 ceph-mon[125702]: pgmap v4536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:19:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:16 smithi057 ceph-mon[92072]: pgmap v4537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:19:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:16 smithi057 ceph-mon[92072]: osdmap e356: 12 total, 12 up, 12 in 2023-03-02T13:19:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:16 smithi122 ceph-mon[125440]: pgmap v4537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:19:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:16 smithi122 ceph-mon[125440]: osdmap e356: 12 total, 12 up, 12 in 2023-03-02T13:19:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:16 smithi136 ceph-mon[125702]: pgmap v4537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:19:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:16 smithi136 ceph-mon[125702]: osdmap e356: 12 total, 12 up, 12 in 2023-03-02T13:19:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:18 smithi057 ceph-mon[92072]: pgmap v4539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:19:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:18 smithi122 ceph-mon[125440]: pgmap v4539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:19:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:18 smithi136 ceph-mon[125702]: pgmap v4539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:19:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:20 smithi057 ceph-mon[92072]: pgmap v4540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T13:19:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:20 smithi122 ceph-mon[125440]: pgmap v4540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T13:19:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:20 smithi136 ceph-mon[125702]: pgmap v4540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T13:19:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:22 smithi057 ceph-mon[92072]: pgmap v4541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:19:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:22 smithi122 ceph-mon[125440]: pgmap v4541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:19:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:22 smithi136 ceph-mon[125702]: pgmap v4541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:19:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:24.561+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:19:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:24.561+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:19:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:24.562+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 69 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:19:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:24.562+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 68 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:19:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:24 smithi057 ceph-mon[92072]: pgmap v4542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:19:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:24 smithi122 ceph-mon[125440]: pgmap v4542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:19:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:24 smithi136 ceph-mon[125702]: pgmap v4542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:19:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:25.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:19:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:25.507+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:19:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:25.507+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:19:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:25.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:19:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:25.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:19:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:26 smithi057 ceph-mon[92072]: pgmap v4543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:19:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:26 smithi122 ceph-mon[125440]: pgmap v4543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:19:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:26 smithi136 ceph-mon[125702]: pgmap v4543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:19:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:28 smithi057 ceph-mon[92072]: pgmap v4544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:19:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:28 smithi122 ceph-mon[125440]: pgmap v4544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:19:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:28 smithi136 ceph-mon[125702]: pgmap v4544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:19:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:30 smithi057 ceph-mon[92072]: pgmap v4545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:19:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:30 smithi122 ceph-mon[125440]: pgmap v4545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:19:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:30 smithi136 ceph-mon[125702]: pgmap v4545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:19:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:32 smithi057 ceph-mon[92072]: pgmap v4546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:19:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:19:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:19:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:32 smithi122 ceph-mon[125440]: pgmap v4546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:19:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:19:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:19:32.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:32 smithi136 ceph-mon[125702]: pgmap v4546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:19:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:19:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:19:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:34 smithi057 ceph-mon[92072]: pgmap v4547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:34 smithi122 ceph-mon[125440]: pgmap v4547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:34 smithi136 ceph-mon[125702]: pgmap v4547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:36 smithi057 ceph-mon[92072]: pgmap v4548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:36 smithi122 ceph-mon[125440]: pgmap v4548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:36 smithi136 ceph-mon[125702]: pgmap v4548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:38 smithi057 ceph-mon[92072]: pgmap v4549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:38 smithi122 ceph-mon[125440]: pgmap v4549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:38 smithi136 ceph-mon[125702]: pgmap v4549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:40 smithi122 ceph-mon[125440]: pgmap v4550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:40.523+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:19:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:40.523+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:19:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:40.523+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:19:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:40.523+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:19:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:40.523+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:19:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:40 smithi136 ceph-mon[125702]: pgmap v4550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:40 smithi057 ceph-mon[92072]: pgmap v4550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:42 smithi122 ceph-mon[125440]: pgmap v4551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:42 smithi136 ceph-mon[125702]: pgmap v4551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:42 smithi057 ceph-mon[92072]: pgmap v4551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:44 smithi122 ceph-mon[125440]: pgmap v4552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:44 smithi136 ceph-mon[125702]: pgmap v4552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:44 smithi057 ceph-mon[92072]: pgmap v4552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:46 smithi136 ceph-mon[125702]: pgmap v4553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:46 smithi057 ceph-mon[92072]: pgmap v4553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:46 smithi122 ceph-mon[125440]: pgmap v4553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:19:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:48 smithi136 ceph-mon[125702]: pgmap v4554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:48 smithi057 ceph-mon[92072]: pgmap v4554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:48 smithi122 ceph-mon[125440]: pgmap v4554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:50 smithi136 ceph-mon[125702]: pgmap v4555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:19:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:50 smithi057 ceph-mon[92072]: pgmap v4555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:19:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:50 smithi122 ceph-mon[125440]: pgmap v4555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:19:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:52 smithi136 ceph-mon[125702]: pgmap v4556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:19:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:52 smithi057 ceph-mon[92072]: pgmap v4556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:19:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:52 smithi122 ceph-mon[125440]: pgmap v4556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:19:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:54 smithi136 ceph-mon[125702]: pgmap v4557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:54 smithi057 ceph-mon[92072]: pgmap v4557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:54 smithi122 ceph-mon[125440]: pgmap v4557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:55.533+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:19:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:55.534+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:19:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:55.534+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:19:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:55.534+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:19:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:19:55.534+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:19:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:56 smithi136 ceph-mon[125702]: pgmap v4558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:19:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:56 smithi057 ceph-mon[92072]: pgmap v4558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:19:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:56 smithi122 ceph-mon[125440]: pgmap v4558: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:19:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:19:58 smithi136 ceph-mon[125702]: pgmap v4559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:19:58 smithi057 ceph-mon[92072]: pgmap v4559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:19:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:19:58 smithi122 ceph-mon[125440]: pgmap v4559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:00 smithi136 ceph-mon[125702]: pgmap v4560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T13:20:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:00 smithi057 ceph-mon[92072]: pgmap v4560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T13:20:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:00 smithi122 ceph-mon[125440]: pgmap v4560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T13:20:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:02 smithi136 ceph-mon[125702]: pgmap v4561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:02 smithi057 ceph-mon[92072]: pgmap v4561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:02 smithi122 ceph-mon[125440]: pgmap v4561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:04 smithi136 ceph-mon[125702]: pgmap v4562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:20:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:04 smithi057 ceph-mon[92072]: pgmap v4562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:20:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:04 smithi122 ceph-mon[125440]: pgmap v4562: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:20:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:06 smithi136 ceph-mon[125702]: pgmap v4563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:20:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:06 smithi057 ceph-mon[92072]: pgmap v4563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:20:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:06 smithi122 ceph-mon[125440]: pgmap v4563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:20:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:08 smithi136 ceph-mon[125702]: pgmap v4564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:20:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:08 smithi057 ceph-mon[92072]: pgmap v4564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:20:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:08 smithi122 ceph-mon[125440]: pgmap v4564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:20:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:09.568+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:20:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:09.568+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:20:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:09.569+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 69 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:20:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:09.569+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 70 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:20:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:10.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:20:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:10.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:20:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:10.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:20:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:10.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:20:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:10.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:20:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:10 smithi136 ceph-mon[125702]: pgmap v4565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:20:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:10 smithi057 ceph-mon[92072]: pgmap v4565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:20:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:10 smithi122 ceph-mon[125440]: pgmap v4565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:20:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:11 smithi136 ceph-mon[125702]: osdmap e357: 12 total, 12 up, 12 in 2023-03-02T13:20:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:11 smithi057 ceph-mon[92072]: osdmap e357: 12 total, 12 up, 12 in 2023-03-02T13:20:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:11 smithi122 ceph-mon[125440]: osdmap e357: 12 total, 12 up, 12 in 2023-03-02T13:20:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:12 smithi057 ceph-mon[92072]: pgmap v4567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:20:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:12 smithi136 ceph-mon[125702]: pgmap v4567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:20:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:12 smithi122 ceph-mon[125440]: pgmap v4567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:20:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:14 smithi136 ceph-mon[125702]: pgmap v4568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:20:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:14 smithi057 ceph-mon[92072]: pgmap v4568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:20:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:14 smithi122 ceph-mon[125440]: pgmap v4568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:20:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:16 smithi136 ceph-mon[125702]: pgmap v4569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:20:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:16 smithi136 ceph-mon[125702]: osdmap e358: 12 total, 12 up, 12 in 2023-03-02T13:20:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:16 smithi057 ceph-mon[92072]: pgmap v4569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:20:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:16 smithi057 ceph-mon[92072]: osdmap e358: 12 total, 12 up, 12 in 2023-03-02T13:20:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:16 smithi122 ceph-mon[125440]: pgmap v4569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:20:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:16 smithi122 ceph-mon[125440]: osdmap e358: 12 total, 12 up, 12 in 2023-03-02T13:20:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:18 smithi136 ceph-mon[125702]: pgmap v4571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:20:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:18 smithi057 ceph-mon[92072]: pgmap v4571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:20:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:18 smithi122 ceph-mon[125440]: pgmap v4571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:20:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:20 smithi136 ceph-mon[125702]: pgmap v4572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T13:20:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:20 smithi057 ceph-mon[92072]: pgmap v4572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T13:20:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:20 smithi122 ceph-mon[125440]: pgmap v4572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T13:20:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:22 smithi136 ceph-mon[125702]: pgmap v4573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:20:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:22 smithi057 ceph-mon[92072]: pgmap v4573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:20:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:22 smithi122 ceph-mon[125440]: pgmap v4573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:20:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:24 smithi136 ceph-mon[125702]: pgmap v4574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:20:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:24 smithi057 ceph-mon[92072]: pgmap v4574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:20:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:24 smithi122 ceph-mon[125440]: pgmap v4574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:20:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:25.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:20:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:25.560+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:20:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:25.560+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:20:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:25.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:20:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:25.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:20:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:26 smithi136 ceph-mon[125702]: pgmap v4575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:20:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:26 smithi057 ceph-mon[92072]: pgmap v4575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:20:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:26 smithi122 ceph-mon[125440]: pgmap v4575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:20:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:28 smithi136 ceph-mon[125702]: pgmap v4576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:20:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:28 smithi057 ceph-mon[92072]: pgmap v4576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:20:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:28 smithi122 ceph-mon[125440]: pgmap v4576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:20:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:30 smithi136 ceph-mon[125702]: pgmap v4577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:30 smithi057 ceph-mon[92072]: pgmap v4577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:30 smithi122 ceph-mon[125440]: pgmap v4577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:32 smithi136 ceph-mon[125702]: pgmap v4578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:20:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:20:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:20:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:20:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:32 smithi057 ceph-mon[92072]: pgmap v4578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:20:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:20:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:20:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:20:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:32 smithi122 ceph-mon[125440]: pgmap v4578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:20:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:20:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:20:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:20:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:34 smithi136 ceph-mon[125702]: pgmap v4579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:34 smithi057 ceph-mon[92072]: pgmap v4579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:34 smithi122 ceph-mon[125440]: pgmap v4579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:36 smithi136 ceph-mon[125702]: pgmap v4580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:36 smithi057 ceph-mon[92072]: pgmap v4580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:36 smithi122 ceph-mon[125440]: pgmap v4580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:38 smithi136 ceph-mon[125702]: pgmap v4581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:38 smithi057 ceph-mon[92072]: pgmap v4581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:38 smithi122 ceph-mon[125440]: pgmap v4581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:40.566+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:20:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:40.567+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:20:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:40.567+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:20:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:40.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:20:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:40.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:20:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:40 smithi136 ceph-mon[125702]: pgmap v4582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:40 smithi057 ceph-mon[92072]: pgmap v4582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:40 smithi122 ceph-mon[125440]: pgmap v4582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:42 smithi057 ceph-mon[92072]: pgmap v4583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:42 smithi122 ceph-mon[125440]: pgmap v4583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:42 smithi136 ceph-mon[125702]: pgmap v4583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:44 smithi057 ceph-mon[92072]: pgmap v4584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:44 smithi122 ceph-mon[125440]: pgmap v4584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:44 smithi136 ceph-mon[125702]: pgmap v4584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:46 smithi057 ceph-mon[92072]: pgmap v4585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:46 smithi122 ceph-mon[125440]: pgmap v4585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:46 smithi136 ceph-mon[125702]: pgmap v4585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:20:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:48 smithi057 ceph-mon[92072]: pgmap v4586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:48 smithi122 ceph-mon[125440]: pgmap v4586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:48 smithi136 ceph-mon[125702]: pgmap v4586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:50 smithi057 ceph-mon[92072]: pgmap v4587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:20:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:50 smithi122 ceph-mon[125440]: pgmap v4587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:20:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:50 smithi136 ceph-mon[125702]: pgmap v4587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:20:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:52 smithi057 ceph-mon[92072]: pgmap v4588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:20:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:52 smithi122 ceph-mon[125440]: pgmap v4588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:20:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:52 smithi136 ceph-mon[125702]: pgmap v4588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:20:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:54 smithi057 ceph-mon[92072]: pgmap v4589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:54 smithi122 ceph-mon[125440]: pgmap v4589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:54 smithi136 ceph-mon[125702]: pgmap v4589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:55.581+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:20:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:55.582+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:20:55.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:55.582+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:20:55.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:55.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:20:55.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:20:55.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:20:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:56 smithi057 ceph-mon[92072]: pgmap v4590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:20:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:56 smithi122 ceph-mon[125440]: pgmap v4590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:20:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:56 smithi136 ceph-mon[125702]: pgmap v4590: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:20:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:20:58 smithi057 ceph-mon[92072]: pgmap v4591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:20:58 smithi122 ceph-mon[125440]: pgmap v4591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:20:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:20:58 smithi136 ceph-mon[125702]: pgmap v4591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:00 smithi057 ceph-mon[92072]: pgmap v4592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:00 smithi122 ceph-mon[125440]: pgmap v4592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:00 smithi136 ceph-mon[125702]: pgmap v4592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:02 smithi057 ceph-mon[92072]: pgmap v4593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:02 smithi122 ceph-mon[125440]: pgmap v4593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:02 smithi136 ceph-mon[125702]: pgmap v4593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:04 smithi057 ceph-mon[92072]: pgmap v4594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:21:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:04 smithi122 ceph-mon[125440]: pgmap v4594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:21:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:04 smithi136 ceph-mon[125702]: pgmap v4594: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:21:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:06 smithi057 ceph-mon[92072]: pgmap v4595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:21:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:06 smithi122 ceph-mon[125440]: pgmap v4595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:21:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:06 smithi136 ceph-mon[125702]: pgmap v4595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:21:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:08 smithi057 ceph-mon[92072]: pgmap v4596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:21:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:08 smithi122 ceph-mon[125440]: pgmap v4596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:21:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:08 smithi136 ceph-mon[125702]: pgmap v4596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:21:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:10.597+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:21:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:10.597+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:21:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:10.597+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:21:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:10.597+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:21:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:10.597+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:21:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:10 smithi057 ceph-mon[92072]: pgmap v4597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:21:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:10 smithi122 ceph-mon[125440]: pgmap v4597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:21:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:10 smithi136 ceph-mon[125702]: pgmap v4597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:21:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:11 smithi057 ceph-mon[92072]: osdmap e359: 12 total, 12 up, 12 in 2023-03-02T13:21:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:11 smithi122 ceph-mon[125440]: osdmap e359: 12 total, 12 up, 12 in 2023-03-02T13:21:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:11 smithi136 ceph-mon[125702]: osdmap e359: 12 total, 12 up, 12 in 2023-03-02T13:21:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:12 smithi057 ceph-mon[92072]: pgmap v4599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:21:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:12 smithi122 ceph-mon[125440]: pgmap v4599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:21:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:12 smithi136 ceph-mon[125702]: pgmap v4599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:21:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:14 smithi057 ceph-mon[92072]: pgmap v4600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:21:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:14 smithi122 ceph-mon[125440]: pgmap v4600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:21:14.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:14 smithi136 ceph-mon[125702]: pgmap v4600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:21:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:16 smithi057 ceph-mon[92072]: pgmap v4601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:21:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:16 smithi057 ceph-mon[92072]: osdmap e360: 12 total, 12 up, 12 in 2023-03-02T13:21:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:16 smithi122 ceph-mon[125440]: pgmap v4601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:21:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:16 smithi122 ceph-mon[125440]: osdmap e360: 12 total, 12 up, 12 in 2023-03-02T13:21:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:16 smithi136 ceph-mon[125702]: pgmap v4601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:21:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:16 smithi136 ceph-mon[125702]: osdmap e360: 12 total, 12 up, 12 in 2023-03-02T13:21:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:18 smithi122 ceph-mon[125440]: pgmap v4603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:21:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:18 smithi136 ceph-mon[125702]: pgmap v4603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:21:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:18 smithi057 ceph-mon[92072]: pgmap v4603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:21:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:20 smithi122 ceph-mon[125440]: pgmap v4604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T13:21:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:20 smithi136 ceph-mon[125702]: pgmap v4604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T13:21:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:20 smithi057 ceph-mon[92072]: pgmap v4604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T13:21:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:22 smithi122 ceph-mon[125440]: pgmap v4605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:21:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:22 smithi136 ceph-mon[125702]: pgmap v4605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:21:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:22 smithi057 ceph-mon[92072]: pgmap v4605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:21:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:24 smithi122 ceph-mon[125440]: pgmap v4606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:21:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:24 smithi136 ceph-mon[125702]: pgmap v4606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:21:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:24 smithi057 ceph-mon[92072]: pgmap v4606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:21:25.609 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:25.608+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:21:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:25.608+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:21:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:25.608+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:21:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:25.608+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:21:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:25.608+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:21:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:26 smithi136 ceph-mon[125702]: pgmap v4607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:21:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:26 smithi057 ceph-mon[92072]: pgmap v4607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:21:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:26 smithi122 ceph-mon[125440]: pgmap v4607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:21:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:28 smithi136 ceph-mon[125702]: pgmap v4608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:21:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:28 smithi057 ceph-mon[92072]: pgmap v4608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:21:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:28 smithi122 ceph-mon[125440]: pgmap v4608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:21:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:30 smithi136 ceph-mon[125702]: pgmap v4609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:30 smithi057 ceph-mon[92072]: pgmap v4609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:30 smithi122 ceph-mon[125440]: pgmap v4609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:32 smithi136 ceph-mon[125702]: pgmap v4610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:21:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:32 smithi057 ceph-mon[92072]: pgmap v4610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:21:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:32 smithi122 ceph-mon[125440]: pgmap v4610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:21:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:34 smithi136 ceph-mon[125702]: pgmap v4611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:34 smithi057 ceph-mon[92072]: pgmap v4611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:34 smithi122 ceph-mon[125440]: pgmap v4611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: pgmap v4612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: pgmap v4612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: pgmap v4612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:21:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:21:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:21:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:21:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:21:37.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:21:37.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:21:37.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:21:37.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:21:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:21:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:21:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:21:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:21:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:21:37.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:21:37.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:21:37.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:21:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:21:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:21:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:21:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:21:37.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:21:37.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:21:37.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:21:37.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:21:37.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:21:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:38 smithi057 ceph-mon[92072]: pgmap v4613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:38 smithi122 ceph-mon[125440]: pgmap v4613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:38 smithi136 ceph-mon[125702]: pgmap v4613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:40.623+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:21:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:40.624+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:21:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:40.624+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:21:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:40.624+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:21:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:40.624+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:21:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:40 smithi057 ceph-mon[92072]: pgmap v4614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:40 smithi122 ceph-mon[125440]: pgmap v4614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:40 smithi136 ceph-mon[125702]: pgmap v4614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:42 smithi057 ceph-mon[92072]: pgmap v4615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:42 smithi122 ceph-mon[125440]: pgmap v4615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:42 smithi136 ceph-mon[125702]: pgmap v4615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:44 smithi057 ceph-mon[92072]: pgmap v4616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:44 smithi122 ceph-mon[125440]: pgmap v4616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:44 smithi136 ceph-mon[125702]: pgmap v4616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:46 smithi057 ceph-mon[92072]: pgmap v4617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:46 smithi122 ceph-mon[125440]: pgmap v4617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:46 smithi136 ceph-mon[125702]: pgmap v4617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:48 smithi057 ceph-mon[92072]: pgmap v4618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:48 smithi122 ceph-mon[125440]: pgmap v4618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:48 smithi136 ceph-mon[125702]: pgmap v4618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:50 smithi057 ceph-mon[92072]: pgmap v4619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:50 smithi122 ceph-mon[125440]: pgmap v4619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:50 smithi136 ceph-mon[125702]: pgmap v4619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:52 smithi057 ceph-mon[92072]: pgmap v4620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:52 smithi122 ceph-mon[125440]: pgmap v4620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:52 smithi136 ceph-mon[125702]: pgmap v4620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:54 smithi057 ceph-mon[92072]: pgmap v4621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:54 smithi122 ceph-mon[125440]: pgmap v4621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:54 smithi136 ceph-mon[125702]: pgmap v4621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:55.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:21:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:55.637+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:21:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:55.637+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:21:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:55.637+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:21:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:21:55.637+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:21:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:56 smithi057 ceph-mon[92072]: pgmap v4622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:56 smithi122 ceph-mon[125440]: pgmap v4622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:56 smithi136 ceph-mon[125702]: pgmap v4622: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:21:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:21:58 smithi057 ceph-mon[92072]: pgmap v4623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:21:58 smithi122 ceph-mon[125440]: pgmap v4623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:21:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:21:58 smithi136 ceph-mon[125702]: pgmap v4623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:00 smithi057 ceph-mon[92072]: pgmap v4624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:00 smithi122 ceph-mon[125440]: pgmap v4624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:00 smithi136 ceph-mon[125702]: pgmap v4624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:02 smithi122 ceph-mon[125440]: pgmap v4625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:02 smithi136 ceph-mon[125702]: pgmap v4625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:02 smithi057 ceph-mon[92072]: pgmap v4625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:04 smithi122 ceph-mon[125440]: pgmap v4626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T13:22:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:04 smithi136 ceph-mon[125702]: pgmap v4626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T13:22:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:04 smithi057 ceph-mon[92072]: pgmap v4626: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T13:22:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:06 smithi122 ceph-mon[125440]: pgmap v4627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:22:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:06 smithi136 ceph-mon[125702]: pgmap v4627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:22:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:06 smithi057 ceph-mon[92072]: pgmap v4627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:22:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:08 smithi136 ceph-mon[125702]: pgmap v4628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:22:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:08 smithi057 ceph-mon[92072]: pgmap v4628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:22:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:08 smithi122 ceph-mon[125440]: pgmap v4628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:22:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:10.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:22:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:10.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:22:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:10.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:22:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:10.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:22:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:10.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:22:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:10 smithi136 ceph-mon[125702]: pgmap v4629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:22:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:10 smithi057 ceph-mon[92072]: pgmap v4629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:22:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:10 smithi122 ceph-mon[125440]: pgmap v4629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:22:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:11 smithi136 ceph-mon[125702]: osdmap e361: 12 total, 12 up, 12 in 2023-03-02T13:22:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:11 smithi057 ceph-mon[92072]: osdmap e361: 12 total, 12 up, 12 in 2023-03-02T13:22:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:11 smithi122 ceph-mon[125440]: osdmap e361: 12 total, 12 up, 12 in 2023-03-02T13:22:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:12 smithi136 ceph-mon[125702]: pgmap v4631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:22:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:12 smithi057 ceph-mon[92072]: pgmap v4631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:22:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:12 smithi122 ceph-mon[125440]: pgmap v4631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:22:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:14 smithi136 ceph-mon[125702]: pgmap v4632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:22:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:14 smithi057 ceph-mon[92072]: pgmap v4632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:22:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:14 smithi122 ceph-mon[125440]: pgmap v4632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:22:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:16 smithi136 ceph-mon[125702]: pgmap v4633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:22:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:16 smithi136 ceph-mon[125702]: osdmap e362: 12 total, 12 up, 12 in 2023-03-02T13:22:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:16 smithi057 ceph-mon[92072]: pgmap v4633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:22:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:16 smithi057 ceph-mon[92072]: osdmap e362: 12 total, 12 up, 12 in 2023-03-02T13:22:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:16 smithi122 ceph-mon[125440]: pgmap v4633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:22:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:16 smithi122 ceph-mon[125440]: osdmap e362: 12 total, 12 up, 12 in 2023-03-02T13:22:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:18 smithi136 ceph-mon[125702]: pgmap v4635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:22:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:18 smithi057 ceph-mon[92072]: pgmap v4635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:22:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:18 smithi122 ceph-mon[125440]: pgmap v4635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:22:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:20 smithi136 ceph-mon[125702]: pgmap v4636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T13:22:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:20 smithi057 ceph-mon[92072]: pgmap v4636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T13:22:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:20 smithi122 ceph-mon[125440]: pgmap v4636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T13:22:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:22 smithi136 ceph-mon[125702]: pgmap v4637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:22:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:22 smithi057 ceph-mon[92072]: pgmap v4637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:22:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:22 smithi122 ceph-mon[125440]: pgmap v4637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:22:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:24 smithi136 ceph-mon[125702]: pgmap v4638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:22:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:24 smithi057 ceph-mon[92072]: pgmap v4638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:22:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:24 smithi122 ceph-mon[125440]: pgmap v4638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:22:25.660 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:25.660+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:22:25.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:25.660+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:22:25.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:25.660+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:22:25.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:25.660+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:22:25.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:25.660+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:22:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:26 smithi136 ceph-mon[125702]: pgmap v4639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:22:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:26 smithi057 ceph-mon[92072]: pgmap v4639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:22:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:26 smithi122 ceph-mon[125440]: pgmap v4639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:22:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:28 smithi136 ceph-mon[125702]: pgmap v4640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:22:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:28 smithi057 ceph-mon[92072]: pgmap v4640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:22:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:28 smithi122 ceph-mon[125440]: pgmap v4640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:22:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:30 smithi136 ceph-mon[125702]: pgmap v4641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:30 smithi057 ceph-mon[92072]: pgmap v4641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:30 smithi122 ceph-mon[125440]: pgmap v4641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:32 smithi136 ceph-mon[125702]: pgmap v4642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:32 smithi057 ceph-mon[92072]: pgmap v4642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:32 smithi122 ceph-mon[125440]: pgmap v4642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:34 smithi136 ceph-mon[125702]: pgmap v4643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:34 smithi057 ceph-mon[92072]: pgmap v4643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:34 smithi122 ceph-mon[125440]: pgmap v4643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:36 smithi136 ceph-mon[125702]: pgmap v4644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:22:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:36 smithi057 ceph-mon[92072]: pgmap v4644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:22:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:36 smithi122 ceph-mon[125440]: pgmap v4644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:22:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:22:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:22:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:22:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:22:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:22:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:22:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:22:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:22:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:22:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:38 smithi136 ceph-mon[125702]: pgmap v4645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:38 smithi057 ceph-mon[92072]: pgmap v4645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:38 smithi122 ceph-mon[125440]: pgmap v4645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:40.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:22:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:40.674+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:22:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:40.674+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:22:40.677 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:40.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:22:40.677 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:40.675+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:22:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:40 smithi136 ceph-mon[125702]: pgmap v4646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:40 smithi057 ceph-mon[92072]: pgmap v4646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:40 smithi122 ceph-mon[125440]: pgmap v4646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:42 smithi136 ceph-mon[125702]: pgmap v4647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:42 smithi057 ceph-mon[92072]: pgmap v4647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:42 smithi122 ceph-mon[125440]: pgmap v4647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:44 smithi136 ceph-mon[125702]: pgmap v4648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:44 smithi057 ceph-mon[92072]: pgmap v4648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:44 smithi122 ceph-mon[125440]: pgmap v4648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:46 smithi136 ceph-mon[125702]: pgmap v4649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:46 smithi057 ceph-mon[92072]: pgmap v4649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:46 smithi122 ceph-mon[125440]: pgmap v4649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:48 smithi136 ceph-mon[125702]: pgmap v4650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:48 smithi057 ceph-mon[92072]: pgmap v4650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:48 smithi122 ceph-mon[125440]: pgmap v4650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:50 smithi136 ceph-mon[125702]: pgmap v4651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:50 smithi057 ceph-mon[92072]: pgmap v4651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:50 smithi122 ceph-mon[125440]: pgmap v4651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:52 smithi136 ceph-mon[125702]: pgmap v4652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:52 smithi057 ceph-mon[92072]: pgmap v4652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:52 smithi122 ceph-mon[125440]: pgmap v4652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:54 smithi136 ceph-mon[125702]: pgmap v4653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:54 smithi057 ceph-mon[92072]: pgmap v4653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:54 smithi122 ceph-mon[125440]: pgmap v4653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:55.684+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:22:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:55.684+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:22:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:55.684+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:22:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:55.684+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:22:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:22:55.684+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:22:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:56 smithi057 ceph-mon[92072]: pgmap v4654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:56 smithi122 ceph-mon[125440]: pgmap v4654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:56 smithi136 ceph-mon[125702]: pgmap v4654: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:22:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:22:58 smithi057 ceph-mon[92072]: pgmap v4655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:22:58 smithi122 ceph-mon[125440]: pgmap v4655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:22:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:22:58 smithi136 ceph-mon[125702]: pgmap v4655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:00 smithi057 ceph-mon[92072]: pgmap v4656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:00 smithi122 ceph-mon[125440]: pgmap v4656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:00 smithi136 ceph-mon[125702]: pgmap v4656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:02 smithi057 ceph-mon[92072]: pgmap v4657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:02 smithi122 ceph-mon[125440]: pgmap v4657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:02 smithi136 ceph-mon[125702]: pgmap v4657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:04 smithi057 ceph-mon[92072]: pgmap v4658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:23:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:04 smithi122 ceph-mon[125440]: pgmap v4658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:23:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:04 smithi136 ceph-mon[125702]: pgmap v4658: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:23:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:06 smithi057 ceph-mon[92072]: pgmap v4659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:23:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:06 smithi122 ceph-mon[125440]: pgmap v4659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:23:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:06 smithi136 ceph-mon[125702]: pgmap v4659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:23:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:08 smithi057 ceph-mon[92072]: pgmap v4660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:23:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:08 smithi122 ceph-mon[125440]: pgmap v4660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:23:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:08 smithi136 ceph-mon[125702]: pgmap v4660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:23:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:09.594+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:23:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:09.594+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:23:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:09.595+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 71 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:23:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:09.595+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 70 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:23:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:10.692+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:23:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:10.693+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:23:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:10.693+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:23:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:10.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:23:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:10.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:23:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:10 smithi057 ceph-mon[92072]: pgmap v4661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:23:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:10 smithi122 ceph-mon[125440]: pgmap v4661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:23:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:10 smithi136 ceph-mon[125702]: pgmap v4661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:23:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:11 smithi057 ceph-mon[92072]: osdmap e363: 12 total, 12 up, 12 in 2023-03-02T13:23:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:11 smithi122 ceph-mon[125440]: osdmap e363: 12 total, 12 up, 12 in 2023-03-02T13:23:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:11 smithi136 ceph-mon[125702]: osdmap e363: 12 total, 12 up, 12 in 2023-03-02T13:23:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:12 smithi057 ceph-mon[92072]: pgmap v4663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:23:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:12 smithi122 ceph-mon[125440]: pgmap v4663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:23:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:12 smithi136 ceph-mon[125702]: pgmap v4663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:23:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:14 smithi057 ceph-mon[92072]: pgmap v4664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:23:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:14 smithi122 ceph-mon[125440]: pgmap v4664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:23:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:14 smithi136 ceph-mon[125702]: pgmap v4664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:23:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:16 smithi057 ceph-mon[92072]: pgmap v4665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:23:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:16 smithi057 ceph-mon[92072]: osdmap e364: 12 total, 12 up, 12 in 2023-03-02T13:23:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:16 smithi122 ceph-mon[125440]: pgmap v4665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:23:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:16 smithi122 ceph-mon[125440]: osdmap e364: 12 total, 12 up, 12 in 2023-03-02T13:23:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:16 smithi136 ceph-mon[125702]: pgmap v4665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:23:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:16 smithi136 ceph-mon[125702]: osdmap e364: 12 total, 12 up, 12 in 2023-03-02T13:23:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:18 smithi057 ceph-mon[92072]: pgmap v4667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:23:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:18 smithi122 ceph-mon[125440]: pgmap v4667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:23:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:18 smithi136 ceph-mon[125702]: pgmap v4667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:23:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:20 smithi057 ceph-mon[92072]: pgmap v4668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T13:23:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:20 smithi122 ceph-mon[125440]: pgmap v4668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T13:23:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:20 smithi136 ceph-mon[125702]: pgmap v4668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T13:23:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:22 smithi122 ceph-mon[125440]: pgmap v4669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:23:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:22 smithi136 ceph-mon[125702]: pgmap v4669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:23:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:22 smithi057 ceph-mon[92072]: pgmap v4669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:23:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:24 smithi122 ceph-mon[125440]: pgmap v4670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:23:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:24 smithi136 ceph-mon[125702]: pgmap v4670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:23:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:24 smithi057 ceph-mon[92072]: pgmap v4670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:23:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:25.707+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:23:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:25.707+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:23:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:25.707+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:23:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:25.707+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:23:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:25.707+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:23:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:26 smithi122 ceph-mon[125440]: pgmap v4671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:23:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:26 smithi136 ceph-mon[125702]: pgmap v4671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:23:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:26 smithi057 ceph-mon[92072]: pgmap v4671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:23:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:28 smithi136 ceph-mon[125702]: pgmap v4672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:23:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:28 smithi057 ceph-mon[92072]: pgmap v4672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:23:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:28 smithi122 ceph-mon[125440]: pgmap v4672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:23:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:30 smithi136 ceph-mon[125702]: pgmap v4673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:30 smithi057 ceph-mon[92072]: pgmap v4673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:30 smithi122 ceph-mon[125440]: pgmap v4673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:32 smithi136 ceph-mon[125702]: pgmap v4674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:32 smithi057 ceph-mon[92072]: pgmap v4674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:32 smithi122 ceph-mon[125440]: pgmap v4674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:34 smithi136 ceph-mon[125702]: pgmap v4675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:34 smithi057 ceph-mon[92072]: pgmap v4675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:34 smithi122 ceph-mon[125440]: pgmap v4675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:36 smithi136 ceph-mon[125702]: pgmap v4676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:36 smithi057 ceph-mon[92072]: pgmap v4676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:36 smithi122 ceph-mon[125440]: pgmap v4676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:23:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:23:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:23:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:38 smithi136 ceph-mon[125702]: pgmap v4677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:23:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:23:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:23:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:23:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:23:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:38 smithi057 ceph-mon[92072]: pgmap v4677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:23:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:23:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:23:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:23:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:23:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:38 smithi122 ceph-mon[125440]: pgmap v4677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:23:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:23:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:23:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:23:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:23:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:40.717+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:23:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:40.717+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:23:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:40.717+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:23:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:40.717+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:23:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:40.717+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:23:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:40 smithi136 ceph-mon[125702]: pgmap v4678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:40 smithi057 ceph-mon[92072]: pgmap v4678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:40 smithi122 ceph-mon[125440]: pgmap v4678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:42 smithi136 ceph-mon[125702]: pgmap v4679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:42 smithi057 ceph-mon[92072]: pgmap v4679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:42 smithi122 ceph-mon[125440]: pgmap v4679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:44 smithi136 ceph-mon[125702]: pgmap v4680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:44 smithi057 ceph-mon[92072]: pgmap v4680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:44 smithi122 ceph-mon[125440]: pgmap v4680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:46 smithi136 ceph-mon[125702]: pgmap v4681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:46 smithi057 ceph-mon[92072]: pgmap v4681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:46 smithi122 ceph-mon[125440]: pgmap v4681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:48 smithi136 ceph-mon[125702]: pgmap v4682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:48 smithi057 ceph-mon[92072]: pgmap v4682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:48 smithi122 ceph-mon[125440]: pgmap v4682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:50 smithi136 ceph-mon[125702]: pgmap v4683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:50 smithi057 ceph-mon[92072]: pgmap v4683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:50 smithi122 ceph-mon[125440]: pgmap v4683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:52 smithi136 ceph-mon[125702]: pgmap v4684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:52 smithi057 ceph-mon[92072]: pgmap v4684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:52 smithi122 ceph-mon[125440]: pgmap v4684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:54 smithi136 ceph-mon[125702]: pgmap v4685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:54 smithi057 ceph-mon[92072]: pgmap v4685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:54 smithi122 ceph-mon[125440]: pgmap v4685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:55.734+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:23:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:55.734+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:23:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:55.734+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:23:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:55.734+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:23:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:23:55.734+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:23:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:56 smithi136 ceph-mon[125702]: pgmap v4686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:56 smithi057 ceph-mon[92072]: pgmap v4686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:56 smithi122 ceph-mon[125440]: pgmap v4686: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:23:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:23:58 smithi136 ceph-mon[125702]: pgmap v4687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:23:58 smithi057 ceph-mon[92072]: pgmap v4687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:23:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:23:58 smithi122 ceph-mon[125440]: pgmap v4687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:00 smithi136 ceph-mon[125702]: pgmap v4688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:00 smithi057 ceph-mon[92072]: pgmap v4688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:00 smithi122 ceph-mon[125440]: pgmap v4688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:02 smithi136 ceph-mon[125702]: pgmap v4689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:02 smithi057 ceph-mon[92072]: pgmap v4689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:02 smithi122 ceph-mon[125440]: pgmap v4689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:04 smithi136 ceph-mon[125702]: pgmap v4690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:24:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:04 smithi057 ceph-mon[92072]: pgmap v4690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:24:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:04 smithi122 ceph-mon[125440]: pgmap v4690: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:24:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:06 smithi136 ceph-mon[125702]: pgmap v4691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:24:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:06 smithi057 ceph-mon[92072]: pgmap v4691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:24:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:06 smithi122 ceph-mon[125440]: pgmap v4691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:24:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:08 smithi136 ceph-mon[125702]: pgmap v4692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:24:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:08 smithi057 ceph-mon[92072]: pgmap v4692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:24:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:08 smithi122 ceph-mon[125440]: pgmap v4692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:24:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:10 smithi136 ceph-mon[125702]: pgmap v4693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:24:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:10 smithi057 ceph-mon[92072]: pgmap v4693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:24:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:10 smithi122 ceph-mon[125440]: pgmap v4693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:24:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:10.740+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:24:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:10.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:24:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:10.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:24:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:10.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:24:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:10.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:24:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:11 smithi136 ceph-mon[125702]: osdmap e365: 12 total, 12 up, 12 in 2023-03-02T13:24:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:11 smithi057 ceph-mon[92072]: osdmap e365: 12 total, 12 up, 12 in 2023-03-02T13:24:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:11 smithi122 ceph-mon[125440]: osdmap e365: 12 total, 12 up, 12 in 2023-03-02T13:24:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:12 smithi136 ceph-mon[125702]: pgmap v4695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:24:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:12 smithi057 ceph-mon[92072]: pgmap v4695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:24:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:12 smithi122 ceph-mon[125440]: pgmap v4695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:24:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:14 smithi136 ceph-mon[125702]: pgmap v4696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:24:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:14 smithi057 ceph-mon[92072]: pgmap v4696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:24:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:14 smithi122 ceph-mon[125440]: pgmap v4696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:24:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:16 smithi057 ceph-mon[92072]: pgmap v4697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:24:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:16 smithi057 ceph-mon[92072]: osdmap e366: 12 total, 12 up, 12 in 2023-03-02T13:24:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:16 smithi122 ceph-mon[125440]: pgmap v4697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:24:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:16 smithi122 ceph-mon[125440]: osdmap e366: 12 total, 12 up, 12 in 2023-03-02T13:24:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:16 smithi136 ceph-mon[125702]: pgmap v4697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:24:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:16 smithi136 ceph-mon[125702]: osdmap e366: 12 total, 12 up, 12 in 2023-03-02T13:24:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:18 smithi057 ceph-mon[92072]: pgmap v4699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:24:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:18 smithi122 ceph-mon[125440]: pgmap v4699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:24:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:18 smithi136 ceph-mon[125702]: pgmap v4699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:24:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:20 smithi057 ceph-mon[92072]: pgmap v4700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T13:24:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:20 smithi122 ceph-mon[125440]: pgmap v4700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T13:24:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:20 smithi136 ceph-mon[125702]: pgmap v4700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T13:24:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:22 smithi057 ceph-mon[92072]: pgmap v4701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:24:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:22 smithi122 ceph-mon[125440]: pgmap v4701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:24:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:22 smithi136 ceph-mon[125702]: pgmap v4701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:24:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:24 smithi057 ceph-mon[92072]: pgmap v4702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:24:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:24 smithi122 ceph-mon[125440]: pgmap v4702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:24:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:24 smithi136 ceph-mon[125702]: pgmap v4702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:24:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:25.753+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:24:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:25.753+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:24:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:25.753+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:24:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:25.753+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:24:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:25.753+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:24:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:26 smithi057 ceph-mon[92072]: pgmap v4703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:24:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:26 smithi122 ceph-mon[125440]: pgmap v4703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:24:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:26 smithi136 ceph-mon[125702]: pgmap v4703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:24:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:28 smithi057 ceph-mon[92072]: pgmap v4704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:24:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:28 smithi122 ceph-mon[125440]: pgmap v4704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:24:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:28 smithi136 ceph-mon[125702]: pgmap v4704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:24:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:30 smithi057 ceph-mon[92072]: pgmap v4705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:24:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:30 smithi122 ceph-mon[125440]: pgmap v4705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:24:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:30 smithi136 ceph-mon[125702]: pgmap v4705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:24:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:32 smithi057 ceph-mon[92072]: pgmap v4706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:24:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:32 smithi122 ceph-mon[125440]: pgmap v4706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:24:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:32 smithi136 ceph-mon[125702]: pgmap v4706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:24:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:34 smithi057 ceph-mon[92072]: pgmap v4707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:34 smithi122 ceph-mon[125440]: pgmap v4707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:34.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:34 smithi136 ceph-mon[125702]: pgmap v4707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:36 smithi057 ceph-mon[92072]: pgmap v4708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:36 smithi122 ceph-mon[125440]: pgmap v4708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:36.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:36 smithi136 ceph-mon[125702]: pgmap v4708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:38 smithi057 ceph-mon[92072]: pgmap v4709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:38 smithi122 ceph-mon[125440]: pgmap v4709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:38 smithi136 ceph-mon[125702]: pgmap v4709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:24:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:24:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:24:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:40.767+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:24:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:40.767+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:24:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:40.767+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:24:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:40.767+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:24:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:40.767+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:24:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:40 smithi136 ceph-mon[125702]: pgmap v4710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:24:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:24:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:40 smithi057 ceph-mon[92072]: pgmap v4710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:24:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:24:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:40 smithi122 ceph-mon[125440]: pgmap v4710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:24:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:24:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:24:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:42 smithi136 ceph-mon[125702]: pgmap v4711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:42 smithi057 ceph-mon[92072]: pgmap v4711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:42 smithi122 ceph-mon[125440]: pgmap v4711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:44 smithi136 ceph-mon[125702]: pgmap v4712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:44 smithi057 ceph-mon[92072]: pgmap v4712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:44 smithi122 ceph-mon[125440]: pgmap v4712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:46 smithi136 ceph-mon[125702]: pgmap v4713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:46 smithi057 ceph-mon[92072]: pgmap v4713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:46 smithi122 ceph-mon[125440]: pgmap v4713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:48 smithi136 ceph-mon[125702]: pgmap v4714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:48 smithi057 ceph-mon[92072]: pgmap v4714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:48 smithi122 ceph-mon[125440]: pgmap v4714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:50 smithi136 ceph-mon[125702]: pgmap v4715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:50 smithi057 ceph-mon[92072]: pgmap v4715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:50 smithi122 ceph-mon[125440]: pgmap v4715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:52 smithi136 ceph-mon[125702]: pgmap v4716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:52 smithi057 ceph-mon[92072]: pgmap v4716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:52 smithi122 ceph-mon[125440]: pgmap v4716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:54 smithi136 ceph-mon[125702]: pgmap v4717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:54 smithi057 ceph-mon[92072]: pgmap v4717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:54 smithi122 ceph-mon[125440]: pgmap v4717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:55.781+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:24:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:55.781+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:24:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:55.781+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:24:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:55.781+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:24:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:24:55.781+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:24:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:56 smithi136 ceph-mon[125702]: pgmap v4718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:56 smithi057 ceph-mon[92072]: pgmap v4718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:56 smithi122 ceph-mon[125440]: pgmap v4718: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:24:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:24:58 smithi136 ceph-mon[125702]: pgmap v4719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:24:58 smithi057 ceph-mon[92072]: pgmap v4719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:24:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:24:58 smithi122 ceph-mon[125440]: pgmap v4719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:00 smithi136 ceph-mon[125702]: pgmap v4720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:00 smithi057 ceph-mon[92072]: pgmap v4720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:00 smithi122 ceph-mon[125440]: pgmap v4720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:02 smithi136 ceph-mon[125702]: pgmap v4721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:02 smithi057 ceph-mon[92072]: pgmap v4721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:02 smithi122 ceph-mon[125440]: pgmap v4721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:04 smithi136 ceph-mon[125702]: pgmap v4722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:25:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:04 smithi057 ceph-mon[92072]: pgmap v4722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:25:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:04 smithi122 ceph-mon[125440]: pgmap v4722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:25:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:06 smithi057 ceph-mon[92072]: pgmap v4723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:25:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:06 smithi122 ceph-mon[125440]: pgmap v4723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:25:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:06 smithi136 ceph-mon[125702]: pgmap v4723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:25:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:08 smithi057 ceph-mon[92072]: pgmap v4724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:25:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:08 smithi122 ceph-mon[125440]: pgmap v4724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:25:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:08 smithi136 ceph-mon[125702]: pgmap v4724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:25:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:10.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:25:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:10.794+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:25:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:10.794+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:25:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:10.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:25:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:10.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:25:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:10 smithi057 ceph-mon[92072]: pgmap v4725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:25:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:10 smithi122 ceph-mon[125440]: pgmap v4725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:25:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:10 smithi136 ceph-mon[125702]: pgmap v4725: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:25:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:11 smithi057 ceph-mon[92072]: osdmap e367: 12 total, 12 up, 12 in 2023-03-02T13:25:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:11 smithi122 ceph-mon[125440]: osdmap e367: 12 total, 12 up, 12 in 2023-03-02T13:25:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:11 smithi136 ceph-mon[125702]: osdmap e367: 12 total, 12 up, 12 in 2023-03-02T13:25:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:12 smithi057 ceph-mon[92072]: pgmap v4727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:25:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:12 smithi122 ceph-mon[125440]: pgmap v4727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:25:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:12 smithi136 ceph-mon[125702]: pgmap v4727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:25:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:14 smithi057 ceph-mon[92072]: pgmap v4728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:25:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:14 smithi122 ceph-mon[125440]: pgmap v4728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:25:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:14 smithi136 ceph-mon[125702]: pgmap v4728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:25:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:16 smithi057 ceph-mon[92072]: pgmap v4729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:25:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:16 smithi057 ceph-mon[92072]: osdmap e368: 12 total, 12 up, 12 in 2023-03-02T13:25:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:16 smithi122 ceph-mon[125440]: pgmap v4729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:25:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:16 smithi122 ceph-mon[125440]: osdmap e368: 12 total, 12 up, 12 in 2023-03-02T13:25:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:16 smithi136 ceph-mon[125702]: pgmap v4729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:25:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:16 smithi136 ceph-mon[125702]: osdmap e368: 12 total, 12 up, 12 in 2023-03-02T13:25:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:18 smithi057 ceph-mon[92072]: pgmap v4731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:25:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:18 smithi122 ceph-mon[125440]: pgmap v4731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:25:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:18 smithi136 ceph-mon[125702]: pgmap v4731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:25:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:20 smithi057 ceph-mon[92072]: pgmap v4732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T13:25:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:20 smithi122 ceph-mon[125440]: pgmap v4732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T13:25:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:20 smithi136 ceph-mon[125702]: pgmap v4732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T13:25:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:22 smithi057 ceph-mon[92072]: pgmap v4733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:25:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:22 smithi122 ceph-mon[125440]: pgmap v4733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:25:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:22 smithi136 ceph-mon[125702]: pgmap v4733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:25:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:24 smithi057 ceph-mon[92072]: pgmap v4734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:25:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:24 smithi122 ceph-mon[125440]: pgmap v4734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:25:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:24 smithi136 ceph-mon[125702]: pgmap v4734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:25:25.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:25.810+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:25:25.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:25.810+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:25:25.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:25.810+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:25:25.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:25.810+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:25:25.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:25.810+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:25:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:26 smithi057 ceph-mon[92072]: pgmap v4735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:25:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:26 smithi122 ceph-mon[125440]: pgmap v4735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:25:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:26 smithi136 ceph-mon[125702]: pgmap v4735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:25:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:28 smithi057 ceph-mon[92072]: pgmap v4736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:25:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:28 smithi122 ceph-mon[125440]: pgmap v4736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:25:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:28 smithi136 ceph-mon[125702]: pgmap v4736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:25:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:30 smithi057 ceph-mon[92072]: pgmap v4737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:30 smithi122 ceph-mon[125440]: pgmap v4737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:30 smithi136 ceph-mon[125702]: pgmap v4737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:32 smithi057 ceph-mon[92072]: pgmap v4738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:32 smithi122 ceph-mon[125440]: pgmap v4738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:32 smithi136 ceph-mon[125702]: pgmap v4738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:34 smithi122 ceph-mon[125440]: pgmap v4739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:34 smithi136 ceph-mon[125702]: pgmap v4739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:34 smithi057 ceph-mon[92072]: pgmap v4739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:36 smithi122 ceph-mon[125440]: pgmap v4740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:36 smithi136 ceph-mon[125702]: pgmap v4740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:36 smithi057 ceph-mon[92072]: pgmap v4740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:38 smithi122 ceph-mon[125440]: pgmap v4741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:38 smithi136 ceph-mon[125702]: pgmap v4741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:38 smithi057 ceph-mon[92072]: pgmap v4741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:40.826+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:25:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:40.826+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:25:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:40.826+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:25:40.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:40.826+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:25:40.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:40.826+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:25:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:40 smithi122 ceph-mon[125440]: pgmap v4742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:25:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:40 smithi136 ceph-mon[125702]: pgmap v4742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:25:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:40 smithi057 ceph-mon[92072]: pgmap v4742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:25:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:25:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:25:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:25:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:25:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:25:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:25:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:25:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:25:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:25:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:42 smithi136 ceph-mon[125702]: pgmap v4743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:42 smithi057 ceph-mon[92072]: pgmap v4743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:42 smithi122 ceph-mon[125440]: pgmap v4743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:44 smithi136 ceph-mon[125702]: pgmap v4744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:44 smithi057 ceph-mon[92072]: pgmap v4744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:44 smithi122 ceph-mon[125440]: pgmap v4744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:46 smithi136 ceph-mon[125702]: pgmap v4745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:46 smithi057 ceph-mon[92072]: pgmap v4745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:46 smithi122 ceph-mon[125440]: pgmap v4745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:48 smithi136 ceph-mon[125702]: pgmap v4746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:48 smithi057 ceph-mon[92072]: pgmap v4746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:48 smithi122 ceph-mon[125440]: pgmap v4746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:50 smithi136 ceph-mon[125702]: pgmap v4747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:50 smithi057 ceph-mon[92072]: pgmap v4747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:50 smithi122 ceph-mon[125440]: pgmap v4747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:52 smithi136 ceph-mon[125702]: pgmap v4748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:52 smithi057 ceph-mon[92072]: pgmap v4748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:52 smithi122 ceph-mon[125440]: pgmap v4748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:54 smithi136 ceph-mon[125702]: pgmap v4749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:54 smithi057 ceph-mon[92072]: pgmap v4749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:54 smithi122 ceph-mon[125440]: pgmap v4749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:55.843 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:55.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:25:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:55.841+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:25:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:55.841+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:25:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:55.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:25:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:25:55.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:25:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:56 smithi136 ceph-mon[125702]: pgmap v4750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:56 smithi057 ceph-mon[92072]: pgmap v4750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:56 smithi122 ceph-mon[125440]: pgmap v4750: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:25:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:25:58 smithi136 ceph-mon[125702]: pgmap v4751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:25:58 smithi057 ceph-mon[92072]: pgmap v4751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:25:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:25:58 smithi122 ceph-mon[125440]: pgmap v4751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:00 smithi136 ceph-mon[125702]: pgmap v4752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:00 smithi057 ceph-mon[92072]: pgmap v4752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:00 smithi122 ceph-mon[125440]: pgmap v4752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:02 smithi136 ceph-mon[125702]: pgmap v4753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:02 smithi057 ceph-mon[92072]: pgmap v4753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:02 smithi122 ceph-mon[125440]: pgmap v4753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:04 smithi136 ceph-mon[125702]: pgmap v4754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:26:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:04 smithi057 ceph-mon[92072]: pgmap v4754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:26:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:04 smithi122 ceph-mon[125440]: pgmap v4754: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:26:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:06 smithi136 ceph-mon[125702]: pgmap v4755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:26:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:06 smithi136 ceph-mon[125702]: osdmap e369: 12 total, 12 up, 12 in 2023-03-02T13:26:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:06 smithi057 ceph-mon[92072]: pgmap v4755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:26:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:06 smithi057 ceph-mon[92072]: osdmap e369: 12 total, 12 up, 12 in 2023-03-02T13:26:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:06 smithi122 ceph-mon[125440]: pgmap v4755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:26:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:06 smithi122 ceph-mon[125440]: osdmap e369: 12 total, 12 up, 12 in 2023-03-02T13:26:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:08 smithi136 ceph-mon[125702]: pgmap v4757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:26:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:08 smithi057 ceph-mon[92072]: pgmap v4757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:26:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:08 smithi122 ceph-mon[125440]: pgmap v4757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:26:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:09.622+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:26:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:09.622+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:26:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:09.622+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 71 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:26:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:09.622+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 72 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:26:10.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:10.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:26:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:10.856+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:26:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:10.856+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:26:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:10.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:26:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:10.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:26:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:10 smithi136 ceph-mon[125702]: pgmap v4758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:26:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:10 smithi057 ceph-mon[92072]: pgmap v4758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:26:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:10 smithi122 ceph-mon[125440]: pgmap v4758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:26:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:12 smithi136 ceph-mon[125702]: pgmap v4759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:26:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:12 smithi136 ceph-mon[125702]: osdmap e370: 12 total, 12 up, 12 in 2023-03-02T13:26:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:12 smithi057 ceph-mon[92072]: pgmap v4759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:26:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:12 smithi057 ceph-mon[92072]: osdmap e370: 12 total, 12 up, 12 in 2023-03-02T13:26:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:12 smithi122 ceph-mon[125440]: pgmap v4759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:26:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:12 smithi122 ceph-mon[125440]: osdmap e370: 12 total, 12 up, 12 in 2023-03-02T13:26:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:14 smithi136 ceph-mon[125702]: pgmap v4761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:26:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:14 smithi057 ceph-mon[92072]: pgmap v4761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:26:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:14 smithi122 ceph-mon[125440]: pgmap v4761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:26:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:16 smithi136 ceph-mon[125702]: pgmap v4762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 217 B/s wr, 11 op/s 2023-03-02T13:26:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:16 smithi057 ceph-mon[92072]: pgmap v4762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 217 B/s wr, 11 op/s 2023-03-02T13:26:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:16 smithi122 ceph-mon[125440]: pgmap v4762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 217 B/s wr, 11 op/s 2023-03-02T13:26:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:18 smithi136 ceph-mon[125702]: pgmap v4763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:26:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:18 smithi057 ceph-mon[92072]: pgmap v4763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:26:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:18 smithi122 ceph-mon[125440]: pgmap v4763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:26:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:20 smithi136 ceph-mon[125702]: pgmap v4764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:26:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:20 smithi057 ceph-mon[92072]: pgmap v4764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:26:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:20 smithi122 ceph-mon[125440]: pgmap v4764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:26:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:22 smithi136 ceph-mon[125702]: pgmap v4765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:26:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:22 smithi057 ceph-mon[92072]: pgmap v4765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:26:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:22 smithi122 ceph-mon[125440]: pgmap v4765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:26:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:24 smithi136 ceph-mon[125702]: pgmap v4766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:26:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:24 smithi057 ceph-mon[92072]: pgmap v4766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:26:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:24 smithi122 ceph-mon[125440]: pgmap v4766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:26:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:25.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:26:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:25.867+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:26:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:25.867+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:26:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:25.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:26:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:25.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:26:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:26 smithi136 ceph-mon[125702]: pgmap v4767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:26 smithi057 ceph-mon[92072]: pgmap v4767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:26 smithi122 ceph-mon[125440]: pgmap v4767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:28 smithi136 ceph-mon[125702]: pgmap v4768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:28 smithi057 ceph-mon[92072]: pgmap v4768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:28 smithi122 ceph-mon[125440]: pgmap v4768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:30 smithi136 ceph-mon[125702]: pgmap v4769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:30 smithi057 ceph-mon[92072]: pgmap v4769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:30 smithi122 ceph-mon[125440]: pgmap v4769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:32 smithi136 ceph-mon[125702]: pgmap v4770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:32 smithi057 ceph-mon[92072]: pgmap v4770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:32 smithi122 ceph-mon[125440]: pgmap v4770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:34 smithi057 ceph-mon[92072]: pgmap v4771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:34 smithi122 ceph-mon[125440]: pgmap v4771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:34 smithi136 ceph-mon[125702]: pgmap v4771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:36 smithi057 ceph-mon[92072]: pgmap v4772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:36 smithi122 ceph-mon[125440]: pgmap v4772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:36 smithi136 ceph-mon[125702]: pgmap v4772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:38 smithi057 ceph-mon[92072]: pgmap v4773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:38 smithi122 ceph-mon[125440]: pgmap v4773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:38 smithi136 ceph-mon[125702]: pgmap v4773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:40 smithi057 ceph-mon[92072]: pgmap v4774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:40 smithi122 ceph-mon[125440]: pgmap v4774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:40 smithi136 ceph-mon[125702]: pgmap v4774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:40.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:40.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:26:40.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:40.874+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:26:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:40.874+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:26:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:40.874+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:26:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:40.874+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:26:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:26:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:26:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:26:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:42 smithi057 ceph-mon[92072]: pgmap v4775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:26:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:26:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:26:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:42 smithi122 ceph-mon[125440]: pgmap v4775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:26:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:26:42.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:26:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:42 smithi136 ceph-mon[125702]: pgmap v4775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:26:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:26:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:26:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:44 smithi057 ceph-mon[92072]: pgmap v4776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:44 smithi122 ceph-mon[125440]: pgmap v4776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:44 smithi136 ceph-mon[125702]: pgmap v4776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:46 smithi057 ceph-mon[92072]: pgmap v4777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:46 smithi122 ceph-mon[125440]: pgmap v4777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:46 smithi136 ceph-mon[125702]: pgmap v4777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:48 smithi057 ceph-mon[92072]: pgmap v4778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:48 smithi122 ceph-mon[125440]: pgmap v4778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:48 smithi136 ceph-mon[125702]: pgmap v4778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:50 smithi057 ceph-mon[92072]: pgmap v4779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:50 smithi122 ceph-mon[125440]: pgmap v4779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:50 smithi136 ceph-mon[125702]: pgmap v4779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:52 smithi057 ceph-mon[92072]: pgmap v4780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:52 smithi122 ceph-mon[125440]: pgmap v4780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:52 smithi136 ceph-mon[125702]: pgmap v4780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:54 smithi057 ceph-mon[92072]: pgmap v4781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:54 smithi122 ceph-mon[125440]: pgmap v4781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:54 smithi136 ceph-mon[125702]: pgmap v4781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:55.886+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:26:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:55.886+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:26:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:55.886+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:26:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:55.886+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:26:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:26:55.886+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:26:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:56 smithi057 ceph-mon[92072]: pgmap v4782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:56 smithi122 ceph-mon[125440]: pgmap v4782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:56 smithi136 ceph-mon[125702]: pgmap v4782: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:26:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:26:58 smithi057 ceph-mon[92072]: pgmap v4783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:26:58 smithi122 ceph-mon[125440]: pgmap v4783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:26:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:26:58 smithi136 ceph-mon[125702]: pgmap v4783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:00 smithi057 ceph-mon[92072]: pgmap v4784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:00 smithi122 ceph-mon[125440]: pgmap v4784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:00 smithi136 ceph-mon[125702]: pgmap v4784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:02 smithi057 ceph-mon[92072]: pgmap v4785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:02 smithi122 ceph-mon[125440]: pgmap v4785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:02 smithi136 ceph-mon[125702]: pgmap v4785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:04 smithi057 ceph-mon[92072]: pgmap v4786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:27:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:04 smithi122 ceph-mon[125440]: pgmap v4786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:27:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:04 smithi136 ceph-mon[125702]: pgmap v4786: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:27:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:06 smithi122 ceph-mon[125440]: pgmap v4787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:27:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:06 smithi122 ceph-mon[125440]: osdmap e371: 12 total, 12 up, 12 in 2023-03-02T13:27:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:06 smithi136 ceph-mon[125702]: pgmap v4787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:27:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:06 smithi136 ceph-mon[125702]: osdmap e371: 12 total, 12 up, 12 in 2023-03-02T13:27:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:06 smithi057 ceph-mon[92072]: pgmap v4787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:27:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:06 smithi057 ceph-mon[92072]: osdmap e371: 12 total, 12 up, 12 in 2023-03-02T13:27:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:08 smithi122 ceph-mon[125440]: pgmap v4789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:27:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:08 smithi136 ceph-mon[125702]: pgmap v4789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:27:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:08 smithi057 ceph-mon[92072]: pgmap v4789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:27:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:10 smithi136 ceph-mon[125702]: pgmap v4790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:27:10.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:10.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:27:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:10.889+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:27:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:10.889+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:27:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:10.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:27:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:10.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:27:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:10 smithi057 ceph-mon[92072]: pgmap v4790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:27:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:10 smithi122 ceph-mon[125440]: pgmap v4790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:27:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:12 smithi136 ceph-mon[125702]: pgmap v4791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:27:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:12 smithi136 ceph-mon[125702]: osdmap e372: 12 total, 12 up, 12 in 2023-03-02T13:27:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:12 smithi057 ceph-mon[92072]: pgmap v4791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:27:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:12 smithi057 ceph-mon[92072]: osdmap e372: 12 total, 12 up, 12 in 2023-03-02T13:27:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:12 smithi122 ceph-mon[125440]: pgmap v4791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:27:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:12 smithi122 ceph-mon[125440]: osdmap e372: 12 total, 12 up, 12 in 2023-03-02T13:27:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:14 smithi136 ceph-mon[125702]: pgmap v4793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:27:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:14 smithi057 ceph-mon[92072]: pgmap v4793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:27:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:14 smithi122 ceph-mon[125440]: pgmap v4793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:27:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:16 smithi136 ceph-mon[125702]: pgmap v4794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T13:27:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:16 smithi057 ceph-mon[92072]: pgmap v4794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T13:27:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:16 smithi122 ceph-mon[125440]: pgmap v4794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T13:27:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:18 smithi136 ceph-mon[125702]: pgmap v4795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:27:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:18 smithi057 ceph-mon[92072]: pgmap v4795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:27:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:18 smithi122 ceph-mon[125440]: pgmap v4795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:27:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:20 smithi136 ceph-mon[125702]: pgmap v4796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:27:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:20 smithi057 ceph-mon[92072]: pgmap v4796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:27:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:20 smithi122 ceph-mon[125440]: pgmap v4796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:27:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:22 smithi136 ceph-mon[125702]: pgmap v4797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:27:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:22 smithi057 ceph-mon[92072]: pgmap v4797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:27:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:22 smithi122 ceph-mon[125440]: pgmap v4797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:27:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:24 smithi057 ceph-mon[92072]: pgmap v4798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:27:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:24 smithi122 ceph-mon[125440]: pgmap v4798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:27:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:24 smithi136 ceph-mon[125702]: pgmap v4798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:27:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:25.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:27:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:25.892+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:27:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:25.892+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:27:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:25.892+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:27:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:25.892+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:27:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:26 smithi057 ceph-mon[92072]: pgmap v4799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:26 smithi122 ceph-mon[125440]: pgmap v4799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:26 smithi136 ceph-mon[125702]: pgmap v4799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:28 smithi057 ceph-mon[92072]: pgmap v4800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:28 smithi122 ceph-mon[125440]: pgmap v4800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:28 smithi136 ceph-mon[125702]: pgmap v4800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:30 smithi057 ceph-mon[92072]: pgmap v4801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:30 smithi122 ceph-mon[125440]: pgmap v4801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:30 smithi136 ceph-mon[125702]: pgmap v4801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:32 smithi057 ceph-mon[92072]: pgmap v4802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:32 smithi122 ceph-mon[125440]: pgmap v4802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:32.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:32 smithi136 ceph-mon[125702]: pgmap v4802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:34 smithi057 ceph-mon[92072]: pgmap v4803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:34 smithi122 ceph-mon[125440]: pgmap v4803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:34 smithi136 ceph-mon[125702]: pgmap v4803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:36 smithi057 ceph-mon[92072]: pgmap v4804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:36 smithi122 ceph-mon[125440]: pgmap v4804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:36 smithi136 ceph-mon[125702]: pgmap v4804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:38 smithi057 ceph-mon[92072]: pgmap v4805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:38 smithi122 ceph-mon[125440]: pgmap v4805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:38 smithi136 ceph-mon[125702]: pgmap v4805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:39.635+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:27:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:39.635+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:27:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:39.635+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 73 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:27:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:39.635+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 72 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:27:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:40 smithi057 ceph-mon[92072]: pgmap v4806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:40 smithi122 ceph-mon[125440]: pgmap v4806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:40 smithi136 ceph-mon[125702]: pgmap v4806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:40.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:40.907+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:27:40.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:40.907+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:27:40.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:40.907+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:27:40.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:40.907+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:27:40.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:40.908+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:27:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:42 smithi057 ceph-mon[92072]: pgmap v4807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:27:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:42 smithi122 ceph-mon[125440]: pgmap v4807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:27:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:42 smithi136 ceph-mon[125702]: pgmap v4807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:27:44.544 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:44 smithi057 ceph-mon[92072]: pgmap v4808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:44 smithi122 ceph-mon[125440]: pgmap v4808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:44 smithi136 ceph-mon[125702]: pgmap v4808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:46 smithi057 ceph-mon[92072]: pgmap v4809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:27:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:27:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:27:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:27:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:27:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:46 smithi122 ceph-mon[125440]: pgmap v4809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:27:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:27:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:27:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:27:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:27:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:46 smithi136 ceph-mon[125702]: pgmap v4809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:27:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:27:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:27:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:27:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:27:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:48 smithi057 ceph-mon[92072]: pgmap v4810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:48 smithi122 ceph-mon[125440]: pgmap v4810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:48 smithi136 ceph-mon[125702]: pgmap v4810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:50 smithi057 ceph-mon[92072]: pgmap v4811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:50 smithi122 ceph-mon[125440]: pgmap v4811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:50 smithi136 ceph-mon[125702]: pgmap v4811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:52 smithi057 ceph-mon[92072]: pgmap v4812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:52 smithi122 ceph-mon[125440]: pgmap v4812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:52 smithi136 ceph-mon[125702]: pgmap v4812: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:54 smithi057 ceph-mon[92072]: pgmap v4813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:54 smithi122 ceph-mon[125440]: pgmap v4813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:54 smithi136 ceph-mon[125702]: pgmap v4813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:55.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:27:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:55.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:27:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:55.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:27:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:55.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:27:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:27:55.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:27:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:56 smithi057 ceph-mon[92072]: pgmap v4814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:56 smithi122 ceph-mon[125440]: pgmap v4814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:56 smithi136 ceph-mon[125702]: pgmap v4814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:27:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:27:58 smithi057 ceph-mon[92072]: pgmap v4815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:27:58 smithi122 ceph-mon[125440]: pgmap v4815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:27:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:27:58 smithi136 ceph-mon[125702]: pgmap v4815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:00 smithi057 ceph-mon[92072]: pgmap v4816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:00 smithi122 ceph-mon[125440]: pgmap v4816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:00 smithi136 ceph-mon[125702]: pgmap v4816: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:02 smithi057 ceph-mon[92072]: pgmap v4817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:02 smithi122 ceph-mon[125440]: pgmap v4817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:02 smithi136 ceph-mon[125702]: pgmap v4817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:04 smithi057 ceph-mon[92072]: pgmap v4818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:28:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:04 smithi122 ceph-mon[125440]: pgmap v4818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:28:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:04 smithi136 ceph-mon[125702]: pgmap v4818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:28:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:06 smithi057 ceph-mon[92072]: pgmap v4819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:28:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:06 smithi122 ceph-mon[125440]: pgmap v4819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:28:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:06 smithi136 ceph-mon[125702]: pgmap v4819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:28:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:08 smithi057 ceph-mon[92072]: pgmap v4820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:28:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:08 smithi122 ceph-mon[125440]: pgmap v4820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:28:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:08 smithi136 ceph-mon[125702]: pgmap v4820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:28:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:10 smithi122 ceph-mon[125440]: pgmap v4821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:28:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:10 smithi136 ceph-mon[125702]: pgmap v4821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:28:10.925 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:10.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:28:10.926 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:10.924+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:28:10.926 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:10.924+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:28:10.926 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:10.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:28:10.926 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:10.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:28:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:10 smithi057 ceph-mon[92072]: pgmap v4821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:28:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:11 smithi122 ceph-mon[125440]: osdmap e373: 12 total, 12 up, 12 in 2023-03-02T13:28:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:11 smithi136 ceph-mon[125702]: osdmap e373: 12 total, 12 up, 12 in 2023-03-02T13:28:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:11 smithi057 ceph-mon[92072]: osdmap e373: 12 total, 12 up, 12 in 2023-03-02T13:28:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:12 smithi122 ceph-mon[125440]: pgmap v4823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:28:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:12 smithi136 ceph-mon[125702]: pgmap v4823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:28:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:12 smithi057 ceph-mon[92072]: pgmap v4823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:28:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:14 smithi136 ceph-mon[125702]: pgmap v4824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:14 smithi057 ceph-mon[92072]: pgmap v4824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:14 smithi122 ceph-mon[125440]: pgmap v4824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:16 smithi136 ceph-mon[125702]: pgmap v4825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:16 smithi136 ceph-mon[125702]: osdmap e374: 12 total, 12 up, 12 in 2023-03-02T13:28:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:16 smithi057 ceph-mon[92072]: pgmap v4825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:16 smithi057 ceph-mon[92072]: osdmap e374: 12 total, 12 up, 12 in 2023-03-02T13:28:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:16 smithi122 ceph-mon[125440]: pgmap v4825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:16 smithi122 ceph-mon[125440]: osdmap e374: 12 total, 12 up, 12 in 2023-03-02T13:28:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:18 smithi136 ceph-mon[125702]: pgmap v4827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:28:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:18 smithi057 ceph-mon[92072]: pgmap v4827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:28:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:18 smithi122 ceph-mon[125440]: pgmap v4827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:28:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:20 smithi136 ceph-mon[125702]: pgmap v4828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-02T13:28:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:20 smithi057 ceph-mon[92072]: pgmap v4828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-02T13:28:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:20 smithi122 ceph-mon[125440]: pgmap v4828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-02T13:28:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:22 smithi136 ceph-mon[125702]: pgmap v4829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T13:28:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:22 smithi057 ceph-mon[92072]: pgmap v4829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T13:28:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:22 smithi122 ceph-mon[125440]: pgmap v4829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T13:28:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:24 smithi136 ceph-mon[125702]: pgmap v4830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:24 smithi057 ceph-mon[92072]: pgmap v4830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:24 smithi122 ceph-mon[125440]: pgmap v4830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:25.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:28:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:25.938+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:28:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:25.938+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:28:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:25.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:28:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:25.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:28:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:26 smithi136 ceph-mon[125702]: pgmap v4831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:26 smithi057 ceph-mon[92072]: pgmap v4831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:26 smithi122 ceph-mon[125440]: pgmap v4831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:28:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:28 smithi136 ceph-mon[125702]: pgmap v4832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 188 B/s wr, 14 op/s 2023-03-02T13:28:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:28 smithi057 ceph-mon[92072]: pgmap v4832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 188 B/s wr, 14 op/s 2023-03-02T13:28:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:28 smithi122 ceph-mon[125440]: pgmap v4832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 188 B/s wr, 14 op/s 2023-03-02T13:28:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:30 smithi136 ceph-mon[125702]: pgmap v4833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:30 smithi057 ceph-mon[92072]: pgmap v4833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:30 smithi122 ceph-mon[125440]: pgmap v4833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:32 smithi136 ceph-mon[125702]: pgmap v4834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:32 smithi057 ceph-mon[92072]: pgmap v4834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:32 smithi122 ceph-mon[125440]: pgmap v4834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:34 smithi136 ceph-mon[125702]: pgmap v4835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:34 smithi057 ceph-mon[92072]: pgmap v4835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:34 smithi122 ceph-mon[125440]: pgmap v4835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:36 smithi136 ceph-mon[125702]: pgmap v4836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:36 smithi057 ceph-mon[92072]: pgmap v4836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:36 smithi122 ceph-mon[125440]: pgmap v4836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:38 smithi136 ceph-mon[125702]: pgmap v4837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:38 smithi057 ceph-mon[92072]: pgmap v4837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:38 smithi122 ceph-mon[125440]: pgmap v4837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:40 smithi136 ceph-mon[125702]: pgmap v4838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:40 smithi057 ceph-mon[92072]: pgmap v4838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:40 smithi122 ceph-mon[125440]: pgmap v4838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:40.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:40.952+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:28:40.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:40.952+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:28:40.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:40.952+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:28:40.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:40.952+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:28:40.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:40.952+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:28:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:42 smithi136 ceph-mon[125702]: pgmap v4839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:42 smithi057 ceph-mon[92072]: pgmap v4839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:42 smithi122 ceph-mon[125440]: pgmap v4839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:44 smithi136 ceph-mon[125702]: pgmap v4840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:44 smithi057 ceph-mon[92072]: pgmap v4840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:44 smithi122 ceph-mon[125440]: pgmap v4840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:46 smithi136 ceph-mon[125702]: pgmap v4841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:28:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:46 smithi057 ceph-mon[92072]: pgmap v4841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:28:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:46 smithi122 ceph-mon[125440]: pgmap v4841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:28:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:48 smithi136 ceph-mon[125702]: pgmap v4842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:48 smithi057 ceph-mon[92072]: pgmap v4842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:48 smithi122 ceph-mon[125440]: pgmap v4842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:50 smithi136 ceph-mon[125702]: pgmap v4843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:50.907 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:50 smithi122 ceph-mon[125440]: pgmap v4843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:50.908 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:50.908 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:50 smithi057 ceph-mon[92072]: pgmap v4843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:52 smithi136 ceph-mon[125702]: pgmap v4844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:52 smithi057 ceph-mon[92072]: pgmap v4844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:52.947 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:52 smithi122 ceph-mon[125440]: pgmap v4844: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:28:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:28:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:28:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:28:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:28:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:28:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:28:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:54 smithi122 ceph-mon[125440]: pgmap v4845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:54 smithi136 ceph-mon[125702]: pgmap v4845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:54 smithi057 ceph-mon[92072]: pgmap v4845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:55.968+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:28:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:55.968+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:28:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:55.968+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:28:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:55.968+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:28:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:28:55.968+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:28:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:56 smithi136 ceph-mon[125702]: pgmap v4846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:56 smithi057 ceph-mon[92072]: pgmap v4846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:56 smithi122 ceph-mon[125440]: pgmap v4846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:28:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:28:58 smithi136 ceph-mon[125702]: pgmap v4847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:28:58 smithi057 ceph-mon[92072]: pgmap v4847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:28:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:28:58 smithi122 ceph-mon[125440]: pgmap v4847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:00 smithi136 ceph-mon[125702]: pgmap v4848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:00 smithi057 ceph-mon[92072]: pgmap v4848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:00 smithi122 ceph-mon[125440]: pgmap v4848: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:02 smithi136 ceph-mon[125702]: pgmap v4849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:02 smithi057 ceph-mon[92072]: pgmap v4849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:02 smithi122 ceph-mon[125440]: pgmap v4849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:04 smithi136 ceph-mon[125702]: pgmap v4850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:29:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:04 smithi057 ceph-mon[92072]: pgmap v4850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:29:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:04 smithi122 ceph-mon[125440]: pgmap v4850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:29:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:06 smithi136 ceph-mon[125702]: pgmap v4851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:29:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:06 smithi057 ceph-mon[92072]: pgmap v4851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:29:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:06 smithi122 ceph-mon[125440]: pgmap v4851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:29:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:08.386+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000256) for more than 900000000 us, fault. 2023-03-02T13:29:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:08.386+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870063000 comp rx=0 tx=0).stop 2023-03-02T13:29:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:08.386+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T13:29:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:08.386+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T13:29:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:08.386+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T13:29:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:08.386+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:29:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:08.387+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f587004a0b0 tx=0x7f5870096000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T13:29:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:09 smithi136 ceph-mon[125702]: pgmap v4852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:29:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:09 smithi057 ceph-mon[92072]: pgmap v4852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:29:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:09 smithi122 ceph-mon[125440]: pgmap v4852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:29:09.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:09.647+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:29:09.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:09.647+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:29:09.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:09.648+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 73 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:29:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:09.648+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 74 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:29:10.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:10.974+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:29:10.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:10.974+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:29:10.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:10.974+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:29:10.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:10.974+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:29:10.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:10.974+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:29:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:11 smithi136 ceph-mon[125702]: pgmap v4853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:29:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:11 smithi057 ceph-mon[92072]: pgmap v4853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:29:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:11 smithi122 ceph-mon[125440]: pgmap v4853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:29:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:12 smithi136 ceph-mon[125702]: osdmap e375: 12 total, 12 up, 12 in 2023-03-02T13:29:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:12 smithi057 ceph-mon[92072]: osdmap e375: 12 total, 12 up, 12 in 2023-03-02T13:29:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:12 smithi122 ceph-mon[125440]: osdmap e375: 12 total, 12 up, 12 in 2023-03-02T13:29:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:13 smithi136 ceph-mon[125702]: pgmap v4855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:29:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:13 smithi057 ceph-mon[92072]: pgmap v4855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:29:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:13 smithi122 ceph-mon[125440]: pgmap v4855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:29:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:14 smithi136 ceph-mon[125702]: pgmap v4856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:29:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:14 smithi057 ceph-mon[92072]: pgmap v4856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:29:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:14 smithi122 ceph-mon[125440]: pgmap v4856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:29:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:16 smithi136 ceph-mon[125702]: pgmap v4857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:29:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:16 smithi057 ceph-mon[92072]: pgmap v4857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:29:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:16 smithi122 ceph-mon[125440]: pgmap v4857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:29:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:17 smithi136 ceph-mon[125702]: osdmap e376: 12 total, 12 up, 12 in 2023-03-02T13:29:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:17 smithi057 ceph-mon[92072]: osdmap e376: 12 total, 12 up, 12 in 2023-03-02T13:29:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:17 smithi122 ceph-mon[125440]: osdmap e376: 12 total, 12 up, 12 in 2023-03-02T13:29:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:18 smithi057 ceph-mon[92072]: pgmap v4859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:29:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:18 smithi122 ceph-mon[125440]: pgmap v4859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:29:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:18 smithi136 ceph-mon[125702]: pgmap v4859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:29:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:20 smithi057 ceph-mon[92072]: pgmap v4860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T13:29:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:20 smithi122 ceph-mon[125440]: pgmap v4860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T13:29:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:20 smithi136 ceph-mon[125702]: pgmap v4860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T13:29:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:22 smithi057 ceph-mon[92072]: pgmap v4861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:29:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:22 smithi122 ceph-mon[125440]: pgmap v4861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:29:22.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:22 smithi136 ceph-mon[125702]: pgmap v4861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:29:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:24 smithi057 ceph-mon[92072]: pgmap v4862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:29:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:24 smithi122 ceph-mon[125440]: pgmap v4862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:29:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:24 smithi136 ceph-mon[125702]: pgmap v4862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:29:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:25.977+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:29:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:25.977+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:29:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:25.977+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:29:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:25.977+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:29:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:25.977+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:29:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:26 smithi057 ceph-mon[92072]: pgmap v4863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:29:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:26 smithi122 ceph-mon[125440]: pgmap v4863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:29:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:26 smithi136 ceph-mon[125702]: pgmap v4863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:29:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:28 smithi057 ceph-mon[92072]: pgmap v4864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:29:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:28 smithi122 ceph-mon[125440]: pgmap v4864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:29:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:28 smithi136 ceph-mon[125702]: pgmap v4864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:29:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:30 smithi057 ceph-mon[92072]: pgmap v4865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:30 smithi122 ceph-mon[125440]: pgmap v4865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:30 smithi136 ceph-mon[125702]: pgmap v4865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:32 smithi057 ceph-mon[92072]: pgmap v4866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:32 smithi122 ceph-mon[125440]: pgmap v4866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:32 smithi136 ceph-mon[125702]: pgmap v4866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:34 smithi057 ceph-mon[92072]: pgmap v4867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:34 smithi122 ceph-mon[125440]: pgmap v4867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:34.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:34 smithi136 ceph-mon[125702]: pgmap v4867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:36 smithi057 ceph-mon[92072]: pgmap v4868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:36 smithi122 ceph-mon[125440]: pgmap v4868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:36 smithi136 ceph-mon[125702]: pgmap v4868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:38 smithi057 ceph-mon[92072]: pgmap v4869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:38 smithi122 ceph-mon[125440]: pgmap v4869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:38.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:38 smithi136 ceph-mon[125702]: pgmap v4869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:40 smithi057 ceph-mon[92072]: pgmap v4870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:40 smithi122 ceph-mon[125440]: pgmap v4870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:40 smithi136 ceph-mon[125702]: pgmap v4870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:40.984+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:29:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:40.985+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:29:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:40.985+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:29:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:40.985+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:29:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:40.985+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:29:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:42 smithi057 ceph-mon[92072]: pgmap v4871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:42 smithi122 ceph-mon[125440]: pgmap v4871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:42 smithi136 ceph-mon[125702]: pgmap v4871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:44 smithi057 ceph-mon[92072]: pgmap v4872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:44 smithi122 ceph-mon[125440]: pgmap v4872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:44.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:44 smithi136 ceph-mon[125702]: pgmap v4872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:46 smithi057 ceph-mon[92072]: pgmap v4873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:46 smithi122 ceph-mon[125440]: pgmap v4873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:46 smithi136 ceph-mon[125702]: pgmap v4873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:48 smithi057 ceph-mon[92072]: pgmap v4874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:48 smithi122 ceph-mon[125440]: pgmap v4874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:48 smithi136 ceph-mon[125702]: pgmap v4874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:50 smithi122 ceph-mon[125440]: pgmap v4875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:50 smithi136 ceph-mon[125702]: pgmap v4875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:50 smithi057 ceph-mon[92072]: pgmap v4875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:52.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:52 smithi122 ceph-mon[125440]: pgmap v4876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:52 smithi136 ceph-mon[125702]: pgmap v4876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:52 smithi057 ceph-mon[92072]: pgmap v4876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:29:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:29:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:29:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:54 smithi122 ceph-mon[125440]: pgmap v4877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:29:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:29:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:29:54.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:54 smithi136 ceph-mon[125702]: pgmap v4877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:29:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:29:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:29:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:54 smithi057 ceph-mon[92072]: pgmap v4877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:29:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:29:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:29:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:56.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:29:56.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:56.001+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:29:56.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:56.001+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:29:56.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:56.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:29:56.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:29:56.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:29:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:56 smithi136 ceph-mon[125702]: pgmap v4878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:56 smithi057 ceph-mon[92072]: pgmap v4878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:56 smithi122 ceph-mon[125440]: pgmap v4878: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:29:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:29:58 smithi136 ceph-mon[125702]: pgmap v4879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:29:58 smithi057 ceph-mon[92072]: pgmap v4879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:29:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:29:58 smithi122 ceph-mon[125440]: pgmap v4879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:00 smithi136 ceph-mon[125702]: pgmap v4880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T13:30:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:00 smithi057 ceph-mon[92072]: pgmap v4880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T13:30:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:00 smithi122 ceph-mon[125440]: pgmap v4880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T13:30:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:02 smithi136 ceph-mon[125702]: pgmap v4881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:02 smithi057 ceph-mon[92072]: pgmap v4881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:02 smithi122 ceph-mon[125440]: pgmap v4881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:04 smithi136 ceph-mon[125702]: pgmap v4882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:30:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:04 smithi057 ceph-mon[92072]: pgmap v4882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:30:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:04 smithi122 ceph-mon[125440]: pgmap v4882: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:30:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:06 smithi136 ceph-mon[125702]: pgmap v4883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:30:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:06 smithi057 ceph-mon[92072]: pgmap v4883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:30:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:06 smithi122 ceph-mon[125440]: pgmap v4883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:30:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:08 smithi136 ceph-mon[125702]: pgmap v4884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:30:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:08 smithi057 ceph-mon[92072]: pgmap v4884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:30:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:08 smithi122 ceph-mon[125440]: pgmap v4884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:30:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:10 smithi122 ceph-mon[125440]: pgmap v4885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:30:10.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:10 smithi136 ceph-mon[125702]: pgmap v4885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:30:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:10 smithi057 ceph-mon[92072]: pgmap v4885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:30:11.012 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:11.011+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:30:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:11.011+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:30:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:11.012+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:30:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:11.012+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:30:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:11.012+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:30:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:11 smithi136 ceph-mon[125702]: osdmap e377: 12 total, 12 up, 12 in 2023-03-02T13:30:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:11 smithi057 ceph-mon[92072]: osdmap e377: 12 total, 12 up, 12 in 2023-03-02T13:30:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:11 smithi122 ceph-mon[125440]: osdmap e377: 12 total, 12 up, 12 in 2023-03-02T13:30:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:12 smithi136 ceph-mon[125702]: pgmap v4887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:30:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:12 smithi057 ceph-mon[92072]: pgmap v4887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:30:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:12 smithi122 ceph-mon[125440]: pgmap v4887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:30:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:14 smithi136 ceph-mon[125702]: pgmap v4888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:30:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:14 smithi057 ceph-mon[92072]: pgmap v4888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:30:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:14 smithi122 ceph-mon[125440]: pgmap v4888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:30:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:16 smithi136 ceph-mon[125702]: pgmap v4889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:30:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:16 smithi136 ceph-mon[125702]: osdmap e378: 12 total, 12 up, 12 in 2023-03-02T13:30:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:16 smithi057 ceph-mon[92072]: pgmap v4889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:30:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:16 smithi057 ceph-mon[92072]: osdmap e378: 12 total, 12 up, 12 in 2023-03-02T13:30:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:16 smithi122 ceph-mon[125440]: pgmap v4889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:30:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:16 smithi122 ceph-mon[125440]: osdmap e378: 12 total, 12 up, 12 in 2023-03-02T13:30:18.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:18 smithi136 ceph-mon[125702]: pgmap v4891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:30:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:18 smithi057 ceph-mon[92072]: pgmap v4891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:30:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:18 smithi122 ceph-mon[125440]: pgmap v4891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:30:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:20 smithi136 ceph-mon[125702]: pgmap v4892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:30:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:20 smithi057 ceph-mon[92072]: pgmap v4892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:30:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:20 smithi122 ceph-mon[125440]: pgmap v4892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:30:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:22 smithi136 ceph-mon[125702]: pgmap v4893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:30:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:22 smithi057 ceph-mon[92072]: pgmap v4893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:30:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:22 smithi122 ceph-mon[125440]: pgmap v4893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:30:24.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:24 smithi136 ceph-mon[125702]: pgmap v4894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:30:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:24 smithi057 ceph-mon[92072]: pgmap v4894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:30:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:24 smithi122 ceph-mon[125440]: pgmap v4894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:30:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:26.016+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:30:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:26.017+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:30:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:26.017+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:30:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:26.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:30:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:26.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:30:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:26 smithi136 ceph-mon[125702]: pgmap v4895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:30:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:26 smithi057 ceph-mon[92072]: pgmap v4895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:30:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:26 smithi122 ceph-mon[125440]: pgmap v4895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:30:28.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:28 smithi136 ceph-mon[125702]: pgmap v4896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:30:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:28 smithi057 ceph-mon[92072]: pgmap v4896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:30:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:28 smithi122 ceph-mon[125440]: pgmap v4896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:30:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:30 smithi136 ceph-mon[125702]: pgmap v4897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:30 smithi057 ceph-mon[92072]: pgmap v4897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:30 smithi122 ceph-mon[125440]: pgmap v4897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:32 smithi136 ceph-mon[125702]: pgmap v4898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:32 smithi057 ceph-mon[92072]: pgmap v4898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:32 smithi122 ceph-mon[125440]: pgmap v4898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:34 smithi136 ceph-mon[125702]: pgmap v4899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:34 smithi057 ceph-mon[92072]: pgmap v4899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:34 smithi122 ceph-mon[125440]: pgmap v4899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:36.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:36 smithi136 ceph-mon[125702]: pgmap v4900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:36 smithi057 ceph-mon[92072]: pgmap v4900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:36 smithi122 ceph-mon[125440]: pgmap v4900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:38 smithi057 ceph-mon[92072]: pgmap v4901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:38 smithi122 ceph-mon[125440]: pgmap v4901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:38 smithi136 ceph-mon[125702]: pgmap v4901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:40 smithi057 ceph-mon[92072]: pgmap v4902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:40 smithi122 ceph-mon[125440]: pgmap v4902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:41.027+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:30:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:41.027+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:30:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:41.027+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:30:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:41.027+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:30:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:41.027+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:30:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:40 smithi136 ceph-mon[125702]: pgmap v4902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:42 smithi057 ceph-mon[92072]: pgmap v4903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:42 smithi122 ceph-mon[125440]: pgmap v4903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:42 smithi136 ceph-mon[125702]: pgmap v4903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:44 smithi057 ceph-mon[92072]: pgmap v4904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:44 smithi122 ceph-mon[125440]: pgmap v4904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:44 smithi136 ceph-mon[125702]: pgmap v4904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:46 smithi057 ceph-mon[92072]: pgmap v4905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:46 smithi122 ceph-mon[125440]: pgmap v4905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:46 smithi136 ceph-mon[125702]: pgmap v4905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:48 smithi057 ceph-mon[92072]: pgmap v4906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:48 smithi122 ceph-mon[125440]: pgmap v4906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:48 smithi136 ceph-mon[125702]: pgmap v4906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:50 smithi057 ceph-mon[92072]: pgmap v4907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:50 smithi122 ceph-mon[125440]: pgmap v4907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:50 smithi136 ceph-mon[125702]: pgmap v4907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:52 smithi057 ceph-mon[92072]: pgmap v4908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:52 smithi122 ceph-mon[125440]: pgmap v4908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:52 smithi136 ceph-mon[125702]: pgmap v4908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:54 smithi057 ceph-mon[92072]: pgmap v4909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:30:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:54 smithi122 ceph-mon[125440]: pgmap v4909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:30:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:54 smithi136 ceph-mon[125702]: pgmap v4909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:30:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:56.038+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:30:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:56.038+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:30:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:56.038+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:30:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:56.038+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:30:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:30:56.038+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:30:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:56 smithi057 ceph-mon[92072]: pgmap v4910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:30:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:30:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:56 smithi122 ceph-mon[125440]: pgmap v4910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:30:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:30:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:56 smithi136 ceph-mon[125702]: pgmap v4910: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:30:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:30:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:30:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:30:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:30:58 smithi057 ceph-mon[92072]: pgmap v4911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:30:58 smithi122 ceph-mon[125440]: pgmap v4911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:30:58.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:30:58 smithi136 ceph-mon[125702]: pgmap v4911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:00 smithi057 ceph-mon[92072]: pgmap v4912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:00 smithi122 ceph-mon[125440]: pgmap v4912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:00.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:00 smithi136 ceph-mon[125702]: pgmap v4912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:02 smithi057 ceph-mon[92072]: pgmap v4913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:02 smithi122 ceph-mon[125440]: pgmap v4913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:02 smithi136 ceph-mon[125702]: pgmap v4913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:04 smithi057 ceph-mon[92072]: pgmap v4914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:31:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:04 smithi122 ceph-mon[125440]: pgmap v4914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:31:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:04 smithi136 ceph-mon[125702]: pgmap v4914: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:31:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:06 smithi057 ceph-mon[92072]: pgmap v4915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:31:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:06 smithi122 ceph-mon[125440]: pgmap v4915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:31:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:06 smithi136 ceph-mon[125702]: pgmap v4915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:31:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:08 smithi057 ceph-mon[92072]: pgmap v4916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:31:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:08 smithi122 ceph-mon[125440]: pgmap v4916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:31:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:08 smithi136 ceph-mon[125702]: pgmap v4916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:31:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:10 smithi057 ceph-mon[92072]: pgmap v4917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:31:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:10 smithi122 ceph-mon[125440]: pgmap v4917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:31:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:10 smithi136 ceph-mon[125702]: pgmap v4917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:31:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:11.052+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:31:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:11.053+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:31:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:11.053+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:31:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:11.053+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:31:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:11.053+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:31:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:11 smithi057 ceph-mon[92072]: osdmap e379: 12 total, 12 up, 12 in 2023-03-02T13:31:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:11 smithi122 ceph-mon[125440]: osdmap e379: 12 total, 12 up, 12 in 2023-03-02T13:31:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:11 smithi136 ceph-mon[125702]: osdmap e379: 12 total, 12 up, 12 in 2023-03-02T13:31:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:12 smithi057 ceph-mon[92072]: pgmap v4919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:31:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:12 smithi122 ceph-mon[125440]: pgmap v4919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:31:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:12 smithi136 ceph-mon[125702]: pgmap v4919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:31:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:14 smithi057 ceph-mon[92072]: pgmap v4920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:31:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:14 smithi122 ceph-mon[125440]: pgmap v4920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:31:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:14 smithi136 ceph-mon[125702]: pgmap v4920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:31:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:16 smithi057 ceph-mon[92072]: pgmap v4921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:31:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:16 smithi057 ceph-mon[92072]: osdmap e380: 12 total, 12 up, 12 in 2023-03-02T13:31:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:16 smithi122 ceph-mon[125440]: pgmap v4921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:31:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:16 smithi122 ceph-mon[125440]: osdmap e380: 12 total, 12 up, 12 in 2023-03-02T13:31:16.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:16 smithi136 ceph-mon[125702]: pgmap v4921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:31:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:16 smithi136 ceph-mon[125702]: osdmap e380: 12 total, 12 up, 12 in 2023-03-02T13:31:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:18 smithi122 ceph-mon[125440]: pgmap v4923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:31:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:18 smithi136 ceph-mon[125702]: pgmap v4923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:31:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:18 smithi057 ceph-mon[92072]: pgmap v4923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:31:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:20 smithi122 ceph-mon[125440]: pgmap v4924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:31:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:20 smithi136 ceph-mon[125702]: pgmap v4924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:31:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:20 smithi057 ceph-mon[92072]: pgmap v4924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:31:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:22 smithi122 ceph-mon[125440]: pgmap v4925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:31:22.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:22 smithi136 ceph-mon[125702]: pgmap v4925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:31:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:22 smithi057 ceph-mon[92072]: pgmap v4925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:31:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:24 smithi122 ceph-mon[125440]: pgmap v4926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:31:24.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:24 smithi136 ceph-mon[125702]: pgmap v4926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:31:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:24 smithi057 ceph-mon[92072]: pgmap v4926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:31:26.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:26.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:31:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:26.069+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:31:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:26.069+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:31:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:26.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:31:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:26.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:31:26.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:26 smithi136 ceph-mon[125702]: pgmap v4927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:31:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:26 smithi057 ceph-mon[92072]: pgmap v4927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:31:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:26 smithi122 ceph-mon[125440]: pgmap v4927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:31:28.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:28 smithi136 ceph-mon[125702]: pgmap v4928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:31:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:28 smithi057 ceph-mon[92072]: pgmap v4928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:31:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:28 smithi122 ceph-mon[125440]: pgmap v4928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:31:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:30 smithi136 ceph-mon[125702]: pgmap v4929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:30.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:30 smithi057 ceph-mon[92072]: pgmap v4929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:30 smithi122 ceph-mon[125440]: pgmap v4929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:32 smithi136 ceph-mon[125702]: pgmap v4930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:32 smithi057 ceph-mon[92072]: pgmap v4930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:32 smithi122 ceph-mon[125440]: pgmap v4930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:34.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:34 smithi136 ceph-mon[125702]: pgmap v4931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:34 smithi057 ceph-mon[92072]: pgmap v4931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:34.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:34 smithi122 ceph-mon[125440]: pgmap v4931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:36.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:36 smithi136 ceph-mon[125702]: pgmap v4932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:36 smithi057 ceph-mon[92072]: pgmap v4932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:36 smithi122 ceph-mon[125440]: pgmap v4932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:38.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:38 smithi136 ceph-mon[125702]: pgmap v4933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:38 smithi057 ceph-mon[92072]: pgmap v4933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:38 smithi122 ceph-mon[125440]: pgmap v4933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:40.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:40 smithi136 ceph-mon[125702]: pgmap v4934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:40 smithi057 ceph-mon[92072]: pgmap v4934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:40 smithi122 ceph-mon[125440]: pgmap v4934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:41.081+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:31:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:41.081+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:31:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:41.081+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:31:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:41.081+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:31:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:41.081+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:31:42.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:42 smithi136 ceph-mon[125702]: pgmap v4935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:42 smithi057 ceph-mon[92072]: pgmap v4935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:42 smithi122 ceph-mon[125440]: pgmap v4935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:44.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:44 smithi136 ceph-mon[125702]: pgmap v4936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:44 smithi057 ceph-mon[92072]: pgmap v4936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:44 smithi122 ceph-mon[125440]: pgmap v4936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:46 smithi136 ceph-mon[125702]: pgmap v4937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:46 smithi057 ceph-mon[92072]: pgmap v4937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:46 smithi122 ceph-mon[125440]: pgmap v4937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:48 smithi136 ceph-mon[125702]: pgmap v4938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:48 smithi057 ceph-mon[92072]: pgmap v4938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:48 smithi122 ceph-mon[125440]: pgmap v4938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:50.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:50 smithi136 ceph-mon[125702]: pgmap v4939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:50 smithi057 ceph-mon[92072]: pgmap v4939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:50 smithi122 ceph-mon[125440]: pgmap v4939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:52.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:52 smithi136 ceph-mon[125702]: pgmap v4940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:52 smithi057 ceph-mon[92072]: pgmap v4940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:52 smithi122 ceph-mon[125440]: pgmap v4940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:54 smithi136 ceph-mon[125702]: pgmap v4941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:54 smithi057 ceph-mon[92072]: pgmap v4941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:54 smithi122 ceph-mon[125440]: pgmap v4941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:31:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:31:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:31:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:56.096+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:31:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:56.096+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:31:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:56.096+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:31:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:56.096+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:31:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:31:56.096+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:31:56.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:56 smithi136 ceph-mon[125702]: pgmap v4942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:56 smithi057 ceph-mon[92072]: pgmap v4942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:56 smithi122 ceph-mon[125440]: pgmap v4942: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:31:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:58 smithi136 ceph-mon[125702]: pgmap v4943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:58 smithi057 ceph-mon[92072]: pgmap v4943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:58 smithi122 ceph-mon[125440]: pgmap v4943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:31:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:31:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:31:59.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: pgmap v4944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:32:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:32:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:32:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:32:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:32:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:32:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:32:01.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:32:01.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:32:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: pgmap v4944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:32:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:32:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:32:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:32:01.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:32:01.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:32:01.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:32:01.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:32:01.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:32:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: pgmap v4944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:32:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:32:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:32:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:32:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:32:01.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:32:01.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:32:01.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:32:01.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:32:01.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:32:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:01 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:32:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:01 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:32:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:01 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:32:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:01 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:32:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:01 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:32:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:01 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:32:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:02 smithi057 ceph-mon[92072]: pgmap v4945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:02 smithi122 ceph-mon[125440]: pgmap v4945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:02 smithi136 ceph-mon[125702]: pgmap v4945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:05.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:04 smithi057 ceph-mon[92072]: pgmap v4946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:32:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:04 smithi122 ceph-mon[125440]: pgmap v4946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:32:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:04 smithi136 ceph-mon[125702]: pgmap v4946: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:32:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:06 smithi057 ceph-mon[92072]: pgmap v4947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:32:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:06 smithi122 ceph-mon[125440]: pgmap v4947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:32:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:06 smithi136 ceph-mon[125702]: pgmap v4947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:32:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:08 smithi122 ceph-mon[125440]: pgmap v4948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:32:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:08 smithi136 ceph-mon[125702]: pgmap v4948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:32:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:08 smithi057 ceph-mon[92072]: pgmap v4948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:32:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:09.675+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:32:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:09.675+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:32:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:09.675+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 74 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:32:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:09.675+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 75 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:32:11.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:11.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:32:11.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:11.107+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:32:11.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:11.107+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:32:11.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:11.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:32:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:11.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:32:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:10 smithi122 ceph-mon[125440]: pgmap v4949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:32:11.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:10 smithi136 ceph-mon[125702]: pgmap v4949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:32:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:10 smithi057 ceph-mon[92072]: pgmap v4949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:32:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:11 smithi136 ceph-mon[125702]: osdmap e381: 12 total, 12 up, 12 in 2023-03-02T13:32:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:11 smithi057 ceph-mon[92072]: osdmap e381: 12 total, 12 up, 12 in 2023-03-02T13:32:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:11 smithi122 ceph-mon[125440]: osdmap e381: 12 total, 12 up, 12 in 2023-03-02T13:32:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:12 smithi136 ceph-mon[125702]: pgmap v4951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:32:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:12 smithi057 ceph-mon[92072]: pgmap v4951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:32:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:12 smithi122 ceph-mon[125440]: pgmap v4951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:32:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:14 smithi136 ceph-mon[125702]: pgmap v4952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:32:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:14 smithi057 ceph-mon[92072]: pgmap v4952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:32:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:14 smithi122 ceph-mon[125440]: pgmap v4952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:32:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:16 smithi136 ceph-mon[125702]: pgmap v4953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:32:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:16 smithi136 ceph-mon[125702]: osdmap e382: 12 total, 12 up, 12 in 2023-03-02T13:32:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:16 smithi057 ceph-mon[92072]: pgmap v4953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:32:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:16 smithi057 ceph-mon[92072]: osdmap e382: 12 total, 12 up, 12 in 2023-03-02T13:32:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:16 smithi122 ceph-mon[125440]: pgmap v4953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:32:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:16 smithi122 ceph-mon[125440]: osdmap e382: 12 total, 12 up, 12 in 2023-03-02T13:32:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:18 smithi136 ceph-mon[125702]: pgmap v4955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:32:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:18 smithi057 ceph-mon[92072]: pgmap v4955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:32:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:18 smithi122 ceph-mon[125440]: pgmap v4955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:32:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:20 smithi136 ceph-mon[125702]: pgmap v4956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:32:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:20 smithi057 ceph-mon[92072]: pgmap v4956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:32:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:20 smithi122 ceph-mon[125440]: pgmap v4956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:32:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:22 smithi136 ceph-mon[125702]: pgmap v4957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:32:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:22 smithi057 ceph-mon[92072]: pgmap v4957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:32:23.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:22 smithi122 ceph-mon[125440]: pgmap v4957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:32:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:25 smithi136 ceph-mon[125702]: pgmap v4958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:32:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:25 smithi057 ceph-mon[92072]: pgmap v4958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:32:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:25 smithi122 ceph-mon[125440]: pgmap v4958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:32:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:26.111+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:32:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:26.111+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:32:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:26.111+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:32:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:26.111+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:32:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:26.111+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:32:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:27 smithi136 ceph-mon[125702]: pgmap v4959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:32:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:27 smithi057 ceph-mon[92072]: pgmap v4959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:32:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:27 smithi122 ceph-mon[125440]: pgmap v4959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:32:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:29 smithi136 ceph-mon[125702]: pgmap v4960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:32:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:29 smithi057 ceph-mon[92072]: pgmap v4960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:32:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:29 smithi122 ceph-mon[125440]: pgmap v4960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:32:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:31 smithi136 ceph-mon[125702]: pgmap v4961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:31 smithi057 ceph-mon[92072]: pgmap v4961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:31 smithi122 ceph-mon[125440]: pgmap v4961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:33 smithi136 ceph-mon[125702]: pgmap v4962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:33 smithi057 ceph-mon[92072]: pgmap v4962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:33 smithi122 ceph-mon[125440]: pgmap v4962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:35 smithi136 ceph-mon[125702]: pgmap v4963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:35 smithi057 ceph-mon[92072]: pgmap v4963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:35 smithi122 ceph-mon[125440]: pgmap v4963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:37 smithi136 ceph-mon[125702]: pgmap v4964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:37.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:37 smithi057 ceph-mon[92072]: pgmap v4964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:37 smithi122 ceph-mon[125440]: pgmap v4964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:39 smithi136 ceph-mon[125702]: pgmap v4965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:39 smithi057 ceph-mon[92072]: pgmap v4965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:39 smithi122 ceph-mon[125440]: pgmap v4965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:41.126+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:32:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:41.126+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:32:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:41.126+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:32:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:41.126+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:32:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:41.127+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:32:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:41 smithi136 ceph-mon[125702]: pgmap v4966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:41 smithi057 ceph-mon[92072]: pgmap v4966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:41 smithi122 ceph-mon[125440]: pgmap v4966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:43 smithi136 ceph-mon[125702]: pgmap v4967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:43 smithi057 ceph-mon[92072]: pgmap v4967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:43 smithi122 ceph-mon[125440]: pgmap v4967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:45 smithi136 ceph-mon[125702]: pgmap v4968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:45 smithi057 ceph-mon[92072]: pgmap v4968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:45 smithi122 ceph-mon[125440]: pgmap v4968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:47 smithi136 ceph-mon[125702]: pgmap v4969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:47 smithi057 ceph-mon[92072]: pgmap v4969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:47.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:47 smithi122 ceph-mon[125440]: pgmap v4969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:49 smithi136 ceph-mon[125702]: pgmap v4970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:49 smithi057 ceph-mon[92072]: pgmap v4970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:49 smithi122 ceph-mon[125440]: pgmap v4970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:51 smithi136 ceph-mon[125702]: pgmap v4971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:51 smithi057 ceph-mon[92072]: pgmap v4971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:51 smithi122 ceph-mon[125440]: pgmap v4971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:53 smithi136 ceph-mon[125702]: pgmap v4972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:53 smithi057 ceph-mon[92072]: pgmap v4972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:53 smithi122 ceph-mon[125440]: pgmap v4972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:55 smithi136 ceph-mon[125702]: pgmap v4973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:55 smithi057 ceph-mon[92072]: pgmap v4973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:55 smithi122 ceph-mon[125440]: pgmap v4973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:56.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:56.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:32:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:56.135+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:32:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:56.135+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:32:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:56.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:32:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:32:56.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:32:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:57 smithi136 ceph-mon[125702]: pgmap v4974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:57 smithi057 ceph-mon[92072]: pgmap v4974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:57 smithi122 ceph-mon[125440]: pgmap v4974: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:32:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:32:58 smithi136 ceph-mon[125702]: pgmap v4975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:32:58 smithi057 ceph-mon[92072]: pgmap v4975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:32:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:32:58 smithi122 ceph-mon[125440]: pgmap v4975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:00 smithi057 ceph-mon[92072]: pgmap v4976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:00 smithi122 ceph-mon[125440]: pgmap v4976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:00.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:00 smithi136 ceph-mon[125702]: pgmap v4976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:33:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:33:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:33:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:02 smithi057 ceph-mon[92072]: pgmap v4977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:33:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:33:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:33:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:02 smithi122 ceph-mon[125440]: pgmap v4977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:33:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:33:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:33:02.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:02 smithi136 ceph-mon[125702]: pgmap v4977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:33:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:33:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:33:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:04 smithi057 ceph-mon[92072]: pgmap v4978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T13:33:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:04 smithi122 ceph-mon[125440]: pgmap v4978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T13:33:04.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:04 smithi136 ceph-mon[125702]: pgmap v4978: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T13:33:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:06 smithi057 ceph-mon[92072]: pgmap v4979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:33:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:06 smithi122 ceph-mon[125440]: pgmap v4979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:33:06.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:06 smithi136 ceph-mon[125702]: pgmap v4979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:33:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:08 smithi057 ceph-mon[92072]: pgmap v4980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:33:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:08 smithi122 ceph-mon[125440]: pgmap v4980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:33:08.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:08 smithi136 ceph-mon[125702]: pgmap v4980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:33:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:10 smithi122 ceph-mon[125440]: pgmap v4981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:33:10.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:10 smithi136 ceph-mon[125702]: pgmap v4981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:33:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:10 smithi057 ceph-mon[92072]: pgmap v4981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:33:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:11.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:33:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:11.151+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:33:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:11.151+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:33:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:11.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:33:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:11.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:33:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:11 smithi122 ceph-mon[125440]: osdmap e383: 12 total, 12 up, 12 in 2023-03-02T13:33:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:11 smithi136 ceph-mon[125702]: osdmap e383: 12 total, 12 up, 12 in 2023-03-02T13:33:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:11 smithi057 ceph-mon[92072]: osdmap e383: 12 total, 12 up, 12 in 2023-03-02T13:33:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:12 smithi122 ceph-mon[125440]: pgmap v4983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:33:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:12 smithi136 ceph-mon[125702]: pgmap v4983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:33:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:12 smithi057 ceph-mon[92072]: pgmap v4983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:33:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:14 smithi136 ceph-mon[125702]: pgmap v4984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:33:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:14 smithi057 ceph-mon[92072]: pgmap v4984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:33:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:14 smithi122 ceph-mon[125440]: pgmap v4984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:33:16.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:16 smithi136 ceph-mon[125702]: pgmap v4985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:33:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:16 smithi136 ceph-mon[125702]: osdmap e384: 12 total, 12 up, 12 in 2023-03-02T13:33:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:16 smithi057 ceph-mon[92072]: pgmap v4985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:33:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:16 smithi057 ceph-mon[92072]: osdmap e384: 12 total, 12 up, 12 in 2023-03-02T13:33:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:16 smithi122 ceph-mon[125440]: pgmap v4985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:33:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:16 smithi122 ceph-mon[125440]: osdmap e384: 12 total, 12 up, 12 in 2023-03-02T13:33:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:18 smithi136 ceph-mon[125702]: pgmap v4987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:33:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:18 smithi057 ceph-mon[92072]: pgmap v4987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:33:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:18 smithi122 ceph-mon[125440]: pgmap v4987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:33:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:20 smithi136 ceph-mon[125702]: pgmap v4988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:33:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:20 smithi057 ceph-mon[92072]: pgmap v4988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:33:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:20 smithi122 ceph-mon[125440]: pgmap v4988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:33:22.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:22 smithi136 ceph-mon[125702]: pgmap v4989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:33:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:22 smithi057 ceph-mon[92072]: pgmap v4989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:33:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:22 smithi122 ceph-mon[125440]: pgmap v4989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:33:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:24 smithi136 ceph-mon[125702]: pgmap v4990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:33:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:24 smithi057 ceph-mon[92072]: pgmap v4990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:33:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:24 smithi122 ceph-mon[125440]: pgmap v4990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:33:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:26.153+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:33:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:26.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:33:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:26.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:33:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:26.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:33:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:26.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:33:26.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:26 smithi136 ceph-mon[125702]: pgmap v4991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:33:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:26 smithi057 ceph-mon[92072]: pgmap v4991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:33:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:26 smithi122 ceph-mon[125440]: pgmap v4991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:33:28.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:28 smithi136 ceph-mon[125702]: pgmap v4992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:33:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:28 smithi057 ceph-mon[92072]: pgmap v4992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:33:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:28 smithi122 ceph-mon[125440]: pgmap v4992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:33:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:30 smithi136 ceph-mon[125702]: pgmap v4993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:30 smithi057 ceph-mon[92072]: pgmap v4993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:30 smithi122 ceph-mon[125440]: pgmap v4993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:32 smithi136 ceph-mon[125702]: pgmap v4994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:32 smithi057 ceph-mon[92072]: pgmap v4994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:32 smithi122 ceph-mon[125440]: pgmap v4994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:33:34.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:34 smithi136 ceph-mon[125702]: pgmap v4995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:34 smithi057 ceph-mon[92072]: pgmap v4995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:34 smithi122 ceph-mon[125440]: pgmap v4995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:36.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:36 smithi136 ceph-mon[125702]: pgmap v4996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:36 smithi057 ceph-mon[92072]: pgmap v4996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:36 smithi122 ceph-mon[125440]: pgmap v4996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:38.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:38 smithi136 ceph-mon[125702]: pgmap v4997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:38 smithi057 ceph-mon[92072]: pgmap v4997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:38 smithi122 ceph-mon[125440]: pgmap v4997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:40.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:40 smithi136 ceph-mon[125702]: pgmap v4998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:40 smithi057 ceph-mon[92072]: pgmap v4998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:40 smithi122 ceph-mon[125440]: pgmap v4998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:41.167+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:33:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:41.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:33:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:41.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:33:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:41.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:33:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:41.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:33:42.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:42 smithi136 ceph-mon[125702]: pgmap v4999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:42 smithi057 ceph-mon[92072]: pgmap v4999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:42 smithi122 ceph-mon[125440]: pgmap v4999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:44.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:44 smithi136 ceph-mon[125702]: pgmap v5000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:44 smithi057 ceph-mon[92072]: pgmap v5000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:44 smithi122 ceph-mon[125440]: pgmap v5000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:46 smithi136 ceph-mon[125702]: pgmap v5001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:46 smithi057 ceph-mon[92072]: pgmap v5001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:46 smithi122 ceph-mon[125440]: pgmap v5001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:48.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:48 smithi136 ceph-mon[125702]: pgmap v5002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:48 smithi057 ceph-mon[92072]: pgmap v5002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:48 smithi122 ceph-mon[125440]: pgmap v5002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:50 smithi136 ceph-mon[125702]: pgmap v5003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:50 smithi057 ceph-mon[92072]: pgmap v5003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:50 smithi122 ceph-mon[125440]: pgmap v5003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:52.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:52 smithi136 ceph-mon[125702]: pgmap v5004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:52 smithi057 ceph-mon[92072]: pgmap v5004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:52 smithi122 ceph-mon[125440]: pgmap v5004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:54.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:54 smithi136 ceph-mon[125702]: pgmap v5005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:54 smithi057 ceph-mon[92072]: pgmap v5005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:54 smithi122 ceph-mon[125440]: pgmap v5005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:56.177+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:33:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:56.178+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:33:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:56.178+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:33:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:56.178+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:33:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:33:56.178+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:33:56.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:56 smithi136 ceph-mon[125702]: pgmap v5006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:56 smithi057 ceph-mon[92072]: pgmap v5006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:56 smithi122 ceph-mon[125440]: pgmap v5006: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:33:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:33:58 smithi136 ceph-mon[125702]: pgmap v5007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:33:58 smithi057 ceph-mon[92072]: pgmap v5007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:33:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:33:58 smithi122 ceph-mon[125440]: pgmap v5007: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:00 smithi136 ceph-mon[125702]: pgmap v5008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:00 smithi057 ceph-mon[92072]: pgmap v5008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:00 smithi122 ceph-mon[125440]: pgmap v5008: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:02 smithi136 ceph-mon[125702]: pgmap v5009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:34:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:34:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:34:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:02 smithi057 ceph-mon[92072]: pgmap v5009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:34:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:34:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:34:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:02 smithi122 ceph-mon[125440]: pgmap v5009: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:34:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:34:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:34:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:34:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:34:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:34:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:34:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:34:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:34:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:34:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:34:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:34:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:04 smithi122 ceph-mon[125440]: pgmap v5010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:34:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:04 smithi136 ceph-mon[125702]: pgmap v5010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:34:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:04 smithi057 ceph-mon[92072]: pgmap v5010: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:34:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:06 smithi122 ceph-mon[125440]: pgmap v5011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:34:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:06 smithi136 ceph-mon[125702]: pgmap v5011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:34:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:06 smithi057 ceph-mon[92072]: pgmap v5011: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:34:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:08 smithi122 ceph-mon[125440]: pgmap v5012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:34:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:08 smithi136 ceph-mon[125702]: pgmap v5012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:34:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:08 smithi057 ceph-mon[92072]: pgmap v5012: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:34:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:11.193+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:34:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:11.194+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:34:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:11.194+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:34:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:11.194+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:34:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:11.194+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:34:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:10 smithi136 ceph-mon[125702]: pgmap v5013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:34:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:10 smithi057 ceph-mon[92072]: pgmap v5013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:34:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:10 smithi122 ceph-mon[125440]: pgmap v5013: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:34:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:11 smithi136 ceph-mon[125702]: osdmap e385: 12 total, 12 up, 12 in 2023-03-02T13:34:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:11 smithi057 ceph-mon[92072]: osdmap e385: 12 total, 12 up, 12 in 2023-03-02T13:34:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:11 smithi122 ceph-mon[125440]: osdmap e385: 12 total, 12 up, 12 in 2023-03-02T13:34:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:12 smithi136 ceph-mon[125702]: pgmap v5015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:34:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:12 smithi057 ceph-mon[92072]: pgmap v5015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:34:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:12 smithi122 ceph-mon[125440]: pgmap v5015: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:34:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:14 smithi136 ceph-mon[125702]: pgmap v5016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:34:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:14 smithi057 ceph-mon[92072]: pgmap v5016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:34:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:14 smithi122 ceph-mon[125440]: pgmap v5016: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:34:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:16 smithi136 ceph-mon[125702]: pgmap v5017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:34:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:16 smithi136 ceph-mon[125702]: osdmap e386: 12 total, 12 up, 12 in 2023-03-02T13:34:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:16 smithi057 ceph-mon[92072]: pgmap v5017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:34:17.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:16 smithi057 ceph-mon[92072]: osdmap e386: 12 total, 12 up, 12 in 2023-03-02T13:34:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:16 smithi122 ceph-mon[125440]: pgmap v5017: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:34:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:16 smithi122 ceph-mon[125440]: osdmap e386: 12 total, 12 up, 12 in 2023-03-02T13:34:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:18 smithi136 ceph-mon[125702]: pgmap v5019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:34:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:18 smithi057 ceph-mon[92072]: pgmap v5019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:34:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:18 smithi122 ceph-mon[125440]: pgmap v5019: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:34:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:20 smithi136 ceph-mon[125702]: pgmap v5020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:34:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:20 smithi057 ceph-mon[92072]: pgmap v5020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:34:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:20 smithi122 ceph-mon[125440]: pgmap v5020: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:34:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:22 smithi136 ceph-mon[125702]: pgmap v5021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:34:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:22 smithi057 ceph-mon[92072]: pgmap v5021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:34:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:22 smithi122 ceph-mon[125440]: pgmap v5021: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:34:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:24 smithi136 ceph-mon[125702]: pgmap v5022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:34:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:24 smithi057 ceph-mon[92072]: pgmap v5022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:34:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:24 smithi122 ceph-mon[125440]: pgmap v5022: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:34:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:26.208+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:34:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:26.209+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:34:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:26.209+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:34:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:26.209+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:34:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:26.209+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:34:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:26 smithi136 ceph-mon[125702]: pgmap v5023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:34:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:26 smithi057 ceph-mon[92072]: pgmap v5023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:34:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:26 smithi122 ceph-mon[125440]: pgmap v5023: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:34:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:29 smithi136 ceph-mon[125702]: pgmap v5024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:34:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:29 smithi057 ceph-mon[92072]: pgmap v5024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:34:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:29 smithi122 ceph-mon[125440]: pgmap v5024: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:34:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:31 smithi136 ceph-mon[125702]: pgmap v5025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:34:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:31 smithi057 ceph-mon[92072]: pgmap v5025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:34:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:31 smithi122 ceph-mon[125440]: pgmap v5025: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:34:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:33 smithi136 ceph-mon[125702]: pgmap v5026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:34:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:33 smithi057 ceph-mon[92072]: pgmap v5026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:34:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:33 smithi122 ceph-mon[125440]: pgmap v5026: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:34:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:35 smithi136 ceph-mon[125702]: pgmap v5027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:35 smithi057 ceph-mon[92072]: pgmap v5027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:35 smithi122 ceph-mon[125440]: pgmap v5027: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:37.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:37 smithi136 ceph-mon[125702]: pgmap v5028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:37 smithi057 ceph-mon[92072]: pgmap v5028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:37 smithi122 ceph-mon[125440]: pgmap v5028: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:39 smithi136 ceph-mon[125702]: pgmap v5029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:39 smithi057 ceph-mon[92072]: pgmap v5029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:39 smithi122 ceph-mon[125440]: pgmap v5029: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:41.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:34:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:41.225+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:34:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:41.225+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:34:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:41.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:34:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:41.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:34:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:41 smithi136 ceph-mon[125702]: pgmap v5030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:41 smithi057 ceph-mon[92072]: pgmap v5030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:41 smithi122 ceph-mon[125440]: pgmap v5030: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:43 smithi136 ceph-mon[125702]: pgmap v5031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:43 smithi057 ceph-mon[92072]: pgmap v5031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:43 smithi122 ceph-mon[125440]: pgmap v5031: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:45 smithi136 ceph-mon[125702]: pgmap v5032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:45 smithi057 ceph-mon[92072]: pgmap v5032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:45 smithi122 ceph-mon[125440]: pgmap v5032: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:47 smithi136 ceph-mon[125702]: pgmap v5033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:47 smithi057 ceph-mon[92072]: pgmap v5033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:47 smithi122 ceph-mon[125440]: pgmap v5033: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:49 smithi136 ceph-mon[125702]: pgmap v5034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:49 smithi057 ceph-mon[92072]: pgmap v5034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:49 smithi122 ceph-mon[125440]: pgmap v5034: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:51 smithi136 ceph-mon[125702]: pgmap v5035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:51 smithi057 ceph-mon[92072]: pgmap v5035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:51 smithi122 ceph-mon[125440]: pgmap v5035: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:53 smithi136 ceph-mon[125702]: pgmap v5036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:53 smithi057 ceph-mon[92072]: pgmap v5036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:53 smithi122 ceph-mon[125440]: pgmap v5036: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:55.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:55 smithi136 ceph-mon[125702]: pgmap v5037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:55 smithi057 ceph-mon[92072]: pgmap v5037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:55 smithi122 ceph-mon[125440]: pgmap v5037: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:56.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:56.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:34:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:56.230+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:34:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:56.230+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:34:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:56.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:34:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:34:56.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:34:57.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:57 smithi136 ceph-mon[125702]: pgmap v5038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:57 smithi057 ceph-mon[92072]: pgmap v5038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:57 smithi122 ceph-mon[125440]: pgmap v5038: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:34:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:34:59 smithi136 ceph-mon[125702]: pgmap v5039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:34:59 smithi057 ceph-mon[92072]: pgmap v5039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:34:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:34:59 smithi122 ceph-mon[125440]: pgmap v5039: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:01 smithi136 ceph-mon[125702]: pgmap v5040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:01 smithi057 ceph-mon[92072]: pgmap v5040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:01 smithi122 ceph-mon[125440]: pgmap v5040: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:03 smithi136 ceph-mon[125702]: pgmap v5041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:03.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:35:03.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:03 smithi057 ceph-mon[92072]: pgmap v5041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:03.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:35:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:03 smithi122 ceph-mon[125440]: pgmap v5041: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:35:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:04 smithi136 ceph-mon[125702]: pgmap v5042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:35:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:35:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:35:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:04 smithi057 ceph-mon[92072]: pgmap v5042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:35:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:35:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:35:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:04 smithi122 ceph-mon[125440]: pgmap v5042: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:35:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:35:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:35:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:35:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:06 smithi136 ceph-mon[125702]: pgmap v5043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:35:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:06 smithi057 ceph-mon[92072]: pgmap v5043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:35:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:06 smithi122 ceph-mon[125440]: pgmap v5043: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:35:08.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:08 smithi136 ceph-mon[125702]: pgmap v5044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:35:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:08 smithi057 ceph-mon[92072]: pgmap v5044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:35:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:08 smithi122 ceph-mon[125440]: pgmap v5044: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:35:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:09.701+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:35:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:09.701+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:35:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:09.701+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 75 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:35:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:09.701+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 76 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:35:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:10 smithi136 ceph-mon[125702]: pgmap v5045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:35:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:10 smithi057 ceph-mon[92072]: pgmap v5045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:35:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:10 smithi122 ceph-mon[125440]: pgmap v5045: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:35:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:11.246+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:35:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:11.246+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:35:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:11.246+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:35:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:11.246+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:35:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:11.246+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:35:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:11 smithi136 ceph-mon[125702]: osdmap e387: 12 total, 12 up, 12 in 2023-03-02T13:35:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:11 smithi057 ceph-mon[92072]: osdmap e387: 12 total, 12 up, 12 in 2023-03-02T13:35:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:11 smithi122 ceph-mon[125440]: osdmap e387: 12 total, 12 up, 12 in 2023-03-02T13:35:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:12 smithi136 ceph-mon[125702]: pgmap v5047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:35:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:12 smithi057 ceph-mon[92072]: pgmap v5047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:35:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:12 smithi122 ceph-mon[125440]: pgmap v5047: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:35:14.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:14 smithi136 ceph-mon[125702]: pgmap v5048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:35:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:14 smithi057 ceph-mon[92072]: pgmap v5048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:35:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:14 smithi122 ceph-mon[125440]: pgmap v5048: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:35:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:16 smithi136 ceph-mon[125702]: pgmap v5049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:35:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:16 smithi136 ceph-mon[125702]: osdmap e388: 12 total, 12 up, 12 in 2023-03-02T13:35:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:16 smithi057 ceph-mon[92072]: pgmap v5049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:35:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:16 smithi057 ceph-mon[92072]: osdmap e388: 12 total, 12 up, 12 in 2023-03-02T13:35:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:16 smithi122 ceph-mon[125440]: pgmap v5049: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:35:16.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:16 smithi122 ceph-mon[125440]: osdmap e388: 12 total, 12 up, 12 in 2023-03-02T13:35:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:18 smithi057 ceph-mon[92072]: pgmap v5051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:35:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:18 smithi122 ceph-mon[125440]: pgmap v5051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:35:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:18 smithi136 ceph-mon[125702]: pgmap v5051: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:35:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:20 smithi057 ceph-mon[92072]: pgmap v5052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:35:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:20 smithi122 ceph-mon[125440]: pgmap v5052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:35:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:20 smithi136 ceph-mon[125702]: pgmap v5052: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:35:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:22 smithi057 ceph-mon[92072]: pgmap v5053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:35:22.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:22 smithi122 ceph-mon[125440]: pgmap v5053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:35:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:22 smithi136 ceph-mon[125702]: pgmap v5053: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:35:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:24 smithi057 ceph-mon[92072]: pgmap v5054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:35:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:24 smithi122 ceph-mon[125440]: pgmap v5054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:35:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:24 smithi136 ceph-mon[125702]: pgmap v5054: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:35:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:26.252+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:35:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:26.253+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:35:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:26.253+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:35:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:26.253+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:35:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:26.253+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:35:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:26 smithi057 ceph-mon[92072]: pgmap v5055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:35:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:26 smithi122 ceph-mon[125440]: pgmap v5055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:35:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:26 smithi136 ceph-mon[125702]: pgmap v5055: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:35:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:28 smithi057 ceph-mon[92072]: pgmap v5056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:35:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:28 smithi122 ceph-mon[125440]: pgmap v5056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:35:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:28 smithi136 ceph-mon[125702]: pgmap v5056: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:35:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:30 smithi057 ceph-mon[92072]: pgmap v5057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:30 smithi122 ceph-mon[125440]: pgmap v5057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:30 smithi136 ceph-mon[125702]: pgmap v5057: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:32 smithi057 ceph-mon[92072]: pgmap v5058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:32 smithi122 ceph-mon[125440]: pgmap v5058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:32 smithi136 ceph-mon[125702]: pgmap v5058: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:34 smithi057 ceph-mon[92072]: pgmap v5059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:34 smithi122 ceph-mon[125440]: pgmap v5059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:34 smithi136 ceph-mon[125702]: pgmap v5059: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:36 smithi057 ceph-mon[92072]: pgmap v5060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:36 smithi122 ceph-mon[125440]: pgmap v5060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:36 smithi136 ceph-mon[125702]: pgmap v5060: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:38 smithi057 ceph-mon[92072]: pgmap v5061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:38.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:38 smithi122 ceph-mon[125440]: pgmap v5061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:38 smithi136 ceph-mon[125702]: pgmap v5061: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:40 smithi057 ceph-mon[92072]: pgmap v5062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:40 smithi122 ceph-mon[125440]: pgmap v5062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:40 smithi136 ceph-mon[125702]: pgmap v5062: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:41.267+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:35:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:41.268+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:35:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:41.268+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:35:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:41.268+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:35:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:41.268+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:35:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:42 smithi057 ceph-mon[92072]: pgmap v5063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:42 smithi122 ceph-mon[125440]: pgmap v5063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:42 smithi136 ceph-mon[125702]: pgmap v5063: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:44 smithi057 ceph-mon[92072]: pgmap v5064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:44 smithi122 ceph-mon[125440]: pgmap v5064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:44 smithi136 ceph-mon[125702]: pgmap v5064: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:46 smithi057 ceph-mon[92072]: pgmap v5065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:46.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:46 smithi122 ceph-mon[125440]: pgmap v5065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:46 smithi136 ceph-mon[125702]: pgmap v5065: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:48 smithi057 ceph-mon[92072]: pgmap v5066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:48 smithi122 ceph-mon[125440]: pgmap v5066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:48 smithi136 ceph-mon[125702]: pgmap v5066: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:50 smithi057 ceph-mon[92072]: pgmap v5067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:50 smithi122 ceph-mon[125440]: pgmap v5067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:50 smithi136 ceph-mon[125702]: pgmap v5067: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:52 smithi057 ceph-mon[92072]: pgmap v5068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:52 smithi122 ceph-mon[125440]: pgmap v5068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:52 smithi136 ceph-mon[125702]: pgmap v5068: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:54.707+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:35:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:54.707+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:35:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:54.708+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 77 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:35:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:54.708+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 76 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:35:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:54 smithi057 ceph-mon[92072]: pgmap v5069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:54 smithi122 ceph-mon[125440]: pgmap v5069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:54 smithi136 ceph-mon[125702]: pgmap v5069: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:56.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:56.284+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:35:56.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:56.285+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:35:56.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:56.285+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:35:56.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:56.285+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:35:56.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:35:56.285+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:35:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:56 smithi057 ceph-mon[92072]: pgmap v5070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:56 smithi122 ceph-mon[125440]: pgmap v5070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:56 smithi136 ceph-mon[125702]: pgmap v5070: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:35:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:35:58 smithi057 ceph-mon[92072]: pgmap v5071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:35:58 smithi122 ceph-mon[125440]: pgmap v5071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:35:59.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:35:58 smithi136 ceph-mon[125702]: pgmap v5071: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:00 smithi057 ceph-mon[92072]: pgmap v5072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:00 smithi122 ceph-mon[125440]: pgmap v5072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:00 smithi136 ceph-mon[125702]: pgmap v5072: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:02 smithi122 ceph-mon[125440]: pgmap v5073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:02 smithi136 ceph-mon[125702]: pgmap v5073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:02 smithi057 ceph-mon[92072]: pgmap v5073: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:04 smithi122 ceph-mon[125440]: pgmap v5074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:36:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:36:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:04 smithi136 ceph-mon[125702]: pgmap v5074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:36:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:36:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:04 smithi057 ceph-mon[92072]: pgmap v5074: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:36:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:36:07.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:06 smithi136 ceph-mon[125702]: pgmap v5075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:36:07.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:36:07.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:36:07.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:36:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:06 smithi057 ceph-mon[92072]: pgmap v5075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:36:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:36:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:36:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:36:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:06 smithi122 ceph-mon[125440]: pgmap v5075: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:36:07.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:36:07.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:36:07.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:36:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:08 smithi136 ceph-mon[125702]: pgmap v5076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:36:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:08 smithi057 ceph-mon[92072]: pgmap v5076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:36:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:08 smithi122 ceph-mon[125440]: pgmap v5076: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:36:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:10 smithi136 ceph-mon[125702]: pgmap v5077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:36:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:10 smithi057 ceph-mon[92072]: pgmap v5077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:36:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:10 smithi122 ceph-mon[125440]: pgmap v5077: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:36:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:11.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:36:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:11.287+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:36:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:11.287+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:36:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:11.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:36:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:11.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:36:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:11 smithi136 ceph-mon[125702]: osdmap e389: 12 total, 12 up, 12 in 2023-03-02T13:36:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:11 smithi057 ceph-mon[92072]: osdmap e389: 12 total, 12 up, 12 in 2023-03-02T13:36:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:11 smithi122 ceph-mon[125440]: osdmap e389: 12 total, 12 up, 12 in 2023-03-02T13:36:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:12 smithi136 ceph-mon[125702]: pgmap v5079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:36:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:12 smithi057 ceph-mon[92072]: pgmap v5079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:36:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:12 smithi122 ceph-mon[125440]: pgmap v5079: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:36:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:14 smithi136 ceph-mon[125702]: pgmap v5080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:36:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:14 smithi057 ceph-mon[92072]: pgmap v5080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:36:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:14 smithi122 ceph-mon[125440]: pgmap v5080: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:36:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:16 smithi136 ceph-mon[125702]: pgmap v5081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:36:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:16 smithi136 ceph-mon[125702]: osdmap e390: 12 total, 12 up, 12 in 2023-03-02T13:36:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:16 smithi057 ceph-mon[92072]: pgmap v5081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:36:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:16 smithi057 ceph-mon[92072]: osdmap e390: 12 total, 12 up, 12 in 2023-03-02T13:36:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:16 smithi122 ceph-mon[125440]: pgmap v5081: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:36:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:16 smithi122 ceph-mon[125440]: osdmap e390: 12 total, 12 up, 12 in 2023-03-02T13:36:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:18 smithi136 ceph-mon[125702]: pgmap v5083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:36:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:18 smithi057 ceph-mon[92072]: pgmap v5083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:36:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:18 smithi122 ceph-mon[125440]: pgmap v5083: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:36:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:20 smithi136 ceph-mon[125702]: pgmap v5084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 237 B/s wr, 11 op/s 2023-03-02T13:36:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:20 smithi057 ceph-mon[92072]: pgmap v5084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 237 B/s wr, 11 op/s 2023-03-02T13:36:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:20 smithi122 ceph-mon[125440]: pgmap v5084: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 237 B/s wr, 11 op/s 2023-03-02T13:36:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:22 smithi136 ceph-mon[125702]: pgmap v5085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:36:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:22 smithi057 ceph-mon[92072]: pgmap v5085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:36:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:22 smithi122 ceph-mon[125440]: pgmap v5085: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:36:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:24 smithi136 ceph-mon[125702]: pgmap v5086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:36:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:24 smithi057 ceph-mon[92072]: pgmap v5086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:36:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:24 smithi122 ceph-mon[125440]: pgmap v5086: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:36:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:26.296+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:36:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:26.296+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:36:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:26.297+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:36:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:26.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:36:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:26.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:36:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:26 smithi136 ceph-mon[125702]: pgmap v5087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:36:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:26 smithi057 ceph-mon[92072]: pgmap v5087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:36:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:26 smithi122 ceph-mon[125440]: pgmap v5087: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:36:29.100 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:28 smithi136 ceph-mon[125702]: pgmap v5088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:36:29.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:28 smithi057 ceph-mon[92072]: pgmap v5088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:36:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:28 smithi122 ceph-mon[125440]: pgmap v5088: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:36:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:30 smithi136 ceph-mon[125702]: pgmap v5089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:30 smithi057 ceph-mon[92072]: pgmap v5089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:30 smithi122 ceph-mon[125440]: pgmap v5089: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:32 smithi136 ceph-mon[125702]: pgmap v5090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:32 smithi057 ceph-mon[92072]: pgmap v5090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:32 smithi122 ceph-mon[125440]: pgmap v5090: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:34 smithi136 ceph-mon[125702]: pgmap v5091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:34 smithi057 ceph-mon[92072]: pgmap v5091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:34 smithi122 ceph-mon[125440]: pgmap v5091: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:36 smithi136 ceph-mon[125702]: pgmap v5092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:36 smithi057 ceph-mon[92072]: pgmap v5092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:36 smithi122 ceph-mon[125440]: pgmap v5092: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:38 smithi136 ceph-mon[125702]: pgmap v5093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:38 smithi057 ceph-mon[92072]: pgmap v5093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:38 smithi122 ceph-mon[125440]: pgmap v5093: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:40 smithi136 ceph-mon[125702]: pgmap v5094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:40 smithi057 ceph-mon[92072]: pgmap v5094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:40 smithi122 ceph-mon[125440]: pgmap v5094: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:41.306+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:36:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:41.306+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:36:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:41.306+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:36:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:41.306+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:36:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:41.306+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:36:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:42 smithi136 ceph-mon[125702]: pgmap v5095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:42 smithi057 ceph-mon[92072]: pgmap v5095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:42 smithi122 ceph-mon[125440]: pgmap v5095: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:44 smithi136 ceph-mon[125702]: pgmap v5096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:44 smithi057 ceph-mon[92072]: pgmap v5096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:44 smithi122 ceph-mon[125440]: pgmap v5096: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:46 smithi136 ceph-mon[125702]: pgmap v5097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:46 smithi057 ceph-mon[92072]: pgmap v5097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:46 smithi122 ceph-mon[125440]: pgmap v5097: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:48 smithi136 ceph-mon[125702]: pgmap v5098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:48 smithi057 ceph-mon[92072]: pgmap v5098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:48 smithi122 ceph-mon[125440]: pgmap v5098: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:50 smithi136 ceph-mon[125702]: pgmap v5099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:50 smithi057 ceph-mon[92072]: pgmap v5099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:50 smithi122 ceph-mon[125440]: pgmap v5099: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:52 smithi057 ceph-mon[92072]: pgmap v5100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:52 smithi122 ceph-mon[125440]: pgmap v5100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:52 smithi136 ceph-mon[125702]: pgmap v5100: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:54 smithi057 ceph-mon[92072]: pgmap v5101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:54 smithi122 ceph-mon[125440]: pgmap v5101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:54 smithi136 ceph-mon[125702]: pgmap v5101: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:56.312+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:36:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:56.313+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:36:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:56.313+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:36:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:56.313+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:36:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:36:56.313+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:36:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:56 smithi057 ceph-mon[92072]: pgmap v5102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:57.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:56 smithi122 ceph-mon[125440]: pgmap v5102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:56 smithi136 ceph-mon[125702]: pgmap v5102: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:36:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:36:58 smithi057 ceph-mon[92072]: pgmap v5103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:36:58 smithi122 ceph-mon[125440]: pgmap v5103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:36:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:36:58 smithi136 ceph-mon[125702]: pgmap v5103: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:00 smithi057 ceph-mon[92072]: pgmap v5104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:00 smithi122 ceph-mon[125440]: pgmap v5104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:00 smithi136 ceph-mon[125702]: pgmap v5104: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:02 smithi057 ceph-mon[92072]: pgmap v5105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:02 smithi122 ceph-mon[125440]: pgmap v5105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:02 smithi136 ceph-mon[125702]: pgmap v5105: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:04 smithi057 ceph-mon[92072]: pgmap v5106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:37:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:04 smithi122 ceph-mon[125440]: pgmap v5106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:37:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:04 smithi136 ceph-mon[125702]: pgmap v5106: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:37:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:06 smithi057 ceph-mon[92072]: pgmap v5107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:37:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:06 smithi057 ceph-mon[92072]: osdmap e391: 12 total, 12 up, 12 in 2023-03-02T13:37:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:37:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:37:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:37:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:37:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:06 smithi122 ceph-mon[125440]: pgmap v5107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:37:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:06 smithi122 ceph-mon[125440]: osdmap e391: 12 total, 12 up, 12 in 2023-03-02T13:37:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:37:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:37:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:37:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:37:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:06 smithi136 ceph-mon[125702]: pgmap v5107: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:37:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:06 smithi136 ceph-mon[125702]: osdmap e391: 12 total, 12 up, 12 in 2023-03-02T13:37:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:37:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:37:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:37:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:37:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:08 smithi057 ceph-mon[92072]: pgmap v5109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:37:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:08 smithi122 ceph-mon[125440]: pgmap v5109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:37:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:08 smithi136 ceph-mon[125702]: pgmap v5109: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:37:11.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:10 smithi057 ceph-mon[92072]: pgmap v5110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:37:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:10 smithi122 ceph-mon[125440]: pgmap v5110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:37:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:11.323+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:37:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:11.323+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:37:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:11.323+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:37:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:11.323+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:37:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:11.323+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:37:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:10 smithi136 ceph-mon[125702]: pgmap v5110: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:37:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:12 smithi136 ceph-mon[125702]: pgmap v5111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:37:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:12 smithi136 ceph-mon[125702]: osdmap e392: 12 total, 12 up, 12 in 2023-03-02T13:37:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:12 smithi057 ceph-mon[92072]: pgmap v5111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:37:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:12 smithi057 ceph-mon[92072]: osdmap e392: 12 total, 12 up, 12 in 2023-03-02T13:37:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:12 smithi122 ceph-mon[125440]: pgmap v5111: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:37:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:12 smithi122 ceph-mon[125440]: osdmap e392: 12 total, 12 up, 12 in 2023-03-02T13:37:14.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:14 smithi136 ceph-mon[125702]: pgmap v5113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:37:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:14 smithi057 ceph-mon[92072]: pgmap v5113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:37:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:14 smithi122 ceph-mon[125440]: pgmap v5113: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:37:16.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:16 smithi136 ceph-mon[125702]: pgmap v5114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T13:37:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:16 smithi057 ceph-mon[92072]: pgmap v5114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T13:37:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:16 smithi122 ceph-mon[125440]: pgmap v5114: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T13:37:18.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:18 smithi136 ceph-mon[125702]: pgmap v5115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:37:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:18 smithi057 ceph-mon[92072]: pgmap v5115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:37:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:18 smithi122 ceph-mon[125440]: pgmap v5115: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:37:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:20 smithi136 ceph-mon[125702]: pgmap v5116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:37:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:20 smithi057 ceph-mon[92072]: pgmap v5116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:37:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:20 smithi122 ceph-mon[125440]: pgmap v5116: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:37:22.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:22 smithi136 ceph-mon[125702]: pgmap v5117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:37:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:22 smithi057 ceph-mon[92072]: pgmap v5117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:37:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:22 smithi122 ceph-mon[125440]: pgmap v5117: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:37:24.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:24 smithi136 ceph-mon[125702]: pgmap v5118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:37:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:24 smithi057 ceph-mon[92072]: pgmap v5118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:37:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:24 smithi122 ceph-mon[125440]: pgmap v5118: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:37:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:26.339+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:37:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:26.339+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:37:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:26.339+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:37:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:26.339+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:37:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:26.339+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:37:26.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:26 smithi136 ceph-mon[125702]: pgmap v5119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:26 smithi057 ceph-mon[92072]: pgmap v5119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:26 smithi122 ceph-mon[125440]: pgmap v5119: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:28.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:28 smithi136 ceph-mon[125702]: pgmap v5120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:28 smithi057 ceph-mon[92072]: pgmap v5120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:28 smithi122 ceph-mon[125440]: pgmap v5120: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:30 smithi136 ceph-mon[125702]: pgmap v5121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:30 smithi057 ceph-mon[92072]: pgmap v5121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:30 smithi122 ceph-mon[125440]: pgmap v5121: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:32 smithi136 ceph-mon[125702]: pgmap v5122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:32 smithi057 ceph-mon[92072]: pgmap v5122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:32 smithi122 ceph-mon[125440]: pgmap v5122: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:34 smithi136 ceph-mon[125702]: pgmap v5123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:34 smithi057 ceph-mon[92072]: pgmap v5123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:34 smithi122 ceph-mon[125440]: pgmap v5123: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:36 smithi136 ceph-mon[125702]: pgmap v5124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:36 smithi057 ceph-mon[92072]: pgmap v5124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:36 smithi122 ceph-mon[125440]: pgmap v5124: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:38.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:38 smithi136 ceph-mon[125702]: pgmap v5125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:38 smithi057 ceph-mon[92072]: pgmap v5125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:38 smithi122 ceph-mon[125440]: pgmap v5125: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:40.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:40 smithi136 ceph-mon[125702]: pgmap v5126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:40 smithi057 ceph-mon[92072]: pgmap v5126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:40 smithi122 ceph-mon[125440]: pgmap v5126: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:41.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:37:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:41.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:37:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:41.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:37:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:41.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:37:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:41.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:37:42.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:42 smithi136 ceph-mon[125702]: pgmap v5127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:42 smithi057 ceph-mon[92072]: pgmap v5127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:42 smithi122 ceph-mon[125440]: pgmap v5127: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:44 smithi136 ceph-mon[125702]: pgmap v5128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:44 smithi057 ceph-mon[92072]: pgmap v5128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:44 smithi122 ceph-mon[125440]: pgmap v5128: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:46.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:46 smithi136 ceph-mon[125702]: pgmap v5129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:46 smithi057 ceph-mon[92072]: pgmap v5129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:46 smithi122 ceph-mon[125440]: pgmap v5129: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:48.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:48 smithi136 ceph-mon[125702]: pgmap v5130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:48 smithi057 ceph-mon[92072]: pgmap v5130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:48 smithi122 ceph-mon[125440]: pgmap v5130: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:50.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:50 smithi136 ceph-mon[125702]: pgmap v5131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:50 smithi057 ceph-mon[92072]: pgmap v5131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:50 smithi122 ceph-mon[125440]: pgmap v5131: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:52.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:52 smithi136 ceph-mon[125702]: pgmap v5132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:52 smithi057 ceph-mon[92072]: pgmap v5132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:52 smithi122 ceph-mon[125440]: pgmap v5132: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:54.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:54 smithi136 ceph-mon[125702]: pgmap v5133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:54 smithi057 ceph-mon[92072]: pgmap v5133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:54 smithi122 ceph-mon[125440]: pgmap v5133: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:56.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:56.357+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:56.357+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:56.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:37:56.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:37:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:56 smithi136 ceph-mon[125702]: pgmap v5134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:56 smithi057 ceph-mon[92072]: pgmap v5134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:56 smithi122 ceph-mon[125440]: pgmap v5134: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:37:58.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:37:58 smithi136 ceph-mon[125702]: pgmap v5135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:37:58 smithi057 ceph-mon[92072]: pgmap v5135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:37:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:37:58 smithi122 ceph-mon[125440]: pgmap v5135: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:00.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:00 smithi136 ceph-mon[125702]: pgmap v5136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:00 smithi057 ceph-mon[92072]: pgmap v5136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:00 smithi122 ceph-mon[125440]: pgmap v5136: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:02 smithi136 ceph-mon[125702]: pgmap v5137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:02 smithi057 ceph-mon[92072]: pgmap v5137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:02 smithi122 ceph-mon[125440]: pgmap v5137: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:04.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:04 smithi136 ceph-mon[125702]: pgmap v5138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:38:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:04 smithi057 ceph-mon[92072]: pgmap v5138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:38:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:04 smithi122 ceph-mon[125440]: pgmap v5138: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:38:06.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:06 smithi136 ceph-mon[125702]: pgmap v5139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:38:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:06 smithi136 ceph-mon[125702]: osdmap e393: 12 total, 12 up, 12 in 2023-03-02T13:38:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:06 smithi057 ceph-mon[92072]: pgmap v5139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:38:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:06 smithi057 ceph-mon[92072]: osdmap e393: 12 total, 12 up, 12 in 2023-03-02T13:38:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:06 smithi122 ceph-mon[125440]: pgmap v5139: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:38:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:06 smithi122 ceph-mon[125440]: osdmap e393: 12 total, 12 up, 12 in 2023-03-02T13:38:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:38:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:38:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:38:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:08 smithi057 ceph-mon[92072]: pgmap v5141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:38:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:38:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:38:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:38:08.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:08 smithi122 ceph-mon[125440]: pgmap v5141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:38:08.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:38:08.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:38:08.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:38:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:08 smithi136 ceph-mon[125702]: pgmap v5141: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:38:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:38:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:38:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:38:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:09.727+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:38:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:09.727+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:38:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:09.728+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 78 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:38:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:09.728+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 77 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:38:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:10 smithi057 ceph-mon[92072]: pgmap v5142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:38:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:10 smithi122 ceph-mon[125440]: pgmap v5142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:38:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:10 smithi136 ceph-mon[125702]: pgmap v5142: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:38:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:11.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:38:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:11.365+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:38:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:11.365+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:38:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:11.365+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:38:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:11.365+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:38:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:12 smithi136 ceph-mon[125702]: pgmap v5143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:38:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:12 smithi136 ceph-mon[125702]: osdmap e394: 12 total, 12 up, 12 in 2023-03-02T13:38:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:12 smithi057 ceph-mon[92072]: pgmap v5143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:38:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:12 smithi057 ceph-mon[92072]: osdmap e394: 12 total, 12 up, 12 in 2023-03-02T13:38:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:12 smithi122 ceph-mon[125440]: pgmap v5143: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:38:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:12 smithi122 ceph-mon[125440]: osdmap e394: 12 total, 12 up, 12 in 2023-03-02T13:38:14.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:14 smithi136 ceph-mon[125702]: pgmap v5145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:38:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:14 smithi057 ceph-mon[92072]: pgmap v5145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:38:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:14 smithi122 ceph-mon[125440]: pgmap v5145: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:38:16.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:16 smithi136 ceph-mon[125702]: pgmap v5146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:38:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:16 smithi057 ceph-mon[92072]: pgmap v5146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:38:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:16 smithi122 ceph-mon[125440]: pgmap v5146: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:38:18.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:18 smithi136 ceph-mon[125702]: pgmap v5147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:38:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:18 smithi057 ceph-mon[92072]: pgmap v5147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:38:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:18 smithi122 ceph-mon[125440]: pgmap v5147: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:38:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:20 smithi136 ceph-mon[125702]: pgmap v5148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:38:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:20 smithi057 ceph-mon[92072]: pgmap v5148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:38:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:20 smithi122 ceph-mon[125440]: pgmap v5148: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:38:22.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:22 smithi136 ceph-mon[125702]: pgmap v5149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:38:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:22 smithi057 ceph-mon[92072]: pgmap v5149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:38:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:22 smithi122 ceph-mon[125440]: pgmap v5149: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:38:24.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:24 smithi136 ceph-mon[125702]: pgmap v5150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:38:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:24 smithi057 ceph-mon[92072]: pgmap v5150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:38:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:24 smithi122 ceph-mon[125440]: pgmap v5150: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-02T13:38:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:26.369+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:38:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:26.370+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:38:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:26.370+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:38:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:26.370+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:38:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:26.370+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:38:26.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:26 smithi136 ceph-mon[125702]: pgmap v5151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:26 smithi057 ceph-mon[92072]: pgmap v5151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:26 smithi122 ceph-mon[125440]: pgmap v5151: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:28.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:28 smithi136 ceph-mon[125702]: pgmap v5152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:28 smithi057 ceph-mon[92072]: pgmap v5152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:28 smithi122 ceph-mon[125440]: pgmap v5152: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:30 smithi136 ceph-mon[125702]: pgmap v5153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:30 smithi057 ceph-mon[92072]: pgmap v5153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:30 smithi122 ceph-mon[125440]: pgmap v5153: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:32 smithi136 ceph-mon[125702]: pgmap v5154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:32 smithi057 ceph-mon[92072]: pgmap v5154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:32 smithi122 ceph-mon[125440]: pgmap v5154: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:34.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:34 smithi136 ceph-mon[125702]: pgmap v5155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:34 smithi057 ceph-mon[92072]: pgmap v5155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:34.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:34 smithi122 ceph-mon[125440]: pgmap v5155: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:36.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:36 smithi136 ceph-mon[125702]: pgmap v5156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:36 smithi057 ceph-mon[92072]: pgmap v5156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:36 smithi122 ceph-mon[125440]: pgmap v5156: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:38.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:38 smithi136 ceph-mon[125702]: pgmap v5157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:38 smithi057 ceph-mon[92072]: pgmap v5157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:38 smithi122 ceph-mon[125440]: pgmap v5157: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:40.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:40 smithi136 ceph-mon[125702]: pgmap v5158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:40 smithi057 ceph-mon[92072]: pgmap v5158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:40 smithi122 ceph-mon[125440]: pgmap v5158: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:41.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:38:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:41.385+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:38:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:41.385+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:38:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:41.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:38:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:41.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:38:42.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:42 smithi136 ceph-mon[125702]: pgmap v5159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:42 smithi057 ceph-mon[92072]: pgmap v5159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:42 smithi122 ceph-mon[125440]: pgmap v5159: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:44.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:44 smithi136 ceph-mon[125702]: pgmap v5160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:44 smithi057 ceph-mon[92072]: pgmap v5160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:44 smithi122 ceph-mon[125440]: pgmap v5160: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:46.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:46 smithi136 ceph-mon[125702]: pgmap v5161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:46 smithi057 ceph-mon[92072]: pgmap v5161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:46 smithi122 ceph-mon[125440]: pgmap v5161: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:48 smithi136 ceph-mon[125702]: pgmap v5162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:48 smithi057 ceph-mon[92072]: pgmap v5162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:48 smithi122 ceph-mon[125440]: pgmap v5162: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:50 smithi136 ceph-mon[125702]: pgmap v5163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:50 smithi057 ceph-mon[92072]: pgmap v5163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:50 smithi122 ceph-mon[125440]: pgmap v5163: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:52.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:52 smithi136 ceph-mon[125702]: pgmap v5164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:52 smithi057 ceph-mon[92072]: pgmap v5164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:52 smithi122 ceph-mon[125440]: pgmap v5164: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:54.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:54 smithi136 ceph-mon[125702]: pgmap v5165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:54 smithi057 ceph-mon[92072]: pgmap v5165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:54 smithi122 ceph-mon[125440]: pgmap v5165: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:56.395+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:38:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:56.395+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:38:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:56.395+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:38:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:56.395+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:38:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:38:56.395+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:38:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:56 smithi136 ceph-mon[125702]: pgmap v5166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:56 smithi057 ceph-mon[92072]: pgmap v5166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:56 smithi122 ceph-mon[125440]: pgmap v5166: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:38:58.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:38:58 smithi136 ceph-mon[125702]: pgmap v5167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:58.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:38:58 smithi057 ceph-mon[92072]: pgmap v5167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:38:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:38:58 smithi122 ceph-mon[125440]: pgmap v5167: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:00.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:00 smithi136 ceph-mon[125702]: pgmap v5168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:00 smithi057 ceph-mon[92072]: pgmap v5168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:00.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:00 smithi122 ceph-mon[125440]: pgmap v5168: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:02 smithi057 ceph-mon[92072]: pgmap v5169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:02 smithi122 ceph-mon[125440]: pgmap v5169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:02 smithi136 ceph-mon[125702]: pgmap v5169: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:04 smithi057 ceph-mon[92072]: pgmap v5170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:39:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:04 smithi122 ceph-mon[125440]: pgmap v5170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:39:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:04 smithi136 ceph-mon[125702]: pgmap v5170: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:39:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:06 smithi057 ceph-mon[92072]: pgmap v5171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:39:06.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:06 smithi122 ceph-mon[125440]: pgmap v5171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:39:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:06 smithi136 ceph-mon[125702]: pgmap v5171: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:39:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:08 smithi057 ceph-mon[92072]: pgmap v5172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:39:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:39:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:39:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:39:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:39:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:08 smithi122 ceph-mon[125440]: pgmap v5172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:39:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:39:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:39:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:39:08.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:39:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:08 smithi136 ceph-mon[125702]: pgmap v5172: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:39:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:39:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:39:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:39:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:39:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:10 smithi057 ceph-mon[92072]: pgmap v5173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:39:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:10 smithi122 ceph-mon[125440]: pgmap v5173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:39:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:10 smithi136 ceph-mon[125702]: pgmap v5173: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:39:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:11.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:39:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:11.412+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:39:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:11.412+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:39:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:11.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:39:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:11.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:39:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:11 smithi057 ceph-mon[92072]: osdmap e395: 12 total, 12 up, 12 in 2023-03-02T13:39:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:11 smithi122 ceph-mon[125440]: osdmap e395: 12 total, 12 up, 12 in 2023-03-02T13:39:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:11 smithi136 ceph-mon[125702]: osdmap e395: 12 total, 12 up, 12 in 2023-03-02T13:39:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:12 smithi057 ceph-mon[92072]: pgmap v5175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:39:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:12 smithi122 ceph-mon[125440]: pgmap v5175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:39:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:12 smithi136 ceph-mon[125702]: pgmap v5175: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:39:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:14 smithi057 ceph-mon[92072]: pgmap v5176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:14 smithi122 ceph-mon[125440]: pgmap v5176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:14 smithi136 ceph-mon[125702]: pgmap v5176: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:16 smithi057 ceph-mon[92072]: pgmap v5177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:16 smithi057 ceph-mon[92072]: osdmap e396: 12 total, 12 up, 12 in 2023-03-02T13:39:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:16 smithi122 ceph-mon[125440]: pgmap v5177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:16 smithi122 ceph-mon[125440]: osdmap e396: 12 total, 12 up, 12 in 2023-03-02T13:39:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:16 smithi136 ceph-mon[125702]: pgmap v5177: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:16 smithi136 ceph-mon[125702]: osdmap e396: 12 total, 12 up, 12 in 2023-03-02T13:39:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:18 smithi057 ceph-mon[92072]: pgmap v5179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:39:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:18 smithi122 ceph-mon[125440]: pgmap v5179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:39:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:18 smithi136 ceph-mon[125702]: pgmap v5179: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:39:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:20 smithi057 ceph-mon[92072]: pgmap v5180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 349 B/s wr, 11 op/s 2023-03-02T13:39:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:20 smithi122 ceph-mon[125440]: pgmap v5180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 349 B/s wr, 11 op/s 2023-03-02T13:39:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:20 smithi136 ceph-mon[125702]: pgmap v5180: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 349 B/s wr, 11 op/s 2023-03-02T13:39:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:22 smithi057 ceph-mon[92072]: pgmap v5181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T13:39:22.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:22 smithi122 ceph-mon[125440]: pgmap v5181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T13:39:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:22 smithi136 ceph-mon[125702]: pgmap v5181: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T13:39:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:24 smithi057 ceph-mon[92072]: pgmap v5182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:24 smithi122 ceph-mon[125440]: pgmap v5182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:24 smithi136 ceph-mon[125702]: pgmap v5182: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:26.421+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:39:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:26.422+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:39:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:26.422+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:39:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:26.422+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:39:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:26.422+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:39:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:26 smithi057 ceph-mon[92072]: pgmap v5183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:26 smithi122 ceph-mon[125440]: pgmap v5183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:26 smithi136 ceph-mon[125702]: pgmap v5183: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:39:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:28 smithi057 ceph-mon[92072]: pgmap v5184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 188 B/s wr, 14 op/s 2023-03-02T13:39:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:28 smithi122 ceph-mon[125440]: pgmap v5184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 188 B/s wr, 14 op/s 2023-03-02T13:39:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:28 smithi136 ceph-mon[125702]: pgmap v5184: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 188 B/s wr, 14 op/s 2023-03-02T13:39:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:30 smithi057 ceph-mon[92072]: pgmap v5185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:30 smithi122 ceph-mon[125440]: pgmap v5185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:30 smithi136 ceph-mon[125702]: pgmap v5185: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:32 smithi057 ceph-mon[92072]: pgmap v5186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:32 smithi122 ceph-mon[125440]: pgmap v5186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:32 smithi136 ceph-mon[125702]: pgmap v5186: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:34 smithi057 ceph-mon[92072]: pgmap v5187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:34 smithi122 ceph-mon[125440]: pgmap v5187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:34 smithi136 ceph-mon[125702]: pgmap v5187: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:36 smithi057 ceph-mon[92072]: pgmap v5188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:36 smithi122 ceph-mon[125440]: pgmap v5188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:36 smithi136 ceph-mon[125702]: pgmap v5188: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:38 smithi057 ceph-mon[92072]: pgmap v5189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:38 smithi122 ceph-mon[125440]: pgmap v5189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:38 smithi136 ceph-mon[125702]: pgmap v5189: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:40 smithi057 ceph-mon[92072]: pgmap v5190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:40 smithi122 ceph-mon[125440]: pgmap v5190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:40 smithi136 ceph-mon[125702]: pgmap v5190: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:41.429+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:39:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:41.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:39:41.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:41.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:39:41.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:41.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:39:41.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:41.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:39:42.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:42 smithi122 ceph-mon[125440]: pgmap v5191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:42 smithi136 ceph-mon[125702]: pgmap v5191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:42 smithi057 ceph-mon[92072]: pgmap v5191: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:44 smithi122 ceph-mon[125440]: pgmap v5192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:44 smithi136 ceph-mon[125702]: pgmap v5192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:44 smithi057 ceph-mon[92072]: pgmap v5192: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:46 smithi122 ceph-mon[125440]: pgmap v5193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:46 smithi136 ceph-mon[125702]: pgmap v5193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:46 smithi057 ceph-mon[92072]: pgmap v5193: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:48 smithi122 ceph-mon[125440]: pgmap v5194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:48 smithi136 ceph-mon[125702]: pgmap v5194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:48 smithi057 ceph-mon[92072]: pgmap v5194: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:50 smithi136 ceph-mon[125702]: pgmap v5195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:50 smithi057 ceph-mon[92072]: pgmap v5195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:50 smithi122 ceph-mon[125440]: pgmap v5195: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:52 smithi136 ceph-mon[125702]: pgmap v5196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:52 smithi057 ceph-mon[92072]: pgmap v5196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:52 smithi122 ceph-mon[125440]: pgmap v5196: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:54 smithi136 ceph-mon[125702]: pgmap v5197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:54 smithi057 ceph-mon[92072]: pgmap v5197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:54 smithi122 ceph-mon[125440]: pgmap v5197: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:56.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:56.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:39:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:56.431+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:39:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:56.431+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:39:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:56.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:39:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:39:56.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:39:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:56 smithi136 ceph-mon[125702]: pgmap v5198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:56 smithi057 ceph-mon[92072]: pgmap v5198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:56 smithi122 ceph-mon[125440]: pgmap v5198: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:39:59.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:39:58 smithi136 ceph-mon[125702]: pgmap v5199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:39:58 smithi057 ceph-mon[92072]: pgmap v5199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:39:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:39:58 smithi122 ceph-mon[125440]: pgmap v5199: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:00 smithi136 ceph-mon[125702]: pgmap v5200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T13:40:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:00 smithi057 ceph-mon[92072]: pgmap v5200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T13:40:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:00 smithi122 ceph-mon[125440]: pgmap v5200: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T13:40:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:02 smithi136 ceph-mon[125702]: pgmap v5201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:02 smithi057 ceph-mon[92072]: pgmap v5201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:02 smithi122 ceph-mon[125440]: pgmap v5201: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:04 smithi136 ceph-mon[125702]: pgmap v5202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:40:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:04 smithi057 ceph-mon[92072]: pgmap v5202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:40:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:04 smithi122 ceph-mon[125440]: pgmap v5202: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:40:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:06 smithi136 ceph-mon[125702]: pgmap v5203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:40:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:06 smithi057 ceph-mon[92072]: pgmap v5203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:40:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:06 smithi122 ceph-mon[125440]: pgmap v5203: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:40:09.028 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:08 smithi057 ceph-mon[92072]: pgmap v5204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:40:09.029 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:40:09.059 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:08 smithi136 ceph-mon[125702]: pgmap v5204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:40:09.060 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:40:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:08 smithi122 ceph-mon[125440]: pgmap v5204: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:40:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:40:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:40:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:40:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:40:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:40:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:40:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:40:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:40:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:40:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:40:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:10 smithi136 ceph-mon[125702]: pgmap v5205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:40:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:10 smithi057 ceph-mon[92072]: pgmap v5205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:40:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:10 smithi122 ceph-mon[125440]: pgmap v5205: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:40:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:11.444+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:40:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:11.444+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:40:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:11.444+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:40:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:11.444+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:40:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:11.444+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:40:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:11 smithi136 ceph-mon[125702]: osdmap e397: 12 total, 12 up, 12 in 2023-03-02T13:40:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:11 smithi057 ceph-mon[92072]: osdmap e397: 12 total, 12 up, 12 in 2023-03-02T13:40:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:11 smithi122 ceph-mon[125440]: osdmap e397: 12 total, 12 up, 12 in 2023-03-02T13:40:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:12 smithi136 ceph-mon[125702]: pgmap v5207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:40:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:12 smithi057 ceph-mon[92072]: pgmap v5207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:40:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:12 smithi122 ceph-mon[125440]: pgmap v5207: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:40:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:14 smithi136 ceph-mon[125702]: pgmap v5208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:40:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:14 smithi057 ceph-mon[92072]: pgmap v5208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:40:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:14 smithi122 ceph-mon[125440]: pgmap v5208: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:40:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:16 smithi136 ceph-mon[125702]: pgmap v5209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:40:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:16 smithi136 ceph-mon[125702]: osdmap e398: 12 total, 12 up, 12 in 2023-03-02T13:40:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:16 smithi057 ceph-mon[92072]: pgmap v5209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:40:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:16 smithi057 ceph-mon[92072]: osdmap e398: 12 total, 12 up, 12 in 2023-03-02T13:40:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:16 smithi122 ceph-mon[125440]: pgmap v5209: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:40:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:16 smithi122 ceph-mon[125440]: osdmap e398: 12 total, 12 up, 12 in 2023-03-02T13:40:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:18 smithi136 ceph-mon[125702]: pgmap v5211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:40:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:18 smithi057 ceph-mon[92072]: pgmap v5211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:40:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:18 smithi122 ceph-mon[125440]: pgmap v5211: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:40:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:20 smithi136 ceph-mon[125702]: pgmap v5212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T13:40:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:20 smithi057 ceph-mon[92072]: pgmap v5212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T13:40:21.274 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:20 smithi122 ceph-mon[125440]: pgmap v5212: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T13:40:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:22 smithi136 ceph-mon[125702]: pgmap v5213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:40:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:22 smithi057 ceph-mon[92072]: pgmap v5213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:40:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:22 smithi122 ceph-mon[125440]: pgmap v5213: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:40:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:24 smithi136 ceph-mon[125702]: pgmap v5214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:40:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:24 smithi057 ceph-mon[92072]: pgmap v5214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:40:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:24 smithi122 ceph-mon[125440]: pgmap v5214: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:40:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:26.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:40:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:26.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:40:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:26.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:40:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:26.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:40:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:26.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:40:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:26 smithi136 ceph-mon[125702]: pgmap v5215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:40:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:26 smithi057 ceph-mon[92072]: pgmap v5215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:40:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:26 smithi122 ceph-mon[125440]: pgmap v5215: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:40:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:28 smithi136 ceph-mon[125702]: pgmap v5216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:40:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:28 smithi057 ceph-mon[92072]: pgmap v5216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:40:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:28 smithi122 ceph-mon[125440]: pgmap v5216: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:40:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:30 smithi136 ceph-mon[125702]: pgmap v5217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:30 smithi057 ceph-mon[92072]: pgmap v5217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:30 smithi122 ceph-mon[125440]: pgmap v5217: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:32 smithi136 ceph-mon[125702]: pgmap v5218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:32 smithi057 ceph-mon[92072]: pgmap v5218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:32 smithi122 ceph-mon[125440]: pgmap v5218: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:34 smithi136 ceph-mon[125702]: pgmap v5219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:34 smithi057 ceph-mon[92072]: pgmap v5219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:34 smithi122 ceph-mon[125440]: pgmap v5219: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:36 smithi057 ceph-mon[92072]: pgmap v5220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:36 smithi122 ceph-mon[125440]: pgmap v5220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:36 smithi136 ceph-mon[125702]: pgmap v5220: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:38 smithi057 ceph-mon[92072]: pgmap v5221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:38 smithi122 ceph-mon[125440]: pgmap v5221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:38 smithi136 ceph-mon[125702]: pgmap v5221: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:41.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:40 smithi057 ceph-mon[92072]: pgmap v5222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:41.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:40 smithi122 ceph-mon[125440]: pgmap v5222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:40 smithi136 ceph-mon[125702]: pgmap v5222: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:41.475+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:40:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:41.475+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:40:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:41.475+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:40:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:41.475+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:40:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:41.475+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:40:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:42 smithi057 ceph-mon[92072]: pgmap v5223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:42 smithi122 ceph-mon[125440]: pgmap v5223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:42 smithi136 ceph-mon[125702]: pgmap v5223: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:44 smithi057 ceph-mon[92072]: pgmap v5224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:44 smithi122 ceph-mon[125440]: pgmap v5224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:44 smithi136 ceph-mon[125702]: pgmap v5224: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:46 smithi057 ceph-mon[92072]: pgmap v5225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:47.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:46 smithi122 ceph-mon[125440]: pgmap v5225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:46 smithi136 ceph-mon[125702]: pgmap v5225: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:48 smithi057 ceph-mon[92072]: pgmap v5226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:48 smithi122 ceph-mon[125440]: pgmap v5226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:48 smithi136 ceph-mon[125702]: pgmap v5226: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:50 smithi057 ceph-mon[92072]: pgmap v5227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:50 smithi122 ceph-mon[125440]: pgmap v5227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:51.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:50 smithi136 ceph-mon[125702]: pgmap v5227: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:52 smithi057 ceph-mon[92072]: pgmap v5228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:53.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:52 smithi122 ceph-mon[125440]: pgmap v5228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:52 smithi136 ceph-mon[125702]: pgmap v5228: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:54 smithi057 ceph-mon[92072]: pgmap v5229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:54 smithi122 ceph-mon[125440]: pgmap v5229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:54 smithi136 ceph-mon[125702]: pgmap v5229: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:56.485+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:56.485+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:56.485+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:40:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:56.485+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:40:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:40:56.485+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:40:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:56 smithi057 ceph-mon[92072]: pgmap v5230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:56 smithi122 ceph-mon[125440]: pgmap v5230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:56 smithi136 ceph-mon[125702]: pgmap v5230: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:40:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:40:58 smithi057 ceph-mon[92072]: pgmap v5231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:40:58 smithi122 ceph-mon[125440]: pgmap v5231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:40:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:40:58 smithi136 ceph-mon[125702]: pgmap v5231: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:00 smithi057 ceph-mon[92072]: pgmap v5232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:00 smithi122 ceph-mon[125440]: pgmap v5232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:00 smithi136 ceph-mon[125702]: pgmap v5232: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:02 smithi057 ceph-mon[92072]: pgmap v5233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:02 smithi122 ceph-mon[125440]: pgmap v5233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:02 smithi136 ceph-mon[125702]: pgmap v5233: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:04 smithi057 ceph-mon[92072]: pgmap v5234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:41:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:04 smithi122 ceph-mon[125440]: pgmap v5234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:41:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:04 smithi136 ceph-mon[125702]: pgmap v5234: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:41:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:06 smithi057 ceph-mon[92072]: pgmap v5235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:41:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:06 smithi122 ceph-mon[125440]: pgmap v5235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:41:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:06 smithi136 ceph-mon[125702]: pgmap v5235: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:41:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:08 smithi057 ceph-mon[92072]: pgmap v5236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:41:09.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:08 smithi122 ceph-mon[125440]: pgmap v5236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:41:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:08 smithi136 ceph-mon[125702]: pgmap v5236: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:41:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:09.752+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:41:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:09.752+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:41:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:09.753+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 78 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:41:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:09.753+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 79 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:41:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:41:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:41:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:41:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:10 smithi136 ceph-mon[125702]: pgmap v5237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:41:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:41:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:41:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:41:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:10 smithi057 ceph-mon[92072]: pgmap v5237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:41:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:41:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:41:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:41:11.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:10 smithi122 ceph-mon[125440]: pgmap v5237: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:41:11.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:41:11.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:41:11.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:41:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:11.495+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:41:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:11.495+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:41:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:11.495+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:41:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:11.495+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:41:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:11.495+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:41:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:11 smithi136 ceph-mon[125702]: osdmap e399: 12 total, 12 up, 12 in 2023-03-02T13:41:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:11 smithi057 ceph-mon[92072]: osdmap e399: 12 total, 12 up, 12 in 2023-03-02T13:41:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:11 smithi122 ceph-mon[125440]: osdmap e399: 12 total, 12 up, 12 in 2023-03-02T13:41:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:12 smithi136 ceph-mon[125702]: pgmap v5239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:41:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:12 smithi057 ceph-mon[92072]: pgmap v5239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:41:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:12 smithi122 ceph-mon[125440]: pgmap v5239: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:41:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:14 smithi136 ceph-mon[125702]: pgmap v5240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:41:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:14 smithi057 ceph-mon[92072]: pgmap v5240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:41:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:14 smithi122 ceph-mon[125440]: pgmap v5240: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:41:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:16 smithi136 ceph-mon[125702]: pgmap v5241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:41:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:16 smithi136 ceph-mon[125702]: osdmap e400: 12 total, 12 up, 12 in 2023-03-02T13:41:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:16 smithi057 ceph-mon[92072]: pgmap v5241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:41:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:16 smithi057 ceph-mon[92072]: osdmap e400: 12 total, 12 up, 12 in 2023-03-02T13:41:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:16 smithi122 ceph-mon[125440]: pgmap v5241: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:41:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:16 smithi122 ceph-mon[125440]: osdmap e400: 12 total, 12 up, 12 in 2023-03-02T13:41:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:18 smithi136 ceph-mon[125702]: pgmap v5243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:41:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:18 smithi057 ceph-mon[92072]: pgmap v5243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:41:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:18 smithi122 ceph-mon[125440]: pgmap v5243: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:41:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:20 smithi136 ceph-mon[125702]: pgmap v5244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:41:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:20 smithi057 ceph-mon[92072]: pgmap v5244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:41:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:20 smithi122 ceph-mon[125440]: pgmap v5244: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:41:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:22 smithi136 ceph-mon[125702]: pgmap v5245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:41:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:22 smithi057 ceph-mon[92072]: pgmap v5245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:41:23.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:22 smithi122 ceph-mon[125440]: pgmap v5245: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:41:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:24 smithi136 ceph-mon[125702]: pgmap v5246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:41:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:24 smithi057 ceph-mon[92072]: pgmap v5246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:41:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:24 smithi122 ceph-mon[125440]: pgmap v5246: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:41:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:26.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:41:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:26.510+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:41:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:26.510+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:41:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:26.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:41:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:26.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:41:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:27 smithi136 ceph-mon[125702]: pgmap v5247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:41:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:27 smithi057 ceph-mon[92072]: pgmap v5247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:41:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:27 smithi122 ceph-mon[125440]: pgmap v5247: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:41:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:29 smithi136 ceph-mon[125702]: pgmap v5248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:41:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:29 smithi057 ceph-mon[92072]: pgmap v5248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:41:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:29 smithi122 ceph-mon[125440]: pgmap v5248: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:41:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:31 smithi136 ceph-mon[125702]: pgmap v5249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:31 smithi057 ceph-mon[92072]: pgmap v5249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:31 smithi122 ceph-mon[125440]: pgmap v5249: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:33 smithi136 ceph-mon[125702]: pgmap v5250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:33 smithi057 ceph-mon[92072]: pgmap v5250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:33 smithi122 ceph-mon[125440]: pgmap v5250: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:35 smithi136 ceph-mon[125702]: pgmap v5251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:35 smithi057 ceph-mon[92072]: pgmap v5251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:35 smithi122 ceph-mon[125440]: pgmap v5251: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:37 smithi136 ceph-mon[125702]: pgmap v5252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:37 smithi057 ceph-mon[92072]: pgmap v5252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:37 smithi122 ceph-mon[125440]: pgmap v5252: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:39 smithi136 ceph-mon[125702]: pgmap v5253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:39 smithi057 ceph-mon[92072]: pgmap v5253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:39 smithi122 ceph-mon[125440]: pgmap v5253: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:41 smithi136 ceph-mon[125702]: pgmap v5254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:41 smithi057 ceph-mon[92072]: pgmap v5254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:41 smithi122 ceph-mon[125440]: pgmap v5254: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:41.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:41:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:41.515+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:41:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:41.515+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:41:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:41.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:41:41.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:41.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:41:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:43 smithi136 ceph-mon[125702]: pgmap v5255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:43 smithi057 ceph-mon[92072]: pgmap v5255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:43 smithi122 ceph-mon[125440]: pgmap v5255: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:45 smithi136 ceph-mon[125702]: pgmap v5256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:45 smithi057 ceph-mon[92072]: pgmap v5256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:45 smithi122 ceph-mon[125440]: pgmap v5256: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:47 smithi136 ceph-mon[125702]: pgmap v5257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:47 smithi057 ceph-mon[92072]: pgmap v5257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:47 smithi122 ceph-mon[125440]: pgmap v5257: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:49 smithi136 ceph-mon[125702]: pgmap v5258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:49 smithi057 ceph-mon[92072]: pgmap v5258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:49 smithi122 ceph-mon[125440]: pgmap v5258: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:51 smithi136 ceph-mon[125702]: pgmap v5259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:51 smithi057 ceph-mon[92072]: pgmap v5259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:51 smithi122 ceph-mon[125440]: pgmap v5259: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:53 smithi136 ceph-mon[125702]: pgmap v5260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:53 smithi057 ceph-mon[92072]: pgmap v5260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:53 smithi122 ceph-mon[125440]: pgmap v5260: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:55 smithi136 ceph-mon[125702]: pgmap v5261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:55 smithi057 ceph-mon[92072]: pgmap v5261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:55 smithi122 ceph-mon[125440]: pgmap v5261: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:56.531+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:41:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:56.531+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:41:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:56.531+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:41:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:56.531+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:41:56.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:41:56.531+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:41:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:57 smithi136 ceph-mon[125702]: pgmap v5262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:57 smithi057 ceph-mon[92072]: pgmap v5262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:57 smithi122 ceph-mon[125440]: pgmap v5262: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:41:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:41:59 smithi136 ceph-mon[125702]: pgmap v5263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:41:59 smithi057 ceph-mon[92072]: pgmap v5263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:41:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:41:59 smithi122 ceph-mon[125440]: pgmap v5263: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:01 smithi136 ceph-mon[125702]: pgmap v5264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:01 smithi057 ceph-mon[92072]: pgmap v5264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:01 smithi122 ceph-mon[125440]: pgmap v5264: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:03 smithi136 ceph-mon[125702]: pgmap v5265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:03 smithi057 ceph-mon[92072]: pgmap v5265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:03.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:03 smithi122 ceph-mon[125440]: pgmap v5265: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:05 smithi136 ceph-mon[125702]: pgmap v5266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:42:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:05 smithi057 ceph-mon[92072]: pgmap v5266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:42:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:05 smithi122 ceph-mon[125440]: pgmap v5266: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:42:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:07 smithi136 ceph-mon[125702]: pgmap v5267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:42:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:07 smithi057 ceph-mon[92072]: pgmap v5267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:42:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:07 smithi122 ceph-mon[125440]: pgmap v5267: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:42:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:09 smithi057 ceph-mon[92072]: pgmap v5268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:42:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:09 smithi122 ceph-mon[125440]: pgmap v5268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:42:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:09 smithi136 ceph-mon[125702]: pgmap v5268: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:42:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:11 smithi057 ceph-mon[92072]: pgmap v5269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:42:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:42:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:11 smithi122 ceph-mon[125440]: pgmap v5269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:42:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:42:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:11.531+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:42:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:11.532+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:42:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:11.532+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:42:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:11.532+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:42:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:11.532+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:42:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:11 smithi136 ceph-mon[125702]: pgmap v5269: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:42:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:42:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:12 smithi057 ceph-mon[92072]: osdmap e401: 12 total, 12 up, 12 in 2023-03-02T13:42:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:12 smithi122 ceph-mon[125440]: osdmap e401: 12 total, 12 up, 12 in 2023-03-02T13:42:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:12 smithi136 ceph-mon[125702]: osdmap e401: 12 total, 12 up, 12 in 2023-03-02T13:42:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:13 smithi122 ceph-mon[125440]: pgmap v5271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:42:13.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:13 smithi057 ceph-mon[92072]: pgmap v5271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:42:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:13 smithi136 ceph-mon[125702]: pgmap v5271: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:42:14.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:14 smithi136 ceph-mon[125702]: pgmap v5272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:42:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:14 smithi057 ceph-mon[92072]: pgmap v5272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:42:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:14 smithi122 ceph-mon[125440]: pgmap v5272: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:42:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:42:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:42:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:42:16.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:42:16.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:42:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:42:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:42:16.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:42:16.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:42:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:42:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:42:16.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:42:16.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:42:16.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:42:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:17 smithi136 ceph-mon[125702]: pgmap v5273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:42:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:17 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:42:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:17 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:42:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:17 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:42:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:17 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:42:17.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:17 smithi136 ceph-mon[125702]: osdmap e402: 12 total, 12 up, 12 in 2023-03-02T13:42:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:17 smithi057 ceph-mon[92072]: pgmap v5273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:42:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:17 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:42:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:17 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:42:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:17 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:42:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:17 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:42:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:17 smithi057 ceph-mon[92072]: osdmap e402: 12 total, 12 up, 12 in 2023-03-02T13:42:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:17 smithi122 ceph-mon[125440]: pgmap v5273: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:42:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:17 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:42:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:17 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:42:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:17 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:42:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:17 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:42:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:17 smithi122 ceph-mon[125440]: osdmap e402: 12 total, 12 up, 12 in 2023-03-02T13:42:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:19 smithi136 ceph-mon[125702]: pgmap v5275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:42:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:19 smithi057 ceph-mon[92072]: pgmap v5275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:42:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:19 smithi122 ceph-mon[125440]: pgmap v5275: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:42:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:21 smithi057 ceph-mon[92072]: pgmap v5276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:42:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:21 smithi122 ceph-mon[125440]: pgmap v5276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:42:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:21 smithi136 ceph-mon[125702]: pgmap v5276: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T13:42:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:23 smithi057 ceph-mon[92072]: pgmap v5277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:42:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:23 smithi122 ceph-mon[125440]: pgmap v5277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:42:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:23 smithi136 ceph-mon[125702]: pgmap v5277: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:42:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:25 smithi057 ceph-mon[92072]: pgmap v5278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:42:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:25 smithi122 ceph-mon[125440]: pgmap v5278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:42:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:25 smithi136 ceph-mon[125702]: pgmap v5278: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:42:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:26.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:42:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:26.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:42:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:26.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:42:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:26.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:42:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:26.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:42:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:27 smithi057 ceph-mon[92072]: pgmap v5279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:42:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:27 smithi122 ceph-mon[125440]: pgmap v5279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:42:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:27 smithi136 ceph-mon[125702]: pgmap v5279: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:42:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:29 smithi057 ceph-mon[92072]: pgmap v5280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:42:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:29 smithi122 ceph-mon[125440]: pgmap v5280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:42:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:29 smithi136 ceph-mon[125702]: pgmap v5280: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:42:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:31 smithi057 ceph-mon[92072]: pgmap v5281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:31 smithi122 ceph-mon[125440]: pgmap v5281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:31 smithi136 ceph-mon[125702]: pgmap v5281: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:33 smithi057 ceph-mon[92072]: pgmap v5282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:33 smithi122 ceph-mon[125440]: pgmap v5282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:33 smithi136 ceph-mon[125702]: pgmap v5282: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:35 smithi057 ceph-mon[92072]: pgmap v5283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:35 smithi122 ceph-mon[125440]: pgmap v5283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:35 smithi136 ceph-mon[125702]: pgmap v5283: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:37 smithi057 ceph-mon[92072]: pgmap v5284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:37 smithi122 ceph-mon[125440]: pgmap v5284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:37.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:37 smithi136 ceph-mon[125702]: pgmap v5284: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:39 smithi057 ceph-mon[92072]: pgmap v5285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:39 smithi122 ceph-mon[125440]: pgmap v5285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:39 smithi136 ceph-mon[125702]: pgmap v5285: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:41 smithi057 ceph-mon[92072]: pgmap v5286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:41 smithi122 ceph-mon[125440]: pgmap v5286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:41.561+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:42:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:41.561+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:42:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:41.561+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:42:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:41.561+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:42:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:41.561+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:42:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:41 smithi136 ceph-mon[125702]: pgmap v5286: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:43 smithi057 ceph-mon[92072]: pgmap v5287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:43 smithi122 ceph-mon[125440]: pgmap v5287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:43 smithi136 ceph-mon[125702]: pgmap v5287: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:45 smithi057 ceph-mon[92072]: pgmap v5288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:45 smithi122 ceph-mon[125440]: pgmap v5288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:45 smithi136 ceph-mon[125702]: pgmap v5288: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:47 smithi057 ceph-mon[92072]: pgmap v5289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:47 smithi122 ceph-mon[125440]: pgmap v5289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:47 smithi136 ceph-mon[125702]: pgmap v5289: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:49 smithi057 ceph-mon[92072]: pgmap v5290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:49 smithi122 ceph-mon[125440]: pgmap v5290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:49 smithi136 ceph-mon[125702]: pgmap v5290: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:50 smithi136 ceph-mon[125702]: pgmap v5291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:50 smithi057 ceph-mon[92072]: pgmap v5291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:50.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:50 smithi122 ceph-mon[125440]: pgmap v5291: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:52.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:52 smithi136 ceph-mon[125702]: pgmap v5292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:52 smithi057 ceph-mon[92072]: pgmap v5292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:52 smithi122 ceph-mon[125440]: pgmap v5292: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:54 smithi057 ceph-mon[92072]: pgmap v5293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:54.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:54 smithi122 ceph-mon[125440]: pgmap v5293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:54 smithi136 ceph-mon[125702]: pgmap v5293: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:56.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:42:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:56.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:42:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:56.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:42:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:56.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:42:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:42:56.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:42:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:56 smithi057 ceph-mon[92072]: pgmap v5294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:56.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:56 smithi122 ceph-mon[125440]: pgmap v5294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:56 smithi136 ceph-mon[125702]: pgmap v5294: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:42:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:42:58 smithi057 ceph-mon[92072]: pgmap v5295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:58.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:42:58 smithi122 ceph-mon[125440]: pgmap v5295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:42:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:42:58 smithi136 ceph-mon[125702]: pgmap v5295: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:00 smithi057 ceph-mon[92072]: pgmap v5296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:00.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:00 smithi122 ceph-mon[125440]: pgmap v5296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:00 smithi136 ceph-mon[125702]: pgmap v5296: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:02 smithi057 ceph-mon[92072]: pgmap v5297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:02.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:02 smithi122 ceph-mon[125440]: pgmap v5297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:02 smithi136 ceph-mon[125702]: pgmap v5297: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:04 smithi057 ceph-mon[92072]: pgmap v5298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:43:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:04 smithi122 ceph-mon[125440]: pgmap v5298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:43:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:04 smithi136 ceph-mon[125702]: pgmap v5298: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:43:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:06 smithi057 ceph-mon[92072]: pgmap v5299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:43:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:06 smithi122 ceph-mon[125440]: pgmap v5299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:43:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:06 smithi136 ceph-mon[125702]: pgmap v5299: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:43:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:08 smithi057 ceph-mon[92072]: pgmap v5300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:43:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:08 smithi122 ceph-mon[125440]: pgmap v5300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:43:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:08 smithi136 ceph-mon[125702]: pgmap v5300: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:43:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:10 smithi057 ceph-mon[92072]: pgmap v5301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:43:10.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:10 smithi122 ceph-mon[125440]: pgmap v5301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:43:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:10 smithi136 ceph-mon[125702]: pgmap v5301: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:43:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:11.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:43:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:11.582+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:43:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:11.582+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:43:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:11.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:43:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:11.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:43:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:11 smithi057 ceph-mon[92072]: osdmap e403: 12 total, 12 up, 12 in 2023-03-02T13:43:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:11 smithi122 ceph-mon[125440]: osdmap e403: 12 total, 12 up, 12 in 2023-03-02T13:43:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:11 smithi136 ceph-mon[125702]: osdmap e403: 12 total, 12 up, 12 in 2023-03-02T13:43:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:12 smithi057 ceph-mon[92072]: pgmap v5303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:43:12.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:12 smithi122 ceph-mon[125440]: pgmap v5303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:43:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:12 smithi136 ceph-mon[125702]: pgmap v5303: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:43:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:14 smithi057 ceph-mon[92072]: pgmap v5304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:43:14.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:14 smithi122 ceph-mon[125440]: pgmap v5304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:43:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:14 smithi136 ceph-mon[125702]: pgmap v5304: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:43:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:16 smithi057 ceph-mon[92072]: pgmap v5305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:43:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:43:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:16 smithi057 ceph-mon[92072]: osdmap e404: 12 total, 12 up, 12 in 2023-03-02T13:43:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:43:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:43:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:43:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:16 smithi122 ceph-mon[125440]: pgmap v5305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:43:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:43:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:16 smithi122 ceph-mon[125440]: osdmap e404: 12 total, 12 up, 12 in 2023-03-02T13:43:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:43:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:43:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:43:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:16 smithi136 ceph-mon[125702]: pgmap v5305: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:43:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:43:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:16 smithi136 ceph-mon[125702]: osdmap e404: 12 total, 12 up, 12 in 2023-03-02T13:43:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:43:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:43:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:43:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:18 smithi057 ceph-mon[92072]: pgmap v5307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:43:18.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:18 smithi122 ceph-mon[125440]: pgmap v5307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:43:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:18 smithi136 ceph-mon[125702]: pgmap v5307: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:43:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:20 smithi057 ceph-mon[92072]: pgmap v5308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:43:20.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:20 smithi122 ceph-mon[125440]: pgmap v5308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:43:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:20 smithi136 ceph-mon[125702]: pgmap v5308: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 231 B/s wr, 11 op/s 2023-03-02T13:43:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:22 smithi057 ceph-mon[92072]: pgmap v5309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:43:22.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:22 smithi122 ceph-mon[125440]: pgmap v5309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:43:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:22 smithi136 ceph-mon[125702]: pgmap v5309: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:43:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:24 smithi057 ceph-mon[92072]: pgmap v5310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:43:24.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:24 smithi122 ceph-mon[125440]: pgmap v5310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:43:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:24 smithi136 ceph-mon[125702]: pgmap v5310: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:43:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:26.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:43:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:26.598+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:43:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:26.598+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:43:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:26.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:43:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:26.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:43:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:26 smithi057 ceph-mon[92072]: pgmap v5311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:43:26.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:26 smithi122 ceph-mon[125440]: pgmap v5311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:43:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:26 smithi136 ceph-mon[125702]: pgmap v5311: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:43:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:28 smithi057 ceph-mon[92072]: pgmap v5312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:43:28.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:28 smithi122 ceph-mon[125440]: pgmap v5312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:43:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:28 smithi136 ceph-mon[125702]: pgmap v5312: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:43:30.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:30 smithi122 ceph-mon[125440]: pgmap v5313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:30 smithi136 ceph-mon[125702]: pgmap v5313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:30 smithi057 ceph-mon[92072]: pgmap v5313: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:32.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:32 smithi122 ceph-mon[125440]: pgmap v5314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:32 smithi136 ceph-mon[125702]: pgmap v5314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:32 smithi057 ceph-mon[92072]: pgmap v5314: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:34.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:34 smithi122 ceph-mon[125440]: pgmap v5315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:34 smithi136 ceph-mon[125702]: pgmap v5315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:34 smithi057 ceph-mon[92072]: pgmap v5315: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:36 smithi122 ceph-mon[125440]: pgmap v5316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:36 smithi136 ceph-mon[125702]: pgmap v5316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:36 smithi057 ceph-mon[92072]: pgmap v5316: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:38 smithi136 ceph-mon[125702]: pgmap v5317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:38 smithi057 ceph-mon[92072]: pgmap v5317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:38 smithi122 ceph-mon[125440]: pgmap v5317: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:40 smithi136 ceph-mon[125702]: pgmap v5318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:40 smithi057 ceph-mon[92072]: pgmap v5318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:41.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:40 smithi122 ceph-mon[125440]: pgmap v5318: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:41.613 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:41.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:43:41.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:41.613+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:43:41.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:41.613+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:43:41.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:41.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:43:41.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:41.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:43:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:42 smithi136 ceph-mon[125702]: pgmap v5319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:42 smithi057 ceph-mon[92072]: pgmap v5319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:42 smithi122 ceph-mon[125440]: pgmap v5319: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:44 smithi136 ceph-mon[125702]: pgmap v5320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:44 smithi057 ceph-mon[92072]: pgmap v5320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:44 smithi122 ceph-mon[125440]: pgmap v5320: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:46 smithi136 ceph-mon[125702]: pgmap v5321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:46 smithi057 ceph-mon[92072]: pgmap v5321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:46 smithi122 ceph-mon[125440]: pgmap v5321: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:48 smithi136 ceph-mon[125702]: pgmap v5322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:48 smithi057 ceph-mon[92072]: pgmap v5322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:48 smithi122 ceph-mon[125440]: pgmap v5322: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:50 smithi136 ceph-mon[125702]: pgmap v5323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:50 smithi057 ceph-mon[92072]: pgmap v5323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:51.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:50 smithi122 ceph-mon[125440]: pgmap v5323: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:52 smithi136 ceph-mon[125702]: pgmap v5324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:52 smithi057 ceph-mon[92072]: pgmap v5324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:53.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:52 smithi122 ceph-mon[125440]: pgmap v5324: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:54 smithi136 ceph-mon[125702]: pgmap v5325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:54 smithi057 ceph-mon[92072]: pgmap v5325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:55.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:54 smithi122 ceph-mon[125440]: pgmap v5325: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:56.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:56.622+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:43:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:56.622+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:43:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:56.622+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:43:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:56.622+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:43:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:43:56.622+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:43:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:56 smithi136 ceph-mon[125702]: pgmap v5326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:56 smithi057 ceph-mon[92072]: pgmap v5326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:57.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:56 smithi122 ceph-mon[125440]: pgmap v5326: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:43:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:43:58 smithi136 ceph-mon[125702]: pgmap v5327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:43:58 smithi057 ceph-mon[92072]: pgmap v5327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:43:59.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:43:58 smithi122 ceph-mon[125440]: pgmap v5327: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:00 smithi136 ceph-mon[125702]: pgmap v5328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:00 smithi057 ceph-mon[92072]: pgmap v5328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:01.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:00 smithi122 ceph-mon[125440]: pgmap v5328: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:02 smithi136 ceph-mon[125702]: pgmap v5329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:02 smithi057 ceph-mon[92072]: pgmap v5329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:02 smithi122 ceph-mon[125440]: pgmap v5329: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:04 smithi136 ceph-mon[125702]: pgmap v5330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:44:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:04 smithi057 ceph-mon[92072]: pgmap v5330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:44:05.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:04 smithi122 ceph-mon[125440]: pgmap v5330: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:44:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:06 smithi136 ceph-mon[125702]: pgmap v5331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:44:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:06 smithi057 ceph-mon[92072]: pgmap v5331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:44:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:06 smithi122 ceph-mon[125440]: pgmap v5331: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:44:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:08.389+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T13:44:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:08.389+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T13:44:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:08.389+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f587004a0b0 tx=0x7f5870096000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:44:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:08.389+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f587004a0b0 tx=0x7f5870096000 comp rx=0 tx=0).stop 2023-03-02T13:44:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:08.389+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T13:44:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:08.389+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 msgr2=0x7f586809be20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T13:44:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:08.389+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809b500 0x7f586809be20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T13:44:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:08.389+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T13:44:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:08.389+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:44:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:08.390+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5870030000 tx=0x7f58700ab050 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T13:44:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:08 smithi136 ceph-mon[125702]: pgmap v5332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:44:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:08 smithi057 ceph-mon[92072]: pgmap v5332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:44:09.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:08 smithi122 ceph-mon[125440]: pgmap v5332: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:44:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:09.780+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:44:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:09.780+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:44:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:09.780+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 80 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T13:44:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:09.780+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 79 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T13:44:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:09.780+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:44:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:09.780+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:44:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:09.780+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 81 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:44:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:09.780+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 80 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:44:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:10 smithi136 ceph-mon[125702]: pgmap v5333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:44:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:10 smithi057 ceph-mon[92072]: pgmap v5333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:44:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:10 smithi122 ceph-mon[125440]: pgmap v5333: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:44:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:11.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:44:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:11.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:44:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:11.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:44:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:11.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:44:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:11.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:44:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:11 smithi136 ceph-mon[125702]: osdmap e405: 12 total, 12 up, 12 in 2023-03-02T13:44:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:11 smithi057 ceph-mon[92072]: osdmap e405: 12 total, 12 up, 12 in 2023-03-02T13:44:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:11 smithi122 ceph-mon[125440]: osdmap e405: 12 total, 12 up, 12 in 2023-03-02T13:44:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:12 smithi136 ceph-mon[125702]: pgmap v5335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:44:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:12 smithi057 ceph-mon[92072]: pgmap v5335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:44:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:12 smithi122 ceph-mon[125440]: pgmap v5335: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:44:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:14 smithi136 ceph-mon[125702]: pgmap v5336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:44:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:14 smithi057 ceph-mon[92072]: pgmap v5336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:44:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:14 smithi122 ceph-mon[125440]: pgmap v5336: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:44:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:16 smithi136 ceph-mon[125702]: pgmap v5337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:44:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:16 smithi136 ceph-mon[125702]: osdmap e406: 12 total, 12 up, 12 in 2023-03-02T13:44:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:44:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:16 smithi057 ceph-mon[92072]: pgmap v5337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:44:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:16 smithi057 ceph-mon[92072]: osdmap e406: 12 total, 12 up, 12 in 2023-03-02T13:44:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:44:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:16 smithi122 ceph-mon[125440]: pgmap v5337: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:44:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:16 smithi122 ceph-mon[125440]: osdmap e406: 12 total, 12 up, 12 in 2023-03-02T13:44:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:44:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:44:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:44:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:18 smithi136 ceph-mon[125702]: pgmap v5339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:44:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:44:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:44:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:44:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:44:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:44:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:18 smithi057 ceph-mon[92072]: pgmap v5339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:44:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:44:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:44:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:44:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:44:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:44:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:18 smithi122 ceph-mon[125440]: pgmap v5339: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:44:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:44:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:44:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:44:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:20 smithi136 ceph-mon[125702]: pgmap v5340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T13:44:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:20 smithi057 ceph-mon[92072]: pgmap v5340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T13:44:20.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:20 smithi122 ceph-mon[125440]: pgmap v5340: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T13:44:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:22 smithi057 ceph-mon[92072]: pgmap v5341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:44:22.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:22 smithi122 ceph-mon[125440]: pgmap v5341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:44:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:22 smithi136 ceph-mon[125702]: pgmap v5341: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:44:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:24 smithi057 ceph-mon[92072]: pgmap v5342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:44:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:24 smithi122 ceph-mon[125440]: pgmap v5342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:44:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:24 smithi136 ceph-mon[125702]: pgmap v5342: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:44:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:26.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:44:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:26.652+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:44:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:26.652+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:44:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:26.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:44:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:26.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:44:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:26 smithi057 ceph-mon[92072]: pgmap v5343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:44:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:26 smithi122 ceph-mon[125440]: pgmap v5343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:44:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:26 smithi136 ceph-mon[125702]: pgmap v5343: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:44:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:28 smithi057 ceph-mon[92072]: pgmap v5344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:44:28.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:28 smithi122 ceph-mon[125440]: pgmap v5344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:44:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:28 smithi136 ceph-mon[125702]: pgmap v5344: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:44:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:30 smithi057 ceph-mon[92072]: pgmap v5345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:44:30.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:30 smithi122 ceph-mon[125440]: pgmap v5345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:44:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:30 smithi136 ceph-mon[125702]: pgmap v5345: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:44:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:32 smithi057 ceph-mon[92072]: pgmap v5346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:44:32.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:32 smithi122 ceph-mon[125440]: pgmap v5346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:44:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:32 smithi136 ceph-mon[125702]: pgmap v5346: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:44:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:34 smithi057 ceph-mon[92072]: pgmap v5347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:34.966 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:34 smithi122 ceph-mon[125440]: pgmap v5347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:34 smithi136 ceph-mon[125702]: pgmap v5347: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:36 smithi057 ceph-mon[92072]: pgmap v5348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:36 smithi122 ceph-mon[125440]: pgmap v5348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:36 smithi136 ceph-mon[125702]: pgmap v5348: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:38 smithi057 ceph-mon[92072]: pgmap v5349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:38 smithi122 ceph-mon[125440]: pgmap v5349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:38 smithi136 ceph-mon[125702]: pgmap v5349: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:40 smithi057 ceph-mon[92072]: pgmap v5350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:40 smithi122 ceph-mon[125440]: pgmap v5350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:40 smithi136 ceph-mon[125702]: pgmap v5350: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:41.658+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:44:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:41.658+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:44:41.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:41.658+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:44:41.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:41.658+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:44:41.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:41.658+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:44:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:42 smithi057 ceph-mon[92072]: pgmap v5351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:42 smithi122 ceph-mon[125440]: pgmap v5351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:42 smithi136 ceph-mon[125702]: pgmap v5351: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:44 smithi057 ceph-mon[92072]: pgmap v5352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:44.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:44 smithi122 ceph-mon[125440]: pgmap v5352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:44 smithi136 ceph-mon[125702]: pgmap v5352: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:46 smithi057 ceph-mon[92072]: pgmap v5353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:46 smithi122 ceph-mon[125440]: pgmap v5353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:46 smithi136 ceph-mon[125702]: pgmap v5353: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:48 smithi057 ceph-mon[92072]: pgmap v5354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:48.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:48 smithi122 ceph-mon[125440]: pgmap v5354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:48 smithi136 ceph-mon[125702]: pgmap v5354: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:50 smithi057 ceph-mon[92072]: pgmap v5355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:50 smithi122 ceph-mon[125440]: pgmap v5355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:50 smithi136 ceph-mon[125702]: pgmap v5355: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:52 smithi057 ceph-mon[92072]: pgmap v5356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:52 smithi122 ceph-mon[125440]: pgmap v5356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:52 smithi136 ceph-mon[125702]: pgmap v5356: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:54 smithi057 ceph-mon[92072]: pgmap v5357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:54.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:54 smithi122 ceph-mon[125440]: pgmap v5357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:54 smithi136 ceph-mon[125702]: pgmap v5357: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:56.673+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:44:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:56.674+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:44:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:56.674+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:44:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:56.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:44:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:44:56.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:44:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:56 smithi057 ceph-mon[92072]: pgmap v5358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:56 smithi122 ceph-mon[125440]: pgmap v5358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:56 smithi136 ceph-mon[125702]: pgmap v5358: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:44:58.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:44:58 smithi122 ceph-mon[125440]: pgmap v5359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:44:58 smithi136 ceph-mon[125702]: pgmap v5359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:44:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:44:58 smithi057 ceph-mon[92072]: pgmap v5359: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:00.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:00 smithi122 ceph-mon[125440]: pgmap v5360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:00 smithi136 ceph-mon[125702]: pgmap v5360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:00 smithi057 ceph-mon[92072]: pgmap v5360: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:02 smithi122 ceph-mon[125440]: pgmap v5361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:02 smithi136 ceph-mon[125702]: pgmap v5361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:02 smithi057 ceph-mon[92072]: pgmap v5361: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:04 smithi122 ceph-mon[125440]: pgmap v5362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:45:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:04 smithi136 ceph-mon[125702]: pgmap v5362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:45:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:04 smithi057 ceph-mon[92072]: pgmap v5362: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:45:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:06 smithi136 ceph-mon[125702]: pgmap v5363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:45:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:06 smithi057 ceph-mon[92072]: pgmap v5363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:45:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:06 smithi122 ceph-mon[125440]: pgmap v5363: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:45:09.098 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:08 smithi136 ceph-mon[125702]: pgmap v5364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:45:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:08 smithi057 ceph-mon[92072]: pgmap v5364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:45:09.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:08 smithi122 ceph-mon[125440]: pgmap v5364: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:45:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:10 smithi136 ceph-mon[125702]: pgmap v5365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:45:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:10 smithi057 ceph-mon[92072]: pgmap v5365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:45:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:10 smithi122 ceph-mon[125440]: pgmap v5365: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:45:11.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:11.689+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:45:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:11.689+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:45:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:11.689+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:45:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:11.689+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:45:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:11.689+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:45:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:11 smithi136 ceph-mon[125702]: osdmap e407: 12 total, 12 up, 12 in 2023-03-02T13:45:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:11 smithi057 ceph-mon[92072]: osdmap e407: 12 total, 12 up, 12 in 2023-03-02T13:45:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:11 smithi122 ceph-mon[125440]: osdmap e407: 12 total, 12 up, 12 in 2023-03-02T13:45:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:12 smithi136 ceph-mon[125702]: pgmap v5367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:45:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:12 smithi057 ceph-mon[92072]: pgmap v5367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:45:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:12 smithi122 ceph-mon[125440]: pgmap v5367: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:45:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:14 smithi136 ceph-mon[125702]: pgmap v5368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:45:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:14 smithi057 ceph-mon[92072]: pgmap v5368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:45:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:14 smithi122 ceph-mon[125440]: pgmap v5368: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:45:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:16 smithi136 ceph-mon[125702]: pgmap v5369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:45:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:16 smithi136 ceph-mon[125702]: osdmap e408: 12 total, 12 up, 12 in 2023-03-02T13:45:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:16 smithi057 ceph-mon[92072]: pgmap v5369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:45:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:16 smithi057 ceph-mon[92072]: osdmap e408: 12 total, 12 up, 12 in 2023-03-02T13:45:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:16 smithi122 ceph-mon[125440]: pgmap v5369: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:45:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:16 smithi122 ceph-mon[125440]: osdmap e408: 12 total, 12 up, 12 in 2023-03-02T13:45:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:18 smithi136 ceph-mon[125702]: pgmap v5371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:45:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:45:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:18 smithi057 ceph-mon[92072]: pgmap v5371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:45:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:45:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:18 smithi122 ceph-mon[125440]: pgmap v5371: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:45:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:45:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:21 smithi122 ceph-mon[125440]: pgmap v5372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T13:45:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:45:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:45:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:21 smithi136 ceph-mon[125702]: pgmap v5372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T13:45:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:45:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:45:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:21 smithi057 ceph-mon[92072]: pgmap v5372: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T13:45:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:45:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:45:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:45:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:22 smithi057 ceph-mon[92072]: pgmap v5373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:45:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:22 smithi122 ceph-mon[125440]: pgmap v5373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:45:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:22 smithi136 ceph-mon[125702]: pgmap v5373: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:45:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:24 smithi057 ceph-mon[92072]: pgmap v5374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:45:24.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:24 smithi122 ceph-mon[125440]: pgmap v5374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:45:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:24 smithi136 ceph-mon[125702]: pgmap v5374: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:45:26.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:26.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:45:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:26.695+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:45:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:26.695+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:45:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:26.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:45:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:26.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:45:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:26 smithi057 ceph-mon[92072]: pgmap v5375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:45:26.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:26 smithi122 ceph-mon[125440]: pgmap v5375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:45:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:26 smithi136 ceph-mon[125702]: pgmap v5375: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:45:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:28 smithi057 ceph-mon[92072]: pgmap v5376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:45:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:28 smithi122 ceph-mon[125440]: pgmap v5376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:45:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:28 smithi136 ceph-mon[125702]: pgmap v5376: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-02T13:45:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:30 smithi057 ceph-mon[92072]: pgmap v5377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:30.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:30 smithi122 ceph-mon[125440]: pgmap v5377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:30 smithi136 ceph-mon[125702]: pgmap v5377: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:32 smithi057 ceph-mon[92072]: pgmap v5378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:32 smithi122 ceph-mon[125440]: pgmap v5378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:32 smithi136 ceph-mon[125702]: pgmap v5378: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:34 smithi057 ceph-mon[92072]: pgmap v5379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:34 smithi122 ceph-mon[125440]: pgmap v5379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:34 smithi136 ceph-mon[125702]: pgmap v5379: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:36 smithi057 ceph-mon[92072]: pgmap v5380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:36.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:36 smithi122 ceph-mon[125440]: pgmap v5380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:36 smithi136 ceph-mon[125702]: pgmap v5380: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:38 smithi057 ceph-mon[92072]: pgmap v5381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:38.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:38 smithi122 ceph-mon[125440]: pgmap v5381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:38 smithi136 ceph-mon[125702]: pgmap v5381: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:40 smithi057 ceph-mon[92072]: pgmap v5382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:40 smithi122 ceph-mon[125440]: pgmap v5382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:40 smithi136 ceph-mon[125702]: pgmap v5382: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:41.703+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:45:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:41.703+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:45:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:41.703+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:45:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:41.703+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:45:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:41.703+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:45:42.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:42 smithi122 ceph-mon[125440]: pgmap v5383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:42 smithi136 ceph-mon[125702]: pgmap v5383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:42 smithi057 ceph-mon[92072]: pgmap v5383: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:44.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:44 smithi122 ceph-mon[125440]: pgmap v5384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:44 smithi136 ceph-mon[125702]: pgmap v5384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:44 smithi057 ceph-mon[92072]: pgmap v5384: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:46 smithi122 ceph-mon[125440]: pgmap v5385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:46 smithi136 ceph-mon[125702]: pgmap v5385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:46 smithi057 ceph-mon[92072]: pgmap v5385: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:48.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:48 smithi122 ceph-mon[125440]: pgmap v5386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:48 smithi136 ceph-mon[125702]: pgmap v5386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:48 smithi057 ceph-mon[92072]: pgmap v5386: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:50 smithi122 ceph-mon[125440]: pgmap v5387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:51.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:50 smithi136 ceph-mon[125702]: pgmap v5387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:50 smithi057 ceph-mon[92072]: pgmap v5387: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:52 smithi136 ceph-mon[125702]: pgmap v5388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:52 smithi057 ceph-mon[92072]: pgmap v5388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:52 smithi122 ceph-mon[125440]: pgmap v5388: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:54 smithi136 ceph-mon[125702]: pgmap v5389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:54 smithi057 ceph-mon[92072]: pgmap v5389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:55.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:54 smithi122 ceph-mon[125440]: pgmap v5389: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:56.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:56.708+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:45:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:56.709+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:45:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:56.709+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:45:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:56.709+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:45:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:45:56.709+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:45:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:56 smithi136 ceph-mon[125702]: pgmap v5390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:57.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:56 smithi057 ceph-mon[92072]: pgmap v5390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:57.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:56 smithi122 ceph-mon[125440]: pgmap v5390: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:45:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:45:58 smithi136 ceph-mon[125702]: pgmap v5391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:45:58 smithi057 ceph-mon[92072]: pgmap v5391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:45:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:45:58 smithi122 ceph-mon[125440]: pgmap v5391: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:00 smithi136 ceph-mon[125702]: pgmap v5392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:00 smithi057 ceph-mon[92072]: pgmap v5392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:01.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:00 smithi122 ceph-mon[125440]: pgmap v5392: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:02 smithi136 ceph-mon[125702]: pgmap v5393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:02 smithi057 ceph-mon[92072]: pgmap v5393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:02 smithi122 ceph-mon[125440]: pgmap v5393: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:04 smithi136 ceph-mon[125702]: pgmap v5394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:46:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:04 smithi057 ceph-mon[92072]: pgmap v5394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:46:05.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:04 smithi122 ceph-mon[125440]: pgmap v5394: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:46:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:06 smithi136 ceph-mon[125702]: pgmap v5395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:46:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:06 smithi057 ceph-mon[92072]: pgmap v5395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:46:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:06 smithi122 ceph-mon[125440]: pgmap v5395: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:46:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:08 smithi136 ceph-mon[125702]: pgmap v5396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:46:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:08 smithi057 ceph-mon[92072]: pgmap v5396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:46:09.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:08 smithi122 ceph-mon[125440]: pgmap v5396: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:46:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:10 smithi136 ceph-mon[125702]: pgmap v5397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:46:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:10 smithi057 ceph-mon[92072]: pgmap v5397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:46:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:10 smithi122 ceph-mon[125440]: pgmap v5397: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:46:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:11.724+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:46:11.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:11.724+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:46:11.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:11.724+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:46:11.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:11.724+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:46:11.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:11.724+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:46:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:11 smithi136 ceph-mon[125702]: osdmap e409: 12 total, 12 up, 12 in 2023-03-02T13:46:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:11 smithi057 ceph-mon[92072]: osdmap e409: 12 total, 12 up, 12 in 2023-03-02T13:46:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:11 smithi122 ceph-mon[125440]: osdmap e409: 12 total, 12 up, 12 in 2023-03-02T13:46:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:12 smithi136 ceph-mon[125702]: pgmap v5399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:46:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:12 smithi057 ceph-mon[92072]: pgmap v5399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:46:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:12 smithi122 ceph-mon[125440]: pgmap v5399: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:46:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:14 smithi136 ceph-mon[125702]: pgmap v5400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:46:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:14 smithi057 ceph-mon[92072]: pgmap v5400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:46:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:14 smithi122 ceph-mon[125440]: pgmap v5400: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:46:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:16 smithi136 ceph-mon[125702]: pgmap v5401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:46:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:16 smithi136 ceph-mon[125702]: osdmap e410: 12 total, 12 up, 12 in 2023-03-02T13:46:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:16 smithi057 ceph-mon[92072]: pgmap v5401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:46:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:16 smithi057 ceph-mon[92072]: osdmap e410: 12 total, 12 up, 12 in 2023-03-02T13:46:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:16 smithi122 ceph-mon[125440]: pgmap v5401: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:46:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:16 smithi122 ceph-mon[125440]: osdmap e410: 12 total, 12 up, 12 in 2023-03-02T13:46:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:18 smithi136 ceph-mon[125702]: pgmap v5403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:46:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:18 smithi057 ceph-mon[92072]: pgmap v5403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:46:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:18 smithi122 ceph-mon[125440]: pgmap v5403: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:46:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:20 smithi136 ceph-mon[125702]: pgmap v5404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T13:46:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:46:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:20 smithi057 ceph-mon[92072]: pgmap v5404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T13:46:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:46:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:20 smithi122 ceph-mon[125440]: pgmap v5404: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T13:46:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:46:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:46:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:46:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:46:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:46:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:46:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:46:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:46:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:46:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:46:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:23 smithi057 ceph-mon[92072]: pgmap v5405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:46:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:23 smithi122 ceph-mon[125440]: pgmap v5405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:46:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:23 smithi136 ceph-mon[125702]: pgmap v5405: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:46:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:25 smithi057 ceph-mon[92072]: pgmap v5406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:46:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:25 smithi122 ceph-mon[125440]: pgmap v5406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:46:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:25 smithi136 ceph-mon[125702]: pgmap v5406: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:46:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:26.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:46:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:26.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:46:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:26.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:46:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:26.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:46:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:26.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:46:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:27 smithi057 ceph-mon[92072]: pgmap v5407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:46:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:27 smithi122 ceph-mon[125440]: pgmap v5407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:46:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:27 smithi136 ceph-mon[125702]: pgmap v5407: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:46:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:29 smithi057 ceph-mon[92072]: pgmap v5408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-03-02T13:46:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:29 smithi122 ceph-mon[125440]: pgmap v5408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-03-02T13:46:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:29 smithi136 ceph-mon[125702]: pgmap v5408: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-03-02T13:46:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:31 smithi122 ceph-mon[125440]: pgmap v5409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:31 smithi136 ceph-mon[125702]: pgmap v5409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:31 smithi057 ceph-mon[92072]: pgmap v5409: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:33 smithi122 ceph-mon[125440]: pgmap v5410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:33 smithi136 ceph-mon[125702]: pgmap v5410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:33 smithi057 ceph-mon[92072]: pgmap v5410: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:35 smithi122 ceph-mon[125440]: pgmap v5411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:35 smithi136 ceph-mon[125702]: pgmap v5411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:35 smithi057 ceph-mon[92072]: pgmap v5411: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:37 smithi136 ceph-mon[125702]: pgmap v5412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:37 smithi057 ceph-mon[92072]: pgmap v5412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:37 smithi122 ceph-mon[125440]: pgmap v5412: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:39 smithi136 ceph-mon[125702]: pgmap v5413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T13:46:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:39 smithi057 ceph-mon[92072]: pgmap v5413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T13:46:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:39 smithi122 ceph-mon[125440]: pgmap v5413: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T13:46:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:41 smithi136 ceph-mon[125702]: pgmap v5414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:41 smithi057 ceph-mon[92072]: pgmap v5414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:41 smithi122 ceph-mon[125440]: pgmap v5414: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:41.738+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:46:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:41.739+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:46:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:41.739+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:46:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:41.739+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:46:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:41.739+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:46:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:42 smithi057 ceph-mon[92072]: pgmap v5415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:42 smithi122 ceph-mon[125440]: pgmap v5415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:42 smithi136 ceph-mon[125702]: pgmap v5415: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:44 smithi057 ceph-mon[92072]: pgmap v5416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:44.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:44 smithi122 ceph-mon[125440]: pgmap v5416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:44 smithi136 ceph-mon[125702]: pgmap v5416: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:46 smithi057 ceph-mon[92072]: pgmap v5417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:46.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:46 smithi122 ceph-mon[125440]: pgmap v5417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:46 smithi136 ceph-mon[125702]: pgmap v5417: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T13:46:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:48 smithi057 ceph-mon[92072]: pgmap v5418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:48.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:48 smithi122 ceph-mon[125440]: pgmap v5418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:48 smithi136 ceph-mon[125702]: pgmap v5418: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:50.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:50 smithi122 ceph-mon[125440]: pgmap v5419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:50 smithi136 ceph-mon[125702]: pgmap v5419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:50 smithi057 ceph-mon[92072]: pgmap v5419: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:52.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:52 smithi122 ceph-mon[125440]: pgmap v5420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:52 smithi136 ceph-mon[125702]: pgmap v5420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:52 smithi057 ceph-mon[92072]: pgmap v5420: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:54.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:54 smithi122 ceph-mon[125440]: pgmap v5421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:54 smithi136 ceph-mon[125702]: pgmap v5421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:54 smithi057 ceph-mon[92072]: pgmap v5421: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:56.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:46:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:56.755+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:46:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:56.755+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:46:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:56.755+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:46:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:46:56.755+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:46:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:56 smithi122 ceph-mon[125440]: pgmap v5422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:56 smithi136 ceph-mon[125702]: pgmap v5422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:56 smithi057 ceph-mon[92072]: pgmap v5422: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:46:58.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:46:58 smithi122 ceph-mon[125440]: pgmap v5423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:46:58 smithi136 ceph-mon[125702]: pgmap v5423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:46:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:46:58 smithi057 ceph-mon[92072]: pgmap v5423: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:00 smithi136 ceph-mon[125702]: pgmap v5424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:00 smithi057 ceph-mon[92072]: pgmap v5424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:00 smithi122 ceph-mon[125440]: pgmap v5424: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:02 smithi136 ceph-mon[125702]: pgmap v5425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:02 smithi057 ceph-mon[92072]: pgmap v5425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:02 smithi122 ceph-mon[125440]: pgmap v5425: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:04 smithi136 ceph-mon[125702]: pgmap v5426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:47:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:04 smithi057 ceph-mon[92072]: pgmap v5426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:47:05.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:04 smithi122 ceph-mon[125440]: pgmap v5426: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:47:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:06 smithi136 ceph-mon[125702]: pgmap v5427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:47:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:06 smithi057 ceph-mon[92072]: pgmap v5427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:47:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:06 smithi122 ceph-mon[125440]: pgmap v5427: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:47:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:08 smithi136 ceph-mon[125702]: pgmap v5428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:47:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:08 smithi057 ceph-mon[92072]: pgmap v5428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:47:09.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:08 smithi122 ceph-mon[125440]: pgmap v5428: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:47:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:09.806+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:47:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:09.806+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:47:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:09.806+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 82 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:47:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:09.806+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 81 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:47:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:10 smithi136 ceph-mon[125702]: pgmap v5429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:47:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:10 smithi057 ceph-mon[92072]: pgmap v5429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:47:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:10 smithi122 ceph-mon[125440]: pgmap v5429: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:47:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:11.759+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:47:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:11.759+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:47:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:11.759+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:47:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:11.759+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:47:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:11.759+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:47:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:11 smithi136 ceph-mon[125702]: osdmap e411: 12 total, 12 up, 12 in 2023-03-02T13:47:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:11 smithi057 ceph-mon[92072]: osdmap e411: 12 total, 12 up, 12 in 2023-03-02T13:47:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:11 smithi122 ceph-mon[125440]: osdmap e411: 12 total, 12 up, 12 in 2023-03-02T13:47:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:12 smithi136 ceph-mon[125702]: pgmap v5431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:47:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:12 smithi057 ceph-mon[92072]: pgmap v5431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:47:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:12 smithi122 ceph-mon[125440]: pgmap v5431: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:47:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:14 smithi136 ceph-mon[125702]: pgmap v5432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:47:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:14 smithi057 ceph-mon[92072]: pgmap v5432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:47:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:14 smithi122 ceph-mon[125440]: pgmap v5432: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:47:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:16 smithi136 ceph-mon[125702]: pgmap v5433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:47:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:16 smithi136 ceph-mon[125702]: osdmap e412: 12 total, 12 up, 12 in 2023-03-02T13:47:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:16 smithi057 ceph-mon[92072]: pgmap v5433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:47:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:16 smithi057 ceph-mon[92072]: osdmap e412: 12 total, 12 up, 12 in 2023-03-02T13:47:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:16 smithi122 ceph-mon[125440]: pgmap v5433: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:47:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:16 smithi122 ceph-mon[125440]: osdmap e412: 12 total, 12 up, 12 in 2023-03-02T13:47:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:18 smithi136 ceph-mon[125702]: pgmap v5435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:47:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:18 smithi057 ceph-mon[92072]: pgmap v5435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:47:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:18 smithi122 ceph-mon[125440]: pgmap v5435: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:47:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:20 smithi136 ceph-mon[125702]: pgmap v5436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T13:47:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:20 smithi057 ceph-mon[92072]: pgmap v5436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T13:47:21.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:20 smithi122 ceph-mon[125440]: pgmap v5436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T13:47:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:47:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:47:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:47:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:22 smithi136 ceph-mon[125702]: pgmap v5437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:47:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:47:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:47:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:47:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:22 smithi057 ceph-mon[92072]: pgmap v5437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:47:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:47:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:47:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:47:23.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:22 smithi122 ceph-mon[125440]: pgmap v5437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:47:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:47:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:47:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:47:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:24 smithi136 ceph-mon[125702]: pgmap v5438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:47:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:24 smithi057 ceph-mon[92072]: pgmap v5438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:47:25.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:24 smithi122 ceph-mon[125440]: pgmap v5438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:47:26.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:26.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:47:26.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:26.774+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:47:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:26.774+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:47:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:26.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:47:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:26.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:47:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:26 smithi136 ceph-mon[125702]: pgmap v5439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:47:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:26 smithi057 ceph-mon[92072]: pgmap v5439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:47:27.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:26 smithi122 ceph-mon[125440]: pgmap v5439: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:47:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:28 smithi136 ceph-mon[125702]: pgmap v5440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:47:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:28 smithi057 ceph-mon[92072]: pgmap v5440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:47:29.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:28 smithi122 ceph-mon[125440]: pgmap v5440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:47:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:30 smithi136 ceph-mon[125702]: pgmap v5441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:30 smithi057 ceph-mon[92072]: pgmap v5441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:30 smithi122 ceph-mon[125440]: pgmap v5441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:32 smithi136 ceph-mon[125702]: pgmap v5442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:32 smithi057 ceph-mon[92072]: pgmap v5442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:33.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:32 smithi122 ceph-mon[125440]: pgmap v5442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:34 smithi136 ceph-mon[125702]: pgmap v5443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:34 smithi057 ceph-mon[92072]: pgmap v5443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:35.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:34 smithi122 ceph-mon[125440]: pgmap v5443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:36 smithi136 ceph-mon[125702]: pgmap v5444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:36 smithi057 ceph-mon[92072]: pgmap v5444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:37.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:36 smithi122 ceph-mon[125440]: pgmap v5444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:38 smithi136 ceph-mon[125702]: pgmap v5445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:38 smithi057 ceph-mon[92072]: pgmap v5445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:39.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:38 smithi122 ceph-mon[125440]: pgmap v5445: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:40 smithi136 ceph-mon[125702]: pgmap v5446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:40 smithi057 ceph-mon[92072]: pgmap v5446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:40 smithi122 ceph-mon[125440]: pgmap v5446: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:41.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:47:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:41.785+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:47:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:41.785+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:47:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:41.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:47:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:41.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:47:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:42 smithi136 ceph-mon[125702]: pgmap v5447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:42 smithi057 ceph-mon[92072]: pgmap v5447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:42 smithi122 ceph-mon[125440]: pgmap v5447: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:44 smithi136 ceph-mon[125702]: pgmap v5448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:44 smithi057 ceph-mon[92072]: pgmap v5448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:45.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:44 smithi122 ceph-mon[125440]: pgmap v5448: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:46 smithi136 ceph-mon[125702]: pgmap v5449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:46 smithi057 ceph-mon[92072]: pgmap v5449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:47.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:46 smithi122 ceph-mon[125440]: pgmap v5449: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:48 smithi136 ceph-mon[125702]: pgmap v5450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:48 smithi057 ceph-mon[92072]: pgmap v5450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:49.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:48 smithi122 ceph-mon[125440]: pgmap v5450: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:50 smithi057 ceph-mon[92072]: pgmap v5451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:51.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:50 smithi122 ceph-mon[125440]: pgmap v5451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:50 smithi136 ceph-mon[125702]: pgmap v5451: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:52 smithi057 ceph-mon[92072]: pgmap v5452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:52 smithi122 ceph-mon[125440]: pgmap v5452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:52 smithi136 ceph-mon[125702]: pgmap v5452: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:54 smithi057 ceph-mon[92072]: pgmap v5453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:55.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:54 smithi122 ceph-mon[125440]: pgmap v5453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:54 smithi136 ceph-mon[125702]: pgmap v5453: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:56.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:56.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:47:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:56.801+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:47:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:56.801+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:47:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:56.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:47:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:47:56.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:47:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:56 smithi057 ceph-mon[92072]: pgmap v5454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:57.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:56 smithi122 ceph-mon[125440]: pgmap v5454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:56 smithi136 ceph-mon[125702]: pgmap v5454: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:47:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:47:58 smithi057 ceph-mon[92072]: pgmap v5455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:59.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:47:58 smithi122 ceph-mon[125440]: pgmap v5455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:47:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:47:58 smithi136 ceph-mon[125702]: pgmap v5455: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:00 smithi057 ceph-mon[92072]: pgmap v5456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:00 smithi122 ceph-mon[125440]: pgmap v5456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:00 smithi136 ceph-mon[125702]: pgmap v5456: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:02 smithi057 ceph-mon[92072]: pgmap v5457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:02 smithi122 ceph-mon[125440]: pgmap v5457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:02 smithi136 ceph-mon[125702]: pgmap v5457: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:04 smithi057 ceph-mon[92072]: pgmap v5458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:48:05.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:04 smithi122 ceph-mon[125440]: pgmap v5458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:48:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:04 smithi136 ceph-mon[125702]: pgmap v5458: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:48:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:06 smithi057 ceph-mon[92072]: pgmap v5459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:48:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:06 smithi057 ceph-mon[92072]: osdmap e413: 12 total, 12 up, 12 in 2023-03-02T13:48:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:06 smithi122 ceph-mon[125440]: pgmap v5459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:48:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:06 smithi122 ceph-mon[125440]: osdmap e413: 12 total, 12 up, 12 in 2023-03-02T13:48:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:06 smithi136 ceph-mon[125702]: pgmap v5459: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:48:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:06 smithi136 ceph-mon[125702]: osdmap e413: 12 total, 12 up, 12 in 2023-03-02T13:48:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:08 smithi057 ceph-mon[92072]: pgmap v5461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:48:09.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:08 smithi122 ceph-mon[125440]: pgmap v5461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:48:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:08 smithi136 ceph-mon[125702]: pgmap v5461: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:48:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:10 smithi057 ceph-mon[92072]: pgmap v5462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:48:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:10 smithi122 ceph-mon[125440]: pgmap v5462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:48:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:10 smithi136 ceph-mon[125702]: pgmap v5462: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:48:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:11.816+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:48:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:11.816+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:48:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:11.816+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:48:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:11.816+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:48:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:11.816+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:48:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:12 smithi057 ceph-mon[92072]: pgmap v5463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:48:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:12 smithi122 ceph-mon[125440]: pgmap v5463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:48:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:12 smithi136 ceph-mon[125702]: pgmap v5463: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:48:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:14 smithi057 ceph-mon[92072]: pgmap v5464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:48:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:14 smithi122 ceph-mon[125440]: pgmap v5464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:48:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:14 smithi136 ceph-mon[125702]: pgmap v5464: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:48:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:16 smithi057 ceph-mon[92072]: pgmap v5465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:48:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:16 smithi057 ceph-mon[92072]: osdmap e414: 12 total, 12 up, 12 in 2023-03-02T13:48:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:16 smithi122 ceph-mon[125440]: pgmap v5465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:48:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:16 smithi122 ceph-mon[125440]: osdmap e414: 12 total, 12 up, 12 in 2023-03-02T13:48:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:16 smithi136 ceph-mon[125702]: pgmap v5465: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:48:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:16 smithi136 ceph-mon[125702]: osdmap e414: 12 total, 12 up, 12 in 2023-03-02T13:48:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:18 smithi057 ceph-mon[92072]: pgmap v5467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:48:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:18 smithi122 ceph-mon[125440]: pgmap v5467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:48:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:18 smithi136 ceph-mon[125702]: pgmap v5467: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:48:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:20 smithi057 ceph-mon[92072]: pgmap v5468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:48:21.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:20 smithi122 ceph-mon[125440]: pgmap v5468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:48:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:20 smithi136 ceph-mon[125702]: pgmap v5468: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:48:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:22 smithi057 ceph-mon[92072]: pgmap v5469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:48:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:48:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:48:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:48:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:48:23.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:22 smithi122 ceph-mon[125440]: pgmap v5469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:48:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:48:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:48:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:48:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:48:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:22 smithi136 ceph-mon[125702]: pgmap v5469: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:48:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:48:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:48:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:48:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:48:25.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:24 smithi122 ceph-mon[125440]: pgmap v5470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:48:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:24 smithi136 ceph-mon[125702]: pgmap v5470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:48:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:24 smithi057 ceph-mon[92072]: pgmap v5470: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:48:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:26.832+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:48:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:26.832+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:48:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:26.832+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:48:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:26.832+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:48:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:26.832+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:48:27.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:26 smithi122 ceph-mon[125440]: pgmap v5471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:48:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:26 smithi136 ceph-mon[125702]: pgmap v5471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:48:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:26 smithi057 ceph-mon[92072]: pgmap v5471: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:48:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:28 smithi136 ceph-mon[125702]: pgmap v5472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:48:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:28 smithi057 ceph-mon[92072]: pgmap v5472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:48:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:28 smithi122 ceph-mon[125440]: pgmap v5472: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:48:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:30 smithi136 ceph-mon[125702]: pgmap v5473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:30 smithi057 ceph-mon[92072]: pgmap v5473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:30 smithi122 ceph-mon[125440]: pgmap v5473: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:32 smithi136 ceph-mon[125702]: pgmap v5474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:32 smithi057 ceph-mon[92072]: pgmap v5474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:32 smithi122 ceph-mon[125440]: pgmap v5474: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:34 smithi136 ceph-mon[125702]: pgmap v5475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:34 smithi057 ceph-mon[92072]: pgmap v5475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:34 smithi122 ceph-mon[125440]: pgmap v5475: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:36 smithi136 ceph-mon[125702]: pgmap v5476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:36 smithi057 ceph-mon[92072]: pgmap v5476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:36 smithi122 ceph-mon[125440]: pgmap v5476: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:38 smithi136 ceph-mon[125702]: pgmap v5477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:38 smithi057 ceph-mon[92072]: pgmap v5477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:38 smithi122 ceph-mon[125440]: pgmap v5477: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:40 smithi136 ceph-mon[125702]: pgmap v5478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:40 smithi057 ceph-mon[92072]: pgmap v5478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:40 smithi122 ceph-mon[125440]: pgmap v5478: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:41.847+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:48:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:41.847+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:48:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:41.847+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:48:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:41.847+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:48:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:41.847+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:48:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:42 smithi136 ceph-mon[125702]: pgmap v5479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:42 smithi057 ceph-mon[92072]: pgmap v5479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:42 smithi122 ceph-mon[125440]: pgmap v5479: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:44 smithi136 ceph-mon[125702]: pgmap v5480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:44 smithi057 ceph-mon[92072]: pgmap v5480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:44 smithi122 ceph-mon[125440]: pgmap v5480: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:47 smithi136 ceph-mon[125702]: pgmap v5481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:47 smithi057 ceph-mon[92072]: pgmap v5481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:47 smithi122 ceph-mon[125440]: pgmap v5481: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:49 smithi136 ceph-mon[125702]: pgmap v5482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:49 smithi057 ceph-mon[92072]: pgmap v5482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:49 smithi122 ceph-mon[125440]: pgmap v5482: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:51 smithi136 ceph-mon[125702]: pgmap v5483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:51 smithi057 ceph-mon[92072]: pgmap v5483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:51 smithi122 ceph-mon[125440]: pgmap v5483: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:53 smithi136 ceph-mon[125702]: pgmap v5484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:53 smithi057 ceph-mon[92072]: pgmap v5484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:53 smithi122 ceph-mon[125440]: pgmap v5484: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:55 smithi136 ceph-mon[125702]: pgmap v5485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:55.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:55 smithi057 ceph-mon[92072]: pgmap v5485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:55.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:55 smithi122 ceph-mon[125440]: pgmap v5485: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:56.859+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:48:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:56.859+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:48:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:56.859+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:48:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:56.860+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:48:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:48:56.860+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:48:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:57 smithi136 ceph-mon[125702]: pgmap v5486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:57.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:57 smithi057 ceph-mon[92072]: pgmap v5486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:57 smithi122 ceph-mon[125440]: pgmap v5486: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:48:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:48:59 smithi136 ceph-mon[125702]: pgmap v5487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:48:59 smithi057 ceph-mon[92072]: pgmap v5487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:48:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:48:59 smithi122 ceph-mon[125440]: pgmap v5487: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:01 smithi136 ceph-mon[125702]: pgmap v5488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:01 smithi057 ceph-mon[92072]: pgmap v5488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:01 smithi122 ceph-mon[125440]: pgmap v5488: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:03 smithi136 ceph-mon[125702]: pgmap v5489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:03 smithi057 ceph-mon[92072]: pgmap v5489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:03 smithi122 ceph-mon[125440]: pgmap v5489: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:05 smithi136 ceph-mon[125702]: pgmap v5490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:49:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:05 smithi057 ceph-mon[92072]: pgmap v5490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:49:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:05 smithi122 ceph-mon[125440]: pgmap v5490: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:49:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:07 smithi136 ceph-mon[125702]: pgmap v5491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:49:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:07 smithi136 ceph-mon[125702]: osdmap e415: 12 total, 12 up, 12 in 2023-03-02T13:49:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:07 smithi057 ceph-mon[92072]: pgmap v5491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:49:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:07 smithi057 ceph-mon[92072]: osdmap e415: 12 total, 12 up, 12 in 2023-03-02T13:49:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:07 smithi122 ceph-mon[125440]: pgmap v5491: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:49:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:07 smithi122 ceph-mon[125440]: osdmap e415: 12 total, 12 up, 12 in 2023-03-02T13:49:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:09 smithi136 ceph-mon[125702]: pgmap v5493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:49:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:09 smithi057 ceph-mon[92072]: pgmap v5493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:49:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:09 smithi122 ceph-mon[125440]: pgmap v5493: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:49:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:11 smithi136 ceph-mon[125702]: pgmap v5494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:49:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:11 smithi057 ceph-mon[92072]: pgmap v5494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:49:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:11 smithi122 ceph-mon[125440]: pgmap v5494: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:49:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:11.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:49:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:11.875+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:49:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:11.875+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:49:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:11.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:49:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:11.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:49:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:13 smithi136 ceph-mon[125702]: pgmap v5495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:49:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:13 smithi057 ceph-mon[92072]: pgmap v5495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:49:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:13 smithi122 ceph-mon[125440]: pgmap v5495: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:49:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:15 smithi136 ceph-mon[125702]: pgmap v5496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:49:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:15 smithi057 ceph-mon[92072]: pgmap v5496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:49:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:15 smithi122 ceph-mon[125440]: pgmap v5496: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:49:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:17 smithi136 ceph-mon[125702]: pgmap v5497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:49:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:17 smithi136 ceph-mon[125702]: osdmap e416: 12 total, 12 up, 12 in 2023-03-02T13:49:17.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:17 smithi057 ceph-mon[92072]: pgmap v5497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:49:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:17 smithi057 ceph-mon[92072]: osdmap e416: 12 total, 12 up, 12 in 2023-03-02T13:49:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:17 smithi122 ceph-mon[125440]: pgmap v5497: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:49:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:17 smithi122 ceph-mon[125440]: osdmap e416: 12 total, 12 up, 12 in 2023-03-02T13:49:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:19 smithi136 ceph-mon[125702]: pgmap v5499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:49:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:19 smithi057 ceph-mon[92072]: pgmap v5499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:49:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:19 smithi122 ceph-mon[125440]: pgmap v5499: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:49:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:21 smithi136 ceph-mon[125702]: pgmap v5500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:49:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:21 smithi057 ceph-mon[92072]: pgmap v5500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:49:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:21 smithi122 ceph-mon[125440]: pgmap v5500: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:49:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:23 smithi057 ceph-mon[92072]: pgmap v5501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:49:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:49:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:23 smithi122 ceph-mon[125440]: pgmap v5501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:49:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:49:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:23 smithi136 ceph-mon[125702]: pgmap v5501: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:49:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:49:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:49:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:49:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:49:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:49:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:49:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:49:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:49:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:49:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:49:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:25 smithi057 ceph-mon[92072]: pgmap v5502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:49:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:25 smithi122 ceph-mon[125440]: pgmap v5502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:49:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:25 smithi136 ceph-mon[125702]: pgmap v5502: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:49:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:26.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:49:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:26.891+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:49:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:26.891+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:49:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:26.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:49:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:26.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:49:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:27 smithi057 ceph-mon[92072]: pgmap v5503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:49:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:27 smithi122 ceph-mon[125440]: pgmap v5503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:49:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:27 smithi136 ceph-mon[125702]: pgmap v5503: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:49:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:29 smithi057 ceph-mon[92072]: pgmap v5504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:49:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:29 smithi122 ceph-mon[125440]: pgmap v5504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:49:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:29 smithi136 ceph-mon[125702]: pgmap v5504: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:49:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:31 smithi057 ceph-mon[92072]: pgmap v5505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:31 smithi122 ceph-mon[125440]: pgmap v5505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:31 smithi136 ceph-mon[125702]: pgmap v5505: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:33 smithi057 ceph-mon[92072]: pgmap v5506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:33 smithi122 ceph-mon[125440]: pgmap v5506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:33 smithi136 ceph-mon[125702]: pgmap v5506: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:35 smithi057 ceph-mon[92072]: pgmap v5507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:35 smithi122 ceph-mon[125440]: pgmap v5507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:35 smithi136 ceph-mon[125702]: pgmap v5507: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:37 smithi057 ceph-mon[92072]: pgmap v5508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:37 smithi122 ceph-mon[125440]: pgmap v5508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:37 smithi136 ceph-mon[125702]: pgmap v5508: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:39 smithi057 ceph-mon[92072]: pgmap v5509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:39 smithi122 ceph-mon[125440]: pgmap v5509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:39 smithi136 ceph-mon[125702]: pgmap v5509: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:41 smithi057 ceph-mon[92072]: pgmap v5510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:41 smithi122 ceph-mon[125440]: pgmap v5510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:41 smithi136 ceph-mon[125702]: pgmap v5510: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:41.901+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:49:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:41.901+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:49:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:41.901+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:49:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:41.901+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:49:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:41.901+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:49:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:43 smithi057 ceph-mon[92072]: pgmap v5511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:43 smithi122 ceph-mon[125440]: pgmap v5511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:43 smithi136 ceph-mon[125702]: pgmap v5511: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:45 smithi057 ceph-mon[92072]: pgmap v5512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:45 smithi122 ceph-mon[125440]: pgmap v5512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:45 smithi136 ceph-mon[125702]: pgmap v5512: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:47 smithi057 ceph-mon[92072]: pgmap v5513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:47 smithi122 ceph-mon[125440]: pgmap v5513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:47 smithi136 ceph-mon[125702]: pgmap v5513: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:49 smithi057 ceph-mon[92072]: pgmap v5514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:49 smithi122 ceph-mon[125440]: pgmap v5514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:49 smithi136 ceph-mon[125702]: pgmap v5514: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:51 smithi057 ceph-mon[92072]: pgmap v5515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:51 smithi122 ceph-mon[125440]: pgmap v5515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:51 smithi136 ceph-mon[125702]: pgmap v5515: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:53 smithi057 ceph-mon[92072]: pgmap v5516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:53 smithi122 ceph-mon[125440]: pgmap v5516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:53 smithi136 ceph-mon[125702]: pgmap v5516: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:55 smithi057 ceph-mon[92072]: pgmap v5517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:55.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:55 smithi122 ceph-mon[125440]: pgmap v5517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:55 smithi136 ceph-mon[125702]: pgmap v5517: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:56.918+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:49:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:56.918+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:49:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:56.918+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:49:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:56.918+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:49:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:49:56.918+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:49:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:57 smithi122 ceph-mon[125440]: pgmap v5518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:57 smithi136 ceph-mon[125702]: pgmap v5518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:57 smithi057 ceph-mon[92072]: pgmap v5518: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:49:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:49:59 smithi122 ceph-mon[125440]: pgmap v5519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:49:59 smithi136 ceph-mon[125702]: pgmap v5519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:49:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:49:59 smithi057 ceph-mon[92072]: pgmap v5519: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T13:50:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T13:50:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T13:50:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:01 smithi122 ceph-mon[125440]: pgmap v5520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:01 smithi136 ceph-mon[125702]: pgmap v5520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:01 smithi057 ceph-mon[92072]: pgmap v5520: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:03 smithi136 ceph-mon[125702]: pgmap v5521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:03 smithi057 ceph-mon[92072]: pgmap v5521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:03 smithi122 ceph-mon[125440]: pgmap v5521: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:05 smithi136 ceph-mon[125702]: pgmap v5522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:50:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:05 smithi057 ceph-mon[92072]: pgmap v5522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:50:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:05 smithi122 ceph-mon[125440]: pgmap v5522: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:50:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:07 smithi136 ceph-mon[125702]: pgmap v5523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:50:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:07 smithi057 ceph-mon[92072]: pgmap v5523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:50:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:07 smithi122 ceph-mon[125440]: pgmap v5523: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:50:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:09 smithi122 ceph-mon[125440]: pgmap v5524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:50:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:09 smithi136 ceph-mon[125702]: pgmap v5524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:50:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:09 smithi057 ceph-mon[92072]: pgmap v5524: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:50:09.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:09.831+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:50:09.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:09.831+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:50:09.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:09.832+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 82 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:50:09.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:09.832+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 83 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:50:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:11 smithi136 ceph-mon[125702]: pgmap v5525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:50:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:11 smithi057 ceph-mon[92072]: pgmap v5525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:50:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:11 smithi122 ceph-mon[125440]: pgmap v5525: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:50:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:11.934+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:50:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:11.934+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:50:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:11.934+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:50:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:11.934+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:50:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:11.934+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:50:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:12 smithi057 ceph-mon[92072]: osdmap e417: 12 total, 12 up, 12 in 2023-03-02T13:50:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:12 smithi136 ceph-mon[125702]: osdmap e417: 12 total, 12 up, 12 in 2023-03-02T13:50:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:12 smithi122 ceph-mon[125440]: osdmap e417: 12 total, 12 up, 12 in 2023-03-02T13:50:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:13 smithi136 ceph-mon[125702]: pgmap v5527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:50:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:13 smithi057 ceph-mon[92072]: pgmap v5527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:50:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:13 smithi122 ceph-mon[125440]: pgmap v5527: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:50:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:15 smithi136 ceph-mon[125702]: pgmap v5528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:15 smithi057 ceph-mon[92072]: pgmap v5528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:15 smithi122 ceph-mon[125440]: pgmap v5528: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:17 smithi136 ceph-mon[125702]: pgmap v5529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:17 smithi136 ceph-mon[125702]: osdmap e418: 12 total, 12 up, 12 in 2023-03-02T13:50:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:17 smithi057 ceph-mon[92072]: pgmap v5529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:17 smithi057 ceph-mon[92072]: osdmap e418: 12 total, 12 up, 12 in 2023-03-02T13:50:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:17 smithi122 ceph-mon[125440]: pgmap v5529: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:17 smithi122 ceph-mon[125440]: osdmap e418: 12 total, 12 up, 12 in 2023-03-02T13:50:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:19 smithi136 ceph-mon[125702]: pgmap v5531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:50:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:19 smithi057 ceph-mon[92072]: pgmap v5531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:50:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:19 smithi122 ceph-mon[125440]: pgmap v5531: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T13:50:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:20 smithi136 ceph-mon[125702]: pgmap v5532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 367 B/s wr, 12 op/s 2023-03-02T13:50:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:20 smithi057 ceph-mon[92072]: pgmap v5532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 367 B/s wr, 12 op/s 2023-03-02T13:50:20.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:20 smithi122 ceph-mon[125440]: pgmap v5532: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 367 B/s wr, 12 op/s 2023-03-02T13:50:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:22 smithi136 ceph-mon[125702]: pgmap v5533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T13:50:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:22 smithi057 ceph-mon[92072]: pgmap v5533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T13:50:23.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:22 smithi122 ceph-mon[125440]: pgmap v5533: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T13:50:24.725 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:24 smithi136 ceph-mon[125702]: pgmap v5534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:24.725 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:50:24.725 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:50:24.726 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:50:24.726 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:50:25.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:24 smithi057 ceph-mon[92072]: pgmap v5534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:50:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:50:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:50:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:50:25.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:24 smithi122 ceph-mon[125440]: pgmap v5534: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:50:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:50:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:50:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:50:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:26.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:50:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:26.943+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:50:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:26.943+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:50:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:26.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:50:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:26.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:50:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:26 smithi136 ceph-mon[125702]: pgmap v5535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:26 smithi057 ceph-mon[92072]: pgmap v5535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:27.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:26 smithi122 ceph-mon[125440]: pgmap v5535: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:50:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:28 smithi136 ceph-mon[125702]: pgmap v5536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:50:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:28 smithi057 ceph-mon[92072]: pgmap v5536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:50:29.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:28 smithi122 ceph-mon[125440]: pgmap v5536: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:50:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:30 smithi136 ceph-mon[125702]: pgmap v5537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:30 smithi057 ceph-mon[92072]: pgmap v5537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:31.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:30 smithi122 ceph-mon[125440]: pgmap v5537: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:32 smithi136 ceph-mon[125702]: pgmap v5538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:32 smithi057 ceph-mon[92072]: pgmap v5538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:33.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:32 smithi122 ceph-mon[125440]: pgmap v5538: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:34 smithi136 ceph-mon[125702]: pgmap v5539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:34 smithi057 ceph-mon[92072]: pgmap v5539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:35.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:34 smithi122 ceph-mon[125440]: pgmap v5539: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:36 smithi136 ceph-mon[125702]: pgmap v5540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:36 smithi057 ceph-mon[92072]: pgmap v5540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:37.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:36 smithi122 ceph-mon[125440]: pgmap v5540: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:38 smithi136 ceph-mon[125702]: pgmap v5541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:38 smithi057 ceph-mon[92072]: pgmap v5541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:39.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:38 smithi122 ceph-mon[125440]: pgmap v5541: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:40 smithi136 ceph-mon[125702]: pgmap v5542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:40 smithi057 ceph-mon[92072]: pgmap v5542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:41.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:40 smithi122 ceph-mon[125440]: pgmap v5542: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:41.947+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:50:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:41.947+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:50:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:41.947+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:50:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:41.947+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:50:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:41.947+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:50:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:42 smithi136 ceph-mon[125702]: pgmap v5543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:43.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:42 smithi057 ceph-mon[92072]: pgmap v5543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:43.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:42 smithi122 ceph-mon[125440]: pgmap v5543: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:44 smithi136 ceph-mon[125702]: pgmap v5544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:44 smithi057 ceph-mon[92072]: pgmap v5544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:45.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:44 smithi122 ceph-mon[125440]: pgmap v5544: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:46 smithi136 ceph-mon[125702]: pgmap v5545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:46 smithi057 ceph-mon[92072]: pgmap v5545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:47.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:46 smithi122 ceph-mon[125440]: pgmap v5545: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:48 smithi136 ceph-mon[125702]: pgmap v5546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:48 smithi057 ceph-mon[92072]: pgmap v5546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:49.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:48 smithi122 ceph-mon[125440]: pgmap v5546: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:50 smithi136 ceph-mon[125702]: pgmap v5547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:50 smithi057 ceph-mon[92072]: pgmap v5547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:51.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:50 smithi122 ceph-mon[125440]: pgmap v5547: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:52 smithi136 ceph-mon[125702]: pgmap v5548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:52 smithi057 ceph-mon[92072]: pgmap v5548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:53.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:52 smithi122 ceph-mon[125440]: pgmap v5548: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:54 smithi136 ceph-mon[125702]: pgmap v5549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:54 smithi057 ceph-mon[92072]: pgmap v5549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:55.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:54 smithi122 ceph-mon[125440]: pgmap v5549: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:56.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:50:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:56.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:50:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:56.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:50:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:56.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:50:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:50:56.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:50:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:56 smithi136 ceph-mon[125702]: pgmap v5550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:56 smithi057 ceph-mon[92072]: pgmap v5550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:57.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:56 smithi122 ceph-mon[125440]: pgmap v5550: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:50:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:50:58 smithi136 ceph-mon[125702]: pgmap v5551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:50:58 smithi057 ceph-mon[92072]: pgmap v5551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:50:59.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:50:58 smithi122 ceph-mon[125440]: pgmap v5551: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:51:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:00 smithi136 ceph-mon[125702]: pgmap v5552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:51:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:00 smithi057 ceph-mon[92072]: pgmap v5552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:51:01.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:00 smithi122 ceph-mon[125440]: pgmap v5552: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:51:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:02 smithi136 ceph-mon[125702]: pgmap v5553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:51:03.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:02 smithi057 ceph-mon[92072]: pgmap v5553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:51:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:02 smithi122 ceph-mon[125440]: pgmap v5553: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:51:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:04 smithi136 ceph-mon[125702]: pgmap v5554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:51:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:04 smithi057 ceph-mon[92072]: pgmap v5554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:51:05.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:04 smithi122 ceph-mon[125440]: pgmap v5554: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:51:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:06 smithi136 ceph-mon[125702]: pgmap v5555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:51:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:06 smithi057 ceph-mon[92072]: pgmap v5555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:51:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:06 smithi122 ceph-mon[125440]: pgmap v5555: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:51:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:08 smithi136 ceph-mon[125702]: pgmap v5556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-02T13:51:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:08 smithi057 ceph-mon[92072]: pgmap v5556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-02T13:51:09.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:08 smithi122 ceph-mon[125440]: pgmap v5556: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-02T13:51:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:10 smithi136 ceph-mon[125702]: pgmap v5557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:51:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:10 smithi057 ceph-mon[92072]: pgmap v5557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:51:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:10 smithi122 ceph-mon[125440]: pgmap v5557: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:51:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:11.973+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:51:11.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:11.973+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:51:11.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:11.973+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:51:11.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:11.973+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:51:11.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:11.973+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:51:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:11 smithi136 ceph-mon[125702]: osdmap e419: 12 total, 12 up, 12 in 2023-03-02T13:51:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:11 smithi057 ceph-mon[92072]: osdmap e419: 12 total, 12 up, 12 in 2023-03-02T13:51:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:11 smithi122 ceph-mon[125440]: osdmap e419: 12 total, 12 up, 12 in 2023-03-02T13:51:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:12 smithi136 ceph-mon[125702]: pgmap v5559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T13:51:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:12 smithi057 ceph-mon[92072]: pgmap v5559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T13:51:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:12 smithi122 ceph-mon[125440]: pgmap v5559: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T13:51:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:14 smithi136 ceph-mon[125702]: pgmap v5560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-02T13:51:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:14 smithi057 ceph-mon[92072]: pgmap v5560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-02T13:51:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:14 smithi122 ceph-mon[125440]: pgmap v5560: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-02T13:51:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:16 smithi057 ceph-mon[92072]: pgmap v5561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-02T13:51:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:16 smithi057 ceph-mon[92072]: osdmap e420: 12 total, 12 up, 12 in 2023-03-02T13:51:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:16 smithi122 ceph-mon[125440]: pgmap v5561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-02T13:51:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:16 smithi122 ceph-mon[125440]: osdmap e420: 12 total, 12 up, 12 in 2023-03-02T13:51:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:16 smithi136 ceph-mon[125702]: pgmap v5561: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-02T13:51:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:16 smithi136 ceph-mon[125702]: osdmap e420: 12 total, 12 up, 12 in 2023-03-02T13:51:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:18 smithi057 ceph-mon[92072]: pgmap v5563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 14 op/s 2023-03-02T13:51:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:18 smithi122 ceph-mon[125440]: pgmap v5563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 14 op/s 2023-03-02T13:51:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:18 smithi136 ceph-mon[125702]: pgmap v5563: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 14 op/s 2023-03-02T13:51:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:20 smithi057 ceph-mon[92072]: pgmap v5564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 12 op/s 2023-03-02T13:51:21.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:20 smithi122 ceph-mon[125440]: pgmap v5564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 12 op/s 2023-03-02T13:51:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:20 smithi136 ceph-mon[125702]: pgmap v5564: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 12 op/s 2023-03-02T13:51:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:22 smithi057 ceph-mon[92072]: pgmap v5565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-02T13:51:23.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:22 smithi122 ceph-mon[125440]: pgmap v5565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-02T13:51:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:22 smithi136 ceph-mon[125702]: pgmap v5565: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-02T13:51:25.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:24 smithi057 ceph-mon[92072]: pgmap v5566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-02T13:51:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:51:25.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:24 smithi122 ceph-mon[125440]: pgmap v5566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-02T13:51:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:51:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:24 smithi136 ceph-mon[125702]: pgmap v5566: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-02T13:51:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:51:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:51:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:51:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:51:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:51:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:51:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:51:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:51:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:51:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:51:26.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:26.984+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:51:26.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:26.984+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:51:26.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:26.984+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:51:26.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:26.984+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:51:26.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:26.984+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:51:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:26 smithi057 ceph-mon[92072]: pgmap v5567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-02T13:51:27.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:26 smithi122 ceph-mon[125440]: pgmap v5567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-02T13:51:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:26 smithi136 ceph-mon[125702]: pgmap v5567: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-02T13:51:29.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:28 smithi057 ceph-mon[92072]: pgmap v5568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:51:29.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:28 smithi122 ceph-mon[125440]: pgmap v5568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:51:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:28 smithi136 ceph-mon[125702]: pgmap v5568: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T13:51:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:30 smithi057 ceph-mon[92072]: pgmap v5569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:31.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:30 smithi122 ceph-mon[125440]: pgmap v5569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:30 smithi136 ceph-mon[125702]: pgmap v5569: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:32 smithi057 ceph-mon[92072]: pgmap v5570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:33.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:32 smithi122 ceph-mon[125440]: pgmap v5570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:32 smithi136 ceph-mon[125702]: pgmap v5570: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:34 smithi057 ceph-mon[92072]: pgmap v5571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:35.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:34 smithi122 ceph-mon[125440]: pgmap v5571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:34 smithi136 ceph-mon[125702]: pgmap v5571: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:36 smithi057 ceph-mon[92072]: pgmap v5572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:37.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:36 smithi122 ceph-mon[125440]: pgmap v5572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:36 smithi136 ceph-mon[125702]: pgmap v5572: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:38 smithi057 ceph-mon[92072]: pgmap v5573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:39.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:38 smithi122 ceph-mon[125440]: pgmap v5573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:38 smithi136 ceph-mon[125702]: pgmap v5573: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:40 smithi057 ceph-mon[92072]: pgmap v5574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:41.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:40 smithi122 ceph-mon[125440]: pgmap v5574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:40 smithi136 ceph-mon[125702]: pgmap v5574: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:41.995+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:51:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:41.995+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:51:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:41.995+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:51:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:41.995+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:51:41.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:41.995+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:51:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:42 smithi057 ceph-mon[92072]: pgmap v5575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:43.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:42 smithi122 ceph-mon[125440]: pgmap v5575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:42 smithi136 ceph-mon[125702]: pgmap v5575: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:44 smithi057 ceph-mon[92072]: pgmap v5576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:45.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:44 smithi122 ceph-mon[125440]: pgmap v5576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:44 smithi136 ceph-mon[125702]: pgmap v5576: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:46 smithi057 ceph-mon[92072]: pgmap v5577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:47.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:46 smithi122 ceph-mon[125440]: pgmap v5577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:46 smithi136 ceph-mon[125702]: pgmap v5577: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:48 smithi057 ceph-mon[92072]: pgmap v5578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:49.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:48 smithi122 ceph-mon[125440]: pgmap v5578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:48 smithi136 ceph-mon[125702]: pgmap v5578: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:51.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:50 smithi057 ceph-mon[92072]: pgmap v5579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:51.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:50 smithi122 ceph-mon[125440]: pgmap v5579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:50 smithi136 ceph-mon[125702]: pgmap v5579: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:52 smithi057 ceph-mon[92072]: pgmap v5580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:53.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:52 smithi122 ceph-mon[125440]: pgmap v5580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:52 smithi136 ceph-mon[125702]: pgmap v5580: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:54 smithi057 ceph-mon[92072]: pgmap v5581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:55.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:54 smithi122 ceph-mon[125440]: pgmap v5581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:54 smithi136 ceph-mon[125702]: pgmap v5581: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:57.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:51:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:57.003+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:51:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:57.003+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:51:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:57.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:51:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:51:57.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:51:57.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:56 smithi122 ceph-mon[125440]: pgmap v5582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:56 smithi136 ceph-mon[125702]: pgmap v5582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:56 smithi057 ceph-mon[92072]: pgmap v5582: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:51:59.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:51:58 smithi122 ceph-mon[125440]: pgmap v5583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:51:58 smithi136 ceph-mon[125702]: pgmap v5583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:51:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:51:58 smithi057 ceph-mon[92072]: pgmap v5583: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-02T13:52:01.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:00 smithi122 ceph-mon[125440]: pgmap v5584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:52:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:00 smithi136 ceph-mon[125702]: pgmap v5584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:52:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:00 smithi057 ceph-mon[92072]: pgmap v5584: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:52:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:02 smithi122 ceph-mon[125440]: pgmap v5585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:52:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:02 smithi136 ceph-mon[125702]: pgmap v5585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:52:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:02 smithi057 ceph-mon[92072]: pgmap v5585: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T13:52:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:04 smithi136 ceph-mon[125702]: pgmap v5586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-02T13:52:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:04 smithi057 ceph-mon[92072]: pgmap v5586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-02T13:52:05.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:04 smithi122 ceph-mon[125440]: pgmap v5586: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-02T13:52:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:06 smithi136 ceph-mon[125702]: pgmap v5587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:52:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:06 smithi057 ceph-mon[92072]: pgmap v5587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:52:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:06 smithi122 ceph-mon[125440]: pgmap v5587: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:52:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:08 smithi136 ceph-mon[125702]: pgmap v5588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-02T13:52:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:08 smithi057 ceph-mon[92072]: pgmap v5588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-02T13:52:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:08 smithi122 ceph-mon[125440]: pgmap v5588: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-02T13:52:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:10 smithi136 ceph-mon[125702]: pgmap v5589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:52:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:10 smithi057 ceph-mon[92072]: pgmap v5589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:52:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:10 smithi122 ceph-mon[125440]: pgmap v5589: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:52:12.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:12.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:52:12.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:12.020+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:52:12.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:12.020+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:52:12.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:12.020+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:52:12.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:12.020+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:52:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:11 smithi136 ceph-mon[125702]: osdmap e421: 12 total, 12 up, 12 in 2023-03-02T13:52:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:11 smithi057 ceph-mon[92072]: osdmap e421: 12 total, 12 up, 12 in 2023-03-02T13:52:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:11 smithi122 ceph-mon[125440]: osdmap e421: 12 total, 12 up, 12 in 2023-03-02T13:52:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:12 smithi136 ceph-mon[125702]: pgmap v5591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T13:52:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:12 smithi057 ceph-mon[92072]: pgmap v5591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T13:52:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:12 smithi122 ceph-mon[125440]: pgmap v5591: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T13:52:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:14 smithi136 ceph-mon[125702]: pgmap v5592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:52:15.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:14 smithi057 ceph-mon[92072]: pgmap v5592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:52:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:14 smithi122 ceph-mon[125440]: pgmap v5592: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:52:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:16 smithi136 ceph-mon[125702]: pgmap v5593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:52:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:16 smithi136 ceph-mon[125702]: osdmap e422: 12 total, 12 up, 12 in 2023-03-02T13:52:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:16 smithi057 ceph-mon[92072]: pgmap v5593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:52:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:16 smithi057 ceph-mon[92072]: osdmap e422: 12 total, 12 up, 12 in 2023-03-02T13:52:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:16 smithi122 ceph-mon[125440]: pgmap v5593: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:52:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:16 smithi122 ceph-mon[125440]: osdmap e422: 12 total, 12 up, 12 in 2023-03-02T13:52:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:19 smithi136 ceph-mon[125702]: pgmap v5595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:52:19.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:19 smithi057 ceph-mon[92072]: pgmap v5595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:52:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:19 smithi122 ceph-mon[125440]: pgmap v5595: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:52:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:21 smithi136 ceph-mon[125702]: pgmap v5596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T13:52:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:21 smithi057 ceph-mon[92072]: pgmap v5596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T13:52:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:21 smithi122 ceph-mon[125440]: pgmap v5596: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T13:52:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:23 smithi136 ceph-mon[125702]: pgmap v5597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:52:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:23 smithi057 ceph-mon[92072]: pgmap v5597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:52:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:23 smithi122 ceph-mon[125440]: pgmap v5597: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:52:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:24.851+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:52:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:24.851+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:52:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:24.851+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 84 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:52:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:24.851+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 83 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:52:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:25 smithi136 ceph-mon[125702]: pgmap v5598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:52:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:25 smithi057 ceph-mon[92072]: pgmap v5598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:52:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:25 smithi122 ceph-mon[125440]: pgmap v5598: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:52:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:52:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:52:26.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:52:27.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:27.035+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:52:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:27.035+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:52:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:27.035+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:52:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:27.035+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:52:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:27.035+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:52:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:27 smithi136 ceph-mon[125702]: pgmap v5599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:52:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:27 smithi057 ceph-mon[92072]: pgmap v5599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:52:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:27 smithi122 ceph-mon[125440]: pgmap v5599: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:52:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:29 smithi136 ceph-mon[125702]: pgmap v5600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:52:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:29 smithi057 ceph-mon[92072]: pgmap v5600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:52:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:29 smithi122 ceph-mon[125440]: pgmap v5600: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:52:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:52:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:52:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: pgmap v5601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:52:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:52:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:52:31.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:52:31.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:52:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:52:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: pgmap v5601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:52:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:52:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:52:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:52:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T13:52:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T13:52:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: pgmap v5601: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T13:52:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T13:52:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T13:52:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:52:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:52:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:52:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:32 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:52:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:32 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:52:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:32 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:52:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:32 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:52:32.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:32 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T13:52:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:32 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T13:52:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:33 smithi136 ceph-mon[125702]: pgmap v5602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:33 smithi057 ceph-mon[92072]: pgmap v5602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:33 smithi122 ceph-mon[125440]: pgmap v5602: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:35 smithi136 ceph-mon[125702]: pgmap v5603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:35.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:35 smithi057 ceph-mon[92072]: pgmap v5603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:35 smithi122 ceph-mon[125440]: pgmap v5603: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:37 smithi136 ceph-mon[125702]: pgmap v5604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:37 smithi057 ceph-mon[92072]: pgmap v5604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:37 smithi122 ceph-mon[125440]: pgmap v5604: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:39 smithi136 ceph-mon[125702]: pgmap v5605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:39 smithi057 ceph-mon[92072]: pgmap v5605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:39 smithi122 ceph-mon[125440]: pgmap v5605: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:41 smithi136 ceph-mon[125702]: pgmap v5606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:41 smithi057 ceph-mon[92072]: pgmap v5606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:41 smithi122 ceph-mon[125440]: pgmap v5606: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:42.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:42.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:52:42.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:42.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:52:42.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:42.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:52:42.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:42.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:52:42.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:42.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:52:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:43 smithi136 ceph-mon[125702]: pgmap v5607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:43 smithi057 ceph-mon[92072]: pgmap v5607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:43 smithi122 ceph-mon[125440]: pgmap v5607: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:45 smithi136 ceph-mon[125702]: pgmap v5608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:45 smithi057 ceph-mon[92072]: pgmap v5608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:45.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:45 smithi122 ceph-mon[125440]: pgmap v5608: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:47 smithi136 ceph-mon[125702]: pgmap v5609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:47.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:47 smithi057 ceph-mon[92072]: pgmap v5609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:47 smithi122 ceph-mon[125440]: pgmap v5609: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:49 smithi136 ceph-mon[125702]: pgmap v5610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:49 smithi057 ceph-mon[92072]: pgmap v5610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:49 smithi122 ceph-mon[125440]: pgmap v5610: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:51 smithi057 ceph-mon[92072]: pgmap v5611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:51 smithi122 ceph-mon[125440]: pgmap v5611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:51 smithi136 ceph-mon[125702]: pgmap v5611: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:53 smithi057 ceph-mon[92072]: pgmap v5612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:53 smithi122 ceph-mon[125440]: pgmap v5612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:53 smithi136 ceph-mon[125702]: pgmap v5612: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:55 smithi057 ceph-mon[92072]: pgmap v5613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:55.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:55 smithi122 ceph-mon[125440]: pgmap v5613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:55 smithi136 ceph-mon[125702]: pgmap v5613: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:57.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:52:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:57.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:52:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:57.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:52:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:57.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:52:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:52:57.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:52:57.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:57 smithi057 ceph-mon[92072]: pgmap v5614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:57 smithi122 ceph-mon[125440]: pgmap v5614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:57 smithi136 ceph-mon[125702]: pgmap v5614: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:52:59.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:52:59 smithi057 ceph-mon[92072]: pgmap v5615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:52:59 smithi122 ceph-mon[125440]: pgmap v5615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:52:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:52:59 smithi136 ceph-mon[125702]: pgmap v5615: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:01 smithi057 ceph-mon[92072]: pgmap v5616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:01 smithi122 ceph-mon[125440]: pgmap v5616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:01 smithi136 ceph-mon[125702]: pgmap v5616: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:03 smithi057 ceph-mon[92072]: pgmap v5617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:03.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:03 smithi122 ceph-mon[125440]: pgmap v5617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:03 smithi136 ceph-mon[125702]: pgmap v5617: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:05 smithi057 ceph-mon[92072]: pgmap v5618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:53:05.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:05 smithi122 ceph-mon[125440]: pgmap v5618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:53:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:05 smithi136 ceph-mon[125702]: pgmap v5618: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:53:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:07 smithi057 ceph-mon[92072]: pgmap v5619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:53:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:07 smithi122 ceph-mon[125440]: pgmap v5619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:53:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:07 smithi136 ceph-mon[125702]: pgmap v5619: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:53:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:09 smithi057 ceph-mon[92072]: pgmap v5620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:53:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:09 smithi122 ceph-mon[125440]: pgmap v5620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:53:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:09 smithi136 ceph-mon[125702]: pgmap v5620: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:53:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:09.857+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:53:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:09.857+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:53:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:09.857+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 85 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:53:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:09.857+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 84 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:53:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:11 smithi057 ceph-mon[92072]: pgmap v5621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:53:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:11 smithi122 ceph-mon[125440]: pgmap v5621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:53:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:11 smithi136 ceph-mon[125702]: pgmap v5621: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:53:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:12.072+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:53:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:12.072+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:53:12.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:12.072+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:53:12.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:12.072+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:53:12.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:12.072+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:53:12.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:12 smithi057 ceph-mon[92072]: osdmap e423: 12 total, 12 up, 12 in 2023-03-02T13:53:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:12 smithi122 ceph-mon[125440]: osdmap e423: 12 total, 12 up, 12 in 2023-03-02T13:53:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:12 smithi136 ceph-mon[125702]: osdmap e423: 12 total, 12 up, 12 in 2023-03-02T13:53:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:13 smithi057 ceph-mon[92072]: pgmap v5623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:53:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:13 smithi122 ceph-mon[125440]: pgmap v5623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:53:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:13 smithi136 ceph-mon[125702]: pgmap v5623: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:53:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:15 smithi057 ceph-mon[92072]: pgmap v5624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:53:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:15 smithi122 ceph-mon[125440]: pgmap v5624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:53:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:15 smithi136 ceph-mon[125702]: pgmap v5624: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:53:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:17 smithi057 ceph-mon[92072]: pgmap v5625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:53:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:17 smithi057 ceph-mon[92072]: osdmap e424: 12 total, 12 up, 12 in 2023-03-02T13:53:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:17 smithi122 ceph-mon[125440]: pgmap v5625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:53:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:17 smithi122 ceph-mon[125440]: osdmap e424: 12 total, 12 up, 12 in 2023-03-02T13:53:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:17 smithi136 ceph-mon[125702]: pgmap v5625: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:53:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:17 smithi136 ceph-mon[125702]: osdmap e424: 12 total, 12 up, 12 in 2023-03-02T13:53:19.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:19 smithi057 ceph-mon[92072]: pgmap v5627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:53:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:19 smithi122 ceph-mon[125440]: pgmap v5627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:53:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:19 smithi136 ceph-mon[125702]: pgmap v5627: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:53:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:21 smithi122 ceph-mon[125440]: pgmap v5628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:53:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:21 smithi136 ceph-mon[125702]: pgmap v5628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:53:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:21 smithi057 ceph-mon[92072]: pgmap v5628: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T13:53:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:23 smithi122 ceph-mon[125440]: pgmap v5629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:53:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:23 smithi136 ceph-mon[125702]: pgmap v5629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:53:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:23 smithi057 ceph-mon[92072]: pgmap v5629: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:53:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:25 smithi122 ceph-mon[125440]: pgmap v5630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:53:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:25 smithi136 ceph-mon[125702]: pgmap v5630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:53:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:25 smithi057 ceph-mon[92072]: pgmap v5630: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:53:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:27.088+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:53:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:27.088+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:53:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:27.088+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:53:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:27.088+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:53:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:27.088+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:53:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:27 smithi122 ceph-mon[125440]: pgmap v5631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:53:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:27 smithi136 ceph-mon[125702]: pgmap v5631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:53:27.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:27 smithi057 ceph-mon[92072]: pgmap v5631: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:53:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:29 smithi136 ceph-mon[125702]: pgmap v5632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:53:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:29 smithi057 ceph-mon[92072]: pgmap v5632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:53:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:29 smithi122 ceph-mon[125440]: pgmap v5632: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:53:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:31 smithi136 ceph-mon[125702]: pgmap v5633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:53:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:31 smithi057 ceph-mon[92072]: pgmap v5633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:53:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:31 smithi122 ceph-mon[125440]: pgmap v5633: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:53:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:32 smithi136 ceph-mon[125702]: pgmap v5634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:53:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:53:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:53:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:32 smithi057 ceph-mon[92072]: pgmap v5634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:53:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:53:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:53:33.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:32 smithi122 ceph-mon[125440]: pgmap v5634: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:53:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:53:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:53:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:34 smithi136 ceph-mon[125702]: pgmap v5635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:34 smithi057 ceph-mon[92072]: pgmap v5635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:35.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:34 smithi122 ceph-mon[125440]: pgmap v5635: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:36 smithi136 ceph-mon[125702]: pgmap v5636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:36 smithi057 ceph-mon[92072]: pgmap v5636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:37.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:36 smithi122 ceph-mon[125440]: pgmap v5636: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:38 smithi136 ceph-mon[125702]: pgmap v5637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:39.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:38 smithi057 ceph-mon[92072]: pgmap v5637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:39.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:38 smithi122 ceph-mon[125440]: pgmap v5637: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:40 smithi136 ceph-mon[125702]: pgmap v5638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:41.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:40 smithi057 ceph-mon[92072]: pgmap v5638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:41.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:40 smithi122 ceph-mon[125440]: pgmap v5638: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:42.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:53:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:42.093+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:53:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:42.093+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:53:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:42.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:53:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:42.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:53:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:42 smithi136 ceph-mon[125702]: pgmap v5639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:42 smithi057 ceph-mon[92072]: pgmap v5639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:43.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:42 smithi122 ceph-mon[125440]: pgmap v5639: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:44 smithi136 ceph-mon[125702]: pgmap v5640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:44 smithi057 ceph-mon[92072]: pgmap v5640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:45.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:44 smithi122 ceph-mon[125440]: pgmap v5640: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:46 smithi136 ceph-mon[125702]: pgmap v5641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:47.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:46 smithi057 ceph-mon[92072]: pgmap v5641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:47.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:46 smithi122 ceph-mon[125440]: pgmap v5641: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:48 smithi057 ceph-mon[92072]: pgmap v5642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:49.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:48 smithi122 ceph-mon[125440]: pgmap v5642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:48 smithi136 ceph-mon[125702]: pgmap v5642: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:50 smithi057 ceph-mon[92072]: pgmap v5643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:51.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:50 smithi122 ceph-mon[125440]: pgmap v5643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:50 smithi136 ceph-mon[125702]: pgmap v5643: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:53.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:52 smithi057 ceph-mon[92072]: pgmap v5644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:52 smithi122 ceph-mon[125440]: pgmap v5644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:52 smithi136 ceph-mon[125702]: pgmap v5644: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:54 smithi057 ceph-mon[92072]: pgmap v5645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:55.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:54 smithi122 ceph-mon[125440]: pgmap v5645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:54 smithi136 ceph-mon[125702]: pgmap v5645: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:57.105+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:53:57.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:57.105+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:53:57.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:57.105+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:53:57.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:57.105+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:53:57.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:53:57.105+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:53:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:56 smithi057 ceph-mon[92072]: pgmap v5646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:57.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:56 smithi122 ceph-mon[125440]: pgmap v5646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:56 smithi136 ceph-mon[125702]: pgmap v5646: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:53:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:53:58 smithi057 ceph-mon[92072]: pgmap v5647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:59.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:53:58 smithi122 ceph-mon[125440]: pgmap v5647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:53:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:53:58 smithi136 ceph-mon[125702]: pgmap v5647: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:00 smithi057 ceph-mon[92072]: pgmap v5648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:01.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:00 smithi122 ceph-mon[125440]: pgmap v5648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:00 smithi136 ceph-mon[125702]: pgmap v5648: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:02 smithi057 ceph-mon[92072]: pgmap v5649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:02 smithi122 ceph-mon[125440]: pgmap v5649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:02 smithi136 ceph-mon[125702]: pgmap v5649: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:04 smithi057 ceph-mon[92072]: pgmap v5650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:54:05.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:04 smithi122 ceph-mon[125440]: pgmap v5650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:54:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:04 smithi136 ceph-mon[125702]: pgmap v5650: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:54:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:06 smithi057 ceph-mon[92072]: pgmap v5651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:54:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:06 smithi122 ceph-mon[125440]: pgmap v5651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:54:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:06 smithi136 ceph-mon[125702]: pgmap v5651: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:54:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:08 smithi057 ceph-mon[92072]: pgmap v5652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:54:09.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:08 smithi122 ceph-mon[125440]: pgmap v5652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:54:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:08 smithi136 ceph-mon[125702]: pgmap v5652: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:54:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:10 smithi057 ceph-mon[92072]: pgmap v5653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:54:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:10 smithi122 ceph-mon[125440]: pgmap v5653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:54:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:10 smithi136 ceph-mon[125702]: pgmap v5653: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:54:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:12.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:54:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:12.121+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:54:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:12.121+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:54:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:12.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:54:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:12.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:54:12.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:11 smithi057 ceph-mon[92072]: osdmap e425: 12 total, 12 up, 12 in 2023-03-02T13:54:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:11 smithi122 ceph-mon[125440]: osdmap e425: 12 total, 12 up, 12 in 2023-03-02T13:54:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:11 smithi136 ceph-mon[125702]: osdmap e425: 12 total, 12 up, 12 in 2023-03-02T13:54:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:12 smithi057 ceph-mon[92072]: pgmap v5655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:54:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:12 smithi122 ceph-mon[125440]: pgmap v5655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:54:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:12 smithi136 ceph-mon[125702]: pgmap v5655: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:54:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:14 smithi057 ceph-mon[92072]: pgmap v5656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:54:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:14 smithi122 ceph-mon[125440]: pgmap v5656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:54:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:14 smithi136 ceph-mon[125702]: pgmap v5656: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:54:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:16 smithi057 ceph-mon[92072]: pgmap v5657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:54:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:16 smithi057 ceph-mon[92072]: osdmap e426: 12 total, 12 up, 12 in 2023-03-02T13:54:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:16 smithi122 ceph-mon[125440]: pgmap v5657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:54:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:16 smithi122 ceph-mon[125440]: osdmap e426: 12 total, 12 up, 12 in 2023-03-02T13:54:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:16 smithi136 ceph-mon[125702]: pgmap v5657: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:54:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:16 smithi136 ceph-mon[125702]: osdmap e426: 12 total, 12 up, 12 in 2023-03-02T13:54:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:18 smithi057 ceph-mon[92072]: pgmap v5659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:54:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:18 smithi122 ceph-mon[125440]: pgmap v5659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:54:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:18 smithi136 ceph-mon[125702]: pgmap v5659: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:54:21.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:20 smithi122 ceph-mon[125440]: pgmap v5660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:54:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:20 smithi136 ceph-mon[125702]: pgmap v5660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:54:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:20 smithi057 ceph-mon[92072]: pgmap v5660: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:54:23.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:22 smithi122 ceph-mon[125440]: pgmap v5661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:54:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:22 smithi136 ceph-mon[125702]: pgmap v5661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:54:23.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:22 smithi057 ceph-mon[92072]: pgmap v5661: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:54:25.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:24 smithi122 ceph-mon[125440]: pgmap v5662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:54:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:24 smithi136 ceph-mon[125702]: pgmap v5662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:54:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:24 smithi057 ceph-mon[92072]: pgmap v5662: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:54:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:27.134+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:54:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:27.134+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:54:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:27.134+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:54:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:27.134+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:54:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:27.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:54:27.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:26 smithi122 ceph-mon[125440]: pgmap v5663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:54:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:26 smithi136 ceph-mon[125702]: pgmap v5663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:54:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:26 smithi057 ceph-mon[92072]: pgmap v5663: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:54:29.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:28 smithi122 ceph-mon[125440]: pgmap v5664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:54:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:28 smithi136 ceph-mon[125702]: pgmap v5664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:54:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:28 smithi057 ceph-mon[92072]: pgmap v5664: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:54:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:30 smithi136 ceph-mon[125702]: pgmap v5665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:30 smithi057 ceph-mon[92072]: pgmap v5665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:30 smithi122 ceph-mon[125440]: pgmap v5665: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:32 smithi136 ceph-mon[125702]: pgmap v5666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:54:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:54:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:54:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:32 smithi057 ceph-mon[92072]: pgmap v5666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:54:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:54:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:54:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:32 smithi122 ceph-mon[125440]: pgmap v5666: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:54:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:54:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:54:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:54:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:54:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:54:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:54:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:54:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:54:34.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:54:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:54:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:54:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:34 smithi136 ceph-mon[125702]: pgmap v5667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:34 smithi057 ceph-mon[92072]: pgmap v5667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:34 smithi122 ceph-mon[125440]: pgmap v5667: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:36 smithi136 ceph-mon[125702]: pgmap v5668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:37.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:36 smithi057 ceph-mon[92072]: pgmap v5668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:36 smithi122 ceph-mon[125440]: pgmap v5668: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:38 smithi136 ceph-mon[125702]: pgmap v5669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:38 smithi057 ceph-mon[92072]: pgmap v5669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:38 smithi122 ceph-mon[125440]: pgmap v5669: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:40 smithi136 ceph-mon[125702]: pgmap v5670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:40 smithi057 ceph-mon[92072]: pgmap v5670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:40 smithi122 ceph-mon[125440]: pgmap v5670: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:42.148+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:54:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:42.149+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:54:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:42.149+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:54:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:42.149+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:54:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:42.149+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:54:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:42 smithi136 ceph-mon[125702]: pgmap v5671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:42 smithi057 ceph-mon[92072]: pgmap v5671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:42 smithi122 ceph-mon[125440]: pgmap v5671: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:44 smithi136 ceph-mon[125702]: pgmap v5672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:45.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:44 smithi057 ceph-mon[92072]: pgmap v5672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:44 smithi122 ceph-mon[125440]: pgmap v5672: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:46 smithi136 ceph-mon[125702]: pgmap v5673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:46 smithi057 ceph-mon[92072]: pgmap v5673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:46 smithi122 ceph-mon[125440]: pgmap v5673: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:48 smithi136 ceph-mon[125702]: pgmap v5674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:48 smithi057 ceph-mon[92072]: pgmap v5674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:48 smithi122 ceph-mon[125440]: pgmap v5674: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:51 smithi136 ceph-mon[125702]: pgmap v5675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:51.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:51 smithi057 ceph-mon[92072]: pgmap v5675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:51 smithi122 ceph-mon[125440]: pgmap v5675: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:53 smithi136 ceph-mon[125702]: pgmap v5676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:53 smithi057 ceph-mon[92072]: pgmap v5676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:53 smithi122 ceph-mon[125440]: pgmap v5676: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:55 smithi136 ceph-mon[125702]: pgmap v5677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:55.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:55 smithi057 ceph-mon[92072]: pgmap v5677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:55.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:55 smithi122 ceph-mon[125440]: pgmap v5677: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:57.164+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:54:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:57.164+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:54:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:57.164+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:54:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:57.164+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:54:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:54:57.164+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:54:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:57 smithi136 ceph-mon[125702]: pgmap v5678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:57 smithi057 ceph-mon[92072]: pgmap v5678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:57 smithi122 ceph-mon[125440]: pgmap v5678: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:54:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:54:59 smithi136 ceph-mon[125702]: pgmap v5679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:54:59 smithi057 ceph-mon[92072]: pgmap v5679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:54:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:54:59 smithi122 ceph-mon[125440]: pgmap v5679: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:01 smithi136 ceph-mon[125702]: pgmap v5680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:01 smithi057 ceph-mon[92072]: pgmap v5680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:01 smithi122 ceph-mon[125440]: pgmap v5680: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:03 smithi136 ceph-mon[125702]: pgmap v5681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:03.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:03 smithi057 ceph-mon[92072]: pgmap v5681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:03.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:03 smithi122 ceph-mon[125440]: pgmap v5681: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:05 smithi136 ceph-mon[125702]: pgmap v5682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:55:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:05 smithi057 ceph-mon[92072]: pgmap v5682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:55:05.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:05 smithi122 ceph-mon[125440]: pgmap v5682: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:55:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:07 smithi136 ceph-mon[125702]: pgmap v5683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:55:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:07 smithi057 ceph-mon[92072]: pgmap v5683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:55:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:07 smithi122 ceph-mon[125440]: pgmap v5683: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:55:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:09 smithi136 ceph-mon[125702]: pgmap v5684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:55:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:09 smithi057 ceph-mon[92072]: pgmap v5684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:55:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:09 smithi122 ceph-mon[125440]: pgmap v5684: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:55:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:11 smithi136 ceph-mon[125702]: pgmap v5685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:55:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:11 smithi057 ceph-mon[92072]: pgmap v5685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:55:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:11 smithi122 ceph-mon[125440]: pgmap v5685: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:55:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:12.174+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:55:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:12.174+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:55:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:12.174+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:55:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:12.174+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:55:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:12.174+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:55:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:12 smithi136 ceph-mon[125702]: osdmap e427: 12 total, 12 up, 12 in 2023-03-02T13:55:12.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:12 smithi057 ceph-mon[92072]: osdmap e427: 12 total, 12 up, 12 in 2023-03-02T13:55:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:12 smithi122 ceph-mon[125440]: osdmap e427: 12 total, 12 up, 12 in 2023-03-02T13:55:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:13 smithi136 ceph-mon[125702]: pgmap v5687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:55:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:13 smithi057 ceph-mon[92072]: pgmap v5687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:55:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:13 smithi122 ceph-mon[125440]: pgmap v5687: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:55:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:15 smithi136 ceph-mon[125702]: pgmap v5688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:55:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:15 smithi057 ceph-mon[92072]: pgmap v5688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:55:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:15 smithi122 ceph-mon[125440]: pgmap v5688: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:55:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:17 smithi136 ceph-mon[125702]: pgmap v5689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:55:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:17 smithi136 ceph-mon[125702]: osdmap e428: 12 total, 12 up, 12 in 2023-03-02T13:55:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:17 smithi057 ceph-mon[92072]: pgmap v5689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:55:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:17 smithi057 ceph-mon[92072]: osdmap e428: 12 total, 12 up, 12 in 2023-03-02T13:55:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:17 smithi122 ceph-mon[125440]: pgmap v5689: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:55:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:17 smithi122 ceph-mon[125440]: osdmap e428: 12 total, 12 up, 12 in 2023-03-02T13:55:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:19 smithi136 ceph-mon[125702]: pgmap v5691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:55:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:19 smithi057 ceph-mon[92072]: pgmap v5691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:55:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:19 smithi122 ceph-mon[125440]: pgmap v5691: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:55:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:21 smithi057 ceph-mon[92072]: pgmap v5692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T13:55:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:21 smithi122 ceph-mon[125440]: pgmap v5692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T13:55:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:21 smithi136 ceph-mon[125702]: pgmap v5692: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T13:55:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:23 smithi057 ceph-mon[92072]: pgmap v5693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:55:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:23 smithi122 ceph-mon[125440]: pgmap v5693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:55:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:23 smithi136 ceph-mon[125702]: pgmap v5693: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:55:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:25 smithi057 ceph-mon[92072]: pgmap v5694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:55:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:25 smithi122 ceph-mon[125440]: pgmap v5694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:55:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:25 smithi136 ceph-mon[125702]: pgmap v5694: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:55:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:27.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:55:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:27.191+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:55:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:27.191+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:55:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:27.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:55:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:27.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:55:27.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:27 smithi057 ceph-mon[92072]: pgmap v5695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:55:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:27 smithi122 ceph-mon[125440]: pgmap v5695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:55:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:27 smithi136 ceph-mon[125702]: pgmap v5695: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:55:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:29 smithi057 ceph-mon[92072]: pgmap v5696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:55:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:29 smithi122 ceph-mon[125440]: pgmap v5696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:55:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:29 smithi136 ceph-mon[125702]: pgmap v5696: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:55:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:31 smithi057 ceph-mon[92072]: pgmap v5697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:31 smithi122 ceph-mon[125440]: pgmap v5697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:31 smithi136 ceph-mon[125702]: pgmap v5697: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:33 smithi057 ceph-mon[92072]: pgmap v5698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:33 smithi122 ceph-mon[125440]: pgmap v5698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:33 smithi136 ceph-mon[125702]: pgmap v5698: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:55:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:34.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:55:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:55:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:35.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:35 smithi057 ceph-mon[92072]: pgmap v5699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:35 smithi122 ceph-mon[125440]: pgmap v5699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:35 smithi136 ceph-mon[125702]: pgmap v5699: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:55:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:55:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:36.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:55:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:55:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:55:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:55:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:55:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:37 smithi057 ceph-mon[92072]: pgmap v5700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:37 smithi122 ceph-mon[125440]: pgmap v5700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:37 smithi136 ceph-mon[125702]: pgmap v5700: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:39.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:39 smithi057 ceph-mon[92072]: pgmap v5701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:39 smithi122 ceph-mon[125440]: pgmap v5701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:39 smithi136 ceph-mon[125702]: pgmap v5701: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:41 smithi122 ceph-mon[125440]: pgmap v5702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:41 smithi136 ceph-mon[125702]: pgmap v5702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:41 smithi057 ceph-mon[92072]: pgmap v5702: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:42.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:42.203+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:55:42.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:42.203+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:55:42.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:42.203+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:55:42.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:42.203+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:55:42.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:42.203+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:55:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:43 smithi122 ceph-mon[125440]: pgmap v5703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:43 smithi136 ceph-mon[125702]: pgmap v5703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:43 smithi057 ceph-mon[92072]: pgmap v5703: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:45 smithi136 ceph-mon[125702]: pgmap v5704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:45 smithi057 ceph-mon[92072]: pgmap v5704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:45 smithi122 ceph-mon[125440]: pgmap v5704: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:47 smithi136 ceph-mon[125702]: pgmap v5705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:47 smithi057 ceph-mon[92072]: pgmap v5705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:47 smithi122 ceph-mon[125440]: pgmap v5705: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:49 smithi136 ceph-mon[125702]: pgmap v5706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:49.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:49 smithi057 ceph-mon[92072]: pgmap v5706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:49 smithi122 ceph-mon[125440]: pgmap v5706: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:51 smithi136 ceph-mon[125702]: pgmap v5707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:51 smithi057 ceph-mon[92072]: pgmap v5707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:51 smithi122 ceph-mon[125440]: pgmap v5707: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:53 smithi136 ceph-mon[125702]: pgmap v5708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:53 smithi057 ceph-mon[92072]: pgmap v5708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:53 smithi122 ceph-mon[125440]: pgmap v5708: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:55 smithi136 ceph-mon[125702]: pgmap v5709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:55 smithi057 ceph-mon[92072]: pgmap v5709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:55 smithi122 ceph-mon[125440]: pgmap v5709: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:57.217+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:55:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:57.217+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:55:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:57.217+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:55:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:57.217+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:55:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:55:57.217+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:55:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:57 smithi136 ceph-mon[125702]: pgmap v5710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:57 smithi057 ceph-mon[92072]: pgmap v5710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:57 smithi122 ceph-mon[125440]: pgmap v5710: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:55:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:55:59 smithi136 ceph-mon[125702]: pgmap v5711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:55:59 smithi057 ceph-mon[92072]: pgmap v5711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:55:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:55:59 smithi122 ceph-mon[125440]: pgmap v5711: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:01 smithi136 ceph-mon[125702]: pgmap v5712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:01 smithi057 ceph-mon[92072]: pgmap v5712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:01 smithi122 ceph-mon[125440]: pgmap v5712: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:03 smithi136 ceph-mon[125702]: pgmap v5713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:03 smithi057 ceph-mon[92072]: pgmap v5713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:03 smithi122 ceph-mon[125440]: pgmap v5713: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:05 smithi136 ceph-mon[125702]: pgmap v5714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:56:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:05 smithi057 ceph-mon[92072]: pgmap v5714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:56:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:05 smithi122 ceph-mon[125440]: pgmap v5714: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:56:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:07 smithi136 ceph-mon[125702]: pgmap v5715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:56:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:07 smithi057 ceph-mon[92072]: pgmap v5715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:56:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:07 smithi122 ceph-mon[125440]: pgmap v5715: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:56:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:09 smithi136 ceph-mon[125702]: pgmap v5716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:56:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:09 smithi057 ceph-mon[92072]: pgmap v5716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:56:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:09 smithi122 ceph-mon[125440]: pgmap v5716: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:56:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:09.883+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:56:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:09.883+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:56:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:09.883+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 85 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:56:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:09.883+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 86 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:56:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:11 smithi136 ceph-mon[125702]: pgmap v5717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:56:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:11 smithi057 ceph-mon[92072]: pgmap v5717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:56:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:11 smithi122 ceph-mon[125440]: pgmap v5717: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:56:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:12.231+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:56:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:12.232+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:56:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:12.232+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:56:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:12.232+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:56:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:12.232+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:56:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:12 smithi136 ceph-mon[125702]: osdmap e429: 12 total, 12 up, 12 in 2023-03-02T13:56:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:12 smithi057 ceph-mon[92072]: osdmap e429: 12 total, 12 up, 12 in 2023-03-02T13:56:12.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:12 smithi122 ceph-mon[125440]: osdmap e429: 12 total, 12 up, 12 in 2023-03-02T13:56:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:13 smithi136 ceph-mon[125702]: pgmap v5719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:56:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:13 smithi057 ceph-mon[92072]: pgmap v5719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:56:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:13 smithi122 ceph-mon[125440]: pgmap v5719: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:56:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:15 smithi136 ceph-mon[125702]: pgmap v5720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:15 smithi057 ceph-mon[92072]: pgmap v5720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:15 smithi122 ceph-mon[125440]: pgmap v5720: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:17 smithi136 ceph-mon[125702]: pgmap v5721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:17 smithi057 ceph-mon[92072]: pgmap v5721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:17 smithi122 ceph-mon[125440]: pgmap v5721: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:18 smithi136 ceph-mon[125702]: pgmap v5722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:18.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:18 smithi057 ceph-mon[92072]: pgmap v5722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:18.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:18 smithi122 ceph-mon[125440]: pgmap v5722: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:20 smithi136 ceph-mon[125702]: pgmap v5723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:20 smithi057 ceph-mon[92072]: pgmap v5723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:21.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:20 smithi122 ceph-mon[125440]: pgmap v5723: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:56:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:22 smithi136 ceph-mon[125702]: pgmap v5724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 197 B/s wr, 10 op/s 2023-03-02T13:56:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:22 smithi136 ceph-mon[125702]: osdmap e430: 12 total, 12 up, 12 in 2023-03-02T13:56:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:22 smithi057 ceph-mon[92072]: pgmap v5724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 197 B/s wr, 10 op/s 2023-03-02T13:56:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:22 smithi057 ceph-mon[92072]: osdmap e430: 12 total, 12 up, 12 in 2023-03-02T13:56:23.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:22 smithi122 ceph-mon[125440]: pgmap v5724: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 197 B/s wr, 10 op/s 2023-03-02T13:56:23.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:22 smithi122 ceph-mon[125440]: osdmap e430: 12 total, 12 up, 12 in 2023-03-02T13:56:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:24 smithi057 ceph-mon[92072]: pgmap v5726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:56:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:24 smithi122 ceph-mon[125440]: pgmap v5726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:56:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:24 smithi136 ceph-mon[125702]: pgmap v5726: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:56:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:26 smithi057 ceph-mon[92072]: pgmap v5727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:56:27.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:26 smithi122 ceph-mon[125440]: pgmap v5727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:56:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:27.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:56:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:27.245+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:56:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:27.245+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:56:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:27.245+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:56:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:27.245+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:56:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:26 smithi136 ceph-mon[125702]: pgmap v5727: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:56:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:28 smithi057 ceph-mon[92072]: pgmap v5728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:56:29.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:28 smithi122 ceph-mon[125440]: pgmap v5728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:56:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:28 smithi136 ceph-mon[125702]: pgmap v5728: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:56:31.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:30 smithi057 ceph-mon[92072]: pgmap v5729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:56:31.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:30 smithi122 ceph-mon[125440]: pgmap v5729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:56:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:30 smithi136 ceph-mon[125702]: pgmap v5729: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:56:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:32 smithi057 ceph-mon[92072]: pgmap v5730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:56:33.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:32 smithi122 ceph-mon[125440]: pgmap v5730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:56:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:32 smithi136 ceph-mon[125702]: pgmap v5730: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:56:35.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:34 smithi057 ceph-mon[92072]: pgmap v5731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:35.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:34 smithi122 ceph-mon[125440]: pgmap v5731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:34 smithi136 ceph-mon[125702]: pgmap v5731: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:56:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:56:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:56:37.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:36 smithi057 ceph-mon[92072]: pgmap v5732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:56:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:56:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:56:37.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:36 smithi122 ceph-mon[125440]: pgmap v5732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:56:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:56:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:56:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:36 smithi136 ceph-mon[125702]: pgmap v5732: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:56:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:56:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:56:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:38 smithi057 ceph-mon[92072]: pgmap v5733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:39.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:38 smithi122 ceph-mon[125440]: pgmap v5733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:38 smithi136 ceph-mon[125702]: pgmap v5733: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:40 smithi057 ceph-mon[92072]: pgmap v5734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:41.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:40 smithi122 ceph-mon[125440]: pgmap v5734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:40 smithi136 ceph-mon[125702]: pgmap v5734: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:42.258+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:56:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:42.259+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:56:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:42.259+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:56:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:42.259+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:56:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:42.259+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:56:43.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:42 smithi057 ceph-mon[92072]: pgmap v5735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:43.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:42 smithi122 ceph-mon[125440]: pgmap v5735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:42 smithi136 ceph-mon[125702]: pgmap v5735: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:44 smithi057 ceph-mon[92072]: pgmap v5736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:45.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:44 smithi122 ceph-mon[125440]: pgmap v5736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:44 smithi136 ceph-mon[125702]: pgmap v5736: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:47.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:46 smithi057 ceph-mon[92072]: pgmap v5737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:47.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:46 smithi122 ceph-mon[125440]: pgmap v5737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:46 smithi136 ceph-mon[125702]: pgmap v5737: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:49.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:48 smithi057 ceph-mon[92072]: pgmap v5738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:49.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:48 smithi122 ceph-mon[125440]: pgmap v5738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:48 smithi136 ceph-mon[125702]: pgmap v5738: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:51.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:50 smithi057 ceph-mon[92072]: pgmap v5739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:51.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:50 smithi122 ceph-mon[125440]: pgmap v5739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:50 smithi136 ceph-mon[125702]: pgmap v5739: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:53.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:52 smithi057 ceph-mon[92072]: pgmap v5740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:53.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:52 smithi122 ceph-mon[125440]: pgmap v5740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:52 smithi136 ceph-mon[125702]: pgmap v5740: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:54 smithi057 ceph-mon[92072]: pgmap v5741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:55.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:54 smithi122 ceph-mon[125440]: pgmap v5741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:54 smithi136 ceph-mon[125702]: pgmap v5741: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:57.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:56 smithi057 ceph-mon[92072]: pgmap v5742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:57.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:56 smithi122 ceph-mon[125440]: pgmap v5742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:57.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:57.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:56:57.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:57.262+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:56:57.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:57.262+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:56:57.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:57.262+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:56:57.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:56:57.262+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:56:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:56 smithi136 ceph-mon[125702]: pgmap v5742: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:56:59.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:56:58 smithi057 ceph-mon[92072]: pgmap v5743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:59.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:56:58 smithi122 ceph-mon[125440]: pgmap v5743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:56:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:56:58 smithi136 ceph-mon[125702]: pgmap v5743: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:57:01.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:00 smithi122 ceph-mon[125440]: pgmap v5744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:00 smithi136 ceph-mon[125702]: pgmap v5744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:01.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:00 smithi057 ceph-mon[92072]: pgmap v5744: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:02 smithi122 ceph-mon[125440]: pgmap v5745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:02 smithi136 ceph-mon[125702]: pgmap v5745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:02 smithi057 ceph-mon[92072]: pgmap v5745: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:05.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:04 smithi122 ceph-mon[125440]: pgmap v5746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:57:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:04 smithi136 ceph-mon[125702]: pgmap v5746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:57:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:04 smithi057 ceph-mon[92072]: pgmap v5746: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:57:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:06 smithi122 ceph-mon[125440]: pgmap v5747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:57:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:06 smithi136 ceph-mon[125702]: pgmap v5747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:57:07.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:06 smithi057 ceph-mon[92072]: pgmap v5747: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:57:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:08 smithi136 ceph-mon[125702]: pgmap v5748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:57:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:08 smithi057 ceph-mon[92072]: pgmap v5748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:57:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:08 smithi122 ceph-mon[125440]: pgmap v5748: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:57:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:10 smithi136 ceph-mon[125702]: pgmap v5749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:57:11.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:10 smithi057 ceph-mon[92072]: pgmap v5749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:57:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:10 smithi122 ceph-mon[125440]: pgmap v5749: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:57:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:12.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:57:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:12.273+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:57:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:12.273+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:57:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:12.273+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:57:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:12.273+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:57:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:11 smithi136 ceph-mon[125702]: osdmap e431: 12 total, 12 up, 12 in 2023-03-02T13:57:12.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:11 smithi057 ceph-mon[92072]: osdmap e431: 12 total, 12 up, 12 in 2023-03-02T13:57:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:11 smithi122 ceph-mon[125440]: osdmap e431: 12 total, 12 up, 12 in 2023-03-02T13:57:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:12 smithi136 ceph-mon[125702]: pgmap v5751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:57:13.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:12 smithi057 ceph-mon[92072]: pgmap v5751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:57:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:12 smithi122 ceph-mon[125440]: pgmap v5751: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:57:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:14 smithi136 ceph-mon[125702]: pgmap v5752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:57:15.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:14 smithi057 ceph-mon[92072]: pgmap v5752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:57:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:14 smithi122 ceph-mon[125440]: pgmap v5752: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:57:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:16 smithi136 ceph-mon[125702]: pgmap v5753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:57:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:16 smithi136 ceph-mon[125702]: osdmap e432: 12 total, 12 up, 12 in 2023-03-02T13:57:17.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:16 smithi057 ceph-mon[92072]: pgmap v5753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:57:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:16 smithi057 ceph-mon[92072]: osdmap e432: 12 total, 12 up, 12 in 2023-03-02T13:57:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:16 smithi122 ceph-mon[125440]: pgmap v5753: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:57:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:16 smithi122 ceph-mon[125440]: osdmap e432: 12 total, 12 up, 12 in 2023-03-02T13:57:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:19 smithi136 ceph-mon[125702]: pgmap v5755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:57:19.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:19 smithi057 ceph-mon[92072]: pgmap v5755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:57:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:19 smithi122 ceph-mon[125440]: pgmap v5755: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:57:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:21 smithi136 ceph-mon[125702]: pgmap v5756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:57:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:21 smithi057 ceph-mon[92072]: pgmap v5756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:57:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:21 smithi122 ceph-mon[125440]: pgmap v5756: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T13:57:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:23 smithi136 ceph-mon[125702]: pgmap v5757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:57:23.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:23 smithi057 ceph-mon[92072]: pgmap v5757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:57:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:23 smithi122 ceph-mon[125440]: pgmap v5757: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:57:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:25 smithi136 ceph-mon[125702]: pgmap v5758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:57:25.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:25 smithi057 ceph-mon[92072]: pgmap v5758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:57:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:25 smithi122 ceph-mon[125440]: pgmap v5758: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:57:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:27.286+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:57:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:27.287+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:57:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:27.287+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:57:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:27.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:57:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:27.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:57:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:27 smithi136 ceph-mon[125702]: pgmap v5759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:57:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:27 smithi057 ceph-mon[92072]: pgmap v5759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:57:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:27 smithi122 ceph-mon[125440]: pgmap v5759: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:57:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:29 smithi136 ceph-mon[125702]: pgmap v5760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:29.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:29 smithi057 ceph-mon[92072]: pgmap v5760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:29 smithi122 ceph-mon[125440]: pgmap v5760: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:31 smithi136 ceph-mon[125702]: pgmap v5761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:31 smithi057 ceph-mon[92072]: pgmap v5761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:31 smithi122 ceph-mon[125440]: pgmap v5761: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:33 smithi136 ceph-mon[125702]: pgmap v5762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T13:57:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:33 smithi057 ceph-mon[92072]: pgmap v5762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T13:57:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:33 smithi122 ceph-mon[125440]: pgmap v5762: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T13:57:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:35 smithi136 ceph-mon[125702]: pgmap v5763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T13:57:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:35 smithi057 ceph-mon[92072]: pgmap v5763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T13:57:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:35 smithi122 ceph-mon[125440]: pgmap v5763: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T13:57:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:37 smithi136 ceph-mon[125702]: pgmap v5764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:57:37.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:37 smithi057 ceph-mon[92072]: pgmap v5764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:57:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:37 smithi122 ceph-mon[125440]: pgmap v5764: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:57:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:57:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:57:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:57:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:57:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:57:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:57:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:57:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:57:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:57:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:39 smithi136 ceph-mon[125702]: pgmap v5765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:57:39.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:39 smithi057 ceph-mon[92072]: pgmap v5765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:57:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:39 smithi122 ceph-mon[125440]: pgmap v5765: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:57:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:41 smithi136 ceph-mon[125702]: pgmap v5766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:41 smithi057 ceph-mon[92072]: pgmap v5766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:41 smithi122 ceph-mon[125440]: pgmap v5766: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:42.303+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:57:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:42.304+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:57:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:42.304+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:57:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:42.304+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:57:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:42.304+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:57:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:43 smithi136 ceph-mon[125702]: pgmap v5767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T13:57:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:43 smithi057 ceph-mon[92072]: pgmap v5767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T13:57:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:43 smithi122 ceph-mon[125440]: pgmap v5767: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T13:57:45.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:45 smithi057 ceph-mon[92072]: pgmap v5768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:45 smithi122 ceph-mon[125440]: pgmap v5768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:45 smithi136 ceph-mon[125702]: pgmap v5768: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:47 smithi057 ceph-mon[92072]: pgmap v5769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:47 smithi122 ceph-mon[125440]: pgmap v5769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:47 smithi136 ceph-mon[125702]: pgmap v5769: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:49.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:49 smithi057 ceph-mon[92072]: pgmap v5770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:57:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:49 smithi122 ceph-mon[125440]: pgmap v5770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:57:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:49 smithi136 ceph-mon[125702]: pgmap v5770: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:57:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:51 smithi057 ceph-mon[92072]: pgmap v5771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:51 smithi122 ceph-mon[125440]: pgmap v5771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:51 smithi136 ceph-mon[125702]: pgmap v5771: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:53 smithi057 ceph-mon[92072]: pgmap v5772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T13:57:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:53 smithi122 ceph-mon[125440]: pgmap v5772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T13:57:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:53 smithi136 ceph-mon[125702]: pgmap v5772: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T13:57:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:55 smithi057 ceph-mon[92072]: pgmap v5773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:55.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:55 smithi122 ceph-mon[125440]: pgmap v5773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:55 smithi136 ceph-mon[125702]: pgmap v5773: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:57:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:57.319+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:57:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:57.319+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:57:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:57.319+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:57:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:57.319+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:57:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:57:57.319+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:57:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:57 smithi057 ceph-mon[92072]: pgmap v5774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:57 smithi122 ceph-mon[125440]: pgmap v5774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:57 smithi136 ceph-mon[125702]: pgmap v5774: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:57:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:57:59 smithi057 ceph-mon[92072]: pgmap v5775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:57:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:57:59 smithi122 ceph-mon[125440]: pgmap v5775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:57:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:57:59 smithi136 ceph-mon[125702]: pgmap v5775: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:01.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:01 smithi057 ceph-mon[92072]: pgmap v5776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:01 smithi122 ceph-mon[125440]: pgmap v5776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:01 smithi136 ceph-mon[125702]: pgmap v5776: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:03 smithi057 ceph-mon[92072]: pgmap v5777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:58:03.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:03 smithi122 ceph-mon[125440]: pgmap v5777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:58:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:03 smithi136 ceph-mon[125702]: pgmap v5777: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:58:05.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:05 smithi057 ceph-mon[92072]: pgmap v5778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T13:58:05.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:05 smithi122 ceph-mon[125440]: pgmap v5778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T13:58:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:05 smithi136 ceph-mon[125702]: pgmap v5778: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T13:58:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:07 smithi057 ceph-mon[92072]: pgmap v5779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:58:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:07 smithi122 ceph-mon[125440]: pgmap v5779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:58:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:07 smithi136 ceph-mon[125702]: pgmap v5779: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T13:58:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:09 smithi057 ceph-mon[92072]: pgmap v5780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:58:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:09 smithi122 ceph-mon[125440]: pgmap v5780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:58:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:09 smithi136 ceph-mon[125702]: pgmap v5780: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:58:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:11 smithi057 ceph-mon[92072]: pgmap v5781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:58:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:11 smithi122 ceph-mon[125440]: pgmap v5781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:58:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:11 smithi136 ceph-mon[125702]: pgmap v5781: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:58:12.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:12.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:58:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:12.333+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:58:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:12.333+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:58:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:12.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:58:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:12.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:58:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:12 smithi122 ceph-mon[125440]: osdmap e433: 12 total, 12 up, 12 in 2023-03-02T13:58:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:12 smithi136 ceph-mon[125702]: osdmap e433: 12 total, 12 up, 12 in 2023-03-02T13:58:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:12 smithi057 ceph-mon[92072]: osdmap e433: 12 total, 12 up, 12 in 2023-03-02T13:58:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:13 smithi122 ceph-mon[125440]: pgmap v5783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:58:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:13 smithi136 ceph-mon[125702]: pgmap v5783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:58:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:13 smithi057 ceph-mon[92072]: pgmap v5783: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:58:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:15 smithi122 ceph-mon[125440]: pgmap v5784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:58:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:15 smithi136 ceph-mon[125702]: pgmap v5784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:58:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:15 smithi057 ceph-mon[92072]: pgmap v5784: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:58:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:17 smithi122 ceph-mon[125440]: pgmap v5785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:58:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:17 smithi122 ceph-mon[125440]: osdmap e434: 12 total, 12 up, 12 in 2023-03-02T13:58:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:17 smithi136 ceph-mon[125702]: pgmap v5785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:58:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:17 smithi136 ceph-mon[125702]: osdmap e434: 12 total, 12 up, 12 in 2023-03-02T13:58:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:17 smithi057 ceph-mon[92072]: pgmap v5785: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:58:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:17 smithi057 ceph-mon[92072]: osdmap e434: 12 total, 12 up, 12 in 2023-03-02T13:58:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:19 smithi136 ceph-mon[125702]: pgmap v5787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:58:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:19 smithi057 ceph-mon[92072]: pgmap v5787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:58:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:19 smithi122 ceph-mon[125440]: pgmap v5787: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:58:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:21 smithi136 ceph-mon[125702]: pgmap v5788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 240 B/s wr, 11 op/s 2023-03-02T13:58:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:21 smithi057 ceph-mon[92072]: pgmap v5788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 240 B/s wr, 11 op/s 2023-03-02T13:58:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:21 smithi122 ceph-mon[125440]: pgmap v5788: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 240 B/s wr, 11 op/s 2023-03-02T13:58:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:23 smithi136 ceph-mon[125702]: pgmap v5789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:58:23.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:23 smithi057 ceph-mon[92072]: pgmap v5789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:58:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:23 smithi122 ceph-mon[125440]: pgmap v5789: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:58:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:25 smithi136 ceph-mon[125702]: pgmap v5790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:58:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:25 smithi057 ceph-mon[92072]: pgmap v5790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:58:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:25 smithi122 ceph-mon[125440]: pgmap v5790: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:58:27.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:27.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:58:27.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:27.348+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:58:27.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:27.348+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:58:27.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:27.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:58:27.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:27.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:58:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:27 smithi136 ceph-mon[125702]: pgmap v5791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:58:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:27 smithi057 ceph-mon[92072]: pgmap v5791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:58:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:27 smithi122 ceph-mon[125440]: pgmap v5791: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T13:58:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:29 smithi136 ceph-mon[125702]: pgmap v5792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:58:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:29 smithi057 ceph-mon[92072]: pgmap v5792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:58:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:29 smithi122 ceph-mon[125440]: pgmap v5792: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T13:58:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:31 smithi136 ceph-mon[125702]: pgmap v5793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:31 smithi057 ceph-mon[92072]: pgmap v5793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:31 smithi122 ceph-mon[125440]: pgmap v5793: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:33 smithi136 ceph-mon[125702]: pgmap v5794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:33 smithi057 ceph-mon[92072]: pgmap v5794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:33 smithi122 ceph-mon[125440]: pgmap v5794: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:35 smithi136 ceph-mon[125702]: pgmap v5795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:35 smithi057 ceph-mon[92072]: pgmap v5795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:35 smithi122 ceph-mon[125440]: pgmap v5795: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:37 smithi136 ceph-mon[125702]: pgmap v5796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:37 smithi057 ceph-mon[92072]: pgmap v5796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:37 smithi122 ceph-mon[125440]: pgmap v5796: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:58:38.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:58:38.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:58:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:39 smithi136 ceph-mon[125702]: pgmap v5797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:39.635 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:39 smithi057 ceph-mon[92072]: pgmap v5797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:39 smithi122 ceph-mon[125440]: pgmap v5797: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:41 smithi057 ceph-mon[92072]: pgmap v5798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:41 smithi136 ceph-mon[125702]: pgmap v5798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:41 smithi122 ceph-mon[125440]: pgmap v5798: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:42.362+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:58:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:42.362+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:58:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:42.362+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:58:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:42.362+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:58:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:42.362+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:58:42.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:58:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:58:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:58:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:58:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:58:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:42 smithi136 ceph-mon[125702]: pgmap v5799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:58:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:58:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:58:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:58:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:58:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:42 smithi057 ceph-mon[92072]: pgmap v5799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:42.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:58:42.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:58:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:58:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:58:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:58:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:42 smithi122 ceph-mon[125440]: pgmap v5799: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:44 smithi136 ceph-mon[125702]: pgmap v5800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:45.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:44 smithi057 ceph-mon[92072]: pgmap v5800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:45.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:44 smithi122 ceph-mon[125440]: pgmap v5800: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:46 smithi136 ceph-mon[125702]: pgmap v5801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:46 smithi057 ceph-mon[92072]: pgmap v5801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:47.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:46 smithi122 ceph-mon[125440]: pgmap v5801: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:49.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:48 smithi057 ceph-mon[92072]: pgmap v5802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:49.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:48 smithi122 ceph-mon[125440]: pgmap v5802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:48 smithi136 ceph-mon[125702]: pgmap v5802: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:50 smithi057 ceph-mon[92072]: pgmap v5803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:51.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:50 smithi122 ceph-mon[125440]: pgmap v5803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:50 smithi136 ceph-mon[125702]: pgmap v5803: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:52 smithi057 ceph-mon[92072]: pgmap v5804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:53.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:52 smithi122 ceph-mon[125440]: pgmap v5804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:52 smithi136 ceph-mon[125702]: pgmap v5804: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:54 smithi057 ceph-mon[92072]: pgmap v5805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:55.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:54 smithi122 ceph-mon[125440]: pgmap v5805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:54 smithi136 ceph-mon[125702]: pgmap v5805: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:56 smithi057 ceph-mon[92072]: pgmap v5806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:57.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:56 smithi122 ceph-mon[125440]: pgmap v5806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:56 smithi136 ceph-mon[125702]: pgmap v5806: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:58:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:57.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:58:57.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:57.377+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:58:57.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:57.377+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:58:57.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:57.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:58:57.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:58:57.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:58:59.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:58:58 smithi057 ceph-mon[92072]: pgmap v5807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:59.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:58:58 smithi122 ceph-mon[125440]: pgmap v5807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:58:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:58:58 smithi136 ceph-mon[125702]: pgmap v5807: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:01.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:00 smithi057 ceph-mon[92072]: pgmap v5808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:01.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:00 smithi122 ceph-mon[125440]: pgmap v5808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:00 smithi136 ceph-mon[125702]: pgmap v5808: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:02 smithi057 ceph-mon[92072]: pgmap v5809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:59:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:02 smithi122 ceph-mon[125440]: pgmap v5809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:59:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:02 smithi136 ceph-mon[125702]: pgmap v5809: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T13:59:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:04 smithi057 ceph-mon[92072]: pgmap v5810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:59:05.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:04 smithi122 ceph-mon[125440]: pgmap v5810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:59:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:04 smithi136 ceph-mon[125702]: pgmap v5810: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:59:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:06 smithi122 ceph-mon[125440]: pgmap v5811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:59:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:06 smithi122 ceph-mon[125440]: osdmap e435: 12 total, 12 up, 12 in 2023-03-02T13:59:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:06 smithi136 ceph-mon[125702]: pgmap v5811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:59:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:06 smithi136 ceph-mon[125702]: osdmap e435: 12 total, 12 up, 12 in 2023-03-02T13:59:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:06 smithi057 ceph-mon[92072]: pgmap v5811: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T13:59:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:06 smithi057 ceph-mon[92072]: osdmap e435: 12 total, 12 up, 12 in 2023-03-02T13:59:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:08.390+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T13:59:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:08.390+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T13:59:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:08.390+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5870030000 tx=0x7f58700ab050 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:59:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:08.390+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5870030000 tx=0x7f58700ab050 comp rx=0 tx=0).stop 2023-03-02T13:59:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:08.390+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T13:59:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:08.390+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T13:59:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:08.390+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T13:59:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:08.390+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809cc70 0x7f586809d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T13:59:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:08.390+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809cc70 0x7f586809d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:59:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:08.391+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809cc70 0x7f586809d040 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f587004a0b0 tx=0x7f5870074070 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T13:59:09.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:08 smithi122 ceph-mon[125440]: pgmap v5813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:59:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:08 smithi136 ceph-mon[125702]: pgmap v5813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:59:09.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:08 smithi057 ceph-mon[92072]: pgmap v5813: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:59:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:09.910+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:59:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:09.910+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:59:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:09.910+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 87 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T13:59:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:09.910+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 86 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T13:59:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:10 smithi122 ceph-mon[125440]: pgmap v5814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:59:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:10 smithi136 ceph-mon[125702]: pgmap v5814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:59:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:10 smithi057 ceph-mon[92072]: pgmap v5814: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T13:59:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:12.393+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:59:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:12.393+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:59:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:12.393+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:59:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:12.393+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:59:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:12.393+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:59:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:12 smithi057 ceph-mon[92072]: pgmap v5815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:59:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:12 smithi057 ceph-mon[92072]: osdmap e436: 12 total, 12 up, 12 in 2023-03-02T13:59:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:12 smithi122 ceph-mon[125440]: pgmap v5815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:59:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:12 smithi122 ceph-mon[125440]: osdmap e436: 12 total, 12 up, 12 in 2023-03-02T13:59:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:12 smithi136 ceph-mon[125702]: pgmap v5815: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T13:59:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:12 smithi136 ceph-mon[125702]: osdmap e436: 12 total, 12 up, 12 in 2023-03-02T13:59:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:14 smithi057 ceph-mon[92072]: pgmap v5817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:59:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:14 smithi122 ceph-mon[125440]: pgmap v5817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:59:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:14 smithi136 ceph-mon[125702]: pgmap v5817: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T13:59:17.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:16 smithi057 ceph-mon[92072]: pgmap v5818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:59:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:16 smithi122 ceph-mon[125440]: pgmap v5818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:59:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:16 smithi136 ceph-mon[125702]: pgmap v5818: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T13:59:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:18 smithi057 ceph-mon[92072]: pgmap v5819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:59:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:18 smithi122 ceph-mon[125440]: pgmap v5819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:18 smithi136 ceph-mon[125702]: pgmap v5819: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:59:21.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:20 smithi057 ceph-mon[92072]: pgmap v5820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:59:21.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:20 smithi122 ceph-mon[125440]: pgmap v5820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:59:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:20 smithi136 ceph-mon[125702]: pgmap v5820: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T13:59:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:22 smithi057 ceph-mon[92072]: pgmap v5821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:59:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:22 smithi122 ceph-mon[125440]: pgmap v5821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:59:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:22 smithi136 ceph-mon[125702]: pgmap v5821: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T13:59:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:24 smithi057 ceph-mon[92072]: pgmap v5822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:25.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:24 smithi122 ceph-mon[125440]: pgmap v5822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:24 smithi136 ceph-mon[125702]: pgmap v5822: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:27.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:26 smithi122 ceph-mon[125440]: pgmap v5823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:26 smithi136 ceph-mon[125702]: pgmap v5823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:27.408+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:59:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:27.409+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:59:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:27.409+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:59:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:27.409+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:59:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:27.409+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:59:27.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:26 smithi057 ceph-mon[92072]: pgmap v5823: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:29.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:28 smithi122 ceph-mon[125440]: pgmap v5824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:28 smithi136 ceph-mon[125702]: pgmap v5824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:28 smithi057 ceph-mon[92072]: pgmap v5824: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:31.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:30 smithi122 ceph-mon[125440]: pgmap v5825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:30 smithi136 ceph-mon[125702]: pgmap v5825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:30 smithi057 ceph-mon[92072]: pgmap v5825: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:33.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:32 smithi122 ceph-mon[125440]: pgmap v5826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:32 smithi136 ceph-mon[125702]: pgmap v5826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:32 smithi057 ceph-mon[92072]: pgmap v5826: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:35.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:34 smithi122 ceph-mon[125440]: pgmap v5827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:34 smithi136 ceph-mon[125702]: pgmap v5827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:34 smithi057 ceph-mon[92072]: pgmap v5827: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:36 smithi136 ceph-mon[125702]: pgmap v5828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:37.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:36 smithi057 ceph-mon[92072]: pgmap v5828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:36 smithi122 ceph-mon[125440]: pgmap v5828: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:38 smithi136 ceph-mon[125702]: pgmap v5829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:39.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:38 smithi057 ceph-mon[92072]: pgmap v5829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:38 smithi122 ceph-mon[125440]: pgmap v5829: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:40 smithi136 ceph-mon[125702]: pgmap v5830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:40 smithi057 ceph-mon[92072]: pgmap v5830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:40 smithi122 ceph-mon[125440]: pgmap v5830: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:59:42.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:42.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:59:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:42.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:59:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:42.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:59:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:42.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:59:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:42.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:59:42.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:59:42.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T13:59:43.274 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:42 smithi122 ceph-mon[125440]: pgmap v5831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:42 smithi136 ceph-mon[125702]: pgmap v5831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:43.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:42 smithi057 ceph-mon[92072]: pgmap v5831: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:45.275 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:44 smithi122 ceph-mon[125440]: pgmap v5832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:44 smithi136 ceph-mon[125702]: pgmap v5832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:45.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:44 smithi057 ceph-mon[92072]: pgmap v5832: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:46.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:46.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:46.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:46 smithi136 ceph-mon[125702]: pgmap v5833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:46 smithi057 ceph-mon[92072]: pgmap v5833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:46.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:46.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:46 smithi122 ceph-mon[125440]: pgmap v5833: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:49.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:48 smithi057 ceph-mon[92072]: pgmap v5834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:49.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:48 smithi122 ceph-mon[125440]: pgmap v5834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:48 smithi136 ceph-mon[125702]: pgmap v5834: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:51.032 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:50 smithi136 ceph-mon[125702]: pgmap v5835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:51.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:50 smithi057 ceph-mon[92072]: pgmap v5835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:50 smithi122 ceph-mon[125440]: pgmap v5835: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:59:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:59:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:59:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:59:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:52.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T13:59:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T13:59:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T13:59:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:53 smithi136 ceph-mon[125702]: pgmap v5836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:53 smithi057 ceph-mon[92072]: pgmap v5836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:53 smithi122 ceph-mon[125440]: pgmap v5836: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:55 smithi136 ceph-mon[125702]: pgmap v5837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:55 smithi057 ceph-mon[92072]: pgmap v5837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:55.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:55 smithi122 ceph-mon[125440]: pgmap v5837: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:57 smithi136 ceph-mon[125702]: pgmap v5838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:57 smithi057 ceph-mon[92072]: pgmap v5838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:57.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T13:59:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:57.441+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T13:59:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:57.441+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T13:59:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:57.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T13:59:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T13:59:57.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T13:59:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:57 smithi122 ceph-mon[125440]: pgmap v5838: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T13:59:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 13:59:59 smithi136 ceph-mon[125702]: pgmap v5839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:59.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 13:59:59 smithi057 ceph-mon[92072]: pgmap v5839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T13:59:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 13:59:59 smithi122 ceph-mon[125440]: pgmap v5839: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T14:00:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T14:00:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T14:00:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:01 smithi136 ceph-mon[125702]: pgmap v5840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:01.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:01 smithi057 ceph-mon[92072]: pgmap v5840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:01 smithi122 ceph-mon[125440]: pgmap v5840: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:03 smithi136 ceph-mon[125702]: pgmap v5841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:00:03.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:03 smithi057 ceph-mon[92072]: pgmap v5841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:00:03.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:03 smithi122 ceph-mon[125440]: pgmap v5841: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:00:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:05 smithi136 ceph-mon[125702]: pgmap v5842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:00:05.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:05 smithi057 ceph-mon[92072]: pgmap v5842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:00:05.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:05 smithi122 ceph-mon[125440]: pgmap v5842: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:00:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:07 smithi136 ceph-mon[125702]: pgmap v5843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:00:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:07 smithi136 ceph-mon[125702]: osdmap e437: 12 total, 12 up, 12 in 2023-03-02T14:00:07.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:07 smithi057 ceph-mon[92072]: pgmap v5843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:00:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:07 smithi057 ceph-mon[92072]: osdmap e437: 12 total, 12 up, 12 in 2023-03-02T14:00:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:07 smithi122 ceph-mon[125440]: pgmap v5843: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:00:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:07 smithi122 ceph-mon[125440]: osdmap e437: 12 total, 12 up, 12 in 2023-03-02T14:00:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:09 smithi136 ceph-mon[125702]: pgmap v5845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:00:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:09 smithi057 ceph-mon[92072]: pgmap v5845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:00:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:09 smithi122 ceph-mon[125440]: pgmap v5845: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:00:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:11 smithi136 ceph-mon[125702]: pgmap v5846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:00:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:11 smithi057 ceph-mon[92072]: pgmap v5846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:00:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:11 smithi122 ceph-mon[125440]: pgmap v5846: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:00:12.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:12.456+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:00:12.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:12.457+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:00:12.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:12.457+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:00:12.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:12.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:00:12.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:12.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:00:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:12 smithi057 ceph-mon[92072]: pgmap v5847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:00:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:12 smithi057 ceph-mon[92072]: osdmap e438: 12 total, 12 up, 12 in 2023-03-02T14:00:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:12 smithi122 ceph-mon[125440]: pgmap v5847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:00:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:12 smithi122 ceph-mon[125440]: osdmap e438: 12 total, 12 up, 12 in 2023-03-02T14:00:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:12 smithi136 ceph-mon[125702]: pgmap v5847: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:00:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:12 smithi136 ceph-mon[125702]: osdmap e438: 12 total, 12 up, 12 in 2023-03-02T14:00:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:14 smithi057 ceph-mon[92072]: pgmap v5849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:00:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:14 smithi122 ceph-mon[125440]: pgmap v5849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:00:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:14 smithi136 ceph-mon[125702]: pgmap v5849: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:00:17.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:16 smithi057 ceph-mon[92072]: pgmap v5850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:00:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:16 smithi122 ceph-mon[125440]: pgmap v5850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:00:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:16 smithi136 ceph-mon[125702]: pgmap v5850: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:00:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:18 smithi057 ceph-mon[92072]: pgmap v5851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:00:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:18 smithi122 ceph-mon[125440]: pgmap v5851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:00:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:18 smithi136 ceph-mon[125702]: pgmap v5851: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:00:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:20 smithi057 ceph-mon[92072]: pgmap v5852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:00:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:20 smithi122 ceph-mon[125440]: pgmap v5852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:00:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:20 smithi136 ceph-mon[125702]: pgmap v5852: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:00:23.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:22 smithi057 ceph-mon[92072]: pgmap v5853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:00:23.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:22 smithi122 ceph-mon[125440]: pgmap v5853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:00:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:22 smithi136 ceph-mon[125702]: pgmap v5853: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:00:25.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:24 smithi122 ceph-mon[125440]: pgmap v5854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:00:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:24 smithi136 ceph-mon[125702]: pgmap v5854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:00:25.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:24 smithi057 ceph-mon[92072]: pgmap v5854: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:00:27.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:26 smithi122 ceph-mon[125440]: pgmap v5855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:26 smithi136 ceph-mon[125702]: pgmap v5855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:00:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:26 smithi057 ceph-mon[92072]: pgmap v5855: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:00:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:27.468+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:00:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:27.469+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:00:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:27.469+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:00:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:27.469+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:00:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:27.469+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:00:29.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:28 smithi122 ceph-mon[125440]: pgmap v5856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:28 smithi136 ceph-mon[125702]: pgmap v5856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:29.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:28 smithi057 ceph-mon[92072]: pgmap v5856: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:31.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:30 smithi122 ceph-mon[125440]: pgmap v5857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:00:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:30 smithi136 ceph-mon[125702]: pgmap v5857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:00:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:30 smithi057 ceph-mon[92072]: pgmap v5857: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:00:33.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:32 smithi122 ceph-mon[125440]: pgmap v5858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:32 smithi136 ceph-mon[125702]: pgmap v5858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:32 smithi057 ceph-mon[92072]: pgmap v5858: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:34 smithi136 ceph-mon[125702]: pgmap v5859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:35.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:34 smithi057 ceph-mon[92072]: pgmap v5859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:34 smithi122 ceph-mon[125440]: pgmap v5859: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:36 smithi136 ceph-mon[125702]: pgmap v5860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:36 smithi057 ceph-mon[92072]: pgmap v5860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:36 smithi122 ceph-mon[125440]: pgmap v5860: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:38 smithi136 ceph-mon[125702]: pgmap v5861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:38 smithi057 ceph-mon[92072]: pgmap v5861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:38 smithi122 ceph-mon[125440]: pgmap v5861: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:39.922+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:39.922+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:39.922+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 87 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:00:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:39.922+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 88 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:00:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:40 smithi136 ceph-mon[125702]: pgmap v5862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:40 smithi057 ceph-mon[92072]: pgmap v5862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:40 smithi122 ceph-mon[125440]: pgmap v5862: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:42.479+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:00:42.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:42.479+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:00:42.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:42.479+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:00:42.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:42.479+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:00:42.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:42.479+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:00:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:42 smithi136 ceph-mon[125702]: pgmap v5863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:42 smithi057 ceph-mon[92072]: pgmap v5863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:42 smithi122 ceph-mon[125440]: pgmap v5863: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:44 smithi136 ceph-mon[125702]: pgmap v5864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:45.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:44 smithi057 ceph-mon[92072]: pgmap v5864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:44 smithi122 ceph-mon[125440]: pgmap v5864: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:46 smithi136 ceph-mon[125702]: pgmap v5865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:46 smithi057 ceph-mon[92072]: pgmap v5865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:46 smithi122 ceph-mon[125440]: pgmap v5865: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:48 smithi136 ceph-mon[125702]: pgmap v5866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:49.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:48 smithi057 ceph-mon[92072]: pgmap v5866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:48 smithi122 ceph-mon[125440]: pgmap v5866: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:50 smithi136 ceph-mon[125702]: pgmap v5867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:51.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:50 smithi057 ceph-mon[92072]: pgmap v5867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:50 smithi122 ceph-mon[125440]: pgmap v5867: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:00:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:00:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:00:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:00:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:00:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:00:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:00:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:00:52.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:00:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:00:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:00:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:00:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:52 smithi136 ceph-mon[125702]: pgmap v5868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:52 smithi057 ceph-mon[92072]: pgmap v5868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:52 smithi122 ceph-mon[125440]: pgmap v5868: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:55 smithi136 ceph-mon[125702]: pgmap v5869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:55.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:55 smithi057 ceph-mon[92072]: pgmap v5869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:55.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:55 smithi122 ceph-mon[125440]: pgmap v5869: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:57 smithi136 ceph-mon[125702]: pgmap v5870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:57 smithi057 ceph-mon[92072]: pgmap v5870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:57 smithi122 ceph-mon[125440]: pgmap v5870: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:00:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:57.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:00:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:57.493+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:00:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:57.493+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:00:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:57.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:00:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:00:57.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:00:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:00:59 smithi136 ceph-mon[125702]: pgmap v5871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:00:59 smithi057 ceph-mon[92072]: pgmap v5871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:00:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:00:59 smithi122 ceph-mon[125440]: pgmap v5871: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:01 smithi136 ceph-mon[125702]: pgmap v5872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:01.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:01 smithi057 ceph-mon[92072]: pgmap v5872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:01 smithi122 ceph-mon[125440]: pgmap v5872: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:03 smithi136 ceph-mon[125702]: pgmap v5873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:01:03.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:03 smithi057 ceph-mon[92072]: pgmap v5873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:01:03.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:03 smithi122 ceph-mon[125440]: pgmap v5873: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:01:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:05 smithi136 ceph-mon[125702]: pgmap v5874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:01:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:05 smithi057 ceph-mon[92072]: pgmap v5874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:01:05.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:05 smithi122 ceph-mon[125440]: pgmap v5874: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:01:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:07 smithi136 ceph-mon[125702]: pgmap v5875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:01:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:07 smithi057 ceph-mon[92072]: pgmap v5875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:01:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:07 smithi122 ceph-mon[125440]: pgmap v5875: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:01:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:09 smithi136 ceph-mon[125702]: pgmap v5876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:01:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:09 smithi057 ceph-mon[92072]: pgmap v5876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:01:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:09 smithi122 ceph-mon[125440]: pgmap v5876: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:01:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:11 smithi136 ceph-mon[125702]: pgmap v5877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:01:11.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:11 smithi057 ceph-mon[92072]: pgmap v5877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:01:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:11 smithi122 ceph-mon[125440]: pgmap v5877: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:01:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:12 smithi136 ceph-mon[125702]: osdmap e439: 12 total, 12 up, 12 in 2023-03-02T14:01:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:12 smithi057 ceph-mon[92072]: osdmap e439: 12 total, 12 up, 12 in 2023-03-02T14:01:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:12 smithi122 ceph-mon[125440]: osdmap e439: 12 total, 12 up, 12 in 2023-03-02T14:01:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:12.505+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:01:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:12.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:01:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:12.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:01:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:12.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:01:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:12.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:01:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:13 smithi136 ceph-mon[125702]: pgmap v5879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:13.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:13 smithi057 ceph-mon[92072]: pgmap v5879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:13 smithi122 ceph-mon[125440]: pgmap v5879: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:15 smithi136 ceph-mon[125702]: pgmap v5880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:15.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:15 smithi057 ceph-mon[92072]: pgmap v5880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:15 smithi122 ceph-mon[125440]: pgmap v5880: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:17 smithi136 ceph-mon[125702]: pgmap v5881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:17 smithi136 ceph-mon[125702]: osdmap e440: 12 total, 12 up, 12 in 2023-03-02T14:01:17.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:17 smithi057 ceph-mon[92072]: pgmap v5881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:17 smithi057 ceph-mon[92072]: osdmap e440: 12 total, 12 up, 12 in 2023-03-02T14:01:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:17 smithi122 ceph-mon[125440]: pgmap v5881: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:17 smithi122 ceph-mon[125440]: osdmap e440: 12 total, 12 up, 12 in 2023-03-02T14:01:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:19 smithi136 ceph-mon[125702]: pgmap v5883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:01:19.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:19 smithi057 ceph-mon[92072]: pgmap v5883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:01:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:19 smithi122 ceph-mon[125440]: pgmap v5883: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:01:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:21 smithi136 ceph-mon[125702]: pgmap v5884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 352 B/s wr, 12 op/s 2023-03-02T14:01:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:21 smithi057 ceph-mon[92072]: pgmap v5884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 352 B/s wr, 12 op/s 2023-03-02T14:01:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:21 smithi122 ceph-mon[125440]: pgmap v5884: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 352 B/s wr, 12 op/s 2023-03-02T14:01:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:23 smithi136 ceph-mon[125702]: pgmap v5885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:23 smithi057 ceph-mon[92072]: pgmap v5885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:23 smithi122 ceph-mon[125440]: pgmap v5885: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:25 smithi136 ceph-mon[125702]: pgmap v5886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:25 smithi057 ceph-mon[92072]: pgmap v5886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:25 smithi122 ceph-mon[125440]: pgmap v5886: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:27 smithi057 ceph-mon[92072]: pgmap v5887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:27 smithi122 ceph-mon[125440]: pgmap v5887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:27.513 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:27.513+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:01:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:27.514+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:01:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:27.514+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:01:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:27.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:01:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:27.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:01:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:27 smithi136 ceph-mon[125702]: pgmap v5887: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:01:29.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:29 smithi057 ceph-mon[92072]: pgmap v5888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:01:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:29 smithi122 ceph-mon[125440]: pgmap v5888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:01:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:29 smithi136 ceph-mon[125702]: pgmap v5888: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:01:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:31 smithi057 ceph-mon[92072]: pgmap v5889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:31 smithi122 ceph-mon[125440]: pgmap v5889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:31 smithi136 ceph-mon[125702]: pgmap v5889: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:33 smithi057 ceph-mon[92072]: pgmap v5890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:33 smithi122 ceph-mon[125440]: pgmap v5890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:33 smithi136 ceph-mon[125702]: pgmap v5890: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:35 smithi057 ceph-mon[92072]: pgmap v5891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:35 smithi122 ceph-mon[125440]: pgmap v5891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:35 smithi136 ceph-mon[125702]: pgmap v5891: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:37 smithi057 ceph-mon[92072]: pgmap v5892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:37 smithi122 ceph-mon[125440]: pgmap v5892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:37 smithi136 ceph-mon[125702]: pgmap v5892: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:39.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:39 smithi057 ceph-mon[92072]: pgmap v5893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:39 smithi122 ceph-mon[125440]: pgmap v5893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:39 smithi136 ceph-mon[125702]: pgmap v5893: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:41 smithi057 ceph-mon[92072]: pgmap v5894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:41 smithi122 ceph-mon[125440]: pgmap v5894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:41 smithi136 ceph-mon[125702]: pgmap v5894: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:42.520+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:01:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:42.520+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:01:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:42.520+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:01:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:42.520+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:01:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:42.520+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:01:43.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:43 smithi057 ceph-mon[92072]: pgmap v5895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:43 smithi122 ceph-mon[125440]: pgmap v5895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:43 smithi136 ceph-mon[125702]: pgmap v5895: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:45.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:45 smithi057 ceph-mon[92072]: pgmap v5896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:45 smithi122 ceph-mon[125440]: pgmap v5896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:45 smithi136 ceph-mon[125702]: pgmap v5896: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:47.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:47 smithi057 ceph-mon[92072]: pgmap v5897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:47 smithi122 ceph-mon[125440]: pgmap v5897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:47 smithi136 ceph-mon[125702]: pgmap v5897: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:49 smithi057 ceph-mon[92072]: pgmap v5898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:49 smithi122 ceph-mon[125440]: pgmap v5898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:49 smithi136 ceph-mon[125702]: pgmap v5898: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:51.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:51 smithi057 ceph-mon[92072]: pgmap v5899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:51 smithi122 ceph-mon[125440]: pgmap v5899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:51 smithi136 ceph-mon[125702]: pgmap v5899: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:53.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:52 smithi122 ceph-mon[125440]: pgmap v5900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:01:53.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:52 smithi136 ceph-mon[125702]: pgmap v5900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:53.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:01:53.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:52 smithi057 ceph-mon[92072]: pgmap v5900: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:01:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:01:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:01:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:01:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:01:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:01:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:01:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:01:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:55 smithi136 ceph-mon[125702]: pgmap v5901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:55 smithi057 ceph-mon[92072]: pgmap v5901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:55 smithi122 ceph-mon[125440]: pgmap v5901: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:57.526+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:01:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:57.526+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:01:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:57.526+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:01:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:57.526+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:01:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:01:57.526+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:01:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:57 smithi057 ceph-mon[92072]: pgmap v5902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:57 smithi122 ceph-mon[125440]: pgmap v5902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:57 smithi136 ceph-mon[125702]: pgmap v5902: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:01:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:01:59 smithi057 ceph-mon[92072]: pgmap v5903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:01:59 smithi122 ceph-mon[125440]: pgmap v5903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:01:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:01:59 smithi136 ceph-mon[125702]: pgmap v5903: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:01 smithi057 ceph-mon[92072]: pgmap v5904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:01 smithi122 ceph-mon[125440]: pgmap v5904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:01 smithi136 ceph-mon[125702]: pgmap v5904: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:03 smithi057 ceph-mon[92072]: pgmap v5905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:02:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:03 smithi122 ceph-mon[125440]: pgmap v5905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:02:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:03 smithi136 ceph-mon[125702]: pgmap v5905: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:02:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:05 smithi057 ceph-mon[92072]: pgmap v5906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:02:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:05 smithi122 ceph-mon[125440]: pgmap v5906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:02:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:05 smithi136 ceph-mon[125702]: pgmap v5906: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:02:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:07 smithi057 ceph-mon[92072]: pgmap v5907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:02:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:07 smithi122 ceph-mon[125440]: pgmap v5907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:02:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:07 smithi136 ceph-mon[125702]: pgmap v5907: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:02:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:09 smithi057 ceph-mon[92072]: pgmap v5908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:02:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:09 smithi122 ceph-mon[125440]: pgmap v5908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:02:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:09 smithi136 ceph-mon[125702]: pgmap v5908: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:02:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:09.935+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:02:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:09.935+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:02:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:09.935+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 88 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:02:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:09.935+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 89 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:02:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:11 smithi057 ceph-mon[92072]: pgmap v5909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:02:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:11 smithi057 ceph-mon[92072]: osdmap e441: 12 total, 12 up, 12 in 2023-03-02T14:02:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:11 smithi122 ceph-mon[125440]: pgmap v5909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:02:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:11 smithi122 ceph-mon[125440]: osdmap e441: 12 total, 12 up, 12 in 2023-03-02T14:02:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:11 smithi136 ceph-mon[125702]: pgmap v5909: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:02:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:11 smithi136 ceph-mon[125702]: osdmap e441: 12 total, 12 up, 12 in 2023-03-02T14:02:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:12.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:02:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:12.541+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:02:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:12.541+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:02:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:12.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:02:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:12.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:02:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:13 smithi057 ceph-mon[92072]: pgmap v5911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:02:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:13 smithi122 ceph-mon[125440]: pgmap v5911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:02:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:13 smithi136 ceph-mon[125702]: pgmap v5911: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:02:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:14 smithi057 ceph-mon[92072]: pgmap v5912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:02:14.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:14 smithi122 ceph-mon[125440]: pgmap v5912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:02:14.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:14 smithi136 ceph-mon[125702]: pgmap v5912: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:02:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:16 smithi136 ceph-mon[125702]: pgmap v5913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:02:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:16 smithi057 ceph-mon[92072]: pgmap v5913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:02:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:16 smithi122 ceph-mon[125440]: pgmap v5913: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:02:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:17 smithi122 ceph-mon[125440]: osdmap e442: 12 total, 12 up, 12 in 2023-03-02T14:02:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:17 smithi136 ceph-mon[125702]: osdmap e442: 12 total, 12 up, 12 in 2023-03-02T14:02:18.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:17 smithi057 ceph-mon[92072]: osdmap e442: 12 total, 12 up, 12 in 2023-03-02T14:02:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:18 smithi136 ceph-mon[125702]: pgmap v5915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:02:19.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:18 smithi057 ceph-mon[92072]: pgmap v5915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:02:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:18 smithi122 ceph-mon[125440]: pgmap v5915: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:02:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:20 smithi136 ceph-mon[125702]: pgmap v5916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 217 B/s wr, 11 op/s 2023-03-02T14:02:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:20 smithi057 ceph-mon[92072]: pgmap v5916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 217 B/s wr, 11 op/s 2023-03-02T14:02:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:20 smithi122 ceph-mon[125440]: pgmap v5916: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 217 B/s wr, 11 op/s 2023-03-02T14:02:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:22 smithi136 ceph-mon[125702]: pgmap v5917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:02:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:22 smithi057 ceph-mon[92072]: pgmap v5917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:02:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:22 smithi122 ceph-mon[125440]: pgmap v5917: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:02:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:24 smithi136 ceph-mon[125702]: pgmap v5918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:02:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:24 smithi057 ceph-mon[92072]: pgmap v5918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:02:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:24 smithi122 ceph-mon[125440]: pgmap v5918: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:02:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:26 smithi136 ceph-mon[125702]: pgmap v5919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:02:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:26 smithi057 ceph-mon[92072]: pgmap v5919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:02:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:26 smithi122 ceph-mon[125440]: pgmap v5919: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:02:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:27.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:02:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:27.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:02:27.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:27.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:02:27.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:27.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:02:27.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:27.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:02:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:28 smithi136 ceph-mon[125702]: pgmap v5920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:02:29.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:28 smithi057 ceph-mon[92072]: pgmap v5920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:02:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:28 smithi122 ceph-mon[125440]: pgmap v5920: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:02:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:31 smithi136 ceph-mon[125702]: pgmap v5921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:31 smithi057 ceph-mon[92072]: pgmap v5921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:31 smithi122 ceph-mon[125440]: pgmap v5921: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:33 smithi136 ceph-mon[125702]: pgmap v5922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:33 smithi057 ceph-mon[92072]: pgmap v5922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:33 smithi122 ceph-mon[125440]: pgmap v5922: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:35 smithi136 ceph-mon[125702]: pgmap v5923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:35.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:35 smithi057 ceph-mon[92072]: pgmap v5923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:35 smithi122 ceph-mon[125440]: pgmap v5923: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:37 smithi136 ceph-mon[125702]: pgmap v5924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:37.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:37 smithi057 ceph-mon[92072]: pgmap v5924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:37 smithi122 ceph-mon[125440]: pgmap v5924: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:39 smithi136 ceph-mon[125702]: pgmap v5925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:39 smithi057 ceph-mon[92072]: pgmap v5925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:39 smithi122 ceph-mon[125440]: pgmap v5925: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:41 smithi136 ceph-mon[125702]: pgmap v5926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:41 smithi057 ceph-mon[92072]: pgmap v5926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:41 smithi122 ceph-mon[125440]: pgmap v5926: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:42.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:02:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:42.567+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:02:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:42.567+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:02:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:42.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:02:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:42.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:02:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:43 smithi136 ceph-mon[125702]: pgmap v5927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:43.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:43 smithi057 ceph-mon[92072]: pgmap v5927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:43 smithi122 ceph-mon[125440]: pgmap v5927: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:45 smithi136 ceph-mon[125702]: pgmap v5928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:45 smithi057 ceph-mon[92072]: pgmap v5928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:45 smithi122 ceph-mon[125440]: pgmap v5928: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:47 smithi136 ceph-mon[125702]: pgmap v5929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:47 smithi057 ceph-mon[92072]: pgmap v5929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:47 smithi122 ceph-mon[125440]: pgmap v5929: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:49 smithi136 ceph-mon[125702]: pgmap v5930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:49 smithi057 ceph-mon[92072]: pgmap v5930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:49 smithi122 ceph-mon[125440]: pgmap v5930: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:51 smithi136 ceph-mon[125702]: pgmap v5931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:51 smithi057 ceph-mon[92072]: pgmap v5931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:51 smithi122 ceph-mon[125440]: pgmap v5931: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:02:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:53 smithi136 ceph-mon[125702]: pgmap v5932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:53.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:53 smithi057 ceph-mon[92072]: pgmap v5932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:53 smithi122 ceph-mon[125440]: pgmap v5932: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:02:54.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:02:54.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:02:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:55 smithi136 ceph-mon[125702]: pgmap v5933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:02:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:55 smithi057 ceph-mon[92072]: pgmap v5933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:02:55.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:55 smithi122 ceph-mon[125440]: pgmap v5933: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:02:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:57 smithi136 ceph-mon[125702]: pgmap v5934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:02:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:57.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:57 smithi057 ceph-mon[92072]: pgmap v5934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:02:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:57 smithi122 ceph-mon[125440]: pgmap v5934: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:02:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:57.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:57.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:02:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:57.583+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:02:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:57.583+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:02:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:57.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:02:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:02:57.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:02:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:58.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T14:02:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:02:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T14:02:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:02:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: pgmap v5935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:02:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:02:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:02:59.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:02:59.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:02:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T14:02:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:02:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T14:02:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:02:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: pgmap v5935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:02:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:02:59.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:02:59.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:02:59.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:02:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:02:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T14:02:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:02:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T14:02:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:02:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: pgmap v5935: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:02:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:02:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:02:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:02:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:02:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:02:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:02:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:03:01.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:01 smithi057 ceph-mon[92072]: pgmap v5936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:03:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:01 smithi122 ceph-mon[125440]: pgmap v5936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:03:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:01 smithi136 ceph-mon[125702]: pgmap v5936: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:03:03.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:03 smithi057 ceph-mon[92072]: pgmap v5937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T14:03:03.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:03 smithi122 ceph-mon[125440]: pgmap v5937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T14:03:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:03 smithi136 ceph-mon[125702]: pgmap v5937: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T14:03:05.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:05 smithi057 ceph-mon[92072]: pgmap v5938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:03:05.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:05 smithi122 ceph-mon[125440]: pgmap v5938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:03:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:05 smithi136 ceph-mon[125702]: pgmap v5938: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:03:07.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:07 smithi057 ceph-mon[92072]: pgmap v5939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:03:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:07 smithi122 ceph-mon[125440]: pgmap v5939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:03:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:07 smithi136 ceph-mon[125702]: pgmap v5939: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:03:09.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:09 smithi057 ceph-mon[92072]: pgmap v5940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:03:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:09 smithi122 ceph-mon[125440]: pgmap v5940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:03:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:09 smithi136 ceph-mon[125702]: pgmap v5940: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:03:11.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:11 smithi057 ceph-mon[92072]: pgmap v5941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:03:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:11 smithi122 ceph-mon[125440]: pgmap v5941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:03:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:11 smithi136 ceph-mon[125702]: pgmap v5941: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:03:12.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:12 smithi057 ceph-mon[92072]: osdmap e443: 12 total, 12 up, 12 in 2023-03-02T14:03:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:12 smithi122 ceph-mon[125440]: osdmap e443: 12 total, 12 up, 12 in 2023-03-02T14:03:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:12 smithi136 ceph-mon[125702]: osdmap e443: 12 total, 12 up, 12 in 2023-03-02T14:03:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:12.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:03:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:12.598+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:03:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:12.598+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:03:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:12.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:03:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:12.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:03:13.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:13 smithi057 ceph-mon[92072]: pgmap v5943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:03:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:13 smithi122 ceph-mon[125440]: pgmap v5943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:03:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:13 smithi136 ceph-mon[125702]: pgmap v5943: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:03:15.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:15 smithi057 ceph-mon[92072]: pgmap v5944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:03:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:15 smithi122 ceph-mon[125440]: pgmap v5944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:03:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:15 smithi136 ceph-mon[125702]: pgmap v5944: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:03:17.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:17 smithi057 ceph-mon[92072]: pgmap v5945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:03:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:17 smithi057 ceph-mon[92072]: osdmap e444: 12 total, 12 up, 12 in 2023-03-02T14:03:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:17 smithi122 ceph-mon[125440]: pgmap v5945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:03:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:17 smithi122 ceph-mon[125440]: osdmap e444: 12 total, 12 up, 12 in 2023-03-02T14:03:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:17 smithi136 ceph-mon[125702]: pgmap v5945: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:03:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:17 smithi136 ceph-mon[125702]: osdmap e444: 12 total, 12 up, 12 in 2023-03-02T14:03:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:19 smithi057 ceph-mon[92072]: pgmap v5947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:03:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:19 smithi122 ceph-mon[125440]: pgmap v5947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:03:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:19 smithi136 ceph-mon[125702]: pgmap v5947: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:03:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:21 smithi122 ceph-mon[125440]: pgmap v5948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T14:03:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:21 smithi136 ceph-mon[125702]: pgmap v5948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T14:03:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:21 smithi057 ceph-mon[92072]: pgmap v5948: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T14:03:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:23 smithi122 ceph-mon[125440]: pgmap v5949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:03:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:23 smithi136 ceph-mon[125702]: pgmap v5949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:03:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:23 smithi057 ceph-mon[92072]: pgmap v5949: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:03:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:25 smithi136 ceph-mon[125702]: pgmap v5950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:03:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:25 smithi057 ceph-mon[92072]: pgmap v5950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:03:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:25 smithi122 ceph-mon[125440]: pgmap v5950: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:03:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:27 smithi136 ceph-mon[125702]: pgmap v5951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:03:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:27.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:03:27.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:27.605+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:03:27.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:27.605+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:03:27.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:27.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:03:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:27.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:03:27.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:27 smithi057 ceph-mon[92072]: pgmap v5951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:03:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:27 smithi122 ceph-mon[125440]: pgmap v5951: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:03:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:29 smithi136 ceph-mon[125702]: pgmap v5952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:03:29.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:29 smithi057 ceph-mon[92072]: pgmap v5952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:03:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:29 smithi122 ceph-mon[125440]: pgmap v5952: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:03:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:31 smithi136 ceph-mon[125702]: pgmap v5953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:31 smithi057 ceph-mon[92072]: pgmap v5953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:31 smithi122 ceph-mon[125440]: pgmap v5953: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:33 smithi136 ceph-mon[125702]: pgmap v5954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:33 smithi057 ceph-mon[92072]: pgmap v5954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:33 smithi122 ceph-mon[125440]: pgmap v5954: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:35 smithi136 ceph-mon[125702]: pgmap v5955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:35.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:35 smithi057 ceph-mon[92072]: pgmap v5955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:35 smithi122 ceph-mon[125440]: pgmap v5955: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:37 smithi136 ceph-mon[125702]: pgmap v5956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:37 smithi057 ceph-mon[92072]: pgmap v5956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:37 smithi122 ceph-mon[125440]: pgmap v5956: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:39 smithi136 ceph-mon[125702]: pgmap v5957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:39 smithi057 ceph-mon[92072]: pgmap v5957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:39 smithi122 ceph-mon[125440]: pgmap v5957: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:41 smithi136 ceph-mon[125702]: pgmap v5958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:41 smithi057 ceph-mon[92072]: pgmap v5958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:41 smithi122 ceph-mon[125440]: pgmap v5958: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:42.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:03:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:42.621+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:03:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:42.621+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:03:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:42.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:03:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:42.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:03:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:43 smithi136 ceph-mon[125702]: pgmap v5959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:43 smithi057 ceph-mon[92072]: pgmap v5959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:43 smithi122 ceph-mon[125440]: pgmap v5959: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:45 smithi136 ceph-mon[125702]: pgmap v5960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:45 smithi057 ceph-mon[92072]: pgmap v5960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:45 smithi122 ceph-mon[125440]: pgmap v5960: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:47 smithi136 ceph-mon[125702]: pgmap v5961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:47 smithi057 ceph-mon[92072]: pgmap v5961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:47 smithi122 ceph-mon[125440]: pgmap v5961: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:49 smithi136 ceph-mon[125702]: pgmap v5962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:49 smithi057 ceph-mon[92072]: pgmap v5962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:49 smithi122 ceph-mon[125440]: pgmap v5962: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:51 smithi136 ceph-mon[125702]: pgmap v5963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:51 smithi057 ceph-mon[92072]: pgmap v5963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:51 smithi122 ceph-mon[125440]: pgmap v5963: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:53 smithi136 ceph-mon[125702]: pgmap v5964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:53 smithi057 ceph-mon[92072]: pgmap v5964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:53 smithi122 ceph-mon[125440]: pgmap v5964: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:55 smithi136 ceph-mon[125702]: pgmap v5965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:55 smithi057 ceph-mon[92072]: pgmap v5965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:55 smithi122 ceph-mon[125440]: pgmap v5965: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:57 smithi136 ceph-mon[125702]: pgmap v5966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:57.635+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:03:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:57.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:03:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:57.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:03:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:57.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:03:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:03:57.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:03:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:57 smithi057 ceph-mon[92072]: pgmap v5966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:57 smithi122 ceph-mon[125440]: pgmap v5966: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:03:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:59 smithi136 ceph-mon[125702]: pgmap v5967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:03:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:03:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:03:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:03:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:03:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:59 smithi057 ceph-mon[92072]: pgmap v5967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:03:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:03:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:03:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:03:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:03:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:59 smithi122 ceph-mon[125440]: pgmap v5967: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:03:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:03:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:03:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:03:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:03:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:04:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:01 smithi136 ceph-mon[125702]: pgmap v5968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:01 smithi057 ceph-mon[92072]: pgmap v5968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:01 smithi122 ceph-mon[125440]: pgmap v5968: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:03 smithi136 ceph-mon[125702]: pgmap v5969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:04:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:03 smithi057 ceph-mon[92072]: pgmap v5969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:04:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:03 smithi122 ceph-mon[125440]: pgmap v5969: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:04:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:05 smithi136 ceph-mon[125702]: pgmap v5970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:04:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:05 smithi057 ceph-mon[92072]: pgmap v5970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:04:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:05 smithi122 ceph-mon[125440]: pgmap v5970: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:04:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:07 smithi136 ceph-mon[125702]: pgmap v5971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:04:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:07 smithi057 ceph-mon[92072]: pgmap v5971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:04:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:07 smithi122 ceph-mon[125440]: pgmap v5971: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:04:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:09 smithi136 ceph-mon[125702]: pgmap v5972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:04:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:09 smithi057 ceph-mon[92072]: pgmap v5972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:04:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:09 smithi122 ceph-mon[125440]: pgmap v5972: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:04:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:11 smithi057 ceph-mon[92072]: pgmap v5973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:04:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:11 smithi057 ceph-mon[92072]: osdmap e445: 12 total, 12 up, 12 in 2023-03-02T14:04:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:11 smithi122 ceph-mon[125440]: pgmap v5973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:04:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:11 smithi122 ceph-mon[125440]: osdmap e445: 12 total, 12 up, 12 in 2023-03-02T14:04:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:11 smithi136 ceph-mon[125702]: pgmap v5973: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:04:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:11 smithi136 ceph-mon[125702]: osdmap e445: 12 total, 12 up, 12 in 2023-03-02T14:04:12.652 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:12.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:04:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:12.653+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:04:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:12.653+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:04:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:12.653+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:04:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:12.653+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:04:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:13 smithi057 ceph-mon[92072]: pgmap v5975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:04:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:13 smithi122 ceph-mon[125440]: pgmap v5975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:04:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:13 smithi136 ceph-mon[125702]: pgmap v5975: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:04:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:15 smithi057 ceph-mon[92072]: pgmap v5976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:04:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:15 smithi122 ceph-mon[125440]: pgmap v5976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:04:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:15 smithi136 ceph-mon[125702]: pgmap v5976: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:04:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:17 smithi057 ceph-mon[92072]: pgmap v5977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:04:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:17 smithi057 ceph-mon[92072]: osdmap e446: 12 total, 12 up, 12 in 2023-03-02T14:04:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:17 smithi122 ceph-mon[125440]: pgmap v5977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:04:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:17 smithi122 ceph-mon[125440]: osdmap e446: 12 total, 12 up, 12 in 2023-03-02T14:04:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:17 smithi136 ceph-mon[125702]: pgmap v5977: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:04:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:17 smithi136 ceph-mon[125702]: osdmap e446: 12 total, 12 up, 12 in 2023-03-02T14:04:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:19 smithi057 ceph-mon[92072]: pgmap v5979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:04:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:19 smithi122 ceph-mon[125440]: pgmap v5979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:04:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:19 smithi136 ceph-mon[125702]: pgmap v5979: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:04:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:21 smithi057 ceph-mon[92072]: pgmap v5980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T14:04:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:21 smithi122 ceph-mon[125440]: pgmap v5980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T14:04:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:21 smithi136 ceph-mon[125702]: pgmap v5980: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T14:04:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:23 smithi057 ceph-mon[92072]: pgmap v5981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:04:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:23 smithi122 ceph-mon[125440]: pgmap v5981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:04:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:23 smithi136 ceph-mon[125702]: pgmap v5981: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:04:25.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:25 smithi057 ceph-mon[92072]: pgmap v5982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:04:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:25 smithi122 ceph-mon[125440]: pgmap v5982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:04:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:25 smithi136 ceph-mon[125702]: pgmap v5982: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:04:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:27.655+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:04:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:27.656+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:04:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:27.656+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:04:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:27.656+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:04:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:27.656+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:04:27.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:27 smithi057 ceph-mon[92072]: pgmap v5983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:04:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:27 smithi122 ceph-mon[125440]: pgmap v5983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:04:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:27 smithi136 ceph-mon[125702]: pgmap v5983: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:04:29.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:29 smithi057 ceph-mon[92072]: pgmap v5984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:04:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:29 smithi122 ceph-mon[125440]: pgmap v5984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:04:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:29 smithi136 ceph-mon[125702]: pgmap v5984: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:04:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:31 smithi057 ceph-mon[92072]: pgmap v5985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:31 smithi122 ceph-mon[125440]: pgmap v5985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:31 smithi136 ceph-mon[125702]: pgmap v5985: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:32 smithi136 ceph-mon[125702]: pgmap v5986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:33.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:32 smithi057 ceph-mon[92072]: pgmap v5986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:32 smithi122 ceph-mon[125440]: pgmap v5986: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:34 smithi136 ceph-mon[125702]: pgmap v5987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:34 smithi057 ceph-mon[92072]: pgmap v5987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:34 smithi122 ceph-mon[125440]: pgmap v5987: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:36 smithi136 ceph-mon[125702]: pgmap v5988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:37.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:36 smithi057 ceph-mon[92072]: pgmap v5988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:36 smithi122 ceph-mon[125440]: pgmap v5988: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:39 smithi136 ceph-mon[125702]: pgmap v5989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:39.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:39 smithi057 ceph-mon[92072]: pgmap v5989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:39 smithi122 ceph-mon[125440]: pgmap v5989: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:41 smithi136 ceph-mon[125702]: pgmap v5990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:41 smithi057 ceph-mon[92072]: pgmap v5990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:41 smithi122 ceph-mon[125440]: pgmap v5990: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:42.671+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:04:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:42.672+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:04:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:42.672+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:04:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:42.672+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:04:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:42.672+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:04:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:43 smithi136 ceph-mon[125702]: pgmap v5991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:43.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:43 smithi057 ceph-mon[92072]: pgmap v5991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:43 smithi122 ceph-mon[125440]: pgmap v5991: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:45 smithi136 ceph-mon[125702]: pgmap v5992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:45.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:45 smithi057 ceph-mon[92072]: pgmap v5992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:45 smithi122 ceph-mon[125440]: pgmap v5992: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:47 smithi136 ceph-mon[125702]: pgmap v5993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:47.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:47 smithi057 ceph-mon[92072]: pgmap v5993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:47 smithi122 ceph-mon[125440]: pgmap v5993: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:49 smithi136 ceph-mon[125702]: pgmap v5994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:49 smithi057 ceph-mon[92072]: pgmap v5994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:49 smithi122 ceph-mon[125440]: pgmap v5994: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:51 smithi136 ceph-mon[125702]: pgmap v5995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:51 smithi057 ceph-mon[92072]: pgmap v5995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:51 smithi122 ceph-mon[125440]: pgmap v5995: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:53 smithi136 ceph-mon[125702]: pgmap v5996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:53 smithi057 ceph-mon[92072]: pgmap v5996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:53 smithi122 ceph-mon[125440]: pgmap v5996: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:55 smithi136 ceph-mon[125702]: pgmap v5997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:55.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:55 smithi057 ceph-mon[92072]: pgmap v5997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:55.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:55 smithi122 ceph-mon[125440]: pgmap v5997: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:57 smithi136 ceph-mon[125702]: pgmap v5998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:57 smithi057 ceph-mon[92072]: pgmap v5998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:57 smithi122 ceph-mon[125440]: pgmap v5998: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:04:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:57.682+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:04:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:57.683+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:04:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:57.683+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:04:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:57.683+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:04:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:04:57.683+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:04:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:04:59 smithi136 ceph-mon[125702]: pgmap v5999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:59.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:04:59 smithi057 ceph-mon[92072]: pgmap v5999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:04:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:04:59 smithi122 ceph-mon[125440]: pgmap v5999: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:05:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:05:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:05:00.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:05:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:05:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:05:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:05:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:05:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:05:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:01 smithi136 ceph-mon[125702]: pgmap v6000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:05:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:05:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:05:01.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:01 smithi057 ceph-mon[92072]: pgmap v6000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:05:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:05:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:05:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:01 smithi122 ceph-mon[125440]: pgmap v6000: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:05:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:05:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:05:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:03 smithi136 ceph-mon[125702]: pgmap v6001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:05:03.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:03 smithi057 ceph-mon[92072]: pgmap v6001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:05:03.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:03 smithi122 ceph-mon[125440]: pgmap v6001: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:05:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:05 smithi136 ceph-mon[125702]: pgmap v6002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:05:05.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:05 smithi057 ceph-mon[92072]: pgmap v6002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:05:05.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:05 smithi122 ceph-mon[125440]: pgmap v6002: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:05:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:07 smithi136 ceph-mon[125702]: pgmap v6003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:05:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:07 smithi057 ceph-mon[92072]: pgmap v6003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:05:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:07 smithi122 ceph-mon[125440]: pgmap v6003: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:05:09.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:09 smithi057 ceph-mon[92072]: pgmap v6004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:05:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:09 smithi122 ceph-mon[125440]: pgmap v6004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:05:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:09 smithi136 ceph-mon[125702]: pgmap v6004: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:05:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:09.961+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:05:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:09.961+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:05:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:09.962+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 89 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:05:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:09.962+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 90 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:05:11.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:11 smithi057 ceph-mon[92072]: pgmap v6005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:05:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:11 smithi122 ceph-mon[125440]: pgmap v6005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:05:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:11 smithi136 ceph-mon[125702]: pgmap v6005: 97 pgs: 97 active+clean; 9.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:05:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:12 smithi057 ceph-mon[92072]: osdmap e447: 12 total, 12 up, 12 in 2023-03-02T14:05:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:12 smithi122 ceph-mon[125440]: osdmap e447: 12 total, 12 up, 12 in 2023-03-02T14:05:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:12 smithi136 ceph-mon[125702]: osdmap e447: 12 total, 12 up, 12 in 2023-03-02T14:05:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:12.691+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:05:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:12.692+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:05:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:12.692+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:05:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:12.692+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:05:12.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:12.692+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:05:13.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:13 smithi057 ceph-mon[92072]: pgmap v6007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:05:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:13 smithi122 ceph-mon[125440]: pgmap v6007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:05:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:13 smithi136 ceph-mon[125702]: pgmap v6007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:05:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:15 smithi057 ceph-mon[92072]: pgmap v6008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:05:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:15 smithi122 ceph-mon[125440]: pgmap v6008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:05:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:15 smithi136 ceph-mon[125702]: pgmap v6008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:05:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:17 smithi057 ceph-mon[92072]: pgmap v6009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:05:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:17 smithi057 ceph-mon[92072]: osdmap e448: 12 total, 12 up, 12 in 2023-03-02T14:05:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:17 smithi122 ceph-mon[125440]: pgmap v6009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:05:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:17 smithi122 ceph-mon[125440]: osdmap e448: 12 total, 12 up, 12 in 2023-03-02T14:05:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:17 smithi136 ceph-mon[125702]: pgmap v6009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:05:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:17 smithi136 ceph-mon[125702]: osdmap e448: 12 total, 12 up, 12 in 2023-03-02T14:05:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:19 smithi057 ceph-mon[92072]: pgmap v6011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:05:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:19 smithi122 ceph-mon[125440]: pgmap v6011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:05:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:19 smithi136 ceph-mon[125702]: pgmap v6011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:05:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:21 smithi057 ceph-mon[92072]: pgmap v6012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T14:05:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:21 smithi122 ceph-mon[125440]: pgmap v6012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T14:05:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:21 smithi136 ceph-mon[125702]: pgmap v6012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T14:05:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:23 smithi057 ceph-mon[92072]: pgmap v6013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:05:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:23 smithi122 ceph-mon[125440]: pgmap v6013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:05:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:23 smithi136 ceph-mon[125702]: pgmap v6013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:05:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:25 smithi057 ceph-mon[92072]: pgmap v6014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:05:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:25 smithi122 ceph-mon[125440]: pgmap v6014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:05:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:25 smithi136 ceph-mon[125702]: pgmap v6014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:05:27.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:27 smithi057 ceph-mon[92072]: pgmap v6015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:05:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:27 smithi122 ceph-mon[125440]: pgmap v6015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:05:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:27 smithi136 ceph-mon[125702]: pgmap v6015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:05:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:27.699+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:05:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:27.699+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:05:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:27.699+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:05:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:27.699+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:05:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:27.699+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:05:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:29 smithi057 ceph-mon[92072]: pgmap v6016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:05:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:29 smithi122 ceph-mon[125440]: pgmap v6016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:05:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:29 smithi136 ceph-mon[125702]: pgmap v6016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:05:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:31 smithi057 ceph-mon[92072]: pgmap v6017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:31 smithi122 ceph-mon[125440]: pgmap v6017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:31 smithi136 ceph-mon[125702]: pgmap v6017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:33.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:33 smithi057 ceph-mon[92072]: pgmap v6018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:33 smithi122 ceph-mon[125440]: pgmap v6018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:33 smithi136 ceph-mon[125702]: pgmap v6018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:35.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:35 smithi057 ceph-mon[92072]: pgmap v6019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:35 smithi122 ceph-mon[125440]: pgmap v6019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:35 smithi136 ceph-mon[125702]: pgmap v6019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:37 smithi057 ceph-mon[92072]: pgmap v6020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:37 smithi122 ceph-mon[125440]: pgmap v6020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:37 smithi136 ceph-mon[125702]: pgmap v6020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:39 smithi122 ceph-mon[125440]: pgmap v6021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:39 smithi136 ceph-mon[125702]: pgmap v6021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:39 smithi057 ceph-mon[92072]: pgmap v6021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:41 smithi122 ceph-mon[125440]: pgmap v6022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:41 smithi136 ceph-mon[125702]: pgmap v6022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:41 smithi057 ceph-mon[92072]: pgmap v6022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:42.703+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:42.704+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:42.704+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:42.704+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:42.704+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:05:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:43 smithi136 ceph-mon[125702]: pgmap v6023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:43 smithi057 ceph-mon[92072]: pgmap v6023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:43 smithi122 ceph-mon[125440]: pgmap v6023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:45 smithi136 ceph-mon[125702]: pgmap v6024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:45 smithi057 ceph-mon[92072]: pgmap v6024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:45 smithi122 ceph-mon[125440]: pgmap v6024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:47 smithi136 ceph-mon[125702]: pgmap v6025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:47 smithi057 ceph-mon[92072]: pgmap v6025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:47 smithi122 ceph-mon[125440]: pgmap v6025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:49 smithi136 ceph-mon[125702]: pgmap v6026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:49.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:49 smithi057 ceph-mon[92072]: pgmap v6026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:49 smithi122 ceph-mon[125440]: pgmap v6026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:51 smithi136 ceph-mon[125702]: pgmap v6027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:51 smithi057 ceph-mon[92072]: pgmap v6027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:51 smithi122 ceph-mon[125440]: pgmap v6027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:53 smithi136 ceph-mon[125702]: pgmap v6028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:53 smithi057 ceph-mon[92072]: pgmap v6028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:53 smithi122 ceph-mon[125440]: pgmap v6028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:55 smithi136 ceph-mon[125702]: pgmap v6029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:55 smithi057 ceph-mon[92072]: pgmap v6029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:55 smithi122 ceph-mon[125440]: pgmap v6029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:57 smithi136 ceph-mon[125702]: pgmap v6030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:57 smithi057 ceph-mon[92072]: pgmap v6030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:57 smithi122 ceph-mon[125440]: pgmap v6030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:05:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:57.719+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:05:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:57.719+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:05:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:57.719+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:05:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:57.719+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:05:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:05:57.719+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:05:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:05:59 smithi136 ceph-mon[125702]: pgmap v6031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:05:59 smithi057 ceph-mon[92072]: pgmap v6031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:05:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:05:59 smithi122 ceph-mon[125440]: pgmap v6031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:01 smithi136 ceph-mon[125702]: pgmap v6032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:06:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:01 smithi057 ceph-mon[92072]: pgmap v6032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:06:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:01 smithi122 ceph-mon[125440]: pgmap v6032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:06:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:03 smithi136 ceph-mon[125702]: pgmap v6033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:06:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:03 smithi057 ceph-mon[92072]: pgmap v6033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:06:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:03 smithi122 ceph-mon[125440]: pgmap v6033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:06:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:06:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:06:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:06:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:06:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:04.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:06:04.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:06:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:06:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:05 smithi136 ceph-mon[125702]: pgmap v6034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:06:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:05 smithi057 ceph-mon[92072]: pgmap v6034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:06:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:05 smithi122 ceph-mon[125440]: pgmap v6034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:06:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:07 smithi136 ceph-mon[125702]: pgmap v6035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:06:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:07 smithi057 ceph-mon[92072]: pgmap v6035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:06:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:07 smithi122 ceph-mon[125440]: pgmap v6035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:06:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:09 smithi136 ceph-mon[125702]: pgmap v6036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:06:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:09 smithi057 ceph-mon[92072]: pgmap v6036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:06:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:09 smithi122 ceph-mon[125440]: pgmap v6036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:06:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:11 smithi136 ceph-mon[125702]: pgmap v6037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:06:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:11 smithi057 ceph-mon[92072]: pgmap v6037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:06:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:11 smithi122 ceph-mon[125440]: pgmap v6037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:06:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:12 smithi136 ceph-mon[125702]: osdmap e449: 12 total, 12 up, 12 in 2023-03-02T14:06:12.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:12 smithi057 ceph-mon[92072]: osdmap e449: 12 total, 12 up, 12 in 2023-03-02T14:06:12.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:12 smithi122 ceph-mon[125440]: osdmap e449: 12 total, 12 up, 12 in 2023-03-02T14:06:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:12.724+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:06:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:12.724+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:06:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:12.724+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:06:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:12.724+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:06:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:12.724+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:06:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:13 smithi136 ceph-mon[125702]: pgmap v6039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:13 smithi057 ceph-mon[92072]: pgmap v6039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:13 smithi122 ceph-mon[125440]: pgmap v6039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:15 smithi136 ceph-mon[125702]: pgmap v6040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:15 smithi057 ceph-mon[92072]: pgmap v6040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:15 smithi122 ceph-mon[125440]: pgmap v6040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:17 smithi136 ceph-mon[125702]: pgmap v6041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:17 smithi057 ceph-mon[92072]: pgmap v6041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:17 smithi122 ceph-mon[125440]: pgmap v6041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:19 smithi136 ceph-mon[125702]: pgmap v6042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:19 smithi057 ceph-mon[92072]: pgmap v6042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:19 smithi122 ceph-mon[125440]: pgmap v6042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:21 smithi136 ceph-mon[125702]: pgmap v6043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:21 smithi057 ceph-mon[92072]: pgmap v6043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:21 smithi122 ceph-mon[125440]: pgmap v6043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:06:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:23 smithi136 ceph-mon[125702]: pgmap v6044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 193 B/s wr, 14 op/s 2023-03-02T14:06:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:23 smithi136 ceph-mon[125702]: osdmap e450: 12 total, 12 up, 12 in 2023-03-02T14:06:23.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:23 smithi057 ceph-mon[92072]: pgmap v6044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 193 B/s wr, 14 op/s 2023-03-02T14:06:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:23 smithi057 ceph-mon[92072]: osdmap e450: 12 total, 12 up, 12 in 2023-03-02T14:06:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:23 smithi122 ceph-mon[125440]: pgmap v6044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 193 B/s wr, 14 op/s 2023-03-02T14:06:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:23 smithi122 ceph-mon[125440]: osdmap e450: 12 total, 12 up, 12 in 2023-03-02T14:06:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:25 smithi136 ceph-mon[125702]: pgmap v6046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:06:25.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:25 smithi057 ceph-mon[92072]: pgmap v6046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:06:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:25 smithi122 ceph-mon[125440]: pgmap v6046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:06:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:27 smithi136 ceph-mon[125702]: pgmap v6047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:06:27.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:27 smithi057 ceph-mon[92072]: pgmap v6047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:06:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:27 smithi122 ceph-mon[125440]: pgmap v6047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:06:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:27.735+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:06:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:27.736+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:06:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:27.736+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:06:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:27.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:06:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:27.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:06:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:29 smithi136 ceph-mon[125702]: pgmap v6048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:06:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:29 smithi057 ceph-mon[92072]: pgmap v6048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:06:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:29 smithi122 ceph-mon[125440]: pgmap v6048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:06:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:31 smithi136 ceph-mon[125702]: pgmap v6049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:06:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:31 smithi057 ceph-mon[92072]: pgmap v6049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:06:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:31 smithi122 ceph-mon[125440]: pgmap v6049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:06:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:33 smithi136 ceph-mon[125702]: pgmap v6050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:06:33.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:33 smithi057 ceph-mon[92072]: pgmap v6050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:06:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:33 smithi122 ceph-mon[125440]: pgmap v6050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:06:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:35 smithi136 ceph-mon[125702]: pgmap v6051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:35 smithi057 ceph-mon[92072]: pgmap v6051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:35 smithi122 ceph-mon[125440]: pgmap v6051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:37 smithi136 ceph-mon[125702]: pgmap v6052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:37.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:37 smithi057 ceph-mon[92072]: pgmap v6052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:37 smithi122 ceph-mon[125440]: pgmap v6052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:39 smithi136 ceph-mon[125702]: pgmap v6053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:39 smithi057 ceph-mon[92072]: pgmap v6053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:39 smithi122 ceph-mon[125440]: pgmap v6053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:41 smithi136 ceph-mon[125702]: pgmap v6054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:41 smithi057 ceph-mon[92072]: pgmap v6054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:41 smithi122 ceph-mon[125440]: pgmap v6054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:42.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:06:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:42.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:06:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:42.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:06:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:42.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:06:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:42.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:06:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:43 smithi136 ceph-mon[125702]: pgmap v6055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:43 smithi057 ceph-mon[92072]: pgmap v6055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:43 smithi122 ceph-mon[125440]: pgmap v6055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:45 smithi136 ceph-mon[125702]: pgmap v6056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:45 smithi057 ceph-mon[92072]: pgmap v6056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:45 smithi122 ceph-mon[125440]: pgmap v6056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:47 smithi136 ceph-mon[125702]: pgmap v6057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:47 smithi057 ceph-mon[92072]: pgmap v6057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:47 smithi122 ceph-mon[125440]: pgmap v6057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:49 smithi136 ceph-mon[125702]: pgmap v6058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:49.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:49 smithi057 ceph-mon[92072]: pgmap v6058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:49 smithi122 ceph-mon[125440]: pgmap v6058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:51 smithi136 ceph-mon[125702]: pgmap v6059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:51.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:51 smithi057 ceph-mon[92072]: pgmap v6059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:51 smithi122 ceph-mon[125440]: pgmap v6059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:53 smithi136 ceph-mon[125702]: pgmap v6060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:53.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:53 smithi057 ceph-mon[92072]: pgmap v6060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:53 smithi122 ceph-mon[125440]: pgmap v6060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:55.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:55 smithi057 ceph-mon[92072]: pgmap v6061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:55.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:55 smithi122 ceph-mon[125440]: pgmap v6061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:55 smithi136 ceph-mon[125702]: pgmap v6061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:57.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:57 smithi057 ceph-mon[92072]: pgmap v6062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:57 smithi122 ceph-mon[125440]: pgmap v6062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:57 smithi136 ceph-mon[125702]: pgmap v6062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:06:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:57.748+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:06:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:57.748+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:06:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:57.748+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:06:57.749 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:57.748+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:06:57.749 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:06:57.748+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:06:59.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:06:59 smithi057 ceph-mon[92072]: pgmap v6063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:06:59 smithi122 ceph-mon[125440]: pgmap v6063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:06:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:06:59 smithi136 ceph-mon[125702]: pgmap v6063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:01 smithi057 ceph-mon[92072]: pgmap v6064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:01 smithi122 ceph-mon[125440]: pgmap v6064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:01 smithi136 ceph-mon[125702]: pgmap v6064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:03.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:03 smithi057 ceph-mon[92072]: pgmap v6065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:07:03.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:03 smithi122 ceph-mon[125440]: pgmap v6065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:07:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:03 smithi136 ceph-mon[125702]: pgmap v6065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:07:04.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:07:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:07:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:07:05.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:05 smithi057 ceph-mon[92072]: pgmap v6066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:07:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:07:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:07:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:07:05.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:05 smithi122 ceph-mon[125440]: pgmap v6066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:07:05.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:07:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:07:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:07:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:05 smithi136 ceph-mon[125702]: pgmap v6066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:07:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:07:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:07:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:07:07.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:07 smithi057 ceph-mon[92072]: pgmap v6067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:07:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:07 smithi122 ceph-mon[125440]: pgmap v6067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:07:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:07 smithi136 ceph-mon[125702]: pgmap v6067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:07:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:09 smithi057 ceph-mon[92072]: pgmap v6068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:07:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:09 smithi122 ceph-mon[125440]: pgmap v6068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:07:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:09 smithi136 ceph-mon[125702]: pgmap v6068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:07:11.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:11 smithi057 ceph-mon[92072]: pgmap v6069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:07:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:11 smithi122 ceph-mon[125440]: pgmap v6069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:07:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:11 smithi136 ceph-mon[125702]: pgmap v6069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:07:12.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:12 smithi057 ceph-mon[92072]: osdmap e451: 12 total, 12 up, 12 in 2023-03-02T14:07:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:12 smithi122 ceph-mon[125440]: osdmap e451: 12 total, 12 up, 12 in 2023-03-02T14:07:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:12 smithi136 ceph-mon[125702]: osdmap e451: 12 total, 12 up, 12 in 2023-03-02T14:07:12.764 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:12.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:07:12.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:12.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:07:12.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:12.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:07:12.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:12.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:07:12.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:12.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:07:13.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:13 smithi057 ceph-mon[92072]: pgmap v6071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:07:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:13 smithi122 ceph-mon[125440]: pgmap v6071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:07:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:13 smithi136 ceph-mon[125702]: pgmap v6071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:07:15.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:15 smithi057 ceph-mon[92072]: pgmap v6072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:07:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:15 smithi122 ceph-mon[125440]: pgmap v6072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:07:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:15 smithi136 ceph-mon[125702]: pgmap v6072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:07:17.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:17 smithi057 ceph-mon[92072]: pgmap v6073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:07:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:17 smithi057 ceph-mon[92072]: osdmap e452: 12 total, 12 up, 12 in 2023-03-02T14:07:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:17 smithi122 ceph-mon[125440]: pgmap v6073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:07:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:17 smithi122 ceph-mon[125440]: osdmap e452: 12 total, 12 up, 12 in 2023-03-02T14:07:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:17 smithi136 ceph-mon[125702]: pgmap v6073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:07:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:17 smithi136 ceph-mon[125702]: osdmap e452: 12 total, 12 up, 12 in 2023-03-02T14:07:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:19 smithi057 ceph-mon[92072]: pgmap v6075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:07:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:19 smithi122 ceph-mon[125440]: pgmap v6075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:07:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:19 smithi136 ceph-mon[125702]: pgmap v6075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:07:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:21 smithi122 ceph-mon[125440]: pgmap v6076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T14:07:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:21 smithi136 ceph-mon[125702]: pgmap v6076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T14:07:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:21 smithi057 ceph-mon[92072]: pgmap v6076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T14:07:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:23 smithi122 ceph-mon[125440]: pgmap v6077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:07:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:23 smithi136 ceph-mon[125702]: pgmap v6077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:07:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:23 smithi057 ceph-mon[92072]: pgmap v6077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:07:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:25 smithi122 ceph-mon[125440]: pgmap v6078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:07:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:25 smithi136 ceph-mon[125702]: pgmap v6078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:07:25.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:25 smithi057 ceph-mon[92072]: pgmap v6078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:07:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:27 smithi122 ceph-mon[125440]: pgmap v6079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:07:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:27 smithi136 ceph-mon[125702]: pgmap v6079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:07:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:27 smithi057 ceph-mon[92072]: pgmap v6079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:07:27.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:27.780+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:07:27.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:27.780+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:07:27.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:27.780+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:07:27.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:27.780+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:07:27.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:27.780+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:07:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:29 smithi122 ceph-mon[125440]: pgmap v6080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T14:07:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:29 smithi136 ceph-mon[125702]: pgmap v6080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T14:07:29.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:29 smithi057 ceph-mon[92072]: pgmap v6080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T14:07:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:31 smithi136 ceph-mon[125702]: pgmap v6081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:07:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:31 smithi057 ceph-mon[92072]: pgmap v6081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:07:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:31 smithi122 ceph-mon[125440]: pgmap v6081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:07:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:33 smithi136 ceph-mon[125702]: pgmap v6082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:33 smithi057 ceph-mon[92072]: pgmap v6082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:33 smithi122 ceph-mon[125440]: pgmap v6082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:35 smithi136 ceph-mon[125702]: pgmap v6083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:35.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:35 smithi057 ceph-mon[92072]: pgmap v6083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:35 smithi122 ceph-mon[125440]: pgmap v6083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:37 smithi136 ceph-mon[125702]: pgmap v6084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:37 smithi057 ceph-mon[92072]: pgmap v6084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:37 smithi122 ceph-mon[125440]: pgmap v6084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:39 smithi136 ceph-mon[125702]: pgmap v6085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:39 smithi057 ceph-mon[92072]: pgmap v6085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:39 smithi122 ceph-mon[125440]: pgmap v6085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:41.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:41 smithi136 ceph-mon[125702]: pgmap v6086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:41 smithi057 ceph-mon[92072]: pgmap v6086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:41 smithi122 ceph-mon[125440]: pgmap v6086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:42.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:42.795+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:07:42.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:42.796+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:07:42.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:42.796+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:07:42.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:42.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:07:42.797 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:42.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:07:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:43 smithi136 ceph-mon[125702]: pgmap v6087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:43 smithi057 ceph-mon[92072]: pgmap v6087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:43 smithi122 ceph-mon[125440]: pgmap v6087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:45 smithi136 ceph-mon[125702]: pgmap v6088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:45 smithi057 ceph-mon[92072]: pgmap v6088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:45 smithi122 ceph-mon[125440]: pgmap v6088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:47 smithi136 ceph-mon[125702]: pgmap v6089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:47 smithi057 ceph-mon[92072]: pgmap v6089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:47 smithi122 ceph-mon[125440]: pgmap v6089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:49 smithi136 ceph-mon[125702]: pgmap v6090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:49 smithi057 ceph-mon[92072]: pgmap v6090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:49 smithi122 ceph-mon[125440]: pgmap v6090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:51 smithi136 ceph-mon[125702]: pgmap v6091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:51 smithi057 ceph-mon[92072]: pgmap v6091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:51 smithi122 ceph-mon[125440]: pgmap v6091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:53 smithi136 ceph-mon[125702]: pgmap v6092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:53 smithi057 ceph-mon[92072]: pgmap v6092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:53 smithi122 ceph-mon[125440]: pgmap v6092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:55 smithi136 ceph-mon[125702]: pgmap v6093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:55 smithi057 ceph-mon[92072]: pgmap v6093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:55 smithi122 ceph-mon[125440]: pgmap v6093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:57 smithi136 ceph-mon[125702]: pgmap v6094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:57 smithi057 ceph-mon[92072]: pgmap v6094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:57 smithi122 ceph-mon[125440]: pgmap v6094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:07:57.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:57.810+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:07:57.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:57.810+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:07:57.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:57.810+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:07:57.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:57.810+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:07:57.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:07:57.810+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:07:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:07:59 smithi136 ceph-mon[125702]: pgmap v6095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:07:59 smithi057 ceph-mon[92072]: pgmap v6095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:07:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:07:59 smithi122 ceph-mon[125440]: pgmap v6095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:01 smithi136 ceph-mon[125702]: pgmap v6096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:01 smithi057 ceph-mon[92072]: pgmap v6096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:01 smithi122 ceph-mon[125440]: pgmap v6096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:03 smithi136 ceph-mon[125702]: pgmap v6097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:08:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:03 smithi057 ceph-mon[92072]: pgmap v6097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:08:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:03 smithi122 ceph-mon[125440]: pgmap v6097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:08:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:05 smithi136 ceph-mon[125702]: pgmap v6098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:08:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:08:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:05 smithi057 ceph-mon[92072]: pgmap v6098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:08:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:08:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:05 smithi122 ceph-mon[125440]: pgmap v6098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:08:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:08:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:07 smithi136 ceph-mon[125702]: pgmap v6099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:08:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:08:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:08:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:08:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:07 smithi057 ceph-mon[92072]: pgmap v6099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:08:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:08:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:08:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:08:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:07 smithi122 ceph-mon[125440]: pgmap v6099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:08:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:08:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:08:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:08:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:09 smithi136 ceph-mon[125702]: pgmap v6100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:08:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:09 smithi057 ceph-mon[92072]: pgmap v6100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:08:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:09 smithi122 ceph-mon[125440]: pgmap v6100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:08:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:09.987+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:08:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:09.987+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:08:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:09.987+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 91 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:08:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:09.987+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 90 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:08:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:11 smithi136 ceph-mon[125702]: pgmap v6101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:08:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:11 smithi136 ceph-mon[125702]: osdmap e453: 12 total, 12 up, 12 in 2023-03-02T14:08:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:11 smithi057 ceph-mon[92072]: pgmap v6101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:08:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:11 smithi057 ceph-mon[92072]: osdmap e453: 12 total, 12 up, 12 in 2023-03-02T14:08:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:11 smithi122 ceph-mon[125440]: pgmap v6101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:08:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:11 smithi122 ceph-mon[125440]: osdmap e453: 12 total, 12 up, 12 in 2023-03-02T14:08:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:12.822+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:08:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:12.822+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:08:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:12.822+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:08:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:12.822+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:08:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:12.822+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:08:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:13 smithi136 ceph-mon[125702]: pgmap v6103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:08:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:13 smithi057 ceph-mon[92072]: pgmap v6103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:08:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:13 smithi122 ceph-mon[125440]: pgmap v6103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:08:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:15 smithi136 ceph-mon[125702]: pgmap v6104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:08:15.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:15 smithi057 ceph-mon[92072]: pgmap v6104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:08:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:15 smithi122 ceph-mon[125440]: pgmap v6104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:08:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:17 smithi136 ceph-mon[125702]: pgmap v6105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:08:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:17 smithi136 ceph-mon[125702]: osdmap e454: 12 total, 12 up, 12 in 2023-03-02T14:08:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:17 smithi057 ceph-mon[92072]: pgmap v6105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:08:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:17 smithi057 ceph-mon[92072]: osdmap e454: 12 total, 12 up, 12 in 2023-03-02T14:08:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:17 smithi122 ceph-mon[125440]: pgmap v6105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:08:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:17 smithi122 ceph-mon[125440]: osdmap e454: 12 total, 12 up, 12 in 2023-03-02T14:08:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:19 smithi136 ceph-mon[125702]: pgmap v6107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:08:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:19 smithi057 ceph-mon[92072]: pgmap v6107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:08:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:19 smithi122 ceph-mon[125440]: pgmap v6107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:08:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:21 smithi057 ceph-mon[92072]: pgmap v6108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T14:08:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:21 smithi122 ceph-mon[125440]: pgmap v6108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T14:08:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:21 smithi136 ceph-mon[125702]: pgmap v6108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T14:08:23.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:23 smithi057 ceph-mon[92072]: pgmap v6109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:08:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:23 smithi122 ceph-mon[125440]: pgmap v6109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:08:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:23 smithi136 ceph-mon[125702]: pgmap v6109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:08:25.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:25 smithi057 ceph-mon[92072]: pgmap v6110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:08:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:25 smithi122 ceph-mon[125440]: pgmap v6110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:08:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:25 smithi136 ceph-mon[125702]: pgmap v6110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:08:27.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:27 smithi057 ceph-mon[92072]: pgmap v6111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:08:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:27 smithi122 ceph-mon[125440]: pgmap v6111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:08:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:27.839+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:08:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:27 smithi136 ceph-mon[125702]: pgmap v6111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:08:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:27.839+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:08:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:27.839+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:08:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:27.839+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:08:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:27.839+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:08:29.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:29 smithi057 ceph-mon[92072]: pgmap v6112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:08:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:29 smithi122 ceph-mon[125440]: pgmap v6112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:08:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:29 smithi136 ceph-mon[125702]: pgmap v6112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:08:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:31 smithi057 ceph-mon[92072]: pgmap v6113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:31 smithi122 ceph-mon[125440]: pgmap v6113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:31 smithi136 ceph-mon[125702]: pgmap v6113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:33 smithi057 ceph-mon[92072]: pgmap v6114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:33 smithi122 ceph-mon[125440]: pgmap v6114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:33 smithi136 ceph-mon[125702]: pgmap v6114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:35 smithi057 ceph-mon[92072]: pgmap v6115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:35 smithi122 ceph-mon[125440]: pgmap v6115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:35 smithi136 ceph-mon[125702]: pgmap v6115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:37 smithi057 ceph-mon[92072]: pgmap v6116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:37 smithi122 ceph-mon[125440]: pgmap v6116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:37 smithi136 ceph-mon[125702]: pgmap v6116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:39 smithi057 ceph-mon[92072]: pgmap v6117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:39 smithi122 ceph-mon[125440]: pgmap v6117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:39 smithi136 ceph-mon[125702]: pgmap v6117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:41 smithi057 ceph-mon[92072]: pgmap v6118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:41 smithi122 ceph-mon[125440]: pgmap v6118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:41 smithi136 ceph-mon[125702]: pgmap v6118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:42.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:42.855+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:42.855+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:42.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:42.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:08:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:43 smithi057 ceph-mon[92072]: pgmap v6119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:43 smithi122 ceph-mon[125440]: pgmap v6119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:43 smithi136 ceph-mon[125702]: pgmap v6119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:45 smithi057 ceph-mon[92072]: pgmap v6120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:45 smithi122 ceph-mon[125440]: pgmap v6120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:45 smithi136 ceph-mon[125702]: pgmap v6120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:47 smithi057 ceph-mon[92072]: pgmap v6121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:47 smithi122 ceph-mon[125440]: pgmap v6121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:47 smithi136 ceph-mon[125702]: pgmap v6121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:49.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:49 smithi057 ceph-mon[92072]: pgmap v6122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:49 smithi122 ceph-mon[125440]: pgmap v6122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:49 smithi136 ceph-mon[125702]: pgmap v6122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:51 smithi057 ceph-mon[92072]: pgmap v6123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:51 smithi122 ceph-mon[125440]: pgmap v6123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:51 smithi136 ceph-mon[125702]: pgmap v6123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:53 smithi057 ceph-mon[92072]: pgmap v6124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:53 smithi122 ceph-mon[125440]: pgmap v6124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:53 smithi136 ceph-mon[125702]: pgmap v6124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:54.995+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:08:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:54.995+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:08:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:54.995+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 92 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:08:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:54.995+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 91 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:08:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:55 smithi057 ceph-mon[92072]: pgmap v6125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:55 smithi122 ceph-mon[125440]: pgmap v6125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:55 smithi136 ceph-mon[125702]: pgmap v6125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:57 smithi057 ceph-mon[92072]: pgmap v6126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:57 smithi122 ceph-mon[125440]: pgmap v6126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:57 smithi136 ceph-mon[125702]: pgmap v6126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:57.868+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:57.868+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:57.868+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:57.868+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:08:57.868+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:08:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:08:59 smithi122 ceph-mon[125440]: pgmap v6127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:08:59 smithi136 ceph-mon[125702]: pgmap v6127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:08:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:08:59 smithi057 ceph-mon[92072]: pgmap v6127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:01 smithi122 ceph-mon[125440]: pgmap v6128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:01 smithi136 ceph-mon[125702]: pgmap v6128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:01 smithi057 ceph-mon[92072]: pgmap v6128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:03 smithi122 ceph-mon[125440]: pgmap v6129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:09:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:03 smithi136 ceph-mon[125702]: pgmap v6129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:09:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:03 smithi057 ceph-mon[92072]: pgmap v6129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:09:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:05 smithi122 ceph-mon[125440]: pgmap v6130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:09:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:05 smithi136 ceph-mon[125702]: pgmap v6130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:09:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:05 smithi057 ceph-mon[92072]: pgmap v6130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:09:06.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:06 smithi136 ceph-mon[125702]: pgmap v6131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:09:06.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:06 smithi057 ceph-mon[92072]: pgmap v6131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:09:06.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:06 smithi122 ceph-mon[125440]: pgmap v6131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:09:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:09:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:09:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:09:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:09:08.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:09:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:09:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:09:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:09:08.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:09:08.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:09:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:09:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:09:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:09 smithi136 ceph-mon[125702]: pgmap v6132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:09:09.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:09 smithi057 ceph-mon[92072]: pgmap v6132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:09:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:09 smithi122 ceph-mon[125440]: pgmap v6132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:09:11.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:11 smithi057 ceph-mon[92072]: pgmap v6133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:09:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:11 smithi122 ceph-mon[125440]: pgmap v6133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:09:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:11 smithi136 ceph-mon[125702]: pgmap v6133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:09:12.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:12 smithi057 ceph-mon[92072]: osdmap e455: 12 total, 12 up, 12 in 2023-03-02T14:09:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:12 smithi122 ceph-mon[125440]: osdmap e455: 12 total, 12 up, 12 in 2023-03-02T14:09:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:12 smithi136 ceph-mon[125702]: osdmap e455: 12 total, 12 up, 12 in 2023-03-02T14:09:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:12.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:09:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:12.875+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:09:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:12.875+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:09:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:12.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:09:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:12.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:09:13.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:13 smithi057 ceph-mon[92072]: pgmap v6135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:09:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:13 smithi122 ceph-mon[125440]: pgmap v6135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:09:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:13 smithi136 ceph-mon[125702]: pgmap v6135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:09:15.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:15 smithi057 ceph-mon[92072]: pgmap v6136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:09:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:15 smithi122 ceph-mon[125440]: pgmap v6136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:09:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:15 smithi136 ceph-mon[125702]: pgmap v6136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:09:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:17 smithi057 ceph-mon[92072]: pgmap v6137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:09:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:17 smithi057 ceph-mon[92072]: osdmap e456: 12 total, 12 up, 12 in 2023-03-02T14:09:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:17 smithi122 ceph-mon[125440]: pgmap v6137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:09:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:17 smithi122 ceph-mon[125440]: osdmap e456: 12 total, 12 up, 12 in 2023-03-02T14:09:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:17 smithi136 ceph-mon[125702]: pgmap v6137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:09:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:17 smithi136 ceph-mon[125702]: osdmap e456: 12 total, 12 up, 12 in 2023-03-02T14:09:19.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:19 smithi057 ceph-mon[92072]: pgmap v6139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:09:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:19 smithi122 ceph-mon[125440]: pgmap v6139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:09:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:19 smithi136 ceph-mon[125702]: pgmap v6139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:09:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:21 smithi057 ceph-mon[92072]: pgmap v6140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T14:09:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:21 smithi122 ceph-mon[125440]: pgmap v6140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T14:09:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:21 smithi136 ceph-mon[125702]: pgmap v6140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T14:09:23.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:23 smithi057 ceph-mon[92072]: pgmap v6141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:09:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:23 smithi122 ceph-mon[125440]: pgmap v6141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:09:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:23 smithi136 ceph-mon[125702]: pgmap v6141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:09:25.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:25 smithi057 ceph-mon[92072]: pgmap v6142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:09:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:25 smithi122 ceph-mon[125440]: pgmap v6142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:09:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:25 smithi136 ceph-mon[125702]: pgmap v6142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:09:27.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:27 smithi057 ceph-mon[92072]: pgmap v6143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:09:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:27 smithi122 ceph-mon[125440]: pgmap v6143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:09:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:27 smithi136 ceph-mon[125702]: pgmap v6143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:09:27.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:27.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:09:27.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:27.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:09:27.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:27.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:09:27.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:27.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:09:27.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:27.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:09:29.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:29 smithi057 ceph-mon[92072]: pgmap v6144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:09:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:29 smithi122 ceph-mon[125440]: pgmap v6144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:09:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:29 smithi136 ceph-mon[125702]: pgmap v6144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:09:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:31 smithi057 ceph-mon[92072]: pgmap v6145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:31 smithi122 ceph-mon[125440]: pgmap v6145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:31 smithi136 ceph-mon[125702]: pgmap v6145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:33 smithi057 ceph-mon[92072]: pgmap v6146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:33.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:33 smithi122 ceph-mon[125440]: pgmap v6146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:33 smithi136 ceph-mon[125702]: pgmap v6146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:35 smithi057 ceph-mon[92072]: pgmap v6147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:35 smithi122 ceph-mon[125440]: pgmap v6147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:35 smithi136 ceph-mon[125702]: pgmap v6147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:37.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:37 smithi057 ceph-mon[92072]: pgmap v6148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:37 smithi122 ceph-mon[125440]: pgmap v6148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:37 smithi136 ceph-mon[125702]: pgmap v6148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:39.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:39 smithi057 ceph-mon[92072]: pgmap v6149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:39 smithi122 ceph-mon[125440]: pgmap v6149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:39 smithi136 ceph-mon[125702]: pgmap v6149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:41 smithi057 ceph-mon[92072]: pgmap v6150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:41 smithi122 ceph-mon[125440]: pgmap v6150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:41 smithi136 ceph-mon[125702]: pgmap v6150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:42.904+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:09:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:42.904+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:09:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:42.904+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:09:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:42.904+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:09:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:42.904+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:09:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:43 smithi122 ceph-mon[125440]: pgmap v6151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:43 smithi136 ceph-mon[125702]: pgmap v6151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:43 smithi057 ceph-mon[92072]: pgmap v6151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:45 smithi122 ceph-mon[125440]: pgmap v6152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:45 smithi136 ceph-mon[125702]: pgmap v6152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:45 smithi057 ceph-mon[92072]: pgmap v6152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:47 smithi122 ceph-mon[125440]: pgmap v6153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:47 smithi136 ceph-mon[125702]: pgmap v6153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:47 smithi057 ceph-mon[92072]: pgmap v6153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:49 smithi122 ceph-mon[125440]: pgmap v6154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:49 smithi136 ceph-mon[125702]: pgmap v6154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:49.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:49 smithi057 ceph-mon[92072]: pgmap v6154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:51 smithi136 ceph-mon[125702]: pgmap v6155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:51 smithi057 ceph-mon[92072]: pgmap v6155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:51 smithi122 ceph-mon[125440]: pgmap v6155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:53 smithi136 ceph-mon[125702]: pgmap v6156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:53 smithi057 ceph-mon[92072]: pgmap v6156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:53 smithi122 ceph-mon[125440]: pgmap v6156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:55 smithi136 ceph-mon[125702]: pgmap v6157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:55 smithi057 ceph-mon[92072]: pgmap v6157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:55 smithi122 ceph-mon[125440]: pgmap v6157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:57 smithi136 ceph-mon[125702]: pgmap v6158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:57 smithi057 ceph-mon[92072]: pgmap v6158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:57 smithi122 ceph-mon[125440]: pgmap v6158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:09:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:57.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:09:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:57.920+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:09:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:57.920+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:09:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:57.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:09:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:09:57.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:09:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:09:59 smithi136 ceph-mon[125702]: pgmap v6159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:09:59 smithi057 ceph-mon[92072]: pgmap v6159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:09:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:09:59 smithi122 ceph-mon[125440]: pgmap v6159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T14:10:00.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T14:10:00.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T14:10:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:01 smithi136 ceph-mon[125702]: pgmap v6160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:01 smithi057 ceph-mon[92072]: pgmap v6160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:01 smithi122 ceph-mon[125440]: pgmap v6160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:03 smithi136 ceph-mon[125702]: pgmap v6161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:10:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:03 smithi057 ceph-mon[92072]: pgmap v6161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:10:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:03 smithi122 ceph-mon[125440]: pgmap v6161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:10:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:05 smithi136 ceph-mon[125702]: pgmap v6162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:10:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:05 smithi057 ceph-mon[92072]: pgmap v6162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:10:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:05 smithi122 ceph-mon[125440]: pgmap v6162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:10:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:07 smithi136 ceph-mon[125702]: pgmap v6163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:10:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:07 smithi136 ceph-mon[125702]: osdmap e457: 12 total, 12 up, 12 in 2023-03-02T14:10:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:07 smithi057 ceph-mon[92072]: pgmap v6163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:10:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:07 smithi057 ceph-mon[92072]: osdmap e457: 12 total, 12 up, 12 in 2023-03-02T14:10:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:07 smithi122 ceph-mon[125440]: pgmap v6163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:10:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:07 smithi122 ceph-mon[125440]: osdmap e457: 12 total, 12 up, 12 in 2023-03-02T14:10:08.550 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:10:08.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:10:08.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:10:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:09 smithi136 ceph-mon[125702]: pgmap v6165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:10:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:10:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:10:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:10:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:09 smithi057 ceph-mon[92072]: pgmap v6165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:10:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:10:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:10:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:10:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:09 smithi122 ceph-mon[125440]: pgmap v6165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:10:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:10:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:10:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:10:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:11 smithi136 ceph-mon[125702]: pgmap v6166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:10:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:11 smithi057 ceph-mon[92072]: pgmap v6166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:10:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:11 smithi122 ceph-mon[125440]: pgmap v6166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:10:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:12.929+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:10:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:12.929+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:10:12.930 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:12.929+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:10:12.930 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:12.929+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:10:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:12.930+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:10:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:13 smithi136 ceph-mon[125702]: pgmap v6167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:10:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:13 smithi136 ceph-mon[125702]: osdmap e458: 12 total, 12 up, 12 in 2023-03-02T14:10:13.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:13 smithi057 ceph-mon[92072]: pgmap v6167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:10:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:13 smithi057 ceph-mon[92072]: osdmap e458: 12 total, 12 up, 12 in 2023-03-02T14:10:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:13 smithi122 ceph-mon[125440]: pgmap v6167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:10:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:13 smithi122 ceph-mon[125440]: osdmap e458: 12 total, 12 up, 12 in 2023-03-02T14:10:15.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:15 smithi057 ceph-mon[92072]: pgmap v6169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:10:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:15 smithi122 ceph-mon[125440]: pgmap v6169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:10:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:15 smithi136 ceph-mon[125702]: pgmap v6169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:10:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:17 smithi057 ceph-mon[92072]: pgmap v6170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:10:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:17 smithi122 ceph-mon[125440]: pgmap v6170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:10:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:17 smithi136 ceph-mon[125702]: pgmap v6170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:10:19.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:19 smithi057 ceph-mon[92072]: pgmap v6171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:10:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:19 smithi122 ceph-mon[125440]: pgmap v6171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:10:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:19 smithi136 ceph-mon[125702]: pgmap v6171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:10:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:21 smithi057 ceph-mon[92072]: pgmap v6172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:10:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:21 smithi122 ceph-mon[125440]: pgmap v6172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:10:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:21 smithi136 ceph-mon[125702]: pgmap v6172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:10:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:23 smithi057 ceph-mon[92072]: pgmap v6173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:10:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:23 smithi122 ceph-mon[125440]: pgmap v6173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:10:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:23 smithi136 ceph-mon[125702]: pgmap v6173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:10:25.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:25 smithi057 ceph-mon[92072]: pgmap v6174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:25 smithi122 ceph-mon[125440]: pgmap v6174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:25 smithi136 ceph-mon[125702]: pgmap v6174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:27.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:27 smithi057 ceph-mon[92072]: pgmap v6175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:27 smithi122 ceph-mon[125440]: pgmap v6175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:27 smithi136 ceph-mon[125702]: pgmap v6175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:27.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:10:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:27.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:10:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:27.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:10:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:27.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:10:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:27.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:10:29.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:29 smithi057 ceph-mon[92072]: pgmap v6176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:29 smithi122 ceph-mon[125440]: pgmap v6176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:29 smithi136 ceph-mon[125702]: pgmap v6176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:31 smithi057 ceph-mon[92072]: pgmap v6177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:31 smithi122 ceph-mon[125440]: pgmap v6177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:31 smithi136 ceph-mon[125702]: pgmap v6177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:33.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:33 smithi057 ceph-mon[92072]: pgmap v6178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:33 smithi122 ceph-mon[125440]: pgmap v6178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:33 smithi136 ceph-mon[125702]: pgmap v6178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:35.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:35 smithi057 ceph-mon[92072]: pgmap v6179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:35 smithi122 ceph-mon[125440]: pgmap v6179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:35 smithi136 ceph-mon[125702]: pgmap v6179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:37.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:37 smithi057 ceph-mon[92072]: pgmap v6180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:37 smithi122 ceph-mon[125440]: pgmap v6180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:37 smithi136 ceph-mon[125702]: pgmap v6180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:39.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:39 smithi057 ceph-mon[92072]: pgmap v6181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:39 smithi122 ceph-mon[125440]: pgmap v6181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:39 smithi136 ceph-mon[125702]: pgmap v6181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:41.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:41 smithi057 ceph-mon[92072]: pgmap v6182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:41 smithi122 ceph-mon[125440]: pgmap v6182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:41 smithi136 ceph-mon[125702]: pgmap v6182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:42.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:10:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:42.951+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:10:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:42.951+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:10:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:42.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:10:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:42.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:10:43.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:43 smithi057 ceph-mon[92072]: pgmap v6183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:43 smithi122 ceph-mon[125440]: pgmap v6183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:43 smithi136 ceph-mon[125702]: pgmap v6183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:45.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:45 smithi057 ceph-mon[92072]: pgmap v6184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:45 smithi122 ceph-mon[125440]: pgmap v6184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:45 smithi136 ceph-mon[125702]: pgmap v6184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:47.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:47 smithi057 ceph-mon[92072]: pgmap v6185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:47 smithi122 ceph-mon[125440]: pgmap v6185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:47 smithi136 ceph-mon[125702]: pgmap v6185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:49.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:49 smithi057 ceph-mon[92072]: pgmap v6186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:49 smithi122 ceph-mon[125440]: pgmap v6186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:49 smithi136 ceph-mon[125702]: pgmap v6186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:51.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:51 smithi057 ceph-mon[92072]: pgmap v6187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:51 smithi122 ceph-mon[125440]: pgmap v6187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:51 smithi136 ceph-mon[125702]: pgmap v6187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:53 smithi122 ceph-mon[125440]: pgmap v6188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:53 smithi136 ceph-mon[125702]: pgmap v6188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:53 smithi057 ceph-mon[92072]: pgmap v6188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:55.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:55 smithi122 ceph-mon[125440]: pgmap v6189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:55 smithi136 ceph-mon[125702]: pgmap v6189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:55 smithi057 ceph-mon[92072]: pgmap v6189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:57 smithi122 ceph-mon[125440]: pgmap v6190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:57 smithi136 ceph-mon[125702]: pgmap v6190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:57 smithi057 ceph-mon[92072]: pgmap v6190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:10:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:57.956+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:10:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:57.956+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:10:57.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:57.956+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:10:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:57.956+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:10:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:10:57.956+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:10:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:10:59 smithi122 ceph-mon[125440]: pgmap v6191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:10:59 smithi136 ceph-mon[125702]: pgmap v6191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:10:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:10:59 smithi057 ceph-mon[92072]: pgmap v6191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:01 smithi122 ceph-mon[125440]: pgmap v6192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:01 smithi136 ceph-mon[125702]: pgmap v6192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:01 smithi057 ceph-mon[92072]: pgmap v6192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:03 smithi136 ceph-mon[125702]: pgmap v6193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:11:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:03 smithi057 ceph-mon[92072]: pgmap v6193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:11:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:03 smithi122 ceph-mon[125440]: pgmap v6193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:11:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:05 smithi136 ceph-mon[125702]: pgmap v6194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:11:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:05 smithi057 ceph-mon[92072]: pgmap v6194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:11:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:05 smithi122 ceph-mon[125440]: pgmap v6194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:11:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:07 smithi136 ceph-mon[125702]: pgmap v6195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:11:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:07 smithi136 ceph-mon[125702]: osdmap e459: 12 total, 12 up, 12 in 2023-03-02T14:11:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:07 smithi057 ceph-mon[92072]: pgmap v6195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:11:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:07 smithi057 ceph-mon[92072]: osdmap e459: 12 total, 12 up, 12 in 2023-03-02T14:11:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:07 smithi122 ceph-mon[125440]: pgmap v6195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:11:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:07 smithi122 ceph-mon[125440]: osdmap e459: 12 total, 12 up, 12 in 2023-03-02T14:11:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:09 smithi136 ceph-mon[125702]: pgmap v6197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:11:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:11:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:09 smithi057 ceph-mon[92072]: pgmap v6197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:11:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:11:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:09 smithi122 ceph-mon[125440]: pgmap v6197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:11:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:11:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:10.014+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:11:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:10.014+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:11:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:10.014+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 92 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:11:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:10.014+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 93 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:11:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:11:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:11:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:11:10.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:11:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:11:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:11:10.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:11:10.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:11:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:11:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:11 smithi136 ceph-mon[125702]: pgmap v6198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:11:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:11 smithi057 ceph-mon[92072]: pgmap v6198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:11:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:11 smithi122 ceph-mon[125440]: pgmap v6198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:11:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:12.959+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:11:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:12.959+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:11:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:12.959+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:11:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:12.959+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:11:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:12.959+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:11:13.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:13 smithi057 ceph-mon[92072]: pgmap v6199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:11:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:13 smithi057 ceph-mon[92072]: osdmap e460: 12 total, 12 up, 12 in 2023-03-02T14:11:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:13 smithi122 ceph-mon[125440]: pgmap v6199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:11:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:13 smithi122 ceph-mon[125440]: osdmap e460: 12 total, 12 up, 12 in 2023-03-02T14:11:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:13 smithi136 ceph-mon[125702]: pgmap v6199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:11:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:13 smithi136 ceph-mon[125702]: osdmap e460: 12 total, 12 up, 12 in 2023-03-02T14:11:15.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:15 smithi057 ceph-mon[92072]: pgmap v6201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:11:15.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:15 smithi122 ceph-mon[125440]: pgmap v6201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:11:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:15 smithi136 ceph-mon[125702]: pgmap v6201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:11:17.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:17 smithi057 ceph-mon[92072]: pgmap v6202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:11:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:17 smithi122 ceph-mon[125440]: pgmap v6202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:11:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:17 smithi136 ceph-mon[125702]: pgmap v6202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:11:19.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:19 smithi057 ceph-mon[92072]: pgmap v6203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:11:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:19 smithi122 ceph-mon[125440]: pgmap v6203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:11:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:19 smithi136 ceph-mon[125702]: pgmap v6203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:11:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:21 smithi057 ceph-mon[92072]: pgmap v6204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:11:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:21 smithi122 ceph-mon[125440]: pgmap v6204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:11:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:21 smithi136 ceph-mon[125702]: pgmap v6204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:11:23.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:23 smithi057 ceph-mon[92072]: pgmap v6205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:11:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:23 smithi122 ceph-mon[125440]: pgmap v6205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:11:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:23 smithi136 ceph-mon[125702]: pgmap v6205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:11:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:25 smithi057 ceph-mon[92072]: pgmap v6206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:25 smithi122 ceph-mon[125440]: pgmap v6206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:25 smithi136 ceph-mon[125702]: pgmap v6206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:27.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:27 smithi057 ceph-mon[92072]: pgmap v6207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:27 smithi122 ceph-mon[125440]: pgmap v6207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:27 smithi136 ceph-mon[125702]: pgmap v6207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:27.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:27.974+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:11:27.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:27.974+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:11:27.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:27.974+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:11:27.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:27.974+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:11:27.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:27.974+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:11:29.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:29 smithi057 ceph-mon[92072]: pgmap v6208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:29 smithi122 ceph-mon[125440]: pgmap v6208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:29 smithi136 ceph-mon[125702]: pgmap v6208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:31 smithi057 ceph-mon[92072]: pgmap v6209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:31 smithi122 ceph-mon[125440]: pgmap v6209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:31 smithi136 ceph-mon[125702]: pgmap v6209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:33.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:33 smithi057 ceph-mon[92072]: pgmap v6210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:33 smithi122 ceph-mon[125440]: pgmap v6210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:33 smithi136 ceph-mon[125702]: pgmap v6210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:35 smithi122 ceph-mon[125440]: pgmap v6211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:35 smithi136 ceph-mon[125702]: pgmap v6211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:35.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:35 smithi057 ceph-mon[92072]: pgmap v6211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:37 smithi122 ceph-mon[125440]: pgmap v6212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:37 smithi136 ceph-mon[125702]: pgmap v6212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:37 smithi057 ceph-mon[92072]: pgmap v6212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:39 smithi122 ceph-mon[125440]: pgmap v6213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:39 smithi136 ceph-mon[125702]: pgmap v6213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:39 smithi057 ceph-mon[92072]: pgmap v6213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:41 smithi122 ceph-mon[125440]: pgmap v6214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:41 smithi136 ceph-mon[125702]: pgmap v6214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:41 smithi057 ceph-mon[92072]: pgmap v6214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:42.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:11:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:42.986+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:11:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:42.986+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:11:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:42.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:11:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:42.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:11:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:43 smithi136 ceph-mon[125702]: pgmap v6215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:43 smithi057 ceph-mon[92072]: pgmap v6215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:43 smithi122 ceph-mon[125440]: pgmap v6215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:45 smithi136 ceph-mon[125702]: pgmap v6216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:11:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:45 smithi057 ceph-mon[92072]: pgmap v6216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:11:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:45 smithi122 ceph-mon[125440]: pgmap v6216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:11:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:47 smithi136 ceph-mon[125702]: pgmap v6217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:11:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:47 smithi057 ceph-mon[92072]: pgmap v6217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:11:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:47 smithi122 ceph-mon[125440]: pgmap v6217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:11:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:49 smithi136 ceph-mon[125702]: pgmap v6218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:49.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:49 smithi057 ceph-mon[92072]: pgmap v6218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:49 smithi122 ceph-mon[125440]: pgmap v6218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:51 smithi136 ceph-mon[125702]: pgmap v6219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:11:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:51 smithi057 ceph-mon[92072]: pgmap v6219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:11:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:51 smithi122 ceph-mon[125440]: pgmap v6219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:11:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:53 smithi136 ceph-mon[125702]: pgmap v6220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:53 smithi057 ceph-mon[92072]: pgmap v6220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:53 smithi122 ceph-mon[125440]: pgmap v6220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:55 smithi136 ceph-mon[125702]: pgmap v6221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:55 smithi057 ceph-mon[92072]: pgmap v6221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:55 smithi122 ceph-mon[125440]: pgmap v6221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:57 smithi136 ceph-mon[125702]: pgmap v6222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:57 smithi057 ceph-mon[92072]: pgmap v6222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:57 smithi122 ceph-mon[125440]: pgmap v6222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:11:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:57.988+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:11:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:57.989+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:11:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:57.989+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:11:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:57.989+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:11:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:11:57.989+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:11:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:11:59 smithi136 ceph-mon[125702]: pgmap v6223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:11:59 smithi057 ceph-mon[92072]: pgmap v6223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:11:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:11:59 smithi122 ceph-mon[125440]: pgmap v6223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:01 smithi136 ceph-mon[125702]: pgmap v6224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:01 smithi057 ceph-mon[92072]: pgmap v6224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:01 smithi122 ceph-mon[125440]: pgmap v6224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:03 smithi136 ceph-mon[125702]: pgmap v6225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:12:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:03 smithi057 ceph-mon[92072]: pgmap v6225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:12:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:03 smithi122 ceph-mon[125440]: pgmap v6225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:12:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:05 smithi136 ceph-mon[125702]: pgmap v6226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:12:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:05 smithi057 ceph-mon[92072]: pgmap v6226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:12:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:05 smithi122 ceph-mon[125440]: pgmap v6226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:12:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:07 smithi136 ceph-mon[125702]: pgmap v6227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:12:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:07 smithi057 ceph-mon[92072]: pgmap v6227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:12:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:07 smithi122 ceph-mon[125440]: pgmap v6227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:12:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:09 smithi136 ceph-mon[125702]: pgmap v6228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:12:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:09 smithi057 ceph-mon[92072]: pgmap v6228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:12:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:09 smithi122 ceph-mon[125440]: pgmap v6228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:12:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:12:10.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:12:10.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:12:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:11 smithi136 ceph-mon[125702]: pgmap v6229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:12:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:12:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:12:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:12:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:11 smithi057 ceph-mon[92072]: pgmap v6229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:12:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:12:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:12:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:12:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:11 smithi122 ceph-mon[125440]: pgmap v6229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:12:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:12:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:12:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:12:12.588 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:12 smithi136 ceph-mon[125702]: osdmap e461: 12 total, 12 up, 12 in 2023-03-02T14:12:12.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:12 smithi057 ceph-mon[92072]: osdmap e461: 12 total, 12 up, 12 in 2023-03-02T14:12:12.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:12 smithi122 ceph-mon[125440]: osdmap e461: 12 total, 12 up, 12 in 2023-03-02T14:12:12.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:12.995+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:12:12.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:12.996+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:12:12.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:12.996+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:12:12.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:12.996+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:12:12.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:12.996+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:12:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:13 smithi136 ceph-mon[125702]: pgmap v6231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:13 smithi057 ceph-mon[92072]: pgmap v6231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:13 smithi122 ceph-mon[125440]: pgmap v6231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:15 smithi136 ceph-mon[125702]: pgmap v6232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:15.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:15 smithi057 ceph-mon[92072]: pgmap v6232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:15 smithi122 ceph-mon[125440]: pgmap v6232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:17 smithi136 ceph-mon[125702]: pgmap v6233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:17 smithi057 ceph-mon[92072]: pgmap v6233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:17 smithi122 ceph-mon[125440]: pgmap v6233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:19 smithi136 ceph-mon[125702]: pgmap v6234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:12:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:19 smithi057 ceph-mon[92072]: pgmap v6234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:12:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:19 smithi122 ceph-mon[125440]: pgmap v6234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:12:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:21 smithi136 ceph-mon[125702]: pgmap v6235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:12:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:21 smithi057 ceph-mon[92072]: pgmap v6235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:12:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:21 smithi122 ceph-mon[125440]: pgmap v6235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:12:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:23 smithi057 ceph-mon[92072]: pgmap v6236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 287 B/s wr, 14 op/s 2023-03-02T14:12:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:23 smithi057 ceph-mon[92072]: osdmap e462: 12 total, 12 up, 12 in 2023-03-02T14:12:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:23 smithi122 ceph-mon[125440]: pgmap v6236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 287 B/s wr, 14 op/s 2023-03-02T14:12:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:23 smithi122 ceph-mon[125440]: osdmap e462: 12 total, 12 up, 12 in 2023-03-02T14:12:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:23 smithi136 ceph-mon[125702]: pgmap v6236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 287 B/s wr, 14 op/s 2023-03-02T14:12:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:23 smithi136 ceph-mon[125702]: osdmap e462: 12 total, 12 up, 12 in 2023-03-02T14:12:25.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:25 smithi057 ceph-mon[92072]: pgmap v6238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:25 smithi122 ceph-mon[125440]: pgmap v6238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:25 smithi136 ceph-mon[125702]: pgmap v6238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:27.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:27 smithi057 ceph-mon[92072]: pgmap v6239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:27 smithi122 ceph-mon[125440]: pgmap v6239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:27 smithi136 ceph-mon[125702]: pgmap v6239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:12:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:27.999+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:12:27.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:27.999+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:12:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:27.999+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:12:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:27.999+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:12:28.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:27.999+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:12:29.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:29 smithi057 ceph-mon[92072]: pgmap v6240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:12:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:29 smithi122 ceph-mon[125440]: pgmap v6240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:12:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:29 smithi136 ceph-mon[125702]: pgmap v6240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:12:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:31 smithi057 ceph-mon[92072]: pgmap v6241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:12:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:31 smithi122 ceph-mon[125440]: pgmap v6241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:12:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:31 smithi136 ceph-mon[125702]: pgmap v6241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:12:33.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:33 smithi057 ceph-mon[92072]: pgmap v6242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:12:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:33 smithi122 ceph-mon[125440]: pgmap v6242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:12:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:33 smithi136 ceph-mon[125702]: pgmap v6242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:12:35.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:35 smithi057 ceph-mon[92072]: pgmap v6243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:35 smithi122 ceph-mon[125440]: pgmap v6243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:35 smithi136 ceph-mon[125702]: pgmap v6243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:37.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:37 smithi057 ceph-mon[92072]: pgmap v6244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:37 smithi122 ceph-mon[125440]: pgmap v6244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:37 smithi136 ceph-mon[125702]: pgmap v6244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:39 smithi057 ceph-mon[92072]: pgmap v6245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:39 smithi122 ceph-mon[125440]: pgmap v6245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:39 smithi136 ceph-mon[125702]: pgmap v6245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:41 smithi057 ceph-mon[92072]: pgmap v6246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:41 smithi122 ceph-mon[125440]: pgmap v6246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:41 smithi136 ceph-mon[125702]: pgmap v6246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:43.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:43.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:12:43.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:43.002+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:12:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:43.002+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:12:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:43.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:12:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:43.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:12:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:43 smithi122 ceph-mon[125440]: pgmap v6247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:43 smithi136 ceph-mon[125702]: pgmap v6247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:43 smithi057 ceph-mon[92072]: pgmap v6247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:45 smithi122 ceph-mon[125440]: pgmap v6248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:45 smithi136 ceph-mon[125702]: pgmap v6248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:45 smithi057 ceph-mon[92072]: pgmap v6248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:47 smithi122 ceph-mon[125440]: pgmap v6249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:47 smithi136 ceph-mon[125702]: pgmap v6249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:47 smithi057 ceph-mon[92072]: pgmap v6249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:49.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:49 smithi122 ceph-mon[125440]: pgmap v6250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:49 smithi136 ceph-mon[125702]: pgmap v6250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:49 smithi057 ceph-mon[92072]: pgmap v6250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:51 smithi136 ceph-mon[125702]: pgmap v6251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:51 smithi057 ceph-mon[92072]: pgmap v6251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:51 smithi122 ceph-mon[125440]: pgmap v6251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:53 smithi136 ceph-mon[125702]: pgmap v6252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:53 smithi057 ceph-mon[92072]: pgmap v6252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:53 smithi122 ceph-mon[125440]: pgmap v6252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:55 smithi136 ceph-mon[125702]: pgmap v6253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:55 smithi057 ceph-mon[92072]: pgmap v6253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:55 smithi122 ceph-mon[125440]: pgmap v6253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:57 smithi136 ceph-mon[125702]: pgmap v6254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:57 smithi057 ceph-mon[92072]: pgmap v6254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:57 smithi122 ceph-mon[125440]: pgmap v6254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:12:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:58.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:12:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:58.019+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:12:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:58.019+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:12:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:58.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:12:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:12:58.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:12:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:12:59 smithi136 ceph-mon[125702]: pgmap v6255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:12:59 smithi057 ceph-mon[92072]: pgmap v6255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:12:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:12:59 smithi122 ceph-mon[125440]: pgmap v6255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:01 smithi136 ceph-mon[125702]: pgmap v6256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:01 smithi057 ceph-mon[92072]: pgmap v6256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:01 smithi122 ceph-mon[125440]: pgmap v6256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:03 smithi136 ceph-mon[125702]: pgmap v6257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:13:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:03 smithi057 ceph-mon[92072]: pgmap v6257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:13:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:03 smithi122 ceph-mon[125440]: pgmap v6257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:13:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:05 smithi136 ceph-mon[125702]: pgmap v6258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:13:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:05 smithi057 ceph-mon[92072]: pgmap v6258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:13:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:05 smithi122 ceph-mon[125440]: pgmap v6258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:13:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:07 smithi136 ceph-mon[125702]: pgmap v6259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:13:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:07 smithi057 ceph-mon[92072]: pgmap v6259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:13:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:07 smithi122 ceph-mon[125440]: pgmap v6259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:13:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:09 smithi136 ceph-mon[125702]: pgmap v6260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:13:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:09 smithi057 ceph-mon[92072]: pgmap v6260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:13:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:09 smithi122 ceph-mon[125440]: pgmap v6260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:13:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:11 smithi136 ceph-mon[125702]: pgmap v6261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:13:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:13:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:11 smithi057 ceph-mon[92072]: pgmap v6261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:13:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:13:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:11 smithi122 ceph-mon[125440]: pgmap v6261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:13:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:13:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:12 smithi136 ceph-mon[125702]: osdmap e463: 12 total, 12 up, 12 in 2023-03-02T14:13:12.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:12 smithi057 ceph-mon[92072]: osdmap e463: 12 total, 12 up, 12 in 2023-03-02T14:13:12.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:12 smithi122 ceph-mon[125440]: osdmap e463: 12 total, 12 up, 12 in 2023-03-02T14:13:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:13.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:13:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:13.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:13:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:13.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:13:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:13.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:13:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:13.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:13:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:13 smithi136 ceph-mon[125702]: pgmap v6263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:13 smithi057 ceph-mon[92072]: pgmap v6263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:13 smithi122 ceph-mon[125440]: pgmap v6263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: pgmap v6264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: pgmap v6264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: pgmap v6264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T14:13:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T14:13:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:13:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:13:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:13:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:13:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T14:13:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T14:13:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:13:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:13:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:13:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:13:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T14:13:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T14:13:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:13:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:13:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:13:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:13:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:13:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:13:17.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:16 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:13:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:16 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:13:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:16 smithi057 ceph-mon[92072]: pgmap v6265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:16 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:13:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:16 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:13:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:16 smithi122 ceph-mon[125440]: pgmap v6265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:16 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:13:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:16 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:13:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:16 smithi136 ceph-mon[125702]: pgmap v6265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:19.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:19 smithi057 ceph-mon[92072]: pgmap v6266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:19 smithi122 ceph-mon[125440]: pgmap v6266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:19 smithi136 ceph-mon[125702]: pgmap v6266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:21 smithi057 ceph-mon[92072]: pgmap v6267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:21 smithi122 ceph-mon[125440]: pgmap v6267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:21 smithi136 ceph-mon[125702]: pgmap v6267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:13:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:23 smithi057 ceph-mon[92072]: pgmap v6268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 191 B/s wr, 14 op/s 2023-03-02T14:13:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:23 smithi057 ceph-mon[92072]: osdmap e464: 12 total, 12 up, 12 in 2023-03-02T14:13:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:23 smithi122 ceph-mon[125440]: pgmap v6268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 191 B/s wr, 14 op/s 2023-03-02T14:13:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:23 smithi122 ceph-mon[125440]: osdmap e464: 12 total, 12 up, 12 in 2023-03-02T14:13:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:23 smithi136 ceph-mon[125702]: pgmap v6268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 191 B/s wr, 14 op/s 2023-03-02T14:13:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:23 smithi136 ceph-mon[125702]: osdmap e464: 12 total, 12 up, 12 in 2023-03-02T14:13:25.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:25 smithi057 ceph-mon[92072]: pgmap v6270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:13:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:25 smithi122 ceph-mon[125440]: pgmap v6270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:13:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:25 smithi136 ceph-mon[125702]: pgmap v6270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:13:27.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:27 smithi057 ceph-mon[92072]: pgmap v6271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:13:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:27 smithi122 ceph-mon[125440]: pgmap v6271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:13:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:27 smithi136 ceph-mon[125702]: pgmap v6271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:13:28.039 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:28.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:13:28.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:28.040+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:13:28.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:28.040+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:13:28.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:28.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:13:28.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:28.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:13:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:29 smithi057 ceph-mon[92072]: pgmap v6272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:13:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:29 smithi122 ceph-mon[125440]: pgmap v6272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:13:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:29 smithi136 ceph-mon[125702]: pgmap v6272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:13:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:31 smithi057 ceph-mon[92072]: pgmap v6273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:13:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:31 smithi122 ceph-mon[125440]: pgmap v6273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:13:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:31 smithi136 ceph-mon[125702]: pgmap v6273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:13:33.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:33 smithi057 ceph-mon[92072]: pgmap v6274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:13:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:33 smithi122 ceph-mon[125440]: pgmap v6274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:13:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:33 smithi136 ceph-mon[125702]: pgmap v6274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:13:35.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:35 smithi057 ceph-mon[92072]: pgmap v6275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:35.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:35 smithi122 ceph-mon[125440]: pgmap v6275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:35 smithi136 ceph-mon[125702]: pgmap v6275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:37 smithi122 ceph-mon[125440]: pgmap v6276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:37 smithi136 ceph-mon[125702]: pgmap v6276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:37 smithi057 ceph-mon[92072]: pgmap v6276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:39.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:39 smithi122 ceph-mon[125440]: pgmap v6277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:39 smithi136 ceph-mon[125702]: pgmap v6277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:39 smithi057 ceph-mon[92072]: pgmap v6277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:41 smithi122 ceph-mon[125440]: pgmap v6278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:41 smithi136 ceph-mon[125702]: pgmap v6278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:41 smithi057 ceph-mon[92072]: pgmap v6278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:43.048+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:13:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:43.049+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:13:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:43.049+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:13:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:43.049+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:13:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:43.049+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:13:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:43 smithi122 ceph-mon[125440]: pgmap v6279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:43 smithi136 ceph-mon[125702]: pgmap v6279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:43 smithi057 ceph-mon[92072]: pgmap v6279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:45 smithi136 ceph-mon[125702]: pgmap v6280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:45 smithi057 ceph-mon[92072]: pgmap v6280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:45 smithi122 ceph-mon[125440]: pgmap v6280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:47 smithi136 ceph-mon[125702]: pgmap v6281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:47 smithi057 ceph-mon[92072]: pgmap v6281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:47 smithi122 ceph-mon[125440]: pgmap v6281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:49 smithi136 ceph-mon[125702]: pgmap v6282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:49.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:49 smithi057 ceph-mon[92072]: pgmap v6282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:49 smithi122 ceph-mon[125440]: pgmap v6282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:51 smithi136 ceph-mon[125702]: pgmap v6283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:51 smithi057 ceph-mon[92072]: pgmap v6283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:51 smithi122 ceph-mon[125440]: pgmap v6283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:53 smithi136 ceph-mon[125702]: pgmap v6284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:53 smithi057 ceph-mon[92072]: pgmap v6284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:53 smithi122 ceph-mon[125440]: pgmap v6284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:55 smithi136 ceph-mon[125702]: pgmap v6285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:55 smithi057 ceph-mon[92072]: pgmap v6285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:55 smithi122 ceph-mon[125440]: pgmap v6285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:57 smithi136 ceph-mon[125702]: pgmap v6286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:57 smithi057 ceph-mon[92072]: pgmap v6286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:57 smithi122 ceph-mon[125440]: pgmap v6286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:13:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:58.065+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:13:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:58.065+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:13:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:58.065+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:13:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:58.065+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:13:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:13:58.065+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:13:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:13:59 smithi136 ceph-mon[125702]: pgmap v6287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:13:59 smithi057 ceph-mon[92072]: pgmap v6287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:13:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:13:59 smithi122 ceph-mon[125440]: pgmap v6287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:01 smithi136 ceph-mon[125702]: pgmap v6288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:01 smithi057 ceph-mon[92072]: pgmap v6288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:01 smithi122 ceph-mon[125440]: pgmap v6288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:03 smithi136 ceph-mon[125702]: pgmap v6289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:14:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:03 smithi057 ceph-mon[92072]: pgmap v6289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:14:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:03 smithi122 ceph-mon[125440]: pgmap v6289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:14:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:05 smithi136 ceph-mon[125702]: pgmap v6290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:14:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:05 smithi057 ceph-mon[92072]: pgmap v6290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:14:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:05 smithi122 ceph-mon[125440]: pgmap v6290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:14:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:07 smithi136 ceph-mon[125702]: pgmap v6291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:14:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:07 smithi057 ceph-mon[92072]: pgmap v6291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:14:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:07 smithi122 ceph-mon[125440]: pgmap v6291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:14:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:08.392+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809cc70 msgr2=0x7f586809d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T14:14:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:08.392+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809cc70 msgr2=0x7f586809d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T14:14:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:08.392+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809cc70 0x7f586809d040 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f587004a0b0 tx=0x7f5870074070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:14:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:08.392+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809cc70 0x7f586809d040 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f587004a0b0 tx=0x7f5870074070 comp rx=0 tx=0).stop 2023-03-02T14:14:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:08.392+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809cc70 msgr2=0x7f586809d040 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T14:14:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:08.392+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809cc70 msgr2=0x7f586809d040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T14:14:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:08.392+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809cc70 0x7f586809d040 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T14:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:08.392+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T14:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:08.393+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:08.393+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5850005a70 tx=0x7f587006c040 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T14:14:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:09 smithi136 ceph-mon[125702]: pgmap v6292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:14:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:09 smithi057 ceph-mon[92072]: pgmap v6292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:14:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:09 smithi122 ceph-mon[125440]: pgmap v6292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:14:10.039 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:10.039+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:14:10.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:10.039+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:14:10.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:10.040+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 94 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:14:10.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:10.040+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 93 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:14:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:11 smithi136 ceph-mon[125702]: pgmap v6293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:14:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:11 smithi057 ceph-mon[92072]: pgmap v6293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:14:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:11 smithi122 ceph-mon[125440]: pgmap v6293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:14:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:12 smithi136 ceph-mon[125702]: osdmap e465: 12 total, 12 up, 12 in 2023-03-02T14:14:12.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:12 smithi057 ceph-mon[92072]: osdmap e465: 12 total, 12 up, 12 in 2023-03-02T14:14:12.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:12 smithi122 ceph-mon[125440]: osdmap e465: 12 total, 12 up, 12 in 2023-03-02T14:14:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:13.081+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:14:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:13.081+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:14:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:13.081+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:14:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:13.081+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:14:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:13.081+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:14:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:13 smithi136 ceph-mon[125702]: pgmap v6295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:13 smithi057 ceph-mon[92072]: pgmap v6295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:13 smithi122 ceph-mon[125440]: pgmap v6295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:15 smithi136 ceph-mon[125702]: pgmap v6296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:15.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:15 smithi057 ceph-mon[92072]: pgmap v6296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:15 smithi122 ceph-mon[125440]: pgmap v6296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:16.588 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:14:16.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:14:16.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:14:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:17 smithi136 ceph-mon[125702]: pgmap v6297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:14:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:14:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:14:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:17 smithi057 ceph-mon[92072]: pgmap v6297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:14:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:14:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:14:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:17 smithi122 ceph-mon[125440]: pgmap v6297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:14:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:14:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:14:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:19 smithi136 ceph-mon[125702]: pgmap v6298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:19 smithi057 ceph-mon[92072]: pgmap v6298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:19 smithi122 ceph-mon[125440]: pgmap v6298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:21 smithi136 ceph-mon[125702]: pgmap v6299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:21 smithi057 ceph-mon[92072]: pgmap v6299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:21 smithi122 ceph-mon[125440]: pgmap v6299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:14:23.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:23 smithi057 ceph-mon[92072]: pgmap v6300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 191 B/s wr, 14 op/s 2023-03-02T14:14:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:23 smithi057 ceph-mon[92072]: osdmap e466: 12 total, 12 up, 12 in 2023-03-02T14:14:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:23 smithi122 ceph-mon[125440]: pgmap v6300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 191 B/s wr, 14 op/s 2023-03-02T14:14:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:23 smithi122 ceph-mon[125440]: osdmap e466: 12 total, 12 up, 12 in 2023-03-02T14:14:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:23 smithi136 ceph-mon[125702]: pgmap v6300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 191 B/s wr, 14 op/s 2023-03-02T14:14:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:23 smithi136 ceph-mon[125702]: osdmap e466: 12 total, 12 up, 12 in 2023-03-02T14:14:25.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:25 smithi057 ceph-mon[92072]: pgmap v6302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:14:25.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:25 smithi122 ceph-mon[125440]: pgmap v6302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:14:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:25 smithi136 ceph-mon[125702]: pgmap v6302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:14:27.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:27 smithi057 ceph-mon[92072]: pgmap v6303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:14:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:27 smithi122 ceph-mon[125440]: pgmap v6303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:14:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:27 smithi136 ceph-mon[125702]: pgmap v6303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:14:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:28.089+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:14:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:28.089+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:14:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:28.089+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:14:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:28.089+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:14:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:28.089+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:14:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:29 smithi122 ceph-mon[125440]: pgmap v6304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:14:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:29 smithi136 ceph-mon[125702]: pgmap v6304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:14:29.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:29 smithi057 ceph-mon[92072]: pgmap v6304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:14:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:31 smithi122 ceph-mon[125440]: pgmap v6305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:14:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:31 smithi136 ceph-mon[125702]: pgmap v6305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:14:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:31 smithi057 ceph-mon[92072]: pgmap v6305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:14:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:33 smithi136 ceph-mon[125702]: pgmap v6306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:14:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:33 smithi057 ceph-mon[92072]: pgmap v6306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:14:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:33 smithi122 ceph-mon[125440]: pgmap v6306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T14:14:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:35 smithi136 ceph-mon[125702]: pgmap v6307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:14:35.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:35 smithi057 ceph-mon[92072]: pgmap v6307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:14:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:35 smithi122 ceph-mon[125440]: pgmap v6307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:14:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:37 smithi136 ceph-mon[125702]: pgmap v6308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:14:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:37 smithi057 ceph-mon[92072]: pgmap v6308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:14:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:37 smithi122 ceph-mon[125440]: pgmap v6308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:14:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:39 smithi136 ceph-mon[125702]: pgmap v6309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:39 smithi057 ceph-mon[92072]: pgmap v6309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:39 smithi122 ceph-mon[125440]: pgmap v6309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:41 smithi136 ceph-mon[125702]: pgmap v6310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:41 smithi057 ceph-mon[92072]: pgmap v6310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:41 smithi122 ceph-mon[125440]: pgmap v6310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:43.097+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:14:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:43.097+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:14:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:43.097+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:14:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:43.097+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:14:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:43.097+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:14:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:43 smithi136 ceph-mon[125702]: pgmap v6311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:43 smithi057 ceph-mon[92072]: pgmap v6311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:43 smithi122 ceph-mon[125440]: pgmap v6311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:45 smithi136 ceph-mon[125702]: pgmap v6312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:45 smithi057 ceph-mon[92072]: pgmap v6312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:45 smithi122 ceph-mon[125440]: pgmap v6312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:47 smithi136 ceph-mon[125702]: pgmap v6313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:47 smithi057 ceph-mon[92072]: pgmap v6313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:47 smithi122 ceph-mon[125440]: pgmap v6313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:49 smithi136 ceph-mon[125702]: pgmap v6314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:49.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:49 smithi057 ceph-mon[92072]: pgmap v6314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:49 smithi122 ceph-mon[125440]: pgmap v6314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:51 smithi136 ceph-mon[125702]: pgmap v6315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:51 smithi057 ceph-mon[92072]: pgmap v6315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:51 smithi122 ceph-mon[125440]: pgmap v6315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:53 smithi136 ceph-mon[125702]: pgmap v6316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:53 smithi057 ceph-mon[92072]: pgmap v6316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:53 smithi122 ceph-mon[125440]: pgmap v6316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:55 smithi136 ceph-mon[125702]: pgmap v6317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:55 smithi057 ceph-mon[92072]: pgmap v6317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:55 smithi122 ceph-mon[125440]: pgmap v6317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:57 smithi136 ceph-mon[125702]: pgmap v6318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:57 smithi057 ceph-mon[92072]: pgmap v6318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:57 smithi122 ceph-mon[125440]: pgmap v6318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:14:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:58.105+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:14:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:58.106+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:14:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:58.106+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:14:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:58.106+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:14:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:14:58.106+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:14:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:14:59 smithi136 ceph-mon[125702]: pgmap v6319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:14:59 smithi057 ceph-mon[92072]: pgmap v6319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:14:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:14:59 smithi122 ceph-mon[125440]: pgmap v6319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:01 smithi136 ceph-mon[125702]: pgmap v6320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:01 smithi057 ceph-mon[92072]: pgmap v6320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:01 smithi122 ceph-mon[125440]: pgmap v6320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:03 smithi136 ceph-mon[125702]: pgmap v6321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:15:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:03 smithi057 ceph-mon[92072]: pgmap v6321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:15:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:03 smithi122 ceph-mon[125440]: pgmap v6321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:15:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:05 smithi136 ceph-mon[125702]: pgmap v6322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:15:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:05 smithi057 ceph-mon[92072]: pgmap v6322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:15:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:05 smithi122 ceph-mon[125440]: pgmap v6322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:15:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:07 smithi136 ceph-mon[125702]: pgmap v6323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:15:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:07 smithi057 ceph-mon[92072]: pgmap v6323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:15:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:07 smithi122 ceph-mon[125440]: pgmap v6323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:15:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:09 smithi136 ceph-mon[125702]: pgmap v6324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:15:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:09 smithi057 ceph-mon[92072]: pgmap v6324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:15:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:09 smithi122 ceph-mon[125440]: pgmap v6324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:15:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:11 smithi136 ceph-mon[125702]: pgmap v6325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:15:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:11 smithi136 ceph-mon[125702]: osdmap e467: 12 total, 12 up, 12 in 2023-03-02T14:15:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:11 smithi057 ceph-mon[92072]: pgmap v6325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:15:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:11 smithi057 ceph-mon[92072]: osdmap e467: 12 total, 12 up, 12 in 2023-03-02T14:15:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:11 smithi122 ceph-mon[125440]: pgmap v6325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:15:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:11 smithi122 ceph-mon[125440]: osdmap e467: 12 total, 12 up, 12 in 2023-03-02T14:15:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:13.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:15:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:13.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:15:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:13.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:15:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:13.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:15:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:13.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:15:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:13 smithi136 ceph-mon[125702]: pgmap v6327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:15:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:13 smithi057 ceph-mon[92072]: pgmap v6327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:15:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:13 smithi122 ceph-mon[125440]: pgmap v6327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:15:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:15 smithi136 ceph-mon[125702]: pgmap v6328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:15:15.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:15 smithi057 ceph-mon[92072]: pgmap v6328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:15:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:15 smithi122 ceph-mon[125440]: pgmap v6328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:15:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:17 smithi136 ceph-mon[125702]: pgmap v6329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:15:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:15:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:15:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:15:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:17 smithi136 ceph-mon[125702]: osdmap e468: 12 total, 12 up, 12 in 2023-03-02T14:15:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:17 smithi057 ceph-mon[92072]: pgmap v6329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:15:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:15:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:15:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:15:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:17 smithi057 ceph-mon[92072]: osdmap e468: 12 total, 12 up, 12 in 2023-03-02T14:15:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:17 smithi122 ceph-mon[125440]: pgmap v6329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:15:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:15:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:15:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:15:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:17 smithi122 ceph-mon[125440]: osdmap e468: 12 total, 12 up, 12 in 2023-03-02T14:15:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:15:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:15:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:15:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:15:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:15:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:15:18.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:15:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:15:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:15:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:19 smithi057 ceph-mon[92072]: pgmap v6331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:15:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:19 smithi122 ceph-mon[125440]: pgmap v6331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:15:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:19 smithi136 ceph-mon[125702]: pgmap v6331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:15:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:21 smithi057 ceph-mon[92072]: pgmap v6332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:15:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:21 smithi122 ceph-mon[125440]: pgmap v6332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:15:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:21 smithi136 ceph-mon[125702]: pgmap v6332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:15:23.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:23 smithi057 ceph-mon[92072]: pgmap v6333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:15:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:23 smithi122 ceph-mon[125440]: pgmap v6333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:15:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:23 smithi136 ceph-mon[125702]: pgmap v6333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:15:25.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:25 smithi057 ceph-mon[92072]: pgmap v6334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:15:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:25 smithi122 ceph-mon[125440]: pgmap v6334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:15:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:25 smithi136 ceph-mon[125702]: pgmap v6334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:15:27.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:27 smithi057 ceph-mon[92072]: pgmap v6335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:15:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:27 smithi122 ceph-mon[125440]: pgmap v6335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:15:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:27 smithi136 ceph-mon[125702]: pgmap v6335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:15:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:28.130+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:15:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:28.130+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:15:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:28.130+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:15:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:28.130+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:15:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:28.130+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:15:29.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:29 smithi057 ceph-mon[92072]: pgmap v6336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:15:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:29 smithi122 ceph-mon[125440]: pgmap v6336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:15:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:29 smithi136 ceph-mon[125702]: pgmap v6336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:15:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:31 smithi057 ceph-mon[92072]: pgmap v6337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:31 smithi122 ceph-mon[125440]: pgmap v6337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:31 smithi136 ceph-mon[125702]: pgmap v6337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:33 smithi057 ceph-mon[92072]: pgmap v6338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:33 smithi122 ceph-mon[125440]: pgmap v6338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:33 smithi136 ceph-mon[125702]: pgmap v6338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:35.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:35 smithi057 ceph-mon[92072]: pgmap v6339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:35 smithi122 ceph-mon[125440]: pgmap v6339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:35 smithi136 ceph-mon[125702]: pgmap v6339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:37 smithi057 ceph-mon[92072]: pgmap v6340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:37 smithi122 ceph-mon[125440]: pgmap v6340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:37 smithi136 ceph-mon[125702]: pgmap v6340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:39 smithi057 ceph-mon[92072]: pgmap v6341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:39 smithi122 ceph-mon[125440]: pgmap v6341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:39 smithi136 ceph-mon[125702]: pgmap v6341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:41 smithi057 ceph-mon[92072]: pgmap v6342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:41 smithi122 ceph-mon[125440]: pgmap v6342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:41 smithi136 ceph-mon[125702]: pgmap v6342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:43.142+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:43.142+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:43.142+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:43.142+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:43.142+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:15:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:43 smithi057 ceph-mon[92072]: pgmap v6343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:43 smithi122 ceph-mon[125440]: pgmap v6343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:43 smithi136 ceph-mon[125702]: pgmap v6343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:45 smithi057 ceph-mon[92072]: pgmap v6344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:45 smithi122 ceph-mon[125440]: pgmap v6344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:45 smithi136 ceph-mon[125702]: pgmap v6344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:47 smithi057 ceph-mon[92072]: pgmap v6345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:47 smithi122 ceph-mon[125440]: pgmap v6345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:47 smithi136 ceph-mon[125702]: pgmap v6345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:49 smithi122 ceph-mon[125440]: pgmap v6346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:49 smithi136 ceph-mon[125702]: pgmap v6346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:49 smithi057 ceph-mon[92072]: pgmap v6346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:51 smithi122 ceph-mon[125440]: pgmap v6347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:51 smithi136 ceph-mon[125702]: pgmap v6347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:51 smithi057 ceph-mon[92072]: pgmap v6347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:53 smithi122 ceph-mon[125440]: pgmap v6348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:53 smithi136 ceph-mon[125702]: pgmap v6348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:53 smithi057 ceph-mon[92072]: pgmap v6348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:55 smithi136 ceph-mon[125702]: pgmap v6349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:55 smithi057 ceph-mon[92072]: pgmap v6349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:55 smithi122 ceph-mon[125440]: pgmap v6349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:57 smithi136 ceph-mon[125702]: pgmap v6350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:57 smithi057 ceph-mon[92072]: pgmap v6350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:57 smithi122 ceph-mon[125440]: pgmap v6350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:15:58.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:58.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:15:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:58.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:15:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:58.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:15:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:58.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:15:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:15:58.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:15:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:15:59 smithi136 ceph-mon[125702]: pgmap v6351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:15:59 smithi057 ceph-mon[92072]: pgmap v6351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:15:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:15:59 smithi122 ceph-mon[125440]: pgmap v6351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:01 smithi136 ceph-mon[125702]: pgmap v6352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:01 smithi057 ceph-mon[92072]: pgmap v6352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:01 smithi122 ceph-mon[125440]: pgmap v6352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:03 smithi136 ceph-mon[125702]: pgmap v6353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:16:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:03 smithi057 ceph-mon[92072]: pgmap v6353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:16:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:03 smithi122 ceph-mon[125440]: pgmap v6353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:16:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:05 smithi136 ceph-mon[125702]: pgmap v6354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:16:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:05 smithi057 ceph-mon[92072]: pgmap v6354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:16:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:05 smithi122 ceph-mon[125440]: pgmap v6354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:16:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:07 smithi136 ceph-mon[125702]: pgmap v6355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:16:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:07 smithi057 ceph-mon[92072]: pgmap v6355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:16:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:07 smithi122 ceph-mon[125440]: pgmap v6355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:16:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:09 smithi136 ceph-mon[125702]: pgmap v6356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:16:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:09 smithi057 ceph-mon[92072]: pgmap v6356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:16:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:09 smithi122 ceph-mon[125440]: pgmap v6356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:16:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:11 smithi136 ceph-mon[125702]: pgmap v6357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:16:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:11 smithi136 ceph-mon[125702]: osdmap e469: 12 total, 12 up, 12 in 2023-03-02T14:16:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:11 smithi057 ceph-mon[92072]: pgmap v6357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:16:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:11 smithi057 ceph-mon[92072]: osdmap e469: 12 total, 12 up, 12 in 2023-03-02T14:16:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:11 smithi122 ceph-mon[125440]: pgmap v6357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:16:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:11 smithi122 ceph-mon[125440]: osdmap e469: 12 total, 12 up, 12 in 2023-03-02T14:16:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:13.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:16:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:13.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:16:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:13.169+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:16:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:13.169+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:16:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:13.169+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:16:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:13 smithi136 ceph-mon[125702]: pgmap v6359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:16:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:13 smithi057 ceph-mon[92072]: pgmap v6359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:16:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:13 smithi122 ceph-mon[125440]: pgmap v6359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:16:14.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:14 smithi136 ceph-mon[125702]: pgmap v6360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:16:14.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:14 smithi057 ceph-mon[92072]: pgmap v6360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:16:14.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:14 smithi122 ceph-mon[125440]: pgmap v6360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:16:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:17 smithi136 ceph-mon[125702]: pgmap v6361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:16:17.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:17 smithi057 ceph-mon[92072]: pgmap v6361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:16:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:17 smithi122 ceph-mon[125440]: pgmap v6361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:16:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:18 smithi136 ceph-mon[125702]: osdmap e470: 12 total, 12 up, 12 in 2023-03-02T14:16:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:16:18.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:18 smithi057 ceph-mon[92072]: osdmap e470: 12 total, 12 up, 12 in 2023-03-02T14:16:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:16:18.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:18 smithi122 ceph-mon[125440]: osdmap e470: 12 total, 12 up, 12 in 2023-03-02T14:16:18.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:16:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:19 smithi136 ceph-mon[125702]: pgmap v6363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:16:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:19 smithi057 ceph-mon[92072]: pgmap v6363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:16:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:19 smithi122 ceph-mon[125440]: pgmap v6363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:16:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:16:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:16:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:20.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:16:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:16:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:20.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:16:20.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:16:20.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:16:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:21 smithi136 ceph-mon[125702]: pgmap v6364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T14:16:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:21 smithi057 ceph-mon[92072]: pgmap v6364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T14:16:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:21 smithi122 ceph-mon[125440]: pgmap v6364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T14:16:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:23 smithi136 ceph-mon[125702]: pgmap v6365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:16:23.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:23 smithi057 ceph-mon[92072]: pgmap v6365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:16:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:23 smithi122 ceph-mon[125440]: pgmap v6365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:16:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:25 smithi136 ceph-mon[125702]: pgmap v6366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:16:25.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:25 smithi057 ceph-mon[92072]: pgmap v6366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:16:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:25 smithi122 ceph-mon[125440]: pgmap v6366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:16:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:27 smithi136 ceph-mon[125702]: pgmap v6367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:16:27.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:27 smithi057 ceph-mon[92072]: pgmap v6367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:16:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:27 smithi122 ceph-mon[125440]: pgmap v6367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:16:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:28.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:16:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:28.184+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:16:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:28.184+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:16:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:28.184+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:16:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:28.184+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:16:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:29 smithi136 ceph-mon[125702]: pgmap v6368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:16:29.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:29 smithi057 ceph-mon[92072]: pgmap v6368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:16:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:29 smithi122 ceph-mon[125440]: pgmap v6368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:16:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:31 smithi136 ceph-mon[125702]: pgmap v6369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:31 smithi057 ceph-mon[92072]: pgmap v6369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:31 smithi122 ceph-mon[125440]: pgmap v6369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:33 smithi136 ceph-mon[125702]: pgmap v6370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:33 smithi057 ceph-mon[92072]: pgmap v6370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:33 smithi122 ceph-mon[125440]: pgmap v6370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:35 smithi136 ceph-mon[125702]: pgmap v6371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:35.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:35 smithi057 ceph-mon[92072]: pgmap v6371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:35 smithi122 ceph-mon[125440]: pgmap v6371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:37 smithi136 ceph-mon[125702]: pgmap v6372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:37 smithi057 ceph-mon[92072]: pgmap v6372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:37 smithi122 ceph-mon[125440]: pgmap v6372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:39 smithi136 ceph-mon[125702]: pgmap v6373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:39 smithi057 ceph-mon[92072]: pgmap v6373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:39 smithi122 ceph-mon[125440]: pgmap v6373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:41 smithi136 ceph-mon[125702]: pgmap v6374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:41 smithi057 ceph-mon[92072]: pgmap v6374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:41 smithi122 ceph-mon[125440]: pgmap v6374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:43.195+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:16:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:43.195+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:16:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:43.195+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:16:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:43.195+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:16:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:43.195+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:16:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:43 smithi057 ceph-mon[92072]: pgmap v6375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:43 smithi122 ceph-mon[125440]: pgmap v6375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:43 smithi136 ceph-mon[125702]: pgmap v6375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:45 smithi057 ceph-mon[92072]: pgmap v6376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:45 smithi122 ceph-mon[125440]: pgmap v6376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:45 smithi136 ceph-mon[125702]: pgmap v6376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:47 smithi057 ceph-mon[92072]: pgmap v6377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:47 smithi122 ceph-mon[125440]: pgmap v6377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:47 smithi136 ceph-mon[125702]: pgmap v6377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:49.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:49 smithi057 ceph-mon[92072]: pgmap v6378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:49 smithi122 ceph-mon[125440]: pgmap v6378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:49 smithi136 ceph-mon[125702]: pgmap v6378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:51 smithi057 ceph-mon[92072]: pgmap v6379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:51 smithi122 ceph-mon[125440]: pgmap v6379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:51 smithi136 ceph-mon[125702]: pgmap v6379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:53 smithi057 ceph-mon[92072]: pgmap v6380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:53 smithi122 ceph-mon[125440]: pgmap v6380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:53 smithi136 ceph-mon[125702]: pgmap v6380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:55 smithi057 ceph-mon[92072]: pgmap v6381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:55 smithi122 ceph-mon[125440]: pgmap v6381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:55 smithi136 ceph-mon[125702]: pgmap v6381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:57 smithi057 ceph-mon[92072]: pgmap v6382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:57 smithi122 ceph-mon[125440]: pgmap v6382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:57 smithi136 ceph-mon[125702]: pgmap v6382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:16:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:58.195+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:16:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:58.196+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:16:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:58.196+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:16:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:58.196+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:16:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:16:58.196+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:16:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:16:59 smithi057 ceph-mon[92072]: pgmap v6383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:16:59 smithi122 ceph-mon[125440]: pgmap v6383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:16:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:16:59 smithi136 ceph-mon[125702]: pgmap v6383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:01 smithi057 ceph-mon[92072]: pgmap v6384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:01 smithi122 ceph-mon[125440]: pgmap v6384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:01 smithi136 ceph-mon[125702]: pgmap v6384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:03 smithi057 ceph-mon[92072]: pgmap v6385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:17:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:03 smithi122 ceph-mon[125440]: pgmap v6385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:17:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:03 smithi136 ceph-mon[125702]: pgmap v6385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:17:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:05 smithi057 ceph-mon[92072]: pgmap v6386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:17:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:05 smithi122 ceph-mon[125440]: pgmap v6386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:17:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:05 smithi136 ceph-mon[125702]: pgmap v6386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:17:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:07 smithi057 ceph-mon[92072]: pgmap v6387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:17:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:07 smithi122 ceph-mon[125440]: pgmap v6387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:17:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:07 smithi136 ceph-mon[125702]: pgmap v6387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:17:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:09 smithi057 ceph-mon[92072]: pgmap v6388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:17:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:09 smithi122 ceph-mon[125440]: pgmap v6388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:17:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:09 smithi136 ceph-mon[125702]: pgmap v6388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:17:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:10.064+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:17:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:10.064+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:17:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:10.065+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 95 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:17:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:10.065+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 94 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:17:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:10.065+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:17:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:10.065+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:17:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:10.065+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 95 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:17:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:10.065+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 96 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:17:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:11 smithi057 ceph-mon[92072]: pgmap v6389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:17:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:11 smithi057 ceph-mon[92072]: osdmap e471: 12 total, 12 up, 12 in 2023-03-02T14:17:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:11 smithi122 ceph-mon[125440]: pgmap v6389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:17:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:11 smithi122 ceph-mon[125440]: osdmap e471: 12 total, 12 up, 12 in 2023-03-02T14:17:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:11 smithi136 ceph-mon[125702]: pgmap v6389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:17:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:11 smithi136 ceph-mon[125702]: osdmap e471: 12 total, 12 up, 12 in 2023-03-02T14:17:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:13.199+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:17:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:13.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:17:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:13.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:17:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:13.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:17:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:13.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:17:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:13 smithi057 ceph-mon[92072]: pgmap v6391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:17:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:13 smithi122 ceph-mon[125440]: pgmap v6391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:17:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:13 smithi136 ceph-mon[125702]: pgmap v6391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:17:15.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:15 smithi057 ceph-mon[92072]: pgmap v6392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:17:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:15 smithi122 ceph-mon[125440]: pgmap v6392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:17:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:15 smithi136 ceph-mon[125702]: pgmap v6392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:17:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:17 smithi057 ceph-mon[92072]: pgmap v6393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:17:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:17 smithi057 ceph-mon[92072]: osdmap e472: 12 total, 12 up, 12 in 2023-03-02T14:17:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:17 smithi122 ceph-mon[125440]: pgmap v6393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:17:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:17 smithi122 ceph-mon[125440]: osdmap e472: 12 total, 12 up, 12 in 2023-03-02T14:17:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:17 smithi136 ceph-mon[125702]: pgmap v6393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:17:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:17 smithi136 ceph-mon[125702]: osdmap e472: 12 total, 12 up, 12 in 2023-03-02T14:17:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:19 smithi122 ceph-mon[125440]: pgmap v6395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:17:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:17:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:19 smithi136 ceph-mon[125702]: pgmap v6395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:17:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:17:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:19 smithi057 ceph-mon[92072]: pgmap v6395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:17:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:17:20.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:17:20.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:17:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:17:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:17:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:17:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:17:20.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:17:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:17:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:17:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:21 smithi122 ceph-mon[125440]: pgmap v6396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:17:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:21 smithi136 ceph-mon[125702]: pgmap v6396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:17:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:21 smithi057 ceph-mon[92072]: pgmap v6396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:17:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:23 smithi136 ceph-mon[125702]: pgmap v6397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:17:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:23 smithi057 ceph-mon[92072]: pgmap v6397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:17:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:23 smithi122 ceph-mon[125440]: pgmap v6397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:17:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:25 smithi136 ceph-mon[125702]: pgmap v6398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:17:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:25 smithi057 ceph-mon[92072]: pgmap v6398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:17:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:25 smithi122 ceph-mon[125440]: pgmap v6398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:17:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:27 smithi136 ceph-mon[125702]: pgmap v6399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:17:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:27 smithi057 ceph-mon[92072]: pgmap v6399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:17:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:27 smithi122 ceph-mon[125440]: pgmap v6399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:17:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:28.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:17:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:28.205+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:17:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:28.205+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:17:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:28.205+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:17:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:28.205+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:17:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:29 smithi136 ceph-mon[125702]: pgmap v6400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:17:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:29 smithi057 ceph-mon[92072]: pgmap v6400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:17:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:29 smithi122 ceph-mon[125440]: pgmap v6400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:17:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:31 smithi136 ceph-mon[125702]: pgmap v6401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:31 smithi057 ceph-mon[92072]: pgmap v6401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:31 smithi122 ceph-mon[125440]: pgmap v6401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:33 smithi136 ceph-mon[125702]: pgmap v6402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:33 smithi057 ceph-mon[92072]: pgmap v6402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:33 smithi122 ceph-mon[125440]: pgmap v6402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:35 smithi136 ceph-mon[125702]: pgmap v6403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:35 smithi057 ceph-mon[92072]: pgmap v6403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:35 smithi122 ceph-mon[125440]: pgmap v6403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:37 smithi136 ceph-mon[125702]: pgmap v6404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:37 smithi057 ceph-mon[92072]: pgmap v6404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:37 smithi122 ceph-mon[125440]: pgmap v6404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:39 smithi136 ceph-mon[125702]: pgmap v6405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:39.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:39 smithi057 ceph-mon[92072]: pgmap v6405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:39 smithi122 ceph-mon[125440]: pgmap v6405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:41 smithi136 ceph-mon[125702]: pgmap v6406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:41 smithi057 ceph-mon[92072]: pgmap v6406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:41 smithi122 ceph-mon[125440]: pgmap v6406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:43.211+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:17:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:43.212+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:17:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:43.212+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:17:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:43.212+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:17:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:43.212+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:17:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:43 smithi136 ceph-mon[125702]: pgmap v6407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:43 smithi057 ceph-mon[92072]: pgmap v6407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:43 smithi122 ceph-mon[125440]: pgmap v6407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:45 smithi136 ceph-mon[125702]: pgmap v6408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:45 smithi057 ceph-mon[92072]: pgmap v6408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:45 smithi122 ceph-mon[125440]: pgmap v6408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:47 smithi136 ceph-mon[125702]: pgmap v6409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:47 smithi057 ceph-mon[92072]: pgmap v6409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:47 smithi122 ceph-mon[125440]: pgmap v6409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:49 smithi136 ceph-mon[125702]: pgmap v6410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:49 smithi057 ceph-mon[92072]: pgmap v6410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:49 smithi122 ceph-mon[125440]: pgmap v6410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:51 smithi136 ceph-mon[125702]: pgmap v6411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:51 smithi057 ceph-mon[92072]: pgmap v6411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:51 smithi122 ceph-mon[125440]: pgmap v6411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:53 smithi136 ceph-mon[125702]: pgmap v6412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:53 smithi057 ceph-mon[92072]: pgmap v6412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:53 smithi122 ceph-mon[125440]: pgmap v6412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:55 smithi136 ceph-mon[125702]: pgmap v6413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:55 smithi057 ceph-mon[92072]: pgmap v6413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:55 smithi122 ceph-mon[125440]: pgmap v6413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:56.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:56 smithi136 ceph-mon[125702]: pgmap v6414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:56.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:56 smithi057 ceph-mon[92072]: pgmap v6414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:56.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:56 smithi122 ceph-mon[125440]: pgmap v6414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:17:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:58.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:17:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:58.223+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:17:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:58.223+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:17:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:58.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:17:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:17:58.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:17:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:17:59 smithi136 ceph-mon[125702]: pgmap v6415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:17:59 smithi057 ceph-mon[92072]: pgmap v6415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:17:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:17:59 smithi122 ceph-mon[125440]: pgmap v6415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:01 smithi136 ceph-mon[125702]: pgmap v6416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:01 smithi057 ceph-mon[92072]: pgmap v6416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:01 smithi122 ceph-mon[125440]: pgmap v6416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:03 smithi136 ceph-mon[125702]: pgmap v6417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:18:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:03 smithi057 ceph-mon[92072]: pgmap v6417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:18:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:03 smithi122 ceph-mon[125440]: pgmap v6417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:18:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:05 smithi136 ceph-mon[125702]: pgmap v6418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:18:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:05 smithi057 ceph-mon[92072]: pgmap v6418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:18:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:05 smithi122 ceph-mon[125440]: pgmap v6418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:18:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:07 smithi136 ceph-mon[125702]: pgmap v6419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:18:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:07 smithi057 ceph-mon[92072]: pgmap v6419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:18:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:07 smithi122 ceph-mon[125440]: pgmap v6419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:18:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:09 smithi136 ceph-mon[125702]: pgmap v6420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:18:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:09 smithi057 ceph-mon[92072]: pgmap v6420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:18:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:09 smithi122 ceph-mon[125440]: pgmap v6420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:18:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:11 smithi136 ceph-mon[125702]: pgmap v6421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:18:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:11 smithi057 ceph-mon[92072]: pgmap v6421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:18:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:11 smithi122 ceph-mon[125440]: pgmap v6421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:18:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:12 smithi136 ceph-mon[125702]: osdmap e473: 12 total, 12 up, 12 in 2023-03-02T14:18:12.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:12 smithi057 ceph-mon[92072]: osdmap e473: 12 total, 12 up, 12 in 2023-03-02T14:18:12.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:12 smithi122 ceph-mon[125440]: osdmap e473: 12 total, 12 up, 12 in 2023-03-02T14:18:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:13.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:18:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:13.224+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:18:13.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:13.224+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:18:13.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:13.224+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:18:13.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:13.224+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:18:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:13 smithi136 ceph-mon[125702]: pgmap v6423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:13 smithi057 ceph-mon[92072]: pgmap v6423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:13 smithi122 ceph-mon[125440]: pgmap v6423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:15 smithi136 ceph-mon[125702]: pgmap v6424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:15.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:15 smithi057 ceph-mon[92072]: pgmap v6424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:15 smithi122 ceph-mon[125440]: pgmap v6424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:17 smithi136 ceph-mon[125702]: pgmap v6425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:17 smithi057 ceph-mon[92072]: pgmap v6425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:17 smithi122 ceph-mon[125440]: pgmap v6425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:19 smithi136 ceph-mon[125702]: pgmap v6426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:19 smithi057 ceph-mon[92072]: pgmap v6426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:19 smithi122 ceph-mon[125440]: pgmap v6426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:20.588 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:18:20.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:18:20.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:18:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:21 smithi136 ceph-mon[125702]: pgmap v6427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:18:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:18:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:18:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:21 smithi057 ceph-mon[92072]: pgmap v6427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:18:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:18:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:18:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:21 smithi122 ceph-mon[125440]: pgmap v6427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:18:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:18:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:18:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:18:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:23 smithi136 ceph-mon[125702]: pgmap v6428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 189 B/s wr, 14 op/s 2023-03-02T14:18:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:23 smithi136 ceph-mon[125702]: osdmap e474: 12 total, 12 up, 12 in 2023-03-02T14:18:23.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:23 smithi057 ceph-mon[92072]: pgmap v6428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 189 B/s wr, 14 op/s 2023-03-02T14:18:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:23 smithi057 ceph-mon[92072]: osdmap e474: 12 total, 12 up, 12 in 2023-03-02T14:18:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:23 smithi122 ceph-mon[125440]: pgmap v6428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 189 B/s wr, 14 op/s 2023-03-02T14:18:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:23 smithi122 ceph-mon[125440]: osdmap e474: 12 total, 12 up, 12 in 2023-03-02T14:18:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:25 smithi136 ceph-mon[125702]: pgmap v6430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:18:25.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:25 smithi057 ceph-mon[92072]: pgmap v6430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:18:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:25 smithi122 ceph-mon[125440]: pgmap v6430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:18:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:27 smithi136 ceph-mon[125702]: pgmap v6431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:18:27.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:27 smithi057 ceph-mon[92072]: pgmap v6431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:18:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:27 smithi122 ceph-mon[125440]: pgmap v6431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:18:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:28.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:18:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:28.236+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:18:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:28.236+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:18:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:28.236+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:18:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:28.236+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:18:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:29 smithi136 ceph-mon[125702]: pgmap v6432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:18:29.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:29 smithi057 ceph-mon[92072]: pgmap v6432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:18:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:29 smithi122 ceph-mon[125440]: pgmap v6432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:18:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:31 smithi136 ceph-mon[125702]: pgmap v6433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:18:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:31 smithi057 ceph-mon[92072]: pgmap v6433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:18:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:31 smithi122 ceph-mon[125440]: pgmap v6433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:18:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:33 smithi136 ceph-mon[125702]: pgmap v6434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:18:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:33 smithi057 ceph-mon[92072]: pgmap v6434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:18:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:33 smithi122 ceph-mon[125440]: pgmap v6434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:18:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:35 smithi136 ceph-mon[125702]: pgmap v6435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:35.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:35 smithi057 ceph-mon[92072]: pgmap v6435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:35 smithi122 ceph-mon[125440]: pgmap v6435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:37 smithi136 ceph-mon[125702]: pgmap v6436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:37 smithi057 ceph-mon[92072]: pgmap v6436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:37 smithi122 ceph-mon[125440]: pgmap v6436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:39 smithi136 ceph-mon[125702]: pgmap v6437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:39 smithi057 ceph-mon[92072]: pgmap v6437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:39 smithi122 ceph-mon[125440]: pgmap v6437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:41 smithi136 ceph-mon[125702]: pgmap v6438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:41 smithi057 ceph-mon[92072]: pgmap v6438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:41 smithi122 ceph-mon[125440]: pgmap v6438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:43.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:18:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:43.251+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:18:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:43.251+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:18:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:43.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:18:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:43.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:18:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:43 smithi136 ceph-mon[125702]: pgmap v6439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:43 smithi057 ceph-mon[92072]: pgmap v6439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:43 smithi122 ceph-mon[125440]: pgmap v6439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:45 smithi136 ceph-mon[125702]: pgmap v6440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:45 smithi057 ceph-mon[92072]: pgmap v6440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:45 smithi122 ceph-mon[125440]: pgmap v6440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:47 smithi136 ceph-mon[125702]: pgmap v6441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:47 smithi057 ceph-mon[92072]: pgmap v6441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:47 smithi122 ceph-mon[125440]: pgmap v6441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:49 smithi136 ceph-mon[125702]: pgmap v6442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:49.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:49 smithi057 ceph-mon[92072]: pgmap v6442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:49 smithi122 ceph-mon[125440]: pgmap v6442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:51 smithi136 ceph-mon[125702]: pgmap v6443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:51 smithi057 ceph-mon[92072]: pgmap v6443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:51 smithi122 ceph-mon[125440]: pgmap v6443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:53 smithi136 ceph-mon[125702]: pgmap v6444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:53 smithi057 ceph-mon[92072]: pgmap v6444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:53 smithi122 ceph-mon[125440]: pgmap v6444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:55 smithi136 ceph-mon[125702]: pgmap v6445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:55 smithi057 ceph-mon[92072]: pgmap v6445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:55 smithi122 ceph-mon[125440]: pgmap v6445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:57 smithi136 ceph-mon[125702]: pgmap v6446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:57 smithi057 ceph-mon[92072]: pgmap v6446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:57 smithi122 ceph-mon[125440]: pgmap v6446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:18:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:58.255+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:18:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:58.256+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:18:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:58.256+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:18:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:58.256+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:18:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:18:58.256+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:18:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:18:59 smithi136 ceph-mon[125702]: pgmap v6447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:18:59 smithi057 ceph-mon[92072]: pgmap v6447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:18:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:18:59 smithi122 ceph-mon[125440]: pgmap v6447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:01 smithi136 ceph-mon[125702]: pgmap v6448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:01 smithi057 ceph-mon[92072]: pgmap v6448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:01 smithi122 ceph-mon[125440]: pgmap v6448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:03 smithi057 ceph-mon[92072]: pgmap v6449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:19:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:03 smithi122 ceph-mon[125440]: pgmap v6449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:19:03.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:03 smithi136 ceph-mon[125702]: pgmap v6449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:19:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:05 smithi057 ceph-mon[92072]: pgmap v6450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:19:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:05 smithi122 ceph-mon[125440]: pgmap v6450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:19:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:05 smithi136 ceph-mon[125702]: pgmap v6450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:19:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:07 smithi057 ceph-mon[92072]: pgmap v6451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:19:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:07 smithi122 ceph-mon[125440]: pgmap v6451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:19:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:07 smithi136 ceph-mon[125702]: pgmap v6451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:19:09.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:09 smithi057 ceph-mon[92072]: pgmap v6452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:19:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:09 smithi122 ceph-mon[125440]: pgmap v6452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:19:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:09 smithi136 ceph-mon[125702]: pgmap v6452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:19:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:11 smithi057 ceph-mon[92072]: pgmap v6453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:19:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:11 smithi057 ceph-mon[92072]: osdmap e475: 12 total, 12 up, 12 in 2023-03-02T14:19:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:11 smithi122 ceph-mon[125440]: pgmap v6453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:19:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:11 smithi122 ceph-mon[125440]: osdmap e475: 12 total, 12 up, 12 in 2023-03-02T14:19:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:11 smithi136 ceph-mon[125702]: pgmap v6453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:19:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:11 smithi136 ceph-mon[125702]: osdmap e475: 12 total, 12 up, 12 in 2023-03-02T14:19:13.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:13.270+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:19:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:13.270+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:19:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:13.270+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:19:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:13.270+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:19:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:13.270+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:19:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:13 smithi057 ceph-mon[92072]: pgmap v6455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:19:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:13 smithi122 ceph-mon[125440]: pgmap v6455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:19:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:13 smithi136 ceph-mon[125702]: pgmap v6455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:19:15.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:15 smithi057 ceph-mon[92072]: pgmap v6456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:19:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:15 smithi122 ceph-mon[125440]: pgmap v6456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:19:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:15 smithi136 ceph-mon[125702]: pgmap v6456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:19:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:17 smithi057 ceph-mon[92072]: pgmap v6457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:19:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:17 smithi057 ceph-mon[92072]: osdmap e476: 12 total, 12 up, 12 in 2023-03-02T14:19:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:17 smithi122 ceph-mon[125440]: pgmap v6457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:19:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:17 smithi122 ceph-mon[125440]: osdmap e476: 12 total, 12 up, 12 in 2023-03-02T14:19:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:17 smithi136 ceph-mon[125702]: pgmap v6457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:19:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:17 smithi136 ceph-mon[125702]: osdmap e476: 12 total, 12 up, 12 in 2023-03-02T14:19:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:19 smithi057 ceph-mon[92072]: pgmap v6459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:19:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:19 smithi122 ceph-mon[125440]: pgmap v6459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:19:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:19 smithi136 ceph-mon[125702]: pgmap v6459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:19:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:21 smithi057 ceph-mon[92072]: pgmap v6460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:19:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:19:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:21 smithi122 ceph-mon[125440]: pgmap v6460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:19:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:19:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:21 smithi136 ceph-mon[125702]: pgmap v6460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:19:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:19:22.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:19:22.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:19:22.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:19:22.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:19:22.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:19:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:19:22.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:19:22.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:19:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:19:23.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:23 smithi057 ceph-mon[92072]: pgmap v6461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:19:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:23 smithi122 ceph-mon[125440]: pgmap v6461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:19:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:23 smithi136 ceph-mon[125702]: pgmap v6461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:19:25.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:25 smithi057 ceph-mon[92072]: pgmap v6462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:19:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:25 smithi122 ceph-mon[125440]: pgmap v6462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:19:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:25 smithi136 ceph-mon[125702]: pgmap v6462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:19:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:27 smithi057 ceph-mon[92072]: pgmap v6463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:19:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:27 smithi122 ceph-mon[125440]: pgmap v6463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:19:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:27 smithi136 ceph-mon[125702]: pgmap v6463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:19:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:28.286+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:19:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:28.286+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:19:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:28.286+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:19:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:28.286+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:19:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:28.286+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:19:29.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:29 smithi057 ceph-mon[92072]: pgmap v6464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:19:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:29 smithi122 ceph-mon[125440]: pgmap v6464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:19:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:29 smithi136 ceph-mon[125702]: pgmap v6464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:19:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:31 smithi057 ceph-mon[92072]: pgmap v6465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:31 smithi122 ceph-mon[125440]: pgmap v6465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:31 smithi136 ceph-mon[125702]: pgmap v6465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:33 smithi057 ceph-mon[92072]: pgmap v6466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:33 smithi122 ceph-mon[125440]: pgmap v6466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:33 smithi136 ceph-mon[125702]: pgmap v6466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:35.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:35 smithi057 ceph-mon[92072]: pgmap v6467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:35 smithi122 ceph-mon[125440]: pgmap v6467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:35 smithi136 ceph-mon[125702]: pgmap v6467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:37 smithi057 ceph-mon[92072]: pgmap v6468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:37 smithi122 ceph-mon[125440]: pgmap v6468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:37 smithi136 ceph-mon[125702]: pgmap v6468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:39 smithi122 ceph-mon[125440]: pgmap v6469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:39 smithi136 ceph-mon[125702]: pgmap v6469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:39.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:39 smithi057 ceph-mon[92072]: pgmap v6469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:41 smithi122 ceph-mon[125440]: pgmap v6470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:41 smithi136 ceph-mon[125702]: pgmap v6470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:41 smithi057 ceph-mon[92072]: pgmap v6470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:43.291+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:19:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:43.291+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:19:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:43.291+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:19:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:43.291+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:19:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:43.291+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:19:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:43 smithi136 ceph-mon[125702]: pgmap v6471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:43 smithi057 ceph-mon[92072]: pgmap v6471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:43 smithi122 ceph-mon[125440]: pgmap v6471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:45 smithi136 ceph-mon[125702]: pgmap v6472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:45 smithi057 ceph-mon[92072]: pgmap v6472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:45 smithi122 ceph-mon[125440]: pgmap v6472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:47 smithi136 ceph-mon[125702]: pgmap v6473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:47 smithi057 ceph-mon[92072]: pgmap v6473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:47 smithi122 ceph-mon[125440]: pgmap v6473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:49 smithi136 ceph-mon[125702]: pgmap v6474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:49 smithi057 ceph-mon[92072]: pgmap v6474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:49 smithi122 ceph-mon[125440]: pgmap v6474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:51 smithi136 ceph-mon[125702]: pgmap v6475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:51 smithi057 ceph-mon[92072]: pgmap v6475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:51 smithi122 ceph-mon[125440]: pgmap v6475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:53 smithi136 ceph-mon[125702]: pgmap v6476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:53 smithi057 ceph-mon[92072]: pgmap v6476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:53 smithi122 ceph-mon[125440]: pgmap v6476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:55 smithi136 ceph-mon[125702]: pgmap v6477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:55 smithi057 ceph-mon[92072]: pgmap v6477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:55 smithi122 ceph-mon[125440]: pgmap v6477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:57 smithi136 ceph-mon[125702]: pgmap v6478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:57 smithi057 ceph-mon[92072]: pgmap v6478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:57 smithi122 ceph-mon[125440]: pgmap v6478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:19:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:58.296+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:19:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:58.296+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:19:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:58.296+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:19:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:58.296+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:19:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:19:58.296+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:19:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:19:59 smithi136 ceph-mon[125702]: pgmap v6479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:19:59 smithi057 ceph-mon[92072]: pgmap v6479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:19:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:19:59 smithi122 ceph-mon[125440]: pgmap v6479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:00.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T14:20:00.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T14:20:00.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T14:20:01.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:01 smithi136 ceph-mon[125702]: pgmap v6480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:01 smithi057 ceph-mon[92072]: pgmap v6480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:01 smithi122 ceph-mon[125440]: pgmap v6480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:03 smithi136 ceph-mon[125702]: pgmap v6481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:20:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:03 smithi057 ceph-mon[92072]: pgmap v6481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:20:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:03 smithi122 ceph-mon[125440]: pgmap v6481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:20:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:05 smithi136 ceph-mon[125702]: pgmap v6482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:20:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:05 smithi057 ceph-mon[92072]: pgmap v6482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:20:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:05 smithi122 ceph-mon[125440]: pgmap v6482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:20:06.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:06 smithi136 ceph-mon[125702]: osdmap e477: 12 total, 12 up, 12 in 2023-03-02T14:20:06.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:06 smithi057 ceph-mon[92072]: osdmap e477: 12 total, 12 up, 12 in 2023-03-02T14:20:06.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:06 smithi122 ceph-mon[125440]: osdmap e477: 12 total, 12 up, 12 in 2023-03-02T14:20:07.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:07 smithi136 ceph-mon[125702]: pgmap v6484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:20:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:07 smithi057 ceph-mon[92072]: pgmap v6484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:20:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:07 smithi122 ceph-mon[125440]: pgmap v6484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:20:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:09 smithi136 ceph-mon[125702]: pgmap v6485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:20:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:09 smithi057 ceph-mon[92072]: pgmap v6485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:20:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:09 smithi122 ceph-mon[125440]: pgmap v6485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:20:10.091 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:10.091+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:20:10.091 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:10.091+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:20:10.092 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:10.091+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 97 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:20:10.092 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:10.091+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 96 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:20:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:11 smithi136 ceph-mon[125702]: pgmap v6486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:20:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:11 smithi057 ceph-mon[92072]: pgmap v6486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:20:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:11 smithi122 ceph-mon[125440]: pgmap v6486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:20:13.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:13.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:20:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:13.310+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:20:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:13.310+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:20:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:13.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:20:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:13.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:20:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:13 smithi136 ceph-mon[125702]: pgmap v6487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:20:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:13 smithi136 ceph-mon[125702]: osdmap e478: 12 total, 12 up, 12 in 2023-03-02T14:20:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:13 smithi057 ceph-mon[92072]: pgmap v6487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:20:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:13 smithi057 ceph-mon[92072]: osdmap e478: 12 total, 12 up, 12 in 2023-03-02T14:20:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:13 smithi122 ceph-mon[125440]: pgmap v6487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:20:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:13 smithi122 ceph-mon[125440]: osdmap e478: 12 total, 12 up, 12 in 2023-03-02T14:20:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:15 smithi136 ceph-mon[125702]: pgmap v6489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T14:20:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:15 smithi057 ceph-mon[92072]: pgmap v6489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T14:20:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:15 smithi122 ceph-mon[125440]: pgmap v6489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T14:20:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:17 smithi136 ceph-mon[125702]: pgmap v6490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:20:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:17 smithi057 ceph-mon[92072]: pgmap v6490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:20:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:17 smithi122 ceph-mon[125440]: pgmap v6490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:20:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:19 smithi136 ceph-mon[125702]: pgmap v6491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:20:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:19 smithi057 ceph-mon[92072]: pgmap v6491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:20:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:19 smithi122 ceph-mon[125440]: pgmap v6491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:20:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:21 smithi136 ceph-mon[125702]: pgmap v6492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:20:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:21 smithi057 ceph-mon[92072]: pgmap v6492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:20:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:21 smithi122 ceph-mon[125440]: pgmap v6492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:20:22.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:20:22.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:20:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:20:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:23 smithi136 ceph-mon[125702]: pgmap v6493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:20:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:20:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:20:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:20:23.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:23 smithi057 ceph-mon[92072]: pgmap v6493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:20:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:20:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:20:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:20:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:23 smithi122 ceph-mon[125440]: pgmap v6493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:20:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:20:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:20:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:20:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:25 smithi136 ceph-mon[125702]: pgmap v6494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:25.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:25 smithi057 ceph-mon[92072]: pgmap v6494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:25 smithi122 ceph-mon[125440]: pgmap v6494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:27 smithi136 ceph-mon[125702]: pgmap v6495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:27.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:27 smithi057 ceph-mon[92072]: pgmap v6495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:27 smithi122 ceph-mon[125440]: pgmap v6495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:28.325+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:20:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:28.325+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:20:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:28.325+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:20:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:28.325+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:20:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:28.325+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:20:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:29 smithi136 ceph-mon[125702]: pgmap v6496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:29 smithi057 ceph-mon[92072]: pgmap v6496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:29 smithi122 ceph-mon[125440]: pgmap v6496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:31 smithi136 ceph-mon[125702]: pgmap v6497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:31 smithi057 ceph-mon[92072]: pgmap v6497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:31 smithi122 ceph-mon[125440]: pgmap v6497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:33 smithi136 ceph-mon[125702]: pgmap v6498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:33 smithi057 ceph-mon[92072]: pgmap v6498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:33 smithi122 ceph-mon[125440]: pgmap v6498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:35.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:35 smithi057 ceph-mon[92072]: pgmap v6499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:35 smithi122 ceph-mon[125440]: pgmap v6499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:35 smithi136 ceph-mon[125702]: pgmap v6499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:37 smithi057 ceph-mon[92072]: pgmap v6500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:37 smithi122 ceph-mon[125440]: pgmap v6500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:37 smithi136 ceph-mon[125702]: pgmap v6500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:39 smithi057 ceph-mon[92072]: pgmap v6501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:39 smithi122 ceph-mon[125440]: pgmap v6501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:39 smithi136 ceph-mon[125702]: pgmap v6501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:41 smithi057 ceph-mon[92072]: pgmap v6502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:41 smithi122 ceph-mon[125440]: pgmap v6502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:41 smithi136 ceph-mon[125702]: pgmap v6502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:43.339+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:20:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:43.339+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:20:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:43.339+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:20:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:43.339+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:20:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:43.339+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:20:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:43 smithi057 ceph-mon[92072]: pgmap v6503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:43 smithi122 ceph-mon[125440]: pgmap v6503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:43 smithi136 ceph-mon[125702]: pgmap v6503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:45 smithi057 ceph-mon[92072]: pgmap v6504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:45 smithi122 ceph-mon[125440]: pgmap v6504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:45 smithi136 ceph-mon[125702]: pgmap v6504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:47 smithi057 ceph-mon[92072]: pgmap v6505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:47 smithi122 ceph-mon[125440]: pgmap v6505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:47 smithi136 ceph-mon[125702]: pgmap v6505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:49 smithi057 ceph-mon[92072]: pgmap v6506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:49 smithi122 ceph-mon[125440]: pgmap v6506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:49 smithi136 ceph-mon[125702]: pgmap v6506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:51 smithi057 ceph-mon[92072]: pgmap v6507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:51 smithi122 ceph-mon[125440]: pgmap v6507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:51 smithi136 ceph-mon[125702]: pgmap v6507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:53 smithi057 ceph-mon[92072]: pgmap v6508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:53 smithi122 ceph-mon[125440]: pgmap v6508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:53 smithi136 ceph-mon[125702]: pgmap v6508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:55 smithi057 ceph-mon[92072]: pgmap v6509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:55 smithi122 ceph-mon[125440]: pgmap v6509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:55 smithi136 ceph-mon[125702]: pgmap v6509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:57 smithi057 ceph-mon[92072]: pgmap v6510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:57 smithi122 ceph-mon[125440]: pgmap v6510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:57 smithi136 ceph-mon[125702]: pgmap v6510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:20:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:58.347+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:20:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:58.348+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:20:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:58.348+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:20:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:58.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:20:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:20:58.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:20:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:20:59 smithi057 ceph-mon[92072]: pgmap v6511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:20:59 smithi122 ceph-mon[125440]: pgmap v6511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:20:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:20:59 smithi136 ceph-mon[125702]: pgmap v6511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:01 smithi057 ceph-mon[92072]: pgmap v6512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:01 smithi122 ceph-mon[125440]: pgmap v6512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:01 smithi136 ceph-mon[125702]: pgmap v6512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:03 smithi057 ceph-mon[92072]: pgmap v6513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:21:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:03 smithi122 ceph-mon[125440]: pgmap v6513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:21:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:03 smithi136 ceph-mon[125702]: pgmap v6513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:21:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:05 smithi057 ceph-mon[92072]: pgmap v6514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:21:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:05 smithi122 ceph-mon[125440]: pgmap v6514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:21:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:05 smithi136 ceph-mon[125702]: pgmap v6514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:21:06.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:06 smithi122 ceph-mon[125440]: osdmap e479: 12 total, 12 up, 12 in 2023-03-02T14:21:06.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:06 smithi136 ceph-mon[125702]: osdmap e479: 12 total, 12 up, 12 in 2023-03-02T14:21:06.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:06 smithi057 ceph-mon[92072]: osdmap e479: 12 total, 12 up, 12 in 2023-03-02T14:21:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:07 smithi122 ceph-mon[125440]: pgmap v6516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:21:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:07 smithi136 ceph-mon[125702]: pgmap v6516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:21:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:07 smithi057 ceph-mon[92072]: pgmap v6516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:21:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:09 smithi136 ceph-mon[125702]: pgmap v6517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:21:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:09 smithi057 ceph-mon[92072]: pgmap v6517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:21:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:09 smithi122 ceph-mon[125440]: pgmap v6517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:21:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:11 smithi136 ceph-mon[125702]: pgmap v6518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:21:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:11 smithi057 ceph-mon[92072]: pgmap v6518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:21:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:11 smithi122 ceph-mon[125440]: pgmap v6518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:21:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:13.362+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:21:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:13.363+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:21:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:13.363+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:21:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:13.363+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:21:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:13.363+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:21:13.588 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:13 smithi136 ceph-mon[125702]: pgmap v6519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:21:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:13 smithi136 ceph-mon[125702]: osdmap e480: 12 total, 12 up, 12 in 2023-03-02T14:21:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:13 smithi057 ceph-mon[92072]: pgmap v6519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:21:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:13 smithi057 ceph-mon[92072]: osdmap e480: 12 total, 12 up, 12 in 2023-03-02T14:21:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:13 smithi122 ceph-mon[125440]: pgmap v6519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:21:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:13 smithi122 ceph-mon[125440]: osdmap e480: 12 total, 12 up, 12 in 2023-03-02T14:21:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:15 smithi136 ceph-mon[125702]: pgmap v6521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T14:21:15.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:15 smithi057 ceph-mon[92072]: pgmap v6521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T14:21:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:15 smithi122 ceph-mon[125440]: pgmap v6521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T14:21:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:17 smithi136 ceph-mon[125702]: pgmap v6522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:21:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:17 smithi057 ceph-mon[92072]: pgmap v6522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:21:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:17 smithi122 ceph-mon[125440]: pgmap v6522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:21:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:19 smithi136 ceph-mon[125702]: pgmap v6523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:21:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:19 smithi057 ceph-mon[92072]: pgmap v6523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:21:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:19 smithi122 ceph-mon[125440]: pgmap v6523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:21:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:21 smithi136 ceph-mon[125702]: pgmap v6524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:21:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:21 smithi057 ceph-mon[92072]: pgmap v6524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:21:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:21 smithi122 ceph-mon[125440]: pgmap v6524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:21:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:23 smithi136 ceph-mon[125702]: pgmap v6525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:21:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:21:23.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:23 smithi057 ceph-mon[92072]: pgmap v6525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:21:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:21:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:23 smithi122 ceph-mon[125440]: pgmap v6525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:21:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:21:24.588 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:21:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:21:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:21:24.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:21:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:21:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:21:24.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:21:24.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:21:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:21:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:25 smithi136 ceph-mon[125702]: pgmap v6526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:25.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:25 smithi057 ceph-mon[92072]: pgmap v6526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:25 smithi122 ceph-mon[125440]: pgmap v6526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:27 smithi136 ceph-mon[125702]: pgmap v6527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:27.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:27 smithi057 ceph-mon[92072]: pgmap v6527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:27 smithi122 ceph-mon[125440]: pgmap v6527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:28.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:21:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:28.378+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:21:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:28.378+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:21:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:28.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:21:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:28.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:21:29.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:29 smithi057 ceph-mon[92072]: pgmap v6528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:29 smithi122 ceph-mon[125440]: pgmap v6528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:29 smithi136 ceph-mon[125702]: pgmap v6528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:31 smithi057 ceph-mon[92072]: pgmap v6529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:31 smithi122 ceph-mon[125440]: pgmap v6529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:31 smithi136 ceph-mon[125702]: pgmap v6529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:33 smithi057 ceph-mon[92072]: pgmap v6530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:33 smithi122 ceph-mon[125440]: pgmap v6530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:33 smithi136 ceph-mon[125702]: pgmap v6530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:35 smithi057 ceph-mon[92072]: pgmap v6531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:35 smithi122 ceph-mon[125440]: pgmap v6531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:35.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:35 smithi136 ceph-mon[125702]: pgmap v6531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:37 smithi057 ceph-mon[92072]: pgmap v6532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:37 smithi122 ceph-mon[125440]: pgmap v6532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:37.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:37 smithi136 ceph-mon[125702]: pgmap v6532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:39 smithi057 ceph-mon[92072]: pgmap v6533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:39 smithi122 ceph-mon[125440]: pgmap v6533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:39 smithi136 ceph-mon[125702]: pgmap v6533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:41 smithi057 ceph-mon[92072]: pgmap v6534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:41 smithi122 ceph-mon[125440]: pgmap v6534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:41.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:41 smithi136 ceph-mon[125702]: pgmap v6534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:43.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:21:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:43.395+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:21:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:43.395+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:21:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:43.395+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:21:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:43.395+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:21:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:43 smithi057 ceph-mon[92072]: pgmap v6535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:43 smithi122 ceph-mon[125440]: pgmap v6535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:43.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:43 smithi136 ceph-mon[125702]: pgmap v6535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:45 smithi057 ceph-mon[92072]: pgmap v6536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:45 smithi122 ceph-mon[125440]: pgmap v6536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:45 smithi136 ceph-mon[125702]: pgmap v6536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:47 smithi057 ceph-mon[92072]: pgmap v6537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:47 smithi122 ceph-mon[125440]: pgmap v6537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:47 smithi136 ceph-mon[125702]: pgmap v6537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:49 smithi057 ceph-mon[92072]: pgmap v6538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:49 smithi122 ceph-mon[125440]: pgmap v6538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:49 smithi136 ceph-mon[125702]: pgmap v6538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:51 smithi057 ceph-mon[92072]: pgmap v6539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:51 smithi122 ceph-mon[125440]: pgmap v6539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:51 smithi136 ceph-mon[125702]: pgmap v6539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:53 smithi057 ceph-mon[92072]: pgmap v6540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:53 smithi122 ceph-mon[125440]: pgmap v6540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:53 smithi136 ceph-mon[125702]: pgmap v6540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:55 smithi057 ceph-mon[92072]: pgmap v6541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:55 smithi122 ceph-mon[125440]: pgmap v6541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:55 smithi136 ceph-mon[125702]: pgmap v6541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:57 smithi057 ceph-mon[92072]: pgmap v6542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:57 smithi122 ceph-mon[125440]: pgmap v6542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:57 smithi136 ceph-mon[125702]: pgmap v6542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:21:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:58.410+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:21:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:58.410+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:21:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:58.410+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:21:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:58.410+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:21:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:21:58.410+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:21:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:21:59 smithi057 ceph-mon[92072]: pgmap v6543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:21:59 smithi122 ceph-mon[125440]: pgmap v6543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:21:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:21:59 smithi136 ceph-mon[125702]: pgmap v6543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:01 smithi057 ceph-mon[92072]: pgmap v6544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:01 smithi122 ceph-mon[125440]: pgmap v6544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:01 smithi136 ceph-mon[125702]: pgmap v6544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:03 smithi057 ceph-mon[92072]: pgmap v6545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:22:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:03 smithi122 ceph-mon[125440]: pgmap v6545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:22:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:03 smithi136 ceph-mon[125702]: pgmap v6545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:22:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:05 smithi057 ceph-mon[92072]: pgmap v6546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:22:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:05 smithi122 ceph-mon[125440]: pgmap v6546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:22:05.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:05 smithi136 ceph-mon[125702]: pgmap v6546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:22:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:07 smithi122 ceph-mon[125440]: pgmap v6547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:22:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:07 smithi136 ceph-mon[125702]: pgmap v6547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:22:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:07 smithi057 ceph-mon[92072]: pgmap v6547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:22:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:09 smithi122 ceph-mon[125440]: pgmap v6548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:22:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:09 smithi136 ceph-mon[125702]: pgmap v6548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:22:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:09 smithi057 ceph-mon[92072]: pgmap v6548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:22:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:11 smithi136 ceph-mon[125702]: pgmap v6549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:22:11.890 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:11 smithi136 ceph-mon[125702]: osdmap e481: 12 total, 12 up, 12 in 2023-03-02T14:22:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:11 smithi057 ceph-mon[92072]: pgmap v6549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:22:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:11 smithi057 ceph-mon[92072]: osdmap e481: 12 total, 12 up, 12 in 2023-03-02T14:22:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:11 smithi122 ceph-mon[125440]: pgmap v6549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:22:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:11 smithi122 ceph-mon[125440]: osdmap e481: 12 total, 12 up, 12 in 2023-03-02T14:22:13.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:13.419+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:22:13.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:13.419+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:22:13.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:13.419+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:22:13.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:13.419+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:22:13.420 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:13.419+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:22:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:13 smithi136 ceph-mon[125702]: pgmap v6551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:13 smithi057 ceph-mon[92072]: pgmap v6551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:13 smithi122 ceph-mon[125440]: pgmap v6551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:15 smithi136 ceph-mon[125702]: pgmap v6552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:15 smithi057 ceph-mon[92072]: pgmap v6552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:15 smithi122 ceph-mon[125440]: pgmap v6552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:17 smithi136 ceph-mon[125702]: pgmap v6553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:17 smithi136 ceph-mon[125702]: osdmap e482: 12 total, 12 up, 12 in 2023-03-02T14:22:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:17 smithi057 ceph-mon[92072]: pgmap v6553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:17 smithi057 ceph-mon[92072]: osdmap e482: 12 total, 12 up, 12 in 2023-03-02T14:22:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:17 smithi122 ceph-mon[125440]: pgmap v6553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:17 smithi122 ceph-mon[125440]: osdmap e482: 12 total, 12 up, 12 in 2023-03-02T14:22:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:19 smithi136 ceph-mon[125702]: pgmap v6555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:22:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:19 smithi057 ceph-mon[92072]: pgmap v6555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:22:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:19 smithi122 ceph-mon[125440]: pgmap v6555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:22:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:21 smithi136 ceph-mon[125702]: pgmap v6556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 317 B/s wr, 10 op/s 2023-03-02T14:22:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:21 smithi057 ceph-mon[92072]: pgmap v6556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 317 B/s wr, 10 op/s 2023-03-02T14:22:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:21 smithi122 ceph-mon[125440]: pgmap v6556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 317 B/s wr, 10 op/s 2023-03-02T14:22:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:23 smithi136 ceph-mon[125702]: pgmap v6557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:23 smithi057 ceph-mon[92072]: pgmap v6557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:23 smithi122 ceph-mon[125440]: pgmap v6557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:24.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:22:24.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:22:24.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:22:24.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:22:24.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:22:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:22:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:22:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:22:24.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:22:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:22:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:22:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:22:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:25 smithi136 ceph-mon[125702]: pgmap v6558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:25 smithi057 ceph-mon[92072]: pgmap v6558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:25 smithi122 ceph-mon[125440]: pgmap v6558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:27 smithi136 ceph-mon[125702]: pgmap v6559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:27 smithi057 ceph-mon[92072]: pgmap v6559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:27 smithi122 ceph-mon[125440]: pgmap v6559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:22:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:28.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:22:28.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:28.425+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:22:28.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:28.425+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:22:28.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:28.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:22:28.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:28.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:22:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:29 smithi136 ceph-mon[125702]: pgmap v6560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:22:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:29 smithi057 ceph-mon[92072]: pgmap v6560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:22:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:29 smithi122 ceph-mon[125440]: pgmap v6560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:22:31.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:31 smithi136 ceph-mon[125702]: pgmap v6561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:31 smithi057 ceph-mon[92072]: pgmap v6561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:31 smithi122 ceph-mon[125440]: pgmap v6561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:33.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:33 smithi136 ceph-mon[125702]: pgmap v6562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:33 smithi057 ceph-mon[92072]: pgmap v6562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:33 smithi122 ceph-mon[125440]: pgmap v6562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:35 smithi136 ceph-mon[125702]: pgmap v6563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:35 smithi057 ceph-mon[92072]: pgmap v6563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:35 smithi122 ceph-mon[125440]: pgmap v6563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:37 smithi136 ceph-mon[125702]: pgmap v6564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:37 smithi057 ceph-mon[92072]: pgmap v6564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:37 smithi122 ceph-mon[125440]: pgmap v6564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:39 smithi136 ceph-mon[125702]: pgmap v6565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:39.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:39 smithi057 ceph-mon[92072]: pgmap v6565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:39 smithi122 ceph-mon[125440]: pgmap v6565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:41 smithi136 ceph-mon[125702]: pgmap v6566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:41 smithi057 ceph-mon[92072]: pgmap v6566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:41 smithi122 ceph-mon[125440]: pgmap v6566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:43.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:22:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:43.436+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:22:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:43.436+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:22:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:43.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:22:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:43.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:22:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:43 smithi136 ceph-mon[125702]: pgmap v6567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:43 smithi057 ceph-mon[92072]: pgmap v6567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:43 smithi122 ceph-mon[125440]: pgmap v6567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:45 smithi136 ceph-mon[125702]: pgmap v6568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:45 smithi057 ceph-mon[92072]: pgmap v6568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:45 smithi122 ceph-mon[125440]: pgmap v6568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:47 smithi136 ceph-mon[125702]: pgmap v6569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:47 smithi057 ceph-mon[92072]: pgmap v6569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:47 smithi122 ceph-mon[125440]: pgmap v6569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:49 smithi136 ceph-mon[125702]: pgmap v6570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:49 smithi057 ceph-mon[92072]: pgmap v6570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:49 smithi122 ceph-mon[125440]: pgmap v6570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:51 smithi136 ceph-mon[125702]: pgmap v6571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:51 smithi057 ceph-mon[92072]: pgmap v6571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:51 smithi122 ceph-mon[125440]: pgmap v6571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:53.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:53 smithi136 ceph-mon[125702]: pgmap v6572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:53 smithi057 ceph-mon[92072]: pgmap v6572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:53 smithi122 ceph-mon[125440]: pgmap v6572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:55 smithi136 ceph-mon[125702]: pgmap v6573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:55 smithi057 ceph-mon[92072]: pgmap v6573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:55 smithi122 ceph-mon[125440]: pgmap v6573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:57 smithi136 ceph-mon[125702]: pgmap v6574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:57 smithi057 ceph-mon[92072]: pgmap v6574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:57 smithi122 ceph-mon[125440]: pgmap v6574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:22:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:58.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:22:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:58.452+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:22:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:58.452+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:22:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:58.452+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:22:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:22:58.452+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:22:58.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:22:58 smithi136 ceph-mon[125702]: pgmap v6575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:58.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:22:58 smithi057 ceph-mon[92072]: pgmap v6575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:22:58.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:22:58 smithi122 ceph-mon[125440]: pgmap v6575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:01 smithi122 ceph-mon[125440]: pgmap v6576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:01 smithi136 ceph-mon[125702]: pgmap v6576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:01 smithi057 ceph-mon[92072]: pgmap v6576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:03 smithi136 ceph-mon[125702]: pgmap v6577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:23:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:03 smithi057 ceph-mon[92072]: pgmap v6577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:23:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:03 smithi122 ceph-mon[125440]: pgmap v6577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:23:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:05 smithi057 ceph-mon[92072]: pgmap v6578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:23:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:05 smithi122 ceph-mon[125440]: pgmap v6578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:23:05.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:05 smithi136 ceph-mon[125702]: pgmap v6578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:23:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:07 smithi057 ceph-mon[92072]: pgmap v6579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:23:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:07 smithi122 ceph-mon[125440]: pgmap v6579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:23:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:07 smithi136 ceph-mon[125702]: pgmap v6579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:23:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:09 smithi057 ceph-mon[92072]: pgmap v6580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:23:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:09 smithi122 ceph-mon[125440]: pgmap v6580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:23:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:09 smithi136 ceph-mon[125702]: pgmap v6580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:23:10.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:10.117+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:23:10.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:10.117+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:23:10.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:10.117+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 98 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:23:10.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:10.118+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 97 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:23:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:11 smithi057 ceph-mon[92072]: pgmap v6581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:23:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:11 smithi057 ceph-mon[92072]: osdmap e483: 12 total, 12 up, 12 in 2023-03-02T14:23:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:11 smithi122 ceph-mon[125440]: pgmap v6581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:23:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:11 smithi122 ceph-mon[125440]: osdmap e483: 12 total, 12 up, 12 in 2023-03-02T14:23:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:11 smithi136 ceph-mon[125702]: pgmap v6581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:23:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:11 smithi136 ceph-mon[125702]: osdmap e483: 12 total, 12 up, 12 in 2023-03-02T14:23:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:13.464+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:23:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:13.465+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:23:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:13.465+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:23:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:13.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:23:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:13.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:23:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:13 smithi057 ceph-mon[92072]: pgmap v6583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:23:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:13 smithi122 ceph-mon[125440]: pgmap v6583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:23:13.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:13 smithi136 ceph-mon[125702]: pgmap v6583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:23:15.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:15 smithi057 ceph-mon[92072]: pgmap v6584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:23:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:15 smithi122 ceph-mon[125440]: pgmap v6584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:23:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:15 smithi136 ceph-mon[125702]: pgmap v6584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:23:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:17 smithi057 ceph-mon[92072]: pgmap v6585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:23:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:17 smithi057 ceph-mon[92072]: osdmap e484: 12 total, 12 up, 12 in 2023-03-02T14:23:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:17 smithi122 ceph-mon[125440]: pgmap v6585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:23:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:17 smithi122 ceph-mon[125440]: osdmap e484: 12 total, 12 up, 12 in 2023-03-02T14:23:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:17 smithi136 ceph-mon[125702]: pgmap v6585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:23:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:17 smithi136 ceph-mon[125702]: osdmap e484: 12 total, 12 up, 12 in 2023-03-02T14:23:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:19 smithi057 ceph-mon[92072]: pgmap v6587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:23:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:19 smithi122 ceph-mon[125440]: pgmap v6587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:23:19.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:19 smithi136 ceph-mon[125702]: pgmap v6587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:23:21.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:21 smithi057 ceph-mon[92072]: pgmap v6588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:23:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:21 smithi122 ceph-mon[125440]: pgmap v6588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:23:21.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:21 smithi136 ceph-mon[125702]: pgmap v6588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:23:23.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:23 smithi057 ceph-mon[92072]: pgmap v6589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:23:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:23 smithi122 ceph-mon[125440]: pgmap v6589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:23:23.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:23 smithi136 ceph-mon[125702]: pgmap v6589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:23:25.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:25 smithi057 ceph-mon[92072]: pgmap v6590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:23:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:23:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:25 smithi122 ceph-mon[125440]: pgmap v6590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:23:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:23:25.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:25 smithi136 ceph-mon[125702]: pgmap v6590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:23:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:23:27.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:27 smithi057 ceph-mon[92072]: pgmap v6591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:23:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:27 smithi122 ceph-mon[125440]: pgmap v6591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:23:27.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:27 smithi136 ceph-mon[125702]: pgmap v6591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:23:28.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:28.475+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:23:28.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:28.476+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:23:28.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:28.476+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:23:28.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:28.476+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:23:28.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:28.476+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:23:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: pgmap v6592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:23:29.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T14:23:29.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:23:29.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T14:23:29.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:23:29.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.098 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:23:29.098 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:23:29.098 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: pgmap v6592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:23:29.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T14:23:29.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:23:29.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T14:23:29.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:23:29.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.191 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.191 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.191 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.191 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:23:29.191 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:23:29.191 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: pgmap v6592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:23:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 223.0M 2023-03-02T14:23:29.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:23:29.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 233848115: error parsing value: Value '233848115' is below minimum 939524096 2023-03-02T14:23:29.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:23:29.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:23:29.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:23:29.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:23:29.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:23:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:29 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:23:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:29 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:23:30.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:29 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:23:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:29 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:23:30.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:29 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:23:30.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:29 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:23:31.338 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:30 smithi136 ceph-mon[125702]: pgmap v6593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:30 smithi057 ceph-mon[92072]: pgmap v6593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:30 smithi122 ceph-mon[125440]: pgmap v6593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:33 smithi057 ceph-mon[92072]: pgmap v6594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:33 smithi122 ceph-mon[125440]: pgmap v6594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:33.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:33 smithi136 ceph-mon[125702]: pgmap v6594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:35.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:35 smithi057 ceph-mon[92072]: pgmap v6595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:35 smithi122 ceph-mon[125440]: pgmap v6595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:35 smithi136 ceph-mon[125702]: pgmap v6595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:37 smithi057 ceph-mon[92072]: pgmap v6596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:37 smithi122 ceph-mon[125440]: pgmap v6596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:37 smithi136 ceph-mon[125702]: pgmap v6596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:39 smithi057 ceph-mon[92072]: pgmap v6597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:39 smithi122 ceph-mon[125440]: pgmap v6597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:39.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:39 smithi136 ceph-mon[125702]: pgmap v6597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:41 smithi057 ceph-mon[92072]: pgmap v6598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:23:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:41 smithi122 ceph-mon[125440]: pgmap v6598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:23:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:41 smithi136 ceph-mon[125702]: pgmap v6598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:23:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:43.476+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:23:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:43.476+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:23:43.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:43.476+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:23:43.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:43.476+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:23:43.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:43.477+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:23:43.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:43 smithi057 ceph-mon[92072]: pgmap v6599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:43.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:43 smithi122 ceph-mon[125440]: pgmap v6599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:43 smithi136 ceph-mon[125702]: pgmap v6599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:45.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:45 smithi057 ceph-mon[92072]: pgmap v6600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:23:45.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:45 smithi122 ceph-mon[125440]: pgmap v6600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:23:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:45 smithi136 ceph-mon[125702]: pgmap v6600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:23:47.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:47 smithi057 ceph-mon[92072]: pgmap v6601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:23:47.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:47 smithi122 ceph-mon[125440]: pgmap v6601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:23:47.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:47 smithi136 ceph-mon[125702]: pgmap v6601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:23:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:49 smithi057 ceph-mon[92072]: pgmap v6602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:49.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:49 smithi122 ceph-mon[125440]: pgmap v6602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:49 smithi136 ceph-mon[125702]: pgmap v6602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:51 smithi057 ceph-mon[92072]: pgmap v6603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:51 smithi122 ceph-mon[125440]: pgmap v6603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:51 smithi136 ceph-mon[125702]: pgmap v6603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:53 smithi057 ceph-mon[92072]: pgmap v6604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:53 smithi122 ceph-mon[125440]: pgmap v6604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:53 smithi136 ceph-mon[125702]: pgmap v6604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:55.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:55 smithi057 ceph-mon[92072]: pgmap v6605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:55 smithi122 ceph-mon[125440]: pgmap v6605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:55 smithi136 ceph-mon[125702]: pgmap v6605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:57 smithi057 ceph-mon[92072]: pgmap v6606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:57 smithi122 ceph-mon[125440]: pgmap v6606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:57.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:57 smithi136 ceph-mon[125702]: pgmap v6606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:23:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:58.488+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:58.489+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:58.489+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:58.489+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:23:58.489+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:23:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:23:59 smithi057 ceph-mon[92072]: pgmap v6607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:23:59 smithi122 ceph-mon[125440]: pgmap v6607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:23:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:23:59 smithi136 ceph-mon[125702]: pgmap v6607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:01 smithi057 ceph-mon[92072]: pgmap v6608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:01 smithi122 ceph-mon[125440]: pgmap v6608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:01 smithi136 ceph-mon[125702]: pgmap v6608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:03 smithi057 ceph-mon[92072]: pgmap v6609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:24:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:03 smithi122 ceph-mon[125440]: pgmap v6609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:24:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:03 smithi136 ceph-mon[125702]: pgmap v6609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:24:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:05 smithi057 ceph-mon[92072]: pgmap v6610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:24:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:05 smithi122 ceph-mon[125440]: pgmap v6610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:24:05.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:05 smithi136 ceph-mon[125702]: pgmap v6610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:24:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:07 smithi057 ceph-mon[92072]: pgmap v6611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:24:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:07 smithi122 ceph-mon[125440]: pgmap v6611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:24:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:07 smithi136 ceph-mon[125702]: pgmap v6611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:24:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:09 smithi057 ceph-mon[92072]: pgmap v6612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:24:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:09 smithi122 ceph-mon[125440]: pgmap v6612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:24:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:09 smithi136 ceph-mon[125702]: pgmap v6612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:24:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:11 smithi122 ceph-mon[125440]: pgmap v6613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:24:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:11 smithi122 ceph-mon[125440]: osdmap e485: 12 total, 12 up, 12 in 2023-03-02T14:24:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:11 smithi136 ceph-mon[125702]: pgmap v6613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:24:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:11 smithi136 ceph-mon[125702]: osdmap e485: 12 total, 12 up, 12 in 2023-03-02T14:24:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:11 smithi057 ceph-mon[92072]: pgmap v6613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:24:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:11 smithi057 ceph-mon[92072]: osdmap e485: 12 total, 12 up, 12 in 2023-03-02T14:24:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:13.500+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:24:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:13.501+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:24:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:13.501+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:24:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:13.501+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:24:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:13.501+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:24:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:13 smithi122 ceph-mon[125440]: pgmap v6615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:24:13.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:13 smithi136 ceph-mon[125702]: pgmap v6615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:24:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:13 smithi057 ceph-mon[92072]: pgmap v6615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:24:15.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:15 smithi136 ceph-mon[125702]: pgmap v6616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:24:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:15 smithi057 ceph-mon[92072]: pgmap v6616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:24:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:15 smithi122 ceph-mon[125440]: pgmap v6616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:24:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:17 smithi136 ceph-mon[125702]: pgmap v6617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:24:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:17 smithi136 ceph-mon[125702]: osdmap e486: 12 total, 12 up, 12 in 2023-03-02T14:24:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:17 smithi057 ceph-mon[92072]: pgmap v6617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:24:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:17 smithi057 ceph-mon[92072]: osdmap e486: 12 total, 12 up, 12 in 2023-03-02T14:24:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:17 smithi122 ceph-mon[125440]: pgmap v6617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:24:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:17 smithi122 ceph-mon[125440]: osdmap e486: 12 total, 12 up, 12 in 2023-03-02T14:24:19.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:19 smithi136 ceph-mon[125702]: pgmap v6619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:24:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:19 smithi057 ceph-mon[92072]: pgmap v6619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:24:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:19 smithi122 ceph-mon[125440]: pgmap v6619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:24:21.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:21 smithi136 ceph-mon[125702]: pgmap v6620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:24:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:21 smithi057 ceph-mon[92072]: pgmap v6620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:24:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:21 smithi122 ceph-mon[125440]: pgmap v6620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:24:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:23 smithi136 ceph-mon[125702]: pgmap v6621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:24:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:23 smithi057 ceph-mon[92072]: pgmap v6621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:24:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:23 smithi122 ceph-mon[125440]: pgmap v6621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:24:25.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:25 smithi136 ceph-mon[125702]: pgmap v6622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:24:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:25 smithi057 ceph-mon[92072]: pgmap v6622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:24:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:25 smithi122 ceph-mon[125440]: pgmap v6622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:24:27.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:27 smithi136 ceph-mon[125702]: pgmap v6623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:24:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:27 smithi057 ceph-mon[92072]: pgmap v6623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:24:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:27 smithi122 ceph-mon[125440]: pgmap v6623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:24:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:28.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:24:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:28.507+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:24:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:28.507+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:24:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:28.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:24:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:28.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:24:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:29 smithi136 ceph-mon[125702]: pgmap v6624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:24:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:24:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:29 smithi057 ceph-mon[92072]: pgmap v6624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:24:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:24:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:29 smithi122 ceph-mon[125440]: pgmap v6624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:24:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:24:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:24:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:24:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:24:30.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:24:30.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:24:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:24:30.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:24:30.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:24:30.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:24:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:31 smithi136 ceph-mon[125702]: pgmap v6625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:31 smithi057 ceph-mon[92072]: pgmap v6625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:31 smithi122 ceph-mon[125440]: pgmap v6625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:33 smithi136 ceph-mon[125702]: pgmap v6626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:33 smithi057 ceph-mon[92072]: pgmap v6626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:33 smithi122 ceph-mon[125440]: pgmap v6626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:35 smithi136 ceph-mon[125702]: pgmap v6627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:35 smithi057 ceph-mon[92072]: pgmap v6627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:35 smithi122 ceph-mon[125440]: pgmap v6627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:37 smithi136 ceph-mon[125702]: pgmap v6628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:37 smithi057 ceph-mon[92072]: pgmap v6628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:37 smithi122 ceph-mon[125440]: pgmap v6628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:39 smithi136 ceph-mon[125702]: pgmap v6629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:39 smithi057 ceph-mon[92072]: pgmap v6629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:39 smithi122 ceph-mon[125440]: pgmap v6629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:41 smithi136 ceph-mon[125702]: pgmap v6630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:41 smithi057 ceph-mon[92072]: pgmap v6630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:41 smithi122 ceph-mon[125440]: pgmap v6630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:43.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:24:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:43.510+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:24:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:43.510+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:24:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:43.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:24:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:43.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:24:43.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:43 smithi136 ceph-mon[125702]: pgmap v6631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:43 smithi057 ceph-mon[92072]: pgmap v6631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:43 smithi122 ceph-mon[125440]: pgmap v6631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:45.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:45 smithi136 ceph-mon[125702]: pgmap v6632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:45 smithi057 ceph-mon[92072]: pgmap v6632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:45 smithi122 ceph-mon[125440]: pgmap v6632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:47.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:47 smithi136 ceph-mon[125702]: pgmap v6633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:47 smithi057 ceph-mon[92072]: pgmap v6633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:47 smithi122 ceph-mon[125440]: pgmap v6633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:49.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:49 smithi136 ceph-mon[125702]: pgmap v6634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:49 smithi057 ceph-mon[92072]: pgmap v6634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:49 smithi122 ceph-mon[125440]: pgmap v6634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:51.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:51 smithi136 ceph-mon[125702]: pgmap v6635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:51 smithi057 ceph-mon[92072]: pgmap v6635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:51 smithi122 ceph-mon[125440]: pgmap v6635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:53.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:53 smithi136 ceph-mon[125702]: pgmap v6636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:53 smithi057 ceph-mon[92072]: pgmap v6636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:53 smithi122 ceph-mon[125440]: pgmap v6636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:55 smithi136 ceph-mon[125702]: pgmap v6637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:55 smithi057 ceph-mon[92072]: pgmap v6637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:55 smithi122 ceph-mon[125440]: pgmap v6637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:57 smithi057 ceph-mon[92072]: pgmap v6638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:57 smithi122 ceph-mon[125440]: pgmap v6638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:57 smithi136 ceph-mon[125702]: pgmap v6638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:24:58.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:58.521+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:24:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:58.521+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:24:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:58.521+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:24:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:58.521+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:24:58.522 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:24:58.521+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:24:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:24:59 smithi057 ceph-mon[92072]: pgmap v6639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:24:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:24:59 smithi122 ceph-mon[125440]: pgmap v6639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:24:59 smithi136 ceph-mon[125702]: pgmap v6639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:00.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:00 smithi057 ceph-mon[92072]: pgmap v6640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:00.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:00 smithi122 ceph-mon[125440]: pgmap v6640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:01.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:00 smithi136 ceph-mon[125702]: pgmap v6640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:03 smithi057 ceph-mon[92072]: pgmap v6641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:25:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:03 smithi122 ceph-mon[125440]: pgmap v6641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:25:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:03 smithi136 ceph-mon[125702]: pgmap v6641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:25:05.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:05 smithi057 ceph-mon[92072]: pgmap v6642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:25:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:05 smithi122 ceph-mon[125440]: pgmap v6642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:25:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:05 smithi136 ceph-mon[125702]: pgmap v6642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:25:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:07 smithi057 ceph-mon[92072]: pgmap v6643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:25:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:07 smithi122 ceph-mon[125440]: pgmap v6643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:25:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:07 smithi136 ceph-mon[125702]: pgmap v6643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:25:09.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:09 smithi057 ceph-mon[92072]: pgmap v6644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:25:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:09 smithi122 ceph-mon[125440]: pgmap v6644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:25:09.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:09 smithi136 ceph-mon[125702]: pgmap v6644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:25:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:11 smithi057 ceph-mon[92072]: pgmap v6645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:25:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:11 smithi057 ceph-mon[92072]: osdmap e487: 12 total, 12 up, 12 in 2023-03-02T14:25:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:11 smithi122 ceph-mon[125440]: pgmap v6645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:25:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:11 smithi122 ceph-mon[125440]: osdmap e487: 12 total, 12 up, 12 in 2023-03-02T14:25:11.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:11 smithi136 ceph-mon[125702]: pgmap v6645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:25:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:11 smithi136 ceph-mon[125702]: osdmap e487: 12 total, 12 up, 12 in 2023-03-02T14:25:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:13.536+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:25:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:13.536+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:25:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:13.536+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:25:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:13.536+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:25:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:13.536+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:25:13.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:13 smithi057 ceph-mon[92072]: pgmap v6647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:25:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:13 smithi122 ceph-mon[125440]: pgmap v6647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:25:13.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:13 smithi136 ceph-mon[125702]: pgmap v6647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:25:15.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:15 smithi057 ceph-mon[92072]: pgmap v6648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:25:15.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:15 smithi122 ceph-mon[125440]: pgmap v6648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:25:15.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:15 smithi136 ceph-mon[125702]: pgmap v6648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:25:17.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:17 smithi057 ceph-mon[92072]: pgmap v6649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:25:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:17 smithi057 ceph-mon[92072]: osdmap e488: 12 total, 12 up, 12 in 2023-03-02T14:25:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:17 smithi122 ceph-mon[125440]: pgmap v6649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:25:17.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:17 smithi122 ceph-mon[125440]: osdmap e488: 12 total, 12 up, 12 in 2023-03-02T14:25:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:17 smithi136 ceph-mon[125702]: pgmap v6649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:25:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:17 smithi136 ceph-mon[125702]: osdmap e488: 12 total, 12 up, 12 in 2023-03-02T14:25:19.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:19 smithi057 ceph-mon[92072]: pgmap v6651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:25:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:19 smithi122 ceph-mon[125440]: pgmap v6651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:25:19.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:19 smithi136 ceph-mon[125702]: pgmap v6651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:25:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:21 smithi057 ceph-mon[92072]: pgmap v6652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:25:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:21 smithi122 ceph-mon[125440]: pgmap v6652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:25:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:21 smithi136 ceph-mon[125702]: pgmap v6652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:25:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:23 smithi122 ceph-mon[125440]: pgmap v6653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:25:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:23 smithi136 ceph-mon[125702]: pgmap v6653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:25:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:23 smithi057 ceph-mon[92072]: pgmap v6653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:25:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:25.137+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:25:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:25.137+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:25:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:25.138+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 99 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:25:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:25.138+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 98 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:25:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:25 smithi122 ceph-mon[125440]: pgmap v6654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:25:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:25 smithi136 ceph-mon[125702]: pgmap v6654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:25:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:25 smithi057 ceph-mon[92072]: pgmap v6654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:25:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:27 smithi122 ceph-mon[125440]: pgmap v6655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:25:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:27 smithi136 ceph-mon[125702]: pgmap v6655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:25:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:27 smithi057 ceph-mon[92072]: pgmap v6655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:25:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:28.548+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:25:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:28.549+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:25:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:28.549+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:25:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:28.549+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:25:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:28.549+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:25:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:29 smithi136 ceph-mon[125702]: pgmap v6656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:25:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:29 smithi057 ceph-mon[92072]: pgmap v6656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:25:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:29 smithi122 ceph-mon[125440]: pgmap v6656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:25:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:25:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:25:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:25:30.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:25:30.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:25:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:25:30.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:25:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:25:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:25:31.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:31 smithi136 ceph-mon[125702]: pgmap v6657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:31.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:25:31.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:25:31.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:25:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:31 smithi057 ceph-mon[92072]: pgmap v6657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:25:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:25:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:25:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:31 smithi122 ceph-mon[125440]: pgmap v6657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:25:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:25:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:25:33.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:33 smithi136 ceph-mon[125702]: pgmap v6658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:33 smithi057 ceph-mon[92072]: pgmap v6658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:33 smithi122 ceph-mon[125440]: pgmap v6658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:35 smithi136 ceph-mon[125702]: pgmap v6659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:35 smithi057 ceph-mon[92072]: pgmap v6659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:35 smithi122 ceph-mon[125440]: pgmap v6659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:37.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:37 smithi136 ceph-mon[125702]: pgmap v6660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:37 smithi057 ceph-mon[92072]: pgmap v6660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:37 smithi122 ceph-mon[125440]: pgmap v6660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:39 smithi136 ceph-mon[125702]: pgmap v6661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:39 smithi057 ceph-mon[92072]: pgmap v6661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:39 smithi122 ceph-mon[125440]: pgmap v6661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:41 smithi136 ceph-mon[125702]: pgmap v6662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:41 smithi057 ceph-mon[92072]: pgmap v6662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:41 smithi122 ceph-mon[125440]: pgmap v6662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:43.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:43.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:25:43.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:43.559+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:25:43.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:43.559+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:25:43.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:43.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:25:43.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:43.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:25:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:43 smithi136 ceph-mon[125702]: pgmap v6663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:43 smithi057 ceph-mon[92072]: pgmap v6663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:43 smithi122 ceph-mon[125440]: pgmap v6663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:45 smithi136 ceph-mon[125702]: pgmap v6664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:45 smithi057 ceph-mon[92072]: pgmap v6664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:45 smithi122 ceph-mon[125440]: pgmap v6664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:47 smithi136 ceph-mon[125702]: pgmap v6665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:47 smithi057 ceph-mon[92072]: pgmap v6665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:47 smithi122 ceph-mon[125440]: pgmap v6665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:49 smithi136 ceph-mon[125702]: pgmap v6666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:49 smithi057 ceph-mon[92072]: pgmap v6666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:49 smithi122 ceph-mon[125440]: pgmap v6666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:51 smithi136 ceph-mon[125702]: pgmap v6667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:51 smithi057 ceph-mon[92072]: pgmap v6667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:51 smithi122 ceph-mon[125440]: pgmap v6667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:53 smithi136 ceph-mon[125702]: pgmap v6668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:53 smithi057 ceph-mon[92072]: pgmap v6668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:53 smithi122 ceph-mon[125440]: pgmap v6668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:55 smithi136 ceph-mon[125702]: pgmap v6669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:55 smithi057 ceph-mon[92072]: pgmap v6669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:55 smithi122 ceph-mon[125440]: pgmap v6669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:57.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:57 smithi136 ceph-mon[125702]: pgmap v6670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:57 smithi057 ceph-mon[92072]: pgmap v6670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:57 smithi122 ceph-mon[125440]: pgmap v6670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:25:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:58.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:25:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:58.575+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:25:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:58.575+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:25:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:58.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:25:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:25:58.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:25:59.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:25:59 smithi136 ceph-mon[125702]: pgmap v6671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:25:59 smithi057 ceph-mon[92072]: pgmap v6671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:25:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:25:59 smithi122 ceph-mon[125440]: pgmap v6671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:01.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:01 smithi136 ceph-mon[125702]: pgmap v6672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:01 smithi057 ceph-mon[92072]: pgmap v6672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:01 smithi122 ceph-mon[125440]: pgmap v6672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:03.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:03 smithi136 ceph-mon[125702]: pgmap v6673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:26:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:03 smithi057 ceph-mon[92072]: pgmap v6673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:26:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:03 smithi122 ceph-mon[125440]: pgmap v6673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:26:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:05 smithi136 ceph-mon[125702]: pgmap v6674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:26:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:05 smithi057 ceph-mon[92072]: pgmap v6674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:26:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:05 smithi122 ceph-mon[125440]: pgmap v6674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:26:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:07 smithi136 ceph-mon[125702]: pgmap v6675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:26:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:07 smithi057 ceph-mon[92072]: pgmap v6675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:26:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:07 smithi122 ceph-mon[125440]: pgmap v6675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:26:09.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:09 smithi136 ceph-mon[125702]: pgmap v6676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:26:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:09 smithi057 ceph-mon[92072]: pgmap v6676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:26:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:09 smithi122 ceph-mon[125440]: pgmap v6676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:26:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:10.144+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:26:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:10.144+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:26:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:10.144+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 99 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:26:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:10.144+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 100 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:26:11.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:11 smithi136 ceph-mon[125702]: pgmap v6677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:26:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:11 smithi136 ceph-mon[125702]: osdmap e489: 12 total, 12 up, 12 in 2023-03-02T14:26:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:11 smithi057 ceph-mon[92072]: pgmap v6677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:26:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:11 smithi057 ceph-mon[92072]: osdmap e489: 12 total, 12 up, 12 in 2023-03-02T14:26:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:11 smithi122 ceph-mon[125440]: pgmap v6677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:26:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:11 smithi122 ceph-mon[125440]: osdmap e489: 12 total, 12 up, 12 in 2023-03-02T14:26:13.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:13.580+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:26:13.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:13.581+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:26:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:13.581+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:26:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:13.581+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:26:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:13.581+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:26:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:13 smithi057 ceph-mon[92072]: pgmap v6679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T14:26:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:13 smithi122 ceph-mon[125440]: pgmap v6679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T14:26:14.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:13 smithi136 ceph-mon[125702]: pgmap v6679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T14:26:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:15 smithi057 ceph-mon[92072]: pgmap v6680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T14:26:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:15 smithi122 ceph-mon[125440]: pgmap v6680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T14:26:16.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:15 smithi136 ceph-mon[125702]: pgmap v6680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T14:26:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:17 smithi057 ceph-mon[92072]: pgmap v6681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T14:26:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:17 smithi057 ceph-mon[92072]: osdmap e490: 12 total, 12 up, 12 in 2023-03-02T14:26:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:17 smithi122 ceph-mon[125440]: pgmap v6681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T14:26:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:17 smithi122 ceph-mon[125440]: osdmap e490: 12 total, 12 up, 12 in 2023-03-02T14:26:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:17 smithi136 ceph-mon[125702]: pgmap v6681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T14:26:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:17 smithi136 ceph-mon[125702]: osdmap e490: 12 total, 12 up, 12 in 2023-03-02T14:26:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:19 smithi057 ceph-mon[92072]: pgmap v6683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:26:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:19 smithi122 ceph-mon[125440]: pgmap v6683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:26:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:19 smithi136 ceph-mon[125702]: pgmap v6683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:26:21.940 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:21 smithi057 ceph-mon[92072]: pgmap v6684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T14:26:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:21 smithi122 ceph-mon[125440]: pgmap v6684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T14:26:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:21 smithi136 ceph-mon[125702]: pgmap v6684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T14:26:23.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:23 smithi057 ceph-mon[92072]: pgmap v6685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:26:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:23 smithi122 ceph-mon[125440]: pgmap v6685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:26:23.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:23 smithi136 ceph-mon[125702]: pgmap v6685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:26:25.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:25 smithi057 ceph-mon[92072]: pgmap v6686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:26:25.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:25 smithi122 ceph-mon[125440]: pgmap v6686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:26:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:25 smithi136 ceph-mon[125702]: pgmap v6686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:26:27.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:27 smithi057 ceph-mon[92072]: pgmap v6687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:26:27.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:27 smithi122 ceph-mon[125440]: pgmap v6687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:26:27.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:27 smithi136 ceph-mon[125702]: pgmap v6687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:26:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:28.589+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:26:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:28.590+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:26:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:28.590+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:26:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:28.590+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:26:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:28.590+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:26:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:29 smithi057 ceph-mon[92072]: pgmap v6688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:26:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:29 smithi122 ceph-mon[125440]: pgmap v6688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:26:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:29 smithi136 ceph-mon[125702]: pgmap v6688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:26:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:31 smithi057 ceph-mon[92072]: pgmap v6689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:26:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:31 smithi122 ceph-mon[125440]: pgmap v6689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:26:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:31 smithi136 ceph-mon[125702]: pgmap v6689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:26:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:26:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:26:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:26:32.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:26:32.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:26:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:26:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:26:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:33 smithi057 ceph-mon[92072]: pgmap v6690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:33 smithi122 ceph-mon[125440]: pgmap v6690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:34.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:33 smithi136 ceph-mon[125702]: pgmap v6690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:35 smithi057 ceph-mon[92072]: pgmap v6691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:35 smithi122 ceph-mon[125440]: pgmap v6691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:36.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:35 smithi136 ceph-mon[125702]: pgmap v6691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:37 smithi057 ceph-mon[92072]: pgmap v6692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:37 smithi122 ceph-mon[125440]: pgmap v6692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:37 smithi136 ceph-mon[125702]: pgmap v6692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:39 smithi057 ceph-mon[92072]: pgmap v6693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:39 smithi122 ceph-mon[125440]: pgmap v6693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:39 smithi136 ceph-mon[125702]: pgmap v6693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:41 smithi057 ceph-mon[92072]: pgmap v6694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:41 smithi122 ceph-mon[125440]: pgmap v6694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:41 smithi136 ceph-mon[125702]: pgmap v6694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:43.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:26:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:43.601+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:26:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:43.601+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:26:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:43.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:26:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:43.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:26:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:43 smithi057 ceph-mon[92072]: pgmap v6695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:43 smithi122 ceph-mon[125440]: pgmap v6695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:44.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:43 smithi136 ceph-mon[125702]: pgmap v6695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:45.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:45 smithi057 ceph-mon[92072]: pgmap v6696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:45 smithi122 ceph-mon[125440]: pgmap v6696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:46.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:45 smithi136 ceph-mon[125702]: pgmap v6696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:47 smithi057 ceph-mon[92072]: pgmap v6697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:47 smithi122 ceph-mon[125440]: pgmap v6697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:47 smithi136 ceph-mon[125702]: pgmap v6697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:48.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:48 smithi057 ceph-mon[92072]: pgmap v6698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:48.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:48 smithi122 ceph-mon[125440]: pgmap v6698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:48 smithi136 ceph-mon[125702]: pgmap v6698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:51.588 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:51 smithi136 ceph-mon[125702]: pgmap v6699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:51 smithi057 ceph-mon[92072]: pgmap v6699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:51 smithi122 ceph-mon[125440]: pgmap v6699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:53.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:53 smithi057 ceph-mon[92072]: pgmap v6700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:53 smithi122 ceph-mon[125440]: pgmap v6700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:53 smithi136 ceph-mon[125702]: pgmap v6700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:55 smithi057 ceph-mon[92072]: pgmap v6701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:55 smithi122 ceph-mon[125440]: pgmap v6701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:55 smithi136 ceph-mon[125702]: pgmap v6701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:57.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:57 smithi057 ceph-mon[92072]: pgmap v6702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:57.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:57 smithi122 ceph-mon[125440]: pgmap v6702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:57 smithi136 ceph-mon[125702]: pgmap v6702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:26:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:58.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:26:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:58.614+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:26:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:58.614+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:26:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:58.614+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:26:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:26:58.614+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:26:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:26:59 smithi057 ceph-mon[92072]: pgmap v6703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:59.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:26:59 smithi122 ceph-mon[125440]: pgmap v6703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:26:59.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:26:59 smithi136 ceph-mon[125702]: pgmap v6703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:01 smithi057 ceph-mon[92072]: pgmap v6704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:01 smithi122 ceph-mon[125440]: pgmap v6704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:01.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:01 smithi136 ceph-mon[125702]: pgmap v6704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:03.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:03 smithi057 ceph-mon[92072]: pgmap v6705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:27:03.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:03 smithi122 ceph-mon[125440]: pgmap v6705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:27:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:03 smithi136 ceph-mon[125702]: pgmap v6705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:27:05.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:05 smithi122 ceph-mon[125440]: pgmap v6706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:27:05.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:05 smithi136 ceph-mon[125702]: pgmap v6706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:27:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:05 smithi057 ceph-mon[92072]: pgmap v6706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:27:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:07 smithi122 ceph-mon[125440]: pgmap v6707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:27:07.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:07 smithi136 ceph-mon[125702]: pgmap v6707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:27:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:07 smithi057 ceph-mon[92072]: pgmap v6707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:27:09.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:09 smithi122 ceph-mon[125440]: pgmap v6708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:27:09.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:09 smithi136 ceph-mon[125702]: pgmap v6708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:27:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:09 smithi057 ceph-mon[92072]: pgmap v6708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:27:11.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:11 smithi136 ceph-mon[125702]: pgmap v6709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:27:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:11 smithi136 ceph-mon[125702]: osdmap e491: 12 total, 12 up, 12 in 2023-03-02T14:27:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:11 smithi057 ceph-mon[92072]: pgmap v6709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:27:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:11 smithi057 ceph-mon[92072]: osdmap e491: 12 total, 12 up, 12 in 2023-03-02T14:27:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:11 smithi122 ceph-mon[125440]: pgmap v6709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:27:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:11 smithi122 ceph-mon[125440]: osdmap e491: 12 total, 12 up, 12 in 2023-03-02T14:27:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:13.630+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:27:13.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:13.631+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:27:13.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:13.631+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:27:13.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:13.631+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:27:13.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:13.631+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:27:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:13 smithi136 ceph-mon[125702]: pgmap v6711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:27:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:13 smithi057 ceph-mon[92072]: pgmap v6711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:27:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:13 smithi122 ceph-mon[125440]: pgmap v6711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:27:15.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:15 smithi136 ceph-mon[125702]: pgmap v6712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:27:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:15 smithi057 ceph-mon[92072]: pgmap v6712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:27:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:15 smithi122 ceph-mon[125440]: pgmap v6712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:27:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:17 smithi136 ceph-mon[125702]: pgmap v6713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:27:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:17 smithi136 ceph-mon[125702]: osdmap e492: 12 total, 12 up, 12 in 2023-03-02T14:27:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:17 smithi057 ceph-mon[92072]: pgmap v6713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:27:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:17 smithi057 ceph-mon[92072]: osdmap e492: 12 total, 12 up, 12 in 2023-03-02T14:27:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:17 smithi122 ceph-mon[125440]: pgmap v6713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:27:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:17 smithi122 ceph-mon[125440]: osdmap e492: 12 total, 12 up, 12 in 2023-03-02T14:27:19.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:19 smithi136 ceph-mon[125702]: pgmap v6715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:27:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:19 smithi057 ceph-mon[92072]: pgmap v6715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:27:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:19 smithi122 ceph-mon[125440]: pgmap v6715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:27:21.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:21 smithi136 ceph-mon[125702]: pgmap v6716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:27:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:21 smithi057 ceph-mon[92072]: pgmap v6716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:27:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:21 smithi122 ceph-mon[125440]: pgmap v6716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:27:23.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:23 smithi136 ceph-mon[125702]: pgmap v6717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:27:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:23 smithi057 ceph-mon[92072]: pgmap v6717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:27:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:23 smithi122 ceph-mon[125440]: pgmap v6717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:27:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:25 smithi136 ceph-mon[125702]: pgmap v6718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:27:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:25 smithi057 ceph-mon[92072]: pgmap v6718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:27:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:25 smithi122 ceph-mon[125440]: pgmap v6718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:27:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:27 smithi136 ceph-mon[125702]: pgmap v6719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:27:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:27 smithi057 ceph-mon[92072]: pgmap v6719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:27:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:27 smithi122 ceph-mon[125440]: pgmap v6719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:27:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:28.646+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:27:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:28.646+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:27:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:28.646+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:27:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:28.646+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:27:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:28.646+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:27:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:29 smithi136 ceph-mon[125702]: pgmap v6720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:27:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:29 smithi057 ceph-mon[92072]: pgmap v6720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:27:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:29 smithi122 ceph-mon[125440]: pgmap v6720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:27:31.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:31 smithi136 ceph-mon[125702]: pgmap v6721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:31 smithi057 ceph-mon[92072]: pgmap v6721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:31 smithi122 ceph-mon[125440]: pgmap v6721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:33 smithi057 ceph-mon[92072]: pgmap v6722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:33.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:27:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:27:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:27:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:27:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:33 smithi122 ceph-mon[125440]: pgmap v6722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:27:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:27:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:27:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:27:33.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:33 smithi136 ceph-mon[125702]: pgmap v6722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:27:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:27:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:27:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:27:35.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:35 smithi057 ceph-mon[92072]: pgmap v6723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:35.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:35 smithi122 ceph-mon[125440]: pgmap v6723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:35.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:35 smithi136 ceph-mon[125702]: pgmap v6723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:37.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:37 smithi057 ceph-mon[92072]: pgmap v6724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:37 smithi122 ceph-mon[125440]: pgmap v6724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:37.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:37 smithi136 ceph-mon[125702]: pgmap v6724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:39 smithi057 ceph-mon[92072]: pgmap v6725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:39 smithi122 ceph-mon[125440]: pgmap v6725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:39.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:39 smithi136 ceph-mon[125702]: pgmap v6725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:41 smithi122 ceph-mon[125440]: pgmap v6726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:41.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:41 smithi136 ceph-mon[125702]: pgmap v6726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:41 smithi057 ceph-mon[92072]: pgmap v6726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:43.660+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:27:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:43.660+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:27:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:43.660+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:27:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:43.660+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:27:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:43.660+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:27:43.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:43 smithi122 ceph-mon[125440]: pgmap v6727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:43.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:43 smithi136 ceph-mon[125702]: pgmap v6727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:43 smithi057 ceph-mon[92072]: pgmap v6727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:45.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:45 smithi136 ceph-mon[125702]: pgmap v6728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:45 smithi057 ceph-mon[92072]: pgmap v6728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:45 smithi122 ceph-mon[125440]: pgmap v6728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:47.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:47 smithi136 ceph-mon[125702]: pgmap v6729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:47 smithi057 ceph-mon[92072]: pgmap v6729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:47 smithi122 ceph-mon[125440]: pgmap v6729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:49.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:49 smithi136 ceph-mon[125702]: pgmap v6730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:49 smithi057 ceph-mon[92072]: pgmap v6730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:49 smithi122 ceph-mon[125440]: pgmap v6730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:51.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:51 smithi136 ceph-mon[125702]: pgmap v6731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:51 smithi057 ceph-mon[92072]: pgmap v6731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:51 smithi122 ceph-mon[125440]: pgmap v6731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:53.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:53 smithi136 ceph-mon[125702]: pgmap v6732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:53 smithi057 ceph-mon[92072]: pgmap v6732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:53 smithi122 ceph-mon[125440]: pgmap v6732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:55.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:55 smithi136 ceph-mon[125702]: pgmap v6733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:55 smithi057 ceph-mon[92072]: pgmap v6733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:55 smithi122 ceph-mon[125440]: pgmap v6733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:57.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:57 smithi136 ceph-mon[125702]: pgmap v6734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:57 smithi057 ceph-mon[92072]: pgmap v6734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:57 smithi122 ceph-mon[125440]: pgmap v6734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:27:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:58.675+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:27:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:58.675+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:27:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:58.675+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:27:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:58.675+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:27:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:27:58.675+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:27:59.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:27:59 smithi136 ceph-mon[125702]: pgmap v6735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:27:59 smithi057 ceph-mon[92072]: pgmap v6735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:27:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:27:59 smithi122 ceph-mon[125440]: pgmap v6735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:01.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:01 smithi136 ceph-mon[125702]: pgmap v6736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:01 smithi057 ceph-mon[92072]: pgmap v6736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:01 smithi122 ceph-mon[125440]: pgmap v6736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:03.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:03 smithi136 ceph-mon[125702]: pgmap v6737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:28:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:03 smithi057 ceph-mon[92072]: pgmap v6737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:28:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:03 smithi122 ceph-mon[125440]: pgmap v6737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:28:05.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:05 smithi136 ceph-mon[125702]: pgmap v6738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:28:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:05 smithi057 ceph-mon[92072]: pgmap v6738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:28:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:05 smithi122 ceph-mon[125440]: pgmap v6738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:28:07.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:07 smithi136 ceph-mon[125702]: pgmap v6739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:28:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:07 smithi057 ceph-mon[92072]: pgmap v6739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:28:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:07 smithi122 ceph-mon[125440]: pgmap v6739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:28:09.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:09 smithi136 ceph-mon[125702]: pgmap v6740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:28:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:09 smithi057 ceph-mon[92072]: pgmap v6740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:28:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:09 smithi122 ceph-mon[125440]: pgmap v6740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:28:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:11 smithi136 ceph-mon[125702]: pgmap v6741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:28:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:11 smithi136 ceph-mon[125702]: osdmap e493: 12 total, 12 up, 12 in 2023-03-02T14:28:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:11 smithi057 ceph-mon[92072]: pgmap v6741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:28:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:11 smithi057 ceph-mon[92072]: osdmap e493: 12 total, 12 up, 12 in 2023-03-02T14:28:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:11 smithi122 ceph-mon[125440]: pgmap v6741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:28:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:11 smithi122 ceph-mon[125440]: osdmap e493: 12 total, 12 up, 12 in 2023-03-02T14:28:13.684 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:13.685+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:28:13.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:13.685+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:28:13.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:13.685+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:28:13.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:13.685+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:28:13.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:13.685+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:28:13.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:13 smithi136 ceph-mon[125702]: pgmap v6743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:28:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:13 smithi057 ceph-mon[92072]: pgmap v6743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:28:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:13 smithi122 ceph-mon[125440]: pgmap v6743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:28:15.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:15 smithi136 ceph-mon[125702]: pgmap v6744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:28:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:15 smithi057 ceph-mon[92072]: pgmap v6744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:28:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:15 smithi122 ceph-mon[125440]: pgmap v6744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:28:17.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:17 smithi136 ceph-mon[125702]: pgmap v6745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:28:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:17 smithi136 ceph-mon[125702]: osdmap e494: 12 total, 12 up, 12 in 2023-03-02T14:28:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:17 smithi057 ceph-mon[92072]: pgmap v6745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:28:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:17 smithi057 ceph-mon[92072]: osdmap e494: 12 total, 12 up, 12 in 2023-03-02T14:28:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:17 smithi122 ceph-mon[125440]: pgmap v6745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:28:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:17 smithi122 ceph-mon[125440]: osdmap e494: 12 total, 12 up, 12 in 2023-03-02T14:28:19.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:19 smithi136 ceph-mon[125702]: pgmap v6747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:28:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:19 smithi057 ceph-mon[92072]: pgmap v6747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:28:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:19 smithi122 ceph-mon[125440]: pgmap v6747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:28:21.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:21 smithi136 ceph-mon[125702]: pgmap v6748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:28:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:21 smithi057 ceph-mon[92072]: pgmap v6748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:28:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:21 smithi122 ceph-mon[125440]: pgmap v6748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:28:23.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:23 smithi136 ceph-mon[125702]: pgmap v6749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:28:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:23 smithi057 ceph-mon[92072]: pgmap v6749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:28:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:23 smithi122 ceph-mon[125440]: pgmap v6749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:28:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:25 smithi136 ceph-mon[125702]: pgmap v6750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:28:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:25 smithi057 ceph-mon[92072]: pgmap v6750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:28:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:25 smithi122 ceph-mon[125440]: pgmap v6750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:28:27.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:27 smithi136 ceph-mon[125702]: pgmap v6751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:28:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:27 smithi057 ceph-mon[92072]: pgmap v6751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:28:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:27 smithi122 ceph-mon[125440]: pgmap v6751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:28:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:28.698+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:28:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:28.698+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:28:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:28.698+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:28:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:28.698+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:28:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:28.698+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:28:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:29 smithi136 ceph-mon[125702]: pgmap v6752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:28:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:29 smithi057 ceph-mon[92072]: pgmap v6752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:28:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:29 smithi122 ceph-mon[125440]: pgmap v6752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:28:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:31 smithi136 ceph-mon[125702]: pgmap v6753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:31 smithi057 ceph-mon[92072]: pgmap v6753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:31 smithi122 ceph-mon[125440]: pgmap v6753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:33.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:33 smithi136 ceph-mon[125702]: pgmap v6754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:28:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:33 smithi057 ceph-mon[92072]: pgmap v6754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:28:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:33 smithi122 ceph-mon[125440]: pgmap v6754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:28:34.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:28:34.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:28:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:28:34.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:28:34.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:28:34.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:28:35.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:28:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:28:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:28:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:35 smithi057 ceph-mon[92072]: pgmap v6755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:28:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:35 smithi122 ceph-mon[125440]: pgmap v6755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:28:36.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:35 smithi136 ceph-mon[125702]: pgmap v6755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:28:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:37 smithi057 ceph-mon[92072]: pgmap v6756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:28:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:37 smithi122 ceph-mon[125440]: pgmap v6756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:28:38.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:37 smithi136 ceph-mon[125702]: pgmap v6756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:28:39.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:39 smithi057 ceph-mon[92072]: pgmap v6757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:39 smithi122 ceph-mon[125440]: pgmap v6757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:39 smithi136 ceph-mon[125702]: pgmap v6757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:41 smithi057 ceph-mon[92072]: pgmap v6758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:28:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:41 smithi122 ceph-mon[125440]: pgmap v6758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:28:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:41 smithi136 ceph-mon[125702]: pgmap v6758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:28:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:43.699+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:28:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:43.700+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:28:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:43.700+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:28:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:43.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:28:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:43.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:28:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:43 smithi057 ceph-mon[92072]: pgmap v6759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:43 smithi122 ceph-mon[125440]: pgmap v6759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:43 smithi136 ceph-mon[125702]: pgmap v6759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:45 smithi057 ceph-mon[92072]: pgmap v6760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:45 smithi122 ceph-mon[125440]: pgmap v6760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:46.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:45 smithi136 ceph-mon[125702]: pgmap v6760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:47 smithi057 ceph-mon[92072]: pgmap v6761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:47 smithi122 ceph-mon[125440]: pgmap v6761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:47 smithi136 ceph-mon[125702]: pgmap v6761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:49 smithi057 ceph-mon[92072]: pgmap v6762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:49 smithi122 ceph-mon[125440]: pgmap v6762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:50.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:49 smithi136 ceph-mon[125702]: pgmap v6762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:50.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:50 smithi057 ceph-mon[92072]: pgmap v6763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:50.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:50 smithi122 ceph-mon[125440]: pgmap v6763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:50 smithi136 ceph-mon[125702]: pgmap v6763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:53.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:53 smithi122 ceph-mon[125440]: pgmap v6764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:53.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:53 smithi136 ceph-mon[125702]: pgmap v6764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:53 smithi057 ceph-mon[92072]: pgmap v6764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:55.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:55 smithi122 ceph-mon[125440]: pgmap v6765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:55 smithi136 ceph-mon[125702]: pgmap v6765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:55 smithi057 ceph-mon[92072]: pgmap v6765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:57 smithi122 ceph-mon[125440]: pgmap v6766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:57.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:57 smithi136 ceph-mon[125702]: pgmap v6766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:57 smithi057 ceph-mon[92072]: pgmap v6766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:28:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:58.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:28:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:58.711+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:28:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:58.711+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:28:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:58.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:28:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:28:58.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:28:59.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:28:59 smithi136 ceph-mon[125702]: pgmap v6767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:28:59 smithi057 ceph-mon[92072]: pgmap v6767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:28:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:28:59 smithi122 ceph-mon[125440]: pgmap v6767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:01.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:01 smithi136 ceph-mon[125702]: pgmap v6768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:01 smithi057 ceph-mon[92072]: pgmap v6768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:01 smithi122 ceph-mon[125440]: pgmap v6768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:03.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:03 smithi136 ceph-mon[125702]: pgmap v6769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:29:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:03 smithi057 ceph-mon[92072]: pgmap v6769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:29:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:03 smithi122 ceph-mon[125440]: pgmap v6769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:29:05.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:05 smithi136 ceph-mon[125702]: pgmap v6770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:29:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:05 smithi057 ceph-mon[92072]: pgmap v6770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:29:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:05 smithi122 ceph-mon[125440]: pgmap v6770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:29:07.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:07 smithi136 ceph-mon[125702]: pgmap v6771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:29:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:07 smithi057 ceph-mon[92072]: pgmap v6771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:29:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:07 smithi122 ceph-mon[125440]: pgmap v6771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:29:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:08.394+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T14:29:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:08.394+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T14:29:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:08.394+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5850005a70 tx=0x7f587006c040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:29:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:08.394+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5850005a70 tx=0x7f587006c040 comp rx=0 tx=0).stop 2023-03-02T14:29:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:08.394+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T14:29:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:08.394+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T14:29:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:08.395+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T14:29:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:08.395+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d040 0x7f586809d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T14:29:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:08.395+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d040 0x7f586809d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:29:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:08.395+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d040 0x7f586809d410 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5870010560 tx=0x7f5870063000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T14:29:09.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:09 smithi136 ceph-mon[125702]: pgmap v6772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:29:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:09 smithi057 ceph-mon[92072]: pgmap v6772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:29:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:09 smithi122 ceph-mon[125440]: pgmap v6772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:29:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:10.169+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:29:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:10.169+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:29:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:10.169+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 101 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:29:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:10.169+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 100 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:29:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:11 smithi136 ceph-mon[125702]: pgmap v6773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:29:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:11 smithi136 ceph-mon[125702]: osdmap e495: 12 total, 12 up, 12 in 2023-03-02T14:29:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:11 smithi057 ceph-mon[92072]: pgmap v6773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:29:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:11 smithi057 ceph-mon[92072]: osdmap e495: 12 total, 12 up, 12 in 2023-03-02T14:29:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:11 smithi122 ceph-mon[125440]: pgmap v6773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:29:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:11 smithi122 ceph-mon[125440]: osdmap e495: 12 total, 12 up, 12 in 2023-03-02T14:29:13.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:13.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:29:13.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:13.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:29:13.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:13.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:29:13.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:13.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:29:13.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:13.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:29:13.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:13 smithi136 ceph-mon[125702]: pgmap v6775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:29:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:13 smithi057 ceph-mon[92072]: pgmap v6775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:29:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:13 smithi122 ceph-mon[125440]: pgmap v6775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:29:15.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:15 smithi136 ceph-mon[125702]: pgmap v6776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:29:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:15 smithi057 ceph-mon[92072]: pgmap v6776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:29:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:15 smithi122 ceph-mon[125440]: pgmap v6776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:29:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:17 smithi136 ceph-mon[125702]: pgmap v6777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:29:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:17 smithi136 ceph-mon[125702]: osdmap e496: 12 total, 12 up, 12 in 2023-03-02T14:29:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:17 smithi057 ceph-mon[92072]: pgmap v6777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:29:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:17 smithi057 ceph-mon[92072]: osdmap e496: 12 total, 12 up, 12 in 2023-03-02T14:29:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:17 smithi122 ceph-mon[125440]: pgmap v6777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:29:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:17 smithi122 ceph-mon[125440]: osdmap e496: 12 total, 12 up, 12 in 2023-03-02T14:29:19.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:19 smithi136 ceph-mon[125702]: pgmap v6779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:29:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:19 smithi057 ceph-mon[92072]: pgmap v6779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:29:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:19 smithi122 ceph-mon[125440]: pgmap v6779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:29:21.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:21 smithi136 ceph-mon[125702]: pgmap v6780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:29:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:21 smithi057 ceph-mon[92072]: pgmap v6780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:29:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:21 smithi122 ceph-mon[125440]: pgmap v6780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:29:23.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:23 smithi136 ceph-mon[125702]: pgmap v6781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:29:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:23 smithi057 ceph-mon[92072]: pgmap v6781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:29:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:23 smithi122 ceph-mon[125440]: pgmap v6781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:29:25.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:25 smithi136 ceph-mon[125702]: pgmap v6782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:29:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:25 smithi057 ceph-mon[92072]: pgmap v6782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:29:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:25 smithi122 ceph-mon[125440]: pgmap v6782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:29:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:27 smithi136 ceph-mon[125702]: pgmap v6783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:29:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:27 smithi057 ceph-mon[92072]: pgmap v6783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:29:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:27 smithi122 ceph-mon[125440]: pgmap v6783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:29:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:28.734+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:29:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:28.734+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:29:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:28.734+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:29:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:28.734+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:29:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:28.734+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:29:29.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:29 smithi136 ceph-mon[125702]: pgmap v6784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:29:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:29 smithi057 ceph-mon[92072]: pgmap v6784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:29:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:29 smithi122 ceph-mon[125440]: pgmap v6784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:29:31.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:31 smithi136 ceph-mon[125702]: pgmap v6785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:31 smithi057 ceph-mon[92072]: pgmap v6785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:31 smithi122 ceph-mon[125440]: pgmap v6785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:33.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:33 smithi136 ceph-mon[125702]: pgmap v6786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:33 smithi057 ceph-mon[92072]: pgmap v6786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:33 smithi122 ceph-mon[125440]: pgmap v6786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:34.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:29:34.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:29:34.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:29:35.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:35 smithi136 ceph-mon[125702]: pgmap v6787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:35 smithi057 ceph-mon[92072]: pgmap v6787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:35 smithi122 ceph-mon[125440]: pgmap v6787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:37.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:37 smithi136 ceph-mon[125702]: pgmap v6788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:37 smithi057 ceph-mon[92072]: pgmap v6788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:37 smithi122 ceph-mon[125440]: pgmap v6788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:39.588 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:39 smithi136 ceph-mon[125702]: pgmap v6789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:29:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:29:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:29:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:29:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:29:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:39 smithi057 ceph-mon[92072]: pgmap v6789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:29:39.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:29:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:29:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:29:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:29:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:39 smithi122 ceph-mon[125440]: pgmap v6789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:29:39.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:29:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:29:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:29:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:29:41.588 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:41 smithi136 ceph-mon[125702]: pgmap v6790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:41 smithi057 ceph-mon[92072]: pgmap v6790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:41 smithi122 ceph-mon[125440]: pgmap v6790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:43.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:29:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:43.736+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:29:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:43.736+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:29:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:43.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:29:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:43.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:29:43.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:43 smithi136 ceph-mon[125702]: pgmap v6791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:43 smithi057 ceph-mon[92072]: pgmap v6791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:43 smithi122 ceph-mon[125440]: pgmap v6791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:45.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:45 smithi136 ceph-mon[125702]: pgmap v6792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:45 smithi057 ceph-mon[92072]: pgmap v6792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:45 smithi122 ceph-mon[125440]: pgmap v6792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:47.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:47 smithi136 ceph-mon[125702]: pgmap v6793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:47 smithi057 ceph-mon[92072]: pgmap v6793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:47 smithi122 ceph-mon[125440]: pgmap v6793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:49.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:49 smithi136 ceph-mon[125702]: pgmap v6794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:49 smithi057 ceph-mon[92072]: pgmap v6794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:49 smithi122 ceph-mon[125440]: pgmap v6794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:51 smithi136 ceph-mon[125702]: pgmap v6795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:51 smithi057 ceph-mon[92072]: pgmap v6795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:51 smithi122 ceph-mon[125440]: pgmap v6795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:53.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:53 smithi136 ceph-mon[125702]: pgmap v6796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:53 smithi057 ceph-mon[92072]: pgmap v6796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:53 smithi122 ceph-mon[125440]: pgmap v6796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:55 smithi136 ceph-mon[125702]: pgmap v6797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:55 smithi057 ceph-mon[92072]: pgmap v6797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:55 smithi122 ceph-mon[125440]: pgmap v6797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:57.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:57 smithi136 ceph-mon[125702]: pgmap v6798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:57 smithi057 ceph-mon[92072]: pgmap v6798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:57 smithi122 ceph-mon[125440]: pgmap v6798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:29:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:58.752+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:29:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:58.752+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:29:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:58.752+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:29:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:58.752+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:29:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:29:58.752+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:29:59.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:29:59 smithi136 ceph-mon[125702]: pgmap v6799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:29:59 smithi057 ceph-mon[92072]: pgmap v6799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:29:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:29:59 smithi122 ceph-mon[125440]: pgmap v6799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:00.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T14:30:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T14:30:00.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T14:30:01.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:01 smithi136 ceph-mon[125702]: pgmap v6800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:01 smithi057 ceph-mon[92072]: pgmap v6800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:01 smithi122 ceph-mon[125440]: pgmap v6800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:03 smithi136 ceph-mon[125702]: pgmap v6801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:30:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:03 smithi057 ceph-mon[92072]: pgmap v6801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:30:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:03 smithi122 ceph-mon[125440]: pgmap v6801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:30:05.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:05 smithi136 ceph-mon[125702]: pgmap v6802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:30:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:05 smithi057 ceph-mon[92072]: pgmap v6802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:30:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:05 smithi122 ceph-mon[125440]: pgmap v6802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:30:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:07 smithi136 ceph-mon[125702]: pgmap v6803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:30:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:07 smithi057 ceph-mon[92072]: pgmap v6803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:30:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:07 smithi122 ceph-mon[125440]: pgmap v6803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:30:09.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:09 smithi136 ceph-mon[125702]: pgmap v6804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:30:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:09 smithi057 ceph-mon[92072]: pgmap v6804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:30:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:09 smithi122 ceph-mon[125440]: pgmap v6804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:30:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:11 smithi136 ceph-mon[125702]: pgmap v6805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:30:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:11 smithi136 ceph-mon[125702]: osdmap e497: 12 total, 12 up, 12 in 2023-03-02T14:30:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:11 smithi057 ceph-mon[92072]: pgmap v6805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:30:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:11 smithi057 ceph-mon[92072]: osdmap e497: 12 total, 12 up, 12 in 2023-03-02T14:30:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:11 smithi122 ceph-mon[125440]: pgmap v6805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:30:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:11 smithi122 ceph-mon[125440]: osdmap e497: 12 total, 12 up, 12 in 2023-03-02T14:30:13.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:13.756+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:30:13.757 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:13.756+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:30:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:13.756+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:30:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:13.756+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:30:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:13.756+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:30:13.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:13 smithi136 ceph-mon[125702]: pgmap v6807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:30:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:13 smithi057 ceph-mon[92072]: pgmap v6807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:30:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:13 smithi122 ceph-mon[125440]: pgmap v6807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:30:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:15 smithi136 ceph-mon[125702]: pgmap v6808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:30:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:15 smithi057 ceph-mon[92072]: pgmap v6808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:30:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:15 smithi122 ceph-mon[125440]: pgmap v6808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:30:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:17 smithi136 ceph-mon[125702]: pgmap v6809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:30:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:17 smithi136 ceph-mon[125702]: osdmap e498: 12 total, 12 up, 12 in 2023-03-02T14:30:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:17 smithi057 ceph-mon[92072]: pgmap v6809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:30:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:17 smithi057 ceph-mon[92072]: osdmap e498: 12 total, 12 up, 12 in 2023-03-02T14:30:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:17 smithi122 ceph-mon[125440]: pgmap v6809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:30:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:17 smithi122 ceph-mon[125440]: osdmap e498: 12 total, 12 up, 12 in 2023-03-02T14:30:19.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:19 smithi136 ceph-mon[125702]: pgmap v6811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:30:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:19 smithi057 ceph-mon[92072]: pgmap v6811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:30:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:19 smithi122 ceph-mon[125440]: pgmap v6811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:30:21.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:21 smithi136 ceph-mon[125702]: pgmap v6812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:30:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:21 smithi057 ceph-mon[92072]: pgmap v6812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:30:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:21 smithi122 ceph-mon[125440]: pgmap v6812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:30:23.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:23 smithi136 ceph-mon[125702]: pgmap v6813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:30:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:23 smithi057 ceph-mon[92072]: pgmap v6813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:30:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:23 smithi122 ceph-mon[125440]: pgmap v6813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:30:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:25 smithi136 ceph-mon[125702]: pgmap v6814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:30:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:25 smithi057 ceph-mon[92072]: pgmap v6814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:30:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:25 smithi122 ceph-mon[125440]: pgmap v6814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:30:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:27 smithi057 ceph-mon[92072]: pgmap v6815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:30:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:27 smithi122 ceph-mon[125440]: pgmap v6815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:30:28.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:27 smithi136 ceph-mon[125702]: pgmap v6815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:30:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:28.769+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:30:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:28.769+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:30:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:28.769+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:30:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:28.769+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:30:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:28.769+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:30:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:29 smithi057 ceph-mon[92072]: pgmap v6816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:30:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:29 smithi122 ceph-mon[125440]: pgmap v6816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:30:30.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:29 smithi136 ceph-mon[125702]: pgmap v6816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:30:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:31 smithi057 ceph-mon[92072]: pgmap v6817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:31 smithi122 ceph-mon[125440]: pgmap v6817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:31 smithi136 ceph-mon[125702]: pgmap v6817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:33 smithi057 ceph-mon[92072]: pgmap v6818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:33 smithi122 ceph-mon[125440]: pgmap v6818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:34.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:33 smithi136 ceph-mon[125702]: pgmap v6818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:35 smithi057 ceph-mon[92072]: pgmap v6819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:35 smithi122 ceph-mon[125440]: pgmap v6819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:36.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:35 smithi136 ceph-mon[125702]: pgmap v6819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:37 smithi057 ceph-mon[92072]: pgmap v6820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:37 smithi122 ceph-mon[125440]: pgmap v6820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:38.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:37 smithi136 ceph-mon[125702]: pgmap v6820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:38.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:30:38.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:30:39.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:30:39.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:39 smithi057 ceph-mon[92072]: pgmap v6821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:39 smithi122 ceph-mon[125440]: pgmap v6821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:40.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:39 smithi136 ceph-mon[125702]: pgmap v6821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:41 smithi057 ceph-mon[92072]: pgmap v6822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:41 smithi122 ceph-mon[125440]: pgmap v6822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:41 smithi136 ceph-mon[125702]: pgmap v6822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:43.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:30:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:43.772+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:30:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:43.772+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:30:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:43.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:30:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:43.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:30:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:43 smithi057 ceph-mon[92072]: pgmap v6823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:43 smithi122 ceph-mon[125440]: pgmap v6823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:43 smithi136 ceph-mon[125702]: pgmap v6823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:45 smithi057 ceph-mon[92072]: pgmap v6824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:45 smithi122 ceph-mon[125440]: pgmap v6824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:45 smithi136 ceph-mon[125702]: pgmap v6824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:47 smithi057 ceph-mon[92072]: pgmap v6825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:47 smithi122 ceph-mon[125440]: pgmap v6825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:48.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:47 smithi136 ceph-mon[125702]: pgmap v6825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:30:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:30:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:48 smithi136 ceph-mon[125702]: pgmap v6826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:49.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:49.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:30:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:30:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:48 smithi057 ceph-mon[92072]: pgmap v6826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:49.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:49.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:49.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:30:49.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:30:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:30:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:48 smithi122 ceph-mon[125440]: pgmap v6826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:51.588 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:51 smithi136 ceph-mon[125702]: pgmap v6827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:51 smithi057 ceph-mon[92072]: pgmap v6827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:51 smithi122 ceph-mon[125440]: pgmap v6827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:53.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:53 smithi136 ceph-mon[125702]: pgmap v6828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:53 smithi057 ceph-mon[92072]: pgmap v6828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:53 smithi122 ceph-mon[125440]: pgmap v6828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:55.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:55 smithi136 ceph-mon[125702]: pgmap v6829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:55 smithi057 ceph-mon[92072]: pgmap v6829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:55 smithi122 ceph-mon[125440]: pgmap v6829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:57.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:57 smithi136 ceph-mon[125702]: pgmap v6830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:57 smithi057 ceph-mon[92072]: pgmap v6830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:57 smithi122 ceph-mon[125440]: pgmap v6830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:30:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:58.787+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:30:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:58.788+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:30:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:58.788+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:30:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:58.788+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:30:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:30:58.788+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:30:59.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:30:59 smithi136 ceph-mon[125702]: pgmap v6831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:30:59 smithi057 ceph-mon[92072]: pgmap v6831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:30:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:30:59 smithi122 ceph-mon[125440]: pgmap v6831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:01.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:01 smithi136 ceph-mon[125702]: pgmap v6832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:01 smithi057 ceph-mon[92072]: pgmap v6832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:01 smithi122 ceph-mon[125440]: pgmap v6832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:03.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:03 smithi136 ceph-mon[125702]: pgmap v6833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:31:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:03 smithi057 ceph-mon[92072]: pgmap v6833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:31:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:03 smithi122 ceph-mon[125440]: pgmap v6833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:31:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:05 smithi136 ceph-mon[125702]: pgmap v6834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:31:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:05 smithi057 ceph-mon[92072]: pgmap v6834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:31:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:05 smithi122 ceph-mon[125440]: pgmap v6834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:31:06.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:06 smithi136 ceph-mon[125702]: osdmap e499: 12 total, 12 up, 12 in 2023-03-02T14:31:06.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:06 smithi057 ceph-mon[92072]: osdmap e499: 12 total, 12 up, 12 in 2023-03-02T14:31:06.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:06 smithi122 ceph-mon[125440]: osdmap e499: 12 total, 12 up, 12 in 2023-03-02T14:31:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:07 smithi136 ceph-mon[125702]: pgmap v6836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:31:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:07 smithi057 ceph-mon[92072]: pgmap v6836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:31:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:07 smithi122 ceph-mon[125440]: pgmap v6836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:31:09.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:09 smithi136 ceph-mon[125702]: pgmap v6837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:31:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:09 smithi057 ceph-mon[92072]: pgmap v6837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:31:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:09 smithi122 ceph-mon[125440]: pgmap v6837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:31:11.543 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:11 smithi136 ceph-mon[125702]: pgmap v6838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:31:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:11 smithi057 ceph-mon[92072]: pgmap v6838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:31:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:11 smithi122 ceph-mon[125440]: pgmap v6838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:31:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:13.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:31:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:13.803+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:31:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:13.803+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:31:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:13.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:31:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:13.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:31:13.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:13 smithi136 ceph-mon[125702]: pgmap v6839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:31:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:13 smithi136 ceph-mon[125702]: osdmap e500: 12 total, 12 up, 12 in 2023-03-02T14:31:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:13 smithi057 ceph-mon[92072]: pgmap v6839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:31:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:13 smithi057 ceph-mon[92072]: osdmap e500: 12 total, 12 up, 12 in 2023-03-02T14:31:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:13 smithi122 ceph-mon[125440]: pgmap v6839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:31:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:13 smithi122 ceph-mon[125440]: osdmap e500: 12 total, 12 up, 12 in 2023-03-02T14:31:15.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:15 smithi136 ceph-mon[125702]: pgmap v6841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T14:31:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:15 smithi057 ceph-mon[92072]: pgmap v6841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T14:31:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:15 smithi122 ceph-mon[125440]: pgmap v6841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T14:31:17.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:17 smithi136 ceph-mon[125702]: pgmap v6842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:31:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:17 smithi057 ceph-mon[92072]: pgmap v6842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:31:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:17 smithi122 ceph-mon[125440]: pgmap v6842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:31:19.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:19 smithi136 ceph-mon[125702]: pgmap v6843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:31:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:19 smithi057 ceph-mon[92072]: pgmap v6843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:31:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:19 smithi122 ceph-mon[125440]: pgmap v6843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:31:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:21 smithi136 ceph-mon[125702]: pgmap v6844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:31:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:21 smithi057 ceph-mon[92072]: pgmap v6844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:31:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:21 smithi122 ceph-mon[125440]: pgmap v6844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:31:23.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:23 smithi136 ceph-mon[125702]: pgmap v6845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:31:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:23 smithi057 ceph-mon[92072]: pgmap v6845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:31:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:23 smithi122 ceph-mon[125440]: pgmap v6845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:31:25.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:25 smithi136 ceph-mon[125702]: pgmap v6846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:25 smithi057 ceph-mon[92072]: pgmap v6846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:25 smithi122 ceph-mon[125440]: pgmap v6846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:27.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:27 smithi136 ceph-mon[125702]: pgmap v6847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:27 smithi057 ceph-mon[92072]: pgmap v6847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:27 smithi122 ceph-mon[125440]: pgmap v6847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:28.811+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:31:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:28.812+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:31:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:28.812+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:31:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:28.812+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:31:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:28.812+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:31:29.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:29 smithi136 ceph-mon[125702]: pgmap v6848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:29 smithi057 ceph-mon[92072]: pgmap v6848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:29 smithi122 ceph-mon[125440]: pgmap v6848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:31.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:31 smithi136 ceph-mon[125702]: pgmap v6849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:31 smithi057 ceph-mon[92072]: pgmap v6849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:31 smithi122 ceph-mon[125440]: pgmap v6849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:33.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:33 smithi136 ceph-mon[125702]: pgmap v6850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:33 smithi057 ceph-mon[92072]: pgmap v6850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:33 smithi122 ceph-mon[125440]: pgmap v6850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:35 smithi136 ceph-mon[125702]: pgmap v6851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:35 smithi057 ceph-mon[92072]: pgmap v6851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:35 smithi122 ceph-mon[125440]: pgmap v6851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:37.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:37 smithi136 ceph-mon[125702]: pgmap v6852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:37 smithi057 ceph-mon[92072]: pgmap v6852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:37 smithi122 ceph-mon[125440]: pgmap v6852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:39.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:39 smithi136 ceph-mon[125702]: pgmap v6853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:39.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:39 smithi057 ceph-mon[92072]: pgmap v6853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:39 smithi122 ceph-mon[125440]: pgmap v6853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:41 smithi136 ceph-mon[125702]: pgmap v6854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:41 smithi057 ceph-mon[92072]: pgmap v6854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:41 smithi122 ceph-mon[125440]: pgmap v6854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:43.814+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:31:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:43.815+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:31:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:43.815+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:31:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:43.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:31:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:43.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:31:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:43 smithi136 ceph-mon[125702]: pgmap v6855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:43 smithi057 ceph-mon[92072]: pgmap v6855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:43 smithi122 ceph-mon[125440]: pgmap v6855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:45.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:45 smithi136 ceph-mon[125702]: pgmap v6856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:45 smithi057 ceph-mon[92072]: pgmap v6856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:45 smithi122 ceph-mon[125440]: pgmap v6856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:47.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:47 smithi136 ceph-mon[125702]: pgmap v6857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:47 smithi057 ceph-mon[92072]: pgmap v6857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:47 smithi122 ceph-mon[125440]: pgmap v6857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:48.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:31:48.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:31:48.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:31:49.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:49 smithi136 ceph-mon[125702]: pgmap v6858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:31:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:31:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:31:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:49 smithi057 ceph-mon[92072]: pgmap v6858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:31:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:31:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:31:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:49 smithi122 ceph-mon[125440]: pgmap v6858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:31:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:31:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:31:51.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:51 smithi136 ceph-mon[125702]: pgmap v6859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:51 smithi057 ceph-mon[92072]: pgmap v6859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:51 smithi122 ceph-mon[125440]: pgmap v6859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:53 smithi057 ceph-mon[92072]: pgmap v6860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:53 smithi122 ceph-mon[125440]: pgmap v6860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:53 smithi136 ceph-mon[125702]: pgmap v6860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:55 smithi057 ceph-mon[92072]: pgmap v6861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:55 smithi122 ceph-mon[125440]: pgmap v6861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:56.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:55 smithi136 ceph-mon[125702]: pgmap v6861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:57 smithi057 ceph-mon[92072]: pgmap v6862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:57 smithi122 ceph-mon[125440]: pgmap v6862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:58.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:57 smithi136 ceph-mon[125702]: pgmap v6862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:31:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:58.830+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:31:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:58.831+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:31:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:58.831+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:31:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:58.831+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:31:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:31:58.831+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:31:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:31:59 smithi057 ceph-mon[92072]: pgmap v6863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:31:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:31:59 smithi122 ceph-mon[125440]: pgmap v6863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:00.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:31:59 smithi136 ceph-mon[125702]: pgmap v6863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:01 smithi057 ceph-mon[92072]: pgmap v6864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:01 smithi122 ceph-mon[125440]: pgmap v6864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:02.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:01 smithi136 ceph-mon[125702]: pgmap v6864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:03 smithi057 ceph-mon[92072]: pgmap v6865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:32:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:03 smithi122 ceph-mon[125440]: pgmap v6865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:32:04.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:03 smithi136 ceph-mon[125702]: pgmap v6865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:32:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:05 smithi057 ceph-mon[92072]: pgmap v6866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:32:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:05 smithi122 ceph-mon[125440]: pgmap v6866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:32:06.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:05 smithi136 ceph-mon[125702]: pgmap v6866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:32:06.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:06 smithi057 ceph-mon[92072]: osdmap e501: 12 total, 12 up, 12 in 2023-03-02T14:32:06.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:06 smithi122 ceph-mon[125440]: osdmap e501: 12 total, 12 up, 12 in 2023-03-02T14:32:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:06 smithi136 ceph-mon[125702]: osdmap e501: 12 total, 12 up, 12 in 2023-03-02T14:32:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:07 smithi057 ceph-mon[92072]: pgmap v6868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:32:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:07 smithi122 ceph-mon[125440]: pgmap v6868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:32:08.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:07 smithi136 ceph-mon[125702]: pgmap v6868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:32:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:09 smithi057 ceph-mon[92072]: pgmap v6869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:32:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:09 smithi122 ceph-mon[125440]: pgmap v6869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:32:10.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:09 smithi136 ceph-mon[125702]: pgmap v6869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:32:10.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:10.196+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:32:10.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:10.196+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:32:10.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:10.196+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 102 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:32:10.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:10.196+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 101 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:32:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:11 smithi057 ceph-mon[92072]: pgmap v6870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:32:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:11 smithi122 ceph-mon[125440]: pgmap v6870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:32:12.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:11 smithi136 ceph-mon[125702]: pgmap v6870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:32:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:13 smithi136 ceph-mon[125702]: pgmap v6871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:32:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:13 smithi136 ceph-mon[125702]: osdmap e502: 12 total, 12 up, 12 in 2023-03-02T14:32:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:13.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:32:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:13.846+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:32:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:13.846+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:32:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:13.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:32:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:13.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:32:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:13 smithi057 ceph-mon[92072]: pgmap v6871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:32:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:13 smithi057 ceph-mon[92072]: osdmap e502: 12 total, 12 up, 12 in 2023-03-02T14:32:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:13 smithi122 ceph-mon[125440]: pgmap v6871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:32:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:13 smithi122 ceph-mon[125440]: osdmap e502: 12 total, 12 up, 12 in 2023-03-02T14:32:15.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:15 smithi136 ceph-mon[125702]: pgmap v6873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T14:32:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:15 smithi057 ceph-mon[92072]: pgmap v6873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T14:32:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:15 smithi122 ceph-mon[125440]: pgmap v6873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T14:32:17.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:17 smithi136 ceph-mon[125702]: pgmap v6874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:32:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:17 smithi057 ceph-mon[92072]: pgmap v6874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:32:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:17 smithi122 ceph-mon[125440]: pgmap v6874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:32:19.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:19 smithi136 ceph-mon[125702]: pgmap v6875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:32:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:19 smithi057 ceph-mon[92072]: pgmap v6875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:32:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:19 smithi122 ceph-mon[125440]: pgmap v6875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:32:21.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:21 smithi136 ceph-mon[125702]: pgmap v6876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:32:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:21 smithi057 ceph-mon[92072]: pgmap v6876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:32:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:21 smithi122 ceph-mon[125440]: pgmap v6876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:32:23.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:23 smithi136 ceph-mon[125702]: pgmap v6877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:32:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:23 smithi057 ceph-mon[92072]: pgmap v6877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:32:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:23 smithi122 ceph-mon[125440]: pgmap v6877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:32:25.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:25 smithi136 ceph-mon[125702]: pgmap v6878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:25 smithi057 ceph-mon[92072]: pgmap v6878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:25 smithi122 ceph-mon[125440]: pgmap v6878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:27 smithi136 ceph-mon[125702]: pgmap v6879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:27 smithi057 ceph-mon[92072]: pgmap v6879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:27 smithi122 ceph-mon[125440]: pgmap v6879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:28.861+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:32:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:28.861+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:32:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:28.861+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:32:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:28.861+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:32:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:28.861+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:32:29.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:29 smithi136 ceph-mon[125702]: pgmap v6880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:29 smithi057 ceph-mon[92072]: pgmap v6880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:29 smithi122 ceph-mon[125440]: pgmap v6880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:31.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:31 smithi136 ceph-mon[125702]: pgmap v6881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:31 smithi057 ceph-mon[92072]: pgmap v6881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:31 smithi122 ceph-mon[125440]: pgmap v6881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:33.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:33 smithi136 ceph-mon[125702]: pgmap v6882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:33 smithi057 ceph-mon[92072]: pgmap v6882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:33 smithi122 ceph-mon[125440]: pgmap v6882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:35.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:35 smithi136 ceph-mon[125702]: pgmap v6883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:35 smithi057 ceph-mon[92072]: pgmap v6883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:35 smithi122 ceph-mon[125440]: pgmap v6883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:37.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:37 smithi136 ceph-mon[125702]: pgmap v6884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:37 smithi057 ceph-mon[92072]: pgmap v6884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:37 smithi122 ceph-mon[125440]: pgmap v6884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:39.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:39 smithi136 ceph-mon[125702]: pgmap v6885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:39.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:39 smithi057 ceph-mon[92072]: pgmap v6885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:39 smithi122 ceph-mon[125440]: pgmap v6885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:41.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:41 smithi136 ceph-mon[125702]: pgmap v6886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:41 smithi057 ceph-mon[92072]: pgmap v6886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:41 smithi122 ceph-mon[125440]: pgmap v6886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:43.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:43 smithi136 ceph-mon[125702]: pgmap v6887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:43.874+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:32:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:43.875+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:32:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:43.875+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:32:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:43.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:32:43.877 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:43.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:32:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:43 smithi057 ceph-mon[92072]: pgmap v6887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:43 smithi122 ceph-mon[125440]: pgmap v6887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:45.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:45 smithi136 ceph-mon[125702]: pgmap v6888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:45 smithi057 ceph-mon[92072]: pgmap v6888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:45 smithi122 ceph-mon[125440]: pgmap v6888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:47 smithi057 ceph-mon[92072]: pgmap v6889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:47 smithi122 ceph-mon[125440]: pgmap v6889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:48.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:47 smithi136 ceph-mon[125702]: pgmap v6889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:49 smithi057 ceph-mon[92072]: pgmap v6890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:32:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:49 smithi122 ceph-mon[125440]: pgmap v6890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:32:50.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:49 smithi136 ceph-mon[125702]: pgmap v6890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:32:51.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:32:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:32:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:50 smithi057 ceph-mon[92072]: pgmap v6891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:51.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:32:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:32:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:50 smithi122 ceph-mon[125440]: pgmap v6891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:51.338 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:32:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:32:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:32:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:50 smithi136 ceph-mon[125702]: pgmap v6891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:53.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:53 smithi136 ceph-mon[125702]: pgmap v6892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:53 smithi057 ceph-mon[92072]: pgmap v6892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:53 smithi122 ceph-mon[125440]: pgmap v6892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:55.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:55 smithi136 ceph-mon[125702]: pgmap v6893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:55 smithi057 ceph-mon[92072]: pgmap v6893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:55 smithi122 ceph-mon[125440]: pgmap v6893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:57.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:57 smithi136 ceph-mon[125702]: pgmap v6894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:57 smithi057 ceph-mon[92072]: pgmap v6894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:57 smithi122 ceph-mon[125440]: pgmap v6894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:32:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:58.885+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:32:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:58.885+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:32:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:58.885+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:32:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:58.885+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:32:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:32:58.885+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:32:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:32:59 smithi136 ceph-mon[125702]: pgmap v6895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:32:59 smithi057 ceph-mon[92072]: pgmap v6895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:32:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:32:59 smithi122 ceph-mon[125440]: pgmap v6895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:01.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:01 smithi136 ceph-mon[125702]: pgmap v6896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:01 smithi057 ceph-mon[92072]: pgmap v6896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:01 smithi122 ceph-mon[125440]: pgmap v6896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:03 smithi136 ceph-mon[125702]: pgmap v6897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:33:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:03 smithi057 ceph-mon[92072]: pgmap v6897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:33:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:03 smithi122 ceph-mon[125440]: pgmap v6897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:33:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:05 smithi136 ceph-mon[125702]: pgmap v6898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:33:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:05 smithi057 ceph-mon[92072]: pgmap v6898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:33:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:05 smithi122 ceph-mon[125440]: pgmap v6898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:33:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:07 smithi136 ceph-mon[125702]: pgmap v6899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:33:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:07 smithi057 ceph-mon[92072]: pgmap v6899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:33:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:07 smithi122 ceph-mon[125440]: pgmap v6899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:33:09.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:09 smithi136 ceph-mon[125702]: pgmap v6900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:33:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:09 smithi057 ceph-mon[92072]: pgmap v6900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:33:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:09 smithi122 ceph-mon[125440]: pgmap v6900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:33:11.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:11 smithi136 ceph-mon[125702]: pgmap v6901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:33:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:11 smithi136 ceph-mon[125702]: osdmap e503: 12 total, 12 up, 12 in 2023-03-02T14:33:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:11 smithi057 ceph-mon[92072]: pgmap v6901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:33:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:11 smithi057 ceph-mon[92072]: osdmap e503: 12 total, 12 up, 12 in 2023-03-02T14:33:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:11 smithi122 ceph-mon[125440]: pgmap v6901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:33:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:11 smithi122 ceph-mon[125440]: osdmap e503: 12 total, 12 up, 12 in 2023-03-02T14:33:13.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:13 smithi136 ceph-mon[125702]: pgmap v6903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:13.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:33:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:13.891+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:33:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:13.891+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:33:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:13.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:33:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:13.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:33:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:13 smithi057 ceph-mon[92072]: pgmap v6903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:13 smithi122 ceph-mon[125440]: pgmap v6903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:15.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:15 smithi136 ceph-mon[125702]: pgmap v6904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:15 smithi057 ceph-mon[92072]: pgmap v6904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:15 smithi122 ceph-mon[125440]: pgmap v6904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:17.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:17 smithi136 ceph-mon[125702]: pgmap v6905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:17 smithi136 ceph-mon[125702]: osdmap e504: 12 total, 12 up, 12 in 2023-03-02T14:33:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:17 smithi057 ceph-mon[92072]: pgmap v6905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:17 smithi057 ceph-mon[92072]: osdmap e504: 12 total, 12 up, 12 in 2023-03-02T14:33:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:17 smithi122 ceph-mon[125440]: pgmap v6905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:17 smithi122 ceph-mon[125440]: osdmap e504: 12 total, 12 up, 12 in 2023-03-02T14:33:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:19 smithi136 ceph-mon[125702]: pgmap v6907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:33:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:19 smithi057 ceph-mon[92072]: pgmap v6907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:33:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:19 smithi122 ceph-mon[125440]: pgmap v6907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:33:21.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:21 smithi136 ceph-mon[125702]: pgmap v6908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 314 B/s wr, 10 op/s 2023-03-02T14:33:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:21 smithi057 ceph-mon[92072]: pgmap v6908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 314 B/s wr, 10 op/s 2023-03-02T14:33:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:21 smithi122 ceph-mon[125440]: pgmap v6908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 314 B/s wr, 10 op/s 2023-03-02T14:33:23.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:23 smithi136 ceph-mon[125702]: pgmap v6909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:23 smithi057 ceph-mon[92072]: pgmap v6909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:23 smithi122 ceph-mon[125440]: pgmap v6909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:25 smithi057 ceph-mon[92072]: pgmap v6910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:25 smithi122 ceph-mon[125440]: pgmap v6910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:26.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:25 smithi136 ceph-mon[125702]: pgmap v6910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:27 smithi057 ceph-mon[92072]: pgmap v6911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:27 smithi122 ceph-mon[125440]: pgmap v6911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:28.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:27 smithi136 ceph-mon[125702]: pgmap v6911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:33:28.904 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:28.904+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:33:28.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:28.904+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:33:28.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:28.904+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:33:28.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:28.904+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:33:28.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:28.904+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:33:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:29 smithi057 ceph-mon[92072]: pgmap v6912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:33:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:29 smithi122 ceph-mon[125440]: pgmap v6912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:33:30.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:29 smithi136 ceph-mon[125702]: pgmap v6912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:33:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:31 smithi057 ceph-mon[92072]: pgmap v6913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:31 smithi122 ceph-mon[125440]: pgmap v6913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:32.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:31 smithi136 ceph-mon[125702]: pgmap v6913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:33 smithi057 ceph-mon[92072]: pgmap v6914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:33 smithi122 ceph-mon[125440]: pgmap v6914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:33 smithi136 ceph-mon[125702]: pgmap v6914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:35 smithi057 ceph-mon[92072]: pgmap v6915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:35 smithi122 ceph-mon[125440]: pgmap v6915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:36.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:35 smithi136 ceph-mon[125702]: pgmap v6915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:37 smithi057 ceph-mon[92072]: pgmap v6916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:37 smithi122 ceph-mon[125440]: pgmap v6916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:38.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:37 smithi136 ceph-mon[125702]: pgmap v6916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:39 smithi057 ceph-mon[92072]: pgmap v6917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:39 smithi122 ceph-mon[125440]: pgmap v6917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:39 smithi136 ceph-mon[125702]: pgmap v6917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:40.209+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:33:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:40.209+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:33:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:40.209+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 102 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:33:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:40.209+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 103 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:33:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:41 smithi057 ceph-mon[92072]: pgmap v6918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:41 smithi122 ceph-mon[125440]: pgmap v6918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:42.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:41 smithi136 ceph-mon[125702]: pgmap v6918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:43.914+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:33:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:43.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:33:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:43.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:33:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:43.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:33:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:43.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:33:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:43 smithi057 ceph-mon[92072]: pgmap v6919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:43 smithi122 ceph-mon[125440]: pgmap v6919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:43 smithi136 ceph-mon[125702]: pgmap v6919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:45 smithi057 ceph-mon[92072]: pgmap v6920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:45 smithi122 ceph-mon[125440]: pgmap v6920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:46.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:45 smithi136 ceph-mon[125702]: pgmap v6920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:47 smithi057 ceph-mon[92072]: pgmap v6921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:47 smithi122 ceph-mon[125440]: pgmap v6921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:48.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:47 smithi136 ceph-mon[125702]: pgmap v6921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:49 smithi057 ceph-mon[92072]: pgmap v6922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:49 smithi122 ceph-mon[125440]: pgmap v6922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:50.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:49 smithi136 ceph-mon[125702]: pgmap v6922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:50.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:33:50.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:33:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:33:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:51 smithi057 ceph-mon[92072]: pgmap v6923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:51 smithi122 ceph-mon[125440]: pgmap v6923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:52.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:51 smithi136 ceph-mon[125702]: pgmap v6923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:53 smithi057 ceph-mon[92072]: pgmap v6924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:53 smithi122 ceph-mon[125440]: pgmap v6924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:53 smithi136 ceph-mon[125702]: pgmap v6924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:54.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:54.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:54.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:54.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:55.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 211.2M 2023-03-02T14:33:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 221500084: error parsing value: Value '221500084' is below minimum 939524096 2023-03-02T14:33:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:33:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:33:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: pgmap v6925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:33:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:33:55.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 211.2M 2023-03-02T14:33:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 221500084: error parsing value: Value '221500084' is below minimum 939524096 2023-03-02T14:33:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:33:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:33:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: pgmap v6925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:33:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:33:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 211.2M 2023-03-02T14:33:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 221500084: error parsing value: Value '221500084' is below minimum 939524096 2023-03-02T14:33:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:33:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:33:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: pgmap v6925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:33:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:33:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:33:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:33:56.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:56 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:33:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:56 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:33:56.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:56 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:33:56.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:56 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:33:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:56 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:33:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:56 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:33:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:57 smithi057 ceph-mon[92072]: pgmap v6926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:57 smithi122 ceph-mon[125440]: pgmap v6926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:58.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:57 smithi136 ceph-mon[125702]: pgmap v6926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:33:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:58.928+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:33:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:58.928+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:33:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:58.928+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:33:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:58.928+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:33:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:33:58.928+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:33:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:33:59 smithi057 ceph-mon[92072]: pgmap v6927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:33:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:33:59 smithi122 ceph-mon[125440]: pgmap v6927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:00.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:33:59 smithi136 ceph-mon[125702]: pgmap v6927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:01 smithi057 ceph-mon[92072]: pgmap v6928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:01 smithi122 ceph-mon[125440]: pgmap v6928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:02.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:01 smithi136 ceph-mon[125702]: pgmap v6928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:03 smithi122 ceph-mon[125440]: pgmap v6929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:34:04.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:03 smithi136 ceph-mon[125702]: pgmap v6929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:34:04.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:03 smithi057 ceph-mon[92072]: pgmap v6929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:34:04.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:04 smithi122 ceph-mon[125440]: pgmap v6930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:34:05.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:04 smithi136 ceph-mon[125702]: pgmap v6930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:34:05.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:04 smithi057 ceph-mon[92072]: pgmap v6930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:34:07.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:07 smithi057 ceph-mon[92072]: pgmap v6931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:34:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:07 smithi122 ceph-mon[125440]: pgmap v6931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:34:07.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:07 smithi136 ceph-mon[125702]: pgmap v6931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:34:09.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:09 smithi136 ceph-mon[125702]: pgmap v6932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:34:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:09 smithi057 ceph-mon[92072]: pgmap v6932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:34:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:09 smithi122 ceph-mon[125440]: pgmap v6932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:34:11.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:11 smithi136 ceph-mon[125702]: pgmap v6933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:34:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:11 smithi136 ceph-mon[125702]: osdmap e505: 12 total, 12 up, 12 in 2023-03-02T14:34:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:11 smithi057 ceph-mon[92072]: pgmap v6933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:34:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:11 smithi057 ceph-mon[92072]: osdmap e505: 12 total, 12 up, 12 in 2023-03-02T14:34:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:11 smithi122 ceph-mon[125440]: pgmap v6933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:34:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:11 smithi122 ceph-mon[125440]: osdmap e505: 12 total, 12 up, 12 in 2023-03-02T14:34:13.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:13 smithi136 ceph-mon[125702]: pgmap v6935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:34:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:13 smithi057 ceph-mon[92072]: pgmap v6935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:34:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:13.944+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:34:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:13.944+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:34:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:13.944+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:34:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:13.944+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:34:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:13.944+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:34:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:13 smithi122 ceph-mon[125440]: pgmap v6935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:34:15.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:15 smithi136 ceph-mon[125702]: pgmap v6936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:34:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:15 smithi057 ceph-mon[92072]: pgmap v6936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:34:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:15 smithi122 ceph-mon[125440]: pgmap v6936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:34:17.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:17 smithi136 ceph-mon[125702]: pgmap v6937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:34:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:17 smithi136 ceph-mon[125702]: osdmap e506: 12 total, 12 up, 12 in 2023-03-02T14:34:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:17 smithi057 ceph-mon[92072]: pgmap v6937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:34:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:17 smithi057 ceph-mon[92072]: osdmap e506: 12 total, 12 up, 12 in 2023-03-02T14:34:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:17 smithi122 ceph-mon[125440]: pgmap v6937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:34:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:17 smithi122 ceph-mon[125440]: osdmap e506: 12 total, 12 up, 12 in 2023-03-02T14:34:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:19 smithi136 ceph-mon[125702]: pgmap v6939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:34:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:19 smithi057 ceph-mon[92072]: pgmap v6939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:34:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:19 smithi122 ceph-mon[125440]: pgmap v6939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:34:21.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:21 smithi136 ceph-mon[125702]: pgmap v6940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:34:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:21 smithi057 ceph-mon[92072]: pgmap v6940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:34:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:21 smithi122 ceph-mon[125440]: pgmap v6940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:34:23.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:23 smithi136 ceph-mon[125702]: pgmap v6941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:34:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:23 smithi057 ceph-mon[92072]: pgmap v6941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:34:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:23 smithi122 ceph-mon[125440]: pgmap v6941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:34:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:25 smithi136 ceph-mon[125702]: pgmap v6942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:34:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:25 smithi057 ceph-mon[92072]: pgmap v6942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:34:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:25 smithi122 ceph-mon[125440]: pgmap v6942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:34:27.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:27 smithi136 ceph-mon[125702]: pgmap v6943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:34:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:27 smithi057 ceph-mon[92072]: pgmap v6943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:34:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:27 smithi122 ceph-mon[125440]: pgmap v6943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:34:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:28.958+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:34:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:28.959+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:34:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:28.959+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:34:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:28.959+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:34:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:28.959+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:34:29.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:29 smithi136 ceph-mon[125702]: pgmap v6944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:34:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:29 smithi057 ceph-mon[92072]: pgmap v6944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:34:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:29 smithi122 ceph-mon[125440]: pgmap v6944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:34:31.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:31 smithi136 ceph-mon[125702]: pgmap v6945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:31 smithi057 ceph-mon[92072]: pgmap v6945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:31 smithi122 ceph-mon[125440]: pgmap v6945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:33 smithi057 ceph-mon[92072]: pgmap v6946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:33 smithi122 ceph-mon[125440]: pgmap v6946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:34.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:33 smithi136 ceph-mon[125702]: pgmap v6946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:35 smithi057 ceph-mon[92072]: pgmap v6947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:35 smithi122 ceph-mon[125440]: pgmap v6947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:36.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:35 smithi136 ceph-mon[125702]: pgmap v6947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:37 smithi057 ceph-mon[92072]: pgmap v6948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:37 smithi122 ceph-mon[125440]: pgmap v6948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:38.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:37 smithi136 ceph-mon[125702]: pgmap v6948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:39.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:39 smithi057 ceph-mon[92072]: pgmap v6949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:39 smithi122 ceph-mon[125440]: pgmap v6949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:39 smithi136 ceph-mon[125702]: pgmap v6949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:41 smithi057 ceph-mon[92072]: pgmap v6950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:41 smithi122 ceph-mon[125440]: pgmap v6950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:42.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:41 smithi136 ceph-mon[125702]: pgmap v6950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:43 smithi057 ceph-mon[92072]: pgmap v6951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:43 smithi122 ceph-mon[125440]: pgmap v6951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:43.974+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:34:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:43.974+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:34:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:43.974+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:34:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:43.974+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:34:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:43.974+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:34:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:43 smithi136 ceph-mon[125702]: pgmap v6951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:45 smithi057 ceph-mon[92072]: pgmap v6952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:45 smithi122 ceph-mon[125440]: pgmap v6952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:46.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:45 smithi136 ceph-mon[125702]: pgmap v6952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:47 smithi057 ceph-mon[92072]: pgmap v6953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:47 smithi122 ceph-mon[125440]: pgmap v6953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:48.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:47 smithi136 ceph-mon[125702]: pgmap v6953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:49 smithi057 ceph-mon[92072]: pgmap v6954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:49 smithi122 ceph-mon[125440]: pgmap v6954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:50.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:49 smithi136 ceph-mon[125702]: pgmap v6954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:51 smithi057 ceph-mon[92072]: pgmap v6955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:51 smithi122 ceph-mon[125440]: pgmap v6955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:52.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:51 smithi136 ceph-mon[125702]: pgmap v6955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:53 smithi057 ceph-mon[92072]: pgmap v6956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:53 smithi122 ceph-mon[125440]: pgmap v6956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:54.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:53 smithi136 ceph-mon[125702]: pgmap v6956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:55 smithi057 ceph-mon[92072]: pgmap v6957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:34:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:55 smithi122 ceph-mon[125440]: pgmap v6957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:34:56.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:55 smithi136 ceph-mon[125702]: pgmap v6957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:34:56.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:34:56.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:34:56.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:34:56.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:34:56.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:34:56.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:34:57.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:34:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:34:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:34:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:57 smithi057 ceph-mon[92072]: pgmap v6958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:57 smithi122 ceph-mon[125440]: pgmap v6958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:58.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:57 smithi136 ceph-mon[125702]: pgmap v6958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:34:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:58.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:34:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:58.987+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:34:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:58.987+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:34:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:58.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:34:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:34:58.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:34:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:34:59 smithi057 ceph-mon[92072]: pgmap v6959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:34:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:34:59 smithi122 ceph-mon[125440]: pgmap v6959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:00.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:34:59 smithi136 ceph-mon[125702]: pgmap v6959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:01 smithi057 ceph-mon[92072]: pgmap v6960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:01 smithi122 ceph-mon[125440]: pgmap v6960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:02.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:01 smithi136 ceph-mon[125702]: pgmap v6960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:03 smithi057 ceph-mon[92072]: pgmap v6961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:35:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:03 smithi122 ceph-mon[125440]: pgmap v6961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:35:04.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:03 smithi136 ceph-mon[125702]: pgmap v6961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:35:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:05 smithi122 ceph-mon[125440]: pgmap v6962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:35:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:05 smithi136 ceph-mon[125702]: pgmap v6962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:35:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:05 smithi057 ceph-mon[92072]: pgmap v6962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:35:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:07 smithi122 ceph-mon[125440]: pgmap v6963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:35:08.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:07 smithi136 ceph-mon[125702]: pgmap v6963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:35:08.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:07 smithi057 ceph-mon[92072]: pgmap v6963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:35:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:09 smithi122 ceph-mon[125440]: pgmap v6964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:35:10.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:09 smithi136 ceph-mon[125702]: pgmap v6964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:35:10.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:09 smithi057 ceph-mon[92072]: pgmap v6964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:35:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:10.222+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:35:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:10.222+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:35:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:10.223+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 103 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:35:10.223 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:10.223+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 104 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:35:11.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:10 smithi136 ceph-mon[125702]: pgmap v6965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:35:11.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:10 smithi057 ceph-mon[92072]: pgmap v6965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:35:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:10 smithi122 ceph-mon[125440]: pgmap v6965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:35:12.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:11 smithi136 ceph-mon[125702]: osdmap e507: 12 total, 12 up, 12 in 2023-03-02T14:35:12.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:11 smithi057 ceph-mon[92072]: osdmap e507: 12 total, 12 up, 12 in 2023-03-02T14:35:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:11 smithi122 ceph-mon[125440]: osdmap e507: 12 total, 12 up, 12 in 2023-03-02T14:35:13.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:13 smithi136 ceph-mon[125702]: pgmap v6967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:35:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:13 smithi057 ceph-mon[92072]: pgmap v6967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:35:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:13 smithi122 ceph-mon[125440]: pgmap v6967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:14.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:14.002+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:35:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:14.002+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:35:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:14.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:35:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:14.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:35:15.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:15 smithi136 ceph-mon[125702]: pgmap v6968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:35:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:15 smithi057 ceph-mon[92072]: pgmap v6968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:35:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:15 smithi122 ceph-mon[125440]: pgmap v6968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:35:17.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:17 smithi136 ceph-mon[125702]: pgmap v6969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:35:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:17 smithi136 ceph-mon[125702]: osdmap e508: 12 total, 12 up, 12 in 2023-03-02T14:35:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:17 smithi057 ceph-mon[92072]: pgmap v6969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:35:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:17 smithi057 ceph-mon[92072]: osdmap e508: 12 total, 12 up, 12 in 2023-03-02T14:35:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:17 smithi122 ceph-mon[125440]: pgmap v6969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:35:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:17 smithi122 ceph-mon[125440]: osdmap e508: 12 total, 12 up, 12 in 2023-03-02T14:35:19.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:19 smithi136 ceph-mon[125702]: pgmap v6971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:35:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:19 smithi057 ceph-mon[92072]: pgmap v6971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:35:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:19 smithi122 ceph-mon[125440]: pgmap v6971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:35:21.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:21 smithi136 ceph-mon[125702]: pgmap v6972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:35:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:21 smithi057 ceph-mon[92072]: pgmap v6972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:35:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:21 smithi122 ceph-mon[125440]: pgmap v6972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:35:23.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:23 smithi136 ceph-mon[125702]: pgmap v6973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:35:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:23 smithi057 ceph-mon[92072]: pgmap v6973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:35:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:23 smithi122 ceph-mon[125440]: pgmap v6973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:35:25.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:25 smithi136 ceph-mon[125702]: pgmap v6974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:35:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:25 smithi057 ceph-mon[92072]: pgmap v6974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:35:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:25 smithi122 ceph-mon[125440]: pgmap v6974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:35:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:27 smithi057 ceph-mon[92072]: pgmap v6975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:35:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:27 smithi122 ceph-mon[125440]: pgmap v6975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:35:28.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:27 smithi136 ceph-mon[125702]: pgmap v6975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:35:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:29.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:35:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:29.010+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:35:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:29.010+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:35:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:29.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:35:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:29.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:35:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:29 smithi057 ceph-mon[92072]: pgmap v6976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:35:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:29 smithi122 ceph-mon[125440]: pgmap v6976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:35:30.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:29 smithi136 ceph-mon[125702]: pgmap v6976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:35:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:31 smithi057 ceph-mon[92072]: pgmap v6977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:31 smithi122 ceph-mon[125440]: pgmap v6977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:31 smithi136 ceph-mon[125702]: pgmap v6977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:33 smithi057 ceph-mon[92072]: pgmap v6978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:33 smithi122 ceph-mon[125440]: pgmap v6978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:34.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:33 smithi136 ceph-mon[125702]: pgmap v6978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:35.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:35 smithi057 ceph-mon[92072]: pgmap v6979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:35 smithi122 ceph-mon[125440]: pgmap v6979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:36.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:35 smithi136 ceph-mon[125702]: pgmap v6979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:37 smithi057 ceph-mon[92072]: pgmap v6980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:37 smithi122 ceph-mon[125440]: pgmap v6980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:38.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:37 smithi136 ceph-mon[125702]: pgmap v6980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:39.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:39 smithi057 ceph-mon[92072]: pgmap v6981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:39 smithi122 ceph-mon[125440]: pgmap v6981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:40.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:39 smithi136 ceph-mon[125702]: pgmap v6981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:41 smithi057 ceph-mon[92072]: pgmap v6982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:41 smithi122 ceph-mon[125440]: pgmap v6982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:42.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:41 smithi136 ceph-mon[125702]: pgmap v6982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:43 smithi057 ceph-mon[92072]: pgmap v6983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:43 smithi122 ceph-mon[125440]: pgmap v6983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:44.025+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:35:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:44.025+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:35:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:44.025+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:35:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:44.025+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:35:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:44.025+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:35:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:43 smithi136 ceph-mon[125702]: pgmap v6983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:45 smithi057 ceph-mon[92072]: pgmap v6984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:45 smithi122 ceph-mon[125440]: pgmap v6984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:46.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:45 smithi136 ceph-mon[125702]: pgmap v6984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:47 smithi057 ceph-mon[92072]: pgmap v6985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:47 smithi122 ceph-mon[125440]: pgmap v6985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:48.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:47 smithi136 ceph-mon[125702]: pgmap v6985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:49 smithi057 ceph-mon[92072]: pgmap v6986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:49 smithi122 ceph-mon[125440]: pgmap v6986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:50.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:49 smithi136 ceph-mon[125702]: pgmap v6986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:51 smithi057 ceph-mon[92072]: pgmap v6987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:51 smithi122 ceph-mon[125440]: pgmap v6987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:52.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:51 smithi136 ceph-mon[125702]: pgmap v6987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:53 smithi057 ceph-mon[92072]: pgmap v6988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:53 smithi122 ceph-mon[125440]: pgmap v6988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:54.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:53 smithi136 ceph-mon[125702]: pgmap v6988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:55 smithi057 ceph-mon[92072]: pgmap v6989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:55 smithi122 ceph-mon[125440]: pgmap v6989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:56.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:55 smithi136 ceph-mon[125702]: pgmap v6989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:56.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:35:56.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:35:57.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:35:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:57 smithi057 ceph-mon[92072]: pgmap v6990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:35:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:35:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:35:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:35:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:35:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:57 smithi122 ceph-mon[125440]: pgmap v6990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:35:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:35:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:35:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:35:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:35:58.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:57 smithi136 ceph-mon[125702]: pgmap v6990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:35:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:35:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:35:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:35:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:35:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:35:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:59.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:35:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:59.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:35:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:59.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:35:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:59.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:35:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:35:59.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:35:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:35:59 smithi057 ceph-mon[92072]: pgmap v6991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:35:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:35:59 smithi122 ceph-mon[125440]: pgmap v6991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:00.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:35:59 smithi136 ceph-mon[125702]: pgmap v6991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:01 smithi122 ceph-mon[125440]: pgmap v6992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:02.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:01 smithi136 ceph-mon[125702]: pgmap v6992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:02.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:01 smithi057 ceph-mon[92072]: pgmap v6992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:03 smithi122 ceph-mon[125440]: pgmap v6993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:36:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:03 smithi136 ceph-mon[125702]: pgmap v6993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:36:04.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:03 smithi057 ceph-mon[92072]: pgmap v6993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:36:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:05 smithi122 ceph-mon[125440]: pgmap v6994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:36:06.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:05 smithi136 ceph-mon[125702]: pgmap v6994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:36:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:05 smithi057 ceph-mon[92072]: pgmap v6994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:36:08.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:07 smithi136 ceph-mon[125702]: pgmap v6995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:36:08.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:07 smithi057 ceph-mon[92072]: pgmap v6995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:36:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:07 smithi122 ceph-mon[125440]: pgmap v6995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:36:10.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:09 smithi136 ceph-mon[125702]: pgmap v6996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:36:10.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:09 smithi057 ceph-mon[92072]: pgmap v6996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:36:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:09 smithi122 ceph-mon[125440]: pgmap v6996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:36:11.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:10 smithi136 ceph-mon[125702]: pgmap v6997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:36:11.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:10 smithi057 ceph-mon[92072]: pgmap v6997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:36:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:10 smithi122 ceph-mon[125440]: pgmap v6997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:36:12.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:11 smithi136 ceph-mon[125702]: osdmap e509: 12 total, 12 up, 12 in 2023-03-02T14:36:12.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:11 smithi057 ceph-mon[92072]: osdmap e509: 12 total, 12 up, 12 in 2023-03-02T14:36:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:11 smithi122 ceph-mon[125440]: osdmap e509: 12 total, 12 up, 12 in 2023-03-02T14:36:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:13 smithi136 ceph-mon[125702]: pgmap v6999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:36:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:13 smithi057 ceph-mon[92072]: pgmap v6999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:36:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:13 smithi122 ceph-mon[125440]: pgmap v6999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:36:14.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:14.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:36:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:14.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:36:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:14.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:36:14.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:14.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:36:14.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:14.044+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:36:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:15 smithi136 ceph-mon[125702]: pgmap v7000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:36:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:15 smithi057 ceph-mon[92072]: pgmap v7000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:36:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:15 smithi122 ceph-mon[125440]: pgmap v7000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:36:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:17 smithi057 ceph-mon[92072]: pgmap v7001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:36:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:17 smithi057 ceph-mon[92072]: osdmap e510: 12 total, 12 up, 12 in 2023-03-02T14:36:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:17 smithi122 ceph-mon[125440]: pgmap v7001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:36:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:17 smithi122 ceph-mon[125440]: osdmap e510: 12 total, 12 up, 12 in 2023-03-02T14:36:18.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:17 smithi136 ceph-mon[125702]: pgmap v7001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:36:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:17 smithi136 ceph-mon[125702]: osdmap e510: 12 total, 12 up, 12 in 2023-03-02T14:36:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:19 smithi057 ceph-mon[92072]: pgmap v7003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:36:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:19 smithi122 ceph-mon[125440]: pgmap v7003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:36:20.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:19 smithi136 ceph-mon[125702]: pgmap v7003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:36:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:21 smithi057 ceph-mon[92072]: pgmap v7004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:36:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:21 smithi122 ceph-mon[125440]: pgmap v7004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:36:22.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:21 smithi136 ceph-mon[125702]: pgmap v7004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T14:36:23.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:23 smithi057 ceph-mon[92072]: pgmap v7005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:36:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:23 smithi122 ceph-mon[125440]: pgmap v7005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:36:24.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:23 smithi136 ceph-mon[125702]: pgmap v7005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:36:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:25 smithi057 ceph-mon[92072]: pgmap v7006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:36:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:25 smithi122 ceph-mon[125440]: pgmap v7006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:36:26.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:25 smithi136 ceph-mon[125702]: pgmap v7006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:36:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:27 smithi057 ceph-mon[92072]: pgmap v7007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:36:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:27 smithi122 ceph-mon[125440]: pgmap v7007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:36:28.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:27 smithi136 ceph-mon[125702]: pgmap v7007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:36:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:29.052+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:36:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:29.052+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:36:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:29.052+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:36:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:29.052+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:36:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:29.052+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:36:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:29 smithi057 ceph-mon[92072]: pgmap v7008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:36:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:29 smithi122 ceph-mon[125440]: pgmap v7008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:36:30.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:29 smithi136 ceph-mon[125702]: pgmap v7008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:36:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:31 smithi057 ceph-mon[92072]: pgmap v7009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:31 smithi122 ceph-mon[125440]: pgmap v7009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:32.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:31 smithi136 ceph-mon[125702]: pgmap v7009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:33 smithi057 ceph-mon[92072]: pgmap v7010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:33 smithi122 ceph-mon[125440]: pgmap v7010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:34.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:33 smithi136 ceph-mon[125702]: pgmap v7010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:35 smithi057 ceph-mon[92072]: pgmap v7011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:35 smithi122 ceph-mon[125440]: pgmap v7011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:36.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:35 smithi136 ceph-mon[125702]: pgmap v7011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:37 smithi057 ceph-mon[92072]: pgmap v7012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:37 smithi122 ceph-mon[125440]: pgmap v7012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:38.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:37 smithi136 ceph-mon[125702]: pgmap v7012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:39.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:39 smithi057 ceph-mon[92072]: pgmap v7013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:39 smithi122 ceph-mon[125440]: pgmap v7013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:40.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:39 smithi136 ceph-mon[125702]: pgmap v7013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:41 smithi057 ceph-mon[92072]: pgmap v7014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:41 smithi122 ceph-mon[125440]: pgmap v7014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:42.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:41 smithi136 ceph-mon[125702]: pgmap v7014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:43 smithi057 ceph-mon[92072]: pgmap v7015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:43 smithi122 ceph-mon[125440]: pgmap v7015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:44.057+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:36:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:44.057+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:36:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:44.057+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:36:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:44.057+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:36:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:44.057+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:36:44.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:43 smithi136 ceph-mon[125702]: pgmap v7015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:45 smithi057 ceph-mon[92072]: pgmap v7016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:45 smithi122 ceph-mon[125440]: pgmap v7016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:46.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:45 smithi136 ceph-mon[125702]: pgmap v7016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:47 smithi057 ceph-mon[92072]: pgmap v7017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:47 smithi122 ceph-mon[125440]: pgmap v7017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:48.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:47 smithi136 ceph-mon[125702]: pgmap v7017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:49 smithi057 ceph-mon[92072]: pgmap v7018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:49 smithi122 ceph-mon[125440]: pgmap v7018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:49 smithi136 ceph-mon[125702]: pgmap v7018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:51 smithi057 ceph-mon[92072]: pgmap v7019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:51 smithi122 ceph-mon[125440]: pgmap v7019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:52.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:51 smithi136 ceph-mon[125702]: pgmap v7019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:53 smithi057 ceph-mon[92072]: pgmap v7020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:53 smithi122 ceph-mon[125440]: pgmap v7020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:54.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:53 smithi136 ceph-mon[125702]: pgmap v7020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:55 smithi057 ceph-mon[92072]: pgmap v7021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:55 smithi122 ceph-mon[125440]: pgmap v7021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:56.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:55 smithi136 ceph-mon[125702]: pgmap v7021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:57 smithi122 ceph-mon[125440]: pgmap v7022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:36:58.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:57 smithi136 ceph-mon[125702]: pgmap v7022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:36:58.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:57 smithi057 ceph-mon[92072]: pgmap v7022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:36:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:36:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:59.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:36:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:59.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:36:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:59.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:36:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:59.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:36:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:36:59.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:36:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:59 smithi122 ceph-mon[125440]: pgmap v7023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:36:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:36:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:36:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:59 smithi136 ceph-mon[125702]: pgmap v7023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:36:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:36:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:36:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:36:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:59 smithi057 ceph-mon[92072]: pgmap v7023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:36:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:36:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:36:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:36:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:37:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:01 smithi122 ceph-mon[125440]: pgmap v7024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:01.838 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:01 smithi136 ceph-mon[125702]: pgmap v7024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:01 smithi057 ceph-mon[92072]: pgmap v7024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:03 smithi057 ceph-mon[92072]: pgmap v7025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:37:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:03 smithi122 ceph-mon[125440]: pgmap v7025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:37:04.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:03 smithi136 ceph-mon[125702]: pgmap v7025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:37:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:05 smithi057 ceph-mon[92072]: pgmap v7026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:37:05.993 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:05 smithi122 ceph-mon[125440]: pgmap v7026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:37:06.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:05 smithi136 ceph-mon[125702]: pgmap v7026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:37:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:07 smithi057 ceph-mon[92072]: pgmap v7027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:37:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:07 smithi122 ceph-mon[125440]: pgmap v7027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:37:08.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:07 smithi136 ceph-mon[125702]: pgmap v7027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:37:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:09 smithi057 ceph-mon[92072]: pgmap v7028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:37:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:09 smithi122 ceph-mon[125440]: pgmap v7028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:37:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:09 smithi136 ceph-mon[125702]: pgmap v7028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:37:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:11 smithi057 ceph-mon[92072]: pgmap v7029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:37:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:11 smithi057 ceph-mon[92072]: osdmap e511: 12 total, 12 up, 12 in 2023-03-02T14:37:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:11 smithi122 ceph-mon[125440]: pgmap v7029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:37:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:11 smithi122 ceph-mon[125440]: osdmap e511: 12 total, 12 up, 12 in 2023-03-02T14:37:12.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:11 smithi136 ceph-mon[125702]: pgmap v7029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:37:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:11 smithi136 ceph-mon[125702]: osdmap e511: 12 total, 12 up, 12 in 2023-03-02T14:37:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:13 smithi057 ceph-mon[92072]: pgmap v7031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:37:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:13 smithi122 ceph-mon[125440]: pgmap v7031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:37:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:14.076+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:37:14.077 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:14.077+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:37:14.077 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:14.077+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:37:14.077 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:14.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:37:14.077 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:14.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:37:14.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:13 smithi136 ceph-mon[125702]: pgmap v7031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:37:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:15 smithi057 ceph-mon[92072]: pgmap v7032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:37:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:15 smithi122 ceph-mon[125440]: pgmap v7032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:37:16.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:15 smithi136 ceph-mon[125702]: pgmap v7032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:37:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:17 smithi057 ceph-mon[92072]: pgmap v7033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:37:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:17 smithi057 ceph-mon[92072]: osdmap e512: 12 total, 12 up, 12 in 2023-03-02T14:37:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:17 smithi122 ceph-mon[125440]: pgmap v7033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:37:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:17 smithi122 ceph-mon[125440]: osdmap e512: 12 total, 12 up, 12 in 2023-03-02T14:37:18.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:17 smithi136 ceph-mon[125702]: pgmap v7033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:37:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:17 smithi136 ceph-mon[125702]: osdmap e512: 12 total, 12 up, 12 in 2023-03-02T14:37:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:19 smithi057 ceph-mon[92072]: pgmap v7035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:37:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:19 smithi122 ceph-mon[125440]: pgmap v7035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:37:20.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:19 smithi136 ceph-mon[125702]: pgmap v7035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:37:21.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:21 smithi057 ceph-mon[92072]: pgmap v7036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:37:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:21 smithi122 ceph-mon[125440]: pgmap v7036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:37:22.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:21 smithi136 ceph-mon[125702]: pgmap v7036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:37:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:23 smithi057 ceph-mon[92072]: pgmap v7037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:37:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:23 smithi122 ceph-mon[125440]: pgmap v7037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:37:24.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:23 smithi136 ceph-mon[125702]: pgmap v7037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:37:25.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:25 smithi057 ceph-mon[92072]: pgmap v7038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:37:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:25 smithi122 ceph-mon[125440]: pgmap v7038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:37:26.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:25 smithi136 ceph-mon[125702]: pgmap v7038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:37:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:27 smithi057 ceph-mon[92072]: pgmap v7039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:37:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:27 smithi122 ceph-mon[125440]: pgmap v7039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:37:28.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:27 smithi136 ceph-mon[125702]: pgmap v7039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:37:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:29.092+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:37:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:29.093+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:37:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:29.093+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:37:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:29.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:37:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:29.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:37:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:29 smithi122 ceph-mon[125440]: pgmap v7040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T14:37:30.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:29 smithi136 ceph-mon[125702]: pgmap v7040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T14:37:30.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:29 smithi057 ceph-mon[92072]: pgmap v7040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T14:37:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:31 smithi122 ceph-mon[125440]: pgmap v7041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:37:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:31 smithi136 ceph-mon[125702]: pgmap v7041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:37:32.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:31 smithi057 ceph-mon[92072]: pgmap v7041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:37:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:33 smithi122 ceph-mon[125440]: pgmap v7042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:33 smithi136 ceph-mon[125702]: pgmap v7042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:34.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:33 smithi057 ceph-mon[92072]: pgmap v7042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:35 smithi136 ceph-mon[125702]: pgmap v7043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:37:36.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:35 smithi057 ceph-mon[92072]: pgmap v7043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:37:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:35 smithi122 ceph-mon[125440]: pgmap v7043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:37:38.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:37 smithi136 ceph-mon[125702]: pgmap v7044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:37:38.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:37 smithi057 ceph-mon[92072]: pgmap v7044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:37:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:37 smithi122 ceph-mon[125440]: pgmap v7044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:37:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:39 smithi136 ceph-mon[125702]: pgmap v7045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:40.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:39 smithi057 ceph-mon[92072]: pgmap v7045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:39 smithi122 ceph-mon[125440]: pgmap v7045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:41 smithi136 ceph-mon[125702]: pgmap v7046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:42.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:41 smithi057 ceph-mon[92072]: pgmap v7046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:41 smithi122 ceph-mon[125440]: pgmap v7046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:44.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:43 smithi136 ceph-mon[125702]: pgmap v7047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:44.096+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:37:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:44.096+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:37:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:44.096+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:37:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:44.096+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:37:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:44.096+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:37:44.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:43 smithi057 ceph-mon[92072]: pgmap v7047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:43 smithi122 ceph-mon[125440]: pgmap v7047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:46.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:45 smithi136 ceph-mon[125702]: pgmap v7048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:46.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:45 smithi057 ceph-mon[92072]: pgmap v7048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:45 smithi122 ceph-mon[125440]: pgmap v7048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:47.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:46 smithi136 ceph-mon[125702]: pgmap v7049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:47.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:46 smithi057 ceph-mon[92072]: pgmap v7049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:47.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:46 smithi122 ceph-mon[125440]: pgmap v7049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:49 smithi057 ceph-mon[92072]: pgmap v7050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:49 smithi122 ceph-mon[125440]: pgmap v7050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:50.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:49 smithi136 ceph-mon[125702]: pgmap v7050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:51 smithi057 ceph-mon[92072]: pgmap v7051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:51 smithi122 ceph-mon[125440]: pgmap v7051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:52.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:51 smithi136 ceph-mon[125702]: pgmap v7051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:53 smithi057 ceph-mon[92072]: pgmap v7052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:53 smithi122 ceph-mon[125440]: pgmap v7052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:53 smithi136 ceph-mon[125702]: pgmap v7052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:55.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:55 smithi057 ceph-mon[92072]: pgmap v7053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:55 smithi122 ceph-mon[125440]: pgmap v7053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:55 smithi136 ceph-mon[125702]: pgmap v7053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:57.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:57 smithi057 ceph-mon[92072]: pgmap v7054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:57 smithi122 ceph-mon[125440]: pgmap v7054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:57 smithi136 ceph-mon[125702]: pgmap v7054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:37:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:59.110+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:37:59.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:59.111+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:37:59.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:59.111+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:37:59.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:59.111+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:37:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:37:59.111+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:37:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:59 smithi057 ceph-mon[92072]: pgmap v7055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:59.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:37:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:37:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:59 smithi122 ceph-mon[125440]: pgmap v7055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:37:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:37:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:38:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:59 smithi136 ceph-mon[125702]: pgmap v7055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:37:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:38:00.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:38:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:38:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:38:00.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:38:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:38:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:38:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:38:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:38:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:38:01.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:01 smithi057 ceph-mon[92072]: pgmap v7056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:01 smithi122 ceph-mon[125440]: pgmap v7056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:01 smithi136 ceph-mon[125702]: pgmap v7056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:03 smithi057 ceph-mon[92072]: pgmap v7057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:38:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:03 smithi122 ceph-mon[125440]: pgmap v7057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:38:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:03 smithi136 ceph-mon[125702]: pgmap v7057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:38:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:05 smithi057 ceph-mon[92072]: pgmap v7058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:38:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:05 smithi122 ceph-mon[125440]: pgmap v7058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:38:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:05 smithi136 ceph-mon[125702]: pgmap v7058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:38:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:07 smithi057 ceph-mon[92072]: pgmap v7059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:38:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:07 smithi122 ceph-mon[125440]: pgmap v7059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:38:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:07 smithi136 ceph-mon[125702]: pgmap v7059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:38:09.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:09 smithi057 ceph-mon[92072]: pgmap v7060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:38:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:09 smithi122 ceph-mon[125440]: pgmap v7060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:38:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:09 smithi136 ceph-mon[125702]: pgmap v7060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:38:10.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:10.249+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:38:10.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:10.249+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:38:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:10.249+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 104 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:38:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:10.249+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 105 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:38:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:11 smithi057 ceph-mon[92072]: pgmap v7061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:38:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:11 smithi057 ceph-mon[92072]: osdmap e513: 12 total, 12 up, 12 in 2023-03-02T14:38:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:11 smithi122 ceph-mon[125440]: pgmap v7061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:38:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:11 smithi122 ceph-mon[125440]: osdmap e513: 12 total, 12 up, 12 in 2023-03-02T14:38:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:11 smithi136 ceph-mon[125702]: pgmap v7061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:38:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:11 smithi136 ceph-mon[125702]: osdmap e513: 12 total, 12 up, 12 in 2023-03-02T14:38:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:13 smithi122 ceph-mon[125440]: pgmap v7063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:38:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:13 smithi136 ceph-mon[125702]: pgmap v7063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:38:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:14.127+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:38:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:14.127+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:38:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:14.127+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:38:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:14.127+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:38:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:14.127+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:38:14.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:13 smithi057 ceph-mon[92072]: pgmap v7063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:38:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:15 smithi122 ceph-mon[125440]: pgmap v7064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:38:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:15 smithi136 ceph-mon[125702]: pgmap v7064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:38:16.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:15 smithi057 ceph-mon[92072]: pgmap v7064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:38:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:17 smithi122 ceph-mon[125440]: pgmap v7065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:38:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:17 smithi122 ceph-mon[125440]: osdmap e514: 12 total, 12 up, 12 in 2023-03-02T14:38:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:17 smithi136 ceph-mon[125702]: pgmap v7065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:38:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:17 smithi136 ceph-mon[125702]: osdmap e514: 12 total, 12 up, 12 in 2023-03-02T14:38:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:17 smithi057 ceph-mon[92072]: pgmap v7065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:38:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:17 smithi057 ceph-mon[92072]: osdmap e514: 12 total, 12 up, 12 in 2023-03-02T14:38:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:19 smithi122 ceph-mon[125440]: pgmap v7067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:38:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:19 smithi136 ceph-mon[125702]: pgmap v7067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:38:20.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:19 smithi057 ceph-mon[92072]: pgmap v7067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:38:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:21 smithi136 ceph-mon[125702]: pgmap v7068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:38:22.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:21 smithi057 ceph-mon[92072]: pgmap v7068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:38:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:21 smithi122 ceph-mon[125440]: pgmap v7068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T14:38:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:23 smithi136 ceph-mon[125702]: pgmap v7069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:38:24.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:23 smithi057 ceph-mon[92072]: pgmap v7069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:38:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:23 smithi122 ceph-mon[125440]: pgmap v7069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:38:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:25 smithi122 ceph-mon[125440]: pgmap v7070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:38:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:25 smithi136 ceph-mon[125702]: pgmap v7070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:38:26.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:25 smithi057 ceph-mon[92072]: pgmap v7070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:38:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:27 smithi136 ceph-mon[125702]: pgmap v7071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:38:28.100 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:27 smithi122 ceph-mon[125440]: pgmap v7071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:38:28.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:27 smithi057 ceph-mon[92072]: pgmap v7071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:38:29.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:29.131+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:38:29.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:29.132+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:38:29.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:29.132+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:38:29.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:29.132+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:38:29.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:29.132+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:38:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:29 smithi136 ceph-mon[125702]: pgmap v7072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:38:30.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:29 smithi057 ceph-mon[92072]: pgmap v7072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:38:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:29 smithi122 ceph-mon[125440]: pgmap v7072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:38:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:31 smithi136 ceph-mon[125702]: pgmap v7073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:32.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:31 smithi057 ceph-mon[92072]: pgmap v7073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:31 smithi122 ceph-mon[125440]: pgmap v7073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:33 smithi136 ceph-mon[125702]: pgmap v7074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:34.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:33 smithi057 ceph-mon[92072]: pgmap v7074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:33 smithi122 ceph-mon[125440]: pgmap v7074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:34 smithi136 ceph-mon[125702]: pgmap v7075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:35.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:34 smithi057 ceph-mon[92072]: pgmap v7075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:35.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:34 smithi122 ceph-mon[125440]: pgmap v7075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:37 smithi136 ceph-mon[125702]: pgmap v7076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:37 smithi057 ceph-mon[92072]: pgmap v7076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:37 smithi122 ceph-mon[125440]: pgmap v7076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:39.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:39 smithi057 ceph-mon[92072]: pgmap v7077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:39 smithi122 ceph-mon[125440]: pgmap v7077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:39 smithi136 ceph-mon[125702]: pgmap v7077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:41 smithi057 ceph-mon[92072]: pgmap v7078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:41 smithi122 ceph-mon[125440]: pgmap v7078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:41 smithi136 ceph-mon[125702]: pgmap v7078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:43 smithi057 ceph-mon[92072]: pgmap v7079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:43 smithi122 ceph-mon[125440]: pgmap v7079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:43 smithi136 ceph-mon[125702]: pgmap v7079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:44.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:38:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:44.135+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:38:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:44.135+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:38:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:44.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:38:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:44.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:38:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:45 smithi057 ceph-mon[92072]: pgmap v7080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:45 smithi122 ceph-mon[125440]: pgmap v7080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:45 smithi136 ceph-mon[125702]: pgmap v7080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:47 smithi057 ceph-mon[92072]: pgmap v7081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:47 smithi122 ceph-mon[125440]: pgmap v7081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:47 smithi136 ceph-mon[125702]: pgmap v7081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:49 smithi057 ceph-mon[92072]: pgmap v7082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:49 smithi122 ceph-mon[125440]: pgmap v7082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:49 smithi136 ceph-mon[125702]: pgmap v7082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:51.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:51 smithi057 ceph-mon[92072]: pgmap v7083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:51 smithi122 ceph-mon[125440]: pgmap v7083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:51 smithi136 ceph-mon[125702]: pgmap v7083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:53.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:53 smithi057 ceph-mon[92072]: pgmap v7084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:53 smithi122 ceph-mon[125440]: pgmap v7084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:53 smithi136 ceph-mon[125702]: pgmap v7084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:38:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:55 smithi122 ceph-mon[125440]: pgmap v7085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:55 smithi136 ceph-mon[125702]: pgmap v7085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:56.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:55 smithi057 ceph-mon[92072]: pgmap v7085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:57 smithi122 ceph-mon[125440]: pgmap v7086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:57 smithi136 ceph-mon[125702]: pgmap v7086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:58.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:57 smithi057 ceph-mon[92072]: pgmap v7086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:38:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:59.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:38:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:59.136+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:38:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:59.136+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:38:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:59.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:38:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:38:59.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:38:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:38:59 smithi122 ceph-mon[125440]: pgmap v7087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:38:59 smithi136 ceph-mon[125702]: pgmap v7087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:00.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:38:59 smithi057 ceph-mon[92072]: pgmap v7087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:01.088 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:39:01.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:39:01.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:39:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:01 smithi136 ceph-mon[125702]: pgmap v7088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:39:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:39:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:39:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:01 smithi057 ceph-mon[92072]: pgmap v7088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:39:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:39:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:39:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:01 smithi122 ceph-mon[125440]: pgmap v7088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:39:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:39:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:39:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:03 smithi136 ceph-mon[125702]: pgmap v7089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:39:04.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:03 smithi057 ceph-mon[92072]: pgmap v7089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:39:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:03 smithi122 ceph-mon[125440]: pgmap v7089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:39:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:05 smithi136 ceph-mon[125702]: pgmap v7090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:39:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:05 smithi057 ceph-mon[92072]: pgmap v7090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:39:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:05 smithi122 ceph-mon[125440]: pgmap v7090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:39:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:07 smithi136 ceph-mon[125702]: pgmap v7091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:39:08.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:07 smithi057 ceph-mon[92072]: pgmap v7091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:39:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:07 smithi122 ceph-mon[125440]: pgmap v7091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:39:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:09 smithi136 ceph-mon[125702]: pgmap v7092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:39:10.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:09 smithi057 ceph-mon[92072]: pgmap v7092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:39:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:09 smithi122 ceph-mon[125440]: pgmap v7092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:39:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:11 smithi136 ceph-mon[125702]: pgmap v7093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:39:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:11 smithi136 ceph-mon[125702]: osdmap e515: 12 total, 12 up, 12 in 2023-03-02T14:39:12.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:11 smithi057 ceph-mon[92072]: pgmap v7093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:39:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:11 smithi057 ceph-mon[92072]: osdmap e515: 12 total, 12 up, 12 in 2023-03-02T14:39:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:11 smithi122 ceph-mon[125440]: pgmap v7093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:39:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:11 smithi122 ceph-mon[125440]: osdmap e515: 12 total, 12 up, 12 in 2023-03-02T14:39:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:13 smithi136 ceph-mon[125702]: pgmap v7095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:39:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:14.150+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:39:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:14.150+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:39:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:14.151+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:39:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:14.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:39:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:14.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:39:14.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:13 smithi057 ceph-mon[92072]: pgmap v7095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:39:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:13 smithi122 ceph-mon[125440]: pgmap v7095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:39:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:14 smithi136 ceph-mon[125702]: pgmap v7096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:39:15.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:14 smithi057 ceph-mon[92072]: pgmap v7096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:39:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:14 smithi122 ceph-mon[125440]: pgmap v7096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:39:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:17 smithi136 ceph-mon[125702]: pgmap v7097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:39:17.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:17 smithi057 ceph-mon[92072]: pgmap v7097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:39:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:17 smithi122 ceph-mon[125440]: pgmap v7097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:39:18.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:18 smithi057 ceph-mon[92072]: osdmap e516: 12 total, 12 up, 12 in 2023-03-02T14:39:18.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:18 smithi122 ceph-mon[125440]: osdmap e516: 12 total, 12 up, 12 in 2023-03-02T14:39:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:18 smithi136 ceph-mon[125702]: osdmap e516: 12 total, 12 up, 12 in 2023-03-02T14:39:19.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:19 smithi057 ceph-mon[92072]: pgmap v7099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:39:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:19 smithi122 ceph-mon[125440]: pgmap v7099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:39:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:19 smithi136 ceph-mon[125702]: pgmap v7099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:39:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:21 smithi057 ceph-mon[92072]: pgmap v7100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:39:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:21 smithi122 ceph-mon[125440]: pgmap v7100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:39:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:21 smithi136 ceph-mon[125702]: pgmap v7100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T14:39:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:23 smithi057 ceph-mon[92072]: pgmap v7101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:39:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:23 smithi122 ceph-mon[125440]: pgmap v7101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:39:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:23 smithi136 ceph-mon[125702]: pgmap v7101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:39:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:25 smithi057 ceph-mon[92072]: pgmap v7102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:39:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:25 smithi122 ceph-mon[125440]: pgmap v7102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:39:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:25 smithi136 ceph-mon[125702]: pgmap v7102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:39:27.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:27 smithi057 ceph-mon[92072]: pgmap v7103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:39:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:27 smithi122 ceph-mon[125440]: pgmap v7103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:39:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:27 smithi136 ceph-mon[125702]: pgmap v7103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T14:39:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:29.159+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:39:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:29.159+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:39:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:29.159+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:39:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:29.159+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:39:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:29.159+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:39:29.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:29 smithi057 ceph-mon[92072]: pgmap v7104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:39:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:29 smithi122 ceph-mon[125440]: pgmap v7104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:39:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:29 smithi136 ceph-mon[125702]: pgmap v7104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:39:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:31 smithi057 ceph-mon[92072]: pgmap v7105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:31.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:31 smithi122 ceph-mon[125440]: pgmap v7105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:31 smithi136 ceph-mon[125702]: pgmap v7105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:33 smithi057 ceph-mon[92072]: pgmap v7106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:33 smithi122 ceph-mon[125440]: pgmap v7106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:33 smithi136 ceph-mon[125702]: pgmap v7106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:35 smithi057 ceph-mon[92072]: pgmap v7107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:35 smithi122 ceph-mon[125440]: pgmap v7107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:35 smithi136 ceph-mon[125702]: pgmap v7107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:37 smithi122 ceph-mon[125440]: pgmap v7108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:37 smithi136 ceph-mon[125702]: pgmap v7108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:38.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:37 smithi057 ceph-mon[92072]: pgmap v7108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:39.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:39 smithi122 ceph-mon[125440]: pgmap v7109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:39 smithi136 ceph-mon[125702]: pgmap v7109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:40.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:39 smithi057 ceph-mon[92072]: pgmap v7109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:41 smithi122 ceph-mon[125440]: pgmap v7110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:41 smithi136 ceph-mon[125702]: pgmap v7110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:42.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:41 smithi057 ceph-mon[92072]: pgmap v7110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:43 smithi122 ceph-mon[125440]: pgmap v7111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:43 smithi136 ceph-mon[125702]: pgmap v7111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:44.162+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:39:44.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:44.163+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:39:44.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:44.163+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:39:44.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:44.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:39:44.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:44.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:39:44.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:43 smithi057 ceph-mon[92072]: pgmap v7111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:45 smithi122 ceph-mon[125440]: pgmap v7112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:45 smithi136 ceph-mon[125702]: pgmap v7112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:46.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:45 smithi057 ceph-mon[92072]: pgmap v7112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:47 smithi136 ceph-mon[125702]: pgmap v7113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:48.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:47 smithi057 ceph-mon[92072]: pgmap v7113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:47 smithi122 ceph-mon[125440]: pgmap v7113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:49 smithi136 ceph-mon[125702]: pgmap v7114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:50.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:49 smithi057 ceph-mon[92072]: pgmap v7114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:49 smithi122 ceph-mon[125440]: pgmap v7114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:51 smithi136 ceph-mon[125702]: pgmap v7115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:52.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:51 smithi057 ceph-mon[92072]: pgmap v7115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:51 smithi122 ceph-mon[125440]: pgmap v7115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:53 smithi136 ceph-mon[125702]: pgmap v7116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:54.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:53 smithi057 ceph-mon[92072]: pgmap v7116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:53 smithi122 ceph-mon[125440]: pgmap v7116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:39:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:55 smithi136 ceph-mon[125702]: pgmap v7117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:56.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:55 smithi057 ceph-mon[92072]: pgmap v7117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:55 smithi122 ceph-mon[125440]: pgmap v7117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:57 smithi136 ceph-mon[125702]: pgmap v7118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:58.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:57 smithi057 ceph-mon[92072]: pgmap v7118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:57 smithi122 ceph-mon[125440]: pgmap v7118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:39:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:59.175+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:39:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:59.175+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:39:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:59.175+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:39:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:59.175+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:39:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:39:59.175+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:40:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:39:59 smithi136 ceph-mon[125702]: pgmap v7119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:40:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:39:59 smithi057 ceph-mon[92072]: pgmap v7119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:40:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:39:59 smithi122 ceph-mon[125440]: pgmap v7119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:40:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T14:40:01.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T14:40:01.195 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T14:40:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:01 smithi122 ceph-mon[125440]: pgmap v7120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:40:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:40:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:40:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:40:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:01 smithi136 ceph-mon[125702]: pgmap v7120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:40:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:40:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:40:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:40:02.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:01 smithi057 ceph-mon[92072]: pgmap v7120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:40:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:40:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:40:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:40:03.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:03 smithi057 ceph-mon[92072]: pgmap v7121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:40:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:03 smithi122 ceph-mon[125440]: pgmap v7121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:40:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:03 smithi136 ceph-mon[125702]: pgmap v7121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:40:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:05 smithi057 ceph-mon[92072]: pgmap v7122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:40:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:05 smithi122 ceph-mon[125440]: pgmap v7122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:40:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:05 smithi136 ceph-mon[125702]: pgmap v7122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:40:07.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:07 smithi057 ceph-mon[92072]: pgmap v7123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:40:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:07 smithi122 ceph-mon[125440]: pgmap v7123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:40:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:07 smithi136 ceph-mon[125702]: pgmap v7123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:40:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:09 smithi057 ceph-mon[92072]: pgmap v7124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:40:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:09 smithi122 ceph-mon[125440]: pgmap v7124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:40:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:09 smithi136 ceph-mon[125702]: pgmap v7124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:40:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:11 smithi057 ceph-mon[92072]: pgmap v7125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:40:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:11 smithi057 ceph-mon[92072]: osdmap e517: 12 total, 12 up, 12 in 2023-03-02T14:40:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:11 smithi122 ceph-mon[125440]: pgmap v7125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:40:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:11 smithi122 ceph-mon[125440]: osdmap e517: 12 total, 12 up, 12 in 2023-03-02T14:40:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:11 smithi136 ceph-mon[125702]: pgmap v7125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:40:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:11 smithi136 ceph-mon[125702]: osdmap e517: 12 total, 12 up, 12 in 2023-03-02T14:40:13.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:13 smithi057 ceph-mon[92072]: pgmap v7127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:40:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:13 smithi122 ceph-mon[125440]: pgmap v7127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:40:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:13 smithi136 ceph-mon[125702]: pgmap v7127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:40:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:14.179+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:40:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:14.179+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:40:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:14.179+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:40:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:14.179+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:40:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:14.179+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:40:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:15 smithi122 ceph-mon[125440]: pgmap v7128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:40:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:15 smithi136 ceph-mon[125702]: pgmap v7128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:40:16.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:15 smithi057 ceph-mon[92072]: pgmap v7128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:40:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:17 smithi122 ceph-mon[125440]: pgmap v7129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:40:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:17 smithi122 ceph-mon[125440]: osdmap e518: 12 total, 12 up, 12 in 2023-03-02T14:40:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:17 smithi136 ceph-mon[125702]: pgmap v7129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:40:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:17 smithi136 ceph-mon[125702]: osdmap e518: 12 total, 12 up, 12 in 2023-03-02T14:40:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:17 smithi057 ceph-mon[92072]: pgmap v7129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:40:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:17 smithi057 ceph-mon[92072]: osdmap e518: 12 total, 12 up, 12 in 2023-03-02T14:40:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:19 smithi122 ceph-mon[125440]: pgmap v7131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:40:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:19 smithi136 ceph-mon[125702]: pgmap v7131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:40:20.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:19 smithi057 ceph-mon[92072]: pgmap v7131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:40:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:21 smithi122 ceph-mon[125440]: pgmap v7132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:40:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:21 smithi136 ceph-mon[125702]: pgmap v7132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:40:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:21 smithi057 ceph-mon[92072]: pgmap v7132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:40:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:23 smithi136 ceph-mon[125702]: pgmap v7133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:40:24.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:23 smithi057 ceph-mon[92072]: pgmap v7133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:40:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:23 smithi122 ceph-mon[125440]: pgmap v7133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:40:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:25 smithi136 ceph-mon[125702]: pgmap v7134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:40:26.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:25 smithi057 ceph-mon[92072]: pgmap v7134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:40:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:25 smithi122 ceph-mon[125440]: pgmap v7134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:40:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:27 smithi136 ceph-mon[125702]: pgmap v7135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:40:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:27 smithi057 ceph-mon[92072]: pgmap v7135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:40:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:27 smithi122 ceph-mon[125440]: pgmap v7135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:40:29.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:29.190+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:40:29.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:29.191+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:40:29.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:29.191+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:40:29.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:29.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:40:29.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:29.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:40:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:29 smithi136 ceph-mon[125702]: pgmap v7136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:40:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:29 smithi057 ceph-mon[92072]: pgmap v7136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:40:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:29 smithi122 ceph-mon[125440]: pgmap v7136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:40:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:31 smithi136 ceph-mon[125702]: pgmap v7137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:31 smithi057 ceph-mon[92072]: pgmap v7137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:32.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:31 smithi122 ceph-mon[125440]: pgmap v7137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:33 smithi136 ceph-mon[125702]: pgmap v7138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:40:34.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:33 smithi057 ceph-mon[92072]: pgmap v7138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:40:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:33 smithi122 ceph-mon[125440]: pgmap v7138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:40:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:35 smithi136 ceph-mon[125702]: pgmap v7139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:36.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:35 smithi057 ceph-mon[92072]: pgmap v7139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:35 smithi122 ceph-mon[125440]: pgmap v7139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:37 smithi136 ceph-mon[125702]: pgmap v7140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:37 smithi057 ceph-mon[92072]: pgmap v7140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:37 smithi122 ceph-mon[125440]: pgmap v7140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:38 smithi136 ceph-mon[125702]: pgmap v7141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:40:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:38 smithi057 ceph-mon[92072]: pgmap v7141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:40:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:38 smithi122 ceph-mon[125440]: pgmap v7141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:40:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:41 smithi136 ceph-mon[125702]: pgmap v7142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:40:41.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:41 smithi057 ceph-mon[92072]: pgmap v7142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:40:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:41 smithi122 ceph-mon[125440]: pgmap v7142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:40:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:43 smithi057 ceph-mon[92072]: pgmap v7143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:40:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:43 smithi122 ceph-mon[125440]: pgmap v7143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:40:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:43 smithi136 ceph-mon[125702]: pgmap v7143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:40:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:44.192+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:40:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:44.193+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:40:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:44.193+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:40:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:44.193+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:40:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:44.193+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:40:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:45 smithi057 ceph-mon[92072]: pgmap v7144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:40:45.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:45 smithi122 ceph-mon[125440]: pgmap v7144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:40:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:45 smithi136 ceph-mon[125702]: pgmap v7144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:40:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:47 smithi122 ceph-mon[125440]: pgmap v7145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:40:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:47 smithi136 ceph-mon[125702]: pgmap v7145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:40:48.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:47 smithi057 ceph-mon[92072]: pgmap v7145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:40:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:49 smithi122 ceph-mon[125440]: pgmap v7146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:40:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:49 smithi136 ceph-mon[125702]: pgmap v7146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:40:50.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:49 smithi057 ceph-mon[92072]: pgmap v7146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:40:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:51 smithi122 ceph-mon[125440]: pgmap v7147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:51 smithi136 ceph-mon[125702]: pgmap v7147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:52.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:51 smithi057 ceph-mon[92072]: pgmap v7147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:53 smithi122 ceph-mon[125440]: pgmap v7148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:40:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:53 smithi136 ceph-mon[125702]: pgmap v7148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:40:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:53 smithi057 ceph-mon[92072]: pgmap v7148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:40:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:55 smithi136 ceph-mon[125702]: pgmap v7149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:56.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:55 smithi057 ceph-mon[92072]: pgmap v7149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:55 smithi122 ceph-mon[125440]: pgmap v7149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:57 smithi136 ceph-mon[125702]: pgmap v7150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:58.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:57 smithi057 ceph-mon[92072]: pgmap v7150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:57 smithi122 ceph-mon[125440]: pgmap v7150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:40:59.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:59.199+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:40:59.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:59.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:40:59.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:59.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:40:59.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:59.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:40:59.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:40:59.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:41:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:40:59 smithi136 ceph-mon[125702]: pgmap v7151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:00.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:40:59 smithi057 ceph-mon[92072]: pgmap v7151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:40:59 smithi122 ceph-mon[125440]: pgmap v7151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:01 smithi136 ceph-mon[125702]: pgmap v7152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:01 smithi057 ceph-mon[92072]: pgmap v7152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:01 smithi122 ceph-mon[125440]: pgmap v7152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:41:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:41:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:41:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:41:03.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:41:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:41:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:41:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:41:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:41:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:41:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:41:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:41:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:03 smithi136 ceph-mon[125702]: pgmap v7153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:41:04.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:03 smithi057 ceph-mon[92072]: pgmap v7153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:41:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:03 smithi122 ceph-mon[125440]: pgmap v7153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:41:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:05 smithi136 ceph-mon[125702]: pgmap v7154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:41:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:05 smithi057 ceph-mon[92072]: pgmap v7154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:41:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:05 smithi122 ceph-mon[125440]: pgmap v7154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:41:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:06 smithi136 ceph-mon[125702]: osdmap e519: 12 total, 12 up, 12 in 2023-03-02T14:41:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:06 smithi057 ceph-mon[92072]: osdmap e519: 12 total, 12 up, 12 in 2023-03-02T14:41:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:06 smithi122 ceph-mon[125440]: osdmap e519: 12 total, 12 up, 12 in 2023-03-02T14:41:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:07 smithi136 ceph-mon[125702]: pgmap v7156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:41:08.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:07 smithi057 ceph-mon[92072]: pgmap v7156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:41:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:07 smithi122 ceph-mon[125440]: pgmap v7156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:41:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:09 smithi136 ceph-mon[125702]: pgmap v7157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:41:10.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:09 smithi057 ceph-mon[92072]: pgmap v7157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:41:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:09 smithi122 ceph-mon[125440]: pgmap v7157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:41:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:10.275+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:41:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:10.275+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:41:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:10.275+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 105 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:41:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:10.275+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 106 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:41:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:10 smithi136 ceph-mon[125702]: pgmap v7158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:41:11.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:10 smithi057 ceph-mon[92072]: pgmap v7158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:41:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:10 smithi122 ceph-mon[125440]: pgmap v7158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:41:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:13 smithi057 ceph-mon[92072]: pgmap v7159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:41:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:13 smithi057 ceph-mon[92072]: osdmap e520: 12 total, 12 up, 12 in 2023-03-02T14:41:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:13 smithi122 ceph-mon[125440]: pgmap v7159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:41:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:13 smithi122 ceph-mon[125440]: osdmap e520: 12 total, 12 up, 12 in 2023-03-02T14:41:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:13 smithi136 ceph-mon[125702]: pgmap v7159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:41:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:13 smithi136 ceph-mon[125702]: osdmap e520: 12 total, 12 up, 12 in 2023-03-02T14:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:14.212+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:41:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:14.212+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:41:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:14.212+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:41:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:14.212+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:41:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:14.212+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:41:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:15 smithi057 ceph-mon[92072]: pgmap v7161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T14:41:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:15 smithi122 ceph-mon[125440]: pgmap v7161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T14:41:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:15 smithi136 ceph-mon[125702]: pgmap v7161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T14:41:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:17 smithi122 ceph-mon[125440]: pgmap v7162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:41:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:17 smithi136 ceph-mon[125702]: pgmap v7162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:41:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:17 smithi057 ceph-mon[92072]: pgmap v7162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:41:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:19 smithi122 ceph-mon[125440]: pgmap v7163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:41:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:19 smithi136 ceph-mon[125702]: pgmap v7163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:41:20.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:19 smithi057 ceph-mon[92072]: pgmap v7163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:41:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:21 smithi136 ceph-mon[125702]: pgmap v7164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:41:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:21 smithi057 ceph-mon[92072]: pgmap v7164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:41:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:21 smithi122 ceph-mon[125440]: pgmap v7164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:41:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:23 smithi136 ceph-mon[125702]: pgmap v7165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:41:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:23 smithi057 ceph-mon[92072]: pgmap v7165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:41:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:23 smithi122 ceph-mon[125440]: pgmap v7165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:41:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:25 smithi136 ceph-mon[125702]: pgmap v7166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:26.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:25 smithi057 ceph-mon[92072]: pgmap v7166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:25 smithi122 ceph-mon[125440]: pgmap v7166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:27 smithi136 ceph-mon[125702]: pgmap v7167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:28.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:27 smithi057 ceph-mon[92072]: pgmap v7167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:27 smithi122 ceph-mon[125440]: pgmap v7167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:29.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:41:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:29.225+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:41:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:29.225+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:41:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:29.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:41:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:29.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:41:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:29 smithi136 ceph-mon[125702]: pgmap v7168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:29 smithi057 ceph-mon[92072]: pgmap v7168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:29 smithi122 ceph-mon[125440]: pgmap v7168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:31 smithi136 ceph-mon[125702]: pgmap v7169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:32.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:31 smithi057 ceph-mon[92072]: pgmap v7169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:31 smithi122 ceph-mon[125440]: pgmap v7169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:33 smithi136 ceph-mon[125702]: pgmap v7170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:33 smithi057 ceph-mon[92072]: pgmap v7170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:33 smithi122 ceph-mon[125440]: pgmap v7170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:35 smithi136 ceph-mon[125702]: pgmap v7171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:35 smithi057 ceph-mon[92072]: pgmap v7171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:35 smithi122 ceph-mon[125440]: pgmap v7171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:37 smithi136 ceph-mon[125702]: pgmap v7172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:38.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:37 smithi057 ceph-mon[92072]: pgmap v7172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:37 smithi122 ceph-mon[125440]: pgmap v7172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:39 smithi136 ceph-mon[125702]: pgmap v7173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:40.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:39 smithi057 ceph-mon[92072]: pgmap v7173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:39 smithi122 ceph-mon[125440]: pgmap v7173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:41 smithi136 ceph-mon[125702]: pgmap v7174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:42.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:41 smithi057 ceph-mon[92072]: pgmap v7174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:41 smithi122 ceph-mon[125440]: pgmap v7174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:43 smithi136 ceph-mon[125702]: pgmap v7175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:43 smithi057 ceph-mon[92072]: pgmap v7175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:43 smithi122 ceph-mon[125440]: pgmap v7175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:44.241+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:41:44.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:44.241+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:41:44.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:44.241+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:41:44.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:44.241+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:41:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:44.241+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:41:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:45 smithi136 ceph-mon[125702]: pgmap v7176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:46.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:45 smithi057 ceph-mon[92072]: pgmap v7176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:45 smithi122 ceph-mon[125440]: pgmap v7176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:47 smithi136 ceph-mon[125702]: pgmap v7177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:47 smithi057 ceph-mon[92072]: pgmap v7177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:47 smithi122 ceph-mon[125440]: pgmap v7177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:49 smithi136 ceph-mon[125702]: pgmap v7178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:49 smithi057 ceph-mon[92072]: pgmap v7178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:49 smithi122 ceph-mon[125440]: pgmap v7178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:50 smithi136 ceph-mon[125702]: pgmap v7179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:50 smithi057 ceph-mon[92072]: pgmap v7179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:51.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:50 smithi122 ceph-mon[125440]: pgmap v7179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:53 smithi122 ceph-mon[125440]: pgmap v7180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:53 smithi136 ceph-mon[125702]: pgmap v7180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:54.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:53 smithi057 ceph-mon[92072]: pgmap v7180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:41:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:55.282+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:41:55.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:55.282+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:41:55.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:55.283+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 106 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:41:55.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:55.283+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 107 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:41:55.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:55 smithi122 ceph-mon[125440]: pgmap v7181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:55 smithi136 ceph-mon[125702]: pgmap v7181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:55 smithi057 ceph-mon[92072]: pgmap v7181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:57 smithi122 ceph-mon[125440]: pgmap v7182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:57 smithi136 ceph-mon[125702]: pgmap v7182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:57 smithi057 ceph-mon[92072]: pgmap v7182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:41:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:59.252+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:41:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:59.252+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:41:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:59.252+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:41:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:59.252+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:41:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:41:59.252+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:41:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:41:59 smithi122 ceph-mon[125440]: pgmap v7183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:41:59 smithi136 ceph-mon[125702]: pgmap v7183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:00.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:41:59 smithi057 ceph-mon[92072]: pgmap v7183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:01 smithi136 ceph-mon[125702]: pgmap v7184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:01 smithi057 ceph-mon[92072]: pgmap v7184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:01 smithi122 ceph-mon[125440]: pgmap v7184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:42:03.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:42:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:42:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:03 smithi136 ceph-mon[125702]: pgmap v7185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:42:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:42:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:42:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:42:04.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:03 smithi057 ceph-mon[92072]: pgmap v7185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:42:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:42:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:42:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:42:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:03 smithi122 ceph-mon[125440]: pgmap v7185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:42:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:42:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:42:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:42:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:05 smithi136 ceph-mon[125702]: pgmap v7186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:42:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:05 smithi057 ceph-mon[92072]: pgmap v7186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:42:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:05 smithi122 ceph-mon[125440]: pgmap v7186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:42:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:06 smithi136 ceph-mon[125702]: osdmap e521: 12 total, 12 up, 12 in 2023-03-02T14:42:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:06 smithi057 ceph-mon[92072]: osdmap e521: 12 total, 12 up, 12 in 2023-03-02T14:42:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:06 smithi122 ceph-mon[125440]: osdmap e521: 12 total, 12 up, 12 in 2023-03-02T14:42:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:07 smithi136 ceph-mon[125702]: pgmap v7188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:42:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:07 smithi057 ceph-mon[92072]: pgmap v7188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:42:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:07 smithi122 ceph-mon[125440]: pgmap v7188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:42:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:09 smithi136 ceph-mon[125702]: pgmap v7189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:42:10.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:09 smithi057 ceph-mon[92072]: pgmap v7189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:42:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:09 smithi122 ceph-mon[125440]: pgmap v7189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:42:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:11 smithi136 ceph-mon[125702]: pgmap v7190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:42:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:11 smithi057 ceph-mon[92072]: pgmap v7190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:42:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:11 smithi122 ceph-mon[125440]: pgmap v7190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:42:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:13 smithi122 ceph-mon[125440]: pgmap v7191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:42:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:13 smithi122 ceph-mon[125440]: osdmap e522: 12 total, 12 up, 12 in 2023-03-02T14:42:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:13 smithi136 ceph-mon[125702]: pgmap v7191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:42:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:13 smithi136 ceph-mon[125702]: osdmap e522: 12 total, 12 up, 12 in 2023-03-02T14:42:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:13 smithi057 ceph-mon[92072]: pgmap v7191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:42:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:13 smithi057 ceph-mon[92072]: osdmap e522: 12 total, 12 up, 12 in 2023-03-02T14:42:14.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:14.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:42:14.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:14.262+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:42:14.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:14.262+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:42:14.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:14.262+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:42:14.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:14.262+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:42:15.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:15 smithi122 ceph-mon[125440]: pgmap v7193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T14:42:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:15 smithi136 ceph-mon[125702]: pgmap v7193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T14:42:16.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:15 smithi057 ceph-mon[92072]: pgmap v7193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T14:42:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:17 smithi136 ceph-mon[125702]: pgmap v7194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:42:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:17 smithi057 ceph-mon[92072]: pgmap v7194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:42:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:17 smithi122 ceph-mon[125440]: pgmap v7194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:42:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:19 smithi136 ceph-mon[125702]: pgmap v7195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:42:20.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:19 smithi057 ceph-mon[92072]: pgmap v7195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:42:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:19 smithi122 ceph-mon[125440]: pgmap v7195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:42:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:21 smithi136 ceph-mon[125702]: pgmap v7196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:42:22.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:21 smithi057 ceph-mon[92072]: pgmap v7196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:42:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:21 smithi122 ceph-mon[125440]: pgmap v7196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:42:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:23 smithi136 ceph-mon[125702]: pgmap v7197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:42:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:23 smithi057 ceph-mon[92072]: pgmap v7197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:42:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:23 smithi122 ceph-mon[125440]: pgmap v7197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:42:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:25 smithi136 ceph-mon[125702]: pgmap v7198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:25 smithi057 ceph-mon[92072]: pgmap v7198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:25 smithi122 ceph-mon[125440]: pgmap v7198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:27 smithi136 ceph-mon[125702]: pgmap v7199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:28.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:27 smithi057 ceph-mon[92072]: pgmap v7199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:27 smithi122 ceph-mon[125440]: pgmap v7199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:29.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:42:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:29.266+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:42:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:29.266+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:42:29.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:29.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:42:29.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:29.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:42:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:29 smithi136 ceph-mon[125702]: pgmap v7200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:29 smithi057 ceph-mon[92072]: pgmap v7200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:29 smithi122 ceph-mon[125440]: pgmap v7200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:31 smithi136 ceph-mon[125702]: pgmap v7201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:31 smithi057 ceph-mon[92072]: pgmap v7201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:31 smithi122 ceph-mon[125440]: pgmap v7201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:33 smithi136 ceph-mon[125702]: pgmap v7202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:33 smithi057 ceph-mon[92072]: pgmap v7202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:33 smithi122 ceph-mon[125440]: pgmap v7202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:35 smithi136 ceph-mon[125702]: pgmap v7203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:35 smithi057 ceph-mon[92072]: pgmap v7203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:35 smithi122 ceph-mon[125440]: pgmap v7203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:37 smithi136 ceph-mon[125702]: pgmap v7204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:37 smithi057 ceph-mon[92072]: pgmap v7204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:37 smithi122 ceph-mon[125440]: pgmap v7204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:39 smithi136 ceph-mon[125702]: pgmap v7205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:39 smithi057 ceph-mon[92072]: pgmap v7205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:39 smithi122 ceph-mon[125440]: pgmap v7205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:41 smithi136 ceph-mon[125702]: pgmap v7206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:41 smithi057 ceph-mon[92072]: pgmap v7206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:41 smithi122 ceph-mon[125440]: pgmap v7206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:43 smithi136 ceph-mon[125702]: pgmap v7207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:43 smithi057 ceph-mon[92072]: pgmap v7207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:43 smithi122 ceph-mon[125440]: pgmap v7207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:44.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:42:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:44.282+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:42:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:44.282+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:42:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:44.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:42:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:44.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:42:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:44 smithi136 ceph-mon[125702]: pgmap v7208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:44 smithi057 ceph-mon[92072]: pgmap v7208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:45.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:44 smithi122 ceph-mon[125440]: pgmap v7208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:47 smithi136 ceph-mon[125702]: pgmap v7209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:47.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:47 smithi057 ceph-mon[92072]: pgmap v7209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:47 smithi122 ceph-mon[125440]: pgmap v7209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:49 smithi136 ceph-mon[125702]: pgmap v7210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:50.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:49 smithi057 ceph-mon[92072]: pgmap v7210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:49 smithi122 ceph-mon[125440]: pgmap v7210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:51 smithi136 ceph-mon[125702]: pgmap v7211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:52.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:51 smithi057 ceph-mon[92072]: pgmap v7211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:51 smithi122 ceph-mon[125440]: pgmap v7211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:53 smithi136 ceph-mon[125702]: pgmap v7212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:54.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:53 smithi057 ceph-mon[92072]: pgmap v7212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:53 smithi122 ceph-mon[125440]: pgmap v7212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:42:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:55 smithi136 ceph-mon[125702]: pgmap v7213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:55 smithi057 ceph-mon[92072]: pgmap v7213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:55 smithi122 ceph-mon[125440]: pgmap v7213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:57 smithi136 ceph-mon[125702]: pgmap v7214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:57 smithi057 ceph-mon[92072]: pgmap v7214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:57 smithi122 ceph-mon[125440]: pgmap v7214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:42:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:59.284+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:42:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:59.284+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:42:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:59.284+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:42:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:59.284+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:42:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:42:59.284+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:43:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:42:59 smithi136 ceph-mon[125702]: pgmap v7215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:42:59 smithi057 ceph-mon[92072]: pgmap v7215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:42:59 smithi122 ceph-mon[125440]: pgmap v7215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:01 smithi136 ceph-mon[125702]: pgmap v7216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:01 smithi057 ceph-mon[92072]: pgmap v7216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:01 smithi122 ceph-mon[125440]: pgmap v7216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:03 smithi136 ceph-mon[125702]: pgmap v7217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:43:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:43:04.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:03 smithi057 ceph-mon[92072]: pgmap v7217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:43:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:43:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:03 smithi122 ceph-mon[125440]: pgmap v7217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:43:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:43:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:43:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:43:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:43:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:43:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:43:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:43:05.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:43:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:43:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:43:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:05 smithi136 ceph-mon[125702]: pgmap v7218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:43:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:05 smithi057 ceph-mon[92072]: pgmap v7218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:43:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:05 smithi122 ceph-mon[125440]: pgmap v7218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:43:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:07 smithi136 ceph-mon[125702]: pgmap v7219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:43:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:07 smithi057 ceph-mon[92072]: pgmap v7219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:43:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:07 smithi122 ceph-mon[125440]: pgmap v7219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:43:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:09 smithi136 ceph-mon[125702]: pgmap v7220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:43:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:09 smithi057 ceph-mon[92072]: pgmap v7220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:43:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:09 smithi122 ceph-mon[125440]: pgmap v7220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:43:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:11 smithi136 ceph-mon[125702]: pgmap v7221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:43:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:11 smithi136 ceph-mon[125702]: osdmap e523: 12 total, 12 up, 12 in 2023-03-02T14:43:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:11 smithi057 ceph-mon[92072]: pgmap v7221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:43:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:11 smithi057 ceph-mon[92072]: osdmap e523: 12 total, 12 up, 12 in 2023-03-02T14:43:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:11 smithi122 ceph-mon[125440]: pgmap v7221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:43:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:11 smithi122 ceph-mon[125440]: osdmap e523: 12 total, 12 up, 12 in 2023-03-02T14:43:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:13 smithi136 ceph-mon[125702]: pgmap v7223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:13 smithi057 ceph-mon[92072]: pgmap v7223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:13 smithi122 ceph-mon[125440]: pgmap v7223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:14.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:14.299+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:43:14.300 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:14.299+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:43:14.300 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:14.299+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:43:14.300 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:14.299+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:43:14.300 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:14.299+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:43:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:15 smithi136 ceph-mon[125702]: pgmap v7224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:15 smithi057 ceph-mon[92072]: pgmap v7224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:15 smithi122 ceph-mon[125440]: pgmap v7224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:16 smithi136 ceph-mon[125702]: pgmap v7225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:16 smithi057 ceph-mon[92072]: pgmap v7225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:16 smithi122 ceph-mon[125440]: pgmap v7225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:18 smithi136 ceph-mon[125702]: osdmap e524: 12 total, 12 up, 12 in 2023-03-02T14:43:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:18 smithi057 ceph-mon[92072]: osdmap e524: 12 total, 12 up, 12 in 2023-03-02T14:43:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:18 smithi122 ceph-mon[125440]: osdmap e524: 12 total, 12 up, 12 in 2023-03-02T14:43:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:19 smithi136 ceph-mon[125702]: pgmap v7227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:43:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:19 smithi057 ceph-mon[92072]: pgmap v7227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:43:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:19 smithi122 ceph-mon[125440]: pgmap v7227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T14:43:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:21 smithi136 ceph-mon[125702]: pgmap v7228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T14:43:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:21 smithi057 ceph-mon[92072]: pgmap v7228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T14:43:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:21 smithi122 ceph-mon[125440]: pgmap v7228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T14:43:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:23 smithi136 ceph-mon[125702]: pgmap v7229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:23 smithi057 ceph-mon[92072]: pgmap v7229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:23 smithi122 ceph-mon[125440]: pgmap v7229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:25 smithi136 ceph-mon[125702]: pgmap v7230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:25 smithi057 ceph-mon[92072]: pgmap v7230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:25 smithi122 ceph-mon[125440]: pgmap v7230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:27 smithi136 ceph-mon[125702]: pgmap v7231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:27 smithi057 ceph-mon[92072]: pgmap v7231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:27 smithi122 ceph-mon[125440]: pgmap v7231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:43:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:29.314+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:43:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:29.314+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:43:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:29.314+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:43:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:29.314+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:43:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:29.314+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:43:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:29 smithi136 ceph-mon[125702]: pgmap v7232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:43:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:29 smithi057 ceph-mon[92072]: pgmap v7232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:43:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:29 smithi122 ceph-mon[125440]: pgmap v7232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:43:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:31 smithi136 ceph-mon[125702]: pgmap v7233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:31 smithi057 ceph-mon[92072]: pgmap v7233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:31 smithi122 ceph-mon[125440]: pgmap v7233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:33 smithi136 ceph-mon[125702]: pgmap v7234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:33 smithi057 ceph-mon[92072]: pgmap v7234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:33 smithi122 ceph-mon[125440]: pgmap v7234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:35 smithi136 ceph-mon[125702]: pgmap v7235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:35 smithi057 ceph-mon[92072]: pgmap v7235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:35 smithi122 ceph-mon[125440]: pgmap v7235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:37 smithi136 ceph-mon[125702]: pgmap v7236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:37 smithi057 ceph-mon[92072]: pgmap v7236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:37 smithi122 ceph-mon[125440]: pgmap v7236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:39 smithi136 ceph-mon[125702]: pgmap v7237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:39 smithi057 ceph-mon[92072]: pgmap v7237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:39 smithi122 ceph-mon[125440]: pgmap v7237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:40 smithi136 ceph-mon[125702]: pgmap v7238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:40 smithi057 ceph-mon[92072]: pgmap v7238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:41.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:40 smithi122 ceph-mon[125440]: pgmap v7238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:43 smithi136 ceph-mon[125702]: pgmap v7239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:43 smithi057 ceph-mon[92072]: pgmap v7239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:43 smithi122 ceph-mon[125440]: pgmap v7239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:44.327+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:43:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:44.328+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:43:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:44.328+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:43:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:44.328+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:43:44.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:44.328+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:43:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:45 smithi136 ceph-mon[125702]: pgmap v7240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:45 smithi057 ceph-mon[92072]: pgmap v7240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:45 smithi122 ceph-mon[125440]: pgmap v7240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:47 smithi136 ceph-mon[125702]: pgmap v7241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:48.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:47 smithi057 ceph-mon[92072]: pgmap v7241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:47 smithi122 ceph-mon[125440]: pgmap v7241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:49 smithi136 ceph-mon[125702]: pgmap v7242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:49 smithi057 ceph-mon[92072]: pgmap v7242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:49 smithi122 ceph-mon[125440]: pgmap v7242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:51 smithi136 ceph-mon[125702]: pgmap v7243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:51 smithi057 ceph-mon[92072]: pgmap v7243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:51 smithi122 ceph-mon[125440]: pgmap v7243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:53 smithi136 ceph-mon[125702]: pgmap v7244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:53 smithi057 ceph-mon[92072]: pgmap v7244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:53 smithi122 ceph-mon[125440]: pgmap v7244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:43:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:55 smithi136 ceph-mon[125702]: pgmap v7245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:55 smithi057 ceph-mon[92072]: pgmap v7245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:55 smithi122 ceph-mon[125440]: pgmap v7245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:57 smithi136 ceph-mon[125702]: pgmap v7246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:57 smithi057 ceph-mon[92072]: pgmap v7246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:57 smithi122 ceph-mon[125440]: pgmap v7246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:43:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:59.343+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:43:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:59.344+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:43:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:59.344+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:43:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:59.344+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:43:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:43:59.344+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:44:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:43:59 smithi136 ceph-mon[125702]: pgmap v7247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:00.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:43:59 smithi057 ceph-mon[92072]: pgmap v7247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:43:59 smithi122 ceph-mon[125440]: pgmap v7247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:01 smithi136 ceph-mon[125702]: pgmap v7248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:01 smithi057 ceph-mon[92072]: pgmap v7248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:01 smithi122 ceph-mon[125440]: pgmap v7248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:03 smithi136 ceph-mon[125702]: pgmap v7249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:44:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:03 smithi057 ceph-mon[92072]: pgmap v7249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:44:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:03 smithi122 ceph-mon[125440]: pgmap v7249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:44:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:44:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:44:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:44:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:05 smithi136 ceph-mon[125702]: pgmap v7250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:44:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:05 smithi057 ceph-mon[92072]: pgmap v7250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:44:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:05 smithi122 ceph-mon[125440]: pgmap v7250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:44:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:06 smithi136 ceph-mon[125702]: pgmap v7251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:44:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:06 smithi057 ceph-mon[92072]: pgmap v7251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:44:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:06 smithi122 ceph-mon[125440]: pgmap v7251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:44:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:08.397+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d040 msgr2=0x7f586809d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T14:44:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:08.397+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d040 msgr2=0x7f586809d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T14:44:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:08.397+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d040 0x7f586809d410 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5870010560 tx=0x7f5870063000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:44:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:08.397+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d040 0x7f586809d410 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5870010560 tx=0x7f5870063000 comp rx=0 tx=0).stop 2023-03-02T14:44:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:08.397+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d040 msgr2=0x7f586809d410 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T14:44:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:08.397+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d040 msgr2=0x7f586809d410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T14:44:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:08.397+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d040 0x7f586809d410 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T14:44:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:08.397+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T14:44:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:08.397+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:44:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:08.397+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f58680329d0 tx=0x7f5870042000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T14:44:08.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:08.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 200.7M 2023-03-02T14:44:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 210494230: error parsing value: Value '210494230' is below minimum 939524096 2023-03-02T14:44:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:44:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:44:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: pgmap v7252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:44:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:44:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:44:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:44:09.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:44:09.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 200.7M 2023-03-02T14:44:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 210494230: error parsing value: Value '210494230' is below minimum 939524096 2023-03-02T14:44:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:44:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:44:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: pgmap v7252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:44:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:44:09.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:44:09.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:44:09.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:44:09.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 200.7M 2023-03-02T14:44:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 210494230: error parsing value: Value '210494230' is below minimum 939524096 2023-03-02T14:44:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:44:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:44:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: pgmap v7252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:44:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:44:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:44:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:44:09.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:44:09.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:44:09.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:44:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:10.302+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:44:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:10.302+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:44:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:10.302+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 107 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:44:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:10.302+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 108 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:44:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:11 smithi136 ceph-mon[125702]: osdmap e525: 12 total, 12 up, 12 in 2023-03-02T14:44:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:11 smithi136 ceph-mon[125702]: pgmap v7254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:44:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:11 smithi057 ceph-mon[92072]: osdmap e525: 12 total, 12 up, 12 in 2023-03-02T14:44:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:11 smithi057 ceph-mon[92072]: pgmap v7254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:44:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:11 smithi122 ceph-mon[125440]: osdmap e525: 12 total, 12 up, 12 in 2023-03-02T14:44:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:11 smithi122 ceph-mon[125440]: pgmap v7254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:44:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:13 smithi136 ceph-mon[125702]: pgmap v7255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:44:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:13 smithi136 ceph-mon[125702]: osdmap e526: 12 total, 12 up, 12 in 2023-03-02T14:44:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:13 smithi057 ceph-mon[92072]: pgmap v7255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:44:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:13 smithi057 ceph-mon[92072]: osdmap e526: 12 total, 12 up, 12 in 2023-03-02T14:44:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:13 smithi122 ceph-mon[125440]: pgmap v7255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:44:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:13 smithi122 ceph-mon[125440]: osdmap e526: 12 total, 12 up, 12 in 2023-03-02T14:44:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:14.359+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:44:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:14.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:44:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:14.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:44:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:14.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:44:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:14.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:44:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:15 smithi136 ceph-mon[125702]: pgmap v7257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:44:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:15 smithi057 ceph-mon[92072]: pgmap v7257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:44:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:15 smithi122 ceph-mon[125440]: pgmap v7257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:44:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:17 smithi136 ceph-mon[125702]: pgmap v7258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:44:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:17 smithi057 ceph-mon[92072]: pgmap v7258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:44:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:17 smithi122 ceph-mon[125440]: pgmap v7258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:44:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:19 smithi136 ceph-mon[125702]: pgmap v7259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:44:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:19 smithi057 ceph-mon[92072]: pgmap v7259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:44:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:19 smithi122 ceph-mon[125440]: pgmap v7259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:44:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:21 smithi136 ceph-mon[125702]: pgmap v7260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:44:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:21 smithi057 ceph-mon[92072]: pgmap v7260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:44:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:21 smithi122 ceph-mon[125440]: pgmap v7260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:44:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:23 smithi136 ceph-mon[125702]: pgmap v7261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:44:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:23 smithi057 ceph-mon[92072]: pgmap v7261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:44:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:23 smithi122 ceph-mon[125440]: pgmap v7261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:44:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:25 smithi136 ceph-mon[125702]: pgmap v7262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:44:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:25 smithi057 ceph-mon[92072]: pgmap v7262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:44:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:25 smithi122 ceph-mon[125440]: pgmap v7262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:44:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:27 smithi136 ceph-mon[125702]: pgmap v7263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T14:44:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:27 smithi057 ceph-mon[92072]: pgmap v7263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T14:44:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:27 smithi122 ceph-mon[125440]: pgmap v7263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T14:44:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:29.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:44:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:29.371+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:44:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:29.371+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:44:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:29.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:44:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:29.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:44:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:29 smithi136 ceph-mon[125702]: pgmap v7264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:44:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:29 smithi057 ceph-mon[92072]: pgmap v7264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:44:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:29 smithi122 ceph-mon[125440]: pgmap v7264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:44:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:31 smithi136 ceph-mon[125702]: pgmap v7265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:31 smithi057 ceph-mon[92072]: pgmap v7265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:31 smithi122 ceph-mon[125440]: pgmap v7265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:33 smithi136 ceph-mon[125702]: pgmap v7266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:33 smithi057 ceph-mon[92072]: pgmap v7266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:33 smithi122 ceph-mon[125440]: pgmap v7266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:35 smithi136 ceph-mon[125702]: pgmap v7267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:35 smithi057 ceph-mon[92072]: pgmap v7267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:35 smithi122 ceph-mon[125440]: pgmap v7267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:37 smithi136 ceph-mon[125702]: pgmap v7268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:37 smithi057 ceph-mon[92072]: pgmap v7268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:37 smithi122 ceph-mon[125440]: pgmap v7268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:39 smithi136 ceph-mon[125702]: pgmap v7269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:39 smithi057 ceph-mon[92072]: pgmap v7269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:39 smithi122 ceph-mon[125440]: pgmap v7269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:41 smithi136 ceph-mon[125702]: pgmap v7270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:41 smithi057 ceph-mon[92072]: pgmap v7270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:41 smithi122 ceph-mon[125440]: pgmap v7270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:43 smithi136 ceph-mon[125702]: pgmap v7271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:43 smithi057 ceph-mon[92072]: pgmap v7271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:43 smithi122 ceph-mon[125440]: pgmap v7271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:44.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:44.387+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:44:44.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:44.387+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:44:44.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:44.387+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:44:44.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:44.387+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:44:44.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:44.387+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:44:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:45 smithi136 ceph-mon[125702]: pgmap v7272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:45 smithi057 ceph-mon[92072]: pgmap v7272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:45 smithi122 ceph-mon[125440]: pgmap v7272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:47 smithi136 ceph-mon[125702]: pgmap v7273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:47 smithi057 ceph-mon[92072]: pgmap v7273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:47 smithi122 ceph-mon[125440]: pgmap v7273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:49 smithi136 ceph-mon[125702]: pgmap v7274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:49 smithi057 ceph-mon[92072]: pgmap v7274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:49 smithi122 ceph-mon[125440]: pgmap v7274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:51 smithi136 ceph-mon[125702]: pgmap v7275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:51 smithi057 ceph-mon[92072]: pgmap v7275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:51 smithi122 ceph-mon[125440]: pgmap v7275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:53 smithi136 ceph-mon[125702]: pgmap v7276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:53 smithi057 ceph-mon[92072]: pgmap v7276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:53 smithi122 ceph-mon[125440]: pgmap v7276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:44:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:55 smithi136 ceph-mon[125702]: pgmap v7277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:55 smithi057 ceph-mon[92072]: pgmap v7277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:55 smithi122 ceph-mon[125440]: pgmap v7277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:57 smithi136 ceph-mon[125702]: pgmap v7278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:57 smithi057 ceph-mon[92072]: pgmap v7278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:57 smithi122 ceph-mon[125440]: pgmap v7278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:44:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:59.390+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:44:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:59.391+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:44:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:59.391+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:44:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:59.391+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:44:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:44:59.391+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:45:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:44:59 smithi136 ceph-mon[125702]: pgmap v7279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:44:59 smithi057 ceph-mon[92072]: pgmap v7279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:44:59 smithi122 ceph-mon[125440]: pgmap v7279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:01 smithi136 ceph-mon[125702]: pgmap v7280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:01 smithi057 ceph-mon[92072]: pgmap v7280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:01 smithi122 ceph-mon[125440]: pgmap v7280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:03 smithi136 ceph-mon[125702]: pgmap v7281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:45:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:03 smithi057 ceph-mon[92072]: pgmap v7281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:45:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:03 smithi122 ceph-mon[125440]: pgmap v7281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:45:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:05 smithi136 ceph-mon[125702]: pgmap v7282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:45:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:05 smithi057 ceph-mon[92072]: pgmap v7282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:45:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:05 smithi122 ceph-mon[125440]: pgmap v7282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:45:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:06 smithi136 ceph-mon[125702]: pgmap v7283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:45:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:06 smithi057 ceph-mon[92072]: pgmap v7283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:45:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:06 smithi122 ceph-mon[125440]: pgmap v7283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:45:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:09 smithi136 ceph-mon[125702]: pgmap v7284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:45:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:45:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:45:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:45:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:45:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:09 smithi057 ceph-mon[92072]: pgmap v7284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:45:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:45:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:45:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:45:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:45:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:09 smithi122 ceph-mon[125440]: pgmap v7284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:45:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:45:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:45:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:45:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:45:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:11 smithi136 ceph-mon[125702]: pgmap v7285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:45:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:11 smithi136 ceph-mon[125702]: osdmap e527: 12 total, 12 up, 12 in 2023-03-02T14:45:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:11 smithi057 ceph-mon[92072]: pgmap v7285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:45:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:11 smithi057 ceph-mon[92072]: osdmap e527: 12 total, 12 up, 12 in 2023-03-02T14:45:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:11 smithi122 ceph-mon[125440]: pgmap v7285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:45:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:11 smithi122 ceph-mon[125440]: osdmap e527: 12 total, 12 up, 12 in 2023-03-02T14:45:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:13 smithi136 ceph-mon[125702]: pgmap v7287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:45:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:13 smithi057 ceph-mon[92072]: pgmap v7287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:45:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:13 smithi122 ceph-mon[125440]: pgmap v7287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:45:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:14.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:45:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:14.405+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:45:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:14.405+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:45:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:14.405+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:45:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:14.405+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:45:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:15 smithi136 ceph-mon[125702]: pgmap v7288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:45:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:15 smithi057 ceph-mon[92072]: pgmap v7288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:45:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:15 smithi122 ceph-mon[125440]: pgmap v7288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:45:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:17 smithi136 ceph-mon[125702]: pgmap v7289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:45:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:17 smithi136 ceph-mon[125702]: osdmap e528: 12 total, 12 up, 12 in 2023-03-02T14:45:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:17 smithi057 ceph-mon[92072]: pgmap v7289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:45:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:17 smithi057 ceph-mon[92072]: osdmap e528: 12 total, 12 up, 12 in 2023-03-02T14:45:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:17 smithi122 ceph-mon[125440]: pgmap v7289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:45:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:17 smithi122 ceph-mon[125440]: osdmap e528: 12 total, 12 up, 12 in 2023-03-02T14:45:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:19 smithi136 ceph-mon[125702]: pgmap v7291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:45:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:19 smithi057 ceph-mon[92072]: pgmap v7291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:45:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:19 smithi122 ceph-mon[125440]: pgmap v7291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:45:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:21 smithi136 ceph-mon[125702]: pgmap v7292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:45:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:21 smithi057 ceph-mon[92072]: pgmap v7292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:45:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:21 smithi122 ceph-mon[125440]: pgmap v7292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:45:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:23 smithi136 ceph-mon[125702]: pgmap v7293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:45:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:23 smithi057 ceph-mon[92072]: pgmap v7293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:45:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:23 smithi122 ceph-mon[125440]: pgmap v7293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:45:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:25 smithi136 ceph-mon[125702]: pgmap v7294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:45:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:25 smithi057 ceph-mon[92072]: pgmap v7294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:45:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:25 smithi122 ceph-mon[125440]: pgmap v7294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:45:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:27 smithi136 ceph-mon[125702]: pgmap v7295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:45:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:27 smithi057 ceph-mon[92072]: pgmap v7295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:45:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:27 smithi122 ceph-mon[125440]: pgmap v7295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:45:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:29.405+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:45:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:29.406+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:45:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:29.406+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:45:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:29.406+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:45:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:29.406+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:45:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:29 smithi136 ceph-mon[125702]: pgmap v7296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:45:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:29 smithi057 ceph-mon[92072]: pgmap v7296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:45:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:29 smithi122 ceph-mon[125440]: pgmap v7296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:45:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:30 smithi136 ceph-mon[125702]: pgmap v7297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:30 smithi057 ceph-mon[92072]: pgmap v7297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:31.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:30 smithi122 ceph-mon[125440]: pgmap v7297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:33 smithi136 ceph-mon[125702]: pgmap v7298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:33 smithi057 ceph-mon[92072]: pgmap v7298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:33 smithi122 ceph-mon[125440]: pgmap v7298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:35 smithi136 ceph-mon[125702]: pgmap v7299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:35 smithi057 ceph-mon[92072]: pgmap v7299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:35 smithi122 ceph-mon[125440]: pgmap v7299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:37 smithi136 ceph-mon[125702]: pgmap v7300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:37 smithi057 ceph-mon[92072]: pgmap v7300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:37 smithi122 ceph-mon[125440]: pgmap v7300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:39 smithi136 ceph-mon[125702]: pgmap v7301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:39 smithi057 ceph-mon[92072]: pgmap v7301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:39 smithi122 ceph-mon[125440]: pgmap v7301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:41 smithi136 ceph-mon[125702]: pgmap v7302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:41 smithi057 ceph-mon[92072]: pgmap v7302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:41 smithi122 ceph-mon[125440]: pgmap v7302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:43 smithi136 ceph-mon[125702]: pgmap v7303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:43 smithi057 ceph-mon[92072]: pgmap v7303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:43 smithi122 ceph-mon[125440]: pgmap v7303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:44.422+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:45:44.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:44.422+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:45:44.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:44.422+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:45:44.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:44.422+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:45:44.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:44.422+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:45:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:45 smithi136 ceph-mon[125702]: pgmap v7304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:45 smithi057 ceph-mon[92072]: pgmap v7304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:45 smithi122 ceph-mon[125440]: pgmap v7304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:47 smithi136 ceph-mon[125702]: pgmap v7305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:47 smithi057 ceph-mon[92072]: pgmap v7305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:47 smithi122 ceph-mon[125440]: pgmap v7305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:49 smithi136 ceph-mon[125702]: pgmap v7306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:49 smithi057 ceph-mon[92072]: pgmap v7306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:49 smithi122 ceph-mon[125440]: pgmap v7306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:51 smithi136 ceph-mon[125702]: pgmap v7307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:51 smithi057 ceph-mon[92072]: pgmap v7307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:51 smithi122 ceph-mon[125440]: pgmap v7307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:53 smithi136 ceph-mon[125702]: pgmap v7308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:53 smithi057 ceph-mon[92072]: pgmap v7308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:53 smithi122 ceph-mon[125440]: pgmap v7308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:45:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:55 smithi136 ceph-mon[125702]: pgmap v7309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:55 smithi057 ceph-mon[92072]: pgmap v7309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:55 smithi122 ceph-mon[125440]: pgmap v7309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:57 smithi136 ceph-mon[125702]: pgmap v7310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:57 smithi057 ceph-mon[92072]: pgmap v7310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:57 smithi122 ceph-mon[125440]: pgmap v7310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:45:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:59.427+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:45:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:59.427+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:45:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:59.427+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:45:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:59.427+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:45:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:45:59.427+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:46:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:45:59 smithi136 ceph-mon[125702]: pgmap v7311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:45:59 smithi057 ceph-mon[92072]: pgmap v7311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:45:59 smithi122 ceph-mon[125440]: pgmap v7311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:00 smithi136 ceph-mon[125702]: pgmap v7312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:00 smithi057 ceph-mon[92072]: pgmap v7312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:00 smithi122 ceph-mon[125440]: pgmap v7312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:03 smithi136 ceph-mon[125702]: pgmap v7313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:46:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:03 smithi057 ceph-mon[92072]: pgmap v7313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:46:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:03 smithi122 ceph-mon[125440]: pgmap v7313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:46:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:05 smithi136 ceph-mon[125702]: pgmap v7314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:46:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:05 smithi057 ceph-mon[92072]: pgmap v7314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:46:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:05 smithi122 ceph-mon[125440]: pgmap v7314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:46:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:07 smithi136 ceph-mon[125702]: pgmap v7315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:46:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:07 smithi057 ceph-mon[92072]: pgmap v7315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:46:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:07 smithi122 ceph-mon[125440]: pgmap v7315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:46:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:09 smithi136 ceph-mon[125702]: pgmap v7316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:46:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:46:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:09 smithi057 ceph-mon[92072]: pgmap v7316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:46:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:46:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:09 smithi122 ceph-mon[125440]: pgmap v7316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:46:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:46:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:46:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:46:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:11 smithi136 ceph-mon[125702]: pgmap v7317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:46:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:46:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:46:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:46:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:46:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:46:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:11 smithi057 ceph-mon[92072]: pgmap v7317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:46:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:46:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:46:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:46:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:46:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:46:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:11 smithi122 ceph-mon[125440]: pgmap v7317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:46:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:46:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:46:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:46:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:12 smithi136 ceph-mon[125702]: osdmap e529: 12 total, 12 up, 12 in 2023-03-02T14:46:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:12 smithi057 ceph-mon[92072]: osdmap e529: 12 total, 12 up, 12 in 2023-03-02T14:46:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:12 smithi122 ceph-mon[125440]: osdmap e529: 12 total, 12 up, 12 in 2023-03-02T14:46:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:13 smithi136 ceph-mon[125702]: pgmap v7319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:13 smithi057 ceph-mon[92072]: pgmap v7319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:13 smithi122 ceph-mon[125440]: pgmap v7319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:14.433+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:46:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:14.434+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:46:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:14.434+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:46:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:14.434+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:46:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:14.434+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:46:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:15 smithi136 ceph-mon[125702]: pgmap v7320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:15 smithi057 ceph-mon[92072]: pgmap v7320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:15 smithi122 ceph-mon[125440]: pgmap v7320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:17 smithi136 ceph-mon[125702]: pgmap v7321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:17 smithi057 ceph-mon[92072]: pgmap v7321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:17 smithi122 ceph-mon[125440]: pgmap v7321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:19 smithi136 ceph-mon[125702]: pgmap v7322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:19 smithi057 ceph-mon[92072]: pgmap v7322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:19 smithi122 ceph-mon[125440]: pgmap v7322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:21 smithi136 ceph-mon[125702]: pgmap v7323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:21 smithi057 ceph-mon[92072]: pgmap v7323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:21 smithi122 ceph-mon[125440]: pgmap v7323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:46:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:23 smithi136 ceph-mon[125702]: pgmap v7324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 182 B/s wr, 13 op/s 2023-03-02T14:46:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:23 smithi136 ceph-mon[125702]: osdmap e530: 12 total, 12 up, 12 in 2023-03-02T14:46:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:23 smithi057 ceph-mon[92072]: pgmap v7324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 182 B/s wr, 13 op/s 2023-03-02T14:46:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:23 smithi057 ceph-mon[92072]: osdmap e530: 12 total, 12 up, 12 in 2023-03-02T14:46:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:23 smithi122 ceph-mon[125440]: pgmap v7324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 182 B/s wr, 13 op/s 2023-03-02T14:46:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:23 smithi122 ceph-mon[125440]: osdmap e530: 12 total, 12 up, 12 in 2023-03-02T14:46:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:25 smithi136 ceph-mon[125702]: pgmap v7326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:46:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:25 smithi057 ceph-mon[92072]: pgmap v7326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:46:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:25 smithi122 ceph-mon[125440]: pgmap v7326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:46:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:27 smithi136 ceph-mon[125702]: pgmap v7327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:46:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:27 smithi057 ceph-mon[92072]: pgmap v7327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:46:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:27 smithi122 ceph-mon[125440]: pgmap v7327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:46:29.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:29.449+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:46:29.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:29.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:46:29.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:29.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:46:29.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:29.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:46:29.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:29.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:46:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:29 smithi136 ceph-mon[125702]: pgmap v7328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:46:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:29 smithi057 ceph-mon[92072]: pgmap v7328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:46:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:29 smithi122 ceph-mon[125440]: pgmap v7328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:46:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:31 smithi136 ceph-mon[125702]: pgmap v7329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:46:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:31 smithi057 ceph-mon[92072]: pgmap v7329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:46:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:31 smithi122 ceph-mon[125440]: pgmap v7329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:46:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:33 smithi136 ceph-mon[125702]: pgmap v7330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:46:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:33 smithi057 ceph-mon[92072]: pgmap v7330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:46:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:33 smithi122 ceph-mon[125440]: pgmap v7330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:46:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:35 smithi136 ceph-mon[125702]: pgmap v7331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:35 smithi057 ceph-mon[92072]: pgmap v7331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:35 smithi122 ceph-mon[125440]: pgmap v7331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:37 smithi136 ceph-mon[125702]: pgmap v7332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:37 smithi057 ceph-mon[92072]: pgmap v7332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:37 smithi122 ceph-mon[125440]: pgmap v7332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:39 smithi136 ceph-mon[125702]: pgmap v7333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:39 smithi057 ceph-mon[92072]: pgmap v7333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:39 smithi122 ceph-mon[125440]: pgmap v7333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:41 smithi136 ceph-mon[125702]: pgmap v7334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:41 smithi057 ceph-mon[92072]: pgmap v7334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:41 smithi122 ceph-mon[125440]: pgmap v7334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:43 smithi136 ceph-mon[125702]: pgmap v7335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:43 smithi057 ceph-mon[92072]: pgmap v7335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:43 smithi122 ceph-mon[125440]: pgmap v7335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:44.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:46:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:44.465+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:46:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:44.465+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:46:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:44.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:46:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:44.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:46:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:44 smithi136 ceph-mon[125702]: pgmap v7336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:44 smithi057 ceph-mon[92072]: pgmap v7336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:44 smithi122 ceph-mon[125440]: pgmap v7336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:47 smithi057 ceph-mon[92072]: pgmap v7337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:47 smithi122 ceph-mon[125440]: pgmap v7337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:47 smithi136 ceph-mon[125702]: pgmap v7337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:49 smithi136 ceph-mon[125702]: pgmap v7338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:49 smithi057 ceph-mon[92072]: pgmap v7338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:49 smithi122 ceph-mon[125440]: pgmap v7338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:51 smithi136 ceph-mon[125702]: pgmap v7339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:51 smithi057 ceph-mon[92072]: pgmap v7339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:51 smithi122 ceph-mon[125440]: pgmap v7339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:53 smithi136 ceph-mon[125702]: pgmap v7340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:53 smithi057 ceph-mon[92072]: pgmap v7340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:53 smithi122 ceph-mon[125440]: pgmap v7340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:46:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:55 smithi136 ceph-mon[125702]: pgmap v7341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:55 smithi057 ceph-mon[92072]: pgmap v7341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:55 smithi122 ceph-mon[125440]: pgmap v7341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:57 smithi136 ceph-mon[125702]: pgmap v7342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:58.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:57 smithi057 ceph-mon[92072]: pgmap v7342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:57 smithi122 ceph-mon[125440]: pgmap v7342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:46:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:59.477+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:46:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:59.477+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:46:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:59.477+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:46:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:59.477+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:46:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:46:59.477+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:47:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:46:59 smithi136 ceph-mon[125702]: pgmap v7343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:46:59 smithi057 ceph-mon[92072]: pgmap v7343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:46:59 smithi122 ceph-mon[125440]: pgmap v7343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:00 smithi136 ceph-mon[125702]: pgmap v7344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:00 smithi057 ceph-mon[92072]: pgmap v7344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:00 smithi122 ceph-mon[125440]: pgmap v7344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:03 smithi136 ceph-mon[125702]: pgmap v7345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:47:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:03 smithi057 ceph-mon[92072]: pgmap v7345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:47:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:03 smithi122 ceph-mon[125440]: pgmap v7345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:47:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:05 smithi136 ceph-mon[125702]: pgmap v7346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:47:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:05 smithi057 ceph-mon[92072]: pgmap v7346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:47:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:05 smithi122 ceph-mon[125440]: pgmap v7346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:47:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:07 smithi136 ceph-mon[125702]: pgmap v7347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:47:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:07 smithi057 ceph-mon[92072]: pgmap v7347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:47:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:07 smithi122 ceph-mon[125440]: pgmap v7347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:47:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:09 smithi136 ceph-mon[125702]: pgmap v7348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:47:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:09 smithi057 ceph-mon[92072]: pgmap v7348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:47:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:09 smithi122 ceph-mon[125440]: pgmap v7348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:47:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:10.328+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:47:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:10.328+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:47:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:10.329+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 109 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:47:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:10.329+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 108 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:47:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:11 smithi136 ceph-mon[125702]: pgmap v7349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:47:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:11 smithi136 ceph-mon[125702]: osdmap e531: 12 total, 12 up, 12 in 2023-03-02T14:47:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:47:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:11 smithi057 ceph-mon[92072]: pgmap v7349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:47:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:11 smithi057 ceph-mon[92072]: osdmap e531: 12 total, 12 up, 12 in 2023-03-02T14:47:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:47:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:11 smithi122 ceph-mon[125440]: pgmap v7349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:47:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:11 smithi122 ceph-mon[125440]: osdmap e531: 12 total, 12 up, 12 in 2023-03-02T14:47:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:47:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:47:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:47:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:47:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:47:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:47:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:47:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:47:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:13 smithi136 ceph-mon[125702]: pgmap v7351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:47:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:13 smithi057 ceph-mon[92072]: pgmap v7351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:47:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:13 smithi122 ceph-mon[125440]: pgmap v7351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:47:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:14.487+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:47:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:14.488+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:47:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:14.488+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:47:14.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:14.488+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:47:14.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:14.488+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:47:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:14 smithi136 ceph-mon[125702]: pgmap v7352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:47:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:14 smithi057 ceph-mon[92072]: pgmap v7352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:47:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:14 smithi122 ceph-mon[125440]: pgmap v7352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:47:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:17 smithi057 ceph-mon[92072]: pgmap v7353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:47:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:17 smithi122 ceph-mon[125440]: pgmap v7353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:47:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:17 smithi136 ceph-mon[125702]: pgmap v7353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:47:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:18 smithi136 ceph-mon[125702]: osdmap e532: 12 total, 12 up, 12 in 2023-03-02T14:47:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:18 smithi057 ceph-mon[92072]: osdmap e532: 12 total, 12 up, 12 in 2023-03-02T14:47:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:18 smithi122 ceph-mon[125440]: osdmap e532: 12 total, 12 up, 12 in 2023-03-02T14:47:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:19 smithi136 ceph-mon[125702]: pgmap v7355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:47:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:19 smithi057 ceph-mon[92072]: pgmap v7355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:47:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:19 smithi122 ceph-mon[125440]: pgmap v7355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:47:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:21 smithi136 ceph-mon[125702]: pgmap v7356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:47:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:21 smithi057 ceph-mon[92072]: pgmap v7356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:47:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:21 smithi122 ceph-mon[125440]: pgmap v7356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:47:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:23 smithi136 ceph-mon[125702]: pgmap v7357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:47:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:23 smithi057 ceph-mon[92072]: pgmap v7357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:47:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:23 smithi122 ceph-mon[125440]: pgmap v7357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:47:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:25 smithi136 ceph-mon[125702]: pgmap v7358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:47:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:25 smithi057 ceph-mon[92072]: pgmap v7358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:47:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:25 smithi122 ceph-mon[125440]: pgmap v7358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:47:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:27 smithi136 ceph-mon[125702]: pgmap v7359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:47:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:27 smithi057 ceph-mon[92072]: pgmap v7359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:47:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:27 smithi122 ceph-mon[125440]: pgmap v7359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:47:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:28 smithi136 ceph-mon[125702]: pgmap v7360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:47:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:28 smithi057 ceph-mon[92072]: pgmap v7360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:47:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:28 smithi122 ceph-mon[125440]: pgmap v7360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:47:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:29.492+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:47:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:29.492+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:47:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:29.492+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:47:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:29.492+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:47:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:29.492+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:47:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:31 smithi057 ceph-mon[92072]: pgmap v7361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:31 smithi122 ceph-mon[125440]: pgmap v7361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:31 smithi136 ceph-mon[125702]: pgmap v7361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:33 smithi136 ceph-mon[125702]: pgmap v7362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:33 smithi057 ceph-mon[92072]: pgmap v7362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:33 smithi122 ceph-mon[125440]: pgmap v7362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:35 smithi136 ceph-mon[125702]: pgmap v7363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:35 smithi057 ceph-mon[92072]: pgmap v7363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:35 smithi122 ceph-mon[125440]: pgmap v7363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:37 smithi136 ceph-mon[125702]: pgmap v7364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:37 smithi057 ceph-mon[92072]: pgmap v7364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:37 smithi122 ceph-mon[125440]: pgmap v7364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:39 smithi136 ceph-mon[125702]: pgmap v7365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:39 smithi057 ceph-mon[92072]: pgmap v7365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:39 smithi122 ceph-mon[125440]: pgmap v7365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:41 smithi136 ceph-mon[125702]: pgmap v7366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:41 smithi057 ceph-mon[92072]: pgmap v7366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:41 smithi122 ceph-mon[125440]: pgmap v7366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:43 smithi136 ceph-mon[125702]: pgmap v7367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:43 smithi057 ceph-mon[92072]: pgmap v7367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:43 smithi122 ceph-mon[125440]: pgmap v7367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:44.501+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:47:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:44.501+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:47:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:44.501+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:47:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:44.501+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:47:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:44.501+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:47:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:45 smithi136 ceph-mon[125702]: pgmap v7368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:45 smithi057 ceph-mon[92072]: pgmap v7368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:45 smithi122 ceph-mon[125440]: pgmap v7368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:47 smithi136 ceph-mon[125702]: pgmap v7369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:47 smithi057 ceph-mon[92072]: pgmap v7369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:47 smithi122 ceph-mon[125440]: pgmap v7369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:49 smithi136 ceph-mon[125702]: pgmap v7370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:49 smithi057 ceph-mon[92072]: pgmap v7370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:49 smithi122 ceph-mon[125440]: pgmap v7370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:51 smithi136 ceph-mon[125702]: pgmap v7371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:51 smithi057 ceph-mon[92072]: pgmap v7371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:51 smithi122 ceph-mon[125440]: pgmap v7371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:53 smithi136 ceph-mon[125702]: pgmap v7372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:53 smithi057 ceph-mon[92072]: pgmap v7372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:53 smithi122 ceph-mon[125440]: pgmap v7372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:47:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:55 smithi136 ceph-mon[125702]: pgmap v7373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:55 smithi057 ceph-mon[92072]: pgmap v7373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:55 smithi122 ceph-mon[125440]: pgmap v7373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:57 smithi136 ceph-mon[125702]: pgmap v7374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:57 smithi057 ceph-mon[92072]: pgmap v7374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:57 smithi122 ceph-mon[125440]: pgmap v7374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:47:59.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:59.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:47:59.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:59.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:47:59.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:59.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:47:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:59.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:47:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:47:59.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:48:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:47:59 smithi136 ceph-mon[125702]: pgmap v7375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:47:59 smithi057 ceph-mon[92072]: pgmap v7375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:47:59 smithi122 ceph-mon[125440]: pgmap v7375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:01 smithi136 ceph-mon[125702]: pgmap v7376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:01 smithi057 ceph-mon[92072]: pgmap v7376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:01 smithi122 ceph-mon[125440]: pgmap v7376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:03 smithi136 ceph-mon[125702]: pgmap v7377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:48:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:03 smithi057 ceph-mon[92072]: pgmap v7377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:48:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:03 smithi122 ceph-mon[125440]: pgmap v7377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:48:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:05 smithi136 ceph-mon[125702]: pgmap v7378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:48:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:05 smithi057 ceph-mon[92072]: pgmap v7378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:48:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:05 smithi122 ceph-mon[125440]: pgmap v7378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:48:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:06 smithi136 ceph-mon[125702]: pgmap v7379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:48:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:06 smithi057 ceph-mon[92072]: pgmap v7379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:48:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:06 smithi122 ceph-mon[125440]: pgmap v7379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:48:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:09 smithi136 ceph-mon[125702]: pgmap v7380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:48:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:09 smithi057 ceph-mon[92072]: pgmap v7380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:48:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:09 smithi122 ceph-mon[125440]: pgmap v7380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:48:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:11 smithi136 ceph-mon[125702]: pgmap v7381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:48:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:11 smithi136 ceph-mon[125702]: osdmap e533: 12 total, 12 up, 12 in 2023-03-02T14:48:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:11 smithi057 ceph-mon[92072]: pgmap v7381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:48:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:11 smithi057 ceph-mon[92072]: osdmap e533: 12 total, 12 up, 12 in 2023-03-02T14:48:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:11 smithi122 ceph-mon[125440]: pgmap v7381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:48:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:11 smithi122 ceph-mon[125440]: osdmap e533: 12 total, 12 up, 12 in 2023-03-02T14:48:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:48:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:48:13.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:48:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:13 smithi136 ceph-mon[125702]: pgmap v7383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:48:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:48:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:48:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:48:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:13 smithi057 ceph-mon[92072]: pgmap v7383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:48:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:48:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:48:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:48:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:13 smithi122 ceph-mon[125440]: pgmap v7383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:48:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:48:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:48:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:48:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:14.519+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:48:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:14.520+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:48:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:14.520+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:48:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:14.520+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:48:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:14.520+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:48:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:14 smithi057 ceph-mon[92072]: pgmap v7384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:48:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:14 smithi122 ceph-mon[125440]: pgmap v7384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:48:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:14 smithi136 ceph-mon[125702]: pgmap v7384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:48:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:17 smithi057 ceph-mon[92072]: pgmap v7385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:48:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:17 smithi122 ceph-mon[125440]: pgmap v7385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:48:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:17 smithi136 ceph-mon[125702]: pgmap v7385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:48:19.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:18 smithi136 ceph-mon[125702]: osdmap e534: 12 total, 12 up, 12 in 2023-03-02T14:48:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:18 smithi057 ceph-mon[92072]: osdmap e534: 12 total, 12 up, 12 in 2023-03-02T14:48:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:18 smithi122 ceph-mon[125440]: osdmap e534: 12 total, 12 up, 12 in 2023-03-02T14:48:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:19 smithi136 ceph-mon[125702]: pgmap v7387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:48:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:19 smithi057 ceph-mon[92072]: pgmap v7387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:48:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:19 smithi122 ceph-mon[125440]: pgmap v7387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:48:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:21 smithi136 ceph-mon[125702]: pgmap v7388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:48:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:21 smithi057 ceph-mon[92072]: pgmap v7388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:48:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:21 smithi122 ceph-mon[125440]: pgmap v7388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:48:24.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:23 smithi136 ceph-mon[125702]: pgmap v7389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:48:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:23 smithi057 ceph-mon[92072]: pgmap v7389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:48:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:23 smithi122 ceph-mon[125440]: pgmap v7389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:48:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:25 smithi136 ceph-mon[125702]: pgmap v7390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:48:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:25 smithi057 ceph-mon[92072]: pgmap v7390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:48:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:25 smithi122 ceph-mon[125440]: pgmap v7390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:48:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:27 smithi136 ceph-mon[125702]: pgmap v7391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:48:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:27 smithi057 ceph-mon[92072]: pgmap v7391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:48:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:27 smithi122 ceph-mon[125440]: pgmap v7391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:48:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:29.535+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:48:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:29.535+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:48:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:29.535+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:48:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:29.535+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:48:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:29.535+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:48:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:29 smithi136 ceph-mon[125702]: pgmap v7392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T14:48:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:29 smithi057 ceph-mon[92072]: pgmap v7392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T14:48:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:29 smithi122 ceph-mon[125440]: pgmap v7392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T14:48:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:31 smithi136 ceph-mon[125702]: pgmap v7393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:48:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:31 smithi057 ceph-mon[92072]: pgmap v7393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:48:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:31 smithi122 ceph-mon[125440]: pgmap v7393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:48:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:33 smithi136 ceph-mon[125702]: pgmap v7394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:33 smithi057 ceph-mon[92072]: pgmap v7394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:33 smithi122 ceph-mon[125440]: pgmap v7394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:34 smithi057 ceph-mon[92072]: pgmap v7395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:48:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:34 smithi122 ceph-mon[125440]: pgmap v7395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:48:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:34 smithi136 ceph-mon[125702]: pgmap v7395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:48:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:37 smithi057 ceph-mon[92072]: pgmap v7396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:48:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:37 smithi122 ceph-mon[125440]: pgmap v7396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:48:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:37 smithi136 ceph-mon[125702]: pgmap v7396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:48:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:39 smithi136 ceph-mon[125702]: pgmap v7397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:39 smithi057 ceph-mon[92072]: pgmap v7397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:39 smithi122 ceph-mon[125440]: pgmap v7397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:41 smithi136 ceph-mon[125702]: pgmap v7398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:41 smithi057 ceph-mon[92072]: pgmap v7398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:41 smithi122 ceph-mon[125440]: pgmap v7398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:43 smithi136 ceph-mon[125702]: pgmap v7399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:43 smithi057 ceph-mon[92072]: pgmap v7399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:43 smithi122 ceph-mon[125440]: pgmap v7399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:44.550+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:48:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:44.550+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:48:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:44.550+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:48:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:44.550+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:48:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:44.550+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:48:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:45 smithi136 ceph-mon[125702]: pgmap v7400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:45 smithi057 ceph-mon[92072]: pgmap v7400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:45 smithi122 ceph-mon[125440]: pgmap v7400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:47 smithi136 ceph-mon[125702]: pgmap v7401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:47 smithi057 ceph-mon[92072]: pgmap v7401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:47 smithi122 ceph-mon[125440]: pgmap v7401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:49 smithi136 ceph-mon[125702]: pgmap v7402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:49 smithi057 ceph-mon[92072]: pgmap v7402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:49 smithi122 ceph-mon[125440]: pgmap v7402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:50 smithi136 ceph-mon[125702]: pgmap v7403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:50 smithi057 ceph-mon[92072]: pgmap v7403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:50 smithi122 ceph-mon[125440]: pgmap v7403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:53 smithi136 ceph-mon[125702]: pgmap v7404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:53 smithi057 ceph-mon[92072]: pgmap v7404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:53 smithi122 ceph-mon[125440]: pgmap v7404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:48:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:55 smithi136 ceph-mon[125702]: pgmap v7405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:55 smithi057 ceph-mon[92072]: pgmap v7405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:55 smithi122 ceph-mon[125440]: pgmap v7405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:57 smithi136 ceph-mon[125702]: pgmap v7406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:57 smithi057 ceph-mon[92072]: pgmap v7406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:57 smithi122 ceph-mon[125440]: pgmap v7406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:48:59.566 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:59.565+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:48:59.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:59.565+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:48:59.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:59.565+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:48:59.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:59.565+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:48:59.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:48:59.565+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:49:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:48:59 smithi136 ceph-mon[125702]: pgmap v7407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:48:59 smithi057 ceph-mon[92072]: pgmap v7407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:48:59 smithi122 ceph-mon[125440]: pgmap v7407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:01 smithi136 ceph-mon[125702]: pgmap v7408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:01 smithi057 ceph-mon[92072]: pgmap v7408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:01 smithi122 ceph-mon[125440]: pgmap v7408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:03 smithi136 ceph-mon[125702]: pgmap v7409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:49:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:03 smithi057 ceph-mon[92072]: pgmap v7409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:49:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:03 smithi122 ceph-mon[125440]: pgmap v7409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:49:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:04 smithi057 ceph-mon[92072]: pgmap v7410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:49:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:04 smithi122 ceph-mon[125440]: pgmap v7410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:49:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:04 smithi136 ceph-mon[125702]: pgmap v7410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:49:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:07 smithi057 ceph-mon[92072]: pgmap v7411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:49:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:07 smithi122 ceph-mon[125440]: pgmap v7411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:49:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:07 smithi136 ceph-mon[125702]: pgmap v7411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:49:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:09 smithi136 ceph-mon[125702]: pgmap v7412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:49:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:09 smithi057 ceph-mon[92072]: pgmap v7412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:49:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:09 smithi122 ceph-mon[125440]: pgmap v7412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:49:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:11 smithi136 ceph-mon[125702]: pgmap v7413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:49:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:11 smithi136 ceph-mon[125702]: osdmap e535: 12 total, 12 up, 12 in 2023-03-02T14:49:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:11 smithi057 ceph-mon[92072]: pgmap v7413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:49:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:11 smithi057 ceph-mon[92072]: osdmap e535: 12 total, 12 up, 12 in 2023-03-02T14:49:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:11 smithi122 ceph-mon[125440]: pgmap v7413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:49:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:11 smithi122 ceph-mon[125440]: osdmap e535: 12 total, 12 up, 12 in 2023-03-02T14:49:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:13 smithi136 ceph-mon[125702]: pgmap v7415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:49:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:49:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:13 smithi057 ceph-mon[92072]: pgmap v7415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:49:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:49:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:13 smithi122 ceph-mon[125440]: pgmap v7415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:49:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:49:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:14.578+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:49:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:14.579+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:49:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:14.579+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:49:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:14.579+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:49:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:14.579+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:49:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:49:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:49:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:49:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:49:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:49:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:49:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:49:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:49:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:49:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:15 smithi136 ceph-mon[125702]: pgmap v7416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:49:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:15 smithi057 ceph-mon[92072]: pgmap v7416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:49:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:15 smithi122 ceph-mon[125440]: pgmap v7416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:49:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:17 smithi136 ceph-mon[125702]: pgmap v7417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:49:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:17 smithi136 ceph-mon[125702]: osdmap e536: 12 total, 12 up, 12 in 2023-03-02T14:49:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:17 smithi057 ceph-mon[92072]: pgmap v7417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:49:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:17 smithi057 ceph-mon[92072]: osdmap e536: 12 total, 12 up, 12 in 2023-03-02T14:49:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:17 smithi122 ceph-mon[125440]: pgmap v7417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:49:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:17 smithi122 ceph-mon[125440]: osdmap e536: 12 total, 12 up, 12 in 2023-03-02T14:49:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:18 smithi057 ceph-mon[92072]: pgmap v7419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:49:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:18 smithi122 ceph-mon[125440]: pgmap v7419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:49:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:18 smithi136 ceph-mon[125702]: pgmap v7419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:49:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:21 smithi057 ceph-mon[92072]: pgmap v7420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:49:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:21 smithi122 ceph-mon[125440]: pgmap v7420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:49:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:21 smithi136 ceph-mon[125702]: pgmap v7420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:49:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:23 smithi136 ceph-mon[125702]: pgmap v7421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:49:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:23 smithi057 ceph-mon[92072]: pgmap v7421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:49:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:23 smithi122 ceph-mon[125440]: pgmap v7421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:49:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:25 smithi136 ceph-mon[125702]: pgmap v7422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:49:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:25 smithi057 ceph-mon[92072]: pgmap v7422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:49:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:25 smithi122 ceph-mon[125440]: pgmap v7422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:49:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:27 smithi136 ceph-mon[125702]: pgmap v7423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:49:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:27 smithi057 ceph-mon[92072]: pgmap v7423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:49:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:27 smithi122 ceph-mon[125440]: pgmap v7423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:49:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:29.594+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:49:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:29.595+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:49:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:29.595+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:49:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:29.595+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:49:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:29.595+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:49:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:29 smithi057 ceph-mon[92072]: pgmap v7424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:49:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:29 smithi122 ceph-mon[125440]: pgmap v7424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:49:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:29 smithi136 ceph-mon[125702]: pgmap v7424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:49:31.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:30 smithi057 ceph-mon[92072]: pgmap v7425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:30 smithi122 ceph-mon[125440]: pgmap v7425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:30 smithi136 ceph-mon[125702]: pgmap v7425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:33 smithi136 ceph-mon[125702]: pgmap v7426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:33 smithi057 ceph-mon[92072]: pgmap v7426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:33 smithi122 ceph-mon[125440]: pgmap v7426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:35 smithi136 ceph-mon[125702]: pgmap v7427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:35 smithi057 ceph-mon[92072]: pgmap v7427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:35 smithi122 ceph-mon[125440]: pgmap v7427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:37 smithi136 ceph-mon[125702]: pgmap v7428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:37 smithi057 ceph-mon[92072]: pgmap v7428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:37 smithi122 ceph-mon[125440]: pgmap v7428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:39 smithi136 ceph-mon[125702]: pgmap v7429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:39 smithi057 ceph-mon[92072]: pgmap v7429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:39 smithi122 ceph-mon[125440]: pgmap v7429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:41 smithi057 ceph-mon[92072]: pgmap v7430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:41 smithi122 ceph-mon[125440]: pgmap v7430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:41 smithi136 ceph-mon[125702]: pgmap v7430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:43 smithi136 ceph-mon[125702]: pgmap v7431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:43 smithi057 ceph-mon[92072]: pgmap v7431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:43 smithi122 ceph-mon[125440]: pgmap v7431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:44.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:49:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:44.610+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:49:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:44.610+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:49:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:44.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:49:44.612 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:44.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:49:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:45 smithi136 ceph-mon[125702]: pgmap v7432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:45 smithi057 ceph-mon[92072]: pgmap v7432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:45 smithi122 ceph-mon[125440]: pgmap v7432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:47 smithi136 ceph-mon[125702]: pgmap v7433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:47 smithi057 ceph-mon[92072]: pgmap v7433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:47 smithi122 ceph-mon[125440]: pgmap v7433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:49 smithi136 ceph-mon[125702]: pgmap v7434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:49 smithi057 ceph-mon[92072]: pgmap v7434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:49 smithi122 ceph-mon[125440]: pgmap v7434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:51 smithi057 ceph-mon[92072]: pgmap v7435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:51 smithi122 ceph-mon[125440]: pgmap v7435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:51 smithi136 ceph-mon[125702]: pgmap v7435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:53 smithi136 ceph-mon[125702]: pgmap v7436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:53 smithi057 ceph-mon[92072]: pgmap v7436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:53 smithi122 ceph-mon[125440]: pgmap v7436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:49:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:55 smithi136 ceph-mon[125702]: pgmap v7437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:55 smithi057 ceph-mon[92072]: pgmap v7437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:55 smithi122 ceph-mon[125440]: pgmap v7437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:57 smithi136 ceph-mon[125702]: pgmap v7438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:57 smithi057 ceph-mon[92072]: pgmap v7438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:57 smithi122 ceph-mon[125440]: pgmap v7438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:49:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:59.625+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:49:59.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:59.625+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:49:59.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:59.625+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:49:59.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:59.625+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:49:59.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:49:59.625+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:50:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:49:59 smithi136 ceph-mon[125702]: pgmap v7439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:49:59 smithi057 ceph-mon[92072]: pgmap v7439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:49:59 smithi122 ceph-mon[125440]: pgmap v7439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T14:50:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T14:50:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T14:50:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:01 smithi057 ceph-mon[92072]: pgmap v7440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:01 smithi122 ceph-mon[125440]: pgmap v7440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:01 smithi136 ceph-mon[125702]: pgmap v7440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:03 smithi057 ceph-mon[92072]: pgmap v7441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:50:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:03 smithi122 ceph-mon[125440]: pgmap v7441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:50:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:03 smithi136 ceph-mon[125702]: pgmap v7441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:50:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:04 smithi057 ceph-mon[92072]: pgmap v7442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:50:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:04 smithi122 ceph-mon[125440]: pgmap v7442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:50:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:04 smithi136 ceph-mon[125702]: pgmap v7442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:50:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:07 smithi057 ceph-mon[92072]: pgmap v7443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:50:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:07 smithi122 ceph-mon[125440]: pgmap v7443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:50:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:07 smithi136 ceph-mon[125702]: pgmap v7443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:50:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:09 smithi136 ceph-mon[125702]: pgmap v7444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:50:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:09 smithi057 ceph-mon[92072]: pgmap v7444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:50:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:09 smithi122 ceph-mon[125440]: pgmap v7444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:50:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:10.355+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:50:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:10.355+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:50:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:10.355+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 110 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T14:50:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:10.356+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 109 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T14:50:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:10.356+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:50:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:10.356+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:50:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:10.356+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 111 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:50:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:10.356+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 110 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:50:12.097 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:11 smithi057 ceph-mon[92072]: pgmap v7445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:50:12.097 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:11 smithi057 ceph-mon[92072]: osdmap e537: 12 total, 12 up, 12 in 2023-03-02T14:50:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:11 smithi122 ceph-mon[125440]: pgmap v7445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:50:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:11 smithi122 ceph-mon[125440]: osdmap e537: 12 total, 12 up, 12 in 2023-03-02T14:50:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:11 smithi136 ceph-mon[125702]: pgmap v7445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:50:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:11 smithi136 ceph-mon[125702]: osdmap e537: 12 total, 12 up, 12 in 2023-03-02T14:50:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:13 smithi136 ceph-mon[125702]: pgmap v7447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:50:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:13 smithi057 ceph-mon[92072]: pgmap v7447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:50:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:13 smithi122 ceph-mon[125440]: pgmap v7447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:50:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:14.641+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:50:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:14.642+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:50:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:14.642+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:50:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:14.642+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:50:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:14.642+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:50:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:50:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:50:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:50:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:15 smithi136 ceph-mon[125702]: pgmap v7448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:50:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:50:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:50:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:50:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:15 smithi057 ceph-mon[92072]: pgmap v7448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:50:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:50:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:50:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:50:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:15 smithi122 ceph-mon[125440]: pgmap v7448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:50:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:50:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:50:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:50:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:17 smithi057 ceph-mon[92072]: pgmap v7449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:50:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:17 smithi057 ceph-mon[92072]: osdmap e538: 12 total, 12 up, 12 in 2023-03-02T14:50:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:17 smithi122 ceph-mon[125440]: pgmap v7449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:50:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:17 smithi122 ceph-mon[125440]: osdmap e538: 12 total, 12 up, 12 in 2023-03-02T14:50:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:17 smithi136 ceph-mon[125702]: pgmap v7449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:50:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:17 smithi136 ceph-mon[125702]: osdmap e538: 12 total, 12 up, 12 in 2023-03-02T14:50:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:18 smithi057 ceph-mon[92072]: pgmap v7451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:50:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:18 smithi122 ceph-mon[125440]: pgmap v7451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:50:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:18 smithi136 ceph-mon[125702]: pgmap v7451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:50:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:21 smithi057 ceph-mon[92072]: pgmap v7452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:50:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:21 smithi122 ceph-mon[125440]: pgmap v7452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:50:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:21 smithi136 ceph-mon[125702]: pgmap v7452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T14:50:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:23 smithi057 ceph-mon[92072]: pgmap v7453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:50:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:23 smithi122 ceph-mon[125440]: pgmap v7453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:50:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:23 smithi136 ceph-mon[125702]: pgmap v7453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:50:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:25 smithi057 ceph-mon[92072]: pgmap v7454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:50:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:25 smithi122 ceph-mon[125440]: pgmap v7454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:50:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:25 smithi136 ceph-mon[125702]: pgmap v7454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:50:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:26 smithi057 ceph-mon[92072]: pgmap v7455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:50:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:26 smithi122 ceph-mon[125440]: pgmap v7455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:50:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:26 smithi136 ceph-mon[125702]: pgmap v7455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:50:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:28 smithi057 ceph-mon[92072]: pgmap v7456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:50:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:28 smithi122 ceph-mon[125440]: pgmap v7456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:50:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:28 smithi136 ceph-mon[125702]: pgmap v7456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T14:50:29.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:29.649+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:50:29.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:29.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:50:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:29.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:50:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:29.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:50:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:29.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:50:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:31 smithi057 ceph-mon[92072]: pgmap v7457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:31 smithi122 ceph-mon[125440]: pgmap v7457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:31 smithi136 ceph-mon[125702]: pgmap v7457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:33 smithi057 ceph-mon[92072]: pgmap v7458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:33 smithi122 ceph-mon[125440]: pgmap v7458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:33 smithi136 ceph-mon[125702]: pgmap v7458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:35 smithi057 ceph-mon[92072]: pgmap v7459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:35 smithi122 ceph-mon[125440]: pgmap v7459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:35 smithi136 ceph-mon[125702]: pgmap v7459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:36 smithi057 ceph-mon[92072]: pgmap v7460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:36 smithi122 ceph-mon[125440]: pgmap v7460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:36 smithi136 ceph-mon[125702]: pgmap v7460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:39 smithi057 ceph-mon[92072]: pgmap v7461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:39 smithi122 ceph-mon[125440]: pgmap v7461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:39 smithi136 ceph-mon[125702]: pgmap v7461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:41 smithi057 ceph-mon[92072]: pgmap v7462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:41 smithi122 ceph-mon[125440]: pgmap v7462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:41 smithi136 ceph-mon[125702]: pgmap v7462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:43 smithi057 ceph-mon[92072]: pgmap v7463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:43 smithi122 ceph-mon[125440]: pgmap v7463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:43 smithi136 ceph-mon[125702]: pgmap v7463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:44.660+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:50:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:44.661+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:50:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:44.661+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:50:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:44.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:50:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:44.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:50:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:45 smithi057 ceph-mon[92072]: pgmap v7464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:45 smithi122 ceph-mon[125440]: pgmap v7464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:45 smithi136 ceph-mon[125702]: pgmap v7464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:46 smithi057 ceph-mon[92072]: pgmap v7465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:46 smithi122 ceph-mon[125440]: pgmap v7465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:46 smithi136 ceph-mon[125702]: pgmap v7465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:49 smithi057 ceph-mon[92072]: pgmap v7466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:49 smithi122 ceph-mon[125440]: pgmap v7466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:49 smithi136 ceph-mon[125702]: pgmap v7466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:50 smithi057 ceph-mon[92072]: pgmap v7467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:50 smithi122 ceph-mon[125440]: pgmap v7467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:50 smithi136 ceph-mon[125702]: pgmap v7467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:53 smithi057 ceph-mon[92072]: pgmap v7468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:53 smithi122 ceph-mon[125440]: pgmap v7468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:53 smithi136 ceph-mon[125702]: pgmap v7468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:50:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:55 smithi057 ceph-mon[92072]: pgmap v7469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:55 smithi122 ceph-mon[125440]: pgmap v7469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:55 smithi136 ceph-mon[125702]: pgmap v7469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:56 smithi057 ceph-mon[92072]: pgmap v7470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:56 smithi122 ceph-mon[125440]: pgmap v7470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:56 smithi136 ceph-mon[125702]: pgmap v7470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:59.669+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:59.669+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:59.669+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:59.669+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:50:59.669+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:51:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:50:59 smithi057 ceph-mon[92072]: pgmap v7471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:50:59 smithi122 ceph-mon[125440]: pgmap v7471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:50:59 smithi136 ceph-mon[125702]: pgmap v7471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:00 smithi057 ceph-mon[92072]: pgmap v7472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:51:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:00 smithi122 ceph-mon[125440]: pgmap v7472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:51:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:00 smithi136 ceph-mon[125702]: pgmap v7472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:51:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:03 smithi057 ceph-mon[92072]: pgmap v7473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:51:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:03 smithi122 ceph-mon[125440]: pgmap v7473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:51:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:03 smithi136 ceph-mon[125702]: pgmap v7473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:51:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:04 smithi057 ceph-mon[92072]: pgmap v7474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:51:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:04 smithi122 ceph-mon[125440]: pgmap v7474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:51:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:04 smithi136 ceph-mon[125702]: pgmap v7474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:51:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:06 smithi057 ceph-mon[92072]: osdmap e539: 12 total, 12 up, 12 in 2023-03-02T14:51:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:06 smithi057 ceph-mon[92072]: pgmap v7476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:51:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:06 smithi122 ceph-mon[125440]: osdmap e539: 12 total, 12 up, 12 in 2023-03-02T14:51:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:06 smithi122 ceph-mon[125440]: pgmap v7476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:51:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:06 smithi136 ceph-mon[125702]: osdmap e539: 12 total, 12 up, 12 in 2023-03-02T14:51:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:06 smithi136 ceph-mon[125702]: pgmap v7476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:51:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:08 smithi057 ceph-mon[92072]: pgmap v7477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:51:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:08 smithi122 ceph-mon[125440]: pgmap v7477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:51:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:08 smithi136 ceph-mon[125702]: pgmap v7477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:51:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:11 smithi122 ceph-mon[125440]: pgmap v7478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:51:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:11 smithi136 ceph-mon[125702]: pgmap v7478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:51:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:11 smithi057 ceph-mon[92072]: pgmap v7478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:51:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:13 smithi057 ceph-mon[92072]: pgmap v7479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:51:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:13 smithi057 ceph-mon[92072]: osdmap e540: 12 total, 12 up, 12 in 2023-03-02T14:51:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:13 smithi122 ceph-mon[125440]: pgmap v7479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:51:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:13 smithi122 ceph-mon[125440]: osdmap e540: 12 total, 12 up, 12 in 2023-03-02T14:51:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:13 smithi136 ceph-mon[125702]: pgmap v7479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:51:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:13 smithi136 ceph-mon[125702]: osdmap e540: 12 total, 12 up, 12 in 2023-03-02T14:51:14.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:14.679+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:51:14.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:14.679+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:51:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:14.679+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:51:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:14.679+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:51:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:14.679+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:51:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:14 smithi057 ceph-mon[92072]: pgmap v7481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T14:51:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:14 smithi122 ceph-mon[125440]: pgmap v7481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T14:51:15.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:14 smithi136 ceph-mon[125702]: pgmap v7481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T14:51:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:51:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:51:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:51:17.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:51:17.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:51:17.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:51:17.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:16 smithi057 ceph-mon[92072]: pgmap v7482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:51:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:51:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:51:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:51:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:16 smithi122 ceph-mon[125440]: pgmap v7482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:51:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:51:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:51:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:51:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:16 smithi136 ceph-mon[125702]: pgmap v7482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:51:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:18 smithi057 ceph-mon[92072]: pgmap v7483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:51:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:18 smithi122 ceph-mon[125440]: pgmap v7483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:51:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:18 smithi136 ceph-mon[125702]: pgmap v7483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:51:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:21 smithi122 ceph-mon[125440]: pgmap v7484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:51:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:21 smithi136 ceph-mon[125702]: pgmap v7484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:51:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:21 smithi057 ceph-mon[92072]: pgmap v7484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:51:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:23 smithi057 ceph-mon[92072]: pgmap v7485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:51:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:23 smithi122 ceph-mon[125440]: pgmap v7485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:51:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:23 smithi136 ceph-mon[125702]: pgmap v7485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T14:51:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:24 smithi057 ceph-mon[92072]: pgmap v7486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:24 smithi122 ceph-mon[125440]: pgmap v7486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:24 smithi136 ceph-mon[125702]: pgmap v7486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:27 smithi122 ceph-mon[125440]: pgmap v7487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:27 smithi136 ceph-mon[125702]: pgmap v7487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:27 smithi057 ceph-mon[92072]: pgmap v7487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:28 smithi057 ceph-mon[92072]: pgmap v7488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:28 smithi122 ceph-mon[125440]: pgmap v7488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:28 smithi136 ceph-mon[125702]: pgmap v7488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:29.692+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:51:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:29.693+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:51:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:29.693+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:51:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:29.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:51:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:29.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:51:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:31 smithi122 ceph-mon[125440]: pgmap v7489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:31 smithi136 ceph-mon[125702]: pgmap v7489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:31 smithi057 ceph-mon[92072]: pgmap v7489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:33 smithi136 ceph-mon[125702]: pgmap v7490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:33 smithi057 ceph-mon[92072]: pgmap v7490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:33 smithi122 ceph-mon[125440]: pgmap v7490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:35 smithi136 ceph-mon[125702]: pgmap v7491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:35 smithi057 ceph-mon[92072]: pgmap v7491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:35 smithi122 ceph-mon[125440]: pgmap v7491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:37 smithi136 ceph-mon[125702]: pgmap v7492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:37 smithi057 ceph-mon[92072]: pgmap v7492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:37 smithi122 ceph-mon[125440]: pgmap v7492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:38 smithi057 ceph-mon[92072]: pgmap v7493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:38 smithi122 ceph-mon[125440]: pgmap v7493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:38 smithi136 ceph-mon[125702]: pgmap v7493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:41 smithi122 ceph-mon[125440]: pgmap v7494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:41 smithi136 ceph-mon[125702]: pgmap v7494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:41 smithi057 ceph-mon[92072]: pgmap v7494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:43 smithi136 ceph-mon[125702]: pgmap v7495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:43 smithi057 ceph-mon[92072]: pgmap v7495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:43 smithi122 ceph-mon[125440]: pgmap v7495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:44.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:51:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:44.701+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:51:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:44.701+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:51:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:44.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:51:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:44.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:51:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:45 smithi136 ceph-mon[125702]: pgmap v7496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:45 smithi057 ceph-mon[92072]: pgmap v7496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:45 smithi122 ceph-mon[125440]: pgmap v7496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:47 smithi136 ceph-mon[125702]: pgmap v7497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:47 smithi057 ceph-mon[92072]: pgmap v7497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:47 smithi122 ceph-mon[125440]: pgmap v7497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:48 smithi057 ceph-mon[92072]: pgmap v7498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:48 smithi122 ceph-mon[125440]: pgmap v7498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:48 smithi136 ceph-mon[125702]: pgmap v7498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:51 smithi136 ceph-mon[125702]: pgmap v7499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:51 smithi057 ceph-mon[92072]: pgmap v7499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:51 smithi122 ceph-mon[125440]: pgmap v7499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:53 smithi136 ceph-mon[125702]: pgmap v7500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:53 smithi057 ceph-mon[92072]: pgmap v7500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:53 smithi122 ceph-mon[125440]: pgmap v7500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:55 smithi136 ceph-mon[125702]: pgmap v7501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:55 smithi057 ceph-mon[92072]: pgmap v7501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:55 smithi122 ceph-mon[125440]: pgmap v7501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:57 smithi136 ceph-mon[125702]: pgmap v7502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:57 smithi057 ceph-mon[92072]: pgmap v7502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:57 smithi122 ceph-mon[125440]: pgmap v7502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:51:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:51:58 smithi057 ceph-mon[92072]: pgmap v7503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:51:58 smithi122 ceph-mon[125440]: pgmap v7503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:51:58 smithi136 ceph-mon[125702]: pgmap v7503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:51:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:59.705+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:59.705+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:59.705+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:59.705+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:51:59.705+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:52:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:01 smithi136 ceph-mon[125702]: pgmap v7504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:01 smithi057 ceph-mon[92072]: pgmap v7504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:01 smithi122 ceph-mon[125440]: pgmap v7504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:03 smithi136 ceph-mon[125702]: pgmap v7505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:52:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:03 smithi057 ceph-mon[92072]: pgmap v7505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:52:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:03 smithi122 ceph-mon[125440]: pgmap v7505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:52:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:05 smithi136 ceph-mon[125702]: pgmap v7506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:52:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:05 smithi057 ceph-mon[92072]: pgmap v7506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:52:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:05 smithi122 ceph-mon[125440]: pgmap v7506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:52:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:07 smithi136 ceph-mon[125702]: pgmap v7507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:52:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:07 smithi057 ceph-mon[92072]: pgmap v7507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:52:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:07 smithi122 ceph-mon[125440]: pgmap v7507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:52:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:08 smithi057 ceph-mon[92072]: pgmap v7508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:52:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:08 smithi122 ceph-mon[125440]: pgmap v7508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:52:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:08 smithi136 ceph-mon[125702]: pgmap v7508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:52:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:11 smithi057 ceph-mon[92072]: osdmap e541: 12 total, 12 up, 12 in 2023-03-02T14:52:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:11 smithi057 ceph-mon[92072]: pgmap v7510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:52:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:11 smithi122 ceph-mon[125440]: osdmap e541: 12 total, 12 up, 12 in 2023-03-02T14:52:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:11 smithi122 ceph-mon[125440]: pgmap v7510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:52:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:11 smithi136 ceph-mon[125702]: osdmap e541: 12 total, 12 up, 12 in 2023-03-02T14:52:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:11 smithi136 ceph-mon[125702]: pgmap v7510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:52:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:13 smithi136 ceph-mon[125702]: pgmap v7511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:52:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:13 smithi136 ceph-mon[125702]: osdmap e542: 12 total, 12 up, 12 in 2023-03-02T14:52:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:13 smithi057 ceph-mon[92072]: pgmap v7511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:52:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:13 smithi057 ceph-mon[92072]: osdmap e542: 12 total, 12 up, 12 in 2023-03-02T14:52:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:13 smithi122 ceph-mon[125440]: pgmap v7511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:52:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:13 smithi122 ceph-mon[125440]: osdmap e542: 12 total, 12 up, 12 in 2023-03-02T14:52:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:14.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:52:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:14.720+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:52:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:14.720+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:52:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:14.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:52:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:14.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:52:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:15 smithi136 ceph-mon[125702]: pgmap v7513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:52:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:15 smithi057 ceph-mon[92072]: pgmap v7513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:52:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:15 smithi122 ceph-mon[125440]: pgmap v7513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:52:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:52:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:52:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:52:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:17 smithi136 ceph-mon[125702]: pgmap v7514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:52:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:52:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:52:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:52:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:17 smithi057 ceph-mon[92072]: pgmap v7514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:52:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:52:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:52:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:52:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:17 smithi122 ceph-mon[125440]: pgmap v7514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:52:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:52:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:52:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:52:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:18 smithi057 ceph-mon[92072]: pgmap v7515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 371 B/s wr, 12 op/s 2023-03-02T14:52:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:18 smithi122 ceph-mon[125440]: pgmap v7515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 371 B/s wr, 12 op/s 2023-03-02T14:52:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:18 smithi136 ceph-mon[125702]: pgmap v7515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 371 B/s wr, 12 op/s 2023-03-02T14:52:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:21 smithi136 ceph-mon[125702]: pgmap v7516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:52:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:21 smithi057 ceph-mon[92072]: pgmap v7516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:52:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:21 smithi122 ceph-mon[125440]: pgmap v7516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:52:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:23 smithi136 ceph-mon[125702]: pgmap v7517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:52:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:23 smithi057 ceph-mon[92072]: pgmap v7517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:52:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:23 smithi122 ceph-mon[125440]: pgmap v7517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:52:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:25 smithi136 ceph-mon[125702]: pgmap v7518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T14:52:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:25 smithi057 ceph-mon[92072]: pgmap v7518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T14:52:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:25 smithi122 ceph-mon[125440]: pgmap v7518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T14:52:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:27 smithi136 ceph-mon[125702]: pgmap v7519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T14:52:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:27 smithi057 ceph-mon[92072]: pgmap v7519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T14:52:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:27 smithi122 ceph-mon[125440]: pgmap v7519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T14:52:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:28 smithi057 ceph-mon[92072]: pgmap v7520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T14:52:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:28 smithi122 ceph-mon[125440]: pgmap v7520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T14:52:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:28 smithi136 ceph-mon[125702]: pgmap v7520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T14:52:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:29.731+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:52:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:29.731+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:52:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:29.731+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:52:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:29.731+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:52:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:29.731+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:52:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:31 smithi136 ceph-mon[125702]: pgmap v7521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:52:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:31 smithi057 ceph-mon[92072]: pgmap v7521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:52:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:31 smithi122 ceph-mon[125440]: pgmap v7521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:52:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:33 smithi136 ceph-mon[125702]: pgmap v7522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:52:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:33 smithi057 ceph-mon[92072]: pgmap v7522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:52:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:33 smithi122 ceph-mon[125440]: pgmap v7522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:52:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:35 smithi136 ceph-mon[125702]: pgmap v7523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:52:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:35 smithi057 ceph-mon[92072]: pgmap v7523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:52:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:35 smithi122 ceph-mon[125440]: pgmap v7523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:52:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:37 smithi136 ceph-mon[125702]: pgmap v7524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:52:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:37 smithi057 ceph-mon[92072]: pgmap v7524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:52:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:37 smithi122 ceph-mon[125440]: pgmap v7524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T14:52:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:38 smithi057 ceph-mon[92072]: pgmap v7525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:52:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:38 smithi122 ceph-mon[125440]: pgmap v7525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:52:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:38 smithi136 ceph-mon[125702]: pgmap v7525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T14:52:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:41 smithi136 ceph-mon[125702]: pgmap v7526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:41 smithi057 ceph-mon[92072]: pgmap v7526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:41 smithi122 ceph-mon[125440]: pgmap v7526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:43 smithi136 ceph-mon[125702]: pgmap v7527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:43 smithi057 ceph-mon[92072]: pgmap v7527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:43 smithi122 ceph-mon[125440]: pgmap v7527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:44.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:44.737+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:52:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:44.738+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:52:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:44.738+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:52:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:44.738+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:52:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:44.738+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:52:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:45 smithi136 ceph-mon[125702]: pgmap v7528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:45 smithi057 ceph-mon[92072]: pgmap v7528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:45 smithi122 ceph-mon[125440]: pgmap v7528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:47 smithi136 ceph-mon[125702]: pgmap v7529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:47 smithi057 ceph-mon[92072]: pgmap v7529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:47 smithi122 ceph-mon[125440]: pgmap v7529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:48 smithi057 ceph-mon[92072]: pgmap v7530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:48 smithi122 ceph-mon[125440]: pgmap v7530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:48 smithi136 ceph-mon[125702]: pgmap v7530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:51 smithi136 ceph-mon[125702]: pgmap v7531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:51 smithi057 ceph-mon[92072]: pgmap v7531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:51 smithi122 ceph-mon[125440]: pgmap v7531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:53 smithi136 ceph-mon[125702]: pgmap v7532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:53 smithi057 ceph-mon[92072]: pgmap v7532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:53 smithi122 ceph-mon[125440]: pgmap v7532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:55 smithi136 ceph-mon[125702]: pgmap v7533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:55 smithi057 ceph-mon[92072]: pgmap v7533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:55 smithi122 ceph-mon[125440]: pgmap v7533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:57 smithi136 ceph-mon[125702]: pgmap v7534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:57 smithi057 ceph-mon[92072]: pgmap v7534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:57 smithi122 ceph-mon[125440]: pgmap v7534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:52:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:52:58 smithi057 ceph-mon[92072]: pgmap v7535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:52:58 smithi122 ceph-mon[125440]: pgmap v7535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:52:58 smithi136 ceph-mon[125702]: pgmap v7535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:59.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:59.754+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:52:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:59.754+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:52:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:59.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:52:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:52:59.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:53:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:01 smithi136 ceph-mon[125702]: pgmap v7536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:01 smithi057 ceph-mon[92072]: pgmap v7536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:01 smithi122 ceph-mon[125440]: pgmap v7536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:03 smithi136 ceph-mon[125702]: pgmap v7537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:53:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:03 smithi057 ceph-mon[92072]: pgmap v7537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:53:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:03 smithi122 ceph-mon[125440]: pgmap v7537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:53:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:05 smithi136 ceph-mon[125702]: pgmap v7538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:53:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:05 smithi057 ceph-mon[92072]: pgmap v7538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:53:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:05 smithi122 ceph-mon[125440]: pgmap v7538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:53:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:07 smithi136 ceph-mon[125702]: pgmap v7539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:53:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:07 smithi057 ceph-mon[92072]: pgmap v7539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:53:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:07 smithi122 ceph-mon[125440]: pgmap v7539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:53:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:08 smithi057 ceph-mon[92072]: pgmap v7540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:53:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:08 smithi122 ceph-mon[125440]: pgmap v7540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:53:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:08 smithi136 ceph-mon[125702]: pgmap v7540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:53:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:10.380+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:53:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:10.380+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:53:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:10.381+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 111 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:53:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:10.381+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 112 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:53:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:11 smithi136 ceph-mon[125702]: osdmap e543: 12 total, 12 up, 12 in 2023-03-02T14:53:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:11 smithi136 ceph-mon[125702]: pgmap v7542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:53:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:11 smithi057 ceph-mon[92072]: osdmap e543: 12 total, 12 up, 12 in 2023-03-02T14:53:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:11 smithi057 ceph-mon[92072]: pgmap v7542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:53:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:11 smithi122 ceph-mon[125440]: osdmap e543: 12 total, 12 up, 12 in 2023-03-02T14:53:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:11 smithi122 ceph-mon[125440]: pgmap v7542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:53:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:13 smithi136 ceph-mon[125702]: pgmap v7543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:53:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:13 smithi136 ceph-mon[125702]: osdmap e544: 12 total, 12 up, 12 in 2023-03-02T14:53:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:13 smithi057 ceph-mon[92072]: pgmap v7543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:53:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:13 smithi057 ceph-mon[92072]: osdmap e544: 12 total, 12 up, 12 in 2023-03-02T14:53:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:13 smithi122 ceph-mon[125440]: pgmap v7543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:53:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:13 smithi122 ceph-mon[125440]: osdmap e544: 12 total, 12 up, 12 in 2023-03-02T14:53:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:14.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:53:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:14.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:53:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:14.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:53:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:14.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:53:14.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:14.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:53:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:15 smithi136 ceph-mon[125702]: pgmap v7545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:53:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:15 smithi057 ceph-mon[92072]: pgmap v7545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:53:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:15 smithi122 ceph-mon[125440]: pgmap v7545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:53:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:17 smithi136 ceph-mon[125702]: pgmap v7546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:53:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:53:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:53:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:53:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:53:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:17 smithi057 ceph-mon[92072]: pgmap v7546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:53:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:53:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:53:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:53:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:53:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:17 smithi122 ceph-mon[125440]: pgmap v7546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:53:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:53:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:53:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:53:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:53:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:18 smithi057 ceph-mon[92072]: pgmap v7547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 375 B/s wr, 12 op/s 2023-03-02T14:53:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:18 smithi122 ceph-mon[125440]: pgmap v7547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 375 B/s wr, 12 op/s 2023-03-02T14:53:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:18 smithi136 ceph-mon[125702]: pgmap v7547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 375 B/s wr, 12 op/s 2023-03-02T14:53:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:21 smithi136 ceph-mon[125702]: pgmap v7548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:53:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:21 smithi057 ceph-mon[92072]: pgmap v7548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:53:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:21 smithi122 ceph-mon[125440]: pgmap v7548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T14:53:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:23 smithi136 ceph-mon[125702]: pgmap v7549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:53:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:23 smithi057 ceph-mon[92072]: pgmap v7549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:53:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:23 smithi122 ceph-mon[125440]: pgmap v7549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:53:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:25 smithi136 ceph-mon[125702]: pgmap v7550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T14:53:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:25 smithi057 ceph-mon[92072]: pgmap v7550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T14:53:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:25 smithi122 ceph-mon[125440]: pgmap v7550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T14:53:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:27 smithi136 ceph-mon[125702]: pgmap v7551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T14:53:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:27 smithi057 ceph-mon[92072]: pgmap v7551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T14:53:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:27 smithi122 ceph-mon[125440]: pgmap v7551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T14:53:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:28 smithi057 ceph-mon[92072]: pgmap v7552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T14:53:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:28 smithi136 ceph-mon[125702]: pgmap v7552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T14:53:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:29.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:53:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:29.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:53:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:29.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:53:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:29.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:53:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:29.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:53:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:31 smithi136 ceph-mon[125702]: pgmap v7553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:31 smithi057 ceph-mon[92072]: pgmap v7553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:28 smithi122 ceph-mon[125440]: pgmap v7552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T14:53:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:31 smithi122 ceph-mon[125440]: pgmap v7553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:33 smithi136 ceph-mon[125702]: pgmap v7554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:33 smithi057 ceph-mon[92072]: pgmap v7554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:33 smithi122 ceph-mon[125440]: pgmap v7554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:35 smithi136 ceph-mon[125702]: pgmap v7555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:35 smithi057 ceph-mon[92072]: pgmap v7555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:35 smithi122 ceph-mon[125440]: pgmap v7555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:37 smithi136 ceph-mon[125702]: pgmap v7556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:37 smithi057 ceph-mon[92072]: pgmap v7556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:37 smithi122 ceph-mon[125440]: pgmap v7556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:38 smithi057 ceph-mon[92072]: pgmap v7557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:38 smithi122 ceph-mon[125440]: pgmap v7557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:38 smithi136 ceph-mon[125702]: pgmap v7557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:41 smithi136 ceph-mon[125702]: pgmap v7558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:53:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:41 smithi057 ceph-mon[92072]: pgmap v7558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:53:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:41 smithi122 ceph-mon[125440]: pgmap v7558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T14:53:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:43 smithi136 ceph-mon[125702]: pgmap v7559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:43 smithi057 ceph-mon[92072]: pgmap v7559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:43 smithi122 ceph-mon[125440]: pgmap v7559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:44.789+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:53:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:44.790+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:53:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:44.790+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:53:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:44.790+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:53:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:44.790+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:53:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:45 smithi136 ceph-mon[125702]: pgmap v7560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2023-03-02T14:53:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:45 smithi057 ceph-mon[92072]: pgmap v7560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2023-03-02T14:53:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:45 smithi122 ceph-mon[125440]: pgmap v7560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2023-03-02T14:53:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:47 smithi136 ceph-mon[125702]: pgmap v7561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2023-03-02T14:53:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:47 smithi057 ceph-mon[92072]: pgmap v7561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2023-03-02T14:53:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:47 smithi122 ceph-mon[125440]: pgmap v7561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2023-03-02T14:53:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:48 smithi057 ceph-mon[92072]: pgmap v7562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:48 smithi122 ceph-mon[125440]: pgmap v7562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:48 smithi136 ceph-mon[125702]: pgmap v7562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:51 smithi136 ceph-mon[125702]: pgmap v7563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:51 smithi057 ceph-mon[92072]: pgmap v7563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:51 smithi122 ceph-mon[125440]: pgmap v7563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:53 smithi136 ceph-mon[125702]: pgmap v7564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:53 smithi057 ceph-mon[92072]: pgmap v7564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:53 smithi122 ceph-mon[125440]: pgmap v7564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:55 smithi136 ceph-mon[125702]: pgmap v7565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:55 smithi057 ceph-mon[92072]: pgmap v7565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:55 smithi122 ceph-mon[125440]: pgmap v7565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:57 smithi136 ceph-mon[125702]: pgmap v7566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:57 smithi057 ceph-mon[92072]: pgmap v7566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:57 smithi122 ceph-mon[125440]: pgmap v7566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:53:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:53:58 smithi057 ceph-mon[92072]: pgmap v7567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:53:58 smithi122 ceph-mon[125440]: pgmap v7567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:53:58 smithi136 ceph-mon[125702]: pgmap v7567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:53:59.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:59.793+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:53:59.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:59.794+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:53:59.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:59.794+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:53:59.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:59.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:53:59.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:53:59.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:54:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:01 smithi136 ceph-mon[125702]: pgmap v7568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:01 smithi057 ceph-mon[92072]: pgmap v7568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:01 smithi122 ceph-mon[125440]: pgmap v7568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:03 smithi136 ceph-mon[125702]: pgmap v7569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:54:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:03 smithi057 ceph-mon[92072]: pgmap v7569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:54:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:03 smithi122 ceph-mon[125440]: pgmap v7569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:54:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:05 smithi136 ceph-mon[125702]: pgmap v7570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:54:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:05 smithi057 ceph-mon[92072]: pgmap v7570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:54:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:05 smithi122 ceph-mon[125440]: pgmap v7570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:54:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:07 smithi136 ceph-mon[125702]: pgmap v7571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:54:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:07 smithi057 ceph-mon[92072]: pgmap v7571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:54:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:07 smithi122 ceph-mon[125440]: pgmap v7571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:54:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:08 smithi057 ceph-mon[92072]: pgmap v7572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:54:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:08 smithi122 ceph-mon[125440]: pgmap v7572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:54:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:08 smithi136 ceph-mon[125702]: pgmap v7572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:54:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:11 smithi136 ceph-mon[125702]: osdmap e545: 12 total, 12 up, 12 in 2023-03-02T14:54:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:11 smithi136 ceph-mon[125702]: pgmap v7574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:54:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:11 smithi057 ceph-mon[92072]: osdmap e545: 12 total, 12 up, 12 in 2023-03-02T14:54:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:11 smithi057 ceph-mon[92072]: pgmap v7574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:54:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:11 smithi122 ceph-mon[125440]: osdmap e545: 12 total, 12 up, 12 in 2023-03-02T14:54:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:11 smithi122 ceph-mon[125440]: pgmap v7574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:54:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:13 smithi136 ceph-mon[125702]: pgmap v7575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:54:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:13 smithi136 ceph-mon[125702]: osdmap e546: 12 total, 12 up, 12 in 2023-03-02T14:54:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:13 smithi057 ceph-mon[92072]: pgmap v7575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:54:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:13 smithi057 ceph-mon[92072]: osdmap e546: 12 total, 12 up, 12 in 2023-03-02T14:54:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:13 smithi122 ceph-mon[125440]: pgmap v7575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:54:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:13 smithi122 ceph-mon[125440]: osdmap e546: 12 total, 12 up, 12 in 2023-03-02T14:54:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:14.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:54:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:14.809+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:54:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:14.809+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:54:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:14.809+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:54:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:14.809+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:54:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:15 smithi136 ceph-mon[125702]: pgmap v7577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:54:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:15 smithi057 ceph-mon[92072]: pgmap v7577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:54:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:15 smithi122 ceph-mon[125440]: pgmap v7577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:54:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:17 smithi136 ceph-mon[125702]: pgmap v7578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:54:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:17 smithi057 ceph-mon[92072]: pgmap v7578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:54:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:17 smithi122 ceph-mon[125440]: pgmap v7578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:54:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:54:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:54:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:54:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:19 smithi136 ceph-mon[125702]: pgmap v7579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T14:54:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:19 smithi057 ceph-mon[92072]: pgmap v7579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T14:54:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:19 smithi122 ceph-mon[125440]: pgmap v7579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2023-03-02T14:54:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:21 smithi136 ceph-mon[125702]: pgmap v7580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:54:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:21 smithi057 ceph-mon[92072]: pgmap v7580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:54:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:21 smithi122 ceph-mon[125440]: pgmap v7580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:54:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 189.2M 2023-03-02T14:54:23.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 198414635: error parsing value: Value '198414635' is below minimum 939524096 2023-03-02T14:54:23.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:54:23.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:54:23.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 189.2M 2023-03-02T14:54:23.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 198414635: error parsing value: Value '198414635' is below minimum 939524096 2023-03-02T14:54:23.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:54:23.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:54:23.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 189.2M 2023-03-02T14:54:23.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 198414635: error parsing value: Value '198414635' is below minimum 939524096 2023-03-02T14:54:23.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T14:54:23.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:54:23.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:54:23.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:54:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:23 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:54:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:23 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:54:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:23 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:54:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:23 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:54:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:23 smithi136 ceph-mon[125702]: pgmap v7581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:54:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:23 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:54:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:23 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:54:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:23 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:54:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:23 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:54:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:23 smithi057 ceph-mon[92072]: pgmap v7581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:54:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:23 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T14:54:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:23 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T14:54:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:23 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T14:54:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:23 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T14:54:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:23 smithi122 ceph-mon[125440]: pgmap v7581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:54:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:25 smithi136 ceph-mon[125702]: pgmap v7582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:54:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:25 smithi057 ceph-mon[92072]: pgmap v7582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:54:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:25 smithi122 ceph-mon[125440]: pgmap v7582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:54:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:27 smithi136 ceph-mon[125702]: pgmap v7583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T14:54:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:27 smithi057 ceph-mon[92072]: pgmap v7583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T14:54:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:27 smithi122 ceph-mon[125440]: pgmap v7583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T14:54:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:28 smithi057 ceph-mon[92072]: pgmap v7584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:54:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:28 smithi122 ceph-mon[125440]: pgmap v7584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:54:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:28 smithi136 ceph-mon[125702]: pgmap v7584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:54:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:29.824+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:54:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:29.824+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:54:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:29.824+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:54:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:29.824+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:54:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:29.824+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:54:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:31 smithi136 ceph-mon[125702]: pgmap v7585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:31 smithi057 ceph-mon[92072]: pgmap v7585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:31 smithi122 ceph-mon[125440]: pgmap v7585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:33 smithi136 ceph-mon[125702]: pgmap v7586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:33 smithi057 ceph-mon[92072]: pgmap v7586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:33 smithi122 ceph-mon[125440]: pgmap v7586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:35 smithi136 ceph-mon[125702]: pgmap v7587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:35 smithi057 ceph-mon[92072]: pgmap v7587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:35 smithi122 ceph-mon[125440]: pgmap v7587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:37 smithi136 ceph-mon[125702]: pgmap v7588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:37 smithi057 ceph-mon[92072]: pgmap v7588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:37 smithi122 ceph-mon[125440]: pgmap v7588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:38 smithi057 ceph-mon[92072]: pgmap v7589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:38 smithi122 ceph-mon[125440]: pgmap v7589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:38 smithi136 ceph-mon[125702]: pgmap v7589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:41 smithi136 ceph-mon[125702]: pgmap v7590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:41 smithi057 ceph-mon[92072]: pgmap v7590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:41 smithi122 ceph-mon[125440]: pgmap v7590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:43 smithi136 ceph-mon[125702]: pgmap v7591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:43 smithi057 ceph-mon[92072]: pgmap v7591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:43 smithi122 ceph-mon[125440]: pgmap v7591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:44.837+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:54:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:44.837+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:54:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:44.837+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:54:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:44.837+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:54:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:44.837+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:54:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:45 smithi136 ceph-mon[125702]: pgmap v7592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:45 smithi057 ceph-mon[92072]: pgmap v7592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:45 smithi122 ceph-mon[125440]: pgmap v7592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:47 smithi136 ceph-mon[125702]: pgmap v7593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T14:54:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:47 smithi057 ceph-mon[92072]: pgmap v7593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T14:54:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:47 smithi122 ceph-mon[125440]: pgmap v7593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T14:54:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:48 smithi057 ceph-mon[92072]: pgmap v7594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:48 smithi122 ceph-mon[125440]: pgmap v7594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:48 smithi136 ceph-mon[125702]: pgmap v7594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:51 smithi136 ceph-mon[125702]: pgmap v7595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:51 smithi057 ceph-mon[92072]: pgmap v7595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:51 smithi122 ceph-mon[125440]: pgmap v7595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:53 smithi136 ceph-mon[125702]: pgmap v7596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:53 smithi057 ceph-mon[92072]: pgmap v7596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:53 smithi122 ceph-mon[125440]: pgmap v7596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:54:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:55 smithi136 ceph-mon[125702]: pgmap v7597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:55 smithi057 ceph-mon[92072]: pgmap v7597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:55 smithi122 ceph-mon[125440]: pgmap v7597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:54:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:57 smithi136 ceph-mon[125702]: pgmap v7598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T14:54:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:57 smithi057 ceph-mon[92072]: pgmap v7598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T14:54:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:57 smithi122 ceph-mon[125440]: pgmap v7598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T14:54:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:54:58 smithi057 ceph-mon[92072]: pgmap v7599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T14:54:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:54:58 smithi122 ceph-mon[125440]: pgmap v7599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T14:54:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:54:58 smithi136 ceph-mon[125702]: pgmap v7599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T14:54:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:59.853+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:54:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:59.853+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:54:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:59.853+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:54:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:59.853+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:54:59.855 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:54:59.853+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:55:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:01 smithi136 ceph-mon[125702]: pgmap v7600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:01 smithi057 ceph-mon[92072]: pgmap v7600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:01 smithi122 ceph-mon[125440]: pgmap v7600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:03 smithi136 ceph-mon[125702]: pgmap v7601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:55:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:03 smithi057 ceph-mon[92072]: pgmap v7601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:55:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:03 smithi122 ceph-mon[125440]: pgmap v7601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:55:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:05 smithi136 ceph-mon[125702]: pgmap v7602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:55:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:05 smithi057 ceph-mon[92072]: pgmap v7602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:55:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:05 smithi122 ceph-mon[125440]: pgmap v7602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:55:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:07 smithi136 ceph-mon[125702]: pgmap v7603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T14:55:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:07 smithi057 ceph-mon[92072]: pgmap v7603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T14:55:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:07 smithi122 ceph-mon[125440]: pgmap v7603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T14:55:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:08 smithi122 ceph-mon[125440]: pgmap v7604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T14:55:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:08 smithi136 ceph-mon[125702]: pgmap v7604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T14:55:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:08 smithi057 ceph-mon[92072]: pgmap v7604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T14:55:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:11 smithi136 ceph-mon[125702]: osdmap e547: 12 total, 12 up, 12 in 2023-03-02T14:55:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:11 smithi136 ceph-mon[125702]: pgmap v7606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:55:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:11 smithi057 ceph-mon[92072]: osdmap e547: 12 total, 12 up, 12 in 2023-03-02T14:55:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:11 smithi057 ceph-mon[92072]: pgmap v7606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:55:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:11 smithi122 ceph-mon[125440]: osdmap e547: 12 total, 12 up, 12 in 2023-03-02T14:55:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:11 smithi122 ceph-mon[125440]: pgmap v7606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:55:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:13 smithi136 ceph-mon[125702]: pgmap v7607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:55:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:13 smithi136 ceph-mon[125702]: osdmap e548: 12 total, 12 up, 12 in 2023-03-02T14:55:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:13 smithi057 ceph-mon[92072]: pgmap v7607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:55:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:13 smithi057 ceph-mon[92072]: osdmap e548: 12 total, 12 up, 12 in 2023-03-02T14:55:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:13 smithi122 ceph-mon[125440]: pgmap v7607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:55:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:13 smithi122 ceph-mon[125440]: osdmap e548: 12 total, 12 up, 12 in 2023-03-02T14:55:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:14.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:55:14.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:14.855+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:55:14.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:14.855+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:55:14.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:14.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:55:14.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:14.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:55:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:15 smithi136 ceph-mon[125702]: pgmap v7609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T14:55:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:15 smithi057 ceph-mon[92072]: pgmap v7609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T14:55:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:15 smithi122 ceph-mon[125440]: pgmap v7609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T14:55:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:17 smithi136 ceph-mon[125702]: pgmap v7610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-03-02T14:55:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:17 smithi057 ceph-mon[92072]: pgmap v7610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-03-02T14:55:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:17 smithi122 ceph-mon[125440]: pgmap v7610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-03-02T14:55:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:18 smithi057 ceph-mon[92072]: pgmap v7611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T14:55:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:18 smithi122 ceph-mon[125440]: pgmap v7611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T14:55:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:18 smithi136 ceph-mon[125702]: pgmap v7611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T14:55:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:21 smithi136 ceph-mon[125702]: pgmap v7612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:55:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:21 smithi057 ceph-mon[92072]: pgmap v7612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:55:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:21 smithi122 ceph-mon[125440]: pgmap v7612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:55:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:55:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:55:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:55:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:23 smithi136 ceph-mon[125702]: pgmap v7613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:55:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:55:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:55:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:55:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:23 smithi057 ceph-mon[92072]: pgmap v7613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:55:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:55:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:55:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:55:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:23 smithi122 ceph-mon[125440]: pgmap v7613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:55:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:55:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:55:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:55:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:25 smithi136 ceph-mon[125702]: pgmap v7614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:55:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:25 smithi057 ceph-mon[92072]: pgmap v7614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:55:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:25 smithi122 ceph-mon[125440]: pgmap v7614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:55:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:27 smithi136 ceph-mon[125702]: pgmap v7615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T14:55:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:27 smithi057 ceph-mon[92072]: pgmap v7615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T14:55:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:27 smithi122 ceph-mon[125440]: pgmap v7615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T14:55:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:28 smithi122 ceph-mon[125440]: pgmap v7616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:28 smithi136 ceph-mon[125702]: pgmap v7616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:28 smithi057 ceph-mon[92072]: pgmap v7616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:29.863+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:55:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:29.863+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:55:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:29.863+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:55:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:29.863+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:55:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:29.863+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:55:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:31 smithi136 ceph-mon[125702]: pgmap v7617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:31 smithi057 ceph-mon[92072]: pgmap v7617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:31 smithi122 ceph-mon[125440]: pgmap v7617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:33 smithi136 ceph-mon[125702]: pgmap v7618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:55:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:33 smithi057 ceph-mon[92072]: pgmap v7618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:55:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:33 smithi122 ceph-mon[125440]: pgmap v7618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:55:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:35 smithi136 ceph-mon[125702]: pgmap v7619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:35 smithi057 ceph-mon[92072]: pgmap v7619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:35 smithi122 ceph-mon[125440]: pgmap v7619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:37 smithi136 ceph-mon[125702]: pgmap v7620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:55:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:37 smithi057 ceph-mon[92072]: pgmap v7620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:55:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:37 smithi122 ceph-mon[125440]: pgmap v7620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:55:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:38 smithi122 ceph-mon[125440]: pgmap v7621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:38 smithi136 ceph-mon[125702]: pgmap v7621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:38 smithi057 ceph-mon[92072]: pgmap v7621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:41 smithi136 ceph-mon[125702]: pgmap v7622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:41 smithi057 ceph-mon[92072]: pgmap v7622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:41 smithi122 ceph-mon[125440]: pgmap v7622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:43 smithi136 ceph-mon[125702]: pgmap v7623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:55:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:43 smithi057 ceph-mon[92072]: pgmap v7623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:55:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:43 smithi122 ceph-mon[125440]: pgmap v7623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:44.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:44.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:44.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:44.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:55:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:44.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:55:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:45 smithi136 ceph-mon[125702]: pgmap v7624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:45 smithi057 ceph-mon[92072]: pgmap v7624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:45 smithi122 ceph-mon[125440]: pgmap v7624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:47 smithi136 ceph-mon[125702]: pgmap v7625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:55:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:47 smithi057 ceph-mon[92072]: pgmap v7625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:55:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:47 smithi122 ceph-mon[125440]: pgmap v7625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:55:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:48 smithi122 ceph-mon[125440]: pgmap v7626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:48 smithi136 ceph-mon[125702]: pgmap v7626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:48 smithi057 ceph-mon[92072]: pgmap v7626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:51 smithi136 ceph-mon[125702]: pgmap v7627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:51 smithi057 ceph-mon[92072]: pgmap v7627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:51 smithi122 ceph-mon[125440]: pgmap v7627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:53 smithi136 ceph-mon[125702]: pgmap v7628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:55:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:53 smithi057 ceph-mon[92072]: pgmap v7628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:55:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:53 smithi122 ceph-mon[125440]: pgmap v7628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:55:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:55 smithi136 ceph-mon[125702]: pgmap v7629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:55 smithi057 ceph-mon[92072]: pgmap v7629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:55 smithi122 ceph-mon[125440]: pgmap v7629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:55:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:57 smithi136 ceph-mon[125702]: pgmap v7630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:55:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:57 smithi057 ceph-mon[92072]: pgmap v7630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:55:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:57 smithi122 ceph-mon[125440]: pgmap v7630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:55:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:55:58 smithi122 ceph-mon[125440]: pgmap v7631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:55:58 smithi136 ceph-mon[125702]: pgmap v7631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:55:58 smithi057 ceph-mon[92072]: pgmap v7631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:55:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:59.880+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:55:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:59.880+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:55:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:59.880+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:55:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:59.880+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:55:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:55:59.880+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:56:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:01 smithi136 ceph-mon[125702]: pgmap v7632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:01 smithi057 ceph-mon[92072]: pgmap v7632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:01 smithi122 ceph-mon[125440]: pgmap v7632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:03 smithi136 ceph-mon[125702]: pgmap v7633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:56:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:03 smithi057 ceph-mon[92072]: pgmap v7633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:56:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:03 smithi122 ceph-mon[125440]: pgmap v7633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:56:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:05 smithi136 ceph-mon[125702]: pgmap v7634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:56:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:05 smithi057 ceph-mon[92072]: pgmap v7634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:56:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:05 smithi122 ceph-mon[125440]: pgmap v7634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:56:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:07 smithi136 ceph-mon[125702]: pgmap v7635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T14:56:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:07 smithi057 ceph-mon[92072]: pgmap v7635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T14:56:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:07 smithi122 ceph-mon[125440]: pgmap v7635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T14:56:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:08 smithi122 ceph-mon[125440]: pgmap v7636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T14:56:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:08 smithi136 ceph-mon[125702]: pgmap v7636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T14:56:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:08 smithi057 ceph-mon[92072]: pgmap v7636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T14:56:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:10.409+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:56:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:10.409+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:56:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:10.409+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 113 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:56:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:10.409+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 112 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:56:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:11 smithi136 ceph-mon[125702]: osdmap e549: 12 total, 12 up, 12 in 2023-03-02T14:56:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:11 smithi136 ceph-mon[125702]: pgmap v7638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:56:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:11 smithi057 ceph-mon[92072]: osdmap e549: 12 total, 12 up, 12 in 2023-03-02T14:56:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:11 smithi057 ceph-mon[92072]: pgmap v7638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:56:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:11 smithi122 ceph-mon[125440]: osdmap e549: 12 total, 12 up, 12 in 2023-03-02T14:56:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:11 smithi122 ceph-mon[125440]: pgmap v7638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:56:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:13 smithi136 ceph-mon[125702]: pgmap v7639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:56:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:13 smithi136 ceph-mon[125702]: osdmap e550: 12 total, 12 up, 12 in 2023-03-02T14:56:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:13 smithi057 ceph-mon[92072]: pgmap v7639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:56:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:13 smithi057 ceph-mon[92072]: osdmap e550: 12 total, 12 up, 12 in 2023-03-02T14:56:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:13 smithi122 ceph-mon[125440]: pgmap v7639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:56:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:13 smithi122 ceph-mon[125440]: osdmap e550: 12 total, 12 up, 12 in 2023-03-02T14:56:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:14.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:56:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:14.889+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:56:14.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:14.889+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:56:14.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:14.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:56:14.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:14.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:56:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:15 smithi136 ceph-mon[125702]: pgmap v7641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 8 op/s 2023-03-02T14:56:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:15 smithi057 ceph-mon[92072]: pgmap v7641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 8 op/s 2023-03-02T14:56:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:15 smithi122 ceph-mon[125440]: pgmap v7641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 8 op/s 2023-03-02T14:56:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:17 smithi136 ceph-mon[125702]: pgmap v7642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-03-02T14:56:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:17 smithi057 ceph-mon[92072]: pgmap v7642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-03-02T14:56:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:17 smithi122 ceph-mon[125440]: pgmap v7642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-03-02T14:56:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:18 smithi122 ceph-mon[125440]: pgmap v7643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T14:56:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:18 smithi136 ceph-mon[125702]: pgmap v7643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T14:56:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:18 smithi057 ceph-mon[92072]: pgmap v7643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T14:56:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:21 smithi136 ceph-mon[125702]: pgmap v7644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:56:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:21 smithi057 ceph-mon[92072]: pgmap v7644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:56:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:21 smithi122 ceph-mon[125440]: pgmap v7644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:56:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:23 smithi136 ceph-mon[125702]: pgmap v7645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:56:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:56:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:23 smithi057 ceph-mon[92072]: pgmap v7645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:56:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:56:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:23 smithi122 ceph-mon[125440]: pgmap v7645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:56:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:56:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:56:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:56:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:56:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:56:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:56:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:24 smithi057 ceph-mon[92072]: pgmap v7646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:56:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:56:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:56:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:56:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:56:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:56:25.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:24 smithi122 ceph-mon[125440]: pgmap v7646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:56:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:56:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:56:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:56:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:56:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:56:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:24 smithi136 ceph-mon[125702]: pgmap v7646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:56:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:27 smithi136 ceph-mon[125702]: pgmap v7647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T14:56:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:27 smithi057 ceph-mon[92072]: pgmap v7647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T14:56:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:27 smithi122 ceph-mon[125440]: pgmap v7647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T14:56:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:28 smithi136 ceph-mon[125702]: pgmap v7648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:28 smithi057 ceph-mon[92072]: pgmap v7648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:28 smithi122 ceph-mon[125440]: pgmap v7648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:29.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:56:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:29.891+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:56:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:29.891+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:56:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:29.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:56:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:29.891+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:56:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:31 smithi136 ceph-mon[125702]: pgmap v7649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:31 smithi057 ceph-mon[92072]: pgmap v7649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:31 smithi122 ceph-mon[125440]: pgmap v7649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:33 smithi136 ceph-mon[125702]: pgmap v7650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:56:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:33 smithi057 ceph-mon[92072]: pgmap v7650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:56:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:33 smithi122 ceph-mon[125440]: pgmap v7650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:56:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:35 smithi136 ceph-mon[125702]: pgmap v7651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:35 smithi057 ceph-mon[92072]: pgmap v7651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:35 smithi122 ceph-mon[125440]: pgmap v7651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:37 smithi136 ceph-mon[125702]: pgmap v7652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:56:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:37 smithi057 ceph-mon[92072]: pgmap v7652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:56:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:37 smithi122 ceph-mon[125440]: pgmap v7652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:56:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:38 smithi122 ceph-mon[125440]: pgmap v7653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:38 smithi136 ceph-mon[125702]: pgmap v7653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:38 smithi057 ceph-mon[92072]: pgmap v7653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:41 smithi136 ceph-mon[125702]: pgmap v7654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:41 smithi057 ceph-mon[92072]: pgmap v7654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:41 smithi122 ceph-mon[125440]: pgmap v7654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:43 smithi136 ceph-mon[125702]: pgmap v7655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:56:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:43 smithi057 ceph-mon[92072]: pgmap v7655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:56:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:43 smithi122 ceph-mon[125440]: pgmap v7655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:56:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:44.901+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:56:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:44.902+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:56:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:44.902+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:56:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:44.902+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:56:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:44.902+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:56:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:45 smithi136 ceph-mon[125702]: pgmap v7656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:45 smithi057 ceph-mon[92072]: pgmap v7656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:45 smithi122 ceph-mon[125440]: pgmap v7656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:47 smithi136 ceph-mon[125702]: pgmap v7657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:56:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:47 smithi057 ceph-mon[92072]: pgmap v7657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:56:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:47 smithi122 ceph-mon[125440]: pgmap v7657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:56:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:48 smithi136 ceph-mon[125702]: pgmap v7658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:48 smithi057 ceph-mon[92072]: pgmap v7658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:48 smithi122 ceph-mon[125440]: pgmap v7658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:51 smithi136 ceph-mon[125702]: pgmap v7659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:51 smithi057 ceph-mon[92072]: pgmap v7659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:51 smithi122 ceph-mon[125440]: pgmap v7659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:53 smithi136 ceph-mon[125702]: pgmap v7660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:56:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:53 smithi057 ceph-mon[92072]: pgmap v7660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:56:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:53 smithi122 ceph-mon[125440]: pgmap v7660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:56:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:55 smithi136 ceph-mon[125702]: pgmap v7661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:55 smithi057 ceph-mon[92072]: pgmap v7661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:55 smithi122 ceph-mon[125440]: pgmap v7661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:56:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:57 smithi136 ceph-mon[125702]: pgmap v7662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:56:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:57 smithi057 ceph-mon[92072]: pgmap v7662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:56:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:57 smithi122 ceph-mon[125440]: pgmap v7662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-03-02T14:56:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:56:58 smithi136 ceph-mon[125702]: pgmap v7663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:56:58 smithi057 ceph-mon[92072]: pgmap v7663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:56:58 smithi122 ceph-mon[125440]: pgmap v7663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T14:56:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:59.918+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:56:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:59.918+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:56:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:59.918+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:56:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:59.918+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:56:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:56:59.918+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:57:02.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:01 smithi136 ceph-mon[125702]: pgmap v7664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:01 smithi057 ceph-mon[92072]: pgmap v7664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:01 smithi122 ceph-mon[125440]: pgmap v7664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:03 smithi136 ceph-mon[125702]: pgmap v7665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:57:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:03 smithi057 ceph-mon[92072]: pgmap v7665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:57:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:03 smithi122 ceph-mon[125440]: pgmap v7665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:57:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:05 smithi136 ceph-mon[125702]: pgmap v7666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:57:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:05 smithi057 ceph-mon[92072]: pgmap v7666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:57:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:05 smithi122 ceph-mon[125440]: pgmap v7666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:57:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:07 smithi136 ceph-mon[125702]: pgmap v7667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:57:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:07 smithi057 ceph-mon[92072]: pgmap v7667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:57:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:07 smithi122 ceph-mon[125440]: pgmap v7667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:57:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:08 smithi136 ceph-mon[125702]: pgmap v7668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T14:57:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:08 smithi057 ceph-mon[92072]: pgmap v7668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T14:57:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:08 smithi122 ceph-mon[125440]: pgmap v7668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T14:57:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:11 smithi136 ceph-mon[125702]: osdmap e551: 12 total, 12 up, 12 in 2023-03-02T14:57:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:11 smithi136 ceph-mon[125702]: pgmap v7670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:57:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:11 smithi057 ceph-mon[92072]: osdmap e551: 12 total, 12 up, 12 in 2023-03-02T14:57:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:11 smithi057 ceph-mon[92072]: pgmap v7670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:57:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:11 smithi122 ceph-mon[125440]: osdmap e551: 12 total, 12 up, 12 in 2023-03-02T14:57:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:11 smithi122 ceph-mon[125440]: pgmap v7670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:57:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:13 smithi136 ceph-mon[125702]: pgmap v7671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:57:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:13 smithi136 ceph-mon[125702]: osdmap e552: 12 total, 12 up, 12 in 2023-03-02T14:57:14.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:13 smithi057 ceph-mon[92072]: pgmap v7671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:57:14.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:13 smithi057 ceph-mon[92072]: osdmap e552: 12 total, 12 up, 12 in 2023-03-02T14:57:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:13 smithi122 ceph-mon[125440]: pgmap v7671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:57:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:13 smithi122 ceph-mon[125440]: osdmap e552: 12 total, 12 up, 12 in 2023-03-02T14:57:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:14.934+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:57:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:14.934+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:57:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:14.934+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:57:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:14.934+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:57:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:14.934+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:57:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:15 smithi136 ceph-mon[125702]: pgmap v7673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:57:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:15 smithi057 ceph-mon[92072]: pgmap v7673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:57:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:15 smithi122 ceph-mon[125440]: pgmap v7673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:57:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:17 smithi136 ceph-mon[125702]: pgmap v7674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:57:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:17 smithi057 ceph-mon[92072]: pgmap v7674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:57:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:17 smithi122 ceph-mon[125440]: pgmap v7674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:57:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:18 smithi136 ceph-mon[125702]: pgmap v7675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T14:57:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:18 smithi057 ceph-mon[92072]: pgmap v7675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T14:57:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:18 smithi122 ceph-mon[125440]: pgmap v7675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T14:57:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:21 smithi136 ceph-mon[125702]: pgmap v7676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:57:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:21 smithi057 ceph-mon[92072]: pgmap v7676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:57:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:21 smithi122 ceph-mon[125440]: pgmap v7676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:57:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:23 smithi136 ceph-mon[125702]: pgmap v7677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:57:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:23 smithi057 ceph-mon[92072]: pgmap v7677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:57:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:23 smithi122 ceph-mon[125440]: pgmap v7677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:57:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:57:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:57:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:57:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:25 smithi136 ceph-mon[125702]: pgmap v7678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:57:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:25 smithi057 ceph-mon[92072]: pgmap v7678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:57:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:25 smithi122 ceph-mon[125440]: pgmap v7678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:57:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:57:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:57:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:57:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:57:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:57:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:57:27.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:57:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:27 smithi136 ceph-mon[125702]: pgmap v7679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:57:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:27 smithi057 ceph-mon[92072]: pgmap v7679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:57:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:27 smithi122 ceph-mon[125440]: pgmap v7679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:57:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:28 smithi136 ceph-mon[125702]: pgmap v7680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:28 smithi057 ceph-mon[92072]: pgmap v7680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:28 smithi122 ceph-mon[125440]: pgmap v7680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:29.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:57:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:29.943+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:57:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:29.943+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:57:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:29.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:57:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:29.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:57:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:31 smithi136 ceph-mon[125702]: pgmap v7681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:31 smithi057 ceph-mon[92072]: pgmap v7681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:31 smithi122 ceph-mon[125440]: pgmap v7681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:33 smithi136 ceph-mon[125702]: pgmap v7682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:33 smithi057 ceph-mon[92072]: pgmap v7682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:33 smithi122 ceph-mon[125440]: pgmap v7682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:35 smithi136 ceph-mon[125702]: pgmap v7683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:35 smithi057 ceph-mon[92072]: pgmap v7683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:35 smithi122 ceph-mon[125440]: pgmap v7683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:37 smithi136 ceph-mon[125702]: pgmap v7684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:37 smithi057 ceph-mon[92072]: pgmap v7684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:37 smithi122 ceph-mon[125440]: pgmap v7684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:38 smithi136 ceph-mon[125702]: pgmap v7685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:38 smithi057 ceph-mon[92072]: pgmap v7685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:38 smithi122 ceph-mon[125440]: pgmap v7685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:41 smithi136 ceph-mon[125702]: pgmap v7686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:41 smithi057 ceph-mon[92072]: pgmap v7686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:41 smithi122 ceph-mon[125440]: pgmap v7686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:43 smithi136 ceph-mon[125702]: pgmap v7687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:43 smithi057 ceph-mon[92072]: pgmap v7687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:43 smithi122 ceph-mon[125440]: pgmap v7687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:44.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:57:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:44.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:57:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:44.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:57:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:44.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:57:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:44.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:57:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:45 smithi136 ceph-mon[125702]: pgmap v7688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:45 smithi057 ceph-mon[92072]: pgmap v7688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:45 smithi122 ceph-mon[125440]: pgmap v7688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:47 smithi136 ceph-mon[125702]: pgmap v7689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:47 smithi057 ceph-mon[92072]: pgmap v7689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:47 smithi122 ceph-mon[125440]: pgmap v7689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:48 smithi136 ceph-mon[125702]: pgmap v7690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:48 smithi057 ceph-mon[92072]: pgmap v7690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:48 smithi122 ceph-mon[125440]: pgmap v7690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:51 smithi136 ceph-mon[125702]: pgmap v7691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:51 smithi057 ceph-mon[92072]: pgmap v7691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:51 smithi122 ceph-mon[125440]: pgmap v7691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:53 smithi136 ceph-mon[125702]: pgmap v7692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:53 smithi057 ceph-mon[92072]: pgmap v7692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:53 smithi122 ceph-mon[125440]: pgmap v7692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:55 smithi136 ceph-mon[125702]: pgmap v7693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:55 smithi057 ceph-mon[92072]: pgmap v7693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:55 smithi122 ceph-mon[125440]: pgmap v7693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:57 smithi136 ceph-mon[125702]: pgmap v7694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:57 smithi057 ceph-mon[92072]: pgmap v7694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:57 smithi122 ceph-mon[125440]: pgmap v7694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:57:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:57:58 smithi136 ceph-mon[125702]: pgmap v7695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:57:58 smithi057 ceph-mon[92072]: pgmap v7695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:57:58 smithi122 ceph-mon[125440]: pgmap v7695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:57:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:59.967+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:57:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:59.967+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:57:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:59.967+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:57:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:59.967+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:57:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:57:59.967+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:58:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:01 smithi136 ceph-mon[125702]: pgmap v7696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:01 smithi057 ceph-mon[92072]: pgmap v7696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:01 smithi122 ceph-mon[125440]: pgmap v7696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:03 smithi136 ceph-mon[125702]: pgmap v7697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:58:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:03 smithi057 ceph-mon[92072]: pgmap v7697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:58:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:03 smithi122 ceph-mon[125440]: pgmap v7697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:58:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:05 smithi136 ceph-mon[125702]: pgmap v7698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:58:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:05 smithi057 ceph-mon[92072]: pgmap v7698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:58:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:05 smithi122 ceph-mon[125440]: pgmap v7698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:58:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:07 smithi136 ceph-mon[125702]: pgmap v7699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:58:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:07 smithi057 ceph-mon[92072]: pgmap v7699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:58:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:07 smithi122 ceph-mon[125440]: pgmap v7699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:58:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:08 smithi136 ceph-mon[125702]: pgmap v7700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:58:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:08 smithi057 ceph-mon[92072]: pgmap v7700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:58:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:08 smithi122 ceph-mon[125440]: pgmap v7700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:58:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:11 smithi136 ceph-mon[125702]: osdmap e553: 12 total, 12 up, 12 in 2023-03-02T14:58:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:11 smithi136 ceph-mon[125702]: pgmap v7702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:58:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:11 smithi057 ceph-mon[92072]: osdmap e553: 12 total, 12 up, 12 in 2023-03-02T14:58:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:11 smithi057 ceph-mon[92072]: pgmap v7702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:58:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:11 smithi122 ceph-mon[125440]: osdmap e553: 12 total, 12 up, 12 in 2023-03-02T14:58:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:11 smithi122 ceph-mon[125440]: pgmap v7702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:58:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:13 smithi136 ceph-mon[125702]: pgmap v7703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:58:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:13 smithi136 ceph-mon[125702]: osdmap e554: 12 total, 12 up, 12 in 2023-03-02T14:58:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:13 smithi057 ceph-mon[92072]: pgmap v7703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:58:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:13 smithi057 ceph-mon[92072]: osdmap e554: 12 total, 12 up, 12 in 2023-03-02T14:58:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:13 smithi122 ceph-mon[125440]: pgmap v7703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:58:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:13 smithi122 ceph-mon[125440]: osdmap e554: 12 total, 12 up, 12 in 2023-03-02T14:58:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:14.983+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:58:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:14.983+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:58:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:14.983+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:58:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:14.983+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:58:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:14.983+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:58:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:15 smithi136 ceph-mon[125702]: pgmap v7705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:58:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:15 smithi057 ceph-mon[92072]: pgmap v7705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:58:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:15 smithi122 ceph-mon[125440]: pgmap v7705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:58:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:17 smithi136 ceph-mon[125702]: pgmap v7706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:58:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:17 smithi057 ceph-mon[92072]: pgmap v7706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:58:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:17 smithi122 ceph-mon[125440]: pgmap v7706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:58:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:18 smithi136 ceph-mon[125702]: pgmap v7707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T14:58:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:18 smithi057 ceph-mon[92072]: pgmap v7707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T14:58:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:18 smithi122 ceph-mon[125440]: pgmap v7707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T14:58:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:21 smithi136 ceph-mon[125702]: pgmap v7708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:58:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:21 smithi057 ceph-mon[92072]: pgmap v7708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:58:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:21 smithi122 ceph-mon[125440]: pgmap v7708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:58:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:23 smithi136 ceph-mon[125702]: pgmap v7709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:58:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:23 smithi057 ceph-mon[92072]: pgmap v7709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:58:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:23 smithi122 ceph-mon[125440]: pgmap v7709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:58:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:25.428+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:58:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:25.428+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:58:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:25.428+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 113 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:58:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:25.429+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 114 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:58:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:25 smithi136 ceph-mon[125702]: pgmap v7710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:58:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:25 smithi057 ceph-mon[92072]: pgmap v7710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:58:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:25 smithi122 ceph-mon[125440]: pgmap v7710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:58:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:58:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:58:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:58:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:27 smithi136 ceph-mon[125702]: pgmap v7711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:58:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:58:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:58:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:58:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:27 smithi057 ceph-mon[92072]: pgmap v7711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:58:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:58:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:58:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:58:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:27 smithi122 ceph-mon[125440]: pgmap v7711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:58:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:58:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:58:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:58:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:28 smithi136 ceph-mon[125702]: pgmap v7712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:28 smithi057 ceph-mon[92072]: pgmap v7712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:28 smithi122 ceph-mon[125440]: pgmap v7712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:29.998+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:29.998+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:58:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:29.998+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:29.998+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:29.998+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:58:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:31 smithi136 ceph-mon[125702]: pgmap v7713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:31 smithi057 ceph-mon[92072]: pgmap v7713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:31 smithi122 ceph-mon[125440]: pgmap v7713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:33 smithi136 ceph-mon[125702]: pgmap v7714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:33 smithi057 ceph-mon[92072]: pgmap v7714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:33 smithi122 ceph-mon[125440]: pgmap v7714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:35 smithi136 ceph-mon[125702]: pgmap v7715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:35 smithi057 ceph-mon[92072]: pgmap v7715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:35 smithi122 ceph-mon[125440]: pgmap v7715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:37 smithi136 ceph-mon[125702]: pgmap v7716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:37 smithi057 ceph-mon[92072]: pgmap v7716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:37 smithi122 ceph-mon[125440]: pgmap v7716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:38 smithi136 ceph-mon[125702]: pgmap v7717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:38 smithi057 ceph-mon[92072]: pgmap v7717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:38 smithi122 ceph-mon[125440]: pgmap v7717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:41 smithi136 ceph-mon[125702]: pgmap v7718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:41 smithi057 ceph-mon[92072]: pgmap v7718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:41 smithi122 ceph-mon[125440]: pgmap v7718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:43 smithi136 ceph-mon[125702]: pgmap v7719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:43 smithi057 ceph-mon[92072]: pgmap v7719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:43 smithi122 ceph-mon[125440]: pgmap v7719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:45.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:58:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:45.010+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:58:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:45.010+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:58:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:45.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:58:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:58:45.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:58:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:45 smithi136 ceph-mon[125702]: pgmap v7720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:45 smithi057 ceph-mon[92072]: pgmap v7720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:45 smithi122 ceph-mon[125440]: pgmap v7720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:47 smithi057 ceph-mon[92072]: pgmap v7721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:47 smithi122 ceph-mon[125440]: pgmap v7721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:47 smithi136 ceph-mon[125702]: pgmap v7721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:48 smithi136 ceph-mon[125702]: pgmap v7722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:48 smithi057 ceph-mon[92072]: pgmap v7722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:48 smithi122 ceph-mon[125440]: pgmap v7722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:51 smithi136 ceph-mon[125702]: pgmap v7723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:51 smithi057 ceph-mon[92072]: pgmap v7723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:51 smithi122 ceph-mon[125440]: pgmap v7723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:53 smithi136 ceph-mon[125702]: pgmap v7724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:53 smithi057 ceph-mon[92072]: pgmap v7724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:53 smithi122 ceph-mon[125440]: pgmap v7724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:55 smithi136 ceph-mon[125702]: pgmap v7725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:55 smithi057 ceph-mon[92072]: pgmap v7725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:55 smithi122 ceph-mon[125440]: pgmap v7725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:57 smithi057 ceph-mon[92072]: pgmap v7726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:57 smithi122 ceph-mon[125440]: pgmap v7726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:57 smithi136 ceph-mon[125702]: pgmap v7726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:58:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:58:58 smithi136 ceph-mon[125702]: pgmap v7727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:58:58 smithi057 ceph-mon[92072]: pgmap v7727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:58:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:58:58 smithi122 ceph-mon[125440]: pgmap v7727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:00.026+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:59:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:00.026+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:59:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:00.026+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:59:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:00.026+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:59:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:00.027+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:59:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:01 smithi136 ceph-mon[125702]: pgmap v7728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:01 smithi057 ceph-mon[92072]: pgmap v7728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:01 smithi122 ceph-mon[125440]: pgmap v7728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:03 smithi136 ceph-mon[125702]: pgmap v7729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:59:04.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:03 smithi057 ceph-mon[92072]: pgmap v7729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:59:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:03 smithi122 ceph-mon[125440]: pgmap v7729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:59:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:05 smithi136 ceph-mon[125702]: pgmap v7730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:59:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:05 smithi057 ceph-mon[92072]: pgmap v7730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:59:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:05 smithi122 ceph-mon[125440]: pgmap v7730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T14:59:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:07 smithi136 ceph-mon[125702]: pgmap v7731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:59:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:07 smithi057 ceph-mon[92072]: pgmap v7731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:59:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:07 smithi122 ceph-mon[125440]: pgmap v7731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T14:59:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:08.398+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T14:59:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:08.398+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T14:59:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:08.398+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f58680329d0 tx=0x7f5870042000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:59:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:08.398+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f58680329d0 tx=0x7f5870042000 comp rx=0 tx=0).stop 2023-03-02T14:59:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:08.398+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T14:59:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:08.398+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 msgr2=0x7f586809c730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T14:59:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:08.398+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c360 0x7f586809c730 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T14:59:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:08.398+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T14:59:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:08.398+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:59:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:08.399+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f586809dfb0 tx=0x7f587005e070 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T14:59:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:08 smithi136 ceph-mon[125702]: pgmap v7732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:59:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:08 smithi057 ceph-mon[92072]: pgmap v7732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:59:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:08 smithi122 ceph-mon[125440]: pgmap v7732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T14:59:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:10.435+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:59:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:10.435+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:59:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:10.435+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 114 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T14:59:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:10.435+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 115 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T14:59:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:11 smithi136 ceph-mon[125702]: osdmap e555: 12 total, 12 up, 12 in 2023-03-02T14:59:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:11 smithi136 ceph-mon[125702]: pgmap v7734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:59:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:11 smithi057 ceph-mon[92072]: osdmap e555: 12 total, 12 up, 12 in 2023-03-02T14:59:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:11 smithi057 ceph-mon[92072]: pgmap v7734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:59:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:11 smithi122 ceph-mon[125440]: osdmap e555: 12 total, 12 up, 12 in 2023-03-02T14:59:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:11 smithi122 ceph-mon[125440]: pgmap v7734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T14:59:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:13 smithi136 ceph-mon[125702]: pgmap v7735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:59:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:13 smithi136 ceph-mon[125702]: osdmap e556: 12 total, 12 up, 12 in 2023-03-02T14:59:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:13 smithi057 ceph-mon[92072]: pgmap v7735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:59:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:13 smithi057 ceph-mon[92072]: osdmap e556: 12 total, 12 up, 12 in 2023-03-02T14:59:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:13 smithi122 ceph-mon[125440]: pgmap v7735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:59:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:13 smithi122 ceph-mon[125440]: osdmap e556: 12 total, 12 up, 12 in 2023-03-02T14:59:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:15.039+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:59:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:15.040+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:59:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:15.040+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:59:15.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:15.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:59:15.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:15.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:59:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:15 smithi136 ceph-mon[125702]: pgmap v7737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:59:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:15 smithi057 ceph-mon[92072]: pgmap v7737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:59:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:15 smithi122 ceph-mon[125440]: pgmap v7737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T14:59:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:17 smithi057 ceph-mon[92072]: pgmap v7738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:59:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:17 smithi122 ceph-mon[125440]: pgmap v7738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:59:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:17 smithi136 ceph-mon[125702]: pgmap v7738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T14:59:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:19 smithi136 ceph-mon[125702]: pgmap v7739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T14:59:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:19 smithi057 ceph-mon[92072]: pgmap v7739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T14:59:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:19 smithi122 ceph-mon[125440]: pgmap v7739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T14:59:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:21 smithi136 ceph-mon[125702]: pgmap v7740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:59:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:21 smithi057 ceph-mon[92072]: pgmap v7740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:59:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:21 smithi122 ceph-mon[125440]: pgmap v7740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T14:59:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:23 smithi136 ceph-mon[125702]: pgmap v7741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:59:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:23 smithi057 ceph-mon[92072]: pgmap v7741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:59:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:23 smithi122 ceph-mon[125440]: pgmap v7741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T14:59:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:25 smithi057 ceph-mon[92072]: pgmap v7742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:59:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:25 smithi122 ceph-mon[125440]: pgmap v7742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:59:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:25 smithi136 ceph-mon[125702]: pgmap v7742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T14:59:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:27 smithi057 ceph-mon[92072]: pgmap v7743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:59:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:59:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:59:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:59:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:59:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:27 smithi122 ceph-mon[125440]: pgmap v7743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:59:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:59:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:59:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:59:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:59:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:27 smithi136 ceph-mon[125702]: pgmap v7743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T14:59:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T14:59:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T14:59:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T14:59:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T14:59:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:28 smithi136 ceph-mon[125702]: pgmap v7744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:28 smithi057 ceph-mon[92072]: pgmap v7744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:28 smithi122 ceph-mon[125440]: pgmap v7744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:30.053+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:59:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:30.053+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:59:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:30.053+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:59:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:30.053+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:59:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:30.053+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:59:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:31 smithi136 ceph-mon[125702]: pgmap v7745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:31 smithi057 ceph-mon[92072]: pgmap v7745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:31 smithi122 ceph-mon[125440]: pgmap v7745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:33 smithi136 ceph-mon[125702]: pgmap v7746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:33 smithi057 ceph-mon[92072]: pgmap v7746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:33 smithi122 ceph-mon[125440]: pgmap v7746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:35 smithi057 ceph-mon[92072]: pgmap v7747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:35 smithi122 ceph-mon[125440]: pgmap v7747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:35 smithi136 ceph-mon[125702]: pgmap v7747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:37 smithi057 ceph-mon[92072]: pgmap v7748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:37 smithi122 ceph-mon[125440]: pgmap v7748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:37 smithi136 ceph-mon[125702]: pgmap v7748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:38 smithi136 ceph-mon[125702]: pgmap v7749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:38 smithi057 ceph-mon[92072]: pgmap v7749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:38 smithi122 ceph-mon[125440]: pgmap v7749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:41 smithi136 ceph-mon[125702]: pgmap v7750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:41 smithi057 ceph-mon[92072]: pgmap v7750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:41 smithi122 ceph-mon[125440]: pgmap v7750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:43 smithi136 ceph-mon[125702]: pgmap v7751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:43 smithi057 ceph-mon[92072]: pgmap v7751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:43 smithi122 ceph-mon[125440]: pgmap v7751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:45.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T14:59:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:45.059+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T14:59:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:45.059+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T14:59:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:45.059+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T14:59:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T14:59:45.059+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T14:59:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:45 smithi057 ceph-mon[92072]: pgmap v7752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:45 smithi122 ceph-mon[125440]: pgmap v7752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:45 smithi136 ceph-mon[125702]: pgmap v7752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:47 smithi057 ceph-mon[92072]: pgmap v7753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:47 smithi122 ceph-mon[125440]: pgmap v7753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:47 smithi136 ceph-mon[125702]: pgmap v7753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:49 smithi136 ceph-mon[125702]: pgmap v7754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:49 smithi057 ceph-mon[92072]: pgmap v7754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:49 smithi122 ceph-mon[125440]: pgmap v7754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:51 smithi136 ceph-mon[125702]: pgmap v7755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:51 smithi057 ceph-mon[92072]: pgmap v7755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:51 smithi122 ceph-mon[125440]: pgmap v7755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:53 smithi057 ceph-mon[92072]: pgmap v7756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:53 smithi122 ceph-mon[125440]: pgmap v7756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:53 smithi136 ceph-mon[125702]: pgmap v7756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:55 smithi057 ceph-mon[92072]: pgmap v7757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:55 smithi122 ceph-mon[125440]: pgmap v7757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:55 smithi136 ceph-mon[125702]: pgmap v7757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:58.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:57 smithi057 ceph-mon[92072]: pgmap v7758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:57 smithi122 ceph-mon[125440]: pgmap v7758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:57 smithi136 ceph-mon[125702]: pgmap v7758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T14:59:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 14:59:59 smithi136 ceph-mon[125702]: pgmap v7759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 14:59:59 smithi057 ceph-mon[92072]: pgmap v7759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T14:59:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 14:59:59 smithi122 ceph-mon[125440]: pgmap v7759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:00.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:00:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:00.069+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:00:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:00.069+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:00:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:00.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:00:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:00.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:00:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T15:00:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T15:00:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T15:00:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:01 smithi136 ceph-mon[125702]: pgmap v7760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:01 smithi057 ceph-mon[92072]: pgmap v7760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:01.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:01 smithi122 ceph-mon[125440]: pgmap v7760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:03 smithi057 ceph-mon[92072]: pgmap v7761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:00:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:03 smithi122 ceph-mon[125440]: pgmap v7761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:00:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:03 smithi136 ceph-mon[125702]: pgmap v7761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:00:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:05 smithi057 ceph-mon[92072]: pgmap v7762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:00:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:05 smithi122 ceph-mon[125440]: pgmap v7762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:00:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:05 smithi136 ceph-mon[125702]: pgmap v7762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:00:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:06 smithi057 ceph-mon[92072]: osdmap e557: 12 total, 12 up, 12 in 2023-03-02T15:00:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:06 smithi122 ceph-mon[125440]: osdmap e557: 12 total, 12 up, 12 in 2023-03-02T15:00:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:06 smithi136 ceph-mon[125702]: osdmap e557: 12 total, 12 up, 12 in 2023-03-02T15:00:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:07 smithi057 ceph-mon[92072]: pgmap v7764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:00:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:07 smithi122 ceph-mon[125440]: pgmap v7764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:00:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:07 smithi136 ceph-mon[125702]: pgmap v7764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:00:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:09 smithi136 ceph-mon[125702]: osdmap e558: 12 total, 12 up, 12 in 2023-03-02T15:00:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:09 smithi136 ceph-mon[125702]: pgmap v7766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:00:09.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:09 smithi057 ceph-mon[92072]: osdmap e558: 12 total, 12 up, 12 in 2023-03-02T15:00:09.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:09 smithi057 ceph-mon[92072]: pgmap v7766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:00:09.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:09 smithi122 ceph-mon[125440]: osdmap e558: 12 total, 12 up, 12 in 2023-03-02T15:00:09.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:09 smithi122 ceph-mon[125440]: pgmap v7766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:00:12.097 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:11 smithi057 ceph-mon[92072]: pgmap v7767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:00:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:11 smithi122 ceph-mon[125440]: pgmap v7767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:00:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:11 smithi136 ceph-mon[125702]: pgmap v7767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:00:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:13 smithi057 ceph-mon[92072]: pgmap v7768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:00:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:13 smithi122 ceph-mon[125440]: pgmap v7768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:00:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:13 smithi136 ceph-mon[125702]: pgmap v7768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:00:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:15.085+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:00:15.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:15.085+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:00:15.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:15.085+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:00:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:15.085+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:00:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:15.085+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:00:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:15 smithi057 ceph-mon[92072]: pgmap v7769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:00:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:15 smithi122 ceph-mon[125440]: pgmap v7769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:00:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:15 smithi136 ceph-mon[125702]: pgmap v7769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:00:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:17 smithi057 ceph-mon[92072]: pgmap v7770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:00:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:17 smithi122 ceph-mon[125440]: pgmap v7770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:00:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:17 smithi136 ceph-mon[125702]: pgmap v7770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:00:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:19 smithi136 ceph-mon[125702]: pgmap v7771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:00:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:19 smithi057 ceph-mon[92072]: pgmap v7771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:00:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:19 smithi122 ceph-mon[125440]: pgmap v7771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:00:22.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:21 smithi057 ceph-mon[92072]: pgmap v7772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:00:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:21 smithi122 ceph-mon[125440]: pgmap v7772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:00:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:21 smithi136 ceph-mon[125702]: pgmap v7772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:00:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:23 smithi057 ceph-mon[92072]: pgmap v7773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:00:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:23 smithi122 ceph-mon[125440]: pgmap v7773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:00:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:23 smithi136 ceph-mon[125702]: pgmap v7773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:00:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:25 smithi057 ceph-mon[92072]: pgmap v7774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:25 smithi122 ceph-mon[125440]: pgmap v7774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:25 smithi136 ceph-mon[125702]: pgmap v7774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:27 smithi057 ceph-mon[92072]: pgmap v7775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:27 smithi122 ceph-mon[125440]: pgmap v7775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:27 smithi136 ceph-mon[125702]: pgmap v7775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:00:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:00:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:00:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:30.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:00:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:30.101+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:00:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:30.101+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:00:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:30.101+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:00:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:30.101+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:00:30.121 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:29 smithi057 ceph-mon[92072]: pgmap v7776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:30.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:29 smithi122 ceph-mon[125440]: pgmap v7776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:29 smithi136 ceph-mon[125702]: pgmap v7776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:31 smithi057 ceph-mon[92072]: pgmap v7777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:31 smithi122 ceph-mon[125440]: pgmap v7777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:31 smithi136 ceph-mon[125702]: pgmap v7777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:00:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:00:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:00:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:00:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:00:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:32 smithi136 ceph-mon[125702]: pgmap v7778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:00:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:00:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:00:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:00:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:00:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:32 smithi057 ceph-mon[92072]: pgmap v7778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:00:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:00:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:00:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:00:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:00:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:32 smithi122 ceph-mon[125440]: pgmap v7778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:35 smithi057 ceph-mon[92072]: pgmap v7779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:35 smithi122 ceph-mon[125440]: pgmap v7779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:35 smithi136 ceph-mon[125702]: pgmap v7779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:37 smithi057 ceph-mon[92072]: pgmap v7780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:37 smithi122 ceph-mon[125440]: pgmap v7780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:37 smithi136 ceph-mon[125702]: pgmap v7780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:39 smithi136 ceph-mon[125702]: pgmap v7781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:39 smithi057 ceph-mon[92072]: pgmap v7781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:39 smithi122 ceph-mon[125440]: pgmap v7781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:41 smithi057 ceph-mon[92072]: pgmap v7782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:41 smithi122 ceph-mon[125440]: pgmap v7782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:41 smithi136 ceph-mon[125702]: pgmap v7782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:43 smithi057 ceph-mon[92072]: pgmap v7783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:43 smithi122 ceph-mon[125440]: pgmap v7783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:43 smithi136 ceph-mon[125702]: pgmap v7783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:45.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:00:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:45.116+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:00:45.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:45.116+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:00:45.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:45.116+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:00:45.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:00:45.116+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:00:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:45 smithi057 ceph-mon[92072]: pgmap v7784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:45 smithi122 ceph-mon[125440]: pgmap v7784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:45 smithi136 ceph-mon[125702]: pgmap v7784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:47 smithi057 ceph-mon[92072]: pgmap v7785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:47 smithi122 ceph-mon[125440]: pgmap v7785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:47 smithi136 ceph-mon[125702]: pgmap v7785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:49 smithi136 ceph-mon[125702]: pgmap v7786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:49 smithi057 ceph-mon[92072]: pgmap v7786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:49 smithi122 ceph-mon[125440]: pgmap v7786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:51 smithi057 ceph-mon[92072]: pgmap v7787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:51 smithi122 ceph-mon[125440]: pgmap v7787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:51 smithi136 ceph-mon[125702]: pgmap v7787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:53 smithi057 ceph-mon[92072]: pgmap v7788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:53 smithi122 ceph-mon[125440]: pgmap v7788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:53 smithi136 ceph-mon[125702]: pgmap v7788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:55 smithi057 ceph-mon[92072]: pgmap v7789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:55 smithi122 ceph-mon[125440]: pgmap v7789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:55 smithi136 ceph-mon[125702]: pgmap v7789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:57 smithi057 ceph-mon[92072]: pgmap v7790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:57 smithi122 ceph-mon[125440]: pgmap v7790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:57 smithi136 ceph-mon[125702]: pgmap v7790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:00:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:00:59 smithi136 ceph-mon[125702]: pgmap v7791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:00:59 smithi057 ceph-mon[92072]: pgmap v7791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:00:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:00:59 smithi122 ceph-mon[125440]: pgmap v7791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:00.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:00.128+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:00.128+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:01:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:00.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:01:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:00.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:01:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:01 smithi136 ceph-mon[125702]: pgmap v7792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:01 smithi057 ceph-mon[92072]: pgmap v7792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:01 smithi122 ceph-mon[125440]: pgmap v7792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:03 smithi057 ceph-mon[92072]: pgmap v7793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:01:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:03 smithi122 ceph-mon[125440]: pgmap v7793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:01:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:03 smithi136 ceph-mon[125702]: pgmap v7793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:01:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:05 smithi057 ceph-mon[92072]: pgmap v7794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:01:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:05 smithi122 ceph-mon[125440]: pgmap v7794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:01:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:05 smithi136 ceph-mon[125702]: pgmap v7794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:01:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:06 smithi057 ceph-mon[92072]: osdmap e559: 12 total, 12 up, 12 in 2023-03-02T15:01:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:06 smithi122 ceph-mon[125440]: osdmap e559: 12 total, 12 up, 12 in 2023-03-02T15:01:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:06 smithi136 ceph-mon[125702]: osdmap e559: 12 total, 12 up, 12 in 2023-03-02T15:01:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:07 smithi057 ceph-mon[92072]: pgmap v7796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:01:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:07 smithi122 ceph-mon[125440]: pgmap v7796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:01:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:07 smithi136 ceph-mon[125702]: pgmap v7796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:01:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:09 smithi136 ceph-mon[125702]: pgmap v7797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:01:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:09 smithi057 ceph-mon[92072]: pgmap v7797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:01:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:09 smithi122 ceph-mon[125440]: pgmap v7797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:01:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:11 smithi057 ceph-mon[92072]: pgmap v7798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:01:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:11 smithi122 ceph-mon[125440]: pgmap v7798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:01:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:11 smithi136 ceph-mon[125702]: pgmap v7798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:01:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:13 smithi057 ceph-mon[92072]: pgmap v7799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:01:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:13 smithi057 ceph-mon[92072]: osdmap e560: 12 total, 12 up, 12 in 2023-03-02T15:01:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:13 smithi122 ceph-mon[125440]: pgmap v7799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:01:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:13 smithi122 ceph-mon[125440]: osdmap e560: 12 total, 12 up, 12 in 2023-03-02T15:01:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:13 smithi136 ceph-mon[125702]: pgmap v7799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:01:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:13 smithi136 ceph-mon[125702]: osdmap e560: 12 total, 12 up, 12 in 2023-03-02T15:01:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:15.144+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:01:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:15.144+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:01:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:15.144+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:01:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:15.144+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:01:15.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:15.144+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:01:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:15 smithi057 ceph-mon[92072]: pgmap v7801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:01:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:15 smithi122 ceph-mon[125440]: pgmap v7801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:01:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:15 smithi136 ceph-mon[125702]: pgmap v7801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:01:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:17 smithi057 ceph-mon[92072]: pgmap v7802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:01:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:17 smithi122 ceph-mon[125440]: pgmap v7802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:01:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:17 smithi136 ceph-mon[125702]: pgmap v7802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:01:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:19 smithi136 ceph-mon[125702]: pgmap v7803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:01:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:19 smithi057 ceph-mon[92072]: pgmap v7803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:01:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:19 smithi122 ceph-mon[125440]: pgmap v7803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:01:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:21 smithi057 ceph-mon[92072]: pgmap v7804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:01:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:21 smithi122 ceph-mon[125440]: pgmap v7804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:01:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:21 smithi136 ceph-mon[125702]: pgmap v7804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:01:24.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:23 smithi057 ceph-mon[92072]: pgmap v7805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:01:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:23 smithi122 ceph-mon[125440]: pgmap v7805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:01:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:23 smithi136 ceph-mon[125702]: pgmap v7805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:01:26.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:25 smithi057 ceph-mon[92072]: pgmap v7806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:25 smithi122 ceph-mon[125440]: pgmap v7806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:25 smithi136 ceph-mon[125702]: pgmap v7806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:27 smithi057 ceph-mon[92072]: pgmap v7807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:27 smithi122 ceph-mon[125440]: pgmap v7807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:27 smithi136 ceph-mon[125702]: pgmap v7807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:29 smithi136 ceph-mon[125702]: pgmap v7808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:29 smithi057 ceph-mon[92072]: pgmap v7808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:29 smithi122 ceph-mon[125440]: pgmap v7808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:30.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:01:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:30.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:01:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:30.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:01:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:30.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:01:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:30.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:01:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:31 smithi057 ceph-mon[92072]: pgmap v7809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:31 smithi122 ceph-mon[125440]: pgmap v7809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:31 smithi136 ceph-mon[125702]: pgmap v7809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:01:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:01:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:01:34.058 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:33 smithi122 ceph-mon[125440]: pgmap v7810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:33 smithi057 ceph-mon[92072]: pgmap v7810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:33 smithi136 ceph-mon[125702]: pgmap v7810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:35 smithi136 ceph-mon[125702]: pgmap v7811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:35 smithi057 ceph-mon[92072]: pgmap v7811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:35 smithi122 ceph-mon[125440]: pgmap v7811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:37 smithi057 ceph-mon[92072]: pgmap v7812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:37 smithi122 ceph-mon[125440]: pgmap v7812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:37.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:37 smithi136 ceph-mon[125702]: pgmap v7812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:01:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:01:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:39 smithi122 ceph-mon[125440]: pgmap v7813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:01:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:01:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:39.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:39 smithi136 ceph-mon[125702]: pgmap v7813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:01:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:01:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:01:39.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:39 smithi057 ceph-mon[92072]: pgmap v7813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:41 smithi057 ceph-mon[92072]: pgmap v7814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:41 smithi122 ceph-mon[125440]: pgmap v7814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:41 smithi136 ceph-mon[125702]: pgmap v7814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:43 smithi057 ceph-mon[92072]: pgmap v7815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:43 smithi122 ceph-mon[125440]: pgmap v7815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:43 smithi136 ceph-mon[125702]: pgmap v7815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:45.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:45.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:01:45.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:45.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:01:45.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:45.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:01:45.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:45.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:01:45.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:01:45.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:01:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:45 smithi057 ceph-mon[92072]: pgmap v7816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:45 smithi122 ceph-mon[125440]: pgmap v7816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:45 smithi136 ceph-mon[125702]: pgmap v7816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:47 smithi057 ceph-mon[92072]: pgmap v7817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:47 smithi122 ceph-mon[125440]: pgmap v7817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:47 smithi136 ceph-mon[125702]: pgmap v7817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:49 smithi136 ceph-mon[125702]: pgmap v7818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:49 smithi057 ceph-mon[92072]: pgmap v7818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:49 smithi122 ceph-mon[125440]: pgmap v7818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:51 smithi057 ceph-mon[92072]: pgmap v7819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:51 smithi122 ceph-mon[125440]: pgmap v7819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:51 smithi136 ceph-mon[125702]: pgmap v7819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:53 smithi057 ceph-mon[92072]: pgmap v7820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:53 smithi122 ceph-mon[125440]: pgmap v7820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:53 smithi136 ceph-mon[125702]: pgmap v7820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:55 smithi057 ceph-mon[92072]: pgmap v7821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:55 smithi122 ceph-mon[125440]: pgmap v7821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:55 smithi136 ceph-mon[125702]: pgmap v7821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:57 smithi057 ceph-mon[92072]: pgmap v7822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:58.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:57 smithi122 ceph-mon[125440]: pgmap v7822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:57 smithi136 ceph-mon[125702]: pgmap v7822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:01:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:01:59 smithi136 ceph-mon[125702]: pgmap v7823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:01:59 smithi057 ceph-mon[92072]: pgmap v7823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:01:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:01:59 smithi122 ceph-mon[125440]: pgmap v7823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:00.175+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:02:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:00.175+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:02:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:00.175+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:02:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:00.175+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:02:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:00.175+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:02:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:01 smithi057 ceph-mon[92072]: pgmap v7824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:01 smithi122 ceph-mon[125440]: pgmap v7824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:01 smithi136 ceph-mon[125702]: pgmap v7824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:03 smithi057 ceph-mon[92072]: pgmap v7825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:02:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:03 smithi122 ceph-mon[125440]: pgmap v7825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:02:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:03 smithi136 ceph-mon[125702]: pgmap v7825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:02:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:05 smithi057 ceph-mon[92072]: pgmap v7826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:02:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:05 smithi122 ceph-mon[125440]: pgmap v7826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:02:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:05 smithi136 ceph-mon[125702]: pgmap v7826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:02:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:06 smithi057 ceph-mon[92072]: osdmap e561: 12 total, 12 up, 12 in 2023-03-02T15:02:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:06 smithi122 ceph-mon[125440]: osdmap e561: 12 total, 12 up, 12 in 2023-03-02T15:02:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:06 smithi136 ceph-mon[125702]: osdmap e561: 12 total, 12 up, 12 in 2023-03-02T15:02:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:07 smithi057 ceph-mon[92072]: pgmap v7828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:02:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:07 smithi122 ceph-mon[125440]: pgmap v7828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:02:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:07 smithi136 ceph-mon[125702]: pgmap v7828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:02:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:09 smithi136 ceph-mon[125702]: osdmap e562: 12 total, 12 up, 12 in 2023-03-02T15:02:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:09 smithi136 ceph-mon[125702]: pgmap v7830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:02:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:09 smithi057 ceph-mon[92072]: osdmap e562: 12 total, 12 up, 12 in 2023-03-02T15:02:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:09 smithi057 ceph-mon[92072]: pgmap v7830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:02:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:09 smithi122 ceph-mon[125440]: osdmap e562: 12 total, 12 up, 12 in 2023-03-02T15:02:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:09 smithi122 ceph-mon[125440]: pgmap v7830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:02:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:10.461+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:02:10.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:10.461+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:02:10.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:10.461+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 116 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:02:10.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:10.461+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 115 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:02:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:11 smithi057 ceph-mon[92072]: pgmap v7831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:02:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:11 smithi122 ceph-mon[125440]: pgmap v7831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:02:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:11 smithi136 ceph-mon[125702]: pgmap v7831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:02:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:13 smithi057 ceph-mon[92072]: pgmap v7832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:02:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:13 smithi122 ceph-mon[125440]: pgmap v7832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:02:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:13 smithi136 ceph-mon[125702]: pgmap v7832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:02:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:15.182+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:02:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:15.182+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:02:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:15.182+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:02:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:15.182+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:02:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:15.182+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:02:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:15 smithi057 ceph-mon[92072]: pgmap v7833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:02:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:15 smithi122 ceph-mon[125440]: pgmap v7833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:02:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:15 smithi136 ceph-mon[125702]: pgmap v7833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:02:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:17 smithi057 ceph-mon[92072]: pgmap v7834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:02:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:17 smithi122 ceph-mon[125440]: pgmap v7834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:02:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:17 smithi136 ceph-mon[125702]: pgmap v7834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:02:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:19 smithi136 ceph-mon[125702]: pgmap v7835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:02:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:19 smithi057 ceph-mon[92072]: pgmap v7835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:02:19.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:19 smithi122 ceph-mon[125440]: pgmap v7835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:02:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:21 smithi057 ceph-mon[92072]: pgmap v7836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:02:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:21 smithi122 ceph-mon[125440]: pgmap v7836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:02:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:21 smithi136 ceph-mon[125702]: pgmap v7836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:02:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:23 smithi057 ceph-mon[92072]: pgmap v7837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:02:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:23 smithi122 ceph-mon[125440]: pgmap v7837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:02:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:23 smithi136 ceph-mon[125702]: pgmap v7837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:02:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:25 smithi057 ceph-mon[92072]: pgmap v7838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:25 smithi122 ceph-mon[125440]: pgmap v7838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:25 smithi136 ceph-mon[125702]: pgmap v7838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:27 smithi057 ceph-mon[92072]: pgmap v7839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:27 smithi122 ceph-mon[125440]: pgmap v7839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:27 smithi136 ceph-mon[125702]: pgmap v7839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:29 smithi136 ceph-mon[125702]: pgmap v7840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:29 smithi057 ceph-mon[92072]: pgmap v7840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:29 smithi122 ceph-mon[125440]: pgmap v7840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:30.195+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:02:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:30.196+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:02:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:30.196+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:02:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:30.196+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:02:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:30.196+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:02:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:31 smithi057 ceph-mon[92072]: pgmap v7841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:31 smithi122 ceph-mon[125440]: pgmap v7841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:31 smithi136 ceph-mon[125702]: pgmap v7841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:33 smithi057 ceph-mon[92072]: pgmap v7842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:33 smithi122 ceph-mon[125440]: pgmap v7842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:33 smithi136 ceph-mon[125702]: pgmap v7842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:35 smithi057 ceph-mon[92072]: pgmap v7843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:35 smithi122 ceph-mon[125440]: pgmap v7843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:35 smithi136 ceph-mon[125702]: pgmap v7843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:37 smithi057 ceph-mon[92072]: pgmap v7844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:37 smithi122 ceph-mon[125440]: pgmap v7844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:37 smithi136 ceph-mon[125702]: pgmap v7844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:02:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:39 smithi136 ceph-mon[125702]: pgmap v7845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:02:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:39 smithi057 ceph-mon[92072]: pgmap v7845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:02:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:39 smithi122 ceph-mon[125440]: pgmap v7845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:02:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:02:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:02:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:02:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:02:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:02:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:02:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:02:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:02:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:41 smithi136 ceph-mon[125702]: pgmap v7846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:41 smithi057 ceph-mon[92072]: pgmap v7846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:41.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:41 smithi122 ceph-mon[125440]: pgmap v7846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:43 smithi057 ceph-mon[92072]: pgmap v7847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:43 smithi122 ceph-mon[125440]: pgmap v7847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:43 smithi136 ceph-mon[125702]: pgmap v7847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:45.207+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:02:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:45.208+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:02:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:45.208+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:02:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:45.208+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:02:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:02:45.208+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:02:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:45 smithi057 ceph-mon[92072]: pgmap v7848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:45 smithi122 ceph-mon[125440]: pgmap v7848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:45 smithi136 ceph-mon[125702]: pgmap v7848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:48.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:47 smithi057 ceph-mon[92072]: pgmap v7849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:47 smithi122 ceph-mon[125440]: pgmap v7849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:47 smithi136 ceph-mon[125702]: pgmap v7849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:49 smithi136 ceph-mon[125702]: pgmap v7850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:49 smithi057 ceph-mon[92072]: pgmap v7850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:49 smithi122 ceph-mon[125440]: pgmap v7850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:51 smithi057 ceph-mon[92072]: pgmap v7851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:51 smithi122 ceph-mon[125440]: pgmap v7851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:51 smithi136 ceph-mon[125702]: pgmap v7851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:02:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:53 smithi057 ceph-mon[92072]: pgmap v7852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:53 smithi122 ceph-mon[125440]: pgmap v7852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:53 smithi136 ceph-mon[125702]: pgmap v7852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:55 smithi057 ceph-mon[92072]: pgmap v7853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:55 smithi122 ceph-mon[125440]: pgmap v7853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:56.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:55 smithi136 ceph-mon[125702]: pgmap v7853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:57 smithi057 ceph-mon[92072]: pgmap v7854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:57 smithi122 ceph-mon[125440]: pgmap v7854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:57 smithi136 ceph-mon[125702]: pgmap v7854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:02:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:02:59 smithi136 ceph-mon[125702]: pgmap v7855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:02:59 smithi057 ceph-mon[92072]: pgmap v7855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:02:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:02:59 smithi122 ceph-mon[125440]: pgmap v7855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:00.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:03:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:00.223+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:03:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:00.223+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:03:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:00.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:03:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:00.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:03:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:01 smithi057 ceph-mon[92072]: pgmap v7856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:01 smithi122 ceph-mon[125440]: pgmap v7856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:01 smithi136 ceph-mon[125702]: pgmap v7856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:03 smithi057 ceph-mon[92072]: pgmap v7857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:03:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:03 smithi122 ceph-mon[125440]: pgmap v7857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:03:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:03 smithi136 ceph-mon[125702]: pgmap v7857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:03:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:05 smithi057 ceph-mon[92072]: pgmap v7858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:03:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:05 smithi122 ceph-mon[125440]: pgmap v7858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:03:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:05 smithi136 ceph-mon[125702]: pgmap v7858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:03:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:07 smithi057 ceph-mon[92072]: pgmap v7859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:03:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:07 smithi122 ceph-mon[125440]: pgmap v7859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:03:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:07 smithi136 ceph-mon[125702]: pgmap v7859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:03:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:09 smithi136 ceph-mon[125702]: pgmap v7860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:03:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:09 smithi057 ceph-mon[92072]: pgmap v7860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:03:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:09 smithi122 ceph-mon[125440]: pgmap v7860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:03:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:11 smithi136 ceph-mon[125702]: osdmap e563: 12 total, 12 up, 12 in 2023-03-02T15:03:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:11 smithi136 ceph-mon[125702]: pgmap v7862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:03:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:11 smithi057 ceph-mon[92072]: osdmap e563: 12 total, 12 up, 12 in 2023-03-02T15:03:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:11 smithi057 ceph-mon[92072]: pgmap v7862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:03:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:11 smithi122 ceph-mon[125440]: osdmap e563: 12 total, 12 up, 12 in 2023-03-02T15:03:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:11 smithi122 ceph-mon[125440]: pgmap v7862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:03:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:13 smithi057 ceph-mon[92072]: pgmap v7863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:03:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:13 smithi057 ceph-mon[92072]: osdmap e564: 12 total, 12 up, 12 in 2023-03-02T15:03:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:13 smithi122 ceph-mon[125440]: pgmap v7863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:03:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:13 smithi122 ceph-mon[125440]: osdmap e564: 12 total, 12 up, 12 in 2023-03-02T15:03:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:13 smithi136 ceph-mon[125702]: pgmap v7863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:03:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:13 smithi136 ceph-mon[125702]: osdmap e564: 12 total, 12 up, 12 in 2023-03-02T15:03:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:15.238+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:03:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:15.239+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:03:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:15.239+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:03:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:15.239+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:03:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:15.239+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:03:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:15 smithi057 ceph-mon[92072]: pgmap v7865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:03:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:15 smithi122 ceph-mon[125440]: pgmap v7865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:03:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:15 smithi136 ceph-mon[125702]: pgmap v7865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:03:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:17 smithi057 ceph-mon[92072]: pgmap v7866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T15:03:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:17 smithi122 ceph-mon[125440]: pgmap v7866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T15:03:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:17 smithi136 ceph-mon[125702]: pgmap v7866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T15:03:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:19 smithi136 ceph-mon[125702]: pgmap v7867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 368 B/s wr, 12 op/s 2023-03-02T15:03:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:19 smithi057 ceph-mon[92072]: pgmap v7867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 368 B/s wr, 12 op/s 2023-03-02T15:03:19.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:19 smithi122 ceph-mon[125440]: pgmap v7867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 368 B/s wr, 12 op/s 2023-03-02T15:03:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:21 smithi057 ceph-mon[92072]: pgmap v7868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:03:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:21 smithi122 ceph-mon[125440]: pgmap v7868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:03:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:21 smithi136 ceph-mon[125702]: pgmap v7868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:03:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:23 smithi057 ceph-mon[92072]: pgmap v7869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:03:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:23 smithi122 ceph-mon[125440]: pgmap v7869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:03:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:23 smithi136 ceph-mon[125702]: pgmap v7869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:03:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:25 smithi057 ceph-mon[92072]: pgmap v7870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T15:03:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:25 smithi122 ceph-mon[125440]: pgmap v7870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T15:03:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:25 smithi136 ceph-mon[125702]: pgmap v7870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T15:03:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:27 smithi057 ceph-mon[92072]: pgmap v7871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T15:03:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:27 smithi122 ceph-mon[125440]: pgmap v7871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T15:03:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:27 smithi136 ceph-mon[125702]: pgmap v7871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T15:03:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:29 smithi136 ceph-mon[125702]: pgmap v7872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:29 smithi057 ceph-mon[92072]: pgmap v7872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:29 smithi122 ceph-mon[125440]: pgmap v7872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:30.243+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:03:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:30.243+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:03:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:30.243+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:03:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:30.243+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:03:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:30.243+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:03:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:31 smithi057 ceph-mon[92072]: pgmap v7873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:31 smithi122 ceph-mon[125440]: pgmap v7873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:31 smithi136 ceph-mon[125702]: pgmap v7873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:33 smithi057 ceph-mon[92072]: pgmap v7874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:33 smithi122 ceph-mon[125440]: pgmap v7874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:33 smithi136 ceph-mon[125702]: pgmap v7874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:35 smithi057 ceph-mon[92072]: pgmap v7875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:35 smithi122 ceph-mon[125440]: pgmap v7875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:35 smithi136 ceph-mon[125702]: pgmap v7875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:37 smithi057 ceph-mon[92072]: pgmap v7876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:37 smithi122 ceph-mon[125440]: pgmap v7876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:37 smithi136 ceph-mon[125702]: pgmap v7876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:39 smithi136 ceph-mon[125702]: pgmap v7877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:39 smithi057 ceph-mon[92072]: pgmap v7877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:39 smithi122 ceph-mon[125440]: pgmap v7877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:03:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:03:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:03:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:03:41.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:03:41.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:41 smithi057 ceph-mon[92072]: pgmap v7878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:03:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:03:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:41 smithi122 ceph-mon[125440]: pgmap v7878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:03:41.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:03:41.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:03:41.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:41 smithi136 ceph-mon[125702]: pgmap v7878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:43 smithi057 ceph-mon[92072]: pgmap v7879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:44.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:43 smithi122 ceph-mon[125440]: pgmap v7879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:43 smithi136 ceph-mon[125702]: pgmap v7879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:45.249+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:03:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:45.250+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:03:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:45.250+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:03:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:45.250+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:03:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:03:45.250+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:03:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:45 smithi057 ceph-mon[92072]: pgmap v7880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:45 smithi122 ceph-mon[125440]: pgmap v7880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:45 smithi136 ceph-mon[125702]: pgmap v7880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:47 smithi057 ceph-mon[92072]: pgmap v7881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:47 smithi122 ceph-mon[125440]: pgmap v7881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:47 smithi136 ceph-mon[125702]: pgmap v7881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:49.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:49 smithi136 ceph-mon[125702]: pgmap v7882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:49 smithi057 ceph-mon[92072]: pgmap v7882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:49 smithi122 ceph-mon[125440]: pgmap v7882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:51 smithi057 ceph-mon[92072]: pgmap v7883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:51 smithi122 ceph-mon[125440]: pgmap v7883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:51 smithi136 ceph-mon[125702]: pgmap v7883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:53 smithi057 ceph-mon[92072]: pgmap v7884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:53 smithi122 ceph-mon[125440]: pgmap v7884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:53 smithi136 ceph-mon[125702]: pgmap v7884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:55 smithi057 ceph-mon[92072]: pgmap v7885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:55 smithi122 ceph-mon[125440]: pgmap v7885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:55 smithi136 ceph-mon[125702]: pgmap v7885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:57 smithi122 ceph-mon[125440]: pgmap v7886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:57 smithi136 ceph-mon[125702]: pgmap v7886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:57 smithi057 ceph-mon[92072]: pgmap v7886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:03:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:03:59 smithi136 ceph-mon[125702]: pgmap v7887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:03:59 smithi057 ceph-mon[92072]: pgmap v7887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:03:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:03:59 smithi122 ceph-mon[125440]: pgmap v7887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:00.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:00.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:04:00.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:00.260+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:04:00.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:00.260+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:04:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:00.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:04:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:00.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:04:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:01 smithi057 ceph-mon[92072]: pgmap v7888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:01 smithi122 ceph-mon[125440]: pgmap v7888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:01 smithi136 ceph-mon[125702]: pgmap v7888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:04.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:03 smithi057 ceph-mon[92072]: pgmap v7889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:04:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:03 smithi122 ceph-mon[125440]: pgmap v7889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:04:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:03 smithi136 ceph-mon[125702]: pgmap v7889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:04:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:05 smithi057 ceph-mon[92072]: pgmap v7890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:04:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:05 smithi122 ceph-mon[125440]: pgmap v7890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:04:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:05 smithi136 ceph-mon[125702]: pgmap v7890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:04:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:07 smithi057 ceph-mon[92072]: pgmap v7891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:04:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:07 smithi122 ceph-mon[125440]: pgmap v7891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:04:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:07 smithi136 ceph-mon[125702]: pgmap v7891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:04:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:09 smithi136 ceph-mon[125702]: pgmap v7892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:04:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:09 smithi057 ceph-mon[92072]: pgmap v7892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:04:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:09 smithi122 ceph-mon[125440]: pgmap v7892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:04:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:11 smithi136 ceph-mon[125702]: osdmap e565: 12 total, 12 up, 12 in 2023-03-02T15:04:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:11 smithi136 ceph-mon[125702]: pgmap v7894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:04:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:11 smithi057 ceph-mon[92072]: osdmap e565: 12 total, 12 up, 12 in 2023-03-02T15:04:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:11 smithi057 ceph-mon[92072]: pgmap v7894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:04:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:11 smithi122 ceph-mon[125440]: osdmap e565: 12 total, 12 up, 12 in 2023-03-02T15:04:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:11 smithi122 ceph-mon[125440]: pgmap v7894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:04:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:13 smithi057 ceph-mon[92072]: pgmap v7895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:04:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:13 smithi057 ceph-mon[92072]: osdmap e566: 12 total, 12 up, 12 in 2023-03-02T15:04:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:13 smithi122 ceph-mon[125440]: pgmap v7895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:04:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:13 smithi122 ceph-mon[125440]: osdmap e566: 12 total, 12 up, 12 in 2023-03-02T15:04:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:13 smithi136 ceph-mon[125702]: pgmap v7895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:04:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:13 smithi136 ceph-mon[125702]: osdmap e566: 12 total, 12 up, 12 in 2023-03-02T15:04:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:15.273+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:04:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:15.273+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:04:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:15.273+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:04:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:15.273+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:04:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:15.273+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:04:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:15 smithi057 ceph-mon[92072]: pgmap v7897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:04:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:15 smithi122 ceph-mon[125440]: pgmap v7897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:04:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:15 smithi136 ceph-mon[125702]: pgmap v7897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:04:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:17 smithi057 ceph-mon[92072]: pgmap v7898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:04:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:17 smithi122 ceph-mon[125440]: pgmap v7898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:04:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:17 smithi136 ceph-mon[125702]: pgmap v7898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:04:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:19 smithi136 ceph-mon[125702]: pgmap v7899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T15:04:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:19 smithi057 ceph-mon[92072]: pgmap v7899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T15:04:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:19 smithi122 ceph-mon[125440]: pgmap v7899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T15:04:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:21 smithi057 ceph-mon[92072]: pgmap v7900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:04:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:21 smithi122 ceph-mon[125440]: pgmap v7900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:04:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:21 smithi136 ceph-mon[125702]: pgmap v7900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:04:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:23 smithi057 ceph-mon[92072]: pgmap v7901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:04:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:23 smithi122 ceph-mon[125440]: pgmap v7901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:04:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:23 smithi136 ceph-mon[125702]: pgmap v7901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:04:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:25 smithi122 ceph-mon[125440]: pgmap v7902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:04:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:25 smithi136 ceph-mon[125702]: pgmap v7902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:04:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:25 smithi057 ceph-mon[92072]: pgmap v7902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:04:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:27 smithi122 ceph-mon[125440]: pgmap v7903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:04:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:27 smithi136 ceph-mon[125702]: pgmap v7903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:04:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:27 smithi057 ceph-mon[92072]: pgmap v7903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:04:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:29 smithi136 ceph-mon[125702]: pgmap v7904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:29 smithi057 ceph-mon[92072]: pgmap v7904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:29 smithi122 ceph-mon[125440]: pgmap v7904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:30.277+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:04:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:30.277+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:04:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:30.277+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:04:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:30.277+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:04:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:30.277+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:04:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:31 smithi057 ceph-mon[92072]: pgmap v7905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:31 smithi122 ceph-mon[125440]: pgmap v7905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:31 smithi136 ceph-mon[125702]: pgmap v7905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:33 smithi057 ceph-mon[92072]: pgmap v7906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:33 smithi122 ceph-mon[125440]: pgmap v7906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:33 smithi136 ceph-mon[125702]: pgmap v7906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:35 smithi057 ceph-mon[92072]: pgmap v7907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:35 smithi122 ceph-mon[125440]: pgmap v7907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:35 smithi136 ceph-mon[125702]: pgmap v7907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:37 smithi057 ceph-mon[92072]: pgmap v7908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:37 smithi122 ceph-mon[125440]: pgmap v7908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:37 smithi136 ceph-mon[125702]: pgmap v7908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:39 smithi136 ceph-mon[125702]: pgmap v7909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:39 smithi057 ceph-mon[92072]: pgmap v7909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:39 smithi122 ceph-mon[125440]: pgmap v7909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:04:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:04:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:04:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:41 smithi057 ceph-mon[92072]: pgmap v7910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:41 smithi122 ceph-mon[125440]: pgmap v7910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:41 smithi136 ceph-mon[125702]: pgmap v7910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:43 smithi057 ceph-mon[92072]: pgmap v7911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:43 smithi122 ceph-mon[125440]: pgmap v7911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:43 smithi136 ceph-mon[125702]: pgmap v7911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:45.290+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:04:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:45.290+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:04:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:45.290+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:04:45.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:45.290+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:04:45.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:04:45.290+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:04:45.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:45.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:45.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:04:45.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:04:45.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 177.9M 2023-03-02T15:04:45.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 186603474: error parsing value: Value '186603474' is below minimum 939524096 2023-03-02T15:04:45.439 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.439 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.439 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.439 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.439 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.440 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.440 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.440 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.440 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:04:45.440 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:04:45.440 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:04:45.440 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:04:45.441 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:45.441 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:45 smithi057 ceph-mon[92072]: pgmap v7912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:04:45.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:04:45.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 177.9M 2023-03-02T15:04:45.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 186603474: error parsing value: Value '186603474' is below minimum 939524096 2023-03-02T15:04:45.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:04:45.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:04:45.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:04:45.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:04:45.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:45.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:45 smithi122 ceph-mon[125440]: pgmap v7912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:45.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:45.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:45.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:04:45.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:04:45.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 177.9M 2023-03-02T15:04:45.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 186603474: error parsing value: Value '186603474' is below minimum 939524096 2023-03-02T15:04:45.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:04:45.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:04:45.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:04:45.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:04:45.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:04:45.599 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:04:45.599 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:45 smithi136 ceph-mon[125702]: pgmap v7912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:47 smithi057 ceph-mon[92072]: pgmap v7913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:47 smithi122 ceph-mon[125440]: pgmap v7913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:47 smithi136 ceph-mon[125702]: pgmap v7913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:49 smithi057 ceph-mon[92072]: pgmap v7914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:49 smithi122 ceph-mon[125440]: pgmap v7914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:49 smithi136 ceph-mon[125702]: pgmap v7914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:51 smithi057 ceph-mon[92072]: pgmap v7915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:51 smithi122 ceph-mon[125440]: pgmap v7915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:51 smithi136 ceph-mon[125702]: pgmap v7915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:53 smithi122 ceph-mon[125440]: pgmap v7916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:53 smithi136 ceph-mon[125702]: pgmap v7916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:53 smithi057 ceph-mon[92072]: pgmap v7916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:55 smithi122 ceph-mon[125440]: pgmap v7917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:55 smithi136 ceph-mon[125702]: pgmap v7917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:55 smithi057 ceph-mon[92072]: pgmap v7917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:57 smithi122 ceph-mon[125440]: pgmap v7918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:57 smithi136 ceph-mon[125702]: pgmap v7918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:57 smithi057 ceph-mon[92072]: pgmap v7918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:04:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:04:59 smithi057 ceph-mon[92072]: pgmap v7919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:04:59 smithi122 ceph-mon[125440]: pgmap v7919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:04:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:04:59 smithi136 ceph-mon[125702]: pgmap v7919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:00.306+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:05:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:00.306+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:05:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:00.306+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:05:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:00.306+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:05:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:00.306+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:05:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:01 smithi057 ceph-mon[92072]: pgmap v7920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:01 smithi122 ceph-mon[125440]: pgmap v7920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:01 smithi136 ceph-mon[125702]: pgmap v7920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:03 smithi057 ceph-mon[92072]: pgmap v7921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:05:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:03 smithi122 ceph-mon[125440]: pgmap v7921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:05:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:03 smithi136 ceph-mon[125702]: pgmap v7921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:05:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:05 smithi122 ceph-mon[125440]: pgmap v7922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:05:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:05 smithi136 ceph-mon[125702]: pgmap v7922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:05:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:05 smithi057 ceph-mon[92072]: pgmap v7922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:05:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:07 smithi122 ceph-mon[125440]: pgmap v7923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:05:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:07 smithi136 ceph-mon[125702]: pgmap v7923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:05:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:07 smithi057 ceph-mon[92072]: pgmap v7923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:05:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:09 smithi057 ceph-mon[92072]: pgmap v7924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:05:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:09 smithi122 ceph-mon[125440]: pgmap v7924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:05:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:09 smithi136 ceph-mon[125702]: pgmap v7924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:05:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:10.488+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:05:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:10.488+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:05:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:10.488+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 116 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:05:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:10.488+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 117 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:05:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:11 smithi136 ceph-mon[125702]: osdmap e567: 12 total, 12 up, 12 in 2023-03-02T15:05:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:11 smithi136 ceph-mon[125702]: pgmap v7926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:05:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:11 smithi057 ceph-mon[92072]: osdmap e567: 12 total, 12 up, 12 in 2023-03-02T15:05:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:11 smithi057 ceph-mon[92072]: pgmap v7926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:05:11.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:11 smithi122 ceph-mon[125440]: osdmap e567: 12 total, 12 up, 12 in 2023-03-02T15:05:11.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:11 smithi122 ceph-mon[125440]: pgmap v7926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:05:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:13 smithi057 ceph-mon[92072]: pgmap v7927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:05:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:13 smithi057 ceph-mon[92072]: osdmap e568: 12 total, 12 up, 12 in 2023-03-02T15:05:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:13 smithi122 ceph-mon[125440]: pgmap v7927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:05:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:13 smithi122 ceph-mon[125440]: osdmap e568: 12 total, 12 up, 12 in 2023-03-02T15:05:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:13 smithi136 ceph-mon[125702]: pgmap v7927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:05:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:13 smithi136 ceph-mon[125702]: osdmap e568: 12 total, 12 up, 12 in 2023-03-02T15:05:15.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:15.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:05:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:15.320+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:05:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:15.320+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:05:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:15.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:05:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:15.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:05:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:15 smithi122 ceph-mon[125440]: pgmap v7929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:05:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:15 smithi136 ceph-mon[125702]: pgmap v7929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:05:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:15 smithi057 ceph-mon[92072]: pgmap v7929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:05:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:17 smithi122 ceph-mon[125440]: pgmap v7930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:05:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:17 smithi136 ceph-mon[125702]: pgmap v7930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:05:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:17 smithi057 ceph-mon[92072]: pgmap v7930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:05:19.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:19 smithi057 ceph-mon[92072]: pgmap v7931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T15:05:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:19 smithi122 ceph-mon[125440]: pgmap v7931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T15:05:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:19 smithi136 ceph-mon[125702]: pgmap v7931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T15:05:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:21 smithi122 ceph-mon[125440]: pgmap v7932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:05:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:21 smithi136 ceph-mon[125702]: pgmap v7932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:05:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:21 smithi057 ceph-mon[92072]: pgmap v7932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:05:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:23 smithi122 ceph-mon[125440]: pgmap v7933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:05:24.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:23 smithi136 ceph-mon[125702]: pgmap v7933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:05:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:23 smithi057 ceph-mon[92072]: pgmap v7933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:05:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:25 smithi136 ceph-mon[125702]: pgmap v7934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:05:26.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:25 smithi057 ceph-mon[92072]: pgmap v7934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:05:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:25 smithi122 ceph-mon[125440]: pgmap v7934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:05:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:27 smithi136 ceph-mon[125702]: pgmap v7935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:05:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:27 smithi057 ceph-mon[92072]: pgmap v7935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:05:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:27 smithi122 ceph-mon[125440]: pgmap v7935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:05:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:29 smithi057 ceph-mon[92072]: pgmap v7936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:29 smithi122 ceph-mon[125440]: pgmap v7936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:29 smithi136 ceph-mon[125702]: pgmap v7936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:30.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:30.332+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:05:30.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:30.332+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:05:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:30.332+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:05:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:30.332+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:05:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:30.332+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:05:32.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:31 smithi122 ceph-mon[125440]: pgmap v7937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:31 smithi136 ceph-mon[125702]: pgmap v7937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:31 smithi057 ceph-mon[92072]: pgmap v7937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:33 smithi122 ceph-mon[125440]: pgmap v7938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:33 smithi136 ceph-mon[125702]: pgmap v7938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:33 smithi057 ceph-mon[92072]: pgmap v7938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:35 smithi122 ceph-mon[125440]: pgmap v7939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:35 smithi136 ceph-mon[125702]: pgmap v7939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:35 smithi057 ceph-mon[92072]: pgmap v7939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:37 smithi136 ceph-mon[125702]: pgmap v7940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:37 smithi057 ceph-mon[92072]: pgmap v7940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:37 smithi122 ceph-mon[125440]: pgmap v7940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:39 smithi057 ceph-mon[92072]: pgmap v7941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:39 smithi122 ceph-mon[125440]: pgmap v7941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:39 smithi136 ceph-mon[125702]: pgmap v7941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:41 smithi122 ceph-mon[125440]: pgmap v7942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:41 smithi136 ceph-mon[125702]: pgmap v7942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:41 smithi057 ceph-mon[92072]: pgmap v7942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:43 smithi122 ceph-mon[125440]: pgmap v7943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:43 smithi136 ceph-mon[125702]: pgmap v7943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:43 smithi057 ceph-mon[92072]: pgmap v7943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:45.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:05:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:45.348+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:05:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:45.348+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:05:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:45.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:05:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:05:45.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:05:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:45 smithi122 ceph-mon[125440]: pgmap v7944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:05:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:05:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:05:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:05:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:45 smithi136 ceph-mon[125702]: pgmap v7944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:05:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:05:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:05:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:05:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:45 smithi057 ceph-mon[92072]: pgmap v7944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:05:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:05:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:05:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:05:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:47 smithi122 ceph-mon[125440]: pgmap v7945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:47 smithi136 ceph-mon[125702]: pgmap v7945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:47 smithi057 ceph-mon[92072]: pgmap v7945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:49 smithi057 ceph-mon[92072]: pgmap v7946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:05:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:49 smithi122 ceph-mon[125440]: pgmap v7946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:05:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:49 smithi136 ceph-mon[125702]: pgmap v7946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:05:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:51 smithi122 ceph-mon[125440]: pgmap v7947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:05:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:51 smithi136 ceph-mon[125702]: pgmap v7947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:05:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:51 smithi057 ceph-mon[92072]: pgmap v7947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:05:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:53 smithi122 ceph-mon[125440]: pgmap v7948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:53 smithi136 ceph-mon[125702]: pgmap v7948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:53 smithi057 ceph-mon[92072]: pgmap v7948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:55 smithi122 ceph-mon[125440]: pgmap v7949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:05:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:55 smithi136 ceph-mon[125702]: pgmap v7949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:05:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:55 smithi057 ceph-mon[92072]: pgmap v7949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:05:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:57 smithi136 ceph-mon[125702]: pgmap v7950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:58.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:57 smithi057 ceph-mon[92072]: pgmap v7950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:57 smithi122 ceph-mon[125440]: pgmap v7950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:05:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:05:59 smithi057 ceph-mon[92072]: pgmap v7951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:05:59 smithi122 ceph-mon[125440]: pgmap v7951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:05:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:05:59 smithi136 ceph-mon[125702]: pgmap v7951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:00.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:06:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:00.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:06:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:00.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:06:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:00.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:06:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:00.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:06:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:01 smithi122 ceph-mon[125440]: pgmap v7952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:01 smithi136 ceph-mon[125702]: pgmap v7952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:01 smithi057 ceph-mon[92072]: pgmap v7952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:03 smithi122 ceph-mon[125440]: pgmap v7953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:06:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:03 smithi136 ceph-mon[125702]: pgmap v7953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:06:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:03 smithi057 ceph-mon[92072]: pgmap v7953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:06:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:05 smithi136 ceph-mon[125702]: pgmap v7954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:06:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:05 smithi057 ceph-mon[92072]: pgmap v7954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:06:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:05 smithi122 ceph-mon[125440]: pgmap v7954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:06:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:07 smithi136 ceph-mon[125702]: pgmap v7955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:06:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:07 smithi057 ceph-mon[92072]: pgmap v7955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:06:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:07 smithi122 ceph-mon[125440]: pgmap v7955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:06:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:09 smithi057 ceph-mon[92072]: pgmap v7956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:06:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:09 smithi122 ceph-mon[125440]: pgmap v7956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:06:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:09 smithi136 ceph-mon[125702]: pgmap v7956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:06:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:11 smithi136 ceph-mon[125702]: osdmap e569: 12 total, 12 up, 12 in 2023-03-02T15:06:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:11 smithi136 ceph-mon[125702]: pgmap v7958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:06:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:11 smithi057 ceph-mon[92072]: osdmap e569: 12 total, 12 up, 12 in 2023-03-02T15:06:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:11 smithi057 ceph-mon[92072]: pgmap v7958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:06:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:11 smithi122 ceph-mon[125440]: osdmap e569: 12 total, 12 up, 12 in 2023-03-02T15:06:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:11 smithi122 ceph-mon[125440]: pgmap v7958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:06:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:13 smithi122 ceph-mon[125440]: pgmap v7959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:06:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:13 smithi122 ceph-mon[125440]: osdmap e570: 12 total, 12 up, 12 in 2023-03-02T15:06:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:13 smithi136 ceph-mon[125702]: pgmap v7959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:06:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:13 smithi136 ceph-mon[125702]: osdmap e570: 12 total, 12 up, 12 in 2023-03-02T15:06:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:13 smithi057 ceph-mon[92072]: pgmap v7959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:06:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:13 smithi057 ceph-mon[92072]: osdmap e570: 12 total, 12 up, 12 in 2023-03-02T15:06:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:15.375+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:06:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:15.375+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:06:15.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:15.375+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:06:15.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:15.375+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:06:15.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:15.375+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:06:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:15 smithi136 ceph-mon[125702]: pgmap v7961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:06:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:15 smithi057 ceph-mon[92072]: pgmap v7961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:06:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:15 smithi122 ceph-mon[125440]: pgmap v7961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:06:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:17 smithi136 ceph-mon[125702]: pgmap v7962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:06:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:17 smithi057 ceph-mon[92072]: pgmap v7962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:06:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:17 smithi122 ceph-mon[125440]: pgmap v7962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:06:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:19 smithi057 ceph-mon[92072]: pgmap v7963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T15:06:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:19 smithi122 ceph-mon[125440]: pgmap v7963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T15:06:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:19 smithi136 ceph-mon[125702]: pgmap v7963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T15:06:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:21 smithi122 ceph-mon[125440]: pgmap v7964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:06:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:21 smithi136 ceph-mon[125702]: pgmap v7964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:06:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:21 smithi057 ceph-mon[92072]: pgmap v7964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:06:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:23 smithi136 ceph-mon[125702]: pgmap v7965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:06:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:23 smithi057 ceph-mon[92072]: pgmap v7965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:06:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:23 smithi122 ceph-mon[125440]: pgmap v7965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:06:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:25 smithi136 ceph-mon[125702]: pgmap v7966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:06:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:25 smithi057 ceph-mon[92072]: pgmap v7966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:06:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:25 smithi122 ceph-mon[125440]: pgmap v7966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:06:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:27 smithi136 ceph-mon[125702]: pgmap v7967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:06:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:27 smithi057 ceph-mon[92072]: pgmap v7967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:06:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:27 smithi122 ceph-mon[125440]: pgmap v7967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:06:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:29 smithi057 ceph-mon[92072]: pgmap v7968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:29 smithi122 ceph-mon[125440]: pgmap v7968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:29 smithi136 ceph-mon[125702]: pgmap v7968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:30.381+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:06:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:30.381+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:06:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:30.381+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:06:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:30.381+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:06:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:30.381+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:06:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:31 smithi136 ceph-mon[125702]: pgmap v7969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:31 smithi057 ceph-mon[92072]: pgmap v7969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:31 smithi122 ceph-mon[125440]: pgmap v7969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:33 smithi136 ceph-mon[125702]: pgmap v7970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:33 smithi057 ceph-mon[92072]: pgmap v7970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:33 smithi122 ceph-mon[125440]: pgmap v7970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:35 smithi136 ceph-mon[125702]: pgmap v7971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:35 smithi057 ceph-mon[92072]: pgmap v7971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:35 smithi122 ceph-mon[125440]: pgmap v7971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:37 smithi136 ceph-mon[125702]: pgmap v7972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:37 smithi057 ceph-mon[92072]: pgmap v7972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:37 smithi122 ceph-mon[125440]: pgmap v7972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:39 smithi057 ceph-mon[92072]: pgmap v7973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:39 smithi122 ceph-mon[125440]: pgmap v7973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:39 smithi136 ceph-mon[125702]: pgmap v7973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:40.501+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:06:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:40.501+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:06:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:40.502+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 118 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:06:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:40.502+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 117 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:06:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:41 smithi136 ceph-mon[125702]: pgmap v7974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:41 smithi057 ceph-mon[92072]: pgmap v7974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:41 smithi122 ceph-mon[125440]: pgmap v7974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:44.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:43 smithi136 ceph-mon[125702]: pgmap v7975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:43 smithi057 ceph-mon[92072]: pgmap v7975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:43 smithi122 ceph-mon[125440]: pgmap v7975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:45.387+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:06:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:45.388+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:06:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:45.388+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:06:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:45.388+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:06:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:06:45.388+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:06:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:45 smithi136 ceph-mon[125702]: pgmap v7976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:06:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:45 smithi057 ceph-mon[92072]: pgmap v7976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:06:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:45 smithi122 ceph-mon[125440]: pgmap v7976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:06:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:06:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:06:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:47 smithi057 ceph-mon[92072]: pgmap v7977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:06:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:06:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:06:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:06:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:06:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:47 smithi122 ceph-mon[125440]: pgmap v7977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:06:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:06:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:06:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:06:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:06:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:47 smithi136 ceph-mon[125702]: pgmap v7977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:06:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:06:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:06:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:49 smithi057 ceph-mon[92072]: pgmap v7978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:49 smithi122 ceph-mon[125440]: pgmap v7978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:49 smithi136 ceph-mon[125702]: pgmap v7978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:51 smithi136 ceph-mon[125702]: pgmap v7979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:51 smithi057 ceph-mon[92072]: pgmap v7979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:51 smithi122 ceph-mon[125440]: pgmap v7979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:53 smithi136 ceph-mon[125702]: pgmap v7980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:53 smithi057 ceph-mon[92072]: pgmap v7980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:53 smithi122 ceph-mon[125440]: pgmap v7980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:55 smithi136 ceph-mon[125702]: pgmap v7981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:55 smithi057 ceph-mon[92072]: pgmap v7981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:55 smithi122 ceph-mon[125440]: pgmap v7981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:57 smithi136 ceph-mon[125702]: pgmap v7982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:57 smithi057 ceph-mon[92072]: pgmap v7982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:57 smithi122 ceph-mon[125440]: pgmap v7982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:06:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:06:59 smithi057 ceph-mon[92072]: pgmap v7983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:06:59 smithi122 ceph-mon[125440]: pgmap v7983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:06:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:06:59 smithi136 ceph-mon[125702]: pgmap v7983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:00.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:07:00.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:00.399+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:07:00.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:00.399+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:07:00.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:00.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:07:00.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:00.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:07:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:01 smithi136 ceph-mon[125702]: pgmap v7984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:01 smithi057 ceph-mon[92072]: pgmap v7984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:01 smithi122 ceph-mon[125440]: pgmap v7984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:03 smithi136 ceph-mon[125702]: pgmap v7985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:07:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:03 smithi057 ceph-mon[92072]: pgmap v7985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:07:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:03 smithi122 ceph-mon[125440]: pgmap v7985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:07:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:05 smithi136 ceph-mon[125702]: pgmap v7986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:07:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:05 smithi057 ceph-mon[92072]: pgmap v7986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:07:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:05 smithi122 ceph-mon[125440]: pgmap v7986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:07:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:07 smithi136 ceph-mon[125702]: pgmap v7987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:07:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:07 smithi057 ceph-mon[92072]: pgmap v7987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:07:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:07 smithi122 ceph-mon[125440]: pgmap v7987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:07:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:09 smithi057 ceph-mon[92072]: pgmap v7988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:07:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:09 smithi122 ceph-mon[125440]: pgmap v7988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:07:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:09 smithi136 ceph-mon[125702]: pgmap v7988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:07:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:11 smithi136 ceph-mon[125702]: osdmap e571: 12 total, 12 up, 12 in 2023-03-02T15:07:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:11 smithi136 ceph-mon[125702]: pgmap v7990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:07:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:11 smithi057 ceph-mon[92072]: osdmap e571: 12 total, 12 up, 12 in 2023-03-02T15:07:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:11 smithi057 ceph-mon[92072]: pgmap v7990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:07:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:11 smithi122 ceph-mon[125440]: osdmap e571: 12 total, 12 up, 12 in 2023-03-02T15:07:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:11 smithi122 ceph-mon[125440]: pgmap v7990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:07:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:13 smithi136 ceph-mon[125702]: pgmap v7991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:07:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:13 smithi136 ceph-mon[125702]: osdmap e572: 12 total, 12 up, 12 in 2023-03-02T15:07:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:13 smithi057 ceph-mon[92072]: pgmap v7991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:07:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:13 smithi057 ceph-mon[92072]: osdmap e572: 12 total, 12 up, 12 in 2023-03-02T15:07:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:13 smithi122 ceph-mon[125440]: pgmap v7991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:07:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:13 smithi122 ceph-mon[125440]: osdmap e572: 12 total, 12 up, 12 in 2023-03-02T15:07:15.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:15.414+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:07:15.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:15.415+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:07:15.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:15.415+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:07:15.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:15.415+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:07:15.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:15.415+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:07:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:15 smithi136 ceph-mon[125702]: pgmap v7993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:07:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:15 smithi057 ceph-mon[92072]: pgmap v7993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:07:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:15 smithi122 ceph-mon[125440]: pgmap v7993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:07:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:17 smithi136 ceph-mon[125702]: pgmap v7994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:07:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:17 smithi057 ceph-mon[92072]: pgmap v7994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:07:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:17 smithi122 ceph-mon[125440]: pgmap v7994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:07:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:19 smithi057 ceph-mon[92072]: pgmap v7995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T15:07:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:19 smithi122 ceph-mon[125440]: pgmap v7995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T15:07:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:19 smithi136 ceph-mon[125702]: pgmap v7995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T15:07:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:21 smithi136 ceph-mon[125702]: pgmap v7996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:07:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:21 smithi057 ceph-mon[92072]: pgmap v7996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:07:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:21 smithi122 ceph-mon[125440]: pgmap v7996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:07:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:23 smithi136 ceph-mon[125702]: pgmap v7997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:07:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:23 smithi057 ceph-mon[92072]: pgmap v7997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:07:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:23 smithi122 ceph-mon[125440]: pgmap v7997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:07:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:25 smithi136 ceph-mon[125702]: pgmap v7998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:07:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:25 smithi057 ceph-mon[92072]: pgmap v7998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:07:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:25 smithi122 ceph-mon[125440]: pgmap v7998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:07:28.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:27 smithi136 ceph-mon[125702]: pgmap v7999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:07:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:27 smithi057 ceph-mon[92072]: pgmap v7999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:07:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:27 smithi122 ceph-mon[125440]: pgmap v7999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:07:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:29 smithi057 ceph-mon[92072]: pgmap v8000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:29 smithi122 ceph-mon[125440]: pgmap v8000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:29 smithi136 ceph-mon[125702]: pgmap v8000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:30.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:07:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:30.424+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:07:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:30.424+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:07:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:30.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:07:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:30.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:07:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:31 smithi136 ceph-mon[125702]: pgmap v8001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:31 smithi057 ceph-mon[92072]: pgmap v8001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:31 smithi122 ceph-mon[125440]: pgmap v8001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:33 smithi136 ceph-mon[125702]: pgmap v8002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:33 smithi057 ceph-mon[92072]: pgmap v8002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:33 smithi122 ceph-mon[125440]: pgmap v8002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:35 smithi136 ceph-mon[125702]: pgmap v8003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:35 smithi057 ceph-mon[92072]: pgmap v8003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:36.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:35 smithi122 ceph-mon[125440]: pgmap v8003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:37 smithi136 ceph-mon[125702]: pgmap v8004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:37 smithi057 ceph-mon[92072]: pgmap v8004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:37 smithi122 ceph-mon[125440]: pgmap v8004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:39 smithi057 ceph-mon[92072]: pgmap v8005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:39 smithi122 ceph-mon[125440]: pgmap v8005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:39 smithi136 ceph-mon[125702]: pgmap v8005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:41 smithi136 ceph-mon[125702]: pgmap v8006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:41 smithi057 ceph-mon[92072]: pgmap v8006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:41 smithi122 ceph-mon[125440]: pgmap v8006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:43 smithi136 ceph-mon[125702]: pgmap v8007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:43 smithi057 ceph-mon[92072]: pgmap v8007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:43 smithi122 ceph-mon[125440]: pgmap v8007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:45.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:07:45.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:45.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:07:45.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:45.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:07:45.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:45.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:07:45.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:07:45.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:07:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:45 smithi136 ceph-mon[125702]: pgmap v8008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:45 smithi057 ceph-mon[92072]: pgmap v8008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:45 smithi122 ceph-mon[125440]: pgmap v8008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:47 smithi136 ceph-mon[125702]: pgmap v8009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:07:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:48.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:48.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:48.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:47 smithi057 ceph-mon[92072]: pgmap v8009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:07:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:47 smithi122 ceph-mon[125440]: pgmap v8009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:07:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:07:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:07:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:49 smithi057 ceph-mon[92072]: pgmap v8010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:07:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:07:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:49 smithi122 ceph-mon[125440]: pgmap v8010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:07:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:07:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:07:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:49 smithi136 ceph-mon[125702]: pgmap v8010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:51 smithi136 ceph-mon[125702]: pgmap v8011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:51 smithi057 ceph-mon[92072]: pgmap v8011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:51 smithi122 ceph-mon[125440]: pgmap v8011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:53 smithi136 ceph-mon[125702]: pgmap v8012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:53 smithi057 ceph-mon[92072]: pgmap v8012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:53 smithi122 ceph-mon[125440]: pgmap v8012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:55 smithi136 ceph-mon[125702]: pgmap v8013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:55 smithi057 ceph-mon[92072]: pgmap v8013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:55 smithi122 ceph-mon[125440]: pgmap v8013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:57 smithi136 ceph-mon[125702]: pgmap v8014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:57 smithi057 ceph-mon[92072]: pgmap v8014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:57 smithi122 ceph-mon[125440]: pgmap v8014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:07:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:07:59 smithi057 ceph-mon[92072]: pgmap v8015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:07:59 smithi122 ceph-mon[125440]: pgmap v8015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:07:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:07:59 smithi136 ceph-mon[125702]: pgmap v8015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:00.445+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:08:00.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:00.446+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:08:00.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:00.446+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:08:00.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:00.446+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:08:00.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:00.446+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:08:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:01 smithi136 ceph-mon[125702]: pgmap v8016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:01 smithi057 ceph-mon[92072]: pgmap v8016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:01 smithi122 ceph-mon[125440]: pgmap v8016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:03 smithi136 ceph-mon[125702]: pgmap v8017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:08:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:03 smithi057 ceph-mon[92072]: pgmap v8017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:08:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:03 smithi122 ceph-mon[125440]: pgmap v8017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:08:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:05 smithi136 ceph-mon[125702]: pgmap v8018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:08:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:05 smithi057 ceph-mon[92072]: pgmap v8018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:08:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:05 smithi122 ceph-mon[125440]: pgmap v8018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:08:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:07 smithi136 ceph-mon[125702]: pgmap v8019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:08:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:07 smithi057 ceph-mon[92072]: pgmap v8019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:08:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:07 smithi122 ceph-mon[125440]: pgmap v8019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:08:09.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:09 smithi057 ceph-mon[92072]: pgmap v8020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:08:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:09 smithi122 ceph-mon[125440]: pgmap v8020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:08:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:09 smithi136 ceph-mon[125702]: pgmap v8020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:08:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:10.515+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:08:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:10.515+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:08:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:10.515+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 119 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:08:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:10.515+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 118 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:08:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:11 smithi136 ceph-mon[125702]: osdmap e573: 12 total, 12 up, 12 in 2023-03-02T15:08:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:11 smithi136 ceph-mon[125702]: pgmap v8022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:08:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:11 smithi057 ceph-mon[92072]: osdmap e573: 12 total, 12 up, 12 in 2023-03-02T15:08:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:11 smithi057 ceph-mon[92072]: pgmap v8022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:08:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:11 smithi122 ceph-mon[125440]: osdmap e573: 12 total, 12 up, 12 in 2023-03-02T15:08:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:11 smithi122 ceph-mon[125440]: pgmap v8022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:08:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:13 smithi136 ceph-mon[125702]: pgmap v8023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:08:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:13 smithi136 ceph-mon[125702]: osdmap e574: 12 total, 12 up, 12 in 2023-03-02T15:08:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:13 smithi057 ceph-mon[92072]: pgmap v8023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:08:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:13 smithi057 ceph-mon[92072]: osdmap e574: 12 total, 12 up, 12 in 2023-03-02T15:08:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:13 smithi122 ceph-mon[125440]: pgmap v8023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:08:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:13 smithi122 ceph-mon[125440]: osdmap e574: 12 total, 12 up, 12 in 2023-03-02T15:08:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:15.458+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:08:15.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:15.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:08:15.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:15.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:08:15.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:15.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:08:15.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:15.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:08:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:15 smithi136 ceph-mon[125702]: pgmap v8025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:08:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:15 smithi057 ceph-mon[92072]: pgmap v8025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:08:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:15 smithi122 ceph-mon[125440]: pgmap v8025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:08:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:17 smithi136 ceph-mon[125702]: pgmap v8026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:08:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:17 smithi057 ceph-mon[92072]: pgmap v8026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:08:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:17 smithi122 ceph-mon[125440]: pgmap v8026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:08:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:19 smithi057 ceph-mon[92072]: pgmap v8027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T15:08:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:19 smithi122 ceph-mon[125440]: pgmap v8027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T15:08:19.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:19 smithi136 ceph-mon[125702]: pgmap v8027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T15:08:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:21 smithi136 ceph-mon[125702]: pgmap v8028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:08:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:21 smithi057 ceph-mon[92072]: pgmap v8028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:08:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:21 smithi122 ceph-mon[125440]: pgmap v8028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:08:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:23 smithi136 ceph-mon[125702]: pgmap v8029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:08:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:23 smithi057 ceph-mon[92072]: pgmap v8029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:08:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:23 smithi122 ceph-mon[125440]: pgmap v8029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:08:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:25 smithi136 ceph-mon[125702]: pgmap v8030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:08:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:25 smithi057 ceph-mon[92072]: pgmap v8030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:08:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:25 smithi122 ceph-mon[125440]: pgmap v8030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:08:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:27 smithi136 ceph-mon[125702]: pgmap v8031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:08:28.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:27 smithi057 ceph-mon[92072]: pgmap v8031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:08:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:27 smithi122 ceph-mon[125440]: pgmap v8031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:08:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:29 smithi057 ceph-mon[92072]: pgmap v8032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:29 smithi122 ceph-mon[125440]: pgmap v8032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:29 smithi136 ceph-mon[125702]: pgmap v8032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:30.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:30.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:08:30.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:30.473+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:30.473+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:30.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:30.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:08:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:31 smithi136 ceph-mon[125702]: pgmap v8033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:31 smithi057 ceph-mon[92072]: pgmap v8033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:31 smithi122 ceph-mon[125440]: pgmap v8033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:33 smithi136 ceph-mon[125702]: pgmap v8034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:33 smithi057 ceph-mon[92072]: pgmap v8034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:33 smithi122 ceph-mon[125440]: pgmap v8034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:36 smithi136 ceph-mon[125702]: pgmap v8035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:36 smithi057 ceph-mon[92072]: pgmap v8035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:36 smithi122 ceph-mon[125440]: pgmap v8035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:38 smithi136 ceph-mon[125702]: pgmap v8036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:38 smithi057 ceph-mon[92072]: pgmap v8036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:38.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:38 smithi122 ceph-mon[125440]: pgmap v8036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:39 smithi057 ceph-mon[92072]: pgmap v8037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:39 smithi122 ceph-mon[125440]: pgmap v8037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:39.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:39 smithi136 ceph-mon[125702]: pgmap v8037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:41 smithi136 ceph-mon[125702]: pgmap v8038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:41 smithi057 ceph-mon[92072]: pgmap v8038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:42.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:41 smithi122 ceph-mon[125440]: pgmap v8038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:44 smithi136 ceph-mon[125702]: pgmap v8039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:44 smithi057 ceph-mon[92072]: pgmap v8039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:44 smithi122 ceph-mon[125440]: pgmap v8039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:45.486+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:08:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:45.486+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:08:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:45.486+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:08:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:45.486+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:08:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:08:45.486+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:08:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:46 smithi136 ceph-mon[125702]: pgmap v8040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:46 smithi057 ceph-mon[92072]: pgmap v8040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:46 smithi122 ceph-mon[125440]: pgmap v8040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:48 smithi136 ceph-mon[125702]: pgmap v8041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:48 smithi057 ceph-mon[92072]: pgmap v8041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:48 smithi122 ceph-mon[125440]: pgmap v8041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:08:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:49 smithi057 ceph-mon[92072]: pgmap v8042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:08:49.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:49 smithi122 ceph-mon[125440]: pgmap v8042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:08:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:49 smithi136 ceph-mon[125702]: pgmap v8042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:08:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:08:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:08:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:08:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:08:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:08:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:08:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:08:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:08:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:51 smithi057 ceph-mon[92072]: pgmap v8043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:51 smithi122 ceph-mon[125440]: pgmap v8043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:51 smithi136 ceph-mon[125702]: pgmap v8043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:53 smithi136 ceph-mon[125702]: pgmap v8044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:53 smithi057 ceph-mon[92072]: pgmap v8044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:53 smithi122 ceph-mon[125440]: pgmap v8044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:55 smithi136 ceph-mon[125702]: pgmap v8045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:55 smithi057 ceph-mon[92072]: pgmap v8045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:55 smithi122 ceph-mon[125440]: pgmap v8045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:58 smithi136 ceph-mon[125702]: pgmap v8046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:58 smithi057 ceph-mon[92072]: pgmap v8046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:58 smithi122 ceph-mon[125440]: pgmap v8046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:08:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:08:59 smithi057 ceph-mon[92072]: pgmap v8047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:08:59 smithi122 ceph-mon[125440]: pgmap v8047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:08:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:08:59 smithi136 ceph-mon[125702]: pgmap v8047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:00.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:00.499+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:09:00.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:00.499+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:09:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:00.499+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:09:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:00.499+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:09:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:00.499+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:09:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:01 smithi136 ceph-mon[125702]: pgmap v8048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:01 smithi057 ceph-mon[92072]: pgmap v8048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:01 smithi122 ceph-mon[125440]: pgmap v8048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:04 smithi136 ceph-mon[125702]: pgmap v8049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:09:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:04 smithi057 ceph-mon[92072]: pgmap v8049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:09:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:04 smithi122 ceph-mon[125440]: pgmap v8049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:09:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:06 smithi136 ceph-mon[125702]: pgmap v8050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:09:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:06 smithi057 ceph-mon[92072]: pgmap v8050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:09:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:06 smithi122 ceph-mon[125440]: pgmap v8050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:09:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:07 smithi136 ceph-mon[125702]: osdmap e575: 12 total, 12 up, 12 in 2023-03-02T15:09:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:07 smithi057 ceph-mon[92072]: osdmap e575: 12 total, 12 up, 12 in 2023-03-02T15:09:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:07 smithi122 ceph-mon[125440]: osdmap e575: 12 total, 12 up, 12 in 2023-03-02T15:09:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:08 smithi136 ceph-mon[125702]: pgmap v8052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:09:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:08 smithi057 ceph-mon[92072]: pgmap v8052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:09:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:08 smithi122 ceph-mon[125440]: pgmap v8052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:09:09.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:09 smithi057 ceph-mon[92072]: osdmap e576: 12 total, 12 up, 12 in 2023-03-02T15:09:09.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:09 smithi057 ceph-mon[92072]: pgmap v8054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:09:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:09 smithi122 ceph-mon[125440]: osdmap e576: 12 total, 12 up, 12 in 2023-03-02T15:09:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:09 smithi122 ceph-mon[125440]: pgmap v8054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:09:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:09 smithi136 ceph-mon[125702]: osdmap e576: 12 total, 12 up, 12 in 2023-03-02T15:09:09.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:09 smithi136 ceph-mon[125702]: pgmap v8054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:09:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:12 smithi136 ceph-mon[125702]: pgmap v8055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:09:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:12 smithi057 ceph-mon[92072]: pgmap v8055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:09:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:12 smithi122 ceph-mon[125440]: pgmap v8055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:09:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:14 smithi136 ceph-mon[125702]: pgmap v8056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:09:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:14 smithi057 ceph-mon[92072]: pgmap v8056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:09:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:14 smithi122 ceph-mon[125440]: pgmap v8056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:09:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:15.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:09:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:15.515+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:09:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:15.515+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:09:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:15.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:09:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:15.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:09:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:16 smithi136 ceph-mon[125702]: pgmap v8057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:09:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:16 smithi057 ceph-mon[92072]: pgmap v8057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:09:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:16 smithi122 ceph-mon[125440]: pgmap v8057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:09:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:18 smithi136 ceph-mon[125702]: pgmap v8058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:09:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:18 smithi057 ceph-mon[92072]: pgmap v8058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:09:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:18 smithi122 ceph-mon[125440]: pgmap v8058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:09:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:19 smithi057 ceph-mon[92072]: pgmap v8059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:09:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:19 smithi122 ceph-mon[125440]: pgmap v8059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:09:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:19 smithi136 ceph-mon[125702]: pgmap v8059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:09:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:22 smithi136 ceph-mon[125702]: pgmap v8060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:09:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:22 smithi057 ceph-mon[92072]: pgmap v8060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:09:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:22 smithi122 ceph-mon[125440]: pgmap v8060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:09:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:24 smithi136 ceph-mon[125702]: pgmap v8061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:09:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:24 smithi057 ceph-mon[92072]: pgmap v8061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:09:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:24 smithi122 ceph-mon[125440]: pgmap v8061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:09:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:26 smithi136 ceph-mon[125702]: pgmap v8062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:26 smithi057 ceph-mon[92072]: pgmap v8062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:26.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:26 smithi122 ceph-mon[125440]: pgmap v8062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:28 smithi136 ceph-mon[125702]: pgmap v8063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:28 smithi057 ceph-mon[92072]: pgmap v8063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:28 smithi122 ceph-mon[125440]: pgmap v8063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:29 smithi057 ceph-mon[92072]: pgmap v8064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:29 smithi122 ceph-mon[125440]: pgmap v8064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:29 smithi136 ceph-mon[125702]: pgmap v8064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:30.525 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:30.524+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:09:30.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:30.525+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:09:30.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:30.525+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:09:30.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:30.525+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:09:30.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:30.525+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:09:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:32 smithi136 ceph-mon[125702]: pgmap v8065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:32 smithi057 ceph-mon[92072]: pgmap v8065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:32 smithi122 ceph-mon[125440]: pgmap v8065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:34 smithi136 ceph-mon[125702]: pgmap v8066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:34 smithi057 ceph-mon[92072]: pgmap v8066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:34 smithi122 ceph-mon[125440]: pgmap v8066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:36 smithi136 ceph-mon[125702]: pgmap v8067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:36 smithi057 ceph-mon[92072]: pgmap v8067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:36 smithi122 ceph-mon[125440]: pgmap v8067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:38 smithi136 ceph-mon[125702]: pgmap v8068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:38 smithi057 ceph-mon[92072]: pgmap v8068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:38 smithi122 ceph-mon[125440]: pgmap v8068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:39 smithi057 ceph-mon[92072]: pgmap v8069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:39 smithi122 ceph-mon[125440]: pgmap v8069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:39 smithi136 ceph-mon[125702]: pgmap v8069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:42 smithi136 ceph-mon[125702]: pgmap v8070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:42 smithi057 ceph-mon[92072]: pgmap v8070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:42 smithi122 ceph-mon[125440]: pgmap v8070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:44 smithi136 ceph-mon[125702]: pgmap v8071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:44 smithi057 ceph-mon[92072]: pgmap v8071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:44 smithi122 ceph-mon[125440]: pgmap v8071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:45.533+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:09:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:45.533+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:09:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:45.533+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:09:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:45.533+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:09:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:09:45.533+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:09:46.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:46 smithi136 ceph-mon[125702]: pgmap v8072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:46 smithi057 ceph-mon[92072]: pgmap v8072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:46 smithi122 ceph-mon[125440]: pgmap v8072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:48 smithi136 ceph-mon[125702]: pgmap v8073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:48 smithi057 ceph-mon[92072]: pgmap v8073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:48.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:48 smithi122 ceph-mon[125440]: pgmap v8073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:49.441 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:49 smithi057 ceph-mon[92072]: pgmap v8074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:49.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:49 smithi122 ceph-mon[125440]: pgmap v8074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:49 smithi136 ceph-mon[125702]: pgmap v8074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:09:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:09:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:09:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:09:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:09:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:09:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:51 smithi057 ceph-mon[92072]: pgmap v8075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:09:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:09:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:09:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:51 smithi122 ceph-mon[125440]: pgmap v8075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:09:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:09:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:09:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:51 smithi136 ceph-mon[125702]: pgmap v8075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:54 smithi136 ceph-mon[125702]: pgmap v8076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:54 smithi057 ceph-mon[92072]: pgmap v8076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:54 smithi122 ceph-mon[125440]: pgmap v8076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:56 smithi136 ceph-mon[125702]: pgmap v8077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:56 smithi057 ceph-mon[92072]: pgmap v8077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:56 smithi122 ceph-mon[125440]: pgmap v8077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:58 smithi136 ceph-mon[125702]: pgmap v8078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:58 smithi057 ceph-mon[92072]: pgmap v8078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:58 smithi122 ceph-mon[125440]: pgmap v8078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:09:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:09:59 smithi057 ceph-mon[92072]: pgmap v8079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:09:59 smithi122 ceph-mon[125440]: pgmap v8079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:09:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:09:59 smithi136 ceph-mon[125702]: pgmap v8079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T15:10:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T15:10:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:00.549+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:10:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:00.549+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:10:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:00.549+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:10:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:00.549+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:10:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:00.549+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:10:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T15:10:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:01 smithi057 ceph-mon[92072]: pgmap v8080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:01 smithi122 ceph-mon[125440]: pgmap v8080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:01 smithi136 ceph-mon[125702]: pgmap v8080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:04 smithi136 ceph-mon[125702]: pgmap v8081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:10:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:04 smithi057 ceph-mon[92072]: pgmap v8081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:10:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:04 smithi122 ceph-mon[125440]: pgmap v8081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:10:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:06 smithi136 ceph-mon[125702]: pgmap v8082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:10:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:06 smithi057 ceph-mon[92072]: pgmap v8082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:10:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:06 smithi122 ceph-mon[125440]: pgmap v8082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:10:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:07 smithi136 ceph-mon[125702]: osdmap e577: 12 total, 12 up, 12 in 2023-03-02T15:10:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:07 smithi057 ceph-mon[92072]: osdmap e577: 12 total, 12 up, 12 in 2023-03-02T15:10:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:07 smithi122 ceph-mon[125440]: osdmap e577: 12 total, 12 up, 12 in 2023-03-02T15:10:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:08 smithi136 ceph-mon[125702]: pgmap v8084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:10:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:08 smithi057 ceph-mon[92072]: pgmap v8084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:10:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:08 smithi122 ceph-mon[125440]: pgmap v8084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:10:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:09 smithi057 ceph-mon[92072]: osdmap e578: 12 total, 12 up, 12 in 2023-03-02T15:10:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:09 smithi057 ceph-mon[92072]: pgmap v8086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:10:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:09 smithi122 ceph-mon[125440]: osdmap e578: 12 total, 12 up, 12 in 2023-03-02T15:10:09.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:09 smithi122 ceph-mon[125440]: pgmap v8086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:10:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:09 smithi136 ceph-mon[125702]: osdmap e578: 12 total, 12 up, 12 in 2023-03-02T15:10:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:09 smithi136 ceph-mon[125702]: pgmap v8086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:10:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:12 smithi136 ceph-mon[125702]: pgmap v8087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:10:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:12 smithi057 ceph-mon[92072]: pgmap v8087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:10:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:12 smithi122 ceph-mon[125440]: pgmap v8087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:10:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:14 smithi136 ceph-mon[125702]: pgmap v8088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:10:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:14 smithi057 ceph-mon[92072]: pgmap v8088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:10:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:14 smithi122 ceph-mon[125440]: pgmap v8088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:10:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:15.564+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:10:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:15.565+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:10:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:15.565+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:10:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:15.565+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:10:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:15.565+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:10:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:16 smithi136 ceph-mon[125702]: pgmap v8089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:10:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:16 smithi057 ceph-mon[92072]: pgmap v8089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:10:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:16 smithi122 ceph-mon[125440]: pgmap v8089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:10:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:18 smithi136 ceph-mon[125702]: pgmap v8090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:10:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:18 smithi057 ceph-mon[92072]: pgmap v8090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:10:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:18 smithi122 ceph-mon[125440]: pgmap v8090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:10:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:19 smithi122 ceph-mon[125440]: pgmap v8091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:10:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:19 smithi136 ceph-mon[125702]: pgmap v8091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:10:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:19 smithi057 ceph-mon[92072]: pgmap v8091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:10:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:22 smithi136 ceph-mon[125702]: pgmap v8092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:10:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:22 smithi057 ceph-mon[92072]: pgmap v8092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:10:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:22 smithi122 ceph-mon[125440]: pgmap v8092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:10:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:24 smithi136 ceph-mon[125702]: pgmap v8093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:10:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:24 smithi057 ceph-mon[92072]: pgmap v8093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:10:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:24 smithi122 ceph-mon[125440]: pgmap v8093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:10:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:26 smithi136 ceph-mon[125702]: pgmap v8094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:26 smithi057 ceph-mon[92072]: pgmap v8094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:26 smithi122 ceph-mon[125440]: pgmap v8094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:28 smithi136 ceph-mon[125702]: pgmap v8095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:28 smithi057 ceph-mon[92072]: pgmap v8095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:28 smithi122 ceph-mon[125440]: pgmap v8095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:29 smithi122 ceph-mon[125440]: pgmap v8096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:29 smithi136 ceph-mon[125702]: pgmap v8096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:29 smithi057 ceph-mon[92072]: pgmap v8096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:30.580+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:10:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:30.581+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:10:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:30.581+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:10:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:30.581+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:10:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:30.581+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:10:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:32 smithi136 ceph-mon[125702]: pgmap v8097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:32 smithi057 ceph-mon[92072]: pgmap v8097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:32 smithi122 ceph-mon[125440]: pgmap v8097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:34 smithi136 ceph-mon[125702]: pgmap v8098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:34 smithi057 ceph-mon[92072]: pgmap v8098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:34 smithi122 ceph-mon[125440]: pgmap v8098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:36 smithi136 ceph-mon[125702]: pgmap v8099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:36 smithi057 ceph-mon[92072]: pgmap v8099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:36 smithi122 ceph-mon[125440]: pgmap v8099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:38 smithi136 ceph-mon[125702]: pgmap v8100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:38 smithi057 ceph-mon[92072]: pgmap v8100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:38 smithi122 ceph-mon[125440]: pgmap v8100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:39 smithi122 ceph-mon[125440]: pgmap v8101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:39 smithi136 ceph-mon[125702]: pgmap v8101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:39 smithi057 ceph-mon[92072]: pgmap v8101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:42 smithi136 ceph-mon[125702]: pgmap v8102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:42 smithi057 ceph-mon[92072]: pgmap v8102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:42 smithi122 ceph-mon[125440]: pgmap v8102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:44 smithi136 ceph-mon[125702]: pgmap v8103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:44 smithi057 ceph-mon[92072]: pgmap v8103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:44 smithi122 ceph-mon[125440]: pgmap v8103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:45.588+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:10:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:45.589+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:10:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:45.589+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:10:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:45.589+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:10:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:10:45.589+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:10:46.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:46 smithi136 ceph-mon[125702]: pgmap v8104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:46 smithi057 ceph-mon[92072]: pgmap v8104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:46 smithi122 ceph-mon[125440]: pgmap v8104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:48 smithi136 ceph-mon[125702]: pgmap v8105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:48 smithi057 ceph-mon[92072]: pgmap v8105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:48 smithi122 ceph-mon[125440]: pgmap v8105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:49.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:49 smithi122 ceph-mon[125440]: pgmap v8106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:49 smithi136 ceph-mon[125702]: pgmap v8106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:49 smithi057 ceph-mon[92072]: pgmap v8106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:10:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:10:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:10:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:51 smithi136 ceph-mon[125702]: pgmap v8107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:10:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:10:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:10:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:51 smithi057 ceph-mon[92072]: pgmap v8107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:10:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:10:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:10:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:51 smithi122 ceph-mon[125440]: pgmap v8107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:10:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:10:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:10:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:54 smithi136 ceph-mon[125702]: pgmap v8108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:54 smithi057 ceph-mon[92072]: pgmap v8108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:54 smithi122 ceph-mon[125440]: pgmap v8108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:56 smithi136 ceph-mon[125702]: pgmap v8109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:56 smithi057 ceph-mon[92072]: pgmap v8109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:56 smithi122 ceph-mon[125440]: pgmap v8109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:58 smithi136 ceph-mon[125702]: pgmap v8110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:58 smithi057 ceph-mon[92072]: pgmap v8110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:58 smithi122 ceph-mon[125440]: pgmap v8110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:10:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:10:59 smithi122 ceph-mon[125440]: pgmap v8111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:10:59 smithi136 ceph-mon[125702]: pgmap v8111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:10:59.690 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:10:59 smithi057 ceph-mon[92072]: pgmap v8111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:00.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:11:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:00.605+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:11:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:00.605+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:11:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:00.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:11:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:00.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:11:02.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:02 smithi136 ceph-mon[125702]: pgmap v8112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:02 smithi057 ceph-mon[92072]: pgmap v8112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:02 smithi122 ceph-mon[125440]: pgmap v8112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:04 smithi136 ceph-mon[125702]: pgmap v8113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:11:04.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:04 smithi057 ceph-mon[92072]: pgmap v8113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:11:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:04 smithi122 ceph-mon[125440]: pgmap v8113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:11:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:06 smithi136 ceph-mon[125702]: pgmap v8114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:11:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:06 smithi057 ceph-mon[92072]: pgmap v8114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:11:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:06 smithi122 ceph-mon[125440]: pgmap v8114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:11:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:07 smithi136 ceph-mon[125702]: osdmap e579: 12 total, 12 up, 12 in 2023-03-02T15:11:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:07 smithi057 ceph-mon[92072]: osdmap e579: 12 total, 12 up, 12 in 2023-03-02T15:11:07.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:07 smithi122 ceph-mon[125440]: osdmap e579: 12 total, 12 up, 12 in 2023-03-02T15:11:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:08 smithi136 ceph-mon[125702]: pgmap v8116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:11:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:08 smithi057 ceph-mon[92072]: pgmap v8116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:11:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:08 smithi122 ceph-mon[125440]: pgmap v8116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:11:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:09 smithi122 ceph-mon[125440]: osdmap e580: 12 total, 12 up, 12 in 2023-03-02T15:11:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:09 smithi122 ceph-mon[125440]: pgmap v8118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:11:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:09 smithi136 ceph-mon[125702]: osdmap e580: 12 total, 12 up, 12 in 2023-03-02T15:11:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:09 smithi136 ceph-mon[125702]: pgmap v8118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:11:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:09 smithi057 ceph-mon[92072]: osdmap e580: 12 total, 12 up, 12 in 2023-03-02T15:11:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:09 smithi057 ceph-mon[92072]: pgmap v8118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:11:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:10.541+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:11:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:10.541+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:11:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:10.541+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 119 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:11:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:10.541+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 120 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:11:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:12 smithi136 ceph-mon[125702]: pgmap v8119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:11:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:12 smithi057 ceph-mon[92072]: pgmap v8119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:11:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:12 smithi122 ceph-mon[125440]: pgmap v8119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:11:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:14 smithi136 ceph-mon[125702]: pgmap v8120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:11:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:14 smithi057 ceph-mon[92072]: pgmap v8120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:11:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:14 smithi122 ceph-mon[125440]: pgmap v8120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:11:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:15.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:11:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:15.616+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:11:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:15.616+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:11:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:15.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:11:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:15.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:11:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:16 smithi136 ceph-mon[125702]: pgmap v8121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:11:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:16 smithi057 ceph-mon[92072]: pgmap v8121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:11:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:16 smithi122 ceph-mon[125440]: pgmap v8121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:11:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:18 smithi136 ceph-mon[125702]: pgmap v8122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:11:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:18 smithi057 ceph-mon[92072]: pgmap v8122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:11:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:18 smithi122 ceph-mon[125440]: pgmap v8122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:11:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:19 smithi136 ceph-mon[125702]: pgmap v8123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:11:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:19 smithi057 ceph-mon[92072]: pgmap v8123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:11:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:19 smithi122 ceph-mon[125440]: pgmap v8123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:11:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:22 smithi136 ceph-mon[125702]: pgmap v8124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:11:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:22 smithi057 ceph-mon[92072]: pgmap v8124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:11:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:22 smithi122 ceph-mon[125440]: pgmap v8124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:11:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:24 smithi136 ceph-mon[125702]: pgmap v8125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:11:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:24 smithi057 ceph-mon[92072]: pgmap v8125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:11:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:24 smithi122 ceph-mon[125440]: pgmap v8125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:11:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:26 smithi136 ceph-mon[125702]: pgmap v8126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:26 smithi057 ceph-mon[92072]: pgmap v8126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:26 smithi122 ceph-mon[125440]: pgmap v8126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:28 smithi136 ceph-mon[125702]: pgmap v8127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:28 smithi057 ceph-mon[92072]: pgmap v8127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:28.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:28 smithi122 ceph-mon[125440]: pgmap v8127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:29 smithi136 ceph-mon[125702]: pgmap v8128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:29 smithi057 ceph-mon[92072]: pgmap v8128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:29 smithi122 ceph-mon[125440]: pgmap v8128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:30.632+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:11:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:30.632+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:11:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:30.632+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:11:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:30.632+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:11:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:30.632+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:11:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:32 smithi136 ceph-mon[125702]: pgmap v8129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:32 smithi057 ceph-mon[92072]: pgmap v8129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:32 smithi122 ceph-mon[125440]: pgmap v8129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:34 smithi136 ceph-mon[125702]: pgmap v8130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:34 smithi057 ceph-mon[92072]: pgmap v8130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:34 smithi122 ceph-mon[125440]: pgmap v8130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:36 smithi136 ceph-mon[125702]: pgmap v8131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:36 smithi057 ceph-mon[92072]: pgmap v8131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:36 smithi122 ceph-mon[125440]: pgmap v8131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:38 smithi136 ceph-mon[125702]: pgmap v8132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:38 smithi057 ceph-mon[92072]: pgmap v8132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:38 smithi122 ceph-mon[125440]: pgmap v8132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:39 smithi136 ceph-mon[125702]: pgmap v8133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:39 smithi057 ceph-mon[92072]: pgmap v8133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:39 smithi122 ceph-mon[125440]: pgmap v8133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:42 smithi136 ceph-mon[125702]: pgmap v8134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:42 smithi057 ceph-mon[92072]: pgmap v8134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:42 smithi122 ceph-mon[125440]: pgmap v8134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:44 smithi136 ceph-mon[125702]: pgmap v8135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:44 smithi057 ceph-mon[92072]: pgmap v8135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:44 smithi122 ceph-mon[125440]: pgmap v8135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:45.640+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:11:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:45.640+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:11:45.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:45.640+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:11:45.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:45.640+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:11:45.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:11:45.640+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:11:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:46 smithi136 ceph-mon[125702]: pgmap v8136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:46 smithi057 ceph-mon[92072]: pgmap v8136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:46 smithi122 ceph-mon[125440]: pgmap v8136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:47 smithi136 ceph-mon[125702]: pgmap v8137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:47 smithi057 ceph-mon[92072]: pgmap v8137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:47 smithi122 ceph-mon[125440]: pgmap v8137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:49.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:49 smithi136 ceph-mon[125702]: pgmap v8138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:49 smithi057 ceph-mon[92072]: pgmap v8138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:49 smithi122 ceph-mon[125440]: pgmap v8138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:52 smithi136 ceph-mon[125702]: pgmap v8139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:11:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:52 smithi057 ceph-mon[92072]: pgmap v8139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:11:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:52 smithi122 ceph-mon[125440]: pgmap v8139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:11:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:11:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:11:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:11:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:11:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:11:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:11:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:11:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:11:53.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:11:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:54 smithi136 ceph-mon[125702]: pgmap v8140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:54 smithi057 ceph-mon[92072]: pgmap v8140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:54 smithi122 ceph-mon[125440]: pgmap v8140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:56 smithi136 ceph-mon[125702]: pgmap v8141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:56 smithi057 ceph-mon[92072]: pgmap v8141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:56 smithi122 ceph-mon[125440]: pgmap v8141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:58 smithi136 ceph-mon[125702]: pgmap v8142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:58 smithi057 ceph-mon[92072]: pgmap v8142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:58 smithi122 ceph-mon[125440]: pgmap v8142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:11:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:11:59 smithi136 ceph-mon[125702]: pgmap v8143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:11:59 smithi057 ceph-mon[92072]: pgmap v8143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:11:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:11:59 smithi122 ceph-mon[125440]: pgmap v8143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:00.656+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:12:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:00.656+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:12:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:00.656+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:12:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:00.656+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:12:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:00.656+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:12:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:02 smithi136 ceph-mon[125702]: pgmap v8144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:02 smithi057 ceph-mon[92072]: pgmap v8144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:02 smithi122 ceph-mon[125440]: pgmap v8144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:04 smithi136 ceph-mon[125702]: pgmap v8145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:12:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:04 smithi057 ceph-mon[92072]: pgmap v8145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:12:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:04 smithi122 ceph-mon[125440]: pgmap v8145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:12:06.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:06 smithi136 ceph-mon[125702]: pgmap v8146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:12:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:06 smithi057 ceph-mon[92072]: pgmap v8146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:12:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:06 smithi122 ceph-mon[125440]: pgmap v8146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:12:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:07 smithi136 ceph-mon[125702]: pgmap v8147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:12:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:07 smithi057 ceph-mon[92072]: pgmap v8147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:12:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:07 smithi122 ceph-mon[125440]: pgmap v8147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:12:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:09 smithi136 ceph-mon[125702]: pgmap v8148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:12:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:09 smithi057 ceph-mon[92072]: pgmap v8148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:12:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:09 smithi122 ceph-mon[125440]: pgmap v8148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:12:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:11 smithi136 ceph-mon[125702]: osdmap e581: 12 total, 12 up, 12 in 2023-03-02T15:12:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:11 smithi136 ceph-mon[125702]: pgmap v8150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:12:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:11 smithi057 ceph-mon[92072]: osdmap e581: 12 total, 12 up, 12 in 2023-03-02T15:12:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:11 smithi057 ceph-mon[92072]: pgmap v8150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:12:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:11 smithi122 ceph-mon[125440]: osdmap e581: 12 total, 12 up, 12 in 2023-03-02T15:12:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:11 smithi122 ceph-mon[125440]: pgmap v8150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:12:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:14 smithi136 ceph-mon[125702]: pgmap v8151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:12:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:14 smithi136 ceph-mon[125702]: osdmap e582: 12 total, 12 up, 12 in 2023-03-02T15:12:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:14 smithi057 ceph-mon[92072]: pgmap v8151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:12:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:14 smithi057 ceph-mon[92072]: osdmap e582: 12 total, 12 up, 12 in 2023-03-02T15:12:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:14 smithi122 ceph-mon[125440]: pgmap v8151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:12:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:14 smithi122 ceph-mon[125440]: osdmap e582: 12 total, 12 up, 12 in 2023-03-02T15:12:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:15.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:12:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:15.665+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:12:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:15.665+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:12:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:15.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:12:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:15.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:12:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:16 smithi136 ceph-mon[125702]: pgmap v8153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:12:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:16 smithi057 ceph-mon[92072]: pgmap v8153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:12:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:16 smithi122 ceph-mon[125440]: pgmap v8153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:12:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:18 smithi136 ceph-mon[125702]: pgmap v8154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T15:12:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:18 smithi057 ceph-mon[92072]: pgmap v8154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T15:12:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:18 smithi122 ceph-mon[125440]: pgmap v8154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T15:12:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:19 smithi136 ceph-mon[125702]: pgmap v8155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 361 B/s wr, 12 op/s 2023-03-02T15:12:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:19 smithi057 ceph-mon[92072]: pgmap v8155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 361 B/s wr, 12 op/s 2023-03-02T15:12:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:19 smithi122 ceph-mon[125440]: pgmap v8155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 361 B/s wr, 12 op/s 2023-03-02T15:12:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:22 smithi136 ceph-mon[125702]: pgmap v8156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:12:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:22 smithi057 ceph-mon[92072]: pgmap v8156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:12:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:22 smithi122 ceph-mon[125440]: pgmap v8156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:12:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:24 smithi136 ceph-mon[125702]: pgmap v8157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:12:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:24 smithi057 ceph-mon[92072]: pgmap v8157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:12:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:24 smithi122 ceph-mon[125440]: pgmap v8157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:12:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:25 smithi057 ceph-mon[92072]: pgmap v8158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T15:12:25.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:25 smithi122 ceph-mon[125440]: pgmap v8158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T15:12:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:25 smithi136 ceph-mon[125702]: pgmap v8158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T15:12:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:28 smithi136 ceph-mon[125702]: pgmap v8159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T15:12:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:28 smithi057 ceph-mon[92072]: pgmap v8159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T15:12:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:28 smithi122 ceph-mon[125440]: pgmap v8159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T15:12:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:29 smithi136 ceph-mon[125702]: pgmap v8160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:29 smithi057 ceph-mon[92072]: pgmap v8160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:29 smithi122 ceph-mon[125440]: pgmap v8160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:30.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:30.670+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:12:30.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:30.670+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:12:30.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:30.670+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:12:30.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:30.670+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:12:30.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:30.670+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:12:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:32 smithi136 ceph-mon[125702]: pgmap v8161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:32 smithi057 ceph-mon[92072]: pgmap v8161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:32 smithi122 ceph-mon[125440]: pgmap v8161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:34 smithi136 ceph-mon[125702]: pgmap v8162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:34 smithi057 ceph-mon[92072]: pgmap v8162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:34 smithi122 ceph-mon[125440]: pgmap v8162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:35 smithi136 ceph-mon[125702]: pgmap v8163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:35 smithi057 ceph-mon[92072]: pgmap v8163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:35 smithi122 ceph-mon[125440]: pgmap v8163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:38 smithi136 ceph-mon[125702]: pgmap v8164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:38 smithi057 ceph-mon[92072]: pgmap v8164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:38 smithi122 ceph-mon[125440]: pgmap v8164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:39 smithi136 ceph-mon[125702]: pgmap v8165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:39 smithi057 ceph-mon[92072]: pgmap v8165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:39 smithi122 ceph-mon[125440]: pgmap v8165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:42 smithi136 ceph-mon[125702]: pgmap v8166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:42 smithi057 ceph-mon[92072]: pgmap v8166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:42 smithi122 ceph-mon[125440]: pgmap v8166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:44 smithi136 ceph-mon[125702]: pgmap v8167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:44 smithi057 ceph-mon[92072]: pgmap v8167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:44 smithi122 ceph-mon[125440]: pgmap v8167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:45.686+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:12:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:45.686+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:12:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:45.686+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:12:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:45.686+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:12:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:12:45.686+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:12:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:46 smithi136 ceph-mon[125702]: pgmap v8168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:46 smithi057 ceph-mon[92072]: pgmap v8168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:46 smithi122 ceph-mon[125440]: pgmap v8168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:48 smithi136 ceph-mon[125702]: pgmap v8169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:48 smithi057 ceph-mon[92072]: pgmap v8169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:48 smithi122 ceph-mon[125440]: pgmap v8169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:49 smithi136 ceph-mon[125702]: pgmap v8170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:49 smithi057 ceph-mon[92072]: pgmap v8170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:49 smithi122 ceph-mon[125440]: pgmap v8170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:52 smithi136 ceph-mon[125702]: pgmap v8171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:52 smithi057 ceph-mon[92072]: pgmap v8171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:52 smithi122 ceph-mon[125440]: pgmap v8171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:12:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:12:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:12:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:12:53.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:12:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:12:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:12:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:12:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:12:53.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:12:53.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:12:53.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:12:53.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:12:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:54 smithi136 ceph-mon[125702]: pgmap v8172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:54 smithi057 ceph-mon[92072]: pgmap v8172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:54 smithi122 ceph-mon[125440]: pgmap v8172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:55 smithi136 ceph-mon[125702]: pgmap v8173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:12:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:55 smithi057 ceph-mon[92072]: pgmap v8173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:12:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:55 smithi122 ceph-mon[125440]: pgmap v8173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:12:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:58 smithi136 ceph-mon[125702]: pgmap v8174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:58 smithi057 ceph-mon[92072]: pgmap v8174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:58 smithi122 ceph-mon[125440]: pgmap v8174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:12:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:12:59 smithi136 ceph-mon[125702]: pgmap v8175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:12:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:12:59 smithi057 ceph-mon[92072]: pgmap v8175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:12:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:12:59 smithi122 ceph-mon[125440]: pgmap v8175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:13:00.688 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:00.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:13:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:00.687+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:13:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:00.687+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:13:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:00.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:13:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:00.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:13:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:02 smithi136 ceph-mon[125702]: pgmap v8176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:13:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:02 smithi057 ceph-mon[92072]: pgmap v8176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:13:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:02 smithi122 ceph-mon[125440]: pgmap v8176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:13:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:04 smithi136 ceph-mon[125702]: pgmap v8177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:13:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:04 smithi057 ceph-mon[92072]: pgmap v8177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:13:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:04 smithi122 ceph-mon[125440]: pgmap v8177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:13:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:06 smithi136 ceph-mon[125702]: pgmap v8178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:13:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:06 smithi057 ceph-mon[92072]: pgmap v8178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:13:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:06 smithi122 ceph-mon[125440]: pgmap v8178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:13:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:07 smithi136 ceph-mon[125702]: pgmap v8179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:13:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:07 smithi057 ceph-mon[92072]: pgmap v8179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:13:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:07 smithi122 ceph-mon[125440]: pgmap v8179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:13:09.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:09 smithi136 ceph-mon[125702]: pgmap v8180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:13:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:09 smithi057 ceph-mon[92072]: pgmap v8180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:13:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:09 smithi122 ceph-mon[125440]: pgmap v8180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:13:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:11 smithi136 ceph-mon[125702]: osdmap e583: 12 total, 12 up, 12 in 2023-03-02T15:13:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:11 smithi136 ceph-mon[125702]: pgmap v8182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:13:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:11 smithi057 ceph-mon[92072]: osdmap e583: 12 total, 12 up, 12 in 2023-03-02T15:13:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:11 smithi057 ceph-mon[92072]: pgmap v8182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:13:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:11 smithi122 ceph-mon[125440]: osdmap e583: 12 total, 12 up, 12 in 2023-03-02T15:13:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:11 smithi122 ceph-mon[125440]: pgmap v8182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:13:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:14 smithi136 ceph-mon[125702]: pgmap v8183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:13:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:14 smithi136 ceph-mon[125702]: osdmap e584: 12 total, 12 up, 12 in 2023-03-02T15:13:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:14 smithi057 ceph-mon[92072]: pgmap v8183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:13:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:14 smithi057 ceph-mon[92072]: osdmap e584: 12 total, 12 up, 12 in 2023-03-02T15:13:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:14 smithi122 ceph-mon[125440]: pgmap v8183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:13:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:14 smithi122 ceph-mon[125440]: osdmap e584: 12 total, 12 up, 12 in 2023-03-02T15:13:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:15.694+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:13:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:15.695+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:13:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:15.695+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:13:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:15.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:13:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:15.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:13:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:16 smithi136 ceph-mon[125702]: pgmap v8185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:13:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:16 smithi057 ceph-mon[92072]: pgmap v8185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:13:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:16 smithi122 ceph-mon[125440]: pgmap v8185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:13:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:18 smithi136 ceph-mon[125702]: pgmap v8186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:13:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:18 smithi057 ceph-mon[92072]: pgmap v8186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:13:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:18 smithi122 ceph-mon[125440]: pgmap v8186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:13:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:19 smithi136 ceph-mon[125702]: pgmap v8187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T15:13:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:19 smithi057 ceph-mon[92072]: pgmap v8187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T15:13:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:19 smithi122 ceph-mon[125440]: pgmap v8187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T15:13:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:22 smithi136 ceph-mon[125702]: pgmap v8188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:13:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:22 smithi057 ceph-mon[92072]: pgmap v8188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:13:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:22 smithi122 ceph-mon[125440]: pgmap v8188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:13:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:24 smithi136 ceph-mon[125702]: pgmap v8189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:13:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:24 smithi057 ceph-mon[92072]: pgmap v8189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:13:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:24 smithi122 ceph-mon[125440]: pgmap v8189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:13:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:25 smithi136 ceph-mon[125702]: pgmap v8190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:13:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:25 smithi057 ceph-mon[92072]: pgmap v8190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:13:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:25 smithi122 ceph-mon[125440]: pgmap v8190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:13:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:28 smithi136 ceph-mon[125702]: pgmap v8191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:13:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:28 smithi057 ceph-mon[92072]: pgmap v8191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:13:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:28 smithi122 ceph-mon[125440]: pgmap v8191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:13:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:29 smithi136 ceph-mon[125702]: pgmap v8192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:29 smithi057 ceph-mon[92072]: pgmap v8192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:29 smithi122 ceph-mon[125440]: pgmap v8192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:30.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:30.710+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:13:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:30.711+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:13:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:30.711+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:13:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:30.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:13:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:30.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:13:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:32 smithi136 ceph-mon[125702]: pgmap v8193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:32 smithi057 ceph-mon[92072]: pgmap v8193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:32 smithi122 ceph-mon[125440]: pgmap v8193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:33 smithi136 ceph-mon[125702]: pgmap v8194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:33 smithi057 ceph-mon[92072]: pgmap v8194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:33 smithi122 ceph-mon[125440]: pgmap v8194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:36 smithi136 ceph-mon[125702]: pgmap v8195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:36 smithi057 ceph-mon[92072]: pgmap v8195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:36 smithi122 ceph-mon[125440]: pgmap v8195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:37 smithi136 ceph-mon[125702]: pgmap v8196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:37 smithi057 ceph-mon[92072]: pgmap v8196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:37 smithi122 ceph-mon[125440]: pgmap v8196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:39 smithi136 ceph-mon[125702]: pgmap v8197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:39 smithi057 ceph-mon[92072]: pgmap v8197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:39 smithi122 ceph-mon[125440]: pgmap v8197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:42 smithi136 ceph-mon[125702]: pgmap v8198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:42 smithi057 ceph-mon[92072]: pgmap v8198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:42 smithi122 ceph-mon[125440]: pgmap v8198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:43 smithi136 ceph-mon[125702]: pgmap v8199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:43 smithi057 ceph-mon[92072]: pgmap v8199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:43 smithi122 ceph-mon[125440]: pgmap v8199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:45.721 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:45.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:13:45.721 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:45.720+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:13:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:45.720+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:13:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:45.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:13:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:13:45.720+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:13:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:46 smithi136 ceph-mon[125702]: pgmap v8200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:46 smithi057 ceph-mon[92072]: pgmap v8200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:46 smithi122 ceph-mon[125440]: pgmap v8200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:47 smithi057 ceph-mon[92072]: pgmap v8201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:47 smithi122 ceph-mon[125440]: pgmap v8201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:47 smithi136 ceph-mon[125702]: pgmap v8201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:49 smithi136 ceph-mon[125702]: pgmap v8202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:49 smithi057 ceph-mon[92072]: pgmap v8202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:49 smithi122 ceph-mon[125440]: pgmap v8202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:51 smithi057 ceph-mon[92072]: pgmap v8203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:51 smithi122 ceph-mon[125440]: pgmap v8203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:51 smithi136 ceph-mon[125702]: pgmap v8203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:53 smithi057 ceph-mon[92072]: pgmap v8204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:13:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:53 smithi122 ceph-mon[125440]: pgmap v8204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:13:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:53 smithi136 ceph-mon[125702]: pgmap v8204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:13:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:13:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:13:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:13:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:13:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:13:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:13:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:13:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:13:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:13:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:55 smithi136 ceph-mon[125702]: pgmap v8205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:55 smithi057 ceph-mon[92072]: pgmap v8205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:55 smithi122 ceph-mon[125440]: pgmap v8205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:57 smithi057 ceph-mon[92072]: pgmap v8206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:57 smithi122 ceph-mon[125440]: pgmap v8206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:57 smithi136 ceph-mon[125702]: pgmap v8206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:13:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:13:59 smithi136 ceph-mon[125702]: pgmap v8207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:13:59 smithi057 ceph-mon[92072]: pgmap v8207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:13:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:13:59 smithi122 ceph-mon[125440]: pgmap v8207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:00.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:14:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:00.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:14:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:00.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:14:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:00.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:14:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:00.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:14:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:01 smithi057 ceph-mon[92072]: pgmap v8208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:01 smithi122 ceph-mon[125440]: pgmap v8208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:01 smithi136 ceph-mon[125702]: pgmap v8208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:03 smithi057 ceph-mon[92072]: pgmap v8209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:14:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:03 smithi122 ceph-mon[125440]: pgmap v8209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:14:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:03 smithi136 ceph-mon[125702]: pgmap v8209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:14:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:05 smithi057 ceph-mon[92072]: pgmap v8210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:14:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:05 smithi122 ceph-mon[125440]: pgmap v8210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:14:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:05 smithi136 ceph-mon[125702]: pgmap v8210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:14:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:07 smithi057 ceph-mon[92072]: pgmap v8211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:14:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:07 smithi122 ceph-mon[125440]: pgmap v8211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:14:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:07 smithi136 ceph-mon[125702]: pgmap v8211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:14:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:08.400+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T15:14:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:08.400+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T15:14:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:08.400+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f586809dfb0 tx=0x7f587005e070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:14:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:08.400+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f586809dfb0 tx=0x7f587005e070 comp rx=0 tx=0).stop 2023-03-02T15:14:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:08.400+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T15:14:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:08.400+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T15:14:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:08.400+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T15:14:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:08.400+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T15:14:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:08.400+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:14:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:08.401+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f587006b000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T15:14:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:09 smithi136 ceph-mon[125702]: pgmap v8212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:14:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:09 smithi057 ceph-mon[92072]: pgmap v8212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:14:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:09 smithi122 ceph-mon[125440]: pgmap v8212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:14:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:10.567+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:14:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:10.567+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:14:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:10.567+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 121 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:14:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:10.567+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 120 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:14:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:11 smithi136 ceph-mon[125702]: osdmap e585: 12 total, 12 up, 12 in 2023-03-02T15:14:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:11 smithi136 ceph-mon[125702]: pgmap v8214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:14:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:11 smithi057 ceph-mon[92072]: osdmap e585: 12 total, 12 up, 12 in 2023-03-02T15:14:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:11 smithi057 ceph-mon[92072]: pgmap v8214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:14:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:11 smithi122 ceph-mon[125440]: osdmap e585: 12 total, 12 up, 12 in 2023-03-02T15:14:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:11 smithi122 ceph-mon[125440]: pgmap v8214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:14:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:13 smithi057 ceph-mon[92072]: pgmap v8215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:14:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:13 smithi122 ceph-mon[125440]: pgmap v8215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:14:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:13 smithi136 ceph-mon[125702]: pgmap v8215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:14:14.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:14 smithi136 ceph-mon[125702]: osdmap e586: 12 total, 12 up, 12 in 2023-03-02T15:14:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:14 smithi057 ceph-mon[92072]: osdmap e586: 12 total, 12 up, 12 in 2023-03-02T15:14:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:14 smithi122 ceph-mon[125440]: osdmap e586: 12 total, 12 up, 12 in 2023-03-02T15:14:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:15 smithi136 ceph-mon[125702]: pgmap v8217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:14:15.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:15 smithi057 ceph-mon[92072]: pgmap v8217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:14:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:15 smithi122 ceph-mon[125440]: pgmap v8217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:14:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:15.744+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:14:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:15.744+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:14:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:15.744+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:14:15.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:15.744+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:14:15.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:15.744+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:14:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:17 smithi057 ceph-mon[92072]: pgmap v8218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:14:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:17 smithi122 ceph-mon[125440]: pgmap v8218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:14:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:17 smithi136 ceph-mon[125702]: pgmap v8218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:14:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:19 smithi136 ceph-mon[125702]: pgmap v8219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T15:14:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:19 smithi057 ceph-mon[92072]: pgmap v8219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T15:14:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:19 smithi122 ceph-mon[125440]: pgmap v8219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T15:14:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:21 smithi057 ceph-mon[92072]: pgmap v8220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:14:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:21 smithi122 ceph-mon[125440]: pgmap v8220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:14:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:21 smithi136 ceph-mon[125702]: pgmap v8220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:14:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:23 smithi057 ceph-mon[92072]: pgmap v8221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:14:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:23 smithi122 ceph-mon[125440]: pgmap v8221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:14:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:23 smithi136 ceph-mon[125702]: pgmap v8221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:14:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:25 smithi057 ceph-mon[92072]: pgmap v8222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:14:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:25 smithi122 ceph-mon[125440]: pgmap v8222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:14:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:25 smithi136 ceph-mon[125702]: pgmap v8222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:14:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:27 smithi057 ceph-mon[92072]: pgmap v8223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:14:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:27 smithi122 ceph-mon[125440]: pgmap v8223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:14:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:27 smithi136 ceph-mon[125702]: pgmap v8223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:14:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:29 smithi136 ceph-mon[125702]: pgmap v8224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:29 smithi057 ceph-mon[92072]: pgmap v8224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:29 smithi122 ceph-mon[125440]: pgmap v8224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:30.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:30.751+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:14:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:30.752+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:14:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:30.752+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:14:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:30.752+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:14:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:30.752+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:14:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:31 smithi057 ceph-mon[92072]: pgmap v8225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:31 smithi122 ceph-mon[125440]: pgmap v8225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:31 smithi136 ceph-mon[125702]: pgmap v8225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:33 smithi057 ceph-mon[92072]: pgmap v8226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:33 smithi122 ceph-mon[125440]: pgmap v8226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:33 smithi136 ceph-mon[125702]: pgmap v8226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:35 smithi057 ceph-mon[92072]: pgmap v8227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:35 smithi122 ceph-mon[125440]: pgmap v8227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:35 smithi136 ceph-mon[125702]: pgmap v8227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:37 smithi057 ceph-mon[92072]: pgmap v8228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:37 smithi122 ceph-mon[125440]: pgmap v8228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:37 smithi136 ceph-mon[125702]: pgmap v8228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:39 smithi136 ceph-mon[125702]: pgmap v8229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:39 smithi057 ceph-mon[92072]: pgmap v8229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:39.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:39 smithi122 ceph-mon[125440]: pgmap v8229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:41 smithi057 ceph-mon[92072]: pgmap v8230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:41 smithi122 ceph-mon[125440]: pgmap v8230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:41 smithi136 ceph-mon[125702]: pgmap v8230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:43 smithi057 ceph-mon[92072]: pgmap v8231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:43 smithi122 ceph-mon[125440]: pgmap v8231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:43 smithi136 ceph-mon[125702]: pgmap v8231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:45 smithi057 ceph-mon[92072]: pgmap v8232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:45 smithi122 ceph-mon[125440]: pgmap v8232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:45 smithi136 ceph-mon[125702]: pgmap v8232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:45.767+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:14:45.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:45.768+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:14:45.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:45.768+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:14:45.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:45.768+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:14:45.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:45.768+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:14:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:47 smithi057 ceph-mon[92072]: pgmap v8233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:47 smithi122 ceph-mon[125440]: pgmap v8233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:47 smithi136 ceph-mon[125702]: pgmap v8233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:49.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:49 smithi136 ceph-mon[125702]: pgmap v8234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:49 smithi057 ceph-mon[92072]: pgmap v8234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:49 smithi122 ceph-mon[125440]: pgmap v8234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:51 smithi057 ceph-mon[92072]: pgmap v8235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:51 smithi122 ceph-mon[125440]: pgmap v8235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:51 smithi136 ceph-mon[125702]: pgmap v8235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:53 smithi057 ceph-mon[92072]: pgmap v8236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:53 smithi122 ceph-mon[125440]: pgmap v8236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:53 smithi136 ceph-mon[125702]: pgmap v8236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:14:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:14:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:14:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:55.573+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:14:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:55.573+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:14:55.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:55.574+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 122 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:14:55.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:14:55.574+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 121 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:14:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:55 smithi136 ceph-mon[125702]: pgmap v8237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:55 smithi057 ceph-mon[92072]: pgmap v8237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:55 smithi122 ceph-mon[125440]: pgmap v8237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:14:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: pgmap v8238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: pgmap v8238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: pgmap v8238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:14:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:58.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:14:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:14:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 166.6M 2023-03-02T15:14:59.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 174792314: error parsing value: Value '174792314' is below minimum 939524096 2023-03-02T15:14:59.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:14:59.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:14:59.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:14:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:14:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:14:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 166.6M 2023-03-02T15:14:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 174792314: error parsing value: Value '174792314' is below minimum 939524096 2023-03-02T15:14:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:14:59.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:14:59.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:14:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:14:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:14:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:14:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 166.6M 2023-03-02T15:14:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 174792314: error parsing value: Value '174792314' is below minimum 939524096 2023-03-02T15:14:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:14:59.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:14:59.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:14:59.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:14:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:15:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:00 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:15:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:00 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:15:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:00 smithi136 ceph-mon[125702]: pgmap v8239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:00 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:15:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:00 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:15:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:00 smithi057 ceph-mon[92072]: pgmap v8239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:00 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:15:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:00 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:15:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:00 smithi122 ceph-mon[125440]: pgmap v8239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:00.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:15:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:00.783+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:15:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:00.783+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:15:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:00.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:15:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:00.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:15:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:02 smithi136 ceph-mon[125702]: pgmap v8240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:02 smithi057 ceph-mon[92072]: pgmap v8240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:02 smithi122 ceph-mon[125440]: pgmap v8240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:04 smithi136 ceph-mon[125702]: pgmap v8241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:15:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:04 smithi057 ceph-mon[92072]: pgmap v8241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:15:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:04 smithi122 ceph-mon[125440]: pgmap v8241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:15:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:06 smithi136 ceph-mon[125702]: pgmap v8242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:15:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:06 smithi057 ceph-mon[92072]: pgmap v8242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:15:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:06 smithi122 ceph-mon[125440]: pgmap v8242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:15:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:08 smithi136 ceph-mon[125702]: pgmap v8243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:15:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:08 smithi057 ceph-mon[92072]: pgmap v8243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:15:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:08 smithi122 ceph-mon[125440]: pgmap v8243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:15:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:09 smithi136 ceph-mon[125702]: pgmap v8244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:15:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:09 smithi057 ceph-mon[92072]: pgmap v8244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:15:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:09 smithi122 ceph-mon[125440]: pgmap v8244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:15:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:11 smithi136 ceph-mon[125702]: osdmap e587: 12 total, 12 up, 12 in 2023-03-02T15:15:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:11 smithi136 ceph-mon[125702]: pgmap v8246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:15:11.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:11 smithi057 ceph-mon[92072]: osdmap e587: 12 total, 12 up, 12 in 2023-03-02T15:15:11.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:11 smithi057 ceph-mon[92072]: pgmap v8246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:15:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:11 smithi122 ceph-mon[125440]: osdmap e587: 12 total, 12 up, 12 in 2023-03-02T15:15:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:11 smithi122 ceph-mon[125440]: pgmap v8246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:15:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:13 smithi057 ceph-mon[92072]: pgmap v8247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:15:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:13 smithi122 ceph-mon[125440]: pgmap v8247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:15:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:13 smithi136 ceph-mon[125702]: pgmap v8247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:15:14.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:14 smithi136 ceph-mon[125702]: osdmap e588: 12 total, 12 up, 12 in 2023-03-02T15:15:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:14 smithi057 ceph-mon[92072]: osdmap e588: 12 total, 12 up, 12 in 2023-03-02T15:15:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:14 smithi122 ceph-mon[125440]: osdmap e588: 12 total, 12 up, 12 in 2023-03-02T15:15:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:15 smithi136 ceph-mon[125702]: pgmap v8249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:15:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:15 smithi057 ceph-mon[92072]: pgmap v8249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:15:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:15 smithi122 ceph-mon[125440]: pgmap v8249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:15:15.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:15.798+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:15:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:15.798+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:15:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:15.798+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:15:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:15.798+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:15:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:15.798+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:15:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:17 smithi057 ceph-mon[92072]: pgmap v8250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:15:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:17 smithi122 ceph-mon[125440]: pgmap v8250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:15:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:17 smithi136 ceph-mon[125702]: pgmap v8250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:15:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:19 smithi136 ceph-mon[125702]: pgmap v8251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T15:15:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:19 smithi057 ceph-mon[92072]: pgmap v8251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T15:15:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:19 smithi122 ceph-mon[125440]: pgmap v8251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T15:15:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:21 smithi057 ceph-mon[92072]: pgmap v8252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:15:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:21 smithi122 ceph-mon[125440]: pgmap v8252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:15:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:21 smithi136 ceph-mon[125702]: pgmap v8252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:15:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:23 smithi057 ceph-mon[92072]: pgmap v8253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:15:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:23 smithi122 ceph-mon[125440]: pgmap v8253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:15:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:23 smithi136 ceph-mon[125702]: pgmap v8253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:15:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:25 smithi057 ceph-mon[92072]: pgmap v8254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:15:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:25 smithi122 ceph-mon[125440]: pgmap v8254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:15:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:25 smithi136 ceph-mon[125702]: pgmap v8254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:15:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:27 smithi057 ceph-mon[92072]: pgmap v8255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:15:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:27 smithi122 ceph-mon[125440]: pgmap v8255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:15:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:27 smithi136 ceph-mon[125702]: pgmap v8255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:15:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:29 smithi136 ceph-mon[125702]: pgmap v8256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:29 smithi057 ceph-mon[92072]: pgmap v8256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:29 smithi122 ceph-mon[125440]: pgmap v8256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:30.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:15:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:30.801+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:15:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:30.801+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:15:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:30.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:15:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:30.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:15:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:31 smithi057 ceph-mon[92072]: pgmap v8257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:31 smithi122 ceph-mon[125440]: pgmap v8257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:31 smithi136 ceph-mon[125702]: pgmap v8257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:33 smithi057 ceph-mon[92072]: pgmap v8258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:33 smithi122 ceph-mon[125440]: pgmap v8258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:33 smithi136 ceph-mon[125702]: pgmap v8258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:35 smithi057 ceph-mon[92072]: pgmap v8259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:35 smithi122 ceph-mon[125440]: pgmap v8259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:35 smithi136 ceph-mon[125702]: pgmap v8259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:37 smithi057 ceph-mon[92072]: pgmap v8260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:37 smithi122 ceph-mon[125440]: pgmap v8260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:37 smithi136 ceph-mon[125702]: pgmap v8260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:39 smithi136 ceph-mon[125702]: pgmap v8261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:39 smithi057 ceph-mon[92072]: pgmap v8261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:39 smithi122 ceph-mon[125440]: pgmap v8261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:41 smithi057 ceph-mon[92072]: pgmap v8262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:41 smithi122 ceph-mon[125440]: pgmap v8262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:41 smithi136 ceph-mon[125702]: pgmap v8262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:43 smithi057 ceph-mon[92072]: pgmap v8263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:43 smithi122 ceph-mon[125440]: pgmap v8263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:43 smithi136 ceph-mon[125702]: pgmap v8263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:45 smithi057 ceph-mon[92072]: pgmap v8264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:45 smithi122 ceph-mon[125440]: pgmap v8264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:45 smithi136 ceph-mon[125702]: pgmap v8264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:45.812+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:15:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:45.812+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:15:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:45.812+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:15:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:45.812+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:15:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:15:45.812+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:15:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:47 smithi057 ceph-mon[92072]: pgmap v8265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:47 smithi122 ceph-mon[125440]: pgmap v8265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:47 smithi136 ceph-mon[125702]: pgmap v8265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:49 smithi136 ceph-mon[125702]: pgmap v8266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:49 smithi057 ceph-mon[92072]: pgmap v8266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:49 smithi122 ceph-mon[125440]: pgmap v8266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:51 smithi057 ceph-mon[92072]: pgmap v8267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:51 smithi122 ceph-mon[125440]: pgmap v8267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:51 smithi136 ceph-mon[125702]: pgmap v8267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:53 smithi057 ceph-mon[92072]: pgmap v8268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:53 smithi122 ceph-mon[125440]: pgmap v8268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:53 smithi136 ceph-mon[125702]: pgmap v8268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:55 smithi057 ceph-mon[92072]: pgmap v8269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:55 smithi122 ceph-mon[125440]: pgmap v8269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:55 smithi136 ceph-mon[125702]: pgmap v8269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:57 smithi057 ceph-mon[92072]: pgmap v8270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:57 smithi122 ceph-mon[125440]: pgmap v8270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:57 smithi136 ceph-mon[125702]: pgmap v8270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:15:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:15:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:59 smithi136 ceph-mon[125702]: pgmap v8271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:15:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:15:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:15:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:15:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:15:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:59 smithi057 ceph-mon[92072]: pgmap v8271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:15:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:15:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:15:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:15:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:15:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:59 smithi122 ceph-mon[125440]: pgmap v8271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:15:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:15:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:15:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:15:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:16:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:00.827+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:16:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:00.827+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:16:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:00.827+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:16:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:00.827+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:16:00.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:00.827+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:16:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:01 smithi057 ceph-mon[92072]: pgmap v8272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:01 smithi122 ceph-mon[125440]: pgmap v8272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:01 smithi136 ceph-mon[125702]: pgmap v8272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:03 smithi057 ceph-mon[92072]: pgmap v8273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:16:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:03 smithi122 ceph-mon[125440]: pgmap v8273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:16:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:03 smithi136 ceph-mon[125702]: pgmap v8273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:16:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:05 smithi057 ceph-mon[92072]: pgmap v8274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:16:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:05 smithi122 ceph-mon[125440]: pgmap v8274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:16:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:05 smithi136 ceph-mon[125702]: pgmap v8274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:16:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:07 smithi057 ceph-mon[92072]: pgmap v8275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:16:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:07 smithi122 ceph-mon[125440]: pgmap v8275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:16:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:07 smithi136 ceph-mon[125702]: pgmap v8275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:16:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:09 smithi136 ceph-mon[125702]: pgmap v8276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:16:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:09 smithi057 ceph-mon[92072]: pgmap v8276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:16:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:09 smithi122 ceph-mon[125440]: pgmap v8276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:16:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:11 smithi136 ceph-mon[125702]: osdmap e589: 12 total, 12 up, 12 in 2023-03-02T15:16:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:11 smithi136 ceph-mon[125702]: pgmap v8278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:16:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:11 smithi057 ceph-mon[92072]: osdmap e589: 12 total, 12 up, 12 in 2023-03-02T15:16:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:11 smithi057 ceph-mon[92072]: pgmap v8278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:16:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:11 smithi122 ceph-mon[125440]: osdmap e589: 12 total, 12 up, 12 in 2023-03-02T15:16:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:11 smithi122 ceph-mon[125440]: pgmap v8278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:16:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:13 smithi057 ceph-mon[92072]: pgmap v8279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:16:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:13 smithi122 ceph-mon[125440]: pgmap v8279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:16:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:13 smithi136 ceph-mon[125702]: pgmap v8279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:16:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:14 smithi136 ceph-mon[125702]: osdmap e590: 12 total, 12 up, 12 in 2023-03-02T15:16:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:14 smithi057 ceph-mon[92072]: osdmap e590: 12 total, 12 up, 12 in 2023-03-02T15:16:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:14 smithi122 ceph-mon[125440]: osdmap e590: 12 total, 12 up, 12 in 2023-03-02T15:16:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:15 smithi136 ceph-mon[125702]: pgmap v8281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:16:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:15 smithi057 ceph-mon[92072]: pgmap v8281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:16:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:15 smithi122 ceph-mon[125440]: pgmap v8281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:16:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:15.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:16:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:15.840+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:16:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:15.840+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:16:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:15.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:16:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:15.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:16:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:17 smithi057 ceph-mon[92072]: pgmap v8282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:16:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:17 smithi122 ceph-mon[125440]: pgmap v8282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:16:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:17 smithi136 ceph-mon[125702]: pgmap v8282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:16:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:19 smithi136 ceph-mon[125702]: pgmap v8283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T15:16:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:19 smithi057 ceph-mon[92072]: pgmap v8283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T15:16:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:19 smithi122 ceph-mon[125440]: pgmap v8283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T15:16:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:21 smithi057 ceph-mon[92072]: pgmap v8284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:16:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:21 smithi122 ceph-mon[125440]: pgmap v8284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:16:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:21 smithi136 ceph-mon[125702]: pgmap v8284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:16:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:23 smithi057 ceph-mon[92072]: pgmap v8285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:16:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:23 smithi122 ceph-mon[125440]: pgmap v8285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:16:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:23 smithi136 ceph-mon[125702]: pgmap v8285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:16:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:25 smithi057 ceph-mon[92072]: pgmap v8286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:16:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:25 smithi122 ceph-mon[125440]: pgmap v8286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:16:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:25 smithi136 ceph-mon[125702]: pgmap v8286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:16:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:27 smithi057 ceph-mon[92072]: pgmap v8287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:16:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:27 smithi122 ceph-mon[125440]: pgmap v8287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:16:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:27 smithi136 ceph-mon[125702]: pgmap v8287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:16:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:29 smithi136 ceph-mon[125702]: pgmap v8288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:29 smithi057 ceph-mon[92072]: pgmap v8288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:29 smithi122 ceph-mon[125440]: pgmap v8288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:30.850+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:16:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:30.851+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:16:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:30.851+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:16:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:30.851+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:16:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:30.851+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:16:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:31 smithi057 ceph-mon[92072]: pgmap v8289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:31 smithi122 ceph-mon[125440]: pgmap v8289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:31 smithi136 ceph-mon[125702]: pgmap v8289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:33 smithi057 ceph-mon[92072]: pgmap v8290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:33 smithi122 ceph-mon[125440]: pgmap v8290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:33 smithi136 ceph-mon[125702]: pgmap v8290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:35.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:35 smithi057 ceph-mon[92072]: pgmap v8291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:35 smithi122 ceph-mon[125440]: pgmap v8291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:35 smithi136 ceph-mon[125702]: pgmap v8291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:37 smithi057 ceph-mon[92072]: pgmap v8292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:37 smithi122 ceph-mon[125440]: pgmap v8292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:37 smithi136 ceph-mon[125702]: pgmap v8292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:39 smithi136 ceph-mon[125702]: pgmap v8293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:39 smithi057 ceph-mon[92072]: pgmap v8293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:39 smithi122 ceph-mon[125440]: pgmap v8293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:41 smithi057 ceph-mon[92072]: pgmap v8294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:41 smithi122 ceph-mon[125440]: pgmap v8294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:41 smithi136 ceph-mon[125702]: pgmap v8294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:43 smithi057 ceph-mon[92072]: pgmap v8295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:43 smithi122 ceph-mon[125440]: pgmap v8295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:43 smithi136 ceph-mon[125702]: pgmap v8295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:45 smithi057 ceph-mon[92072]: pgmap v8296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:45 smithi122 ceph-mon[125440]: pgmap v8296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:45 smithi136 ceph-mon[125702]: pgmap v8296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:45.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:16:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:45.856+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:16:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:45.856+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:16:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:45.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:16:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:16:45.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:16:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:47 smithi057 ceph-mon[92072]: pgmap v8297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:47 smithi122 ceph-mon[125440]: pgmap v8297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:47 smithi136 ceph-mon[125702]: pgmap v8297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:49 smithi136 ceph-mon[125702]: pgmap v8298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:49 smithi057 ceph-mon[92072]: pgmap v8298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:49 smithi122 ceph-mon[125440]: pgmap v8298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:51 smithi057 ceph-mon[92072]: pgmap v8299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:51 smithi122 ceph-mon[125440]: pgmap v8299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:51 smithi136 ceph-mon[125702]: pgmap v8299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:53 smithi057 ceph-mon[92072]: pgmap v8300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:53 smithi122 ceph-mon[125440]: pgmap v8300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:53 smithi136 ceph-mon[125702]: pgmap v8300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:55 smithi057 ceph-mon[92072]: pgmap v8301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:55 smithi122 ceph-mon[125440]: pgmap v8301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:55.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:55 smithi136 ceph-mon[125702]: pgmap v8301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:57 smithi057 ceph-mon[92072]: pgmap v8302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:57 smithi122 ceph-mon[125440]: pgmap v8302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:57 smithi136 ceph-mon[125702]: pgmap v8302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:16:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:16:59 smithi136 ceph-mon[125702]: pgmap v8303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:16:59 smithi057 ceph-mon[92072]: pgmap v8303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:16:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:16:59 smithi122 ceph-mon[125440]: pgmap v8303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:17:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:17:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:17:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:17:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:17:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:17:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:17:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:17:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:17:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:00.871+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:17:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:00.872+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:17:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:00.872+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:17:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:00.872+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:17:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:00.872+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:17:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:17:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:17:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:17:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:01 smithi136 ceph-mon[125702]: pgmap v8304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:17:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:17:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:17:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:01 smithi057 ceph-mon[92072]: pgmap v8304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:17:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:17:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:17:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:01 smithi122 ceph-mon[125440]: pgmap v8304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:03 smithi057 ceph-mon[92072]: pgmap v8305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:17:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:03 smithi122 ceph-mon[125440]: pgmap v8305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:17:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:03 smithi136 ceph-mon[125702]: pgmap v8305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:17:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:05 smithi057 ceph-mon[92072]: pgmap v8306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:17:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:05 smithi122 ceph-mon[125440]: pgmap v8306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:17:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:05 smithi136 ceph-mon[125702]: pgmap v8306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:17:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:07 smithi057 ceph-mon[92072]: pgmap v8307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:17:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:07 smithi122 ceph-mon[125440]: pgmap v8307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:17:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:07 smithi136 ceph-mon[125702]: pgmap v8307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:17:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:09 smithi136 ceph-mon[125702]: pgmap v8308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:17:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:09 smithi057 ceph-mon[92072]: pgmap v8308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:17:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:09 smithi122 ceph-mon[125440]: pgmap v8308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:17:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:10.594+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:17:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:10.594+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:17:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:10.594+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 123 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:17:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:10.594+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 122 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:17:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:11 smithi136 ceph-mon[125702]: osdmap e591: 12 total, 12 up, 12 in 2023-03-02T15:17:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:11 smithi136 ceph-mon[125702]: pgmap v8310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:17:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:11 smithi057 ceph-mon[92072]: osdmap e591: 12 total, 12 up, 12 in 2023-03-02T15:17:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:11 smithi057 ceph-mon[92072]: pgmap v8310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:17:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:11 smithi122 ceph-mon[125440]: osdmap e591: 12 total, 12 up, 12 in 2023-03-02T15:17:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:11 smithi122 ceph-mon[125440]: pgmap v8310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:17:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:13 smithi057 ceph-mon[92072]: pgmap v8311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:17:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:13 smithi122 ceph-mon[125440]: pgmap v8311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:17:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:13 smithi136 ceph-mon[125702]: pgmap v8311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:17:14.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:14 smithi136 ceph-mon[125702]: osdmap e592: 12 total, 12 up, 12 in 2023-03-02T15:17:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:14 smithi057 ceph-mon[92072]: osdmap e592: 12 total, 12 up, 12 in 2023-03-02T15:17:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:14 smithi122 ceph-mon[125440]: osdmap e592: 12 total, 12 up, 12 in 2023-03-02T15:17:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:15 smithi136 ceph-mon[125702]: pgmap v8313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:17:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:15 smithi057 ceph-mon[92072]: pgmap v8313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:17:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:15 smithi122 ceph-mon[125440]: pgmap v8313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:17:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:15.884+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:17:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:15.884+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:17:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:15.884+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:17:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:15.884+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:17:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:15.884+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:17:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:17 smithi057 ceph-mon[92072]: pgmap v8314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:17:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:17 smithi122 ceph-mon[125440]: pgmap v8314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:17:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:17 smithi136 ceph-mon[125702]: pgmap v8314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:17:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:19 smithi136 ceph-mon[125702]: pgmap v8315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:17:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:19 smithi057 ceph-mon[92072]: pgmap v8315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:17:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:19 smithi122 ceph-mon[125440]: pgmap v8315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:17:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:21 smithi057 ceph-mon[92072]: pgmap v8316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:17:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:21 smithi122 ceph-mon[125440]: pgmap v8316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:17:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:21 smithi136 ceph-mon[125702]: pgmap v8316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:17:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:23 smithi057 ceph-mon[92072]: pgmap v8317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:17:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:23 smithi122 ceph-mon[125440]: pgmap v8317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:17:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:23 smithi136 ceph-mon[125702]: pgmap v8317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:17:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:25 smithi057 ceph-mon[92072]: pgmap v8318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:17:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:25 smithi122 ceph-mon[125440]: pgmap v8318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:17:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:25 smithi136 ceph-mon[125702]: pgmap v8318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:17:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:27 smithi057 ceph-mon[92072]: pgmap v8319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:17:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:27 smithi122 ceph-mon[125440]: pgmap v8319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:17:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:27 smithi136 ceph-mon[125702]: pgmap v8319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:17:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:29 smithi136 ceph-mon[125702]: pgmap v8320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:29 smithi057 ceph-mon[92072]: pgmap v8320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:29 smithi122 ceph-mon[125440]: pgmap v8320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:30.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:17:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:30.897+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:17:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:30.897+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:17:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:30.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:17:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:30.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:17:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:31 smithi057 ceph-mon[92072]: pgmap v8321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:31 smithi122 ceph-mon[125440]: pgmap v8321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:31 smithi136 ceph-mon[125702]: pgmap v8321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:33 smithi057 ceph-mon[92072]: pgmap v8322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:33 smithi122 ceph-mon[125440]: pgmap v8322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:33 smithi136 ceph-mon[125702]: pgmap v8322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:35 smithi057 ceph-mon[92072]: pgmap v8323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:35 smithi122 ceph-mon[125440]: pgmap v8323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:35 smithi136 ceph-mon[125702]: pgmap v8323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:37 smithi057 ceph-mon[92072]: pgmap v8324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:37 smithi122 ceph-mon[125440]: pgmap v8324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:37 smithi136 ceph-mon[125702]: pgmap v8324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:39 smithi136 ceph-mon[125702]: pgmap v8325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:39 smithi057 ceph-mon[92072]: pgmap v8325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:39 smithi122 ceph-mon[125440]: pgmap v8325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:41 smithi057 ceph-mon[92072]: pgmap v8326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:41 smithi122 ceph-mon[125440]: pgmap v8326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:41 smithi136 ceph-mon[125702]: pgmap v8326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:43 smithi057 ceph-mon[92072]: pgmap v8327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:43 smithi122 ceph-mon[125440]: pgmap v8327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:43 smithi136 ceph-mon[125702]: pgmap v8327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:45 smithi057 ceph-mon[92072]: pgmap v8328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:45 smithi122 ceph-mon[125440]: pgmap v8328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:45 smithi136 ceph-mon[125702]: pgmap v8328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:45.914+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:17:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:45.914+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:17:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:45.914+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:17:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:45.914+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:17:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:17:45.914+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:17:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:47 smithi057 ceph-mon[92072]: pgmap v8329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:47 smithi122 ceph-mon[125440]: pgmap v8329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:47 smithi136 ceph-mon[125702]: pgmap v8329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:49 smithi136 ceph-mon[125702]: pgmap v8330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:49 smithi057 ceph-mon[92072]: pgmap v8330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:49 smithi122 ceph-mon[125440]: pgmap v8330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:51 smithi057 ceph-mon[92072]: pgmap v8331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:51 smithi122 ceph-mon[125440]: pgmap v8331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:51 smithi136 ceph-mon[125702]: pgmap v8331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:53 smithi057 ceph-mon[92072]: pgmap v8332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:53 smithi122 ceph-mon[125440]: pgmap v8332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:53 smithi136 ceph-mon[125702]: pgmap v8332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:55 smithi057 ceph-mon[92072]: pgmap v8333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:55 smithi122 ceph-mon[125440]: pgmap v8333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:55 smithi136 ceph-mon[125702]: pgmap v8333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:57 smithi057 ceph-mon[92072]: pgmap v8334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:57 smithi122 ceph-mon[125440]: pgmap v8334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:57 smithi136 ceph-mon[125702]: pgmap v8334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:17:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:17:59 smithi136 ceph-mon[125702]: pgmap v8335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:17:59 smithi057 ceph-mon[92072]: pgmap v8335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:17:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:17:59 smithi122 ceph-mon[125440]: pgmap v8335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:00.927+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:18:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:00.928+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:18:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:00.928+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:18:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:00.928+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:18:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:00.928+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:18:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:18:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:18:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:18:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:01 smithi057 ceph-mon[92072]: pgmap v8336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:01 smithi122 ceph-mon[125440]: pgmap v8336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:01 smithi136 ceph-mon[125702]: pgmap v8336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:18:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:18:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:18:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:18:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:18:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:18:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:18:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:03 smithi057 ceph-mon[92072]: pgmap v8337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:18:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:03 smithi122 ceph-mon[125440]: pgmap v8337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:18:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:03 smithi136 ceph-mon[125702]: pgmap v8337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:18:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:05 smithi057 ceph-mon[92072]: pgmap v8338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:18:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:05 smithi122 ceph-mon[125440]: pgmap v8338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:18:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:05 smithi136 ceph-mon[125702]: pgmap v8338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:18:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:07 smithi057 ceph-mon[92072]: pgmap v8339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:18:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:07 smithi122 ceph-mon[125440]: pgmap v8339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:18:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:07 smithi136 ceph-mon[125702]: pgmap v8339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:18:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:09 smithi136 ceph-mon[125702]: pgmap v8340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:18:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:09 smithi057 ceph-mon[92072]: pgmap v8340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:18:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:09 smithi122 ceph-mon[125440]: pgmap v8340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:18:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:11 smithi136 ceph-mon[125702]: osdmap e593: 12 total, 12 up, 12 in 2023-03-02T15:18:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:11 smithi136 ceph-mon[125702]: pgmap v8342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:18:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:11 smithi057 ceph-mon[92072]: osdmap e593: 12 total, 12 up, 12 in 2023-03-02T15:18:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:11 smithi057 ceph-mon[92072]: pgmap v8342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:18:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:11 smithi122 ceph-mon[125440]: osdmap e593: 12 total, 12 up, 12 in 2023-03-02T15:18:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:11 smithi122 ceph-mon[125440]: pgmap v8342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:18:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:13 smithi057 ceph-mon[92072]: pgmap v8343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:18:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:13 smithi122 ceph-mon[125440]: pgmap v8343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:18:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:13 smithi136 ceph-mon[125702]: pgmap v8343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:18:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:14 smithi136 ceph-mon[125702]: osdmap e594: 12 total, 12 up, 12 in 2023-03-02T15:18:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:14 smithi057 ceph-mon[92072]: osdmap e594: 12 total, 12 up, 12 in 2023-03-02T15:18:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:14 smithi122 ceph-mon[125440]: osdmap e594: 12 total, 12 up, 12 in 2023-03-02T15:18:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:15 smithi136 ceph-mon[125702]: pgmap v8345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:18:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:15 smithi057 ceph-mon[92072]: pgmap v8345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:18:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:15 smithi122 ceph-mon[125440]: pgmap v8345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:18:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:15.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:18:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:15.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:18:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:15.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:18:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:15.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:18:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:15.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:18:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:17 smithi057 ceph-mon[92072]: pgmap v8346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:18:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:17 smithi122 ceph-mon[125440]: pgmap v8346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:18:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:17 smithi136 ceph-mon[125702]: pgmap v8346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:18:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:19 smithi136 ceph-mon[125702]: pgmap v8347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:18:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:19 smithi057 ceph-mon[92072]: pgmap v8347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:18:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:19 smithi122 ceph-mon[125440]: pgmap v8347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:18:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:21 smithi057 ceph-mon[92072]: pgmap v8348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:18:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:21 smithi122 ceph-mon[125440]: pgmap v8348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:18:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:21 smithi136 ceph-mon[125702]: pgmap v8348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:18:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:23 smithi057 ceph-mon[92072]: pgmap v8349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:18:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:23 smithi122 ceph-mon[125440]: pgmap v8349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:18:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:23 smithi136 ceph-mon[125702]: pgmap v8349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:18:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:25 smithi057 ceph-mon[92072]: pgmap v8350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:18:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:25 smithi122 ceph-mon[125440]: pgmap v8350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:18:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:25 smithi136 ceph-mon[125702]: pgmap v8350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T15:18:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:27 smithi057 ceph-mon[92072]: pgmap v8351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:18:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:27 smithi122 ceph-mon[125440]: pgmap v8351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:18:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:27 smithi136 ceph-mon[125702]: pgmap v8351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:18:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:29 smithi136 ceph-mon[125702]: pgmap v8352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:29 smithi057 ceph-mon[92072]: pgmap v8352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:29 smithi122 ceph-mon[125440]: pgmap v8352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:30.956+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:18:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:30.956+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:18:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:30.956+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:18:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:30.956+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:18:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:30.956+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:18:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:31 smithi057 ceph-mon[92072]: pgmap v8353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:31 smithi122 ceph-mon[125440]: pgmap v8353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:31 smithi136 ceph-mon[125702]: pgmap v8353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:33 smithi057 ceph-mon[92072]: pgmap v8354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:33 smithi122 ceph-mon[125440]: pgmap v8354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:33 smithi136 ceph-mon[125702]: pgmap v8354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:35 smithi057 ceph-mon[92072]: pgmap v8355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:35 smithi122 ceph-mon[125440]: pgmap v8355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:35 smithi136 ceph-mon[125702]: pgmap v8355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:37 smithi057 ceph-mon[92072]: pgmap v8356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:37 smithi122 ceph-mon[125440]: pgmap v8356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:37 smithi136 ceph-mon[125702]: pgmap v8356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:39 smithi136 ceph-mon[125702]: pgmap v8357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:39 smithi057 ceph-mon[92072]: pgmap v8357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:39 smithi122 ceph-mon[125440]: pgmap v8357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:41 smithi057 ceph-mon[92072]: pgmap v8358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:41 smithi122 ceph-mon[125440]: pgmap v8358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:41 smithi136 ceph-mon[125702]: pgmap v8358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:43 smithi057 ceph-mon[92072]: pgmap v8359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:43 smithi122 ceph-mon[125440]: pgmap v8359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:43 smithi136 ceph-mon[125702]: pgmap v8359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:45 smithi057 ceph-mon[92072]: pgmap v8360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:45 smithi122 ceph-mon[125440]: pgmap v8360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:45 smithi136 ceph-mon[125702]: pgmap v8360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:45.959+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:18:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:45.959+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:18:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:45.959+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:18:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:45.959+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:18:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:18:45.959+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:18:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:47 smithi057 ceph-mon[92072]: pgmap v8361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:47 smithi122 ceph-mon[125440]: pgmap v8361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:47 smithi136 ceph-mon[125702]: pgmap v8361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:49 smithi136 ceph-mon[125702]: pgmap v8362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:49 smithi057 ceph-mon[92072]: pgmap v8362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:49 smithi122 ceph-mon[125440]: pgmap v8362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:51 smithi057 ceph-mon[92072]: pgmap v8363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:51 smithi122 ceph-mon[125440]: pgmap v8363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:51 smithi136 ceph-mon[125702]: pgmap v8363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:53 smithi057 ceph-mon[92072]: pgmap v8364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:53 smithi122 ceph-mon[125440]: pgmap v8364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:53 smithi136 ceph-mon[125702]: pgmap v8364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:55 smithi057 ceph-mon[92072]: pgmap v8365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:55 smithi122 ceph-mon[125440]: pgmap v8365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:55 smithi136 ceph-mon[125702]: pgmap v8365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:57 smithi057 ceph-mon[92072]: pgmap v8366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:57 smithi122 ceph-mon[125440]: pgmap v8366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:57 smithi136 ceph-mon[125702]: pgmap v8366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:18:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:18:59 smithi136 ceph-mon[125702]: pgmap v8367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:18:59 smithi057 ceph-mon[92072]: pgmap v8367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:18:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:18:59 smithi122 ceph-mon[125440]: pgmap v8367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:00.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:19:00.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:00.975+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:19:00.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:00.975+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:19:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:00.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:19:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:00.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:19:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:01 smithi122 ceph-mon[125440]: pgmap v8368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:01 smithi136 ceph-mon[125702]: pgmap v8368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:01 smithi057 ceph-mon[92072]: pgmap v8368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:02.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:19:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:19:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:19:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:19:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:19:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:19:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:03 smithi136 ceph-mon[125702]: pgmap v8369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:19:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:19:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:19:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:19:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:03 smithi057 ceph-mon[92072]: pgmap v8369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:19:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:19:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:19:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:19:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:03 smithi122 ceph-mon[125440]: pgmap v8369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:19:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:05 smithi057 ceph-mon[92072]: pgmap v8370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:19:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:05 smithi122 ceph-mon[125440]: pgmap v8370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:19:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:05 smithi136 ceph-mon[125702]: pgmap v8370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:19:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:07 smithi122 ceph-mon[125440]: osdmap e595: 12 total, 12 up, 12 in 2023-03-02T15:19:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:07 smithi122 ceph-mon[125440]: pgmap v8372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:19:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:07 smithi136 ceph-mon[125702]: osdmap e595: 12 total, 12 up, 12 in 2023-03-02T15:19:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:07 smithi136 ceph-mon[125702]: pgmap v8372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:19:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:07 smithi057 ceph-mon[92072]: osdmap e595: 12 total, 12 up, 12 in 2023-03-02T15:19:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:07 smithi057 ceph-mon[92072]: pgmap v8372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:19:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:09 smithi136 ceph-mon[125702]: osdmap e596: 12 total, 12 up, 12 in 2023-03-02T15:19:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:09 smithi136 ceph-mon[125702]: pgmap v8374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:19:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:09 smithi057 ceph-mon[92072]: osdmap e596: 12 total, 12 up, 12 in 2023-03-02T15:19:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:09 smithi057 ceph-mon[92072]: pgmap v8374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:19:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:09 smithi122 ceph-mon[125440]: osdmap e596: 12 total, 12 up, 12 in 2023-03-02T15:19:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:09 smithi122 ceph-mon[125440]: pgmap v8374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:19:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:11 smithi122 ceph-mon[125440]: pgmap v8375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:19:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:11 smithi136 ceph-mon[125702]: pgmap v8375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:19:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:11 smithi057 ceph-mon[92072]: pgmap v8375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:19:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:13 smithi122 ceph-mon[125440]: pgmap v8376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:19:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:13 smithi136 ceph-mon[125702]: pgmap v8376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:19:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:13 smithi057 ceph-mon[92072]: pgmap v8376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:19:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:15 smithi057 ceph-mon[92072]: pgmap v8377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:19:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:15 smithi122 ceph-mon[125440]: pgmap v8377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:19:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:15 smithi136 ceph-mon[125702]: pgmap v8377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:19:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:15.984+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:19:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:15.984+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:19:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:15.984+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:19:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:15.984+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:19:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:15.984+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:19:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:17 smithi122 ceph-mon[125440]: pgmap v8378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:19:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:17 smithi136 ceph-mon[125702]: pgmap v8378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:19:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:17 smithi057 ceph-mon[92072]: pgmap v8378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:19:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:19 smithi136 ceph-mon[125702]: pgmap v8379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:19:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:19 smithi057 ceph-mon[92072]: pgmap v8379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:19:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:19 smithi122 ceph-mon[125440]: pgmap v8379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:19:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:21 smithi122 ceph-mon[125440]: pgmap v8380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:19:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:21 smithi136 ceph-mon[125702]: pgmap v8380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:19:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:21 smithi057 ceph-mon[92072]: pgmap v8380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:19:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:23 smithi122 ceph-mon[125440]: pgmap v8381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:19:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:23 smithi136 ceph-mon[125702]: pgmap v8381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:19:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:23 smithi057 ceph-mon[92072]: pgmap v8381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:19:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:25 smithi122 ceph-mon[125440]: pgmap v8382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:25 smithi136 ceph-mon[125702]: pgmap v8382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:25 smithi057 ceph-mon[92072]: pgmap v8382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:27 smithi122 ceph-mon[125440]: pgmap v8383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:27 smithi136 ceph-mon[125702]: pgmap v8383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:27 smithi057 ceph-mon[92072]: pgmap v8383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:29 smithi057 ceph-mon[92072]: pgmap v8384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:29 smithi122 ceph-mon[125440]: pgmap v8384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:29 smithi136 ceph-mon[125702]: pgmap v8384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:30.999+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:19:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:30.999+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:19:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:30.999+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:19:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:30.999+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:19:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:30.999+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:19:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:31 smithi122 ceph-mon[125440]: pgmap v8385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:31 smithi136 ceph-mon[125702]: pgmap v8385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:31 smithi057 ceph-mon[92072]: pgmap v8385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:33 smithi122 ceph-mon[125440]: pgmap v8386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:33 smithi136 ceph-mon[125702]: pgmap v8386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:33 smithi057 ceph-mon[92072]: pgmap v8386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:35 smithi122 ceph-mon[125440]: pgmap v8387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:35 smithi136 ceph-mon[125702]: pgmap v8387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:35 smithi057 ceph-mon[92072]: pgmap v8387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:37 smithi122 ceph-mon[125440]: pgmap v8388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:37 smithi136 ceph-mon[125702]: pgmap v8388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:37 smithi057 ceph-mon[92072]: pgmap v8388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:39 smithi057 ceph-mon[92072]: pgmap v8389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:39 smithi122 ceph-mon[125440]: pgmap v8389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:39 smithi136 ceph-mon[125702]: pgmap v8389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:41 smithi122 ceph-mon[125440]: pgmap v8390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:41 smithi136 ceph-mon[125702]: pgmap v8390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:41 smithi057 ceph-mon[92072]: pgmap v8390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:43 smithi122 ceph-mon[125440]: pgmap v8391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:43 smithi136 ceph-mon[125702]: pgmap v8391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:43 smithi057 ceph-mon[92072]: pgmap v8391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:45 smithi122 ceph-mon[125440]: pgmap v8392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:45 smithi136 ceph-mon[125702]: pgmap v8392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:45 smithi057 ceph-mon[92072]: pgmap v8392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:46.014+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:19:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:46.014+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:19:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:46.014+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:19:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:46.014+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:19:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:19:46.014+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:19:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:47 smithi122 ceph-mon[125440]: pgmap v8393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:47 smithi136 ceph-mon[125702]: pgmap v8393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:47 smithi057 ceph-mon[92072]: pgmap v8393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:49 smithi057 ceph-mon[92072]: pgmap v8394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:49 smithi122 ceph-mon[125440]: pgmap v8394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:49 smithi136 ceph-mon[125702]: pgmap v8394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:51 smithi122 ceph-mon[125440]: pgmap v8395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:51 smithi136 ceph-mon[125702]: pgmap v8395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:51 smithi057 ceph-mon[92072]: pgmap v8395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:53 smithi122 ceph-mon[125440]: pgmap v8396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:53 smithi136 ceph-mon[125702]: pgmap v8396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:53 smithi057 ceph-mon[92072]: pgmap v8396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:55 smithi122 ceph-mon[125440]: pgmap v8397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:55 smithi136 ceph-mon[125702]: pgmap v8397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:55 smithi057 ceph-mon[92072]: pgmap v8397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:57 smithi122 ceph-mon[125440]: pgmap v8398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:57 smithi136 ceph-mon[125702]: pgmap v8398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:57 smithi057 ceph-mon[92072]: pgmap v8398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:19:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:19:59 smithi057 ceph-mon[92072]: pgmap v8399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:19:59 smithi122 ceph-mon[125440]: pgmap v8399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:19:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:19:59 smithi136 ceph-mon[125702]: pgmap v8399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T15:20:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T15:20:00.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T15:20:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:01.027+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:20:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:01.027+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:20:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:01.027+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:20:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:01.027+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:20:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:01.027+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:20:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:01 smithi057 ceph-mon[92072]: pgmap v8400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:01 smithi122 ceph-mon[125440]: pgmap v8400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:01 smithi136 ceph-mon[125702]: pgmap v8400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:20:03.436 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:20:03.456 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:20:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:04 smithi057 ceph-mon[92072]: pgmap v8401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:20:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:20:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:20:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:20:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:04 smithi122 ceph-mon[125440]: pgmap v8401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:20:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:20:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:20:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:20:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:04 smithi136 ceph-mon[125702]: pgmap v8401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:20:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:20:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:20:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:20:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:05 smithi122 ceph-mon[125440]: pgmap v8402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:20:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:05 smithi136 ceph-mon[125702]: pgmap v8402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:20:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:05 smithi057 ceph-mon[92072]: pgmap v8402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:20:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:07 smithi136 ceph-mon[125702]: osdmap e597: 12 total, 12 up, 12 in 2023-03-02T15:20:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:07 smithi136 ceph-mon[125702]: pgmap v8404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:20:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:07 smithi057 ceph-mon[92072]: osdmap e597: 12 total, 12 up, 12 in 2023-03-02T15:20:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:07 smithi057 ceph-mon[92072]: pgmap v8404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:20:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:07 smithi122 ceph-mon[125440]: osdmap e597: 12 total, 12 up, 12 in 2023-03-02T15:20:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:07 smithi122 ceph-mon[125440]: pgmap v8404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:20:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:09 smithi057 ceph-mon[92072]: pgmap v8405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:20:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:09 smithi122 ceph-mon[125440]: pgmap v8405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:20:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:09 smithi136 ceph-mon[125702]: pgmap v8405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:20:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:10.620+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:20:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:10.620+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:20:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:10.620+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 124 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:20:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:10.620+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 123 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:20:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:11 smithi122 ceph-mon[125440]: pgmap v8406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:20:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:11 smithi136 ceph-mon[125702]: pgmap v8406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:20:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:11 smithi057 ceph-mon[92072]: pgmap v8406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:20:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:13 smithi122 ceph-mon[125440]: pgmap v8407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:20:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:13 smithi136 ceph-mon[125702]: pgmap v8407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:20:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:13 smithi057 ceph-mon[92072]: pgmap v8407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:20:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:14 smithi057 ceph-mon[92072]: osdmap e598: 12 total, 12 up, 12 in 2023-03-02T15:20:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:14 smithi122 ceph-mon[125440]: osdmap e598: 12 total, 12 up, 12 in 2023-03-02T15:20:14.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:14 smithi136 ceph-mon[125702]: osdmap e598: 12 total, 12 up, 12 in 2023-03-02T15:20:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:15 smithi057 ceph-mon[92072]: pgmap v8409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:20:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:15 smithi122 ceph-mon[125440]: pgmap v8409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:20:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:15 smithi136 ceph-mon[125702]: pgmap v8409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T15:20:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:16.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:20:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:16.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:20:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:16.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:20:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:16.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:20:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:16.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:20:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:17 smithi122 ceph-mon[125440]: pgmap v8410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:20:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:17 smithi136 ceph-mon[125702]: pgmap v8410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:20:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:17 smithi057 ceph-mon[92072]: pgmap v8410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:20:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:19 smithi057 ceph-mon[92072]: pgmap v8411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:20:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:19 smithi122 ceph-mon[125440]: pgmap v8411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:20:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:19 smithi136 ceph-mon[125702]: pgmap v8411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:20:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:21 smithi122 ceph-mon[125440]: pgmap v8412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:20:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:21 smithi136 ceph-mon[125702]: pgmap v8412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:20:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:21 smithi057 ceph-mon[92072]: pgmap v8412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:20:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:23 smithi122 ceph-mon[125440]: pgmap v8413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:20:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:23 smithi136 ceph-mon[125702]: pgmap v8413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:20:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:23 smithi057 ceph-mon[92072]: pgmap v8413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:20:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:25 smithi136 ceph-mon[125702]: pgmap v8414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:25 smithi057 ceph-mon[92072]: pgmap v8414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:25 smithi122 ceph-mon[125440]: pgmap v8414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:27 smithi136 ceph-mon[125702]: pgmap v8415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:27 smithi057 ceph-mon[92072]: pgmap v8415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:27 smithi122 ceph-mon[125440]: pgmap v8415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:29 smithi057 ceph-mon[92072]: pgmap v8416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:29 smithi122 ceph-mon[125440]: pgmap v8416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:29 smithi136 ceph-mon[125702]: pgmap v8416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:31.047+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:20:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:31.047+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:20:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:31.047+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:20:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:31.047+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:20:31.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:31.048+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:20:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:31 smithi122 ceph-mon[125440]: pgmap v8417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:31 smithi136 ceph-mon[125702]: pgmap v8417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:31 smithi057 ceph-mon[92072]: pgmap v8417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:34 smithi057 ceph-mon[92072]: pgmap v8418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:34 smithi122 ceph-mon[125440]: pgmap v8418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:34.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:34 smithi136 ceph-mon[125702]: pgmap v8418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:36 smithi057 ceph-mon[92072]: pgmap v8419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:36 smithi122 ceph-mon[125440]: pgmap v8419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:36.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:36 smithi136 ceph-mon[125702]: pgmap v8419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:38 smithi057 ceph-mon[92072]: pgmap v8420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:38 smithi122 ceph-mon[125440]: pgmap v8420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:38.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:38 smithi136 ceph-mon[125702]: pgmap v8420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:40 smithi057 ceph-mon[92072]: pgmap v8421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:40 smithi122 ceph-mon[125440]: pgmap v8421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:40.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:40 smithi136 ceph-mon[125702]: pgmap v8421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:42 smithi057 ceph-mon[92072]: pgmap v8422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:42 smithi122 ceph-mon[125440]: pgmap v8422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:42.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:42 smithi136 ceph-mon[125702]: pgmap v8422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:44 smithi057 ceph-mon[92072]: pgmap v8423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:44 smithi122 ceph-mon[125440]: pgmap v8423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:44.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:44 smithi136 ceph-mon[125702]: pgmap v8423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:46.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:20:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:46.064+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:20:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:46.064+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:20:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:46.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:20:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:20:46.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:20:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:46 smithi057 ceph-mon[92072]: pgmap v8424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:46 smithi122 ceph-mon[125440]: pgmap v8424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:46.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:46 smithi136 ceph-mon[125702]: pgmap v8424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:48 smithi057 ceph-mon[92072]: pgmap v8425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:48 smithi122 ceph-mon[125440]: pgmap v8425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:48.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:48 smithi136 ceph-mon[125702]: pgmap v8425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:50 smithi057 ceph-mon[92072]: pgmap v8426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:50 smithi122 ceph-mon[125440]: pgmap v8426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:50.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:50 smithi136 ceph-mon[125702]: pgmap v8426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:52 smithi057 ceph-mon[92072]: pgmap v8427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:52 smithi122 ceph-mon[125440]: pgmap v8427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:52.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:52 smithi136 ceph-mon[125702]: pgmap v8427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:54 smithi057 ceph-mon[92072]: pgmap v8428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:54 smithi122 ceph-mon[125440]: pgmap v8428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:54.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:54 smithi136 ceph-mon[125702]: pgmap v8428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:56 smithi057 ceph-mon[92072]: pgmap v8429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:56 smithi122 ceph-mon[125440]: pgmap v8429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:56.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:56 smithi136 ceph-mon[125702]: pgmap v8429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:20:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:20:58 smithi057 ceph-mon[92072]: pgmap v8430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:20:58 smithi122 ceph-mon[125440]: pgmap v8430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:20:58.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:20:58 smithi136 ceph-mon[125702]: pgmap v8430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:00 smithi057 ceph-mon[92072]: pgmap v8431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:00 smithi122 ceph-mon[125440]: pgmap v8431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:00.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:00 smithi136 ceph-mon[125702]: pgmap v8431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:01.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:01.074+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:21:01.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:01.074+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:21:01.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:01.074+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:21:01.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:01.074+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:21:01.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:01.074+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:21:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:02 smithi057 ceph-mon[92072]: pgmap v8432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:02 smithi122 ceph-mon[125440]: pgmap v8432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:02.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:02 smithi136 ceph-mon[125702]: pgmap v8432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:04 smithi057 ceph-mon[92072]: pgmap v8433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:21:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:21:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:04 smithi122 ceph-mon[125440]: pgmap v8433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:21:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:21:04.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:04 smithi136 ceph-mon[125702]: pgmap v8433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:21:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:21:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:21:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:21:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:21:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:21:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:21:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:21:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:21:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:21:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:21:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:06 smithi057 ceph-mon[92072]: pgmap v8434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:21:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:06 smithi057 ceph-mon[92072]: osdmap e599: 12 total, 12 up, 12 in 2023-03-02T15:21:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:06 smithi122 ceph-mon[125440]: pgmap v8434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:21:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:06 smithi122 ceph-mon[125440]: osdmap e599: 12 total, 12 up, 12 in 2023-03-02T15:21:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:06 smithi136 ceph-mon[125702]: pgmap v8434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:21:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:06 smithi136 ceph-mon[125702]: osdmap e599: 12 total, 12 up, 12 in 2023-03-02T15:21:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:08 smithi122 ceph-mon[125440]: pgmap v8436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:21:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:08 smithi136 ceph-mon[125702]: pgmap v8436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:21:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:08 smithi057 ceph-mon[92072]: pgmap v8436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:21:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:10 smithi122 ceph-mon[125440]: pgmap v8437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:21:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:10 smithi136 ceph-mon[125702]: pgmap v8437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:21:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:10 smithi057 ceph-mon[92072]: pgmap v8437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:21:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:12 smithi122 ceph-mon[125440]: pgmap v8438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:21:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:12 smithi136 ceph-mon[125702]: pgmap v8438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:21:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:12 smithi057 ceph-mon[92072]: pgmap v8438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:21:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:14 smithi122 ceph-mon[125440]: pgmap v8439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:21:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:14 smithi136 ceph-mon[125702]: pgmap v8439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:21:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:14 smithi057 ceph-mon[92072]: pgmap v8439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:21:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:16.081+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:21:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:16.082+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:21:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:16.082+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:21:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:16.082+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:21:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:16.082+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:21:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:16 smithi122 ceph-mon[125440]: pgmap v8440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:21:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:16 smithi136 ceph-mon[125702]: pgmap v8440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:21:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:16 smithi057 ceph-mon[92072]: pgmap v8440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:21:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:18 smithi136 ceph-mon[125702]: pgmap v8441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 190 B/s wr, 14 op/s 2023-03-02T15:21:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:18 smithi136 ceph-mon[125702]: osdmap e600: 12 total, 12 up, 12 in 2023-03-02T15:21:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:18 smithi057 ceph-mon[92072]: pgmap v8441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 190 B/s wr, 14 op/s 2023-03-02T15:21:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:18 smithi057 ceph-mon[92072]: osdmap e600: 12 total, 12 up, 12 in 2023-03-02T15:21:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:18 smithi122 ceph-mon[125440]: pgmap v8441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 190 B/s wr, 14 op/s 2023-03-02T15:21:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:18 smithi122 ceph-mon[125440]: osdmap e600: 12 total, 12 up, 12 in 2023-03-02T15:21:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:20 smithi136 ceph-mon[125702]: pgmap v8443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:21:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:20 smithi057 ceph-mon[92072]: pgmap v8443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:21:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:20 smithi122 ceph-mon[125440]: pgmap v8443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:21:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:22 smithi136 ceph-mon[125702]: pgmap v8444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:21:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:22 smithi057 ceph-mon[92072]: pgmap v8444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:21:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:22 smithi122 ceph-mon[125440]: pgmap v8444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:21:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:24 smithi136 ceph-mon[125702]: pgmap v8445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:21:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:24 smithi057 ceph-mon[92072]: pgmap v8445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:21:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:24 smithi122 ceph-mon[125440]: pgmap v8445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:21:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:26 smithi136 ceph-mon[125702]: pgmap v8446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:21:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:26 smithi057 ceph-mon[92072]: pgmap v8446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:21:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:26 smithi122 ceph-mon[125440]: pgmap v8446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:21:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:28 smithi136 ceph-mon[125702]: pgmap v8447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:21:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:28 smithi057 ceph-mon[92072]: pgmap v8447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:21:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:28 smithi122 ceph-mon[125440]: pgmap v8447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:21:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:30 smithi136 ceph-mon[125702]: pgmap v8448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:21:31.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:31.094+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:21:31.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:31.095+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:21:31.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:31.095+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:21:31.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:31.095+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:21:31.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:31.095+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:21:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:30 smithi057 ceph-mon[92072]: pgmap v8448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:21:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:30 smithi122 ceph-mon[125440]: pgmap v8448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:21:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:32 smithi136 ceph-mon[125702]: pgmap v8449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:32 smithi057 ceph-mon[92072]: pgmap v8449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:32 smithi122 ceph-mon[125440]: pgmap v8449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:34 smithi136 ceph-mon[125702]: pgmap v8450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:34 smithi057 ceph-mon[92072]: pgmap v8450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:34 smithi122 ceph-mon[125440]: pgmap v8450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:36 smithi136 ceph-mon[125702]: pgmap v8451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:36 smithi057 ceph-mon[92072]: pgmap v8451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:36 smithi122 ceph-mon[125440]: pgmap v8451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:38 smithi136 ceph-mon[125702]: pgmap v8452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:38 smithi057 ceph-mon[92072]: pgmap v8452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:38 smithi122 ceph-mon[125440]: pgmap v8452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:40 smithi136 ceph-mon[125702]: pgmap v8453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:40 smithi057 ceph-mon[92072]: pgmap v8453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:40 smithi122 ceph-mon[125440]: pgmap v8453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:42 smithi136 ceph-mon[125702]: pgmap v8454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:42 smithi057 ceph-mon[92072]: pgmap v8454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:42 smithi122 ceph-mon[125440]: pgmap v8454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:44 smithi136 ceph-mon[125702]: pgmap v8455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:44 smithi057 ceph-mon[92072]: pgmap v8455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:44 smithi122 ceph-mon[125440]: pgmap v8455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:46.105+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:21:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:46.105+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:21:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:46.105+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:21:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:46.105+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:21:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:21:46.105+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:21:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:46 smithi136 ceph-mon[125702]: pgmap v8456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:46 smithi057 ceph-mon[92072]: pgmap v8456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:46 smithi122 ceph-mon[125440]: pgmap v8456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:48 smithi136 ceph-mon[125702]: pgmap v8457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:48 smithi057 ceph-mon[92072]: pgmap v8457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:48 smithi122 ceph-mon[125440]: pgmap v8457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:50 smithi136 ceph-mon[125702]: pgmap v8458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:50 smithi057 ceph-mon[92072]: pgmap v8458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:50 smithi122 ceph-mon[125440]: pgmap v8458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:52 smithi136 ceph-mon[125702]: pgmap v8459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:52 smithi057 ceph-mon[92072]: pgmap v8459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:52 smithi122 ceph-mon[125440]: pgmap v8459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:54 smithi136 ceph-mon[125702]: pgmap v8460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:54 smithi057 ceph-mon[92072]: pgmap v8460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:54 smithi122 ceph-mon[125440]: pgmap v8460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:56 smithi136 ceph-mon[125702]: pgmap v8461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:56 smithi057 ceph-mon[92072]: pgmap v8461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:56 smithi122 ceph-mon[125440]: pgmap v8461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:21:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:21:58 smithi136 ceph-mon[125702]: pgmap v8462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:21:58 smithi057 ceph-mon[92072]: pgmap v8462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:21:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:21:58 smithi122 ceph-mon[125440]: pgmap v8462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:00 smithi136 ceph-mon[125702]: pgmap v8463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:01.116+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:22:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:01.117+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:22:01.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:01.117+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:22:01.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:01.117+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:22:01.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:01.117+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:22:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:00 smithi057 ceph-mon[92072]: pgmap v8463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:00 smithi122 ceph-mon[125440]: pgmap v8463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:02 smithi136 ceph-mon[125702]: pgmap v8464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:02 smithi057 ceph-mon[92072]: pgmap v8464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:02 smithi122 ceph-mon[125440]: pgmap v8464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:04 smithi136 ceph-mon[125702]: pgmap v8465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:22:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:22:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:04 smithi057 ceph-mon[92072]: pgmap v8465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:22:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:22:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:04 smithi122 ceph-mon[125440]: pgmap v8465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:22:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:22:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:22:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:22:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:22:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:22:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:22:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:22:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:22:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:22:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:22:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:06 smithi057 ceph-mon[92072]: pgmap v8466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:22:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:06 smithi122 ceph-mon[125440]: pgmap v8466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:22:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:06 smithi136 ceph-mon[125702]: pgmap v8466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:22:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:08 smithi057 ceph-mon[92072]: pgmap v8467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:22:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:08 smithi122 ceph-mon[125440]: pgmap v8467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:22:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:08 smithi136 ceph-mon[125702]: pgmap v8467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:22:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:10 smithi057 ceph-mon[92072]: pgmap v8468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:22:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:10 smithi122 ceph-mon[125440]: pgmap v8468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:22:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:10 smithi136 ceph-mon[125702]: pgmap v8468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:22:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:11 smithi057 ceph-mon[92072]: osdmap e601: 12 total, 12 up, 12 in 2023-03-02T15:22:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:11 smithi122 ceph-mon[125440]: osdmap e601: 12 total, 12 up, 12 in 2023-03-02T15:22:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:11 smithi136 ceph-mon[125702]: osdmap e601: 12 total, 12 up, 12 in 2023-03-02T15:22:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:12 smithi057 ceph-mon[92072]: pgmap v8470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:22:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:12 smithi122 ceph-mon[125440]: pgmap v8470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:22:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:12 smithi136 ceph-mon[125702]: pgmap v8470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:22:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:14 smithi057 ceph-mon[92072]: pgmap v8471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:14 smithi122 ceph-mon[125440]: pgmap v8471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:14 smithi136 ceph-mon[125702]: pgmap v8471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:16.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:22:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:16.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:22:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:16.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:22:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:16.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:22:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:16.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:22:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:16 smithi057 ceph-mon[92072]: pgmap v8472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:16 smithi122 ceph-mon[125440]: pgmap v8472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:16 smithi136 ceph-mon[125702]: pgmap v8472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:18 smithi057 ceph-mon[92072]: pgmap v8473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:18 smithi057 ceph-mon[92072]: osdmap e602: 12 total, 12 up, 12 in 2023-03-02T15:22:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:18 smithi122 ceph-mon[125440]: pgmap v8473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:18 smithi122 ceph-mon[125440]: osdmap e602: 12 total, 12 up, 12 in 2023-03-02T15:22:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:18 smithi136 ceph-mon[125702]: pgmap v8473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:18 smithi136 ceph-mon[125702]: osdmap e602: 12 total, 12 up, 12 in 2023-03-02T15:22:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:20 smithi057 ceph-mon[92072]: pgmap v8475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 246 B/s wr, 12 op/s 2023-03-02T15:22:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:20 smithi122 ceph-mon[125440]: pgmap v8475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 246 B/s wr, 12 op/s 2023-03-02T15:22:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:20 smithi136 ceph-mon[125702]: pgmap v8475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 246 B/s wr, 12 op/s 2023-03-02T15:22:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:22 smithi057 ceph-mon[92072]: pgmap v8476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:22 smithi122 ceph-mon[125440]: pgmap v8476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:22 smithi136 ceph-mon[125702]: pgmap v8476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:22:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:24 smithi057 ceph-mon[92072]: pgmap v8477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:22:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:24 smithi122 ceph-mon[125440]: pgmap v8477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:22:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:24 smithi136 ceph-mon[125702]: pgmap v8477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:22:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:26 smithi057 ceph-mon[92072]: pgmap v8478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:22:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:26 smithi122 ceph-mon[125440]: pgmap v8478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:22:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:26 smithi136 ceph-mon[125702]: pgmap v8478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:22:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:28 smithi057 ceph-mon[92072]: pgmap v8479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:22:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:28 smithi122 ceph-mon[125440]: pgmap v8479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:22:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:28 smithi136 ceph-mon[125702]: pgmap v8479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:22:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:31.133+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:22:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:31.133+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:22:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:31.133+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:22:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:31.133+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:22:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:31.133+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:22:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:30 smithi057 ceph-mon[92072]: pgmap v8480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:22:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:30 smithi122 ceph-mon[125440]: pgmap v8480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:22:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:30 smithi136 ceph-mon[125702]: pgmap v8480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:22:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:32 smithi057 ceph-mon[92072]: pgmap v8481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:32 smithi122 ceph-mon[125440]: pgmap v8481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:32 smithi136 ceph-mon[125702]: pgmap v8481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:34 smithi057 ceph-mon[92072]: pgmap v8482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:34 smithi122 ceph-mon[125440]: pgmap v8482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:34 smithi136 ceph-mon[125702]: pgmap v8482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:36 smithi122 ceph-mon[125440]: pgmap v8483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:36 smithi136 ceph-mon[125702]: pgmap v8483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:36 smithi057 ceph-mon[92072]: pgmap v8483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:38 smithi122 ceph-mon[125440]: pgmap v8484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:38 smithi136 ceph-mon[125702]: pgmap v8484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:38 smithi057 ceph-mon[92072]: pgmap v8484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:40 smithi122 ceph-mon[125440]: pgmap v8485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:40 smithi136 ceph-mon[125702]: pgmap v8485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:40 smithi057 ceph-mon[92072]: pgmap v8485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:42 smithi122 ceph-mon[125440]: pgmap v8486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:42 smithi136 ceph-mon[125702]: pgmap v8486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:42 smithi057 ceph-mon[92072]: pgmap v8486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:44 smithi136 ceph-mon[125702]: pgmap v8487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:44 smithi057 ceph-mon[92072]: pgmap v8487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:44 smithi122 ceph-mon[125440]: pgmap v8487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:46.145+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:22:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:46.145+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:22:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:46.145+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:22:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:46.145+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:22:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:22:46.145+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:22:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:46 smithi136 ceph-mon[125702]: pgmap v8488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:46 smithi057 ceph-mon[92072]: pgmap v8488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:46 smithi122 ceph-mon[125440]: pgmap v8488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:48 smithi136 ceph-mon[125702]: pgmap v8489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:48 smithi057 ceph-mon[92072]: pgmap v8489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:48 smithi122 ceph-mon[125440]: pgmap v8489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:50 smithi136 ceph-mon[125702]: pgmap v8490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:50 smithi057 ceph-mon[92072]: pgmap v8490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:50 smithi122 ceph-mon[125440]: pgmap v8490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:52 smithi136 ceph-mon[125702]: pgmap v8491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:52 smithi057 ceph-mon[92072]: pgmap v8491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:52 smithi122 ceph-mon[125440]: pgmap v8491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:54 smithi136 ceph-mon[125702]: pgmap v8492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:54 smithi057 ceph-mon[92072]: pgmap v8492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:54 smithi122 ceph-mon[125440]: pgmap v8492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:57 smithi136 ceph-mon[125702]: pgmap v8493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:57 smithi057 ceph-mon[92072]: pgmap v8493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:57 smithi122 ceph-mon[125440]: pgmap v8493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:22:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:22:59 smithi136 ceph-mon[125702]: pgmap v8494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:22:59 smithi057 ceph-mon[92072]: pgmap v8494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:22:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:22:59 smithi122 ceph-mon[125440]: pgmap v8494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:01.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:01.149+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:23:01.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:01.149+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:23:01.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:01.149+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:23:01.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:01.149+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:23:01.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:01.149+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:23:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:01 smithi136 ceph-mon[125702]: pgmap v8495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:01 smithi057 ceph-mon[92072]: pgmap v8495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:01 smithi122 ceph-mon[125440]: pgmap v8495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:03 smithi136 ceph-mon[125702]: pgmap v8496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:03 smithi057 ceph-mon[92072]: pgmap v8496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:03 smithi122 ceph-mon[125440]: pgmap v8496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:05 smithi136 ceph-mon[125702]: pgmap v8497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:23:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:05 smithi057 ceph-mon[92072]: pgmap v8497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:23:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:05 smithi122 ceph-mon[125440]: pgmap v8497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:23:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:23:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:23:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:23:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:07 smithi136 ceph-mon[125702]: pgmap v8498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:23:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:23:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:23:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:23:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:07 smithi057 ceph-mon[92072]: pgmap v8498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:23:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:23:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:23:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:23:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:07 smithi122 ceph-mon[125440]: pgmap v8498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:23:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:23:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:23:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:23:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:09 smithi136 ceph-mon[125702]: pgmap v8499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:23:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:09 smithi057 ceph-mon[92072]: pgmap v8499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:23:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:09 smithi122 ceph-mon[125440]: pgmap v8499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:23:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:10.647+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:23:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:10.647+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:23:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:10.647+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 125 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:23:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:10.647+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:23:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:10.647+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 124 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:23:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:10.647+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:23:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:10.648+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 126 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:23:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:10.648+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 125 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:23:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:11 smithi136 ceph-mon[125702]: pgmap v8500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:23:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:11 smithi057 ceph-mon[92072]: pgmap v8500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:23:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:11 smithi122 ceph-mon[125440]: pgmap v8500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:23:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:12 smithi136 ceph-mon[125702]: osdmap e603: 12 total, 12 up, 12 in 2023-03-02T15:23:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:12 smithi057 ceph-mon[92072]: osdmap e603: 12 total, 12 up, 12 in 2023-03-02T15:23:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:12 smithi122 ceph-mon[125440]: osdmap e603: 12 total, 12 up, 12 in 2023-03-02T15:23:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:13 smithi136 ceph-mon[125702]: pgmap v8502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:23:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:13 smithi057 ceph-mon[92072]: pgmap v8502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:23:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:13 smithi122 ceph-mon[125440]: pgmap v8502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:23:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:15 smithi136 ceph-mon[125702]: pgmap v8503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:15 smithi057 ceph-mon[92072]: pgmap v8503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:15 smithi122 ceph-mon[125440]: pgmap v8503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:16.159+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:23:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:16.159+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:23:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:16.159+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:23:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:16.160+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:23:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:16.160+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:23:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:17 smithi136 ceph-mon[125702]: pgmap v8504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:17 smithi057 ceph-mon[92072]: pgmap v8504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:17 smithi122 ceph-mon[125440]: pgmap v8504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:19 smithi136 ceph-mon[125702]: pgmap v8505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:19 smithi136 ceph-mon[125702]: osdmap e604: 12 total, 12 up, 12 in 2023-03-02T15:23:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:19 smithi057 ceph-mon[92072]: pgmap v8505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:19 smithi057 ceph-mon[92072]: osdmap e604: 12 total, 12 up, 12 in 2023-03-02T15:23:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:19 smithi122 ceph-mon[125440]: pgmap v8505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:19 smithi122 ceph-mon[125440]: osdmap e604: 12 total, 12 up, 12 in 2023-03-02T15:23:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:21 smithi136 ceph-mon[125702]: pgmap v8507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 251 B/s wr, 12 op/s 2023-03-02T15:23:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:21 smithi057 ceph-mon[92072]: pgmap v8507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 251 B/s wr, 12 op/s 2023-03-02T15:23:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:21 smithi122 ceph-mon[125440]: pgmap v8507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 251 B/s wr, 12 op/s 2023-03-02T15:23:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:23 smithi057 ceph-mon[92072]: pgmap v8508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:23 smithi122 ceph-mon[125440]: pgmap v8508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:23 smithi136 ceph-mon[125702]: pgmap v8508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:23:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:25 smithi057 ceph-mon[92072]: pgmap v8509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:23:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:25 smithi122 ceph-mon[125440]: pgmap v8509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:23:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:25 smithi136 ceph-mon[125702]: pgmap v8509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:23:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:27 smithi057 ceph-mon[92072]: pgmap v8510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:23:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:27 smithi122 ceph-mon[125440]: pgmap v8510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:23:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:27 smithi136 ceph-mon[125702]: pgmap v8510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:23:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:29 smithi057 ceph-mon[92072]: pgmap v8511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:23:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:29 smithi122 ceph-mon[125440]: pgmap v8511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:23:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:29 smithi136 ceph-mon[125702]: pgmap v8511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:23:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:31.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:23:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:31.172+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:23:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:31.172+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:23:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:31.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:23:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:31.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:23:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:31 smithi057 ceph-mon[92072]: pgmap v8512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:23:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:31 smithi122 ceph-mon[125440]: pgmap v8512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:23:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:31 smithi136 ceph-mon[125702]: pgmap v8512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:23:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:33 smithi057 ceph-mon[92072]: pgmap v8513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:33 smithi122 ceph-mon[125440]: pgmap v8513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:33 smithi136 ceph-mon[125702]: pgmap v8513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:35 smithi057 ceph-mon[92072]: pgmap v8514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:35 smithi122 ceph-mon[125440]: pgmap v8514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:35 smithi136 ceph-mon[125702]: pgmap v8514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:37 smithi057 ceph-mon[92072]: pgmap v8515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:37 smithi122 ceph-mon[125440]: pgmap v8515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:37 smithi136 ceph-mon[125702]: pgmap v8515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:39 smithi057 ceph-mon[92072]: pgmap v8516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:39 smithi122 ceph-mon[125440]: pgmap v8516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:39 smithi136 ceph-mon[125702]: pgmap v8516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:41 smithi057 ceph-mon[92072]: pgmap v8517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:41 smithi122 ceph-mon[125440]: pgmap v8517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:41 smithi136 ceph-mon[125702]: pgmap v8517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:43 smithi057 ceph-mon[92072]: pgmap v8518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:43 smithi122 ceph-mon[125440]: pgmap v8518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:43 smithi136 ceph-mon[125702]: pgmap v8518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:45 smithi057 ceph-mon[92072]: pgmap v8519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:45 smithi122 ceph-mon[125440]: pgmap v8519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:45 smithi136 ceph-mon[125702]: pgmap v8519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:46.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:46.184+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:23:46.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:46.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:23:46.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:46.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:23:46.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:46.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:23:46.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:23:46.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:23:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:47 smithi057 ceph-mon[92072]: pgmap v8520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:47 smithi122 ceph-mon[125440]: pgmap v8520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:47 smithi136 ceph-mon[125702]: pgmap v8520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:49 smithi057 ceph-mon[92072]: pgmap v8521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:49 smithi122 ceph-mon[125440]: pgmap v8521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:49 smithi136 ceph-mon[125702]: pgmap v8521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:51 smithi057 ceph-mon[92072]: pgmap v8522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:51 smithi122 ceph-mon[125440]: pgmap v8522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:51 smithi136 ceph-mon[125702]: pgmap v8522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:53 smithi057 ceph-mon[92072]: pgmap v8523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:53 smithi122 ceph-mon[125440]: pgmap v8523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:53 smithi136 ceph-mon[125702]: pgmap v8523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:55 smithi057 ceph-mon[92072]: pgmap v8524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:55 smithi122 ceph-mon[125440]: pgmap v8524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:55 smithi136 ceph-mon[125702]: pgmap v8524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:57 smithi057 ceph-mon[92072]: pgmap v8525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:57 smithi122 ceph-mon[125440]: pgmap v8525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:57 smithi136 ceph-mon[125702]: pgmap v8525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:23:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:23:59 smithi057 ceph-mon[92072]: pgmap v8526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:23:59 smithi122 ceph-mon[125440]: pgmap v8526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:23:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:23:59 smithi136 ceph-mon[125702]: pgmap v8526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:01.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:24:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:01.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:24:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:01.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:24:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:01.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:24:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:01.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:24:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:01 smithi057 ceph-mon[92072]: pgmap v8527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:01 smithi122 ceph-mon[125440]: pgmap v8527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:01 smithi136 ceph-mon[125702]: pgmap v8527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:03 smithi057 ceph-mon[92072]: pgmap v8528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:03 smithi122 ceph-mon[125440]: pgmap v8528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:03 smithi136 ceph-mon[125702]: pgmap v8528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:04 smithi057 ceph-mon[92072]: pgmap v8529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:24:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:04 smithi122 ceph-mon[125440]: pgmap v8529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:24:04.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:04 smithi136 ceph-mon[125702]: pgmap v8529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:24:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:06 smithi057 ceph-mon[92072]: pgmap v8530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:24:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:06 smithi122 ceph-mon[125440]: pgmap v8530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:24:06.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:06 smithi136 ceph-mon[125702]: pgmap v8530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:24:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:24:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:24:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:24:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:24:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:24:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:24:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:24:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:24:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:24:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:24:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:24:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:24:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:08 smithi122 ceph-mon[125440]: pgmap v8531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:24:08.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:08 smithi136 ceph-mon[125702]: pgmap v8531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:24:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:08 smithi057 ceph-mon[92072]: pgmap v8531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:24:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:10 smithi122 ceph-mon[125440]: pgmap v8532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:24:10.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:10 smithi136 ceph-mon[125702]: pgmap v8532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:24:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:10 smithi057 ceph-mon[92072]: pgmap v8532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:24:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:12 smithi122 ceph-mon[125440]: pgmap v8533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:24:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:12 smithi122 ceph-mon[125440]: osdmap e605: 12 total, 12 up, 12 in 2023-03-02T15:24:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:12 smithi136 ceph-mon[125702]: pgmap v8533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:24:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:12 smithi136 ceph-mon[125702]: osdmap e605: 12 total, 12 up, 12 in 2023-03-02T15:24:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:12 smithi057 ceph-mon[92072]: pgmap v8533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:24:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:12 smithi057 ceph-mon[92072]: osdmap e605: 12 total, 12 up, 12 in 2023-03-02T15:24:14.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:14 smithi136 ceph-mon[125702]: pgmap v8535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:24:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:14 smithi057 ceph-mon[92072]: pgmap v8535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:24:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:14 smithi122 ceph-mon[125440]: pgmap v8535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:24:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:16.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:24:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:16.202+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:24:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:16.202+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:24:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:16.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:24:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:16.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:24:16.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:16 smithi136 ceph-mon[125702]: pgmap v8536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:24:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:16 smithi057 ceph-mon[92072]: pgmap v8536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:24:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:16 smithi122 ceph-mon[125440]: pgmap v8536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:24:18.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:18 smithi136 ceph-mon[125702]: pgmap v8537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:24:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:18 smithi136 ceph-mon[125702]: osdmap e606: 12 total, 12 up, 12 in 2023-03-02T15:24:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:18 smithi057 ceph-mon[92072]: pgmap v8537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:24:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:18 smithi057 ceph-mon[92072]: osdmap e606: 12 total, 12 up, 12 in 2023-03-02T15:24:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:18 smithi122 ceph-mon[125440]: pgmap v8537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:24:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:18 smithi122 ceph-mon[125440]: osdmap e606: 12 total, 12 up, 12 in 2023-03-02T15:24:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:20 smithi136 ceph-mon[125702]: pgmap v8539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:24:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:20 smithi057 ceph-mon[92072]: pgmap v8539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:24:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:20 smithi122 ceph-mon[125440]: pgmap v8539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:24:22.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:22 smithi136 ceph-mon[125702]: pgmap v8540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T15:24:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:22 smithi057 ceph-mon[92072]: pgmap v8540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T15:24:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:22 smithi122 ceph-mon[125440]: pgmap v8540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-02T15:24:24.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:24 smithi136 ceph-mon[125702]: pgmap v8541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:24:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:24 smithi057 ceph-mon[92072]: pgmap v8541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:24:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:24 smithi122 ceph-mon[125440]: pgmap v8541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:24:26.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:26 smithi136 ceph-mon[125702]: pgmap v8542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:24:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:26 smithi057 ceph-mon[92072]: pgmap v8542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:24:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:26 smithi122 ceph-mon[125440]: pgmap v8542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:24:28.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:28 smithi136 ceph-mon[125702]: pgmap v8543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:24:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:28 smithi057 ceph-mon[92072]: pgmap v8543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:24:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:28 smithi122 ceph-mon[125440]: pgmap v8543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:24:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:30 smithi136 ceph-mon[125702]: pgmap v8544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:24:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:30 smithi057 ceph-mon[92072]: pgmap v8544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:24:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:30 smithi122 ceph-mon[125440]: pgmap v8544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:24:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:31.210+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:24:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:31.211+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:24:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:31.211+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:24:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:31.211+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:24:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:31.211+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:24:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:32 smithi136 ceph-mon[125702]: pgmap v8545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:32 smithi057 ceph-mon[92072]: pgmap v8545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:32 smithi122 ceph-mon[125440]: pgmap v8545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:34.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:34 smithi136 ceph-mon[125702]: pgmap v8546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:34 smithi057 ceph-mon[92072]: pgmap v8546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:34 smithi122 ceph-mon[125440]: pgmap v8546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:36.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:36 smithi136 ceph-mon[125702]: pgmap v8547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:36 smithi057 ceph-mon[92072]: pgmap v8547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:36 smithi122 ceph-mon[125440]: pgmap v8547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:38.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:38 smithi136 ceph-mon[125702]: pgmap v8548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:38 smithi057 ceph-mon[92072]: pgmap v8548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:38 smithi122 ceph-mon[125440]: pgmap v8548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:40.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:40 smithi136 ceph-mon[125702]: pgmap v8549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:40 smithi057 ceph-mon[92072]: pgmap v8549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:40 smithi122 ceph-mon[125440]: pgmap v8549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:42.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:42 smithi136 ceph-mon[125702]: pgmap v8550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:42 smithi057 ceph-mon[92072]: pgmap v8550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:42 smithi122 ceph-mon[125440]: pgmap v8550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:44.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:44 smithi136 ceph-mon[125702]: pgmap v8551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:44 smithi057 ceph-mon[92072]: pgmap v8551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:44 smithi122 ceph-mon[125440]: pgmap v8551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:46.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:46.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:24:46.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:46.225+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:24:46.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:46.225+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:24:46.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:46.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:24:46.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:24:46.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:24:46.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:46 smithi136 ceph-mon[125702]: pgmap v8552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:46 smithi057 ceph-mon[92072]: pgmap v8552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:46 smithi122 ceph-mon[125440]: pgmap v8552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:48.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:48 smithi136 ceph-mon[125702]: pgmap v8553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:48 smithi057 ceph-mon[92072]: pgmap v8553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:48 smithi122 ceph-mon[125440]: pgmap v8553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:50.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:50 smithi136 ceph-mon[125702]: pgmap v8554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:50 smithi057 ceph-mon[92072]: pgmap v8554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:50 smithi122 ceph-mon[125440]: pgmap v8554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:52.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:52 smithi136 ceph-mon[125702]: pgmap v8555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:52 smithi057 ceph-mon[92072]: pgmap v8555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:52 smithi122 ceph-mon[125440]: pgmap v8555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:54.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:54 smithi136 ceph-mon[125702]: pgmap v8556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:54 smithi057 ceph-mon[92072]: pgmap v8556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:54 smithi122 ceph-mon[125440]: pgmap v8556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:56 smithi057 ceph-mon[92072]: pgmap v8557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:56 smithi122 ceph-mon[125440]: pgmap v8557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:56 smithi136 ceph-mon[125702]: pgmap v8557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:24:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:24:58 smithi057 ceph-mon[92072]: pgmap v8558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:24:58 smithi122 ceph-mon[125440]: pgmap v8558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:24:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:24:58 smithi136 ceph-mon[125702]: pgmap v8558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:00 smithi057 ceph-mon[92072]: pgmap v8559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:25:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:00 smithi122 ceph-mon[125440]: pgmap v8559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:25:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:00 smithi136 ceph-mon[125702]: pgmap v8559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:25:01.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:01.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:25:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:01.230+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:25:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:01.230+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:25:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:01.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:25:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:01.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:25:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:02 smithi057 ceph-mon[92072]: pgmap v8560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:25:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:02 smithi122 ceph-mon[125440]: pgmap v8560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:25:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:02 smithi136 ceph-mon[125702]: pgmap v8560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:25:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:04 smithi057 ceph-mon[92072]: pgmap v8561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:25:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:04 smithi122 ceph-mon[125440]: pgmap v8561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:25:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:04 smithi136 ceph-mon[125702]: pgmap v8561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:25:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:06 smithi057 ceph-mon[92072]: pgmap v8562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:25:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:06 smithi122 ceph-mon[125440]: pgmap v8562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:25:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:06 smithi136 ceph-mon[125702]: pgmap v8562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:25:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:25:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:25:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:25:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:08 smithi057 ceph-mon[92072]: pgmap v8563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:25:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:08 smithi122 ceph-mon[125440]: pgmap v8563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:25:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:08 smithi136 ceph-mon[125702]: pgmap v8563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:25:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:10 smithi057 ceph-mon[92072]: pgmap v8564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:25:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:10 smithi122 ceph-mon[125440]: pgmap v8564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:25:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:10 smithi136 ceph-mon[125702]: pgmap v8564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:25:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:11.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: osdmap e607: 12 total, 12 up, 12 in 2023-03-02T15:25:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:25:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:25:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:25:11.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:25:11.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: osdmap e607: 12 total, 12 up, 12 in 2023-03-02T15:25:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:25:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:25:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:11.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:25:11.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:25:11.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: osdmap e607: 12 total, 12 up, 12 in 2023-03-02T15:25:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:25:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:25:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:25:12.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:25:12.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:25:12.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:25:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:12 smithi057 ceph-mon[92072]: pgmap v8566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:25:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:12 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 155.6M 2023-03-02T15:25:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:12 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 163249590: error parsing value: Value '163249590' is below minimum 939524096 2023-03-02T15:25:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:12 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:25:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:12 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:25:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:12 smithi122 ceph-mon[125440]: pgmap v8566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:25:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:12 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 155.6M 2023-03-02T15:25:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:12 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 163249590: error parsing value: Value '163249590' is below minimum 939524096 2023-03-02T15:25:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:12 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:25:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:12 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:25:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:12 smithi136 ceph-mon[125702]: pgmap v8566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:25:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:12 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 155.6M 2023-03-02T15:25:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:12 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 163249590: error parsing value: Value '163249590' is below minimum 939524096 2023-03-02T15:25:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:12 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:25:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:12 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:25:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:14 smithi057 ceph-mon[92072]: pgmap v8567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:14 smithi122 ceph-mon[125440]: pgmap v8567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:14 smithi136 ceph-mon[125702]: pgmap v8567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:16.247+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:25:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:16.247+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:25:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:16.247+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:25:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:16.247+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:25:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:16.247+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:25:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:16 smithi057 ceph-mon[92072]: pgmap v8568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:16 smithi122 ceph-mon[125440]: pgmap v8568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:16 smithi136 ceph-mon[125702]: pgmap v8568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:18 smithi057 ceph-mon[92072]: pgmap v8569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:18 smithi057 ceph-mon[92072]: osdmap e608: 12 total, 12 up, 12 in 2023-03-02T15:25:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:18 smithi122 ceph-mon[125440]: pgmap v8569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:18 smithi122 ceph-mon[125440]: osdmap e608: 12 total, 12 up, 12 in 2023-03-02T15:25:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:18 smithi136 ceph-mon[125702]: pgmap v8569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:18 smithi136 ceph-mon[125702]: osdmap e608: 12 total, 12 up, 12 in 2023-03-02T15:25:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:20 smithi057 ceph-mon[92072]: pgmap v8571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:25:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:20 smithi122 ceph-mon[125440]: pgmap v8571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:25:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:20 smithi136 ceph-mon[125702]: pgmap v8571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:25:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:22 smithi057 ceph-mon[92072]: pgmap v8572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:22 smithi122 ceph-mon[125440]: pgmap v8572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:22 smithi136 ceph-mon[125702]: pgmap v8572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:25:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:24 smithi057 ceph-mon[92072]: pgmap v8573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:25:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:24 smithi122 ceph-mon[125440]: pgmap v8573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:25:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:24 smithi136 ceph-mon[125702]: pgmap v8573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:25:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:26 smithi057 ceph-mon[92072]: pgmap v8574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:25:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:26 smithi122 ceph-mon[125440]: pgmap v8574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:25:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:26 smithi136 ceph-mon[125702]: pgmap v8574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:25:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:28 smithi057 ceph-mon[92072]: pgmap v8575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:25:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:28 smithi122 ceph-mon[125440]: pgmap v8575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:25:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:28 smithi136 ceph-mon[125702]: pgmap v8575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:25:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:30 smithi057 ceph-mon[92072]: pgmap v8576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:25:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:30 smithi122 ceph-mon[125440]: pgmap v8576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:25:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:31.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:25:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:31.263+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:25:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:31.263+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:25:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:31.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:25:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:31.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:25:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:30 smithi136 ceph-mon[125702]: pgmap v8576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:25:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:32 smithi122 ceph-mon[125440]: pgmap v8577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:32 smithi136 ceph-mon[125702]: pgmap v8577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:32 smithi057 ceph-mon[92072]: pgmap v8577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:34 smithi122 ceph-mon[125440]: pgmap v8578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:34 smithi136 ceph-mon[125702]: pgmap v8578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:34 smithi057 ceph-mon[92072]: pgmap v8578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:36 smithi122 ceph-mon[125440]: pgmap v8579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:36 smithi136 ceph-mon[125702]: pgmap v8579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:36 smithi057 ceph-mon[92072]: pgmap v8579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:38 smithi136 ceph-mon[125702]: pgmap v8580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:38 smithi057 ceph-mon[92072]: pgmap v8580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:38 smithi122 ceph-mon[125440]: pgmap v8580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:40 smithi136 ceph-mon[125702]: pgmap v8581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:40 smithi057 ceph-mon[92072]: pgmap v8581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:40 smithi122 ceph-mon[125440]: pgmap v8581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:42 smithi136 ceph-mon[125702]: pgmap v8582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:42 smithi057 ceph-mon[92072]: pgmap v8582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:42 smithi122 ceph-mon[125440]: pgmap v8582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:44 smithi136 ceph-mon[125702]: pgmap v8583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:44 smithi057 ceph-mon[92072]: pgmap v8583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:44 smithi122 ceph-mon[125440]: pgmap v8583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:46.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:46.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:25:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:46.279+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:25:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:46.279+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:25:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:46.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:25:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:25:46.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:25:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:46 smithi136 ceph-mon[125702]: pgmap v8584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:46 smithi057 ceph-mon[92072]: pgmap v8584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:46 smithi122 ceph-mon[125440]: pgmap v8584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:48 smithi136 ceph-mon[125702]: pgmap v8585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:48 smithi057 ceph-mon[92072]: pgmap v8585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:48 smithi122 ceph-mon[125440]: pgmap v8585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:50 smithi136 ceph-mon[125702]: pgmap v8586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:50 smithi057 ceph-mon[92072]: pgmap v8586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:50 smithi122 ceph-mon[125440]: pgmap v8586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:53 smithi136 ceph-mon[125702]: pgmap v8587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:53 smithi057 ceph-mon[92072]: pgmap v8587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:53 smithi122 ceph-mon[125440]: pgmap v8587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:55 smithi136 ceph-mon[125702]: pgmap v8588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:55 smithi057 ceph-mon[92072]: pgmap v8588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:55 smithi122 ceph-mon[125440]: pgmap v8588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:57 smithi136 ceph-mon[125702]: pgmap v8589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:57 smithi057 ceph-mon[92072]: pgmap v8589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:57 smithi122 ceph-mon[125440]: pgmap v8589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:25:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:25:59 smithi136 ceph-mon[125702]: pgmap v8590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:25:59 smithi057 ceph-mon[92072]: pgmap v8590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:25:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:25:59 smithi122 ceph-mon[125440]: pgmap v8590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:01.291+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:01.291+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:01.291+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:26:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:01.291+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:26:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:01.291+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:26:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:01 smithi136 ceph-mon[125702]: pgmap v8591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:01 smithi057 ceph-mon[92072]: pgmap v8591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:01 smithi122 ceph-mon[125440]: pgmap v8591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:03 smithi136 ceph-mon[125702]: pgmap v8592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:03 smithi057 ceph-mon[92072]: pgmap v8592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:03 smithi122 ceph-mon[125440]: pgmap v8592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:05 smithi136 ceph-mon[125702]: pgmap v8593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:26:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:05 smithi057 ceph-mon[92072]: pgmap v8593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:26:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:05 smithi122 ceph-mon[125440]: pgmap v8593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:26:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:07 smithi136 ceph-mon[125702]: pgmap v8594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:26:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:07 smithi057 ceph-mon[92072]: pgmap v8594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:26:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:07 smithi122 ceph-mon[125440]: pgmap v8594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:26:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:09 smithi136 ceph-mon[125702]: pgmap v8595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:26:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:09 smithi057 ceph-mon[92072]: pgmap v8595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:26:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:09 smithi122 ceph-mon[125440]: pgmap v8595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:26:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:10.672+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:26:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:10.672+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:26:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:10.672+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 127 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:26:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:10.672+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 126 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:26:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:11 smithi136 ceph-mon[125702]: pgmap v8596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:26:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:11 smithi057 ceph-mon[92072]: pgmap v8596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:26:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:11 smithi122 ceph-mon[125440]: pgmap v8596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:26:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:12 smithi136 ceph-mon[125702]: osdmap e609: 12 total, 12 up, 12 in 2023-03-02T15:26:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:26:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:12 smithi057 ceph-mon[92072]: osdmap e609: 12 total, 12 up, 12 in 2023-03-02T15:26:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:26:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:12 smithi122 ceph-mon[125440]: osdmap e609: 12 total, 12 up, 12 in 2023-03-02T15:26:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:26:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:13 smithi136 ceph-mon[125702]: pgmap v8598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:26:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:26:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:26:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:26:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:13 smithi057 ceph-mon[92072]: pgmap v8598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:26:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:26:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:26:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:26:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:13 smithi122 ceph-mon[125440]: pgmap v8598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:26:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:26:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:26:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:26:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:15 smithi136 ceph-mon[125702]: pgmap v8599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:15 smithi057 ceph-mon[92072]: pgmap v8599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:15 smithi122 ceph-mon[125440]: pgmap v8599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:16.307+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:26:16.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:16.307+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:26:16.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:16.307+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:26:16.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:16.307+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:26:16.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:16.307+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:26:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:17 smithi136 ceph-mon[125702]: pgmap v8600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:17 smithi057 ceph-mon[92072]: pgmap v8600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:17 smithi122 ceph-mon[125440]: pgmap v8600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:19 smithi136 ceph-mon[125702]: pgmap v8601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:19 smithi136 ceph-mon[125702]: osdmap e610: 12 total, 12 up, 12 in 2023-03-02T15:26:19.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:19 smithi057 ceph-mon[92072]: pgmap v8601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:19.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:19 smithi057 ceph-mon[92072]: osdmap e610: 12 total, 12 up, 12 in 2023-03-02T15:26:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:19 smithi122 ceph-mon[125440]: pgmap v8601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:19 smithi122 ceph-mon[125440]: osdmap e610: 12 total, 12 up, 12 in 2023-03-02T15:26:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:21 smithi057 ceph-mon[92072]: pgmap v8603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 250 B/s wr, 12 op/s 2023-03-02T15:26:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:21 smithi122 ceph-mon[125440]: pgmap v8603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 250 B/s wr, 12 op/s 2023-03-02T15:26:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:21 smithi136 ceph-mon[125702]: pgmap v8603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 250 B/s wr, 12 op/s 2023-03-02T15:26:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:23 smithi057 ceph-mon[92072]: pgmap v8604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:23 smithi122 ceph-mon[125440]: pgmap v8604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:23 smithi136 ceph-mon[125702]: pgmap v8604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:26:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:25 smithi057 ceph-mon[92072]: pgmap v8605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:26:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:25 smithi122 ceph-mon[125440]: pgmap v8605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:26:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:25 smithi136 ceph-mon[125702]: pgmap v8605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:26:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:27 smithi057 ceph-mon[92072]: pgmap v8606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:26:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:27 smithi122 ceph-mon[125440]: pgmap v8606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:26:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:27 smithi136 ceph-mon[125702]: pgmap v8606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:26:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:29 smithi057 ceph-mon[92072]: pgmap v8607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:26:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:29 smithi122 ceph-mon[125440]: pgmap v8607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:26:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:29 smithi136 ceph-mon[125702]: pgmap v8607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:26:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:31.323+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:26:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:31.323+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:26:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:31.323+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:26:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:31.323+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:26:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:31.323+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:26:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:31 smithi057 ceph-mon[92072]: pgmap v8608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:26:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:31 smithi122 ceph-mon[125440]: pgmap v8608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:26:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:31 smithi136 ceph-mon[125702]: pgmap v8608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:26:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:33 smithi057 ceph-mon[92072]: pgmap v8609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:33 smithi122 ceph-mon[125440]: pgmap v8609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:33 smithi136 ceph-mon[125702]: pgmap v8609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:35 smithi057 ceph-mon[92072]: pgmap v8610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:35 smithi122 ceph-mon[125440]: pgmap v8610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:35 smithi136 ceph-mon[125702]: pgmap v8610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:37 smithi057 ceph-mon[92072]: pgmap v8611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:37 smithi122 ceph-mon[125440]: pgmap v8611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:37 smithi136 ceph-mon[125702]: pgmap v8611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:39 smithi057 ceph-mon[92072]: pgmap v8612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:39 smithi122 ceph-mon[125440]: pgmap v8612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:39 smithi136 ceph-mon[125702]: pgmap v8612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:41 smithi057 ceph-mon[92072]: pgmap v8613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:41.547 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:41 smithi122 ceph-mon[125440]: pgmap v8613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:41 smithi136 ceph-mon[125702]: pgmap v8613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:43 smithi057 ceph-mon[92072]: pgmap v8614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:43 smithi122 ceph-mon[125440]: pgmap v8614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:43 smithi136 ceph-mon[125702]: pgmap v8614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:45 smithi057 ceph-mon[92072]: pgmap v8615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:45 smithi122 ceph-mon[125440]: pgmap v8615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:45 smithi136 ceph-mon[125702]: pgmap v8615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:46.335+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:26:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:46.336+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:26:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:46.336+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:26:46.337 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:46.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:26:46.337 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:26:46.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:26:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:47 smithi057 ceph-mon[92072]: pgmap v8616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:47 smithi122 ceph-mon[125440]: pgmap v8616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:47 smithi136 ceph-mon[125702]: pgmap v8616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:49 smithi057 ceph-mon[92072]: pgmap v8617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:49 smithi122 ceph-mon[125440]: pgmap v8617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:49 smithi136 ceph-mon[125702]: pgmap v8617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:51 smithi057 ceph-mon[92072]: pgmap v8618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:51 smithi122 ceph-mon[125440]: pgmap v8618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:51 smithi136 ceph-mon[125702]: pgmap v8618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:53 smithi057 ceph-mon[92072]: pgmap v8619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:53 smithi122 ceph-mon[125440]: pgmap v8619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:53 smithi136 ceph-mon[125702]: pgmap v8619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:55 smithi122 ceph-mon[125440]: pgmap v8620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:55 smithi136 ceph-mon[125702]: pgmap v8620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:55 smithi057 ceph-mon[92072]: pgmap v8620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:57 smithi122 ceph-mon[125440]: pgmap v8621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:57 smithi136 ceph-mon[125702]: pgmap v8621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:57 smithi057 ceph-mon[92072]: pgmap v8621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:26:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:26:59 smithi122 ceph-mon[125440]: pgmap v8622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:26:59 smithi136 ceph-mon[125702]: pgmap v8622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:26:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:26:59 smithi057 ceph-mon[92072]: pgmap v8622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:01.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:01.351+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:27:01.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:01.351+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:27:01.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:01.351+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:27:01.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:01.351+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:27:01.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:01.351+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:27:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:01 smithi122 ceph-mon[125440]: pgmap v8623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:01 smithi136 ceph-mon[125702]: pgmap v8623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:01 smithi057 ceph-mon[92072]: pgmap v8623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:03 smithi136 ceph-mon[125702]: pgmap v8624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:03 smithi057 ceph-mon[92072]: pgmap v8624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:03 smithi122 ceph-mon[125440]: pgmap v8624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:05 smithi136 ceph-mon[125702]: pgmap v8625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:27:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:05 smithi057 ceph-mon[92072]: pgmap v8625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:27:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:05 smithi122 ceph-mon[125440]: pgmap v8625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:27:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:07 smithi136 ceph-mon[125702]: pgmap v8626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:27:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:07 smithi057 ceph-mon[92072]: pgmap v8626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:27:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:07 smithi122 ceph-mon[125440]: pgmap v8626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:27:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:09 smithi136 ceph-mon[125702]: pgmap v8627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:27:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:09 smithi057 ceph-mon[92072]: pgmap v8627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:27:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:09 smithi122 ceph-mon[125440]: pgmap v8627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:27:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:10 smithi136 ceph-mon[125702]: pgmap v8628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:27:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:10 smithi057 ceph-mon[92072]: pgmap v8628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:27:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:10 smithi122 ceph-mon[125440]: pgmap v8628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:27:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:12 smithi136 ceph-mon[125702]: osdmap e611: 12 total, 12 up, 12 in 2023-03-02T15:27:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:12 smithi136 ceph-mon[125702]: pgmap v8630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:27:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:12 smithi057 ceph-mon[92072]: osdmap e611: 12 total, 12 up, 12 in 2023-03-02T15:27:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:12 smithi057 ceph-mon[92072]: pgmap v8630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:27:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:12 smithi122 ceph-mon[125440]: osdmap e611: 12 total, 12 up, 12 in 2023-03-02T15:27:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:12 smithi122 ceph-mon[125440]: pgmap v8630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:27:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:27:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:27:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:27:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:27:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:27:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:27:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:27:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:27:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:27:14.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:14 smithi136 ceph-mon[125702]: pgmap v8631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:27:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:27:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:27:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:14 smithi057 ceph-mon[92072]: pgmap v8631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:27:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:27:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:27:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:14 smithi122 ceph-mon[125440]: pgmap v8631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:27:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:27:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:27:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:16.359+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:27:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:16.359+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:27:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:16.359+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:27:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:16.359+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:27:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:16.359+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:27:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:16 smithi136 ceph-mon[125702]: pgmap v8632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:16 smithi057 ceph-mon[92072]: pgmap v8632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:16 smithi122 ceph-mon[125440]: pgmap v8632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:18.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:18 smithi136 ceph-mon[125702]: pgmap v8633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:18 smithi136 ceph-mon[125702]: osdmap e612: 12 total, 12 up, 12 in 2023-03-02T15:27:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:18 smithi057 ceph-mon[92072]: pgmap v8633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:18 smithi057 ceph-mon[92072]: osdmap e612: 12 total, 12 up, 12 in 2023-03-02T15:27:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:18 smithi122 ceph-mon[125440]: pgmap v8633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:18 smithi122 ceph-mon[125440]: osdmap e612: 12 total, 12 up, 12 in 2023-03-02T15:27:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:20 smithi136 ceph-mon[125702]: pgmap v8635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:27:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:20 smithi057 ceph-mon[92072]: pgmap v8635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:27:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:20 smithi122 ceph-mon[125440]: pgmap v8635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:27:22.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:22 smithi136 ceph-mon[125702]: pgmap v8636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:22 smithi057 ceph-mon[92072]: pgmap v8636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:22 smithi122 ceph-mon[125440]: pgmap v8636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:27:24.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:24 smithi136 ceph-mon[125702]: pgmap v8637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:27:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:24 smithi057 ceph-mon[92072]: pgmap v8637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:27:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:24 smithi122 ceph-mon[125440]: pgmap v8637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:27:26.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:26 smithi136 ceph-mon[125702]: pgmap v8638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:27:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:26 smithi057 ceph-mon[92072]: pgmap v8638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:27:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:26 smithi122 ceph-mon[125440]: pgmap v8638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:27:28.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:28 smithi136 ceph-mon[125702]: pgmap v8639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:27:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:28 smithi057 ceph-mon[92072]: pgmap v8639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:27:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:28 smithi122 ceph-mon[125440]: pgmap v8639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:27:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:30 smithi136 ceph-mon[125702]: pgmap v8640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:27:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:30 smithi057 ceph-mon[92072]: pgmap v8640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:27:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:30 smithi122 ceph-mon[125440]: pgmap v8640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:27:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:31.365+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:27:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:31.366+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:27:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:31.366+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:27:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:31.366+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:27:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:31.366+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:27:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:32 smithi136 ceph-mon[125702]: pgmap v8641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:32 smithi057 ceph-mon[92072]: pgmap v8641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:32 smithi122 ceph-mon[125440]: pgmap v8641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:34.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:34 smithi136 ceph-mon[125702]: pgmap v8642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:34 smithi057 ceph-mon[92072]: pgmap v8642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:34 smithi122 ceph-mon[125440]: pgmap v8642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:36.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:36 smithi136 ceph-mon[125702]: pgmap v8643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:36 smithi057 ceph-mon[92072]: pgmap v8643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:36 smithi122 ceph-mon[125440]: pgmap v8643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:38.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:38 smithi136 ceph-mon[125702]: pgmap v8644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:38 smithi057 ceph-mon[92072]: pgmap v8644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:38 smithi122 ceph-mon[125440]: pgmap v8644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:40.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:40 smithi136 ceph-mon[125702]: pgmap v8645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:40 smithi057 ceph-mon[92072]: pgmap v8645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:40 smithi122 ceph-mon[125440]: pgmap v8645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:42.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:42 smithi136 ceph-mon[125702]: pgmap v8646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:42 smithi057 ceph-mon[92072]: pgmap v8646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:43.069 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:42 smithi122 ceph-mon[125440]: pgmap v8646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:44.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:44 smithi136 ceph-mon[125702]: pgmap v8647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:44 smithi057 ceph-mon[92072]: pgmap v8647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:44 smithi122 ceph-mon[125440]: pgmap v8647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:46.372+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:27:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:46.372+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:27:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:46.372+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:27:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:46.372+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:27:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:27:46.372+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:27:46.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:46 smithi136 ceph-mon[125702]: pgmap v8648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:46 smithi057 ceph-mon[92072]: pgmap v8648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:46 smithi122 ceph-mon[125440]: pgmap v8648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:48.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:48 smithi136 ceph-mon[125702]: pgmap v8649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:48 smithi057 ceph-mon[92072]: pgmap v8649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:48 smithi122 ceph-mon[125440]: pgmap v8649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:50.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:50 smithi136 ceph-mon[125702]: pgmap v8650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:50 smithi057 ceph-mon[92072]: pgmap v8650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:50 smithi122 ceph-mon[125440]: pgmap v8650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:52.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:52 smithi136 ceph-mon[125702]: pgmap v8651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:52 smithi057 ceph-mon[92072]: pgmap v8651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:52 smithi122 ceph-mon[125440]: pgmap v8651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:54.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:54 smithi136 ceph-mon[125702]: pgmap v8652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:54 smithi057 ceph-mon[92072]: pgmap v8652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:54 smithi122 ceph-mon[125440]: pgmap v8652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:56 smithi057 ceph-mon[92072]: pgmap v8653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:56 smithi122 ceph-mon[125440]: pgmap v8653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:56 smithi136 ceph-mon[125702]: pgmap v8653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:27:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:27:58 smithi057 ceph-mon[92072]: pgmap v8654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:27:58 smithi122 ceph-mon[125440]: pgmap v8654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:27:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:27:58 smithi136 ceph-mon[125702]: pgmap v8654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:00 smithi057 ceph-mon[92072]: pgmap v8655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:00 smithi122 ceph-mon[125440]: pgmap v8655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:00 smithi136 ceph-mon[125702]: pgmap v8655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:01.374+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:28:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:01.375+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:28:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:01.375+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:28:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:01.375+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:28:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:01.375+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:28:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:02 smithi057 ceph-mon[92072]: pgmap v8656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:02 smithi122 ceph-mon[125440]: pgmap v8656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:02 smithi136 ceph-mon[125702]: pgmap v8656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:04 smithi057 ceph-mon[92072]: pgmap v8657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:28:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:04 smithi122 ceph-mon[125440]: pgmap v8657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:28:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:04 smithi136 ceph-mon[125702]: pgmap v8657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:28:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:06 smithi057 ceph-mon[92072]: pgmap v8658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:28:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:06 smithi057 ceph-mon[92072]: osdmap e613: 12 total, 12 up, 12 in 2023-03-02T15:28:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:06 smithi122 ceph-mon[125440]: pgmap v8658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:28:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:06 smithi122 ceph-mon[125440]: osdmap e613: 12 total, 12 up, 12 in 2023-03-02T15:28:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:06 smithi136 ceph-mon[125702]: pgmap v8658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:28:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:06 smithi136 ceph-mon[125702]: osdmap e613: 12 total, 12 up, 12 in 2023-03-02T15:28:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:08 smithi057 ceph-mon[92072]: pgmap v8660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:28:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:08 smithi057 ceph-mon[92072]: osdmap e614: 12 total, 12 up, 12 in 2023-03-02T15:28:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:08 smithi122 ceph-mon[125440]: pgmap v8660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:28:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:08 smithi122 ceph-mon[125440]: osdmap e614: 12 total, 12 up, 12 in 2023-03-02T15:28:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:08 smithi136 ceph-mon[125702]: pgmap v8660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:28:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:08 smithi136 ceph-mon[125702]: osdmap e614: 12 total, 12 up, 12 in 2023-03-02T15:28:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:10 smithi057 ceph-mon[92072]: pgmap v8662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:28:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:10 smithi122 ceph-mon[125440]: pgmap v8662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:28:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:10 smithi136 ceph-mon[125702]: pgmap v8662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:28:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:12 smithi057 ceph-mon[92072]: pgmap v8663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:28:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:12 smithi122 ceph-mon[125440]: pgmap v8663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:28:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:12 smithi136 ceph-mon[125702]: pgmap v8663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:28:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:14 smithi057 ceph-mon[92072]: pgmap v8664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:28:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:28:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:14 smithi122 ceph-mon[125440]: pgmap v8664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:28:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:28:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:14 smithi136 ceph-mon[125702]: pgmap v8664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:28:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:28:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:28:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:28:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:28:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:28:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:28:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:28:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:28:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:16.386+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:28:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:16.386+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:28:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:16.386+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:28:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:16.386+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:28:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:16.386+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:28:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:16 smithi057 ceph-mon[92072]: pgmap v8665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T15:28:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:16 smithi122 ceph-mon[125440]: pgmap v8665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T15:28:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:16 smithi136 ceph-mon[125702]: pgmap v8665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T15:28:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:18 smithi057 ceph-mon[92072]: pgmap v8666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:28:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:18 smithi122 ceph-mon[125440]: pgmap v8666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:28:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:18 smithi136 ceph-mon[125702]: pgmap v8666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:28:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:20 smithi057 ceph-mon[92072]: pgmap v8667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:28:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:20 smithi122 ceph-mon[125440]: pgmap v8667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:28:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:20 smithi136 ceph-mon[125702]: pgmap v8667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:28:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:22 smithi057 ceph-mon[92072]: pgmap v8668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:28:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:22 smithi122 ceph-mon[125440]: pgmap v8668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:28:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:22 smithi136 ceph-mon[125702]: pgmap v8668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:28:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:24 smithi122 ceph-mon[125440]: pgmap v8669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:28:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:24 smithi136 ceph-mon[125702]: pgmap v8669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:28:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:24 smithi057 ceph-mon[92072]: pgmap v8669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:28:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:26 smithi122 ceph-mon[125440]: pgmap v8670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:26 smithi136 ceph-mon[125702]: pgmap v8670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:26 smithi057 ceph-mon[92072]: pgmap v8670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:28 smithi122 ceph-mon[125440]: pgmap v8671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:28 smithi136 ceph-mon[125702]: pgmap v8671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:28 smithi057 ceph-mon[92072]: pgmap v8671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:30 smithi122 ceph-mon[125440]: pgmap v8672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:30 smithi136 ceph-mon[125702]: pgmap v8672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:30 smithi057 ceph-mon[92072]: pgmap v8672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:31.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:31.398+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:28:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:31.399+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:28:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:31.399+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:28:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:31.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:28:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:31.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:28:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:32 smithi136 ceph-mon[125702]: pgmap v8673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:32 smithi057 ceph-mon[92072]: pgmap v8673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:32 smithi122 ceph-mon[125440]: pgmap v8673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:34 smithi136 ceph-mon[125702]: pgmap v8674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:34 smithi057 ceph-mon[92072]: pgmap v8674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:34 smithi122 ceph-mon[125440]: pgmap v8674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:36 smithi136 ceph-mon[125702]: pgmap v8675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:36 smithi057 ceph-mon[92072]: pgmap v8675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:36 smithi122 ceph-mon[125440]: pgmap v8675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:38 smithi136 ceph-mon[125702]: pgmap v8676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:38 smithi057 ceph-mon[92072]: pgmap v8676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:38 smithi122 ceph-mon[125440]: pgmap v8676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:40 smithi136 ceph-mon[125702]: pgmap v8677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:40 smithi057 ceph-mon[92072]: pgmap v8677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:40 smithi122 ceph-mon[125440]: pgmap v8677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:42 smithi136 ceph-mon[125702]: pgmap v8678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:42 smithi057 ceph-mon[92072]: pgmap v8678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:42 smithi122 ceph-mon[125440]: pgmap v8678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:44 smithi136 ceph-mon[125702]: pgmap v8679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:44 smithi057 ceph-mon[92072]: pgmap v8679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:44 smithi122 ceph-mon[125440]: pgmap v8679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:46.414+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:28:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:46.415+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:28:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:46.415+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:28:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:46.415+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:28:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:28:46.415+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:28:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:46 smithi136 ceph-mon[125702]: pgmap v8680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:46 smithi057 ceph-mon[92072]: pgmap v8680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:46 smithi122 ceph-mon[125440]: pgmap v8680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:48 smithi136 ceph-mon[125702]: pgmap v8681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:48 smithi057 ceph-mon[92072]: pgmap v8681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:48 smithi122 ceph-mon[125440]: pgmap v8681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:50 smithi136 ceph-mon[125702]: pgmap v8682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:50 smithi057 ceph-mon[92072]: pgmap v8682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:50 smithi122 ceph-mon[125440]: pgmap v8682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:52 smithi136 ceph-mon[125702]: pgmap v8683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:52 smithi057 ceph-mon[92072]: pgmap v8683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:52 smithi122 ceph-mon[125440]: pgmap v8683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:54 smithi136 ceph-mon[125702]: pgmap v8684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:55.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:54 smithi057 ceph-mon[92072]: pgmap v8684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:54 smithi122 ceph-mon[125440]: pgmap v8684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:56 smithi136 ceph-mon[125702]: pgmap v8685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:56 smithi057 ceph-mon[92072]: pgmap v8685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:56 smithi122 ceph-mon[125440]: pgmap v8685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:28:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:28:58 smithi136 ceph-mon[125702]: pgmap v8686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:28:58 smithi057 ceph-mon[92072]: pgmap v8686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:28:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:28:58 smithi122 ceph-mon[125440]: pgmap v8686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:00 smithi136 ceph-mon[125702]: pgmap v8687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:00 smithi057 ceph-mon[92072]: pgmap v8687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:00 smithi122 ceph-mon[125440]: pgmap v8687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:01.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:01.429+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:29:01.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:01.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:29:01.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:01.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:29:01.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:01.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:29:01.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:01.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:29:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:02 smithi136 ceph-mon[125702]: pgmap v8688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:02 smithi057 ceph-mon[92072]: pgmap v8688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:02 smithi122 ceph-mon[125440]: pgmap v8688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:04 smithi136 ceph-mon[125702]: pgmap v8689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:29:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:04 smithi057 ceph-mon[92072]: pgmap v8689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:29:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:04 smithi122 ceph-mon[125440]: pgmap v8689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:29:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:06 smithi136 ceph-mon[125702]: pgmap v8690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:29:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:06 smithi136 ceph-mon[125702]: osdmap e615: 12 total, 12 up, 12 in 2023-03-02T15:29:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:06 smithi057 ceph-mon[92072]: pgmap v8690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:29:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:06 smithi057 ceph-mon[92072]: osdmap e615: 12 total, 12 up, 12 in 2023-03-02T15:29:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:06 smithi122 ceph-mon[125440]: pgmap v8690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:29:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:06 smithi122 ceph-mon[125440]: osdmap e615: 12 total, 12 up, 12 in 2023-03-02T15:29:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:08.403+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T15:29:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:08.403+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T15:29:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:08.403+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f587006b000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:29:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:08.403+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f587006b000 comp rx=0 tx=0).stop 2023-03-02T15:29:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:08.403+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T15:29:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:08.403+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T15:29:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:08.403+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T15:29:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:08.403+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T15:29:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:08.403+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:29:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:08.403+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5870019fd0 tx=0x7f58700b3000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T15:29:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:08 smithi136 ceph-mon[125702]: pgmap v8692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:29:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:08 smithi136 ceph-mon[125702]: osdmap e616: 12 total, 12 up, 12 in 2023-03-02T15:29:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:08 smithi057 ceph-mon[92072]: pgmap v8692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:29:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:08 smithi057 ceph-mon[92072]: osdmap e616: 12 total, 12 up, 12 in 2023-03-02T15:29:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:08 smithi122 ceph-mon[125440]: pgmap v8692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:29:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:08 smithi122 ceph-mon[125440]: osdmap e616: 12 total, 12 up, 12 in 2023-03-02T15:29:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:10.698+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:29:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:10.699+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:29:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:10.699+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 127 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:29:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:10.699+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 128 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:29:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:10 smithi136 ceph-mon[125702]: pgmap v8694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:29:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:10 smithi057 ceph-mon[92072]: pgmap v8694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:29:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:10 smithi122 ceph-mon[125440]: pgmap v8694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:29:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:12 smithi136 ceph-mon[125702]: pgmap v8695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:29:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:12 smithi057 ceph-mon[92072]: pgmap v8695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:29:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:12 smithi122 ceph-mon[125440]: pgmap v8695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:29:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:14 smithi136 ceph-mon[125702]: pgmap v8696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:29:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:14 smithi057 ceph-mon[92072]: pgmap v8696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:29:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:14 smithi122 ceph-mon[125440]: pgmap v8696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:29:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:29:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:29:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:29:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:16.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:29:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:16.441+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:29:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:16.441+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:29:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:16.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:29:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:16.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:29:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:16 smithi057 ceph-mon[92072]: pgmap v8697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T15:29:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:29:17.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:29:17.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:29:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:16 smithi122 ceph-mon[125440]: pgmap v8697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T15:29:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:29:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:29:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:29:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:16 smithi136 ceph-mon[125702]: pgmap v8697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T15:29:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:29:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:29:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:29:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:18 smithi057 ceph-mon[92072]: pgmap v8698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:29:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:18 smithi122 ceph-mon[125440]: pgmap v8698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:29:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:18 smithi136 ceph-mon[125702]: pgmap v8698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:29:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:20 smithi057 ceph-mon[92072]: pgmap v8699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:29:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:20 smithi122 ceph-mon[125440]: pgmap v8699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:29:21.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:20 smithi136 ceph-mon[125702]: pgmap v8699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:29:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:22 smithi057 ceph-mon[92072]: pgmap v8700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:29:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:22 smithi122 ceph-mon[125440]: pgmap v8700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:29:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:22 smithi136 ceph-mon[125702]: pgmap v8700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:29:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:24 smithi057 ceph-mon[92072]: pgmap v8701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:29:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:24 smithi122 ceph-mon[125440]: pgmap v8701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:29:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:24 smithi136 ceph-mon[125702]: pgmap v8701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:29:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:26 smithi057 ceph-mon[92072]: pgmap v8702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:26 smithi122 ceph-mon[125440]: pgmap v8702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:26 smithi136 ceph-mon[125702]: pgmap v8702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:28 smithi057 ceph-mon[92072]: pgmap v8703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:28 smithi122 ceph-mon[125440]: pgmap v8703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:28 smithi136 ceph-mon[125702]: pgmap v8703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:30 smithi057 ceph-mon[92072]: pgmap v8704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:30 smithi122 ceph-mon[125440]: pgmap v8704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:30 smithi136 ceph-mon[125702]: pgmap v8704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:31.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:29:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:31.451+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:29:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:31.451+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:29:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:31.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:29:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:31.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:29:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:32 smithi057 ceph-mon[92072]: pgmap v8705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:32 smithi122 ceph-mon[125440]: pgmap v8705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:32 smithi136 ceph-mon[125702]: pgmap v8705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:34 smithi057 ceph-mon[92072]: pgmap v8706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:34 smithi122 ceph-mon[125440]: pgmap v8706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:34 smithi136 ceph-mon[125702]: pgmap v8706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:36 smithi057 ceph-mon[92072]: pgmap v8707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:36 smithi122 ceph-mon[125440]: pgmap v8707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:36 smithi136 ceph-mon[125702]: pgmap v8707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:38 smithi057 ceph-mon[92072]: pgmap v8708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:39.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:38 smithi122 ceph-mon[125440]: pgmap v8708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:38 smithi136 ceph-mon[125702]: pgmap v8708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:40 smithi057 ceph-mon[92072]: pgmap v8709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:40 smithi122 ceph-mon[125440]: pgmap v8709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:40 smithi136 ceph-mon[125702]: pgmap v8709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:42 smithi057 ceph-mon[92072]: pgmap v8710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:42 smithi122 ceph-mon[125440]: pgmap v8710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:42 smithi136 ceph-mon[125702]: pgmap v8710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:44 smithi057 ceph-mon[92072]: pgmap v8711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:44 smithi122 ceph-mon[125440]: pgmap v8711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:44 smithi136 ceph-mon[125702]: pgmap v8711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:46.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:46.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:29:46.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:46.457+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:29:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:46.457+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:29:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:46.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:29:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:29:46.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:29:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:46 smithi057 ceph-mon[92072]: pgmap v8712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:46 smithi122 ceph-mon[125440]: pgmap v8712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:46 smithi136 ceph-mon[125702]: pgmap v8712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:48 smithi057 ceph-mon[92072]: pgmap v8713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:48 smithi122 ceph-mon[125440]: pgmap v8713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:48 smithi136 ceph-mon[125702]: pgmap v8713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:50 smithi057 ceph-mon[92072]: pgmap v8714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:50 smithi122 ceph-mon[125440]: pgmap v8714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:50 smithi136 ceph-mon[125702]: pgmap v8714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:52 smithi057 ceph-mon[92072]: pgmap v8715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:52 smithi122 ceph-mon[125440]: pgmap v8715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:52 smithi136 ceph-mon[125702]: pgmap v8715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:54 smithi122 ceph-mon[125440]: pgmap v8716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:54 smithi136 ceph-mon[125702]: pgmap v8716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:54 smithi057 ceph-mon[92072]: pgmap v8716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:56 smithi122 ceph-mon[125440]: pgmap v8717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:56 smithi136 ceph-mon[125702]: pgmap v8717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:56 smithi057 ceph-mon[92072]: pgmap v8717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:29:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:29:58 smithi122 ceph-mon[125440]: pgmap v8718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:29:58 smithi136 ceph-mon[125702]: pgmap v8718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:29:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:29:58 smithi057 ceph-mon[92072]: pgmap v8718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:00 smithi122 ceph-mon[125440]: pgmap v8719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T15:30:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:00 smithi136 ceph-mon[125702]: pgmap v8719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T15:30:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:00 smithi057 ceph-mon[92072]: pgmap v8719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T15:30:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:01.458+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:30:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:01.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:30:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:01.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:30:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:01.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:30:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:01.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:30:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:02 smithi136 ceph-mon[125702]: pgmap v8720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:02 smithi057 ceph-mon[92072]: pgmap v8720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:02 smithi122 ceph-mon[125440]: pgmap v8720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:04 smithi136 ceph-mon[125702]: pgmap v8721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:30:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:04 smithi057 ceph-mon[92072]: pgmap v8721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:30:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:04 smithi122 ceph-mon[125440]: pgmap v8721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:30:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:06 smithi136 ceph-mon[125702]: pgmap v8722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:30:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:06 smithi136 ceph-mon[125702]: osdmap e617: 12 total, 12 up, 12 in 2023-03-02T15:30:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:06 smithi057 ceph-mon[92072]: pgmap v8722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:30:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:06 smithi057 ceph-mon[92072]: osdmap e617: 12 total, 12 up, 12 in 2023-03-02T15:30:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:06 smithi122 ceph-mon[125440]: pgmap v8722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:30:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:06 smithi122 ceph-mon[125440]: osdmap e617: 12 total, 12 up, 12 in 2023-03-02T15:30:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:08 smithi136 ceph-mon[125702]: pgmap v8724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:30:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:08 smithi136 ceph-mon[125702]: osdmap e618: 12 total, 12 up, 12 in 2023-03-02T15:30:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:08 smithi057 ceph-mon[92072]: pgmap v8724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:30:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:08 smithi057 ceph-mon[92072]: osdmap e618: 12 total, 12 up, 12 in 2023-03-02T15:30:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:08 smithi122 ceph-mon[125440]: pgmap v8724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:30:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:08 smithi122 ceph-mon[125440]: osdmap e618: 12 total, 12 up, 12 in 2023-03-02T15:30:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:10 smithi136 ceph-mon[125702]: pgmap v8726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:30:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:10 smithi057 ceph-mon[92072]: pgmap v8726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:30:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:10 smithi122 ceph-mon[125440]: pgmap v8726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:30:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:12 smithi136 ceph-mon[125702]: pgmap v8727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:30:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:12 smithi057 ceph-mon[92072]: pgmap v8727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:30:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:12 smithi122 ceph-mon[125440]: pgmap v8727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:30:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:14 smithi136 ceph-mon[125702]: pgmap v8728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:30:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:14 smithi057 ceph-mon[92072]: pgmap v8728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:30:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:14 smithi122 ceph-mon[125440]: pgmap v8728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:30:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:16.464+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:30:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:16.464+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:30:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:16.464+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:30:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:16.464+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:30:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:16.464+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:30:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:16 smithi136 ceph-mon[125702]: pgmap v8729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T15:30:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:30:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:16 smithi057 ceph-mon[92072]: pgmap v8729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T15:30:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:30:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:16 smithi122 ceph-mon[125440]: pgmap v8729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T15:30:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:30:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:30:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:30:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:30:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:30:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:30:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:30:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:30:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:30:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:30:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:19 smithi136 ceph-mon[125702]: pgmap v8730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:30:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:19 smithi057 ceph-mon[92072]: pgmap v8730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:30:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:19 smithi122 ceph-mon[125440]: pgmap v8730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:30:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:21 smithi136 ceph-mon[125702]: pgmap v8731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:30:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:21 smithi057 ceph-mon[92072]: pgmap v8731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:30:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:21 smithi122 ceph-mon[125440]: pgmap v8731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:30:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:23 smithi136 ceph-mon[125702]: pgmap v8732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:30:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:23 smithi057 ceph-mon[92072]: pgmap v8732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:30:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:23 smithi122 ceph-mon[125440]: pgmap v8732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:30:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:25 smithi136 ceph-mon[125702]: pgmap v8733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:30:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:25 smithi057 ceph-mon[92072]: pgmap v8733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:30:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:25 smithi122 ceph-mon[125440]: pgmap v8733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:30:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:27 smithi136 ceph-mon[125702]: pgmap v8734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:27 smithi057 ceph-mon[92072]: pgmap v8734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:27 smithi122 ceph-mon[125440]: pgmap v8734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:29 smithi136 ceph-mon[125702]: pgmap v8735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:29 smithi057 ceph-mon[92072]: pgmap v8735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:29 smithi122 ceph-mon[125440]: pgmap v8735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:31 smithi136 ceph-mon[125702]: pgmap v8736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:31 smithi057 ceph-mon[92072]: pgmap v8736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:31 smithi122 ceph-mon[125440]: pgmap v8736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:31.478+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:30:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:31.478+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:30:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:31.478+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:30:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:31.478+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:30:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:31.478+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:30:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:33 smithi136 ceph-mon[125702]: pgmap v8737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:33 smithi057 ceph-mon[92072]: pgmap v8737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:33 smithi122 ceph-mon[125440]: pgmap v8737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:35 smithi136 ceph-mon[125702]: pgmap v8738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:35 smithi057 ceph-mon[92072]: pgmap v8738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:35 smithi122 ceph-mon[125440]: pgmap v8738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:37 smithi136 ceph-mon[125702]: pgmap v8739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:37 smithi057 ceph-mon[92072]: pgmap v8739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:37 smithi122 ceph-mon[125440]: pgmap v8739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:39 smithi136 ceph-mon[125702]: pgmap v8740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:39 smithi057 ceph-mon[92072]: pgmap v8740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:39 smithi122 ceph-mon[125440]: pgmap v8740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:41 smithi136 ceph-mon[125702]: pgmap v8741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:41 smithi057 ceph-mon[92072]: pgmap v8741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:41.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:41 smithi122 ceph-mon[125440]: pgmap v8741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:43 smithi136 ceph-mon[125702]: pgmap v8742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:43 smithi057 ceph-mon[92072]: pgmap v8742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:43 smithi122 ceph-mon[125440]: pgmap v8742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:45 smithi136 ceph-mon[125702]: pgmap v8743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:45 smithi057 ceph-mon[92072]: pgmap v8743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:45 smithi122 ceph-mon[125440]: pgmap v8743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:46.490+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:30:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:46.490+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:30:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:46.490+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:30:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:46.490+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:30:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:30:46.490+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:30:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:47 smithi136 ceph-mon[125702]: pgmap v8744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:47 smithi057 ceph-mon[92072]: pgmap v8744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:47 smithi122 ceph-mon[125440]: pgmap v8744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:49 smithi136 ceph-mon[125702]: pgmap v8745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:49 smithi057 ceph-mon[92072]: pgmap v8745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:49 smithi122 ceph-mon[125440]: pgmap v8745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:51 smithi136 ceph-mon[125702]: pgmap v8746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:51 smithi057 ceph-mon[92072]: pgmap v8746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:51 smithi122 ceph-mon[125440]: pgmap v8746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:53.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:53 smithi136 ceph-mon[125702]: pgmap v8747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:53 smithi057 ceph-mon[92072]: pgmap v8747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:53.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:53 smithi122 ceph-mon[125440]: pgmap v8747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:55 smithi136 ceph-mon[125702]: pgmap v8748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:55 smithi057 ceph-mon[92072]: pgmap v8748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:55 smithi122 ceph-mon[125440]: pgmap v8748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:57 smithi136 ceph-mon[125702]: pgmap v8749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:57 smithi057 ceph-mon[92072]: pgmap v8749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:57 smithi122 ceph-mon[125440]: pgmap v8749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:30:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:30:59 smithi057 ceph-mon[92072]: pgmap v8750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:30:59 smithi122 ceph-mon[125440]: pgmap v8750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:30:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:30:59 smithi136 ceph-mon[125702]: pgmap v8750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:01 smithi057 ceph-mon[92072]: pgmap v8751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:01 smithi122 ceph-mon[125440]: pgmap v8751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:01.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:31:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:01.503+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:31:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:01.503+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:31:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:01.503+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:31:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:01.503+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:31:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:01 smithi136 ceph-mon[125702]: pgmap v8751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:03 smithi057 ceph-mon[92072]: pgmap v8752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:03 smithi122 ceph-mon[125440]: pgmap v8752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:03.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:03 smithi136 ceph-mon[125702]: pgmap v8752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:05 smithi057 ceph-mon[92072]: pgmap v8753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:31:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:05 smithi122 ceph-mon[125440]: pgmap v8753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:31:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:05 smithi136 ceph-mon[125702]: pgmap v8753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:31:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:07 smithi057 ceph-mon[92072]: pgmap v8754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:31:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:07 smithi122 ceph-mon[125440]: pgmap v8754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:31:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:07 smithi136 ceph-mon[125702]: pgmap v8754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:31:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:09 smithi057 ceph-mon[92072]: pgmap v8755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:31:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:09 smithi122 ceph-mon[125440]: pgmap v8755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:31:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:09 smithi136 ceph-mon[125702]: pgmap v8755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:31:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:11 smithi057 ceph-mon[92072]: pgmap v8756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:31:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:11 smithi122 ceph-mon[125440]: pgmap v8756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:31:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:11 smithi136 ceph-mon[125702]: pgmap v8756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:31:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:12 smithi057 ceph-mon[92072]: osdmap e619: 12 total, 12 up, 12 in 2023-03-02T15:31:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:12 smithi122 ceph-mon[125440]: osdmap e619: 12 total, 12 up, 12 in 2023-03-02T15:31:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:12 smithi136 ceph-mon[125702]: osdmap e619: 12 total, 12 up, 12 in 2023-03-02T15:31:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:13 smithi057 ceph-mon[92072]: pgmap v8758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:31:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:13 smithi122 ceph-mon[125440]: pgmap v8758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:31:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:13 smithi136 ceph-mon[125702]: pgmap v8758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:31:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:15 smithi057 ceph-mon[92072]: pgmap v8759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:15 smithi122 ceph-mon[125440]: pgmap v8759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:15 smithi136 ceph-mon[125702]: pgmap v8759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:16.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:16.515+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:16.515+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:16.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:16.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:31:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:17 smithi057 ceph-mon[92072]: pgmap v8760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:31:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:17 smithi122 ceph-mon[125440]: pgmap v8760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:31:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:17 smithi136 ceph-mon[125702]: pgmap v8760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:31:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:19 smithi057 ceph-mon[92072]: pgmap v8761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:31:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:19 smithi057 ceph-mon[92072]: osdmap e620: 12 total, 12 up, 12 in 2023-03-02T15:31:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:19 smithi122 ceph-mon[125440]: pgmap v8761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:31:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:19 smithi122 ceph-mon[125440]: osdmap e620: 12 total, 12 up, 12 in 2023-03-02T15:31:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:19 smithi136 ceph-mon[125702]: pgmap v8761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:31:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:19 smithi136 ceph-mon[125702]: osdmap e620: 12 total, 12 up, 12 in 2023-03-02T15:31:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:21 smithi057 ceph-mon[92072]: pgmap v8763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 374 B/s wr, 12 op/s 2023-03-02T15:31:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:31:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:31:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:31:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:31:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:31:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:21 smithi122 ceph-mon[125440]: pgmap v8763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 374 B/s wr, 12 op/s 2023-03-02T15:31:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:31:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:31:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:31:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:31:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:31:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:21 smithi136 ceph-mon[125702]: pgmap v8763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 374 B/s wr, 12 op/s 2023-03-02T15:31:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:31:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:31:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:31:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:31:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:31:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:23 smithi057 ceph-mon[92072]: pgmap v8764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:31:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:23 smithi122 ceph-mon[125440]: pgmap v8764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:31:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:23 smithi136 ceph-mon[125702]: pgmap v8764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:31:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:25 smithi057 ceph-mon[92072]: pgmap v8765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:25 smithi122 ceph-mon[125440]: pgmap v8765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:25 smithi136 ceph-mon[125702]: pgmap v8765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:25.719+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:31:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:25.719+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:31:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:25.719+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 128 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:31:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:25.719+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 129 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:31:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:27 smithi057 ceph-mon[92072]: pgmap v8766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:27 smithi122 ceph-mon[125440]: pgmap v8766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:27 smithi136 ceph-mon[125702]: pgmap v8766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:31:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:29 smithi057 ceph-mon[92072]: pgmap v8767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:31:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:29 smithi122 ceph-mon[125440]: pgmap v8767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:31:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:29 smithi136 ceph-mon[125702]: pgmap v8767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:31:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:31 smithi057 ceph-mon[92072]: pgmap v8768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:31:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:31 smithi122 ceph-mon[125440]: pgmap v8768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:31:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:31.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:31:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:31.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:31:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:31.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:31:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:31.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:31:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:31.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:31:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:31 smithi136 ceph-mon[125702]: pgmap v8768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:31:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:33 smithi057 ceph-mon[92072]: pgmap v8769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:33 smithi122 ceph-mon[125440]: pgmap v8769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:33 smithi136 ceph-mon[125702]: pgmap v8769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:35 smithi122 ceph-mon[125440]: pgmap v8770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:35 smithi136 ceph-mon[125702]: pgmap v8770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:35 smithi057 ceph-mon[92072]: pgmap v8770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:37 smithi122 ceph-mon[125440]: pgmap v8771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:37 smithi136 ceph-mon[125702]: pgmap v8771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:37 smithi057 ceph-mon[92072]: pgmap v8771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:39 smithi122 ceph-mon[125440]: pgmap v8772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:39 smithi136 ceph-mon[125702]: pgmap v8772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:39 smithi057 ceph-mon[92072]: pgmap v8772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:41 smithi122 ceph-mon[125440]: pgmap v8773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:41 smithi136 ceph-mon[125702]: pgmap v8773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:41 smithi057 ceph-mon[92072]: pgmap v8773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:43 smithi136 ceph-mon[125702]: pgmap v8774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:43 smithi057 ceph-mon[92072]: pgmap v8774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:43 smithi122 ceph-mon[125440]: pgmap v8774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:45 smithi136 ceph-mon[125702]: pgmap v8775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:45 smithi057 ceph-mon[92072]: pgmap v8775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:45 smithi122 ceph-mon[125440]: pgmap v8775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:46.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:46.543+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:31:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:46.543+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:31:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:46.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:31:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:31:46.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:31:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:47 smithi136 ceph-mon[125702]: pgmap v8776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:47 smithi057 ceph-mon[92072]: pgmap v8776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:47 smithi122 ceph-mon[125440]: pgmap v8776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:49 smithi136 ceph-mon[125702]: pgmap v8777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:49 smithi057 ceph-mon[92072]: pgmap v8777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:49 smithi122 ceph-mon[125440]: pgmap v8777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:51 smithi136 ceph-mon[125702]: pgmap v8778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:51 smithi057 ceph-mon[92072]: pgmap v8778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:51 smithi122 ceph-mon[125440]: pgmap v8778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:53 smithi136 ceph-mon[125702]: pgmap v8779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:53 smithi057 ceph-mon[92072]: pgmap v8779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:53 smithi122 ceph-mon[125440]: pgmap v8779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:55 smithi136 ceph-mon[125702]: pgmap v8780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:55 smithi057 ceph-mon[92072]: pgmap v8780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:55 smithi122 ceph-mon[125440]: pgmap v8780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:57 smithi136 ceph-mon[125702]: pgmap v8781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:57 smithi057 ceph-mon[92072]: pgmap v8781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:57 smithi122 ceph-mon[125440]: pgmap v8781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:31:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:31:59 smithi136 ceph-mon[125702]: pgmap v8782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:31:59 smithi057 ceph-mon[92072]: pgmap v8782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:31:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:31:59 smithi122 ceph-mon[125440]: pgmap v8782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:01.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:01.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:32:01.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:01.559+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:32:01.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:01.559+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:32:01.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:01.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:32:01.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:01.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:32:01.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:01 smithi136 ceph-mon[125702]: pgmap v8783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:01 smithi057 ceph-mon[92072]: pgmap v8783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:01 smithi122 ceph-mon[125440]: pgmap v8783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:03 smithi136 ceph-mon[125702]: pgmap v8784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:03 smithi057 ceph-mon[92072]: pgmap v8784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:03 smithi122 ceph-mon[125440]: pgmap v8784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:04.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:04 smithi136 ceph-mon[125702]: pgmap v8785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:32:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:04 smithi057 ceph-mon[92072]: pgmap v8785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:32:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:04 smithi122 ceph-mon[125440]: pgmap v8785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:32:06.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:06 smithi136 ceph-mon[125702]: pgmap v8786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:32:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:06 smithi057 ceph-mon[92072]: pgmap v8786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:32:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:06 smithi122 ceph-mon[125440]: pgmap v8786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:32:08.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:08 smithi136 ceph-mon[125702]: pgmap v8787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:32:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:08 smithi057 ceph-mon[92072]: pgmap v8787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:32:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:08 smithi122 ceph-mon[125440]: pgmap v8787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:32:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:10.725+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:32:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:10.725+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:32:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:10.725+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 130 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:32:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:10.726+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 129 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:32:10.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:10 smithi136 ceph-mon[125702]: pgmap v8788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:32:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:10 smithi057 ceph-mon[92072]: pgmap v8788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:32:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:10 smithi122 ceph-mon[125440]: pgmap v8788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:32:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:11 smithi057 ceph-mon[92072]: osdmap e621: 12 total, 12 up, 12 in 2023-03-02T15:32:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:11 smithi122 ceph-mon[125440]: osdmap e621: 12 total, 12 up, 12 in 2023-03-02T15:32:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:11 smithi136 ceph-mon[125702]: osdmap e621: 12 total, 12 up, 12 in 2023-03-02T15:32:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:12 smithi057 ceph-mon[92072]: pgmap v8790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:32:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:12 smithi122 ceph-mon[125440]: pgmap v8790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:32:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:12 smithi136 ceph-mon[125702]: pgmap v8790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:32:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:14 smithi057 ceph-mon[92072]: pgmap v8791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:14 smithi122 ceph-mon[125440]: pgmap v8791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:14 smithi136 ceph-mon[125702]: pgmap v8791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:16.570+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:16.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:32:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:16.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:32:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:16.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:32:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:16.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:32:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:16 smithi057 ceph-mon[92072]: pgmap v8792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:16 smithi122 ceph-mon[125440]: pgmap v8792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:16 smithi136 ceph-mon[125702]: pgmap v8792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:18 smithi057 ceph-mon[92072]: pgmap v8793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:18 smithi057 ceph-mon[92072]: osdmap e622: 12 total, 12 up, 12 in 2023-03-02T15:32:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:18 smithi122 ceph-mon[125440]: pgmap v8793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:18 smithi122 ceph-mon[125440]: osdmap e622: 12 total, 12 up, 12 in 2023-03-02T15:32:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:18 smithi136 ceph-mon[125702]: pgmap v8793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:18 smithi136 ceph-mon[125702]: osdmap e622: 12 total, 12 up, 12 in 2023-03-02T15:32:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:20 smithi057 ceph-mon[92072]: pgmap v8795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T15:32:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:20 smithi122 ceph-mon[125440]: pgmap v8795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T15:32:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:20 smithi136 ceph-mon[125702]: pgmap v8795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T15:32:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:32:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:32:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:32:22.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:22 smithi136 ceph-mon[125702]: pgmap v8796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:22 smithi057 ceph-mon[92072]: pgmap v8796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:22.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:22 smithi122 ceph-mon[125440]: pgmap v8796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:32:24.644 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:24 smithi122 ceph-mon[125440]: pgmap v8797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:32:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:24 smithi057 ceph-mon[92072]: pgmap v8797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:32:24.951 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:24 smithi136 ceph-mon[125702]: pgmap v8797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:32:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:26 smithi122 ceph-mon[125440]: pgmap v8798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:32:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:32:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:32:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:26 smithi136 ceph-mon[125702]: pgmap v8798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:32:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:32:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:32:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:26 smithi057 ceph-mon[92072]: pgmap v8798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:32:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:32:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:32:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:32:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:28 smithi057 ceph-mon[92072]: pgmap v8799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:32:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:28 smithi122 ceph-mon[125440]: pgmap v8799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:32:28.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:28 smithi136 ceph-mon[125702]: pgmap v8799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:32:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:30 smithi136 ceph-mon[125702]: pgmap v8800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:32:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:30 smithi057 ceph-mon[92072]: pgmap v8800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:32:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:30 smithi122 ceph-mon[125440]: pgmap v8800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:32:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:31.587+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:32:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:31.587+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:32:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:31.587+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:32:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:31.587+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:32:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:31.587+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:32:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:32 smithi136 ceph-mon[125702]: pgmap v8801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:32 smithi057 ceph-mon[92072]: pgmap v8801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:32 smithi122 ceph-mon[125440]: pgmap v8801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:34.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:34 smithi136 ceph-mon[125702]: pgmap v8802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:34 smithi057 ceph-mon[92072]: pgmap v8802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:34 smithi122 ceph-mon[125440]: pgmap v8802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:36.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:36 smithi136 ceph-mon[125702]: pgmap v8803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:36 smithi057 ceph-mon[92072]: pgmap v8803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:36 smithi122 ceph-mon[125440]: pgmap v8803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:38 smithi057 ceph-mon[92072]: pgmap v8804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:38 smithi122 ceph-mon[125440]: pgmap v8804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:38 smithi136 ceph-mon[125702]: pgmap v8804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:40 smithi057 ceph-mon[92072]: pgmap v8805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:40 smithi122 ceph-mon[125440]: pgmap v8805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:40 smithi136 ceph-mon[125702]: pgmap v8805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:42 smithi057 ceph-mon[92072]: pgmap v8806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:42 smithi122 ceph-mon[125440]: pgmap v8806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:43.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:42 smithi136 ceph-mon[125702]: pgmap v8806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:44 smithi057 ceph-mon[92072]: pgmap v8807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:44 smithi122 ceph-mon[125440]: pgmap v8807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:44 smithi136 ceph-mon[125702]: pgmap v8807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:46.599+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:32:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:46.599+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:32:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:46.599+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:32:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:46.599+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:32:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:32:46.599+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:32:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:46 smithi057 ceph-mon[92072]: pgmap v8808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:46 smithi122 ceph-mon[125440]: pgmap v8808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:46 smithi136 ceph-mon[125702]: pgmap v8808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:48 smithi057 ceph-mon[92072]: pgmap v8809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:48 smithi122 ceph-mon[125440]: pgmap v8809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:48 smithi136 ceph-mon[125702]: pgmap v8809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:50 smithi057 ceph-mon[92072]: pgmap v8810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:50 smithi122 ceph-mon[125440]: pgmap v8810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:50 smithi136 ceph-mon[125702]: pgmap v8810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:52.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:52 smithi057 ceph-mon[92072]: pgmap v8811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:52 smithi122 ceph-mon[125440]: pgmap v8811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:52 smithi136 ceph-mon[125702]: pgmap v8811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:54 smithi057 ceph-mon[92072]: pgmap v8812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:54 smithi122 ceph-mon[125440]: pgmap v8812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:54 smithi136 ceph-mon[125702]: pgmap v8812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:56 smithi057 ceph-mon[92072]: pgmap v8813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:56 smithi122 ceph-mon[125440]: pgmap v8813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:56 smithi136 ceph-mon[125702]: pgmap v8813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:32:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:32:58 smithi057 ceph-mon[92072]: pgmap v8814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:32:58 smithi122 ceph-mon[125440]: pgmap v8814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:32:59.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:32:58 smithi136 ceph-mon[125702]: pgmap v8814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:00 smithi057 ceph-mon[92072]: pgmap v8815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:00 smithi122 ceph-mon[125440]: pgmap v8815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:00 smithi136 ceph-mon[125702]: pgmap v8815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:01.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:33:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:01.616+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:33:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:01.616+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:33:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:01.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:33:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:01.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:33:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:02 smithi057 ceph-mon[92072]: pgmap v8816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:02 smithi122 ceph-mon[125440]: pgmap v8816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:02 smithi136 ceph-mon[125702]: pgmap v8816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:04 smithi057 ceph-mon[92072]: pgmap v8817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:33:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:04 smithi122 ceph-mon[125440]: pgmap v8817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:33:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:04 smithi136 ceph-mon[125702]: pgmap v8817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:33:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:06 smithi057 ceph-mon[92072]: pgmap v8818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:33:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:06 smithi122 ceph-mon[125440]: pgmap v8818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:33:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:06 smithi136 ceph-mon[125702]: pgmap v8818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:33:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:08 smithi057 ceph-mon[92072]: pgmap v8819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:33:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:08 smithi122 ceph-mon[125440]: pgmap v8819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:33:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:08 smithi136 ceph-mon[125702]: pgmap v8819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:33:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:10 smithi122 ceph-mon[125440]: pgmap v8820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:33:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:10 smithi136 ceph-mon[125702]: pgmap v8820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:33:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:10 smithi057 ceph-mon[92072]: pgmap v8820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:33:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:11 smithi122 ceph-mon[125440]: osdmap e623: 12 total, 12 up, 12 in 2023-03-02T15:33:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:11 smithi136 ceph-mon[125702]: osdmap e623: 12 total, 12 up, 12 in 2023-03-02T15:33:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:11 smithi057 ceph-mon[92072]: osdmap e623: 12 total, 12 up, 12 in 2023-03-02T15:33:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:12 smithi122 ceph-mon[125440]: pgmap v8822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:33:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:12 smithi136 ceph-mon[125702]: pgmap v8822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:33:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:12 smithi057 ceph-mon[92072]: pgmap v8822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:33:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:14 smithi136 ceph-mon[125702]: pgmap v8823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:14 smithi057 ceph-mon[92072]: pgmap v8823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:14 smithi122 ceph-mon[125440]: pgmap v8823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:16.622+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:33:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:16.623+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:33:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:16.623+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:33:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:16.623+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:33:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:16.623+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:33:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:16 smithi136 ceph-mon[125702]: pgmap v8824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:16 smithi057 ceph-mon[92072]: pgmap v8824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:16 smithi122 ceph-mon[125440]: pgmap v8824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:18 smithi136 ceph-mon[125702]: pgmap v8825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:18 smithi136 ceph-mon[125702]: osdmap e624: 12 total, 12 up, 12 in 2023-03-02T15:33:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:18 smithi057 ceph-mon[92072]: pgmap v8825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:18 smithi057 ceph-mon[92072]: osdmap e624: 12 total, 12 up, 12 in 2023-03-02T15:33:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:18 smithi122 ceph-mon[125440]: pgmap v8825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:18 smithi122 ceph-mon[125440]: osdmap e624: 12 total, 12 up, 12 in 2023-03-02T15:33:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:20 smithi136 ceph-mon[125702]: pgmap v8827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T15:33:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:20 smithi057 ceph-mon[92072]: pgmap v8827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T15:33:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:20 smithi122 ceph-mon[125440]: pgmap v8827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T15:33:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:22 smithi136 ceph-mon[125702]: pgmap v8828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:22 smithi057 ceph-mon[92072]: pgmap v8828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:22 smithi122 ceph-mon[125440]: pgmap v8828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:33:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:24 smithi136 ceph-mon[125702]: pgmap v8829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:33:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:24 smithi057 ceph-mon[92072]: pgmap v8829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:33:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:24 smithi122 ceph-mon[125440]: pgmap v8829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:33:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:26 smithi136 ceph-mon[125702]: pgmap v8830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:33:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:33:27.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:26 smithi057 ceph-mon[92072]: pgmap v8830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:33:27.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:33:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:26 smithi122 ceph-mon[125440]: pgmap v8830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T15:33:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:33:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:33:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:33:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:33:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:33:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:33:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:33:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:33:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:33:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:33:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:29 smithi057 ceph-mon[92072]: pgmap v8831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T15:33:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:29 smithi122 ceph-mon[125440]: pgmap v8831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T15:33:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:29 smithi136 ceph-mon[125702]: pgmap v8831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T15:33:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:31 smithi057 ceph-mon[92072]: pgmap v8832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T15:33:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:31 smithi122 ceph-mon[125440]: pgmap v8832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T15:33:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:31 smithi136 ceph-mon[125702]: pgmap v8832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T15:33:31.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:31.638+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:33:31.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:31.639+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:33:31.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:31.639+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:33:31.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:31.639+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:33:31.640 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:31.639+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:33:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:33 smithi057 ceph-mon[92072]: pgmap v8833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:33:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:33 smithi122 ceph-mon[125440]: pgmap v8833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:33:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:33 smithi136 ceph-mon[125702]: pgmap v8833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:33:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:35 smithi057 ceph-mon[92072]: pgmap v8834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:33:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:35 smithi122 ceph-mon[125440]: pgmap v8834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:33:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:35 smithi136 ceph-mon[125702]: pgmap v8834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:33:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:37 smithi057 ceph-mon[92072]: pgmap v8835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:37 smithi122 ceph-mon[125440]: pgmap v8835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:37 smithi136 ceph-mon[125702]: pgmap v8835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:39 smithi122 ceph-mon[125440]: pgmap v8836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:39 smithi136 ceph-mon[125702]: pgmap v8836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:39 smithi057 ceph-mon[92072]: pgmap v8836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:41 smithi122 ceph-mon[125440]: pgmap v8837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:41 smithi136 ceph-mon[125702]: pgmap v8837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:41 smithi057 ceph-mon[92072]: pgmap v8837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:43 smithi122 ceph-mon[125440]: pgmap v8838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:43.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:43 smithi136 ceph-mon[125702]: pgmap v8838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:43 smithi057 ceph-mon[92072]: pgmap v8838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:45 smithi122 ceph-mon[125440]: pgmap v8839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:45 smithi136 ceph-mon[125702]: pgmap v8839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:45 smithi057 ceph-mon[92072]: pgmap v8839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:46.649+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:33:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:46.649+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:33:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:46.649+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:33:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:46.649+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:33:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:33:46.649+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:33:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:47 smithi122 ceph-mon[125440]: pgmap v8840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:47 smithi136 ceph-mon[125702]: pgmap v8840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:47 smithi057 ceph-mon[92072]: pgmap v8840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:49 smithi136 ceph-mon[125702]: pgmap v8841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:49 smithi057 ceph-mon[92072]: pgmap v8841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:49 smithi122 ceph-mon[125440]: pgmap v8841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:51 smithi136 ceph-mon[125702]: pgmap v8842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:51 smithi057 ceph-mon[92072]: pgmap v8842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:51 smithi122 ceph-mon[125440]: pgmap v8842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:53 smithi136 ceph-mon[125702]: pgmap v8843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:53 smithi057 ceph-mon[92072]: pgmap v8843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:53 smithi122 ceph-mon[125440]: pgmap v8843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:55 smithi136 ceph-mon[125702]: pgmap v8844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:55 smithi057 ceph-mon[92072]: pgmap v8844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:55 smithi122 ceph-mon[125440]: pgmap v8844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:57 smithi136 ceph-mon[125702]: pgmap v8845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:57 smithi057 ceph-mon[92072]: pgmap v8845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:57 smithi122 ceph-mon[125440]: pgmap v8845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:33:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:33:59 smithi136 ceph-mon[125702]: pgmap v8846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:33:59 smithi057 ceph-mon[92072]: pgmap v8846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:33:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:33:59 smithi122 ceph-mon[125440]: pgmap v8846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:01 smithi136 ceph-mon[125702]: pgmap v8847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:01.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:34:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:01.652+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:34:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:01.652+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:34:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:01.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:34:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:01.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:34:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:01 smithi057 ceph-mon[92072]: pgmap v8847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:01 smithi122 ceph-mon[125440]: pgmap v8847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:03 smithi136 ceph-mon[125702]: pgmap v8848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:03 smithi057 ceph-mon[92072]: pgmap v8848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:03 smithi122 ceph-mon[125440]: pgmap v8848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:05 smithi136 ceph-mon[125702]: pgmap v8849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:34:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:05 smithi057 ceph-mon[92072]: pgmap v8849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:34:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:05 smithi122 ceph-mon[125440]: pgmap v8849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:34:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:07 smithi136 ceph-mon[125702]: pgmap v8850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:34:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:07 smithi057 ceph-mon[92072]: pgmap v8850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:34:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:07 smithi122 ceph-mon[125440]: pgmap v8850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:34:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:09 smithi136 ceph-mon[125702]: pgmap v8851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:34:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:09 smithi057 ceph-mon[92072]: pgmap v8851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:34:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:09 smithi122 ceph-mon[125440]: pgmap v8851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:34:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:11 smithi136 ceph-mon[125702]: pgmap v8852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:34:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:11 smithi057 ceph-mon[92072]: pgmap v8852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:34:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:11 smithi122 ceph-mon[125440]: pgmap v8852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:34:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:12 smithi136 ceph-mon[125702]: osdmap e625: 12 total, 12 up, 12 in 2023-03-02T15:34:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:12 smithi057 ceph-mon[92072]: osdmap e625: 12 total, 12 up, 12 in 2023-03-02T15:34:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:12 smithi122 ceph-mon[125440]: osdmap e625: 12 total, 12 up, 12 in 2023-03-02T15:34:13.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:13 smithi136 ceph-mon[125702]: pgmap v8854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:34:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:13 smithi057 ceph-mon[92072]: pgmap v8854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:34:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:13 smithi122 ceph-mon[125440]: pgmap v8854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:34:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:15 smithi136 ceph-mon[125702]: pgmap v8855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:15 smithi057 ceph-mon[92072]: pgmap v8855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:15 smithi122 ceph-mon[125440]: pgmap v8855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:16.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:16.654+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:34:16.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:16.654+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:34:16.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:16.654+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:34:16.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:16.654+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:34:16.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:16.654+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:34:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:17 smithi136 ceph-mon[125702]: pgmap v8856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:17 smithi057 ceph-mon[92072]: pgmap v8856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:17 smithi122 ceph-mon[125440]: pgmap v8856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:19 smithi136 ceph-mon[125702]: pgmap v8857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:19 smithi136 ceph-mon[125702]: osdmap e626: 12 total, 12 up, 12 in 2023-03-02T15:34:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:19 smithi057 ceph-mon[92072]: pgmap v8857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:19 smithi057 ceph-mon[92072]: osdmap e626: 12 total, 12 up, 12 in 2023-03-02T15:34:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:19 smithi122 ceph-mon[125440]: pgmap v8857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:19 smithi122 ceph-mon[125440]: osdmap e626: 12 total, 12 up, 12 in 2023-03-02T15:34:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:21 smithi136 ceph-mon[125702]: pgmap v8859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 252 B/s wr, 12 op/s 2023-03-02T15:34:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:21 smithi057 ceph-mon[92072]: pgmap v8859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 252 B/s wr, 12 op/s 2023-03-02T15:34:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:21 smithi122 ceph-mon[125440]: pgmap v8859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 252 B/s wr, 12 op/s 2023-03-02T15:34:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:23 smithi136 ceph-mon[125702]: pgmap v8860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:23 smithi057 ceph-mon[92072]: pgmap v8860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:23 smithi122 ceph-mon[125440]: pgmap v8860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:34:24.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:24 smithi057 ceph-mon[92072]: pgmap v8861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:34:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:24 smithi122 ceph-mon[125440]: pgmap v8861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:34:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:24 smithi136 ceph-mon[125702]: pgmap v8861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:34:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:26 smithi057 ceph-mon[92072]: pgmap v8862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:34:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:26 smithi122 ceph-mon[125440]: pgmap v8862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:34:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:26 smithi136 ceph-mon[125702]: pgmap v8862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:34:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:34:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:34:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:34:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:28 smithi057 ceph-mon[92072]: pgmap v8863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:34:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:28 smithi122 ceph-mon[125440]: pgmap v8863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:34:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:28 smithi136 ceph-mon[125702]: pgmap v8863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:34:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:34:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:34:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:34:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:34:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:34:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:34:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:34:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:30 smithi057 ceph-mon[92072]: pgmap v8864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:34:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:30 smithi122 ceph-mon[125440]: pgmap v8864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:34:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:30 smithi136 ceph-mon[125702]: pgmap v8864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:34:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:31.669+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:34:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:31.669+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:34:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:31.669+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:34:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:31.669+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:31.669+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:34:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:32 smithi057 ceph-mon[92072]: pgmap v8865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:32 smithi122 ceph-mon[125440]: pgmap v8865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:32 smithi136 ceph-mon[125702]: pgmap v8865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:34 smithi057 ceph-mon[92072]: pgmap v8866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:34 smithi122 ceph-mon[125440]: pgmap v8866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:34 smithi136 ceph-mon[125702]: pgmap v8866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:36 smithi057 ceph-mon[92072]: pgmap v8867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:36 smithi122 ceph-mon[125440]: pgmap v8867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:36 smithi136 ceph-mon[125702]: pgmap v8867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:38 smithi057 ceph-mon[92072]: pgmap v8868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:38 smithi122 ceph-mon[125440]: pgmap v8868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:38 smithi136 ceph-mon[125702]: pgmap v8868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:40 smithi057 ceph-mon[92072]: pgmap v8869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:40 smithi122 ceph-mon[125440]: pgmap v8869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:40 smithi136 ceph-mon[125702]: pgmap v8869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:42 smithi057 ceph-mon[92072]: pgmap v8870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:42 smithi122 ceph-mon[125440]: pgmap v8870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:42 smithi136 ceph-mon[125702]: pgmap v8870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:44 smithi122 ceph-mon[125440]: pgmap v8871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:44 smithi136 ceph-mon[125702]: pgmap v8871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:44 smithi057 ceph-mon[92072]: pgmap v8871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:46.679+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:34:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:46.679+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:34:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:46.679+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:34:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:46.679+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:34:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:34:46.679+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:34:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:46 smithi122 ceph-mon[125440]: pgmap v8872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:46 smithi136 ceph-mon[125702]: pgmap v8872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:46 smithi057 ceph-mon[92072]: pgmap v8872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:48 smithi122 ceph-mon[125440]: pgmap v8873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:48 smithi136 ceph-mon[125702]: pgmap v8873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:49.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:48 smithi057 ceph-mon[92072]: pgmap v8873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:50 smithi136 ceph-mon[125702]: pgmap v8874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:50 smithi057 ceph-mon[92072]: pgmap v8874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:50 smithi122 ceph-mon[125440]: pgmap v8874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:52 smithi136 ceph-mon[125702]: pgmap v8875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:52 smithi057 ceph-mon[92072]: pgmap v8875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:52 smithi122 ceph-mon[125440]: pgmap v8875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:54 smithi136 ceph-mon[125702]: pgmap v8876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:54 smithi057 ceph-mon[92072]: pgmap v8876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:54 smithi122 ceph-mon[125440]: pgmap v8876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:56 smithi136 ceph-mon[125702]: pgmap v8877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:56 smithi057 ceph-mon[92072]: pgmap v8877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:56 smithi122 ceph-mon[125440]: pgmap v8877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:34:59.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:34:58 smithi136 ceph-mon[125702]: pgmap v8878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:34:58 smithi057 ceph-mon[92072]: pgmap v8878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:34:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:34:58 smithi122 ceph-mon[125440]: pgmap v8878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:00 smithi136 ceph-mon[125702]: pgmap v8879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:00 smithi057 ceph-mon[92072]: pgmap v8879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:00 smithi122 ceph-mon[125440]: pgmap v8879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:01.686+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:35:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:01.686+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:35:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:01.686+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:35:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:01.686+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:35:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:01.686+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:35:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:02 smithi136 ceph-mon[125702]: pgmap v8880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:02 smithi057 ceph-mon[92072]: pgmap v8880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:02 smithi122 ceph-mon[125440]: pgmap v8880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:04 smithi136 ceph-mon[125702]: pgmap v8881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:35:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:04 smithi057 ceph-mon[92072]: pgmap v8881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:35:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:04 smithi122 ceph-mon[125440]: pgmap v8881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:35:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:06 smithi136 ceph-mon[125702]: pgmap v8882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:35:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:06 smithi057 ceph-mon[92072]: pgmap v8882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:35:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:06 smithi122 ceph-mon[125440]: pgmap v8882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:35:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:08 smithi136 ceph-mon[125702]: pgmap v8883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:35:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:08 smithi057 ceph-mon[92072]: pgmap v8883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:35:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:08 smithi122 ceph-mon[125440]: pgmap v8883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:35:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:10.751+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:35:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:10.751+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:35:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:10.751+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 131 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:35:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:10.751+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 130 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:35:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:10 smithi136 ceph-mon[125702]: pgmap v8884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:35:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:10 smithi057 ceph-mon[92072]: pgmap v8884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:35:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:10 smithi122 ceph-mon[125440]: pgmap v8884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:35:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:11 smithi136 ceph-mon[125702]: osdmap e627: 12 total, 12 up, 12 in 2023-03-02T15:35:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:11 smithi057 ceph-mon[92072]: osdmap e627: 12 total, 12 up, 12 in 2023-03-02T15:35:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:11 smithi122 ceph-mon[125440]: osdmap e627: 12 total, 12 up, 12 in 2023-03-02T15:35:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:12 smithi136 ceph-mon[125702]: pgmap v8886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:35:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:12 smithi057 ceph-mon[92072]: pgmap v8886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:35:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:12 smithi122 ceph-mon[125440]: pgmap v8886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:35:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:14 smithi136 ceph-mon[125702]: pgmap v8887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:14 smithi057 ceph-mon[92072]: pgmap v8887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:14 smithi122 ceph-mon[125440]: pgmap v8887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:16.699+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:35:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:16.700+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:35:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:16.700+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:35:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:16.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:35:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:16.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:35:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:16 smithi136 ceph-mon[125702]: pgmap v8888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:16 smithi057 ceph-mon[92072]: pgmap v8888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:16 smithi122 ceph-mon[125440]: pgmap v8888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:18 smithi136 ceph-mon[125702]: pgmap v8889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:18 smithi136 ceph-mon[125702]: osdmap e628: 12 total, 12 up, 12 in 2023-03-02T15:35:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:18 smithi057 ceph-mon[92072]: pgmap v8889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:18 smithi057 ceph-mon[92072]: osdmap e628: 12 total, 12 up, 12 in 2023-03-02T15:35:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:18 smithi122 ceph-mon[125440]: pgmap v8889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:18 smithi122 ceph-mon[125440]: osdmap e628: 12 total, 12 up, 12 in 2023-03-02T15:35:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:20 smithi136 ceph-mon[125702]: pgmap v8891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T15:35:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:20 smithi057 ceph-mon[92072]: pgmap v8891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T15:35:21.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:20 smithi122 ceph-mon[125440]: pgmap v8891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T15:35:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:22 smithi136 ceph-mon[125702]: pgmap v8892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:22 smithi057 ceph-mon[92072]: pgmap v8892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:22 smithi122 ceph-mon[125440]: pgmap v8892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:35:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:24 smithi136 ceph-mon[125702]: pgmap v8893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:35:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:24 smithi057 ceph-mon[92072]: pgmap v8893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:35:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:24 smithi122 ceph-mon[125440]: pgmap v8893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:35:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:26 smithi136 ceph-mon[125702]: pgmap v8894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:35:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:26 smithi057 ceph-mon[92072]: pgmap v8894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:35:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:26 smithi122 ceph-mon[125440]: pgmap v8894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:35:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:28 smithi136 ceph-mon[125702]: pgmap v8895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:35:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:35:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:28 smithi057 ceph-mon[92072]: pgmap v8895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:35:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:35:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:28 smithi122 ceph-mon[125440]: pgmap v8895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:35:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:35:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:30 smithi136 ceph-mon[125702]: pgmap v8896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:35:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:30 smithi057 ceph-mon[92072]: pgmap v8896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:35:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:30 smithi122 ceph-mon[125440]: pgmap v8896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:35:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:31.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:35:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:31.712+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:35:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:31.712+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:35:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:31.712+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:35:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:31.712+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:35:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: pgmap v8897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: pgmap v8897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: pgmap v8897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:33.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:35:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:35:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 144.1M 2023-03-02T15:35:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 151169994: error parsing value: Value '151169994' is below minimum 939524096 2023-03-02T15:35:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:35:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:35:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:35:34.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:35:34.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:35:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:35:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 144.1M 2023-03-02T15:35:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 151169994: error parsing value: Value '151169994' is below minimum 939524096 2023-03-02T15:35:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:35:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:35:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:35:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:35:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:35:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:35:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 144.1M 2023-03-02T15:35:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 151169994: error parsing value: Value '151169994' is below minimum 939524096 2023-03-02T15:35:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:35:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:35:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:35:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:35:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:35:34.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:35:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:35 smithi136 ceph-mon[125702]: pgmap v8898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:35 smithi057 ceph-mon[92072]: pgmap v8898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:35 smithi122 ceph-mon[125440]: pgmap v8898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:37 smithi136 ceph-mon[125702]: pgmap v8899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:37 smithi057 ceph-mon[92072]: pgmap v8899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:37 smithi122 ceph-mon[125440]: pgmap v8899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:39 smithi136 ceph-mon[125702]: pgmap v8900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:39 smithi057 ceph-mon[92072]: pgmap v8900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:39 smithi122 ceph-mon[125440]: pgmap v8900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:41 smithi136 ceph-mon[125702]: pgmap v8901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:41 smithi057 ceph-mon[92072]: pgmap v8901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:41 smithi122 ceph-mon[125440]: pgmap v8901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:43 smithi136 ceph-mon[125702]: pgmap v8902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:43 smithi057 ceph-mon[92072]: pgmap v8902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:43 smithi122 ceph-mon[125440]: pgmap v8902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:45 smithi136 ceph-mon[125702]: pgmap v8903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:45 smithi057 ceph-mon[92072]: pgmap v8903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:45 smithi122 ceph-mon[125440]: pgmap v8903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:46.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:35:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:46.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:35:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:46.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:35:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:46.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:35:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:35:46.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:35:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:47 smithi136 ceph-mon[125702]: pgmap v8904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:47 smithi057 ceph-mon[92072]: pgmap v8904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:47 smithi122 ceph-mon[125440]: pgmap v8904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:49 smithi136 ceph-mon[125702]: pgmap v8905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:49 smithi057 ceph-mon[92072]: pgmap v8905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:49 smithi122 ceph-mon[125440]: pgmap v8905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:51 smithi136 ceph-mon[125702]: pgmap v8906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:51 smithi057 ceph-mon[92072]: pgmap v8906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:51 smithi122 ceph-mon[125440]: pgmap v8906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:53 smithi136 ceph-mon[125702]: pgmap v8907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:53 smithi057 ceph-mon[92072]: pgmap v8907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:53 smithi122 ceph-mon[125440]: pgmap v8907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:55 smithi136 ceph-mon[125702]: pgmap v8908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:55 smithi057 ceph-mon[92072]: pgmap v8908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:55 smithi122 ceph-mon[125440]: pgmap v8908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:57 smithi136 ceph-mon[125702]: pgmap v8909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:57 smithi057 ceph-mon[92072]: pgmap v8909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:57 smithi122 ceph-mon[125440]: pgmap v8909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:35:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:35:59 smithi136 ceph-mon[125702]: pgmap v8910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:35:59 smithi057 ceph-mon[92072]: pgmap v8910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:35:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:35:59 smithi122 ceph-mon[125440]: pgmap v8910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:01 smithi136 ceph-mon[125702]: pgmap v8911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:01 smithi057 ceph-mon[92072]: pgmap v8911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:01 smithi122 ceph-mon[125440]: pgmap v8911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:01.738+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:36:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:01.738+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:36:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:01.738+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:36:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:01.738+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:36:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:01.738+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:36:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:03 smithi136 ceph-mon[125702]: pgmap v8912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:03 smithi057 ceph-mon[92072]: pgmap v8912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:03 smithi122 ceph-mon[125440]: pgmap v8912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:05 smithi136 ceph-mon[125702]: pgmap v8913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:36:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:05 smithi057 ceph-mon[92072]: pgmap v8913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:36:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:05 smithi122 ceph-mon[125440]: pgmap v8913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:36:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:07 smithi136 ceph-mon[125702]: pgmap v8914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:36:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:07 smithi057 ceph-mon[92072]: pgmap v8914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:36:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:07 smithi122 ceph-mon[125440]: pgmap v8914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:36:08.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:08 smithi136 ceph-mon[125702]: pgmap v8915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:36:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:08 smithi057 ceph-mon[92072]: pgmap v8915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:36:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:08 smithi122 ceph-mon[125440]: pgmap v8915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:36:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:10 smithi057 ceph-mon[92072]: pgmap v8916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:36:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:10 smithi122 ceph-mon[125440]: pgmap v8916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:36:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:10 smithi136 ceph-mon[125702]: pgmap v8916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:36:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:11 smithi057 ceph-mon[92072]: osdmap e629: 12 total, 12 up, 12 in 2023-03-02T15:36:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:11 smithi122 ceph-mon[125440]: osdmap e629: 12 total, 12 up, 12 in 2023-03-02T15:36:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:11 smithi136 ceph-mon[125702]: osdmap e629: 12 total, 12 up, 12 in 2023-03-02T15:36:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:12 smithi057 ceph-mon[92072]: pgmap v8918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:36:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:12 smithi122 ceph-mon[125440]: pgmap v8918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:36:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:12 smithi136 ceph-mon[125702]: pgmap v8918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:36:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:14 smithi057 ceph-mon[92072]: pgmap v8919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:14 smithi122 ceph-mon[125440]: pgmap v8919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:14 smithi136 ceph-mon[125702]: pgmap v8919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:16.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:16.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:36:16.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:16.755+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:36:16.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:16.755+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:36:16.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:16.755+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:36:16.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:16.755+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:16 smithi057 ceph-mon[92072]: pgmap v8920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:16 smithi122 ceph-mon[125440]: pgmap v8920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:16 smithi136 ceph-mon[125702]: pgmap v8920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:18 smithi057 ceph-mon[92072]: pgmap v8921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:18 smithi057 ceph-mon[92072]: osdmap e630: 12 total, 12 up, 12 in 2023-03-02T15:36:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:18 smithi122 ceph-mon[125440]: pgmap v8921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:18 smithi122 ceph-mon[125440]: osdmap e630: 12 total, 12 up, 12 in 2023-03-02T15:36:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:18 smithi136 ceph-mon[125702]: pgmap v8921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:18 smithi136 ceph-mon[125702]: osdmap e630: 12 total, 12 up, 12 in 2023-03-02T15:36:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:20 smithi057 ceph-mon[92072]: pgmap v8923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T15:36:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:20 smithi122 ceph-mon[125440]: pgmap v8923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T15:36:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:20 smithi136 ceph-mon[125702]: pgmap v8923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-02T15:36:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:22 smithi122 ceph-mon[125440]: pgmap v8924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:22 smithi136 ceph-mon[125702]: pgmap v8924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:22 smithi057 ceph-mon[92072]: pgmap v8924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:36:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:24 smithi122 ceph-mon[125440]: pgmap v8925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:36:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:24 smithi136 ceph-mon[125702]: pgmap v8925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:36:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:24 smithi057 ceph-mon[92072]: pgmap v8925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:36:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:26 smithi122 ceph-mon[125440]: pgmap v8926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:36:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:26 smithi136 ceph-mon[125702]: pgmap v8926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:36:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:26 smithi057 ceph-mon[92072]: pgmap v8926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:36:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:28 smithi122 ceph-mon[125440]: pgmap v8927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:36:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:28 smithi136 ceph-mon[125702]: pgmap v8927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:36:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:28 smithi057 ceph-mon[92072]: pgmap v8927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:36:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:30 smithi136 ceph-mon[125702]: pgmap v8928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T15:36:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:30 smithi057 ceph-mon[92072]: pgmap v8928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T15:36:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:30 smithi122 ceph-mon[125440]: pgmap v8928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T15:36:31.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:31.770+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:36:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:31.770+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:36:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:31.770+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:36:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:31.770+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:36:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:31.770+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:36:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:32 smithi136 ceph-mon[125702]: pgmap v8929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:36:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:32 smithi057 ceph-mon[92072]: pgmap v8929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:36:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:32 smithi122 ceph-mon[125440]: pgmap v8929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:36:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:36:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:36:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:36:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:34 smithi136 ceph-mon[125702]: pgmap v8930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:36:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:36:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:36:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:34 smithi057 ceph-mon[92072]: pgmap v8930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:36:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:36:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:36:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:34 smithi122 ceph-mon[125440]: pgmap v8930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:36:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:36:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:36:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:36 smithi136 ceph-mon[125702]: pgmap v8931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:36:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:36 smithi057 ceph-mon[92072]: pgmap v8931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:36:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:36 smithi122 ceph-mon[125440]: pgmap v8931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:36:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:38 smithi136 ceph-mon[125702]: pgmap v8932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:38 smithi057 ceph-mon[92072]: pgmap v8932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:38 smithi122 ceph-mon[125440]: pgmap v8932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:40 smithi136 ceph-mon[125702]: pgmap v8933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:40 smithi057 ceph-mon[92072]: pgmap v8933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:40 smithi122 ceph-mon[125440]: pgmap v8933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:42 smithi136 ceph-mon[125702]: pgmap v8934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:42 smithi057 ceph-mon[92072]: pgmap v8934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:42 smithi122 ceph-mon[125440]: pgmap v8934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:44 smithi136 ceph-mon[125702]: pgmap v8935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:44 smithi057 ceph-mon[92072]: pgmap v8935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:44 smithi122 ceph-mon[125440]: pgmap v8935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:46.771+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:36:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:46.772+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:36:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:46.772+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:36:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:46.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:36:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:36:46.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:36:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:46 smithi136 ceph-mon[125702]: pgmap v8936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:46 smithi057 ceph-mon[92072]: pgmap v8936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:46 smithi122 ceph-mon[125440]: pgmap v8936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:48 smithi136 ceph-mon[125702]: pgmap v8937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:48 smithi057 ceph-mon[92072]: pgmap v8937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:48 smithi122 ceph-mon[125440]: pgmap v8937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:50 smithi136 ceph-mon[125702]: pgmap v8938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:50 smithi057 ceph-mon[92072]: pgmap v8938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:50 smithi122 ceph-mon[125440]: pgmap v8938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:52 smithi136 ceph-mon[125702]: pgmap v8939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:52 smithi057 ceph-mon[92072]: pgmap v8939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:52 smithi122 ceph-mon[125440]: pgmap v8939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:54 smithi136 ceph-mon[125702]: pgmap v8940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:54 smithi057 ceph-mon[92072]: pgmap v8940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:54 smithi122 ceph-mon[125440]: pgmap v8940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:56 smithi136 ceph-mon[125702]: pgmap v8941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:56 smithi057 ceph-mon[92072]: pgmap v8941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:56 smithi122 ceph-mon[125440]: pgmap v8941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:36:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:36:58 smithi136 ceph-mon[125702]: pgmap v8942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:36:58 smithi057 ceph-mon[92072]: pgmap v8942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:36:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:36:58 smithi122 ceph-mon[125440]: pgmap v8942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:00 smithi136 ceph-mon[125702]: pgmap v8943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:00 smithi057 ceph-mon[92072]: pgmap v8943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:00 smithi122 ceph-mon[125440]: pgmap v8943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:01.786+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:37:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:01.787+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:37:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:01.787+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:37:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:01.787+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:37:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:01.787+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:37:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:02 smithi136 ceph-mon[125702]: pgmap v8944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:02 smithi057 ceph-mon[92072]: pgmap v8944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:02 smithi122 ceph-mon[125440]: pgmap v8944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:04 smithi136 ceph-mon[125702]: pgmap v8945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:37:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:04 smithi057 ceph-mon[92072]: pgmap v8945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:37:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:04 smithi122 ceph-mon[125440]: pgmap v8945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:37:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:06 smithi136 ceph-mon[125702]: pgmap v8946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:37:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:06 smithi136 ceph-mon[125702]: osdmap e631: 12 total, 12 up, 12 in 2023-03-02T15:37:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:06 smithi057 ceph-mon[92072]: pgmap v8946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:37:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:06 smithi057 ceph-mon[92072]: osdmap e631: 12 total, 12 up, 12 in 2023-03-02T15:37:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:06 smithi122 ceph-mon[125440]: pgmap v8946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:37:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:06 smithi122 ceph-mon[125440]: osdmap e631: 12 total, 12 up, 12 in 2023-03-02T15:37:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:08 smithi136 ceph-mon[125702]: pgmap v8948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:37:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:08 smithi136 ceph-mon[125702]: osdmap e632: 12 total, 12 up, 12 in 2023-03-02T15:37:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:08 smithi057 ceph-mon[92072]: pgmap v8948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:37:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:08 smithi057 ceph-mon[92072]: osdmap e632: 12 total, 12 up, 12 in 2023-03-02T15:37:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:08 smithi122 ceph-mon[125440]: pgmap v8948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:37:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:08 smithi122 ceph-mon[125440]: osdmap e632: 12 total, 12 up, 12 in 2023-03-02T15:37:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:10 smithi136 ceph-mon[125702]: pgmap v8950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:37:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:10 smithi057 ceph-mon[92072]: pgmap v8950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:37:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:10 smithi122 ceph-mon[125440]: pgmap v8950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:37:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:12 smithi136 ceph-mon[125702]: pgmap v8951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:37:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:12 smithi057 ceph-mon[92072]: pgmap v8951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:37:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:12 smithi122 ceph-mon[125440]: pgmap v8951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:37:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:14 smithi136 ceph-mon[125702]: pgmap v8952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:37:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:14 smithi057 ceph-mon[92072]: pgmap v8952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:37:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:14 smithi122 ceph-mon[125440]: pgmap v8952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:16.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:16.794+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:16.794+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:16.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:16.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:37:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:16 smithi136 ceph-mon[125702]: pgmap v8953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T15:37:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:16 smithi057 ceph-mon[92072]: pgmap v8953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T15:37:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:16 smithi122 ceph-mon[125440]: pgmap v8953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T15:37:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:18 smithi057 ceph-mon[92072]: pgmap v8954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:37:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:18 smithi122 ceph-mon[125440]: pgmap v8954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:37:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:18 smithi136 ceph-mon[125702]: pgmap v8954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:37:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:20 smithi057 ceph-mon[92072]: pgmap v8955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:37:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:20 smithi122 ceph-mon[125440]: pgmap v8955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:37:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:20 smithi136 ceph-mon[125702]: pgmap v8955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:37:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:22 smithi057 ceph-mon[92072]: pgmap v8956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:37:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:22 smithi122 ceph-mon[125440]: pgmap v8956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:37:23.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:22 smithi136 ceph-mon[125702]: pgmap v8956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:37:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:24 smithi057 ceph-mon[92072]: pgmap v8957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:37:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:24 smithi122 ceph-mon[125440]: pgmap v8957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:37:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:24 smithi136 ceph-mon[125702]: pgmap v8957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:37:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:26 smithi057 ceph-mon[92072]: pgmap v8958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:26 smithi122 ceph-mon[125440]: pgmap v8958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:26 smithi136 ceph-mon[125702]: pgmap v8958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:28 smithi057 ceph-mon[92072]: pgmap v8959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:28 smithi122 ceph-mon[125440]: pgmap v8959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:28 smithi136 ceph-mon[125702]: pgmap v8959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:30 smithi057 ceph-mon[92072]: pgmap v8960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:30 smithi122 ceph-mon[125440]: pgmap v8960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:30 smithi136 ceph-mon[125702]: pgmap v8960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:31.809+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:37:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:31.809+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:37:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:31.809+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:37:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:31.809+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:37:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:31.809+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:37:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:32 smithi057 ceph-mon[92072]: pgmap v8961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:32 smithi122 ceph-mon[125440]: pgmap v8961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:32 smithi136 ceph-mon[125702]: pgmap v8961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:34 smithi057 ceph-mon[92072]: pgmap v8962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:37:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:37:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:37:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:34 smithi122 ceph-mon[125440]: pgmap v8962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:37:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:37:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:37:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:34 smithi136 ceph-mon[125702]: pgmap v8962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:37:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:37:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:37:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:37:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:37:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:37:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:37:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:37:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:37:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:37:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:37:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:37:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:36 smithi057 ceph-mon[92072]: pgmap v8963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:36 smithi122 ceph-mon[125440]: pgmap v8963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:36 smithi136 ceph-mon[125702]: pgmap v8963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:38 smithi057 ceph-mon[92072]: pgmap v8964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:38 smithi122 ceph-mon[125440]: pgmap v8964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:38 smithi136 ceph-mon[125702]: pgmap v8964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:40 smithi057 ceph-mon[92072]: pgmap v8965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:40 smithi122 ceph-mon[125440]: pgmap v8965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:40 smithi136 ceph-mon[125702]: pgmap v8965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:42 smithi057 ceph-mon[92072]: pgmap v8966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:42 smithi122 ceph-mon[125440]: pgmap v8966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:42 smithi136 ceph-mon[125702]: pgmap v8966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:44 smithi057 ceph-mon[92072]: pgmap v8967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:44 smithi122 ceph-mon[125440]: pgmap v8967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:44 smithi136 ceph-mon[125702]: pgmap v8967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:46.818 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:46.817+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:37:46.818 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:46.818+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:37:46.818 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:46.818+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:37:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:46.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:37:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:37:46.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:37:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:46 smithi122 ceph-mon[125440]: pgmap v8968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:46 smithi136 ceph-mon[125702]: pgmap v8968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:46 smithi057 ceph-mon[92072]: pgmap v8968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:48 smithi122 ceph-mon[125440]: pgmap v8969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:48 smithi136 ceph-mon[125702]: pgmap v8969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:48 smithi057 ceph-mon[92072]: pgmap v8969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:50 smithi122 ceph-mon[125440]: pgmap v8970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:50 smithi136 ceph-mon[125702]: pgmap v8970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:50 smithi057 ceph-mon[92072]: pgmap v8970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:52 smithi122 ceph-mon[125440]: pgmap v8971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:52 smithi136 ceph-mon[125702]: pgmap v8971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:52 smithi057 ceph-mon[92072]: pgmap v8971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:54 smithi136 ceph-mon[125702]: pgmap v8972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:54 smithi057 ceph-mon[92072]: pgmap v8972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:54 smithi122 ceph-mon[125440]: pgmap v8972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:56 smithi136 ceph-mon[125702]: pgmap v8973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:56 smithi057 ceph-mon[92072]: pgmap v8973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:56 smithi122 ceph-mon[125440]: pgmap v8973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:37:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:37:58 smithi136 ceph-mon[125702]: pgmap v8974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:37:58 smithi057 ceph-mon[92072]: pgmap v8974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:37:59.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:37:58 smithi122 ceph-mon[125440]: pgmap v8974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:00 smithi136 ceph-mon[125702]: pgmap v8975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:00 smithi057 ceph-mon[92072]: pgmap v8975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:00 smithi122 ceph-mon[125440]: pgmap v8975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:01.824+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:38:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:01.825+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:38:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:01.825+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:38:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:01.825+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:38:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:01.825+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:38:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:02 smithi136 ceph-mon[125702]: pgmap v8976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:02 smithi057 ceph-mon[92072]: pgmap v8976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:02 smithi122 ceph-mon[125440]: pgmap v8976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:04 smithi136 ceph-mon[125702]: pgmap v8977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:38:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:04 smithi057 ceph-mon[92072]: pgmap v8977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:38:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:04 smithi122 ceph-mon[125440]: pgmap v8977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:38:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:06 smithi136 ceph-mon[125702]: pgmap v8978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:38:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:06 smithi136 ceph-mon[125702]: osdmap e633: 12 total, 12 up, 12 in 2023-03-02T15:38:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:06 smithi057 ceph-mon[92072]: pgmap v8978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:38:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:06 smithi057 ceph-mon[92072]: osdmap e633: 12 total, 12 up, 12 in 2023-03-02T15:38:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:06 smithi122 ceph-mon[125440]: pgmap v8978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:38:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:06 smithi122 ceph-mon[125440]: osdmap e633: 12 total, 12 up, 12 in 2023-03-02T15:38:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:08 smithi136 ceph-mon[125702]: pgmap v8980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:38:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:08 smithi136 ceph-mon[125702]: osdmap e634: 12 total, 12 up, 12 in 2023-03-02T15:38:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:08 smithi057 ceph-mon[92072]: pgmap v8980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:38:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:08 smithi057 ceph-mon[92072]: osdmap e634: 12 total, 12 up, 12 in 2023-03-02T15:38:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:08 smithi122 ceph-mon[125440]: pgmap v8980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:38:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:08 smithi122 ceph-mon[125440]: osdmap e634: 12 total, 12 up, 12 in 2023-03-02T15:38:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:10.775+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:38:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:10.775+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:38:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:10.775+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 132 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:38:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:10.775+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 131 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:38:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:10 smithi136 ceph-mon[125702]: pgmap v8982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:38:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:10 smithi057 ceph-mon[92072]: pgmap v8982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:38:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:10 smithi122 ceph-mon[125440]: pgmap v8982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:38:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:12 smithi136 ceph-mon[125702]: pgmap v8983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:38:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:12 smithi057 ceph-mon[92072]: pgmap v8983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:38:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:12 smithi122 ceph-mon[125440]: pgmap v8983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:38:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:14 smithi136 ceph-mon[125702]: pgmap v8984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:38:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:14 smithi057 ceph-mon[92072]: pgmap v8984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:38:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:14 smithi122 ceph-mon[125440]: pgmap v8984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:38:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:16.830+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:38:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:16.830+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:38:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:16.830+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:38:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:16.830+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:38:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:16.830+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:38:17.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:17 smithi136 ceph-mon[125702]: pgmap v8985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T15:38:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:17 smithi057 ceph-mon[92072]: pgmap v8985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T15:38:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:17 smithi122 ceph-mon[125440]: pgmap v8985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T15:38:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:19 smithi136 ceph-mon[125702]: pgmap v8986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:38:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:19 smithi057 ceph-mon[92072]: pgmap v8986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:38:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:19 smithi122 ceph-mon[125440]: pgmap v8986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:38:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:21 smithi136 ceph-mon[125702]: pgmap v8987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:38:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:21 smithi057 ceph-mon[92072]: pgmap v8987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:38:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:21 smithi122 ceph-mon[125440]: pgmap v8987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:38:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:23 smithi136 ceph-mon[125702]: pgmap v8988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:38:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:23 smithi057 ceph-mon[92072]: pgmap v8988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:38:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:23 smithi122 ceph-mon[125440]: pgmap v8988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:38:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:25 smithi136 ceph-mon[125702]: pgmap v8989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:38:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:25 smithi057 ceph-mon[92072]: pgmap v8989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:38:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:25 smithi122 ceph-mon[125440]: pgmap v8989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:38:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:27 smithi136 ceph-mon[125702]: pgmap v8990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:27 smithi057 ceph-mon[92072]: pgmap v8990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:27 smithi122 ceph-mon[125440]: pgmap v8990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:29 smithi136 ceph-mon[125702]: pgmap v8991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:29 smithi057 ceph-mon[92072]: pgmap v8991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:29 smithi122 ceph-mon[125440]: pgmap v8991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:31 smithi136 ceph-mon[125702]: pgmap v8992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:31 smithi057 ceph-mon[92072]: pgmap v8992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:31 smithi122 ceph-mon[125440]: pgmap v8992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:31.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:38:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:31.846+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:38:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:31.846+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:38:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:31.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:38:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:31.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:38:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:33 smithi136 ceph-mon[125702]: pgmap v8993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:33 smithi057 ceph-mon[92072]: pgmap v8993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:33 smithi122 ceph-mon[125440]: pgmap v8993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:35 smithi136 ceph-mon[125702]: pgmap v8994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:35 smithi057 ceph-mon[92072]: pgmap v8994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:35 smithi122 ceph-mon[125440]: pgmap v8994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:38:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:38:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:38:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:37 smithi057 ceph-mon[92072]: pgmap v8995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:38:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:38:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:37 smithi122 ceph-mon[125440]: pgmap v8995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:38:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:38:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:37 smithi136 ceph-mon[125702]: pgmap v8995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:38:37.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:38:37.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:38:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:39 smithi057 ceph-mon[92072]: pgmap v8996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:39 smithi122 ceph-mon[125440]: pgmap v8996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:39 smithi136 ceph-mon[125702]: pgmap v8996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:41 smithi057 ceph-mon[92072]: pgmap v8997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:41 smithi122 ceph-mon[125440]: pgmap v8997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:41 smithi136 ceph-mon[125702]: pgmap v8997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:43 smithi057 ceph-mon[92072]: pgmap v8998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:43 smithi122 ceph-mon[125440]: pgmap v8998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:43 smithi136 ceph-mon[125702]: pgmap v8998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:45 smithi057 ceph-mon[92072]: pgmap v8999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:45 smithi122 ceph-mon[125440]: pgmap v8999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:45 smithi136 ceph-mon[125702]: pgmap v8999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:46.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:38:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:46.857+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:38:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:46.857+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:38:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:46.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:38:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:38:46.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:38:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:47 smithi057 ceph-mon[92072]: pgmap v9000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:47 smithi122 ceph-mon[125440]: pgmap v9000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:47 smithi136 ceph-mon[125702]: pgmap v9000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:49 smithi057 ceph-mon[92072]: pgmap v9001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:49 smithi122 ceph-mon[125440]: pgmap v9001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:49 smithi136 ceph-mon[125702]: pgmap v9001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:51 smithi057 ceph-mon[92072]: pgmap v9002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:51 smithi122 ceph-mon[125440]: pgmap v9002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:51 smithi136 ceph-mon[125702]: pgmap v9002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:53 smithi057 ceph-mon[92072]: pgmap v9003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:53 smithi122 ceph-mon[125440]: pgmap v9003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:53 smithi136 ceph-mon[125702]: pgmap v9003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:55 smithi057 ceph-mon[92072]: pgmap v9004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:55 smithi122 ceph-mon[125440]: pgmap v9004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:55 smithi136 ceph-mon[125702]: pgmap v9004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:57 smithi122 ceph-mon[125440]: pgmap v9005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:57 smithi136 ceph-mon[125702]: pgmap v9005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:57 smithi057 ceph-mon[92072]: pgmap v9005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:38:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:38:59 smithi122 ceph-mon[125440]: pgmap v9006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:38:59 smithi136 ceph-mon[125702]: pgmap v9006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:38:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:38:59 smithi057 ceph-mon[92072]: pgmap v9006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:01 smithi122 ceph-mon[125440]: pgmap v9007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:01 smithi136 ceph-mon[125702]: pgmap v9007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:01 smithi057 ceph-mon[92072]: pgmap v9007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:01.872+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:39:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:01.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:39:01.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:01.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:39:01.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:01.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:39:01.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:01.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:39:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:03 smithi122 ceph-mon[125440]: pgmap v9008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:03 smithi136 ceph-mon[125702]: pgmap v9008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:03 smithi057 ceph-mon[92072]: pgmap v9008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:05 smithi122 ceph-mon[125440]: pgmap v9009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:39:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:05 smithi136 ceph-mon[125702]: pgmap v9009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:39:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:05 smithi057 ceph-mon[92072]: pgmap v9009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:39:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:07 smithi136 ceph-mon[125702]: pgmap v9010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:39:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:07 smithi136 ceph-mon[125702]: osdmap e635: 12 total, 12 up, 12 in 2023-03-02T15:39:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:07 smithi057 ceph-mon[92072]: pgmap v9010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:39:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:07 smithi057 ceph-mon[92072]: osdmap e635: 12 total, 12 up, 12 in 2023-03-02T15:39:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:07 smithi122 ceph-mon[125440]: pgmap v9010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:39:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:07 smithi122 ceph-mon[125440]: osdmap e635: 12 total, 12 up, 12 in 2023-03-02T15:39:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:09 smithi136 ceph-mon[125702]: pgmap v9012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:39:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:09 smithi136 ceph-mon[125702]: osdmap e636: 12 total, 12 up, 12 in 2023-03-02T15:39:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:09 smithi057 ceph-mon[92072]: pgmap v9012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:39:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:09 smithi057 ceph-mon[92072]: osdmap e636: 12 total, 12 up, 12 in 2023-03-02T15:39:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:09 smithi122 ceph-mon[125440]: pgmap v9012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:39:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:09 smithi122 ceph-mon[125440]: osdmap e636: 12 total, 12 up, 12 in 2023-03-02T15:39:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:11 smithi136 ceph-mon[125702]: pgmap v9014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:39:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:11 smithi057 ceph-mon[92072]: pgmap v9014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:39:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:11 smithi122 ceph-mon[125440]: pgmap v9014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:39:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:13 smithi136 ceph-mon[125702]: pgmap v9015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:39:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:13 smithi057 ceph-mon[92072]: pgmap v9015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:39:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:13 smithi122 ceph-mon[125440]: pgmap v9015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:39:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:15 smithi136 ceph-mon[125702]: pgmap v9016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:39:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:15 smithi057 ceph-mon[92072]: pgmap v9016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:39:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:15 smithi122 ceph-mon[125440]: pgmap v9016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:39:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:16.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:39:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:16.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:39:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:16.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:39:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:16.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:39:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:16.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:39:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:17 smithi136 ceph-mon[125702]: pgmap v9017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 11 op/s 2023-03-02T15:39:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:17 smithi057 ceph-mon[92072]: pgmap v9017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 11 op/s 2023-03-02T15:39:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:17 smithi122 ceph-mon[125440]: pgmap v9017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 11 op/s 2023-03-02T15:39:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:19 smithi136 ceph-mon[125702]: pgmap v9018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:39:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:19 smithi057 ceph-mon[92072]: pgmap v9018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:39:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:19 smithi122 ceph-mon[125440]: pgmap v9018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:39:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:21 smithi136 ceph-mon[125702]: pgmap v9019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:39:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:21 smithi057 ceph-mon[92072]: pgmap v9019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:39:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:21 smithi122 ceph-mon[125440]: pgmap v9019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-02T15:39:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:23 smithi136 ceph-mon[125702]: pgmap v9020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:39:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:23 smithi057 ceph-mon[92072]: pgmap v9020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:39:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:23 smithi122 ceph-mon[125440]: pgmap v9020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:39:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:25 smithi136 ceph-mon[125702]: pgmap v9021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:39:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:25 smithi057 ceph-mon[92072]: pgmap v9021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:39:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:25 smithi122 ceph-mon[125440]: pgmap v9021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:39:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:27 smithi136 ceph-mon[125702]: pgmap v9022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:39:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:27 smithi057 ceph-mon[92072]: pgmap v9022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:39:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:27 smithi122 ceph-mon[125440]: pgmap v9022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:39:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:29 smithi136 ceph-mon[125702]: pgmap v9023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:29 smithi057 ceph-mon[92072]: pgmap v9023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:29 smithi122 ceph-mon[125440]: pgmap v9023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:31 smithi136 ceph-mon[125702]: pgmap v9024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:39:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:31 smithi057 ceph-mon[92072]: pgmap v9024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:39:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:31 smithi122 ceph-mon[125440]: pgmap v9024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:39:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:31.894+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:39:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:31.894+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:39:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:31.894+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:39:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:31.894+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:39:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:31.894+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:39:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:33 smithi136 ceph-mon[125702]: pgmap v9025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:39:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:33 smithi057 ceph-mon[92072]: pgmap v9025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:39:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:33 smithi122 ceph-mon[125440]: pgmap v9025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:39:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:35 smithi136 ceph-mon[125702]: pgmap v9026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:35 smithi057 ceph-mon[92072]: pgmap v9026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:35 smithi122 ceph-mon[125440]: pgmap v9026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:37 smithi136 ceph-mon[125702]: pgmap v9027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:39:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:37 smithi057 ceph-mon[92072]: pgmap v9027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:39:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:37 smithi122 ceph-mon[125440]: pgmap v9027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:39:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:39:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:39:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:39:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:39:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:39:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:39:38.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:39:38.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:39:38.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:39:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:39 smithi136 ceph-mon[125702]: pgmap v9028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:39 smithi057 ceph-mon[92072]: pgmap v9028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:39 smithi122 ceph-mon[125440]: pgmap v9028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:40.789+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:39:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:40.789+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:39:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:40.790+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 133 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:39:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:40.790+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 132 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:39:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:41 smithi136 ceph-mon[125702]: pgmap v9029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:41 smithi057 ceph-mon[92072]: pgmap v9029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:41 smithi122 ceph-mon[125440]: pgmap v9029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:43 smithi136 ceph-mon[125702]: pgmap v9030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:43 smithi057 ceph-mon[92072]: pgmap v9030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:43 smithi122 ceph-mon[125440]: pgmap v9030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:45 smithi136 ceph-mon[125702]: pgmap v9031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:45 smithi057 ceph-mon[92072]: pgmap v9031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:45 smithi122 ceph-mon[125440]: pgmap v9031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:46.896+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:39:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:46.897+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:39:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:46.897+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:39:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:46.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:39:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:39:46.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:39:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:47 smithi136 ceph-mon[125702]: pgmap v9032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:47 smithi057 ceph-mon[92072]: pgmap v9032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:47 smithi122 ceph-mon[125440]: pgmap v9032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:49 smithi136 ceph-mon[125702]: pgmap v9033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:49 smithi057 ceph-mon[92072]: pgmap v9033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:49 smithi122 ceph-mon[125440]: pgmap v9033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:51 smithi136 ceph-mon[125702]: pgmap v9034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:51 smithi057 ceph-mon[92072]: pgmap v9034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:51 smithi122 ceph-mon[125440]: pgmap v9034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:53 smithi136 ceph-mon[125702]: pgmap v9035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:53 smithi057 ceph-mon[92072]: pgmap v9035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:53 smithi122 ceph-mon[125440]: pgmap v9035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:55 smithi136 ceph-mon[125702]: pgmap v9036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:55 smithi057 ceph-mon[92072]: pgmap v9036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:55 smithi122 ceph-mon[125440]: pgmap v9036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:57 smithi136 ceph-mon[125702]: pgmap v9037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:57 smithi057 ceph-mon[92072]: pgmap v9037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:57 smithi122 ceph-mon[125440]: pgmap v9037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:39:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:39:59 smithi057 ceph-mon[92072]: pgmap v9038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:39:59 smithi122 ceph-mon[125440]: pgmap v9038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:39:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:39:59 smithi136 ceph-mon[125702]: pgmap v9038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T15:40:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T15:40:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T15:40:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:01 smithi057 ceph-mon[92072]: pgmap v9039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:01 smithi122 ceph-mon[125440]: pgmap v9039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:01 smithi136 ceph-mon[125702]: pgmap v9039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:01.909+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:40:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:01.909+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:40:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:01.909+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:40:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:01.909+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:40:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:01.909+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:40:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:02 smithi057 ceph-mon[92072]: pgmap v9040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:02 smithi122 ceph-mon[125440]: pgmap v9040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:02.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:02 smithi136 ceph-mon[125702]: pgmap v9040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:04 smithi136 ceph-mon[125702]: pgmap v9041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:40:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:04 smithi057 ceph-mon[92072]: pgmap v9041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:40:05.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:04 smithi122 ceph-mon[125440]: pgmap v9041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:40:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:06 smithi136 ceph-mon[125702]: pgmap v9042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:40:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:06 smithi057 ceph-mon[92072]: pgmap v9042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:40:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:06 smithi122 ceph-mon[125440]: pgmap v9042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:40:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:08 smithi136 ceph-mon[125702]: pgmap v9043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:40:09.120 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:08 smithi122 ceph-mon[125440]: pgmap v9043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:40:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:08 smithi057 ceph-mon[92072]: pgmap v9043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:40:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:10 smithi136 ceph-mon[125702]: pgmap v9044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:40:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:10 smithi057 ceph-mon[92072]: pgmap v9044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:40:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:10 smithi122 ceph-mon[125440]: pgmap v9044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:40:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:11 smithi136 ceph-mon[125702]: osdmap e637: 12 total, 12 up, 12 in 2023-03-02T15:40:12.097 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:11 smithi057 ceph-mon[92072]: osdmap e637: 12 total, 12 up, 12 in 2023-03-02T15:40:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:11 smithi122 ceph-mon[125440]: osdmap e637: 12 total, 12 up, 12 in 2023-03-02T15:40:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:12 smithi136 ceph-mon[125702]: pgmap v9046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:40:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:12 smithi057 ceph-mon[92072]: pgmap v9046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:40:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:12 smithi122 ceph-mon[125440]: pgmap v9046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:40:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:14 smithi136 ceph-mon[125702]: pgmap v9047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:14 smithi057 ceph-mon[92072]: pgmap v9047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:14 smithi122 ceph-mon[125440]: pgmap v9047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:16.922+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:40:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:16.922+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:40:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:16.922+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:40:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:16.922+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:40:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:16.922+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:40:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:16 smithi136 ceph-mon[125702]: pgmap v9048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:16 smithi057 ceph-mon[92072]: pgmap v9048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:16 smithi122 ceph-mon[125440]: pgmap v9048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:18 smithi136 ceph-mon[125702]: pgmap v9049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:40:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:18 smithi136 ceph-mon[125702]: osdmap e638: 12 total, 12 up, 12 in 2023-03-02T15:40:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:18 smithi057 ceph-mon[92072]: pgmap v9049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:40:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:18 smithi057 ceph-mon[92072]: osdmap e638: 12 total, 12 up, 12 in 2023-03-02T15:40:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:18 smithi122 ceph-mon[125440]: pgmap v9049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:40:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:18 smithi122 ceph-mon[125440]: osdmap e638: 12 total, 12 up, 12 in 2023-03-02T15:40:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:20 smithi136 ceph-mon[125702]: pgmap v9051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 351 B/s wr, 11 op/s 2023-03-02T15:40:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:20 smithi057 ceph-mon[92072]: pgmap v9051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 351 B/s wr, 11 op/s 2023-03-02T15:40:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:20 smithi122 ceph-mon[125440]: pgmap v9051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 351 B/s wr, 11 op/s 2023-03-02T15:40:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:22 smithi136 ceph-mon[125702]: pgmap v9052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:40:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:22 smithi057 ceph-mon[92072]: pgmap v9052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:40:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:22 smithi122 ceph-mon[125440]: pgmap v9052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:40:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:24 smithi136 ceph-mon[125702]: pgmap v9053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:24 smithi057 ceph-mon[92072]: pgmap v9053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:24 smithi122 ceph-mon[125440]: pgmap v9053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:26 smithi136 ceph-mon[125702]: pgmap v9054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:26 smithi057 ceph-mon[92072]: pgmap v9054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:26 smithi122 ceph-mon[125440]: pgmap v9054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:40:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:28 smithi136 ceph-mon[125702]: pgmap v9055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:40:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:28 smithi057 ceph-mon[92072]: pgmap v9055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:40:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:28 smithi122 ceph-mon[125440]: pgmap v9055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:40:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:30 smithi136 ceph-mon[125702]: pgmap v9056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:40:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:30 smithi057 ceph-mon[92072]: pgmap v9056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:40:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:30 smithi122 ceph-mon[125440]: pgmap v9056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:40:31.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:31.937+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:40:31.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:31.938+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:40:31.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:31.938+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:40:31.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:31.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:40:31.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:31.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:40:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:32 smithi136 ceph-mon[125702]: pgmap v9057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:32 smithi057 ceph-mon[92072]: pgmap v9057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:32 smithi122 ceph-mon[125440]: pgmap v9057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:34 smithi136 ceph-mon[125702]: pgmap v9058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:35.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:34 smithi057 ceph-mon[92072]: pgmap v9058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:34 smithi122 ceph-mon[125440]: pgmap v9058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:36 smithi136 ceph-mon[125702]: pgmap v9059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:36 smithi057 ceph-mon[92072]: pgmap v9059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:36 smithi122 ceph-mon[125440]: pgmap v9059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:38 smithi136 ceph-mon[125702]: pgmap v9060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:40:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:40:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:40:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:40:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:38 smithi057 ceph-mon[92072]: pgmap v9060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:40:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:40:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:40:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:40:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:38 smithi122 ceph-mon[125440]: pgmap v9060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:40:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:40:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:40:39.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:40:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:40 smithi136 ceph-mon[125702]: pgmap v9061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:40 smithi057 ceph-mon[92072]: pgmap v9061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:40 smithi122 ceph-mon[125440]: pgmap v9061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:43.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:42 smithi136 ceph-mon[125702]: pgmap v9062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:42 smithi057 ceph-mon[92072]: pgmap v9062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:42 smithi122 ceph-mon[125440]: pgmap v9062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:44 smithi057 ceph-mon[92072]: pgmap v9063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:44 smithi122 ceph-mon[125440]: pgmap v9063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:44 smithi136 ceph-mon[125702]: pgmap v9063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:46.947+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:40:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:46.947+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:40:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:46.947+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:40:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:46.947+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:40:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:40:46.947+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:40:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:46 smithi057 ceph-mon[92072]: pgmap v9064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:46 smithi122 ceph-mon[125440]: pgmap v9064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:46 smithi136 ceph-mon[125702]: pgmap v9064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:48 smithi057 ceph-mon[92072]: pgmap v9065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:48 smithi122 ceph-mon[125440]: pgmap v9065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:48 smithi136 ceph-mon[125702]: pgmap v9065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:50 smithi057 ceph-mon[92072]: pgmap v9066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:50 smithi122 ceph-mon[125440]: pgmap v9066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:50 smithi136 ceph-mon[125702]: pgmap v9066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:52 smithi057 ceph-mon[92072]: pgmap v9067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:52 smithi122 ceph-mon[125440]: pgmap v9067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:52 smithi136 ceph-mon[125702]: pgmap v9067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:54 smithi057 ceph-mon[92072]: pgmap v9068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:54 smithi122 ceph-mon[125440]: pgmap v9068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:54 smithi136 ceph-mon[125702]: pgmap v9068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:56 smithi057 ceph-mon[92072]: pgmap v9069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:56 smithi122 ceph-mon[125440]: pgmap v9069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:56 smithi136 ceph-mon[125702]: pgmap v9069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:40:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:40:58 smithi057 ceph-mon[92072]: pgmap v9070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:40:58 smithi122 ceph-mon[125440]: pgmap v9070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:40:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:40:58 smithi136 ceph-mon[125702]: pgmap v9070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:00 smithi057 ceph-mon[92072]: pgmap v9071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:00 smithi122 ceph-mon[125440]: pgmap v9071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:00 smithi136 ceph-mon[125702]: pgmap v9071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:01.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:01.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:41:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:01.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:41:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:01.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:41:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:01.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:41:01.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:01.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:41:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:02 smithi057 ceph-mon[92072]: pgmap v9072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:02 smithi122 ceph-mon[125440]: pgmap v9072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:02 smithi136 ceph-mon[125702]: pgmap v9072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:04 smithi057 ceph-mon[92072]: pgmap v9073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:41:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:04 smithi122 ceph-mon[125440]: pgmap v9073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:41:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:04 smithi136 ceph-mon[125702]: pgmap v9073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:41:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:06 smithi057 ceph-mon[92072]: pgmap v9074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:41:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:06 smithi122 ceph-mon[125440]: pgmap v9074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:41:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:06 smithi136 ceph-mon[125702]: pgmap v9074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:41:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:08 smithi057 ceph-mon[92072]: pgmap v9075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:41:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:08 smithi122 ceph-mon[125440]: pgmap v9075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:41:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:08 smithi136 ceph-mon[125702]: pgmap v9075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:41:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:10.803+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:41:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:10.803+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:41:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:10.803+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 133 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:41:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:10.803+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 134 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:41:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:10 smithi057 ceph-mon[92072]: pgmap v9076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:41:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:10 smithi122 ceph-mon[125440]: pgmap v9076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:41:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:10 smithi136 ceph-mon[125702]: pgmap v9076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:41:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:11 smithi122 ceph-mon[125440]: osdmap e639: 12 total, 12 up, 12 in 2023-03-02T15:41:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:11 smithi136 ceph-mon[125702]: osdmap e639: 12 total, 12 up, 12 in 2023-03-02T15:41:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:11 smithi057 ceph-mon[92072]: osdmap e639: 12 total, 12 up, 12 in 2023-03-02T15:41:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:12 smithi122 ceph-mon[125440]: pgmap v9078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:41:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:12 smithi136 ceph-mon[125702]: pgmap v9078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:41:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:12 smithi057 ceph-mon[92072]: pgmap v9078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:41:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:14 smithi122 ceph-mon[125440]: pgmap v9079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:14 smithi136 ceph-mon[125702]: pgmap v9079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:14 smithi057 ceph-mon[92072]: pgmap v9079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:16.976+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:41:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:16.976+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:41:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:16.976+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:41:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:16.976+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:41:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:16.976+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:41:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:16 smithi136 ceph-mon[125702]: pgmap v9080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:16 smithi057 ceph-mon[92072]: pgmap v9080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:16 smithi122 ceph-mon[125440]: pgmap v9080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:18 smithi136 ceph-mon[125702]: pgmap v9081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:18 smithi136 ceph-mon[125702]: osdmap e640: 12 total, 12 up, 12 in 2023-03-02T15:41:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:18 smithi057 ceph-mon[92072]: pgmap v9081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:18 smithi057 ceph-mon[92072]: osdmap e640: 12 total, 12 up, 12 in 2023-03-02T15:41:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:18 smithi122 ceph-mon[125440]: pgmap v9081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:18 smithi122 ceph-mon[125440]: osdmap e640: 12 total, 12 up, 12 in 2023-03-02T15:41:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:20 smithi136 ceph-mon[125702]: pgmap v9083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:41:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:20 smithi057 ceph-mon[92072]: pgmap v9083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:41:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:20 smithi122 ceph-mon[125440]: pgmap v9083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:41:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:22 smithi136 ceph-mon[125702]: pgmap v9084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:22 smithi057 ceph-mon[92072]: pgmap v9084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:22 smithi122 ceph-mon[125440]: pgmap v9084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:41:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:24 smithi136 ceph-mon[125702]: pgmap v9085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:41:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:24 smithi057 ceph-mon[92072]: pgmap v9085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:41:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:24 smithi122 ceph-mon[125440]: pgmap v9085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:41:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:26 smithi136 ceph-mon[125702]: pgmap v9086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:41:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:26 smithi057 ceph-mon[92072]: pgmap v9086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:41:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:26 smithi122 ceph-mon[125440]: pgmap v9086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:41:29.346 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:28 smithi136 ceph-mon[125702]: pgmap v9087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:41:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:28 smithi057 ceph-mon[92072]: pgmap v9087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:41:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:28 smithi122 ceph-mon[125440]: pgmap v9087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:41:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:30 smithi136 ceph-mon[125702]: pgmap v9088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:41:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:30 smithi057 ceph-mon[92072]: pgmap v9088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:41:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:30 smithi122 ceph-mon[125440]: pgmap v9088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:41:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:31.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:41:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:31.990+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:41:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:31.990+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:41:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:31.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:41:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:31.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:41:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:32 smithi136 ceph-mon[125702]: pgmap v9089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:32 smithi057 ceph-mon[92072]: pgmap v9089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:32 smithi122 ceph-mon[125440]: pgmap v9089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:34 smithi136 ceph-mon[125702]: pgmap v9090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:34 smithi057 ceph-mon[92072]: pgmap v9090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:34 smithi122 ceph-mon[125440]: pgmap v9090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:36 smithi136 ceph-mon[125702]: pgmap v9091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:36 smithi057 ceph-mon[92072]: pgmap v9091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:36 smithi122 ceph-mon[125440]: pgmap v9091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:39 smithi136 ceph-mon[125702]: pgmap v9092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:41:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:39 smithi057 ceph-mon[92072]: pgmap v9092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:41:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:39 smithi122 ceph-mon[125440]: pgmap v9092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:41:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:41:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:41:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:41:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:41:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:41:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:41:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:41:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:41:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:41:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:41 smithi136 ceph-mon[125702]: pgmap v9093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:41 smithi057 ceph-mon[92072]: pgmap v9093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:41 smithi122 ceph-mon[125440]: pgmap v9093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:43 smithi136 ceph-mon[125702]: pgmap v9094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:43 smithi057 ceph-mon[92072]: pgmap v9094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:43 smithi122 ceph-mon[125440]: pgmap v9094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:45 smithi136 ceph-mon[125702]: pgmap v9095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:45 smithi057 ceph-mon[92072]: pgmap v9095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:45 smithi122 ceph-mon[125440]: pgmap v9095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:46.999+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:41:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:47.000+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:41:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:47.000+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:41:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:47.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:41:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:41:47.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:41:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:47 smithi136 ceph-mon[125702]: pgmap v9096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:47 smithi057 ceph-mon[92072]: pgmap v9096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:47 smithi122 ceph-mon[125440]: pgmap v9096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:49 smithi136 ceph-mon[125702]: pgmap v9097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:49 smithi057 ceph-mon[92072]: pgmap v9097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:49 smithi122 ceph-mon[125440]: pgmap v9097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:51 smithi136 ceph-mon[125702]: pgmap v9098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:51 smithi057 ceph-mon[92072]: pgmap v9098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:51 smithi122 ceph-mon[125440]: pgmap v9098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:53 smithi136 ceph-mon[125702]: pgmap v9099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:53 smithi057 ceph-mon[92072]: pgmap v9099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:53 smithi122 ceph-mon[125440]: pgmap v9099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:55 smithi136 ceph-mon[125702]: pgmap v9100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:55 smithi057 ceph-mon[92072]: pgmap v9100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:55 smithi122 ceph-mon[125440]: pgmap v9100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:57 smithi136 ceph-mon[125702]: pgmap v9101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:57 smithi057 ceph-mon[92072]: pgmap v9101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:57 smithi122 ceph-mon[125440]: pgmap v9101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:41:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:41:59 smithi136 ceph-mon[125702]: pgmap v9102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:41:59 smithi057 ceph-mon[92072]: pgmap v9102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:41:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:41:59 smithi122 ceph-mon[125440]: pgmap v9102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:01 smithi136 ceph-mon[125702]: pgmap v9103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:01 smithi057 ceph-mon[92072]: pgmap v9103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:01 smithi122 ceph-mon[125440]: pgmap v9103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:02.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:42:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:02.003+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:42:02.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:02.003+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:42:02.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:02.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:42:02.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:02.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:42:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:03 smithi136 ceph-mon[125702]: pgmap v9104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:03 smithi057 ceph-mon[92072]: pgmap v9104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:03 smithi122 ceph-mon[125440]: pgmap v9104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:05 smithi136 ceph-mon[125702]: pgmap v9105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:42:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:05 smithi057 ceph-mon[92072]: pgmap v9105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:42:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:05 smithi122 ceph-mon[125440]: pgmap v9105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:42:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:07 smithi136 ceph-mon[125702]: pgmap v9106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:42:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:07 smithi057 ceph-mon[92072]: pgmap v9106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:42:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:07 smithi122 ceph-mon[125440]: pgmap v9106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:42:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:09 smithi136 ceph-mon[125702]: pgmap v9107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:42:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:09 smithi057 ceph-mon[92072]: pgmap v9107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:42:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:09 smithi122 ceph-mon[125440]: pgmap v9107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:42:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:11 smithi057 ceph-mon[92072]: pgmap v9108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:42:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:11 smithi122 ceph-mon[125440]: pgmap v9108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:42:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:11 smithi136 ceph-mon[125702]: pgmap v9108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:42:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:12 smithi057 ceph-mon[92072]: osdmap e641: 12 total, 12 up, 12 in 2023-03-02T15:42:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:12 smithi122 ceph-mon[125440]: osdmap e641: 12 total, 12 up, 12 in 2023-03-02T15:42:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:12 smithi136 ceph-mon[125702]: osdmap e641: 12 total, 12 up, 12 in 2023-03-02T15:42:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:13 smithi057 ceph-mon[92072]: pgmap v9110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:42:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:13 smithi122 ceph-mon[125440]: pgmap v9110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:42:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:13 smithi136 ceph-mon[125702]: pgmap v9110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:42:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:15 smithi057 ceph-mon[92072]: pgmap v9111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:15 smithi122 ceph-mon[125440]: pgmap v9111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:15 smithi136 ceph-mon[125702]: pgmap v9111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:17.014+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:42:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:17.014+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:42:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:17.014+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:42:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:17.014+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:42:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:17.014+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:42:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:17 smithi057 ceph-mon[92072]: pgmap v9112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:17 smithi122 ceph-mon[125440]: pgmap v9112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:17 smithi136 ceph-mon[125702]: pgmap v9112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:19 smithi057 ceph-mon[92072]: pgmap v9113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:19 smithi057 ceph-mon[92072]: osdmap e642: 12 total, 12 up, 12 in 2023-03-02T15:42:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:19 smithi122 ceph-mon[125440]: pgmap v9113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:19 smithi122 ceph-mon[125440]: osdmap e642: 12 total, 12 up, 12 in 2023-03-02T15:42:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:19 smithi136 ceph-mon[125702]: pgmap v9113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:19 smithi136 ceph-mon[125702]: osdmap e642: 12 total, 12 up, 12 in 2023-03-02T15:42:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:21 smithi057 ceph-mon[92072]: pgmap v9115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T15:42:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:21 smithi122 ceph-mon[125440]: pgmap v9115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T15:42:21.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:21 smithi136 ceph-mon[125702]: pgmap v9115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T15:42:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:23 smithi057 ceph-mon[92072]: pgmap v9116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:23 smithi122 ceph-mon[125440]: pgmap v9116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:23 smithi136 ceph-mon[125702]: pgmap v9116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:42:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:25 smithi057 ceph-mon[92072]: pgmap v9117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:42:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:25 smithi122 ceph-mon[125440]: pgmap v9117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:42:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:25 smithi136 ceph-mon[125702]: pgmap v9117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:42:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:27 smithi057 ceph-mon[92072]: pgmap v9118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:42:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:27 smithi122 ceph-mon[125440]: pgmap v9118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:42:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:27 smithi136 ceph-mon[125702]: pgmap v9118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:42:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:29 smithi057 ceph-mon[92072]: pgmap v9119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:42:29.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:29 smithi122 ceph-mon[125440]: pgmap v9119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:42:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:29 smithi136 ceph-mon[125702]: pgmap v9119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:42:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:31 smithi057 ceph-mon[92072]: pgmap v9120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:42:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:31 smithi122 ceph-mon[125440]: pgmap v9120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:42:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:31 smithi136 ceph-mon[125702]: pgmap v9120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:42:32.024 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:32.023+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:42:32.025 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:32.023+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:42:32.025 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:32.023+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:42:32.026 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:32.023+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:42:32.026 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:32.023+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:42:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:33 smithi057 ceph-mon[92072]: pgmap v9121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:33 smithi122 ceph-mon[125440]: pgmap v9121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:33 smithi136 ceph-mon[125702]: pgmap v9121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:35 smithi057 ceph-mon[92072]: pgmap v9122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:35 smithi122 ceph-mon[125440]: pgmap v9122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:35 smithi136 ceph-mon[125702]: pgmap v9122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:37 smithi057 ceph-mon[92072]: pgmap v9123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:37 smithi122 ceph-mon[125440]: pgmap v9123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:37 smithi136 ceph-mon[125702]: pgmap v9123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:39.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:39 smithi057 ceph-mon[92072]: pgmap v9124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:39 smithi122 ceph-mon[125440]: pgmap v9124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:39 smithi136 ceph-mon[125702]: pgmap v9124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:42:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:42:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:42:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:41 smithi122 ceph-mon[125440]: pgmap v9125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:42:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:42:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:42:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:41 smithi136 ceph-mon[125702]: pgmap v9125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:42:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:42:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:42:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:41 smithi057 ceph-mon[92072]: pgmap v9125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:42:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:42:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:42:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:43 smithi122 ceph-mon[125440]: pgmap v9126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:43 smithi136 ceph-mon[125702]: pgmap v9126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:43 smithi057 ceph-mon[92072]: pgmap v9126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:45 smithi122 ceph-mon[125440]: pgmap v9127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:45 smithi136 ceph-mon[125702]: pgmap v9127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:45 smithi057 ceph-mon[92072]: pgmap v9127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:47.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:42:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:47.040+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:42:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:47.040+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:42:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:47.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:42:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:42:47.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:42:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:47 smithi136 ceph-mon[125702]: pgmap v9128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:47 smithi057 ceph-mon[92072]: pgmap v9128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:47 smithi122 ceph-mon[125440]: pgmap v9128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:49 smithi136 ceph-mon[125702]: pgmap v9129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:49 smithi057 ceph-mon[92072]: pgmap v9129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:49 smithi122 ceph-mon[125440]: pgmap v9129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:51 smithi136 ceph-mon[125702]: pgmap v9130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:51 smithi057 ceph-mon[92072]: pgmap v9130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:51 smithi122 ceph-mon[125440]: pgmap v9130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:53 smithi136 ceph-mon[125702]: pgmap v9131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:53 smithi057 ceph-mon[92072]: pgmap v9131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:53 smithi122 ceph-mon[125440]: pgmap v9131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:55 smithi136 ceph-mon[125702]: pgmap v9132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:55 smithi057 ceph-mon[92072]: pgmap v9132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:55 smithi122 ceph-mon[125440]: pgmap v9132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:57 smithi136 ceph-mon[125702]: pgmap v9133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:57 smithi057 ceph-mon[92072]: pgmap v9133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:57 smithi122 ceph-mon[125440]: pgmap v9133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:42:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:42:59 smithi136 ceph-mon[125702]: pgmap v9134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:42:59 smithi057 ceph-mon[92072]: pgmap v9134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:42:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:42:59 smithi122 ceph-mon[125440]: pgmap v9134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:01 smithi136 ceph-mon[125702]: pgmap v9135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:01 smithi057 ceph-mon[92072]: pgmap v9135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:01 smithi122 ceph-mon[125440]: pgmap v9135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:02.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:43:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:02.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:43:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:02.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:43:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:02.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:43:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:02.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:43:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:03 smithi136 ceph-mon[125702]: pgmap v9136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:03 smithi057 ceph-mon[92072]: pgmap v9136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:03 smithi122 ceph-mon[125440]: pgmap v9136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:05 smithi136 ceph-mon[125702]: pgmap v9137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:43:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:05 smithi057 ceph-mon[92072]: pgmap v9137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:43:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:05 smithi122 ceph-mon[125440]: pgmap v9137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:43:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:07 smithi136 ceph-mon[125702]: pgmap v9138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:43:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:07 smithi057 ceph-mon[92072]: pgmap v9138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:43:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:07 smithi122 ceph-mon[125440]: pgmap v9138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:43:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:09 smithi136 ceph-mon[125702]: pgmap v9139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:43:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:09 smithi057 ceph-mon[92072]: pgmap v9139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:43:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:09 smithi122 ceph-mon[125440]: pgmap v9139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:43:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:11 smithi136 ceph-mon[125702]: pgmap v9140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:43:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:11 smithi057 ceph-mon[92072]: pgmap v9140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:43:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:11 smithi122 ceph-mon[125440]: pgmap v9140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:43:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:12 smithi136 ceph-mon[125702]: osdmap e643: 12 total, 12 up, 12 in 2023-03-02T15:43:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:12 smithi057 ceph-mon[92072]: osdmap e643: 12 total, 12 up, 12 in 2023-03-02T15:43:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:12 smithi122 ceph-mon[125440]: osdmap e643: 12 total, 12 up, 12 in 2023-03-02T15:43:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:13 smithi136 ceph-mon[125702]: pgmap v9142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:43:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:13 smithi057 ceph-mon[92072]: pgmap v9142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:43:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:13 smithi122 ceph-mon[125440]: pgmap v9142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:43:15.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:15 smithi136 ceph-mon[125702]: pgmap v9143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:15 smithi057 ceph-mon[92072]: pgmap v9143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:15 smithi122 ceph-mon[125440]: pgmap v9143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:17.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:43:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:17.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:43:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:17.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:43:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:17.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:43:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:17.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:43:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:17 smithi136 ceph-mon[125702]: pgmap v9144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:17 smithi057 ceph-mon[92072]: pgmap v9144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:17 smithi122 ceph-mon[125440]: pgmap v9144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:19 smithi136 ceph-mon[125702]: pgmap v9145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:19 smithi136 ceph-mon[125702]: osdmap e644: 12 total, 12 up, 12 in 2023-03-02T15:43:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:19 smithi057 ceph-mon[92072]: pgmap v9145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:19 smithi057 ceph-mon[92072]: osdmap e644: 12 total, 12 up, 12 in 2023-03-02T15:43:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:19 smithi122 ceph-mon[125440]: pgmap v9145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:19 smithi122 ceph-mon[125440]: osdmap e644: 12 total, 12 up, 12 in 2023-03-02T15:43:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:21 smithi136 ceph-mon[125702]: pgmap v9147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T15:43:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:21 smithi057 ceph-mon[92072]: pgmap v9147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T15:43:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:21 smithi122 ceph-mon[125440]: pgmap v9147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T15:43:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:23 smithi136 ceph-mon[125702]: pgmap v9148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:23 smithi057 ceph-mon[92072]: pgmap v9148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:23 smithi122 ceph-mon[125440]: pgmap v9148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:43:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:25 smithi057 ceph-mon[92072]: pgmap v9149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:43:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:25 smithi122 ceph-mon[125440]: pgmap v9149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:43:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:25 smithi136 ceph-mon[125702]: pgmap v9149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:43:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:27 smithi057 ceph-mon[92072]: pgmap v9150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:43:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:27 smithi122 ceph-mon[125440]: pgmap v9150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:43:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:27 smithi136 ceph-mon[125702]: pgmap v9150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:43:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:29 smithi057 ceph-mon[92072]: pgmap v9151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:43:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:29 smithi122 ceph-mon[125440]: pgmap v9151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:43:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:29 smithi136 ceph-mon[125702]: pgmap v9151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:43:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:31 smithi057 ceph-mon[92072]: pgmap v9152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:43:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:31 smithi122 ceph-mon[125440]: pgmap v9152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:43:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:31 smithi136 ceph-mon[125702]: pgmap v9152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:43:32.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:32.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:43:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:32.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:43:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:32.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:43:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:32.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:43:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:32.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:43:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:33 smithi057 ceph-mon[92072]: pgmap v9153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:33 smithi122 ceph-mon[125440]: pgmap v9153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:33 smithi136 ceph-mon[125702]: pgmap v9153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:35 smithi057 ceph-mon[92072]: pgmap v9154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:35 smithi122 ceph-mon[125440]: pgmap v9154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:35 smithi136 ceph-mon[125702]: pgmap v9154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:37 smithi057 ceph-mon[92072]: pgmap v9155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:37 smithi122 ceph-mon[125440]: pgmap v9155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:37 smithi136 ceph-mon[125702]: pgmap v9155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:39 smithi057 ceph-mon[92072]: pgmap v9156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:39 smithi122 ceph-mon[125440]: pgmap v9156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:39 smithi136 ceph-mon[125702]: pgmap v9156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:41 smithi057 ceph-mon[92072]: pgmap v9157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:43:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:43:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:43:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:43:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:41 smithi122 ceph-mon[125440]: pgmap v9157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:43:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:43:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:43:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:43:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:41 smithi136 ceph-mon[125702]: pgmap v9157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:43:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:43:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:43:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:43:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:42 smithi057 ceph-mon[92072]: pgmap v9158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:42 smithi122 ceph-mon[125440]: pgmap v9158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:42 smithi136 ceph-mon[125702]: pgmap v9158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:44 smithi136 ceph-mon[125702]: pgmap v9159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:44 smithi057 ceph-mon[92072]: pgmap v9159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:44 smithi122 ceph-mon[125440]: pgmap v9159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:46 smithi136 ceph-mon[125702]: pgmap v9160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:47.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:43:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:47.100+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:43:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:47.100+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:43:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:47.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:43:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:43:47.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:43:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:46 smithi057 ceph-mon[92072]: pgmap v9160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:46 smithi122 ceph-mon[125440]: pgmap v9160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:48 smithi136 ceph-mon[125702]: pgmap v9161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:48 smithi057 ceph-mon[92072]: pgmap v9161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:48 smithi122 ceph-mon[125440]: pgmap v9161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:50 smithi136 ceph-mon[125702]: pgmap v9162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:50 smithi057 ceph-mon[92072]: pgmap v9162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:50 smithi122 ceph-mon[125440]: pgmap v9162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:52 smithi136 ceph-mon[125702]: pgmap v9163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:52 smithi057 ceph-mon[92072]: pgmap v9163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:52 smithi122 ceph-mon[125440]: pgmap v9163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:55.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:54 smithi136 ceph-mon[125702]: pgmap v9164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:54 smithi057 ceph-mon[92072]: pgmap v9164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:54 smithi122 ceph-mon[125440]: pgmap v9164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:56 smithi136 ceph-mon[125702]: pgmap v9165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:56 smithi057 ceph-mon[92072]: pgmap v9165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:56 smithi122 ceph-mon[125440]: pgmap v9165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:43:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:43:58 smithi136 ceph-mon[125702]: pgmap v9166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:43:58 smithi057 ceph-mon[92072]: pgmap v9166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:43:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:43:58 smithi122 ceph-mon[125440]: pgmap v9166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:00 smithi136 ceph-mon[125702]: pgmap v9167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:00 smithi057 ceph-mon[92072]: pgmap v9167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:00 smithi122 ceph-mon[125440]: pgmap v9167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:02.113 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:02.113+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:44:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:02.113+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:44:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:02.113+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:44:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:02.113+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:44:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:02.113+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:44:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:02 smithi136 ceph-mon[125702]: pgmap v9168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:02 smithi057 ceph-mon[92072]: pgmap v9168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:02 smithi122 ceph-mon[125440]: pgmap v9168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:04 smithi136 ceph-mon[125702]: pgmap v9169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:44:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:04 smithi057 ceph-mon[92072]: pgmap v9169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:44:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:04 smithi122 ceph-mon[125440]: pgmap v9169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:44:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:06 smithi136 ceph-mon[125702]: pgmap v9170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:44:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:06 smithi057 ceph-mon[92072]: pgmap v9170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:44:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:06 smithi122 ceph-mon[125440]: pgmap v9170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:44:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:08.403+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T15:44:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:08.403+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T15:44:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:08.403+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5870019fd0 tx=0x7f58700b3000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:44:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:08.403+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5870019fd0 tx=0x7f58700b3000 comp rx=0 tx=0).stop 2023-03-02T15:44:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:08.403+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T15:44:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:08.403+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T15:44:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:08.403+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T15:44:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:08.403+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T15:44:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:08.403+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:44:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:08.404+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f587005e050 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T15:44:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:08 smithi136 ceph-mon[125702]: pgmap v9171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:44:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:08 smithi057 ceph-mon[92072]: pgmap v9171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:44:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:08 smithi122 ceph-mon[125440]: pgmap v9171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:44:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:10.829+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:44:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:10.829+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:44:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:10.834+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 134 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:44:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:10.834+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 135 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:44:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:10 smithi136 ceph-mon[125702]: pgmap v9172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:44:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:10 smithi057 ceph-mon[92072]: pgmap v9172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:44:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:10 smithi122 ceph-mon[125440]: pgmap v9172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:44:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:11 smithi057 ceph-mon[92072]: osdmap e645: 12 total, 12 up, 12 in 2023-03-02T15:44:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:11 smithi122 ceph-mon[125440]: osdmap e645: 12 total, 12 up, 12 in 2023-03-02T15:44:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:11 smithi136 ceph-mon[125702]: osdmap e645: 12 total, 12 up, 12 in 2023-03-02T15:44:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:12 smithi057 ceph-mon[92072]: pgmap v9174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:44:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:12 smithi122 ceph-mon[125440]: pgmap v9174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:44:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:12 smithi136 ceph-mon[125702]: pgmap v9174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:44:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:14 smithi057 ceph-mon[92072]: pgmap v9175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:14 smithi122 ceph-mon[125440]: pgmap v9175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:14 smithi136 ceph-mon[125702]: pgmap v9175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:17.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:44:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:17.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:44:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:17.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:44:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:17.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:44:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:17.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:44:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:16 smithi057 ceph-mon[92072]: pgmap v9176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:16 smithi122 ceph-mon[125440]: pgmap v9176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:16 smithi136 ceph-mon[125702]: pgmap v9176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:18 smithi057 ceph-mon[92072]: pgmap v9177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:18 smithi057 ceph-mon[92072]: osdmap e646: 12 total, 12 up, 12 in 2023-03-02T15:44:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:18 smithi122 ceph-mon[125440]: pgmap v9177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:18 smithi122 ceph-mon[125440]: osdmap e646: 12 total, 12 up, 12 in 2023-03-02T15:44:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:18 smithi136 ceph-mon[125702]: pgmap v9177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:18 smithi136 ceph-mon[125702]: osdmap e646: 12 total, 12 up, 12 in 2023-03-02T15:44:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:20 smithi057 ceph-mon[92072]: pgmap v9179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T15:44:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:20 smithi122 ceph-mon[125440]: pgmap v9179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T15:44:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:20 smithi136 ceph-mon[125702]: pgmap v9179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T15:44:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:22 smithi057 ceph-mon[92072]: pgmap v9180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:22 smithi122 ceph-mon[125440]: pgmap v9180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:22 smithi136 ceph-mon[125702]: pgmap v9180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:44:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:24 smithi057 ceph-mon[92072]: pgmap v9181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:44:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:24 smithi122 ceph-mon[125440]: pgmap v9181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:44:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:24 smithi136 ceph-mon[125702]: pgmap v9181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:44:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:26 smithi057 ceph-mon[92072]: pgmap v9182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:44:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:26 smithi122 ceph-mon[125440]: pgmap v9182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:44:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:26 smithi136 ceph-mon[125702]: pgmap v9182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:44:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:28 smithi057 ceph-mon[92072]: pgmap v9183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:44:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:28 smithi122 ceph-mon[125440]: pgmap v9183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:44:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:28 smithi136 ceph-mon[125702]: pgmap v9183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:44:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:30 smithi057 ceph-mon[92072]: pgmap v9184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:44:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:30 smithi122 ceph-mon[125440]: pgmap v9184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:44:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:30 smithi136 ceph-mon[125702]: pgmap v9184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:44:32.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:32.134+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:44:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:32.135+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:44:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:32.135+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:44:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:32.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:44:32.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:32.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:44:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:32 smithi057 ceph-mon[92072]: pgmap v9185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:32 smithi122 ceph-mon[125440]: pgmap v9185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:32 smithi136 ceph-mon[125702]: pgmap v9185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:34 smithi057 ceph-mon[92072]: pgmap v9186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:34 smithi122 ceph-mon[125440]: pgmap v9186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:34 smithi136 ceph-mon[125702]: pgmap v9186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:36 smithi057 ceph-mon[92072]: pgmap v9187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:36 smithi122 ceph-mon[125440]: pgmap v9187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:36 smithi136 ceph-mon[125702]: pgmap v9187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:38 smithi057 ceph-mon[92072]: pgmap v9188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:38 smithi122 ceph-mon[125440]: pgmap v9188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:38 smithi136 ceph-mon[125702]: pgmap v9188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:40 smithi057 ceph-mon[92072]: pgmap v9189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:40 smithi122 ceph-mon[125440]: pgmap v9189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:40 smithi136 ceph-mon[125702]: pgmap v9189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:44:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:44:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:44:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:42 smithi122 ceph-mon[125440]: pgmap v9190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:44:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:44:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:44:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:42 smithi136 ceph-mon[125702]: pgmap v9190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:44:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:44:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:44:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:42 smithi057 ceph-mon[92072]: pgmap v9190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:44:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:44:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:44:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:44 smithi122 ceph-mon[125440]: pgmap v9191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:44 smithi136 ceph-mon[125702]: pgmap v9191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:44 smithi057 ceph-mon[92072]: pgmap v9191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:47.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:44:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:47.138+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:44:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:47.138+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:44:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:47.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:44:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:44:47.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:44:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:46 smithi122 ceph-mon[125440]: pgmap v9192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:46 smithi136 ceph-mon[125702]: pgmap v9192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:46 smithi057 ceph-mon[92072]: pgmap v9192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:48 smithi136 ceph-mon[125702]: pgmap v9193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:48 smithi057 ceph-mon[92072]: pgmap v9193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:48 smithi122 ceph-mon[125440]: pgmap v9193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:50 smithi136 ceph-mon[125702]: pgmap v9194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:50 smithi057 ceph-mon[92072]: pgmap v9194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:50 smithi122 ceph-mon[125440]: pgmap v9194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:52 smithi136 ceph-mon[125702]: pgmap v9195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:53.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:52 smithi057 ceph-mon[92072]: pgmap v9195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:52 smithi122 ceph-mon[125440]: pgmap v9195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:54 smithi136 ceph-mon[125702]: pgmap v9196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:54 smithi057 ceph-mon[92072]: pgmap v9196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:54 smithi122 ceph-mon[125440]: pgmap v9196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:56 smithi136 ceph-mon[125702]: pgmap v9197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:56 smithi057 ceph-mon[92072]: pgmap v9197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:56 smithi122 ceph-mon[125440]: pgmap v9197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:44:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:44:58 smithi136 ceph-mon[125702]: pgmap v9198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:44:58 smithi057 ceph-mon[92072]: pgmap v9198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:44:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:44:58 smithi122 ceph-mon[125440]: pgmap v9198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:45:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:00 smithi136 ceph-mon[125702]: pgmap v9199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:01.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:00 smithi057 ceph-mon[92072]: pgmap v9199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:00 smithi122 ceph-mon[125440]: pgmap v9199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:02.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:45:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:02.155+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:45:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:02.155+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:45:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:02.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:45:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:02.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:45:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:02 smithi136 ceph-mon[125702]: pgmap v9200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:02 smithi057 ceph-mon[92072]: pgmap v9200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:02 smithi122 ceph-mon[125440]: pgmap v9200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:04 smithi136 ceph-mon[125702]: pgmap v9201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:45:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:04 smithi057 ceph-mon[92072]: pgmap v9201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:45:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:04 smithi122 ceph-mon[125440]: pgmap v9201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:45:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:07 smithi136 ceph-mon[125702]: pgmap v9202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:45:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:07 smithi136 ceph-mon[125702]: osdmap e647: 12 total, 12 up, 12 in 2023-03-02T15:45:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:07 smithi057 ceph-mon[92072]: pgmap v9202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:45:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:07 smithi057 ceph-mon[92072]: osdmap e647: 12 total, 12 up, 12 in 2023-03-02T15:45:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:07 smithi122 ceph-mon[125440]: pgmap v9202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:45:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:07 smithi122 ceph-mon[125440]: osdmap e647: 12 total, 12 up, 12 in 2023-03-02T15:45:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:09 smithi136 ceph-mon[125702]: pgmap v9204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:45:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:09 smithi057 ceph-mon[92072]: pgmap v9204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:45:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:09 smithi122 ceph-mon[125440]: pgmap v9204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:45:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:11 smithi136 ceph-mon[125702]: pgmap v9205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:45:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:11 smithi057 ceph-mon[92072]: pgmap v9205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:45:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:11 smithi122 ceph-mon[125440]: pgmap v9205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:45:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:13 smithi136 ceph-mon[125702]: pgmap v9206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:45:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:13 smithi057 ceph-mon[92072]: pgmap v9206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:45:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:13 smithi122 ceph-mon[125440]: pgmap v9206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:45:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:15 smithi136 ceph-mon[125702]: pgmap v9207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:45:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:15 smithi057 ceph-mon[92072]: pgmap v9207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:45:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:15 smithi122 ceph-mon[125440]: pgmap v9207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:45:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:17.167+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:45:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:17.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:45:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:17.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:45:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:17.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:45:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:17.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:45:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:17 smithi136 ceph-mon[125702]: pgmap v9208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:45:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:17 smithi057 ceph-mon[92072]: pgmap v9208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:45:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:17 smithi122 ceph-mon[125440]: pgmap v9208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:45:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:19 smithi136 ceph-mon[125702]: pgmap v9209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 176 B/s wr, 13 op/s 2023-03-02T15:45:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:19 smithi136 ceph-mon[125702]: osdmap e648: 12 total, 12 up, 12 in 2023-03-02T15:45:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:19 smithi057 ceph-mon[92072]: pgmap v9209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 176 B/s wr, 13 op/s 2023-03-02T15:45:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:19 smithi057 ceph-mon[92072]: osdmap e648: 12 total, 12 up, 12 in 2023-03-02T15:45:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:19 smithi122 ceph-mon[125440]: pgmap v9209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 176 B/s wr, 13 op/s 2023-03-02T15:45:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:19 smithi122 ceph-mon[125440]: osdmap e648: 12 total, 12 up, 12 in 2023-03-02T15:45:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:21 smithi136 ceph-mon[125702]: pgmap v9211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:45:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:21 smithi057 ceph-mon[92072]: pgmap v9211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:45:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:21 smithi122 ceph-mon[125440]: pgmap v9211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:45:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:23 smithi136 ceph-mon[125702]: pgmap v9212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:45:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:23 smithi057 ceph-mon[92072]: pgmap v9212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:45:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:23 smithi122 ceph-mon[125440]: pgmap v9212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:45:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:25 smithi136 ceph-mon[125702]: pgmap v9213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:45:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:25 smithi057 ceph-mon[92072]: pgmap v9213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:45:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:25 smithi122 ceph-mon[125440]: pgmap v9213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:45:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:27 smithi136 ceph-mon[125702]: pgmap v9214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:45:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:27 smithi057 ceph-mon[92072]: pgmap v9214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:45:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:27 smithi122 ceph-mon[125440]: pgmap v9214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:45:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:29 smithi136 ceph-mon[125702]: pgmap v9215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:45:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:29 smithi057 ceph-mon[92072]: pgmap v9215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:45:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:29 smithi122 ceph-mon[125440]: pgmap v9215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:45:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:31 smithi057 ceph-mon[92072]: pgmap v9216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:45:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:31 smithi122 ceph-mon[125440]: pgmap v9216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:45:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:31 smithi136 ceph-mon[125702]: pgmap v9216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:45:32.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:32.173+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:45:32.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:32.174+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:45:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:32.174+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:45:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:32.174+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:45:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:32.174+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:45:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:33 smithi057 ceph-mon[92072]: pgmap v9217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:33 smithi122 ceph-mon[125440]: pgmap v9217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:33 smithi136 ceph-mon[125702]: pgmap v9217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:35 smithi057 ceph-mon[92072]: pgmap v9218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:45:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:35 smithi122 ceph-mon[125440]: pgmap v9218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:45:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:35 smithi136 ceph-mon[125702]: pgmap v9218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:45:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:37 smithi057 ceph-mon[92072]: pgmap v9219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T15:45:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:37 smithi122 ceph-mon[125440]: pgmap v9219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T15:45:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:37 smithi136 ceph-mon[125702]: pgmap v9219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T15:45:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:39 smithi057 ceph-mon[92072]: pgmap v9220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:45:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:39 smithi122 ceph-mon[125440]: pgmap v9220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:45:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:39 smithi136 ceph-mon[125702]: pgmap v9220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:45:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:41 smithi057 ceph-mon[92072]: pgmap v9221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:45:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:41 smithi122 ceph-mon[125440]: pgmap v9221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:45:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:41 smithi136 ceph-mon[125702]: pgmap v9221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:45:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:43 smithi057 ceph-mon[92072]: pgmap v9222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:45:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:45:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:43 smithi122 ceph-mon[125440]: pgmap v9222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:45:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:45:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:43 smithi136 ceph-mon[125702]: pgmap v9222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:45:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:45:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:45 smithi057 ceph-mon[92072]: pgmap v9223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:45:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:45 smithi122 ceph-mon[125440]: pgmap v9223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:45:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:45 smithi136 ceph-mon[125702]: pgmap v9223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:45:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:46.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:47.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:45:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:47.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:45:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:47.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:45:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:47.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:45:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:45:47.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:45:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: pgmap v9224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 133.1M 2023-03-02T15:45:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 139627270: error parsing value: Value '139627270' is below minimum 939524096 2023-03-02T15:45:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:45:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:45:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:45:47.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:45:47.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: pgmap v9224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 133.1M 2023-03-02T15:45:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 139627270: error parsing value: Value '139627270' is below minimum 939524096 2023-03-02T15:45:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:45:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:45:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:45:47.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:45:47.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: pgmap v9224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 133.1M 2023-03-02T15:45:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 139627270: error parsing value: Value '139627270' is below minimum 939524096 2023-03-02T15:45:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:45:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:45:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:45:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:45:47.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:45:47.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:45:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:48 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:45:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:48 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:45:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:48 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:45:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:48 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:45:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:48 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:45:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:48 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:45:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:49 smithi136 ceph-mon[125702]: pgmap v9225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:45:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:49 smithi057 ceph-mon[92072]: pgmap v9225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:45:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:49 smithi122 ceph-mon[125440]: pgmap v9225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:45:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:51 smithi136 ceph-mon[125702]: pgmap v9226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:51 smithi057 ceph-mon[92072]: pgmap v9226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:51 smithi122 ceph-mon[125440]: pgmap v9226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:53 smithi136 ceph-mon[125702]: pgmap v9227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:53 smithi057 ceph-mon[92072]: pgmap v9227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:53 smithi122 ceph-mon[125440]: pgmap v9227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:55 smithi136 ceph-mon[125702]: pgmap v9228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:45:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:55 smithi057 ceph-mon[92072]: pgmap v9228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:45:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:55 smithi122 ceph-mon[125440]: pgmap v9228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:45:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:57 smithi136 ceph-mon[125702]: pgmap v9229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:57 smithi057 ceph-mon[92072]: pgmap v9229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:57 smithi122 ceph-mon[125440]: pgmap v9229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:45:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:45:59 smithi136 ceph-mon[125702]: pgmap v9230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:45:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:45:59 smithi057 ceph-mon[92072]: pgmap v9230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:45:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:45:59 smithi122 ceph-mon[125440]: pgmap v9230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:01.339 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:01 smithi057 ceph-mon[92072]: pgmap v9231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:01 smithi136 ceph-mon[125702]: pgmap v9231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:01 smithi122 ceph-mon[125440]: pgmap v9231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:02.194+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:46:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:02.195+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:46:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:02.195+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:46:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:02.195+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:46:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:02.195+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:46:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:03 smithi057 ceph-mon[92072]: pgmap v9232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:03 smithi122 ceph-mon[125440]: pgmap v9232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:03 smithi136 ceph-mon[125702]: pgmap v9232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:05 smithi057 ceph-mon[92072]: pgmap v9233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:46:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:05 smithi122 ceph-mon[125440]: pgmap v9233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:46:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:05 smithi136 ceph-mon[125702]: pgmap v9233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:46:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:07 smithi057 ceph-mon[92072]: pgmap v9234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:46:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:07 smithi057 ceph-mon[92072]: osdmap e649: 12 total, 12 up, 12 in 2023-03-02T15:46:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:07 smithi122 ceph-mon[125440]: pgmap v9234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:46:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:07 smithi122 ceph-mon[125440]: osdmap e649: 12 total, 12 up, 12 in 2023-03-02T15:46:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:07 smithi136 ceph-mon[125702]: pgmap v9234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:46:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:07 smithi136 ceph-mon[125702]: osdmap e649: 12 total, 12 up, 12 in 2023-03-02T15:46:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:09 smithi057 ceph-mon[92072]: pgmap v9236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:46:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:09 smithi122 ceph-mon[125440]: pgmap v9236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:46:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:09 smithi136 ceph-mon[125702]: pgmap v9236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:46:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:11 smithi057 ceph-mon[92072]: pgmap v9237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:46:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:11 smithi122 ceph-mon[125440]: pgmap v9237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:46:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:11 smithi136 ceph-mon[125702]: pgmap v9237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:46:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:13 smithi057 ceph-mon[92072]: pgmap v9238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:46:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:13 smithi122 ceph-mon[125440]: pgmap v9238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:46:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:13 smithi136 ceph-mon[125702]: pgmap v9238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:46:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:15 smithi057 ceph-mon[92072]: pgmap v9239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:46:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:15 smithi122 ceph-mon[125440]: pgmap v9239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:46:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:15 smithi136 ceph-mon[125702]: pgmap v9239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:46:17.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:17.203+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:46:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:17.203+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:46:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:17.203+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:46:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:17.203+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:46:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:17.203+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:46:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:17 smithi057 ceph-mon[92072]: pgmap v9240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:46:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:17 smithi122 ceph-mon[125440]: pgmap v9240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:46:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:17 smithi136 ceph-mon[125702]: pgmap v9240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:46:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:19 smithi057 ceph-mon[92072]: pgmap v9241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 182 B/s wr, 13 op/s 2023-03-02T15:46:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:19 smithi057 ceph-mon[92072]: osdmap e650: 12 total, 12 up, 12 in 2023-03-02T15:46:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:19 smithi122 ceph-mon[125440]: pgmap v9241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 182 B/s wr, 13 op/s 2023-03-02T15:46:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:19 smithi122 ceph-mon[125440]: osdmap e650: 12 total, 12 up, 12 in 2023-03-02T15:46:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:19 smithi136 ceph-mon[125702]: pgmap v9241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 182 B/s wr, 13 op/s 2023-03-02T15:46:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:19 smithi136 ceph-mon[125702]: osdmap e650: 12 total, 12 up, 12 in 2023-03-02T15:46:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:21 smithi057 ceph-mon[92072]: pgmap v9243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:46:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:21 smithi122 ceph-mon[125440]: pgmap v9243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:46:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:21 smithi136 ceph-mon[125702]: pgmap v9243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:46:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:23 smithi057 ceph-mon[92072]: pgmap v9244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:46:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:23 smithi122 ceph-mon[125440]: pgmap v9244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:46:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:23 smithi136 ceph-mon[125702]: pgmap v9244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:46:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:25 smithi057 ceph-mon[92072]: pgmap v9245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:46:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:25 smithi122 ceph-mon[125440]: pgmap v9245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:46:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:25 smithi136 ceph-mon[125702]: pgmap v9245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:46:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:27 smithi057 ceph-mon[92072]: pgmap v9246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:46:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:27 smithi122 ceph-mon[125440]: pgmap v9246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:46:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:27 smithi136 ceph-mon[125702]: pgmap v9246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:46:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:29 smithi057 ceph-mon[92072]: pgmap v9247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:46:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:29 smithi122 ceph-mon[125440]: pgmap v9247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:46:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:29 smithi136 ceph-mon[125702]: pgmap v9247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T15:46:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:31 smithi057 ceph-mon[92072]: pgmap v9248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T15:46:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:31 smithi122 ceph-mon[125440]: pgmap v9248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T15:46:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:31 smithi136 ceph-mon[125702]: pgmap v9248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T15:46:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:32.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:46:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:32.204+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:46:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:32.204+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:46:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:32.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:46:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:32.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:46:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:33 smithi057 ceph-mon[92072]: pgmap v9249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:33 smithi122 ceph-mon[125440]: pgmap v9249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:33 smithi136 ceph-mon[125702]: pgmap v9249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:34 smithi136 ceph-mon[125702]: pgmap v9250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:34 smithi057 ceph-mon[92072]: pgmap v9250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:34 smithi122 ceph-mon[125440]: pgmap v9250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:36 smithi136 ceph-mon[125702]: pgmap v9251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:36 smithi057 ceph-mon[92072]: pgmap v9251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:36 smithi122 ceph-mon[125440]: pgmap v9251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:38 smithi057 ceph-mon[92072]: pgmap v9252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:38 smithi122 ceph-mon[125440]: pgmap v9252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:38 smithi136 ceph-mon[125702]: pgmap v9252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:40 smithi057 ceph-mon[92072]: pgmap v9253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:40 smithi122 ceph-mon[125440]: pgmap v9253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:40 smithi136 ceph-mon[125702]: pgmap v9253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:42 smithi057 ceph-mon[92072]: pgmap v9254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:42 smithi122 ceph-mon[125440]: pgmap v9254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:42 smithi136 ceph-mon[125702]: pgmap v9254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:44 smithi057 ceph-mon[92072]: pgmap v9255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:44 smithi122 ceph-mon[125440]: pgmap v9255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:44 smithi136 ceph-mon[125702]: pgmap v9255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:46 smithi057 ceph-mon[92072]: pgmap v9256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:46 smithi122 ceph-mon[125440]: pgmap v9256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:47.219+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:46:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:47.219+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:46:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:47.219+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:46:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:47.219+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:46:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:46:47.219+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:46:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:46 smithi136 ceph-mon[125702]: pgmap v9256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:46:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:46:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:46:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:48 smithi057 ceph-mon[92072]: pgmap v9257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:46:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:46:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:46:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:48 smithi122 ceph-mon[125440]: pgmap v9257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:46:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:46:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:46:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:48 smithi136 ceph-mon[125702]: pgmap v9257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:46:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:46:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:46:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:50 smithi057 ceph-mon[92072]: pgmap v9258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:50 smithi122 ceph-mon[125440]: pgmap v9258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:50 smithi136 ceph-mon[125702]: pgmap v9258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:52 smithi057 ceph-mon[92072]: pgmap v9259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:52 smithi122 ceph-mon[125440]: pgmap v9259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:52 smithi136 ceph-mon[125702]: pgmap v9259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:46:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:54 smithi057 ceph-mon[92072]: pgmap v9260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:54 smithi122 ceph-mon[125440]: pgmap v9260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:54 smithi136 ceph-mon[125702]: pgmap v9260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:56 smithi057 ceph-mon[92072]: pgmap v9261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:56 smithi122 ceph-mon[125440]: pgmap v9261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:56 smithi136 ceph-mon[125702]: pgmap v9261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:46:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:46:58 smithi057 ceph-mon[92072]: pgmap v9262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:46:58 smithi122 ceph-mon[125440]: pgmap v9262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:46:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:46:58 smithi136 ceph-mon[125702]: pgmap v9262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:00 smithi057 ceph-mon[92072]: pgmap v9263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:00 smithi122 ceph-mon[125440]: pgmap v9263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:00 smithi136 ceph-mon[125702]: pgmap v9263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:02.234+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:47:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:02.234+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:47:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:02.234+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:47:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:02.234+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:47:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:02.234+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:47:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:02 smithi057 ceph-mon[92072]: pgmap v9264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:02 smithi122 ceph-mon[125440]: pgmap v9264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:02 smithi136 ceph-mon[125702]: pgmap v9264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:05.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:04 smithi057 ceph-mon[92072]: pgmap v9265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:47:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:04 smithi122 ceph-mon[125440]: pgmap v9265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:47:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:04 smithi136 ceph-mon[125702]: pgmap v9265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:47:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:06 smithi122 ceph-mon[125440]: pgmap v9266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:47:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:06 smithi122 ceph-mon[125440]: osdmap e651: 12 total, 12 up, 12 in 2023-03-02T15:47:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:06 smithi136 ceph-mon[125702]: pgmap v9266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:47:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:06 smithi136 ceph-mon[125702]: osdmap e651: 12 total, 12 up, 12 in 2023-03-02T15:47:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:06 smithi057 ceph-mon[92072]: pgmap v9266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:47:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:06 smithi057 ceph-mon[92072]: osdmap e651: 12 total, 12 up, 12 in 2023-03-02T15:47:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:08 smithi122 ceph-mon[125440]: pgmap v9268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:47:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:08 smithi122 ceph-mon[125440]: osdmap e652: 12 total, 12 up, 12 in 2023-03-02T15:47:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:08 smithi136 ceph-mon[125702]: pgmap v9268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:47:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:08 smithi136 ceph-mon[125702]: osdmap e652: 12 total, 12 up, 12 in 2023-03-02T15:47:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:08 smithi057 ceph-mon[92072]: pgmap v9268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:47:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:08 smithi057 ceph-mon[92072]: osdmap e652: 12 total, 12 up, 12 in 2023-03-02T15:47:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:10.856+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:47:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:10.856+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:47:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:10.856+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 136 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:47:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:10.857+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 135 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:47:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:10 smithi122 ceph-mon[125440]: pgmap v9270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:47:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:10 smithi136 ceph-mon[125702]: pgmap v9270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:47:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:10 smithi057 ceph-mon[92072]: pgmap v9270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:47:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:12 smithi122 ceph-mon[125440]: pgmap v9271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:47:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:12 smithi136 ceph-mon[125702]: pgmap v9271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:47:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:12 smithi057 ceph-mon[92072]: pgmap v9271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:47:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:14 smithi122 ceph-mon[125440]: pgmap v9272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:47:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:14 smithi136 ceph-mon[125702]: pgmap v9272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:47:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:14 smithi057 ceph-mon[92072]: pgmap v9272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:47:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:17.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:47:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:17.251+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:47:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:17.251+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:47:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:17.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:47:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:17.251+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:47:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:16 smithi136 ceph-mon[125702]: pgmap v9273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T15:47:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:16 smithi057 ceph-mon[92072]: pgmap v9273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T15:47:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:16 smithi122 ceph-mon[125440]: pgmap v9273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T15:47:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:18 smithi136 ceph-mon[125702]: pgmap v9274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:47:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:18 smithi057 ceph-mon[92072]: pgmap v9274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:47:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:18 smithi122 ceph-mon[125440]: pgmap v9274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:47:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:20 smithi136 ceph-mon[125702]: pgmap v9275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:47:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:20 smithi057 ceph-mon[92072]: pgmap v9275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:47:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:20 smithi122 ceph-mon[125440]: pgmap v9275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:47:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:22 smithi136 ceph-mon[125702]: pgmap v9276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:47:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:22 smithi057 ceph-mon[92072]: pgmap v9276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:47:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:22 smithi122 ceph-mon[125440]: pgmap v9276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:47:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:24 smithi136 ceph-mon[125702]: pgmap v9277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:47:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:24 smithi057 ceph-mon[92072]: pgmap v9277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:47:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:24 smithi122 ceph-mon[125440]: pgmap v9277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:47:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:26 smithi136 ceph-mon[125702]: pgmap v9278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:26 smithi057 ceph-mon[92072]: pgmap v9278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:26 smithi122 ceph-mon[125440]: pgmap v9278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:29 smithi136 ceph-mon[125702]: pgmap v9279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:29 smithi057 ceph-mon[92072]: pgmap v9279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:29 smithi122 ceph-mon[125440]: pgmap v9279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:31 smithi136 ceph-mon[125702]: pgmap v9280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:31 smithi057 ceph-mon[92072]: pgmap v9280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:31 smithi122 ceph-mon[125440]: pgmap v9280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:32.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:47:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:32.267+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:47:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:32.267+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:47:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:32.267+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:47:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:32.267+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:47:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:33 smithi136 ceph-mon[125702]: pgmap v9281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:33 smithi057 ceph-mon[92072]: pgmap v9281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:33 smithi122 ceph-mon[125440]: pgmap v9281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:35 smithi136 ceph-mon[125702]: pgmap v9282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:35 smithi057 ceph-mon[92072]: pgmap v9282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:35 smithi122 ceph-mon[125440]: pgmap v9282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:37 smithi136 ceph-mon[125702]: pgmap v9283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:37 smithi057 ceph-mon[92072]: pgmap v9283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:37 smithi122 ceph-mon[125440]: pgmap v9283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:39 smithi136 ceph-mon[125702]: pgmap v9284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:39 smithi057 ceph-mon[92072]: pgmap v9284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:39 smithi122 ceph-mon[125440]: pgmap v9284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:41 smithi136 ceph-mon[125702]: pgmap v9285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:41 smithi057 ceph-mon[92072]: pgmap v9285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:41 smithi122 ceph-mon[125440]: pgmap v9285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:43 smithi136 ceph-mon[125702]: pgmap v9286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:43 smithi057 ceph-mon[92072]: pgmap v9286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:43 smithi122 ceph-mon[125440]: pgmap v9286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:45 smithi136 ceph-mon[125702]: pgmap v9287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:45.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:45 smithi057 ceph-mon[92072]: pgmap v9287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:45 smithi122 ceph-mon[125440]: pgmap v9287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:47.271+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:47:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:47.271+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:47:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:47.271+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:47:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:47.271+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:47:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:47.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:47:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:47 smithi136 ceph-mon[125702]: pgmap v9288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:47 smithi057 ceph-mon[92072]: pgmap v9288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:47 smithi122 ceph-mon[125440]: pgmap v9288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:49 smithi136 ceph-mon[125702]: pgmap v9289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:47:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:47:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:47:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:49 smithi057 ceph-mon[92072]: pgmap v9289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:47:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:47:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:47:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:49 smithi122 ceph-mon[125440]: pgmap v9289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:47:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:47:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:47:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:47:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:47:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:47:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:47:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:47:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:47:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:47:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:47:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:47:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:51 smithi136 ceph-mon[125702]: pgmap v9290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:51 smithi057 ceph-mon[92072]: pgmap v9290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:51 smithi122 ceph-mon[125440]: pgmap v9290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:53 smithi136 ceph-mon[125702]: pgmap v9291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:53 smithi057 ceph-mon[92072]: pgmap v9291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:53 smithi122 ceph-mon[125440]: pgmap v9291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:55 smithi136 ceph-mon[125702]: pgmap v9292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:55 smithi057 ceph-mon[92072]: pgmap v9292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:55 smithi122 ceph-mon[125440]: pgmap v9292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:55.863+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:47:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:55.863+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:47:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:55.863+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 136 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:47:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:47:55.863+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 137 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:47:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:57 smithi136 ceph-mon[125702]: pgmap v9293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:57 smithi057 ceph-mon[92072]: pgmap v9293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:57 smithi122 ceph-mon[125440]: pgmap v9293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:47:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:47:59 smithi136 ceph-mon[125702]: pgmap v9294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:47:59 smithi057 ceph-mon[92072]: pgmap v9294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:47:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:47:59 smithi122 ceph-mon[125440]: pgmap v9294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:01 smithi136 ceph-mon[125702]: pgmap v9295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:01 smithi057 ceph-mon[92072]: pgmap v9295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:01 smithi122 ceph-mon[125440]: pgmap v9295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:02.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:02.276+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:48:02.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:02.276+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:48:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:02.276+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:48:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:02.276+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:48:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:02.276+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:48:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:03 smithi136 ceph-mon[125702]: pgmap v9296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:03 smithi057 ceph-mon[92072]: pgmap v9296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:03 smithi122 ceph-mon[125440]: pgmap v9296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:05 smithi057 ceph-mon[92072]: pgmap v9297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:48:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:05 smithi122 ceph-mon[125440]: pgmap v9297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:48:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:05 smithi136 ceph-mon[125702]: pgmap v9297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:48:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:07 smithi057 ceph-mon[92072]: pgmap v9298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:48:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:07 smithi057 ceph-mon[92072]: osdmap e653: 12 total, 12 up, 12 in 2023-03-02T15:48:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:07 smithi122 ceph-mon[125440]: pgmap v9298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:48:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:07 smithi122 ceph-mon[125440]: osdmap e653: 12 total, 12 up, 12 in 2023-03-02T15:48:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:07 smithi136 ceph-mon[125702]: pgmap v9298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:48:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:07 smithi136 ceph-mon[125702]: osdmap e653: 12 total, 12 up, 12 in 2023-03-02T15:48:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:09 smithi057 ceph-mon[92072]: pgmap v9300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:48:09.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:09 smithi057 ceph-mon[92072]: osdmap e654: 12 total, 12 up, 12 in 2023-03-02T15:48:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:09 smithi122 ceph-mon[125440]: pgmap v9300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:48:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:09 smithi122 ceph-mon[125440]: osdmap e654: 12 total, 12 up, 12 in 2023-03-02T15:48:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:09 smithi136 ceph-mon[125702]: pgmap v9300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:48:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:09 smithi136 ceph-mon[125702]: osdmap e654: 12 total, 12 up, 12 in 2023-03-02T15:48:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:11 smithi057 ceph-mon[92072]: pgmap v9302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:48:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:11 smithi122 ceph-mon[125440]: pgmap v9302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:48:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:11 smithi136 ceph-mon[125702]: pgmap v9302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T15:48:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:13 smithi057 ceph-mon[92072]: pgmap v9303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:48:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:13 smithi122 ceph-mon[125440]: pgmap v9303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:48:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:13 smithi136 ceph-mon[125702]: pgmap v9303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:48:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:15 smithi057 ceph-mon[92072]: pgmap v9304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:48:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:15 smithi122 ceph-mon[125440]: pgmap v9304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:48:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:15 smithi136 ceph-mon[125702]: pgmap v9304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:48:17.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:17.292+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:48:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:17.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:48:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:17.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:48:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:17.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:48:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:17.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:48:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:17 smithi057 ceph-mon[92072]: pgmap v9305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T15:48:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:17 smithi122 ceph-mon[125440]: pgmap v9305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T15:48:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:17 smithi136 ceph-mon[125702]: pgmap v9305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T15:48:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:19 smithi057 ceph-mon[92072]: pgmap v9306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:48:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:19 smithi122 ceph-mon[125440]: pgmap v9306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:48:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:19 smithi136 ceph-mon[125702]: pgmap v9306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:48:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:21 smithi057 ceph-mon[92072]: pgmap v9307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:48:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:21 smithi122 ceph-mon[125440]: pgmap v9307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:48:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:21 smithi136 ceph-mon[125702]: pgmap v9307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:48:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:23 smithi057 ceph-mon[92072]: pgmap v9308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:48:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:23 smithi122 ceph-mon[125440]: pgmap v9308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:48:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:23 smithi136 ceph-mon[125702]: pgmap v9308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T15:48:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:25 smithi057 ceph-mon[92072]: pgmap v9309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:48:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:25 smithi122 ceph-mon[125440]: pgmap v9309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:48:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:25 smithi136 ceph-mon[125702]: pgmap v9309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:48:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:27 smithi057 ceph-mon[92072]: pgmap v9310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:27 smithi122 ceph-mon[125440]: pgmap v9310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:27 smithi136 ceph-mon[125702]: pgmap v9310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:29 smithi057 ceph-mon[92072]: pgmap v9311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:29 smithi122 ceph-mon[125440]: pgmap v9311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:29 smithi136 ceph-mon[125702]: pgmap v9311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:31 smithi057 ceph-mon[92072]: pgmap v9312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:31 smithi122 ceph-mon[125440]: pgmap v9312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:31 smithi136 ceph-mon[125702]: pgmap v9312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:32.307+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:48:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:32.307+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:48:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:32.308+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:48:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:32.308+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:48:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:32.308+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:48:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:33 smithi122 ceph-mon[125440]: pgmap v9313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:33 smithi136 ceph-mon[125702]: pgmap v9313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:33 smithi057 ceph-mon[92072]: pgmap v9313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:35 smithi122 ceph-mon[125440]: pgmap v9314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:35 smithi136 ceph-mon[125702]: pgmap v9314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:35 smithi057 ceph-mon[92072]: pgmap v9314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:37 smithi122 ceph-mon[125440]: pgmap v9315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:37 smithi136 ceph-mon[125702]: pgmap v9315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:37 smithi057 ceph-mon[92072]: pgmap v9315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:39 smithi122 ceph-mon[125440]: pgmap v9316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:39 smithi136 ceph-mon[125702]: pgmap v9316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:39 smithi057 ceph-mon[92072]: pgmap v9316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:41 smithi136 ceph-mon[125702]: pgmap v9317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:41 smithi057 ceph-mon[92072]: pgmap v9317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:41 smithi122 ceph-mon[125440]: pgmap v9317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:43 smithi136 ceph-mon[125702]: pgmap v9318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:43 smithi057 ceph-mon[92072]: pgmap v9318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:43 smithi122 ceph-mon[125440]: pgmap v9318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:45 smithi136 ceph-mon[125702]: pgmap v9319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:45 smithi057 ceph-mon[92072]: pgmap v9319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:45 smithi122 ceph-mon[125440]: pgmap v9319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:47.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:48:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:47.320+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:48:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:47.320+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:48:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:47.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:48:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:48:47.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:48:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:47 smithi136 ceph-mon[125702]: pgmap v9320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:47 smithi057 ceph-mon[92072]: pgmap v9320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:47 smithi122 ceph-mon[125440]: pgmap v9320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:49 smithi136 ceph-mon[125702]: pgmap v9321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:49 smithi057 ceph-mon[92072]: pgmap v9321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:49 smithi122 ceph-mon[125440]: pgmap v9321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:48:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:48:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:48:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:51 smithi136 ceph-mon[125702]: pgmap v9322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:48:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:48:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:51 smithi057 ceph-mon[92072]: pgmap v9322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:48:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:48:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:51 smithi122 ceph-mon[125440]: pgmap v9322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:48:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:48:51.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:48:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:53 smithi136 ceph-mon[125702]: pgmap v9323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:53 smithi057 ceph-mon[92072]: pgmap v9323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:53 smithi122 ceph-mon[125440]: pgmap v9323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:55 smithi136 ceph-mon[125702]: pgmap v9324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:55 smithi057 ceph-mon[92072]: pgmap v9324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:55 smithi122 ceph-mon[125440]: pgmap v9324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:57 smithi136 ceph-mon[125702]: pgmap v9325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:57 smithi057 ceph-mon[92072]: pgmap v9325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:57 smithi122 ceph-mon[125440]: pgmap v9325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:48:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:48:59 smithi136 ceph-mon[125702]: pgmap v9326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:48:59 smithi057 ceph-mon[92072]: pgmap v9326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:48:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:48:59 smithi122 ceph-mon[125440]: pgmap v9326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:01 smithi136 ceph-mon[125702]: pgmap v9327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:01 smithi057 ceph-mon[92072]: pgmap v9327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:01 smithi122 ceph-mon[125440]: pgmap v9327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:02.329+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:49:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:02.329+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:49:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:02.329+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:49:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:02.329+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:49:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:02.329+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:49:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:03 smithi136 ceph-mon[125702]: pgmap v9328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:03 smithi057 ceph-mon[92072]: pgmap v9328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:03 smithi122 ceph-mon[125440]: pgmap v9328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:05 smithi136 ceph-mon[125702]: pgmap v9329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:49:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:05 smithi057 ceph-mon[92072]: pgmap v9329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:49:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:05 smithi122 ceph-mon[125440]: pgmap v9329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:49:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:07 smithi136 ceph-mon[125702]: pgmap v9330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:49:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:07 smithi057 ceph-mon[92072]: pgmap v9330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:49:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:07 smithi122 ceph-mon[125440]: pgmap v9330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:49:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:09 smithi136 ceph-mon[125702]: pgmap v9331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:49:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:09 smithi057 ceph-mon[92072]: pgmap v9331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:49:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:09 smithi122 ceph-mon[125440]: pgmap v9331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:49:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:11 smithi136 ceph-mon[125702]: pgmap v9332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:49:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:11 smithi057 ceph-mon[92072]: pgmap v9332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:49:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:11 smithi122 ceph-mon[125440]: pgmap v9332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:49:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:12 smithi136 ceph-mon[125702]: osdmap e655: 12 total, 12 up, 12 in 2023-03-02T15:49:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:12 smithi057 ceph-mon[92072]: osdmap e655: 12 total, 12 up, 12 in 2023-03-02T15:49:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:12 smithi122 ceph-mon[125440]: osdmap e655: 12 total, 12 up, 12 in 2023-03-02T15:49:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:13 smithi136 ceph-mon[125702]: pgmap v9334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:49:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:13 smithi057 ceph-mon[92072]: pgmap v9334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:49:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:13 smithi122 ceph-mon[125440]: pgmap v9334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:49:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:15 smithi136 ceph-mon[125702]: pgmap v9335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:15 smithi057 ceph-mon[92072]: pgmap v9335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:15 smithi122 ceph-mon[125440]: pgmap v9335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:17.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:49:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:17.340+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:49:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:17.340+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:49:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:17.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:49:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:17.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:49:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:17 smithi057 ceph-mon[92072]: pgmap v9336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:17 smithi122 ceph-mon[125440]: pgmap v9336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:17 smithi136 ceph-mon[125702]: pgmap v9336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:19 smithi057 ceph-mon[92072]: pgmap v9337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:49:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:19 smithi057 ceph-mon[92072]: osdmap e656: 12 total, 12 up, 12 in 2023-03-02T15:49:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:19 smithi122 ceph-mon[125440]: pgmap v9337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:49:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:19 smithi122 ceph-mon[125440]: osdmap e656: 12 total, 12 up, 12 in 2023-03-02T15:49:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:19 smithi136 ceph-mon[125702]: pgmap v9337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:49:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:19 smithi136 ceph-mon[125702]: osdmap e656: 12 total, 12 up, 12 in 2023-03-02T15:49:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:21 smithi057 ceph-mon[92072]: pgmap v9339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 368 B/s wr, 12 op/s 2023-03-02T15:49:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:21 smithi122 ceph-mon[125440]: pgmap v9339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 368 B/s wr, 12 op/s 2023-03-02T15:49:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:21 smithi136 ceph-mon[125702]: pgmap v9339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 368 B/s wr, 12 op/s 2023-03-02T15:49:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:23 smithi057 ceph-mon[92072]: pgmap v9340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:49:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:23 smithi122 ceph-mon[125440]: pgmap v9340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:49:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:23 smithi136 ceph-mon[125702]: pgmap v9340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:49:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:25 smithi057 ceph-mon[92072]: pgmap v9341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:25 smithi122 ceph-mon[125440]: pgmap v9341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:25 smithi136 ceph-mon[125702]: pgmap v9341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:27 smithi057 ceph-mon[92072]: pgmap v9342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:27 smithi122 ceph-mon[125440]: pgmap v9342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:27 smithi136 ceph-mon[125702]: pgmap v9342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:49:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:29 smithi057 ceph-mon[92072]: pgmap v9343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:49:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:29 smithi122 ceph-mon[125440]: pgmap v9343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:49:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:29 smithi136 ceph-mon[125702]: pgmap v9343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:49:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:31 smithi057 ceph-mon[92072]: pgmap v9344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:49:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:31 smithi122 ceph-mon[125440]: pgmap v9344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:49:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:31 smithi136 ceph-mon[125702]: pgmap v9344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:49:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:32.342+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:49:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:32.343+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:49:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:32.343+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:49:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:32.343+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:49:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:32.343+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:49:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:33 smithi057 ceph-mon[92072]: pgmap v9345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:33 smithi122 ceph-mon[125440]: pgmap v9345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:33 smithi136 ceph-mon[125702]: pgmap v9345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:35 smithi057 ceph-mon[92072]: pgmap v9346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:35 smithi122 ceph-mon[125440]: pgmap v9346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:35 smithi136 ceph-mon[125702]: pgmap v9346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:37 smithi057 ceph-mon[92072]: pgmap v9347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:49:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:37 smithi122 ceph-mon[125440]: pgmap v9347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:49:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:37 smithi136 ceph-mon[125702]: pgmap v9347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:49:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:39 smithi057 ceph-mon[92072]: pgmap v9348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:39 smithi122 ceph-mon[125440]: pgmap v9348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:39 smithi136 ceph-mon[125702]: pgmap v9348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:41 smithi057 ceph-mon[92072]: pgmap v9349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:49:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:41 smithi122 ceph-mon[125440]: pgmap v9349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:49:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:41 smithi136 ceph-mon[125702]: pgmap v9349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:49:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:43 smithi057 ceph-mon[92072]: pgmap v9350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:49:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:43 smithi122 ceph-mon[125440]: pgmap v9350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:49:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:43 smithi136 ceph-mon[125702]: pgmap v9350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T15:49:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:45 smithi122 ceph-mon[125440]: pgmap v9351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:45 smithi136 ceph-mon[125702]: pgmap v9351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:45 smithi057 ceph-mon[92072]: pgmap v9351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:47.352+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:49:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:47.352+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:49:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:47.352+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:49:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:47.352+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:49:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:49:47.352+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:49:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:47 smithi122 ceph-mon[125440]: pgmap v9352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:47 smithi136 ceph-mon[125702]: pgmap v9352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:47 smithi057 ceph-mon[92072]: pgmap v9352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:49 smithi122 ceph-mon[125440]: pgmap v9353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:49 smithi136 ceph-mon[125702]: pgmap v9353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:49 smithi057 ceph-mon[92072]: pgmap v9353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:51 smithi122 ceph-mon[125440]: pgmap v9354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:49:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:51 smithi136 ceph-mon[125702]: pgmap v9354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:49:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:51 smithi057 ceph-mon[92072]: pgmap v9354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:49:52.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:49:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:49:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:49:52.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:49:52.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:49:52.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:49:52.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:49:52.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:49:52.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:49:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:53 smithi136 ceph-mon[125702]: pgmap v9355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:53 smithi057 ceph-mon[92072]: pgmap v9355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:53 smithi122 ceph-mon[125440]: pgmap v9355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:54 smithi057 ceph-mon[92072]: pgmap v9356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:54 smithi122 ceph-mon[125440]: pgmap v9356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:55.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:54 smithi136 ceph-mon[125702]: pgmap v9356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:56 smithi057 ceph-mon[92072]: pgmap v9357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:56 smithi122 ceph-mon[125440]: pgmap v9357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:56 smithi136 ceph-mon[125702]: pgmap v9357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:49:59.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:49:58 smithi057 ceph-mon[92072]: pgmap v9358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:49:58 smithi122 ceph-mon[125440]: pgmap v9358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:49:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:49:58 smithi136 ceph-mon[125702]: pgmap v9358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:00 smithi057 ceph-mon[92072]: pgmap v9359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T15:50:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:00 smithi122 ceph-mon[125440]: pgmap v9359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T15:50:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:00 smithi136 ceph-mon[125702]: pgmap v9359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T15:50:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:02.368+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:50:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:02.368+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:50:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:02.368+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:50:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:02.368+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:50:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:02.368+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:50:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:02 smithi057 ceph-mon[92072]: pgmap v9360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:02 smithi122 ceph-mon[125440]: pgmap v9360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:02 smithi136 ceph-mon[125702]: pgmap v9360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:04 smithi057 ceph-mon[92072]: pgmap v9361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:50:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:04 smithi122 ceph-mon[125440]: pgmap v9361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:50:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:04 smithi136 ceph-mon[125702]: pgmap v9361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:50:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:06 smithi057 ceph-mon[92072]: pgmap v9362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:50:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:06 smithi122 ceph-mon[125440]: pgmap v9362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:50:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:06 smithi136 ceph-mon[125702]: pgmap v9362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:50:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:08 smithi057 ceph-mon[92072]: pgmap v9363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:50:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:08 smithi122 ceph-mon[125440]: pgmap v9363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:50:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:08 smithi136 ceph-mon[125702]: pgmap v9363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:50:10.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:10.880+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:50:10.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:10.880+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:50:10.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:10.881+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 138 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:50:10.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:10.881+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 137 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:50:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:10 smithi057 ceph-mon[92072]: pgmap v9364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:50:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:10 smithi122 ceph-mon[125440]: pgmap v9364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:50:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:10 smithi136 ceph-mon[125702]: pgmap v9364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:50:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:11 smithi122 ceph-mon[125440]: osdmap e657: 12 total, 12 up, 12 in 2023-03-02T15:50:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:11 smithi136 ceph-mon[125702]: osdmap e657: 12 total, 12 up, 12 in 2023-03-02T15:50:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:11 smithi057 ceph-mon[92072]: osdmap e657: 12 total, 12 up, 12 in 2023-03-02T15:50:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:12 smithi122 ceph-mon[125440]: pgmap v9366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:50:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:12 smithi136 ceph-mon[125702]: pgmap v9366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:50:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:12 smithi057 ceph-mon[92072]: pgmap v9366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:50:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:14 smithi122 ceph-mon[125440]: pgmap v9367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:14 smithi136 ceph-mon[125702]: pgmap v9367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:14 smithi057 ceph-mon[92072]: pgmap v9367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:16 smithi122 ceph-mon[125440]: pgmap v9368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:16 smithi136 ceph-mon[125702]: pgmap v9368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:17.383+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:50:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:17.383+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:50:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:17.383+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:50:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:17.383+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:50:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:17.383+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:50:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:16 smithi057 ceph-mon[92072]: pgmap v9368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:18 smithi136 ceph-mon[125702]: pgmap v9369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:18 smithi136 ceph-mon[125702]: osdmap e658: 12 total, 12 up, 12 in 2023-03-02T15:50:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:18 smithi057 ceph-mon[92072]: pgmap v9369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:18 smithi057 ceph-mon[92072]: osdmap e658: 12 total, 12 up, 12 in 2023-03-02T15:50:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:18 smithi122 ceph-mon[125440]: pgmap v9369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:18 smithi122 ceph-mon[125440]: osdmap e658: 12 total, 12 up, 12 in 2023-03-02T15:50:21.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:20 smithi136 ceph-mon[125702]: pgmap v9371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T15:50:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:20 smithi057 ceph-mon[92072]: pgmap v9371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T15:50:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:20 smithi122 ceph-mon[125440]: pgmap v9371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T15:50:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:22 smithi136 ceph-mon[125702]: pgmap v9372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:22 smithi057 ceph-mon[92072]: pgmap v9372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:22 smithi122 ceph-mon[125440]: pgmap v9372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:50:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:24 smithi136 ceph-mon[125702]: pgmap v9373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:50:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:24 smithi057 ceph-mon[92072]: pgmap v9373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:50:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:24 smithi122 ceph-mon[125440]: pgmap v9373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:50:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:26 smithi136 ceph-mon[125702]: pgmap v9374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:50:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:26 smithi057 ceph-mon[92072]: pgmap v9374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:50:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:26 smithi122 ceph-mon[125440]: pgmap v9374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:50:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:28 smithi136 ceph-mon[125702]: pgmap v9375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:50:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:28 smithi057 ceph-mon[92072]: pgmap v9375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:50:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:28 smithi122 ceph-mon[125440]: pgmap v9375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:50:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:30 smithi136 ceph-mon[125702]: pgmap v9376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:50:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:30 smithi057 ceph-mon[92072]: pgmap v9376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:50:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:30 smithi122 ceph-mon[125440]: pgmap v9376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:50:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:32.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:50:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:32.399+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:50:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:32.399+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:50:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:32.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:50:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:32.400+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:50:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:32 smithi136 ceph-mon[125702]: pgmap v9377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:32 smithi057 ceph-mon[92072]: pgmap v9377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:32 smithi122 ceph-mon[125440]: pgmap v9377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:34 smithi136 ceph-mon[125702]: pgmap v9378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:34 smithi057 ceph-mon[92072]: pgmap v9378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:34 smithi122 ceph-mon[125440]: pgmap v9378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:36 smithi136 ceph-mon[125702]: pgmap v9379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:36 smithi057 ceph-mon[92072]: pgmap v9379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:36 smithi122 ceph-mon[125440]: pgmap v9379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:38 smithi136 ceph-mon[125702]: pgmap v9380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:38 smithi057 ceph-mon[92072]: pgmap v9380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:38 smithi122 ceph-mon[125440]: pgmap v9380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:41 smithi136 ceph-mon[125702]: pgmap v9381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:41 smithi057 ceph-mon[92072]: pgmap v9381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:41.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:41 smithi122 ceph-mon[125440]: pgmap v9381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:43 smithi136 ceph-mon[125702]: pgmap v9382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:43 smithi057 ceph-mon[92072]: pgmap v9382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:43 smithi122 ceph-mon[125440]: pgmap v9382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:45 smithi136 ceph-mon[125702]: pgmap v9383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:45 smithi057 ceph-mon[92072]: pgmap v9383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:45 smithi122 ceph-mon[125440]: pgmap v9383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:47 smithi136 ceph-mon[125702]: pgmap v9384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:47.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:47.405+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:50:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:47.405+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:50:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:47.405+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:50:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:47.405+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:50:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:50:47.405+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:50:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:47 smithi057 ceph-mon[92072]: pgmap v9384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:47 smithi122 ceph-mon[125440]: pgmap v9384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:49 smithi136 ceph-mon[125702]: pgmap v9385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:49 smithi057 ceph-mon[92072]: pgmap v9385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:49 smithi122 ceph-mon[125440]: pgmap v9385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:51 smithi136 ceph-mon[125702]: pgmap v9386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:51.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:51 smithi057 ceph-mon[92072]: pgmap v9386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:51 smithi122 ceph-mon[125440]: pgmap v9386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:50:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:50:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:50:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:53 smithi136 ceph-mon[125702]: pgmap v9387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:50:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:50:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:50:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:53 smithi057 ceph-mon[92072]: pgmap v9387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:50:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:50:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:50:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:53 smithi122 ceph-mon[125440]: pgmap v9387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:50:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:50:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:50:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:55 smithi136 ceph-mon[125702]: pgmap v9388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:55 smithi057 ceph-mon[92072]: pgmap v9388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:55 smithi122 ceph-mon[125440]: pgmap v9388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:57 smithi136 ceph-mon[125702]: pgmap v9389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:57 smithi057 ceph-mon[92072]: pgmap v9389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:57 smithi122 ceph-mon[125440]: pgmap v9389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:50:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:50:59 smithi136 ceph-mon[125702]: pgmap v9390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:50:59 smithi057 ceph-mon[92072]: pgmap v9390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:50:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:50:59 smithi122 ceph-mon[125440]: pgmap v9390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:51:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:01 smithi136 ceph-mon[125702]: pgmap v9391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:01 smithi057 ceph-mon[92072]: pgmap v9391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:01 smithi122 ceph-mon[125440]: pgmap v9391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:02.421+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:51:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:02.421+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:51:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:02.421+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:51:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:02.421+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:51:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:02.421+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:51:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:03 smithi136 ceph-mon[125702]: pgmap v9392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:03 smithi057 ceph-mon[92072]: pgmap v9392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:03 smithi122 ceph-mon[125440]: pgmap v9392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:05 smithi136 ceph-mon[125702]: pgmap v9393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:51:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:05 smithi057 ceph-mon[92072]: pgmap v9393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:51:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:05 smithi122 ceph-mon[125440]: pgmap v9393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T15:51:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:07 smithi057 ceph-mon[92072]: pgmap v9394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:51:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:07 smithi122 ceph-mon[125440]: pgmap v9394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:51:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:07 smithi136 ceph-mon[125702]: pgmap v9394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:51:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:09 smithi057 ceph-mon[92072]: pgmap v9395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:51:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:09 smithi122 ceph-mon[125440]: pgmap v9395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:51:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:09 smithi136 ceph-mon[125702]: pgmap v9395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:51:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:11 smithi057 ceph-mon[92072]: pgmap v9396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:51:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:11 smithi122 ceph-mon[125440]: pgmap v9396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:51:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:11 smithi136 ceph-mon[125702]: pgmap v9396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:51:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:12 smithi057 ceph-mon[92072]: osdmap e659: 12 total, 12 up, 12 in 2023-03-02T15:51:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:12 smithi122 ceph-mon[125440]: osdmap e659: 12 total, 12 up, 12 in 2023-03-02T15:51:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:12 smithi136 ceph-mon[125702]: osdmap e659: 12 total, 12 up, 12 in 2023-03-02T15:51:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:13 smithi057 ceph-mon[92072]: pgmap v9398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:51:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:13 smithi122 ceph-mon[125440]: pgmap v9398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:51:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:13 smithi136 ceph-mon[125702]: pgmap v9398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:51:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:15 smithi057 ceph-mon[92072]: pgmap v9399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:51:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:15 smithi122 ceph-mon[125440]: pgmap v9399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:51:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:15 smithi136 ceph-mon[125702]: pgmap v9399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:51:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:17 smithi057 ceph-mon[92072]: pgmap v9400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:51:17.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:17.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:51:17.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:17.431+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:51:17.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:17.431+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:51:17.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:17.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:51:17.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:17.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:51:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:17 smithi122 ceph-mon[125440]: pgmap v9400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:51:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:17 smithi136 ceph-mon[125702]: pgmap v9400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:51:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:19 smithi057 ceph-mon[92072]: pgmap v9401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:51:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:19 smithi057 ceph-mon[92072]: osdmap e660: 12 total, 12 up, 12 in 2023-03-02T15:51:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:19 smithi122 ceph-mon[125440]: pgmap v9401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:51:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:19 smithi122 ceph-mon[125440]: osdmap e660: 12 total, 12 up, 12 in 2023-03-02T15:51:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:19 smithi136 ceph-mon[125702]: pgmap v9401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:51:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:19 smithi136 ceph-mon[125702]: osdmap e660: 12 total, 12 up, 12 in 2023-03-02T15:51:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:21 smithi057 ceph-mon[92072]: pgmap v9403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:51:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:21 smithi122 ceph-mon[125440]: pgmap v9403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:51:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:21 smithi136 ceph-mon[125702]: pgmap v9403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T15:51:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:23 smithi057 ceph-mon[92072]: pgmap v9404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 204 B/s wr, 12 op/s 2023-03-02T15:51:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:23 smithi122 ceph-mon[125440]: pgmap v9404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 204 B/s wr, 12 op/s 2023-03-02T15:51:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:23 smithi136 ceph-mon[125702]: pgmap v9404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 204 B/s wr, 12 op/s 2023-03-02T15:51:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:25 smithi057 ceph-mon[92072]: pgmap v9405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:51:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:25 smithi122 ceph-mon[125440]: pgmap v9405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:51:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:25 smithi136 ceph-mon[125702]: pgmap v9405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:51:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:27 smithi057 ceph-mon[92072]: pgmap v9406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:51:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:27 smithi122 ceph-mon[125440]: pgmap v9406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:51:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:27 smithi136 ceph-mon[125702]: pgmap v9406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:51:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:29 smithi057 ceph-mon[92072]: pgmap v9407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:51:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:29 smithi122 ceph-mon[125440]: pgmap v9407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:51:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:29 smithi136 ceph-mon[125702]: pgmap v9407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:51:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:31 smithi057 ceph-mon[92072]: pgmap v9408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:51:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:31 smithi122 ceph-mon[125440]: pgmap v9408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:51:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:31 smithi136 ceph-mon[125702]: pgmap v9408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:51:32.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:32.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:51:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:32.448+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:51:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:32.448+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:51:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:32.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:51:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:32.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:51:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:33 smithi057 ceph-mon[92072]: pgmap v9409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T15:51:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:33 smithi122 ceph-mon[125440]: pgmap v9409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T15:51:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:33 smithi136 ceph-mon[125702]: pgmap v9409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T15:51:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:35 smithi122 ceph-mon[125440]: pgmap v9410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T15:51:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:35 smithi136 ceph-mon[125702]: pgmap v9410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T15:51:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:35 smithi057 ceph-mon[92072]: pgmap v9410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T15:51:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:37 smithi122 ceph-mon[125440]: pgmap v9411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:37 smithi136 ceph-mon[125702]: pgmap v9411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:37 smithi057 ceph-mon[92072]: pgmap v9411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:39 smithi136 ceph-mon[125702]: pgmap v9412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:51:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:39 smithi057 ceph-mon[92072]: pgmap v9412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:51:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:39 smithi122 ceph-mon[125440]: pgmap v9412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:51:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:41 smithi136 ceph-mon[125702]: pgmap v9413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:41 smithi057 ceph-mon[92072]: pgmap v9413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:41 smithi122 ceph-mon[125440]: pgmap v9413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:43 smithi136 ceph-mon[125702]: pgmap v9414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:51:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:43 smithi057 ceph-mon[92072]: pgmap v9414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:51:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:43 smithi122 ceph-mon[125440]: pgmap v9414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:51:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:45 smithi136 ceph-mon[125702]: pgmap v9415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:51:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:45 smithi057 ceph-mon[92072]: pgmap v9415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:51:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:45 smithi122 ceph-mon[125440]: pgmap v9415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:51:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:47.454+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:51:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:47.455+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:51:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:47.455+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:51:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:47.455+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:51:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:51:47.455+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:51:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:47 smithi136 ceph-mon[125702]: pgmap v9416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:47 smithi057 ceph-mon[92072]: pgmap v9416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:47 smithi122 ceph-mon[125440]: pgmap v9416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:49 smithi136 ceph-mon[125702]: pgmap v9417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:51:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:49 smithi057 ceph-mon[92072]: pgmap v9417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:51:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:49 smithi122 ceph-mon[125440]: pgmap v9417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:51:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:51 smithi136 ceph-mon[125702]: pgmap v9418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:51 smithi057 ceph-mon[92072]: pgmap v9418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:51 smithi122 ceph-mon[125440]: pgmap v9418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:53 smithi136 ceph-mon[125702]: pgmap v9419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:51:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:51:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:53 smithi057 ceph-mon[92072]: pgmap v9419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:51:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:51:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:53 smithi122 ceph-mon[125440]: pgmap v9419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:51:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:51:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:51:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:51:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:51:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:51:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:51:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:51:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:51:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:51:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:51:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:55 smithi136 ceph-mon[125702]: pgmap v9420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:51:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:55 smithi057 ceph-mon[92072]: pgmap v9420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:51:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:55 smithi122 ceph-mon[125440]: pgmap v9420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:51:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:57 smithi136 ceph-mon[125702]: pgmap v9421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:57 smithi057 ceph-mon[92072]: pgmap v9421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:57 smithi122 ceph-mon[125440]: pgmap v9421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:51:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:51:59 smithi136 ceph-mon[125702]: pgmap v9422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:51:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:51:59 smithi057 ceph-mon[92072]: pgmap v9422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:51:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:51:59 smithi122 ceph-mon[125440]: pgmap v9422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:52:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:01 smithi136 ceph-mon[125702]: pgmap v9423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:01 smithi057 ceph-mon[92072]: pgmap v9423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:01 smithi122 ceph-mon[125440]: pgmap v9423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:02.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:52:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:02.471+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:52:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:02.471+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:52:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:02.471+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:52:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:02.471+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:52:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:03 smithi136 ceph-mon[125702]: pgmap v9424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:52:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:03 smithi057 ceph-mon[92072]: pgmap v9424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:52:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:03 smithi122 ceph-mon[125440]: pgmap v9424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:52:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:05 smithi136 ceph-mon[125702]: pgmap v9425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:52:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:05 smithi057 ceph-mon[92072]: pgmap v9425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:52:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:05 smithi122 ceph-mon[125440]: pgmap v9425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:52:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:07 smithi136 ceph-mon[125702]: pgmap v9426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:52:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:07 smithi057 ceph-mon[92072]: pgmap v9426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:52:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:07 smithi122 ceph-mon[125440]: pgmap v9426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:52:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:09 smithi136 ceph-mon[125702]: pgmap v9427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:52:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:09 smithi057 ceph-mon[92072]: pgmap v9427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:52:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:09 smithi122 ceph-mon[125440]: pgmap v9427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:52:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:11 smithi136 ceph-mon[125702]: pgmap v9428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:52:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:11 smithi057 ceph-mon[92072]: pgmap v9428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:52:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:11 smithi122 ceph-mon[125440]: pgmap v9428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:52:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:12 smithi136 ceph-mon[125702]: osdmap e661: 12 total, 12 up, 12 in 2023-03-02T15:52:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:12 smithi057 ceph-mon[92072]: osdmap e661: 12 total, 12 up, 12 in 2023-03-02T15:52:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:12 smithi122 ceph-mon[125440]: osdmap e661: 12 total, 12 up, 12 in 2023-03-02T15:52:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:13 smithi136 ceph-mon[125702]: pgmap v9430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-02T15:52:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:13 smithi057 ceph-mon[92072]: pgmap v9430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-02T15:52:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:13 smithi122 ceph-mon[125440]: pgmap v9430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-02T15:52:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:15 smithi136 ceph-mon[125702]: pgmap v9431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:15 smithi057 ceph-mon[92072]: pgmap v9431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:15 smithi122 ceph-mon[125440]: pgmap v9431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:17.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:17.479+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:52:17.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:17.479+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:52:17.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:17.479+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:52:17.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:17.479+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:52:17.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:17.479+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:52:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:17 smithi136 ceph-mon[125702]: pgmap v9432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:17 smithi057 ceph-mon[92072]: pgmap v9432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:17 smithi122 ceph-mon[125440]: pgmap v9432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:19 smithi136 ceph-mon[125702]: pgmap v9433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:19.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:19 smithi136 ceph-mon[125702]: osdmap e662: 12 total, 12 up, 12 in 2023-03-02T15:52:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:19 smithi057 ceph-mon[92072]: pgmap v9433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:19 smithi057 ceph-mon[92072]: osdmap e662: 12 total, 12 up, 12 in 2023-03-02T15:52:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:19 smithi122 ceph-mon[125440]: pgmap v9433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:19 smithi122 ceph-mon[125440]: osdmap e662: 12 total, 12 up, 12 in 2023-03-02T15:52:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:21 smithi136 ceph-mon[125702]: pgmap v9435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T15:52:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:21 smithi057 ceph-mon[92072]: pgmap v9435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T15:52:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:21 smithi122 ceph-mon[125440]: pgmap v9435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 243 B/s wr, 12 op/s 2023-03-02T15:52:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:23 smithi136 ceph-mon[125702]: pgmap v9436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:23 smithi057 ceph-mon[92072]: pgmap v9436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:23 smithi122 ceph-mon[125440]: pgmap v9436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:52:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:25 smithi136 ceph-mon[125702]: pgmap v9437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:52:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:25 smithi057 ceph-mon[92072]: pgmap v9437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:52:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:25 smithi122 ceph-mon[125440]: pgmap v9437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:52:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:27 smithi136 ceph-mon[125702]: pgmap v9438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:52:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:27 smithi057 ceph-mon[92072]: pgmap v9438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:52:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:27 smithi122 ceph-mon[125440]: pgmap v9438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:52:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:29 smithi136 ceph-mon[125702]: pgmap v9439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:52:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:29 smithi057 ceph-mon[92072]: pgmap v9439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:52:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:29 smithi122 ceph-mon[125440]: pgmap v9439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:52:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:31 smithi057 ceph-mon[92072]: pgmap v9440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:31 smithi122 ceph-mon[125440]: pgmap v9440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:31 smithi136 ceph-mon[125702]: pgmap v9440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:32.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:52:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:32.482+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:52:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:32.482+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:52:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:32.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:52:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:32.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:52:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:33 smithi057 ceph-mon[92072]: pgmap v9441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:52:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:33 smithi122 ceph-mon[125440]: pgmap v9441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:52:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:33 smithi136 ceph-mon[125702]: pgmap v9441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:52:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:35 smithi057 ceph-mon[92072]: pgmap v9442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:35 smithi122 ceph-mon[125440]: pgmap v9442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:35 smithi136 ceph-mon[125702]: pgmap v9442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:37 smithi057 ceph-mon[92072]: pgmap v9443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:37 smithi122 ceph-mon[125440]: pgmap v9443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:37 smithi136 ceph-mon[125702]: pgmap v9443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:39 smithi057 ceph-mon[92072]: pgmap v9444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:52:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:39 smithi122 ceph-mon[125440]: pgmap v9444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:52:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:39 smithi136 ceph-mon[125702]: pgmap v9444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:52:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:41 smithi057 ceph-mon[92072]: pgmap v9445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:41 smithi122 ceph-mon[125440]: pgmap v9445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:41 smithi136 ceph-mon[125702]: pgmap v9445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:43 smithi057 ceph-mon[92072]: pgmap v9446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:52:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:43 smithi122 ceph-mon[125440]: pgmap v9446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:52:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:43 smithi136 ceph-mon[125702]: pgmap v9446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:52:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:45 smithi057 ceph-mon[92072]: pgmap v9447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:45 smithi122 ceph-mon[125440]: pgmap v9447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:45 smithi136 ceph-mon[125702]: pgmap v9447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:47.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:47.497+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:52:47.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:47.497+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:52:47.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:47.497+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:52:47.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:47.497+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:52:47.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:52:47.497+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:52:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:47 smithi057 ceph-mon[92072]: pgmap v9448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:47 smithi122 ceph-mon[125440]: pgmap v9448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:47 smithi136 ceph-mon[125702]: pgmap v9448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:49 smithi057 ceph-mon[92072]: pgmap v9449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:52:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:49 smithi122 ceph-mon[125440]: pgmap v9449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:52:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:49 smithi136 ceph-mon[125702]: pgmap v9449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:52:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:51 smithi057 ceph-mon[92072]: pgmap v9450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:51 smithi122 ceph-mon[125440]: pgmap v9450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:51 smithi136 ceph-mon[125702]: pgmap v9450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:53 smithi057 ceph-mon[92072]: pgmap v9451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:52:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:53 smithi122 ceph-mon[125440]: pgmap v9451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:52:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:53 smithi136 ceph-mon[125702]: pgmap v9451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:52:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:52:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:52:54.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:52:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:55 smithi057 ceph-mon[92072]: pgmap v9452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:52:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:52:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:52:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:55 smithi122 ceph-mon[125440]: pgmap v9452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:55.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:52:55.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:52:55.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:52:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:55 smithi136 ceph-mon[125702]: pgmap v9452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:52:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:52:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:52:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:52:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:57 smithi057 ceph-mon[92072]: pgmap v9453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:57 smithi122 ceph-mon[125440]: pgmap v9453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:57 smithi136 ceph-mon[125702]: pgmap v9453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:52:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:52:59 smithi122 ceph-mon[125440]: pgmap v9454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:52:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:52:59 smithi136 ceph-mon[125702]: pgmap v9454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:52:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:52:59 smithi057 ceph-mon[92072]: pgmap v9454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:53:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:01 smithi122 ceph-mon[125440]: pgmap v9455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:01 smithi136 ceph-mon[125702]: pgmap v9455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:01 smithi057 ceph-mon[92072]: pgmap v9455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:02.501+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:53:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:02.502+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:53:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:02.502+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:53:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:02.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:53:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:02.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:53:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:03 smithi122 ceph-mon[125440]: pgmap v9456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:53:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:03 smithi136 ceph-mon[125702]: pgmap v9456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:53:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:03 smithi057 ceph-mon[92072]: pgmap v9456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:53:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:05 smithi122 ceph-mon[125440]: pgmap v9457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:53:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:05 smithi136 ceph-mon[125702]: pgmap v9457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:53:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:05 smithi057 ceph-mon[92072]: pgmap v9457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:53:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:07 smithi136 ceph-mon[125702]: pgmap v9458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:53:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:07 smithi057 ceph-mon[92072]: pgmap v9458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:53:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:07 smithi122 ceph-mon[125440]: pgmap v9458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:53:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:09 smithi136 ceph-mon[125702]: pgmap v9459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:53:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:09 smithi057 ceph-mon[92072]: pgmap v9459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:53:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:09 smithi122 ceph-mon[125440]: pgmap v9459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:53:10.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:10.908+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:53:10.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:10.908+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:53:10.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:10.908+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 139 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:53:10.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:10.908+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 138 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:53:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:11 smithi136 ceph-mon[125702]: pgmap v9460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:53:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:11 smithi057 ceph-mon[92072]: pgmap v9460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:53:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:11 smithi122 ceph-mon[125440]: pgmap v9460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:53:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:12 smithi136 ceph-mon[125702]: osdmap e663: 12 total, 12 up, 12 in 2023-03-02T15:53:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:12 smithi057 ceph-mon[92072]: osdmap e663: 12 total, 12 up, 12 in 2023-03-02T15:53:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:12 smithi122 ceph-mon[125440]: osdmap e663: 12 total, 12 up, 12 in 2023-03-02T15:53:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:13 smithi136 ceph-mon[125702]: pgmap v9462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-02T15:53:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:13 smithi057 ceph-mon[92072]: pgmap v9462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-02T15:53:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:13 smithi122 ceph-mon[125440]: pgmap v9462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-02T15:53:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:14 smithi122 ceph-mon[125440]: pgmap v9463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:14 smithi136 ceph-mon[125702]: pgmap v9463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:14 smithi057 ceph-mon[92072]: pgmap v9463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:16 smithi122 ceph-mon[125440]: pgmap v9464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:16 smithi136 ceph-mon[125702]: pgmap v9464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:16 smithi057 ceph-mon[92072]: pgmap v9464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:17.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:53:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:17.508+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:53:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:17.508+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:53:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:17.508+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:53:17.509 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:17.508+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:53:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:18 smithi136 ceph-mon[125702]: pgmap v9465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:18 smithi136 ceph-mon[125702]: osdmap e664: 12 total, 12 up, 12 in 2023-03-02T15:53:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:18 smithi057 ceph-mon[92072]: pgmap v9465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:18 smithi057 ceph-mon[92072]: osdmap e664: 12 total, 12 up, 12 in 2023-03-02T15:53:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:18 smithi122 ceph-mon[125440]: pgmap v9465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:18 smithi122 ceph-mon[125440]: osdmap e664: 12 total, 12 up, 12 in 2023-03-02T15:53:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:20 smithi136 ceph-mon[125702]: pgmap v9467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T15:53:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:20 smithi057 ceph-mon[92072]: pgmap v9467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T15:53:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:20 smithi122 ceph-mon[125440]: pgmap v9467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T15:53:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:22 smithi136 ceph-mon[125702]: pgmap v9468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:22 smithi057 ceph-mon[92072]: pgmap v9468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:22 smithi122 ceph-mon[125440]: pgmap v9468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:53:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:24 smithi136 ceph-mon[125702]: pgmap v9469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:53:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:24 smithi057 ceph-mon[92072]: pgmap v9469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:53:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:24 smithi122 ceph-mon[125440]: pgmap v9469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:53:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:26 smithi136 ceph-mon[125702]: pgmap v9470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:53:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:26 smithi057 ceph-mon[92072]: pgmap v9470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:53:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:26 smithi122 ceph-mon[125440]: pgmap v9470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:53:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:28 smithi136 ceph-mon[125702]: pgmap v9471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:53:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:28 smithi057 ceph-mon[92072]: pgmap v9471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:53:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:28 smithi122 ceph-mon[125440]: pgmap v9471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:53:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:30 smithi136 ceph-mon[125702]: pgmap v9472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:30 smithi057 ceph-mon[92072]: pgmap v9472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:30 smithi122 ceph-mon[125440]: pgmap v9472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:32.513+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:53:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:32.513+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:53:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:32.513+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:53:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:32.513+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:53:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:32.513+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:53:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:32 smithi136 ceph-mon[125702]: pgmap v9473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:53:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:32 smithi057 ceph-mon[92072]: pgmap v9473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:53:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:32 smithi122 ceph-mon[125440]: pgmap v9473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:53:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:34 smithi136 ceph-mon[125702]: pgmap v9474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:34 smithi057 ceph-mon[92072]: pgmap v9474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:34 smithi122 ceph-mon[125440]: pgmap v9474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:36 smithi136 ceph-mon[125702]: pgmap v9475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:36 smithi057 ceph-mon[92072]: pgmap v9475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:36 smithi122 ceph-mon[125440]: pgmap v9475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:38 smithi136 ceph-mon[125702]: pgmap v9476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:53:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:38 smithi057 ceph-mon[92072]: pgmap v9476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:53:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:38 smithi122 ceph-mon[125440]: pgmap v9476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:53:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:40 smithi136 ceph-mon[125702]: pgmap v9477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:40 smithi057 ceph-mon[92072]: pgmap v9477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:40 smithi122 ceph-mon[125440]: pgmap v9477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:43 smithi136 ceph-mon[125702]: pgmap v9478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:53:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:43 smithi057 ceph-mon[92072]: pgmap v9478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:53:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:43 smithi122 ceph-mon[125440]: pgmap v9478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:53:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:45 smithi136 ceph-mon[125702]: pgmap v9479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:45 smithi057 ceph-mon[92072]: pgmap v9479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:45 smithi122 ceph-mon[125440]: pgmap v9479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:47 smithi136 ceph-mon[125702]: pgmap v9480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:47 smithi057 ceph-mon[92072]: pgmap v9480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:47 smithi122 ceph-mon[125440]: pgmap v9480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:47.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:53:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:47.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:53:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:47.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:53:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:47.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:53:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:53:47.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:53:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:49 smithi136 ceph-mon[125702]: pgmap v9481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:53:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:49 smithi057 ceph-mon[92072]: pgmap v9481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:53:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:49 smithi122 ceph-mon[125440]: pgmap v9481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:53:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:51 smithi136 ceph-mon[125702]: pgmap v9482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:51 smithi057 ceph-mon[92072]: pgmap v9482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:51 smithi122 ceph-mon[125440]: pgmap v9482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:53 smithi136 ceph-mon[125702]: pgmap v9483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:53:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:53 smithi057 ceph-mon[92072]: pgmap v9483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:53:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:53 smithi122 ceph-mon[125440]: pgmap v9483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:53:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:55 smithi136 ceph-mon[125702]: pgmap v9484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:53:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:55 smithi057 ceph-mon[92072]: pgmap v9484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:53:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:55 smithi122 ceph-mon[125440]: pgmap v9484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:53:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:53:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:53:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:53:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:53:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:53:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:53:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:53:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:53:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:53:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:53:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:57 smithi057 ceph-mon[92072]: pgmap v9485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:57 smithi122 ceph-mon[125440]: pgmap v9485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:57 smithi136 ceph-mon[125702]: pgmap v9485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:53:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:53:59 smithi057 ceph-mon[92072]: pgmap v9486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:53:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:53:59 smithi122 ceph-mon[125440]: pgmap v9486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:53:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:53:59 smithi136 ceph-mon[125702]: pgmap v9486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:01 smithi057 ceph-mon[92072]: pgmap v9487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:01 smithi122 ceph-mon[125440]: pgmap v9487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:01 smithi136 ceph-mon[125702]: pgmap v9487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:02.542+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:54:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:02.543+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:54:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:02.543+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:54:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:02.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:54:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:02.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:54:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:03 smithi057 ceph-mon[92072]: pgmap v9488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:54:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:03 smithi122 ceph-mon[125440]: pgmap v9488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:54:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:03 smithi136 ceph-mon[125702]: pgmap v9488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:54:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:05 smithi057 ceph-mon[92072]: pgmap v9489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:54:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:05 smithi122 ceph-mon[125440]: pgmap v9489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:54:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:05 smithi136 ceph-mon[125702]: pgmap v9489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:54:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:07 smithi057 ceph-mon[92072]: pgmap v9490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:54:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:07 smithi057 ceph-mon[92072]: osdmap e665: 12 total, 12 up, 12 in 2023-03-02T15:54:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:07 smithi122 ceph-mon[125440]: pgmap v9490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:54:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:07 smithi122 ceph-mon[125440]: osdmap e665: 12 total, 12 up, 12 in 2023-03-02T15:54:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:07 smithi136 ceph-mon[125702]: pgmap v9490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:54:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:07 smithi136 ceph-mon[125702]: osdmap e665: 12 total, 12 up, 12 in 2023-03-02T15:54:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:09 smithi057 ceph-mon[92072]: pgmap v9492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:54:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:09 smithi122 ceph-mon[125440]: pgmap v9492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:54:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:09 smithi136 ceph-mon[125702]: pgmap v9492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:54:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:11 smithi057 ceph-mon[92072]: pgmap v9493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:54:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:11 smithi122 ceph-mon[125440]: pgmap v9493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:54:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:11 smithi136 ceph-mon[125702]: pgmap v9493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:54:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:13 smithi057 ceph-mon[92072]: pgmap v9494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-02T15:54:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:13 smithi122 ceph-mon[125440]: pgmap v9494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-02T15:54:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:13 smithi136 ceph-mon[125702]: pgmap v9494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-02T15:54:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:14 smithi136 ceph-mon[125702]: pgmap v9495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:54:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:14 smithi136 ceph-mon[125702]: osdmap e666: 12 total, 12 up, 12 in 2023-03-02T15:54:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:14 smithi057 ceph-mon[92072]: pgmap v9495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:54:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:14 smithi057 ceph-mon[92072]: osdmap e666: 12 total, 12 up, 12 in 2023-03-02T15:54:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:14 smithi122 ceph-mon[125440]: pgmap v9495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:54:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:14 smithi122 ceph-mon[125440]: osdmap e666: 12 total, 12 up, 12 in 2023-03-02T15:54:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:16 smithi136 ceph-mon[125702]: pgmap v9497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T15:54:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:16 smithi057 ceph-mon[92072]: pgmap v9497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T15:54:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:16 smithi122 ceph-mon[125440]: pgmap v9497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T15:54:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:17.558+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:54:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:17.559+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:54:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:17.559+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:54:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:17.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:54:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:17.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:54:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:18 smithi136 ceph-mon[125702]: pgmap v9498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:54:19.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:18 smithi057 ceph-mon[92072]: pgmap v9498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:54:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:18 smithi122 ceph-mon[125440]: pgmap v9498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:54:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:20 smithi136 ceph-mon[125702]: pgmap v9499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:54:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:20 smithi057 ceph-mon[92072]: pgmap v9499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:54:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:20 smithi122 ceph-mon[125440]: pgmap v9499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:54:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:22 smithi136 ceph-mon[125702]: pgmap v9500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:54:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:22 smithi057 ceph-mon[92072]: pgmap v9500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:54:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:22 smithi122 ceph-mon[125440]: pgmap v9500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:54:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:24 smithi136 ceph-mon[125702]: pgmap v9501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:54:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:24 smithi057 ceph-mon[92072]: pgmap v9501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:54:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:24 smithi122 ceph-mon[125440]: pgmap v9501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:54:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:26 smithi136 ceph-mon[125702]: pgmap v9502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:26 smithi057 ceph-mon[92072]: pgmap v9502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:26 smithi122 ceph-mon[125440]: pgmap v9502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:28 smithi136 ceph-mon[125702]: pgmap v9503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:28 smithi057 ceph-mon[92072]: pgmap v9503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:28 smithi122 ceph-mon[125440]: pgmap v9503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:30 smithi136 ceph-mon[125702]: pgmap v9504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:30 smithi057 ceph-mon[92072]: pgmap v9504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:30 smithi122 ceph-mon[125440]: pgmap v9504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:32.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:54:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:32.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:54:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:32.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:54:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:32.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:54:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:32.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:54:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:33 smithi136 ceph-mon[125702]: pgmap v9505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:54:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:33 smithi057 ceph-mon[92072]: pgmap v9505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:54:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:33 smithi122 ceph-mon[125440]: pgmap v9505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:54:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:35 smithi136 ceph-mon[125702]: pgmap v9506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:54:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:35 smithi057 ceph-mon[92072]: pgmap v9506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:54:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:35 smithi122 ceph-mon[125440]: pgmap v9506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:54:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:37 smithi136 ceph-mon[125702]: pgmap v9507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:37 smithi057 ceph-mon[92072]: pgmap v9507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:37 smithi122 ceph-mon[125440]: pgmap v9507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:39 smithi136 ceph-mon[125702]: pgmap v9508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:39 smithi057 ceph-mon[92072]: pgmap v9508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:39 smithi122 ceph-mon[125440]: pgmap v9508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:41 smithi136 ceph-mon[125702]: pgmap v9509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:41 smithi057 ceph-mon[92072]: pgmap v9509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:41 smithi122 ceph-mon[125440]: pgmap v9509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:43.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:43 smithi136 ceph-mon[125702]: pgmap v9510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:54:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:43 smithi057 ceph-mon[92072]: pgmap v9510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:54:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:43 smithi122 ceph-mon[125440]: pgmap v9510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:54:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:45 smithi136 ceph-mon[125702]: pgmap v9511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:54:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:45 smithi057 ceph-mon[92072]: pgmap v9511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:54:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:45 smithi122 ceph-mon[125440]: pgmap v9511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:54:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:47 smithi136 ceph-mon[125702]: pgmap v9512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:47 smithi057 ceph-mon[92072]: pgmap v9512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:47 smithi122 ceph-mon[125440]: pgmap v9512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:47.586+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:54:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:47.586+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:54:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:47.586+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:54:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:47.586+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:54:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:54:47.586+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:54:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:49 smithi136 ceph-mon[125702]: pgmap v9513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:49 smithi057 ceph-mon[92072]: pgmap v9513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:49 smithi122 ceph-mon[125440]: pgmap v9513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:51 smithi136 ceph-mon[125702]: pgmap v9514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:51 smithi057 ceph-mon[92072]: pgmap v9514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:51 smithi122 ceph-mon[125440]: pgmap v9514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:53 smithi136 ceph-mon[125702]: pgmap v9515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:54:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:53 smithi057 ceph-mon[92072]: pgmap v9515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:54:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:53 smithi122 ceph-mon[125440]: pgmap v9515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:54:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:55 smithi136 ceph-mon[125702]: pgmap v9516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:54:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:55 smithi057 ceph-mon[92072]: pgmap v9516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:54:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:55 smithi122 ceph-mon[125440]: pgmap v9516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:54:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:54:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:54:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:54:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:57 smithi136 ceph-mon[125702]: pgmap v9517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:54:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:54:57.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:54:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:57 smithi057 ceph-mon[92072]: pgmap v9517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:54:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:54:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:54:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:57 smithi122 ceph-mon[125440]: pgmap v9517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:54:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:54:57.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:54:57.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:54:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:54:59 smithi136 ceph-mon[125702]: pgmap v9518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:54:59 smithi057 ceph-mon[92072]: pgmap v9518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:54:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:54:59 smithi122 ceph-mon[125440]: pgmap v9518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:01 smithi136 ceph-mon[125702]: pgmap v9519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:01 smithi057 ceph-mon[92072]: pgmap v9519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:01 smithi122 ceph-mon[125440]: pgmap v9519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:02.600+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:55:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:02.601+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:55:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:02.601+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:55:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:02.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:55:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:02.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:55:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:03 smithi057 ceph-mon[92072]: pgmap v9520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:55:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:03 smithi122 ceph-mon[125440]: pgmap v9520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:55:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:03 smithi136 ceph-mon[125702]: pgmap v9520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:55:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:05 smithi057 ceph-mon[92072]: pgmap v9521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:55:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:05 smithi122 ceph-mon[125440]: pgmap v9521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:55:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:05 smithi136 ceph-mon[125702]: pgmap v9521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:55:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:07 smithi057 ceph-mon[92072]: pgmap v9522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:55:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:07 smithi057 ceph-mon[92072]: osdmap e667: 12 total, 12 up, 12 in 2023-03-02T15:55:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:07 smithi122 ceph-mon[125440]: pgmap v9522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:55:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:07 smithi122 ceph-mon[125440]: osdmap e667: 12 total, 12 up, 12 in 2023-03-02T15:55:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:07 smithi136 ceph-mon[125702]: pgmap v9522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:55:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:07 smithi136 ceph-mon[125702]: osdmap e667: 12 total, 12 up, 12 in 2023-03-02T15:55:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:09 smithi057 ceph-mon[92072]: pgmap v9524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:55:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:09 smithi057 ceph-mon[92072]: osdmap e668: 12 total, 12 up, 12 in 2023-03-02T15:55:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:09 smithi122 ceph-mon[125440]: pgmap v9524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:55:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:09 smithi122 ceph-mon[125440]: osdmap e668: 12 total, 12 up, 12 in 2023-03-02T15:55:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:09 smithi136 ceph-mon[125702]: pgmap v9524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:55:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:09 smithi136 ceph-mon[125702]: osdmap e668: 12 total, 12 up, 12 in 2023-03-02T15:55:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:11 smithi057 ceph-mon[92072]: pgmap v9526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2023-03-02T15:55:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:11 smithi122 ceph-mon[125440]: pgmap v9526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2023-03-02T15:55:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:11 smithi136 ceph-mon[125702]: pgmap v9526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2023-03-02T15:55:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:13 smithi057 ceph-mon[92072]: pgmap v9527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 10 op/s 2023-03-02T15:55:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:13 smithi122 ceph-mon[125440]: pgmap v9527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 10 op/s 2023-03-02T15:55:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:13 smithi136 ceph-mon[125702]: pgmap v9527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 10 op/s 2023-03-02T15:55:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:15 smithi057 ceph-mon[92072]: pgmap v9528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:55:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:15 smithi122 ceph-mon[125440]: pgmap v9528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:55:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:15 smithi136 ceph-mon[125702]: pgmap v9528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:55:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:17 smithi057 ceph-mon[92072]: pgmap v9529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T15:55:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:17 smithi122 ceph-mon[125440]: pgmap v9529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T15:55:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:17 smithi136 ceph-mon[125702]: pgmap v9529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T15:55:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:17.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:55:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:17.613+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:55:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:17.613+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:55:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:17.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:55:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:17.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:55:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:19 smithi057 ceph-mon[92072]: pgmap v9530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:55:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:19 smithi122 ceph-mon[125440]: pgmap v9530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:55:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:19 smithi136 ceph-mon[125702]: pgmap v9530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:55:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:21 smithi057 ceph-mon[92072]: pgmap v9531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:55:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:21 smithi122 ceph-mon[125440]: pgmap v9531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:55:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:21 smithi136 ceph-mon[125702]: pgmap v9531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:55:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:23 smithi057 ceph-mon[92072]: pgmap v9532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-02T15:55:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:23 smithi122 ceph-mon[125440]: pgmap v9532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-02T15:55:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:23 smithi136 ceph-mon[125702]: pgmap v9532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-02T15:55:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:25 smithi057 ceph-mon[92072]: pgmap v9533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-02T15:55:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:25 smithi122 ceph-mon[125440]: pgmap v9533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-02T15:55:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:25 smithi136 ceph-mon[125702]: pgmap v9533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-02T15:55:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:27 smithi057 ceph-mon[92072]: pgmap v9534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:27 smithi122 ceph-mon[125440]: pgmap v9534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:27 smithi136 ceph-mon[125702]: pgmap v9534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:29 smithi057 ceph-mon[92072]: pgmap v9535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:29 smithi122 ceph-mon[125440]: pgmap v9535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:29 smithi136 ceph-mon[125702]: pgmap v9535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:31 smithi057 ceph-mon[92072]: pgmap v9536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:31 smithi122 ceph-mon[125440]: pgmap v9536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:31 smithi136 ceph-mon[125702]: pgmap v9536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:32.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:55:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:32.629+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:55:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:32.629+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:55:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:32.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:55:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:32.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:55:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:33 smithi057 ceph-mon[92072]: pgmap v9537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:55:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:33 smithi122 ceph-mon[125440]: pgmap v9537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:55:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:33 smithi136 ceph-mon[125702]: pgmap v9537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:55:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:35 smithi122 ceph-mon[125440]: pgmap v9538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:55:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:35 smithi136 ceph-mon[125702]: pgmap v9538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:55:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:35 smithi057 ceph-mon[92072]: pgmap v9538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:55:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:37 smithi122 ceph-mon[125440]: pgmap v9539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:37 smithi136 ceph-mon[125702]: pgmap v9539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:37 smithi057 ceph-mon[92072]: pgmap v9539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:39 smithi136 ceph-mon[125702]: pgmap v9540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:39 smithi057 ceph-mon[92072]: pgmap v9540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:39 smithi122 ceph-mon[125440]: pgmap v9540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:41 smithi136 ceph-mon[125702]: pgmap v9541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:41 smithi057 ceph-mon[92072]: pgmap v9541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:41 smithi122 ceph-mon[125440]: pgmap v9541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:43 smithi136 ceph-mon[125702]: pgmap v9542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:55:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:43 smithi057 ceph-mon[92072]: pgmap v9542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:55:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:43 smithi122 ceph-mon[125440]: pgmap v9542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:55:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:45 smithi136 ceph-mon[125702]: pgmap v9543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:55:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:45 smithi057 ceph-mon[92072]: pgmap v9543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:55:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:45 smithi122 ceph-mon[125440]: pgmap v9543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:55:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:47 smithi136 ceph-mon[125702]: pgmap v9544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:47.642+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:55:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:47.642+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:55:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:47.642+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:55:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:47.642+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:55:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:55:47.642+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:55:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:47 smithi057 ceph-mon[92072]: pgmap v9544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:47 smithi122 ceph-mon[125440]: pgmap v9544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:49 smithi136 ceph-mon[125702]: pgmap v9545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:49 smithi057 ceph-mon[92072]: pgmap v9545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:49 smithi122 ceph-mon[125440]: pgmap v9545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:51 smithi136 ceph-mon[125702]: pgmap v9546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:51 smithi057 ceph-mon[92072]: pgmap v9546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:51 smithi122 ceph-mon[125440]: pgmap v9546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:53 smithi136 ceph-mon[125702]: pgmap v9547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:55:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:53 smithi057 ceph-mon[92072]: pgmap v9547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:55:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:53 smithi122 ceph-mon[125440]: pgmap v9547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:55:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:55 smithi136 ceph-mon[125702]: pgmap v9548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:55:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:55 smithi057 ceph-mon[92072]: pgmap v9548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:55:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:55 smithi122 ceph-mon[125440]: pgmap v9548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:55:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:57 smithi136 ceph-mon[125702]: pgmap v9549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:55:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:57 smithi057 ceph-mon[92072]: pgmap v9549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:55:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:57 smithi122 ceph-mon[125440]: pgmap v9549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:55:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:55:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:55:59 smithi136 ceph-mon[125702]: pgmap v9550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:55:59 smithi057 ceph-mon[92072]: pgmap v9550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:55:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:55:59 smithi122 ceph-mon[125440]: pgmap v9550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:00.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:00.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: pgmap v9551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 122.1M 2023-03-02T15:56:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 128084545: error parsing value: Value '128084545' is below minimum 939524096 2023-03-02T15:56:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:01.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: pgmap v9551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 122.1M 2023-03-02T15:56:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 128084545: error parsing value: Value '128084545' is below minimum 939524096 2023-03-02T15:56:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:01.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: pgmap v9551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 122.1M 2023-03-02T15:56:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 128084545: error parsing value: Value '128084545' is below minimum 939524096 2023-03-02T15:56:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:01.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:02.652 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:02.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:56:02.652 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:02.652+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:56:02.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:02.652+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:56:02.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:02.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:56:02.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:02.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:56:02.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:56:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:56:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: pgmap v9552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:56:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:56:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:56:02.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:56:02.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:56:02.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:56:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:56:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: pgmap v9552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:56:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:56:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:56:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:56:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:56:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T15:56:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T15:56:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: pgmap v9552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2023-03-02T15:56:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T15:56:02.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T15:56:02.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T15:56:02.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:56:02.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:56:02.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:56:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:05 smithi136 ceph-mon[125702]: pgmap v9553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:56:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:05 smithi057 ceph-mon[92072]: pgmap v9553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:56:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:05 smithi122 ceph-mon[125440]: pgmap v9553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:56:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:07 smithi136 ceph-mon[125702]: pgmap v9554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:56:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:07 smithi136 ceph-mon[125702]: osdmap e669: 12 total, 12 up, 12 in 2023-03-02T15:56:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:07 smithi057 ceph-mon[92072]: pgmap v9554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:56:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:07 smithi057 ceph-mon[92072]: osdmap e669: 12 total, 12 up, 12 in 2023-03-02T15:56:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:07 smithi122 ceph-mon[125440]: pgmap v9554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:56:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:07 smithi122 ceph-mon[125440]: osdmap e669: 12 total, 12 up, 12 in 2023-03-02T15:56:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:09 smithi136 ceph-mon[125702]: pgmap v9556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:56:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:09 smithi136 ceph-mon[125702]: osdmap e670: 12 total, 12 up, 12 in 2023-03-02T15:56:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:09 smithi057 ceph-mon[92072]: pgmap v9556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:56:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:09 smithi057 ceph-mon[92072]: osdmap e670: 12 total, 12 up, 12 in 2023-03-02T15:56:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:09 smithi122 ceph-mon[125440]: pgmap v9556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:56:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:09 smithi122 ceph-mon[125440]: osdmap e670: 12 total, 12 up, 12 in 2023-03-02T15:56:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:10.933+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:56:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:10.933+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:56:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:10.934+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 140 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T15:56:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:10.934+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:56:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:10.934+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 139 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T15:56:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:10.934+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:56:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:10.934+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 141 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:56:10.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:10.934+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 140 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:56:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:11 smithi136 ceph-mon[125702]: pgmap v9558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2023-03-02T15:56:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:11 smithi057 ceph-mon[92072]: pgmap v9558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2023-03-02T15:56:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:11 smithi122 ceph-mon[125440]: pgmap v9558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 27 op/s 2023-03-02T15:56:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:13 smithi136 ceph-mon[125702]: pgmap v9559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 10 op/s 2023-03-02T15:56:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:13 smithi057 ceph-mon[92072]: pgmap v9559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 10 op/s 2023-03-02T15:56:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:13 smithi122 ceph-mon[125440]: pgmap v9559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 10 op/s 2023-03-02T15:56:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:15 smithi136 ceph-mon[125702]: pgmap v9560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:56:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:15 smithi057 ceph-mon[92072]: pgmap v9560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:56:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:15 smithi122 ceph-mon[125440]: pgmap v9560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:56:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:17 smithi136 ceph-mon[125702]: pgmap v9561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T15:56:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:17 smithi057 ceph-mon[92072]: pgmap v9561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T15:56:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:17 smithi122 ceph-mon[125440]: pgmap v9561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T15:56:17.665 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:17.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:56:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:17.665+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:56:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:17.665+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:56:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:17.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:56:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:17.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:56:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:19 smithi136 ceph-mon[125702]: pgmap v9562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:56:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:19 smithi057 ceph-mon[92072]: pgmap v9562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:56:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:19 smithi122 ceph-mon[125440]: pgmap v9562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:56:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:21 smithi136 ceph-mon[125702]: pgmap v9563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:56:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:21 smithi057 ceph-mon[92072]: pgmap v9563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:56:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:21 smithi122 ceph-mon[125440]: pgmap v9563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:56:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:23 smithi136 ceph-mon[125702]: pgmap v9564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-02T15:56:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:23 smithi057 ceph-mon[92072]: pgmap v9564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-02T15:56:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:23 smithi122 ceph-mon[125440]: pgmap v9564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-02T15:56:25.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:25 smithi136 ceph-mon[125702]: pgmap v9565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-02T15:56:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:25 smithi057 ceph-mon[92072]: pgmap v9565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-02T15:56:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:25 smithi122 ceph-mon[125440]: pgmap v9565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-02T15:56:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:27 smithi136 ceph-mon[125702]: pgmap v9566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:27 smithi057 ceph-mon[92072]: pgmap v9566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:27 smithi122 ceph-mon[125440]: pgmap v9566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:29.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:29 smithi136 ceph-mon[125702]: pgmap v9567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:29 smithi057 ceph-mon[92072]: pgmap v9567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:29 smithi122 ceph-mon[125440]: pgmap v9567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:31 smithi136 ceph-mon[125702]: pgmap v9568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:31 smithi057 ceph-mon[92072]: pgmap v9568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:31 smithi122 ceph-mon[125440]: pgmap v9568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:32.681+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:56:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:32.681+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:56:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:32.681+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:56:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:32.681+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:56:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:32.681+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:56:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:33 smithi136 ceph-mon[125702]: pgmap v9569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:56:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:33 smithi057 ceph-mon[92072]: pgmap v9569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:56:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:33 smithi122 ceph-mon[125440]: pgmap v9569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:56:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:35 smithi136 ceph-mon[125702]: pgmap v9570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:56:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:35 smithi057 ceph-mon[92072]: pgmap v9570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:56:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:35 smithi122 ceph-mon[125440]: pgmap v9570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:56:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:37 smithi136 ceph-mon[125702]: pgmap v9571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:37 smithi057 ceph-mon[92072]: pgmap v9571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:37 smithi122 ceph-mon[125440]: pgmap v9571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:39 smithi057 ceph-mon[92072]: pgmap v9572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:39 smithi122 ceph-mon[125440]: pgmap v9572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:39 smithi136 ceph-mon[125702]: pgmap v9572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:41 smithi057 ceph-mon[92072]: pgmap v9573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:41 smithi122 ceph-mon[125440]: pgmap v9573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:41 smithi136 ceph-mon[125702]: pgmap v9573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:43 smithi057 ceph-mon[92072]: pgmap v9574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:56:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:43 smithi122 ceph-mon[125440]: pgmap v9574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:56:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:43 smithi136 ceph-mon[125702]: pgmap v9574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:56:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:45 smithi057 ceph-mon[92072]: pgmap v9575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:56:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:45 smithi122 ceph-mon[125440]: pgmap v9575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:56:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:45 smithi136 ceph-mon[125702]: pgmap v9575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:56:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:47 smithi057 ceph-mon[92072]: pgmap v9576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:47 smithi122 ceph-mon[125440]: pgmap v9576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:47 smithi136 ceph-mon[125702]: pgmap v9576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:47.698 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:47.696+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:56:47.698 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:47.696+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:56:47.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:47.696+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:56:47.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:47.696+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:56:47.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:56:47.696+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:56:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:49 smithi057 ceph-mon[92072]: pgmap v9577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:49 smithi122 ceph-mon[125440]: pgmap v9577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:49 smithi136 ceph-mon[125702]: pgmap v9577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:51 smithi057 ceph-mon[92072]: pgmap v9578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:51 smithi122 ceph-mon[125440]: pgmap v9578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:51 smithi136 ceph-mon[125702]: pgmap v9578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:53 smithi057 ceph-mon[92072]: pgmap v9579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:56:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:53 smithi122 ceph-mon[125440]: pgmap v9579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:56:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:53 smithi136 ceph-mon[125702]: pgmap v9579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T15:56:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:55 smithi057 ceph-mon[92072]: pgmap v9580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:56:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:55 smithi122 ceph-mon[125440]: pgmap v9580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:56:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:55 smithi136 ceph-mon[125702]: pgmap v9580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:56:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:57 smithi057 ceph-mon[92072]: pgmap v9581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:57 smithi122 ceph-mon[125440]: pgmap v9581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:57 smithi136 ceph-mon[125702]: pgmap v9581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:56:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:56:59 smithi057 ceph-mon[92072]: pgmap v9582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:56:59 smithi122 ceph-mon[125440]: pgmap v9582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:56:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:56:59 smithi136 ceph-mon[125702]: pgmap v9582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:01 smithi057 ceph-mon[92072]: pgmap v9583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:01 smithi122 ceph-mon[125440]: pgmap v9583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:01 smithi136 ceph-mon[125702]: pgmap v9583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:57:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:57:02.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:57:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:02.712+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:57:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:02.712+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:57:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:02.712+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:57:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:02.712+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:57:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:02.712+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:57:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:03 smithi057 ceph-mon[92072]: pgmap v9584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:57:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:57:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:57:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:57:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:03 smithi122 ceph-mon[125440]: pgmap v9584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:57:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:57:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:57:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:57:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:03 smithi136 ceph-mon[125702]: pgmap v9584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:57:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:57:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:57:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:57:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:05 smithi057 ceph-mon[92072]: pgmap v9585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:57:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:05 smithi122 ceph-mon[125440]: pgmap v9585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:57:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:05 smithi136 ceph-mon[125702]: pgmap v9585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T15:57:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:07 smithi057 ceph-mon[92072]: pgmap v9586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:57:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:07 smithi057 ceph-mon[92072]: osdmap e671: 12 total, 12 up, 12 in 2023-03-02T15:57:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:07 smithi122 ceph-mon[125440]: pgmap v9586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:57:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:07 smithi122 ceph-mon[125440]: osdmap e671: 12 total, 12 up, 12 in 2023-03-02T15:57:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:07 smithi136 ceph-mon[125702]: pgmap v9586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:57:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:07 smithi136 ceph-mon[125702]: osdmap e671: 12 total, 12 up, 12 in 2023-03-02T15:57:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:09 smithi122 ceph-mon[125440]: pgmap v9588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:57:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:09 smithi122 ceph-mon[125440]: osdmap e672: 12 total, 12 up, 12 in 2023-03-02T15:57:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:09 smithi136 ceph-mon[125702]: pgmap v9588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:57:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:09 smithi136 ceph-mon[125702]: osdmap e672: 12 total, 12 up, 12 in 2023-03-02T15:57:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:09 smithi057 ceph-mon[92072]: pgmap v9588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T15:57:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:09 smithi057 ceph-mon[92072]: osdmap e672: 12 total, 12 up, 12 in 2023-03-02T15:57:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:11 smithi122 ceph-mon[125440]: pgmap v9590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:57:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:11 smithi136 ceph-mon[125702]: pgmap v9590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:57:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:11 smithi057 ceph-mon[92072]: pgmap v9590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T15:57:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:13 smithi122 ceph-mon[125440]: pgmap v9591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:57:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:13 smithi136 ceph-mon[125702]: pgmap v9591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:57:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:13 smithi057 ceph-mon[92072]: pgmap v9591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:57:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:15 smithi122 ceph-mon[125440]: pgmap v9592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:57:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:15 smithi136 ceph-mon[125702]: pgmap v9592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:57:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:15 smithi057 ceph-mon[92072]: pgmap v9592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T15:57:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:17 smithi122 ceph-mon[125440]: pgmap v9593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T15:57:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:17 smithi136 ceph-mon[125702]: pgmap v9593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T15:57:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:17 smithi057 ceph-mon[92072]: pgmap v9593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T15:57:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:17.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:57:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:17.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:57:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:17.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:57:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:17.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:57:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:17.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:57:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:19 smithi136 ceph-mon[125702]: pgmap v9594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:57:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:19 smithi057 ceph-mon[92072]: pgmap v9594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:57:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:19 smithi122 ceph-mon[125440]: pgmap v9594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:57:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:21 smithi136 ceph-mon[125702]: pgmap v9595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:57:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:21 smithi057 ceph-mon[92072]: pgmap v9595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:57:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:21 smithi122 ceph-mon[125440]: pgmap v9595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T15:57:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:23 smithi136 ceph-mon[125702]: pgmap v9596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:57:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:23 smithi057 ceph-mon[92072]: pgmap v9596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:57:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:23 smithi122 ceph-mon[125440]: pgmap v9596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T15:57:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:25 smithi136 ceph-mon[125702]: pgmap v9597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:25 smithi057 ceph-mon[92072]: pgmap v9597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:25 smithi122 ceph-mon[125440]: pgmap v9597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:27 smithi136 ceph-mon[125702]: pgmap v9598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:27 smithi057 ceph-mon[92072]: pgmap v9598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:27 smithi122 ceph-mon[125440]: pgmap v9598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:29 smithi136 ceph-mon[125702]: pgmap v9599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:29 smithi057 ceph-mon[92072]: pgmap v9599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:29 smithi122 ceph-mon[125440]: pgmap v9599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:31 smithi136 ceph-mon[125702]: pgmap v9600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:31 smithi057 ceph-mon[92072]: pgmap v9600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:31 smithi122 ceph-mon[125440]: pgmap v9600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:32.744+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:57:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:32.744+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:57:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:32.744+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:57:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:32.744+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:57:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:32.744+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:57:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:33 smithi136 ceph-mon[125702]: pgmap v9601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:33 smithi057 ceph-mon[92072]: pgmap v9601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:33 smithi122 ceph-mon[125440]: pgmap v9601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:35 smithi136 ceph-mon[125702]: pgmap v9602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:35 smithi057 ceph-mon[92072]: pgmap v9602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:35 smithi122 ceph-mon[125440]: pgmap v9602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:37 smithi136 ceph-mon[125702]: pgmap v9603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:37 smithi057 ceph-mon[92072]: pgmap v9603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:37 smithi122 ceph-mon[125440]: pgmap v9603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:39 smithi136 ceph-mon[125702]: pgmap v9604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:39 smithi057 ceph-mon[92072]: pgmap v9604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:39 smithi122 ceph-mon[125440]: pgmap v9604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:41 smithi136 ceph-mon[125702]: pgmap v9605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:41 smithi057 ceph-mon[92072]: pgmap v9605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:41 smithi122 ceph-mon[125440]: pgmap v9605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:43 smithi136 ceph-mon[125702]: pgmap v9606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:43 smithi057 ceph-mon[92072]: pgmap v9606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:43 smithi122 ceph-mon[125440]: pgmap v9606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:45 smithi136 ceph-mon[125702]: pgmap v9607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:45 smithi057 ceph-mon[92072]: pgmap v9607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:45 smithi122 ceph-mon[125440]: pgmap v9607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:47 smithi136 ceph-mon[125702]: pgmap v9608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:47 smithi057 ceph-mon[92072]: pgmap v9608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:47 smithi122 ceph-mon[125440]: pgmap v9608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:47.759+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:57:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:47.759+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:57:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:47.759+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:57:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:47.759+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:57:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:57:47.759+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:57:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:49 smithi136 ceph-mon[125702]: pgmap v9609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:49 smithi057 ceph-mon[92072]: pgmap v9609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:49 smithi122 ceph-mon[125440]: pgmap v9609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:51 smithi136 ceph-mon[125702]: pgmap v9610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:51 smithi057 ceph-mon[92072]: pgmap v9610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:51 smithi122 ceph-mon[125440]: pgmap v9610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:53 smithi136 ceph-mon[125702]: pgmap v9611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:53 smithi057 ceph-mon[92072]: pgmap v9611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:53 smithi122 ceph-mon[125440]: pgmap v9611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:55 smithi136 ceph-mon[125702]: pgmap v9612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:55 smithi057 ceph-mon[92072]: pgmap v9612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:55 smithi122 ceph-mon[125440]: pgmap v9612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:57 smithi136 ceph-mon[125702]: pgmap v9613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:57 smithi057 ceph-mon[92072]: pgmap v9613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:57 smithi122 ceph-mon[125440]: pgmap v9613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:57:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:57:59 smithi136 ceph-mon[125702]: pgmap v9614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:57:59 smithi057 ceph-mon[92072]: pgmap v9614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:57:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:57:59 smithi122 ceph-mon[125440]: pgmap v9614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:58:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:01 smithi136 ceph-mon[125702]: pgmap v9615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:01 smithi057 ceph-mon[92072]: pgmap v9615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:01 smithi122 ceph-mon[125440]: pgmap v9615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:02.775+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:58:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:02.775+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:58:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:02.775+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:58:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:02.775+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:58:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:02.775+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:58:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:03 smithi136 ceph-mon[125702]: pgmap v9616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:58:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:58:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:03 smithi057 ceph-mon[92072]: pgmap v9616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:58:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:58:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:03 smithi122 ceph-mon[125440]: pgmap v9616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:58:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:58:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:58:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:58:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:58:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:58:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:58:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:58:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:58:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:58:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:58:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:58:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:58:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:58:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:58:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:58:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:58:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:05 smithi136 ceph-mon[125702]: pgmap v9617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:58:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:05 smithi057 ceph-mon[92072]: pgmap v9617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:58:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:05 smithi122 ceph-mon[125440]: pgmap v9617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:58:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:07 smithi057 ceph-mon[92072]: pgmap v9618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:58:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:07 smithi122 ceph-mon[125440]: pgmap v9618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:58:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:07 smithi136 ceph-mon[125702]: pgmap v9618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:58:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:09 smithi057 ceph-mon[92072]: pgmap v9619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:58:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:09 smithi122 ceph-mon[125440]: pgmap v9619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:58:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:09 smithi136 ceph-mon[125702]: pgmap v9619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:58:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:11 smithi057 ceph-mon[92072]: pgmap v9620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:58:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:11 smithi122 ceph-mon[125440]: pgmap v9620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:58:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:11 smithi136 ceph-mon[125702]: pgmap v9620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:58:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:12 smithi057 ceph-mon[92072]: osdmap e673: 12 total, 12 up, 12 in 2023-03-02T15:58:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:12 smithi122 ceph-mon[125440]: osdmap e673: 12 total, 12 up, 12 in 2023-03-02T15:58:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:12 smithi136 ceph-mon[125702]: osdmap e673: 12 total, 12 up, 12 in 2023-03-02T15:58:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:13 smithi057 ceph-mon[92072]: pgmap v9622: 97 pgs: 3 active+clean+snaptrim_wait, 94 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:13 smithi122 ceph-mon[125440]: pgmap v9622: 97 pgs: 3 active+clean+snaptrim_wait, 94 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:13 smithi136 ceph-mon[125702]: pgmap v9622: 97 pgs: 3 active+clean+snaptrim_wait, 94 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:15 smithi057 ceph-mon[92072]: pgmap v9623: 97 pgs: 3 active+clean+snaptrim_wait, 94 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:15 smithi122 ceph-mon[125440]: pgmap v9623: 97 pgs: 3 active+clean+snaptrim_wait, 94 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:15 smithi136 ceph-mon[125702]: pgmap v9623: 97 pgs: 3 active+clean+snaptrim_wait, 94 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:17 smithi057 ceph-mon[92072]: pgmap v9624: 97 pgs: 3 active+clean+snaptrim_wait, 94 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:17 smithi122 ceph-mon[125440]: pgmap v9624: 97 pgs: 3 active+clean+snaptrim_wait, 94 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:17.790+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:58:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:17.791+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:58:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:17.791+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:58:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:17.791+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:58:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:17.791+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:58:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:17 smithi136 ceph-mon[125702]: pgmap v9624: 97 pgs: 3 active+clean+snaptrim_wait, 94 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:19 smithi057 ceph-mon[92072]: pgmap v9625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:58:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:19 smithi057 ceph-mon[92072]: osdmap e674: 12 total, 12 up, 12 in 2023-03-02T15:58:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:19 smithi122 ceph-mon[125440]: pgmap v9625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:58:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:19 smithi122 ceph-mon[125440]: osdmap e674: 12 total, 12 up, 12 in 2023-03-02T15:58:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:19 smithi136 ceph-mon[125702]: pgmap v9625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T15:58:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:19 smithi136 ceph-mon[125702]: osdmap e674: 12 total, 12 up, 12 in 2023-03-02T15:58:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:21 smithi057 ceph-mon[92072]: pgmap v9627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 363 B/s wr, 12 op/s 2023-03-02T15:58:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:21 smithi122 ceph-mon[125440]: pgmap v9627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 363 B/s wr, 12 op/s 2023-03-02T15:58:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:21 smithi136 ceph-mon[125702]: pgmap v9627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 363 B/s wr, 12 op/s 2023-03-02T15:58:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:23 smithi057 ceph-mon[92072]: pgmap v9628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:23 smithi122 ceph-mon[125440]: pgmap v9628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:23 smithi136 ceph-mon[125702]: pgmap v9628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:25 smithi057 ceph-mon[92072]: pgmap v9629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:25 smithi122 ceph-mon[125440]: pgmap v9629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:25 smithi136 ceph-mon[125702]: pgmap v9629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:27 smithi057 ceph-mon[92072]: pgmap v9630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:27 smithi122 ceph-mon[125440]: pgmap v9630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:27 smithi136 ceph-mon[125702]: pgmap v9630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:58:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:29 smithi057 ceph-mon[92072]: pgmap v9631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:58:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:29 smithi122 ceph-mon[125440]: pgmap v9631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:58:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:29 smithi136 ceph-mon[125702]: pgmap v9631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:58:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:31 smithi057 ceph-mon[92072]: pgmap v9632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:58:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:31 smithi122 ceph-mon[125440]: pgmap v9632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:58:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:31 smithi136 ceph-mon[125702]: pgmap v9632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:58:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:32.797+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:58:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:32.797+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:58:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:32.797+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:58:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:32.797+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:58:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:32.797+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:58:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:33 smithi057 ceph-mon[92072]: pgmap v9633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:58:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:33 smithi122 ceph-mon[125440]: pgmap v9633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:58:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:33 smithi136 ceph-mon[125702]: pgmap v9633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:58:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:35 smithi057 ceph-mon[92072]: pgmap v9634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:35 smithi122 ceph-mon[125440]: pgmap v9634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:35 smithi136 ceph-mon[125702]: pgmap v9634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:37 smithi057 ceph-mon[92072]: pgmap v9635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:37 smithi122 ceph-mon[125440]: pgmap v9635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:37 smithi136 ceph-mon[125702]: pgmap v9635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:39 smithi057 ceph-mon[92072]: pgmap v9636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:58:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:39 smithi122 ceph-mon[125440]: pgmap v9636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:58:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:39 smithi136 ceph-mon[125702]: pgmap v9636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:58:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:41 smithi057 ceph-mon[92072]: pgmap v9637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:41 smithi122 ceph-mon[125440]: pgmap v9637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:41 smithi136 ceph-mon[125702]: pgmap v9637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:43 smithi057 ceph-mon[92072]: pgmap v9638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:58:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:43 smithi122 ceph-mon[125440]: pgmap v9638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:58:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:43 smithi136 ceph-mon[125702]: pgmap v9638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:58:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:45 smithi057 ceph-mon[92072]: pgmap v9639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:45 smithi122 ceph-mon[125440]: pgmap v9639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:45 smithi136 ceph-mon[125702]: pgmap v9639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:47 smithi122 ceph-mon[125440]: pgmap v9640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:47.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:47.798+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:58:47.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:47.799+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:58:47.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:47.799+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:58:47.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:47.799+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:58:47.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:58:47.799+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:58:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:47 smithi136 ceph-mon[125702]: pgmap v9640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:47 smithi057 ceph-mon[92072]: pgmap v9640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:58:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:49 smithi122 ceph-mon[125440]: pgmap v9641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:58:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:49 smithi136 ceph-mon[125702]: pgmap v9641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:58:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:49 smithi057 ceph-mon[92072]: pgmap v9641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:58:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:51 smithi122 ceph-mon[125440]: pgmap v9642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:58:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:51 smithi136 ceph-mon[125702]: pgmap v9642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:58:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:51 smithi057 ceph-mon[92072]: pgmap v9642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:58:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:53 smithi136 ceph-mon[125702]: pgmap v9643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:58:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:53 smithi057 ceph-mon[92072]: pgmap v9643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:58:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:53 smithi122 ceph-mon[125440]: pgmap v9643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:58:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:55 smithi136 ceph-mon[125702]: pgmap v9644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:58:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:55 smithi057 ceph-mon[92072]: pgmap v9644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:58:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:55 smithi122 ceph-mon[125440]: pgmap v9644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:58:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:57 smithi136 ceph-mon[125702]: pgmap v9645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:58:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:57 smithi057 ceph-mon[92072]: pgmap v9645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:58:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:57 smithi122 ceph-mon[125440]: pgmap v9645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T15:58:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:58:59 smithi136 ceph-mon[125702]: pgmap v9646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:58:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:58:59 smithi057 ceph-mon[92072]: pgmap v9646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:58:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:58:59 smithi122 ceph-mon[125440]: pgmap v9646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T15:59:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:01 smithi136 ceph-mon[125702]: pgmap v9647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:01 smithi057 ceph-mon[92072]: pgmap v9647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:01 smithi122 ceph-mon[125440]: pgmap v9647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:02.814 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:02.813+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:59:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:02.813+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:59:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:02.813+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:59:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:02.813+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:59:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:02.814+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:59:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:03 smithi136 ceph-mon[125702]: pgmap v9648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:59:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:03 smithi057 ceph-mon[92072]: pgmap v9648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:59:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:03 smithi122 ceph-mon[125440]: pgmap v9648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:59:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:05 smithi136 ceph-mon[125702]: pgmap v9649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:59:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:59:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:05.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:05 smithi057 ceph-mon[92072]: pgmap v9649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:59:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:59:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:05 smithi122 ceph-mon[125440]: pgmap v9649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:59:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T15:59:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:59:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:59:06.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:59:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:59:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T15:59:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T15:59:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T15:59:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:07 smithi122 ceph-mon[125440]: pgmap v9650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:59:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:07 smithi136 ceph-mon[125702]: pgmap v9650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:59:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:07 smithi057 ceph-mon[92072]: pgmap v9650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T15:59:08.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:08.405+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T15:59:08.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:08.405+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T15:59:08.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:08.405+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f587005e050 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:59:08.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:08.405+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f587005e050 comp rx=0 tx=0).stop 2023-03-02T15:59:08.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:08.405+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T15:59:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:08.405+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T15:59:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:08.405+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T15:59:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:08.405+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T15:59:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:08.405+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:59:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:08.406+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f58700387f0 tx=0x7f5870097040 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T15:59:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:09 smithi122 ceph-mon[125440]: pgmap v9651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:59:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:09 smithi136 ceph-mon[125702]: pgmap v9651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:59:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:09 smithi057 ceph-mon[92072]: pgmap v9651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T15:59:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:10.960+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:59:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:10.960+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:59:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:10.960+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 141 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T15:59:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:10.960+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 142 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T15:59:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:11 smithi136 ceph-mon[125702]: pgmap v9652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:59:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:11 smithi057 ceph-mon[92072]: pgmap v9652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:59:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:11 smithi122 ceph-mon[125440]: pgmap v9652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T15:59:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:12 smithi136 ceph-mon[125702]: osdmap e675: 12 total, 12 up, 12 in 2023-03-02T15:59:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:12 smithi057 ceph-mon[92072]: osdmap e675: 12 total, 12 up, 12 in 2023-03-02T15:59:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:12 smithi122 ceph-mon[125440]: osdmap e675: 12 total, 12 up, 12 in 2023-03-02T15:59:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:13 smithi136 ceph-mon[125702]: pgmap v9654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:13 smithi057 ceph-mon[92072]: pgmap v9654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:13 smithi122 ceph-mon[125440]: pgmap v9654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:15 smithi136 ceph-mon[125702]: pgmap v9655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:15 smithi057 ceph-mon[92072]: pgmap v9655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:15 smithi122 ceph-mon[125440]: pgmap v9655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:17.827+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:59:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:17.827+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:59:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:17.827+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:59:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:17.827+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:59:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:17.827+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:59:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:17 smithi136 ceph-mon[125702]: pgmap v9656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:17 smithi057 ceph-mon[92072]: pgmap v9656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:17 smithi122 ceph-mon[125440]: pgmap v9656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:19 smithi136 ceph-mon[125702]: pgmap v9657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:19 smithi136 ceph-mon[125702]: osdmap e676: 12 total, 12 up, 12 in 2023-03-02T15:59:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:19 smithi057 ceph-mon[92072]: pgmap v9657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:19 smithi057 ceph-mon[92072]: osdmap e676: 12 total, 12 up, 12 in 2023-03-02T15:59:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:19 smithi122 ceph-mon[125440]: pgmap v9657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T15:59:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:19 smithi122 ceph-mon[125440]: osdmap e676: 12 total, 12 up, 12 in 2023-03-02T15:59:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:21 smithi136 ceph-mon[125702]: pgmap v9659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T15:59:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:21 smithi057 ceph-mon[92072]: pgmap v9659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T15:59:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:21 smithi122 ceph-mon[125440]: pgmap v9659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-02T15:59:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:23 smithi136 ceph-mon[125702]: pgmap v9660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:59:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:23 smithi057 ceph-mon[92072]: pgmap v9660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:59:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:23 smithi122 ceph-mon[125440]: pgmap v9660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:59:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:25 smithi136 ceph-mon[125702]: pgmap v9661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:59:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:25 smithi057 ceph-mon[92072]: pgmap v9661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:59:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:25 smithi122 ceph-mon[125440]: pgmap v9661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:59:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:27 smithi136 ceph-mon[125702]: pgmap v9662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:59:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:27 smithi057 ceph-mon[92072]: pgmap v9662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:59:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:27 smithi122 ceph-mon[125440]: pgmap v9662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T15:59:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:29 smithi136 ceph-mon[125702]: pgmap v9663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:59:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:29 smithi057 ceph-mon[92072]: pgmap v9663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:59:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:29 smithi122 ceph-mon[125440]: pgmap v9663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T15:59:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:31 smithi136 ceph-mon[125702]: pgmap v9664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:59:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:31 smithi057 ceph-mon[92072]: pgmap v9664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:59:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:31 smithi122 ceph-mon[125440]: pgmap v9664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T15:59:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:32.837+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:59:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:32.838+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:59:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:32.838+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:59:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:32.838+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:59:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:32.838+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:59:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:33 smithi136 ceph-mon[125702]: pgmap v9665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:33 smithi057 ceph-mon[92072]: pgmap v9665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:33 smithi122 ceph-mon[125440]: pgmap v9665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:35 smithi136 ceph-mon[125702]: pgmap v9666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:35 smithi057 ceph-mon[92072]: pgmap v9666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:35 smithi122 ceph-mon[125440]: pgmap v9666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:37 smithi136 ceph-mon[125702]: pgmap v9667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:37 smithi057 ceph-mon[92072]: pgmap v9667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:37 smithi122 ceph-mon[125440]: pgmap v9667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:39 smithi136 ceph-mon[125702]: pgmap v9668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:39 smithi057 ceph-mon[92072]: pgmap v9668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:39 smithi122 ceph-mon[125440]: pgmap v9668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:41 smithi136 ceph-mon[125702]: pgmap v9669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:41 smithi057 ceph-mon[92072]: pgmap v9669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:41 smithi122 ceph-mon[125440]: pgmap v9669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:43 smithi136 ceph-mon[125702]: pgmap v9670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:43 smithi057 ceph-mon[92072]: pgmap v9670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:43 smithi122 ceph-mon[125440]: pgmap v9670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:45 smithi136 ceph-mon[125702]: pgmap v9671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:45 smithi057 ceph-mon[92072]: pgmap v9671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:45 smithi122 ceph-mon[125440]: pgmap v9671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:47 smithi136 ceph-mon[125702]: pgmap v9672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:47.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:47.850+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T15:59:47.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:47.851+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T15:59:47.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:47.851+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T15:59:47.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:47.851+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T15:59:47.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T15:59:47.851+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T15:59:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:47 smithi057 ceph-mon[92072]: pgmap v9672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:47 smithi122 ceph-mon[125440]: pgmap v9672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:49 smithi136 ceph-mon[125702]: pgmap v9673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:49 smithi057 ceph-mon[92072]: pgmap v9673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:49 smithi122 ceph-mon[125440]: pgmap v9673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:51 smithi136 ceph-mon[125702]: pgmap v9674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:51 smithi057 ceph-mon[92072]: pgmap v9674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:51 smithi122 ceph-mon[125440]: pgmap v9674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:53 smithi136 ceph-mon[125702]: pgmap v9675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:53 smithi057 ceph-mon[92072]: pgmap v9675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:53 smithi122 ceph-mon[125440]: pgmap v9675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:55 smithi136 ceph-mon[125702]: pgmap v9676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:55 smithi057 ceph-mon[92072]: pgmap v9676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:55 smithi122 ceph-mon[125440]: pgmap v9676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:57 smithi136 ceph-mon[125702]: pgmap v9677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:57 smithi057 ceph-mon[92072]: pgmap v9677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:57 smithi122 ceph-mon[125440]: pgmap v9677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T15:59:58.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 15:59:58 smithi136 ceph-mon[125702]: pgmap v9678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:58.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 15:59:58 smithi057 ceph-mon[92072]: pgmap v9678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T15:59:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 15:59:58 smithi122 ceph-mon[125440]: pgmap v9678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T16:00:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T16:00:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T16:00:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:01 smithi136 ceph-mon[125702]: pgmap v9679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:01 smithi057 ceph-mon[92072]: pgmap v9679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:01 smithi122 ceph-mon[125440]: pgmap v9679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:02.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:00:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:02.855+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:00:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:02.855+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:00:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:02.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:00:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:02.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:00:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:03 smithi136 ceph-mon[125702]: pgmap v9680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:00:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:03 smithi057 ceph-mon[92072]: pgmap v9680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:00:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:03 smithi122 ceph-mon[125440]: pgmap v9680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:00:05.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:05 smithi136 ceph-mon[125702]: pgmap v9681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:00:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:05 smithi057 ceph-mon[92072]: pgmap v9681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:00:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:05 smithi122 ceph-mon[125440]: pgmap v9681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:00:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:00:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:00:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:00:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:07 smithi136 ceph-mon[125702]: pgmap v9682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:00:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:00:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:00:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:00:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:07 smithi122 ceph-mon[125440]: pgmap v9682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:00:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:00:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:00:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:00:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:07 smithi057 ceph-mon[92072]: pgmap v9682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:00:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:00:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:00:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:00:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:09 smithi136 ceph-mon[125702]: pgmap v9683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:00:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:09 smithi057 ceph-mon[92072]: pgmap v9683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:00:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:09 smithi122 ceph-mon[125440]: pgmap v9683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:00:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:11 smithi057 ceph-mon[92072]: pgmap v9684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:00:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:11 smithi122 ceph-mon[125440]: pgmap v9684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:00:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:11 smithi136 ceph-mon[125702]: pgmap v9684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:00:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:12 smithi057 ceph-mon[92072]: osdmap e677: 12 total, 12 up, 12 in 2023-03-02T16:00:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:12 smithi122 ceph-mon[125440]: osdmap e677: 12 total, 12 up, 12 in 2023-03-02T16:00:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:12 smithi136 ceph-mon[125702]: osdmap e677: 12 total, 12 up, 12 in 2023-03-02T16:00:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:13 smithi057 ceph-mon[92072]: pgmap v9686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:00:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:13 smithi122 ceph-mon[125440]: pgmap v9686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:00:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:13 smithi136 ceph-mon[125702]: pgmap v9686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:00:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:15 smithi136 ceph-mon[125702]: pgmap v9687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:00:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:15 smithi136 ceph-mon[125702]: osdmap e678: 12 total, 12 up, 12 in 2023-03-02T16:00:15.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:15 smithi057 ceph-mon[92072]: pgmap v9687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:00:15.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:15 smithi057 ceph-mon[92072]: osdmap e678: 12 total, 12 up, 12 in 2023-03-02T16:00:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:15 smithi122 ceph-mon[125440]: pgmap v9687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:00:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:15 smithi122 ceph-mon[125440]: osdmap e678: 12 total, 12 up, 12 in 2023-03-02T16:00:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:17 smithi136 ceph-mon[125702]: pgmap v9689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:00:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:17 smithi057 ceph-mon[92072]: pgmap v9689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:00:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:17 smithi122 ceph-mon[125440]: pgmap v9689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:00:17.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:17.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:00:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:17.866+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:00:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:17.866+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:00:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:17.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:00:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:17.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:00:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:19 smithi136 ceph-mon[125702]: pgmap v9690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:00:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:19 smithi057 ceph-mon[92072]: pgmap v9690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:00:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:19 smithi122 ceph-mon[125440]: pgmap v9690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:00:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:21 smithi136 ceph-mon[125702]: pgmap v9691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:00:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:21 smithi057 ceph-mon[92072]: pgmap v9691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:00:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:21 smithi122 ceph-mon[125440]: pgmap v9691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:00:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:23 smithi057 ceph-mon[92072]: pgmap v9692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:00:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:23 smithi122 ceph-mon[125440]: pgmap v9692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:00:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:23 smithi136 ceph-mon[125702]: pgmap v9692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:00:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:25 smithi057 ceph-mon[92072]: pgmap v9693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:00:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:25 smithi122 ceph-mon[125440]: pgmap v9693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:00:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:25 smithi136 ceph-mon[125702]: pgmap v9693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:00:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:27 smithi057 ceph-mon[92072]: pgmap v9694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:00:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:27 smithi122 ceph-mon[125440]: pgmap v9694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:00:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:27 smithi136 ceph-mon[125702]: pgmap v9694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:00:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:29 smithi057 ceph-mon[92072]: pgmap v9695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:00:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:29 smithi122 ceph-mon[125440]: pgmap v9695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:00:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:29 smithi136 ceph-mon[125702]: pgmap v9695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:00:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:31 smithi057 ceph-mon[92072]: pgmap v9696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:31 smithi122 ceph-mon[125440]: pgmap v9696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:31 smithi136 ceph-mon[125702]: pgmap v9696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:32.878+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:00:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:32.879+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:00:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:32.879+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:00:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:32.879+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:00:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:32.879+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:00:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:33 smithi057 ceph-mon[92072]: pgmap v9697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:33 smithi122 ceph-mon[125440]: pgmap v9697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:33 smithi136 ceph-mon[125702]: pgmap v9697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:35 smithi057 ceph-mon[92072]: pgmap v9698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:35 smithi122 ceph-mon[125440]: pgmap v9698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:35 smithi136 ceph-mon[125702]: pgmap v9698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:37.393 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:37 smithi136 ceph-mon[125702]: pgmap v9699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:37 smithi057 ceph-mon[92072]: pgmap v9699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:37 smithi122 ceph-mon[125440]: pgmap v9699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:39 smithi057 ceph-mon[92072]: pgmap v9700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:39 smithi122 ceph-mon[125440]: pgmap v9700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:39 smithi136 ceph-mon[125702]: pgmap v9700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:41 smithi057 ceph-mon[92072]: pgmap v9701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:41 smithi122 ceph-mon[125440]: pgmap v9701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:41 smithi136 ceph-mon[125702]: pgmap v9701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:43 smithi057 ceph-mon[92072]: pgmap v9702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:43 smithi122 ceph-mon[125440]: pgmap v9702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:43 smithi136 ceph-mon[125702]: pgmap v9702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:45 smithi057 ceph-mon[92072]: pgmap v9703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:45 smithi122 ceph-mon[125440]: pgmap v9703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:45 smithi136 ceph-mon[125702]: pgmap v9703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:47 smithi057 ceph-mon[92072]: pgmap v9704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:47 smithi122 ceph-mon[125440]: pgmap v9704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:47 smithi136 ceph-mon[125702]: pgmap v9704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:47.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:47.893+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:00:47.894 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:47.893+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:00:47.894 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:47.893+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:00:47.894 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:47.893+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:00:47.894 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:00:47.893+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:00:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:49 smithi057 ceph-mon[92072]: pgmap v9705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:49 smithi122 ceph-mon[125440]: pgmap v9705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:49 smithi136 ceph-mon[125702]: pgmap v9705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:51 smithi057 ceph-mon[92072]: pgmap v9706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:51 smithi122 ceph-mon[125440]: pgmap v9706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:51 smithi136 ceph-mon[125702]: pgmap v9706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:53 smithi057 ceph-mon[92072]: pgmap v9707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:53 smithi122 ceph-mon[125440]: pgmap v9707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:53 smithi136 ceph-mon[125702]: pgmap v9707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:55 smithi057 ceph-mon[92072]: pgmap v9708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:55 smithi122 ceph-mon[125440]: pgmap v9708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:55 smithi136 ceph-mon[125702]: pgmap v9708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:57 smithi057 ceph-mon[92072]: pgmap v9709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:57 smithi122 ceph-mon[125440]: pgmap v9709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:57 smithi136 ceph-mon[125702]: pgmap v9709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:00:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:00:59 smithi057 ceph-mon[92072]: pgmap v9710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:00:59 smithi122 ceph-mon[125440]: pgmap v9710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:00:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:00:59 smithi136 ceph-mon[125702]: pgmap v9710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:01 smithi057 ceph-mon[92072]: pgmap v9711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:01 smithi122 ceph-mon[125440]: pgmap v9711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:01 smithi136 ceph-mon[125702]: pgmap v9711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:02.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:02.909+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:01:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:02.909+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:01:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:02.909+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:01:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:02.909+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:01:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:02.909+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:01:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:03 smithi057 ceph-mon[92072]: pgmap v9712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:01:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:03 smithi122 ceph-mon[125440]: pgmap v9712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:01:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:03 smithi136 ceph-mon[125702]: pgmap v9712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:01:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:05 smithi122 ceph-mon[125440]: pgmap v9713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:01:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:05 smithi136 ceph-mon[125702]: pgmap v9713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:01:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:05 smithi057 ceph-mon[92072]: pgmap v9713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:01:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:07 smithi122 ceph-mon[125440]: pgmap v9714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:01:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:01:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:01:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:01:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:01:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:07 smithi136 ceph-mon[125702]: pgmap v9714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:01:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:01:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:01:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:01:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:01:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:07 smithi057 ceph-mon[92072]: pgmap v9714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:01:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:01:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:01:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:01:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:01:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:09 smithi122 ceph-mon[125440]: pgmap v9715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:01:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:09 smithi136 ceph-mon[125702]: pgmap v9715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:01:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:09 smithi057 ceph-mon[92072]: pgmap v9715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:01:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:11 smithi136 ceph-mon[125702]: pgmap v9716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:01:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:11 smithi057 ceph-mon[92072]: pgmap v9716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:01:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:11 smithi122 ceph-mon[125440]: pgmap v9716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:01:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:12 smithi136 ceph-mon[125702]: osdmap e679: 12 total, 12 up, 12 in 2023-03-02T16:01:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:12 smithi057 ceph-mon[92072]: osdmap e679: 12 total, 12 up, 12 in 2023-03-02T16:01:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:12 smithi122 ceph-mon[125440]: osdmap e679: 12 total, 12 up, 12 in 2023-03-02T16:01:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:13 smithi136 ceph-mon[125702]: pgmap v9718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:01:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:13 smithi057 ceph-mon[92072]: pgmap v9718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:01:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:13 smithi122 ceph-mon[125440]: pgmap v9718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:01:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:15 smithi136 ceph-mon[125702]: pgmap v9719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:01:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:15 smithi136 ceph-mon[125702]: osdmap e680: 12 total, 12 up, 12 in 2023-03-02T16:01:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:15 smithi057 ceph-mon[92072]: pgmap v9719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:01:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:15 smithi057 ceph-mon[92072]: osdmap e680: 12 total, 12 up, 12 in 2023-03-02T16:01:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:15 smithi122 ceph-mon[125440]: pgmap v9719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:01:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:15 smithi122 ceph-mon[125440]: osdmap e680: 12 total, 12 up, 12 in 2023-03-02T16:01:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:17 smithi057 ceph-mon[92072]: pgmap v9721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:01:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:17 smithi122 ceph-mon[125440]: pgmap v9721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:01:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:17 smithi136 ceph-mon[125702]: pgmap v9721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:01:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:17.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:01:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:17.924+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:01:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:17.924+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:01:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:17.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:01:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:17.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:01:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:19 smithi057 ceph-mon[92072]: pgmap v9722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:01:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:19 smithi122 ceph-mon[125440]: pgmap v9722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:01:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:19 smithi136 ceph-mon[125702]: pgmap v9722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:01:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:21 smithi057 ceph-mon[92072]: pgmap v9723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T16:01:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:21 smithi122 ceph-mon[125440]: pgmap v9723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T16:01:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:21 smithi136 ceph-mon[125702]: pgmap v9723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 11 op/s 2023-03-02T16:01:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:23 smithi057 ceph-mon[92072]: pgmap v9724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:01:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:23 smithi122 ceph-mon[125440]: pgmap v9724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:01:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:23 smithi136 ceph-mon[125702]: pgmap v9724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:01:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:25 smithi057 ceph-mon[92072]: pgmap v9725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:01:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:25 smithi122 ceph-mon[125440]: pgmap v9725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:01:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:25 smithi136 ceph-mon[125702]: pgmap v9725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:01:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:27 smithi057 ceph-mon[92072]: pgmap v9726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T16:01:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:27 smithi122 ceph-mon[125440]: pgmap v9726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T16:01:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:27 smithi136 ceph-mon[125702]: pgmap v9726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T16:01:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:29 smithi057 ceph-mon[92072]: pgmap v9727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:01:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:29 smithi122 ceph-mon[125440]: pgmap v9727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:01:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:29 smithi136 ceph-mon[125702]: pgmap v9727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:01:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:31 smithi057 ceph-mon[92072]: pgmap v9728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:31 smithi122 ceph-mon[125440]: pgmap v9728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:31 smithi136 ceph-mon[125702]: pgmap v9728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:32.933+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:01:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:32.933+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:01:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:32.933+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:01:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:32.933+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:01:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:32.933+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:01:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:33 smithi057 ceph-mon[92072]: pgmap v9729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:33 smithi122 ceph-mon[125440]: pgmap v9729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:33 smithi136 ceph-mon[125702]: pgmap v9729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:35 smithi057 ceph-mon[92072]: pgmap v9730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:35 smithi122 ceph-mon[125440]: pgmap v9730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:35 smithi136 ceph-mon[125702]: pgmap v9730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:37 smithi057 ceph-mon[92072]: pgmap v9731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:37 smithi122 ceph-mon[125440]: pgmap v9731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:37 smithi136 ceph-mon[125702]: pgmap v9731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:39 smithi057 ceph-mon[92072]: pgmap v9732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:39 smithi122 ceph-mon[125440]: pgmap v9732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:39 smithi136 ceph-mon[125702]: pgmap v9732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:41 smithi057 ceph-mon[92072]: pgmap v9733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:41 smithi122 ceph-mon[125440]: pgmap v9733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:41 smithi136 ceph-mon[125702]: pgmap v9733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:43 smithi057 ceph-mon[92072]: pgmap v9734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:43 smithi122 ceph-mon[125440]: pgmap v9734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:43 smithi136 ceph-mon[125702]: pgmap v9734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:45 smithi057 ceph-mon[92072]: pgmap v9735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:45 smithi122 ceph-mon[125440]: pgmap v9735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:45 smithi136 ceph-mon[125702]: pgmap v9735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:47 smithi057 ceph-mon[92072]: pgmap v9736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:47 smithi122 ceph-mon[125440]: pgmap v9736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:47 smithi136 ceph-mon[125702]: pgmap v9736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:47.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:47.944+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:01:47.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:47.945+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:01:47.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:47.945+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:01:47.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:47.945+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:01:47.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:01:47.945+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:01:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:49 smithi057 ceph-mon[92072]: pgmap v9737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:49 smithi122 ceph-mon[125440]: pgmap v9737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:49 smithi136 ceph-mon[125702]: pgmap v9737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:51 smithi057 ceph-mon[92072]: pgmap v9738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:51 smithi122 ceph-mon[125440]: pgmap v9738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:51 smithi136 ceph-mon[125702]: pgmap v9738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:53 smithi057 ceph-mon[92072]: pgmap v9739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:53 smithi122 ceph-mon[125440]: pgmap v9739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:53 smithi136 ceph-mon[125702]: pgmap v9739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:55 smithi057 ceph-mon[92072]: pgmap v9740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:55 smithi122 ceph-mon[125440]: pgmap v9740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:55 smithi136 ceph-mon[125702]: pgmap v9740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:57 smithi057 ceph-mon[92072]: pgmap v9741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:57 smithi122 ceph-mon[125440]: pgmap v9741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:57 smithi136 ceph-mon[125702]: pgmap v9741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:01:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:01:59 smithi057 ceph-mon[92072]: pgmap v9742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:01:59 smithi122 ceph-mon[125440]: pgmap v9742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:01:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:01:59 smithi136 ceph-mon[125702]: pgmap v9742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:01 smithi057 ceph-mon[92072]: pgmap v9743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:01 smithi122 ceph-mon[125440]: pgmap v9743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:01 smithi136 ceph-mon[125702]: pgmap v9743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:02.960+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:02:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:02.961+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:02:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:02.961+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:02:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:02.961+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:02:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:02.961+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:02:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:03 smithi122 ceph-mon[125440]: pgmap v9744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:02:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:03 smithi136 ceph-mon[125702]: pgmap v9744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:02:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:03 smithi057 ceph-mon[92072]: pgmap v9744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:02:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:05 smithi122 ceph-mon[125440]: pgmap v9745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:02:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:05 smithi136 ceph-mon[125702]: pgmap v9745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:02:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:05 smithi057 ceph-mon[92072]: pgmap v9745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:02:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:07 smithi122 ceph-mon[125440]: pgmap v9746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:02:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:07 smithi136 ceph-mon[125702]: pgmap v9746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:02:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:07 smithi057 ceph-mon[92072]: pgmap v9746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:02:08.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:02:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:02:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:02:09.487 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:09 smithi057 ceph-mon[92072]: pgmap v9747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:02:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:09 smithi136 ceph-mon[125702]: pgmap v9747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:02:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:09 smithi122 ceph-mon[125440]: pgmap v9747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:02:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:10.987+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:02:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:10.987+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:02:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:10.988+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 142 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:02:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:10.988+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 143 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:02:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:11 smithi136 ceph-mon[125702]: pgmap v9748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:02:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:02:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:02:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:02:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:02:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:02:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:11 smithi057 ceph-mon[92072]: pgmap v9748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:02:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:02:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:02:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:02:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:02:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:02:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:11 smithi122 ceph-mon[125440]: pgmap v9748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:02:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:02:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:02:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:02:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:02:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:02:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:12 smithi136 ceph-mon[125702]: osdmap e681: 12 total, 12 up, 12 in 2023-03-02T16:02:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:12 smithi057 ceph-mon[92072]: osdmap e681: 12 total, 12 up, 12 in 2023-03-02T16:02:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:12 smithi122 ceph-mon[125440]: osdmap e681: 12 total, 12 up, 12 in 2023-03-02T16:02:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:13 smithi136 ceph-mon[125702]: pgmap v9750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:02:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:13 smithi057 ceph-mon[92072]: pgmap v9750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:02:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:13 smithi122 ceph-mon[125440]: pgmap v9750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:02:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:15 smithi057 ceph-mon[92072]: pgmap v9751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:02:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:15 smithi057 ceph-mon[92072]: osdmap e682: 12 total, 12 up, 12 in 2023-03-02T16:02:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:15 smithi122 ceph-mon[125440]: pgmap v9751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:02:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:15 smithi122 ceph-mon[125440]: osdmap e682: 12 total, 12 up, 12 in 2023-03-02T16:02:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:15 smithi136 ceph-mon[125702]: pgmap v9751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:02:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:15 smithi136 ceph-mon[125702]: osdmap e682: 12 total, 12 up, 12 in 2023-03-02T16:02:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:17 smithi057 ceph-mon[92072]: pgmap v9753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:02:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:17 smithi122 ceph-mon[125440]: pgmap v9753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:02:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:17 smithi136 ceph-mon[125702]: pgmap v9753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:02:17.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:17.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:02:17.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:17.975+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:02:17.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:17.975+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:02:17.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:17.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:02:17.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:17.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:02:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:19 smithi057 ceph-mon[92072]: pgmap v9754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:02:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:19 smithi122 ceph-mon[125440]: pgmap v9754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:02:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:19 smithi136 ceph-mon[125702]: pgmap v9754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:02:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:21 smithi057 ceph-mon[92072]: pgmap v9755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T16:02:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:21 smithi122 ceph-mon[125440]: pgmap v9755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T16:02:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:21 smithi136 ceph-mon[125702]: pgmap v9755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T16:02:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:23 smithi057 ceph-mon[92072]: pgmap v9756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:02:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:23 smithi122 ceph-mon[125440]: pgmap v9756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:02:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:23 smithi136 ceph-mon[125702]: pgmap v9756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:02:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:25 smithi057 ceph-mon[92072]: pgmap v9757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:02:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:25 smithi122 ceph-mon[125440]: pgmap v9757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:02:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:25 smithi136 ceph-mon[125702]: pgmap v9757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:02:27.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:27 smithi057 ceph-mon[92072]: pgmap v9758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:02:27.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:27 smithi122 ceph-mon[125440]: pgmap v9758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:02:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:27 smithi136 ceph-mon[125702]: pgmap v9758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:02:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:29 smithi057 ceph-mon[92072]: pgmap v9759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:02:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:29 smithi122 ceph-mon[125440]: pgmap v9759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:02:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:29 smithi136 ceph-mon[125702]: pgmap v9759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:02:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:31 smithi057 ceph-mon[92072]: pgmap v9760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:31 smithi122 ceph-mon[125440]: pgmap v9760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:31 smithi136 ceph-mon[125702]: pgmap v9760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:32.986 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:32.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:02:32.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:32.986+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:02:32.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:32.986+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:02:32.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:32.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:02:32.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:32.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:02:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:33 smithi057 ceph-mon[92072]: pgmap v9761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:33 smithi122 ceph-mon[125440]: pgmap v9761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:33 smithi136 ceph-mon[125702]: pgmap v9761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:35 smithi057 ceph-mon[92072]: pgmap v9762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:02:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:35 smithi122 ceph-mon[125440]: pgmap v9762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:02:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:35 smithi136 ceph-mon[125702]: pgmap v9762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:02:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:37 smithi057 ceph-mon[92072]: pgmap v9763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:02:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:37 smithi122 ceph-mon[125440]: pgmap v9763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:02:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:37 smithi136 ceph-mon[125702]: pgmap v9763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:02:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:39 smithi057 ceph-mon[92072]: pgmap v9764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:39 smithi122 ceph-mon[125440]: pgmap v9764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:39 smithi136 ceph-mon[125702]: pgmap v9764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:41 smithi057 ceph-mon[92072]: pgmap v9765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:02:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:41 smithi122 ceph-mon[125440]: pgmap v9765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:02:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:41 smithi136 ceph-mon[125702]: pgmap v9765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:02:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:43 smithi057 ceph-mon[92072]: pgmap v9766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:43 smithi122 ceph-mon[125440]: pgmap v9766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:43 smithi136 ceph-mon[125702]: pgmap v9766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:45 smithi057 ceph-mon[92072]: pgmap v9767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:45 smithi122 ceph-mon[125440]: pgmap v9767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:45 smithi136 ceph-mon[125702]: pgmap v9767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:47 smithi057 ceph-mon[92072]: pgmap v9768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:47 smithi122 ceph-mon[125440]: pgmap v9768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:47 smithi136 ceph-mon[125702]: pgmap v9768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:47.993+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:02:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:47.993+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:02:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:47.993+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:02:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:47.993+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:02:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:02:47.993+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:02:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:49 smithi057 ceph-mon[92072]: pgmap v9769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:49 smithi122 ceph-mon[125440]: pgmap v9769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:49 smithi136 ceph-mon[125702]: pgmap v9769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:51 smithi057 ceph-mon[92072]: pgmap v9770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:51 smithi122 ceph-mon[125440]: pgmap v9770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:51 smithi136 ceph-mon[125702]: pgmap v9770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:53 smithi122 ceph-mon[125440]: pgmap v9771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:53 smithi136 ceph-mon[125702]: pgmap v9771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:53 smithi057 ceph-mon[92072]: pgmap v9771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:55 smithi122 ceph-mon[125440]: pgmap v9772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:55 smithi136 ceph-mon[125702]: pgmap v9772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:55 smithi057 ceph-mon[92072]: pgmap v9772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:57 smithi122 ceph-mon[125440]: pgmap v9773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:57 smithi136 ceph-mon[125702]: pgmap v9773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:57 smithi057 ceph-mon[92072]: pgmap v9773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:02:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:02:59 smithi122 ceph-mon[125440]: pgmap v9774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:02:59 smithi136 ceph-mon[125702]: pgmap v9774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:02:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:02:59 smithi057 ceph-mon[92072]: pgmap v9774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:01 smithi122 ceph-mon[125440]: pgmap v9775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:01 smithi136 ceph-mon[125702]: pgmap v9775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:01 smithi057 ceph-mon[92072]: pgmap v9775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:03.008+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:03:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:03.008+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:03:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:03.008+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:03:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:03.008+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:03:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:03.008+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:03:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:03 smithi136 ceph-mon[125702]: pgmap v9776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:03:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:03 smithi057 ceph-mon[92072]: pgmap v9776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:03:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:03 smithi122 ceph-mon[125440]: pgmap v9776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:03:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:05 smithi136 ceph-mon[125702]: pgmap v9777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:03:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:05 smithi057 ceph-mon[92072]: pgmap v9777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:03:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:05 smithi122 ceph-mon[125440]: pgmap v9777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:03:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:07 smithi136 ceph-mon[125702]: pgmap v9778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:03:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:07 smithi136 ceph-mon[125702]: osdmap e683: 12 total, 12 up, 12 in 2023-03-02T16:03:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:07 smithi057 ceph-mon[92072]: pgmap v9778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:03:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:07 smithi057 ceph-mon[92072]: osdmap e683: 12 total, 12 up, 12 in 2023-03-02T16:03:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:07 smithi122 ceph-mon[125440]: pgmap v9778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:03:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:07 smithi122 ceph-mon[125440]: osdmap e683: 12 total, 12 up, 12 in 2023-03-02T16:03:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:09 smithi136 ceph-mon[125702]: pgmap v9780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:03:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:09 smithi057 ceph-mon[92072]: pgmap v9780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:03:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:09 smithi122 ceph-mon[125440]: pgmap v9780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:03:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:11 smithi136 ceph-mon[125702]: pgmap v9781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:03:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:03:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:11 smithi057 ceph-mon[92072]: pgmap v9781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:03:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:03:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:11 smithi122 ceph-mon[125440]: pgmap v9781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:03:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:03:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:13 smithi122 ceph-mon[125440]: pgmap v9782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:03:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:13 smithi136 ceph-mon[125702]: pgmap v9782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:03:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:13 smithi057 ceph-mon[92072]: pgmap v9782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:03:15.194 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:15 smithi122 ceph-mon[125440]: pgmap v9783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:03:15.194 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:15 smithi122 ceph-mon[125440]: osdmap e684: 12 total, 12 up, 12 in 2023-03-02T16:03:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:15 smithi057 ceph-mon[92072]: pgmap v9783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:03:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:15 smithi057 ceph-mon[92072]: osdmap e684: 12 total, 12 up, 12 in 2023-03-02T16:03:15.522 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:15 smithi136 ceph-mon[125702]: pgmap v9783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:03:15.522 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:15 smithi136 ceph-mon[125702]: osdmap e684: 12 total, 12 up, 12 in 2023-03-02T16:03:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:17.507 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:17 smithi136 ceph-mon[125702]: pgmap v9785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:03:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:17 smithi057 ceph-mon[92072]: pgmap v9785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:03:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:17 smithi122 ceph-mon[125440]: pgmap v9785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:03:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:18.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:03:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:18.019+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:03:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:18.019+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:03:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:18.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:03:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:18.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:03:18.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:03:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:03:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:18.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:18.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:18.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:03:18.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:03:18.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:03:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:03:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:03:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:19 smithi136 ceph-mon[125702]: pgmap v9786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:03:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:19 smithi057 ceph-mon[92072]: pgmap v9786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:03:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:19 smithi122 ceph-mon[125440]: pgmap v9786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:03:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:21 smithi136 ceph-mon[125702]: pgmap v9787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:03:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:21 smithi057 ceph-mon[92072]: pgmap v9787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:03:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:21 smithi122 ceph-mon[125440]: pgmap v9787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:03:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:23 smithi136 ceph-mon[125702]: pgmap v9788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:03:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:23 smithi057 ceph-mon[92072]: pgmap v9788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:03:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:23 smithi122 ceph-mon[125440]: pgmap v9788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:03:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:25 smithi136 ceph-mon[125702]: pgmap v9789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:03:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:25 smithi057 ceph-mon[92072]: pgmap v9789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:03:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:25 smithi122 ceph-mon[125440]: pgmap v9789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:03:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:27 smithi136 ceph-mon[125702]: pgmap v9790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:27 smithi057 ceph-mon[92072]: pgmap v9790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:27 smithi122 ceph-mon[125440]: pgmap v9790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:29 smithi136 ceph-mon[125702]: pgmap v9791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:29 smithi057 ceph-mon[92072]: pgmap v9791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:29 smithi122 ceph-mon[125440]: pgmap v9791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:31 smithi136 ceph-mon[125702]: pgmap v9792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:31 smithi057 ceph-mon[92072]: pgmap v9792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:31 smithi122 ceph-mon[125440]: pgmap v9792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:33.033+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:03:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:33.033+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:03:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:33.033+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:03:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:33.033+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:03:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:33.033+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:03:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:33 smithi136 ceph-mon[125702]: pgmap v9793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:33 smithi057 ceph-mon[92072]: pgmap v9793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:33 smithi122 ceph-mon[125440]: pgmap v9793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:35 smithi136 ceph-mon[125702]: pgmap v9794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:35 smithi057 ceph-mon[92072]: pgmap v9794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:35 smithi122 ceph-mon[125440]: pgmap v9794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:37 smithi057 ceph-mon[92072]: pgmap v9795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:37 smithi122 ceph-mon[125440]: pgmap v9795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:37 smithi136 ceph-mon[125702]: pgmap v9795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:38 smithi057 ceph-mon[92072]: pgmap v9796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:38 smithi122 ceph-mon[125440]: pgmap v9796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:38 smithi136 ceph-mon[125702]: pgmap v9796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:41 smithi057 ceph-mon[92072]: pgmap v9797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:41 smithi122 ceph-mon[125440]: pgmap v9797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:41 smithi136 ceph-mon[125702]: pgmap v9797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:43 smithi057 ceph-mon[92072]: pgmap v9798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:43 smithi122 ceph-mon[125440]: pgmap v9798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:43 smithi136 ceph-mon[125702]: pgmap v9798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:45 smithi057 ceph-mon[92072]: pgmap v9799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:45 smithi122 ceph-mon[125440]: pgmap v9799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:45 smithi136 ceph-mon[125702]: pgmap v9799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:47 smithi057 ceph-mon[92072]: pgmap v9800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:47 smithi122 ceph-mon[125440]: pgmap v9800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:47 smithi136 ceph-mon[125702]: pgmap v9800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:48.045+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:03:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:48.045+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:03:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:48.045+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:03:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:48.045+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:03:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:03:48.045+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:03:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:49 smithi057 ceph-mon[92072]: pgmap v9801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:49 smithi122 ceph-mon[125440]: pgmap v9801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:49 smithi136 ceph-mon[125702]: pgmap v9801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:51 smithi057 ceph-mon[92072]: pgmap v9802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:51 smithi122 ceph-mon[125440]: pgmap v9802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:51 smithi136 ceph-mon[125702]: pgmap v9802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:53 smithi057 ceph-mon[92072]: pgmap v9803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:53 smithi122 ceph-mon[125440]: pgmap v9803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:53 smithi136 ceph-mon[125702]: pgmap v9803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:55 smithi057 ceph-mon[92072]: pgmap v9804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:55 smithi122 ceph-mon[125440]: pgmap v9804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:55 smithi136 ceph-mon[125702]: pgmap v9804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:57 smithi057 ceph-mon[92072]: pgmap v9805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:57 smithi122 ceph-mon[125440]: pgmap v9805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:57 smithi136 ceph-mon[125702]: pgmap v9805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:03:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:03:59 smithi057 ceph-mon[92072]: pgmap v9806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:03:59 smithi122 ceph-mon[125440]: pgmap v9806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:03:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:03:59 smithi136 ceph-mon[125702]: pgmap v9806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:01 smithi057 ceph-mon[92072]: pgmap v9807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:01 smithi122 ceph-mon[125440]: pgmap v9807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:01 smithi136 ceph-mon[125702]: pgmap v9807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:03.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:03.056+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:04:03.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:03.056+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:04:03.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:03.056+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:04:03.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:03.056+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:04:03.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:03.056+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:04:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:03 smithi057 ceph-mon[92072]: pgmap v9808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:04:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:03 smithi122 ceph-mon[125440]: pgmap v9808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:04:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:03 smithi136 ceph-mon[125702]: pgmap v9808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:04:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:05 smithi057 ceph-mon[92072]: pgmap v9809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:04:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:05 smithi122 ceph-mon[125440]: pgmap v9809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:04:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:05 smithi136 ceph-mon[125702]: pgmap v9809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:04:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:07 smithi122 ceph-mon[125440]: pgmap v9810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:04:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:07 smithi122 ceph-mon[125440]: osdmap e685: 12 total, 12 up, 12 in 2023-03-02T16:04:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:07 smithi136 ceph-mon[125702]: pgmap v9810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:04:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:07 smithi136 ceph-mon[125702]: osdmap e685: 12 total, 12 up, 12 in 2023-03-02T16:04:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:07 smithi057 ceph-mon[92072]: pgmap v9810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:04:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:07 smithi057 ceph-mon[92072]: osdmap e685: 12 total, 12 up, 12 in 2023-03-02T16:04:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:09 smithi122 ceph-mon[125440]: pgmap v9812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:04:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:09 smithi136 ceph-mon[125702]: pgmap v9812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:04:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:09 smithi057 ceph-mon[92072]: pgmap v9812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:04:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:11 smithi136 ceph-mon[125702]: pgmap v9813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:04:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:11 smithi057 ceph-mon[92072]: pgmap v9813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:04:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:11 smithi122 ceph-mon[125440]: pgmap v9813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:04:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:13 smithi136 ceph-mon[125702]: pgmap v9814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:04:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:13 smithi057 ceph-mon[92072]: pgmap v9814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:04:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:13 smithi122 ceph-mon[125440]: pgmap v9814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:04:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:15 smithi057 ceph-mon[92072]: pgmap v9815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:04:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:15 smithi057 ceph-mon[92072]: osdmap e686: 12 total, 12 up, 12 in 2023-03-02T16:04:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:15 smithi122 ceph-mon[125440]: pgmap v9815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:04:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:15 smithi122 ceph-mon[125440]: osdmap e686: 12 total, 12 up, 12 in 2023-03-02T16:04:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:15 smithi136 ceph-mon[125702]: pgmap v9815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:04:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:15 smithi136 ceph-mon[125702]: osdmap e686: 12 total, 12 up, 12 in 2023-03-02T16:04:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:17 smithi057 ceph-mon[92072]: pgmap v9817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:04:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:17 smithi122 ceph-mon[125440]: pgmap v9817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:04:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:17 smithi136 ceph-mon[125702]: pgmap v9817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:04:18.058 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:18.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:04:18.059 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:18.058+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:04:18.059 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:18.058+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:04:18.059 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:18.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:04:18.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:18.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:04:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:04:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:04:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:04:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:19 smithi057 ceph-mon[92072]: pgmap v9818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:04:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:04:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:04:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:04:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:19 smithi122 ceph-mon[125440]: pgmap v9818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:04:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:04:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:04:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:04:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:19 smithi136 ceph-mon[125702]: pgmap v9818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:04:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:04:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:04:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:04:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:21 smithi057 ceph-mon[92072]: pgmap v9819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:04:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:21 smithi122 ceph-mon[125440]: pgmap v9819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:04:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:21 smithi136 ceph-mon[125702]: pgmap v9819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:04:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:23 smithi057 ceph-mon[92072]: pgmap v9820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:04:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:23 smithi122 ceph-mon[125440]: pgmap v9820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:04:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:23 smithi136 ceph-mon[125702]: pgmap v9820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:04:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:25 smithi057 ceph-mon[92072]: pgmap v9821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:04:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:25 smithi122 ceph-mon[125440]: pgmap v9821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:04:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:25 smithi136 ceph-mon[125702]: pgmap v9821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:04:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:26.007+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:04:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:26.007+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:04:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:26.007+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 144 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:04:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:26.007+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 143 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:04:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:27 smithi057 ceph-mon[92072]: pgmap v9822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:27 smithi122 ceph-mon[125440]: pgmap v9822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:27 smithi136 ceph-mon[125702]: pgmap v9822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:29 smithi057 ceph-mon[92072]: pgmap v9823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:29 smithi122 ceph-mon[125440]: pgmap v9823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:29 smithi136 ceph-mon[125702]: pgmap v9823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:31 smithi122 ceph-mon[125440]: pgmap v9824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:31 smithi136 ceph-mon[125702]: pgmap v9824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:31 smithi057 ceph-mon[92072]: pgmap v9824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:33.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:33.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:04:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:33.066+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:04:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:33.066+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:04:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:33.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:04:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:33.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:04:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:33 smithi122 ceph-mon[125440]: pgmap v9825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:33 smithi136 ceph-mon[125702]: pgmap v9825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:33 smithi057 ceph-mon[92072]: pgmap v9825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:35 smithi122 ceph-mon[125440]: pgmap v9826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:35 smithi136 ceph-mon[125702]: pgmap v9826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:35 smithi057 ceph-mon[92072]: pgmap v9826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:37 smithi122 ceph-mon[125440]: pgmap v9827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:37 smithi136 ceph-mon[125702]: pgmap v9827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:37 smithi057 ceph-mon[92072]: pgmap v9827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:39 smithi122 ceph-mon[125440]: pgmap v9828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:39 smithi136 ceph-mon[125702]: pgmap v9828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:39 smithi057 ceph-mon[92072]: pgmap v9828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:41 smithi136 ceph-mon[125702]: pgmap v9829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:41 smithi057 ceph-mon[92072]: pgmap v9829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:41 smithi122 ceph-mon[125440]: pgmap v9829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:43 smithi136 ceph-mon[125702]: pgmap v9830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:43 smithi057 ceph-mon[92072]: pgmap v9830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:43 smithi122 ceph-mon[125440]: pgmap v9830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:45 smithi136 ceph-mon[125702]: pgmap v9831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:45 smithi057 ceph-mon[92072]: pgmap v9831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:45 smithi122 ceph-mon[125440]: pgmap v9831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:47 smithi136 ceph-mon[125702]: pgmap v9832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:47 smithi057 ceph-mon[92072]: pgmap v9832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:47 smithi122 ceph-mon[125440]: pgmap v9832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:48.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:48.072+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:04:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:48.073+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:04:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:48.073+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:04:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:48.073+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:04:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:04:48.073+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:04:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:49 smithi136 ceph-mon[125702]: pgmap v9833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:49 smithi057 ceph-mon[92072]: pgmap v9833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:49 smithi122 ceph-mon[125440]: pgmap v9833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:51 smithi136 ceph-mon[125702]: pgmap v9834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:51 smithi057 ceph-mon[92072]: pgmap v9834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:51 smithi122 ceph-mon[125440]: pgmap v9834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:53 smithi136 ceph-mon[125702]: pgmap v9835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:53 smithi057 ceph-mon[92072]: pgmap v9835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:53 smithi122 ceph-mon[125440]: pgmap v9835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:55 smithi136 ceph-mon[125702]: pgmap v9836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:55 smithi057 ceph-mon[92072]: pgmap v9836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:55 smithi122 ceph-mon[125440]: pgmap v9836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:57 smithi136 ceph-mon[125702]: pgmap v9837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:57 smithi057 ceph-mon[92072]: pgmap v9837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:57 smithi122 ceph-mon[125440]: pgmap v9837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:04:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:04:59 smithi136 ceph-mon[125702]: pgmap v9838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:04:59 smithi057 ceph-mon[92072]: pgmap v9838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:04:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:04:59 smithi122 ceph-mon[125440]: pgmap v9838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:01 smithi136 ceph-mon[125702]: pgmap v9839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:01 smithi057 ceph-mon[92072]: pgmap v9839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:01 smithi122 ceph-mon[125440]: pgmap v9839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:03.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:03.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:05:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:03.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:05:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:03.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:05:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:03.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:05:03.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:03.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:05:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:03 smithi136 ceph-mon[125702]: pgmap v9840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:05:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:03 smithi057 ceph-mon[92072]: pgmap v9840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:05:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:03 smithi122 ceph-mon[125440]: pgmap v9840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:05:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:05 smithi136 ceph-mon[125702]: pgmap v9841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:05:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:05 smithi057 ceph-mon[92072]: pgmap v9841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:05:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:05 smithi122 ceph-mon[125440]: pgmap v9841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:05:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:07 smithi136 ceph-mon[125702]: pgmap v9842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:05:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:07 smithi136 ceph-mon[125702]: osdmap e687: 12 total, 12 up, 12 in 2023-03-02T16:05:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:07 smithi057 ceph-mon[92072]: pgmap v9842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:05:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:07 smithi057 ceph-mon[92072]: osdmap e687: 12 total, 12 up, 12 in 2023-03-02T16:05:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:07 smithi122 ceph-mon[125440]: pgmap v9842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:05:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:07 smithi122 ceph-mon[125440]: osdmap e687: 12 total, 12 up, 12 in 2023-03-02T16:05:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:09 smithi136 ceph-mon[125702]: pgmap v9844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:05:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:09 smithi057 ceph-mon[92072]: pgmap v9844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:05:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:09 smithi122 ceph-mon[125440]: pgmap v9844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:05:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:11.014+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:05:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:11.014+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:05:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:11.015+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 145 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:05:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:11.015+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 144 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:05:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:11 smithi136 ceph-mon[125702]: pgmap v9845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:05:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:11 smithi057 ceph-mon[92072]: pgmap v9845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:05:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:11 smithi122 ceph-mon[125440]: pgmap v9845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:05:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:13 smithi136 ceph-mon[125702]: pgmap v9846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:05:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:13 smithi057 ceph-mon[92072]: pgmap v9846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:05:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:13 smithi122 ceph-mon[125440]: pgmap v9846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:05:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:15 smithi057 ceph-mon[92072]: pgmap v9847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:05:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:15 smithi057 ceph-mon[92072]: osdmap e688: 12 total, 12 up, 12 in 2023-03-02T16:05:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:15 smithi122 ceph-mon[125440]: pgmap v9847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:05:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:15 smithi122 ceph-mon[125440]: osdmap e688: 12 total, 12 up, 12 in 2023-03-02T16:05:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:15 smithi136 ceph-mon[125702]: pgmap v9847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:05:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:15 smithi136 ceph-mon[125702]: osdmap e688: 12 total, 12 up, 12 in 2023-03-02T16:05:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:17 smithi057 ceph-mon[92072]: pgmap v9849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:05:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:17 smithi122 ceph-mon[125440]: pgmap v9849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:05:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:17 smithi136 ceph-mon[125702]: pgmap v9849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:05:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:18.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:05:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:18.094+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:05:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:18.094+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:05:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:18.094+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:05:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:18.094+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:05:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:19 smithi057 ceph-mon[92072]: pgmap v9850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:05:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:05:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:19 smithi122 ceph-mon[125440]: pgmap v9850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:05:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:05:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:19 smithi136 ceph-mon[125702]: pgmap v9850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:05:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:05:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:05:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:05:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:20 smithi136 ceph-mon[125702]: pgmap v9851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:05:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:05:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:05:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:20 smithi057 ceph-mon[92072]: pgmap v9851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:05:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:05:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:05:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:05:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:20 smithi122 ceph-mon[125440]: pgmap v9851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:05:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:22 smithi136 ceph-mon[125702]: pgmap v9852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:05:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:22 smithi057 ceph-mon[92072]: pgmap v9852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:05:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:22 smithi122 ceph-mon[125440]: pgmap v9852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:05:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:25 smithi057 ceph-mon[92072]: pgmap v9853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:05:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:25 smithi122 ceph-mon[125440]: pgmap v9853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:05:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:25 smithi136 ceph-mon[125702]: pgmap v9853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:05:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:27 smithi057 ceph-mon[92072]: pgmap v9854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:27 smithi122 ceph-mon[125440]: pgmap v9854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:27 smithi136 ceph-mon[125702]: pgmap v9854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:29 smithi057 ceph-mon[92072]: pgmap v9855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:29 smithi122 ceph-mon[125440]: pgmap v9855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:29 smithi136 ceph-mon[125702]: pgmap v9855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:31 smithi057 ceph-mon[92072]: pgmap v9856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:31 smithi122 ceph-mon[125440]: pgmap v9856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:31 smithi136 ceph-mon[125702]: pgmap v9856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:33.105+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:05:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:33.105+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:05:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:33.105+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:05:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:33.105+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:05:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:33.105+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:05:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:33 smithi057 ceph-mon[92072]: pgmap v9857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:33 smithi122 ceph-mon[125440]: pgmap v9857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:33 smithi136 ceph-mon[125702]: pgmap v9857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:35 smithi057 ceph-mon[92072]: pgmap v9858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:35 smithi122 ceph-mon[125440]: pgmap v9858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:35 smithi136 ceph-mon[125702]: pgmap v9858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:37 smithi122 ceph-mon[125440]: pgmap v9859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:37 smithi136 ceph-mon[125702]: pgmap v9859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:37 smithi057 ceph-mon[92072]: pgmap v9859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:39 smithi122 ceph-mon[125440]: pgmap v9860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:39 smithi136 ceph-mon[125702]: pgmap v9860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:39 smithi057 ceph-mon[92072]: pgmap v9860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:41 smithi122 ceph-mon[125440]: pgmap v9861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:41 smithi136 ceph-mon[125702]: pgmap v9861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:41 smithi057 ceph-mon[92072]: pgmap v9861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:43 smithi122 ceph-mon[125440]: pgmap v9862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:43 smithi136 ceph-mon[125702]: pgmap v9862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:43 smithi057 ceph-mon[92072]: pgmap v9862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:45 smithi122 ceph-mon[125440]: pgmap v9863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:45 smithi136 ceph-mon[125702]: pgmap v9863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:45 smithi057 ceph-mon[92072]: pgmap v9863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:47 smithi136 ceph-mon[125702]: pgmap v9864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:47 smithi057 ceph-mon[92072]: pgmap v9864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:47 smithi122 ceph-mon[125440]: pgmap v9864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:48.116+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:05:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:48.116+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:05:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:48.116+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:05:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:48.116+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:05:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:05:48.116+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:05:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:49 smithi136 ceph-mon[125702]: pgmap v9865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:49 smithi057 ceph-mon[92072]: pgmap v9865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:49 smithi122 ceph-mon[125440]: pgmap v9865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:51 smithi136 ceph-mon[125702]: pgmap v9866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:51 smithi057 ceph-mon[92072]: pgmap v9866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:51 smithi122 ceph-mon[125440]: pgmap v9866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:53 smithi136 ceph-mon[125702]: pgmap v9867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:53 smithi057 ceph-mon[92072]: pgmap v9867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:53 smithi122 ceph-mon[125440]: pgmap v9867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:55 smithi136 ceph-mon[125702]: pgmap v9868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:55 smithi057 ceph-mon[92072]: pgmap v9868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:55 smithi122 ceph-mon[125440]: pgmap v9868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:57 smithi136 ceph-mon[125702]: pgmap v9869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:57 smithi057 ceph-mon[92072]: pgmap v9869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:57 smithi122 ceph-mon[125440]: pgmap v9869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:05:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:05:59 smithi136 ceph-mon[125702]: pgmap v9870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:05:59 smithi057 ceph-mon[92072]: pgmap v9870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:05:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:05:59 smithi122 ceph-mon[125440]: pgmap v9870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:01 smithi136 ceph-mon[125702]: pgmap v9871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:01 smithi057 ceph-mon[92072]: pgmap v9871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:01 smithi122 ceph-mon[125440]: pgmap v9871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:03.120+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:06:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:03.121+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:06:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:03.121+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:06:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:03.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:06:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:03.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:06:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:03 smithi136 ceph-mon[125702]: pgmap v9872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:06:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:03 smithi057 ceph-mon[92072]: pgmap v9872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:06:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:03 smithi122 ceph-mon[125440]: pgmap v9872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:06:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:05 smithi136 ceph-mon[125702]: pgmap v9873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:06:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:05 smithi057 ceph-mon[92072]: pgmap v9873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:06:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:05 smithi122 ceph-mon[125440]: pgmap v9873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:06:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:07 smithi136 ceph-mon[125702]: pgmap v9874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:06:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:07 smithi057 ceph-mon[92072]: pgmap v9874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:06:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:07 smithi122 ceph-mon[125440]: pgmap v9874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:06:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:09 smithi136 ceph-mon[125702]: pgmap v9875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:06:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:09 smithi057 ceph-mon[92072]: pgmap v9875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:06:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:09 smithi122 ceph-mon[125440]: pgmap v9875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:06:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:11 smithi136 ceph-mon[125702]: pgmap v9876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:06:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:11 smithi057 ceph-mon[92072]: pgmap v9876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:06:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:11 smithi122 ceph-mon[125440]: pgmap v9876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:06:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:12 smithi136 ceph-mon[125702]: osdmap e689: 12 total, 12 up, 12 in 2023-03-02T16:06:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:12 smithi057 ceph-mon[92072]: osdmap e689: 12 total, 12 up, 12 in 2023-03-02T16:06:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:12 smithi122 ceph-mon[125440]: osdmap e689: 12 total, 12 up, 12 in 2023-03-02T16:06:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:13 smithi136 ceph-mon[125702]: pgmap v9878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:13 smithi057 ceph-mon[92072]: pgmap v9878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:13 smithi122 ceph-mon[125440]: pgmap v9878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:15 smithi057 ceph-mon[92072]: pgmap v9879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:15 smithi057 ceph-mon[92072]: osdmap e690: 12 total, 12 up, 12 in 2023-03-02T16:06:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:15 smithi122 ceph-mon[125440]: pgmap v9879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:15 smithi122 ceph-mon[125440]: osdmap e690: 12 total, 12 up, 12 in 2023-03-02T16:06:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:15 smithi136 ceph-mon[125702]: pgmap v9879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:15 smithi136 ceph-mon[125702]: osdmap e690: 12 total, 12 up, 12 in 2023-03-02T16:06:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:17 smithi057 ceph-mon[92072]: pgmap v9881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:06:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:17 smithi122 ceph-mon[125440]: pgmap v9881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:06:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:17 smithi136 ceph-mon[125702]: pgmap v9881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:06:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:18.132+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:06:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:18.132+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:06:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:18.132+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:06:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:18.132+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:06:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:18.132+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:06:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:19 smithi057 ceph-mon[92072]: pgmap v9882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T16:06:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:19 smithi122 ceph-mon[125440]: pgmap v9882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T16:06:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:19 smithi136 ceph-mon[125702]: pgmap v9882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T16:06:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:06:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:06:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:06:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:21 smithi122 ceph-mon[125440]: pgmap v9883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 353 B/s wr, 12 op/s 2023-03-02T16:06:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:21 smithi136 ceph-mon[125702]: pgmap v9883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 353 B/s wr, 12 op/s 2023-03-02T16:06:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:21 smithi057 ceph-mon[92072]: pgmap v9883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 353 B/s wr, 12 op/s 2023-03-02T16:06:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:23 smithi122 ceph-mon[125440]: pgmap v9884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:23.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:23 smithi136 ceph-mon[125702]: pgmap v9884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:23 smithi057 ceph-mon[92072]: pgmap v9884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:06:25.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:06:25.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 110.8M 2023-03-02T16:06:25.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 116273385: error parsing value: Value '116273385' is below minimum 939524096 2023-03-02T16:06:25.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: pgmap v9885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:25.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:06:25.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:06:25.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:06:25.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:06:25.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:06:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:06:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 110.8M 2023-03-02T16:06:25.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 116273385: error parsing value: Value '116273385' is below minimum 939524096 2023-03-02T16:06:25.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: pgmap v9885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:25.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:06:25.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:06:25.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:06:25.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:06:25.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:06:25.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:06:25.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 110.8M 2023-03-02T16:06:25.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 116273385: error parsing value: Value '116273385' is below minimum 939524096 2023-03-02T16:06:25.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: pgmap v9885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:06:25.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:06:25.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:06:25.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:06:25.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:06:25.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:06:25.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:06:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:27 smithi136 ceph-mon[125702]: pgmap v9886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T16:06:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:27 smithi057 ceph-mon[92072]: pgmap v9886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T16:06:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:27 smithi122 ceph-mon[125440]: pgmap v9886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 173 B/s wr, 8 op/s 2023-03-02T16:06:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:29 smithi136 ceph-mon[125702]: pgmap v9887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T16:06:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:29 smithi057 ceph-mon[92072]: pgmap v9887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T16:06:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:29 smithi122 ceph-mon[125440]: pgmap v9887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T16:06:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:31 smithi122 ceph-mon[125440]: pgmap v9888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:31 smithi136 ceph-mon[125702]: pgmap v9888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:31 smithi057 ceph-mon[92072]: pgmap v9888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:33.148+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:06:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:33.148+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:06:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:33.148+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:06:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:33.148+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:06:33.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:33.148+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:06:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:33 smithi136 ceph-mon[125702]: pgmap v9889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:33 smithi057 ceph-mon[92072]: pgmap v9889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:33 smithi122 ceph-mon[125440]: pgmap v9889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:35 smithi136 ceph-mon[125702]: pgmap v9890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:35 smithi057 ceph-mon[92072]: pgmap v9890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:35 smithi122 ceph-mon[125440]: pgmap v9890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:37 smithi136 ceph-mon[125702]: pgmap v9891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:37 smithi057 ceph-mon[92072]: pgmap v9891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:37 smithi122 ceph-mon[125440]: pgmap v9891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:39 smithi136 ceph-mon[125702]: pgmap v9892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:39 smithi057 ceph-mon[92072]: pgmap v9892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:39 smithi122 ceph-mon[125440]: pgmap v9892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:41 smithi136 ceph-mon[125702]: pgmap v9893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:41 smithi057 ceph-mon[92072]: pgmap v9893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:41 smithi122 ceph-mon[125440]: pgmap v9893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:43 smithi136 ceph-mon[125702]: pgmap v9894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:43 smithi057 ceph-mon[92072]: pgmap v9894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:43 smithi122 ceph-mon[125440]: pgmap v9894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:45 smithi136 ceph-mon[125702]: pgmap v9895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:45 smithi057 ceph-mon[92072]: pgmap v9895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:45 smithi122 ceph-mon[125440]: pgmap v9895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:47 smithi136 ceph-mon[125702]: pgmap v9896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:47 smithi057 ceph-mon[92072]: pgmap v9896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:47 smithi122 ceph-mon[125440]: pgmap v9896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:48.164 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:48.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:06:48.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:48.163+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:06:48.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:48.163+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:06:48.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:48.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:06:48.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:06:48.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:06:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:49 smithi136 ceph-mon[125702]: pgmap v9897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:49 smithi057 ceph-mon[92072]: pgmap v9897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:49 smithi122 ceph-mon[125440]: pgmap v9897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:51 smithi136 ceph-mon[125702]: pgmap v9898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:51 smithi057 ceph-mon[92072]: pgmap v9898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:51 smithi122 ceph-mon[125440]: pgmap v9898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:53 smithi136 ceph-mon[125702]: pgmap v9899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:53 smithi057 ceph-mon[92072]: pgmap v9899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:53 smithi122 ceph-mon[125440]: pgmap v9899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:55 smithi136 ceph-mon[125702]: pgmap v9900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:55 smithi057 ceph-mon[92072]: pgmap v9900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:55 smithi122 ceph-mon[125440]: pgmap v9900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:57 smithi136 ceph-mon[125702]: pgmap v9901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:57 smithi057 ceph-mon[92072]: pgmap v9901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:57 smithi122 ceph-mon[125440]: pgmap v9901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:06:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:06:59 smithi136 ceph-mon[125702]: pgmap v9902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:06:59 smithi057 ceph-mon[92072]: pgmap v9902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:06:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:06:59 smithi122 ceph-mon[125440]: pgmap v9902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:01 smithi136 ceph-mon[125702]: pgmap v9903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:01 smithi057 ceph-mon[92072]: pgmap v9903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:01 smithi122 ceph-mon[125440]: pgmap v9903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:03.178+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:07:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:03.179+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:07:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:03.179+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:07:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:03.179+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:07:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:03.179+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:07:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:03 smithi136 ceph-mon[125702]: pgmap v9904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:07:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:03 smithi057 ceph-mon[92072]: pgmap v9904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:07:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:03 smithi122 ceph-mon[125440]: pgmap v9904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:07:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:05 smithi136 ceph-mon[125702]: pgmap v9905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:07:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:05 smithi057 ceph-mon[92072]: pgmap v9905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:07:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:05 smithi122 ceph-mon[125440]: pgmap v9905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:07:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:07 smithi136 ceph-mon[125702]: pgmap v9906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:07:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:07 smithi057 ceph-mon[92072]: pgmap v9906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:07:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:07 smithi122 ceph-mon[125440]: pgmap v9906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:07:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:09 smithi136 ceph-mon[125702]: pgmap v9907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:07:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:09 smithi057 ceph-mon[92072]: pgmap v9907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:07:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:09 smithi122 ceph-mon[125440]: pgmap v9907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:07:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:11 smithi136 ceph-mon[125702]: pgmap v9908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:07:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:11 smithi057 ceph-mon[92072]: pgmap v9908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:07:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:11 smithi122 ceph-mon[125440]: pgmap v9908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:07:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:12 smithi136 ceph-mon[125702]: osdmap e691: 12 total, 12 up, 12 in 2023-03-02T16:07:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:12 smithi057 ceph-mon[92072]: osdmap e691: 12 total, 12 up, 12 in 2023-03-02T16:07:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:12 smithi122 ceph-mon[125440]: osdmap e691: 12 total, 12 up, 12 in 2023-03-02T16:07:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:13 smithi136 ceph-mon[125702]: pgmap v9910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:07:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:13 smithi057 ceph-mon[92072]: pgmap v9910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:07:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:13 smithi122 ceph-mon[125440]: pgmap v9910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:07:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:15 smithi122 ceph-mon[125440]: pgmap v9911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:07:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:15 smithi122 ceph-mon[125440]: osdmap e692: 12 total, 12 up, 12 in 2023-03-02T16:07:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:15 smithi136 ceph-mon[125702]: pgmap v9911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:07:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:15 smithi136 ceph-mon[125702]: osdmap e692: 12 total, 12 up, 12 in 2023-03-02T16:07:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:15 smithi057 ceph-mon[92072]: pgmap v9911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:07:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:15 smithi057 ceph-mon[92072]: osdmap e692: 12 total, 12 up, 12 in 2023-03-02T16:07:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:17 smithi122 ceph-mon[125440]: pgmap v9913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:07:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:17 smithi136 ceph-mon[125702]: pgmap v9913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:07:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:17 smithi057 ceph-mon[92072]: pgmap v9913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:18.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:18.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:07:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:18.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:07:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:18.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:07:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:18.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:07:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:19 smithi122 ceph-mon[125440]: pgmap v9914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:07:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:19 smithi136 ceph-mon[125702]: pgmap v9914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:07:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:19 smithi057 ceph-mon[92072]: pgmap v9914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:07:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:21 smithi122 ceph-mon[125440]: pgmap v9915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:07:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:21 smithi136 ceph-mon[125702]: pgmap v9915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:07:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:21 smithi057 ceph-mon[92072]: pgmap v9915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:07:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:23 smithi136 ceph-mon[125702]: pgmap v9916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:07:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:23 smithi057 ceph-mon[92072]: pgmap v9916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:07:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:23 smithi122 ceph-mon[125440]: pgmap v9916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:07:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:25 smithi136 ceph-mon[125702]: pgmap v9917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:07:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:07:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:25 smithi057 ceph-mon[92072]: pgmap v9917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:07:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:07:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:25 smithi122 ceph-mon[125440]: pgmap v9917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:07:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:07:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:07:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:07:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:07:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:07:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:07:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:07:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:07:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:07:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:07:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:27 smithi057 ceph-mon[92072]: pgmap v9918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T16:07:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:27 smithi122 ceph-mon[125440]: pgmap v9918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T16:07:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:27 smithi136 ceph-mon[125702]: pgmap v9918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 86 B/s wr, 8 op/s 2023-03-02T16:07:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:29 smithi057 ceph-mon[92072]: pgmap v9919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:07:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:29 smithi122 ceph-mon[125440]: pgmap v9919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:07:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:29 smithi136 ceph-mon[125702]: pgmap v9919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:07:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:31 smithi057 ceph-mon[92072]: pgmap v9920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:31 smithi122 ceph-mon[125440]: pgmap v9920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:31 smithi136 ceph-mon[125702]: pgmap v9920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:33.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:07:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:33.197+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:07:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:33.197+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:07:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:33.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:07:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:33.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:07:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:33 smithi057 ceph-mon[92072]: pgmap v9921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:33 smithi122 ceph-mon[125440]: pgmap v9921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:33 smithi136 ceph-mon[125702]: pgmap v9921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:35 smithi057 ceph-mon[92072]: pgmap v9922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:35 smithi122 ceph-mon[125440]: pgmap v9922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:35 smithi136 ceph-mon[125702]: pgmap v9922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:37 smithi122 ceph-mon[125440]: pgmap v9923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:37 smithi136 ceph-mon[125702]: pgmap v9923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:37 smithi057 ceph-mon[92072]: pgmap v9923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:39 smithi122 ceph-mon[125440]: pgmap v9924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:39 smithi136 ceph-mon[125702]: pgmap v9924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:39 smithi057 ceph-mon[92072]: pgmap v9924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:41 smithi122 ceph-mon[125440]: pgmap v9925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:41 smithi136 ceph-mon[125702]: pgmap v9925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:41 smithi057 ceph-mon[92072]: pgmap v9925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:43 smithi136 ceph-mon[125702]: pgmap v9926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:43 smithi057 ceph-mon[92072]: pgmap v9926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:43 smithi122 ceph-mon[125440]: pgmap v9926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:45 smithi136 ceph-mon[125702]: pgmap v9927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:45 smithi057 ceph-mon[92072]: pgmap v9927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:45 smithi122 ceph-mon[125440]: pgmap v9927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:47 smithi136 ceph-mon[125702]: pgmap v9928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:47 smithi057 ceph-mon[92072]: pgmap v9928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:47 smithi122 ceph-mon[125440]: pgmap v9928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:48.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:48.205+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:07:48.207 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:48.205+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:07:48.207 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:48.205+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:07:48.207 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:48.205+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:07:48.207 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:07:48.205+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:07:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:49 smithi136 ceph-mon[125702]: pgmap v9929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:49 smithi057 ceph-mon[92072]: pgmap v9929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:49 smithi122 ceph-mon[125440]: pgmap v9929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:51 smithi136 ceph-mon[125702]: pgmap v9930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:51 smithi057 ceph-mon[92072]: pgmap v9930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:51 smithi122 ceph-mon[125440]: pgmap v9930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:53 smithi136 ceph-mon[125702]: pgmap v9931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:53 smithi057 ceph-mon[92072]: pgmap v9931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:53 smithi122 ceph-mon[125440]: pgmap v9931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:55 smithi136 ceph-mon[125702]: pgmap v9932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:55 smithi057 ceph-mon[92072]: pgmap v9932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:55 smithi122 ceph-mon[125440]: pgmap v9932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:57 smithi136 ceph-mon[125702]: pgmap v9933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:57 smithi057 ceph-mon[92072]: pgmap v9933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:57 smithi122 ceph-mon[125440]: pgmap v9933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:07:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:07:59 smithi136 ceph-mon[125702]: pgmap v9934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:07:59 smithi057 ceph-mon[92072]: pgmap v9934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:07:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:07:59 smithi122 ceph-mon[125440]: pgmap v9934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:01 smithi136 ceph-mon[125702]: pgmap v9935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:01 smithi057 ceph-mon[92072]: pgmap v9935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:01 smithi122 ceph-mon[125440]: pgmap v9935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:03.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:03.222+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:08:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:03.222+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:08:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:03.222+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:08:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:03.222+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:08:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:03.222+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:08:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:03 smithi136 ceph-mon[125702]: pgmap v9936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:08:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:03 smithi057 ceph-mon[92072]: pgmap v9936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:08:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:03 smithi122 ceph-mon[125440]: pgmap v9936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:08:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:05 smithi136 ceph-mon[125702]: pgmap v9937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:08:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:05 smithi057 ceph-mon[92072]: pgmap v9937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:08:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:05 smithi122 ceph-mon[125440]: pgmap v9937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:08:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:07 smithi136 ceph-mon[125702]: pgmap v9938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:08:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:07 smithi057 ceph-mon[92072]: pgmap v9938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:08:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:07 smithi122 ceph-mon[125440]: pgmap v9938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:08:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:09 smithi136 ceph-mon[125702]: pgmap v9939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:08:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:09 smithi057 ceph-mon[92072]: pgmap v9939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:08:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:09 smithi122 ceph-mon[125440]: pgmap v9939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:08:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:11.040+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:08:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:11.040+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:08:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:11.041+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 146 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:08:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:11.041+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 145 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:08:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:11 smithi136 ceph-mon[125702]: pgmap v9940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:08:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:11 smithi057 ceph-mon[92072]: pgmap v9940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:08:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:11 smithi122 ceph-mon[125440]: pgmap v9940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:08:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:12 smithi136 ceph-mon[125702]: osdmap e693: 12 total, 12 up, 12 in 2023-03-02T16:08:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:12 smithi057 ceph-mon[92072]: osdmap e693: 12 total, 12 up, 12 in 2023-03-02T16:08:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:12 smithi122 ceph-mon[125440]: osdmap e693: 12 total, 12 up, 12 in 2023-03-02T16:08:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:13 smithi136 ceph-mon[125702]: pgmap v9942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:08:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:13 smithi057 ceph-mon[92072]: pgmap v9942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:08:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:13 smithi122 ceph-mon[125440]: pgmap v9942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:08:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:15 smithi136 ceph-mon[125702]: pgmap v9943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:08:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:15 smithi136 ceph-mon[125702]: osdmap e694: 12 total, 12 up, 12 in 2023-03-02T16:08:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:15 smithi057 ceph-mon[92072]: pgmap v9943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:08:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:15 smithi057 ceph-mon[92072]: osdmap e694: 12 total, 12 up, 12 in 2023-03-02T16:08:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:15 smithi122 ceph-mon[125440]: pgmap v9943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:08:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:15 smithi122 ceph-mon[125440]: osdmap e694: 12 total, 12 up, 12 in 2023-03-02T16:08:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:17 smithi136 ceph-mon[125702]: pgmap v9945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:08:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:17 smithi057 ceph-mon[92072]: pgmap v9945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:08:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:17 smithi122 ceph-mon[125440]: pgmap v9945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:08:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:18.237+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:08:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:18.237+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:08:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:18.237+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:08:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:18.237+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:08:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:18.237+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:08:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:19 smithi136 ceph-mon[125702]: pgmap v9946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:08:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:19 smithi057 ceph-mon[92072]: pgmap v9946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:08:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:19 smithi122 ceph-mon[125440]: pgmap v9946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:08:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:21 smithi136 ceph-mon[125702]: pgmap v9947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T16:08:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:21 smithi057 ceph-mon[92072]: pgmap v9947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T16:08:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:21 smithi122 ceph-mon[125440]: pgmap v9947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T16:08:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:23 smithi136 ceph-mon[125702]: pgmap v9948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:08:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:23 smithi057 ceph-mon[92072]: pgmap v9948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:08:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:23 smithi122 ceph-mon[125440]: pgmap v9948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:08:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:25 smithi136 ceph-mon[125702]: pgmap v9949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:08:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:25 smithi057 ceph-mon[92072]: pgmap v9949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:08:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:25 smithi122 ceph-mon[125440]: pgmap v9949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:08:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:08:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:08:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:08:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:08:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:08:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:08:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:08:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:08:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:08:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:27 smithi136 ceph-mon[125702]: pgmap v9950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:08:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:08:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:08:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:08:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:27 smithi057 ceph-mon[92072]: pgmap v9950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:08:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:08:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:08:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:08:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:27 smithi122 ceph-mon[125440]: pgmap v9950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:08:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:08:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:08:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:08:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:29 smithi136 ceph-mon[125702]: pgmap v9951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:08:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:29 smithi057 ceph-mon[92072]: pgmap v9951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:08:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:29 smithi122 ceph-mon[125440]: pgmap v9951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:08:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:31 smithi136 ceph-mon[125702]: pgmap v9952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:31 smithi057 ceph-mon[92072]: pgmap v9952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:31 smithi122 ceph-mon[125440]: pgmap v9952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:33.253+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:08:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:33.253+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:08:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:33.253+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:08:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:33.253+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:08:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:33.253+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:08:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:33 smithi136 ceph-mon[125702]: pgmap v9953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:33 smithi057 ceph-mon[92072]: pgmap v9953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:33 smithi122 ceph-mon[125440]: pgmap v9953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:35 smithi136 ceph-mon[125702]: pgmap v9954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:35 smithi057 ceph-mon[92072]: pgmap v9954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:35 smithi122 ceph-mon[125440]: pgmap v9954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:37 smithi136 ceph-mon[125702]: pgmap v9955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:37 smithi057 ceph-mon[92072]: pgmap v9955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:37 smithi122 ceph-mon[125440]: pgmap v9955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:39 smithi136 ceph-mon[125702]: pgmap v9956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:39 smithi057 ceph-mon[92072]: pgmap v9956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:39 smithi122 ceph-mon[125440]: pgmap v9956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:41 smithi136 ceph-mon[125702]: pgmap v9957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:41 smithi057 ceph-mon[92072]: pgmap v9957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:41 smithi122 ceph-mon[125440]: pgmap v9957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:43 smithi136 ceph-mon[125702]: pgmap v9958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:43 smithi057 ceph-mon[92072]: pgmap v9958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:43 smithi122 ceph-mon[125440]: pgmap v9958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:45 smithi136 ceph-mon[125702]: pgmap v9959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:45 smithi057 ceph-mon[92072]: pgmap v9959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:45 smithi122 ceph-mon[125440]: pgmap v9959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:47 smithi136 ceph-mon[125702]: pgmap v9960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:47 smithi057 ceph-mon[92072]: pgmap v9960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:47 smithi122 ceph-mon[125440]: pgmap v9960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:48.269+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:08:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:48.269+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:08:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:48.269+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:08:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:48.269+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:08:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:08:48.269+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:08:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:49 smithi136 ceph-mon[125702]: pgmap v9961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:49 smithi057 ceph-mon[92072]: pgmap v9961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:49 smithi122 ceph-mon[125440]: pgmap v9961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:51 smithi136 ceph-mon[125702]: pgmap v9962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:51 smithi057 ceph-mon[92072]: pgmap v9962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:51 smithi122 ceph-mon[125440]: pgmap v9962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:53 smithi136 ceph-mon[125702]: pgmap v9963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:53 smithi057 ceph-mon[92072]: pgmap v9963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:53 smithi122 ceph-mon[125440]: pgmap v9963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:55 smithi136 ceph-mon[125702]: pgmap v9964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:55 smithi057 ceph-mon[92072]: pgmap v9964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:55 smithi122 ceph-mon[125440]: pgmap v9964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:57.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:57 smithi136 ceph-mon[125702]: pgmap v9965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:57 smithi057 ceph-mon[92072]: pgmap v9965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:57 smithi122 ceph-mon[125440]: pgmap v9965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:08:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:08:59 smithi136 ceph-mon[125702]: pgmap v9966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:08:59 smithi057 ceph-mon[92072]: pgmap v9966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:08:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:08:59 smithi122 ceph-mon[125440]: pgmap v9966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:01 smithi136 ceph-mon[125702]: pgmap v9967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:01 smithi057 ceph-mon[92072]: pgmap v9967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:01 smithi122 ceph-mon[125440]: pgmap v9967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:03.277+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:09:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:03.277+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:09:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:03.277+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:09:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:03.277+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:09:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:03.277+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:09:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:03 smithi136 ceph-mon[125702]: pgmap v9968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:09:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:03 smithi057 ceph-mon[92072]: pgmap v9968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:09:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:03 smithi122 ceph-mon[125440]: pgmap v9968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:09:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:05 smithi136 ceph-mon[125702]: pgmap v9969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:09:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:05 smithi057 ceph-mon[92072]: pgmap v9969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:09:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:05 smithi122 ceph-mon[125440]: pgmap v9969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:09:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:07 smithi136 ceph-mon[125702]: pgmap v9970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:09:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:07 smithi057 ceph-mon[92072]: pgmap v9970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:09:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:07 smithi122 ceph-mon[125440]: pgmap v9970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:09:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:09 smithi057 ceph-mon[92072]: pgmap v9971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:09:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:09 smithi122 ceph-mon[125440]: pgmap v9971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:09:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:09 smithi136 ceph-mon[125702]: pgmap v9971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:09:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:11 smithi057 ceph-mon[92072]: pgmap v9972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:09:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:11 smithi122 ceph-mon[125440]: pgmap v9972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:09:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:11 smithi136 ceph-mon[125702]: pgmap v9972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:09:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:12 smithi057 ceph-mon[92072]: osdmap e695: 12 total, 12 up, 12 in 2023-03-02T16:09:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:12 smithi122 ceph-mon[125440]: osdmap e695: 12 total, 12 up, 12 in 2023-03-02T16:09:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:12 smithi136 ceph-mon[125702]: osdmap e695: 12 total, 12 up, 12 in 2023-03-02T16:09:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:13 smithi057 ceph-mon[92072]: pgmap v9974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:13 smithi122 ceph-mon[125440]: pgmap v9974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:13 smithi136 ceph-mon[125702]: pgmap v9974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:15 smithi057 ceph-mon[92072]: pgmap v9975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:15 smithi122 ceph-mon[125440]: pgmap v9975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:15 smithi136 ceph-mon[125702]: pgmap v9975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:17 smithi057 ceph-mon[92072]: pgmap v9976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:17 smithi122 ceph-mon[125440]: pgmap v9976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:17 smithi136 ceph-mon[125702]: pgmap v9976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:18.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:18.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:09:18.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:18.282+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:09:18.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:18.282+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:09:18.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:18.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:09:18.284 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:18.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:09:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:19 smithi057 ceph-mon[92072]: pgmap v9977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:19 smithi057 ceph-mon[92072]: osdmap e696: 12 total, 12 up, 12 in 2023-03-02T16:09:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:19 smithi122 ceph-mon[125440]: pgmap v9977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:19 smithi122 ceph-mon[125440]: osdmap e696: 12 total, 12 up, 12 in 2023-03-02T16:09:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:19 smithi136 ceph-mon[125702]: pgmap v9977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:09:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:19 smithi136 ceph-mon[125702]: osdmap e696: 12 total, 12 up, 12 in 2023-03-02T16:09:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:21 smithi057 ceph-mon[92072]: pgmap v9979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T16:09:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:21 smithi122 ceph-mon[125440]: pgmap v9979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T16:09:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:21 smithi136 ceph-mon[125702]: pgmap v9979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T16:09:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:23 smithi057 ceph-mon[92072]: pgmap v9980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:09:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:23 smithi122 ceph-mon[125440]: pgmap v9980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:09:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:23 smithi136 ceph-mon[125702]: pgmap v9980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:09:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:25 smithi057 ceph-mon[92072]: pgmap v9981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:09:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:25 smithi122 ceph-mon[125440]: pgmap v9981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:09:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:25 smithi136 ceph-mon[125702]: pgmap v9981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:09:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:27 smithi057 ceph-mon[92072]: pgmap v9982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:09:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:09:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:27 smithi122 ceph-mon[125440]: pgmap v9982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:09:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:09:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:27 smithi136 ceph-mon[125702]: pgmap v9982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:09:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:09:28.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:09:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:09:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:09:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:09:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:09:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:09:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:09:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:29 smithi136 ceph-mon[125702]: pgmap v9983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:09:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:29 smithi057 ceph-mon[92072]: pgmap v9983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:09:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:29 smithi122 ceph-mon[125440]: pgmap v9983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:09:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:31 smithi136 ceph-mon[125702]: pgmap v9984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:09:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:31 smithi057 ceph-mon[92072]: pgmap v9984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:09:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:31 smithi122 ceph-mon[125440]: pgmap v9984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:09:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:33.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:09:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:33.297+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:09:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:33.297+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:09:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:33.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:09:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:33.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:09:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:33 smithi136 ceph-mon[125702]: pgmap v9985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:33 smithi057 ceph-mon[92072]: pgmap v9985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:33 smithi122 ceph-mon[125440]: pgmap v9985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:35 smithi136 ceph-mon[125702]: pgmap v9986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:35 smithi057 ceph-mon[92072]: pgmap v9986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:35 smithi122 ceph-mon[125440]: pgmap v9986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:37 smithi136 ceph-mon[125702]: pgmap v9987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:37 smithi057 ceph-mon[92072]: pgmap v9987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:37 smithi122 ceph-mon[125440]: pgmap v9987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:39 smithi136 ceph-mon[125702]: pgmap v9988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:39 smithi057 ceph-mon[92072]: pgmap v9988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:39 smithi122 ceph-mon[125440]: pgmap v9988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:41 smithi057 ceph-mon[92072]: pgmap v9989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:41 smithi122 ceph-mon[125440]: pgmap v9989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:41 smithi136 ceph-mon[125702]: pgmap v9989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:43 smithi057 ceph-mon[92072]: pgmap v9990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:43 smithi122 ceph-mon[125440]: pgmap v9990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:43 smithi136 ceph-mon[125702]: pgmap v9990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:45 smithi057 ceph-mon[92072]: pgmap v9991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:45 smithi122 ceph-mon[125440]: pgmap v9991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:45 smithi136 ceph-mon[125702]: pgmap v9991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:47 smithi057 ceph-mon[92072]: pgmap v9992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:47 smithi122 ceph-mon[125440]: pgmap v9992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:47 smithi136 ceph-mon[125702]: pgmap v9992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:48.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:09:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:48.310+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:09:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:48.310+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:09:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:48.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:09:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:09:48.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:09:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:49 smithi057 ceph-mon[92072]: pgmap v9993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:49 smithi122 ceph-mon[125440]: pgmap v9993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:49 smithi136 ceph-mon[125702]: pgmap v9993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:51 smithi057 ceph-mon[92072]: pgmap v9994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:51 smithi122 ceph-mon[125440]: pgmap v9994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:51 smithi136 ceph-mon[125702]: pgmap v9994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:53 smithi057 ceph-mon[92072]: pgmap v9995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:53 smithi122 ceph-mon[125440]: pgmap v9995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:53 smithi136 ceph-mon[125702]: pgmap v9995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:55 smithi057 ceph-mon[92072]: pgmap v9996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:55 smithi122 ceph-mon[125440]: pgmap v9996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:55 smithi136 ceph-mon[125702]: pgmap v9996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:57 smithi057 ceph-mon[92072]: pgmap v9997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:57 smithi122 ceph-mon[125440]: pgmap v9997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:57 smithi136 ceph-mon[125702]: pgmap v9997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:09:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:09:59 smithi057 ceph-mon[92072]: pgmap v9998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:09:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:09:59 smithi122 ceph-mon[125440]: pgmap v9998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:09:59 smithi136 ceph-mon[125702]: pgmap v9998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T16:10:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T16:10:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T16:10:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:01 smithi057 ceph-mon[92072]: pgmap v9999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:01 smithi122 ceph-mon[125440]: pgmap v9999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:01 smithi136 ceph-mon[125702]: pgmap v9999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:03.311+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:10:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:03.312+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:10:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:03.312+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:10:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:03.312+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:10:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:03.312+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:10:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:03 smithi057 ceph-mon[92072]: pgmap v10000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:10:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:03 smithi122 ceph-mon[125440]: pgmap v10000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:10:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:03 smithi136 ceph-mon[125702]: pgmap v10000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:10:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:05 smithi057 ceph-mon[92072]: pgmap v10001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:10:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:05 smithi122 ceph-mon[125440]: pgmap v10001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:10:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:05 smithi136 ceph-mon[125702]: pgmap v10001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:10:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:06 smithi057 ceph-mon[92072]: pgmap v10002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:10:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:06 smithi122 ceph-mon[125440]: pgmap v10002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:10:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:06 smithi136 ceph-mon[125702]: pgmap v10002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:10:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:09 smithi136 ceph-mon[125702]: pgmap v10003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:10:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:09 smithi057 ceph-mon[92072]: pgmap v10003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:10:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:09 smithi122 ceph-mon[125440]: pgmap v10003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:10:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:11 smithi136 ceph-mon[125702]: pgmap v10004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:10:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:11 smithi057 ceph-mon[92072]: pgmap v10004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:10:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:11 smithi122 ceph-mon[125440]: pgmap v10004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:10:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:12 smithi057 ceph-mon[92072]: osdmap e697: 12 total, 12 up, 12 in 2023-03-02T16:10:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:12 smithi136 ceph-mon[125702]: osdmap e697: 12 total, 12 up, 12 in 2023-03-02T16:10:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:12 smithi122 ceph-mon[125440]: osdmap e697: 12 total, 12 up, 12 in 2023-03-02T16:10:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:13 smithi136 ceph-mon[125702]: pgmap v10006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:13 smithi057 ceph-mon[92072]: pgmap v10006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:13 smithi122 ceph-mon[125440]: pgmap v10006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:15 smithi136 ceph-mon[125702]: pgmap v10007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:15 smithi057 ceph-mon[92072]: pgmap v10007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:15 smithi122 ceph-mon[125440]: pgmap v10007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:17 smithi136 ceph-mon[125702]: pgmap v10008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:17 smithi057 ceph-mon[92072]: pgmap v10008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:17 smithi122 ceph-mon[125440]: pgmap v10008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:18.325+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:10:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:18.326+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:10:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:18.326+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:10:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:18.326+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:10:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:18.326+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:10:19.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:19 smithi136 ceph-mon[125702]: pgmap v10009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:19.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:19 smithi136 ceph-mon[125702]: osdmap e698: 12 total, 12 up, 12 in 2023-03-02T16:10:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:19 smithi057 ceph-mon[92072]: pgmap v10009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:19 smithi057 ceph-mon[92072]: osdmap e698: 12 total, 12 up, 12 in 2023-03-02T16:10:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:19 smithi122 ceph-mon[125440]: pgmap v10009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:10:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:19 smithi122 ceph-mon[125440]: osdmap e698: 12 total, 12 up, 12 in 2023-03-02T16:10:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:21 smithi136 ceph-mon[125702]: pgmap v10011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:10:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:21 smithi057 ceph-mon[92072]: pgmap v10011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:10:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:21 smithi122 ceph-mon[125440]: pgmap v10011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:10:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:23 smithi136 ceph-mon[125702]: pgmap v10012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:10:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:23 smithi057 ceph-mon[92072]: pgmap v10012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:10:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:23 smithi122 ceph-mon[125440]: pgmap v10012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:10:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:25 smithi136 ceph-mon[125702]: pgmap v10013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:10:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:25 smithi057 ceph-mon[92072]: pgmap v10013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:10:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:25 smithi122 ceph-mon[125440]: pgmap v10013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:10:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:27 smithi136 ceph-mon[125702]: pgmap v10014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:10:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:27 smithi057 ceph-mon[92072]: pgmap v10014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:10:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:27 smithi122 ceph-mon[125440]: pgmap v10014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:10:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:29 smithi136 ceph-mon[125702]: pgmap v10015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T16:10:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:10:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:10:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:10:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:10:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:29 smithi057 ceph-mon[92072]: pgmap v10015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T16:10:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:10:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:10:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:10:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:10:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:29 smithi122 ceph-mon[125440]: pgmap v10015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T16:10:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:10:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:10:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:10:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:10:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:31 smithi136 ceph-mon[125702]: pgmap v10016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T16:10:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:31 smithi057 ceph-mon[92072]: pgmap v10016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T16:10:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:31 smithi122 ceph-mon[125440]: pgmap v10016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T16:10:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:33.329+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:10:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:33.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:10:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:33.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:10:33.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:33.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:10:33.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:33.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:10:33.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:33 smithi136 ceph-mon[125702]: pgmap v10017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:33 smithi057 ceph-mon[92072]: pgmap v10017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:33 smithi122 ceph-mon[125440]: pgmap v10017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:35 smithi136 ceph-mon[125702]: pgmap v10018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:10:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:35 smithi057 ceph-mon[92072]: pgmap v10018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:10:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:35 smithi122 ceph-mon[125440]: pgmap v10018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:10:37.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:37 smithi136 ceph-mon[125702]: pgmap v10019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:10:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:37 smithi057 ceph-mon[92072]: pgmap v10019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:10:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:37 smithi122 ceph-mon[125440]: pgmap v10019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:10:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:39 smithi136 ceph-mon[125702]: pgmap v10020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:39 smithi057 ceph-mon[92072]: pgmap v10020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:39 smithi122 ceph-mon[125440]: pgmap v10020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:41 smithi136 ceph-mon[125702]: pgmap v10021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:41 smithi057 ceph-mon[92072]: pgmap v10021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:41 smithi122 ceph-mon[125440]: pgmap v10021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:43 smithi057 ceph-mon[92072]: pgmap v10022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:43 smithi122 ceph-mon[125440]: pgmap v10022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:43 smithi136 ceph-mon[125702]: pgmap v10022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:45 smithi057 ceph-mon[92072]: pgmap v10023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:45 smithi122 ceph-mon[125440]: pgmap v10023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:45 smithi136 ceph-mon[125702]: pgmap v10023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:47 smithi057 ceph-mon[92072]: pgmap v10024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:47 smithi122 ceph-mon[125440]: pgmap v10024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:47 smithi136 ceph-mon[125702]: pgmap v10024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:48.345+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:10:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:48.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:10:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:48.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:10:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:48.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:10:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:10:48.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:10:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:49 smithi057 ceph-mon[92072]: pgmap v10025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:49 smithi122 ceph-mon[125440]: pgmap v10025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:49 smithi136 ceph-mon[125702]: pgmap v10025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:51 smithi057 ceph-mon[92072]: pgmap v10026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:51 smithi122 ceph-mon[125440]: pgmap v10026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:51 smithi136 ceph-mon[125702]: pgmap v10026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:53 smithi057 ceph-mon[92072]: pgmap v10027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:53 smithi122 ceph-mon[125440]: pgmap v10027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:53 smithi136 ceph-mon[125702]: pgmap v10027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:55 smithi057 ceph-mon[92072]: pgmap v10028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:55 smithi122 ceph-mon[125440]: pgmap v10028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:55 smithi136 ceph-mon[125702]: pgmap v10028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:57 smithi057 ceph-mon[92072]: pgmap v10029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:57 smithi122 ceph-mon[125440]: pgmap v10029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:57 smithi136 ceph-mon[125702]: pgmap v10029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:10:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:10:59 smithi057 ceph-mon[92072]: pgmap v10030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:10:59 smithi122 ceph-mon[125440]: pgmap v10030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:10:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:10:59 smithi136 ceph-mon[125702]: pgmap v10030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:01 smithi057 ceph-mon[92072]: pgmap v10031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:01 smithi122 ceph-mon[125440]: pgmap v10031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:01 smithi136 ceph-mon[125702]: pgmap v10031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:03.355+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:11:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:03.356+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:11:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:03.356+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:11:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:03.356+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:11:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:03.356+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:11:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:03 smithi057 ceph-mon[92072]: pgmap v10032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:11:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:03 smithi122 ceph-mon[125440]: pgmap v10032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:11:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:03 smithi136 ceph-mon[125702]: pgmap v10032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:11:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:05 smithi057 ceph-mon[92072]: pgmap v10033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:11:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:05 smithi122 ceph-mon[125440]: pgmap v10033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:11:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:05 smithi136 ceph-mon[125702]: pgmap v10033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:11:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:07 smithi057 ceph-mon[92072]: pgmap v10034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:11:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:07 smithi057 ceph-mon[92072]: osdmap e699: 12 total, 12 up, 12 in 2023-03-02T16:11:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:07 smithi122 ceph-mon[125440]: pgmap v10034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:11:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:07 smithi122 ceph-mon[125440]: osdmap e699: 12 total, 12 up, 12 in 2023-03-02T16:11:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:07 smithi136 ceph-mon[125702]: pgmap v10034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:11:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:07 smithi136 ceph-mon[125702]: osdmap e699: 12 total, 12 up, 12 in 2023-03-02T16:11:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:09 smithi057 ceph-mon[92072]: pgmap v10036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:11:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:09 smithi057 ceph-mon[92072]: osdmap e700: 12 total, 12 up, 12 in 2023-03-02T16:11:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:09 smithi122 ceph-mon[125440]: pgmap v10036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:11:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:09 smithi122 ceph-mon[125440]: osdmap e700: 12 total, 12 up, 12 in 2023-03-02T16:11:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:09 smithi136 ceph-mon[125702]: pgmap v10036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:11:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:09 smithi136 ceph-mon[125702]: osdmap e700: 12 total, 12 up, 12 in 2023-03-02T16:11:11.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:11.065+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:11:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:11.065+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:11:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:11.065+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 146 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:11:11.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:11.065+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 147 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:11:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:11 smithi057 ceph-mon[92072]: pgmap v10038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:11:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:11 smithi122 ceph-mon[125440]: pgmap v10038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:11:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:11 smithi136 ceph-mon[125702]: pgmap v10038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:11:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:13 smithi057 ceph-mon[92072]: pgmap v10039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:11:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:13 smithi122 ceph-mon[125440]: pgmap v10039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:11:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:13 smithi136 ceph-mon[125702]: pgmap v10039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:11:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:15 smithi057 ceph-mon[92072]: pgmap v10040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:11:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:15 smithi122 ceph-mon[125440]: pgmap v10040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:11:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:15 smithi136 ceph-mon[125702]: pgmap v10040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:11:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:17 smithi057 ceph-mon[92072]: pgmap v10041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:11:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:17 smithi122 ceph-mon[125440]: pgmap v10041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:11:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:17 smithi136 ceph-mon[125702]: pgmap v10041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:11:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:18.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:11:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:18.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:11:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:18.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:11:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:18.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:11:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:18.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:11:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:19 smithi057 ceph-mon[92072]: pgmap v10042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:11:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:19 smithi122 ceph-mon[125440]: pgmap v10042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:11:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:19 smithi136 ceph-mon[125702]: pgmap v10042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:11:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:21 smithi057 ceph-mon[92072]: pgmap v10043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:11:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:21 smithi122 ceph-mon[125440]: pgmap v10043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:11:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:21 smithi136 ceph-mon[125702]: pgmap v10043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:11:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:23 smithi057 ceph-mon[92072]: pgmap v10044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:11:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:23 smithi122 ceph-mon[125440]: pgmap v10044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:11:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:23 smithi136 ceph-mon[125702]: pgmap v10044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:11:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:25 smithi057 ceph-mon[92072]: pgmap v10045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:25 smithi122 ceph-mon[125440]: pgmap v10045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:25 smithi136 ceph-mon[125702]: pgmap v10045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:27 smithi122 ceph-mon[125440]: pgmap v10046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:27 smithi136 ceph-mon[125702]: pgmap v10046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:27 smithi057 ceph-mon[92072]: pgmap v10046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:29 smithi122 ceph-mon[125440]: pgmap v10047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:11:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:29 smithi136 ceph-mon[125702]: pgmap v10047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:11:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:29 smithi057 ceph-mon[92072]: pgmap v10047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:11:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:11:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:11:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:11:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:11:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:11:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:11:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:11:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:11:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:11:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:31 smithi122 ceph-mon[125440]: pgmap v10048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:31 smithi136 ceph-mon[125702]: pgmap v10048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:31 smithi057 ceph-mon[92072]: pgmap v10048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:33.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:11:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:33.378+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:11:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:33.378+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:11:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:33.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:11:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:33.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:11:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:33 smithi122 ceph-mon[125440]: pgmap v10049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:33 smithi136 ceph-mon[125702]: pgmap v10049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:33 smithi057 ceph-mon[92072]: pgmap v10049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:35 smithi136 ceph-mon[125702]: pgmap v10050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:35 smithi057 ceph-mon[92072]: pgmap v10050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:35 smithi122 ceph-mon[125440]: pgmap v10050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:37 smithi136 ceph-mon[125702]: pgmap v10051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:37 smithi057 ceph-mon[92072]: pgmap v10051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:37 smithi122 ceph-mon[125440]: pgmap v10051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:39 smithi136 ceph-mon[125702]: pgmap v10052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:39 smithi057 ceph-mon[92072]: pgmap v10052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:39 smithi122 ceph-mon[125440]: pgmap v10052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:41 smithi136 ceph-mon[125702]: pgmap v10053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:41 smithi057 ceph-mon[92072]: pgmap v10053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:41 smithi122 ceph-mon[125440]: pgmap v10053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:43 smithi136 ceph-mon[125702]: pgmap v10054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:43 smithi057 ceph-mon[92072]: pgmap v10054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:43 smithi122 ceph-mon[125440]: pgmap v10054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:45 smithi136 ceph-mon[125702]: pgmap v10055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:45 smithi057 ceph-mon[92072]: pgmap v10055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:45 smithi122 ceph-mon[125440]: pgmap v10055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:47 smithi136 ceph-mon[125702]: pgmap v10056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:47 smithi057 ceph-mon[92072]: pgmap v10056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:47 smithi122 ceph-mon[125440]: pgmap v10056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:48.392+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:11:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:48.392+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:11:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:48.392+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:11:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:48.392+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:11:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:11:48.392+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:11:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:49 smithi136 ceph-mon[125702]: pgmap v10057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:49 smithi057 ceph-mon[92072]: pgmap v10057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:49 smithi122 ceph-mon[125440]: pgmap v10057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:51 smithi136 ceph-mon[125702]: pgmap v10058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:51 smithi057 ceph-mon[92072]: pgmap v10058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:51 smithi122 ceph-mon[125440]: pgmap v10058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:53 smithi136 ceph-mon[125702]: pgmap v10059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:53 smithi057 ceph-mon[92072]: pgmap v10059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:53 smithi122 ceph-mon[125440]: pgmap v10059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:55 smithi136 ceph-mon[125702]: pgmap v10060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:55 smithi057 ceph-mon[92072]: pgmap v10060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:55 smithi122 ceph-mon[125440]: pgmap v10060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:57 smithi136 ceph-mon[125702]: pgmap v10061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:57 smithi057 ceph-mon[92072]: pgmap v10061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:57 smithi122 ceph-mon[125440]: pgmap v10061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:11:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:11:59 smithi136 ceph-mon[125702]: pgmap v10062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:11:59 smithi057 ceph-mon[92072]: pgmap v10062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:11:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:11:59 smithi122 ceph-mon[125440]: pgmap v10062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:01 smithi136 ceph-mon[125702]: pgmap v10063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:01 smithi057 ceph-mon[92072]: pgmap v10063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:01 smithi122 ceph-mon[125440]: pgmap v10063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:03.403+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:12:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:03.404+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:12:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:03.404+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:12:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:03.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:12:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:03.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:12:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:03 smithi136 ceph-mon[125702]: pgmap v10064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:12:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:03 smithi057 ceph-mon[92072]: pgmap v10064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:12:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:03 smithi122 ceph-mon[125440]: pgmap v10064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:12:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:05 smithi136 ceph-mon[125702]: pgmap v10065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:12:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:05 smithi057 ceph-mon[92072]: pgmap v10065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:12:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:05 smithi122 ceph-mon[125440]: pgmap v10065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:12:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:07 smithi136 ceph-mon[125702]: pgmap v10066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:12:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:07 smithi136 ceph-mon[125702]: osdmap e701: 12 total, 12 up, 12 in 2023-03-02T16:12:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:07 smithi057 ceph-mon[92072]: pgmap v10066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:12:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:07 smithi057 ceph-mon[92072]: osdmap e701: 12 total, 12 up, 12 in 2023-03-02T16:12:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:07 smithi122 ceph-mon[125440]: pgmap v10066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:12:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:07 smithi122 ceph-mon[125440]: osdmap e701: 12 total, 12 up, 12 in 2023-03-02T16:12:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:09 smithi136 ceph-mon[125702]: pgmap v10068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:12:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:09 smithi057 ceph-mon[92072]: pgmap v10068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:12:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:09 smithi122 ceph-mon[125440]: pgmap v10068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:12:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:11 smithi136 ceph-mon[125702]: pgmap v10069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:12:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:11 smithi057 ceph-mon[92072]: pgmap v10069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:12:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:11 smithi122 ceph-mon[125440]: pgmap v10069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:12:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:13 smithi136 ceph-mon[125702]: pgmap v10070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:12:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:13 smithi057 ceph-mon[92072]: pgmap v10070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:12:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:13 smithi122 ceph-mon[125440]: pgmap v10070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:12:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:15 smithi136 ceph-mon[125702]: pgmap v10071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:12:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:15 smithi136 ceph-mon[125702]: osdmap e702: 12 total, 12 up, 12 in 2023-03-02T16:12:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:15 smithi057 ceph-mon[92072]: pgmap v10071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:12:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:15 smithi057 ceph-mon[92072]: osdmap e702: 12 total, 12 up, 12 in 2023-03-02T16:12:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:15 smithi122 ceph-mon[125440]: pgmap v10071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:12:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:15 smithi122 ceph-mon[125440]: osdmap e702: 12 total, 12 up, 12 in 2023-03-02T16:12:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:17 smithi136 ceph-mon[125702]: pgmap v10073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T16:12:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:17 smithi057 ceph-mon[92072]: pgmap v10073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T16:12:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:17 smithi122 ceph-mon[125440]: pgmap v10073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T16:12:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:18.415+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:12:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:18.415+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:12:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:18.415+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:12:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:18.415+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:12:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:18.415+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:12:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:19 smithi136 ceph-mon[125702]: pgmap v10074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T16:12:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:19 smithi057 ceph-mon[92072]: pgmap v10074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T16:12:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:19 smithi122 ceph-mon[125440]: pgmap v10074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T16:12:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:21 smithi136 ceph-mon[125702]: pgmap v10075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T16:12:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:21 smithi057 ceph-mon[92072]: pgmap v10075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T16:12:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:21 smithi122 ceph-mon[125440]: pgmap v10075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T16:12:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:23 smithi136 ceph-mon[125702]: pgmap v10076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T16:12:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:23 smithi057 ceph-mon[92072]: pgmap v10076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T16:12:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:23 smithi122 ceph-mon[125440]: pgmap v10076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T16:12:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:25 smithi136 ceph-mon[125702]: pgmap v10077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T16:12:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:25 smithi057 ceph-mon[92072]: pgmap v10077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T16:12:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:25 smithi122 ceph-mon[125440]: pgmap v10077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T16:12:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:27 smithi136 ceph-mon[125702]: pgmap v10078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:12:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:27 smithi057 ceph-mon[92072]: pgmap v10078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:12:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:27 smithi122 ceph-mon[125440]: pgmap v10078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:12:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:29 smithi136 ceph-mon[125702]: pgmap v10079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T16:12:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:29 smithi057 ceph-mon[92072]: pgmap v10079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T16:12:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:29 smithi122 ceph-mon[125440]: pgmap v10079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T16:12:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:12:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:12:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:12:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:31 smithi136 ceph-mon[125702]: pgmap v10080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T16:12:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:12:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:12:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:12:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:31 smithi057 ceph-mon[92072]: pgmap v10080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T16:12:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:12:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:12:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:12:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:31 smithi122 ceph-mon[125440]: pgmap v10080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T16:12:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:12:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:12:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:12:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:33.423+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:12:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:33.424+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:12:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:33.424+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:12:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:33.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:12:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:33.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:12:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:33 smithi136 ceph-mon[125702]: pgmap v10081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T16:12:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:33 smithi057 ceph-mon[92072]: pgmap v10081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T16:12:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:33 smithi122 ceph-mon[125440]: pgmap v10081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T16:12:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:35 smithi136 ceph-mon[125702]: pgmap v10082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:35 smithi057 ceph-mon[92072]: pgmap v10082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:35 smithi122 ceph-mon[125440]: pgmap v10082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:37 smithi057 ceph-mon[92072]: pgmap v10083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:37 smithi122 ceph-mon[125440]: pgmap v10083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:37 smithi136 ceph-mon[125702]: pgmap v10083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:39 smithi057 ceph-mon[92072]: pgmap v10084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:39 smithi122 ceph-mon[125440]: pgmap v10084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:39 smithi136 ceph-mon[125702]: pgmap v10084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:41.079+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:12:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:41.079+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:12:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:41.079+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 148 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:12:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:41.079+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 147 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:12:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:41 smithi057 ceph-mon[92072]: pgmap v10085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:41 smithi122 ceph-mon[125440]: pgmap v10085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:41 smithi136 ceph-mon[125702]: pgmap v10085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:43 smithi057 ceph-mon[92072]: pgmap v10086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:43 smithi122 ceph-mon[125440]: pgmap v10086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:43 smithi136 ceph-mon[125702]: pgmap v10086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:45 smithi057 ceph-mon[92072]: pgmap v10087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:45 smithi122 ceph-mon[125440]: pgmap v10087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:45 smithi136 ceph-mon[125702]: pgmap v10087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:47 smithi057 ceph-mon[92072]: pgmap v10088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:47 smithi122 ceph-mon[125440]: pgmap v10088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:47 smithi136 ceph-mon[125702]: pgmap v10088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:48.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:12:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:48.435+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:12:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:48.435+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:12:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:48.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:12:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:12:48.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:12:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:49 smithi057 ceph-mon[92072]: pgmap v10089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:49 smithi122 ceph-mon[125440]: pgmap v10089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:49 smithi136 ceph-mon[125702]: pgmap v10089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:51 smithi057 ceph-mon[92072]: pgmap v10090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:51 smithi122 ceph-mon[125440]: pgmap v10090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:51 smithi136 ceph-mon[125702]: pgmap v10090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:53 smithi057 ceph-mon[92072]: pgmap v10091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:53 smithi122 ceph-mon[125440]: pgmap v10091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:53 smithi136 ceph-mon[125702]: pgmap v10091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:55 smithi057 ceph-mon[92072]: pgmap v10092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:55 smithi122 ceph-mon[125440]: pgmap v10092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:55 smithi136 ceph-mon[125702]: pgmap v10092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:57 smithi057 ceph-mon[92072]: pgmap v10093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:57 smithi122 ceph-mon[125440]: pgmap v10093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:57 smithi136 ceph-mon[125702]: pgmap v10093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:12:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:12:59 smithi057 ceph-mon[92072]: pgmap v10094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:12:59 smithi122 ceph-mon[125440]: pgmap v10094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:12:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:12:59 smithi136 ceph-mon[125702]: pgmap v10094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:01 smithi057 ceph-mon[92072]: pgmap v10095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:01 smithi122 ceph-mon[125440]: pgmap v10095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:01 smithi136 ceph-mon[125702]: pgmap v10095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:03.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:03.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:13:03.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:03.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:13:03.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:03.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:13:03.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:03.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:13:03.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:03.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:13:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:03 smithi057 ceph-mon[92072]: pgmap v10096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:13:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:03 smithi122 ceph-mon[125440]: pgmap v10096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:13:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:03 smithi136 ceph-mon[125702]: pgmap v10096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:13:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:05 smithi057 ceph-mon[92072]: pgmap v10097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:13:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:05 smithi122 ceph-mon[125440]: pgmap v10097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:13:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:05 smithi136 ceph-mon[125702]: pgmap v10097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:13:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:07 smithi057 ceph-mon[92072]: pgmap v10098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:13:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:07 smithi057 ceph-mon[92072]: osdmap e703: 12 total, 12 up, 12 in 2023-03-02T16:13:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:07 smithi122 ceph-mon[125440]: pgmap v10098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:13:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:07 smithi122 ceph-mon[125440]: osdmap e703: 12 total, 12 up, 12 in 2023-03-02T16:13:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:07 smithi136 ceph-mon[125702]: pgmap v10098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:13:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:07 smithi136 ceph-mon[125702]: osdmap e703: 12 total, 12 up, 12 in 2023-03-02T16:13:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:09 smithi057 ceph-mon[92072]: pgmap v10100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:13:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:09 smithi122 ceph-mon[125440]: pgmap v10100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:13:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:09 smithi136 ceph-mon[125702]: pgmap v10100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:13:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:11 smithi122 ceph-mon[125440]: pgmap v10101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:13:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:11 smithi136 ceph-mon[125702]: pgmap v10101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:13:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:11 smithi057 ceph-mon[92072]: pgmap v10101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:13:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:13 smithi122 ceph-mon[125440]: pgmap v10102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:13:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:13 smithi136 ceph-mon[125702]: pgmap v10102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:13:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:13 smithi057 ceph-mon[92072]: pgmap v10102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:13:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:15 smithi136 ceph-mon[125702]: pgmap v10103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:13:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:15 smithi136 ceph-mon[125702]: osdmap e704: 12 total, 12 up, 12 in 2023-03-02T16:13:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:15 smithi057 ceph-mon[92072]: pgmap v10103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:13:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:15 smithi057 ceph-mon[92072]: osdmap e704: 12 total, 12 up, 12 in 2023-03-02T16:13:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:15 smithi122 ceph-mon[125440]: pgmap v10103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:13:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:15 smithi122 ceph-mon[125440]: osdmap e704: 12 total, 12 up, 12 in 2023-03-02T16:13:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:17 smithi136 ceph-mon[125702]: pgmap v10105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:13:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:17 smithi057 ceph-mon[92072]: pgmap v10105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:13:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:17 smithi122 ceph-mon[125440]: pgmap v10105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:13:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:18.455+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:13:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:18.455+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:13:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:18.455+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:13:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:18.455+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:13:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:18.455+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:13:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:19 smithi136 ceph-mon[125702]: pgmap v10106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:13:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:19 smithi057 ceph-mon[92072]: pgmap v10106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:13:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:19 smithi122 ceph-mon[125440]: pgmap v10106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:13:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:21 smithi136 ceph-mon[125702]: pgmap v10107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:13:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:21 smithi057 ceph-mon[92072]: pgmap v10107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:13:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:21 smithi122 ceph-mon[125440]: pgmap v10107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:13:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:23 smithi136 ceph-mon[125702]: pgmap v10108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:13:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:23 smithi057 ceph-mon[92072]: pgmap v10108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:13:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:23 smithi122 ceph-mon[125440]: pgmap v10108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:13:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:25 smithi136 ceph-mon[125702]: pgmap v10109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:13:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:25 smithi057 ceph-mon[92072]: pgmap v10109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:13:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:25 smithi122 ceph-mon[125440]: pgmap v10109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:13:27.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:27 smithi136 ceph-mon[125702]: pgmap v10110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:27 smithi057 ceph-mon[92072]: pgmap v10110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:27 smithi122 ceph-mon[125440]: pgmap v10110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:29.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:29 smithi136 ceph-mon[125702]: pgmap v10111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:29 smithi057 ceph-mon[92072]: pgmap v10111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:29 smithi122 ceph-mon[125440]: pgmap v10111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:31 smithi057 ceph-mon[92072]: pgmap v10112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:13:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:31 smithi122 ceph-mon[125440]: pgmap v10112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:13:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:31 smithi136 ceph-mon[125702]: pgmap v10112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:13:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:13:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:13:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:13:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:13:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:13:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:13:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:13:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:13:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:13:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:33.463+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:13:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:33.463+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:13:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:33.463+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:13:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:33.463+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:13:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:33.463+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:13:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:33 smithi057 ceph-mon[92072]: pgmap v10113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:33 smithi122 ceph-mon[125440]: pgmap v10113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:33 smithi136 ceph-mon[125702]: pgmap v10113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:35 smithi057 ceph-mon[92072]: pgmap v10114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:35 smithi122 ceph-mon[125440]: pgmap v10114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:35 smithi136 ceph-mon[125702]: pgmap v10114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:37 smithi057 ceph-mon[92072]: pgmap v10115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:37 smithi122 ceph-mon[125440]: pgmap v10115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:37 smithi136 ceph-mon[125702]: pgmap v10115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:39 smithi057 ceph-mon[92072]: pgmap v10116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:39 smithi122 ceph-mon[125440]: pgmap v10116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:39 smithi136 ceph-mon[125702]: pgmap v10116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:41 smithi057 ceph-mon[92072]: pgmap v10117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:41 smithi122 ceph-mon[125440]: pgmap v10117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:41 smithi136 ceph-mon[125702]: pgmap v10117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:43 smithi057 ceph-mon[92072]: pgmap v10118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:43 smithi122 ceph-mon[125440]: pgmap v10118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:43 smithi136 ceph-mon[125702]: pgmap v10118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:45 smithi057 ceph-mon[92072]: pgmap v10119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:45 smithi122 ceph-mon[125440]: pgmap v10119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:45 smithi136 ceph-mon[125702]: pgmap v10119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:47 smithi057 ceph-mon[92072]: pgmap v10120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:47 smithi122 ceph-mon[125440]: pgmap v10120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:47 smithi136 ceph-mon[125702]: pgmap v10120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:48.480+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:13:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:48.480+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:13:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:48.480+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:13:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:48.480+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:13:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:13:48.480+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:13:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:49 smithi057 ceph-mon[92072]: pgmap v10121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:49 smithi122 ceph-mon[125440]: pgmap v10121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:49 smithi136 ceph-mon[125702]: pgmap v10121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:51 smithi057 ceph-mon[92072]: pgmap v10122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:51 smithi122 ceph-mon[125440]: pgmap v10122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:51 smithi136 ceph-mon[125702]: pgmap v10122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:53 smithi057 ceph-mon[92072]: pgmap v10123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:53 smithi122 ceph-mon[125440]: pgmap v10123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:53 smithi136 ceph-mon[125702]: pgmap v10123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:55 smithi057 ceph-mon[92072]: pgmap v10124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:55 smithi122 ceph-mon[125440]: pgmap v10124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:55 smithi136 ceph-mon[125702]: pgmap v10124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:57 smithi057 ceph-mon[92072]: pgmap v10125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:57 smithi122 ceph-mon[125440]: pgmap v10125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:57 smithi136 ceph-mon[125702]: pgmap v10125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:13:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:13:59 smithi057 ceph-mon[92072]: pgmap v10126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:13:59 smithi122 ceph-mon[125440]: pgmap v10126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:13:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:13:59 smithi136 ceph-mon[125702]: pgmap v10126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:01 smithi057 ceph-mon[92072]: pgmap v10127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:01 smithi122 ceph-mon[125440]: pgmap v10127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:01 smithi136 ceph-mon[125702]: pgmap v10127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:03.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:14:03.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:03.496+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:14:03.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:03.496+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:14:03.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:03.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:14:03.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:03.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:14:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:03 smithi057 ceph-mon[92072]: pgmap v10128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:14:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:03 smithi122 ceph-mon[125440]: pgmap v10128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:14:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:03 smithi136 ceph-mon[125702]: pgmap v10128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:14:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:05 smithi057 ceph-mon[92072]: pgmap v10129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:14:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:05 smithi122 ceph-mon[125440]: pgmap v10129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:14:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:05 smithi136 ceph-mon[125702]: pgmap v10129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:14:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:07 smithi057 ceph-mon[92072]: pgmap v10130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:14:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:07 smithi057 ceph-mon[92072]: osdmap e705: 12 total, 12 up, 12 in 2023-03-02T16:14:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:07 smithi122 ceph-mon[125440]: pgmap v10130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:14:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:07 smithi122 ceph-mon[125440]: osdmap e705: 12 total, 12 up, 12 in 2023-03-02T16:14:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:07 smithi136 ceph-mon[125702]: pgmap v10130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:14:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:07 smithi136 ceph-mon[125702]: osdmap e705: 12 total, 12 up, 12 in 2023-03-02T16:14:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:08.409+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T16:14:08.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:08.409+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T16:14:08.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:08.409+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f58700387f0 tx=0x7f5870097040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:14:08.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:08.409+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f58700387f0 tx=0x7f5870097040 comp rx=0 tx=0).stop 2023-03-02T16:14:08.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:08.409+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T16:14:08.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:08.409+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T16:14:08.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:08.409+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T16:14:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:08.409+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T16:14:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:08.409+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:14:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:08.409+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870041000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T16:14:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:09 smithi057 ceph-mon[92072]: pgmap v10132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:14:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:09 smithi122 ceph-mon[125440]: pgmap v10132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:14:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:09 smithi136 ceph-mon[125702]: pgmap v10132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:14:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:11.091+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:14:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:11.091+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:14:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:11.092+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 149 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:14:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:11.092+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 148 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:14:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:11 smithi122 ceph-mon[125440]: pgmap v10133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:14:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:11 smithi136 ceph-mon[125702]: pgmap v10133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:14:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:11 smithi057 ceph-mon[92072]: pgmap v10133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:14:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:13 smithi122 ceph-mon[125440]: pgmap v10134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:14:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:13 smithi136 ceph-mon[125702]: pgmap v10134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:14:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:13 smithi057 ceph-mon[92072]: pgmap v10134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:14:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:15 smithi136 ceph-mon[125702]: pgmap v10135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:14:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:15 smithi136 ceph-mon[125702]: osdmap e706: 12 total, 12 up, 12 in 2023-03-02T16:14:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:15 smithi057 ceph-mon[92072]: pgmap v10135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:14:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:15 smithi057 ceph-mon[92072]: osdmap e706: 12 total, 12 up, 12 in 2023-03-02T16:14:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:15 smithi122 ceph-mon[125440]: pgmap v10135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:14:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:15 smithi122 ceph-mon[125440]: osdmap e706: 12 total, 12 up, 12 in 2023-03-02T16:14:17.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:17 smithi136 ceph-mon[125702]: pgmap v10137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:14:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:17 smithi057 ceph-mon[92072]: pgmap v10137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:14:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:17 smithi122 ceph-mon[125440]: pgmap v10137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:14:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:18.505+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:14:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:18.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:14:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:18.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:14:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:18.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:14:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:18.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:14:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:19 smithi136 ceph-mon[125702]: pgmap v10138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:14:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:19 smithi057 ceph-mon[92072]: pgmap v10138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:14:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:19 smithi122 ceph-mon[125440]: pgmap v10138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:14:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:21 smithi136 ceph-mon[125702]: pgmap v10139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:14:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:21 smithi057 ceph-mon[92072]: pgmap v10139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:14:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:21 smithi122 ceph-mon[125440]: pgmap v10139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:14:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:23 smithi136 ceph-mon[125702]: pgmap v10140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:14:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:23 smithi057 ceph-mon[92072]: pgmap v10140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:14:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:23 smithi122 ceph-mon[125440]: pgmap v10140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:14:25.319 INFO:journalctl@ceph.osd.2.smithi136.stdout:Mar 02 16:14:25 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-2[131505]: problem writing to /var/log/ceph/ceph-osd.2.log: (28) No space left on device 2023-03-02T16:14:25.320 INFO:journalctl@ceph.osd.8.smithi136.stdout:Mar 02 16:14:25 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-8[142485]: problem writing to /var/log/ceph/ceph-osd.8.log: (28) No space left on device 2023-03-02T16:14:25.320 INFO:journalctl@ceph.mds.i.smithi136.stdout:Mar 02 16:14:25 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-i[151872]: problem writing to /var/log/ceph/ceph-mds.i.log: (28) No space left on device 2023-03-02T16:14:25.320 INFO:journalctl@ceph.mds.c.smithi136.stdout:Mar 02 16:14:25 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-c[151532]: problem writing to /var/log/ceph/ceph-mds.c.log: (28) No space left on device 2023-03-02T16:14:25.589 INFO:journalctl@ceph.osd.5.smithi136.stdout:Mar 02 16:14:25 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-5[136985]: problem writing to /var/log/ceph/ceph-osd.5.log: (28) No space left on device 2023-03-02T16:14:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:25 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mon-c[125676]: problem writing to /var/log/ceph/ceph-mon.c.log: (28) No space left on device 2023-03-02T16:14:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:25 smithi136 ceph-mon[125702]: pgmap v10141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:14:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:25 smithi057 ceph-mon[92072]: pgmap v10141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:14:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:25 smithi122 ceph-mon[125440]: pgmap v10141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:14:26.089 INFO:journalctl@ceph.osd.11.smithi136.stdout:Mar 02 16:14:25 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-11[147929]: problem writing to /var/log/ceph/ceph-osd.11.log: (28) No space left on device 2023-03-02T16:14:26.090 INFO:journalctl@ceph.mds.f.smithi136.stdout:Mar 02 16:14:25 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-f[151195]: problem writing to /var/log/ceph/ceph-mds.f.log: (28) No space left on device 2023-03-02T16:14:26.091 INFO:journalctl@ceph.mds.l.smithi136.stdout:Mar 02 16:14:25 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-l[150847]: problem writing to /var/log/ceph/ceph-mds.l.log: (28) No space left on device 2023-03-02T16:14:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:27 smithi057 ceph-mon[92072]: pgmap v10142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:27 smithi122 ceph-mon[125440]: pgmap v10142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:27 smithi136 ceph-mon[125702]: pgmap v10142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:29 smithi057 ceph-mon[92072]: pgmap v10143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:29 smithi122 ceph-mon[125440]: pgmap v10143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:29 smithi136 ceph-mon[125702]: pgmap v10143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:31 smithi057 ceph-mon[92072]: pgmap v10144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:31 smithi122 ceph-mon[125440]: pgmap v10144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:31.833 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:31 smithi136 ceph-mon[125702]: pgmap v10144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:14:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:14:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:14:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:33.521+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:14:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:33.521+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:14:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:33.521+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:14:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:33.521+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:14:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:33.521+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:14:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:33 smithi057 ceph-mon[92072]: pgmap v10145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:14:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:14:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:14:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:33 smithi122 ceph-mon[125440]: pgmap v10145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:14:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:14:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:14:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:33 smithi136 ceph-mon[125702]: pgmap v10145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:14:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:14:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:14:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:35 smithi057 ceph-mon[92072]: pgmap v10146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:35 smithi122 ceph-mon[125440]: pgmap v10146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:35 smithi136 ceph-mon[125702]: pgmap v10146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:37 smithi057 ceph-mon[92072]: pgmap v10147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:37 smithi122 ceph-mon[125440]: pgmap v10147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:37 smithi136 ceph-mon[125702]: pgmap v10147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:38.589 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Mar 02 16:14:38 smithi136 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-z[127670]: problem writing to /var/log/ceph/ceph-mgr.z.log: (28) No space left on device 2023-03-02T16:14:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:39 smithi057 ceph-mon[92072]: pgmap v10148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:39 smithi122 ceph-mon[125440]: pgmap v10148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:39 smithi136 ceph-mon[125702]: pgmap v10148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:41 smithi057 ceph-mon[92072]: pgmap v10149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:41 smithi122 ceph-mon[125440]: pgmap v10149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:41 smithi136 ceph-mon[125702]: pgmap v10149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:43 smithi057 ceph-mon[92072]: pgmap v10150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:43 smithi122 ceph-mon[125440]: pgmap v10150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:43 smithi136 ceph-mon[125702]: pgmap v10150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:45 smithi057 ceph-mon[92072]: pgmap v10151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:45 smithi122 ceph-mon[125440]: pgmap v10151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:45 smithi136 ceph-mon[125702]: pgmap v10151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:47 smithi057 ceph-mon[92072]: pgmap v10152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:47 smithi122 ceph-mon[125440]: pgmap v10152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:47 smithi136 ceph-mon[125702]: pgmap v10152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:48.531+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:14:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:48.532+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:14:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:48.532+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:14:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:48.532+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:14:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:14:48.532+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:14:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:49 smithi122 ceph-mon[125440]: pgmap v10153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:49 smithi136 ceph-mon[125702]: pgmap v10153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:49 smithi057 ceph-mon[92072]: pgmap v10153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:51 smithi122 ceph-mon[125440]: pgmap v10154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:51 smithi136 ceph-mon[125702]: pgmap v10154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:51 smithi057 ceph-mon[92072]: pgmap v10154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:53 smithi122 ceph-mon[125440]: pgmap v10155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:53 smithi136 ceph-mon[125702]: pgmap v10155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:53 smithi057 ceph-mon[92072]: pgmap v10155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:55 smithi122 ceph-mon[125440]: pgmap v10156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:55 smithi136 ceph-mon[125702]: pgmap v10156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:55 smithi057 ceph-mon[92072]: pgmap v10156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:57 smithi136 ceph-mon[125702]: pgmap v10157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:57 smithi057 ceph-mon[92072]: pgmap v10157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:57 smithi122 ceph-mon[125440]: pgmap v10157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:14:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:14:59 smithi136 ceph-mon[125702]: pgmap v10158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:14:59 smithi057 ceph-mon[92072]: pgmap v10158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:14:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:14:59 smithi122 ceph-mon[125440]: pgmap v10158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:01 smithi136 ceph-mon[125702]: pgmap v10159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:01 smithi057 ceph-mon[92072]: pgmap v10159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:01 smithi122 ceph-mon[125440]: pgmap v10159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:03.547+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:15:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:03.547+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:15:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:03.547+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:15:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:03.547+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:15:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:03.547+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:15:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:03 smithi136 ceph-mon[125702]: pgmap v10160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:15:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:03 smithi057 ceph-mon[92072]: pgmap v10160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:15:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:03 smithi122 ceph-mon[125440]: pgmap v10160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:15:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:05 smithi136 ceph-mon[125702]: pgmap v10161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:15:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:05 smithi057 ceph-mon[92072]: pgmap v10161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:15:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:05 smithi122 ceph-mon[125440]: pgmap v10161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:15:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:07 smithi136 ceph-mon[125702]: pgmap v10162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:15:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:07 smithi057 ceph-mon[92072]: pgmap v10162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:15:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:07 smithi122 ceph-mon[125440]: pgmap v10162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:15:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:09 smithi136 ceph-mon[125702]: pgmap v10163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:15:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:09 smithi057 ceph-mon[92072]: pgmap v10163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:15:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:09 smithi122 ceph-mon[125440]: pgmap v10163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:15:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:11 smithi136 ceph-mon[125702]: pgmap v10164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:15:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:11 smithi057 ceph-mon[92072]: pgmap v10164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:15:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:11 smithi122 ceph-mon[125440]: pgmap v10164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:15:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:12 smithi136 ceph-mon[125702]: osdmap e707: 12 total, 12 up, 12 in 2023-03-02T16:15:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:12 smithi057 ceph-mon[92072]: osdmap e707: 12 total, 12 up, 12 in 2023-03-02T16:15:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:12 smithi122 ceph-mon[125440]: osdmap e707: 12 total, 12 up, 12 in 2023-03-02T16:15:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:13 smithi136 ceph-mon[125702]: pgmap v10166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:13 smithi057 ceph-mon[92072]: pgmap v10166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:13 smithi122 ceph-mon[125440]: pgmap v10166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:15 smithi136 ceph-mon[125702]: pgmap v10167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:15 smithi057 ceph-mon[92072]: pgmap v10167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:15 smithi122 ceph-mon[125440]: pgmap v10167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:17 smithi136 ceph-mon[125702]: pgmap v10168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:17 smithi057 ceph-mon[92072]: pgmap v10168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:17 smithi122 ceph-mon[125440]: pgmap v10168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:18.563+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:15:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:18.563+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:15:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:18.563+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:15:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:18.563+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:15:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:18.563+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:15:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:19 smithi136 ceph-mon[125702]: pgmap v10169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:15:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:19 smithi136 ceph-mon[125702]: osdmap e708: 12 total, 12 up, 12 in 2023-03-02T16:15:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:19 smithi057 ceph-mon[92072]: pgmap v10169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:15:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:19 smithi057 ceph-mon[92072]: osdmap e708: 12 total, 12 up, 12 in 2023-03-02T16:15:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:19 smithi122 ceph-mon[125440]: pgmap v10169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:15:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:19 smithi122 ceph-mon[125440]: osdmap e708: 12 total, 12 up, 12 in 2023-03-02T16:15:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:21 smithi136 ceph-mon[125702]: pgmap v10171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 357 B/s wr, 12 op/s 2023-03-02T16:15:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:21 smithi057 ceph-mon[92072]: pgmap v10171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 357 B/s wr, 12 op/s 2023-03-02T16:15:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:21 smithi122 ceph-mon[125440]: pgmap v10171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 357 B/s wr, 12 op/s 2023-03-02T16:15:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:23 smithi136 ceph-mon[125702]: pgmap v10172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:23 smithi057 ceph-mon[92072]: pgmap v10172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:23 smithi122 ceph-mon[125440]: pgmap v10172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:25 smithi136 ceph-mon[125702]: pgmap v10173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:25 smithi057 ceph-mon[92072]: pgmap v10173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:25 smithi122 ceph-mon[125440]: pgmap v10173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:27 smithi136 ceph-mon[125702]: pgmap v10174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:27 smithi057 ceph-mon[92072]: pgmap v10174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:27 smithi122 ceph-mon[125440]: pgmap v10174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:15:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:29 smithi136 ceph-mon[125702]: pgmap v10175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:15:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:29 smithi057 ceph-mon[92072]: pgmap v10175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:15:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:29 smithi122 ceph-mon[125440]: pgmap v10175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:15:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:31 smithi136 ceph-mon[125702]: pgmap v10176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:15:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:31 smithi057 ceph-mon[92072]: pgmap v10176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:15:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:31 smithi122 ceph-mon[125440]: pgmap v10176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:15:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:33.566+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:15:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:33.566+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:15:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:33.566+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:15:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:33.566+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:15:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:33.566+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:15:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:33 smithi136 ceph-mon[125702]: pgmap v10177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:15:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:15:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:15:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:15:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:33 smithi057 ceph-mon[92072]: pgmap v10177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:15:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:15:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:15:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:15:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:33 smithi122 ceph-mon[125440]: pgmap v10177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:15:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:15:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:15:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:15:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:35 smithi136 ceph-mon[125702]: pgmap v10178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:35 smithi057 ceph-mon[92072]: pgmap v10178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:35 smithi122 ceph-mon[125440]: pgmap v10178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:37 smithi136 ceph-mon[125702]: pgmap v10179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:37 smithi057 ceph-mon[92072]: pgmap v10179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:37 smithi122 ceph-mon[125440]: pgmap v10179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:39 smithi136 ceph-mon[125702]: pgmap v10180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:39 smithi057 ceph-mon[92072]: pgmap v10180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:39 smithi122 ceph-mon[125440]: pgmap v10180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:41 smithi136 ceph-mon[125702]: pgmap v10181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:41 smithi057 ceph-mon[92072]: pgmap v10181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:41 smithi122 ceph-mon[125440]: pgmap v10181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:43 smithi136 ceph-mon[125702]: pgmap v10182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:43 smithi057 ceph-mon[92072]: pgmap v10182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:43 smithi122 ceph-mon[125440]: pgmap v10182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:45 smithi136 ceph-mon[125702]: pgmap v10183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:45 smithi057 ceph-mon[92072]: pgmap v10183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:45 smithi122 ceph-mon[125440]: pgmap v10183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:47 smithi057 ceph-mon[92072]: pgmap v10184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:47 smithi122 ceph-mon[125440]: pgmap v10184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:47 smithi136 ceph-mon[125702]: pgmap v10184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:48.579+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:15:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:48.579+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:15:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:48.579+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:15:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:48.579+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:15:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:15:48.579+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:15:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:49 smithi057 ceph-mon[92072]: pgmap v10185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:49 smithi122 ceph-mon[125440]: pgmap v10185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:49 smithi136 ceph-mon[125702]: pgmap v10185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:51 smithi057 ceph-mon[92072]: pgmap v10186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:51 smithi122 ceph-mon[125440]: pgmap v10186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:51 smithi136 ceph-mon[125702]: pgmap v10186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:53 smithi057 ceph-mon[92072]: pgmap v10187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:53 smithi122 ceph-mon[125440]: pgmap v10187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:53 smithi136 ceph-mon[125702]: pgmap v10187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:55 smithi057 ceph-mon[92072]: pgmap v10188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:55 smithi122 ceph-mon[125440]: pgmap v10188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:55 smithi136 ceph-mon[125702]: pgmap v10188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:57 smithi057 ceph-mon[92072]: pgmap v10189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:57 smithi122 ceph-mon[125440]: pgmap v10189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:57 smithi136 ceph-mon[125702]: pgmap v10189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:15:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:15:59 smithi057 ceph-mon[92072]: pgmap v10190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:15:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:15:59 smithi122 ceph-mon[125440]: pgmap v10190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:15:59 smithi136 ceph-mon[125702]: pgmap v10190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:01 smithi057 ceph-mon[92072]: pgmap v10191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:01 smithi122 ceph-mon[125440]: pgmap v10191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:01 smithi136 ceph-mon[125702]: pgmap v10191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:03.592+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:16:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:03.593+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:16:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:03.593+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:16:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:03.593+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:16:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:03.593+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:16:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:03 smithi057 ceph-mon[92072]: pgmap v10192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:16:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:03 smithi122 ceph-mon[125440]: pgmap v10192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:16:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:03 smithi136 ceph-mon[125702]: pgmap v10192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:16:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:05 smithi057 ceph-mon[92072]: pgmap v10193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:16:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:05 smithi122 ceph-mon[125440]: pgmap v10193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:16:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:05 smithi136 ceph-mon[125702]: pgmap v10193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:16:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:07 smithi057 ceph-mon[92072]: pgmap v10194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:16:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:07 smithi122 ceph-mon[125440]: pgmap v10194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:16:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:07 smithi136 ceph-mon[125702]: pgmap v10194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:16:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:09 smithi057 ceph-mon[92072]: pgmap v10195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:16:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:09 smithi122 ceph-mon[125440]: pgmap v10195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:16:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:09 smithi136 ceph-mon[125702]: pgmap v10195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:16:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:11 smithi057 ceph-mon[92072]: pgmap v10196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:16:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:11 smithi057 ceph-mon[92072]: osdmap e709: 12 total, 12 up, 12 in 2023-03-02T16:16:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:11 smithi122 ceph-mon[125440]: pgmap v10196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:16:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:11 smithi122 ceph-mon[125440]: osdmap e709: 12 total, 12 up, 12 in 2023-03-02T16:16:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:11 smithi136 ceph-mon[125702]: pgmap v10196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:16:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:11 smithi136 ceph-mon[125702]: osdmap e709: 12 total, 12 up, 12 in 2023-03-02T16:16:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:13 smithi057 ceph-mon[92072]: pgmap v10198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:16:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:13 smithi122 ceph-mon[125440]: pgmap v10198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:16:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:13 smithi136 ceph-mon[125702]: pgmap v10198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:16:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:15 smithi057 ceph-mon[92072]: pgmap v10199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:16:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:15 smithi057 ceph-mon[92072]: osdmap e710: 12 total, 12 up, 12 in 2023-03-02T16:16:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:15 smithi122 ceph-mon[125440]: pgmap v10199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:16:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:15 smithi122 ceph-mon[125440]: osdmap e710: 12 total, 12 up, 12 in 2023-03-02T16:16:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:15 smithi136 ceph-mon[125702]: pgmap v10199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:16:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:15 smithi136 ceph-mon[125702]: osdmap e710: 12 total, 12 up, 12 in 2023-03-02T16:16:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:17 smithi057 ceph-mon[92072]: pgmap v10201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:16:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:17 smithi122 ceph-mon[125440]: pgmap v10201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:16:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:17 smithi136 ceph-mon[125702]: pgmap v10201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:16:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:18.594+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:16:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:18.594+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:16:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:18.594+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:16:18.596 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:18.594+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:16:18.596 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:18.594+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:16:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:19 smithi057 ceph-mon[92072]: pgmap v10202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:16:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:19 smithi122 ceph-mon[125440]: pgmap v10202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:16:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:19 smithi136 ceph-mon[125702]: pgmap v10202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:16:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:21 smithi057 ceph-mon[92072]: pgmap v10203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T16:16:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:21 smithi122 ceph-mon[125440]: pgmap v10203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T16:16:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:21 smithi136 ceph-mon[125702]: pgmap v10203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T16:16:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:23 smithi057 ceph-mon[92072]: pgmap v10204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:16:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:23 smithi122 ceph-mon[125440]: pgmap v10204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:16:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:23 smithi136 ceph-mon[125702]: pgmap v10204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:16:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:25 smithi057 ceph-mon[92072]: pgmap v10205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:16:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:25 smithi122 ceph-mon[125440]: pgmap v10205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:16:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:25 smithi136 ceph-mon[125702]: pgmap v10205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:16:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:27 smithi057 ceph-mon[92072]: pgmap v10206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:16:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:27 smithi122 ceph-mon[125440]: pgmap v10206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:16:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:27 smithi136 ceph-mon[125702]: pgmap v10206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:16:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:29 smithi057 ceph-mon[92072]: pgmap v10207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:16:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:29 smithi122 ceph-mon[125440]: pgmap v10207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:16:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:29 smithi136 ceph-mon[125702]: pgmap v10207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:16:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:31 smithi057 ceph-mon[92072]: pgmap v10208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:31 smithi122 ceph-mon[125440]: pgmap v10208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:31 smithi136 ceph-mon[125702]: pgmap v10208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:33.608+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:16:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:33.608+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:16:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:33.608+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:16:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:33.608+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:16:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:33.608+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:16:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:33 smithi057 ceph-mon[92072]: pgmap v10209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:33 smithi122 ceph-mon[125440]: pgmap v10209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:33 smithi136 ceph-mon[125702]: pgmap v10209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:16:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:16:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:16:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:35 smithi057 ceph-mon[92072]: pgmap v10210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:35.693 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:35 smithi122 ceph-mon[125440]: pgmap v10210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:35 smithi136 ceph-mon[125702]: pgmap v10210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: pgmap v10211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:37.982 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:37.982 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:37.982 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:37.983 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:37.983 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.983 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.984 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.984 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.984 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.984 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.985 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.985 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.985 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:37.986 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:37.987 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: pgmap v10211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:37.987 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:37.987 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:37.988 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:37.988 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:37.988 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.988 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.989 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.989 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.990 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.990 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.990 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.991 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:37.991 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:37.991 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: pgmap v10211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:38.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 100.3M 2023-03-02T16:16:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 105267531: error parsing value: Value '105267531' is below minimum 939524096 2023-03-02T16:16:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:16:38.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:16:38.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 100.3M 2023-03-02T16:16:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 105267531: error parsing value: Value '105267531' is below minimum 939524096 2023-03-02T16:16:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:38.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:16:38.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:16:38.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 100.3M 2023-03-02T16:16:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 105267531: error parsing value: Value '105267531' is below minimum 939524096 2023-03-02T16:16:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:16:39.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:16:39.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:16:39.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:16:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:39 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:16:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:39 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:16:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:39 smithi122 ceph-mon[125440]: pgmap v10212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:39 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:16:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:39 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:16:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:39 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:16:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:39 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:16:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:39 smithi136 ceph-mon[125702]: pgmap v10212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:39 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:16:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:39 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:16:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:39 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:16:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:39 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:16:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:39 smithi057 ceph-mon[92072]: pgmap v10212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:39 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:16:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:39 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:16:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:41 smithi122 ceph-mon[125440]: pgmap v10213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:41 smithi136 ceph-mon[125702]: pgmap v10213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:41 smithi057 ceph-mon[92072]: pgmap v10213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:43 smithi122 ceph-mon[125440]: pgmap v10214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:43 smithi136 ceph-mon[125702]: pgmap v10214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:43 smithi057 ceph-mon[92072]: pgmap v10214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:45 smithi122 ceph-mon[125440]: pgmap v10215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:45 smithi136 ceph-mon[125702]: pgmap v10215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:45 smithi057 ceph-mon[92072]: pgmap v10215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:47 smithi136 ceph-mon[125702]: pgmap v10216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:47 smithi057 ceph-mon[92072]: pgmap v10216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:47 smithi122 ceph-mon[125440]: pgmap v10216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:48.624+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:16:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:48.624+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:16:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:48.624+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:16:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:48.624+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:16:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:16:48.624+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:16:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:49 smithi136 ceph-mon[125702]: pgmap v10217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:49 smithi057 ceph-mon[92072]: pgmap v10217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:49 smithi122 ceph-mon[125440]: pgmap v10217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:51 smithi136 ceph-mon[125702]: pgmap v10218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:51 smithi057 ceph-mon[92072]: pgmap v10218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:51 smithi122 ceph-mon[125440]: pgmap v10218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:53 smithi136 ceph-mon[125702]: pgmap v10219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:53 smithi057 ceph-mon[92072]: pgmap v10219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:53 smithi122 ceph-mon[125440]: pgmap v10219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:55 smithi057 ceph-mon[92072]: pgmap v10220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:55 smithi122 ceph-mon[125440]: pgmap v10220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:55 smithi136 ceph-mon[125702]: pgmap v10220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:57 smithi057 ceph-mon[92072]: pgmap v10221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:57 smithi122 ceph-mon[125440]: pgmap v10221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:57 smithi136 ceph-mon[125702]: pgmap v10221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:16:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:16:59 smithi057 ceph-mon[92072]: pgmap v10222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:16:59 smithi122 ceph-mon[125440]: pgmap v10222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:16:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:16:59 smithi136 ceph-mon[125702]: pgmap v10222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:01 smithi057 ceph-mon[92072]: pgmap v10223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:01 smithi122 ceph-mon[125440]: pgmap v10223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:01 smithi136 ceph-mon[125702]: pgmap v10223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:03.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:03.635+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:17:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:03.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:17:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:03.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:17:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:03.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:17:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:03.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:17:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:03 smithi057 ceph-mon[92072]: pgmap v10224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:17:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:03 smithi122 ceph-mon[125440]: pgmap v10224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:17:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:03 smithi136 ceph-mon[125702]: pgmap v10224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:17:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:05 smithi057 ceph-mon[92072]: pgmap v10225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:17:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:05 smithi122 ceph-mon[125440]: pgmap v10225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:17:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:05 smithi136 ceph-mon[125702]: pgmap v10225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:17:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:07 smithi057 ceph-mon[92072]: pgmap v10226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:17:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:07 smithi122 ceph-mon[125440]: pgmap v10226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:17:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:07 smithi136 ceph-mon[125702]: pgmap v10226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:17:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:09 smithi057 ceph-mon[92072]: pgmap v10227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:17:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:09 smithi122 ceph-mon[125440]: pgmap v10227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:17:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:09 smithi136 ceph-mon[125702]: pgmap v10227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:17:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:11.117+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:17:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:11.117+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:17:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:11.117+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 149 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:17:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:11.117+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 150 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:17:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:11 smithi057 ceph-mon[92072]: pgmap v10228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:17:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:11 smithi122 ceph-mon[125440]: pgmap v10228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:17:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:11 smithi136 ceph-mon[125702]: pgmap v10228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:17:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:12 smithi057 ceph-mon[92072]: osdmap e711: 12 total, 12 up, 12 in 2023-03-02T16:17:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:12 smithi122 ceph-mon[125440]: osdmap e711: 12 total, 12 up, 12 in 2023-03-02T16:17:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:12 smithi136 ceph-mon[125702]: osdmap e711: 12 total, 12 up, 12 in 2023-03-02T16:17:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:13 smithi057 ceph-mon[92072]: pgmap v10230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:13 smithi122 ceph-mon[125440]: pgmap v10230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:13 smithi136 ceph-mon[125702]: pgmap v10230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:15 smithi122 ceph-mon[125440]: pgmap v10231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:15 smithi136 ceph-mon[125702]: pgmap v10231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:15 smithi057 ceph-mon[92072]: pgmap v10231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:17 smithi122 ceph-mon[125440]: pgmap v10232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:17 smithi136 ceph-mon[125702]: pgmap v10232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:17 smithi057 ceph-mon[92072]: pgmap v10232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:18.651+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:17:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:18.651+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:17:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:18.651+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:17:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:18.651+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:17:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:18.651+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:17:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:19 smithi122 ceph-mon[125440]: pgmap v10233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:19 smithi122 ceph-mon[125440]: osdmap e712: 12 total, 12 up, 12 in 2023-03-02T16:17:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:19 smithi136 ceph-mon[125702]: pgmap v10233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:19 smithi136 ceph-mon[125702]: osdmap e712: 12 total, 12 up, 12 in 2023-03-02T16:17:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:19 smithi057 ceph-mon[92072]: pgmap v10233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:17:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:19 smithi057 ceph-mon[92072]: osdmap e712: 12 total, 12 up, 12 in 2023-03-02T16:17:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:21 smithi122 ceph-mon[125440]: pgmap v10235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:17:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:21 smithi136 ceph-mon[125702]: pgmap v10235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:17:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:21 smithi057 ceph-mon[92072]: pgmap v10235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:17:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:23 smithi122 ceph-mon[125440]: pgmap v10236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:17:23.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:23 smithi136 ceph-mon[125702]: pgmap v10236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:17:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:23 smithi057 ceph-mon[92072]: pgmap v10236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:17:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:25 smithi136 ceph-mon[125702]: pgmap v10237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:17:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:25 smithi057 ceph-mon[92072]: pgmap v10237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:17:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:25 smithi122 ceph-mon[125440]: pgmap v10237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:17:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:27 smithi136 ceph-mon[125702]: pgmap v10238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:17:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:27 smithi057 ceph-mon[92072]: pgmap v10238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:17:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:27 smithi122 ceph-mon[125440]: pgmap v10238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:17:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:29 smithi136 ceph-mon[125702]: pgmap v10239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:17:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:29 smithi057 ceph-mon[92072]: pgmap v10239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:17:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:29 smithi122 ceph-mon[125440]: pgmap v10239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:17:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:31 smithi136 ceph-mon[125702]: pgmap v10240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:17:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:31 smithi057 ceph-mon[92072]: pgmap v10240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:17:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:31 smithi122 ceph-mon[125440]: pgmap v10240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:17:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:33.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:17:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:33.662+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:17:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:33.662+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:17:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:33.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:17:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:33.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:17:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:33 smithi136 ceph-mon[125702]: pgmap v10241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:33 smithi057 ceph-mon[92072]: pgmap v10241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:33 smithi122 ceph-mon[125440]: pgmap v10241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:35 smithi136 ceph-mon[125702]: pgmap v10242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:35 smithi057 ceph-mon[92072]: pgmap v10242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:35 smithi122 ceph-mon[125440]: pgmap v10242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:37 smithi136 ceph-mon[125702]: pgmap v10243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:37 smithi057 ceph-mon[92072]: pgmap v10243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:37 smithi122 ceph-mon[125440]: pgmap v10243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:17:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:17:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:17:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:39 smithi136 ceph-mon[125702]: pgmap v10244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:17:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:17:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:17:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:39 smithi057 ceph-mon[92072]: pgmap v10244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:17:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:17:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:17:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:39 smithi122 ceph-mon[125440]: pgmap v10244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:17:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:17:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:17:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:41 smithi136 ceph-mon[125702]: pgmap v10245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:41 smithi057 ceph-mon[92072]: pgmap v10245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:41 smithi122 ceph-mon[125440]: pgmap v10245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:43 smithi136 ceph-mon[125702]: pgmap v10246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:43 smithi057 ceph-mon[92072]: pgmap v10246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:43 smithi122 ceph-mon[125440]: pgmap v10246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:45 smithi136 ceph-mon[125702]: pgmap v10247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:45 smithi057 ceph-mon[92072]: pgmap v10247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:45 smithi122 ceph-mon[125440]: pgmap v10247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:47 smithi136 ceph-mon[125702]: pgmap v10248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:47 smithi057 ceph-mon[92072]: pgmap v10248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:47 smithi122 ceph-mon[125440]: pgmap v10248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:48.677+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:17:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:48.677+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:17:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:48.677+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:17:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:48.677+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:17:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:17:48.677+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:17:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:49 smithi136 ceph-mon[125702]: pgmap v10249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:49.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:49 smithi057 ceph-mon[92072]: pgmap v10249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:49 smithi122 ceph-mon[125440]: pgmap v10249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:51 smithi136 ceph-mon[125702]: pgmap v10250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:51 smithi057 ceph-mon[92072]: pgmap v10250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:51 smithi122 ceph-mon[125440]: pgmap v10250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:53 smithi136 ceph-mon[125702]: pgmap v10251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:53 smithi057 ceph-mon[92072]: pgmap v10251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:53 smithi122 ceph-mon[125440]: pgmap v10251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:55 smithi136 ceph-mon[125702]: pgmap v10252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:55 smithi057 ceph-mon[92072]: pgmap v10252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:55.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:55 smithi122 ceph-mon[125440]: pgmap v10252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:57 smithi136 ceph-mon[125702]: pgmap v10253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:57 smithi057 ceph-mon[92072]: pgmap v10253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:57 smithi122 ceph-mon[125440]: pgmap v10253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:17:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:17:59 smithi136 ceph-mon[125702]: pgmap v10254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:17:59 smithi057 ceph-mon[92072]: pgmap v10254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:17:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:17:59 smithi122 ceph-mon[125440]: pgmap v10254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:01 smithi136 ceph-mon[125702]: pgmap v10255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:01 smithi057 ceph-mon[92072]: pgmap v10255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:01 smithi122 ceph-mon[125440]: pgmap v10255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:03.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:18:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:03.693+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:18:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:03.693+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:18:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:03.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:18:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:03.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:18:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:03 smithi136 ceph-mon[125702]: pgmap v10256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:18:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:03 smithi057 ceph-mon[92072]: pgmap v10256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:18:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:03 smithi122 ceph-mon[125440]: pgmap v10256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:18:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:05 smithi136 ceph-mon[125702]: pgmap v10257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:18:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:05 smithi057 ceph-mon[92072]: pgmap v10257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:18:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:05 smithi122 ceph-mon[125440]: pgmap v10257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:18:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:07 smithi136 ceph-mon[125702]: pgmap v10258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:18:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:07 smithi057 ceph-mon[92072]: pgmap v10258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:18:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:07 smithi122 ceph-mon[125440]: pgmap v10258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:18:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:09 smithi136 ceph-mon[125702]: pgmap v10259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:18:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:09 smithi057 ceph-mon[92072]: pgmap v10259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:18:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:09 smithi122 ceph-mon[125440]: pgmap v10259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:18:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:11 smithi057 ceph-mon[92072]: pgmap v10260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:18:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:11 smithi057 ceph-mon[92072]: osdmap e713: 12 total, 12 up, 12 in 2023-03-02T16:18:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:11 smithi122 ceph-mon[125440]: pgmap v10260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:18:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:11 smithi122 ceph-mon[125440]: osdmap e713: 12 total, 12 up, 12 in 2023-03-02T16:18:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:11 smithi136 ceph-mon[125702]: pgmap v10260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:18:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:11 smithi136 ceph-mon[125702]: osdmap e713: 12 total, 12 up, 12 in 2023-03-02T16:18:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:13 smithi057 ceph-mon[92072]: pgmap v10262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:18:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:13 smithi122 ceph-mon[125440]: pgmap v10262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:18:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:13 smithi136 ceph-mon[125702]: pgmap v10262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:18:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:15 smithi057 ceph-mon[92072]: pgmap v10263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:18:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:15 smithi057 ceph-mon[92072]: osdmap e714: 12 total, 12 up, 12 in 2023-03-02T16:18:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:15 smithi122 ceph-mon[125440]: pgmap v10263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:18:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:15 smithi122 ceph-mon[125440]: osdmap e714: 12 total, 12 up, 12 in 2023-03-02T16:18:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:15 smithi136 ceph-mon[125702]: pgmap v10263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:18:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:15 smithi136 ceph-mon[125702]: osdmap e714: 12 total, 12 up, 12 in 2023-03-02T16:18:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:17 smithi057 ceph-mon[92072]: pgmap v10265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:18:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:17 smithi122 ceph-mon[125440]: pgmap v10265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:18:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:17 smithi136 ceph-mon[125702]: pgmap v10265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:18:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:18.708+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:18:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:18.709+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:18:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:18.709+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:18:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:18.709+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:18:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:18.709+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:18:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:19 smithi057 ceph-mon[92072]: pgmap v10266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:18:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:19 smithi122 ceph-mon[125440]: pgmap v10266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:18:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:19 smithi136 ceph-mon[125702]: pgmap v10266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:18:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:21 smithi057 ceph-mon[92072]: pgmap v10267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T16:18:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:21 smithi122 ceph-mon[125440]: pgmap v10267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T16:18:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:21 smithi136 ceph-mon[125702]: pgmap v10267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T16:18:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:23 smithi057 ceph-mon[92072]: pgmap v10268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:18:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:23 smithi122 ceph-mon[125440]: pgmap v10268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:18:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:23 smithi136 ceph-mon[125702]: pgmap v10268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:18:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:25 smithi057 ceph-mon[92072]: pgmap v10269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:18:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:25 smithi122 ceph-mon[125440]: pgmap v10269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:18:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:25 smithi136 ceph-mon[125702]: pgmap v10269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:18:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:27 smithi057 ceph-mon[92072]: pgmap v10270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:18:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:27 smithi122 ceph-mon[125440]: pgmap v10270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:18:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:27 smithi136 ceph-mon[125702]: pgmap v10270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:18:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:29 smithi057 ceph-mon[92072]: pgmap v10271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:18:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:29 smithi122 ceph-mon[125440]: pgmap v10271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:18:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:29 smithi136 ceph-mon[125702]: pgmap v10271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:18:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:31 smithi122 ceph-mon[125440]: pgmap v10272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:31 smithi136 ceph-mon[125702]: pgmap v10272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:31 smithi057 ceph-mon[92072]: pgmap v10272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:33 smithi122 ceph-mon[125440]: pgmap v10273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:33.724+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:18:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:33.725+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:18:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:33.725+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:18:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:33.725+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:18:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:33.725+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:18:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:33 smithi136 ceph-mon[125702]: pgmap v10273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:33 smithi057 ceph-mon[92072]: pgmap v10273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:35 smithi122 ceph-mon[125440]: pgmap v10274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:35 smithi136 ceph-mon[125702]: pgmap v10274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:35 smithi057 ceph-mon[92072]: pgmap v10274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:37 smithi122 ceph-mon[125440]: pgmap v10275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:37 smithi136 ceph-mon[125702]: pgmap v10275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:37 smithi057 ceph-mon[92072]: pgmap v10275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:39 smithi122 ceph-mon[125440]: pgmap v10276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:18:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:39 smithi136 ceph-mon[125702]: pgmap v10276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:18:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:39 smithi057 ceph-mon[92072]: pgmap v10276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:18:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:18:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:18:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:40 smithi136 ceph-mon[125702]: pgmap v10277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:18:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:18:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:18:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:18:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:18:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:40 smithi057 ceph-mon[92072]: pgmap v10277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:18:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:18:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:18:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:18:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:18:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:40 smithi122 ceph-mon[125440]: pgmap v10277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:18:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:18:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:18:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:43 smithi136 ceph-mon[125702]: pgmap v10278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:43 smithi057 ceph-mon[92072]: pgmap v10278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:43 smithi122 ceph-mon[125440]: pgmap v10278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:45 smithi057 ceph-mon[92072]: pgmap v10279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:45 smithi122 ceph-mon[125440]: pgmap v10279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:45 smithi136 ceph-mon[125702]: pgmap v10279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:47 smithi057 ceph-mon[92072]: pgmap v10280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:47 smithi122 ceph-mon[125440]: pgmap v10280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:47 smithi136 ceph-mon[125702]: pgmap v10280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:48.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:48.739+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:18:48.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:48.739+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:18:48.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:48.739+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:18:48.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:48.739+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:18:48.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:18:48.739+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:18:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:49 smithi057 ceph-mon[92072]: pgmap v10281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:49 smithi122 ceph-mon[125440]: pgmap v10281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:49 smithi136 ceph-mon[125702]: pgmap v10281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:51 smithi057 ceph-mon[92072]: pgmap v10282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:51 smithi122 ceph-mon[125440]: pgmap v10282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:51 smithi136 ceph-mon[125702]: pgmap v10282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:53 smithi057 ceph-mon[92072]: pgmap v10283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:53 smithi122 ceph-mon[125440]: pgmap v10283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:53 smithi136 ceph-mon[125702]: pgmap v10283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:55 smithi122 ceph-mon[125440]: pgmap v10284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:55 smithi136 ceph-mon[125702]: pgmap v10284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:55 smithi057 ceph-mon[92072]: pgmap v10284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:57 smithi122 ceph-mon[125440]: pgmap v10285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:57 smithi136 ceph-mon[125702]: pgmap v10285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:57 smithi057 ceph-mon[92072]: pgmap v10285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:18:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:18:59 smithi122 ceph-mon[125440]: pgmap v10286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:18:59 smithi136 ceph-mon[125702]: pgmap v10286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:18:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:18:59 smithi057 ceph-mon[92072]: pgmap v10286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:01 smithi122 ceph-mon[125440]: pgmap v10287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:01 smithi136 ceph-mon[125702]: pgmap v10287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:01 smithi057 ceph-mon[92072]: pgmap v10287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:03.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:19:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:03.751+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:19:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:03.751+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:19:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:03.751+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:19:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:03.751+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:19:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:03 smithi136 ceph-mon[125702]: pgmap v10288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:19:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:03 smithi057 ceph-mon[92072]: pgmap v10288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:19:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:03 smithi122 ceph-mon[125440]: pgmap v10288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:19:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:05 smithi136 ceph-mon[125702]: pgmap v10289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:19:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:05 smithi057 ceph-mon[92072]: pgmap v10289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:19:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:05 smithi122 ceph-mon[125440]: pgmap v10289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:19:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:07 smithi136 ceph-mon[125702]: pgmap v10290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:19:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:07 smithi136 ceph-mon[125702]: osdmap e715: 12 total, 12 up, 12 in 2023-03-02T16:19:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:07 smithi057 ceph-mon[92072]: pgmap v10290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:19:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:07 smithi057 ceph-mon[92072]: osdmap e715: 12 total, 12 up, 12 in 2023-03-02T16:19:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:07 smithi122 ceph-mon[125440]: pgmap v10290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:19:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:07 smithi122 ceph-mon[125440]: osdmap e715: 12 total, 12 up, 12 in 2023-03-02T16:19:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:09 smithi136 ceph-mon[125702]: pgmap v10292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:19:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:09 smithi057 ceph-mon[92072]: pgmap v10292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:19:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:09 smithi122 ceph-mon[125440]: pgmap v10292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:19:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:11 smithi136 ceph-mon[125702]: pgmap v10293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:19:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:11 smithi057 ceph-mon[92072]: pgmap v10293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:19:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:11 smithi122 ceph-mon[125440]: pgmap v10293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:19:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:13 smithi136 ceph-mon[125702]: pgmap v10294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:19:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:13 smithi057 ceph-mon[92072]: pgmap v10294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:19:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:13 smithi122 ceph-mon[125440]: pgmap v10294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:19:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:15 smithi057 ceph-mon[92072]: pgmap v10295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:19:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:15 smithi057 ceph-mon[92072]: osdmap e716: 12 total, 12 up, 12 in 2023-03-02T16:19:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:15 smithi122 ceph-mon[125440]: pgmap v10295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:19:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:15 smithi122 ceph-mon[125440]: osdmap e716: 12 total, 12 up, 12 in 2023-03-02T16:19:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:15 smithi136 ceph-mon[125702]: pgmap v10295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:19:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:15 smithi136 ceph-mon[125702]: osdmap e716: 12 total, 12 up, 12 in 2023-03-02T16:19:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:17 smithi057 ceph-mon[92072]: pgmap v10297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:19:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:17 smithi122 ceph-mon[125440]: pgmap v10297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:19:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:17 smithi136 ceph-mon[125702]: pgmap v10297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:19:18.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:18.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:19:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:18.767+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:19:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:18.767+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:19:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:18.767+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:19:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:18.767+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:19:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:19 smithi057 ceph-mon[92072]: pgmap v10298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:19:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:19 smithi122 ceph-mon[125440]: pgmap v10298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:19:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:19 smithi136 ceph-mon[125702]: pgmap v10298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:19:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:21 smithi057 ceph-mon[92072]: pgmap v10299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:19:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:21 smithi122 ceph-mon[125440]: pgmap v10299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:19:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:21 smithi136 ceph-mon[125702]: pgmap v10299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:19:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:23 smithi122 ceph-mon[125440]: pgmap v10300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:19:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:23 smithi136 ceph-mon[125702]: pgmap v10300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:19:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:23 smithi057 ceph-mon[92072]: pgmap v10300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:19:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:25 smithi122 ceph-mon[125440]: pgmap v10301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:19:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:25 smithi136 ceph-mon[125702]: pgmap v10301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:19:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:25 smithi057 ceph-mon[92072]: pgmap v10301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:19:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:27 smithi122 ceph-mon[125440]: pgmap v10302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:19:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:27 smithi136 ceph-mon[125702]: pgmap v10302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:19:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:27 smithi057 ceph-mon[92072]: pgmap v10302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:19:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:29 smithi122 ceph-mon[125440]: pgmap v10303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:29 smithi136 ceph-mon[125702]: pgmap v10303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:29 smithi057 ceph-mon[92072]: pgmap v10303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:31 smithi136 ceph-mon[125702]: pgmap v10304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:31 smithi057 ceph-mon[92072]: pgmap v10304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:31 smithi122 ceph-mon[125440]: pgmap v10304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:33.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:33.782+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:19:33.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:33.783+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:19:33.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:33.783+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:19:33.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:33.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:19:33.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:33.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:19:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:33 smithi136 ceph-mon[125702]: pgmap v10305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:33 smithi057 ceph-mon[92072]: pgmap v10305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:33 smithi122 ceph-mon[125440]: pgmap v10305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:35 smithi136 ceph-mon[125702]: pgmap v10306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:35 smithi057 ceph-mon[92072]: pgmap v10306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:35 smithi122 ceph-mon[125440]: pgmap v10306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:37 smithi136 ceph-mon[125702]: pgmap v10307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:37 smithi057 ceph-mon[92072]: pgmap v10307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:37 smithi122 ceph-mon[125440]: pgmap v10307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:39 smithi136 ceph-mon[125702]: pgmap v10308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:39 smithi057 ceph-mon[92072]: pgmap v10308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:39 smithi122 ceph-mon[125440]: pgmap v10308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:41 smithi136 ceph-mon[125702]: pgmap v10309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:19:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:41 smithi057 ceph-mon[92072]: pgmap v10309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:19:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:41 smithi122 ceph-mon[125440]: pgmap v10309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:19:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:42.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:19:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:19:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:19:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:19:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:19:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:19:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:19:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:43 smithi136 ceph-mon[125702]: pgmap v10310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:43 smithi057 ceph-mon[92072]: pgmap v10310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:43 smithi122 ceph-mon[125440]: pgmap v10310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:45 smithi136 ceph-mon[125702]: pgmap v10311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:45 smithi057 ceph-mon[92072]: pgmap v10311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:45 smithi122 ceph-mon[125440]: pgmap v10311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:47 smithi136 ceph-mon[125702]: pgmap v10312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:47 smithi057 ceph-mon[92072]: pgmap v10312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:47 smithi122 ceph-mon[125440]: pgmap v10312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:48.786+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:19:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:48.786+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:19:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:48.786+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:19:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:48.786+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:19:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:19:48.786+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:19:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:49 smithi136 ceph-mon[125702]: pgmap v10313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:49 smithi057 ceph-mon[92072]: pgmap v10313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:49 smithi122 ceph-mon[125440]: pgmap v10313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:51 smithi136 ceph-mon[125702]: pgmap v10314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:51 smithi057 ceph-mon[92072]: pgmap v10314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:51 smithi122 ceph-mon[125440]: pgmap v10314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:53 smithi136 ceph-mon[125702]: pgmap v10315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:53 smithi057 ceph-mon[92072]: pgmap v10315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:53 smithi122 ceph-mon[125440]: pgmap v10315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:55 smithi136 ceph-mon[125702]: pgmap v10316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:55 smithi057 ceph-mon[92072]: pgmap v10316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:55 smithi122 ceph-mon[125440]: pgmap v10316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:57 smithi136 ceph-mon[125702]: pgmap v10317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:57 smithi057 ceph-mon[92072]: pgmap v10317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:57 smithi122 ceph-mon[125440]: pgmap v10317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:19:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:19:59 smithi136 ceph-mon[125702]: pgmap v10318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:19:59 smithi057 ceph-mon[92072]: pgmap v10318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:19:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:19:59 smithi122 ceph-mon[125440]: pgmap v10318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:00.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T16:20:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T16:20:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T16:20:01.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:01 smithi136 ceph-mon[125702]: pgmap v10319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:01 smithi057 ceph-mon[92072]: pgmap v10319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:01 smithi122 ceph-mon[125440]: pgmap v10319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:03.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:03.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:20:03.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:03.801+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:20:03.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:03.801+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:20:03.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:03.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:20:03.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:03.801+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:20:03.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:03 smithi136 ceph-mon[125702]: pgmap v10320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:20:03.940 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:03 smithi057 ceph-mon[92072]: pgmap v10320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:20:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:03 smithi122 ceph-mon[125440]: pgmap v10320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:20:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:05 smithi136 ceph-mon[125702]: pgmap v10321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:20:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:05 smithi057 ceph-mon[92072]: pgmap v10321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:20:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:05 smithi122 ceph-mon[125440]: pgmap v10321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:20:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:07 smithi136 ceph-mon[125702]: pgmap v10322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:20:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:07 smithi136 ceph-mon[125702]: osdmap e717: 12 total, 12 up, 12 in 2023-03-02T16:20:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:07 smithi057 ceph-mon[92072]: pgmap v10322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:20:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:07 smithi057 ceph-mon[92072]: osdmap e717: 12 total, 12 up, 12 in 2023-03-02T16:20:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:07 smithi122 ceph-mon[125440]: pgmap v10322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:20:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:07 smithi122 ceph-mon[125440]: osdmap e717: 12 total, 12 up, 12 in 2023-03-02T16:20:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:09 smithi136 ceph-mon[125702]: pgmap v10324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:20:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:09 smithi057 ceph-mon[92072]: pgmap v10324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:20:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:09 smithi122 ceph-mon[125440]: pgmap v10324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:20:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:11.142+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:20:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:11.142+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:20:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:11.142+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 150 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:20:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:11.142+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 151 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:20:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:11 smithi136 ceph-mon[125702]: pgmap v10325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:20:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:11 smithi057 ceph-mon[92072]: pgmap v10325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:20:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:11 smithi122 ceph-mon[125440]: pgmap v10325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:20:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:13 smithi136 ceph-mon[125702]: pgmap v10326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:20:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:13 smithi057 ceph-mon[92072]: pgmap v10326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:20:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:13 smithi122 ceph-mon[125440]: pgmap v10326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:20:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:15 smithi122 ceph-mon[125440]: pgmap v10327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:20:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:15 smithi122 ceph-mon[125440]: osdmap e718: 12 total, 12 up, 12 in 2023-03-02T16:20:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:15 smithi136 ceph-mon[125702]: pgmap v10327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:20:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:15 smithi136 ceph-mon[125702]: osdmap e718: 12 total, 12 up, 12 in 2023-03-02T16:20:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:15 smithi057 ceph-mon[92072]: pgmap v10327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:20:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:15 smithi057 ceph-mon[92072]: osdmap e718: 12 total, 12 up, 12 in 2023-03-02T16:20:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:17 smithi122 ceph-mon[125440]: pgmap v10329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:20:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:17 smithi136 ceph-mon[125702]: pgmap v10329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:20:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:17 smithi057 ceph-mon[92072]: pgmap v10329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:20:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:18.806+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:20:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:18.807+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:20:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:18.807+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:20:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:18.807+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:20:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:18.807+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:20:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:19 smithi122 ceph-mon[125440]: pgmap v10330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:20:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:19 smithi136 ceph-mon[125702]: pgmap v10330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:20:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:19 smithi057 ceph-mon[92072]: pgmap v10330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:20:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:21 smithi136 ceph-mon[125702]: pgmap v10331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:20:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:21 smithi057 ceph-mon[92072]: pgmap v10331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:20:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:21 smithi122 ceph-mon[125440]: pgmap v10331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:20:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:23 smithi136 ceph-mon[125702]: pgmap v10332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T16:20:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:23 smithi057 ceph-mon[92072]: pgmap v10332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T16:20:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:23 smithi122 ceph-mon[125440]: pgmap v10332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T16:20:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:25 smithi136 ceph-mon[125702]: pgmap v10333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T16:20:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:25 smithi057 ceph-mon[92072]: pgmap v10333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T16:20:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:25 smithi122 ceph-mon[125440]: pgmap v10333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T16:20:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:27 smithi136 ceph-mon[125702]: pgmap v10334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:27 smithi057 ceph-mon[92072]: pgmap v10334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:27 smithi122 ceph-mon[125440]: pgmap v10334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:29 smithi136 ceph-mon[125702]: pgmap v10335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:29 smithi057 ceph-mon[92072]: pgmap v10335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:29 smithi122 ceph-mon[125440]: pgmap v10335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:31 smithi136 ceph-mon[125702]: pgmap v10336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:31 smithi057 ceph-mon[92072]: pgmap v10336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:31 smithi122 ceph-mon[125440]: pgmap v10336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:33.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:20:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:33.820+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:20:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:33.820+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:20:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:33.820+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:20:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:33.820+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:20:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:33 smithi136 ceph-mon[125702]: pgmap v10337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:33.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:33 smithi057 ceph-mon[92072]: pgmap v10337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:33 smithi122 ceph-mon[125440]: pgmap v10337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:35.785 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:35 smithi057 ceph-mon[92072]: pgmap v10338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:35 smithi136 ceph-mon[125702]: pgmap v10338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:35 smithi122 ceph-mon[125440]: pgmap v10338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:37 smithi136 ceph-mon[125702]: pgmap v10339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:37 smithi057 ceph-mon[92072]: pgmap v10339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:37 smithi122 ceph-mon[125440]: pgmap v10339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:39 smithi136 ceph-mon[125702]: pgmap v10340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:39 smithi057 ceph-mon[92072]: pgmap v10340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:39 smithi122 ceph-mon[125440]: pgmap v10340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:41 smithi136 ceph-mon[125702]: pgmap v10341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:41 smithi057 ceph-mon[92072]: pgmap v10341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:41 smithi122 ceph-mon[125440]: pgmap v10341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:42.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:20:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:20:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:20:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:43 smithi136 ceph-mon[125702]: pgmap v10342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:43.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:20:43.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:20:43.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:20:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:43 smithi057 ceph-mon[92072]: pgmap v10342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:20:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:20:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:20:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:43 smithi122 ceph-mon[125440]: pgmap v10342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:20:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:20:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:20:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:45 smithi136 ceph-mon[125702]: pgmap v10343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:45.875 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:45 smithi057 ceph-mon[92072]: pgmap v10343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:45 smithi122 ceph-mon[125440]: pgmap v10343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:47 smithi136 ceph-mon[125702]: pgmap v10344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:47 smithi057 ceph-mon[92072]: pgmap v10344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:47 smithi122 ceph-mon[125440]: pgmap v10344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:48.827+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:48.827+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:48.827+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:20:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:48.827+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:20:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:48.827+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:20:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:49 smithi136 ceph-mon[125702]: pgmap v10345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:49 smithi057 ceph-mon[92072]: pgmap v10345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:49 smithi122 ceph-mon[125440]: pgmap v10345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:51 smithi136 ceph-mon[125702]: pgmap v10346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:51 smithi057 ceph-mon[92072]: pgmap v10346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:51 smithi122 ceph-mon[125440]: pgmap v10346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:53 smithi136 ceph-mon[125702]: pgmap v10347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:53 smithi057 ceph-mon[92072]: pgmap v10347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:53 smithi122 ceph-mon[125440]: pgmap v10347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:55 smithi136 ceph-mon[125702]: pgmap v10348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:55 smithi057 ceph-mon[92072]: pgmap v10348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:55 smithi122 ceph-mon[125440]: pgmap v10348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:56.148+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:20:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:56.148+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:20:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:56.148+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 152 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:20:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:20:56.149+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 151 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:20:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:57 smithi136 ceph-mon[125702]: pgmap v10349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:57 smithi057 ceph-mon[92072]: pgmap v10349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:57 smithi122 ceph-mon[125440]: pgmap v10349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:20:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:20:59 smithi136 ceph-mon[125702]: pgmap v10350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:20:59 smithi057 ceph-mon[92072]: pgmap v10350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:20:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:20:59 smithi122 ceph-mon[125440]: pgmap v10350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:01 smithi136 ceph-mon[125702]: pgmap v10351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:01 smithi057 ceph-mon[92072]: pgmap v10351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:01 smithi122 ceph-mon[125440]: pgmap v10351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:03.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:03.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:21:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:03.834+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:21:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:03.834+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:21:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:03.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:21:03.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:03.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:21:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:03 smithi136 ceph-mon[125702]: pgmap v10352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:21:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:03 smithi057 ceph-mon[92072]: pgmap v10352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:21:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:03 smithi122 ceph-mon[125440]: pgmap v10352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:21:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:05 smithi136 ceph-mon[125702]: pgmap v10353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:21:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:05 smithi057 ceph-mon[92072]: pgmap v10353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:21:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:05 smithi122 ceph-mon[125440]: pgmap v10353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:21:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:07 smithi136 ceph-mon[125702]: pgmap v10354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:21:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:07 smithi136 ceph-mon[125702]: osdmap e719: 12 total, 12 up, 12 in 2023-03-02T16:21:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:07 smithi057 ceph-mon[92072]: pgmap v10354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:21:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:07 smithi057 ceph-mon[92072]: osdmap e719: 12 total, 12 up, 12 in 2023-03-02T16:21:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:07 smithi122 ceph-mon[125440]: pgmap v10354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:21:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:07 smithi122 ceph-mon[125440]: osdmap e719: 12 total, 12 up, 12 in 2023-03-02T16:21:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:09 smithi136 ceph-mon[125702]: pgmap v10356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:21:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:09 smithi057 ceph-mon[92072]: pgmap v10356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:21:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:09 smithi122 ceph-mon[125440]: pgmap v10356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:21:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:11 smithi136 ceph-mon[125702]: pgmap v10357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:21:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:11 smithi057 ceph-mon[92072]: pgmap v10357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:21:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:11 smithi122 ceph-mon[125440]: pgmap v10357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:21:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:13 smithi136 ceph-mon[125702]: pgmap v10358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:21:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:13 smithi057 ceph-mon[92072]: pgmap v10358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:21:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:13 smithi122 ceph-mon[125440]: pgmap v10358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:21:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:15 smithi122 ceph-mon[125440]: pgmap v10359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:21:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:15 smithi122 ceph-mon[125440]: osdmap e720: 12 total, 12 up, 12 in 2023-03-02T16:21:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:15 smithi136 ceph-mon[125702]: pgmap v10359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:21:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:15 smithi136 ceph-mon[125702]: osdmap e720: 12 total, 12 up, 12 in 2023-03-02T16:21:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:15 smithi057 ceph-mon[92072]: pgmap v10359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:21:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:15 smithi057 ceph-mon[92072]: osdmap e720: 12 total, 12 up, 12 in 2023-03-02T16:21:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:17 smithi136 ceph-mon[125702]: pgmap v10361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:21:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:17 smithi057 ceph-mon[92072]: pgmap v10361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:21:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:17 smithi122 ceph-mon[125440]: pgmap v10361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:21:18.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:18.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:21:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:18.841+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:21:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:18.841+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:21:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:18.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:21:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:18.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:21:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:19 smithi136 ceph-mon[125702]: pgmap v10362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:21:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:19 smithi057 ceph-mon[92072]: pgmap v10362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:21:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:19 smithi122 ceph-mon[125440]: pgmap v10362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:21:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:21 smithi136 ceph-mon[125702]: pgmap v10363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:21:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:21 smithi057 ceph-mon[92072]: pgmap v10363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:21:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:21 smithi122 ceph-mon[125440]: pgmap v10363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:21:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:23 smithi136 ceph-mon[125702]: pgmap v10364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:21:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:23 smithi057 ceph-mon[92072]: pgmap v10364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:21:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:23 smithi122 ceph-mon[125440]: pgmap v10364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:21:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:25 smithi136 ceph-mon[125702]: pgmap v10365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:21:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:25 smithi057 ceph-mon[92072]: pgmap v10365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:21:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:25 smithi122 ceph-mon[125440]: pgmap v10365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:21:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:27 smithi136 ceph-mon[125702]: pgmap v10366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:21:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:27 smithi057 ceph-mon[92072]: pgmap v10366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:21:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:27 smithi122 ceph-mon[125440]: pgmap v10366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:21:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:29 smithi136 ceph-mon[125702]: pgmap v10367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:29 smithi057 ceph-mon[92072]: pgmap v10367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:29 smithi122 ceph-mon[125440]: pgmap v10367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:31 smithi136 ceph-mon[125702]: pgmap v10368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:31 smithi057 ceph-mon[92072]: pgmap v10368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:31 smithi122 ceph-mon[125440]: pgmap v10368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:33 smithi136 ceph-mon[125702]: pgmap v10369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:33.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:33.857+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:33.857+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:33.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:33.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:21:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:33 smithi057 ceph-mon[92072]: pgmap v10369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:33 smithi122 ceph-mon[125440]: pgmap v10369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:35 smithi136 ceph-mon[125702]: pgmap v10370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:35 smithi057 ceph-mon[92072]: pgmap v10370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:35 smithi122 ceph-mon[125440]: pgmap v10370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:37 smithi136 ceph-mon[125702]: pgmap v10371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:37 smithi057 ceph-mon[92072]: pgmap v10371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:37 smithi122 ceph-mon[125440]: pgmap v10371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:39 smithi136 ceph-mon[125702]: pgmap v10372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:39 smithi057 ceph-mon[92072]: pgmap v10372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:39 smithi122 ceph-mon[125440]: pgmap v10372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:41 smithi136 ceph-mon[125702]: pgmap v10373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:41 smithi057 ceph-mon[92072]: pgmap v10373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:41 smithi122 ceph-mon[125440]: pgmap v10373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:43 smithi136 ceph-mon[125702]: pgmap v10374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:21:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:43 smithi057 ceph-mon[92072]: pgmap v10374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:21:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:43 smithi122 ceph-mon[125440]: pgmap v10374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:21:44.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:21:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:21:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:21:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:21:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:21:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:21:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:21:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:21:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:21:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:45 smithi136 ceph-mon[125702]: pgmap v10375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:45 smithi057 ceph-mon[92072]: pgmap v10375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:45 smithi122 ceph-mon[125440]: pgmap v10375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:47 smithi136 ceph-mon[125702]: pgmap v10376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:47 smithi057 ceph-mon[92072]: pgmap v10376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:48.258 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:47 smithi122 ceph-mon[125440]: pgmap v10376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:48.872+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:21:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:48.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:21:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:48.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:21:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:48.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:21:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:21:48.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:21:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:49 smithi136 ceph-mon[125702]: pgmap v10377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:49 smithi057 ceph-mon[92072]: pgmap v10377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:49 smithi122 ceph-mon[125440]: pgmap v10377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:51 smithi136 ceph-mon[125702]: pgmap v10378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:51 smithi057 ceph-mon[92072]: pgmap v10378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:51 smithi122 ceph-mon[125440]: pgmap v10378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:53 smithi136 ceph-mon[125702]: pgmap v10379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:53 smithi057 ceph-mon[92072]: pgmap v10379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:53 smithi122 ceph-mon[125440]: pgmap v10379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:21:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:55 smithi136 ceph-mon[125702]: pgmap v10380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:55 smithi057 ceph-mon[92072]: pgmap v10380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:55 smithi122 ceph-mon[125440]: pgmap v10380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:57 smithi136 ceph-mon[125702]: pgmap v10381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:57 smithi057 ceph-mon[92072]: pgmap v10381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:21:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:57 smithi122 ceph-mon[125440]: pgmap v10381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:21:59 smithi136 ceph-mon[125702]: pgmap v10382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:21:59 smithi057 ceph-mon[92072]: pgmap v10382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:21:59 smithi122 ceph-mon[125440]: pgmap v10382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:00 smithi136 ceph-mon[125702]: pgmap v10383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:00 smithi057 ceph-mon[92072]: pgmap v10383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:00 smithi122 ceph-mon[125440]: pgmap v10383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:03 smithi136 ceph-mon[125702]: pgmap v10384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:22:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:03 smithi057 ceph-mon[92072]: pgmap v10384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:22:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:03 smithi122 ceph-mon[125440]: pgmap v10384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:22:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:03.882+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:22:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:03.882+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:22:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:03.883+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:22:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:03.883+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:22:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:03.883+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:22:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:05 smithi136 ceph-mon[125702]: pgmap v10385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:22:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:05 smithi057 ceph-mon[92072]: pgmap v10385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:22:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:05 smithi122 ceph-mon[125440]: pgmap v10385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:22:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:07 smithi136 ceph-mon[125702]: pgmap v10386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:22:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:07 smithi136 ceph-mon[125702]: osdmap e721: 12 total, 12 up, 12 in 2023-03-02T16:22:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:07 smithi057 ceph-mon[92072]: pgmap v10386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:22:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:07 smithi057 ceph-mon[92072]: osdmap e721: 12 total, 12 up, 12 in 2023-03-02T16:22:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:07 smithi122 ceph-mon[125440]: pgmap v10386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:22:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:07 smithi122 ceph-mon[125440]: osdmap e721: 12 total, 12 up, 12 in 2023-03-02T16:22:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:09 smithi136 ceph-mon[125702]: pgmap v10388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:22:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:09 smithi057 ceph-mon[92072]: pgmap v10388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:22:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:09 smithi122 ceph-mon[125440]: pgmap v10388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:22:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:11 smithi136 ceph-mon[125702]: pgmap v10389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:22:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:11 smithi057 ceph-mon[92072]: pgmap v10389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:22:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:11 smithi122 ceph-mon[125440]: pgmap v10389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:22:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:13 smithi136 ceph-mon[125702]: pgmap v10390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:22:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:13 smithi057 ceph-mon[92072]: pgmap v10390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:22:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:13 smithi122 ceph-mon[125440]: pgmap v10390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:22:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:15 smithi136 ceph-mon[125702]: pgmap v10391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:22:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:15 smithi136 ceph-mon[125702]: osdmap e722: 12 total, 12 up, 12 in 2023-03-02T16:22:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:15 smithi057 ceph-mon[92072]: pgmap v10391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:22:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:15 smithi057 ceph-mon[92072]: osdmap e722: 12 total, 12 up, 12 in 2023-03-02T16:22:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:15 smithi122 ceph-mon[125440]: pgmap v10391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:22:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:15 smithi122 ceph-mon[125440]: osdmap e722: 12 total, 12 up, 12 in 2023-03-02T16:22:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:17 smithi136 ceph-mon[125702]: pgmap v10393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:22:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:17 smithi057 ceph-mon[92072]: pgmap v10393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:22:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:17 smithi122 ceph-mon[125440]: pgmap v10393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:22:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:18.885+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:22:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:18.885+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:22:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:18.885+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:22:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:18.885+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:22:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:18.885+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:22:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:19 smithi136 ceph-mon[125702]: pgmap v10394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:22:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:19 smithi057 ceph-mon[92072]: pgmap v10394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:22:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:19 smithi122 ceph-mon[125440]: pgmap v10394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:22:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:21 smithi136 ceph-mon[125702]: pgmap v10395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:22:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:21 smithi057 ceph-mon[92072]: pgmap v10395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:22:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:21 smithi122 ceph-mon[125440]: pgmap v10395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:22:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:23 smithi136 ceph-mon[125702]: pgmap v10396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:22:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:23 smithi057 ceph-mon[92072]: pgmap v10396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:22:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:23 smithi122 ceph-mon[125440]: pgmap v10396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:22:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:25 smithi136 ceph-mon[125702]: pgmap v10397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:22:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:25 smithi057 ceph-mon[92072]: pgmap v10397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:22:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:25 smithi122 ceph-mon[125440]: pgmap v10397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:22:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:27 smithi136 ceph-mon[125702]: pgmap v10398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:22:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:27 smithi057 ceph-mon[92072]: pgmap v10398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:22:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:27 smithi122 ceph-mon[125440]: pgmap v10398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:22:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:29 smithi136 ceph-mon[125702]: pgmap v10399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:29 smithi057 ceph-mon[92072]: pgmap v10399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:29 smithi122 ceph-mon[125440]: pgmap v10399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:31 smithi136 ceph-mon[125702]: pgmap v10400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:31 smithi057 ceph-mon[92072]: pgmap v10400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:31 smithi122 ceph-mon[125440]: pgmap v10400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:33 smithi136 ceph-mon[125702]: pgmap v10401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:33.900+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:33.900+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:33.900+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:33.900+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:33.900+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:22:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:33 smithi057 ceph-mon[92072]: pgmap v10401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:33 smithi122 ceph-mon[125440]: pgmap v10401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:35 smithi136 ceph-mon[125702]: pgmap v10402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:35 smithi057 ceph-mon[92072]: pgmap v10402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:35 smithi122 ceph-mon[125440]: pgmap v10402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:37 smithi136 ceph-mon[125702]: pgmap v10403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:37 smithi057 ceph-mon[92072]: pgmap v10403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:37 smithi122 ceph-mon[125440]: pgmap v10403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:39 smithi136 ceph-mon[125702]: pgmap v10404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:39 smithi057 ceph-mon[92072]: pgmap v10404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:39 smithi122 ceph-mon[125440]: pgmap v10404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:41 smithi136 ceph-mon[125702]: pgmap v10405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:41 smithi057 ceph-mon[92072]: pgmap v10405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:41 smithi122 ceph-mon[125440]: pgmap v10405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:43 smithi136 ceph-mon[125702]: pgmap v10406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:43 smithi057 ceph-mon[92072]: pgmap v10406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:43 smithi122 ceph-mon[125440]: pgmap v10406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:22:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:22:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:22:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:45 smithi136 ceph-mon[125702]: pgmap v10407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:22:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:22:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:22:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:45 smithi057 ceph-mon[92072]: pgmap v10407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:22:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:22:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:22:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:45 smithi122 ceph-mon[125440]: pgmap v10407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:22:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:22:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:22:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:47 smithi136 ceph-mon[125702]: pgmap v10408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:47 smithi057 ceph-mon[92072]: pgmap v10408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:47 smithi122 ceph-mon[125440]: pgmap v10408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:48.911+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:22:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:48.911+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:22:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:48.911+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:22:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:48.911+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:22:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:22:48.911+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:22:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:49 smithi136 ceph-mon[125702]: pgmap v10409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:49 smithi057 ceph-mon[92072]: pgmap v10409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:49 smithi122 ceph-mon[125440]: pgmap v10409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:51 smithi136 ceph-mon[125702]: pgmap v10410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:51 smithi057 ceph-mon[92072]: pgmap v10410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:51 smithi122 ceph-mon[125440]: pgmap v10410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:53 smithi136 ceph-mon[125702]: pgmap v10411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:53 smithi057 ceph-mon[92072]: pgmap v10411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:53 smithi122 ceph-mon[125440]: pgmap v10411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:55 smithi122 ceph-mon[125440]: pgmap v10412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:55 smithi136 ceph-mon[125702]: pgmap v10412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:55 smithi057 ceph-mon[92072]: pgmap v10412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:57 smithi136 ceph-mon[125702]: pgmap v10413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:57 smithi057 ceph-mon[92072]: pgmap v10413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:57 smithi122 ceph-mon[125440]: pgmap v10413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:22:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:22:59 smithi136 ceph-mon[125702]: pgmap v10414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:22:59 smithi057 ceph-mon[92072]: pgmap v10414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:22:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:22:59 smithi122 ceph-mon[125440]: pgmap v10414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:01 smithi136 ceph-mon[125702]: pgmap v10415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:01 smithi057 ceph-mon[92072]: pgmap v10415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:01 smithi122 ceph-mon[125440]: pgmap v10415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:03 smithi136 ceph-mon[125702]: pgmap v10416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:23:03.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:03.914+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:23:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:03.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:23:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:03.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:23:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:03.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:23:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:03.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:23:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:03 smithi057 ceph-mon[92072]: pgmap v10416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:23:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:03 smithi122 ceph-mon[125440]: pgmap v10416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:23:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:05 smithi057 ceph-mon[92072]: pgmap v10417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:23:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:05 smithi122 ceph-mon[125440]: pgmap v10417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:23:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:05 smithi136 ceph-mon[125702]: pgmap v10417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:23:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:07 smithi057 ceph-mon[92072]: pgmap v10418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:23:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:07 smithi122 ceph-mon[125440]: pgmap v10418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:23:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:07 smithi136 ceph-mon[125702]: pgmap v10418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:23:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:09 smithi057 ceph-mon[92072]: pgmap v10419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:23:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:09 smithi122 ceph-mon[125440]: pgmap v10419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:23:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:09 smithi136 ceph-mon[125702]: pgmap v10419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:23:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:11.168+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:23:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:11.168+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:23:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:11.168+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 153 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:23:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:11.168+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 152 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:23:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:11 smithi057 ceph-mon[92072]: pgmap v10420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:23:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:11 smithi122 ceph-mon[125440]: pgmap v10420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:23:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:11 smithi136 ceph-mon[125702]: pgmap v10420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:23:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:12 smithi057 ceph-mon[92072]: osdmap e723: 12 total, 12 up, 12 in 2023-03-02T16:23:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:12 smithi122 ceph-mon[125440]: osdmap e723: 12 total, 12 up, 12 in 2023-03-02T16:23:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:12 smithi136 ceph-mon[125702]: osdmap e723: 12 total, 12 up, 12 in 2023-03-02T16:23:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:13 smithi057 ceph-mon[92072]: pgmap v10422: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:13 smithi122 ceph-mon[125440]: pgmap v10422: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:13 smithi136 ceph-mon[125702]: pgmap v10422: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:15 smithi057 ceph-mon[92072]: pgmap v10423: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:15 smithi122 ceph-mon[125440]: pgmap v10423: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:15 smithi136 ceph-mon[125702]: pgmap v10423: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:17 smithi057 ceph-mon[92072]: pgmap v10424: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:17 smithi122 ceph-mon[125440]: pgmap v10424: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:17 smithi136 ceph-mon[125702]: pgmap v10424: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:18.930+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:23:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:18.930+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:23:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:18.930+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:23:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:18.930+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:23:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:18.930+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:23:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:19 smithi057 ceph-mon[92072]: pgmap v10425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:23:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:19 smithi057 ceph-mon[92072]: osdmap e724: 12 total, 12 up, 12 in 2023-03-02T16:23:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:19 smithi122 ceph-mon[125440]: pgmap v10425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:23:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:19 smithi122 ceph-mon[125440]: osdmap e724: 12 total, 12 up, 12 in 2023-03-02T16:23:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:19 smithi136 ceph-mon[125702]: pgmap v10425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:23:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:19 smithi136 ceph-mon[125702]: osdmap e724: 12 total, 12 up, 12 in 2023-03-02T16:23:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:21 smithi057 ceph-mon[92072]: pgmap v10427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 356 B/s wr, 12 op/s 2023-03-02T16:23:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:21 smithi122 ceph-mon[125440]: pgmap v10427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 356 B/s wr, 12 op/s 2023-03-02T16:23:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:21 smithi136 ceph-mon[125702]: pgmap v10427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 356 B/s wr, 12 op/s 2023-03-02T16:23:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:23 smithi057 ceph-mon[92072]: pgmap v10428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:23 smithi122 ceph-mon[125440]: pgmap v10428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:23 smithi136 ceph-mon[125702]: pgmap v10428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:25 smithi057 ceph-mon[92072]: pgmap v10429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:25 smithi122 ceph-mon[125440]: pgmap v10429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:25 smithi136 ceph-mon[125702]: pgmap v10429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:27 smithi057 ceph-mon[92072]: pgmap v10430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:27 smithi122 ceph-mon[125440]: pgmap v10430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:27 smithi136 ceph-mon[125702]: pgmap v10430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:23:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:29 smithi057 ceph-mon[92072]: pgmap v10431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:23:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:29 smithi122 ceph-mon[125440]: pgmap v10431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:23:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:29 smithi136 ceph-mon[125702]: pgmap v10431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:23:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:31 smithi122 ceph-mon[125440]: pgmap v10432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:23:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:31 smithi136 ceph-mon[125702]: pgmap v10432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:23:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:31 smithi057 ceph-mon[92072]: pgmap v10432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:23:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:33.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:23:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:33.944+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:23:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:33.944+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:23:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:33.944+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:23:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:33.944+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:23:33.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:33 smithi122 ceph-mon[125440]: pgmap v10433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:33 smithi136 ceph-mon[125702]: pgmap v10433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:33 smithi057 ceph-mon[92072]: pgmap v10433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:35 smithi136 ceph-mon[125702]: pgmap v10434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:35 smithi057 ceph-mon[92072]: pgmap v10434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:35 smithi122 ceph-mon[125440]: pgmap v10434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:37 smithi136 ceph-mon[125702]: pgmap v10435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:37 smithi057 ceph-mon[92072]: pgmap v10435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:37 smithi122 ceph-mon[125440]: pgmap v10435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:39 smithi136 ceph-mon[125702]: pgmap v10436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:39 smithi057 ceph-mon[92072]: pgmap v10436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:39 smithi122 ceph-mon[125440]: pgmap v10436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:41 smithi136 ceph-mon[125702]: pgmap v10437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:41 smithi057 ceph-mon[92072]: pgmap v10437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:41 smithi122 ceph-mon[125440]: pgmap v10437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:43 smithi136 ceph-mon[125702]: pgmap v10438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:43 smithi057 ceph-mon[92072]: pgmap v10438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:43 smithi122 ceph-mon[125440]: pgmap v10438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:45 smithi136 ceph-mon[125702]: pgmap v10439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:23:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:23:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:23:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:23:46.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:45 smithi057 ceph-mon[92072]: pgmap v10439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:46.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:23:46.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:23:46.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:23:46.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:23:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:45 smithi122 ceph-mon[125440]: pgmap v10439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:23:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:23:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:23:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:23:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:47 smithi136 ceph-mon[125702]: pgmap v10440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:47 smithi057 ceph-mon[92072]: pgmap v10440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:47 smithi122 ceph-mon[125440]: pgmap v10440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:48.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:48.949+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:23:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:48.949+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:23:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:48.949+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:23:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:48.949+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:23:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:23:48.949+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:23:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:49 smithi136 ceph-mon[125702]: pgmap v10441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:49 smithi057 ceph-mon[92072]: pgmap v10441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:49 smithi122 ceph-mon[125440]: pgmap v10441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:51 smithi136 ceph-mon[125702]: pgmap v10442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:51 smithi057 ceph-mon[92072]: pgmap v10442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:51 smithi122 ceph-mon[125440]: pgmap v10442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:53 smithi136 ceph-mon[125702]: pgmap v10443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:53 smithi057 ceph-mon[92072]: pgmap v10443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:53 smithi122 ceph-mon[125440]: pgmap v10443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:23:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:55 smithi136 ceph-mon[125702]: pgmap v10444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:55 smithi057 ceph-mon[92072]: pgmap v10444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:55 smithi122 ceph-mon[125440]: pgmap v10444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:57 smithi136 ceph-mon[125702]: pgmap v10445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:57 smithi057 ceph-mon[92072]: pgmap v10445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:23:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:57 smithi122 ceph-mon[125440]: pgmap v10445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:23:59 smithi136 ceph-mon[125702]: pgmap v10446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:23:59 smithi057 ceph-mon[92072]: pgmap v10446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:23:59 smithi122 ceph-mon[125440]: pgmap v10446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:01 smithi136 ceph-mon[125702]: pgmap v10447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:01 smithi057 ceph-mon[92072]: pgmap v10447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:01 smithi122 ceph-mon[125440]: pgmap v10447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:03.962+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:24:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:03.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:24:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:03.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:24:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:03.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:24:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:03.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:24:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:03 smithi136 ceph-mon[125702]: pgmap v10448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:24:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:03 smithi057 ceph-mon[92072]: pgmap v10448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:24:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:03 smithi122 ceph-mon[125440]: pgmap v10448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:24:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:05 smithi136 ceph-mon[125702]: pgmap v10449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:24:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:05 smithi057 ceph-mon[92072]: pgmap v10449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:24:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:05 smithi122 ceph-mon[125440]: pgmap v10449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:24:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:07 smithi136 ceph-mon[125702]: pgmap v10450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:24:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:07 smithi057 ceph-mon[92072]: pgmap v10450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:24:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:07 smithi122 ceph-mon[125440]: pgmap v10450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:24:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:08 smithi136 ceph-mon[125702]: pgmap v10451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:24:09.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:08 smithi057 ceph-mon[92072]: pgmap v10451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:24:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:08 smithi122 ceph-mon[125440]: pgmap v10451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:24:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:11 smithi136 ceph-mon[125702]: pgmap v10452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:24:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:11 smithi057 ceph-mon[92072]: pgmap v10452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:24:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:11 smithi122 ceph-mon[125440]: pgmap v10452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:24:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:12 smithi136 ceph-mon[125702]: osdmap e725: 12 total, 12 up, 12 in 2023-03-02T16:24:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:12 smithi057 ceph-mon[92072]: osdmap e725: 12 total, 12 up, 12 in 2023-03-02T16:24:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:12 smithi122 ceph-mon[125440]: osdmap e725: 12 total, 12 up, 12 in 2023-03-02T16:24:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:13 smithi136 ceph-mon[125702]: pgmap v10454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:13 smithi057 ceph-mon[92072]: pgmap v10454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:13 smithi122 ceph-mon[125440]: pgmap v10454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:15 smithi136 ceph-mon[125702]: pgmap v10455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:15 smithi057 ceph-mon[92072]: pgmap v10455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:15 smithi122 ceph-mon[125440]: pgmap v10455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:17 smithi136 ceph-mon[125702]: pgmap v10456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:17 smithi057 ceph-mon[92072]: pgmap v10456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:17 smithi122 ceph-mon[125440]: pgmap v10456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:18.973+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:24:18.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:18.973+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:24:18.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:18.973+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:24:18.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:18.973+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:24:18.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:18.974+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:24:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:19 smithi136 ceph-mon[125702]: pgmap v10457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:19 smithi136 ceph-mon[125702]: osdmap e726: 12 total, 12 up, 12 in 2023-03-02T16:24:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:19 smithi057 ceph-mon[92072]: pgmap v10457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:19 smithi057 ceph-mon[92072]: osdmap e726: 12 total, 12 up, 12 in 2023-03-02T16:24:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:19 smithi122 ceph-mon[125440]: pgmap v10457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:24:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:19 smithi122 ceph-mon[125440]: osdmap e726: 12 total, 12 up, 12 in 2023-03-02T16:24:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:21 smithi136 ceph-mon[125702]: pgmap v10459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:24:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:21 smithi057 ceph-mon[92072]: pgmap v10459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:24:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:21 smithi122 ceph-mon[125440]: pgmap v10459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:24:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:23 smithi136 ceph-mon[125702]: pgmap v10460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:24:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:23 smithi057 ceph-mon[92072]: pgmap v10460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:24:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:23 smithi122 ceph-mon[125440]: pgmap v10460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:24:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:25 smithi136 ceph-mon[125702]: pgmap v10461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:24:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:25 smithi057 ceph-mon[92072]: pgmap v10461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:24:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:25 smithi122 ceph-mon[125440]: pgmap v10461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:24:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:27 smithi136 ceph-mon[125702]: pgmap v10462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:24:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:27 smithi057 ceph-mon[92072]: pgmap v10462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:24:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:27 smithi122 ceph-mon[125440]: pgmap v10462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:24:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:29 smithi136 ceph-mon[125702]: pgmap v10463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:24:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:29 smithi057 ceph-mon[92072]: pgmap v10463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:24:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:29 smithi122 ceph-mon[125440]: pgmap v10463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:24:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:31 smithi136 ceph-mon[125702]: pgmap v10464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:24:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:31 smithi057 ceph-mon[92072]: pgmap v10464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:24:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:31 smithi122 ceph-mon[125440]: pgmap v10464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:24:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:33 smithi136 ceph-mon[125702]: pgmap v10465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:33 smithi057 ceph-mon[92072]: pgmap v10465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:33 smithi122 ceph-mon[125440]: pgmap v10465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:33.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:24:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:33.990+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:24:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:33.990+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:24:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:33.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:24:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:33.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:24:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:35 smithi136 ceph-mon[125702]: pgmap v10466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:35 smithi057 ceph-mon[92072]: pgmap v10466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:35 smithi122 ceph-mon[125440]: pgmap v10466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:37 smithi136 ceph-mon[125702]: pgmap v10467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:37 smithi057 ceph-mon[92072]: pgmap v10467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:37 smithi122 ceph-mon[125440]: pgmap v10467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:39 smithi136 ceph-mon[125702]: pgmap v10468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:39 smithi057 ceph-mon[92072]: pgmap v10468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:39 smithi122 ceph-mon[125440]: pgmap v10468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:41 smithi136 ceph-mon[125702]: pgmap v10469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:41 smithi057 ceph-mon[92072]: pgmap v10469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:41 smithi122 ceph-mon[125440]: pgmap v10469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:43 smithi136 ceph-mon[125702]: pgmap v10470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:43 smithi057 ceph-mon[92072]: pgmap v10470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:43 smithi122 ceph-mon[125440]: pgmap v10470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:45 smithi136 ceph-mon[125702]: pgmap v10471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:24:45.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:45 smithi057 ceph-mon[92072]: pgmap v10471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:24:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:45 smithi122 ceph-mon[125440]: pgmap v10471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:24:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:24:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:24:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:24:46.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:24:46.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:24:46.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:24:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:24:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:24:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:24:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:47 smithi057 ceph-mon[92072]: pgmap v10472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:47 smithi122 ceph-mon[125440]: pgmap v10472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:47 smithi136 ceph-mon[125702]: pgmap v10472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:49.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:24:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:49.001+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:24:49.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:49.001+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:24:49.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:49.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:24:49.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:24:49.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:24:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:49 smithi057 ceph-mon[92072]: pgmap v10473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:49 smithi122 ceph-mon[125440]: pgmap v10473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:49 smithi136 ceph-mon[125702]: pgmap v10473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:51 smithi057 ceph-mon[92072]: pgmap v10474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:51 smithi122 ceph-mon[125440]: pgmap v10474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:51 smithi136 ceph-mon[125702]: pgmap v10474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:53 smithi057 ceph-mon[92072]: pgmap v10475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:53 smithi122 ceph-mon[125440]: pgmap v10475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:53 smithi136 ceph-mon[125702]: pgmap v10475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:55 smithi057 ceph-mon[92072]: pgmap v10476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:55 smithi122 ceph-mon[125440]: pgmap v10476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:55 smithi136 ceph-mon[125702]: pgmap v10476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:57 smithi057 ceph-mon[92072]: pgmap v10477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:57 smithi122 ceph-mon[125440]: pgmap v10477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:57 smithi136 ceph-mon[125702]: pgmap v10477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:24:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:24:59 smithi057 ceph-mon[92072]: pgmap v10478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:24:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:24:59 smithi122 ceph-mon[125440]: pgmap v10478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:24:59 smithi136 ceph-mon[125702]: pgmap v10478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:01.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:01 smithi057 ceph-mon[92072]: pgmap v10479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:01 smithi122 ceph-mon[125440]: pgmap v10479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:01 smithi136 ceph-mon[125702]: pgmap v10479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:03 smithi057 ceph-mon[92072]: pgmap v10480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:25:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:03 smithi122 ceph-mon[125440]: pgmap v10480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:25:04.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:04.013+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:25:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:04.014+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:25:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:04.014+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:25:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:04.014+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:25:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:04.014+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:25:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:03 smithi136 ceph-mon[125702]: pgmap v10480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:25:05.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:05 smithi057 ceph-mon[92072]: pgmap v10481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:25:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:05 smithi122 ceph-mon[125440]: pgmap v10481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:25:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:05 smithi136 ceph-mon[125702]: pgmap v10481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:25:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:07 smithi057 ceph-mon[92072]: pgmap v10482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:25:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:07 smithi122 ceph-mon[125440]: pgmap v10482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:25:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:07 smithi136 ceph-mon[125702]: pgmap v10482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:25:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:09 smithi057 ceph-mon[92072]: pgmap v10483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:25:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:09 smithi122 ceph-mon[125440]: pgmap v10483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:25:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:09 smithi136 ceph-mon[125702]: pgmap v10483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:25:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:11 smithi057 ceph-mon[92072]: pgmap v10484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:25:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:11 smithi057 ceph-mon[92072]: osdmap e727: 12 total, 12 up, 12 in 2023-03-02T16:25:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:11 smithi122 ceph-mon[125440]: pgmap v10484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:25:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:11 smithi122 ceph-mon[125440]: osdmap e727: 12 total, 12 up, 12 in 2023-03-02T16:25:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:11 smithi136 ceph-mon[125702]: pgmap v10484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:25:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:11 smithi136 ceph-mon[125702]: osdmap e727: 12 total, 12 up, 12 in 2023-03-02T16:25:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:13 smithi057 ceph-mon[92072]: pgmap v10486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:25:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:13 smithi122 ceph-mon[125440]: pgmap v10486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:25:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:13 smithi136 ceph-mon[125702]: pgmap v10486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:25:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:15 smithi136 ceph-mon[125702]: pgmap v10487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:25:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:15 smithi136 ceph-mon[125702]: osdmap e728: 12 total, 12 up, 12 in 2023-03-02T16:25:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:15 smithi057 ceph-mon[92072]: pgmap v10487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:25:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:15 smithi057 ceph-mon[92072]: osdmap e728: 12 total, 12 up, 12 in 2023-03-02T16:25:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:15 smithi122 ceph-mon[125440]: pgmap v10487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:25:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:15 smithi122 ceph-mon[125440]: osdmap e728: 12 total, 12 up, 12 in 2023-03-02T16:25:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:17 smithi136 ceph-mon[125702]: pgmap v10489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:25:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:17 smithi057 ceph-mon[92072]: pgmap v10489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:25:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:17 smithi122 ceph-mon[125440]: pgmap v10489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:25:19.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:19.022+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:25:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:19.022+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:25:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:19.022+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:25:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:19.022+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:25:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:19.022+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:25:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:19 smithi136 ceph-mon[125702]: pgmap v10490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:25:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:19 smithi057 ceph-mon[92072]: pgmap v10490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:25:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:19 smithi122 ceph-mon[125440]: pgmap v10490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:25:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:21 smithi136 ceph-mon[125702]: pgmap v10491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T16:25:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:21 smithi057 ceph-mon[92072]: pgmap v10491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T16:25:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:21 smithi122 ceph-mon[125440]: pgmap v10491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T16:25:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:23 smithi136 ceph-mon[125702]: pgmap v10492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:25:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:23 smithi057 ceph-mon[92072]: pgmap v10492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:25:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:23 smithi122 ceph-mon[125440]: pgmap v10492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:25:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:25 smithi136 ceph-mon[125702]: pgmap v10493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:25:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:25 smithi057 ceph-mon[92072]: pgmap v10493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:25:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:25 smithi122 ceph-mon[125440]: pgmap v10493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:25:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:27 smithi136 ceph-mon[125702]: pgmap v10494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:25:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:27 smithi057 ceph-mon[92072]: pgmap v10494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:25:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:27 smithi122 ceph-mon[125440]: pgmap v10494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:25:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:29 smithi136 ceph-mon[125702]: pgmap v10495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:25:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:29 smithi057 ceph-mon[92072]: pgmap v10495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:25:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:29 smithi122 ceph-mon[125440]: pgmap v10495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:25:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:31 smithi136 ceph-mon[125702]: pgmap v10496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:31 smithi057 ceph-mon[92072]: pgmap v10496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:31 smithi122 ceph-mon[125440]: pgmap v10496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:33 smithi136 ceph-mon[125702]: pgmap v10497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:33 smithi057 ceph-mon[92072]: pgmap v10497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:33 smithi122 ceph-mon[125440]: pgmap v10497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:34.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:25:34.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:34.034+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:25:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:34.034+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:25:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:34.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:25:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:34.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:25:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:35 smithi136 ceph-mon[125702]: pgmap v10498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:35.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:35 smithi057 ceph-mon[92072]: pgmap v10498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:35 smithi122 ceph-mon[125440]: pgmap v10498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:37 smithi136 ceph-mon[125702]: pgmap v10499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:37 smithi057 ceph-mon[92072]: pgmap v10499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:37.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:37 smithi122 ceph-mon[125440]: pgmap v10499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:39 smithi057 ceph-mon[92072]: pgmap v10500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:39 smithi122 ceph-mon[125440]: pgmap v10500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:39 smithi136 ceph-mon[125702]: pgmap v10500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:41 smithi057 ceph-mon[92072]: pgmap v10501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:41 smithi122 ceph-mon[125440]: pgmap v10501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:41 smithi136 ceph-mon[125702]: pgmap v10501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:43 smithi057 ceph-mon[92072]: pgmap v10502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:43.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:43 smithi122 ceph-mon[125440]: pgmap v10502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:43 smithi136 ceph-mon[125702]: pgmap v10502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:45 smithi057 ceph-mon[92072]: pgmap v10503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:45 smithi122 ceph-mon[125440]: pgmap v10503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:45 smithi136 ceph-mon[125702]: pgmap v10503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:46.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:25:46.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:25:47.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:25:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:47 smithi057 ceph-mon[92072]: pgmap v10504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:25:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:25:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:25:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:47 smithi122 ceph-mon[125440]: pgmap v10504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:25:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:25:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:25:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:47 smithi136 ceph-mon[125702]: pgmap v10504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:25:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:25:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:25:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:49.049+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:25:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:49.050+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:25:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:49.050+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:25:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:49.050+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:25:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:25:49.050+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:25:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:49 smithi057 ceph-mon[92072]: pgmap v10505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:49 smithi122 ceph-mon[125440]: pgmap v10505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:49 smithi136 ceph-mon[125702]: pgmap v10505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:51 smithi057 ceph-mon[92072]: pgmap v10506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:51 smithi122 ceph-mon[125440]: pgmap v10506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:51 smithi136 ceph-mon[125702]: pgmap v10506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:53 smithi057 ceph-mon[92072]: pgmap v10507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:53 smithi122 ceph-mon[125440]: pgmap v10507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:53 smithi136 ceph-mon[125702]: pgmap v10507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:55 smithi057 ceph-mon[92072]: pgmap v10508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:55 smithi122 ceph-mon[125440]: pgmap v10508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:55 smithi136 ceph-mon[125702]: pgmap v10508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:57 smithi057 ceph-mon[92072]: pgmap v10509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:57 smithi122 ceph-mon[125440]: pgmap v10509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:57 smithi136 ceph-mon[125702]: pgmap v10509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:25:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:25:59 smithi057 ceph-mon[92072]: pgmap v10510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:25:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:25:59 smithi122 ceph-mon[125440]: pgmap v10510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:25:59 smithi136 ceph-mon[125702]: pgmap v10510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:01 smithi057 ceph-mon[92072]: pgmap v10511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:01 smithi122 ceph-mon[125440]: pgmap v10511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:01 smithi136 ceph-mon[125702]: pgmap v10511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:03 smithi057 ceph-mon[92072]: pgmap v10512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:26:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:03 smithi122 ceph-mon[125440]: pgmap v10512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:26:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:04.065+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:26:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:04.066+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:26:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:04.066+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:26:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:04.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:26:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:04.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:26:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:03 smithi136 ceph-mon[125702]: pgmap v10512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:26:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:05 smithi057 ceph-mon[92072]: pgmap v10513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:26:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:05 smithi122 ceph-mon[125440]: pgmap v10513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:26:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:05 smithi136 ceph-mon[125702]: pgmap v10513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:26:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:07 smithi057 ceph-mon[92072]: pgmap v10514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:26:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:07 smithi122 ceph-mon[125440]: pgmap v10514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:26:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:07 smithi136 ceph-mon[125702]: pgmap v10514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:26:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:09 smithi057 ceph-mon[92072]: pgmap v10515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:26:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:09 smithi122 ceph-mon[125440]: pgmap v10515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:26:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:09 smithi136 ceph-mon[125702]: pgmap v10515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:26:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:11.196+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:26:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:11.196+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:26:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:11.196+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 154 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:26:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:11.196+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 153 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:26:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:11 smithi057 ceph-mon[92072]: pgmap v10516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:26:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:11 smithi057 ceph-mon[92072]: osdmap e729: 12 total, 12 up, 12 in 2023-03-02T16:26:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:11 smithi122 ceph-mon[125440]: pgmap v10516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:26:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:11 smithi122 ceph-mon[125440]: osdmap e729: 12 total, 12 up, 12 in 2023-03-02T16:26:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:11 smithi136 ceph-mon[125702]: pgmap v10516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:26:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:11 smithi136 ceph-mon[125702]: osdmap e729: 12 total, 12 up, 12 in 2023-03-02T16:26:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:13 smithi057 ceph-mon[92072]: pgmap v10518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:26:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:13 smithi122 ceph-mon[125440]: pgmap v10518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:26:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:13 smithi136 ceph-mon[125702]: pgmap v10518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:26:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:15 smithi136 ceph-mon[125702]: pgmap v10519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:26:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:15 smithi136 ceph-mon[125702]: osdmap e730: 12 total, 12 up, 12 in 2023-03-02T16:26:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:15 smithi057 ceph-mon[92072]: pgmap v10519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:26:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:15 smithi057 ceph-mon[92072]: osdmap e730: 12 total, 12 up, 12 in 2023-03-02T16:26:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:15 smithi122 ceph-mon[125440]: pgmap v10519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:26:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:15 smithi122 ceph-mon[125440]: osdmap e730: 12 total, 12 up, 12 in 2023-03-02T16:26:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:17 smithi136 ceph-mon[125702]: pgmap v10521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:26:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:17 smithi057 ceph-mon[92072]: pgmap v10521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:26:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:17 smithi122 ceph-mon[125440]: pgmap v10521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:26:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:19.078+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:26:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:19.079+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:26:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:19.079+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:26:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:19.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:26:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:19.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:26:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:19 smithi136 ceph-mon[125702]: pgmap v10522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:26:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:19 smithi057 ceph-mon[92072]: pgmap v10522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:26:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:19 smithi122 ceph-mon[125440]: pgmap v10522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:26:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:21 smithi136 ceph-mon[125702]: pgmap v10523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:26:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:21 smithi057 ceph-mon[92072]: pgmap v10523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:26:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:21 smithi122 ceph-mon[125440]: pgmap v10523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:26:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:23 smithi136 ceph-mon[125702]: pgmap v10524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:26:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:23 smithi057 ceph-mon[92072]: pgmap v10524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:26:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:23 smithi122 ceph-mon[125440]: pgmap v10524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:26:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:25 smithi136 ceph-mon[125702]: pgmap v10525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:26:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:25 smithi057 ceph-mon[92072]: pgmap v10525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:26:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:25 smithi122 ceph-mon[125440]: pgmap v10525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:26:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:27 smithi136 ceph-mon[125702]: pgmap v10526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:26:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:27 smithi057 ceph-mon[92072]: pgmap v10526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:26:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:27 smithi122 ceph-mon[125440]: pgmap v10526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:26:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:29 smithi136 ceph-mon[125702]: pgmap v10527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:26:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:29 smithi057 ceph-mon[92072]: pgmap v10527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:26:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:29 smithi122 ceph-mon[125440]: pgmap v10527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:26:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:31 smithi057 ceph-mon[92072]: pgmap v10528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:31 smithi122 ceph-mon[125440]: pgmap v10528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:31 smithi136 ceph-mon[125702]: pgmap v10528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:33 smithi057 ceph-mon[92072]: pgmap v10529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:33 smithi122 ceph-mon[125440]: pgmap v10529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:33 smithi136 ceph-mon[125702]: pgmap v10529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:34.094+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:26:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:34.094+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:26:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:34.094+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:26:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:34.094+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:26:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:34.094+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:26:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:35 smithi057 ceph-mon[92072]: pgmap v10530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:35 smithi122 ceph-mon[125440]: pgmap v10530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:35 smithi136 ceph-mon[125702]: pgmap v10530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:37.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:37 smithi057 ceph-mon[92072]: pgmap v10531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:37 smithi122 ceph-mon[125440]: pgmap v10531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:37 smithi136 ceph-mon[125702]: pgmap v10531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:39 smithi057 ceph-mon[92072]: pgmap v10532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:39 smithi122 ceph-mon[125440]: pgmap v10532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:39 smithi136 ceph-mon[125702]: pgmap v10532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:41 smithi057 ceph-mon[92072]: pgmap v10533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:41 smithi122 ceph-mon[125440]: pgmap v10533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:41 smithi136 ceph-mon[125702]: pgmap v10533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:43 smithi057 ceph-mon[92072]: pgmap v10534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:43 smithi122 ceph-mon[125440]: pgmap v10534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:43 smithi136 ceph-mon[125702]: pgmap v10534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:45 smithi057 ceph-mon[92072]: pgmap v10535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:45 smithi122 ceph-mon[125440]: pgmap v10535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:45 smithi136 ceph-mon[125702]: pgmap v10535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:47 smithi057 ceph-mon[92072]: pgmap v10536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:26:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:47 smithi122 ceph-mon[125440]: pgmap v10536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:26:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:47 smithi136 ceph-mon[125702]: pgmap v10536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:26:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:49.110+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:26:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:49.111+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:26:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:49.111+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:26:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:49.111+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:26:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:26:49.111+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:26:49.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:49 smithi057 ceph-mon[92072]: pgmap v10537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:49 smithi122 ceph-mon[125440]: pgmap v10537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:49 smithi136 ceph-mon[125702]: pgmap v10537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: pgmap v10538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:26:51.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:26:51.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: pgmap v10538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:26:51.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:26:51.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: pgmap v10538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:26:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:26:51.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:26:51.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:26:51.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:26:52.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:52 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:26:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:52 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:26:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:52 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 91528k 2023-03-02T16:26:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:52 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 93724807: error parsing value: Value '93724807' is below minimum 939524096 2023-03-02T16:26:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:52 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:26:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:52 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:26:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:52 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:26:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:52 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:26:52.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:52 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 91528k 2023-03-02T16:26:52.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:52 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 93724807: error parsing value: Value '93724807' is below minimum 939524096 2023-03-02T16:26:52.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:52 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:26:52.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:52 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:26:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:52 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:26:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:52 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:26:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:52 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 91528k 2023-03-02T16:26:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:52 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 93724807: error parsing value: Value '93724807' is below minimum 939524096 2023-03-02T16:26:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:52 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:26:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:52 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:26:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:53 smithi136 ceph-mon[125702]: pgmap v10539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:53 smithi057 ceph-mon[92072]: pgmap v10539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:53 smithi122 ceph-mon[125440]: pgmap v10539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:26:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:55 smithi136 ceph-mon[125702]: pgmap v10540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:26:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:55 smithi057 ceph-mon[92072]: pgmap v10540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:26:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:55 smithi122 ceph-mon[125440]: pgmap v10540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:26:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:57 smithi136 ceph-mon[125702]: pgmap v10541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:26:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:57 smithi057 ceph-mon[92072]: pgmap v10541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:26:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:57 smithi122 ceph-mon[125440]: pgmap v10541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:26:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:26:59 smithi136 ceph-mon[125702]: pgmap v10542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T16:26:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:26:59 smithi057 ceph-mon[92072]: pgmap v10542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T16:26:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:26:59 smithi122 ceph-mon[125440]: pgmap v10542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T16:27:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:01 smithi136 ceph-mon[125702]: pgmap v10543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T16:27:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:01 smithi057 ceph-mon[92072]: pgmap v10543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T16:27:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:01 smithi122 ceph-mon[125440]: pgmap v10543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T16:27:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:03 smithi136 ceph-mon[125702]: pgmap v10544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:27:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:03 smithi057 ceph-mon[92072]: pgmap v10544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:27:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:03 smithi122 ceph-mon[125440]: pgmap v10544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:27:04.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:04.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:27:04.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:04.122+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:27:04.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:04.122+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:27:04.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:04.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:27:04.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:04.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:27:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:05 smithi136 ceph-mon[125702]: pgmap v10545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:27:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:05 smithi057 ceph-mon[92072]: pgmap v10545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:27:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:05 smithi122 ceph-mon[125440]: pgmap v10545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:27:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:07 smithi136 ceph-mon[125702]: pgmap v10546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:27:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:07 smithi057 ceph-mon[92072]: pgmap v10546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:27:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:07 smithi122 ceph-mon[125440]: pgmap v10546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:27:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:09 smithi057 ceph-mon[92072]: pgmap v10547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:27:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:09 smithi122 ceph-mon[125440]: pgmap v10547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:27:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:09 smithi136 ceph-mon[125702]: pgmap v10547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:27:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:11 smithi057 ceph-mon[92072]: pgmap v10548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:27:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:11 smithi122 ceph-mon[125440]: pgmap v10548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:27:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:11 smithi136 ceph-mon[125702]: pgmap v10548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:27:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:12 smithi057 ceph-mon[92072]: osdmap e731: 12 total, 12 up, 12 in 2023-03-02T16:27:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:12 smithi122 ceph-mon[125440]: osdmap e731: 12 total, 12 up, 12 in 2023-03-02T16:27:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:12 smithi136 ceph-mon[125702]: osdmap e731: 12 total, 12 up, 12 in 2023-03-02T16:27:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:13 smithi057 ceph-mon[92072]: pgmap v10550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:13 smithi122 ceph-mon[125440]: pgmap v10550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:13 smithi136 ceph-mon[125702]: pgmap v10550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:15.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:15 smithi057 ceph-mon[92072]: pgmap v10551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:15 smithi122 ceph-mon[125440]: pgmap v10551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:15 smithi136 ceph-mon[125702]: pgmap v10551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:17 smithi057 ceph-mon[92072]: pgmap v10552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:17 smithi122 ceph-mon[125440]: pgmap v10552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:17 smithi136 ceph-mon[125702]: pgmap v10552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:19.137+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:27:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:19.138+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:27:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:19.138+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:27:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:19.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:27:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:19.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:27:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:19 smithi057 ceph-mon[92072]: pgmap v10553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:19 smithi057 ceph-mon[92072]: osdmap e732: 12 total, 12 up, 12 in 2023-03-02T16:27:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:19 smithi122 ceph-mon[125440]: pgmap v10553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:19 smithi122 ceph-mon[125440]: osdmap e732: 12 total, 12 up, 12 in 2023-03-02T16:27:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:19 smithi136 ceph-mon[125702]: pgmap v10553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:27:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:19 smithi136 ceph-mon[125702]: osdmap e732: 12 total, 12 up, 12 in 2023-03-02T16:27:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:21 smithi057 ceph-mon[92072]: pgmap v10555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:27:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:21 smithi122 ceph-mon[125440]: pgmap v10555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:27:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:21 smithi136 ceph-mon[125702]: pgmap v10555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:27:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:23 smithi057 ceph-mon[92072]: pgmap v10556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:27:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:23 smithi122 ceph-mon[125440]: pgmap v10556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:27:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:23 smithi136 ceph-mon[125702]: pgmap v10556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:27:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:25 smithi057 ceph-mon[92072]: pgmap v10557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:27:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:25 smithi122 ceph-mon[125440]: pgmap v10557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:27:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:25 smithi136 ceph-mon[125702]: pgmap v10557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:27:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:27 smithi057 ceph-mon[92072]: pgmap v10558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:27:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:27 smithi122 ceph-mon[125440]: pgmap v10558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:27:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:27 smithi136 ceph-mon[125702]: pgmap v10558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:27:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:29 smithi057 ceph-mon[92072]: pgmap v10559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:27:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:29 smithi122 ceph-mon[125440]: pgmap v10559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:27:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:29 smithi136 ceph-mon[125702]: pgmap v10559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:27:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:31 smithi057 ceph-mon[92072]: pgmap v10560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:27:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:31 smithi122 ceph-mon[125440]: pgmap v10560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:27:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:31 smithi136 ceph-mon[125702]: pgmap v10560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T16:27:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:33 smithi057 ceph-mon[92072]: pgmap v10561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:33 smithi122 ceph-mon[125440]: pgmap v10561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:33 smithi136 ceph-mon[125702]: pgmap v10561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:34.153+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:27:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:34.153+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:27:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:34.153+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:27:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:34.153+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:27:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:34.153+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:27:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:35 smithi057 ceph-mon[92072]: pgmap v10562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:35 smithi122 ceph-mon[125440]: pgmap v10562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:35 smithi136 ceph-mon[125702]: pgmap v10562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:37 smithi057 ceph-mon[92072]: pgmap v10563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:37 smithi122 ceph-mon[125440]: pgmap v10563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:37 smithi136 ceph-mon[125702]: pgmap v10563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:39 smithi057 ceph-mon[92072]: pgmap v10564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:39 smithi122 ceph-mon[125440]: pgmap v10564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:39 smithi136 ceph-mon[125702]: pgmap v10564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:41 smithi057 ceph-mon[92072]: pgmap v10565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:41 smithi122 ceph-mon[125440]: pgmap v10565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:41 smithi136 ceph-mon[125702]: pgmap v10565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:43.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:43 smithi122 ceph-mon[125440]: pgmap v10566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:43 smithi136 ceph-mon[125702]: pgmap v10566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:43 smithi057 ceph-mon[92072]: pgmap v10566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:45 smithi122 ceph-mon[125440]: pgmap v10567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:45 smithi136 ceph-mon[125702]: pgmap v10567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:45 smithi057 ceph-mon[92072]: pgmap v10567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:47 smithi136 ceph-mon[125702]: pgmap v10568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:47 smithi057 ceph-mon[92072]: pgmap v10568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:47 smithi122 ceph-mon[125440]: pgmap v10568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:49.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:27:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:49.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:27:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:49.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:27:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:49.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:27:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:27:49.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:27:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:49 smithi136 ceph-mon[125702]: pgmap v10569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:49 smithi057 ceph-mon[92072]: pgmap v10569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:49 smithi122 ceph-mon[125440]: pgmap v10569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:51 smithi136 ceph-mon[125702]: pgmap v10570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:52.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:27:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:51 smithi057 ceph-mon[92072]: pgmap v10570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:27:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:51 smithi122 ceph-mon[125440]: pgmap v10570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:27:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:27:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:27:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:27:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:27:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:27:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:27:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:27:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:27:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:27:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:53 smithi136 ceph-mon[125702]: pgmap v10571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:53 smithi057 ceph-mon[92072]: pgmap v10571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:53 smithi122 ceph-mon[125440]: pgmap v10571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:27:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:55 smithi136 ceph-mon[125702]: pgmap v10572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:55 smithi057 ceph-mon[92072]: pgmap v10572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:55 smithi122 ceph-mon[125440]: pgmap v10572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:57 smithi136 ceph-mon[125702]: pgmap v10573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:57 smithi057 ceph-mon[92072]: pgmap v10573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:27:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:57 smithi122 ceph-mon[125440]: pgmap v10573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:27:59 smithi136 ceph-mon[125702]: pgmap v10574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:00.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:27:59 smithi057 ceph-mon[92072]: pgmap v10574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:00.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:27:59 smithi122 ceph-mon[125440]: pgmap v10574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:01 smithi136 ceph-mon[125702]: pgmap v10575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:01 smithi057 ceph-mon[92072]: pgmap v10575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:01 smithi122 ceph-mon[125440]: pgmap v10575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:03 smithi136 ceph-mon[125702]: pgmap v10576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:28:04.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:03 smithi057 ceph-mon[92072]: pgmap v10576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:28:04.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:04.184+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:28:04.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:04.184+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:28:04.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:04.184+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:28:04.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:04.184+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:28:04.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:04.184+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:28:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:03 smithi122 ceph-mon[125440]: pgmap v10576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:28:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:05 smithi136 ceph-mon[125702]: pgmap v10577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:28:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:05 smithi057 ceph-mon[92072]: pgmap v10577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:28:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:05 smithi122 ceph-mon[125440]: pgmap v10577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:28:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:06 smithi136 ceph-mon[125702]: osdmap e733: 12 total, 12 up, 12 in 2023-03-02T16:28:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:06 smithi057 ceph-mon[92072]: osdmap e733: 12 total, 12 up, 12 in 2023-03-02T16:28:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:06 smithi122 ceph-mon[125440]: osdmap e733: 12 total, 12 up, 12 in 2023-03-02T16:28:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:07 smithi136 ceph-mon[125702]: pgmap v10579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:28:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:07 smithi057 ceph-mon[92072]: pgmap v10579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:28:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:07 smithi122 ceph-mon[125440]: pgmap v10579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:28:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:09 smithi136 ceph-mon[125702]: pgmap v10580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:28:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:09 smithi136 ceph-mon[125702]: osdmap e734: 12 total, 12 up, 12 in 2023-03-02T16:28:10.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:09 smithi057 ceph-mon[92072]: pgmap v10580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:28:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:09 smithi057 ceph-mon[92072]: osdmap e734: 12 total, 12 up, 12 in 2023-03-02T16:28:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:09 smithi122 ceph-mon[125440]: pgmap v10580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:28:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:09 smithi122 ceph-mon[125440]: osdmap e734: 12 total, 12 up, 12 in 2023-03-02T16:28:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:11 smithi136 ceph-mon[125702]: pgmap v10582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:28:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:11 smithi057 ceph-mon[92072]: pgmap v10582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:28:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:11 smithi122 ceph-mon[125440]: pgmap v10582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:28:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:13 smithi136 ceph-mon[125702]: pgmap v10583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:28:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:13 smithi057 ceph-mon[92072]: pgmap v10583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:28:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:13 smithi122 ceph-mon[125440]: pgmap v10583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:28:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:15 smithi136 ceph-mon[125702]: pgmap v10584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T16:28:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:15 smithi057 ceph-mon[92072]: pgmap v10584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T16:28:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:15 smithi122 ceph-mon[125440]: pgmap v10584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T16:28:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:17 smithi136 ceph-mon[125702]: pgmap v10585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:28:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:17 smithi057 ceph-mon[92072]: pgmap v10585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:28:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:17 smithi122 ceph-mon[125440]: pgmap v10585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:28:19.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:19.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:28:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:19.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:28:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:19.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:28:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:19.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:28:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:19.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:28:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:19 smithi136 ceph-mon[125702]: pgmap v10586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:28:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:19 smithi057 ceph-mon[92072]: pgmap v10586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:28:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:19 smithi122 ceph-mon[125440]: pgmap v10586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:28:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:21 smithi136 ceph-mon[125702]: pgmap v10587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:28:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:21 smithi057 ceph-mon[92072]: pgmap v10587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:28:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:21 smithi122 ceph-mon[125440]: pgmap v10587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:28:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:23 smithi136 ceph-mon[125702]: pgmap v10588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:28:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:23 smithi057 ceph-mon[92072]: pgmap v10588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:28:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:23 smithi122 ceph-mon[125440]: pgmap v10588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:28:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:25 smithi136 ceph-mon[125702]: pgmap v10589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:25 smithi057 ceph-mon[92072]: pgmap v10589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:25 smithi122 ceph-mon[125440]: pgmap v10589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:26 smithi136 ceph-mon[125702]: pgmap v10590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:26 smithi057 ceph-mon[92072]: pgmap v10590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:26 smithi122 ceph-mon[125440]: pgmap v10590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:29 smithi057 ceph-mon[92072]: pgmap v10591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:29 smithi122 ceph-mon[125440]: pgmap v10591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:29 smithi136 ceph-mon[125702]: pgmap v10591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:31 smithi136 ceph-mon[125702]: pgmap v10592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:31 smithi057 ceph-mon[92072]: pgmap v10592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:31 smithi122 ceph-mon[125440]: pgmap v10592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:33 smithi057 ceph-mon[92072]: pgmap v10593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:33.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:33 smithi122 ceph-mon[125440]: pgmap v10593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:33 smithi136 ceph-mon[125702]: pgmap v10593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:34.214+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:28:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:34.214+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:28:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:34.214+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:28:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:34.214+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:28:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:34.214+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:28:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:35 smithi057 ceph-mon[92072]: pgmap v10594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:35.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:35 smithi122 ceph-mon[125440]: pgmap v10594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:35 smithi136 ceph-mon[125702]: pgmap v10594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:37 smithi057 ceph-mon[92072]: pgmap v10595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:37 smithi122 ceph-mon[125440]: pgmap v10595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:37 smithi136 ceph-mon[125702]: pgmap v10595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:39 smithi057 ceph-mon[92072]: pgmap v10596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:39 smithi122 ceph-mon[125440]: pgmap v10596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:39 smithi136 ceph-mon[125702]: pgmap v10596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:41 smithi057 ceph-mon[92072]: pgmap v10597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:41 smithi122 ceph-mon[125440]: pgmap v10597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:41 smithi136 ceph-mon[125702]: pgmap v10597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:43 smithi057 ceph-mon[92072]: pgmap v10598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:43 smithi122 ceph-mon[125440]: pgmap v10598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:43 smithi136 ceph-mon[125702]: pgmap v10598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:45 smithi057 ceph-mon[92072]: pgmap v10599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:45 smithi122 ceph-mon[125440]: pgmap v10599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:45 smithi136 ceph-mon[125702]: pgmap v10599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:47 smithi057 ceph-mon[92072]: pgmap v10600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:47 smithi122 ceph-mon[125440]: pgmap v10600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:47 smithi136 ceph-mon[125702]: pgmap v10600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:49.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:28:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:49.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:28:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:49.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:28:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:49.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:28:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:28:49.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:28:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:49 smithi057 ceph-mon[92072]: pgmap v10601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:49 smithi122 ceph-mon[125440]: pgmap v10601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:49 smithi136 ceph-mon[125702]: pgmap v10601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:51 smithi057 ceph-mon[92072]: pgmap v10602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:51 smithi122 ceph-mon[125440]: pgmap v10602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:51 smithi136 ceph-mon[125702]: pgmap v10602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:52.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:28:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:28:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:28:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:53 smithi057 ceph-mon[92072]: pgmap v10603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:28:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:28:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:53 smithi122 ceph-mon[125440]: pgmap v10603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:28:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:28:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:53 smithi136 ceph-mon[125702]: pgmap v10603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:28:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:28:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:28:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:28:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:28:54.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:28:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:28:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:28:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:28:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:28:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:28:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:28:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:55 smithi136 ceph-mon[125702]: pgmap v10604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:55 smithi057 ceph-mon[92072]: pgmap v10604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:55 smithi122 ceph-mon[125440]: pgmap v10604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:57 smithi136 ceph-mon[125702]: pgmap v10605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:57 smithi057 ceph-mon[92072]: pgmap v10605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:28:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:57 smithi122 ceph-mon[125440]: pgmap v10605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:28:59 smithi136 ceph-mon[125702]: pgmap v10606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:00.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:28:59 smithi057 ceph-mon[92072]: pgmap v10606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:28:59 smithi122 ceph-mon[125440]: pgmap v10606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:01 smithi136 ceph-mon[125702]: pgmap v10607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:01 smithi057 ceph-mon[92072]: pgmap v10607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:01 smithi122 ceph-mon[125440]: pgmap v10607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:03 smithi136 ceph-mon[125702]: pgmap v10608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:29:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:03 smithi057 ceph-mon[92072]: pgmap v10608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:29:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:03 smithi122 ceph-mon[125440]: pgmap v10608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:29:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:04.237+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:29:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:04.238+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:29:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:04.238+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:29:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:04.238+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:29:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:04.238+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:29:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:05 smithi136 ceph-mon[125702]: pgmap v10609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:29:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:05 smithi057 ceph-mon[92072]: pgmap v10609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:29:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:05 smithi122 ceph-mon[125440]: pgmap v10609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:29:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:06 smithi136 ceph-mon[125702]: osdmap e735: 12 total, 12 up, 12 in 2023-03-02T16:29:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:06 smithi057 ceph-mon[92072]: osdmap e735: 12 total, 12 up, 12 in 2023-03-02T16:29:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:06 smithi122 ceph-mon[125440]: osdmap e735: 12 total, 12 up, 12 in 2023-03-02T16:29:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:07 smithi136 ceph-mon[125702]: pgmap v10611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:29:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:07 smithi057 ceph-mon[92072]: pgmap v10611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:29:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:07 smithi122 ceph-mon[125440]: pgmap v10611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:29:08.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:08.410+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T16:29:08.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:08.410+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T16:29:08.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:08.410+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870041000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:29:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:08.410+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870041000 comp rx=0 tx=0).stop 2023-03-02T16:29:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:08.410+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T16:29:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:08.410+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T16:29:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:08.410+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T16:29:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:08.410+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T16:29:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:08.410+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:29:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:08.411+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5850005870 tx=0x7f587005e070 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T16:29:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:09 smithi136 ceph-mon[125702]: pgmap v10612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:29:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:09 smithi136 ceph-mon[125702]: osdmap e736: 12 total, 12 up, 12 in 2023-03-02T16:29:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:09 smithi057 ceph-mon[92072]: pgmap v10612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:29:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:09 smithi057 ceph-mon[92072]: osdmap e736: 12 total, 12 up, 12 in 2023-03-02T16:29:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:09 smithi122 ceph-mon[125440]: pgmap v10612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:29:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:09 smithi122 ceph-mon[125440]: osdmap e736: 12 total, 12 up, 12 in 2023-03-02T16:29:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:10 smithi136 ceph-mon[125702]: pgmap v10614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:29:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:10 smithi057 ceph-mon[92072]: pgmap v10614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:29:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:10 smithi122 ceph-mon[125440]: pgmap v10614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:29:11.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:11.223+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:29:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:11.223+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:29:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:11.223+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 155 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T16:29:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:11.224+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:29:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:11.224+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 154 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T16:29:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:11.224+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:29:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:11.224+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 156 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:29:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:11.224+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 155 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:29:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:13 smithi057 ceph-mon[92072]: pgmap v10615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:29:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:13 smithi122 ceph-mon[125440]: pgmap v10615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:29:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:13 smithi136 ceph-mon[125702]: pgmap v10615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:29:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:15 smithi057 ceph-mon[92072]: pgmap v10616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T16:29:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:15 smithi122 ceph-mon[125440]: pgmap v10616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T16:29:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:15 smithi136 ceph-mon[125702]: pgmap v10616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T16:29:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:17 smithi057 ceph-mon[92072]: pgmap v10617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:29:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:17 smithi122 ceph-mon[125440]: pgmap v10617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:29:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:17 smithi136 ceph-mon[125702]: pgmap v10617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:29:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:19.253+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:29:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:19.254+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:29:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:19.254+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:29:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:19.254+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:29:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:19.254+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:29:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:19 smithi057 ceph-mon[92072]: pgmap v10618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:29:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:19 smithi122 ceph-mon[125440]: pgmap v10618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:29:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:19 smithi136 ceph-mon[125702]: pgmap v10618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:29:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:21 smithi057 ceph-mon[92072]: pgmap v10619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:29:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:21 smithi122 ceph-mon[125440]: pgmap v10619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:29:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:21 smithi136 ceph-mon[125702]: pgmap v10619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:29:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:23 smithi057 ceph-mon[92072]: pgmap v10620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:29:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:23 smithi122 ceph-mon[125440]: pgmap v10620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:29:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:23 smithi136 ceph-mon[125702]: pgmap v10620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:29:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:25 smithi057 ceph-mon[92072]: pgmap v10621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:25 smithi122 ceph-mon[125440]: pgmap v10621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:25 smithi136 ceph-mon[125702]: pgmap v10621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:27 smithi057 ceph-mon[92072]: pgmap v10622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:27 smithi122 ceph-mon[125440]: pgmap v10622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:28.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:27 smithi136 ceph-mon[125702]: pgmap v10622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:29 smithi057 ceph-mon[92072]: pgmap v10623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:29 smithi122 ceph-mon[125440]: pgmap v10623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:29 smithi136 ceph-mon[125702]: pgmap v10623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:31.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:31 smithi057 ceph-mon[92072]: pgmap v10624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:31 smithi122 ceph-mon[125440]: pgmap v10624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:31 smithi136 ceph-mon[125702]: pgmap v10624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:33 smithi057 ceph-mon[92072]: pgmap v10625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:33 smithi122 ceph-mon[125440]: pgmap v10625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:33 smithi136 ceph-mon[125702]: pgmap v10625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:34.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:34.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:29:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:34.266+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:29:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:34.266+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:29:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:34.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:29:34.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:34.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:29:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:35 smithi057 ceph-mon[92072]: pgmap v10626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:35 smithi122 ceph-mon[125440]: pgmap v10626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:35 smithi136 ceph-mon[125702]: pgmap v10626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:37 smithi057 ceph-mon[92072]: pgmap v10627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:37.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:37 smithi122 ceph-mon[125440]: pgmap v10627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:37 smithi136 ceph-mon[125702]: pgmap v10627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:39 smithi057 ceph-mon[92072]: pgmap v10628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:39.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:39 smithi122 ceph-mon[125440]: pgmap v10628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:39 smithi136 ceph-mon[125702]: pgmap v10628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:41 smithi057 ceph-mon[92072]: pgmap v10629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:41.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:41 smithi122 ceph-mon[125440]: pgmap v10629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:41 smithi136 ceph-mon[125702]: pgmap v10629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:43 smithi057 ceph-mon[92072]: pgmap v10630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:43.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:43 smithi122 ceph-mon[125440]: pgmap v10630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:43 smithi136 ceph-mon[125702]: pgmap v10630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:45 smithi122 ceph-mon[125440]: pgmap v10631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:45 smithi136 ceph-mon[125702]: pgmap v10631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:45 smithi057 ceph-mon[92072]: pgmap v10631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:47 smithi122 ceph-mon[125440]: pgmap v10632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:47 smithi136 ceph-mon[125702]: pgmap v10632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:47 smithi057 ceph-mon[92072]: pgmap v10632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:49.277+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:29:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:49.278+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:29:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:49.278+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:29:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:49.278+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:29:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:29:49.278+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:29:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:49 smithi122 ceph-mon[125440]: pgmap v10633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:49 smithi136 ceph-mon[125702]: pgmap v10633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:50.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:49 smithi057 ceph-mon[92072]: pgmap v10633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:51 smithi122 ceph-mon[125440]: pgmap v10634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:51 smithi136 ceph-mon[125702]: pgmap v10634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:51 smithi057 ceph-mon[92072]: pgmap v10634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:53 smithi136 ceph-mon[125702]: pgmap v10635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:54.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:53 smithi057 ceph-mon[92072]: pgmap v10635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:53 smithi122 ceph-mon[125440]: pgmap v10635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:29:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:29:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:29:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:55.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:29:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:55 smithi136 ceph-mon[125702]: pgmap v10636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:29:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:29:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:55 smithi057 ceph-mon[92072]: pgmap v10636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:29:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:29:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:55 smithi122 ceph-mon[125440]: pgmap v10636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:29:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:29:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:29:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:57 smithi136 ceph-mon[125702]: pgmap v10637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:58.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:57 smithi057 ceph-mon[92072]: pgmap v10637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:29:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:57 smithi122 ceph-mon[125440]: pgmap v10637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:29:59 smithi136 ceph-mon[125702]: pgmap v10638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:29:59 smithi057 ceph-mon[92072]: pgmap v10638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:29:59 smithi122 ceph-mon[125440]: pgmap v10638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T16:30:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T16:30:01.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T16:30:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:01 smithi136 ceph-mon[125702]: pgmap v10639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:01 smithi057 ceph-mon[92072]: pgmap v10639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:01 smithi122 ceph-mon[125440]: pgmap v10639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:03 smithi136 ceph-mon[125702]: pgmap v10640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:30:04.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:03 smithi057 ceph-mon[92072]: pgmap v10640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:30:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:03 smithi122 ceph-mon[125440]: pgmap v10640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:30:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:04.294+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:30:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:04.295+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:30:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:04.295+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:30:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:04.295+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:30:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:04.295+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:30:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:05 smithi136 ceph-mon[125702]: pgmap v10641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:30:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:05 smithi057 ceph-mon[92072]: pgmap v10641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:30:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:05 smithi122 ceph-mon[125440]: pgmap v10641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:30:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:06 smithi136 ceph-mon[125702]: osdmap e737: 12 total, 12 up, 12 in 2023-03-02T16:30:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:06 smithi057 ceph-mon[92072]: osdmap e737: 12 total, 12 up, 12 in 2023-03-02T16:30:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:06 smithi122 ceph-mon[125440]: osdmap e737: 12 total, 12 up, 12 in 2023-03-02T16:30:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:07 smithi136 ceph-mon[125702]: pgmap v10643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:30:08.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:07 smithi057 ceph-mon[92072]: pgmap v10643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:30:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:07 smithi122 ceph-mon[125440]: pgmap v10643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:30:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:09 smithi136 ceph-mon[125702]: pgmap v10644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:30:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:09 smithi136 ceph-mon[125702]: osdmap e738: 12 total, 12 up, 12 in 2023-03-02T16:30:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:09 smithi057 ceph-mon[92072]: pgmap v10644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:30:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:09 smithi057 ceph-mon[92072]: osdmap e738: 12 total, 12 up, 12 in 2023-03-02T16:30:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:09 smithi122 ceph-mon[125440]: pgmap v10644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:30:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:09 smithi122 ceph-mon[125440]: osdmap e738: 12 total, 12 up, 12 in 2023-03-02T16:30:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:11 smithi136 ceph-mon[125702]: pgmap v10646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:30:12.096 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:11 smithi057 ceph-mon[92072]: pgmap v10646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:30:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:11 smithi122 ceph-mon[125440]: pgmap v10646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:30:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:13 smithi136 ceph-mon[125702]: pgmap v10647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:30:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:13 smithi057 ceph-mon[92072]: pgmap v10647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:30:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:13 smithi122 ceph-mon[125440]: pgmap v10647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:30:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:15 smithi136 ceph-mon[125702]: pgmap v10648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T16:30:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:15 smithi057 ceph-mon[92072]: pgmap v10648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T16:30:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:15 smithi122 ceph-mon[125440]: pgmap v10648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T16:30:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:17 smithi136 ceph-mon[125702]: pgmap v10649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:30:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:17 smithi057 ceph-mon[92072]: pgmap v10649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:30:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:17 smithi122 ceph-mon[125440]: pgmap v10649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:30:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:19.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:30:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:19.311+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:30:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:19.311+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:30:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:19.311+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:30:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:19.311+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:30:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:19 smithi136 ceph-mon[125702]: pgmap v10650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:30:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:19 smithi057 ceph-mon[92072]: pgmap v10650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:30:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:19 smithi122 ceph-mon[125440]: pgmap v10650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:30:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:21 smithi136 ceph-mon[125702]: pgmap v10651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:30:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:21 smithi057 ceph-mon[92072]: pgmap v10651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:30:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:21 smithi122 ceph-mon[125440]: pgmap v10651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:30:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:23 smithi136 ceph-mon[125702]: pgmap v10652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:30:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:23 smithi057 ceph-mon[92072]: pgmap v10652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:30:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:23 smithi122 ceph-mon[125440]: pgmap v10652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:30:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:25 smithi136 ceph-mon[125702]: pgmap v10653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:25 smithi057 ceph-mon[92072]: pgmap v10653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:25 smithi122 ceph-mon[125440]: pgmap v10653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:27 smithi136 ceph-mon[125702]: pgmap v10654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:27 smithi057 ceph-mon[92072]: pgmap v10654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:27 smithi122 ceph-mon[125440]: pgmap v10654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:29 smithi136 ceph-mon[125702]: pgmap v10655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:29 smithi057 ceph-mon[92072]: pgmap v10655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:29 smithi122 ceph-mon[125440]: pgmap v10655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:31 smithi136 ceph-mon[125702]: pgmap v10656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:31 smithi057 ceph-mon[92072]: pgmap v10656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:31 smithi122 ceph-mon[125440]: pgmap v10656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:33 smithi136 ceph-mon[125702]: pgmap v10657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:33 smithi057 ceph-mon[92072]: pgmap v10657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:33 smithi122 ceph-mon[125440]: pgmap v10657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:34.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:30:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:34.318+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:30:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:34.318+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:30:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:34.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:30:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:34.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:30:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:35 smithi136 ceph-mon[125702]: pgmap v10658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:35 smithi057 ceph-mon[92072]: pgmap v10658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:35 smithi122 ceph-mon[125440]: pgmap v10658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:37 smithi136 ceph-mon[125702]: pgmap v10659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:37 smithi057 ceph-mon[92072]: pgmap v10659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:37 smithi122 ceph-mon[125440]: pgmap v10659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:39 smithi057 ceph-mon[92072]: pgmap v10660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:39 smithi122 ceph-mon[125440]: pgmap v10660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:39 smithi136 ceph-mon[125702]: pgmap v10660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:41.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:40 smithi057 ceph-mon[92072]: pgmap v10661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:41.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:40 smithi122 ceph-mon[125440]: pgmap v10661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:40 smithi136 ceph-mon[125702]: pgmap v10661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:43 smithi122 ceph-mon[125440]: pgmap v10662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:43 smithi136 ceph-mon[125702]: pgmap v10662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:43.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:43 smithi057 ceph-mon[92072]: pgmap v10662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:45 smithi057 ceph-mon[92072]: pgmap v10663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:45 smithi122 ceph-mon[125440]: pgmap v10663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:45 smithi136 ceph-mon[125702]: pgmap v10663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:47 smithi057 ceph-mon[92072]: pgmap v10664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:47.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:47 smithi122 ceph-mon[125440]: pgmap v10664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:47 smithi136 ceph-mon[125702]: pgmap v10664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:49.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:30:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:49.321+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:30:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:49.321+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:30:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:49.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:30:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:30:49.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:30:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:49 smithi057 ceph-mon[92072]: pgmap v10665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:49.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:49 smithi122 ceph-mon[125440]: pgmap v10665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:49 smithi136 ceph-mon[125702]: pgmap v10665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:51 smithi057 ceph-mon[92072]: pgmap v10666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:51.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:51 smithi122 ceph-mon[125440]: pgmap v10666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:51 smithi136 ceph-mon[125702]: pgmap v10666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:53 smithi057 ceph-mon[92072]: pgmap v10667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:53.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:53 smithi122 ceph-mon[125440]: pgmap v10667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:53 smithi136 ceph-mon[125702]: pgmap v10667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:55 smithi057 ceph-mon[92072]: pgmap v10668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:30:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:55 smithi122 ceph-mon[125440]: pgmap v10668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:30:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:55 smithi136 ceph-mon[125702]: pgmap v10668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:30:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:30:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:30:56.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:30:56.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:30:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:30:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:30:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:30:57.102 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:30:57.103 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:30:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:57 smithi057 ceph-mon[92072]: pgmap v10669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:57.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:57 smithi122 ceph-mon[125440]: pgmap v10669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:57 smithi136 ceph-mon[125702]: pgmap v10669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:30:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:30:59 smithi057 ceph-mon[92072]: pgmap v10670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:30:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:30:59 smithi122 ceph-mon[125440]: pgmap v10670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:30:59 smithi136 ceph-mon[125702]: pgmap v10670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:01 smithi057 ceph-mon[92072]: pgmap v10671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:01 smithi122 ceph-mon[125440]: pgmap v10671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:01 smithi136 ceph-mon[125702]: pgmap v10671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:03 smithi057 ceph-mon[92072]: pgmap v10672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:31:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:03 smithi122 ceph-mon[125440]: pgmap v10672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:31:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:03 smithi136 ceph-mon[125702]: pgmap v10672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:31:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:04.337+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:31:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:04.337+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:31:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:04.337+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:31:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:04.337+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:31:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:04.337+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:31:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:05 smithi122 ceph-mon[125440]: pgmap v10673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:31:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:05 smithi136 ceph-mon[125702]: pgmap v10673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:31:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:05 smithi057 ceph-mon[92072]: pgmap v10673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:31:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:06 smithi122 ceph-mon[125440]: osdmap e739: 12 total, 12 up, 12 in 2023-03-02T16:31:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:06 smithi136 ceph-mon[125702]: osdmap e739: 12 total, 12 up, 12 in 2023-03-02T16:31:07.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:06 smithi057 ceph-mon[92072]: osdmap e739: 12 total, 12 up, 12 in 2023-03-02T16:31:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:07 smithi122 ceph-mon[125440]: pgmap v10675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:31:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:07 smithi136 ceph-mon[125702]: pgmap v10675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:31:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:07 smithi057 ceph-mon[92072]: pgmap v10675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:31:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:09 smithi122 ceph-mon[125440]: pgmap v10676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:31:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:09 smithi122 ceph-mon[125440]: osdmap e740: 12 total, 12 up, 12 in 2023-03-02T16:31:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:09 smithi136 ceph-mon[125702]: pgmap v10676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:31:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:09 smithi136 ceph-mon[125702]: osdmap e740: 12 total, 12 up, 12 in 2023-03-02T16:31:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:09 smithi057 ceph-mon[92072]: pgmap v10676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:31:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:09 smithi057 ceph-mon[92072]: osdmap e740: 12 total, 12 up, 12 in 2023-03-02T16:31:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:11 smithi136 ceph-mon[125702]: pgmap v10678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:31:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:11 smithi057 ceph-mon[92072]: pgmap v10678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:31:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:11 smithi122 ceph-mon[125440]: pgmap v10678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:31:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:13 smithi136 ceph-mon[125702]: pgmap v10679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:31:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:13 smithi057 ceph-mon[92072]: pgmap v10679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:31:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:13 smithi122 ceph-mon[125440]: pgmap v10679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:31:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:15 smithi136 ceph-mon[125702]: pgmap v10680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:31:16.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:15 smithi057 ceph-mon[92072]: pgmap v10680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:31:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:15 smithi122 ceph-mon[125440]: pgmap v10680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:31:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:17 smithi136 ceph-mon[125702]: pgmap v10681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:31:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:17 smithi057 ceph-mon[92072]: pgmap v10681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:31:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:17 smithi122 ceph-mon[125440]: pgmap v10681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:31:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:19.347+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:31:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:19.347+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:31:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:19.347+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:31:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:19.347+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:31:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:19.347+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:31:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:19 smithi136 ceph-mon[125702]: pgmap v10682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:31:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:19 smithi057 ceph-mon[92072]: pgmap v10682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:31:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:19 smithi122 ceph-mon[125440]: pgmap v10682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:31:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:21 smithi136 ceph-mon[125702]: pgmap v10683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:31:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:21 smithi057 ceph-mon[92072]: pgmap v10683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:31:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:21 smithi122 ceph-mon[125440]: pgmap v10683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:31:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:23 smithi136 ceph-mon[125702]: pgmap v10684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:31:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:23 smithi057 ceph-mon[92072]: pgmap v10684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:31:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:23 smithi122 ceph-mon[125440]: pgmap v10684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:31:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:25 smithi136 ceph-mon[125702]: pgmap v10685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:25 smithi057 ceph-mon[92072]: pgmap v10685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:25 smithi122 ceph-mon[125440]: pgmap v10685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:27 smithi136 ceph-mon[125702]: pgmap v10686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:27 smithi057 ceph-mon[92072]: pgmap v10686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:27 smithi122 ceph-mon[125440]: pgmap v10686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:29 smithi136 ceph-mon[125702]: pgmap v10687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:30.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:29 smithi057 ceph-mon[92072]: pgmap v10687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:29 smithi122 ceph-mon[125440]: pgmap v10687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:31 smithi136 ceph-mon[125702]: pgmap v10688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:31 smithi057 ceph-mon[92072]: pgmap v10688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:31 smithi122 ceph-mon[125440]: pgmap v10688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:33 smithi136 ceph-mon[125702]: pgmap v10689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:33 smithi057 ceph-mon[92072]: pgmap v10689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:33 smithi122 ceph-mon[125440]: pgmap v10689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:34.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:34.354+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:31:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:34.354+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:31:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:34.354+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:31:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:34.354+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:31:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:34.354+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:31:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:35 smithi136 ceph-mon[125702]: pgmap v10690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:35 smithi057 ceph-mon[92072]: pgmap v10690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:35 smithi122 ceph-mon[125440]: pgmap v10690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:37 smithi136 ceph-mon[125702]: pgmap v10691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:37 smithi057 ceph-mon[92072]: pgmap v10691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:37 smithi122 ceph-mon[125440]: pgmap v10691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:39 smithi136 ceph-mon[125702]: pgmap v10692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:39 smithi057 ceph-mon[92072]: pgmap v10692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:39 smithi122 ceph-mon[125440]: pgmap v10692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:41 smithi136 ceph-mon[125702]: pgmap v10693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:41 smithi057 ceph-mon[92072]: pgmap v10693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:41 smithi122 ceph-mon[125440]: pgmap v10693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:43 smithi136 ceph-mon[125702]: pgmap v10694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:43 smithi057 ceph-mon[92072]: pgmap v10694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:43 smithi122 ceph-mon[125440]: pgmap v10694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:45 smithi136 ceph-mon[125702]: pgmap v10695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:45 smithi057 ceph-mon[92072]: pgmap v10695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:45 smithi122 ceph-mon[125440]: pgmap v10695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:47 smithi136 ceph-mon[125702]: pgmap v10696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:47 smithi057 ceph-mon[92072]: pgmap v10696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:47 smithi122 ceph-mon[125440]: pgmap v10696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:49.370+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:49.370+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:49.370+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:49.370+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:31:49.370+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:31:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:49 smithi136 ceph-mon[125702]: pgmap v10697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:49 smithi057 ceph-mon[92072]: pgmap v10697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:49 smithi122 ceph-mon[125440]: pgmap v10697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:51 smithi136 ceph-mon[125702]: pgmap v10698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:51 smithi057 ceph-mon[92072]: pgmap v10698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:51 smithi122 ceph-mon[125440]: pgmap v10698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:53 smithi136 ceph-mon[125702]: pgmap v10699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:53 smithi057 ceph-mon[92072]: pgmap v10699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:53 smithi122 ceph-mon[125440]: pgmap v10699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:55 smithi136 ceph-mon[125702]: pgmap v10700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:56.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:55 smithi057 ceph-mon[92072]: pgmap v10700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:55 smithi122 ceph-mon[125440]: pgmap v10700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:57.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:31:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:31:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:31:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:57 smithi057 ceph-mon[92072]: pgmap v10701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:31:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:31:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:31:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:57 smithi122 ceph-mon[125440]: pgmap v10701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:31:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:31:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:31:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:57 smithi136 ceph-mon[125702]: pgmap v10701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:31:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:31:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:31:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:31:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:31:58 smithi057 ceph-mon[92072]: pgmap v10702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:59.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:31:58 smithi122 ceph-mon[125440]: pgmap v10702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:31:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:31:58 smithi136 ceph-mon[125702]: pgmap v10702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:01 smithi057 ceph-mon[92072]: pgmap v10703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:01 smithi122 ceph-mon[125440]: pgmap v10703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:01 smithi136 ceph-mon[125702]: pgmap v10703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:03 smithi057 ceph-mon[92072]: pgmap v10704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:32:03.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:03 smithi122 ceph-mon[125440]: pgmap v10704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:32:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:03 smithi136 ceph-mon[125702]: pgmap v10704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:32:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:04.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:32:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:04.385+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:32:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:04.385+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:32:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:04.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:32:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:04.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:32:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:05 smithi057 ceph-mon[92072]: pgmap v10705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:32:05.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:05 smithi122 ceph-mon[125440]: pgmap v10705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:32:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:05 smithi136 ceph-mon[125702]: pgmap v10705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:32:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:07 smithi057 ceph-mon[92072]: pgmap v10706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:32:07.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:07 smithi122 ceph-mon[125440]: pgmap v10706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:32:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:07 smithi136 ceph-mon[125702]: pgmap v10706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:32:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:09 smithi057 ceph-mon[92072]: pgmap v10707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:32:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:09 smithi122 ceph-mon[125440]: pgmap v10707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:32:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:09 smithi136 ceph-mon[125702]: pgmap v10707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:32:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:11.249+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:32:11.250 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:11.249+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:32:11.250 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:11.250+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 157 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:32:11.250 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:11.250+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 156 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:32:11.931 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:11 smithi057 ceph-mon[92072]: pgmap v10708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:32:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:11 smithi057 ceph-mon[92072]: osdmap e741: 12 total, 12 up, 12 in 2023-03-02T16:32:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:11 smithi122 ceph-mon[125440]: pgmap v10708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:32:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:11 smithi122 ceph-mon[125440]: osdmap e741: 12 total, 12 up, 12 in 2023-03-02T16:32:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:11 smithi136 ceph-mon[125702]: pgmap v10708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:32:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:11 smithi136 ceph-mon[125702]: osdmap e741: 12 total, 12 up, 12 in 2023-03-02T16:32:13.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:13 smithi122 ceph-mon[125440]: pgmap v10710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:13 smithi136 ceph-mon[125702]: pgmap v10710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:13 smithi057 ceph-mon[92072]: pgmap v10710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:15 smithi057 ceph-mon[92072]: pgmap v10711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:15 smithi057 ceph-mon[92072]: osdmap e742: 12 total, 12 up, 12 in 2023-03-02T16:32:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:15 smithi122 ceph-mon[125440]: pgmap v10711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:15 smithi122 ceph-mon[125440]: osdmap e742: 12 total, 12 up, 12 in 2023-03-02T16:32:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:15 smithi136 ceph-mon[125702]: pgmap v10711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:15 smithi136 ceph-mon[125702]: osdmap e742: 12 total, 12 up, 12 in 2023-03-02T16:32:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:17 smithi057 ceph-mon[92072]: pgmap v10713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:32:17.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:17 smithi122 ceph-mon[125440]: pgmap v10713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:32:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:17 smithi136 ceph-mon[125702]: pgmap v10713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:32:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:19.395+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:32:19.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:19.395+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:32:19.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:19.395+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:32:19.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:19.395+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:32:19.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:19.396+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:32:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:19 smithi057 ceph-mon[92072]: pgmap v10714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T16:32:19.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:19 smithi122 ceph-mon[125440]: pgmap v10714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T16:32:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:19 smithi136 ceph-mon[125702]: pgmap v10714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T16:32:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:21 smithi057 ceph-mon[92072]: pgmap v10715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T16:32:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:21 smithi122 ceph-mon[125440]: pgmap v10715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T16:32:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:21 smithi136 ceph-mon[125702]: pgmap v10715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T16:32:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:23 smithi122 ceph-mon[125440]: pgmap v10716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:23 smithi136 ceph-mon[125702]: pgmap v10716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:23 smithi057 ceph-mon[92072]: pgmap v10716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:25 smithi122 ceph-mon[125440]: pgmap v10717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:25 smithi136 ceph-mon[125702]: pgmap v10717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:25 smithi057 ceph-mon[92072]: pgmap v10717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:32:27.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:27 smithi122 ceph-mon[125440]: pgmap v10718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 174 B/s wr, 8 op/s 2023-03-02T16:32:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:27 smithi136 ceph-mon[125702]: pgmap v10718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 174 B/s wr, 8 op/s 2023-03-02T16:32:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:27 smithi057 ceph-mon[92072]: pgmap v10718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 174 B/s wr, 8 op/s 2023-03-02T16:32:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:29 smithi122 ceph-mon[125440]: pgmap v10719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T16:32:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:29 smithi136 ceph-mon[125702]: pgmap v10719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T16:32:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:29 smithi057 ceph-mon[92072]: pgmap v10719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T16:32:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:31 smithi136 ceph-mon[125702]: pgmap v10720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:31 smithi057 ceph-mon[92072]: pgmap v10720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:31 smithi122 ceph-mon[125440]: pgmap v10720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:33 smithi136 ceph-mon[125702]: pgmap v10721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:33 smithi057 ceph-mon[92072]: pgmap v10721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:33 smithi122 ceph-mon[125440]: pgmap v10721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:34.411+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:32:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:34.411+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:32:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:34.411+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:32:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:34.411+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:32:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:34.411+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:32:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:35 smithi136 ceph-mon[125702]: pgmap v10722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:35 smithi057 ceph-mon[92072]: pgmap v10722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:35 smithi122 ceph-mon[125440]: pgmap v10722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:37 smithi136 ceph-mon[125702]: pgmap v10723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:37 smithi057 ceph-mon[92072]: pgmap v10723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:37 smithi122 ceph-mon[125440]: pgmap v10723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:39 smithi136 ceph-mon[125702]: pgmap v10724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:39 smithi057 ceph-mon[92072]: pgmap v10724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:39 smithi122 ceph-mon[125440]: pgmap v10724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:41 smithi136 ceph-mon[125702]: pgmap v10725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:41 smithi057 ceph-mon[92072]: pgmap v10725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:41 smithi122 ceph-mon[125440]: pgmap v10725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:43 smithi136 ceph-mon[125702]: pgmap v10726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:43 smithi057 ceph-mon[92072]: pgmap v10726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:43 smithi122 ceph-mon[125440]: pgmap v10726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:45 smithi136 ceph-mon[125702]: pgmap v10727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:45 smithi057 ceph-mon[92072]: pgmap v10727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:45 smithi122 ceph-mon[125440]: pgmap v10727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:47 smithi136 ceph-mon[125702]: pgmap v10728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:47 smithi057 ceph-mon[92072]: pgmap v10728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:47 smithi122 ceph-mon[125440]: pgmap v10728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:49.427+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:32:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:49.427+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:32:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:49.427+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:32:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:49.427+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:32:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:32:49.427+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:32:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:49 smithi136 ceph-mon[125702]: pgmap v10729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:49 smithi057 ceph-mon[92072]: pgmap v10729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:49 smithi122 ceph-mon[125440]: pgmap v10729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:51 smithi136 ceph-mon[125702]: pgmap v10730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:51 smithi057 ceph-mon[92072]: pgmap v10730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:51 smithi122 ceph-mon[125440]: pgmap v10730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:53 smithi136 ceph-mon[125702]: pgmap v10731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:54.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:53 smithi057 ceph-mon[92072]: pgmap v10731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:53 smithi122 ceph-mon[125440]: pgmap v10731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:32:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:55 smithi136 ceph-mon[125702]: pgmap v10732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:55 smithi057 ceph-mon[92072]: pgmap v10732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:55 smithi122 ceph-mon[125440]: pgmap v10732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:57 smithi136 ceph-mon[125702]: pgmap v10733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:32:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:57 smithi057 ceph-mon[92072]: pgmap v10733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:32:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:57 smithi122 ceph-mon[125440]: pgmap v10733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:32:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:33:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:32:59 smithi136 ceph-mon[125702]: pgmap v10734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:32:59 smithi057 ceph-mon[92072]: pgmap v10734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:32:59 smithi122 ceph-mon[125440]: pgmap v10734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:01 smithi136 ceph-mon[125702]: pgmap v10735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:33:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:33:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:33:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:33:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:33:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:01 smithi057 ceph-mon[92072]: pgmap v10735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:33:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:33:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:33:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:33:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:33:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:01 smithi122 ceph-mon[125440]: pgmap v10735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:33:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:33:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:33:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:33:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:33:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:03 smithi136 ceph-mon[125702]: pgmap v10736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:33:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:03 smithi057 ceph-mon[92072]: pgmap v10736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:33:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:03 smithi122 ceph-mon[125440]: pgmap v10736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:33:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:04.439+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:33:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:04.439+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:33:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:04.439+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:33:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:04.439+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:33:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:04.439+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:33:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:05 smithi136 ceph-mon[125702]: pgmap v10737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:33:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:05 smithi057 ceph-mon[92072]: pgmap v10737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:33:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:05 smithi122 ceph-mon[125440]: pgmap v10737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:33:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:07 smithi136 ceph-mon[125702]: pgmap v10738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:33:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:07 smithi057 ceph-mon[92072]: pgmap v10738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:33:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:07 smithi122 ceph-mon[125440]: pgmap v10738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:33:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:09 smithi136 ceph-mon[125702]: pgmap v10739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:33:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:09 smithi057 ceph-mon[92072]: pgmap v10739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:33:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:09 smithi122 ceph-mon[125440]: pgmap v10739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:33:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:11 smithi136 ceph-mon[125702]: pgmap v10740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:33:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:11 smithi136 ceph-mon[125702]: osdmap e743: 12 total, 12 up, 12 in 2023-03-02T16:33:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:11 smithi057 ceph-mon[92072]: pgmap v10740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:33:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:11 smithi057 ceph-mon[92072]: osdmap e743: 12 total, 12 up, 12 in 2023-03-02T16:33:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:11 smithi122 ceph-mon[125440]: pgmap v10740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:33:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:11 smithi122 ceph-mon[125440]: osdmap e743: 12 total, 12 up, 12 in 2023-03-02T16:33:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:13 smithi136 ceph-mon[125702]: pgmap v10742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:33:14.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:13 smithi057 ceph-mon[92072]: pgmap v10742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:33:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:13 smithi122 ceph-mon[125440]: pgmap v10742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:33:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:15 smithi057 ceph-mon[92072]: pgmap v10743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:33:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:15 smithi057 ceph-mon[92072]: osdmap e744: 12 total, 12 up, 12 in 2023-03-02T16:33:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:15 smithi122 ceph-mon[125440]: pgmap v10743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:33:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:15 smithi122 ceph-mon[125440]: osdmap e744: 12 total, 12 up, 12 in 2023-03-02T16:33:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:15 smithi136 ceph-mon[125702]: pgmap v10743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:33:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:15 smithi136 ceph-mon[125702]: osdmap e744: 12 total, 12 up, 12 in 2023-03-02T16:33:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:17 smithi057 ceph-mon[92072]: pgmap v10745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:33:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:17 smithi122 ceph-mon[125440]: pgmap v10745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:33:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:17 smithi136 ceph-mon[125702]: pgmap v10745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:33:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:19.443+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:33:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:19.443+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:33:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:19.443+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:33:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:19.443+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:33:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:19.443+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:33:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:19 smithi057 ceph-mon[92072]: pgmap v10746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:33:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:19 smithi122 ceph-mon[125440]: pgmap v10746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:33:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:19 smithi136 ceph-mon[125702]: pgmap v10746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:33:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:21 smithi122 ceph-mon[125440]: pgmap v10747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T16:33:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:21 smithi136 ceph-mon[125702]: pgmap v10747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T16:33:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:21 smithi057 ceph-mon[92072]: pgmap v10747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T16:33:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:23 smithi122 ceph-mon[125440]: pgmap v10748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:33:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:23 smithi136 ceph-mon[125702]: pgmap v10748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:33:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:23 smithi057 ceph-mon[92072]: pgmap v10748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:33:25.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:25 smithi122 ceph-mon[125440]: pgmap v10749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:33:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:25 smithi136 ceph-mon[125702]: pgmap v10749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:33:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:25 smithi057 ceph-mon[92072]: pgmap v10749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:33:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:27 smithi122 ceph-mon[125440]: pgmap v10750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:33:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:27 smithi136 ceph-mon[125702]: pgmap v10750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:33:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:27 smithi057 ceph-mon[92072]: pgmap v10750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:33:29.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:29 smithi122 ceph-mon[125440]: pgmap v10751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:33:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:29 smithi136 ceph-mon[125702]: pgmap v10751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:33:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:29 smithi057 ceph-mon[92072]: pgmap v10751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:33:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:31 smithi136 ceph-mon[125702]: pgmap v10752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:31 smithi057 ceph-mon[92072]: pgmap v10752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:31 smithi122 ceph-mon[125440]: pgmap v10752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:33 smithi136 ceph-mon[125702]: pgmap v10753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:33 smithi057 ceph-mon[92072]: pgmap v10753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:33 smithi122 ceph-mon[125440]: pgmap v10753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:34.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:33:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:34.448+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:33:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:34.448+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:33:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:34.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:33:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:34.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:33:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:35 smithi136 ceph-mon[125702]: pgmap v10754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:35 smithi057 ceph-mon[92072]: pgmap v10754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:35 smithi122 ceph-mon[125440]: pgmap v10754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:37 smithi136 ceph-mon[125702]: pgmap v10755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:37 smithi057 ceph-mon[92072]: pgmap v10755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:37 smithi122 ceph-mon[125440]: pgmap v10755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:39 smithi136 ceph-mon[125702]: pgmap v10756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:39 smithi057 ceph-mon[92072]: pgmap v10756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:39 smithi122 ceph-mon[125440]: pgmap v10756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:41 smithi136 ceph-mon[125702]: pgmap v10757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:42.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:41 smithi057 ceph-mon[92072]: pgmap v10757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:41 smithi122 ceph-mon[125440]: pgmap v10757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:43 smithi136 ceph-mon[125702]: pgmap v10758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:43 smithi057 ceph-mon[92072]: pgmap v10758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:43 smithi122 ceph-mon[125440]: pgmap v10758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:45 smithi136 ceph-mon[125702]: pgmap v10759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:45 smithi057 ceph-mon[92072]: pgmap v10759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:45 smithi122 ceph-mon[125440]: pgmap v10759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:47 smithi136 ceph-mon[125702]: pgmap v10760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:47 smithi057 ceph-mon[92072]: pgmap v10760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:47 smithi122 ceph-mon[125440]: pgmap v10760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:49.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:33:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:49.458+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:33:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:49.458+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:33:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:49.458+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:33:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:33:49.458+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:33:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:49 smithi136 ceph-mon[125702]: pgmap v10761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:49 smithi057 ceph-mon[92072]: pgmap v10761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:49 smithi122 ceph-mon[125440]: pgmap v10761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:51 smithi136 ceph-mon[125702]: pgmap v10762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:51 smithi057 ceph-mon[92072]: pgmap v10762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:51 smithi122 ceph-mon[125440]: pgmap v10762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:53 smithi136 ceph-mon[125702]: pgmap v10763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:53 smithi057 ceph-mon[92072]: pgmap v10763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:53 smithi122 ceph-mon[125440]: pgmap v10763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:33:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:55 smithi136 ceph-mon[125702]: pgmap v10764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:55 smithi057 ceph-mon[92072]: pgmap v10764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:55 smithi122 ceph-mon[125440]: pgmap v10764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:57 smithi136 ceph-mon[125702]: pgmap v10765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:57 smithi057 ceph-mon[92072]: pgmap v10765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:33:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:57 smithi122 ceph-mon[125440]: pgmap v10765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:33:59 smithi136 ceph-mon[125702]: pgmap v10766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:33:59 smithi057 ceph-mon[92072]: pgmap v10766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:33:59 smithi122 ceph-mon[125440]: pgmap v10766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:01 smithi136 ceph-mon[125702]: pgmap v10767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:34:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:01 smithi057 ceph-mon[92072]: pgmap v10767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:34:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:01 smithi122 ceph-mon[125440]: pgmap v10767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:34:03.795 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:03 smithi136 ceph-mon[125702]: pgmap v10768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:34:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:03 smithi122 ceph-mon[125440]: pgmap v10768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:34:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:03 smithi057 ceph-mon[92072]: pgmap v10768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:34:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:04.468+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:34:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:04.468+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:34:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:04.468+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:34:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:04.468+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:34:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:04.468+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:34:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:05 smithi136 ceph-mon[125702]: pgmap v10769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:34:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:34:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:34:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:05 smithi057 ceph-mon[92072]: pgmap v10769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:34:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:34:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:34:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:05 smithi122 ceph-mon[125440]: pgmap v10769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:34:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:34:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:34:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:34:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:07 smithi136 ceph-mon[125702]: pgmap v10770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:34:08.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:07 smithi057 ceph-mon[92072]: pgmap v10770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:34:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:07 smithi122 ceph-mon[125440]: pgmap v10770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:34:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:09 smithi136 ceph-mon[125702]: pgmap v10771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:34:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:09 smithi057 ceph-mon[92072]: pgmap v10771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:34:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:09 smithi122 ceph-mon[125440]: pgmap v10771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:34:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:11 smithi136 ceph-mon[125702]: pgmap v10772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:34:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:11 smithi136 ceph-mon[125702]: osdmap e745: 12 total, 12 up, 12 in 2023-03-02T16:34:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:11 smithi057 ceph-mon[92072]: pgmap v10772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:34:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:11 smithi057 ceph-mon[92072]: osdmap e745: 12 total, 12 up, 12 in 2023-03-02T16:34:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:11 smithi122 ceph-mon[125440]: pgmap v10772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:34:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:11 smithi122 ceph-mon[125440]: osdmap e745: 12 total, 12 up, 12 in 2023-03-02T16:34:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:13 smithi136 ceph-mon[125702]: pgmap v10774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:13 smithi057 ceph-mon[92072]: pgmap v10774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:13 smithi122 ceph-mon[125440]: pgmap v10774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:15 smithi136 ceph-mon[125702]: pgmap v10775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:15 smithi057 ceph-mon[92072]: pgmap v10775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:15 smithi122 ceph-mon[125440]: pgmap v10775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:17 smithi136 ceph-mon[125702]: pgmap v10776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:17 smithi057 ceph-mon[92072]: pgmap v10776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:17 smithi122 ceph-mon[125440]: pgmap v10776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:19.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:34:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:19.481+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:34:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:19.481+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:34:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:19.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:34:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:19.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:34:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:19 smithi136 ceph-mon[125702]: pgmap v10777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:19 smithi136 ceph-mon[125702]: osdmap e746: 12 total, 12 up, 12 in 2023-03-02T16:34:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:19 smithi057 ceph-mon[92072]: pgmap v10777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:19 smithi057 ceph-mon[92072]: osdmap e746: 12 total, 12 up, 12 in 2023-03-02T16:34:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:19 smithi122 ceph-mon[125440]: pgmap v10777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:34:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:19 smithi122 ceph-mon[125440]: osdmap e746: 12 total, 12 up, 12 in 2023-03-02T16:34:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:21 smithi136 ceph-mon[125702]: pgmap v10779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:34:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:21 smithi057 ceph-mon[92072]: pgmap v10779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:34:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:21 smithi122 ceph-mon[125440]: pgmap v10779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T16:34:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:23 smithi136 ceph-mon[125702]: pgmap v10780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:34:24.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:23 smithi057 ceph-mon[92072]: pgmap v10780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:34:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:23 smithi122 ceph-mon[125440]: pgmap v10780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:34:26.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:25 smithi057 ceph-mon[92072]: pgmap v10781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:34:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:25 smithi122 ceph-mon[125440]: pgmap v10781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:34:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:25 smithi136 ceph-mon[125702]: pgmap v10781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:34:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:27 smithi057 ceph-mon[92072]: pgmap v10782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:34:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:27 smithi122 ceph-mon[125440]: pgmap v10782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:34:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:27 smithi136 ceph-mon[125702]: pgmap v10782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:34:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:29 smithi057 ceph-mon[92072]: pgmap v10783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:34:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:29 smithi122 ceph-mon[125440]: pgmap v10783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:34:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:29 smithi136 ceph-mon[125702]: pgmap v10783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:34:32.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:31 smithi057 ceph-mon[92072]: pgmap v10784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T16:34:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:31 smithi122 ceph-mon[125440]: pgmap v10784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T16:34:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:31 smithi136 ceph-mon[125702]: pgmap v10784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T16:34:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:33 smithi057 ceph-mon[92072]: pgmap v10785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:33 smithi122 ceph-mon[125440]: pgmap v10785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:33 smithi136 ceph-mon[125702]: pgmap v10785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:34.483+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:34:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:34.484+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:34:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:34.484+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:34:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:34.484+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:34:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:34.484+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:34:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:35 smithi057 ceph-mon[92072]: pgmap v10786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:35 smithi122 ceph-mon[125440]: pgmap v10786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:35 smithi136 ceph-mon[125702]: pgmap v10786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:37 smithi057 ceph-mon[92072]: pgmap v10787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:37 smithi122 ceph-mon[125440]: pgmap v10787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:37 smithi136 ceph-mon[125702]: pgmap v10787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:40.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:39 smithi057 ceph-mon[92072]: pgmap v10788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:39 smithi122 ceph-mon[125440]: pgmap v10788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:39 smithi136 ceph-mon[125702]: pgmap v10788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:40 smithi057 ceph-mon[92072]: pgmap v10789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:41.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:40 smithi122 ceph-mon[125440]: pgmap v10789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:40 smithi136 ceph-mon[125702]: pgmap v10789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:43 smithi136 ceph-mon[125702]: pgmap v10790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:43 smithi057 ceph-mon[92072]: pgmap v10790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:43 smithi122 ceph-mon[125440]: pgmap v10790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:45 smithi136 ceph-mon[125702]: pgmap v10791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:46.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:45 smithi057 ceph-mon[92072]: pgmap v10791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:45 smithi122 ceph-mon[125440]: pgmap v10791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:47 smithi136 ceph-mon[125702]: pgmap v10792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:47 smithi057 ceph-mon[92072]: pgmap v10792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:47 smithi122 ceph-mon[125440]: pgmap v10792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:49.486+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:34:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:49.487+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:34:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:49.487+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:34:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:49.487+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:34:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:34:49.487+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:34:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:49 smithi136 ceph-mon[125702]: pgmap v10793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:49 smithi057 ceph-mon[92072]: pgmap v10793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:49 smithi122 ceph-mon[125440]: pgmap v10793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:51 smithi136 ceph-mon[125702]: pgmap v10794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:51 smithi057 ceph-mon[92072]: pgmap v10794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:51 smithi122 ceph-mon[125440]: pgmap v10794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:53 smithi136 ceph-mon[125702]: pgmap v10795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:53 smithi057 ceph-mon[92072]: pgmap v10795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:53 smithi122 ceph-mon[125440]: pgmap v10795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:34:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:55 smithi136 ceph-mon[125702]: pgmap v10796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:56.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:55 smithi057 ceph-mon[92072]: pgmap v10796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:55 smithi122 ceph-mon[125440]: pgmap v10796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:57 smithi136 ceph-mon[125702]: pgmap v10797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:57 smithi057 ceph-mon[92072]: pgmap v10797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:34:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:57 smithi122 ceph-mon[125440]: pgmap v10797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:34:59 smithi136 ceph-mon[125702]: pgmap v10798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:34:59 smithi057 ceph-mon[92072]: pgmap v10798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:34:59 smithi122 ceph-mon[125440]: pgmap v10798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:01 smithi136 ceph-mon[125702]: pgmap v10799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:01 smithi057 ceph-mon[92072]: pgmap v10799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:01 smithi122 ceph-mon[125440]: pgmap v10799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:03 smithi136 ceph-mon[125702]: pgmap v10800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:35:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:03 smithi057 ceph-mon[92072]: pgmap v10800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:35:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:03 smithi122 ceph-mon[125440]: pgmap v10800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:35:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:04.503+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:35:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:04.503+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:35:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:04.503+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:35:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:04.503+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:35:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:04.503+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:35:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:05 smithi136 ceph-mon[125702]: pgmap v10801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:35:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:35:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:05 smithi057 ceph-mon[92072]: pgmap v10801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:35:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:35:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:05 smithi122 ceph-mon[125440]: pgmap v10801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:35:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:35:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:35:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:35:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:35:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:35:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:35:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:35:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:35:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:35:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:35:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:07 smithi136 ceph-mon[125702]: pgmap v10802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:35:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:07 smithi057 ceph-mon[92072]: pgmap v10802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:35:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:07 smithi122 ceph-mon[125440]: pgmap v10802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:35:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:09 smithi136 ceph-mon[125702]: pgmap v10803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:35:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:09 smithi057 ceph-mon[92072]: pgmap v10803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:35:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:09 smithi122 ceph-mon[125440]: pgmap v10803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:35:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:11.274+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:35:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:11.274+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:35:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:11.275+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 157 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:35:11.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:11.275+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 158 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:35:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:11 smithi136 ceph-mon[125702]: pgmap v10804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:35:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:11 smithi136 ceph-mon[125702]: osdmap e747: 12 total, 12 up, 12 in 2023-03-02T16:35:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:11 smithi057 ceph-mon[92072]: pgmap v10804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:35:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:11 smithi057 ceph-mon[92072]: osdmap e747: 12 total, 12 up, 12 in 2023-03-02T16:35:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:11 smithi122 ceph-mon[125440]: pgmap v10804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:35:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:11 smithi122 ceph-mon[125440]: osdmap e747: 12 total, 12 up, 12 in 2023-03-02T16:35:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:13 smithi136 ceph-mon[125702]: pgmap v10806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:35:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:13 smithi057 ceph-mon[92072]: pgmap v10806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:35:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:13 smithi122 ceph-mon[125440]: pgmap v10806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:35:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:15 smithi136 ceph-mon[125702]: pgmap v10807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:35:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:15 smithi136 ceph-mon[125702]: osdmap e748: 12 total, 12 up, 12 in 2023-03-02T16:35:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:15 smithi057 ceph-mon[92072]: pgmap v10807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:35:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:15 smithi057 ceph-mon[92072]: osdmap e748: 12 total, 12 up, 12 in 2023-03-02T16:35:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:15 smithi122 ceph-mon[125440]: pgmap v10807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:35:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:15 smithi122 ceph-mon[125440]: osdmap e748: 12 total, 12 up, 12 in 2023-03-02T16:35:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:17 smithi136 ceph-mon[125702]: pgmap v10809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:35:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:17 smithi057 ceph-mon[92072]: pgmap v10809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:35:18.264 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:17 smithi122 ceph-mon[125440]: pgmap v10809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:35:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:19.505+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:35:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:19.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:35:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:19.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:35:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:19.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:35:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:19.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:35:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:19 smithi136 ceph-mon[125702]: pgmap v10810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:35:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:19 smithi057 ceph-mon[92072]: pgmap v10810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:35:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:19 smithi122 ceph-mon[125440]: pgmap v10810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:35:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:21 smithi136 ceph-mon[125702]: pgmap v10811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:35:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:21 smithi057 ceph-mon[92072]: pgmap v10811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:35:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:21 smithi122 ceph-mon[125440]: pgmap v10811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:35:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:23 smithi136 ceph-mon[125702]: pgmap v10812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:35:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:23 smithi057 ceph-mon[92072]: pgmap v10812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:35:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:23 smithi122 ceph-mon[125440]: pgmap v10812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:35:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:25 smithi136 ceph-mon[125702]: pgmap v10813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:35:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:25 smithi057 ceph-mon[92072]: pgmap v10813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:35:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:25 smithi122 ceph-mon[125440]: pgmap v10813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:35:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:27 smithi136 ceph-mon[125702]: pgmap v10814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:35:28.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:27 smithi057 ceph-mon[92072]: pgmap v10814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:35:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:27 smithi122 ceph-mon[125440]: pgmap v10814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:35:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:29 smithi136 ceph-mon[125702]: pgmap v10815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:35:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:29 smithi057 ceph-mon[92072]: pgmap v10815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:35:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:29 smithi122 ceph-mon[125440]: pgmap v10815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:35:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:31 smithi136 ceph-mon[125702]: pgmap v10816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:31 smithi057 ceph-mon[92072]: pgmap v10816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:31 smithi122 ceph-mon[125440]: pgmap v10816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:33 smithi136 ceph-mon[125702]: pgmap v10817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:33 smithi057 ceph-mon[92072]: pgmap v10817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:33 smithi122 ceph-mon[125440]: pgmap v10817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:34.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:35:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:34.515+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:35:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:34.515+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:35:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:34.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:35:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:34.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:35:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:35 smithi136 ceph-mon[125702]: pgmap v10818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:35 smithi057 ceph-mon[92072]: pgmap v10818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:35 smithi122 ceph-mon[125440]: pgmap v10818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:37 smithi136 ceph-mon[125702]: pgmap v10819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:37 smithi057 ceph-mon[92072]: pgmap v10819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:37 smithi122 ceph-mon[125440]: pgmap v10819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:39 smithi136 ceph-mon[125702]: pgmap v10820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:39 smithi057 ceph-mon[92072]: pgmap v10820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:39 smithi122 ceph-mon[125440]: pgmap v10820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:41 smithi136 ceph-mon[125702]: pgmap v10821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:41 smithi057 ceph-mon[92072]: pgmap v10821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:41 smithi122 ceph-mon[125440]: pgmap v10821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:43 smithi136 ceph-mon[125702]: pgmap v10822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:43 smithi057 ceph-mon[92072]: pgmap v10822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:43 smithi122 ceph-mon[125440]: pgmap v10822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:45 smithi136 ceph-mon[125702]: pgmap v10823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:45 smithi057 ceph-mon[92072]: pgmap v10823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:45 smithi122 ceph-mon[125440]: pgmap v10823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:47 smithi136 ceph-mon[125702]: pgmap v10824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:47 smithi057 ceph-mon[92072]: pgmap v10824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:47 smithi122 ceph-mon[125440]: pgmap v10824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:49.523+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:35:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:49.523+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:35:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:49.523+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:35:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:49.523+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:35:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:35:49.523+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:35:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:49 smithi136 ceph-mon[125702]: pgmap v10825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:49 smithi057 ceph-mon[92072]: pgmap v10825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:49 smithi122 ceph-mon[125440]: pgmap v10825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:51 smithi136 ceph-mon[125702]: pgmap v10826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:51 smithi057 ceph-mon[92072]: pgmap v10826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:51 smithi122 ceph-mon[125440]: pgmap v10826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:53 smithi136 ceph-mon[125702]: pgmap v10827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:53 smithi057 ceph-mon[92072]: pgmap v10827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:53 smithi122 ceph-mon[125440]: pgmap v10827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:35:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:55 smithi057 ceph-mon[92072]: pgmap v10828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:55 smithi122 ceph-mon[125440]: pgmap v10828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:55 smithi136 ceph-mon[125702]: pgmap v10828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:57 smithi057 ceph-mon[92072]: pgmap v10829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:57 smithi122 ceph-mon[125440]: pgmap v10829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:35:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:57 smithi136 ceph-mon[125702]: pgmap v10829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:35:59 smithi057 ceph-mon[92072]: pgmap v10830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:35:59 smithi122 ceph-mon[125440]: pgmap v10830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:35:59 smithi136 ceph-mon[125702]: pgmap v10830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:01 smithi057 ceph-mon[92072]: pgmap v10831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:01 smithi122 ceph-mon[125440]: pgmap v10831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:01 smithi136 ceph-mon[125702]: pgmap v10831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:03 smithi057 ceph-mon[92072]: pgmap v10832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:36:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:03 smithi122 ceph-mon[125440]: pgmap v10832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:36:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:03 smithi136 ceph-mon[125702]: pgmap v10832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:36:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:04.527+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:36:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:04.527+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:36:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:04.527+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:36:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:04.527+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:36:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:04.527+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:36:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:05 smithi057 ceph-mon[92072]: pgmap v10833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:36:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:05 smithi122 ceph-mon[125440]: pgmap v10833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:36:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:05 smithi136 ceph-mon[125702]: pgmap v10833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:36:07.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:06 smithi057 ceph-mon[92072]: osdmap e749: 12 total, 12 up, 12 in 2023-03-02T16:36:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:36:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:06 smithi122 ceph-mon[125440]: osdmap e749: 12 total, 12 up, 12 in 2023-03-02T16:36:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:36:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:06 smithi136 ceph-mon[125702]: osdmap e749: 12 total, 12 up, 12 in 2023-03-02T16:36:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:36:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:07 smithi057 ceph-mon[92072]: pgmap v10835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:36:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:36:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:36:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:07 smithi122 ceph-mon[125440]: pgmap v10835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:36:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:07 smithi136 ceph-mon[125702]: pgmap v10835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:36:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:36:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:36:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:36:09.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:08 smithi057 ceph-mon[92072]: pgmap v10836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:36:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:08 smithi122 ceph-mon[125440]: pgmap v10836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:36:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:08 smithi136 ceph-mon[125702]: pgmap v10836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:36:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:10 smithi136 ceph-mon[125702]: osdmap e750: 12 total, 12 up, 12 in 2023-03-02T16:36:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:10 smithi057 ceph-mon[92072]: osdmap e750: 12 total, 12 up, 12 in 2023-03-02T16:36:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:10 smithi122 ceph-mon[125440]: osdmap e750: 12 total, 12 up, 12 in 2023-03-02T16:36:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:11 smithi136 ceph-mon[125702]: pgmap v10838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:36:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:11 smithi057 ceph-mon[92072]: pgmap v10838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:36:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:11 smithi122 ceph-mon[125440]: pgmap v10838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:36:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:13 smithi136 ceph-mon[125702]: pgmap v10839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:36:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:13 smithi057 ceph-mon[92072]: pgmap v10839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:36:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:13 smithi122 ceph-mon[125440]: pgmap v10839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:36:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:15 smithi136 ceph-mon[125702]: pgmap v10840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T16:36:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:15 smithi057 ceph-mon[92072]: pgmap v10840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T16:36:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:15 smithi122 ceph-mon[125440]: pgmap v10840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T16:36:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:17 smithi136 ceph-mon[125702]: pgmap v10841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:36:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:17 smithi057 ceph-mon[92072]: pgmap v10841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:36:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:17 smithi122 ceph-mon[125440]: pgmap v10841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:36:19.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:19.542+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:36:19.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:19.542+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:36:19.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:19.542+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:36:19.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:19.542+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:36:19.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:19.542+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:36:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:19 smithi136 ceph-mon[125702]: pgmap v10842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:36:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:19 smithi057 ceph-mon[92072]: pgmap v10842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:36:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:19 smithi122 ceph-mon[125440]: pgmap v10842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:36:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:21 smithi136 ceph-mon[125702]: pgmap v10843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:36:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:21 smithi057 ceph-mon[92072]: pgmap v10843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:36:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:21 smithi122 ceph-mon[125440]: pgmap v10843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:36:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:23 smithi136 ceph-mon[125702]: pgmap v10844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:36:24.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:23 smithi057 ceph-mon[92072]: pgmap v10844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:36:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:23 smithi122 ceph-mon[125440]: pgmap v10844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:36:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:25 smithi136 ceph-mon[125702]: pgmap v10845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:25 smithi057 ceph-mon[92072]: pgmap v10845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:25 smithi122 ceph-mon[125440]: pgmap v10845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:27 smithi136 ceph-mon[125702]: pgmap v10846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:27 smithi057 ceph-mon[92072]: pgmap v10846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:27 smithi122 ceph-mon[125440]: pgmap v10846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:29 smithi136 ceph-mon[125702]: pgmap v10847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:29 smithi057 ceph-mon[92072]: pgmap v10847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:29 smithi122 ceph-mon[125440]: pgmap v10847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:31 smithi136 ceph-mon[125702]: pgmap v10848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:31 smithi057 ceph-mon[92072]: pgmap v10848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:31 smithi122 ceph-mon[125440]: pgmap v10848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:33 smithi136 ceph-mon[125702]: pgmap v10849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:33 smithi057 ceph-mon[92072]: pgmap v10849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:33 smithi122 ceph-mon[125440]: pgmap v10849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:34.551+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:36:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:34.551+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:36:34.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:34.551+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:36:34.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:34.551+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:36:34.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:34.551+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:36:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:35 smithi136 ceph-mon[125702]: pgmap v10850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:35 smithi057 ceph-mon[92072]: pgmap v10850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:35 smithi122 ceph-mon[125440]: pgmap v10850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:37 smithi136 ceph-mon[125702]: pgmap v10851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:37 smithi057 ceph-mon[92072]: pgmap v10851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:37 smithi122 ceph-mon[125440]: pgmap v10851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:39 smithi136 ceph-mon[125702]: pgmap v10852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:39 smithi057 ceph-mon[92072]: pgmap v10852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:39 smithi122 ceph-mon[125440]: pgmap v10852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:41 smithi136 ceph-mon[125702]: pgmap v10853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:41 smithi057 ceph-mon[92072]: pgmap v10853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:41 smithi122 ceph-mon[125440]: pgmap v10853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:43 smithi136 ceph-mon[125702]: pgmap v10854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:43 smithi057 ceph-mon[92072]: pgmap v10854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:43 smithi122 ceph-mon[125440]: pgmap v10854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:45 smithi136 ceph-mon[125702]: pgmap v10855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:45 smithi057 ceph-mon[92072]: pgmap v10855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:45 smithi122 ceph-mon[125440]: pgmap v10855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:47 smithi136 ceph-mon[125702]: pgmap v10856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:47 smithi057 ceph-mon[92072]: pgmap v10856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:47 smithi122 ceph-mon[125440]: pgmap v10856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:49.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:49.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:36:49.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:49.567+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:36:49.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:49.567+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:36:49.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:49.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:36:49.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:36:49.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:36:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:49 smithi136 ceph-mon[125702]: pgmap v10857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:49 smithi057 ceph-mon[92072]: pgmap v10857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:49 smithi122 ceph-mon[125440]: pgmap v10857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:51 smithi136 ceph-mon[125702]: pgmap v10858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:52.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:51 smithi057 ceph-mon[92072]: pgmap v10858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:51 smithi122 ceph-mon[125440]: pgmap v10858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:53 smithi136 ceph-mon[125702]: pgmap v10859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:53 smithi057 ceph-mon[92072]: pgmap v10859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:53 smithi122 ceph-mon[125440]: pgmap v10859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:36:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:55 smithi057 ceph-mon[92072]: pgmap v10860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:55 smithi122 ceph-mon[125440]: pgmap v10860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:55 smithi136 ceph-mon[125702]: pgmap v10860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:57 smithi057 ceph-mon[92072]: pgmap v10861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:57 smithi122 ceph-mon[125440]: pgmap v10861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:36:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:57 smithi136 ceph-mon[125702]: pgmap v10861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:36:59 smithi057 ceph-mon[92072]: pgmap v10862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:36:59 smithi122 ceph-mon[125440]: pgmap v10862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:36:59 smithi136 ceph-mon[125702]: pgmap v10862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:01 smithi057 ceph-mon[92072]: pgmap v10863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:01 smithi122 ceph-mon[125440]: pgmap v10863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:01 smithi136 ceph-mon[125702]: pgmap v10863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:03 smithi057 ceph-mon[92072]: pgmap v10864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:37:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:03 smithi122 ceph-mon[125440]: pgmap v10864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:37:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:03 smithi136 ceph-mon[125702]: pgmap v10864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:37:04.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:04.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:37:04.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:04.575+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:37:04.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:04.575+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:37:04.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:04.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:37:04.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:04.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:37:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:05 smithi057 ceph-mon[92072]: pgmap v10865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:37:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:05 smithi122 ceph-mon[125440]: pgmap v10865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:37:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:05 smithi136 ceph-mon[125702]: pgmap v10865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:37:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:06 smithi057 ceph-mon[92072]: osdmap e751: 12 total, 12 up, 12 in 2023-03-02T16:37:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:06 smithi122 ceph-mon[125440]: osdmap e751: 12 total, 12 up, 12 in 2023-03-02T16:37:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:06 smithi136 ceph-mon[125702]: osdmap e751: 12 total, 12 up, 12 in 2023-03-02T16:37:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:07 smithi057 ceph-mon[92072]: pgmap v10867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:37:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:37:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:07 smithi122 ceph-mon[125440]: pgmap v10867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:37:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:37:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:07 smithi136 ceph-mon[125702]: pgmap v10867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:37:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:37:10.153 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:09 smithi122 ceph-mon[125440]: pgmap v10868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:37:10.153 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:09 smithi122 ceph-mon[125440]: osdmap e752: 12 total, 12 up, 12 in 2023-03-02T16:37:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:09 smithi057 ceph-mon[92072]: pgmap v10868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:37:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:09 smithi057 ceph-mon[92072]: osdmap e752: 12 total, 12 up, 12 in 2023-03-02T16:37:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:09 smithi136 ceph-mon[125702]: pgmap v10868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:37:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:09 smithi136 ceph-mon[125702]: osdmap e752: 12 total, 12 up, 12 in 2023-03-02T16:37:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: pgmap v10870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:37:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: pgmap v10870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:37:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: pgmap v10870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:37:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:12.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:12 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:37:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:12 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 79731k 2023-03-02T16:37:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:12 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:37:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:12 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 81645211: error parsing value: Value '81645211' is below minimum 939524096 2023-03-02T16:37:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:13.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:12 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:37:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:12 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 79731k 2023-03-02T16:37:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:12 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:37:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:12 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 81645211: error parsing value: Value '81645211' is below minimum 939524096 2023-03-02T16:37:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:13.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:12 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:37:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:12 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 79731k 2023-03-02T16:37:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:12 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:37:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:12 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 81645211: error parsing value: Value '81645211' is below minimum 939524096 2023-03-02T16:37:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:13.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: pgmap v10871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:37:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:37:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:37:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: pgmap v10871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:37:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:37:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:37:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: pgmap v10871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:37:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:37:14.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:37:14.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:37:14.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:37:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:14 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:37:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:14 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:37:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:14 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:37:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:14 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:37:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:14 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:37:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:14 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:37:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:15 smithi136 ceph-mon[125702]: pgmap v10872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T16:37:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:15 smithi057 ceph-mon[92072]: pgmap v10872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T16:37:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:15 smithi122 ceph-mon[125440]: pgmap v10872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T16:37:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:17 smithi136 ceph-mon[125702]: pgmap v10873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:37:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:17 smithi057 ceph-mon[92072]: pgmap v10873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:37:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:17 smithi122 ceph-mon[125440]: pgmap v10873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:37:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:19.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:37:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:19.584+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:37:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:19.584+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:37:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:19.584+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:37:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:19.584+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:37:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:19 smithi136 ceph-mon[125702]: pgmap v10874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:37:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:19 smithi057 ceph-mon[92072]: pgmap v10874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:37:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:19 smithi122 ceph-mon[125440]: pgmap v10874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:37:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:21 smithi136 ceph-mon[125702]: pgmap v10875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:37:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:21 smithi057 ceph-mon[92072]: pgmap v10875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:37:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:21 smithi122 ceph-mon[125440]: pgmap v10875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:37:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:23 smithi136 ceph-mon[125702]: pgmap v10876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:37:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:23 smithi057 ceph-mon[92072]: pgmap v10876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:37:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:23 smithi122 ceph-mon[125440]: pgmap v10876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:37:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:25 smithi136 ceph-mon[125702]: pgmap v10877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:25 smithi057 ceph-mon[92072]: pgmap v10877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:25 smithi122 ceph-mon[125440]: pgmap v10877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:26.294+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:37:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:26.294+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:37:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:26.294+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 159 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:37:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:26.294+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 158 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:37:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:27 smithi136 ceph-mon[125702]: pgmap v10878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:27 smithi057 ceph-mon[92072]: pgmap v10878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:27 smithi122 ceph-mon[125440]: pgmap v10878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:29 smithi136 ceph-mon[125702]: pgmap v10879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:29 smithi057 ceph-mon[92072]: pgmap v10879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:29 smithi122 ceph-mon[125440]: pgmap v10879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:31 smithi136 ceph-mon[125702]: pgmap v10880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:31 smithi057 ceph-mon[92072]: pgmap v10880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:31 smithi122 ceph-mon[125440]: pgmap v10880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:33 smithi136 ceph-mon[125702]: pgmap v10881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:33 smithi057 ceph-mon[92072]: pgmap v10881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:33 smithi122 ceph-mon[125440]: pgmap v10881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:34.590+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:37:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:34.590+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:37:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:34.590+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:37:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:34.590+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:37:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:34.590+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:37:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:35 smithi136 ceph-mon[125702]: pgmap v10882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:35 smithi057 ceph-mon[92072]: pgmap v10882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:35 smithi122 ceph-mon[125440]: pgmap v10882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:37 smithi136 ceph-mon[125702]: pgmap v10883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:37 smithi057 ceph-mon[92072]: pgmap v10883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:37 smithi122 ceph-mon[125440]: pgmap v10883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:39 smithi136 ceph-mon[125702]: pgmap v10884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:39 smithi057 ceph-mon[92072]: pgmap v10884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:39 smithi122 ceph-mon[125440]: pgmap v10884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:41 smithi057 ceph-mon[92072]: pgmap v10885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:41 smithi122 ceph-mon[125440]: pgmap v10885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:41 smithi136 ceph-mon[125702]: pgmap v10885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:43 smithi057 ceph-mon[92072]: pgmap v10886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:43 smithi122 ceph-mon[125440]: pgmap v10886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:43 smithi136 ceph-mon[125702]: pgmap v10886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:45 smithi057 ceph-mon[92072]: pgmap v10887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:45 smithi122 ceph-mon[125440]: pgmap v10887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:45 smithi136 ceph-mon[125702]: pgmap v10887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:47 smithi057 ceph-mon[92072]: pgmap v10888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:47 smithi122 ceph-mon[125440]: pgmap v10888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:47 smithi136 ceph-mon[125702]: pgmap v10888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:49.597+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:37:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:49.597+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:37:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:49.597+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:37:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:49.597+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:37:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:37:49.597+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:37:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:49 smithi057 ceph-mon[92072]: pgmap v10889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:49 smithi122 ceph-mon[125440]: pgmap v10889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:49 smithi136 ceph-mon[125702]: pgmap v10889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:51 smithi057 ceph-mon[92072]: pgmap v10890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:51 smithi122 ceph-mon[125440]: pgmap v10890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:51 smithi136 ceph-mon[125702]: pgmap v10890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:54.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:53 smithi057 ceph-mon[92072]: pgmap v10891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:53 smithi122 ceph-mon[125440]: pgmap v10891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:53 smithi136 ceph-mon[125702]: pgmap v10891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:37:56.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:55 smithi057 ceph-mon[92072]: pgmap v10892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:55 smithi122 ceph-mon[125440]: pgmap v10892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:55 smithi136 ceph-mon[125702]: pgmap v10892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:57 smithi057 ceph-mon[92072]: pgmap v10893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:57 smithi122 ceph-mon[125440]: pgmap v10893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:37:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:57 smithi136 ceph-mon[125702]: pgmap v10893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:37:59 smithi057 ceph-mon[92072]: pgmap v10894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:37:59 smithi122 ceph-mon[125440]: pgmap v10894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:37:59 smithi136 ceph-mon[125702]: pgmap v10894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:01 smithi057 ceph-mon[92072]: pgmap v10895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:01 smithi122 ceph-mon[125440]: pgmap v10895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:01 smithi136 ceph-mon[125702]: pgmap v10895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:03 smithi057 ceph-mon[92072]: pgmap v10896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:38:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:03 smithi122 ceph-mon[125440]: pgmap v10896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:38:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:03 smithi136 ceph-mon[125702]: pgmap v10896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:38:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:04.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:38:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:04.610+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:38:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:04.610+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:38:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:04.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:38:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:04.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:38:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:05 smithi057 ceph-mon[92072]: pgmap v10897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:38:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:05 smithi122 ceph-mon[125440]: pgmap v10897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:38:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:05 smithi136 ceph-mon[125702]: pgmap v10897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:38:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:06 smithi057 ceph-mon[92072]: osdmap e753: 12 total, 12 up, 12 in 2023-03-02T16:38:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:06 smithi057 ceph-mon[92072]: pgmap v10899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:38:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:06 smithi122 ceph-mon[125440]: osdmap e753: 12 total, 12 up, 12 in 2023-03-02T16:38:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:06 smithi122 ceph-mon[125440]: pgmap v10899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:38:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:06 smithi136 ceph-mon[125702]: osdmap e753: 12 total, 12 up, 12 in 2023-03-02T16:38:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:06 smithi136 ceph-mon[125702]: pgmap v10899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:38:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:09 smithi136 ceph-mon[125702]: pgmap v10900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:38:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:09 smithi057 ceph-mon[92072]: pgmap v10900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:38:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:09 smithi122 ceph-mon[125440]: pgmap v10900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:38:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:11.302+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:38:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:11.302+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:38:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:11.302+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 159 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:38:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:11.302+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 160 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:38:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:11 smithi136 ceph-mon[125702]: pgmap v10901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:38:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:11 smithi057 ceph-mon[92072]: pgmap v10901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:38:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:11 smithi122 ceph-mon[125440]: pgmap v10901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:38:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:13 smithi136 ceph-mon[125702]: pgmap v10902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:38:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:38:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:38:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:38:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:38:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:13 smithi057 ceph-mon[92072]: pgmap v10902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:38:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:38:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:38:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:38:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:38:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:13 smithi122 ceph-mon[125440]: pgmap v10902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:38:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:38:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:38:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:38:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:38:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:15 smithi136 ceph-mon[125702]: pgmap v10903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:38:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:15 smithi136 ceph-mon[125702]: osdmap e754: 12 total, 12 up, 12 in 2023-03-02T16:38:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:15 smithi057 ceph-mon[92072]: pgmap v10903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:38:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:15 smithi057 ceph-mon[92072]: osdmap e754: 12 total, 12 up, 12 in 2023-03-02T16:38:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:15 smithi122 ceph-mon[125440]: pgmap v10903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:38:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:15 smithi122 ceph-mon[125440]: osdmap e754: 12 total, 12 up, 12 in 2023-03-02T16:38:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:17 smithi136 ceph-mon[125702]: pgmap v10905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:38:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:17 smithi057 ceph-mon[92072]: pgmap v10905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:38:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:17 smithi122 ceph-mon[125440]: pgmap v10905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:38:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:19.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:38:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:19.616+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:38:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:19.616+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:38:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:19.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:38:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:19.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:38:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:19 smithi136 ceph-mon[125702]: pgmap v10906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:38:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:19 smithi057 ceph-mon[92072]: pgmap v10906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:38:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:19 smithi122 ceph-mon[125440]: pgmap v10906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:38:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:21 smithi136 ceph-mon[125702]: pgmap v10907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:38:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:21 smithi057 ceph-mon[92072]: pgmap v10907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:38:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:21 smithi122 ceph-mon[125440]: pgmap v10907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:38:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:23 smithi136 ceph-mon[125702]: pgmap v10908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:38:24.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:23 smithi057 ceph-mon[92072]: pgmap v10908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:38:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:23 smithi122 ceph-mon[125440]: pgmap v10908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:38:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:25 smithi136 ceph-mon[125702]: pgmap v10909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:38:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:25 smithi057 ceph-mon[92072]: pgmap v10909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:38:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:25 smithi122 ceph-mon[125440]: pgmap v10909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:38:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:27 smithi136 ceph-mon[125702]: pgmap v10910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:38:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:27 smithi057 ceph-mon[92072]: pgmap v10910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:38:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:27 smithi122 ceph-mon[125440]: pgmap v10910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:38:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:29 smithi136 ceph-mon[125702]: pgmap v10911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:29 smithi057 ceph-mon[92072]: pgmap v10911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:29 smithi122 ceph-mon[125440]: pgmap v10911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:31 smithi136 ceph-mon[125702]: pgmap v10912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:31 smithi057 ceph-mon[92072]: pgmap v10912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:31 smithi122 ceph-mon[125440]: pgmap v10912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:33 smithi136 ceph-mon[125702]: pgmap v10913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:33 smithi057 ceph-mon[92072]: pgmap v10913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:33 smithi122 ceph-mon[125440]: pgmap v10913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:34.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:38:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:34.629+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:38:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:34.629+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:38:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:34.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:38:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:34.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:38:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:35 smithi136 ceph-mon[125702]: pgmap v10914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:35 smithi057 ceph-mon[92072]: pgmap v10914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:35 smithi122 ceph-mon[125440]: pgmap v10914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:37 smithi136 ceph-mon[125702]: pgmap v10915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:38.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:37 smithi057 ceph-mon[92072]: pgmap v10915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:37 smithi122 ceph-mon[125440]: pgmap v10915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:39 smithi136 ceph-mon[125702]: pgmap v10916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:39 smithi057 ceph-mon[92072]: pgmap v10916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:39 smithi122 ceph-mon[125440]: pgmap v10916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:41 smithi136 ceph-mon[125702]: pgmap v10917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:41 smithi057 ceph-mon[92072]: pgmap v10917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:41 smithi122 ceph-mon[125440]: pgmap v10917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:43 smithi057 ceph-mon[92072]: pgmap v10918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:43 smithi122 ceph-mon[125440]: pgmap v10918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:43 smithi136 ceph-mon[125702]: pgmap v10918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:45 smithi057 ceph-mon[92072]: pgmap v10919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:38:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:45 smithi122 ceph-mon[125440]: pgmap v10919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:38:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:45 smithi136 ceph-mon[125702]: pgmap v10919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:38:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:47 smithi057 ceph-mon[92072]: pgmap v10920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:38:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:47 smithi122 ceph-mon[125440]: pgmap v10920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:38:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:47 smithi136 ceph-mon[125702]: pgmap v10920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:38:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:49.635+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:38:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:49.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:38:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:49.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:38:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:49.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:38:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:38:49.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:38:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:49 smithi057 ceph-mon[92072]: pgmap v10921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:49 smithi122 ceph-mon[125440]: pgmap v10921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:49 smithi136 ceph-mon[125702]: pgmap v10921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:52.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:51 smithi057 ceph-mon[92072]: pgmap v10922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:38:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:51 smithi122 ceph-mon[125440]: pgmap v10922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:38:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:51 smithi136 ceph-mon[125702]: pgmap v10922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:38:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:53 smithi057 ceph-mon[92072]: pgmap v10923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:53 smithi122 ceph-mon[125440]: pgmap v10923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:53 smithi136 ceph-mon[125702]: pgmap v10923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:38:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:55 smithi057 ceph-mon[92072]: pgmap v10924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:55 smithi122 ceph-mon[125440]: pgmap v10924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:55 smithi136 ceph-mon[125702]: pgmap v10924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:57 smithi057 ceph-mon[92072]: pgmap v10925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:57 smithi122 ceph-mon[125440]: pgmap v10925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:38:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:57 smithi136 ceph-mon[125702]: pgmap v10925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:00.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:38:59 smithi057 ceph-mon[92072]: pgmap v10926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:38:59 smithi122 ceph-mon[125440]: pgmap v10926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:38:59 smithi136 ceph-mon[125702]: pgmap v10926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:01 smithi057 ceph-mon[92072]: pgmap v10927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:01 smithi122 ceph-mon[125440]: pgmap v10927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:01 smithi136 ceph-mon[125702]: pgmap v10927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:03 smithi057 ceph-mon[92072]: pgmap v10928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:39:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:03 smithi122 ceph-mon[125440]: pgmap v10928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:39:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:03 smithi136 ceph-mon[125702]: pgmap v10928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:39:04.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:04.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:39:04.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:04.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:39:04.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:04.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:39:04.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:04.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:39:04.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:04.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:39:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:05 smithi057 ceph-mon[92072]: pgmap v10929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:39:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:05 smithi122 ceph-mon[125440]: pgmap v10929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:39:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:05 smithi136 ceph-mon[125702]: pgmap v10929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:39:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:06 smithi122 ceph-mon[125440]: osdmap e755: 12 total, 12 up, 12 in 2023-03-02T16:39:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:06 smithi122 ceph-mon[125440]: pgmap v10931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:39:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:06 smithi136 ceph-mon[125702]: osdmap e755: 12 total, 12 up, 12 in 2023-03-02T16:39:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:06 smithi136 ceph-mon[125702]: pgmap v10931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:39:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:06 smithi057 ceph-mon[92072]: osdmap e755: 12 total, 12 up, 12 in 2023-03-02T16:39:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:06 smithi057 ceph-mon[92072]: pgmap v10931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:39:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:09 smithi136 ceph-mon[125702]: pgmap v10932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:39:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:09 smithi057 ceph-mon[92072]: pgmap v10932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:39:09.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:09 smithi122 ceph-mon[125440]: pgmap v10932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:39:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:10 smithi136 ceph-mon[125702]: osdmap e756: 12 total, 12 up, 12 in 2023-03-02T16:39:11.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:10 smithi057 ceph-mon[92072]: osdmap e756: 12 total, 12 up, 12 in 2023-03-02T16:39:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:10 smithi122 ceph-mon[125440]: osdmap e756: 12 total, 12 up, 12 in 2023-03-02T16:39:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:11 smithi136 ceph-mon[125702]: pgmap v10934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:39:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:11 smithi057 ceph-mon[92072]: pgmap v10934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:39:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:11 smithi122 ceph-mon[125440]: pgmap v10934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:39:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:13 smithi136 ceph-mon[125702]: pgmap v10935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:39:14.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:13 smithi057 ceph-mon[92072]: pgmap v10935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:39:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:13 smithi122 ceph-mon[125440]: pgmap v10935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:39:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:39:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:39:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:39:15.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:39:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:39:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:39:15.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:39:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:39:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:39:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:15 smithi136 ceph-mon[125702]: pgmap v10936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T16:39:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:39:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:39:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:39:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:15 smithi057 ceph-mon[92072]: pgmap v10936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T16:39:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:39:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:39:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:39:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:15 smithi122 ceph-mon[125440]: pgmap v10936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T16:39:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:39:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:39:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:39:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:17 smithi136 ceph-mon[125702]: pgmap v10937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:39:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:17 smithi057 ceph-mon[92072]: pgmap v10937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:39:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:17 smithi122 ceph-mon[125440]: pgmap v10937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:39:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:19.663+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:39:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:19.663+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:39:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:19.663+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:39:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:19.663+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:39:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:19.663+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:39:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:19 smithi136 ceph-mon[125702]: pgmap v10938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:39:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:19 smithi057 ceph-mon[92072]: pgmap v10938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:39:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:19 smithi122 ceph-mon[125440]: pgmap v10938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:39:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:21 smithi136 ceph-mon[125702]: pgmap v10939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:39:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:21 smithi057 ceph-mon[92072]: pgmap v10939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:39:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:21 smithi122 ceph-mon[125440]: pgmap v10939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:39:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:23 smithi136 ceph-mon[125702]: pgmap v10940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:39:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:23 smithi057 ceph-mon[92072]: pgmap v10940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:39:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:23 smithi122 ceph-mon[125440]: pgmap v10940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:39:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:25 smithi057 ceph-mon[92072]: pgmap v10941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:25 smithi122 ceph-mon[125440]: pgmap v10941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:25 smithi136 ceph-mon[125702]: pgmap v10941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:27 smithi057 ceph-mon[92072]: pgmap v10942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:27 smithi122 ceph-mon[125440]: pgmap v10942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:27 smithi136 ceph-mon[125702]: pgmap v10942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:29 smithi057 ceph-mon[92072]: pgmap v10943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:29 smithi122 ceph-mon[125440]: pgmap v10943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:29 smithi136 ceph-mon[125702]: pgmap v10943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:31 smithi057 ceph-mon[92072]: pgmap v10944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:31 smithi122 ceph-mon[125440]: pgmap v10944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:31 smithi136 ceph-mon[125702]: pgmap v10944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:33 smithi057 ceph-mon[92072]: pgmap v10945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:33 smithi122 ceph-mon[125440]: pgmap v10945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:33 smithi136 ceph-mon[125702]: pgmap v10945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:34.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:39:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:34.678+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:39:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:34.678+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:39:34.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:34.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:39:34.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:34.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:39:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:35 smithi057 ceph-mon[92072]: pgmap v10946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:35 smithi122 ceph-mon[125440]: pgmap v10946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:35 smithi136 ceph-mon[125702]: pgmap v10946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:37 smithi057 ceph-mon[92072]: pgmap v10947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:37 smithi122 ceph-mon[125440]: pgmap v10947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:37 smithi136 ceph-mon[125702]: pgmap v10947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:39 smithi057 ceph-mon[92072]: pgmap v10948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:39 smithi122 ceph-mon[125440]: pgmap v10948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:39 smithi136 ceph-mon[125702]: pgmap v10948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:42.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:41 smithi057 ceph-mon[92072]: pgmap v10949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:41 smithi122 ceph-mon[125440]: pgmap v10949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:41 smithi136 ceph-mon[125702]: pgmap v10949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:43 smithi057 ceph-mon[92072]: pgmap v10950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:43 smithi122 ceph-mon[125440]: pgmap v10950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:43 smithi136 ceph-mon[125702]: pgmap v10950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:46.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:45 smithi057 ceph-mon[92072]: pgmap v10951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:45 smithi122 ceph-mon[125440]: pgmap v10951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:45 smithi136 ceph-mon[125702]: pgmap v10951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:47 smithi057 ceph-mon[92072]: pgmap v10952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:47 smithi122 ceph-mon[125440]: pgmap v10952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:47 smithi136 ceph-mon[125702]: pgmap v10952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:49.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:49.694+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:39:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:49.694+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:39:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:49.694+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:39:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:49.694+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:39:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:39:49.694+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:39:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:49 smithi057 ceph-mon[92072]: pgmap v10953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:49 smithi122 ceph-mon[125440]: pgmap v10953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:49 smithi136 ceph-mon[125702]: pgmap v10953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:51 smithi057 ceph-mon[92072]: pgmap v10954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:51 smithi122 ceph-mon[125440]: pgmap v10954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:51 smithi136 ceph-mon[125702]: pgmap v10954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:53 smithi057 ceph-mon[92072]: pgmap v10955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:53 smithi122 ceph-mon[125440]: pgmap v10955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:53 smithi136 ceph-mon[125702]: pgmap v10955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:39:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:55 smithi057 ceph-mon[92072]: pgmap v10956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:55 smithi122 ceph-mon[125440]: pgmap v10956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:55 smithi136 ceph-mon[125702]: pgmap v10956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:57 smithi057 ceph-mon[92072]: pgmap v10957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:57 smithi122 ceph-mon[125440]: pgmap v10957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:39:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:57 smithi136 ceph-mon[125702]: pgmap v10957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:00.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:39:59 smithi057 ceph-mon[92072]: pgmap v10958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:39:59 smithi122 ceph-mon[125440]: pgmap v10958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:39:59 smithi136 ceph-mon[125702]: pgmap v10958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:01.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T16:40:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T16:40:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T16:40:02.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:01 smithi057 ceph-mon[92072]: pgmap v10959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:01 smithi122 ceph-mon[125440]: pgmap v10959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:01 smithi136 ceph-mon[125702]: pgmap v10959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:03.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:02 smithi122 ceph-mon[125440]: pgmap v10960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:40:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:02 smithi136 ceph-mon[125702]: pgmap v10960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:40:03.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:02 smithi057 ceph-mon[92072]: pgmap v10960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:40:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:04.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:40:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:04.711+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:40:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:04.711+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:40:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:04.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:40:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:04.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:40:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:05 smithi136 ceph-mon[125702]: pgmap v10961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:40:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:05 smithi057 ceph-mon[92072]: pgmap v10961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:40:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:05 smithi122 ceph-mon[125440]: pgmap v10961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:40:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:06 smithi136 ceph-mon[125702]: osdmap e757: 12 total, 12 up, 12 in 2023-03-02T16:40:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:06 smithi057 ceph-mon[92072]: osdmap e757: 12 total, 12 up, 12 in 2023-03-02T16:40:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:06 smithi122 ceph-mon[125440]: osdmap e757: 12 total, 12 up, 12 in 2023-03-02T16:40:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:07 smithi136 ceph-mon[125702]: pgmap v10963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:40:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:07 smithi057 ceph-mon[92072]: pgmap v10963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:40:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:07 smithi122 ceph-mon[125440]: pgmap v10963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:40:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:09 smithi057 ceph-mon[92072]: pgmap v10964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:40:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:09 smithi057 ceph-mon[92072]: osdmap e758: 12 total, 12 up, 12 in 2023-03-02T16:40:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:09 smithi122 ceph-mon[125440]: pgmap v10964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:40:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:09 smithi122 ceph-mon[125440]: osdmap e758: 12 total, 12 up, 12 in 2023-03-02T16:40:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:09 smithi136 ceph-mon[125702]: pgmap v10964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:40:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:09 smithi136 ceph-mon[125702]: osdmap e758: 12 total, 12 up, 12 in 2023-03-02T16:40:12.096 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:11 smithi057 ceph-mon[92072]: pgmap v10966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:40:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:11 smithi122 ceph-mon[125440]: pgmap v10966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:40:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:11 smithi136 ceph-mon[125702]: pgmap v10966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:40:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:13 smithi057 ceph-mon[92072]: pgmap v10967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:40:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:13 smithi122 ceph-mon[125440]: pgmap v10967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:40:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:13 smithi136 ceph-mon[125702]: pgmap v10967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:40:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:15 smithi136 ceph-mon[125702]: pgmap v10968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:40:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:40:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:15 smithi057 ceph-mon[92072]: pgmap v10968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:40:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:40:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:15 smithi122 ceph-mon[125440]: pgmap v10968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:40:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:40:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:40:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:40:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:40:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:40:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:40:17.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:40:17.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:40:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:17 smithi057 ceph-mon[92072]: pgmap v10969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:40:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:17 smithi122 ceph-mon[125440]: pgmap v10969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:40:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:17 smithi136 ceph-mon[125702]: pgmap v10969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:40:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:19.721+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:40:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:19.721+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:40:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:19.721+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:40:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:19.721+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:40:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:19.721+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:40:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:19 smithi057 ceph-mon[92072]: pgmap v10970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:40:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:19 smithi122 ceph-mon[125440]: pgmap v10970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:40:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:19 smithi136 ceph-mon[125702]: pgmap v10970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:40:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:21 smithi057 ceph-mon[92072]: pgmap v10971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:40:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:21 smithi122 ceph-mon[125440]: pgmap v10971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:40:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:21 smithi136 ceph-mon[125702]: pgmap v10971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:40:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:23 smithi057 ceph-mon[92072]: pgmap v10972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:40:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:23 smithi122 ceph-mon[125440]: pgmap v10972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:40:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:23 smithi136 ceph-mon[125702]: pgmap v10972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:40:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:25 smithi136 ceph-mon[125702]: pgmap v10973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:40:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:25 smithi057 ceph-mon[92072]: pgmap v10973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:40:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:25 smithi122 ceph-mon[125440]: pgmap v10973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:40:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:27 smithi136 ceph-mon[125702]: pgmap v10974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:40:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:27 smithi057 ceph-mon[92072]: pgmap v10974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:40:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:27 smithi122 ceph-mon[125440]: pgmap v10974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:40:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:29 smithi136 ceph-mon[125702]: pgmap v10975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:30.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:29 smithi057 ceph-mon[92072]: pgmap v10975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:29 smithi122 ceph-mon[125440]: pgmap v10975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:31 smithi136 ceph-mon[125702]: pgmap v10976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:40:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:31 smithi057 ceph-mon[92072]: pgmap v10976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:40:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:31 smithi122 ceph-mon[125440]: pgmap v10976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:40:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:33 smithi136 ceph-mon[125702]: pgmap v10977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:33 smithi057 ceph-mon[92072]: pgmap v10977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:33 smithi122 ceph-mon[125440]: pgmap v10977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:34.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:34.731+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:40:34.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:34.731+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:40:34.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:34.731+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:40:34.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:34.731+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:40:34.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:34.731+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:40:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:35 smithi057 ceph-mon[92072]: pgmap v10978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:35 smithi122 ceph-mon[125440]: pgmap v10978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:35 smithi136 ceph-mon[125702]: pgmap v10978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:37 smithi057 ceph-mon[92072]: pgmap v10979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:37 smithi122 ceph-mon[125440]: pgmap v10979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:37 smithi136 ceph-mon[125702]: pgmap v10979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:39 smithi057 ceph-mon[92072]: pgmap v10980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:39 smithi122 ceph-mon[125440]: pgmap v10980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:39 smithi136 ceph-mon[125702]: pgmap v10980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:42.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:41 smithi057 ceph-mon[92072]: pgmap v10981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:41 smithi122 ceph-mon[125440]: pgmap v10981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:41 smithi136 ceph-mon[125702]: pgmap v10981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:43 smithi057 ceph-mon[92072]: pgmap v10982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:43 smithi122 ceph-mon[125440]: pgmap v10982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:43 smithi136 ceph-mon[125702]: pgmap v10982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:46.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:45 smithi057 ceph-mon[92072]: pgmap v10983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:45 smithi122 ceph-mon[125440]: pgmap v10983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:45 smithi136 ceph-mon[125702]: pgmap v10983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:47 smithi057 ceph-mon[92072]: pgmap v10984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:47 smithi122 ceph-mon[125440]: pgmap v10984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:47 smithi136 ceph-mon[125702]: pgmap v10984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:49.742+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:40:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:49.742+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:40:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:49.742+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:40:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:49.742+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:40:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:40:49.742+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:40:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:49 smithi057 ceph-mon[92072]: pgmap v10985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:49 smithi122 ceph-mon[125440]: pgmap v10985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:49 smithi136 ceph-mon[125702]: pgmap v10985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:51 smithi057 ceph-mon[92072]: pgmap v10986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:51 smithi122 ceph-mon[125440]: pgmap v10986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:51 smithi136 ceph-mon[125702]: pgmap v10986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:53 smithi057 ceph-mon[92072]: pgmap v10987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:53 smithi122 ceph-mon[125440]: pgmap v10987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:53 smithi136 ceph-mon[125702]: pgmap v10987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:40:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:55 smithi057 ceph-mon[92072]: pgmap v10988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:55 smithi122 ceph-mon[125440]: pgmap v10988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:55 smithi136 ceph-mon[125702]: pgmap v10988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:58.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:57 smithi057 ceph-mon[92072]: pgmap v10989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:57 smithi122 ceph-mon[125440]: pgmap v10989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:40:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:57 smithi136 ceph-mon[125702]: pgmap v10989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:40:59 smithi057 ceph-mon[92072]: pgmap v10990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:40:59 smithi122 ceph-mon[125440]: pgmap v10990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:40:59 smithi136 ceph-mon[125702]: pgmap v10990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:01 smithi057 ceph-mon[92072]: pgmap v10991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:01 smithi122 ceph-mon[125440]: pgmap v10991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:01 smithi136 ceph-mon[125702]: pgmap v10991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:03 smithi057 ceph-mon[92072]: pgmap v10992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:41:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:03 smithi122 ceph-mon[125440]: pgmap v10992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:41:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:03 smithi136 ceph-mon[125702]: pgmap v10992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:41:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:04.756+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:41:04.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:04.756+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:41:04.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:04.756+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:41:04.757 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:04.756+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:41:04.757 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:04.756+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:41:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:05 smithi057 ceph-mon[92072]: pgmap v10993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:41:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:05 smithi122 ceph-mon[125440]: pgmap v10993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:41:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:05 smithi136 ceph-mon[125702]: pgmap v10993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:41:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:07 smithi057 ceph-mon[92072]: pgmap v10994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:41:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:07 smithi122 ceph-mon[125440]: pgmap v10994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:41:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:07 smithi136 ceph-mon[125702]: pgmap v10994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:41:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:09 smithi057 ceph-mon[92072]: pgmap v10995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:41:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:09 smithi122 ceph-mon[125440]: pgmap v10995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:41:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:09 smithi136 ceph-mon[125702]: pgmap v10995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:41:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:11.329+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:41:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:11.329+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:41:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:11.329+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 160 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:41:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:11.329+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 161 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:41:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:11 smithi057 ceph-mon[92072]: pgmap v10996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:41:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:11 smithi057 ceph-mon[92072]: osdmap e759: 12 total, 12 up, 12 in 2023-03-02T16:41:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:11 smithi122 ceph-mon[125440]: pgmap v10996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:41:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:11 smithi122 ceph-mon[125440]: osdmap e759: 12 total, 12 up, 12 in 2023-03-02T16:41:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:11 smithi136 ceph-mon[125702]: pgmap v10996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:41:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:11 smithi136 ceph-mon[125702]: osdmap e759: 12 total, 12 up, 12 in 2023-03-02T16:41:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:13 smithi057 ceph-mon[92072]: pgmap v10998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:13 smithi122 ceph-mon[125440]: pgmap v10998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:13 smithi136 ceph-mon[125702]: pgmap v10998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:15 smithi136 ceph-mon[125702]: pgmap v10999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:15 smithi136 ceph-mon[125702]: osdmap e760: 12 total, 12 up, 12 in 2023-03-02T16:41:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:15 smithi057 ceph-mon[92072]: pgmap v10999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:15 smithi057 ceph-mon[92072]: osdmap e760: 12 total, 12 up, 12 in 2023-03-02T16:41:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:15 smithi122 ceph-mon[125440]: pgmap v10999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:15 smithi122 ceph-mon[125440]: osdmap e760: 12 total, 12 up, 12 in 2023-03-02T16:41:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:41:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:41:17.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:41:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:17 smithi057 ceph-mon[92072]: pgmap v11001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:41:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:41:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:41:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:41:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:17 smithi122 ceph-mon[125440]: pgmap v11001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:41:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:41:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:41:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:41:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:17 smithi136 ceph-mon[125702]: pgmap v11001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:41:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:41:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:41:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:41:19.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:19.762+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:41:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:19.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:41:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:19.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:41:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:19.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:41:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:19.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:41:20.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:19 smithi057 ceph-mon[92072]: pgmap v11002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T16:41:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:19 smithi122 ceph-mon[125440]: pgmap v11002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T16:41:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:19 smithi136 ceph-mon[125702]: pgmap v11002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T16:41:22.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:21 smithi057 ceph-mon[92072]: pgmap v11003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 318 B/s wr, 10 op/s 2023-03-02T16:41:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:21 smithi122 ceph-mon[125440]: pgmap v11003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 318 B/s wr, 10 op/s 2023-03-02T16:41:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:21 smithi136 ceph-mon[125702]: pgmap v11003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 318 B/s wr, 10 op/s 2023-03-02T16:41:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:23 smithi057 ceph-mon[92072]: pgmap v11004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:23 smithi122 ceph-mon[125440]: pgmap v11004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:23 smithi136 ceph-mon[125702]: pgmap v11004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:26.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:25 smithi057 ceph-mon[92072]: pgmap v11005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:25 smithi122 ceph-mon[125440]: pgmap v11005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:25 smithi136 ceph-mon[125702]: pgmap v11005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:41:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:27 smithi057 ceph-mon[92072]: pgmap v11006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 174 B/s wr, 8 op/s 2023-03-02T16:41:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:27 smithi122 ceph-mon[125440]: pgmap v11006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 174 B/s wr, 8 op/s 2023-03-02T16:41:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:27 smithi136 ceph-mon[125702]: pgmap v11006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 174 B/s wr, 8 op/s 2023-03-02T16:41:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:29 smithi057 ceph-mon[92072]: pgmap v11007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T16:41:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:29 smithi122 ceph-mon[125440]: pgmap v11007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T16:41:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:29 smithi136 ceph-mon[125702]: pgmap v11007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T16:41:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:31 smithi057 ceph-mon[92072]: pgmap v11008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:31 smithi122 ceph-mon[125440]: pgmap v11008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:31 smithi136 ceph-mon[125702]: pgmap v11008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:33 smithi057 ceph-mon[92072]: pgmap v11009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T16:41:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:33 smithi122 ceph-mon[125440]: pgmap v11009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T16:41:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:33 smithi136 ceph-mon[125702]: pgmap v11009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T16:41:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:34.778+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:41:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:34.779+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:41:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:34.779+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:41:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:34.779+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:41:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:34.779+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:41:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:35 smithi057 ceph-mon[92072]: pgmap v11010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:35 smithi122 ceph-mon[125440]: pgmap v11010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:35 smithi136 ceph-mon[125702]: pgmap v11010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:38.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:37 smithi057 ceph-mon[92072]: pgmap v11011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:37 smithi122 ceph-mon[125440]: pgmap v11011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:37 smithi136 ceph-mon[125702]: pgmap v11011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:39 smithi057 ceph-mon[92072]: pgmap v11012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:39 smithi122 ceph-mon[125440]: pgmap v11012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:39 smithi136 ceph-mon[125702]: pgmap v11012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:41 smithi057 ceph-mon[92072]: pgmap v11013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:41:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:41 smithi122 ceph-mon[125440]: pgmap v11013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:41:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:41 smithi136 ceph-mon[125702]: pgmap v11013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:41:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:43 smithi057 ceph-mon[92072]: pgmap v11014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:43 smithi122 ceph-mon[125440]: pgmap v11014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:43 smithi136 ceph-mon[125702]: pgmap v11014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:45 smithi057 ceph-mon[92072]: pgmap v11015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:41:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:45 smithi122 ceph-mon[125440]: pgmap v11015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:41:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:45 smithi136 ceph-mon[125702]: pgmap v11015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:41:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:47 smithi122 ceph-mon[125440]: pgmap v11016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:41:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:47 smithi136 ceph-mon[125702]: pgmap v11016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:41:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:47 smithi057 ceph-mon[92072]: pgmap v11016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:41:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:49.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:41:49.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:49.794+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:41:49.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:49.794+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:41:49.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:49.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:41:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:41:49.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:41:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:49 smithi122 ceph-mon[125440]: pgmap v11017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:49 smithi136 ceph-mon[125702]: pgmap v11017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:49 smithi057 ceph-mon[92072]: pgmap v11017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:50 smithi136 ceph-mon[125702]: pgmap v11018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:50 smithi057 ceph-mon[92072]: pgmap v11018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:50 smithi122 ceph-mon[125440]: pgmap v11018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:53 smithi057 ceph-mon[92072]: pgmap v11019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:53 smithi122 ceph-mon[125440]: pgmap v11019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:53 smithi136 ceph-mon[125702]: pgmap v11019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:41:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:55 smithi057 ceph-mon[92072]: pgmap v11020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:55 smithi122 ceph-mon[125440]: pgmap v11020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:55 smithi136 ceph-mon[125702]: pgmap v11020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:57 smithi057 ceph-mon[92072]: pgmap v11021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:57 smithi122 ceph-mon[125440]: pgmap v11021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:41:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:57 smithi136 ceph-mon[125702]: pgmap v11021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:41:59 smithi057 ceph-mon[92072]: pgmap v11022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:41:59 smithi122 ceph-mon[125440]: pgmap v11022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:41:59 smithi136 ceph-mon[125702]: pgmap v11022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:01 smithi057 ceph-mon[92072]: pgmap v11023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:01 smithi122 ceph-mon[125440]: pgmap v11023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:01 smithi136 ceph-mon[125702]: pgmap v11023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:03 smithi057 ceph-mon[92072]: pgmap v11024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:42:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:03 smithi122 ceph-mon[125440]: pgmap v11024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:42:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:03 smithi136 ceph-mon[125702]: pgmap v11024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:42:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:04.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:42:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:04.803+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:42:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:04.803+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:42:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:04.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:42:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:04.804+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:42:06.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:05 smithi057 ceph-mon[92072]: pgmap v11025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:42:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:05 smithi122 ceph-mon[125440]: pgmap v11025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:42:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:05 smithi136 ceph-mon[125702]: pgmap v11025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:42:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:07 smithi057 ceph-mon[92072]: pgmap v11026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:42:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:07 smithi122 ceph-mon[125440]: pgmap v11026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:42:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:07 smithi136 ceph-mon[125702]: pgmap v11026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:42:10.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:09 smithi057 ceph-mon[92072]: pgmap v11027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:42:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:09 smithi122 ceph-mon[125440]: pgmap v11027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:42:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:09 smithi136 ceph-mon[125702]: pgmap v11027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:42:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:11 smithi057 ceph-mon[92072]: pgmap v11028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:42:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:11 smithi057 ceph-mon[92072]: osdmap e761: 12 total, 12 up, 12 in 2023-03-02T16:42:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:11 smithi122 ceph-mon[125440]: pgmap v11028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:42:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:11 smithi122 ceph-mon[125440]: osdmap e761: 12 total, 12 up, 12 in 2023-03-02T16:42:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:11 smithi136 ceph-mon[125702]: pgmap v11028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:42:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:11 smithi136 ceph-mon[125702]: osdmap e761: 12 total, 12 up, 12 in 2023-03-02T16:42:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:13 smithi057 ceph-mon[92072]: pgmap v11030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:42:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:13 smithi122 ceph-mon[125440]: pgmap v11030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:42:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:13 smithi136 ceph-mon[125702]: pgmap v11030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:42:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:15 smithi057 ceph-mon[92072]: pgmap v11031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:42:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:15 smithi057 ceph-mon[92072]: osdmap e762: 12 total, 12 up, 12 in 2023-03-02T16:42:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:15 smithi122 ceph-mon[125440]: pgmap v11031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:42:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:15 smithi122 ceph-mon[125440]: osdmap e762: 12 total, 12 up, 12 in 2023-03-02T16:42:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:15 smithi136 ceph-mon[125702]: pgmap v11031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:42:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:15 smithi136 ceph-mon[125702]: osdmap e762: 12 total, 12 up, 12 in 2023-03-02T16:42:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:17 smithi057 ceph-mon[92072]: pgmap v11033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:42:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:42:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:17 smithi122 ceph-mon[125440]: pgmap v11033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:42:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:42:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:17 smithi136 ceph-mon[125702]: pgmap v11033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:42:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:42:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:42:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:42:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:42:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:42:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:42:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:42:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:42:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:42:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:42:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:19.806+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:42:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:19.807+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:42:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:19.807+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:42:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:19.807+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:42:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:19.807+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:42:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:19 smithi057 ceph-mon[92072]: pgmap v11034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:42:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:19 smithi122 ceph-mon[125440]: pgmap v11034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:42:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:19 smithi136 ceph-mon[125702]: pgmap v11034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:42:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:21 smithi057 ceph-mon[92072]: pgmap v11035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:42:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:21 smithi122 ceph-mon[125440]: pgmap v11035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:42:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:21 smithi136 ceph-mon[125702]: pgmap v11035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:42:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:23 smithi057 ceph-mon[92072]: pgmap v11036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:42:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:23 smithi122 ceph-mon[125440]: pgmap v11036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:42:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:23 smithi136 ceph-mon[125702]: pgmap v11036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:42:26.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:25 smithi057 ceph-mon[92072]: pgmap v11037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:42:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:25 smithi122 ceph-mon[125440]: pgmap v11037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:42:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:25 smithi136 ceph-mon[125702]: pgmap v11037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:42:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:27 smithi057 ceph-mon[92072]: pgmap v11038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:42:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:27 smithi122 ceph-mon[125440]: pgmap v11038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:42:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:27 smithi136 ceph-mon[125702]: pgmap v11038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:42:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:29 smithi057 ceph-mon[92072]: pgmap v11039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:42:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:29 smithi122 ceph-mon[125440]: pgmap v11039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:42:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:29 smithi136 ceph-mon[125702]: pgmap v11039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:42:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:31 smithi057 ceph-mon[92072]: pgmap v11040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:31 smithi122 ceph-mon[125440]: pgmap v11040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:31 smithi136 ceph-mon[125702]: pgmap v11040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:33 smithi057 ceph-mon[92072]: pgmap v11041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:33 smithi122 ceph-mon[125440]: pgmap v11041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:33 smithi136 ceph-mon[125702]: pgmap v11041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:34.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:34.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:42:34.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:34.815+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:42:34.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:34.815+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:42:34.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:34.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:42:34.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:34.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:42:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:35 smithi057 ceph-mon[92072]: pgmap v11042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:35 smithi122 ceph-mon[125440]: pgmap v11042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:35 smithi136 ceph-mon[125702]: pgmap v11042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:37 smithi057 ceph-mon[92072]: pgmap v11043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:37 smithi122 ceph-mon[125440]: pgmap v11043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:37 smithi136 ceph-mon[125702]: pgmap v11043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:39 smithi057 ceph-mon[92072]: pgmap v11044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:39 smithi122 ceph-mon[125440]: pgmap v11044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:39 smithi136 ceph-mon[125702]: pgmap v11044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:41 smithi057 ceph-mon[92072]: pgmap v11045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:41 smithi122 ceph-mon[125440]: pgmap v11045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:41 smithi136 ceph-mon[125702]: pgmap v11045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:43 smithi057 ceph-mon[92072]: pgmap v11046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:43 smithi122 ceph-mon[125440]: pgmap v11046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:43 smithi136 ceph-mon[125702]: pgmap v11046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:46.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:45 smithi057 ceph-mon[92072]: pgmap v11047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:45 smithi122 ceph-mon[125440]: pgmap v11047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:45 smithi136 ceph-mon[125702]: pgmap v11047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:47 smithi122 ceph-mon[125440]: pgmap v11048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:47 smithi136 ceph-mon[125702]: pgmap v11048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:47 smithi057 ceph-mon[92072]: pgmap v11048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:49.828+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:42:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:49.828+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:42:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:49.828+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:42:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:49.828+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:42:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:42:49.829+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:42:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:49 smithi122 ceph-mon[125440]: pgmap v11049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:49 smithi136 ceph-mon[125702]: pgmap v11049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:50.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:49 smithi057 ceph-mon[92072]: pgmap v11049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:51 smithi122 ceph-mon[125440]: pgmap v11050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:51 smithi136 ceph-mon[125702]: pgmap v11050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:51 smithi057 ceph-mon[92072]: pgmap v11050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:53 smithi122 ceph-mon[125440]: pgmap v11051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:53 smithi136 ceph-mon[125702]: pgmap v11051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:53 smithi057 ceph-mon[92072]: pgmap v11051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:55 smithi136 ceph-mon[125702]: pgmap v11052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:55 smithi057 ceph-mon[92072]: pgmap v11052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:55 smithi122 ceph-mon[125440]: pgmap v11052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:56 smithi136 ceph-mon[125702]: pgmap v11053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:56 smithi057 ceph-mon[92072]: pgmap v11053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:57.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:56 smithi122 ceph-mon[125440]: pgmap v11053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:42:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:42:59 smithi057 ceph-mon[92072]: pgmap v11054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:42:59.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:42:59 smithi122 ceph-mon[125440]: pgmap v11054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:42:59 smithi136 ceph-mon[125702]: pgmap v11054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:01 smithi057 ceph-mon[92072]: pgmap v11055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:01 smithi122 ceph-mon[125440]: pgmap v11055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:01 smithi136 ceph-mon[125702]: pgmap v11055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:03 smithi057 ceph-mon[92072]: pgmap v11056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:43:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:03 smithi122 ceph-mon[125440]: pgmap v11056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:43:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:03 smithi136 ceph-mon[125702]: pgmap v11056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:43:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:04.839+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:43:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:04.839+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:43:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:04.839+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:43:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:04.839+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:43:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:04.839+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:43:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:05 smithi057 ceph-mon[92072]: pgmap v11057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:43:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:05 smithi122 ceph-mon[125440]: pgmap v11057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:43:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:05 smithi136 ceph-mon[125702]: pgmap v11057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:43:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:07 smithi057 ceph-mon[92072]: pgmap v11058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:43:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:07 smithi122 ceph-mon[125440]: pgmap v11058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:43:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:07 smithi136 ceph-mon[125702]: pgmap v11058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:43:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:09 smithi057 ceph-mon[92072]: pgmap v11059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:43:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:09 smithi122 ceph-mon[125440]: pgmap v11059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:43:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:09 smithi136 ceph-mon[125702]: pgmap v11059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:43:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:11 smithi057 ceph-mon[92072]: pgmap v11060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:43:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:11 smithi057 ceph-mon[92072]: osdmap e763: 12 total, 12 up, 12 in 2023-03-02T16:43:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:11 smithi122 ceph-mon[125440]: pgmap v11060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:43:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:11 smithi122 ceph-mon[125440]: osdmap e763: 12 total, 12 up, 12 in 2023-03-02T16:43:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:11 smithi136 ceph-mon[125702]: pgmap v11060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:43:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:11 smithi136 ceph-mon[125702]: osdmap e763: 12 total, 12 up, 12 in 2023-03-02T16:43:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:13 smithi057 ceph-mon[92072]: pgmap v11062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:43:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:13 smithi122 ceph-mon[125440]: pgmap v11062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:43:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:13 smithi136 ceph-mon[125702]: pgmap v11062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:43:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:15 smithi057 ceph-mon[92072]: pgmap v11063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:43:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:15 smithi057 ceph-mon[92072]: osdmap e764: 12 total, 12 up, 12 in 2023-03-02T16:43:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:15 smithi122 ceph-mon[125440]: pgmap v11063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:43:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:15 smithi122 ceph-mon[125440]: osdmap e764: 12 total, 12 up, 12 in 2023-03-02T16:43:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:15 smithi136 ceph-mon[125702]: pgmap v11063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:43:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:15 smithi136 ceph-mon[125702]: osdmap e764: 12 total, 12 up, 12 in 2023-03-02T16:43:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:17 smithi057 ceph-mon[92072]: pgmap v11065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:43:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:17 smithi122 ceph-mon[125440]: pgmap v11065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:43:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:17 smithi136 ceph-mon[125702]: pgmap v11065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:43:19.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:43:19.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:43:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:43:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:19.851+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:43:19.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:19.851+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:43:19.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:19.851+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:43:19.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:19.851+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:43:19.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:19.851+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:43:20.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:19 smithi057 ceph-mon[92072]: pgmap v11066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:43:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:43:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:43:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:43:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:19 smithi122 ceph-mon[125440]: pgmap v11066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:43:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:43:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:43:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:43:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:19 smithi136 ceph-mon[125702]: pgmap v11066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:43:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:43:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:43:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:43:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:21 smithi057 ceph-mon[92072]: pgmap v11067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:43:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:21 smithi122 ceph-mon[125440]: pgmap v11067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:43:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:21 smithi136 ceph-mon[125702]: pgmap v11067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-02T16:43:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:23 smithi057 ceph-mon[92072]: pgmap v11068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:43:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:23 smithi122 ceph-mon[125440]: pgmap v11068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:43:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:23 smithi136 ceph-mon[125702]: pgmap v11068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:43:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:25 smithi057 ceph-mon[92072]: pgmap v11069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:43:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:25 smithi122 ceph-mon[125440]: pgmap v11069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:43:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:25 smithi136 ceph-mon[125702]: pgmap v11069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:43:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:27 smithi057 ceph-mon[92072]: pgmap v11070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:43:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:27 smithi122 ceph-mon[125440]: pgmap v11070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:43:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:27 smithi136 ceph-mon[125702]: pgmap v11070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T16:43:30.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:29 smithi057 ceph-mon[92072]: pgmap v11071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:43:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:29 smithi122 ceph-mon[125440]: pgmap v11071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:43:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:29 smithi136 ceph-mon[125702]: pgmap v11071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:43:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:31 smithi057 ceph-mon[92072]: pgmap v11072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:31 smithi122 ceph-mon[125440]: pgmap v11072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:31 smithi136 ceph-mon[125702]: pgmap v11072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:33 smithi057 ceph-mon[92072]: pgmap v11073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:33 smithi122 ceph-mon[125440]: pgmap v11073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:33 smithi136 ceph-mon[125702]: pgmap v11073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:34.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:43:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:34.866+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:43:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:34.866+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:43:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:34.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:43:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:34.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:43:36.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:35 smithi057 ceph-mon[92072]: pgmap v11074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:35 smithi122 ceph-mon[125440]: pgmap v11074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:35 smithi136 ceph-mon[125702]: pgmap v11074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:37 smithi057 ceph-mon[92072]: pgmap v11075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:37 smithi122 ceph-mon[125440]: pgmap v11075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:37 smithi136 ceph-mon[125702]: pgmap v11075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:39 smithi057 ceph-mon[92072]: pgmap v11076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:39 smithi122 ceph-mon[125440]: pgmap v11076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:39 smithi136 ceph-mon[125702]: pgmap v11076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:41 smithi057 ceph-mon[92072]: pgmap v11077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:41 smithi122 ceph-mon[125440]: pgmap v11077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:41 smithi136 ceph-mon[125702]: pgmap v11077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:43 smithi122 ceph-mon[125440]: pgmap v11078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:43 smithi136 ceph-mon[125702]: pgmap v11078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:43 smithi057 ceph-mon[92072]: pgmap v11078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:45 smithi122 ceph-mon[125440]: pgmap v11079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:45 smithi136 ceph-mon[125702]: pgmap v11079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:45 smithi057 ceph-mon[92072]: pgmap v11079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:47 smithi122 ceph-mon[125440]: pgmap v11080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:47 smithi136 ceph-mon[125702]: pgmap v11080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:47 smithi057 ceph-mon[92072]: pgmap v11080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:49.882+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:43:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:49.882+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:43:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:49.882+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:43:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:49.882+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:43:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:43:49.882+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:43:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:49 smithi136 ceph-mon[125702]: pgmap v11081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:50.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:49 smithi057 ceph-mon[92072]: pgmap v11081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:50.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:49 smithi122 ceph-mon[125440]: pgmap v11081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:51 smithi136 ceph-mon[125702]: pgmap v11082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:51 smithi057 ceph-mon[92072]: pgmap v11082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:52.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:51 smithi122 ceph-mon[125440]: pgmap v11082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:52 smithi136 ceph-mon[125702]: pgmap v11083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:53.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:52 smithi057 ceph-mon[92072]: pgmap v11083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:52 smithi122 ceph-mon[125440]: pgmap v11083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:43:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:55 smithi057 ceph-mon[92072]: pgmap v11084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:55 smithi122 ceph-mon[125440]: pgmap v11084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:55 smithi136 ceph-mon[125702]: pgmap v11084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:57 smithi057 ceph-mon[92072]: pgmap v11085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:57 smithi122 ceph-mon[125440]: pgmap v11085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:43:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:57 smithi136 ceph-mon[125702]: pgmap v11085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:00.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:43:59 smithi057 ceph-mon[92072]: pgmap v11086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:43:59 smithi122 ceph-mon[125440]: pgmap v11086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:43:59 smithi136 ceph-mon[125702]: pgmap v11086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:01 smithi057 ceph-mon[92072]: pgmap v11087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:02.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:01 smithi122 ceph-mon[125440]: pgmap v11087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:01 smithi136 ceph-mon[125702]: pgmap v11087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:03 smithi057 ceph-mon[92072]: pgmap v11088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:44:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:03 smithi122 ceph-mon[125440]: pgmap v11088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:44:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:03 smithi136 ceph-mon[125702]: pgmap v11088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:44:04.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:04.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:44:04.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:04.889+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:44:04.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:04.889+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:44:04.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:04.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:44:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:04.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:44:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:05 smithi057 ceph-mon[92072]: pgmap v11089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:44:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:05 smithi122 ceph-mon[125440]: pgmap v11089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:44:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:05 smithi136 ceph-mon[125702]: pgmap v11089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:44:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:06 smithi057 ceph-mon[92072]: osdmap e765: 12 total, 12 up, 12 in 2023-03-02T16:44:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:06 smithi122 ceph-mon[125440]: osdmap e765: 12 total, 12 up, 12 in 2023-03-02T16:44:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:06 smithi136 ceph-mon[125702]: osdmap e765: 12 total, 12 up, 12 in 2023-03-02T16:44:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:07 smithi057 ceph-mon[92072]: pgmap v11091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:44:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:07 smithi122 ceph-mon[125440]: pgmap v11091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:44:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:07 smithi136 ceph-mon[125702]: pgmap v11091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:44:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:08.412+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T16:44:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:08.412+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T16:44:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:08.412+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5850005870 tx=0x7f587005e070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:44:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:08.412+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5850005870 tx=0x7f587005e070 comp rx=0 tx=0).stop 2023-03-02T16:44:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:08.412+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T16:44:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:08.412+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T16:44:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:08.412+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T16:44:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:08.412+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T16:44:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:08.412+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:44:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:08.412+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5870029040 tx=0x7f587008e000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T16:44:10.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:09 smithi057 ceph-mon[92072]: pgmap v11092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:44:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:09 smithi057 ceph-mon[92072]: osdmap e766: 12 total, 12 up, 12 in 2023-03-02T16:44:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:09 smithi122 ceph-mon[125440]: pgmap v11092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:44:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:09 smithi122 ceph-mon[125440]: osdmap e766: 12 total, 12 up, 12 in 2023-03-02T16:44:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:09 smithi136 ceph-mon[125702]: pgmap v11092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:44:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:09 smithi136 ceph-mon[125702]: osdmap e766: 12 total, 12 up, 12 in 2023-03-02T16:44:11.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:11.355+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:44:11.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:11.355+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:44:11.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:11.355+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 161 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006520 con 0x558558b6f6b0 2023-03-02T16:44:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:11.355+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 162 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:44:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:11 smithi122 ceph-mon[125440]: pgmap v11094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:44:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:11 smithi136 ceph-mon[125702]: pgmap v11094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:44:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:11 smithi057 ceph-mon[92072]: pgmap v11094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:44:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:13 smithi122 ceph-mon[125440]: pgmap v11095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:44:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:13 smithi136 ceph-mon[125702]: pgmap v11095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:44:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:13 smithi057 ceph-mon[92072]: pgmap v11095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:44:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:15 smithi122 ceph-mon[125440]: pgmap v11096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:44:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:15 smithi136 ceph-mon[125702]: pgmap v11096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:44:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:15 smithi057 ceph-mon[92072]: pgmap v11096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:44:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:17 smithi136 ceph-mon[125702]: pgmap v11097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:44:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:17 smithi057 ceph-mon[92072]: pgmap v11097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:44:18.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:17 smithi122 ceph-mon[125440]: pgmap v11097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:44:19.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:19.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:44:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:19.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:44:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:19.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:44:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:19.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:44:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:19.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:44:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:19 smithi136 ceph-mon[125702]: pgmap v11098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:44:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:44:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:19 smithi057 ceph-mon[92072]: pgmap v11098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:44:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:44:20.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:19 smithi122 ceph-mon[125440]: pgmap v11098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:44:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:44:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:44:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:44:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:44:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:20 smithi136 ceph-mon[125702]: pgmap v11099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:44:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:44:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:44:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:44:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:20 smithi057 ceph-mon[92072]: pgmap v11099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:44:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:44:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:44:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:44:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:20 smithi122 ceph-mon[125440]: pgmap v11099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:44:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:23 smithi057 ceph-mon[92072]: pgmap v11100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:44:23.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:23 smithi122 ceph-mon[125440]: pgmap v11100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:44:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:23 smithi136 ceph-mon[125702]: pgmap v11100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:44:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:25 smithi057 ceph-mon[92072]: pgmap v11101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:25 smithi122 ceph-mon[125440]: pgmap v11101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:25 smithi136 ceph-mon[125702]: pgmap v11101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:28.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:27 smithi057 ceph-mon[92072]: pgmap v11102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:27 smithi122 ceph-mon[125440]: pgmap v11102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:27 smithi136 ceph-mon[125702]: pgmap v11102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:29 smithi057 ceph-mon[92072]: pgmap v11103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:29 smithi122 ceph-mon[125440]: pgmap v11103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:29 smithi136 ceph-mon[125702]: pgmap v11103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:32.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:31 smithi057 ceph-mon[92072]: pgmap v11104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:31 smithi122 ceph-mon[125440]: pgmap v11104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:31 smithi136 ceph-mon[125702]: pgmap v11104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:33 smithi057 ceph-mon[92072]: pgmap v11105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:33 smithi122 ceph-mon[125440]: pgmap v11105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:33 smithi136 ceph-mon[125702]: pgmap v11105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:34.919+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:44:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:34.920+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:44:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:34.920+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:44:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:34.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:44:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:34.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:44:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:35 smithi057 ceph-mon[92072]: pgmap v11106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:35 smithi122 ceph-mon[125440]: pgmap v11106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:35 smithi136 ceph-mon[125702]: pgmap v11106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:37 smithi057 ceph-mon[92072]: pgmap v11107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:37 smithi122 ceph-mon[125440]: pgmap v11107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:37 smithi136 ceph-mon[125702]: pgmap v11107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:39 smithi057 ceph-mon[92072]: pgmap v11108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:39 smithi122 ceph-mon[125440]: pgmap v11108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:39 smithi136 ceph-mon[125702]: pgmap v11108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:41 smithi057 ceph-mon[92072]: pgmap v11109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:42.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:41 smithi122 ceph-mon[125440]: pgmap v11109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:41 smithi136 ceph-mon[125702]: pgmap v11109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:43 smithi057 ceph-mon[92072]: pgmap v11110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:43 smithi122 ceph-mon[125440]: pgmap v11110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:43 smithi136 ceph-mon[125702]: pgmap v11110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:46.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:45 smithi057 ceph-mon[92072]: pgmap v11111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:45 smithi122 ceph-mon[125440]: pgmap v11111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:45 smithi136 ceph-mon[125702]: pgmap v11111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:47 smithi122 ceph-mon[125440]: pgmap v11112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:47 smithi136 ceph-mon[125702]: pgmap v11112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:47 smithi057 ceph-mon[92072]: pgmap v11112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:49.921+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:44:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:49.922+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:44:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:49.922+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:44:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:49.922+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:44:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:44:49.922+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:44:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:49 smithi122 ceph-mon[125440]: pgmap v11113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:49 smithi136 ceph-mon[125702]: pgmap v11113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:50.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:49 smithi057 ceph-mon[92072]: pgmap v11113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:51 smithi122 ceph-mon[125440]: pgmap v11114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:51 smithi136 ceph-mon[125702]: pgmap v11114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:51 smithi057 ceph-mon[92072]: pgmap v11114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:53 smithi136 ceph-mon[125702]: pgmap v11115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:54.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:53 smithi057 ceph-mon[92072]: pgmap v11115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:54.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:53 smithi122 ceph-mon[125440]: pgmap v11115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:44:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:55 smithi136 ceph-mon[125702]: pgmap v11116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:55 smithi057 ceph-mon[92072]: pgmap v11116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:56.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:55 smithi122 ceph-mon[125440]: pgmap v11116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:57 smithi136 ceph-mon[125702]: pgmap v11117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:57 smithi057 ceph-mon[92072]: pgmap v11117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:44:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:57 smithi122 ceph-mon[125440]: pgmap v11117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:44:59 smithi136 ceph-mon[125702]: pgmap v11118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:44:59 smithi057 ceph-mon[92072]: pgmap v11118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:44:59 smithi122 ceph-mon[125440]: pgmap v11118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:01 smithi136 ceph-mon[125702]: pgmap v11119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:01 smithi057 ceph-mon[92072]: pgmap v11119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:02.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:01 smithi122 ceph-mon[125440]: pgmap v11119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:02 smithi136 ceph-mon[125702]: pgmap v11120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:45:03.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:02 smithi057 ceph-mon[92072]: pgmap v11120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:45:03.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:02 smithi122 ceph-mon[125440]: pgmap v11120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:45:04.926 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:04.926+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:45:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:04.926+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:45:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:04.926+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:45:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:04.926+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:45:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:04.926+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:45:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:05 smithi057 ceph-mon[92072]: pgmap v11121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:45:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:05 smithi122 ceph-mon[125440]: pgmap v11121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:45:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:05 smithi136 ceph-mon[125702]: pgmap v11121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:45:07.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:06 smithi057 ceph-mon[92072]: osdmap e767: 12 total, 12 up, 12 in 2023-03-02T16:45:07.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:06 smithi122 ceph-mon[125440]: osdmap e767: 12 total, 12 up, 12 in 2023-03-02T16:45:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:06 smithi136 ceph-mon[125702]: osdmap e767: 12 total, 12 up, 12 in 2023-03-02T16:45:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:07 smithi057 ceph-mon[92072]: pgmap v11123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:45:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:07 smithi122 ceph-mon[125440]: pgmap v11123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:45:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:07 smithi136 ceph-mon[125702]: pgmap v11123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:45:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:09 smithi057 ceph-mon[92072]: pgmap v11124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:45:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:09 smithi122 ceph-mon[125440]: pgmap v11124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:45:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:09 smithi136 ceph-mon[125702]: pgmap v11124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:45:12.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:11 smithi057 ceph-mon[92072]: pgmap v11125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:45:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:11 smithi122 ceph-mon[125440]: pgmap v11125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:45:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:11 smithi136 ceph-mon[125702]: pgmap v11125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:45:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:13 smithi057 ceph-mon[92072]: pgmap v11126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:45:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:13 smithi122 ceph-mon[125440]: pgmap v11126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:45:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:13 smithi136 ceph-mon[125702]: pgmap v11126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:45:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:15 smithi057 ceph-mon[92072]: pgmap v11127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:45:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:15 smithi057 ceph-mon[92072]: osdmap e768: 12 total, 12 up, 12 in 2023-03-02T16:45:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:15 smithi122 ceph-mon[125440]: pgmap v11127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:45:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:15 smithi122 ceph-mon[125440]: osdmap e768: 12 total, 12 up, 12 in 2023-03-02T16:45:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:15 smithi136 ceph-mon[125702]: pgmap v11127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:45:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:15 smithi136 ceph-mon[125702]: osdmap e768: 12 total, 12 up, 12 in 2023-03-02T16:45:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:17 smithi057 ceph-mon[92072]: pgmap v11129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:45:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:17 smithi122 ceph-mon[125440]: pgmap v11129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:45:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:17 smithi136 ceph-mon[125702]: pgmap v11129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:45:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:19.937+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:45:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:19.938+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:45:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:19.938+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:45:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:19.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:45:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:19.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:45:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:19 smithi057 ceph-mon[92072]: pgmap v11130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:45:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:19 smithi122 ceph-mon[125440]: pgmap v11130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:45:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:19 smithi136 ceph-mon[125702]: pgmap v11130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:45:21.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:45:21.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:45:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:45:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:21 smithi057 ceph-mon[92072]: pgmap v11131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:45:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:45:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:45:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:45:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:21 smithi122 ceph-mon[125440]: pgmap v11131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:45:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:45:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:45:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:45:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:21 smithi136 ceph-mon[125702]: pgmap v11131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:45:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:45:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:45:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:45:24.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:23 smithi057 ceph-mon[92072]: pgmap v11132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:45:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:23 smithi122 ceph-mon[125440]: pgmap v11132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:45:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:23 smithi136 ceph-mon[125702]: pgmap v11132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:45:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:25 smithi057 ceph-mon[92072]: pgmap v11133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:45:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:25 smithi122 ceph-mon[125440]: pgmap v11133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:45:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:25 smithi136 ceph-mon[125702]: pgmap v11133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:45:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:27 smithi057 ceph-mon[92072]: pgmap v11134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:45:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:27 smithi122 ceph-mon[125440]: pgmap v11134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:45:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:27 smithi136 ceph-mon[125702]: pgmap v11134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T16:45:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:29 smithi122 ceph-mon[125440]: pgmap v11135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:29 smithi136 ceph-mon[125702]: pgmap v11135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:30.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:29 smithi057 ceph-mon[92072]: pgmap v11135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:31 smithi122 ceph-mon[125440]: pgmap v11136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:31 smithi136 ceph-mon[125702]: pgmap v11136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:32.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:31 smithi057 ceph-mon[92072]: pgmap v11136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:33 smithi136 ceph-mon[125702]: pgmap v11137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:33 smithi057 ceph-mon[92072]: pgmap v11137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:34.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:33 smithi122 ceph-mon[125440]: pgmap v11137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:34.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:34.947+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:45:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:34.948+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:45:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:34.948+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:45:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:34.948+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:45:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:34.948+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:45:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:35 smithi136 ceph-mon[125702]: pgmap v11138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:35 smithi057 ceph-mon[92072]: pgmap v11138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:36.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:35 smithi122 ceph-mon[125440]: pgmap v11138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:37 smithi136 ceph-mon[125702]: pgmap v11139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:38.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:37 smithi057 ceph-mon[92072]: pgmap v11139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:37 smithi122 ceph-mon[125440]: pgmap v11139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:39 smithi136 ceph-mon[125702]: pgmap v11140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:40.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:39 smithi057 ceph-mon[92072]: pgmap v11140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:40.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:39 smithi122 ceph-mon[125440]: pgmap v11140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:41.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:41.369+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:45:41.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:41.369+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:45:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:41.369+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 163 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:45:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:41.369+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 162 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:45:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:41 smithi136 ceph-mon[125702]: pgmap v11141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:41 smithi057 ceph-mon[92072]: pgmap v11141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:42.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:41 smithi122 ceph-mon[125440]: pgmap v11141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:43 smithi136 ceph-mon[125702]: pgmap v11142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:44.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:43 smithi057 ceph-mon[92072]: pgmap v11142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:44.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:43 smithi122 ceph-mon[125440]: pgmap v11142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:45 smithi057 ceph-mon[92072]: pgmap v11143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:45 smithi122 ceph-mon[125440]: pgmap v11143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:45 smithi136 ceph-mon[125702]: pgmap v11143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:47 smithi057 ceph-mon[92072]: pgmap v11144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:47 smithi122 ceph-mon[125440]: pgmap v11144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:47 smithi136 ceph-mon[125702]: pgmap v11144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:49.960+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:45:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:49.961+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:45:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:49.961+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:45:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:49.961+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:45:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:45:49.961+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:45:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:49 smithi057 ceph-mon[92072]: pgmap v11145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:49 smithi122 ceph-mon[125440]: pgmap v11145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:49 smithi136 ceph-mon[125702]: pgmap v11145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:51 smithi122 ceph-mon[125440]: pgmap v11146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:51 smithi136 ceph-mon[125702]: pgmap v11146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:52.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:51 smithi057 ceph-mon[92072]: pgmap v11146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:53 smithi122 ceph-mon[125440]: pgmap v11147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:53 smithi136 ceph-mon[125702]: pgmap v11147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:54.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:53 smithi057 ceph-mon[92072]: pgmap v11147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:45:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:55 smithi122 ceph-mon[125440]: pgmap v11148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:55 smithi136 ceph-mon[125702]: pgmap v11148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:55 smithi057 ceph-mon[92072]: pgmap v11148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:57 smithi122 ceph-mon[125440]: pgmap v11149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:57 smithi136 ceph-mon[125702]: pgmap v11149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:45:58.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:57 smithi057 ceph-mon[92072]: pgmap v11149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:45:59 smithi136 ceph-mon[125702]: pgmap v11150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:00.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:45:59 smithi057 ceph-mon[92072]: pgmap v11150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:45:59 smithi122 ceph-mon[125440]: pgmap v11150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:01 smithi136 ceph-mon[125702]: pgmap v11151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:01 smithi057 ceph-mon[92072]: pgmap v11151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:02.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:01 smithi122 ceph-mon[125440]: pgmap v11151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:03 smithi136 ceph-mon[125702]: pgmap v11152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:46:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:03 smithi057 ceph-mon[92072]: pgmap v11152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:46:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:03 smithi122 ceph-mon[125440]: pgmap v11152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:46:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:04.964+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:46:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:04.964+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:46:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:04.965+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:46:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:04.965+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:46:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:04.965+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:46:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:05 smithi136 ceph-mon[125702]: pgmap v11153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:46:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:05 smithi057 ceph-mon[92072]: pgmap v11153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:46:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:05 smithi122 ceph-mon[125440]: pgmap v11153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:46:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:06 smithi136 ceph-mon[125702]: osdmap e769: 12 total, 12 up, 12 in 2023-03-02T16:46:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:06 smithi057 ceph-mon[92072]: osdmap e769: 12 total, 12 up, 12 in 2023-03-02T16:46:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:06 smithi122 ceph-mon[125440]: osdmap e769: 12 total, 12 up, 12 in 2023-03-02T16:46:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:07 smithi136 ceph-mon[125702]: pgmap v11155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 29 op/s 2023-03-02T16:46:08.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:07 smithi057 ceph-mon[92072]: pgmap v11155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 29 op/s 2023-03-02T16:46:08.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:07 smithi122 ceph-mon[125440]: pgmap v11155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 29 op/s 2023-03-02T16:46:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:09 smithi136 ceph-mon[125702]: pgmap v11156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:46:09.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:09 smithi057 ceph-mon[92072]: pgmap v11156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:46:09.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:09 smithi122 ceph-mon[125440]: pgmap v11156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:46:12.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:11 smithi057 ceph-mon[92072]: pgmap v11157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:46:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:11 smithi122 ceph-mon[125440]: pgmap v11157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:46:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:11 smithi136 ceph-mon[125702]: pgmap v11157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:46:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:13 smithi122 ceph-mon[125440]: pgmap v11158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:46:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:13 smithi136 ceph-mon[125702]: pgmap v11158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:46:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:13 smithi057 ceph-mon[92072]: pgmap v11158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:46:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:15 smithi057 ceph-mon[92072]: pgmap v11159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:46:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:15 smithi057 ceph-mon[92072]: osdmap e770: 12 total, 12 up, 12 in 2023-03-02T16:46:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:15 smithi122 ceph-mon[125440]: pgmap v11159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:46:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:15 smithi122 ceph-mon[125440]: osdmap e770: 12 total, 12 up, 12 in 2023-03-02T16:46:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:15 smithi136 ceph-mon[125702]: pgmap v11159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:46:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:15 smithi136 ceph-mon[125702]: osdmap e770: 12 total, 12 up, 12 in 2023-03-02T16:46:18.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:17 smithi057 ceph-mon[92072]: pgmap v11161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:46:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:17 smithi122 ceph-mon[125440]: pgmap v11161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:46:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:17 smithi136 ceph-mon[125702]: pgmap v11161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:46:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:19.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:46:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:19.979+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:46:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:19.979+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:46:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:19.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:46:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:19.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:46:20.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:19 smithi057 ceph-mon[92072]: pgmap v11162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:46:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:19 smithi122 ceph-mon[125440]: pgmap v11162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:46:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:19 smithi136 ceph-mon[125702]: pgmap v11162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:46:22.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:21 smithi122 ceph-mon[125440]: pgmap v11163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:46:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:46:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:46:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:46:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:46:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:21 smithi136 ceph-mon[125702]: pgmap v11163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:46:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:46:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:46:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:46:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:46:22.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:21 smithi057 ceph-mon[92072]: pgmap v11163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:46:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:46:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:46:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:46:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:46:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:23 smithi122 ceph-mon[125440]: pgmap v11164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:46:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:23 smithi136 ceph-mon[125702]: pgmap v11164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:46:24.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:23 smithi057 ceph-mon[92072]: pgmap v11164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:46:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:25 smithi122 ceph-mon[125440]: pgmap v11165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:46:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:25 smithi136 ceph-mon[125702]: pgmap v11165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:46:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:25 smithi057 ceph-mon[92072]: pgmap v11165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:46:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:27 smithi122 ceph-mon[125440]: pgmap v11166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T16:46:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:27 smithi136 ceph-mon[125702]: pgmap v11166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T16:46:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:27 smithi057 ceph-mon[92072]: pgmap v11166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T16:46:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:29 smithi136 ceph-mon[125702]: pgmap v11167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-02T16:46:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:29 smithi057 ceph-mon[92072]: pgmap v11167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-02T16:46:30.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:29 smithi122 ceph-mon[125440]: pgmap v11167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-02T16:46:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:31 smithi136 ceph-mon[125702]: pgmap v11168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:32.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:31 smithi057 ceph-mon[92072]: pgmap v11168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:32.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:31 smithi122 ceph-mon[125440]: pgmap v11168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:33 smithi136 ceph-mon[125702]: pgmap v11169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:33 smithi057 ceph-mon[92072]: pgmap v11169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:34.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:33 smithi122 ceph-mon[125440]: pgmap v11169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:34.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:34.991+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:46:34.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:34.992+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:46:34.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:34.992+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:46:34.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:34.992+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:46:34.993 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:34.992+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:46:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:35 smithi136 ceph-mon[125702]: pgmap v11170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:35 smithi057 ceph-mon[92072]: pgmap v11170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:36.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:35 smithi122 ceph-mon[125440]: pgmap v11170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:37 smithi136 ceph-mon[125702]: pgmap v11171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:46:38.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:37 smithi057 ceph-mon[92072]: pgmap v11171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:46:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:37 smithi122 ceph-mon[125440]: pgmap v11171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:46:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:39 smithi136 ceph-mon[125702]: pgmap v11172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-02T16:46:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:39 smithi057 ceph-mon[92072]: pgmap v11172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-02T16:46:40.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:39 smithi122 ceph-mon[125440]: pgmap v11172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-02T16:46:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:41 smithi136 ceph-mon[125702]: pgmap v11173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:41 smithi057 ceph-mon[92072]: pgmap v11173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:42.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:41 smithi122 ceph-mon[125440]: pgmap v11173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:43 smithi136 ceph-mon[125702]: pgmap v11174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:43 smithi057 ceph-mon[92072]: pgmap v11174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:44.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:43 smithi122 ceph-mon[125440]: pgmap v11174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:45 smithi057 ceph-mon[92072]: pgmap v11175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:45 smithi122 ceph-mon[125440]: pgmap v11175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:45 smithi136 ceph-mon[125702]: pgmap v11175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:47 smithi057 ceph-mon[92072]: pgmap v11176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:46:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:47 smithi122 ceph-mon[125440]: pgmap v11176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:46:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:47 smithi136 ceph-mon[125702]: pgmap v11176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:46:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:50.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:46:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:50.001+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:46:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:50.001+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:46:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:50.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:46:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:46:50.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:46:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:49 smithi122 ceph-mon[125440]: pgmap v11177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:46:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:49 smithi136 ceph-mon[125702]: pgmap v11177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:46:50.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:49 smithi057 ceph-mon[92072]: pgmap v11177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:46:52.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:51 smithi122 ceph-mon[125440]: pgmap v11178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:51 smithi136 ceph-mon[125702]: pgmap v11178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:52.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:51 smithi057 ceph-mon[92072]: pgmap v11178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:53 smithi122 ceph-mon[125440]: pgmap v11179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:53 smithi136 ceph-mon[125702]: pgmap v11179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:54.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:53 smithi057 ceph-mon[92072]: pgmap v11179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:46:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:55 smithi136 ceph-mon[125702]: pgmap v11180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:56.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:55 smithi057 ceph-mon[92072]: pgmap v11180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:56.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:55 smithi122 ceph-mon[125440]: pgmap v11180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:46:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:57 smithi136 ceph-mon[125702]: pgmap v11181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:46:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:57 smithi057 ceph-mon[92072]: pgmap v11181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:46:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:57 smithi122 ceph-mon[125440]: pgmap v11181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:46:59 smithi136 ceph-mon[125702]: pgmap v11182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:46:59 smithi057 ceph-mon[92072]: pgmap v11182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:46:59 smithi122 ceph-mon[125440]: pgmap v11182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:01 smithi136 ceph-mon[125702]: pgmap v11183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:02.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:01 smithi057 ceph-mon[92072]: pgmap v11183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:02.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:01 smithi122 ceph-mon[125440]: pgmap v11183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:03 smithi136 ceph-mon[125702]: pgmap v11184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:47:04.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:03 smithi057 ceph-mon[92072]: pgmap v11184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:47:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:03 smithi122 ceph-mon[125440]: pgmap v11184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:47:05.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:05.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:47:05.010 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:05.010+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:47:05.010 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:05.010+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:47:05.010 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:05.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:47:05.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:05.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:47:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:05 smithi136 ceph-mon[125702]: pgmap v11185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:47:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:05 smithi057 ceph-mon[92072]: pgmap v11185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:47:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:05 smithi122 ceph-mon[125440]: pgmap v11185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:47:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:06 smithi136 ceph-mon[125702]: osdmap e771: 12 total, 12 up, 12 in 2023-03-02T16:47:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:06 smithi057 ceph-mon[92072]: osdmap e771: 12 total, 12 up, 12 in 2023-03-02T16:47:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:06 smithi122 ceph-mon[125440]: osdmap e771: 12 total, 12 up, 12 in 2023-03-02T16:47:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:07 smithi136 ceph-mon[125702]: pgmap v11187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:47:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:07 smithi057 ceph-mon[92072]: pgmap v11187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:47:08.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:07 smithi122 ceph-mon[125440]: pgmap v11187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:47:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:09 smithi136 ceph-mon[125702]: pgmap v11188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:47:09.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:09 smithi057 ceph-mon[92072]: pgmap v11188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:47:09.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:09 smithi122 ceph-mon[125440]: pgmap v11188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:47:11.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:10 smithi122 ceph-mon[125440]: osdmap e772: 12 total, 12 up, 12 in 2023-03-02T16:47:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:10 smithi136 ceph-mon[125702]: osdmap e772: 12 total, 12 up, 12 in 2023-03-02T16:47:11.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:11.381+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:47:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:11.381+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:47:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:11.381+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 163 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:47:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:11.382+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 164 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:47:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:10 smithi057 ceph-mon[92072]: osdmap e772: 12 total, 12 up, 12 in 2023-03-02T16:47:12.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:11 smithi122 ceph-mon[125440]: pgmap v11190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:47:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:11 smithi136 ceph-mon[125702]: pgmap v11190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:47:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:11 smithi057 ceph-mon[92072]: pgmap v11190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:47:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:13 smithi136 ceph-mon[125702]: pgmap v11191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:47:14.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:13 smithi057 ceph-mon[92072]: pgmap v11191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:47:14.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:13 smithi122 ceph-mon[125440]: pgmap v11191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:47:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:15 smithi136 ceph-mon[125702]: pgmap v11192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:47:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:15 smithi057 ceph-mon[92072]: pgmap v11192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:47:16.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:15 smithi122 ceph-mon[125440]: pgmap v11192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:47:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:17 smithi136 ceph-mon[125702]: pgmap v11193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:47:18.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:17 smithi057 ceph-mon[92072]: pgmap v11193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:47:18.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:17 smithi122 ceph-mon[125440]: pgmap v11193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:47:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:20.012+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:47:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:20.012+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:47:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:20.012+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:47:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:20.012+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:47:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:20.012+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:47:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:19 smithi136 ceph-mon[125702]: pgmap v11194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:47:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:19 smithi057 ceph-mon[92072]: pgmap v11194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:47:20.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:19 smithi122 ceph-mon[125440]: pgmap v11194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:47:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:21 smithi136 ceph-mon[125702]: pgmap v11195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:47:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:47:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:21 smithi057 ceph-mon[92072]: pgmap v11195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:47:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:47:22.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:21 smithi122 ceph-mon[125440]: pgmap v11195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:47:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:47:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:23 smithi136 ceph-mon[125702]: pgmap v11196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:47:24.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:23 smithi057 ceph-mon[92072]: pgmap v11196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:47:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:23 smithi122 ceph-mon[125440]: pgmap v11196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:47:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: pgmap v11197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:47:26.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:47:26.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: pgmap v11197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:47:26.439 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:47:26.439 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: pgmap v11197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.459 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:47:26.459 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:47:26.459 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:47:26.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:47:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:26 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:47:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:26 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:47:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:26 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:47:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:26 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:47:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:26 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 68197k 2023-03-02T16:47:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:26 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 69834051: error parsing value: Value '69834051' is below minimum 939524096 2023-03-02T16:47:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:26 smithi136 ceph-mon[125702]: pgmap v11198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:26 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:47:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:26 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:47:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:26 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:47:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:26 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:47:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:26 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 68197k 2023-03-02T16:47:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:26 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 69834051: error parsing value: Value '69834051' is below minimum 939524096 2023-03-02T16:47:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:26 smithi057 ceph-mon[92072]: pgmap v11198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:26 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:47:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:26 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:47:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:26 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:47:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:26 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:47:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:26 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 68197k 2023-03-02T16:47:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:26 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 69834051: error parsing value: Value '69834051' is below minimum 939524096 2023-03-02T16:47:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:26 smithi122 ceph-mon[125440]: pgmap v11198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:29 smithi136 ceph-mon[125702]: pgmap v11199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:30.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:29 smithi057 ceph-mon[92072]: pgmap v11199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:29 smithi122 ceph-mon[125440]: pgmap v11199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:32.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:31 smithi122 ceph-mon[125440]: pgmap v11200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:31 smithi136 ceph-mon[125702]: pgmap v11200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:31 smithi057 ceph-mon[92072]: pgmap v11200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:33 smithi136 ceph-mon[125702]: pgmap v11201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:47:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:33 smithi057 ceph-mon[92072]: pgmap v11201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:47:34.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:33 smithi122 ceph-mon[125440]: pgmap v11201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:47:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:35.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:47:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:35.019+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:47:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:35.019+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:47:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:35.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:47:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:35.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:47:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:35 smithi136 ceph-mon[125702]: pgmap v11202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:36.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:35 smithi057 ceph-mon[92072]: pgmap v11202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:36.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:35 smithi122 ceph-mon[125440]: pgmap v11202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:37 smithi136 ceph-mon[125702]: pgmap v11203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:37 smithi057 ceph-mon[92072]: pgmap v11203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:37 smithi122 ceph-mon[125440]: pgmap v11203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:39 smithi136 ceph-mon[125702]: pgmap v11204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:40.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:39 smithi057 ceph-mon[92072]: pgmap v11204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:40.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:39 smithi122 ceph-mon[125440]: pgmap v11204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:41 smithi136 ceph-mon[125702]: pgmap v11205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:42.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:41 smithi057 ceph-mon[92072]: pgmap v11205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:42.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:41 smithi122 ceph-mon[125440]: pgmap v11205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:43 smithi136 ceph-mon[125702]: pgmap v11206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:47:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:43 smithi057 ceph-mon[92072]: pgmap v11206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:47:44.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:43 smithi122 ceph-mon[125440]: pgmap v11206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:47:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:45 smithi136 ceph-mon[125702]: pgmap v11207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:45 smithi057 ceph-mon[92072]: pgmap v11207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:46.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:45 smithi122 ceph-mon[125440]: pgmap v11207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:47 smithi136 ceph-mon[125702]: pgmap v11208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:48.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:47 smithi057 ceph-mon[92072]: pgmap v11208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:48.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:47 smithi122 ceph-mon[125440]: pgmap v11208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:50.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:50.031+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:47:50.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:50.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:47:50.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:50.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:47:50.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:50.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:47:50.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:47:50.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:47:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:49 smithi136 ceph-mon[125702]: pgmap v11209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:49 smithi057 ceph-mon[92072]: pgmap v11209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:50.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:49 smithi122 ceph-mon[125440]: pgmap v11209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:47:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:52 smithi136 ceph-mon[125702]: pgmap v11210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:52 smithi057 ceph-mon[92072]: pgmap v11210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:52.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:52 smithi122 ceph-mon[125440]: pgmap v11210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:53 smithi136 ceph-mon[125702]: pgmap v11211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:47:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:53 smithi057 ceph-mon[92072]: pgmap v11211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:47:53.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:53 smithi122 ceph-mon[125440]: pgmap v11211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:47:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:55 smithi136 ceph-mon[125702]: pgmap v11212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:55 smithi057 ceph-mon[92072]: pgmap v11212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:56.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:55 smithi122 ceph-mon[125440]: pgmap v11212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:47:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:57 smithi136 ceph-mon[125702]: pgmap v11213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:58.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:57 smithi057 ceph-mon[92072]: pgmap v11213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:47:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:57 smithi122 ceph-mon[125440]: pgmap v11213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:47:59 smithi136 ceph-mon[125702]: pgmap v11214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:00.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:47:59 smithi057 ceph-mon[92072]: pgmap v11214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:47:59 smithi122 ceph-mon[125440]: pgmap v11214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:01 smithi136 ceph-mon[125702]: pgmap v11215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:01 smithi057 ceph-mon[92072]: pgmap v11215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:02.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:01 smithi122 ceph-mon[125440]: pgmap v11215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:03 smithi136 ceph-mon[125702]: pgmap v11216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:48:04.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:03 smithi057 ceph-mon[92072]: pgmap v11216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:48:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:03 smithi122 ceph-mon[125440]: pgmap v11216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:48:05.039 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:05.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:48:05.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:05.040+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:48:05.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:05.040+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:48:05.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:05.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:48:05.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:05.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:48:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:05 smithi136 ceph-mon[125702]: pgmap v11217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:48:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:05 smithi057 ceph-mon[92072]: pgmap v11217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:48:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:05 smithi122 ceph-mon[125440]: pgmap v11217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:48:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:06 smithi136 ceph-mon[125702]: osdmap e773: 12 total, 12 up, 12 in 2023-03-02T16:48:07.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:06 smithi057 ceph-mon[92072]: osdmap e773: 12 total, 12 up, 12 in 2023-03-02T16:48:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:06 smithi122 ceph-mon[125440]: osdmap e773: 12 total, 12 up, 12 in 2023-03-02T16:48:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:07 smithi136 ceph-mon[125702]: pgmap v11219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:48:08.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:07 smithi057 ceph-mon[92072]: pgmap v11219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:48:08.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:07 smithi122 ceph-mon[125440]: pgmap v11219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:48:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:09 smithi136 ceph-mon[125702]: pgmap v11220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:48:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:09 smithi136 ceph-mon[125702]: osdmap e774: 12 total, 12 up, 12 in 2023-03-02T16:48:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:09 smithi057 ceph-mon[92072]: pgmap v11220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:48:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:09 smithi057 ceph-mon[92072]: osdmap e774: 12 total, 12 up, 12 in 2023-03-02T16:48:10.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:09 smithi122 ceph-mon[125440]: pgmap v11220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:48:10.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:09 smithi122 ceph-mon[125440]: osdmap e774: 12 total, 12 up, 12 in 2023-03-02T16:48:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:11 smithi136 ceph-mon[125702]: pgmap v11222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:48:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:11 smithi057 ceph-mon[92072]: pgmap v11222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:48:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:11 smithi122 ceph-mon[125440]: pgmap v11222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:48:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:13 smithi136 ceph-mon[125702]: pgmap v11223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:48:14.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:13 smithi057 ceph-mon[92072]: pgmap v11223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:48:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:13 smithi122 ceph-mon[125440]: pgmap v11223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:48:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:15 smithi136 ceph-mon[125702]: pgmap v11224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:48:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:15 smithi057 ceph-mon[92072]: pgmap v11224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:48:16.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:15 smithi122 ceph-mon[125440]: pgmap v11224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:48:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:17 smithi136 ceph-mon[125702]: pgmap v11225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:48:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:17 smithi057 ceph-mon[92072]: pgmap v11225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:48:18.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:17 smithi122 ceph-mon[125440]: pgmap v11225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:48:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:20.044+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:48:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:20.045+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:48:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:20.045+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:48:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:20.045+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:48:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:20.045+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:48:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:19 smithi136 ceph-mon[125702]: pgmap v11226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:48:20.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:19 smithi057 ceph-mon[92072]: pgmap v11226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:48:20.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:19 smithi122 ceph-mon[125440]: pgmap v11226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:48:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:21 smithi136 ceph-mon[125702]: pgmap v11227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:48:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:21 smithi057 ceph-mon[92072]: pgmap v11227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:48:22.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:21 smithi122 ceph-mon[125440]: pgmap v11227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:48:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:23 smithi136 ceph-mon[125702]: pgmap v11228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:48:24.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:23 smithi057 ceph-mon[92072]: pgmap v11228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:48:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:23 smithi122 ceph-mon[125440]: pgmap v11228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:48:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:25 smithi136 ceph-mon[125702]: pgmap v11229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:48:26.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:25 smithi057 ceph-mon[92072]: pgmap v11229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:48:26.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:25 smithi122 ceph-mon[125440]: pgmap v11229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:48:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:48:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:48:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:48:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:48:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:48:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:48:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:48:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:48:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:48:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:28 smithi136 ceph-mon[125702]: pgmap v11230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:28.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:28 smithi057 ceph-mon[92072]: pgmap v11230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:28.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:28 smithi122 ceph-mon[125440]: pgmap v11230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:29 smithi136 ceph-mon[125702]: pgmap v11231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:29 smithi057 ceph-mon[92072]: pgmap v11231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:29 smithi122 ceph-mon[125440]: pgmap v11231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:31 smithi136 ceph-mon[125702]: pgmap v11232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:31 smithi057 ceph-mon[92072]: pgmap v11232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:32.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:31 smithi122 ceph-mon[125440]: pgmap v11232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:33 smithi136 ceph-mon[125702]: pgmap v11233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:48:34.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:33 smithi057 ceph-mon[92072]: pgmap v11233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:48:34.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:33 smithi122 ceph-mon[125440]: pgmap v11233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:48:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:35.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:48:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:35.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:48:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:35.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:48:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:35.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:48:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:35.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:48:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:35 smithi136 ceph-mon[125702]: pgmap v11234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:35 smithi057 ceph-mon[92072]: pgmap v11234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:36.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:35 smithi122 ceph-mon[125440]: pgmap v11234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:37 smithi136 ceph-mon[125702]: pgmap v11235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:37 smithi057 ceph-mon[92072]: pgmap v11235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:37 smithi122 ceph-mon[125440]: pgmap v11235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:39 smithi136 ceph-mon[125702]: pgmap v11236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:40.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:39 smithi057 ceph-mon[92072]: pgmap v11236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:40.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:39 smithi122 ceph-mon[125440]: pgmap v11236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:41 smithi136 ceph-mon[125702]: pgmap v11237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:41 smithi057 ceph-mon[92072]: pgmap v11237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:42.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:41 smithi122 ceph-mon[125440]: pgmap v11237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:43 smithi136 ceph-mon[125702]: pgmap v11238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:48:44.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:43 smithi057 ceph-mon[92072]: pgmap v11238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:48:44.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:43 smithi122 ceph-mon[125440]: pgmap v11238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:48:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:45 smithi136 ceph-mon[125702]: pgmap v11239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:46.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:45 smithi057 ceph-mon[92072]: pgmap v11239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:46.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:45 smithi122 ceph-mon[125440]: pgmap v11239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:47 smithi136 ceph-mon[125702]: pgmap v11240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:47 smithi057 ceph-mon[92072]: pgmap v11240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:47 smithi122 ceph-mon[125440]: pgmap v11240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:50.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:50.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:48:50.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:50.071+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:48:50.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:50.071+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:48:50.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:50.071+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:48:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:48:50.071+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:48:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:49 smithi136 ceph-mon[125702]: pgmap v11241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:49 smithi057 ceph-mon[92072]: pgmap v11241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:49 smithi122 ceph-mon[125440]: pgmap v11241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:48:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:51 smithi136 ceph-mon[125702]: pgmap v11242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:52.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:51 smithi057 ceph-mon[92072]: pgmap v11242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:52.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:51 smithi122 ceph-mon[125440]: pgmap v11242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:53 smithi136 ceph-mon[125702]: pgmap v11243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:48:54.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:53 smithi057 ceph-mon[92072]: pgmap v11243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:48:54.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:53 smithi122 ceph-mon[125440]: pgmap v11243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:48:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:55 smithi136 ceph-mon[125702]: pgmap v11244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:55 smithi057 ceph-mon[92072]: pgmap v11244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:56.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:55 smithi122 ceph-mon[125440]: pgmap v11244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:48:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:57 smithi136 ceph-mon[125702]: pgmap v11245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:57 smithi057 ceph-mon[92072]: pgmap v11245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:48:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:57 smithi122 ceph-mon[125440]: pgmap v11245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:48:59 smithi136 ceph-mon[125702]: pgmap v11246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:48:59 smithi057 ceph-mon[92072]: pgmap v11246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:48:59 smithi122 ceph-mon[125440]: pgmap v11246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:01 smithi136 ceph-mon[125702]: pgmap v11247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:01 smithi057 ceph-mon[92072]: pgmap v11247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:02.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:01 smithi122 ceph-mon[125440]: pgmap v11247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:04 smithi136 ceph-mon[125702]: pgmap v11248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:49:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:04 smithi057 ceph-mon[92072]: pgmap v11248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:49:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:04 smithi122 ceph-mon[125440]: pgmap v11248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:49:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:05.085+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:49:05.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:05.086+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:49:05.087 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:05.086+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:49:05.087 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:05.086+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:49:05.087 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:05.086+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:49:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:06 smithi136 ceph-mon[125702]: pgmap v11249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:49:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:06 smithi057 ceph-mon[92072]: pgmap v11249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:49:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:06 smithi122 ceph-mon[125440]: pgmap v11249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:49:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:07 smithi136 ceph-mon[125702]: osdmap e775: 12 total, 12 up, 12 in 2023-03-02T16:49:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:07 smithi136 ceph-mon[125702]: pgmap v11251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:49:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:07 smithi057 ceph-mon[92072]: osdmap e775: 12 total, 12 up, 12 in 2023-03-02T16:49:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:07 smithi057 ceph-mon[92072]: pgmap v11251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:49:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:07 smithi122 ceph-mon[125440]: osdmap e775: 12 total, 12 up, 12 in 2023-03-02T16:49:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:07 smithi122 ceph-mon[125440]: pgmap v11251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:49:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:09 smithi136 ceph-mon[125702]: pgmap v11252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:49:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:09 smithi057 ceph-mon[92072]: pgmap v11252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:49:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:09 smithi122 ceph-mon[125440]: pgmap v11252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:49:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:10 smithi136 ceph-mon[125702]: osdmap e776: 12 total, 12 up, 12 in 2023-03-02T16:49:11.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:10 smithi057 ceph-mon[92072]: osdmap e776: 12 total, 12 up, 12 in 2023-03-02T16:49:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:10 smithi122 ceph-mon[125440]: osdmap e776: 12 total, 12 up, 12 in 2023-03-02T16:49:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:11 smithi136 ceph-mon[125702]: pgmap v11254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:49:12.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:11 smithi057 ceph-mon[92072]: pgmap v11254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:49:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:11 smithi122 ceph-mon[125440]: pgmap v11254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:49:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:13 smithi136 ceph-mon[125702]: pgmap v11255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:49:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:13 smithi057 ceph-mon[92072]: pgmap v11255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:49:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:13 smithi122 ceph-mon[125440]: pgmap v11255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:49:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:15 smithi136 ceph-mon[125702]: pgmap v11256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:49:16.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:15 smithi057 ceph-mon[92072]: pgmap v11256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:49:16.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:15 smithi122 ceph-mon[125440]: pgmap v11256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 235 B/s wr, 11 op/s 2023-03-02T16:49:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:18 smithi136 ceph-mon[125702]: pgmap v11257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:49:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:18 smithi057 ceph-mon[92072]: pgmap v11257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:49:18.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:18 smithi122 ceph-mon[125440]: pgmap v11257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:49:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:20.101+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:49:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:20.101+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:49:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:20.101+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:49:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:20.101+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:49:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:20.101+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:49:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:20 smithi136 ceph-mon[125702]: pgmap v11258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:49:20.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:20 smithi057 ceph-mon[92072]: pgmap v11258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:49:20.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:20 smithi122 ceph-mon[125440]: pgmap v11258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:49:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:21 smithi136 ceph-mon[125702]: pgmap v11259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:49:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:21 smithi057 ceph-mon[92072]: pgmap v11259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:49:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:21 smithi122 ceph-mon[125440]: pgmap v11259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:49:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:23 smithi136 ceph-mon[125702]: pgmap v11260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:49:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:23 smithi057 ceph-mon[92072]: pgmap v11260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:49:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:23 smithi122 ceph-mon[125440]: pgmap v11260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:49:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:25 smithi136 ceph-mon[125702]: pgmap v11261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:25 smithi057 ceph-mon[92072]: pgmap v11261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:25 smithi122 ceph-mon[125440]: pgmap v11261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:49:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:49:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:49:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:27 smithi136 ceph-mon[125702]: pgmap v11262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:49:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:49:28.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:27 smithi057 ceph-mon[92072]: pgmap v11262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:49:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:49:28.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:27 smithi122 ceph-mon[125440]: pgmap v11262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:49:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:49:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:49:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:49:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:49:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:49:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:49:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:49:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:49:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:49:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:49:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:29 smithi136 ceph-mon[125702]: pgmap v11263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:30.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:29 smithi057 ceph-mon[92072]: pgmap v11263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:29 smithi122 ceph-mon[125440]: pgmap v11263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:32 smithi136 ceph-mon[125702]: pgmap v11264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:32.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:32 smithi057 ceph-mon[92072]: pgmap v11264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:32.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:32 smithi122 ceph-mon[125440]: pgmap v11264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:34 smithi136 ceph-mon[125702]: pgmap v11265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:49:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:34 smithi057 ceph-mon[92072]: pgmap v11265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:49:34.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:34 smithi122 ceph-mon[125440]: pgmap v11265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:49:35.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:35.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:49:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:35.107+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:49:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:35.107+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:49:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:35.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:49:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:35.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:49:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:35 smithi136 ceph-mon[125702]: pgmap v11266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:35 smithi057 ceph-mon[92072]: pgmap v11266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:36.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:35 smithi122 ceph-mon[125440]: pgmap v11266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:37 smithi136 ceph-mon[125702]: pgmap v11267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:37 smithi057 ceph-mon[92072]: pgmap v11267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:37 smithi122 ceph-mon[125440]: pgmap v11267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:39 smithi136 ceph-mon[125702]: pgmap v11268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:40.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:39 smithi057 ceph-mon[92072]: pgmap v11268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:40.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:39 smithi122 ceph-mon[125440]: pgmap v11268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:41 smithi136 ceph-mon[125702]: pgmap v11269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:41 smithi057 ceph-mon[92072]: pgmap v11269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:42.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:41 smithi122 ceph-mon[125440]: pgmap v11269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:43 smithi136 ceph-mon[125702]: pgmap v11270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:49:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:43 smithi057 ceph-mon[92072]: pgmap v11270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:49:44.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:43 smithi122 ceph-mon[125440]: pgmap v11270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:49:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:46 smithi136 ceph-mon[125702]: pgmap v11271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:46 smithi057 ceph-mon[92072]: pgmap v11271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:46.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:46 smithi122 ceph-mon[125440]: pgmap v11271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:48 smithi136 ceph-mon[125702]: pgmap v11272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:48.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:48 smithi057 ceph-mon[92072]: pgmap v11272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:48.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:48 smithi122 ceph-mon[125440]: pgmap v11272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:50.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:49:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:50.121+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:49:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:50.121+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:49:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:50.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:49:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:49:50.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:49:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:50 smithi136 ceph-mon[125702]: pgmap v11273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:50 smithi057 ceph-mon[92072]: pgmap v11273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:50.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:50 smithi122 ceph-mon[125440]: pgmap v11273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:49:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:51 smithi136 ceph-mon[125702]: pgmap v11274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:51.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:51 smithi057 ceph-mon[92072]: pgmap v11274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:51 smithi122 ceph-mon[125440]: pgmap v11274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:53 smithi136 ceph-mon[125702]: pgmap v11275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:49:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:53 smithi057 ceph-mon[92072]: pgmap v11275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:49:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:53 smithi122 ceph-mon[125440]: pgmap v11275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:49:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:55 smithi136 ceph-mon[125702]: pgmap v11276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:55 smithi057 ceph-mon[92072]: pgmap v11276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:56.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:55 smithi122 ceph-mon[125440]: pgmap v11276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:49:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:49:57 smithi136 ceph-mon[125702]: pgmap v11277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:58.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:49:57 smithi057 ceph-mon[92072]: pgmap v11277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:49:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:49:57 smithi122 ceph-mon[125440]: pgmap v11277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:50:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:00 smithi136 ceph-mon[125702]: pgmap v11278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:50:00.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:00 smithi057 ceph-mon[92072]: pgmap v11278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:50:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:00 smithi122 ceph-mon[125440]: pgmap v11278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:50:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:01 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T16:50:01.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:01 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T16:50:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:01 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T16:50:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:02 smithi136 ceph-mon[125702]: pgmap v11279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:02 smithi057 ceph-mon[92072]: pgmap v11279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:02.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:02 smithi122 ceph-mon[125440]: pgmap v11279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:04 smithi136 ceph-mon[125702]: pgmap v11280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:50:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:04 smithi057 ceph-mon[92072]: pgmap v11280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:50:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:04 smithi122 ceph-mon[125440]: pgmap v11280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:50:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:05.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:50:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:05.136+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:50:05.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:05.136+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:50:05.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:05.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:50:05.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:05.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:50:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:05 smithi136 ceph-mon[125702]: pgmap v11281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:50:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:05 smithi057 ceph-mon[92072]: pgmap v11281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:50:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:05 smithi122 ceph-mon[125440]: pgmap v11281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:50:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:07 smithi136 ceph-mon[125702]: pgmap v11282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:50:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:07 smithi057 ceph-mon[92072]: pgmap v11282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:50:08.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:07 smithi122 ceph-mon[125440]: pgmap v11282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:50:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:10 smithi136 ceph-mon[125702]: pgmap v11283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:50:10.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:10 smithi057 ceph-mon[92072]: pgmap v11283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:50:10.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:10 smithi122 ceph-mon[125440]: pgmap v11283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:50:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:11.408+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:50:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:11.408+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:50:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:11.409+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 164 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:50:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:11.409+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 165 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:50:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:12 smithi136 ceph-mon[125702]: pgmap v11284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:50:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:12 smithi136 ceph-mon[125702]: osdmap e777: 12 total, 12 up, 12 in 2023-03-02T16:50:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:12 smithi057 ceph-mon[92072]: pgmap v11284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:50:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:12 smithi057 ceph-mon[92072]: osdmap e777: 12 total, 12 up, 12 in 2023-03-02T16:50:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:12 smithi122 ceph-mon[125440]: pgmap v11284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:50:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:12 smithi122 ceph-mon[125440]: osdmap e777: 12 total, 12 up, 12 in 2023-03-02T16:50:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:13 smithi136 ceph-mon[125702]: pgmap v11286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:13.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:13 smithi057 ceph-mon[92072]: pgmap v11286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:13 smithi122 ceph-mon[125440]: pgmap v11286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:15 smithi136 ceph-mon[125702]: pgmap v11287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:15 smithi057 ceph-mon[92072]: pgmap v11287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:16.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:15 smithi122 ceph-mon[125440]: pgmap v11287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:18 smithi136 ceph-mon[125702]: pgmap v11288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:50:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:17 smithi057 ceph-mon[92072]: pgmap v11288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:50:18.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:18 smithi122 ceph-mon[125440]: pgmap v11288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:50:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:20.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:50:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:20.151+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:50:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:20.151+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:50:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:20.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:20.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:50:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:20 smithi136 ceph-mon[125702]: pgmap v11289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:50:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:20 smithi136 ceph-mon[125702]: osdmap e778: 12 total, 12 up, 12 in 2023-03-02T16:50:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:20 smithi057 ceph-mon[92072]: pgmap v11289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:50:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:20 smithi057 ceph-mon[92072]: osdmap e778: 12 total, 12 up, 12 in 2023-03-02T16:50:20.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:20 smithi122 ceph-mon[125440]: pgmap v11289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T16:50:20.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:20 smithi122 ceph-mon[125440]: osdmap e778: 12 total, 12 up, 12 in 2023-03-02T16:50:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:22 smithi136 ceph-mon[125702]: pgmap v11291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 316 B/s wr, 10 op/s 2023-03-02T16:50:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:22 smithi057 ceph-mon[92072]: pgmap v11291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 316 B/s wr, 10 op/s 2023-03-02T16:50:22.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:22 smithi122 ceph-mon[125440]: pgmap v11291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 316 B/s wr, 10 op/s 2023-03-02T16:50:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:24 smithi136 ceph-mon[125702]: pgmap v11292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:24 smithi057 ceph-mon[92072]: pgmap v11292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:24 smithi122 ceph-mon[125440]: pgmap v11292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:25 smithi136 ceph-mon[125702]: pgmap v11293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:25 smithi057 ceph-mon[92072]: pgmap v11293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:26.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:25 smithi122 ceph-mon[125440]: pgmap v11293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:50:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:28 smithi136 ceph-mon[125702]: pgmap v11294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:50:28.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:28 smithi057 ceph-mon[92072]: pgmap v11294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:50:28.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:28 smithi122 ceph-mon[125440]: pgmap v11294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:50:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:50:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:29.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:50:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:29.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:50:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:30 smithi136 ceph-mon[125702]: pgmap v11295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:50:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:50:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:50:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:30 smithi057 ceph-mon[92072]: pgmap v11295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:50:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:50:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:50:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:30.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:30 smithi122 ceph-mon[125440]: pgmap v11295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:50:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:50:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:50:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:50:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:32 smithi136 ceph-mon[125702]: pgmap v11296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T16:50:32.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:32 smithi057 ceph-mon[92072]: pgmap v11296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T16:50:32.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:32 smithi122 ceph-mon[125440]: pgmap v11296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T16:50:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:33 smithi136 ceph-mon[125702]: pgmap v11297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:50:33.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:33 smithi057 ceph-mon[92072]: pgmap v11297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:50:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:33 smithi122 ceph-mon[125440]: pgmap v11297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:50:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:35.161+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:50:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:35.161+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:50:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:35.161+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:50:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:35.161+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:50:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:35.161+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:50:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:36 smithi136 ceph-mon[125702]: pgmap v11298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:36.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:36 smithi057 ceph-mon[92072]: pgmap v11298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:36.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:36 smithi122 ceph-mon[125440]: pgmap v11298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:38 smithi136 ceph-mon[125702]: pgmap v11299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:50:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:38 smithi057 ceph-mon[92072]: pgmap v11299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:50:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:38 smithi122 ceph-mon[125440]: pgmap v11299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:50:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:40 smithi136 ceph-mon[125702]: pgmap v11300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:50:40.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:40 smithi057 ceph-mon[92072]: pgmap v11300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:50:40.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:40 smithi122 ceph-mon[125440]: pgmap v11300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:50:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:42 smithi136 ceph-mon[125702]: pgmap v11301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:42.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:42 smithi057 ceph-mon[92072]: pgmap v11301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:42.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:42 smithi122 ceph-mon[125440]: pgmap v11301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:44 smithi136 ceph-mon[125702]: pgmap v11302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:50:44.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:44 smithi057 ceph-mon[92072]: pgmap v11302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:50:44.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:44 smithi122 ceph-mon[125440]: pgmap v11302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:50:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:46 smithi136 ceph-mon[125702]: pgmap v11303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:46.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:46 smithi057 ceph-mon[92072]: pgmap v11303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:46.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:46 smithi122 ceph-mon[125440]: pgmap v11303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:48 smithi136 ceph-mon[125702]: pgmap v11304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:50:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:48 smithi057 ceph-mon[92072]: pgmap v11304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:50:48.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:48 smithi122 ceph-mon[125440]: pgmap v11304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:50:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:50.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:50:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:50.172+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:50:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:50.172+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:50:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:50.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:50:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:50:50.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:50:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:50 smithi136 ceph-mon[125702]: pgmap v11305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:50:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:50 smithi057 ceph-mon[92072]: pgmap v11305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:50:50.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:50 smithi122 ceph-mon[125440]: pgmap v11305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:50:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:51 smithi136 ceph-mon[125702]: pgmap v11306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:51.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:51 smithi057 ceph-mon[92072]: pgmap v11306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:51 smithi122 ceph-mon[125440]: pgmap v11306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:53 smithi136 ceph-mon[125702]: pgmap v11307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:50:54.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:53 smithi057 ceph-mon[92072]: pgmap v11307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:50:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:53 smithi122 ceph-mon[125440]: pgmap v11307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:50:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:56 smithi136 ceph-mon[125702]: pgmap v11308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:56.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:56 smithi057 ceph-mon[92072]: pgmap v11308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:56.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:56 smithi122 ceph-mon[125440]: pgmap v11308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:50:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:58 smithi136 ceph-mon[125702]: pgmap v11309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:50:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:58 smithi057 ceph-mon[92072]: pgmap v11309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:50:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:58 smithi122 ceph-mon[125440]: pgmap v11309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:50:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:50:59 smithi136 ceph-mon[125702]: pgmap v11310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-02T16:50:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:50:59 smithi057 ceph-mon[92072]: pgmap v11310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-02T16:50:59.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:50:59 smithi122 ceph-mon[125440]: pgmap v11310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-02T16:51:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:02 smithi136 ceph-mon[125702]: pgmap v11311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:51:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:02 smithi057 ceph-mon[92072]: pgmap v11311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:51:02.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:02 smithi122 ceph-mon[125440]: pgmap v11311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:51:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:04 smithi136 ceph-mon[125702]: pgmap v11312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:51:04.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:04 smithi057 ceph-mon[92072]: pgmap v11312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:51:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:04 smithi122 ceph-mon[125440]: pgmap v11312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:51:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:05.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:51:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:05.184+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:51:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:05.184+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:51:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:05.184+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:51:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:05.184+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:51:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:06 smithi136 ceph-mon[125702]: pgmap v11313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:51:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:06 smithi057 ceph-mon[92072]: pgmap v11313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:51:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:06 smithi122 ceph-mon[125440]: pgmap v11313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:51:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:07 smithi136 ceph-mon[125702]: pgmap v11314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:51:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:07 smithi057 ceph-mon[92072]: pgmap v11314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:51:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:07 smithi122 ceph-mon[125440]: pgmap v11314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:51:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:09 smithi136 ceph-mon[125702]: pgmap v11315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:51:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:09 smithi057 ceph-mon[92072]: pgmap v11315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:51:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:09 smithi122 ceph-mon[125440]: pgmap v11315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:51:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:12 smithi136 ceph-mon[125702]: pgmap v11316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:51:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:12 smithi136 ceph-mon[125702]: osdmap e779: 12 total, 12 up, 12 in 2023-03-02T16:51:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:12 smithi057 ceph-mon[92072]: pgmap v11316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:51:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:12 smithi057 ceph-mon[92072]: osdmap e779: 12 total, 12 up, 12 in 2023-03-02T16:51:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:12 smithi122 ceph-mon[125440]: pgmap v11316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:51:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:12 smithi122 ceph-mon[125440]: osdmap e779: 12 total, 12 up, 12 in 2023-03-02T16:51:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:13 smithi136 ceph-mon[125702]: pgmap v11318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:51:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:13 smithi057 ceph-mon[92072]: pgmap v11318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:51:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:13 smithi122 ceph-mon[125440]: pgmap v11318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:51:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:16 smithi136 ceph-mon[125702]: pgmap v11319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:51:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:16 smithi136 ceph-mon[125702]: osdmap e780: 12 total, 12 up, 12 in 2023-03-02T16:51:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:16 smithi057 ceph-mon[92072]: pgmap v11319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:51:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:16 smithi057 ceph-mon[92072]: osdmap e780: 12 total, 12 up, 12 in 2023-03-02T16:51:16.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:16 smithi122 ceph-mon[125440]: pgmap v11319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:51:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:16 smithi122 ceph-mon[125440]: osdmap e780: 12 total, 12 up, 12 in 2023-03-02T16:51:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:18 smithi136 ceph-mon[125702]: pgmap v11321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-03-02T16:51:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:18 smithi057 ceph-mon[92072]: pgmap v11321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-03-02T16:51:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:18 smithi122 ceph-mon[125440]: pgmap v11321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-03-02T16:51:19.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:19 smithi136 ceph-mon[125702]: pgmap v11322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:51:19.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:19 smithi057 ceph-mon[92072]: pgmap v11322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:51:19.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:19 smithi122 ceph-mon[125440]: pgmap v11322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:51:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:20.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:51:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:20.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:51:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:20.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:51:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:20.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:51:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:20.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:51:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:22 smithi136 ceph-mon[125702]: pgmap v11323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:51:22.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:22 smithi057 ceph-mon[92072]: pgmap v11323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:51:22.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:22 smithi122 ceph-mon[125440]: pgmap v11323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:51:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:23 smithi136 ceph-mon[125702]: pgmap v11324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:51:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:23 smithi057 ceph-mon[92072]: pgmap v11324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:51:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:23 smithi122 ceph-mon[125440]: pgmap v11324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:51:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:26 smithi136 ceph-mon[125702]: pgmap v11325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:51:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:26 smithi057 ceph-mon[92072]: pgmap v11325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:51:26.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:26 smithi122 ceph-mon[125440]: pgmap v11325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:51:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:28 smithi136 ceph-mon[125702]: pgmap v11326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 87 B/s wr, 12 op/s 2023-03-02T16:51:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:28 smithi057 ceph-mon[92072]: pgmap v11326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 87 B/s wr, 12 op/s 2023-03-02T16:51:28.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:28 smithi122 ceph-mon[125440]: pgmap v11326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 87 B/s wr, 12 op/s 2023-03-02T16:51:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:30 smithi136 ceph-mon[125702]: pgmap v11327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:51:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:51:30.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:30 smithi057 ceph-mon[92072]: pgmap v11327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:51:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:51:30.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:30 smithi122 ceph-mon[125440]: pgmap v11327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:51:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:51:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:51:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:51:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:51:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:31 smithi136 ceph-mon[125702]: pgmap v11328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:51:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:51:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:51:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:31 smithi057 ceph-mon[92072]: pgmap v11328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:51:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:51:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:51:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:31 smithi122 ceph-mon[125440]: pgmap v11328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:33 smithi136 ceph-mon[125702]: pgmap v11329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:51:34.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:33 smithi057 ceph-mon[92072]: pgmap v11329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:51:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:33 smithi122 ceph-mon[125440]: pgmap v11329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:51:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:35.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:51:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:35.204+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:51:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:35.204+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:51:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:35.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:51:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:35.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:51:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:36 smithi136 ceph-mon[125702]: pgmap v11330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:36.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:36 smithi057 ceph-mon[92072]: pgmap v11330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:36 smithi122 ceph-mon[125440]: pgmap v11330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:37 smithi136 ceph-mon[125702]: pgmap v11331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:51:37.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:37 smithi057 ceph-mon[92072]: pgmap v11331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:51:37.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:37 smithi122 ceph-mon[125440]: pgmap v11331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:51:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:39 smithi136 ceph-mon[125702]: pgmap v11332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:51:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:39 smithi057 ceph-mon[92072]: pgmap v11332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:51:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:39 smithi122 ceph-mon[125440]: pgmap v11332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:51:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:42 smithi136 ceph-mon[125702]: pgmap v11333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:42 smithi057 ceph-mon[92072]: pgmap v11333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:42.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:42 smithi122 ceph-mon[125440]: pgmap v11333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:44 smithi136 ceph-mon[125702]: pgmap v11334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:51:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:44 smithi057 ceph-mon[92072]: pgmap v11334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:51:44.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:44 smithi122 ceph-mon[125440]: pgmap v11334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:51:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:46 smithi136 ceph-mon[125702]: pgmap v11335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:46.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:46 smithi057 ceph-mon[92072]: pgmap v11335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:46.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:46 smithi122 ceph-mon[125440]: pgmap v11335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:47.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:47 smithi136 ceph-mon[125702]: pgmap v11336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:51:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:47 smithi057 ceph-mon[92072]: pgmap v11336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:51:47.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:47 smithi122 ceph-mon[125440]: pgmap v11336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:51:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:49 smithi136 ceph-mon[125702]: pgmap v11337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:51:50.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:49 smithi057 ceph-mon[92072]: pgmap v11337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:51:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:49 smithi122 ceph-mon[125440]: pgmap v11337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:51:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:50.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:51:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:50.220+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:51:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:50.220+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:51:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:50.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:51:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:51:50.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:51:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:52 smithi136 ceph-mon[125702]: pgmap v11338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:52.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:52 smithi057 ceph-mon[92072]: pgmap v11338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:52.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:52 smithi122 ceph-mon[125440]: pgmap v11338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:54 smithi136 ceph-mon[125702]: pgmap v11339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:51:54.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:54 smithi057 ceph-mon[92072]: pgmap v11339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:51:54.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:54 smithi122 ceph-mon[125440]: pgmap v11339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:51:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:56 smithi136 ceph-mon[125702]: pgmap v11340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:56 smithi057 ceph-mon[92072]: pgmap v11340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:56 smithi122 ceph-mon[125440]: pgmap v11340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:51:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:57 smithi136 ceph-mon[125702]: pgmap v11341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:51:57.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:57 smithi057 ceph-mon[92072]: pgmap v11341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:51:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:57 smithi122 ceph-mon[125440]: pgmap v11341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T16:52:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:51:59 smithi136 ceph-mon[125702]: pgmap v11342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:52:00.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:51:59 smithi057 ceph-mon[92072]: pgmap v11342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:52:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:51:59 smithi122 ceph-mon[125440]: pgmap v11342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T16:52:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:01 smithi136 ceph-mon[125702]: pgmap v11343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:01 smithi057 ceph-mon[92072]: pgmap v11343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:01 smithi122 ceph-mon[125440]: pgmap v11343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:03 smithi136 ceph-mon[125702]: pgmap v11344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:52:04.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:03 smithi057 ceph-mon[92072]: pgmap v11344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:52:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:03 smithi122 ceph-mon[125440]: pgmap v11344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:52:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:05.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:52:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:05.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:52:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:05.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:52:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:05.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:52:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:05.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:52:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:06 smithi136 ceph-mon[125702]: pgmap v11345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:52:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:06 smithi057 ceph-mon[92072]: pgmap v11345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:52:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:06 smithi122 ceph-mon[125440]: pgmap v11345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:52:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:07 smithi136 ceph-mon[125702]: osdmap e781: 12 total, 12 up, 12 in 2023-03-02T16:52:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:07 smithi136 ceph-mon[125702]: pgmap v11347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T16:52:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:07 smithi057 ceph-mon[92072]: osdmap e781: 12 total, 12 up, 12 in 2023-03-02T16:52:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:07 smithi057 ceph-mon[92072]: pgmap v11347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T16:52:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:07 smithi122 ceph-mon[125440]: osdmap e781: 12 total, 12 up, 12 in 2023-03-02T16:52:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:07 smithi122 ceph-mon[125440]: pgmap v11347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T16:52:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:09 smithi136 ceph-mon[125702]: pgmap v11348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:52:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:09 smithi057 ceph-mon[92072]: pgmap v11348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:52:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:09 smithi122 ceph-mon[125440]: pgmap v11348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:52:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:12 smithi136 ceph-mon[125702]: pgmap v11349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:52:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:12 smithi057 ceph-mon[92072]: pgmap v11349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:52:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:12 smithi122 ceph-mon[125440]: pgmap v11349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:52:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:13 smithi136 ceph-mon[125702]: pgmap v11350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:52:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:13 smithi057 ceph-mon[92072]: pgmap v11350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:52:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:13 smithi122 ceph-mon[125440]: pgmap v11350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:52:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:16 smithi136 ceph-mon[125702]: pgmap v11351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:52:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:16 smithi136 ceph-mon[125702]: osdmap e782: 12 total, 12 up, 12 in 2023-03-02T16:52:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:16 smithi057 ceph-mon[92072]: pgmap v11351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:52:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:16 smithi057 ceph-mon[92072]: osdmap e782: 12 total, 12 up, 12 in 2023-03-02T16:52:16.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:16 smithi122 ceph-mon[125440]: pgmap v11351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:52:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:16 smithi122 ceph-mon[125440]: osdmap e782: 12 total, 12 up, 12 in 2023-03-02T16:52:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:17 smithi136 ceph-mon[125702]: pgmap v11353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:52:17.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:17 smithi057 ceph-mon[92072]: pgmap v11353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:52:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:17 smithi122 ceph-mon[125440]: pgmap v11353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:52:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:19 smithi136 ceph-mon[125702]: pgmap v11354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:52:20.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:19 smithi057 ceph-mon[92072]: pgmap v11354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:52:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:19 smithi122 ceph-mon[125440]: pgmap v11354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:52:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:20.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:52:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:20.244+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:52:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:20.244+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:52:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:20.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:52:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:20.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:52:22.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:22 smithi136 ceph-mon[125702]: pgmap v11355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:52:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:22 smithi057 ceph-mon[92072]: pgmap v11355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:52:22.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:22 smithi122 ceph-mon[125440]: pgmap v11355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:52:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:23 smithi136 ceph-mon[125702]: pgmap v11356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:52:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:23 smithi057 ceph-mon[92072]: pgmap v11356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:52:23.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:23 smithi122 ceph-mon[125440]: pgmap v11356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:52:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:26 smithi136 ceph-mon[125702]: pgmap v11357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:52:26.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:26 smithi057 ceph-mon[92072]: pgmap v11357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:52:26.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:26 smithi122 ceph-mon[125440]: pgmap v11357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:52:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:27 smithi136 ceph-mon[125702]: pgmap v11358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T16:52:27.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:27 smithi057 ceph-mon[92072]: pgmap v11358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T16:52:27.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:27 smithi122 ceph-mon[125440]: pgmap v11358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T16:52:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:29 smithi136 ceph-mon[125702]: pgmap v11359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:29 smithi057 ceph-mon[92072]: pgmap v11359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:29 smithi122 ceph-mon[125440]: pgmap v11359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:52:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:31 smithi136 ceph-mon[125702]: pgmap v11360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:52:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:31 smithi057 ceph-mon[92072]: pgmap v11360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:52:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:31 smithi122 ceph-mon[125440]: pgmap v11360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:52:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:52:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:52:32.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:52:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:52:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:52:32.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:52:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:52:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:52:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:33 smithi136 ceph-mon[125702]: pgmap v11361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:33.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:33 smithi057 ceph-mon[92072]: pgmap v11361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:33 smithi122 ceph-mon[125440]: pgmap v11361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:35.259+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:52:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:35.260+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:52:35.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:35.260+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:52:35.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:35.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:52:35.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:35.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:52:36.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:35 smithi136 ceph-mon[125702]: pgmap v11362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:35 smithi057 ceph-mon[92072]: pgmap v11362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:35 smithi122 ceph-mon[125440]: pgmap v11362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:37 smithi136 ceph-mon[125702]: pgmap v11363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:37 smithi057 ceph-mon[92072]: pgmap v11363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:37 smithi122 ceph-mon[125440]: pgmap v11363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:39 smithi136 ceph-mon[125702]: pgmap v11364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:39 smithi057 ceph-mon[92072]: pgmap v11364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:39 smithi122 ceph-mon[125440]: pgmap v11364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:41 smithi136 ceph-mon[125702]: pgmap v11365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:41 smithi057 ceph-mon[92072]: pgmap v11365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:41 smithi122 ceph-mon[125440]: pgmap v11365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:43 smithi136 ceph-mon[125702]: pgmap v11366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:43 smithi057 ceph-mon[92072]: pgmap v11366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:43 smithi122 ceph-mon[125440]: pgmap v11366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:45 smithi136 ceph-mon[125702]: pgmap v11367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:45 smithi057 ceph-mon[92072]: pgmap v11367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:45 smithi122 ceph-mon[125440]: pgmap v11367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:47 smithi136 ceph-mon[125702]: pgmap v11368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:47 smithi057 ceph-mon[92072]: pgmap v11368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:47 smithi122 ceph-mon[125440]: pgmap v11368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:49 smithi136 ceph-mon[125702]: pgmap v11369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:49 smithi057 ceph-mon[92072]: pgmap v11369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:49 smithi122 ceph-mon[125440]: pgmap v11369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:50.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:50.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:52:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:50.261+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:52:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:50.261+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:52:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:50.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:52:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:52:50.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:52:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:51 smithi136 ceph-mon[125702]: pgmap v11370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:51 smithi057 ceph-mon[92072]: pgmap v11370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:51 smithi122 ceph-mon[125440]: pgmap v11370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:53 smithi136 ceph-mon[125702]: pgmap v11371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:53 smithi057 ceph-mon[92072]: pgmap v11371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:53 smithi122 ceph-mon[125440]: pgmap v11371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:55 smithi136 ceph-mon[125702]: pgmap v11372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:56.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:55 smithi057 ceph-mon[92072]: pgmap v11372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:55 smithi122 ceph-mon[125440]: pgmap v11372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:52:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:57 smithi136 ceph-mon[125702]: pgmap v11373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:57 smithi057 ceph-mon[92072]: pgmap v11373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:52:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:57 smithi122 ceph-mon[125440]: pgmap v11373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:52:59 smithi136 ceph-mon[125702]: pgmap v11374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:00.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:52:59 smithi057 ceph-mon[92072]: pgmap v11374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:52:59 smithi122 ceph-mon[125440]: pgmap v11374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:01 smithi136 ceph-mon[125702]: pgmap v11375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:01 smithi057 ceph-mon[92072]: pgmap v11375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:01 smithi122 ceph-mon[125440]: pgmap v11375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:03 smithi136 ceph-mon[125702]: pgmap v11376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:53:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:03 smithi057 ceph-mon[92072]: pgmap v11376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:53:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:03 smithi122 ceph-mon[125440]: pgmap v11376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:53:05.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:05.277+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:53:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:05.278+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:53:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:05.278+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:53:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:05.278+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:53:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:05.278+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:53:06.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:05 smithi136 ceph-mon[125702]: pgmap v11377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:53:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:05 smithi057 ceph-mon[92072]: pgmap v11377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:53:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:05 smithi122 ceph-mon[125440]: pgmap v11377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:53:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:07 smithi057 ceph-mon[92072]: pgmap v11378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:53:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:07 smithi057 ceph-mon[92072]: osdmap e783: 12 total, 12 up, 12 in 2023-03-02T16:53:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:07 smithi122 ceph-mon[125440]: pgmap v11378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:53:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:07 smithi122 ceph-mon[125440]: osdmap e783: 12 total, 12 up, 12 in 2023-03-02T16:53:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:07 smithi136 ceph-mon[125702]: pgmap v11378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:53:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:07 smithi136 ceph-mon[125702]: osdmap e783: 12 total, 12 up, 12 in 2023-03-02T16:53:10.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:09 smithi057 ceph-mon[92072]: pgmap v11380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:53:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:09 smithi122 ceph-mon[125440]: pgmap v11380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:53:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:09 smithi136 ceph-mon[125702]: pgmap v11380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:53:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:11 smithi136 ceph-mon[125702]: pgmap v11381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:53:11.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:11 smithi057 ceph-mon[92072]: pgmap v11381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:53:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:11.435+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:53:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:11.435+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:53:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:11.435+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 166 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:53:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:11.435+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 165 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:53:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:11 smithi122 ceph-mon[125440]: pgmap v11381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:53:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:13 smithi136 ceph-mon[125702]: pgmap v11382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:53:14.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:13 smithi057 ceph-mon[92072]: pgmap v11382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:53:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:13 smithi122 ceph-mon[125440]: pgmap v11382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:53:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:15 smithi136 ceph-mon[125702]: pgmap v11383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:53:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:15 smithi136 ceph-mon[125702]: osdmap e784: 12 total, 12 up, 12 in 2023-03-02T16:53:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:15 smithi057 ceph-mon[92072]: pgmap v11383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:53:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:15 smithi057 ceph-mon[92072]: osdmap e784: 12 total, 12 up, 12 in 2023-03-02T16:53:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:15 smithi122 ceph-mon[125440]: pgmap v11383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:53:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:15 smithi122 ceph-mon[125440]: osdmap e784: 12 total, 12 up, 12 in 2023-03-02T16:53:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:17 smithi057 ceph-mon[92072]: pgmap v11385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-02T16:53:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:17 smithi122 ceph-mon[125440]: pgmap v11385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-02T16:53:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:17 smithi136 ceph-mon[125702]: pgmap v11385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-02T16:53:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:19 smithi057 ceph-mon[92072]: pgmap v11386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:53:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:19 smithi122 ceph-mon[125440]: pgmap v11386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:53:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:20.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:53:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:20.294+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:53:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:20.294+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:53:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:20.294+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:53:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:20.294+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:53:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:19 smithi136 ceph-mon[125702]: pgmap v11386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:53:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:21 smithi136 ceph-mon[125702]: pgmap v11387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:53:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:21 smithi057 ceph-mon[92072]: pgmap v11387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:53:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:21 smithi122 ceph-mon[125440]: pgmap v11387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:53:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:23 smithi136 ceph-mon[125702]: pgmap v11388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:53:24.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:23 smithi057 ceph-mon[92072]: pgmap v11388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:53:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:23 smithi122 ceph-mon[125440]: pgmap v11388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:53:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:25 smithi057 ceph-mon[92072]: pgmap v11389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:53:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:25 smithi122 ceph-mon[125440]: pgmap v11389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:53:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:25 smithi136 ceph-mon[125702]: pgmap v11389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:53:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:27 smithi057 ceph-mon[92072]: pgmap v11390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T16:53:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:27 smithi122 ceph-mon[125440]: pgmap v11390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T16:53:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:27 smithi136 ceph-mon[125702]: pgmap v11390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T16:53:30.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:29 smithi057 ceph-mon[92072]: pgmap v11391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:29 smithi122 ceph-mon[125440]: pgmap v11391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:29 smithi136 ceph-mon[125702]: pgmap v11391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:31 smithi136 ceph-mon[125702]: pgmap v11392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:31 smithi057 ceph-mon[92072]: pgmap v11392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:31 smithi122 ceph-mon[125440]: pgmap v11392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:32.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:53:32.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:53:32.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:53:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:53:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:53:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:53:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:33 smithi136 ceph-mon[125702]: pgmap v11393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:53:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:53:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:53:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:33 smithi057 ceph-mon[92072]: pgmap v11393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:33.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:53:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:53:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:53:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:33 smithi122 ceph-mon[125440]: pgmap v11393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:35.307+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:53:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:35.307+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:53:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:35.307+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:53:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:35.307+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:53:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:35.307+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:53:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:35 smithi136 ceph-mon[125702]: pgmap v11394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:36.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:35 smithi057 ceph-mon[92072]: pgmap v11394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:36.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:35 smithi122 ceph-mon[125440]: pgmap v11394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:37 smithi136 ceph-mon[125702]: pgmap v11395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:37 smithi057 ceph-mon[92072]: pgmap v11395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:37 smithi122 ceph-mon[125440]: pgmap v11395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:39 smithi057 ceph-mon[92072]: pgmap v11396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:39 smithi122 ceph-mon[125440]: pgmap v11396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:39 smithi136 ceph-mon[125702]: pgmap v11396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:41 smithi136 ceph-mon[125702]: pgmap v11397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:41 smithi057 ceph-mon[92072]: pgmap v11397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:41 smithi122 ceph-mon[125440]: pgmap v11397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:44.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:43 smithi057 ceph-mon[92072]: pgmap v11398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:43 smithi122 ceph-mon[125440]: pgmap v11398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:43 smithi136 ceph-mon[125702]: pgmap v11398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:46.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:45 smithi057 ceph-mon[92072]: pgmap v11399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:45 smithi122 ceph-mon[125440]: pgmap v11399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:45 smithi136 ceph-mon[125702]: pgmap v11399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:53:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:47 smithi057 ceph-mon[92072]: pgmap v11400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:47 smithi122 ceph-mon[125440]: pgmap v11400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:47 smithi136 ceph-mon[125702]: pgmap v11400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:53:50.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:49 smithi057 ceph-mon[92072]: pgmap v11401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:53:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:49 smithi122 ceph-mon[125440]: pgmap v11401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:53:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:50.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:53:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:50.318+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:53:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:50.318+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:53:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:50.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:53:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:50.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:53:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:49 smithi136 ceph-mon[125702]: pgmap v11401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:53:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:51 smithi136 ceph-mon[125702]: pgmap v11402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:53:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:51 smithi057 ceph-mon[92072]: pgmap v11402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:53:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:51 smithi122 ceph-mon[125440]: pgmap v11402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T16:53:54.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:53 smithi057 ceph-mon[92072]: pgmap v11403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T16:53:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:53 smithi122 ceph-mon[125440]: pgmap v11403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T16:53:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:53 smithi136 ceph-mon[125702]: pgmap v11403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T16:53:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:55 smithi057 ceph-mon[92072]: pgmap v11404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-02T16:53:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:55 smithi122 ceph-mon[125440]: pgmap v11404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-02T16:53:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:55 smithi136 ceph-mon[125702]: pgmap v11404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-02T16:53:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:56.440+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:53:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:56.440+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:53:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:56.440+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 166 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:53:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:53:56.440+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 167 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:53:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:57 smithi057 ceph-mon[92072]: pgmap v11405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T16:53:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:57 smithi122 ceph-mon[125440]: pgmap v11405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T16:53:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:57 smithi136 ceph-mon[125702]: pgmap v11405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T16:54:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:53:59 smithi057 ceph-mon[92072]: pgmap v11406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T16:54:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:53:59 smithi122 ceph-mon[125440]: pgmap v11406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T16:54:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:53:59 smithi136 ceph-mon[125702]: pgmap v11406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T16:54:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:01 smithi136 ceph-mon[125702]: pgmap v11407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T16:54:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:01 smithi057 ceph-mon[92072]: pgmap v11407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T16:54:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:01 smithi122 ceph-mon[125440]: pgmap v11407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T16:54:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:03 smithi057 ceph-mon[92072]: pgmap v11408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:54:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:03 smithi122 ceph-mon[125440]: pgmap v11408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:54:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:03 smithi136 ceph-mon[125702]: pgmap v11408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T16:54:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:05.328+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:54:05.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:05.329+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:54:05.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:05.329+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:54:05.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:05.329+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:54:05.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:05.329+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:54:06.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:05 smithi057 ceph-mon[92072]: pgmap v11409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:54:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:05 smithi122 ceph-mon[125440]: pgmap v11409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:54:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:05 smithi136 ceph-mon[125702]: pgmap v11409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:54:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:07 smithi057 ceph-mon[92072]: pgmap v11410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:54:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:07 smithi057 ceph-mon[92072]: osdmap e785: 12 total, 12 up, 12 in 2023-03-02T16:54:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:07 smithi122 ceph-mon[125440]: pgmap v11410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:54:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:07 smithi122 ceph-mon[125440]: osdmap e785: 12 total, 12 up, 12 in 2023-03-02T16:54:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:07 smithi136 ceph-mon[125702]: pgmap v11410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:54:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:07 smithi136 ceph-mon[125702]: osdmap e785: 12 total, 12 up, 12 in 2023-03-02T16:54:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:09 smithi057 ceph-mon[92072]: pgmap v11412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:54:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:09 smithi122 ceph-mon[125440]: pgmap v11412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:54:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:09 smithi136 ceph-mon[125702]: pgmap v11412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:54:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:11 smithi136 ceph-mon[125702]: pgmap v11413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:54:11.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:11 smithi057 ceph-mon[92072]: pgmap v11413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:54:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:11 smithi122 ceph-mon[125440]: pgmap v11413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:54:14.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:13 smithi057 ceph-mon[92072]: pgmap v11414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:54:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:13 smithi122 ceph-mon[125440]: pgmap v11414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:54:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:13 smithi136 ceph-mon[125702]: pgmap v11414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:54:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:15 smithi057 ceph-mon[92072]: pgmap v11415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:54:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:15 smithi057 ceph-mon[92072]: osdmap e786: 12 total, 12 up, 12 in 2023-03-02T16:54:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:15 smithi122 ceph-mon[125440]: pgmap v11415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:54:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:15 smithi122 ceph-mon[125440]: osdmap e786: 12 total, 12 up, 12 in 2023-03-02T16:54:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:15 smithi136 ceph-mon[125702]: pgmap v11415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:54:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:15 smithi136 ceph-mon[125702]: osdmap e786: 12 total, 12 up, 12 in 2023-03-02T16:54:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:17 smithi057 ceph-mon[92072]: pgmap v11417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-02T16:54:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:17 smithi122 ceph-mon[125440]: pgmap v11417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-02T16:54:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:17 smithi136 ceph-mon[125702]: pgmap v11417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-02T16:54:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:19 smithi057 ceph-mon[92072]: pgmap v11418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:54:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:19 smithi122 ceph-mon[125440]: pgmap v11418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:54:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:19 smithi136 ceph-mon[125702]: pgmap v11418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:54:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:20.344+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:54:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:20.345+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:54:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:20.345+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:54:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:20.345+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:54:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:20.345+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:54:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:21 smithi136 ceph-mon[125702]: pgmap v11419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:54:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:21 smithi057 ceph-mon[92072]: pgmap v11419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:54:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:21 smithi122 ceph-mon[125440]: pgmap v11419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:54:24.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:23 smithi057 ceph-mon[92072]: pgmap v11420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:54:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:23 smithi122 ceph-mon[125440]: pgmap v11420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:54:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:23 smithi136 ceph-mon[125702]: pgmap v11420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:54:26.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:25 smithi057 ceph-mon[92072]: pgmap v11421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:54:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:25 smithi122 ceph-mon[125440]: pgmap v11421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:54:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:25 smithi136 ceph-mon[125702]: pgmap v11421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T16:54:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:27 smithi057 ceph-mon[92072]: pgmap v11422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T16:54:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:27 smithi122 ceph-mon[125440]: pgmap v11422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T16:54:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:27 smithi136 ceph-mon[125702]: pgmap v11422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T16:54:30.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:29 smithi057 ceph-mon[92072]: pgmap v11423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:29 smithi122 ceph-mon[125440]: pgmap v11423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:29 smithi136 ceph-mon[125702]: pgmap v11423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:31 smithi136 ceph-mon[125702]: pgmap v11424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:31 smithi057 ceph-mon[92072]: pgmap v11424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:31 smithi122 ceph-mon[125440]: pgmap v11424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:32.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:54:32.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:54:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:54:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:33 smithi057 ceph-mon[92072]: pgmap v11425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:54:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:54:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:54:33.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:33 smithi122 ceph-mon[125440]: pgmap v11425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:54:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:54:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:54:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:33 smithi136 ceph-mon[125702]: pgmap v11425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:54:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:54:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:54:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:35.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:54:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:35.361+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:54:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:35.361+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:54:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:35.361+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:54:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:35.361+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:54:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:35 smithi057 ceph-mon[92072]: pgmap v11426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:35 smithi122 ceph-mon[125440]: pgmap v11426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:35 smithi136 ceph-mon[125702]: pgmap v11426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:37 smithi057 ceph-mon[92072]: pgmap v11427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:37 smithi122 ceph-mon[125440]: pgmap v11427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:37 smithi136 ceph-mon[125702]: pgmap v11427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:39 smithi057 ceph-mon[92072]: pgmap v11428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:39 smithi122 ceph-mon[125440]: pgmap v11428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:39 smithi136 ceph-mon[125702]: pgmap v11428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:41 smithi136 ceph-mon[125702]: pgmap v11429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:41 smithi057 ceph-mon[92072]: pgmap v11429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:41 smithi122 ceph-mon[125440]: pgmap v11429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:44.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:43 smithi057 ceph-mon[92072]: pgmap v11430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:43 smithi122 ceph-mon[125440]: pgmap v11430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:43 smithi136 ceph-mon[125702]: pgmap v11430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:45 smithi057 ceph-mon[92072]: pgmap v11431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:45 smithi122 ceph-mon[125440]: pgmap v11431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:45 smithi136 ceph-mon[125702]: pgmap v11431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:48.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:47 smithi057 ceph-mon[92072]: pgmap v11432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:47 smithi122 ceph-mon[125440]: pgmap v11432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:47 smithi136 ceph-mon[125702]: pgmap v11432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:49 smithi057 ceph-mon[92072]: pgmap v11433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:49 smithi122 ceph-mon[125440]: pgmap v11433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:49 smithi136 ceph-mon[125702]: pgmap v11433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:50.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:54:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:50.377+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:54:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:50.377+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:54:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:50.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:54:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:54:50.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:54:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:51 smithi136 ceph-mon[125702]: pgmap v11434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:51.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:51 smithi057 ceph-mon[92072]: pgmap v11434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:51 smithi122 ceph-mon[125440]: pgmap v11434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:53 smithi057 ceph-mon[92072]: pgmap v11435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:53 smithi122 ceph-mon[125440]: pgmap v11435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:53 smithi136 ceph-mon[125702]: pgmap v11435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:55 smithi057 ceph-mon[92072]: pgmap v11436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:55 smithi122 ceph-mon[125440]: pgmap v11436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:55 smithi136 ceph-mon[125702]: pgmap v11436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:54:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:57 smithi057 ceph-mon[92072]: pgmap v11437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:57 smithi122 ceph-mon[125440]: pgmap v11437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:54:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:57 smithi136 ceph-mon[125702]: pgmap v11437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:54:59 smithi057 ceph-mon[92072]: pgmap v11438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:54:59 smithi122 ceph-mon[125440]: pgmap v11438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:54:59 smithi136 ceph-mon[125702]: pgmap v11438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:01 smithi136 ceph-mon[125702]: pgmap v11439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:01 smithi057 ceph-mon[92072]: pgmap v11439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:01 smithi122 ceph-mon[125440]: pgmap v11439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:03 smithi057 ceph-mon[92072]: pgmap v11440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:55:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:03 smithi122 ceph-mon[125440]: pgmap v11440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:55:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:03 smithi136 ceph-mon[125702]: pgmap v11440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:55:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:05.391+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:55:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:05.391+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:55:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:05.391+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:55:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:05.391+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:55:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:05.391+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:55:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:05 smithi057 ceph-mon[92072]: pgmap v11441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:55:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:05 smithi122 ceph-mon[125440]: pgmap v11441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:55:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:05 smithi136 ceph-mon[125702]: pgmap v11441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:55:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:07 smithi136 ceph-mon[125702]: osdmap e787: 12 total, 12 up, 12 in 2023-03-02T16:55:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:07 smithi136 ceph-mon[125702]: pgmap v11443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:55:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:07 smithi057 ceph-mon[92072]: osdmap e787: 12 total, 12 up, 12 in 2023-03-02T16:55:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:07 smithi057 ceph-mon[92072]: pgmap v11443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:55:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:07 smithi122 ceph-mon[125440]: osdmap e787: 12 total, 12 up, 12 in 2023-03-02T16:55:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:07 smithi122 ceph-mon[125440]: pgmap v11443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:55:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:09 smithi057 ceph-mon[92072]: pgmap v11444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:55:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:09 smithi122 ceph-mon[125440]: pgmap v11444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:55:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:09 smithi136 ceph-mon[125702]: pgmap v11444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:55:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:11 smithi136 ceph-mon[125702]: osdmap e788: 12 total, 12 up, 12 in 2023-03-02T16:55:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:11 smithi136 ceph-mon[125702]: pgmap v11446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:55:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:11 smithi057 ceph-mon[92072]: osdmap e788: 12 total, 12 up, 12 in 2023-03-02T16:55:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:11 smithi057 ceph-mon[92072]: pgmap v11446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:55:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:11 smithi122 ceph-mon[125440]: osdmap e788: 12 total, 12 up, 12 in 2023-03-02T16:55:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:11 smithi122 ceph-mon[125440]: pgmap v11446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:55:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:13 smithi057 ceph-mon[92072]: pgmap v11447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:55:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:13 smithi122 ceph-mon[125440]: pgmap v11447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:55:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:13 smithi136 ceph-mon[125702]: pgmap v11447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:55:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:15 smithi057 ceph-mon[92072]: pgmap v11448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:55:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:15 smithi122 ceph-mon[125440]: pgmap v11448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:55:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:15 smithi136 ceph-mon[125702]: pgmap v11448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T16:55:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:17 smithi057 ceph-mon[92072]: pgmap v11449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:55:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:17 smithi122 ceph-mon[125440]: pgmap v11449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:55:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:17 smithi136 ceph-mon[125702]: pgmap v11449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:55:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:19 smithi057 ceph-mon[92072]: pgmap v11450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:55:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:19 smithi122 ceph-mon[125440]: pgmap v11450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:55:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:19 smithi136 ceph-mon[125702]: pgmap v11450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:55:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:20.408+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:55:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:20.408+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:55:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:20.408+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:55:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:20.408+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:55:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:20.408+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:55:21.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:21 smithi136 ceph-mon[125702]: pgmap v11451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:55:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:21 smithi057 ceph-mon[92072]: pgmap v11451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:55:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:21 smithi122 ceph-mon[125440]: pgmap v11451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:55:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:23 smithi057 ceph-mon[92072]: pgmap v11452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:55:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:23 smithi122 ceph-mon[125440]: pgmap v11452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:55:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:23 smithi136 ceph-mon[125702]: pgmap v11452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:55:26.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:25 smithi057 ceph-mon[92072]: pgmap v11453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:25 smithi122 ceph-mon[125440]: pgmap v11453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:25 smithi136 ceph-mon[125702]: pgmap v11453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:27 smithi057 ceph-mon[92072]: pgmap v11454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T16:55:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:27 smithi122 ceph-mon[125440]: pgmap v11454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T16:55:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:27 smithi136 ceph-mon[125702]: pgmap v11454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T16:55:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:29 smithi057 ceph-mon[92072]: pgmap v11455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:29 smithi122 ceph-mon[125440]: pgmap v11455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:29 smithi136 ceph-mon[125702]: pgmap v11455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:31 smithi057 ceph-mon[92072]: pgmap v11456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:31 smithi122 ceph-mon[125440]: pgmap v11456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:31 smithi136 ceph-mon[125702]: pgmap v11456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:34.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:33 smithi057 ceph-mon[92072]: pgmap v11457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:55:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:33 smithi122 ceph-mon[125440]: pgmap v11457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:55:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:33 smithi136 ceph-mon[125702]: pgmap v11457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:55:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:55:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:55:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:55:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:55:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:55:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:55:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:55:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:55:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:55:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:35.422+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:55:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:35.423+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:55:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:35.423+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:55:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:35.423+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:55:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:35.423+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:55:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:35 smithi122 ceph-mon[125440]: pgmap v11458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:35 smithi136 ceph-mon[125702]: pgmap v11458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:36.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:35 smithi057 ceph-mon[92072]: pgmap v11458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:37 smithi136 ceph-mon[125702]: pgmap v11459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:37 smithi057 ceph-mon[92072]: pgmap v11459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:37 smithi122 ceph-mon[125440]: pgmap v11459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:39 smithi136 ceph-mon[125702]: pgmap v11460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:39 smithi057 ceph-mon[92072]: pgmap v11460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:40.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:39 smithi122 ceph-mon[125440]: pgmap v11460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:41 smithi057 ceph-mon[92072]: pgmap v11461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:41 smithi122 ceph-mon[125440]: pgmap v11461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:41 smithi136 ceph-mon[125702]: pgmap v11461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:44.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:43 smithi057 ceph-mon[92072]: pgmap v11462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:43 smithi122 ceph-mon[125440]: pgmap v11462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:43 smithi136 ceph-mon[125702]: pgmap v11462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:45 smithi057 ceph-mon[92072]: pgmap v11463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:45 smithi122 ceph-mon[125440]: pgmap v11463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:45 smithi136 ceph-mon[125702]: pgmap v11463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:47 smithi057 ceph-mon[92072]: pgmap v11464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:47 smithi122 ceph-mon[125440]: pgmap v11464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:47 smithi136 ceph-mon[125702]: pgmap v11464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:49 smithi057 ceph-mon[92072]: pgmap v11465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:49 smithi122 ceph-mon[125440]: pgmap v11465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:49 smithi136 ceph-mon[125702]: pgmap v11465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:50.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:50.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:55:50.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:50.431+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:55:50.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:50.431+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:55:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:50.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:55:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:55:50.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:55:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:51 smithi057 ceph-mon[92072]: pgmap v11466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:51 smithi122 ceph-mon[125440]: pgmap v11466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:51 smithi136 ceph-mon[125702]: pgmap v11466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:53 smithi057 ceph-mon[92072]: pgmap v11467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:53 smithi122 ceph-mon[125440]: pgmap v11467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:53 smithi136 ceph-mon[125702]: pgmap v11467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:55 smithi057 ceph-mon[92072]: pgmap v11468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:55 smithi122 ceph-mon[125440]: pgmap v11468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:55 smithi136 ceph-mon[125702]: pgmap v11468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:55:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:57 smithi057 ceph-mon[92072]: pgmap v11469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:57 smithi122 ceph-mon[125440]: pgmap v11469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:55:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:57 smithi136 ceph-mon[125702]: pgmap v11469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:55:59 smithi057 ceph-mon[92072]: pgmap v11470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:55:59 smithi122 ceph-mon[125440]: pgmap v11470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:55:59 smithi136 ceph-mon[125702]: pgmap v11470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:01 smithi057 ceph-mon[92072]: pgmap v11471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:01 smithi122 ceph-mon[125440]: pgmap v11471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:01 smithi136 ceph-mon[125702]: pgmap v11471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:03 smithi057 ceph-mon[92072]: pgmap v11472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:56:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:03 smithi122 ceph-mon[125440]: pgmap v11472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:56:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:03 smithi136 ceph-mon[125702]: pgmap v11472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:56:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:05.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:56:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:05.442+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:56:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:05.442+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:56:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:05.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:56:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:05.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:56:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:05 smithi057 ceph-mon[92072]: pgmap v11473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:56:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:05 smithi122 ceph-mon[125440]: pgmap v11473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:56:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:05 smithi136 ceph-mon[125702]: pgmap v11473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:56:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:07 smithi057 ceph-mon[92072]: osdmap e789: 12 total, 12 up, 12 in 2023-03-02T16:56:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:07 smithi057 ceph-mon[92072]: pgmap v11475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:56:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:07 smithi122 ceph-mon[125440]: osdmap e789: 12 total, 12 up, 12 in 2023-03-02T16:56:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:07 smithi122 ceph-mon[125440]: pgmap v11475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:56:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:07 smithi136 ceph-mon[125702]: osdmap e789: 12 total, 12 up, 12 in 2023-03-02T16:56:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:07 smithi136 ceph-mon[125702]: pgmap v11475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:56:10.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:09 smithi057 ceph-mon[92072]: pgmap v11476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:56:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:09 smithi122 ceph-mon[125440]: pgmap v11476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:56:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:09 smithi136 ceph-mon[125702]: pgmap v11476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T16:56:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:11 smithi057 ceph-mon[92072]: osdmap e790: 12 total, 12 up, 12 in 2023-03-02T16:56:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:11 smithi057 ceph-mon[92072]: pgmap v11478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:56:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:11 smithi122 ceph-mon[125440]: osdmap e790: 12 total, 12 up, 12 in 2023-03-02T16:56:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:11 smithi122 ceph-mon[125440]: pgmap v11478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:56:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:11.460+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:11.460+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:11.460+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 167 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:56:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:11.460+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 168 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:56:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:11 smithi136 ceph-mon[125702]: osdmap e790: 12 total, 12 up, 12 in 2023-03-02T16:56:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:11 smithi136 ceph-mon[125702]: pgmap v11478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T16:56:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:13 smithi057 ceph-mon[92072]: pgmap v11479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T16:56:14.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:13 smithi122 ceph-mon[125440]: pgmap v11479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T16:56:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:13 smithi136 ceph-mon[125702]: pgmap v11479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T16:56:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:15 smithi057 ceph-mon[92072]: pgmap v11480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 234 B/s wr, 12 op/s 2023-03-02T16:56:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:15 smithi122 ceph-mon[125440]: pgmap v11480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 234 B/s wr, 12 op/s 2023-03-02T16:56:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:15 smithi136 ceph-mon[125702]: pgmap v11480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 234 B/s wr, 12 op/s 2023-03-02T16:56:18.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:17 smithi057 ceph-mon[92072]: pgmap v11481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:56:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:17 smithi122 ceph-mon[125440]: pgmap v11481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:56:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:17 smithi136 ceph-mon[125702]: pgmap v11481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:56:20.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:19 smithi057 ceph-mon[92072]: pgmap v11482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:56:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:19 smithi122 ceph-mon[125440]: pgmap v11482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:56:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:19 smithi136 ceph-mon[125702]: pgmap v11482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:56:20.455 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:20.455+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:56:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:20.456+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:56:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:20.456+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:56:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:20.456+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:56:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:20.456+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:56:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:21 smithi057 ceph-mon[92072]: pgmap v11483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:56:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:21 smithi122 ceph-mon[125440]: pgmap v11483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:56:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:21 smithi136 ceph-mon[125702]: pgmap v11483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T16:56:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:23 smithi057 ceph-mon[92072]: pgmap v11484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:56:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:23 smithi122 ceph-mon[125440]: pgmap v11484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:56:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:23 smithi136 ceph-mon[125702]: pgmap v11484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T16:56:26.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:25 smithi057 ceph-mon[92072]: pgmap v11485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:25 smithi122 ceph-mon[125440]: pgmap v11485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:25 smithi136 ceph-mon[125702]: pgmap v11485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:28.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:27 smithi057 ceph-mon[92072]: pgmap v11486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:27 smithi122 ceph-mon[125440]: pgmap v11486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:27 smithi136 ceph-mon[125702]: pgmap v11486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:29 smithi057 ceph-mon[92072]: pgmap v11487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:29 smithi122 ceph-mon[125440]: pgmap v11487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:29 smithi136 ceph-mon[125702]: pgmap v11487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:31 smithi057 ceph-mon[92072]: pgmap v11488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:31 smithi122 ceph-mon[125440]: pgmap v11488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:31 smithi136 ceph-mon[125702]: pgmap v11488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:34.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:33 smithi057 ceph-mon[92072]: pgmap v11489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:33 smithi122 ceph-mon[125440]: pgmap v11489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:33 smithi136 ceph-mon[125702]: pgmap v11489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:56:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:56:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:56:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:56:35.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:56:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:56:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:56:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:56:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:56:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:56:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:56:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:56:35.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:35.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:56:35.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:35.465+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:56:35.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:35.465+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:56:35.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:35.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:56:35.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:35.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:56:36.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:35 smithi057 ceph-mon[92072]: pgmap v11490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:35 smithi122 ceph-mon[125440]: pgmap v11490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:35 smithi136 ceph-mon[125702]: pgmap v11490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:37 smithi057 ceph-mon[92072]: pgmap v11491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:37 smithi122 ceph-mon[125440]: pgmap v11491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:37 smithi136 ceph-mon[125702]: pgmap v11491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:39 smithi057 ceph-mon[92072]: pgmap v11492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:39 smithi122 ceph-mon[125440]: pgmap v11492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:39 smithi136 ceph-mon[125702]: pgmap v11492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:41 smithi057 ceph-mon[92072]: pgmap v11493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:41 smithi122 ceph-mon[125440]: pgmap v11493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:41 smithi136 ceph-mon[125702]: pgmap v11493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:43 smithi057 ceph-mon[92072]: pgmap v11494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:43 smithi122 ceph-mon[125440]: pgmap v11494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:43 smithi136 ceph-mon[125702]: pgmap v11494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:45 smithi057 ceph-mon[92072]: pgmap v11495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:45 smithi122 ceph-mon[125440]: pgmap v11495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:45 smithi136 ceph-mon[125702]: pgmap v11495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:47 smithi057 ceph-mon[92072]: pgmap v11496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:47 smithi122 ceph-mon[125440]: pgmap v11496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:47 smithi136 ceph-mon[125702]: pgmap v11496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:49 smithi057 ceph-mon[92072]: pgmap v11497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:49 smithi122 ceph-mon[125440]: pgmap v11497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:49 smithi136 ceph-mon[125702]: pgmap v11497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:50.480+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:56:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:50.480+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:56:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:50.480+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:56:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:50.480+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:56:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:56:50.480+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:56:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:51 smithi057 ceph-mon[92072]: pgmap v11498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:51 smithi122 ceph-mon[125440]: pgmap v11498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:51 smithi136 ceph-mon[125702]: pgmap v11498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:53 smithi057 ceph-mon[92072]: pgmap v11499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:53 smithi122 ceph-mon[125440]: pgmap v11499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:53 smithi136 ceph-mon[125702]: pgmap v11499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:55 smithi057 ceph-mon[92072]: pgmap v11500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:55 smithi122 ceph-mon[125440]: pgmap v11500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:55 smithi136 ceph-mon[125702]: pgmap v11500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:56:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:57 smithi057 ceph-mon[92072]: pgmap v11501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:57 smithi122 ceph-mon[125440]: pgmap v11501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:56:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:57 smithi136 ceph-mon[125702]: pgmap v11501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:56:59 smithi057 ceph-mon[92072]: pgmap v11502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:56:59 smithi122 ceph-mon[125440]: pgmap v11502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:56:59 smithi136 ceph-mon[125702]: pgmap v11502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:01 smithi057 ceph-mon[92072]: pgmap v11503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:01 smithi122 ceph-mon[125440]: pgmap v11503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:01 smithi136 ceph-mon[125702]: pgmap v11503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:03 smithi057 ceph-mon[92072]: pgmap v11504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:57:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:03 smithi122 ceph-mon[125440]: pgmap v11504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:57:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:03 smithi136 ceph-mon[125702]: pgmap v11504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:57:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:05.494+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:57:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:05.494+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:57:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:05.495+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:57:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:05.495+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:57:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:05.495+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:57:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:05 smithi057 ceph-mon[92072]: pgmap v11505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:57:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:05 smithi122 ceph-mon[125440]: pgmap v11505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:57:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:05 smithi136 ceph-mon[125702]: pgmap v11505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:57:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:07 smithi057 ceph-mon[92072]: pgmap v11506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:57:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:07 smithi122 ceph-mon[125440]: pgmap v11506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:57:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:07 smithi136 ceph-mon[125702]: pgmap v11506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:57:10.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:09 smithi057 ceph-mon[92072]: pgmap v11507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:57:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:09 smithi122 ceph-mon[125440]: pgmap v11507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:57:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:09 smithi136 ceph-mon[125702]: pgmap v11507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:57:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:11 smithi057 ceph-mon[92072]: pgmap v11508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:57:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:11 smithi122 ceph-mon[125440]: pgmap v11508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:57:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:11 smithi136 ceph-mon[125702]: pgmap v11508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:57:12.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:12 smithi057 ceph-mon[92072]: osdmap e791: 12 total, 12 up, 12 in 2023-03-02T16:57:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:12 smithi122 ceph-mon[125440]: osdmap e791: 12 total, 12 up, 12 in 2023-03-02T16:57:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:12 smithi136 ceph-mon[125702]: osdmap e791: 12 total, 12 up, 12 in 2023-03-02T16:57:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:13 smithi057 ceph-mon[92072]: pgmap v11510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:13 smithi122 ceph-mon[125440]: pgmap v11510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:13 smithi136 ceph-mon[125702]: pgmap v11510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:15 smithi057 ceph-mon[92072]: pgmap v11511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:15 smithi057 ceph-mon[92072]: osdmap e792: 12 total, 12 up, 12 in 2023-03-02T16:57:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:15 smithi122 ceph-mon[125440]: pgmap v11511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:15 smithi122 ceph-mon[125440]: osdmap e792: 12 total, 12 up, 12 in 2023-03-02T16:57:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:15 smithi136 ceph-mon[125702]: pgmap v11511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:15 smithi136 ceph-mon[125702]: osdmap e792: 12 total, 12 up, 12 in 2023-03-02T16:57:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:17 smithi057 ceph-mon[92072]: pgmap v11513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T16:57:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:17 smithi122 ceph-mon[125440]: pgmap v11513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T16:57:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:17 smithi136 ceph-mon[125702]: pgmap v11513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T16:57:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:19 smithi057 ceph-mon[92072]: pgmap v11514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T16:57:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:19 smithi122 ceph-mon[125440]: pgmap v11514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T16:57:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:19 smithi136 ceph-mon[125702]: pgmap v11514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T16:57:20.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:20.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:57:20.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:20.507+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:57:20.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:20.507+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:57:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:20.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:57:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:20.507+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:57:21.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:21 smithi057 ceph-mon[92072]: pgmap v11515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T16:57:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:21 smithi122 ceph-mon[125440]: pgmap v11515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T16:57:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:21 smithi136 ceph-mon[125702]: pgmap v11515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T16:57:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:23 smithi057 ceph-mon[92072]: pgmap v11516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:23 smithi122 ceph-mon[125440]: pgmap v11516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:23 smithi136 ceph-mon[125702]: pgmap v11516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:25 smithi057 ceph-mon[92072]: pgmap v11517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:25 smithi122 ceph-mon[125440]: pgmap v11517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:25 smithi136 ceph-mon[125702]: pgmap v11517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:57:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:27 smithi057 ceph-mon[92072]: pgmap v11518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 174 B/s wr, 13 op/s 2023-03-02T16:57:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:27 smithi122 ceph-mon[125440]: pgmap v11518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 174 B/s wr, 13 op/s 2023-03-02T16:57:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:27 smithi136 ceph-mon[125702]: pgmap v11518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 174 B/s wr, 13 op/s 2023-03-02T16:57:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:29 smithi057 ceph-mon[92072]: pgmap v11519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:29 smithi122 ceph-mon[125440]: pgmap v11519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:29 smithi136 ceph-mon[125702]: pgmap v11519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:31 smithi057 ceph-mon[92072]: pgmap v11520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:31 smithi122 ceph-mon[125440]: pgmap v11520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:31 smithi136 ceph-mon[125702]: pgmap v11520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:33 smithi057 ceph-mon[92072]: pgmap v11521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:33 smithi122 ceph-mon[125440]: pgmap v11521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:33 smithi136 ceph-mon[125702]: pgmap v11521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:35.521+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:57:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:35.522+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:57:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:35.522+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:57:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:35.522+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:57:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:35.522+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:57:36.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:35 smithi057 ceph-mon[92072]: pgmap v11522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:57:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:35 smithi122 ceph-mon[125440]: pgmap v11522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:57:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:35 smithi136 ceph-mon[125702]: pgmap v11522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:57:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:37 smithi057 ceph-mon[92072]: pgmap v11523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:37 smithi122 ceph-mon[125440]: pgmap v11523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:37 smithi136 ceph-mon[125702]: pgmap v11523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:57:39.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:57:39.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:57:39.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:57:39.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T16:57:39.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:57:39.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:57:39.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:57:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:40 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:57:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:40 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:57:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:40 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:57:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:40 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:57:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:40 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 57187k 2023-03-02T16:57:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:40 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 58559762: error parsing value: Value '58559762' is below minimum 939524096 2023-03-02T16:57:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:40 smithi136 ceph-mon[125702]: pgmap v11524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:40 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:57:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:40 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:57:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:40 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:57:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:40 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:57:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:40 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 57187k 2023-03-02T16:57:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:40 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 58559762: error parsing value: Value '58559762' is below minimum 939524096 2023-03-02T16:57:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:40 smithi057 ceph-mon[92072]: pgmap v11524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:40.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:40 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T16:57:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:40 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T16:57:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:40 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T16:57:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:40 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T16:57:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:40 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 57187k 2023-03-02T16:57:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:40 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 58559762: error parsing value: Value '58559762' is below minimum 939524096 2023-03-02T16:57:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:40 smithi122 ceph-mon[125440]: pgmap v11524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:41 smithi057 ceph-mon[92072]: pgmap v11525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:41 smithi122 ceph-mon[125440]: pgmap v11525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:41 smithi136 ceph-mon[125702]: pgmap v11525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:43 smithi057 ceph-mon[92072]: pgmap v11526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:43 smithi122 ceph-mon[125440]: pgmap v11526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:43 smithi136 ceph-mon[125702]: pgmap v11526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:45 smithi057 ceph-mon[92072]: pgmap v11527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:46.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:45 smithi122 ceph-mon[125440]: pgmap v11527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:45 smithi136 ceph-mon[125702]: pgmap v11527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:47 smithi057 ceph-mon[92072]: pgmap v11528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:47 smithi122 ceph-mon[125440]: pgmap v11528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:47 smithi136 ceph-mon[125702]: pgmap v11528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:49 smithi057 ceph-mon[92072]: pgmap v11529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:50.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:49 smithi122 ceph-mon[125440]: pgmap v11529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:49 smithi136 ceph-mon[125702]: pgmap v11529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:50.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:57:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:50.531+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:57:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:50.531+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:57:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:50.531+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:57:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:57:50.531+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:57:51.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:51 smithi057 ceph-mon[92072]: pgmap v11530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:51 smithi122 ceph-mon[125440]: pgmap v11530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:51 smithi136 ceph-mon[125702]: pgmap v11530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:54.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:53 smithi057 ceph-mon[92072]: pgmap v11531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:53 smithi122 ceph-mon[125440]: pgmap v11531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:53 smithi136 ceph-mon[125702]: pgmap v11531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:55 smithi057 ceph-mon[92072]: pgmap v11532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:55 smithi122 ceph-mon[125440]: pgmap v11532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:55 smithi136 ceph-mon[125702]: pgmap v11532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:57:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:57 smithi057 ceph-mon[92072]: pgmap v11533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:57 smithi122 ceph-mon[125440]: pgmap v11533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:57:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:57 smithi136 ceph-mon[125702]: pgmap v11533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:57:59 smithi057 ceph-mon[92072]: pgmap v11534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:00.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:57:59 smithi122 ceph-mon[125440]: pgmap v11534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:57:59 smithi136 ceph-mon[125702]: pgmap v11534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:01 smithi057 ceph-mon[92072]: pgmap v11535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:01 smithi122 ceph-mon[125440]: pgmap v11535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:01 smithi136 ceph-mon[125702]: pgmap v11535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:03 smithi057 ceph-mon[92072]: pgmap v11536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:58:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:03 smithi122 ceph-mon[125440]: pgmap v11536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:58:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:03 smithi136 ceph-mon[125702]: pgmap v11536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:58:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:05.540+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:58:05.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:05.540+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:58:05.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:05.540+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:58:05.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:05.540+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:58:05.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:05.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:58:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:05 smithi057 ceph-mon[92072]: pgmap v11537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:58:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:05 smithi122 ceph-mon[125440]: pgmap v11537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:58:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:05 smithi136 ceph-mon[125702]: pgmap v11537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:58:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:07 smithi057 ceph-mon[92072]: pgmap v11538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:58:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:07 smithi122 ceph-mon[125440]: pgmap v11538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:58:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:07 smithi136 ceph-mon[125702]: pgmap v11538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:58:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:09 smithi057 ceph-mon[92072]: pgmap v11539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:58:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:09 smithi122 ceph-mon[125440]: pgmap v11539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:58:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:09 smithi136 ceph-mon[125702]: pgmap v11539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:58:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:11 smithi057 ceph-mon[92072]: pgmap v11540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:58:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:11 smithi122 ceph-mon[125440]: pgmap v11540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:58:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:11 smithi136 ceph-mon[125702]: pgmap v11540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:58:12.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:12 smithi057 ceph-mon[92072]: osdmap e793: 12 total, 12 up, 12 in 2023-03-02T16:58:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:12 smithi122 ceph-mon[125440]: osdmap e793: 12 total, 12 up, 12 in 2023-03-02T16:58:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:12 smithi136 ceph-mon[125702]: osdmap e793: 12 total, 12 up, 12 in 2023-03-02T16:58:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:13 smithi057 ceph-mon[92072]: pgmap v11542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:58:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:13 smithi122 ceph-mon[125440]: pgmap v11542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:58:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:13 smithi136 ceph-mon[125702]: pgmap v11542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:58:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:15 smithi057 ceph-mon[92072]: pgmap v11543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:58:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:15 smithi057 ceph-mon[92072]: osdmap e794: 12 total, 12 up, 12 in 2023-03-02T16:58:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:15 smithi122 ceph-mon[125440]: pgmap v11543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:58:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:15 smithi122 ceph-mon[125440]: osdmap e794: 12 total, 12 up, 12 in 2023-03-02T16:58:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:15 smithi136 ceph-mon[125702]: pgmap v11543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:58:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:15 smithi136 ceph-mon[125702]: osdmap e794: 12 total, 12 up, 12 in 2023-03-02T16:58:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:17 smithi057 ceph-mon[92072]: pgmap v11545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:58:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:17 smithi122 ceph-mon[125440]: pgmap v11545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:58:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:17 smithi136 ceph-mon[125702]: pgmap v11545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:58:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:19 smithi057 ceph-mon[92072]: pgmap v11546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:58:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:19 smithi122 ceph-mon[125440]: pgmap v11546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:58:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:19 smithi136 ceph-mon[125702]: pgmap v11546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:58:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:20.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:58:20.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:20.556+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:58:20.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:20.556+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:58:20.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:20.556+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:58:20.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:20.556+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:58:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:21 smithi057 ceph-mon[92072]: pgmap v11547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:58:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:21 smithi122 ceph-mon[125440]: pgmap v11547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:58:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:21 smithi136 ceph-mon[125702]: pgmap v11547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:58:24.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:23 smithi057 ceph-mon[92072]: pgmap v11548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:58:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:23 smithi122 ceph-mon[125440]: pgmap v11548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:58:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:23 smithi136 ceph-mon[125702]: pgmap v11548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:58:26.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:25 smithi057 ceph-mon[92072]: pgmap v11549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:58:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:25 smithi122 ceph-mon[125440]: pgmap v11549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:58:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:25 smithi136 ceph-mon[125702]: pgmap v11549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:58:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:27 smithi122 ceph-mon[125440]: pgmap v11550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 87 B/s wr, 12 op/s 2023-03-02T16:58:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:27 smithi136 ceph-mon[125702]: pgmap v11550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 87 B/s wr, 12 op/s 2023-03-02T16:58:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:27 smithi057 ceph-mon[92072]: pgmap v11550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 87 B/s wr, 12 op/s 2023-03-02T16:58:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:29 smithi122 ceph-mon[125440]: pgmap v11551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:29 smithi136 ceph-mon[125702]: pgmap v11551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:29 smithi057 ceph-mon[92072]: pgmap v11551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:31 smithi057 ceph-mon[92072]: pgmap v11552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:31 smithi122 ceph-mon[125440]: pgmap v11552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:31 smithi136 ceph-mon[125702]: pgmap v11552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:33 smithi057 ceph-mon[92072]: pgmap v11553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:33 smithi122 ceph-mon[125440]: pgmap v11553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:33 smithi136 ceph-mon[125702]: pgmap v11553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:35.557+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:58:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:35.558+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:58:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:35.558+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:58:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:35.558+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:58:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:35.558+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:58:36.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:35 smithi057 ceph-mon[92072]: pgmap v11554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:35 smithi122 ceph-mon[125440]: pgmap v11554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:35 smithi136 ceph-mon[125702]: pgmap v11554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:37 smithi057 ceph-mon[92072]: pgmap v11555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:37 smithi122 ceph-mon[125440]: pgmap v11555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:37 smithi136 ceph-mon[125702]: pgmap v11555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:39.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:58:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:58:39.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:58:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:39 smithi122 ceph-mon[125440]: pgmap v11556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:58:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:58:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:58:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:39 smithi136 ceph-mon[125702]: pgmap v11556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:58:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:58:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:58:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:39 smithi057 ceph-mon[92072]: pgmap v11556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:58:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:58:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:58:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:41 smithi057 ceph-mon[92072]: pgmap v11557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:41 smithi122 ceph-mon[125440]: pgmap v11557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:41 smithi136 ceph-mon[125702]: pgmap v11557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:43 smithi057 ceph-mon[92072]: pgmap v11558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:43 smithi122 ceph-mon[125440]: pgmap v11558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:43 smithi136 ceph-mon[125702]: pgmap v11558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:45 smithi122 ceph-mon[125440]: pgmap v11559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:45 smithi136 ceph-mon[125702]: pgmap v11559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:45 smithi057 ceph-mon[92072]: pgmap v11559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:48.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:47 smithi122 ceph-mon[125440]: pgmap v11560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:47 smithi136 ceph-mon[125702]: pgmap v11560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:48.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:47 smithi057 ceph-mon[92072]: pgmap v11560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:49 smithi122 ceph-mon[125440]: pgmap v11561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:49 smithi136 ceph-mon[125702]: pgmap v11561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:49 smithi057 ceph-mon[92072]: pgmap v11561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:50.573+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:58:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:50.574+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:58:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:50.574+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:58:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:50.574+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:58:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:58:50.574+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:58:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:51 smithi057 ceph-mon[92072]: pgmap v11562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:51 smithi122 ceph-mon[125440]: pgmap v11562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:51 smithi136 ceph-mon[125702]: pgmap v11562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:54.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:53 smithi057 ceph-mon[92072]: pgmap v11563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:53 smithi122 ceph-mon[125440]: pgmap v11563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:53 smithi136 ceph-mon[125702]: pgmap v11563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:56.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:55 smithi122 ceph-mon[125440]: pgmap v11564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:55 smithi136 ceph-mon[125702]: pgmap v11564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:55 smithi057 ceph-mon[92072]: pgmap v11564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:58:58.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:57 smithi122 ceph-mon[125440]: pgmap v11565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:57 smithi136 ceph-mon[125702]: pgmap v11565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:58:58.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:57 smithi057 ceph-mon[92072]: pgmap v11565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:58:59 smithi122 ceph-mon[125440]: pgmap v11566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:58:59 smithi136 ceph-mon[125702]: pgmap v11566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:58:59 smithi057 ceph-mon[92072]: pgmap v11566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:01.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:01 smithi057 ceph-mon[92072]: pgmap v11567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:01 smithi122 ceph-mon[125440]: pgmap v11567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:01 smithi136 ceph-mon[125702]: pgmap v11567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:04.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:03 smithi122 ceph-mon[125440]: pgmap v11568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:59:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:03 smithi136 ceph-mon[125702]: pgmap v11568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:59:04.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:03 smithi057 ceph-mon[92072]: pgmap v11568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:59:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:05.581+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:59:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:05.582+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:59:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:05.582+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:59:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:05.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:59:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:05.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:59:06.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:05 smithi122 ceph-mon[125440]: pgmap v11569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:59:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:05 smithi136 ceph-mon[125702]: pgmap v11569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:59:06.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:05 smithi057 ceph-mon[92072]: pgmap v11569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T16:59:08.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:07 smithi122 ceph-mon[125440]: pgmap v11570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:59:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:07 smithi136 ceph-mon[125702]: pgmap v11570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:59:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:08.414+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T16:59:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:08.414+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T16:59:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:08.414+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5870029040 tx=0x7f587008e000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:59:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:08.414+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5870029040 tx=0x7f587008e000 comp rx=0 tx=0).stop 2023-03-02T16:59:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:08.414+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T16:59:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:08.414+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T16:59:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:08.414+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T16:59:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:08.414+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T16:59:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:08.414+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:59:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:08.415+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5870019fd0 tx=0x7f5870056000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T16:59:08.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:07 smithi057 ceph-mon[92072]: pgmap v11570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T16:59:10.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:09 smithi122 ceph-mon[125440]: pgmap v11571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:59:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:09 smithi136 ceph-mon[125702]: pgmap v11571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:59:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:09 smithi057 ceph-mon[92072]: pgmap v11571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:59:11.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:11 smithi057 ceph-mon[92072]: pgmap v11572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:59:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:11 smithi122 ceph-mon[125440]: pgmap v11572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:59:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:11.487+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:59:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:11.487+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:59:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:11.488+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 169 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T16:59:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:11.488+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 168 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T16:59:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:11 smithi136 ceph-mon[125702]: pgmap v11572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T16:59:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:12 smithi057 ceph-mon[92072]: osdmap e795: 12 total, 12 up, 12 in 2023-03-02T16:59:12.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:12 smithi122 ceph-mon[125440]: osdmap e795: 12 total, 12 up, 12 in 2023-03-02T16:59:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:12 smithi136 ceph-mon[125702]: osdmap e795: 12 total, 12 up, 12 in 2023-03-02T16:59:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:13 smithi057 ceph-mon[92072]: pgmap v11574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:59:13.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:13 smithi122 ceph-mon[125440]: pgmap v11574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:59:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:13 smithi136 ceph-mon[125702]: pgmap v11574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:59:16.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:15 smithi122 ceph-mon[125440]: pgmap v11575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:59:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:15 smithi122 ceph-mon[125440]: osdmap e796: 12 total, 12 up, 12 in 2023-03-02T16:59:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:15 smithi136 ceph-mon[125702]: pgmap v11575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:59:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:15 smithi136 ceph-mon[125702]: osdmap e796: 12 total, 12 up, 12 in 2023-03-02T16:59:16.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:15 smithi057 ceph-mon[92072]: pgmap v11575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T16:59:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:15 smithi057 ceph-mon[92072]: osdmap e796: 12 total, 12 up, 12 in 2023-03-02T16:59:18.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:17 smithi122 ceph-mon[125440]: pgmap v11577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:59:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:17 smithi136 ceph-mon[125702]: pgmap v11577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:59:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:17 smithi057 ceph-mon[92072]: pgmap v11577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:59:20.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:19 smithi122 ceph-mon[125440]: pgmap v11578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:59:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:19 smithi136 ceph-mon[125702]: pgmap v11578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:59:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:19 smithi057 ceph-mon[92072]: pgmap v11578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T16:59:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:20.597+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:59:20.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:20.597+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:59:20.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:20.597+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:59:20.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:20.597+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:59:20.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:20.597+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:59:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:21 smithi057 ceph-mon[92072]: pgmap v11579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:59:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:21 smithi122 ceph-mon[125440]: pgmap v11579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:59:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:21 smithi136 ceph-mon[125702]: pgmap v11579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T16:59:24.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:23 smithi122 ceph-mon[125440]: pgmap v11580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:59:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:23 smithi136 ceph-mon[125702]: pgmap v11580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:59:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:23 smithi057 ceph-mon[92072]: pgmap v11580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:59:26.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:25 smithi122 ceph-mon[125440]: pgmap v11581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:59:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:25 smithi136 ceph-mon[125702]: pgmap v11581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:59:26.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:25 smithi057 ceph-mon[92072]: pgmap v11581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T16:59:28.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:27 smithi122 ceph-mon[125440]: pgmap v11582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 87 B/s wr, 12 op/s 2023-03-02T16:59:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:27 smithi136 ceph-mon[125702]: pgmap v11582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 87 B/s wr, 12 op/s 2023-03-02T16:59:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:27 smithi057 ceph-mon[92072]: pgmap v11582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 87 B/s wr, 12 op/s 2023-03-02T16:59:30.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:29 smithi122 ceph-mon[125440]: pgmap v11583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:29 smithi136 ceph-mon[125702]: pgmap v11583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:29 smithi057 ceph-mon[92072]: pgmap v11583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:31 smithi057 ceph-mon[92072]: pgmap v11584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:31 smithi122 ceph-mon[125440]: pgmap v11584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:31 smithi136 ceph-mon[125702]: pgmap v11584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:34.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:33 smithi122 ceph-mon[125440]: pgmap v11585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:33 smithi136 ceph-mon[125702]: pgmap v11585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:33 smithi057 ceph-mon[92072]: pgmap v11585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:35.606+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:59:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:35.606+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:59:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:35.606+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:59:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:35.606+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:59:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:35.606+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:59:36.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:35 smithi122 ceph-mon[125440]: pgmap v11586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:35 smithi136 ceph-mon[125702]: pgmap v11586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:36.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:35 smithi057 ceph-mon[92072]: pgmap v11586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:38.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:37 smithi122 ceph-mon[125440]: pgmap v11587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:37 smithi136 ceph-mon[125702]: pgmap v11587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:38.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:37 smithi057 ceph-mon[92072]: pgmap v11587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:40.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:39 smithi122 ceph-mon[125440]: pgmap v11588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:59:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:39 smithi136 ceph-mon[125702]: pgmap v11588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:59:40.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:39 smithi057 ceph-mon[92072]: pgmap v11588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T16:59:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:59:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:59:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:41 smithi057 ceph-mon[92072]: pgmap v11589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:59:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:59:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:59:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:59:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:59:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:41 smithi122 ceph-mon[125440]: pgmap v11589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:59:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:59:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:59:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:59:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:59:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:41 smithi136 ceph-mon[125702]: pgmap v11589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T16:59:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T16:59:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T16:59:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:43 smithi122 ceph-mon[125440]: pgmap v11590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:43 smithi136 ceph-mon[125702]: pgmap v11590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:44.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:43 smithi057 ceph-mon[92072]: pgmap v11590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:45 smithi136 ceph-mon[125702]: pgmap v11591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:46.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:45 smithi057 ceph-mon[92072]: pgmap v11591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:46.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:45 smithi122 ceph-mon[125440]: pgmap v11591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:47 smithi136 ceph-mon[125702]: pgmap v11592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:47 smithi057 ceph-mon[92072]: pgmap v11592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:48.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:47 smithi122 ceph-mon[125440]: pgmap v11592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:49 smithi136 ceph-mon[125702]: pgmap v11593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:49 smithi057 ceph-mon[92072]: pgmap v11593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:50.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:49 smithi122 ceph-mon[125440]: pgmap v11593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:50.619+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T16:59:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:50.620+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T16:59:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:50.620+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T16:59:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:50.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T16:59:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T16:59:50.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T16:59:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:51 smithi057 ceph-mon[92072]: pgmap v11594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:51 smithi122 ceph-mon[125440]: pgmap v11594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:51 smithi136 ceph-mon[125702]: pgmap v11594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:54.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:53 smithi122 ceph-mon[125440]: pgmap v11595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:53 smithi136 ceph-mon[125702]: pgmap v11595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:53 smithi057 ceph-mon[92072]: pgmap v11595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:55 smithi136 ceph-mon[125702]: pgmap v11596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:55 smithi057 ceph-mon[92072]: pgmap v11596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:56.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:55 smithi122 ceph-mon[125440]: pgmap v11596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T16:59:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:57 smithi136 ceph-mon[125702]: pgmap v11597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:57 smithi057 ceph-mon[92072]: pgmap v11597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T16:59:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:57 smithi122 ceph-mon[125440]: pgmap v11597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 16:59:59 smithi136 ceph-mon[125702]: pgmap v11598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:00.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 16:59:59 smithi057 ceph-mon[92072]: pgmap v11598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 16:59:59 smithi122 ceph-mon[125440]: pgmap v11598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T17:00:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T17:00:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T17:00:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:01 smithi136 ceph-mon[125702]: pgmap v11599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:02.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:01 smithi057 ceph-mon[92072]: pgmap v11599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:02.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:01 smithi122 ceph-mon[125440]: pgmap v11599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:03 smithi136 ceph-mon[125702]: pgmap v11600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:00:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:03 smithi057 ceph-mon[92072]: pgmap v11600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:00:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:03 smithi122 ceph-mon[125440]: pgmap v11600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:00:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:05.635+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:00:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:05.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:00:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:05.636+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:00:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:05.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:00:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:05.636+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:00:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:05 smithi136 ceph-mon[125702]: pgmap v11601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:00:06.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:05 smithi057 ceph-mon[92072]: pgmap v11601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:00:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:05 smithi122 ceph-mon[125440]: pgmap v11601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:00:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:07 smithi057 ceph-mon[92072]: osdmap e797: 12 total, 12 up, 12 in 2023-03-02T17:00:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:07 smithi057 ceph-mon[92072]: pgmap v11603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:00:07.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:07 smithi122 ceph-mon[125440]: osdmap e797: 12 total, 12 up, 12 in 2023-03-02T17:00:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:07 smithi122 ceph-mon[125440]: pgmap v11603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:00:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:07 smithi136 ceph-mon[125702]: osdmap e797: 12 total, 12 up, 12 in 2023-03-02T17:00:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:07 smithi136 ceph-mon[125702]: pgmap v11603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:00:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:09 smithi136 ceph-mon[125702]: pgmap v11604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:00:10.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:09 smithi057 ceph-mon[92072]: pgmap v11604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:00:10.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:09 smithi122 ceph-mon[125440]: pgmap v11604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:00:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:11 smithi057 ceph-mon[92072]: osdmap e798: 12 total, 12 up, 12 in 2023-03-02T17:00:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:11 smithi057 ceph-mon[92072]: pgmap v11606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:00:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:11 smithi122 ceph-mon[125440]: osdmap e798: 12 total, 12 up, 12 in 2023-03-02T17:00:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:11 smithi122 ceph-mon[125440]: pgmap v11606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:00:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:11 smithi136 ceph-mon[125702]: osdmap e798: 12 total, 12 up, 12 in 2023-03-02T17:00:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:11 smithi136 ceph-mon[125702]: pgmap v11606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:00:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:13 smithi136 ceph-mon[125702]: pgmap v11607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:00:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:13 smithi057 ceph-mon[92072]: pgmap v11607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:00:14.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:13 smithi122 ceph-mon[125440]: pgmap v11607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:00:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:15 smithi136 ceph-mon[125702]: pgmap v11608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:00:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:15 smithi057 ceph-mon[92072]: pgmap v11608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:00:16.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:15 smithi122 ceph-mon[125440]: pgmap v11608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:00:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:17 smithi136 ceph-mon[125702]: pgmap v11609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:00:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:17 smithi057 ceph-mon[92072]: pgmap v11609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:00:18.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:17 smithi122 ceph-mon[125440]: pgmap v11609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:00:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:19 smithi136 ceph-mon[125702]: pgmap v11610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:00:20.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:19 smithi057 ceph-mon[92072]: pgmap v11610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:00:20.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:19 smithi122 ceph-mon[125440]: pgmap v11610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:00:20.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:20.637+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:00:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:20.638+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:00:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:20.638+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:00:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:20.638+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:00:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:20.638+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:00:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:21 smithi057 ceph-mon[92072]: pgmap v11611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:00:21.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:21 smithi122 ceph-mon[125440]: pgmap v11611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:00:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:21 smithi136 ceph-mon[125702]: pgmap v11611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:00:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:23 smithi136 ceph-mon[125702]: pgmap v11612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:00:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:23 smithi057 ceph-mon[92072]: pgmap v11612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:00:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:23 smithi122 ceph-mon[125440]: pgmap v11612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:00:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:25 smithi136 ceph-mon[125702]: pgmap v11613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:25 smithi057 ceph-mon[92072]: pgmap v11613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:25 smithi122 ceph-mon[125440]: pgmap v11613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:27 smithi136 ceph-mon[125702]: pgmap v11614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:28.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:27 smithi057 ceph-mon[92072]: pgmap v11614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:28.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:27 smithi122 ceph-mon[125440]: pgmap v11614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:29 smithi136 ceph-mon[125702]: pgmap v11615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:29 smithi057 ceph-mon[92072]: pgmap v11615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:30.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:29 smithi122 ceph-mon[125440]: pgmap v11615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:31.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:31 smithi057 ceph-mon[92072]: pgmap v11616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:31 smithi122 ceph-mon[125440]: pgmap v11616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:31 smithi136 ceph-mon[125702]: pgmap v11616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:33 smithi136 ceph-mon[125702]: pgmap v11617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:34.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:33 smithi057 ceph-mon[92072]: pgmap v11617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:34.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:33 smithi122 ceph-mon[125440]: pgmap v11617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:35.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:00:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:35.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:00:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:35.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:00:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:35.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:00:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:35.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:00:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:35 smithi136 ceph-mon[125702]: pgmap v11618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:35 smithi057 ceph-mon[92072]: pgmap v11618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:36.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:35 smithi122 ceph-mon[125440]: pgmap v11618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:37 smithi136 ceph-mon[125702]: pgmap v11619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:37 smithi057 ceph-mon[92072]: pgmap v11619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:37 smithi122 ceph-mon[125440]: pgmap v11619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:39 smithi136 ceph-mon[125702]: pgmap v11620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:40.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:39 smithi057 ceph-mon[92072]: pgmap v11620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:40.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:39 smithi122 ceph-mon[125440]: pgmap v11620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:41.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:41 smithi057 ceph-mon[92072]: pgmap v11621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:41 smithi122 ceph-mon[125440]: pgmap v11621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:41 smithi136 ceph-mon[125702]: pgmap v11621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:42.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:00:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:42.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:00:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:00:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:43.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:00:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:00:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:43 smithi122 ceph-mon[125440]: pgmap v11622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:00:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:00:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:43 smithi136 ceph-mon[125702]: pgmap v11622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:00:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:00:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:00:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:43 smithi057 ceph-mon[92072]: pgmap v11622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:45 smithi136 ceph-mon[125702]: pgmap v11623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:45 smithi057 ceph-mon[92072]: pgmap v11623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:46.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:45 smithi122 ceph-mon[125440]: pgmap v11623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:47 smithi136 ceph-mon[125702]: pgmap v11624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:48.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:47 smithi057 ceph-mon[92072]: pgmap v11624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:48.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:47 smithi122 ceph-mon[125440]: pgmap v11624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:49 smithi136 ceph-mon[125702]: pgmap v11625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:49 smithi057 ceph-mon[92072]: pgmap v11625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:50.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:49 smithi122 ceph-mon[125440]: pgmap v11625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:50.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:00:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:50.662+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:00:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:50.662+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:00:50.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:50.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:00:50.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:00:50.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:00:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:51 smithi122 ceph-mon[125440]: pgmap v11626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:51 smithi136 ceph-mon[125702]: pgmap v11626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:51 smithi057 ceph-mon[92072]: pgmap v11626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:53 smithi136 ceph-mon[125702]: pgmap v11627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:53 smithi057 ceph-mon[92072]: pgmap v11627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:54.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:53 smithi122 ceph-mon[125440]: pgmap v11627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:55 smithi136 ceph-mon[125702]: pgmap v11628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:55 smithi057 ceph-mon[92072]: pgmap v11628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:56.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:55 smithi122 ceph-mon[125440]: pgmap v11628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:00:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:57 smithi136 ceph-mon[125702]: pgmap v11629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:58.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:57 smithi057 ceph-mon[92072]: pgmap v11629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:00:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:57 smithi122 ceph-mon[125440]: pgmap v11629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:00:59 smithi136 ceph-mon[125702]: pgmap v11630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:00.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:00:59 smithi057 ceph-mon[92072]: pgmap v11630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:00:59 smithi122 ceph-mon[125440]: pgmap v11630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:01.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:01 smithi122 ceph-mon[125440]: pgmap v11631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:01 smithi136 ceph-mon[125702]: pgmap v11631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:01 smithi057 ceph-mon[92072]: pgmap v11631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:03 smithi136 ceph-mon[125702]: pgmap v11632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:01:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:03 smithi057 ceph-mon[92072]: pgmap v11632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:01:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:03 smithi122 ceph-mon[125440]: pgmap v11632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:01:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:05.673+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:01:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:05.674+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:01:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:05.674+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:01:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:05.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:01:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:05.674+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:01:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:05 smithi136 ceph-mon[125702]: pgmap v11633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:01:06.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:05 smithi057 ceph-mon[92072]: pgmap v11633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:01:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:05 smithi122 ceph-mon[125440]: pgmap v11633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:01:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:07 smithi122 ceph-mon[125440]: osdmap e799: 12 total, 12 up, 12 in 2023-03-02T17:01:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:07 smithi122 ceph-mon[125440]: pgmap v11635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:01:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:07 smithi136 ceph-mon[125702]: osdmap e799: 12 total, 12 up, 12 in 2023-03-02T17:01:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:07 smithi136 ceph-mon[125702]: pgmap v11635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:01:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:07 smithi057 ceph-mon[92072]: osdmap e799: 12 total, 12 up, 12 in 2023-03-02T17:01:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:07 smithi057 ceph-mon[92072]: pgmap v11635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:01:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:09 smithi136 ceph-mon[125702]: pgmap v11636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:01:10.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:09 smithi057 ceph-mon[92072]: pgmap v11636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:01:10.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:09 smithi122 ceph-mon[125440]: pgmap v11636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:01:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:11 smithi057 ceph-mon[92072]: osdmap e800: 12 total, 12 up, 12 in 2023-03-02T17:01:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:11 smithi057 ceph-mon[92072]: pgmap v11638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:01:11.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:11 smithi122 ceph-mon[125440]: osdmap e800: 12 total, 12 up, 12 in 2023-03-02T17:01:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:11 smithi122 ceph-mon[125440]: pgmap v11638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:01:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:11 smithi136 ceph-mon[125702]: osdmap e800: 12 total, 12 up, 12 in 2023-03-02T17:01:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:11 smithi136 ceph-mon[125702]: pgmap v11638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:01:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:13 smithi136 ceph-mon[125702]: pgmap v11639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:01:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:13 smithi057 ceph-mon[92072]: pgmap v11639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:01:14.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:13 smithi122 ceph-mon[125440]: pgmap v11639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:01:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:15 smithi136 ceph-mon[125702]: pgmap v11640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:01:16.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:15 smithi057 ceph-mon[92072]: pgmap v11640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:01:16.495 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:15 smithi122 ceph-mon[125440]: pgmap v11640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:01:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:17 smithi136 ceph-mon[125702]: pgmap v11641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:01:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:17 smithi057 ceph-mon[92072]: pgmap v11641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:01:18.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:17 smithi122 ceph-mon[125440]: pgmap v11641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:01:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:19 smithi136 ceph-mon[125702]: pgmap v11642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:01:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:19 smithi057 ceph-mon[92072]: pgmap v11642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:01:20.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:19 smithi122 ceph-mon[125440]: pgmap v11642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:01:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:20.686+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:01:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:20.686+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:01:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:20.686+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:01:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:20.686+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:01:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:20.686+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:01:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:21 smithi122 ceph-mon[125440]: pgmap v11643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:01:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:21 smithi136 ceph-mon[125702]: pgmap v11643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:01:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:21 smithi057 ceph-mon[92072]: pgmap v11643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:01:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:23 smithi136 ceph-mon[125702]: pgmap v11644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:01:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:23 smithi057 ceph-mon[92072]: pgmap v11644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:01:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:23 smithi122 ceph-mon[125440]: pgmap v11644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:01:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:25 smithi136 ceph-mon[125702]: pgmap v11645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:25 smithi057 ceph-mon[92072]: pgmap v11645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:26.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:25 smithi122 ceph-mon[125440]: pgmap v11645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:27 smithi136 ceph-mon[125702]: pgmap v11646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:27 smithi057 ceph-mon[92072]: pgmap v11646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:28.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:27 smithi122 ceph-mon[125440]: pgmap v11646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:30 smithi136 ceph-mon[125702]: pgmap v11647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:30 smithi057 ceph-mon[92072]: pgmap v11647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:30.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:30 smithi122 ceph-mon[125440]: pgmap v11647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:31.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:31 smithi122 ceph-mon[125440]: pgmap v11648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:31 smithi136 ceph-mon[125702]: pgmap v11648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:31 smithi057 ceph-mon[92072]: pgmap v11648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:33 smithi136 ceph-mon[125702]: pgmap v11649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:33 smithi057 ceph-mon[92072]: pgmap v11649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:34.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:33 smithi122 ceph-mon[125440]: pgmap v11649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:35.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:35.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:01:35.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:35.701+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:01:35.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:35.701+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:01:35.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:35.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:01:35.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:35.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:01:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:35 smithi136 ceph-mon[125702]: pgmap v11650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:36.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:35 smithi057 ceph-mon[92072]: pgmap v11650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:35 smithi122 ceph-mon[125440]: pgmap v11650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:37 smithi136 ceph-mon[125702]: pgmap v11651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:38.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:37 smithi057 ceph-mon[92072]: pgmap v11651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:37 smithi122 ceph-mon[125440]: pgmap v11651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:39 smithi136 ceph-mon[125702]: pgmap v11652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:39 smithi057 ceph-mon[92072]: pgmap v11652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:40.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:39 smithi122 ceph-mon[125440]: pgmap v11652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:41.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:41 smithi122 ceph-mon[125440]: pgmap v11653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:41 smithi136 ceph-mon[125702]: pgmap v11653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:41 smithi057 ceph-mon[92072]: pgmap v11653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:01:43.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:01:43.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:01:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:43 smithi136 ceph-mon[125702]: pgmap v11654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:01:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:01:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:01:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:43 smithi057 ceph-mon[92072]: pgmap v11654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:01:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:01:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:01:44.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:43 smithi122 ceph-mon[125440]: pgmap v11654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:01:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:01:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:01:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:45 smithi136 ceph-mon[125702]: pgmap v11655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:45 smithi057 ceph-mon[92072]: pgmap v11655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:46.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:45 smithi122 ceph-mon[125440]: pgmap v11655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:47 smithi136 ceph-mon[125702]: pgmap v11656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:47 smithi057 ceph-mon[92072]: pgmap v11656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:48.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:47 smithi122 ceph-mon[125440]: pgmap v11656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:49 smithi136 ceph-mon[125702]: pgmap v11657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:49 smithi057 ceph-mon[92072]: pgmap v11657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:49 smithi122 ceph-mon[125440]: pgmap v11657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:50.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:50.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:01:50.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:50.712+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:01:50.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:50.712+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:01:50.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:50.712+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:01:50.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:01:50.712+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:01:51.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:51 smithi122 ceph-mon[125440]: pgmap v11658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:51 smithi136 ceph-mon[125702]: pgmap v11658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:51 smithi057 ceph-mon[92072]: pgmap v11658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:53 smithi136 ceph-mon[125702]: pgmap v11659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:53 smithi057 ceph-mon[92072]: pgmap v11659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:54.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:53 smithi122 ceph-mon[125440]: pgmap v11659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:55 smithi136 ceph-mon[125702]: pgmap v11660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:55 smithi057 ceph-mon[92072]: pgmap v11660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:56.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:55 smithi122 ceph-mon[125440]: pgmap v11660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:01:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:57 smithi136 ceph-mon[125702]: pgmap v11661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:58.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:57 smithi057 ceph-mon[92072]: pgmap v11661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:01:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:57 smithi122 ceph-mon[125440]: pgmap v11661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:01:59 smithi136 ceph-mon[125702]: pgmap v11662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:00.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:01:59 smithi057 ceph-mon[92072]: pgmap v11662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:01:59 smithi122 ceph-mon[125440]: pgmap v11662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:01 smithi136 ceph-mon[125702]: pgmap v11663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:01 smithi057 ceph-mon[92072]: pgmap v11663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:01 smithi122 ceph-mon[125440]: pgmap v11663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:03 smithi136 ceph-mon[125702]: pgmap v11664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:02:04.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:03 smithi057 ceph-mon[92072]: pgmap v11664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:02:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:03 smithi122 ceph-mon[125440]: pgmap v11664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:02:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:05.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:02:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:05.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:02:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:05.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:02:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:05.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:02:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:05.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:02:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:05 smithi136 ceph-mon[125702]: pgmap v11665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:02:06.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:05 smithi057 ceph-mon[92072]: pgmap v11665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:02:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:05 smithi122 ceph-mon[125440]: pgmap v11665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:02:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:07 smithi136 ceph-mon[125702]: osdmap e801: 12 total, 12 up, 12 in 2023-03-02T17:02:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:07 smithi136 ceph-mon[125702]: pgmap v11667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:02:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:07 smithi057 ceph-mon[92072]: osdmap e801: 12 total, 12 up, 12 in 2023-03-02T17:02:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:07 smithi057 ceph-mon[92072]: pgmap v11667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:02:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:07 smithi122 ceph-mon[125440]: osdmap e801: 12 total, 12 up, 12 in 2023-03-02T17:02:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:07 smithi122 ceph-mon[125440]: pgmap v11667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:02:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:09 smithi136 ceph-mon[125702]: pgmap v11668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:02:10.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:09 smithi057 ceph-mon[92072]: pgmap v11668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:02:10.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:09 smithi122 ceph-mon[125440]: pgmap v11668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:02:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:11.513+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:02:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:11.513+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:02:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:11.514+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 170 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:02:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:11.514+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:02:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:11.514+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 169 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:02:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:11.514+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:02:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:11.514+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 171 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:02:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:11.514+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 170 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:02:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:11 smithi136 ceph-mon[125702]: osdmap e802: 12 total, 12 up, 12 in 2023-03-02T17:02:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:11 smithi136 ceph-mon[125702]: pgmap v11670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:02:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:11 smithi057 ceph-mon[92072]: osdmap e802: 12 total, 12 up, 12 in 2023-03-02T17:02:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:11 smithi057 ceph-mon[92072]: pgmap v11670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:02:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:11 smithi122 ceph-mon[125440]: osdmap e802: 12 total, 12 up, 12 in 2023-03-02T17:02:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:11 smithi122 ceph-mon[125440]: pgmap v11670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:02:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:13 smithi136 ceph-mon[125702]: pgmap v11671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:02:14.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:13 smithi057 ceph-mon[92072]: pgmap v11671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:02:14.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:13 smithi122 ceph-mon[125440]: pgmap v11671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:02:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:15 smithi136 ceph-mon[125702]: pgmap v11672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:02:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:15 smithi057 ceph-mon[92072]: pgmap v11672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:02:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:15 smithi122 ceph-mon[125440]: pgmap v11672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:02:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:17 smithi136 ceph-mon[125702]: pgmap v11673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:02:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:17 smithi057 ceph-mon[92072]: pgmap v11673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:02:18.511 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:17 smithi122 ceph-mon[125440]: pgmap v11673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:02:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:20 smithi136 ceph-mon[125702]: pgmap v11674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:02:20.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:20 smithi057 ceph-mon[92072]: pgmap v11674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:02:20.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:20 smithi122 ceph-mon[125440]: pgmap v11674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:02:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:20.739+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:02:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:20.739+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:02:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:20.739+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:02:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:20.739+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:02:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:20.739+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:02:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:21 smithi136 ceph-mon[125702]: pgmap v11675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:02:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:21 smithi057 ceph-mon[92072]: pgmap v11675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:02:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:21 smithi122 ceph-mon[125440]: pgmap v11675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:02:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:23 smithi136 ceph-mon[125702]: pgmap v11676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:02:24.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:23 smithi057 ceph-mon[92072]: pgmap v11676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:02:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:23 smithi122 ceph-mon[125440]: pgmap v11676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:02:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:25 smithi136 ceph-mon[125702]: pgmap v11677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:25 smithi057 ceph-mon[92072]: pgmap v11677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:25 smithi122 ceph-mon[125440]: pgmap v11677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:28 smithi136 ceph-mon[125702]: pgmap v11678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:28 smithi057 ceph-mon[92072]: pgmap v11678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:28.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:28 smithi122 ceph-mon[125440]: pgmap v11678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:30 smithi136 ceph-mon[125702]: pgmap v11679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:30 smithi057 ceph-mon[92072]: pgmap v11679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:30.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:30 smithi122 ceph-mon[125440]: pgmap v11679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:31 smithi136 ceph-mon[125702]: pgmap v11680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:31 smithi057 ceph-mon[92072]: pgmap v11680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:31 smithi122 ceph-mon[125440]: pgmap v11680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:33 smithi136 ceph-mon[125702]: pgmap v11681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:34.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:33 smithi057 ceph-mon[92072]: pgmap v11681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:34.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:33 smithi122 ceph-mon[125440]: pgmap v11681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:35.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:35.746+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:02:35.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:35.746+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:02:35.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:35.746+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:02:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:35.746+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:02:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:35.746+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:02:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:35 smithi136 ceph-mon[125702]: pgmap v11682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:35 smithi057 ceph-mon[92072]: pgmap v11682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:36.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:35 smithi122 ceph-mon[125440]: pgmap v11682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:37 smithi136 ceph-mon[125702]: pgmap v11683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:37 smithi057 ceph-mon[92072]: pgmap v11683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:37 smithi122 ceph-mon[125440]: pgmap v11683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:40 smithi136 ceph-mon[125702]: pgmap v11684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:40 smithi057 ceph-mon[92072]: pgmap v11684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:40.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:40 smithi122 ceph-mon[125440]: pgmap v11684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:41 smithi136 ceph-mon[125702]: pgmap v11685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:41.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:41 smithi057 ceph-mon[92072]: pgmap v11685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:41 smithi122 ceph-mon[125440]: pgmap v11685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:43 smithi136 ceph-mon[125702]: pgmap v11686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:02:44.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:43 smithi057 ceph-mon[92072]: pgmap v11686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:02:44.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:43 smithi122 ceph-mon[125440]: pgmap v11686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:02:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:02:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:02:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:02:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:02:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:02:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:02:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:02:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:02:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:02:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:45 smithi136 ceph-mon[125702]: pgmap v11687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:45 smithi057 ceph-mon[92072]: pgmap v11687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:45 smithi122 ceph-mon[125440]: pgmap v11687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:48 smithi136 ceph-mon[125702]: pgmap v11688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:48 smithi057 ceph-mon[92072]: pgmap v11688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:48.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:48 smithi122 ceph-mon[125440]: pgmap v11688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:50 smithi136 ceph-mon[125702]: pgmap v11689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:50 smithi057 ceph-mon[92072]: pgmap v11689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:50.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:50 smithi122 ceph-mon[125440]: pgmap v11689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:50.757+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:02:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:50.757+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:02:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:50.757+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:02:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:50.757+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:02:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:02:50.757+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:02:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:51 smithi136 ceph-mon[125702]: pgmap v11690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:51.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:51 smithi057 ceph-mon[92072]: pgmap v11690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:51 smithi122 ceph-mon[125440]: pgmap v11690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:54 smithi136 ceph-mon[125702]: pgmap v11691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:54 smithi057 ceph-mon[92072]: pgmap v11691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:54.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:54 smithi122 ceph-mon[125440]: pgmap v11691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:56 smithi136 ceph-mon[125702]: pgmap v11692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:56 smithi057 ceph-mon[92072]: pgmap v11692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:56.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:56 smithi122 ceph-mon[125440]: pgmap v11692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:02:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:02:58 smithi136 ceph-mon[125702]: pgmap v11693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:58.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:02:58 smithi057 ceph-mon[92072]: pgmap v11693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:02:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:02:58 smithi122 ceph-mon[125440]: pgmap v11693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:00 smithi136 ceph-mon[125702]: pgmap v11694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:00.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:00 smithi057 ceph-mon[92072]: pgmap v11694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:00 smithi122 ceph-mon[125440]: pgmap v11694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:01 smithi136 ceph-mon[125702]: pgmap v11695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:01 smithi057 ceph-mon[92072]: pgmap v11695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:01 smithi122 ceph-mon[125440]: pgmap v11695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:04 smithi136 ceph-mon[125702]: pgmap v11696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:03:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:04 smithi057 ceph-mon[92072]: pgmap v11696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:03:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:04 smithi122 ceph-mon[125440]: pgmap v11696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:03:05.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:05.773+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:03:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:05.773+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:03:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:05.773+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:03:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:05.773+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:03:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:05.773+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:03:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:06 smithi136 ceph-mon[125702]: pgmap v11697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:03:06.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:06 smithi057 ceph-mon[92072]: pgmap v11697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:03:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:06 smithi122 ceph-mon[125440]: pgmap v11697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:03:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:07 smithi136 ceph-mon[125702]: osdmap e803: 12 total, 12 up, 12 in 2023-03-02T17:03:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:07 smithi136 ceph-mon[125702]: pgmap v11699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:03:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:07 smithi057 ceph-mon[92072]: osdmap e803: 12 total, 12 up, 12 in 2023-03-02T17:03:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:07 smithi057 ceph-mon[92072]: pgmap v11699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:03:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:07 smithi122 ceph-mon[125440]: osdmap e803: 12 total, 12 up, 12 in 2023-03-02T17:03:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:07 smithi122 ceph-mon[125440]: pgmap v11699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:03:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:10 smithi136 ceph-mon[125702]: pgmap v11700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:03:10.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:10 smithi057 ceph-mon[92072]: pgmap v11700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:03:10.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:10 smithi122 ceph-mon[125440]: pgmap v11700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:03:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:11 smithi136 ceph-mon[125702]: osdmap e804: 12 total, 12 up, 12 in 2023-03-02T17:03:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:11 smithi136 ceph-mon[125702]: pgmap v11702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:03:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:11 smithi057 ceph-mon[92072]: osdmap e804: 12 total, 12 up, 12 in 2023-03-02T17:03:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:11 smithi057 ceph-mon[92072]: pgmap v11702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:03:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:11 smithi122 ceph-mon[125440]: osdmap e804: 12 total, 12 up, 12 in 2023-03-02T17:03:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:11 smithi122 ceph-mon[125440]: pgmap v11702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:03:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:14 smithi136 ceph-mon[125702]: pgmap v11703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:03:14.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:14 smithi057 ceph-mon[92072]: pgmap v11703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:03:14.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:14 smithi122 ceph-mon[125440]: pgmap v11703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:03:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:16 smithi136 ceph-mon[125702]: pgmap v11704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:03:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:16 smithi057 ceph-mon[92072]: pgmap v11704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:03:16.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:16 smithi122 ceph-mon[125440]: pgmap v11704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:03:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:18 smithi136 ceph-mon[125702]: pgmap v11705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:03:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:18 smithi057 ceph-mon[92072]: pgmap v11705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:03:18.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:18 smithi122 ceph-mon[125440]: pgmap v11705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:03:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:20 smithi136 ceph-mon[125702]: pgmap v11706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:03:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:20 smithi057 ceph-mon[92072]: pgmap v11706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:03:20.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:20 smithi122 ceph-mon[125440]: pgmap v11706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:03:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:20.777+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:03:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:20.777+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:03:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:20.777+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:03:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:20.777+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:03:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:20.777+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:03:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:21 smithi136 ceph-mon[125702]: pgmap v11707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:03:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:21 smithi057 ceph-mon[92072]: pgmap v11707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:03:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:21 smithi122 ceph-mon[125440]: pgmap v11707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:03:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:24 smithi136 ceph-mon[125702]: pgmap v11708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:03:24.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:24 smithi057 ceph-mon[92072]: pgmap v11708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:03:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:24 smithi122 ceph-mon[125440]: pgmap v11708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:03:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:26 smithi136 ceph-mon[125702]: pgmap v11709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:03:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:26 smithi057 ceph-mon[92072]: pgmap v11709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:03:26.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:26 smithi122 ceph-mon[125440]: pgmap v11709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:03:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:28 smithi136 ceph-mon[125702]: pgmap v11710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:28 smithi057 ceph-mon[92072]: pgmap v11710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:28.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:28 smithi122 ceph-mon[125440]: pgmap v11710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:30 smithi136 ceph-mon[125702]: pgmap v11711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:30 smithi057 ceph-mon[92072]: pgmap v11711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:30.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:30 smithi122 ceph-mon[125440]: pgmap v11711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:31 smithi136 ceph-mon[125702]: pgmap v11712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:31 smithi057 ceph-mon[92072]: pgmap v11712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:31 smithi122 ceph-mon[125440]: pgmap v11712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:34 smithi136 ceph-mon[125702]: pgmap v11713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:34.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:34 smithi057 ceph-mon[92072]: pgmap v11713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:34 smithi122 ceph-mon[125440]: pgmap v11713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:35.792+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:03:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:35.792+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:03:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:35.792+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:03:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:35.792+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:03:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:35.792+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:03:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:36 smithi136 ceph-mon[125702]: pgmap v11714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:36 smithi057 ceph-mon[92072]: pgmap v11714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:36.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:36 smithi122 ceph-mon[125440]: pgmap v11714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:38 smithi136 ceph-mon[125702]: pgmap v11715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:38 smithi057 ceph-mon[92072]: pgmap v11715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:38 smithi122 ceph-mon[125440]: pgmap v11715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:40 smithi136 ceph-mon[125702]: pgmap v11716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:40.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:40 smithi057 ceph-mon[92072]: pgmap v11716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:40 smithi122 ceph-mon[125440]: pgmap v11716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:41 smithi136 ceph-mon[125702]: pgmap v11717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:41 smithi057 ceph-mon[92072]: pgmap v11717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:41 smithi122 ceph-mon[125440]: pgmap v11717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:44 smithi136 ceph-mon[125702]: pgmap v11718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:44 smithi057 ceph-mon[92072]: pgmap v11718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:44 smithi122 ceph-mon[125440]: pgmap v11718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:03:45.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:03:45.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:03:46.278 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:46 smithi057 ceph-mon[92072]: pgmap v11719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:46 smithi136 ceph-mon[125702]: pgmap v11719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:46.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:46 smithi122 ceph-mon[125440]: pgmap v11719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:48 smithi136 ceph-mon[125702]: pgmap v11720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:48.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:48 smithi057 ceph-mon[92072]: pgmap v11720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:48.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:48 smithi122 ceph-mon[125440]: pgmap v11720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:03:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:03:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:03:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:03:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:03:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:49 smithi136 ceph-mon[125702]: pgmap v11721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:03:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:03:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:03:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:03:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:03:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:49 smithi057 ceph-mon[92072]: pgmap v11721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:03:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:03:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:03:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:03:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:03:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:49 smithi122 ceph-mon[125440]: pgmap v11721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:50.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:03:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:50.795+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:03:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:50.795+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:03:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:50.795+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:03:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:03:50.795+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:03:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:51 smithi136 ceph-mon[125702]: pgmap v11722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:51 smithi057 ceph-mon[92072]: pgmap v11722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:51 smithi122 ceph-mon[125440]: pgmap v11722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:54 smithi136 ceph-mon[125702]: pgmap v11723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:54.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:54 smithi057 ceph-mon[92072]: pgmap v11723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:54.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:54 smithi122 ceph-mon[125440]: pgmap v11723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:56 smithi136 ceph-mon[125702]: pgmap v11724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:56 smithi057 ceph-mon[92072]: pgmap v11724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:56 smithi122 ceph-mon[125440]: pgmap v11724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:03:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:03:58 smithi136 ceph-mon[125702]: pgmap v11725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:58.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:03:58 smithi057 ceph-mon[92072]: pgmap v11725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:03:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:03:58 smithi122 ceph-mon[125440]: pgmap v11725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:00 smithi136 ceph-mon[125702]: pgmap v11726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:00 smithi057 ceph-mon[92072]: pgmap v11726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:00 smithi122 ceph-mon[125440]: pgmap v11726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:01 smithi136 ceph-mon[125702]: pgmap v11727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:01 smithi057 ceph-mon[92072]: pgmap v11727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:01 smithi122 ceph-mon[125440]: pgmap v11727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:04 smithi136 ceph-mon[125702]: pgmap v11728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:04:04.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:04 smithi057 ceph-mon[92072]: pgmap v11728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:04:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:04 smithi122 ceph-mon[125440]: pgmap v11728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:04:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:05.811+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:04:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:05.812+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:04:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:05.812+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:04:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:05.812+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:04:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:05.812+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:04:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:06 smithi136 ceph-mon[125702]: pgmap v11729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:04:06.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:06 smithi057 ceph-mon[92072]: pgmap v11729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:04:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:06 smithi122 ceph-mon[125440]: pgmap v11729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:04:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:07 smithi136 ceph-mon[125702]: osdmap e805: 12 total, 12 up, 12 in 2023-03-02T17:04:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:07 smithi136 ceph-mon[125702]: pgmap v11731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:04:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:07 smithi057 ceph-mon[92072]: osdmap e805: 12 total, 12 up, 12 in 2023-03-02T17:04:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:07 smithi057 ceph-mon[92072]: pgmap v11731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:04:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:07 smithi122 ceph-mon[125440]: osdmap e805: 12 total, 12 up, 12 in 2023-03-02T17:04:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:07 smithi122 ceph-mon[125440]: pgmap v11731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:04:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:10 smithi136 ceph-mon[125702]: pgmap v11732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:04:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:10 smithi057 ceph-mon[92072]: pgmap v11732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:04:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:10 smithi122 ceph-mon[125440]: pgmap v11732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:04:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:11 smithi136 ceph-mon[125702]: osdmap e806: 12 total, 12 up, 12 in 2023-03-02T17:04:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:11 smithi136 ceph-mon[125702]: pgmap v11734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:04:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:11 smithi057 ceph-mon[92072]: osdmap e806: 12 total, 12 up, 12 in 2023-03-02T17:04:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:11 smithi057 ceph-mon[92072]: pgmap v11734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:04:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:11 smithi122 ceph-mon[125440]: osdmap e806: 12 total, 12 up, 12 in 2023-03-02T17:04:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:11 smithi122 ceph-mon[125440]: pgmap v11734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:04:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:14 smithi136 ceph-mon[125702]: pgmap v11735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:04:14.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:14 smithi057 ceph-mon[92072]: pgmap v11735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:04:14.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:14 smithi122 ceph-mon[125440]: pgmap v11735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:04:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:16 smithi136 ceph-mon[125702]: pgmap v11736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:04:16.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:16 smithi057 ceph-mon[92072]: pgmap v11736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:04:16.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:16 smithi122 ceph-mon[125440]: pgmap v11736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:04:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:18 smithi136 ceph-mon[125702]: pgmap v11737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:04:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:18 smithi057 ceph-mon[92072]: pgmap v11737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:04:18.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:18 smithi122 ceph-mon[125440]: pgmap v11737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:04:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:20 smithi136 ceph-mon[125702]: pgmap v11738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:04:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:20 smithi057 ceph-mon[92072]: pgmap v11738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:04:20.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:20 smithi122 ceph-mon[125440]: pgmap v11738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:04:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:20.816+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:04:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:20.816+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:04:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:20.816+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:04:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:20.816+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:04:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:20.816+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:04:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:21 smithi136 ceph-mon[125702]: pgmap v11739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:04:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:21 smithi057 ceph-mon[92072]: pgmap v11739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:04:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:21 smithi122 ceph-mon[125440]: pgmap v11739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:04:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:24 smithi136 ceph-mon[125702]: pgmap v11740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:04:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:24 smithi057 ceph-mon[92072]: pgmap v11740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:04:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:24 smithi122 ceph-mon[125440]: pgmap v11740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:04:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:26 smithi136 ceph-mon[125702]: pgmap v11741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:26 smithi057 ceph-mon[92072]: pgmap v11741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:26 smithi122 ceph-mon[125440]: pgmap v11741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:28 smithi136 ceph-mon[125702]: pgmap v11742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:28 smithi057 ceph-mon[92072]: pgmap v11742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:28 smithi122 ceph-mon[125440]: pgmap v11742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:30 smithi136 ceph-mon[125702]: pgmap v11743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:30 smithi057 ceph-mon[92072]: pgmap v11743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:30 smithi122 ceph-mon[125440]: pgmap v11743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:31 smithi136 ceph-mon[125702]: pgmap v11744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:31.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:31 smithi057 ceph-mon[92072]: pgmap v11744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:31 smithi122 ceph-mon[125440]: pgmap v11744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:34 smithi136 ceph-mon[125702]: pgmap v11745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:34 smithi057 ceph-mon[92072]: pgmap v11745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:34.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:34 smithi122 ceph-mon[125440]: pgmap v11745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:35.828+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:04:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:35.828+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:04:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:35.828+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:04:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:35.828+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:04:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:35.828+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:04:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:36 smithi136 ceph-mon[125702]: pgmap v11746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:36 smithi057 ceph-mon[92072]: pgmap v11746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:36.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:36 smithi122 ceph-mon[125440]: pgmap v11746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:38 smithi136 ceph-mon[125702]: pgmap v11747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:38 smithi057 ceph-mon[92072]: pgmap v11747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:38 smithi122 ceph-mon[125440]: pgmap v11747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:40 smithi136 ceph-mon[125702]: pgmap v11748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:40 smithi057 ceph-mon[92072]: pgmap v11748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:40 smithi122 ceph-mon[125440]: pgmap v11748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:41 smithi136 ceph-mon[125702]: pgmap v11749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:41 smithi057 ceph-mon[92072]: pgmap v11749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:41 smithi122 ceph-mon[125440]: pgmap v11749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:44 smithi136 ceph-mon[125702]: pgmap v11750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:44 smithi057 ceph-mon[92072]: pgmap v11750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:44 smithi122 ceph-mon[125440]: pgmap v11750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:46 smithi136 ceph-mon[125702]: pgmap v11751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:46 smithi057 ceph-mon[92072]: pgmap v11751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:46 smithi122 ceph-mon[125440]: pgmap v11751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:48 smithi136 ceph-mon[125702]: pgmap v11752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:48 smithi057 ceph-mon[92072]: pgmap v11752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:48.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:48 smithi122 ceph-mon[125440]: pgmap v11752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:04:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:04:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:04:50.322 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:50 smithi122 ceph-mon[125440]: pgmap v11753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:50 smithi136 ceph-mon[125702]: pgmap v11753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:50 smithi057 ceph-mon[92072]: pgmap v11753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:50.843 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:50.842+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:04:50.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:50.842+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:04:50.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:50.842+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:04:50.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:50.842+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:04:50.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:04:50.842+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:04:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:51 smithi136 ceph-mon[125702]: pgmap v11754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:51 smithi057 ceph-mon[92072]: pgmap v11754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:51 smithi122 ceph-mon[125440]: pgmap v11754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:04:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:04:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:53 smithi136 ceph-mon[125702]: pgmap v11755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:04:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:04:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:53 smithi057 ceph-mon[92072]: pgmap v11755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:04:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:04:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:04:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:53 smithi122 ceph-mon[125440]: pgmap v11755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:56 smithi136 ceph-mon[125702]: pgmap v11756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:56.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:56 smithi057 ceph-mon[92072]: pgmap v11756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:56 smithi122 ceph-mon[125440]: pgmap v11756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:04:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:04:58 smithi136 ceph-mon[125702]: pgmap v11757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:04:58 smithi057 ceph-mon[92072]: pgmap v11757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:04:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:04:58 smithi122 ceph-mon[125440]: pgmap v11757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:00 smithi136 ceph-mon[125702]: pgmap v11758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:00 smithi057 ceph-mon[92072]: pgmap v11758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:00.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:00 smithi122 ceph-mon[125440]: pgmap v11758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:01 smithi136 ceph-mon[125702]: pgmap v11759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:01 smithi057 ceph-mon[92072]: pgmap v11759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:01 smithi122 ceph-mon[125440]: pgmap v11759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:04 smithi136 ceph-mon[125702]: pgmap v11760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:05:04.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:04 smithi057 ceph-mon[92072]: pgmap v11760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:05:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:04 smithi122 ceph-mon[125440]: pgmap v11760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:05:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:05.855+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:05:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:05.856+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:05:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:05.856+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:05:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:05.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:05:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:05.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:05:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:06 smithi136 ceph-mon[125702]: pgmap v11761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:05:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:06 smithi057 ceph-mon[92072]: pgmap v11761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:05:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:06 smithi122 ceph-mon[125440]: pgmap v11761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:05:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:08 smithi136 ceph-mon[125702]: pgmap v11762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:05:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:08 smithi057 ceph-mon[92072]: pgmap v11762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:05:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:08 smithi122 ceph-mon[125440]: pgmap v11762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:05:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:10 smithi136 ceph-mon[125702]: pgmap v11763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:05:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:10 smithi057 ceph-mon[92072]: pgmap v11763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:05:10.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:10 smithi122 ceph-mon[125440]: pgmap v11763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:05:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:11.540+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:05:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:11.540+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:05:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:11.540+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 171 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:05:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:11.540+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 172 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:05:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:11 smithi136 ceph-mon[125702]: pgmap v11764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:05:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:11 smithi057 ceph-mon[92072]: pgmap v11764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:05:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:11 smithi122 ceph-mon[125440]: pgmap v11764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:05:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:12 smithi136 ceph-mon[125702]: osdmap e807: 12 total, 12 up, 12 in 2023-03-02T17:05:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:12 smithi057 ceph-mon[92072]: osdmap e807: 12 total, 12 up, 12 in 2023-03-02T17:05:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:12 smithi122 ceph-mon[125440]: osdmap e807: 12 total, 12 up, 12 in 2023-03-02T17:05:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:13 smithi136 ceph-mon[125702]: pgmap v11766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:13 smithi057 ceph-mon[92072]: pgmap v11766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:13 smithi122 ceph-mon[125440]: pgmap v11766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:16 smithi136 ceph-mon[125702]: pgmap v11767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:16 smithi057 ceph-mon[92072]: pgmap v11767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:16 smithi122 ceph-mon[125440]: pgmap v11767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:18 smithi136 ceph-mon[125702]: pgmap v11768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:05:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:18 smithi057 ceph-mon[92072]: pgmap v11768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:05:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:18 smithi122 ceph-mon[125440]: pgmap v11768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:05:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:20 smithi136 ceph-mon[125702]: pgmap v11769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:05:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:20 smithi057 ceph-mon[92072]: pgmap v11769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:05:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:20 smithi122 ceph-mon[125440]: pgmap v11769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:05:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:20.871+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:05:20.872 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:20.871+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:05:20.872 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:20.871+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:05:20.872 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:20.871+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:05:20.872 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:20.871+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:05:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:21 smithi136 ceph-mon[125702]: osdmap e808: 12 total, 12 up, 12 in 2023-03-02T17:05:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:21 smithi136 ceph-mon[125702]: pgmap v11771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 316 B/s wr, 10 op/s 2023-03-02T17:05:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:21 smithi057 ceph-mon[92072]: osdmap e808: 12 total, 12 up, 12 in 2023-03-02T17:05:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:21 smithi057 ceph-mon[92072]: pgmap v11771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 316 B/s wr, 10 op/s 2023-03-02T17:05:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:21 smithi122 ceph-mon[125440]: osdmap e808: 12 total, 12 up, 12 in 2023-03-02T17:05:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:21 smithi122 ceph-mon[125440]: pgmap v11771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 316 B/s wr, 10 op/s 2023-03-02T17:05:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:24 smithi136 ceph-mon[125702]: pgmap v11772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:24 smithi057 ceph-mon[92072]: pgmap v11772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:24 smithi122 ceph-mon[125440]: pgmap v11772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:26 smithi136 ceph-mon[125702]: pgmap v11773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:26 smithi057 ceph-mon[92072]: pgmap v11773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:26 smithi122 ceph-mon[125440]: pgmap v11773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:05:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:28 smithi136 ceph-mon[125702]: pgmap v11774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:05:28.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:28 smithi057 ceph-mon[92072]: pgmap v11774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:05:28.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:28 smithi122 ceph-mon[125440]: pgmap v11774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:05:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:30 smithi136 ceph-mon[125702]: pgmap v11775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:05:30.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:30 smithi057 ceph-mon[92072]: pgmap v11775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:05:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:30 smithi122 ceph-mon[125440]: pgmap v11775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:05:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:31 smithi136 ceph-mon[125702]: pgmap v11776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:05:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:31 smithi057 ceph-mon[92072]: pgmap v11776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:05:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:31 smithi122 ceph-mon[125440]: pgmap v11776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:05:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:34 smithi136 ceph-mon[125702]: pgmap v11777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:34 smithi057 ceph-mon[92072]: pgmap v11777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:34 smithi122 ceph-mon[125440]: pgmap v11777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:35.884+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:05:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:35.885+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:05:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:35.885+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:05:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:35.885+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:05:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:35.885+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:05:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:36 smithi136 ceph-mon[125702]: pgmap v11778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:36 smithi057 ceph-mon[92072]: pgmap v11778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:36 smithi122 ceph-mon[125440]: pgmap v11778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:38 smithi136 ceph-mon[125702]: pgmap v11779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:38 smithi057 ceph-mon[92072]: pgmap v11779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:38 smithi122 ceph-mon[125440]: pgmap v11779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:40 smithi136 ceph-mon[125702]: pgmap v11780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:40 smithi057 ceph-mon[92072]: pgmap v11780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:40 smithi122 ceph-mon[125440]: pgmap v11780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:41 smithi136 ceph-mon[125702]: pgmap v11781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:41 smithi057 ceph-mon[92072]: pgmap v11781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:41 smithi122 ceph-mon[125440]: pgmap v11781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:44 smithi136 ceph-mon[125702]: pgmap v11782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:44 smithi057 ceph-mon[92072]: pgmap v11782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:44 smithi122 ceph-mon[125440]: pgmap v11782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:46 smithi136 ceph-mon[125702]: pgmap v11783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:46 smithi057 ceph-mon[92072]: pgmap v11783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:46 smithi122 ceph-mon[125440]: pgmap v11783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:48 smithi136 ceph-mon[125702]: pgmap v11784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:48 smithi057 ceph-mon[92072]: pgmap v11784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:48 smithi122 ceph-mon[125440]: pgmap v11784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:50 smithi136 ceph-mon[125702]: pgmap v11785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:50 smithi057 ceph-mon[92072]: pgmap v11785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:50 smithi122 ceph-mon[125440]: pgmap v11785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:50.899+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:05:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:50.900+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:05:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:50.900+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:05:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:50.900+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:05:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:05:50.900+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:05:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:51 smithi136 ceph-mon[125702]: pgmap v11786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:51 smithi057 ceph-mon[92072]: pgmap v11786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:51 smithi122 ceph-mon[125440]: pgmap v11786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:53.181 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:05:53.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:05:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:05:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:53 smithi057 ceph-mon[92072]: pgmap v11787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:05:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:05:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:05:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:53 smithi122 ceph-mon[125440]: pgmap v11787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:05:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:05:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:05:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:53 smithi136 ceph-mon[125702]: pgmap v11787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:05:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:05:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:05:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:56 smithi136 ceph-mon[125702]: pgmap v11788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:56 smithi057 ceph-mon[92072]: pgmap v11788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:56 smithi122 ceph-mon[125440]: pgmap v11788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:05:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:05:58 smithi136 ceph-mon[125702]: pgmap v11789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:58.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:05:58 smithi057 ceph-mon[92072]: pgmap v11789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:05:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:05:58 smithi122 ceph-mon[125440]: pgmap v11789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:00 smithi136 ceph-mon[125702]: pgmap v11790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:00.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:00 smithi057 ceph-mon[92072]: pgmap v11790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:00 smithi122 ceph-mon[125440]: pgmap v11790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:01 smithi136 ceph-mon[125702]: pgmap v11791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:01 smithi057 ceph-mon[92072]: pgmap v11791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:01 smithi122 ceph-mon[125440]: pgmap v11791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:04 smithi136 ceph-mon[125702]: pgmap v11792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:06:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:04 smithi057 ceph-mon[92072]: pgmap v11792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:06:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:04 smithi122 ceph-mon[125440]: pgmap v11792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:06:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:05.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:06:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:05.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:06:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:05.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:06:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:05.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:06:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:05.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:06:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:06 smithi136 ceph-mon[125702]: pgmap v11793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:06:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:06 smithi057 ceph-mon[92072]: pgmap v11793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:06:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:06 smithi122 ceph-mon[125440]: pgmap v11793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:06:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:08 smithi136 ceph-mon[125702]: pgmap v11794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:06:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:08 smithi057 ceph-mon[92072]: pgmap v11794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:06:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:08 smithi122 ceph-mon[125440]: pgmap v11794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:06:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:10 smithi136 ceph-mon[125702]: pgmap v11795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:06:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:10 smithi057 ceph-mon[92072]: pgmap v11795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:06:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:10 smithi122 ceph-mon[125440]: pgmap v11795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:06:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:11 smithi136 ceph-mon[125702]: pgmap v11796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:06:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:11 smithi057 ceph-mon[92072]: pgmap v11796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:06:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:11 smithi122 ceph-mon[125440]: pgmap v11796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:06:12.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:12 smithi136 ceph-mon[125702]: osdmap e809: 12 total, 12 up, 12 in 2023-03-02T17:06:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:12 smithi057 ceph-mon[92072]: osdmap e809: 12 total, 12 up, 12 in 2023-03-02T17:06:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:12 smithi122 ceph-mon[125440]: osdmap e809: 12 total, 12 up, 12 in 2023-03-02T17:06:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:13 smithi136 ceph-mon[125702]: pgmap v11798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:13 smithi057 ceph-mon[92072]: pgmap v11798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:13 smithi122 ceph-mon[125440]: pgmap v11798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:16.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:16 smithi136 ceph-mon[125702]: pgmap v11799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:16 smithi057 ceph-mon[92072]: pgmap v11799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:16.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:16 smithi122 ceph-mon[125440]: pgmap v11799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:18 smithi136 ceph-mon[125702]: pgmap v11800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:18 smithi057 ceph-mon[92072]: pgmap v11800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:18 smithi122 ceph-mon[125440]: pgmap v11800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:20.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:20 smithi136 ceph-mon[125702]: pgmap v11801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:20 smithi057 ceph-mon[92072]: pgmap v11801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:20 smithi122 ceph-mon[125440]: pgmap v11801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:06:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:20.932+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:06:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:20.932+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:06:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:20.932+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:06:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:20.932+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:06:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:20.932+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:06:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:21 smithi136 ceph-mon[125702]: osdmap e810: 12 total, 12 up, 12 in 2023-03-02T17:06:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:21 smithi136 ceph-mon[125702]: pgmap v11803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:06:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:21 smithi057 ceph-mon[92072]: osdmap e810: 12 total, 12 up, 12 in 2023-03-02T17:06:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:21 smithi057 ceph-mon[92072]: pgmap v11803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:06:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:21 smithi122 ceph-mon[125440]: osdmap e810: 12 total, 12 up, 12 in 2023-03-02T17:06:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:21 smithi122 ceph-mon[125440]: pgmap v11803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:06:24.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:24 smithi136 ceph-mon[125702]: pgmap v11804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:06:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:24 smithi057 ceph-mon[92072]: pgmap v11804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:06:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:24 smithi122 ceph-mon[125440]: pgmap v11804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:06:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:26 smithi136 ceph-mon[125702]: pgmap v11805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:06:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:26 smithi057 ceph-mon[92072]: pgmap v11805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:06:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:26 smithi122 ceph-mon[125440]: pgmap v11805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:06:28.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:28 smithi136 ceph-mon[125702]: pgmap v11806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:06:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:28 smithi057 ceph-mon[92072]: pgmap v11806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:06:28.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:28 smithi122 ceph-mon[125440]: pgmap v11806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:06:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:30 smithi136 ceph-mon[125702]: pgmap v11807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:06:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:30 smithi057 ceph-mon[92072]: pgmap v11807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:06:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:30 smithi122 ceph-mon[125440]: pgmap v11807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:06:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:31 smithi136 ceph-mon[125702]: pgmap v11808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:06:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:31 smithi057 ceph-mon[92072]: pgmap v11808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:06:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:31 smithi122 ceph-mon[125440]: pgmap v11808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:06:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:34 smithi136 ceph-mon[125702]: pgmap v11809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:34.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:34 smithi057 ceph-mon[92072]: pgmap v11809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:34 smithi122 ceph-mon[125440]: pgmap v11809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:35.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:35.948+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:06:35.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:35.948+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:06:35.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:35.948+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:06:35.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:35.948+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:06:35.949 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:35.948+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:06:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:36 smithi136 ceph-mon[125702]: pgmap v11810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:36 smithi057 ceph-mon[92072]: pgmap v11810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:36 smithi122 ceph-mon[125440]: pgmap v11810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:38 smithi136 ceph-mon[125702]: pgmap v11811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:38 smithi057 ceph-mon[92072]: pgmap v11811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:38 smithi122 ceph-mon[125440]: pgmap v11811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:40 smithi136 ceph-mon[125702]: pgmap v11812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:40 smithi057 ceph-mon[92072]: pgmap v11812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:40 smithi122 ceph-mon[125440]: pgmap v11812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:41 smithi136 ceph-mon[125702]: pgmap v11813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:41 smithi057 ceph-mon[92072]: pgmap v11813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:41 smithi122 ceph-mon[125440]: pgmap v11813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:44 smithi136 ceph-mon[125702]: pgmap v11814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:44 smithi057 ceph-mon[92072]: pgmap v11814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:44 smithi122 ceph-mon[125440]: pgmap v11814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:46.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:46 smithi136 ceph-mon[125702]: pgmap v11815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:46 smithi057 ceph-mon[92072]: pgmap v11815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:46 smithi122 ceph-mon[125440]: pgmap v11815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:48 smithi136 ceph-mon[125702]: pgmap v11816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:48 smithi057 ceph-mon[92072]: pgmap v11816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:48 smithi122 ceph-mon[125440]: pgmap v11816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:50.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:50 smithi136 ceph-mon[125702]: pgmap v11817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:50 smithi057 ceph-mon[92072]: pgmap v11817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:50 smithi122 ceph-mon[125440]: pgmap v11817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:50.950+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:06:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:50.950+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:06:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:50.950+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:06:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:50.950+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:06:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:06:50.950+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:06:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:51 smithi136 ceph-mon[125702]: pgmap v11818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:51 smithi057 ceph-mon[92072]: pgmap v11818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:51 smithi122 ceph-mon[125440]: pgmap v11818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:54 smithi136 ceph-mon[125702]: pgmap v11819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:06:54.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:54 smithi057 ceph-mon[92072]: pgmap v11819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:06:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:54 smithi122 ceph-mon[125440]: pgmap v11819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:06:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:55 smithi136 ceph-mon[125702]: pgmap v11820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:06:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:06:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:55 smithi057 ceph-mon[92072]: pgmap v11820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:06:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:06:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:55 smithi122 ceph-mon[125440]: pgmap v11820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:06:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:06:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:06:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:06:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:06:58 smithi136 ceph-mon[125702]: pgmap v11821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:06:58 smithi057 ceph-mon[92072]: pgmap v11821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:06:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:06:58 smithi122 ceph-mon[125440]: pgmap v11821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:00 smithi136 ceph-mon[125702]: pgmap v11822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:00.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:00 smithi057 ceph-mon[92072]: pgmap v11822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:00 smithi122 ceph-mon[125440]: pgmap v11822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:01 smithi136 ceph-mon[125702]: pgmap v11823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:01 smithi057 ceph-mon[92072]: pgmap v11823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:01 smithi122 ceph-mon[125440]: pgmap v11823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:04 smithi136 ceph-mon[125702]: pgmap v11824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:07:04.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:04 smithi057 ceph-mon[92072]: pgmap v11824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:07:04.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:04 smithi122 ceph-mon[125440]: pgmap v11824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:07:05.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:05.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:07:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:05.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:07:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:05.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:07:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:05.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:07:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:05.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:07:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:06 smithi136 ceph-mon[125702]: pgmap v11825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:07:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:06 smithi057 ceph-mon[92072]: pgmap v11825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:07:06.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:06 smithi122 ceph-mon[125440]: pgmap v11825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:07:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:07 smithi136 ceph-mon[125702]: osdmap e811: 12 total, 12 up, 12 in 2023-03-02T17:07:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:07 smithi136 ceph-mon[125702]: pgmap v11827: 97 pgs: 3 active+clean+snaptrim, 94 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:07:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:07 smithi057 ceph-mon[92072]: osdmap e811: 12 total, 12 up, 12 in 2023-03-02T17:07:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:07 smithi057 ceph-mon[92072]: pgmap v11827: 97 pgs: 3 active+clean+snaptrim, 94 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:07:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:07 smithi122 ceph-mon[125440]: osdmap e811: 12 total, 12 up, 12 in 2023-03-02T17:07:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:07 smithi122 ceph-mon[125440]: pgmap v11827: 97 pgs: 3 active+clean+snaptrim, 94 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:07:10.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:10 smithi136 ceph-mon[125702]: pgmap v11828: 97 pgs: 3 active+clean+snaptrim, 94 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:07:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:10 smithi057 ceph-mon[92072]: pgmap v11828: 97 pgs: 3 active+clean+snaptrim, 94 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:07:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:10 smithi122 ceph-mon[125440]: pgmap v11828: 97 pgs: 3 active+clean+snaptrim, 94 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:07:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:11 smithi136 ceph-mon[125702]: osdmap e812: 12 total, 12 up, 12 in 2023-03-02T17:07:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:11 smithi136 ceph-mon[125702]: pgmap v11830: 97 pgs: 3 active+clean+snaptrim, 94 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:07:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:11 smithi057 ceph-mon[92072]: osdmap e812: 12 total, 12 up, 12 in 2023-03-02T17:07:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:11 smithi057 ceph-mon[92072]: pgmap v11830: 97 pgs: 3 active+clean+snaptrim, 94 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:07:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:11 smithi122 ceph-mon[125440]: osdmap e812: 12 total, 12 up, 12 in 2023-03-02T17:07:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:11 smithi122 ceph-mon[125440]: pgmap v11830: 97 pgs: 3 active+clean+snaptrim, 94 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:07:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:14 smithi136 ceph-mon[125702]: pgmap v11831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:07:14.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:14 smithi057 ceph-mon[92072]: pgmap v11831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:07:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:14 smithi122 ceph-mon[125440]: pgmap v11831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:07:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:16 smithi136 ceph-mon[125702]: pgmap v11832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:07:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:16 smithi136 ceph-mon[125702]: osdmap e813: 12 total, 12 up, 12 in 2023-03-02T17:07:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:16 smithi057 ceph-mon[92072]: pgmap v11832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:07:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:16 smithi057 ceph-mon[92072]: osdmap e813: 12 total, 12 up, 12 in 2023-03-02T17:07:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:16 smithi122 ceph-mon[125440]: pgmap v11832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:07:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:16 smithi122 ceph-mon[125440]: osdmap e813: 12 total, 12 up, 12 in 2023-03-02T17:07:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:18 smithi057 ceph-mon[92072]: pgmap v11834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-02T17:07:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:18 smithi122 ceph-mon[125440]: pgmap v11834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-02T17:07:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:18 smithi136 ceph-mon[125702]: pgmap v11834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-02T17:07:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:20 smithi057 ceph-mon[92072]: pgmap v11835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 117 B/s wr, 11 op/s 2023-03-02T17:07:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:20 smithi122 ceph-mon[125440]: pgmap v11835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 117 B/s wr, 11 op/s 2023-03-02T17:07:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:20 smithi136 ceph-mon[125702]: pgmap v11835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 117 B/s wr, 11 op/s 2023-03-02T17:07:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:20.977+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:07:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:20.977+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:07:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:20.977+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:07:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:20.977+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:07:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:20.977+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:07:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:21 smithi136 ceph-mon[125702]: pgmap v11836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:07:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:21 smithi057 ceph-mon[92072]: pgmap v11836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:07:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:21 smithi122 ceph-mon[125440]: pgmap v11836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:07:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:24 smithi136 ceph-mon[125702]: pgmap v11837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:07:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:24 smithi057 ceph-mon[92072]: pgmap v11837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:07:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:24 smithi122 ceph-mon[125440]: pgmap v11837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:07:26.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:26 smithi136 ceph-mon[125702]: pgmap v11838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:07:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:26 smithi057 ceph-mon[92072]: pgmap v11838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:07:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:26 smithi122 ceph-mon[125440]: pgmap v11838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:07:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:28 smithi057 ceph-mon[92072]: pgmap v11839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T17:07:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:28 smithi122 ceph-mon[125440]: pgmap v11839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T17:07:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:28 smithi136 ceph-mon[125702]: pgmap v11839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T17:07:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:30 smithi057 ceph-mon[92072]: pgmap v11840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:30 smithi122 ceph-mon[125440]: pgmap v11840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:30 smithi136 ceph-mon[125702]: pgmap v11840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:31 smithi136 ceph-mon[125702]: pgmap v11841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:31 smithi057 ceph-mon[92072]: pgmap v11841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:31 smithi122 ceph-mon[125440]: pgmap v11841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:34.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:34 smithi136 ceph-mon[125702]: pgmap v11842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:34.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:34 smithi057 ceph-mon[92072]: pgmap v11842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:34 smithi122 ceph-mon[125440]: pgmap v11842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:35.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:07:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:35.991+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:07:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:35.991+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:07:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:35.991+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:07:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:35.991+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:07:36.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:36 smithi136 ceph-mon[125702]: pgmap v11843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:36 smithi057 ceph-mon[92072]: pgmap v11843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:36 smithi122 ceph-mon[125440]: pgmap v11843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:38.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:38 smithi136 ceph-mon[125702]: pgmap v11844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:38 smithi057 ceph-mon[92072]: pgmap v11844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:38 smithi122 ceph-mon[125440]: pgmap v11844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:40 smithi057 ceph-mon[92072]: pgmap v11845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:40 smithi122 ceph-mon[125440]: pgmap v11845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:40 smithi136 ceph-mon[125702]: pgmap v11845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:41 smithi136 ceph-mon[125702]: pgmap v11846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:41 smithi057 ceph-mon[92072]: pgmap v11846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:41 smithi122 ceph-mon[125440]: pgmap v11846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:44.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:44 smithi136 ceph-mon[125702]: pgmap v11847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:44.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:44 smithi057 ceph-mon[92072]: pgmap v11847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:44 smithi122 ceph-mon[125440]: pgmap v11847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:46 smithi057 ceph-mon[92072]: pgmap v11848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:46 smithi122 ceph-mon[125440]: pgmap v11848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:46.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:46 smithi136 ceph-mon[125702]: pgmap v11848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:48 smithi057 ceph-mon[92072]: pgmap v11849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:48 smithi122 ceph-mon[125440]: pgmap v11849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:48 smithi136 ceph-mon[125702]: pgmap v11849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:50 smithi057 ceph-mon[92072]: pgmap v11850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:50 smithi122 ceph-mon[125440]: pgmap v11850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:50 smithi136 ceph-mon[125702]: pgmap v11850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:51.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:51.006+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:07:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:51.007+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:07:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:51.007+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:07:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:51.007+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:07:51.008 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:07:51.007+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:07:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:51 smithi136 ceph-mon[125702]: pgmap v11851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:51 smithi057 ceph-mon[92072]: pgmap v11851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:51 smithi122 ceph-mon[125440]: pgmap v11851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:54 smithi136 ceph-mon[125702]: pgmap v11852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:54 smithi057 ceph-mon[92072]: pgmap v11852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:54.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:54 smithi122 ceph-mon[125440]: pgmap v11852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:56 smithi136 ceph-mon[125702]: pgmap v11853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:07:56.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:56 smithi057 ceph-mon[92072]: pgmap v11853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:07:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:56 smithi122 ceph-mon[125440]: pgmap v11853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:07:58.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:58 smithi057 ceph-mon[92072]: pgmap v11854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:58 smithi122 ceph-mon[125440]: pgmap v11854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:58 smithi136 ceph-mon[125702]: pgmap v11854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:07:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:07:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:07:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 45915k 2023-03-02T17:07:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 47017037: error parsing value: Value '47017037' is below minimum 939524096 2023-03-02T17:07:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:07:59 smithi136 ceph-mon[125702]: pgmap v11855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:07:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:07:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 45915k 2023-03-02T17:07:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 47017037: error parsing value: Value '47017037' is below minimum 939524096 2023-03-02T17:07:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:07:59 smithi057 ceph-mon[92072]: pgmap v11855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:07:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:07:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:07:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:07:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:07:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 45915k 2023-03-02T17:07:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 47017037: error parsing value: Value '47017037' is below minimum 939524096 2023-03-02T17:07:59.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:07:59 smithi122 ceph-mon[125440]: pgmap v11855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:08:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:08:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:08:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:08:00.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:08:00.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:08:00.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:08:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:08:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:08:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:08:00.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:08:00.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:08:00.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:08:00.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:08:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:08:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:08:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:08:00.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:08:00.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:08:00.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:08:00.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:08:00.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:08:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:01 smithi136 ceph-mon[125702]: pgmap v11856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:01 smithi057 ceph-mon[92072]: pgmap v11856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:01 smithi122 ceph-mon[125440]: pgmap v11856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:04 smithi136 ceph-mon[125702]: pgmap v11857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:08:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:04 smithi057 ceph-mon[92072]: pgmap v11857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:08:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:04 smithi122 ceph-mon[125440]: pgmap v11857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:08:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:06.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:08:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:06.010+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:08:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:06.010+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:08:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:06.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:08:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:06.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:08:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:06 smithi136 ceph-mon[125702]: pgmap v11858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:08:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:06 smithi057 ceph-mon[92072]: pgmap v11858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:08:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:06 smithi122 ceph-mon[125440]: pgmap v11858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:08:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:07 smithi136 ceph-mon[125702]: osdmap e814: 12 total, 12 up, 12 in 2023-03-02T17:08:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:07 smithi136 ceph-mon[125702]: pgmap v11860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:08:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:07 smithi057 ceph-mon[92072]: osdmap e814: 12 total, 12 up, 12 in 2023-03-02T17:08:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:07 smithi057 ceph-mon[92072]: pgmap v11860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:08:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:07 smithi122 ceph-mon[125440]: osdmap e814: 12 total, 12 up, 12 in 2023-03-02T17:08:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:07 smithi122 ceph-mon[125440]: pgmap v11860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:08:10.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:10 smithi057 ceph-mon[92072]: pgmap v11861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:08:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:10 smithi122 ceph-mon[125440]: pgmap v11861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:08:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:10 smithi136 ceph-mon[125702]: pgmap v11861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:08:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:11.565+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:08:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:11.565+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:08:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:11.566+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 173 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:08:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:11.566+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 172 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:08:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:11 smithi136 ceph-mon[125702]: pgmap v11862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:08:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:11 smithi057 ceph-mon[92072]: pgmap v11862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:08:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:11 smithi122 ceph-mon[125440]: pgmap v11862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:08:14.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:14 smithi136 ceph-mon[125702]: pgmap v11863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:08:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:14 smithi057 ceph-mon[92072]: pgmap v11863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:08:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:14 smithi122 ceph-mon[125440]: pgmap v11863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:08:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:16 smithi057 ceph-mon[92072]: pgmap v11864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:08:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:16 smithi057 ceph-mon[92072]: osdmap e815: 12 total, 12 up, 12 in 2023-03-02T17:08:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:16 smithi122 ceph-mon[125440]: pgmap v11864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:08:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:16 smithi122 ceph-mon[125440]: osdmap e815: 12 total, 12 up, 12 in 2023-03-02T17:08:16.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:16 smithi136 ceph-mon[125702]: pgmap v11864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:08:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:16 smithi136 ceph-mon[125702]: osdmap e815: 12 total, 12 up, 12 in 2023-03-02T17:08:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:18 smithi057 ceph-mon[92072]: pgmap v11866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:08:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:18 smithi122 ceph-mon[125440]: pgmap v11866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:08:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:18 smithi136 ceph-mon[125702]: pgmap v11866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:08:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:20 smithi057 ceph-mon[92072]: pgmap v11867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:08:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:20 smithi122 ceph-mon[125440]: pgmap v11867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:08:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:20 smithi136 ceph-mon[125702]: pgmap v11867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:08:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:21.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:08:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:21.018+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:08:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:21.018+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:08:21.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:21.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:08:21.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:21.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:08:21.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:21 smithi136 ceph-mon[125702]: pgmap v11868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:08:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:21 smithi057 ceph-mon[92072]: pgmap v11868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:08:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:21 smithi122 ceph-mon[125440]: pgmap v11868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:08:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:24 smithi057 ceph-mon[92072]: pgmap v11869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:08:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:24 smithi122 ceph-mon[125440]: pgmap v11869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:08:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:24 smithi136 ceph-mon[125702]: pgmap v11869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:08:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:26 smithi057 ceph-mon[92072]: pgmap v11870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:08:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:26 smithi122 ceph-mon[125440]: pgmap v11870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:08:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:26 smithi136 ceph-mon[125702]: pgmap v11870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:08:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:28 smithi057 ceph-mon[92072]: pgmap v11871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:08:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:28 smithi122 ceph-mon[125440]: pgmap v11871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:08:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:28 smithi136 ceph-mon[125702]: pgmap v11871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:08:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:30 smithi057 ceph-mon[92072]: pgmap v11872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:30 smithi122 ceph-mon[125440]: pgmap v11872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:30 smithi136 ceph-mon[125702]: pgmap v11872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:31 smithi136 ceph-mon[125702]: pgmap v11873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:31 smithi057 ceph-mon[92072]: pgmap v11873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:31 smithi122 ceph-mon[125440]: pgmap v11873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:34 smithi057 ceph-mon[92072]: pgmap v11874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:34 smithi122 ceph-mon[125440]: pgmap v11874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:34 smithi136 ceph-mon[125702]: pgmap v11874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:36.027+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:08:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:36.028+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:08:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:36.028+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:08:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:36.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:08:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:36.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:08:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:36 smithi057 ceph-mon[92072]: pgmap v11875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:08:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:36 smithi122 ceph-mon[125440]: pgmap v11875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:08:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:36 smithi136 ceph-mon[125702]: pgmap v11875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:08:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:38 smithi057 ceph-mon[92072]: pgmap v11876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:38 smithi122 ceph-mon[125440]: pgmap v11876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:38 smithi136 ceph-mon[125702]: pgmap v11876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:40 smithi057 ceph-mon[92072]: pgmap v11877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:08:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:40 smithi122 ceph-mon[125440]: pgmap v11877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:08:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:40 smithi136 ceph-mon[125702]: pgmap v11877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:08:41.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:41 smithi136 ceph-mon[125702]: pgmap v11878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:08:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:41 smithi057 ceph-mon[92072]: pgmap v11878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:08:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:41 smithi122 ceph-mon[125440]: pgmap v11878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:08:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:44 smithi057 ceph-mon[92072]: pgmap v11879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:44 smithi122 ceph-mon[125440]: pgmap v11879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:44.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:44 smithi136 ceph-mon[125702]: pgmap v11879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:46 smithi057 ceph-mon[92072]: pgmap v11880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:46 smithi122 ceph-mon[125440]: pgmap v11880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:46.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:46 smithi136 ceph-mon[125702]: pgmap v11880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:48 smithi057 ceph-mon[92072]: pgmap v11881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:48 smithi122 ceph-mon[125440]: pgmap v11881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:48 smithi136 ceph-mon[125702]: pgmap v11881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:50 smithi057 ceph-mon[92072]: pgmap v11882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:50 smithi122 ceph-mon[125440]: pgmap v11882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:50 smithi136 ceph-mon[125702]: pgmap v11882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:51.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:08:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:51.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:08:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:51.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:08:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:51.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:08:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:08:51.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:08:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:51 smithi136 ceph-mon[125702]: pgmap v11883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:51 smithi057 ceph-mon[92072]: pgmap v11883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:51 smithi122 ceph-mon[125440]: pgmap v11883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:54.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:54 smithi057 ceph-mon[92072]: pgmap v11884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:54.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:54 smithi122 ceph-mon[125440]: pgmap v11884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:54 smithi136 ceph-mon[125702]: pgmap v11884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:56 smithi057 ceph-mon[92072]: pgmap v11885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:56 smithi122 ceph-mon[125440]: pgmap v11885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:56.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:56 smithi136 ceph-mon[125702]: pgmap v11885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:08:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:08:58 smithi057 ceph-mon[92072]: pgmap v11886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:08:58 smithi122 ceph-mon[125440]: pgmap v11886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:08:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:08:58 smithi136 ceph-mon[125702]: pgmap v11886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:00 smithi057 ceph-mon[92072]: pgmap v11887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:00 smithi122 ceph-mon[125440]: pgmap v11887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:00 smithi136 ceph-mon[125702]: pgmap v11887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:09:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:09:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:09:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:09:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:09:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:09:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:09:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:09:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:09:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:09:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:09:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:09:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:02 smithi057 ceph-mon[92072]: pgmap v11888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:02 smithi122 ceph-mon[125440]: pgmap v11888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:02.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:02 smithi136 ceph-mon[125702]: pgmap v11888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:04 smithi057 ceph-mon[92072]: pgmap v11889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:09:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:04 smithi122 ceph-mon[125440]: pgmap v11889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:09:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:04 smithi136 ceph-mon[125702]: pgmap v11889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:09:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:06.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:09:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:06.058+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:09:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:06.058+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:09:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:06.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:09:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:06.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:09:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:06 smithi057 ceph-mon[92072]: pgmap v11890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:09:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:06 smithi122 ceph-mon[125440]: pgmap v11890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:09:06.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:06 smithi136 ceph-mon[125702]: pgmap v11890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:09:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:07 smithi136 ceph-mon[125702]: osdmap e816: 12 total, 12 up, 12 in 2023-03-02T17:09:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:07 smithi136 ceph-mon[125702]: pgmap v11892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:09:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:07 smithi057 ceph-mon[92072]: osdmap e816: 12 total, 12 up, 12 in 2023-03-02T17:09:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:07 smithi057 ceph-mon[92072]: pgmap v11892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:09:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:07 smithi122 ceph-mon[125440]: osdmap e816: 12 total, 12 up, 12 in 2023-03-02T17:09:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:07 smithi122 ceph-mon[125440]: pgmap v11892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:09:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:10 smithi057 ceph-mon[92072]: pgmap v11893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:09:10.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:10 smithi122 ceph-mon[125440]: pgmap v11893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:09:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:10 smithi136 ceph-mon[125702]: pgmap v11893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:09:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:11 smithi136 ceph-mon[125702]: osdmap e817: 12 total, 12 up, 12 in 2023-03-02T17:09:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:11 smithi136 ceph-mon[125702]: pgmap v11895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:09:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:11 smithi057 ceph-mon[92072]: osdmap e817: 12 total, 12 up, 12 in 2023-03-02T17:09:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:11 smithi057 ceph-mon[92072]: pgmap v11895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:09:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:11 smithi122 ceph-mon[125440]: osdmap e817: 12 total, 12 up, 12 in 2023-03-02T17:09:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:11 smithi122 ceph-mon[125440]: pgmap v11895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:09:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:14 smithi057 ceph-mon[92072]: pgmap v11896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:09:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:14 smithi122 ceph-mon[125440]: pgmap v11896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:09:14.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:14 smithi136 ceph-mon[125702]: pgmap v11896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:09:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:16 smithi057 ceph-mon[92072]: pgmap v11897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:09:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:16 smithi122 ceph-mon[125440]: pgmap v11897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:09:16.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:16 smithi136 ceph-mon[125702]: pgmap v11897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:09:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:18 smithi057 ceph-mon[92072]: pgmap v11898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:09:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:18 smithi122 ceph-mon[125440]: pgmap v11898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:09:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:18 smithi136 ceph-mon[125702]: pgmap v11898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:09:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:20 smithi057 ceph-mon[92072]: pgmap v11899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:09:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:20 smithi122 ceph-mon[125440]: pgmap v11899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:09:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:20 smithi136 ceph-mon[125702]: pgmap v11899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:09:21.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:21.075+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:09:21.076 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:21.075+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:09:21.076 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:21.075+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:09:21.076 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:21.075+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:09:21.076 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:21.075+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:09:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:21 smithi136 ceph-mon[125702]: pgmap v11900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:09:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:21 smithi057 ceph-mon[92072]: pgmap v11900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:09:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:21 smithi122 ceph-mon[125440]: pgmap v11900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:09:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:24 smithi057 ceph-mon[92072]: pgmap v11901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:09:24.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:24 smithi122 ceph-mon[125440]: pgmap v11901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:09:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:24 smithi136 ceph-mon[125702]: pgmap v11901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:09:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:26 smithi057 ceph-mon[92072]: pgmap v11902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:26 smithi122 ceph-mon[125440]: pgmap v11902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:26 smithi136 ceph-mon[125702]: pgmap v11902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:28 smithi057 ceph-mon[92072]: pgmap v11903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:09:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:28 smithi122 ceph-mon[125440]: pgmap v11903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:09:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:28 smithi136 ceph-mon[125702]: pgmap v11903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:09:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:30 smithi057 ceph-mon[92072]: pgmap v11904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:30 smithi122 ceph-mon[125440]: pgmap v11904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:30 smithi136 ceph-mon[125702]: pgmap v11904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:31.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:31 smithi136 ceph-mon[125702]: pgmap v11905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:31 smithi057 ceph-mon[92072]: pgmap v11905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:31 smithi122 ceph-mon[125440]: pgmap v11905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:34 smithi057 ceph-mon[92072]: pgmap v11906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:34 smithi122 ceph-mon[125440]: pgmap v11906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:34 smithi136 ceph-mon[125702]: pgmap v11906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:36.083+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:09:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:36.083+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:09:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:36.083+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:09:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:36.083+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:09:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:36.083+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:09:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:36 smithi057 ceph-mon[92072]: pgmap v11907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:36 smithi122 ceph-mon[125440]: pgmap v11907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:36 smithi136 ceph-mon[125702]: pgmap v11907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:38 smithi057 ceph-mon[92072]: pgmap v11908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:38 smithi122 ceph-mon[125440]: pgmap v11908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:38 smithi136 ceph-mon[125702]: pgmap v11908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:40 smithi057 ceph-mon[92072]: pgmap v11909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:40 smithi122 ceph-mon[125440]: pgmap v11909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:40 smithi136 ceph-mon[125702]: pgmap v11909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:41 smithi057 ceph-mon[92072]: pgmap v11910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:41 smithi122 ceph-mon[125440]: pgmap v11910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:41 smithi136 ceph-mon[125702]: pgmap v11910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:44 smithi057 ceph-mon[92072]: pgmap v11911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:44 smithi122 ceph-mon[125440]: pgmap v11911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:44 smithi136 ceph-mon[125702]: pgmap v11911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:46 smithi057 ceph-mon[92072]: pgmap v11912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:46 smithi122 ceph-mon[125440]: pgmap v11912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:46.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:46 smithi136 ceph-mon[125702]: pgmap v11912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:48 smithi057 ceph-mon[92072]: pgmap v11913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:48 smithi122 ceph-mon[125440]: pgmap v11913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:48 smithi136 ceph-mon[125702]: pgmap v11913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:50 smithi057 ceph-mon[92072]: pgmap v11914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:50 smithi122 ceph-mon[125440]: pgmap v11914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:50 smithi136 ceph-mon[125702]: pgmap v11914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:51.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:51.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:09:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:51.093+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:09:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:51.093+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:09:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:51.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:09:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:09:51.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:09:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:51 smithi136 ceph-mon[125702]: pgmap v11915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:51 smithi057 ceph-mon[92072]: pgmap v11915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:51 smithi122 ceph-mon[125440]: pgmap v11915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:54 smithi057 ceph-mon[92072]: pgmap v11916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:54 smithi122 ceph-mon[125440]: pgmap v11916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:54 smithi136 ceph-mon[125702]: pgmap v11916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:56 smithi057 ceph-mon[92072]: pgmap v11917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:56 smithi122 ceph-mon[125440]: pgmap v11917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:56.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:56 smithi136 ceph-mon[125702]: pgmap v11917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:09:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:09:58 smithi057 ceph-mon[92072]: pgmap v11918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:09:58 smithi122 ceph-mon[125440]: pgmap v11918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:09:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:09:58 smithi136 ceph-mon[125702]: pgmap v11918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:00 smithi057 ceph-mon[92072]: pgmap v11919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T17:10:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:00 smithi122 ceph-mon[125440]: pgmap v11919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T17:10:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:00 smithi136 ceph-mon[125702]: pgmap v11919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T17:10:01.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:01 smithi057 ceph-mon[92072]: pgmap v11920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:10:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:01 smithi122 ceph-mon[125440]: pgmap v11920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:10:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:01 smithi136 ceph-mon[125702]: pgmap v11920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:10:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:10:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:10:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:10:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:10:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:10:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:10:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:10:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:10:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:10:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:10:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:10:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:10:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:10:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:10:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:10:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:03 smithi136 ceph-mon[125702]: pgmap v11921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:10:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:03 smithi057 ceph-mon[92072]: pgmap v11921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:10:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:03 smithi122 ceph-mon[125440]: pgmap v11921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:10:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:06.109+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:10:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:06.109+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:10:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:06.109+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:10:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:06.109+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:10:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:06.109+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:10:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:06 smithi057 ceph-mon[92072]: pgmap v11922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:10:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:06 smithi122 ceph-mon[125440]: pgmap v11922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:10:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:06 smithi136 ceph-mon[125702]: pgmap v11922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:10:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:07 smithi057 ceph-mon[92072]: osdmap e818: 12 total, 12 up, 12 in 2023-03-02T17:10:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:07 smithi057 ceph-mon[92072]: pgmap v11924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:10:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:07 smithi122 ceph-mon[125440]: osdmap e818: 12 total, 12 up, 12 in 2023-03-02T17:10:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:07 smithi122 ceph-mon[125440]: pgmap v11924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:10:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:07 smithi136 ceph-mon[125702]: osdmap e818: 12 total, 12 up, 12 in 2023-03-02T17:10:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:07 smithi136 ceph-mon[125702]: pgmap v11924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:10:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:10 smithi057 ceph-mon[92072]: pgmap v11925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:10:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:10 smithi122 ceph-mon[125440]: pgmap v11925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:10:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:10 smithi136 ceph-mon[125702]: pgmap v11925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:10:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:11 smithi057 ceph-mon[92072]: pgmap v11926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:10:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:11 smithi122 ceph-mon[125440]: pgmap v11926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:10:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:11 smithi136 ceph-mon[125702]: pgmap v11926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:10:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:14 smithi057 ceph-mon[92072]: pgmap v11927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:10:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:14 smithi122 ceph-mon[125440]: pgmap v11927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:10:14.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:14 smithi136 ceph-mon[125702]: pgmap v11927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:10:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:16 smithi057 ceph-mon[92072]: pgmap v11928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:10:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:16 smithi057 ceph-mon[92072]: osdmap e819: 12 total, 12 up, 12 in 2023-03-02T17:10:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:16 smithi122 ceph-mon[125440]: pgmap v11928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:10:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:16 smithi122 ceph-mon[125440]: osdmap e819: 12 total, 12 up, 12 in 2023-03-02T17:10:16.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:16 smithi136 ceph-mon[125702]: pgmap v11928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:10:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:16 smithi136 ceph-mon[125702]: osdmap e819: 12 total, 12 up, 12 in 2023-03-02T17:10:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:18 smithi057 ceph-mon[92072]: pgmap v11930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:10:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:18 smithi122 ceph-mon[125440]: pgmap v11930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:10:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:18 smithi136 ceph-mon[125702]: pgmap v11930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:10:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:20 smithi057 ceph-mon[92072]: pgmap v11931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:10:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:20 smithi122 ceph-mon[125440]: pgmap v11931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:10:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:20 smithi136 ceph-mon[125702]: pgmap v11931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:10:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:21.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:10:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:21.114+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:10:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:21.114+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:10:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:21.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:10:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:21.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:10:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:21 smithi057 ceph-mon[92072]: pgmap v11932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:10:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:21 smithi122 ceph-mon[125440]: pgmap v11932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:10:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:21 smithi136 ceph-mon[125702]: pgmap v11932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:10:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:24 smithi057 ceph-mon[92072]: pgmap v11933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:10:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:24 smithi122 ceph-mon[125440]: pgmap v11933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:10:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:24 smithi136 ceph-mon[125702]: pgmap v11933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:10:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:26 smithi057 ceph-mon[92072]: pgmap v11934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:10:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:26 smithi122 ceph-mon[125440]: pgmap v11934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:10:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:26.586+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:10:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:26.586+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:10:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:26.586+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 173 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:10:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:26.586+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 174 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:10:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:26 smithi136 ceph-mon[125702]: pgmap v11934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:10:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:28 smithi057 ceph-mon[92072]: pgmap v11935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:10:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:28 smithi122 ceph-mon[125440]: pgmap v11935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:10:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:28 smithi136 ceph-mon[125702]: pgmap v11935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:10:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:30 smithi057 ceph-mon[92072]: pgmap v11936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:30 smithi122 ceph-mon[125440]: pgmap v11936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:30 smithi136 ceph-mon[125702]: pgmap v11936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:31 smithi057 ceph-mon[92072]: pgmap v11937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:31 smithi122 ceph-mon[125440]: pgmap v11937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:31 smithi136 ceph-mon[125702]: pgmap v11937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:34 smithi057 ceph-mon[92072]: pgmap v11938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:34 smithi122 ceph-mon[125440]: pgmap v11938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:34 smithi136 ceph-mon[125702]: pgmap v11938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:36.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:36.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:10:36.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:36.128+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:10:36.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:36.128+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:10:36.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:36.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:10:36.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:36.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:10:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:36 smithi057 ceph-mon[92072]: pgmap v11939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:36 smithi122 ceph-mon[125440]: pgmap v11939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:36 smithi136 ceph-mon[125702]: pgmap v11939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:38 smithi057 ceph-mon[92072]: pgmap v11940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:38.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:38 smithi122 ceph-mon[125440]: pgmap v11940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:38 smithi136 ceph-mon[125702]: pgmap v11940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:40 smithi057 ceph-mon[92072]: pgmap v11941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:40 smithi122 ceph-mon[125440]: pgmap v11941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:40 smithi136 ceph-mon[125702]: pgmap v11941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:41 smithi057 ceph-mon[92072]: pgmap v11942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:41 smithi122 ceph-mon[125440]: pgmap v11942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:41 smithi136 ceph-mon[125702]: pgmap v11942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:44 smithi057 ceph-mon[92072]: pgmap v11943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:44 smithi122 ceph-mon[125440]: pgmap v11943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:44.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:44 smithi136 ceph-mon[125702]: pgmap v11943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:46 smithi057 ceph-mon[92072]: pgmap v11944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:46 smithi122 ceph-mon[125440]: pgmap v11944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:46 smithi136 ceph-mon[125702]: pgmap v11944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:48.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:48 smithi057 ceph-mon[92072]: pgmap v11945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:48 smithi122 ceph-mon[125440]: pgmap v11945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:48 smithi136 ceph-mon[125702]: pgmap v11945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:50 smithi057 ceph-mon[92072]: pgmap v11946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:50 smithi122 ceph-mon[125440]: pgmap v11946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:50 smithi136 ceph-mon[125702]: pgmap v11946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:51.142+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:10:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:51.142+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:10:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:51.142+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:10:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:51.142+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:10:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:10:51.142+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:10:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:51 smithi057 ceph-mon[92072]: pgmap v11947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:51 smithi122 ceph-mon[125440]: pgmap v11947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:51 smithi136 ceph-mon[125702]: pgmap v11947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:54 smithi057 ceph-mon[92072]: pgmap v11948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:54 smithi122 ceph-mon[125440]: pgmap v11948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:54 smithi136 ceph-mon[125702]: pgmap v11948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:56 smithi057 ceph-mon[92072]: pgmap v11949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:56 smithi122 ceph-mon[125440]: pgmap v11949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:56.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:56 smithi136 ceph-mon[125702]: pgmap v11949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:10:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:10:58 smithi057 ceph-mon[92072]: pgmap v11950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:10:58 smithi122 ceph-mon[125440]: pgmap v11950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:10:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:10:58 smithi136 ceph-mon[125702]: pgmap v11950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:00 smithi057 ceph-mon[92072]: pgmap v11951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:00 smithi122 ceph-mon[125440]: pgmap v11951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:00 smithi136 ceph-mon[125702]: pgmap v11951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:01 smithi057 ceph-mon[92072]: pgmap v11952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:01 smithi122 ceph-mon[125440]: pgmap v11952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:01 smithi136 ceph-mon[125702]: pgmap v11952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:11:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:11:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:11:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:04 smithi057 ceph-mon[92072]: pgmap v11953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:11:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:11:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:11:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:04 smithi122 ceph-mon[125440]: pgmap v11953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:11:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:11:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:11:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:04 smithi136 ceph-mon[125702]: pgmap v11953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:11:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:11:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:11:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:11:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:06.156+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:11:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:06.157+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:11:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:06.157+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:11:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:06.157+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:11:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:06.157+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:11:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:06 smithi057 ceph-mon[92072]: pgmap v11954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:11:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:06 smithi122 ceph-mon[125440]: pgmap v11954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:11:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:06 smithi136 ceph-mon[125702]: pgmap v11954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:11:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:07 smithi057 ceph-mon[92072]: osdmap e820: 12 total, 12 up, 12 in 2023-03-02T17:11:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:07 smithi057 ceph-mon[92072]: pgmap v11956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:11:07.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:07 smithi122 ceph-mon[125440]: osdmap e820: 12 total, 12 up, 12 in 2023-03-02T17:11:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:07 smithi122 ceph-mon[125440]: pgmap v11956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:11:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:07 smithi136 ceph-mon[125702]: osdmap e820: 12 total, 12 up, 12 in 2023-03-02T17:11:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:07 smithi136 ceph-mon[125702]: pgmap v11956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:11:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:10 smithi057 ceph-mon[92072]: pgmap v11957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:11:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:10 smithi122 ceph-mon[125440]: pgmap v11957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:11:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:10 smithi136 ceph-mon[125702]: pgmap v11957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:11:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:11.593+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:11:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:11.593+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:11:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:11.593+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 175 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:11:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:11.593+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 174 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:11:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:11 smithi057 ceph-mon[92072]: pgmap v11958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:11:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:11 smithi122 ceph-mon[125440]: pgmap v11958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:11:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:11 smithi136 ceph-mon[125702]: pgmap v11958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:11:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:14 smithi057 ceph-mon[92072]: pgmap v11959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:11:14.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:14 smithi122 ceph-mon[125440]: pgmap v11959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:11:14.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:14 smithi136 ceph-mon[125702]: pgmap v11959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:11:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:16 smithi057 ceph-mon[92072]: pgmap v11960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:11:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:16 smithi057 ceph-mon[92072]: osdmap e821: 12 total, 12 up, 12 in 2023-03-02T17:11:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:16 smithi122 ceph-mon[125440]: pgmap v11960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:11:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:16 smithi122 ceph-mon[125440]: osdmap e821: 12 total, 12 up, 12 in 2023-03-02T17:11:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:16 smithi136 ceph-mon[125702]: pgmap v11960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:11:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:16 smithi136 ceph-mon[125702]: osdmap e821: 12 total, 12 up, 12 in 2023-03-02T17:11:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:18 smithi057 ceph-mon[92072]: pgmap v11962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:11:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:18 smithi122 ceph-mon[125440]: pgmap v11962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:11:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:18 smithi136 ceph-mon[125702]: pgmap v11962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:11:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:20 smithi057 ceph-mon[92072]: pgmap v11963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:11:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:20 smithi122 ceph-mon[125440]: pgmap v11963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:11:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:20 smithi136 ceph-mon[125702]: pgmap v11963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:11:21.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:21.171+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:11:21.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:21.171+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:11:21.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:21.171+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:11:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:21.171+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:11:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:21.171+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:11:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:21 smithi057 ceph-mon[92072]: pgmap v11964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:11:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:21 smithi122 ceph-mon[125440]: pgmap v11964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:11:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:21 smithi136 ceph-mon[125702]: pgmap v11964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:11:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:24 smithi057 ceph-mon[92072]: pgmap v11965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:11:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:24 smithi122 ceph-mon[125440]: pgmap v11965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:11:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:24 smithi136 ceph-mon[125702]: pgmap v11965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:11:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:26 smithi057 ceph-mon[92072]: pgmap v11966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:11:26.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:26 smithi122 ceph-mon[125440]: pgmap v11966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:11:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:26 smithi136 ceph-mon[125702]: pgmap v11966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:11:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:28 smithi057 ceph-mon[92072]: pgmap v11967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:11:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:28 smithi122 ceph-mon[125440]: pgmap v11967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:11:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:28 smithi136 ceph-mon[125702]: pgmap v11967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:11:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:30 smithi057 ceph-mon[92072]: pgmap v11968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:30 smithi122 ceph-mon[125440]: pgmap v11968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:30 smithi136 ceph-mon[125702]: pgmap v11968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:31 smithi057 ceph-mon[92072]: pgmap v11969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:31 smithi122 ceph-mon[125440]: pgmap v11969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:31 smithi136 ceph-mon[125702]: pgmap v11969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:34 smithi057 ceph-mon[92072]: pgmap v11970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:34 smithi122 ceph-mon[125440]: pgmap v11970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:34 smithi136 ceph-mon[125702]: pgmap v11970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:36.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:11:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:36.183+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:11:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:36.183+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:11:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:36.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:11:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:36.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:11:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:36 smithi057 ceph-mon[92072]: pgmap v11971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:36 smithi122 ceph-mon[125440]: pgmap v11971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:36 smithi136 ceph-mon[125702]: pgmap v11971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:38 smithi057 ceph-mon[92072]: pgmap v11972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:38 smithi122 ceph-mon[125440]: pgmap v11972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:38 smithi136 ceph-mon[125702]: pgmap v11972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:40 smithi057 ceph-mon[92072]: pgmap v11973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:40 smithi122 ceph-mon[125440]: pgmap v11973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:40 smithi136 ceph-mon[125702]: pgmap v11973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:41 smithi057 ceph-mon[92072]: pgmap v11974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:41 smithi122 ceph-mon[125440]: pgmap v11974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:41 smithi136 ceph-mon[125702]: pgmap v11974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:44 smithi057 ceph-mon[92072]: pgmap v11975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:44 smithi122 ceph-mon[125440]: pgmap v11975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:44.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:44 smithi136 ceph-mon[125702]: pgmap v11975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:46 smithi057 ceph-mon[92072]: pgmap v11976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:46 smithi122 ceph-mon[125440]: pgmap v11976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:46.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:46 smithi136 ceph-mon[125702]: pgmap v11976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:48 smithi057 ceph-mon[92072]: pgmap v11977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:48 smithi122 ceph-mon[125440]: pgmap v11977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:48 smithi136 ceph-mon[125702]: pgmap v11977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:50 smithi057 ceph-mon[92072]: pgmap v11978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:50 smithi122 ceph-mon[125440]: pgmap v11978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:50 smithi136 ceph-mon[125702]: pgmap v11978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:51.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:11:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:51.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:11:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:51.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:11:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:51.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:11:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:11:51.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:11:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:51 smithi057 ceph-mon[92072]: pgmap v11979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:51 smithi122 ceph-mon[125440]: pgmap v11979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:51 smithi136 ceph-mon[125702]: pgmap v11979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:54 smithi057 ceph-mon[92072]: pgmap v11980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:54 smithi122 ceph-mon[125440]: pgmap v11980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:54 smithi136 ceph-mon[125702]: pgmap v11980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:56 smithi057 ceph-mon[92072]: pgmap v11981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:56 smithi122 ceph-mon[125440]: pgmap v11981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:56 smithi136 ceph-mon[125702]: pgmap v11981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:11:58.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:11:58 smithi057 ceph-mon[92072]: pgmap v11982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:58.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:11:58 smithi122 ceph-mon[125440]: pgmap v11982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:11:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:11:58 smithi136 ceph-mon[125702]: pgmap v11982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:00 smithi057 ceph-mon[92072]: pgmap v11983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:00 smithi122 ceph-mon[125440]: pgmap v11983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:00 smithi136 ceph-mon[125702]: pgmap v11983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:01 smithi057 ceph-mon[92072]: pgmap v11984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:01 smithi122 ceph-mon[125440]: pgmap v11984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:01 smithi136 ceph-mon[125702]: pgmap v11984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:04 smithi057 ceph-mon[92072]: pgmap v11985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:12:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:12:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:04 smithi122 ceph-mon[125440]: pgmap v11985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:12:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:12:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:04 smithi136 ceph-mon[125702]: pgmap v11985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:12:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:12:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:12:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:12:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:12:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:12:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:12:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:12:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:12:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:12:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:12:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:06.209+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:12:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:06.209+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:12:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:06.209+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:12:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:06.209+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:12:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:06.209+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:12:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:06 smithi057 ceph-mon[92072]: pgmap v11986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:12:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:06 smithi122 ceph-mon[125440]: pgmap v11986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:12:06.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:06 smithi136 ceph-mon[125702]: pgmap v11986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:12:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:07 smithi136 ceph-mon[125702]: osdmap e822: 12 total, 12 up, 12 in 2023-03-02T17:12:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:07 smithi136 ceph-mon[125702]: pgmap v11988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:12:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:07 smithi057 ceph-mon[92072]: osdmap e822: 12 total, 12 up, 12 in 2023-03-02T17:12:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:07 smithi057 ceph-mon[92072]: pgmap v11988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:12:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:07 smithi122 ceph-mon[125440]: osdmap e822: 12 total, 12 up, 12 in 2023-03-02T17:12:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:07 smithi122 ceph-mon[125440]: pgmap v11988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:12:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:10 smithi057 ceph-mon[92072]: pgmap v11989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:12:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:10 smithi122 ceph-mon[125440]: pgmap v11989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:12:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:10 smithi136 ceph-mon[125702]: pgmap v11989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:12:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:11 smithi057 ceph-mon[92072]: pgmap v11990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:12:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:11 smithi122 ceph-mon[125440]: pgmap v11990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:12:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:11 smithi136 ceph-mon[125702]: pgmap v11990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:12:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:14 smithi057 ceph-mon[92072]: pgmap v11991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:12:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:14 smithi122 ceph-mon[125440]: pgmap v11991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:12:14.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:14 smithi136 ceph-mon[125702]: pgmap v11991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:12:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:16 smithi057 ceph-mon[92072]: pgmap v11992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:12:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:16 smithi057 ceph-mon[92072]: osdmap e823: 12 total, 12 up, 12 in 2023-03-02T17:12:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:16 smithi122 ceph-mon[125440]: pgmap v11992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:12:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:16 smithi122 ceph-mon[125440]: osdmap e823: 12 total, 12 up, 12 in 2023-03-02T17:12:16.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:16 smithi136 ceph-mon[125702]: pgmap v11992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:12:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:16 smithi136 ceph-mon[125702]: osdmap e823: 12 total, 12 up, 12 in 2023-03-02T17:12:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:18 smithi057 ceph-mon[92072]: pgmap v11994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:12:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:18 smithi122 ceph-mon[125440]: pgmap v11994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:12:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:18 smithi136 ceph-mon[125702]: pgmap v11994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:12:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:20 smithi057 ceph-mon[92072]: pgmap v11995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:12:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:20 smithi122 ceph-mon[125440]: pgmap v11995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:12:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:20 smithi136 ceph-mon[125702]: pgmap v11995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:12:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:21.213+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:12:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:21.213+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:12:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:21.213+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:12:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:21.213+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:12:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:21.213+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:12:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:21 smithi057 ceph-mon[92072]: pgmap v11996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:12:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:21 smithi122 ceph-mon[125440]: pgmap v11996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:12:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:21 smithi136 ceph-mon[125702]: pgmap v11996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:12:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:24 smithi057 ceph-mon[92072]: pgmap v11997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:12:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:24 smithi122 ceph-mon[125440]: pgmap v11997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:12:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:24 smithi136 ceph-mon[125702]: pgmap v11997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:12:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:26 smithi057 ceph-mon[92072]: pgmap v11998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:12:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:26 smithi122 ceph-mon[125440]: pgmap v11998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:12:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:26 smithi136 ceph-mon[125702]: pgmap v11998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:12:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:28 smithi057 ceph-mon[92072]: pgmap v11999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:12:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:28 smithi122 ceph-mon[125440]: pgmap v11999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:12:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:28 smithi136 ceph-mon[125702]: pgmap v11999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:12:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:30 smithi057 ceph-mon[92072]: pgmap v12000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:30 smithi122 ceph-mon[125440]: pgmap v12000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:30 smithi136 ceph-mon[125702]: pgmap v12000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:31 smithi057 ceph-mon[92072]: pgmap v12001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:31 smithi122 ceph-mon[125440]: pgmap v12001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:31 smithi136 ceph-mon[125702]: pgmap v12001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:34 smithi057 ceph-mon[92072]: pgmap v12002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:34 smithi122 ceph-mon[125440]: pgmap v12002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:34 smithi136 ceph-mon[125702]: pgmap v12002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:36.227+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:12:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:36.227+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:12:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:36.227+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:12:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:36.227+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:12:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:36.228+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:12:36.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:36 smithi057 ceph-mon[92072]: pgmap v12003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:36 smithi122 ceph-mon[125440]: pgmap v12003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:36 smithi136 ceph-mon[125702]: pgmap v12003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:38 smithi057 ceph-mon[92072]: pgmap v12004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:38 smithi122 ceph-mon[125440]: pgmap v12004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:38 smithi136 ceph-mon[125702]: pgmap v12004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:40 smithi057 ceph-mon[92072]: pgmap v12005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:40 smithi122 ceph-mon[125440]: pgmap v12005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:40 smithi136 ceph-mon[125702]: pgmap v12005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:41 smithi057 ceph-mon[92072]: pgmap v12006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:41 smithi122 ceph-mon[125440]: pgmap v12006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:41 smithi136 ceph-mon[125702]: pgmap v12006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:44 smithi057 ceph-mon[92072]: pgmap v12007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:44 smithi122 ceph-mon[125440]: pgmap v12007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:44.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:44 smithi136 ceph-mon[125702]: pgmap v12007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:46 smithi057 ceph-mon[92072]: pgmap v12008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:46 smithi122 ceph-mon[125440]: pgmap v12008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:46.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:46 smithi136 ceph-mon[125702]: pgmap v12008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:48 smithi122 ceph-mon[125440]: pgmap v12009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:48 smithi136 ceph-mon[125702]: pgmap v12009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:48 smithi057 ceph-mon[92072]: pgmap v12009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:50 smithi122 ceph-mon[125440]: pgmap v12010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:50 smithi136 ceph-mon[125702]: pgmap v12010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:50 smithi057 ceph-mon[92072]: pgmap v12010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:51.243+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:12:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:51.243+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:12:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:51.243+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:12:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:51.243+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:12:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:12:51.243+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:12:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:51 smithi057 ceph-mon[92072]: pgmap v12011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:51 smithi122 ceph-mon[125440]: pgmap v12011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:51 smithi136 ceph-mon[125702]: pgmap v12011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:54 smithi057 ceph-mon[92072]: pgmap v12012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:54 smithi122 ceph-mon[125440]: pgmap v12012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:54 smithi136 ceph-mon[125702]: pgmap v12012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:56 smithi122 ceph-mon[125440]: pgmap v12013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:56.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:56 smithi136 ceph-mon[125702]: pgmap v12013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:56 smithi057 ceph-mon[92072]: pgmap v12013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:12:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:12:58 smithi122 ceph-mon[125440]: pgmap v12014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:12:58 smithi136 ceph-mon[125702]: pgmap v12014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:12:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:12:58 smithi057 ceph-mon[92072]: pgmap v12014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:00 smithi122 ceph-mon[125440]: pgmap v12015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:00 smithi136 ceph-mon[125702]: pgmap v12015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:00 smithi057 ceph-mon[92072]: pgmap v12015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:01 smithi057 ceph-mon[92072]: pgmap v12016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:01.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:01 smithi122 ceph-mon[125440]: pgmap v12016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:01 smithi136 ceph-mon[125702]: pgmap v12016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:04 smithi057 ceph-mon[92072]: pgmap v12017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:13:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:04 smithi122 ceph-mon[125440]: pgmap v12017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:13:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:04 smithi136 ceph-mon[125702]: pgmap v12017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:13:05.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:13:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:13:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:13:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:06.254+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:13:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:06.254+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:13:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:06.254+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:13:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:06.254+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:13:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:06.254+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:13:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:06 smithi057 ceph-mon[92072]: pgmap v12018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:13:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:13:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:13:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:13:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:06 smithi122 ceph-mon[125440]: pgmap v12018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:13:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:13:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:13:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:13:06.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:06 smithi136 ceph-mon[125702]: pgmap v12018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:13:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:13:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:13:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:13:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:08 smithi122 ceph-mon[125440]: pgmap v12019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:13:08.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:08 smithi136 ceph-mon[125702]: pgmap v12019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:13:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:08 smithi057 ceph-mon[92072]: pgmap v12019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:13:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:10 smithi122 ceph-mon[125440]: pgmap v12020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:13:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:10 smithi136 ceph-mon[125702]: pgmap v12020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:13:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:10 smithi057 ceph-mon[92072]: pgmap v12020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:13:11.681 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:11 smithi057 ceph-mon[92072]: pgmap v12021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:13:11.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:11 smithi122 ceph-mon[125440]: pgmap v12021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:13:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:11 smithi136 ceph-mon[125702]: pgmap v12021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:13:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:12 smithi057 ceph-mon[92072]: osdmap e824: 12 total, 12 up, 12 in 2023-03-02T17:13:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:12 smithi122 ceph-mon[125440]: osdmap e824: 12 total, 12 up, 12 in 2023-03-02T17:13:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:12 smithi136 ceph-mon[125702]: osdmap e824: 12 total, 12 up, 12 in 2023-03-02T17:13:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:13 smithi057 ceph-mon[92072]: pgmap v12023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:13 smithi122 ceph-mon[125440]: pgmap v12023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:13 smithi136 ceph-mon[125702]: pgmap v12023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:16 smithi057 ceph-mon[92072]: pgmap v12024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:16 smithi122 ceph-mon[125440]: pgmap v12024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:16.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:16 smithi136 ceph-mon[125702]: pgmap v12024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:18 smithi122 ceph-mon[125440]: pgmap v12025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:18 smithi136 ceph-mon[125702]: pgmap v12025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:18 smithi057 ceph-mon[92072]: pgmap v12025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:20 smithi122 ceph-mon[125440]: pgmap v12026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:20 smithi136 ceph-mon[125702]: pgmap v12026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:20 smithi057 ceph-mon[92072]: pgmap v12026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:13:21.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:21.264+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:13:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:21.264+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:13:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:21.264+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:13:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:21.264+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:13:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:21.264+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:13:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:21 smithi057 ceph-mon[92072]: osdmap e825: 12 total, 12 up, 12 in 2023-03-02T17:13:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:21 smithi057 ceph-mon[92072]: pgmap v12028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:13:21.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:21 smithi122 ceph-mon[125440]: osdmap e825: 12 total, 12 up, 12 in 2023-03-02T17:13:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:21 smithi122 ceph-mon[125440]: pgmap v12028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:13:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:21 smithi136 ceph-mon[125702]: osdmap e825: 12 total, 12 up, 12 in 2023-03-02T17:13:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:21 smithi136 ceph-mon[125702]: pgmap v12028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:13:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:24 smithi122 ceph-mon[125440]: pgmap v12029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:13:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:24 smithi136 ceph-mon[125702]: pgmap v12029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:13:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:24 smithi057 ceph-mon[92072]: pgmap v12029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:13:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:26 smithi122 ceph-mon[125440]: pgmap v12030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:13:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:26 smithi136 ceph-mon[125702]: pgmap v12030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:13:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:26 smithi057 ceph-mon[92072]: pgmap v12030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:13:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:28 smithi122 ceph-mon[125440]: pgmap v12031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:13:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:28 smithi136 ceph-mon[125702]: pgmap v12031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:13:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:28 smithi057 ceph-mon[92072]: pgmap v12031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:13:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:30 smithi136 ceph-mon[125702]: pgmap v12032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:13:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:30 smithi057 ceph-mon[92072]: pgmap v12032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:13:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:30 smithi122 ceph-mon[125440]: pgmap v12032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:13:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:31 smithi057 ceph-mon[92072]: pgmap v12033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:13:31.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:31 smithi122 ceph-mon[125440]: pgmap v12033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:13:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:31 smithi136 ceph-mon[125702]: pgmap v12033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:13:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:34 smithi057 ceph-mon[92072]: pgmap v12034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:34 smithi122 ceph-mon[125440]: pgmap v12034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:34 smithi136 ceph-mon[125702]: pgmap v12034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:36.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:13:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:36.279+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:13:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:36.279+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:13:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:36.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:13:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:36.279+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:13:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:36 smithi122 ceph-mon[125440]: pgmap v12035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:36 smithi136 ceph-mon[125702]: pgmap v12035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:36 smithi057 ceph-mon[92072]: pgmap v12035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:38 smithi122 ceph-mon[125440]: pgmap v12036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:38 smithi136 ceph-mon[125702]: pgmap v12036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:38 smithi057 ceph-mon[92072]: pgmap v12036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:40 smithi136 ceph-mon[125702]: pgmap v12037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:40 smithi057 ceph-mon[92072]: pgmap v12037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:40 smithi122 ceph-mon[125440]: pgmap v12037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:41 smithi057 ceph-mon[92072]: pgmap v12038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:41.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:41 smithi122 ceph-mon[125440]: pgmap v12038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:41 smithi136 ceph-mon[125702]: pgmap v12038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:44 smithi122 ceph-mon[125440]: pgmap v12039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:44.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:44 smithi136 ceph-mon[125702]: pgmap v12039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:44 smithi057 ceph-mon[92072]: pgmap v12039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:46 smithi122 ceph-mon[125440]: pgmap v12040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:46.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:46 smithi136 ceph-mon[125702]: pgmap v12040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:46 smithi057 ceph-mon[92072]: pgmap v12040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:48 smithi122 ceph-mon[125440]: pgmap v12041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:48 smithi136 ceph-mon[125702]: pgmap v12041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:48 smithi057 ceph-mon[92072]: pgmap v12041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:50 smithi122 ceph-mon[125440]: pgmap v12042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:50 smithi136 ceph-mon[125702]: pgmap v12042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:50 smithi057 ceph-mon[92072]: pgmap v12042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:51.292+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:13:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:51.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:13:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:51.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:13:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:51.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:13:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:13:51.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:13:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:51 smithi057 ceph-mon[92072]: pgmap v12043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:51 smithi122 ceph-mon[125440]: pgmap v12043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:51 smithi136 ceph-mon[125702]: pgmap v12043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:54 smithi122 ceph-mon[125440]: pgmap v12044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:54 smithi136 ceph-mon[125702]: pgmap v12044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:54 smithi057 ceph-mon[92072]: pgmap v12044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:56 smithi122 ceph-mon[125440]: pgmap v12045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:56.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:56 smithi136 ceph-mon[125702]: pgmap v12045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:56 smithi057 ceph-mon[92072]: pgmap v12045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:13:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:13:58 smithi136 ceph-mon[125702]: pgmap v12046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:13:58 smithi057 ceph-mon[92072]: pgmap v12046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:13:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:13:58 smithi122 ceph-mon[125440]: pgmap v12046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:00 smithi136 ceph-mon[125702]: pgmap v12047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:00 smithi057 ceph-mon[92072]: pgmap v12047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:00 smithi122 ceph-mon[125440]: pgmap v12047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:01 smithi057 ceph-mon[92072]: pgmap v12048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:01 smithi122 ceph-mon[125440]: pgmap v12048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:01 smithi136 ceph-mon[125702]: pgmap v12048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:04 smithi122 ceph-mon[125440]: pgmap v12049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:14:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:04 smithi136 ceph-mon[125702]: pgmap v12049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:14:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:04 smithi057 ceph-mon[92072]: pgmap v12049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:14:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:06.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:14:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:06.305+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:14:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:06.305+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:14:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:06.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:14:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:06.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:14:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:06 smithi122 ceph-mon[125440]: pgmap v12050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:14:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:14:06.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:06 smithi136 ceph-mon[125702]: pgmap v12050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:14:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:14:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:06 smithi057 ceph-mon[92072]: pgmap v12050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:14:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:14:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:14:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:14:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:14:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:14:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:14:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:14:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:14:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:14:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:14:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:08.415+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T17:14:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:08.415+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T17:14:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:08.415+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5870019fd0 tx=0x7f5870056000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:14:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:08.415+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5870019fd0 tx=0x7f5870056000 comp rx=0 tx=0).stop 2023-03-02T17:14:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:08.415+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T17:14:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:08.415+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T17:14:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:08.415+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T17:14:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:08.415+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T17:14:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:08.415+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:14:08.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:08.416+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5850006720 tx=0x7f5870057000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T17:14:08.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:08 smithi136 ceph-mon[125702]: pgmap v12051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:14:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:08 smithi057 ceph-mon[92072]: pgmap v12051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:14:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:08 smithi122 ceph-mon[125440]: pgmap v12051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:14:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:10 smithi136 ceph-mon[125702]: pgmap v12052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:14:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:10 smithi057 ceph-mon[92072]: pgmap v12052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:14:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:10 smithi122 ceph-mon[125440]: pgmap v12052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:14:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:11.619+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:14:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:11.619+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:14:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:11.619+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 175 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:14:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:11.620+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 176 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:14:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:11 smithi057 ceph-mon[92072]: pgmap v12053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:14:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:11 smithi122 ceph-mon[125440]: pgmap v12053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:14:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:11 smithi136 ceph-mon[125702]: pgmap v12053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:14:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:12 smithi057 ceph-mon[92072]: osdmap e826: 12 total, 12 up, 12 in 2023-03-02T17:14:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:12 smithi122 ceph-mon[125440]: osdmap e826: 12 total, 12 up, 12 in 2023-03-02T17:14:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:12 smithi136 ceph-mon[125702]: osdmap e826: 12 total, 12 up, 12 in 2023-03-02T17:14:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:13 smithi057 ceph-mon[92072]: pgmap v12055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:13 smithi122 ceph-mon[125440]: pgmap v12055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:13 smithi136 ceph-mon[125702]: pgmap v12055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:16 smithi122 ceph-mon[125440]: pgmap v12056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:16.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:16 smithi136 ceph-mon[125702]: pgmap v12056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:16 smithi057 ceph-mon[92072]: pgmap v12056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:18 smithi122 ceph-mon[125440]: pgmap v12057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:18 smithi136 ceph-mon[125702]: pgmap v12057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:18 smithi057 ceph-mon[92072]: pgmap v12057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:20 smithi122 ceph-mon[125440]: pgmap v12058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:20 smithi136 ceph-mon[125702]: pgmap v12058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:20 smithi057 ceph-mon[92072]: pgmap v12058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:14:21.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:21.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:14:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:21.320+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:14:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:21.320+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:14:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:21.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:14:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:21.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:14:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:21 smithi057 ceph-mon[92072]: osdmap e827: 12 total, 12 up, 12 in 2023-03-02T17:14:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:21 smithi057 ceph-mon[92072]: pgmap v12060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:14:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:21 smithi122 ceph-mon[125440]: osdmap e827: 12 total, 12 up, 12 in 2023-03-02T17:14:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:21 smithi122 ceph-mon[125440]: pgmap v12060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:14:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:21 smithi136 ceph-mon[125702]: osdmap e827: 12 total, 12 up, 12 in 2023-03-02T17:14:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:21 smithi136 ceph-mon[125702]: pgmap v12060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:14:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:24 smithi122 ceph-mon[125440]: pgmap v12061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:14:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:24 smithi136 ceph-mon[125702]: pgmap v12061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:14:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:24 smithi057 ceph-mon[92072]: pgmap v12061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:14:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:26 smithi136 ceph-mon[125702]: pgmap v12062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:14:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:26 smithi057 ceph-mon[92072]: pgmap v12062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:14:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:26 smithi122 ceph-mon[125440]: pgmap v12062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:14:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:28 smithi136 ceph-mon[125702]: pgmap v12063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:14:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:28 smithi057 ceph-mon[92072]: pgmap v12063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:14:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:28 smithi122 ceph-mon[125440]: pgmap v12063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:14:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:30 smithi136 ceph-mon[125702]: pgmap v12064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:14:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:30 smithi057 ceph-mon[92072]: pgmap v12064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:14:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:30 smithi122 ceph-mon[125440]: pgmap v12064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:14:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:31 smithi057 ceph-mon[92072]: pgmap v12065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:14:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:31 smithi122 ceph-mon[125440]: pgmap v12065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:14:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:31 smithi136 ceph-mon[125702]: pgmap v12065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:14:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:34 smithi122 ceph-mon[125440]: pgmap v12066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:34 smithi136 ceph-mon[125702]: pgmap v12066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:34 smithi057 ceph-mon[92072]: pgmap v12066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:36.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:36.334+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:14:36.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:36.334+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:14:36.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:36.334+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:14:36.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:36.334+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:14:36.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:36.334+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:14:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:36 smithi136 ceph-mon[125702]: pgmap v12067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:36 smithi057 ceph-mon[92072]: pgmap v12067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:36 smithi122 ceph-mon[125440]: pgmap v12067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:38 smithi136 ceph-mon[125702]: pgmap v12068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:38 smithi057 ceph-mon[92072]: pgmap v12068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:38 smithi122 ceph-mon[125440]: pgmap v12068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:40 smithi136 ceph-mon[125702]: pgmap v12069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:40 smithi057 ceph-mon[92072]: pgmap v12069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:40 smithi122 ceph-mon[125440]: pgmap v12069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:41 smithi057 ceph-mon[92072]: pgmap v12070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:41 smithi122 ceph-mon[125440]: pgmap v12070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:41 smithi136 ceph-mon[125702]: pgmap v12070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:44 smithi136 ceph-mon[125702]: pgmap v12071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:44 smithi057 ceph-mon[92072]: pgmap v12071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:44 smithi122 ceph-mon[125440]: pgmap v12071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:46.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:46 smithi136 ceph-mon[125702]: pgmap v12072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:46 smithi057 ceph-mon[92072]: pgmap v12072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:46 smithi122 ceph-mon[125440]: pgmap v12072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:48 smithi136 ceph-mon[125702]: pgmap v12073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:48 smithi057 ceph-mon[92072]: pgmap v12073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:48 smithi122 ceph-mon[125440]: pgmap v12073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:50 smithi136 ceph-mon[125702]: pgmap v12074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:50 smithi057 ceph-mon[92072]: pgmap v12074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:50 smithi122 ceph-mon[125440]: pgmap v12074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:51.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:14:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:51.348+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:14:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:51.348+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:14:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:51.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:14:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:14:51.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:14:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:51 smithi122 ceph-mon[125440]: pgmap v12075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:51 smithi136 ceph-mon[125702]: pgmap v12075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:51 smithi057 ceph-mon[92072]: pgmap v12075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:54 smithi136 ceph-mon[125702]: pgmap v12076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:54 smithi057 ceph-mon[92072]: pgmap v12076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:54 smithi122 ceph-mon[125440]: pgmap v12076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:56 smithi136 ceph-mon[125702]: pgmap v12077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:56 smithi057 ceph-mon[92072]: pgmap v12077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:56 smithi122 ceph-mon[125440]: pgmap v12077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:14:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:14:58 smithi136 ceph-mon[125702]: pgmap v12078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:14:58 smithi057 ceph-mon[92072]: pgmap v12078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:14:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:14:58 smithi122 ceph-mon[125440]: pgmap v12078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:00 smithi136 ceph-mon[125702]: pgmap v12079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:00 smithi057 ceph-mon[92072]: pgmap v12079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:00 smithi122 ceph-mon[125440]: pgmap v12079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:01 smithi057 ceph-mon[92072]: pgmap v12080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:01 smithi122 ceph-mon[125440]: pgmap v12080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:01 smithi136 ceph-mon[125702]: pgmap v12080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:04 smithi136 ceph-mon[125702]: pgmap v12081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:15:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:04 smithi057 ceph-mon[92072]: pgmap v12081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:15:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:04 smithi122 ceph-mon[125440]: pgmap v12081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:15:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:06.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:15:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:06.357+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:15:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:06.357+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:15:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:06.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:15:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:06.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:15:06.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:06 smithi136 ceph-mon[125702]: pgmap v12082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:15:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:06 smithi057 ceph-mon[92072]: pgmap v12082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:15:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:06 smithi122 ceph-mon[125440]: pgmap v12082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:15:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:07 smithi122 ceph-mon[125440]: osdmap e828: 12 total, 12 up, 12 in 2023-03-02T17:15:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:15:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:07 smithi122 ceph-mon[125440]: pgmap v12084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:15:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:15:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:15:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:15:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:07 smithi136 ceph-mon[125702]: osdmap e828: 12 total, 12 up, 12 in 2023-03-02T17:15:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:15:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:07 smithi136 ceph-mon[125702]: pgmap v12084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:15:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:15:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:15:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:15:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:07 smithi057 ceph-mon[92072]: osdmap e828: 12 total, 12 up, 12 in 2023-03-02T17:15:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:15:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:07 smithi057 ceph-mon[92072]: pgmap v12084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:15:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:15:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:15:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:15:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:10 smithi136 ceph-mon[125702]: pgmap v12085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:15:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:10 smithi057 ceph-mon[92072]: pgmap v12085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:15:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:10 smithi122 ceph-mon[125440]: pgmap v12085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:15:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:11 smithi122 ceph-mon[125440]: pgmap v12086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:15:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:11 smithi136 ceph-mon[125702]: pgmap v12086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:15:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:11 smithi057 ceph-mon[92072]: pgmap v12086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:15:14.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:14 smithi136 ceph-mon[125702]: pgmap v12087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:15:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:14 smithi057 ceph-mon[92072]: pgmap v12087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:15:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:14 smithi122 ceph-mon[125440]: pgmap v12087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:15:16.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:16 smithi136 ceph-mon[125702]: pgmap v12088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:15:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:16 smithi136 ceph-mon[125702]: osdmap e829: 12 total, 12 up, 12 in 2023-03-02T17:15:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:16 smithi057 ceph-mon[92072]: pgmap v12088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:15:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:16 smithi057 ceph-mon[92072]: osdmap e829: 12 total, 12 up, 12 in 2023-03-02T17:15:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:16 smithi122 ceph-mon[125440]: pgmap v12088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:15:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:16 smithi122 ceph-mon[125440]: osdmap e829: 12 total, 12 up, 12 in 2023-03-02T17:15:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:18 smithi136 ceph-mon[125702]: pgmap v12090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:15:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:18 smithi057 ceph-mon[92072]: pgmap v12090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:15:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:18 smithi122 ceph-mon[125440]: pgmap v12090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:15:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:20 smithi136 ceph-mon[125702]: pgmap v12091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:15:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:20 smithi057 ceph-mon[92072]: pgmap v12091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:15:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:20 smithi122 ceph-mon[125440]: pgmap v12091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:15:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:21.361+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:15:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:21.361+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:15:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:21.361+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:15:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:21.361+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:15:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:21.361+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:15:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:21 smithi122 ceph-mon[125440]: pgmap v12092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:15:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:21 smithi136 ceph-mon[125702]: pgmap v12092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:15:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:21 smithi057 ceph-mon[92072]: pgmap v12092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:15:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:24 smithi136 ceph-mon[125702]: pgmap v12093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T17:15:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:24 smithi057 ceph-mon[92072]: pgmap v12093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T17:15:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:24 smithi122 ceph-mon[125440]: pgmap v12093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T17:15:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:26 smithi136 ceph-mon[125702]: pgmap v12094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T17:15:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:26 smithi057 ceph-mon[92072]: pgmap v12094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T17:15:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:26 smithi122 ceph-mon[125440]: pgmap v12094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T17:15:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:28 smithi136 ceph-mon[125702]: pgmap v12095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:15:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:28 smithi057 ceph-mon[92072]: pgmap v12095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:15:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:28 smithi122 ceph-mon[125440]: pgmap v12095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:15:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:30 smithi136 ceph-mon[125702]: pgmap v12096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:15:30.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:30 smithi057 ceph-mon[92072]: pgmap v12096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:15:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:30 smithi122 ceph-mon[125440]: pgmap v12096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:15:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:31 smithi122 ceph-mon[125440]: pgmap v12097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:15:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:31 smithi136 ceph-mon[125702]: pgmap v12097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:15:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:31 smithi057 ceph-mon[92072]: pgmap v12097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:15:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:34 smithi136 ceph-mon[125702]: pgmap v12098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:34 smithi057 ceph-mon[92072]: pgmap v12098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:34 smithi122 ceph-mon[125440]: pgmap v12098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:36.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:36.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:15:36.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:36.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:15:36.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:36.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:15:36.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:36.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:15:36.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:36.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:15:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:36 smithi136 ceph-mon[125702]: pgmap v12099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:36 smithi057 ceph-mon[92072]: pgmap v12099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:36 smithi122 ceph-mon[125440]: pgmap v12099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:38 smithi136 ceph-mon[125702]: pgmap v12100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:38 smithi057 ceph-mon[92072]: pgmap v12100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:38 smithi122 ceph-mon[125440]: pgmap v12100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:40 smithi136 ceph-mon[125702]: pgmap v12101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:40 smithi057 ceph-mon[92072]: pgmap v12101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:40 smithi122 ceph-mon[125440]: pgmap v12101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:41 smithi122 ceph-mon[125440]: pgmap v12102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:41 smithi136 ceph-mon[125702]: pgmap v12102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:41 smithi057 ceph-mon[92072]: pgmap v12102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:44.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:44 smithi136 ceph-mon[125702]: pgmap v12103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:44 smithi057 ceph-mon[92072]: pgmap v12103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:44 smithi122 ceph-mon[125440]: pgmap v12103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:46 smithi136 ceph-mon[125702]: pgmap v12104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:46 smithi057 ceph-mon[92072]: pgmap v12104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:47.126 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:46 smithi122 ceph-mon[125440]: pgmap v12104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:48 smithi136 ceph-mon[125702]: pgmap v12105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:48 smithi057 ceph-mon[92072]: pgmap v12105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:48 smithi122 ceph-mon[125440]: pgmap v12105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:50 smithi136 ceph-mon[125702]: pgmap v12106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:50 smithi057 ceph-mon[92072]: pgmap v12106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:50 smithi122 ceph-mon[125440]: pgmap v12106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:51.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:15:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:51.379+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:15:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:51.379+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:15:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:51.379+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:15:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:15:51.379+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:15:51.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:51 smithi122 ceph-mon[125440]: pgmap v12107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:51 smithi136 ceph-mon[125702]: pgmap v12107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:51 smithi057 ceph-mon[92072]: pgmap v12107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:54 smithi136 ceph-mon[125702]: pgmap v12108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:54 smithi057 ceph-mon[92072]: pgmap v12108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:54 smithi122 ceph-mon[125440]: pgmap v12108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:56.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:56 smithi136 ceph-mon[125702]: pgmap v12109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:56 smithi057 ceph-mon[92072]: pgmap v12109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:56 smithi122 ceph-mon[125440]: pgmap v12109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:15:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:15:58 smithi136 ceph-mon[125702]: pgmap v12110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:15:58 smithi057 ceph-mon[92072]: pgmap v12110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:15:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:15:58 smithi122 ceph-mon[125440]: pgmap v12110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:00 smithi136 ceph-mon[125702]: pgmap v12111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:16:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:00 smithi057 ceph-mon[92072]: pgmap v12111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:16:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:00 smithi122 ceph-mon[125440]: pgmap v12111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:16:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:01 smithi122 ceph-mon[125440]: pgmap v12112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:16:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:01 smithi136 ceph-mon[125702]: pgmap v12112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:16:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:01 smithi057 ceph-mon[92072]: pgmap v12112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:16:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:04 smithi136 ceph-mon[125702]: pgmap v12113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:16:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:04 smithi057 ceph-mon[92072]: pgmap v12113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:16:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:04 smithi122 ceph-mon[125440]: pgmap v12113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:16:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:06.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:16:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:06.386+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:16:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:06.386+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:16:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:06.386+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:16:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:06.386+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:16:06.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:06 smithi136 ceph-mon[125702]: pgmap v12114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:16:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:06 smithi057 ceph-mon[92072]: pgmap v12114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:16:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:06 smithi122 ceph-mon[125440]: pgmap v12114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:16:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:07 smithi136 ceph-mon[125702]: osdmap e830: 12 total, 12 up, 12 in 2023-03-02T17:16:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:07 smithi136 ceph-mon[125702]: pgmap v12116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:16:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:07 smithi057 ceph-mon[92072]: osdmap e830: 12 total, 12 up, 12 in 2023-03-02T17:16:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:07 smithi057 ceph-mon[92072]: pgmap v12116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:16:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:07 smithi122 ceph-mon[125440]: osdmap e830: 12 total, 12 up, 12 in 2023-03-02T17:16:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:07 smithi122 ceph-mon[125440]: pgmap v12116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:16:08.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:16:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:16:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:16:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:16:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:16:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:16:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:16:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:16:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:16:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:16:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:16:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:16:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:09 smithi136 ceph-mon[125702]: pgmap v12117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:16:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:09 smithi057 ceph-mon[92072]: pgmap v12117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:16:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:09 smithi122 ceph-mon[125440]: pgmap v12117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:16:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:11 smithi122 ceph-mon[125440]: pgmap v12118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:16:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:11 smithi136 ceph-mon[125702]: pgmap v12118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:16:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:11 smithi057 ceph-mon[92072]: pgmap v12118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:16:14.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:14 smithi136 ceph-mon[125702]: pgmap v12119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:16:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:14 smithi057 ceph-mon[92072]: pgmap v12119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:16:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:14 smithi122 ceph-mon[125440]: pgmap v12119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:16:16.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:16 smithi136 ceph-mon[125702]: pgmap v12120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:16:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:16 smithi136 ceph-mon[125702]: osdmap e831: 12 total, 12 up, 12 in 2023-03-02T17:16:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:16 smithi057 ceph-mon[92072]: pgmap v12120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:16:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:16 smithi057 ceph-mon[92072]: osdmap e831: 12 total, 12 up, 12 in 2023-03-02T17:16:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:16 smithi122 ceph-mon[125440]: pgmap v12120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:16:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:16 smithi122 ceph-mon[125440]: osdmap e831: 12 total, 12 up, 12 in 2023-03-02T17:16:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:18 smithi136 ceph-mon[125702]: pgmap v12122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:16:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:18 smithi057 ceph-mon[92072]: pgmap v12122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:16:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:18 smithi122 ceph-mon[125440]: pgmap v12122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:16:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:20 smithi136 ceph-mon[125702]: pgmap v12123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:16:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:20 smithi057 ceph-mon[92072]: pgmap v12123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:16:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:20 smithi122 ceph-mon[125440]: pgmap v12123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:16:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:21.395+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:16:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:21.396+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:16:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:21.396+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:16:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:21.396+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:16:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:21.396+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:16:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:21 smithi136 ceph-mon[125702]: pgmap v12124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:16:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:21 smithi057 ceph-mon[92072]: pgmap v12124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:16:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:21 smithi122 ceph-mon[125440]: pgmap v12124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:16:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:24 smithi136 ceph-mon[125702]: pgmap v12125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:16:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:24 smithi057 ceph-mon[92072]: pgmap v12125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:16:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:24 smithi122 ceph-mon[125440]: pgmap v12125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:16:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:26 smithi136 ceph-mon[125702]: pgmap v12126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:16:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:26 smithi057 ceph-mon[92072]: pgmap v12126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:16:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:26 smithi122 ceph-mon[125440]: pgmap v12126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:16:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:28 smithi136 ceph-mon[125702]: pgmap v12127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:16:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:28 smithi057 ceph-mon[92072]: pgmap v12127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:16:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:28 smithi122 ceph-mon[125440]: pgmap v12127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:16:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:30 smithi136 ceph-mon[125702]: pgmap v12128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:30 smithi057 ceph-mon[92072]: pgmap v12128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:30 smithi122 ceph-mon[125440]: pgmap v12128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:31 smithi136 ceph-mon[125702]: pgmap v12129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:31 smithi057 ceph-mon[92072]: pgmap v12129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:31 smithi122 ceph-mon[125440]: pgmap v12129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:34 smithi136 ceph-mon[125702]: pgmap v12130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:34 smithi057 ceph-mon[92072]: pgmap v12130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:34 smithi122 ceph-mon[125440]: pgmap v12130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:36.411+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:16:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:36.412+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:16:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:36.412+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:16:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:36.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:16:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:36.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:16:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:36 smithi136 ceph-mon[125702]: pgmap v12131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:36 smithi057 ceph-mon[92072]: pgmap v12131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:36 smithi122 ceph-mon[125440]: pgmap v12131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:38 smithi136 ceph-mon[125702]: pgmap v12132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:38 smithi057 ceph-mon[92072]: pgmap v12132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:38 smithi122 ceph-mon[125440]: pgmap v12132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:40 smithi136 ceph-mon[125702]: pgmap v12133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:40 smithi057 ceph-mon[92072]: pgmap v12133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:40 smithi122 ceph-mon[125440]: pgmap v12133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:41 smithi136 ceph-mon[125702]: pgmap v12134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:41 smithi057 ceph-mon[92072]: pgmap v12134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:41 smithi122 ceph-mon[125440]: pgmap v12134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:44.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:44 smithi136 ceph-mon[125702]: pgmap v12135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:44.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:44 smithi057 ceph-mon[92072]: pgmap v12135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:44 smithi122 ceph-mon[125440]: pgmap v12135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:46.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:46 smithi136 ceph-mon[125702]: pgmap v12136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:46 smithi057 ceph-mon[92072]: pgmap v12136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:46 smithi122 ceph-mon[125440]: pgmap v12136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:48 smithi136 ceph-mon[125702]: pgmap v12137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:48 smithi057 ceph-mon[92072]: pgmap v12137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:48 smithi122 ceph-mon[125440]: pgmap v12137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:50 smithi136 ceph-mon[125702]: pgmap v12138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:50 smithi057 ceph-mon[92072]: pgmap v12138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:50 smithi122 ceph-mon[125440]: pgmap v12138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:51.415 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:51.414+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:16:51.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:51.414+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:16:51.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:51.414+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:16:51.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:51.414+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:16:51.416 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:16:51.414+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:16:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:51 smithi136 ceph-mon[125702]: pgmap v12139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:51 smithi057 ceph-mon[92072]: pgmap v12139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:51 smithi122 ceph-mon[125440]: pgmap v12139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:54 smithi136 ceph-mon[125702]: pgmap v12140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:54 smithi057 ceph-mon[92072]: pgmap v12140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:54 smithi122 ceph-mon[125440]: pgmap v12140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:56.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:56 smithi136 ceph-mon[125702]: pgmap v12141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:56 smithi057 ceph-mon[92072]: pgmap v12141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:56 smithi122 ceph-mon[125440]: pgmap v12141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:16:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:16:58 smithi136 ceph-mon[125702]: pgmap v12142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:16:58 smithi057 ceph-mon[92072]: pgmap v12142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:16:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:16:58 smithi122 ceph-mon[125440]: pgmap v12142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:00 smithi136 ceph-mon[125702]: pgmap v12143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:00 smithi057 ceph-mon[92072]: pgmap v12143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:00 smithi122 ceph-mon[125440]: pgmap v12143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:01 smithi136 ceph-mon[125702]: pgmap v12144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:01 smithi057 ceph-mon[92072]: pgmap v12144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:01 smithi122 ceph-mon[125440]: pgmap v12144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:04 smithi136 ceph-mon[125702]: pgmap v12145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:17:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:04 smithi057 ceph-mon[92072]: pgmap v12145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:17:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:04 smithi122 ceph-mon[125440]: pgmap v12145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:17:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:06.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:17:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:06.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:17:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:06.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:17:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:06.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:17:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:06.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:17:06.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:06 smithi136 ceph-mon[125702]: pgmap v12146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:17:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:06 smithi057 ceph-mon[92072]: pgmap v12146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:17:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:06 smithi122 ceph-mon[125440]: pgmap v12146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:17:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:07 smithi136 ceph-mon[125702]: osdmap e832: 12 total, 12 up, 12 in 2023-03-02T17:17:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:07 smithi136 ceph-mon[125702]: pgmap v12148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:17:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:07 smithi057 ceph-mon[92072]: osdmap e832: 12 total, 12 up, 12 in 2023-03-02T17:17:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:07 smithi057 ceph-mon[92072]: pgmap v12148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:17:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:07 smithi122 ceph-mon[125440]: osdmap e832: 12 total, 12 up, 12 in 2023-03-02T17:17:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:07 smithi122 ceph-mon[125440]: pgmap v12148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:17:08.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:17:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:17:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:17:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:17:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:17:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:17:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:09 smithi136 ceph-mon[125702]: pgmap v12149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:17:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:17:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:17:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:17:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:09 smithi057 ceph-mon[92072]: pgmap v12149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:17:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:17:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:17:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:17:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:09 smithi122 ceph-mon[125440]: pgmap v12149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:17:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:11.645+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:17:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:11.645+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:17:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:11.645+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 177 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:17:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:11.645+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 176 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:17:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:11 smithi136 ceph-mon[125702]: pgmap v12150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:17:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:11 smithi057 ceph-mon[92072]: pgmap v12150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:17:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:11 smithi122 ceph-mon[125440]: pgmap v12150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:17:14.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:14 smithi136 ceph-mon[125702]: pgmap v12151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:17:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:14 smithi057 ceph-mon[92072]: pgmap v12151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:17:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:14 smithi122 ceph-mon[125440]: pgmap v12151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:17:16.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:16 smithi136 ceph-mon[125702]: pgmap v12152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:17:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:16 smithi136 ceph-mon[125702]: osdmap e833: 12 total, 12 up, 12 in 2023-03-02T17:17:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:16 smithi057 ceph-mon[92072]: pgmap v12152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:17:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:16 smithi057 ceph-mon[92072]: osdmap e833: 12 total, 12 up, 12 in 2023-03-02T17:17:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:16 smithi122 ceph-mon[125440]: pgmap v12152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:17:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:16 smithi122 ceph-mon[125440]: osdmap e833: 12 total, 12 up, 12 in 2023-03-02T17:17:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:18 smithi136 ceph-mon[125702]: pgmap v12154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:17:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:18 smithi057 ceph-mon[92072]: pgmap v12154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:17:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:18 smithi122 ceph-mon[125440]: pgmap v12154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:17:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:20 smithi136 ceph-mon[125702]: pgmap v12155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:17:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:20 smithi057 ceph-mon[92072]: pgmap v12155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:17:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:20 smithi122 ceph-mon[125440]: pgmap v12155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:17:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:21.446+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:17:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:21.446+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:17:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:21.446+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:17:21.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:21.446+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:17:21.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:21.446+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:17:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:21 smithi136 ceph-mon[125702]: pgmap v12156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:17:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:21 smithi057 ceph-mon[92072]: pgmap v12156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:17:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:21 smithi122 ceph-mon[125440]: pgmap v12156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:17:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:24 smithi136 ceph-mon[125702]: pgmap v12157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:17:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:24 smithi057 ceph-mon[92072]: pgmap v12157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:17:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:24 smithi122 ceph-mon[125440]: pgmap v12157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:17:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:26 smithi136 ceph-mon[125702]: pgmap v12158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:17:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:26 smithi057 ceph-mon[92072]: pgmap v12158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:17:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:26 smithi122 ceph-mon[125440]: pgmap v12158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:17:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:28 smithi136 ceph-mon[125702]: pgmap v12159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:17:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:28 smithi057 ceph-mon[92072]: pgmap v12159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:17:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:28 smithi122 ceph-mon[125440]: pgmap v12159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:17:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:30 smithi136 ceph-mon[125702]: pgmap v12160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:30 smithi057 ceph-mon[92072]: pgmap v12160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:30 smithi122 ceph-mon[125440]: pgmap v12160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:31 smithi136 ceph-mon[125702]: pgmap v12161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:31 smithi057 ceph-mon[92072]: pgmap v12161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:31 smithi122 ceph-mon[125440]: pgmap v12161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:34 smithi136 ceph-mon[125702]: pgmap v12162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:34 smithi057 ceph-mon[92072]: pgmap v12162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:34 smithi122 ceph-mon[125440]: pgmap v12162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:36.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:17:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:36.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:17:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:36.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:17:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:36.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:17:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:36.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:17:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:36 smithi136 ceph-mon[125702]: pgmap v12163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:36 smithi057 ceph-mon[92072]: pgmap v12163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:36 smithi122 ceph-mon[125440]: pgmap v12163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:38 smithi136 ceph-mon[125702]: pgmap v12164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:38 smithi057 ceph-mon[92072]: pgmap v12164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:38 smithi122 ceph-mon[125440]: pgmap v12164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:40 smithi136 ceph-mon[125702]: pgmap v12165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:40.988 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:40 smithi122 ceph-mon[125440]: pgmap v12165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:40.989 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:40 smithi057 ceph-mon[92072]: pgmap v12165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:41 smithi136 ceph-mon[125702]: pgmap v12166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:41 smithi057 ceph-mon[92072]: pgmap v12166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:41 smithi122 ceph-mon[125440]: pgmap v12166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:44.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:44 smithi136 ceph-mon[125702]: pgmap v12167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:44 smithi057 ceph-mon[92072]: pgmap v12167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:44 smithi122 ceph-mon[125440]: pgmap v12167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:46.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:46 smithi136 ceph-mon[125702]: pgmap v12168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:46 smithi057 ceph-mon[92072]: pgmap v12168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:46 smithi122 ceph-mon[125440]: pgmap v12168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:48 smithi136 ceph-mon[125702]: pgmap v12169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:48 smithi057 ceph-mon[92072]: pgmap v12169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:48 smithi122 ceph-mon[125440]: pgmap v12169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:50 smithi136 ceph-mon[125702]: pgmap v12170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:50 smithi057 ceph-mon[92072]: pgmap v12170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:50 smithi122 ceph-mon[125440]: pgmap v12170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:51.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:17:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:51.473+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:17:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:51.473+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:17:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:51.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:17:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:17:51.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:17:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:51 smithi136 ceph-mon[125702]: pgmap v12171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:51 smithi057 ceph-mon[92072]: pgmap v12171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:51 smithi122 ceph-mon[125440]: pgmap v12171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:54 smithi136 ceph-mon[125702]: pgmap v12172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:54 smithi057 ceph-mon[92072]: pgmap v12172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:54 smithi122 ceph-mon[125440]: pgmap v12172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:56.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:56 smithi136 ceph-mon[125702]: pgmap v12173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:56 smithi057 ceph-mon[92072]: pgmap v12173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:56 smithi122 ceph-mon[125440]: pgmap v12173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:17:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:17:58 smithi136 ceph-mon[125702]: pgmap v12174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:17:58 smithi057 ceph-mon[92072]: pgmap v12174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:17:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:17:58 smithi122 ceph-mon[125440]: pgmap v12174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:00 smithi136 ceph-mon[125702]: pgmap v12175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:00 smithi057 ceph-mon[92072]: pgmap v12175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:00 smithi122 ceph-mon[125440]: pgmap v12175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:01 smithi136 ceph-mon[125702]: pgmap v12176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:01 smithi057 ceph-mon[92072]: pgmap v12176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:01 smithi122 ceph-mon[125440]: pgmap v12176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:04 smithi136 ceph-mon[125702]: pgmap v12177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:18:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:04 smithi057 ceph-mon[92072]: pgmap v12177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:18:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:04 smithi122 ceph-mon[125440]: pgmap v12177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:18:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:06.490+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:18:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:06.490+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:18:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:06.490+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:18:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:06.490+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:18:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:06.490+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:18:06.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:06 smithi136 ceph-mon[125702]: pgmap v12178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:18:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:06 smithi057 ceph-mon[92072]: pgmap v12178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:18:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:06 smithi122 ceph-mon[125440]: pgmap v12178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:18:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:07 smithi136 ceph-mon[125702]: osdmap e834: 12 total, 12 up, 12 in 2023-03-02T17:18:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:07 smithi136 ceph-mon[125702]: pgmap v12180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:18:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:07 smithi057 ceph-mon[92072]: osdmap e834: 12 total, 12 up, 12 in 2023-03-02T17:18:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:07 smithi057 ceph-mon[92072]: pgmap v12180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:18:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:07 smithi122 ceph-mon[125440]: osdmap e834: 12 total, 12 up, 12 in 2023-03-02T17:18:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:07 smithi122 ceph-mon[125440]: pgmap v12180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:18:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:10 smithi136 ceph-mon[125702]: pgmap v12181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:18:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:18:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:10 smithi057 ceph-mon[92072]: pgmap v12181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:18:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:18:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:10 smithi122 ceph-mon[125440]: pgmap v12181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:18:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:18:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:11 smithi136 ceph-mon[125702]: pgmap v12182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:18:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:11 smithi057 ceph-mon[92072]: pgmap v12182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:18:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:11 smithi122 ceph-mon[125440]: pgmap v12182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:18:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:18:13.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:18:13.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 34380k 2023-03-02T17:18:13.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:18:13.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:18:13.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 35205877: error parsing value: Value '35205877' is below minimum 939524096 2023-03-02T17:18:13.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:18:13.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:18:13.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:13 smithi057 ceph-mon[92072]: pgmap v12183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:18:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:18:13.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:18:13.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 34380k 2023-03-02T17:18:13.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:18:13.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:18:13.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 35205877: error parsing value: Value '35205877' is below minimum 939524096 2023-03-02T17:18:13.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:18:13.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:18:13.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:13 smithi122 ceph-mon[125440]: pgmap v12183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:18:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:18:13.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:18:13.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:18:13.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 34380k 2023-03-02T17:18:13.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:18:13.847 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:18:13.847 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 35205877: error parsing value: Value '35205877' is below minimum 939524096 2023-03-02T17:18:13.847 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:18:13.847 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:18:13.847 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:18:13.847 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:13 smithi136 ceph-mon[125702]: pgmap v12183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:18:16.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:16 smithi136 ceph-mon[125702]: pgmap v12184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:18:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:16 smithi136 ceph-mon[125702]: osdmap e835: 12 total, 12 up, 12 in 2023-03-02T17:18:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:16 smithi057 ceph-mon[92072]: pgmap v12184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:18:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:16 smithi057 ceph-mon[92072]: osdmap e835: 12 total, 12 up, 12 in 2023-03-02T17:18:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:16 smithi122 ceph-mon[125440]: pgmap v12184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:18:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:16 smithi122 ceph-mon[125440]: osdmap e835: 12 total, 12 up, 12 in 2023-03-02T17:18:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:18 smithi136 ceph-mon[125702]: pgmap v12186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:18:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:18 smithi057 ceph-mon[92072]: pgmap v12186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:18:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:18 smithi122 ceph-mon[125440]: pgmap v12186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:18:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:20 smithi136 ceph-mon[125702]: pgmap v12187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:18:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:20 smithi057 ceph-mon[92072]: pgmap v12187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:18:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:20 smithi122 ceph-mon[125440]: pgmap v12187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:18:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:21.505+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:18:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:21.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:18:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:21.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:18:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:21.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:18:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:21.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:18:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:21 smithi136 ceph-mon[125702]: pgmap v12188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:18:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:21 smithi057 ceph-mon[92072]: pgmap v12188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:18:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:21 smithi122 ceph-mon[125440]: pgmap v12188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:18:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:24 smithi136 ceph-mon[125702]: pgmap v12189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:18:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:24 smithi057 ceph-mon[92072]: pgmap v12189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:18:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:24 smithi122 ceph-mon[125440]: pgmap v12189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:18:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:26 smithi136 ceph-mon[125702]: pgmap v12190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:18:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:26 smithi057 ceph-mon[92072]: pgmap v12190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:18:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:26 smithi122 ceph-mon[125440]: pgmap v12190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:18:28.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:28 smithi136 ceph-mon[125702]: pgmap v12191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:18:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:28 smithi057 ceph-mon[92072]: pgmap v12191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:18:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:28 smithi122 ceph-mon[125440]: pgmap v12191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:18:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:30 smithi136 ceph-mon[125702]: pgmap v12192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:30 smithi057 ceph-mon[92072]: pgmap v12192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:30 smithi122 ceph-mon[125440]: pgmap v12192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:31 smithi136 ceph-mon[125702]: pgmap v12193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:31 smithi057 ceph-mon[92072]: pgmap v12193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:31 smithi122 ceph-mon[125440]: pgmap v12193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:34 smithi136 ceph-mon[125702]: pgmap v12194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:34 smithi057 ceph-mon[92072]: pgmap v12194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:34 smithi122 ceph-mon[125440]: pgmap v12194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:36.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:18:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:36.519+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:18:36.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:36.519+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:18:36.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:36.519+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:18:36.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:36.519+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:18:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:36 smithi136 ceph-mon[125702]: pgmap v12195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:36.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:36 smithi057 ceph-mon[92072]: pgmap v12195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:36 smithi122 ceph-mon[125440]: pgmap v12195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:38 smithi136 ceph-mon[125702]: pgmap v12196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:38 smithi057 ceph-mon[92072]: pgmap v12196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:38 smithi122 ceph-mon[125440]: pgmap v12196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:40.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:40 smithi136 ceph-mon[125702]: pgmap v12197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:40 smithi057 ceph-mon[92072]: pgmap v12197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:40 smithi122 ceph-mon[125440]: pgmap v12197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:41.658+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:18:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:41.658+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:18:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:41.658+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 178 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:18:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:41.658+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 177 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:18:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:41 smithi136 ceph-mon[125702]: pgmap v12198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:41 smithi057 ceph-mon[92072]: pgmap v12198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:41 smithi122 ceph-mon[125440]: pgmap v12198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:44.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:44 smithi136 ceph-mon[125702]: pgmap v12199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:44 smithi057 ceph-mon[92072]: pgmap v12199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:44 smithi122 ceph-mon[125440]: pgmap v12199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:46.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:46 smithi136 ceph-mon[125702]: pgmap v12200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:46 smithi057 ceph-mon[92072]: pgmap v12200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:46 smithi122 ceph-mon[125440]: pgmap v12200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:48 smithi136 ceph-mon[125702]: pgmap v12201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:48 smithi057 ceph-mon[92072]: pgmap v12201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:48 smithi122 ceph-mon[125440]: pgmap v12201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:50 smithi136 ceph-mon[125702]: pgmap v12202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:50 smithi057 ceph-mon[92072]: pgmap v12202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:50 smithi122 ceph-mon[125440]: pgmap v12202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:51.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:51.519+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:18:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:51.519+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:18:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:51.519+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:18:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:51.519+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:18:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:18:51.519+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:18:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:51 smithi136 ceph-mon[125702]: pgmap v12203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:51 smithi057 ceph-mon[92072]: pgmap v12203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:51 smithi122 ceph-mon[125440]: pgmap v12203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:54 smithi136 ceph-mon[125702]: pgmap v12204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:54 smithi057 ceph-mon[92072]: pgmap v12204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:54 smithi122 ceph-mon[125440]: pgmap v12204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:56.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:56 smithi136 ceph-mon[125702]: pgmap v12205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:56 smithi057 ceph-mon[92072]: pgmap v12205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:56 smithi122 ceph-mon[125440]: pgmap v12205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:58 smithi136 ceph-mon[125702]: pgmap v12206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:58 smithi057 ceph-mon[92072]: pgmap v12206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:58 smithi122 ceph-mon[125440]: pgmap v12206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:18:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:18:59 smithi136 ceph-mon[125702]: pgmap v12207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:18:59 smithi057 ceph-mon[92072]: pgmap v12207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:18:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:18:59 smithi122 ceph-mon[125440]: pgmap v12207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:01 smithi136 ceph-mon[125702]: pgmap v12208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:01 smithi057 ceph-mon[92072]: pgmap v12208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:01 smithi122 ceph-mon[125440]: pgmap v12208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:04 smithi136 ceph-mon[125702]: pgmap v12209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:19:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:04 smithi057 ceph-mon[92072]: pgmap v12209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:19:04.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:04 smithi122 ceph-mon[125440]: pgmap v12209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:19:06.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:06.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:19:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:06.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:19:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:06.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:19:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:06.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:19:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:06.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:19:06.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:06 smithi136 ceph-mon[125702]: pgmap v12210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:19:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:06 smithi057 ceph-mon[92072]: pgmap v12210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:19:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:06 smithi122 ceph-mon[125440]: pgmap v12210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:19:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:07 smithi136 ceph-mon[125702]: osdmap e836: 12 total, 12 up, 12 in 2023-03-02T17:19:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:07 smithi136 ceph-mon[125702]: pgmap v12212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:19:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:07 smithi057 ceph-mon[92072]: osdmap e836: 12 total, 12 up, 12 in 2023-03-02T17:19:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:07 smithi057 ceph-mon[92072]: pgmap v12212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:19:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:07 smithi122 ceph-mon[125440]: osdmap e836: 12 total, 12 up, 12 in 2023-03-02T17:19:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:07 smithi122 ceph-mon[125440]: pgmap v12212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:19:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:10 smithi136 ceph-mon[125702]: pgmap v12213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:19:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:10 smithi057 ceph-mon[92072]: pgmap v12213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:19:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:10 smithi122 ceph-mon[125440]: pgmap v12213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:19:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:11 smithi136 ceph-mon[125702]: pgmap v12214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:19:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:11 smithi057 ceph-mon[92072]: pgmap v12214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:19:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:11 smithi122 ceph-mon[125440]: pgmap v12214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:19:14.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:14 smithi136 ceph-mon[125702]: pgmap v12215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:19:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:19:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:19:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:19:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:19:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:14 smithi057 ceph-mon[92072]: pgmap v12215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:19:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:19:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:19:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:19:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:19:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:14 smithi122 ceph-mon[125440]: pgmap v12215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:19:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:19:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:19:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:19:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:19:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:16 smithi136 ceph-mon[125702]: pgmap v12216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:19:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:16 smithi136 ceph-mon[125702]: osdmap e837: 12 total, 12 up, 12 in 2023-03-02T17:19:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:16 smithi057 ceph-mon[92072]: pgmap v12216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:19:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:16 smithi057 ceph-mon[92072]: osdmap e837: 12 total, 12 up, 12 in 2023-03-02T17:19:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:16 smithi122 ceph-mon[125440]: pgmap v12216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:19:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:16 smithi122 ceph-mon[125440]: osdmap e837: 12 total, 12 up, 12 in 2023-03-02T17:19:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:18 smithi136 ceph-mon[125702]: pgmap v12218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:19:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:18 smithi057 ceph-mon[92072]: pgmap v12218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:19:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:18 smithi122 ceph-mon[125440]: pgmap v12218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:19:20.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:20 smithi136 ceph-mon[125702]: pgmap v12219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:19:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:20 smithi057 ceph-mon[92072]: pgmap v12219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:19:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:20 smithi122 ceph-mon[125440]: pgmap v12219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:19:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:21.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:19:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:21.543+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:19:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:21.543+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:19:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:21.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:19:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:21.544+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:19:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:21 smithi136 ceph-mon[125702]: pgmap v12220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:19:21.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:21 smithi057 ceph-mon[92072]: pgmap v12220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:19:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:21 smithi122 ceph-mon[125440]: pgmap v12220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:19:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:24 smithi136 ceph-mon[125702]: pgmap v12221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:19:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:24 smithi057 ceph-mon[92072]: pgmap v12221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:19:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:24 smithi122 ceph-mon[125440]: pgmap v12221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:19:26.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:26 smithi136 ceph-mon[125702]: pgmap v12222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:19:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:26 smithi057 ceph-mon[92072]: pgmap v12222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:19:26.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:26 smithi122 ceph-mon[125440]: pgmap v12222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:19:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:28 smithi136 ceph-mon[125702]: pgmap v12223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:19:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:28 smithi057 ceph-mon[92072]: pgmap v12223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:19:28.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:28 smithi122 ceph-mon[125440]: pgmap v12223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:19:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:30 smithi136 ceph-mon[125702]: pgmap v12224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:30 smithi057 ceph-mon[92072]: pgmap v12224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:30 smithi122 ceph-mon[125440]: pgmap v12224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:31 smithi136 ceph-mon[125702]: pgmap v12225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:31 smithi057 ceph-mon[92072]: pgmap v12225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:31 smithi122 ceph-mon[125440]: pgmap v12225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:34 smithi136 ceph-mon[125702]: pgmap v12226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:34 smithi057 ceph-mon[92072]: pgmap v12226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:34 smithi122 ceph-mon[125440]: pgmap v12226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:36.556+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:19:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:36.557+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:19:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:36.557+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:19:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:36.557+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:19:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:36.557+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:19:36.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:36 smithi136 ceph-mon[125702]: pgmap v12227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:36 smithi057 ceph-mon[92072]: pgmap v12227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:36 smithi122 ceph-mon[125440]: pgmap v12227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:38 smithi136 ceph-mon[125702]: pgmap v12228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:38 smithi057 ceph-mon[92072]: pgmap v12228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:38 smithi122 ceph-mon[125440]: pgmap v12228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:39 smithi136 ceph-mon[125702]: pgmap v12229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:39 smithi057 ceph-mon[92072]: pgmap v12229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:39 smithi122 ceph-mon[125440]: pgmap v12229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:41 smithi136 ceph-mon[125702]: pgmap v12230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:41 smithi057 ceph-mon[92072]: pgmap v12230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:41 smithi122 ceph-mon[125440]: pgmap v12230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:44.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:44 smithi136 ceph-mon[125702]: pgmap v12231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:44 smithi057 ceph-mon[92072]: pgmap v12231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:44 smithi122 ceph-mon[125440]: pgmap v12231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:46 smithi136 ceph-mon[125702]: pgmap v12232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:46 smithi057 ceph-mon[92072]: pgmap v12232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:46 smithi122 ceph-mon[125440]: pgmap v12232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:48.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:48 smithi136 ceph-mon[125702]: pgmap v12233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:48 smithi057 ceph-mon[92072]: pgmap v12233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:48 smithi122 ceph-mon[125440]: pgmap v12233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:50.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:50 smithi136 ceph-mon[125702]: pgmap v12234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:50 smithi057 ceph-mon[92072]: pgmap v12234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:50 smithi122 ceph-mon[125440]: pgmap v12234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:51.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:19:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:51.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:19:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:51.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:19:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:51.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:19:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:19:51.572+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:19:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:51 smithi136 ceph-mon[125702]: pgmap v12235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:51 smithi057 ceph-mon[92072]: pgmap v12235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:51 smithi122 ceph-mon[125440]: pgmap v12235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:54 smithi136 ceph-mon[125702]: pgmap v12236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:54 smithi057 ceph-mon[92072]: pgmap v12236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:54 smithi122 ceph-mon[125440]: pgmap v12236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:56 smithi136 ceph-mon[125702]: pgmap v12237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:56 smithi057 ceph-mon[92072]: pgmap v12237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:56 smithi122 ceph-mon[125440]: pgmap v12237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:58.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:58 smithi136 ceph-mon[125702]: pgmap v12238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:58 smithi057 ceph-mon[92072]: pgmap v12238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:58.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:58 smithi122 ceph-mon[125440]: pgmap v12238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:19:59.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:19:59 smithi136 ceph-mon[125702]: pgmap v12239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:19:59 smithi057 ceph-mon[92072]: pgmap v12239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:19:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:19:59 smithi122 ceph-mon[125440]: pgmap v12239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:00.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T17:20:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T17:20:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T17:20:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:01 smithi136 ceph-mon[125702]: pgmap v12240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:01 smithi057 ceph-mon[92072]: pgmap v12240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:01 smithi122 ceph-mon[125440]: pgmap v12240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:04.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:04 smithi136 ceph-mon[125702]: pgmap v12241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:20:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:04 smithi057 ceph-mon[92072]: pgmap v12241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:20:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:04 smithi122 ceph-mon[125440]: pgmap v12241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:20:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:06.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:20:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:06.584+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:20:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:06.584+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:20:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:06.584+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:20:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:06.584+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:20:06.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:06 smithi136 ceph-mon[125702]: pgmap v12242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:20:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:06 smithi057 ceph-mon[92072]: pgmap v12242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:20:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:06 smithi122 ceph-mon[125440]: pgmap v12242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:20:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:07 smithi057 ceph-mon[92072]: pgmap v12243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:20:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:07 smithi122 ceph-mon[125440]: pgmap v12243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:20:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:07 smithi136 ceph-mon[125702]: pgmap v12243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:20:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:10 smithi122 ceph-mon[125440]: pgmap v12244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:20:10.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:10 smithi136 ceph-mon[125702]: pgmap v12244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:20:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:10 smithi057 ceph-mon[92072]: pgmap v12244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:20:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:11.670+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:20:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:11.670+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:20:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:11.670+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 179 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:20:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:11.670+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 178 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:20:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:11 smithi136 ceph-mon[125702]: pgmap v12245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:20:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:11 smithi057 ceph-mon[92072]: pgmap v12245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:20:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:11 smithi122 ceph-mon[125440]: pgmap v12245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:20:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:12 smithi136 ceph-mon[125702]: osdmap e838: 12 total, 12 up, 12 in 2023-03-02T17:20:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:12 smithi057 ceph-mon[92072]: osdmap e838: 12 total, 12 up, 12 in 2023-03-02T17:20:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:12 smithi122 ceph-mon[125440]: osdmap e838: 12 total, 12 up, 12 in 2023-03-02T17:20:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:13 smithi136 ceph-mon[125702]: pgmap v12247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:13 smithi057 ceph-mon[92072]: pgmap v12247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:13 smithi122 ceph-mon[125440]: pgmap v12247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:14.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:20:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:20:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:20:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:20:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:20:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:15 smithi136 ceph-mon[125702]: pgmap v12248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:20:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:20:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:20:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:20:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:20:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:15 smithi057 ceph-mon[92072]: pgmap v12248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:20:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:20:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:20:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:20:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:20:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:15 smithi122 ceph-mon[125440]: pgmap v12248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:20:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:20:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:20:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:18 smithi136 ceph-mon[125702]: pgmap v12249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:20:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:18 smithi057 ceph-mon[92072]: pgmap v12249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:20:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:18 smithi122 ceph-mon[125440]: pgmap v12249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:20:19.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:19 smithi136 ceph-mon[125702]: pgmap v12250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:20:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:19 smithi057 ceph-mon[92072]: pgmap v12250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:20:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:19 smithi122 ceph-mon[125440]: pgmap v12250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:20:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:21.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:20:21.599 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:21.598+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:20:21.599 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:21.598+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:20:21.599 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:21.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:20:21.599 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:21.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:20:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:21 smithi136 ceph-mon[125702]: osdmap e839: 12 total, 12 up, 12 in 2023-03-02T17:20:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:21 smithi136 ceph-mon[125702]: pgmap v12252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T17:20:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:21 smithi057 ceph-mon[92072]: osdmap e839: 12 total, 12 up, 12 in 2023-03-02T17:20:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:21 smithi057 ceph-mon[92072]: pgmap v12252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T17:20:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:21 smithi122 ceph-mon[125440]: osdmap e839: 12 total, 12 up, 12 in 2023-03-02T17:20:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:21 smithi122 ceph-mon[125440]: pgmap v12252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 315 B/s wr, 10 op/s 2023-03-02T17:20:24.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:24 smithi136 ceph-mon[125702]: pgmap v12253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:24 smithi057 ceph-mon[92072]: pgmap v12253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:24 smithi122 ceph-mon[125440]: pgmap v12253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:25.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:25 smithi136 ceph-mon[125702]: pgmap v12254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:25 smithi057 ceph-mon[92072]: pgmap v12254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:25 smithi122 ceph-mon[125440]: pgmap v12254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:20:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:28 smithi136 ceph-mon[125702]: pgmap v12255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:20:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:28 smithi057 ceph-mon[92072]: pgmap v12255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:20:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:28 smithi122 ceph-mon[125440]: pgmap v12255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:20:30.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:30 smithi136 ceph-mon[125702]: pgmap v12256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:20:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:30 smithi057 ceph-mon[92072]: pgmap v12256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:20:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:30 smithi122 ceph-mon[125440]: pgmap v12256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:20:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:31 smithi136 ceph-mon[125702]: pgmap v12257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:20:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:31 smithi057 ceph-mon[92072]: pgmap v12257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:20:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:31 smithi122 ceph-mon[125440]: pgmap v12257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:20:34.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:34 smithi136 ceph-mon[125702]: pgmap v12258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:20:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:34 smithi057 ceph-mon[92072]: pgmap v12258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:20:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:34 smithi122 ceph-mon[125440]: pgmap v12258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:20:35.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:35 smithi136 ceph-mon[125702]: pgmap v12259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:35 smithi057 ceph-mon[92072]: pgmap v12259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:35 smithi122 ceph-mon[125440]: pgmap v12259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:36.614+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:20:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:36.614+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:20:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:36.614+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:20:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:36.614+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:20:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:36.614+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:20:38.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:38 smithi136 ceph-mon[125702]: pgmap v12260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:20:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:38 smithi057 ceph-mon[92072]: pgmap v12260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:20:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:38 smithi122 ceph-mon[125440]: pgmap v12260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:20:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:39 smithi136 ceph-mon[125702]: pgmap v12261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:39 smithi057 ceph-mon[92072]: pgmap v12261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:39 smithi122 ceph-mon[125440]: pgmap v12261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:41 smithi136 ceph-mon[125702]: pgmap v12262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:42.018 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:41 smithi122 ceph-mon[125440]: pgmap v12262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:42.019 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:41 smithi057 ceph-mon[92072]: pgmap v12262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:20:44.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:44 smithi136 ceph-mon[125702]: pgmap v12263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:20:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:44 smithi057 ceph-mon[92072]: pgmap v12263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:20:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:44 smithi122 ceph-mon[125440]: pgmap v12263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:20:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:45 smithi136 ceph-mon[125702]: pgmap v12264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:20:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:45 smithi057 ceph-mon[92072]: pgmap v12264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:20:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:45 smithi122 ceph-mon[125440]: pgmap v12264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:20:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:48 smithi136 ceph-mon[125702]: pgmap v12265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:20:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:48 smithi057 ceph-mon[92072]: pgmap v12265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:20:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:48 smithi122 ceph-mon[125440]: pgmap v12265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:20:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:49 smithi136 ceph-mon[125702]: pgmap v12266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:20:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:49 smithi057 ceph-mon[92072]: pgmap v12266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:20:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:49 smithi122 ceph-mon[125440]: pgmap v12266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:20:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:51.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:20:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:51.621+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:20:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:51.621+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:20:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:51.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:20:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:20:51.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:20:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:51 smithi136 ceph-mon[125702]: pgmap v12267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:20:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:51 smithi057 ceph-mon[92072]: pgmap v12267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:20:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:51 smithi122 ceph-mon[125440]: pgmap v12267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:20:54.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:54 smithi136 ceph-mon[125702]: pgmap v12268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T17:20:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:54 smithi057 ceph-mon[92072]: pgmap v12268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T17:20:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:54 smithi122 ceph-mon[125440]: pgmap v12268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T17:20:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:55 smithi136 ceph-mon[125702]: pgmap v12269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T17:20:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:55 smithi057 ceph-mon[92072]: pgmap v12269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T17:20:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:55 smithi122 ceph-mon[125440]: pgmap v12269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T17:20:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:57 smithi057 ceph-mon[92072]: pgmap v12270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:20:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:57 smithi122 ceph-mon[125440]: pgmap v12270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:20:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:57 smithi136 ceph-mon[125702]: pgmap v12270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:20:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:20:59 smithi057 ceph-mon[92072]: pgmap v12271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:20:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:20:59 smithi122 ceph-mon[125440]: pgmap v12271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:20:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:20:59 smithi136 ceph-mon[125702]: pgmap v12271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:21:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:01 smithi136 ceph-mon[125702]: pgmap v12272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:21:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:01 smithi057 ceph-mon[92072]: pgmap v12272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:21:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:01 smithi122 ceph-mon[125440]: pgmap v12272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:21:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:03 smithi057 ceph-mon[92072]: pgmap v12273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:21:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:03 smithi122 ceph-mon[125440]: pgmap v12273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:21:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:03 smithi136 ceph-mon[125702]: pgmap v12273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:21:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:05 smithi057 ceph-mon[92072]: pgmap v12274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:21:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:05 smithi122 ceph-mon[125440]: pgmap v12274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:21:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:05 smithi136 ceph-mon[125702]: pgmap v12274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:21:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:06.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:21:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:06.629+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:21:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:06.629+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:21:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:06.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:21:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:06.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:21:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:07 smithi057 ceph-mon[92072]: pgmap v12275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:21:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:07 smithi122 ceph-mon[125440]: pgmap v12275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:21:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:07 smithi136 ceph-mon[125702]: pgmap v12275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:21:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:09 smithi057 ceph-mon[92072]: pgmap v12276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:21:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:09 smithi122 ceph-mon[125440]: pgmap v12276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:21:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:09 smithi136 ceph-mon[125702]: pgmap v12276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:21:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:11 smithi136 ceph-mon[125702]: pgmap v12277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:21:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:11 smithi057 ceph-mon[92072]: pgmap v12277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:21:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:11 smithi122 ceph-mon[125440]: pgmap v12277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:21:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:12 smithi136 ceph-mon[125702]: osdmap e840: 12 total, 12 up, 12 in 2023-03-02T17:21:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:12 smithi057 ceph-mon[92072]: osdmap e840: 12 total, 12 up, 12 in 2023-03-02T17:21:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:12 smithi122 ceph-mon[125440]: osdmap e840: 12 total, 12 up, 12 in 2023-03-02T17:21:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:13 smithi136 ceph-mon[125702]: pgmap v12279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:13 smithi057 ceph-mon[92072]: pgmap v12279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:13 smithi122 ceph-mon[125440]: pgmap v12279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:15 smithi057 ceph-mon[92072]: pgmap v12280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:15 smithi122 ceph-mon[125440]: pgmap v12280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:15 smithi136 ceph-mon[125702]: pgmap v12280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:16.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:21:16.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:16.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:16.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:16.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:21:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:21:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:21:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:21:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:17 smithi136 ceph-mon[125702]: pgmap v12281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:21:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:21:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:17 smithi057 ceph-mon[92072]: pgmap v12281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:21:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:21:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:21:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:17 smithi122 ceph-mon[125440]: pgmap v12281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:19 smithi057 ceph-mon[92072]: pgmap v12282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:19 smithi122 ceph-mon[125440]: pgmap v12282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:19 smithi136 ceph-mon[125702]: pgmap v12282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:21:21.640 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:21.639+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:21:21.640 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:21.640+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:21:21.640 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:21.640+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:21:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:21.640+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:21:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:21.640+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:21:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:21 smithi136 ceph-mon[125702]: osdmap e841: 12 total, 12 up, 12 in 2023-03-02T17:21:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:21 smithi136 ceph-mon[125702]: pgmap v12284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:21:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:21 smithi057 ceph-mon[92072]: osdmap e841: 12 total, 12 up, 12 in 2023-03-02T17:21:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:21 smithi057 ceph-mon[92072]: pgmap v12284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:21:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:21 smithi122 ceph-mon[125440]: osdmap e841: 12 total, 12 up, 12 in 2023-03-02T17:21:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:21 smithi122 ceph-mon[125440]: pgmap v12284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-02T17:21:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:23 smithi057 ceph-mon[92072]: pgmap v12285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:21:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:23 smithi122 ceph-mon[125440]: pgmap v12285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:21:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:23 smithi136 ceph-mon[125702]: pgmap v12285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:21:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:25 smithi057 ceph-mon[92072]: pgmap v12286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:21:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:25 smithi122 ceph-mon[125440]: pgmap v12286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:21:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:25 smithi136 ceph-mon[125702]: pgmap v12286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:21:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:27 smithi057 ceph-mon[92072]: pgmap v12287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:21:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:27 smithi122 ceph-mon[125440]: pgmap v12287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:21:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:27 smithi136 ceph-mon[125702]: pgmap v12287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:21:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:29 smithi057 ceph-mon[92072]: pgmap v12288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:21:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:29 smithi122 ceph-mon[125440]: pgmap v12288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:21:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:29 smithi136 ceph-mon[125702]: pgmap v12288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:21:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:31 smithi136 ceph-mon[125702]: pgmap v12289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T17:21:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:31 smithi057 ceph-mon[92072]: pgmap v12289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T17:21:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:31 smithi122 ceph-mon[125440]: pgmap v12289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T17:21:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:33 smithi057 ceph-mon[92072]: pgmap v12290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:21:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:33 smithi122 ceph-mon[125440]: pgmap v12290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:21:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:33 smithi136 ceph-mon[125702]: pgmap v12290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:21:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:35 smithi057 ceph-mon[92072]: pgmap v12291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:35 smithi122 ceph-mon[125440]: pgmap v12291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:35 smithi136 ceph-mon[125702]: pgmap v12291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:36.655+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:21:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:36.656+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:21:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:36.656+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:21:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:36.656+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:21:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:36.656+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:21:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:37 smithi057 ceph-mon[92072]: pgmap v12292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:37 smithi122 ceph-mon[125440]: pgmap v12292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:37 smithi136 ceph-mon[125702]: pgmap v12292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:39 smithi057 ceph-mon[92072]: pgmap v12293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:39 smithi122 ceph-mon[125440]: pgmap v12293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:39 smithi136 ceph-mon[125702]: pgmap v12293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:41 smithi136 ceph-mon[125702]: pgmap v12294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:41 smithi057 ceph-mon[92072]: pgmap v12294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:41 smithi122 ceph-mon[125440]: pgmap v12294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:43 smithi057 ceph-mon[92072]: pgmap v12295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:43 smithi122 ceph-mon[125440]: pgmap v12295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:43 smithi136 ceph-mon[125702]: pgmap v12295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:45 smithi057 ceph-mon[92072]: pgmap v12296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:45 smithi122 ceph-mon[125440]: pgmap v12296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:45 smithi136 ceph-mon[125702]: pgmap v12296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:47 smithi057 ceph-mon[92072]: pgmap v12297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:47 smithi122 ceph-mon[125440]: pgmap v12297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:47 smithi136 ceph-mon[125702]: pgmap v12297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:49 smithi057 ceph-mon[92072]: pgmap v12298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:49 smithi122 ceph-mon[125440]: pgmap v12298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:49 smithi136 ceph-mon[125702]: pgmap v12298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:51.668+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:21:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:51.668+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:21:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:51.668+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:21:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:51.668+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:21:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:21:51.669+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:21:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:51 smithi136 ceph-mon[125702]: pgmap v12299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:51 smithi057 ceph-mon[92072]: pgmap v12299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:51 smithi122 ceph-mon[125440]: pgmap v12299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:53 smithi057 ceph-mon[92072]: pgmap v12300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:53 smithi122 ceph-mon[125440]: pgmap v12300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:53 smithi136 ceph-mon[125702]: pgmap v12300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:55 smithi057 ceph-mon[92072]: pgmap v12301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:55 smithi122 ceph-mon[125440]: pgmap v12301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:55 smithi136 ceph-mon[125702]: pgmap v12301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:57 smithi057 ceph-mon[92072]: pgmap v12302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:57 smithi122 ceph-mon[125440]: pgmap v12302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:57 smithi136 ceph-mon[125702]: pgmap v12302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:21:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:21:59 smithi057 ceph-mon[92072]: pgmap v12303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:21:59 smithi122 ceph-mon[125440]: pgmap v12303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:21:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:21:59 smithi136 ceph-mon[125702]: pgmap v12303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:01 smithi136 ceph-mon[125702]: pgmap v12304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:01 smithi057 ceph-mon[92072]: pgmap v12304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:01 smithi122 ceph-mon[125440]: pgmap v12304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:03 smithi057 ceph-mon[92072]: pgmap v12305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:22:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:03 smithi122 ceph-mon[125440]: pgmap v12305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:22:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:03 smithi136 ceph-mon[125702]: pgmap v12305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:22:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:05 smithi057 ceph-mon[92072]: pgmap v12306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:22:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:05 smithi122 ceph-mon[125440]: pgmap v12306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:22:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:05 smithi136 ceph-mon[125702]: pgmap v12306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:22:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:06.676+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:22:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:06.676+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:22:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:06.676+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:22:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:06.676+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:22:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:06.676+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:22:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:07 smithi136 ceph-mon[125702]: osdmap e842: 12 total, 12 up, 12 in 2023-03-02T17:22:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:07 smithi136 ceph-mon[125702]: pgmap v12308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:22:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:07 smithi057 ceph-mon[92072]: osdmap e842: 12 total, 12 up, 12 in 2023-03-02T17:22:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:07 smithi057 ceph-mon[92072]: pgmap v12308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:22:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:07 smithi122 ceph-mon[125440]: osdmap e842: 12 total, 12 up, 12 in 2023-03-02T17:22:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:07 smithi122 ceph-mon[125440]: pgmap v12308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:22:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:09 smithi057 ceph-mon[92072]: pgmap v12309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:22:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:09 smithi122 ceph-mon[125440]: pgmap v12309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:22:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:09 smithi136 ceph-mon[125702]: pgmap v12309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:22:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:11 smithi136 ceph-mon[125702]: osdmap e843: 12 total, 12 up, 12 in 2023-03-02T17:22:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:11 smithi136 ceph-mon[125702]: pgmap v12311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:22:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:11 smithi057 ceph-mon[92072]: osdmap e843: 12 total, 12 up, 12 in 2023-03-02T17:22:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:11 smithi057 ceph-mon[92072]: pgmap v12311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:22:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:11 smithi122 ceph-mon[125440]: osdmap e843: 12 total, 12 up, 12 in 2023-03-02T17:22:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:11 smithi122 ceph-mon[125440]: pgmap v12311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T17:22:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:13 smithi057 ceph-mon[92072]: pgmap v12312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:22:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:13 smithi122 ceph-mon[125440]: pgmap v12312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:22:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:13 smithi136 ceph-mon[125702]: pgmap v12312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:22:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:15 smithi057 ceph-mon[92072]: pgmap v12313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:22:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:15 smithi122 ceph-mon[125440]: pgmap v12313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:22:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:15 smithi136 ceph-mon[125702]: pgmap v12313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-02T17:22:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:22:17.431 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:22:17.450 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:22:18.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:18 smithi136 ceph-mon[125702]: pgmap v12314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:22:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:22:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:22:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:22:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:18 smithi057 ceph-mon[92072]: pgmap v12314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:22:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:22:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:22:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:22:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:18 smithi122 ceph-mon[125440]: pgmap v12314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:22:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:22:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:22:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:22:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:19 smithi057 ceph-mon[92072]: pgmap v12315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:22:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:19 smithi122 ceph-mon[125440]: pgmap v12315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:22:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:19 smithi136 ceph-mon[125702]: pgmap v12315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:22:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:21.683+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:22:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:21.683+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:22:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:21.683+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:22:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:21.683+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:22:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:21.683+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:22:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:21 smithi136 ceph-mon[125702]: pgmap v12316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:22:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:21 smithi057 ceph-mon[92072]: pgmap v12316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:22:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:21 smithi122 ceph-mon[125440]: pgmap v12316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-02T17:22:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:23 smithi057 ceph-mon[92072]: pgmap v12317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:22:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:23 smithi122 ceph-mon[125440]: pgmap v12317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:22:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:23 smithi136 ceph-mon[125702]: pgmap v12317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T17:22:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:25 smithi057 ceph-mon[92072]: pgmap v12318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:25 smithi122 ceph-mon[125440]: pgmap v12318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:25 smithi136 ceph-mon[125702]: pgmap v12318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:27 smithi057 ceph-mon[92072]: pgmap v12319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:22:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:27 smithi122 ceph-mon[125440]: pgmap v12319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:22:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:27 smithi136 ceph-mon[125702]: pgmap v12319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:22:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:29 smithi057 ceph-mon[92072]: pgmap v12320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:29 smithi122 ceph-mon[125440]: pgmap v12320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:29 smithi136 ceph-mon[125702]: pgmap v12320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:31 smithi136 ceph-mon[125702]: pgmap v12321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:31 smithi057 ceph-mon[92072]: pgmap v12321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:31 smithi122 ceph-mon[125440]: pgmap v12321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:33 smithi057 ceph-mon[92072]: pgmap v12322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:33 smithi122 ceph-mon[125440]: pgmap v12322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:33 smithi136 ceph-mon[125702]: pgmap v12322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:35 smithi057 ceph-mon[92072]: pgmap v12323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:35 smithi122 ceph-mon[125440]: pgmap v12323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:35 smithi136 ceph-mon[125702]: pgmap v12323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:36.694+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:22:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:36.695+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:22:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:36.695+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:22:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:36.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:22:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:36.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:22:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:37 smithi057 ceph-mon[92072]: pgmap v12324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:37 smithi122 ceph-mon[125440]: pgmap v12324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:37 smithi136 ceph-mon[125702]: pgmap v12324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:39 smithi057 ceph-mon[92072]: pgmap v12325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:39 smithi122 ceph-mon[125440]: pgmap v12325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:39 smithi136 ceph-mon[125702]: pgmap v12325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:41 smithi136 ceph-mon[125702]: pgmap v12326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:41 smithi057 ceph-mon[92072]: pgmap v12326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:41 smithi122 ceph-mon[125440]: pgmap v12326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:43 smithi057 ceph-mon[92072]: pgmap v12327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:43 smithi122 ceph-mon[125440]: pgmap v12327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:43 smithi136 ceph-mon[125702]: pgmap v12327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:45 smithi057 ceph-mon[92072]: pgmap v12328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:45 smithi122 ceph-mon[125440]: pgmap v12328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:45 smithi136 ceph-mon[125702]: pgmap v12328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:47 smithi057 ceph-mon[92072]: pgmap v12329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:47 smithi122 ceph-mon[125440]: pgmap v12329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:47 smithi136 ceph-mon[125702]: pgmap v12329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:49 smithi057 ceph-mon[92072]: pgmap v12330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:49 smithi122 ceph-mon[125440]: pgmap v12330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:49 smithi136 ceph-mon[125702]: pgmap v12330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:51.696+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:22:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:51.697+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:22:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:51.697+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:22:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:51.697+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:22:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:22:51.697+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:22:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:51 smithi136 ceph-mon[125702]: pgmap v12331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:51 smithi057 ceph-mon[92072]: pgmap v12331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:51 smithi122 ceph-mon[125440]: pgmap v12331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:53 smithi057 ceph-mon[92072]: pgmap v12332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:53 smithi122 ceph-mon[125440]: pgmap v12332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:53 smithi136 ceph-mon[125702]: pgmap v12332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:55 smithi057 ceph-mon[92072]: pgmap v12333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:55 smithi122 ceph-mon[125440]: pgmap v12333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:55 smithi136 ceph-mon[125702]: pgmap v12333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:57 smithi057 ceph-mon[92072]: pgmap v12334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:57 smithi122 ceph-mon[125440]: pgmap v12334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:57 smithi136 ceph-mon[125702]: pgmap v12334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:22:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:22:59 smithi057 ceph-mon[92072]: pgmap v12335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:22:59 smithi122 ceph-mon[125440]: pgmap v12335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:22:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:22:59 smithi136 ceph-mon[125702]: pgmap v12335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:01 smithi136 ceph-mon[125702]: pgmap v12336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:01 smithi057 ceph-mon[92072]: pgmap v12336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:01 smithi122 ceph-mon[125440]: pgmap v12336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:03 smithi057 ceph-mon[92072]: pgmap v12337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:23:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:03 smithi122 ceph-mon[125440]: pgmap v12337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:23:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:03 smithi136 ceph-mon[125702]: pgmap v12337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:23:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:05 smithi057 ceph-mon[92072]: pgmap v12338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:23:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:05 smithi122 ceph-mon[125440]: pgmap v12338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:23:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:05 smithi136 ceph-mon[125702]: pgmap v12338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:23:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:06.713+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:23:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:06.713+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:23:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:06.713+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:23:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:06.713+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:23:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:06.713+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:23:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:07 smithi136 ceph-mon[125702]: osdmap e844: 12 total, 12 up, 12 in 2023-03-02T17:23:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:07 smithi136 ceph-mon[125702]: pgmap v12340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:23:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:07 smithi057 ceph-mon[92072]: osdmap e844: 12 total, 12 up, 12 in 2023-03-02T17:23:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:07 smithi057 ceph-mon[92072]: pgmap v12340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:23:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:07 smithi122 ceph-mon[125440]: osdmap e844: 12 total, 12 up, 12 in 2023-03-02T17:23:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:07 smithi122 ceph-mon[125440]: pgmap v12340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:23:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:09 smithi057 ceph-mon[92072]: pgmap v12341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:23:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:09 smithi122 ceph-mon[125440]: pgmap v12341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:23:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:09 smithi136 ceph-mon[125702]: pgmap v12341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:23:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:11.695+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:23:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:11.695+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:23:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:11.695+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 179 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:23:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:11.696+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 180 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:23:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:11 smithi136 ceph-mon[125702]: pgmap v12342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:23:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:11 smithi057 ceph-mon[92072]: pgmap v12342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:23:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:11 smithi122 ceph-mon[125440]: pgmap v12342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:23:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:13 smithi057 ceph-mon[92072]: pgmap v12343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:23:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:13 smithi122 ceph-mon[125440]: pgmap v12343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:23:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:13 smithi136 ceph-mon[125702]: pgmap v12343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:23:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:15 smithi057 ceph-mon[92072]: pgmap v12344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:23:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:15 smithi122 ceph-mon[125440]: pgmap v12344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:23:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:15 smithi136 ceph-mon[125702]: pgmap v12344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:23:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:16 smithi136 ceph-mon[125702]: osdmap e845: 12 total, 12 up, 12 in 2023-03-02T17:23:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:16 smithi057 ceph-mon[92072]: osdmap e845: 12 total, 12 up, 12 in 2023-03-02T17:23:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:16 smithi122 ceph-mon[125440]: osdmap e845: 12 total, 12 up, 12 in 2023-03-02T17:23:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:17 smithi136 ceph-mon[125702]: pgmap v12346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:23:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:17 smithi057 ceph-mon[92072]: pgmap v12346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:23:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:17 smithi122 ceph-mon[125440]: pgmap v12346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:23:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:23:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:23:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:23:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:23:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:23:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:23:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:19 smithi057 ceph-mon[92072]: pgmap v12347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:23:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:23:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:23:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:23:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:19 smithi122 ceph-mon[125440]: pgmap v12347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:23:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:23:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:23:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:23:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:19 smithi136 ceph-mon[125702]: pgmap v12347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:23:21.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:21.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:23:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:21.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:23:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:21.727+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:23:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:21.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:23:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:21.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:23:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:21 smithi136 ceph-mon[125702]: pgmap v12348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:23:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:21 smithi057 ceph-mon[92072]: pgmap v12348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:23:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:21 smithi122 ceph-mon[125440]: pgmap v12348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:23:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:23 smithi057 ceph-mon[92072]: pgmap v12349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:23:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:23 smithi122 ceph-mon[125440]: pgmap v12349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:23:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:23 smithi136 ceph-mon[125702]: pgmap v12349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:23:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:25 smithi057 ceph-mon[92072]: pgmap v12350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:23:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:25 smithi122 ceph-mon[125440]: pgmap v12350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:23:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:25 smithi136 ceph-mon[125702]: pgmap v12350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:23:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:27 smithi057 ceph-mon[92072]: pgmap v12351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T17:23:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:27 smithi122 ceph-mon[125440]: pgmap v12351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T17:23:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:27 smithi136 ceph-mon[125702]: pgmap v12351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T17:23:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:29 smithi057 ceph-mon[92072]: pgmap v12352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:29.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:29 smithi122 ceph-mon[125440]: pgmap v12352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:29 smithi136 ceph-mon[125702]: pgmap v12352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:31 smithi136 ceph-mon[125702]: pgmap v12353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:31 smithi057 ceph-mon[92072]: pgmap v12353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:31 smithi122 ceph-mon[125440]: pgmap v12353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:33 smithi057 ceph-mon[92072]: pgmap v12354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:33 smithi122 ceph-mon[125440]: pgmap v12354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:33 smithi136 ceph-mon[125702]: pgmap v12354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:35 smithi057 ceph-mon[92072]: pgmap v12355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:35 smithi122 ceph-mon[125440]: pgmap v12355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:35 smithi136 ceph-mon[125702]: pgmap v12355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:36.737+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:23:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:36.737+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:23:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:36.737+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:23:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:36.737+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:23:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:36.737+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:23:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:37 smithi057 ceph-mon[92072]: pgmap v12356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:37.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:37 smithi122 ceph-mon[125440]: pgmap v12356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:37 smithi136 ceph-mon[125702]: pgmap v12356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:39 smithi057 ceph-mon[92072]: pgmap v12357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:39 smithi122 ceph-mon[125440]: pgmap v12357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:39 smithi136 ceph-mon[125702]: pgmap v12357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:41 smithi136 ceph-mon[125702]: pgmap v12358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:41 smithi057 ceph-mon[92072]: pgmap v12358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:41 smithi122 ceph-mon[125440]: pgmap v12358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:43 smithi057 ceph-mon[92072]: pgmap v12359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:43 smithi122 ceph-mon[125440]: pgmap v12359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:43 smithi136 ceph-mon[125702]: pgmap v12359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:45 smithi057 ceph-mon[92072]: pgmap v12360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:45 smithi122 ceph-mon[125440]: pgmap v12360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:45 smithi136 ceph-mon[125702]: pgmap v12360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:47 smithi057 ceph-mon[92072]: pgmap v12361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:47 smithi122 ceph-mon[125440]: pgmap v12361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:47 smithi136 ceph-mon[125702]: pgmap v12361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:49 smithi057 ceph-mon[92072]: pgmap v12362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:49 smithi122 ceph-mon[125440]: pgmap v12362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:49 smithi136 ceph-mon[125702]: pgmap v12362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:51.753+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:23:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:51.753+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:23:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:51.753+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:23:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:51.753+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:23:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:23:51.753+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:23:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:51 smithi136 ceph-mon[125702]: pgmap v12363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:51 smithi057 ceph-mon[92072]: pgmap v12363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:51 smithi122 ceph-mon[125440]: pgmap v12363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:53 smithi057 ceph-mon[92072]: pgmap v12364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:53 smithi122 ceph-mon[125440]: pgmap v12364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:53 smithi136 ceph-mon[125702]: pgmap v12364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:55 smithi057 ceph-mon[92072]: pgmap v12365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:55 smithi122 ceph-mon[125440]: pgmap v12365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:55 smithi136 ceph-mon[125702]: pgmap v12365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:57 smithi057 ceph-mon[92072]: pgmap v12366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:57 smithi122 ceph-mon[125440]: pgmap v12366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:57 smithi136 ceph-mon[125702]: pgmap v12366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:23:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:23:59 smithi057 ceph-mon[92072]: pgmap v12367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:23:59 smithi122 ceph-mon[125440]: pgmap v12367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:23:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:23:59 smithi136 ceph-mon[125702]: pgmap v12367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:01 smithi136 ceph-mon[125702]: pgmap v12368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:01 smithi057 ceph-mon[92072]: pgmap v12368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:01 smithi122 ceph-mon[125440]: pgmap v12368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:03 smithi057 ceph-mon[92072]: pgmap v12369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:24:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:03 smithi122 ceph-mon[125440]: pgmap v12369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:24:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:03 smithi136 ceph-mon[125702]: pgmap v12369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:24:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:05 smithi057 ceph-mon[92072]: pgmap v12370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:24:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:05 smithi122 ceph-mon[125440]: pgmap v12370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:24:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:05 smithi136 ceph-mon[125702]: pgmap v12370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:24:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:06.769+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:24:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:06.769+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:24:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:06.769+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:24:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:06.769+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:24:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:06.769+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:24:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:07 smithi136 ceph-mon[125702]: osdmap e846: 12 total, 12 up, 12 in 2023-03-02T17:24:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:07 smithi136 ceph-mon[125702]: pgmap v12372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:24:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:07 smithi057 ceph-mon[92072]: osdmap e846: 12 total, 12 up, 12 in 2023-03-02T17:24:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:07 smithi057 ceph-mon[92072]: pgmap v12372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:24:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:07 smithi122 ceph-mon[125440]: osdmap e846: 12 total, 12 up, 12 in 2023-03-02T17:24:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:07 smithi122 ceph-mon[125440]: pgmap v12372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:24:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:09 smithi057 ceph-mon[92072]: pgmap v12373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:24:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:09 smithi122 ceph-mon[125440]: pgmap v12373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:24:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:09 smithi136 ceph-mon[125702]: pgmap v12373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:24:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:11 smithi136 ceph-mon[125702]: pgmap v12374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:24:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:11 smithi057 ceph-mon[92072]: pgmap v12374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:24:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:11 smithi122 ceph-mon[125440]: pgmap v12374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:24:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:13 smithi057 ceph-mon[92072]: pgmap v12375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:24:13.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:13 smithi122 ceph-mon[125440]: pgmap v12375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:24:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:13 smithi136 ceph-mon[125702]: pgmap v12375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:24:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:15 smithi057 ceph-mon[92072]: pgmap v12376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:24:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:15 smithi122 ceph-mon[125440]: pgmap v12376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:24:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:15 smithi136 ceph-mon[125702]: pgmap v12376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:24:16.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:16 smithi136 ceph-mon[125702]: osdmap e847: 12 total, 12 up, 12 in 2023-03-02T17:24:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:16 smithi057 ceph-mon[92072]: osdmap e847: 12 total, 12 up, 12 in 2023-03-02T17:24:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:16 smithi122 ceph-mon[125440]: osdmap e847: 12 total, 12 up, 12 in 2023-03-02T17:24:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:17 smithi057 ceph-mon[92072]: pgmap v12378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:24:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:17 smithi122 ceph-mon[125440]: pgmap v12378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:24:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:17 smithi136 ceph-mon[125702]: pgmap v12378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:24:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:24:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:24:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:24:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:19 smithi136 ceph-mon[125702]: pgmap v12379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:24:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:24:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:24:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:24:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:19 smithi057 ceph-mon[92072]: pgmap v12379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:24:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:24:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:24:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:24:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:19 smithi122 ceph-mon[125440]: pgmap v12379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:24:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:24:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:24:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:24:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:21.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:24:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:21.783+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:24:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:21.783+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:24:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:21.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:24:21.785 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:21.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:24:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:21 smithi057 ceph-mon[92072]: pgmap v12380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:24:21.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:21 smithi122 ceph-mon[125440]: pgmap v12380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:24:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:21 smithi136 ceph-mon[125702]: pgmap v12380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:24:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:23 smithi057 ceph-mon[92072]: pgmap v12381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:24:23.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:23 smithi122 ceph-mon[125440]: pgmap v12381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:24:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:23 smithi136 ceph-mon[125702]: pgmap v12381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:24:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:25 smithi057 ceph-mon[92072]: pgmap v12382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:24:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:25 smithi122 ceph-mon[125440]: pgmap v12382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:24:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:25 smithi136 ceph-mon[125702]: pgmap v12382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:24:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:27 smithi057 ceph-mon[92072]: pgmap v12383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:24:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:27 smithi122 ceph-mon[125440]: pgmap v12383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:24:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:27 smithi136 ceph-mon[125702]: pgmap v12383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:24:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:29 smithi057 ceph-mon[92072]: pgmap v12384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:29 smithi122 ceph-mon[125440]: pgmap v12384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:29 smithi136 ceph-mon[125702]: pgmap v12384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:31 smithi057 ceph-mon[92072]: pgmap v12385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:31 smithi122 ceph-mon[125440]: pgmap v12385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:31 smithi136 ceph-mon[125702]: pgmap v12385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:33 smithi057 ceph-mon[92072]: pgmap v12386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:33 smithi122 ceph-mon[125440]: pgmap v12386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:33 smithi136 ceph-mon[125702]: pgmap v12386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:35 smithi057 ceph-mon[92072]: pgmap v12387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:35 smithi122 ceph-mon[125440]: pgmap v12387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:35 smithi136 ceph-mon[125702]: pgmap v12387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:36.800+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:24:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:36.800+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:24:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:36.800+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:24:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:36.800+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:24:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:36.800+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:24:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:37 smithi057 ceph-mon[92072]: pgmap v12388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:37 smithi122 ceph-mon[125440]: pgmap v12388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:37 smithi136 ceph-mon[125702]: pgmap v12388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:39 smithi057 ceph-mon[92072]: pgmap v12389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:39 smithi122 ceph-mon[125440]: pgmap v12389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:39 smithi136 ceph-mon[125702]: pgmap v12389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:41 smithi057 ceph-mon[92072]: pgmap v12390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:41 smithi122 ceph-mon[125440]: pgmap v12390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:41 smithi136 ceph-mon[125702]: pgmap v12390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:43 smithi057 ceph-mon[92072]: pgmap v12391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:43 smithi122 ceph-mon[125440]: pgmap v12391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:43 smithi136 ceph-mon[125702]: pgmap v12391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:45 smithi057 ceph-mon[92072]: pgmap v12392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:45 smithi122 ceph-mon[125440]: pgmap v12392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:45 smithi136 ceph-mon[125702]: pgmap v12392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:47 smithi057 ceph-mon[92072]: pgmap v12393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:47 smithi122 ceph-mon[125440]: pgmap v12393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:47 smithi136 ceph-mon[125702]: pgmap v12393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:49 smithi057 ceph-mon[92072]: pgmap v12394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:49 smithi122 ceph-mon[125440]: pgmap v12394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:49 smithi136 ceph-mon[125702]: pgmap v12394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:51.811+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:24:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:51.812+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:24:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:51.812+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:24:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:51.812+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:24:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:24:51.812+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:24:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:51 smithi057 ceph-mon[92072]: pgmap v12395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:51 smithi122 ceph-mon[125440]: pgmap v12395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:51 smithi136 ceph-mon[125702]: pgmap v12395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:53 smithi057 ceph-mon[92072]: pgmap v12396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:53 smithi122 ceph-mon[125440]: pgmap v12396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:53 smithi136 ceph-mon[125702]: pgmap v12396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:55 smithi057 ceph-mon[92072]: pgmap v12397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:55 smithi122 ceph-mon[125440]: pgmap v12397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:55 smithi136 ceph-mon[125702]: pgmap v12397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:57 smithi057 ceph-mon[92072]: pgmap v12398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:57 smithi122 ceph-mon[125440]: pgmap v12398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:57 smithi136 ceph-mon[125702]: pgmap v12398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:24:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:24:59 smithi057 ceph-mon[92072]: pgmap v12399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:24:59 smithi122 ceph-mon[125440]: pgmap v12399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:24:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:24:59 smithi136 ceph-mon[125702]: pgmap v12399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:01 smithi057 ceph-mon[92072]: pgmap v12400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:01.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:01 smithi122 ceph-mon[125440]: pgmap v12400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:01 smithi136 ceph-mon[125702]: pgmap v12400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:03 smithi057 ceph-mon[92072]: pgmap v12401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:25:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:03 smithi122 ceph-mon[125440]: pgmap v12401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:25:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:03 smithi136 ceph-mon[125702]: pgmap v12401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:25:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:05 smithi057 ceph-mon[92072]: pgmap v12402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:25:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:05 smithi122 ceph-mon[125440]: pgmap v12402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:25:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:05 smithi136 ceph-mon[125702]: pgmap v12402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:25:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:06.824+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:25:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:06.825+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:25:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:06.825+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:25:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:06.825+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:25:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:06.825+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:25:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:07 smithi057 ceph-mon[92072]: osdmap e848: 12 total, 12 up, 12 in 2023-03-02T17:25:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:07 smithi057 ceph-mon[92072]: pgmap v12404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:25:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:07 smithi122 ceph-mon[125440]: osdmap e848: 12 total, 12 up, 12 in 2023-03-02T17:25:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:07 smithi122 ceph-mon[125440]: pgmap v12404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:25:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:07 smithi136 ceph-mon[125702]: osdmap e848: 12 total, 12 up, 12 in 2023-03-02T17:25:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:07 smithi136 ceph-mon[125702]: pgmap v12404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:25:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:09 smithi057 ceph-mon[92072]: pgmap v12405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:25:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:09 smithi122 ceph-mon[125440]: pgmap v12405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:25:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:09 smithi136 ceph-mon[125702]: pgmap v12405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:25:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:11 smithi057 ceph-mon[92072]: pgmap v12406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:25:11.950 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:11 smithi122 ceph-mon[125440]: pgmap v12406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:25:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:11 smithi136 ceph-mon[125702]: pgmap v12406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:25:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:13 smithi057 ceph-mon[92072]: pgmap v12407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:25:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:13 smithi122 ceph-mon[125440]: pgmap v12407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:25:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:13 smithi136 ceph-mon[125702]: pgmap v12407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:25:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:15 smithi057 ceph-mon[92072]: pgmap v12408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:25:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:15 smithi122 ceph-mon[125440]: pgmap v12408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:25:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:15 smithi136 ceph-mon[125702]: pgmap v12408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:25:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:16 smithi057 ceph-mon[92072]: osdmap e849: 12 total, 12 up, 12 in 2023-03-02T17:25:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:16 smithi122 ceph-mon[125440]: osdmap e849: 12 total, 12 up, 12 in 2023-03-02T17:25:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:16 smithi136 ceph-mon[125702]: osdmap e849: 12 total, 12 up, 12 in 2023-03-02T17:25:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:17 smithi057 ceph-mon[92072]: pgmap v12410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:25:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:17 smithi122 ceph-mon[125440]: pgmap v12410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:25:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:17 smithi136 ceph-mon[125702]: pgmap v12410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:25:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:19 smithi057 ceph-mon[92072]: pgmap v12411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:25:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:19 smithi122 ceph-mon[125440]: pgmap v12411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:25:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:19 smithi136 ceph-mon[125702]: pgmap v12411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:25:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:25:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:25:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:25:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:25:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:25:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:25:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:25:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:25:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:25:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:25:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:25:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:25:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:21.835+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:25:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:21.835+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:25:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:21.835+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:25:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:21.835+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:25:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:21.835+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:25:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:21 smithi057 ceph-mon[92072]: pgmap v12412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:25:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:21 smithi122 ceph-mon[125440]: pgmap v12412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:25:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:21 smithi136 ceph-mon[125702]: pgmap v12412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:25:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:23 smithi057 ceph-mon[92072]: pgmap v12413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:25:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:23 smithi122 ceph-mon[125440]: pgmap v12413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:25:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:23 smithi136 ceph-mon[125702]: pgmap v12413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:25:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:25 smithi057 ceph-mon[92072]: pgmap v12414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:25:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:25 smithi122 ceph-mon[125440]: pgmap v12414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:25:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:25 smithi136 ceph-mon[125702]: pgmap v12414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:25:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:27 smithi057 ceph-mon[92072]: pgmap v12415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:25:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:27 smithi122 ceph-mon[125440]: pgmap v12415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:25:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:27 smithi136 ceph-mon[125702]: pgmap v12415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:25:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:29 smithi057 ceph-mon[92072]: pgmap v12416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:29 smithi122 ceph-mon[125440]: pgmap v12416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:29 smithi136 ceph-mon[125702]: pgmap v12416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:31 smithi057 ceph-mon[92072]: pgmap v12417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:31 smithi122 ceph-mon[125440]: pgmap v12417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:31 smithi136 ceph-mon[125702]: pgmap v12417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:33 smithi057 ceph-mon[92072]: pgmap v12418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:33 smithi122 ceph-mon[125440]: pgmap v12418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:33 smithi136 ceph-mon[125702]: pgmap v12418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:35 smithi057 ceph-mon[92072]: pgmap v12419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:35 smithi122 ceph-mon[125440]: pgmap v12419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:35 smithi136 ceph-mon[125702]: pgmap v12419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:36.842+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:25:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:36.843+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:25:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:36.843+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:25:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:36.843+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:25:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:36.843+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:25:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:37 smithi057 ceph-mon[92072]: pgmap v12420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:37 smithi122 ceph-mon[125440]: pgmap v12420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:37 smithi136 ceph-mon[125702]: pgmap v12420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:39 smithi057 ceph-mon[92072]: pgmap v12421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:39 smithi122 ceph-mon[125440]: pgmap v12421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:39 smithi136 ceph-mon[125702]: pgmap v12421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:41 smithi057 ceph-mon[92072]: pgmap v12422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:41 smithi122 ceph-mon[125440]: pgmap v12422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:41 smithi136 ceph-mon[125702]: pgmap v12422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:43 smithi057 ceph-mon[92072]: pgmap v12423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:43 smithi122 ceph-mon[125440]: pgmap v12423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:43 smithi136 ceph-mon[125702]: pgmap v12423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:45 smithi057 ceph-mon[92072]: pgmap v12424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:45 smithi122 ceph-mon[125440]: pgmap v12424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:45 smithi136 ceph-mon[125702]: pgmap v12424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:47 smithi057 ceph-mon[92072]: pgmap v12425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:47 smithi122 ceph-mon[125440]: pgmap v12425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:47 smithi136 ceph-mon[125702]: pgmap v12425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:49 smithi057 ceph-mon[92072]: pgmap v12426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:49 smithi122 ceph-mon[125440]: pgmap v12426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:49 smithi136 ceph-mon[125702]: pgmap v12426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:51.859+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:25:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:51.859+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:25:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:51.859+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:25:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:51.859+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:25:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:25:51.859+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:25:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:51 smithi057 ceph-mon[92072]: pgmap v12427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:51 smithi122 ceph-mon[125440]: pgmap v12427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:51 smithi136 ceph-mon[125702]: pgmap v12427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:53 smithi057 ceph-mon[92072]: pgmap v12428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:53 smithi122 ceph-mon[125440]: pgmap v12428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:53 smithi136 ceph-mon[125702]: pgmap v12428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:55 smithi057 ceph-mon[92072]: pgmap v12429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:55 smithi122 ceph-mon[125440]: pgmap v12429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:55 smithi136 ceph-mon[125702]: pgmap v12429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:57 smithi057 ceph-mon[92072]: pgmap v12430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:57 smithi122 ceph-mon[125440]: pgmap v12430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:57 smithi136 ceph-mon[125702]: pgmap v12430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:25:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:25:59 smithi057 ceph-mon[92072]: pgmap v12431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:25:59 smithi122 ceph-mon[125440]: pgmap v12431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:25:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:25:59 smithi136 ceph-mon[125702]: pgmap v12431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:01 smithi057 ceph-mon[92072]: pgmap v12432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:01 smithi122 ceph-mon[125440]: pgmap v12432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:01 smithi136 ceph-mon[125702]: pgmap v12432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:03 smithi057 ceph-mon[92072]: pgmap v12433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:26:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:03 smithi122 ceph-mon[125440]: pgmap v12433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:26:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:03 smithi136 ceph-mon[125702]: pgmap v12433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:26:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:05 smithi057 ceph-mon[92072]: pgmap v12434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:26:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:05 smithi122 ceph-mon[125440]: pgmap v12434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:26:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:05 smithi136 ceph-mon[125702]: pgmap v12434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:26:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:06.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:06.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:06.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:06.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:06.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:26:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:07 smithi057 ceph-mon[92072]: osdmap e850: 12 total, 12 up, 12 in 2023-03-02T17:26:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:07 smithi057 ceph-mon[92072]: pgmap v12436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:26:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:07 smithi122 ceph-mon[125440]: osdmap e850: 12 total, 12 up, 12 in 2023-03-02T17:26:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:07 smithi122 ceph-mon[125440]: pgmap v12436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:26:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:07 smithi136 ceph-mon[125702]: osdmap e850: 12 total, 12 up, 12 in 2023-03-02T17:26:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:07 smithi136 ceph-mon[125702]: pgmap v12436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:26:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:09 smithi057 ceph-mon[92072]: pgmap v12437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:26:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:09 smithi122 ceph-mon[125440]: pgmap v12437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:26:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:09 smithi136 ceph-mon[125702]: pgmap v12437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:26:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:11.723+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:26:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:11.723+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:26:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:11.723+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 180 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:26:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:11.723+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 181 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:26:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:11 smithi057 ceph-mon[92072]: pgmap v12438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:26:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:11 smithi122 ceph-mon[125440]: pgmap v12438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:26:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:11 smithi136 ceph-mon[125702]: pgmap v12438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:26:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:13 smithi057 ceph-mon[92072]: pgmap v12439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:26:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:13 smithi122 ceph-mon[125440]: pgmap v12439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:26:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:13 smithi136 ceph-mon[125702]: pgmap v12439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:26:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:15 smithi057 ceph-mon[92072]: pgmap v12440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:26:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:15 smithi122 ceph-mon[125440]: pgmap v12440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:26:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:15 smithi136 ceph-mon[125702]: pgmap v12440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:26:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:16 smithi057 ceph-mon[92072]: osdmap e851: 12 total, 12 up, 12 in 2023-03-02T17:26:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:16 smithi122 ceph-mon[125440]: osdmap e851: 12 total, 12 up, 12 in 2023-03-02T17:26:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:16 smithi136 ceph-mon[125702]: osdmap e851: 12 total, 12 up, 12 in 2023-03-02T17:26:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:17 smithi057 ceph-mon[92072]: pgmap v12442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:26:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:17 smithi122 ceph-mon[125440]: pgmap v12442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:26:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:17 smithi136 ceph-mon[125702]: pgmap v12442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:26:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:19 smithi057 ceph-mon[92072]: pgmap v12443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:26:19.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:19 smithi122 ceph-mon[125440]: pgmap v12443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:26:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:19 smithi136 ceph-mon[125702]: pgmap v12443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:26:20.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:26:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:26:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:26:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:21.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:26:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:21.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:26:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:21.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:26:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:21.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:26:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:21.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:26:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:26:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:26:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:26:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:21 smithi057 ceph-mon[92072]: pgmap v12444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:26:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:26:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:26:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:26:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:21 smithi122 ceph-mon[125440]: pgmap v12444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:26:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:26:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:26:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:26:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:21 smithi136 ceph-mon[125702]: pgmap v12444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:26:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:23 smithi057 ceph-mon[92072]: pgmap v12445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:26:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:23 smithi122 ceph-mon[125440]: pgmap v12445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:26:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:23 smithi136 ceph-mon[125702]: pgmap v12445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:26:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:25 smithi057 ceph-mon[92072]: pgmap v12446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:26:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:25 smithi122 ceph-mon[125440]: pgmap v12446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:26:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:25 smithi136 ceph-mon[125702]: pgmap v12446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:26:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:27 smithi057 ceph-mon[92072]: pgmap v12447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:26:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:27 smithi122 ceph-mon[125440]: pgmap v12447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:26:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:27 smithi136 ceph-mon[125702]: pgmap v12447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:26:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:29 smithi057 ceph-mon[92072]: pgmap v12448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:29 smithi122 ceph-mon[125440]: pgmap v12448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:29 smithi136 ceph-mon[125702]: pgmap v12448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:31 smithi057 ceph-mon[92072]: pgmap v12449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:31 smithi122 ceph-mon[125440]: pgmap v12449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:31 smithi136 ceph-mon[125702]: pgmap v12449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:33 smithi057 ceph-mon[92072]: pgmap v12450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:33 smithi122 ceph-mon[125440]: pgmap v12450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:33 smithi136 ceph-mon[125702]: pgmap v12450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:35 smithi057 ceph-mon[92072]: pgmap v12451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:35 smithi122 ceph-mon[125440]: pgmap v12451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:35 smithi136 ceph-mon[125702]: pgmap v12451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:36.898 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:36.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:26:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:36.897+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:26:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:36.897+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:26:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:36.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:26:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:36.897+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:26:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:37 smithi057 ceph-mon[92072]: pgmap v12452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:37 smithi122 ceph-mon[125440]: pgmap v12452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:37 smithi136 ceph-mon[125702]: pgmap v12452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:39 smithi057 ceph-mon[92072]: pgmap v12453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:39 smithi122 ceph-mon[125440]: pgmap v12453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:39 smithi136 ceph-mon[125702]: pgmap v12453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:41 smithi057 ceph-mon[92072]: pgmap v12454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:41 smithi122 ceph-mon[125440]: pgmap v12454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:41 smithi136 ceph-mon[125702]: pgmap v12454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:43 smithi057 ceph-mon[92072]: pgmap v12455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:43 smithi122 ceph-mon[125440]: pgmap v12455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:43 smithi136 ceph-mon[125702]: pgmap v12455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:45 smithi057 ceph-mon[92072]: pgmap v12456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:45 smithi122 ceph-mon[125440]: pgmap v12456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:45 smithi136 ceph-mon[125702]: pgmap v12456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:47 smithi057 ceph-mon[92072]: pgmap v12457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:47 smithi122 ceph-mon[125440]: pgmap v12457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:47 smithi136 ceph-mon[125702]: pgmap v12457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:49 smithi057 ceph-mon[92072]: pgmap v12458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:49 smithi122 ceph-mon[125440]: pgmap v12458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:49 smithi136 ceph-mon[125702]: pgmap v12458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:51.913+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:26:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:51.913+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:26:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:51.913+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:26:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:51.913+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:26:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:51.913+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:26:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:51 smithi057 ceph-mon[92072]: pgmap v12459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:51 smithi122 ceph-mon[125440]: pgmap v12459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:51 smithi136 ceph-mon[125702]: pgmap v12459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:53 smithi057 ceph-mon[92072]: pgmap v12460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:53 smithi122 ceph-mon[125440]: pgmap v12460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:53 smithi136 ceph-mon[125702]: pgmap v12460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:55 smithi057 ceph-mon[92072]: pgmap v12461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:55 smithi122 ceph-mon[125440]: pgmap v12461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:55 smithi136 ceph-mon[125702]: pgmap v12461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:56.730+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:56.730+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:56.730+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 181 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:26:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:26:56.730+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 182 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:26:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:57 smithi057 ceph-mon[92072]: pgmap v12462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:57 smithi122 ceph-mon[125440]: pgmap v12462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:57 smithi136 ceph-mon[125702]: pgmap v12462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:26:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:26:59 smithi057 ceph-mon[92072]: pgmap v12463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:26:59 smithi122 ceph-mon[125440]: pgmap v12463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:26:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:26:59 smithi136 ceph-mon[125702]: pgmap v12463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:01 smithi057 ceph-mon[92072]: pgmap v12464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:01 smithi122 ceph-mon[125440]: pgmap v12464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:01 smithi136 ceph-mon[125702]: pgmap v12464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:03 smithi057 ceph-mon[92072]: pgmap v12465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:27:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:03 smithi122 ceph-mon[125440]: pgmap v12465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:27:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:03 smithi136 ceph-mon[125702]: pgmap v12465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:27:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:05 smithi057 ceph-mon[92072]: pgmap v12466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:27:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:05 smithi122 ceph-mon[125440]: pgmap v12466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:27:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:05 smithi136 ceph-mon[125702]: pgmap v12466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:27:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:06.914+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:27:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:06.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:27:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:06.915+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:27:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:06.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:27:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:06.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:27:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:07 smithi057 ceph-mon[92072]: osdmap e852: 12 total, 12 up, 12 in 2023-03-02T17:27:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:07 smithi057 ceph-mon[92072]: pgmap v12468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:27:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:07 smithi122 ceph-mon[125440]: osdmap e852: 12 total, 12 up, 12 in 2023-03-02T17:27:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:07 smithi122 ceph-mon[125440]: pgmap v12468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:27:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:07 smithi136 ceph-mon[125702]: osdmap e852: 12 total, 12 up, 12 in 2023-03-02T17:27:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:07 smithi136 ceph-mon[125702]: pgmap v12468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:27:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:09 smithi057 ceph-mon[92072]: pgmap v12469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:27:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:09 smithi122 ceph-mon[125440]: pgmap v12469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:27:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:09 smithi136 ceph-mon[125702]: pgmap v12469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:27:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:11 smithi057 ceph-mon[92072]: pgmap v12470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:27:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:11 smithi122 ceph-mon[125440]: pgmap v12470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:27:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:11 smithi136 ceph-mon[125702]: pgmap v12470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:27:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:13 smithi057 ceph-mon[92072]: pgmap v12471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:27:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:13 smithi122 ceph-mon[125440]: pgmap v12471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:27:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:13 smithi136 ceph-mon[125702]: pgmap v12471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:27:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:15 smithi057 ceph-mon[92072]: pgmap v12472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:27:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:15 smithi122 ceph-mon[125440]: pgmap v12472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:27:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:15 smithi136 ceph-mon[125702]: pgmap v12472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:27:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:16 smithi057 ceph-mon[92072]: osdmap e853: 12 total, 12 up, 12 in 2023-03-02T17:27:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:16 smithi122 ceph-mon[125440]: osdmap e853: 12 total, 12 up, 12 in 2023-03-02T17:27:17.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:16 smithi136 ceph-mon[125702]: osdmap e853: 12 total, 12 up, 12 in 2023-03-02T17:27:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:17 smithi057 ceph-mon[92072]: pgmap v12474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:27:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:17 smithi122 ceph-mon[125440]: pgmap v12474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:27:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:17 smithi136 ceph-mon[125702]: pgmap v12474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:27:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:19 smithi057 ceph-mon[92072]: pgmap v12475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:27:19.700 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:19 smithi122 ceph-mon[125440]: pgmap v12475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:27:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:19 smithi136 ceph-mon[125702]: pgmap v12475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:27:21.930 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:21.930+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:27:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:21.930+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:27:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:21.930+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:27:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:21.930+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:27:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:21.930+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:27:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:27:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:21 smithi057 ceph-mon[92072]: pgmap v12476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:27:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:27:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:21 smithi122 ceph-mon[125440]: pgmap v12476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:27:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:27:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:21 smithi136 ceph-mon[125702]: pgmap v12476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:27:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:27:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:27:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:27:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:27:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:27:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:27:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:27:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:27:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:27:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:23 smithi057 ceph-mon[92072]: pgmap v12477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:27:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:23 smithi122 ceph-mon[125440]: pgmap v12477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:27:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:23 smithi136 ceph-mon[125702]: pgmap v12477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:27:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:25 smithi057 ceph-mon[92072]: pgmap v12478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:27:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:25 smithi122 ceph-mon[125440]: pgmap v12478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:27:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:25 smithi136 ceph-mon[125702]: pgmap v12478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:27:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:27 smithi057 ceph-mon[92072]: pgmap v12479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:27:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:27 smithi122 ceph-mon[125440]: pgmap v12479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:27:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:27 smithi136 ceph-mon[125702]: pgmap v12479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:27:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:29 smithi122 ceph-mon[125440]: pgmap v12480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:29 smithi136 ceph-mon[125702]: pgmap v12480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:29 smithi057 ceph-mon[92072]: pgmap v12480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:31 smithi057 ceph-mon[92072]: pgmap v12481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:31 smithi122 ceph-mon[125440]: pgmap v12481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:31 smithi136 ceph-mon[125702]: pgmap v12481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:33 smithi122 ceph-mon[125440]: pgmap v12482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:33 smithi136 ceph-mon[125702]: pgmap v12482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:33 smithi057 ceph-mon[92072]: pgmap v12482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:35 smithi122 ceph-mon[125440]: pgmap v12483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:35 smithi136 ceph-mon[125702]: pgmap v12483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:35 smithi057 ceph-mon[92072]: pgmap v12483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:36.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:27:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:36.943+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:27:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:36.943+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:27:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:36.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:27:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:36.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:27:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:37 smithi122 ceph-mon[125440]: pgmap v12484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:37 smithi136 ceph-mon[125702]: pgmap v12484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:37 smithi057 ceph-mon[92072]: pgmap v12484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:39 smithi122 ceph-mon[125440]: pgmap v12485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:39 smithi136 ceph-mon[125702]: pgmap v12485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:39 smithi057 ceph-mon[92072]: pgmap v12485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:41.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:41 smithi057 ceph-mon[92072]: pgmap v12486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:41 smithi122 ceph-mon[125440]: pgmap v12486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:41 smithi136 ceph-mon[125702]: pgmap v12486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:43 smithi122 ceph-mon[125440]: pgmap v12487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:43 smithi136 ceph-mon[125702]: pgmap v12487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:43 smithi057 ceph-mon[92072]: pgmap v12487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:45 smithi122 ceph-mon[125440]: pgmap v12488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:45 smithi136 ceph-mon[125702]: pgmap v12488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:45 smithi057 ceph-mon[92072]: pgmap v12488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:47 smithi122 ceph-mon[125440]: pgmap v12489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:47 smithi136 ceph-mon[125702]: pgmap v12489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:47 smithi057 ceph-mon[92072]: pgmap v12489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:49 smithi122 ceph-mon[125440]: pgmap v12490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:49 smithi136 ceph-mon[125702]: pgmap v12490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:49 smithi057 ceph-mon[92072]: pgmap v12490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:51 smithi057 ceph-mon[92072]: pgmap v12491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:51 smithi122 ceph-mon[125440]: pgmap v12491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:51.960+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:27:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:51.960+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:27:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:51.960+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:27:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:51.960+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:27:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:27:51.960+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:27:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:51 smithi136 ceph-mon[125702]: pgmap v12491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:53 smithi122 ceph-mon[125440]: pgmap v12492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:53 smithi136 ceph-mon[125702]: pgmap v12492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:53 smithi057 ceph-mon[92072]: pgmap v12492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:55 smithi122 ceph-mon[125440]: pgmap v12493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:55 smithi136 ceph-mon[125702]: pgmap v12493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:55 smithi057 ceph-mon[92072]: pgmap v12493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:57 smithi122 ceph-mon[125440]: pgmap v12494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:57 smithi136 ceph-mon[125702]: pgmap v12494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:57 smithi057 ceph-mon[92072]: pgmap v12494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:27:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:27:59 smithi122 ceph-mon[125440]: pgmap v12495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:27:59 smithi136 ceph-mon[125702]: pgmap v12495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:27:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:27:59 smithi057 ceph-mon[92072]: pgmap v12495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:02 smithi057 ceph-mon[92072]: pgmap v12496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:02 smithi122 ceph-mon[125440]: pgmap v12496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:02 smithi136 ceph-mon[125702]: pgmap v12496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:04 smithi057 ceph-mon[92072]: pgmap v12497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:28:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:04 smithi122 ceph-mon[125440]: pgmap v12497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:28:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:04 smithi136 ceph-mon[125702]: pgmap v12497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:28:06.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:06 smithi057 ceph-mon[92072]: pgmap v12498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:28:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:06 smithi122 ceph-mon[125440]: pgmap v12498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:28:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:06.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:28:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:06.976+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:28:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:06.976+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:28:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:06.976+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:28:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:06.976+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:28:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:06 smithi136 ceph-mon[125702]: pgmap v12498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:28:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:08 smithi057 ceph-mon[92072]: pgmap v12499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:28:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:08 smithi122 ceph-mon[125440]: pgmap v12499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:28:09.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:08 smithi136 ceph-mon[125702]: pgmap v12499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:28:10.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:10 smithi057 ceph-mon[92072]: pgmap v12500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:28:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:10 smithi122 ceph-mon[125440]: pgmap v12500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:28:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:10 smithi136 ceph-mon[125702]: pgmap v12500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:28:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:12 smithi057 ceph-mon[92072]: pgmap v12501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:28:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:12 smithi057 ceph-mon[92072]: osdmap e854: 12 total, 12 up, 12 in 2023-03-02T17:28:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:12 smithi122 ceph-mon[125440]: pgmap v12501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:28:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:12 smithi122 ceph-mon[125440]: osdmap e854: 12 total, 12 up, 12 in 2023-03-02T17:28:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:12 smithi136 ceph-mon[125702]: pgmap v12501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:28:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:12 smithi136 ceph-mon[125702]: osdmap e854: 12 total, 12 up, 12 in 2023-03-02T17:28:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:14 smithi122 ceph-mon[125440]: pgmap v12503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:14 smithi136 ceph-mon[125702]: pgmap v12503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:14 smithi057 ceph-mon[92072]: pgmap v12503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:16 smithi122 ceph-mon[125440]: pgmap v12504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:16 smithi136 ceph-mon[125702]: pgmap v12504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:16 smithi057 ceph-mon[92072]: pgmap v12504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:18 smithi122 ceph-mon[125440]: pgmap v12505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:28:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:18 smithi136 ceph-mon[125702]: pgmap v12505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:28:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:18 smithi057 ceph-mon[92072]: pgmap v12505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:28:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:20 smithi122 ceph-mon[125440]: pgmap v12506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:28:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:20 smithi122 ceph-mon[125440]: osdmap e855: 12 total, 12 up, 12 in 2023-03-02T17:28:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:20 smithi136 ceph-mon[125702]: pgmap v12506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:28:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:20 smithi136 ceph-mon[125702]: osdmap e855: 12 total, 12 up, 12 in 2023-03-02T17:28:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:20 smithi057 ceph-mon[92072]: pgmap v12506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:28:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:20 smithi057 ceph-mon[92072]: osdmap e855: 12 total, 12 up, 12 in 2023-03-02T17:28:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:21.984+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:28:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:21.985+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:28:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:21.985+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:28:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:21.985+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:28:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:21.985+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:28:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:22 smithi136 ceph-mon[125702]: pgmap v12508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 210 B/s wr, 5 op/s 2023-03-02T17:28:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:28:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:22 smithi057 ceph-mon[92072]: pgmap v12508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 210 B/s wr, 5 op/s 2023-03-02T17:28:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:28:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:22 smithi122 ceph-mon[125440]: pgmap v12508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 210 B/s wr, 5 op/s 2023-03-02T17:28:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:28:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:24 smithi136 ceph-mon[125702]: pgmap v12509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:24 smithi057 ceph-mon[92072]: pgmap v12509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:24 smithi122 ceph-mon[125440]: pgmap v12509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:28:26.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:28:26.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:28:26.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:28:26.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:28:26.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:28:26.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:28:26.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:28:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:27 smithi057 ceph-mon[92072]: pgmap v12510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:27 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:28:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:27 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:28:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:27 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:28:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:27 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:28:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:27 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 23108k 2023-03-02T17:28:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:27 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 23663153: error parsing value: Value '23663153' is below minimum 939524096 2023-03-02T17:28:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:27 smithi122 ceph-mon[125440]: pgmap v12510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:27 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:28:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:27 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:28:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:27 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:28:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:27 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:28:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:27 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 23108k 2023-03-02T17:28:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:27 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 23663153: error parsing value: Value '23663153' is below minimum 939524096 2023-03-02T17:28:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:27 smithi136 ceph-mon[125702]: pgmap v12510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:28:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:27 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:28:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:27 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:28:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:27 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:28:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:27 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:28:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:27 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 23108k 2023-03-02T17:28:27.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:27 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 23663153: error parsing value: Value '23663153' is below minimum 939524096 2023-03-02T17:28:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:28 smithi122 ceph-mon[125440]: pgmap v12511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:28:28.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:28 smithi136 ceph-mon[125702]: pgmap v12511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:28:28.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:28 smithi057 ceph-mon[92072]: pgmap v12511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:28:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:30 smithi122 ceph-mon[125440]: pgmap v12512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:28:30.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:30 smithi136 ceph-mon[125702]: pgmap v12512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:28:30.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:30 smithi057 ceph-mon[92072]: pgmap v12512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:28:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:32 smithi057 ceph-mon[92072]: pgmap v12513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:28:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:32 smithi122 ceph-mon[125440]: pgmap v12513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:28:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:32 smithi136 ceph-mon[125702]: pgmap v12513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T17:28:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:34 smithi057 ceph-mon[92072]: pgmap v12514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:34 smithi122 ceph-mon[125440]: pgmap v12514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:34 smithi136 ceph-mon[125702]: pgmap v12514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:36 smithi057 ceph-mon[92072]: pgmap v12515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:36 smithi122 ceph-mon[125440]: pgmap v12515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:37.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:28:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:37.001+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:28:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:37.001+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:28:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:37.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:28:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:37.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:28:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:36 smithi136 ceph-mon[125702]: pgmap v12515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:38 smithi057 ceph-mon[92072]: pgmap v12516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:38 smithi122 ceph-mon[125440]: pgmap v12516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:38 smithi136 ceph-mon[125702]: pgmap v12516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:40 smithi057 ceph-mon[92072]: pgmap v12517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:40 smithi122 ceph-mon[125440]: pgmap v12517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:41.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:40 smithi136 ceph-mon[125702]: pgmap v12517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:42.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:42 smithi057 ceph-mon[92072]: pgmap v12518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:42 smithi122 ceph-mon[125440]: pgmap v12518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:42 smithi136 ceph-mon[125702]: pgmap v12518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:44 smithi122 ceph-mon[125440]: pgmap v12519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:44 smithi136 ceph-mon[125702]: pgmap v12519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:44 smithi057 ceph-mon[92072]: pgmap v12519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:46 smithi122 ceph-mon[125440]: pgmap v12520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:46 smithi136 ceph-mon[125702]: pgmap v12520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:46 smithi057 ceph-mon[92072]: pgmap v12520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:48 smithi122 ceph-mon[125440]: pgmap v12521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:48 smithi136 ceph-mon[125702]: pgmap v12521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:48 smithi057 ceph-mon[92072]: pgmap v12521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:50 smithi122 ceph-mon[125440]: pgmap v12522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:50 smithi136 ceph-mon[125702]: pgmap v12522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:50 smithi057 ceph-mon[92072]: pgmap v12522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:52.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:28:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:52.015+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:28:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:52.015+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:28:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:52.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:28:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:28:52.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:28:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:52 smithi122 ceph-mon[125440]: pgmap v12523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:53.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:52 smithi136 ceph-mon[125702]: pgmap v12523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:52 smithi057 ceph-mon[92072]: pgmap v12523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:54 smithi136 ceph-mon[125702]: pgmap v12524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:54 smithi057 ceph-mon[92072]: pgmap v12524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:54 smithi122 ceph-mon[125440]: pgmap v12524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:56 smithi136 ceph-mon[125702]: pgmap v12525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:56 smithi057 ceph-mon[92072]: pgmap v12525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:56 smithi122 ceph-mon[125440]: pgmap v12525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:28:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:28:58 smithi136 ceph-mon[125702]: pgmap v12526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:28:58 smithi057 ceph-mon[92072]: pgmap v12526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:28:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:28:58 smithi122 ceph-mon[125440]: pgmap v12526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:01.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:00 smithi136 ceph-mon[125702]: pgmap v12527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:00 smithi057 ceph-mon[92072]: pgmap v12527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:00 smithi122 ceph-mon[125440]: pgmap v12527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:02 smithi136 ceph-mon[125702]: pgmap v12528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:02 smithi057 ceph-mon[92072]: pgmap v12528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:02 smithi122 ceph-mon[125440]: pgmap v12528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:04 smithi136 ceph-mon[125702]: pgmap v12529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:29:05.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:04 smithi057 ceph-mon[92072]: pgmap v12529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:29:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:04 smithi122 ceph-mon[125440]: pgmap v12529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:29:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:07.020+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:29:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:07.021+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:29:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:07.021+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:29:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:07.021+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:29:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:07.021+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:29:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:06 smithi136 ceph-mon[125702]: pgmap v12530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:29:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:06 smithi057 ceph-mon[92072]: pgmap v12530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:29:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:06 smithi122 ceph-mon[125440]: pgmap v12530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:29:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:07 smithi136 ceph-mon[125702]: osdmap e856: 12 total, 12 up, 12 in 2023-03-02T17:29:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:07 smithi057 ceph-mon[92072]: osdmap e856: 12 total, 12 up, 12 in 2023-03-02T17:29:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:07 smithi122 ceph-mon[125440]: osdmap e856: 12 total, 12 up, 12 in 2023-03-02T17:29:08.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:08.417+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T17:29:08.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:08.417+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T17:29:08.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:08.417+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5850006720 tx=0x7f5870057000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:29:08.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:08.417+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5850006720 tx=0x7f5870057000 comp rx=0 tx=0).stop 2023-03-02T17:29:08.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:08.417+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T17:29:08.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:08.417+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T17:29:08.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:08.417+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T17:29:08.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:08.417+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T17:29:08.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:08.417+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:29:08.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:08.418+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f58500047b0 tx=0x7f5870063000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T17:29:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:08 smithi136 ceph-mon[125702]: pgmap v12532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:29:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:08 smithi057 ceph-mon[92072]: pgmap v12532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:29:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:08 smithi122 ceph-mon[125440]: pgmap v12532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:29:11.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:10 smithi136 ceph-mon[125702]: pgmap v12533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:29:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:10 smithi057 ceph-mon[92072]: pgmap v12533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:29:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:10 smithi122 ceph-mon[125440]: pgmap v12533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:29:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:11.750+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:29:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:11.750+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:29:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:11.750+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 182 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:29:11.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:11.750+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 183 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:29:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:12 smithi136 ceph-mon[125702]: pgmap v12534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:29:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:12 smithi057 ceph-mon[92072]: pgmap v12534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:29:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:12 smithi122 ceph-mon[125440]: pgmap v12534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:29:15.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:14 smithi136 ceph-mon[125702]: pgmap v12535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:29:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:14 smithi057 ceph-mon[92072]: pgmap v12535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:29:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:14 smithi122 ceph-mon[125440]: pgmap v12535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:29:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:16 smithi057 ceph-mon[92072]: pgmap v12536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:29:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:16 smithi057 ceph-mon[92072]: osdmap e857: 12 total, 12 up, 12 in 2023-03-02T17:29:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:16 smithi122 ceph-mon[125440]: pgmap v12536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:29:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:16 smithi122 ceph-mon[125440]: osdmap e857: 12 total, 12 up, 12 in 2023-03-02T17:29:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:16 smithi136 ceph-mon[125702]: pgmap v12536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:29:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:16 smithi136 ceph-mon[125702]: osdmap e857: 12 total, 12 up, 12 in 2023-03-02T17:29:18.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:18 smithi057 ceph-mon[92072]: pgmap v12538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:29:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:18 smithi122 ceph-mon[125440]: pgmap v12538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:29:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:18 smithi136 ceph-mon[125702]: pgmap v12538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:29:20.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:20 smithi057 ceph-mon[92072]: pgmap v12539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:29:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:20 smithi122 ceph-mon[125440]: pgmap v12539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:29:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:20 smithi136 ceph-mon[125702]: pgmap v12539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:22.031+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:22.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:22.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:22.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:22.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:29:22.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:22 smithi057 ceph-mon[92072]: pgmap v12540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:29:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:22 smithi122 ceph-mon[125440]: pgmap v12540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:29:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:22 smithi136 ceph-mon[125702]: pgmap v12540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:29:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:24 smithi122 ceph-mon[125440]: pgmap v12541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:29:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:24 smithi136 ceph-mon[125702]: pgmap v12541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:29:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:24 smithi057 ceph-mon[92072]: pgmap v12541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:29:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:26 smithi122 ceph-mon[125440]: pgmap v12542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:29:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:29:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:26 smithi136 ceph-mon[125702]: pgmap v12542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:29:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:29:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:26 smithi057 ceph-mon[92072]: pgmap v12542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:29:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:29:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:29:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:29:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:29:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:29:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:29:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:29:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:29:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:29:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:29:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:29 smithi136 ceph-mon[125702]: pgmap v12543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:29:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:29 smithi057 ceph-mon[92072]: pgmap v12543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:29:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:29 smithi122 ceph-mon[125440]: pgmap v12543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:29:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:31 smithi136 ceph-mon[125702]: pgmap v12544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:31 smithi057 ceph-mon[92072]: pgmap v12544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:31 smithi122 ceph-mon[125440]: pgmap v12544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:33 smithi136 ceph-mon[125702]: pgmap v12545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:33 smithi057 ceph-mon[92072]: pgmap v12545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:33 smithi122 ceph-mon[125440]: pgmap v12545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:35 smithi136 ceph-mon[125702]: pgmap v12546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:35 smithi057 ceph-mon[92072]: pgmap v12546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:35 smithi122 ceph-mon[125440]: pgmap v12546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:37.048+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:29:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:37.048+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:29:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:37.048+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:29:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:37.048+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:29:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:37.048+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:29:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:37 smithi136 ceph-mon[125702]: pgmap v12547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:37 smithi057 ceph-mon[92072]: pgmap v12547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:37 smithi122 ceph-mon[125440]: pgmap v12547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:39 smithi136 ceph-mon[125702]: pgmap v12548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:39 smithi057 ceph-mon[92072]: pgmap v12548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:39 smithi122 ceph-mon[125440]: pgmap v12548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:41.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:41 smithi136 ceph-mon[125702]: pgmap v12549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:41 smithi057 ceph-mon[92072]: pgmap v12549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:41 smithi122 ceph-mon[125440]: pgmap v12549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:43 smithi136 ceph-mon[125702]: pgmap v12550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:43 smithi057 ceph-mon[92072]: pgmap v12550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:43 smithi122 ceph-mon[125440]: pgmap v12550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:45 smithi136 ceph-mon[125702]: pgmap v12551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:45 smithi057 ceph-mon[92072]: pgmap v12551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:45 smithi122 ceph-mon[125440]: pgmap v12551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:47 smithi136 ceph-mon[125702]: pgmap v12552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:47 smithi057 ceph-mon[92072]: pgmap v12552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:47 smithi122 ceph-mon[125440]: pgmap v12552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:49 smithi136 ceph-mon[125702]: pgmap v12553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:49 smithi057 ceph-mon[92072]: pgmap v12553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:49 smithi122 ceph-mon[125440]: pgmap v12553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:51.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:51 smithi136 ceph-mon[125702]: pgmap v12554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:51 smithi057 ceph-mon[92072]: pgmap v12554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:51 smithi122 ceph-mon[125440]: pgmap v12554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:52.062+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:29:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:52.062+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:29:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:52.062+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:29:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:52.062+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:29:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:29:52.062+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:29:53.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:53 smithi136 ceph-mon[125702]: pgmap v12555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:53 smithi057 ceph-mon[92072]: pgmap v12555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:53 smithi122 ceph-mon[125440]: pgmap v12555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:55 smithi136 ceph-mon[125702]: pgmap v12556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:55 smithi057 ceph-mon[92072]: pgmap v12556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:55 smithi122 ceph-mon[125440]: pgmap v12556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:57 smithi136 ceph-mon[125702]: pgmap v12557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:57 smithi057 ceph-mon[92072]: pgmap v12557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:57 smithi122 ceph-mon[125440]: pgmap v12557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:29:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:29:59 smithi136 ceph-mon[125702]: pgmap v12558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:29:59 smithi057 ceph-mon[92072]: pgmap v12558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:29:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:29:59 smithi122 ceph-mon[125440]: pgmap v12558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T17:30:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T17:30:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T17:30:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:01 smithi057 ceph-mon[92072]: pgmap v12559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:01 smithi122 ceph-mon[125440]: pgmap v12559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:01 smithi136 ceph-mon[125702]: pgmap v12559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:03 smithi057 ceph-mon[92072]: pgmap v12560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:03 smithi122 ceph-mon[125440]: pgmap v12560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:03 smithi136 ceph-mon[125702]: pgmap v12560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:05 smithi057 ceph-mon[92072]: pgmap v12561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:30:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:05 smithi122 ceph-mon[125440]: pgmap v12561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:30:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:05 smithi136 ceph-mon[125702]: pgmap v12561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:30:07.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:07.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:30:07.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:07.071+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:30:07.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:07.071+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:30:07.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:07.071+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:30:07.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:07.071+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:30:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:07 smithi057 ceph-mon[92072]: pgmap v12562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:30:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:07 smithi057 ceph-mon[92072]: osdmap e858: 12 total, 12 up, 12 in 2023-03-02T17:30:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:07 smithi122 ceph-mon[125440]: pgmap v12562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:30:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:07 smithi122 ceph-mon[125440]: osdmap e858: 12 total, 12 up, 12 in 2023-03-02T17:30:07.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:07 smithi136 ceph-mon[125702]: pgmap v12562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:30:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:07 smithi136 ceph-mon[125702]: osdmap e858: 12 total, 12 up, 12 in 2023-03-02T17:30:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:09 smithi057 ceph-mon[92072]: pgmap v12564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:30:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:09 smithi122 ceph-mon[125440]: pgmap v12564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:30:09.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:09 smithi136 ceph-mon[125702]: pgmap v12564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:30:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:11 smithi057 ceph-mon[92072]: pgmap v12565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:30:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:11 smithi122 ceph-mon[125440]: pgmap v12565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:30:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:11 smithi136 ceph-mon[125702]: pgmap v12565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:30:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:13 smithi057 ceph-mon[92072]: pgmap v12566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:30:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:13 smithi122 ceph-mon[125440]: pgmap v12566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:30:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:13 smithi136 ceph-mon[125702]: pgmap v12566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:30:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:15 smithi057 ceph-mon[92072]: pgmap v12567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:30:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:15 smithi122 ceph-mon[125440]: pgmap v12567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:30:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:15 smithi136 ceph-mon[125702]: pgmap v12567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:30:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:16 smithi122 ceph-mon[125440]: pgmap v12568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:30:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:16 smithi122 ceph-mon[125440]: osdmap e859: 12 total, 12 up, 12 in 2023-03-02T17:30:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:16 smithi136 ceph-mon[125702]: pgmap v12568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:30:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:16 smithi136 ceph-mon[125702]: osdmap e859: 12 total, 12 up, 12 in 2023-03-02T17:30:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:16 smithi057 ceph-mon[92072]: pgmap v12568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:30:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:16 smithi057 ceph-mon[92072]: osdmap e859: 12 total, 12 up, 12 in 2023-03-02T17:30:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:18 smithi122 ceph-mon[125440]: pgmap v12570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:30:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:18 smithi136 ceph-mon[125702]: pgmap v12570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:30:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:18 smithi057 ceph-mon[92072]: pgmap v12570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:30:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:20 smithi122 ceph-mon[125440]: pgmap v12571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:30:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:20 smithi136 ceph-mon[125702]: pgmap v12571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:30:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:20 smithi057 ceph-mon[92072]: pgmap v12571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:30:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:22.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:30:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:22.085+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:30:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:22.085+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:30:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:22.085+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:30:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:22.085+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:30:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:22 smithi136 ceph-mon[125702]: pgmap v12572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:30:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:22 smithi057 ceph-mon[92072]: pgmap v12572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:30:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:22 smithi122 ceph-mon[125440]: pgmap v12572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:30:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:24 smithi136 ceph-mon[125702]: pgmap v12573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:30:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:24 smithi057 ceph-mon[92072]: pgmap v12573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:30:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:24 smithi122 ceph-mon[125440]: pgmap v12573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:30:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:26 smithi136 ceph-mon[125702]: pgmap v12574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:30:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:26 smithi057 ceph-mon[92072]: pgmap v12574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:30:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:26 smithi122 ceph-mon[125440]: pgmap v12574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:30:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:30:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:30:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:30:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:30:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:30:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:30:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:30:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:30:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:30:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:28 smithi136 ceph-mon[125702]: pgmap v12575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:30:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:30:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:30:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:30:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:28 smithi057 ceph-mon[92072]: pgmap v12575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:30:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:30:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:30:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:30:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:28 smithi122 ceph-mon[125440]: pgmap v12575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:30:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:30:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:30:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:30:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:30 smithi136 ceph-mon[125702]: pgmap v12576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:30 smithi057 ceph-mon[92072]: pgmap v12576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:30 smithi122 ceph-mon[125440]: pgmap v12576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:32 smithi136 ceph-mon[125702]: pgmap v12577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:32 smithi057 ceph-mon[92072]: pgmap v12577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:32 smithi122 ceph-mon[125440]: pgmap v12577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:35.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:34 smithi136 ceph-mon[125702]: pgmap v12578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:34 smithi057 ceph-mon[92072]: pgmap v12578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:34 smithi122 ceph-mon[125440]: pgmap v12578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:37.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:36 smithi136 ceph-mon[125702]: pgmap v12579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:37.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:30:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:37.094+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:30:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:37.094+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:30:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:37.094+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:30:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:37.094+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:30:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:36 smithi057 ceph-mon[92072]: pgmap v12579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:36 smithi122 ceph-mon[125440]: pgmap v12579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:39.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:38 smithi136 ceph-mon[125702]: pgmap v12580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:38 smithi057 ceph-mon[92072]: pgmap v12580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:38 smithi122 ceph-mon[125440]: pgmap v12580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:40 smithi136 ceph-mon[125702]: pgmap v12581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:40 smithi057 ceph-mon[92072]: pgmap v12581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:40 smithi122 ceph-mon[125440]: pgmap v12581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:42 smithi136 ceph-mon[125702]: pgmap v12582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:42 smithi057 ceph-mon[92072]: pgmap v12582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:42 smithi122 ceph-mon[125440]: pgmap v12582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:44 smithi136 ceph-mon[125702]: pgmap v12583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:44 smithi057 ceph-mon[92072]: pgmap v12583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:44 smithi122 ceph-mon[125440]: pgmap v12583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:46 smithi136 ceph-mon[125702]: pgmap v12584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:46 smithi057 ceph-mon[92072]: pgmap v12584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:46 smithi122 ceph-mon[125440]: pgmap v12584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:48 smithi136 ceph-mon[125702]: pgmap v12585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:48 smithi057 ceph-mon[92072]: pgmap v12585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:48 smithi122 ceph-mon[125440]: pgmap v12585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:50 smithi136 ceph-mon[125702]: pgmap v12586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:50 smithi057 ceph-mon[92072]: pgmap v12586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:50 smithi122 ceph-mon[125440]: pgmap v12586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:52.103+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:30:52.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:52.104+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:30:52.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:52.104+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:30:52.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:52.104+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:30:52.107 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:30:52.104+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:30:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:52 smithi136 ceph-mon[125702]: pgmap v12587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:52 smithi057 ceph-mon[92072]: pgmap v12587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:52 smithi122 ceph-mon[125440]: pgmap v12587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:54 smithi136 ceph-mon[125702]: pgmap v12588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:54 smithi057 ceph-mon[92072]: pgmap v12588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:54 smithi122 ceph-mon[125440]: pgmap v12588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:56 smithi136 ceph-mon[125702]: pgmap v12589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:56 smithi057 ceph-mon[92072]: pgmap v12589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:56 smithi122 ceph-mon[125440]: pgmap v12589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:30:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:30:58 smithi136 ceph-mon[125702]: pgmap v12590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:30:58 smithi057 ceph-mon[92072]: pgmap v12590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:30:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:30:58 smithi122 ceph-mon[125440]: pgmap v12590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:01.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:00 smithi136 ceph-mon[125702]: pgmap v12591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:00 smithi057 ceph-mon[92072]: pgmap v12591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:00 smithi122 ceph-mon[125440]: pgmap v12591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:02 smithi136 ceph-mon[125702]: pgmap v12592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:02 smithi057 ceph-mon[92072]: pgmap v12592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:02 smithi122 ceph-mon[125440]: pgmap v12592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:04 smithi136 ceph-mon[125702]: pgmap v12593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:31:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:04 smithi057 ceph-mon[92072]: pgmap v12593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:31:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:04 smithi122 ceph-mon[125440]: pgmap v12593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:31:07.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:06 smithi136 ceph-mon[125702]: pgmap v12594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:31:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:07.116+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:31:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:07.116+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:31:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:07.116+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:31:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:07.116+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:31:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:07.116+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:31:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:06 smithi057 ceph-mon[92072]: pgmap v12594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:31:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:06 smithi122 ceph-mon[125440]: pgmap v12594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:31:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:07 smithi136 ceph-mon[125702]: osdmap e860: 12 total, 12 up, 12 in 2023-03-02T17:31:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:07 smithi057 ceph-mon[92072]: osdmap e860: 12 total, 12 up, 12 in 2023-03-02T17:31:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:07 smithi122 ceph-mon[125440]: osdmap e860: 12 total, 12 up, 12 in 2023-03-02T17:31:09.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:08 smithi136 ceph-mon[125702]: pgmap v12596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:31:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:08 smithi057 ceph-mon[92072]: pgmap v12596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:31:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:08 smithi122 ceph-mon[125440]: pgmap v12596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:31:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:10 smithi136 ceph-mon[125702]: pgmap v12597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:31:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:10 smithi057 ceph-mon[92072]: pgmap v12597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:31:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:10 smithi122 ceph-mon[125440]: pgmap v12597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:31:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:12 smithi136 ceph-mon[125702]: pgmap v12598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:31:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:12 smithi057 ceph-mon[92072]: pgmap v12598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:31:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:12 smithi122 ceph-mon[125440]: pgmap v12598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:31:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:14 smithi057 ceph-mon[92072]: pgmap v12599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:31:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:14 smithi122 ceph-mon[125440]: pgmap v12599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:31:15.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:14 smithi136 ceph-mon[125702]: pgmap v12599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:31:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:16 smithi136 ceph-mon[125702]: pgmap v12600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:31:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:16 smithi136 ceph-mon[125702]: osdmap e861: 12 total, 12 up, 12 in 2023-03-02T17:31:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:16 smithi057 ceph-mon[92072]: pgmap v12600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:31:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:16 smithi057 ceph-mon[92072]: osdmap e861: 12 total, 12 up, 12 in 2023-03-02T17:31:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:16 smithi122 ceph-mon[125440]: pgmap v12600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:31:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:16 smithi122 ceph-mon[125440]: osdmap e861: 12 total, 12 up, 12 in 2023-03-02T17:31:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:18 smithi136 ceph-mon[125702]: pgmap v12602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:31:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:18 smithi057 ceph-mon[92072]: pgmap v12602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:31:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:18 smithi122 ceph-mon[125440]: pgmap v12602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:31:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:20 smithi136 ceph-mon[125702]: pgmap v12603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:31:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:20 smithi057 ceph-mon[92072]: pgmap v12603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:31:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:20 smithi122 ceph-mon[125440]: pgmap v12603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:31:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:22.125+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:31:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:22.126+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:31:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:22.126+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:31:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:22.126+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:31:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:22.126+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:31:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:22 smithi136 ceph-mon[125702]: pgmap v12604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:31:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:22 smithi057 ceph-mon[92072]: pgmap v12604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:31:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:22 smithi122 ceph-mon[125440]: pgmap v12604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:31:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:24 smithi136 ceph-mon[125702]: pgmap v12605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:31:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:24 smithi057 ceph-mon[92072]: pgmap v12605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:31:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:24 smithi122 ceph-mon[125440]: pgmap v12605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:31:27.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:26 smithi136 ceph-mon[125702]: pgmap v12606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:31:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:26 smithi057 ceph-mon[92072]: pgmap v12606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:31:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:26 smithi122 ceph-mon[125440]: pgmap v12606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:31:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:28 smithi136 ceph-mon[125702]: pgmap v12607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:31:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:31:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:28 smithi057 ceph-mon[92072]: pgmap v12607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:31:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:31:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:28 smithi122 ceph-mon[125440]: pgmap v12607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:31:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:31:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:31:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:31:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:31:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:31:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:31:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:31:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:31:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:31 smithi057 ceph-mon[92072]: pgmap v12608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:31 smithi122 ceph-mon[125440]: pgmap v12608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:31 smithi136 ceph-mon[125702]: pgmap v12608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:33 smithi057 ceph-mon[92072]: pgmap v12609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:33 smithi122 ceph-mon[125440]: pgmap v12609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:33 smithi136 ceph-mon[125702]: pgmap v12609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:35 smithi057 ceph-mon[92072]: pgmap v12610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:35 smithi122 ceph-mon[125440]: pgmap v12610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:35 smithi136 ceph-mon[125702]: pgmap v12610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:37.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:31:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:37.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:31:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:37.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:31:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:37.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:31:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:37.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:31:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:37 smithi057 ceph-mon[92072]: pgmap v12611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:37 smithi122 ceph-mon[125440]: pgmap v12611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:37 smithi136 ceph-mon[125702]: pgmap v12611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:39 smithi057 ceph-mon[92072]: pgmap v12612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:39 smithi122 ceph-mon[125440]: pgmap v12612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:39.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:39 smithi136 ceph-mon[125702]: pgmap v12612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:41 smithi057 ceph-mon[92072]: pgmap v12613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:41 smithi122 ceph-mon[125440]: pgmap v12613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:41 smithi136 ceph-mon[125702]: pgmap v12613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:43 smithi057 ceph-mon[92072]: pgmap v12614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:43 smithi122 ceph-mon[125440]: pgmap v12614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:43.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:43 smithi136 ceph-mon[125702]: pgmap v12614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:45 smithi057 ceph-mon[92072]: pgmap v12615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:45 smithi122 ceph-mon[125440]: pgmap v12615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:45.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:45 smithi136 ceph-mon[125702]: pgmap v12615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:47 smithi057 ceph-mon[92072]: pgmap v12616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:47 smithi122 ceph-mon[125440]: pgmap v12616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:47.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:47 smithi136 ceph-mon[125702]: pgmap v12616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:49 smithi122 ceph-mon[125440]: pgmap v12617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:49.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:49 smithi136 ceph-mon[125702]: pgmap v12617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:49 smithi057 ceph-mon[92072]: pgmap v12617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:51 smithi122 ceph-mon[125440]: pgmap v12618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:51.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:51 smithi136 ceph-mon[125702]: pgmap v12618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:51 smithi057 ceph-mon[92072]: pgmap v12618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:52.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:52.144+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:31:52.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:52.144+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:31:52.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:52.144+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:31:52.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:52.144+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:31:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:31:52.144+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:31:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:53 smithi122 ceph-mon[125440]: pgmap v12619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:53.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:53 smithi136 ceph-mon[125702]: pgmap v12619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:53 smithi057 ceph-mon[92072]: pgmap v12619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:55.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:55 smithi136 ceph-mon[125702]: pgmap v12620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:55 smithi057 ceph-mon[92072]: pgmap v12620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:55 smithi122 ceph-mon[125440]: pgmap v12620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:57 smithi136 ceph-mon[125702]: pgmap v12621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:57 smithi057 ceph-mon[92072]: pgmap v12621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:57 smithi122 ceph-mon[125440]: pgmap v12621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:31:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:31:59 smithi136 ceph-mon[125702]: pgmap v12622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:31:59 smithi057 ceph-mon[92072]: pgmap v12622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:31:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:31:59 smithi122 ceph-mon[125440]: pgmap v12622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:01.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:01 smithi136 ceph-mon[125702]: pgmap v12623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:01 smithi057 ceph-mon[92072]: pgmap v12623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:01 smithi122 ceph-mon[125440]: pgmap v12623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:03 smithi136 ceph-mon[125702]: pgmap v12624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:03 smithi057 ceph-mon[92072]: pgmap v12624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:03 smithi122 ceph-mon[125440]: pgmap v12624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:05 smithi136 ceph-mon[125702]: pgmap v12625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:32:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:05 smithi057 ceph-mon[92072]: pgmap v12625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:32:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:05 smithi122 ceph-mon[125440]: pgmap v12625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:32:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:07.158+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:32:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:07.158+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:32:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:07.158+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:32:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:07.158+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:32:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:07.158+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:32:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:07 smithi136 ceph-mon[125702]: pgmap v12626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:32:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:07 smithi136 ceph-mon[125702]: osdmap e862: 12 total, 12 up, 12 in 2023-03-02T17:32:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:07 smithi057 ceph-mon[92072]: pgmap v12626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:32:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:07 smithi057 ceph-mon[92072]: osdmap e862: 12 total, 12 up, 12 in 2023-03-02T17:32:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:07 smithi122 ceph-mon[125440]: pgmap v12626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:32:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:07 smithi122 ceph-mon[125440]: osdmap e862: 12 total, 12 up, 12 in 2023-03-02T17:32:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:09 smithi136 ceph-mon[125702]: pgmap v12628: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:32:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:09 smithi057 ceph-mon[92072]: pgmap v12628: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:32:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:09 smithi122 ceph-mon[125440]: pgmap v12628: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:32:11.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:11 smithi136 ceph-mon[125702]: pgmap v12629: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:32:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:11 smithi057 ceph-mon[92072]: pgmap v12629: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:32:11.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:11 smithi122 ceph-mon[125440]: pgmap v12629: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:32:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:11.775+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:32:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:11.775+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:32:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:11.775+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 183 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:32:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:11.775+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 184 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:32:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:13 smithi136 ceph-mon[125702]: pgmap v12630: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:32:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:13 smithi057 ceph-mon[92072]: pgmap v12630: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:32:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:13 smithi122 ceph-mon[125440]: pgmap v12630: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:32:15.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:15 smithi136 ceph-mon[125702]: pgmap v12631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:32:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:15 smithi057 ceph-mon[92072]: pgmap v12631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:32:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:15 smithi122 ceph-mon[125440]: pgmap v12631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:32:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:16 smithi136 ceph-mon[125702]: pgmap v12632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:32:17.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:16 smithi136 ceph-mon[125702]: osdmap e863: 12 total, 12 up, 12 in 2023-03-02T17:32:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:16 smithi057 ceph-mon[92072]: pgmap v12632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:32:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:16 smithi057 ceph-mon[92072]: osdmap e863: 12 total, 12 up, 12 in 2023-03-02T17:32:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:16 smithi122 ceph-mon[125440]: pgmap v12632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:32:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:16 smithi122 ceph-mon[125440]: osdmap e863: 12 total, 12 up, 12 in 2023-03-02T17:32:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:18 smithi136 ceph-mon[125702]: pgmap v12634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:32:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:18 smithi057 ceph-mon[92072]: pgmap v12634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:32:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:18 smithi122 ceph-mon[125440]: pgmap v12634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:32:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:20 smithi136 ceph-mon[125702]: pgmap v12635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:32:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:20 smithi057 ceph-mon[92072]: pgmap v12635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:32:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:20 smithi122 ceph-mon[125440]: pgmap v12635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:32:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:22.172+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:32:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:22.173+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:32:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:22.173+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:32:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:22.173+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:32:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:22.173+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:32:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:22 smithi136 ceph-mon[125702]: pgmap v12636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:32:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:22 smithi057 ceph-mon[92072]: pgmap v12636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:32:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:22 smithi122 ceph-mon[125440]: pgmap v12636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:32:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:24 smithi136 ceph-mon[125702]: pgmap v12637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:32:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:24 smithi057 ceph-mon[92072]: pgmap v12637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:32:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:24 smithi122 ceph-mon[125440]: pgmap v12637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:32:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:26 smithi136 ceph-mon[125702]: pgmap v12638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:32:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:26 smithi057 ceph-mon[92072]: pgmap v12638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:32:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:26 smithi122 ceph-mon[125440]: pgmap v12638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:32:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:28 smithi136 ceph-mon[125702]: pgmap v12639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:32:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:28 smithi057 ceph-mon[92072]: pgmap v12639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:32:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:28 smithi122 ceph-mon[125440]: pgmap v12639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:32:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:30 smithi136 ceph-mon[125702]: pgmap v12640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:32:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:32:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:32:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:32:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:30 smithi057 ceph-mon[92072]: pgmap v12640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:32:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:32:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:32:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:32:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:30 smithi122 ceph-mon[125440]: pgmap v12640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:32:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:32:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:32:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:32:33.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:32 smithi136 ceph-mon[125702]: pgmap v12641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:32 smithi057 ceph-mon[92072]: pgmap v12641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:32 smithi122 ceph-mon[125440]: pgmap v12641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:34 smithi136 ceph-mon[125702]: pgmap v12642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:34 smithi057 ceph-mon[92072]: pgmap v12642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:34 smithi122 ceph-mon[125440]: pgmap v12642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:36 smithi136 ceph-mon[125702]: pgmap v12643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:36 smithi057 ceph-mon[92072]: pgmap v12643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:37.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:32:37.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:37.188+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:32:37.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:37.188+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:32:37.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:37.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:32:37.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:37.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:32:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:36 smithi122 ceph-mon[125440]: pgmap v12643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:38 smithi136 ceph-mon[125702]: pgmap v12644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:38 smithi057 ceph-mon[92072]: pgmap v12644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:38 smithi122 ceph-mon[125440]: pgmap v12644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:40 smithi136 ceph-mon[125702]: pgmap v12645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:40 smithi057 ceph-mon[92072]: pgmap v12645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:40 smithi122 ceph-mon[125440]: pgmap v12645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:42 smithi136 ceph-mon[125702]: pgmap v12646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:42 smithi057 ceph-mon[92072]: pgmap v12646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:42 smithi122 ceph-mon[125440]: pgmap v12646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:44 smithi136 ceph-mon[125702]: pgmap v12647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:44 smithi057 ceph-mon[92072]: pgmap v12647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:44 smithi122 ceph-mon[125440]: pgmap v12647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:46 smithi136 ceph-mon[125702]: pgmap v12648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:46 smithi057 ceph-mon[92072]: pgmap v12648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:46 smithi122 ceph-mon[125440]: pgmap v12648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:48 smithi136 ceph-mon[125702]: pgmap v12649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:48 smithi057 ceph-mon[92072]: pgmap v12649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:48 smithi122 ceph-mon[125440]: pgmap v12649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:50 smithi136 ceph-mon[125702]: pgmap v12650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:50 smithi057 ceph-mon[92072]: pgmap v12650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:50 smithi122 ceph-mon[125440]: pgmap v12650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:52.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:32:52.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:52.197+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:32:52.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:52.197+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:32:52.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:52.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:32:52.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:32:52.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:32:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:52 smithi136 ceph-mon[125702]: pgmap v12651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:52 smithi057 ceph-mon[92072]: pgmap v12651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:52 smithi122 ceph-mon[125440]: pgmap v12651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:54 smithi136 ceph-mon[125702]: pgmap v12652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:54 smithi057 ceph-mon[92072]: pgmap v12652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:54 smithi122 ceph-mon[125440]: pgmap v12652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:56 smithi136 ceph-mon[125702]: pgmap v12653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:56 smithi057 ceph-mon[92072]: pgmap v12653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:56 smithi122 ceph-mon[125440]: pgmap v12653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:32:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:32:58 smithi136 ceph-mon[125702]: pgmap v12654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:32:58 smithi057 ceph-mon[92072]: pgmap v12654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:32:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:32:58 smithi122 ceph-mon[125440]: pgmap v12654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:01.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:00 smithi136 ceph-mon[125702]: pgmap v12655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:00 smithi057 ceph-mon[92072]: pgmap v12655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:00 smithi122 ceph-mon[125440]: pgmap v12655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:03.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:02 smithi136 ceph-mon[125702]: pgmap v12656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:02 smithi057 ceph-mon[92072]: pgmap v12656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:02 smithi122 ceph-mon[125440]: pgmap v12656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:05.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:04 smithi136 ceph-mon[125702]: pgmap v12657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:33:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:04 smithi057 ceph-mon[92072]: pgmap v12657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:33:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:04 smithi122 ceph-mon[125440]: pgmap v12657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:33:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:06 smithi057 ceph-mon[92072]: pgmap v12658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:33:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:06 smithi122 ceph-mon[125440]: pgmap v12658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:33:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:07.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:33:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:07.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:33:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:07.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:33:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:07.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:33:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:07.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:33:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:06 smithi136 ceph-mon[125702]: pgmap v12658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:33:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:07 smithi057 ceph-mon[92072]: osdmap e864: 12 total, 12 up, 12 in 2023-03-02T17:33:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:07 smithi122 ceph-mon[125440]: osdmap e864: 12 total, 12 up, 12 in 2023-03-02T17:33:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:07 smithi136 ceph-mon[125702]: osdmap e864: 12 total, 12 up, 12 in 2023-03-02T17:33:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:08 smithi057 ceph-mon[92072]: pgmap v12660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:33:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:08 smithi122 ceph-mon[125440]: pgmap v12660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:33:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:08 smithi136 ceph-mon[125702]: pgmap v12660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:33:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:10 smithi057 ceph-mon[92072]: pgmap v12661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:33:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:10 smithi122 ceph-mon[125440]: pgmap v12661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:33:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:10 smithi136 ceph-mon[125702]: pgmap v12661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:33:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:12 smithi057 ceph-mon[92072]: pgmap v12662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:33:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:12 smithi122 ceph-mon[125440]: pgmap v12662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:33:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:12 smithi136 ceph-mon[125702]: pgmap v12662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:33:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:14 smithi057 ceph-mon[92072]: pgmap v12663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:33:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:14 smithi122 ceph-mon[125440]: pgmap v12663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:33:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:14 smithi136 ceph-mon[125702]: pgmap v12663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:33:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:16 smithi136 ceph-mon[125702]: pgmap v12664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:33:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:16 smithi136 ceph-mon[125702]: osdmap e865: 12 total, 12 up, 12 in 2023-03-02T17:33:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:16 smithi057 ceph-mon[92072]: pgmap v12664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:33:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:16 smithi057 ceph-mon[92072]: osdmap e865: 12 total, 12 up, 12 in 2023-03-02T17:33:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:16 smithi122 ceph-mon[125440]: pgmap v12664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:33:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:16 smithi122 ceph-mon[125440]: osdmap e865: 12 total, 12 up, 12 in 2023-03-02T17:33:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:18 smithi136 ceph-mon[125702]: pgmap v12666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:33:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:18 smithi057 ceph-mon[92072]: pgmap v12666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:33:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:18 smithi122 ceph-mon[125440]: pgmap v12666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:33:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:20 smithi136 ceph-mon[125702]: pgmap v12667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:33:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:20 smithi057 ceph-mon[92072]: pgmap v12667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:33:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:20 smithi122 ceph-mon[125440]: pgmap v12667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:33:22.217 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:22.217+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:33:22.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:22.217+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:33:22.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:22.217+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:33:22.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:22.217+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:33:22.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:22.217+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:33:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:22 smithi136 ceph-mon[125702]: pgmap v12668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:33:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:22 smithi057 ceph-mon[92072]: pgmap v12668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:33:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:22 smithi122 ceph-mon[125440]: pgmap v12668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:33:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:24 smithi136 ceph-mon[125702]: pgmap v12669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:33:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:24 smithi057 ceph-mon[92072]: pgmap v12669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:33:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:24 smithi122 ceph-mon[125440]: pgmap v12669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:33:27.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:26 smithi136 ceph-mon[125702]: pgmap v12670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:33:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:26 smithi057 ceph-mon[92072]: pgmap v12670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:33:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:26 smithi122 ceph-mon[125440]: pgmap v12670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:33:29.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:28 smithi136 ceph-mon[125702]: pgmap v12671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:33:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:28 smithi057 ceph-mon[92072]: pgmap v12671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:33:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:28 smithi122 ceph-mon[125440]: pgmap v12671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:33:31.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:30 smithi136 ceph-mon[125702]: pgmap v12672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:30 smithi057 ceph-mon[92072]: pgmap v12672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:30 smithi122 ceph-mon[125440]: pgmap v12672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:33:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:33:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:33:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:33:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:33:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:33:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:33:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:33:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:33:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:33:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:33:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:33:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:32 smithi136 ceph-mon[125702]: pgmap v12673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:32 smithi057 ceph-mon[92072]: pgmap v12673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:32 smithi122 ceph-mon[125440]: pgmap v12673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:34 smithi136 ceph-mon[125702]: pgmap v12674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:34 smithi057 ceph-mon[92072]: pgmap v12674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:34 smithi122 ceph-mon[125440]: pgmap v12674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:36 smithi136 ceph-mon[125702]: pgmap v12675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:36 smithi057 ceph-mon[92072]: pgmap v12675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:36 smithi122 ceph-mon[125440]: pgmap v12675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:37.231+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:33:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:37.231+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:33:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:37.231+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:33:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:37.231+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:33:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:37.231+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:33:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:38 smithi136 ceph-mon[125702]: pgmap v12676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:38 smithi057 ceph-mon[92072]: pgmap v12676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:38 smithi122 ceph-mon[125440]: pgmap v12676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:40 smithi136 ceph-mon[125702]: pgmap v12677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:41.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:40 smithi057 ceph-mon[92072]: pgmap v12677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:40 smithi122 ceph-mon[125440]: pgmap v12677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:42 smithi136 ceph-mon[125702]: pgmap v12678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:42 smithi057 ceph-mon[92072]: pgmap v12678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:42 smithi122 ceph-mon[125440]: pgmap v12678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:44 smithi136 ceph-mon[125702]: pgmap v12679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:44 smithi057 ceph-mon[92072]: pgmap v12679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:44 smithi122 ceph-mon[125440]: pgmap v12679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:46 smithi136 ceph-mon[125702]: pgmap v12680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:46 smithi057 ceph-mon[92072]: pgmap v12680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:46 smithi122 ceph-mon[125440]: pgmap v12680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:48 smithi136 ceph-mon[125702]: pgmap v12681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:48 smithi057 ceph-mon[92072]: pgmap v12681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:48 smithi122 ceph-mon[125440]: pgmap v12681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:50 smithi057 ceph-mon[92072]: pgmap v12682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:50 smithi122 ceph-mon[125440]: pgmap v12682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:50 smithi136 ceph-mon[125702]: pgmap v12682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:52.247+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:33:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:52.247+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:33:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:52.247+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:33:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:52.247+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:33:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:33:52.247+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:33:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:52 smithi057 ceph-mon[92072]: pgmap v12683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:52 smithi122 ceph-mon[125440]: pgmap v12683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:52 smithi136 ceph-mon[125702]: pgmap v12683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:54 smithi057 ceph-mon[92072]: pgmap v12684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:54 smithi122 ceph-mon[125440]: pgmap v12684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:55.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:54 smithi136 ceph-mon[125702]: pgmap v12684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:56 smithi057 ceph-mon[92072]: pgmap v12685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:56 smithi122 ceph-mon[125440]: pgmap v12685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:56 smithi136 ceph-mon[125702]: pgmap v12685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:33:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:33:58 smithi057 ceph-mon[92072]: pgmap v12686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:33:58 smithi122 ceph-mon[125440]: pgmap v12686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:33:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:33:58 smithi136 ceph-mon[125702]: pgmap v12686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:34:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:00 smithi057 ceph-mon[92072]: pgmap v12687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:00 smithi122 ceph-mon[125440]: pgmap v12687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:00 smithi136 ceph-mon[125702]: pgmap v12687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:02 smithi057 ceph-mon[92072]: pgmap v12688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:02 smithi122 ceph-mon[125440]: pgmap v12688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:03.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:02 smithi136 ceph-mon[125702]: pgmap v12688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:04 smithi057 ceph-mon[92072]: pgmap v12689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:34:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:04 smithi122 ceph-mon[125440]: pgmap v12689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:34:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:04 smithi136 ceph-mon[125702]: pgmap v12689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:34:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:06 smithi057 ceph-mon[92072]: pgmap v12690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:34:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:06 smithi122 ceph-mon[125440]: pgmap v12690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:34:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:07.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:34:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:07.260+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:34:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:07.260+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:34:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:07.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:34:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:07.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:34:07.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:06 smithi136 ceph-mon[125702]: pgmap v12690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:34:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:07 smithi057 ceph-mon[92072]: osdmap e866: 12 total, 12 up, 12 in 2023-03-02T17:34:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:07 smithi122 ceph-mon[125440]: osdmap e866: 12 total, 12 up, 12 in 2023-03-02T17:34:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:07 smithi136 ceph-mon[125702]: osdmap e866: 12 total, 12 up, 12 in 2023-03-02T17:34:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:08 smithi057 ceph-mon[92072]: pgmap v12692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:34:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:08 smithi122 ceph-mon[125440]: pgmap v12692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:34:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:08 smithi136 ceph-mon[125702]: pgmap v12692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:34:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:10 smithi057 ceph-mon[92072]: pgmap v12693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:34:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:10 smithi122 ceph-mon[125440]: pgmap v12693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:34:11.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:10 smithi136 ceph-mon[125702]: pgmap v12693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:34:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:12 smithi057 ceph-mon[92072]: pgmap v12694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:34:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:12 smithi122 ceph-mon[125440]: pgmap v12694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:34:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:12 smithi136 ceph-mon[125702]: pgmap v12694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:34:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:14 smithi057 ceph-mon[92072]: pgmap v12695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:34:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:14 smithi122 ceph-mon[125440]: pgmap v12695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:34:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:14 smithi136 ceph-mon[125702]: pgmap v12695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:34:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:16 smithi136 ceph-mon[125702]: pgmap v12696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:34:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:16 smithi136 ceph-mon[125702]: osdmap e867: 12 total, 12 up, 12 in 2023-03-02T17:34:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:16 smithi057 ceph-mon[92072]: pgmap v12696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:34:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:16 smithi057 ceph-mon[92072]: osdmap e867: 12 total, 12 up, 12 in 2023-03-02T17:34:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:16 smithi122 ceph-mon[125440]: pgmap v12696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:34:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:16 smithi122 ceph-mon[125440]: osdmap e867: 12 total, 12 up, 12 in 2023-03-02T17:34:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:18 smithi136 ceph-mon[125702]: pgmap v12698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:34:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:18 smithi057 ceph-mon[92072]: pgmap v12698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:34:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:18 smithi122 ceph-mon[125440]: pgmap v12698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:34:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:20 smithi136 ceph-mon[125702]: pgmap v12699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:34:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:20 smithi057 ceph-mon[92072]: pgmap v12699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:34:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:20 smithi122 ceph-mon[125440]: pgmap v12699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:34:22.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:22.276+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:34:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:22.276+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:34:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:22.276+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:34:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:22.276+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:34:22.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:22.276+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:34:23.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:22 smithi136 ceph-mon[125702]: pgmap v12700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:34:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:22 smithi057 ceph-mon[92072]: pgmap v12700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:34:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:22 smithi122 ceph-mon[125440]: pgmap v12700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:34:25.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:24 smithi136 ceph-mon[125702]: pgmap v12701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:34:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:24 smithi057 ceph-mon[92072]: pgmap v12701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:34:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:24 smithi122 ceph-mon[125440]: pgmap v12701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:34:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:26 smithi136 ceph-mon[125702]: pgmap v12702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:34:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:26 smithi057 ceph-mon[92072]: pgmap v12702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:34:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:26 smithi122 ceph-mon[125440]: pgmap v12702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:34:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:28 smithi136 ceph-mon[125702]: pgmap v12703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:34:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:28 smithi057 ceph-mon[92072]: pgmap v12703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:34:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:28 smithi122 ceph-mon[125440]: pgmap v12703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:34:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:30 smithi136 ceph-mon[125702]: pgmap v12704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:34:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:30 smithi057 ceph-mon[92072]: pgmap v12704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:34:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:30 smithi122 ceph-mon[125440]: pgmap v12704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:34:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:34:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:34:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:34:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:32 smithi136 ceph-mon[125702]: pgmap v12705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:34:33.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:32 smithi057 ceph-mon[92072]: pgmap v12705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:34:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:32 smithi122 ceph-mon[125440]: pgmap v12705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:34:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:34 smithi136 ceph-mon[125702]: pgmap v12706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:34:35.161 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:34 smithi057 ceph-mon[92072]: pgmap v12706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:34:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:34 smithi122 ceph-mon[125440]: pgmap v12706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:34:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:36 smithi136 ceph-mon[125702]: pgmap v12707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T17:34:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:34:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:34:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:34:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:34:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:34:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:36 smithi057 ceph-mon[92072]: pgmap v12707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T17:34:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:34:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:34:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:34:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:34:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:34:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:36 smithi122 ceph-mon[125440]: pgmap v12707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T17:34:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:34:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:34:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:34:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:34:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:34:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:37.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:34:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:37.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:34:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:37.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:34:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:37.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:34:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:37.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:34:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:38 smithi136 ceph-mon[125702]: pgmap v12708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T17:34:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:38 smithi057 ceph-mon[92072]: pgmap v12708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T17:34:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:38 smithi122 ceph-mon[125440]: pgmap v12708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-02T17:34:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:40 smithi136 ceph-mon[125702]: pgmap v12709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:34:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:40 smithi057 ceph-mon[92072]: pgmap v12709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:34:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:40 smithi122 ceph-mon[125440]: pgmap v12709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:34:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:42 smithi136 ceph-mon[125702]: pgmap v12710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:34:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:42 smithi057 ceph-mon[92072]: pgmap v12710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:34:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:42 smithi122 ceph-mon[125440]: pgmap v12710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T17:34:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:44 smithi136 ceph-mon[125702]: pgmap v12711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:34:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:44 smithi057 ceph-mon[92072]: pgmap v12711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:34:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:44 smithi122 ceph-mon[125440]: pgmap v12711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T17:34:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:46 smithi136 ceph-mon[125702]: pgmap v12712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:34:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:46 smithi057 ceph-mon[92072]: pgmap v12712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:34:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:46 smithi122 ceph-mon[125440]: pgmap v12712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:34:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:48 smithi136 ceph-mon[125702]: pgmap v12713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:34:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:48 smithi057 ceph-mon[92072]: pgmap v12713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:34:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:48 smithi122 ceph-mon[125440]: pgmap v12713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:34:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:50 smithi136 ceph-mon[125702]: pgmap v12714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:50 smithi057 ceph-mon[92072]: pgmap v12714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:50 smithi122 ceph-mon[125440]: pgmap v12714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:52.304+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:34:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:52.305+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:34:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:52.305+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:34:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:52.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:34:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:34:52.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:34:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:52 smithi136 ceph-mon[125702]: pgmap v12715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:52 smithi057 ceph-mon[92072]: pgmap v12715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:52 smithi122 ceph-mon[125440]: pgmap v12715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:54 smithi136 ceph-mon[125702]: pgmap v12716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:34:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:54 smithi057 ceph-mon[92072]: pgmap v12716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:34:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:54 smithi122 ceph-mon[125440]: pgmap v12716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:34:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:56 smithi136 ceph-mon[125702]: pgmap v12717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:56 smithi057 ceph-mon[92072]: pgmap v12717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:56 smithi122 ceph-mon[125440]: pgmap v12717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:34:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:34:58 smithi136 ceph-mon[125702]: pgmap v12718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:34:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:34:58 smithi057 ceph-mon[92072]: pgmap v12718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:34:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:34:58 smithi122 ceph-mon[125440]: pgmap v12718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:00 smithi136 ceph-mon[125702]: pgmap v12719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:00 smithi057 ceph-mon[92072]: pgmap v12719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:00 smithi122 ceph-mon[125440]: pgmap v12719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:02 smithi057 ceph-mon[92072]: pgmap v12720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:02 smithi122 ceph-mon[125440]: pgmap v12720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:02 smithi136 ceph-mon[125702]: pgmap v12720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:04 smithi057 ceph-mon[92072]: pgmap v12721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:35:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:04 smithi122 ceph-mon[125440]: pgmap v12721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:35:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:04 smithi136 ceph-mon[125702]: pgmap v12721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:35:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:06 smithi057 ceph-mon[92072]: pgmap v12722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:35:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:06 smithi122 ceph-mon[125440]: pgmap v12722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:35:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:07.307+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:35:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:07.307+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:35:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:07.307+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:35:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:07.307+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:35:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:07.307+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:35:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:06 smithi136 ceph-mon[125702]: pgmap v12722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:35:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:08 smithi057 ceph-mon[92072]: pgmap v12723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:35:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:08 smithi122 ceph-mon[125440]: pgmap v12723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:35:09.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:08 smithi136 ceph-mon[125702]: pgmap v12723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:35:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:10 smithi057 ceph-mon[92072]: pgmap v12724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:35:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:10 smithi122 ceph-mon[125440]: pgmap v12724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:35:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:10 smithi136 ceph-mon[125702]: pgmap v12724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:35:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:11.800+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:35:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:11.800+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:35:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:11.800+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 184 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T17:35:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:11.801+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:35:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:11.801+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 185 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T17:35:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:11.801+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:35:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:11.801+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 185 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:35:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:11.801+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 186 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:35:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:12 smithi057 ceph-mon[92072]: pgmap v12725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:35:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:12 smithi057 ceph-mon[92072]: osdmap e868: 12 total, 12 up, 12 in 2023-03-02T17:35:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:12 smithi122 ceph-mon[125440]: pgmap v12725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:35:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:12 smithi122 ceph-mon[125440]: osdmap e868: 12 total, 12 up, 12 in 2023-03-02T17:35:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:12 smithi136 ceph-mon[125702]: pgmap v12725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:35:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:12 smithi136 ceph-mon[125702]: osdmap e868: 12 total, 12 up, 12 in 2023-03-02T17:35:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:14 smithi057 ceph-mon[92072]: pgmap v12727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:14 smithi122 ceph-mon[125440]: pgmap v12727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:14 smithi136 ceph-mon[125702]: pgmap v12727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:16 smithi057 ceph-mon[92072]: pgmap v12728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:16 smithi122 ceph-mon[125440]: pgmap v12728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:16 smithi136 ceph-mon[125702]: pgmap v12728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:18 smithi057 ceph-mon[92072]: pgmap v12729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:35:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:18 smithi122 ceph-mon[125440]: pgmap v12729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:35:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:18 smithi136 ceph-mon[125702]: pgmap v12729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:35:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:20 smithi057 ceph-mon[92072]: pgmap v12730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:35:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:20 smithi057 ceph-mon[92072]: osdmap e869: 12 total, 12 up, 12 in 2023-03-02T17:35:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:20 smithi122 ceph-mon[125440]: pgmap v12730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:35:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:20 smithi122 ceph-mon[125440]: osdmap e869: 12 total, 12 up, 12 in 2023-03-02T17:35:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:20 smithi136 ceph-mon[125702]: pgmap v12730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:35:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:20 smithi136 ceph-mon[125702]: osdmap e869: 12 total, 12 up, 12 in 2023-03-02T17:35:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:22.313+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:35:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:22.313+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:35:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:22.313+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:35:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:22.313+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:35:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:22.313+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:35:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:22 smithi057 ceph-mon[92072]: pgmap v12732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 212 B/s wr, 5 op/s 2023-03-02T17:35:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:22 smithi122 ceph-mon[125440]: pgmap v12732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 212 B/s wr, 5 op/s 2023-03-02T17:35:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:22 smithi136 ceph-mon[125702]: pgmap v12732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 212 B/s wr, 5 op/s 2023-03-02T17:35:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:24 smithi057 ceph-mon[92072]: pgmap v12733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:24 smithi122 ceph-mon[125440]: pgmap v12733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:24 smithi136 ceph-mon[125702]: pgmap v12733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:26 smithi057 ceph-mon[92072]: pgmap v12734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:26 smithi122 ceph-mon[125440]: pgmap v12734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:26 smithi136 ceph-mon[125702]: pgmap v12734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:35:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:28 smithi057 ceph-mon[92072]: pgmap v12735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:35:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:28 smithi122 ceph-mon[125440]: pgmap v12735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:35:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:28 smithi136 ceph-mon[125702]: pgmap v12735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:35:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:30 smithi057 ceph-mon[92072]: pgmap v12736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:35:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:30 smithi122 ceph-mon[125440]: pgmap v12736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:35:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:30 smithi136 ceph-mon[125702]: pgmap v12736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:35:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:32 smithi057 ceph-mon[92072]: pgmap v12737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T17:35:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:32 smithi122 ceph-mon[125440]: pgmap v12737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T17:35:33.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:32 smithi136 ceph-mon[125702]: pgmap v12737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T17:35:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:34 smithi122 ceph-mon[125440]: pgmap v12738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:35:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:34 smithi136 ceph-mon[125702]: pgmap v12738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:35:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:34 smithi057 ceph-mon[92072]: pgmap v12738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:35:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:35:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:35:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:35:37.312 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:36 smithi122 ceph-mon[125440]: pgmap v12739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:37.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:35:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:37.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:35:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:37.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:35:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:37.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:35:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:37.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:35:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:36 smithi136 ceph-mon[125702]: pgmap v12739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:36 smithi057 ceph-mon[92072]: pgmap v12739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:39.292 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:38 smithi136 ceph-mon[125702]: pgmap v12740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:39.370 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:38 smithi122 ceph-mon[125440]: pgmap v12740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:38 smithi057 ceph-mon[92072]: pgmap v12740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:40 smithi136 ceph-mon[125702]: pgmap v12741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:35:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:35:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:40 smithi057 ceph-mon[92072]: pgmap v12741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:35:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:35:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:40 smithi122 ceph-mon[125440]: pgmap v12741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:35:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:35:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:35:43.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:42 smithi136 ceph-mon[125702]: pgmap v12742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:42 smithi057 ceph-mon[92072]: pgmap v12742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:42 smithi122 ceph-mon[125440]: pgmap v12742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:45.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:44 smithi136 ceph-mon[125702]: pgmap v12743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:44 smithi057 ceph-mon[92072]: pgmap v12743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:44 smithi122 ceph-mon[125440]: pgmap v12743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:46 smithi136 ceph-mon[125702]: pgmap v12744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:46 smithi057 ceph-mon[92072]: pgmap v12744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:46 smithi122 ceph-mon[125440]: pgmap v12744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:48 smithi136 ceph-mon[125702]: pgmap v12745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:48 smithi057 ceph-mon[92072]: pgmap v12745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:48 smithi122 ceph-mon[125440]: pgmap v12745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:50 smithi136 ceph-mon[125702]: pgmap v12746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:50 smithi057 ceph-mon[92072]: pgmap v12746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:50 smithi122 ceph-mon[125440]: pgmap v12746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:52.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:35:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:52.341+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:35:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:52.341+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:35:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:52.341+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:35:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:35:52.341+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:35:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:52 smithi136 ceph-mon[125702]: pgmap v12747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:52 smithi057 ceph-mon[92072]: pgmap v12747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:52 smithi122 ceph-mon[125440]: pgmap v12747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:55.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:54 smithi136 ceph-mon[125702]: pgmap v12748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:54 smithi057 ceph-mon[92072]: pgmap v12748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:54 smithi122 ceph-mon[125440]: pgmap v12748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:57.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:56 smithi136 ceph-mon[125702]: pgmap v12749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:56 smithi057 ceph-mon[92072]: pgmap v12749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:56 smithi122 ceph-mon[125440]: pgmap v12749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:35:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:35:58 smithi136 ceph-mon[125702]: pgmap v12750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:35:58 smithi057 ceph-mon[92072]: pgmap v12750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:35:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:35:58 smithi122 ceph-mon[125440]: pgmap v12750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:01.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:00 smithi136 ceph-mon[125702]: pgmap v12751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:00 smithi057 ceph-mon[92072]: pgmap v12751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:00 smithi122 ceph-mon[125440]: pgmap v12751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:02 smithi136 ceph-mon[125702]: pgmap v12752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:02 smithi057 ceph-mon[92072]: pgmap v12752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:02 smithi122 ceph-mon[125440]: pgmap v12752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:04 smithi057 ceph-mon[92072]: pgmap v12753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:36:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:04 smithi122 ceph-mon[125440]: pgmap v12753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:36:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:04 smithi136 ceph-mon[125702]: pgmap v12753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:36:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:06 smithi057 ceph-mon[92072]: pgmap v12754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:36:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:06 smithi122 ceph-mon[125440]: pgmap v12754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:36:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:06 smithi136 ceph-mon[125702]: pgmap v12754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:36:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:07.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:36:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:07.357+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:07.357+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:07.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:07.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:36:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:08 smithi057 ceph-mon[92072]: pgmap v12755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:36:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:08 smithi122 ceph-mon[125440]: pgmap v12755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:36:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:08 smithi136 ceph-mon[125702]: pgmap v12755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:36:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:10 smithi057 ceph-mon[92072]: pgmap v12756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:36:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:10 smithi122 ceph-mon[125440]: pgmap v12756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:36:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:10 smithi136 ceph-mon[125702]: pgmap v12756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:36:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:12 smithi057 ceph-mon[92072]: pgmap v12757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:36:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:12 smithi057 ceph-mon[92072]: osdmap e870: 12 total, 12 up, 12 in 2023-03-02T17:36:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:12 smithi122 ceph-mon[125440]: pgmap v12757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:36:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:12 smithi122 ceph-mon[125440]: osdmap e870: 12 total, 12 up, 12 in 2023-03-02T17:36:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:12 smithi136 ceph-mon[125702]: pgmap v12757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:36:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:12 smithi136 ceph-mon[125702]: osdmap e870: 12 total, 12 up, 12 in 2023-03-02T17:36:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:14 smithi057 ceph-mon[92072]: pgmap v12759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:14 smithi122 ceph-mon[125440]: pgmap v12759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:14 smithi136 ceph-mon[125702]: pgmap v12759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:16 smithi057 ceph-mon[92072]: pgmap v12760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:16 smithi122 ceph-mon[125440]: pgmap v12760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:16 smithi136 ceph-mon[125702]: pgmap v12760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:18 smithi057 ceph-mon[92072]: pgmap v12761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:18 smithi122 ceph-mon[125440]: pgmap v12761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:18 smithi136 ceph-mon[125702]: pgmap v12761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:20 smithi057 ceph-mon[92072]: pgmap v12762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:20 smithi057 ceph-mon[92072]: osdmap e871: 12 total, 12 up, 12 in 2023-03-02T17:36:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:20 smithi122 ceph-mon[125440]: pgmap v12762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:20 smithi122 ceph-mon[125440]: osdmap e871: 12 total, 12 up, 12 in 2023-03-02T17:36:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:20 smithi136 ceph-mon[125702]: pgmap v12762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:36:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:20 smithi136 ceph-mon[125702]: osdmap e871: 12 total, 12 up, 12 in 2023-03-02T17:36:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:22.369+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:36:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:22.369+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:36:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:22.369+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:36:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:22.369+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:36:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:22.369+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:36:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:22 smithi057 ceph-mon[92072]: pgmap v12764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T17:36:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:22 smithi122 ceph-mon[125440]: pgmap v12764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T17:36:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:22 smithi136 ceph-mon[125702]: pgmap v12764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T17:36:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:24 smithi057 ceph-mon[92072]: pgmap v12765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:36:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:24 smithi122 ceph-mon[125440]: pgmap v12765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:36:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:24 smithi136 ceph-mon[125702]: pgmap v12765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:36:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:26 smithi057 ceph-mon[92072]: pgmap v12766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:36:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:26 smithi122 ceph-mon[125440]: pgmap v12766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:36:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:26 smithi136 ceph-mon[125702]: pgmap v12766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:36:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:28 smithi057 ceph-mon[92072]: pgmap v12767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:36:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:28 smithi122 ceph-mon[125440]: pgmap v12767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:36:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:28 smithi136 ceph-mon[125702]: pgmap v12767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:36:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:30 smithi057 ceph-mon[92072]: pgmap v12768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:36:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:30 smithi122 ceph-mon[125440]: pgmap v12768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:36:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:30 smithi136 ceph-mon[125702]: pgmap v12768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:36:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:32 smithi122 ceph-mon[125440]: pgmap v12769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T17:36:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:32 smithi136 ceph-mon[125702]: pgmap v12769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T17:36:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:32 smithi057 ceph-mon[92072]: pgmap v12769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T17:36:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:34 smithi122 ceph-mon[125440]: pgmap v12770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:36:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:34 smithi136 ceph-mon[125702]: pgmap v12770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:36:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:34 smithi057 ceph-mon[92072]: pgmap v12770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:36:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:36 smithi122 ceph-mon[125440]: pgmap v12771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:36 smithi136 ceph-mon[125702]: pgmap v12771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:37.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:37.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:36:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:37.386+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:36:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:37.386+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:36:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:37.386+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:36:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:37.386+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:36:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:36 smithi057 ceph-mon[92072]: pgmap v12771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:38 smithi122 ceph-mon[125440]: pgmap v12772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:38 smithi136 ceph-mon[125702]: pgmap v12772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:38 smithi057 ceph-mon[92072]: pgmap v12772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:36:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:36:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:36:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:40 smithi136 ceph-mon[125702]: pgmap v12773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:36:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:36:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:36:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:40 smithi057 ceph-mon[92072]: pgmap v12773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:36:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:36:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:36:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:40 smithi122 ceph-mon[125440]: pgmap v12773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:36:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:36:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:36:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:42 smithi136 ceph-mon[125702]: pgmap v12774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:43.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:42 smithi057 ceph-mon[92072]: pgmap v12774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:42 smithi122 ceph-mon[125440]: pgmap v12774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:44 smithi136 ceph-mon[125702]: pgmap v12775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:44 smithi057 ceph-mon[92072]: pgmap v12775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:44 smithi122 ceph-mon[125440]: pgmap v12775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:46 smithi136 ceph-mon[125702]: pgmap v12776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:46 smithi057 ceph-mon[92072]: pgmap v12776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:46 smithi122 ceph-mon[125440]: pgmap v12776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:48 smithi136 ceph-mon[125702]: pgmap v12777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:48 smithi057 ceph-mon[92072]: pgmap v12777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:48 smithi122 ceph-mon[125440]: pgmap v12777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:50 smithi136 ceph-mon[125702]: pgmap v12778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:50 smithi057 ceph-mon[92072]: pgmap v12778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:50 smithi122 ceph-mon[125440]: pgmap v12778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:52.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:52.398+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:36:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:52.399+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:36:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:52.399+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:36:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:52.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:36:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:36:52.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:36:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:52 smithi136 ceph-mon[125702]: pgmap v12779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:52 smithi057 ceph-mon[92072]: pgmap v12779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:52 smithi122 ceph-mon[125440]: pgmap v12779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:55 smithi136 ceph-mon[125702]: pgmap v12780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:55 smithi057 ceph-mon[92072]: pgmap v12780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:55 smithi122 ceph-mon[125440]: pgmap v12780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:57 smithi136 ceph-mon[125702]: pgmap v12781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:57 smithi057 ceph-mon[92072]: pgmap v12781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:57 smithi122 ceph-mon[125440]: pgmap v12781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:36:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:36:59 smithi136 ceph-mon[125702]: pgmap v12782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:36:59 smithi057 ceph-mon[92072]: pgmap v12782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:36:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:36:59 smithi122 ceph-mon[125440]: pgmap v12782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:01 smithi136 ceph-mon[125702]: pgmap v12783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:01 smithi057 ceph-mon[92072]: pgmap v12783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:01 smithi122 ceph-mon[125440]: pgmap v12783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:03 smithi136 ceph-mon[125702]: pgmap v12784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:03 smithi057 ceph-mon[92072]: pgmap v12784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:03 smithi122 ceph-mon[125440]: pgmap v12784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:05 smithi136 ceph-mon[125702]: pgmap v12785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:37:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:05 smithi057 ceph-mon[92072]: pgmap v12785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:37:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:05 smithi122 ceph-mon[125440]: pgmap v12785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:37:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:07 smithi136 ceph-mon[125702]: pgmap v12786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:37:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:07 smithi136 ceph-mon[125702]: osdmap e872: 12 total, 12 up, 12 in 2023-03-02T17:37:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:07.411+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:37:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:07.412+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:37:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:07.412+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:37:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:07.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:37:07.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:07.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:37:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:07 smithi057 ceph-mon[92072]: pgmap v12786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:37:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:07 smithi057 ceph-mon[92072]: osdmap e872: 12 total, 12 up, 12 in 2023-03-02T17:37:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:07 smithi122 ceph-mon[125440]: pgmap v12786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:37:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:07 smithi122 ceph-mon[125440]: osdmap e872: 12 total, 12 up, 12 in 2023-03-02T17:37:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:09 smithi136 ceph-mon[125702]: pgmap v12788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:37:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:09 smithi057 ceph-mon[92072]: pgmap v12788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:37:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:09 smithi122 ceph-mon[125440]: pgmap v12788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:37:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:11 smithi136 ceph-mon[125702]: pgmap v12789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:37:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:11 smithi057 ceph-mon[92072]: pgmap v12789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:37:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:11 smithi122 ceph-mon[125440]: pgmap v12789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:37:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:13 smithi136 ceph-mon[125702]: pgmap v12790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:37:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:13 smithi057 ceph-mon[92072]: pgmap v12790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:37:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:13 smithi122 ceph-mon[125440]: pgmap v12790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:37:15.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:15 smithi136 ceph-mon[125702]: pgmap v12791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:37:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:15 smithi057 ceph-mon[92072]: pgmap v12791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:37:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:15 smithi122 ceph-mon[125440]: pgmap v12791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:37:17.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:16 smithi136 ceph-mon[125702]: pgmap v12792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:37:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:16 smithi136 ceph-mon[125702]: osdmap e873: 12 total, 12 up, 12 in 2023-03-02T17:37:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:16 smithi057 ceph-mon[92072]: pgmap v12792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:37:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:16 smithi057 ceph-mon[92072]: osdmap e873: 12 total, 12 up, 12 in 2023-03-02T17:37:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:16 smithi122 ceph-mon[125440]: pgmap v12792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:37:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:16 smithi122 ceph-mon[125440]: osdmap e873: 12 total, 12 up, 12 in 2023-03-02T17:37:19.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:18 smithi136 ceph-mon[125702]: pgmap v12794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:37:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:18 smithi057 ceph-mon[92072]: pgmap v12794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:37:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:18 smithi122 ceph-mon[125440]: pgmap v12794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:37:21.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:20 smithi136 ceph-mon[125702]: pgmap v12795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:37:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:20 smithi057 ceph-mon[92072]: pgmap v12795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:37:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:20 smithi122 ceph-mon[125440]: pgmap v12795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:37:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:22.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:37:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:22.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:37:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:22.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:37:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:22.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:37:22.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:22.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:37:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:22 smithi057 ceph-mon[92072]: pgmap v12796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:37:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:22 smithi122 ceph-mon[125440]: pgmap v12796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:37:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:22 smithi136 ceph-mon[125702]: pgmap v12796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:37:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:24 smithi057 ceph-mon[92072]: pgmap v12797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:37:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:24 smithi122 ceph-mon[125440]: pgmap v12797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:37:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:24 smithi136 ceph-mon[125702]: pgmap v12797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:37:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:26 smithi057 ceph-mon[92072]: pgmap v12798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:37:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:26 smithi122 ceph-mon[125440]: pgmap v12798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:37:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:26 smithi136 ceph-mon[125702]: pgmap v12798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:37:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:28 smithi057 ceph-mon[92072]: pgmap v12799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T17:37:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:28 smithi122 ceph-mon[125440]: pgmap v12799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T17:37:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:28 smithi136 ceph-mon[125702]: pgmap v12799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T17:37:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:30 smithi057 ceph-mon[92072]: pgmap v12800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:30 smithi122 ceph-mon[125440]: pgmap v12800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:30 smithi136 ceph-mon[125702]: pgmap v12800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:32 smithi057 ceph-mon[92072]: pgmap v12801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:32 smithi122 ceph-mon[125440]: pgmap v12801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:32 smithi136 ceph-mon[125702]: pgmap v12801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:34 smithi057 ceph-mon[92072]: pgmap v12802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:34 smithi122 ceph-mon[125440]: pgmap v12802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:34 smithi136 ceph-mon[125702]: pgmap v12802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:36 smithi057 ceph-mon[92072]: pgmap v12803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:36 smithi122 ceph-mon[125440]: pgmap v12803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:36 smithi136 ceph-mon[125702]: pgmap v12803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:37.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:37.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:37:37.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:37.431+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:37:37.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:37.431+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:37:37.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:37.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:37:37.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:37.431+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:37:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:38 smithi057 ceph-mon[92072]: pgmap v12804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:38 smithi122 ceph-mon[125440]: pgmap v12804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:38 smithi136 ceph-mon[125702]: pgmap v12804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:40 smithi057 ceph-mon[92072]: pgmap v12805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:37:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:40 smithi122 ceph-mon[125440]: pgmap v12805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:37:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:40 smithi136 ceph-mon[125702]: pgmap v12805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:37:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:43 smithi136 ceph-mon[125702]: pgmap v12806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:37:43.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:37:43.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:43 smithi057 ceph-mon[92072]: pgmap v12806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:37:43.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:37:43.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:43 smithi122 ceph-mon[125440]: pgmap v12806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:37:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:37:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:37:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:45 smithi136 ceph-mon[125702]: pgmap v12807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:45 smithi057 ceph-mon[92072]: pgmap v12807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:45 smithi122 ceph-mon[125440]: pgmap v12807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:47 smithi136 ceph-mon[125702]: pgmap v12808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:47 smithi057 ceph-mon[92072]: pgmap v12808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:47 smithi122 ceph-mon[125440]: pgmap v12808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:49 smithi136 ceph-mon[125702]: pgmap v12809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:49 smithi057 ceph-mon[92072]: pgmap v12809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:49 smithi122 ceph-mon[125440]: pgmap v12809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:51 smithi136 ceph-mon[125702]: pgmap v12810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:51 smithi057 ceph-mon[92072]: pgmap v12810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:51 smithi122 ceph-mon[125440]: pgmap v12810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:52.438+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:37:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:52.439+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:37:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:52.439+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:37:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:52.439+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:37:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:37:52.439+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:37:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:53 smithi136 ceph-mon[125702]: pgmap v12811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:53 smithi057 ceph-mon[92072]: pgmap v12811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:53 smithi122 ceph-mon[125440]: pgmap v12811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:55 smithi136 ceph-mon[125702]: pgmap v12812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:55 smithi057 ceph-mon[92072]: pgmap v12812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:55 smithi122 ceph-mon[125440]: pgmap v12812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:57 smithi136 ceph-mon[125702]: pgmap v12813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:57 smithi057 ceph-mon[92072]: pgmap v12813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:57 smithi122 ceph-mon[125440]: pgmap v12813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:37:59.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:37:59 smithi136 ceph-mon[125702]: pgmap v12814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:37:59 smithi057 ceph-mon[92072]: pgmap v12814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:37:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:37:59 smithi122 ceph-mon[125440]: pgmap v12814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:01 smithi136 ceph-mon[125702]: pgmap v12815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:01 smithi057 ceph-mon[92072]: pgmap v12815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:01 smithi122 ceph-mon[125440]: pgmap v12815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:03 smithi136 ceph-mon[125702]: pgmap v12816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:03 smithi057 ceph-mon[92072]: pgmap v12816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:03 smithi122 ceph-mon[125440]: pgmap v12816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:05 smithi136 ceph-mon[125702]: pgmap v12817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:38:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:05 smithi057 ceph-mon[92072]: pgmap v12817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:38:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:05 smithi122 ceph-mon[125440]: pgmap v12817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:38:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:07 smithi136 ceph-mon[125702]: pgmap v12818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:38:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:07 smithi136 ceph-mon[125702]: osdmap e874: 12 total, 12 up, 12 in 2023-03-02T17:38:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:07 smithi057 ceph-mon[92072]: pgmap v12818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:38:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:07 smithi057 ceph-mon[92072]: osdmap e874: 12 total, 12 up, 12 in 2023-03-02T17:38:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:07 smithi122 ceph-mon[125440]: pgmap v12818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:38:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:07 smithi122 ceph-mon[125440]: osdmap e874: 12 total, 12 up, 12 in 2023-03-02T17:38:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:07.454+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:38:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:07.454+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:38:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:07.454+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:38:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:07.454+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:38:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:07.454+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:38:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:09 smithi136 ceph-mon[125702]: pgmap v12820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:38:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:09 smithi057 ceph-mon[92072]: pgmap v12820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:38:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:09 smithi122 ceph-mon[125440]: pgmap v12820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:38:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:11 smithi136 ceph-mon[125702]: pgmap v12821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:38:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:11 smithi057 ceph-mon[92072]: pgmap v12821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:38:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:11 smithi122 ceph-mon[125440]: pgmap v12821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:38:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:11.827+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:38:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:11.827+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:38:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:11.827+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 186 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:38:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:11.827+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 187 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:38:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:13 smithi136 ceph-mon[125702]: pgmap v12822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:38:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:13 smithi057 ceph-mon[92072]: pgmap v12822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:38:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:13 smithi122 ceph-mon[125440]: pgmap v12822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:38:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:15 smithi057 ceph-mon[92072]: pgmap v12823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:38:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:15 smithi122 ceph-mon[125440]: pgmap v12823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:38:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:15 smithi136 ceph-mon[125702]: pgmap v12823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:38:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:16 smithi136 ceph-mon[125702]: pgmap v12824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:38:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:16 smithi136 ceph-mon[125702]: osdmap e875: 12 total, 12 up, 12 in 2023-03-02T17:38:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:16 smithi057 ceph-mon[92072]: pgmap v12824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:38:17.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:16 smithi057 ceph-mon[92072]: osdmap e875: 12 total, 12 up, 12 in 2023-03-02T17:38:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:16 smithi122 ceph-mon[125440]: pgmap v12824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:38:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:16 smithi122 ceph-mon[125440]: osdmap e875: 12 total, 12 up, 12 in 2023-03-02T17:38:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:18 smithi057 ceph-mon[92072]: pgmap v12826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:38:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:18 smithi122 ceph-mon[125440]: pgmap v12826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:38:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:18 smithi136 ceph-mon[125702]: pgmap v12826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:38:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:20 smithi057 ceph-mon[92072]: pgmap v12827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:38:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:20 smithi122 ceph-mon[125440]: pgmap v12827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:38:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:20 smithi136 ceph-mon[125702]: pgmap v12827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:38:22.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:22.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:38:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:22.470+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:38:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:22.470+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:38:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:22.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:38:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:22.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:38:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:22 smithi057 ceph-mon[92072]: pgmap v12828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:38:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:22 smithi122 ceph-mon[125440]: pgmap v12828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:38:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:22 smithi136 ceph-mon[125702]: pgmap v12828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:38:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:24 smithi057 ceph-mon[92072]: pgmap v12829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:38:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:24 smithi122 ceph-mon[125440]: pgmap v12829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:38:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:24 smithi136 ceph-mon[125702]: pgmap v12829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:38:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:26 smithi057 ceph-mon[92072]: pgmap v12830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:38:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:26 smithi122 ceph-mon[125440]: pgmap v12830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:38:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:26 smithi136 ceph-mon[125702]: pgmap v12830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:38:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:28 smithi057 ceph-mon[92072]: pgmap v12831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:38:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:28 smithi122 ceph-mon[125440]: pgmap v12831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:38:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:28 smithi136 ceph-mon[125702]: pgmap v12831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:38:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:30 smithi057 ceph-mon[92072]: pgmap v12832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:30 smithi122 ceph-mon[125440]: pgmap v12832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:30 smithi136 ceph-mon[125702]: pgmap v12832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:32 smithi057 ceph-mon[92072]: pgmap v12833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:32 smithi122 ceph-mon[125440]: pgmap v12833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:32 smithi136 ceph-mon[125702]: pgmap v12833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:34 smithi057 ceph-mon[92072]: pgmap v12834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:34 smithi122 ceph-mon[125440]: pgmap v12834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:34 smithi136 ceph-mon[125702]: pgmap v12834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:36 smithi057 ceph-mon[92072]: pgmap v12835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:36 smithi122 ceph-mon[125440]: pgmap v12835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:36 smithi136 ceph-mon[125702]: pgmap v12835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:37.485+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:38:37.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:37.485+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:38:37.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:37.485+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:38:37.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:37.485+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:38:37.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:37.485+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:38:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:38 smithi057 ceph-mon[92072]: pgmap v12836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:38 smithi122 ceph-mon[125440]: pgmap v12836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:38 smithi136 ceph-mon[125702]: pgmap v12836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:40 smithi057 ceph-mon[92072]: pgmap v12837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:40 smithi122 ceph-mon[125440]: pgmap v12837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:40 smithi136 ceph-mon[125702]: pgmap v12837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:42 smithi057 ceph-mon[92072]: pgmap v12838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:38:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:42 smithi122 ceph-mon[125440]: pgmap v12838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:38:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:42 smithi136 ceph-mon[125702]: pgmap v12838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:38:45.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:44 smithi057 ceph-mon[92072]: pgmap v12839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:44 smithi122 ceph-mon[125440]: pgmap v12839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:44 smithi136 ceph-mon[125702]: pgmap v12839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.689 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.689 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.689 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.689 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.690 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.690 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.690 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:38:46.691 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:38:46.691 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:38:46.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:38:46.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:46.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:38:46.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:38:46.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:38:46.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:38:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:47 smithi136 ceph-mon[125702]: pgmap v12840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:47 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:38:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:47 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 12622k 2023-03-02T17:38:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:47 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:38:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:47 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:38:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:47 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 12925734: error parsing value: Value '12925734' is below minimum 939524096 2023-03-02T17:38:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:47 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:38:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:47 smithi057 ceph-mon[92072]: pgmap v12840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:47 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:38:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:47 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 12622k 2023-03-02T17:38:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:47 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:38:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:47 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:38:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:47 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 12925734: error parsing value: Value '12925734' is below minimum 939524096 2023-03-02T17:38:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:47 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:38:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:47 smithi122 ceph-mon[125440]: pgmap v12840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:47 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:38:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:47 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 12622k 2023-03-02T17:38:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:47 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:38:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:47 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:38:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:47 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 12925734: error parsing value: Value '12925734' is below minimum 939524096 2023-03-02T17:38:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:47 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:38:48.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:48 smithi136 ceph-mon[125702]: pgmap v12841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:48.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:48 smithi057 ceph-mon[92072]: pgmap v12841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:48 smithi122 ceph-mon[125440]: pgmap v12841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:50.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:50 smithi057 ceph-mon[92072]: pgmap v12842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:50 smithi122 ceph-mon[125440]: pgmap v12842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:50 smithi136 ceph-mon[125702]: pgmap v12842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:52.497+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:38:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:52.497+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:38:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:52.497+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:38:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:52.497+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:38:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:38:52.497+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:38:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:52 smithi057 ceph-mon[92072]: pgmap v12843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:52 smithi122 ceph-mon[125440]: pgmap v12843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:52 smithi136 ceph-mon[125702]: pgmap v12843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:55.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:54 smithi057 ceph-mon[92072]: pgmap v12844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:54 smithi122 ceph-mon[125440]: pgmap v12844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:55.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:54 smithi136 ceph-mon[125702]: pgmap v12844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:57.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:56 smithi057 ceph-mon[92072]: pgmap v12845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:57.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:56 smithi122 ceph-mon[125440]: pgmap v12845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:57.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:56 smithi136 ceph-mon[125702]: pgmap v12845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:38:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:38:58 smithi057 ceph-mon[92072]: pgmap v12846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:38:58 smithi122 ceph-mon[125440]: pgmap v12846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:38:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:38:58 smithi136 ceph-mon[125702]: pgmap v12846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:00 smithi057 ceph-mon[92072]: pgmap v12847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:00 smithi122 ceph-mon[125440]: pgmap v12847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:01.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:00 smithi136 ceph-mon[125702]: pgmap v12847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:03.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:02 smithi057 ceph-mon[92072]: pgmap v12848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:02 smithi122 ceph-mon[125440]: pgmap v12848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:02 smithi136 ceph-mon[125702]: pgmap v12848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:05.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:04 smithi057 ceph-mon[92072]: pgmap v12849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:39:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:04 smithi122 ceph-mon[125440]: pgmap v12849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:39:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:04 smithi136 ceph-mon[125702]: pgmap v12849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:39:07.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:06 smithi057 ceph-mon[92072]: pgmap v12850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:39:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:06 smithi122 ceph-mon[125440]: pgmap v12850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:39:07.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:06 smithi136 ceph-mon[125702]: pgmap v12850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:39:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:07.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:39:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:07.511+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:39:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:07.511+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:39:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:07.511+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:39:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:07.511+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:39:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:07 smithi057 ceph-mon[92072]: osdmap e876: 12 total, 12 up, 12 in 2023-03-02T17:39:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:07 smithi122 ceph-mon[125440]: osdmap e876: 12 total, 12 up, 12 in 2023-03-02T17:39:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:07 smithi136 ceph-mon[125702]: osdmap e876: 12 total, 12 up, 12 in 2023-03-02T17:39:09.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:08 smithi057 ceph-mon[92072]: pgmap v12852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:39:09.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:08 smithi122 ceph-mon[125440]: pgmap v12852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:39:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:08 smithi136 ceph-mon[125702]: pgmap v12852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:39:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:10 smithi057 ceph-mon[92072]: pgmap v12853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:39:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:10 smithi122 ceph-mon[125440]: pgmap v12853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:39:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:10 smithi136 ceph-mon[125702]: pgmap v12853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:39:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:12 smithi057 ceph-mon[92072]: pgmap v12854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:39:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:12 smithi122 ceph-mon[125440]: pgmap v12854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:39:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:12 smithi136 ceph-mon[125702]: pgmap v12854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:39:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:14 smithi057 ceph-mon[92072]: pgmap v12855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:39:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:14 smithi122 ceph-mon[125440]: pgmap v12855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:39:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:14 smithi136 ceph-mon[125702]: pgmap v12855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:39:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:16 smithi057 ceph-mon[92072]: pgmap v12856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:39:17.197 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:16 smithi057 ceph-mon[92072]: osdmap e877: 12 total, 12 up, 12 in 2023-03-02T17:39:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:16 smithi122 ceph-mon[125440]: pgmap v12856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:39:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:16 smithi122 ceph-mon[125440]: osdmap e877: 12 total, 12 up, 12 in 2023-03-02T17:39:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:16 smithi136 ceph-mon[125702]: pgmap v12856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:39:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:16 smithi136 ceph-mon[125702]: osdmap e877: 12 total, 12 up, 12 in 2023-03-02T17:39:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:18 smithi057 ceph-mon[92072]: pgmap v12858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:39:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:18 smithi122 ceph-mon[125440]: pgmap v12858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:39:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:18 smithi136 ceph-mon[125702]: pgmap v12858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:39:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:20 smithi057 ceph-mon[92072]: pgmap v12859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:39:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:20 smithi122 ceph-mon[125440]: pgmap v12859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:39:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:20 smithi136 ceph-mon[125702]: pgmap v12859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:39:22.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:22.526+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:39:22.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:22.527+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:39:22.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:22.527+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:39:22.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:22.527+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:39:22.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:22.527+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:39:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:22 smithi057 ceph-mon[92072]: pgmap v12860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:39:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:22 smithi122 ceph-mon[125440]: pgmap v12860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:39:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:22 smithi136 ceph-mon[125702]: pgmap v12860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:39:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:24 smithi057 ceph-mon[92072]: pgmap v12861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:39:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:24 smithi122 ceph-mon[125440]: pgmap v12861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:39:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:24 smithi136 ceph-mon[125702]: pgmap v12861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:39:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:26 smithi057 ceph-mon[92072]: pgmap v12862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:39:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:26 smithi122 ceph-mon[125440]: pgmap v12862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:39:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:26 smithi136 ceph-mon[125702]: pgmap v12862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:39:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:28 smithi057 ceph-mon[92072]: pgmap v12863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:39:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:28 smithi122 ceph-mon[125440]: pgmap v12863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:39:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:28 smithi136 ceph-mon[125702]: pgmap v12863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:39:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:30 smithi057 ceph-mon[92072]: pgmap v12864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:30 smithi122 ceph-mon[125440]: pgmap v12864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:31.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:30 smithi136 ceph-mon[125702]: pgmap v12864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:32 smithi057 ceph-mon[92072]: pgmap v12865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:32 smithi122 ceph-mon[125440]: pgmap v12865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:32 smithi136 ceph-mon[125702]: pgmap v12865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:34 smithi057 ceph-mon[92072]: pgmap v12866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:34 smithi122 ceph-mon[125440]: pgmap v12866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:35.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:34 smithi136 ceph-mon[125702]: pgmap v12866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:36 smithi057 ceph-mon[92072]: pgmap v12867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:36 smithi122 ceph-mon[125440]: pgmap v12867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:37.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:36 smithi136 ceph-mon[125702]: pgmap v12867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:37.540+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:39:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:37.540+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:39:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:37.540+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:39:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:37.540+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:39:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:37.540+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:39:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:38 smithi122 ceph-mon[125440]: pgmap v12868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:38 smithi136 ceph-mon[125702]: pgmap v12868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:38 smithi057 ceph-mon[92072]: pgmap v12868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:40 smithi122 ceph-mon[125440]: pgmap v12869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:40 smithi136 ceph-mon[125702]: pgmap v12869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:40 smithi057 ceph-mon[92072]: pgmap v12869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:42 smithi122 ceph-mon[125440]: pgmap v12870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:42 smithi136 ceph-mon[125702]: pgmap v12870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:42 smithi057 ceph-mon[92072]: pgmap v12870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:44 smithi136 ceph-mon[125702]: pgmap v12871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:44 smithi057 ceph-mon[92072]: pgmap v12871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:44 smithi122 ceph-mon[125440]: pgmap v12871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:46 smithi136 ceph-mon[125702]: pgmap v12872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:39:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:46 smithi057 ceph-mon[92072]: pgmap v12872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:39:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:46 smithi122 ceph-mon[125440]: pgmap v12872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:39:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:39:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:39:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:39:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:39:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:39:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:39:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:39:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:39:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:39:49.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:49 smithi136 ceph-mon[125702]: pgmap v12873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:49 smithi057 ceph-mon[92072]: pgmap v12873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:49 smithi122 ceph-mon[125440]: pgmap v12873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:51 smithi136 ceph-mon[125702]: pgmap v12874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:51 smithi057 ceph-mon[92072]: pgmap v12874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:51 smithi122 ceph-mon[125440]: pgmap v12874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:52.556+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:39:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:52.556+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:39:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:52.556+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:39:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:52.556+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:39:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:39:52.556+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:39:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:53 smithi136 ceph-mon[125702]: pgmap v12875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:53 smithi057 ceph-mon[92072]: pgmap v12875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:53 smithi122 ceph-mon[125440]: pgmap v12875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:55 smithi136 ceph-mon[125702]: pgmap v12876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:55 smithi057 ceph-mon[92072]: pgmap v12876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:55 smithi122 ceph-mon[125440]: pgmap v12876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:57 smithi136 ceph-mon[125702]: pgmap v12877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:57 smithi057 ceph-mon[92072]: pgmap v12877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:57 smithi122 ceph-mon[125440]: pgmap v12877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:39:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:39:59 smithi136 ceph-mon[125702]: pgmap v12878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:39:59 smithi057 ceph-mon[92072]: pgmap v12878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:39:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:39:59 smithi122 ceph-mon[125440]: pgmap v12878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T17:40:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T17:40:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T17:40:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:01 smithi057 ceph-mon[92072]: pgmap v12879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:01 smithi122 ceph-mon[125440]: pgmap v12879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:01 smithi136 ceph-mon[125702]: pgmap v12879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:03 smithi057 ceph-mon[92072]: pgmap v12880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:03 smithi122 ceph-mon[125440]: pgmap v12880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:03.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:03 smithi136 ceph-mon[125702]: pgmap v12880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:05 smithi057 ceph-mon[92072]: pgmap v12881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:40:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:05 smithi122 ceph-mon[125440]: pgmap v12881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:40:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:05 smithi136 ceph-mon[125702]: pgmap v12881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:40:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:07 smithi057 ceph-mon[92072]: pgmap v12882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:40:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:07 smithi057 ceph-mon[92072]: osdmap e878: 12 total, 12 up, 12 in 2023-03-02T17:40:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:07 smithi122 ceph-mon[125440]: pgmap v12882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:40:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:07 smithi122 ceph-mon[125440]: osdmap e878: 12 total, 12 up, 12 in 2023-03-02T17:40:07.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:07.568+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:40:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:07.569+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:40:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:07.569+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:40:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:07.569+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:40:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:07.569+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:40:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:07 smithi136 ceph-mon[125702]: pgmap v12882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:40:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:07 smithi136 ceph-mon[125702]: osdmap e878: 12 total, 12 up, 12 in 2023-03-02T17:40:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:09 smithi057 ceph-mon[92072]: pgmap v12884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:40:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:09 smithi122 ceph-mon[125440]: pgmap v12884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:40:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:09 smithi136 ceph-mon[125702]: pgmap v12884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:40:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:11 smithi057 ceph-mon[92072]: pgmap v12885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:40:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:11 smithi122 ceph-mon[125440]: pgmap v12885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:40:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:11 smithi136 ceph-mon[125702]: pgmap v12885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:40:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:13 smithi057 ceph-mon[92072]: pgmap v12886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:40:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:13 smithi122 ceph-mon[125440]: pgmap v12886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:40:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:13 smithi136 ceph-mon[125702]: pgmap v12886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:40:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:15 smithi057 ceph-mon[92072]: pgmap v12887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:40:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:15 smithi122 ceph-mon[125440]: pgmap v12887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:40:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:15 smithi136 ceph-mon[125702]: pgmap v12887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:40:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:16 smithi057 ceph-mon[92072]: pgmap v12888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:40:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:16 smithi057 ceph-mon[92072]: osdmap e879: 12 total, 12 up, 12 in 2023-03-02T17:40:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:16 smithi122 ceph-mon[125440]: pgmap v12888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:40:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:16 smithi122 ceph-mon[125440]: osdmap e879: 12 total, 12 up, 12 in 2023-03-02T17:40:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:16 smithi136 ceph-mon[125702]: pgmap v12888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:40:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:16 smithi136 ceph-mon[125702]: osdmap e879: 12 total, 12 up, 12 in 2023-03-02T17:40:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:18 smithi057 ceph-mon[92072]: pgmap v12890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:40:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:18 smithi122 ceph-mon[125440]: pgmap v12890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:40:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:18 smithi136 ceph-mon[125702]: pgmap v12890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:40:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:20 smithi057 ceph-mon[92072]: pgmap v12891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:40:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:20 smithi122 ceph-mon[125440]: pgmap v12891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:40:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:20 smithi136 ceph-mon[125702]: pgmap v12891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:40:22.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:22.581+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:40:22.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:22.582+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:40:22.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:22.582+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:40:22.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:22.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:40:22.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:22.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:40:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:22 smithi057 ceph-mon[92072]: pgmap v12892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:40:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:22 smithi122 ceph-mon[125440]: pgmap v12892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:40:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:22 smithi136 ceph-mon[125702]: pgmap v12892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:40:25.051 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:24 smithi136 ceph-mon[125702]: pgmap v12893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:40:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:24 smithi057 ceph-mon[92072]: pgmap v12893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:40:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:24 smithi122 ceph-mon[125440]: pgmap v12893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:40:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:26 smithi057 ceph-mon[92072]: pgmap v12894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:40:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:26 smithi122 ceph-mon[125440]: pgmap v12894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:40:27.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:26 smithi136 ceph-mon[125702]: pgmap v12894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:40:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:28 smithi057 ceph-mon[92072]: pgmap v12895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:40:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:28 smithi122 ceph-mon[125440]: pgmap v12895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:40:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:28 smithi136 ceph-mon[125702]: pgmap v12895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:40:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:30 smithi057 ceph-mon[92072]: pgmap v12896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:40:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:30 smithi122 ceph-mon[125440]: pgmap v12896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:40:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:30 smithi136 ceph-mon[125702]: pgmap v12896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:40:33.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:32 smithi057 ceph-mon[92072]: pgmap v12897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:40:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:32 smithi122 ceph-mon[125440]: pgmap v12897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:40:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:32 smithi136 ceph-mon[125702]: pgmap v12897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:40:35.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:34 smithi057 ceph-mon[92072]: pgmap v12898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:34 smithi122 ceph-mon[125440]: pgmap v12898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:34 smithi136 ceph-mon[125702]: pgmap v12898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:37.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:36 smithi057 ceph-mon[92072]: pgmap v12899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:40:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:36 smithi122 ceph-mon[125440]: pgmap v12899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:40:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:36 smithi136 ceph-mon[125702]: pgmap v12899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:40:37.595 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:37.595+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:40:37.596 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:37.595+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:40:37.596 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:37.595+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:40:37.596 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:37.595+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:40:37.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:37.595+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:40:39.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:38 smithi057 ceph-mon[92072]: pgmap v12900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:38 smithi122 ceph-mon[125440]: pgmap v12900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:39.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:38 smithi136 ceph-mon[125702]: pgmap v12900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:40 smithi057 ceph-mon[92072]: pgmap v12901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:40 smithi122 ceph-mon[125440]: pgmap v12901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:40 smithi136 ceph-mon[125702]: pgmap v12901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:43.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:42 smithi057 ceph-mon[92072]: pgmap v12902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:42 smithi122 ceph-mon[125440]: pgmap v12902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:42 smithi136 ceph-mon[125702]: pgmap v12902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:44 smithi122 ceph-mon[125440]: pgmap v12903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:44 smithi136 ceph-mon[125702]: pgmap v12903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:44 smithi057 ceph-mon[92072]: pgmap v12903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:47.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:46 smithi122 ceph-mon[125440]: pgmap v12904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:46 smithi136 ceph-mon[125702]: pgmap v12904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:46 smithi057 ceph-mon[92072]: pgmap v12904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:40:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:40:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:40:48.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:40:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:40:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:40:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:40:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:40:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:40:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:48 smithi122 ceph-mon[125440]: pgmap v12905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:40:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:40:49.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:40:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:48 smithi136 ceph-mon[125702]: pgmap v12905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:49.392 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:40:49.392 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:40:49.392 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:40:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:48 smithi057 ceph-mon[92072]: pgmap v12905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:40:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:40:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:40:50.147 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:49 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mon-b[125417]: problem writing to /var/log/ceph/ceph-mon.b.log: (28) No space left on device 2023-03-02T17:40:50.148 INFO:journalctl@ceph.osd.7.smithi122.stdout:Mar 02 17:40:49 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-7[141681]: problem writing to /var/log/ceph/ceph-osd.7.log: (28) No space left on device 2023-03-02T17:40:50.148 INFO:journalctl@ceph.osd.10.smithi122.stdout:Mar 02 17:40:49 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-10[147146]: problem writing to /var/log/ceph/ceph-osd.10.log: (28) No space left on device 2023-03-02T17:40:50.149 INFO:journalctl@ceph.mds.k.smithi122.stdout:Mar 02 17:40:49 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-k[149892]: problem writing to /var/log/ceph/ceph-mds.k.log: (28) No space left on device 2023-03-02T17:40:50.153 INFO:journalctl@ceph.mds.b.smithi122.stdout:Mar 02 17:40:50 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-b[154306]: problem writing to /var/log/ceph/ceph-mds.b.log: (28) No space left on device 2023-03-02T17:40:50.153 INFO:journalctl@ceph.osd.4.smithi122.stdout:Mar 02 17:40:49 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-4[136107]: problem writing to /var/log/ceph/ceph-osd.4.log: (28) No space left on device 2023-03-02T17:40:50.154 INFO:journalctl@ceph.osd.1.smithi122.stdout:Mar 02 17:40:49 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-osd-1[130537]: problem writing to /var/log/ceph/ceph-osd.1.log: (28) No space left on device 2023-03-02T17:40:50.451 INFO:journalctl@ceph.mds.h.smithi122.stdout:Mar 02 17:40:50 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-h[150587]: problem writing to /var/log/ceph/ceph-mds.h.log: (28) No space left on device 2023-03-02T17:40:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:50 smithi136 ceph-mon[125702]: pgmap v12906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:51.365 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:50 smithi122 ceph-mon[125440]: pgmap v12906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:50 smithi057 ceph-mon[92072]: pgmap v12906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:51.701 INFO:journalctl@ceph.mds.e.smithi122.stdout:Mar 02 17:40:51 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mds-e[150242]: problem writing to /var/log/ceph/ceph-mds.e.log: (28) No space left on device 2023-03-02T17:40:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:52.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:40:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:52.605+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:40:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:52.605+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:40:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:52.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:40:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:40:52.605+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:40:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:52 smithi136 ceph-mon[125702]: pgmap v12907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:52 smithi057 ceph-mon[92072]: pgmap v12907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:52 smithi122 ceph-mon[125440]: pgmap v12907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:54 smithi136 ceph-mon[125702]: pgmap v12908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:54 smithi057 ceph-mon[92072]: pgmap v12908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:54 smithi122 ceph-mon[125440]: pgmap v12908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:56 smithi136 ceph-mon[125702]: pgmap v12909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:56 smithi057 ceph-mon[92072]: pgmap v12909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:56 smithi122 ceph-mon[125440]: pgmap v12909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:40:58.951 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Mar 02 17:40:58 smithi122 ceph-886f029e-b8e7-11ed-9ae9-001a4aab830c-mgr-y[126895]: problem writing to /var/log/ceph/ceph-mgr.y.log: (28) No space left on device 2023-03-02T17:40:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:40:58 smithi136 ceph-mon[125702]: pgmap v12910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:40:58 smithi057 ceph-mon[92072]: pgmap v12910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:40:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:40:58 smithi122 ceph-mon[125440]: pgmap v12910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:00 smithi136 ceph-mon[125702]: pgmap v12911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:00 smithi057 ceph-mon[92072]: pgmap v12911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:00 smithi122 ceph-mon[125440]: pgmap v12911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:02 smithi136 ceph-mon[125702]: pgmap v12912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:02 smithi057 ceph-mon[92072]: pgmap v12912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:02 smithi122 ceph-mon[125440]: pgmap v12912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:04 smithi136 ceph-mon[125702]: pgmap v12913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:41:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:04 smithi057 ceph-mon[92072]: pgmap v12913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:41:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:04 smithi122 ceph-mon[125440]: pgmap v12913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:41:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:06 smithi136 ceph-mon[125702]: pgmap v12914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:41:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:06 smithi136 ceph-mon[125702]: osdmap e880: 12 total, 12 up, 12 in 2023-03-02T17:41:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:06 smithi057 ceph-mon[92072]: pgmap v12914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:41:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:06 smithi057 ceph-mon[92072]: osdmap e880: 12 total, 12 up, 12 in 2023-03-02T17:41:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:06 smithi122 ceph-mon[125440]: pgmap v12914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:41:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:06 smithi122 ceph-mon[125440]: osdmap e880: 12 total, 12 up, 12 in 2023-03-02T17:41:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:07.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:41:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:07.622+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:41:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:07.622+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:41:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:07.622+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:41:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:07.622+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:41:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:08 smithi136 ceph-mon[125702]: pgmap v12916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:41:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:08 smithi057 ceph-mon[92072]: pgmap v12916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:41:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:08 smithi122 ceph-mon[125440]: pgmap v12916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:41:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:10 smithi136 ceph-mon[125702]: pgmap v12917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:41:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:10 smithi057 ceph-mon[92072]: pgmap v12917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:41:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:10 smithi122 ceph-mon[125440]: pgmap v12917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:41:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:11.853+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:41:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:11.853+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:41:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:11.853+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 187 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:41:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:11.853+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 188 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:41:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:13 smithi136 ceph-mon[125702]: pgmap v12918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:41:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:13 smithi057 ceph-mon[92072]: pgmap v12918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:41:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:13 smithi122 ceph-mon[125440]: pgmap v12918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:41:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:15 smithi136 ceph-mon[125702]: pgmap v12919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:41:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:15 smithi057 ceph-mon[92072]: pgmap v12919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:41:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:15 smithi122 ceph-mon[125440]: pgmap v12919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:41:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:16 smithi057 ceph-mon[92072]: pgmap v12920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:41:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:16 smithi057 ceph-mon[92072]: osdmap e881: 12 total, 12 up, 12 in 2023-03-02T17:41:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:16 smithi122 ceph-mon[125440]: pgmap v12920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:41:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:16 smithi122 ceph-mon[125440]: osdmap e881: 12 total, 12 up, 12 in 2023-03-02T17:41:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:16 smithi136 ceph-mon[125702]: pgmap v12920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:41:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:16 smithi136 ceph-mon[125702]: osdmap e881: 12 total, 12 up, 12 in 2023-03-02T17:41:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:18 smithi057 ceph-mon[92072]: pgmap v12922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:41:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:18 smithi122 ceph-mon[125440]: pgmap v12922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:41:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:18 smithi136 ceph-mon[125702]: pgmap v12922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:41:21.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:20 smithi057 ceph-mon[92072]: pgmap v12923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:41:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:20 smithi122 ceph-mon[125440]: pgmap v12923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:41:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:20 smithi136 ceph-mon[125702]: pgmap v12923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:41:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:22.637+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:41:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:22.638+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:41:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:22.638+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:41:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:22.638+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:41:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:22.638+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:41:23.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:22 smithi057 ceph-mon[92072]: pgmap v12924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:41:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:22 smithi122 ceph-mon[125440]: pgmap v12924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:41:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:22 smithi136 ceph-mon[125702]: pgmap v12924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:41:25.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:24 smithi057 ceph-mon[92072]: pgmap v12925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:41:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:24 smithi122 ceph-mon[125440]: pgmap v12925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:41:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:24 smithi136 ceph-mon[125702]: pgmap v12925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:41:27.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:26 smithi057 ceph-mon[92072]: pgmap v12926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:41:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:26 smithi122 ceph-mon[125440]: pgmap v12926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:41:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:26 smithi136 ceph-mon[125702]: pgmap v12926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:41:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:28 smithi057 ceph-mon[92072]: pgmap v12927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:41:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:28 smithi122 ceph-mon[125440]: pgmap v12927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:41:29.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:28 smithi136 ceph-mon[125702]: pgmap v12927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:41:31.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:30 smithi057 ceph-mon[92072]: pgmap v12928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:30 smithi122 ceph-mon[125440]: pgmap v12928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:30 smithi136 ceph-mon[125702]: pgmap v12928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:32 smithi122 ceph-mon[125440]: pgmap v12929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:32 smithi136 ceph-mon[125702]: pgmap v12929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:32 smithi057 ceph-mon[92072]: pgmap v12929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:34 smithi122 ceph-mon[125440]: pgmap v12930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:34 smithi136 ceph-mon[125702]: pgmap v12930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:34 smithi057 ceph-mon[92072]: pgmap v12930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:36 smithi122 ceph-mon[125440]: pgmap v12931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:36 smithi136 ceph-mon[125702]: pgmap v12931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:36 smithi057 ceph-mon[92072]: pgmap v12931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:37.649+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:41:37.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:37.649+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:41:37.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:37.649+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:41:37.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:37.649+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:41:37.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:37.649+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:41:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:38 smithi122 ceph-mon[125440]: pgmap v12932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:38 smithi136 ceph-mon[125702]: pgmap v12932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:38 smithi057 ceph-mon[92072]: pgmap v12932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:40 smithi122 ceph-mon[125440]: pgmap v12933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:40 smithi136 ceph-mon[125702]: pgmap v12933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:40 smithi057 ceph-mon[92072]: pgmap v12933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:42 smithi136 ceph-mon[125702]: pgmap v12934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:42 smithi057 ceph-mon[92072]: pgmap v12934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:42 smithi122 ceph-mon[125440]: pgmap v12934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:44 smithi136 ceph-mon[125702]: pgmap v12935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:44 smithi057 ceph-mon[92072]: pgmap v12935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:44 smithi122 ceph-mon[125440]: pgmap v12935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:46 smithi136 ceph-mon[125702]: pgmap v12936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:46 smithi057 ceph-mon[92072]: pgmap v12936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:46 smithi122 ceph-mon[125440]: pgmap v12936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:48 smithi136 ceph-mon[125702]: pgmap v12937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:41:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:48 smithi057 ceph-mon[92072]: pgmap v12937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:41:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:48 smithi122 ceph-mon[125440]: pgmap v12937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:41:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:41:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:41:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:41:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:41:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:41:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:41:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:41:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:51 smithi136 ceph-mon[125702]: pgmap v12938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:51 smithi057 ceph-mon[92072]: pgmap v12938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:51 smithi122 ceph-mon[125440]: pgmap v12938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:52.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:41:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:52.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:41:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:52.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:41:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:52.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:41:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:41:52.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:41:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:53 smithi136 ceph-mon[125702]: pgmap v12939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:53 smithi057 ceph-mon[92072]: pgmap v12939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:53 smithi122 ceph-mon[125440]: pgmap v12939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:55 smithi136 ceph-mon[125702]: pgmap v12940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:55 smithi057 ceph-mon[92072]: pgmap v12940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:55 smithi122 ceph-mon[125440]: pgmap v12940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:57 smithi136 ceph-mon[125702]: pgmap v12941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:57 smithi057 ceph-mon[92072]: pgmap v12941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:57 smithi122 ceph-mon[125440]: pgmap v12941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:41:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:41:59 smithi136 ceph-mon[125702]: pgmap v12942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:41:59 smithi057 ceph-mon[92072]: pgmap v12942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:41:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:41:59 smithi122 ceph-mon[125440]: pgmap v12942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:42:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:01 smithi136 ceph-mon[125702]: pgmap v12943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:01 smithi057 ceph-mon[92072]: pgmap v12943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:01 smithi122 ceph-mon[125440]: pgmap v12943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:03 smithi136 ceph-mon[125702]: pgmap v12944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:03 smithi057 ceph-mon[92072]: pgmap v12944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:03 smithi122 ceph-mon[125440]: pgmap v12944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:05 smithi136 ceph-mon[125702]: pgmap v12945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:42:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:05 smithi057 ceph-mon[92072]: pgmap v12945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:42:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:05 smithi122 ceph-mon[125440]: pgmap v12945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:42:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:07 smithi136 ceph-mon[125702]: pgmap v12946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:42:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:07.666+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:42:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:07.666+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:42:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:07.666+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:42:07.668 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:07.666+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:42:07.668 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:07.666+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:42:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:07 smithi057 ceph-mon[92072]: pgmap v12946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:42:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:07 smithi122 ceph-mon[125440]: pgmap v12946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:42:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:09 smithi136 ceph-mon[125702]: pgmap v12947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:42:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:09 smithi057 ceph-mon[92072]: pgmap v12947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:42:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:09 smithi122 ceph-mon[125440]: pgmap v12947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:42:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:11 smithi136 ceph-mon[125702]: pgmap v12948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:42:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:11 smithi057 ceph-mon[92072]: pgmap v12948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:42:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:11 smithi122 ceph-mon[125440]: pgmap v12948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:42:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:12 smithi057 ceph-mon[92072]: pgmap v12949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:42:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:12 smithi057 ceph-mon[92072]: osdmap e882: 12 total, 12 up, 12 in 2023-03-02T17:42:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:12 smithi122 ceph-mon[125440]: pgmap v12949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:42:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:12 smithi122 ceph-mon[125440]: osdmap e882: 12 total, 12 up, 12 in 2023-03-02T17:42:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:12 smithi136 ceph-mon[125702]: pgmap v12949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:42:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:12 smithi136 ceph-mon[125702]: osdmap e882: 12 total, 12 up, 12 in 2023-03-02T17:42:15.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:14 smithi057 ceph-mon[92072]: pgmap v12951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:14 smithi122 ceph-mon[125440]: pgmap v12951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:14 smithi136 ceph-mon[125702]: pgmap v12951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:17.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:16 smithi057 ceph-mon[92072]: pgmap v12952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:17.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:16 smithi122 ceph-mon[125440]: pgmap v12952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:17.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:16 smithi136 ceph-mon[125702]: pgmap v12952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:18 smithi057 ceph-mon[92072]: pgmap v12953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:42:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:18 smithi122 ceph-mon[125440]: pgmap v12953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:42:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:18 smithi136 ceph-mon[125702]: pgmap v12953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:42:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:20 smithi122 ceph-mon[125440]: pgmap v12954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:42:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:20 smithi122 ceph-mon[125440]: osdmap e883: 12 total, 12 up, 12 in 2023-03-02T17:42:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:20 smithi136 ceph-mon[125702]: pgmap v12954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:42:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:20 smithi136 ceph-mon[125702]: osdmap e883: 12 total, 12 up, 12 in 2023-03-02T17:42:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:20 smithi057 ceph-mon[92072]: pgmap v12954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:42:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:20 smithi057 ceph-mon[92072]: osdmap e883: 12 total, 12 up, 12 in 2023-03-02T17:42:22.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:22.682+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:42:22.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:22.682+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:42:22.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:22.682+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:42:22.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:22.682+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:42:22.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:22.682+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:42:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:22 smithi122 ceph-mon[125440]: pgmap v12956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 210 B/s wr, 6 op/s 2023-03-02T17:42:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:22 smithi136 ceph-mon[125702]: pgmap v12956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 210 B/s wr, 6 op/s 2023-03-02T17:42:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:22 smithi057 ceph-mon[92072]: pgmap v12956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 210 B/s wr, 6 op/s 2023-03-02T17:42:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:24 smithi122 ceph-mon[125440]: pgmap v12957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:24 smithi136 ceph-mon[125702]: pgmap v12957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:24 smithi057 ceph-mon[92072]: pgmap v12957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:26 smithi122 ceph-mon[125440]: pgmap v12958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:26 smithi136 ceph-mon[125702]: pgmap v12958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:26 smithi057 ceph-mon[92072]: pgmap v12958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:42:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:28 smithi136 ceph-mon[125702]: pgmap v12959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:42:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:28 smithi057 ceph-mon[92072]: pgmap v12959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:42:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:28 smithi122 ceph-mon[125440]: pgmap v12959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:42:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:30 smithi136 ceph-mon[125702]: pgmap v12960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:42:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:30 smithi057 ceph-mon[92072]: pgmap v12960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:42:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:30 smithi122 ceph-mon[125440]: pgmap v12960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:42:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:32 smithi136 ceph-mon[125702]: pgmap v12961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:42:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:32 smithi057 ceph-mon[92072]: pgmap v12961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:42:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:32 smithi122 ceph-mon[125440]: pgmap v12961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:42:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:34 smithi136 ceph-mon[125702]: pgmap v12962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:42:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:34 smithi057 ceph-mon[92072]: pgmap v12962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:42:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:34 smithi122 ceph-mon[125440]: pgmap v12962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:42:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:36 smithi136 ceph-mon[125702]: pgmap v12963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:36 smithi057 ceph-mon[92072]: pgmap v12963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:36 smithi122 ceph-mon[125440]: pgmap v12963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:37.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:37.696+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:42:37.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:37.696+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:42:37.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:37.696+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:42:37.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:37.696+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:42:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:37.696+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:42:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:38 smithi136 ceph-mon[125702]: pgmap v12964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:42:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:38 smithi057 ceph-mon[92072]: pgmap v12964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:42:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:38 smithi122 ceph-mon[125440]: pgmap v12964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:42:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:40 smithi136 ceph-mon[125702]: pgmap v12965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:40 smithi057 ceph-mon[92072]: pgmap v12965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:40 smithi122 ceph-mon[125440]: pgmap v12965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:42 smithi136 ceph-mon[125702]: pgmap v12966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:42:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:42 smithi057 ceph-mon[92072]: pgmap v12966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:42:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:42 smithi122 ceph-mon[125440]: pgmap v12966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:42:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:44 smithi136 ceph-mon[125702]: pgmap v12967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:42:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:44 smithi057 ceph-mon[92072]: pgmap v12967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:42:45.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:44 smithi122 ceph-mon[125440]: pgmap v12967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:42:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:46 smithi136 ceph-mon[125702]: pgmap v12968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:46 smithi057 ceph-mon[92072]: pgmap v12968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:46 smithi122 ceph-mon[125440]: pgmap v12968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:49 smithi136 ceph-mon[125702]: pgmap v12969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:42:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:49 smithi057 ceph-mon[92072]: pgmap v12969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:42:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:49 smithi122 ceph-mon[125440]: pgmap v12969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:42:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:51 smithi136 ceph-mon[125702]: pgmap v12970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:42:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:42:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:42:51.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:42:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:51 smithi057 ceph-mon[92072]: pgmap v12970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:42:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:42:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:42:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:42:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:51 smithi122 ceph-mon[125440]: pgmap v12970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:42:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:42:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:42:51.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:42:52.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:52.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:42:52.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:52.711+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:42:52.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:52.711+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:42:52.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:52.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:42:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:42:52.711+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:42:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:53 smithi136 ceph-mon[125702]: pgmap v12971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:42:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:53 smithi057 ceph-mon[92072]: pgmap v12971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:42:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:53 smithi122 ceph-mon[125440]: pgmap v12971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:42:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:55 smithi136 ceph-mon[125702]: pgmap v12972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:42:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:55 smithi057 ceph-mon[92072]: pgmap v12972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:42:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:55 smithi122 ceph-mon[125440]: pgmap v12972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:42:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:57 smithi136 ceph-mon[125702]: pgmap v12973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:57 smithi057 ceph-mon[92072]: pgmap v12973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:57 smithi122 ceph-mon[125440]: pgmap v12973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:42:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:42:59 smithi136 ceph-mon[125702]: pgmap v12974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:42:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:42:59 smithi057 ceph-mon[92072]: pgmap v12974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:42:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:42:59 smithi122 ceph-mon[125440]: pgmap v12974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:43:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:01 smithi136 ceph-mon[125702]: pgmap v12975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:01 smithi057 ceph-mon[92072]: pgmap v12975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:01 smithi122 ceph-mon[125440]: pgmap v12975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:03 smithi136 ceph-mon[125702]: pgmap v12976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:43:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:03 smithi057 ceph-mon[92072]: pgmap v12976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:43:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:03 smithi122 ceph-mon[125440]: pgmap v12976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:43:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:05 smithi136 ceph-mon[125702]: pgmap v12977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:43:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:05 smithi057 ceph-mon[92072]: pgmap v12977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:43:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:05 smithi122 ceph-mon[125440]: pgmap v12977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:43:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:07 smithi136 ceph-mon[125702]: pgmap v12978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:43:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:07 smithi057 ceph-mon[92072]: pgmap v12978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:43:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:07 smithi122 ceph-mon[125440]: pgmap v12978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:43:07.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:07.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:43:07.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:07.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:43:07.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:07.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:43:07.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:07.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:43:07.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:07.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:43:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:09 smithi136 ceph-mon[125702]: pgmap v12979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:43:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:09 smithi057 ceph-mon[92072]: pgmap v12979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:43:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:09 smithi122 ceph-mon[125440]: pgmap v12979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:43:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:11 smithi136 ceph-mon[125702]: pgmap v12980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:43:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:11 smithi057 ceph-mon[92072]: pgmap v12980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:43:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:11 smithi122 ceph-mon[125440]: pgmap v12980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:43:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:12 smithi136 ceph-mon[125702]: osdmap e884: 12 total, 12 up, 12 in 2023-03-02T17:43:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:12 smithi057 ceph-mon[92072]: osdmap e884: 12 total, 12 up, 12 in 2023-03-02T17:43:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:12 smithi122 ceph-mon[125440]: osdmap e884: 12 total, 12 up, 12 in 2023-03-02T17:43:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:13 smithi136 ceph-mon[125702]: pgmap v12982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:43:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:13 smithi057 ceph-mon[92072]: pgmap v12982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:43:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:13 smithi122 ceph-mon[125440]: pgmap v12982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:43:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:15 smithi136 ceph-mon[125702]: pgmap v12983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:15 smithi057 ceph-mon[92072]: pgmap v12983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:15 smithi122 ceph-mon[125440]: pgmap v12983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:17 smithi136 ceph-mon[125702]: pgmap v12984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:17 smithi057 ceph-mon[92072]: pgmap v12984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:17 smithi122 ceph-mon[125440]: pgmap v12984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:19 smithi057 ceph-mon[92072]: pgmap v12985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:19 smithi122 ceph-mon[125440]: pgmap v12985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:19 smithi136 ceph-mon[125702]: pgmap v12985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:21 smithi057 ceph-mon[92072]: pgmap v12986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:21 smithi057 ceph-mon[92072]: osdmap e885: 12 total, 12 up, 12 in 2023-03-02T17:43:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:21 smithi122 ceph-mon[125440]: pgmap v12986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:21 smithi122 ceph-mon[125440]: osdmap e885: 12 total, 12 up, 12 in 2023-03-02T17:43:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:21 smithi136 ceph-mon[125702]: pgmap v12986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:43:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:21 smithi136 ceph-mon[125702]: osdmap e885: 12 total, 12 up, 12 in 2023-03-02T17:43:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:22.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:43:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:22.743+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:43:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:22.743+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:43:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:22.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:43:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:22.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:43:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:23 smithi057 ceph-mon[92072]: pgmap v12988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:43:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:23 smithi122 ceph-mon[125440]: pgmap v12988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:43:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:23 smithi136 ceph-mon[125702]: pgmap v12988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:43:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:25 smithi057 ceph-mon[92072]: pgmap v12989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:43:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:25 smithi122 ceph-mon[125440]: pgmap v12989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:43:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:25 smithi136 ceph-mon[125702]: pgmap v12989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:43:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:26.872+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:43:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:26.872+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:43:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:26.873+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 188 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:43:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:26.873+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 189 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:43:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:27 smithi057 ceph-mon[92072]: pgmap v12990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:43:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:27 smithi122 ceph-mon[125440]: pgmap v12990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:43:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:27 smithi136 ceph-mon[125702]: pgmap v12990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:43:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:29 smithi057 ceph-mon[92072]: pgmap v12991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:43:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:29 smithi122 ceph-mon[125440]: pgmap v12991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:43:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:29 smithi136 ceph-mon[125702]: pgmap v12991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:43:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:31 smithi057 ceph-mon[92072]: pgmap v12992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:43:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:31 smithi122 ceph-mon[125440]: pgmap v12992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:43:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:31 smithi136 ceph-mon[125702]: pgmap v12992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:43:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:33 smithi057 ceph-mon[92072]: pgmap v12993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 op/s 2023-03-02T17:43:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:33 smithi122 ceph-mon[125440]: pgmap v12993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 op/s 2023-03-02T17:43:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:33 smithi136 ceph-mon[125702]: pgmap v12993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 op/s 2023-03-02T17:43:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:35 smithi057 ceph-mon[92072]: pgmap v12994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:43:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:35 smithi122 ceph-mon[125440]: pgmap v12994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:43:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:35 smithi136 ceph-mon[125702]: pgmap v12994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:43:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:37 smithi057 ceph-mon[92072]: pgmap v12995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:37 smithi122 ceph-mon[125440]: pgmap v12995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:37 smithi136 ceph-mon[125702]: pgmap v12995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:37.752+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:43:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:37.753+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:43:37.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:37.753+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:43:37.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:37.753+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:43:37.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:37.753+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:43:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:39 smithi057 ceph-mon[92072]: pgmap v12996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:43:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:39 smithi122 ceph-mon[125440]: pgmap v12996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:43:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:39 smithi136 ceph-mon[125702]: pgmap v12996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:43:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:41 smithi057 ceph-mon[92072]: pgmap v12997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:41 smithi122 ceph-mon[125440]: pgmap v12997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:41 smithi136 ceph-mon[125702]: pgmap v12997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:43 smithi057 ceph-mon[92072]: pgmap v12998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:43:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:43 smithi122 ceph-mon[125440]: pgmap v12998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:43:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:43 smithi136 ceph-mon[125702]: pgmap v12998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:43:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:45 smithi057 ceph-mon[92072]: pgmap v12999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:43:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:45 smithi122 ceph-mon[125440]: pgmap v12999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:43:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:45 smithi136 ceph-mon[125702]: pgmap v12999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:43:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:47 smithi057 ceph-mon[92072]: pgmap v13000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:47 smithi122 ceph-mon[125440]: pgmap v13000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:47 smithi136 ceph-mon[125702]: pgmap v13000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:49 smithi057 ceph-mon[92072]: pgmap v13001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:43:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:49 smithi122 ceph-mon[125440]: pgmap v13001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:43:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:49 smithi136 ceph-mon[125702]: pgmap v13001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:43:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:51 smithi057 ceph-mon[92072]: pgmap v13002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:43:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:51 smithi122 ceph-mon[125440]: pgmap v13002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:43:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:51 smithi136 ceph-mon[125702]: pgmap v13002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:43:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:43:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:43:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:43:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:43:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:43:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:43:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:43:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:43:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:43:52.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:52.759+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:43:52.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:52.759+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:43:52.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:52.759+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:43:52.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:52.759+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:43:52.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:43:52.759+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:43:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:53 smithi122 ceph-mon[125440]: pgmap v13003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:43:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:53 smithi136 ceph-mon[125702]: pgmap v13003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:43:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:53 smithi057 ceph-mon[92072]: pgmap v13003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:43:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:55 smithi122 ceph-mon[125440]: pgmap v13004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:43:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:55 smithi136 ceph-mon[125702]: pgmap v13004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:43:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:55 smithi057 ceph-mon[92072]: pgmap v13004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:43:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:57 smithi122 ceph-mon[125440]: pgmap v13005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:57 smithi136 ceph-mon[125702]: pgmap v13005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:57 smithi057 ceph-mon[92072]: pgmap v13005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:43:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:43:59 smithi136 ceph-mon[125702]: pgmap v13006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:43:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:43:59 smithi057 ceph-mon[92072]: pgmap v13006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:43:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:43:59 smithi122 ceph-mon[125440]: pgmap v13006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:44:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:01 smithi136 ceph-mon[125702]: pgmap v13007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:01 smithi057 ceph-mon[92072]: pgmap v13007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:01 smithi122 ceph-mon[125440]: pgmap v13007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:03 smithi136 ceph-mon[125702]: pgmap v13008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:44:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:03 smithi057 ceph-mon[92072]: pgmap v13008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:44:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:03 smithi122 ceph-mon[125440]: pgmap v13008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:44:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:05 smithi136 ceph-mon[125702]: pgmap v13009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:44:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:05 smithi057 ceph-mon[92072]: pgmap v13009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:44:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:05 smithi122 ceph-mon[125440]: pgmap v13009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:44:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:07 smithi136 ceph-mon[125702]: pgmap v13010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:44:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:07 smithi136 ceph-mon[125702]: osdmap e886: 12 total, 12 up, 12 in 2023-03-02T17:44:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:07 smithi057 ceph-mon[92072]: pgmap v13010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:44:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:07 smithi057 ceph-mon[92072]: osdmap e886: 12 total, 12 up, 12 in 2023-03-02T17:44:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:07 smithi122 ceph-mon[125440]: pgmap v13010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:44:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:07 smithi122 ceph-mon[125440]: osdmap e886: 12 total, 12 up, 12 in 2023-03-02T17:44:07.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:07.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:44:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:07.774+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:44:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:07.774+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:44:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:07.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:44:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:07.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:44:08.420 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:08.419+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T17:44:08.420 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:08.419+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T17:44:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:08.419+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f58500047b0 tx=0x7f5870063000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:44:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:08.419+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f58500047b0 tx=0x7f5870063000 comp rx=0 tx=0).stop 2023-03-02T17:44:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:08.419+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T17:44:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:08.419+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T17:44:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:08.419+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T17:44:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:08.419+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T17:44:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:08.419+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:44:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:08.419+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5850005b30 tx=0x7f58700b1000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T17:44:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:09 smithi136 ceph-mon[125702]: pgmap v13012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:44:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:09 smithi057 ceph-mon[92072]: pgmap v13012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:44:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:09 smithi122 ceph-mon[125440]: pgmap v13012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:44:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:11 smithi136 ceph-mon[125702]: pgmap v13013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:44:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:11 smithi057 ceph-mon[92072]: pgmap v13013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:44:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:11 smithi122 ceph-mon[125440]: pgmap v13013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:44:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:11.879+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:44:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:11.879+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:44:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:11.879+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 190 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:44:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:11.879+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 189 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:44:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:13 smithi136 ceph-mon[125702]: pgmap v13014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:44:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:13 smithi057 ceph-mon[92072]: pgmap v13014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:44:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:13 smithi122 ceph-mon[125440]: pgmap v13014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:44:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:15 smithi136 ceph-mon[125702]: pgmap v13015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:44:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:15 smithi057 ceph-mon[92072]: pgmap v13015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:44:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:15 smithi122 ceph-mon[125440]: pgmap v13015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:44:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:16 smithi122 ceph-mon[125440]: pgmap v13016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:44:17.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:16 smithi122 ceph-mon[125440]: osdmap e887: 12 total, 12 up, 12 in 2023-03-02T17:44:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:16 smithi136 ceph-mon[125702]: pgmap v13016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:44:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:16 smithi136 ceph-mon[125702]: osdmap e887: 12 total, 12 up, 12 in 2023-03-02T17:44:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:16 smithi057 ceph-mon[92072]: pgmap v13016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:44:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:16 smithi057 ceph-mon[92072]: osdmap e887: 12 total, 12 up, 12 in 2023-03-02T17:44:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:18 smithi122 ceph-mon[125440]: pgmap v13018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:44:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:18 smithi136 ceph-mon[125702]: pgmap v13018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:44:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:18 smithi057 ceph-mon[92072]: pgmap v13018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:44:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:20 smithi122 ceph-mon[125440]: pgmap v13019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:44:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:20 smithi136 ceph-mon[125702]: pgmap v13019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:44:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:20 smithi057 ceph-mon[92072]: pgmap v13019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:44:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:22.787+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:44:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:22.788+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:44:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:22.788+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:44:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:22.788+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:44:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:22.788+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:44:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:22 smithi136 ceph-mon[125702]: pgmap v13020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:44:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:22 smithi057 ceph-mon[92072]: pgmap v13020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:44:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:22 smithi122 ceph-mon[125440]: pgmap v13020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:44:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:24 smithi136 ceph-mon[125702]: pgmap v13021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:44:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:24 smithi057 ceph-mon[92072]: pgmap v13021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:44:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:24 smithi122 ceph-mon[125440]: pgmap v13021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:44:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:26 smithi136 ceph-mon[125702]: pgmap v13022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:44:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:26 smithi057 ceph-mon[92072]: pgmap v13022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:44:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:26 smithi122 ceph-mon[125440]: pgmap v13022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:44:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:28 smithi136 ceph-mon[125702]: pgmap v13023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:44:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:28 smithi057 ceph-mon[92072]: pgmap v13023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:44:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:28 smithi122 ceph-mon[125440]: pgmap v13023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:44:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:30 smithi136 ceph-mon[125702]: pgmap v13024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:30 smithi057 ceph-mon[92072]: pgmap v13024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:30 smithi122 ceph-mon[125440]: pgmap v13024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:32 smithi136 ceph-mon[125702]: pgmap v13025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:44:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:32 smithi057 ceph-mon[92072]: pgmap v13025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:44:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:32 smithi122 ceph-mon[125440]: pgmap v13025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:44:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:34 smithi136 ceph-mon[125702]: pgmap v13026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:44:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:34 smithi057 ceph-mon[92072]: pgmap v13026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:44:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:34 smithi122 ceph-mon[125440]: pgmap v13026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:44:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:36 smithi136 ceph-mon[125702]: pgmap v13027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:36 smithi057 ceph-mon[92072]: pgmap v13027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:36 smithi122 ceph-mon[125440]: pgmap v13027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:37.799+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:44:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:37.799+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:44:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:37.799+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:44:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:37.799+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:44:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:37.799+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:44:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:39 smithi136 ceph-mon[125702]: pgmap v13028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:44:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:39 smithi057 ceph-mon[92072]: pgmap v13028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:44:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:39 smithi122 ceph-mon[125440]: pgmap v13028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:44:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:41 smithi136 ceph-mon[125702]: pgmap v13029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:41 smithi057 ceph-mon[92072]: pgmap v13029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:41 smithi122 ceph-mon[125440]: pgmap v13029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:43 smithi136 ceph-mon[125702]: pgmap v13030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:44:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:43 smithi057 ceph-mon[92072]: pgmap v13030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:44:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:43 smithi122 ceph-mon[125440]: pgmap v13030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:44:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:45 smithi136 ceph-mon[125702]: pgmap v13031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:44:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:45 smithi057 ceph-mon[92072]: pgmap v13031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:44:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:45 smithi122 ceph-mon[125440]: pgmap v13031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:44:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:47 smithi136 ceph-mon[125702]: pgmap v13032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:47 smithi057 ceph-mon[92072]: pgmap v13032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:47 smithi122 ceph-mon[125440]: pgmap v13032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:49 smithi136 ceph-mon[125702]: pgmap v13033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:44:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:49 smithi057 ceph-mon[92072]: pgmap v13033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:44:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:49 smithi122 ceph-mon[125440]: pgmap v13033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:44:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:51 smithi136 ceph-mon[125702]: pgmap v13034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:51 smithi057 ceph-mon[92072]: pgmap v13034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:51 smithi122 ceph-mon[125440]: pgmap v13034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:44:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:44:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:44:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:52.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:44:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:52.804+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:44:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:52.804+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:44:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:52.804+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:44:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:44:52.804+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:44:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:53 smithi136 ceph-mon[125702]: pgmap v13035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:44:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:44:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:44:53.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:44:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:53 smithi057 ceph-mon[92072]: pgmap v13035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:44:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:44:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:44:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:44:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:53 smithi122 ceph-mon[125440]: pgmap v13035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:44:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:44:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:44:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:44:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:55 smithi136 ceph-mon[125702]: pgmap v13036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:44:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:55 smithi057 ceph-mon[92072]: pgmap v13036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:44:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:55 smithi122 ceph-mon[125440]: pgmap v13036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:44:57.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:57 smithi136 ceph-mon[125702]: pgmap v13037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:57 smithi057 ceph-mon[92072]: pgmap v13037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:57 smithi122 ceph-mon[125440]: pgmap v13037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:44:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:44:59 smithi136 ceph-mon[125702]: pgmap v13038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:44:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:44:59 smithi057 ceph-mon[92072]: pgmap v13038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:44:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:44:59 smithi122 ceph-mon[125440]: pgmap v13038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:45:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:01 smithi136 ceph-mon[125702]: pgmap v13039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:01 smithi057 ceph-mon[92072]: pgmap v13039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:01 smithi122 ceph-mon[125440]: pgmap v13039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:03 smithi136 ceph-mon[125702]: pgmap v13040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:45:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:03 smithi057 ceph-mon[92072]: pgmap v13040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:45:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:03 smithi122 ceph-mon[125440]: pgmap v13040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:45:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:05 smithi136 ceph-mon[125702]: pgmap v13041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:45:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:05 smithi057 ceph-mon[92072]: pgmap v13041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:45:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:05 smithi122 ceph-mon[125440]: pgmap v13041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:45:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:07 smithi136 ceph-mon[125702]: pgmap v13042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:45:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:07 smithi136 ceph-mon[125702]: osdmap e888: 12 total, 12 up, 12 in 2023-03-02T17:45:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:07 smithi057 ceph-mon[92072]: pgmap v13042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:45:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:07 smithi057 ceph-mon[92072]: osdmap e888: 12 total, 12 up, 12 in 2023-03-02T17:45:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:07 smithi122 ceph-mon[125440]: pgmap v13042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:45:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:07 smithi122 ceph-mon[125440]: osdmap e888: 12 total, 12 up, 12 in 2023-03-02T17:45:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:07.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:45:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:07.818+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:45:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:07.818+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:45:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:07.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:45:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:07.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:45:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:09 smithi136 ceph-mon[125702]: pgmap v13044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:45:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:09 smithi057 ceph-mon[92072]: pgmap v13044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:45:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:09 smithi122 ceph-mon[125440]: pgmap v13044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:45:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:11 smithi136 ceph-mon[125702]: pgmap v13045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:45:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:11 smithi057 ceph-mon[92072]: pgmap v13045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:45:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:11 smithi122 ceph-mon[125440]: pgmap v13045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:45:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:13 smithi136 ceph-mon[125702]: pgmap v13046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:45:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:13 smithi057 ceph-mon[92072]: pgmap v13046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:45:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:13 smithi122 ceph-mon[125440]: pgmap v13046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:45:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:15 smithi136 ceph-mon[125702]: pgmap v13047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:45:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:15 smithi057 ceph-mon[92072]: pgmap v13047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:45:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:15 smithi122 ceph-mon[125440]: pgmap v13047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:45:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:16 smithi136 ceph-mon[125702]: pgmap v13048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:45:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:16 smithi136 ceph-mon[125702]: osdmap e889: 12 total, 12 up, 12 in 2023-03-02T17:45:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:16 smithi057 ceph-mon[92072]: pgmap v13048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:45:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:16 smithi057 ceph-mon[92072]: osdmap e889: 12 total, 12 up, 12 in 2023-03-02T17:45:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:16 smithi122 ceph-mon[125440]: pgmap v13048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:45:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:16 smithi122 ceph-mon[125440]: osdmap e889: 12 total, 12 up, 12 in 2023-03-02T17:45:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:18 smithi136 ceph-mon[125702]: pgmap v13050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:45:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:18 smithi057 ceph-mon[92072]: pgmap v13050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:45:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:18 smithi122 ceph-mon[125440]: pgmap v13050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:45:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:20 smithi136 ceph-mon[125702]: pgmap v13051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:45:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:20 smithi057 ceph-mon[92072]: pgmap v13051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:45:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:20 smithi122 ceph-mon[125440]: pgmap v13051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:45:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:22.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:45:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:22.833+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:45:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:22.833+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:45:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:22.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:45:22.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:22.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:45:23.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:22 smithi136 ceph-mon[125702]: pgmap v13052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:45:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:22 smithi057 ceph-mon[92072]: pgmap v13052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:45:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:22 smithi122 ceph-mon[125440]: pgmap v13052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:45:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:24 smithi136 ceph-mon[125702]: pgmap v13053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:45:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:24 smithi057 ceph-mon[92072]: pgmap v13053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:45:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:24 smithi122 ceph-mon[125440]: pgmap v13053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:45:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:26 smithi136 ceph-mon[125702]: pgmap v13054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:45:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:26 smithi057 ceph-mon[92072]: pgmap v13054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:45:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:26 smithi122 ceph-mon[125440]: pgmap v13054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:45:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:28 smithi136 ceph-mon[125702]: pgmap v13055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:45:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:28 smithi057 ceph-mon[92072]: pgmap v13055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:45:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:28 smithi122 ceph-mon[125440]: pgmap v13055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:45:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:30 smithi136 ceph-mon[125702]: pgmap v13056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:30 smithi057 ceph-mon[92072]: pgmap v13056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:30 smithi122 ceph-mon[125440]: pgmap v13056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:33 smithi136 ceph-mon[125702]: pgmap v13057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:45:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:33 smithi057 ceph-mon[92072]: pgmap v13057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:45:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:33 smithi122 ceph-mon[125440]: pgmap v13057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:45:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:35 smithi136 ceph-mon[125702]: pgmap v13058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:45:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:35 smithi057 ceph-mon[92072]: pgmap v13058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:45:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:35 smithi122 ceph-mon[125440]: pgmap v13058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:45:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:37 smithi136 ceph-mon[125702]: pgmap v13059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:37 smithi057 ceph-mon[92072]: pgmap v13059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:37 smithi122 ceph-mon[125440]: pgmap v13059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:37.850+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:45:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:37.850+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:45:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:37.850+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:45:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:37.850+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:45:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:37.850+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:45:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:39 smithi136 ceph-mon[125702]: pgmap v13060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:45:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:39 smithi057 ceph-mon[92072]: pgmap v13060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:45:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:39 smithi122 ceph-mon[125440]: pgmap v13060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:45:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:41 smithi136 ceph-mon[125702]: pgmap v13061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:41 smithi057 ceph-mon[92072]: pgmap v13061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:41 smithi122 ceph-mon[125440]: pgmap v13061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:43 smithi136 ceph-mon[125702]: pgmap v13062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:45:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:43 smithi057 ceph-mon[92072]: pgmap v13062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:45:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:43 smithi122 ceph-mon[125440]: pgmap v13062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:45:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:45 smithi136 ceph-mon[125702]: pgmap v13063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:45:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:45 smithi057 ceph-mon[92072]: pgmap v13063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:45:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:45 smithi122 ceph-mon[125440]: pgmap v13063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:45:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:47 smithi136 ceph-mon[125702]: pgmap v13064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:47 smithi057 ceph-mon[92072]: pgmap v13064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:47 smithi122 ceph-mon[125440]: pgmap v13064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:49 smithi136 ceph-mon[125702]: pgmap v13065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:45:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:49 smithi057 ceph-mon[92072]: pgmap v13065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:45:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:49 smithi122 ceph-mon[125440]: pgmap v13065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:45:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:51 smithi136 ceph-mon[125702]: pgmap v13066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:51 smithi057 ceph-mon[92072]: pgmap v13066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:51 smithi122 ceph-mon[125440]: pgmap v13066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:52.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:45:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:52.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:45:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:52.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:45:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:52.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:45:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:45:52.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:45:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:53 smithi136 ceph-mon[125702]: pgmap v13067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:45:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:45:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:53 smithi057 ceph-mon[92072]: pgmap v13067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:45:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:45:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:53 smithi122 ceph-mon[125440]: pgmap v13067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:45:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:45:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:45:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:45:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:45:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:45:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:45:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:45:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:45:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:45:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:45:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:55 smithi057 ceph-mon[92072]: pgmap v13068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:45:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:55 smithi122 ceph-mon[125440]: pgmap v13068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:45:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:55 smithi136 ceph-mon[125702]: pgmap v13068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:45:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:57 smithi057 ceph-mon[92072]: pgmap v13069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:57 smithi122 ceph-mon[125440]: pgmap v13069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:57 smithi136 ceph-mon[125702]: pgmap v13069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:45:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:45:59 smithi122 ceph-mon[125440]: pgmap v13070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:45:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:45:59 smithi136 ceph-mon[125702]: pgmap v13070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:45:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:45:59 smithi057 ceph-mon[92072]: pgmap v13070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:46:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:01 smithi122 ceph-mon[125440]: pgmap v13071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:01 smithi136 ceph-mon[125702]: pgmap v13071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:01 smithi057 ceph-mon[92072]: pgmap v13071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:03 smithi122 ceph-mon[125440]: pgmap v13072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:46:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:03 smithi136 ceph-mon[125702]: pgmap v13072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:46:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:03 smithi057 ceph-mon[92072]: pgmap v13072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:46:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:05 smithi122 ceph-mon[125440]: pgmap v13073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:46:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:05 smithi136 ceph-mon[125702]: pgmap v13073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:46:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:05 smithi057 ceph-mon[92072]: pgmap v13073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:46:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:07 smithi136 ceph-mon[125702]: pgmap v13074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:46:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:07 smithi136 ceph-mon[125702]: osdmap e890: 12 total, 12 up, 12 in 2023-03-02T17:46:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:07.881+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:07.881+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:07.881+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:07.881+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:46:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:07.881+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:46:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:07 smithi057 ceph-mon[92072]: pgmap v13074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:46:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:07 smithi057 ceph-mon[92072]: osdmap e890: 12 total, 12 up, 12 in 2023-03-02T17:46:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:07 smithi122 ceph-mon[125440]: pgmap v13074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:46:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:07 smithi122 ceph-mon[125440]: osdmap e890: 12 total, 12 up, 12 in 2023-03-02T17:46:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:09 smithi136 ceph-mon[125702]: pgmap v13076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:46:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:09 smithi057 ceph-mon[92072]: pgmap v13076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:46:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:09 smithi122 ceph-mon[125440]: pgmap v13076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:46:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:11 smithi136 ceph-mon[125702]: pgmap v13077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:46:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:11 smithi057 ceph-mon[92072]: pgmap v13077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:46:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:11 smithi122 ceph-mon[125440]: pgmap v13077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:46:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:13 smithi136 ceph-mon[125702]: pgmap v13078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:46:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:13 smithi057 ceph-mon[92072]: pgmap v13078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:46:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:13 smithi122 ceph-mon[125440]: pgmap v13078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:46:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:15 smithi136 ceph-mon[125702]: pgmap v13079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:46:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:15 smithi057 ceph-mon[92072]: pgmap v13079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:46:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:15 smithi122 ceph-mon[125440]: pgmap v13079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:46:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:16 smithi136 ceph-mon[125702]: pgmap v13080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:46:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:16 smithi136 ceph-mon[125702]: osdmap e891: 12 total, 12 up, 12 in 2023-03-02T17:46:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:16 smithi057 ceph-mon[92072]: pgmap v13080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:46:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:16 smithi057 ceph-mon[92072]: osdmap e891: 12 total, 12 up, 12 in 2023-03-02T17:46:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:16 smithi122 ceph-mon[125440]: pgmap v13080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:46:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:16 smithi122 ceph-mon[125440]: osdmap e891: 12 total, 12 up, 12 in 2023-03-02T17:46:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:18 smithi136 ceph-mon[125702]: pgmap v13082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:46:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:18 smithi057 ceph-mon[92072]: pgmap v13082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:46:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:18 smithi122 ceph-mon[125440]: pgmap v13082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:46:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:20 smithi136 ceph-mon[125702]: pgmap v13083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:46:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:20 smithi057 ceph-mon[92072]: pgmap v13083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:46:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:20 smithi122 ceph-mon[125440]: pgmap v13083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:46:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:22.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:46:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:22.889+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:46:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:22.889+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:46:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:22.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:46:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:22.889+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:46:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:23 smithi136 ceph-mon[125702]: pgmap v13084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:46:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:22 smithi057 ceph-mon[92072]: pgmap v13084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:46:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:23 smithi122 ceph-mon[125440]: pgmap v13084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:46:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:25 smithi136 ceph-mon[125702]: pgmap v13085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:46:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:25 smithi057 ceph-mon[92072]: pgmap v13085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:46:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:25 smithi122 ceph-mon[125440]: pgmap v13085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:46:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:27 smithi136 ceph-mon[125702]: pgmap v13086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:46:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:27 smithi057 ceph-mon[92072]: pgmap v13086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:46:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:27 smithi122 ceph-mon[125440]: pgmap v13086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:46:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:29 smithi136 ceph-mon[125702]: pgmap v13087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:46:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:29 smithi057 ceph-mon[92072]: pgmap v13087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:46:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:29 smithi122 ceph-mon[125440]: pgmap v13087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:46:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:31 smithi136 ceph-mon[125702]: pgmap v13088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:31 smithi057 ceph-mon[92072]: pgmap v13088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:31 smithi122 ceph-mon[125440]: pgmap v13088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:33 smithi136 ceph-mon[125702]: pgmap v13089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:46:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:33 smithi057 ceph-mon[92072]: pgmap v13089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:46:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:33 smithi122 ceph-mon[125440]: pgmap v13089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:46:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:35 smithi136 ceph-mon[125702]: pgmap v13090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:46:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:35 smithi057 ceph-mon[92072]: pgmap v13090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:46:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:35 smithi122 ceph-mon[125440]: pgmap v13090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:46:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:37 smithi136 ceph-mon[125702]: pgmap v13091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:37 smithi057 ceph-mon[92072]: pgmap v13091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:37 smithi122 ceph-mon[125440]: pgmap v13091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:37.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:46:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:37.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:46:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:37.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:46:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:37.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:46:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:37.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:46:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:39 smithi136 ceph-mon[125702]: pgmap v13092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:46:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:39 smithi057 ceph-mon[92072]: pgmap v13092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:46:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:39 smithi122 ceph-mon[125440]: pgmap v13092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:46:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:41 smithi136 ceph-mon[125702]: pgmap v13093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:41 smithi057 ceph-mon[92072]: pgmap v13093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:41 smithi122 ceph-mon[125440]: pgmap v13093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:43 smithi136 ceph-mon[125702]: pgmap v13094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:46:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:43 smithi057 ceph-mon[92072]: pgmap v13094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:46:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:43 smithi122 ceph-mon[125440]: pgmap v13094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:46:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:45 smithi136 ceph-mon[125702]: pgmap v13095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:46:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:45 smithi057 ceph-mon[92072]: pgmap v13095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:46:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:45 smithi122 ceph-mon[125440]: pgmap v13095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:46:47.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:47 smithi136 ceph-mon[125702]: pgmap v13096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:47 smithi057 ceph-mon[92072]: pgmap v13096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:47 smithi122 ceph-mon[125440]: pgmap v13096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:49 smithi136 ceph-mon[125702]: pgmap v13097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:46:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:49 smithi057 ceph-mon[92072]: pgmap v13097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:46:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:49 smithi122 ceph-mon[125440]: pgmap v13097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:46:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:51 smithi136 ceph-mon[125702]: pgmap v13098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:51 smithi057 ceph-mon[92072]: pgmap v13098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:51 smithi122 ceph-mon[125440]: pgmap v13098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:52.917+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:46:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:52.917+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:46:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:52.917+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:46:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:52.917+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:46:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:46:52.917+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:46:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:53 smithi136 ceph-mon[125702]: pgmap v13099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:46:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:53 smithi057 ceph-mon[92072]: pgmap v13099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:46:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:53 smithi122 ceph-mon[125440]: pgmap v13099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:46:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:46:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:46:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:46:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:55 smithi136 ceph-mon[125702]: pgmap v13100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:46:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:46:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:46:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:46:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:55 smithi057 ceph-mon[92072]: pgmap v13100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:46:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:46:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:46:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:46:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:55 smithi122 ceph-mon[125440]: pgmap v13100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:46:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:46:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:46:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:46:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:57 smithi057 ceph-mon[92072]: pgmap v13101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:57 smithi122 ceph-mon[125440]: pgmap v13101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:57 smithi136 ceph-mon[125702]: pgmap v13101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:46:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:46:59 smithi057 ceph-mon[92072]: pgmap v13102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:46:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:46:59 smithi122 ceph-mon[125440]: pgmap v13102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:46:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:46:59 smithi136 ceph-mon[125702]: pgmap v13102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:01 smithi057 ceph-mon[92072]: pgmap v13103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:01 smithi122 ceph-mon[125440]: pgmap v13103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:01 smithi136 ceph-mon[125702]: pgmap v13103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:03 smithi057 ceph-mon[92072]: pgmap v13104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:47:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:03 smithi122 ceph-mon[125440]: pgmap v13104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:47:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:03 smithi136 ceph-mon[125702]: pgmap v13104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:47:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:05 smithi057 ceph-mon[92072]: pgmap v13105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:47:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:05 smithi122 ceph-mon[125440]: pgmap v13105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:47:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:05 smithi136 ceph-mon[125702]: pgmap v13105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:47:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:07 smithi057 ceph-mon[92072]: pgmap v13106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:47:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:07 smithi057 ceph-mon[92072]: osdmap e892: 12 total, 12 up, 12 in 2023-03-02T17:47:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:07 smithi122 ceph-mon[125440]: pgmap v13106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:47:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:07 smithi122 ceph-mon[125440]: osdmap e892: 12 total, 12 up, 12 in 2023-03-02T17:47:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:07 smithi136 ceph-mon[125702]: pgmap v13106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:47:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:07 smithi136 ceph-mon[125702]: osdmap e892: 12 total, 12 up, 12 in 2023-03-02T17:47:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:07.932+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:47:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:07.932+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:47:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:07.932+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:47:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:07.932+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:47:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:07.932+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:47:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:09 smithi057 ceph-mon[92072]: pgmap v13108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:47:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:09 smithi122 ceph-mon[125440]: pgmap v13108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:47:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:09 smithi136 ceph-mon[125702]: pgmap v13108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:47:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:11 smithi057 ceph-mon[92072]: pgmap v13109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:47:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:11 smithi057 ceph-mon[92072]: osdmap e893: 12 total, 12 up, 12 in 2023-03-02T17:47:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:11 smithi122 ceph-mon[125440]: pgmap v13109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:47:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:11 smithi122 ceph-mon[125440]: osdmap e893: 12 total, 12 up, 12 in 2023-03-02T17:47:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:11 smithi136 ceph-mon[125702]: pgmap v13109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:47:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:11 smithi136 ceph-mon[125702]: osdmap e893: 12 total, 12 up, 12 in 2023-03-02T17:47:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:11.905+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:47:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:11.905+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:47:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:11.905+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 191 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:47:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:11.906+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 190 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:47:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:13 smithi057 ceph-mon[92072]: pgmap v13111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 9 op/s 2023-03-02T17:47:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:13 smithi122 ceph-mon[125440]: pgmap v13111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 9 op/s 2023-03-02T17:47:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:13 smithi136 ceph-mon[125702]: pgmap v13111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 9 op/s 2023-03-02T17:47:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:15 smithi057 ceph-mon[92072]: pgmap v13112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:47:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:15 smithi122 ceph-mon[125440]: pgmap v13112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:47:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:15 smithi136 ceph-mon[125702]: pgmap v13112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:47:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:17 smithi057 ceph-mon[92072]: pgmap v13113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T17:47:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:17 smithi122 ceph-mon[125440]: pgmap v13113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T17:47:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:17 smithi136 ceph-mon[125702]: pgmap v13113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T17:47:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:19 smithi057 ceph-mon[92072]: pgmap v13114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:47:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:19 smithi122 ceph-mon[125440]: pgmap v13114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:47:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:19 smithi136 ceph-mon[125702]: pgmap v13114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:47:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:21 smithi057 ceph-mon[92072]: pgmap v13115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:47:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:21 smithi122 ceph-mon[125440]: pgmap v13115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:47:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:21 smithi136 ceph-mon[125702]: pgmap v13115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:47:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:22.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:47:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:22.944+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:47:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:22.944+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:47:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:22.944+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:47:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:22.944+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:47:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:23 smithi057 ceph-mon[92072]: pgmap v13116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 95 B/s wr, 11 op/s 2023-03-02T17:47:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:23 smithi122 ceph-mon[125440]: pgmap v13116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 95 B/s wr, 11 op/s 2023-03-02T17:47:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:23 smithi136 ceph-mon[125702]: pgmap v13116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 95 B/s wr, 11 op/s 2023-03-02T17:47:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:25 smithi057 ceph-mon[92072]: pgmap v13117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:25 smithi122 ceph-mon[125440]: pgmap v13117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:25 smithi136 ceph-mon[125702]: pgmap v13117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:27 smithi122 ceph-mon[125440]: pgmap v13118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:27 smithi136 ceph-mon[125702]: pgmap v13118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:27 smithi057 ceph-mon[92072]: pgmap v13118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:29 smithi122 ceph-mon[125440]: pgmap v13119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:29 smithi136 ceph-mon[125702]: pgmap v13119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:29 smithi057 ceph-mon[92072]: pgmap v13119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:31 smithi122 ceph-mon[125440]: pgmap v13120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:31 smithi136 ceph-mon[125702]: pgmap v13120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:31 smithi057 ceph-mon[92072]: pgmap v13120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:33 smithi122 ceph-mon[125440]: pgmap v13121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:47:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:33 smithi136 ceph-mon[125702]: pgmap v13121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:47:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:33 smithi057 ceph-mon[92072]: pgmap v13121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:47:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:35 smithi136 ceph-mon[125702]: pgmap v13122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:35 smithi057 ceph-mon[92072]: pgmap v13122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:35 smithi122 ceph-mon[125440]: pgmap v13122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:37 smithi136 ceph-mon[125702]: pgmap v13123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:37 smithi057 ceph-mon[92072]: pgmap v13123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:37 smithi122 ceph-mon[125440]: pgmap v13123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:37.957 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:37.956+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:47:37.957 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:37.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:47:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:37.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:47:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:37.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:47:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:37.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:47:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:39 smithi136 ceph-mon[125702]: pgmap v13124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:39 smithi057 ceph-mon[92072]: pgmap v13124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:39 smithi122 ceph-mon[125440]: pgmap v13124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:41 smithi136 ceph-mon[125702]: pgmap v13125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:41 smithi057 ceph-mon[92072]: pgmap v13125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:41 smithi122 ceph-mon[125440]: pgmap v13125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:43 smithi136 ceph-mon[125702]: pgmap v13126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:47:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:43 smithi057 ceph-mon[92072]: pgmap v13126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:47:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:43 smithi122 ceph-mon[125440]: pgmap v13126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:47:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:45 smithi136 ceph-mon[125702]: pgmap v13127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:45 smithi057 ceph-mon[92072]: pgmap v13127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:45 smithi122 ceph-mon[125440]: pgmap v13127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:47 smithi136 ceph-mon[125702]: pgmap v13128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:47 smithi057 ceph-mon[92072]: pgmap v13128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:47 smithi122 ceph-mon[125440]: pgmap v13128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:49 smithi136 ceph-mon[125702]: pgmap v13129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:49 smithi057 ceph-mon[92072]: pgmap v13129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:49 smithi122 ceph-mon[125440]: pgmap v13129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:51 smithi136 ceph-mon[125702]: pgmap v13130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:51 smithi057 ceph-mon[92072]: pgmap v13130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:51 smithi122 ceph-mon[125440]: pgmap v13130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:52.966+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:47:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:52.966+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:47:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:52.966+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:47:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:52.966+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:47:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:47:52.966+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:47:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:53 smithi136 ceph-mon[125702]: pgmap v13131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:47:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:53 smithi057 ceph-mon[92072]: pgmap v13131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:47:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:53 smithi122 ceph-mon[125440]: pgmap v13131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T17:47:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:55 smithi136 ceph-mon[125702]: pgmap v13132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:55.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:47:55.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:47:55.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:47:55.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:47:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:55 smithi057 ceph-mon[92072]: pgmap v13132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:47:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:47:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:47:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:47:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:55 smithi122 ceph-mon[125440]: pgmap v13132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:47:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:47:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:47:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:47:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:47:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:57 smithi136 ceph-mon[125702]: pgmap v13133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:57 smithi057 ceph-mon[92072]: pgmap v13133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:57 smithi122 ceph-mon[125440]: pgmap v13133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:47:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:47:59 smithi136 ceph-mon[125702]: pgmap v13134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:47:59 smithi057 ceph-mon[92072]: pgmap v13134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:47:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:47:59 smithi122 ceph-mon[125440]: pgmap v13134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:48:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:01 smithi136 ceph-mon[125702]: pgmap v13135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:01 smithi057 ceph-mon[92072]: pgmap v13135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:01 smithi122 ceph-mon[125440]: pgmap v13135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:03 smithi136 ceph-mon[125702]: pgmap v13136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:48:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:03 smithi057 ceph-mon[92072]: pgmap v13136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:48:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:03 smithi122 ceph-mon[125440]: pgmap v13136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T17:48:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:05 smithi136 ceph-mon[125702]: pgmap v13137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:48:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:05 smithi057 ceph-mon[92072]: pgmap v13137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:48:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:05 smithi122 ceph-mon[125440]: pgmap v13137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T17:48:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:07 smithi136 ceph-mon[125702]: pgmap v13138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:48:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:07 smithi136 ceph-mon[125702]: osdmap e894: 12 total, 12 up, 12 in 2023-03-02T17:48:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:07 smithi057 ceph-mon[92072]: pgmap v13138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:48:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:07 smithi057 ceph-mon[92072]: osdmap e894: 12 total, 12 up, 12 in 2023-03-02T17:48:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:07 smithi122 ceph-mon[125440]: pgmap v13138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:48:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:07 smithi122 ceph-mon[125440]: osdmap e894: 12 total, 12 up, 12 in 2023-03-02T17:48:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:07.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:48:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:07.982+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:48:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:07.982+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:48:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:07.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:48:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:07.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:48:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:09 smithi136 ceph-mon[125702]: pgmap v13140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:48:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:09 smithi057 ceph-mon[92072]: pgmap v13140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:48:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:09 smithi122 ceph-mon[125440]: pgmap v13140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:48:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:11 smithi136 ceph-mon[125702]: pgmap v13141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:48:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:11 smithi136 ceph-mon[125702]: osdmap e895: 12 total, 12 up, 12 in 2023-03-02T17:48:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:11 smithi057 ceph-mon[92072]: pgmap v13141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:48:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:11 smithi057 ceph-mon[92072]: osdmap e895: 12 total, 12 up, 12 in 2023-03-02T17:48:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:11 smithi122 ceph-mon[125440]: pgmap v13141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:48:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:11 smithi122 ceph-mon[125440]: osdmap e895: 12 total, 12 up, 12 in 2023-03-02T17:48:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:13 smithi136 ceph-mon[125702]: pgmap v13143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-02T17:48:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:13 smithi057 ceph-mon[92072]: pgmap v13143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-02T17:48:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:13 smithi122 ceph-mon[125440]: pgmap v13143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-02T17:48:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:15 smithi136 ceph-mon[125702]: pgmap v13144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:48:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:15 smithi057 ceph-mon[92072]: pgmap v13144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:48:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:15 smithi122 ceph-mon[125440]: pgmap v13144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:48:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:17 smithi136 ceph-mon[125702]: pgmap v13145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T17:48:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:17 smithi057 ceph-mon[92072]: pgmap v13145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T17:48:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:17 smithi122 ceph-mon[125440]: pgmap v13145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T17:48:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:19 smithi136 ceph-mon[125702]: pgmap v13146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:48:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:19 smithi057 ceph-mon[92072]: pgmap v13146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:48:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:19 smithi122 ceph-mon[125440]: pgmap v13146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:48:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:21 smithi136 ceph-mon[125702]: pgmap v13147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:48:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:21 smithi057 ceph-mon[92072]: pgmap v13147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:48:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:21 smithi122 ceph-mon[125440]: pgmap v13147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T17:48:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:22.989+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:48:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:22.989+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:48:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:22.989+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:48:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:22.989+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:48:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:22.989+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:48:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:23 smithi136 ceph-mon[125702]: pgmap v13148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 95 B/s wr, 11 op/s 2023-03-02T17:48:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:23 smithi057 ceph-mon[92072]: pgmap v13148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 95 B/s wr, 11 op/s 2023-03-02T17:48:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:23 smithi122 ceph-mon[125440]: pgmap v13148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 95 B/s wr, 11 op/s 2023-03-02T17:48:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:25 smithi136 ceph-mon[125702]: pgmap v13149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2023-03-02T17:48:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:25 smithi057 ceph-mon[92072]: pgmap v13149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2023-03-02T17:48:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:25 smithi122 ceph-mon[125440]: pgmap v13149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2023-03-02T17:48:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:27 smithi136 ceph-mon[125702]: pgmap v13150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:27 smithi057 ceph-mon[92072]: pgmap v13150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:27 smithi122 ceph-mon[125440]: pgmap v13150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:29 smithi136 ceph-mon[125702]: pgmap v13151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:48:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:29 smithi057 ceph-mon[92072]: pgmap v13151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:48:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:29 smithi122 ceph-mon[125440]: pgmap v13151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:48:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:31 smithi057 ceph-mon[92072]: pgmap v13152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:31 smithi122 ceph-mon[125440]: pgmap v13152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:31 smithi136 ceph-mon[125702]: pgmap v13152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:33 smithi057 ceph-mon[92072]: pgmap v13153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T17:48:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:33 smithi122 ceph-mon[125440]: pgmap v13153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T17:48:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:33 smithi136 ceph-mon[125702]: pgmap v13153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T17:48:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:35 smithi057 ceph-mon[92072]: pgmap v13154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:48:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:35 smithi122 ceph-mon[125440]: pgmap v13154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:48:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:35 smithi136 ceph-mon[125702]: pgmap v13154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:48:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:37 smithi057 ceph-mon[92072]: pgmap v13155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:37 smithi122 ceph-mon[125440]: pgmap v13155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:37 smithi136 ceph-mon[125702]: pgmap v13155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:38.005+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:48:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:38.005+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:48:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:38.005+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:48:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:38.005+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:48:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:38.005+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:48:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:39 smithi057 ceph-mon[92072]: pgmap v13156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:48:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:39 smithi122 ceph-mon[125440]: pgmap v13156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:48:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:39 smithi136 ceph-mon[125702]: pgmap v13156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:48:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:41 smithi057 ceph-mon[92072]: pgmap v13157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:41 smithi122 ceph-mon[125440]: pgmap v13157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:41 smithi136 ceph-mon[125702]: pgmap v13157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:43 smithi057 ceph-mon[92072]: pgmap v13158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T17:48:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:43 smithi122 ceph-mon[125440]: pgmap v13158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T17:48:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:43 smithi136 ceph-mon[125702]: pgmap v13158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T17:48:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:45 smithi057 ceph-mon[92072]: pgmap v13159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:48:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:45 smithi122 ceph-mon[125440]: pgmap v13159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:48:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:45 smithi136 ceph-mon[125702]: pgmap v13159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:48:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:47 smithi057 ceph-mon[92072]: pgmap v13160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:47 smithi122 ceph-mon[125440]: pgmap v13160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:47 smithi136 ceph-mon[125702]: pgmap v13160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:49 smithi057 ceph-mon[92072]: pgmap v13161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:48:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:49 smithi122 ceph-mon[125440]: pgmap v13161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:48:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:49 smithi136 ceph-mon[125702]: pgmap v13161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:48:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:51 smithi057 ceph-mon[92072]: pgmap v13162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:51 smithi122 ceph-mon[125440]: pgmap v13162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:51 smithi136 ceph-mon[125702]: pgmap v13162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:53.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:48:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:53.019+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:48:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:53.019+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:48:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:53.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:48:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:48:53.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:48:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:53 smithi057 ceph-mon[92072]: pgmap v13163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:48:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:53 smithi122 ceph-mon[125440]: pgmap v13163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:48:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:53 smithi136 ceph-mon[125702]: pgmap v13163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:48:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:55 smithi057 ceph-mon[92072]: pgmap v13164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:48:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:48:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:55 smithi122 ceph-mon[125440]: pgmap v13164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:48:55.737 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:48:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:55 smithi136 ceph-mon[125702]: pgmap v13164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T17:48:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:48:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:57 smithi057 ceph-mon[92072]: pgmap v13165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:57 smithi122 ceph-mon[125440]: pgmap v13165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:57 smithi136 ceph-mon[125702]: pgmap v13165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:48:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: pgmap v13166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:48:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:48:59.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:48:59.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:48:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: pgmap v13166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:48:59.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:48:59.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:48:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: pgmap v13166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:48:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:48:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:48:59.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:48:59.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:48:59.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:48:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:49:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:00 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:49:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:00 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:49:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:00 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:49:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:00 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:49:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:00 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi057 to 302.0k 2023-03-02T17:49:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:00 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi057 to 309268: error parsing value: Value '309268' is below minimum 939524096 2023-03-02T17:49:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:00 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:49:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:00 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:49:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:00 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:49:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:00 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:49:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:00 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi057 to 302.0k 2023-03-02T17:49:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:00 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi057 to 309268: error parsing value: Value '309268' is below minimum 939524096 2023-03-02T17:49:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:00 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:49:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:00 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:49:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:00 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:49:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:00 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:49:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:00 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi057 to 302.0k 2023-03-02T17:49:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:00 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi057 to 309268: error parsing value: Value '309268' is below minimum 939524096 2023-03-02T17:49:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:01 smithi136 ceph-mon[125702]: pgmap v13167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:01.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:01 smithi057 ceph-mon[92072]: pgmap v13167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:01 smithi122 ceph-mon[125440]: pgmap v13167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:03 smithi136 ceph-mon[125702]: pgmap v13168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:49:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:03 smithi057 ceph-mon[92072]: pgmap v13168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:49:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:03 smithi122 ceph-mon[125440]: pgmap v13168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:49:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:05 smithi136 ceph-mon[125702]: pgmap v13169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:49:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:05 smithi057 ceph-mon[92072]: pgmap v13169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:49:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:05 smithi122 ceph-mon[125440]: pgmap v13169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:49:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:07 smithi136 ceph-mon[125702]: pgmap v13170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:49:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:07 smithi057 ceph-mon[92072]: pgmap v13170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:49:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:07 smithi122 ceph-mon[125440]: pgmap v13170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:49:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:08.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:49:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:08.034+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:49:08.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:08.034+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:49:08.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:08.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:49:08.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:08.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:49:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:09 smithi136 ceph-mon[125702]: pgmap v13171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:49:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:09 smithi057 ceph-mon[92072]: pgmap v13171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:49:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:09 smithi122 ceph-mon[125440]: pgmap v13171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:49:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:11 smithi136 ceph-mon[125702]: pgmap v13172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:49:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:11 smithi057 ceph-mon[92072]: pgmap v13172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:49:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:11 smithi122 ceph-mon[125440]: pgmap v13172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:49:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:12 smithi136 ceph-mon[125702]: osdmap e896: 12 total, 12 up, 12 in 2023-03-02T17:49:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:12 smithi057 ceph-mon[92072]: osdmap e896: 12 total, 12 up, 12 in 2023-03-02T17:49:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:12 smithi122 ceph-mon[125440]: osdmap e896: 12 total, 12 up, 12 in 2023-03-02T17:49:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:13 smithi136 ceph-mon[125702]: pgmap v13174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:13 smithi057 ceph-mon[92072]: pgmap v13174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:13 smithi122 ceph-mon[125440]: pgmap v13174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:15 smithi136 ceph-mon[125702]: pgmap v13175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:15 smithi057 ceph-mon[92072]: pgmap v13175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:15 smithi122 ceph-mon[125440]: pgmap v13175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:17 smithi136 ceph-mon[125702]: pgmap v13176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:17 smithi136 ceph-mon[125702]: osdmap e897: 12 total, 12 up, 12 in 2023-03-02T17:49:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:17 smithi057 ceph-mon[92072]: pgmap v13176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:17 smithi057 ceph-mon[92072]: osdmap e897: 12 total, 12 up, 12 in 2023-03-02T17:49:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:17 smithi122 ceph-mon[125440]: pgmap v13176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:17 smithi122 ceph-mon[125440]: osdmap e897: 12 total, 12 up, 12 in 2023-03-02T17:49:19.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:19 smithi136 ceph-mon[125702]: pgmap v13178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T17:49:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:19 smithi057 ceph-mon[92072]: pgmap v13178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T17:49:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:19 smithi122 ceph-mon[125440]: pgmap v13178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T17:49:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:21 smithi136 ceph-mon[125702]: pgmap v13179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 361 B/s wr, 12 op/s 2023-03-02T17:49:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:21 smithi057 ceph-mon[92072]: pgmap v13179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 361 B/s wr, 12 op/s 2023-03-02T17:49:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:21 smithi122 ceph-mon[125440]: pgmap v13179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 361 B/s wr, 12 op/s 2023-03-02T17:49:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:23.045+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:49:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:23.045+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:49:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:23.045+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:49:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:23.045+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:49:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:23.045+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:49:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:23 smithi136 ceph-mon[125702]: pgmap v13180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:23 smithi057 ceph-mon[92072]: pgmap v13180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:23 smithi122 ceph-mon[125440]: pgmap v13180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:25 smithi136 ceph-mon[125702]: pgmap v13181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:25 smithi057 ceph-mon[92072]: pgmap v13181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:25 smithi122 ceph-mon[125440]: pgmap v13181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:27 smithi136 ceph-mon[125702]: pgmap v13182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:27 smithi057 ceph-mon[92072]: pgmap v13182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:27 smithi122 ceph-mon[125440]: pgmap v13182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:49:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:29 smithi136 ceph-mon[125702]: pgmap v13183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 174 B/s wr, 12 op/s 2023-03-02T17:49:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:29 smithi057 ceph-mon[92072]: pgmap v13183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 174 B/s wr, 12 op/s 2023-03-02T17:49:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:29 smithi122 ceph-mon[125440]: pgmap v13183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 174 B/s wr, 12 op/s 2023-03-02T17:49:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:31 smithi136 ceph-mon[125702]: pgmap v13184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:31 smithi057 ceph-mon[92072]: pgmap v13184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:31 smithi122 ceph-mon[125440]: pgmap v13184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:33.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:33 smithi136 ceph-mon[125702]: pgmap v13185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:49:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:33 smithi057 ceph-mon[92072]: pgmap v13185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:49:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:33 smithi122 ceph-mon[125440]: pgmap v13185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T17:49:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:35 smithi136 ceph-mon[125702]: pgmap v13186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:49:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:35 smithi057 ceph-mon[92072]: pgmap v13186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:49:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:35 smithi122 ceph-mon[125440]: pgmap v13186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:49:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:37 smithi136 ceph-mon[125702]: pgmap v13187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:37 smithi057 ceph-mon[92072]: pgmap v13187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:37 smithi122 ceph-mon[125440]: pgmap v13187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:38.051+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:49:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:38.051+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:49:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:38.051+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:49:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:38.051+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:49:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:38.051+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:49:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:39 smithi057 ceph-mon[92072]: pgmap v13188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:49:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:39 smithi122 ceph-mon[125440]: pgmap v13188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:49:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:39 smithi136 ceph-mon[125702]: pgmap v13188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:49:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:41 smithi057 ceph-mon[92072]: pgmap v13189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:41 smithi122 ceph-mon[125440]: pgmap v13189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:41 smithi136 ceph-mon[125702]: pgmap v13189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:43 smithi057 ceph-mon[92072]: pgmap v13190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:49:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:43 smithi122 ceph-mon[125440]: pgmap v13190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:49:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:43 smithi136 ceph-mon[125702]: pgmap v13190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:49:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:45 smithi057 ceph-mon[92072]: pgmap v13191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:49:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:45 smithi122 ceph-mon[125440]: pgmap v13191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:49:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:45 smithi136 ceph-mon[125702]: pgmap v13191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:49:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:47 smithi057 ceph-mon[92072]: pgmap v13192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:47 smithi122 ceph-mon[125440]: pgmap v13192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:47 smithi136 ceph-mon[125702]: pgmap v13192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:49 smithi057 ceph-mon[92072]: pgmap v13193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:49:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:49 smithi122 ceph-mon[125440]: pgmap v13193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:49:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:49 smithi136 ceph-mon[125702]: pgmap v13193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:49:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:51 smithi057 ceph-mon[92072]: pgmap v13194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:51 smithi122 ceph-mon[125440]: pgmap v13194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:51 smithi136 ceph-mon[125702]: pgmap v13194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:53.067+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:53.068+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:53.068+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:53.068+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:49:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:49:53.068+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:49:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:53 smithi057 ceph-mon[92072]: pgmap v13195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:49:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:53 smithi122 ceph-mon[125440]: pgmap v13195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:49:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:53 smithi136 ceph-mon[125702]: pgmap v13195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:49:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:55 smithi057 ceph-mon[92072]: pgmap v13196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:49:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:55 smithi122 ceph-mon[125440]: pgmap v13196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:49:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:55 smithi136 ceph-mon[125702]: pgmap v13196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:49:57.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:57 smithi057 ceph-mon[92072]: pgmap v13197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:57 smithi122 ceph-mon[125440]: pgmap v13197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:57 smithi136 ceph-mon[125702]: pgmap v13197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:49:59.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:49:59 smithi057 ceph-mon[92072]: pgmap v13198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:49:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:49:59 smithi122 ceph-mon[125440]: pgmap v13198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:49:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:49:59 smithi136 ceph-mon[125702]: pgmap v13198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:50:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:50:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:50:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:50:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:50:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T17:50:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:50:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:50:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:50:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:50:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T17:50:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:50:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:50:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:50:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:50:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T17:50:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:01 smithi057 ceph-mon[92072]: pgmap v13199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:01 smithi122 ceph-mon[125440]: pgmap v13199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:01 smithi136 ceph-mon[125702]: pgmap v13199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:03 smithi057 ceph-mon[92072]: pgmap v13200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:50:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:03 smithi122 ceph-mon[125440]: pgmap v13200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:50:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:03 smithi136 ceph-mon[125702]: pgmap v13200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:50:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:05 smithi057 ceph-mon[92072]: pgmap v13201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:50:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:05 smithi122 ceph-mon[125440]: pgmap v13201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:50:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:05 smithi136 ceph-mon[125702]: pgmap v13201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:50:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:07 smithi057 ceph-mon[92072]: pgmap v13202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:50:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:07 smithi122 ceph-mon[125440]: pgmap v13202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:50:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:07 smithi136 ceph-mon[125702]: pgmap v13202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:50:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:08.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:50:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:08.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:50:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:08.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:50:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:08.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:50:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:08.081+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:50:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:09 smithi057 ceph-mon[92072]: pgmap v13203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:50:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:09 smithi122 ceph-mon[125440]: pgmap v13203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:50:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:09 smithi136 ceph-mon[125702]: pgmap v13203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:50:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:11 smithi057 ceph-mon[92072]: pgmap v13204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:50:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:11 smithi122 ceph-mon[125440]: pgmap v13204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:50:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:11 smithi136 ceph-mon[125702]: pgmap v13204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:50:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:11.932+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:50:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:11.932+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:50:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:11.932+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 192 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:50:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:11.932+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 191 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:50:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:12 smithi057 ceph-mon[92072]: osdmap e898: 12 total, 12 up, 12 in 2023-03-02T17:50:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:12 smithi122 ceph-mon[125440]: osdmap e898: 12 total, 12 up, 12 in 2023-03-02T17:50:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:12 smithi136 ceph-mon[125702]: osdmap e898: 12 total, 12 up, 12 in 2023-03-02T17:50:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:13 smithi122 ceph-mon[125440]: pgmap v13206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:13 smithi136 ceph-mon[125702]: pgmap v13206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:13 smithi057 ceph-mon[92072]: pgmap v13206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:15 smithi122 ceph-mon[125440]: pgmap v13207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:15 smithi136 ceph-mon[125702]: pgmap v13207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:15 smithi057 ceph-mon[92072]: pgmap v13207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:17 smithi136 ceph-mon[125702]: pgmap v13208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:17 smithi057 ceph-mon[92072]: pgmap v13208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:17 smithi122 ceph-mon[125440]: pgmap v13208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:19 smithi136 ceph-mon[125702]: pgmap v13209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:19 smithi057 ceph-mon[92072]: pgmap v13209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:19 smithi122 ceph-mon[125440]: pgmap v13209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:21 smithi136 ceph-mon[125702]: pgmap v13210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:21 smithi136 ceph-mon[125702]: osdmap e899: 12 total, 12 up, 12 in 2023-03-02T17:50:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:21 smithi057 ceph-mon[92072]: pgmap v13210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:21 smithi057 ceph-mon[92072]: osdmap e899: 12 total, 12 up, 12 in 2023-03-02T17:50:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:21 smithi122 ceph-mon[125440]: pgmap v13210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:50:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:21 smithi122 ceph-mon[125440]: osdmap e899: 12 total, 12 up, 12 in 2023-03-02T17:50:23.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:23.092+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:50:23.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:23.093+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:50:23.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:23.093+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:50:23.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:23.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:50:23.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:23.093+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:50:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:23 smithi136 ceph-mon[125702]: pgmap v13212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:50:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:23 smithi057 ceph-mon[92072]: pgmap v13212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:50:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:23 smithi122 ceph-mon[125440]: pgmap v13212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:50:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:25 smithi136 ceph-mon[125702]: pgmap v13213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:50:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:25 smithi057 ceph-mon[92072]: pgmap v13213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:50:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:25 smithi122 ceph-mon[125440]: pgmap v13213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:50:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:27 smithi136 ceph-mon[125702]: pgmap v13214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:50:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:27 smithi057 ceph-mon[92072]: pgmap v13214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:50:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:27 smithi122 ceph-mon[125440]: pgmap v13214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:50:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:29 smithi136 ceph-mon[125702]: pgmap v13215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:50:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:29 smithi057 ceph-mon[92072]: pgmap v13215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:50:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:29 smithi122 ceph-mon[125440]: pgmap v13215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:50:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:31 smithi136 ceph-mon[125702]: pgmap v13216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:50:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:31 smithi057 ceph-mon[92072]: pgmap v13216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:50:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:31 smithi122 ceph-mon[125440]: pgmap v13216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T17:50:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:33 smithi136 ceph-mon[125702]: pgmap v13217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-02T17:50:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:33 smithi057 ceph-mon[92072]: pgmap v13217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-02T17:50:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:33 smithi122 ceph-mon[125440]: pgmap v13217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-02T17:50:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:35 smithi136 ceph-mon[125702]: pgmap v13218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:50:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:35 smithi057 ceph-mon[92072]: pgmap v13218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:50:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:35 smithi122 ceph-mon[125440]: pgmap v13218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:50:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:37 smithi136 ceph-mon[125702]: pgmap v13219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:37 smithi057 ceph-mon[92072]: pgmap v13219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:37 smithi122 ceph-mon[125440]: pgmap v13219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:38.102+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:50:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:38.102+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:50:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:38.102+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:50:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:38.102+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:50:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:38.102+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:50:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:39 smithi136 ceph-mon[125702]: pgmap v13220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:50:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:39 smithi057 ceph-mon[92072]: pgmap v13220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:50:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:39 smithi122 ceph-mon[125440]: pgmap v13220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:50:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:41 smithi136 ceph-mon[125702]: pgmap v13221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:41 smithi057 ceph-mon[92072]: pgmap v13221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:41 smithi122 ceph-mon[125440]: pgmap v13221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:43 smithi136 ceph-mon[125702]: pgmap v13222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:50:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:43 smithi057 ceph-mon[92072]: pgmap v13222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:50:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:43 smithi122 ceph-mon[125440]: pgmap v13222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:50:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:45 smithi136 ceph-mon[125702]: pgmap v13223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:50:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:45 smithi057 ceph-mon[92072]: pgmap v13223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:50:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:45 smithi122 ceph-mon[125440]: pgmap v13223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:50:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:47 smithi136 ceph-mon[125702]: pgmap v13224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:47 smithi057 ceph-mon[92072]: pgmap v13224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:47 smithi122 ceph-mon[125440]: pgmap v13224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:49 smithi136 ceph-mon[125702]: pgmap v13225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:50:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:49 smithi057 ceph-mon[92072]: pgmap v13225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:50:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:49 smithi122 ceph-mon[125440]: pgmap v13225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:50:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:51 smithi136 ceph-mon[125702]: pgmap v13226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:51 smithi057 ceph-mon[92072]: pgmap v13226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:51 smithi122 ceph-mon[125440]: pgmap v13226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:53.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:50:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:53.115+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:50:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:53.115+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:50:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:53.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:50:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:50:53.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:50:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:53 smithi136 ceph-mon[125702]: pgmap v13227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:50:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:53 smithi057 ceph-mon[92072]: pgmap v13227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:50:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:53 smithi122 ceph-mon[125440]: pgmap v13227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T17:50:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:55 smithi136 ceph-mon[125702]: pgmap v13228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:50:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:55 smithi057 ceph-mon[92072]: pgmap v13228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:50:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:55 smithi122 ceph-mon[125440]: pgmap v13228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T17:50:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:57 smithi136 ceph-mon[125702]: pgmap v13229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:57 smithi057 ceph-mon[92072]: pgmap v13229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:57 smithi122 ceph-mon[125440]: pgmap v13229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:50:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:50:59 smithi136 ceph-mon[125702]: pgmap v13230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:50:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:50:59 smithi057 ceph-mon[92072]: pgmap v13230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:50:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:50:59 smithi122 ceph-mon[125440]: pgmap v13230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:51:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:51:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:51:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:01 smithi136 ceph-mon[125702]: pgmap v13231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:51:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:51:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:01 smithi057 ceph-mon[92072]: pgmap v13231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:51:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:51:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:01 smithi122 ceph-mon[125440]: pgmap v13231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:51:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:51:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:51:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:51:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:51:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:51:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:51:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:51:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:51:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:51:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:51:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:03 smithi136 ceph-mon[125702]: pgmap v13232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:51:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:03 smithi057 ceph-mon[92072]: pgmap v13232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:51:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:03 smithi122 ceph-mon[125440]: pgmap v13232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T17:51:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:05 smithi136 ceph-mon[125702]: pgmap v13233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:51:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:05 smithi057 ceph-mon[92072]: pgmap v13233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:51:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:05 smithi122 ceph-mon[125440]: pgmap v13233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:51:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:07 smithi136 ceph-mon[125702]: pgmap v13234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:51:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:07 smithi136 ceph-mon[125702]: osdmap e900: 12 total, 12 up, 12 in 2023-03-02T17:51:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:07 smithi057 ceph-mon[92072]: pgmap v13234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:51:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:07 smithi057 ceph-mon[92072]: osdmap e900: 12 total, 12 up, 12 in 2023-03-02T17:51:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:07 smithi122 ceph-mon[125440]: pgmap v13234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:51:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:07 smithi122 ceph-mon[125440]: osdmap e900: 12 total, 12 up, 12 in 2023-03-02T17:51:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:08.127+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:51:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:08.127+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:51:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:08.127+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:51:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:08.127+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:51:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:08.127+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:51:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:09 smithi136 ceph-mon[125702]: pgmap v13236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:51:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:09 smithi057 ceph-mon[92072]: pgmap v13236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:51:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:09 smithi122 ceph-mon[125440]: pgmap v13236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:51:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:11 smithi136 ceph-mon[125702]: pgmap v13237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:51:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:11 smithi136 ceph-mon[125702]: osdmap e901: 12 total, 12 up, 12 in 2023-03-02T17:51:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:11 smithi057 ceph-mon[92072]: pgmap v13237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:51:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:11 smithi057 ceph-mon[92072]: osdmap e901: 12 total, 12 up, 12 in 2023-03-02T17:51:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:11 smithi122 ceph-mon[125440]: pgmap v13237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:51:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:11 smithi122 ceph-mon[125440]: osdmap e901: 12 total, 12 up, 12 in 2023-03-02T17:51:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:13 smithi136 ceph-mon[125702]: pgmap v13239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:51:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:13 smithi057 ceph-mon[92072]: pgmap v13239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:51:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:13 smithi122 ceph-mon[125440]: pgmap v13239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:51:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:15 smithi136 ceph-mon[125702]: pgmap v13240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:51:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:15 smithi057 ceph-mon[92072]: pgmap v13240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:51:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:15 smithi122 ceph-mon[125440]: pgmap v13240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T17:51:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:17 smithi136 ceph-mon[125702]: pgmap v13241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T17:51:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:17 smithi057 ceph-mon[92072]: pgmap v13241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T17:51:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:17 smithi122 ceph-mon[125440]: pgmap v13241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T17:51:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:19 smithi136 ceph-mon[125702]: pgmap v13242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:51:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:19 smithi057 ceph-mon[92072]: pgmap v13242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:51:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:19 smithi122 ceph-mon[125440]: pgmap v13242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:51:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:21 smithi136 ceph-mon[125702]: pgmap v13243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:51:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:21 smithi057 ceph-mon[92072]: pgmap v13243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:51:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:21 smithi122 ceph-mon[125440]: pgmap v13243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:51:23.143 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:23.143+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:51:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:23.143+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:51:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:23.143+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:51:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:23.143+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:51:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:23.143+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:51:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:23 smithi136 ceph-mon[125702]: pgmap v13244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T17:51:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:23 smithi057 ceph-mon[92072]: pgmap v13244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T17:51:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:23 smithi122 ceph-mon[125440]: pgmap v13244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T17:51:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:25 smithi136 ceph-mon[125702]: pgmap v13245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:25 smithi057 ceph-mon[92072]: pgmap v13245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:25 smithi122 ceph-mon[125440]: pgmap v13245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:27 smithi136 ceph-mon[125702]: pgmap v13246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:27 smithi057 ceph-mon[92072]: pgmap v13246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:27 smithi122 ceph-mon[125440]: pgmap v13246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:29 smithi136 ceph-mon[125702]: pgmap v13247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:51:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:29 smithi057 ceph-mon[92072]: pgmap v13247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:51:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:29 smithi122 ceph-mon[125440]: pgmap v13247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T17:51:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:31 smithi136 ceph-mon[125702]: pgmap v13248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:31 smithi057 ceph-mon[92072]: pgmap v13248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:31 smithi122 ceph-mon[125440]: pgmap v13248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:33 smithi136 ceph-mon[125702]: pgmap v13249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:33 smithi057 ceph-mon[92072]: pgmap v13249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:33 smithi122 ceph-mon[125440]: pgmap v13249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:35 smithi136 ceph-mon[125702]: pgmap v13250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:35 smithi057 ceph-mon[92072]: pgmap v13250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:35 smithi122 ceph-mon[125440]: pgmap v13250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:37 smithi136 ceph-mon[125702]: pgmap v13251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:37 smithi057 ceph-mon[92072]: pgmap v13251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:37 smithi122 ceph-mon[125440]: pgmap v13251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:38.156+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:51:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:38.157+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:51:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:38.157+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:51:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:38.157+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:51:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:38.157+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:51:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:39 smithi136 ceph-mon[125702]: pgmap v13252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:39 smithi057 ceph-mon[92072]: pgmap v13252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:39 smithi122 ceph-mon[125440]: pgmap v13252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:41 smithi136 ceph-mon[125702]: pgmap v13253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:41 smithi057 ceph-mon[92072]: pgmap v13253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:41.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:41.944+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:51:41.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:41.944+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:51:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:41.944+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 193 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:51:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:41.944+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 192 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:51:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:41 smithi122 ceph-mon[125440]: pgmap v13253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:43 smithi136 ceph-mon[125702]: pgmap v13254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:43 smithi057 ceph-mon[92072]: pgmap v13254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:43 smithi122 ceph-mon[125440]: pgmap v13254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:45 smithi136 ceph-mon[125702]: pgmap v13255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:45 smithi057 ceph-mon[92072]: pgmap v13255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:45 smithi122 ceph-mon[125440]: pgmap v13255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:47 smithi136 ceph-mon[125702]: pgmap v13256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:47 smithi057 ceph-mon[92072]: pgmap v13256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:47 smithi122 ceph-mon[125440]: pgmap v13256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:49 smithi136 ceph-mon[125702]: pgmap v13257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:49 smithi057 ceph-mon[92072]: pgmap v13257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:49 smithi122 ceph-mon[125440]: pgmap v13257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:51 smithi136 ceph-mon[125702]: pgmap v13258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:51 smithi057 ceph-mon[92072]: pgmap v13258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:51 smithi122 ceph-mon[125440]: pgmap v13258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:53.170+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:51:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:53.170+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:51:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:53.170+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:51:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:53.170+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:51:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:51:53.170+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:51:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:53 smithi136 ceph-mon[125702]: pgmap v13259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:53 smithi057 ceph-mon[92072]: pgmap v13259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:53 smithi122 ceph-mon[125440]: pgmap v13259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:55 smithi057 ceph-mon[92072]: pgmap v13260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:55 smithi122 ceph-mon[125440]: pgmap v13260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:55 smithi136 ceph-mon[125702]: pgmap v13260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:57 smithi057 ceph-mon[92072]: pgmap v13261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:57 smithi122 ceph-mon[125440]: pgmap v13261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:57 smithi136 ceph-mon[125702]: pgmap v13261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:51:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:51:59 smithi057 ceph-mon[92072]: pgmap v13262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:51:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:51:59 smithi122 ceph-mon[125440]: pgmap v13262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:51:59 smithi136 ceph-mon[125702]: pgmap v13262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:01 smithi057 ceph-mon[92072]: pgmap v13263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:52:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:01 smithi122 ceph-mon[125440]: pgmap v13263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:52:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:01 smithi136 ceph-mon[125702]: pgmap v13263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:52:03.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:03 smithi136 ceph-mon[125702]: pgmap v13264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:52:03.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:52:03.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:52:03.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:03 smithi057 ceph-mon[92072]: pgmap v13264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:52:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:52:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:52:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:03 smithi122 ceph-mon[125440]: pgmap v13264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:52:03.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:03.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:52:03.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:52:03.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:52:05.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:05 smithi057 ceph-mon[92072]: pgmap v13265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:52:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:05 smithi122 ceph-mon[125440]: pgmap v13265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:52:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:05 smithi136 ceph-mon[125702]: pgmap v13265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:52:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:07 smithi057 ceph-mon[92072]: pgmap v13266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:52:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:07 smithi057 ceph-mon[92072]: osdmap e902: 12 total, 12 up, 12 in 2023-03-02T17:52:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:07 smithi122 ceph-mon[125440]: pgmap v13266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:52:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:07 smithi122 ceph-mon[125440]: osdmap e902: 12 total, 12 up, 12 in 2023-03-02T17:52:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:07 smithi136 ceph-mon[125702]: pgmap v13266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:52:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:07 smithi136 ceph-mon[125702]: osdmap e902: 12 total, 12 up, 12 in 2023-03-02T17:52:08.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:08.176+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:52:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:08.176+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:52:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:08.176+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:52:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:08.177+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:52:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:08.177+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:52:09.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:09 smithi057 ceph-mon[92072]: pgmap v13268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:52:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:09 smithi122 ceph-mon[125440]: pgmap v13268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:52:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:09 smithi136 ceph-mon[125702]: pgmap v13268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:52:11.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:11 smithi057 ceph-mon[92072]: pgmap v13269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:52:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:11 smithi122 ceph-mon[125440]: pgmap v13269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:52:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:11 smithi136 ceph-mon[125702]: pgmap v13269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:52:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:13 smithi057 ceph-mon[92072]: pgmap v13270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:52:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:13 smithi122 ceph-mon[125440]: pgmap v13270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:52:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:13 smithi136 ceph-mon[125702]: pgmap v13270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:52:15.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:15 smithi057 ceph-mon[92072]: pgmap v13271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:52:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:15 smithi122 ceph-mon[125440]: pgmap v13271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:52:15.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:15 smithi136 ceph-mon[125702]: pgmap v13271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:52:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:17 smithi136 ceph-mon[125702]: pgmap v13272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:52:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:17 smithi136 ceph-mon[125702]: osdmap e903: 12 total, 12 up, 12 in 2023-03-02T17:52:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:17 smithi057 ceph-mon[92072]: pgmap v13272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:52:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:17 smithi057 ceph-mon[92072]: osdmap e903: 12 total, 12 up, 12 in 2023-03-02T17:52:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:17 smithi122 ceph-mon[125440]: pgmap v13272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:52:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:17 smithi122 ceph-mon[125440]: osdmap e903: 12 total, 12 up, 12 in 2023-03-02T17:52:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:19 smithi057 ceph-mon[92072]: pgmap v13274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:52:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:19 smithi122 ceph-mon[125440]: pgmap v13274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:52:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:19 smithi136 ceph-mon[125702]: pgmap v13274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:52:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:21 smithi057 ceph-mon[92072]: pgmap v13275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:52:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:21 smithi122 ceph-mon[125440]: pgmap v13275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:52:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:21 smithi136 ceph-mon[125702]: pgmap v13275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:52:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:23.192+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:52:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:23.192+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:52:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:23.192+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:52:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:23.192+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:52:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:23.192+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:52:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:23 smithi057 ceph-mon[92072]: pgmap v13276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:52:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:23 smithi122 ceph-mon[125440]: pgmap v13276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:52:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:23 smithi136 ceph-mon[125702]: pgmap v13276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:52:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:25 smithi057 ceph-mon[92072]: pgmap v13277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:52:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:25 smithi122 ceph-mon[125440]: pgmap v13277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:52:25.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:25 smithi136 ceph-mon[125702]: pgmap v13277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:52:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:27 smithi057 ceph-mon[92072]: pgmap v13278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:52:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:27 smithi122 ceph-mon[125440]: pgmap v13278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:52:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:27 smithi136 ceph-mon[125702]: pgmap v13278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:52:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:29 smithi057 ceph-mon[92072]: pgmap v13279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:52:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:29 smithi122 ceph-mon[125440]: pgmap v13279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:52:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:29 smithi136 ceph-mon[125702]: pgmap v13279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:52:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:31 smithi057 ceph-mon[92072]: pgmap v13280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:31 smithi122 ceph-mon[125440]: pgmap v13280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:31 smithi136 ceph-mon[125702]: pgmap v13280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:33 smithi057 ceph-mon[92072]: pgmap v13281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:33 smithi122 ceph-mon[125440]: pgmap v13281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:33 smithi136 ceph-mon[125702]: pgmap v13281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:35 smithi057 ceph-mon[92072]: pgmap v13282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:35 smithi122 ceph-mon[125440]: pgmap v13282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:35 smithi136 ceph-mon[125702]: pgmap v13282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:37 smithi057 ceph-mon[92072]: pgmap v13283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:37 smithi122 ceph-mon[125440]: pgmap v13283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:37 smithi136 ceph-mon[125702]: pgmap v13283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:38.208+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:52:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:38.208+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:52:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:38.208+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:52:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:38.208+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:52:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:38.208+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:52:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:39 smithi057 ceph-mon[92072]: pgmap v13284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:39 smithi122 ceph-mon[125440]: pgmap v13284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:39 smithi136 ceph-mon[125702]: pgmap v13284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:41 smithi057 ceph-mon[92072]: pgmap v13285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:41 smithi122 ceph-mon[125440]: pgmap v13285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:41 smithi136 ceph-mon[125702]: pgmap v13285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:43 smithi057 ceph-mon[92072]: pgmap v13286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:43 smithi122 ceph-mon[125440]: pgmap v13286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:43 smithi136 ceph-mon[125702]: pgmap v13286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:45 smithi057 ceph-mon[92072]: pgmap v13287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:45 smithi122 ceph-mon[125440]: pgmap v13287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:45 smithi136 ceph-mon[125702]: pgmap v13287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:47 smithi057 ceph-mon[92072]: pgmap v13288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:47 smithi122 ceph-mon[125440]: pgmap v13288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:47 smithi136 ceph-mon[125702]: pgmap v13288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:49 smithi057 ceph-mon[92072]: pgmap v13289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:49 smithi122 ceph-mon[125440]: pgmap v13289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:49 smithi136 ceph-mon[125702]: pgmap v13289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:51.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:51 smithi057 ceph-mon[92072]: pgmap v13290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:51 smithi122 ceph-mon[125440]: pgmap v13290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:51 smithi136 ceph-mon[125702]: pgmap v13290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:52:53.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:53.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:52:53.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:53.223+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:52:53.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:53.223+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:52:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:53.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:52:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:52:53.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:52:53.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:53 smithi057 ceph-mon[92072]: pgmap v13291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:53 smithi122 ceph-mon[125440]: pgmap v13291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:53 smithi136 ceph-mon[125702]: pgmap v13291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:55.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:55 smithi057 ceph-mon[92072]: pgmap v13292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:52:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:55 smithi122 ceph-mon[125440]: pgmap v13292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:52:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:55 smithi136 ceph-mon[125702]: pgmap v13292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:52:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:57 smithi122 ceph-mon[125440]: pgmap v13293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:52:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:57 smithi136 ceph-mon[125702]: pgmap v13293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:52:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:57 smithi057 ceph-mon[92072]: pgmap v13293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:52:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:52:59 smithi122 ceph-mon[125440]: pgmap v13294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:52:59 smithi136 ceph-mon[125702]: pgmap v13294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:52:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:52:59 smithi057 ceph-mon[92072]: pgmap v13294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:01 smithi122 ceph-mon[125440]: pgmap v13295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:53:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:01 smithi136 ceph-mon[125702]: pgmap v13295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:53:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:01 smithi057 ceph-mon[92072]: pgmap v13295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T17:53:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:03 smithi122 ceph-mon[125440]: pgmap v13296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:53:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:53:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:03 smithi136 ceph-mon[125702]: pgmap v13296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:53:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:53:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:03 smithi057 ceph-mon[92072]: pgmap v13296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:53:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:53:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:53:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:53:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:53:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:53:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:53:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:53:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:53:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:53:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:53:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:05 smithi122 ceph-mon[125440]: pgmap v13297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:53:05.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:05 smithi136 ceph-mon[125702]: pgmap v13297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:53:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:05 smithi057 ceph-mon[92072]: pgmap v13297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:53:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:07 smithi136 ceph-mon[125702]: pgmap v13298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:53:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:07 smithi136 ceph-mon[125702]: osdmap e904: 12 total, 12 up, 12 in 2023-03-02T17:53:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:07 smithi057 ceph-mon[92072]: pgmap v13298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:53:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:07 smithi057 ceph-mon[92072]: osdmap e904: 12 total, 12 up, 12 in 2023-03-02T17:53:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:07 smithi122 ceph-mon[125440]: pgmap v13298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:53:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:07 smithi122 ceph-mon[125440]: osdmap e904: 12 total, 12 up, 12 in 2023-03-02T17:53:08.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:08.231+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:53:08.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:08.232+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:53:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:08.232+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:53:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:08.232+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:53:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:08.232+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:53:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:09 smithi136 ceph-mon[125702]: pgmap v13300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:53:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:09 smithi057 ceph-mon[92072]: pgmap v13300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:53:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:09 smithi122 ceph-mon[125440]: pgmap v13300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:53:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:11 smithi136 ceph-mon[125702]: pgmap v13301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:53:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:11 smithi057 ceph-mon[92072]: pgmap v13301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:53:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:11 smithi122 ceph-mon[125440]: pgmap v13301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:53:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:11.957+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:53:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:11.957+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:53:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:11.958+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 193 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:53:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:11.958+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 194 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:53:13.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:13 smithi136 ceph-mon[125702]: pgmap v13302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:53:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:13 smithi057 ceph-mon[92072]: pgmap v13302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:53:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:13 smithi122 ceph-mon[125440]: pgmap v13302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:53:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:15 smithi136 ceph-mon[125702]: pgmap v13303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:53:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:15 smithi057 ceph-mon[92072]: pgmap v13303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:53:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:15 smithi122 ceph-mon[125440]: pgmap v13303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:53:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:17 smithi057 ceph-mon[92072]: pgmap v13304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:53:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:17 smithi057 ceph-mon[92072]: osdmap e905: 12 total, 12 up, 12 in 2023-03-02T17:53:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:17 smithi122 ceph-mon[125440]: pgmap v13304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:53:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:17 smithi122 ceph-mon[125440]: osdmap e905: 12 total, 12 up, 12 in 2023-03-02T17:53:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:17 smithi136 ceph-mon[125702]: pgmap v13304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:53:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:17 smithi136 ceph-mon[125702]: osdmap e905: 12 total, 12 up, 12 in 2023-03-02T17:53:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:19 smithi057 ceph-mon[92072]: pgmap v13306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:53:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:19 smithi122 ceph-mon[125440]: pgmap v13306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:53:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:19 smithi136 ceph-mon[125702]: pgmap v13306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:53:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:21 smithi057 ceph-mon[92072]: pgmap v13307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:53:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:21 smithi122 ceph-mon[125440]: pgmap v13307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:53:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:21 smithi136 ceph-mon[125702]: pgmap v13307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:53:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:23.247+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:53:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:23.248+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:53:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:23.248+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:53:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:23.248+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:53:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:23.248+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:53:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:23 smithi057 ceph-mon[92072]: pgmap v13308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:53:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:23 smithi122 ceph-mon[125440]: pgmap v13308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:53:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:23 smithi136 ceph-mon[125702]: pgmap v13308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:53:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:25 smithi057 ceph-mon[92072]: pgmap v13309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:53:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:25 smithi122 ceph-mon[125440]: pgmap v13309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:53:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:25 smithi136 ceph-mon[125702]: pgmap v13309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:53:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:27 smithi057 ceph-mon[92072]: pgmap v13310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:53:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:27 smithi122 ceph-mon[125440]: pgmap v13310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:53:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:27 smithi136 ceph-mon[125702]: pgmap v13310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:53:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:29 smithi057 ceph-mon[92072]: pgmap v13311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:53:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:29 smithi122 ceph-mon[125440]: pgmap v13311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:53:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:29 smithi136 ceph-mon[125702]: pgmap v13311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:53:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:31 smithi057 ceph-mon[92072]: pgmap v13312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:31 smithi122 ceph-mon[125440]: pgmap v13312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:31 smithi136 ceph-mon[125702]: pgmap v13312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:33 smithi057 ceph-mon[92072]: pgmap v13313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:33 smithi122 ceph-mon[125440]: pgmap v13313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:33 smithi136 ceph-mon[125702]: pgmap v13313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:35 smithi057 ceph-mon[92072]: pgmap v13314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:35 smithi122 ceph-mon[125440]: pgmap v13314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:35 smithi136 ceph-mon[125702]: pgmap v13314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:37 smithi057 ceph-mon[92072]: pgmap v13315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:37 smithi122 ceph-mon[125440]: pgmap v13315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:37 smithi136 ceph-mon[125702]: pgmap v13315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:38.254+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:53:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:38.254+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:53:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:38.254+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:53:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:38.254+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:53:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:38.254+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:53:39.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:39 smithi057 ceph-mon[92072]: pgmap v13316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:39 smithi122 ceph-mon[125440]: pgmap v13316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:39 smithi136 ceph-mon[125702]: pgmap v13316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:41.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:41 smithi057 ceph-mon[92072]: pgmap v13317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:41 smithi122 ceph-mon[125440]: pgmap v13317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:41 smithi136 ceph-mon[125702]: pgmap v13317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:43.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:43 smithi057 ceph-mon[92072]: pgmap v13318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:43 smithi122 ceph-mon[125440]: pgmap v13318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:43 smithi136 ceph-mon[125702]: pgmap v13318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:45 smithi057 ceph-mon[92072]: pgmap v13319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:45 smithi122 ceph-mon[125440]: pgmap v13319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:45 smithi136 ceph-mon[125702]: pgmap v13319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:47.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:47 smithi057 ceph-mon[92072]: pgmap v13320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:47 smithi122 ceph-mon[125440]: pgmap v13320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:47 smithi136 ceph-mon[125702]: pgmap v13320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:49.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:49 smithi057 ceph-mon[92072]: pgmap v13321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:49 smithi122 ceph-mon[125440]: pgmap v13321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:49 smithi136 ceph-mon[125702]: pgmap v13321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:51 smithi122 ceph-mon[125440]: pgmap v13322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:51 smithi136 ceph-mon[125702]: pgmap v13322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:51 smithi057 ceph-mon[92072]: pgmap v13322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:53.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:53:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:53.261+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:53:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:53.261+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:53:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:53.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:53:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:53:53.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:53:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:53 smithi122 ceph-mon[125440]: pgmap v13323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:53 smithi136 ceph-mon[125702]: pgmap v13323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:53 smithi057 ceph-mon[92072]: pgmap v13323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:55 smithi122 ceph-mon[125440]: pgmap v13324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:55 smithi136 ceph-mon[125702]: pgmap v13324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:55 smithi057 ceph-mon[92072]: pgmap v13324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:57.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:57 smithi122 ceph-mon[125440]: pgmap v13325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:57 smithi136 ceph-mon[125702]: pgmap v13325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:57 smithi057 ceph-mon[92072]: pgmap v13325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:53:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:53:59 smithi136 ceph-mon[125702]: pgmap v13326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:53:59 smithi057 ceph-mon[92072]: pgmap v13326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:53:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:53:59 smithi122 ceph-mon[125440]: pgmap v13326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:01 smithi136 ceph-mon[125702]: pgmap v13327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:01 smithi057 ceph-mon[92072]: pgmap v13327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:01 smithi122 ceph-mon[125440]: pgmap v13327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:03 smithi136 ceph-mon[125702]: pgmap v13328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:54:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:03 smithi057 ceph-mon[92072]: pgmap v13328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:54:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:03 smithi122 ceph-mon[125440]: pgmap v13328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:54:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:54:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:54:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:54:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:05 smithi136 ceph-mon[125702]: pgmap v13329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:54:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:54:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:54:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:54:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:05 smithi057 ceph-mon[92072]: pgmap v13329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:54:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:54:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:54:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:54:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:05 smithi122 ceph-mon[125440]: pgmap v13329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:54:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:54:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:54:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:54:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:07 smithi136 ceph-mon[125702]: pgmap v13330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:54:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:07 smithi136 ceph-mon[125702]: osdmap e906: 12 total, 12 up, 12 in 2023-03-02T17:54:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:07 smithi057 ceph-mon[92072]: pgmap v13330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:54:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:07 smithi057 ceph-mon[92072]: osdmap e906: 12 total, 12 up, 12 in 2023-03-02T17:54:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:07 smithi122 ceph-mon[125440]: pgmap v13330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:54:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:07 smithi122 ceph-mon[125440]: osdmap e906: 12 total, 12 up, 12 in 2023-03-02T17:54:08.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:08.267+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:54:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:08.267+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:54:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:08.267+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:54:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:08.267+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:54:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:08.267+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:54:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:09 smithi136 ceph-mon[125702]: pgmap v13332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:54:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:09 smithi057 ceph-mon[92072]: pgmap v13332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:54:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:09 smithi122 ceph-mon[125440]: pgmap v13332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:54:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:11 smithi136 ceph-mon[125702]: pgmap v13333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:54:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:11 smithi057 ceph-mon[92072]: pgmap v13333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:54:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:11 smithi122 ceph-mon[125440]: pgmap v13333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:54:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:13 smithi136 ceph-mon[125702]: pgmap v13334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:54:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:13 smithi057 ceph-mon[92072]: pgmap v13334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:54:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:13 smithi122 ceph-mon[125440]: pgmap v13334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:54:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:15 smithi136 ceph-mon[125702]: pgmap v13335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:54:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:15 smithi057 ceph-mon[92072]: pgmap v13335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:54:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:15 smithi122 ceph-mon[125440]: pgmap v13335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:54:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:17 smithi057 ceph-mon[92072]: pgmap v13336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:54:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:17 smithi057 ceph-mon[92072]: osdmap e907: 12 total, 12 up, 12 in 2023-03-02T17:54:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:17 smithi122 ceph-mon[125440]: pgmap v13336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:54:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:17 smithi122 ceph-mon[125440]: osdmap e907: 12 total, 12 up, 12 in 2023-03-02T17:54:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:17 smithi136 ceph-mon[125702]: pgmap v13336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:54:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:17 smithi136 ceph-mon[125702]: osdmap e907: 12 total, 12 up, 12 in 2023-03-02T17:54:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:19 smithi057 ceph-mon[92072]: pgmap v13338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:54:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:19 smithi122 ceph-mon[125440]: pgmap v13338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:54:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:19 smithi136 ceph-mon[125702]: pgmap v13338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:54:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:21 smithi057 ceph-mon[92072]: pgmap v13339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:54:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:21 smithi122 ceph-mon[125440]: pgmap v13339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:54:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:21 smithi136 ceph-mon[125702]: pgmap v13339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:54:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:23.283+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:54:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:23.283+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:54:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:23.283+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:54:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:23.283+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:54:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:23.283+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:54:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:23 smithi057 ceph-mon[92072]: pgmap v13340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:54:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:23 smithi122 ceph-mon[125440]: pgmap v13340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:54:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:23 smithi136 ceph-mon[125702]: pgmap v13340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:54:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:25 smithi057 ceph-mon[92072]: pgmap v13341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:54:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:25 smithi122 ceph-mon[125440]: pgmap v13341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:54:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:25 smithi136 ceph-mon[125702]: pgmap v13341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:54:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:27 smithi057 ceph-mon[92072]: pgmap v13342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:54:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:27 smithi122 ceph-mon[125440]: pgmap v13342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:54:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:27 smithi136 ceph-mon[125702]: pgmap v13342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:54:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:29 smithi057 ceph-mon[92072]: pgmap v13343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:54:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:29 smithi122 ceph-mon[125440]: pgmap v13343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:54:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:29 smithi136 ceph-mon[125702]: pgmap v13343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:54:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:31 smithi057 ceph-mon[92072]: pgmap v13344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:31 smithi122 ceph-mon[125440]: pgmap v13344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:31 smithi136 ceph-mon[125702]: pgmap v13344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:33.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:33 smithi057 ceph-mon[92072]: pgmap v13345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:33 smithi122 ceph-mon[125440]: pgmap v13345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:33 smithi136 ceph-mon[125702]: pgmap v13345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:35 smithi057 ceph-mon[92072]: pgmap v13346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:35 smithi122 ceph-mon[125440]: pgmap v13346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:35 smithi136 ceph-mon[125702]: pgmap v13346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:37.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:37 smithi057 ceph-mon[92072]: pgmap v13347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:37 smithi122 ceph-mon[125440]: pgmap v13347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:37 smithi136 ceph-mon[125702]: pgmap v13347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:38.292+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:54:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:38.292+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:54:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:38.292+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:54:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:38.292+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:54:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:38.292+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:54:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:39 smithi122 ceph-mon[125440]: pgmap v13348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:39 smithi136 ceph-mon[125702]: pgmap v13348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:39 smithi057 ceph-mon[92072]: pgmap v13348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:41 smithi122 ceph-mon[125440]: pgmap v13349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:41 smithi136 ceph-mon[125702]: pgmap v13349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:41 smithi057 ceph-mon[92072]: pgmap v13349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:43 smithi122 ceph-mon[125440]: pgmap v13350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:43 smithi136 ceph-mon[125702]: pgmap v13350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:43 smithi057 ceph-mon[92072]: pgmap v13350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:45 smithi122 ceph-mon[125440]: pgmap v13351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:45 smithi136 ceph-mon[125702]: pgmap v13351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:45 smithi057 ceph-mon[92072]: pgmap v13351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:47.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:47 smithi122 ceph-mon[125440]: pgmap v13352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:47 smithi136 ceph-mon[125702]: pgmap v13352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:47 smithi057 ceph-mon[92072]: pgmap v13352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:49 smithi136 ceph-mon[125702]: pgmap v13353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:49 smithi057 ceph-mon[92072]: pgmap v13353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:49 smithi122 ceph-mon[125440]: pgmap v13353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:51 smithi136 ceph-mon[125702]: pgmap v13354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:51 smithi057 ceph-mon[92072]: pgmap v13354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:51 smithi122 ceph-mon[125440]: pgmap v13354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:53.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:53.307+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:54:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:53.308+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:54:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:53.308+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:54:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:53.308+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:54:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:54:53.308+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:54:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:53 smithi136 ceph-mon[125702]: pgmap v13355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:53 smithi057 ceph-mon[92072]: pgmap v13355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:53 smithi122 ceph-mon[125440]: pgmap v13355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:55 smithi136 ceph-mon[125702]: pgmap v13356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:55 smithi057 ceph-mon[92072]: pgmap v13356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:55 smithi122 ceph-mon[125440]: pgmap v13356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:57 smithi136 ceph-mon[125702]: pgmap v13357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:57 smithi057 ceph-mon[92072]: pgmap v13357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:57 smithi122 ceph-mon[125440]: pgmap v13357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:54:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:54:59 smithi136 ceph-mon[125702]: pgmap v13358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:54:59 smithi057 ceph-mon[92072]: pgmap v13358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:54:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:54:59 smithi122 ceph-mon[125440]: pgmap v13358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:01 smithi136 ceph-mon[125702]: pgmap v13359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:01 smithi057 ceph-mon[92072]: pgmap v13359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:01 smithi122 ceph-mon[125440]: pgmap v13359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:03 smithi136 ceph-mon[125702]: pgmap v13360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:55:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:03 smithi057 ceph-mon[92072]: pgmap v13360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:55:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:03 smithi122 ceph-mon[125440]: pgmap v13360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:55:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:05 smithi136 ceph-mon[125702]: pgmap v13361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:55:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:55:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:05 smithi057 ceph-mon[92072]: pgmap v13361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:55:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:55:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:05 smithi122 ceph-mon[125440]: pgmap v13361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:55:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:55:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:55:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:55:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:55:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:55:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:55:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:55:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:55:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:55:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:55:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:07 smithi136 ceph-mon[125702]: pgmap v13362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:55:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:07 smithi136 ceph-mon[125702]: osdmap e908: 12 total, 12 up, 12 in 2023-03-02T17:55:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:07 smithi057 ceph-mon[92072]: pgmap v13362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:55:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:07 smithi057 ceph-mon[92072]: osdmap e908: 12 total, 12 up, 12 in 2023-03-02T17:55:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:07 smithi122 ceph-mon[125440]: pgmap v13362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:55:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:07 smithi122 ceph-mon[125440]: osdmap e908: 12 total, 12 up, 12 in 2023-03-02T17:55:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:08.309+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:55:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:08.309+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:55:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:08.309+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:55:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:08.309+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:55:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:08.309+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:55:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:09 smithi136 ceph-mon[125702]: pgmap v13364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:55:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:09 smithi057 ceph-mon[92072]: pgmap v13364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:55:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:09 smithi122 ceph-mon[125440]: pgmap v13364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:55:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:11 smithi136 ceph-mon[125702]: pgmap v13365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:55:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:11 smithi057 ceph-mon[92072]: pgmap v13365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:55:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:11 smithi122 ceph-mon[125440]: pgmap v13365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:55:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:13 smithi136 ceph-mon[125702]: pgmap v13366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:55:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:13 smithi057 ceph-mon[92072]: pgmap v13366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:55:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:13 smithi122 ceph-mon[125440]: pgmap v13366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:55:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:15 smithi136 ceph-mon[125702]: pgmap v13367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:55:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:15 smithi057 ceph-mon[92072]: pgmap v13367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:55:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:15 smithi122 ceph-mon[125440]: pgmap v13367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:55:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:17 smithi057 ceph-mon[92072]: pgmap v13368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:55:17.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:17 smithi057 ceph-mon[92072]: osdmap e909: 12 total, 12 up, 12 in 2023-03-02T17:55:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:17 smithi122 ceph-mon[125440]: pgmap v13368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:55:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:17 smithi122 ceph-mon[125440]: osdmap e909: 12 total, 12 up, 12 in 2023-03-02T17:55:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:17 smithi136 ceph-mon[125702]: pgmap v13368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:55:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:17 smithi136 ceph-mon[125702]: osdmap e909: 12 total, 12 up, 12 in 2023-03-02T17:55:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:19 smithi057 ceph-mon[92072]: pgmap v13370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:55:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:19 smithi122 ceph-mon[125440]: pgmap v13370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:55:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:19 smithi136 ceph-mon[125702]: pgmap v13370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:55:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:21 smithi057 ceph-mon[92072]: pgmap v13371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:55:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:21 smithi122 ceph-mon[125440]: pgmap v13371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:55:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:21 smithi136 ceph-mon[125702]: pgmap v13371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:55:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:23.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:55:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:23.317+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:55:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:23.317+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:55:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:23.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:55:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:23.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:55:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:23 smithi057 ceph-mon[92072]: pgmap v13372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:55:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:23 smithi122 ceph-mon[125440]: pgmap v13372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:55:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:23 smithi136 ceph-mon[125702]: pgmap v13372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:55:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:25 smithi057 ceph-mon[92072]: pgmap v13373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:55:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:25 smithi122 ceph-mon[125440]: pgmap v13373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:55:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:25 smithi136 ceph-mon[125702]: pgmap v13373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:55:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:27 smithi057 ceph-mon[92072]: pgmap v13374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:55:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:27 smithi122 ceph-mon[125440]: pgmap v13374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:55:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:27 smithi136 ceph-mon[125702]: pgmap v13374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:55:29.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:29 smithi057 ceph-mon[92072]: pgmap v13375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:55:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:29 smithi122 ceph-mon[125440]: pgmap v13375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:55:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:29 smithi136 ceph-mon[125702]: pgmap v13375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:55:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:31 smithi122 ceph-mon[125440]: pgmap v13376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:31 smithi136 ceph-mon[125702]: pgmap v13376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:31 smithi057 ceph-mon[92072]: pgmap v13376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:33 smithi122 ceph-mon[125440]: pgmap v13377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:33 smithi136 ceph-mon[125702]: pgmap v13377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:33 smithi057 ceph-mon[92072]: pgmap v13377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:35 smithi122 ceph-mon[125440]: pgmap v13378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:35 smithi136 ceph-mon[125702]: pgmap v13378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:35 smithi057 ceph-mon[92072]: pgmap v13378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:37 smithi122 ceph-mon[125440]: pgmap v13379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:37 smithi136 ceph-mon[125702]: pgmap v13379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:37 smithi057 ceph-mon[92072]: pgmap v13379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:38.329+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:55:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:38.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:55:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:38.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:55:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:38.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:55:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:38.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:55:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:39 smithi122 ceph-mon[125440]: pgmap v13380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:39 smithi136 ceph-mon[125702]: pgmap v13380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:39 smithi057 ceph-mon[92072]: pgmap v13380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:41 smithi122 ceph-mon[125440]: pgmap v13381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:41 smithi136 ceph-mon[125702]: pgmap v13381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:41 smithi057 ceph-mon[92072]: pgmap v13381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:43 smithi136 ceph-mon[125702]: pgmap v13382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:43 smithi057 ceph-mon[92072]: pgmap v13382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:43 smithi122 ceph-mon[125440]: pgmap v13382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:45 smithi136 ceph-mon[125702]: pgmap v13383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:45 smithi057 ceph-mon[92072]: pgmap v13383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:45 smithi122 ceph-mon[125440]: pgmap v13383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:47 smithi136 ceph-mon[125702]: pgmap v13384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:47 smithi057 ceph-mon[92072]: pgmap v13384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:47 smithi122 ceph-mon[125440]: pgmap v13384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:49 smithi136 ceph-mon[125702]: pgmap v13385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:49 smithi057 ceph-mon[92072]: pgmap v13385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:49 smithi122 ceph-mon[125440]: pgmap v13385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:51 smithi136 ceph-mon[125702]: pgmap v13386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:51 smithi057 ceph-mon[92072]: pgmap v13386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:51 smithi122 ceph-mon[125440]: pgmap v13386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:53.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:55:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:53.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:55:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:53.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:55:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:53.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:55:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:55:53.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:55:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:53 smithi136 ceph-mon[125702]: pgmap v13387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:53 smithi057 ceph-mon[92072]: pgmap v13387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:53 smithi122 ceph-mon[125440]: pgmap v13387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:55 smithi136 ceph-mon[125702]: pgmap v13388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:55 smithi057 ceph-mon[92072]: pgmap v13388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:55 smithi122 ceph-mon[125440]: pgmap v13388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:57 smithi136 ceph-mon[125702]: pgmap v13389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:57 smithi057 ceph-mon[92072]: pgmap v13389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:57 smithi122 ceph-mon[125440]: pgmap v13389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:55:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:55:59 smithi136 ceph-mon[125702]: pgmap v13390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:55:59 smithi057 ceph-mon[92072]: pgmap v13390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:55:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:55:59 smithi122 ceph-mon[125440]: pgmap v13390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:01 smithi136 ceph-mon[125702]: pgmap v13391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:01 smithi057 ceph-mon[92072]: pgmap v13391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:01 smithi122 ceph-mon[125440]: pgmap v13391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:03 smithi136 ceph-mon[125702]: pgmap v13392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:56:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:03 smithi057 ceph-mon[92072]: pgmap v13392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:56:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:03 smithi122 ceph-mon[125440]: pgmap v13392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:56:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:05 smithi136 ceph-mon[125702]: pgmap v13393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:56:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:05 smithi057 ceph-mon[92072]: pgmap v13393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:56:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:05 smithi122 ceph-mon[125440]: pgmap v13393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:56:06.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:56:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:56:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:56:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:07 smithi136 ceph-mon[125702]: pgmap v13394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:56:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:56:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:56:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:56:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:07 smithi057 ceph-mon[92072]: pgmap v13394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:56:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:56:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:56:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:56:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:07 smithi122 ceph-mon[125440]: pgmap v13394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:56:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:56:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:56:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:56:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:08.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:56:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:08.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:56:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:08.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:56:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:08.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:56:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:08.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:56:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:09 smithi136 ceph-mon[125702]: pgmap v13395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:56:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:09 smithi057 ceph-mon[92072]: pgmap v13395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:56:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:09 smithi122 ceph-mon[125440]: pgmap v13395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:56:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:11 smithi136 ceph-mon[125702]: pgmap v13396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:56:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:11 smithi057 ceph-mon[92072]: pgmap v13396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:56:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:11 smithi122 ceph-mon[125440]: pgmap v13396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:56:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:11.983+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:56:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:11.983+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:56:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:11.983+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 195 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:56:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:11.983+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 194 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:56:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:12 smithi136 ceph-mon[125702]: osdmap e910: 12 total, 12 up, 12 in 2023-03-02T17:56:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:12 smithi057 ceph-mon[92072]: osdmap e910: 12 total, 12 up, 12 in 2023-03-02T17:56:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:12 smithi122 ceph-mon[125440]: osdmap e910: 12 total, 12 up, 12 in 2023-03-02T17:56:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:13 smithi136 ceph-mon[125702]: pgmap v13398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:13 smithi057 ceph-mon[92072]: pgmap v13398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:13 smithi122 ceph-mon[125440]: pgmap v13398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:15 smithi136 ceph-mon[125702]: pgmap v13399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:15 smithi057 ceph-mon[92072]: pgmap v13399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:15 smithi122 ceph-mon[125440]: pgmap v13399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:17 smithi136 ceph-mon[125702]: pgmap v13400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:17 smithi057 ceph-mon[92072]: pgmap v13400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:17 smithi122 ceph-mon[125440]: pgmap v13400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:19 smithi136 ceph-mon[125702]: pgmap v13401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:56:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:19 smithi057 ceph-mon[92072]: pgmap v13401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:56:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:19 smithi122 ceph-mon[125440]: pgmap v13401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:56:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:21 smithi136 ceph-mon[125702]: pgmap v13402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:56:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:21 smithi136 ceph-mon[125702]: osdmap e911: 12 total, 12 up, 12 in 2023-03-02T17:56:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:21 smithi057 ceph-mon[92072]: pgmap v13402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:56:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:21 smithi057 ceph-mon[92072]: osdmap e911: 12 total, 12 up, 12 in 2023-03-02T17:56:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:21 smithi122 ceph-mon[125440]: pgmap v13402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T17:56:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:21 smithi122 ceph-mon[125440]: osdmap e911: 12 total, 12 up, 12 in 2023-03-02T17:56:23.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:23.373+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:56:23.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:23.373+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:56:23.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:23.373+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:56:23.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:23.373+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:56:23.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:23.373+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:56:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:23 smithi136 ceph-mon[125702]: pgmap v13404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:23 smithi057 ceph-mon[92072]: pgmap v13404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:23 smithi122 ceph-mon[125440]: pgmap v13404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:25 smithi136 ceph-mon[125702]: pgmap v13405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:25 smithi057 ceph-mon[92072]: pgmap v13405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:25 smithi122 ceph-mon[125440]: pgmap v13405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:27 smithi136 ceph-mon[125702]: pgmap v13406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:27 smithi057 ceph-mon[92072]: pgmap v13406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:27 smithi122 ceph-mon[125440]: pgmap v13406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:56:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:29 smithi136 ceph-mon[125702]: pgmap v13407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:56:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:29 smithi057 ceph-mon[92072]: pgmap v13407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:56:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:29 smithi122 ceph-mon[125440]: pgmap v13407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:56:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:31 smithi057 ceph-mon[92072]: pgmap v13408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:56:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:31 smithi122 ceph-mon[125440]: pgmap v13408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:56:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:31 smithi136 ceph-mon[125702]: pgmap v13408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:56:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:33 smithi057 ceph-mon[92072]: pgmap v13409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 op/s 2023-03-02T17:56:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:33 smithi122 ceph-mon[125440]: pgmap v13409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 op/s 2023-03-02T17:56:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:33 smithi136 ceph-mon[125702]: pgmap v13409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 op/s 2023-03-02T17:56:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:35 smithi057 ceph-mon[92072]: pgmap v13410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:35 smithi122 ceph-mon[125440]: pgmap v13410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:35 smithi136 ceph-mon[125702]: pgmap v13410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:37 smithi057 ceph-mon[92072]: pgmap v13411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:37 smithi122 ceph-mon[125440]: pgmap v13411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:37 smithi136 ceph-mon[125702]: pgmap v13411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:38.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:56:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:38.389+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:56:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:38.389+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:56:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:38.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:56:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:38.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:56:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:39 smithi057 ceph-mon[92072]: pgmap v13412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:39 smithi122 ceph-mon[125440]: pgmap v13412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:39 smithi136 ceph-mon[125702]: pgmap v13412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:41 smithi057 ceph-mon[92072]: pgmap v13413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:41 smithi122 ceph-mon[125440]: pgmap v13413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:41 smithi136 ceph-mon[125702]: pgmap v13413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:43 smithi057 ceph-mon[92072]: pgmap v13414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:43 smithi122 ceph-mon[125440]: pgmap v13414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:43 smithi136 ceph-mon[125702]: pgmap v13414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:45 smithi057 ceph-mon[92072]: pgmap v13415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:45 smithi122 ceph-mon[125440]: pgmap v13415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:45 smithi136 ceph-mon[125702]: pgmap v13415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:47 smithi057 ceph-mon[92072]: pgmap v13416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:47 smithi122 ceph-mon[125440]: pgmap v13416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:47 smithi136 ceph-mon[125702]: pgmap v13416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:49 smithi057 ceph-mon[92072]: pgmap v13417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:49 smithi122 ceph-mon[125440]: pgmap v13417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:49 smithi136 ceph-mon[125702]: pgmap v13417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:51 smithi057 ceph-mon[92072]: pgmap v13418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:51 smithi122 ceph-mon[125440]: pgmap v13418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:51 smithi136 ceph-mon[125702]: pgmap v13418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:53.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:56:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:53.404+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:56:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:53.404+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:56:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:53.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:56:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:56:53.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:56:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:53 smithi057 ceph-mon[92072]: pgmap v13419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:53 smithi122 ceph-mon[125440]: pgmap v13419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:53 smithi136 ceph-mon[125702]: pgmap v13419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:55 smithi057 ceph-mon[92072]: pgmap v13420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:55 smithi122 ceph-mon[125440]: pgmap v13420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:55 smithi136 ceph-mon[125702]: pgmap v13420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:57 smithi057 ceph-mon[92072]: pgmap v13421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:57 smithi122 ceph-mon[125440]: pgmap v13421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:57 smithi136 ceph-mon[125702]: pgmap v13421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:56:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:56:59 smithi057 ceph-mon[92072]: pgmap v13422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:56:59 smithi122 ceph-mon[125440]: pgmap v13422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:56:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:56:59 smithi136 ceph-mon[125702]: pgmap v13422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:01 smithi057 ceph-mon[92072]: pgmap v13423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:01 smithi122 ceph-mon[125440]: pgmap v13423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:01 smithi136 ceph-mon[125702]: pgmap v13423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:03 smithi057 ceph-mon[92072]: pgmap v13424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:57:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:03 smithi122 ceph-mon[125440]: pgmap v13424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:57:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:03 smithi136 ceph-mon[125702]: pgmap v13424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:57:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:05 smithi057 ceph-mon[92072]: pgmap v13425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:57:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:05 smithi122 ceph-mon[125440]: pgmap v13425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:57:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:05 smithi136 ceph-mon[125702]: pgmap v13425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:57:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:07 smithi122 ceph-mon[125440]: pgmap v13426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:57:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:57:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:57:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:57:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:57:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:07 smithi136 ceph-mon[125702]: pgmap v13426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:57:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:57:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:57:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:57:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:57:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:07 smithi057 ceph-mon[92072]: pgmap v13426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T17:57:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:57:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:57:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:57:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:57:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:08.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:57:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:08.412+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:57:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:08.412+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:57:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:08.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:57:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:08.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:57:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:09 smithi136 ceph-mon[125702]: pgmap v13427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:57:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:09 smithi057 ceph-mon[92072]: pgmap v13427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:57:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:09 smithi122 ceph-mon[125440]: pgmap v13427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:57:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:11 smithi136 ceph-mon[125702]: pgmap v13428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:57:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:11 smithi057 ceph-mon[92072]: pgmap v13428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:57:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:11 smithi122 ceph-mon[125440]: pgmap v13428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:57:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:12 smithi136 ceph-mon[125702]: osdmap e912: 12 total, 12 up, 12 in 2023-03-02T17:57:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:12 smithi057 ceph-mon[92072]: osdmap e912: 12 total, 12 up, 12 in 2023-03-02T17:57:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:12 smithi122 ceph-mon[125440]: osdmap e912: 12 total, 12 up, 12 in 2023-03-02T17:57:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:13 smithi136 ceph-mon[125702]: pgmap v13430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:13 smithi057 ceph-mon[92072]: pgmap v13430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:13 smithi122 ceph-mon[125440]: pgmap v13430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:15 smithi136 ceph-mon[125702]: pgmap v13431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:15 smithi057 ceph-mon[92072]: pgmap v13431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:15 smithi122 ceph-mon[125440]: pgmap v13431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:17 smithi136 ceph-mon[125702]: pgmap v13432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:17 smithi057 ceph-mon[92072]: pgmap v13432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:17 smithi122 ceph-mon[125440]: pgmap v13432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:19 smithi136 ceph-mon[125702]: pgmap v13433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:19 smithi057 ceph-mon[92072]: pgmap v13433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:19 smithi122 ceph-mon[125440]: pgmap v13433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:21 smithi136 ceph-mon[125702]: pgmap v13434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:21 smithi136 ceph-mon[125702]: osdmap e913: 12 total, 12 up, 12 in 2023-03-02T17:57:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:21 smithi057 ceph-mon[92072]: pgmap v13434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:21 smithi057 ceph-mon[92072]: osdmap e913: 12 total, 12 up, 12 in 2023-03-02T17:57:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:21 smithi122 ceph-mon[125440]: pgmap v13434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:57:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:21 smithi122 ceph-mon[125440]: osdmap e913: 12 total, 12 up, 12 in 2023-03-02T17:57:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:23.428+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:57:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:23.428+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:57:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:23.428+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:57:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:23.428+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:57:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:23.428+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:57:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:23 smithi136 ceph-mon[125702]: pgmap v13436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:57:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:23 smithi057 ceph-mon[92072]: pgmap v13436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:57:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:23 smithi122 ceph-mon[125440]: pgmap v13436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:57:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:25 smithi136 ceph-mon[125702]: pgmap v13437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:57:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:25 smithi057 ceph-mon[92072]: pgmap v13437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:57:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:25 smithi122 ceph-mon[125440]: pgmap v13437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:57:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:27 smithi136 ceph-mon[125702]: pgmap v13438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:57:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:27 smithi057 ceph-mon[92072]: pgmap v13438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:57:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:27 smithi122 ceph-mon[125440]: pgmap v13438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:57:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:29 smithi136 ceph-mon[125702]: pgmap v13439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:57:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:29 smithi057 ceph-mon[92072]: pgmap v13439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:57:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:29 smithi122 ceph-mon[125440]: pgmap v13439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:57:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:31 smithi136 ceph-mon[125702]: pgmap v13440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:57:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:31 smithi057 ceph-mon[92072]: pgmap v13440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:57:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:31 smithi122 ceph-mon[125440]: pgmap v13440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:57:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:33 smithi136 ceph-mon[125702]: pgmap v13441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 op/s 2023-03-02T17:57:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:33 smithi057 ceph-mon[92072]: pgmap v13441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 op/s 2023-03-02T17:57:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:33 smithi122 ceph-mon[125440]: pgmap v13441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 op/s 2023-03-02T17:57:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:35 smithi136 ceph-mon[125702]: pgmap v13442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:35 smithi057 ceph-mon[92072]: pgmap v13442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:35 smithi122 ceph-mon[125440]: pgmap v13442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:37 smithi136 ceph-mon[125702]: pgmap v13443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:37 smithi057 ceph-mon[92072]: pgmap v13443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:37 smithi122 ceph-mon[125440]: pgmap v13443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:38.442 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:38.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:57:38.442 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:38.442+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:57:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:38.442+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:57:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:38.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:57:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:38.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:57:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:39 smithi136 ceph-mon[125702]: pgmap v13444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:39 smithi057 ceph-mon[92072]: pgmap v13444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:39 smithi122 ceph-mon[125440]: pgmap v13444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:41 smithi136 ceph-mon[125702]: pgmap v13445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:41 smithi057 ceph-mon[92072]: pgmap v13445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:41 smithi122 ceph-mon[125440]: pgmap v13445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:43 smithi136 ceph-mon[125702]: pgmap v13446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:43 smithi057 ceph-mon[92072]: pgmap v13446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:43 smithi122 ceph-mon[125440]: pgmap v13446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:45 smithi136 ceph-mon[125702]: pgmap v13447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:45 smithi057 ceph-mon[92072]: pgmap v13447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:45 smithi122 ceph-mon[125440]: pgmap v13447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:47 smithi136 ceph-mon[125702]: pgmap v13448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:47 smithi057 ceph-mon[92072]: pgmap v13448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:47 smithi122 ceph-mon[125440]: pgmap v13448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:49 smithi136 ceph-mon[125702]: pgmap v13449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:49 smithi057 ceph-mon[92072]: pgmap v13449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:49 smithi122 ceph-mon[125440]: pgmap v13449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:51 smithi136 ceph-mon[125702]: pgmap v13450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:51 smithi057 ceph-mon[92072]: pgmap v13450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:51 smithi122 ceph-mon[125440]: pgmap v13450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:53.453+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:57:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:53.454+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:57:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:53.454+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:57:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:53.454+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:57:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:57:53.454+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:57:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:53 smithi057 ceph-mon[92072]: pgmap v13451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:53 smithi122 ceph-mon[125440]: pgmap v13451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:53 smithi136 ceph-mon[125702]: pgmap v13451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:55 smithi057 ceph-mon[92072]: pgmap v13452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:55 smithi122 ceph-mon[125440]: pgmap v13452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:55 smithi136 ceph-mon[125702]: pgmap v13452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:57 smithi057 ceph-mon[92072]: pgmap v13453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:57 smithi122 ceph-mon[125440]: pgmap v13453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:57 smithi136 ceph-mon[125702]: pgmap v13453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:57:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:57:59 smithi057 ceph-mon[92072]: pgmap v13454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:57:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:57:59 smithi122 ceph-mon[125440]: pgmap v13454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:57:59 smithi136 ceph-mon[125702]: pgmap v13454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:01 smithi057 ceph-mon[92072]: pgmap v13455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:01 smithi122 ceph-mon[125440]: pgmap v13455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:01 smithi136 ceph-mon[125702]: pgmap v13455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:03 smithi057 ceph-mon[92072]: pgmap v13456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:58:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:03 smithi122 ceph-mon[125440]: pgmap v13456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:58:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:03 smithi136 ceph-mon[125702]: pgmap v13456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:58:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:05 smithi057 ceph-mon[92072]: pgmap v13457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:58:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:05 smithi122 ceph-mon[125440]: pgmap v13457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:58:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:05 smithi136 ceph-mon[125702]: pgmap v13457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:58:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:07 smithi057 ceph-mon[92072]: pgmap v13458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:58:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:07 smithi057 ceph-mon[92072]: osdmap e914: 12 total, 12 up, 12 in 2023-03-02T17:58:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:58:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:07 smithi122 ceph-mon[125440]: pgmap v13458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:58:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:07 smithi122 ceph-mon[125440]: osdmap e914: 12 total, 12 up, 12 in 2023-03-02T17:58:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:58:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:07 smithi136 ceph-mon[125702]: pgmap v13458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:58:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:07 smithi136 ceph-mon[125702]: osdmap e914: 12 total, 12 up, 12 in 2023-03-02T17:58:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:58:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:08.469+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:58:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:08.469+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:58:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:08.469+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:58:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:08.469+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:58:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:08.469+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:58:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:58:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:58:08.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:58:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:58:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:58:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:58:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:58:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:58:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:58:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:09 smithi057 ceph-mon[92072]: pgmap v13460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:58:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:09 smithi122 ceph-mon[125440]: pgmap v13460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:58:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:09 smithi136 ceph-mon[125702]: pgmap v13460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:58:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:11 smithi057 ceph-mon[92072]: pgmap v13461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:58:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:11 smithi122 ceph-mon[125440]: pgmap v13461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:58:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:11 smithi136 ceph-mon[125702]: pgmap v13461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:58:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:13 smithi057 ceph-mon[92072]: pgmap v13462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:58:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:13 smithi122 ceph-mon[125440]: pgmap v13462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:58:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:13 smithi136 ceph-mon[125702]: pgmap v13462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:58:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:15 smithi057 ceph-mon[92072]: pgmap v13463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:58:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:15 smithi122 ceph-mon[125440]: pgmap v13463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:58:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:15 smithi136 ceph-mon[125702]: pgmap v13463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:58:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:17 smithi122 ceph-mon[125440]: pgmap v13464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:58:17.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:17 smithi122 ceph-mon[125440]: osdmap e915: 12 total, 12 up, 12 in 2023-03-02T17:58:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:17 smithi136 ceph-mon[125702]: pgmap v13464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:58:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:17 smithi136 ceph-mon[125702]: osdmap e915: 12 total, 12 up, 12 in 2023-03-02T17:58:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:17 smithi057 ceph-mon[92072]: pgmap v13464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:58:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:17 smithi057 ceph-mon[92072]: osdmap e915: 12 total, 12 up, 12 in 2023-03-02T17:58:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:19 smithi122 ceph-mon[125440]: pgmap v13466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:58:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:19 smithi136 ceph-mon[125702]: pgmap v13466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:58:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:19 smithi057 ceph-mon[92072]: pgmap v13466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:58:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:21 smithi122 ceph-mon[125440]: pgmap v13467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:58:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:21 smithi136 ceph-mon[125702]: pgmap v13467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:58:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:21 smithi057 ceph-mon[92072]: pgmap v13467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:58:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:23.480+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:58:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:23.480+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:58:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:23.480+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:58:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:23.480+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:58:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:23.480+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:58:23.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:23 smithi136 ceph-mon[125702]: pgmap v13468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:58:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:23 smithi057 ceph-mon[92072]: pgmap v13468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:58:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:23 smithi122 ceph-mon[125440]: pgmap v13468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:58:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:25 smithi136 ceph-mon[125702]: pgmap v13469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:58:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:25 smithi057 ceph-mon[92072]: pgmap v13469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:58:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:25 smithi122 ceph-mon[125440]: pgmap v13469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:58:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:27 smithi136 ceph-mon[125702]: pgmap v13470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:58:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:27 smithi057 ceph-mon[92072]: pgmap v13470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:58:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:27 smithi122 ceph-mon[125440]: pgmap v13470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:58:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:29 smithi136 ceph-mon[125702]: pgmap v13471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:58:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:29 smithi057 ceph-mon[92072]: pgmap v13471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:58:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:29 smithi122 ceph-mon[125440]: pgmap v13471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:58:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:31 smithi136 ceph-mon[125702]: pgmap v13472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:31 smithi057 ceph-mon[92072]: pgmap v13472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:31 smithi122 ceph-mon[125440]: pgmap v13472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:33 smithi136 ceph-mon[125702]: pgmap v13473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:33 smithi057 ceph-mon[92072]: pgmap v13473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:33 smithi122 ceph-mon[125440]: pgmap v13473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:35 smithi136 ceph-mon[125702]: pgmap v13474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:35 smithi057 ceph-mon[92072]: pgmap v13474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:35 smithi122 ceph-mon[125440]: pgmap v13474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:37 smithi136 ceph-mon[125702]: pgmap v13475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:37 smithi057 ceph-mon[92072]: pgmap v13475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:37 smithi122 ceph-mon[125440]: pgmap v13475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:38.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:58:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:38.497+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:58:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:38.497+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:58:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:38.497+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:58:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:38.497+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:58:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:39 smithi136 ceph-mon[125702]: pgmap v13476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:39 smithi057 ceph-mon[92072]: pgmap v13476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:39 smithi122 ceph-mon[125440]: pgmap v13476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:41 smithi136 ceph-mon[125702]: pgmap v13477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:41 smithi057 ceph-mon[92072]: pgmap v13477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:41 smithi122 ceph-mon[125440]: pgmap v13477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:43 smithi136 ceph-mon[125702]: pgmap v13478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:43 smithi057 ceph-mon[92072]: pgmap v13478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:43 smithi122 ceph-mon[125440]: pgmap v13478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:45 smithi136 ceph-mon[125702]: pgmap v13479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:45 smithi057 ceph-mon[92072]: pgmap v13479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:45 smithi122 ceph-mon[125440]: pgmap v13479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:47 smithi136 ceph-mon[125702]: pgmap v13480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:47 smithi057 ceph-mon[92072]: pgmap v13480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:47 smithi122 ceph-mon[125440]: pgmap v13480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:49 smithi136 ceph-mon[125702]: pgmap v13481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:49 smithi057 ceph-mon[92072]: pgmap v13481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:49 smithi122 ceph-mon[125440]: pgmap v13481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:51 smithi136 ceph-mon[125702]: pgmap v13482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:51 smithi057 ceph-mon[92072]: pgmap v13482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:51 smithi122 ceph-mon[125440]: pgmap v13482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:53.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:58:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:53.502+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:58:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:53.502+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:58:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:53.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:58:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:58:53.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:58:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:53 smithi136 ceph-mon[125702]: pgmap v13483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:53 smithi057 ceph-mon[92072]: pgmap v13483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:53 smithi122 ceph-mon[125440]: pgmap v13483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:55 smithi136 ceph-mon[125702]: pgmap v13484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:55 smithi057 ceph-mon[92072]: pgmap v13484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:55 smithi122 ceph-mon[125440]: pgmap v13484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:57 smithi136 ceph-mon[125702]: pgmap v13485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:57 smithi057 ceph-mon[92072]: pgmap v13485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:57 smithi122 ceph-mon[125440]: pgmap v13485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:58:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:58:59 smithi136 ceph-mon[125702]: pgmap v13486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:58:59 smithi057 ceph-mon[92072]: pgmap v13486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:58:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:58:59 smithi122 ceph-mon[125440]: pgmap v13486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:01 smithi136 ceph-mon[125702]: pgmap v13487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:01 smithi057 ceph-mon[92072]: pgmap v13487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:01 smithi122 ceph-mon[125440]: pgmap v13487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:03 smithi136 ceph-mon[125702]: pgmap v13488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:59:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:03 smithi057 ceph-mon[92072]: pgmap v13488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:59:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:03 smithi122 ceph-mon[125440]: pgmap v13488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T17:59:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:05 smithi136 ceph-mon[125702]: pgmap v13489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:59:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:05 smithi057 ceph-mon[92072]: pgmap v13489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:59:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:05 smithi122 ceph-mon[125440]: pgmap v13489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:59:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:07 smithi136 ceph-mon[125702]: pgmap v13490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:59:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:07 smithi136 ceph-mon[125702]: osdmap e916: 12 total, 12 up, 12 in 2023-03-02T17:59:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:07 smithi057 ceph-mon[92072]: pgmap v13490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:59:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:07 smithi057 ceph-mon[92072]: osdmap e916: 12 total, 12 up, 12 in 2023-03-02T17:59:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:07 smithi122 ceph-mon[125440]: pgmap v13490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T17:59:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:07 smithi122 ceph-mon[125440]: osdmap e916: 12 total, 12 up, 12 in 2023-03-02T17:59:08.420 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.420+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T17:59:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.420+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T17:59:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.420+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5850005b30 tx=0x7f58700b1000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:59:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.420+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5850005b30 tx=0x7f58700b1000 comp rx=0 tx=0).stop 2023-03-02T17:59:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.420+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T17:59:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.420+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T17:59:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.420+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T17:59:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.420+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T17:59:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.420+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:59:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.420+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f58700970d0 tx=0x7f5870074000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T17:59:08.518 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:59:08.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:59:08.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:59:08.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:59:08.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:08.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:59:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:59:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:59:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T17:59:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:09 smithi136 ceph-mon[125702]: pgmap v13492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:59:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:09 smithi057 ceph-mon[92072]: pgmap v13492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:59:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:09 smithi122 ceph-mon[125440]: pgmap v13492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:59:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:11 smithi136 ceph-mon[125702]: pgmap v13493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:59:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:11 smithi057 ceph-mon[92072]: pgmap v13493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:59:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:11 smithi122 ceph-mon[125440]: pgmap v13493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T17:59:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:12.010+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:59:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:12.010+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:59:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:12.010+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 196 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:59:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:12.010+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 195 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:59:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]': finished 2023-03-02T17:59:12.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:59:12.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:59:12.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]': finished 2023-03-02T17:59:12.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:59:12.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:59:12.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]': finished 2023-03-02T17:59:12.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T17:59:12.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T17:59:12.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T17:59:12.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T17:59:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:13 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:59:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:13 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:59:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:13 smithi057 ceph-mon[92072]: pgmap v13494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:59:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:13 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:59:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:13 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:59:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:13 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:59:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:13 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:59:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:13 smithi122 ceph-mon[125440]: pgmap v13494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:59:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:13 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:59:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:13 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:59:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:13 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T17:59:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:13 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T17:59:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:13 smithi136 ceph-mon[125702]: pgmap v13494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:59:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:13 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T17:59:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:13 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T17:59:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:15 smithi057 ceph-mon[92072]: pgmap v13495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:59:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:15 smithi122 ceph-mon[125440]: pgmap v13495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:59:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:15 smithi136 ceph-mon[125702]: pgmap v13495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:59:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:17 smithi136 ceph-mon[125702]: pgmap v13496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:59:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:17 smithi136 ceph-mon[125702]: osdmap e917: 12 total, 12 up, 12 in 2023-03-02T17:59:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:17 smithi057 ceph-mon[92072]: pgmap v13496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:59:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:17 smithi057 ceph-mon[92072]: osdmap e917: 12 total, 12 up, 12 in 2023-03-02T17:59:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:17 smithi122 ceph-mon[125440]: pgmap v13496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T17:59:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:17 smithi122 ceph-mon[125440]: osdmap e917: 12 total, 12 up, 12 in 2023-03-02T17:59:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:19 smithi136 ceph-mon[125702]: pgmap v13498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:59:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:19 smithi057 ceph-mon[92072]: pgmap v13498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:59:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:19 smithi122 ceph-mon[125440]: pgmap v13498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:59:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:21 smithi136 ceph-mon[125702]: pgmap v13499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:59:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:21 smithi057 ceph-mon[92072]: pgmap v13499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:59:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:21 smithi122 ceph-mon[125440]: pgmap v13499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T17:59:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:23.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:59:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:23.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:59:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:23.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:59:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:23.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:59:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:23.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:59:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:23 smithi136 ceph-mon[125702]: pgmap v13500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:59:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:23 smithi057 ceph-mon[92072]: pgmap v13500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:59:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:23 smithi122 ceph-mon[125440]: pgmap v13500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:59:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:25 smithi136 ceph-mon[125702]: pgmap v13501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:59:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:25 smithi057 ceph-mon[92072]: pgmap v13501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:59:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:25 smithi122 ceph-mon[125440]: pgmap v13501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:59:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:27 smithi136 ceph-mon[125702]: pgmap v13502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:59:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:27 smithi057 ceph-mon[92072]: pgmap v13502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:59:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:27 smithi122 ceph-mon[125440]: pgmap v13502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T17:59:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:29 smithi136 ceph-mon[125702]: pgmap v13503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:59:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:29 smithi057 ceph-mon[92072]: pgmap v13503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:59:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:29 smithi122 ceph-mon[125440]: pgmap v13503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T17:59:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:31 smithi136 ceph-mon[125702]: pgmap v13504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:31 smithi057 ceph-mon[92072]: pgmap v13504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:31 smithi122 ceph-mon[125440]: pgmap v13504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:33 smithi136 ceph-mon[125702]: pgmap v13505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:33 smithi057 ceph-mon[92072]: pgmap v13505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:33 smithi122 ceph-mon[125440]: pgmap v13505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:35 smithi136 ceph-mon[125702]: pgmap v13506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:35 smithi057 ceph-mon[92072]: pgmap v13506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:35 smithi122 ceph-mon[125440]: pgmap v13506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:37 smithi136 ceph-mon[125702]: pgmap v13507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:37 smithi057 ceph-mon[92072]: pgmap v13507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:37 smithi122 ceph-mon[125440]: pgmap v13507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:38.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:59:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:38.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:59:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:38.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:59:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:38.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:59:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:38.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:59:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:39 smithi136 ceph-mon[125702]: pgmap v13508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:39 smithi057 ceph-mon[92072]: pgmap v13508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:39 smithi122 ceph-mon[125440]: pgmap v13508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:41 smithi136 ceph-mon[125702]: pgmap v13509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:41 smithi057 ceph-mon[92072]: pgmap v13509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:41 smithi122 ceph-mon[125440]: pgmap v13509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:43 smithi136 ceph-mon[125702]: pgmap v13510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:43 smithi057 ceph-mon[92072]: pgmap v13510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:43 smithi122 ceph-mon[125440]: pgmap v13510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:45 smithi136 ceph-mon[125702]: pgmap v13511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:45 smithi057 ceph-mon[92072]: pgmap v13511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:45 smithi122 ceph-mon[125440]: pgmap v13511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:47 smithi136 ceph-mon[125702]: pgmap v13512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:47 smithi057 ceph-mon[92072]: pgmap v13512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:47 smithi122 ceph-mon[125440]: pgmap v13512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:49 smithi136 ceph-mon[125702]: pgmap v13513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:49 smithi057 ceph-mon[92072]: pgmap v13513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:49 smithi122 ceph-mon[125440]: pgmap v13513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:51 smithi136 ceph-mon[125702]: pgmap v13514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:51 smithi057 ceph-mon[92072]: pgmap v13514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:51 smithi122 ceph-mon[125440]: pgmap v13514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:53.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T17:59:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:53.559+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T17:59:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:53.559+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T17:59:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:53.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T17:59:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:53.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T17:59:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:53 smithi136 ceph-mon[125702]: pgmap v13515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:53 smithi057 ceph-mon[92072]: pgmap v13515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:53 smithi122 ceph-mon[125440]: pgmap v13515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:55 smithi136 ceph-mon[125702]: pgmap v13516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:55 smithi057 ceph-mon[92072]: pgmap v13516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:55 smithi122 ceph-mon[125440]: pgmap v13516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:57.017+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:59:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:57.017+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:59:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:57.017+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 196 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T17:59:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T17:59:57.017+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 197 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T17:59:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:57 smithi136 ceph-mon[125702]: pgmap v13517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:57 smithi057 ceph-mon[92072]: pgmap v13517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:57 smithi122 ceph-mon[125440]: pgmap v13517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T17:59:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 17:59:59 smithi136 ceph-mon[125702]: pgmap v13518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 17:59:59 smithi057 ceph-mon[92072]: pgmap v13518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T17:59:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 17:59:59 smithi122 ceph-mon[125440]: pgmap v13518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T18:00:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T18:00:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T18:00:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:01 smithi136 ceph-mon[125702]: pgmap v13519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:01 smithi057 ceph-mon[92072]: pgmap v13519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:01 smithi122 ceph-mon[125440]: pgmap v13519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:03 smithi136 ceph-mon[125702]: pgmap v13520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:00:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:03 smithi057 ceph-mon[92072]: pgmap v13520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:00:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:03 smithi122 ceph-mon[125440]: pgmap v13520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:00:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:05 smithi136 ceph-mon[125702]: pgmap v13521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:00:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:05 smithi057 ceph-mon[92072]: pgmap v13521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:00:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:05 smithi122 ceph-mon[125440]: pgmap v13521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:00:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:07 smithi136 ceph-mon[125702]: pgmap v13522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:00:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:07 smithi136 ceph-mon[125702]: osdmap e918: 12 total, 12 up, 12 in 2023-03-02T18:00:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:07 smithi057 ceph-mon[92072]: pgmap v13522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:00:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:07 smithi057 ceph-mon[92072]: osdmap e918: 12 total, 12 up, 12 in 2023-03-02T18:00:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:07 smithi122 ceph-mon[125440]: pgmap v13522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:00:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:07 smithi122 ceph-mon[125440]: osdmap e918: 12 total, 12 up, 12 in 2023-03-02T18:00:08.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:08.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:00:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:08.575+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:00:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:08.575+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:00:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:08.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:00:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:08.576+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:00:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:09 smithi122 ceph-mon[125440]: pgmap v13524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:00:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:09 smithi136 ceph-mon[125702]: pgmap v13524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:00:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:09 smithi057 ceph-mon[92072]: pgmap v13524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:00:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:11 smithi136 ceph-mon[125702]: pgmap v13525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:00:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:11 smithi057 ceph-mon[92072]: pgmap v13525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:00:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:11 smithi122 ceph-mon[125440]: pgmap v13525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:00:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:00:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:00:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:00:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:13 smithi136 ceph-mon[125702]: pgmap v13526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:00:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:00:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:00:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:00:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:13 smithi057 ceph-mon[92072]: pgmap v13526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:00:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:00:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:00:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:00:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:13 smithi122 ceph-mon[125440]: pgmap v13526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:00:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:00:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:00:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:00:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:15 smithi136 ceph-mon[125702]: pgmap v13527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:00:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:15 smithi057 ceph-mon[92072]: pgmap v13527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:00:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:15 smithi122 ceph-mon[125440]: pgmap v13527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:00:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:17 smithi136 ceph-mon[125702]: pgmap v13528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:00:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:17 smithi136 ceph-mon[125702]: osdmap e919: 12 total, 12 up, 12 in 2023-03-02T18:00:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:17 smithi057 ceph-mon[92072]: pgmap v13528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:00:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:17 smithi057 ceph-mon[92072]: osdmap e919: 12 total, 12 up, 12 in 2023-03-02T18:00:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:17 smithi122 ceph-mon[125440]: pgmap v13528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:00:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:17 smithi122 ceph-mon[125440]: osdmap e919: 12 total, 12 up, 12 in 2023-03-02T18:00:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:19 smithi136 ceph-mon[125702]: pgmap v13530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:00:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:19 smithi057 ceph-mon[92072]: pgmap v13530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:00:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:19 smithi122 ceph-mon[125440]: pgmap v13530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:00:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:21 smithi136 ceph-mon[125702]: pgmap v13531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:00:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:21 smithi057 ceph-mon[92072]: pgmap v13531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:00:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:21 smithi122 ceph-mon[125440]: pgmap v13531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:00:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:23.588+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:00:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:23.588+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:00:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:23.588+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:00:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:23.588+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:00:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:23.588+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:00:23.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:23 smithi136 ceph-mon[125702]: pgmap v13532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:00:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:23 smithi057 ceph-mon[92072]: pgmap v13532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:00:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:23 smithi122 ceph-mon[125440]: pgmap v13532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:00:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:25 smithi136 ceph-mon[125702]: pgmap v13533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:00:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:25 smithi057 ceph-mon[92072]: pgmap v13533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:00:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:25 smithi122 ceph-mon[125440]: pgmap v13533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:00:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:27 smithi136 ceph-mon[125702]: pgmap v13534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:00:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:27 smithi057 ceph-mon[92072]: pgmap v13534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:00:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:27 smithi122 ceph-mon[125440]: pgmap v13534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:00:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:29 smithi136 ceph-mon[125702]: pgmap v13535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:00:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:29 smithi057 ceph-mon[92072]: pgmap v13535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:00:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:29 smithi122 ceph-mon[125440]: pgmap v13535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:00:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:31 smithi136 ceph-mon[125702]: pgmap v13536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:31 smithi057 ceph-mon[92072]: pgmap v13536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:31 smithi122 ceph-mon[125440]: pgmap v13536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:33 smithi136 ceph-mon[125702]: pgmap v13537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:33 smithi057 ceph-mon[92072]: pgmap v13537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:33 smithi122 ceph-mon[125440]: pgmap v13537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:35 smithi136 ceph-mon[125702]: pgmap v13538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:35 smithi057 ceph-mon[92072]: pgmap v13538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:35 smithi122 ceph-mon[125440]: pgmap v13538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:37 smithi136 ceph-mon[125702]: pgmap v13539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:37 smithi057 ceph-mon[92072]: pgmap v13539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:37 smithi122 ceph-mon[125440]: pgmap v13539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:38.602+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:00:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:38.602+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:00:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:38.602+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:00:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:38.602+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:00:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:38.602+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:00:39.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:39 smithi136 ceph-mon[125702]: pgmap v13540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:39 smithi057 ceph-mon[92072]: pgmap v13540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:39 smithi122 ceph-mon[125440]: pgmap v13540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:41 smithi136 ceph-mon[125702]: pgmap v13541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:41 smithi057 ceph-mon[92072]: pgmap v13541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:41 smithi122 ceph-mon[125440]: pgmap v13541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:43 smithi136 ceph-mon[125702]: pgmap v13542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:43 smithi057 ceph-mon[92072]: pgmap v13542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:43 smithi122 ceph-mon[125440]: pgmap v13542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:45 smithi136 ceph-mon[125702]: pgmap v13543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:45 smithi057 ceph-mon[92072]: pgmap v13543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:45 smithi122 ceph-mon[125440]: pgmap v13543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:47 smithi136 ceph-mon[125702]: pgmap v13544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:47 smithi057 ceph-mon[92072]: pgmap v13544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:47 smithi122 ceph-mon[125440]: pgmap v13544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:49 smithi136 ceph-mon[125702]: pgmap v13545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:49 smithi057 ceph-mon[92072]: pgmap v13545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:49 smithi122 ceph-mon[125440]: pgmap v13545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:51 smithi136 ceph-mon[125702]: pgmap v13546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:51 smithi057 ceph-mon[92072]: pgmap v13546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:51 smithi122 ceph-mon[125440]: pgmap v13546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:53 smithi136 ceph-mon[125702]: pgmap v13547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:53.619+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:00:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:53.619+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:00:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:53.619+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:00:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:53.619+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:00:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:00:53.619+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:00:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:53 smithi057 ceph-mon[92072]: pgmap v13547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:53 smithi122 ceph-mon[125440]: pgmap v13547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:55 smithi136 ceph-mon[125702]: pgmap v13548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:55 smithi057 ceph-mon[92072]: pgmap v13548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:55 smithi122 ceph-mon[125440]: pgmap v13548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:57 smithi136 ceph-mon[125702]: pgmap v13549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:57 smithi057 ceph-mon[92072]: pgmap v13549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:57 smithi122 ceph-mon[125440]: pgmap v13549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:00:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:00:59 smithi136 ceph-mon[125702]: pgmap v13550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:00:59 smithi057 ceph-mon[92072]: pgmap v13550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:00:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:00:59 smithi122 ceph-mon[125440]: pgmap v13550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:01 smithi136 ceph-mon[125702]: pgmap v13551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:01 smithi057 ceph-mon[92072]: pgmap v13551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:01 smithi122 ceph-mon[125440]: pgmap v13551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:03 smithi136 ceph-mon[125702]: pgmap v13552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:01:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:03 smithi057 ceph-mon[92072]: pgmap v13552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:01:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:03 smithi122 ceph-mon[125440]: pgmap v13552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:01:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:05 smithi136 ceph-mon[125702]: pgmap v13553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:01:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:05 smithi057 ceph-mon[92072]: pgmap v13553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:01:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:05 smithi122 ceph-mon[125440]: pgmap v13553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:01:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:07 smithi136 ceph-mon[125702]: pgmap v13554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:01:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:07 smithi136 ceph-mon[125702]: osdmap e920: 12 total, 12 up, 12 in 2023-03-02T18:01:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:07 smithi057 ceph-mon[92072]: pgmap v13554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:01:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:07 smithi057 ceph-mon[92072]: osdmap e920: 12 total, 12 up, 12 in 2023-03-02T18:01:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:07 smithi122 ceph-mon[125440]: pgmap v13554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:01:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:07 smithi122 ceph-mon[125440]: osdmap e920: 12 total, 12 up, 12 in 2023-03-02T18:01:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:08.635+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:01:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:08.635+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:01:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:08.635+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:01:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:08.635+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:01:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:08.635+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:01:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:09 smithi136 ceph-mon[125702]: pgmap v13556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:01:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:09 smithi057 ceph-mon[92072]: pgmap v13556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:01:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:09 smithi122 ceph-mon[125440]: pgmap v13556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:01:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:11 smithi057 ceph-mon[92072]: pgmap v13557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:01:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:11 smithi057 ceph-mon[92072]: osdmap e921: 12 total, 12 up, 12 in 2023-03-02T18:01:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:11 smithi122 ceph-mon[125440]: pgmap v13557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:01:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:11 smithi122 ceph-mon[125440]: osdmap e921: 12 total, 12 up, 12 in 2023-03-02T18:01:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:11 smithi136 ceph-mon[125702]: pgmap v13557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:01:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:11 smithi136 ceph-mon[125702]: osdmap e921: 12 total, 12 up, 12 in 2023-03-02T18:01:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:13 smithi057 ceph-mon[92072]: pgmap v13559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:01:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:01:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:13 smithi122 ceph-mon[125440]: pgmap v13559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:01:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:01:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:13 smithi136 ceph-mon[125702]: pgmap v13559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:01:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:01:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:01:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:01:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:01:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:01:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:01:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:01:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:01:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:01:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:01:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:01:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:01:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:01:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:01:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:01:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:01:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:15 smithi057 ceph-mon[92072]: pgmap v13560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:01:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:15 smithi122 ceph-mon[125440]: pgmap v13560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:01:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:15 smithi136 ceph-mon[125702]: pgmap v13560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:01:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:17 smithi057 ceph-mon[92072]: pgmap v13561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T18:01:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:17 smithi122 ceph-mon[125440]: pgmap v13561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T18:01:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:17 smithi136 ceph-mon[125702]: pgmap v13561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T18:01:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:19 smithi057 ceph-mon[92072]: pgmap v13562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:01:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:19 smithi122 ceph-mon[125440]: pgmap v13562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:01:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:19 smithi136 ceph-mon[125702]: pgmap v13562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:01:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:21 smithi057 ceph-mon[92072]: pgmap v13563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:01:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:21 smithi122 ceph-mon[125440]: pgmap v13563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:01:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:21 smithi136 ceph-mon[125702]: pgmap v13563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:01:23.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:23.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:01:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:23.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:01:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:23.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:01:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:23.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:01:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:23.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:01:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:23 smithi057 ceph-mon[92072]: pgmap v13564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:01:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:23 smithi122 ceph-mon[125440]: pgmap v13564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:01:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:23 smithi136 ceph-mon[125702]: pgmap v13564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:01:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:25 smithi057 ceph-mon[92072]: pgmap v13565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:25 smithi122 ceph-mon[125440]: pgmap v13565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:25 smithi136 ceph-mon[125702]: pgmap v13565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:27 smithi057 ceph-mon[92072]: pgmap v13566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:27 smithi122 ceph-mon[125440]: pgmap v13566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:27 smithi136 ceph-mon[125702]: pgmap v13566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:29 smithi057 ceph-mon[92072]: pgmap v13567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:29 smithi122 ceph-mon[125440]: pgmap v13567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:29 smithi136 ceph-mon[125702]: pgmap v13567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:31 smithi057 ceph-mon[92072]: pgmap v13568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:31 smithi122 ceph-mon[125440]: pgmap v13568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:31 smithi136 ceph-mon[125702]: pgmap v13568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:33 smithi057 ceph-mon[92072]: pgmap v13569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:33 smithi122 ceph-mon[125440]: pgmap v13569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:33 smithi136 ceph-mon[125702]: pgmap v13569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:35 smithi057 ceph-mon[92072]: pgmap v13570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:35 smithi122 ceph-mon[125440]: pgmap v13570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:35 smithi136 ceph-mon[125702]: pgmap v13570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:37 smithi057 ceph-mon[92072]: pgmap v13571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:37 smithi122 ceph-mon[125440]: pgmap v13571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:37 smithi136 ceph-mon[125702]: pgmap v13571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:38.655+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:01:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:38.655+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:01:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:38.655+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:01:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:38.655+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:01:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:38.655+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:01:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:39 smithi122 ceph-mon[125440]: pgmap v13572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:39 smithi136 ceph-mon[125702]: pgmap v13572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:39 smithi057 ceph-mon[92072]: pgmap v13572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:41 smithi136 ceph-mon[125702]: pgmap v13573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:41 smithi057 ceph-mon[92072]: pgmap v13573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:41 smithi122 ceph-mon[125440]: pgmap v13573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:43 smithi136 ceph-mon[125702]: pgmap v13574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:43 smithi057 ceph-mon[92072]: pgmap v13574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:43 smithi122 ceph-mon[125440]: pgmap v13574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:45 smithi136 ceph-mon[125702]: pgmap v13575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:45 smithi057 ceph-mon[92072]: pgmap v13575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:45 smithi122 ceph-mon[125440]: pgmap v13575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:47 smithi136 ceph-mon[125702]: pgmap v13576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:47 smithi057 ceph-mon[92072]: pgmap v13576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:47 smithi122 ceph-mon[125440]: pgmap v13576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:49 smithi136 ceph-mon[125702]: pgmap v13577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:49 smithi057 ceph-mon[92072]: pgmap v13577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:49 smithi122 ceph-mon[125440]: pgmap v13577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:51 smithi136 ceph-mon[125702]: pgmap v13578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:51 smithi057 ceph-mon[92072]: pgmap v13578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:52.270 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:51 smithi122 ceph-mon[125440]: pgmap v13578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:53.658+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:01:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:53.658+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:01:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:53.658+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:01:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:53.658+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:01:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:01:53.658+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:01:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:53 smithi136 ceph-mon[125702]: pgmap v13579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:53 smithi057 ceph-mon[92072]: pgmap v13579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:53 smithi122 ceph-mon[125440]: pgmap v13579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:55 smithi136 ceph-mon[125702]: pgmap v13580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:55 smithi057 ceph-mon[92072]: pgmap v13580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:55 smithi122 ceph-mon[125440]: pgmap v13580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:57 smithi136 ceph-mon[125702]: pgmap v13581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:57 smithi057 ceph-mon[92072]: pgmap v13581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:57 smithi122 ceph-mon[125440]: pgmap v13581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:01:59.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:01:58 smithi136 ceph-mon[125702]: pgmap v13582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:01:58 smithi057 ceph-mon[92072]: pgmap v13582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:01:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:01:58 smithi122 ceph-mon[125440]: pgmap v13582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:01 smithi136 ceph-mon[125702]: pgmap v13583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:01.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:01 smithi057 ceph-mon[92072]: pgmap v13583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:01 smithi122 ceph-mon[125440]: pgmap v13583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:03 smithi136 ceph-mon[125702]: pgmap v13584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:02:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:03 smithi057 ceph-mon[92072]: pgmap v13584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:02:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:03 smithi122 ceph-mon[125440]: pgmap v13584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:02:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:05 smithi136 ceph-mon[125702]: pgmap v13585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:02:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:05 smithi057 ceph-mon[92072]: pgmap v13585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:02:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:05 smithi122 ceph-mon[125440]: pgmap v13585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:02:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:07 smithi136 ceph-mon[125702]: pgmap v13586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:02:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:07 smithi136 ceph-mon[125702]: osdmap e922: 12 total, 12 up, 12 in 2023-03-02T18:02:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:07 smithi057 ceph-mon[92072]: pgmap v13586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:02:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:07 smithi057 ceph-mon[92072]: osdmap e922: 12 total, 12 up, 12 in 2023-03-02T18:02:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:07 smithi122 ceph-mon[125440]: pgmap v13586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:02:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:07 smithi122 ceph-mon[125440]: osdmap e922: 12 total, 12 up, 12 in 2023-03-02T18:02:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:08.670+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:02:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:08.670+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:02:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:08.670+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:02:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:08.670+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:02:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:08.670+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:02:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:09 smithi136 ceph-mon[125702]: pgmap v13588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:02:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:09 smithi057 ceph-mon[92072]: pgmap v13588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:02:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:09 smithi122 ceph-mon[125440]: pgmap v13588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:02:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:11 smithi136 ceph-mon[125702]: pgmap v13589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:02:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:11 smithi057 ceph-mon[92072]: pgmap v13589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:02:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:11 smithi122 ceph-mon[125440]: pgmap v13589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:02:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:12.036+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:02:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:12.036+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:02:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:12.037+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 197 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:02:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:12.037+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 198 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:02:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:13 smithi136 ceph-mon[125702]: pgmap v13590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:02:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:13 smithi057 ceph-mon[92072]: pgmap v13590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:02:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:13 smithi122 ceph-mon[125440]: pgmap v13590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:02:15.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:15 smithi136 ceph-mon[125702]: pgmap v13591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:02:15.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:02:15.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:15.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:15.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:15.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:15 smithi057 ceph-mon[92072]: pgmap v13591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:02:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:02:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:15 smithi122 ceph-mon[125440]: pgmap v13591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:02:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:02:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:02:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:02:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:16 smithi136 ceph-mon[125702]: osdmap e923: 12 total, 12 up, 12 in 2023-03-02T18:02:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:02:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:02:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:16 smithi057 ceph-mon[92072]: osdmap e923: 12 total, 12 up, 12 in 2023-03-02T18:02:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:02:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:02:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:02:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:16 smithi122 ceph-mon[125440]: osdmap e923: 12 total, 12 up, 12 in 2023-03-02T18:02:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:17 smithi136 ceph-mon[125702]: pgmap v13592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:02:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:17 smithi057 ceph-mon[92072]: pgmap v13592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:02:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:17 smithi122 ceph-mon[125440]: pgmap v13592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:02:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:19 smithi136 ceph-mon[125702]: pgmap v13594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:02:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:19 smithi057 ceph-mon[92072]: pgmap v13594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:02:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:19 smithi122 ceph-mon[125440]: pgmap v13594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:02:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:21 smithi136 ceph-mon[125702]: pgmap v13595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:02:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:21 smithi057 ceph-mon[92072]: pgmap v13595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:02:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:21 smithi122 ceph-mon[125440]: pgmap v13595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:02:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:23 smithi136 ceph-mon[125702]: pgmap v13596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:02:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:23 smithi057 ceph-mon[92072]: pgmap v13596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:02:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:23.682+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:02:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:23.682+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:02:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:23.682+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:02:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:23.682+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:02:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:23.682+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:02:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:23 smithi122 ceph-mon[125440]: pgmap v13596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:02:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:25 smithi136 ceph-mon[125702]: pgmap v13597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:02:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:25 smithi057 ceph-mon[92072]: pgmap v13597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:02:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:25 smithi122 ceph-mon[125440]: pgmap v13597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:02:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:27 smithi136 ceph-mon[125702]: pgmap v13598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:02:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:27 smithi057 ceph-mon[92072]: pgmap v13598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:02:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:27 smithi122 ceph-mon[125440]: pgmap v13598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:02:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:29 smithi136 ceph-mon[125702]: pgmap v13599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:02:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:29 smithi057 ceph-mon[92072]: pgmap v13599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:02:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:29 smithi122 ceph-mon[125440]: pgmap v13599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:02:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:31 smithi136 ceph-mon[125702]: pgmap v13600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:02:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:31 smithi057 ceph-mon[92072]: pgmap v13600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:02:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:31 smithi122 ceph-mon[125440]: pgmap v13600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:02:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:33 smithi136 ceph-mon[125702]: pgmap v13601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:02:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:33 smithi057 ceph-mon[92072]: pgmap v13601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:02:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:33 smithi122 ceph-mon[125440]: pgmap v13601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:02:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:35 smithi057 ceph-mon[92072]: pgmap v13602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:02:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:35 smithi122 ceph-mon[125440]: pgmap v13602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:02:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:35 smithi136 ceph-mon[125702]: pgmap v13602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:02:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:37 smithi057 ceph-mon[92072]: pgmap v13603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:02:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:37 smithi122 ceph-mon[125440]: pgmap v13603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:02:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:37 smithi136 ceph-mon[125702]: pgmap v13603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:02:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:38.685+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:02:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:38.685+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:02:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:38.685+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:02:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:38.685+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:02:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:38.685+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:02:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:39 smithi057 ceph-mon[92072]: pgmap v13604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:02:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:39 smithi122 ceph-mon[125440]: pgmap v13604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:02:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:39 smithi136 ceph-mon[125702]: pgmap v13604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:02:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:41 smithi057 ceph-mon[92072]: pgmap v13605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:02:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:41 smithi122 ceph-mon[125440]: pgmap v13605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:02:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:41 smithi136 ceph-mon[125702]: pgmap v13605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:02:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:43 smithi057 ceph-mon[92072]: pgmap v13606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:43 smithi122 ceph-mon[125440]: pgmap v13606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:43 smithi136 ceph-mon[125702]: pgmap v13606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:45 smithi057 ceph-mon[92072]: pgmap v13607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:45 smithi122 ceph-mon[125440]: pgmap v13607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:45 smithi136 ceph-mon[125702]: pgmap v13607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:47 smithi057 ceph-mon[92072]: pgmap v13608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:47 smithi122 ceph-mon[125440]: pgmap v13608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:47 smithi136 ceph-mon[125702]: pgmap v13608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:49 smithi057 ceph-mon[92072]: pgmap v13609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:49 smithi122 ceph-mon[125440]: pgmap v13609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:49 smithi136 ceph-mon[125702]: pgmap v13609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:51 smithi057 ceph-mon[92072]: pgmap v13610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:51 smithi122 ceph-mon[125440]: pgmap v13610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:51 smithi136 ceph-mon[125702]: pgmap v13610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:53 smithi057 ceph-mon[92072]: pgmap v13611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:53 smithi122 ceph-mon[125440]: pgmap v13611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:53.702+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:02:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:53.702+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:02:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:53.702+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:02:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:53.702+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:02:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:02:53.702+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:02:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:53 smithi136 ceph-mon[125702]: pgmap v13611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:55 smithi057 ceph-mon[92072]: pgmap v13612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:55 smithi122 ceph-mon[125440]: pgmap v13612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:55 smithi136 ceph-mon[125702]: pgmap v13612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:57 smithi057 ceph-mon[92072]: pgmap v13613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:57 smithi122 ceph-mon[125440]: pgmap v13613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:57 smithi136 ceph-mon[125702]: pgmap v13613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:02:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:02:59 smithi057 ceph-mon[92072]: pgmap v13614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:02:59 smithi122 ceph-mon[125440]: pgmap v13614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:02:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:02:59 smithi136 ceph-mon[125702]: pgmap v13614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:03:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:01 smithi057 ceph-mon[92072]: pgmap v13615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:01 smithi122 ceph-mon[125440]: pgmap v13615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:01 smithi136 ceph-mon[125702]: pgmap v13615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:03 smithi057 ceph-mon[92072]: pgmap v13616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:03:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:03 smithi122 ceph-mon[125440]: pgmap v13616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:03:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:03 smithi136 ceph-mon[125702]: pgmap v13616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:03:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:05 smithi057 ceph-mon[92072]: pgmap v13617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:03:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:05 smithi122 ceph-mon[125440]: pgmap v13617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:03:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:05 smithi136 ceph-mon[125702]: pgmap v13617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:03:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:07 smithi057 ceph-mon[92072]: pgmap v13618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:03:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:07 smithi122 ceph-mon[125440]: pgmap v13618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:03:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:07 smithi136 ceph-mon[125702]: pgmap v13618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:03:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:08.717+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:03:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:08.717+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:03:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:08.717+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:03:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:08.717+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:03:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:08.717+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:03:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:09 smithi122 ceph-mon[125440]: pgmap v13619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:03:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:09 smithi136 ceph-mon[125702]: pgmap v13619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:03:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:09 smithi057 ceph-mon[92072]: pgmap v13619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:03:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:11 smithi122 ceph-mon[125440]: pgmap v13620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:03:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:11 smithi136 ceph-mon[125702]: pgmap v13620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:03:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:11 smithi057 ceph-mon[92072]: pgmap v13620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:03:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:12 smithi122 ceph-mon[125440]: osdmap e924: 12 total, 12 up, 12 in 2023-03-02T18:03:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:12 smithi136 ceph-mon[125702]: osdmap e924: 12 total, 12 up, 12 in 2023-03-02T18:03:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:12 smithi057 ceph-mon[92072]: osdmap e924: 12 total, 12 up, 12 in 2023-03-02T18:03:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:13 smithi136 ceph-mon[125702]: pgmap v13622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:13 smithi057 ceph-mon[92072]: pgmap v13622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:13 smithi122 ceph-mon[125440]: pgmap v13622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:15 smithi136 ceph-mon[125702]: pgmap v13623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:15 smithi057 ceph-mon[92072]: pgmap v13623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:15 smithi122 ceph-mon[125440]: pgmap v13623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:16.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:03:16.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:03:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:03:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:17 smithi136 ceph-mon[125702]: pgmap v13624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:03:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:03:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:03:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:17 smithi057 ceph-mon[92072]: pgmap v13624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:03:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:03:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:03:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:17 smithi122 ceph-mon[125440]: pgmap v13624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:03:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:03:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:03:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:19 smithi136 ceph-mon[125702]: pgmap v13625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:03:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:19 smithi057 ceph-mon[92072]: pgmap v13625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:03:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:19 smithi122 ceph-mon[125440]: pgmap v13625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:03:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:21 smithi136 ceph-mon[125702]: pgmap v13626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:03:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:21 smithi136 ceph-mon[125702]: osdmap e925: 12 total, 12 up, 12 in 2023-03-02T18:03:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:21 smithi057 ceph-mon[92072]: pgmap v13626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:03:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:21 smithi057 ceph-mon[92072]: osdmap e925: 12 total, 12 up, 12 in 2023-03-02T18:03:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:21 smithi122 ceph-mon[125440]: pgmap v13626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:03:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:21 smithi122 ceph-mon[125440]: osdmap e925: 12 total, 12 up, 12 in 2023-03-02T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:23.732+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:23.733+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:03:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:23.733+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:03:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:23.733+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:03:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:23.733+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:03:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:23 smithi136 ceph-mon[125702]: pgmap v13628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:23 smithi057 ceph-mon[92072]: pgmap v13628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:23 smithi122 ceph-mon[125440]: pgmap v13628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:25 smithi136 ceph-mon[125702]: pgmap v13629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:25 smithi057 ceph-mon[92072]: pgmap v13629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:25 smithi122 ceph-mon[125440]: pgmap v13629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:27 smithi136 ceph-mon[125702]: pgmap v13630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:27 smithi057 ceph-mon[92072]: pgmap v13630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:27 smithi122 ceph-mon[125440]: pgmap v13630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:03:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:29 smithi136 ceph-mon[125702]: pgmap v13631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:03:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:29 smithi057 ceph-mon[92072]: pgmap v13631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:03:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:29 smithi122 ceph-mon[125440]: pgmap v13631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:03:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:31 smithi136 ceph-mon[125702]: pgmap v13632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:03:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:31 smithi057 ceph-mon[92072]: pgmap v13632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:03:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:31 smithi122 ceph-mon[125440]: pgmap v13632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:03:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:33 smithi136 ceph-mon[125702]: pgmap v13633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-02T18:03:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:33 smithi057 ceph-mon[92072]: pgmap v13633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-02T18:03:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:33 smithi122 ceph-mon[125440]: pgmap v13633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-02T18:03:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:35 smithi136 ceph-mon[125702]: pgmap v13634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:35 smithi057 ceph-mon[92072]: pgmap v13634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:35 smithi122 ceph-mon[125440]: pgmap v13634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:37 smithi136 ceph-mon[125702]: pgmap v13635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:37 smithi057 ceph-mon[92072]: pgmap v13635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:37 smithi122 ceph-mon[125440]: pgmap v13635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:38.735+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:03:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:38.736+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:03:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:38.736+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:03:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:38.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:03:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:38.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:03:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:39 smithi136 ceph-mon[125702]: pgmap v13636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:03:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:39 smithi057 ceph-mon[92072]: pgmap v13636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:03:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:39 smithi122 ceph-mon[125440]: pgmap v13636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:03:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:41 smithi136 ceph-mon[125702]: pgmap v13637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:03:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:41 smithi057 ceph-mon[92072]: pgmap v13637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:03:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:41 smithi122 ceph-mon[125440]: pgmap v13637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:03:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:43 smithi136 ceph-mon[125702]: pgmap v13638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:03:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:43 smithi057 ceph-mon[92072]: pgmap v13638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:03:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:43 smithi122 ceph-mon[125440]: pgmap v13638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:03:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:45 smithi136 ceph-mon[125702]: pgmap v13639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:45 smithi057 ceph-mon[92072]: pgmap v13639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:45 smithi122 ceph-mon[125440]: pgmap v13639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:47 smithi136 ceph-mon[125702]: pgmap v13640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:47 smithi057 ceph-mon[92072]: pgmap v13640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:47 smithi122 ceph-mon[125440]: pgmap v13640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:03:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:49 smithi136 ceph-mon[125702]: pgmap v13641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:03:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:49 smithi057 ceph-mon[92072]: pgmap v13641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:03:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:49 smithi122 ceph-mon[125440]: pgmap v13641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:03:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:51 smithi136 ceph-mon[125702]: pgmap v13642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:51 smithi057 ceph-mon[92072]: pgmap v13642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:51 smithi122 ceph-mon[125440]: pgmap v13642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:53.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:03:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:53.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:03:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:53.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:03:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:53.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:03:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:03:53.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:03:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:53 smithi136 ceph-mon[125702]: pgmap v13643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:03:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:53 smithi057 ceph-mon[92072]: pgmap v13643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:03:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:53 smithi122 ceph-mon[125440]: pgmap v13643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:03:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:55 smithi136 ceph-mon[125702]: pgmap v13644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:55 smithi057 ceph-mon[92072]: pgmap v13644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:55 smithi122 ceph-mon[125440]: pgmap v13644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:57 smithi136 ceph-mon[125702]: pgmap v13645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:57 smithi057 ceph-mon[92072]: pgmap v13645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:57 smithi122 ceph-mon[125440]: pgmap v13645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:03:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:03:59 smithi136 ceph-mon[125702]: pgmap v13646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:03:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:03:59 smithi057 ceph-mon[92072]: pgmap v13646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:03:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:03:59 smithi122 ceph-mon[125440]: pgmap v13646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:01 smithi057 ceph-mon[92072]: pgmap v13647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:01 smithi122 ceph-mon[125440]: pgmap v13647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:01 smithi136 ceph-mon[125702]: pgmap v13647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:03 smithi057 ceph-mon[92072]: pgmap v13648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:04:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:03 smithi122 ceph-mon[125440]: pgmap v13648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:04:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:03 smithi136 ceph-mon[125702]: pgmap v13648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:04:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:05 smithi057 ceph-mon[92072]: pgmap v13649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:04:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:05 smithi122 ceph-mon[125440]: pgmap v13649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:04:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:05 smithi136 ceph-mon[125702]: pgmap v13649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:04:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:07 smithi057 ceph-mon[92072]: pgmap v13650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:04:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:07 smithi122 ceph-mon[125440]: pgmap v13650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:04:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:07 smithi136 ceph-mon[125702]: pgmap v13650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:04:08.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:08.758+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:04:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:08.758+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:04:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:08.758+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:04:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:08.758+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:04:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:08.758+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:04:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:09 smithi057 ceph-mon[92072]: pgmap v13651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:04:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:09 smithi122 ceph-mon[125440]: pgmap v13651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:04:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:09 smithi136 ceph-mon[125702]: pgmap v13651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:04:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:11 smithi057 ceph-mon[92072]: pgmap v13652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:04:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:11 smithi122 ceph-mon[125440]: pgmap v13652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:04:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:11 smithi136 ceph-mon[125702]: pgmap v13652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:04:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:12 smithi057 ceph-mon[92072]: osdmap e926: 12 total, 12 up, 12 in 2023-03-02T18:04:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:12 smithi122 ceph-mon[125440]: osdmap e926: 12 total, 12 up, 12 in 2023-03-02T18:04:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:12 smithi136 ceph-mon[125702]: osdmap e926: 12 total, 12 up, 12 in 2023-03-02T18:04:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:13 smithi057 ceph-mon[92072]: pgmap v13654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:13 smithi122 ceph-mon[125440]: pgmap v13654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:13 smithi136 ceph-mon[125702]: pgmap v13654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:15 smithi057 ceph-mon[92072]: pgmap v13655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:15 smithi122 ceph-mon[125440]: pgmap v13655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:15 smithi136 ceph-mon[125702]: pgmap v13655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:17 smithi057 ceph-mon[92072]: pgmap v13656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:04:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:04:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:04:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:04:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:17 smithi122 ceph-mon[125440]: pgmap v13656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:04:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:04:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:04:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:04:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:17 smithi136 ceph-mon[125702]: pgmap v13656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:04:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:04:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:04:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:04:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:19 smithi057 ceph-mon[92072]: pgmap v13657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:19 smithi122 ceph-mon[125440]: pgmap v13657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:19 smithi136 ceph-mon[125702]: pgmap v13657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:21 smithi057 ceph-mon[92072]: pgmap v13658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:21 smithi057 ceph-mon[92072]: osdmap e927: 12 total, 12 up, 12 in 2023-03-02T18:04:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:21 smithi122 ceph-mon[125440]: pgmap v13658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:21 smithi122 ceph-mon[125440]: osdmap e927: 12 total, 12 up, 12 in 2023-03-02T18:04:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:21 smithi136 ceph-mon[125702]: pgmap v13658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:04:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:21 smithi136 ceph-mon[125702]: osdmap e927: 12 total, 12 up, 12 in 2023-03-02T18:04:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:23.760+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:04:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:23.760+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:04:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:23.760+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:04:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:23.760+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:04:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:23.760+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:04:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:23 smithi057 ceph-mon[92072]: pgmap v13660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:04:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:23 smithi122 ceph-mon[125440]: pgmap v13660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:04:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:23 smithi136 ceph-mon[125702]: pgmap v13660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:04:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:25 smithi057 ceph-mon[92072]: pgmap v13661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:04:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:25 smithi122 ceph-mon[125440]: pgmap v13661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:04:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:25 smithi136 ceph-mon[125702]: pgmap v13661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:04:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:27 smithi057 ceph-mon[92072]: pgmap v13662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:04:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:27 smithi122 ceph-mon[125440]: pgmap v13662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:04:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:27 smithi136 ceph-mon[125702]: pgmap v13662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:04:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:29 smithi057 ceph-mon[92072]: pgmap v13663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:04:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:29 smithi122 ceph-mon[125440]: pgmap v13663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:04:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:29 smithi136 ceph-mon[125702]: pgmap v13663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:04:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:31 smithi057 ceph-mon[92072]: pgmap v13664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:04:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:31 smithi122 ceph-mon[125440]: pgmap v13664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:04:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:31 smithi136 ceph-mon[125702]: pgmap v13664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:04:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:33 smithi057 ceph-mon[92072]: pgmap v13665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 op/s 2023-03-02T18:04:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:33 smithi122 ceph-mon[125440]: pgmap v13665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 op/s 2023-03-02T18:04:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:33 smithi136 ceph-mon[125702]: pgmap v13665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 op/s 2023-03-02T18:04:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:35 smithi057 ceph-mon[92072]: pgmap v13666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:35 smithi122 ceph-mon[125440]: pgmap v13666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:35 smithi136 ceph-mon[125702]: pgmap v13666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:37 smithi122 ceph-mon[125440]: pgmap v13667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:37 smithi136 ceph-mon[125702]: pgmap v13667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:37 smithi057 ceph-mon[92072]: pgmap v13667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:38.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:38.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:04:38.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:38.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:04:38.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:38.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:04:38.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:38.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:04:38.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:38.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:04:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:39 smithi122 ceph-mon[125440]: pgmap v13668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:39 smithi136 ceph-mon[125702]: pgmap v13668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:39 smithi057 ceph-mon[92072]: pgmap v13668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:41 smithi122 ceph-mon[125440]: pgmap v13669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:41 smithi136 ceph-mon[125702]: pgmap v13669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:41 smithi057 ceph-mon[92072]: pgmap v13669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:43 smithi122 ceph-mon[125440]: pgmap v13670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:43 smithi136 ceph-mon[125702]: pgmap v13670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:43 smithi057 ceph-mon[92072]: pgmap v13670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:45 smithi136 ceph-mon[125702]: pgmap v13671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:04:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:45 smithi057 ceph-mon[92072]: pgmap v13671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:04:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:45 smithi122 ceph-mon[125440]: pgmap v13671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:04:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:47 smithi136 ceph-mon[125702]: pgmap v13672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:04:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:47 smithi057 ceph-mon[92072]: pgmap v13672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:04:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:47 smithi122 ceph-mon[125440]: pgmap v13672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:04:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:49 smithi136 ceph-mon[125702]: pgmap v13673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:49 smithi057 ceph-mon[92072]: pgmap v13673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:49 smithi122 ceph-mon[125440]: pgmap v13673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:51 smithi136 ceph-mon[125702]: pgmap v13674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:04:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:51 smithi057 ceph-mon[92072]: pgmap v13674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:04:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:51 smithi122 ceph-mon[125440]: pgmap v13674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:04:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:53.779+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:04:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:53.779+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:04:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:53.779+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:04:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:53.779+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:04:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:04:53.779+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:04:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:53 smithi136 ceph-mon[125702]: pgmap v13675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:53 smithi057 ceph-mon[92072]: pgmap v13675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:53 smithi122 ceph-mon[125440]: pgmap v13675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:04:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:55 smithi136 ceph-mon[125702]: pgmap v13676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:55 smithi057 ceph-mon[92072]: pgmap v13676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:55 smithi122 ceph-mon[125440]: pgmap v13676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:57 smithi136 ceph-mon[125702]: pgmap v13677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:57 smithi057 ceph-mon[92072]: pgmap v13677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:04:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:57 smithi122 ceph-mon[125440]: pgmap v13677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:04:59 smithi136 ceph-mon[125702]: pgmap v13678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:04:59 smithi057 ceph-mon[92072]: pgmap v13678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:04:59 smithi122 ceph-mon[125440]: pgmap v13678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:01 smithi136 ceph-mon[125702]: pgmap v13679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:01 smithi057 ceph-mon[92072]: pgmap v13679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:01 smithi122 ceph-mon[125440]: pgmap v13679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:03 smithi136 ceph-mon[125702]: pgmap v13680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:05:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:03 smithi057 ceph-mon[92072]: pgmap v13680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:05:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:03 smithi122 ceph-mon[125440]: pgmap v13680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:05:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:05 smithi136 ceph-mon[125702]: pgmap v13681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:05:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:05 smithi057 ceph-mon[92072]: pgmap v13681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:05:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:05 smithi122 ceph-mon[125440]: pgmap v13681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:05:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:07 smithi136 ceph-mon[125702]: pgmap v13682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:05:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:07 smithi136 ceph-mon[125702]: osdmap e928: 12 total, 12 up, 12 in 2023-03-02T18:05:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:07 smithi057 ceph-mon[92072]: pgmap v13682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:05:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:07 smithi057 ceph-mon[92072]: osdmap e928: 12 total, 12 up, 12 in 2023-03-02T18:05:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:07 smithi122 ceph-mon[125440]: pgmap v13682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:05:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:07 smithi122 ceph-mon[125440]: osdmap e928: 12 total, 12 up, 12 in 2023-03-02T18:05:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:08.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:05:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:08.783+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:05:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:08.783+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:05:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:08.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:05:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:08.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:05:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:09 smithi136 ceph-mon[125702]: pgmap v13684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:05:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:09 smithi057 ceph-mon[92072]: pgmap v13684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:05:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:09 smithi122 ceph-mon[125440]: pgmap v13684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:05:11.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:10 smithi136 ceph-mon[125702]: pgmap v13685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:05:11.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:10 smithi057 ceph-mon[92072]: pgmap v13685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:05:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:10 smithi122 ceph-mon[125440]: pgmap v13685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:05:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:12.062+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:05:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:12.062+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:05:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:12.063+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 199 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:05:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:12.063+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 198 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:05:13.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:13 smithi136 ceph-mon[125702]: pgmap v13686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:05:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:13 smithi057 ceph-mon[92072]: pgmap v13686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:05:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:13 smithi122 ceph-mon[125440]: pgmap v13686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:05:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:15 smithi136 ceph-mon[125702]: pgmap v13687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:05:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:15 smithi057 ceph-mon[92072]: pgmap v13687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:05:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:15 smithi122 ceph-mon[125440]: pgmap v13687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:05:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:17 smithi136 ceph-mon[125702]: pgmap v13688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:05:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:17 smithi136 ceph-mon[125702]: osdmap e929: 12 total, 12 up, 12 in 2023-03-02T18:05:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:17 smithi057 ceph-mon[92072]: pgmap v13688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:05:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:17 smithi057 ceph-mon[92072]: osdmap e929: 12 total, 12 up, 12 in 2023-03-02T18:05:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:17 smithi122 ceph-mon[125440]: pgmap v13688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:05:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:17 smithi122 ceph-mon[125440]: osdmap e929: 12 total, 12 up, 12 in 2023-03-02T18:05:18.589 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:05:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:05:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:05:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:19 smithi136 ceph-mon[125702]: pgmap v13690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:05:19.658 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:19 smithi057 ceph-mon[92072]: pgmap v13690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:05:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:19 smithi122 ceph-mon[125440]: pgmap v13690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:05:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:21 smithi136 ceph-mon[125702]: pgmap v13691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:05:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:21 smithi057 ceph-mon[92072]: pgmap v13691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:05:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:21 smithi122 ceph-mon[125440]: pgmap v13691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:05:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:05:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:05:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:05:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:05:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:05:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:05:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:05:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:05:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:05:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:05:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:05:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:05:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:05:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:05:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:05:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:23 smithi057 ceph-mon[92072]: pgmap v13692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:05:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:23 smithi122 ceph-mon[125440]: pgmap v13692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:05:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:23.799+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:05:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:23.800+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:05:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:23.800+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:05:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:23.800+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:05:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:23.800+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:05:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:23 smithi136 ceph-mon[125702]: pgmap v13692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:05:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:25 smithi057 ceph-mon[92072]: pgmap v13693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:05:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:25 smithi122 ceph-mon[125440]: pgmap v13693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:05:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:25 smithi136 ceph-mon[125702]: pgmap v13693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:05:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:27 smithi057 ceph-mon[92072]: pgmap v13694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:05:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:27 smithi122 ceph-mon[125440]: pgmap v13694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:05:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:27 smithi136 ceph-mon[125702]: pgmap v13694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:05:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:29 smithi057 ceph-mon[92072]: pgmap v13695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T18:05:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:29 smithi122 ceph-mon[125440]: pgmap v13695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T18:05:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:29 smithi136 ceph-mon[125702]: pgmap v13695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T18:05:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:31 smithi057 ceph-mon[92072]: pgmap v13696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:31 smithi122 ceph-mon[125440]: pgmap v13696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:31 smithi136 ceph-mon[125702]: pgmap v13696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:33 smithi057 ceph-mon[92072]: pgmap v13697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:33 smithi122 ceph-mon[125440]: pgmap v13697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:33 smithi136 ceph-mon[125702]: pgmap v13697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:35 smithi057 ceph-mon[92072]: pgmap v13698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:35 smithi122 ceph-mon[125440]: pgmap v13698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:35 smithi136 ceph-mon[125702]: pgmap v13698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:37 smithi057 ceph-mon[92072]: pgmap v13699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:37 smithi122 ceph-mon[125440]: pgmap v13699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:37 smithi136 ceph-mon[125702]: pgmap v13699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:38.806+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:05:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:38.806+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:05:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:38.806+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:05:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:38.806+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:05:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:38.806+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:05:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:39 smithi057 ceph-mon[92072]: pgmap v13700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:39 smithi122 ceph-mon[125440]: pgmap v13700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:39 smithi136 ceph-mon[125702]: pgmap v13700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:41 smithi057 ceph-mon[92072]: pgmap v13701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:41 smithi122 ceph-mon[125440]: pgmap v13701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:41 smithi136 ceph-mon[125702]: pgmap v13701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:43 smithi057 ceph-mon[92072]: pgmap v13702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:43 smithi122 ceph-mon[125440]: pgmap v13702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:43 smithi136 ceph-mon[125702]: pgmap v13702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:45 smithi057 ceph-mon[92072]: pgmap v13703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:45 smithi122 ceph-mon[125440]: pgmap v13703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:45 smithi136 ceph-mon[125702]: pgmap v13703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:47.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:47 smithi057 ceph-mon[92072]: pgmap v13704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:47 smithi122 ceph-mon[125440]: pgmap v13704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:47 smithi136 ceph-mon[125702]: pgmap v13704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:49 smithi057 ceph-mon[92072]: pgmap v13705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:49 smithi122 ceph-mon[125440]: pgmap v13705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:49 smithi136 ceph-mon[125702]: pgmap v13705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:51.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:51 smithi057 ceph-mon[92072]: pgmap v13706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:51 smithi122 ceph-mon[125440]: pgmap v13706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:51 smithi136 ceph-mon[125702]: pgmap v13706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:53 smithi057 ceph-mon[92072]: pgmap v13707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:53 smithi122 ceph-mon[125440]: pgmap v13707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:53.806+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:05:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:53.807+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:05:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:53.807+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:05:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:53.807+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:05:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:05:53.807+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:05:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:53 smithi136 ceph-mon[125702]: pgmap v13707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:55 smithi122 ceph-mon[125440]: pgmap v13708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:55 smithi136 ceph-mon[125702]: pgmap v13708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:55 smithi057 ceph-mon[92072]: pgmap v13708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:57 smithi122 ceph-mon[125440]: pgmap v13709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:57 smithi136 ceph-mon[125702]: pgmap v13709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:57 smithi057 ceph-mon[92072]: pgmap v13709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:05:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:05:59 smithi136 ceph-mon[125702]: pgmap v13710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:05:59 smithi057 ceph-mon[92072]: pgmap v13710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:05:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:05:59 smithi122 ceph-mon[125440]: pgmap v13710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:01 smithi136 ceph-mon[125702]: pgmap v13711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:01 smithi057 ceph-mon[92072]: pgmap v13711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:01 smithi122 ceph-mon[125440]: pgmap v13711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:03 smithi136 ceph-mon[125702]: pgmap v13712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:06:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:03 smithi057 ceph-mon[92072]: pgmap v13712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:06:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:03 smithi122 ceph-mon[125440]: pgmap v13712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:06:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:05 smithi136 ceph-mon[125702]: pgmap v13713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:06:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:05 smithi057 ceph-mon[92072]: pgmap v13713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:06:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:05 smithi122 ceph-mon[125440]: pgmap v13713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:06:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:07 smithi136 ceph-mon[125702]: pgmap v13714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:06:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:07 smithi136 ceph-mon[125702]: osdmap e930: 12 total, 12 up, 12 in 2023-03-02T18:06:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:07 smithi057 ceph-mon[92072]: pgmap v13714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:06:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:07 smithi057 ceph-mon[92072]: osdmap e930: 12 total, 12 up, 12 in 2023-03-02T18:06:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:07 smithi122 ceph-mon[125440]: pgmap v13714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:06:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:07 smithi122 ceph-mon[125440]: osdmap e930: 12 total, 12 up, 12 in 2023-03-02T18:06:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:08.823+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:06:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:08.823+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:06:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:08.823+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:06:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:08.823+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:06:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:08.823+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:06:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:09 smithi136 ceph-mon[125702]: pgmap v13716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:06:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:09 smithi057 ceph-mon[92072]: pgmap v13716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:06:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:09 smithi122 ceph-mon[125440]: pgmap v13716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:06:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:11 smithi136 ceph-mon[125702]: pgmap v13717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:06:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:11 smithi136 ceph-mon[125702]: osdmap e931: 12 total, 12 up, 12 in 2023-03-02T18:06:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:11 smithi057 ceph-mon[92072]: pgmap v13717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:06:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:11 smithi057 ceph-mon[92072]: osdmap e931: 12 total, 12 up, 12 in 2023-03-02T18:06:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:11 smithi122 ceph-mon[125440]: pgmap v13717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:06:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:11 smithi122 ceph-mon[125440]: osdmap e931: 12 total, 12 up, 12 in 2023-03-02T18:06:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:13 smithi136 ceph-mon[125702]: pgmap v13719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T18:06:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:13 smithi057 ceph-mon[92072]: pgmap v13719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T18:06:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:13 smithi122 ceph-mon[125440]: pgmap v13719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T18:06:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:15 smithi136 ceph-mon[125702]: pgmap v13720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T18:06:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:15 smithi057 ceph-mon[92072]: pgmap v13720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T18:06:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:15 smithi122 ceph-mon[125440]: pgmap v13720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T18:06:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:17 smithi136 ceph-mon[125702]: pgmap v13721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T18:06:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:17 smithi057 ceph-mon[92072]: pgmap v13721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T18:06:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:17 smithi122 ceph-mon[125440]: pgmap v13721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T18:06:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:19 smithi136 ceph-mon[125702]: pgmap v13722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:06:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:19 smithi057 ceph-mon[92072]: pgmap v13722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:06:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:19 smithi122 ceph-mon[125440]: pgmap v13722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:06:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:21 smithi136 ceph-mon[125702]: pgmap v13723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:06:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:06:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:21 smithi057 ceph-mon[92072]: pgmap v13723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:06:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:06:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:21 smithi122 ceph-mon[125440]: pgmap v13723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:06:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:06:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:23 smithi136 ceph-mon[125702]: pgmap v13724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:06:23.821 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:23 smithi122 ceph-mon[125440]: pgmap v13724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:06:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:23.839+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:06:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:23.840+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:06:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:23.840+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:06:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:23.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:06:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:23.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:06:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:23 smithi057 ceph-mon[92072]: pgmap v13724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:06:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:25 smithi136 ceph-mon[125702]: pgmap v13725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:25 smithi057 ceph-mon[92072]: pgmap v13725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:25 smithi122 ceph-mon[125440]: pgmap v13725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:06:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:06:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:06:26.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:06:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:06:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:06:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:06:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:27 smithi136 ceph-mon[125702]: pgmap v13726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:27 smithi057 ceph-mon[92072]: pgmap v13726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:27 smithi122 ceph-mon[125440]: pgmap v13726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:29 smithi136 ceph-mon[125702]: pgmap v13727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:29 smithi057 ceph-mon[92072]: pgmap v13727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:29 smithi122 ceph-mon[125440]: pgmap v13727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:31 smithi136 ceph-mon[125702]: pgmap v13728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:31 smithi057 ceph-mon[92072]: pgmap v13728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:31 smithi122 ceph-mon[125440]: pgmap v13728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:33 smithi136 ceph-mon[125702]: pgmap v13729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:33 smithi057 ceph-mon[92072]: pgmap v13729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:33 smithi122 ceph-mon[125440]: pgmap v13729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:35 smithi136 ceph-mon[125702]: pgmap v13730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:35 smithi057 ceph-mon[92072]: pgmap v13730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:35 smithi122 ceph-mon[125440]: pgmap v13730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:37 smithi136 ceph-mon[125702]: pgmap v13731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:37 smithi057 ceph-mon[92072]: pgmap v13731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:37 smithi122 ceph-mon[125440]: pgmap v13731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:38.850+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:06:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:38.851+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:06:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:38.851+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:06:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:38.851+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:06:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:38.851+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:06:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:39 smithi136 ceph-mon[125702]: pgmap v13732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:39 smithi057 ceph-mon[92072]: pgmap v13732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:39 smithi122 ceph-mon[125440]: pgmap v13732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:41 smithi136 ceph-mon[125702]: pgmap v13733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:41 smithi057 ceph-mon[92072]: pgmap v13733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:41 smithi122 ceph-mon[125440]: pgmap v13733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:43 smithi136 ceph-mon[125702]: pgmap v13734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:43 smithi057 ceph-mon[92072]: pgmap v13734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:43 smithi122 ceph-mon[125440]: pgmap v13734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:45 smithi136 ceph-mon[125702]: pgmap v13735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:45 smithi057 ceph-mon[92072]: pgmap v13735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:45 smithi122 ceph-mon[125440]: pgmap v13735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:47 smithi136 ceph-mon[125702]: pgmap v13736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:47 smithi057 ceph-mon[92072]: pgmap v13736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:47 smithi122 ceph-mon[125440]: pgmap v13736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:49 smithi136 ceph-mon[125702]: pgmap v13737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:49 smithi057 ceph-mon[92072]: pgmap v13737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:49 smithi122 ceph-mon[125440]: pgmap v13737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:51 smithi057 ceph-mon[92072]: pgmap v13738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:51 smithi122 ceph-mon[125440]: pgmap v13738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:51 smithi136 ceph-mon[125702]: pgmap v13738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:53.861+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:06:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:53.861+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:06:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:53.861+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:06:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:53.861+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:06:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:06:53.861+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:06:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:53 smithi057 ceph-mon[92072]: pgmap v13739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:53 smithi122 ceph-mon[125440]: pgmap v13739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:53 smithi136 ceph-mon[125702]: pgmap v13739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:55 smithi057 ceph-mon[92072]: pgmap v13740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:55 smithi122 ceph-mon[125440]: pgmap v13740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:55 smithi136 ceph-mon[125702]: pgmap v13740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:57 smithi057 ceph-mon[92072]: pgmap v13741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:57 smithi122 ceph-mon[125440]: pgmap v13741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:57 smithi136 ceph-mon[125702]: pgmap v13741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:06:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:06:59 smithi057 ceph-mon[92072]: pgmap v13742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:06:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:06:59 smithi122 ceph-mon[125440]: pgmap v13742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:06:59 smithi136 ceph-mon[125702]: pgmap v13742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:01 smithi057 ceph-mon[92072]: pgmap v13743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:01 smithi122 ceph-mon[125440]: pgmap v13743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:01 smithi136 ceph-mon[125702]: pgmap v13743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:03 smithi057 ceph-mon[92072]: pgmap v13744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:07:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:03 smithi122 ceph-mon[125440]: pgmap v13744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:07:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:03 smithi136 ceph-mon[125702]: pgmap v13744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:07:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:05 smithi057 ceph-mon[92072]: pgmap v13745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:07:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:05 smithi122 ceph-mon[125440]: pgmap v13745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:07:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:05 smithi136 ceph-mon[125702]: pgmap v13745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:07:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:07 smithi057 ceph-mon[92072]: pgmap v13746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:07:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:07 smithi057 ceph-mon[92072]: osdmap e932: 12 total, 12 up, 12 in 2023-03-02T18:07:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:07 smithi122 ceph-mon[125440]: pgmap v13746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:07:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:07 smithi122 ceph-mon[125440]: osdmap e932: 12 total, 12 up, 12 in 2023-03-02T18:07:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:07 smithi136 ceph-mon[125702]: pgmap v13746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:07:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:07 smithi136 ceph-mon[125702]: osdmap e932: 12 total, 12 up, 12 in 2023-03-02T18:07:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:08.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:08.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:08.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:08.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:07:08.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:08.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:07:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:09 smithi057 ceph-mon[92072]: pgmap v13748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:07:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:09 smithi122 ceph-mon[125440]: pgmap v13748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:07:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:09 smithi136 ceph-mon[125702]: pgmap v13748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:07:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:11 smithi057 ceph-mon[92072]: pgmap v13749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:07:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:11 smithi122 ceph-mon[125440]: pgmap v13749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:07:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:11 smithi136 ceph-mon[125702]: pgmap v13749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:07:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:13 smithi057 ceph-mon[92072]: pgmap v13750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:07:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:13 smithi122 ceph-mon[125440]: pgmap v13750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:07:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:13 smithi136 ceph-mon[125702]: pgmap v13750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:07:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:15 smithi057 ceph-mon[92072]: pgmap v13751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:07:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:15 smithi122 ceph-mon[125440]: pgmap v13751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:07:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:15 smithi136 ceph-mon[125702]: pgmap v13751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:07:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:17 smithi057 ceph-mon[92072]: pgmap v13752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:07:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:17 smithi057 ceph-mon[92072]: osdmap e933: 12 total, 12 up, 12 in 2023-03-02T18:07:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:17 smithi122 ceph-mon[125440]: pgmap v13752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:07:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:17 smithi122 ceph-mon[125440]: osdmap e933: 12 total, 12 up, 12 in 2023-03-02T18:07:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:17 smithi136 ceph-mon[125702]: pgmap v13752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:07:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:17 smithi136 ceph-mon[125702]: osdmap e933: 12 total, 12 up, 12 in 2023-03-02T18:07:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:19 smithi057 ceph-mon[92072]: pgmap v13754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:07:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:19 smithi122 ceph-mon[125440]: pgmap v13754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:07:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:19 smithi136 ceph-mon[125702]: pgmap v13754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:07:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:21 smithi057 ceph-mon[92072]: pgmap v13755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:07:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:21 smithi122 ceph-mon[125440]: pgmap v13755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:07:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:21 smithi136 ceph-mon[125702]: pgmap v13755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:07:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:23 smithi057 ceph-mon[92072]: pgmap v13756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:07:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:23 smithi122 ceph-mon[125440]: pgmap v13756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:07:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:23 smithi136 ceph-mon[125702]: pgmap v13756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:07:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:23.869+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:07:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:23.869+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:07:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:23.869+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:07:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:23.869+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:07:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:23.869+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:07:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:25 smithi057 ceph-mon[92072]: pgmap v13757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:07:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:25 smithi122 ceph-mon[125440]: pgmap v13757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:07:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:25 smithi136 ceph-mon[125702]: pgmap v13757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:07:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:07:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:07:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:07:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:27 smithi057 ceph-mon[92072]: pgmap v13758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:07:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:07:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:07:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:07:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:27 smithi122 ceph-mon[125440]: pgmap v13758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:07:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:07:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:07:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:07:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:27 smithi136 ceph-mon[125702]: pgmap v13758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:07:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:07:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:07:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:07:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:29 smithi057 ceph-mon[92072]: pgmap v13759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:07:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:29 smithi122 ceph-mon[125440]: pgmap v13759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:07:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:29 smithi136 ceph-mon[125702]: pgmap v13759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:07:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:31 smithi057 ceph-mon[92072]: pgmap v13760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:31 smithi122 ceph-mon[125440]: pgmap v13760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:31 smithi136 ceph-mon[125702]: pgmap v13760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:33 smithi057 ceph-mon[92072]: pgmap v13761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:33 smithi122 ceph-mon[125440]: pgmap v13761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:33 smithi136 ceph-mon[125702]: pgmap v13761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:35 smithi057 ceph-mon[92072]: pgmap v13762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:35 smithi122 ceph-mon[125440]: pgmap v13762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:35 smithi136 ceph-mon[125702]: pgmap v13762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:37 smithi057 ceph-mon[92072]: pgmap v13763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:37 smithi122 ceph-mon[125440]: pgmap v13763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:37 smithi136 ceph-mon[125702]: pgmap v13763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:38.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:38.882+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:07:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:38.882+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:07:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:38.882+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:07:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:38.882+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:07:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:38.882+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:07:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:39 smithi057 ceph-mon[92072]: pgmap v13764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:39.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:39 smithi122 ceph-mon[125440]: pgmap v13764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:39 smithi136 ceph-mon[125702]: pgmap v13764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:41 smithi057 ceph-mon[92072]: pgmap v13765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:41 smithi122 ceph-mon[125440]: pgmap v13765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:41 smithi136 ceph-mon[125702]: pgmap v13765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:43 smithi057 ceph-mon[92072]: pgmap v13766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:43 smithi122 ceph-mon[125440]: pgmap v13766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:43 smithi136 ceph-mon[125702]: pgmap v13766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:45 smithi057 ceph-mon[92072]: pgmap v13767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:45 smithi122 ceph-mon[125440]: pgmap v13767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:45 smithi136 ceph-mon[125702]: pgmap v13767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:47 smithi122 ceph-mon[125440]: pgmap v13768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:47 smithi136 ceph-mon[125702]: pgmap v13768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:47 smithi057 ceph-mon[92072]: pgmap v13768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:49.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:49 smithi122 ceph-mon[125440]: pgmap v13769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:49 smithi136 ceph-mon[125702]: pgmap v13769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:49 smithi057 ceph-mon[92072]: pgmap v13769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:51 smithi122 ceph-mon[125440]: pgmap v13770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:51 smithi136 ceph-mon[125702]: pgmap v13770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:51 smithi057 ceph-mon[92072]: pgmap v13770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:53 smithi122 ceph-mon[125440]: pgmap v13771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:53 smithi136 ceph-mon[125702]: pgmap v13771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:53.894+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:07:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:53.895+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:07:53.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:53.895+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:07:53.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:53.895+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:07:53.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:07:53.895+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:07:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:53 smithi057 ceph-mon[92072]: pgmap v13771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:55 smithi136 ceph-mon[125702]: pgmap v13772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:55 smithi057 ceph-mon[92072]: pgmap v13772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:55 smithi122 ceph-mon[125440]: pgmap v13772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:57 smithi136 ceph-mon[125702]: pgmap v13773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:57 smithi057 ceph-mon[92072]: pgmap v13773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:57 smithi122 ceph-mon[125440]: pgmap v13773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:07:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:07:59 smithi136 ceph-mon[125702]: pgmap v13774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:07:59 smithi057 ceph-mon[92072]: pgmap v13774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:07:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:07:59 smithi122 ceph-mon[125440]: pgmap v13774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:01 smithi136 ceph-mon[125702]: pgmap v13775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:01 smithi057 ceph-mon[92072]: pgmap v13775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:01 smithi122 ceph-mon[125440]: pgmap v13775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:03 smithi136 ceph-mon[125702]: pgmap v13776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:08:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:03 smithi057 ceph-mon[92072]: pgmap v13776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:08:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:03 smithi122 ceph-mon[125440]: pgmap v13776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:08:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:05 smithi136 ceph-mon[125702]: pgmap v13777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:08:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:05 smithi057 ceph-mon[92072]: pgmap v13777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:08:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:05 smithi122 ceph-mon[125440]: pgmap v13777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:08:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:07 smithi136 ceph-mon[125702]: pgmap v13778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:08:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:07 smithi136 ceph-mon[125702]: osdmap e934: 12 total, 12 up, 12 in 2023-03-02T18:08:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:07 smithi057 ceph-mon[92072]: pgmap v13778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:08:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:07 smithi057 ceph-mon[92072]: osdmap e934: 12 total, 12 up, 12 in 2023-03-02T18:08:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:07 smithi122 ceph-mon[125440]: pgmap v13778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:08:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:07 smithi122 ceph-mon[125440]: osdmap e934: 12 total, 12 up, 12 in 2023-03-02T18:08:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:08.898+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:08:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:08.898+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:08:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:08.898+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:08:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:08.898+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:08:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:08.898+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:08:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:09 smithi136 ceph-mon[125702]: pgmap v13780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:08:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:09 smithi057 ceph-mon[92072]: pgmap v13780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:08:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:09 smithi122 ceph-mon[125440]: pgmap v13780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:08:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:11 smithi136 ceph-mon[125702]: pgmap v13781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:08:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:11 smithi136 ceph-mon[125702]: osdmap e935: 12 total, 12 up, 12 in 2023-03-02T18:08:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:11 smithi057 ceph-mon[92072]: pgmap v13781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:08:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:11 smithi057 ceph-mon[92072]: osdmap e935: 12 total, 12 up, 12 in 2023-03-02T18:08:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:11 smithi122 ceph-mon[125440]: pgmap v13781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:08:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:11 smithi122 ceph-mon[125440]: osdmap e935: 12 total, 12 up, 12 in 2023-03-02T18:08:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:12.087+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:08:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:12.087+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:08:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:12.088+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 200 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:08:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:12.088+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:08:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:12.088+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 199 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:08:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:12.088+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:08:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:12.088+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 201 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:08:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:12.088+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 200 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:08:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:13 smithi136 ceph-mon[125702]: pgmap v13783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:08:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:13 smithi057 ceph-mon[92072]: pgmap v13783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:08:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:13 smithi122 ceph-mon[125440]: pgmap v13783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:08:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:15 smithi136 ceph-mon[125702]: pgmap v13784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:08:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:15 smithi057 ceph-mon[92072]: pgmap v13784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:08:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:15 smithi122 ceph-mon[125440]: pgmap v13784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:08:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:17 smithi136 ceph-mon[125702]: pgmap v13785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T18:08:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:17 smithi057 ceph-mon[92072]: pgmap v13785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T18:08:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:17 smithi122 ceph-mon[125440]: pgmap v13785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T18:08:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:19 smithi136 ceph-mon[125702]: pgmap v13786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:08:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:19 smithi057 ceph-mon[92072]: pgmap v13786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:08:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:19 smithi122 ceph-mon[125440]: pgmap v13786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:08:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:21 smithi136 ceph-mon[125702]: pgmap v13787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:08:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:21 smithi057 ceph-mon[92072]: pgmap v13787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:08:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:21 smithi122 ceph-mon[125440]: pgmap v13787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:08:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:23 smithi136 ceph-mon[125702]: pgmap v13788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:08:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:23.902+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:08:23.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:23.902+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:08:23.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:23.902+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:08:23.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:23.902+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:08:23.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:23.902+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:08:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:23 smithi057 ceph-mon[92072]: pgmap v13788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:08:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:23 smithi122 ceph-mon[125440]: pgmap v13788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:08:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:25 smithi136 ceph-mon[125702]: pgmap v13789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:25 smithi057 ceph-mon[92072]: pgmap v13789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:25 smithi122 ceph-mon[125440]: pgmap v13789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:27 smithi057 ceph-mon[92072]: pgmap v13790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:08:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:27 smithi122 ceph-mon[125440]: pgmap v13790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:08:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:27 smithi136 ceph-mon[125702]: pgmap v13790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:08:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:08:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:08:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:08:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:08:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:08:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:08:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:08:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:29 smithi136 ceph-mon[125702]: pgmap v13791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:29 smithi057 ceph-mon[92072]: pgmap v13791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:29 smithi122 ceph-mon[125440]: pgmap v13791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:31 smithi136 ceph-mon[125702]: pgmap v13792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:31 smithi057 ceph-mon[92072]: pgmap v13792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:31 smithi122 ceph-mon[125440]: pgmap v13792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:33 smithi136 ceph-mon[125702]: pgmap v13793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:33 smithi057 ceph-mon[92072]: pgmap v13793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:33 smithi122 ceph-mon[125440]: pgmap v13793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:35 smithi136 ceph-mon[125702]: pgmap v13794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:35 smithi057 ceph-mon[92072]: pgmap v13794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:35 smithi122 ceph-mon[125440]: pgmap v13794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:37 smithi136 ceph-mon[125702]: pgmap v13795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:37 smithi057 ceph-mon[92072]: pgmap v13795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:37 smithi122 ceph-mon[125440]: pgmap v13795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:38.904+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:08:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:38.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:08:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:38.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:08:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:38.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:08:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:38.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:08:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:39 smithi136 ceph-mon[125702]: pgmap v13796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:39 smithi057 ceph-mon[92072]: pgmap v13796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:39 smithi122 ceph-mon[125440]: pgmap v13796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:41 smithi136 ceph-mon[125702]: pgmap v13797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:41 smithi057 ceph-mon[92072]: pgmap v13797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:41 smithi122 ceph-mon[125440]: pgmap v13797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:43 smithi136 ceph-mon[125702]: pgmap v13798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:43 smithi057 ceph-mon[92072]: pgmap v13798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:43 smithi122 ceph-mon[125440]: pgmap v13798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:45 smithi136 ceph-mon[125702]: pgmap v13799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:45 smithi057 ceph-mon[92072]: pgmap v13799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:45 smithi122 ceph-mon[125440]: pgmap v13799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:47 smithi136 ceph-mon[125702]: pgmap v13800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:47 smithi057 ceph-mon[92072]: pgmap v13800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:47 smithi122 ceph-mon[125440]: pgmap v13800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:49 smithi136 ceph-mon[125702]: pgmap v13801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:49 smithi057 ceph-mon[92072]: pgmap v13801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:49 smithi122 ceph-mon[125440]: pgmap v13801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:51 smithi136 ceph-mon[125702]: pgmap v13802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:51 smithi057 ceph-mon[92072]: pgmap v13802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:51 smithi122 ceph-mon[125440]: pgmap v13802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:53.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:08:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:53.916+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:08:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:53.916+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:08:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:53.916+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:08:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:08:53.916+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:08:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:53 smithi136 ceph-mon[125702]: pgmap v13803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:53 smithi057 ceph-mon[92072]: pgmap v13803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:53 smithi122 ceph-mon[125440]: pgmap v13803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:08:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:55 smithi136 ceph-mon[125702]: pgmap v13804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:55 smithi057 ceph-mon[92072]: pgmap v13804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:55 smithi122 ceph-mon[125440]: pgmap v13804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:57 smithi136 ceph-mon[125702]: pgmap v13805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:57 smithi057 ceph-mon[92072]: pgmap v13805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:08:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:57 smithi122 ceph-mon[125440]: pgmap v13805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:08:59 smithi136 ceph-mon[125702]: pgmap v13806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:08:59 smithi057 ceph-mon[92072]: pgmap v13806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:08:59 smithi122 ceph-mon[125440]: pgmap v13806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:01 smithi136 ceph-mon[125702]: pgmap v13807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:01 smithi057 ceph-mon[92072]: pgmap v13807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:01 smithi122 ceph-mon[125440]: pgmap v13807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:03 smithi136 ceph-mon[125702]: pgmap v13808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:09:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:03 smithi057 ceph-mon[92072]: pgmap v13808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:09:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:03 smithi122 ceph-mon[125440]: pgmap v13808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:09:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:05 smithi136 ceph-mon[125702]: pgmap v13809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:09:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:05 smithi057 ceph-mon[92072]: pgmap v13809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:09:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:05 smithi122 ceph-mon[125440]: pgmap v13809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:09:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:07 smithi057 ceph-mon[92072]: pgmap v13810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:09:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:07 smithi057 ceph-mon[92072]: osdmap e936: 12 total, 12 up, 12 in 2023-03-02T18:09:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:07 smithi122 ceph-mon[125440]: pgmap v13810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:09:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:07 smithi122 ceph-mon[125440]: osdmap e936: 12 total, 12 up, 12 in 2023-03-02T18:09:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:07 smithi136 ceph-mon[125702]: pgmap v13810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:09:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:07 smithi136 ceph-mon[125702]: osdmap e936: 12 total, 12 up, 12 in 2023-03-02T18:09:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:08.930+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:09:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:08.930+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:09:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:08.931+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:09:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:08.931+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:09:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:08.931+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:09:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:09 smithi057 ceph-mon[92072]: pgmap v13812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:09:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:09 smithi122 ceph-mon[125440]: pgmap v13812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:09:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:09 smithi136 ceph-mon[125702]: pgmap v13812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:09:11.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:11 smithi057 ceph-mon[92072]: pgmap v13813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:09:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:11 smithi122 ceph-mon[125440]: pgmap v13813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:09:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:11 smithi136 ceph-mon[125702]: pgmap v13813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:09:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:13 smithi057 ceph-mon[92072]: pgmap v13814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:09:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:13 smithi122 ceph-mon[125440]: pgmap v13814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:09:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:13 smithi136 ceph-mon[125702]: pgmap v13814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:09:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:15 smithi057 ceph-mon[92072]: pgmap v13815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:09:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:15 smithi122 ceph-mon[125440]: pgmap v13815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:09:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:15 smithi136 ceph-mon[125702]: pgmap v13815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:09:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:17 smithi057 ceph-mon[92072]: pgmap v13816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:09:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:17 smithi057 ceph-mon[92072]: osdmap e937: 12 total, 12 up, 12 in 2023-03-02T18:09:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:17 smithi122 ceph-mon[125440]: pgmap v13816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:09:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:17 smithi122 ceph-mon[125440]: osdmap e937: 12 total, 12 up, 12 in 2023-03-02T18:09:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:17 smithi136 ceph-mon[125702]: pgmap v13816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:09:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:17 smithi136 ceph-mon[125702]: osdmap e937: 12 total, 12 up, 12 in 2023-03-02T18:09:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:19 smithi057 ceph-mon[92072]: pgmap v13818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:09:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:19 smithi122 ceph-mon[125440]: pgmap v13818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:09:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:19 smithi136 ceph-mon[125702]: pgmap v13818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:09:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:21 smithi057 ceph-mon[92072]: pgmap v13819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:09:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:21 smithi122 ceph-mon[125440]: pgmap v13819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:09:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:21 smithi136 ceph-mon[125702]: pgmap v13819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:09:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:23 smithi057 ceph-mon[92072]: pgmap v13820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:09:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:23 smithi122 ceph-mon[125440]: pgmap v13820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:09:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:23 smithi136 ceph-mon[125702]: pgmap v13820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:09:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:23.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:09:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:23.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:09:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:23.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:09:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:23.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:09:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:23.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:09:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:25 smithi057 ceph-mon[92072]: pgmap v13821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:09:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:25 smithi122 ceph-mon[125440]: pgmap v13821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:09:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:25 smithi136 ceph-mon[125702]: pgmap v13821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:09:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:27 smithi057 ceph-mon[92072]: pgmap v13822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:09:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:27 smithi122 ceph-mon[125440]: pgmap v13822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:09:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:27 smithi136 ceph-mon[125702]: pgmap v13822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:09:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:09:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:09:28.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:09:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:29 smithi057 ceph-mon[92072]: pgmap v13823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:09:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:29 smithi122 ceph-mon[125440]: pgmap v13823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:09:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:29 smithi136 ceph-mon[125702]: pgmap v13823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:09:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:31 smithi057 ceph-mon[92072]: pgmap v13824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:31 smithi122 ceph-mon[125440]: pgmap v13824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:31 smithi136 ceph-mon[125702]: pgmap v13824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:09:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:09:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:09:32.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:09:32.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:09:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:09:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:09:32.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:09:32.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:09:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:09:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:09:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:09:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:09:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:09:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:33 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:09:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:33 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:09:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:33 smithi057 ceph-mon[92072]: pgmap v13825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:33 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:09:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:33 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:09:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:33 smithi122 ceph-mon[125440]: pgmap v13825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:33 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:09:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:33 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:09:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:33 smithi136 ceph-mon[125702]: pgmap v13825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:35 smithi122 ceph-mon[125440]: pgmap v13826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:35 smithi136 ceph-mon[125702]: pgmap v13826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:35 smithi057 ceph-mon[92072]: pgmap v13826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:37 smithi122 ceph-mon[125440]: pgmap v13827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:37 smithi136 ceph-mon[125702]: pgmap v13827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:37 smithi057 ceph-mon[92072]: pgmap v13827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:38.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:09:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:38.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:09:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:38.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:09:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:38.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:09:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:38.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:09:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:39 smithi136 ceph-mon[125702]: pgmap v13828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:39 smithi057 ceph-mon[92072]: pgmap v13828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:39 smithi122 ceph-mon[125440]: pgmap v13828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:41.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:41 smithi136 ceph-mon[125702]: pgmap v13829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:41 smithi057 ceph-mon[92072]: pgmap v13829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:41 smithi122 ceph-mon[125440]: pgmap v13829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:43 smithi136 ceph-mon[125702]: pgmap v13830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:43 smithi057 ceph-mon[92072]: pgmap v13830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:43 smithi122 ceph-mon[125440]: pgmap v13830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:45 smithi136 ceph-mon[125702]: pgmap v13831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:45 smithi057 ceph-mon[92072]: pgmap v13831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:45 smithi122 ceph-mon[125440]: pgmap v13831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:47 smithi136 ceph-mon[125702]: pgmap v13832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:47 smithi057 ceph-mon[92072]: pgmap v13832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:47 smithi122 ceph-mon[125440]: pgmap v13832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:49 smithi136 ceph-mon[125702]: pgmap v13833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:49 smithi057 ceph-mon[92072]: pgmap v13833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:49 smithi122 ceph-mon[125440]: pgmap v13833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:51 smithi136 ceph-mon[125702]: pgmap v13834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:51 smithi057 ceph-mon[92072]: pgmap v13834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:51 smithi122 ceph-mon[125440]: pgmap v13834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:53 smithi136 ceph-mon[125702]: pgmap v13835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:53 smithi057 ceph-mon[92072]: pgmap v13835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:53 smithi122 ceph-mon[125440]: pgmap v13835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:53.966+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:09:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:53.966+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:09:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:53.966+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:09:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:53.966+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:09:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:09:53.966+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:09:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:55 smithi136 ceph-mon[125702]: pgmap v13836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:55 smithi057 ceph-mon[92072]: pgmap v13836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:55 smithi122 ceph-mon[125440]: pgmap v13836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:57 smithi136 ceph-mon[125702]: pgmap v13837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:57 smithi057 ceph-mon[92072]: pgmap v13837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:57 smithi122 ceph-mon[125440]: pgmap v13837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:09:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:09:59 smithi136 ceph-mon[125702]: pgmap v13838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:09:59 smithi057 ceph-mon[92072]: pgmap v13838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:09:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:09:59 smithi122 ceph-mon[125440]: pgmap v13838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T18:10:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T18:10:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T18:10:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:01 smithi136 ceph-mon[125702]: pgmap v13839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:01 smithi057 ceph-mon[92072]: pgmap v13839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:01 smithi122 ceph-mon[125440]: pgmap v13839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:03 smithi136 ceph-mon[125702]: pgmap v13840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:10:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:03 smithi057 ceph-mon[92072]: pgmap v13840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:10:03.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:03 smithi122 ceph-mon[125440]: pgmap v13840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:10:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:05 smithi136 ceph-mon[125702]: pgmap v13841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:10:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:05 smithi057 ceph-mon[92072]: pgmap v13841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:10:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:05 smithi122 ceph-mon[125440]: pgmap v13841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:10:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:07 smithi136 ceph-mon[125702]: pgmap v13842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:10:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:07 smithi057 ceph-mon[92072]: pgmap v13842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:10:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:07 smithi122 ceph-mon[125440]: pgmap v13842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:10:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:08.980+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:10:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:08.980+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:10:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:08.980+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:10:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:08.980+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:10:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:08.980+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:10:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:09 smithi136 ceph-mon[125702]: pgmap v13843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:10:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:09 smithi057 ceph-mon[92072]: pgmap v13843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:10:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:09 smithi122 ceph-mon[125440]: pgmap v13843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:10:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:11 smithi136 ceph-mon[125702]: pgmap v13844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:10:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:11 smithi057 ceph-mon[92072]: pgmap v13844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:10:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:11 smithi122 ceph-mon[125440]: pgmap v13844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:10:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:12 smithi136 ceph-mon[125702]: osdmap e938: 12 total, 12 up, 12 in 2023-03-02T18:10:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:12 smithi057 ceph-mon[92072]: osdmap e938: 12 total, 12 up, 12 in 2023-03-02T18:10:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:12 smithi122 ceph-mon[125440]: osdmap e938: 12 total, 12 up, 12 in 2023-03-02T18:10:13.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:13 smithi136 ceph-mon[125702]: pgmap v13846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:13 smithi057 ceph-mon[92072]: pgmap v13846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:13 smithi122 ceph-mon[125440]: pgmap v13846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:15 smithi136 ceph-mon[125702]: pgmap v13847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:15 smithi057 ceph-mon[92072]: pgmap v13847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:15 smithi122 ceph-mon[125440]: pgmap v13847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:17.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:17 smithi057 ceph-mon[92072]: pgmap v13848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:17 smithi057 ceph-mon[92072]: osdmap e939: 12 total, 12 up, 12 in 2023-03-02T18:10:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:17 smithi122 ceph-mon[125440]: pgmap v13848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:17.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:17 smithi122 ceph-mon[125440]: osdmap e939: 12 total, 12 up, 12 in 2023-03-02T18:10:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:17 smithi136 ceph-mon[125702]: pgmap v13848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:17 smithi136 ceph-mon[125702]: osdmap e939: 12 total, 12 up, 12 in 2023-03-02T18:10:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:19 smithi057 ceph-mon[92072]: pgmap v13850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T18:10:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:19 smithi122 ceph-mon[125440]: pgmap v13850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T18:10:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:19 smithi136 ceph-mon[125702]: pgmap v13850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T18:10:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:21 smithi057 ceph-mon[92072]: pgmap v13851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 358 B/s wr, 12 op/s 2023-03-02T18:10:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:21 smithi122 ceph-mon[125440]: pgmap v13851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 358 B/s wr, 12 op/s 2023-03-02T18:10:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:21 smithi136 ceph-mon[125702]: pgmap v13851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 358 B/s wr, 12 op/s 2023-03-02T18:10:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:23 smithi057 ceph-mon[92072]: pgmap v13852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:23 smithi122 ceph-mon[125440]: pgmap v13852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:23 smithi136 ceph-mon[125702]: pgmap v13852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:23.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:10:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:23.986+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:10:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:23.986+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:10:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:23.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:10:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:23.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:10:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:25 smithi057 ceph-mon[92072]: pgmap v13853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:25 smithi122 ceph-mon[125440]: pgmap v13853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:25 smithi136 ceph-mon[125702]: pgmap v13853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:27.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:27 smithi057 ceph-mon[92072]: pgmap v13854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:27 smithi122 ceph-mon[125440]: pgmap v13854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:27 smithi136 ceph-mon[125702]: pgmap v13854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:10:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:29 smithi057 ceph-mon[92072]: pgmap v13855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 174 B/s wr, 13 op/s 2023-03-02T18:10:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:29 smithi122 ceph-mon[125440]: pgmap v13855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 174 B/s wr, 13 op/s 2023-03-02T18:10:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:29 smithi136 ceph-mon[125702]: pgmap v13855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 174 B/s wr, 13 op/s 2023-03-02T18:10:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:31 smithi122 ceph-mon[125440]: pgmap v13856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:31 smithi136 ceph-mon[125702]: pgmap v13856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:31 smithi057 ceph-mon[92072]: pgmap v13856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:10:32.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:10:32.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:10:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:33 smithi122 ceph-mon[125440]: pgmap v13857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:10:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:10:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:10:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:33 smithi136 ceph-mon[125702]: pgmap v13857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:10:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:10:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:10:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:33 smithi057 ceph-mon[92072]: pgmap v13857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:10:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:10:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:10:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:35 smithi122 ceph-mon[125440]: pgmap v13858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:35 smithi136 ceph-mon[125702]: pgmap v13858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:35 smithi057 ceph-mon[92072]: pgmap v13858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:37 smithi136 ceph-mon[125702]: pgmap v13859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:37 smithi057 ceph-mon[92072]: pgmap v13859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:37 smithi122 ceph-mon[125440]: pgmap v13859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:38.996+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:10:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:38.997+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:10:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:38.997+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:10:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:38.997+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:10:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:38.997+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:10:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:39 smithi136 ceph-mon[125702]: pgmap v13860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:39 smithi057 ceph-mon[92072]: pgmap v13860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:39 smithi122 ceph-mon[125440]: pgmap v13860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:41 smithi136 ceph-mon[125702]: pgmap v13861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:41 smithi057 ceph-mon[92072]: pgmap v13861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:41 smithi122 ceph-mon[125440]: pgmap v13861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:43 smithi136 ceph-mon[125702]: pgmap v13862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:43 smithi057 ceph-mon[92072]: pgmap v13862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:43 smithi122 ceph-mon[125440]: pgmap v13862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:45 smithi136 ceph-mon[125702]: pgmap v13863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:45 smithi057 ceph-mon[92072]: pgmap v13863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:45 smithi122 ceph-mon[125440]: pgmap v13863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:47 smithi136 ceph-mon[125702]: pgmap v13864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:47 smithi057 ceph-mon[92072]: pgmap v13864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:47 smithi122 ceph-mon[125440]: pgmap v13864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:49 smithi136 ceph-mon[125702]: pgmap v13865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:49 smithi057 ceph-mon[92072]: pgmap v13865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:49 smithi122 ceph-mon[125440]: pgmap v13865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:51 smithi136 ceph-mon[125702]: pgmap v13866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:51 smithi057 ceph-mon[92072]: pgmap v13866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:51 smithi122 ceph-mon[125440]: pgmap v13866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:53 smithi136 ceph-mon[125702]: pgmap v13867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:53 smithi057 ceph-mon[92072]: pgmap v13867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:53 smithi122 ceph-mon[125440]: pgmap v13867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:54.012 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:54.011+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:10:54.012 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:54.012+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:10:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:54.012+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:10:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:54.012+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:10:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:10:54.012+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:10:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:55 smithi136 ceph-mon[125702]: pgmap v13868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:55 smithi057 ceph-mon[92072]: pgmap v13868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:55 smithi122 ceph-mon[125440]: pgmap v13868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:57.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:57 smithi136 ceph-mon[125702]: pgmap v13869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:57 smithi057 ceph-mon[92072]: pgmap v13869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:57 smithi122 ceph-mon[125440]: pgmap v13869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:10:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:10:59 smithi136 ceph-mon[125702]: pgmap v13870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:10:59 smithi057 ceph-mon[92072]: pgmap v13870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:10:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:10:59 smithi122 ceph-mon[125440]: pgmap v13870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:01 smithi136 ceph-mon[125702]: pgmap v13871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:01 smithi057 ceph-mon[92072]: pgmap v13871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:01 smithi122 ceph-mon[125440]: pgmap v13871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:03.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:03 smithi136 ceph-mon[125702]: pgmap v13872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:11:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:03 smithi057 ceph-mon[92072]: pgmap v13872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:11:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:03 smithi122 ceph-mon[125440]: pgmap v13872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:11:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:05 smithi136 ceph-mon[125702]: pgmap v13873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:11:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:05 smithi057 ceph-mon[92072]: pgmap v13873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:11:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:05 smithi122 ceph-mon[125440]: pgmap v13873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:11:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:07 smithi136 ceph-mon[125702]: pgmap v13874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:11:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:07 smithi057 ceph-mon[92072]: pgmap v13874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:11:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:07 smithi122 ceph-mon[125440]: pgmap v13874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:11:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:09.027+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:11:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:09.028+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:11:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:09.028+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:11:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:09.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:11:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:09.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:11:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:09 smithi136 ceph-mon[125702]: pgmap v13875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:11:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:09 smithi057 ceph-mon[92072]: pgmap v13875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:11:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:09 smithi122 ceph-mon[125440]: pgmap v13875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:11:11.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:11 smithi136 ceph-mon[125702]: pgmap v13876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:11:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:11 smithi057 ceph-mon[92072]: pgmap v13876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:11:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:11 smithi122 ceph-mon[125440]: pgmap v13876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:11:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:12.111+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:11:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:12.111+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:11:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:12.112+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 202 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:11:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:12.112+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 201 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:11:12.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:12 smithi136 ceph-mon[125702]: osdmap e940: 12 total, 12 up, 12 in 2023-03-02T18:11:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:12 smithi057 ceph-mon[92072]: osdmap e940: 12 total, 12 up, 12 in 2023-03-02T18:11:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:12 smithi122 ceph-mon[125440]: osdmap e940: 12 total, 12 up, 12 in 2023-03-02T18:11:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:13 smithi136 ceph-mon[125702]: pgmap v13878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:13 smithi057 ceph-mon[92072]: pgmap v13878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:13 smithi122 ceph-mon[125440]: pgmap v13878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:15.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:15 smithi136 ceph-mon[125702]: pgmap v13879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:15 smithi057 ceph-mon[92072]: pgmap v13879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:15 smithi122 ceph-mon[125440]: pgmap v13879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:17 smithi136 ceph-mon[125702]: pgmap v13880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:17 smithi057 ceph-mon[92072]: pgmap v13880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:17 smithi122 ceph-mon[125440]: pgmap v13880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:19 smithi136 ceph-mon[125702]: pgmap v13881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:19 smithi057 ceph-mon[92072]: pgmap v13881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:19 smithi122 ceph-mon[125440]: pgmap v13881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:21.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:21 smithi136 ceph-mon[125702]: pgmap v13882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:21 smithi136 ceph-mon[125702]: osdmap e941: 12 total, 12 up, 12 in 2023-03-02T18:11:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:21 smithi057 ceph-mon[92072]: pgmap v13882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:21 smithi057 ceph-mon[92072]: osdmap e941: 12 total, 12 up, 12 in 2023-03-02T18:11:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:21 smithi122 ceph-mon[125440]: pgmap v13882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:11:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:21 smithi122 ceph-mon[125440]: osdmap e941: 12 total, 12 up, 12 in 2023-03-02T18:11:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:23 smithi136 ceph-mon[125702]: pgmap v13884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:11:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:23 smithi057 ceph-mon[92072]: pgmap v13884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:11:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:23 smithi122 ceph-mon[125440]: pgmap v13884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:11:24.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:24.033+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:11:24.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:24.033+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:11:24.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:24.033+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:11:24.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:24.033+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:11:24.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:24.033+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:11:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:25 smithi136 ceph-mon[125702]: pgmap v13885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:11:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:25 smithi057 ceph-mon[92072]: pgmap v13885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:11:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:25 smithi122 ceph-mon[125440]: pgmap v13885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:11:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:27 smithi136 ceph-mon[125702]: pgmap v13886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:11:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:27 smithi057 ceph-mon[92072]: pgmap v13886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:11:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:27 smithi122 ceph-mon[125440]: pgmap v13886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:11:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:29 smithi136 ceph-mon[125702]: pgmap v13887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:11:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:29 smithi057 ceph-mon[92072]: pgmap v13887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:11:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:29 smithi122 ceph-mon[125440]: pgmap v13887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:11:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:31 smithi136 ceph-mon[125702]: pgmap v13888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:11:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:31 smithi057 ceph-mon[92072]: pgmap v13888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:11:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:31 smithi122 ceph-mon[125440]: pgmap v13888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:11:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:33 smithi136 ceph-mon[125702]: pgmap v13889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 op/s 2023-03-02T18:11:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:11:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:11:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:11:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:33 smithi057 ceph-mon[92072]: pgmap v13889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 op/s 2023-03-02T18:11:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:11:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:11:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:11:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:33 smithi122 ceph-mon[125440]: pgmap v13889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 op/s 2023-03-02T18:11:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:11:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:11:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:11:34.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:11:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:11:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:11:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:11:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:11:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:11:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:11:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:11:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:11:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:35 smithi136 ceph-mon[125702]: pgmap v13890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:35 smithi057 ceph-mon[92072]: pgmap v13890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:35 smithi122 ceph-mon[125440]: pgmap v13890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:37 smithi057 ceph-mon[92072]: pgmap v13891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:37 smithi122 ceph-mon[125440]: pgmap v13891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:37 smithi136 ceph-mon[125702]: pgmap v13891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:39.046+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:11:39.047 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:39.046+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:11:39.047 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:39.046+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:11:39.047 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:39.046+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:11:39.047 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:39.046+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:11:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:39 smithi057 ceph-mon[92072]: pgmap v13892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:39 smithi122 ceph-mon[125440]: pgmap v13892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:39 smithi136 ceph-mon[125702]: pgmap v13892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:41 smithi057 ceph-mon[92072]: pgmap v13893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:41 smithi122 ceph-mon[125440]: pgmap v13893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:41 smithi136 ceph-mon[125702]: pgmap v13893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:43 smithi057 ceph-mon[92072]: pgmap v13894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:43 smithi122 ceph-mon[125440]: pgmap v13894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:43 smithi136 ceph-mon[125702]: pgmap v13894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:45 smithi057 ceph-mon[92072]: pgmap v13895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:45 smithi122 ceph-mon[125440]: pgmap v13895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:45 smithi136 ceph-mon[125702]: pgmap v13895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:47 smithi057 ceph-mon[92072]: pgmap v13896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:47 smithi122 ceph-mon[125440]: pgmap v13896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:47 smithi136 ceph-mon[125702]: pgmap v13896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:49 smithi057 ceph-mon[92072]: pgmap v13897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:49 smithi122 ceph-mon[125440]: pgmap v13897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:49 smithi136 ceph-mon[125702]: pgmap v13897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:51 smithi057 ceph-mon[92072]: pgmap v13898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:51 smithi122 ceph-mon[125440]: pgmap v13898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:51 smithi136 ceph-mon[125702]: pgmap v13898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:53 smithi057 ceph-mon[92072]: pgmap v13899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:53 smithi122 ceph-mon[125440]: pgmap v13899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:54.059+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:11:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:54.059+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:11:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:54.059+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:11:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:54.059+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:11:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:11:54.059+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:11:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:53 smithi136 ceph-mon[125702]: pgmap v13899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:55 smithi057 ceph-mon[92072]: pgmap v13900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:55 smithi122 ceph-mon[125440]: pgmap v13900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:55 smithi136 ceph-mon[125702]: pgmap v13900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:57 smithi057 ceph-mon[92072]: pgmap v13901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:57 smithi122 ceph-mon[125440]: pgmap v13901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:57 smithi136 ceph-mon[125702]: pgmap v13901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:11:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:11:59 smithi057 ceph-mon[92072]: pgmap v13902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:11:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:11:59 smithi122 ceph-mon[125440]: pgmap v13902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:11:59 smithi136 ceph-mon[125702]: pgmap v13902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:01 smithi057 ceph-mon[92072]: pgmap v13903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:01.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:01 smithi122 ceph-mon[125440]: pgmap v13903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:01 smithi136 ceph-mon[125702]: pgmap v13903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:03 smithi057 ceph-mon[92072]: pgmap v13904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:12:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:03 smithi122 ceph-mon[125440]: pgmap v13904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:12:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:03 smithi136 ceph-mon[125702]: pgmap v13904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:12:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:05 smithi057 ceph-mon[92072]: pgmap v13905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:12:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:05 smithi122 ceph-mon[125440]: pgmap v13905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:12:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:05 smithi136 ceph-mon[125702]: pgmap v13905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:12:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:07 smithi057 ceph-mon[92072]: pgmap v13906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:12:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:07 smithi057 ceph-mon[92072]: osdmap e942: 12 total, 12 up, 12 in 2023-03-02T18:12:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:07 smithi122 ceph-mon[125440]: pgmap v13906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:12:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:07 smithi122 ceph-mon[125440]: osdmap e942: 12 total, 12 up, 12 in 2023-03-02T18:12:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:07 smithi136 ceph-mon[125702]: pgmap v13906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:12:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:07 smithi136 ceph-mon[125702]: osdmap e942: 12 total, 12 up, 12 in 2023-03-02T18:12:09.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:09.074+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:12:09.076 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:09.075+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:12:09.076 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:09.075+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:12:09.076 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:09.075+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:12:09.076 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:09.075+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:12:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:09 smithi057 ceph-mon[92072]: pgmap v13908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:12:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:09 smithi122 ceph-mon[125440]: pgmap v13908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:12:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:09 smithi136 ceph-mon[125702]: pgmap v13908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:12:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:11 smithi122 ceph-mon[125440]: pgmap v13909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:12:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:11 smithi136 ceph-mon[125702]: pgmap v13909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:12:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:11 smithi057 ceph-mon[92072]: pgmap v13909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:12:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:13 smithi122 ceph-mon[125440]: pgmap v13910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:12:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:13 smithi136 ceph-mon[125702]: pgmap v13910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:12:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:13 smithi057 ceph-mon[92072]: pgmap v13910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:12:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:15 smithi122 ceph-mon[125440]: pgmap v13911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:12:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:15 smithi136 ceph-mon[125702]: pgmap v13911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:12:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:15 smithi057 ceph-mon[92072]: pgmap v13911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:12:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:17 smithi122 ceph-mon[125440]: pgmap v13912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:12:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:17 smithi122 ceph-mon[125440]: osdmap e943: 12 total, 12 up, 12 in 2023-03-02T18:12:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:17 smithi136 ceph-mon[125702]: pgmap v13912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:12:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:17 smithi136 ceph-mon[125702]: osdmap e943: 12 total, 12 up, 12 in 2023-03-02T18:12:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:17 smithi057 ceph-mon[92072]: pgmap v13912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:12:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:17 smithi057 ceph-mon[92072]: osdmap e943: 12 total, 12 up, 12 in 2023-03-02T18:12:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:19 smithi136 ceph-mon[125702]: pgmap v13914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:12:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:19 smithi057 ceph-mon[92072]: pgmap v13914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:12:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:19 smithi122 ceph-mon[125440]: pgmap v13914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:12:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:21 smithi136 ceph-mon[125702]: pgmap v13915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:12:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:21 smithi057 ceph-mon[92072]: pgmap v13915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:12:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:21 smithi122 ceph-mon[125440]: pgmap v13915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:12:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:23 smithi136 ceph-mon[125702]: pgmap v13916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:12:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:23 smithi057 ceph-mon[92072]: pgmap v13916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:12:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:23 smithi122 ceph-mon[125440]: pgmap v13916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:12:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:24.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:12:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:24.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:12:24.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:24.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:12:24.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:24.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:12:24.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:24.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:12:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:25 smithi136 ceph-mon[125702]: pgmap v13917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:12:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:25 smithi057 ceph-mon[92072]: pgmap v13917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:12:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:25 smithi122 ceph-mon[125440]: pgmap v13917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:12:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:27 smithi136 ceph-mon[125702]: pgmap v13918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:12:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:27 smithi057 ceph-mon[92072]: pgmap v13918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:12:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:27 smithi122 ceph-mon[125440]: pgmap v13918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:12:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:29 smithi136 ceph-mon[125702]: pgmap v13919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:12:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:29 smithi057 ceph-mon[92072]: pgmap v13919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:12:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:29 smithi122 ceph-mon[125440]: pgmap v13919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:12:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:31 smithi136 ceph-mon[125702]: pgmap v13920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:31 smithi057 ceph-mon[92072]: pgmap v13920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:31 smithi122 ceph-mon[125440]: pgmap v13920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:33 smithi136 ceph-mon[125702]: pgmap v13921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:33 smithi057 ceph-mon[92072]: pgmap v13921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:33 smithi122 ceph-mon[125440]: pgmap v13921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:12:34.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:12:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:12:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:35 smithi057 ceph-mon[92072]: pgmap v13922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:12:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:12:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:35 smithi122 ceph-mon[125440]: pgmap v13922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:12:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:12:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:35 smithi136 ceph-mon[125702]: pgmap v13922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:12:36.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:12:36.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:12:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:37 smithi136 ceph-mon[125702]: pgmap v13923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:37 smithi057 ceph-mon[92072]: pgmap v13923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:37 smithi122 ceph-mon[125440]: pgmap v13923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:39.086+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:12:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:39.086+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:12:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:39.086+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:12:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:39.086+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:12:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:39.086+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:12:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:39 smithi136 ceph-mon[125702]: pgmap v13924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:39 smithi057 ceph-mon[92072]: pgmap v13924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:39 smithi122 ceph-mon[125440]: pgmap v13924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:41 smithi136 ceph-mon[125702]: pgmap v13925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:41 smithi057 ceph-mon[92072]: pgmap v13925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:41 smithi122 ceph-mon[125440]: pgmap v13925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:43 smithi136 ceph-mon[125702]: pgmap v13926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:43 smithi057 ceph-mon[92072]: pgmap v13926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:43 smithi122 ceph-mon[125440]: pgmap v13926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:45.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:45 smithi136 ceph-mon[125702]: pgmap v13927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:45 smithi057 ceph-mon[92072]: pgmap v13927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:45 smithi122 ceph-mon[125440]: pgmap v13927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:47 smithi136 ceph-mon[125702]: pgmap v13928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:47 smithi057 ceph-mon[92072]: pgmap v13928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:47 smithi122 ceph-mon[125440]: pgmap v13928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:49 smithi136 ceph-mon[125702]: pgmap v13929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:49 smithi057 ceph-mon[92072]: pgmap v13929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:49 smithi122 ceph-mon[125440]: pgmap v13929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:51 smithi136 ceph-mon[125702]: pgmap v13930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:51 smithi057 ceph-mon[92072]: pgmap v13930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:51 smithi122 ceph-mon[125440]: pgmap v13930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:53 smithi136 ceph-mon[125702]: pgmap v13931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:53 smithi057 ceph-mon[92072]: pgmap v13931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:53 smithi122 ceph-mon[125440]: pgmap v13931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:54.102+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:12:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:54.103+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:12:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:54.103+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:12:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:54.103+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:12:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:12:54.103+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:12:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:55 smithi136 ceph-mon[125702]: pgmap v13932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:55 smithi057 ceph-mon[92072]: pgmap v13932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:55 smithi122 ceph-mon[125440]: pgmap v13932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:57 smithi136 ceph-mon[125702]: pgmap v13933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:57 smithi057 ceph-mon[92072]: pgmap v13933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:57 smithi122 ceph-mon[125440]: pgmap v13933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:12:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:12:59 smithi136 ceph-mon[125702]: pgmap v13934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:12:59 smithi057 ceph-mon[92072]: pgmap v13934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:12:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:12:59 smithi122 ceph-mon[125440]: pgmap v13934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:01 smithi136 ceph-mon[125702]: pgmap v13935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:01 smithi057 ceph-mon[92072]: pgmap v13935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:01 smithi122 ceph-mon[125440]: pgmap v13935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:03 smithi136 ceph-mon[125702]: pgmap v13936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:13:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:03 smithi057 ceph-mon[92072]: pgmap v13936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:13:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:03 smithi122 ceph-mon[125440]: pgmap v13936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:13:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:05 smithi136 ceph-mon[125702]: pgmap v13937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:13:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:05 smithi057 ceph-mon[92072]: pgmap v13937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:13:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:05 smithi122 ceph-mon[125440]: pgmap v13937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:13:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:07 smithi136 ceph-mon[125702]: pgmap v13938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:13:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:07 smithi136 ceph-mon[125702]: osdmap e944: 12 total, 12 up, 12 in 2023-03-02T18:13:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:07 smithi057 ceph-mon[92072]: pgmap v13938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:13:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:07 smithi057 ceph-mon[92072]: osdmap e944: 12 total, 12 up, 12 in 2023-03-02T18:13:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:07 smithi122 ceph-mon[125440]: pgmap v13938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:13:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:07 smithi122 ceph-mon[125440]: osdmap e944: 12 total, 12 up, 12 in 2023-03-02T18:13:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:09.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:13:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:09.115+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:13:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:09.115+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:13:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:09.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:13:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:09.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:13:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:09 smithi136 ceph-mon[125702]: pgmap v13940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:13:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:09 smithi057 ceph-mon[92072]: pgmap v13940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:13:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:09 smithi122 ceph-mon[125440]: pgmap v13940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:13:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:11 smithi136 ceph-mon[125702]: pgmap v13941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:13:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:11 smithi057 ceph-mon[92072]: pgmap v13941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:13:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:11 smithi122 ceph-mon[125440]: pgmap v13941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:13:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:13 smithi136 ceph-mon[125702]: pgmap v13942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:13:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:13 smithi057 ceph-mon[92072]: pgmap v13942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:13:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:13 smithi122 ceph-mon[125440]: pgmap v13942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:13:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:15 smithi136 ceph-mon[125702]: pgmap v13943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:13:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:15 smithi057 ceph-mon[92072]: pgmap v13943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:13:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:15 smithi122 ceph-mon[125440]: pgmap v13943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:13:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:17 smithi136 ceph-mon[125702]: pgmap v13944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:13:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:17 smithi136 ceph-mon[125702]: osdmap e945: 12 total, 12 up, 12 in 2023-03-02T18:13:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:17 smithi057 ceph-mon[92072]: pgmap v13944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:13:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:17 smithi057 ceph-mon[92072]: osdmap e945: 12 total, 12 up, 12 in 2023-03-02T18:13:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:17 smithi122 ceph-mon[125440]: pgmap v13944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:13:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:17 smithi122 ceph-mon[125440]: osdmap e945: 12 total, 12 up, 12 in 2023-03-02T18:13:19.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:19 smithi136 ceph-mon[125702]: pgmap v13946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:13:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:19 smithi057 ceph-mon[92072]: pgmap v13946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:13:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:19 smithi122 ceph-mon[125440]: pgmap v13946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:13:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:21 smithi136 ceph-mon[125702]: pgmap v13947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:13:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:21 smithi057 ceph-mon[92072]: pgmap v13947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:13:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:21 smithi122 ceph-mon[125440]: pgmap v13947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:13:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:23 smithi136 ceph-mon[125702]: pgmap v13948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:13:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:23 smithi057 ceph-mon[92072]: pgmap v13948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:13:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:23 smithi122 ceph-mon[125440]: pgmap v13948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:13:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:24.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:13:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:24.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:13:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:24.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:13:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:24.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:13:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:24.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:13:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:25 smithi136 ceph-mon[125702]: pgmap v13949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:13:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:25 smithi057 ceph-mon[92072]: pgmap v13949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:13:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:25 smithi122 ceph-mon[125440]: pgmap v13949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:13:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:27 smithi136 ceph-mon[125702]: pgmap v13950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:13:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:27 smithi057 ceph-mon[92072]: pgmap v13950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:13:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:27 smithi122 ceph-mon[125440]: pgmap v13950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:13:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:29 smithi136 ceph-mon[125702]: pgmap v13951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:13:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:29 smithi057 ceph-mon[92072]: pgmap v13951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:13:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:29 smithi122 ceph-mon[125440]: pgmap v13951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:13:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:31 smithi136 ceph-mon[125702]: pgmap v13952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:31 smithi057 ceph-mon[92072]: pgmap v13952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:31 smithi122 ceph-mon[125440]: pgmap v13952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:33 smithi136 ceph-mon[125702]: pgmap v13953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:33 smithi057 ceph-mon[92072]: pgmap v13953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:33 smithi122 ceph-mon[125440]: pgmap v13953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:35 smithi136 ceph-mon[125702]: pgmap v13954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:35 smithi057 ceph-mon[92072]: pgmap v13954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:35 smithi122 ceph-mon[125440]: pgmap v13954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:13:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:13:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:13:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:13:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:13:36.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:13:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:13:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:13:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:13:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:13:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:13:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:13:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:37 smithi136 ceph-mon[125702]: pgmap v13955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:37 smithi057 ceph-mon[92072]: pgmap v13955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:37 smithi122 ceph-mon[125440]: pgmap v13955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:39.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:13:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:39.139+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:13:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:39.139+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:13:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:39.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:13:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:39.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:13:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:39 smithi136 ceph-mon[125702]: pgmap v13956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:39 smithi057 ceph-mon[92072]: pgmap v13956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:39 smithi122 ceph-mon[125440]: pgmap v13956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:41 smithi136 ceph-mon[125702]: pgmap v13957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:41 smithi057 ceph-mon[92072]: pgmap v13957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:41 smithi122 ceph-mon[125440]: pgmap v13957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:43 smithi136 ceph-mon[125702]: pgmap v13958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:43 smithi057 ceph-mon[92072]: pgmap v13958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:43 smithi122 ceph-mon[125440]: pgmap v13958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:45 smithi136 ceph-mon[125702]: pgmap v13959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:45 smithi057 ceph-mon[92072]: pgmap v13959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:45 smithi122 ceph-mon[125440]: pgmap v13959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:47 smithi136 ceph-mon[125702]: pgmap v13960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:47 smithi057 ceph-mon[92072]: pgmap v13960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:47 smithi122 ceph-mon[125440]: pgmap v13960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:49 smithi136 ceph-mon[125702]: pgmap v13961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:49 smithi057 ceph-mon[92072]: pgmap v13961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:49 smithi122 ceph-mon[125440]: pgmap v13961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:51 smithi136 ceph-mon[125702]: pgmap v13962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:51 smithi057 ceph-mon[92072]: pgmap v13962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:51 smithi122 ceph-mon[125440]: pgmap v13962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:53 smithi136 ceph-mon[125702]: pgmap v13963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:53 smithi057 ceph-mon[92072]: pgmap v13963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:53 smithi122 ceph-mon[125440]: pgmap v13963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:54.147+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:13:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:54.147+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:13:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:54.147+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:13:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:54.147+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:13:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:13:54.147+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:13:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:55 smithi136 ceph-mon[125702]: pgmap v13964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:55 smithi057 ceph-mon[92072]: pgmap v13964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:55 smithi122 ceph-mon[125440]: pgmap v13964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:57 smithi136 ceph-mon[125702]: pgmap v13965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:57 smithi057 ceph-mon[92072]: pgmap v13965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:57 smithi122 ceph-mon[125440]: pgmap v13965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:13:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:13:59 smithi136 ceph-mon[125702]: pgmap v13966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:13:59 smithi057 ceph-mon[92072]: pgmap v13966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:13:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:13:59 smithi122 ceph-mon[125440]: pgmap v13966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:01 smithi136 ceph-mon[125702]: pgmap v13967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:01 smithi057 ceph-mon[92072]: pgmap v13967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:01 smithi122 ceph-mon[125440]: pgmap v13967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:03 smithi136 ceph-mon[125702]: pgmap v13968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:14:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:03 smithi057 ceph-mon[92072]: pgmap v13968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:14:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:03 smithi122 ceph-mon[125440]: pgmap v13968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:14:05.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:05 smithi136 ceph-mon[125702]: pgmap v13969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:14:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:05 smithi057 ceph-mon[92072]: pgmap v13969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:14:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:05 smithi122 ceph-mon[125440]: pgmap v13969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:14:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:07 smithi136 ceph-mon[125702]: pgmap v13970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:14:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:07 smithi136 ceph-mon[125702]: osdmap e946: 12 total, 12 up, 12 in 2023-03-02T18:14:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:07 smithi057 ceph-mon[92072]: pgmap v13970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:14:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:07 smithi057 ceph-mon[92072]: osdmap e946: 12 total, 12 up, 12 in 2023-03-02T18:14:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:07 smithi122 ceph-mon[125440]: pgmap v13970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:14:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:07 smithi122 ceph-mon[125440]: osdmap e946: 12 total, 12 up, 12 in 2023-03-02T18:14:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:08.420+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T18:14:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:08.420+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T18:14:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:08.420+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f58700970d0 tx=0x7f5870074000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:14:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:08.420+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f58700970d0 tx=0x7f5870074000 comp rx=0 tx=0).stop 2023-03-02T18:14:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:08.420+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T18:14:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:08.420+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T18:14:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:08.420+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T18:14:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:08.420+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T18:14:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:08.420+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:14:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:08.421+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5870019800 tx=0x7f5870096000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T18:14:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:09.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:14:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:09.163+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:14:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:09.163+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:14:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:09.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:14:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:09.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:14:09.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:09 smithi136 ceph-mon[125702]: pgmap v13972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:14:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:09 smithi057 ceph-mon[92072]: pgmap v13972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:14:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:09 smithi122 ceph-mon[125440]: pgmap v13972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:14:11.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:11 smithi136 ceph-mon[125702]: pgmap v13973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:14:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:11 smithi057 ceph-mon[92072]: pgmap v13973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:14:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:11 smithi122 ceph-mon[125440]: pgmap v13973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:14:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:12.137+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:14:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:12.137+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:14:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:12.138+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 203 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:14:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:12.138+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 202 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:14:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:13 smithi136 ceph-mon[125702]: pgmap v13974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:14:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:13 smithi057 ceph-mon[92072]: pgmap v13974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:14:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:13 smithi122 ceph-mon[125440]: pgmap v13974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:14:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:15 smithi136 ceph-mon[125702]: pgmap v13975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:14:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:15 smithi057 ceph-mon[92072]: pgmap v13975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:14:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:15 smithi122 ceph-mon[125440]: pgmap v13975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:14:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:17 smithi136 ceph-mon[125702]: pgmap v13976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:14:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:17 smithi136 ceph-mon[125702]: osdmap e947: 12 total, 12 up, 12 in 2023-03-02T18:14:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:17 smithi057 ceph-mon[92072]: pgmap v13976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:14:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:17 smithi057 ceph-mon[92072]: osdmap e947: 12 total, 12 up, 12 in 2023-03-02T18:14:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:17 smithi122 ceph-mon[125440]: pgmap v13976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:14:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:17 smithi122 ceph-mon[125440]: osdmap e947: 12 total, 12 up, 12 in 2023-03-02T18:14:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:19 smithi136 ceph-mon[125702]: pgmap v13978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:14:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:19 smithi057 ceph-mon[92072]: pgmap v13978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:14:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:19 smithi122 ceph-mon[125440]: pgmap v13978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:14:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:21 smithi136 ceph-mon[125702]: pgmap v13979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:14:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:21 smithi057 ceph-mon[92072]: pgmap v13979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:14:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:21 smithi122 ceph-mon[125440]: pgmap v13979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:14:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:23 smithi136 ceph-mon[125702]: pgmap v13980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:14:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:23 smithi057 ceph-mon[92072]: pgmap v13980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:14:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:23 smithi122 ceph-mon[125440]: pgmap v13980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:14:24.179 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:24.179+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:14:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:24.179+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:14:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:24.179+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:14:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:24.179+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:14:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:24.179+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:14:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:25 smithi136 ceph-mon[125702]: pgmap v13981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:14:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:25 smithi057 ceph-mon[92072]: pgmap v13981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:14:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:25 smithi122 ceph-mon[125440]: pgmap v13981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:14:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:27 smithi136 ceph-mon[125702]: pgmap v13982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:14:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:27 smithi057 ceph-mon[92072]: pgmap v13982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:14:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:27 smithi122 ceph-mon[125440]: pgmap v13982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:14:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:29 smithi136 ceph-mon[125702]: pgmap v13983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:14:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:29 smithi057 ceph-mon[92072]: pgmap v13983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:14:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:29 smithi122 ceph-mon[125440]: pgmap v13983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:14:31.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:31 smithi136 ceph-mon[125702]: pgmap v13984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:31 smithi057 ceph-mon[92072]: pgmap v13984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:31 smithi122 ceph-mon[125440]: pgmap v13984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:33 smithi136 ceph-mon[125702]: pgmap v13985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:33 smithi057 ceph-mon[92072]: pgmap v13985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:33 smithi122 ceph-mon[125440]: pgmap v13985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:35.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:35 smithi136 ceph-mon[125702]: pgmap v13986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:35 smithi057 ceph-mon[92072]: pgmap v13986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:35 smithi122 ceph-mon[125440]: pgmap v13986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:37 smithi136 ceph-mon[125702]: pgmap v13987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:14:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:14:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:14:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:14:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:37 smithi057 ceph-mon[92072]: pgmap v13987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:14:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:14:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:14:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:14:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:37 smithi122 ceph-mon[125440]: pgmap v13987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:14:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:14:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:14:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:14:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:39.193+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:14:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:39.193+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:14:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:39.193+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:14:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:39.193+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:14:39.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:39.193+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:14:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:39 smithi136 ceph-mon[125702]: pgmap v13988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:39 smithi057 ceph-mon[92072]: pgmap v13988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:39 smithi122 ceph-mon[125440]: pgmap v13988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:41 smithi136 ceph-mon[125702]: pgmap v13989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:41 smithi057 ceph-mon[92072]: pgmap v13989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:41 smithi122 ceph-mon[125440]: pgmap v13989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:43 smithi136 ceph-mon[125702]: pgmap v13990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:43 smithi057 ceph-mon[92072]: pgmap v13990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:43 smithi122 ceph-mon[125440]: pgmap v13990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:45 smithi136 ceph-mon[125702]: pgmap v13991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:45 smithi057 ceph-mon[92072]: pgmap v13991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:45 smithi122 ceph-mon[125440]: pgmap v13991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:47 smithi136 ceph-mon[125702]: pgmap v13992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:47 smithi057 ceph-mon[92072]: pgmap v13992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:47 smithi122 ceph-mon[125440]: pgmap v13992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:49 smithi136 ceph-mon[125702]: pgmap v13993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:49 smithi057 ceph-mon[92072]: pgmap v13993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:49 smithi122 ceph-mon[125440]: pgmap v13993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:51 smithi136 ceph-mon[125702]: pgmap v13994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:51 smithi057 ceph-mon[92072]: pgmap v13994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:51 smithi122 ceph-mon[125440]: pgmap v13994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:53 smithi136 ceph-mon[125702]: pgmap v13995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:53 smithi057 ceph-mon[92072]: pgmap v13995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:53 smithi122 ceph-mon[125440]: pgmap v13995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:54.208+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:14:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:54.208+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:14:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:54.208+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:14:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:54.208+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:14:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:14:54.208+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:14:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:55 smithi136 ceph-mon[125702]: pgmap v13996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:55 smithi057 ceph-mon[92072]: pgmap v13996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:55 smithi122 ceph-mon[125440]: pgmap v13996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:57 smithi136 ceph-mon[125702]: pgmap v13997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:57 smithi057 ceph-mon[92072]: pgmap v13997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:57 smithi122 ceph-mon[125440]: pgmap v13997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:14:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:14:59 smithi136 ceph-mon[125702]: pgmap v13998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:14:59 smithi057 ceph-mon[92072]: pgmap v13998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:14:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:14:59 smithi122 ceph-mon[125440]: pgmap v13998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:01 smithi136 ceph-mon[125702]: pgmap v13999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:01 smithi057 ceph-mon[92072]: pgmap v13999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:01 smithi122 ceph-mon[125440]: pgmap v13999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:03 smithi136 ceph-mon[125702]: pgmap v14000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:15:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:03 smithi057 ceph-mon[92072]: pgmap v14000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:15:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:03 smithi122 ceph-mon[125440]: pgmap v14000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:15:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:05 smithi136 ceph-mon[125702]: pgmap v14001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:15:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:05 smithi057 ceph-mon[92072]: pgmap v14001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:15:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:05 smithi122 ceph-mon[125440]: pgmap v14001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:15:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:07 smithi057 ceph-mon[92072]: pgmap v14002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:15:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:07 smithi057 ceph-mon[92072]: osdmap e948: 12 total, 12 up, 12 in 2023-03-02T18:15:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:07 smithi122 ceph-mon[125440]: pgmap v14002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:15:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:07 smithi122 ceph-mon[125440]: osdmap e948: 12 total, 12 up, 12 in 2023-03-02T18:15:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:07 smithi136 ceph-mon[125702]: pgmap v14002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:15:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:07 smithi136 ceph-mon[125702]: osdmap e948: 12 total, 12 up, 12 in 2023-03-02T18:15:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:09.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:15:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:09.218+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:15:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:09.218+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:15:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:09.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:15:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:09.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:15:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:09 smithi057 ceph-mon[92072]: pgmap v14004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:15:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:09 smithi122 ceph-mon[125440]: pgmap v14004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:15:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:09 smithi136 ceph-mon[125702]: pgmap v14004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:15:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:11 smithi057 ceph-mon[92072]: pgmap v14005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:15:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:11 smithi122 ceph-mon[125440]: pgmap v14005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:15:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:11 smithi136 ceph-mon[125702]: pgmap v14005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:15:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:13 smithi057 ceph-mon[92072]: pgmap v14006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:15:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:13 smithi122 ceph-mon[125440]: pgmap v14006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:15:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:13 smithi136 ceph-mon[125702]: pgmap v14006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:15:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:15 smithi057 ceph-mon[92072]: pgmap v14007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:15:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:15 smithi122 ceph-mon[125440]: pgmap v14007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:15:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:15 smithi136 ceph-mon[125702]: pgmap v14007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:15:17.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:17 smithi136 ceph-mon[125702]: pgmap v14008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:15:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:17 smithi136 ceph-mon[125702]: osdmap e949: 12 total, 12 up, 12 in 2023-03-02T18:15:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:17 smithi057 ceph-mon[92072]: pgmap v14008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:15:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:17 smithi057 ceph-mon[92072]: osdmap e949: 12 total, 12 up, 12 in 2023-03-02T18:15:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:17 smithi122 ceph-mon[125440]: pgmap v14008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:15:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:17 smithi122 ceph-mon[125440]: osdmap e949: 12 total, 12 up, 12 in 2023-03-02T18:15:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:19 smithi136 ceph-mon[125702]: pgmap v14010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:15:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:19 smithi057 ceph-mon[92072]: pgmap v14010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:15:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:19 smithi122 ceph-mon[125440]: pgmap v14010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:15:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:21 smithi136 ceph-mon[125702]: pgmap v14011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:15:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:21 smithi057 ceph-mon[92072]: pgmap v14011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:15:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:21 smithi122 ceph-mon[125440]: pgmap v14011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:15:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:23 smithi136 ceph-mon[125702]: pgmap v14012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:15:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:23 smithi057 ceph-mon[92072]: pgmap v14012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:15:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:23 smithi122 ceph-mon[125440]: pgmap v14012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:15:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:24.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:15:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:24.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:15:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:24.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:15:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:24.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:15:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:24.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:15:25.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:25 smithi136 ceph-mon[125702]: pgmap v14013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:15:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:25 smithi057 ceph-mon[92072]: pgmap v14013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:15:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:25 smithi122 ceph-mon[125440]: pgmap v14013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:15:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:27 smithi136 ceph-mon[125702]: pgmap v14014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:15:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:27 smithi057 ceph-mon[92072]: pgmap v14014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:15:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:27 smithi122 ceph-mon[125440]: pgmap v14014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:15:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:29 smithi136 ceph-mon[125702]: pgmap v14015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:15:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:29 smithi057 ceph-mon[92072]: pgmap v14015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:15:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:29 smithi122 ceph-mon[125440]: pgmap v14015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:15:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:31 smithi136 ceph-mon[125702]: pgmap v14016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:31 smithi057 ceph-mon[92072]: pgmap v14016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:31 smithi122 ceph-mon[125440]: pgmap v14016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:33 smithi136 ceph-mon[125702]: pgmap v14017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:33 smithi057 ceph-mon[92072]: pgmap v14017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:33 smithi122 ceph-mon[125440]: pgmap v14017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:35 smithi136 ceph-mon[125702]: pgmap v14018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:35 smithi057 ceph-mon[92072]: pgmap v14018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:35 smithi122 ceph-mon[125440]: pgmap v14018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:37 smithi136 ceph-mon[125702]: pgmap v14019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:15:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:37 smithi057 ceph-mon[92072]: pgmap v14019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:15:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:37 smithi122 ceph-mon[125440]: pgmap v14019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:15:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:15:38.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:15:38.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:15:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:15:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:15:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:15:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:15:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:15:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:15:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:39.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:15:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:39.236+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:15:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:39.236+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:15:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:39.236+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:15:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:39.236+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:15:39.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:39 smithi136 ceph-mon[125702]: pgmap v14020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:39 smithi057 ceph-mon[92072]: pgmap v14020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:39 smithi122 ceph-mon[125440]: pgmap v14020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:41 smithi136 ceph-mon[125702]: pgmap v14021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:41 smithi057 ceph-mon[92072]: pgmap v14021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:41 smithi122 ceph-mon[125440]: pgmap v14021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:43.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:43 smithi136 ceph-mon[125702]: pgmap v14022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:43 smithi057 ceph-mon[92072]: pgmap v14022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:43 smithi122 ceph-mon[125440]: pgmap v14022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:45 smithi136 ceph-mon[125702]: pgmap v14023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:45 smithi057 ceph-mon[92072]: pgmap v14023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:45 smithi122 ceph-mon[125440]: pgmap v14023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:47 smithi136 ceph-mon[125702]: pgmap v14024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:47 smithi057 ceph-mon[92072]: pgmap v14024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:47 smithi122 ceph-mon[125440]: pgmap v14024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:49.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:49 smithi136 ceph-mon[125702]: pgmap v14025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:49 smithi057 ceph-mon[92072]: pgmap v14025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:49 smithi122 ceph-mon[125440]: pgmap v14025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:51.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:51 smithi136 ceph-mon[125702]: pgmap v14026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:51 smithi057 ceph-mon[92072]: pgmap v14026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:51 smithi122 ceph-mon[125440]: pgmap v14026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:53.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:53 smithi136 ceph-mon[125702]: pgmap v14027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:53 smithi057 ceph-mon[92072]: pgmap v14027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:53 smithi122 ceph-mon[125440]: pgmap v14027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:54.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:54.252+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:15:54.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:54.252+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:15:54.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:54.252+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:15:54.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:54.252+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:15:54.254 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:15:54.252+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:15:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:55 smithi057 ceph-mon[92072]: pgmap v14028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:55 smithi122 ceph-mon[125440]: pgmap v14028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:55 smithi136 ceph-mon[125702]: pgmap v14028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:57 smithi057 ceph-mon[92072]: pgmap v14029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:57 smithi122 ceph-mon[125440]: pgmap v14029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:57 smithi136 ceph-mon[125702]: pgmap v14029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:15:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:15:59 smithi057 ceph-mon[92072]: pgmap v14030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:15:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:15:59 smithi122 ceph-mon[125440]: pgmap v14030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:16:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:15:59 smithi136 ceph-mon[125702]: pgmap v14030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:16:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:01 smithi057 ceph-mon[92072]: pgmap v14031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:01 smithi122 ceph-mon[125440]: pgmap v14031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:01 smithi136 ceph-mon[125702]: pgmap v14031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:03 smithi057 ceph-mon[92072]: pgmap v14032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:16:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:03 smithi122 ceph-mon[125440]: pgmap v14032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:16:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:03 smithi136 ceph-mon[125702]: pgmap v14032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:16:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:05 smithi057 ceph-mon[92072]: pgmap v14033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:16:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:05 smithi122 ceph-mon[125440]: pgmap v14033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:16:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:05 smithi136 ceph-mon[125702]: pgmap v14033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:16:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:07 smithi057 ceph-mon[92072]: pgmap v14034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:16:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:07 smithi057 ceph-mon[92072]: osdmap e950: 12 total, 12 up, 12 in 2023-03-02T18:16:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:07 smithi122 ceph-mon[125440]: pgmap v14034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:16:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:07 smithi122 ceph-mon[125440]: osdmap e950: 12 total, 12 up, 12 in 2023-03-02T18:16:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:07 smithi136 ceph-mon[125702]: pgmap v14034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:16:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:07 smithi136 ceph-mon[125702]: osdmap e950: 12 total, 12 up, 12 in 2023-03-02T18:16:09.256 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:09.256+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:16:09.257 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:09.256+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:16:09.257 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:09.256+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:16:09.258 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:09.256+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:16:09.258 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:09.256+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:16:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:09 smithi057 ceph-mon[92072]: pgmap v14036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:16:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:09 smithi122 ceph-mon[125440]: pgmap v14036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:16:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:09 smithi136 ceph-mon[125702]: pgmap v14036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:16:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:11 smithi057 ceph-mon[92072]: pgmap v14037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:16:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:11 smithi122 ceph-mon[125440]: pgmap v14037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:16:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:11 smithi136 ceph-mon[125702]: pgmap v14037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:16:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:13 smithi057 ceph-mon[92072]: pgmap v14038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:16:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:13 smithi122 ceph-mon[125440]: pgmap v14038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:16:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:13 smithi136 ceph-mon[125702]: pgmap v14038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:16:15.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:15 smithi057 ceph-mon[92072]: pgmap v14039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:16:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:15 smithi122 ceph-mon[125440]: pgmap v14039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:16:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:15 smithi136 ceph-mon[125702]: pgmap v14039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:16:17.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:17 smithi136 ceph-mon[125702]: pgmap v14040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:16:17.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:17 smithi136 ceph-mon[125702]: osdmap e951: 12 total, 12 up, 12 in 2023-03-02T18:16:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:17 smithi057 ceph-mon[92072]: pgmap v14040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:16:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:17 smithi057 ceph-mon[92072]: osdmap e951: 12 total, 12 up, 12 in 2023-03-02T18:16:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:17 smithi122 ceph-mon[125440]: pgmap v14040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:16:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:17 smithi122 ceph-mon[125440]: osdmap e951: 12 total, 12 up, 12 in 2023-03-02T18:16:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:19 smithi136 ceph-mon[125702]: pgmap v14042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:16:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:19 smithi057 ceph-mon[92072]: pgmap v14042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:16:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:19 smithi122 ceph-mon[125440]: pgmap v14042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:16:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:21 smithi136 ceph-mon[125702]: pgmap v14043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:16:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:21 smithi057 ceph-mon[92072]: pgmap v14043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:16:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:21 smithi122 ceph-mon[125440]: pgmap v14043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:16:23.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:23 smithi136 ceph-mon[125702]: pgmap v14044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:16:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:23 smithi057 ceph-mon[92072]: pgmap v14044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:16:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:23 smithi122 ceph-mon[125440]: pgmap v14044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:16:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:24.259+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:16:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:24.259+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:16:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:24.259+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:16:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:24.259+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:16:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:24.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:16:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:25 smithi136 ceph-mon[125702]: pgmap v14045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:16:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:25 smithi057 ceph-mon[92072]: pgmap v14045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:16:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:25 smithi122 ceph-mon[125440]: pgmap v14045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:16:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:27.157+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:16:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:27.157+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:16:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:27.157+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 204 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:16:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:27.157+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 203 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:16:27.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:27 smithi136 ceph-mon[125702]: pgmap v14046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:16:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:27 smithi057 ceph-mon[92072]: pgmap v14046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:16:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:27 smithi122 ceph-mon[125440]: pgmap v14046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:16:29.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:29 smithi136 ceph-mon[125702]: pgmap v14047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:16:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:29 smithi057 ceph-mon[92072]: pgmap v14047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:16:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:29 smithi122 ceph-mon[125440]: pgmap v14047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:16:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:31 smithi136 ceph-mon[125702]: pgmap v14048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:31 smithi057 ceph-mon[92072]: pgmap v14048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:31 smithi122 ceph-mon[125440]: pgmap v14048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:33.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:33 smithi136 ceph-mon[125702]: pgmap v14049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:16:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:33 smithi057 ceph-mon[92072]: pgmap v14049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:16:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:33 smithi122 ceph-mon[125440]: pgmap v14049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:16:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:35 smithi136 ceph-mon[125702]: pgmap v14050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:35 smithi057 ceph-mon[92072]: pgmap v14050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:35 smithi122 ceph-mon[125440]: pgmap v14050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:37.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:37 smithi136 ceph-mon[125702]: pgmap v14051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:37 smithi057 ceph-mon[92072]: pgmap v14051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:37 smithi122 ceph-mon[125440]: pgmap v14051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:16:38.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:16:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:16:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:39.275+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:16:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:39.275+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:16:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:39.275+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:16:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:39.275+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:16:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:39.275+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:16:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:39 smithi136 ceph-mon[125702]: pgmap v14052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:16:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:16:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:16:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:16:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:39 smithi057 ceph-mon[92072]: pgmap v14052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:16:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:16:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:16:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:16:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:39 smithi122 ceph-mon[125440]: pgmap v14052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:16:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:16:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:16:39.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:16:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:41 smithi136 ceph-mon[125702]: pgmap v14053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:16:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:41 smithi057 ceph-mon[92072]: pgmap v14053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:16:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:41 smithi122 ceph-mon[125440]: pgmap v14053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:16:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:43 smithi136 ceph-mon[125702]: pgmap v14054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:16:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:43 smithi057 ceph-mon[92072]: pgmap v14054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:16:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:43 smithi122 ceph-mon[125440]: pgmap v14054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:16:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:45 smithi057 ceph-mon[92072]: pgmap v14055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T18:16:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:45 smithi122 ceph-mon[125440]: pgmap v14055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T18:16:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:45 smithi136 ceph-mon[125702]: pgmap v14055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T18:16:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:47 smithi057 ceph-mon[92072]: pgmap v14056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T18:16:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:47 smithi122 ceph-mon[125440]: pgmap v14056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T18:16:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:47 smithi136 ceph-mon[125702]: pgmap v14056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T18:16:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:49 smithi057 ceph-mon[92072]: pgmap v14057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:16:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:49 smithi122 ceph-mon[125440]: pgmap v14057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:16:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:49 smithi136 ceph-mon[125702]: pgmap v14057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:16:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:51 smithi057 ceph-mon[92072]: pgmap v14058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:51 smithi122 ceph-mon[125440]: pgmap v14058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:51 smithi136 ceph-mon[125702]: pgmap v14058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:53 smithi057 ceph-mon[92072]: pgmap v14059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:16:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:53 smithi122 ceph-mon[125440]: pgmap v14059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:16:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:53 smithi136 ceph-mon[125702]: pgmap v14059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:16:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:54.285+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:16:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:54.285+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:16:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:54.285+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:16:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:54.285+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:16:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:16:54.285+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:16:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:55 smithi057 ceph-mon[92072]: pgmap v14060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:55 smithi122 ceph-mon[125440]: pgmap v14060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:55 smithi136 ceph-mon[125702]: pgmap v14060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:57 smithi057 ceph-mon[92072]: pgmap v14061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:57 smithi122 ceph-mon[125440]: pgmap v14061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:57 smithi136 ceph-mon[125702]: pgmap v14061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:16:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:16:59 smithi057 ceph-mon[92072]: pgmap v14062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:16:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:16:59 smithi122 ceph-mon[125440]: pgmap v14062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:16:59 smithi136 ceph-mon[125702]: pgmap v14062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:01 smithi057 ceph-mon[92072]: pgmap v14063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:01 smithi122 ceph-mon[125440]: pgmap v14063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:01 smithi136 ceph-mon[125702]: pgmap v14063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:03 smithi057 ceph-mon[92072]: pgmap v14064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:17:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:03 smithi122 ceph-mon[125440]: pgmap v14064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:17:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:03 smithi136 ceph-mon[125702]: pgmap v14064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:17:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:05 smithi057 ceph-mon[92072]: pgmap v14065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:17:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:05 smithi122 ceph-mon[125440]: pgmap v14065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:17:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:05 smithi136 ceph-mon[125702]: pgmap v14065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:17:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:07 smithi057 ceph-mon[92072]: pgmap v14066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:17:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:07 smithi122 ceph-mon[125440]: pgmap v14066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:17:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:07 smithi136 ceph-mon[125702]: pgmap v14066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:17:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:09.296+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:17:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:09.296+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:17:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:09.297+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:17:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:09.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:17:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:09.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:17:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:09 smithi057 ceph-mon[92072]: pgmap v14067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:17:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:09 smithi122 ceph-mon[125440]: pgmap v14067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:17:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:09 smithi136 ceph-mon[125702]: pgmap v14067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:17:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:11 smithi057 ceph-mon[92072]: pgmap v14068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:17:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:11 smithi122 ceph-mon[125440]: pgmap v14068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:17:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:11 smithi136 ceph-mon[125702]: pgmap v14068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:17:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:12.163+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:17:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:12.163+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:17:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:12.164+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 205 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:17:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:12.164+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 204 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:17:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:12 smithi057 ceph-mon[92072]: osdmap e952: 12 total, 12 up, 12 in 2023-03-02T18:17:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:12 smithi122 ceph-mon[125440]: osdmap e952: 12 total, 12 up, 12 in 2023-03-02T18:17:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:12 smithi136 ceph-mon[125702]: osdmap e952: 12 total, 12 up, 12 in 2023-03-02T18:17:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:13 smithi057 ceph-mon[92072]: pgmap v14070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:13 smithi122 ceph-mon[125440]: pgmap v14070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:13 smithi136 ceph-mon[125702]: pgmap v14070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:15 smithi122 ceph-mon[125440]: pgmap v14071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:15 smithi136 ceph-mon[125702]: pgmap v14071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:15 smithi057 ceph-mon[92072]: pgmap v14071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:17 smithi122 ceph-mon[125440]: pgmap v14072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:17 smithi136 ceph-mon[125702]: pgmap v14072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:17 smithi057 ceph-mon[92072]: pgmap v14072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:19 smithi122 ceph-mon[125440]: pgmap v14073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:17:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:19 smithi136 ceph-mon[125702]: pgmap v14073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:17:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:19 smithi057 ceph-mon[92072]: pgmap v14073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:17:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:21 smithi122 ceph-mon[125440]: pgmap v14074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:17:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:21 smithi122 ceph-mon[125440]: osdmap e953: 12 total, 12 up, 12 in 2023-03-02T18:17:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:21 smithi136 ceph-mon[125702]: pgmap v14074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:17:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:21 smithi136 ceph-mon[125702]: osdmap e953: 12 total, 12 up, 12 in 2023-03-02T18:17:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:21 smithi057 ceph-mon[92072]: pgmap v14074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:17:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:21 smithi057 ceph-mon[92072]: osdmap e953: 12 total, 12 up, 12 in 2023-03-02T18:17:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:23 smithi136 ceph-mon[125702]: pgmap v14076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:23 smithi057 ceph-mon[92072]: pgmap v14076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:23 smithi122 ceph-mon[125440]: pgmap v14076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:24.311+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:17:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:24.312+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:17:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:24.312+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:17:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:24.312+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:17:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:24.312+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:17:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:25 smithi136 ceph-mon[125702]: pgmap v14077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:25 smithi057 ceph-mon[92072]: pgmap v14077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:25 smithi122 ceph-mon[125440]: pgmap v14077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:27 smithi136 ceph-mon[125702]: pgmap v14078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:27 smithi057 ceph-mon[92072]: pgmap v14078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:27 smithi122 ceph-mon[125440]: pgmap v14078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:17:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:29 smithi136 ceph-mon[125702]: pgmap v14079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:17:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:29 smithi057 ceph-mon[92072]: pgmap v14079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:17:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:29 smithi122 ceph-mon[125440]: pgmap v14079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:17:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:31 smithi136 ceph-mon[125702]: pgmap v14080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:17:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:31 smithi057 ceph-mon[92072]: pgmap v14080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:17:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:31 smithi122 ceph-mon[125440]: pgmap v14080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:17:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:33 smithi136 ceph-mon[125702]: pgmap v14081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 op/s 2023-03-02T18:17:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:33 smithi057 ceph-mon[92072]: pgmap v14081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 op/s 2023-03-02T18:17:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:33 smithi122 ceph-mon[125440]: pgmap v14081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 op/s 2023-03-02T18:17:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:35 smithi136 ceph-mon[125702]: pgmap v14082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:35 smithi057 ceph-mon[92072]: pgmap v14082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:35 smithi122 ceph-mon[125440]: pgmap v14082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:37 smithi136 ceph-mon[125702]: pgmap v14083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:37 smithi057 ceph-mon[92072]: pgmap v14083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:37 smithi122 ceph-mon[125440]: pgmap v14083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:39.327+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:17:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:39.328+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:17:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:39.328+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:17:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:39.328+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:17:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:39.328+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:17:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:39 smithi136 ceph-mon[125702]: pgmap v14084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:17:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:39 smithi057 ceph-mon[92072]: pgmap v14084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:17:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:39 smithi122 ceph-mon[125440]: pgmap v14084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:17:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:17:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:17:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:17:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:17:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:17:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:17:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:17:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:17:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:17:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:41 smithi057 ceph-mon[92072]: pgmap v14085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:41 smithi122 ceph-mon[125440]: pgmap v14085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:42.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:41 smithi136 ceph-mon[125702]: pgmap v14085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:43 smithi057 ceph-mon[92072]: pgmap v14086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:43 smithi122 ceph-mon[125440]: pgmap v14086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:43 smithi136 ceph-mon[125702]: pgmap v14086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:45.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:44 smithi136 ceph-mon[125702]: pgmap v14087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:45.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:44 smithi057 ceph-mon[92072]: pgmap v14087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:44 smithi122 ceph-mon[125440]: pgmap v14087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:47.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:47 smithi136 ceph-mon[125702]: pgmap v14088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:47 smithi057 ceph-mon[92072]: pgmap v14088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:47 smithi122 ceph-mon[125440]: pgmap v14088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:17:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:49 smithi136 ceph-mon[125702]: pgmap v14089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:49 smithi057 ceph-mon[92072]: pgmap v14089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:49 smithi122 ceph-mon[125440]: pgmap v14089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:51 smithi136 ceph-mon[125702]: pgmap v14090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:17:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:51 smithi057 ceph-mon[92072]: pgmap v14090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:17:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:51 smithi122 ceph-mon[125440]: pgmap v14090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:17:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:53 smithi136 ceph-mon[125702]: pgmap v14091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:53 smithi057 ceph-mon[92072]: pgmap v14091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:53 smithi122 ceph-mon[125440]: pgmap v14091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:54.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:17:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:54.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:17:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:54.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:17:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:54.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:17:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:17:54.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:17:55.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:55 smithi136 ceph-mon[125702]: pgmap v14092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:17:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:55 smithi057 ceph-mon[92072]: pgmap v14092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:17:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:55 smithi122 ceph-mon[125440]: pgmap v14092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:17:57.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:57 smithi136 ceph-mon[125702]: pgmap v14093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:17:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:57 smithi057 ceph-mon[92072]: pgmap v14093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:17:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:57 smithi122 ceph-mon[125440]: pgmap v14093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:17:59.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:17:59 smithi136 ceph-mon[125702]: pgmap v14094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:17:59 smithi057 ceph-mon[92072]: pgmap v14094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:17:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:17:59 smithi122 ceph-mon[125440]: pgmap v14094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:01.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:01 smithi136 ceph-mon[125702]: pgmap v14095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:01.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:01 smithi057 ceph-mon[92072]: pgmap v14095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:01 smithi122 ceph-mon[125440]: pgmap v14095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:03 smithi136 ceph-mon[125702]: pgmap v14096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:18:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:03 smithi057 ceph-mon[92072]: pgmap v14096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:18:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:03 smithi122 ceph-mon[125440]: pgmap v14096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:18:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:05 smithi136 ceph-mon[125702]: pgmap v14097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:18:05.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:05 smithi057 ceph-mon[92072]: pgmap v14097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:18:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:05 smithi122 ceph-mon[125440]: pgmap v14097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:18:07.839 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:07 smithi136 ceph-mon[125702]: pgmap v14098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:18:07.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:07 smithi057 ceph-mon[92072]: pgmap v14098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:18:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:07 smithi122 ceph-mon[125440]: pgmap v14098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:18:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:09.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:18:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:09.347+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:18:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:09.347+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:18:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:09.347+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:18:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:09.347+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:18:09.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:09 smithi057 ceph-mon[92072]: pgmap v14099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:18:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:09 smithi122 ceph-mon[125440]: pgmap v14099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:18:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:09 smithi136 ceph-mon[125702]: pgmap v14099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:18:11.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:11 smithi057 ceph-mon[92072]: pgmap v14100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:18:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:11 smithi122 ceph-mon[125440]: pgmap v14100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:18:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:11 smithi136 ceph-mon[125702]: pgmap v14100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:18:12.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:12 smithi057 ceph-mon[92072]: osdmap e954: 12 total, 12 up, 12 in 2023-03-02T18:18:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:12 smithi122 ceph-mon[125440]: osdmap e954: 12 total, 12 up, 12 in 2023-03-02T18:18:13.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:12 smithi136 ceph-mon[125702]: osdmap e954: 12 total, 12 up, 12 in 2023-03-02T18:18:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:13 smithi057 ceph-mon[92072]: pgmap v14102: 97 pgs: 1 active+clean+snaptrim, 90 active+clean, 6 active+clean+snaptrim_wait; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:13 smithi122 ceph-mon[125440]: pgmap v14102: 97 pgs: 1 active+clean+snaptrim, 90 active+clean, 6 active+clean+snaptrim_wait; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:13 smithi136 ceph-mon[125702]: pgmap v14102: 97 pgs: 1 active+clean+snaptrim, 90 active+clean, 6 active+clean+snaptrim_wait; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:15 smithi057 ceph-mon[92072]: pgmap v14103: 97 pgs: 1 active+clean+snaptrim, 90 active+clean, 6 active+clean+snaptrim_wait; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:15 smithi122 ceph-mon[125440]: pgmap v14103: 97 pgs: 1 active+clean+snaptrim, 90 active+clean, 6 active+clean+snaptrim_wait; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:15 smithi136 ceph-mon[125702]: pgmap v14103: 97 pgs: 1 active+clean+snaptrim, 90 active+clean, 6 active+clean+snaptrim_wait; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:17 smithi057 ceph-mon[92072]: pgmap v14104: 97 pgs: 1 active+clean+snaptrim, 90 active+clean, 6 active+clean+snaptrim_wait; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:17 smithi122 ceph-mon[125440]: pgmap v14104: 97 pgs: 1 active+clean+snaptrim, 90 active+clean, 6 active+clean+snaptrim_wait; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:17 smithi136 ceph-mon[125702]: pgmap v14104: 97 pgs: 1 active+clean+snaptrim, 90 active+clean, 6 active+clean+snaptrim_wait; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:19 smithi057 ceph-mon[92072]: pgmap v14105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:19 smithi122 ceph-mon[125440]: pgmap v14105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:19 smithi136 ceph-mon[125702]: pgmap v14105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:21 smithi057 ceph-mon[92072]: pgmap v14106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:21 smithi057 ceph-mon[92072]: osdmap e955: 12 total, 12 up, 12 in 2023-03-02T18:18:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:21 smithi122 ceph-mon[125440]: pgmap v14106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:21 smithi122 ceph-mon[125440]: osdmap e955: 12 total, 12 up, 12 in 2023-03-02T18:18:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:21 smithi136 ceph-mon[125702]: pgmap v14106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:18:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:21 smithi136 ceph-mon[125702]: osdmap e955: 12 total, 12 up, 12 in 2023-03-02T18:18:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:23 smithi057 ceph-mon[92072]: pgmap v14108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:18:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:23 smithi122 ceph-mon[125440]: pgmap v14108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:18:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:23 smithi136 ceph-mon[125702]: pgmap v14108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:18:24.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:24.352+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:18:24.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:24.352+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:18:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:24.352+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:18:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:24.352+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:18:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:24.352+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:18:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:25 smithi057 ceph-mon[92072]: pgmap v14109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:18:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:25 smithi122 ceph-mon[125440]: pgmap v14109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:18:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:25 smithi136 ceph-mon[125702]: pgmap v14109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:18:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:27 smithi057 ceph-mon[92072]: pgmap v14110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:18:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:27 smithi122 ceph-mon[125440]: pgmap v14110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:18:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:27 smithi136 ceph-mon[125702]: pgmap v14110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:18:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:29 smithi057 ceph-mon[92072]: pgmap v14111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:18:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:29 smithi122 ceph-mon[125440]: pgmap v14111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:18:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:29 smithi136 ceph-mon[125702]: pgmap v14111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:18:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:31 smithi057 ceph-mon[92072]: pgmap v14112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:18:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:31 smithi122 ceph-mon[125440]: pgmap v14112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:18:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:31 smithi136 ceph-mon[125702]: pgmap v14112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:18:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:33 smithi057 ceph-mon[92072]: pgmap v14113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 op/s 2023-03-02T18:18:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:33 smithi122 ceph-mon[125440]: pgmap v14113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 op/s 2023-03-02T18:18:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:33 smithi136 ceph-mon[125702]: pgmap v14113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 op/s 2023-03-02T18:18:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:35 smithi057 ceph-mon[92072]: pgmap v14114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:35 smithi122 ceph-mon[125440]: pgmap v14114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:35 smithi136 ceph-mon[125702]: pgmap v14114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:37 smithi057 ceph-mon[92072]: pgmap v14115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:37 smithi122 ceph-mon[125440]: pgmap v14115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:37 smithi136 ceph-mon[125702]: pgmap v14115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:39.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:18:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:39.358+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:18:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:39.358+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:18:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:39.358+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:18:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:39.358+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:18:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:39 smithi057 ceph-mon[92072]: pgmap v14116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:39 smithi122 ceph-mon[125440]: pgmap v14116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:39 smithi136 ceph-mon[125702]: pgmap v14116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:18:41.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:18:41.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:18:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:41 smithi122 ceph-mon[125440]: pgmap v14117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:18:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:18:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:18:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:41 smithi136 ceph-mon[125702]: pgmap v14117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:18:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:18:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:18:42.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:41 smithi057 ceph-mon[92072]: pgmap v14117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:42.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:18:42.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:18:42.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:18:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:43 smithi122 ceph-mon[125440]: pgmap v14118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:43 smithi136 ceph-mon[125702]: pgmap v14118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:43 smithi057 ceph-mon[92072]: pgmap v14118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:45 smithi122 ceph-mon[125440]: pgmap v14119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:45 smithi136 ceph-mon[125702]: pgmap v14119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:45 smithi057 ceph-mon[92072]: pgmap v14119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:47 smithi136 ceph-mon[125702]: pgmap v14120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:47 smithi057 ceph-mon[92072]: pgmap v14120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:47 smithi122 ceph-mon[125440]: pgmap v14120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:49 smithi136 ceph-mon[125702]: pgmap v14121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:49 smithi057 ceph-mon[92072]: pgmap v14121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:49 smithi122 ceph-mon[125440]: pgmap v14121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:51 smithi136 ceph-mon[125702]: pgmap v14122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:51 smithi057 ceph-mon[92072]: pgmap v14122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:51 smithi122 ceph-mon[125440]: pgmap v14122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:53 smithi136 ceph-mon[125702]: pgmap v14123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:53 smithi057 ceph-mon[92072]: pgmap v14123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:53 smithi122 ceph-mon[125440]: pgmap v14123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:18:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:54.368+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:18:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:54.368+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:18:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:54.368+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:18:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:54.368+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:18:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:18:54.368+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:18:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:55 smithi136 ceph-mon[125702]: pgmap v14124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:55 smithi057 ceph-mon[92072]: pgmap v14124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:55 smithi122 ceph-mon[125440]: pgmap v14124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:57 smithi136 ceph-mon[125702]: pgmap v14125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:57 smithi057 ceph-mon[92072]: pgmap v14125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:18:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:57 smithi122 ceph-mon[125440]: pgmap v14125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:18:59 smithi136 ceph-mon[125702]: pgmap v14126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:18:59 smithi057 ceph-mon[92072]: pgmap v14126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:18:59 smithi122 ceph-mon[125440]: pgmap v14126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:01 smithi136 ceph-mon[125702]: pgmap v14127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:01 smithi057 ceph-mon[92072]: pgmap v14127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:01 smithi122 ceph-mon[125440]: pgmap v14127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:04.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:03 smithi136 ceph-mon[125702]: pgmap v14128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:19:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:03 smithi057 ceph-mon[92072]: pgmap v14128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:19:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:03 smithi122 ceph-mon[125440]: pgmap v14128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:19:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:05 smithi136 ceph-mon[125702]: pgmap v14129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:19:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:05 smithi057 ceph-mon[92072]: pgmap v14129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:19:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:05 smithi122 ceph-mon[125440]: pgmap v14129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:19:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:07 smithi136 ceph-mon[125702]: pgmap v14130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:19:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:07 smithi136 ceph-mon[125702]: osdmap e956: 12 total, 12 up, 12 in 2023-03-02T18:19:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:07 smithi057 ceph-mon[92072]: pgmap v14130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:19:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:07 smithi057 ceph-mon[92072]: osdmap e956: 12 total, 12 up, 12 in 2023-03-02T18:19:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:07 smithi122 ceph-mon[125440]: pgmap v14130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:19:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:07 smithi122 ceph-mon[125440]: osdmap e956: 12 total, 12 up, 12 in 2023-03-02T18:19:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:09.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:19:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:09.385+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:19:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:09.385+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:19:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:09.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:19:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:09.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:19:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:09 smithi136 ceph-mon[125702]: pgmap v14132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:19:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:09 smithi057 ceph-mon[92072]: pgmap v14132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:19:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:09 smithi122 ceph-mon[125440]: pgmap v14132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:19:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:11 smithi136 ceph-mon[125702]: pgmap v14133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:19:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:11 smithi057 ceph-mon[92072]: pgmap v14133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:19:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:11 smithi122 ceph-mon[125440]: pgmap v14133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:19:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:13 smithi136 ceph-mon[125702]: pgmap v14134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:19:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:13 smithi057 ceph-mon[92072]: pgmap v14134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:19:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:13 smithi122 ceph-mon[125440]: pgmap v14134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:19:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:15 smithi136 ceph-mon[125702]: pgmap v14135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:19:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:15 smithi057 ceph-mon[92072]: pgmap v14135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:19:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:15 smithi122 ceph-mon[125440]: pgmap v14135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:19:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:17 smithi136 ceph-mon[125702]: pgmap v14136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:19:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:17 smithi136 ceph-mon[125702]: osdmap e957: 12 total, 12 up, 12 in 2023-03-02T18:19:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:17 smithi057 ceph-mon[92072]: pgmap v14136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:19:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:17 smithi057 ceph-mon[92072]: osdmap e957: 12 total, 12 up, 12 in 2023-03-02T18:19:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:17 smithi122 ceph-mon[125440]: pgmap v14136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:19:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:17 smithi122 ceph-mon[125440]: osdmap e957: 12 total, 12 up, 12 in 2023-03-02T18:19:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:19 smithi136 ceph-mon[125702]: pgmap v14138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:19:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:19 smithi057 ceph-mon[92072]: pgmap v14138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:19:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:19 smithi122 ceph-mon[125440]: pgmap v14138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:19:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:21 smithi136 ceph-mon[125702]: pgmap v14139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:19:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:21 smithi057 ceph-mon[92072]: pgmap v14139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:19:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:21 smithi122 ceph-mon[125440]: pgmap v14139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:19:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:23 smithi057 ceph-mon[92072]: pgmap v14140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:19:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:23 smithi122 ceph-mon[125440]: pgmap v14140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:19:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:23 smithi136 ceph-mon[125702]: pgmap v14140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:19:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:24.397+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:19:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:24.397+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:19:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:24.397+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:19:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:24.397+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:19:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:24.397+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:19:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:25 smithi057 ceph-mon[92072]: pgmap v14141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:19:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:25 smithi122 ceph-mon[125440]: pgmap v14141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:19:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:25 smithi136 ceph-mon[125702]: pgmap v14141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:19:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:27 smithi057 ceph-mon[92072]: pgmap v14142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:19:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:27 smithi122 ceph-mon[125440]: pgmap v14142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:19:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:27 smithi136 ceph-mon[125702]: pgmap v14142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:19:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:29 smithi057 ceph-mon[92072]: pgmap v14143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T18:19:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:29 smithi122 ceph-mon[125440]: pgmap v14143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T18:19:30.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:29 smithi136 ceph-mon[125702]: pgmap v14143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T18:19:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:31 smithi057 ceph-mon[92072]: pgmap v14144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:31 smithi122 ceph-mon[125440]: pgmap v14144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:31 smithi136 ceph-mon[125702]: pgmap v14144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:33 smithi057 ceph-mon[92072]: pgmap v14145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:33 smithi122 ceph-mon[125440]: pgmap v14145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:33 smithi136 ceph-mon[125702]: pgmap v14145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:35 smithi057 ceph-mon[92072]: pgmap v14146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:35 smithi122 ceph-mon[125440]: pgmap v14146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:35 smithi136 ceph-mon[125702]: pgmap v14146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:37 smithi057 ceph-mon[92072]: pgmap v14147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:37 smithi122 ceph-mon[125440]: pgmap v14147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:37 smithi136 ceph-mon[125702]: pgmap v14147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:39.410+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:19:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:39.411+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:19:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:39.411+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:19:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:39.411+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:19:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:39.411+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:19:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:39 smithi057 ceph-mon[92072]: pgmap v14148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:39 smithi122 ceph-mon[125440]: pgmap v14148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:39 smithi136 ceph-mon[125702]: pgmap v14148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:41 smithi057 ceph-mon[92072]: pgmap v14149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:19:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:41 smithi122 ceph-mon[125440]: pgmap v14149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:19:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:41 smithi136 ceph-mon[125702]: pgmap v14149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:19:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:43 smithi057 ceph-mon[92072]: pgmap v14150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:43 smithi122 ceph-mon[125440]: pgmap v14150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:43 smithi136 ceph-mon[125702]: pgmap v14150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:19:45.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:19:45.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:19:45.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:19:45.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:45.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:19:45.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:19:45.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:19:45.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:19:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:45 smithi136 ceph-mon[125702]: pgmap v14151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:45 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:19:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:45 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:19:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:45 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:19:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:45 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:19:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:45 smithi057 ceph-mon[92072]: pgmap v14151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:45 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:19:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:45 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:19:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:45 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:19:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:45 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:19:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:45 smithi122 ceph-mon[125440]: pgmap v14151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:45 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:19:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:45 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:19:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:45 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:19:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:45 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:19:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:47 smithi136 ceph-mon[125702]: pgmap v14152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:47 smithi057 ceph-mon[92072]: pgmap v14152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:47 smithi122 ceph-mon[125440]: pgmap v14152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:49 smithi136 ceph-mon[125702]: pgmap v14153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:49 smithi057 ceph-mon[92072]: pgmap v14153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:49 smithi122 ceph-mon[125440]: pgmap v14153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:51 smithi136 ceph-mon[125702]: pgmap v14154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:51 smithi057 ceph-mon[92072]: pgmap v14154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:51 smithi122 ceph-mon[125440]: pgmap v14154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:53 smithi136 ceph-mon[125702]: pgmap v14155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:53 smithi057 ceph-mon[92072]: pgmap v14155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:53 smithi122 ceph-mon[125440]: pgmap v14155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:19:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:54.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:19:54.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:54.412+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:19:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:54.412+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:19:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:54.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:19:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:19:54.412+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:19:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:55 smithi136 ceph-mon[125702]: pgmap v14156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:55 smithi057 ceph-mon[92072]: pgmap v14156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:55 smithi122 ceph-mon[125440]: pgmap v14156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:57 smithi057 ceph-mon[92072]: pgmap v14157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:57 smithi122 ceph-mon[125440]: pgmap v14157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:19:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:57 smithi136 ceph-mon[125702]: pgmap v14157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:19:59 smithi057 ceph-mon[92072]: pgmap v14158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:19:59 smithi122 ceph-mon[125440]: pgmap v14158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:19:59 smithi136 ceph-mon[125702]: pgmap v14158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T18:20:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T18:20:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T18:20:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:01 smithi057 ceph-mon[92072]: pgmap v14159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:01 smithi122 ceph-mon[125440]: pgmap v14159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:01 smithi136 ceph-mon[125702]: pgmap v14159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:03 smithi057 ceph-mon[92072]: pgmap v14160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:20:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:03 smithi122 ceph-mon[125440]: pgmap v14160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:20:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:03 smithi136 ceph-mon[125702]: pgmap v14160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:20:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:05 smithi057 ceph-mon[92072]: pgmap v14161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:20:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:05 smithi122 ceph-mon[125440]: pgmap v14161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:20:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:05 smithi136 ceph-mon[125702]: pgmap v14161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:20:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:07 smithi057 ceph-mon[92072]: pgmap v14162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:20:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:07 smithi057 ceph-mon[92072]: osdmap e958: 12 total, 12 up, 12 in 2023-03-02T18:20:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:07 smithi122 ceph-mon[125440]: pgmap v14162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:20:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:07 smithi122 ceph-mon[125440]: osdmap e958: 12 total, 12 up, 12 in 2023-03-02T18:20:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:07 smithi136 ceph-mon[125702]: pgmap v14162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:20:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:07 smithi136 ceph-mon[125702]: osdmap e958: 12 total, 12 up, 12 in 2023-03-02T18:20:09.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:09.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:20:09.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:09.425+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:20:09.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:09.425+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:20:09.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:09.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:20:09.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:09.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:20:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:09 smithi057 ceph-mon[92072]: pgmap v14164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:20:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:09 smithi122 ceph-mon[125440]: pgmap v14164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:20:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:09 smithi136 ceph-mon[125702]: pgmap v14164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:20:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:11 smithi057 ceph-mon[92072]: pgmap v14165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:20:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:12.189+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:20:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:12.189+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:20:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:12.189+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 206 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:20:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:12.189+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 205 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:20:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:11 smithi122 ceph-mon[125440]: pgmap v14165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:20:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:11 smithi136 ceph-mon[125702]: pgmap v14165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:20:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:13 smithi057 ceph-mon[92072]: pgmap v14166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:20:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:13 smithi122 ceph-mon[125440]: pgmap v14166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:20:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:13 smithi136 ceph-mon[125702]: pgmap v14166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:20:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:15 smithi057 ceph-mon[92072]: pgmap v14167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:20:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:15 smithi122 ceph-mon[125440]: pgmap v14167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:20:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:15 smithi136 ceph-mon[125702]: pgmap v14167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:20:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:17 smithi057 ceph-mon[92072]: pgmap v14168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:20:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:17 smithi057 ceph-mon[92072]: osdmap e959: 12 total, 12 up, 12 in 2023-03-02T18:20:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:17 smithi122 ceph-mon[125440]: pgmap v14168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:20:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:17 smithi122 ceph-mon[125440]: osdmap e959: 12 total, 12 up, 12 in 2023-03-02T18:20:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:17 smithi136 ceph-mon[125702]: pgmap v14168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:20:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:17 smithi136 ceph-mon[125702]: osdmap e959: 12 total, 12 up, 12 in 2023-03-02T18:20:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:19 smithi057 ceph-mon[92072]: pgmap v14170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:20:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:19 smithi122 ceph-mon[125440]: pgmap v14170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:20:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:19 smithi136 ceph-mon[125702]: pgmap v14170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:20:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:21 smithi057 ceph-mon[92072]: pgmap v14171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:20:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:21 smithi122 ceph-mon[125440]: pgmap v14171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:20:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:21 smithi136 ceph-mon[125702]: pgmap v14171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:20:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:23 smithi057 ceph-mon[92072]: pgmap v14172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:20:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:23 smithi122 ceph-mon[125440]: pgmap v14172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:20:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:23 smithi136 ceph-mon[125702]: pgmap v14172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:20:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:24.442+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:20:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:24.443+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:20:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:24.443+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:20:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:24.443+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:20:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:24.443+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:20:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:25 smithi057 ceph-mon[92072]: pgmap v14173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:20:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:25 smithi122 ceph-mon[125440]: pgmap v14173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:20:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:25 smithi136 ceph-mon[125702]: pgmap v14173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:20:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:27 smithi057 ceph-mon[92072]: pgmap v14174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:20:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:27 smithi122 ceph-mon[125440]: pgmap v14174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:20:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:27 smithi136 ceph-mon[125702]: pgmap v14174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:20:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:29 smithi057 ceph-mon[92072]: pgmap v14175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T18:20:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:29 smithi122 ceph-mon[125440]: pgmap v14175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T18:20:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:29 smithi136 ceph-mon[125702]: pgmap v14175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-02T18:20:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:31 smithi057 ceph-mon[92072]: pgmap v14176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:31 smithi122 ceph-mon[125440]: pgmap v14176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:31 smithi136 ceph-mon[125702]: pgmap v14176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:33 smithi057 ceph-mon[92072]: pgmap v14177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:33 smithi122 ceph-mon[125440]: pgmap v14177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:33 smithi136 ceph-mon[125702]: pgmap v14177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:35 smithi057 ceph-mon[92072]: pgmap v14178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:35 smithi122 ceph-mon[125440]: pgmap v14178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:36.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:35 smithi136 ceph-mon[125702]: pgmap v14178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:37 smithi057 ceph-mon[92072]: pgmap v14179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:37 smithi122 ceph-mon[125440]: pgmap v14179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:37 smithi136 ceph-mon[125702]: pgmap v14179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:39.456+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:20:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:39.456+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:20:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:39.456+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:20:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:39.456+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:20:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:39.456+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:20:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:39 smithi057 ceph-mon[92072]: pgmap v14180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:39 smithi122 ceph-mon[125440]: pgmap v14180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:39 smithi136 ceph-mon[125702]: pgmap v14180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:41 smithi057 ceph-mon[92072]: pgmap v14181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:41 smithi122 ceph-mon[125440]: pgmap v14181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:41 smithi136 ceph-mon[125702]: pgmap v14181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:43 smithi057 ceph-mon[92072]: pgmap v14182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:43 smithi122 ceph-mon[125440]: pgmap v14182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:43 smithi136 ceph-mon[125702]: pgmap v14182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:45.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:45 smithi057 ceph-mon[92072]: pgmap v14183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:20:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:20:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:20:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:20:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:45 smithi122 ceph-mon[125440]: pgmap v14183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:20:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:20:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:20:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:20:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:45 smithi136 ceph-mon[125702]: pgmap v14183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:20:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:20:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:20:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:20:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:47 smithi057 ceph-mon[92072]: pgmap v14184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:47 smithi122 ceph-mon[125440]: pgmap v14184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:47 smithi136 ceph-mon[125702]: pgmap v14184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:49.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:49 smithi057 ceph-mon[92072]: pgmap v14185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:49 smithi122 ceph-mon[125440]: pgmap v14185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:49 smithi136 ceph-mon[125702]: pgmap v14185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:51.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:51 smithi057 ceph-mon[92072]: pgmap v14186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:51 smithi122 ceph-mon[125440]: pgmap v14186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:51 smithi136 ceph-mon[125702]: pgmap v14186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:53 smithi057 ceph-mon[92072]: pgmap v14187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:53 smithi122 ceph-mon[125440]: pgmap v14187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:53 smithi136 ceph-mon[125702]: pgmap v14187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:54.461+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:20:54.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:54.462+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:20:54.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:54.462+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:20:54.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:54.462+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:20:54.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:20:54.462+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:20:55.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:55 smithi057 ceph-mon[92072]: pgmap v14188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:55 smithi122 ceph-mon[125440]: pgmap v14188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:55 smithi136 ceph-mon[125702]: pgmap v14188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:57 smithi057 ceph-mon[92072]: pgmap v14189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:57 smithi122 ceph-mon[125440]: pgmap v14189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:57 smithi136 ceph-mon[125702]: pgmap v14189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:20:59.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:20:59 smithi057 ceph-mon[92072]: pgmap v14190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:20:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:20:59 smithi122 ceph-mon[125440]: pgmap v14190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:20:59 smithi136 ceph-mon[125702]: pgmap v14190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:01 smithi122 ceph-mon[125440]: pgmap v14191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:01 smithi136 ceph-mon[125702]: pgmap v14191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:01 smithi057 ceph-mon[92072]: pgmap v14191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:03 smithi122 ceph-mon[125440]: pgmap v14192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:21:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:03 smithi136 ceph-mon[125702]: pgmap v14192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:21:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:03 smithi057 ceph-mon[92072]: pgmap v14192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:21:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:05 smithi136 ceph-mon[125702]: pgmap v14193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:21:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:05 smithi057 ceph-mon[92072]: pgmap v14193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:21:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:05 smithi122 ceph-mon[125440]: pgmap v14193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:21:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:07 smithi136 ceph-mon[125702]: pgmap v14194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:21:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:07 smithi136 ceph-mon[125702]: osdmap e960: 12 total, 12 up, 12 in 2023-03-02T18:21:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:07 smithi057 ceph-mon[92072]: pgmap v14194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:21:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:07 smithi057 ceph-mon[92072]: osdmap e960: 12 total, 12 up, 12 in 2023-03-02T18:21:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:07 smithi122 ceph-mon[125440]: pgmap v14194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:21:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:07 smithi122 ceph-mon[125440]: osdmap e960: 12 total, 12 up, 12 in 2023-03-02T18:21:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:09.468+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:21:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:09.468+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:21:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:09.468+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:21:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:09.468+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:21:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:09.468+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:21:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:09 smithi136 ceph-mon[125702]: pgmap v14196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:21:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:09 smithi057 ceph-mon[92072]: pgmap v14196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:21:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:09 smithi122 ceph-mon[125440]: pgmap v14196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:21:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:11 smithi136 ceph-mon[125702]: pgmap v14197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:21:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:11 smithi057 ceph-mon[92072]: pgmap v14197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:21:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:11 smithi122 ceph-mon[125440]: pgmap v14197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:21:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:13 smithi136 ceph-mon[125702]: pgmap v14198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:21:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:13 smithi057 ceph-mon[92072]: pgmap v14198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:21:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:13 smithi122 ceph-mon[125440]: pgmap v14198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:21:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:15 smithi136 ceph-mon[125702]: pgmap v14199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:21:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:15 smithi057 ceph-mon[92072]: pgmap v14199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:21:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:15 smithi122 ceph-mon[125440]: pgmap v14199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:21:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:17 smithi057 ceph-mon[92072]: pgmap v14200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:21:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:17 smithi057 ceph-mon[92072]: osdmap e961: 12 total, 12 up, 12 in 2023-03-02T18:21:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:17 smithi122 ceph-mon[125440]: pgmap v14200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:21:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:17 smithi122 ceph-mon[125440]: osdmap e961: 12 total, 12 up, 12 in 2023-03-02T18:21:18.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:17 smithi136 ceph-mon[125702]: pgmap v14200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:21:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:17 smithi136 ceph-mon[125702]: osdmap e961: 12 total, 12 up, 12 in 2023-03-02T18:21:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:19 smithi057 ceph-mon[92072]: pgmap v14202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:21:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:19 smithi122 ceph-mon[125440]: pgmap v14202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:21:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:19 smithi136 ceph-mon[125702]: pgmap v14202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:21:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:21 smithi057 ceph-mon[92072]: pgmap v14203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:21:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:21 smithi122 ceph-mon[125440]: pgmap v14203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:21:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:21 smithi136 ceph-mon[125702]: pgmap v14203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:21:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:23 smithi057 ceph-mon[92072]: pgmap v14204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:21:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:23 smithi122 ceph-mon[125440]: pgmap v14204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:21:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:23 smithi136 ceph-mon[125702]: pgmap v14204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:21:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:24.484+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:21:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:24.485+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:21:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:24.485+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:21:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:24.485+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:21:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:24.485+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:21:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:25 smithi057 ceph-mon[92072]: pgmap v14205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:21:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:25 smithi122 ceph-mon[125440]: pgmap v14205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:21:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:25 smithi136 ceph-mon[125702]: pgmap v14205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:21:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:27 smithi057 ceph-mon[92072]: pgmap v14206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:21:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:27 smithi122 ceph-mon[125440]: pgmap v14206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:21:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:27 smithi136 ceph-mon[125702]: pgmap v14206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:21:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:29 smithi057 ceph-mon[92072]: pgmap v14207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:21:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:29 smithi122 ceph-mon[125440]: pgmap v14207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:21:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:29 smithi136 ceph-mon[125702]: pgmap v14207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:21:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:31 smithi057 ceph-mon[92072]: pgmap v14208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:31 smithi122 ceph-mon[125440]: pgmap v14208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:31 smithi136 ceph-mon[125702]: pgmap v14208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:33 smithi057 ceph-mon[92072]: pgmap v14209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:33 smithi122 ceph-mon[125440]: pgmap v14209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:34.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:33 smithi136 ceph-mon[125702]: pgmap v14209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:35 smithi057 ceph-mon[92072]: pgmap v14210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:35 smithi122 ceph-mon[125440]: pgmap v14210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:35 smithi136 ceph-mon[125702]: pgmap v14210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:37 smithi057 ceph-mon[92072]: pgmap v14211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:37 smithi122 ceph-mon[125440]: pgmap v14211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:37 smithi136 ceph-mon[125702]: pgmap v14211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:39.495+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:21:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:39.496+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:21:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:39.496+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:21:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:39.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:21:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:39.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:21:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:39 smithi057 ceph-mon[92072]: pgmap v14212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:39 smithi122 ceph-mon[125440]: pgmap v14212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:39 smithi136 ceph-mon[125702]: pgmap v14212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:41.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:41 smithi057 ceph-mon[92072]: pgmap v14213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:41 smithi122 ceph-mon[125440]: pgmap v14213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:42.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:41 smithi136 ceph-mon[125702]: pgmap v14213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:43 smithi057 ceph-mon[92072]: pgmap v14214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:43 smithi122 ceph-mon[125440]: pgmap v14214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:43 smithi136 ceph-mon[125702]: pgmap v14214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:45 smithi122 ceph-mon[125440]: pgmap v14215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:45 smithi136 ceph-mon[125702]: pgmap v14215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:45 smithi057 ceph-mon[92072]: pgmap v14215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:21:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:21:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:21:47.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:21:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:21:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:21:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:21:47.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:21:47.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:21:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:47 smithi122 ceph-mon[125440]: pgmap v14216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:21:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:21:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:21:48.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:47 smithi136 ceph-mon[125702]: pgmap v14216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:21:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:21:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:21:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:47 smithi057 ceph-mon[92072]: pgmap v14216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:21:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:21:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:21:49.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:49 smithi122 ceph-mon[125440]: pgmap v14217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:49 smithi136 ceph-mon[125702]: pgmap v14217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:49 smithi057 ceph-mon[92072]: pgmap v14217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:51 smithi122 ceph-mon[125440]: pgmap v14218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:51 smithi136 ceph-mon[125702]: pgmap v14218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:52.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:51 smithi057 ceph-mon[92072]: pgmap v14218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:53 smithi136 ceph-mon[125702]: pgmap v14219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:53 smithi057 ceph-mon[92072]: pgmap v14219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:53 smithi122 ceph-mon[125440]: pgmap v14219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:54.511+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:54.511+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:54.511+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:54.511+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:21:54.511+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:21:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:55 smithi136 ceph-mon[125702]: pgmap v14220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:55 smithi057 ceph-mon[92072]: pgmap v14220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:55 smithi122 ceph-mon[125440]: pgmap v14220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:57 smithi136 ceph-mon[125702]: pgmap v14221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:57 smithi057 ceph-mon[92072]: pgmap v14221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:21:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:57 smithi122 ceph-mon[125440]: pgmap v14221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:21:59 smithi136 ceph-mon[125702]: pgmap v14222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:21:59 smithi057 ceph-mon[92072]: pgmap v14222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:21:59 smithi122 ceph-mon[125440]: pgmap v14222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:01 smithi136 ceph-mon[125702]: pgmap v14223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:01 smithi057 ceph-mon[92072]: pgmap v14223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:01 smithi122 ceph-mon[125440]: pgmap v14223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:03 smithi136 ceph-mon[125702]: pgmap v14224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:22:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:03 smithi057 ceph-mon[92072]: pgmap v14224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:22:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:03 smithi122 ceph-mon[125440]: pgmap v14224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:22:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:05 smithi136 ceph-mon[125702]: pgmap v14225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:22:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:05 smithi057 ceph-mon[92072]: pgmap v14225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:22:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:05 smithi122 ceph-mon[125440]: pgmap v14225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:22:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:07 smithi136 ceph-mon[125702]: pgmap v14226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:22:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:07 smithi136 ceph-mon[125702]: osdmap e962: 12 total, 12 up, 12 in 2023-03-02T18:22:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:07 smithi057 ceph-mon[92072]: pgmap v14226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:22:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:07 smithi057 ceph-mon[92072]: osdmap e962: 12 total, 12 up, 12 in 2023-03-02T18:22:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:07 smithi122 ceph-mon[125440]: pgmap v14226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:22:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:07 smithi122 ceph-mon[125440]: osdmap e962: 12 total, 12 up, 12 in 2023-03-02T18:22:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:09.513+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:22:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:09.513+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:22:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:09.513+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:22:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:09.513+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:22:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:09.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:22:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:09 smithi136 ceph-mon[125702]: pgmap v14228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:22:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:09 smithi057 ceph-mon[92072]: pgmap v14228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:22:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:09 smithi122 ceph-mon[125440]: pgmap v14228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:22:12.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:11 smithi136 ceph-mon[125702]: pgmap v14229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:22:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:11 smithi057 ceph-mon[92072]: pgmap v14229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:22:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:11 smithi122 ceph-mon[125440]: pgmap v14229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:22:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:13 smithi136 ceph-mon[125702]: pgmap v14230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:22:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:13 smithi057 ceph-mon[92072]: pgmap v14230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:22:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:13 smithi122 ceph-mon[125440]: pgmap v14230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:22:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:15 smithi136 ceph-mon[125702]: pgmap v14231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:22:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:15 smithi057 ceph-mon[92072]: pgmap v14231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:22:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:15 smithi122 ceph-mon[125440]: pgmap v14231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:22:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:17 smithi057 ceph-mon[92072]: pgmap v14232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:22:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:17 smithi057 ceph-mon[92072]: osdmap e963: 12 total, 12 up, 12 in 2023-03-02T18:22:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:17 smithi122 ceph-mon[125440]: pgmap v14232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:22:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:17 smithi122 ceph-mon[125440]: osdmap e963: 12 total, 12 up, 12 in 2023-03-02T18:22:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:17 smithi136 ceph-mon[125702]: pgmap v14232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:22:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:17 smithi136 ceph-mon[125702]: osdmap e963: 12 total, 12 up, 12 in 2023-03-02T18:22:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:19 smithi057 ceph-mon[92072]: pgmap v14234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:22:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:19 smithi122 ceph-mon[125440]: pgmap v14234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:22:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:19 smithi136 ceph-mon[125702]: pgmap v14234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:22:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:21 smithi057 ceph-mon[92072]: pgmap v14235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:22:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:21 smithi122 ceph-mon[125440]: pgmap v14235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:22:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:21 smithi136 ceph-mon[125702]: pgmap v14235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:22:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:23 smithi057 ceph-mon[92072]: pgmap v14236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:22:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:23 smithi122 ceph-mon[125440]: pgmap v14236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:22:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:23 smithi136 ceph-mon[125702]: pgmap v14236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:22:24.530 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:24.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:22:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:24.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:22:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:24.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:22:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:24.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:22:24.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:24.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:22:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:25 smithi057 ceph-mon[92072]: pgmap v14237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:22:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:25 smithi122 ceph-mon[125440]: pgmap v14237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:22:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:25 smithi136 ceph-mon[125702]: pgmap v14237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:22:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:27 smithi057 ceph-mon[92072]: pgmap v14238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:22:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:27 smithi122 ceph-mon[125440]: pgmap v14238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:22:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:27 smithi136 ceph-mon[125702]: pgmap v14238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:22:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:29 smithi057 ceph-mon[92072]: pgmap v14239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:22:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:29 smithi122 ceph-mon[125440]: pgmap v14239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:22:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:29 smithi136 ceph-mon[125702]: pgmap v14239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:22:31.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:31 smithi057 ceph-mon[92072]: pgmap v14240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:31 smithi122 ceph-mon[125440]: pgmap v14240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:32.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:31 smithi136 ceph-mon[125702]: pgmap v14240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:33 smithi057 ceph-mon[92072]: pgmap v14241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:33 smithi122 ceph-mon[125440]: pgmap v14241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:33 smithi136 ceph-mon[125702]: pgmap v14241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:35.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:35 smithi057 ceph-mon[92072]: pgmap v14242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:35 smithi122 ceph-mon[125440]: pgmap v14242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:35 smithi136 ceph-mon[125702]: pgmap v14242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:37.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:37 smithi057 ceph-mon[92072]: pgmap v14243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:37 smithi122 ceph-mon[125440]: pgmap v14243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:37 smithi136 ceph-mon[125702]: pgmap v14243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:39.539+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:22:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:39.539+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:22:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:39.539+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:22:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:39.539+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:22:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:39.539+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:22:39.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:39 smithi057 ceph-mon[92072]: pgmap v14244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:39 smithi122 ceph-mon[125440]: pgmap v14244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:39 smithi136 ceph-mon[125702]: pgmap v14244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:41.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:41 smithi122 ceph-mon[125440]: pgmap v14245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:41 smithi136 ceph-mon[125702]: pgmap v14245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:41 smithi057 ceph-mon[92072]: pgmap v14245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:43 smithi122 ceph-mon[125440]: pgmap v14246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:43 smithi136 ceph-mon[125702]: pgmap v14246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:43 smithi057 ceph-mon[92072]: pgmap v14246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:45 smithi136 ceph-mon[125702]: pgmap v14247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:45 smithi057 ceph-mon[92072]: pgmap v14247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:45 smithi122 ceph-mon[125440]: pgmap v14247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:47 smithi136 ceph-mon[125702]: pgmap v14248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:22:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:47 smithi057 ceph-mon[92072]: pgmap v14248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:22:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:47 smithi122 ceph-mon[125440]: pgmap v14248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:22:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:22:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:22:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:22:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:22:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:22:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:22:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:22:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:49 smithi136 ceph-mon[125702]: pgmap v14249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:49 smithi057 ceph-mon[92072]: pgmap v14249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:49 smithi122 ceph-mon[125440]: pgmap v14249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:51 smithi136 ceph-mon[125702]: pgmap v14250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:51 smithi057 ceph-mon[92072]: pgmap v14250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:51 smithi122 ceph-mon[125440]: pgmap v14250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:53 smithi136 ceph-mon[125702]: pgmap v14251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:54.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:53 smithi057 ceph-mon[92072]: pgmap v14251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:53 smithi122 ceph-mon[125440]: pgmap v14251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:22:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:54.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:22:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:54.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:22:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:54.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:22:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:54.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:22:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:22:54.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:22:56.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:55 smithi136 ceph-mon[125702]: pgmap v14252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:55 smithi057 ceph-mon[92072]: pgmap v14252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:55 smithi122 ceph-mon[125440]: pgmap v14252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:58.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:57 smithi136 ceph-mon[125702]: pgmap v14253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:57 smithi057 ceph-mon[92072]: pgmap v14253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:22:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:57 smithi122 ceph-mon[125440]: pgmap v14253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:00.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:22:59 smithi136 ceph-mon[125702]: pgmap v14254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:22:59 smithi057 ceph-mon[92072]: pgmap v14254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:22:59 smithi122 ceph-mon[125440]: pgmap v14254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:01 smithi136 ceph-mon[125702]: pgmap v14255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:01 smithi057 ceph-mon[92072]: pgmap v14255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:01 smithi122 ceph-mon[125440]: pgmap v14255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:03 smithi136 ceph-mon[125702]: pgmap v14256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:23:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:03 smithi057 ceph-mon[92072]: pgmap v14256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:23:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:03 smithi122 ceph-mon[125440]: pgmap v14256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:23:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:05 smithi136 ceph-mon[125702]: pgmap v14257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:23:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:05 smithi057 ceph-mon[92072]: pgmap v14257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:23:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:05 smithi122 ceph-mon[125440]: pgmap v14257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:23:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:07 smithi136 ceph-mon[125702]: pgmap v14258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:23:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:07 smithi136 ceph-mon[125702]: osdmap e964: 12 total, 12 up, 12 in 2023-03-02T18:23:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:07 smithi057 ceph-mon[92072]: pgmap v14258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:23:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:07 smithi057 ceph-mon[92072]: osdmap e964: 12 total, 12 up, 12 in 2023-03-02T18:23:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:07 smithi122 ceph-mon[125440]: pgmap v14258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:23:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:07 smithi122 ceph-mon[125440]: osdmap e964: 12 total, 12 up, 12 in 2023-03-02T18:23:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:09.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:23:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:09.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:23:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:09.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:23:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:09.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:23:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:09.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:23:10.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:09 smithi136 ceph-mon[125702]: pgmap v14260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:23:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:09 smithi057 ceph-mon[92072]: pgmap v14260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:23:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:09 smithi122 ceph-mon[125440]: pgmap v14260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:23:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:11 smithi136 ceph-mon[125702]: pgmap v14261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:23:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:11 smithi057 ceph-mon[92072]: pgmap v14261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:23:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:11 smithi122 ceph-mon[125440]: pgmap v14261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:23:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:12.216+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:23:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:12.216+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:23:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:12.216+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 206 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:23:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:12.216+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 207 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:23:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:13 smithi136 ceph-mon[125702]: pgmap v14262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:23:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:13 smithi057 ceph-mon[92072]: pgmap v14262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:23:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:13 smithi122 ceph-mon[125440]: pgmap v14262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:23:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:15 smithi136 ceph-mon[125702]: pgmap v14263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:23:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:15 smithi057 ceph-mon[92072]: pgmap v14263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:23:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:15 smithi122 ceph-mon[125440]: pgmap v14263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:23:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:17 smithi057 ceph-mon[92072]: pgmap v14264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:23:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:17 smithi057 ceph-mon[92072]: osdmap e965: 12 total, 12 up, 12 in 2023-03-02T18:23:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:17 smithi122 ceph-mon[125440]: pgmap v14264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:23:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:17 smithi122 ceph-mon[125440]: osdmap e965: 12 total, 12 up, 12 in 2023-03-02T18:23:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:17 smithi136 ceph-mon[125702]: pgmap v14264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:23:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:17 smithi136 ceph-mon[125702]: osdmap e965: 12 total, 12 up, 12 in 2023-03-02T18:23:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:19 smithi057 ceph-mon[92072]: pgmap v14266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:23:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:19 smithi122 ceph-mon[125440]: pgmap v14266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:23:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:19 smithi136 ceph-mon[125702]: pgmap v14266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:23:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:21 smithi057 ceph-mon[92072]: pgmap v14267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:23:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:21 smithi122 ceph-mon[125440]: pgmap v14267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:23:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:21 smithi136 ceph-mon[125702]: pgmap v14267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:23:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:23 smithi057 ceph-mon[92072]: pgmap v14268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:23:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:23 smithi122 ceph-mon[125440]: pgmap v14268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:23:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:23 smithi136 ceph-mon[125702]: pgmap v14268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:23:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:24.561+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:23:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:24.561+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:23:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:24.561+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:23:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:24.561+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:23:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:24.561+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:23:25.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:25 smithi057 ceph-mon[92072]: pgmap v14269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:23:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:25 smithi122 ceph-mon[125440]: pgmap v14269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:23:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:25 smithi136 ceph-mon[125702]: pgmap v14269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:23:27.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:27 smithi057 ceph-mon[92072]: pgmap v14270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:23:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:27 smithi122 ceph-mon[125440]: pgmap v14270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:23:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:27 smithi136 ceph-mon[125702]: pgmap v14270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:23:29.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:29 smithi057 ceph-mon[92072]: pgmap v14271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:23:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:29 smithi122 ceph-mon[125440]: pgmap v14271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:23:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:29 smithi136 ceph-mon[125702]: pgmap v14271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:23:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:31 smithi122 ceph-mon[125440]: pgmap v14272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:31 smithi136 ceph-mon[125702]: pgmap v14272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:31 smithi057 ceph-mon[92072]: pgmap v14272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:33 smithi122 ceph-mon[125440]: pgmap v14273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:33 smithi136 ceph-mon[125702]: pgmap v14273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:33 smithi057 ceph-mon[92072]: pgmap v14273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:35 smithi136 ceph-mon[125702]: pgmap v14274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:35 smithi057 ceph-mon[92072]: pgmap v14274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:35 smithi122 ceph-mon[125440]: pgmap v14274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:37 smithi136 ceph-mon[125702]: pgmap v14275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:37 smithi057 ceph-mon[92072]: pgmap v14275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:37 smithi122 ceph-mon[125440]: pgmap v14275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:39.578+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:23:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:39.578+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:23:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:39.578+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:23:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:39.578+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:23:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:39.578+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:23:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:39 smithi136 ceph-mon[125702]: pgmap v14276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:39 smithi057 ceph-mon[92072]: pgmap v14276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:39 smithi122 ceph-mon[125440]: pgmap v14276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:41 smithi136 ceph-mon[125702]: pgmap v14277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:41 smithi057 ceph-mon[92072]: pgmap v14277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:41 smithi122 ceph-mon[125440]: pgmap v14277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:44.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:43 smithi136 ceph-mon[125702]: pgmap v14278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:43 smithi057 ceph-mon[92072]: pgmap v14278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:43 smithi122 ceph-mon[125440]: pgmap v14278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:45 smithi136 ceph-mon[125702]: pgmap v14279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:45 smithi057 ceph-mon[92072]: pgmap v14279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:45 smithi122 ceph-mon[125440]: pgmap v14279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:47 smithi136 ceph-mon[125702]: pgmap v14280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:47 smithi057 ceph-mon[92072]: pgmap v14280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:47 smithi122 ceph-mon[125440]: pgmap v14280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:49.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:23:49.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:23:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:23:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:49 smithi136 ceph-mon[125702]: pgmap v14281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:23:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:23:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:23:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:49 smithi057 ceph-mon[92072]: pgmap v14281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:23:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:23:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:23:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:49 smithi122 ceph-mon[125440]: pgmap v14281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:23:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:23:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:23:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:51 smithi136 ceph-mon[125702]: pgmap v14282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:51 smithi057 ceph-mon[92072]: pgmap v14282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:51 smithi122 ceph-mon[125440]: pgmap v14282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:53 smithi136 ceph-mon[125702]: pgmap v14283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:53 smithi057 ceph-mon[92072]: pgmap v14283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:53 smithi122 ceph-mon[125440]: pgmap v14283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:23:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:54.591+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:23:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:54.592+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:23:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:54.592+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:23:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:54.592+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:23:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:23:54.592+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:23:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:55 smithi136 ceph-mon[125702]: pgmap v14284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:55 smithi057 ceph-mon[92072]: pgmap v14284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:55 smithi122 ceph-mon[125440]: pgmap v14284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:57 smithi136 ceph-mon[125702]: pgmap v14285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:57 smithi057 ceph-mon[92072]: pgmap v14285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:23:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:57 smithi122 ceph-mon[125440]: pgmap v14285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:23:59 smithi136 ceph-mon[125702]: pgmap v14286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:23:59 smithi057 ceph-mon[92072]: pgmap v14286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:23:59 smithi122 ceph-mon[125440]: pgmap v14286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:01 smithi136 ceph-mon[125702]: pgmap v14287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:01 smithi057 ceph-mon[92072]: pgmap v14287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:01 smithi122 ceph-mon[125440]: pgmap v14287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:03 smithi136 ceph-mon[125702]: pgmap v14288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:24:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:03 smithi057 ceph-mon[92072]: pgmap v14288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:24:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:03 smithi122 ceph-mon[125440]: pgmap v14288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:24:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:05 smithi136 ceph-mon[125702]: pgmap v14289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:24:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:05 smithi057 ceph-mon[92072]: pgmap v14289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:24:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:05 smithi122 ceph-mon[125440]: pgmap v14289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:24:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:07 smithi136 ceph-mon[125702]: pgmap v14290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:24:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:07 smithi136 ceph-mon[125702]: osdmap e966: 12 total, 12 up, 12 in 2023-03-02T18:24:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:07 smithi057 ceph-mon[92072]: pgmap v14290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:24:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:07 smithi057 ceph-mon[92072]: osdmap e966: 12 total, 12 up, 12 in 2023-03-02T18:24:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:07 smithi122 ceph-mon[125440]: pgmap v14290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:24:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:07 smithi122 ceph-mon[125440]: osdmap e966: 12 total, 12 up, 12 in 2023-03-02T18:24:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:09.603+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:24:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:09.603+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:24:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:09.603+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:24:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:09.603+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:24:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:09.603+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:24:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:09 smithi136 ceph-mon[125702]: pgmap v14292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:24:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:09 smithi057 ceph-mon[92072]: pgmap v14292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:24:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:09 smithi122 ceph-mon[125440]: pgmap v14292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:24:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:11 smithi136 ceph-mon[125702]: pgmap v14293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:24:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:11 smithi057 ceph-mon[92072]: pgmap v14293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:24:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:11 smithi122 ceph-mon[125440]: pgmap v14293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:24:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:13 smithi136 ceph-mon[125702]: pgmap v14294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:24:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:13 smithi057 ceph-mon[92072]: pgmap v14294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:24:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:13 smithi122 ceph-mon[125440]: pgmap v14294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:24:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:15 smithi136 ceph-mon[125702]: pgmap v14295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:24:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:15 smithi057 ceph-mon[92072]: pgmap v14295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:24:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:15 smithi122 ceph-mon[125440]: pgmap v14295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:24:17.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:17 smithi057 ceph-mon[92072]: pgmap v14296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:24:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:17 smithi057 ceph-mon[92072]: osdmap e967: 12 total, 12 up, 12 in 2023-03-02T18:24:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:17 smithi122 ceph-mon[125440]: pgmap v14296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:24:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:17 smithi122 ceph-mon[125440]: osdmap e967: 12 total, 12 up, 12 in 2023-03-02T18:24:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:17 smithi136 ceph-mon[125702]: pgmap v14296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:24:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:17 smithi136 ceph-mon[125702]: osdmap e967: 12 total, 12 up, 12 in 2023-03-02T18:24:19.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:19 smithi057 ceph-mon[92072]: pgmap v14298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:24:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:19 smithi122 ceph-mon[125440]: pgmap v14298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:24:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:19 smithi136 ceph-mon[125702]: pgmap v14298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:24:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:21 smithi057 ceph-mon[92072]: pgmap v14299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:24:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:21 smithi122 ceph-mon[125440]: pgmap v14299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:24:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:21 smithi136 ceph-mon[125702]: pgmap v14299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:24:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:23 smithi057 ceph-mon[92072]: pgmap v14300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:24:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:23 smithi122 ceph-mon[125440]: pgmap v14300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:24:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:23 smithi136 ceph-mon[125702]: pgmap v14300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:24:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:24.609+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:24:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:24.609+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:24:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:24.609+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:24:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:24.609+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:24:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:24.609+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:24:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:25 smithi122 ceph-mon[125440]: pgmap v14301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:24:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:25 smithi136 ceph-mon[125702]: pgmap v14301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:24:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:25 smithi057 ceph-mon[92072]: pgmap v14301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:24:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:27 smithi122 ceph-mon[125440]: pgmap v14302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:24:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:27 smithi136 ceph-mon[125702]: pgmap v14302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:24:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:27 smithi057 ceph-mon[92072]: pgmap v14302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:24:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:29 smithi122 ceph-mon[125440]: pgmap v14303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:24:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:29 smithi136 ceph-mon[125702]: pgmap v14303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:24:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:29 smithi057 ceph-mon[92072]: pgmap v14303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2023-03-02T18:24:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:31 smithi136 ceph-mon[125702]: pgmap v14304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:31 smithi057 ceph-mon[92072]: pgmap v14304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:31 smithi122 ceph-mon[125440]: pgmap v14304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:33 smithi136 ceph-mon[125702]: pgmap v14305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:33 smithi057 ceph-mon[92072]: pgmap v14305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:33 smithi122 ceph-mon[125440]: pgmap v14305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:35 smithi136 ceph-mon[125702]: pgmap v14306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:35 smithi057 ceph-mon[92072]: pgmap v14306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:35 smithi122 ceph-mon[125440]: pgmap v14306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:37 smithi136 ceph-mon[125702]: pgmap v14307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:37 smithi057 ceph-mon[92072]: pgmap v14307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:37 smithi122 ceph-mon[125440]: pgmap v14307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:39.619+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:24:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:39.619+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:24:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:39.619+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:24:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:39.619+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:24:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:39.619+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:24:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:39 smithi136 ceph-mon[125702]: pgmap v14308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:39 smithi057 ceph-mon[92072]: pgmap v14308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:39 smithi122 ceph-mon[125440]: pgmap v14308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:41 smithi136 ceph-mon[125702]: pgmap v14309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:41 smithi057 ceph-mon[92072]: pgmap v14309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:41 smithi122 ceph-mon[125440]: pgmap v14309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:42.229+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:24:42.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:42.229+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:24:42.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:42.229+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 207 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:24:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:42.229+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 208 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:24:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:43 smithi136 ceph-mon[125702]: pgmap v14310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:43 smithi057 ceph-mon[92072]: pgmap v14310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:43 smithi122 ceph-mon[125440]: pgmap v14310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:45 smithi136 ceph-mon[125702]: pgmap v14311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:45 smithi057 ceph-mon[92072]: pgmap v14311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:45 smithi122 ceph-mon[125440]: pgmap v14311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:47 smithi136 ceph-mon[125702]: pgmap v14312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:47 smithi057 ceph-mon[92072]: pgmap v14312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:47 smithi122 ceph-mon[125440]: pgmap v14312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:50.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:49 smithi136 ceph-mon[125702]: pgmap v14313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:24:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:49 smithi057 ceph-mon[92072]: pgmap v14313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:24:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:49 smithi122 ceph-mon[125440]: pgmap v14313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:24:51.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:24:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:24:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:24:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:24:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:24:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:24:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:24:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:24:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:24:52.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:51 smithi136 ceph-mon[125702]: pgmap v14314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:51 smithi057 ceph-mon[92072]: pgmap v14314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:51 smithi122 ceph-mon[125440]: pgmap v14314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:53 smithi136 ceph-mon[125702]: pgmap v14315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:53 smithi057 ceph-mon[92072]: pgmap v14315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:53 smithi122 ceph-mon[125440]: pgmap v14315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:24:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:54.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:24:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:54.621+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:24:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:54.621+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:24:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:54.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:24:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:24:54.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:24:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:55 smithi136 ceph-mon[125702]: pgmap v14316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:55 smithi057 ceph-mon[92072]: pgmap v14316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:55 smithi122 ceph-mon[125440]: pgmap v14316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:57 smithi136 ceph-mon[125702]: pgmap v14317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:57 smithi057 ceph-mon[92072]: pgmap v14317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:24:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:57 smithi122 ceph-mon[125440]: pgmap v14317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:24:59 smithi136 ceph-mon[125702]: pgmap v14318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:24:59 smithi057 ceph-mon[92072]: pgmap v14318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:24:59 smithi122 ceph-mon[125440]: pgmap v14318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:01 smithi136 ceph-mon[125702]: pgmap v14319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:01 smithi057 ceph-mon[92072]: pgmap v14319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:01 smithi122 ceph-mon[125440]: pgmap v14319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:03 smithi136 ceph-mon[125702]: pgmap v14320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:25:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:03 smithi057 ceph-mon[92072]: pgmap v14320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:25:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:03 smithi122 ceph-mon[125440]: pgmap v14320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:25:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:05 smithi136 ceph-mon[125702]: pgmap v14321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:25:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:05 smithi057 ceph-mon[92072]: pgmap v14321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:25:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:05 smithi122 ceph-mon[125440]: pgmap v14321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:25:08.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:07 smithi136 ceph-mon[125702]: pgmap v14322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:25:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:07 smithi057 ceph-mon[92072]: pgmap v14322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:25:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:07 smithi122 ceph-mon[125440]: pgmap v14322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:25:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:09.635+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:25:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:09.635+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:25:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:09.635+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:25:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:09.635+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:25:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:09.635+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:25:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:09 smithi136 ceph-mon[125702]: pgmap v14323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:25:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:09 smithi057 ceph-mon[92072]: pgmap v14323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:25:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:09 smithi122 ceph-mon[125440]: pgmap v14323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:25:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:11 smithi136 ceph-mon[125702]: pgmap v14324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:25:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:11 smithi057 ceph-mon[92072]: pgmap v14324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:25:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:11 smithi122 ceph-mon[125440]: pgmap v14324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:25:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:12 smithi136 ceph-mon[125702]: osdmap e968: 12 total, 12 up, 12 in 2023-03-02T18:25:13.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:12 smithi057 ceph-mon[92072]: osdmap e968: 12 total, 12 up, 12 in 2023-03-02T18:25:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:12 smithi122 ceph-mon[125440]: osdmap e968: 12 total, 12 up, 12 in 2023-03-02T18:25:14.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:13 smithi136 ceph-mon[125702]: pgmap v14326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:13 smithi057 ceph-mon[92072]: pgmap v14326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:13 smithi122 ceph-mon[125440]: pgmap v14326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:16.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:15 smithi136 ceph-mon[125702]: pgmap v14327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:15 smithi057 ceph-mon[92072]: pgmap v14327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:15 smithi122 ceph-mon[125440]: pgmap v14327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:17 smithi136 ceph-mon[125702]: pgmap v14328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:17 smithi057 ceph-mon[92072]: pgmap v14328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:17 smithi122 ceph-mon[125440]: pgmap v14328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:19 smithi136 ceph-mon[125702]: pgmap v14329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:19 smithi057 ceph-mon[92072]: pgmap v14329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:19 smithi122 ceph-mon[125440]: pgmap v14329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:22.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:21 smithi136 ceph-mon[125702]: pgmap v14330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:21 smithi136 ceph-mon[125702]: osdmap e969: 12 total, 12 up, 12 in 2023-03-02T18:25:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:21 smithi057 ceph-mon[92072]: pgmap v14330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:21 smithi057 ceph-mon[92072]: osdmap e969: 12 total, 12 up, 12 in 2023-03-02T18:25:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:21 smithi122 ceph-mon[125440]: pgmap v14330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:25:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:21 smithi122 ceph-mon[125440]: osdmap e969: 12 total, 12 up, 12 in 2023-03-02T18:25:24.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:23 smithi136 ceph-mon[125702]: pgmap v14332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:25:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:23 smithi057 ceph-mon[92072]: pgmap v14332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:25:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:23 smithi122 ceph-mon[125440]: pgmap v14332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:25:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:24.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:25:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:24.648+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:25:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:24.648+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:25:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:24.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:25:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:24.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:25:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:25 smithi136 ceph-mon[125702]: pgmap v14333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:25:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:25 smithi057 ceph-mon[92072]: pgmap v14333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:25:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:25 smithi122 ceph-mon[125440]: pgmap v14333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:25:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:27 smithi057 ceph-mon[92072]: pgmap v14334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:25:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:27 smithi122 ceph-mon[125440]: pgmap v14334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:25:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:27 smithi136 ceph-mon[125702]: pgmap v14334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:25:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:29 smithi057 ceph-mon[92072]: pgmap v14335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:25:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:29 smithi122 ceph-mon[125440]: pgmap v14335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:25:30.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:29 smithi136 ceph-mon[125702]: pgmap v14335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:25:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:31 smithi057 ceph-mon[92072]: pgmap v14336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:25:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:31 smithi122 ceph-mon[125440]: pgmap v14336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:25:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:31 smithi136 ceph-mon[125702]: pgmap v14336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:25:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:33 smithi057 ceph-mon[92072]: pgmap v14337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 14 op/s 2023-03-02T18:25:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:33 smithi122 ceph-mon[125440]: pgmap v14337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 14 op/s 2023-03-02T18:25:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:33 smithi136 ceph-mon[125702]: pgmap v14337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 14 op/s 2023-03-02T18:25:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:35 smithi057 ceph-mon[92072]: pgmap v14338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:35 smithi122 ceph-mon[125440]: pgmap v14338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:35 smithi136 ceph-mon[125702]: pgmap v14338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:37 smithi057 ceph-mon[92072]: pgmap v14339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:37 smithi122 ceph-mon[125440]: pgmap v14339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:37 smithi136 ceph-mon[125702]: pgmap v14339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:39.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:25:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:39.662+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:25:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:39.662+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:25:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:39.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:25:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:39.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:25:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:39 smithi057 ceph-mon[92072]: pgmap v14340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:39 smithi122 ceph-mon[125440]: pgmap v14340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:39 smithi136 ceph-mon[125702]: pgmap v14340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:41 smithi057 ceph-mon[92072]: pgmap v14341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:41 smithi122 ceph-mon[125440]: pgmap v14341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:41 smithi136 ceph-mon[125702]: pgmap v14341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:43 smithi057 ceph-mon[92072]: pgmap v14342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:43 smithi122 ceph-mon[125440]: pgmap v14342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:43 smithi136 ceph-mon[125702]: pgmap v14342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:45 smithi057 ceph-mon[92072]: pgmap v14343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:45 smithi122 ceph-mon[125440]: pgmap v14343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:45 smithi136 ceph-mon[125702]: pgmap v14343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:47 smithi057 ceph-mon[92072]: pgmap v14344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:47 smithi122 ceph-mon[125440]: pgmap v14344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:47 smithi136 ceph-mon[125702]: pgmap v14344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:49 smithi057 ceph-mon[92072]: pgmap v14345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:49 smithi122 ceph-mon[125440]: pgmap v14345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:49 smithi136 ceph-mon[125702]: pgmap v14345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:51.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:25:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:25:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:25:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:51 smithi057 ceph-mon[92072]: pgmap v14346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:25:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:25:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:25:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:51 smithi122 ceph-mon[125440]: pgmap v14346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:25:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:25:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:25:52.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:51 smithi136 ceph-mon[125702]: pgmap v14346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:25:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:25:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:25:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:53 smithi057 ceph-mon[92072]: pgmap v14347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:53 smithi122 ceph-mon[125440]: pgmap v14347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:54.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:53 smithi136 ceph-mon[125702]: pgmap v14347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:25:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:54.667+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:25:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:54.668+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:25:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:54.668+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:25:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:54.668+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:25:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:25:54.668+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:25:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:55 smithi122 ceph-mon[125440]: pgmap v14348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:55 smithi136 ceph-mon[125702]: pgmap v14348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:55 smithi057 ceph-mon[92072]: pgmap v14348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:57 smithi122 ceph-mon[125440]: pgmap v14349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:57 smithi136 ceph-mon[125702]: pgmap v14349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:25:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:57 smithi057 ceph-mon[92072]: pgmap v14349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:25:59 smithi122 ceph-mon[125440]: pgmap v14350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:25:59 smithi136 ceph-mon[125702]: pgmap v14350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:25:59 smithi057 ceph-mon[92072]: pgmap v14350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:01 smithi122 ceph-mon[125440]: pgmap v14351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:01 smithi136 ceph-mon[125702]: pgmap v14351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:01 smithi057 ceph-mon[92072]: pgmap v14351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:03 smithi122 ceph-mon[125440]: pgmap v14352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:26:04.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:03 smithi136 ceph-mon[125702]: pgmap v14352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:26:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:03 smithi057 ceph-mon[92072]: pgmap v14352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:26:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:05 smithi136 ceph-mon[125702]: pgmap v14353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:26:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:05 smithi057 ceph-mon[92072]: pgmap v14353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:26:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:05 smithi122 ceph-mon[125440]: pgmap v14353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:26:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:06 smithi136 ceph-mon[125702]: osdmap e970: 12 total, 12 up, 12 in 2023-03-02T18:26:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:06 smithi057 ceph-mon[92072]: osdmap e970: 12 total, 12 up, 12 in 2023-03-02T18:26:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:06 smithi122 ceph-mon[125440]: osdmap e970: 12 total, 12 up, 12 in 2023-03-02T18:26:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:07 smithi136 ceph-mon[125702]: pgmap v14355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:26:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:07 smithi057 ceph-mon[92072]: pgmap v14355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:26:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:07 smithi122 ceph-mon[125440]: pgmap v14355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:26:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:09.670+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:26:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:09.670+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:26:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:09.670+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:26:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:09.670+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:26:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:09.670+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:26:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:09 smithi136 ceph-mon[125702]: pgmap v14356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:26:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:09 smithi057 ceph-mon[92072]: pgmap v14356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:26:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:09 smithi122 ceph-mon[125440]: pgmap v14356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:26:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:12.242+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:26:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:12.242+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:26:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:12.243+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 208 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:26:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:12.243+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 209 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:26:12.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:11 smithi136 ceph-mon[125702]: pgmap v14357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:26:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:11 smithi136 ceph-mon[125702]: osdmap e971: 12 total, 12 up, 12 in 2023-03-02T18:26:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:11 smithi057 ceph-mon[92072]: pgmap v14357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:26:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:11 smithi057 ceph-mon[92072]: osdmap e971: 12 total, 12 up, 12 in 2023-03-02T18:26:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:11 smithi122 ceph-mon[125440]: pgmap v14357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:26:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:11 smithi122 ceph-mon[125440]: osdmap e971: 12 total, 12 up, 12 in 2023-03-02T18:26:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:13 smithi136 ceph-mon[125702]: pgmap v14359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:26:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:13 smithi057 ceph-mon[92072]: pgmap v14359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:26:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:13 smithi122 ceph-mon[125440]: pgmap v14359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:26:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:15 smithi136 ceph-mon[125702]: pgmap v14360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T18:26:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:15 smithi057 ceph-mon[92072]: pgmap v14360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T18:26:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:15 smithi122 ceph-mon[125440]: pgmap v14360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T18:26:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:17 smithi136 ceph-mon[125702]: pgmap v14361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:26:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:17 smithi057 ceph-mon[92072]: pgmap v14361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:26:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:17 smithi122 ceph-mon[125440]: pgmap v14361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:26:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:19 smithi136 ceph-mon[125702]: pgmap v14362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:26:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:19 smithi057 ceph-mon[92072]: pgmap v14362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:26:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:19 smithi122 ceph-mon[125440]: pgmap v14362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:26:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:21 smithi136 ceph-mon[125702]: pgmap v14363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:26:21.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:21 smithi057 ceph-mon[92072]: pgmap v14363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:26:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:21 smithi122 ceph-mon[125440]: pgmap v14363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:26:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:23 smithi136 ceph-mon[125702]: pgmap v14364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:26:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:23 smithi057 ceph-mon[92072]: pgmap v14364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:26:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:23 smithi122 ceph-mon[125440]: pgmap v14364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 14 op/s 2023-03-02T18:26:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:24.680+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:26:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:24.680+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:26:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:24.680+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:26:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:24.680+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:26:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:24.681+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:26:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:25 smithi136 ceph-mon[125702]: pgmap v14365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:25 smithi057 ceph-mon[92072]: pgmap v14365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:25 smithi122 ceph-mon[125440]: pgmap v14365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:28.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:27 smithi136 ceph-mon[125702]: pgmap v14366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:27 smithi057 ceph-mon[92072]: pgmap v14366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:27 smithi122 ceph-mon[125440]: pgmap v14366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:30.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:29 smithi136 ceph-mon[125702]: pgmap v14367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:29 smithi057 ceph-mon[92072]: pgmap v14367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:29 smithi122 ceph-mon[125440]: pgmap v14367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:31 smithi136 ceph-mon[125702]: pgmap v14368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:31 smithi057 ceph-mon[92072]: pgmap v14368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:31 smithi122 ceph-mon[125440]: pgmap v14368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:33 smithi136 ceph-mon[125702]: pgmap v14369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:33 smithi057 ceph-mon[92072]: pgmap v14369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:33 smithi122 ceph-mon[125440]: pgmap v14369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:35 smithi136 ceph-mon[125702]: pgmap v14370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:35 smithi057 ceph-mon[92072]: pgmap v14370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:35 smithi122 ceph-mon[125440]: pgmap v14370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:38.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:37 smithi136 ceph-mon[125702]: pgmap v14371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:37 smithi057 ceph-mon[92072]: pgmap v14371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:37 smithi122 ceph-mon[125440]: pgmap v14371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:39.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:39.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:26:39.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:39.695+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:26:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:39.695+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:26:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:39.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:26:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:39.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:26:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:39 smithi136 ceph-mon[125702]: pgmap v14372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:39 smithi057 ceph-mon[92072]: pgmap v14372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:39 smithi122 ceph-mon[125440]: pgmap v14372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:41 smithi136 ceph-mon[125702]: pgmap v14373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:41 smithi057 ceph-mon[92072]: pgmap v14373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:41 smithi122 ceph-mon[125440]: pgmap v14373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:43 smithi136 ceph-mon[125702]: pgmap v14374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:43 smithi057 ceph-mon[92072]: pgmap v14374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:43 smithi122 ceph-mon[125440]: pgmap v14374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:45 smithi136 ceph-mon[125702]: pgmap v14375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:45 smithi057 ceph-mon[92072]: pgmap v14375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:45 smithi122 ceph-mon[125440]: pgmap v14375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:47 smithi136 ceph-mon[125702]: pgmap v14376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:47 smithi057 ceph-mon[92072]: pgmap v14376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:47 smithi122 ceph-mon[125440]: pgmap v14376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:49 smithi136 ceph-mon[125702]: pgmap v14377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:49 smithi057 ceph-mon[92072]: pgmap v14377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:49 smithi122 ceph-mon[125440]: pgmap v14377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:51 smithi136 ceph-mon[125702]: pgmap v14378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:26:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:51 smithi057 ceph-mon[92072]: pgmap v14378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:26:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:51 smithi122 ceph-mon[125440]: pgmap v14378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:26:53.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:26:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:26:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:26:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:26:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:26:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:26:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:26:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:26:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:26:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:53 smithi057 ceph-mon[92072]: pgmap v14379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:53 smithi122 ceph-mon[125440]: pgmap v14379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:53 smithi136 ceph-mon[125702]: pgmap v14379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:26:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:54.708+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:26:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:54.709+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:26:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:54.709+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:26:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:54.709+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:26:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:26:54.709+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:26:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:55 smithi057 ceph-mon[92072]: pgmap v14380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:55 smithi122 ceph-mon[125440]: pgmap v14380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:55 smithi136 ceph-mon[125702]: pgmap v14380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:57 smithi057 ceph-mon[92072]: pgmap v14381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:57 smithi122 ceph-mon[125440]: pgmap v14381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:26:58.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:57 smithi136 ceph-mon[125702]: pgmap v14381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:26:59 smithi057 ceph-mon[92072]: pgmap v14382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:26:59 smithi122 ceph-mon[125440]: pgmap v14382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:00.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:26:59 smithi136 ceph-mon[125702]: pgmap v14382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:01 smithi057 ceph-mon[92072]: pgmap v14383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:01 smithi122 ceph-mon[125440]: pgmap v14383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:02.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:01 smithi136 ceph-mon[125702]: pgmap v14383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:03 smithi057 ceph-mon[92072]: pgmap v14384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:27:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:03 smithi122 ceph-mon[125440]: pgmap v14384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:27:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:03 smithi136 ceph-mon[125702]: pgmap v14384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:27:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:05 smithi057 ceph-mon[92072]: pgmap v14385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:27:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:05 smithi122 ceph-mon[125440]: pgmap v14385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:27:06.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:05 smithi136 ceph-mon[125702]: pgmap v14385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:27:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:07 smithi057 ceph-mon[92072]: pgmap v14386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:27:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:07 smithi057 ceph-mon[92072]: osdmap e972: 12 total, 12 up, 12 in 2023-03-02T18:27:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:07 smithi122 ceph-mon[125440]: pgmap v14386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:27:08.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:07 smithi122 ceph-mon[125440]: osdmap e972: 12 total, 12 up, 12 in 2023-03-02T18:27:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:07 smithi136 ceph-mon[125702]: pgmap v14386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:27:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:07 smithi136 ceph-mon[125702]: osdmap e972: 12 total, 12 up, 12 in 2023-03-02T18:27:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:09.717+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:27:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:09.717+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:27:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:09.717+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:27:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:09.717+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:27:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:09.718+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:27:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:09 smithi122 ceph-mon[125440]: pgmap v14388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:27:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:09 smithi136 ceph-mon[125702]: pgmap v14388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:27:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:09 smithi057 ceph-mon[92072]: pgmap v14388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:27:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:11 smithi122 ceph-mon[125440]: pgmap v14389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:27:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:11 smithi136 ceph-mon[125702]: pgmap v14389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:27:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:11 smithi057 ceph-mon[92072]: pgmap v14389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:27:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:13 smithi136 ceph-mon[125702]: pgmap v14390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:27:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:13 smithi057 ceph-mon[92072]: pgmap v14390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:27:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:13 smithi122 ceph-mon[125440]: pgmap v14390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:27:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:15 smithi136 ceph-mon[125702]: pgmap v14391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:27:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:15 smithi057 ceph-mon[92072]: pgmap v14391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:27:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:15 smithi122 ceph-mon[125440]: pgmap v14391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:27:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:17 smithi136 ceph-mon[125702]: pgmap v14392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:27:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:17 smithi136 ceph-mon[125702]: osdmap e973: 12 total, 12 up, 12 in 2023-03-02T18:27:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:17 smithi057 ceph-mon[92072]: pgmap v14392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:27:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:17 smithi057 ceph-mon[92072]: osdmap e973: 12 total, 12 up, 12 in 2023-03-02T18:27:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:17 smithi122 ceph-mon[125440]: pgmap v14392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:27:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:17 smithi122 ceph-mon[125440]: osdmap e973: 12 total, 12 up, 12 in 2023-03-02T18:27:20.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:19 smithi136 ceph-mon[125702]: pgmap v14394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:27:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:19 smithi057 ceph-mon[92072]: pgmap v14394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:27:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:19 smithi122 ceph-mon[125440]: pgmap v14394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:27:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:21 smithi136 ceph-mon[125702]: pgmap v14395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:27:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:21 smithi057 ceph-mon[92072]: pgmap v14395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:27:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:21 smithi122 ceph-mon[125440]: pgmap v14395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:27:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:23 smithi136 ceph-mon[125702]: pgmap v14396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:27:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:23 smithi057 ceph-mon[92072]: pgmap v14396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:27:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:23 smithi122 ceph-mon[125440]: pgmap v14396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:27:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:24.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:27:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:24.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:27:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:24.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:27:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:24.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:27:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:24.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:27:26.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:25 smithi136 ceph-mon[125702]: pgmap v14397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:27:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:25 smithi057 ceph-mon[92072]: pgmap v14397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:27:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:25 smithi122 ceph-mon[125440]: pgmap v14397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:27:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:27 smithi136 ceph-mon[125702]: pgmap v14398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:27:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:27 smithi057 ceph-mon[92072]: pgmap v14398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:27:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:27 smithi122 ceph-mon[125440]: pgmap v14398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:27:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:29 smithi136 ceph-mon[125702]: pgmap v14399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:27:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:29 smithi057 ceph-mon[92072]: pgmap v14399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:27:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:29 smithi122 ceph-mon[125440]: pgmap v14399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:27:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:31 smithi136 ceph-mon[125702]: pgmap v14400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:27:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:31 smithi057 ceph-mon[92072]: pgmap v14400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:27:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:31 smithi122 ceph-mon[125440]: pgmap v14400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:27:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:33 smithi136 ceph-mon[125702]: pgmap v14401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:33 smithi057 ceph-mon[92072]: pgmap v14401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:33 smithi122 ceph-mon[125440]: pgmap v14401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:35 smithi136 ceph-mon[125702]: pgmap v14402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:27:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:35 smithi057 ceph-mon[92072]: pgmap v14402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:27:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:35 smithi122 ceph-mon[125440]: pgmap v14402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:27:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:37 smithi136 ceph-mon[125702]: pgmap v14403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:27:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:37 smithi057 ceph-mon[92072]: pgmap v14403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:27:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:37 smithi122 ceph-mon[125440]: pgmap v14403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:27:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:39.740+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:27:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:39.740+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:27:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:39.740+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:27:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:39.740+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:27:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:39.740+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:27:40.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:39 smithi136 ceph-mon[125702]: pgmap v14404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:39 smithi057 ceph-mon[92072]: pgmap v14404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:39 smithi122 ceph-mon[125440]: pgmap v14404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:41 smithi136 ceph-mon[125702]: pgmap v14405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:41 smithi057 ceph-mon[92072]: pgmap v14405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:41 smithi122 ceph-mon[125440]: pgmap v14405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:43 smithi136 ceph-mon[125702]: pgmap v14406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:43 smithi057 ceph-mon[92072]: pgmap v14406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:43 smithi122 ceph-mon[125440]: pgmap v14406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:46.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:45 smithi136 ceph-mon[125702]: pgmap v14407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:45 smithi057 ceph-mon[92072]: pgmap v14407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:45 smithi122 ceph-mon[125440]: pgmap v14407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:47 smithi136 ceph-mon[125702]: pgmap v14408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:47 smithi057 ceph-mon[92072]: pgmap v14408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:47 smithi122 ceph-mon[125440]: pgmap v14408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:49 smithi136 ceph-mon[125702]: pgmap v14409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:49 smithi057 ceph-mon[92072]: pgmap v14409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:49 smithi122 ceph-mon[125440]: pgmap v14409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:51 smithi136 ceph-mon[125702]: pgmap v14410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:51 smithi057 ceph-mon[92072]: pgmap v14410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:51 smithi122 ceph-mon[125440]: pgmap v14410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:27:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:27:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:27:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:27:53.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:27:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:27:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:27:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:27:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:27:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:27:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:27:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:27:54.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:53 smithi136 ceph-mon[125702]: pgmap v14411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:53 smithi057 ceph-mon[92072]: pgmap v14411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:53 smithi122 ceph-mon[125440]: pgmap v14411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:27:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:54.749+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:27:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:54.749+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:27:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:54.749+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:27:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:54.749+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:27:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:27:54.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:27:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:55 smithi136 ceph-mon[125702]: pgmap v14412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:55 smithi057 ceph-mon[92072]: pgmap v14412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:55 smithi122 ceph-mon[125440]: pgmap v14412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:57 smithi136 ceph-mon[125702]: pgmap v14413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:57 smithi057 ceph-mon[92072]: pgmap v14413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:27:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:57 smithi122 ceph-mon[125440]: pgmap v14413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:27:59 smithi136 ceph-mon[125702]: pgmap v14414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:27:59 smithi057 ceph-mon[92072]: pgmap v14414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:27:59 smithi122 ceph-mon[125440]: pgmap v14414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:01 smithi136 ceph-mon[125702]: pgmap v14415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:01 smithi057 ceph-mon[92072]: pgmap v14415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:01 smithi122 ceph-mon[125440]: pgmap v14415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:03 smithi136 ceph-mon[125702]: pgmap v14416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:28:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:03 smithi057 ceph-mon[92072]: pgmap v14416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:28:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:03 smithi122 ceph-mon[125440]: pgmap v14416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:28:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:05 smithi136 ceph-mon[125702]: pgmap v14417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:28:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:05 smithi057 ceph-mon[92072]: pgmap v14417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:28:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:05 smithi122 ceph-mon[125440]: pgmap v14417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:28:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:07 smithi057 ceph-mon[92072]: pgmap v14418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:28:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:07 smithi057 ceph-mon[92072]: osdmap e974: 12 total, 12 up, 12 in 2023-03-02T18:28:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:07 smithi122 ceph-mon[125440]: pgmap v14418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:28:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:07 smithi122 ceph-mon[125440]: osdmap e974: 12 total, 12 up, 12 in 2023-03-02T18:28:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:07 smithi136 ceph-mon[125702]: pgmap v14418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:28:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:07 smithi136 ceph-mon[125702]: osdmap e974: 12 total, 12 up, 12 in 2023-03-02T18:28:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:09.764+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:28:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:09.764+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:28:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:09.764+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:28:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:09.764+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:28:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:09.764+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:28:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:09 smithi057 ceph-mon[92072]: pgmap v14420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:28:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:09 smithi122 ceph-mon[125440]: pgmap v14420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:28:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:09 smithi136 ceph-mon[125702]: pgmap v14420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:28:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:11 smithi057 ceph-mon[92072]: pgmap v14421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:28:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:11 smithi122 ceph-mon[125440]: pgmap v14421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:28:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:11 smithi136 ceph-mon[125702]: pgmap v14421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:28:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:13 smithi057 ceph-mon[92072]: pgmap v14422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:28:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:13 smithi122 ceph-mon[125440]: pgmap v14422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:28:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:13 smithi136 ceph-mon[125702]: pgmap v14422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:28:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:15 smithi057 ceph-mon[92072]: pgmap v14423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:28:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:15 smithi122 ceph-mon[125440]: pgmap v14423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:28:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:15 smithi136 ceph-mon[125702]: pgmap v14423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:28:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:17 smithi136 ceph-mon[125702]: pgmap v14424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:28:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:17 smithi136 ceph-mon[125702]: osdmap e975: 12 total, 12 up, 12 in 2023-03-02T18:28:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:17 smithi057 ceph-mon[92072]: pgmap v14424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:28:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:17 smithi057 ceph-mon[92072]: osdmap e975: 12 total, 12 up, 12 in 2023-03-02T18:28:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:17 smithi122 ceph-mon[125440]: pgmap v14424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:28:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:17 smithi122 ceph-mon[125440]: osdmap e975: 12 total, 12 up, 12 in 2023-03-02T18:28:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:19 smithi136 ceph-mon[125702]: pgmap v14426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:28:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:19 smithi057 ceph-mon[92072]: pgmap v14426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:28:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:19 smithi122 ceph-mon[125440]: pgmap v14426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:28:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:21 smithi136 ceph-mon[125702]: pgmap v14427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:28:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:21 smithi057 ceph-mon[92072]: pgmap v14427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:28:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:21 smithi122 ceph-mon[125440]: pgmap v14427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:28:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:23 smithi136 ceph-mon[125702]: pgmap v14428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:28:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:23 smithi057 ceph-mon[92072]: pgmap v14428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:28:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:23 smithi122 ceph-mon[125440]: pgmap v14428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:28:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:24.775+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:28:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:24.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:28:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:24.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:28:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:24.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:28:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:24.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:28:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:25 smithi136 ceph-mon[125702]: pgmap v14429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:28:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:25 smithi057 ceph-mon[92072]: pgmap v14429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:28:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:25 smithi122 ceph-mon[125440]: pgmap v14429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:28:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:27 smithi136 ceph-mon[125702]: pgmap v14430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:28:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:27 smithi057 ceph-mon[92072]: pgmap v14430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:28:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:27 smithi122 ceph-mon[125440]: pgmap v14430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:28:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:29 smithi136 ceph-mon[125702]: pgmap v14431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:28:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:29 smithi057 ceph-mon[92072]: pgmap v14431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:28:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:29 smithi122 ceph-mon[125440]: pgmap v14431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:28:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:31 smithi136 ceph-mon[125702]: pgmap v14432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:31 smithi057 ceph-mon[92072]: pgmap v14432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:31 smithi122 ceph-mon[125440]: pgmap v14432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:33 smithi136 ceph-mon[125702]: pgmap v14433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:33 smithi057 ceph-mon[92072]: pgmap v14433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:33 smithi122 ceph-mon[125440]: pgmap v14433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:35 smithi136 ceph-mon[125702]: pgmap v14434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:35 smithi057 ceph-mon[92072]: pgmap v14434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:35 smithi122 ceph-mon[125440]: pgmap v14434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:37 smithi136 ceph-mon[125702]: pgmap v14435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:37 smithi057 ceph-mon[92072]: pgmap v14435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:37 smithi122 ceph-mon[125440]: pgmap v14435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:39.777+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:28:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:39.777+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:28:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:39.777+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:28:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:39.777+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:28:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:39.777+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:28:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:39 smithi136 ceph-mon[125702]: pgmap v14436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:39 smithi057 ceph-mon[92072]: pgmap v14436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:39 smithi122 ceph-mon[125440]: pgmap v14436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:41 smithi136 ceph-mon[125702]: pgmap v14437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:41 smithi057 ceph-mon[92072]: pgmap v14437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:41 smithi122 ceph-mon[125440]: pgmap v14437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:43 smithi136 ceph-mon[125702]: pgmap v14438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:43 smithi057 ceph-mon[92072]: pgmap v14438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:43 smithi122 ceph-mon[125440]: pgmap v14438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:45 smithi136 ceph-mon[125702]: pgmap v14439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:45 smithi057 ceph-mon[92072]: pgmap v14439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:45 smithi122 ceph-mon[125440]: pgmap v14439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:47 smithi136 ceph-mon[125702]: pgmap v14440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:47 smithi057 ceph-mon[92072]: pgmap v14440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:47 smithi122 ceph-mon[125440]: pgmap v14440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:49 smithi136 ceph-mon[125702]: pgmap v14441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:49 smithi057 ceph-mon[92072]: pgmap v14441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:49 smithi122 ceph-mon[125440]: pgmap v14441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:51 smithi136 ceph-mon[125702]: pgmap v14442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:51 smithi057 ceph-mon[92072]: pgmap v14442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:51 smithi122 ceph-mon[125440]: pgmap v14442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:53 smithi057 ceph-mon[92072]: pgmap v14443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:28:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:28:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:28:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:28:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:53 smithi122 ceph-mon[125440]: pgmap v14443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:28:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:28:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:28:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:28:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:53 smithi136 ceph-mon[125702]: pgmap v14443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:28:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:28:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:28:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:28:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:28:54.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:54.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:28:54.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:54.794+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:28:54.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:54.794+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:28:54.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:54.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:28:54.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:28:54.794+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:28:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:55 smithi057 ceph-mon[92072]: pgmap v14444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:55 smithi122 ceph-mon[125440]: pgmap v14444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:55 smithi136 ceph-mon[125702]: pgmap v14444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:57 smithi057 ceph-mon[92072]: pgmap v14445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:57 smithi122 ceph-mon[125440]: pgmap v14445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:28:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:57 smithi136 ceph-mon[125702]: pgmap v14445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:28:59 smithi057 ceph-mon[92072]: pgmap v14446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:28:59 smithi122 ceph-mon[125440]: pgmap v14446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:28:59 smithi136 ceph-mon[125702]: pgmap v14446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:01 smithi057 ceph-mon[92072]: pgmap v14447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:01 smithi122 ceph-mon[125440]: pgmap v14447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:01 smithi136 ceph-mon[125702]: pgmap v14447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:03 smithi057 ceph-mon[92072]: pgmap v14448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:29:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:03 smithi122 ceph-mon[125440]: pgmap v14448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:29:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:03 smithi136 ceph-mon[125702]: pgmap v14448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:29:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:05 smithi057 ceph-mon[92072]: pgmap v14449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:29:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:05 smithi122 ceph-mon[125440]: pgmap v14449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:29:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:05 smithi136 ceph-mon[125702]: pgmap v14449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:29:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:07 smithi057 ceph-mon[92072]: pgmap v14450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:29:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:07 smithi057 ceph-mon[92072]: osdmap e976: 12 total, 12 up, 12 in 2023-03-02T18:29:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:07 smithi122 ceph-mon[125440]: pgmap v14450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:29:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:07 smithi122 ceph-mon[125440]: osdmap e976: 12 total, 12 up, 12 in 2023-03-02T18:29:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:07 smithi136 ceph-mon[125702]: pgmap v14450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:29:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:07 smithi136 ceph-mon[125702]: osdmap e976: 12 total, 12 up, 12 in 2023-03-02T18:29:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:08.421+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000161) for more than 900000000 us, fault. 2023-03-02T18:29:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:08.421+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5870019800 tx=0x7f5870096000 comp rx=0 tx=0).stop 2023-03-02T18:29:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:08.421+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T18:29:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:08.421+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T18:29:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:08.421+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T18:29:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:08.421+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:29:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:08.421+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870098000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T18:29:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:09.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:29:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:09.803+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:29:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:09.803+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:29:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:09.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:29:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:09.803+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:29:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:09 smithi057 ceph-mon[92072]: pgmap v14452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:29:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:09 smithi122 ceph-mon[125440]: pgmap v14452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:29:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:09 smithi136 ceph-mon[125702]: pgmap v14452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:29:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:11 smithi057 ceph-mon[92072]: pgmap v14453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:29:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:11 smithi122 ceph-mon[125440]: pgmap v14453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:29:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:12.269+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:29:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:12.269+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:29:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:12.269+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 210 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:29:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:12.269+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 209 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:29:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:11 smithi136 ceph-mon[125702]: pgmap v14453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:29:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:13 smithi057 ceph-mon[92072]: pgmap v14454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:29:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:13 smithi122 ceph-mon[125440]: pgmap v14454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:29:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:13 smithi136 ceph-mon[125702]: pgmap v14454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:29:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:15 smithi057 ceph-mon[92072]: pgmap v14455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:29:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:15 smithi122 ceph-mon[125440]: pgmap v14455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:29:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:15 smithi136 ceph-mon[125702]: pgmap v14455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:29:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:17 smithi136 ceph-mon[125702]: pgmap v14456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:29:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:17 smithi136 ceph-mon[125702]: osdmap e977: 12 total, 12 up, 12 in 2023-03-02T18:29:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:17 smithi057 ceph-mon[92072]: pgmap v14456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:29:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:17 smithi057 ceph-mon[92072]: osdmap e977: 12 total, 12 up, 12 in 2023-03-02T18:29:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:17 smithi122 ceph-mon[125440]: pgmap v14456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:29:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:17 smithi122 ceph-mon[125440]: osdmap e977: 12 total, 12 up, 12 in 2023-03-02T18:29:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:19 smithi136 ceph-mon[125702]: pgmap v14458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:29:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:19 smithi057 ceph-mon[92072]: pgmap v14458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:29:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:19 smithi122 ceph-mon[125440]: pgmap v14458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:29:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:21 smithi136 ceph-mon[125702]: pgmap v14459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:29:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:21 smithi057 ceph-mon[92072]: pgmap v14459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:29:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:21 smithi122 ceph-mon[125440]: pgmap v14459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:29:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:23 smithi136 ceph-mon[125702]: pgmap v14460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:29:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:23 smithi057 ceph-mon[92072]: pgmap v14460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:29:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:23 smithi122 ceph-mon[125440]: pgmap v14460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:29:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:24.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:29:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:24.815+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:29:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:24.815+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:29:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:24.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:29:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:24.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:29:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:25 smithi136 ceph-mon[125702]: pgmap v14461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:29:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:25 smithi057 ceph-mon[92072]: pgmap v14461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:29:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:25 smithi122 ceph-mon[125440]: pgmap v14461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:29:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:27 smithi136 ceph-mon[125702]: pgmap v14462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:29:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:27 smithi057 ceph-mon[92072]: pgmap v14462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:29:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:27 smithi122 ceph-mon[125440]: pgmap v14462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:29:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:29 smithi136 ceph-mon[125702]: pgmap v14463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:29:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:29 smithi057 ceph-mon[92072]: pgmap v14463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:29:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:29 smithi122 ceph-mon[125440]: pgmap v14463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:29:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:31 smithi136 ceph-mon[125702]: pgmap v14464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:31 smithi057 ceph-mon[92072]: pgmap v14464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:31 smithi122 ceph-mon[125440]: pgmap v14464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:33 smithi136 ceph-mon[125702]: pgmap v14465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:33 smithi057 ceph-mon[92072]: pgmap v14465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:33 smithi122 ceph-mon[125440]: pgmap v14465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:35 smithi136 ceph-mon[125702]: pgmap v14466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:29:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:35 smithi057 ceph-mon[92072]: pgmap v14466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:29:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:35 smithi122 ceph-mon[125440]: pgmap v14466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:29:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:37 smithi136 ceph-mon[125702]: pgmap v14467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:29:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:37 smithi057 ceph-mon[92072]: pgmap v14467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:29:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:37 smithi122 ceph-mon[125440]: pgmap v14467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:29:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:39.818+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:29:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:39.819+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:29:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:39.819+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:29:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:39.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:29:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:39.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:29:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:39 smithi136 ceph-mon[125702]: pgmap v14468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:39 smithi057 ceph-mon[92072]: pgmap v14468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:39 smithi122 ceph-mon[125440]: pgmap v14468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:41 smithi136 ceph-mon[125702]: pgmap v14469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:29:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:41 smithi057 ceph-mon[92072]: pgmap v14469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:29:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:41 smithi122 ceph-mon[125440]: pgmap v14469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:29:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:43 smithi136 ceph-mon[125702]: pgmap v14470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:43 smithi057 ceph-mon[92072]: pgmap v14470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:43 smithi122 ceph-mon[125440]: pgmap v14470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:45 smithi136 ceph-mon[125702]: pgmap v14471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:45 smithi057 ceph-mon[92072]: pgmap v14471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:45 smithi122 ceph-mon[125440]: pgmap v14471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:47 smithi136 ceph-mon[125702]: pgmap v14472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:47 smithi057 ceph-mon[92072]: pgmap v14472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:47 smithi122 ceph-mon[125440]: pgmap v14472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:49 smithi136 ceph-mon[125702]: pgmap v14473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:49 smithi057 ceph-mon[92072]: pgmap v14473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:49 smithi122 ceph-mon[125440]: pgmap v14473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:51 smithi136 ceph-mon[125702]: pgmap v14474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:51 smithi057 ceph-mon[92072]: pgmap v14474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:51 smithi122 ceph-mon[125440]: pgmap v14474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:53 smithi057 ceph-mon[92072]: pgmap v14475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:29:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:53 smithi122 ceph-mon[125440]: pgmap v14475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:29:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:53 smithi136 ceph-mon[125702]: pgmap v14475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:29:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:29:54.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:54.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:29:54.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:54.834+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:29:54.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:54.834+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:29:54.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:54.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:29:54.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:29:54.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:29:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:55 smithi057 ceph-mon[92072]: pgmap v14476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:55 smithi122 ceph-mon[125440]: pgmap v14476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:55 smithi136 ceph-mon[125702]: pgmap v14476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:57.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: pgmap v14477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:29:57.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:29:57.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: pgmap v14477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:57.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:29:57.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:29:57.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: pgmap v14477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:29:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:29:58.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:29:58.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:29:58.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:29:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:58 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:29:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:58 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:29:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:58 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:29:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:58 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:29:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:58 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:29:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:58 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:29:59.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:58 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:29:59.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:58 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:29:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:58 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:29:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:58 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:29:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:58 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:29:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:58 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:29:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:29:59 smithi122 ceph-mon[125440]: pgmap v14478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:29:59 smithi136 ceph-mon[125702]: pgmap v14478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:29:59 smithi057 ceph-mon[92072]: pgmap v14478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T18:30:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T18:30:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T18:30:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:01 smithi122 ceph-mon[125440]: pgmap v14479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:02.089 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:01 smithi136 ceph-mon[125702]: pgmap v14479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:01 smithi057 ceph-mon[92072]: pgmap v14479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:03 smithi136 ceph-mon[125702]: pgmap v14480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:30:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:03 smithi057 ceph-mon[92072]: pgmap v14480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:30:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:03 smithi122 ceph-mon[125440]: pgmap v14480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:30:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:05 smithi136 ceph-mon[125702]: pgmap v14481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:30:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:05 smithi057 ceph-mon[92072]: pgmap v14481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:30:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:05 smithi122 ceph-mon[125440]: pgmap v14481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:30:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:07 smithi136 ceph-mon[125702]: pgmap v14482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:30:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:07 smithi136 ceph-mon[125702]: osdmap e978: 12 total, 12 up, 12 in 2023-03-02T18:30:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:07 smithi057 ceph-mon[92072]: pgmap v14482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:30:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:07 smithi057 ceph-mon[92072]: osdmap e978: 12 total, 12 up, 12 in 2023-03-02T18:30:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:07 smithi122 ceph-mon[125440]: pgmap v14482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:30:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:07 smithi122 ceph-mon[125440]: osdmap e978: 12 total, 12 up, 12 in 2023-03-02T18:30:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:09.848+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:30:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:09.849+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:30:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:09.849+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:30:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:09.849+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:30:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:09.849+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:30:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:09 smithi136 ceph-mon[125702]: pgmap v14484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:30:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:09 smithi057 ceph-mon[92072]: pgmap v14484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:30:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:09 smithi122 ceph-mon[125440]: pgmap v14484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:30:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:11 smithi136 ceph-mon[125702]: pgmap v14485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:30:12.096 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:11 smithi057 ceph-mon[92072]: pgmap v14485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:30:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:11 smithi122 ceph-mon[125440]: pgmap v14485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:30:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:13 smithi136 ceph-mon[125702]: pgmap v14486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:30:14.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:13 smithi057 ceph-mon[92072]: pgmap v14486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:30:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:13 smithi122 ceph-mon[125440]: pgmap v14486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:30:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:15 smithi136 ceph-mon[125702]: pgmap v14487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:30:16.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:15 smithi057 ceph-mon[92072]: pgmap v14487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:30:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:15 smithi122 ceph-mon[125440]: pgmap v14487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:30:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:17 smithi136 ceph-mon[125702]: pgmap v14488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:30:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:17 smithi136 ceph-mon[125702]: osdmap e979: 12 total, 12 up, 12 in 2023-03-02T18:30:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:17 smithi057 ceph-mon[92072]: pgmap v14488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:30:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:17 smithi057 ceph-mon[92072]: osdmap e979: 12 total, 12 up, 12 in 2023-03-02T18:30:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:17 smithi122 ceph-mon[125440]: pgmap v14488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:30:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:17 smithi122 ceph-mon[125440]: osdmap e979: 12 total, 12 up, 12 in 2023-03-02T18:30:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:19 smithi136 ceph-mon[125702]: pgmap v14490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:30:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:19 smithi057 ceph-mon[92072]: pgmap v14490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:30:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:19 smithi122 ceph-mon[125440]: pgmap v14490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:30:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:21 smithi136 ceph-mon[125702]: pgmap v14491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:30:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:21 smithi057 ceph-mon[92072]: pgmap v14491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:30:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:21 smithi122 ceph-mon[125440]: pgmap v14491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:30:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:23 smithi136 ceph-mon[125702]: pgmap v14492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:30:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:23 smithi057 ceph-mon[92072]: pgmap v14492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:30:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:23 smithi122 ceph-mon[125440]: pgmap v14492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:30:24.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:24.864+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:30:24.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:24.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:30:24.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:24.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:30:24.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:24.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:30:24.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:24.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:30:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:25 smithi136 ceph-mon[125702]: pgmap v14493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:30:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:25 smithi057 ceph-mon[92072]: pgmap v14493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:30:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:25 smithi122 ceph-mon[125440]: pgmap v14493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:30:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:27 smithi136 ceph-mon[125702]: pgmap v14494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:30:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:27 smithi057 ceph-mon[92072]: pgmap v14494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:30:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:27 smithi122 ceph-mon[125440]: pgmap v14494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:30:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:29 smithi136 ceph-mon[125702]: pgmap v14495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:30:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:29 smithi057 ceph-mon[92072]: pgmap v14495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:30:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:29 smithi122 ceph-mon[125440]: pgmap v14495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:30:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:31 smithi136 ceph-mon[125702]: pgmap v14496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:31 smithi057 ceph-mon[92072]: pgmap v14496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:31 smithi122 ceph-mon[125440]: pgmap v14496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:33 smithi136 ceph-mon[125702]: pgmap v14497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:33 smithi057 ceph-mon[92072]: pgmap v14497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:33 smithi122 ceph-mon[125440]: pgmap v14497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:35 smithi136 ceph-mon[125702]: pgmap v14498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:35 smithi057 ceph-mon[92072]: pgmap v14498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:35 smithi122 ceph-mon[125440]: pgmap v14498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:37 smithi136 ceph-mon[125702]: pgmap v14499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:37 smithi057 ceph-mon[92072]: pgmap v14499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:37 smithi122 ceph-mon[125440]: pgmap v14499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:39.880+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:30:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:39.880+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:30:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:39.880+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:30:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:39.880+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:30:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:39.880+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:30:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:39 smithi057 ceph-mon[92072]: pgmap v14500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:40.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:39 smithi122 ceph-mon[125440]: pgmap v14500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:39 smithi136 ceph-mon[125702]: pgmap v14500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:41 smithi057 ceph-mon[92072]: pgmap v14501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:41 smithi122 ceph-mon[125440]: pgmap v14501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:41 smithi136 ceph-mon[125702]: pgmap v14501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:30:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:43 smithi057 ceph-mon[92072]: pgmap v14502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:43 smithi122 ceph-mon[125440]: pgmap v14502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:43 smithi136 ceph-mon[125702]: pgmap v14502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:45 smithi057 ceph-mon[92072]: pgmap v14503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:45 smithi122 ceph-mon[125440]: pgmap v14503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:45 smithi136 ceph-mon[125702]: pgmap v14503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:47 smithi057 ceph-mon[92072]: pgmap v14504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:47 smithi122 ceph-mon[125440]: pgmap v14504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:47 smithi136 ceph-mon[125702]: pgmap v14504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:49 smithi057 ceph-mon[92072]: pgmap v14505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:49 smithi122 ceph-mon[125440]: pgmap v14505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:49 smithi136 ceph-mon[125702]: pgmap v14505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:30:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:51 smithi057 ceph-mon[92072]: pgmap v14506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:51 smithi122 ceph-mon[125440]: pgmap v14506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:51 smithi136 ceph-mon[125702]: pgmap v14506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:53 smithi057 ceph-mon[92072]: pgmap v14507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:30:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:53 smithi122 ceph-mon[125440]: pgmap v14507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:30:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:53 smithi136 ceph-mon[125702]: pgmap v14507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T18:30:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:54.894+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:30:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:54.894+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:30:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:54.894+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:30:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:54.894+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:30:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:30:54.894+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:30:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:55 smithi057 ceph-mon[92072]: pgmap v14508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:55 smithi122 ceph-mon[125440]: pgmap v14508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:55 smithi136 ceph-mon[125702]: pgmap v14508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:57 smithi057 ceph-mon[92072]: pgmap v14509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:30:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:57 smithi122 ceph-mon[125440]: pgmap v14509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:30:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:57 smithi136 ceph-mon[125702]: pgmap v14509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:30:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:30:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:30:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:30:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:30:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:30:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:30:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:30:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:30:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:30:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:31:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:30:59 smithi057 ceph-mon[92072]: pgmap v14510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:30:59 smithi122 ceph-mon[125440]: pgmap v14510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:30:59 smithi136 ceph-mon[125702]: pgmap v14510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:01 smithi057 ceph-mon[92072]: pgmap v14511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:31:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:01 smithi122 ceph-mon[125440]: pgmap v14511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:31:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:01 smithi136 ceph-mon[125702]: pgmap v14511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:31:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:03 smithi057 ceph-mon[92072]: pgmap v14512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:31:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:03 smithi122 ceph-mon[125440]: pgmap v14512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:31:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:03 smithi136 ceph-mon[125702]: pgmap v14512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:31:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:05 smithi057 ceph-mon[92072]: pgmap v14513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:31:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:05 smithi122 ceph-mon[125440]: pgmap v14513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:31:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:05 smithi136 ceph-mon[125702]: pgmap v14513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:31:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:07 smithi057 ceph-mon[92072]: pgmap v14514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:31:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:07 smithi057 ceph-mon[92072]: osdmap e980: 12 total, 12 up, 12 in 2023-03-02T18:31:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:07 smithi122 ceph-mon[125440]: pgmap v14514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:31:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:07 smithi122 ceph-mon[125440]: osdmap e980: 12 total, 12 up, 12 in 2023-03-02T18:31:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:07 smithi136 ceph-mon[125702]: pgmap v14514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:31:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:07 smithi136 ceph-mon[125702]: osdmap e980: 12 total, 12 up, 12 in 2023-03-02T18:31:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:09.907+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:31:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:09.907+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:31:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:09.907+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:31:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:09.907+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:31:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:09.907+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:31:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:09 smithi057 ceph-mon[92072]: pgmap v14516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:31:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:09 smithi122 ceph-mon[125440]: pgmap v14516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:31:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:09 smithi136 ceph-mon[125702]: pgmap v14516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:31:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:11 smithi057 ceph-mon[92072]: pgmap v14517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:31:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:11 smithi122 ceph-mon[125440]: pgmap v14517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:31:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:11 smithi136 ceph-mon[125702]: pgmap v14517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:31:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:13 smithi122 ceph-mon[125440]: pgmap v14518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:31:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:13 smithi136 ceph-mon[125702]: pgmap v14518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:31:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:13 smithi057 ceph-mon[92072]: pgmap v14518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:31:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:15 smithi122 ceph-mon[125440]: pgmap v14519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:31:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:15 smithi136 ceph-mon[125702]: pgmap v14519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:31:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:15 smithi057 ceph-mon[92072]: pgmap v14519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:31:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:17 smithi136 ceph-mon[125702]: pgmap v14520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:31:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:17 smithi136 ceph-mon[125702]: osdmap e981: 12 total, 12 up, 12 in 2023-03-02T18:31:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:17 smithi057 ceph-mon[92072]: pgmap v14520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:31:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:17 smithi057 ceph-mon[92072]: osdmap e981: 12 total, 12 up, 12 in 2023-03-02T18:31:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:17 smithi122 ceph-mon[125440]: pgmap v14520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:31:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:17 smithi122 ceph-mon[125440]: osdmap e981: 12 total, 12 up, 12 in 2023-03-02T18:31:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:19 smithi136 ceph-mon[125702]: pgmap v14522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:31:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:19 smithi057 ceph-mon[92072]: pgmap v14522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:31:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:19 smithi122 ceph-mon[125440]: pgmap v14522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:31:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:21 smithi136 ceph-mon[125702]: pgmap v14523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:31:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:21 smithi057 ceph-mon[92072]: pgmap v14523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:31:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:21 smithi122 ceph-mon[125440]: pgmap v14523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:31:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:23 smithi136 ceph-mon[125702]: pgmap v14524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:31:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:23 smithi057 ceph-mon[92072]: pgmap v14524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:31:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:23 smithi122 ceph-mon[125440]: pgmap v14524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:31:24.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:24.923+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:31:24.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:24.923+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:31:24.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:24.923+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:31:24.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:24.923+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:31:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:24.923+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:31:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:25 smithi136 ceph-mon[125702]: pgmap v14525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:31:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:25 smithi057 ceph-mon[92072]: pgmap v14525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:31:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:25 smithi122 ceph-mon[125440]: pgmap v14525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:31:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:27 smithi136 ceph-mon[125702]: pgmap v14526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:31:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:27 smithi057 ceph-mon[92072]: pgmap v14526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:31:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:27 smithi122 ceph-mon[125440]: pgmap v14526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:31:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:29 smithi136 ceph-mon[125702]: pgmap v14527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:31:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:29 smithi057 ceph-mon[92072]: pgmap v14527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:31:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:29 smithi122 ceph-mon[125440]: pgmap v14527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:31:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:31 smithi136 ceph-mon[125702]: pgmap v14528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:31 smithi057 ceph-mon[92072]: pgmap v14528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:31 smithi122 ceph-mon[125440]: pgmap v14528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:33 smithi136 ceph-mon[125702]: pgmap v14529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:33 smithi057 ceph-mon[92072]: pgmap v14529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:33 smithi122 ceph-mon[125440]: pgmap v14529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:35 smithi057 ceph-mon[92072]: pgmap v14530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:35 smithi122 ceph-mon[125440]: pgmap v14530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:35 smithi136 ceph-mon[125702]: pgmap v14530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:37 smithi057 ceph-mon[92072]: pgmap v14531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:37 smithi122 ceph-mon[125440]: pgmap v14531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:37 smithi136 ceph-mon[125702]: pgmap v14531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:39.935+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:31:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:39.935+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:31:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:39.935+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:31:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:39.935+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:31:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:39.935+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:31:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:39 smithi057 ceph-mon[92072]: pgmap v14532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:39 smithi122 ceph-mon[125440]: pgmap v14532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:39 smithi136 ceph-mon[125702]: pgmap v14532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:41 smithi057 ceph-mon[92072]: pgmap v14533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:41 smithi122 ceph-mon[125440]: pgmap v14533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:41 smithi136 ceph-mon[125702]: pgmap v14533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:43 smithi057 ceph-mon[92072]: pgmap v14534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:43 smithi122 ceph-mon[125440]: pgmap v14534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:43 smithi136 ceph-mon[125702]: pgmap v14534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:45 smithi057 ceph-mon[92072]: pgmap v14535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:45 smithi122 ceph-mon[125440]: pgmap v14535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:45 smithi136 ceph-mon[125702]: pgmap v14535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:47 smithi057 ceph-mon[92072]: pgmap v14536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:47 smithi122 ceph-mon[125440]: pgmap v14536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:47 smithi136 ceph-mon[125702]: pgmap v14536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:49 smithi057 ceph-mon[92072]: pgmap v14537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:49 smithi122 ceph-mon[125440]: pgmap v14537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:49 smithi136 ceph-mon[125702]: pgmap v14537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:51 smithi057 ceph-mon[92072]: pgmap v14538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:51 smithi122 ceph-mon[125440]: pgmap v14538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:51 smithi136 ceph-mon[125702]: pgmap v14538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:53 smithi057 ceph-mon[92072]: pgmap v14539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:53 smithi122 ceph-mon[125440]: pgmap v14539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:53 smithi136 ceph-mon[125702]: pgmap v14539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:31:54.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:54.945+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:31:54.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:54.945+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:31:54.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:54.945+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:31:54.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:54.945+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:31:54.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:31:54.946+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:31:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:55 smithi057 ceph-mon[92072]: pgmap v14540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:55 smithi122 ceph-mon[125440]: pgmap v14540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:55 smithi136 ceph-mon[125702]: pgmap v14540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:57 smithi057 ceph-mon[92072]: pgmap v14541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:57 smithi122 ceph-mon[125440]: pgmap v14541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:57 smithi136 ceph-mon[125702]: pgmap v14541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:31:59.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:31:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:31:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:32:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:59 smithi057 ceph-mon[92072]: pgmap v14542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:32:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:31:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:32:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:59 smithi122 ceph-mon[125440]: pgmap v14542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:32:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:31:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:32:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:59 smithi136 ceph-mon[125702]: pgmap v14542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:32:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:31:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:32:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:32:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:32:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:32:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:32:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:32:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:32:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:32:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:32:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:32:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:01 smithi122 ceph-mon[125440]: pgmap v14543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:32:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:01 smithi136 ceph-mon[125702]: pgmap v14543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:32:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:01 smithi057 ceph-mon[92072]: pgmap v14543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:32:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:03 smithi122 ceph-mon[125440]: pgmap v14544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:32:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:03 smithi136 ceph-mon[125702]: pgmap v14544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:32:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:03 smithi057 ceph-mon[92072]: pgmap v14544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:32:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:05 smithi136 ceph-mon[125702]: pgmap v14545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:32:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:05 smithi057 ceph-mon[92072]: pgmap v14545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:32:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:05 smithi122 ceph-mon[125440]: pgmap v14545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:32:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:07 smithi136 ceph-mon[125702]: pgmap v14546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:32:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:07 smithi057 ceph-mon[92072]: pgmap v14546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:32:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:07 smithi122 ceph-mon[125440]: pgmap v14546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:32:09.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:09.962+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:32:09.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:09.962+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:32:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:09.962+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:32:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:09.962+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:32:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:09.962+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:32:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:09 smithi136 ceph-mon[125702]: pgmap v14547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:32:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:09 smithi057 ceph-mon[92072]: pgmap v14547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:32:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:09 smithi122 ceph-mon[125440]: pgmap v14547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:32:12.295 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:12.295+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:32:12.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:12.295+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:32:12.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:12.295+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 211 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:32:12.296 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:12.295+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 210 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:32:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:11 smithi136 ceph-mon[125702]: pgmap v14548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:32:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:11 smithi136 ceph-mon[125702]: osdmap e982: 12 total, 12 up, 12 in 2023-03-02T18:32:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:11 smithi057 ceph-mon[92072]: pgmap v14548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:32:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:11 smithi057 ceph-mon[92072]: osdmap e982: 12 total, 12 up, 12 in 2023-03-02T18:32:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:11 smithi122 ceph-mon[125440]: pgmap v14548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:32:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:11 smithi122 ceph-mon[125440]: osdmap e982: 12 total, 12 up, 12 in 2023-03-02T18:32:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:13 smithi136 ceph-mon[125702]: pgmap v14550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:32:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:13 smithi057 ceph-mon[92072]: pgmap v14550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:32:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:13 smithi122 ceph-mon[125440]: pgmap v14550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:32:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:15 smithi136 ceph-mon[125702]: pgmap v14551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:32:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:15 smithi057 ceph-mon[92072]: pgmap v14551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:32:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:15 smithi122 ceph-mon[125440]: pgmap v14551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:32:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:17 smithi136 ceph-mon[125702]: pgmap v14552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:32:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:17 smithi136 ceph-mon[125702]: osdmap e983: 12 total, 12 up, 12 in 2023-03-02T18:32:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:17 smithi057 ceph-mon[92072]: pgmap v14552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:32:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:17 smithi057 ceph-mon[92072]: osdmap e983: 12 total, 12 up, 12 in 2023-03-02T18:32:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:17 smithi122 ceph-mon[125440]: pgmap v14552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:32:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:17 smithi122 ceph-mon[125440]: osdmap e983: 12 total, 12 up, 12 in 2023-03-02T18:32:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:19 smithi136 ceph-mon[125702]: pgmap v14554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:32:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:19 smithi057 ceph-mon[92072]: pgmap v14554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:32:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:19 smithi122 ceph-mon[125440]: pgmap v14554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:32:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:21 smithi136 ceph-mon[125702]: pgmap v14555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T18:32:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:21 smithi057 ceph-mon[92072]: pgmap v14555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T18:32:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:21 smithi122 ceph-mon[125440]: pgmap v14555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T18:32:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:23 smithi136 ceph-mon[125702]: pgmap v14556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:32:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:23 smithi057 ceph-mon[92072]: pgmap v14556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:32:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:23 smithi122 ceph-mon[125440]: pgmap v14556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:32:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:24.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:32:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:24.971+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:32:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:24.971+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:32:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:24.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:32:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:24.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:32:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:25 smithi136 ceph-mon[125702]: pgmap v14557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:32:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:25 smithi057 ceph-mon[92072]: pgmap v14557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:32:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:25 smithi122 ceph-mon[125440]: pgmap v14557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:32:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:27 smithi057 ceph-mon[92072]: pgmap v14558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:32:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:27 smithi122 ceph-mon[125440]: pgmap v14558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:32:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:27 smithi136 ceph-mon[125702]: pgmap v14558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:32:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:29 smithi057 ceph-mon[92072]: pgmap v14559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T18:32:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:29 smithi122 ceph-mon[125440]: pgmap v14559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T18:32:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:29 smithi136 ceph-mon[125702]: pgmap v14559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T18:32:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:31 smithi057 ceph-mon[92072]: pgmap v14560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:31 smithi122 ceph-mon[125440]: pgmap v14560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:31 smithi136 ceph-mon[125702]: pgmap v14560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:33 smithi057 ceph-mon[92072]: pgmap v14561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:32:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:33 smithi122 ceph-mon[125440]: pgmap v14561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:32:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:33 smithi136 ceph-mon[125702]: pgmap v14561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:32:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:35 smithi057 ceph-mon[92072]: pgmap v14562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:35 smithi122 ceph-mon[125440]: pgmap v14562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:35 smithi136 ceph-mon[125702]: pgmap v14562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:37 smithi057 ceph-mon[92072]: pgmap v14563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:37 smithi122 ceph-mon[125440]: pgmap v14563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:37 smithi136 ceph-mon[125702]: pgmap v14563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:39.983+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:32:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:39.984+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:32:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:39.984+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:32:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:39.984+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:32:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:39.984+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:32:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:39 smithi057 ceph-mon[92072]: pgmap v14564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:39 smithi122 ceph-mon[125440]: pgmap v14564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:39 smithi136 ceph-mon[125702]: pgmap v14564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:41 smithi057 ceph-mon[92072]: pgmap v14565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:41 smithi122 ceph-mon[125440]: pgmap v14565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:41 smithi136 ceph-mon[125702]: pgmap v14565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:43 smithi057 ceph-mon[92072]: pgmap v14566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:43 smithi122 ceph-mon[125440]: pgmap v14566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:43 smithi136 ceph-mon[125702]: pgmap v14566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:45 smithi057 ceph-mon[92072]: pgmap v14567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:45 smithi122 ceph-mon[125440]: pgmap v14567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:45 smithi136 ceph-mon[125702]: pgmap v14567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:47 smithi057 ceph-mon[92072]: pgmap v14568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:47 smithi122 ceph-mon[125440]: pgmap v14568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:47 smithi136 ceph-mon[125702]: pgmap v14568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:49 smithi057 ceph-mon[92072]: pgmap v14569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:49 smithi122 ceph-mon[125440]: pgmap v14569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:49 smithi136 ceph-mon[125702]: pgmap v14569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:51 smithi057 ceph-mon[92072]: pgmap v14570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:51 smithi122 ceph-mon[125440]: pgmap v14570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:51 smithi136 ceph-mon[125702]: pgmap v14570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:53 smithi057 ceph-mon[92072]: pgmap v14571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:53 smithi122 ceph-mon[125440]: pgmap v14571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:53 smithi136 ceph-mon[125702]: pgmap v14571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:32:55.000 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:54.999+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:32:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:55.000+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:32:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:55.000+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:32:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:55.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:32:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:55.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:32:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:55 smithi057 ceph-mon[92072]: pgmap v14572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:55 smithi122 ceph-mon[125440]: pgmap v14572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:55 smithi136 ceph-mon[125702]: pgmap v14572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:57.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:57.301+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:32:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:57.301+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:32:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:57.302+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 212 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:32:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:32:57.302+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 211 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:32:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:57 smithi057 ceph-mon[92072]: pgmap v14573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:57 smithi122 ceph-mon[125440]: pgmap v14573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:32:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:57 smithi136 ceph-mon[125702]: pgmap v14573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:32:59 smithi057 ceph-mon[92072]: pgmap v14574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:32:59 smithi122 ceph-mon[125440]: pgmap v14574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:32:59 smithi136 ceph-mon[125702]: pgmap v14574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:01.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:33:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:33:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:33:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:01 smithi057 ceph-mon[92072]: pgmap v14575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:33:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:33:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:01 smithi122 ceph-mon[125440]: pgmap v14575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:33:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:33:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:01 smithi136 ceph-mon[125702]: pgmap v14575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:33:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:33:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:33:04.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:03 smithi057 ceph-mon[92072]: pgmap v14576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:33:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:03 smithi122 ceph-mon[125440]: pgmap v14576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:33:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:03 smithi136 ceph-mon[125702]: pgmap v14576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:33:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:05 smithi122 ceph-mon[125440]: pgmap v14577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:33:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:05 smithi136 ceph-mon[125702]: pgmap v14577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:33:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:05 smithi057 ceph-mon[92072]: pgmap v14577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:33:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:07 smithi122 ceph-mon[125440]: pgmap v14578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:33:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:07 smithi122 ceph-mon[125440]: osdmap e984: 12 total, 12 up, 12 in 2023-03-02T18:33:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:07 smithi136 ceph-mon[125702]: pgmap v14578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:33:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:07 smithi136 ceph-mon[125702]: osdmap e984: 12 total, 12 up, 12 in 2023-03-02T18:33:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:07 smithi057 ceph-mon[92072]: pgmap v14578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:33:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:07 smithi057 ceph-mon[92072]: osdmap e984: 12 total, 12 up, 12 in 2023-03-02T18:33:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:10.007+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:33:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:10.007+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:33:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:10.007+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:33:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:10.007+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:33:10.010 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:10.007+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:33:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:09 smithi122 ceph-mon[125440]: pgmap v14580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:33:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:09 smithi136 ceph-mon[125702]: pgmap v14580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:33:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:09 smithi057 ceph-mon[92072]: pgmap v14580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:33:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:11 smithi136 ceph-mon[125702]: pgmap v14581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:33:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:11 smithi057 ceph-mon[92072]: pgmap v14581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:33:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:11 smithi122 ceph-mon[125440]: pgmap v14581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:33:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:13 smithi136 ceph-mon[125702]: pgmap v14582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:33:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:13 smithi057 ceph-mon[92072]: pgmap v14582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:33:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:13 smithi122 ceph-mon[125440]: pgmap v14582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:33:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:15 smithi136 ceph-mon[125702]: pgmap v14583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:33:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:15 smithi057 ceph-mon[92072]: pgmap v14583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:33:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:15 smithi122 ceph-mon[125440]: pgmap v14583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:33:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:17 smithi136 ceph-mon[125702]: pgmap v14584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:33:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:17 smithi136 ceph-mon[125702]: osdmap e985: 12 total, 12 up, 12 in 2023-03-02T18:33:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:17 smithi057 ceph-mon[92072]: pgmap v14584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:33:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:17 smithi057 ceph-mon[92072]: osdmap e985: 12 total, 12 up, 12 in 2023-03-02T18:33:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:17 smithi122 ceph-mon[125440]: pgmap v14584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:33:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:17 smithi122 ceph-mon[125440]: osdmap e985: 12 total, 12 up, 12 in 2023-03-02T18:33:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:19 smithi136 ceph-mon[125702]: pgmap v14586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:33:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:19 smithi057 ceph-mon[92072]: pgmap v14586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:33:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:19 smithi122 ceph-mon[125440]: pgmap v14586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:33:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:21 smithi136 ceph-mon[125702]: pgmap v14587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:33:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:21 smithi057 ceph-mon[92072]: pgmap v14587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:33:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:21 smithi122 ceph-mon[125440]: pgmap v14587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:33:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:23 smithi057 ceph-mon[92072]: pgmap v14588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:33:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:23 smithi122 ceph-mon[125440]: pgmap v14588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:33:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:23 smithi136 ceph-mon[125702]: pgmap v14588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:33:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:25.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:33:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:25.015+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:33:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:25.015+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:33:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:25.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:33:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:25.015+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:33:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:25 smithi057 ceph-mon[92072]: pgmap v14589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:33:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:25 smithi122 ceph-mon[125440]: pgmap v14589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:33:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:25 smithi136 ceph-mon[125702]: pgmap v14589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:33:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:27 smithi057 ceph-mon[92072]: pgmap v14590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:33:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:27 smithi122 ceph-mon[125440]: pgmap v14590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:33:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:27 smithi136 ceph-mon[125702]: pgmap v14590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:33:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:29 smithi057 ceph-mon[92072]: pgmap v14591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:33:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:29 smithi122 ceph-mon[125440]: pgmap v14591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:33:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:29 smithi136 ceph-mon[125702]: pgmap v14591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:33:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:31 smithi057 ceph-mon[92072]: pgmap v14592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:31 smithi122 ceph-mon[125440]: pgmap v14592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:31 smithi136 ceph-mon[125702]: pgmap v14592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:33 smithi057 ceph-mon[92072]: pgmap v14593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:33 smithi122 ceph-mon[125440]: pgmap v14593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:33 smithi136 ceph-mon[125702]: pgmap v14593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:35 smithi057 ceph-mon[92072]: pgmap v14594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:35 smithi122 ceph-mon[125440]: pgmap v14594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:35 smithi136 ceph-mon[125702]: pgmap v14594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:37 smithi057 ceph-mon[92072]: pgmap v14595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:37 smithi122 ceph-mon[125440]: pgmap v14595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:37 smithi136 ceph-mon[125702]: pgmap v14595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:40.024 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:40.024+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:33:40.025 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:40.024+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:33:40.025 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:40.024+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:33:40.025 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:40.024+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:33:40.025 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:40.024+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:33:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:39 smithi057 ceph-mon[92072]: pgmap v14596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:39 smithi122 ceph-mon[125440]: pgmap v14596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:39 smithi136 ceph-mon[125702]: pgmap v14596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:41 smithi057 ceph-mon[92072]: pgmap v14597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:41 smithi122 ceph-mon[125440]: pgmap v14597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:41 smithi136 ceph-mon[125702]: pgmap v14597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:43 smithi057 ceph-mon[92072]: pgmap v14598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:43 smithi122 ceph-mon[125440]: pgmap v14598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:43 smithi136 ceph-mon[125702]: pgmap v14598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:45 smithi057 ceph-mon[92072]: pgmap v14599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:45 smithi122 ceph-mon[125440]: pgmap v14599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:45 smithi136 ceph-mon[125702]: pgmap v14599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:47 smithi057 ceph-mon[92072]: pgmap v14600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:47 smithi122 ceph-mon[125440]: pgmap v14600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:47 smithi136 ceph-mon[125702]: pgmap v14600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:49 smithi057 ceph-mon[92072]: pgmap v14601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:49 smithi122 ceph-mon[125440]: pgmap v14601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:49 smithi136 ceph-mon[125702]: pgmap v14601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:51 smithi057 ceph-mon[92072]: pgmap v14602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:51 smithi122 ceph-mon[125440]: pgmap v14602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:51 smithi136 ceph-mon[125702]: pgmap v14602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:54.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:53 smithi057 ceph-mon[92072]: pgmap v14603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:53 smithi122 ceph-mon[125440]: pgmap v14603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:53 smithi136 ceph-mon[125702]: pgmap v14603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:33:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:55.037+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:33:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:55.038+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:33:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:55.038+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:33:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:55.038+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:33:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:33:55.038+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:33:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:55 smithi057 ceph-mon[92072]: pgmap v14604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:55 smithi122 ceph-mon[125440]: pgmap v14604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:55 smithi136 ceph-mon[125702]: pgmap v14604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:57 smithi057 ceph-mon[92072]: pgmap v14605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:57 smithi122 ceph-mon[125440]: pgmap v14605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:33:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:57 smithi136 ceph-mon[125702]: pgmap v14605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:33:59 smithi122 ceph-mon[125440]: pgmap v14606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:33:59 smithi136 ceph-mon[125702]: pgmap v14606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:33:59 smithi057 ceph-mon[92072]: pgmap v14606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:01 smithi122 ceph-mon[125440]: pgmap v14607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:34:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:01 smithi136 ceph-mon[125702]: pgmap v14607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:34:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:01 smithi057 ceph-mon[92072]: pgmap v14607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:34:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:34:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:34:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:34:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:34:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:34:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:34:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:34:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:34:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:34:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:03 smithi122 ceph-mon[125440]: pgmap v14608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:34:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:03 smithi136 ceph-mon[125702]: pgmap v14608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:34:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:03 smithi057 ceph-mon[92072]: pgmap v14608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:34:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:05 smithi136 ceph-mon[125702]: pgmap v14609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:34:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:05 smithi057 ceph-mon[92072]: pgmap v14609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:34:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:05 smithi122 ceph-mon[125440]: pgmap v14609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:34:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:07 smithi136 ceph-mon[125702]: pgmap v14610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:34:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:07 smithi136 ceph-mon[125702]: osdmap e986: 12 total, 12 up, 12 in 2023-03-02T18:34:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:07 smithi057 ceph-mon[92072]: pgmap v14610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:34:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:07 smithi057 ceph-mon[92072]: osdmap e986: 12 total, 12 up, 12 in 2023-03-02T18:34:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:07 smithi122 ceph-mon[125440]: pgmap v14610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:34:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:07 smithi122 ceph-mon[125440]: osdmap e986: 12 total, 12 up, 12 in 2023-03-02T18:34:10.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:10.039+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:34:10.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:10.039+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:34:10.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:10.039+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:34:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:10.039+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:34:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:10.039+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:34:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:09 smithi136 ceph-mon[125702]: pgmap v14612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:34:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:09 smithi057 ceph-mon[92072]: pgmap v14612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:34:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:09 smithi122 ceph-mon[125440]: pgmap v14612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:34:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:11 smithi136 ceph-mon[125702]: pgmap v14613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:34:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:11 smithi057 ceph-mon[92072]: pgmap v14613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:34:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:11 smithi122 ceph-mon[125440]: pgmap v14613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:34:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:13 smithi136 ceph-mon[125702]: pgmap v14614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:34:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:13 smithi057 ceph-mon[92072]: pgmap v14614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:34:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:13 smithi122 ceph-mon[125440]: pgmap v14614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:34:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:15 smithi136 ceph-mon[125702]: pgmap v14615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:34:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:15 smithi057 ceph-mon[92072]: pgmap v14615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:34:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:15 smithi122 ceph-mon[125440]: pgmap v14615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:34:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:17 smithi057 ceph-mon[92072]: pgmap v14616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:34:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:17 smithi057 ceph-mon[92072]: osdmap e987: 12 total, 12 up, 12 in 2023-03-02T18:34:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:17 smithi122 ceph-mon[125440]: pgmap v14616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:34:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:17 smithi122 ceph-mon[125440]: osdmap e987: 12 total, 12 up, 12 in 2023-03-02T18:34:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:17 smithi136 ceph-mon[125702]: pgmap v14616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:34:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:17 smithi136 ceph-mon[125702]: osdmap e987: 12 total, 12 up, 12 in 2023-03-02T18:34:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:19 smithi057 ceph-mon[92072]: pgmap v14618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:34:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:19 smithi122 ceph-mon[125440]: pgmap v14618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:34:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:19 smithi136 ceph-mon[125702]: pgmap v14618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:34:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:21 smithi057 ceph-mon[92072]: pgmap v14619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:34:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:21 smithi122 ceph-mon[125440]: pgmap v14619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:34:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:21 smithi136 ceph-mon[125702]: pgmap v14619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:34:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:23 smithi057 ceph-mon[92072]: pgmap v14620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:34:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:23 smithi122 ceph-mon[125440]: pgmap v14620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:34:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:23 smithi136 ceph-mon[125702]: pgmap v14620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:34:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:25.054+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:34:25.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:25.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:34:25.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:25.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:34:25.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:25.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:34:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:25.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:34:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:25 smithi057 ceph-mon[92072]: pgmap v14621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:34:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:25 smithi122 ceph-mon[125440]: pgmap v14621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:34:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:25 smithi136 ceph-mon[125702]: pgmap v14621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:34:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:27 smithi057 ceph-mon[92072]: pgmap v14622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:34:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:27 smithi122 ceph-mon[125440]: pgmap v14622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:34:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:27 smithi136 ceph-mon[125702]: pgmap v14622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:34:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:29 smithi057 ceph-mon[92072]: pgmap v14623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:34:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:29 smithi122 ceph-mon[125440]: pgmap v14623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:34:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:29 smithi136 ceph-mon[125702]: pgmap v14623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:34:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:31 smithi057 ceph-mon[92072]: pgmap v14624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:31 smithi122 ceph-mon[125440]: pgmap v14624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:31 smithi136 ceph-mon[125702]: pgmap v14624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:33 smithi057 ceph-mon[92072]: pgmap v14625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:33 smithi122 ceph-mon[125440]: pgmap v14625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:33 smithi136 ceph-mon[125702]: pgmap v14625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:35 smithi057 ceph-mon[92072]: pgmap v14626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:35 smithi122 ceph-mon[125440]: pgmap v14626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:35 smithi136 ceph-mon[125702]: pgmap v14626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:37 smithi057 ceph-mon[92072]: pgmap v14627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:37 smithi122 ceph-mon[125440]: pgmap v14627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:37 smithi136 ceph-mon[125702]: pgmap v14627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:40.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:34:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:40.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:34:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:40.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:34:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:40.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:34:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:40.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:34:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:39 smithi057 ceph-mon[92072]: pgmap v14628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:39 smithi122 ceph-mon[125440]: pgmap v14628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:39 smithi136 ceph-mon[125702]: pgmap v14628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:41 smithi057 ceph-mon[92072]: pgmap v14629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:41 smithi122 ceph-mon[125440]: pgmap v14629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:41 smithi136 ceph-mon[125702]: pgmap v14629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:43 smithi057 ceph-mon[92072]: pgmap v14630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:43 smithi122 ceph-mon[125440]: pgmap v14630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:43 smithi136 ceph-mon[125702]: pgmap v14630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:45 smithi057 ceph-mon[92072]: pgmap v14631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:45 smithi122 ceph-mon[125440]: pgmap v14631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:45 smithi136 ceph-mon[125702]: pgmap v14631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:47 smithi122 ceph-mon[125440]: pgmap v14632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:47 smithi136 ceph-mon[125702]: pgmap v14632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:47 smithi057 ceph-mon[92072]: pgmap v14632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:49 smithi122 ceph-mon[125440]: pgmap v14633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:49 smithi136 ceph-mon[125702]: pgmap v14633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:49 smithi057 ceph-mon[92072]: pgmap v14633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:51 smithi122 ceph-mon[125440]: pgmap v14634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:51 smithi136 ceph-mon[125702]: pgmap v14634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:51 smithi057 ceph-mon[92072]: pgmap v14634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:53 smithi122 ceph-mon[125440]: pgmap v14635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:53 smithi136 ceph-mon[125702]: pgmap v14635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:53 smithi057 ceph-mon[92072]: pgmap v14635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:34:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:55.083+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:34:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:55.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:34:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:55.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:34:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:55.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:34:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:34:55.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:34:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:55 smithi136 ceph-mon[125702]: pgmap v14636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:55 smithi057 ceph-mon[92072]: pgmap v14636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:56.488 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:55 smithi122 ceph-mon[125440]: pgmap v14636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:57 smithi136 ceph-mon[125702]: pgmap v14637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:57 smithi057 ceph-mon[92072]: pgmap v14637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:34:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:57 smithi122 ceph-mon[125440]: pgmap v14637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:34:59 smithi136 ceph-mon[125702]: pgmap v14638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:34:59 smithi057 ceph-mon[92072]: pgmap v14638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:34:59 smithi122 ceph-mon[125440]: pgmap v14638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:01 smithi136 ceph-mon[125702]: pgmap v14639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:01 smithi057 ceph-mon[92072]: pgmap v14639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:01 smithi122 ceph-mon[125440]: pgmap v14639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:35:03.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:35:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:35:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:03 smithi136 ceph-mon[125702]: pgmap v14640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:35:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:35:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:35:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:35:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:03 smithi057 ceph-mon[92072]: pgmap v14640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:35:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:35:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:35:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:35:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:03 smithi122 ceph-mon[125440]: pgmap v14640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:35:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:35:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:35:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:35:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:05 smithi136 ceph-mon[125702]: pgmap v14641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:35:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:05 smithi057 ceph-mon[92072]: pgmap v14641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:35:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:05 smithi122 ceph-mon[125440]: pgmap v14641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:35:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:07 smithi136 ceph-mon[125702]: osdmap e988: 12 total, 12 up, 12 in 2023-03-02T18:35:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:06 smithi057 ceph-mon[92072]: osdmap e988: 12 total, 12 up, 12 in 2023-03-02T18:35:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:06 smithi122 ceph-mon[125440]: osdmap e988: 12 total, 12 up, 12 in 2023-03-02T18:35:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:08 smithi136 ceph-mon[125702]: pgmap v14643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:35:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:08 smithi057 ceph-mon[92072]: pgmap v14643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:35:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:08 smithi122 ceph-mon[125440]: pgmap v14643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:35:10.098 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:10.097+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:35:10.098 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:10.097+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:35:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:10.097+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:35:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:10.097+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:35:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:10.097+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:35:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:10 smithi136 ceph-mon[125702]: pgmap v14644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:35:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:10 smithi057 ceph-mon[92072]: pgmap v14644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:35:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:10 smithi122 ceph-mon[125440]: pgmap v14644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:35:12.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:12.320+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:35:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:12.320+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:35:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:12.320+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 212 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:35:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:12.320+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 213 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:35:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:12 smithi136 ceph-mon[125702]: pgmap v14645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:35:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:12 smithi136 ceph-mon[125702]: osdmap e989: 12 total, 12 up, 12 in 2023-03-02T18:35:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:12 smithi057 ceph-mon[92072]: pgmap v14645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:35:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:12 smithi057 ceph-mon[92072]: osdmap e989: 12 total, 12 up, 12 in 2023-03-02T18:35:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:12 smithi122 ceph-mon[125440]: pgmap v14645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:35:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:12 smithi122 ceph-mon[125440]: osdmap e989: 12 total, 12 up, 12 in 2023-03-02T18:35:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:14 smithi136 ceph-mon[125702]: pgmap v14647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:35:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:14 smithi057 ceph-mon[92072]: pgmap v14647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:35:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:14 smithi122 ceph-mon[125440]: pgmap v14647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:35:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:16 smithi136 ceph-mon[125702]: pgmap v14648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T18:35:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:16 smithi057 ceph-mon[92072]: pgmap v14648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T18:35:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:16 smithi122 ceph-mon[125440]: pgmap v14648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T18:35:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:18 smithi136 ceph-mon[125702]: pgmap v14649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:35:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:18 smithi057 ceph-mon[92072]: pgmap v14649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:35:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:18 smithi122 ceph-mon[125440]: pgmap v14649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:35:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:20 smithi136 ceph-mon[125702]: pgmap v14650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:35:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:20 smithi057 ceph-mon[92072]: pgmap v14650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:35:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:20 smithi122 ceph-mon[125440]: pgmap v14650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:35:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:22 smithi136 ceph-mon[125702]: pgmap v14651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:35:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:22 smithi057 ceph-mon[92072]: pgmap v14651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:35:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:22 smithi122 ceph-mon[125440]: pgmap v14651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:35:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:24 smithi136 ceph-mon[125702]: pgmap v14652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:35:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:24 smithi057 ceph-mon[92072]: pgmap v14652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:35:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:24 smithi122 ceph-mon[125440]: pgmap v14652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:35:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:25.108+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:35:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:25.108+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:35:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:25.108+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:35:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:25.108+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:35:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:25.108+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:35:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:26 smithi136 ceph-mon[125702]: pgmap v14653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:26 smithi057 ceph-mon[92072]: pgmap v14653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:26 smithi122 ceph-mon[125440]: pgmap v14653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:28 smithi136 ceph-mon[125702]: pgmap v14654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:28 smithi057 ceph-mon[92072]: pgmap v14654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:28 smithi122 ceph-mon[125440]: pgmap v14654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:30 smithi136 ceph-mon[125702]: pgmap v14655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:30 smithi057 ceph-mon[92072]: pgmap v14655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:30 smithi122 ceph-mon[125440]: pgmap v14655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:32 smithi136 ceph-mon[125702]: pgmap v14656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:32 smithi057 ceph-mon[92072]: pgmap v14656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:32 smithi122 ceph-mon[125440]: pgmap v14656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:34 smithi057 ceph-mon[92072]: pgmap v14657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:34 smithi122 ceph-mon[125440]: pgmap v14657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:34 smithi136 ceph-mon[125702]: pgmap v14657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:35.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:35 smithi057 ceph-mon[92072]: pgmap v14658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:35 smithi122 ceph-mon[125440]: pgmap v14658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:35 smithi136 ceph-mon[125702]: pgmap v14658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:38.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:37 smithi057 ceph-mon[92072]: pgmap v14659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:37 smithi122 ceph-mon[125440]: pgmap v14659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:37 smithi136 ceph-mon[125702]: pgmap v14659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:40.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:40.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:35:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:40.115+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:35:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:40.115+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:35:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:40.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:35:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:40.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:35:40.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:39 smithi057 ceph-mon[92072]: pgmap v14660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:39 smithi122 ceph-mon[125440]: pgmap v14660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:39 smithi136 ceph-mon[125702]: pgmap v14660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:42.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:41 smithi057 ceph-mon[92072]: pgmap v14661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:41 smithi122 ceph-mon[125440]: pgmap v14661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:41 smithi136 ceph-mon[125702]: pgmap v14661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:44.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:43 smithi057 ceph-mon[92072]: pgmap v14662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:43 smithi122 ceph-mon[125440]: pgmap v14662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:43 smithi136 ceph-mon[125702]: pgmap v14662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:45 smithi057 ceph-mon[92072]: pgmap v14663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:45 smithi122 ceph-mon[125440]: pgmap v14663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:45 smithi136 ceph-mon[125702]: pgmap v14663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:48.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:47 smithi057 ceph-mon[92072]: pgmap v14664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:47 smithi122 ceph-mon[125440]: pgmap v14664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:47 smithi136 ceph-mon[125702]: pgmap v14664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:50.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:49 smithi057 ceph-mon[92072]: pgmap v14665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:49 smithi122 ceph-mon[125440]: pgmap v14665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:49 smithi136 ceph-mon[125702]: pgmap v14665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:52.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:51 smithi057 ceph-mon[92072]: pgmap v14666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:51 smithi122 ceph-mon[125440]: pgmap v14666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:51 smithi136 ceph-mon[125702]: pgmap v14666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:53 smithi057 ceph-mon[92072]: pgmap v14667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:53 smithi122 ceph-mon[125440]: pgmap v14667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:53 smithi136 ceph-mon[125702]: pgmap v14667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:35:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:55.130+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:35:55.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:55.131+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:35:55.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:55.131+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:35:55.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:55.131+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:35:55.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:35:55.131+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:35:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:55 smithi057 ceph-mon[92072]: pgmap v14668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:55 smithi122 ceph-mon[125440]: pgmap v14668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:55 smithi136 ceph-mon[125702]: pgmap v14668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:58.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:57 smithi057 ceph-mon[92072]: pgmap v14669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:57 smithi122 ceph-mon[125440]: pgmap v14669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:35:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:57 smithi136 ceph-mon[125702]: pgmap v14669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:00.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:35:59 smithi057 ceph-mon[92072]: pgmap v14670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:35:59 smithi122 ceph-mon[125440]: pgmap v14670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:35:59 smithi136 ceph-mon[125702]: pgmap v14670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:01 smithi057 ceph-mon[92072]: pgmap v14671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:01 smithi122 ceph-mon[125440]: pgmap v14671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:01 smithi136 ceph-mon[125702]: pgmap v14671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:03 smithi122 ceph-mon[125440]: pgmap v14672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:36:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:36:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:03 smithi136 ceph-mon[125702]: pgmap v14672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:36:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:36:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:03 smithi057 ceph-mon[92072]: pgmap v14672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:36:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:36:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:05 smithi122 ceph-mon[125440]: pgmap v14673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:36:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:05 smithi136 ceph-mon[125702]: pgmap v14673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:36:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:05 smithi057 ceph-mon[92072]: pgmap v14673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:36:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:07 smithi122 ceph-mon[125440]: pgmap v14674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:36:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:07 smithi122 ceph-mon[125440]: osdmap e990: 12 total, 12 up, 12 in 2023-03-02T18:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:36:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:07 smithi136 ceph-mon[125702]: pgmap v14674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:36:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:07 smithi136 ceph-mon[125702]: osdmap e990: 12 total, 12 up, 12 in 2023-03-02T18:36:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:36:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:36:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:36:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:36:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:36:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:07 smithi057 ceph-mon[92072]: pgmap v14674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:36:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:07 smithi057 ceph-mon[92072]: osdmap e990: 12 total, 12 up, 12 in 2023-03-02T18:36:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:36:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:36:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:36:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:36:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:36:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:10.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:36:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:10.137+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:36:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:10.137+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:36:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:10.137+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:36:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:10.137+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:36:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:09 smithi136 ceph-mon[125702]: pgmap v14676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:36:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:09 smithi057 ceph-mon[92072]: pgmap v14676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:36:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:09 smithi122 ceph-mon[125440]: pgmap v14676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:36:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:11 smithi136 ceph-mon[125702]: pgmap v14677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:36:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:11 smithi057 ceph-mon[92072]: pgmap v14677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:36:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:11 smithi122 ceph-mon[125440]: pgmap v14677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:36:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:13 smithi136 ceph-mon[125702]: pgmap v14678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:36:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:13 smithi057 ceph-mon[92072]: pgmap v14678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:36:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:13 smithi122 ceph-mon[125440]: pgmap v14678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:36:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:15 smithi136 ceph-mon[125702]: pgmap v14679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:36:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:15 smithi057 ceph-mon[92072]: pgmap v14679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:36:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:15 smithi122 ceph-mon[125440]: pgmap v14679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:36:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:17 smithi057 ceph-mon[92072]: pgmap v14680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:36:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:17 smithi057 ceph-mon[92072]: osdmap e991: 12 total, 12 up, 12 in 2023-03-02T18:36:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:17 smithi122 ceph-mon[125440]: pgmap v14680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:36:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:17 smithi122 ceph-mon[125440]: osdmap e991: 12 total, 12 up, 12 in 2023-03-02T18:36:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:17 smithi136 ceph-mon[125702]: pgmap v14680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:36:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:17 smithi136 ceph-mon[125702]: osdmap e991: 12 total, 12 up, 12 in 2023-03-02T18:36:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:19 smithi057 ceph-mon[92072]: pgmap v14682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:36:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:19 smithi122 ceph-mon[125440]: pgmap v14682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:36:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:19 smithi136 ceph-mon[125702]: pgmap v14682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:36:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:21 smithi057 ceph-mon[92072]: pgmap v14683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:36:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:21 smithi122 ceph-mon[125440]: pgmap v14683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:36:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:21 smithi136 ceph-mon[125702]: pgmap v14683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:36:24.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:23 smithi057 ceph-mon[92072]: pgmap v14684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:36:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:23 smithi122 ceph-mon[125440]: pgmap v14684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:36:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:23 smithi136 ceph-mon[125702]: pgmap v14684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:36:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:25.143+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:36:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:25.143+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:36:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:25.143+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:36:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:25.143+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:36:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:25.144+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:36:26.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:25 smithi057 ceph-mon[92072]: pgmap v14685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:36:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:25 smithi122 ceph-mon[125440]: pgmap v14685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:36:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:25 smithi136 ceph-mon[125702]: pgmap v14685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:36:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:27 smithi057 ceph-mon[92072]: pgmap v14686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:36:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:27 smithi122 ceph-mon[125440]: pgmap v14686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:36:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:27 smithi136 ceph-mon[125702]: pgmap v14686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:36:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:29 smithi057 ceph-mon[92072]: pgmap v14687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:36:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:29 smithi122 ceph-mon[125440]: pgmap v14687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:36:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:29 smithi136 ceph-mon[125702]: pgmap v14687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:36:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:31 smithi122 ceph-mon[125440]: pgmap v14688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:31 smithi136 ceph-mon[125702]: pgmap v14688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:31 smithi057 ceph-mon[92072]: pgmap v14688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:33 smithi122 ceph-mon[125440]: pgmap v14689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:33 smithi136 ceph-mon[125702]: pgmap v14689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:33 smithi057 ceph-mon[92072]: pgmap v14689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:35 smithi122 ceph-mon[125440]: pgmap v14690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:35 smithi136 ceph-mon[125702]: pgmap v14690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:35 smithi057 ceph-mon[92072]: pgmap v14690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:37 smithi136 ceph-mon[125702]: pgmap v14691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:37 smithi057 ceph-mon[92072]: pgmap v14691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:37 smithi122 ceph-mon[125440]: pgmap v14691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:40.160+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:36:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:40.160+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:36:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:40.160+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:36:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:40.160+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:36:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:40.161+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:36:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:39 smithi136 ceph-mon[125702]: pgmap v14692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:39 smithi057 ceph-mon[92072]: pgmap v14692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:39 smithi122 ceph-mon[125440]: pgmap v14692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:41 smithi136 ceph-mon[125702]: pgmap v14693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:41 smithi057 ceph-mon[92072]: pgmap v14693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:41 smithi122 ceph-mon[125440]: pgmap v14693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:43 smithi136 ceph-mon[125702]: pgmap v14694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:43 smithi057 ceph-mon[92072]: pgmap v14694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:43 smithi122 ceph-mon[125440]: pgmap v14694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:45 smithi136 ceph-mon[125702]: pgmap v14695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:45 smithi057 ceph-mon[92072]: pgmap v14695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:45 smithi122 ceph-mon[125440]: pgmap v14695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:47 smithi136 ceph-mon[125702]: pgmap v14696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:47 smithi057 ceph-mon[92072]: pgmap v14696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:47 smithi122 ceph-mon[125440]: pgmap v14696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:49 smithi136 ceph-mon[125702]: pgmap v14697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:50.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:49 smithi057 ceph-mon[92072]: pgmap v14697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:49 smithi122 ceph-mon[125440]: pgmap v14697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:51 smithi136 ceph-mon[125702]: pgmap v14698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:51 smithi057 ceph-mon[92072]: pgmap v14698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:51 smithi122 ceph-mon[125440]: pgmap v14698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:53 smithi136 ceph-mon[125702]: pgmap v14699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:53 smithi057 ceph-mon[92072]: pgmap v14699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:53 smithi122 ceph-mon[125440]: pgmap v14699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:36:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:55.167+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:36:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:55.167+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:36:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:55.167+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:36:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:55.167+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:36:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:36:55.167+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:36:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:56 smithi136 ceph-mon[125702]: pgmap v14700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:56 smithi057 ceph-mon[92072]: pgmap v14700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:56 smithi122 ceph-mon[125440]: pgmap v14700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:36:58 smithi136 ceph-mon[125702]: pgmap v14701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:36:58 smithi057 ceph-mon[92072]: pgmap v14701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:36:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:36:58 smithi122 ceph-mon[125440]: pgmap v14701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:00 smithi136 ceph-mon[125702]: pgmap v14702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:00 smithi057 ceph-mon[92072]: pgmap v14702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:00 smithi122 ceph-mon[125440]: pgmap v14702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:02 smithi136 ceph-mon[125702]: pgmap v14703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:02 smithi057 ceph-mon[92072]: pgmap v14703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:02 smithi122 ceph-mon[125440]: pgmap v14703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:04 smithi136 ceph-mon[125702]: pgmap v14704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:37:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:04 smithi057 ceph-mon[92072]: pgmap v14704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:37:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:04 smithi122 ceph-mon[125440]: pgmap v14704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:37:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:06 smithi136 ceph-mon[125702]: pgmap v14705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:37:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:06 smithi057 ceph-mon[92072]: pgmap v14705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:37:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:06 smithi122 ceph-mon[125440]: pgmap v14705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:37:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:07 smithi136 ceph-mon[125702]: osdmap e992: 12 total, 12 up, 12 in 2023-03-02T18:37:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:07 smithi057 ceph-mon[92072]: osdmap e992: 12 total, 12 up, 12 in 2023-03-02T18:37:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:07 smithi122 ceph-mon[125440]: osdmap e992: 12 total, 12 up, 12 in 2023-03-02T18:37:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:08 smithi136 ceph-mon[125702]: pgmap v14707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:37:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:37:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:08 smithi057 ceph-mon[92072]: pgmap v14707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:37:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:37:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:08 smithi122 ceph-mon[125440]: pgmap v14707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:37:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:37:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:10.173+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:37:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:10.173+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:37:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:10.173+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:37:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:10.173+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:37:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:10.173+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:37:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:10 smithi122 ceph-mon[125440]: pgmap v14708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:37:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:10 smithi136 ceph-mon[125702]: pgmap v14708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:37:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:10 smithi057 ceph-mon[92072]: pgmap v14708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:37:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:12 smithi136 ceph-mon[125702]: pgmap v14709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:37:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:37:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:37:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:12 smithi136 ceph-mon[125702]: osdmap e993: 12 total, 12 up, 12 in 2023-03-02T18:37:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:12 smithi057 ceph-mon[92072]: pgmap v14709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:37:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:37:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:37:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:12 smithi057 ceph-mon[92072]: osdmap e993: 12 total, 12 up, 12 in 2023-03-02T18:37:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:12 smithi122 ceph-mon[125440]: pgmap v14709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:37:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:37:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:37:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:37:12.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:12 smithi122 ceph-mon[125440]: osdmap e993: 12 total, 12 up, 12 in 2023-03-02T18:37:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:14 smithi136 ceph-mon[125702]: pgmap v14711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:37:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:14 smithi057 ceph-mon[92072]: pgmap v14711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:37:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:14 smithi122 ceph-mon[125440]: pgmap v14711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:37:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:16 smithi136 ceph-mon[125702]: pgmap v14712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T18:37:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:16 smithi057 ceph-mon[92072]: pgmap v14712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T18:37:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:16 smithi122 ceph-mon[125440]: pgmap v14712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T18:37:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:18 smithi057 ceph-mon[92072]: pgmap v14713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:37:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:18 smithi122 ceph-mon[125440]: pgmap v14713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:37:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:18 smithi136 ceph-mon[125702]: pgmap v14713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:37:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:20 smithi057 ceph-mon[92072]: pgmap v14714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:37:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:20 smithi122 ceph-mon[125440]: pgmap v14714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:37:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:20 smithi136 ceph-mon[125702]: pgmap v14714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:37:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:22 smithi057 ceph-mon[92072]: pgmap v14715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:37:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:22 smithi122 ceph-mon[125440]: pgmap v14715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:37:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:22 smithi136 ceph-mon[125702]: pgmap v14715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:37:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:24 smithi057 ceph-mon[92072]: pgmap v14716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:37:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:24 smithi122 ceph-mon[125440]: pgmap v14716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:37:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:24 smithi136 ceph-mon[125702]: pgmap v14716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:37:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:25.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:37:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:25.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:37:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:25.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:37:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:25.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:37:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:25.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:37:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:25 smithi057 ceph-mon[92072]: pgmap v14717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:25 smithi122 ceph-mon[125440]: pgmap v14717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:25 smithi136 ceph-mon[125702]: pgmap v14717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:28.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:27 smithi057 ceph-mon[92072]: pgmap v14718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:27 smithi122 ceph-mon[125440]: pgmap v14718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:27 smithi136 ceph-mon[125702]: pgmap v14718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:30.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:29 smithi057 ceph-mon[92072]: pgmap v14719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:29 smithi122 ceph-mon[125440]: pgmap v14719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:29 smithi136 ceph-mon[125702]: pgmap v14719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:32.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:31 smithi057 ceph-mon[92072]: pgmap v14720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:31 smithi122 ceph-mon[125440]: pgmap v14720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:31 smithi136 ceph-mon[125702]: pgmap v14720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:34.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:33 smithi057 ceph-mon[92072]: pgmap v14721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:33 smithi122 ceph-mon[125440]: pgmap v14721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:33 smithi136 ceph-mon[125702]: pgmap v14721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:36.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:35 smithi057 ceph-mon[92072]: pgmap v14722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:35 smithi122 ceph-mon[125440]: pgmap v14722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:35 smithi136 ceph-mon[125702]: pgmap v14722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:37 smithi122 ceph-mon[125440]: pgmap v14723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:37 smithi136 ceph-mon[125702]: pgmap v14723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:37 smithi057 ceph-mon[92072]: pgmap v14723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:39 smithi122 ceph-mon[125440]: pgmap v14724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:40.201+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:37:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:40.202+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:37:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:40.202+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:37:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:40.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:37:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:40.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:37:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:39 smithi136 ceph-mon[125702]: pgmap v14724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:39 smithi057 ceph-mon[92072]: pgmap v14724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:41 smithi122 ceph-mon[125440]: pgmap v14725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:41 smithi136 ceph-mon[125702]: pgmap v14725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:41 smithi057 ceph-mon[92072]: pgmap v14725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:43 smithi122 ceph-mon[125440]: pgmap v14726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:43 smithi136 ceph-mon[125702]: pgmap v14726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:43 smithi057 ceph-mon[92072]: pgmap v14726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:45 smithi136 ceph-mon[125702]: pgmap v14727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:45 smithi057 ceph-mon[92072]: pgmap v14727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:45 smithi122 ceph-mon[125440]: pgmap v14727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:47 smithi136 ceph-mon[125702]: pgmap v14728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:47 smithi057 ceph-mon[92072]: pgmap v14728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:47 smithi122 ceph-mon[125440]: pgmap v14728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:49 smithi136 ceph-mon[125702]: pgmap v14729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:50.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:49 smithi057 ceph-mon[92072]: pgmap v14729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:49 smithi122 ceph-mon[125440]: pgmap v14729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:51 smithi136 ceph-mon[125702]: pgmap v14730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:51 smithi057 ceph-mon[92072]: pgmap v14730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:51 smithi122 ceph-mon[125440]: pgmap v14730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:53 smithi136 ceph-mon[125702]: pgmap v14731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:53 smithi057 ceph-mon[92072]: pgmap v14731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:53 smithi122 ceph-mon[125440]: pgmap v14731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:37:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:55.217+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:37:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:55.217+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:37:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:55.217+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:37:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:55.217+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:37:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:37:55.217+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:37:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:55 smithi136 ceph-mon[125702]: pgmap v14732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:55 smithi057 ceph-mon[92072]: pgmap v14732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:55 smithi122 ceph-mon[125440]: pgmap v14732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:57 smithi136 ceph-mon[125702]: pgmap v14733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:57 smithi057 ceph-mon[92072]: pgmap v14733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:37:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:57 smithi122 ceph-mon[125440]: pgmap v14733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:37:59 smithi136 ceph-mon[125702]: pgmap v14734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:37:59 smithi057 ceph-mon[92072]: pgmap v14734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:37:59 smithi122 ceph-mon[125440]: pgmap v14734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:01 smithi136 ceph-mon[125702]: pgmap v14735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:01 smithi057 ceph-mon[92072]: pgmap v14735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:01 smithi122 ceph-mon[125440]: pgmap v14735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:03 smithi136 ceph-mon[125702]: pgmap v14736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:38:04.419 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:03 smithi122 ceph-mon[125440]: pgmap v14736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:38:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:03 smithi057 ceph-mon[92072]: pgmap v14736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:38:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:05 smithi136 ceph-mon[125702]: pgmap v14737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:38:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:05 smithi057 ceph-mon[92072]: pgmap v14737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:38:06.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:05 smithi122 ceph-mon[125440]: pgmap v14737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:38:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:08 smithi136 ceph-mon[125702]: pgmap v14738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:38:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:07 smithi057 ceph-mon[92072]: pgmap v14738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:38:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:07 smithi122 ceph-mon[125440]: pgmap v14738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:38:10.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:10.228+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:38:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:10.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:38:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:10.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:38:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:10.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:38:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:10.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:38:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:10 smithi136 ceph-mon[125702]: pgmap v14739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:38:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:10 smithi057 ceph-mon[92072]: pgmap v14739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:38:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:10 smithi122 ceph-mon[125440]: pgmap v14739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:38:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:12 smithi136 ceph-mon[125702]: pgmap v14740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:38:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:12 smithi136 ceph-mon[125702]: osdmap e994: 12 total, 12 up, 12 in 2023-03-02T18:38:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:38:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:12.347+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:38:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:12.347+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:38:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:12.347+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 213 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:38:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:12.347+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 214 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:38:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:12 smithi057 ceph-mon[92072]: pgmap v14740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:38:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:12 smithi057 ceph-mon[92072]: osdmap e994: 12 total, 12 up, 12 in 2023-03-02T18:38:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:38:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:12 smithi122 ceph-mon[125440]: pgmap v14740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:38:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:12 smithi122 ceph-mon[125440]: osdmap e994: 12 total, 12 up, 12 in 2023-03-02T18:38:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:38:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:38:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:38:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:38:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:38:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:38:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:38:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:38:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:38:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:38:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:14 smithi122 ceph-mon[125440]: pgmap v14742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:14 smithi136 ceph-mon[125702]: pgmap v14742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:14 smithi057 ceph-mon[92072]: pgmap v14742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:16 smithi136 ceph-mon[125702]: pgmap v14743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:16 smithi057 ceph-mon[92072]: pgmap v14743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:16 smithi122 ceph-mon[125440]: pgmap v14743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:17 smithi057 ceph-mon[92072]: pgmap v14744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:17 smithi057 ceph-mon[92072]: osdmap e995: 12 total, 12 up, 12 in 2023-03-02T18:38:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:17 smithi122 ceph-mon[125440]: pgmap v14744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:17 smithi122 ceph-mon[125440]: osdmap e995: 12 total, 12 up, 12 in 2023-03-02T18:38:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:17 smithi136 ceph-mon[125702]: pgmap v14744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:17 smithi136 ceph-mon[125702]: osdmap e995: 12 total, 12 up, 12 in 2023-03-02T18:38:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:19 smithi122 ceph-mon[125440]: pgmap v14746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T18:38:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:19 smithi136 ceph-mon[125702]: pgmap v14746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T18:38:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:19 smithi057 ceph-mon[92072]: pgmap v14746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T18:38:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:21 smithi122 ceph-mon[125440]: pgmap v14747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 319 B/s wr, 10 op/s 2023-03-02T18:38:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:21 smithi136 ceph-mon[125702]: pgmap v14747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 319 B/s wr, 10 op/s 2023-03-02T18:38:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:21 smithi057 ceph-mon[92072]: pgmap v14747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 319 B/s wr, 10 op/s 2023-03-02T18:38:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:23 smithi136 ceph-mon[125702]: pgmap v14748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:23 smithi057 ceph-mon[92072]: pgmap v14748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:23 smithi122 ceph-mon[125440]: pgmap v14748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:25.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:25.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:38:25.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:25.244+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:38:25.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:25.244+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:38:25.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:25.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:38:25.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:25.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:38:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:25 smithi122 ceph-mon[125440]: pgmap v14749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:25 smithi136 ceph-mon[125702]: pgmap v14749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:25 smithi057 ceph-mon[92072]: pgmap v14749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:27 smithi136 ceph-mon[125702]: pgmap v14750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:27 smithi057 ceph-mon[92072]: pgmap v14750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:27 smithi122 ceph-mon[125440]: pgmap v14750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:38:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:29 smithi136 ceph-mon[125702]: pgmap v14751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:38:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:29 smithi057 ceph-mon[92072]: pgmap v14751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:38:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:29 smithi122 ceph-mon[125440]: pgmap v14751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:38:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:31 smithi136 ceph-mon[125702]: pgmap v14752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:31 smithi057 ceph-mon[92072]: pgmap v14752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:31 smithi122 ceph-mon[125440]: pgmap v14752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:33 smithi136 ceph-mon[125702]: pgmap v14753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:33 smithi057 ceph-mon[92072]: pgmap v14753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:33 smithi122 ceph-mon[125440]: pgmap v14753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:35 smithi136 ceph-mon[125702]: pgmap v14754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:35 smithi057 ceph-mon[92072]: pgmap v14754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:35 smithi122 ceph-mon[125440]: pgmap v14754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:37 smithi136 ceph-mon[125702]: pgmap v14755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:37 smithi057 ceph-mon[92072]: pgmap v14755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:37 smithi122 ceph-mon[125440]: pgmap v14755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:40.255+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:38:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:40.255+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:38:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:40.255+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:38:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:40.255+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:38:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:40.255+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:38:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:39 smithi136 ceph-mon[125702]: pgmap v14756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:39 smithi057 ceph-mon[92072]: pgmap v14756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:39 smithi122 ceph-mon[125440]: pgmap v14756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:41 smithi136 ceph-mon[125702]: pgmap v14757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:41 smithi057 ceph-mon[92072]: pgmap v14757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:41 smithi122 ceph-mon[125440]: pgmap v14757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:43 smithi136 ceph-mon[125702]: pgmap v14758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:43 smithi057 ceph-mon[92072]: pgmap v14758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:43 smithi122 ceph-mon[125440]: pgmap v14758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:46 smithi136 ceph-mon[125702]: pgmap v14759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:46 smithi057 ceph-mon[92072]: pgmap v14759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:46 smithi122 ceph-mon[125440]: pgmap v14759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:48 smithi136 ceph-mon[125702]: pgmap v14760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:48 smithi057 ceph-mon[92072]: pgmap v14760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:48 smithi122 ceph-mon[125440]: pgmap v14760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:50 smithi136 ceph-mon[125702]: pgmap v14761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:50 smithi057 ceph-mon[92072]: pgmap v14761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:50 smithi122 ceph-mon[125440]: pgmap v14761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:52 smithi136 ceph-mon[125702]: pgmap v14762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:52 smithi057 ceph-mon[92072]: pgmap v14762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:52 smithi122 ceph-mon[125440]: pgmap v14762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:54 smithi136 ceph-mon[125702]: pgmap v14763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:54 smithi057 ceph-mon[92072]: pgmap v14763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:54 smithi122 ceph-mon[125440]: pgmap v14763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:38:55.272 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:55.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:38:55.273 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:55.272+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:38:55.273 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:55.272+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:38:55.273 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:55.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:38:55.273 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:38:55.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:38:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:56 smithi136 ceph-mon[125702]: pgmap v14764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:56 smithi057 ceph-mon[92072]: pgmap v14764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:56 smithi122 ceph-mon[125440]: pgmap v14764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:38:58 smithi136 ceph-mon[125702]: pgmap v14765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:38:58 smithi057 ceph-mon[92072]: pgmap v14765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:38:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:38:58 smithi122 ceph-mon[125440]: pgmap v14765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:00 smithi136 ceph-mon[125702]: pgmap v14766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:00 smithi057 ceph-mon[92072]: pgmap v14766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:00 smithi122 ceph-mon[125440]: pgmap v14766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:02 smithi136 ceph-mon[125702]: pgmap v14767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:02 smithi057 ceph-mon[92072]: pgmap v14767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:02 smithi122 ceph-mon[125440]: pgmap v14767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:04 smithi136 ceph-mon[125702]: pgmap v14768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:39:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:04 smithi057 ceph-mon[92072]: pgmap v14768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:39:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:04 smithi122 ceph-mon[125440]: pgmap v14768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:39:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:06 smithi136 ceph-mon[125702]: pgmap v14769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:39:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:06 smithi057 ceph-mon[92072]: pgmap v14769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:39:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:06 smithi122 ceph-mon[125440]: pgmap v14769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:39:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:08 smithi136 ceph-mon[125702]: pgmap v14770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:39:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:08 smithi057 ceph-mon[92072]: pgmap v14770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:39:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:08 smithi122 ceph-mon[125440]: pgmap v14770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:39:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:10.275+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:39:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:10.275+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:39:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:10.275+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:39:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:10.275+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:39:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:10.275+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:39:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:10 smithi136 ceph-mon[125702]: pgmap v14771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:39:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:10 smithi057 ceph-mon[92072]: pgmap v14771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:39:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:10 smithi122 ceph-mon[125440]: pgmap v14771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:39:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:12 smithi136 ceph-mon[125702]: pgmap v14772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:39:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:12 smithi136 ceph-mon[125702]: osdmap e996: 12 total, 12 up, 12 in 2023-03-02T18:39:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:12 smithi057 ceph-mon[92072]: pgmap v14772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:39:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:12 smithi057 ceph-mon[92072]: osdmap e996: 12 total, 12 up, 12 in 2023-03-02T18:39:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:12 smithi122 ceph-mon[125440]: pgmap v14772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:39:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:12 smithi122 ceph-mon[125440]: osdmap e996: 12 total, 12 up, 12 in 2023-03-02T18:39:13.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:39:13.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:39:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:39:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:14 smithi057 ceph-mon[92072]: pgmap v14774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:39:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:39:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:39:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:14 smithi122 ceph-mon[125440]: pgmap v14774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:39:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:39:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:39:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:14 smithi136 ceph-mon[125702]: pgmap v14774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:39:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:39:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:39:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:39:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:16 smithi057 ceph-mon[92072]: pgmap v14775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:39:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:16 smithi122 ceph-mon[125440]: pgmap v14775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:39:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:16 smithi136 ceph-mon[125702]: pgmap v14775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:39:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:17 smithi122 ceph-mon[125440]: pgmap v14776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:39:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:17 smithi122 ceph-mon[125440]: osdmap e997: 12 total, 12 up, 12 in 2023-03-02T18:39:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:17 smithi136 ceph-mon[125702]: pgmap v14776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:39:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:17 smithi136 ceph-mon[125702]: osdmap e997: 12 total, 12 up, 12 in 2023-03-02T18:39:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:17 smithi057 ceph-mon[92072]: pgmap v14776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:39:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:17 smithi057 ceph-mon[92072]: osdmap e997: 12 total, 12 up, 12 in 2023-03-02T18:39:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:19 smithi122 ceph-mon[125440]: pgmap v14778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:39:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:19 smithi136 ceph-mon[125702]: pgmap v14778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:39:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:19 smithi057 ceph-mon[92072]: pgmap v14778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:39:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:21 smithi136 ceph-mon[125702]: pgmap v14779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T18:39:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:21 smithi057 ceph-mon[92072]: pgmap v14779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T18:39:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:21 smithi122 ceph-mon[125440]: pgmap v14779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T18:39:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:23 smithi136 ceph-mon[125702]: pgmap v14780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:39:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:23 smithi057 ceph-mon[92072]: pgmap v14780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:39:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:23 smithi122 ceph-mon[125440]: pgmap v14780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:39:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:25.286+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:39:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:25.286+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:39:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:25.286+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:39:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:25.286+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:39:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:25.286+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:39:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:25 smithi136 ceph-mon[125702]: pgmap v14781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:39:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:25 smithi057 ceph-mon[92072]: pgmap v14781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:39:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:25 smithi122 ceph-mon[125440]: pgmap v14781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:39:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:27 smithi136 ceph-mon[125702]: pgmap v14782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:39:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:27 smithi057 ceph-mon[92072]: pgmap v14782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:39:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:27 smithi122 ceph-mon[125440]: pgmap v14782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:39:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:29 smithi136 ceph-mon[125702]: pgmap v14783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:39:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:29 smithi057 ceph-mon[92072]: pgmap v14783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:39:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:29 smithi122 ceph-mon[125440]: pgmap v14783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:39:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:31 smithi136 ceph-mon[125702]: pgmap v14784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:31 smithi057 ceph-mon[92072]: pgmap v14784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:31 smithi122 ceph-mon[125440]: pgmap v14784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:33 smithi136 ceph-mon[125702]: pgmap v14785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:33 smithi057 ceph-mon[92072]: pgmap v14785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:33 smithi122 ceph-mon[125440]: pgmap v14785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:35 smithi136 ceph-mon[125702]: pgmap v14786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:39:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:35 smithi057 ceph-mon[92072]: pgmap v14786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:39:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:35 smithi122 ceph-mon[125440]: pgmap v14786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:39:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:37 smithi136 ceph-mon[125702]: pgmap v14787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:39:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:37 smithi057 ceph-mon[92072]: pgmap v14787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:39:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:37 smithi122 ceph-mon[125440]: pgmap v14787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:39:40.300 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:40.298+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:39:40.300 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:40.298+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:39:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:40.298+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:39:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:40.298+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:39:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:40.299+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:39:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:40 smithi136 ceph-mon[125702]: pgmap v14788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:40 smithi057 ceph-mon[92072]: pgmap v14788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:40 smithi122 ceph-mon[125440]: pgmap v14788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:42 smithi136 ceph-mon[125702]: pgmap v14789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:39:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:42 smithi057 ceph-mon[92072]: pgmap v14789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:39:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:42 smithi122 ceph-mon[125440]: pgmap v14789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:39:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:44 smithi136 ceph-mon[125702]: pgmap v14790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:44 smithi057 ceph-mon[92072]: pgmap v14790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:44 smithi122 ceph-mon[125440]: pgmap v14790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:46 smithi136 ceph-mon[125702]: pgmap v14791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:46 smithi057 ceph-mon[92072]: pgmap v14791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:46 smithi122 ceph-mon[125440]: pgmap v14791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:48 smithi136 ceph-mon[125702]: pgmap v14792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:48 smithi057 ceph-mon[92072]: pgmap v14792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:48 smithi122 ceph-mon[125440]: pgmap v14792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:50 smithi136 ceph-mon[125702]: pgmap v14793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:50 smithi057 ceph-mon[92072]: pgmap v14793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:50 smithi122 ceph-mon[125440]: pgmap v14793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:52 smithi136 ceph-mon[125702]: pgmap v14794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:52 smithi057 ceph-mon[92072]: pgmap v14794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:52 smithi122 ceph-mon[125440]: pgmap v14794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:54 smithi136 ceph-mon[125702]: pgmap v14795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:54 smithi057 ceph-mon[92072]: pgmap v14795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:54 smithi122 ceph-mon[125440]: pgmap v14795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:39:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:55.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:39:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:55.310+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:39:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:55.310+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:39:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:55.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:39:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:39:55.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:39:56.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:56 smithi136 ceph-mon[125702]: pgmap v14796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:56 smithi057 ceph-mon[92072]: pgmap v14796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:56 smithi122 ceph-mon[125440]: pgmap v14796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:39:58 smithi136 ceph-mon[125702]: pgmap v14797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:39:58 smithi057 ceph-mon[92072]: pgmap v14797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:39:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:39:58 smithi122 ceph-mon[125440]: pgmap v14797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:00 smithi136 ceph-mon[125702]: pgmap v14798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T18:40:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:00 smithi057 ceph-mon[92072]: pgmap v14798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T18:40:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:00 smithi122 ceph-mon[125440]: pgmap v14798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T18:40:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:02 smithi136 ceph-mon[125702]: pgmap v14799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:02 smithi057 ceph-mon[92072]: pgmap v14799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:02 smithi122 ceph-mon[125440]: pgmap v14799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:04 smithi136 ceph-mon[125702]: pgmap v14800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:40:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:04 smithi057 ceph-mon[92072]: pgmap v14800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:40:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:04 smithi122 ceph-mon[125440]: pgmap v14800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:40:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:06 smithi136 ceph-mon[125702]: pgmap v14801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:40:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:06 smithi057 ceph-mon[92072]: pgmap v14801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:40:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:06 smithi122 ceph-mon[125440]: pgmap v14801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:40:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:07 smithi136 ceph-mon[125702]: osdmap e998: 12 total, 12 up, 12 in 2023-03-02T18:40:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:07 smithi057 ceph-mon[92072]: osdmap e998: 12 total, 12 up, 12 in 2023-03-02T18:40:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:07 smithi122 ceph-mon[125440]: osdmap e998: 12 total, 12 up, 12 in 2023-03-02T18:40:08.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:08 smithi136 ceph-mon[125702]: pgmap v14803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:40:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:08 smithi057 ceph-mon[92072]: pgmap v14803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:40:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:08 smithi122 ceph-mon[125440]: pgmap v14803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:40:10.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:10.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:40:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:10.319+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:40:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:10.319+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:40:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:10.319+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:40:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:10.319+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:40:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:10 smithi057 ceph-mon[92072]: pgmap v14804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:40:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:10 smithi122 ceph-mon[125440]: pgmap v14804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:40:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:10 smithi136 ceph-mon[125702]: pgmap v14804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:40:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:12 smithi057 ceph-mon[92072]: pgmap v14805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:40:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:12 smithi057 ceph-mon[92072]: osdmap e999: 12 total, 12 up, 12 in 2023-03-02T18:40:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:12 smithi122 ceph-mon[125440]: pgmap v14805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:40:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:12 smithi122 ceph-mon[125440]: osdmap e999: 12 total, 12 up, 12 in 2023-03-02T18:40:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:12 smithi136 ceph-mon[125702]: pgmap v14805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:40:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:12 smithi136 ceph-mon[125702]: osdmap e999: 12 total, 12 up, 12 in 2023-03-02T18:40:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:14 smithi057 ceph-mon[92072]: pgmap v14807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:40:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:40:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:14 smithi122 ceph-mon[125440]: pgmap v14807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:40:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:40:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:14 smithi136 ceph-mon[125702]: pgmap v14807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:40:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:40:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:16 smithi057 ceph-mon[92072]: pgmap v14808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T18:40:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:16 smithi122 ceph-mon[125440]: pgmap v14808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T18:40:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:16 smithi136 ceph-mon[125702]: pgmap v14808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T18:40:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: pgmap v14809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:40:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:40:18.098 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:40:18.098 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: pgmap v14809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:40:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:40:18.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:40:18.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: pgmap v14809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:40:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:40:18.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:40:18.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:40:18.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:40:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:18 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:40:19.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:18 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:40:19.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:18 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:40:19.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:18 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:40:19.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:18 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:40:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:18 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:40:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:18 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:40:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:18 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:40:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:18 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:40:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:18 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:40:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:18 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:40:19.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:18 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:40:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:19 smithi136 ceph-mon[125702]: pgmap v14810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:40:20.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:19 smithi057 ceph-mon[92072]: pgmap v14810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:40:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:19 smithi122 ceph-mon[125440]: pgmap v14810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:40:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:21 smithi136 ceph-mon[125702]: pgmap v14811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:40:22.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:21 smithi057 ceph-mon[92072]: pgmap v14811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:40:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:21 smithi122 ceph-mon[125440]: pgmap v14811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:40:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:23 smithi136 ceph-mon[125702]: pgmap v14812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:40:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:23 smithi057 ceph-mon[92072]: pgmap v14812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:40:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:23 smithi122 ceph-mon[125440]: pgmap v14812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:40:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:25.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:40:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:25.321+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:40:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:25.321+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:40:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:25.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:40:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:25.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:40:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:25 smithi136 ceph-mon[125702]: pgmap v14813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:25 smithi057 ceph-mon[92072]: pgmap v14813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:25 smithi122 ceph-mon[125440]: pgmap v14813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:27 smithi136 ceph-mon[125702]: pgmap v14814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:27 smithi057 ceph-mon[92072]: pgmap v14814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:27 smithi122 ceph-mon[125440]: pgmap v14814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:29 smithi136 ceph-mon[125702]: pgmap v14815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:29 smithi057 ceph-mon[92072]: pgmap v14815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:29 smithi122 ceph-mon[125440]: pgmap v14815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:31 smithi136 ceph-mon[125702]: pgmap v14816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:31 smithi057 ceph-mon[92072]: pgmap v14816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:31 smithi122 ceph-mon[125440]: pgmap v14816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:33 smithi136 ceph-mon[125702]: pgmap v14817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:33 smithi057 ceph-mon[92072]: pgmap v14817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:33 smithi122 ceph-mon[125440]: pgmap v14817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:35 smithi136 ceph-mon[125702]: pgmap v14818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:35 smithi057 ceph-mon[92072]: pgmap v14818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:35 smithi122 ceph-mon[125440]: pgmap v14818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:38 smithi136 ceph-mon[125702]: pgmap v14819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:38 smithi057 ceph-mon[92072]: pgmap v14819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:38 smithi122 ceph-mon[125440]: pgmap v14819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:40.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:40:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:40.336+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:40:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:40.336+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:40:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:40.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:40:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:40.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:40:40.339 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:40 smithi136 ceph-mon[125702]: pgmap v14820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:40 smithi057 ceph-mon[92072]: pgmap v14820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:40 smithi122 ceph-mon[125440]: pgmap v14820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:42 smithi136 ceph-mon[125702]: pgmap v14821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:42 smithi057 ceph-mon[92072]: pgmap v14821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:42 smithi122 ceph-mon[125440]: pgmap v14821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:44 smithi136 ceph-mon[125702]: pgmap v14822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:44 smithi057 ceph-mon[92072]: pgmap v14822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:44 smithi122 ceph-mon[125440]: pgmap v14822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:46 smithi136 ceph-mon[125702]: pgmap v14823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:46 smithi057 ceph-mon[92072]: pgmap v14823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:46 smithi122 ceph-mon[125440]: pgmap v14823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:48 smithi136 ceph-mon[125702]: pgmap v14824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:48 smithi057 ceph-mon[92072]: pgmap v14824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:48 smithi122 ceph-mon[125440]: pgmap v14824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:50 smithi136 ceph-mon[125702]: pgmap v14825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:50 smithi057 ceph-mon[92072]: pgmap v14825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:50 smithi122 ceph-mon[125440]: pgmap v14825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:52 smithi136 ceph-mon[125702]: pgmap v14826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:52 smithi057 ceph-mon[92072]: pgmap v14826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:52 smithi122 ceph-mon[125440]: pgmap v14826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:54 smithi136 ceph-mon[125702]: pgmap v14827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:54 smithi057 ceph-mon[92072]: pgmap v14827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:54 smithi122 ceph-mon[125440]: pgmap v14827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:40:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:55.350+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:40:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:55.351+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:40:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:55.351+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:40:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:55.351+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:40:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:40:55.351+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:40:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:56 smithi136 ceph-mon[125702]: pgmap v14828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:56 smithi057 ceph-mon[92072]: pgmap v14828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:56 smithi122 ceph-mon[125440]: pgmap v14828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:40:58 smithi136 ceph-mon[125702]: pgmap v14829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:40:58 smithi057 ceph-mon[92072]: pgmap v14829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:40:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:40:58 smithi122 ceph-mon[125440]: pgmap v14829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:00 smithi136 ceph-mon[125702]: pgmap v14830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:00 smithi057 ceph-mon[92072]: pgmap v14830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:00 smithi122 ceph-mon[125440]: pgmap v14830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:02 smithi136 ceph-mon[125702]: pgmap v14831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:02 smithi057 ceph-mon[92072]: pgmap v14831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:02 smithi122 ceph-mon[125440]: pgmap v14831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:04 smithi136 ceph-mon[125702]: pgmap v14832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:41:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:04 smithi057 ceph-mon[92072]: pgmap v14832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:41:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:04 smithi122 ceph-mon[125440]: pgmap v14832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:41:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:06 smithi136 ceph-mon[125702]: pgmap v14833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:41:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:06 smithi057 ceph-mon[92072]: pgmap v14833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:41:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:06 smithi122 ceph-mon[125440]: pgmap v14833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:41:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:07 smithi057 ceph-mon[92072]: osdmap e1000: 12 total, 12 up, 12 in 2023-03-02T18:41:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:07 smithi122 ceph-mon[125440]: osdmap e1000: 12 total, 12 up, 12 in 2023-03-02T18:41:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:07 smithi136 ceph-mon[125702]: osdmap e1000: 12 total, 12 up, 12 in 2023-03-02T18:41:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:08 smithi057 ceph-mon[92072]: pgmap v14835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:41:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:08 smithi122 ceph-mon[125440]: pgmap v14835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:41:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:08 smithi136 ceph-mon[125702]: pgmap v14835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:41:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:10.356+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:41:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:10.356+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:41:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:10.356+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:41:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:10.356+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:41:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:10.356+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:41:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:10 smithi057 ceph-mon[92072]: pgmap v14836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:41:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:10 smithi122 ceph-mon[125440]: pgmap v14836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:41:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:10 smithi136 ceph-mon[125702]: pgmap v14836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:41:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:12.373+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:41:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:12.373+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:41:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:12.374+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 215 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T18:41:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:12.374+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:41:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:12.374+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 214 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T18:41:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:12.374+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:41:12.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:12.374+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 216 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:41:12.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:12.374+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 215 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:41:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:12 smithi057 ceph-mon[92072]: pgmap v14837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:41:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:12 smithi057 ceph-mon[92072]: osdmap e1001: 12 total, 12 up, 12 in 2023-03-02T18:41:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:12 smithi122 ceph-mon[125440]: pgmap v14837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:41:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:12 smithi122 ceph-mon[125440]: osdmap e1001: 12 total, 12 up, 12 in 2023-03-02T18:41:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:12 smithi136 ceph-mon[125702]: pgmap v14837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:41:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:12 smithi136 ceph-mon[125702]: osdmap e1001: 12 total, 12 up, 12 in 2023-03-02T18:41:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:14 smithi057 ceph-mon[92072]: pgmap v14839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:41:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:14 smithi122 ceph-mon[125440]: pgmap v14839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:41:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:14 smithi136 ceph-mon[125702]: pgmap v14839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:41:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:16 smithi057 ceph-mon[92072]: pgmap v14840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T18:41:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:16 smithi122 ceph-mon[125440]: pgmap v14840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T18:41:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:16 smithi136 ceph-mon[125702]: pgmap v14840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T18:41:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:18 smithi057 ceph-mon[92072]: pgmap v14841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:41:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:41:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:18 smithi122 ceph-mon[125440]: pgmap v14841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:41:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:41:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:18 smithi136 ceph-mon[125702]: pgmap v14841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:41:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:41:19.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:41:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:41:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:41:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:41:19.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:41:19.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:41:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:41:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:41:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:41:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:20 smithi057 ceph-mon[92072]: pgmap v14842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:41:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:20 smithi122 ceph-mon[125440]: pgmap v14842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:41:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:20 smithi136 ceph-mon[125702]: pgmap v14842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:41:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:22 smithi057 ceph-mon[92072]: pgmap v14843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:41:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:22 smithi122 ceph-mon[125440]: pgmap v14843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:41:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:22 smithi136 ceph-mon[125702]: pgmap v14843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:41:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:24 smithi057 ceph-mon[92072]: pgmap v14844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:41:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:24 smithi122 ceph-mon[125440]: pgmap v14844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:41:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:24 smithi136 ceph-mon[125702]: pgmap v14844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:41:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:25.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:41:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:25.372+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:41:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:25.372+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:41:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:25.372+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:41:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:25.372+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:41:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:26 smithi057 ceph-mon[92072]: pgmap v14845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:26 smithi122 ceph-mon[125440]: pgmap v14845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:26 smithi136 ceph-mon[125702]: pgmap v14845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:28 smithi057 ceph-mon[92072]: pgmap v14846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:28 smithi122 ceph-mon[125440]: pgmap v14846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:28 smithi136 ceph-mon[125702]: pgmap v14846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:30 smithi057 ceph-mon[92072]: pgmap v14847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:30 smithi122 ceph-mon[125440]: pgmap v14847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:30 smithi136 ceph-mon[125702]: pgmap v14847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:31 smithi057 ceph-mon[92072]: pgmap v14848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:31 smithi122 ceph-mon[125440]: pgmap v14848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:31 smithi136 ceph-mon[125702]: pgmap v14848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:33 smithi136 ceph-mon[125702]: pgmap v14849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:33 smithi057 ceph-mon[92072]: pgmap v14849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:33 smithi122 ceph-mon[125440]: pgmap v14849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:35 smithi136 ceph-mon[125702]: pgmap v14850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:35 smithi057 ceph-mon[92072]: pgmap v14850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:35 smithi122 ceph-mon[125440]: pgmap v14850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:37 smithi136 ceph-mon[125702]: pgmap v14851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:37 smithi057 ceph-mon[92072]: pgmap v14851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:37 smithi122 ceph-mon[125440]: pgmap v14851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:40.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:40 smithi136 ceph-mon[125702]: pgmap v14852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:40.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:41:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:40.378+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:41:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:40.378+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:41:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:40.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:41:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:40.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:41:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:40 smithi057 ceph-mon[92072]: pgmap v14852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:40 smithi122 ceph-mon[125440]: pgmap v14852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:42.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:42 smithi136 ceph-mon[125702]: pgmap v14853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:42 smithi057 ceph-mon[92072]: pgmap v14853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:42 smithi122 ceph-mon[125440]: pgmap v14853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:44 smithi136 ceph-mon[125702]: pgmap v14854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:44 smithi057 ceph-mon[92072]: pgmap v14854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:44 smithi122 ceph-mon[125440]: pgmap v14854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:46 smithi136 ceph-mon[125702]: pgmap v14855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:46 smithi057 ceph-mon[92072]: pgmap v14855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:46 smithi122 ceph-mon[125440]: pgmap v14855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:48 smithi136 ceph-mon[125702]: pgmap v14856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:48 smithi057 ceph-mon[92072]: pgmap v14856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:48.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:48 smithi122 ceph-mon[125440]: pgmap v14856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:50 smithi136 ceph-mon[125702]: pgmap v14857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:50 smithi057 ceph-mon[92072]: pgmap v14857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:50 smithi122 ceph-mon[125440]: pgmap v14857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:52 smithi136 ceph-mon[125702]: pgmap v14858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:52 smithi057 ceph-mon[92072]: pgmap v14858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:52 smithi122 ceph-mon[125440]: pgmap v14858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:54 smithi136 ceph-mon[125702]: pgmap v14859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:54 smithi057 ceph-mon[92072]: pgmap v14859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:54 smithi122 ceph-mon[125440]: pgmap v14859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:41:55.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:55.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:41:55.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:55.385+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:41:55.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:55.385+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:41:55.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:55.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:41:55.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:41:55.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:41:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:56 smithi136 ceph-mon[125702]: pgmap v14860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:56 smithi057 ceph-mon[92072]: pgmap v14860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:56 smithi122 ceph-mon[125440]: pgmap v14860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:41:58 smithi136 ceph-mon[125702]: pgmap v14861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:41:58 smithi057 ceph-mon[92072]: pgmap v14861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:41:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:41:58 smithi122 ceph-mon[125440]: pgmap v14861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:00 smithi136 ceph-mon[125702]: pgmap v14862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:00 smithi057 ceph-mon[92072]: pgmap v14862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:00 smithi122 ceph-mon[125440]: pgmap v14862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:02 smithi136 ceph-mon[125702]: pgmap v14863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:02 smithi057 ceph-mon[92072]: pgmap v14863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:02 smithi122 ceph-mon[125440]: pgmap v14863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:04 smithi136 ceph-mon[125702]: pgmap v14864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:42:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:04 smithi057 ceph-mon[92072]: pgmap v14864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:42:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:04 smithi122 ceph-mon[125440]: pgmap v14864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:42:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:06 smithi136 ceph-mon[125702]: pgmap v14865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:42:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:06 smithi057 ceph-mon[92072]: pgmap v14865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:42:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:06 smithi122 ceph-mon[125440]: pgmap v14865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:42:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:07 smithi057 ceph-mon[92072]: osdmap e1002: 12 total, 12 up, 12 in 2023-03-02T18:42:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:07 smithi122 ceph-mon[125440]: osdmap e1002: 12 total, 12 up, 12 in 2023-03-02T18:42:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:07 smithi136 ceph-mon[125702]: osdmap e1002: 12 total, 12 up, 12 in 2023-03-02T18:42:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:08 smithi057 ceph-mon[92072]: pgmap v14867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 29 op/s 2023-03-02T18:42:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:08 smithi122 ceph-mon[125440]: pgmap v14867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 29 op/s 2023-03-02T18:42:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:08 smithi136 ceph-mon[125702]: pgmap v14867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 29 op/s 2023-03-02T18:42:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:10.399+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:42:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:10.400+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:42:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:10.400+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:42:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:10.400+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:42:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:10.400+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:42:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:10 smithi057 ceph-mon[92072]: pgmap v14868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:42:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:10 smithi122 ceph-mon[125440]: pgmap v14868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:42:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:10 smithi136 ceph-mon[125702]: pgmap v14868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:42:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:12 smithi057 ceph-mon[92072]: pgmap v14869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:42:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:12 smithi057 ceph-mon[92072]: osdmap e1003: 12 total, 12 up, 12 in 2023-03-02T18:42:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:12 smithi122 ceph-mon[125440]: pgmap v14869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:42:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:12 smithi122 ceph-mon[125440]: osdmap e1003: 12 total, 12 up, 12 in 2023-03-02T18:42:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:12 smithi136 ceph-mon[125702]: pgmap v14869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:42:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:12 smithi136 ceph-mon[125702]: osdmap e1003: 12 total, 12 up, 12 in 2023-03-02T18:42:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:14 smithi057 ceph-mon[92072]: pgmap v14871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:42:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:14 smithi122 ceph-mon[125440]: pgmap v14871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:42:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:14 smithi136 ceph-mon[125702]: pgmap v14871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:42:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:16 smithi057 ceph-mon[92072]: pgmap v14872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T18:42:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:16 smithi122 ceph-mon[125440]: pgmap v14872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T18:42:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:16 smithi136 ceph-mon[125702]: pgmap v14872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T18:42:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:18 smithi057 ceph-mon[92072]: pgmap v14873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:42:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:18 smithi122 ceph-mon[125440]: pgmap v14873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:42:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:18 smithi136 ceph-mon[125702]: pgmap v14873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:42:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:42:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:42:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:42:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:20 smithi057 ceph-mon[92072]: pgmap v14874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:42:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:42:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:42:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:42:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:42:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:42:20.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:20 smithi122 ceph-mon[125440]: pgmap v14874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:42:20.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:42:20.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:42:20.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:42:20.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:42:20.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:42:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:20 smithi136 ceph-mon[125702]: pgmap v14874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:42:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:42:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:42:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:42:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:42:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:42:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:22 smithi057 ceph-mon[92072]: pgmap v14875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:42:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:22 smithi122 ceph-mon[125440]: pgmap v14875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:42:22.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:22 smithi136 ceph-mon[125702]: pgmap v14875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:42:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:24 smithi057 ceph-mon[92072]: pgmap v14876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:42:24.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:24 smithi122 ceph-mon[125440]: pgmap v14876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:42:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:24 smithi136 ceph-mon[125702]: pgmap v14876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:42:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:25.413+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:42:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:25.413+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:42:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:25.413+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:42:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:25.413+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:42:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:25.413+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:42:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:26 smithi057 ceph-mon[92072]: pgmap v14877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:26 smithi122 ceph-mon[125440]: pgmap v14877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:26 smithi136 ceph-mon[125702]: pgmap v14877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:28 smithi057 ceph-mon[92072]: pgmap v14878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:42:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:28 smithi122 ceph-mon[125440]: pgmap v14878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:42:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:28 smithi136 ceph-mon[125702]: pgmap v14878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:42:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:30 smithi057 ceph-mon[92072]: pgmap v14879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:42:30.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:30 smithi122 ceph-mon[125440]: pgmap v14879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:42:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:30 smithi136 ceph-mon[125702]: pgmap v14879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:42:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:31 smithi136 ceph-mon[125702]: pgmap v14880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:31 smithi057 ceph-mon[92072]: pgmap v14880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:31 smithi122 ceph-mon[125440]: pgmap v14880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:34 smithi136 ceph-mon[125702]: pgmap v14881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:34 smithi057 ceph-mon[92072]: pgmap v14881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:34 smithi122 ceph-mon[125440]: pgmap v14881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:36 smithi136 ceph-mon[125702]: pgmap v14882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:36 smithi057 ceph-mon[92072]: pgmap v14882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:36 smithi122 ceph-mon[125440]: pgmap v14882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:38 smithi136 ceph-mon[125702]: pgmap v14883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:42:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:38 smithi057 ceph-mon[92072]: pgmap v14883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:42:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:38 smithi122 ceph-mon[125440]: pgmap v14883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:42:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:40 smithi136 ceph-mon[125702]: pgmap v14884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:42:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:40.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:42:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:40.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:42:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:40.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:42:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:40.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:42:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:40.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:42:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:40 smithi057 ceph-mon[92072]: pgmap v14884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:42:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:40 smithi122 ceph-mon[125440]: pgmap v14884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:42:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:42 smithi136 ceph-mon[125702]: pgmap v14885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:42 smithi057 ceph-mon[92072]: pgmap v14885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:42 smithi122 ceph-mon[125440]: pgmap v14885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:44 smithi136 ceph-mon[125702]: pgmap v14886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:44 smithi057 ceph-mon[92072]: pgmap v14886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:44 smithi122 ceph-mon[125440]: pgmap v14886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:46 smithi136 ceph-mon[125702]: pgmap v14887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:46 smithi057 ceph-mon[92072]: pgmap v14887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:46 smithi122 ceph-mon[125440]: pgmap v14887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:48 smithi136 ceph-mon[125702]: pgmap v14888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:42:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:48 smithi057 ceph-mon[92072]: pgmap v14888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:42:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:48 smithi122 ceph-mon[125440]: pgmap v14888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:42:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:50 smithi136 ceph-mon[125702]: pgmap v14889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:42:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:50 smithi057 ceph-mon[92072]: pgmap v14889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:42:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:50 smithi122 ceph-mon[125440]: pgmap v14889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:42:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:52 smithi136 ceph-mon[125702]: pgmap v14890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:52 smithi057 ceph-mon[92072]: pgmap v14890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:52 smithi122 ceph-mon[125440]: pgmap v14890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:54 smithi136 ceph-mon[125702]: pgmap v14891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:54 smithi057 ceph-mon[92072]: pgmap v14891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:54 smithi122 ceph-mon[125440]: pgmap v14891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:42:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:55.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:42:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:55.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:42:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:55.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:42:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:55.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:42:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:42:55.427+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:42:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:56 smithi136 ceph-mon[125702]: pgmap v14892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:56 smithi057 ceph-mon[92072]: pgmap v14892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:56 smithi122 ceph-mon[125440]: pgmap v14892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:42:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:42:58 smithi057 ceph-mon[92072]: pgmap v14893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:42:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:42:58 smithi122 ceph-mon[125440]: pgmap v14893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:42:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:42:58 smithi136 ceph-mon[125702]: pgmap v14893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:43:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:00 smithi057 ceph-mon[92072]: pgmap v14894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:43:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:00 smithi122 ceph-mon[125440]: pgmap v14894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:43:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:00 smithi136 ceph-mon[125702]: pgmap v14894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:43:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:02 smithi057 ceph-mon[92072]: pgmap v14895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:02 smithi122 ceph-mon[125440]: pgmap v14895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:02 smithi136 ceph-mon[125702]: pgmap v14895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:04 smithi057 ceph-mon[92072]: pgmap v14896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:43:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:04 smithi122 ceph-mon[125440]: pgmap v14896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:43:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:04 smithi136 ceph-mon[125702]: pgmap v14896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:43:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:06 smithi057 ceph-mon[92072]: pgmap v14897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:43:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:06 smithi122 ceph-mon[125440]: pgmap v14897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:43:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:06 smithi136 ceph-mon[125702]: pgmap v14897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:43:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:07 smithi057 ceph-mon[92072]: osdmap e1004: 12 total, 12 up, 12 in 2023-03-02T18:43:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:07 smithi122 ceph-mon[125440]: osdmap e1004: 12 total, 12 up, 12 in 2023-03-02T18:43:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:07 smithi136 ceph-mon[125702]: osdmap e1004: 12 total, 12 up, 12 in 2023-03-02T18:43:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:08 smithi057 ceph-mon[92072]: pgmap v14899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:43:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:08 smithi122 ceph-mon[125440]: pgmap v14899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:43:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:08 smithi136 ceph-mon[125702]: pgmap v14899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:43:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:10 smithi057 ceph-mon[92072]: pgmap v14900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:43:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:10.443+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:43:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:10.444+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:43:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:10.444+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:43:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:10.444+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:43:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:10.444+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:43:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:10 smithi122 ceph-mon[125440]: pgmap v14900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:43:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:10 smithi136 ceph-mon[125702]: pgmap v14900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:43:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:12 smithi057 ceph-mon[92072]: pgmap v14901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:43:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:12 smithi122 ceph-mon[125440]: pgmap v14901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:43:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:12 smithi136 ceph-mon[125702]: pgmap v14901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:43:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:14 smithi057 ceph-mon[92072]: pgmap v14902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:43:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:14 smithi122 ceph-mon[125440]: pgmap v14902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:43:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:14 smithi136 ceph-mon[125702]: pgmap v14902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:43:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:16 smithi057 ceph-mon[92072]: pgmap v14903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:43:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:16 smithi122 ceph-mon[125440]: pgmap v14903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:43:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:16 smithi136 ceph-mon[125702]: pgmap v14903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:43:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:18 smithi136 ceph-mon[125702]: pgmap v14904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 193 B/s wr, 11 op/s 2023-03-02T18:43:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:18 smithi136 ceph-mon[125702]: osdmap e1005: 12 total, 12 up, 12 in 2023-03-02T18:43:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:18 smithi057 ceph-mon[92072]: pgmap v14904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 193 B/s wr, 11 op/s 2023-03-02T18:43:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:18 smithi057 ceph-mon[92072]: osdmap e1005: 12 total, 12 up, 12 in 2023-03-02T18:43:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:18 smithi122 ceph-mon[125440]: pgmap v14904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 193 B/s wr, 11 op/s 2023-03-02T18:43:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:18 smithi122 ceph-mon[125440]: osdmap e1005: 12 total, 12 up, 12 in 2023-03-02T18:43:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:20 smithi136 ceph-mon[125702]: pgmap v14906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:43:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:20 smithi057 ceph-mon[92072]: pgmap v14906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:43:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:20 smithi122 ceph-mon[125440]: pgmap v14906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:43:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:43:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:21.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:21.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:43:21.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:43:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:22 smithi136 ceph-mon[125702]: pgmap v14907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:43:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:43:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:43:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:22 smithi057 ceph-mon[92072]: pgmap v14907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:43:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:43:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:43:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:22 smithi122 ceph-mon[125440]: pgmap v14907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:43:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:43:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:43:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:43:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:24 smithi136 ceph-mon[125702]: pgmap v14908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:43:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:24 smithi057 ceph-mon[92072]: pgmap v14908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:43:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:24 smithi122 ceph-mon[125440]: pgmap v14908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:43:25.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:25.456+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:43:25.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:25.457+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:43:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:25.457+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:43:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:25.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:43:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:25.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:43:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:26 smithi136 ceph-mon[125702]: pgmap v14909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:43:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:26 smithi057 ceph-mon[92072]: pgmap v14909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:43:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:26 smithi122 ceph-mon[125440]: pgmap v14909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:43:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:28 smithi136 ceph-mon[125702]: pgmap v14910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:43:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:28 smithi057 ceph-mon[92072]: pgmap v14910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:43:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:28 smithi122 ceph-mon[125440]: pgmap v14910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:43:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:30 smithi136 ceph-mon[125702]: pgmap v14911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:43:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:30 smithi057 ceph-mon[92072]: pgmap v14911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:43:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:30 smithi122 ceph-mon[125440]: pgmap v14911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:43:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:32 smithi136 ceph-mon[125702]: pgmap v14912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:32 smithi057 ceph-mon[92072]: pgmap v14912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:32 smithi122 ceph-mon[125440]: pgmap v14912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:34 smithi136 ceph-mon[125702]: pgmap v14913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:43:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:34 smithi057 ceph-mon[92072]: pgmap v14913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:43:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:34 smithi122 ceph-mon[125440]: pgmap v14913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:43:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:36 smithi136 ceph-mon[125702]: pgmap v14914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:36 smithi057 ceph-mon[92072]: pgmap v14914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:36 smithi122 ceph-mon[125440]: pgmap v14914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:38 smithi136 ceph-mon[125702]: pgmap v14915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:43:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:38 smithi057 ceph-mon[92072]: pgmap v14915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:43:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:38 smithi122 ceph-mon[125440]: pgmap v14915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:43:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:40 smithi136 ceph-mon[125702]: pgmap v14916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:43:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:40 smithi057 ceph-mon[92072]: pgmap v14916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:43:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:40 smithi122 ceph-mon[125440]: pgmap v14916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:43:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:40.458+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:43:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:40.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:43:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:40.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:43:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:40.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:43:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:40.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:43:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:42 smithi136 ceph-mon[125702]: pgmap v14917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:42 smithi057 ceph-mon[92072]: pgmap v14917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:42 smithi122 ceph-mon[125440]: pgmap v14917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:44 smithi057 ceph-mon[92072]: pgmap v14918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:43:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:44 smithi122 ceph-mon[125440]: pgmap v14918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:43:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:44 smithi136 ceph-mon[125702]: pgmap v14918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:43:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:46 smithi057 ceph-mon[92072]: pgmap v14919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:46 smithi122 ceph-mon[125440]: pgmap v14919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:46 smithi136 ceph-mon[125702]: pgmap v14919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:48 smithi057 ceph-mon[92072]: pgmap v14920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:43:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:48 smithi122 ceph-mon[125440]: pgmap v14920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:43:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:48 smithi136 ceph-mon[125702]: pgmap v14920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:43:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:50 smithi057 ceph-mon[92072]: pgmap v14921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:43:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:50 smithi122 ceph-mon[125440]: pgmap v14921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:43:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:50 smithi136 ceph-mon[125702]: pgmap v14921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:43:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:52 smithi057 ceph-mon[92072]: pgmap v14922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:52 smithi122 ceph-mon[125440]: pgmap v14922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:52 smithi136 ceph-mon[125702]: pgmap v14922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:54 smithi057 ceph-mon[92072]: pgmap v14923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:43:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:54 smithi122 ceph-mon[125440]: pgmap v14923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:43:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:54 smithi136 ceph-mon[125702]: pgmap v14923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:43:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:55.463+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:43:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:55.464+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:43:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:55.464+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:43:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:55.464+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:43:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:43:55.464+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:43:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:56 smithi057 ceph-mon[92072]: pgmap v14924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:56 smithi122 ceph-mon[125440]: pgmap v14924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:56 smithi136 ceph-mon[125702]: pgmap v14924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:43:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:43:58 smithi057 ceph-mon[92072]: pgmap v14925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:43:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:43:58 smithi122 ceph-mon[125440]: pgmap v14925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:43:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:43:58 smithi136 ceph-mon[125702]: pgmap v14925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:44:00.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:00 smithi057 ceph-mon[92072]: pgmap v14926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:44:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:00 smithi122 ceph-mon[125440]: pgmap v14926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:44:00.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:00 smithi136 ceph-mon[125702]: pgmap v14926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:44:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:02 smithi057 ceph-mon[92072]: pgmap v14927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:02 smithi122 ceph-mon[125440]: pgmap v14927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:02 smithi136 ceph-mon[125702]: pgmap v14927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:04 smithi057 ceph-mon[92072]: pgmap v14928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:44:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:04 smithi122 ceph-mon[125440]: pgmap v14928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:44:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:04 smithi136 ceph-mon[125702]: pgmap v14928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:44:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:06 smithi057 ceph-mon[92072]: pgmap v14929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:44:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:06 smithi122 ceph-mon[125440]: pgmap v14929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:44:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:06 smithi136 ceph-mon[125702]: pgmap v14929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:44:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:07 smithi057 ceph-mon[92072]: osdmap e1006: 12 total, 12 up, 12 in 2023-03-02T18:44:07.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:07 smithi122 ceph-mon[125440]: osdmap e1006: 12 total, 12 up, 12 in 2023-03-02T18:44:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:07 smithi136 ceph-mon[125702]: osdmap e1006: 12 total, 12 up, 12 in 2023-03-02T18:44:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:08.421+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T18:44:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:08.421+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T18:44:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:08.421+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870098000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:44:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:08.421+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870098000 comp rx=0 tx=0).stop 2023-03-02T18:44:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:08.421+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T18:44:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:08.421+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T18:44:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:08.421+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T18:44:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:08.421+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T18:44:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:08.421+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:44:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:08.421+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5870019780 tx=0x7f58700b9000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T18:44:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:08 smithi057 ceph-mon[92072]: pgmap v14931: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:44:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:08 smithi122 ceph-mon[125440]: pgmap v14931: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:44:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:08 smithi136 ceph-mon[125702]: pgmap v14931: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:44:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:10 smithi057 ceph-mon[92072]: pgmap v14932: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:44:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:10 smithi122 ceph-mon[125440]: pgmap v14932: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:44:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:10.480+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:44:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:10.481+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:44:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:10.481+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:44:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:10.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:44:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:10.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:44:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:10 smithi136 ceph-mon[125702]: pgmap v14932: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:44:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:12.401+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:44:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:12.401+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:44:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:12.402+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 216 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:44:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:12.402+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 217 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:44:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:12 smithi057 ceph-mon[92072]: pgmap v14933: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:44:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:12 smithi122 ceph-mon[125440]: pgmap v14933: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:44:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:12 smithi136 ceph-mon[125702]: pgmap v14933: 97 pgs: 8 active+clean+snaptrim_wait, 89 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:44:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:14 smithi057 ceph-mon[92072]: pgmap v14934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:44:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:14 smithi122 ceph-mon[125440]: pgmap v14934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:44:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:14 smithi136 ceph-mon[125702]: pgmap v14934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:44:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:16 smithi122 ceph-mon[125440]: pgmap v14935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:44:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:16 smithi136 ceph-mon[125702]: pgmap v14935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:44:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:16 smithi057 ceph-mon[92072]: pgmap v14935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:44:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:18 smithi136 ceph-mon[125702]: pgmap v14936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 193 B/s wr, 11 op/s 2023-03-02T18:44:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:18 smithi136 ceph-mon[125702]: osdmap e1007: 12 total, 12 up, 12 in 2023-03-02T18:44:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:18 smithi057 ceph-mon[92072]: pgmap v14936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 193 B/s wr, 11 op/s 2023-03-02T18:44:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:18 smithi057 ceph-mon[92072]: osdmap e1007: 12 total, 12 up, 12 in 2023-03-02T18:44:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:18 smithi122 ceph-mon[125440]: pgmap v14936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 193 B/s wr, 11 op/s 2023-03-02T18:44:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:18 smithi122 ceph-mon[125440]: osdmap e1007: 12 total, 12 up, 12 in 2023-03-02T18:44:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:20 smithi136 ceph-mon[125702]: pgmap v14938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:44:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:20 smithi057 ceph-mon[92072]: pgmap v14938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:44:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:20 smithi122 ceph-mon[125440]: pgmap v14938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:44:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:22 smithi136 ceph-mon[125702]: pgmap v14939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:44:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:44:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:22 smithi057 ceph-mon[92072]: pgmap v14939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:44:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:44:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:22 smithi122 ceph-mon[125440]: pgmap v14939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:44:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:44:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:44:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:44:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:44:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:44:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:44:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:44:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:44:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:44:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:44:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:24 smithi136 ceph-mon[125702]: pgmap v14940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T18:44:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:24 smithi057 ceph-mon[92072]: pgmap v14940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T18:44:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:24 smithi122 ceph-mon[125440]: pgmap v14940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T18:44:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:25.491+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:44:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:25.491+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:44:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:25.491+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:44:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:25.491+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:44:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:25.491+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:44:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:26 smithi136 ceph-mon[125702]: pgmap v14941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T18:44:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:26 smithi057 ceph-mon[92072]: pgmap v14941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T18:44:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:26 smithi122 ceph-mon[125440]: pgmap v14941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T18:44:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:28 smithi136 ceph-mon[125702]: pgmap v14942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-02T18:44:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:28 smithi057 ceph-mon[92072]: pgmap v14942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-02T18:44:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:28 smithi122 ceph-mon[125440]: pgmap v14942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-02T18:44:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:30 smithi136 ceph-mon[125702]: pgmap v14943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:44:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:30 smithi057 ceph-mon[92072]: pgmap v14943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:44:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:30 smithi122 ceph-mon[125440]: pgmap v14943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:44:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:32 smithi136 ceph-mon[125702]: pgmap v14944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:32 smithi057 ceph-mon[92072]: pgmap v14944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:32 smithi122 ceph-mon[125440]: pgmap v14944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:34 smithi136 ceph-mon[125702]: pgmap v14945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:44:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:34 smithi057 ceph-mon[92072]: pgmap v14945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:44:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:34 smithi122 ceph-mon[125440]: pgmap v14945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:44:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:36 smithi136 ceph-mon[125702]: pgmap v14946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:36 smithi057 ceph-mon[92072]: pgmap v14946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:36 smithi122 ceph-mon[125440]: pgmap v14946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:38 smithi136 ceph-mon[125702]: pgmap v14947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:44:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:38 smithi057 ceph-mon[92072]: pgmap v14947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:44:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:38 smithi122 ceph-mon[125440]: pgmap v14947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:44:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:40 smithi136 ceph-mon[125702]: pgmap v14948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T18:44:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:40 smithi057 ceph-mon[92072]: pgmap v14948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T18:44:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:40 smithi122 ceph-mon[125440]: pgmap v14948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T18:44:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:40.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:44:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:40.496+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:44:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:40.496+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:44:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:40.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:44:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:40.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:44:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:42 smithi057 ceph-mon[92072]: pgmap v14949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:42 smithi122 ceph-mon[125440]: pgmap v14949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:42 smithi136 ceph-mon[125702]: pgmap v14949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:44 smithi057 ceph-mon[92072]: pgmap v14950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:44:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:44 smithi122 ceph-mon[125440]: pgmap v14950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:44:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:44 smithi136 ceph-mon[125702]: pgmap v14950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:44:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:46 smithi057 ceph-mon[92072]: pgmap v14951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:46 smithi122 ceph-mon[125440]: pgmap v14951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:46 smithi136 ceph-mon[125702]: pgmap v14951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:48 smithi057 ceph-mon[92072]: pgmap v14952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:44:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:48 smithi122 ceph-mon[125440]: pgmap v14952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:44:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:48 smithi136 ceph-mon[125702]: pgmap v14952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T18:44:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:50 smithi057 ceph-mon[92072]: pgmap v14953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:44:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:50 smithi122 ceph-mon[125440]: pgmap v14953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:44:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:50 smithi136 ceph-mon[125702]: pgmap v14953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:44:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:52 smithi057 ceph-mon[92072]: pgmap v14954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:52 smithi122 ceph-mon[125440]: pgmap v14954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:52 smithi136 ceph-mon[125702]: pgmap v14954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:54 smithi057 ceph-mon[92072]: pgmap v14955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:44:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:54 smithi122 ceph-mon[125440]: pgmap v14955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:44:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:54 smithi136 ceph-mon[125702]: pgmap v14955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:44:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:55.511+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:44:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:55.511+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:44:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:55.511+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:44:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:55.511+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:44:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:44:55.511+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:44:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:56 smithi057 ceph-mon[92072]: pgmap v14956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:56 smithi122 ceph-mon[125440]: pgmap v14956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:56 smithi136 ceph-mon[125702]: pgmap v14956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:44:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:44:58 smithi057 ceph-mon[92072]: pgmap v14957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T18:44:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:44:58 smithi122 ceph-mon[125440]: pgmap v14957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T18:44:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:44:58 smithi136 ceph-mon[125702]: pgmap v14957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T18:45:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:00 smithi057 ceph-mon[92072]: pgmap v14958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:45:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:00 smithi122 ceph-mon[125440]: pgmap v14958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:45:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:00 smithi136 ceph-mon[125702]: pgmap v14958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T18:45:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:02 smithi057 ceph-mon[92072]: pgmap v14959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:02 smithi122 ceph-mon[125440]: pgmap v14959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:02 smithi136 ceph-mon[125702]: pgmap v14959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:04 smithi057 ceph-mon[92072]: pgmap v14960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:45:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:04 smithi122 ceph-mon[125440]: pgmap v14960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:45:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:04 smithi136 ceph-mon[125702]: pgmap v14960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:45:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:06 smithi057 ceph-mon[92072]: pgmap v14961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:45:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:06 smithi122 ceph-mon[125440]: pgmap v14961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:45:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:06 smithi136 ceph-mon[125702]: pgmap v14961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:45:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:08 smithi057 ceph-mon[92072]: pgmap v14962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:45:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:08 smithi122 ceph-mon[125440]: pgmap v14962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:45:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:08 smithi136 ceph-mon[125702]: pgmap v14962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:45:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:10 smithi057 ceph-mon[92072]: pgmap v14963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:45:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:10 smithi122 ceph-mon[125440]: pgmap v14963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:45:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:10.517+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:45:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:10.517+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:45:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:10.517+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:45:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:10.517+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:45:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:10.517+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:45:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:10 smithi136 ceph-mon[125702]: pgmap v14963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:45:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:12 smithi057 ceph-mon[92072]: pgmap v14964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:45:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:12 smithi057 ceph-mon[92072]: osdmap e1008: 12 total, 12 up, 12 in 2023-03-02T18:45:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:12 smithi122 ceph-mon[125440]: pgmap v14964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:45:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:12 smithi122 ceph-mon[125440]: osdmap e1008: 12 total, 12 up, 12 in 2023-03-02T18:45:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:12 smithi136 ceph-mon[125702]: pgmap v14964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:45:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:12 smithi136 ceph-mon[125702]: osdmap e1008: 12 total, 12 up, 12 in 2023-03-02T18:45:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:14 smithi122 ceph-mon[125440]: pgmap v14966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:14 smithi136 ceph-mon[125702]: pgmap v14966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:14 smithi057 ceph-mon[92072]: pgmap v14966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:16 smithi122 ceph-mon[125440]: pgmap v14967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:16 smithi136 ceph-mon[125702]: pgmap v14967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:16 smithi057 ceph-mon[92072]: pgmap v14967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:18 smithi122 ceph-mon[125440]: pgmap v14968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:45:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:18 smithi136 ceph-mon[125702]: pgmap v14968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:45:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:18 smithi057 ceph-mon[92072]: pgmap v14968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:45:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:20 smithi122 ceph-mon[125440]: pgmap v14969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:45:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:20 smithi136 ceph-mon[125702]: pgmap v14969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:45:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:20 smithi057 ceph-mon[92072]: pgmap v14969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:45:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:21 smithi136 ceph-mon[125702]: pgmap v14970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:45:21.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:21 smithi057 ceph-mon[92072]: pgmap v14970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:45:21.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:21 smithi122 ceph-mon[125440]: pgmap v14970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:45:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:23 smithi136 ceph-mon[125702]: osdmap e1009: 12 total, 12 up, 12 in 2023-03-02T18:45:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:45:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:23 smithi057 ceph-mon[92072]: osdmap e1009: 12 total, 12 up, 12 in 2023-03-02T18:45:23.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:45:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:23 smithi122 ceph-mon[125440]: osdmap e1009: 12 total, 12 up, 12 in 2023-03-02T18:45:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:45:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:24 smithi136 ceph-mon[125702]: pgmap v14972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:45:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:45:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:45:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:24 smithi057 ceph-mon[92072]: pgmap v14972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:45:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:45:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:45:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:24 smithi122 ceph-mon[125440]: pgmap v14972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:45:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:45:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:45:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:25.527+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:45:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:25.528+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:45:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:25.528+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:45:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:25.528+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:45:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:25.528+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:45:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:26 smithi136 ceph-mon[125702]: pgmap v14973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:26 smithi057 ceph-mon[92072]: pgmap v14973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:26 smithi122 ceph-mon[125440]: pgmap v14973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:45:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:28 smithi136 ceph-mon[125702]: pgmap v14974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:45:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:28 smithi057 ceph-mon[92072]: pgmap v14974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:45:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:28 smithi122 ceph-mon[125440]: pgmap v14974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:45:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:30 smithi136 ceph-mon[125702]: pgmap v14975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:45:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:30 smithi057 ceph-mon[92072]: pgmap v14975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:45:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:30 smithi122 ceph-mon[125440]: pgmap v14975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:45:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:32 smithi136 ceph-mon[125702]: pgmap v14976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:45:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:32 smithi057 ceph-mon[92072]: pgmap v14976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:45:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:32 smithi122 ceph-mon[125440]: pgmap v14976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:45:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:34 smithi057 ceph-mon[92072]: pgmap v14977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T18:45:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:34 smithi122 ceph-mon[125440]: pgmap v14977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T18:45:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:34 smithi136 ceph-mon[125702]: pgmap v14977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T18:45:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:36 smithi057 ceph-mon[92072]: pgmap v14978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:45:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:36 smithi122 ceph-mon[125440]: pgmap v14978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:45:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:36 smithi136 ceph-mon[125702]: pgmap v14978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T18:45:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:38 smithi057 ceph-mon[92072]: pgmap v14979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T18:45:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:38 smithi122 ceph-mon[125440]: pgmap v14979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T18:45:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:38 smithi136 ceph-mon[125702]: pgmap v14979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-02T18:45:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:40 smithi057 ceph-mon[92072]: pgmap v14980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T18:45:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:40 smithi122 ceph-mon[125440]: pgmap v14980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T18:45:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:40.531+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:45:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:40.531+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:45:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:40.531+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:45:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:40.531+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:45:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:40.531+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:45:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:40 smithi136 ceph-mon[125702]: pgmap v14980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-02T18:45:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:42 smithi057 ceph-mon[92072]: pgmap v14981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:45:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:42 smithi122 ceph-mon[125440]: pgmap v14981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:45:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:42 smithi136 ceph-mon[125702]: pgmap v14981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:45:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:44 smithi057 ceph-mon[92072]: pgmap v14982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:45:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:44 smithi122 ceph-mon[125440]: pgmap v14982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:45:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:44 smithi136 ceph-mon[125702]: pgmap v14982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:45:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:46 smithi057 ceph-mon[92072]: pgmap v14983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:46 smithi122 ceph-mon[125440]: pgmap v14983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:46 smithi136 ceph-mon[125702]: pgmap v14983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:48 smithi057 ceph-mon[92072]: pgmap v14984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T18:45:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:48 smithi122 ceph-mon[125440]: pgmap v14984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T18:45:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:48 smithi136 ceph-mon[125702]: pgmap v14984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T18:45:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:50 smithi057 ceph-mon[92072]: pgmap v14985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T18:45:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:50 smithi122 ceph-mon[125440]: pgmap v14985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T18:45:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:50 smithi136 ceph-mon[125702]: pgmap v14985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T18:45:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:52 smithi057 ceph-mon[92072]: pgmap v14986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:52 smithi122 ceph-mon[125440]: pgmap v14986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:52 smithi136 ceph-mon[125702]: pgmap v14986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:54.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:54 smithi057 ceph-mon[92072]: pgmap v14987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:45:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:54 smithi122 ceph-mon[125440]: pgmap v14987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:45:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:54 smithi136 ceph-mon[125702]: pgmap v14987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:45:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:55.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:45:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:55.541+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:45:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:55.541+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:45:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:55.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:45:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:45:55.541+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:45:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:56 smithi057 ceph-mon[92072]: pgmap v14988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:56 smithi122 ceph-mon[125440]: pgmap v14988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:56 smithi136 ceph-mon[125702]: pgmap v14988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:45:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:45:58 smithi057 ceph-mon[92072]: pgmap v14989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T18:45:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:45:58 smithi122 ceph-mon[125440]: pgmap v14989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T18:45:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:45:58 smithi136 ceph-mon[125702]: pgmap v14989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-02T18:46:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:00 smithi057 ceph-mon[92072]: pgmap v14990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T18:46:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:00 smithi122 ceph-mon[125440]: pgmap v14990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T18:46:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:00 smithi136 ceph-mon[125702]: pgmap v14990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-02T18:46:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:02 smithi057 ceph-mon[92072]: pgmap v14991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:02 smithi122 ceph-mon[125440]: pgmap v14991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:02 smithi136 ceph-mon[125702]: pgmap v14991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:04 smithi057 ceph-mon[92072]: pgmap v14992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:46:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:04 smithi122 ceph-mon[125440]: pgmap v14992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:46:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:04 smithi136 ceph-mon[125702]: pgmap v14992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:46:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:06 smithi057 ceph-mon[92072]: pgmap v14993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:46:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:06 smithi122 ceph-mon[125440]: pgmap v14993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:46:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:06 smithi136 ceph-mon[125702]: pgmap v14993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:46:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:08 smithi122 ceph-mon[125440]: pgmap v14994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:46:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:08 smithi136 ceph-mon[125702]: pgmap v14994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:46:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:08 smithi057 ceph-mon[92072]: pgmap v14994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T18:46:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:10 smithi122 ceph-mon[125440]: pgmap v14995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:46:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:10.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:46:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:10.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:46:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:10.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:46:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:10.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:46:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:10.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:46:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:10 smithi136 ceph-mon[125702]: pgmap v14995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:46:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:10 smithi057 ceph-mon[92072]: pgmap v14995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:46:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:12 smithi122 ceph-mon[125440]: pgmap v14996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:46:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:12 smithi122 ceph-mon[125440]: osdmap e1010: 12 total, 12 up, 12 in 2023-03-02T18:46:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:12 smithi136 ceph-mon[125702]: pgmap v14996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:46:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:12 smithi136 ceph-mon[125702]: osdmap e1010: 12 total, 12 up, 12 in 2023-03-02T18:46:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:12 smithi057 ceph-mon[92072]: pgmap v14996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:46:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:12 smithi057 ceph-mon[92072]: osdmap e1010: 12 total, 12 up, 12 in 2023-03-02T18:46:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:14 smithi136 ceph-mon[125702]: pgmap v14998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:46:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:14 smithi057 ceph-mon[92072]: pgmap v14998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:46:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:14 smithi122 ceph-mon[125440]: pgmap v14998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:46:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:16 smithi136 ceph-mon[125702]: pgmap v14999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:46:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:16 smithi057 ceph-mon[92072]: pgmap v14999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:46:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:16 smithi122 ceph-mon[125440]: pgmap v14999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:46:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:18 smithi136 ceph-mon[125702]: pgmap v15000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:46:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:18 smithi136 ceph-mon[125702]: osdmap e1011: 12 total, 12 up, 12 in 2023-03-02T18:46:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:18 smithi057 ceph-mon[92072]: pgmap v15000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:46:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:18 smithi057 ceph-mon[92072]: osdmap e1011: 12 total, 12 up, 12 in 2023-03-02T18:46:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:18 smithi122 ceph-mon[125440]: pgmap v15000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:46:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:18 smithi122 ceph-mon[125440]: osdmap e1011: 12 total, 12 up, 12 in 2023-03-02T18:46:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:20 smithi136 ceph-mon[125702]: pgmap v15002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:46:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:20 smithi057 ceph-mon[92072]: pgmap v15002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:46:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:20 smithi122 ceph-mon[125440]: pgmap v15002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:46:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:22 smithi057 ceph-mon[92072]: pgmap v15003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T18:46:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:22 smithi122 ceph-mon[125440]: pgmap v15003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T18:46:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:22 smithi136 ceph-mon[125702]: pgmap v15003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T18:46:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:24 smithi057 ceph-mon[92072]: pgmap v15004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:46:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:46:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:46:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:46:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:46:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:24 smithi122 ceph-mon[125440]: pgmap v15004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:46:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:46:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:46:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:46:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:46:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:24 smithi136 ceph-mon[125702]: pgmap v15004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:46:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:46:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:46:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:46:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:25.556+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:25.556+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:25.556+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:25.556+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:46:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:25.556+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:46:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:26 smithi057 ceph-mon[92072]: pgmap v15005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:46:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:26 smithi122 ceph-mon[125440]: pgmap v15005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:46:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:26 smithi136 ceph-mon[125702]: pgmap v15005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:46:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:28 smithi057 ceph-mon[92072]: pgmap v15006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:46:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:28 smithi122 ceph-mon[125440]: pgmap v15006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:46:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:28 smithi136 ceph-mon[125702]: pgmap v15006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:46:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:30 smithi057 ceph-mon[92072]: pgmap v15007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T18:46:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:30 smithi122 ceph-mon[125440]: pgmap v15007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T18:46:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:30 smithi136 ceph-mon[125702]: pgmap v15007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T18:46:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:32 smithi057 ceph-mon[92072]: pgmap v15008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:32 smithi122 ceph-mon[125440]: pgmap v15008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:32 smithi136 ceph-mon[125702]: pgmap v15008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:34 smithi057 ceph-mon[92072]: pgmap v15009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:46:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:34 smithi122 ceph-mon[125440]: pgmap v15009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:46:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:34 smithi136 ceph-mon[125702]: pgmap v15009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:46:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:36 smithi057 ceph-mon[92072]: pgmap v15010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:36 smithi122 ceph-mon[125440]: pgmap v15010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:36 smithi136 ceph-mon[125702]: pgmap v15010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:38 smithi057 ceph-mon[92072]: pgmap v15011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:38 smithi122 ceph-mon[125440]: pgmap v15011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:38 smithi136 ceph-mon[125702]: pgmap v15011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:40 smithi057 ceph-mon[92072]: pgmap v15012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:40 smithi122 ceph-mon[125440]: pgmap v15012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:40.568+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:46:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:40.568+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:46:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:40.568+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:46:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:40.568+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:46:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:40.568+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:46:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:40 smithi136 ceph-mon[125702]: pgmap v15012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:42 smithi057 ceph-mon[92072]: pgmap v15013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:42 smithi122 ceph-mon[125440]: pgmap v15013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:42 smithi136 ceph-mon[125702]: pgmap v15013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:44 smithi057 ceph-mon[92072]: pgmap v15014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:44 smithi122 ceph-mon[125440]: pgmap v15014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:44 smithi136 ceph-mon[125702]: pgmap v15014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:46 smithi057 ceph-mon[92072]: pgmap v15015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:46 smithi122 ceph-mon[125440]: pgmap v15015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:46 smithi136 ceph-mon[125702]: pgmap v15015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:48 smithi122 ceph-mon[125440]: pgmap v15016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:48 smithi136 ceph-mon[125702]: pgmap v15016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:48 smithi057 ceph-mon[92072]: pgmap v15016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:50 smithi122 ceph-mon[125440]: pgmap v15017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:50 smithi136 ceph-mon[125702]: pgmap v15017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:50 smithi057 ceph-mon[92072]: pgmap v15017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:52 smithi122 ceph-mon[125440]: pgmap v15018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:52 smithi136 ceph-mon[125702]: pgmap v15018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:52 smithi057 ceph-mon[92072]: pgmap v15018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:54 smithi136 ceph-mon[125702]: pgmap v15019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:54 smithi057 ceph-mon[92072]: pgmap v15019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:54 smithi122 ceph-mon[125440]: pgmap v15019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:55.576+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:46:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:55.577+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:46:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:55.577+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:46:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:55.577+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:46:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:46:55.577+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:46:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:56 smithi136 ceph-mon[125702]: pgmap v15020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:56 smithi057 ceph-mon[92072]: pgmap v15020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:56 smithi122 ceph-mon[125440]: pgmap v15020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:46:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:46:58 smithi136 ceph-mon[125702]: pgmap v15021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:46:58 smithi057 ceph-mon[92072]: pgmap v15021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:46:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:46:58 smithi122 ceph-mon[125440]: pgmap v15021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:00 smithi136 ceph-mon[125702]: pgmap v15022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:00 smithi057 ceph-mon[92072]: pgmap v15022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:00 smithi122 ceph-mon[125440]: pgmap v15022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:01 smithi136 ceph-mon[125702]: pgmap v15023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:01 smithi057 ceph-mon[92072]: pgmap v15023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:01 smithi122 ceph-mon[125440]: pgmap v15023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:04 smithi057 ceph-mon[92072]: pgmap v15024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:47:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:04 smithi122 ceph-mon[125440]: pgmap v15024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:47:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:04 smithi136 ceph-mon[125702]: pgmap v15024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:47:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:06 smithi057 ceph-mon[92072]: pgmap v15025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:47:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:06 smithi122 ceph-mon[125440]: pgmap v15025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:47:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:06 smithi136 ceph-mon[125702]: pgmap v15025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:47:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:07 smithi057 ceph-mon[92072]: osdmap e1012: 12 total, 12 up, 12 in 2023-03-02T18:47:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:07 smithi122 ceph-mon[125440]: osdmap e1012: 12 total, 12 up, 12 in 2023-03-02T18:47:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:07 smithi136 ceph-mon[125702]: osdmap e1012: 12 total, 12 up, 12 in 2023-03-02T18:47:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:08 smithi057 ceph-mon[92072]: pgmap v15027: 97 pgs: 7 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:47:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:08 smithi122 ceph-mon[125440]: pgmap v15027: 97 pgs: 7 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:47:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:08 smithi136 ceph-mon[125702]: pgmap v15027: 97 pgs: 7 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:47:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:10 smithi057 ceph-mon[92072]: pgmap v15028: 97 pgs: 7 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:47:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:10 smithi122 ceph-mon[125440]: pgmap v15028: 97 pgs: 7 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:47:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:10 smithi136 ceph-mon[125702]: pgmap v15028: 97 pgs: 7 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:47:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:10.592+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:47:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:10.592+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:47:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:10.592+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:47:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:10.592+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:47:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:10.592+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:47:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:12.427+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:47:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:12.427+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:47:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:12.427+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 217 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:47:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:12.427+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 218 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:47:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:12 smithi057 ceph-mon[92072]: pgmap v15029: 97 pgs: 7 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:47:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:12 smithi122 ceph-mon[125440]: pgmap v15029: 97 pgs: 7 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:47:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:12 smithi136 ceph-mon[125702]: pgmap v15029: 97 pgs: 7 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:47:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:14 smithi057 ceph-mon[92072]: pgmap v15030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:47:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:14 smithi122 ceph-mon[125440]: pgmap v15030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:47:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:14 smithi136 ceph-mon[125702]: pgmap v15030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:47:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:16 smithi057 ceph-mon[92072]: pgmap v15031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:47:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:16 smithi122 ceph-mon[125440]: pgmap v15031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:47:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:16 smithi136 ceph-mon[125702]: pgmap v15031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:47:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:18 smithi057 ceph-mon[92072]: pgmap v15032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:47:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:18 smithi057 ceph-mon[92072]: osdmap e1013: 12 total, 12 up, 12 in 2023-03-02T18:47:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:18 smithi122 ceph-mon[125440]: pgmap v15032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:47:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:18 smithi122 ceph-mon[125440]: osdmap e1013: 12 total, 12 up, 12 in 2023-03-02T18:47:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:18 smithi136 ceph-mon[125702]: pgmap v15032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:47:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:18 smithi136 ceph-mon[125702]: osdmap e1013: 12 total, 12 up, 12 in 2023-03-02T18:47:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:20 smithi057 ceph-mon[92072]: pgmap v15034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:47:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:20 smithi122 ceph-mon[125440]: pgmap v15034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:47:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:20 smithi136 ceph-mon[125702]: pgmap v15034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:47:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:22 smithi057 ceph-mon[92072]: pgmap v15035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:47:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:22 smithi122 ceph-mon[125440]: pgmap v15035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:47:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:22 smithi136 ceph-mon[125702]: pgmap v15035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:47:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:24 smithi057 ceph-mon[92072]: pgmap v15036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:47:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:47:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:24 smithi122 ceph-mon[125440]: pgmap v15036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:47:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:47:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:24 smithi136 ceph-mon[125702]: pgmap v15036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:47:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:47:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:47:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:47:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:47:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:47:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:47:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:47:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:47:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:47:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:47:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:25.603+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:47:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:25.604+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:47:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:25.604+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:47:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:25.604+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:47:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:25.604+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:47:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:26 smithi057 ceph-mon[92072]: pgmap v15037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:47:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:26 smithi122 ceph-mon[125440]: pgmap v15037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:47:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:26 smithi136 ceph-mon[125702]: pgmap v15037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:47:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:28 smithi057 ceph-mon[92072]: pgmap v15038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:47:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:28 smithi122 ceph-mon[125440]: pgmap v15038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:47:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:28 smithi136 ceph-mon[125702]: pgmap v15038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:47:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:30 smithi057 ceph-mon[92072]: pgmap v15039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:47:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:30 smithi122 ceph-mon[125440]: pgmap v15039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:47:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:30 smithi136 ceph-mon[125702]: pgmap v15039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:47:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:32 smithi057 ceph-mon[92072]: pgmap v15040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:32 smithi122 ceph-mon[125440]: pgmap v15040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:32 smithi136 ceph-mon[125702]: pgmap v15040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:34 smithi057 ceph-mon[92072]: pgmap v15041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:34 smithi122 ceph-mon[125440]: pgmap v15041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:34 smithi136 ceph-mon[125702]: pgmap v15041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:36 smithi057 ceph-mon[92072]: pgmap v15042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:36 smithi122 ceph-mon[125440]: pgmap v15042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:36 smithi136 ceph-mon[125702]: pgmap v15042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:38 smithi057 ceph-mon[92072]: pgmap v15043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:38 smithi122 ceph-mon[125440]: pgmap v15043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:38 smithi136 ceph-mon[125702]: pgmap v15043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:40 smithi057 ceph-mon[92072]: pgmap v15044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:40 smithi122 ceph-mon[125440]: pgmap v15044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:40 smithi136 ceph-mon[125702]: pgmap v15044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:40.618+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:47:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:40.618+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:47:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:40.618+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:47:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:40.618+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:47:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:40.618+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:47:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:42 smithi057 ceph-mon[92072]: pgmap v15045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:42 smithi122 ceph-mon[125440]: pgmap v15045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:42 smithi136 ceph-mon[125702]: pgmap v15045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:44.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:44 smithi057 ceph-mon[92072]: pgmap v15046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:44 smithi122 ceph-mon[125440]: pgmap v15046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:44 smithi136 ceph-mon[125702]: pgmap v15046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:46 smithi057 ceph-mon[92072]: pgmap v15047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:46 smithi122 ceph-mon[125440]: pgmap v15047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:46 smithi136 ceph-mon[125702]: pgmap v15047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:48 smithi057 ceph-mon[92072]: pgmap v15048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:48 smithi122 ceph-mon[125440]: pgmap v15048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:48 smithi136 ceph-mon[125702]: pgmap v15048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:50 smithi057 ceph-mon[92072]: pgmap v15049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:50 smithi122 ceph-mon[125440]: pgmap v15049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:50 smithi136 ceph-mon[125702]: pgmap v15049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:52 smithi122 ceph-mon[125440]: pgmap v15050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:52 smithi136 ceph-mon[125702]: pgmap v15050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:52 smithi057 ceph-mon[92072]: pgmap v15050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:54 smithi122 ceph-mon[125440]: pgmap v15051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:54 smithi136 ceph-mon[125702]: pgmap v15051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:54 smithi057 ceph-mon[92072]: pgmap v15051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:55.634+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:47:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:55.634+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:47:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:55.634+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:47:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:55.634+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:47:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:47:55.634+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:47:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:56 smithi136 ceph-mon[125702]: pgmap v15052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:56 smithi057 ceph-mon[92072]: pgmap v15052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:56 smithi122 ceph-mon[125440]: pgmap v15052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:47:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:47:58 smithi136 ceph-mon[125702]: pgmap v15053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:47:58 smithi057 ceph-mon[92072]: pgmap v15053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:47:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:47:58 smithi122 ceph-mon[125440]: pgmap v15053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:00 smithi136 ceph-mon[125702]: pgmap v15054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:00 smithi057 ceph-mon[92072]: pgmap v15054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:00 smithi122 ceph-mon[125440]: pgmap v15054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:02 smithi136 ceph-mon[125702]: pgmap v15055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:02 smithi057 ceph-mon[92072]: pgmap v15055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:02 smithi122 ceph-mon[125440]: pgmap v15055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:03 smithi136 ceph-mon[125702]: pgmap v15056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:48:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:03 smithi057 ceph-mon[92072]: pgmap v15056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:48:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:03 smithi122 ceph-mon[125440]: pgmap v15056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:48:06.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:05 smithi057 ceph-mon[92072]: pgmap v15057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:48:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:05 smithi122 ceph-mon[125440]: pgmap v15057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:48:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:05 smithi136 ceph-mon[125702]: pgmap v15057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:48:08.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:07 smithi057 ceph-mon[92072]: pgmap v15058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:48:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:07 smithi057 ceph-mon[92072]: osdmap e1014: 12 total, 12 up, 12 in 2023-03-02T18:48:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:07 smithi122 ceph-mon[125440]: pgmap v15058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:48:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:07 smithi122 ceph-mon[125440]: osdmap e1014: 12 total, 12 up, 12 in 2023-03-02T18:48:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:07 smithi136 ceph-mon[125702]: pgmap v15058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:48:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:07 smithi136 ceph-mon[125702]: osdmap e1014: 12 total, 12 up, 12 in 2023-03-02T18:48:10.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:09 smithi057 ceph-mon[92072]: pgmap v15060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:48:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:09 smithi122 ceph-mon[125440]: pgmap v15060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:48:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:09 smithi136 ceph-mon[125702]: pgmap v15060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:48:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:10.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:10.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:10.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:10.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:48:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:10.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:48:12.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:11 smithi057 ceph-mon[92072]: pgmap v15061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:48:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:11 smithi122 ceph-mon[125440]: pgmap v15061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:48:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:11 smithi136 ceph-mon[125702]: pgmap v15061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:48:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:14 smithi057 ceph-mon[92072]: pgmap v15062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:48:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:14 smithi122 ceph-mon[125440]: pgmap v15062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:48:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:14 smithi136 ceph-mon[125702]: pgmap v15062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:48:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:16 smithi057 ceph-mon[92072]: pgmap v15063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:48:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:16 smithi122 ceph-mon[125440]: pgmap v15063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:48:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:16 smithi136 ceph-mon[125702]: pgmap v15063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:48:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:18 smithi057 ceph-mon[92072]: pgmap v15064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:48:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:18 smithi057 ceph-mon[92072]: osdmap e1015: 12 total, 12 up, 12 in 2023-03-02T18:48:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:18 smithi122 ceph-mon[125440]: pgmap v15064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:48:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:18 smithi122 ceph-mon[125440]: osdmap e1015: 12 total, 12 up, 12 in 2023-03-02T18:48:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:18 smithi136 ceph-mon[125702]: pgmap v15064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:48:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:18 smithi136 ceph-mon[125702]: osdmap e1015: 12 total, 12 up, 12 in 2023-03-02T18:48:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:20 smithi057 ceph-mon[92072]: pgmap v15066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:48:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:20 smithi122 ceph-mon[125440]: pgmap v15066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:48:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:20 smithi136 ceph-mon[125702]: pgmap v15066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:48:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:22 smithi057 ceph-mon[92072]: pgmap v15067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:48:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:22 smithi122 ceph-mon[125440]: pgmap v15067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:48:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:22 smithi136 ceph-mon[125702]: pgmap v15067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:48:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:24 smithi057 ceph-mon[92072]: pgmap v15068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:48:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:24 smithi122 ceph-mon[125440]: pgmap v15068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:48:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:24 smithi136 ceph-mon[125702]: pgmap v15068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:48:25.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:48:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:48:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:48:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:25.664+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:48:25.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:25.665+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:48:25.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:25.665+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:48:25.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:25.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:48:25.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:25.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:48:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:26 smithi057 ceph-mon[92072]: pgmap v15069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:48:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:48:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:48:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:48:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:26 smithi122 ceph-mon[125440]: pgmap v15069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:48:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:48:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:48:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:48:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:26 smithi136 ceph-mon[125702]: pgmap v15069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T18:48:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:48:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:48:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:48:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:28 smithi057 ceph-mon[92072]: pgmap v15070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:48:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:28 smithi122 ceph-mon[125440]: pgmap v15070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:48:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:28 smithi136 ceph-mon[125702]: pgmap v15070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:48:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:30 smithi057 ceph-mon[92072]: pgmap v15071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:48:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:30 smithi122 ceph-mon[125440]: pgmap v15071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:48:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:30 smithi136 ceph-mon[125702]: pgmap v15071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:48:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:32 smithi057 ceph-mon[92072]: pgmap v15072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:32 smithi122 ceph-mon[125440]: pgmap v15072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:32 smithi136 ceph-mon[125702]: pgmap v15072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:34 smithi057 ceph-mon[92072]: pgmap v15073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:34 smithi122 ceph-mon[125440]: pgmap v15073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:34 smithi136 ceph-mon[125702]: pgmap v15073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:36 smithi057 ceph-mon[92072]: pgmap v15074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:36 smithi122 ceph-mon[125440]: pgmap v15074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:36 smithi136 ceph-mon[125702]: pgmap v15074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:38 smithi057 ceph-mon[92072]: pgmap v15075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:38 smithi122 ceph-mon[125440]: pgmap v15075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:38 smithi136 ceph-mon[125702]: pgmap v15075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:40 smithi057 ceph-mon[92072]: pgmap v15076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:40 smithi122 ceph-mon[125440]: pgmap v15076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:40 smithi136 ceph-mon[125702]: pgmap v15076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:40.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:40.679+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:48:40.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:40.680+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:48:40.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:40.680+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:48:40.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:40.680+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:48:40.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:40.680+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:48:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:42 smithi122 ceph-mon[125440]: pgmap v15077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:42 smithi136 ceph-mon[125702]: pgmap v15077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:42 smithi057 ceph-mon[92072]: pgmap v15077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:44 smithi122 ceph-mon[125440]: pgmap v15078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:44 smithi136 ceph-mon[125702]: pgmap v15078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:44 smithi057 ceph-mon[92072]: pgmap v15078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:46 smithi122 ceph-mon[125440]: pgmap v15079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:46 smithi136 ceph-mon[125702]: pgmap v15079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:46 smithi057 ceph-mon[92072]: pgmap v15079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:48 smithi122 ceph-mon[125440]: pgmap v15080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:48 smithi136 ceph-mon[125702]: pgmap v15080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:48 smithi057 ceph-mon[92072]: pgmap v15080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:50 smithi122 ceph-mon[125440]: pgmap v15081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:50 smithi136 ceph-mon[125702]: pgmap v15081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:50 smithi057 ceph-mon[92072]: pgmap v15081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:52 smithi136 ceph-mon[125702]: pgmap v15082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:52 smithi057 ceph-mon[92072]: pgmap v15082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:52 smithi122 ceph-mon[125440]: pgmap v15082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:54 smithi136 ceph-mon[125702]: pgmap v15083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:54 smithi057 ceph-mon[92072]: pgmap v15083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:54 smithi122 ceph-mon[125440]: pgmap v15083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:55.685+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:48:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:55.685+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:48:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:55.685+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:48:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:55.685+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:48:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:48:55.685+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:48:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:56 smithi136 ceph-mon[125702]: pgmap v15084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:56 smithi057 ceph-mon[92072]: pgmap v15084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:56 smithi122 ceph-mon[125440]: pgmap v15084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:58 smithi136 ceph-mon[125702]: pgmap v15085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:58 smithi057 ceph-mon[92072]: pgmap v15085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:58 smithi122 ceph-mon[125440]: pgmap v15085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:48:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:48:59 smithi136 ceph-mon[125702]: pgmap v15086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:48:59 smithi057 ceph-mon[92072]: pgmap v15086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:48:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:48:59 smithi122 ceph-mon[125440]: pgmap v15086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:02.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:01 smithi057 ceph-mon[92072]: pgmap v15087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:01 smithi122 ceph-mon[125440]: pgmap v15087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:01 smithi136 ceph-mon[125702]: pgmap v15087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:04 smithi057 ceph-mon[92072]: pgmap v15088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:49:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:04 smithi122 ceph-mon[125440]: pgmap v15088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:49:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:04 smithi136 ceph-mon[125702]: pgmap v15088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:49:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:06 smithi057 ceph-mon[92072]: pgmap v15089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:49:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:06 smithi122 ceph-mon[125440]: pgmap v15089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:49:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:06 smithi136 ceph-mon[125702]: pgmap v15089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:49:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:07 smithi057 ceph-mon[92072]: osdmap e1016: 12 total, 12 up, 12 in 2023-03-02T18:49:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:07 smithi122 ceph-mon[125440]: osdmap e1016: 12 total, 12 up, 12 in 2023-03-02T18:49:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:07 smithi136 ceph-mon[125702]: osdmap e1016: 12 total, 12 up, 12 in 2023-03-02T18:49:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:08 smithi057 ceph-mon[92072]: pgmap v15091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:49:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:08 smithi122 ceph-mon[125440]: pgmap v15091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:49:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:08 smithi136 ceph-mon[125702]: pgmap v15091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:49:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:10 smithi057 ceph-mon[92072]: pgmap v15092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:49:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:10 smithi122 ceph-mon[125440]: pgmap v15092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:49:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:10 smithi136 ceph-mon[125702]: pgmap v15092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:49:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:10.688+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:49:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:10.688+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:49:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:10.688+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:49:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:10.688+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:49:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:10.688+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:49:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:12 smithi057 ceph-mon[92072]: pgmap v15093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:49:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:12 smithi122 ceph-mon[125440]: pgmap v15093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:49:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:12 smithi136 ceph-mon[125702]: pgmap v15093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:49:14.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:14 smithi057 ceph-mon[92072]: pgmap v15094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:49:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:14 smithi122 ceph-mon[125440]: pgmap v15094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:49:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:14 smithi136 ceph-mon[125702]: pgmap v15094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:49:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:16 smithi057 ceph-mon[92072]: pgmap v15095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:49:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:16 smithi122 ceph-mon[125440]: pgmap v15095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:49:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:16 smithi136 ceph-mon[125702]: pgmap v15095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:49:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:18 smithi057 ceph-mon[92072]: pgmap v15096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 191 B/s wr, 14 op/s 2023-03-02T18:49:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:18 smithi057 ceph-mon[92072]: osdmap e1017: 12 total, 12 up, 12 in 2023-03-02T18:49:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:18 smithi122 ceph-mon[125440]: pgmap v15096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 191 B/s wr, 14 op/s 2023-03-02T18:49:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:18 smithi122 ceph-mon[125440]: osdmap e1017: 12 total, 12 up, 12 in 2023-03-02T18:49:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:18 smithi136 ceph-mon[125702]: pgmap v15096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 191 B/s wr, 14 op/s 2023-03-02T18:49:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:18 smithi136 ceph-mon[125702]: osdmap e1017: 12 total, 12 up, 12 in 2023-03-02T18:49:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:20 smithi057 ceph-mon[92072]: pgmap v15098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:49:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:20 smithi122 ceph-mon[125440]: pgmap v15098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:49:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:20 smithi136 ceph-mon[125702]: pgmap v15098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:49:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:22 smithi057 ceph-mon[92072]: pgmap v15099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:49:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:22 smithi122 ceph-mon[125440]: pgmap v15099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:49:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:22 smithi136 ceph-mon[125702]: pgmap v15099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:49:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:24 smithi057 ceph-mon[92072]: pgmap v15100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:49:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:24 smithi122 ceph-mon[125440]: pgmap v15100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:49:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:24 smithi136 ceph-mon[125702]: pgmap v15100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:49:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:25.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:49:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:25.701+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:49:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:25.701+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:49:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:25.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:49:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:25.701+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:49:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:26 smithi057 ceph-mon[92072]: pgmap v15101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:49:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:49:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:26 smithi122 ceph-mon[125440]: pgmap v15101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:49:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:49:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:26 smithi136 ceph-mon[125702]: pgmap v15101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:49:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:49:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:49:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:49:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:49:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:27.446+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:49:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:27.446+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:49:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:27.446+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 218 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:49:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:27.446+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 219 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:49:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:49:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:49:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:49:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:49:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:49:27.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:49:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:28 smithi057 ceph-mon[92072]: pgmap v15102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:49:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:28 smithi122 ceph-mon[125440]: pgmap v15102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:49:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:28 smithi136 ceph-mon[125702]: pgmap v15102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:49:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:30 smithi057 ceph-mon[92072]: pgmap v15103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:49:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:30 smithi122 ceph-mon[125440]: pgmap v15103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:49:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:30 smithi136 ceph-mon[125702]: pgmap v15103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:49:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:32 smithi057 ceph-mon[92072]: pgmap v15104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:32 smithi122 ceph-mon[125440]: pgmap v15104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:32 smithi136 ceph-mon[125702]: pgmap v15104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:34.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:34 smithi057 ceph-mon[92072]: pgmap v15105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:34 smithi122 ceph-mon[125440]: pgmap v15105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:34 smithi136 ceph-mon[125702]: pgmap v15105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:36 smithi057 ceph-mon[92072]: pgmap v15106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:36 smithi122 ceph-mon[125440]: pgmap v15106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:36 smithi136 ceph-mon[125702]: pgmap v15106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:38 smithi122 ceph-mon[125440]: pgmap v15107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:38 smithi136 ceph-mon[125702]: pgmap v15107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:38 smithi057 ceph-mon[92072]: pgmap v15107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:40 smithi122 ceph-mon[125440]: pgmap v15108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:40 smithi136 ceph-mon[125702]: pgmap v15108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:40 smithi057 ceph-mon[92072]: pgmap v15108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:40.717+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:49:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:40.717+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:49:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:40.717+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:49:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:40.717+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:49:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:40.717+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:49:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:42 smithi122 ceph-mon[125440]: pgmap v15109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:42 smithi136 ceph-mon[125702]: pgmap v15109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:42 smithi057 ceph-mon[92072]: pgmap v15109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:44 smithi136 ceph-mon[125702]: pgmap v15110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:44 smithi057 ceph-mon[92072]: pgmap v15110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:44 smithi122 ceph-mon[125440]: pgmap v15110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:46 smithi136 ceph-mon[125702]: pgmap v15111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:46 smithi057 ceph-mon[92072]: pgmap v15111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:46 smithi122 ceph-mon[125440]: pgmap v15111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:48 smithi136 ceph-mon[125702]: pgmap v15112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:48 smithi057 ceph-mon[92072]: pgmap v15112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:48 smithi122 ceph-mon[125440]: pgmap v15112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:50 smithi136 ceph-mon[125702]: pgmap v15113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:50 smithi057 ceph-mon[92072]: pgmap v15113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:50 smithi122 ceph-mon[125440]: pgmap v15113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:52 smithi136 ceph-mon[125702]: pgmap v15114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:52 smithi057 ceph-mon[92072]: pgmap v15114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:52 smithi122 ceph-mon[125440]: pgmap v15114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:54 smithi136 ceph-mon[125702]: pgmap v15115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:54 smithi057 ceph-mon[92072]: pgmap v15115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:54 smithi122 ceph-mon[125440]: pgmap v15115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:55 smithi136 ceph-mon[125702]: pgmap v15116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:55 smithi057 ceph-mon[92072]: pgmap v15116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:55 smithi122 ceph-mon[125440]: pgmap v15116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:49:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:55.729+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:49:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:55.729+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:49:55.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:55.729+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:49:55.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:55.729+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:49:55.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:49:55.729+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:49:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:49:58 smithi057 ceph-mon[92072]: pgmap v15117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:49:58 smithi122 ceph-mon[125440]: pgmap v15117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:49:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:49:58 smithi136 ceph-mon[125702]: pgmap v15117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:00 smithi057 ceph-mon[92072]: pgmap v15118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T18:50:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:00 smithi122 ceph-mon[125440]: pgmap v15118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T18:50:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:00 smithi136 ceph-mon[125702]: pgmap v15118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T18:50:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:02 smithi057 ceph-mon[92072]: pgmap v15119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:02 smithi122 ceph-mon[125440]: pgmap v15119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:02 smithi136 ceph-mon[125702]: pgmap v15119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:04 smithi057 ceph-mon[92072]: pgmap v15120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:50:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:04 smithi122 ceph-mon[125440]: pgmap v15120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:50:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:04 smithi136 ceph-mon[125702]: pgmap v15120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:50:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:06 smithi057 ceph-mon[92072]: pgmap v15121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:50:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:06 smithi122 ceph-mon[125440]: pgmap v15121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:50:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:06 smithi136 ceph-mon[125702]: pgmap v15121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:50:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:07 smithi057 ceph-mon[92072]: osdmap e1018: 12 total, 12 up, 12 in 2023-03-02T18:50:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:07 smithi122 ceph-mon[125440]: osdmap e1018: 12 total, 12 up, 12 in 2023-03-02T18:50:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:07 smithi136 ceph-mon[125702]: osdmap e1018: 12 total, 12 up, 12 in 2023-03-02T18:50:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:08 smithi122 ceph-mon[125440]: pgmap v15123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:50:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:08 smithi136 ceph-mon[125702]: pgmap v15123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:50:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:08 smithi057 ceph-mon[92072]: pgmap v15123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:50:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:10 smithi122 ceph-mon[125440]: pgmap v15124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:50:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:10 smithi136 ceph-mon[125702]: pgmap v15124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:50:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:10 smithi057 ceph-mon[92072]: pgmap v15124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:50:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:10.739+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:50:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:10.740+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:50:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:10.740+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:50:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:10.740+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:50:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:10.740+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:50:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:12 smithi057 ceph-mon[92072]: pgmap v15125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:50:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:12 smithi122 ceph-mon[125440]: pgmap v15125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:50:12.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:12.454+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:50:12.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:12.454+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:50:12.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:12.455+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 220 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:50:12.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:12.455+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 219 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:50:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:12 smithi136 ceph-mon[125702]: pgmap v15125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:50:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:14 smithi122 ceph-mon[125440]: pgmap v15126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:50:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:14 smithi136 ceph-mon[125702]: pgmap v15126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:50:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:14 smithi057 ceph-mon[92072]: pgmap v15126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:50:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:16 smithi136 ceph-mon[125702]: pgmap v15127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:50:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:16 smithi057 ceph-mon[92072]: pgmap v15127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:50:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:16 smithi122 ceph-mon[125440]: pgmap v15127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:50:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:18 smithi057 ceph-mon[92072]: pgmap v15128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:50:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:18 smithi057 ceph-mon[92072]: osdmap e1019: 12 total, 12 up, 12 in 2023-03-02T18:50:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:18 smithi122 ceph-mon[125440]: pgmap v15128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:50:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:18 smithi122 ceph-mon[125440]: osdmap e1019: 12 total, 12 up, 12 in 2023-03-02T18:50:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:18 smithi136 ceph-mon[125702]: pgmap v15128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:50:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:18 smithi136 ceph-mon[125702]: osdmap e1019: 12 total, 12 up, 12 in 2023-03-02T18:50:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:20 smithi057 ceph-mon[92072]: pgmap v15130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:50:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:20 smithi122 ceph-mon[125440]: pgmap v15130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:50:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:20 smithi136 ceph-mon[125702]: pgmap v15130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:50:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:22 smithi057 ceph-mon[92072]: pgmap v15131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:50:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:22 smithi122 ceph-mon[125440]: pgmap v15131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:50:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:22 smithi136 ceph-mon[125702]: pgmap v15131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:50:24.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:24 smithi057 ceph-mon[92072]: pgmap v15132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:50:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:24 smithi122 ceph-mon[125440]: pgmap v15132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:50:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:24 smithi136 ceph-mon[125702]: pgmap v15132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:50:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:25.755+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:50:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:25.755+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:50:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:25.755+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:50:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:25.755+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:50:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:25.755+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:50:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:26 smithi057 ceph-mon[92072]: pgmap v15133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:50:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:26 smithi122 ceph-mon[125440]: pgmap v15133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:50:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:26 smithi136 ceph-mon[125702]: pgmap v15133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:50:27.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:50:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:50:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:50:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:28 smithi057 ceph-mon[92072]: pgmap v15134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:50:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:28 smithi122 ceph-mon[125440]: pgmap v15134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:50:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:28 smithi136 ceph-mon[125702]: pgmap v15134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:50:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:30 smithi057 ceph-mon[92072]: pgmap v15135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:50:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:30 smithi122 ceph-mon[125440]: pgmap v15135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:50:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:30 smithi136 ceph-mon[125702]: pgmap v15135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:50:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:50:31.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:50:31.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:50:31.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:50:31.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T18:50:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:50:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:50:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:50:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:32 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:50:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:32 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:50:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:32 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:50:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:32 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:50:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:32 smithi122 ceph-mon[125440]: pgmap v15136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:32 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:50:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:32 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:50:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:32 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:50:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:32 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:50:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:32 smithi136 ceph-mon[125702]: pgmap v15136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:32 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T18:50:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:32 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T18:50:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:32 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T18:50:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:32 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T18:50:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:32 smithi057 ceph-mon[92072]: pgmap v15136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:34 smithi122 ceph-mon[125440]: pgmap v15137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:34 smithi136 ceph-mon[125702]: pgmap v15137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:34 smithi057 ceph-mon[92072]: pgmap v15137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:36 smithi136 ceph-mon[125702]: pgmap v15138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:36 smithi057 ceph-mon[92072]: pgmap v15138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:36 smithi122 ceph-mon[125440]: pgmap v15138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:38 smithi136 ceph-mon[125702]: pgmap v15139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:38 smithi057 ceph-mon[92072]: pgmap v15139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:38 smithi122 ceph-mon[125440]: pgmap v15139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:40 smithi136 ceph-mon[125702]: pgmap v15140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:40 smithi057 ceph-mon[92072]: pgmap v15140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:40 smithi122 ceph-mon[125440]: pgmap v15140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:40.768+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:50:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:40.769+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:50:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:40.769+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:50:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:40.769+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:50:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:40.769+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:50:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:42 smithi136 ceph-mon[125702]: pgmap v15141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:42 smithi057 ceph-mon[92072]: pgmap v15141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:42 smithi122 ceph-mon[125440]: pgmap v15141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:44 smithi136 ceph-mon[125702]: pgmap v15142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:44 smithi057 ceph-mon[92072]: pgmap v15142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:44 smithi122 ceph-mon[125440]: pgmap v15142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:46 smithi136 ceph-mon[125702]: pgmap v15143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:46 smithi057 ceph-mon[92072]: pgmap v15143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:46 smithi122 ceph-mon[125440]: pgmap v15143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:48 smithi136 ceph-mon[125702]: pgmap v15144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:48 smithi057 ceph-mon[92072]: pgmap v15144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:48 smithi122 ceph-mon[125440]: pgmap v15144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:50 smithi136 ceph-mon[125702]: pgmap v15145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:50 smithi057 ceph-mon[92072]: pgmap v15145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:50 smithi122 ceph-mon[125440]: pgmap v15145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:52 smithi136 ceph-mon[125702]: pgmap v15146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:52 smithi057 ceph-mon[92072]: pgmap v15146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:52 smithi122 ceph-mon[125440]: pgmap v15146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:53 smithi136 ceph-mon[125702]: pgmap v15147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:53 smithi057 ceph-mon[92072]: pgmap v15147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:53 smithi122 ceph-mon[125440]: pgmap v15147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:55.781+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:50:55.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:55.782+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:50:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:55.782+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:50:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:55.782+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:50:55.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:50:55.782+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:50:56.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:55 smithi057 ceph-mon[92072]: pgmap v15148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:55 smithi122 ceph-mon[125440]: pgmap v15148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:55 smithi136 ceph-mon[125702]: pgmap v15148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:50:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:50:58 smithi057 ceph-mon[92072]: pgmap v15149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:50:58 smithi122 ceph-mon[125440]: pgmap v15149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:50:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:50:58 smithi136 ceph-mon[125702]: pgmap v15149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:00 smithi057 ceph-mon[92072]: pgmap v15150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:00 smithi122 ceph-mon[125440]: pgmap v15150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:00 smithi136 ceph-mon[125702]: pgmap v15150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:02 smithi057 ceph-mon[92072]: pgmap v15151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:02 smithi122 ceph-mon[125440]: pgmap v15151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:02 smithi136 ceph-mon[125702]: pgmap v15151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:04.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:04 smithi057 ceph-mon[92072]: pgmap v15152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:51:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:04 smithi122 ceph-mon[125440]: pgmap v15152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:51:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:04 smithi136 ceph-mon[125702]: pgmap v15152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:51:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:06 smithi057 ceph-mon[92072]: pgmap v15153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:51:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:06 smithi122 ceph-mon[125440]: pgmap v15153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:51:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:06 smithi136 ceph-mon[125702]: pgmap v15153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:51:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:07 smithi122 ceph-mon[125440]: osdmap e1020: 12 total, 12 up, 12 in 2023-03-02T18:51:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:07 smithi136 ceph-mon[125702]: osdmap e1020: 12 total, 12 up, 12 in 2023-03-02T18:51:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:07 smithi057 ceph-mon[92072]: osdmap e1020: 12 total, 12 up, 12 in 2023-03-02T18:51:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:08 smithi122 ceph-mon[125440]: pgmap v15155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:51:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:08 smithi136 ceph-mon[125702]: pgmap v15155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:51:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:08 smithi057 ceph-mon[92072]: pgmap v15155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:51:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:10 smithi136 ceph-mon[125702]: pgmap v15156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:51:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:10 smithi057 ceph-mon[92072]: pgmap v15156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:51:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:10 smithi122 ceph-mon[125440]: pgmap v15156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:51:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:10.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:51:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:10.796+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:51:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:10.796+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:51:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:10.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:51:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:10.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:51:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:12 smithi136 ceph-mon[125702]: pgmap v15157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:51:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:12 smithi136 ceph-mon[125702]: osdmap e1021: 12 total, 12 up, 12 in 2023-03-02T18:51:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:12 smithi057 ceph-mon[92072]: pgmap v15157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:51:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:12 smithi057 ceph-mon[92072]: osdmap e1021: 12 total, 12 up, 12 in 2023-03-02T18:51:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:12 smithi122 ceph-mon[125440]: pgmap v15157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:51:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:12 smithi122 ceph-mon[125440]: osdmap e1021: 12 total, 12 up, 12 in 2023-03-02T18:51:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:14 smithi136 ceph-mon[125702]: pgmap v15159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:51:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:14 smithi057 ceph-mon[92072]: pgmap v15159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:51:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:14 smithi122 ceph-mon[125440]: pgmap v15159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:51:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:16 smithi136 ceph-mon[125702]: pgmap v15160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T18:51:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:16 smithi057 ceph-mon[92072]: pgmap v15160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T18:51:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:16 smithi122 ceph-mon[125440]: pgmap v15160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T18:51:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:18 smithi136 ceph-mon[125702]: pgmap v15161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:51:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:18 smithi057 ceph-mon[92072]: pgmap v15161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:51:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:18 smithi122 ceph-mon[125440]: pgmap v15161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:51:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:20 smithi136 ceph-mon[125702]: pgmap v15162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:51:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:20 smithi057 ceph-mon[92072]: pgmap v15162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:51:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:20 smithi122 ceph-mon[125440]: pgmap v15162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:51:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:22 smithi136 ceph-mon[125702]: pgmap v15163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:51:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:22 smithi057 ceph-mon[92072]: pgmap v15163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:51:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:22 smithi122 ceph-mon[125440]: pgmap v15163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:51:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:24 smithi136 ceph-mon[125702]: pgmap v15164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:51:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:24 smithi057 ceph-mon[92072]: pgmap v15164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:51:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:24 smithi122 ceph-mon[125440]: pgmap v15164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:51:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:25.802+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:51:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:25.802+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:51:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:25.802+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:51:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:25.802+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:51:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:25.802+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:51:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:26 smithi136 ceph-mon[125702]: pgmap v15165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:26 smithi057 ceph-mon[92072]: pgmap v15165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:26 smithi122 ceph-mon[125440]: pgmap v15165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:28 smithi057 ceph-mon[92072]: pgmap v15166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:28 smithi122 ceph-mon[125440]: pgmap v15166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:28 smithi136 ceph-mon[125702]: pgmap v15166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:30 smithi057 ceph-mon[92072]: pgmap v15167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:30 smithi122 ceph-mon[125440]: pgmap v15167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:30 smithi136 ceph-mon[125702]: pgmap v15167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:31.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:51:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:51:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:51:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:32 smithi057 ceph-mon[92072]: pgmap v15168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:51:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:51:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:51:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:32 smithi122 ceph-mon[125440]: pgmap v15168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:51:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:51:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:51:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:32 smithi136 ceph-mon[125702]: pgmap v15168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:51:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:51:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:51:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:34 smithi122 ceph-mon[125440]: pgmap v15169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:34 smithi136 ceph-mon[125702]: pgmap v15169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:34 smithi057 ceph-mon[92072]: pgmap v15169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:36 smithi122 ceph-mon[125440]: pgmap v15170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:36 smithi136 ceph-mon[125702]: pgmap v15170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:36 smithi057 ceph-mon[92072]: pgmap v15170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:38 smithi136 ceph-mon[125702]: pgmap v15171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:38 smithi057 ceph-mon[92072]: pgmap v15171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:38 smithi122 ceph-mon[125440]: pgmap v15171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:40 smithi136 ceph-mon[125702]: pgmap v15172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:40 smithi057 ceph-mon[92072]: pgmap v15172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:40 smithi122 ceph-mon[125440]: pgmap v15172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:40.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:51:40.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:40.808+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:51:40.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:40.808+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:51:40.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:40.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:51:40.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:40.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:51:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:42 smithi136 ceph-mon[125702]: pgmap v15173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:42 smithi057 ceph-mon[92072]: pgmap v15173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:42 smithi122 ceph-mon[125440]: pgmap v15173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:44 smithi136 ceph-mon[125702]: pgmap v15174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:44 smithi057 ceph-mon[92072]: pgmap v15174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:44 smithi122 ceph-mon[125440]: pgmap v15174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:46 smithi136 ceph-mon[125702]: pgmap v15175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:51:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:46 smithi057 ceph-mon[92072]: pgmap v15175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:51:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:46 smithi122 ceph-mon[125440]: pgmap v15175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:51:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:48 smithi136 ceph-mon[125702]: pgmap v15176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:48 smithi057 ceph-mon[92072]: pgmap v15176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:48 smithi122 ceph-mon[125440]: pgmap v15176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:50 smithi136 ceph-mon[125702]: pgmap v15177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:51:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:50 smithi057 ceph-mon[92072]: pgmap v15177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:51:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:50 smithi122 ceph-mon[125440]: pgmap v15177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:51:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:52 smithi136 ceph-mon[125702]: pgmap v15178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:51:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:52 smithi057 ceph-mon[92072]: pgmap v15178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:51:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:52 smithi122 ceph-mon[125440]: pgmap v15178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:51:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:54 smithi136 ceph-mon[125702]: pgmap v15179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:54 smithi057 ceph-mon[92072]: pgmap v15179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:54 smithi122 ceph-mon[125440]: pgmap v15179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:55.824+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:51:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:55.825+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:51:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:55.825+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:51:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:55.825+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:51:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:51:55.825+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:51:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:56 smithi136 ceph-mon[125702]: pgmap v15180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:56 smithi057 ceph-mon[92072]: pgmap v15180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:56 smithi122 ceph-mon[125440]: pgmap v15180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:51:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:51:58 smithi136 ceph-mon[125702]: pgmap v15181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:51:58 smithi057 ceph-mon[92072]: pgmap v15181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:51:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:51:58 smithi122 ceph-mon[125440]: pgmap v15181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:00 smithi136 ceph-mon[125702]: pgmap v15182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:00 smithi057 ceph-mon[92072]: pgmap v15182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:00 smithi122 ceph-mon[125440]: pgmap v15182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:01 smithi136 ceph-mon[125702]: pgmap v15183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:01 smithi057 ceph-mon[92072]: pgmap v15183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:01 smithi122 ceph-mon[125440]: pgmap v15183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:04 smithi122 ceph-mon[125440]: pgmap v15184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:52:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:04 smithi136 ceph-mon[125702]: pgmap v15184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:52:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:04 smithi057 ceph-mon[92072]: pgmap v15184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:52:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:06 smithi122 ceph-mon[125440]: pgmap v15185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:52:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:06 smithi136 ceph-mon[125702]: pgmap v15185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:52:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:06 smithi057 ceph-mon[92072]: pgmap v15185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:52:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:08 smithi136 ceph-mon[125702]: pgmap v15186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:52:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:08 smithi057 ceph-mon[92072]: pgmap v15186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:52:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:08 smithi122 ceph-mon[125440]: pgmap v15186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:52:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:10 smithi136 ceph-mon[125702]: pgmap v15187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:52:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:10 smithi057 ceph-mon[92072]: pgmap v15187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:52:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:10 smithi122 ceph-mon[125440]: pgmap v15187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:52:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:10.828+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:52:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:10.829+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:52:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:10.829+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:52:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:10.829+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:52:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:10.829+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:52:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:12 smithi136 ceph-mon[125702]: pgmap v15188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:52:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:12 smithi136 ceph-mon[125702]: osdmap e1022: 12 total, 12 up, 12 in 2023-03-02T18:52:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:12 smithi057 ceph-mon[92072]: pgmap v15188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:52:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:12 smithi057 ceph-mon[92072]: osdmap e1022: 12 total, 12 up, 12 in 2023-03-02T18:52:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:12 smithi122 ceph-mon[125440]: pgmap v15188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:52:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:12 smithi122 ceph-mon[125440]: osdmap e1022: 12 total, 12 up, 12 in 2023-03-02T18:52:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:14 smithi136 ceph-mon[125702]: pgmap v15190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:14 smithi057 ceph-mon[92072]: pgmap v15190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:14 smithi122 ceph-mon[125440]: pgmap v15190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:16 smithi136 ceph-mon[125702]: pgmap v15191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:16 smithi057 ceph-mon[92072]: pgmap v15191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:16 smithi122 ceph-mon[125440]: pgmap v15191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:18 smithi136 ceph-mon[125702]: pgmap v15192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:52:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:18 smithi057 ceph-mon[92072]: pgmap v15192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:52:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:18 smithi122 ceph-mon[125440]: pgmap v15192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:52:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:20 smithi136 ceph-mon[125702]: pgmap v15193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:52:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:20 smithi057 ceph-mon[92072]: pgmap v15193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:52:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:20 smithi122 ceph-mon[125440]: pgmap v15193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:52:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:22 smithi136 ceph-mon[125702]: pgmap v15194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:52:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:22 smithi136 ceph-mon[125702]: osdmap e1023: 12 total, 12 up, 12 in 2023-03-02T18:52:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:22 smithi057 ceph-mon[92072]: pgmap v15194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:52:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:22 smithi057 ceph-mon[92072]: osdmap e1023: 12 total, 12 up, 12 in 2023-03-02T18:52:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:22 smithi122 ceph-mon[125440]: pgmap v15194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:52:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:22 smithi122 ceph-mon[125440]: osdmap e1023: 12 total, 12 up, 12 in 2023-03-02T18:52:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:24 smithi136 ceph-mon[125702]: pgmap v15196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:24 smithi057 ceph-mon[92072]: pgmap v15196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:24 smithi122 ceph-mon[125440]: pgmap v15196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:25 smithi136 ceph-mon[125702]: pgmap v15197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:25.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:25 smithi057 ceph-mon[92072]: pgmap v15197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:25 smithi122 ceph-mon[125440]: pgmap v15197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:52:25.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:25.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:52:25.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:25.834+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:52:25.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:25.834+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:52:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:25.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:52:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:25.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:52:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:28 smithi122 ceph-mon[125440]: pgmap v15198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:52:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:28 smithi136 ceph-mon[125702]: pgmap v15198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:52:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:28 smithi057 ceph-mon[92072]: pgmap v15198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:52:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:30 smithi122 ceph-mon[125440]: pgmap v15199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:52:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:30 smithi136 ceph-mon[125702]: pgmap v15199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:52:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:30 smithi057 ceph-mon[92072]: pgmap v15199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:52:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:32 smithi122 ceph-mon[125440]: pgmap v15200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:52:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:52:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:52:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:52:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:32 smithi136 ceph-mon[125702]: pgmap v15200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:52:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:52:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:52:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:52:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:32 smithi057 ceph-mon[92072]: pgmap v15200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:52:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:52:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:52:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:52:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:52:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:52:33.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:52:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:52:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:52:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:52:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:52:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:52:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:52:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:34 smithi136 ceph-mon[125702]: pgmap v15201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:52:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:34 smithi057 ceph-mon[92072]: pgmap v15201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:52:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:34 smithi122 ceph-mon[125440]: pgmap v15201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:52:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:36 smithi136 ceph-mon[125702]: pgmap v15202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:36 smithi057 ceph-mon[92072]: pgmap v15202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:36 smithi122 ceph-mon[125440]: pgmap v15202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:38 smithi136 ceph-mon[125702]: pgmap v15203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:38 smithi057 ceph-mon[92072]: pgmap v15203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:38 smithi122 ceph-mon[125440]: pgmap v15203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:40 smithi136 ceph-mon[125702]: pgmap v15204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:40 smithi057 ceph-mon[92072]: pgmap v15204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:40 smithi122 ceph-mon[125440]: pgmap v15204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:40.848+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:52:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:40.848+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:52:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:40.848+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:52:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:40.848+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:52:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:40.848+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:52:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:42 smithi136 ceph-mon[125702]: pgmap v15205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:42 smithi057 ceph-mon[92072]: pgmap v15205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:42 smithi122 ceph-mon[125440]: pgmap v15205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:44 smithi136 ceph-mon[125702]: pgmap v15206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:44 smithi057 ceph-mon[92072]: pgmap v15206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:44 smithi122 ceph-mon[125440]: pgmap v15206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:46 smithi136 ceph-mon[125702]: pgmap v15207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:46 smithi057 ceph-mon[92072]: pgmap v15207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:46 smithi122 ceph-mon[125440]: pgmap v15207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:48 smithi136 ceph-mon[125702]: pgmap v15208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:48 smithi057 ceph-mon[92072]: pgmap v15208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:48 smithi122 ceph-mon[125440]: pgmap v15208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:50 smithi136 ceph-mon[125702]: pgmap v15209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:50 smithi057 ceph-mon[92072]: pgmap v15209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:50 smithi122 ceph-mon[125440]: pgmap v15209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:52 smithi136 ceph-mon[125702]: pgmap v15210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:52 smithi057 ceph-mon[92072]: pgmap v15210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:52 smithi122 ceph-mon[125440]: pgmap v15210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:54 smithi136 ceph-mon[125702]: pgmap v15211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:54 smithi057 ceph-mon[92072]: pgmap v15211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:54 smithi122 ceph-mon[125440]: pgmap v15211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:55.862+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:52:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:55.863+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:52:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:55.863+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:52:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:55.863+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:52:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:52:55.863+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:52:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:56 smithi136 ceph-mon[125702]: pgmap v15212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:56 smithi057 ceph-mon[92072]: pgmap v15212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:56 smithi122 ceph-mon[125440]: pgmap v15212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:52:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:52:58 smithi136 ceph-mon[125702]: pgmap v15213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:52:58 smithi057 ceph-mon[92072]: pgmap v15213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:52:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:52:58 smithi122 ceph-mon[125440]: pgmap v15213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:00 smithi136 ceph-mon[125702]: pgmap v15214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:00 smithi057 ceph-mon[92072]: pgmap v15214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:00 smithi122 ceph-mon[125440]: pgmap v15214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:01 smithi136 ceph-mon[125702]: pgmap v15215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:01 smithi057 ceph-mon[92072]: pgmap v15215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:01 smithi122 ceph-mon[125440]: pgmap v15215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:04 smithi136 ceph-mon[125702]: pgmap v15216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:53:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:04 smithi057 ceph-mon[92072]: pgmap v15216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:53:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:04 smithi122 ceph-mon[125440]: pgmap v15216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:53:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:06 smithi136 ceph-mon[125702]: pgmap v15217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:53:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:06 smithi057 ceph-mon[92072]: pgmap v15217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:53:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:06 smithi122 ceph-mon[125440]: pgmap v15217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T18:53:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:08 smithi136 ceph-mon[125702]: pgmap v15218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:53:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:08 smithi057 ceph-mon[92072]: pgmap v15218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:53:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:08 smithi122 ceph-mon[125440]: pgmap v15218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:53:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:10 smithi136 ceph-mon[125702]: pgmap v15219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:53:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:10 smithi057 ceph-mon[92072]: pgmap v15219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:53:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:10 smithi122 ceph-mon[125440]: pgmap v15219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:53:10.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:10.868+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:53:10.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:10.868+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:53:10.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:10.868+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:53:10.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:10.868+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:53:10.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:10.869+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:53:12.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:12.480+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:53:12.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:12.480+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:53:12.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:12.480+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 221 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:53:12.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:12.480+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 220 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:53:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:12 smithi136 ceph-mon[125702]: pgmap v15220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:53:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:12 smithi136 ceph-mon[125702]: osdmap e1024: 12 total, 12 up, 12 in 2023-03-02T18:53:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:12 smithi057 ceph-mon[92072]: pgmap v15220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:53:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:12 smithi057 ceph-mon[92072]: osdmap e1024: 12 total, 12 up, 12 in 2023-03-02T18:53:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:12 smithi122 ceph-mon[125440]: pgmap v15220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:53:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:12 smithi122 ceph-mon[125440]: osdmap e1024: 12 total, 12 up, 12 in 2023-03-02T18:53:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:14 smithi136 ceph-mon[125702]: pgmap v15222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:53:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:14 smithi057 ceph-mon[92072]: pgmap v15222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:53:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:14 smithi122 ceph-mon[125440]: pgmap v15222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:53:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:16 smithi136 ceph-mon[125702]: pgmap v15223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:53:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:16 smithi057 ceph-mon[92072]: pgmap v15223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:53:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:16 smithi122 ceph-mon[125440]: pgmap v15223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:53:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:18 smithi136 ceph-mon[125702]: pgmap v15224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:53:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:18 smithi136 ceph-mon[125702]: osdmap e1025: 12 total, 12 up, 12 in 2023-03-02T18:53:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:18 smithi057 ceph-mon[92072]: pgmap v15224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:53:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:18 smithi057 ceph-mon[92072]: osdmap e1025: 12 total, 12 up, 12 in 2023-03-02T18:53:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:18 smithi122 ceph-mon[125440]: pgmap v15224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:53:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:18 smithi122 ceph-mon[125440]: osdmap e1025: 12 total, 12 up, 12 in 2023-03-02T18:53:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:20 smithi136 ceph-mon[125702]: pgmap v15226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:53:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:20 smithi057 ceph-mon[92072]: pgmap v15226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:53:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:20 smithi122 ceph-mon[125440]: pgmap v15226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:53:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:22 smithi136 ceph-mon[125702]: pgmap v15227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T18:53:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:22 smithi057 ceph-mon[92072]: pgmap v15227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T18:53:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:22 smithi122 ceph-mon[125440]: pgmap v15227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T18:53:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:24 smithi136 ceph-mon[125702]: pgmap v15228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:53:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:24 smithi057 ceph-mon[92072]: pgmap v15228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:53:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:24 smithi122 ceph-mon[125440]: pgmap v15228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:53:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:25.883+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:53:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:25.884+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:53:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:25.884+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:53:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:25.884+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:53:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:25.884+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:53:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:26 smithi136 ceph-mon[125702]: pgmap v15229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:53:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:26 smithi057 ceph-mon[92072]: pgmap v15229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:53:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:26 smithi122 ceph-mon[125440]: pgmap v15229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:53:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:28 smithi136 ceph-mon[125702]: pgmap v15230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:53:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:28 smithi057 ceph-mon[92072]: pgmap v15230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:53:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:28 smithi122 ceph-mon[125440]: pgmap v15230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:53:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:30 smithi136 ceph-mon[125702]: pgmap v15231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:53:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:30 smithi057 ceph-mon[92072]: pgmap v15231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:53:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:30 smithi122 ceph-mon[125440]: pgmap v15231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:53:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:32 smithi136 ceph-mon[125702]: pgmap v15232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:32 smithi057 ceph-mon[92072]: pgmap v15232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:32 smithi122 ceph-mon[125440]: pgmap v15232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:53:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:53:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:53:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:34 smithi136 ceph-mon[125702]: pgmap v15233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:34 smithi057 ceph-mon[92072]: pgmap v15233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:34 smithi122 ceph-mon[125440]: pgmap v15233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:53:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:53:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:53:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:53:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:53:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:53:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:53:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:36 smithi136 ceph-mon[125702]: pgmap v15234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:36 smithi057 ceph-mon[92072]: pgmap v15234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:36 smithi122 ceph-mon[125440]: pgmap v15234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:38 smithi136 ceph-mon[125702]: pgmap v15235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:38 smithi057 ceph-mon[92072]: pgmap v15235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:38 smithi122 ceph-mon[125440]: pgmap v15235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:40 smithi136 ceph-mon[125702]: pgmap v15236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:40 smithi057 ceph-mon[92072]: pgmap v15236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:40 smithi122 ceph-mon[125440]: pgmap v15236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:40.900 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:40.898+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:53:40.902 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:40.899+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:53:40.902 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:40.899+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:53:40.902 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:40.899+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:53:40.902 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:40.899+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:53:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:42 smithi136 ceph-mon[125702]: pgmap v15237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:42 smithi057 ceph-mon[92072]: pgmap v15237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:42 smithi122 ceph-mon[125440]: pgmap v15237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:44 smithi136 ceph-mon[125702]: pgmap v15238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:44 smithi057 ceph-mon[92072]: pgmap v15238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:44 smithi122 ceph-mon[125440]: pgmap v15238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:46 smithi136 ceph-mon[125702]: pgmap v15239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:46 smithi057 ceph-mon[92072]: pgmap v15239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:46 smithi122 ceph-mon[125440]: pgmap v15239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:48 smithi136 ceph-mon[125702]: pgmap v15240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:48 smithi057 ceph-mon[92072]: pgmap v15240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:48 smithi122 ceph-mon[125440]: pgmap v15240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:50 smithi136 ceph-mon[125702]: pgmap v15241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:50 smithi057 ceph-mon[92072]: pgmap v15241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:50 smithi122 ceph-mon[125440]: pgmap v15241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:52 smithi136 ceph-mon[125702]: pgmap v15242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:52 smithi057 ceph-mon[92072]: pgmap v15242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:52 smithi122 ceph-mon[125440]: pgmap v15242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:54 smithi136 ceph-mon[125702]: pgmap v15243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:54 smithi057 ceph-mon[92072]: pgmap v15243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:54 smithi122 ceph-mon[125440]: pgmap v15243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:55.915+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:55.916+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:55.916+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:55.916+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:53:55.916+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:53:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:56 smithi136 ceph-mon[125702]: pgmap v15244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:56 smithi057 ceph-mon[92072]: pgmap v15244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:56 smithi122 ceph-mon[125440]: pgmap v15244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:53:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:53:58 smithi136 ceph-mon[125702]: pgmap v15245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:53:58 smithi057 ceph-mon[92072]: pgmap v15245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:53:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:53:58 smithi122 ceph-mon[125440]: pgmap v15245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:00 smithi136 ceph-mon[125702]: pgmap v15246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:00 smithi057 ceph-mon[92072]: pgmap v15246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:00 smithi122 ceph-mon[125440]: pgmap v15246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:02 smithi136 ceph-mon[125702]: pgmap v15247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:02 smithi057 ceph-mon[92072]: pgmap v15247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:02 smithi122 ceph-mon[125440]: pgmap v15247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:04 smithi136 ceph-mon[125702]: pgmap v15248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:54:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:04 smithi057 ceph-mon[92072]: pgmap v15248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:54:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:04 smithi122 ceph-mon[125440]: pgmap v15248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:54:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:06 smithi136 ceph-mon[125702]: pgmap v15249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:54:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:06 smithi057 ceph-mon[92072]: pgmap v15249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:54:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:06 smithi122 ceph-mon[125440]: pgmap v15249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:54:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:07 smithi136 ceph-mon[125702]: osdmap e1026: 12 total, 12 up, 12 in 2023-03-02T18:54:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:07 smithi057 ceph-mon[92072]: osdmap e1026: 12 total, 12 up, 12 in 2023-03-02T18:54:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:07 smithi122 ceph-mon[125440]: osdmap e1026: 12 total, 12 up, 12 in 2023-03-02T18:54:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:08 smithi136 ceph-mon[125702]: pgmap v15251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:54:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:08 smithi057 ceph-mon[92072]: pgmap v15251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:54:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:08 smithi122 ceph-mon[125440]: pgmap v15251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:54:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:10 smithi136 ceph-mon[125702]: pgmap v15252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:54:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:10 smithi057 ceph-mon[92072]: pgmap v15252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:54:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:10 smithi122 ceph-mon[125440]: pgmap v15252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:54:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:10.931+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:54:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:10.932+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:54:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:10.932+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:54:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:10.932+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:54:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:10.932+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:54:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:12 smithi136 ceph-mon[125702]: pgmap v15253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:54:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:12 smithi136 ceph-mon[125702]: osdmap e1027: 12 total, 12 up, 12 in 2023-03-02T18:54:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:12 smithi057 ceph-mon[92072]: pgmap v15253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:54:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:12 smithi057 ceph-mon[92072]: osdmap e1027: 12 total, 12 up, 12 in 2023-03-02T18:54:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:12 smithi122 ceph-mon[125440]: pgmap v15253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:54:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:12 smithi122 ceph-mon[125440]: osdmap e1027: 12 total, 12 up, 12 in 2023-03-02T18:54:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:13 smithi136 ceph-mon[125702]: pgmap v15255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:54:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:13 smithi057 ceph-mon[92072]: pgmap v15255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:54:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:13 smithi122 ceph-mon[125440]: pgmap v15255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:54:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:15 smithi136 ceph-mon[125702]: pgmap v15256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T18:54:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:15 smithi057 ceph-mon[92072]: pgmap v15256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T18:54:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:15 smithi122 ceph-mon[125440]: pgmap v15256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T18:54:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:18 smithi136 ceph-mon[125702]: pgmap v15257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:54:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:18 smithi057 ceph-mon[92072]: pgmap v15257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:54:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:18 smithi122 ceph-mon[125440]: pgmap v15257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:54:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:20 smithi136 ceph-mon[125702]: pgmap v15258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:54:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:20 smithi057 ceph-mon[92072]: pgmap v15258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:54:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:20 smithi122 ceph-mon[125440]: pgmap v15258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:54:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:22 smithi136 ceph-mon[125702]: pgmap v15259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:54:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:22 smithi057 ceph-mon[92072]: pgmap v15259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:54:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:22 smithi122 ceph-mon[125440]: pgmap v15259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:54:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:24 smithi136 ceph-mon[125702]: pgmap v15260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:54:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:24 smithi057 ceph-mon[92072]: pgmap v15260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:54:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:24 smithi122 ceph-mon[125440]: pgmap v15260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:54:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:25.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:54:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:25.943+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:54:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:25.943+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:54:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:25.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:54:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:25.943+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:54:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:26 smithi136 ceph-mon[125702]: pgmap v15261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:26 smithi057 ceph-mon[92072]: pgmap v15261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:26 smithi122 ceph-mon[125440]: pgmap v15261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:28 smithi136 ceph-mon[125702]: pgmap v15262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:28 smithi057 ceph-mon[92072]: pgmap v15262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:28 smithi122 ceph-mon[125440]: pgmap v15262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:30 smithi136 ceph-mon[125702]: pgmap v15263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:30 smithi057 ceph-mon[92072]: pgmap v15263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:30 smithi122 ceph-mon[125440]: pgmap v15263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:32 smithi136 ceph-mon[125702]: pgmap v15264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:32 smithi057 ceph-mon[92072]: pgmap v15264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:32 smithi122 ceph-mon[125440]: pgmap v15264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:34 smithi136 ceph-mon[125702]: pgmap v15265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:34 smithi057 ceph-mon[92072]: pgmap v15265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:34 smithi122 ceph-mon[125440]: pgmap v15265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:54:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:54:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:54:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:54:35.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:54:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:54:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:54:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:54:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:54:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:54:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:54:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:54:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:36 smithi136 ceph-mon[125702]: pgmap v15266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:36 smithi057 ceph-mon[92072]: pgmap v15266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:36 smithi122 ceph-mon[125440]: pgmap v15266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:38 smithi136 ceph-mon[125702]: pgmap v15267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:38 smithi057 ceph-mon[92072]: pgmap v15267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:38 smithi122 ceph-mon[125440]: pgmap v15267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:39 smithi136 ceph-mon[125702]: pgmap v15268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:39.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:39 smithi057 ceph-mon[92072]: pgmap v15268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:39 smithi122 ceph-mon[125440]: pgmap v15268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:40.953+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:54:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:40.954+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:54:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:40.954+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:54:40.957 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:40.954+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:54:40.957 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:40.954+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:54:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:41 smithi136 ceph-mon[125702]: pgmap v15269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:41 smithi057 ceph-mon[92072]: pgmap v15269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:41 smithi122 ceph-mon[125440]: pgmap v15269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:44 smithi136 ceph-mon[125702]: pgmap v15270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:44 smithi057 ceph-mon[92072]: pgmap v15270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:44 smithi122 ceph-mon[125440]: pgmap v15270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:46 smithi136 ceph-mon[125702]: pgmap v15271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:46 smithi057 ceph-mon[92072]: pgmap v15271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:46 smithi122 ceph-mon[125440]: pgmap v15271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:48 smithi136 ceph-mon[125702]: pgmap v15272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:48 smithi057 ceph-mon[92072]: pgmap v15272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:48 smithi122 ceph-mon[125440]: pgmap v15272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:50 smithi136 ceph-mon[125702]: pgmap v15273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:50 smithi057 ceph-mon[92072]: pgmap v15273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:50 smithi122 ceph-mon[125440]: pgmap v15273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:52 smithi136 ceph-mon[125702]: pgmap v15274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:52 smithi057 ceph-mon[92072]: pgmap v15274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:52 smithi122 ceph-mon[125440]: pgmap v15274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:54 smithi136 ceph-mon[125702]: pgmap v15275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:54 smithi057 ceph-mon[92072]: pgmap v15275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:54 smithi122 ceph-mon[125440]: pgmap v15275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:55.969+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:54:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:55.969+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:54:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:55.969+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:54:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:55.969+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:54:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:54:55.969+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:54:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:56 smithi136 ceph-mon[125702]: pgmap v15276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:56 smithi057 ceph-mon[92072]: pgmap v15276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:56 smithi122 ceph-mon[125440]: pgmap v15276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:54:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:54:58 smithi136 ceph-mon[125702]: pgmap v15277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:54:58 smithi057 ceph-mon[92072]: pgmap v15277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:54:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:54:58 smithi122 ceph-mon[125440]: pgmap v15277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:00 smithi136 ceph-mon[125702]: pgmap v15278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:00 smithi057 ceph-mon[92072]: pgmap v15278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:00 smithi122 ceph-mon[125440]: pgmap v15278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:02.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:02 smithi136 ceph-mon[125702]: pgmap v15279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:02 smithi057 ceph-mon[92072]: pgmap v15279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:02 smithi122 ceph-mon[125440]: pgmap v15279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:04 smithi136 ceph-mon[125702]: pgmap v15280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:55:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:04 smithi057 ceph-mon[92072]: pgmap v15280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:55:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:04 smithi122 ceph-mon[125440]: pgmap v15280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:55:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:06 smithi136 ceph-mon[125702]: pgmap v15281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:55:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:06 smithi057 ceph-mon[92072]: pgmap v15281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:55:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:06 smithi122 ceph-mon[125440]: pgmap v15281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:55:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:07 smithi136 ceph-mon[125702]: osdmap e1028: 12 total, 12 up, 12 in 2023-03-02T18:55:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:07 smithi136 ceph-mon[125702]: pgmap v15283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:55:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:07 smithi057 ceph-mon[92072]: osdmap e1028: 12 total, 12 up, 12 in 2023-03-02T18:55:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:07 smithi057 ceph-mon[92072]: pgmap v15283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:55:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:07 smithi122 ceph-mon[125440]: osdmap e1028: 12 total, 12 up, 12 in 2023-03-02T18:55:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:07 smithi122 ceph-mon[125440]: pgmap v15283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:55:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:09 smithi136 ceph-mon[125702]: pgmap v15284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:55:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:09 smithi057 ceph-mon[92072]: pgmap v15284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:55:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:09 smithi122 ceph-mon[125440]: pgmap v15284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:55:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:10.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:55:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:10.979+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:55:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:10.979+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:55:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:10.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:55:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:10.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:55:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:11 smithi136 ceph-mon[125702]: pgmap v15285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:55:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:11 smithi057 ceph-mon[92072]: pgmap v15285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:55:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:11 smithi122 ceph-mon[125440]: pgmap v15285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:55:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:13 smithi136 ceph-mon[125702]: osdmap e1029: 12 total, 12 up, 12 in 2023-03-02T18:55:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:13 smithi057 ceph-mon[92072]: osdmap e1029: 12 total, 12 up, 12 in 2023-03-02T18:55:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:13 smithi122 ceph-mon[125440]: osdmap e1029: 12 total, 12 up, 12 in 2023-03-02T18:55:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:14 smithi136 ceph-mon[125702]: pgmap v15287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:55:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:14 smithi057 ceph-mon[92072]: pgmap v15287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:55:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:14 smithi122 ceph-mon[125440]: pgmap v15287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T18:55:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:16 smithi136 ceph-mon[125702]: pgmap v15288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T18:55:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:16 smithi057 ceph-mon[92072]: pgmap v15288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T18:55:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:16 smithi122 ceph-mon[125440]: pgmap v15288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 237 B/s wr, 12 op/s 2023-03-02T18:55:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:18 smithi136 ceph-mon[125702]: pgmap v15289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:55:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:18 smithi057 ceph-mon[92072]: pgmap v15289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:55:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:18 smithi122 ceph-mon[125440]: pgmap v15289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:55:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:20 smithi136 ceph-mon[125702]: pgmap v15290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:55:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:20 smithi057 ceph-mon[92072]: pgmap v15290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:55:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:20 smithi122 ceph-mon[125440]: pgmap v15290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:55:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:22 smithi136 ceph-mon[125702]: pgmap v15291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:55:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:22 smithi057 ceph-mon[92072]: pgmap v15291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:55:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:22 smithi122 ceph-mon[125440]: pgmap v15291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:55:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:24 smithi136 ceph-mon[125702]: pgmap v15292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:55:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:24 smithi057 ceph-mon[92072]: pgmap v15292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:55:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:24 smithi122 ceph-mon[125440]: pgmap v15292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T18:55:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:25.989+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:55:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:25.989+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:55:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:25.989+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:55:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:25.989+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:55:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:25.989+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:55:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:26 smithi136 ceph-mon[125702]: pgmap v15293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:26 smithi057 ceph-mon[92072]: pgmap v15293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:26 smithi122 ceph-mon[125440]: pgmap v15293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:28 smithi136 ceph-mon[125702]: pgmap v15294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:28 smithi057 ceph-mon[92072]: pgmap v15294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:28 smithi122 ceph-mon[125440]: pgmap v15294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:30 smithi136 ceph-mon[125702]: pgmap v15295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:30 smithi057 ceph-mon[92072]: pgmap v15295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:30 smithi122 ceph-mon[125440]: pgmap v15295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:32 smithi136 ceph-mon[125702]: pgmap v15296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:32 smithi057 ceph-mon[92072]: pgmap v15296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:32 smithi122 ceph-mon[125440]: pgmap v15296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:34 smithi136 ceph-mon[125702]: pgmap v15297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:34 smithi057 ceph-mon[92072]: pgmap v15297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:34 smithi122 ceph-mon[125440]: pgmap v15297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:36 smithi136 ceph-mon[125702]: pgmap v15298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:55:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:55:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:55:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:55:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:36 smithi057 ceph-mon[92072]: pgmap v15298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:55:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:55:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:55:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:55:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:36 smithi122 ceph-mon[125440]: pgmap v15298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:55:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:55:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:55:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:55:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:38 smithi136 ceph-mon[125702]: pgmap v15299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:38 smithi057 ceph-mon[92072]: pgmap v15299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:38 smithi122 ceph-mon[125440]: pgmap v15299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:39 smithi136 ceph-mon[125702]: pgmap v15300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:39 smithi057 ceph-mon[92072]: pgmap v15300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:39 smithi122 ceph-mon[125440]: pgmap v15300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:41.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:55:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:41.004+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:55:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:41.004+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:55:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:41.004+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:55:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:41.004+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:55:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:41 smithi136 ceph-mon[125702]: pgmap v15301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:41 smithi057 ceph-mon[92072]: pgmap v15301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:41 smithi122 ceph-mon[125440]: pgmap v15301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:44 smithi136 ceph-mon[125702]: pgmap v15302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:44 smithi057 ceph-mon[92072]: pgmap v15302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:44 smithi122 ceph-mon[125440]: pgmap v15302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:46 smithi136 ceph-mon[125702]: pgmap v15303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:46 smithi057 ceph-mon[92072]: pgmap v15303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:46 smithi122 ceph-mon[125440]: pgmap v15303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:48 smithi136 ceph-mon[125702]: pgmap v15304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:48 smithi057 ceph-mon[92072]: pgmap v15304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:48 smithi122 ceph-mon[125440]: pgmap v15304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:50 smithi136 ceph-mon[125702]: pgmap v15305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:50 smithi057 ceph-mon[92072]: pgmap v15305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:50 smithi122 ceph-mon[125440]: pgmap v15305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:52 smithi136 ceph-mon[125702]: pgmap v15306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:52 smithi057 ceph-mon[92072]: pgmap v15306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:52 smithi122 ceph-mon[125440]: pgmap v15306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:54 smithi136 ceph-mon[125702]: pgmap v15307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:54 smithi057 ceph-mon[92072]: pgmap v15307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:54 smithi122 ceph-mon[125440]: pgmap v15307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:56.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:55:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:56.018+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:55:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:56.018+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:55:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:56.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:55:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:55:56.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:55:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:56 smithi136 ceph-mon[125702]: pgmap v15308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:56 smithi057 ceph-mon[92072]: pgmap v15308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:56 smithi122 ceph-mon[125440]: pgmap v15308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:55:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:55:58 smithi136 ceph-mon[125702]: pgmap v15309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:55:58 smithi057 ceph-mon[92072]: pgmap v15309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:55:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:55:58 smithi122 ceph-mon[125440]: pgmap v15309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:00 smithi136 ceph-mon[125702]: pgmap v15310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:00 smithi057 ceph-mon[92072]: pgmap v15310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:00 smithi122 ceph-mon[125440]: pgmap v15310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:01 smithi136 ceph-mon[125702]: pgmap v15311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:01 smithi057 ceph-mon[92072]: pgmap v15311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:01 smithi122 ceph-mon[125440]: pgmap v15311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:04 smithi136 ceph-mon[125702]: pgmap v15312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:56:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:04 smithi057 ceph-mon[92072]: pgmap v15312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:56:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:04 smithi122 ceph-mon[125440]: pgmap v15312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:56:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:06 smithi136 ceph-mon[125702]: pgmap v15313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:56:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:06 smithi057 ceph-mon[92072]: pgmap v15313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:56:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:06 smithi122 ceph-mon[125440]: pgmap v15313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:56:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:07 smithi136 ceph-mon[125702]: osdmap e1030: 12 total, 12 up, 12 in 2023-03-02T18:56:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:07 smithi057 ceph-mon[92072]: osdmap e1030: 12 total, 12 up, 12 in 2023-03-02T18:56:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:07 smithi122 ceph-mon[125440]: osdmap e1030: 12 total, 12 up, 12 in 2023-03-02T18:56:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:08 smithi136 ceph-mon[125702]: pgmap v15315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:56:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:08 smithi057 ceph-mon[92072]: pgmap v15315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:56:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:08 smithi122 ceph-mon[125440]: pgmap v15315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:56:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:10 smithi136 ceph-mon[125702]: pgmap v15316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:56:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:10 smithi057 ceph-mon[92072]: pgmap v15316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:56:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:10 smithi122 ceph-mon[125440]: pgmap v15316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:56:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:11.020+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:56:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:11.020+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:56:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:11.021+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:56:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:11.021+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:56:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:11.021+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:56:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:12.506+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:56:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:12.506+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:56:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:12.506+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 221 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:56:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:12.506+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 222 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:56:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:12 smithi136 ceph-mon[125702]: pgmap v15317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:56:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:12 smithi057 ceph-mon[92072]: pgmap v15317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:56:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:12 smithi122 ceph-mon[125440]: pgmap v15317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:56:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:14 smithi136 ceph-mon[125702]: pgmap v15318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:56:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:14 smithi057 ceph-mon[92072]: pgmap v15318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:56:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:14 smithi122 ceph-mon[125440]: pgmap v15318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:56:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:16 smithi136 ceph-mon[125702]: pgmap v15319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:56:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:16 smithi057 ceph-mon[92072]: pgmap v15319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:56:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:16 smithi122 ceph-mon[125440]: pgmap v15319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:56:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:18 smithi136 ceph-mon[125702]: pgmap v15320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:56:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:18 smithi136 ceph-mon[125702]: osdmap e1031: 12 total, 12 up, 12 in 2023-03-02T18:56:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:18 smithi057 ceph-mon[92072]: pgmap v15320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:56:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:18 smithi057 ceph-mon[92072]: osdmap e1031: 12 total, 12 up, 12 in 2023-03-02T18:56:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:18 smithi122 ceph-mon[125440]: pgmap v15320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:56:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:18 smithi122 ceph-mon[125440]: osdmap e1031: 12 total, 12 up, 12 in 2023-03-02T18:56:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:20 smithi136 ceph-mon[125702]: pgmap v15322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:56:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:20 smithi057 ceph-mon[92072]: pgmap v15322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:56:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:20 smithi122 ceph-mon[125440]: pgmap v15322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:56:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:22 smithi136 ceph-mon[125702]: pgmap v15323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:56:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:22 smithi057 ceph-mon[92072]: pgmap v15323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:56:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:22 smithi122 ceph-mon[125440]: pgmap v15323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:56:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:24 smithi136 ceph-mon[125702]: pgmap v15324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:56:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:24 smithi057 ceph-mon[92072]: pgmap v15324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:56:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:24 smithi122 ceph-mon[125440]: pgmap v15324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:56:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:26.036+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:56:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:26.037+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:56:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:26.037+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:56:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:26.037+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:56:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:26.037+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:56:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:26 smithi136 ceph-mon[125702]: pgmap v15325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:56:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:26 smithi057 ceph-mon[92072]: pgmap v15325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:56:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:26 smithi122 ceph-mon[125440]: pgmap v15325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:56:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:28 smithi136 ceph-mon[125702]: pgmap v15326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:56:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:28 smithi057 ceph-mon[92072]: pgmap v15326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:56:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:28 smithi122 ceph-mon[125440]: pgmap v15326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:56:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:30 smithi136 ceph-mon[125702]: pgmap v15327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:56:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:30 smithi057 ceph-mon[92072]: pgmap v15327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:56:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:30 smithi122 ceph-mon[125440]: pgmap v15327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:56:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:32 smithi136 ceph-mon[125702]: pgmap v15328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:32 smithi057 ceph-mon[92072]: pgmap v15328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:32 smithi122 ceph-mon[125440]: pgmap v15328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:34 smithi136 ceph-mon[125702]: pgmap v15329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:34 smithi057 ceph-mon[92072]: pgmap v15329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:34 smithi122 ceph-mon[125440]: pgmap v15329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:36 smithi136 ceph-mon[125702]: pgmap v15330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:56:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:36 smithi057 ceph-mon[92072]: pgmap v15330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:56:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:36 smithi122 ceph-mon[125440]: pgmap v15330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:56:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:56:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:56:37.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:56:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:56:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:56:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:56:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:56:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:56:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:56:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:38 smithi136 ceph-mon[125702]: pgmap v15331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:38 smithi057 ceph-mon[92072]: pgmap v15331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:38 smithi122 ceph-mon[125440]: pgmap v15331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:39 smithi136 ceph-mon[125702]: pgmap v15332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:39 smithi057 ceph-mon[92072]: pgmap v15332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:39 smithi122 ceph-mon[125440]: pgmap v15332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:41.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:56:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:41.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:56:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:41.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:56:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:41.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:56:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:41.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:56:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:41 smithi136 ceph-mon[125702]: pgmap v15333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:41 smithi057 ceph-mon[92072]: pgmap v15333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:41 smithi122 ceph-mon[125440]: pgmap v15333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:44 smithi136 ceph-mon[125702]: pgmap v15334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:44 smithi057 ceph-mon[92072]: pgmap v15334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:44 smithi122 ceph-mon[125440]: pgmap v15334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:46 smithi136 ceph-mon[125702]: pgmap v15335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:46 smithi057 ceph-mon[92072]: pgmap v15335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:46 smithi122 ceph-mon[125440]: pgmap v15335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:48 smithi136 ceph-mon[125702]: pgmap v15336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:48 smithi057 ceph-mon[92072]: pgmap v15336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:48 smithi122 ceph-mon[125440]: pgmap v15336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:50 smithi136 ceph-mon[125702]: pgmap v15337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:50 smithi057 ceph-mon[92072]: pgmap v15337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:50 smithi122 ceph-mon[125440]: pgmap v15337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:52 smithi136 ceph-mon[125702]: pgmap v15338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:52 smithi057 ceph-mon[92072]: pgmap v15338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:52 smithi122 ceph-mon[125440]: pgmap v15338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:56:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:54 smithi136 ceph-mon[125702]: pgmap v15339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:54 smithi057 ceph-mon[92072]: pgmap v15339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:54 smithi122 ceph-mon[125440]: pgmap v15339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:56.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:56.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:56:56.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:56.058+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:56:56.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:56.058+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:56:56.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:56.058+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:56:56.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:56:56.059+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:56:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:56 smithi136 ceph-mon[125702]: pgmap v15340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:56:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:56 smithi057 ceph-mon[92072]: pgmap v15340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:56:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:56 smithi122 ceph-mon[125440]: pgmap v15340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:56:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:58 smithi136 ceph-mon[125702]: pgmap v15341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:58 smithi057 ceph-mon[92072]: pgmap v15341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:58 smithi122 ceph-mon[125440]: pgmap v15341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:56:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:56:59 smithi136 ceph-mon[125702]: pgmap v15342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:56:59.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:56:59 smithi057 ceph-mon[92072]: pgmap v15342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:56:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:56:59 smithi122 ceph-mon[125440]: pgmap v15342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:57:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:01 smithi136 ceph-mon[125702]: pgmap v15343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:57:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:01 smithi057 ceph-mon[92072]: pgmap v15343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:57:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:01 smithi122 ceph-mon[125440]: pgmap v15343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T18:57:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:04 smithi136 ceph-mon[125702]: pgmap v15344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:57:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:04 smithi057 ceph-mon[92072]: pgmap v15344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:57:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:04 smithi122 ceph-mon[125440]: pgmap v15344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:57:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:06 smithi136 ceph-mon[125702]: pgmap v15345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:57:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:06 smithi057 ceph-mon[92072]: pgmap v15345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:57:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:06 smithi122 ceph-mon[125440]: pgmap v15345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:57:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:07 smithi136 ceph-mon[125702]: osdmap e1032: 12 total, 12 up, 12 in 2023-03-02T18:57:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:07 smithi057 ceph-mon[92072]: osdmap e1032: 12 total, 12 up, 12 in 2023-03-02T18:57:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:07 smithi122 ceph-mon[125440]: osdmap e1032: 12 total, 12 up, 12 in 2023-03-02T18:57:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:08 smithi136 ceph-mon[125702]: pgmap v15347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:57:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:08 smithi057 ceph-mon[92072]: pgmap v15347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:57:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:08 smithi122 ceph-mon[125440]: pgmap v15347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:57:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:10 smithi136 ceph-mon[125702]: pgmap v15348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:57:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:10 smithi057 ceph-mon[92072]: pgmap v15348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:57:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:10 smithi122 ceph-mon[125440]: pgmap v15348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:57:11.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:11.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:57:11.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:11.064+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:57:11.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:11.064+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:57:11.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:11.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:57:11.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:11.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:57:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:12 smithi136 ceph-mon[125702]: pgmap v15349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:57:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:12 smithi057 ceph-mon[92072]: pgmap v15349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:57:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:12 smithi122 ceph-mon[125440]: pgmap v15349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:57:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:14 smithi136 ceph-mon[125702]: pgmap v15350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:57:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:14 smithi057 ceph-mon[92072]: pgmap v15350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:57:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:14 smithi122 ceph-mon[125440]: pgmap v15350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:57:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:16 smithi136 ceph-mon[125702]: pgmap v15351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:57:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:16 smithi057 ceph-mon[92072]: pgmap v15351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:57:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:16 smithi122 ceph-mon[125440]: pgmap v15351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:57:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:18 smithi136 ceph-mon[125702]: pgmap v15352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:57:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:18 smithi136 ceph-mon[125702]: osdmap e1033: 12 total, 12 up, 12 in 2023-03-02T18:57:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:18 smithi057 ceph-mon[92072]: pgmap v15352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:57:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:18 smithi057 ceph-mon[92072]: osdmap e1033: 12 total, 12 up, 12 in 2023-03-02T18:57:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:18 smithi122 ceph-mon[125440]: pgmap v15352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:57:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:18 smithi122 ceph-mon[125440]: osdmap e1033: 12 total, 12 up, 12 in 2023-03-02T18:57:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:20 smithi136 ceph-mon[125702]: pgmap v15354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:57:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:20 smithi057 ceph-mon[92072]: pgmap v15354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:57:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:20 smithi122 ceph-mon[125440]: pgmap v15354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:57:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:22 smithi136 ceph-mon[125702]: pgmap v15355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:57:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:22 smithi057 ceph-mon[92072]: pgmap v15355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:57:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:22 smithi122 ceph-mon[125440]: pgmap v15355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T18:57:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:24 smithi136 ceph-mon[125702]: pgmap v15356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:57:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:24 smithi057 ceph-mon[92072]: pgmap v15356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:57:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:24 smithi122 ceph-mon[125440]: pgmap v15356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:57:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:26.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:57:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:26.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:57:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:26.080+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:57:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:26.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:57:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:26.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:57:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:26 smithi136 ceph-mon[125702]: pgmap v15357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:57:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:26 smithi057 ceph-mon[92072]: pgmap v15357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:57:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:26 smithi122 ceph-mon[125440]: pgmap v15357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:57:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:28 smithi136 ceph-mon[125702]: pgmap v15358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:57:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:28 smithi057 ceph-mon[92072]: pgmap v15358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:57:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:28 smithi122 ceph-mon[125440]: pgmap v15358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:57:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:30 smithi136 ceph-mon[125702]: pgmap v15359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:57:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:30 smithi057 ceph-mon[92072]: pgmap v15359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:57:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:30 smithi122 ceph-mon[125440]: pgmap v15359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:57:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:32 smithi136 ceph-mon[125702]: pgmap v15360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:32 smithi057 ceph-mon[92072]: pgmap v15360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:32 smithi122 ceph-mon[125440]: pgmap v15360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:34 smithi136 ceph-mon[125702]: pgmap v15361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:34 smithi057 ceph-mon[92072]: pgmap v15361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:34 smithi122 ceph-mon[125440]: pgmap v15361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:36 smithi136 ceph-mon[125702]: pgmap v15362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:36 smithi057 ceph-mon[92072]: pgmap v15362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:36 smithi122 ceph-mon[125440]: pgmap v15362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:57:37.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:57:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:57:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:38 smithi136 ceph-mon[125702]: pgmap v15363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:57:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:57:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:57:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:38 smithi057 ceph-mon[92072]: pgmap v15363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:57:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:57:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:57:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:38 smithi122 ceph-mon[125440]: pgmap v15363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:57:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:57:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:57:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:39 smithi136 ceph-mon[125702]: pgmap v15364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:39 smithi057 ceph-mon[92072]: pgmap v15364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:39 smithi122 ceph-mon[125440]: pgmap v15364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:41.088+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:57:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:41.089+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:57:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:41.089+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:57:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:41.089+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:57:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:41.089+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:57:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:42 smithi136 ceph-mon[125702]: pgmap v15365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:42 smithi057 ceph-mon[92072]: pgmap v15365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:42 smithi122 ceph-mon[125440]: pgmap v15365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:42.519+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:57:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:42.519+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:57:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:42.520+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 222 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:57:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:42.520+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 223 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:57:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:44 smithi136 ceph-mon[125702]: pgmap v15366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:44 smithi057 ceph-mon[92072]: pgmap v15366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:44 smithi122 ceph-mon[125440]: pgmap v15366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:46 smithi136 ceph-mon[125702]: pgmap v15367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:46 smithi057 ceph-mon[92072]: pgmap v15367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:46 smithi122 ceph-mon[125440]: pgmap v15367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:48 smithi136 ceph-mon[125702]: pgmap v15368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:48 smithi057 ceph-mon[92072]: pgmap v15368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:48 smithi122 ceph-mon[125440]: pgmap v15368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:50 smithi136 ceph-mon[125702]: pgmap v15369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:50 smithi057 ceph-mon[92072]: pgmap v15369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:50 smithi122 ceph-mon[125440]: pgmap v15369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:52 smithi136 ceph-mon[125702]: pgmap v15370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:52 smithi057 ceph-mon[92072]: pgmap v15370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:52 smithi122 ceph-mon[125440]: pgmap v15370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:54 smithi136 ceph-mon[125702]: pgmap v15371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:54 smithi057 ceph-mon[92072]: pgmap v15371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:54 smithi122 ceph-mon[125440]: pgmap v15371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:56.103+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:57:56.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:56.104+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:57:56.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:56.104+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:57:56.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:56.104+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:57:56.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:57:56.104+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:57:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:56 smithi136 ceph-mon[125702]: pgmap v15372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:56 smithi057 ceph-mon[92072]: pgmap v15372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:56 smithi122 ceph-mon[125440]: pgmap v15372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:57:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:57:58 smithi136 ceph-mon[125702]: pgmap v15373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:57:58 smithi057 ceph-mon[92072]: pgmap v15373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:57:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:57:58 smithi122 ceph-mon[125440]: pgmap v15373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:00 smithi136 ceph-mon[125702]: pgmap v15374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:00 smithi057 ceph-mon[92072]: pgmap v15374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:00 smithi122 ceph-mon[125440]: pgmap v15374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:02 smithi136 ceph-mon[125702]: pgmap v15375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:02 smithi057 ceph-mon[92072]: pgmap v15375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:02 smithi122 ceph-mon[125440]: pgmap v15375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:04 smithi136 ceph-mon[125702]: pgmap v15376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:58:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:04 smithi057 ceph-mon[92072]: pgmap v15376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:58:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:04 smithi122 ceph-mon[125440]: pgmap v15376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:58:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:06 smithi136 ceph-mon[125702]: pgmap v15377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:58:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:06 smithi057 ceph-mon[92072]: pgmap v15377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:58:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:06 smithi122 ceph-mon[125440]: pgmap v15377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:58:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:07 smithi136 ceph-mon[125702]: osdmap e1034: 12 total, 12 up, 12 in 2023-03-02T18:58:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:07 smithi136 ceph-mon[125702]: pgmap v15379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:58:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:07 smithi057 ceph-mon[92072]: osdmap e1034: 12 total, 12 up, 12 in 2023-03-02T18:58:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:07 smithi057 ceph-mon[92072]: pgmap v15379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:58:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:07 smithi122 ceph-mon[125440]: osdmap e1034: 12 total, 12 up, 12 in 2023-03-02T18:58:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:07 smithi122 ceph-mon[125440]: pgmap v15379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:58:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:10 smithi136 ceph-mon[125702]: pgmap v15380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:58:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:10 smithi057 ceph-mon[92072]: pgmap v15380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:58:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:10 smithi122 ceph-mon[125440]: pgmap v15380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:58:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:11.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:58:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:11.114+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:58:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:11.114+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:58:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:11.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:58:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:11.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:58:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:12 smithi136 ceph-mon[125702]: pgmap v15381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:58:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:12 smithi057 ceph-mon[92072]: pgmap v15381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:58:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:12 smithi122 ceph-mon[125440]: pgmap v15381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T18:58:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:14 smithi136 ceph-mon[125702]: pgmap v15382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:58:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:14 smithi057 ceph-mon[92072]: pgmap v15382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:58:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:14 smithi122 ceph-mon[125440]: pgmap v15382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:58:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:16 smithi136 ceph-mon[125702]: pgmap v15383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:58:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:16 smithi057 ceph-mon[92072]: pgmap v15383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:58:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:16 smithi122 ceph-mon[125440]: pgmap v15383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:58:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:18 smithi136 ceph-mon[125702]: pgmap v15384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:58:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:18 smithi136 ceph-mon[125702]: osdmap e1035: 12 total, 12 up, 12 in 2023-03-02T18:58:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:18 smithi057 ceph-mon[92072]: pgmap v15384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:58:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:18 smithi057 ceph-mon[92072]: osdmap e1035: 12 total, 12 up, 12 in 2023-03-02T18:58:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:18 smithi122 ceph-mon[125440]: pgmap v15384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T18:58:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:18 smithi122 ceph-mon[125440]: osdmap e1035: 12 total, 12 up, 12 in 2023-03-02T18:58:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:20 smithi136 ceph-mon[125702]: pgmap v15386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:58:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:20 smithi057 ceph-mon[92072]: pgmap v15386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:58:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:20 smithi122 ceph-mon[125440]: pgmap v15386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:58:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:22 smithi136 ceph-mon[125702]: pgmap v15387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:58:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:22 smithi057 ceph-mon[92072]: pgmap v15387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:58:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:22 smithi122 ceph-mon[125440]: pgmap v15387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T18:58:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:24 smithi136 ceph-mon[125702]: pgmap v15388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:58:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:24 smithi057 ceph-mon[92072]: pgmap v15388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:58:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:24 smithi122 ceph-mon[125440]: pgmap v15388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:58:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:26.131+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:58:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:26.131+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:58:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:26.131+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:58:26.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:26.131+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:58:26.133 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:26.131+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:58:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:26 smithi136 ceph-mon[125702]: pgmap v15389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:58:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:26 smithi057 ceph-mon[92072]: pgmap v15389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:58:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:26 smithi122 ceph-mon[125440]: pgmap v15389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:58:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:28 smithi136 ceph-mon[125702]: pgmap v15390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:58:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:28 smithi057 ceph-mon[92072]: pgmap v15390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:58:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:28 smithi122 ceph-mon[125440]: pgmap v15390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T18:58:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:30 smithi136 ceph-mon[125702]: pgmap v15391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:58:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:30 smithi057 ceph-mon[92072]: pgmap v15391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:58:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:30 smithi122 ceph-mon[125440]: pgmap v15391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T18:58:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:31 smithi136 ceph-mon[125702]: pgmap v15392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:31 smithi057 ceph-mon[92072]: pgmap v15392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:31 smithi122 ceph-mon[125440]: pgmap v15392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:34 smithi136 ceph-mon[125702]: pgmap v15393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:34 smithi057 ceph-mon[92072]: pgmap v15393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:34 smithi122 ceph-mon[125440]: pgmap v15393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:36 smithi136 ceph-mon[125702]: pgmap v15394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:36 smithi057 ceph-mon[92072]: pgmap v15394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:36 smithi122 ceph-mon[125440]: pgmap v15394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:38 smithi136 ceph-mon[125702]: pgmap v15395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:58:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:38 smithi057 ceph-mon[92072]: pgmap v15395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:58:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:38 smithi122 ceph-mon[125440]: pgmap v15395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:58:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:58:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:58:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:58:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:58:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:58:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:58:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:58:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:58:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:58:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:40 smithi136 ceph-mon[125702]: pgmap v15396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:40 smithi057 ceph-mon[92072]: pgmap v15396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:40 smithi122 ceph-mon[125440]: pgmap v15396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:41.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:41.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:58:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:41.138+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:58:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:41.138+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:58:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:41.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:58:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:41.138+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:58:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:42 smithi136 ceph-mon[125702]: pgmap v15397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:42 smithi057 ceph-mon[92072]: pgmap v15397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:42 smithi122 ceph-mon[125440]: pgmap v15397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:43 smithi136 ceph-mon[125702]: pgmap v15398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:43 smithi057 ceph-mon[92072]: pgmap v15398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:43 smithi122 ceph-mon[125440]: pgmap v15398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:46 smithi136 ceph-mon[125702]: pgmap v15399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:46 smithi057 ceph-mon[92072]: pgmap v15399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:46 smithi122 ceph-mon[125440]: pgmap v15399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:48 smithi136 ceph-mon[125702]: pgmap v15400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:48 smithi057 ceph-mon[92072]: pgmap v15400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:48 smithi122 ceph-mon[125440]: pgmap v15400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:50 smithi136 ceph-mon[125702]: pgmap v15401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:50 smithi057 ceph-mon[92072]: pgmap v15401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:50 smithi122 ceph-mon[125440]: pgmap v15401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:52 smithi136 ceph-mon[125702]: pgmap v15402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:52 smithi057 ceph-mon[92072]: pgmap v15402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:52 smithi122 ceph-mon[125440]: pgmap v15402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:54 smithi136 ceph-mon[125702]: pgmap v15403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:54.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:54 smithi057 ceph-mon[92072]: pgmap v15403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:54 smithi122 ceph-mon[125440]: pgmap v15403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:55 smithi057 ceph-mon[92072]: pgmap v15404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:55 smithi122 ceph-mon[125440]: pgmap v15404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:55 smithi136 ceph-mon[125702]: pgmap v15404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:58:56.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:56.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:58:56.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:56.139+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:58:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:56.139+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:58:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:56.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:58:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:58:56.140+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:58:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:58:58 smithi136 ceph-mon[125702]: pgmap v15405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:58:58 smithi057 ceph-mon[92072]: pgmap v15405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:58:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:58:58 smithi122 ceph-mon[125440]: pgmap v15405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:00 smithi136 ceph-mon[125702]: pgmap v15406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:00 smithi057 ceph-mon[92072]: pgmap v15406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:00 smithi122 ceph-mon[125440]: pgmap v15406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:02 smithi136 ceph-mon[125702]: pgmap v15407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:02 smithi057 ceph-mon[92072]: pgmap v15407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:02 smithi122 ceph-mon[125440]: pgmap v15407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:04 smithi136 ceph-mon[125702]: pgmap v15408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:59:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:04 smithi057 ceph-mon[92072]: pgmap v15408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:59:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:04 smithi122 ceph-mon[125440]: pgmap v15408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:59:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:06 smithi136 ceph-mon[125702]: pgmap v15409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:59:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:06 smithi057 ceph-mon[92072]: pgmap v15409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:59:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:06 smithi122 ceph-mon[125440]: pgmap v15409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:59:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:08.422+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T18:59:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:08.422+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T18:59:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:08.422+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5870019780 tx=0x7f58700b9000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:59:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:08.422+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5870019780 tx=0x7f58700b9000 comp rx=0 tx=0).stop 2023-03-02T18:59:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:08.422+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T18:59:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:08.422+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T18:59:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:08.422+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T18:59:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:08.422+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T18:59:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:08.422+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:59:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:08.422+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5870019780 tx=0x7f587008e000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T18:59:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:08 smithi136 ceph-mon[125702]: pgmap v15410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:59:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:08 smithi057 ceph-mon[92072]: pgmap v15410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:59:08.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:08 smithi122 ceph-mon[125440]: pgmap v15410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T18:59:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:10 smithi136 ceph-mon[125702]: pgmap v15411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:59:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:10 smithi057 ceph-mon[92072]: pgmap v15411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:59:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:10 smithi122 ceph-mon[125440]: pgmap v15411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:59:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:11.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:59:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:11.151+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:59:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:11.151+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:59:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:11.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:59:11.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:11.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:59:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:12.531+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:59:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:12.531+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:59:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:12.532+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 223 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T18:59:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:12.532+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 224 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T18:59:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:12 smithi136 ceph-mon[125702]: pgmap v15412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:59:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:12 smithi136 ceph-mon[125702]: osdmap e1036: 12 total, 12 up, 12 in 2023-03-02T18:59:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:12 smithi057 ceph-mon[92072]: pgmap v15412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:59:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:12 smithi057 ceph-mon[92072]: osdmap e1036: 12 total, 12 up, 12 in 2023-03-02T18:59:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:12 smithi122 ceph-mon[125440]: pgmap v15412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T18:59:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:12 smithi122 ceph-mon[125440]: osdmap e1036: 12 total, 12 up, 12 in 2023-03-02T18:59:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:14 smithi136 ceph-mon[125702]: pgmap v15414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:59:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:14 smithi057 ceph-mon[92072]: pgmap v15414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:59:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:14 smithi122 ceph-mon[125440]: pgmap v15414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:59:15.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:15 smithi057 ceph-mon[92072]: pgmap v15415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:59:15.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:15 smithi122 ceph-mon[125440]: pgmap v15415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:59:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:15 smithi136 ceph-mon[125702]: pgmap v15415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T18:59:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:18 smithi136 ceph-mon[125702]: pgmap v15416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:59:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:18 smithi136 ceph-mon[125702]: osdmap e1037: 12 total, 12 up, 12 in 2023-03-02T18:59:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:18 smithi057 ceph-mon[92072]: pgmap v15416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:59:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:18 smithi057 ceph-mon[92072]: osdmap e1037: 12 total, 12 up, 12 in 2023-03-02T18:59:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:18 smithi122 ceph-mon[125440]: pgmap v15416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T18:59:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:18 smithi122 ceph-mon[125440]: osdmap e1037: 12 total, 12 up, 12 in 2023-03-02T18:59:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:20 smithi136 ceph-mon[125702]: pgmap v15418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T18:59:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:20 smithi057 ceph-mon[92072]: pgmap v15418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T18:59:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:20 smithi122 ceph-mon[125440]: pgmap v15418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T18:59:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:22 smithi136 ceph-mon[125702]: pgmap v15419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 318 B/s wr, 10 op/s 2023-03-02T18:59:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:22 smithi057 ceph-mon[92072]: pgmap v15419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 318 B/s wr, 10 op/s 2023-03-02T18:59:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:22 smithi122 ceph-mon[125440]: pgmap v15419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 318 B/s wr, 10 op/s 2023-03-02T18:59:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:24 smithi136 ceph-mon[125702]: pgmap v15420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T18:59:24.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:24 smithi057 ceph-mon[92072]: pgmap v15420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T18:59:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:24 smithi122 ceph-mon[125440]: pgmap v15420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T18:59:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:26.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:59:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:26.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:59:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:26.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:59:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:26.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:59:26.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:26.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:59:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:26 smithi136 ceph-mon[125702]: pgmap v15421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T18:59:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:26 smithi057 ceph-mon[92072]: pgmap v15421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T18:59:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:26 smithi122 ceph-mon[125440]: pgmap v15421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T18:59:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:28 smithi136 ceph-mon[125702]: pgmap v15422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T18:59:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:28 smithi057 ceph-mon[92072]: pgmap v15422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T18:59:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:28 smithi122 ceph-mon[125440]: pgmap v15422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T18:59:29.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:29 smithi057 ceph-mon[92072]: pgmap v15423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T18:59:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:29 smithi122 ceph-mon[125440]: pgmap v15423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T18:59:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:29 smithi136 ceph-mon[125702]: pgmap v15423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T18:59:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:32 smithi136 ceph-mon[125702]: pgmap v15424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:32 smithi057 ceph-mon[92072]: pgmap v15424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:32 smithi122 ceph-mon[125440]: pgmap v15424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:34 smithi136 ceph-mon[125702]: pgmap v15425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:59:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:34 smithi057 ceph-mon[92072]: pgmap v15425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:59:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:34 smithi122 ceph-mon[125440]: pgmap v15425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T18:59:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:36 smithi136 ceph-mon[125702]: pgmap v15426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:36 smithi057 ceph-mon[92072]: pgmap v15426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:36 smithi122 ceph-mon[125440]: pgmap v15426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:38 smithi136 ceph-mon[125702]: pgmap v15427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:38 smithi057 ceph-mon[92072]: pgmap v15427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:38 smithi122 ceph-mon[125440]: pgmap v15427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:39.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:59:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:39 smithi057 ceph-mon[92072]: pgmap v15428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:59:39.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:39 smithi122 ceph-mon[125440]: pgmap v15428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T18:59:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:39 smithi136 ceph-mon[125702]: pgmap v15428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:59:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:59:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:59:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:59:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:59:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:59:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T18:59:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T18:59:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T18:59:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:41.184+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:59:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:41.184+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:59:41.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:41.184+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:59:41.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:41.184+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:59:41.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:41.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:59:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:41 smithi057 ceph-mon[92072]: pgmap v15429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:41 smithi122 ceph-mon[125440]: pgmap v15429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:41 smithi136 ceph-mon[125702]: pgmap v15429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:44 smithi136 ceph-mon[125702]: pgmap v15430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:44 smithi057 ceph-mon[92072]: pgmap v15430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:44 smithi122 ceph-mon[125440]: pgmap v15430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:46 smithi136 ceph-mon[125702]: pgmap v15431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:46 smithi057 ceph-mon[92072]: pgmap v15431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:46 smithi122 ceph-mon[125440]: pgmap v15431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:48 smithi136 ceph-mon[125702]: pgmap v15432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:48 smithi057 ceph-mon[92072]: pgmap v15432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:48 smithi122 ceph-mon[125440]: pgmap v15432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:50 smithi136 ceph-mon[125702]: pgmap v15433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:50 smithi057 ceph-mon[92072]: pgmap v15433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:50 smithi122 ceph-mon[125440]: pgmap v15433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:52 smithi057 ceph-mon[92072]: pgmap v15434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:52 smithi122 ceph-mon[125440]: pgmap v15434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:52 smithi136 ceph-mon[125702]: pgmap v15434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:53 smithi057 ceph-mon[92072]: pgmap v15435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:53 smithi122 ceph-mon[125440]: pgmap v15435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:53 smithi136 ceph-mon[125702]: pgmap v15435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:56.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:56.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T18:59:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:56.192+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T18:59:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:56.192+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T18:59:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:56.192+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T18:59:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T18:59:56.192+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T18:59:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:56 smithi136 ceph-mon[125702]: pgmap v15436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:56 smithi057 ceph-mon[92072]: pgmap v15436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:56 smithi122 ceph-mon[125440]: pgmap v15436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T18:59:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 18:59:58 smithi136 ceph-mon[125702]: pgmap v15437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 18:59:58 smithi057 ceph-mon[92072]: pgmap v15437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T18:59:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 18:59:58 smithi122 ceph-mon[125440]: pgmap v15437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:00 smithi136 ceph-mon[125702]: pgmap v15438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T19:00:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:00 smithi057 ceph-mon[92072]: pgmap v15438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T19:00:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:00 smithi122 ceph-mon[125440]: pgmap v15438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T19:00:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:02 smithi136 ceph-mon[125702]: pgmap v15439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:02 smithi057 ceph-mon[92072]: pgmap v15439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:02 smithi122 ceph-mon[125440]: pgmap v15439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:03 smithi057 ceph-mon[92072]: pgmap v15440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:00:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:03 smithi122 ceph-mon[125440]: pgmap v15440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:00:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:03 smithi136 ceph-mon[125702]: pgmap v15440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:00:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:06 smithi136 ceph-mon[125702]: pgmap v15441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:00:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:06 smithi057 ceph-mon[92072]: pgmap v15441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:00:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:06 smithi122 ceph-mon[125440]: pgmap v15441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:00:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:08 smithi057 ceph-mon[92072]: pgmap v15442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:00:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:08 smithi122 ceph-mon[125440]: pgmap v15442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:00:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:08 smithi136 ceph-mon[125702]: pgmap v15442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:00:09.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:09 smithi122 ceph-mon[125440]: pgmap v15443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:00:09.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:09 smithi057 ceph-mon[92072]: pgmap v15443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:00:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:09 smithi136 ceph-mon[125702]: pgmap v15443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:00:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:11.205+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:00:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:11.206+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:00:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:11.206+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:00:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:11.206+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:00:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:11.206+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:00:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:12 smithi136 ceph-mon[125702]: pgmap v15444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:00:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:12 smithi136 ceph-mon[125702]: osdmap e1038: 12 total, 12 up, 12 in 2023-03-02T19:00:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:12 smithi057 ceph-mon[92072]: pgmap v15444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:00:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:12 smithi057 ceph-mon[92072]: osdmap e1038: 12 total, 12 up, 12 in 2023-03-02T19:00:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:12 smithi122 ceph-mon[125440]: pgmap v15444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:00:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:12 smithi122 ceph-mon[125440]: osdmap e1038: 12 total, 12 up, 12 in 2023-03-02T19:00:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:14 smithi136 ceph-mon[125702]: pgmap v15446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:14.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:14 smithi057 ceph-mon[92072]: pgmap v15446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:14 smithi122 ceph-mon[125440]: pgmap v15446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:16 smithi057 ceph-mon[92072]: pgmap v15447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:16 smithi122 ceph-mon[125440]: pgmap v15447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:16 smithi136 ceph-mon[125702]: pgmap v15447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:18 smithi136 ceph-mon[125702]: pgmap v15448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:18 smithi057 ceph-mon[92072]: pgmap v15448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:18 smithi122 ceph-mon[125440]: pgmap v15448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:20 smithi136 ceph-mon[125702]: pgmap v15449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:20 smithi057 ceph-mon[92072]: pgmap v15449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:20 smithi122 ceph-mon[125440]: pgmap v15449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:22 smithi057 ceph-mon[92072]: pgmap v15450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:22 smithi057 ceph-mon[92072]: osdmap e1039: 12 total, 12 up, 12 in 2023-03-02T19:00:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:22 smithi122 ceph-mon[125440]: pgmap v15450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:22 smithi122 ceph-mon[125440]: osdmap e1039: 12 total, 12 up, 12 in 2023-03-02T19:00:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:22 smithi136 ceph-mon[125702]: pgmap v15450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:00:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:22 smithi136 ceph-mon[125702]: osdmap e1039: 12 total, 12 up, 12 in 2023-03-02T19:00:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:23 smithi057 ceph-mon[92072]: pgmap v15452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:00:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:23 smithi122 ceph-mon[125440]: pgmap v15452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:00:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:23 smithi136 ceph-mon[125702]: pgmap v15452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:00:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:26.214+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:00:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:26.214+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:00:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:26.214+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:00:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:26.214+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:00:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:26.214+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:00:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:26 smithi136 ceph-mon[125702]: pgmap v15453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:00:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:26 smithi057 ceph-mon[92072]: pgmap v15453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:00:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:26 smithi122 ceph-mon[125440]: pgmap v15453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:00:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:28 smithi057 ceph-mon[92072]: pgmap v15454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:00:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:28 smithi122 ceph-mon[125440]: pgmap v15454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:00:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:28 smithi136 ceph-mon[125702]: pgmap v15454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:00:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:30 smithi057 ceph-mon[92072]: pgmap v15455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:00:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:30 smithi122 ceph-mon[125440]: pgmap v15455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:00:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:30 smithi136 ceph-mon[125702]: pgmap v15455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:00:31.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:31 smithi057 ceph-mon[92072]: pgmap v15456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:00:31.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:31 smithi122 ceph-mon[125440]: pgmap v15456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:00:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:31 smithi136 ceph-mon[125702]: pgmap v15456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:00:34.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:34 smithi057 ceph-mon[92072]: pgmap v15457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:00:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:34 smithi122 ceph-mon[125440]: pgmap v15457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:00:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:34 smithi136 ceph-mon[125702]: pgmap v15457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:00:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:36 smithi057 ceph-mon[92072]: pgmap v15458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:36 smithi122 ceph-mon[125440]: pgmap v15458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:36 smithi136 ceph-mon[125702]: pgmap v15458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:38 smithi057 ceph-mon[92072]: pgmap v15459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:38 smithi122 ceph-mon[125440]: pgmap v15459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:38 smithi136 ceph-mon[125702]: pgmap v15459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:40 smithi057 ceph-mon[92072]: pgmap v15460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:00:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:40 smithi122 ceph-mon[125440]: pgmap v15460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:00:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:40 smithi136 ceph-mon[125702]: pgmap v15460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:41.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:41.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:41.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:41.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:41.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:00:41.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:41 smithi057 ceph-mon[92072]: pgmap v15461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:41.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:41 smithi122 ceph-mon[125440]: pgmap v15461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:41 smithi136 ceph-mon[125702]: pgmap v15461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: pgmap v15462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:43.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:00:43.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:00:43.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:00:43.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:00:43.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: pgmap v15462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:43.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:00:43.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:00:43.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:00:43.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:00:43.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:43.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: pgmap v15462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:43.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:00:43.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:00:43.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:00:43.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:00:43.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:00:43.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:00:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:44 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:00:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:44 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:00:45.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:44 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:00:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:44 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:00:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:44 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:00:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:44 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:00:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:45 smithi136 ceph-mon[125702]: pgmap v15463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:46.182 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:45 smithi057 ceph-mon[92072]: pgmap v15463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:45 smithi122 ceph-mon[125440]: pgmap v15463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:48 smithi057 ceph-mon[92072]: pgmap v15464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:48 smithi122 ceph-mon[125440]: pgmap v15464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:48 smithi136 ceph-mon[125702]: pgmap v15464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:49.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:49 smithi057 ceph-mon[92072]: pgmap v15465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:49 smithi122 ceph-mon[125440]: pgmap v15465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:49 smithi136 ceph-mon[125702]: pgmap v15465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:52 smithi136 ceph-mon[125702]: pgmap v15466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:52 smithi057 ceph-mon[92072]: pgmap v15466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:52 smithi122 ceph-mon[125440]: pgmap v15466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:54 smithi057 ceph-mon[92072]: pgmap v15467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:54 smithi122 ceph-mon[125440]: pgmap v15467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:54 smithi136 ceph-mon[125702]: pgmap v15467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:55.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:55 smithi057 ceph-mon[92072]: pgmap v15468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:55 smithi122 ceph-mon[125440]: pgmap v15468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:55 smithi136 ceph-mon[125702]: pgmap v15468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:00:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:56.245+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:00:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:56.245+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:00:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:56.245+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:00:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:56.245+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:00:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:00:56.245+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:00:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:00:58 smithi057 ceph-mon[92072]: pgmap v15469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:00:58 smithi122 ceph-mon[125440]: pgmap v15469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:00:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:00:58 smithi136 ceph-mon[125702]: pgmap v15469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:00 smithi057 ceph-mon[92072]: pgmap v15470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:00 smithi122 ceph-mon[125440]: pgmap v15470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:00 smithi136 ceph-mon[125702]: pgmap v15470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:01.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:01 smithi057 ceph-mon[92072]: pgmap v15471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:01 smithi122 ceph-mon[125440]: pgmap v15471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:01.789 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:01 smithi136 ceph-mon[125702]: pgmap v15471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:04 smithi057 ceph-mon[92072]: pgmap v15472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:01:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:04 smithi122 ceph-mon[125440]: pgmap v15472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:01:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:04 smithi136 ceph-mon[125702]: pgmap v15472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:01:05.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:05 smithi057 ceph-mon[92072]: pgmap v15473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:01:05.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:05 smithi122 ceph-mon[125440]: pgmap v15473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:01:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:05 smithi136 ceph-mon[125702]: pgmap v15473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:01:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:07 smithi057 ceph-mon[92072]: osdmap e1040: 12 total, 12 up, 12 in 2023-03-02T19:01:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:07 smithi057 ceph-mon[92072]: pgmap v15475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:01:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:07 smithi122 ceph-mon[125440]: osdmap e1040: 12 total, 12 up, 12 in 2023-03-02T19:01:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:07 smithi122 ceph-mon[125440]: pgmap v15475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:01:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:07 smithi136 ceph-mon[125702]: osdmap e1040: 12 total, 12 up, 12 in 2023-03-02T19:01:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:07 smithi136 ceph-mon[125702]: pgmap v15475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:01:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:10 smithi136 ceph-mon[125702]: pgmap v15476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:01:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:10 smithi057 ceph-mon[92072]: pgmap v15476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:01:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:10 smithi122 ceph-mon[125440]: pgmap v15476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:01:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:11.258+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:01:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:11.258+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:01:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:11.258+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:01:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:11.258+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:01:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:11.258+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:01:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:12 smithi136 ceph-mon[125702]: pgmap v15477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:01:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:12 smithi057 ceph-mon[92072]: pgmap v15477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:01:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:12 smithi122 ceph-mon[125440]: pgmap v15477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:01:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:13 smithi057 ceph-mon[92072]: osdmap e1041: 12 total, 12 up, 12 in 2023-03-02T19:01:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:13 smithi057 ceph-mon[92072]: pgmap v15479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:01:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:13 smithi122 ceph-mon[125440]: osdmap e1041: 12 total, 12 up, 12 in 2023-03-02T19:01:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:13 smithi122 ceph-mon[125440]: pgmap v15479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:01:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:13 smithi136 ceph-mon[125702]: osdmap e1041: 12 total, 12 up, 12 in 2023-03-02T19:01:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:13 smithi136 ceph-mon[125702]: pgmap v15479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:01:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:16 smithi136 ceph-mon[125702]: pgmap v15480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T19:01:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:16 smithi057 ceph-mon[92072]: pgmap v15480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T19:01:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:16 smithi122 ceph-mon[125440]: pgmap v15480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 236 B/s wr, 12 op/s 2023-03-02T19:01:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:18 smithi057 ceph-mon[92072]: pgmap v15481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:01:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:18 smithi122 ceph-mon[125440]: pgmap v15481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:01:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:18 smithi136 ceph-mon[125702]: pgmap v15481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:01:19.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:19 smithi057 ceph-mon[92072]: pgmap v15482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:01:19.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:19 smithi122 ceph-mon[125440]: pgmap v15482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:01:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:19 smithi136 ceph-mon[125702]: pgmap v15482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:01:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:22 smithi136 ceph-mon[125702]: pgmap v15483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:01:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:22 smithi057 ceph-mon[92072]: pgmap v15483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:01:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:22 smithi122 ceph-mon[125440]: pgmap v15483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:01:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:23 smithi057 ceph-mon[92072]: pgmap v15484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:01:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:23 smithi122 ceph-mon[125440]: pgmap v15484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:01:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:23 smithi136 ceph-mon[125702]: pgmap v15484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:01:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:26.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:01:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:26.263+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:01:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:26.263+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:01:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:26.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:01:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:26.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:01:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:26 smithi136 ceph-mon[125702]: pgmap v15485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:26 smithi057 ceph-mon[92072]: pgmap v15485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:26 smithi122 ceph-mon[125440]: pgmap v15485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:28 smithi136 ceph-mon[125702]: pgmap v15486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:01:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:28 smithi057 ceph-mon[92072]: pgmap v15486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:01:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:28 smithi122 ceph-mon[125440]: pgmap v15486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:01:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:30 smithi136 ceph-mon[125702]: pgmap v15487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:30 smithi057 ceph-mon[92072]: pgmap v15487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:30 smithi122 ceph-mon[125440]: pgmap v15487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:32 smithi136 ceph-mon[125702]: pgmap v15488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:32 smithi057 ceph-mon[92072]: pgmap v15488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:32 smithi122 ceph-mon[125440]: pgmap v15488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:33 smithi057 ceph-mon[92072]: pgmap v15489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:33 smithi122 ceph-mon[125440]: pgmap v15489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:33 smithi136 ceph-mon[125702]: pgmap v15489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:36 smithi136 ceph-mon[125702]: pgmap v15490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:36 smithi057 ceph-mon[92072]: pgmap v15490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:36 smithi122 ceph-mon[125440]: pgmap v15490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:38 smithi136 ceph-mon[125702]: pgmap v15491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:38 smithi057 ceph-mon[92072]: pgmap v15491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:38 smithi122 ceph-mon[125440]: pgmap v15491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:40 smithi136 ceph-mon[125702]: pgmap v15492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:40 smithi057 ceph-mon[92072]: pgmap v15492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:40 smithi122 ceph-mon[125440]: pgmap v15492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:41.278+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:01:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:41.278+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:01:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:41.278+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:01:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:41.278+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:01:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:41.278+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:01:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:42 smithi057 ceph-mon[92072]: pgmap v15493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:42 smithi122 ceph-mon[125440]: pgmap v15493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:42 smithi136 ceph-mon[125702]: pgmap v15493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:43 smithi057 ceph-mon[92072]: pgmap v15494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:43 smithi122 ceph-mon[125440]: pgmap v15494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:43 smithi136 ceph-mon[125702]: pgmap v15494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:44.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:01:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:01:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:01:45.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:01:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:01:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:01:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:45 smithi057 ceph-mon[92072]: pgmap v15495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:01:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:01:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:01:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:45 smithi122 ceph-mon[125440]: pgmap v15495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:01:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:01:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:01:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:45 smithi136 ceph-mon[125702]: pgmap v15495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:48 smithi136 ceph-mon[125702]: pgmap v15496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:48 smithi057 ceph-mon[92072]: pgmap v15496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:48 smithi122 ceph-mon[125440]: pgmap v15496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:50 smithi136 ceph-mon[125702]: pgmap v15497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:50 smithi057 ceph-mon[92072]: pgmap v15497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:50 smithi122 ceph-mon[125440]: pgmap v15497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:52 smithi057 ceph-mon[92072]: pgmap v15498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:52 smithi122 ceph-mon[125440]: pgmap v15498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:52 smithi136 ceph-mon[125702]: pgmap v15498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:53 smithi057 ceph-mon[92072]: pgmap v15499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:53 smithi122 ceph-mon[125440]: pgmap v15499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:53 smithi136 ceph-mon[125702]: pgmap v15499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:56.281+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:01:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:56.281+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:01:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:56.281+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:01:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:56.281+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:01:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:01:56.281+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:01:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:56 smithi136 ceph-mon[125702]: pgmap v15500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:56.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:56 smithi057 ceph-mon[92072]: pgmap v15500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:56 smithi122 ceph-mon[125440]: pgmap v15500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:01:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:01:58 smithi057 ceph-mon[92072]: pgmap v15501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:01:58 smithi122 ceph-mon[125440]: pgmap v15501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:01:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:01:58 smithi136 ceph-mon[125702]: pgmap v15501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:00 smithi057 ceph-mon[92072]: pgmap v15502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:00 smithi122 ceph-mon[125440]: pgmap v15502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:00 smithi136 ceph-mon[125702]: pgmap v15502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:02 smithi057 ceph-mon[92072]: pgmap v15503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:02 smithi122 ceph-mon[125440]: pgmap v15503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:02 smithi136 ceph-mon[125702]: pgmap v15503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:03 smithi057 ceph-mon[92072]: pgmap v15504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:02:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:03 smithi122 ceph-mon[125440]: pgmap v15504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:02:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:03 smithi136 ceph-mon[125702]: pgmap v15504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:02:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:06 smithi136 ceph-mon[125702]: pgmap v15505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:02:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:06 smithi057 ceph-mon[92072]: pgmap v15505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:02:06.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:06 smithi122 ceph-mon[125440]: pgmap v15505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:02:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:07 smithi057 ceph-mon[92072]: osdmap e1042: 12 total, 12 up, 12 in 2023-03-02T19:02:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:07 smithi122 ceph-mon[125440]: osdmap e1042: 12 total, 12 up, 12 in 2023-03-02T19:02:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:07 smithi136 ceph-mon[125702]: osdmap e1042: 12 total, 12 up, 12 in 2023-03-02T19:02:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:08 smithi057 ceph-mon[92072]: pgmap v15507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:02:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:08 smithi122 ceph-mon[125440]: pgmap v15507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:02:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:08 smithi136 ceph-mon[125702]: pgmap v15507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:02:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:10 smithi057 ceph-mon[92072]: pgmap v15508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:02:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:10 smithi122 ceph-mon[125440]: pgmap v15508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:02:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:10 smithi136 ceph-mon[125702]: pgmap v15508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:02:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:11.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:02:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:11.297+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:02:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:11.297+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:02:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:11.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:02:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:11.297+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:02:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:12 smithi057 ceph-mon[92072]: pgmap v15509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:02:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:12 smithi122 ceph-mon[125440]: pgmap v15509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:02:12.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:12.559+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:02:12.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:12.559+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:02:12.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:12.559+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 225 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:02:12.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:12.559+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 224 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:02:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:12 smithi136 ceph-mon[125702]: pgmap v15509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:02:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:13 smithi057 ceph-mon[92072]: pgmap v15510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:02:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:13 smithi122 ceph-mon[125440]: pgmap v15510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:02:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:13 smithi136 ceph-mon[125702]: pgmap v15510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:02:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:16 smithi057 ceph-mon[92072]: pgmap v15511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:02:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:16 smithi122 ceph-mon[125440]: pgmap v15511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:02:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:16 smithi136 ceph-mon[125702]: pgmap v15511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:02:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:18 smithi057 ceph-mon[92072]: pgmap v15512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 13 op/s 2023-03-02T19:02:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:18 smithi057 ceph-mon[92072]: osdmap e1043: 12 total, 12 up, 12 in 2023-03-02T19:02:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:18 smithi122 ceph-mon[125440]: pgmap v15512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 13 op/s 2023-03-02T19:02:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:18 smithi122 ceph-mon[125440]: osdmap e1043: 12 total, 12 up, 12 in 2023-03-02T19:02:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:18 smithi136 ceph-mon[125702]: pgmap v15512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 13 op/s 2023-03-02T19:02:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:18 smithi136 ceph-mon[125702]: osdmap e1043: 12 total, 12 up, 12 in 2023-03-02T19:02:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:20 smithi057 ceph-mon[92072]: pgmap v15514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:02:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:20 smithi122 ceph-mon[125440]: pgmap v15514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:02:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:20 smithi136 ceph-mon[125702]: pgmap v15514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:02:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:22 smithi057 ceph-mon[92072]: pgmap v15515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:02:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:22 smithi122 ceph-mon[125440]: pgmap v15515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:02:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:22 smithi136 ceph-mon[125702]: pgmap v15515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:02:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:23 smithi057 ceph-mon[92072]: pgmap v15516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:02:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:23 smithi122 ceph-mon[125440]: pgmap v15516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:02:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:23 smithi136 ceph-mon[125702]: pgmap v15516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:02:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:26.298+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:02:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:26.299+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:02:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:26.299+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:02:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:26.299+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:02:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:26.299+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:02:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:26 smithi057 ceph-mon[92072]: pgmap v15517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:02:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:26 smithi122 ceph-mon[125440]: pgmap v15517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:02:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:26 smithi136 ceph-mon[125702]: pgmap v15517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:02:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:28 smithi057 ceph-mon[92072]: pgmap v15518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:02:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:28 smithi122 ceph-mon[125440]: pgmap v15518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:02:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:28 smithi136 ceph-mon[125702]: pgmap v15518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:02:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:30 smithi057 ceph-mon[92072]: pgmap v15519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:02:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:30 smithi122 ceph-mon[125440]: pgmap v15519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:02:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:30 smithi136 ceph-mon[125702]: pgmap v15519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:02:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:32 smithi057 ceph-mon[92072]: pgmap v15520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:32 smithi122 ceph-mon[125440]: pgmap v15520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:32 smithi136 ceph-mon[125702]: pgmap v15520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:33 smithi057 ceph-mon[92072]: pgmap v15521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:33 smithi122 ceph-mon[125440]: pgmap v15521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:33 smithi136 ceph-mon[125702]: pgmap v15521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:36 smithi057 ceph-mon[92072]: pgmap v15522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:36 smithi122 ceph-mon[125440]: pgmap v15522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:36 smithi136 ceph-mon[125702]: pgmap v15522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:38 smithi057 ceph-mon[92072]: pgmap v15523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:38 smithi122 ceph-mon[125440]: pgmap v15523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:38 smithi136 ceph-mon[125702]: pgmap v15523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:40 smithi057 ceph-mon[92072]: pgmap v15524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:40 smithi122 ceph-mon[125440]: pgmap v15524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:40 smithi136 ceph-mon[125702]: pgmap v15524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:41.311 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:41.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:02:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:41.311+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:02:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:41.311+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:02:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:41.311+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:02:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:41.311+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:02:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:42 smithi057 ceph-mon[92072]: pgmap v15525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:42 smithi122 ceph-mon[125440]: pgmap v15525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:42 smithi136 ceph-mon[125702]: pgmap v15525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:43 smithi057 ceph-mon[92072]: pgmap v15526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:43 smithi122 ceph-mon[125440]: pgmap v15526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:43 smithi136 ceph-mon[125702]: pgmap v15526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:44.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:02:44.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:02:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:02:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:46 smithi136 ceph-mon[125702]: pgmap v15527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:02:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:02:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:02:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:02:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:02:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:46 smithi057 ceph-mon[92072]: pgmap v15527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:02:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:02:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:02:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:02:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:02:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:46 smithi122 ceph-mon[125440]: pgmap v15527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:02:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:02:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:02:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:02:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:02:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:48 smithi136 ceph-mon[125702]: pgmap v15528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:48 smithi057 ceph-mon[92072]: pgmap v15528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:48 smithi122 ceph-mon[125440]: pgmap v15528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:50 smithi057 ceph-mon[92072]: pgmap v15529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:50 smithi122 ceph-mon[125440]: pgmap v15529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:50 smithi136 ceph-mon[125702]: pgmap v15529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:52 smithi057 ceph-mon[92072]: pgmap v15530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:52 smithi122 ceph-mon[125440]: pgmap v15530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:52 smithi136 ceph-mon[125702]: pgmap v15530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:53 smithi057 ceph-mon[92072]: pgmap v15531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:53 smithi122 ceph-mon[125440]: pgmap v15531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:53 smithi136 ceph-mon[125702]: pgmap v15531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:56.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:02:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:56.317+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:02:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:56.317+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:02:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:56.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:02:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:02:56.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:02:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:56 smithi057 ceph-mon[92072]: pgmap v15532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:56 smithi122 ceph-mon[125440]: pgmap v15532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:56 smithi136 ceph-mon[125702]: pgmap v15532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:02:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:02:58 smithi057 ceph-mon[92072]: pgmap v15533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:02:58 smithi122 ceph-mon[125440]: pgmap v15533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:02:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:02:58 smithi136 ceph-mon[125702]: pgmap v15533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:00 smithi057 ceph-mon[92072]: pgmap v15534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:00 smithi122 ceph-mon[125440]: pgmap v15534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:00 smithi136 ceph-mon[125702]: pgmap v15534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:02 smithi057 ceph-mon[92072]: pgmap v15535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:02 smithi122 ceph-mon[125440]: pgmap v15535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:02 smithi136 ceph-mon[125702]: pgmap v15535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:03 smithi057 ceph-mon[92072]: pgmap v15536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:03:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:03 smithi122 ceph-mon[125440]: pgmap v15536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:03:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:03 smithi136 ceph-mon[125702]: pgmap v15536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:03:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:06 smithi057 ceph-mon[92072]: pgmap v15537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:03:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:06 smithi122 ceph-mon[125440]: pgmap v15537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:03:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:06 smithi136 ceph-mon[125702]: pgmap v15537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:03:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:07 smithi057 ceph-mon[92072]: osdmap e1044: 12 total, 12 up, 12 in 2023-03-02T19:03:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:07 smithi122 ceph-mon[125440]: osdmap e1044: 12 total, 12 up, 12 in 2023-03-02T19:03:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:07 smithi136 ceph-mon[125702]: osdmap e1044: 12 total, 12 up, 12 in 2023-03-02T19:03:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:08 smithi057 ceph-mon[92072]: pgmap v15539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:03:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:08 smithi057 ceph-mon[92072]: osdmap e1045: 12 total, 12 up, 12 in 2023-03-02T19:03:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:08 smithi122 ceph-mon[125440]: pgmap v15539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:03:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:08 smithi122 ceph-mon[125440]: osdmap e1045: 12 total, 12 up, 12 in 2023-03-02T19:03:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:08 smithi136 ceph-mon[125702]: pgmap v15539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:03:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:08 smithi136 ceph-mon[125702]: osdmap e1045: 12 total, 12 up, 12 in 2023-03-02T19:03:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:10 smithi057 ceph-mon[92072]: pgmap v15541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:03:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:10 smithi122 ceph-mon[125440]: pgmap v15541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:03:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:10 smithi136 ceph-mon[125702]: pgmap v15541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:03:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:11.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:11.333+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:11.333+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:11.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:03:11.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:11.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:03:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:12 smithi057 ceph-mon[92072]: pgmap v15542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:03:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:12 smithi122 ceph-mon[125440]: pgmap v15542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:03:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:12 smithi136 ceph-mon[125702]: pgmap v15542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:03:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:13 smithi057 ceph-mon[92072]: pgmap v15543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:03:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:13 smithi122 ceph-mon[125440]: pgmap v15543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:03:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:13 smithi136 ceph-mon[125702]: pgmap v15543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:03:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:16 smithi057 ceph-mon[92072]: pgmap v15544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:03:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:16 smithi122 ceph-mon[125440]: pgmap v15544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:03:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:16 smithi136 ceph-mon[125702]: pgmap v15544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:03:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:18 smithi057 ceph-mon[92072]: pgmap v15545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:03:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:18 smithi122 ceph-mon[125440]: pgmap v15545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:03:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:18 smithi136 ceph-mon[125702]: pgmap v15545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:03:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:20 smithi057 ceph-mon[92072]: pgmap v15546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:03:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:20 smithi122 ceph-mon[125440]: pgmap v15546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:03:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:20 smithi136 ceph-mon[125702]: pgmap v15546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:03:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:22 smithi057 ceph-mon[92072]: pgmap v15547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:03:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:22 smithi122 ceph-mon[125440]: pgmap v15547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:03:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:22 smithi136 ceph-mon[125702]: pgmap v15547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:03:23.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:23 smithi057 ceph-mon[92072]: pgmap v15548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:03:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:23 smithi122 ceph-mon[125440]: pgmap v15548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:03:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:23 smithi136 ceph-mon[125702]: pgmap v15548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:03:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:26.341+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:03:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:26.341+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:03:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:26.341+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:03:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:26.341+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:03:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:26.341+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:03:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:26 smithi057 ceph-mon[92072]: pgmap v15549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:26 smithi122 ceph-mon[125440]: pgmap v15549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:26 smithi136 ceph-mon[125702]: pgmap v15549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:28 smithi057 ceph-mon[92072]: pgmap v15550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:28 smithi122 ceph-mon[125440]: pgmap v15550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:28 smithi136 ceph-mon[125702]: pgmap v15550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:30 smithi057 ceph-mon[92072]: pgmap v15551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:30 smithi122 ceph-mon[125440]: pgmap v15551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:30 smithi136 ceph-mon[125702]: pgmap v15551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:32 smithi057 ceph-mon[92072]: pgmap v15552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:32 smithi122 ceph-mon[125440]: pgmap v15552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:32 smithi136 ceph-mon[125702]: pgmap v15552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:33 smithi057 ceph-mon[92072]: pgmap v15553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:33 smithi122 ceph-mon[125440]: pgmap v15553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:33 smithi136 ceph-mon[125702]: pgmap v15553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:36 smithi057 ceph-mon[92072]: pgmap v15554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:36 smithi122 ceph-mon[125440]: pgmap v15554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:36 smithi136 ceph-mon[125702]: pgmap v15554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:38 smithi057 ceph-mon[92072]: pgmap v15555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:38 smithi122 ceph-mon[125440]: pgmap v15555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:38 smithi136 ceph-mon[125702]: pgmap v15555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:40 smithi057 ceph-mon[92072]: pgmap v15556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:40 smithi122 ceph-mon[125440]: pgmap v15556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:40 smithi136 ceph-mon[125702]: pgmap v15556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:41.352+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:03:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:41.352+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:03:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:41.352+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:03:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:41.352+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:03:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:41.353+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:03:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:42 smithi057 ceph-mon[92072]: pgmap v15557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:42 smithi122 ceph-mon[125440]: pgmap v15557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:42 smithi136 ceph-mon[125702]: pgmap v15557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:43 smithi057 ceph-mon[92072]: pgmap v15558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:43 smithi122 ceph-mon[125440]: pgmap v15558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:43 smithi136 ceph-mon[125702]: pgmap v15558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:46 smithi057 ceph-mon[92072]: pgmap v15559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:03:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:46 smithi122 ceph-mon[125440]: pgmap v15559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:03:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:46 smithi136 ceph-mon[125702]: pgmap v15559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:03:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:47 smithi136 ceph-mon[125702]: pgmap v15560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:03:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:03:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:47 smithi057 ceph-mon[92072]: pgmap v15560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:47.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:03:47.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:03:47.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:47 smithi122 ceph-mon[125440]: pgmap v15560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:03:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:03:47.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:03:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:50 smithi057 ceph-mon[92072]: pgmap v15561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:50 smithi122 ceph-mon[125440]: pgmap v15561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:50.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:50 smithi136 ceph-mon[125702]: pgmap v15561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:52 smithi057 ceph-mon[92072]: pgmap v15562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:52 smithi122 ceph-mon[125440]: pgmap v15562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:52 smithi136 ceph-mon[125702]: pgmap v15562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:53 smithi057 ceph-mon[92072]: pgmap v15563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:53.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:53 smithi122 ceph-mon[125440]: pgmap v15563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:53 smithi136 ceph-mon[125702]: pgmap v15563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:56.356+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:03:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:56.356+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:03:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:56.356+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:03:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:56.356+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:03:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:03:56.356+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:03:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:56 smithi057 ceph-mon[92072]: pgmap v15564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:56 smithi122 ceph-mon[125440]: pgmap v15564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:56 smithi136 ceph-mon[125702]: pgmap v15564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:03:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:03:58 smithi057 ceph-mon[92072]: pgmap v15565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:03:58 smithi122 ceph-mon[125440]: pgmap v15565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:03:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:03:58 smithi136 ceph-mon[125702]: pgmap v15565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:00 smithi057 ceph-mon[92072]: pgmap v15566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:00 smithi122 ceph-mon[125440]: pgmap v15566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:00 smithi136 ceph-mon[125702]: pgmap v15566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:02 smithi057 ceph-mon[92072]: pgmap v15567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:02 smithi122 ceph-mon[125440]: pgmap v15567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:02 smithi136 ceph-mon[125702]: pgmap v15567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:03 smithi057 ceph-mon[92072]: pgmap v15568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:04:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:03 smithi122 ceph-mon[125440]: pgmap v15568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:04:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:03 smithi136 ceph-mon[125702]: pgmap v15568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:04:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:06 smithi057 ceph-mon[92072]: pgmap v15569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:04:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:06 smithi122 ceph-mon[125440]: pgmap v15569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:04:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:06 smithi136 ceph-mon[125702]: pgmap v15569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:04:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:07 smithi057 ceph-mon[92072]: osdmap e1046: 12 total, 12 up, 12 in 2023-03-02T19:04:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:07 smithi122 ceph-mon[125440]: osdmap e1046: 12 total, 12 up, 12 in 2023-03-02T19:04:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:07 smithi136 ceph-mon[125702]: osdmap e1046: 12 total, 12 up, 12 in 2023-03-02T19:04:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:08 smithi057 ceph-mon[92072]: pgmap v15571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:04:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:08 smithi057 ceph-mon[92072]: osdmap e1047: 12 total, 12 up, 12 in 2023-03-02T19:04:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:08 smithi122 ceph-mon[125440]: pgmap v15571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:04:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:08 smithi122 ceph-mon[125440]: osdmap e1047: 12 total, 12 up, 12 in 2023-03-02T19:04:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:08 smithi136 ceph-mon[125702]: pgmap v15571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:04:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:08 smithi136 ceph-mon[125702]: osdmap e1047: 12 total, 12 up, 12 in 2023-03-02T19:04:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:10 smithi057 ceph-mon[92072]: pgmap v15573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:04:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:10 smithi122 ceph-mon[125440]: pgmap v15573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:04:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:10 smithi136 ceph-mon[125702]: pgmap v15573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:04:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:11.372+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:04:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:11.372+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:04:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:11.372+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:04:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:11.372+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:04:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:11.372+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:04:12.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:12 smithi057 ceph-mon[92072]: pgmap v15574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:04:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:12 smithi122 ceph-mon[125440]: pgmap v15574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:04:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:12 smithi136 ceph-mon[125702]: pgmap v15574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:04:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:13 smithi057 ceph-mon[92072]: pgmap v15575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:04:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:13 smithi122 ceph-mon[125440]: pgmap v15575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:04:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:13 smithi136 ceph-mon[125702]: pgmap v15575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:04:16.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:16 smithi057 ceph-mon[92072]: pgmap v15576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:04:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:16 smithi122 ceph-mon[125440]: pgmap v15576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:04:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:16 smithi136 ceph-mon[125702]: pgmap v15576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:04:18.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:18 smithi057 ceph-mon[92072]: pgmap v15577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:04:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:18 smithi122 ceph-mon[125440]: pgmap v15577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:04:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:18 smithi136 ceph-mon[125702]: pgmap v15577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:04:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:20 smithi057 ceph-mon[92072]: pgmap v15578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:04:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:20 smithi122 ceph-mon[125440]: pgmap v15578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:04:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:20 smithi136 ceph-mon[125702]: pgmap v15578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:04:22.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:22 smithi057 ceph-mon[92072]: pgmap v15579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:04:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:22 smithi122 ceph-mon[125440]: pgmap v15579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:04:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:22 smithi136 ceph-mon[125702]: pgmap v15579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:04:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:23 smithi057 ceph-mon[92072]: pgmap v15580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:04:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:23 smithi122 ceph-mon[125440]: pgmap v15580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:04:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:23 smithi136 ceph-mon[125702]: pgmap v15580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:04:26.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:26.380+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:04:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:26.381+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:04:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:26.381+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:04:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:26.381+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:04:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:26.381+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:04:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:26 smithi057 ceph-mon[92072]: pgmap v15581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:26 smithi122 ceph-mon[125440]: pgmap v15581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:26 smithi136 ceph-mon[125702]: pgmap v15581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:28 smithi057 ceph-mon[92072]: pgmap v15582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:28 smithi122 ceph-mon[125440]: pgmap v15582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:28 smithi136 ceph-mon[125702]: pgmap v15582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:30 smithi057 ceph-mon[92072]: pgmap v15583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:30 smithi122 ceph-mon[125440]: pgmap v15583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:30 smithi136 ceph-mon[125702]: pgmap v15583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:32 smithi057 ceph-mon[92072]: pgmap v15584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:32 smithi122 ceph-mon[125440]: pgmap v15584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:32 smithi136 ceph-mon[125702]: pgmap v15584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:33.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:33 smithi057 ceph-mon[92072]: pgmap v15585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:33 smithi122 ceph-mon[125440]: pgmap v15585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:33 smithi136 ceph-mon[125702]: pgmap v15585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:36.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:36 smithi057 ceph-mon[92072]: pgmap v15586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:36 smithi122 ceph-mon[125440]: pgmap v15586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:36 smithi136 ceph-mon[125702]: pgmap v15586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:38 smithi057 ceph-mon[92072]: pgmap v15587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:38 smithi122 ceph-mon[125440]: pgmap v15587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:38 smithi136 ceph-mon[125702]: pgmap v15587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:40.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:40 smithi057 ceph-mon[92072]: pgmap v15588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:40 smithi122 ceph-mon[125440]: pgmap v15588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:40 smithi136 ceph-mon[125702]: pgmap v15588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:41.397+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:04:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:41.397+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:04:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:41.397+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:04:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:41.397+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:04:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:41.397+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:04:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:42 smithi057 ceph-mon[92072]: pgmap v15589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:42 smithi122 ceph-mon[125440]: pgmap v15589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:42 smithi136 ceph-mon[125702]: pgmap v15589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:43.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:43 smithi057 ceph-mon[92072]: pgmap v15590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:43 smithi122 ceph-mon[125440]: pgmap v15590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:43 smithi136 ceph-mon[125702]: pgmap v15590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:46 smithi057 ceph-mon[92072]: pgmap v15591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:46 smithi122 ceph-mon[125440]: pgmap v15591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:46 smithi136 ceph-mon[125702]: pgmap v15591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:48 smithi057 ceph-mon[92072]: pgmap v15592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:04:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:04:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:04:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:04:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:48 smithi122 ceph-mon[125440]: pgmap v15592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:04:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:04:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:04:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:04:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:48 smithi136 ceph-mon[125702]: pgmap v15592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:04:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:04:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:04:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:04:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:50 smithi057 ceph-mon[92072]: pgmap v15593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:50 smithi122 ceph-mon[125440]: pgmap v15593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:50 smithi136 ceph-mon[125702]: pgmap v15593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:52 smithi057 ceph-mon[92072]: pgmap v15594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:52 smithi122 ceph-mon[125440]: pgmap v15594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:52 smithi136 ceph-mon[125702]: pgmap v15594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:53.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:53 smithi057 ceph-mon[92072]: pgmap v15595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:53 smithi122 ceph-mon[125440]: pgmap v15595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:53 smithi136 ceph-mon[125702]: pgmap v15595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:56.408+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:04:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:56.408+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:04:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:56.408+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:04:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:56.408+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:04:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:04:56.408+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:04:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:56 smithi057 ceph-mon[92072]: pgmap v15596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:56 smithi122 ceph-mon[125440]: pgmap v15596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:56 smithi136 ceph-mon[125702]: pgmap v15596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:04:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:04:58 smithi057 ceph-mon[92072]: pgmap v15597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:04:58 smithi122 ceph-mon[125440]: pgmap v15597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:04:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:04:58 smithi136 ceph-mon[125702]: pgmap v15597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:00 smithi057 ceph-mon[92072]: pgmap v15598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:00 smithi122 ceph-mon[125440]: pgmap v15598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:00 smithi136 ceph-mon[125702]: pgmap v15598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:02 smithi057 ceph-mon[92072]: pgmap v15599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:02 smithi122 ceph-mon[125440]: pgmap v15599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:02 smithi136 ceph-mon[125702]: pgmap v15599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:03.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:03 smithi057 ceph-mon[92072]: pgmap v15600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:05:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:03 smithi122 ceph-mon[125440]: pgmap v15600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:05:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:03 smithi136 ceph-mon[125702]: pgmap v15600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:05:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:06 smithi057 ceph-mon[92072]: pgmap v15601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:05:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:06 smithi122 ceph-mon[125440]: pgmap v15601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:05:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:06 smithi136 ceph-mon[125702]: pgmap v15601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:05:07.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:07 smithi057 ceph-mon[92072]: osdmap e1048: 12 total, 12 up, 12 in 2023-03-02T19:05:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:07 smithi122 ceph-mon[125440]: osdmap e1048: 12 total, 12 up, 12 in 2023-03-02T19:05:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:07 smithi136 ceph-mon[125702]: osdmap e1048: 12 total, 12 up, 12 in 2023-03-02T19:05:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:08 smithi057 ceph-mon[92072]: pgmap v15603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:05:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:08 smithi122 ceph-mon[125440]: pgmap v15603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:05:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:08 smithi136 ceph-mon[125702]: pgmap v15603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:05:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:10 smithi057 ceph-mon[92072]: pgmap v15604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:05:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:10 smithi122 ceph-mon[125440]: pgmap v15604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:05:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:10 smithi136 ceph-mon[125702]: pgmap v15604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:05:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:11.417+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:05:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:11.417+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:05:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:11.417+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:05:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:11.417+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:05:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:11.417+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:05:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:12 smithi057 ceph-mon[92072]: pgmap v15605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:05:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:12 smithi122 ceph-mon[125440]: pgmap v15605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:05:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:12.584+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:05:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:12.584+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:05:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:12.585+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 226 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:05:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:12.585+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 225 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:05:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:12 smithi136 ceph-mon[125702]: pgmap v15605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:05:13.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:13 smithi057 ceph-mon[92072]: pgmap v15606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:05:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:13 smithi122 ceph-mon[125440]: pgmap v15606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:05:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:13 smithi136 ceph-mon[125702]: pgmap v15606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:05:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:16 smithi057 ceph-mon[92072]: pgmap v15607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:05:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:16 smithi122 ceph-mon[125440]: pgmap v15607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:05:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:16 smithi136 ceph-mon[125702]: pgmap v15607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:05:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:18 smithi057 ceph-mon[92072]: pgmap v15608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:05:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:18 smithi057 ceph-mon[92072]: osdmap e1049: 12 total, 12 up, 12 in 2023-03-02T19:05:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:18 smithi122 ceph-mon[125440]: pgmap v15608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:05:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:18 smithi122 ceph-mon[125440]: osdmap e1049: 12 total, 12 up, 12 in 2023-03-02T19:05:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:18 smithi136 ceph-mon[125702]: pgmap v15608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:05:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:18 smithi136 ceph-mon[125702]: osdmap e1049: 12 total, 12 up, 12 in 2023-03-02T19:05:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:20 smithi057 ceph-mon[92072]: pgmap v15610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:05:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:20 smithi122 ceph-mon[125440]: pgmap v15610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:05:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:20 smithi136 ceph-mon[125702]: pgmap v15610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:05:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:22 smithi057 ceph-mon[92072]: pgmap v15611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:05:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:22 smithi122 ceph-mon[125440]: pgmap v15611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:05:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:22 smithi136 ceph-mon[125702]: pgmap v15611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:05:23.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:23 smithi122 ceph-mon[125440]: pgmap v15612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:05:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:23 smithi136 ceph-mon[125702]: pgmap v15612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:05:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:23 smithi057 ceph-mon[92072]: pgmap v15612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:05:26.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:26 smithi057 ceph-mon[92072]: pgmap v15613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:05:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:26.432+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:05:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:26.432+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:05:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:26.432+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:05:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:26.432+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:05:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:26.432+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:05:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:26 smithi122 ceph-mon[125440]: pgmap v15613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:05:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:26 smithi136 ceph-mon[125702]: pgmap v15613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:05:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:28 smithi057 ceph-mon[92072]: pgmap v15614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:05:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:28 smithi122 ceph-mon[125440]: pgmap v15614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:05:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:28 smithi136 ceph-mon[125702]: pgmap v15614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:05:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:30 smithi057 ceph-mon[92072]: pgmap v15615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:05:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:30 smithi122 ceph-mon[125440]: pgmap v15615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:05:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:30 smithi136 ceph-mon[125702]: pgmap v15615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:05:32.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:32 smithi057 ceph-mon[92072]: pgmap v15616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:32 smithi122 ceph-mon[125440]: pgmap v15616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:32 smithi136 ceph-mon[125702]: pgmap v15616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:33 smithi122 ceph-mon[125440]: pgmap v15617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:33 smithi136 ceph-mon[125702]: pgmap v15617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:33 smithi057 ceph-mon[92072]: pgmap v15617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:36 smithi057 ceph-mon[92072]: pgmap v15618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:36 smithi122 ceph-mon[125440]: pgmap v15618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:36 smithi136 ceph-mon[125702]: pgmap v15618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:38 smithi057 ceph-mon[92072]: pgmap v15619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:38 smithi122 ceph-mon[125440]: pgmap v15619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:38 smithi136 ceph-mon[125702]: pgmap v15619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:40 smithi057 ceph-mon[92072]: pgmap v15620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:40 smithi122 ceph-mon[125440]: pgmap v15620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:40 smithi136 ceph-mon[125702]: pgmap v15620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:41.443+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:05:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:41.443+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:05:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:41.443+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:05:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:41.443+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:05:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:41.443+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:05:42.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:42 smithi057 ceph-mon[92072]: pgmap v15621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:42 smithi122 ceph-mon[125440]: pgmap v15621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:42 smithi136 ceph-mon[125702]: pgmap v15621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:43.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:43 smithi122 ceph-mon[125440]: pgmap v15622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:43 smithi136 ceph-mon[125702]: pgmap v15622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:43 smithi057 ceph-mon[92072]: pgmap v15622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:46 smithi057 ceph-mon[92072]: pgmap v15623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:46 smithi122 ceph-mon[125440]: pgmap v15623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:46 smithi136 ceph-mon[125702]: pgmap v15623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:48 smithi057 ceph-mon[92072]: pgmap v15624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:48 smithi122 ceph-mon[125440]: pgmap v15624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:48 smithi136 ceph-mon[125702]: pgmap v15624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:05:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:05:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:05:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:05:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:05:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:05:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:05:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:05:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:05:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:05:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:05:49.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:05:50.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:50 smithi057 ceph-mon[92072]: pgmap v15625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:50 smithi122 ceph-mon[125440]: pgmap v15625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:50 smithi136 ceph-mon[125702]: pgmap v15625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:52.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:52 smithi057 ceph-mon[92072]: pgmap v15626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:52 smithi122 ceph-mon[125440]: pgmap v15626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:52 smithi136 ceph-mon[125702]: pgmap v15626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:53 smithi122 ceph-mon[125440]: pgmap v15627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:53 smithi136 ceph-mon[125702]: pgmap v15627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:53 smithi057 ceph-mon[92072]: pgmap v15627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:56 smithi057 ceph-mon[92072]: pgmap v15628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:56.447+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:05:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:56.448+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:05:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:56.448+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:05:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:56.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:05:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:56.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:05:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:56 smithi122 ceph-mon[125440]: pgmap v15628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:56 smithi136 ceph-mon[125702]: pgmap v15628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:05:57.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:57.591+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:05:57.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:57.591+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:05:57.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:57.592+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 226 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:05:57.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:05:57.592+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 227 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:05:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:05:58 smithi057 ceph-mon[92072]: pgmap v15629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:05:58 smithi122 ceph-mon[125440]: pgmap v15629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:05:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:05:58 smithi136 ceph-mon[125702]: pgmap v15629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:00.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:00 smithi057 ceph-mon[92072]: pgmap v15630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:00 smithi122 ceph-mon[125440]: pgmap v15630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:00 smithi136 ceph-mon[125702]: pgmap v15630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:02.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:02 smithi057 ceph-mon[92072]: pgmap v15631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:02 smithi122 ceph-mon[125440]: pgmap v15631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:02 smithi136 ceph-mon[125702]: pgmap v15631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:03.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:03 smithi122 ceph-mon[125440]: pgmap v15632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:06:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:03 smithi136 ceph-mon[125702]: pgmap v15632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:06:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:03 smithi057 ceph-mon[92072]: pgmap v15632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:06:06.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:06 smithi057 ceph-mon[92072]: pgmap v15633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:06:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:06 smithi122 ceph-mon[125440]: pgmap v15633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:06:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:06 smithi136 ceph-mon[125702]: pgmap v15633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:06:08.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:08 smithi057 ceph-mon[92072]: pgmap v15634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:06:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:08 smithi122 ceph-mon[125440]: pgmap v15634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:06:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:08 smithi136 ceph-mon[125702]: pgmap v15634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:06:10.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:10 smithi057 ceph-mon[92072]: pgmap v15635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:06:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:10 smithi122 ceph-mon[125440]: pgmap v15635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:06:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:10 smithi136 ceph-mon[125702]: pgmap v15635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:06:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:11.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:06:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:11.451+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:06:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:11.451+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:06:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:11.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:06:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:11.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:06:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:12 smithi122 ceph-mon[125440]: pgmap v15636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:06:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:12 smithi122 ceph-mon[125440]: osdmap e1050: 12 total, 12 up, 12 in 2023-03-02T19:06:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:12 smithi136 ceph-mon[125702]: pgmap v15636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:06:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:12 smithi136 ceph-mon[125702]: osdmap e1050: 12 total, 12 up, 12 in 2023-03-02T19:06:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:12 smithi057 ceph-mon[92072]: pgmap v15636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:06:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:12 smithi057 ceph-mon[92072]: osdmap e1050: 12 total, 12 up, 12 in 2023-03-02T19:06:13.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:13 smithi122 ceph-mon[125440]: pgmap v15638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:13 smithi136 ceph-mon[125702]: pgmap v15638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:13 smithi057 ceph-mon[92072]: pgmap v15638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:16 smithi057 ceph-mon[92072]: pgmap v15639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:16 smithi122 ceph-mon[125440]: pgmap v15639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:16 smithi136 ceph-mon[125702]: pgmap v15639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:18 smithi057 ceph-mon[92072]: pgmap v15640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:06:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:18 smithi057 ceph-mon[92072]: osdmap e1051: 12 total, 12 up, 12 in 2023-03-02T19:06:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:18 smithi122 ceph-mon[125440]: pgmap v15640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:06:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:18 smithi122 ceph-mon[125440]: osdmap e1051: 12 total, 12 up, 12 in 2023-03-02T19:06:18.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:18 smithi136 ceph-mon[125702]: pgmap v15640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:06:18.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:18 smithi136 ceph-mon[125702]: osdmap e1051: 12 total, 12 up, 12 in 2023-03-02T19:06:20.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:20 smithi057 ceph-mon[92072]: pgmap v15642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T19:06:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:20 smithi122 ceph-mon[125440]: pgmap v15642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T19:06:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:20 smithi136 ceph-mon[125702]: pgmap v15642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T19:06:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:22 smithi057 ceph-mon[92072]: pgmap v15643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:06:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:22 smithi122 ceph-mon[125440]: pgmap v15643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:06:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:22 smithi136 ceph-mon[125702]: pgmap v15643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:06:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:23 smithi136 ceph-mon[125702]: pgmap v15644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:23 smithi057 ceph-mon[92072]: pgmap v15644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:23 smithi122 ceph-mon[125440]: pgmap v15644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:26 smithi057 ceph-mon[92072]: pgmap v15645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:26 smithi122 ceph-mon[125440]: pgmap v15645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:26.458+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:06:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:26.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:06:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:26.459+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:06:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:26.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:06:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:26.459+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:06:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:26 smithi136 ceph-mon[125702]: pgmap v15645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:06:28.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:28 smithi057 ceph-mon[92072]: pgmap v15646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:06:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:28 smithi122 ceph-mon[125440]: pgmap v15646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:06:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:28 smithi136 ceph-mon[125702]: pgmap v15646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:06:30.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:30 smithi057 ceph-mon[92072]: pgmap v15647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:06:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:30 smithi122 ceph-mon[125440]: pgmap v15647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:06:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:30 smithi136 ceph-mon[125702]: pgmap v15647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:06:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:32 smithi057 ceph-mon[92072]: pgmap v15648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:32 smithi122 ceph-mon[125440]: pgmap v15648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:32 smithi136 ceph-mon[125702]: pgmap v15648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:33.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:33 smithi122 ceph-mon[125440]: pgmap v15649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:33 smithi136 ceph-mon[125702]: pgmap v15649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:33 smithi057 ceph-mon[92072]: pgmap v15649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:36 smithi057 ceph-mon[92072]: pgmap v15650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:36 smithi122 ceph-mon[125440]: pgmap v15650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:36 smithi136 ceph-mon[125702]: pgmap v15650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:38.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:38 smithi057 ceph-mon[92072]: pgmap v15651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:38 smithi122 ceph-mon[125440]: pgmap v15651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:38 smithi136 ceph-mon[125702]: pgmap v15651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:40 smithi122 ceph-mon[125440]: pgmap v15652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:40 smithi136 ceph-mon[125702]: pgmap v15652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:40 smithi057 ceph-mon[92072]: pgmap v15652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:41.469+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:06:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:41.469+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:06:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:41.469+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:06:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:41.469+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:06:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:41.469+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:06:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:42 smithi122 ceph-mon[125440]: pgmap v15653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:42 smithi136 ceph-mon[125702]: pgmap v15653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:42 smithi057 ceph-mon[92072]: pgmap v15653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:43 smithi136 ceph-mon[125702]: pgmap v15654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:43 smithi057 ceph-mon[92072]: pgmap v15654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:43 smithi122 ceph-mon[125440]: pgmap v15654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:46.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:46 smithi057 ceph-mon[92072]: pgmap v15655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:46 smithi122 ceph-mon[125440]: pgmap v15655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:46 smithi136 ceph-mon[125702]: pgmap v15655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:48.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:48 smithi057 ceph-mon[92072]: pgmap v15656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:48 smithi122 ceph-mon[125440]: pgmap v15656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:48 smithi136 ceph-mon[125702]: pgmap v15656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:06:49.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:06:49.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:06:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:50 smithi122 ceph-mon[125440]: pgmap v15657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:50 smithi136 ceph-mon[125702]: pgmap v15657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:50.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:50 smithi057 ceph-mon[92072]: pgmap v15657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:52 smithi122 ceph-mon[125440]: pgmap v15658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:52.452 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:52 smithi057 ceph-mon[92072]: pgmap v15658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:52 smithi136 ceph-mon[125702]: pgmap v15658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:06:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:06:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:06:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:06:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:06:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:53 smithi136 ceph-mon[125702]: pgmap v15659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:06:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:06:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:06:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:06:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:06:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:53 smithi057 ceph-mon[92072]: pgmap v15659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:06:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:06:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:06:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:06:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:06:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:53 smithi122 ceph-mon[125440]: pgmap v15659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:56.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:56 smithi057 ceph-mon[92072]: pgmap v15660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:56 smithi122 ceph-mon[125440]: pgmap v15660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:56.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:56.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:06:56.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:56.483+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:06:56.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:56.483+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:06:56.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:56.483+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:06:56.485 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:06:56.483+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:06:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:56 smithi136 ceph-mon[125702]: pgmap v15660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:06:58.432 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:06:58 smithi057 ceph-mon[92072]: pgmap v15661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:06:58 smithi122 ceph-mon[125440]: pgmap v15661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:06:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:06:58 smithi136 ceph-mon[125702]: pgmap v15661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:00 smithi122 ceph-mon[125440]: pgmap v15662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:00 smithi136 ceph-mon[125702]: pgmap v15662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:00 smithi057 ceph-mon[92072]: pgmap v15662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:02 smithi122 ceph-mon[125440]: pgmap v15663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:02 smithi136 ceph-mon[125702]: pgmap v15663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:02 smithi057 ceph-mon[92072]: pgmap v15663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:03 smithi136 ceph-mon[125702]: pgmap v15664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:07:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:03 smithi057 ceph-mon[92072]: pgmap v15664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:07:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:03 smithi122 ceph-mon[125440]: pgmap v15664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:07:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:06 smithi057 ceph-mon[92072]: pgmap v15665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:07:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:06 smithi122 ceph-mon[125440]: pgmap v15665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:07:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:06 smithi136 ceph-mon[125702]: pgmap v15665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:07:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:07 smithi122 ceph-mon[125440]: osdmap e1052: 12 total, 12 up, 12 in 2023-03-02T19:07:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:07 smithi136 ceph-mon[125702]: osdmap e1052: 12 total, 12 up, 12 in 2023-03-02T19:07:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:07 smithi057 ceph-mon[92072]: osdmap e1052: 12 total, 12 up, 12 in 2023-03-02T19:07:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:08 smithi122 ceph-mon[125440]: pgmap v15667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:07:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:08 smithi122 ceph-mon[125440]: osdmap e1053: 12 total, 12 up, 12 in 2023-03-02T19:07:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:08 smithi136 ceph-mon[125702]: pgmap v15667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:07:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:08 smithi136 ceph-mon[125702]: osdmap e1053: 12 total, 12 up, 12 in 2023-03-02T19:07:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:08 smithi057 ceph-mon[92072]: pgmap v15667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:07:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:08 smithi057 ceph-mon[92072]: osdmap e1053: 12 total, 12 up, 12 in 2023-03-02T19:07:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:10 smithi122 ceph-mon[125440]: pgmap v15669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:07:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:10 smithi136 ceph-mon[125702]: pgmap v15669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:07:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:10 smithi057 ceph-mon[92072]: pgmap v15669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:07:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:11.492+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:07:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:11.492+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:07:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:11.492+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:07:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:11.492+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:07:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:11.492+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:07:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:12 smithi122 ceph-mon[125440]: pgmap v15670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:07:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:12 smithi136 ceph-mon[125702]: pgmap v15670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:07:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:12 smithi057 ceph-mon[92072]: pgmap v15670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:07:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:13 smithi136 ceph-mon[125702]: pgmap v15671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:07:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:13 smithi057 ceph-mon[92072]: pgmap v15671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:07:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:13 smithi122 ceph-mon[125440]: pgmap v15671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:07:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:16 smithi057 ceph-mon[92072]: pgmap v15672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:07:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:16 smithi122 ceph-mon[125440]: pgmap v15672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:07:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:16 smithi136 ceph-mon[125702]: pgmap v15672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:07:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:18 smithi122 ceph-mon[125440]: pgmap v15673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:07:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:18 smithi136 ceph-mon[125702]: pgmap v15673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:07:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:18 smithi057 ceph-mon[92072]: pgmap v15673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:07:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:20 smithi122 ceph-mon[125440]: pgmap v15674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:07:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:20 smithi136 ceph-mon[125702]: pgmap v15674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:07:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:20 smithi057 ceph-mon[92072]: pgmap v15674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:07:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:22 smithi136 ceph-mon[125702]: pgmap v15675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:07:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:22 smithi057 ceph-mon[92072]: pgmap v15675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:07:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:22 smithi122 ceph-mon[125440]: pgmap v15675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:07:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:23 smithi136 ceph-mon[125702]: pgmap v15676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:07:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:23 smithi057 ceph-mon[92072]: pgmap v15676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:07:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:23 smithi122 ceph-mon[125440]: pgmap v15676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:07:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:26 smithi122 ceph-mon[125440]: pgmap v15677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:26.497+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:07:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:26.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:07:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:26.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:07:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:26.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:07:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:26.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:07:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:26 smithi136 ceph-mon[125702]: pgmap v15677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:26 smithi057 ceph-mon[92072]: pgmap v15677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:28 smithi122 ceph-mon[125440]: pgmap v15678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:28 smithi136 ceph-mon[125702]: pgmap v15678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:28 smithi057 ceph-mon[92072]: pgmap v15678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:30 smithi122 ceph-mon[125440]: pgmap v15679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:30 smithi136 ceph-mon[125702]: pgmap v15679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:30 smithi057 ceph-mon[92072]: pgmap v15679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:32 smithi122 ceph-mon[125440]: pgmap v15680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:32 smithi136 ceph-mon[125702]: pgmap v15680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:32 smithi057 ceph-mon[92072]: pgmap v15680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:33 smithi136 ceph-mon[125702]: pgmap v15681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:33 smithi057 ceph-mon[92072]: pgmap v15681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:33 smithi122 ceph-mon[125440]: pgmap v15681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:36 smithi122 ceph-mon[125440]: pgmap v15682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:36 smithi136 ceph-mon[125702]: pgmap v15682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:36 smithi057 ceph-mon[92072]: pgmap v15682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:38 smithi122 ceph-mon[125440]: pgmap v15683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:38 smithi136 ceph-mon[125702]: pgmap v15683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:38 smithi057 ceph-mon[92072]: pgmap v15683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:40 smithi122 ceph-mon[125440]: pgmap v15684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:40 smithi136 ceph-mon[125702]: pgmap v15684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:40 smithi057 ceph-mon[92072]: pgmap v15684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:41.505+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:07:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:41.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:07:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:41.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:07:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:41.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:07:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:41.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:07:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:42 smithi122 ceph-mon[125440]: pgmap v15685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:42 smithi136 ceph-mon[125702]: pgmap v15685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:42 smithi057 ceph-mon[92072]: pgmap v15685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:43 smithi136 ceph-mon[125702]: pgmap v15686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:43 smithi057 ceph-mon[92072]: pgmap v15686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:43 smithi122 ceph-mon[125440]: pgmap v15686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:46 smithi122 ceph-mon[125440]: pgmap v15687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:07:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:46 smithi136 ceph-mon[125702]: pgmap v15687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:07:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:46 smithi057 ceph-mon[92072]: pgmap v15687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:07:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:48 smithi122 ceph-mon[125440]: pgmap v15688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:48 smithi136 ceph-mon[125702]: pgmap v15688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:48 smithi057 ceph-mon[92072]: pgmap v15688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:50 smithi122 ceph-mon[125440]: pgmap v15689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:07:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:50 smithi136 ceph-mon[125702]: pgmap v15689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:07:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:50 smithi057 ceph-mon[92072]: pgmap v15689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:07:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:52 smithi122 ceph-mon[125440]: pgmap v15690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:07:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:52 smithi136 ceph-mon[125702]: pgmap v15690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:07:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:52 smithi057 ceph-mon[92072]: pgmap v15690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:07:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:07:53.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:53 smithi136 ceph-mon[125702]: pgmap v15691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:07:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:53 smithi057 ceph-mon[92072]: pgmap v15691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:07:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:53 smithi122 ceph-mon[125440]: pgmap v15691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:56.198 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:56 smithi136 ceph-mon[125702]: pgmap v15692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:56 smithi122 ceph-mon[125440]: pgmap v15692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:56.523 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:56.522+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:07:56.523 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:56.522+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:07:56.523 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:56.522+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:07:56.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:56.522+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:07:56.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:07:56.522+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:07:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:56 smithi057 ceph-mon[92072]: pgmap v15692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:07:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:07:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:07:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:07:57 smithi136 ceph-mon[125702]: pgmap v15693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:07:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:07:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:07:57 smithi057 ceph-mon[92072]: pgmap v15693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:07:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:07:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:07:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:07:58.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:07:57 smithi122 ceph-mon[125440]: pgmap v15693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:00 smithi122 ceph-mon[125440]: pgmap v15694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:00 smithi136 ceph-mon[125702]: pgmap v15694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:00 smithi057 ceph-mon[92072]: pgmap v15694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:02 smithi122 ceph-mon[125440]: pgmap v15695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:02 smithi136 ceph-mon[125702]: pgmap v15695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:02 smithi057 ceph-mon[92072]: pgmap v15695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:03 smithi136 ceph-mon[125702]: pgmap v15696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:08:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:03 smithi057 ceph-mon[92072]: pgmap v15696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:08:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:03 smithi122 ceph-mon[125440]: pgmap v15696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:08:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:06 smithi136 ceph-mon[125702]: pgmap v15697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:08:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:06 smithi057 ceph-mon[92072]: pgmap v15697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:08:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:06 smithi122 ceph-mon[125440]: pgmap v15697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:08:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:07 smithi136 ceph-mon[125702]: osdmap e1054: 12 total, 12 up, 12 in 2023-03-02T19:08:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:07 smithi057 ceph-mon[92072]: osdmap e1054: 12 total, 12 up, 12 in 2023-03-02T19:08:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:07 smithi122 ceph-mon[125440]: osdmap e1054: 12 total, 12 up, 12 in 2023-03-02T19:08:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:08 smithi136 ceph-mon[125702]: pgmap v15699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:08:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:08 smithi136 ceph-mon[125702]: osdmap e1055: 12 total, 12 up, 12 in 2023-03-02T19:08:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:08 smithi057 ceph-mon[92072]: pgmap v15699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:08:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:08 smithi057 ceph-mon[92072]: osdmap e1055: 12 total, 12 up, 12 in 2023-03-02T19:08:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:08 smithi122 ceph-mon[125440]: pgmap v15699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:08:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:08 smithi122 ceph-mon[125440]: osdmap e1055: 12 total, 12 up, 12 in 2023-03-02T19:08:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:10 smithi136 ceph-mon[125702]: pgmap v15701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:08:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:10 smithi057 ceph-mon[92072]: pgmap v15701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:08:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:10 smithi122 ceph-mon[125440]: pgmap v15701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:08:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:11.537+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:08:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:11.538+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:08:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:11.538+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:08:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:11.538+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:08:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:11.538+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:08:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:12 smithi136 ceph-mon[125702]: pgmap v15702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:08:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:12.611+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:08:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:12.611+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:08:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:12.612+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 228 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:08:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:12.612+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 227 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:08:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:12 smithi057 ceph-mon[92072]: pgmap v15702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:08:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:12 smithi122 ceph-mon[125440]: pgmap v15702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:08:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:13 smithi136 ceph-mon[125702]: pgmap v15703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:08:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:13 smithi057 ceph-mon[92072]: pgmap v15703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:08:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:13 smithi122 ceph-mon[125440]: pgmap v15703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:08:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:16 smithi122 ceph-mon[125440]: pgmap v15704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:08:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:16 smithi136 ceph-mon[125702]: pgmap v15704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:08:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:16 smithi057 ceph-mon[92072]: pgmap v15704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:08:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:18 smithi136 ceph-mon[125702]: pgmap v15705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:08:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:18 smithi057 ceph-mon[92072]: pgmap v15705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:08:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:18 smithi122 ceph-mon[125440]: pgmap v15705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:08:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:20 smithi136 ceph-mon[125702]: pgmap v15706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:08:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:20 smithi057 ceph-mon[92072]: pgmap v15706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:08:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:20 smithi122 ceph-mon[125440]: pgmap v15706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:08:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:22 smithi136 ceph-mon[125702]: pgmap v15707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:08:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:22 smithi057 ceph-mon[92072]: pgmap v15707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:08:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:22 smithi122 ceph-mon[125440]: pgmap v15707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:08:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:23 smithi136 ceph-mon[125702]: pgmap v15708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:08:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:23 smithi057 ceph-mon[92072]: pgmap v15708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:08:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:23 smithi122 ceph-mon[125440]: pgmap v15708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:08:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:26.546+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:08:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:26.547+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:08:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:26.547+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:08:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:26.547+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:08:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:26.547+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:08:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:26 smithi136 ceph-mon[125702]: pgmap v15709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:26 smithi057 ceph-mon[92072]: pgmap v15709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:26 smithi122 ceph-mon[125440]: pgmap v15709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:28 smithi136 ceph-mon[125702]: pgmap v15710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:28 smithi057 ceph-mon[92072]: pgmap v15710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:28 smithi122 ceph-mon[125440]: pgmap v15710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:30 smithi136 ceph-mon[125702]: pgmap v15711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:30 smithi057 ceph-mon[92072]: pgmap v15711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:30 smithi122 ceph-mon[125440]: pgmap v15711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:32 smithi136 ceph-mon[125702]: pgmap v15712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:32 smithi057 ceph-mon[92072]: pgmap v15712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:32 smithi122 ceph-mon[125440]: pgmap v15712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:33 smithi136 ceph-mon[125702]: pgmap v15713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:33 smithi057 ceph-mon[92072]: pgmap v15713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:33 smithi122 ceph-mon[125440]: pgmap v15713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:36 smithi122 ceph-mon[125440]: pgmap v15714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:36 smithi136 ceph-mon[125702]: pgmap v15714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:36 smithi057 ceph-mon[92072]: pgmap v15714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:38 smithi136 ceph-mon[125702]: pgmap v15715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:38 smithi057 ceph-mon[92072]: pgmap v15715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:38 smithi122 ceph-mon[125440]: pgmap v15715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:40 smithi136 ceph-mon[125702]: pgmap v15716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:40 smithi057 ceph-mon[92072]: pgmap v15716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:40 smithi122 ceph-mon[125440]: pgmap v15716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:41.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:41.552+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:08:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:41.553+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:08:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:41.553+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:08:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:41.553+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:08:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:41.553+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:08:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:42 smithi136 ceph-mon[125702]: pgmap v15717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:42 smithi057 ceph-mon[92072]: pgmap v15717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:42 smithi122 ceph-mon[125440]: pgmap v15717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:43 smithi136 ceph-mon[125702]: pgmap v15718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:43 smithi057 ceph-mon[92072]: pgmap v15718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:43 smithi122 ceph-mon[125440]: pgmap v15718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:46 smithi136 ceph-mon[125702]: pgmap v15719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:46 smithi057 ceph-mon[92072]: pgmap v15719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:46 smithi122 ceph-mon[125440]: pgmap v15719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:48 smithi136 ceph-mon[125702]: pgmap v15720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:48 smithi057 ceph-mon[92072]: pgmap v15720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:48 smithi122 ceph-mon[125440]: pgmap v15720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:50 smithi136 ceph-mon[125702]: pgmap v15721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:50 smithi057 ceph-mon[92072]: pgmap v15721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:50 smithi122 ceph-mon[125440]: pgmap v15721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:52 smithi136 ceph-mon[125702]: pgmap v15722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:52 smithi057 ceph-mon[92072]: pgmap v15722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:52 smithi122 ceph-mon[125440]: pgmap v15722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:53 smithi136 ceph-mon[125702]: pgmap v15723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:53 smithi057 ceph-mon[92072]: pgmap v15723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:53 smithi122 ceph-mon[125440]: pgmap v15723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:56.568+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:08:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:56.569+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:08:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:56.569+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:08:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:56.569+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:08:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:08:56.569+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:08:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:56 smithi136 ceph-mon[125702]: pgmap v15724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:56 smithi057 ceph-mon[92072]: pgmap v15724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:56 smithi122 ceph-mon[125440]: pgmap v15724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:08:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:08:57.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:08:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:08:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:58 smithi136 ceph-mon[125702]: pgmap v15725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:08:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:08:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:08:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:08:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:58 smithi057 ceph-mon[92072]: pgmap v15725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:08:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:08:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:08:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:08:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:58 smithi122 ceph-mon[125440]: pgmap v15725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:08:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:08:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:08:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:08:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:09:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:00 smithi136 ceph-mon[125702]: pgmap v15726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:00 smithi057 ceph-mon[92072]: pgmap v15726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:00 smithi122 ceph-mon[125440]: pgmap v15726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:02 smithi136 ceph-mon[125702]: pgmap v15727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:02 smithi057 ceph-mon[92072]: pgmap v15727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:02 smithi122 ceph-mon[125440]: pgmap v15727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:03 smithi136 ceph-mon[125702]: pgmap v15728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:09:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:03 smithi057 ceph-mon[92072]: pgmap v15728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:09:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:03 smithi122 ceph-mon[125440]: pgmap v15728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:09:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:06 smithi136 ceph-mon[125702]: pgmap v15729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:09:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:06 smithi057 ceph-mon[92072]: pgmap v15729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:09:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:06 smithi122 ceph-mon[125440]: pgmap v15729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:09:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:07 smithi136 ceph-mon[125702]: osdmap e1056: 12 total, 12 up, 12 in 2023-03-02T19:09:07.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:07 smithi057 ceph-mon[92072]: osdmap e1056: 12 total, 12 up, 12 in 2023-03-02T19:09:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:07 smithi122 ceph-mon[125440]: osdmap e1056: 12 total, 12 up, 12 in 2023-03-02T19:09:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:08 smithi136 ceph-mon[125702]: pgmap v15731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:09:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:08 smithi057 ceph-mon[92072]: pgmap v15731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:09:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:08 smithi122 ceph-mon[125440]: pgmap v15731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:09:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:10 smithi136 ceph-mon[125702]: pgmap v15732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:09:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:10 smithi057 ceph-mon[92072]: pgmap v15732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:09:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:10 smithi122 ceph-mon[125440]: pgmap v15732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:09:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:11.585+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:09:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:11.586+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:09:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:11.586+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:09:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:11.586+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:09:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:11.586+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:09:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:12 smithi136 ceph-mon[125702]: pgmap v15733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:09:12.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:12 smithi057 ceph-mon[92072]: pgmap v15733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:09:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:12 smithi122 ceph-mon[125440]: pgmap v15733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:09:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:13 smithi136 ceph-mon[125702]: pgmap v15734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:09:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:13 smithi057 ceph-mon[92072]: pgmap v15734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:09:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:13 smithi122 ceph-mon[125440]: pgmap v15734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:09:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:16 smithi136 ceph-mon[125702]: pgmap v15735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:09:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:16 smithi057 ceph-mon[92072]: pgmap v15735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:09:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:16 smithi122 ceph-mon[125440]: pgmap v15735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:09:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:18 smithi136 ceph-mon[125702]: pgmap v15736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:09:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:18 smithi136 ceph-mon[125702]: osdmap e1057: 12 total, 12 up, 12 in 2023-03-02T19:09:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:18 smithi057 ceph-mon[92072]: pgmap v15736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:09:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:18 smithi057 ceph-mon[92072]: osdmap e1057: 12 total, 12 up, 12 in 2023-03-02T19:09:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:18 smithi122 ceph-mon[125440]: pgmap v15736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:09:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:18 smithi122 ceph-mon[125440]: osdmap e1057: 12 total, 12 up, 12 in 2023-03-02T19:09:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:20 smithi136 ceph-mon[125702]: pgmap v15738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:09:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:20 smithi057 ceph-mon[92072]: pgmap v15738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:09:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:20 smithi122 ceph-mon[125440]: pgmap v15738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:09:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:22 smithi136 ceph-mon[125702]: pgmap v15739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:09:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:22 smithi057 ceph-mon[92072]: pgmap v15739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:09:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:22 smithi122 ceph-mon[125440]: pgmap v15739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:09:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:23 smithi136 ceph-mon[125702]: pgmap v15740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:09:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:23 smithi057 ceph-mon[92072]: pgmap v15740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:09:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:23 smithi122 ceph-mon[125440]: pgmap v15740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:09:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:26 smithi136 ceph-mon[125702]: pgmap v15741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:09:26.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:26.591+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:09:26.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:26.591+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:09:26.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:26.592+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:09:26.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:26.592+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:09:26.593 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:26.592+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:09:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:26 smithi057 ceph-mon[92072]: pgmap v15741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:09:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:26 smithi122 ceph-mon[125440]: pgmap v15741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:09:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:28 smithi136 ceph-mon[125702]: pgmap v15742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:09:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:28 smithi057 ceph-mon[92072]: pgmap v15742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:09:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:28 smithi122 ceph-mon[125440]: pgmap v15742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:09:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:30 smithi136 ceph-mon[125702]: pgmap v15743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:09:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:30 smithi057 ceph-mon[92072]: pgmap v15743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:09:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:30 smithi122 ceph-mon[125440]: pgmap v15743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:09:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:32 smithi136 ceph-mon[125702]: pgmap v15744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:32 smithi057 ceph-mon[92072]: pgmap v15744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:32 smithi122 ceph-mon[125440]: pgmap v15744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:33 smithi136 ceph-mon[125702]: pgmap v15745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:33 smithi057 ceph-mon[92072]: pgmap v15745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:33.973 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:33 smithi122 ceph-mon[125440]: pgmap v15745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:36 smithi136 ceph-mon[125702]: pgmap v15746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:36 smithi057 ceph-mon[92072]: pgmap v15746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:36 smithi122 ceph-mon[125440]: pgmap v15746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:38 smithi136 ceph-mon[125702]: pgmap v15747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:38 smithi057 ceph-mon[92072]: pgmap v15747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:38 smithi122 ceph-mon[125440]: pgmap v15747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:40 smithi136 ceph-mon[125702]: pgmap v15748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:40 smithi057 ceph-mon[92072]: pgmap v15748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:40 smithi122 ceph-mon[125440]: pgmap v15748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:41.595+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:09:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:41.595+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:09:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:41.595+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:09:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:41.595+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:09:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:41.595+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:09:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:42 smithi136 ceph-mon[125702]: pgmap v15749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:42 smithi057 ceph-mon[92072]: pgmap v15749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:42 smithi122 ceph-mon[125440]: pgmap v15749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:43 smithi136 ceph-mon[125702]: pgmap v15750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:43 smithi057 ceph-mon[92072]: pgmap v15750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:43 smithi122 ceph-mon[125440]: pgmap v15750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:46 smithi136 ceph-mon[125702]: pgmap v15751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:46 smithi057 ceph-mon[92072]: pgmap v15751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:46 smithi122 ceph-mon[125440]: pgmap v15751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:48 smithi136 ceph-mon[125702]: pgmap v15752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:48 smithi057 ceph-mon[92072]: pgmap v15752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:48 smithi122 ceph-mon[125440]: pgmap v15752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:50 smithi136 ceph-mon[125702]: pgmap v15753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:50 smithi057 ceph-mon[92072]: pgmap v15753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:50 smithi122 ceph-mon[125440]: pgmap v15753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:52 smithi136 ceph-mon[125702]: pgmap v15754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:52 smithi057 ceph-mon[92072]: pgmap v15754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:52 smithi122 ceph-mon[125440]: pgmap v15754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:53 smithi136 ceph-mon[125702]: pgmap v15755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:53 smithi057 ceph-mon[92072]: pgmap v15755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:53 smithi122 ceph-mon[125440]: pgmap v15755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:56 smithi136 ceph-mon[125702]: pgmap v15756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:56.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:09:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:56.610+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:09:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:56.610+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:09:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:56.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:09:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:09:56.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:09:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:56 smithi057 ceph-mon[92072]: pgmap v15756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:56 smithi122 ceph-mon[125440]: pgmap v15756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:09:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:58 smithi136 ceph-mon[125702]: pgmap v15757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:09:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:09:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:58 smithi057 ceph-mon[92072]: pgmap v15757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:09:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:09:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:58 smithi122 ceph-mon[125440]: pgmap v15757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:09:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:09:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:10:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:00 smithi136 ceph-mon[125702]: pgmap v15758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:10:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:10:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T19:10:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:00 smithi057 ceph-mon[92072]: pgmap v15758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:10:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:10:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T19:10:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:00 smithi122 ceph-mon[125440]: pgmap v15758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:10:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:10:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:10:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T19:10:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:02 smithi136 ceph-mon[125702]: pgmap v15759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:02 smithi057 ceph-mon[92072]: pgmap v15759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:02 smithi122 ceph-mon[125440]: pgmap v15759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:03 smithi136 ceph-mon[125702]: pgmap v15760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:10:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:03 smithi057 ceph-mon[92072]: pgmap v15760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:10:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:03 smithi122 ceph-mon[125440]: pgmap v15760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:10:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:06 smithi136 ceph-mon[125702]: pgmap v15761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:10:06.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:06 smithi057 ceph-mon[92072]: pgmap v15761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:10:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:06 smithi122 ceph-mon[125440]: pgmap v15761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:10:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:07 smithi136 ceph-mon[125702]: osdmap e1058: 12 total, 12 up, 12 in 2023-03-02T19:10:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:07 smithi057 ceph-mon[92072]: osdmap e1058: 12 total, 12 up, 12 in 2023-03-02T19:10:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:07 smithi122 ceph-mon[125440]: osdmap e1058: 12 total, 12 up, 12 in 2023-03-02T19:10:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:08 smithi136 ceph-mon[125702]: pgmap v15763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:10:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:08 smithi136 ceph-mon[125702]: osdmap e1059: 12 total, 12 up, 12 in 2023-03-02T19:10:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:08 smithi057 ceph-mon[92072]: pgmap v15763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:10:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:08 smithi057 ceph-mon[92072]: osdmap e1059: 12 total, 12 up, 12 in 2023-03-02T19:10:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:08 smithi122 ceph-mon[125440]: pgmap v15763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:10:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:08 smithi122 ceph-mon[125440]: osdmap e1059: 12 total, 12 up, 12 in 2023-03-02T19:10:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:10 smithi136 ceph-mon[125702]: pgmap v15765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:10:10.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:10 smithi057 ceph-mon[92072]: pgmap v15765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:10:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:10 smithi122 ceph-mon[125440]: pgmap v15765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:10:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:11.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:10:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:11.627+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:10:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:11.627+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:10:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:11.627+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:10:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:11.627+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:10:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:12 smithi057 ceph-mon[92072]: pgmap v15766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:10:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:12 smithi136 ceph-mon[125702]: pgmap v15766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:10:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:12 smithi122 ceph-mon[125440]: pgmap v15766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:10:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:13 smithi136 ceph-mon[125702]: pgmap v15767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:10:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:13 smithi057 ceph-mon[92072]: pgmap v15767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:10:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:13 smithi122 ceph-mon[125440]: pgmap v15767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:10:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:16 smithi136 ceph-mon[125702]: pgmap v15768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:10:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:16 smithi057 ceph-mon[92072]: pgmap v15768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:10:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:16 smithi122 ceph-mon[125440]: pgmap v15768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:10:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:18 smithi136 ceph-mon[125702]: pgmap v15769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:10:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:18 smithi057 ceph-mon[92072]: pgmap v15769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:10:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:18 smithi122 ceph-mon[125440]: pgmap v15769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:10:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:20 smithi136 ceph-mon[125702]: pgmap v15770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:10:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:20 smithi057 ceph-mon[92072]: pgmap v15770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:10:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:20 smithi122 ceph-mon[125440]: pgmap v15770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:10:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:22 smithi136 ceph-mon[125702]: pgmap v15771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:10:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:22 smithi057 ceph-mon[92072]: pgmap v15771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:10:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:22 smithi122 ceph-mon[125440]: pgmap v15771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:10:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:23 smithi136 ceph-mon[125702]: pgmap v15772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:10:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:23 smithi057 ceph-mon[92072]: pgmap v15772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:10:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:23 smithi122 ceph-mon[125440]: pgmap v15772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:10:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:26 smithi136 ceph-mon[125702]: pgmap v15773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:26.641+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:10:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:26.642+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:10:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:26.642+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:10:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:26.642+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:10:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:26.642+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:10:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:26 smithi057 ceph-mon[92072]: pgmap v15773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:26 smithi122 ceph-mon[125440]: pgmap v15773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:28 smithi136 ceph-mon[125702]: pgmap v15774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:28 smithi057 ceph-mon[92072]: pgmap v15774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:28 smithi122 ceph-mon[125440]: pgmap v15774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:30 smithi136 ceph-mon[125702]: pgmap v15775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:30.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:30 smithi057 ceph-mon[92072]: pgmap v15775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:30 smithi122 ceph-mon[125440]: pgmap v15775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:32 smithi136 ceph-mon[125702]: pgmap v15776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:32 smithi057 ceph-mon[92072]: pgmap v15776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:32 smithi122 ceph-mon[125440]: pgmap v15776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:33 smithi136 ceph-mon[125702]: pgmap v15777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:33 smithi057 ceph-mon[92072]: pgmap v15777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:33 smithi122 ceph-mon[125440]: pgmap v15777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:36 smithi136 ceph-mon[125702]: pgmap v15778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:36 smithi057 ceph-mon[92072]: pgmap v15778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:36 smithi122 ceph-mon[125440]: pgmap v15778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:38 smithi136 ceph-mon[125702]: pgmap v15779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:38 smithi057 ceph-mon[92072]: pgmap v15779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:38 smithi122 ceph-mon[125440]: pgmap v15779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:40 smithi136 ceph-mon[125702]: pgmap v15780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:40 smithi057 ceph-mon[92072]: pgmap v15780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:40 smithi122 ceph-mon[125440]: pgmap v15780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:41.646+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:10:41.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:41.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:10:41.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:41.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:10:41.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:41.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:10:41.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:41.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:10:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:42 smithi136 ceph-mon[125702]: pgmap v15781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:42 smithi057 ceph-mon[92072]: pgmap v15781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:42 smithi122 ceph-mon[125440]: pgmap v15781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:43 smithi136 ceph-mon[125702]: pgmap v15782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:43.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:43 smithi057 ceph-mon[92072]: pgmap v15782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:43 smithi122 ceph-mon[125440]: pgmap v15782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:46 smithi136 ceph-mon[125702]: pgmap v15783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:46 smithi057 ceph-mon[92072]: pgmap v15783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:46 smithi122 ceph-mon[125440]: pgmap v15783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:48 smithi136 ceph-mon[125702]: pgmap v15784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:48.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:48 smithi057 ceph-mon[92072]: pgmap v15784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:48 smithi122 ceph-mon[125440]: pgmap v15784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:50 smithi136 ceph-mon[125702]: pgmap v15785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:50 smithi057 ceph-mon[92072]: pgmap v15785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:50 smithi122 ceph-mon[125440]: pgmap v15785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:52 smithi136 ceph-mon[125702]: pgmap v15786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:52 smithi057 ceph-mon[92072]: pgmap v15786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:52 smithi122 ceph-mon[125440]: pgmap v15786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:53 smithi136 ceph-mon[125702]: pgmap v15787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:53.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:53 smithi057 ceph-mon[92072]: pgmap v15787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:53 smithi122 ceph-mon[125440]: pgmap v15787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:56 smithi136 ceph-mon[125702]: pgmap v15788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:56.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:10:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:56.661+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:10:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:56.661+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:10:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:56.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:10:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:10:56.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:10:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:56 smithi057 ceph-mon[92072]: pgmap v15788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:56 smithi122 ceph-mon[125440]: pgmap v15788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:10:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:10:58 smithi136 ceph-mon[125702]: pgmap v15789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:10:58 smithi057 ceph-mon[92072]: pgmap v15789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:10:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:10:58 smithi122 ceph-mon[125440]: pgmap v15789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:00 smithi136 ceph-mon[125702]: pgmap v15790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:11:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:00 smithi057 ceph-mon[92072]: pgmap v15790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:11:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:00 smithi122 ceph-mon[125440]: pgmap v15790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:11:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:02 smithi136 ceph-mon[125702]: pgmap v15791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:02 smithi057 ceph-mon[92072]: pgmap v15791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:02 smithi122 ceph-mon[125440]: pgmap v15791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:11:03.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:11:03.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:11:03.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:11:03.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:11:03.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:11:03.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:11:03.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:11:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:04 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:11:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:04 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:11:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:04 smithi136 ceph-mon[125702]: pgmap v15792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:11:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:04 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:11:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:04 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:11:04.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:04 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:11:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:04 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:11:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:04 smithi057 ceph-mon[92072]: pgmap v15792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:11:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:04 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:11:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:04 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:11:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:04 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:11:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:04 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:11:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:04 smithi122 ceph-mon[125440]: pgmap v15792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:11:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:04 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:11:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:04 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:11:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:06 smithi136 ceph-mon[125702]: pgmap v15793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:11:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:06 smithi057 ceph-mon[92072]: pgmap v15793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:11:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:06 smithi122 ceph-mon[125440]: pgmap v15793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:11:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:07 smithi136 ceph-mon[125702]: osdmap e1060: 12 total, 12 up, 12 in 2023-03-02T19:11:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:07 smithi057 ceph-mon[92072]: osdmap e1060: 12 total, 12 up, 12 in 2023-03-02T19:11:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:07 smithi122 ceph-mon[125440]: osdmap e1060: 12 total, 12 up, 12 in 2023-03-02T19:11:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:08 smithi136 ceph-mon[125702]: pgmap v15795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:11:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:08 smithi136 ceph-mon[125702]: osdmap e1061: 12 total, 12 up, 12 in 2023-03-02T19:11:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:08 smithi057 ceph-mon[92072]: pgmap v15795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:11:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:08 smithi057 ceph-mon[92072]: osdmap e1061: 12 total, 12 up, 12 in 2023-03-02T19:11:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:08 smithi122 ceph-mon[125440]: pgmap v15795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:11:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:08 smithi122 ceph-mon[125440]: osdmap e1061: 12 total, 12 up, 12 in 2023-03-02T19:11:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:10 smithi057 ceph-mon[92072]: pgmap v15797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:11:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:10 smithi122 ceph-mon[125440]: pgmap v15797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:11:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:10 smithi136 ceph-mon[125702]: pgmap v15797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:11:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:11.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:11:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:11.665+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:11:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:11.665+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:11:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:11.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:11:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:11.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:11:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:12.638+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:11:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:12.638+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:11:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:12.638+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 229 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:11:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:12.638+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 228 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:11:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:12 smithi057 ceph-mon[92072]: pgmap v15798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:11:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:12 smithi122 ceph-mon[125440]: pgmap v15798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:11:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:12 smithi136 ceph-mon[125702]: pgmap v15798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:11:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:13 smithi136 ceph-mon[125702]: pgmap v15799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:11:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:13 smithi057 ceph-mon[92072]: pgmap v15799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:11:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:13 smithi122 ceph-mon[125440]: pgmap v15799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:11:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:16 smithi136 ceph-mon[125702]: pgmap v15800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T19:11:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:16 smithi057 ceph-mon[92072]: pgmap v15800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T19:11:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:16 smithi122 ceph-mon[125440]: pgmap v15800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-02T19:11:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:18 smithi136 ceph-mon[125702]: pgmap v15801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:11:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:18 smithi057 ceph-mon[92072]: pgmap v15801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:11:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:18 smithi122 ceph-mon[125440]: pgmap v15801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:11:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:20 smithi136 ceph-mon[125702]: pgmap v15802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:11:20.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:20 smithi057 ceph-mon[92072]: pgmap v15802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:11:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:20 smithi122 ceph-mon[125440]: pgmap v15802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:11:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:22 smithi136 ceph-mon[125702]: pgmap v15803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:11:22.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:22 smithi057 ceph-mon[92072]: pgmap v15803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:11:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:22 smithi122 ceph-mon[125440]: pgmap v15803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:11:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:23 smithi136 ceph-mon[125702]: pgmap v15804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:11:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:23 smithi057 ceph-mon[92072]: pgmap v15804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:11:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:23 smithi122 ceph-mon[125440]: pgmap v15804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:11:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:26 smithi136 ceph-mon[125702]: pgmap v15805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:26.681+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:11:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:26 smithi057 ceph-mon[92072]: pgmap v15805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:26.682+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:11:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:26.682+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:11:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:26.682+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:11:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:26.682+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:11:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:26 smithi122 ceph-mon[125440]: pgmap v15805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:28 smithi136 ceph-mon[125702]: pgmap v15806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:28 smithi057 ceph-mon[92072]: pgmap v15806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:28 smithi122 ceph-mon[125440]: pgmap v15806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:30 smithi136 ceph-mon[125702]: pgmap v15807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:30 smithi057 ceph-mon[92072]: pgmap v15807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:30 smithi122 ceph-mon[125440]: pgmap v15807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:32 smithi136 ceph-mon[125702]: pgmap v15808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:32 smithi057 ceph-mon[92072]: pgmap v15808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:32 smithi122 ceph-mon[125440]: pgmap v15808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:33 smithi136 ceph-mon[125702]: pgmap v15809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:33 smithi057 ceph-mon[92072]: pgmap v15809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:33 smithi122 ceph-mon[125440]: pgmap v15809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:36 smithi136 ceph-mon[125702]: pgmap v15810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:36 smithi057 ceph-mon[92072]: pgmap v15810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:36 smithi122 ceph-mon[125440]: pgmap v15810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:38 smithi136 ceph-mon[125702]: pgmap v15811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:38 smithi057 ceph-mon[92072]: pgmap v15811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:38 smithi122 ceph-mon[125440]: pgmap v15811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:40 smithi136 ceph-mon[125702]: pgmap v15812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:40 smithi057 ceph-mon[92072]: pgmap v15812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:40 smithi122 ceph-mon[125440]: pgmap v15812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:41.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:41.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:11:41.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:41.693+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:11:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:41.693+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:11:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:41.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:11:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:41.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:11:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:42 smithi136 ceph-mon[125702]: pgmap v15813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:42 smithi057 ceph-mon[92072]: pgmap v15813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:42 smithi122 ceph-mon[125440]: pgmap v15813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:43 smithi136 ceph-mon[125702]: pgmap v15814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:43 smithi057 ceph-mon[92072]: pgmap v15814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:43 smithi122 ceph-mon[125440]: pgmap v15814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:46 smithi136 ceph-mon[125702]: pgmap v15815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:46 smithi057 ceph-mon[92072]: pgmap v15815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:46 smithi122 ceph-mon[125440]: pgmap v15815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:48 smithi136 ceph-mon[125702]: pgmap v15816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:48 smithi057 ceph-mon[92072]: pgmap v15816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:48 smithi122 ceph-mon[125440]: pgmap v15816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:50.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:50 smithi136 ceph-mon[125702]: pgmap v15817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:50 smithi057 ceph-mon[92072]: pgmap v15817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:50 smithi122 ceph-mon[125440]: pgmap v15817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:52 smithi136 ceph-mon[125702]: pgmap v15818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:52.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:52 smithi057 ceph-mon[92072]: pgmap v15818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:52 smithi122 ceph-mon[125440]: pgmap v15818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:53 smithi136 ceph-mon[125702]: pgmap v15819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:53 smithi057 ceph-mon[92072]: pgmap v15819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:53 smithi122 ceph-mon[125440]: pgmap v15819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:56 smithi136 ceph-mon[125702]: pgmap v15820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:56.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:56 smithi057 ceph-mon[92072]: pgmap v15820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:56.697+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:11:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:56.697+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:11:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:56.697+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:11:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:56.697+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:11:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:11:56.698+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:11:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:56 smithi122 ceph-mon[125440]: pgmap v15820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:11:58.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:11:58 smithi136 ceph-mon[125702]: pgmap v15821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:11:58 smithi057 ceph-mon[92072]: pgmap v15821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:11:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:11:58 smithi122 ceph-mon[125440]: pgmap v15821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:00 smithi136 ceph-mon[125702]: pgmap v15822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:00.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:00 smithi057 ceph-mon[92072]: pgmap v15822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:00 smithi122 ceph-mon[125440]: pgmap v15822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:02 smithi136 ceph-mon[125702]: pgmap v15823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:02 smithi057 ceph-mon[92072]: pgmap v15823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:02 smithi122 ceph-mon[125440]: pgmap v15823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:03 smithi136 ceph-mon[125702]: pgmap v15824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:12:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:12:03.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:03 smithi057 ceph-mon[92072]: pgmap v15824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:12:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:12:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:03 smithi122 ceph-mon[125440]: pgmap v15824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:12:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:12:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:12:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:12:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:12:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:12:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:12:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:12:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:12:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:12:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:12:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:05 smithi136 ceph-mon[125702]: pgmap v15825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:12:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:05 smithi057 ceph-mon[92072]: pgmap v15825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:12:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:05 smithi122 ceph-mon[125440]: pgmap v15825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:12:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:07 smithi136 ceph-mon[125702]: osdmap e1062: 12 total, 12 up, 12 in 2023-03-02T19:12:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:07 smithi136 ceph-mon[125702]: pgmap v15827: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:12:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:07 smithi057 ceph-mon[92072]: osdmap e1062: 12 total, 12 up, 12 in 2023-03-02T19:12:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:07 smithi057 ceph-mon[92072]: pgmap v15827: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:12:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:07 smithi122 ceph-mon[125440]: osdmap e1062: 12 total, 12 up, 12 in 2023-03-02T19:12:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:07 smithi122 ceph-mon[125440]: pgmap v15827: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:12:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:10 smithi136 ceph-mon[125702]: pgmap v15828: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:12:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:10 smithi057 ceph-mon[92072]: pgmap v15828: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:12:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:10 smithi122 ceph-mon[125440]: pgmap v15828: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:12:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:11.709+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:12:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:11.709+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:12:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:11.709+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:12:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:11.709+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:12:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:11.709+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:12:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:12 smithi136 ceph-mon[125702]: pgmap v15829: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:12:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:12 smithi057 ceph-mon[92072]: pgmap v15829: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:12:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:12 smithi122 ceph-mon[125440]: pgmap v15829: 97 pgs: 1 active+clean+snaptrim_wait, 96 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:12:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:13 smithi136 ceph-mon[125702]: pgmap v15830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:12:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:13 smithi057 ceph-mon[92072]: pgmap v15830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:12:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:13 smithi122 ceph-mon[125440]: pgmap v15830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:12:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:16 smithi136 ceph-mon[125702]: pgmap v15831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:12:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:16 smithi057 ceph-mon[92072]: pgmap v15831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:12:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:16 smithi122 ceph-mon[125440]: pgmap v15831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:12:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:18 smithi136 ceph-mon[125702]: pgmap v15832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T19:12:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:18 smithi136 ceph-mon[125702]: osdmap e1063: 12 total, 12 up, 12 in 2023-03-02T19:12:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:18 smithi057 ceph-mon[92072]: pgmap v15832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T19:12:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:18 smithi057 ceph-mon[92072]: osdmap e1063: 12 total, 12 up, 12 in 2023-03-02T19:12:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:18 smithi122 ceph-mon[125440]: pgmap v15832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 192 B/s wr, 14 op/s 2023-03-02T19:12:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:18 smithi122 ceph-mon[125440]: osdmap e1063: 12 total, 12 up, 12 in 2023-03-02T19:12:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:20 smithi136 ceph-mon[125702]: pgmap v15834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:12:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:20 smithi057 ceph-mon[92072]: pgmap v15834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:12:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:20 smithi122 ceph-mon[125440]: pgmap v15834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:12:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:22 smithi136 ceph-mon[125702]: pgmap v15835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:12:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:22 smithi057 ceph-mon[92072]: pgmap v15835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:12:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:22 smithi122 ceph-mon[125440]: pgmap v15835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:12:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:23 smithi136 ceph-mon[125702]: pgmap v15836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:12:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:23 smithi057 ceph-mon[92072]: pgmap v15836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:12:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:23 smithi122 ceph-mon[125440]: pgmap v15836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:12:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:26 smithi136 ceph-mon[125702]: pgmap v15837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:12:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:26 smithi057 ceph-mon[92072]: pgmap v15837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:12:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:26 smithi122 ceph-mon[125440]: pgmap v15837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:12:26.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:26.725+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:12:26.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:26.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:12:26.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:26.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:12:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:26.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:12:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:26.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:12:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:28 smithi136 ceph-mon[125702]: pgmap v15838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:12:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:28 smithi057 ceph-mon[92072]: pgmap v15838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:12:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:28 smithi122 ceph-mon[125440]: pgmap v15838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:12:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:30 smithi136 ceph-mon[125702]: pgmap v15839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:12:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:30 smithi057 ceph-mon[92072]: pgmap v15839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:12:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:30 smithi122 ceph-mon[125440]: pgmap v15839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:12:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:32 smithi136 ceph-mon[125702]: pgmap v15840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:32 smithi057 ceph-mon[92072]: pgmap v15840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:32 smithi122 ceph-mon[125440]: pgmap v15840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:33 smithi136 ceph-mon[125702]: pgmap v15841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:33 smithi057 ceph-mon[92072]: pgmap v15841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:33 smithi122 ceph-mon[125440]: pgmap v15841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:36 smithi136 ceph-mon[125702]: pgmap v15842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:36.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:36 smithi057 ceph-mon[92072]: pgmap v15842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:36 smithi122 ceph-mon[125440]: pgmap v15842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:38.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:38 smithi136 ceph-mon[125702]: pgmap v15843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:38.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:38 smithi057 ceph-mon[92072]: pgmap v15843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:38 smithi122 ceph-mon[125440]: pgmap v15843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:40 smithi136 ceph-mon[125702]: pgmap v15844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:40 smithi057 ceph-mon[92072]: pgmap v15844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:40 smithi122 ceph-mon[125440]: pgmap v15844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:41.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:12:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:41.742+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:12:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:41.742+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:12:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:41.742+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:12:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:41.742+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:12:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:42 smithi136 ceph-mon[125702]: pgmap v15845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:42 smithi057 ceph-mon[92072]: pgmap v15845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:42 smithi122 ceph-mon[125440]: pgmap v15845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:43 smithi136 ceph-mon[125702]: pgmap v15846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:43 smithi057 ceph-mon[92072]: pgmap v15846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:43 smithi122 ceph-mon[125440]: pgmap v15846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:46 smithi136 ceph-mon[125702]: pgmap v15847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:46 smithi057 ceph-mon[92072]: pgmap v15847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:46 smithi122 ceph-mon[125440]: pgmap v15847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:48 smithi136 ceph-mon[125702]: pgmap v15848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:48 smithi057 ceph-mon[92072]: pgmap v15848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:48 smithi122 ceph-mon[125440]: pgmap v15848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:50 smithi136 ceph-mon[125702]: pgmap v15849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:50 smithi057 ceph-mon[92072]: pgmap v15849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:50 smithi122 ceph-mon[125440]: pgmap v15849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:52 smithi136 ceph-mon[125702]: pgmap v15850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:52 smithi057 ceph-mon[92072]: pgmap v15850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:52 smithi122 ceph-mon[125440]: pgmap v15850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:53 smithi136 ceph-mon[125702]: pgmap v15851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:53 smithi057 ceph-mon[92072]: pgmap v15851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:53 smithi122 ceph-mon[125440]: pgmap v15851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:56 smithi136 ceph-mon[125702]: pgmap v15852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:56 smithi057 ceph-mon[92072]: pgmap v15852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:56 smithi122 ceph-mon[125440]: pgmap v15852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:12:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:56.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:12:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:56.754+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:12:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:56.754+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:12:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:56.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:12:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:12:56.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:12:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:12:58 smithi136 ceph-mon[125702]: pgmap v15853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:12:58 smithi057 ceph-mon[92072]: pgmap v15853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:12:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:12:58 smithi122 ceph-mon[125440]: pgmap v15853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:00 smithi136 ceph-mon[125702]: pgmap v15854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:13:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:00 smithi057 ceph-mon[92072]: pgmap v15854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:13:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:00 smithi122 ceph-mon[125440]: pgmap v15854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:13:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:02 smithi136 ceph-mon[125702]: pgmap v15855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:13:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:02 smithi057 ceph-mon[92072]: pgmap v15855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:13:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:02 smithi122 ceph-mon[125440]: pgmap v15855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:13:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:03 smithi136 ceph-mon[125702]: pgmap v15856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:13:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:03 smithi057 ceph-mon[92072]: pgmap v15856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:13:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:03 smithi122 ceph-mon[125440]: pgmap v15856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:13:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:13:04.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:13:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:13:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:13:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:13:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:05 smithi136 ceph-mon[125702]: pgmap v15857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:13:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:13:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:13:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:13:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:13:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:13:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:05 smithi057 ceph-mon[92072]: pgmap v15857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:13:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:13:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:13:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:13:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:13:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:13:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:05 smithi122 ceph-mon[125440]: pgmap v15857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:13:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:13:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:13:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:13:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:08 smithi136 ceph-mon[125702]: pgmap v15858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:13:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:08 smithi057 ceph-mon[92072]: pgmap v15858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:13:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:08 smithi122 ceph-mon[125440]: pgmap v15858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:13:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:10 smithi136 ceph-mon[125702]: pgmap v15859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:13:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:10 smithi057 ceph-mon[92072]: pgmap v15859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:13:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:10 smithi122 ceph-mon[125440]: pgmap v15859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:13:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:11.767+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:13:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:11.768+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:13:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:11.768+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:13:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:11.768+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:13:11.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:11.768+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:13:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:12 smithi136 ceph-mon[125702]: pgmap v15860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:13:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:12 smithi136 ceph-mon[125702]: osdmap e1064: 12 total, 12 up, 12 in 2023-03-02T19:13:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:12 smithi057 ceph-mon[92072]: pgmap v15860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:13:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:12 smithi057 ceph-mon[92072]: osdmap e1064: 12 total, 12 up, 12 in 2023-03-02T19:13:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:12 smithi122 ceph-mon[125440]: pgmap v15860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:13:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:12 smithi122 ceph-mon[125440]: osdmap e1064: 12 total, 12 up, 12 in 2023-03-02T19:13:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:13 smithi136 ceph-mon[125702]: pgmap v15862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:13 smithi057 ceph-mon[92072]: pgmap v15862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:13 smithi122 ceph-mon[125440]: pgmap v15862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:16 smithi136 ceph-mon[125702]: pgmap v15863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:16 smithi057 ceph-mon[92072]: pgmap v15863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:16 smithi122 ceph-mon[125440]: pgmap v15863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:18 smithi136 ceph-mon[125702]: pgmap v15864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:13:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:18 smithi136 ceph-mon[125702]: osdmap e1065: 12 total, 12 up, 12 in 2023-03-02T19:13:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:18 smithi057 ceph-mon[92072]: pgmap v15864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:13:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:18 smithi057 ceph-mon[92072]: osdmap e1065: 12 total, 12 up, 12 in 2023-03-02T19:13:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:18 smithi122 ceph-mon[125440]: pgmap v15864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:13:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:18 smithi122 ceph-mon[125440]: osdmap e1065: 12 total, 12 up, 12 in 2023-03-02T19:13:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:20 smithi136 ceph-mon[125702]: pgmap v15866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T19:13:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:20 smithi057 ceph-mon[92072]: pgmap v15866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T19:13:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:20 smithi122 ceph-mon[125440]: pgmap v15866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2023-03-02T19:13:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:22 smithi136 ceph-mon[125702]: pgmap v15867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:13:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:22 smithi057 ceph-mon[92072]: pgmap v15867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:13:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:22 smithi122 ceph-mon[125440]: pgmap v15867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:13:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:23 smithi136 ceph-mon[125702]: pgmap v15868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:23.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:23 smithi057 ceph-mon[92072]: pgmap v15868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:23 smithi122 ceph-mon[125440]: pgmap v15868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:26 smithi136 ceph-mon[125702]: pgmap v15869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:26 smithi057 ceph-mon[92072]: pgmap v15869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:26 smithi122 ceph-mon[125440]: pgmap v15869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:13:26.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:26.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:13:26.785 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:26.784+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:13:26.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:26.784+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:13:26.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:26.784+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:13:26.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:26.784+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:13:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:28 smithi136 ceph-mon[125702]: pgmap v15870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T19:13:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:28 smithi057 ceph-mon[92072]: pgmap v15870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T19:13:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:28 smithi122 ceph-mon[125440]: pgmap v15870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T19:13:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:30 smithi136 ceph-mon[125702]: pgmap v15871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T19:13:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:30 smithi057 ceph-mon[92072]: pgmap v15871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T19:13:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:30 smithi122 ceph-mon[125440]: pgmap v15871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T19:13:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:32 smithi136 ceph-mon[125702]: pgmap v15872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:32.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:32 smithi057 ceph-mon[92072]: pgmap v15872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:32 smithi122 ceph-mon[125440]: pgmap v15872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:33 smithi136 ceph-mon[125702]: pgmap v15873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:13:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:33 smithi057 ceph-mon[92072]: pgmap v15873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:13:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:33 smithi122 ceph-mon[125440]: pgmap v15873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:13:36.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:36 smithi136 ceph-mon[125702]: pgmap v15874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:36 smithi057 ceph-mon[92072]: pgmap v15874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:36 smithi122 ceph-mon[125440]: pgmap v15874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:38 smithi136 ceph-mon[125702]: pgmap v15875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:38 smithi057 ceph-mon[92072]: pgmap v15875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:38 smithi122 ceph-mon[125440]: pgmap v15875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:40 smithi136 ceph-mon[125702]: pgmap v15876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:40 smithi057 ceph-mon[92072]: pgmap v15876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:40 smithi122 ceph-mon[125440]: pgmap v15876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:41.798+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:13:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:41.799+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:13:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:41.799+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:13:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:41.799+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:13:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:41.799+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:13:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:42 smithi136 ceph-mon[125702]: pgmap v15877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:42.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:42 smithi057 ceph-mon[92072]: pgmap v15877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:42 smithi122 ceph-mon[125440]: pgmap v15877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:43 smithi136 ceph-mon[125702]: pgmap v15878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:43 smithi057 ceph-mon[92072]: pgmap v15878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:43 smithi122 ceph-mon[125440]: pgmap v15878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:46 smithi136 ceph-mon[125702]: pgmap v15879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:46 smithi057 ceph-mon[92072]: pgmap v15879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:46 smithi122 ceph-mon[125440]: pgmap v15879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:48 smithi136 ceph-mon[125702]: pgmap v15880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:48 smithi057 ceph-mon[92072]: pgmap v15880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:48 smithi122 ceph-mon[125440]: pgmap v15880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:50 smithi136 ceph-mon[125702]: pgmap v15881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:50.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:50 smithi057 ceph-mon[92072]: pgmap v15881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:50 smithi122 ceph-mon[125440]: pgmap v15881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:52 smithi136 ceph-mon[125702]: pgmap v15882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:52 smithi057 ceph-mon[92072]: pgmap v15882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:52 smithi122 ceph-mon[125440]: pgmap v15882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:53.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:53 smithi136 ceph-mon[125702]: pgmap v15883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:53 smithi057 ceph-mon[92072]: pgmap v15883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:53 smithi122 ceph-mon[125440]: pgmap v15883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:56 smithi136 ceph-mon[125702]: pgmap v15884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:56 smithi057 ceph-mon[92072]: pgmap v15884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:56 smithi122 ceph-mon[125440]: pgmap v15884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:13:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:56.805+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:13:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:56.805+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:13:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:56.805+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:13:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:56.805+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:13:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:13:56.805+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:13:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:13:58 smithi136 ceph-mon[125702]: pgmap v15885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:58.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:13:58 smithi057 ceph-mon[92072]: pgmap v15885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:13:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:13:58 smithi122 ceph-mon[125440]: pgmap v15885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:00 smithi136 ceph-mon[125702]: pgmap v15886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:00 smithi057 ceph-mon[92072]: pgmap v15886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:00 smithi122 ceph-mon[125440]: pgmap v15886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:02 smithi136 ceph-mon[125702]: pgmap v15887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:02 smithi057 ceph-mon[92072]: pgmap v15887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:02 smithi122 ceph-mon[125440]: pgmap v15887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:03 smithi136 ceph-mon[125702]: pgmap v15888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:14:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:03 smithi057 ceph-mon[92072]: pgmap v15888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:14:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:03 smithi122 ceph-mon[125440]: pgmap v15888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:14:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:06 smithi136 ceph-mon[125702]: pgmap v15889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:14:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:14:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:06 smithi057 ceph-mon[92072]: pgmap v15889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:14:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:14:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:06 smithi122 ceph-mon[125440]: pgmap v15889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:14:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:14:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:07 smithi136 ceph-mon[125702]: osdmap e1066: 12 total, 12 up, 12 in 2023-03-02T19:14:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:14:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:14:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:07 smithi057 ceph-mon[92072]: osdmap e1066: 12 total, 12 up, 12 in 2023-03-02T19:14:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:14:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:14:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:07 smithi122 ceph-mon[125440]: osdmap e1066: 12 total, 12 up, 12 in 2023-03-02T19:14:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:14:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:14:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:14:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:08.422+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T19:14:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:08.422+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T19:14:08.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:08.422+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5870019780 tx=0x7f587008e000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:14:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:08.422+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5870019780 tx=0x7f587008e000 comp rx=0 tx=0).stop 2023-03-02T19:14:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:08.422+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T19:14:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:08.422+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T19:14:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:08.422+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T19:14:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:08.422+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T19:14:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:08.422+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:14:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:08.423+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5870019800 tx=0x7f5870041000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T19:14:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:08 smithi136 ceph-mon[125702]: pgmap v15891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:14:08.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:08 smithi057 ceph-mon[92072]: pgmap v15891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:14:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:08 smithi122 ceph-mon[125440]: pgmap v15891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:14:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:10 smithi136 ceph-mon[125702]: pgmap v15892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:14:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:10 smithi057 ceph-mon[92072]: pgmap v15892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:14:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:10 smithi122 ceph-mon[125440]: pgmap v15892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:14:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:11.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:14:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:11.819+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:14:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:11.819+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:14:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:11.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:14:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:11.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:14:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:12 smithi136 ceph-mon[125702]: pgmap v15893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:14:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:12.663+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:14:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:12.663+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:14:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:12.663+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 230 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:14:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:12.663+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:14:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:12.663+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 229 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:14:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:12.663+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:14:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:12.663+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 231 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:14:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:12.664+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 230 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:14:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:12 smithi057 ceph-mon[92072]: pgmap v15893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:14:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:12 smithi122 ceph-mon[125440]: pgmap v15893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:14:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:13 smithi136 ceph-mon[125702]: osdmap e1067: 12 total, 12 up, 12 in 2023-03-02T19:14:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:13 smithi136 ceph-mon[125702]: pgmap v15895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:14:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:13 smithi057 ceph-mon[92072]: osdmap e1067: 12 total, 12 up, 12 in 2023-03-02T19:14:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:13 smithi057 ceph-mon[92072]: pgmap v15895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:14:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:13 smithi122 ceph-mon[125440]: osdmap e1067: 12 total, 12 up, 12 in 2023-03-02T19:14:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:13 smithi122 ceph-mon[125440]: pgmap v15895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:14:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:16 smithi136 ceph-mon[125702]: pgmap v15896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:14:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:16 smithi057 ceph-mon[92072]: pgmap v15896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:14:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:16 smithi122 ceph-mon[125440]: pgmap v15896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-02T19:14:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:18 smithi136 ceph-mon[125702]: pgmap v15897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:14:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:18 smithi057 ceph-mon[92072]: pgmap v15897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:14:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:18 smithi122 ceph-mon[125440]: pgmap v15897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:14:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:20 smithi136 ceph-mon[125702]: pgmap v15898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:14:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:20 smithi057 ceph-mon[92072]: pgmap v15898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:14:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:20 smithi122 ceph-mon[125440]: pgmap v15898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:14:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:22 smithi136 ceph-mon[125702]: pgmap v15899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:14:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:22 smithi057 ceph-mon[92072]: pgmap v15899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:14:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:22 smithi122 ceph-mon[125440]: pgmap v15899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:14:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:23 smithi136 ceph-mon[125702]: pgmap v15900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:14:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:23 smithi057 ceph-mon[92072]: pgmap v15900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:14:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:23 smithi122 ceph-mon[125440]: pgmap v15900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:14:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:26 smithi136 ceph-mon[125702]: pgmap v15901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:26 smithi057 ceph-mon[92072]: pgmap v15901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:26 smithi122 ceph-mon[125440]: pgmap v15901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:26.831+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:14:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:26.831+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:14:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:26.831+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:14:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:26.831+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:14:26.834 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:26.831+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:14:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:28 smithi136 ceph-mon[125702]: pgmap v15902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:28 smithi057 ceph-mon[92072]: pgmap v15902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:28 smithi122 ceph-mon[125440]: pgmap v15902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:30 smithi136 ceph-mon[125702]: pgmap v15903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:30 smithi057 ceph-mon[92072]: pgmap v15903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:30 smithi122 ceph-mon[125440]: pgmap v15903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:32 smithi136 ceph-mon[125702]: pgmap v15904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:32 smithi057 ceph-mon[92072]: pgmap v15904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:32 smithi122 ceph-mon[125440]: pgmap v15904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:33 smithi136 ceph-mon[125702]: pgmap v15905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:33 smithi057 ceph-mon[92072]: pgmap v15905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:33 smithi122 ceph-mon[125440]: pgmap v15905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:36 smithi136 ceph-mon[125702]: pgmap v15906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:36 smithi057 ceph-mon[92072]: pgmap v15906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:36 smithi122 ceph-mon[125440]: pgmap v15906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:38 smithi136 ceph-mon[125702]: pgmap v15907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:38 smithi057 ceph-mon[92072]: pgmap v15907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:38 smithi122 ceph-mon[125440]: pgmap v15907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:40 smithi136 ceph-mon[125702]: pgmap v15908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:40.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:40 smithi057 ceph-mon[92072]: pgmap v15908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:40 smithi122 ceph-mon[125440]: pgmap v15908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:41.843 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:41.842+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:14:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:41.842+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:14:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:41.842+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:14:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:41.842+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:14:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:41.842+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:14:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:42 smithi136 ceph-mon[125702]: pgmap v15909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:42 smithi057 ceph-mon[92072]: pgmap v15909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:42 smithi122 ceph-mon[125440]: pgmap v15909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:43 smithi057 ceph-mon[92072]: pgmap v15910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:43 smithi122 ceph-mon[125440]: pgmap v15910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:43 smithi136 ceph-mon[125702]: pgmap v15910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:46 smithi136 ceph-mon[125702]: pgmap v15911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:46.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:46 smithi057 ceph-mon[92072]: pgmap v15911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:46 smithi122 ceph-mon[125440]: pgmap v15911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:48 smithi136 ceph-mon[125702]: pgmap v15912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:48 smithi057 ceph-mon[92072]: pgmap v15912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:48 smithi122 ceph-mon[125440]: pgmap v15912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:50 smithi136 ceph-mon[125702]: pgmap v15913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:50 smithi057 ceph-mon[92072]: pgmap v15913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:50 smithi122 ceph-mon[125440]: pgmap v15913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:52 smithi136 ceph-mon[125702]: pgmap v15914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:52 smithi057 ceph-mon[92072]: pgmap v15914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:52 smithi122 ceph-mon[125440]: pgmap v15914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:53 smithi057 ceph-mon[92072]: pgmap v15915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:53 smithi122 ceph-mon[125440]: pgmap v15915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:53 smithi136 ceph-mon[125702]: pgmap v15915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:56 smithi136 ceph-mon[125702]: pgmap v15916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:56 smithi057 ceph-mon[92072]: pgmap v15916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:56 smithi122 ceph-mon[125440]: pgmap v15916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:14:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:56.858+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:14:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:56.858+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:14:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:56.858+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:14:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:56.858+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:14:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:14:56.858+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:14:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:14:58 smithi136 ceph-mon[125702]: pgmap v15917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:14:58 smithi057 ceph-mon[92072]: pgmap v15917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:14:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:14:58 smithi122 ceph-mon[125440]: pgmap v15917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:00 smithi136 ceph-mon[125702]: pgmap v15918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:00 smithi057 ceph-mon[92072]: pgmap v15918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:00 smithi122 ceph-mon[125440]: pgmap v15918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:02 smithi136 ceph-mon[125702]: pgmap v15919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:02.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:02 smithi057 ceph-mon[92072]: pgmap v15919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:02 smithi122 ceph-mon[125440]: pgmap v15919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:03 smithi057 ceph-mon[92072]: pgmap v15920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:15:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:03 smithi122 ceph-mon[125440]: pgmap v15920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:15:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:03 smithi136 ceph-mon[125702]: pgmap v15920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:15:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:06 smithi136 ceph-mon[125702]: pgmap v15921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:15:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:06 smithi057 ceph-mon[92072]: pgmap v15921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:15:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:06 smithi122 ceph-mon[125440]: pgmap v15921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:15:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:07 smithi136 ceph-mon[125702]: osdmap e1068: 12 total, 12 up, 12 in 2023-03-02T19:15:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:15:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:07 smithi057 ceph-mon[92072]: osdmap e1068: 12 total, 12 up, 12 in 2023-03-02T19:15:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:15:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:07 smithi122 ceph-mon[125440]: osdmap e1068: 12 total, 12 up, 12 in 2023-03-02T19:15:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:15:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:08 smithi136 ceph-mon[125702]: pgmap v15923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:15:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:15:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:15:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:15:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:08 smithi057 ceph-mon[92072]: pgmap v15923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:15:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:15:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:15:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:15:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:08 smithi122 ceph-mon[125440]: pgmap v15923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:15:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:15:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:15:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:15:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:10 smithi136 ceph-mon[125702]: pgmap v15924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:15:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:10 smithi057 ceph-mon[92072]: pgmap v15924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:15:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:10 smithi122 ceph-mon[125440]: pgmap v15924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:15:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:11.863+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:15:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:11.863+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:15:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:11.863+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:15:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:11.863+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:15:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:11.863+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:15:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:12 smithi057 ceph-mon[92072]: pgmap v15925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:15:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:12 smithi122 ceph-mon[125440]: pgmap v15925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:15:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:12 smithi136 ceph-mon[125702]: pgmap v15925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:15:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:13 smithi057 ceph-mon[92072]: pgmap v15926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:15:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:13 smithi122 ceph-mon[125440]: pgmap v15926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:15:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:13 smithi136 ceph-mon[125702]: pgmap v15926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:15:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:16 smithi136 ceph-mon[125702]: pgmap v15927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:15:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:16 smithi057 ceph-mon[92072]: pgmap v15927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:15:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:16 smithi122 ceph-mon[125440]: pgmap v15927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:15:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:18 smithi136 ceph-mon[125702]: pgmap v15928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:15:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:18 smithi136 ceph-mon[125702]: osdmap e1069: 12 total, 12 up, 12 in 2023-03-02T19:15:18.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:18 smithi057 ceph-mon[92072]: pgmap v15928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:15:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:18 smithi057 ceph-mon[92072]: osdmap e1069: 12 total, 12 up, 12 in 2023-03-02T19:15:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:18 smithi122 ceph-mon[125440]: pgmap v15928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:15:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:18 smithi122 ceph-mon[125440]: osdmap e1069: 12 total, 12 up, 12 in 2023-03-02T19:15:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:20 smithi136 ceph-mon[125702]: pgmap v15930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:15:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:20 smithi057 ceph-mon[92072]: pgmap v15930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:15:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:20 smithi122 ceph-mon[125440]: pgmap v15930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:15:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:22 smithi136 ceph-mon[125702]: pgmap v15931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:15:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:22 smithi057 ceph-mon[92072]: pgmap v15931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:15:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:22 smithi122 ceph-mon[125440]: pgmap v15931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:15:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:23 smithi057 ceph-mon[92072]: pgmap v15932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:15:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:23 smithi122 ceph-mon[125440]: pgmap v15932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:15:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:23 smithi136 ceph-mon[125702]: pgmap v15932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:15:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:26 smithi136 ceph-mon[125702]: pgmap v15933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:15:26.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:26 smithi057 ceph-mon[92072]: pgmap v15933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:15:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:26 smithi122 ceph-mon[125440]: pgmap v15933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:15:26.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:26.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:15:26.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:26.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:15:26.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:26.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:15:26.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:26.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:15:26.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:26.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:15:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:28 smithi136 ceph-mon[125702]: pgmap v15934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:15:28.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:28 smithi057 ceph-mon[92072]: pgmap v15934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:15:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:28 smithi122 ceph-mon[125440]: pgmap v15934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:15:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:30 smithi136 ceph-mon[125702]: pgmap v15935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:15:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:30 smithi057 ceph-mon[92072]: pgmap v15935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:15:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:30 smithi122 ceph-mon[125440]: pgmap v15935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:15:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:32 smithi136 ceph-mon[125702]: pgmap v15936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:32.689 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:32 smithi057 ceph-mon[92072]: pgmap v15936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:32 smithi122 ceph-mon[125440]: pgmap v15936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:33 smithi057 ceph-mon[92072]: pgmap v15937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:33 smithi122 ceph-mon[125440]: pgmap v15937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:33 smithi136 ceph-mon[125702]: pgmap v15937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:36 smithi136 ceph-mon[125702]: pgmap v15938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:36 smithi057 ceph-mon[92072]: pgmap v15938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:36 smithi122 ceph-mon[125440]: pgmap v15938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:38 smithi136 ceph-mon[125702]: pgmap v15939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:38 smithi057 ceph-mon[92072]: pgmap v15939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:38 smithi122 ceph-mon[125440]: pgmap v15939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:40 smithi136 ceph-mon[125702]: pgmap v15940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:40 smithi057 ceph-mon[92072]: pgmap v15940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:40 smithi122 ceph-mon[125440]: pgmap v15940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:41.876+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:15:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:41.876+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:15:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:41.876+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:15:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:41.876+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:15:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:41.876+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:15:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:42 smithi057 ceph-mon[92072]: pgmap v15941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:42 smithi122 ceph-mon[125440]: pgmap v15941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:42 smithi136 ceph-mon[125702]: pgmap v15941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:43 smithi057 ceph-mon[92072]: pgmap v15942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:43 smithi122 ceph-mon[125440]: pgmap v15942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:43 smithi136 ceph-mon[125702]: pgmap v15942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:46 smithi136 ceph-mon[125702]: pgmap v15943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:46 smithi057 ceph-mon[92072]: pgmap v15943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:46 smithi122 ceph-mon[125440]: pgmap v15943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:48 smithi136 ceph-mon[125702]: pgmap v15944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:48 smithi057 ceph-mon[92072]: pgmap v15944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:48 smithi122 ceph-mon[125440]: pgmap v15944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:50 smithi057 ceph-mon[92072]: pgmap v15945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:50 smithi122 ceph-mon[125440]: pgmap v15945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:50 smithi136 ceph-mon[125702]: pgmap v15945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:52 smithi057 ceph-mon[92072]: pgmap v15946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:52 smithi122 ceph-mon[125440]: pgmap v15946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:52 smithi136 ceph-mon[125702]: pgmap v15946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:53 smithi057 ceph-mon[92072]: pgmap v15947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:53 smithi122 ceph-mon[125440]: pgmap v15947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:53 smithi136 ceph-mon[125702]: pgmap v15947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:56 smithi136 ceph-mon[125702]: pgmap v15948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:56 smithi057 ceph-mon[92072]: pgmap v15948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:56 smithi122 ceph-mon[125440]: pgmap v15948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:15:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:56.878+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:15:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:56.878+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:15:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:56.878+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:15:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:56.878+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:15:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:15:56.878+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:15:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:15:58 smithi136 ceph-mon[125702]: pgmap v15949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:15:58 smithi057 ceph-mon[92072]: pgmap v15949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:15:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:15:58 smithi122 ceph-mon[125440]: pgmap v15949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:00 smithi136 ceph-mon[125702]: pgmap v15950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:00 smithi057 ceph-mon[92072]: pgmap v15950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:00 smithi122 ceph-mon[125440]: pgmap v15950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:02 smithi057 ceph-mon[92072]: pgmap v15951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:02 smithi122 ceph-mon[125440]: pgmap v15951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:02 smithi136 ceph-mon[125702]: pgmap v15951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:03 smithi057 ceph-mon[92072]: pgmap v15952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:16:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:03 smithi122 ceph-mon[125440]: pgmap v15952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:16:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:03 smithi136 ceph-mon[125702]: pgmap v15952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:16:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:06 smithi136 ceph-mon[125702]: pgmap v15953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:16:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:06 smithi057 ceph-mon[92072]: pgmap v15953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:16:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:06 smithi122 ceph-mon[125440]: pgmap v15953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:16:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:07 smithi057 ceph-mon[92072]: osdmap e1070: 12 total, 12 up, 12 in 2023-03-02T19:16:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:07 smithi122 ceph-mon[125440]: osdmap e1070: 12 total, 12 up, 12 in 2023-03-02T19:16:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:07 smithi136 ceph-mon[125702]: osdmap e1070: 12 total, 12 up, 12 in 2023-03-02T19:16:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:08 smithi057 ceph-mon[92072]: pgmap v15955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:16:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:16:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:08 smithi122 ceph-mon[125440]: pgmap v15955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:16:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:16:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:08 smithi136 ceph-mon[125702]: pgmap v15955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:16:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:16:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:16:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:16:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:16:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:16:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:16:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:16:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:16:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:16:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:16:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:10 smithi057 ceph-mon[92072]: pgmap v15956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:16:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:10 smithi122 ceph-mon[125440]: pgmap v15956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:16:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:10 smithi136 ceph-mon[125702]: pgmap v15956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:16:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:11.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:16:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:11.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:16:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:11.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:16:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:11.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:16:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:11.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:16:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:12 smithi057 ceph-mon[92072]: pgmap v15957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:16:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:12 smithi122 ceph-mon[125440]: pgmap v15957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:16:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:12 smithi136 ceph-mon[125702]: pgmap v15957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:16:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:13 smithi057 ceph-mon[92072]: pgmap v15958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:16:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:13 smithi122 ceph-mon[125440]: pgmap v15958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:16:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:13 smithi136 ceph-mon[125702]: pgmap v15958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:16:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:16 smithi136 ceph-mon[125702]: pgmap v15959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:16:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:16 smithi057 ceph-mon[92072]: pgmap v15959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:16:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:16 smithi122 ceph-mon[125440]: pgmap v15959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:16:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:18 smithi057 ceph-mon[92072]: pgmap v15960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:16:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:18 smithi057 ceph-mon[92072]: osdmap e1071: 12 total, 12 up, 12 in 2023-03-02T19:16:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:18 smithi122 ceph-mon[125440]: pgmap v15960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:16:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:18 smithi122 ceph-mon[125440]: osdmap e1071: 12 total, 12 up, 12 in 2023-03-02T19:16:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:18 smithi136 ceph-mon[125702]: pgmap v15960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:16:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:18 smithi136 ceph-mon[125702]: osdmap e1071: 12 total, 12 up, 12 in 2023-03-02T19:16:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:20 smithi057 ceph-mon[92072]: pgmap v15962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:16:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:20 smithi122 ceph-mon[125440]: pgmap v15962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:16:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:20 smithi136 ceph-mon[125702]: pgmap v15962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:16:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:22 smithi057 ceph-mon[92072]: pgmap v15963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:16:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:22 smithi122 ceph-mon[125440]: pgmap v15963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:16:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:22 smithi136 ceph-mon[125702]: pgmap v15963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:16:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:23 smithi057 ceph-mon[92072]: pgmap v15964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:16:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:23 smithi122 ceph-mon[125440]: pgmap v15964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:16:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:23 smithi136 ceph-mon[125702]: pgmap v15964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:16:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:26 smithi136 ceph-mon[125702]: pgmap v15965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:16:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:26 smithi057 ceph-mon[92072]: pgmap v15965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:16:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:26 smithi122 ceph-mon[125440]: pgmap v15965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:16:26.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:26.901+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:16:26.904 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:26.901+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:16:26.904 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:26.901+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:16:26.904 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:26.901+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:16:26.904 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:26.901+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:16:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:28 smithi057 ceph-mon[92072]: pgmap v15966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:16:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:28 smithi122 ceph-mon[125440]: pgmap v15966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:16:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:28 smithi136 ceph-mon[125702]: pgmap v15966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:16:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:30 smithi057 ceph-mon[92072]: pgmap v15967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:16:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:30 smithi122 ceph-mon[125440]: pgmap v15967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:16:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:30 smithi136 ceph-mon[125702]: pgmap v15967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:16:32.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:32 smithi057 ceph-mon[92072]: pgmap v15968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:32 smithi122 ceph-mon[125440]: pgmap v15968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:32 smithi136 ceph-mon[125702]: pgmap v15968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:33.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:33 smithi057 ceph-mon[92072]: pgmap v15969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:33 smithi122 ceph-mon[125440]: pgmap v15969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:33 smithi136 ceph-mon[125702]: pgmap v15969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:36 smithi057 ceph-mon[92072]: pgmap v15970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:36 smithi122 ceph-mon[125440]: pgmap v15970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:36 smithi136 ceph-mon[125702]: pgmap v15970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:38 smithi057 ceph-mon[92072]: pgmap v15971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:38 smithi122 ceph-mon[125440]: pgmap v15971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:38 smithi136 ceph-mon[125702]: pgmap v15971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:40 smithi057 ceph-mon[92072]: pgmap v15972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:40 smithi122 ceph-mon[125440]: pgmap v15972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:40 smithi136 ceph-mon[125702]: pgmap v15972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:41.918 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:41.917+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:16:41.919 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:41.917+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:16:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:41.917+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:16:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:41.917+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:16:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:41.917+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:16:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:42 smithi057 ceph-mon[92072]: pgmap v15973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:42 smithi122 ceph-mon[125440]: pgmap v15973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:42 smithi136 ceph-mon[125702]: pgmap v15973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:43 smithi057 ceph-mon[92072]: pgmap v15974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:43 smithi122 ceph-mon[125440]: pgmap v15974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:43 smithi136 ceph-mon[125702]: pgmap v15974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:46 smithi057 ceph-mon[92072]: pgmap v15975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:46 smithi122 ceph-mon[125440]: pgmap v15975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:46 smithi136 ceph-mon[125702]: pgmap v15975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:48 smithi057 ceph-mon[92072]: pgmap v15976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:48 smithi122 ceph-mon[125440]: pgmap v15976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:48 smithi136 ceph-mon[125702]: pgmap v15976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:50 smithi057 ceph-mon[92072]: pgmap v15977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:50 smithi122 ceph-mon[125440]: pgmap v15977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:50 smithi136 ceph-mon[125702]: pgmap v15977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:52 smithi057 ceph-mon[92072]: pgmap v15978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:52 smithi122 ceph-mon[125440]: pgmap v15978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:52 smithi136 ceph-mon[125702]: pgmap v15978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:53 smithi057 ceph-mon[92072]: pgmap v15979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:53 smithi122 ceph-mon[125440]: pgmap v15979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:53 smithi136 ceph-mon[125702]: pgmap v15979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:56 smithi057 ceph-mon[92072]: pgmap v15980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:56 smithi122 ceph-mon[125440]: pgmap v15980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:56 smithi136 ceph-mon[125702]: pgmap v15980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:16:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:56.931+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:16:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:56.932+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:16:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:56.932+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:16:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:56.932+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:16:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:16:56.932+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:16:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:16:58 smithi057 ceph-mon[92072]: pgmap v15981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:16:58 smithi122 ceph-mon[125440]: pgmap v15981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:16:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:16:58 smithi136 ceph-mon[125702]: pgmap v15981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:00 smithi057 ceph-mon[92072]: pgmap v15982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:00 smithi122 ceph-mon[125440]: pgmap v15982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:00 smithi136 ceph-mon[125702]: pgmap v15982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:02 smithi057 ceph-mon[92072]: pgmap v15983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:02 smithi122 ceph-mon[125440]: pgmap v15983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:02 smithi136 ceph-mon[125702]: pgmap v15983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:03 smithi057 ceph-mon[92072]: pgmap v15984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:17:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:03 smithi122 ceph-mon[125440]: pgmap v15984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:17:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:03 smithi136 ceph-mon[125702]: pgmap v15984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:17:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:06 smithi057 ceph-mon[92072]: pgmap v15985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:17:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:06 smithi122 ceph-mon[125440]: pgmap v15985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:17:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:06 smithi136 ceph-mon[125702]: pgmap v15985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:17:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:07 smithi057 ceph-mon[92072]: osdmap e1072: 12 total, 12 up, 12 in 2023-03-02T19:17:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:07 smithi122 ceph-mon[125440]: osdmap e1072: 12 total, 12 up, 12 in 2023-03-02T19:17:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:07 smithi136 ceph-mon[125702]: osdmap e1072: 12 total, 12 up, 12 in 2023-03-02T19:17:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:08 smithi057 ceph-mon[92072]: pgmap v15987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:17:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:08 smithi057 ceph-mon[92072]: osdmap e1073: 12 total, 12 up, 12 in 2023-03-02T19:17:08.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:08 smithi122 ceph-mon[125440]: pgmap v15987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:17:08.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:08 smithi122 ceph-mon[125440]: osdmap e1073: 12 total, 12 up, 12 in 2023-03-02T19:17:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:08 smithi136 ceph-mon[125702]: pgmap v15987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:17:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:08 smithi136 ceph-mon[125702]: osdmap e1073: 12 total, 12 up, 12 in 2023-03-02T19:17:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:17:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:17:09.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:17:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:10 smithi057 ceph-mon[92072]: pgmap v15989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:17:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:17:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:17:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:17:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:10 smithi122 ceph-mon[125440]: pgmap v15989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:17:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:17:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:17:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:17:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:10 smithi136 ceph-mon[125702]: pgmap v15989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:17:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:17:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:17:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:17:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:11.947+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:17:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:11.949+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:17:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:11.949+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:17:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:11.949+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:17:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:11.949+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:17:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:12 smithi057 ceph-mon[92072]: pgmap v15990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:17:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:12.690+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:17:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:12.690+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:17:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:12.690+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 231 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:17:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:12.690+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 232 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:17:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:12 smithi122 ceph-mon[125440]: pgmap v15990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:17:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:12 smithi136 ceph-mon[125702]: pgmap v15990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:17:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:13 smithi057 ceph-mon[92072]: pgmap v15991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:17:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:13 smithi122 ceph-mon[125440]: pgmap v15991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:17:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:13 smithi136 ceph-mon[125702]: pgmap v15991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:17:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:16 smithi057 ceph-mon[92072]: pgmap v15992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-02T19:17:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:16 smithi122 ceph-mon[125440]: pgmap v15992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-02T19:17:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:16 smithi136 ceph-mon[125702]: pgmap v15992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-02T19:17:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:18 smithi057 ceph-mon[92072]: pgmap v15993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:17:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:18 smithi122 ceph-mon[125440]: pgmap v15993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:17:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:18 smithi136 ceph-mon[125702]: pgmap v15993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:17:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:20 smithi057 ceph-mon[92072]: pgmap v15994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:17:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:20 smithi122 ceph-mon[125440]: pgmap v15994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:17:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:20 smithi136 ceph-mon[125702]: pgmap v15994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:17:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:22 smithi057 ceph-mon[92072]: pgmap v15995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:17:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:22 smithi122 ceph-mon[125440]: pgmap v15995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:17:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:22 smithi136 ceph-mon[125702]: pgmap v15995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:17:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:23 smithi057 ceph-mon[92072]: pgmap v15996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:17:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:23 smithi122 ceph-mon[125440]: pgmap v15996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:17:24.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:23 smithi136 ceph-mon[125702]: pgmap v15996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:17:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:26 smithi057 ceph-mon[92072]: pgmap v15997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:26.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:26 smithi122 ceph-mon[125440]: pgmap v15997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:26 smithi136 ceph-mon[125702]: pgmap v15997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:26.953+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:17:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:26.953+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:17:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:26.953+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:17:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:26.953+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:17:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:26.953+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:17:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:28 smithi057 ceph-mon[92072]: pgmap v15998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:28 smithi122 ceph-mon[125440]: pgmap v15998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:28 smithi136 ceph-mon[125702]: pgmap v15998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:30 smithi057 ceph-mon[92072]: pgmap v15999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:30 smithi122 ceph-mon[125440]: pgmap v15999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:30 smithi136 ceph-mon[125702]: pgmap v15999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:32 smithi057 ceph-mon[92072]: pgmap v16000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:32 smithi122 ceph-mon[125440]: pgmap v16000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:32 smithi136 ceph-mon[125702]: pgmap v16000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:33 smithi057 ceph-mon[92072]: pgmap v16001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:33 smithi122 ceph-mon[125440]: pgmap v16001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:33 smithi136 ceph-mon[125702]: pgmap v16001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:36 smithi057 ceph-mon[92072]: pgmap v16002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:36 smithi122 ceph-mon[125440]: pgmap v16002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:36 smithi136 ceph-mon[125702]: pgmap v16002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:38 smithi057 ceph-mon[92072]: pgmap v16003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:38 smithi122 ceph-mon[125440]: pgmap v16003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:38 smithi136 ceph-mon[125702]: pgmap v16003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:40 smithi057 ceph-mon[92072]: pgmap v16004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:40 smithi122 ceph-mon[125440]: pgmap v16004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:40 smithi136 ceph-mon[125702]: pgmap v16004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:41.964+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:17:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:41.965+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:17:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:41.965+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:17:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:41.965+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:17:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:41.965+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:17:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:42 smithi057 ceph-mon[92072]: pgmap v16005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:42 smithi122 ceph-mon[125440]: pgmap v16005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:42 smithi136 ceph-mon[125702]: pgmap v16005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:43 smithi057 ceph-mon[92072]: pgmap v16006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:43 smithi122 ceph-mon[125440]: pgmap v16006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:43 smithi136 ceph-mon[125702]: pgmap v16006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:46 smithi057 ceph-mon[92072]: pgmap v16007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:46 smithi122 ceph-mon[125440]: pgmap v16007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:46 smithi136 ceph-mon[125702]: pgmap v16007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:48 smithi057 ceph-mon[92072]: pgmap v16008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:48 smithi122 ceph-mon[125440]: pgmap v16008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:48 smithi136 ceph-mon[125702]: pgmap v16008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:50 smithi057 ceph-mon[92072]: pgmap v16009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:50 smithi122 ceph-mon[125440]: pgmap v16009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:50 smithi136 ceph-mon[125702]: pgmap v16009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:52 smithi057 ceph-mon[92072]: pgmap v16010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:52 smithi122 ceph-mon[125440]: pgmap v16010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:52 smithi136 ceph-mon[125702]: pgmap v16010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:53 smithi057 ceph-mon[92072]: pgmap v16011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:53 smithi122 ceph-mon[125440]: pgmap v16011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:53 smithi136 ceph-mon[125702]: pgmap v16011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:56 smithi057 ceph-mon[92072]: pgmap v16012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:56 smithi122 ceph-mon[125440]: pgmap v16012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:56 smithi136 ceph-mon[125702]: pgmap v16012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:17:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:56.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:17:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:56.979+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:17:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:56.979+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:17:56.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:56.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:17:56.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:17:56.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:17:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:17:58 smithi057 ceph-mon[92072]: pgmap v16013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:17:58 smithi122 ceph-mon[125440]: pgmap v16013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:17:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:17:58 smithi136 ceph-mon[125702]: pgmap v16013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:00 smithi057 ceph-mon[92072]: pgmap v16014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:00 smithi122 ceph-mon[125440]: pgmap v16014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:00 smithi136 ceph-mon[125702]: pgmap v16014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:02 smithi057 ceph-mon[92072]: pgmap v16015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:02 smithi122 ceph-mon[125440]: pgmap v16015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:02 smithi136 ceph-mon[125702]: pgmap v16015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:03 smithi057 ceph-mon[92072]: pgmap v16016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:18:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:03 smithi122 ceph-mon[125440]: pgmap v16016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:18:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:03 smithi136 ceph-mon[125702]: pgmap v16016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:18:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:06 smithi057 ceph-mon[92072]: pgmap v16017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:18:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:06 smithi122 ceph-mon[125440]: pgmap v16017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:18:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:06 smithi136 ceph-mon[125702]: pgmap v16017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:18:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:07 smithi057 ceph-mon[92072]: osdmap e1074: 12 total, 12 up, 12 in 2023-03-02T19:18:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:07 smithi122 ceph-mon[125440]: osdmap e1074: 12 total, 12 up, 12 in 2023-03-02T19:18:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:07 smithi136 ceph-mon[125702]: osdmap e1074: 12 total, 12 up, 12 in 2023-03-02T19:18:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:08 smithi057 ceph-mon[92072]: pgmap v16019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:18:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:08 smithi122 ceph-mon[125440]: pgmap v16019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:18:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:08 smithi136 ceph-mon[125702]: pgmap v16019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:18:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:10 smithi057 ceph-mon[92072]: pgmap v16020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:18:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:18:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:10 smithi122 ceph-mon[125440]: pgmap v16020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:18:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:18:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:10 smithi136 ceph-mon[125702]: pgmap v16020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:18:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:18:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:18:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:18:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:18:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:18:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:18:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:18:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:18:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:18:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:18:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:11.995+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:18:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:11.995+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:18:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:11.995+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:18:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:11.995+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:18:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:11.995+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:18:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:12 smithi057 ceph-mon[92072]: pgmap v16021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:18:12.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:12 smithi122 ceph-mon[125440]: pgmap v16021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:18:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:12 smithi136 ceph-mon[125702]: pgmap v16021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:18:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:13 smithi057 ceph-mon[92072]: pgmap v16022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:18:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:13 smithi122 ceph-mon[125440]: pgmap v16022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:18:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:13 smithi136 ceph-mon[125702]: pgmap v16022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:18:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:16 smithi057 ceph-mon[92072]: pgmap v16023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:18:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:16 smithi122 ceph-mon[125440]: pgmap v16023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:18:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:16 smithi136 ceph-mon[125702]: pgmap v16023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:18:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:18 smithi057 ceph-mon[92072]: pgmap v16024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:18:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:18 smithi057 ceph-mon[92072]: osdmap e1075: 12 total, 12 up, 12 in 2023-03-02T19:18:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:18 smithi122 ceph-mon[125440]: pgmap v16024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:18:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:18 smithi122 ceph-mon[125440]: osdmap e1075: 12 total, 12 up, 12 in 2023-03-02T19:18:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:18 smithi136 ceph-mon[125702]: pgmap v16024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:18:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:18 smithi136 ceph-mon[125702]: osdmap e1075: 12 total, 12 up, 12 in 2023-03-02T19:18:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:20 smithi057 ceph-mon[92072]: pgmap v16026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:18:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:20 smithi122 ceph-mon[125440]: pgmap v16026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:18:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:20 smithi136 ceph-mon[125702]: pgmap v16026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:18:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:22 smithi057 ceph-mon[92072]: pgmap v16027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:18:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:22 smithi122 ceph-mon[125440]: pgmap v16027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:18:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:22 smithi136 ceph-mon[125702]: pgmap v16027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:18:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:23 smithi057 ceph-mon[92072]: pgmap v16028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:18:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:23 smithi122 ceph-mon[125440]: pgmap v16028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:18:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:23 smithi136 ceph-mon[125702]: pgmap v16028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:18:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:26 smithi057 ceph-mon[92072]: pgmap v16029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:18:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:26 smithi122 ceph-mon[125440]: pgmap v16029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:18:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:26 smithi136 ceph-mon[125702]: pgmap v16029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:18:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:27.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:18:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:27.002+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:18:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:27.002+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:18:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:27.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:18:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:27.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:18:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:28 smithi057 ceph-mon[92072]: pgmap v16030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:18:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:28 smithi122 ceph-mon[125440]: pgmap v16030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:18:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:28 smithi136 ceph-mon[125702]: pgmap v16030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:18:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:30 smithi057 ceph-mon[92072]: pgmap v16031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:18:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:30 smithi122 ceph-mon[125440]: pgmap v16031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:18:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:30 smithi136 ceph-mon[125702]: pgmap v16031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:18:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:32 smithi057 ceph-mon[92072]: pgmap v16032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:32 smithi122 ceph-mon[125440]: pgmap v16032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:32 smithi136 ceph-mon[125702]: pgmap v16032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:33 smithi057 ceph-mon[92072]: pgmap v16033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:33 smithi122 ceph-mon[125440]: pgmap v16033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:33 smithi136 ceph-mon[125702]: pgmap v16033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:36 smithi057 ceph-mon[92072]: pgmap v16034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:36 smithi122 ceph-mon[125440]: pgmap v16034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:36 smithi136 ceph-mon[125702]: pgmap v16034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:38.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:38 smithi057 ceph-mon[92072]: pgmap v16035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:38 smithi122 ceph-mon[125440]: pgmap v16035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:38 smithi136 ceph-mon[125702]: pgmap v16035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:40 smithi057 ceph-mon[92072]: pgmap v16036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:40 smithi122 ceph-mon[125440]: pgmap v16036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:40.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:40 smithi136 ceph-mon[125702]: pgmap v16036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:42.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:18:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:42.018+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:18:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:42.018+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:18:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:42.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:18:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:42.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:18:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:42 smithi057 ceph-mon[92072]: pgmap v16037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:42 smithi122 ceph-mon[125440]: pgmap v16037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:42 smithi136 ceph-mon[125702]: pgmap v16037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:43 smithi057 ceph-mon[92072]: pgmap v16038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:43 smithi122 ceph-mon[125440]: pgmap v16038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:43 smithi136 ceph-mon[125702]: pgmap v16038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:46 smithi057 ceph-mon[92072]: pgmap v16039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:46 smithi122 ceph-mon[125440]: pgmap v16039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:46 smithi136 ceph-mon[125702]: pgmap v16039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:48 smithi057 ceph-mon[92072]: pgmap v16040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:48 smithi122 ceph-mon[125440]: pgmap v16040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:48 smithi136 ceph-mon[125702]: pgmap v16040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:50 smithi057 ceph-mon[92072]: pgmap v16041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:50 smithi122 ceph-mon[125440]: pgmap v16041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:50 smithi136 ceph-mon[125702]: pgmap v16041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:52 smithi057 ceph-mon[92072]: pgmap v16042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:52 smithi122 ceph-mon[125440]: pgmap v16042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:52 smithi136 ceph-mon[125702]: pgmap v16042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:53 smithi057 ceph-mon[92072]: pgmap v16043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:53 smithi122 ceph-mon[125440]: pgmap v16043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:53 smithi136 ceph-mon[125702]: pgmap v16043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:56 smithi057 ceph-mon[92072]: pgmap v16044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:56 smithi122 ceph-mon[125440]: pgmap v16044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:56 smithi136 ceph-mon[125702]: pgmap v16044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:18:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:57.024+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:18:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:57.025+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:18:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:57.025+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:18:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:57.025+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:18:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:18:57.025+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:18:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:18:58 smithi057 ceph-mon[92072]: pgmap v16045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:18:58 smithi122 ceph-mon[125440]: pgmap v16045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:18:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:18:58 smithi136 ceph-mon[125702]: pgmap v16045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:00 smithi057 ceph-mon[92072]: pgmap v16046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:00 smithi122 ceph-mon[125440]: pgmap v16046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:00 smithi136 ceph-mon[125702]: pgmap v16046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:02 smithi057 ceph-mon[92072]: pgmap v16047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:02 smithi122 ceph-mon[125440]: pgmap v16047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:02 smithi136 ceph-mon[125702]: pgmap v16047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:03 smithi057 ceph-mon[92072]: pgmap v16048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:19:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:03 smithi122 ceph-mon[125440]: pgmap v16048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:19:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:03 smithi136 ceph-mon[125702]: pgmap v16048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:19:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:06 smithi057 ceph-mon[92072]: pgmap v16049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:19:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:06 smithi122 ceph-mon[125440]: pgmap v16049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:19:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:06 smithi136 ceph-mon[125702]: pgmap v16049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:19:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:07 smithi057 ceph-mon[92072]: osdmap e1076: 12 total, 12 up, 12 in 2023-03-02T19:19:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:07 smithi122 ceph-mon[125440]: osdmap e1076: 12 total, 12 up, 12 in 2023-03-02T19:19:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:07 smithi136 ceph-mon[125702]: osdmap e1076: 12 total, 12 up, 12 in 2023-03-02T19:19:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:08 smithi057 ceph-mon[92072]: pgmap v16051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:19:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:08 smithi122 ceph-mon[125440]: pgmap v16051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:19:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:08 smithi136 ceph-mon[125702]: pgmap v16051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:19:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:10 smithi057 ceph-mon[92072]: pgmap v16052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:19:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:10 smithi122 ceph-mon[125440]: pgmap v16052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:19:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:10 smithi136 ceph-mon[125702]: pgmap v16052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:19:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:19:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:19:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:19:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:19:11.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:19:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:19:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:19:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:19:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:19:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:19:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:19:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:19:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:12.040+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:19:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:12.041+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:19:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:12.041+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:19:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:12.041+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:19:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:12.041+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:19:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:12 smithi057 ceph-mon[92072]: pgmap v16053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:19:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:12 smithi122 ceph-mon[125440]: pgmap v16053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:19:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:12 smithi136 ceph-mon[125702]: pgmap v16053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:19:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:13 smithi057 ceph-mon[92072]: pgmap v16054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:19:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:13 smithi122 ceph-mon[125440]: pgmap v16054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:19:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:13 smithi136 ceph-mon[125702]: pgmap v16054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:19:16.682 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:16 smithi057 ceph-mon[92072]: pgmap v16055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:19:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:16 smithi122 ceph-mon[125440]: pgmap v16055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:19:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:16 smithi136 ceph-mon[125702]: pgmap v16055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:19:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:18 smithi057 ceph-mon[92072]: pgmap v16056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:19:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:18 smithi057 ceph-mon[92072]: osdmap e1077: 12 total, 12 up, 12 in 2023-03-02T19:19:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:18 smithi122 ceph-mon[125440]: pgmap v16056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:19:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:18 smithi122 ceph-mon[125440]: osdmap e1077: 12 total, 12 up, 12 in 2023-03-02T19:19:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:18 smithi136 ceph-mon[125702]: pgmap v16056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:19:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:18 smithi136 ceph-mon[125702]: osdmap e1077: 12 total, 12 up, 12 in 2023-03-02T19:19:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:20 smithi057 ceph-mon[92072]: pgmap v16058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:19:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:20 smithi122 ceph-mon[125440]: pgmap v16058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:19:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:20 smithi136 ceph-mon[125702]: pgmap v16058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:19:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:22 smithi057 ceph-mon[92072]: pgmap v16059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:19:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:22 smithi122 ceph-mon[125440]: pgmap v16059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:19:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:22 smithi136 ceph-mon[125702]: pgmap v16059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:19:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:23 smithi057 ceph-mon[92072]: pgmap v16060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:19:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:23 smithi122 ceph-mon[125440]: pgmap v16060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:19:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:23 smithi136 ceph-mon[125702]: pgmap v16060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:19:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:26 smithi057 ceph-mon[92072]: pgmap v16061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:19:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:26 smithi122 ceph-mon[125440]: pgmap v16061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:19:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:26 smithi136 ceph-mon[125702]: pgmap v16061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:19:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:27.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:19:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:27.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:19:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:27.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:19:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:27.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:19:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:27.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:19:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:28 smithi057 ceph-mon[92072]: pgmap v16062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:19:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:28 smithi122 ceph-mon[125440]: pgmap v16062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:19:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:28 smithi136 ceph-mon[125702]: pgmap v16062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:19:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:30 smithi057 ceph-mon[92072]: pgmap v16063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:19:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:30 smithi122 ceph-mon[125440]: pgmap v16063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:19:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:30 smithi136 ceph-mon[125702]: pgmap v16063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:19:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:32 smithi057 ceph-mon[92072]: pgmap v16064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:32 smithi122 ceph-mon[125440]: pgmap v16064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:32 smithi136 ceph-mon[125702]: pgmap v16064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:33 smithi122 ceph-mon[125440]: pgmap v16065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:33 smithi136 ceph-mon[125702]: pgmap v16065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:33 smithi057 ceph-mon[92072]: pgmap v16065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:36 smithi057 ceph-mon[92072]: pgmap v16066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:36 smithi122 ceph-mon[125440]: pgmap v16066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:36 smithi136 ceph-mon[125702]: pgmap v16066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:38 smithi057 ceph-mon[92072]: pgmap v16067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:38 smithi122 ceph-mon[125440]: pgmap v16067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:38 smithi136 ceph-mon[125702]: pgmap v16067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:40 smithi057 ceph-mon[92072]: pgmap v16068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:40 smithi122 ceph-mon[125440]: pgmap v16068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:40 smithi136 ceph-mon[125702]: pgmap v16068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:42.069 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:42.067+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:19:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:42.067+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:19:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:42.067+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:19:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:42.067+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:19:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:42.067+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:19:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:42 smithi057 ceph-mon[92072]: pgmap v16069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:42.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:42 smithi122 ceph-mon[125440]: pgmap v16069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:42 smithi136 ceph-mon[125702]: pgmap v16069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:43 smithi057 ceph-mon[92072]: pgmap v16070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:43 smithi122 ceph-mon[125440]: pgmap v16070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:43 smithi136 ceph-mon[125702]: pgmap v16070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:46 smithi057 ceph-mon[92072]: pgmap v16071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:46 smithi122 ceph-mon[125440]: pgmap v16071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:46 smithi136 ceph-mon[125702]: pgmap v16071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:48 smithi057 ceph-mon[92072]: pgmap v16072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:48.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:48 smithi122 ceph-mon[125440]: pgmap v16072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:48 smithi136 ceph-mon[125702]: pgmap v16072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:50 smithi057 ceph-mon[92072]: pgmap v16073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:50 smithi122 ceph-mon[125440]: pgmap v16073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:50 smithi136 ceph-mon[125702]: pgmap v16073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:52 smithi057 ceph-mon[92072]: pgmap v16074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:52 smithi122 ceph-mon[125440]: pgmap v16074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:52 smithi136 ceph-mon[125702]: pgmap v16074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:53.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:53 smithi122 ceph-mon[125440]: pgmap v16075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:53 smithi136 ceph-mon[125702]: pgmap v16075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:53 smithi057 ceph-mon[92072]: pgmap v16075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:56 smithi057 ceph-mon[92072]: pgmap v16076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:56 smithi122 ceph-mon[125440]: pgmap v16076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:56 smithi136 ceph-mon[125702]: pgmap v16076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:19:57.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:57.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:19:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:57.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:19:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:57.084+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:19:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:57.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:19:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:19:57.084+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:19:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:19:58 smithi057 ceph-mon[92072]: pgmap v16077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:19:58 smithi122 ceph-mon[125440]: pgmap v16077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:19:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:19:58 smithi136 ceph-mon[125702]: pgmap v16077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:00 smithi057 ceph-mon[92072]: pgmap v16078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T19:20:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:00 smithi122 ceph-mon[125440]: pgmap v16078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T19:20:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:00 smithi136 ceph-mon[125702]: pgmap v16078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T19:20:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:02 smithi057 ceph-mon[92072]: pgmap v16079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:02 smithi122 ceph-mon[125440]: pgmap v16079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:02 smithi136 ceph-mon[125702]: pgmap v16079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:03 smithi122 ceph-mon[125440]: pgmap v16080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:20:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:03 smithi136 ceph-mon[125702]: pgmap v16080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:20:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:03 smithi057 ceph-mon[92072]: pgmap v16080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:20:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:06 smithi057 ceph-mon[92072]: pgmap v16081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:20:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:06 smithi122 ceph-mon[125440]: pgmap v16081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:20:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:06 smithi136 ceph-mon[125702]: pgmap v16081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:20:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:08 smithi057 ceph-mon[92072]: pgmap v16082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:20:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:08 smithi122 ceph-mon[125440]: pgmap v16082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:20:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:08 smithi136 ceph-mon[125702]: pgmap v16082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:20:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:10 smithi057 ceph-mon[92072]: pgmap v16083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:20:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:10 smithi122 ceph-mon[125440]: pgmap v16083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:20:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:10 smithi136 ceph-mon[125702]: pgmap v16083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:20:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:12.099+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:20:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:12.099+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:20:12.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:12.099+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:20:12.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:12.099+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:20:12.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:12.099+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:20:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:12 smithi057 ceph-mon[92072]: pgmap v16084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:20:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:12 smithi057 ceph-mon[92072]: osdmap e1078: 12 total, 12 up, 12 in 2023-03-02T19:20:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:20:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:20:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:20:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:20:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:12 smithi122 ceph-mon[125440]: pgmap v16084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:20:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:12 smithi122 ceph-mon[125440]: osdmap e1078: 12 total, 12 up, 12 in 2023-03-02T19:20:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:20:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:20:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:20:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:20:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:12.716+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:20:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:12.716+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:20:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:12.716+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 232 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:20:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:12.716+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 233 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:20:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:12 smithi136 ceph-mon[125702]: pgmap v16084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:20:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:12 smithi136 ceph-mon[125702]: osdmap e1078: 12 total, 12 up, 12 in 2023-03-02T19:20:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:20:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:20:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:20:12.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:20:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:13 smithi122 ceph-mon[125440]: pgmap v16086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:13 smithi136 ceph-mon[125702]: pgmap v16086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:13 smithi057 ceph-mon[92072]: pgmap v16086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:16 smithi057 ceph-mon[92072]: pgmap v16087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:16 smithi122 ceph-mon[125440]: pgmap v16087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:16 smithi136 ceph-mon[125702]: pgmap v16087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:18 smithi057 ceph-mon[92072]: pgmap v16088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:20:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:18 smithi057 ceph-mon[92072]: osdmap e1079: 12 total, 12 up, 12 in 2023-03-02T19:20:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:18 smithi122 ceph-mon[125440]: pgmap v16088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:20:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:18 smithi122 ceph-mon[125440]: osdmap e1079: 12 total, 12 up, 12 in 2023-03-02T19:20:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:18 smithi136 ceph-mon[125702]: pgmap v16088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:20:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:18 smithi136 ceph-mon[125702]: osdmap e1079: 12 total, 12 up, 12 in 2023-03-02T19:20:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:20 smithi057 ceph-mon[92072]: pgmap v16090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T19:20:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:20 smithi122 ceph-mon[125440]: pgmap v16090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T19:20:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:20 smithi136 ceph-mon[125702]: pgmap v16090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T19:20:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:22 smithi057 ceph-mon[92072]: pgmap v16091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:20:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:22 smithi122 ceph-mon[125440]: pgmap v16091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:20:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:22 smithi136 ceph-mon[125702]: pgmap v16091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:20:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:23 smithi136 ceph-mon[125702]: pgmap v16092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:23 smithi057 ceph-mon[92072]: pgmap v16092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:23 smithi122 ceph-mon[125440]: pgmap v16092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:26 smithi057 ceph-mon[92072]: pgmap v16093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:26 smithi122 ceph-mon[125440]: pgmap v16093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:26 smithi136 ceph-mon[125702]: pgmap v16093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:20:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:27.113+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:20:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:27.114+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:20:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:27.114+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:20:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:27.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:20:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:27.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:20:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:28 smithi057 ceph-mon[92072]: pgmap v16094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:20:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:28 smithi122 ceph-mon[125440]: pgmap v16094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:20:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:28 smithi136 ceph-mon[125702]: pgmap v16094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:20:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:30 smithi057 ceph-mon[92072]: pgmap v16095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:20:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:30 smithi122 ceph-mon[125440]: pgmap v16095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:20:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:30 smithi136 ceph-mon[125702]: pgmap v16095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:20:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:32 smithi057 ceph-mon[92072]: pgmap v16096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:32 smithi122 ceph-mon[125440]: pgmap v16096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:32 smithi136 ceph-mon[125702]: pgmap v16096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:33 smithi122 ceph-mon[125440]: pgmap v16097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:33 smithi136 ceph-mon[125702]: pgmap v16097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:33 smithi057 ceph-mon[92072]: pgmap v16097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:36 smithi057 ceph-mon[92072]: pgmap v16098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:36 smithi122 ceph-mon[125440]: pgmap v16098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:36 smithi136 ceph-mon[125702]: pgmap v16098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:38 smithi057 ceph-mon[92072]: pgmap v16099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:38 smithi122 ceph-mon[125440]: pgmap v16099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:38 smithi136 ceph-mon[125702]: pgmap v16099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:40 smithi057 ceph-mon[92072]: pgmap v16100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:40 smithi122 ceph-mon[125440]: pgmap v16100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:40 smithi136 ceph-mon[125702]: pgmap v16100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:42.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:20:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:42.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:20:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:42.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:20:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:42.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:20:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:42.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:20:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:42 smithi057 ceph-mon[92072]: pgmap v16101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:42 smithi122 ceph-mon[125440]: pgmap v16101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:42 smithi136 ceph-mon[125702]: pgmap v16101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:43.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:43 smithi122 ceph-mon[125440]: pgmap v16102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:43 smithi136 ceph-mon[125702]: pgmap v16102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:43 smithi057 ceph-mon[92072]: pgmap v16102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:46 smithi057 ceph-mon[92072]: pgmap v16103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:46 smithi122 ceph-mon[125440]: pgmap v16103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:46 smithi136 ceph-mon[125702]: pgmap v16103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:48 smithi057 ceph-mon[92072]: pgmap v16104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:48 smithi122 ceph-mon[125440]: pgmap v16104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:48 smithi136 ceph-mon[125702]: pgmap v16104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:50 smithi057 ceph-mon[92072]: pgmap v16105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:50 smithi122 ceph-mon[125440]: pgmap v16105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:50 smithi136 ceph-mon[125702]: pgmap v16105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:52 smithi057 ceph-mon[92072]: pgmap v16106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:52 smithi122 ceph-mon[125440]: pgmap v16106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:52 smithi136 ceph-mon[125702]: pgmap v16106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:53 smithi136 ceph-mon[125702]: pgmap v16107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:53 smithi057 ceph-mon[92072]: pgmap v16107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:54.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:53 smithi122 ceph-mon[125440]: pgmap v16107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:56 smithi057 ceph-mon[92072]: pgmap v16108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:56 smithi122 ceph-mon[125440]: pgmap v16108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:56 smithi136 ceph-mon[125702]: pgmap v16108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:20:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:57.145+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:20:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:57.146+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:20:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:57.146+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:20:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:57.146+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:20:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:20:57.146+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:20:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:20:58 smithi057 ceph-mon[92072]: pgmap v16109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:20:58 smithi122 ceph-mon[125440]: pgmap v16109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:20:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:20:58 smithi136 ceph-mon[125702]: pgmap v16109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:00 smithi057 ceph-mon[92072]: pgmap v16110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:00 smithi122 ceph-mon[125440]: pgmap v16110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:00 smithi136 ceph-mon[125702]: pgmap v16110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:02 smithi057 ceph-mon[92072]: pgmap v16111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:02 smithi122 ceph-mon[125440]: pgmap v16111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:02 smithi136 ceph-mon[125702]: pgmap v16111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:03 smithi136 ceph-mon[125702]: pgmap v16112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:21:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:03 smithi057 ceph-mon[92072]: pgmap v16112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:21:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:03 smithi122 ceph-mon[125440]: pgmap v16112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:21:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:06 smithi057 ceph-mon[92072]: pgmap v16113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:21:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:06 smithi122 ceph-mon[125440]: pgmap v16113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:21:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:06 smithi136 ceph-mon[125702]: pgmap v16113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:21:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:07 smithi122 ceph-mon[125440]: osdmap e1080: 12 total, 12 up, 12 in 2023-03-02T19:21:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:07 smithi136 ceph-mon[125702]: osdmap e1080: 12 total, 12 up, 12 in 2023-03-02T19:21:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:07 smithi057 ceph-mon[92072]: osdmap e1080: 12 total, 12 up, 12 in 2023-03-02T19:21:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:08 smithi122 ceph-mon[125440]: pgmap v16115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:21:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:08 smithi136 ceph-mon[125702]: pgmap v16115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:21:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:08 smithi057 ceph-mon[92072]: pgmap v16115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:21:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:10 smithi122 ceph-mon[125440]: pgmap v16116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:21:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:10 smithi136 ceph-mon[125702]: pgmap v16116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:21:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:10 smithi057 ceph-mon[92072]: pgmap v16116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:21:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:12.161+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:21:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:12.162+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:21:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:12.162+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:21:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:12.162+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:21:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:12.162+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:21:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:12 smithi136 ceph-mon[125702]: pgmap v16117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:21:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:21:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:12 smithi057 ceph-mon[92072]: pgmap v16117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:21:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:21:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:12 smithi122 ceph-mon[125440]: pgmap v16117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:21:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:21:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:13 smithi136 ceph-mon[125702]: pgmap v16118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:21:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:13 smithi057 ceph-mon[92072]: pgmap v16118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:21:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:13 smithi122 ceph-mon[125440]: pgmap v16118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:21:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: pgmap v16119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:21:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: pgmap v16119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:21:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: pgmap v16119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:21:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:16.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:21:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:21:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:21:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:21:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:21:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:21:17.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:21:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:21:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:21:17.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:21:17.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:21:17.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:21:17.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:21:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:21:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:21:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:21:17.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:21:17.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:21:17.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:21:17.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:21:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:18 smithi136 ceph-mon[125702]: pgmap v16120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:21:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:18 smithi136 ceph-mon[125702]: osdmap e1081: 12 total, 12 up, 12 in 2023-03-02T19:21:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:18 smithi057 ceph-mon[92072]: pgmap v16120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:21:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:18 smithi057 ceph-mon[92072]: osdmap e1081: 12 total, 12 up, 12 in 2023-03-02T19:21:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:18 smithi122 ceph-mon[125440]: pgmap v16120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:21:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:18 smithi122 ceph-mon[125440]: osdmap e1081: 12 total, 12 up, 12 in 2023-03-02T19:21:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:20 smithi057 ceph-mon[92072]: pgmap v16122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:21:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:20 smithi122 ceph-mon[125440]: pgmap v16122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:21:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:20 smithi136 ceph-mon[125702]: pgmap v16122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:21:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:22 smithi057 ceph-mon[92072]: pgmap v16123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:21:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:22 smithi122 ceph-mon[125440]: pgmap v16123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:21:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:22 smithi136 ceph-mon[125702]: pgmap v16123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:21:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:23 smithi136 ceph-mon[125702]: pgmap v16124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:21:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:23 smithi057 ceph-mon[92072]: pgmap v16124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:21:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:23 smithi122 ceph-mon[125440]: pgmap v16124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:21:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:26 smithi057 ceph-mon[92072]: pgmap v16125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:21:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:26 smithi122 ceph-mon[125440]: pgmap v16125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:21:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:26 smithi136 ceph-mon[125702]: pgmap v16125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:21:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:27.173+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:21:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:27.174+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:21:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:27.174+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:21:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:27.174+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:21:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:27.174+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:21:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:28 smithi057 ceph-mon[92072]: pgmap v16126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:21:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:28 smithi122 ceph-mon[125440]: pgmap v16126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:21:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:28 smithi136 ceph-mon[125702]: pgmap v16126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:21:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:30 smithi122 ceph-mon[125440]: pgmap v16127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:30 smithi136 ceph-mon[125702]: pgmap v16127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:30 smithi057 ceph-mon[92072]: pgmap v16127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:32 smithi122 ceph-mon[125440]: pgmap v16128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:21:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:32 smithi136 ceph-mon[125702]: pgmap v16128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:21:32.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:32 smithi057 ceph-mon[92072]: pgmap v16128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:21:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:33 smithi136 ceph-mon[125702]: pgmap v16129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:33 smithi057 ceph-mon[92072]: pgmap v16129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:33 smithi122 ceph-mon[125440]: pgmap v16129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:36 smithi057 ceph-mon[92072]: pgmap v16130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:21:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:36 smithi122 ceph-mon[125440]: pgmap v16130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:21:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:36 smithi136 ceph-mon[125702]: pgmap v16130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:21:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:38 smithi057 ceph-mon[92072]: pgmap v16131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:38 smithi122 ceph-mon[125440]: pgmap v16131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:38 smithi136 ceph-mon[125702]: pgmap v16131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:40 smithi122 ceph-mon[125440]: pgmap v16132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:40 smithi136 ceph-mon[125702]: pgmap v16132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:40 smithi057 ceph-mon[92072]: pgmap v16132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:42.187+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:21:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:42.187+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:21:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:42.187+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:21:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:42.187+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:21:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:42.187+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:21:42.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:42 smithi122 ceph-mon[125440]: pgmap v16133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:42 smithi136 ceph-mon[125702]: pgmap v16133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:42 smithi057 ceph-mon[92072]: pgmap v16133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:43 smithi136 ceph-mon[125702]: pgmap v16134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:43 smithi057 ceph-mon[92072]: pgmap v16134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:43 smithi122 ceph-mon[125440]: pgmap v16134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:46 smithi057 ceph-mon[92072]: pgmap v16135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:46 smithi122 ceph-mon[125440]: pgmap v16135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:46 smithi136 ceph-mon[125702]: pgmap v16135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:48 smithi122 ceph-mon[125440]: pgmap v16136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:48 smithi136 ceph-mon[125702]: pgmap v16136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:48 smithi057 ceph-mon[92072]: pgmap v16136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:50 smithi122 ceph-mon[125440]: pgmap v16137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:50 smithi136 ceph-mon[125702]: pgmap v16137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:50 smithi057 ceph-mon[92072]: pgmap v16137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:52 smithi136 ceph-mon[125702]: pgmap v16138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:52 smithi057 ceph-mon[92072]: pgmap v16138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:52 smithi122 ceph-mon[125440]: pgmap v16138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:53 smithi136 ceph-mon[125702]: pgmap v16139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:53 smithi057 ceph-mon[92072]: pgmap v16139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:53 smithi122 ceph-mon[125440]: pgmap v16139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:56 smithi057 ceph-mon[92072]: pgmap v16140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:56 smithi122 ceph-mon[125440]: pgmap v16140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:56 smithi136 ceph-mon[125702]: pgmap v16140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:21:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:57.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:21:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:57.188+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:21:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:57.188+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:21:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:57.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:21:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:21:57.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:21:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:21:58 smithi122 ceph-mon[125440]: pgmap v16141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:21:58 smithi136 ceph-mon[125702]: pgmap v16141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:21:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:21:58 smithi057 ceph-mon[92072]: pgmap v16141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:00 smithi122 ceph-mon[125440]: pgmap v16142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:00 smithi136 ceph-mon[125702]: pgmap v16142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:00 smithi057 ceph-mon[92072]: pgmap v16142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:02 smithi122 ceph-mon[125440]: pgmap v16143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:02.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:02 smithi136 ceph-mon[125702]: pgmap v16143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:02 smithi057 ceph-mon[92072]: pgmap v16143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:03 smithi136 ceph-mon[125702]: pgmap v16144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:22:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:03 smithi057 ceph-mon[92072]: pgmap v16144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:22:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:03 smithi122 ceph-mon[125440]: pgmap v16144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:22:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:06 smithi122 ceph-mon[125440]: pgmap v16145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:22:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:06 smithi136 ceph-mon[125702]: pgmap v16145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:22:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:06 smithi057 ceph-mon[92072]: pgmap v16145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:22:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:07 smithi122 ceph-mon[125440]: osdmap e1082: 12 total, 12 up, 12 in 2023-03-02T19:22:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:07 smithi136 ceph-mon[125702]: osdmap e1082: 12 total, 12 up, 12 in 2023-03-02T19:22:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:07 smithi057 ceph-mon[92072]: osdmap e1082: 12 total, 12 up, 12 in 2023-03-02T19:22:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:08 smithi122 ceph-mon[125440]: pgmap v16147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T19:22:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:08 smithi136 ceph-mon[125702]: pgmap v16147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T19:22:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:08 smithi057 ceph-mon[92072]: pgmap v16147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T19:22:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:10 smithi136 ceph-mon[125702]: pgmap v16148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T19:22:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:10 smithi057 ceph-mon[92072]: pgmap v16148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T19:22:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:10 smithi122 ceph-mon[125440]: pgmap v16148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T19:22:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:12.203+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:22:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:12.204+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:22:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:12.204+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:22:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:12.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:22:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:12.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:22:12.462 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:12 smithi057 ceph-mon[92072]: pgmap v16149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T19:22:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:12 smithi136 ceph-mon[125702]: pgmap v16149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T19:22:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:12 smithi122 ceph-mon[125440]: pgmap v16149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T19:22:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:13 smithi136 ceph-mon[125702]: pgmap v16150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:22:14.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:13 smithi057 ceph-mon[92072]: pgmap v16150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:22:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:13 smithi122 ceph-mon[125440]: pgmap v16150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:22:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:16 smithi122 ceph-mon[125440]: pgmap v16151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:22:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:16 smithi136 ceph-mon[125702]: pgmap v16151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:22:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:16 smithi057 ceph-mon[92072]: pgmap v16151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:22:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:22:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:22:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:22:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:22:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:22:17.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:22:17.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:22:17.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:22:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:22:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:22:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:22:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:22:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:18 smithi122 ceph-mon[125440]: pgmap v16152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:22:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:18 smithi122 ceph-mon[125440]: osdmap e1083: 12 total, 12 up, 12 in 2023-03-02T19:22:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:18 smithi136 ceph-mon[125702]: pgmap v16152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:22:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:18 smithi136 ceph-mon[125702]: osdmap e1083: 12 total, 12 up, 12 in 2023-03-02T19:22:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:18 smithi057 ceph-mon[92072]: pgmap v16152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:22:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:18 smithi057 ceph-mon[92072]: osdmap e1083: 12 total, 12 up, 12 in 2023-03-02T19:22:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:20 smithi122 ceph-mon[125440]: pgmap v16154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:22:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:20 smithi136 ceph-mon[125702]: pgmap v16154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:22:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:20 smithi057 ceph-mon[92072]: pgmap v16154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:22:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:22 smithi136 ceph-mon[125702]: pgmap v16155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:22:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:22 smithi057 ceph-mon[92072]: pgmap v16155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:22:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:22 smithi122 ceph-mon[125440]: pgmap v16155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:22:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:23 smithi136 ceph-mon[125702]: pgmap v16156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:22:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:23 smithi057 ceph-mon[92072]: pgmap v16156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:22:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:23 smithi122 ceph-mon[125440]: pgmap v16156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:22:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:26 smithi122 ceph-mon[125440]: pgmap v16157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:22:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:26 smithi136 ceph-mon[125702]: pgmap v16157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:22:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:26 smithi057 ceph-mon[92072]: pgmap v16157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:22:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:27.219+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:22:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:27.220+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:22:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:27.220+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:22:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:27.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:22:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:27.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:22:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:27.735+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:22:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:27.735+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:22:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:27.736+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 233 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:22:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:27.736+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 234 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:22:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:28 smithi122 ceph-mon[125440]: pgmap v16158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:22:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:28 smithi136 ceph-mon[125702]: pgmap v16158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:22:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:28 smithi057 ceph-mon[92072]: pgmap v16158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:22:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:30 smithi136 ceph-mon[125702]: pgmap v16159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:22:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:30 smithi057 ceph-mon[92072]: pgmap v16159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:22:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:30 smithi122 ceph-mon[125440]: pgmap v16159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:22:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:32 smithi136 ceph-mon[125702]: pgmap v16160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:32 smithi057 ceph-mon[92072]: pgmap v16160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:32 smithi122 ceph-mon[125440]: pgmap v16160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:33 smithi136 ceph-mon[125702]: pgmap v16161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:33 smithi057 ceph-mon[92072]: pgmap v16161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:33 smithi122 ceph-mon[125440]: pgmap v16161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:36 smithi122 ceph-mon[125440]: pgmap v16162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:36 smithi136 ceph-mon[125702]: pgmap v16162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:36 smithi057 ceph-mon[92072]: pgmap v16162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:38 smithi122 ceph-mon[125440]: pgmap v16163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:38 smithi136 ceph-mon[125702]: pgmap v16163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:38 smithi057 ceph-mon[92072]: pgmap v16163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:40 smithi136 ceph-mon[125702]: pgmap v16164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:40 smithi057 ceph-mon[92072]: pgmap v16164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:40 smithi122 ceph-mon[125440]: pgmap v16164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:42.223 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:42.222+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:22:42.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:42.223+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:22:42.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:42.223+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:22:42.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:42.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:22:42.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:42.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:22:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:42 smithi136 ceph-mon[125702]: pgmap v16165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:42 smithi057 ceph-mon[92072]: pgmap v16165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:42 smithi122 ceph-mon[125440]: pgmap v16165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:43 smithi136 ceph-mon[125702]: pgmap v16166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:43 smithi057 ceph-mon[92072]: pgmap v16166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:43 smithi122 ceph-mon[125440]: pgmap v16166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:46 smithi122 ceph-mon[125440]: pgmap v16167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:46 smithi136 ceph-mon[125702]: pgmap v16167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:46 smithi057 ceph-mon[92072]: pgmap v16167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:48 smithi136 ceph-mon[125702]: pgmap v16168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:48 smithi057 ceph-mon[92072]: pgmap v16168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:48 smithi122 ceph-mon[125440]: pgmap v16168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:50 smithi136 ceph-mon[125702]: pgmap v16169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:50 smithi057 ceph-mon[92072]: pgmap v16169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:50 smithi122 ceph-mon[125440]: pgmap v16169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:52 smithi136 ceph-mon[125702]: pgmap v16170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:52 smithi057 ceph-mon[92072]: pgmap v16170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:52 smithi122 ceph-mon[125440]: pgmap v16170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:53 smithi136 ceph-mon[125702]: pgmap v16171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:53 smithi057 ceph-mon[92072]: pgmap v16171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:53 smithi122 ceph-mon[125440]: pgmap v16171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:56 smithi136 ceph-mon[125702]: pgmap v16172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:56 smithi057 ceph-mon[92072]: pgmap v16172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:56 smithi122 ceph-mon[125440]: pgmap v16172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:22:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:57.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:22:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:57.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:22:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:57.229+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:22:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:57.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:22:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:22:57.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:22:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:22:58 smithi136 ceph-mon[125702]: pgmap v16173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:22:58 smithi057 ceph-mon[92072]: pgmap v16173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:22:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:22:58 smithi122 ceph-mon[125440]: pgmap v16173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:00 smithi136 ceph-mon[125702]: pgmap v16174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:00 smithi057 ceph-mon[92072]: pgmap v16174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:00 smithi122 ceph-mon[125440]: pgmap v16174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:02 smithi136 ceph-mon[125702]: pgmap v16175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:02 smithi057 ceph-mon[92072]: pgmap v16175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:02 smithi122 ceph-mon[125440]: pgmap v16175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:03 smithi136 ceph-mon[125702]: pgmap v16176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:23:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:03 smithi057 ceph-mon[92072]: pgmap v16176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:23:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:03 smithi122 ceph-mon[125440]: pgmap v16176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:23:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:06 smithi136 ceph-mon[125702]: pgmap v16177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:23:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:06 smithi057 ceph-mon[92072]: pgmap v16177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:23:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:06 smithi122 ceph-mon[125440]: pgmap v16177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:23:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:07 smithi136 ceph-mon[125702]: osdmap e1084: 12 total, 12 up, 12 in 2023-03-02T19:23:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:07 smithi057 ceph-mon[92072]: osdmap e1084: 12 total, 12 up, 12 in 2023-03-02T19:23:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:07 smithi122 ceph-mon[125440]: osdmap e1084: 12 total, 12 up, 12 in 2023-03-02T19:23:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:08 smithi136 ceph-mon[125702]: pgmap v16179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:23:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:08 smithi057 ceph-mon[92072]: pgmap v16179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:23:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:08 smithi122 ceph-mon[125440]: pgmap v16179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:23:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:10 smithi136 ceph-mon[125702]: pgmap v16180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:23:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:10 smithi057 ceph-mon[92072]: pgmap v16180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:23:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:10 smithi122 ceph-mon[125440]: pgmap v16180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:23:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:12.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:23:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:12.235+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:23:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:12.235+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:23:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:12.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:23:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:12.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:23:12.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:12.742+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:23:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:12.742+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 234 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:23:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:12.742+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:23:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:12.743+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 235 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:23:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:12 smithi136 ceph-mon[125702]: pgmap v16181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:23:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:12 smithi057 ceph-mon[92072]: pgmap v16181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:23:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:12 smithi122 ceph-mon[125440]: pgmap v16181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:23:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:13 smithi136 ceph-mon[125702]: pgmap v16182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:23:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:13 smithi057 ceph-mon[92072]: pgmap v16182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:23:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:13 smithi122 ceph-mon[125440]: pgmap v16182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:23:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:16 smithi136 ceph-mon[125702]: pgmap v16183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:23:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:16 smithi057 ceph-mon[92072]: pgmap v16183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:23:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:16 smithi122 ceph-mon[125440]: pgmap v16183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:23:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:23:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:23:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:23:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:18 smithi136 ceph-mon[125702]: pgmap v16184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:23:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:18 smithi136 ceph-mon[125702]: osdmap e1085: 12 total, 12 up, 12 in 2023-03-02T19:23:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:23:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:23:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:18 smithi057 ceph-mon[92072]: pgmap v16184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:23:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:18 smithi057 ceph-mon[92072]: osdmap e1085: 12 total, 12 up, 12 in 2023-03-02T19:23:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:23:18.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:23:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:18 smithi122 ceph-mon[125440]: pgmap v16184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:23:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:18 smithi122 ceph-mon[125440]: osdmap e1085: 12 total, 12 up, 12 in 2023-03-02T19:23:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:23:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:23:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:23:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:23:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:23:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:23:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:23:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:23:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:23:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:23:19.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:23:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:20 smithi136 ceph-mon[125702]: pgmap v16186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:23:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:20 smithi057 ceph-mon[92072]: pgmap v16186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:23:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:20 smithi122 ceph-mon[125440]: pgmap v16186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:23:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:22 smithi136 ceph-mon[125702]: pgmap v16187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:23:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:22 smithi057 ceph-mon[92072]: pgmap v16187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:23:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:22 smithi122 ceph-mon[125440]: pgmap v16187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:23:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:23 smithi136 ceph-mon[125702]: pgmap v16188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:23:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:23 smithi057 ceph-mon[92072]: pgmap v16188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:23:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:23 smithi122 ceph-mon[125440]: pgmap v16188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:23:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:26 smithi136 ceph-mon[125702]: pgmap v16189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:23:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:26 smithi057 ceph-mon[92072]: pgmap v16189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:23:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:26 smithi122 ceph-mon[125440]: pgmap v16189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:23:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:27.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:23:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:27.244+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:23:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:27.244+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:23:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:27.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:23:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:27.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:23:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:28 smithi136 ceph-mon[125702]: pgmap v16190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:23:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:28 smithi057 ceph-mon[92072]: pgmap v16190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:23:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:28 smithi122 ceph-mon[125440]: pgmap v16190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:23:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:30 smithi136 ceph-mon[125702]: pgmap v16191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:23:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:30 smithi057 ceph-mon[92072]: pgmap v16191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:23:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:30 smithi122 ceph-mon[125440]: pgmap v16191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:23:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:32 smithi136 ceph-mon[125702]: pgmap v16192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:32 smithi057 ceph-mon[92072]: pgmap v16192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:32 smithi122 ceph-mon[125440]: pgmap v16192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:33 smithi136 ceph-mon[125702]: pgmap v16193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:33 smithi057 ceph-mon[92072]: pgmap v16193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:33 smithi122 ceph-mon[125440]: pgmap v16193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:36 smithi136 ceph-mon[125702]: pgmap v16194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:36 smithi057 ceph-mon[92072]: pgmap v16194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:36 smithi122 ceph-mon[125440]: pgmap v16194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:38 smithi136 ceph-mon[125702]: pgmap v16195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:38 smithi057 ceph-mon[92072]: pgmap v16195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:38 smithi122 ceph-mon[125440]: pgmap v16195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:40 smithi136 ceph-mon[125702]: pgmap v16196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:40 smithi057 ceph-mon[92072]: pgmap v16196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:40 smithi122 ceph-mon[125440]: pgmap v16196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:42.257+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:23:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:42.257+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:23:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:42.257+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:23:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:42.257+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:23:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:42.257+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:23:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:42 smithi136 ceph-mon[125702]: pgmap v16197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:42 smithi057 ceph-mon[92072]: pgmap v16197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:42 smithi122 ceph-mon[125440]: pgmap v16197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:43 smithi136 ceph-mon[125702]: pgmap v16198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:43 smithi057 ceph-mon[92072]: pgmap v16198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:43 smithi122 ceph-mon[125440]: pgmap v16198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:46 smithi136 ceph-mon[125702]: pgmap v16199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:46 smithi057 ceph-mon[92072]: pgmap v16199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:46 smithi122 ceph-mon[125440]: pgmap v16199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:48 smithi136 ceph-mon[125702]: pgmap v16200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:48 smithi057 ceph-mon[92072]: pgmap v16200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:48 smithi122 ceph-mon[125440]: pgmap v16200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:50 smithi136 ceph-mon[125702]: pgmap v16201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:50 smithi057 ceph-mon[92072]: pgmap v16201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:50 smithi122 ceph-mon[125440]: pgmap v16201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:52 smithi136 ceph-mon[125702]: pgmap v16202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:52 smithi057 ceph-mon[92072]: pgmap v16202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:52 smithi122 ceph-mon[125440]: pgmap v16202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:53 smithi136 ceph-mon[125702]: pgmap v16203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:53 smithi057 ceph-mon[92072]: pgmap v16203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:53 smithi122 ceph-mon[125440]: pgmap v16203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:56 smithi136 ceph-mon[125702]: pgmap v16204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:56 smithi057 ceph-mon[92072]: pgmap v16204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:56 smithi122 ceph-mon[125440]: pgmap v16204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:23:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:57.267+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:23:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:57.267+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:23:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:57.267+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:23:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:57.267+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:23:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:23:57.267+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:23:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:23:58 smithi136 ceph-mon[125702]: pgmap v16205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:23:58 smithi057 ceph-mon[92072]: pgmap v16205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:23:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:23:58 smithi122 ceph-mon[125440]: pgmap v16205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:00 smithi136 ceph-mon[125702]: pgmap v16206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:00 smithi057 ceph-mon[92072]: pgmap v16206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:00 smithi122 ceph-mon[125440]: pgmap v16206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:02 smithi136 ceph-mon[125702]: pgmap v16207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:02 smithi057 ceph-mon[92072]: pgmap v16207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:02 smithi122 ceph-mon[125440]: pgmap v16207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:03 smithi136 ceph-mon[125702]: pgmap v16208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:24:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:03 smithi057 ceph-mon[92072]: pgmap v16208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:24:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:03 smithi122 ceph-mon[125440]: pgmap v16208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:24:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:06 smithi136 ceph-mon[125702]: pgmap v16209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:24:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:06 smithi057 ceph-mon[92072]: pgmap v16209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:24:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:06 smithi122 ceph-mon[125440]: pgmap v16209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:24:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:07 smithi136 ceph-mon[125702]: osdmap e1086: 12 total, 12 up, 12 in 2023-03-02T19:24:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:07 smithi057 ceph-mon[92072]: osdmap e1086: 12 total, 12 up, 12 in 2023-03-02T19:24:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:07 smithi122 ceph-mon[125440]: osdmap e1086: 12 total, 12 up, 12 in 2023-03-02T19:24:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:08 smithi136 ceph-mon[125702]: pgmap v16211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:24:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:08 smithi057 ceph-mon[92072]: pgmap v16211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:24:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:08 smithi122 ceph-mon[125440]: pgmap v16211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:24:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:10 smithi136 ceph-mon[125702]: pgmap v16212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:24:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:10 smithi057 ceph-mon[92072]: pgmap v16212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:24:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:10 smithi122 ceph-mon[125440]: pgmap v16212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:24:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:12.274+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:24:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:12.274+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:24:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:12.274+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:24:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:12.274+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:24:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:12.274+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:24:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:12 smithi136 ceph-mon[125702]: pgmap v16213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:24:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:12 smithi057 ceph-mon[92072]: pgmap v16213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:24:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:12 smithi122 ceph-mon[125440]: pgmap v16213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:24:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:13 smithi136 ceph-mon[125702]: pgmap v16214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:24:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:13 smithi057 ceph-mon[92072]: pgmap v16214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:24:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:13 smithi122 ceph-mon[125440]: pgmap v16214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:24:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:16 smithi136 ceph-mon[125702]: pgmap v16215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:24:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:16 smithi057 ceph-mon[92072]: pgmap v16215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:24:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:16 smithi122 ceph-mon[125440]: pgmap v16215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:24:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:18 smithi136 ceph-mon[125702]: pgmap v16216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:24:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:18 smithi136 ceph-mon[125702]: osdmap e1087: 12 total, 12 up, 12 in 2023-03-02T19:24:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:18 smithi057 ceph-mon[92072]: pgmap v16216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:24:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:18 smithi057 ceph-mon[92072]: osdmap e1087: 12 total, 12 up, 12 in 2023-03-02T19:24:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:18 smithi122 ceph-mon[125440]: pgmap v16216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:24:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:18 smithi122 ceph-mon[125440]: osdmap e1087: 12 total, 12 up, 12 in 2023-03-02T19:24:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:24:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:24:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:24:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:20 smithi136 ceph-mon[125702]: pgmap v16218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:24:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:24:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:24:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:20 smithi057 ceph-mon[92072]: pgmap v16218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:24:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:24:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:24:20.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:20 smithi122 ceph-mon[125440]: pgmap v16218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:24:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:24:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:24:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:24:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:22 smithi136 ceph-mon[125702]: pgmap v16219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:24:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:22 smithi057 ceph-mon[92072]: pgmap v16219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:24:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:22 smithi122 ceph-mon[125440]: pgmap v16219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:24:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:23 smithi136 ceph-mon[125702]: pgmap v16220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:24:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:23 smithi057 ceph-mon[92072]: pgmap v16220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:24:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:23 smithi122 ceph-mon[125440]: pgmap v16220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:24:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:26 smithi136 ceph-mon[125702]: pgmap v16221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:24:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:26 smithi057 ceph-mon[92072]: pgmap v16221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:24:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:26 smithi122 ceph-mon[125440]: pgmap v16221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:24:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:27.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:24:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:27.287+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:24:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:27.287+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:24:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:27.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:24:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:27.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:24:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:28 smithi136 ceph-mon[125702]: pgmap v16222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:24:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:28 smithi057 ceph-mon[92072]: pgmap v16222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:24:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:28 smithi122 ceph-mon[125440]: pgmap v16222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:24:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:30 smithi136 ceph-mon[125702]: pgmap v16223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:24:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:30 smithi057 ceph-mon[92072]: pgmap v16223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:24:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:30 smithi122 ceph-mon[125440]: pgmap v16223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:24:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:32 smithi136 ceph-mon[125702]: pgmap v16224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:32 smithi057 ceph-mon[92072]: pgmap v16224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:32 smithi122 ceph-mon[125440]: pgmap v16224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:33 smithi136 ceph-mon[125702]: pgmap v16225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:33 smithi057 ceph-mon[92072]: pgmap v16225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:33 smithi122 ceph-mon[125440]: pgmap v16225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:36 smithi136 ceph-mon[125702]: pgmap v16226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:36 smithi057 ceph-mon[92072]: pgmap v16226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:36 smithi122 ceph-mon[125440]: pgmap v16226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:38 smithi136 ceph-mon[125702]: pgmap v16227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:38 smithi057 ceph-mon[92072]: pgmap v16227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:38 smithi122 ceph-mon[125440]: pgmap v16227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:40 smithi136 ceph-mon[125702]: pgmap v16228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:40 smithi057 ceph-mon[92072]: pgmap v16228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:40 smithi122 ceph-mon[125440]: pgmap v16228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:42.303+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:24:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:42.303+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:24:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:42.303+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:24:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:42.303+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:24:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:42.303+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:24:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:42 smithi136 ceph-mon[125702]: pgmap v16229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:42 smithi057 ceph-mon[92072]: pgmap v16229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:42 smithi122 ceph-mon[125440]: pgmap v16229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:43 smithi136 ceph-mon[125702]: pgmap v16230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:43 smithi057 ceph-mon[92072]: pgmap v16230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:43 smithi122 ceph-mon[125440]: pgmap v16230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:46 smithi136 ceph-mon[125702]: pgmap v16231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:46 smithi057 ceph-mon[92072]: pgmap v16231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:46 smithi122 ceph-mon[125440]: pgmap v16231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:48 smithi136 ceph-mon[125702]: pgmap v16232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:48 smithi057 ceph-mon[92072]: pgmap v16232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:48 smithi122 ceph-mon[125440]: pgmap v16232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:50 smithi136 ceph-mon[125702]: pgmap v16233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:50 smithi057 ceph-mon[92072]: pgmap v16233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:50 smithi122 ceph-mon[125440]: pgmap v16233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:52 smithi136 ceph-mon[125702]: pgmap v16234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:52 smithi057 ceph-mon[92072]: pgmap v16234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:52 smithi122 ceph-mon[125440]: pgmap v16234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:53 smithi136 ceph-mon[125702]: pgmap v16235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:53 smithi057 ceph-mon[92072]: pgmap v16235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:53 smithi122 ceph-mon[125440]: pgmap v16235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:56 smithi136 ceph-mon[125702]: pgmap v16236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:56 smithi057 ceph-mon[92072]: pgmap v16236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:56 smithi122 ceph-mon[125440]: pgmap v16236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:24:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:57.303+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:24:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:57.304+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:24:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:57.304+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:24:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:57.304+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:24:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:24:57.304+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:24:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:24:58 smithi136 ceph-mon[125702]: pgmap v16237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:24:58 smithi057 ceph-mon[92072]: pgmap v16237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:24:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:24:58 smithi122 ceph-mon[125440]: pgmap v16237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:00 smithi136 ceph-mon[125702]: pgmap v16238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:00 smithi057 ceph-mon[92072]: pgmap v16238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:00 smithi122 ceph-mon[125440]: pgmap v16238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:02 smithi136 ceph-mon[125702]: pgmap v16239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:02 smithi057 ceph-mon[92072]: pgmap v16239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:02 smithi122 ceph-mon[125440]: pgmap v16239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:03 smithi136 ceph-mon[125702]: pgmap v16240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:25:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:03 smithi057 ceph-mon[92072]: pgmap v16240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:25:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:03 smithi122 ceph-mon[125440]: pgmap v16240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:25:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:06 smithi136 ceph-mon[125702]: pgmap v16241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:25:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:06 smithi057 ceph-mon[92072]: pgmap v16241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:25:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:06 smithi122 ceph-mon[125440]: pgmap v16241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:25:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:07 smithi136 ceph-mon[125702]: osdmap e1088: 12 total, 12 up, 12 in 2023-03-02T19:25:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:07 smithi057 ceph-mon[92072]: osdmap e1088: 12 total, 12 up, 12 in 2023-03-02T19:25:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:07 smithi122 ceph-mon[125440]: osdmap e1088: 12 total, 12 up, 12 in 2023-03-02T19:25:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:08 smithi136 ceph-mon[125702]: pgmap v16243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:25:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:08 smithi136 ceph-mon[125702]: osdmap e1089: 12 total, 12 up, 12 in 2023-03-02T19:25:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:08 smithi057 ceph-mon[92072]: pgmap v16243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:25:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:08 smithi057 ceph-mon[92072]: osdmap e1089: 12 total, 12 up, 12 in 2023-03-02T19:25:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:08 smithi122 ceph-mon[125440]: pgmap v16243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:25:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:08 smithi122 ceph-mon[125440]: osdmap e1089: 12 total, 12 up, 12 in 2023-03-02T19:25:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:10 smithi136 ceph-mon[125702]: pgmap v16245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:25:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:10 smithi057 ceph-mon[92072]: pgmap v16245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:25:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:10 smithi122 ceph-mon[125440]: pgmap v16245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-02T19:25:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:12.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:25:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:12.318+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:25:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:12.318+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:25:12.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:12.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:25:12.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:12.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:25:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:12 smithi136 ceph-mon[125702]: pgmap v16246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:25:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:12 smithi057 ceph-mon[92072]: pgmap v16246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:25:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:12 smithi122 ceph-mon[125440]: pgmap v16246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T19:25:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:13 smithi136 ceph-mon[125702]: pgmap v16247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:25:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:13 smithi057 ceph-mon[92072]: pgmap v16247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:25:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:13 smithi122 ceph-mon[125440]: pgmap v16247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:25:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:16 smithi136 ceph-mon[125702]: pgmap v16248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-02T19:25:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:16 smithi057 ceph-mon[92072]: pgmap v16248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-02T19:25:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:16 smithi122 ceph-mon[125440]: pgmap v16248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-02T19:25:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:18 smithi136 ceph-mon[125702]: pgmap v16249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:25:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:18 smithi057 ceph-mon[92072]: pgmap v16249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:25:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:18 smithi122 ceph-mon[125440]: pgmap v16249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:25:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:20 smithi136 ceph-mon[125702]: pgmap v16250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:25:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:25:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:20 smithi057 ceph-mon[92072]: pgmap v16250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:25:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:25:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:20 smithi122 ceph-mon[125440]: pgmap v16250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 87 B/s wr, 8 op/s 2023-03-02T19:25:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:25:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:25:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:25:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:25:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:25:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:25:21.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:25:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:25:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:25:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:25:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:22 smithi136 ceph-mon[125702]: pgmap v16251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:25:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:22 smithi057 ceph-mon[92072]: pgmap v16251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:25:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:22 smithi122 ceph-mon[125440]: pgmap v16251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-02T19:25:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:23 smithi136 ceph-mon[125702]: pgmap v16252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:25:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:23 smithi057 ceph-mon[92072]: pgmap v16252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:25:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:23 smithi122 ceph-mon[125440]: pgmap v16252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T19:25:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:26 smithi136 ceph-mon[125702]: pgmap v16253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:26 smithi057 ceph-mon[92072]: pgmap v16253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:26 smithi122 ceph-mon[125440]: pgmap v16253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:27.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:27.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:25:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:27.321+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:25:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:27.321+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:25:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:27.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:25:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:27.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:25:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:28 smithi136 ceph-mon[125702]: pgmap v16254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:28 smithi057 ceph-mon[92072]: pgmap v16254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:28 smithi122 ceph-mon[125440]: pgmap v16254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:30 smithi136 ceph-mon[125702]: pgmap v16255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:30 smithi057 ceph-mon[92072]: pgmap v16255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:30 smithi122 ceph-mon[125440]: pgmap v16255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:32 smithi136 ceph-mon[125702]: pgmap v16256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:32 smithi057 ceph-mon[92072]: pgmap v16256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:32 smithi122 ceph-mon[125440]: pgmap v16256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:33 smithi136 ceph-mon[125702]: pgmap v16257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:33 smithi057 ceph-mon[92072]: pgmap v16257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:33 smithi122 ceph-mon[125440]: pgmap v16257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:36 smithi136 ceph-mon[125702]: pgmap v16258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:36 smithi057 ceph-mon[92072]: pgmap v16258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:36 smithi122 ceph-mon[125440]: pgmap v16258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:38 smithi136 ceph-mon[125702]: pgmap v16259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:38 smithi057 ceph-mon[92072]: pgmap v16259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:38 smithi122 ceph-mon[125440]: pgmap v16259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:40 smithi136 ceph-mon[125702]: pgmap v16260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:40 smithi057 ceph-mon[92072]: pgmap v16260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:40 smithi122 ceph-mon[125440]: pgmap v16260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:42.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:25:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:42.336+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:25:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:42.336+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:25:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:42.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:25:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:42.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:25:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:42 smithi136 ceph-mon[125702]: pgmap v16261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:42 smithi057 ceph-mon[92072]: pgmap v16261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:42 smithi122 ceph-mon[125440]: pgmap v16261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:43 smithi136 ceph-mon[125702]: pgmap v16262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:43 smithi057 ceph-mon[92072]: pgmap v16262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:43 smithi122 ceph-mon[125440]: pgmap v16262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:46 smithi136 ceph-mon[125702]: pgmap v16263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:46 smithi057 ceph-mon[92072]: pgmap v16263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:46 smithi122 ceph-mon[125440]: pgmap v16263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:48 smithi136 ceph-mon[125702]: pgmap v16264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:48 smithi057 ceph-mon[92072]: pgmap v16264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:48 smithi122 ceph-mon[125440]: pgmap v16264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:50 smithi136 ceph-mon[125702]: pgmap v16265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:50 smithi057 ceph-mon[92072]: pgmap v16265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:50 smithi122 ceph-mon[125440]: pgmap v16265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:52 smithi136 ceph-mon[125702]: pgmap v16266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:52 smithi057 ceph-mon[92072]: pgmap v16266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:52 smithi122 ceph-mon[125440]: pgmap v16266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:53 smithi136 ceph-mon[125702]: pgmap v16267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:54.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:53 smithi057 ceph-mon[92072]: pgmap v16267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:53 smithi122 ceph-mon[125440]: pgmap v16267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:56 smithi136 ceph-mon[125702]: pgmap v16268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:56 smithi057 ceph-mon[92072]: pgmap v16268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:56 smithi122 ceph-mon[125440]: pgmap v16268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:25:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:57.338+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:25:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:57.338+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:25:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:57.338+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:25:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:57.338+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:25:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:25:57.338+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:25:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:25:58 smithi136 ceph-mon[125702]: pgmap v16269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:25:58 smithi057 ceph-mon[92072]: pgmap v16269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:25:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:25:58 smithi122 ceph-mon[125440]: pgmap v16269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:00 smithi136 ceph-mon[125702]: pgmap v16270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:00 smithi057 ceph-mon[92072]: pgmap v16270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:00 smithi122 ceph-mon[125440]: pgmap v16270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:02 smithi136 ceph-mon[125702]: pgmap v16271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:02 smithi057 ceph-mon[92072]: pgmap v16271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:02 smithi122 ceph-mon[125440]: pgmap v16271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:03 smithi136 ceph-mon[125702]: pgmap v16272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:26:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:03 smithi057 ceph-mon[92072]: pgmap v16272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:26:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:03 smithi122 ceph-mon[125440]: pgmap v16272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:26:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:06 smithi136 ceph-mon[125702]: pgmap v16273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:26:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:06 smithi057 ceph-mon[92072]: pgmap v16273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:26:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:06 smithi122 ceph-mon[125440]: pgmap v16273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:26:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:07 smithi136 ceph-mon[125702]: osdmap e1090: 12 total, 12 up, 12 in 2023-03-02T19:26:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:07 smithi057 ceph-mon[92072]: osdmap e1090: 12 total, 12 up, 12 in 2023-03-02T19:26:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:07 smithi122 ceph-mon[125440]: osdmap e1090: 12 total, 12 up, 12 in 2023-03-02T19:26:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:08 smithi136 ceph-mon[125702]: pgmap v16275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:26:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:08 smithi057 ceph-mon[92072]: pgmap v16275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:26:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:08 smithi122 ceph-mon[125440]: pgmap v16275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:26:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:10 smithi136 ceph-mon[125702]: pgmap v16276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:26:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:10 smithi057 ceph-mon[92072]: pgmap v16276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:26:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:10 smithi122 ceph-mon[125440]: pgmap v16276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:26:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:12.345+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:26:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:12.345+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:26:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:12.345+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:26:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:12.345+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:26:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:12.345+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:26:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:12.768+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:26:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:12.768+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:26:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:12.768+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 236 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:26:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:12.768+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 235 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:26:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:12 smithi136 ceph-mon[125702]: pgmap v16277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:26:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:12 smithi057 ceph-mon[92072]: pgmap v16277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:26:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:12 smithi122 ceph-mon[125440]: pgmap v16277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:26:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:13 smithi136 ceph-mon[125702]: pgmap v16278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:26:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:13 smithi057 ceph-mon[92072]: pgmap v16278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:26:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:13 smithi122 ceph-mon[125440]: pgmap v16278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:26:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:16 smithi136 ceph-mon[125702]: pgmap v16279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:26:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:16 smithi057 ceph-mon[92072]: pgmap v16279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:26:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:16 smithi122 ceph-mon[125440]: pgmap v16279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:26:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:18 smithi136 ceph-mon[125702]: pgmap v16280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 13 op/s 2023-03-02T19:26:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:18 smithi136 ceph-mon[125702]: osdmap e1091: 12 total, 12 up, 12 in 2023-03-02T19:26:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:18 smithi057 ceph-mon[92072]: pgmap v16280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 13 op/s 2023-03-02T19:26:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:18 smithi057 ceph-mon[92072]: osdmap e1091: 12 total, 12 up, 12 in 2023-03-02T19:26:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:18 smithi122 ceph-mon[125440]: pgmap v16280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 13 op/s 2023-03-02T19:26:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:18 smithi122 ceph-mon[125440]: osdmap e1091: 12 total, 12 up, 12 in 2023-03-02T19:26:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:20 smithi136 ceph-mon[125702]: pgmap v16282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:26:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:20 smithi057 ceph-mon[92072]: pgmap v16282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:26:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:20 smithi122 ceph-mon[125440]: pgmap v16282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:26:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:26:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:26:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:26:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:22 smithi136 ceph-mon[125702]: pgmap v16283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:26:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:26:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:26:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:26:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:22 smithi057 ceph-mon[92072]: pgmap v16283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:26:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:26:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:26:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:26:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:22 smithi122 ceph-mon[125440]: pgmap v16283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:26:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:26:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:26:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:26:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:23 smithi136 ceph-mon[125702]: pgmap v16284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:26:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:23 smithi057 ceph-mon[92072]: pgmap v16284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:26:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:23 smithi122 ceph-mon[125440]: pgmap v16284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:26:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:26 smithi136 ceph-mon[125702]: pgmap v16285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:26:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:26 smithi057 ceph-mon[92072]: pgmap v16285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:26:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:26 smithi122 ceph-mon[125440]: pgmap v16285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:26:27.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:27.356+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:26:27.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:27.356+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:26:27.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:27.356+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:26:27.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:27.356+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:26:27.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:27.356+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:26:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:28 smithi136 ceph-mon[125702]: pgmap v16286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:26:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:28 smithi057 ceph-mon[92072]: pgmap v16286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:26:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:28 smithi122 ceph-mon[125440]: pgmap v16286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:26:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:30 smithi136 ceph-mon[125702]: pgmap v16287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:26:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:30 smithi057 ceph-mon[92072]: pgmap v16287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:26:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:30 smithi122 ceph-mon[125440]: pgmap v16287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:26:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:32 smithi136 ceph-mon[125702]: pgmap v16288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:32 smithi057 ceph-mon[92072]: pgmap v16288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:32 smithi122 ceph-mon[125440]: pgmap v16288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:33 smithi136 ceph-mon[125702]: pgmap v16289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:33 smithi057 ceph-mon[92072]: pgmap v16289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:33 smithi122 ceph-mon[125440]: pgmap v16289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:36 smithi136 ceph-mon[125702]: pgmap v16290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:36 smithi057 ceph-mon[92072]: pgmap v16290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:36 smithi122 ceph-mon[125440]: pgmap v16290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:38 smithi136 ceph-mon[125702]: pgmap v16291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:38 smithi057 ceph-mon[92072]: pgmap v16291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:38 smithi122 ceph-mon[125440]: pgmap v16291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:40 smithi136 ceph-mon[125702]: pgmap v16292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:40 smithi057 ceph-mon[92072]: pgmap v16292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:40 smithi122 ceph-mon[125440]: pgmap v16292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:42.363+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:26:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:42.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:26:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:42.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:26:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:42.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:26:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:42.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:26:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:42 smithi136 ceph-mon[125702]: pgmap v16293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:42 smithi057 ceph-mon[92072]: pgmap v16293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:42 smithi122 ceph-mon[125440]: pgmap v16293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:43 smithi136 ceph-mon[125702]: pgmap v16294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:43 smithi057 ceph-mon[92072]: pgmap v16294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:43 smithi122 ceph-mon[125440]: pgmap v16294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:46 smithi136 ceph-mon[125702]: pgmap v16295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:46 smithi057 ceph-mon[92072]: pgmap v16295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:46 smithi122 ceph-mon[125440]: pgmap v16295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:48 smithi136 ceph-mon[125702]: pgmap v16296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:48 smithi057 ceph-mon[92072]: pgmap v16296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:48 smithi122 ceph-mon[125440]: pgmap v16296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:50 smithi136 ceph-mon[125702]: pgmap v16297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:50 smithi057 ceph-mon[92072]: pgmap v16297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:50 smithi122 ceph-mon[125440]: pgmap v16297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:52 smithi136 ceph-mon[125702]: pgmap v16298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:52 smithi057 ceph-mon[92072]: pgmap v16298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:52 smithi122 ceph-mon[125440]: pgmap v16298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:26:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:53 smithi136 ceph-mon[125702]: pgmap v16299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:53 smithi057 ceph-mon[92072]: pgmap v16299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:53 smithi122 ceph-mon[125440]: pgmap v16299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:56 smithi136 ceph-mon[125702]: pgmap v16300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:26:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:56 smithi057 ceph-mon[92072]: pgmap v16300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:26:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:56 smithi122 ceph-mon[125440]: pgmap v16300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:26:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:57.367+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:26:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:57.367+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:26:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:57.367+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:26:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:57.367+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:26:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:26:57.367+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:26:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:26:58 smithi136 ceph-mon[125702]: pgmap v16301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:26:58 smithi057 ceph-mon[92072]: pgmap v16301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:26:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:26:58 smithi122 ceph-mon[125440]: pgmap v16301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:00 smithi136 ceph-mon[125702]: pgmap v16302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:27:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:00 smithi057 ceph-mon[92072]: pgmap v16302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:27:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:00 smithi122 ceph-mon[125440]: pgmap v16302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:27:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:02 smithi136 ceph-mon[125702]: pgmap v16303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:27:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:02 smithi057 ceph-mon[92072]: pgmap v16303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:27:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:02 smithi122 ceph-mon[125440]: pgmap v16303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:27:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:03 smithi136 ceph-mon[125702]: pgmap v16304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:27:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:03 smithi057 ceph-mon[92072]: pgmap v16304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:27:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:03 smithi122 ceph-mon[125440]: pgmap v16304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:27:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:06 smithi136 ceph-mon[125702]: pgmap v16305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:27:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:06 smithi057 ceph-mon[92072]: pgmap v16305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:27:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:06 smithi122 ceph-mon[125440]: pgmap v16305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:27:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:08 smithi136 ceph-mon[125702]: pgmap v16306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:27:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:08 smithi057 ceph-mon[92072]: pgmap v16306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:27:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:08 smithi122 ceph-mon[125440]: pgmap v16306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:27:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:10 smithi136 ceph-mon[125702]: pgmap v16307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:27:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:10 smithi057 ceph-mon[92072]: pgmap v16307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:27:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:10 smithi122 ceph-mon[125440]: pgmap v16307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:27:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:12.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:27:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:12.377+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:27:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:12.377+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:27:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:12.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:27:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:12.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:27:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:12 smithi136 ceph-mon[125702]: pgmap v16308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:27:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:12 smithi136 ceph-mon[125702]: osdmap e1092: 12 total, 12 up, 12 in 2023-03-02T19:27:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:12 smithi057 ceph-mon[92072]: pgmap v16308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:27:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:12 smithi057 ceph-mon[92072]: osdmap e1092: 12 total, 12 up, 12 in 2023-03-02T19:27:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:12 smithi122 ceph-mon[125440]: pgmap v16308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:27:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:12 smithi122 ceph-mon[125440]: osdmap e1092: 12 total, 12 up, 12 in 2023-03-02T19:27:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:13 smithi136 ceph-mon[125702]: pgmap v16310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:13 smithi057 ceph-mon[92072]: pgmap v16310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:13 smithi122 ceph-mon[125440]: pgmap v16310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:16.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:16 smithi136 ceph-mon[125702]: pgmap v16311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:16 smithi057 ceph-mon[92072]: pgmap v16311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:16 smithi122 ceph-mon[125440]: pgmap v16311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:18 smithi136 ceph-mon[125702]: pgmap v16312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:27:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:18 smithi136 ceph-mon[125702]: osdmap e1093: 12 total, 12 up, 12 in 2023-03-02T19:27:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:18 smithi057 ceph-mon[92072]: pgmap v16312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:27:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:18 smithi057 ceph-mon[92072]: osdmap e1093: 12 total, 12 up, 12 in 2023-03-02T19:27:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:18 smithi122 ceph-mon[125440]: pgmap v16312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:27:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:18 smithi122 ceph-mon[125440]: osdmap e1093: 12 total, 12 up, 12 in 2023-03-02T19:27:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:20 smithi136 ceph-mon[125702]: pgmap v16314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T19:27:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:20 smithi057 ceph-mon[92072]: pgmap v16314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T19:27:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:20 smithi122 ceph-mon[125440]: pgmap v16314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T19:27:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:22 smithi136 ceph-mon[125702]: pgmap v16315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:27:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:27:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:22 smithi057 ceph-mon[92072]: pgmap v16315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:27:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:27:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:22 smithi122 ceph-mon[125440]: pgmap v16315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T19:27:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:27:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:27:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:27:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:27:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:27:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:27:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:27:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:27:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:27:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:27:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:24 smithi136 ceph-mon[125702]: pgmap v16316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:24 smithi057 ceph-mon[92072]: pgmap v16316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:24 smithi122 ceph-mon[125440]: pgmap v16316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:26 smithi136 ceph-mon[125702]: pgmap v16317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:26 smithi057 ceph-mon[92072]: pgmap v16317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:26 smithi122 ceph-mon[125440]: pgmap v16317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:27:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:27.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:27:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:27.394+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:27:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:27.394+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:27:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:27.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:27:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:27.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:27:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:28 smithi136 ceph-mon[125702]: pgmap v16318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:27:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:28 smithi057 ceph-mon[92072]: pgmap v16318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:27:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:28 smithi122 ceph-mon[125440]: pgmap v16318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:27:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:30 smithi136 ceph-mon[125702]: pgmap v16319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T19:27:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:30 smithi057 ceph-mon[92072]: pgmap v16319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T19:27:30.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:30 smithi122 ceph-mon[125440]: pgmap v16319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T19:27:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:32 smithi136 ceph-mon[125702]: pgmap v16320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:32 smithi057 ceph-mon[92072]: pgmap v16320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:32 smithi122 ceph-mon[125440]: pgmap v16320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:33 smithi136 ceph-mon[125702]: pgmap v16321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:27:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:33 smithi057 ceph-mon[92072]: pgmap v16321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:27:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:33 smithi122 ceph-mon[125440]: pgmap v16321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:27:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:36 smithi136 ceph-mon[125702]: pgmap v16322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:36 smithi057 ceph-mon[92072]: pgmap v16322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:36 smithi122 ceph-mon[125440]: pgmap v16322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:38 smithi136 ceph-mon[125702]: pgmap v16323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:38 smithi057 ceph-mon[92072]: pgmap v16323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:38 smithi122 ceph-mon[125440]: pgmap v16323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:40 smithi136 ceph-mon[125702]: pgmap v16324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:40 smithi057 ceph-mon[92072]: pgmap v16324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:40 smithi122 ceph-mon[125440]: pgmap v16324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:42.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:42.409+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:27:42.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:42.410+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:27:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:42.410+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:27:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:42.410+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:27:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:42.410+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:27:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:42 smithi136 ceph-mon[125702]: pgmap v16325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:42 smithi057 ceph-mon[92072]: pgmap v16325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:42 smithi122 ceph-mon[125440]: pgmap v16325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:43 smithi136 ceph-mon[125702]: pgmap v16326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:43 smithi057 ceph-mon[92072]: pgmap v16326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:43 smithi122 ceph-mon[125440]: pgmap v16326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:46 smithi136 ceph-mon[125702]: pgmap v16327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:46 smithi057 ceph-mon[92072]: pgmap v16327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:46 smithi122 ceph-mon[125440]: pgmap v16327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:48 smithi136 ceph-mon[125702]: pgmap v16328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:48 smithi057 ceph-mon[92072]: pgmap v16328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:48 smithi122 ceph-mon[125440]: pgmap v16328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:50 smithi136 ceph-mon[125702]: pgmap v16329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:50 smithi057 ceph-mon[92072]: pgmap v16329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:50.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:50 smithi122 ceph-mon[125440]: pgmap v16329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:52 smithi136 ceph-mon[125702]: pgmap v16330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:52 smithi057 ceph-mon[92072]: pgmap v16330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:52 smithi122 ceph-mon[125440]: pgmap v16330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:53 smithi136 ceph-mon[125702]: pgmap v16331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:53 smithi057 ceph-mon[92072]: pgmap v16331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:53 smithi122 ceph-mon[125440]: pgmap v16331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:56 smithi136 ceph-mon[125702]: pgmap v16332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:56 smithi057 ceph-mon[92072]: pgmap v16332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:56 smithi122 ceph-mon[125440]: pgmap v16332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:27:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:57.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:27:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:57.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:27:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:57.426+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:27:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:57.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:27:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:27:57.426+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:27:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:27:58 smithi136 ceph-mon[125702]: pgmap v16333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:27:58 smithi057 ceph-mon[92072]: pgmap v16333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:27:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:27:58 smithi122 ceph-mon[125440]: pgmap v16333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:00 smithi136 ceph-mon[125702]: pgmap v16334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:00 smithi057 ceph-mon[92072]: pgmap v16334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:00 smithi122 ceph-mon[125440]: pgmap v16334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:02 smithi136 ceph-mon[125702]: pgmap v16335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:02 smithi057 ceph-mon[92072]: pgmap v16335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:02 smithi122 ceph-mon[125440]: pgmap v16335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:03 smithi136 ceph-mon[125702]: pgmap v16336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:28:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:03 smithi057 ceph-mon[92072]: pgmap v16336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:28:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:03 smithi122 ceph-mon[125440]: pgmap v16336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:28:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:06 smithi136 ceph-mon[125702]: pgmap v16337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:28:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:06 smithi057 ceph-mon[92072]: pgmap v16337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:28:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:06 smithi122 ceph-mon[125440]: pgmap v16337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:28:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:07 smithi136 ceph-mon[125702]: osdmap e1094: 12 total, 12 up, 12 in 2023-03-02T19:28:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:07 smithi057 ceph-mon[92072]: osdmap e1094: 12 total, 12 up, 12 in 2023-03-02T19:28:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:07 smithi122 ceph-mon[125440]: osdmap e1094: 12 total, 12 up, 12 in 2023-03-02T19:28:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:08 smithi136 ceph-mon[125702]: pgmap v16339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:28:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:08 smithi057 ceph-mon[92072]: pgmap v16339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:28:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:08 smithi122 ceph-mon[125440]: pgmap v16339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:28:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:10 smithi136 ceph-mon[125702]: pgmap v16340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:28:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:10 smithi057 ceph-mon[92072]: pgmap v16340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:28:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:10 smithi122 ceph-mon[125440]: pgmap v16340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:28:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:12.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:28:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:12.441+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:28:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:12.441+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:28:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:12.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:28:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:12.441+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:28:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:12 smithi136 ceph-mon[125702]: pgmap v16341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:28:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:12 smithi057 ceph-mon[92072]: pgmap v16341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:28:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:12 smithi122 ceph-mon[125440]: pgmap v16341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:28:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:13 smithi136 ceph-mon[125702]: pgmap v16342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:28:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:13 smithi057 ceph-mon[92072]: pgmap v16342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:28:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:13 smithi122 ceph-mon[125440]: pgmap v16342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:28:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:16 smithi136 ceph-mon[125702]: pgmap v16343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:28:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:16 smithi057 ceph-mon[92072]: pgmap v16343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:28:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:16 smithi122 ceph-mon[125440]: pgmap v16343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:28:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:18 smithi136 ceph-mon[125702]: pgmap v16344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:28:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:18 smithi136 ceph-mon[125702]: osdmap e1095: 12 total, 12 up, 12 in 2023-03-02T19:28:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:18 smithi057 ceph-mon[92072]: pgmap v16344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:28:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:18 smithi057 ceph-mon[92072]: osdmap e1095: 12 total, 12 up, 12 in 2023-03-02T19:28:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:18 smithi122 ceph-mon[125440]: pgmap v16344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:28:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:18 smithi122 ceph-mon[125440]: osdmap e1095: 12 total, 12 up, 12 in 2023-03-02T19:28:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:20 smithi136 ceph-mon[125702]: pgmap v16346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:28:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:20 smithi057 ceph-mon[92072]: pgmap v16346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:28:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:20 smithi122 ceph-mon[125440]: pgmap v16346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:28:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:22 smithi136 ceph-mon[125702]: pgmap v16347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:28:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:22 smithi057 ceph-mon[92072]: pgmap v16347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:28:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:22 smithi122 ceph-mon[125440]: pgmap v16347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:28:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:28:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:28:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:28:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:28:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:28:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:28:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:28:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:28:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:28:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:28:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:28:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:28:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:24 smithi136 ceph-mon[125702]: pgmap v16348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:28:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:24 smithi057 ceph-mon[92072]: pgmap v16348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:28:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:24 smithi122 ceph-mon[125440]: pgmap v16348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:28:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:26 smithi136 ceph-mon[125702]: pgmap v16349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:28:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:26 smithi057 ceph-mon[92072]: pgmap v16349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:28:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:26 smithi122 ceph-mon[125440]: pgmap v16349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:28:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:27.455+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:28:27.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:27.455+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:28:27.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:27.455+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:28:27.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:27.455+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:28:27.458 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:27.455+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:28:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:28 smithi136 ceph-mon[125702]: pgmap v16350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:28:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:28 smithi057 ceph-mon[92072]: pgmap v16350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:28:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:28 smithi122 ceph-mon[125440]: pgmap v16350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:28:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:30 smithi136 ceph-mon[125702]: pgmap v16351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:28:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:30 smithi057 ceph-mon[92072]: pgmap v16351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:28:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:30 smithi122 ceph-mon[125440]: pgmap v16351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:28:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:32 smithi057 ceph-mon[92072]: pgmap v16352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:32 smithi122 ceph-mon[125440]: pgmap v16352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:33.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:32 smithi136 ceph-mon[125702]: pgmap v16352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:33 smithi136 ceph-mon[125702]: pgmap v16353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:33 smithi057 ceph-mon[92072]: pgmap v16353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:33 smithi122 ceph-mon[125440]: pgmap v16353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:36 smithi136 ceph-mon[125702]: pgmap v16354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:36 smithi057 ceph-mon[92072]: pgmap v16354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:36 smithi122 ceph-mon[125440]: pgmap v16354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:38 smithi136 ceph-mon[125702]: pgmap v16355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:38 smithi057 ceph-mon[92072]: pgmap v16355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:38 smithi122 ceph-mon[125440]: pgmap v16355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:40 smithi136 ceph-mon[125702]: pgmap v16356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:40 smithi057 ceph-mon[92072]: pgmap v16356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:40 smithi122 ceph-mon[125440]: pgmap v16356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:42.471+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:28:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:42.472+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:28:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:42.472+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:28:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:42.472+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:28:42.474 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:42.472+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:28:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:42 smithi136 ceph-mon[125702]: pgmap v16357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:42 smithi057 ceph-mon[92072]: pgmap v16357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:42 smithi122 ceph-mon[125440]: pgmap v16357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:43 smithi057 ceph-mon[92072]: pgmap v16358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:43 smithi122 ceph-mon[125440]: pgmap v16358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:43 smithi136 ceph-mon[125702]: pgmap v16358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:46 smithi136 ceph-mon[125702]: pgmap v16359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:46 smithi057 ceph-mon[92072]: pgmap v16359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:46 smithi122 ceph-mon[125440]: pgmap v16359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:48 smithi136 ceph-mon[125702]: pgmap v16360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:48 smithi057 ceph-mon[92072]: pgmap v16360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:48 smithi122 ceph-mon[125440]: pgmap v16360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:50 smithi136 ceph-mon[125702]: pgmap v16361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:50 smithi057 ceph-mon[92072]: pgmap v16361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:50 smithi122 ceph-mon[125440]: pgmap v16361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:52 smithi136 ceph-mon[125702]: pgmap v16362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:52 smithi057 ceph-mon[92072]: pgmap v16362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:52 smithi122 ceph-mon[125440]: pgmap v16362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:53 smithi057 ceph-mon[92072]: pgmap v16363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:53 smithi122 ceph-mon[125440]: pgmap v16363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:53 smithi136 ceph-mon[125702]: pgmap v16363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:56 smithi136 ceph-mon[125702]: pgmap v16364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:56 smithi057 ceph-mon[92072]: pgmap v16364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:56 smithi122 ceph-mon[125440]: pgmap v16364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:28:57.485 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:57.483+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:28:57.486 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:57.484+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:28:57.486 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:57.484+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:28:57.486 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:57.484+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:28:57.486 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:28:57.484+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:28:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:28:58 smithi136 ceph-mon[125702]: pgmap v16365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:28:58 smithi057 ceph-mon[92072]: pgmap v16365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:28:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:28:58 smithi122 ceph-mon[125440]: pgmap v16365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:00 smithi136 ceph-mon[125702]: pgmap v16366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:00 smithi057 ceph-mon[92072]: pgmap v16366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:00.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:00 smithi122 ceph-mon[125440]: pgmap v16366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:02 smithi136 ceph-mon[125702]: pgmap v16367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:02 smithi057 ceph-mon[92072]: pgmap v16367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:02 smithi122 ceph-mon[125440]: pgmap v16367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:03 smithi057 ceph-mon[92072]: pgmap v16368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:29:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:03 smithi122 ceph-mon[125440]: pgmap v16368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:29:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:03 smithi136 ceph-mon[125702]: pgmap v16368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:29:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:06 smithi136 ceph-mon[125702]: pgmap v16369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:29:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:06 smithi057 ceph-mon[92072]: pgmap v16369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:29:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:06 smithi122 ceph-mon[125440]: pgmap v16369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:29:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:07 smithi136 ceph-mon[125702]: osdmap e1096: 12 total, 12 up, 12 in 2023-03-02T19:29:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:07 smithi057 ceph-mon[92072]: osdmap e1096: 12 total, 12 up, 12 in 2023-03-02T19:29:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:07 smithi122 ceph-mon[125440]: osdmap e1096: 12 total, 12 up, 12 in 2023-03-02T19:29:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:08.424+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T19:29:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:08.424+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T19:29:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:08.424+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5870019800 tx=0x7f5870041000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:29:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:08.424+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5870019800 tx=0x7f5870041000 comp rx=0 tx=0).stop 2023-03-02T19:29:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:08.424+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T19:29:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:08.424+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T19:29:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:08.424+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T19:29:08.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:08.424+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T19:29:08.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:08.424+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:29:08.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:08.425+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5850005b30 tx=0x7f5870063000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T19:29:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:08 smithi136 ceph-mon[125702]: pgmap v16371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:29:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:08 smithi057 ceph-mon[92072]: pgmap v16371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:29:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:08 smithi122 ceph-mon[125440]: pgmap v16371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:29:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:10 smithi136 ceph-mon[125702]: pgmap v16372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:29:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:10 smithi057 ceph-mon[92072]: pgmap v16372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:29:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:10 smithi122 ceph-mon[125440]: pgmap v16372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:29:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:12.488+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:29:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:12.488+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:29:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:12.488+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:29:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:12.488+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:29:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:12.488+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:29:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:12.794+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:29:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:12.794+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:29:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:12.795+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 237 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:29:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:12.795+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 236 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:29:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:12 smithi057 ceph-mon[92072]: pgmap v16373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:29:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:12 smithi122 ceph-mon[125440]: pgmap v16373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:29:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:12 smithi136 ceph-mon[125702]: pgmap v16373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:29:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:13 smithi057 ceph-mon[92072]: pgmap v16374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:29:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:13 smithi122 ceph-mon[125440]: pgmap v16374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:29:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:13 smithi136 ceph-mon[125702]: pgmap v16374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:29:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:16 smithi136 ceph-mon[125702]: pgmap v16375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:29:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:16 smithi057 ceph-mon[92072]: pgmap v16375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:29:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:16 smithi122 ceph-mon[125440]: pgmap v16375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:29:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:18 smithi136 ceph-mon[125702]: pgmap v16376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:29:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:18 smithi136 ceph-mon[125702]: osdmap e1097: 12 total, 12 up, 12 in 2023-03-02T19:29:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:18 smithi057 ceph-mon[92072]: pgmap v16376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:29:18.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:18 smithi057 ceph-mon[92072]: osdmap e1097: 12 total, 12 up, 12 in 2023-03-02T19:29:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:18 smithi122 ceph-mon[125440]: pgmap v16376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:29:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:18 smithi122 ceph-mon[125440]: osdmap e1097: 12 total, 12 up, 12 in 2023-03-02T19:29:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:20 smithi136 ceph-mon[125702]: pgmap v16378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:29:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:20 smithi057 ceph-mon[92072]: pgmap v16378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:29:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:20 smithi122 ceph-mon[125440]: pgmap v16378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:29:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:22 smithi136 ceph-mon[125702]: pgmap v16379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:29:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:22 smithi057 ceph-mon[92072]: pgmap v16379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:29:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:22 smithi122 ceph-mon[125440]: pgmap v16379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:29:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:23 smithi057 ceph-mon[92072]: pgmap v16380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:29:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:29:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:23 smithi122 ceph-mon[125440]: pgmap v16380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:29:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:29:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:23 smithi136 ceph-mon[125702]: pgmap v16380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:29:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:29:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:29:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:29:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:29:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:29:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:29:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:29:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:29:25.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:29:25.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:29:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:25 smithi057 ceph-mon[92072]: pgmap v16381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:29:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:25 smithi122 ceph-mon[125440]: pgmap v16381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:29:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:25 smithi136 ceph-mon[125702]: pgmap v16381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:29:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:27.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:29:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:27.502+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:29:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:27.502+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:29:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:27.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:29:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:27.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:29:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:28 smithi136 ceph-mon[125702]: pgmap v16382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:29:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:28 smithi057 ceph-mon[92072]: pgmap v16382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:29:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:28 smithi122 ceph-mon[125440]: pgmap v16382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:29:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:30 smithi136 ceph-mon[125702]: pgmap v16383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:29:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:30 smithi057 ceph-mon[92072]: pgmap v16383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:29:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:30 smithi122 ceph-mon[125440]: pgmap v16383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:29:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:32 smithi136 ceph-mon[125702]: pgmap v16384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:32 smithi057 ceph-mon[92072]: pgmap v16384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:32 smithi122 ceph-mon[125440]: pgmap v16384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:33 smithi057 ceph-mon[92072]: pgmap v16385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:33 smithi122 ceph-mon[125440]: pgmap v16385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:33 smithi136 ceph-mon[125702]: pgmap v16385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:36 smithi136 ceph-mon[125702]: pgmap v16386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:36 smithi057 ceph-mon[92072]: pgmap v16386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:36 smithi122 ceph-mon[125440]: pgmap v16386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:38 smithi136 ceph-mon[125702]: pgmap v16387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:38 smithi057 ceph-mon[92072]: pgmap v16387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:38 smithi122 ceph-mon[125440]: pgmap v16387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:40 smithi136 ceph-mon[125702]: pgmap v16388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:40 smithi057 ceph-mon[92072]: pgmap v16388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:40 smithi122 ceph-mon[125440]: pgmap v16388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:42.519+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:29:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:42.519+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:29:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:42.519+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:29:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:42.519+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:29:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:42.519+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:29:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:42 smithi136 ceph-mon[125702]: pgmap v16389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:42 smithi057 ceph-mon[92072]: pgmap v16389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:42 smithi122 ceph-mon[125440]: pgmap v16389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:43 smithi057 ceph-mon[92072]: pgmap v16390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:43 smithi122 ceph-mon[125440]: pgmap v16390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:43 smithi136 ceph-mon[125702]: pgmap v16390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:46 smithi136 ceph-mon[125702]: pgmap v16391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:46 smithi057 ceph-mon[92072]: pgmap v16391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:46 smithi122 ceph-mon[125440]: pgmap v16391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:48 smithi136 ceph-mon[125702]: pgmap v16392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:48 smithi057 ceph-mon[92072]: pgmap v16392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:48 smithi122 ceph-mon[125440]: pgmap v16392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:50 smithi136 ceph-mon[125702]: pgmap v16393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:50 smithi057 ceph-mon[92072]: pgmap v16393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:50 smithi122 ceph-mon[125440]: pgmap v16393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:52 smithi136 ceph-mon[125702]: pgmap v16394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:52 smithi057 ceph-mon[92072]: pgmap v16394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:52 smithi122 ceph-mon[125440]: pgmap v16394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:53 smithi057 ceph-mon[92072]: pgmap v16395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:53 smithi122 ceph-mon[125440]: pgmap v16395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:53 smithi136 ceph-mon[125702]: pgmap v16395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:56 smithi136 ceph-mon[125702]: pgmap v16396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:56 smithi057 ceph-mon[92072]: pgmap v16396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:56 smithi122 ceph-mon[125440]: pgmap v16396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:29:57.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:57.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:29:57.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:57.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:29:57.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:57.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:29:57.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:57.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:29:57.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:29:57.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:29:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:29:58 smithi136 ceph-mon[125702]: pgmap v16397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:29:58 smithi057 ceph-mon[92072]: pgmap v16397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:29:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:29:58 smithi122 ceph-mon[125440]: pgmap v16397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:00 smithi136 ceph-mon[125702]: pgmap v16398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T19:30:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:00 smithi057 ceph-mon[92072]: pgmap v16398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T19:30:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:00 smithi122 ceph-mon[125440]: pgmap v16398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T19:30:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:02 smithi136 ceph-mon[125702]: pgmap v16399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:02 smithi057 ceph-mon[92072]: pgmap v16399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:02 smithi122 ceph-mon[125440]: pgmap v16399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:03 smithi057 ceph-mon[92072]: pgmap v16400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:30:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:03 smithi122 ceph-mon[125440]: pgmap v16400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:30:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:03 smithi136 ceph-mon[125702]: pgmap v16400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:30:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:06 smithi136 ceph-mon[125702]: pgmap v16401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:30:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:06 smithi057 ceph-mon[92072]: pgmap v16401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:30:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:06 smithi122 ceph-mon[125440]: pgmap v16401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:30:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:07 smithi057 ceph-mon[92072]: osdmap e1098: 12 total, 12 up, 12 in 2023-03-02T19:30:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:07 smithi122 ceph-mon[125440]: osdmap e1098: 12 total, 12 up, 12 in 2023-03-02T19:30:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:07 smithi136 ceph-mon[125702]: osdmap e1098: 12 total, 12 up, 12 in 2023-03-02T19:30:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:08 smithi057 ceph-mon[92072]: pgmap v16403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:30:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:08 smithi122 ceph-mon[125440]: pgmap v16403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:30:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:08 smithi136 ceph-mon[125702]: pgmap v16403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:30:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:10 smithi057 ceph-mon[92072]: pgmap v16404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:30:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:10 smithi122 ceph-mon[125440]: pgmap v16404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:30:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:10 smithi136 ceph-mon[125702]: pgmap v16404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:30:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:12.544+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:30:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:12.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:30:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:12.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:30:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:12.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:30:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:12.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:30:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:12 smithi057 ceph-mon[92072]: pgmap v16405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:30:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:12 smithi122 ceph-mon[125440]: pgmap v16405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:30:13.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:12 smithi136 ceph-mon[125702]: pgmap v16405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:30:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:13 smithi057 ceph-mon[92072]: pgmap v16406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:30:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:13 smithi122 ceph-mon[125440]: pgmap v16406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:30:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:13 smithi136 ceph-mon[125702]: pgmap v16406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:30:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:16 smithi136 ceph-mon[125702]: pgmap v16407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:30:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:16 smithi057 ceph-mon[92072]: pgmap v16407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:30:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:16 smithi122 ceph-mon[125440]: pgmap v16407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:30:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:18 smithi136 ceph-mon[125702]: pgmap v16408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:30:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:18 smithi136 ceph-mon[125702]: osdmap e1099: 12 total, 12 up, 12 in 2023-03-02T19:30:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:18 smithi057 ceph-mon[92072]: pgmap v16408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:30:18.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:18 smithi057 ceph-mon[92072]: osdmap e1099: 12 total, 12 up, 12 in 2023-03-02T19:30:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:18 smithi122 ceph-mon[125440]: pgmap v16408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:30:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:18 smithi122 ceph-mon[125440]: osdmap e1099: 12 total, 12 up, 12 in 2023-03-02T19:30:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:20 smithi057 ceph-mon[92072]: pgmap v16410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:30:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:20 smithi122 ceph-mon[125440]: pgmap v16410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:30:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:20 smithi136 ceph-mon[125702]: pgmap v16410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:30:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:22 smithi057 ceph-mon[92072]: pgmap v16411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:30:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:22 smithi122 ceph-mon[125440]: pgmap v16411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:30:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:22 smithi136 ceph-mon[125702]: pgmap v16411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:30:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:23 smithi057 ceph-mon[92072]: pgmap v16412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:30:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:23 smithi122 ceph-mon[125440]: pgmap v16412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:30:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:23 smithi136 ceph-mon[125702]: pgmap v16412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:30:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:30:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:30:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:30:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:30:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:30:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:30:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:25 smithi057 ceph-mon[92072]: pgmap v16413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:30:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:30:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:30:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:30:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:25 smithi122 ceph-mon[125440]: pgmap v16413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:30:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:30:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:30:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:30:26.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:25 smithi136 ceph-mon[125702]: pgmap v16413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:30:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:27.550+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:30:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:27.550+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:30:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:27.550+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:30:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:27.550+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:30:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:27.550+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:30:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:28 smithi136 ceph-mon[125702]: pgmap v16414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:30:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:28 smithi057 ceph-mon[92072]: pgmap v16414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:30:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:28 smithi122 ceph-mon[125440]: pgmap v16414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:30:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:30 smithi057 ceph-mon[92072]: pgmap v16415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:30:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:30 smithi122 ceph-mon[125440]: pgmap v16415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:30:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:30 smithi136 ceph-mon[125702]: pgmap v16415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:30:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:32 smithi057 ceph-mon[92072]: pgmap v16416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:32 smithi122 ceph-mon[125440]: pgmap v16416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:32 smithi136 ceph-mon[125702]: pgmap v16416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:33 smithi057 ceph-mon[92072]: pgmap v16417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:33 smithi122 ceph-mon[125440]: pgmap v16417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:33 smithi136 ceph-mon[125702]: pgmap v16417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:36 smithi136 ceph-mon[125702]: pgmap v16418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:36 smithi057 ceph-mon[92072]: pgmap v16418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:36 smithi122 ceph-mon[125440]: pgmap v16418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:38 smithi057 ceph-mon[92072]: pgmap v16419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:38 smithi122 ceph-mon[125440]: pgmap v16419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:38 smithi136 ceph-mon[125702]: pgmap v16419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:40 smithi057 ceph-mon[92072]: pgmap v16420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:40 smithi122 ceph-mon[125440]: pgmap v16420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:40 smithi136 ceph-mon[125702]: pgmap v16420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:42.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:30:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:42.567+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:30:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:42.567+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:30:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:42.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:30:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:42.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:30:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:42.807+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:30:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:42.807+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:30:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:42.808+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 237 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:30:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:42.808+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 238 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:30:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:42 smithi057 ceph-mon[92072]: pgmap v16421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:42 smithi122 ceph-mon[125440]: pgmap v16421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:42 smithi136 ceph-mon[125702]: pgmap v16421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:43 smithi057 ceph-mon[92072]: pgmap v16422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:43 smithi122 ceph-mon[125440]: pgmap v16422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:43 smithi136 ceph-mon[125702]: pgmap v16422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:46 smithi136 ceph-mon[125702]: pgmap v16423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:46 smithi057 ceph-mon[92072]: pgmap v16423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:46 smithi122 ceph-mon[125440]: pgmap v16423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:48 smithi057 ceph-mon[92072]: pgmap v16424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:48 smithi122 ceph-mon[125440]: pgmap v16424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:48 smithi136 ceph-mon[125702]: pgmap v16424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:50 smithi057 ceph-mon[92072]: pgmap v16425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:50 smithi122 ceph-mon[125440]: pgmap v16425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:50 smithi136 ceph-mon[125702]: pgmap v16425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:52 smithi057 ceph-mon[92072]: pgmap v16426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:52 smithi122 ceph-mon[125440]: pgmap v16426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:52 smithi136 ceph-mon[125702]: pgmap v16426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:53 smithi057 ceph-mon[92072]: pgmap v16427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:53 smithi122 ceph-mon[125440]: pgmap v16427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:53 smithi136 ceph-mon[125702]: pgmap v16427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:56 smithi057 ceph-mon[92072]: pgmap v16428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:56 smithi122 ceph-mon[125440]: pgmap v16428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:56 smithi136 ceph-mon[125702]: pgmap v16428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:30:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:57.579+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:30:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:57.579+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:30:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:57.579+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:30:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:57.579+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:30:57.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:30:57.579+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:30:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:30:58 smithi057 ceph-mon[92072]: pgmap v16429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:30:58 smithi122 ceph-mon[125440]: pgmap v16429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:30:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:30:58 smithi136 ceph-mon[125702]: pgmap v16429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:00 smithi057 ceph-mon[92072]: pgmap v16430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:00 smithi122 ceph-mon[125440]: pgmap v16430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:00 smithi136 ceph-mon[125702]: pgmap v16430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:02 smithi057 ceph-mon[92072]: pgmap v16431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:02 smithi122 ceph-mon[125440]: pgmap v16431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:02 smithi136 ceph-mon[125702]: pgmap v16431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:03 smithi057 ceph-mon[92072]: pgmap v16432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:31:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:03 smithi122 ceph-mon[125440]: pgmap v16432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:31:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:03 smithi136 ceph-mon[125702]: pgmap v16432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:31:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:06 smithi057 ceph-mon[92072]: pgmap v16433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:31:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:06 smithi122 ceph-mon[125440]: pgmap v16433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:31:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:06 smithi136 ceph-mon[125702]: pgmap v16433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:31:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:07 smithi057 ceph-mon[92072]: osdmap e1100: 12 total, 12 up, 12 in 2023-03-02T19:31:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:07 smithi122 ceph-mon[125440]: osdmap e1100: 12 total, 12 up, 12 in 2023-03-02T19:31:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:07 smithi136 ceph-mon[125702]: osdmap e1100: 12 total, 12 up, 12 in 2023-03-02T19:31:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:08 smithi057 ceph-mon[92072]: pgmap v16435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:31:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:08 smithi122 ceph-mon[125440]: pgmap v16435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:31:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:08 smithi136 ceph-mon[125702]: pgmap v16435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:31:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:10 smithi057 ceph-mon[92072]: pgmap v16436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:31:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:10 smithi122 ceph-mon[125440]: pgmap v16436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:31:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:10 smithi136 ceph-mon[125702]: pgmap v16436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:31:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:12.585+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:31:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:12.586+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:31:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:12.586+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:31:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:12.586+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:31:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:12.586+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:31:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:12 smithi057 ceph-mon[92072]: pgmap v16437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:31:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:12 smithi122 ceph-mon[125440]: pgmap v16437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:31:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:12 smithi136 ceph-mon[125702]: pgmap v16437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:31:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:13 smithi057 ceph-mon[92072]: pgmap v16438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:31:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:13 smithi122 ceph-mon[125440]: pgmap v16438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:31:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:13 smithi136 ceph-mon[125702]: pgmap v16438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:31:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:16 smithi057 ceph-mon[92072]: pgmap v16439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:31:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:16 smithi122 ceph-mon[125440]: pgmap v16439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:31:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:16 smithi136 ceph-mon[125702]: pgmap v16439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:31:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:18 smithi057 ceph-mon[92072]: pgmap v16440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:31:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:18 smithi057 ceph-mon[92072]: osdmap e1101: 12 total, 12 up, 12 in 2023-03-02T19:31:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:18 smithi122 ceph-mon[125440]: pgmap v16440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:31:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:18 smithi122 ceph-mon[125440]: osdmap e1101: 12 total, 12 up, 12 in 2023-03-02T19:31:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:18 smithi136 ceph-mon[125702]: pgmap v16440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:31:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:18 smithi136 ceph-mon[125702]: osdmap e1101: 12 total, 12 up, 12 in 2023-03-02T19:31:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:20 smithi057 ceph-mon[92072]: pgmap v16442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:31:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:20 smithi122 ceph-mon[125440]: pgmap v16442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:31:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:20 smithi136 ceph-mon[125702]: pgmap v16442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:31:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:22 smithi057 ceph-mon[92072]: pgmap v16443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:31:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:22 smithi122 ceph-mon[125440]: pgmap v16443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:31:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:22 smithi136 ceph-mon[125702]: pgmap v16443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:31:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:23 smithi057 ceph-mon[92072]: pgmap v16444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:31:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:23 smithi122 ceph-mon[125440]: pgmap v16444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:31:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:23 smithi136 ceph-mon[125702]: pgmap v16444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:31:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:31:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:31:25.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:31:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:26 smithi057 ceph-mon[92072]: pgmap v16445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:31:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:26 smithi122 ceph-mon[125440]: pgmap v16445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:31:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:26 smithi136 ceph-mon[125702]: pgmap v16445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:31:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:27.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:31:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:27.601+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:31:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:27.601+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:31:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:27.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:31:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:27.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:31:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:28 smithi057 ceph-mon[92072]: pgmap v16446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:31:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:28 smithi122 ceph-mon[125440]: pgmap v16446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:31:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:28.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:28.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:28 smithi136 ceph-mon[125702]: pgmap v16446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:31:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:31:29.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:31:29.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:29.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:31:29.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:31:29.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:31:30.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:31:30.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:31:30.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:31:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:30 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:31:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:30 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:31:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:30 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:31:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:30 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:31:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:30 smithi057 ceph-mon[92072]: pgmap v16447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:31:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:30 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:31:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:30 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:31:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:30 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:31:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:30 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:31:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:30 smithi122 ceph-mon[125440]: pgmap v16447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:31:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:30 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:31:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:30 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:31:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:30 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:31:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:30 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:31:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:30 smithi136 ceph-mon[125702]: pgmap v16447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:31:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:32 smithi057 ceph-mon[92072]: pgmap v16448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:32 smithi122 ceph-mon[125440]: pgmap v16448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:32 smithi136 ceph-mon[125702]: pgmap v16448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:33 smithi057 ceph-mon[92072]: pgmap v16449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:33 smithi122 ceph-mon[125440]: pgmap v16449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:33 smithi136 ceph-mon[125702]: pgmap v16449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:36 smithi057 ceph-mon[92072]: pgmap v16450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:36 smithi122 ceph-mon[125440]: pgmap v16450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:36 smithi136 ceph-mon[125702]: pgmap v16450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:38 smithi057 ceph-mon[92072]: pgmap v16451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:38 smithi122 ceph-mon[125440]: pgmap v16451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:38 smithi136 ceph-mon[125702]: pgmap v16451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:40.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:40 smithi057 ceph-mon[92072]: pgmap v16452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:40 smithi122 ceph-mon[125440]: pgmap v16452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:40 smithi136 ceph-mon[125702]: pgmap v16452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:42.612 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:42.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:31:42.613 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:42.610+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:31:42.613 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:42.610+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:31:42.613 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:42.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:31:42.613 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:42.610+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:31:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:42 smithi057 ceph-mon[92072]: pgmap v16453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:42.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:42 smithi122 ceph-mon[125440]: pgmap v16453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:42 smithi136 ceph-mon[125702]: pgmap v16453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:43 smithi057 ceph-mon[92072]: pgmap v16454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:43 smithi122 ceph-mon[125440]: pgmap v16454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:43 smithi136 ceph-mon[125702]: pgmap v16454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:46 smithi057 ceph-mon[92072]: pgmap v16455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:46 smithi122 ceph-mon[125440]: pgmap v16455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:46 smithi136 ceph-mon[125702]: pgmap v16455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:48 smithi057 ceph-mon[92072]: pgmap v16456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:48 smithi122 ceph-mon[125440]: pgmap v16456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:48 smithi136 ceph-mon[125702]: pgmap v16456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:50 smithi057 ceph-mon[92072]: pgmap v16457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:50 smithi122 ceph-mon[125440]: pgmap v16457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:50 smithi136 ceph-mon[125702]: pgmap v16457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:52 smithi057 ceph-mon[92072]: pgmap v16458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:52 smithi122 ceph-mon[125440]: pgmap v16458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:53.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:52 smithi136 ceph-mon[125702]: pgmap v16458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:53 smithi057 ceph-mon[92072]: pgmap v16459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:53 smithi122 ceph-mon[125440]: pgmap v16459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:53 smithi136 ceph-mon[125702]: pgmap v16459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:56 smithi057 ceph-mon[92072]: pgmap v16460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:56 smithi122 ceph-mon[125440]: pgmap v16460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:56 smithi136 ceph-mon[125702]: pgmap v16460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:31:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:57.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:57.613+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:57.613+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:57.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:31:57.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:31:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:31:58 smithi057 ceph-mon[92072]: pgmap v16461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:31:58 smithi122 ceph-mon[125440]: pgmap v16461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:31:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:31:58 smithi136 ceph-mon[125702]: pgmap v16461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:00 smithi057 ceph-mon[92072]: pgmap v16462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:00 smithi122 ceph-mon[125440]: pgmap v16462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:00 smithi136 ceph-mon[125702]: pgmap v16462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:02 smithi057 ceph-mon[92072]: pgmap v16463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:02 smithi122 ceph-mon[125440]: pgmap v16463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:02 smithi136 ceph-mon[125702]: pgmap v16463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:03 smithi057 ceph-mon[92072]: pgmap v16464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:32:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:03 smithi122 ceph-mon[125440]: pgmap v16464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:32:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:03 smithi136 ceph-mon[125702]: pgmap v16464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:32:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:06 smithi057 ceph-mon[92072]: pgmap v16465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:32:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:06 smithi122 ceph-mon[125440]: pgmap v16465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:32:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:06 smithi136 ceph-mon[125702]: pgmap v16465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:32:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:07 smithi057 ceph-mon[92072]: osdmap e1102: 12 total, 12 up, 12 in 2023-03-02T19:32:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:07 smithi122 ceph-mon[125440]: osdmap e1102: 12 total, 12 up, 12 in 2023-03-02T19:32:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:07 smithi136 ceph-mon[125702]: osdmap e1102: 12 total, 12 up, 12 in 2023-03-02T19:32:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:08 smithi057 ceph-mon[92072]: pgmap v16467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:32:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:08 smithi122 ceph-mon[125440]: pgmap v16467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:32:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:08 smithi136 ceph-mon[125702]: pgmap v16467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:32:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:10 smithi057 ceph-mon[92072]: pgmap v16468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:32:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:10 smithi122 ceph-mon[125440]: pgmap v16468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:32:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:10 smithi136 ceph-mon[125702]: pgmap v16468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:32:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:12.619+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:32:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:12.620+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:32:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:12.620+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:32:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:12.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:32:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:12.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:32:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:12.820+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:32:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:12.820+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:32:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:12.821+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 239 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:32:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:12.821+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 238 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:32:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:12 smithi057 ceph-mon[92072]: pgmap v16469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:32:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:12 smithi122 ceph-mon[125440]: pgmap v16469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:32:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:12 smithi136 ceph-mon[125702]: pgmap v16469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:32:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:13 smithi057 ceph-mon[92072]: pgmap v16470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:32:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:13 smithi122 ceph-mon[125440]: pgmap v16470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:32:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:13 smithi136 ceph-mon[125702]: pgmap v16470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:32:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:16 smithi057 ceph-mon[92072]: pgmap v16471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:32:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:16 smithi122 ceph-mon[125440]: pgmap v16471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:32:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:16 smithi136 ceph-mon[125702]: pgmap v16471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:32:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:18 smithi057 ceph-mon[92072]: pgmap v16472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 187 B/s wr, 13 op/s 2023-03-02T19:32:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:18 smithi057 ceph-mon[92072]: osdmap e1103: 12 total, 12 up, 12 in 2023-03-02T19:32:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:18 smithi122 ceph-mon[125440]: pgmap v16472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 187 B/s wr, 13 op/s 2023-03-02T19:32:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:18 smithi122 ceph-mon[125440]: osdmap e1103: 12 total, 12 up, 12 in 2023-03-02T19:32:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:18 smithi136 ceph-mon[125702]: pgmap v16472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 187 B/s wr, 13 op/s 2023-03-02T19:32:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:18 smithi136 ceph-mon[125702]: osdmap e1103: 12 total, 12 up, 12 in 2023-03-02T19:32:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:20 smithi057 ceph-mon[92072]: pgmap v16474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T19:32:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:20 smithi122 ceph-mon[125440]: pgmap v16474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T19:32:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:20 smithi136 ceph-mon[125702]: pgmap v16474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T19:32:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:22 smithi057 ceph-mon[92072]: pgmap v16475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T19:32:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:22 smithi122 ceph-mon[125440]: pgmap v16475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T19:32:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:22 smithi136 ceph-mon[125702]: pgmap v16475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T19:32:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:23 smithi057 ceph-mon[92072]: pgmap v16476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:32:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:23 smithi122 ceph-mon[125440]: pgmap v16476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:32:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:23 smithi136 ceph-mon[125702]: pgmap v16476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:32:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:26 smithi057 ceph-mon[92072]: pgmap v16477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:32:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:26 smithi122 ceph-mon[125440]: pgmap v16477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:32:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:26 smithi136 ceph-mon[125702]: pgmap v16477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:32:27.634 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:27.633+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:32:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:27.633+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:32:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:27.633+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:32:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:27.633+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:32:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:27.633+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:32:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:28 smithi057 ceph-mon[92072]: pgmap v16478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:32:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:28 smithi122 ceph-mon[125440]: pgmap v16478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:32:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:28 smithi136 ceph-mon[125702]: pgmap v16478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:32:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:32:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:32:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:32:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:30 smithi057 ceph-mon[92072]: pgmap v16479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:32:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:32:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:32:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:32:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:30 smithi122 ceph-mon[125440]: pgmap v16479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:32:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:32:30.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:32:30.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:32:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:30 smithi136 ceph-mon[125702]: pgmap v16479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:32:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:32:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:32:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:32:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:32 smithi057 ceph-mon[92072]: pgmap v16480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:32 smithi122 ceph-mon[125440]: pgmap v16480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:32 smithi136 ceph-mon[125702]: pgmap v16480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:33 smithi057 ceph-mon[92072]: pgmap v16481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:33 smithi122 ceph-mon[125440]: pgmap v16481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:33 smithi136 ceph-mon[125702]: pgmap v16481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:36 smithi057 ceph-mon[92072]: pgmap v16482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:36 smithi122 ceph-mon[125440]: pgmap v16482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:37.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:36 smithi136 ceph-mon[125702]: pgmap v16482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:38 smithi057 ceph-mon[92072]: pgmap v16483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:38 smithi122 ceph-mon[125440]: pgmap v16483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:38 smithi136 ceph-mon[125702]: pgmap v16483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:40 smithi057 ceph-mon[92072]: pgmap v16484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:40 smithi122 ceph-mon[125440]: pgmap v16484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:40 smithi136 ceph-mon[125702]: pgmap v16484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:42.645+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:32:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:42.645+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:32:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:42.645+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:32:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:42.645+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:32:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:42.645+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:32:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:42 smithi057 ceph-mon[92072]: pgmap v16485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:42 smithi122 ceph-mon[125440]: pgmap v16485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:42 smithi136 ceph-mon[125702]: pgmap v16485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:43 smithi057 ceph-mon[92072]: pgmap v16486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:43 smithi122 ceph-mon[125440]: pgmap v16486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:43 smithi136 ceph-mon[125702]: pgmap v16486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:46 smithi057 ceph-mon[92072]: pgmap v16487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:46 smithi122 ceph-mon[125440]: pgmap v16487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:46 smithi136 ceph-mon[125702]: pgmap v16487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:48 smithi057 ceph-mon[92072]: pgmap v16488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:48 smithi122 ceph-mon[125440]: pgmap v16488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:48 smithi136 ceph-mon[125702]: pgmap v16488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:50 smithi057 ceph-mon[92072]: pgmap v16489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:50 smithi122 ceph-mon[125440]: pgmap v16489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:50 smithi136 ceph-mon[125702]: pgmap v16489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:52 smithi057 ceph-mon[92072]: pgmap v16490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:52 smithi122 ceph-mon[125440]: pgmap v16490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:52 smithi136 ceph-mon[125702]: pgmap v16490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:53 smithi057 ceph-mon[92072]: pgmap v16491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:53 smithi122 ceph-mon[125440]: pgmap v16491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:53 smithi136 ceph-mon[125702]: pgmap v16491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:56 smithi057 ceph-mon[92072]: pgmap v16492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:56 smithi122 ceph-mon[125440]: pgmap v16492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:56 smithi136 ceph-mon[125702]: pgmap v16492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:32:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:57.661+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:32:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:57.662+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:32:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:57.662+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:32:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:57.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:32:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:32:57.662+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:32:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:32:58 smithi057 ceph-mon[92072]: pgmap v16493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:32:58 smithi122 ceph-mon[125440]: pgmap v16493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:32:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:32:58 smithi136 ceph-mon[125702]: pgmap v16493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:00.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:00 smithi057 ceph-mon[92072]: pgmap v16494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:00 smithi122 ceph-mon[125440]: pgmap v16494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:00 smithi136 ceph-mon[125702]: pgmap v16494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:02 smithi057 ceph-mon[92072]: pgmap v16495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:02 smithi122 ceph-mon[125440]: pgmap v16495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:02 smithi136 ceph-mon[125702]: pgmap v16495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:03 smithi057 ceph-mon[92072]: pgmap v16496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:33:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:03 smithi122 ceph-mon[125440]: pgmap v16496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:33:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:03 smithi136 ceph-mon[125702]: pgmap v16496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:33:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:06 smithi057 ceph-mon[92072]: pgmap v16497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:33:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:06 smithi122 ceph-mon[125440]: pgmap v16497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:33:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:06 smithi136 ceph-mon[125702]: pgmap v16497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:33:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:07 smithi057 ceph-mon[92072]: osdmap e1104: 12 total, 12 up, 12 in 2023-03-02T19:33:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:07 smithi122 ceph-mon[125440]: osdmap e1104: 12 total, 12 up, 12 in 2023-03-02T19:33:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:07 smithi136 ceph-mon[125702]: osdmap e1104: 12 total, 12 up, 12 in 2023-03-02T19:33:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:08 smithi057 ceph-mon[92072]: pgmap v16499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:33:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:08 smithi122 ceph-mon[125440]: pgmap v16499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:33:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:08 smithi136 ceph-mon[125702]: pgmap v16499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:33:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:09 smithi057 ceph-mon[92072]: pgmap v16500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:33:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:09 smithi122 ceph-mon[125440]: pgmap v16500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:33:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:09 smithi136 ceph-mon[125702]: pgmap v16500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:33:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:12.677+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:33:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:12.678+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:33:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:12.678+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:33:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:12.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:33:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:12.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:33:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:12 smithi057 ceph-mon[92072]: pgmap v16501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:33:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:12 smithi122 ceph-mon[125440]: pgmap v16501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:33:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:12 smithi136 ceph-mon[125702]: pgmap v16501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:33:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:13 smithi057 ceph-mon[92072]: pgmap v16502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:33:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:13 smithi122 ceph-mon[125440]: pgmap v16502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:33:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:13 smithi136 ceph-mon[125702]: pgmap v16502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:33:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:16 smithi057 ceph-mon[92072]: pgmap v16503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:33:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:16 smithi122 ceph-mon[125440]: pgmap v16503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:33:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:16 smithi136 ceph-mon[125702]: pgmap v16503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:33:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:18 smithi057 ceph-mon[92072]: pgmap v16504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:33:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:18 smithi057 ceph-mon[92072]: osdmap e1105: 12 total, 12 up, 12 in 2023-03-02T19:33:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:18 smithi122 ceph-mon[125440]: pgmap v16504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:33:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:18 smithi122 ceph-mon[125440]: osdmap e1105: 12 total, 12 up, 12 in 2023-03-02T19:33:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:18 smithi136 ceph-mon[125702]: pgmap v16504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:33:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:18 smithi136 ceph-mon[125702]: osdmap e1105: 12 total, 12 up, 12 in 2023-03-02T19:33:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:20 smithi057 ceph-mon[92072]: pgmap v16506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:33:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:20 smithi122 ceph-mon[125440]: pgmap v16506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:33:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:20 smithi136 ceph-mon[125702]: pgmap v16506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:33:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:22 smithi057 ceph-mon[92072]: pgmap v16507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:33:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:22 smithi122 ceph-mon[125440]: pgmap v16507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:33:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:22 smithi136 ceph-mon[125702]: pgmap v16507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:33:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:23 smithi057 ceph-mon[92072]: pgmap v16508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:33:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:23 smithi122 ceph-mon[125440]: pgmap v16508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:33:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:23 smithi136 ceph-mon[125702]: pgmap v16508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:33:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:26 smithi057 ceph-mon[92072]: pgmap v16509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:33:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:26 smithi122 ceph-mon[125440]: pgmap v16509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:33:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:26 smithi136 ceph-mon[125702]: pgmap v16509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:33:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:27.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:33:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:27.694+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:33:27.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:27.694+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:33:27.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:27.694+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:33:27.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:27.694+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:33:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:28 smithi057 ceph-mon[92072]: pgmap v16510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:33:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:28 smithi122 ceph-mon[125440]: pgmap v16510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:33:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:28 smithi136 ceph-mon[125702]: pgmap v16510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:33:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:30 smithi057 ceph-mon[92072]: pgmap v16511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:33:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:33:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:33:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:30 smithi122 ceph-mon[125440]: pgmap v16511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:33:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:33:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:33:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:30 smithi136 ceph-mon[125702]: pgmap v16511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:33:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:33:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:33:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:33:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:33:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:33:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:33:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:33:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:33:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:33:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:33:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:33:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:33:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:33:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:33:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:32 smithi057 ceph-mon[92072]: pgmap v16512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:32 smithi122 ceph-mon[125440]: pgmap v16512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:32 smithi136 ceph-mon[125702]: pgmap v16512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:33 smithi057 ceph-mon[92072]: pgmap v16513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:33 smithi122 ceph-mon[125440]: pgmap v16513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:33 smithi136 ceph-mon[125702]: pgmap v16513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:36 smithi057 ceph-mon[92072]: pgmap v16514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:36 smithi122 ceph-mon[125440]: pgmap v16514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:36 smithi136 ceph-mon[125702]: pgmap v16514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:38 smithi057 ceph-mon[92072]: pgmap v16515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:38 smithi122 ceph-mon[125440]: pgmap v16515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:38 smithi136 ceph-mon[125702]: pgmap v16515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:40 smithi057 ceph-mon[92072]: pgmap v16516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:40 smithi122 ceph-mon[125440]: pgmap v16516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:40 smithi136 ceph-mon[125702]: pgmap v16516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:42.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:33:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:42.700+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:33:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:42.700+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:33:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:42.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:33:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:42.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:33:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:42 smithi057 ceph-mon[92072]: pgmap v16517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:42 smithi122 ceph-mon[125440]: pgmap v16517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:42 smithi136 ceph-mon[125702]: pgmap v16517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:43 smithi057 ceph-mon[92072]: pgmap v16518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:43 smithi122 ceph-mon[125440]: pgmap v16518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:43 smithi136 ceph-mon[125702]: pgmap v16518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:46 smithi057 ceph-mon[92072]: pgmap v16519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:46 smithi122 ceph-mon[125440]: pgmap v16519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:46 smithi136 ceph-mon[125702]: pgmap v16519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:48 smithi057 ceph-mon[92072]: pgmap v16520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:48 smithi122 ceph-mon[125440]: pgmap v16520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:48 smithi136 ceph-mon[125702]: pgmap v16520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:50 smithi057 ceph-mon[92072]: pgmap v16521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:50 smithi122 ceph-mon[125440]: pgmap v16521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:50 smithi136 ceph-mon[125702]: pgmap v16521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:52 smithi057 ceph-mon[92072]: pgmap v16522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:52 smithi122 ceph-mon[125440]: pgmap v16522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:52 smithi136 ceph-mon[125702]: pgmap v16522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:53 smithi122 ceph-mon[125440]: pgmap v16523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:53 smithi136 ceph-mon[125702]: pgmap v16523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:53 smithi057 ceph-mon[92072]: pgmap v16523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:56 smithi057 ceph-mon[92072]: pgmap v16524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:56 smithi122 ceph-mon[125440]: pgmap v16524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:56 smithi136 ceph-mon[125702]: pgmap v16524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:33:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:57.716+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:33:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:57.716+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:33:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:57.716+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:33:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:57.716+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:33:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:33:57.716+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:33:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:33:58 smithi057 ceph-mon[92072]: pgmap v16525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:33:58 smithi122 ceph-mon[125440]: pgmap v16525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:33:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:33:58 smithi136 ceph-mon[125702]: pgmap v16525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:00 smithi057 ceph-mon[92072]: pgmap v16526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:00 smithi122 ceph-mon[125440]: pgmap v16526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:00 smithi136 ceph-mon[125702]: pgmap v16526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:01 smithi057 ceph-mon[92072]: pgmap v16527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:01 smithi122 ceph-mon[125440]: pgmap v16527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:01 smithi136 ceph-mon[125702]: pgmap v16527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:03 smithi122 ceph-mon[125440]: pgmap v16528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:34:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:03 smithi136 ceph-mon[125702]: pgmap v16528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:34:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:03 smithi057 ceph-mon[92072]: pgmap v16528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:34:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:06 smithi057 ceph-mon[92072]: pgmap v16529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:34:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:06 smithi122 ceph-mon[125440]: pgmap v16529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:34:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:06 smithi136 ceph-mon[125702]: pgmap v16529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:34:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:08 smithi057 ceph-mon[92072]: pgmap v16530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:34:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:08 smithi122 ceph-mon[125440]: pgmap v16530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:34:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:08 smithi136 ceph-mon[125702]: pgmap v16530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:34:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:09 smithi136 ceph-mon[125702]: pgmap v16531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:34:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:09 smithi057 ceph-mon[92072]: pgmap v16531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:34:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:09 smithi122 ceph-mon[125440]: pgmap v16531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:34:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:12 smithi136 ceph-mon[125702]: osdmap e1106: 12 total, 12 up, 12 in 2023-03-02T19:34:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:12 smithi136 ceph-mon[125702]: pgmap v16533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:34:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:12 smithi057 ceph-mon[92072]: osdmap e1106: 12 total, 12 up, 12 in 2023-03-02T19:34:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:12 smithi057 ceph-mon[92072]: pgmap v16533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:34:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:12 smithi122 ceph-mon[125440]: osdmap e1106: 12 total, 12 up, 12 in 2023-03-02T19:34:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:12 smithi122 ceph-mon[125440]: pgmap v16533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:34:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:12.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:34:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:12.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:34:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:12.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:34:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:12.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:34:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:12.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:34:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:13 smithi122 ceph-mon[125440]: pgmap v16534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:13 smithi136 ceph-mon[125702]: pgmap v16534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:13 smithi057 ceph-mon[92072]: pgmap v16534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:16 smithi057 ceph-mon[92072]: pgmap v16535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:16 smithi122 ceph-mon[125440]: pgmap v16535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:16 smithi136 ceph-mon[125702]: pgmap v16535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:18 smithi057 ceph-mon[92072]: pgmap v16536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:34:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:18 smithi057 ceph-mon[92072]: osdmap e1107: 12 total, 12 up, 12 in 2023-03-02T19:34:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:18 smithi122 ceph-mon[125440]: pgmap v16536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:34:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:18 smithi122 ceph-mon[125440]: osdmap e1107: 12 total, 12 up, 12 in 2023-03-02T19:34:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:18 smithi136 ceph-mon[125702]: pgmap v16536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:34:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:18 smithi136 ceph-mon[125702]: osdmap e1107: 12 total, 12 up, 12 in 2023-03-02T19:34:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:20 smithi057 ceph-mon[92072]: pgmap v16538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 359 B/s wr, 12 op/s 2023-03-02T19:34:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:20 smithi122 ceph-mon[125440]: pgmap v16538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 359 B/s wr, 12 op/s 2023-03-02T19:34:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:20 smithi136 ceph-mon[125702]: pgmap v16538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 359 B/s wr, 12 op/s 2023-03-02T19:34:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:22 smithi057 ceph-mon[92072]: pgmap v16539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:34:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:22 smithi122 ceph-mon[125440]: pgmap v16539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:34:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:22 smithi136 ceph-mon[125702]: pgmap v16539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:34:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:23 smithi122 ceph-mon[125440]: pgmap v16540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:23 smithi136 ceph-mon[125702]: pgmap v16540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:23 smithi057 ceph-mon[92072]: pgmap v16540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:26 smithi057 ceph-mon[92072]: pgmap v16541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:26 smithi122 ceph-mon[125440]: pgmap v16541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:26 smithi136 ceph-mon[125702]: pgmap v16541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:34:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:27.738+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:34:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:27.739+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:34:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:27.739+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:34:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:27.739+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:34:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:27.739+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:34:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:28 smithi057 ceph-mon[92072]: pgmap v16542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:34:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:28 smithi122 ceph-mon[125440]: pgmap v16542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:34:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:28 smithi136 ceph-mon[125702]: pgmap v16542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:34:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:29 smithi136 ceph-mon[125702]: pgmap v16543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:34:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:29 smithi057 ceph-mon[92072]: pgmap v16543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:34:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:29 smithi122 ceph-mon[125440]: pgmap v16543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:34:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:34:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:34:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:34:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:32 smithi136 ceph-mon[125702]: pgmap v16544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:32 smithi057 ceph-mon[92072]: pgmap v16544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:32.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:32 smithi122 ceph-mon[125440]: pgmap v16544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:34:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:34:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:34:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:34:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:34:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:34:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:34:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:34 smithi136 ceph-mon[125702]: pgmap v16545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:34 smithi057 ceph-mon[92072]: pgmap v16545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:34 smithi122 ceph-mon[125440]: pgmap v16545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:36 smithi057 ceph-mon[92072]: pgmap v16546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:36 smithi122 ceph-mon[125440]: pgmap v16546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:36 smithi136 ceph-mon[125702]: pgmap v16546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:38 smithi057 ceph-mon[92072]: pgmap v16547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:38 smithi122 ceph-mon[125440]: pgmap v16547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:38 smithi136 ceph-mon[125702]: pgmap v16547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:39 smithi057 ceph-mon[92072]: pgmap v16548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:39 smithi122 ceph-mon[125440]: pgmap v16548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:39 smithi136 ceph-mon[125702]: pgmap v16548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:42.750 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:42.749+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:34:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:42.749+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:34:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:42.749+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:34:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:42.749+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:34:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:42.749+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:34:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:42 smithi057 ceph-mon[92072]: pgmap v16549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:42 smithi122 ceph-mon[125440]: pgmap v16549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:42 smithi136 ceph-mon[125702]: pgmap v16549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:43 smithi122 ceph-mon[125440]: pgmap v16550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:43 smithi136 ceph-mon[125702]: pgmap v16550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:43 smithi057 ceph-mon[92072]: pgmap v16550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:46 smithi057 ceph-mon[92072]: pgmap v16551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:46 smithi122 ceph-mon[125440]: pgmap v16551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:46 smithi136 ceph-mon[125702]: pgmap v16551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:47 smithi057 ceph-mon[92072]: pgmap v16552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:47 smithi122 ceph-mon[125440]: pgmap v16552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:47 smithi136 ceph-mon[125702]: pgmap v16552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:50 smithi057 ceph-mon[92072]: pgmap v16553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:50 smithi122 ceph-mon[125440]: pgmap v16553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:50 smithi136 ceph-mon[125702]: pgmap v16553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:51 smithi122 ceph-mon[125440]: pgmap v16554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:51 smithi136 ceph-mon[125702]: pgmap v16554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:51 smithi057 ceph-mon[92072]: pgmap v16554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:53 smithi136 ceph-mon[125702]: pgmap v16555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:53 smithi057 ceph-mon[92072]: pgmap v16555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:53 smithi122 ceph-mon[125440]: pgmap v16555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:56 smithi057 ceph-mon[92072]: pgmap v16556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:56 smithi122 ceph-mon[125440]: pgmap v16556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:56 smithi136 ceph-mon[125702]: pgmap v16556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:57.761 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:57.760+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:34:57.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:57.760+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:34:57.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:57.760+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:34:57.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:57.760+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:34:57.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:34:57.760+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:34:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:58 smithi057 ceph-mon[92072]: pgmap v16557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:58 smithi122 ceph-mon[125440]: pgmap v16557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:58 smithi136 ceph-mon[125702]: pgmap v16557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:34:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:34:59 smithi057 ceph-mon[92072]: pgmap v16558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:34:59.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:34:59 smithi122 ceph-mon[125440]: pgmap v16558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:34:59 smithi136 ceph-mon[125702]: pgmap v16558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:02 smithi057 ceph-mon[92072]: pgmap v16559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:02 smithi122 ceph-mon[125440]: pgmap v16559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:02 smithi136 ceph-mon[125702]: pgmap v16559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:03 smithi136 ceph-mon[125702]: pgmap v16560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:35:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:03 smithi057 ceph-mon[92072]: pgmap v16560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:35:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:03 smithi122 ceph-mon[125440]: pgmap v16560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:35:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:06 smithi057 ceph-mon[92072]: pgmap v16561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:35:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:06 smithi122 ceph-mon[125440]: pgmap v16561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:35:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:06 smithi136 ceph-mon[125702]: pgmap v16561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:35:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:07 smithi122 ceph-mon[125440]: osdmap e1108: 12 total, 12 up, 12 in 2023-03-02T19:35:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:07 smithi122 ceph-mon[125440]: pgmap v16563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:35:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:07 smithi136 ceph-mon[125702]: osdmap e1108: 12 total, 12 up, 12 in 2023-03-02T19:35:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:07 smithi136 ceph-mon[125702]: pgmap v16563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:35:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:07 smithi057 ceph-mon[92072]: osdmap e1108: 12 total, 12 up, 12 in 2023-03-02T19:35:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:07 smithi057 ceph-mon[92072]: pgmap v16563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:35:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:10 smithi057 ceph-mon[92072]: pgmap v16564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:35:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:10 smithi122 ceph-mon[125440]: pgmap v16564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:35:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:10 smithi136 ceph-mon[125702]: pgmap v16564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:35:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:11 smithi057 ceph-mon[92072]: pgmap v16565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:35:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:11 smithi122 ceph-mon[125440]: pgmap v16565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:35:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:11 smithi136 ceph-mon[125702]: pgmap v16565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:35:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:12.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:35:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:12.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:35:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:12.776+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:35:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:12.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:35:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:12.776+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:35:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:12.846+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:35:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:12.846+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:35:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:12.846+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 240 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:35:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:12.846+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 239 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:35:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:13 smithi136 ceph-mon[125702]: pgmap v16566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:35:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:13 smithi057 ceph-mon[92072]: pgmap v16566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:35:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:13 smithi122 ceph-mon[125440]: pgmap v16566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:35:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:16 smithi057 ceph-mon[92072]: pgmap v16567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:35:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:16 smithi122 ceph-mon[125440]: pgmap v16567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:35:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:16 smithi136 ceph-mon[125702]: pgmap v16567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:35:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:18 smithi057 ceph-mon[92072]: pgmap v16568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:35:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:18 smithi057 ceph-mon[92072]: osdmap e1109: 12 total, 12 up, 12 in 2023-03-02T19:35:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:18 smithi122 ceph-mon[125440]: pgmap v16568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:35:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:18 smithi122 ceph-mon[125440]: osdmap e1109: 12 total, 12 up, 12 in 2023-03-02T19:35:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:18 smithi136 ceph-mon[125702]: pgmap v16568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 187 B/s wr, 14 op/s 2023-03-02T19:35:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:18 smithi136 ceph-mon[125702]: osdmap e1109: 12 total, 12 up, 12 in 2023-03-02T19:35:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:19 smithi122 ceph-mon[125440]: pgmap v16570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:35:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:19 smithi136 ceph-mon[125702]: pgmap v16570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:35:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:19 smithi057 ceph-mon[92072]: pgmap v16570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:35:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:22 smithi057 ceph-mon[92072]: pgmap v16571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:35:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:22 smithi122 ceph-mon[125440]: pgmap v16571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:35:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:22 smithi136 ceph-mon[125702]: pgmap v16571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:35:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:23 smithi136 ceph-mon[125702]: pgmap v16572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:35:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:23 smithi057 ceph-mon[92072]: pgmap v16572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:35:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:23 smithi122 ceph-mon[125440]: pgmap v16572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:35:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:26 smithi057 ceph-mon[92072]: pgmap v16573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:35:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:26 smithi122 ceph-mon[125440]: pgmap v16573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:35:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:26 smithi136 ceph-mon[125702]: pgmap v16573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:35:27.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:27.792+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:35:27.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:27.792+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:35:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:27.792+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:35:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:27.792+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:35:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:27.792+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:35:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:27 smithi136 ceph-mon[125702]: pgmap v16574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:35:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:27 smithi057 ceph-mon[92072]: pgmap v16574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:35:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:27 smithi122 ceph-mon[125440]: pgmap v16574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:35:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:30 smithi057 ceph-mon[92072]: pgmap v16575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:35:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:30 smithi122 ceph-mon[125440]: pgmap v16575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:35:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:30 smithi136 ceph-mon[125702]: pgmap v16575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:35:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:31 smithi122 ceph-mon[125440]: pgmap v16576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:31 smithi136 ceph-mon[125702]: pgmap v16576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:31 smithi057 ceph-mon[92072]: pgmap v16576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:35:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:35:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:35:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:34 smithi136 ceph-mon[125702]: pgmap v16577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:35:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:35:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:35:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:33 smithi057 ceph-mon[92072]: pgmap v16577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:35:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:35:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:35:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:33 smithi122 ceph-mon[125440]: pgmap v16577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:35:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:35:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:35:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:36 smithi057 ceph-mon[92072]: pgmap v16578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:36 smithi122 ceph-mon[125440]: pgmap v16578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:36 smithi136 ceph-mon[125702]: pgmap v16578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:37 smithi122 ceph-mon[125440]: pgmap v16579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:37 smithi136 ceph-mon[125702]: pgmap v16579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:37 smithi057 ceph-mon[92072]: pgmap v16579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:40 smithi122 ceph-mon[125440]: pgmap v16580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:40 smithi136 ceph-mon[125702]: pgmap v16580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:40 smithi057 ceph-mon[92072]: pgmap v16580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:41 smithi122 ceph-mon[125440]: pgmap v16581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:41 smithi136 ceph-mon[125702]: pgmap v16581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:41 smithi057 ceph-mon[92072]: pgmap v16581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:42.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:35:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:42.808+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:35:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:42.808+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:35:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:42.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:35:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:42.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:35:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:43 smithi136 ceph-mon[125702]: pgmap v16582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:43 smithi057 ceph-mon[92072]: pgmap v16582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:43 smithi122 ceph-mon[125440]: pgmap v16582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:45 smithi136 ceph-mon[125702]: pgmap v16583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:45 smithi057 ceph-mon[92072]: pgmap v16583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:45 smithi122 ceph-mon[125440]: pgmap v16583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:47 smithi136 ceph-mon[125702]: pgmap v16584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:47 smithi057 ceph-mon[92072]: pgmap v16584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:47 smithi122 ceph-mon[125440]: pgmap v16584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:49 smithi136 ceph-mon[125702]: pgmap v16585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:49 smithi057 ceph-mon[92072]: pgmap v16585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:49 smithi122 ceph-mon[125440]: pgmap v16585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:51 smithi136 ceph-mon[125702]: pgmap v16586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:51 smithi057 ceph-mon[92072]: pgmap v16586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:51 smithi122 ceph-mon[125440]: pgmap v16586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:53 smithi136 ceph-mon[125702]: pgmap v16587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:53 smithi057 ceph-mon[92072]: pgmap v16587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:53 smithi122 ceph-mon[125440]: pgmap v16587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:55 smithi136 ceph-mon[125702]: pgmap v16588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:55 smithi057 ceph-mon[92072]: pgmap v16588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:55 smithi122 ceph-mon[125440]: pgmap v16588: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:35:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:57.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:35:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:57.815+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:35:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:57.815+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:35:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:57.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:35:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:35:57.815+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:35:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:57 smithi136 ceph-mon[125702]: pgmap v16589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:57 smithi057 ceph-mon[92072]: pgmap v16589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:35:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:57 smithi122 ceph-mon[125440]: pgmap v16589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:35:59 smithi136 ceph-mon[125702]: pgmap v16590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:35:59 smithi057 ceph-mon[92072]: pgmap v16590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:35:59 smithi122 ceph-mon[125440]: pgmap v16590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:01 smithi136 ceph-mon[125702]: pgmap v16591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:01 smithi057 ceph-mon[92072]: pgmap v16591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:01 smithi122 ceph-mon[125440]: pgmap v16591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:03 smithi136 ceph-mon[125702]: pgmap v16592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:36:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:03 smithi057 ceph-mon[92072]: pgmap v16592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:36:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:03 smithi122 ceph-mon[125440]: pgmap v16592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:36:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:05 smithi136 ceph-mon[125702]: pgmap v16593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:36:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:05 smithi057 ceph-mon[92072]: pgmap v16593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:36:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:05 smithi122 ceph-mon[125440]: pgmap v16593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:36:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:07 smithi136 ceph-mon[125702]: osdmap e1110: 12 total, 12 up, 12 in 2023-03-02T19:36:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:07 smithi136 ceph-mon[125702]: pgmap v16595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:36:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:07 smithi057 ceph-mon[92072]: osdmap e1110: 12 total, 12 up, 12 in 2023-03-02T19:36:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:07 smithi057 ceph-mon[92072]: pgmap v16595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:07 smithi122 ceph-mon[125440]: osdmap e1110: 12 total, 12 up, 12 in 2023-03-02T19:36:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:07 smithi122 ceph-mon[125440]: pgmap v16595: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:36:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:09 smithi136 ceph-mon[125702]: pgmap v16596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:36:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:09 smithi057 ceph-mon[92072]: pgmap v16596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:36:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:09 smithi122 ceph-mon[125440]: pgmap v16596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:36:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:11 smithi136 ceph-mon[125702]: pgmap v16597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:36:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:11 smithi057 ceph-mon[92072]: pgmap v16597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:36:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:11 smithi122 ceph-mon[125440]: pgmap v16597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:36:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:12.830+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:36:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:12.831+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:36:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:12.831+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:36:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:12.831+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:36:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:12.831+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:36:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:13 smithi136 ceph-mon[125702]: pgmap v16598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:36:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:13 smithi057 ceph-mon[92072]: pgmap v16598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:36:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:13 smithi122 ceph-mon[125440]: pgmap v16598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:36:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:15 smithi136 ceph-mon[125702]: pgmap v16599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:36:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:15 smithi057 ceph-mon[92072]: pgmap v16599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:36:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:15 smithi122 ceph-mon[125440]: pgmap v16599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:36:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:17 smithi136 ceph-mon[125702]: pgmap v16600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 188 B/s wr, 10 op/s 2023-03-02T19:36:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:17 smithi057 ceph-mon[92072]: pgmap v16600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 188 B/s wr, 10 op/s 2023-03-02T19:36:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:17 smithi122 ceph-mon[125440]: pgmap v16600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 188 B/s wr, 10 op/s 2023-03-02T19:36:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:18 smithi136 ceph-mon[125702]: osdmap e1111: 12 total, 12 up, 12 in 2023-03-02T19:36:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:18 smithi057 ceph-mon[92072]: osdmap e1111: 12 total, 12 up, 12 in 2023-03-02T19:36:19.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:18 smithi122 ceph-mon[125440]: osdmap e1111: 12 total, 12 up, 12 in 2023-03-02T19:36:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:19 smithi136 ceph-mon[125702]: pgmap v16602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:36:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:19 smithi057 ceph-mon[92072]: pgmap v16602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:36:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:19 smithi122 ceph-mon[125440]: pgmap v16602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:36:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:21 smithi136 ceph-mon[125702]: pgmap v16603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:36:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:21 smithi057 ceph-mon[92072]: pgmap v16603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:36:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:21 smithi122 ceph-mon[125440]: pgmap v16603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:36:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:23 smithi136 ceph-mon[125702]: pgmap v16604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:36:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:23 smithi057 ceph-mon[92072]: pgmap v16604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:36:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:23 smithi122 ceph-mon[125440]: pgmap v16604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:36:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:25 smithi136 ceph-mon[125702]: pgmap v16605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:36:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:25 smithi057 ceph-mon[92072]: pgmap v16605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:36:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:25 smithi122 ceph-mon[125440]: pgmap v16605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:36:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:27.844+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:36:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:27.845+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:36:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:27.845+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:36:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:27.845+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:36:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:27.845+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:36:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:27 smithi136 ceph-mon[125702]: pgmap v16606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:36:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:27 smithi057 ceph-mon[92072]: pgmap v16606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:36:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:27 smithi122 ceph-mon[125440]: pgmap v16606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:36:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:29 smithi136 ceph-mon[125702]: pgmap v16607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:36:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:29 smithi057 ceph-mon[92072]: pgmap v16607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:36:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:29 smithi122 ceph-mon[125440]: pgmap v16607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:36:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:31 smithi136 ceph-mon[125702]: pgmap v16608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:31 smithi057 ceph-mon[92072]: pgmap v16608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:31 smithi122 ceph-mon[125440]: pgmap v16608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:33 smithi136 ceph-mon[125702]: pgmap v16609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:36:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:33 smithi057 ceph-mon[92072]: pgmap v16609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:36:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:33 smithi122 ceph-mon[125440]: pgmap v16609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:36:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:36:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:36:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:36:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:36:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:36:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:36:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:36:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:36:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:36:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:35 smithi136 ceph-mon[125702]: pgmap v16610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:35 smithi057 ceph-mon[92072]: pgmap v16610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:35 smithi122 ceph-mon[125440]: pgmap v16610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:37 smithi136 ceph-mon[125702]: pgmap v16611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:37 smithi057 ceph-mon[92072]: pgmap v16611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:37 smithi122 ceph-mon[125440]: pgmap v16611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:39 smithi136 ceph-mon[125702]: pgmap v16612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:39 smithi057 ceph-mon[92072]: pgmap v16612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:39 smithi122 ceph-mon[125440]: pgmap v16612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:41 smithi136 ceph-mon[125702]: pgmap v16613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:41 smithi057 ceph-mon[92072]: pgmap v16613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:41 smithi122 ceph-mon[125440]: pgmap v16613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:42.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:42.848+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:36:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:42.849+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:36:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:42.849+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:36:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:42.849+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:36:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:42.849+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:36:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:43 smithi136 ceph-mon[125702]: pgmap v16614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:43 smithi057 ceph-mon[92072]: pgmap v16614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:43 smithi122 ceph-mon[125440]: pgmap v16614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:45 smithi136 ceph-mon[125702]: pgmap v16615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:45 smithi057 ceph-mon[92072]: pgmap v16615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:45 smithi122 ceph-mon[125440]: pgmap v16615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:47 smithi136 ceph-mon[125702]: pgmap v16616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:47 smithi057 ceph-mon[92072]: pgmap v16616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:47 smithi122 ceph-mon[125440]: pgmap v16616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:49 smithi136 ceph-mon[125702]: pgmap v16617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:49 smithi057 ceph-mon[92072]: pgmap v16617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:49 smithi122 ceph-mon[125440]: pgmap v16617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:51 smithi136 ceph-mon[125702]: pgmap v16618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:51 smithi057 ceph-mon[92072]: pgmap v16618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:51 smithi122 ceph-mon[125440]: pgmap v16618: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:53 smithi136 ceph-mon[125702]: pgmap v16619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:53 smithi057 ceph-mon[92072]: pgmap v16619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:53 smithi122 ceph-mon[125440]: pgmap v16619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:55 smithi136 ceph-mon[125702]: pgmap v16620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:55 smithi057 ceph-mon[92072]: pgmap v16620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:55 smithi122 ceph-mon[125440]: pgmap v16620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:36:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:57.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:36:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:57.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:36:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:57.865+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:36:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:57.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:36:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:36:57.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:36:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:57 smithi136 ceph-mon[125702]: pgmap v16621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:57 smithi057 ceph-mon[92072]: pgmap v16621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:36:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:57 smithi122 ceph-mon[125440]: pgmap v16621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:36:59 smithi136 ceph-mon[125702]: pgmap v16622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:36:59 smithi057 ceph-mon[92072]: pgmap v16622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:36:59 smithi122 ceph-mon[125440]: pgmap v16622: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:01 smithi136 ceph-mon[125702]: pgmap v16623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:01 smithi057 ceph-mon[92072]: pgmap v16623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:01 smithi122 ceph-mon[125440]: pgmap v16623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:03 smithi136 ceph-mon[125702]: pgmap v16624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:37:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:03 smithi057 ceph-mon[92072]: pgmap v16624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:37:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:03 smithi122 ceph-mon[125440]: pgmap v16624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:37:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:05 smithi136 ceph-mon[125702]: pgmap v16625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:37:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:05 smithi057 ceph-mon[92072]: pgmap v16625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:37:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:05 smithi122 ceph-mon[125440]: pgmap v16625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:37:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:07 smithi136 ceph-mon[125702]: osdmap e1112: 12 total, 12 up, 12 in 2023-03-02T19:37:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:07 smithi136 ceph-mon[125702]: pgmap v16627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:37:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:07 smithi057 ceph-mon[92072]: osdmap e1112: 12 total, 12 up, 12 in 2023-03-02T19:37:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:07 smithi057 ceph-mon[92072]: pgmap v16627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:37:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:07 smithi122 ceph-mon[125440]: osdmap e1112: 12 total, 12 up, 12 in 2023-03-02T19:37:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:07 smithi122 ceph-mon[125440]: pgmap v16627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:37:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:09 smithi136 ceph-mon[125702]: pgmap v16628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:37:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:09 smithi057 ceph-mon[92072]: pgmap v16628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:37:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:09 smithi122 ceph-mon[125440]: pgmap v16628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:37:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:11 smithi136 ceph-mon[125702]: pgmap v16629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:37:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:11 smithi057 ceph-mon[92072]: pgmap v16629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:37:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:11 smithi122 ceph-mon[125440]: pgmap v16629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:37:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:12.876+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:37:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:12.876+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:37:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:12.876+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:37:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:12.876+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:37:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:12.876+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:37:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:13 smithi136 ceph-mon[125702]: pgmap v16630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:37:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:13 smithi057 ceph-mon[92072]: pgmap v16630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:37:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:13 smithi122 ceph-mon[125440]: pgmap v16630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:37:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:15 smithi136 ceph-mon[125702]: pgmap v16631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:37:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:15 smithi057 ceph-mon[92072]: pgmap v16631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:37:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:15 smithi122 ceph-mon[125440]: pgmap v16631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:37:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:17 smithi136 ceph-mon[125702]: pgmap v16632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:37:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:17 smithi057 ceph-mon[92072]: pgmap v16632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:37:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:17 smithi122 ceph-mon[125440]: pgmap v16632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:37:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:18 smithi136 ceph-mon[125702]: osdmap e1113: 12 total, 12 up, 12 in 2023-03-02T19:37:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:18 smithi057 ceph-mon[92072]: osdmap e1113: 12 total, 12 up, 12 in 2023-03-02T19:37:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:18 smithi122 ceph-mon[125440]: osdmap e1113: 12 total, 12 up, 12 in 2023-03-02T19:37:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:19 smithi136 ceph-mon[125702]: pgmap v16634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:37:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:19 smithi057 ceph-mon[92072]: pgmap v16634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:37:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:19 smithi122 ceph-mon[125440]: pgmap v16634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:37:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:21 smithi136 ceph-mon[125702]: pgmap v16635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:37:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:21 smithi057 ceph-mon[92072]: pgmap v16635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:37:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:21 smithi122 ceph-mon[125440]: pgmap v16635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:37:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:23 smithi136 ceph-mon[125702]: pgmap v16636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:37:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:23 smithi057 ceph-mon[92072]: pgmap v16636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:37:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:23 smithi122 ceph-mon[125440]: pgmap v16636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:37:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:25 smithi136 ceph-mon[125702]: pgmap v16637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:37:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:25 smithi057 ceph-mon[92072]: pgmap v16637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:37:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:25 smithi122 ceph-mon[125440]: pgmap v16637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:37:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:27.892+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:37:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:27.892+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:37:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:27.892+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:37:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:27.892+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:37:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:27.892+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:37:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:27 smithi136 ceph-mon[125702]: pgmap v16638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:37:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:27 smithi057 ceph-mon[92072]: pgmap v16638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:37:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:27 smithi122 ceph-mon[125440]: pgmap v16638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:37:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:29 smithi136 ceph-mon[125702]: pgmap v16639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:37:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:29 smithi057 ceph-mon[92072]: pgmap v16639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:37:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:29 smithi122 ceph-mon[125440]: pgmap v16639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:37:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:31 smithi136 ceph-mon[125702]: pgmap v16640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:31 smithi057 ceph-mon[92072]: pgmap v16640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:31 smithi122 ceph-mon[125440]: pgmap v16640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:33 smithi136 ceph-mon[125702]: pgmap v16641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:33 smithi057 ceph-mon[92072]: pgmap v16641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:33 smithi122 ceph-mon[125440]: pgmap v16641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:37:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:37:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:37:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:36 smithi136 ceph-mon[125702]: pgmap v16642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:36 smithi057 ceph-mon[92072]: pgmap v16642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:36 smithi122 ceph-mon[125440]: pgmap v16642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:38.050 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:37 smithi057 ceph-mon[92072]: pgmap v16643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:37 smithi136 ceph-mon[125702]: pgmap v16643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:37 smithi122 ceph-mon[125440]: pgmap v16643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:37:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:37:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:37:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:37:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:37:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:37:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:37:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:37:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:37:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:37:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:37:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:37:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:37:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:37:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:37:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:40 smithi136 ceph-mon[125702]: pgmap v16644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:40 smithi057 ceph-mon[92072]: pgmap v16644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:40 smithi122 ceph-mon[125440]: pgmap v16644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:41 smithi136 ceph-mon[125702]: pgmap v16645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:41 smithi057 ceph-mon[92072]: pgmap v16645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:41 smithi122 ceph-mon[125440]: pgmap v16645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:42.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:42.894+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:37:42.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:42.894+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:37:42.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:42.894+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:37:42.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:42.894+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:37:42.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:42.894+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:37:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:43 smithi136 ceph-mon[125702]: pgmap v16646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:43 smithi057 ceph-mon[92072]: pgmap v16646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:43 smithi122 ceph-mon[125440]: pgmap v16646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:45 smithi136 ceph-mon[125702]: pgmap v16647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:45 smithi057 ceph-mon[92072]: pgmap v16647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:45 smithi122 ceph-mon[125440]: pgmap v16647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:48.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:47 smithi136 ceph-mon[125702]: pgmap v16648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:47 smithi057 ceph-mon[92072]: pgmap v16648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:47 smithi122 ceph-mon[125440]: pgmap v16648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:49 smithi136 ceph-mon[125702]: pgmap v16649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:49 smithi057 ceph-mon[92072]: pgmap v16649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:49 smithi122 ceph-mon[125440]: pgmap v16649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:51 smithi136 ceph-mon[125702]: pgmap v16650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:51 smithi057 ceph-mon[92072]: pgmap v16650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:51 smithi122 ceph-mon[125440]: pgmap v16650: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:54 smithi136 ceph-mon[125702]: pgmap v16651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:53 smithi057 ceph-mon[92072]: pgmap v16651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:54 smithi122 ceph-mon[125440]: pgmap v16651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:55 smithi136 ceph-mon[125702]: pgmap v16652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:55 smithi057 ceph-mon[92072]: pgmap v16652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:55 smithi122 ceph-mon[125440]: pgmap v16652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:37:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:57.910+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:37:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:57.910+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:37:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:57.910+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:37:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:57.910+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:37:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:37:57.910+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:37:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:57 smithi136 ceph-mon[125702]: pgmap v16653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:57 smithi057 ceph-mon[92072]: pgmap v16653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:37:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:57 smithi122 ceph-mon[125440]: pgmap v16653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:37:59 smithi136 ceph-mon[125702]: pgmap v16654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:37:59 smithi057 ceph-mon[92072]: pgmap v16654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:37:59 smithi122 ceph-mon[125440]: pgmap v16654: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:01 smithi136 ceph-mon[125702]: pgmap v16655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:01 smithi057 ceph-mon[92072]: pgmap v16655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:01 smithi122 ceph-mon[125440]: pgmap v16655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:04 smithi136 ceph-mon[125702]: pgmap v16656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:38:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:04 smithi057 ceph-mon[92072]: pgmap v16656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:38:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:04 smithi122 ceph-mon[125440]: pgmap v16656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:38:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:05 smithi136 ceph-mon[125702]: pgmap v16657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:38:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:05 smithi057 ceph-mon[92072]: pgmap v16657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:38:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:05 smithi122 ceph-mon[125440]: pgmap v16657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:38:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:07 smithi136 ceph-mon[125702]: osdmap e1114: 12 total, 12 up, 12 in 2023-03-02T19:38:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:07 smithi136 ceph-mon[125702]: pgmap v16659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:38:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:07 smithi057 ceph-mon[92072]: osdmap e1114: 12 total, 12 up, 12 in 2023-03-02T19:38:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:07 smithi057 ceph-mon[92072]: pgmap v16659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:38:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:07 smithi122 ceph-mon[125440]: osdmap e1114: 12 total, 12 up, 12 in 2023-03-02T19:38:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:07 smithi122 ceph-mon[125440]: pgmap v16659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:38:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:09 smithi136 ceph-mon[125702]: pgmap v16660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:38:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:09 smithi057 ceph-mon[92072]: pgmap v16660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:38:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:09 smithi122 ceph-mon[125440]: pgmap v16660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:38:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:11 smithi136 ceph-mon[125702]: pgmap v16661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:38:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:11 smithi057 ceph-mon[92072]: pgmap v16661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:38:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:11 smithi122 ceph-mon[125440]: pgmap v16661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:38:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:12.872+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:38:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:12.872+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:38:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:12.872+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 241 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:38:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:12.872+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 240 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:38:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:12.925+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:38:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:12.925+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:38:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:12.925+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:38:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:12.925+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:38:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:12.925+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:38:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:14 smithi136 ceph-mon[125702]: pgmap v16662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:38:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:14 smithi057 ceph-mon[92072]: pgmap v16662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:38:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:14 smithi122 ceph-mon[125440]: pgmap v16662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:38:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:15 smithi136 ceph-mon[125702]: pgmap v16663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:38:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:15 smithi057 ceph-mon[92072]: pgmap v16663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:38:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:15 smithi122 ceph-mon[125440]: pgmap v16663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:38:18.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:17 smithi136 ceph-mon[125702]: pgmap v16664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:38:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:17 smithi057 ceph-mon[92072]: pgmap v16664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:38:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:17 smithi122 ceph-mon[125440]: pgmap v16664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:38:19.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:19 smithi136 ceph-mon[125702]: osdmap e1115: 12 total, 12 up, 12 in 2023-03-02T19:38:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:19 smithi057 ceph-mon[92072]: osdmap e1115: 12 total, 12 up, 12 in 2023-03-02T19:38:19.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:19 smithi122 ceph-mon[125440]: osdmap e1115: 12 total, 12 up, 12 in 2023-03-02T19:38:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:20 smithi136 ceph-mon[125702]: pgmap v16666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:38:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:20 smithi057 ceph-mon[92072]: pgmap v16666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:38:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:20 smithi122 ceph-mon[125440]: pgmap v16666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:38:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:21 smithi136 ceph-mon[125702]: pgmap v16667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:38:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:21 smithi057 ceph-mon[92072]: pgmap v16667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:38:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:21 smithi122 ceph-mon[125440]: pgmap v16667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:38:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:24 smithi136 ceph-mon[125702]: pgmap v16668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:38:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:24 smithi057 ceph-mon[92072]: pgmap v16668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:38:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:24 smithi122 ceph-mon[125440]: pgmap v16668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:38:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:25 smithi136 ceph-mon[125702]: pgmap v16669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:38:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:25 smithi057 ceph-mon[92072]: pgmap v16669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:38:26.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:25 smithi122 ceph-mon[125440]: pgmap v16669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:38:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:27.940+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:38:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:27.941+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:38:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:27.941+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:38:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:27.941+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:38:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:27.941+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:38:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:27 smithi136 ceph-mon[125702]: pgmap v16670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:38:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:27 smithi057 ceph-mon[92072]: pgmap v16670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:38:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:27 smithi122 ceph-mon[125440]: pgmap v16670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:38:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:29 smithi136 ceph-mon[125702]: pgmap v16671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:38:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:29 smithi057 ceph-mon[92072]: pgmap v16671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:38:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:29 smithi122 ceph-mon[125440]: pgmap v16671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:38:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:31 smithi136 ceph-mon[125702]: pgmap v16672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:31 smithi057 ceph-mon[92072]: pgmap v16672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:31 smithi122 ceph-mon[125440]: pgmap v16672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:34 smithi136 ceph-mon[125702]: pgmap v16673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:34 smithi057 ceph-mon[92072]: pgmap v16673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:34 smithi122 ceph-mon[125440]: pgmap v16673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:35 smithi136 ceph-mon[125702]: pgmap v16674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:35 smithi057 ceph-mon[92072]: pgmap v16674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:35 smithi122 ceph-mon[125440]: pgmap v16674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:37 smithi136 ceph-mon[125702]: pgmap v16675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:37 smithi057 ceph-mon[92072]: pgmap v16675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:37 smithi122 ceph-mon[125440]: pgmap v16675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:38:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:38:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:38:40.334 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:40 smithi122 ceph-mon[125440]: pgmap v16676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:40 smithi136 ceph-mon[125702]: pgmap v16676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:40 smithi057 ceph-mon[92072]: pgmap v16676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:42.067 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:41 smithi136 ceph-mon[125702]: pgmap v16677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:42.169 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:41 smithi122 ceph-mon[125440]: pgmap v16677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:41 smithi057 ceph-mon[92072]: pgmap v16677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:42.950+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:38:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:42.951+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:38:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:42.951+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:38:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:42.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:38:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:42.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:38:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:38:43.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:38:43.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:38:43.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:38:43.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:43.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:38:43.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:38:43.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:38:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:44 smithi136 ceph-mon[125702]: pgmap v16678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:44 smithi057 ceph-mon[92072]: pgmap v16678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:44 smithi122 ceph-mon[125440]: pgmap v16678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:45 smithi136 ceph-mon[125702]: pgmap v16679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:45 smithi057 ceph-mon[92072]: pgmap v16679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:45 smithi122 ceph-mon[125440]: pgmap v16679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:47 smithi136 ceph-mon[125702]: pgmap v16680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:47 smithi057 ceph-mon[92072]: pgmap v16680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:47 smithi122 ceph-mon[125440]: pgmap v16680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:49 smithi136 ceph-mon[125702]: pgmap v16681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:49 smithi057 ceph-mon[92072]: pgmap v16681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:49 smithi122 ceph-mon[125440]: pgmap v16681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:51 smithi136 ceph-mon[125702]: pgmap v16682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:51 smithi057 ceph-mon[92072]: pgmap v16682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:51 smithi122 ceph-mon[125440]: pgmap v16682: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:54 smithi136 ceph-mon[125702]: pgmap v16683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:54 smithi057 ceph-mon[92072]: pgmap v16683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:54 smithi122 ceph-mon[125440]: pgmap v16683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:55 smithi136 ceph-mon[125702]: pgmap v16684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:55 smithi057 ceph-mon[92072]: pgmap v16684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:55 smithi122 ceph-mon[125440]: pgmap v16684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:38:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:57.879+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:38:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:57.879+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:38:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:57.879+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 241 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:38:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:57.879+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 242 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:38:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:57.964+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:38:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:57.965+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:38:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:57.965+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:38:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:57.965+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:38:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:38:57.965+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:38:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:57 smithi136 ceph-mon[125702]: pgmap v16685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:57 smithi057 ceph-mon[92072]: pgmap v16685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:38:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:57 smithi122 ceph-mon[125440]: pgmap v16685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:38:59 smithi136 ceph-mon[125702]: pgmap v16686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:38:59 smithi057 ceph-mon[92072]: pgmap v16686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:38:59 smithi122 ceph-mon[125440]: pgmap v16686: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:01 smithi136 ceph-mon[125702]: pgmap v16687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:01 smithi057 ceph-mon[92072]: pgmap v16687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:01 smithi122 ceph-mon[125440]: pgmap v16687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:04 smithi136 ceph-mon[125702]: pgmap v16688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:39:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:04 smithi057 ceph-mon[92072]: pgmap v16688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:39:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:04 smithi122 ceph-mon[125440]: pgmap v16688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:39:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:05 smithi136 ceph-mon[125702]: pgmap v16689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:39:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:05 smithi057 ceph-mon[92072]: pgmap v16689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:39:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:05 smithi122 ceph-mon[125440]: pgmap v16689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:39:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:07 smithi136 ceph-mon[125702]: osdmap e1116: 12 total, 12 up, 12 in 2023-03-02T19:39:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:07 smithi136 ceph-mon[125702]: pgmap v16691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:39:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:07 smithi057 ceph-mon[92072]: osdmap e1116: 12 total, 12 up, 12 in 2023-03-02T19:39:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:07 smithi057 ceph-mon[92072]: pgmap v16691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:39:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:07 smithi122 ceph-mon[125440]: osdmap e1116: 12 total, 12 up, 12 in 2023-03-02T19:39:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:07 smithi122 ceph-mon[125440]: pgmap v16691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:39:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:09 smithi136 ceph-mon[125702]: pgmap v16692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:39:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:09 smithi057 ceph-mon[92072]: pgmap v16692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:39:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:09 smithi122 ceph-mon[125440]: pgmap v16692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:39:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:11 smithi136 ceph-mon[125702]: pgmap v16693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:39:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:11 smithi057 ceph-mon[92072]: pgmap v16693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:39:12.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:11 smithi122 ceph-mon[125440]: pgmap v16693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:39:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:12.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:39:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:12.971+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:39:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:12.971+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:39:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:12.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:39:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:12.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:39:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:14 smithi136 ceph-mon[125702]: pgmap v16694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:39:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:14 smithi057 ceph-mon[92072]: pgmap v16694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:39:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:14 smithi122 ceph-mon[125440]: pgmap v16694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:39:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:15 smithi136 ceph-mon[125702]: pgmap v16695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:39:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:15 smithi057 ceph-mon[92072]: pgmap v16695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:39:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:15 smithi122 ceph-mon[125440]: pgmap v16695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:39:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:17 smithi136 ceph-mon[125702]: pgmap v16696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:39:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:17 smithi057 ceph-mon[92072]: pgmap v16696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:39:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:17 smithi122 ceph-mon[125440]: pgmap v16696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:39:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:19 smithi136 ceph-mon[125702]: osdmap e1117: 12 total, 12 up, 12 in 2023-03-02T19:39:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:19 smithi057 ceph-mon[92072]: osdmap e1117: 12 total, 12 up, 12 in 2023-03-02T19:39:19.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:19 smithi122 ceph-mon[125440]: osdmap e1117: 12 total, 12 up, 12 in 2023-03-02T19:39:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:20 smithi136 ceph-mon[125702]: pgmap v16698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:39:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:20 smithi057 ceph-mon[92072]: pgmap v16698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:39:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:20 smithi122 ceph-mon[125440]: pgmap v16698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:39:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:21 smithi136 ceph-mon[125702]: pgmap v16699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:39:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:21 smithi057 ceph-mon[92072]: pgmap v16699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:39:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:21 smithi122 ceph-mon[125440]: pgmap v16699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:39:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:24 smithi136 ceph-mon[125702]: pgmap v16700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:39:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:24 smithi057 ceph-mon[92072]: pgmap v16700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:39:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:24 smithi122 ceph-mon[125440]: pgmap v16700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:39:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:25 smithi136 ceph-mon[125702]: pgmap v16701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:39:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:25 smithi057 ceph-mon[92072]: pgmap v16701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:39:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:25 smithi122 ceph-mon[125440]: pgmap v16701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:39:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:27.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:39:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:27.987+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:39:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:27.987+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:39:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:27.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:39:27.990 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:27.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:39:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:27 smithi136 ceph-mon[125702]: pgmap v16702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:39:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:27 smithi057 ceph-mon[92072]: pgmap v16702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:39:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:27 smithi122 ceph-mon[125440]: pgmap v16702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:39:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:29 smithi136 ceph-mon[125702]: pgmap v16703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:39:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:29 smithi057 ceph-mon[92072]: pgmap v16703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:39:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:29 smithi122 ceph-mon[125440]: pgmap v16703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:39:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:31 smithi136 ceph-mon[125702]: pgmap v16704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:31 smithi057 ceph-mon[92072]: pgmap v16704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:31 smithi122 ceph-mon[125440]: pgmap v16704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:34 smithi136 ceph-mon[125702]: pgmap v16705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:34 smithi057 ceph-mon[92072]: pgmap v16705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:34 smithi122 ceph-mon[125440]: pgmap v16705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:35 smithi136 ceph-mon[125702]: pgmap v16706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:35 smithi057 ceph-mon[92072]: pgmap v16706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:35 smithi122 ceph-mon[125440]: pgmap v16706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:37 smithi136 ceph-mon[125702]: pgmap v16707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:37 smithi057 ceph-mon[92072]: pgmap v16707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:37 smithi122 ceph-mon[125440]: pgmap v16707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:39 smithi136 ceph-mon[125702]: pgmap v16708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:39 smithi057 ceph-mon[92072]: pgmap v16708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:39 smithi122 ceph-mon[125440]: pgmap v16708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:41 smithi136 ceph-mon[125702]: pgmap v16709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:41 smithi057 ceph-mon[92072]: pgmap v16709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:41 smithi122 ceph-mon[125440]: pgmap v16709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:43.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:39:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:43.003+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:39:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:43.003+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:39:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:43.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:39:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:43.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:39:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:39:43.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:39:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:39:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:39:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:39:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:39:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:44 smithi136 ceph-mon[125702]: pgmap v16710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:39:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:39:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:39:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:44 smithi057 ceph-mon[92072]: pgmap v16710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:39:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:39:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:39:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:44 smithi122 ceph-mon[125440]: pgmap v16710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:45 smithi136 ceph-mon[125702]: pgmap v16711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:45 smithi057 ceph-mon[92072]: pgmap v16711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:45 smithi122 ceph-mon[125440]: pgmap v16711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:47 smithi136 ceph-mon[125702]: pgmap v16712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:47 smithi057 ceph-mon[92072]: pgmap v16712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:47 smithi122 ceph-mon[125440]: pgmap v16712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:49 smithi136 ceph-mon[125702]: pgmap v16713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:49 smithi057 ceph-mon[92072]: pgmap v16713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:49 smithi122 ceph-mon[125440]: pgmap v16713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:51 smithi136 ceph-mon[125702]: pgmap v16714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:51 smithi057 ceph-mon[92072]: pgmap v16714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:51 smithi122 ceph-mon[125440]: pgmap v16714: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:54 smithi136 ceph-mon[125702]: pgmap v16715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:54 smithi057 ceph-mon[92072]: pgmap v16715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:54 smithi122 ceph-mon[125440]: pgmap v16715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:55 smithi136 ceph-mon[125702]: pgmap v16716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:55 smithi057 ceph-mon[92072]: pgmap v16716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:55 smithi122 ceph-mon[125440]: pgmap v16716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:39:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:58.016+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:39:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:58.017+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:39:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:58.017+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:39:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:58.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:39:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:39:58.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:39:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:57 smithi136 ceph-mon[125702]: pgmap v16717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:57 smithi057 ceph-mon[92072]: pgmap v16717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:39:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:57 smithi122 ceph-mon[125440]: pgmap v16717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:40:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:39:59 smithi136 ceph-mon[125702]: pgmap v16718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:39:59 smithi057 ceph-mon[92072]: pgmap v16718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:39:59 smithi122 ceph-mon[125440]: pgmap v16718: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T19:40:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T19:40:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T19:40:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:01 smithi136 ceph-mon[125702]: pgmap v16719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:01 smithi057 ceph-mon[92072]: pgmap v16719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:01 smithi122 ceph-mon[125440]: pgmap v16719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:04 smithi136 ceph-mon[125702]: pgmap v16720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:40:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:04 smithi057 ceph-mon[92072]: pgmap v16720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:40:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:04 smithi122 ceph-mon[125440]: pgmap v16720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:40:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:05 smithi136 ceph-mon[125702]: pgmap v16721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:40:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:05 smithi057 ceph-mon[92072]: pgmap v16721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:40:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:05 smithi122 ceph-mon[125440]: pgmap v16721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:40:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:07 smithi136 ceph-mon[125702]: pgmap v16722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:40:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:07 smithi057 ceph-mon[92072]: pgmap v16722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:40:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:07 smithi122 ceph-mon[125440]: pgmap v16722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:40:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:09 smithi136 ceph-mon[125702]: pgmap v16723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:40:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:09 smithi057 ceph-mon[92072]: pgmap v16723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:40:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:09 smithi122 ceph-mon[125440]: pgmap v16723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:40:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:12 smithi136 ceph-mon[125702]: osdmap e1118: 12 total, 12 up, 12 in 2023-03-02T19:40:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:12 smithi136 ceph-mon[125702]: pgmap v16725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:40:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:12 smithi057 ceph-mon[92072]: osdmap e1118: 12 total, 12 up, 12 in 2023-03-02T19:40:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:12 smithi057 ceph-mon[92072]: pgmap v16725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:40:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:12 smithi122 ceph-mon[125440]: osdmap e1118: 12 total, 12 up, 12 in 2023-03-02T19:40:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:12 smithi122 ceph-mon[125440]: pgmap v16725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:40:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:13.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:40:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:13.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:40:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:13.032+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:40:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:13.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:40:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:13.032+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:40:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:14 smithi136 ceph-mon[125702]: pgmap v16726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:14 smithi057 ceph-mon[92072]: pgmap v16726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:14 smithi122 ceph-mon[125440]: pgmap v16726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:15 smithi136 ceph-mon[125702]: pgmap v16727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:15 smithi057 ceph-mon[92072]: pgmap v16727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:15 smithi122 ceph-mon[125440]: pgmap v16727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:17 smithi136 ceph-mon[125702]: pgmap v16728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:40:18.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:17 smithi057 ceph-mon[92072]: pgmap v16728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:40:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:17 smithi122 ceph-mon[125440]: pgmap v16728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:40:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:19 smithi136 ceph-mon[125702]: osdmap e1119: 12 total, 12 up, 12 in 2023-03-02T19:40:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:19 smithi057 ceph-mon[92072]: osdmap e1119: 12 total, 12 up, 12 in 2023-03-02T19:40:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:19 smithi122 ceph-mon[125440]: osdmap e1119: 12 total, 12 up, 12 in 2023-03-02T19:40:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:20 smithi136 ceph-mon[125702]: pgmap v16730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 355 B/s wr, 12 op/s 2023-03-02T19:40:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:20 smithi057 ceph-mon[92072]: pgmap v16730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 355 B/s wr, 12 op/s 2023-03-02T19:40:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:20 smithi122 ceph-mon[125440]: pgmap v16730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 355 B/s wr, 12 op/s 2023-03-02T19:40:22.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:21 smithi136 ceph-mon[125702]: pgmap v16731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:40:22.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:21 smithi057 ceph-mon[92072]: pgmap v16731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:40:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:21 smithi122 ceph-mon[125440]: pgmap v16731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:40:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:24 smithi136 ceph-mon[125702]: pgmap v16732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:24 smithi057 ceph-mon[92072]: pgmap v16732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:24 smithi122 ceph-mon[125440]: pgmap v16732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:25 smithi136 ceph-mon[125702]: pgmap v16733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:25 smithi057 ceph-mon[92072]: pgmap v16733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:25 smithi122 ceph-mon[125440]: pgmap v16733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:40:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:28.046+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:40:28.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:28.047+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:40:28.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:28.047+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:40:28.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:28.047+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:40:28.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:28.047+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:40:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:27 smithi136 ceph-mon[125702]: pgmap v16734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:40:28.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:27 smithi057 ceph-mon[92072]: pgmap v16734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:40:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:27 smithi122 ceph-mon[125440]: pgmap v16734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:40:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:29 smithi136 ceph-mon[125702]: pgmap v16735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:40:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:29 smithi057 ceph-mon[92072]: pgmap v16735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:40:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:29 smithi122 ceph-mon[125440]: pgmap v16735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:40:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:31 smithi136 ceph-mon[125702]: pgmap v16736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2023-03-02T19:40:32.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:31 smithi057 ceph-mon[92072]: pgmap v16736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2023-03-02T19:40:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:31 smithi122 ceph-mon[125440]: pgmap v16736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2023-03-02T19:40:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:34 smithi136 ceph-mon[125702]: pgmap v16737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T19:40:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:34 smithi057 ceph-mon[92072]: pgmap v16737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T19:40:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:34 smithi122 ceph-mon[125440]: pgmap v16737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T19:40:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:35 smithi136 ceph-mon[125702]: pgmap v16738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:40:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:35 smithi057 ceph-mon[92072]: pgmap v16738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:40:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:35 smithi122 ceph-mon[125440]: pgmap v16738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:40:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:37 smithi136 ceph-mon[125702]: pgmap v16739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:40:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:37 smithi057 ceph-mon[92072]: pgmap v16739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:40:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:37 smithi122 ceph-mon[125440]: pgmap v16739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:40:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:39 smithi136 ceph-mon[125702]: pgmap v16740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:40:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:39 smithi057 ceph-mon[92072]: pgmap v16740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:40:40.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:39 smithi122 ceph-mon[125440]: pgmap v16740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:40:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:41 smithi136 ceph-mon[125702]: pgmap v16741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2023-03-02T19:40:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:41 smithi057 ceph-mon[92072]: pgmap v16741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2023-03-02T19:40:42.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:41 smithi122 ceph-mon[125440]: pgmap v16741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2023-03-02T19:40:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:43.063+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:40:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:43.063+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:40:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:43.063+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:40:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:43.063+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:40:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:43.063+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:40:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:40:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:44 smithi136 ceph-mon[125702]: pgmap v16742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-02T19:40:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:40:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:44 smithi057 ceph-mon[92072]: pgmap v16742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-02T19:40:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:40:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:44 smithi122 ceph-mon[125440]: pgmap v16742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-02T19:40:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:40:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:40:45.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:40:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:40:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:45.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:40:45.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:40:45.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:40:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:46 smithi136 ceph-mon[125702]: pgmap v16743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:46 smithi057 ceph-mon[92072]: pgmap v16743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:46 smithi122 ceph-mon[125440]: pgmap v16743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:47 smithi136 ceph-mon[125702]: pgmap v16744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:40:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:47 smithi057 ceph-mon[92072]: pgmap v16744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:40:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:47 smithi122 ceph-mon[125440]: pgmap v16744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:40:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:49 smithi136 ceph-mon[125702]: pgmap v16745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:49 smithi057 ceph-mon[92072]: pgmap v16745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:49 smithi122 ceph-mon[125440]: pgmap v16745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:51 smithi136 ceph-mon[125702]: pgmap v16746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-02T19:40:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:51 smithi057 ceph-mon[92072]: pgmap v16746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-02T19:40:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:51 smithi122 ceph-mon[125440]: pgmap v16746: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-02T19:40:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:54 smithi136 ceph-mon[125702]: pgmap v16747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-02T19:40:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:54 smithi057 ceph-mon[92072]: pgmap v16747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-02T19:40:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:54 smithi122 ceph-mon[125440]: pgmap v16747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-02T19:40:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:55 smithi136 ceph-mon[125702]: pgmap v16748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:55 smithi057 ceph-mon[92072]: pgmap v16748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:55 smithi122 ceph-mon[125440]: pgmap v16748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:40:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:58.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:40:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:58.079+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:40:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:58.079+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:40:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:58.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:40:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:40:58.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:40:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:57 smithi136 ceph-mon[125702]: pgmap v16749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:40:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:57 smithi057 ceph-mon[92072]: pgmap v16749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:40:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:57 smithi122 ceph-mon[125440]: pgmap v16749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:41:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:40:59 smithi136 ceph-mon[125702]: pgmap v16750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:40:59 smithi057 ceph-mon[92072]: pgmap v16750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:40:59 smithi122 ceph-mon[125440]: pgmap v16750: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:01 smithi136 ceph-mon[125702]: pgmap v16751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T19:41:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:01 smithi057 ceph-mon[92072]: pgmap v16751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T19:41:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:01 smithi122 ceph-mon[125440]: pgmap v16751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T19:41:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:04 smithi136 ceph-mon[125702]: pgmap v16752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T19:41:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:04 smithi057 ceph-mon[92072]: pgmap v16752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T19:41:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:04 smithi122 ceph-mon[125440]: pgmap v16752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T19:41:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:05 smithi136 ceph-mon[125702]: pgmap v16753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:41:06.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:05 smithi057 ceph-mon[92072]: pgmap v16753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:41:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:05 smithi122 ceph-mon[125440]: pgmap v16753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:41:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:07 smithi136 ceph-mon[125702]: osdmap e1120: 12 total, 12 up, 12 in 2023-03-02T19:41:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:07 smithi136 ceph-mon[125702]: pgmap v16755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:41:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:07 smithi057 ceph-mon[92072]: osdmap e1120: 12 total, 12 up, 12 in 2023-03-02T19:41:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:07 smithi057 ceph-mon[92072]: pgmap v16755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:41:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:07 smithi122 ceph-mon[125440]: osdmap e1120: 12 total, 12 up, 12 in 2023-03-02T19:41:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:07 smithi122 ceph-mon[125440]: pgmap v16755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:41:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:09 smithi136 ceph-mon[125702]: pgmap v16756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:41:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:09 smithi057 ceph-mon[92072]: pgmap v16756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:41:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:09 smithi122 ceph-mon[125440]: pgmap v16756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:41:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:11 smithi136 ceph-mon[125702]: pgmap v16757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:41:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:11 smithi057 ceph-mon[92072]: pgmap v16757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:41:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:11 smithi122 ceph-mon[125440]: pgmap v16757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:41:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:12.899+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:41:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:12.899+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:41:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:12.900+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 243 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:41:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:12.900+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 242 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:41:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:13.095+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:41:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:13.095+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:41:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:13.095+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:41:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:13.095+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:41:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:13.095+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:41:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:14 smithi136 ceph-mon[125702]: pgmap v16758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:41:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:14 smithi057 ceph-mon[92072]: pgmap v16758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:41:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:14 smithi122 ceph-mon[125440]: pgmap v16758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:41:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:15 smithi136 ceph-mon[125702]: pgmap v16759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:41:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:15 smithi057 ceph-mon[92072]: pgmap v16759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:41:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:15 smithi122 ceph-mon[125440]: pgmap v16759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:41:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:17 smithi136 ceph-mon[125702]: pgmap v16760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:41:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:17 smithi057 ceph-mon[92072]: pgmap v16760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:41:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:17 smithi122 ceph-mon[125440]: pgmap v16760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 187 B/s wr, 10 op/s 2023-03-02T19:41:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:19 smithi136 ceph-mon[125702]: osdmap e1121: 12 total, 12 up, 12 in 2023-03-02T19:41:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:19 smithi057 ceph-mon[92072]: osdmap e1121: 12 total, 12 up, 12 in 2023-03-02T19:41:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:19 smithi122 ceph-mon[125440]: osdmap e1121: 12 total, 12 up, 12 in 2023-03-02T19:41:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:20 smithi136 ceph-mon[125702]: pgmap v16762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:41:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:20 smithi057 ceph-mon[92072]: pgmap v16762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:41:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:20 smithi122 ceph-mon[125440]: pgmap v16762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:41:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:21 smithi136 ceph-mon[125702]: pgmap v16763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:41:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:21 smithi057 ceph-mon[92072]: pgmap v16763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:41:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:21 smithi122 ceph-mon[125440]: pgmap v16763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:41:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:24 smithi136 ceph-mon[125702]: pgmap v16764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:24 smithi057 ceph-mon[92072]: pgmap v16764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:24 smithi122 ceph-mon[125440]: pgmap v16764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:25 smithi136 ceph-mon[125702]: pgmap v16765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:25 smithi057 ceph-mon[92072]: pgmap v16765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:25 smithi122 ceph-mon[125440]: pgmap v16765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:27 smithi136 ceph-mon[125702]: pgmap v16766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:28.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:28.106+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:41:28.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:28.106+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:41:28.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:28.106+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:41:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:28.106+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:41:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:28.106+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:41:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:27 smithi057 ceph-mon[92072]: pgmap v16766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:27 smithi122 ceph-mon[125440]: pgmap v16766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:29 smithi136 ceph-mon[125702]: pgmap v16767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:41:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:29 smithi057 ceph-mon[92072]: pgmap v16767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:41:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:29 smithi122 ceph-mon[125440]: pgmap v16767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T19:41:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:31 smithi136 ceph-mon[125702]: pgmap v16768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-02T19:41:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:31 smithi057 ceph-mon[92072]: pgmap v16768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-02T19:41:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:31 smithi122 ceph-mon[125440]: pgmap v16768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-02T19:41:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:34 smithi136 ceph-mon[125702]: pgmap v16769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:34 smithi057 ceph-mon[92072]: pgmap v16769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:34 smithi122 ceph-mon[125440]: pgmap v16769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:35 smithi136 ceph-mon[125702]: pgmap v16770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:35 smithi057 ceph-mon[92072]: pgmap v16770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:35 smithi122 ceph-mon[125440]: pgmap v16770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:37 smithi136 ceph-mon[125702]: pgmap v16771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:41:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:37 smithi057 ceph-mon[92072]: pgmap v16771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:41:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:37 smithi122 ceph-mon[125440]: pgmap v16771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:41:40.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:39 smithi136 ceph-mon[125702]: pgmap v16772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:39 smithi057 ceph-mon[92072]: pgmap v16772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:39 smithi122 ceph-mon[125440]: pgmap v16772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:41 smithi136 ceph-mon[125702]: pgmap v16773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T19:41:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:41 smithi057 ceph-mon[92072]: pgmap v16773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T19:41:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:41 smithi122 ceph-mon[125440]: pgmap v16773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T19:41:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:43.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:41:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:43.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:41:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:43.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:41:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:43.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:41:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:43.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:41:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:44 smithi136 ceph-mon[125702]: pgmap v16774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:44 smithi057 ceph-mon[92072]: pgmap v16774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:44 smithi122 ceph-mon[125440]: pgmap v16774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:41:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:41:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:41:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:41:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:46 smithi136 ceph-mon[125702]: pgmap v16775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:46 smithi057 ceph-mon[92072]: pgmap v16775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:46 smithi122 ceph-mon[125440]: pgmap v16775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:47 smithi136 ceph-mon[125702]: pgmap v16776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:41:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:47 smithi057 ceph-mon[92072]: pgmap v16776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:41:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:47 smithi122 ceph-mon[125440]: pgmap v16776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:41:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:41:49.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:41:49.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:41:49.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:41:49.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:41:49.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:41:49.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:41:49.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:41:49.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:49.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.208 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.209 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.209 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:41:49.209 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:41:49.209 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:41:49.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:41:49.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:41:49.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:41:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:49 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:41:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:49 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:41:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:49 smithi057 ceph-mon[92072]: pgmap v16777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:49 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:41:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:49 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:41:50.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:49 smithi122 ceph-mon[125440]: pgmap v16777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:49 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:41:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:49 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:41:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:49 smithi136 ceph-mon[125702]: pgmap v16777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:51 smithi136 ceph-mon[125702]: pgmap v16778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T19:41:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:51 smithi057 ceph-mon[92072]: pgmap v16778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T19:41:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:51 smithi122 ceph-mon[125440]: pgmap v16778: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T19:41:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:54 smithi136 ceph-mon[125702]: pgmap v16779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T19:41:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:54 smithi057 ceph-mon[92072]: pgmap v16779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T19:41:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:54 smithi122 ceph-mon[125440]: pgmap v16779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T19:41:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:55 smithi136 ceph-mon[125702]: pgmap v16780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:55 smithi057 ceph-mon[92072]: pgmap v16780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:55 smithi122 ceph-mon[125440]: pgmap v16780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:41:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:57 smithi136 ceph-mon[125702]: pgmap v16781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:41:58.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:58.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:41:58.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:58.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:41:58.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:58.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:41:58.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:58.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:41:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:41:58.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:41:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:57 smithi057 ceph-mon[92072]: pgmap v16781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:41:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:57 smithi122 ceph-mon[125440]: pgmap v16781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:41:59 smithi136 ceph-mon[125702]: pgmap v16782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:41:59 smithi057 ceph-mon[92072]: pgmap v16782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:41:59 smithi122 ceph-mon[125440]: pgmap v16782: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:01 smithi136 ceph-mon[125702]: pgmap v16783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:42:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:01 smithi057 ceph-mon[92072]: pgmap v16783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:42:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:01 smithi122 ceph-mon[125440]: pgmap v16783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T19:42:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:04 smithi136 ceph-mon[125702]: pgmap v16784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T19:42:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:04 smithi057 ceph-mon[92072]: pgmap v16784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T19:42:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:04 smithi122 ceph-mon[125440]: pgmap v16784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T19:42:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:05 smithi136 ceph-mon[125702]: pgmap v16785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:42:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:05 smithi057 ceph-mon[92072]: pgmap v16785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:42:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:05 smithi122 ceph-mon[125440]: pgmap v16785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:42:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:07 smithi136 ceph-mon[125702]: osdmap e1122: 12 total, 12 up, 12 in 2023-03-02T19:42:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:07 smithi136 ceph-mon[125702]: pgmap v16787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:42:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:07 smithi057 ceph-mon[92072]: osdmap e1122: 12 total, 12 up, 12 in 2023-03-02T19:42:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:07 smithi057 ceph-mon[92072]: pgmap v16787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:42:08.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:07 smithi122 ceph-mon[125440]: osdmap e1122: 12 total, 12 up, 12 in 2023-03-02T19:42:08.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:07 smithi122 ceph-mon[125440]: pgmap v16787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:42:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:09 smithi136 ceph-mon[125702]: pgmap v16788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:42:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:09 smithi057 ceph-mon[92072]: pgmap v16788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:42:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:09 smithi122 ceph-mon[125440]: pgmap v16788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:42:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:11 smithi136 ceph-mon[125702]: pgmap v16789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:42:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:11 smithi057 ceph-mon[92072]: pgmap v16789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:42:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:11 smithi122 ceph-mon[125440]: pgmap v16789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:42:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:13.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:42:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:13.140+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:42:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:13.140+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:42:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:13.140+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:42:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:13.140+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:42:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:14 smithi136 ceph-mon[125702]: osdmap e1123: 12 total, 12 up, 12 in 2023-03-02T19:42:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:14 smithi057 ceph-mon[92072]: osdmap e1123: 12 total, 12 up, 12 in 2023-03-02T19:42:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:14 smithi122 ceph-mon[125440]: osdmap e1123: 12 total, 12 up, 12 in 2023-03-02T19:42:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:15 smithi136 ceph-mon[125702]: pgmap v16791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:42:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:15 smithi057 ceph-mon[92072]: pgmap v16791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:42:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:15 smithi122 ceph-mon[125440]: pgmap v16791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:42:17.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:17 smithi136 ceph-mon[125702]: pgmap v16792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 114 B/s wr, 5 op/s 2023-03-02T19:42:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:17 smithi057 ceph-mon[92072]: pgmap v16792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 114 B/s wr, 5 op/s 2023-03-02T19:42:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:17 smithi122 ceph-mon[125440]: pgmap v16792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 114 B/s wr, 5 op/s 2023-03-02T19:42:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:19 smithi057 ceph-mon[92072]: pgmap v16793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:42:19.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:19 smithi122 ceph-mon[125440]: pgmap v16793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:42:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:19 smithi136 ceph-mon[125702]: pgmap v16793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:42:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:21 smithi057 ceph-mon[92072]: pgmap v16794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:42:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:21 smithi122 ceph-mon[125440]: pgmap v16794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:42:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:21 smithi136 ceph-mon[125702]: pgmap v16794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:42:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:23 smithi057 ceph-mon[92072]: pgmap v16795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:42:23.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:23 smithi122 ceph-mon[125440]: pgmap v16795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:42:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:23 smithi136 ceph-mon[125702]: pgmap v16795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:42:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:25 smithi057 ceph-mon[92072]: pgmap v16796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:42:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:25 smithi122 ceph-mon[125440]: pgmap v16796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:42:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:25 smithi136 ceph-mon[125702]: pgmap v16796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:42:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:27 smithi057 ceph-mon[92072]: pgmap v16797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:27 smithi122 ceph-mon[125440]: pgmap v16797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:27 smithi136 ceph-mon[125702]: pgmap v16797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:28.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:42:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:28.155+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:42:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:28.155+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:42:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:28.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:42:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:28.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:42:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:29 smithi057 ceph-mon[92072]: pgmap v16798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:42:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:29 smithi122 ceph-mon[125440]: pgmap v16798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:42:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:29 smithi136 ceph-mon[125702]: pgmap v16798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:42:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:31 smithi057 ceph-mon[92072]: pgmap v16799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:31 smithi122 ceph-mon[125440]: pgmap v16799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:31 smithi136 ceph-mon[125702]: pgmap v16799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:33 smithi057 ceph-mon[92072]: pgmap v16800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:33 smithi122 ceph-mon[125440]: pgmap v16800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:33 smithi136 ceph-mon[125702]: pgmap v16800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:35 smithi057 ceph-mon[92072]: pgmap v16801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:35 smithi122 ceph-mon[125440]: pgmap v16801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:35.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:35 smithi136 ceph-mon[125702]: pgmap v16801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:37 smithi057 ceph-mon[92072]: pgmap v16802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:37.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:37 smithi122 ceph-mon[125440]: pgmap v16802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:37 smithi136 ceph-mon[125702]: pgmap v16802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:39 smithi057 ceph-mon[92072]: pgmap v16803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:39 smithi122 ceph-mon[125440]: pgmap v16803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:39 smithi136 ceph-mon[125702]: pgmap v16803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:41 smithi057 ceph-mon[92072]: pgmap v16804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:41 smithi122 ceph-mon[125440]: pgmap v16804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:41 smithi136 ceph-mon[125702]: pgmap v16804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:43.165+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:42:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:43.166+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:42:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:43.166+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:42:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:43.166+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:42:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:43.166+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:42:43.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:43 smithi057 ceph-mon[92072]: pgmap v16805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:43 smithi122 ceph-mon[125440]: pgmap v16805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:43 smithi136 ceph-mon[125702]: pgmap v16805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:45 smithi057 ceph-mon[92072]: pgmap v16806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:45 smithi122 ceph-mon[125440]: pgmap v16806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:45 smithi136 ceph-mon[125702]: pgmap v16806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:47 smithi057 ceph-mon[92072]: pgmap v16807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:47.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:47 smithi122 ceph-mon[125440]: pgmap v16807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:47 smithi136 ceph-mon[125702]: pgmap v16807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:49 smithi057 ceph-mon[92072]: pgmap v16808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:42:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:49 smithi122 ceph-mon[125440]: pgmap v16808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:42:49.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:49 smithi136 ceph-mon[125702]: pgmap v16808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:49.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:42:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:42:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:42:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:42:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:42:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:42:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:42:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:42:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:42:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:42:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:51 smithi122 ceph-mon[125440]: pgmap v16809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:52.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:51 smithi136 ceph-mon[125702]: pgmap v16809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:51 smithi057 ceph-mon[92072]: pgmap v16809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:53 smithi122 ceph-mon[125440]: pgmap v16810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:53 smithi136 ceph-mon[125702]: pgmap v16810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:53 smithi057 ceph-mon[92072]: pgmap v16810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:42:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:55 smithi136 ceph-mon[125702]: pgmap v16811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:55 smithi057 ceph-mon[92072]: pgmap v16811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:55 smithi122 ceph-mon[125440]: pgmap v16811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:57 smithi136 ceph-mon[125702]: pgmap v16812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:57 smithi057 ceph-mon[92072]: pgmap v16812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:42:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:58.182+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:42:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:58.182+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:42:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:58.182+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:42:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:58.182+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:42:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:42:58.182+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:42:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:57 smithi122 ceph-mon[125440]: pgmap v16812: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:42:59 smithi136 ceph-mon[125702]: pgmap v16813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:42:59 smithi057 ceph-mon[92072]: pgmap v16813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:42:59 smithi122 ceph-mon[125440]: pgmap v16813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:01 smithi136 ceph-mon[125702]: pgmap v16814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:01 smithi057 ceph-mon[92072]: pgmap v16814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:01 smithi122 ceph-mon[125440]: pgmap v16814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:03 smithi136 ceph-mon[125702]: pgmap v16815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:43:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:03 smithi057 ceph-mon[92072]: pgmap v16815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:43:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:03 smithi122 ceph-mon[125440]: pgmap v16815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:43:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:05 smithi136 ceph-mon[125702]: pgmap v16816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:43:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:05 smithi057 ceph-mon[92072]: pgmap v16816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:43:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:05 smithi122 ceph-mon[125440]: pgmap v16816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:43:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:07 smithi136 ceph-mon[125702]: pgmap v16817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:43:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:07 smithi136 ceph-mon[125702]: osdmap e1124: 12 total, 12 up, 12 in 2023-03-02T19:43:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:07 smithi057 ceph-mon[92072]: pgmap v16817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:43:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:07 smithi057 ceph-mon[92072]: osdmap e1124: 12 total, 12 up, 12 in 2023-03-02T19:43:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:07 smithi122 ceph-mon[125440]: pgmap v16817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:43:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:07 smithi122 ceph-mon[125440]: osdmap e1124: 12 total, 12 up, 12 in 2023-03-02T19:43:10.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:09 smithi136 ceph-mon[125702]: pgmap v16819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:43:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:09 smithi057 ceph-mon[92072]: pgmap v16819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:43:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:09 smithi122 ceph-mon[125440]: pgmap v16819: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:43:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:10 smithi136 ceph-mon[125702]: pgmap v16820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:43:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:10 smithi057 ceph-mon[92072]: pgmap v16820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:43:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:10 smithi122 ceph-mon[125440]: pgmap v16820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:43:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:12 smithi136 ceph-mon[125702]: pgmap v16821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:43:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:12 smithi057 ceph-mon[92072]: pgmap v16821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:43:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:13.190+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:43:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:13.190+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:43:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:13.190+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:43:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:13.190+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:43:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:13.190+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:43:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:12 smithi122 ceph-mon[125440]: pgmap v16821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:43:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:14 smithi057 ceph-mon[92072]: osdmap e1125: 12 total, 12 up, 12 in 2023-03-02T19:43:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:14 smithi122 ceph-mon[125440]: osdmap e1125: 12 total, 12 up, 12 in 2023-03-02T19:43:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:14 smithi136 ceph-mon[125702]: osdmap e1125: 12 total, 12 up, 12 in 2023-03-02T19:43:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:15 smithi057 ceph-mon[92072]: pgmap v16823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:43:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:15 smithi122 ceph-mon[125440]: pgmap v16823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:43:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:15 smithi136 ceph-mon[125702]: pgmap v16823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:43:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:17 smithi057 ceph-mon[92072]: pgmap v16824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 113 B/s wr, 5 op/s 2023-03-02T19:43:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:17 smithi122 ceph-mon[125440]: pgmap v16824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 113 B/s wr, 5 op/s 2023-03-02T19:43:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:17 smithi136 ceph-mon[125702]: pgmap v16824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 113 B/s wr, 5 op/s 2023-03-02T19:43:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:19 smithi057 ceph-mon[92072]: pgmap v16825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:43:19.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:19 smithi122 ceph-mon[125440]: pgmap v16825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:43:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:19 smithi136 ceph-mon[125702]: pgmap v16825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:43:21.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:21 smithi057 ceph-mon[92072]: pgmap v16826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:43:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:21 smithi122 ceph-mon[125440]: pgmap v16826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:43:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:21 smithi136 ceph-mon[125702]: pgmap v16826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:43:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:23 smithi057 ceph-mon[92072]: pgmap v16827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:43:23.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:23 smithi122 ceph-mon[125440]: pgmap v16827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:43:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:23 smithi136 ceph-mon[125702]: pgmap v16827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:43:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:25 smithi057 ceph-mon[92072]: pgmap v16828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:43:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:25 smithi122 ceph-mon[125440]: pgmap v16828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:43:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:25 smithi136 ceph-mon[125702]: pgmap v16828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:43:27.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:27 smithi057 ceph-mon[92072]: pgmap v16829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:27 smithi122 ceph-mon[125440]: pgmap v16829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:27 smithi136 ceph-mon[125702]: pgmap v16829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:28.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:43:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:28.197+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:43:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:28.197+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:43:28.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:28.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:43:28.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:28.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:43:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:29 smithi057 ceph-mon[92072]: pgmap v16830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:43:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:29 smithi122 ceph-mon[125440]: pgmap v16830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:43:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:29 smithi136 ceph-mon[125702]: pgmap v16830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:43:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:31 smithi057 ceph-mon[92072]: pgmap v16831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:31 smithi122 ceph-mon[125440]: pgmap v16831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:31 smithi136 ceph-mon[125702]: pgmap v16831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:33 smithi057 ceph-mon[92072]: pgmap v16832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:33 smithi122 ceph-mon[125440]: pgmap v16832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:33 smithi136 ceph-mon[125702]: pgmap v16832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:35 smithi057 ceph-mon[92072]: pgmap v16833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:35 smithi122 ceph-mon[125440]: pgmap v16833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:35 smithi136 ceph-mon[125702]: pgmap v16833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:37 smithi057 ceph-mon[92072]: pgmap v16834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:37 smithi122 ceph-mon[125440]: pgmap v16834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:37 smithi136 ceph-mon[125702]: pgmap v16834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:39 smithi057 ceph-mon[92072]: pgmap v16835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:39 smithi122 ceph-mon[125440]: pgmap v16835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:39 smithi136 ceph-mon[125702]: pgmap v16835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:41 smithi057 ceph-mon[92072]: pgmap v16836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:41 smithi122 ceph-mon[125440]: pgmap v16836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:41 smithi136 ceph-mon[125702]: pgmap v16836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:43.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:43:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:43.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:43:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:43.200+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:43:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:43.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:43:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:43.200+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:43:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:43 smithi057 ceph-mon[92072]: pgmap v16837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:43 smithi122 ceph-mon[125440]: pgmap v16837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:43 smithi136 ceph-mon[125702]: pgmap v16837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:45 smithi057 ceph-mon[92072]: pgmap v16838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:45.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:45 smithi122 ceph-mon[125440]: pgmap v16838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:45 smithi136 ceph-mon[125702]: pgmap v16838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:47 smithi057 ceph-mon[92072]: pgmap v16839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:47.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:47 smithi122 ceph-mon[125440]: pgmap v16839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:47 smithi136 ceph-mon[125702]: pgmap v16839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:49 smithi057 ceph-mon[92072]: pgmap v16840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:49 smithi122 ceph-mon[125440]: pgmap v16840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:49 smithi136 ceph-mon[125702]: pgmap v16840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:43:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:43:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:43:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:51 smithi057 ceph-mon[92072]: pgmap v16841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:43:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:43:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:43:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:43:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:43:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:51 smithi122 ceph-mon[125440]: pgmap v16841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:43:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:43:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:43:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:43:51.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:43:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:51 smithi136 ceph-mon[125702]: pgmap v16841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:43:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:43:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:43:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:43:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:43:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:53 smithi057 ceph-mon[92072]: pgmap v16842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:53 smithi122 ceph-mon[125440]: pgmap v16842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:53.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:53 smithi136 ceph-mon[125702]: pgmap v16842: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:55 smithi057 ceph-mon[92072]: pgmap v16843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:55 smithi122 ceph-mon[125440]: pgmap v16843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:55 smithi136 ceph-mon[125702]: pgmap v16843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:57 smithi057 ceph-mon[92072]: pgmap v16844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:57.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:57 smithi122 ceph-mon[125440]: pgmap v16844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:57 smithi136 ceph-mon[125702]: pgmap v16844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:43:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:58.211+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:43:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:58.212+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:43:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:58.212+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:43:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:58.212+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:43:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:43:58.212+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:43:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:43:59 smithi057 ceph-mon[92072]: pgmap v16845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:43:59 smithi122 ceph-mon[125440]: pgmap v16845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:43:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:43:59 smithi136 ceph-mon[125702]: pgmap v16845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:01 smithi057 ceph-mon[92072]: pgmap v16846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:01 smithi122 ceph-mon[125440]: pgmap v16846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:01 smithi136 ceph-mon[125702]: pgmap v16846: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:03 smithi057 ceph-mon[92072]: pgmap v16847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:44:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:03 smithi122 ceph-mon[125440]: pgmap v16847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:44:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:03 smithi136 ceph-mon[125702]: pgmap v16847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:44:05.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:05 smithi057 ceph-mon[92072]: pgmap v16848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:44:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:05 smithi122 ceph-mon[125440]: pgmap v16848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:44:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:05 smithi136 ceph-mon[125702]: pgmap v16848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:44:07.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:07 smithi057 ceph-mon[92072]: pgmap v16849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:44:07.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:07 smithi057 ceph-mon[92072]: osdmap e1126: 12 total, 12 up, 12 in 2023-03-02T19:44:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:07 smithi122 ceph-mon[125440]: pgmap v16849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:44:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:07 smithi122 ceph-mon[125440]: osdmap e1126: 12 total, 12 up, 12 in 2023-03-02T19:44:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:07 smithi136 ceph-mon[125702]: pgmap v16849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:44:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:07 smithi136 ceph-mon[125702]: osdmap e1126: 12 total, 12 up, 12 in 2023-03-02T19:44:08.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:08.425+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T19:44:08.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:08.425+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T19:44:08.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:08.425+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5850005b30 tx=0x7f5870063000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:44:08.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:08.425+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5850005b30 tx=0x7f5870063000 comp rx=0 tx=0).stop 2023-03-02T19:44:08.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:08.425+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T19:44:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:08.425+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T19:44:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:08.425+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T19:44:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:08.425+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T19:44:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:08.425+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:44:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:08.426+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870096000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T19:44:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:09 smithi057 ceph-mon[92072]: pgmap v16851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:44:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:09 smithi122 ceph-mon[125440]: pgmap v16851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:44:09.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:09 smithi136 ceph-mon[125702]: pgmap v16851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:44:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:11 smithi057 ceph-mon[92072]: pgmap v16852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:44:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:11 smithi122 ceph-mon[125440]: pgmap v16852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:44:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:11 smithi136 ceph-mon[125702]: pgmap v16852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:44:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:12.925+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:44:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:12.925+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:44:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:12.925+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 244 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:44:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:12.925+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 243 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:44:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:13.227+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:44:13.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:13.227+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:44:13.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:13.227+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:44:13.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:13.227+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:44:13.229 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:13.227+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:44:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:13 smithi057 ceph-mon[92072]: pgmap v16853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:44:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:13 smithi057 ceph-mon[92072]: osdmap e1127: 12 total, 12 up, 12 in 2023-03-02T19:44:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:13 smithi122 ceph-mon[125440]: pgmap v16853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:44:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:13 smithi122 ceph-mon[125440]: osdmap e1127: 12 total, 12 up, 12 in 2023-03-02T19:44:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:13 smithi136 ceph-mon[125702]: pgmap v16853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:44:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:13 smithi136 ceph-mon[125702]: osdmap e1127: 12 total, 12 up, 12 in 2023-03-02T19:44:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:15 smithi057 ceph-mon[92072]: pgmap v16855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:44:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:15 smithi122 ceph-mon[125440]: pgmap v16855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:44:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:15 smithi136 ceph-mon[125702]: pgmap v16855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:44:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:17 smithi122 ceph-mon[125440]: pgmap v16856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-02T19:44:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:17 smithi136 ceph-mon[125702]: pgmap v16856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-02T19:44:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:17 smithi057 ceph-mon[92072]: pgmap v16856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-02T19:44:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:19 smithi122 ceph-mon[125440]: pgmap v16857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:44:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:19 smithi136 ceph-mon[125702]: pgmap v16857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:44:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:19 smithi057 ceph-mon[92072]: pgmap v16857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:44:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:21 smithi136 ceph-mon[125702]: pgmap v16858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:44:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:21 smithi057 ceph-mon[92072]: pgmap v16858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:44:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:21 smithi122 ceph-mon[125440]: pgmap v16858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:44:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:23 smithi136 ceph-mon[125702]: pgmap v16859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:44:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:23 smithi057 ceph-mon[92072]: pgmap v16859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:44:23.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:23 smithi122 ceph-mon[125440]: pgmap v16859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:44:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:25 smithi136 ceph-mon[125702]: pgmap v16860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:44:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:25 smithi057 ceph-mon[92072]: pgmap v16860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:44:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:25 smithi122 ceph-mon[125440]: pgmap v16860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:44:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:27 smithi136 ceph-mon[125702]: pgmap v16861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:27 smithi057 ceph-mon[92072]: pgmap v16861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:27 smithi122 ceph-mon[125440]: pgmap v16861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:28.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:28.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:44:28.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:28.236+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:44:28.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:28.236+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:44:28.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:28.236+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:44:28.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:28.236+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:44:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:29 smithi136 ceph-mon[125702]: pgmap v16862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:29 smithi057 ceph-mon[92072]: pgmap v16862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:29 smithi122 ceph-mon[125440]: pgmap v16862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:31 smithi136 ceph-mon[125702]: pgmap v16863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:31 smithi057 ceph-mon[92072]: pgmap v16863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:31 smithi122 ceph-mon[125440]: pgmap v16863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:33 smithi136 ceph-mon[125702]: pgmap v16864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:33 smithi057 ceph-mon[92072]: pgmap v16864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:33 smithi122 ceph-mon[125440]: pgmap v16864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:35 smithi136 ceph-mon[125702]: pgmap v16865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:35 smithi057 ceph-mon[92072]: pgmap v16865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:35.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:35 smithi122 ceph-mon[125440]: pgmap v16865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:37 smithi136 ceph-mon[125702]: pgmap v16866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:37 smithi057 ceph-mon[92072]: pgmap v16866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:37 smithi122 ceph-mon[125440]: pgmap v16866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:39 smithi136 ceph-mon[125702]: pgmap v16867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:39 smithi057 ceph-mon[92072]: pgmap v16867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:39.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:39 smithi122 ceph-mon[125440]: pgmap v16867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:41 smithi136 ceph-mon[125702]: pgmap v16868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:41 smithi057 ceph-mon[92072]: pgmap v16868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:41 smithi122 ceph-mon[125440]: pgmap v16868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:43.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:43.246+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:44:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:43.246+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:44:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:43.246+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:44:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:43.246+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:44:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:43.246+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:44:43.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:43 smithi136 ceph-mon[125702]: pgmap v16869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:43 smithi057 ceph-mon[92072]: pgmap v16869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:43 smithi122 ceph-mon[125440]: pgmap v16869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:45.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:45 smithi136 ceph-mon[125702]: pgmap v16870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:45 smithi057 ceph-mon[92072]: pgmap v16870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:45 smithi122 ceph-mon[125440]: pgmap v16870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:47.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:47 smithi136 ceph-mon[125702]: pgmap v16871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:47 smithi057 ceph-mon[92072]: pgmap v16871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:47 smithi122 ceph-mon[125440]: pgmap v16871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:49 smithi136 ceph-mon[125702]: pgmap v16872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:49 smithi057 ceph-mon[92072]: pgmap v16872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:49 smithi122 ceph-mon[125440]: pgmap v16872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:51.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:51 smithi136 ceph-mon[125702]: pgmap v16873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:51.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:44:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:51 smithi057 ceph-mon[92072]: pgmap v16873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:44:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:51 smithi122 ceph-mon[125440]: pgmap v16873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:44:53.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:44:53.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:44:53.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:44:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:44:53.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:53.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:44:53.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:44:53.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:44:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:53 smithi136 ceph-mon[125702]: pgmap v16874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:53 smithi057 ceph-mon[92072]: pgmap v16874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:53 smithi122 ceph-mon[125440]: pgmap v16874: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:44:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:55 smithi136 ceph-mon[125702]: pgmap v16875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:55 smithi057 ceph-mon[92072]: pgmap v16875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:55 smithi122 ceph-mon[125440]: pgmap v16875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:57 smithi136 ceph-mon[125702]: pgmap v16876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:57 smithi057 ceph-mon[92072]: pgmap v16876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:58.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:57 smithi122 ceph-mon[125440]: pgmap v16876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:44:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:58.256+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:44:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:58.256+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:44:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:58.256+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:44:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:58.256+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:44:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:44:58.256+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:45:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:44:59 smithi136 ceph-mon[125702]: pgmap v16877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:44:59 smithi057 ceph-mon[92072]: pgmap v16877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:44:59 smithi122 ceph-mon[125440]: pgmap v16877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:01 smithi136 ceph-mon[125702]: pgmap v16878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:01 smithi057 ceph-mon[92072]: pgmap v16878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:01 smithi122 ceph-mon[125440]: pgmap v16878: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:03 smithi136 ceph-mon[125702]: pgmap v16879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:45:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:03 smithi057 ceph-mon[92072]: pgmap v16879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:45:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:03 smithi122 ceph-mon[125440]: pgmap v16879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:45:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:04 smithi136 ceph-mon[125702]: pgmap v16880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:45:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:04 smithi057 ceph-mon[92072]: pgmap v16880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:45:05.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:04 smithi122 ceph-mon[125440]: pgmap v16880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:45:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:06 smithi057 ceph-mon[92072]: pgmap v16881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:45:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:06 smithi122 ceph-mon[125440]: pgmap v16881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:45:07.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:06 smithi136 ceph-mon[125702]: pgmap v16881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:45:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:07 smithi057 ceph-mon[92072]: osdmap e1128: 12 total, 12 up, 12 in 2023-03-02T19:45:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:07 smithi122 ceph-mon[125440]: osdmap e1128: 12 total, 12 up, 12 in 2023-03-02T19:45:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:07 smithi136 ceph-mon[125702]: osdmap e1128: 12 total, 12 up, 12 in 2023-03-02T19:45:09.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:09 smithi057 ceph-mon[92072]: pgmap v16883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:45:09.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:09 smithi122 ceph-mon[125440]: pgmap v16883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:45:09.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:09 smithi136 ceph-mon[125702]: pgmap v16883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:45:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:11 smithi057 ceph-mon[92072]: pgmap v16884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:45:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:11 smithi122 ceph-mon[125440]: pgmap v16884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:45:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:11 smithi136 ceph-mon[125702]: pgmap v16884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:45:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:13.271+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:45:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:13.272+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:45:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:13.272+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:45:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:13.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:45:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:13.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:45:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:13 smithi057 ceph-mon[92072]: pgmap v16885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:45:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:13 smithi057 ceph-mon[92072]: osdmap e1129: 12 total, 12 up, 12 in 2023-03-02T19:45:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:13 smithi122 ceph-mon[125440]: pgmap v16885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:45:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:13 smithi122 ceph-mon[125440]: osdmap e1129: 12 total, 12 up, 12 in 2023-03-02T19:45:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:13 smithi136 ceph-mon[125702]: pgmap v16885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:45:13.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:13 smithi136 ceph-mon[125702]: osdmap e1129: 12 total, 12 up, 12 in 2023-03-02T19:45:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:15 smithi057 ceph-mon[92072]: pgmap v16887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:45:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:15 smithi122 ceph-mon[125440]: pgmap v16887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:45:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:15 smithi136 ceph-mon[125702]: pgmap v16887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:45:17.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:17 smithi057 ceph-mon[92072]: pgmap v16888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 114 B/s wr, 5 op/s 2023-03-02T19:45:17.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:17 smithi122 ceph-mon[125440]: pgmap v16888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 114 B/s wr, 5 op/s 2023-03-02T19:45:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:17 smithi136 ceph-mon[125702]: pgmap v16888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 114 B/s wr, 5 op/s 2023-03-02T19:45:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:19 smithi057 ceph-mon[92072]: pgmap v16889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:45:19.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:19 smithi122 ceph-mon[125440]: pgmap v16889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:45:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:19 smithi136 ceph-mon[125702]: pgmap v16889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:45:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:21 smithi057 ceph-mon[92072]: pgmap v16890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:45:21.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:21 smithi122 ceph-mon[125440]: pgmap v16890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:45:21.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:21 smithi136 ceph-mon[125702]: pgmap v16890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:45:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:23 smithi057 ceph-mon[92072]: pgmap v16891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:45:23.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:23 smithi122 ceph-mon[125440]: pgmap v16891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:45:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:23 smithi136 ceph-mon[125702]: pgmap v16891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:45:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:25 smithi057 ceph-mon[92072]: pgmap v16892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:45:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:25 smithi122 ceph-mon[125440]: pgmap v16892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:45:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:25 smithi136 ceph-mon[125702]: pgmap v16892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:45:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:27 smithi057 ceph-mon[92072]: pgmap v16893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:27 smithi122 ceph-mon[125440]: pgmap v16893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:27 smithi136 ceph-mon[125702]: pgmap v16893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:28.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:45:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:28.287+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:45:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:28.287+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:45:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:28.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:45:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:28.287+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:45:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:29 smithi057 ceph-mon[92072]: pgmap v16894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:29 smithi122 ceph-mon[125440]: pgmap v16894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:29 smithi136 ceph-mon[125702]: pgmap v16894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:31 smithi057 ceph-mon[92072]: pgmap v16895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:31 smithi122 ceph-mon[125440]: pgmap v16895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:31 smithi136 ceph-mon[125702]: pgmap v16895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:33 smithi057 ceph-mon[92072]: pgmap v16896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:33.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:33 smithi122 ceph-mon[125440]: pgmap v16896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:33 smithi136 ceph-mon[125702]: pgmap v16896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:35 smithi122 ceph-mon[125440]: pgmap v16897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:35 smithi136 ceph-mon[125702]: pgmap v16897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:35 smithi057 ceph-mon[92072]: pgmap v16897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:37 smithi122 ceph-mon[125440]: pgmap v16898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:37.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:37 smithi136 ceph-mon[125702]: pgmap v16898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:37.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:37 smithi057 ceph-mon[92072]: pgmap v16898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:39 smithi122 ceph-mon[125440]: pgmap v16899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:39 smithi136 ceph-mon[125702]: pgmap v16899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:39 smithi057 ceph-mon[92072]: pgmap v16899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:41 smithi122 ceph-mon[125440]: pgmap v16900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:41 smithi136 ceph-mon[125702]: pgmap v16900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:41 smithi057 ceph-mon[92072]: pgmap v16900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:43.300+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:45:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:43.300+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:45:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:43.300+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:45:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:43.300+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:45:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:43.300+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:45:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:43 smithi122 ceph-mon[125440]: pgmap v16901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:43 smithi136 ceph-mon[125702]: pgmap v16901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:43 smithi057 ceph-mon[92072]: pgmap v16901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:45 smithi136 ceph-mon[125702]: pgmap v16902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:45 smithi057 ceph-mon[92072]: pgmap v16902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:45.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:45 smithi122 ceph-mon[125440]: pgmap v16902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:47 smithi136 ceph-mon[125702]: pgmap v16903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:47 smithi057 ceph-mon[92072]: pgmap v16903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:47 smithi122 ceph-mon[125440]: pgmap v16903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:49.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:49 smithi136 ceph-mon[125702]: pgmap v16904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:49 smithi057 ceph-mon[92072]: pgmap v16904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:49 smithi122 ceph-mon[125440]: pgmap v16904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:51 smithi136 ceph-mon[125702]: pgmap v16905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:51 smithi057 ceph-mon[92072]: pgmap v16905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:51 smithi122 ceph-mon[125440]: pgmap v16905: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:53 smithi136 ceph-mon[125702]: pgmap v16906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:45:53.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:53 smithi057 ceph-mon[92072]: pgmap v16906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:53.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:45:53.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:53 smithi122 ceph-mon[125440]: pgmap v16906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:53.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:45:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:45:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:45:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:45:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:45:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:45:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:45:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:45:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:45:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:45:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:55 smithi122 ceph-mon[125440]: pgmap v16907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:55 smithi136 ceph-mon[125702]: pgmap v16907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:55 smithi057 ceph-mon[92072]: pgmap v16907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:57 smithi122 ceph-mon[125440]: pgmap v16908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:57 smithi136 ceph-mon[125702]: pgmap v16908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:57 smithi057 ceph-mon[92072]: pgmap v16908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:45:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:58.315+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:45:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:58.315+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:45:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:58.315+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:45:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:58.315+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:45:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:45:58.315+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:45:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:45:59 smithi136 ceph-mon[125702]: pgmap v16909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:45:59 smithi057 ceph-mon[92072]: pgmap v16909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:45:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:45:59 smithi122 ceph-mon[125440]: pgmap v16909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:01 smithi136 ceph-mon[125702]: pgmap v16910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:01 smithi057 ceph-mon[92072]: pgmap v16910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:01 smithi122 ceph-mon[125440]: pgmap v16910: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:03.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:03 smithi136 ceph-mon[125702]: pgmap v16911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:46:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:03 smithi057 ceph-mon[92072]: pgmap v16911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:46:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:03 smithi122 ceph-mon[125440]: pgmap v16911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:46:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:05 smithi136 ceph-mon[125702]: pgmap v16912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:46:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:05 smithi057 ceph-mon[92072]: pgmap v16912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:46:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:05 smithi122 ceph-mon[125440]: pgmap v16912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:46:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:07 smithi136 ceph-mon[125702]: pgmap v16913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:46:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:07 smithi136 ceph-mon[125702]: osdmap e1130: 12 total, 12 up, 12 in 2023-03-02T19:46:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:07 smithi057 ceph-mon[92072]: pgmap v16913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:46:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:07 smithi057 ceph-mon[92072]: osdmap e1130: 12 total, 12 up, 12 in 2023-03-02T19:46:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:07 smithi122 ceph-mon[125440]: pgmap v16913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:46:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:07 smithi122 ceph-mon[125440]: osdmap e1130: 12 total, 12 up, 12 in 2023-03-02T19:46:09.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:09 smithi136 ceph-mon[125702]: pgmap v16915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:46:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:09 smithi057 ceph-mon[92072]: pgmap v16915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:46:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:09 smithi122 ceph-mon[125440]: pgmap v16915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:46:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:11 smithi136 ceph-mon[125702]: pgmap v16916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:46:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:11 smithi057 ceph-mon[92072]: pgmap v16916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:46:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:11 smithi122 ceph-mon[125440]: pgmap v16916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:46:13.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:13.324+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:46:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:13.325+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:46:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:13.325+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:46:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:13.325+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:46:13.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:13.325+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:46:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:13 smithi136 ceph-mon[125702]: pgmap v16917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:46:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:13 smithi136 ceph-mon[125702]: osdmap e1131: 12 total, 12 up, 12 in 2023-03-02T19:46:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:13 smithi057 ceph-mon[92072]: pgmap v16917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:46:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:13 smithi057 ceph-mon[92072]: osdmap e1131: 12 total, 12 up, 12 in 2023-03-02T19:46:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:13 smithi122 ceph-mon[125440]: pgmap v16917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:46:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:13 smithi122 ceph-mon[125440]: osdmap e1131: 12 total, 12 up, 12 in 2023-03-02T19:46:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:15 smithi136 ceph-mon[125702]: pgmap v16919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:46:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:15 smithi057 ceph-mon[92072]: pgmap v16919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:46:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:15 smithi122 ceph-mon[125440]: pgmap v16919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:46:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:17 smithi136 ceph-mon[125702]: pgmap v16920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T19:46:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:17 smithi057 ceph-mon[92072]: pgmap v16920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T19:46:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:17 smithi122 ceph-mon[125440]: pgmap v16920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-02T19:46:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:19 smithi136 ceph-mon[125702]: pgmap v16921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:46:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:19 smithi057 ceph-mon[92072]: pgmap v16921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:46:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:19 smithi122 ceph-mon[125440]: pgmap v16921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:46:21.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:21 smithi136 ceph-mon[125702]: pgmap v16922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:46:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:21 smithi057 ceph-mon[92072]: pgmap v16922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:46:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:21 smithi122 ceph-mon[125440]: pgmap v16922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:46:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:23 smithi136 ceph-mon[125702]: pgmap v16923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:46:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:23 smithi057 ceph-mon[92072]: pgmap v16923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:46:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:23 smithi122 ceph-mon[125440]: pgmap v16923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:46:25.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:25 smithi136 ceph-mon[125702]: pgmap v16924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:46:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:25 smithi057 ceph-mon[92072]: pgmap v16924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:46:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:25 smithi122 ceph-mon[125440]: pgmap v16924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:46:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:27 smithi136 ceph-mon[125702]: pgmap v16925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:27 smithi057 ceph-mon[92072]: pgmap v16925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:27.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:27 smithi122 ceph-mon[125440]: pgmap v16925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:28.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:28.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:46:28.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:28.340+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:46:28.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:28.340+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:46:28.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:28.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:46:28.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:28.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:46:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:29 smithi136 ceph-mon[125702]: pgmap v16926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:29 smithi057 ceph-mon[92072]: pgmap v16926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:29 smithi122 ceph-mon[125440]: pgmap v16926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:31 smithi136 ceph-mon[125702]: pgmap v16927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:31 smithi057 ceph-mon[92072]: pgmap v16927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:31 smithi122 ceph-mon[125440]: pgmap v16927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:33 smithi136 ceph-mon[125702]: pgmap v16928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:33 smithi057 ceph-mon[92072]: pgmap v16928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:33 smithi122 ceph-mon[125440]: pgmap v16928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:35 smithi136 ceph-mon[125702]: pgmap v16929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:35 smithi057 ceph-mon[92072]: pgmap v16929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:35 smithi122 ceph-mon[125440]: pgmap v16929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:37.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:37 smithi136 ceph-mon[125702]: pgmap v16930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:37 smithi057 ceph-mon[92072]: pgmap v16930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:37.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:37 smithi122 ceph-mon[125440]: pgmap v16930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:39.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:39 smithi136 ceph-mon[125702]: pgmap v16931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:39 smithi057 ceph-mon[92072]: pgmap v16931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:39 smithi122 ceph-mon[125440]: pgmap v16931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:41 smithi136 ceph-mon[125702]: pgmap v16932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:41 smithi057 ceph-mon[92072]: pgmap v16932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:41 smithi122 ceph-mon[125440]: pgmap v16932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:43.355+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:46:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:43.355+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:46:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:43.355+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:46:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:43.355+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:46:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:43.355+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:46:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:43 smithi057 ceph-mon[92072]: pgmap v16933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:43 smithi122 ceph-mon[125440]: pgmap v16933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:43 smithi136 ceph-mon[125702]: pgmap v16933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:45 smithi057 ceph-mon[92072]: pgmap v16934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:45 smithi122 ceph-mon[125440]: pgmap v16934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:45 smithi136 ceph-mon[125702]: pgmap v16934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:47 smithi057 ceph-mon[92072]: pgmap v16935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:47 smithi122 ceph-mon[125440]: pgmap v16935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:47 smithi136 ceph-mon[125702]: pgmap v16935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:49 smithi057 ceph-mon[92072]: pgmap v16936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:49 smithi122 ceph-mon[125440]: pgmap v16936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:49 smithi136 ceph-mon[125702]: pgmap v16936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:51 smithi057 ceph-mon[92072]: pgmap v16937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:51 smithi122 ceph-mon[125440]: pgmap v16937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:51 smithi136 ceph-mon[125702]: pgmap v16937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:53 smithi057 ceph-mon[92072]: pgmap v16938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:46:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:53 smithi122 ceph-mon[125440]: pgmap v16938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:46:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:53 smithi136 ceph-mon[125702]: pgmap v16938: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:46:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:46:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:46:54.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:46:54.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:46:54.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:46:54.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:46:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:46:55.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:46:55.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:46:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:55 smithi057 ceph-mon[92072]: pgmap v16939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:55 smithi122 ceph-mon[125440]: pgmap v16939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:55 smithi136 ceph-mon[125702]: pgmap v16939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:57 smithi057 ceph-mon[92072]: pgmap v16940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:57.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:57 smithi122 ceph-mon[125440]: pgmap v16940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:57 smithi136 ceph-mon[125702]: pgmap v16940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:46:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:58.359+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:46:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:58.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:46:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:58.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:46:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:58.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:46:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:46:58.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:46:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:46:59 smithi057 ceph-mon[92072]: pgmap v16941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:46:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:46:59 smithi122 ceph-mon[125440]: pgmap v16941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:46:59 smithi136 ceph-mon[125702]: pgmap v16941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:01 smithi057 ceph-mon[92072]: pgmap v16942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:01 smithi122 ceph-mon[125440]: pgmap v16942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:01 smithi136 ceph-mon[125702]: pgmap v16942: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:03.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:03 smithi057 ceph-mon[92072]: pgmap v16943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:47:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:03 smithi122 ceph-mon[125440]: pgmap v16943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:47:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:03 smithi136 ceph-mon[125702]: pgmap v16943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:47:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:05 smithi057 ceph-mon[92072]: pgmap v16944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:47:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:05 smithi122 ceph-mon[125440]: pgmap v16944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:47:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:05 smithi136 ceph-mon[125702]: pgmap v16944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:47:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:07 smithi057 ceph-mon[92072]: pgmap v16945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:47:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:07 smithi122 ceph-mon[125440]: pgmap v16945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:47:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:07 smithi136 ceph-mon[125702]: pgmap v16945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:47:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:09 smithi057 ceph-mon[92072]: pgmap v16946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:47:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:09 smithi122 ceph-mon[125440]: pgmap v16946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:47:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:09 smithi136 ceph-mon[125702]: pgmap v16946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:47:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:11 smithi057 ceph-mon[92072]: pgmap v16947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:47:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:11 smithi122 ceph-mon[125440]: pgmap v16947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:47:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:11 smithi136 ceph-mon[125702]: pgmap v16947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:47:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:12 smithi057 ceph-mon[92072]: osdmap e1132: 12 total, 12 up, 12 in 2023-03-02T19:47:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:12 smithi122 ceph-mon[125440]: osdmap e1132: 12 total, 12 up, 12 in 2023-03-02T19:47:12.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:12.950+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:47:12.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:12.950+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:47:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:12.951+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 245 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T19:47:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:12.951+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:47:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:12.951+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 244 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T19:47:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:12.951+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:47:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:12.951+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 246 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:47:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:12.951+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 245 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:47:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:12 smithi136 ceph-mon[125702]: osdmap e1132: 12 total, 12 up, 12 in 2023-03-02T19:47:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:13.370+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:47:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:13.371+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:47:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:13.371+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:47:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:13.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:47:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:13.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:47:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:13 smithi057 ceph-mon[92072]: pgmap v16949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:13 smithi122 ceph-mon[125440]: pgmap v16949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:14.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:13 smithi136 ceph-mon[125702]: pgmap v16949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:15 smithi122 ceph-mon[125440]: pgmap v16950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:15 smithi136 ceph-mon[125702]: pgmap v16950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:16.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:15 smithi057 ceph-mon[92072]: pgmap v16950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:17 smithi122 ceph-mon[125440]: pgmap v16951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:17 smithi136 ceph-mon[125702]: pgmap v16951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:17 smithi057 ceph-mon[92072]: pgmap v16951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:19 smithi122 ceph-mon[125440]: pgmap v16952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:47:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:19 smithi136 ceph-mon[125702]: pgmap v16952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:47:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:19 smithi057 ceph-mon[92072]: pgmap v16952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:47:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:21 smithi136 ceph-mon[125702]: pgmap v16953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:47:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:21 smithi057 ceph-mon[92072]: pgmap v16953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:47:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:21 smithi122 ceph-mon[125440]: pgmap v16953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:47:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:23 smithi136 ceph-mon[125702]: pgmap v16954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 201 B/s wr, 12 op/s 2023-03-02T19:47:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:23 smithi136 ceph-mon[125702]: osdmap e1133: 12 total, 12 up, 12 in 2023-03-02T19:47:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:23 smithi057 ceph-mon[92072]: pgmap v16954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 201 B/s wr, 12 op/s 2023-03-02T19:47:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:23 smithi057 ceph-mon[92072]: osdmap e1133: 12 total, 12 up, 12 in 2023-03-02T19:47:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:23 smithi122 ceph-mon[125440]: pgmap v16954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 201 B/s wr, 12 op/s 2023-03-02T19:47:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:23 smithi122 ceph-mon[125440]: osdmap e1133: 12 total, 12 up, 12 in 2023-03-02T19:47:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:25 smithi136 ceph-mon[125702]: pgmap v16956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:25 smithi057 ceph-mon[92072]: pgmap v16956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:25 smithi122 ceph-mon[125440]: pgmap v16956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:27 smithi136 ceph-mon[125702]: pgmap v16957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:27 smithi057 ceph-mon[92072]: pgmap v16957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:28.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:27 smithi122 ceph-mon[125440]: pgmap v16957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:47:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:28.386+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:47:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:28.387+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:47:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:28.387+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:47:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:28.387+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:47:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:28.387+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:47:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:29 smithi136 ceph-mon[125702]: pgmap v16958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:47:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:29 smithi057 ceph-mon[92072]: pgmap v16958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:47:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:29 smithi122 ceph-mon[125440]: pgmap v16958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:47:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:31 smithi136 ceph-mon[125702]: pgmap v16959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:47:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:31 smithi057 ceph-mon[92072]: pgmap v16959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:47:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:31 smithi122 ceph-mon[125440]: pgmap v16959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:47:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:33 smithi136 ceph-mon[125702]: pgmap v16960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:47:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:33 smithi057 ceph-mon[92072]: pgmap v16960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:47:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:33 smithi122 ceph-mon[125440]: pgmap v16960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:47:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:35 smithi136 ceph-mon[125702]: pgmap v16961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:47:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:35 smithi057 ceph-mon[92072]: pgmap v16961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:47:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:35 smithi122 ceph-mon[125440]: pgmap v16961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:47:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:37 smithi136 ceph-mon[125702]: pgmap v16962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:37 smithi057 ceph-mon[92072]: pgmap v16962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:37 smithi122 ceph-mon[125440]: pgmap v16962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:39 smithi136 ceph-mon[125702]: pgmap v16963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:39 smithi057 ceph-mon[92072]: pgmap v16963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:39 smithi122 ceph-mon[125440]: pgmap v16963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:41 smithi136 ceph-mon[125702]: pgmap v16964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:41 smithi057 ceph-mon[92072]: pgmap v16964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:42.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:41 smithi122 ceph-mon[125440]: pgmap v16964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:43.402+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:47:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:43.403+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:47:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:43.403+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:47:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:43.403+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:47:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:43.403+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:47:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:43 smithi136 ceph-mon[125702]: pgmap v16965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:43 smithi057 ceph-mon[92072]: pgmap v16965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:43 smithi122 ceph-mon[125440]: pgmap v16965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:45 smithi136 ceph-mon[125702]: pgmap v16966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:45 smithi057 ceph-mon[92072]: pgmap v16966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:45 smithi122 ceph-mon[125440]: pgmap v16966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:47 smithi136 ceph-mon[125702]: pgmap v16967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:47 smithi057 ceph-mon[92072]: pgmap v16967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:47 smithi122 ceph-mon[125440]: pgmap v16967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:49 smithi136 ceph-mon[125702]: pgmap v16968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:49 smithi057 ceph-mon[92072]: pgmap v16968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:49 smithi122 ceph-mon[125440]: pgmap v16968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:51 smithi136 ceph-mon[125702]: pgmap v16969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:51 smithi057 ceph-mon[92072]: pgmap v16969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:51 smithi122 ceph-mon[125440]: pgmap v16969: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:53 smithi136 ceph-mon[125702]: pgmap v16970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:53 smithi057 ceph-mon[92072]: pgmap v16970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:53 smithi122 ceph-mon[125440]: pgmap v16970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:47:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:47:55.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:47:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:55 smithi136 ceph-mon[125702]: pgmap v16971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:47:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:47:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:47:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:55 smithi057 ceph-mon[92072]: pgmap v16971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:47:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:47:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:47:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:55 smithi122 ceph-mon[125440]: pgmap v16971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:47:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:47:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:47:57.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:56 smithi136 ceph-mon[125702]: pgmap v16972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:57.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:56 smithi057 ceph-mon[92072]: pgmap v16972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:57.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:56 smithi122 ceph-mon[125440]: pgmap v16972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:47:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:58.416+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:47:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:58.417+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:47:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:58.417+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:47:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:58.417+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:47:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:47:58.417+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:47:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:47:59 smithi122 ceph-mon[125440]: pgmap v16973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:47:59 smithi136 ceph-mon[125702]: pgmap v16973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:47:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:47:59 smithi057 ceph-mon[92072]: pgmap v16973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:01.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:01 smithi122 ceph-mon[125440]: pgmap v16974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:01.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:01 smithi136 ceph-mon[125702]: pgmap v16974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:01 smithi057 ceph-mon[92072]: pgmap v16974: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:03.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:03 smithi122 ceph-mon[125440]: pgmap v16975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:48:03.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:03 smithi136 ceph-mon[125702]: pgmap v16975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:48:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:03 smithi057 ceph-mon[92072]: pgmap v16975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:48:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:05 smithi136 ceph-mon[125702]: pgmap v16976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:48:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:05 smithi057 ceph-mon[92072]: pgmap v16976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:48:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:05 smithi122 ceph-mon[125440]: pgmap v16976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:48:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:07 smithi136 ceph-mon[125702]: pgmap v16977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:48:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:07 smithi136 ceph-mon[125702]: osdmap e1134: 12 total, 12 up, 12 in 2023-03-02T19:48:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:07 smithi057 ceph-mon[92072]: pgmap v16977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:48:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:07 smithi057 ceph-mon[92072]: osdmap e1134: 12 total, 12 up, 12 in 2023-03-02T19:48:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:07 smithi122 ceph-mon[125440]: pgmap v16977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:48:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:07 smithi122 ceph-mon[125440]: osdmap e1134: 12 total, 12 up, 12 in 2023-03-02T19:48:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:09 smithi136 ceph-mon[125702]: pgmap v16979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:48:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:09 smithi057 ceph-mon[92072]: pgmap v16979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:48:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:09 smithi122 ceph-mon[125440]: pgmap v16979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:48:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:11 smithi136 ceph-mon[125702]: pgmap v16980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:48:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:11 smithi057 ceph-mon[92072]: pgmap v16980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:48:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:11 smithi122 ceph-mon[125440]: pgmap v16980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:48:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:13.432+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:48:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:13.432+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:48:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:13.432+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:48:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:13.432+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:48:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:13.432+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:48:13.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:13 smithi136 ceph-mon[125702]: pgmap v16981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:48:13.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:13 smithi136 ceph-mon[125702]: osdmap e1135: 12 total, 12 up, 12 in 2023-03-02T19:48:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:13 smithi057 ceph-mon[92072]: pgmap v16981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:48:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:13 smithi057 ceph-mon[92072]: osdmap e1135: 12 total, 12 up, 12 in 2023-03-02T19:48:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:13 smithi122 ceph-mon[125440]: pgmap v16981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:48:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:13 smithi122 ceph-mon[125440]: osdmap e1135: 12 total, 12 up, 12 in 2023-03-02T19:48:15.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:15 smithi136 ceph-mon[125702]: pgmap v16983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:48:15.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:15 smithi057 ceph-mon[92072]: pgmap v16983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:48:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:15 smithi122 ceph-mon[125440]: pgmap v16983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:48:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:17 smithi136 ceph-mon[125702]: pgmap v16984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T19:48:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:17 smithi057 ceph-mon[92072]: pgmap v16984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T19:48:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:17 smithi122 ceph-mon[125440]: pgmap v16984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-02T19:48:19.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:19 smithi136 ceph-mon[125702]: pgmap v16985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:48:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:19 smithi057 ceph-mon[92072]: pgmap v16985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:48:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:19 smithi122 ceph-mon[125440]: pgmap v16985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:48:21.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:21 smithi136 ceph-mon[125702]: pgmap v16986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:48:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:21 smithi057 ceph-mon[92072]: pgmap v16986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:48:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:21 smithi122 ceph-mon[125440]: pgmap v16986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:48:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:23 smithi136 ceph-mon[125702]: pgmap v16987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:48:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:23 smithi057 ceph-mon[92072]: pgmap v16987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:48:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:23 smithi122 ceph-mon[125440]: pgmap v16987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:48:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:25 smithi136 ceph-mon[125702]: pgmap v16988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:48:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:25 smithi057 ceph-mon[92072]: pgmap v16988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:48:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:25 smithi122 ceph-mon[125440]: pgmap v16988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:48:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:27 smithi136 ceph-mon[125702]: pgmap v16989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:27 smithi057 ceph-mon[92072]: pgmap v16989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:27 smithi122 ceph-mon[125440]: pgmap v16989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:28.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:28.437+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:48:28.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:28.438+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:48:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:28.438+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:48:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:28.438+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:48:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:28.438+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:48:29.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:29 smithi136 ceph-mon[125702]: pgmap v16990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:29 smithi057 ceph-mon[92072]: pgmap v16990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:29 smithi122 ceph-mon[125440]: pgmap v16990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:31 smithi136 ceph-mon[125702]: pgmap v16991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:31 smithi057 ceph-mon[92072]: pgmap v16991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:31 smithi122 ceph-mon[125440]: pgmap v16991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:33.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:33 smithi136 ceph-mon[125702]: pgmap v16992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:33 smithi057 ceph-mon[92072]: pgmap v16992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:33 smithi122 ceph-mon[125440]: pgmap v16992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:35.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:35 smithi136 ceph-mon[125702]: pgmap v16993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:35 smithi057 ceph-mon[92072]: pgmap v16993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:35 smithi122 ceph-mon[125440]: pgmap v16993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:37 smithi136 ceph-mon[125702]: pgmap v16994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:37.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:37 smithi057 ceph-mon[92072]: pgmap v16994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:37 smithi122 ceph-mon[125440]: pgmap v16994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:39 smithi136 ceph-mon[125702]: pgmap v16995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:39 smithi057 ceph-mon[92072]: pgmap v16995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:39.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:39 smithi122 ceph-mon[125440]: pgmap v16995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:41 smithi136 ceph-mon[125702]: pgmap v16996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:41 smithi057 ceph-mon[92072]: pgmap v16996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:41 smithi122 ceph-mon[125440]: pgmap v16996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:43.449+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:48:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:43.449+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:48:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:43.449+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:48:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:43.449+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:48:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:43.449+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:48:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:43 smithi136 ceph-mon[125702]: pgmap v16997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:43 smithi057 ceph-mon[92072]: pgmap v16997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:43 smithi122 ceph-mon[125440]: pgmap v16997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:45.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:45 smithi136 ceph-mon[125702]: pgmap v16998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:45 smithi057 ceph-mon[92072]: pgmap v16998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:45 smithi122 ceph-mon[125440]: pgmap v16998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:47 smithi136 ceph-mon[125702]: pgmap v16999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:47 smithi057 ceph-mon[92072]: pgmap v16999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:47 smithi122 ceph-mon[125440]: pgmap v16999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:49.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:49 smithi136 ceph-mon[125702]: pgmap v17000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:49 smithi057 ceph-mon[92072]: pgmap v17000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:49 smithi122 ceph-mon[125440]: pgmap v17000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:51 smithi136 ceph-mon[125702]: pgmap v17001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:51 smithi057 ceph-mon[92072]: pgmap v17001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:51 smithi122 ceph-mon[125440]: pgmap v17001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:53.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:53 smithi136 ceph-mon[125702]: pgmap v17002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:53 smithi057 ceph-mon[92072]: pgmap v17002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:53 smithi122 ceph-mon[125440]: pgmap v17002: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:55.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:55 smithi136 ceph-mon[125702]: pgmap v17003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:55.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:48:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:55 smithi057 ceph-mon[92072]: pgmap v17003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:55.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:48:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:55 smithi122 ceph-mon[125440]: pgmap v17003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:48:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:48:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:48:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:48:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:48:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:48:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:48:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:48:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:48:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:48:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:57 smithi057 ceph-mon[92072]: pgmap v17004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:57.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:57 smithi122 ceph-mon[125440]: pgmap v17004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:57 smithi136 ceph-mon[125702]: pgmap v17004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:48:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:58.452+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:48:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:58.452+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:48:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:58.452+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:48:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:58.452+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:48:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:48:58.452+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:48:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:48:59 smithi057 ceph-mon[92072]: pgmap v17005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:48:59 smithi122 ceph-mon[125440]: pgmap v17005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:48:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:48:59 smithi136 ceph-mon[125702]: pgmap v17005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:01 smithi057 ceph-mon[92072]: pgmap v17006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:01 smithi122 ceph-mon[125440]: pgmap v17006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:01 smithi136 ceph-mon[125702]: pgmap v17006: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:03 smithi057 ceph-mon[92072]: pgmap v17007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:49:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:03 smithi122 ceph-mon[125440]: pgmap v17007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:49:03.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:03 smithi136 ceph-mon[125702]: pgmap v17007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:49:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:05 smithi057 ceph-mon[92072]: pgmap v17008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:49:05.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:05 smithi122 ceph-mon[125440]: pgmap v17008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:49:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:05 smithi136 ceph-mon[125702]: pgmap v17008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:49:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:07 smithi057 ceph-mon[92072]: pgmap v17009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:49:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:07 smithi057 ceph-mon[92072]: osdmap e1136: 12 total, 12 up, 12 in 2023-03-02T19:49:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:07 smithi122 ceph-mon[125440]: pgmap v17009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:49:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:07 smithi122 ceph-mon[125440]: osdmap e1136: 12 total, 12 up, 12 in 2023-03-02T19:49:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:07 smithi136 ceph-mon[125702]: pgmap v17009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:49:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:07 smithi136 ceph-mon[125702]: osdmap e1136: 12 total, 12 up, 12 in 2023-03-02T19:49:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:09 smithi057 ceph-mon[92072]: pgmap v17011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:49:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:09 smithi122 ceph-mon[125440]: pgmap v17011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:49:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:09 smithi136 ceph-mon[125702]: pgmap v17011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:49:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:11 smithi057 ceph-mon[92072]: pgmap v17012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:49:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:11 smithi122 ceph-mon[125440]: pgmap v17012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:49:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:11 smithi136 ceph-mon[125702]: pgmap v17012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:49:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:13.466+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:49:13.469 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:13.466+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:49:13.469 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:13.466+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:49:13.469 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:13.466+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:49:13.469 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:13.466+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:49:13.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:13 smithi057 ceph-mon[92072]: pgmap v17013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:49:13.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:13 smithi057 ceph-mon[92072]: osdmap e1137: 12 total, 12 up, 12 in 2023-03-02T19:49:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:13 smithi122 ceph-mon[125440]: pgmap v17013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:49:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:13 smithi122 ceph-mon[125440]: osdmap e1137: 12 total, 12 up, 12 in 2023-03-02T19:49:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:13 smithi136 ceph-mon[125702]: pgmap v17013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:49:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:13 smithi136 ceph-mon[125702]: osdmap e1137: 12 total, 12 up, 12 in 2023-03-02T19:49:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:15 smithi057 ceph-mon[92072]: pgmap v17015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:49:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:15 smithi122 ceph-mon[125440]: pgmap v17015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:49:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:15 smithi136 ceph-mon[125702]: pgmap v17015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:49:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:17 smithi057 ceph-mon[92072]: pgmap v17016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T19:49:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:17 smithi122 ceph-mon[125440]: pgmap v17016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T19:49:17.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:17 smithi136 ceph-mon[125702]: pgmap v17016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T19:49:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:19 smithi057 ceph-mon[92072]: pgmap v17017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:49:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:19 smithi122 ceph-mon[125440]: pgmap v17017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:49:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:19 smithi136 ceph-mon[125702]: pgmap v17017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:49:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:21 smithi057 ceph-mon[92072]: pgmap v17018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:49:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:21 smithi122 ceph-mon[125440]: pgmap v17018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:49:21.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:21 smithi136 ceph-mon[125702]: pgmap v17018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:49:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:23 smithi057 ceph-mon[92072]: pgmap v17019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:49:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:23 smithi122 ceph-mon[125440]: pgmap v17019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:49:23.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:23 smithi136 ceph-mon[125702]: pgmap v17019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:49:25.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:25 smithi057 ceph-mon[92072]: pgmap v17020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:49:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:25 smithi122 ceph-mon[125440]: pgmap v17020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:49:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:25 smithi136 ceph-mon[125702]: pgmap v17020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:49:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:27 smithi057 ceph-mon[92072]: pgmap v17021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:27 smithi122 ceph-mon[125440]: pgmap v17021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:27 smithi136 ceph-mon[125702]: pgmap v17021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:28.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:49:28.485 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:28.483+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:49:28.485 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:28.483+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:49:28.485 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:28.483+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:49:28.485 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:28.483+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:49:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:29 smithi057 ceph-mon[92072]: pgmap v17022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:29 smithi122 ceph-mon[125440]: pgmap v17022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:29 smithi136 ceph-mon[125702]: pgmap v17022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:31 smithi057 ceph-mon[92072]: pgmap v17023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:31 smithi122 ceph-mon[125440]: pgmap v17023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:31.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:31 smithi136 ceph-mon[125702]: pgmap v17023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:33 smithi057 ceph-mon[92072]: pgmap v17024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:33 smithi122 ceph-mon[125440]: pgmap v17024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:33 smithi136 ceph-mon[125702]: pgmap v17024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:35 smithi122 ceph-mon[125440]: pgmap v17025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:35 smithi136 ceph-mon[125702]: pgmap v17025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:35 smithi057 ceph-mon[92072]: pgmap v17025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:37 smithi122 ceph-mon[125440]: pgmap v17026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:37 smithi136 ceph-mon[125702]: pgmap v17026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:37 smithi057 ceph-mon[92072]: pgmap v17026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:39.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:39 smithi122 ceph-mon[125440]: pgmap v17027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:39 smithi136 ceph-mon[125702]: pgmap v17027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:39 smithi057 ceph-mon[92072]: pgmap v17027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:41 smithi122 ceph-mon[125440]: pgmap v17028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:41 smithi136 ceph-mon[125702]: pgmap v17028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:41 smithi057 ceph-mon[92072]: pgmap v17028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:43.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:49:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:43.499+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:49:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:43.499+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:49:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:43.499+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:49:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:43.499+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:49:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:43 smithi136 ceph-mon[125702]: pgmap v17029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:43 smithi057 ceph-mon[92072]: pgmap v17029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:43 smithi122 ceph-mon[125440]: pgmap v17029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:45.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:45 smithi136 ceph-mon[125702]: pgmap v17030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:45 smithi057 ceph-mon[92072]: pgmap v17030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:45.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:45 smithi122 ceph-mon[125440]: pgmap v17030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:47 smithi136 ceph-mon[125702]: pgmap v17031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:47 smithi057 ceph-mon[92072]: pgmap v17031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:47 smithi122 ceph-mon[125440]: pgmap v17031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:49 smithi136 ceph-mon[125702]: pgmap v17032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:49 smithi057 ceph-mon[92072]: pgmap v17032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:49 smithi122 ceph-mon[125440]: pgmap v17032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:51 smithi136 ceph-mon[125702]: pgmap v17033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:51 smithi057 ceph-mon[92072]: pgmap v17033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:51 smithi122 ceph-mon[125440]: pgmap v17033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:53 smithi136 ceph-mon[125702]: pgmap v17034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:53 smithi057 ceph-mon[92072]: pgmap v17034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:53 smithi122 ceph-mon[125440]: pgmap v17034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:55 smithi136 ceph-mon[125702]: pgmap v17035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:55 smithi057 ceph-mon[92072]: pgmap v17035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:55 smithi122 ceph-mon[125440]: pgmap v17035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:49:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:49:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:49:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:57 smithi136 ceph-mon[125702]: pgmap v17036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:49:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:57 smithi057 ceph-mon[92072]: pgmap v17036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:49:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:49:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:49:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:57 smithi122 ceph-mon[125440]: pgmap v17036: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:49:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:49:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:49:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:49:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:58.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:49:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:58.515+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:49:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:58.515+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:49:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:58.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:49:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:49:58.515+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:49:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:49:59 smithi136 ceph-mon[125702]: pgmap v17037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:49:59 smithi057 ceph-mon[92072]: pgmap v17037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:49:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:49:59 smithi122 ceph-mon[125440]: pgmap v17037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T19:50:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T19:50:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T19:50:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:01 smithi136 ceph-mon[125702]: pgmap v17038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:01 smithi057 ceph-mon[92072]: pgmap v17038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:01 smithi122 ceph-mon[125440]: pgmap v17038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:03.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:03 smithi136 ceph-mon[125702]: pgmap v17039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:50:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:03 smithi057 ceph-mon[92072]: pgmap v17039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:50:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:03 smithi122 ceph-mon[125440]: pgmap v17039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:50:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:05 smithi136 ceph-mon[125702]: pgmap v17040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:50:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:05 smithi057 ceph-mon[92072]: pgmap v17040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:50:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:05 smithi122 ceph-mon[125440]: pgmap v17040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:50:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:07 smithi136 ceph-mon[125702]: pgmap v17041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:50:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:07 smithi136 ceph-mon[125702]: osdmap e1138: 12 total, 12 up, 12 in 2023-03-02T19:50:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:07 smithi057 ceph-mon[92072]: pgmap v17041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:50:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:07 smithi057 ceph-mon[92072]: osdmap e1138: 12 total, 12 up, 12 in 2023-03-02T19:50:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:07 smithi122 ceph-mon[125440]: pgmap v17041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:50:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:07 smithi122 ceph-mon[125440]: osdmap e1138: 12 total, 12 up, 12 in 2023-03-02T19:50:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:09 smithi136 ceph-mon[125702]: pgmap v17043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:50:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:09 smithi057 ceph-mon[92072]: pgmap v17043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:50:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:09 smithi122 ceph-mon[125440]: pgmap v17043: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:50:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:11 smithi136 ceph-mon[125702]: pgmap v17044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:50:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:11 smithi057 ceph-mon[92072]: pgmap v17044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:50:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:11 smithi122 ceph-mon[125440]: pgmap v17044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:50:12.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:12.976+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:50:12.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:12.976+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:50:12.979 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:12.976+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 247 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:50:12.979 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:12.976+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 246 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:50:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:13.524+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:50:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:13.524+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:50:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:13.524+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:50:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:13.524+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:50:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:13.524+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:50:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:13 smithi136 ceph-mon[125702]: pgmap v17045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:50:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:13 smithi136 ceph-mon[125702]: osdmap e1139: 12 total, 12 up, 12 in 2023-03-02T19:50:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:13 smithi057 ceph-mon[92072]: pgmap v17045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:50:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:13 smithi057 ceph-mon[92072]: osdmap e1139: 12 total, 12 up, 12 in 2023-03-02T19:50:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:13 smithi122 ceph-mon[125440]: pgmap v17045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:50:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:13 smithi122 ceph-mon[125440]: osdmap e1139: 12 total, 12 up, 12 in 2023-03-02T19:50:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:15 smithi136 ceph-mon[125702]: pgmap v17047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:50:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:15 smithi057 ceph-mon[92072]: pgmap v17047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:50:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:15 smithi122 ceph-mon[125440]: pgmap v17047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:50:17.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:17 smithi136 ceph-mon[125702]: pgmap v17048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-02T19:50:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:17 smithi057 ceph-mon[92072]: pgmap v17048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-02T19:50:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:17 smithi122 ceph-mon[125440]: pgmap v17048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-02T19:50:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:19 smithi136 ceph-mon[125702]: pgmap v17049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:50:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:19 smithi057 ceph-mon[92072]: pgmap v17049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:50:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:19 smithi122 ceph-mon[125440]: pgmap v17049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:50:21.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:21 smithi136 ceph-mon[125702]: pgmap v17050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:50:21.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:21 smithi057 ceph-mon[92072]: pgmap v17050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:50:21.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:21 smithi122 ceph-mon[125440]: pgmap v17050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:50:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:23 smithi136 ceph-mon[125702]: pgmap v17051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:50:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:23 smithi057 ceph-mon[92072]: pgmap v17051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:50:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:23 smithi122 ceph-mon[125440]: pgmap v17051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:50:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:25 smithi136 ceph-mon[125702]: pgmap v17052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:50:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:25 smithi057 ceph-mon[92072]: pgmap v17052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:50:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:25 smithi122 ceph-mon[125440]: pgmap v17052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:50:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:27 smithi136 ceph-mon[125702]: pgmap v17053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:27 smithi057 ceph-mon[92072]: pgmap v17053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:27 smithi122 ceph-mon[125440]: pgmap v17053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:28.537+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:50:28.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:28.537+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:50:28.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:28.537+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:50:28.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:28.537+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:50:28.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:28.537+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:50:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:29 smithi057 ceph-mon[92072]: pgmap v17054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:29 smithi122 ceph-mon[125440]: pgmap v17054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:29 smithi136 ceph-mon[125702]: pgmap v17054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:31 smithi057 ceph-mon[92072]: pgmap v17055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:31 smithi122 ceph-mon[125440]: pgmap v17055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:31 smithi136 ceph-mon[125702]: pgmap v17055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:33 smithi057 ceph-mon[92072]: pgmap v17056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:33 smithi122 ceph-mon[125440]: pgmap v17056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:33 smithi136 ceph-mon[125702]: pgmap v17056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:35 smithi057 ceph-mon[92072]: pgmap v17057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:35 smithi122 ceph-mon[125440]: pgmap v17057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:35 smithi136 ceph-mon[125702]: pgmap v17057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:37 smithi057 ceph-mon[92072]: pgmap v17058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:37 smithi122 ceph-mon[125440]: pgmap v17058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:37 smithi136 ceph-mon[125702]: pgmap v17058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:39 smithi057 ceph-mon[92072]: pgmap v17059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:39 smithi122 ceph-mon[125440]: pgmap v17059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:39 smithi136 ceph-mon[125702]: pgmap v17059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:41 smithi057 ceph-mon[92072]: pgmap v17060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:41 smithi122 ceph-mon[125440]: pgmap v17060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:41 smithi136 ceph-mon[125702]: pgmap v17060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:43.548+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:50:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:43.549+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:50:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:43.549+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:50:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:43.549+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:50:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:43.549+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:50:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:43 smithi057 ceph-mon[92072]: pgmap v17061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:43 smithi122 ceph-mon[125440]: pgmap v17061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:43 smithi136 ceph-mon[125702]: pgmap v17061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:45 smithi057 ceph-mon[92072]: pgmap v17062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:45 smithi122 ceph-mon[125440]: pgmap v17062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:45 smithi136 ceph-mon[125702]: pgmap v17062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:47 smithi057 ceph-mon[92072]: pgmap v17063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:47 smithi122 ceph-mon[125440]: pgmap v17063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:47 smithi136 ceph-mon[125702]: pgmap v17063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:49 smithi057 ceph-mon[92072]: pgmap v17064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:49 smithi122 ceph-mon[125440]: pgmap v17064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:49 smithi136 ceph-mon[125702]: pgmap v17064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:51 smithi057 ceph-mon[92072]: pgmap v17065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:51 smithi122 ceph-mon[125440]: pgmap v17065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:51 smithi136 ceph-mon[125702]: pgmap v17065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:53 smithi057 ceph-mon[92072]: pgmap v17066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:53 smithi122 ceph-mon[125440]: pgmap v17066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:53 smithi136 ceph-mon[125702]: pgmap v17066: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:50:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:55 smithi057 ceph-mon[92072]: pgmap v17067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:55 smithi122 ceph-mon[125440]: pgmap v17067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:55 smithi136 ceph-mon[125702]: pgmap v17067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:57 smithi057 ceph-mon[92072]: pgmap v17068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:50:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:57 smithi122 ceph-mon[125440]: pgmap v17068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:50:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:57 smithi136 ceph-mon[125702]: pgmap v17068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:50:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:50:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:58.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:50:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:58.561+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:50:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:58.561+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:50:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:58.561+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:50:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:50:58.561+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:50:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:50:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:50:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:50:58.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:50:58.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:50:58.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:50:59.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:50:59.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:50:59.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:51:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:50:59 smithi136 ceph-mon[125702]: pgmap v17069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:50:59 smithi057 ceph-mon[92072]: pgmap v17069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:50:59 smithi122 ceph-mon[125440]: pgmap v17069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:01 smithi136 ceph-mon[125702]: pgmap v17070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:01 smithi057 ceph-mon[92072]: pgmap v17070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:01 smithi122 ceph-mon[125440]: pgmap v17070: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:03 smithi136 ceph-mon[125702]: pgmap v17071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:51:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:03 smithi057 ceph-mon[92072]: pgmap v17071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:51:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:03 smithi122 ceph-mon[125440]: pgmap v17071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:51:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:05 smithi136 ceph-mon[125702]: pgmap v17072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:51:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:05 smithi057 ceph-mon[92072]: pgmap v17072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:51:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:05 smithi122 ceph-mon[125440]: pgmap v17072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:51:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:07 smithi136 ceph-mon[125702]: pgmap v17073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:51:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:07 smithi136 ceph-mon[125702]: osdmap e1140: 12 total, 12 up, 12 in 2023-03-02T19:51:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:07 smithi057 ceph-mon[92072]: pgmap v17073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:51:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:07 smithi057 ceph-mon[92072]: osdmap e1140: 12 total, 12 up, 12 in 2023-03-02T19:51:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:07 smithi122 ceph-mon[125440]: pgmap v17073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:51:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:07 smithi122 ceph-mon[125440]: osdmap e1140: 12 total, 12 up, 12 in 2023-03-02T19:51:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:09 smithi136 ceph-mon[125702]: pgmap v17075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:51:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:09 smithi057 ceph-mon[92072]: pgmap v17075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:51:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:09 smithi122 ceph-mon[125440]: pgmap v17075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:51:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:11 smithi136 ceph-mon[125702]: pgmap v17076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:51:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:11 smithi057 ceph-mon[92072]: pgmap v17076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:51:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:11 smithi122 ceph-mon[125440]: pgmap v17076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:51:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:13.572+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:51:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:13.572+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:51:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:13.572+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:51:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:13.572+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:51:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:13.572+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:51:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:13 smithi136 ceph-mon[125702]: pgmap v17077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:51:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:13 smithi136 ceph-mon[125702]: osdmap e1141: 12 total, 12 up, 12 in 2023-03-02T19:51:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:13 smithi057 ceph-mon[92072]: pgmap v17077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:51:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:13 smithi057 ceph-mon[92072]: osdmap e1141: 12 total, 12 up, 12 in 2023-03-02T19:51:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:13 smithi122 ceph-mon[125440]: pgmap v17077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:51:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:13 smithi122 ceph-mon[125440]: osdmap e1141: 12 total, 12 up, 12 in 2023-03-02T19:51:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:15 smithi136 ceph-mon[125702]: pgmap v17079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:51:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:15 smithi057 ceph-mon[92072]: pgmap v17079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:51:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:15 smithi122 ceph-mon[125440]: pgmap v17079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:51:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:17 smithi136 ceph-mon[125702]: pgmap v17080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 112 B/s wr, 5 op/s 2023-03-02T19:51:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:17 smithi057 ceph-mon[92072]: pgmap v17080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 112 B/s wr, 5 op/s 2023-03-02T19:51:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:17 smithi122 ceph-mon[125440]: pgmap v17080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 112 B/s wr, 5 op/s 2023-03-02T19:51:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:19 smithi136 ceph-mon[125702]: pgmap v17081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:51:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:19 smithi057 ceph-mon[92072]: pgmap v17081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:51:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:19 smithi122 ceph-mon[125440]: pgmap v17081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:51:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:21 smithi136 ceph-mon[125702]: pgmap v17082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:51:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:21 smithi057 ceph-mon[92072]: pgmap v17082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:51:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:21 smithi122 ceph-mon[125440]: pgmap v17082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:51:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:22 smithi057 ceph-mon[92072]: pgmap v17083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:51:23.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:22 smithi122 ceph-mon[125440]: pgmap v17083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:51:23.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:22 smithi136 ceph-mon[125702]: pgmap v17083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:51:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:25 smithi136 ceph-mon[125702]: pgmap v17084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:51:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:25 smithi057 ceph-mon[92072]: pgmap v17084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:51:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:25 smithi122 ceph-mon[125440]: pgmap v17084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:51:27.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:27 smithi136 ceph-mon[125702]: pgmap v17085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:27 smithi057 ceph-mon[92072]: pgmap v17085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:27 smithi122 ceph-mon[125440]: pgmap v17085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:28.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:51:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:28.582+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:51:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:28.582+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:51:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:28.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:51:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:28.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:51:29.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:29 smithi136 ceph-mon[125702]: pgmap v17086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:29 smithi057 ceph-mon[92072]: pgmap v17086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:29 smithi122 ceph-mon[125440]: pgmap v17086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:31.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:31 smithi136 ceph-mon[125702]: pgmap v17087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:31 smithi057 ceph-mon[92072]: pgmap v17087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:31 smithi122 ceph-mon[125440]: pgmap v17087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:33 smithi136 ceph-mon[125702]: pgmap v17088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:33 smithi057 ceph-mon[92072]: pgmap v17088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:33 smithi122 ceph-mon[125440]: pgmap v17088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:35.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:35 smithi136 ceph-mon[125702]: pgmap v17089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:35 smithi057 ceph-mon[92072]: pgmap v17089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:35 smithi122 ceph-mon[125440]: pgmap v17089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:37.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:37 smithi136 ceph-mon[125702]: pgmap v17090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:37 smithi057 ceph-mon[92072]: pgmap v17090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:37 smithi122 ceph-mon[125440]: pgmap v17090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:39.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:39 smithi136 ceph-mon[125702]: pgmap v17091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:39 smithi057 ceph-mon[92072]: pgmap v17091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:39.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:39 smithi122 ceph-mon[125440]: pgmap v17091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:41 smithi136 ceph-mon[125702]: pgmap v17092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:41 smithi057 ceph-mon[92072]: pgmap v17092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:41 smithi122 ceph-mon[125440]: pgmap v17092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:43 smithi136 ceph-mon[125702]: pgmap v17093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:43.589+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:51:43.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:43.589+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:51:43.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:43.589+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:51:43.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:43.589+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:51:43.592 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:43.589+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:51:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:43 smithi057 ceph-mon[92072]: pgmap v17093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:43 smithi122 ceph-mon[125440]: pgmap v17093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:45.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:45 smithi136 ceph-mon[125702]: pgmap v17094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:45 smithi057 ceph-mon[92072]: pgmap v17094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:45 smithi122 ceph-mon[125440]: pgmap v17094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:47 smithi136 ceph-mon[125702]: pgmap v17095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:47 smithi057 ceph-mon[92072]: pgmap v17095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:47 smithi122 ceph-mon[125440]: pgmap v17095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:49.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:49 smithi136 ceph-mon[125702]: pgmap v17096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:49 smithi057 ceph-mon[92072]: pgmap v17096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:49 smithi122 ceph-mon[125440]: pgmap v17096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:51 smithi136 ceph-mon[125702]: pgmap v17097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:51 smithi057 ceph-mon[92072]: pgmap v17097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:51 smithi122 ceph-mon[125440]: pgmap v17097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:53 smithi136 ceph-mon[125702]: pgmap v17098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:53 smithi057 ceph-mon[92072]: pgmap v17098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:53 smithi122 ceph-mon[125440]: pgmap v17098: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:51:55.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:55 smithi136 ceph-mon[125702]: pgmap v17099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:55 smithi057 ceph-mon[92072]: pgmap v17099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:55 smithi122 ceph-mon[125440]: pgmap v17099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:57.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:57 smithi136 ceph-mon[125702]: pgmap v17100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:57 smithi057 ceph-mon[92072]: pgmap v17100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:57 smithi122 ceph-mon[125440]: pgmap v17100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:51:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:51:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:58.604+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:51:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:58.604+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:51:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:58.604+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:51:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:58.604+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:51:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:51:58.604+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:51:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:51:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:51:59.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:51:59 smithi057 ceph-mon[92072]: pgmap v17101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:00.048 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:51:59 smithi136 ceph-mon[125702]: pgmap v17101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:00.049 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:51:59 smithi122 ceph-mon[125440]: pgmap v17101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: pgmap v17102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:02.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: pgmap v17102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: pgmap v17102: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:52:03.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:52:03.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:52:03.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:52:03.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:52:03.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:52:03.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:52:03.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:52:03.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:52:03.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:52:03.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:52:03.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:52:03.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:03.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T19:52:03.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T19:52:03.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T19:52:03.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T19:52:03.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T19:52:03.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:52:03.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:52:03.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:52:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:03 smithi136 ceph-mon[125702]: pgmap v17103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:52:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:03 smithi057 ceph-mon[92072]: pgmap v17103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:52:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:03 smithi122 ceph-mon[125440]: pgmap v17103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:52:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:05 smithi136 ceph-mon[125702]: pgmap v17104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:52:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:05 smithi057 ceph-mon[92072]: pgmap v17104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:52:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:05 smithi122 ceph-mon[125440]: pgmap v17104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:52:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:07 smithi057 ceph-mon[92072]: pgmap v17105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:52:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:07 smithi057 ceph-mon[92072]: osdmap e1142: 12 total, 12 up, 12 in 2023-03-02T19:52:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:07 smithi122 ceph-mon[125440]: pgmap v17105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:52:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:07 smithi122 ceph-mon[125440]: osdmap e1142: 12 total, 12 up, 12 in 2023-03-02T19:52:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:07 smithi136 ceph-mon[125702]: pgmap v17105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:52:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:07 smithi136 ceph-mon[125702]: osdmap e1142: 12 total, 12 up, 12 in 2023-03-02T19:52:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:09 smithi057 ceph-mon[92072]: pgmap v17107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:52:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:09 smithi122 ceph-mon[125440]: pgmap v17107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:52:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:09 smithi136 ceph-mon[125702]: pgmap v17107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:52:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:10 smithi057 ceph-mon[92072]: pgmap v17108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:52:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:10 smithi122 ceph-mon[125440]: pgmap v17108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:52:11.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:10 smithi136 ceph-mon[125702]: pgmap v17108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:52:13.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:12 smithi136 ceph-mon[125702]: pgmap v17109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:52:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:12 smithi057 ceph-mon[92072]: pgmap v17109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:52:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:12 smithi122 ceph-mon[125440]: pgmap v17109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:52:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:13.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:52:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:13.620+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:52:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:13.620+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:52:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:13.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:52:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:13.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:52:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:14 smithi136 ceph-mon[125702]: osdmap e1143: 12 total, 12 up, 12 in 2023-03-02T19:52:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:14 smithi057 ceph-mon[92072]: osdmap e1143: 12 total, 12 up, 12 in 2023-03-02T19:52:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:14 smithi122 ceph-mon[125440]: osdmap e1143: 12 total, 12 up, 12 in 2023-03-02T19:52:15.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:15 smithi136 ceph-mon[125702]: pgmap v17111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:52:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:15 smithi057 ceph-mon[92072]: pgmap v17111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:52:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:15 smithi122 ceph-mon[125440]: pgmap v17111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:52:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:17 smithi136 ceph-mon[125702]: pgmap v17112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 112 B/s wr, 5 op/s 2023-03-02T19:52:17.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:17 smithi057 ceph-mon[92072]: pgmap v17112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 112 B/s wr, 5 op/s 2023-03-02T19:52:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:17 smithi122 ceph-mon[125440]: pgmap v17112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 112 B/s wr, 5 op/s 2023-03-02T19:52:19.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:19 smithi136 ceph-mon[125702]: pgmap v17113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:52:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:19 smithi057 ceph-mon[92072]: pgmap v17113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:52:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:19 smithi122 ceph-mon[125440]: pgmap v17113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:52:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:21 smithi136 ceph-mon[125702]: pgmap v17114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:52:21.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:21 smithi057 ceph-mon[92072]: pgmap v17114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:52:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:21 smithi122 ceph-mon[125440]: pgmap v17114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:52:23.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:23 smithi136 ceph-mon[125702]: pgmap v17115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:52:23.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:23 smithi057 ceph-mon[92072]: pgmap v17115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:52:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:23 smithi122 ceph-mon[125440]: pgmap v17115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:52:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:25 smithi136 ceph-mon[125702]: pgmap v17116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:52:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:25 smithi057 ceph-mon[92072]: pgmap v17116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:52:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:25 smithi122 ceph-mon[125440]: pgmap v17116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:52:27.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:27 smithi136 ceph-mon[125702]: pgmap v17117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:27 smithi057 ceph-mon[92072]: pgmap v17117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:27 smithi122 ceph-mon[125440]: pgmap v17117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:28.623+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:52:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:28.623+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:52:28.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:28.623+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:52:28.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:28.623+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:52:28.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:28.623+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:52:29.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:29 smithi136 ceph-mon[125702]: pgmap v17118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:29 smithi057 ceph-mon[92072]: pgmap v17118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:29 smithi122 ceph-mon[125440]: pgmap v17118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:31 smithi136 ceph-mon[125702]: pgmap v17119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:31 smithi057 ceph-mon[92072]: pgmap v17119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:31 smithi122 ceph-mon[125440]: pgmap v17119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:33 smithi136 ceph-mon[125702]: pgmap v17120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:33 smithi057 ceph-mon[92072]: pgmap v17120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:33 smithi122 ceph-mon[125440]: pgmap v17120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:35.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:35 smithi136 ceph-mon[125702]: pgmap v17121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:35 smithi057 ceph-mon[92072]: pgmap v17121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:35 smithi122 ceph-mon[125440]: pgmap v17121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:37 smithi057 ceph-mon[92072]: pgmap v17122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:37 smithi122 ceph-mon[125440]: pgmap v17122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:37 smithi136 ceph-mon[125702]: pgmap v17122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:39 smithi057 ceph-mon[92072]: pgmap v17123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:39.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:39 smithi122 ceph-mon[125440]: pgmap v17123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:39 smithi136 ceph-mon[125702]: pgmap v17123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:41 smithi057 ceph-mon[92072]: pgmap v17124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:41 smithi122 ceph-mon[125440]: pgmap v17124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:41 smithi136 ceph-mon[125702]: pgmap v17124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:43.628+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:52:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:43.628+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:52:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:43.628+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:52:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:43.628+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:52:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:43.628+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:52:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:43 smithi057 ceph-mon[92072]: pgmap v17125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:43 smithi122 ceph-mon[125440]: pgmap v17125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:43 smithi136 ceph-mon[125702]: pgmap v17125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:45 smithi057 ceph-mon[92072]: pgmap v17126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:45 smithi122 ceph-mon[125440]: pgmap v17126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:45 smithi136 ceph-mon[125702]: pgmap v17126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:47 smithi057 ceph-mon[92072]: pgmap v17127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:47 smithi122 ceph-mon[125440]: pgmap v17127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:47 smithi136 ceph-mon[125702]: pgmap v17127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:49.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:49 smithi057 ceph-mon[92072]: pgmap v17128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:49 smithi122 ceph-mon[125440]: pgmap v17128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:49 smithi136 ceph-mon[125702]: pgmap v17128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:51 smithi057 ceph-mon[92072]: pgmap v17129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:51 smithi122 ceph-mon[125440]: pgmap v17129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:51 smithi136 ceph-mon[125702]: pgmap v17129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:53 smithi057 ceph-mon[92072]: pgmap v17130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:53 smithi122 ceph-mon[125440]: pgmap v17130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:53 smithi136 ceph-mon[125702]: pgmap v17130: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:55 smithi057 ceph-mon[92072]: pgmap v17131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:55 smithi122 ceph-mon[125440]: pgmap v17131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:55.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:55 smithi136 ceph-mon[125702]: pgmap v17131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:57 smithi057 ceph-mon[92072]: pgmap v17132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:57 smithi122 ceph-mon[125440]: pgmap v17132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:57.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:57 smithi136 ceph-mon[125702]: pgmap v17132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:52:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:58.643+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:52:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:58.644+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:52:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:58.644+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:52:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:58.644+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:52:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:52:58.644+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:52:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:52:59 smithi057 ceph-mon[92072]: pgmap v17133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:52:59 smithi122 ceph-mon[125440]: pgmap v17133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:52:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:52:59 smithi136 ceph-mon[125702]: pgmap v17133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:01.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:01 smithi057 ceph-mon[92072]: pgmap v17134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:01 smithi122 ceph-mon[125440]: pgmap v17134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:01 smithi136 ceph-mon[125702]: pgmap v17134: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:53:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:53:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:53:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:03 smithi057 ceph-mon[92072]: pgmap v17135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:53:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:53:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:53:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:53:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:03 smithi122 ceph-mon[125440]: pgmap v17135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:53:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:53:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:53:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:53:03.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:03 smithi136 ceph-mon[125702]: pgmap v17135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:53:03.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:53:03.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:53:03.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:53:05.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:05 smithi057 ceph-mon[92072]: pgmap v17136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:53:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:05 smithi122 ceph-mon[125440]: pgmap v17136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:53:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:05 smithi136 ceph-mon[125702]: pgmap v17136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:53:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:07 smithi122 ceph-mon[125440]: pgmap v17137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:53:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:07 smithi122 ceph-mon[125440]: osdmap e1144: 12 total, 12 up, 12 in 2023-03-02T19:53:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:07 smithi136 ceph-mon[125702]: pgmap v17137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:53:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:07 smithi136 ceph-mon[125702]: osdmap e1144: 12 total, 12 up, 12 in 2023-03-02T19:53:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:07 smithi057 ceph-mon[92072]: pgmap v17137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:53:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:07 smithi057 ceph-mon[92072]: osdmap e1144: 12 total, 12 up, 12 in 2023-03-02T19:53:09.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:09 smithi122 ceph-mon[125440]: pgmap v17139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:53:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:09 smithi136 ceph-mon[125702]: pgmap v17139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:53:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:09 smithi057 ceph-mon[92072]: pgmap v17139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:53:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:11 smithi136 ceph-mon[125702]: pgmap v17140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:53:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:11 smithi057 ceph-mon[92072]: pgmap v17140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:53:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:11 smithi122 ceph-mon[125440]: pgmap v17140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:53:13.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:13.002+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:53:13.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:13.002+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:53:13.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:13.002+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 247 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:53:13.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:13.003+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 248 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:53:13.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:13.651+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:53:13.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:13.652+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:53:13.654 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:13.652+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:53:13.654 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:13.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:53:13.654 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:13.652+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:53:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:13 smithi136 ceph-mon[125702]: pgmap v17141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:53:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:13 smithi136 ceph-mon[125702]: osdmap e1145: 12 total, 12 up, 12 in 2023-03-02T19:53:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:13 smithi057 ceph-mon[92072]: pgmap v17141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:53:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:13 smithi057 ceph-mon[92072]: osdmap e1145: 12 total, 12 up, 12 in 2023-03-02T19:53:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:13 smithi122 ceph-mon[125440]: pgmap v17141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:53:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:13 smithi122 ceph-mon[125440]: osdmap e1145: 12 total, 12 up, 12 in 2023-03-02T19:53:15.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:15 smithi136 ceph-mon[125702]: pgmap v17143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:53:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:15 smithi057 ceph-mon[92072]: pgmap v17143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:53:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:15 smithi122 ceph-mon[125440]: pgmap v17143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:53:17.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:17 smithi136 ceph-mon[125702]: pgmap v17144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T19:53:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:17 smithi057 ceph-mon[92072]: pgmap v17144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T19:53:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:17 smithi122 ceph-mon[125440]: pgmap v17144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T19:53:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:19 smithi136 ceph-mon[125702]: pgmap v17145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:53:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:19 smithi057 ceph-mon[92072]: pgmap v17145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:53:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:19 smithi122 ceph-mon[125440]: pgmap v17145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:53:21.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:21 smithi136 ceph-mon[125702]: pgmap v17146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:53:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:21 smithi057 ceph-mon[92072]: pgmap v17146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:53:21.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:21 smithi122 ceph-mon[125440]: pgmap v17146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:53:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:23 smithi136 ceph-mon[125702]: pgmap v17147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:53:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:23 smithi057 ceph-mon[92072]: pgmap v17147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:53:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:23 smithi122 ceph-mon[125440]: pgmap v17147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:53:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:25 smithi136 ceph-mon[125702]: pgmap v17148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:53:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:25 smithi057 ceph-mon[92072]: pgmap v17148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:53:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:25 smithi122 ceph-mon[125440]: pgmap v17148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:53:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:27 smithi136 ceph-mon[125702]: pgmap v17149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:27 smithi057 ceph-mon[92072]: pgmap v17149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:27 smithi122 ceph-mon[125440]: pgmap v17149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:28.666+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:53:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:28.667+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:53:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:28.667+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:53:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:28.667+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:53:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:28.667+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:53:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:29 smithi136 ceph-mon[125702]: pgmap v17150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:29 smithi057 ceph-mon[92072]: pgmap v17150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:29 smithi122 ceph-mon[125440]: pgmap v17150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:31 smithi136 ceph-mon[125702]: pgmap v17151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:31 smithi057 ceph-mon[92072]: pgmap v17151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:31 smithi122 ceph-mon[125440]: pgmap v17151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:33 smithi136 ceph-mon[125702]: pgmap v17152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:33 smithi057 ceph-mon[92072]: pgmap v17152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:33 smithi122 ceph-mon[125440]: pgmap v17152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:35.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:35 smithi136 ceph-mon[125702]: pgmap v17153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:35 smithi057 ceph-mon[92072]: pgmap v17153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:35 smithi122 ceph-mon[125440]: pgmap v17153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:37 smithi136 ceph-mon[125702]: pgmap v17154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:37 smithi057 ceph-mon[92072]: pgmap v17154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:37 smithi122 ceph-mon[125440]: pgmap v17154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:39 smithi136 ceph-mon[125702]: pgmap v17155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:39 smithi057 ceph-mon[92072]: pgmap v17155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:39 smithi122 ceph-mon[125440]: pgmap v17155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:41 smithi136 ceph-mon[125702]: pgmap v17156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:41 smithi057 ceph-mon[92072]: pgmap v17156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:41 smithi122 ceph-mon[125440]: pgmap v17156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:43.671+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:53:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:43.671+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:53:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:43.671+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:53:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:43.671+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:53:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:43.671+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:53:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:43 smithi136 ceph-mon[125702]: pgmap v17157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:43 smithi057 ceph-mon[92072]: pgmap v17157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:43 smithi122 ceph-mon[125440]: pgmap v17157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:45 smithi136 ceph-mon[125702]: pgmap v17158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:45 smithi057 ceph-mon[92072]: pgmap v17158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:45 smithi122 ceph-mon[125440]: pgmap v17158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:47 smithi136 ceph-mon[125702]: pgmap v17159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:47 smithi057 ceph-mon[92072]: pgmap v17159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:47 smithi122 ceph-mon[125440]: pgmap v17159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:49 smithi136 ceph-mon[125702]: pgmap v17160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:49 smithi057 ceph-mon[92072]: pgmap v17160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:49 smithi122 ceph-mon[125440]: pgmap v17160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:51.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:51 smithi136 ceph-mon[125702]: pgmap v17161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:51 smithi057 ceph-mon[92072]: pgmap v17161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:51 smithi122 ceph-mon[125440]: pgmap v17161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:53 smithi136 ceph-mon[125702]: pgmap v17162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:53 smithi057 ceph-mon[92072]: pgmap v17162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:53 smithi122 ceph-mon[125440]: pgmap v17162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:55 smithi136 ceph-mon[125702]: pgmap v17163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:55 smithi057 ceph-mon[92072]: pgmap v17163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:55 smithi122 ceph-mon[125440]: pgmap v17163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:57 smithi136 ceph-mon[125702]: pgmap v17164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:57 smithi057 ceph-mon[92072]: pgmap v17164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:57 smithi122 ceph-mon[125440]: pgmap v17164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:53:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:58.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:53:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:58.688+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:53:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:58.688+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:53:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:58.688+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:53:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:53:58.688+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:53:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:53:59 smithi136 ceph-mon[125702]: pgmap v17165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:53:59 smithi057 ceph-mon[92072]: pgmap v17165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:53:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:53:59 smithi122 ceph-mon[125440]: pgmap v17165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:01 smithi136 ceph-mon[125702]: pgmap v17166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:01 smithi057 ceph-mon[92072]: pgmap v17166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:01 smithi122 ceph-mon[125440]: pgmap v17166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:03.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:03 smithi136 ceph-mon[125702]: pgmap v17167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:54:03.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:54:03.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:54:03.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:54:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:03 smithi057 ceph-mon[92072]: pgmap v17167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:54:03.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:54:03.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:54:03.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:54:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:03 smithi122 ceph-mon[125440]: pgmap v17167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:54:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:54:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:54:03.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:54:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:54:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:54:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:54:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:54:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:54:04.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:54:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:54:05.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:54:05.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:54:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:05 smithi057 ceph-mon[92072]: pgmap v17168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:54:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:05 smithi122 ceph-mon[125440]: pgmap v17168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:54:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:05 smithi136 ceph-mon[125702]: pgmap v17168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:54:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:07 smithi057 ceph-mon[92072]: pgmap v17169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:54:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:07 smithi122 ceph-mon[125440]: pgmap v17169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:54:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:07 smithi136 ceph-mon[125702]: pgmap v17169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:54:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:09 smithi057 ceph-mon[92072]: pgmap v17170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:54:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:09 smithi122 ceph-mon[125440]: pgmap v17170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:54:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:09 smithi136 ceph-mon[125702]: pgmap v17170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:54:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:11 smithi057 ceph-mon[92072]: pgmap v17171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:54:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:11 smithi122 ceph-mon[125440]: pgmap v17171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:54:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:11 smithi136 ceph-mon[125702]: pgmap v17171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:54:12.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:12 smithi057 ceph-mon[92072]: osdmap e1146: 12 total, 12 up, 12 in 2023-03-02T19:54:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:12 smithi122 ceph-mon[125440]: osdmap e1146: 12 total, 12 up, 12 in 2023-03-02T19:54:13.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:12 smithi136 ceph-mon[125702]: osdmap e1146: 12 total, 12 up, 12 in 2023-03-02T19:54:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:13.691+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:54:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:13.691+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:54:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:13.691+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:54:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:13.691+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:54:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:13.691+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:54:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:13 smithi057 ceph-mon[92072]: pgmap v17173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:54:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:13 smithi122 ceph-mon[125440]: pgmap v17173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:54:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:13 smithi136 ceph-mon[125702]: pgmap v17173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:54:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:15 smithi057 ceph-mon[92072]: pgmap v17174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:54:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:15 smithi122 ceph-mon[125440]: pgmap v17174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:54:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:15 smithi136 ceph-mon[125702]: pgmap v17174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:54:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:17 smithi057 ceph-mon[92072]: pgmap v17175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:54:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:17 smithi122 ceph-mon[125440]: pgmap v17175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:54:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:17 smithi136 ceph-mon[125702]: pgmap v17175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:54:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:19 smithi057 ceph-mon[92072]: pgmap v17176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:54:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:19 smithi122 ceph-mon[125440]: pgmap v17176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:54:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:19 smithi136 ceph-mon[125702]: pgmap v17176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:54:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:21 smithi057 ceph-mon[92072]: pgmap v17177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:54:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:21 smithi122 ceph-mon[125440]: pgmap v17177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:54:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:21 smithi136 ceph-mon[125702]: pgmap v17177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T19:54:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:23 smithi057 ceph-mon[92072]: pgmap v17178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 297 B/s wr, 14 op/s 2023-03-02T19:54:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:23 smithi057 ceph-mon[92072]: osdmap e1147: 12 total, 12 up, 12 in 2023-03-02T19:54:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:23 smithi122 ceph-mon[125440]: pgmap v17178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 297 B/s wr, 14 op/s 2023-03-02T19:54:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:23 smithi122 ceph-mon[125440]: osdmap e1147: 12 total, 12 up, 12 in 2023-03-02T19:54:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:23 smithi136 ceph-mon[125702]: pgmap v17178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 297 B/s wr, 14 op/s 2023-03-02T19:54:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:23 smithi136 ceph-mon[125702]: osdmap e1147: 12 total, 12 up, 12 in 2023-03-02T19:54:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:25 smithi057 ceph-mon[92072]: pgmap v17180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T19:54:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:25 smithi122 ceph-mon[125440]: pgmap v17180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T19:54:26.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:25 smithi136 ceph-mon[125702]: pgmap v17180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T19:54:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:27 smithi122 ceph-mon[125440]: pgmap v17181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T19:54:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:27 smithi136 ceph-mon[125702]: pgmap v17181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T19:54:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:27 smithi057 ceph-mon[92072]: pgmap v17181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T19:54:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:28.706+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:54:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:28.706+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:54:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:28.706+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:54:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:28.706+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:54:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:28.706+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:54:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:29 smithi122 ceph-mon[125440]: pgmap v17182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:54:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:29 smithi136 ceph-mon[125702]: pgmap v17182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:54:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:29 smithi057 ceph-mon[92072]: pgmap v17182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:54:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:31 smithi122 ceph-mon[125440]: pgmap v17183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:54:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:31 smithi136 ceph-mon[125702]: pgmap v17183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:54:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:31 smithi057 ceph-mon[92072]: pgmap v17183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T19:54:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:33 smithi122 ceph-mon[125440]: pgmap v17184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:54:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:33 smithi136 ceph-mon[125702]: pgmap v17184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:54:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:33 smithi057 ceph-mon[92072]: pgmap v17184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:54:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:35 smithi136 ceph-mon[125702]: pgmap v17185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:54:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:35 smithi057 ceph-mon[92072]: pgmap v17185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:54:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:35 smithi122 ceph-mon[125440]: pgmap v17185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:54:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:37 smithi136 ceph-mon[125702]: pgmap v17186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:37 smithi057 ceph-mon[92072]: pgmap v17186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:37 smithi122 ceph-mon[125440]: pgmap v17186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:39 smithi136 ceph-mon[125702]: pgmap v17187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:39 smithi057 ceph-mon[92072]: pgmap v17187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:40.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:39 smithi122 ceph-mon[125440]: pgmap v17187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:41 smithi136 ceph-mon[125702]: pgmap v17188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:41 smithi057 ceph-mon[92072]: pgmap v17188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:42.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:41 smithi122 ceph-mon[125440]: pgmap v17188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:43.714+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:54:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:43.714+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:54:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:43.714+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:54:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:43.714+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:54:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:43.714+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:54:44.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:43 smithi136 ceph-mon[125702]: pgmap v17189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:43 smithi057 ceph-mon[92072]: pgmap v17189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:43 smithi122 ceph-mon[125440]: pgmap v17189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:45 smithi136 ceph-mon[125702]: pgmap v17190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:45 smithi057 ceph-mon[92072]: pgmap v17190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:45 smithi122 ceph-mon[125440]: pgmap v17190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:47 smithi136 ceph-mon[125702]: pgmap v17191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:47 smithi057 ceph-mon[92072]: pgmap v17191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:47 smithi122 ceph-mon[125440]: pgmap v17191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:49 smithi136 ceph-mon[125702]: pgmap v17192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:49 smithi057 ceph-mon[92072]: pgmap v17192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:49 smithi122 ceph-mon[125440]: pgmap v17192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:51 smithi136 ceph-mon[125702]: pgmap v17193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:51 smithi057 ceph-mon[92072]: pgmap v17193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:51 smithi122 ceph-mon[125440]: pgmap v17193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:53 smithi136 ceph-mon[125702]: pgmap v17194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:53 smithi057 ceph-mon[92072]: pgmap v17194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:53 smithi122 ceph-mon[125440]: pgmap v17194: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:54:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:55 smithi136 ceph-mon[125702]: pgmap v17195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:55 smithi057 ceph-mon[92072]: pgmap v17195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:56.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:55 smithi122 ceph-mon[125440]: pgmap v17195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:58.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:57 smithi136 ceph-mon[125702]: pgmap v17196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:57 smithi057 ceph-mon[92072]: pgmap v17196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:57 smithi122 ceph-mon[125440]: pgmap v17196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:54:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:58.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:54:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:58.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:54:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:58.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:54:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:58.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:54:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:54:58.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:55:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:54:59 smithi136 ceph-mon[125702]: pgmap v17197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:54:59 smithi057 ceph-mon[92072]: pgmap v17197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:54:59 smithi122 ceph-mon[125440]: pgmap v17197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:01 smithi136 ceph-mon[125702]: pgmap v17198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:01 smithi057 ceph-mon[92072]: pgmap v17198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:01 smithi122 ceph-mon[125440]: pgmap v17198: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:03 smithi136 ceph-mon[125702]: pgmap v17199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:55:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:03 smithi057 ceph-mon[92072]: pgmap v17199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:55:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:03 smithi122 ceph-mon[125440]: pgmap v17199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:55:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:55:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:05.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:05.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:05.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:55:05.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:05.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:05.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:05.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:05.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:55:05.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:05.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:05.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:05.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:05 smithi136 ceph-mon[125702]: pgmap v17200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:55:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:55:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:55:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:05 smithi057 ceph-mon[92072]: pgmap v17200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:55:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:55:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:55:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:05 smithi122 ceph-mon[125440]: pgmap v17200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:55:06.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:55:06.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:55:06.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:55:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:07 smithi136 ceph-mon[125702]: pgmap v17201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:55:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:07 smithi136 ceph-mon[125702]: osdmap e1148: 12 total, 12 up, 12 in 2023-03-02T19:55:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:07 smithi057 ceph-mon[92072]: pgmap v17201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:55:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:07 smithi057 ceph-mon[92072]: osdmap e1148: 12 total, 12 up, 12 in 2023-03-02T19:55:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:07 smithi122 ceph-mon[125440]: pgmap v17201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:55:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:07 smithi122 ceph-mon[125440]: osdmap e1148: 12 total, 12 up, 12 in 2023-03-02T19:55:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:09 smithi136 ceph-mon[125702]: pgmap v17203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:55:10.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:09 smithi057 ceph-mon[92072]: pgmap v17203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:55:10.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:09 smithi122 ceph-mon[125440]: pgmap v17203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:55:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:11 smithi136 ceph-mon[125702]: pgmap v17204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:55:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:11 smithi057 ceph-mon[92072]: pgmap v17204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:55:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:11 smithi122 ceph-mon[125440]: pgmap v17204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:55:13.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:13.740+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:55:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:13.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:55:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:13.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:55:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:13.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:55:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:13.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:55:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:13 smithi136 ceph-mon[125702]: pgmap v17205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:55:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:13 smithi136 ceph-mon[125702]: osdmap e1149: 12 total, 12 up, 12 in 2023-03-02T19:55:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:13 smithi057 ceph-mon[92072]: pgmap v17205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:55:14.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:13 smithi057 ceph-mon[92072]: osdmap e1149: 12 total, 12 up, 12 in 2023-03-02T19:55:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:13 smithi122 ceph-mon[125440]: pgmap v17205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:55:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:13 smithi122 ceph-mon[125440]: osdmap e1149: 12 total, 12 up, 12 in 2023-03-02T19:55:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:15 smithi136 ceph-mon[125702]: pgmap v17207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:55:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:15 smithi057 ceph-mon[92072]: pgmap v17207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:55:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:15 smithi122 ceph-mon[125440]: pgmap v17207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:55:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:17 smithi136 ceph-mon[125702]: pgmap v17208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T19:55:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:17 smithi057 ceph-mon[92072]: pgmap v17208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T19:55:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:17 smithi122 ceph-mon[125440]: pgmap v17208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T19:55:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:19 smithi136 ceph-mon[125702]: pgmap v17209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:55:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:19 smithi057 ceph-mon[92072]: pgmap v17209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:55:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:19 smithi122 ceph-mon[125440]: pgmap v17209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:55:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:21 smithi136 ceph-mon[125702]: pgmap v17210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:55:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:21 smithi057 ceph-mon[92072]: pgmap v17210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:55:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:21 smithi122 ceph-mon[125440]: pgmap v17210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:55:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:23 smithi057 ceph-mon[92072]: pgmap v17211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:55:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:23 smithi122 ceph-mon[125440]: pgmap v17211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:55:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:23 smithi136 ceph-mon[125702]: pgmap v17211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:55:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:25 smithi057 ceph-mon[92072]: pgmap v17212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:55:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:25 smithi122 ceph-mon[125440]: pgmap v17212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:55:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:25 smithi136 ceph-mon[125702]: pgmap v17212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:55:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:28.022+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:55:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:28.022+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:55:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:28.022+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 249 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:55:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:28.022+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 248 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:55:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:27 smithi057 ceph-mon[92072]: pgmap v17213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:27 smithi122 ceph-mon[125440]: pgmap v17213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:27 smithi136 ceph-mon[125702]: pgmap v17213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:28.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:28.742+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:55:28.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:28.743+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:55:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:28.743+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:55:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:28.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:55:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:28.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:55:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:29 smithi057 ceph-mon[92072]: pgmap v17214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:29 smithi122 ceph-mon[125440]: pgmap v17214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:29 smithi136 ceph-mon[125702]: pgmap v17214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:31 smithi057 ceph-mon[92072]: pgmap v17215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:55:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:31 smithi122 ceph-mon[125440]: pgmap v17215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:55:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:31 smithi136 ceph-mon[125702]: pgmap v17215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T19:55:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:33 smithi057 ceph-mon[92072]: pgmap v17216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:33 smithi122 ceph-mon[125440]: pgmap v17216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:33 smithi136 ceph-mon[125702]: pgmap v17216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:35 smithi057 ceph-mon[92072]: pgmap v17217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:35 smithi122 ceph-mon[125440]: pgmap v17217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:35 smithi136 ceph-mon[125702]: pgmap v17217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:37 smithi057 ceph-mon[92072]: pgmap v17218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:37 smithi122 ceph-mon[125440]: pgmap v17218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:37 smithi136 ceph-mon[125702]: pgmap v17218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:39.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:39 smithi136 ceph-mon[125702]: pgmap v17219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:39 smithi057 ceph-mon[92072]: pgmap v17219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:39.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:39 smithi122 ceph-mon[125440]: pgmap v17219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:41 smithi136 ceph-mon[125702]: pgmap v17220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:41.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:41 smithi057 ceph-mon[92072]: pgmap v17220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:41 smithi122 ceph-mon[125440]: pgmap v17220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:43.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:43 smithi136 ceph-mon[125702]: pgmap v17221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:43.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:43 smithi057 ceph-mon[92072]: pgmap v17221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:43.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:43 smithi122 ceph-mon[125440]: pgmap v17221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:43.756+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:55:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:43.756+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:55:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:43.756+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:55:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:43.756+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:55:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:43.756+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:55:45.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:45 smithi136 ceph-mon[125702]: pgmap v17222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:45 smithi057 ceph-mon[92072]: pgmap v17222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:45 smithi122 ceph-mon[125440]: pgmap v17222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:47 smithi057 ceph-mon[92072]: pgmap v17223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:47 smithi122 ceph-mon[125440]: pgmap v17223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:47 smithi136 ceph-mon[125702]: pgmap v17223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:49.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:49 smithi057 ceph-mon[92072]: pgmap v17224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:49 smithi122 ceph-mon[125440]: pgmap v17224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:49 smithi136 ceph-mon[125702]: pgmap v17224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:51 smithi057 ceph-mon[92072]: pgmap v17225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:51 smithi122 ceph-mon[125440]: pgmap v17225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:51 smithi136 ceph-mon[125702]: pgmap v17225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:53 smithi057 ceph-mon[92072]: pgmap v17226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:53 smithi122 ceph-mon[125440]: pgmap v17226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:53 smithi136 ceph-mon[125702]: pgmap v17226: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:55 smithi057 ceph-mon[92072]: pgmap v17227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:55 smithi122 ceph-mon[125440]: pgmap v17227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:55 smithi136 ceph-mon[125702]: pgmap v17227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:57 smithi057 ceph-mon[92072]: pgmap v17228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:57 smithi122 ceph-mon[125440]: pgmap v17228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:57.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:57 smithi136 ceph-mon[125702]: pgmap v17228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:55:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:58.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:55:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:58.773+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:55:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:58.773+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:55:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:58.773+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:55:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:55:58.773+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:55:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:55:59 smithi057 ceph-mon[92072]: pgmap v17229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:55:59 smithi122 ceph-mon[125440]: pgmap v17229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:55:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:55:59 smithi136 ceph-mon[125702]: pgmap v17229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:01 smithi057 ceph-mon[92072]: pgmap v17230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:01 smithi122 ceph-mon[125440]: pgmap v17230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:01 smithi136 ceph-mon[125702]: pgmap v17230: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:03.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:03 smithi057 ceph-mon[92072]: pgmap v17231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:56:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:03 smithi122 ceph-mon[125440]: pgmap v17231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:56:03.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:03 smithi136 ceph-mon[125702]: pgmap v17231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:56:05.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:05 smithi057 ceph-mon[92072]: pgmap v17232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:56:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:05 smithi122 ceph-mon[125440]: pgmap v17232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:56:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:05 smithi136 ceph-mon[125702]: pgmap v17232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:56:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:56:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:56:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:56:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:56:06.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:56:06.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:56:06.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:56:06.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:56:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:56:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:56:06.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:56:06.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:56:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:07 smithi057 ceph-mon[92072]: pgmap v17233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:56:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:07 smithi057 ceph-mon[92072]: osdmap e1150: 12 total, 12 up, 12 in 2023-03-02T19:56:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:07 smithi122 ceph-mon[125440]: pgmap v17233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:56:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:07 smithi122 ceph-mon[125440]: osdmap e1150: 12 total, 12 up, 12 in 2023-03-02T19:56:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:07 smithi136 ceph-mon[125702]: pgmap v17233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:56:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:07 smithi136 ceph-mon[125702]: osdmap e1150: 12 total, 12 up, 12 in 2023-03-02T19:56:09.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:09 smithi057 ceph-mon[92072]: pgmap v17235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:56:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:09 smithi122 ceph-mon[125440]: pgmap v17235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:56:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:09 smithi136 ceph-mon[125702]: pgmap v17235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:56:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:11 smithi057 ceph-mon[92072]: pgmap v17236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:56:11.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:11 smithi122 ceph-mon[125440]: pgmap v17236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:56:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:11 smithi136 ceph-mon[125702]: pgmap v17236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:56:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:13.029+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:56:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:13.029+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:56:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:13.029+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 250 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:56:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:13.029+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 249 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:56:13.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:13 smithi057 ceph-mon[92072]: pgmap v17237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:56:13.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:13 smithi057 ceph-mon[92072]: osdmap e1151: 12 total, 12 up, 12 in 2023-03-02T19:56:13.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:13 smithi122 ceph-mon[125440]: pgmap v17237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:56:13.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:13 smithi122 ceph-mon[125440]: osdmap e1151: 12 total, 12 up, 12 in 2023-03-02T19:56:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:13.788+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:56:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:13.788+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:56:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:13.788+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:56:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:13.788+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:56:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:13.788+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:56:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:13 smithi136 ceph-mon[125702]: pgmap v17237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:56:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:13 smithi136 ceph-mon[125702]: osdmap e1151: 12 total, 12 up, 12 in 2023-03-02T19:56:15.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:15 smithi057 ceph-mon[92072]: pgmap v17239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:56:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:15 smithi122 ceph-mon[125440]: pgmap v17239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:56:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:15 smithi136 ceph-mon[125702]: pgmap v17239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:56:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:17 smithi057 ceph-mon[92072]: pgmap v17240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T19:56:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:17 smithi122 ceph-mon[125440]: pgmap v17240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T19:56:17.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:17 smithi136 ceph-mon[125702]: pgmap v17240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 213 B/s wr, 10 op/s 2023-03-02T19:56:19.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:19 smithi057 ceph-mon[92072]: pgmap v17241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:56:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:19 smithi122 ceph-mon[125440]: pgmap v17241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:56:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:19 smithi136 ceph-mon[125702]: pgmap v17241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:56:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:21 smithi057 ceph-mon[92072]: pgmap v17242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:56:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:21 smithi122 ceph-mon[125440]: pgmap v17242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:56:21.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:21 smithi136 ceph-mon[125702]: pgmap v17242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:56:23.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:23 smithi057 ceph-mon[92072]: pgmap v17243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:56:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:23 smithi122 ceph-mon[125440]: pgmap v17243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:56:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:23 smithi136 ceph-mon[125702]: pgmap v17243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:56:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:25 smithi057 ceph-mon[92072]: pgmap v17244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:56:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:25 smithi122 ceph-mon[125440]: pgmap v17244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:56:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:25 smithi136 ceph-mon[125702]: pgmap v17244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:56:27.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:27 smithi057 ceph-mon[92072]: pgmap v17245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:27 smithi122 ceph-mon[125440]: pgmap v17245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:27 smithi136 ceph-mon[125702]: pgmap v17245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:28.804+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:56:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:28.804+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:56:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:28.804+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:56:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:28.804+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:56:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:28.804+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:56:29.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:29 smithi122 ceph-mon[125440]: pgmap v17246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:56:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:29 smithi136 ceph-mon[125702]: pgmap v17246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:56:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:29 smithi057 ceph-mon[92072]: pgmap v17246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:56:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:31 smithi122 ceph-mon[125440]: pgmap v17247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:31 smithi136 ceph-mon[125702]: pgmap v17247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:31.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:31 smithi057 ceph-mon[92072]: pgmap v17247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:33 smithi122 ceph-mon[125440]: pgmap v17248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:33 smithi136 ceph-mon[125702]: pgmap v17248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:33 smithi057 ceph-mon[92072]: pgmap v17248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:35 smithi122 ceph-mon[125440]: pgmap v17249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:35.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:35 smithi136 ceph-mon[125702]: pgmap v17249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:35 smithi057 ceph-mon[92072]: pgmap v17249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:37 smithi122 ceph-mon[125440]: pgmap v17250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:37 smithi136 ceph-mon[125702]: pgmap v17250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:37 smithi057 ceph-mon[92072]: pgmap v17250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:39 smithi136 ceph-mon[125702]: pgmap v17251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:39 smithi057 ceph-mon[92072]: pgmap v17251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:39 smithi122 ceph-mon[125440]: pgmap v17251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:41 smithi136 ceph-mon[125702]: pgmap v17252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:41 smithi057 ceph-mon[92072]: pgmap v17252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:41 smithi122 ceph-mon[125440]: pgmap v17252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:43.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:56:43.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:43.819+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:56:43.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:43.819+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:56:43.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:43.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:56:43.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:43.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:56:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:43 smithi136 ceph-mon[125702]: pgmap v17253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:43.941 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:43 smithi057 ceph-mon[92072]: pgmap v17253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:43 smithi122 ceph-mon[125440]: pgmap v17253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:45 smithi136 ceph-mon[125702]: pgmap v17254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:45 smithi057 ceph-mon[92072]: pgmap v17254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:45 smithi122 ceph-mon[125440]: pgmap v17254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:47 smithi136 ceph-mon[125702]: pgmap v17255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:47 smithi057 ceph-mon[92072]: pgmap v17255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:47 smithi122 ceph-mon[125440]: pgmap v17255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:49 smithi136 ceph-mon[125702]: pgmap v17256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:49 smithi057 ceph-mon[92072]: pgmap v17256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:49 smithi122 ceph-mon[125440]: pgmap v17256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:51 smithi136 ceph-mon[125702]: pgmap v17257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:51 smithi057 ceph-mon[92072]: pgmap v17257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:51 smithi122 ceph-mon[125440]: pgmap v17257: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:53 smithi136 ceph-mon[125702]: pgmap v17258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:53 smithi057 ceph-mon[92072]: pgmap v17258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:53 smithi122 ceph-mon[125440]: pgmap v17258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:55 smithi136 ceph-mon[125702]: pgmap v17259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:55 smithi057 ceph-mon[92072]: pgmap v17259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:55 smithi122 ceph-mon[125440]: pgmap v17259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:57 smithi136 ceph-mon[125702]: pgmap v17260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:57 smithi057 ceph-mon[92072]: pgmap v17260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:57 smithi122 ceph-mon[125440]: pgmap v17260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:56:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:58.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:56:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:58.833+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:56:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:58.833+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:56:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:58.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:56:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:56:58.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:56:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:56:59 smithi136 ceph-mon[125702]: pgmap v17261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:56:59 smithi057 ceph-mon[92072]: pgmap v17261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:56:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:56:59 smithi122 ceph-mon[125440]: pgmap v17261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:01 smithi136 ceph-mon[125702]: pgmap v17262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:01 smithi057 ceph-mon[92072]: pgmap v17262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:01 smithi122 ceph-mon[125440]: pgmap v17262: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:03.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:03 smithi136 ceph-mon[125702]: pgmap v17263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:57:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:03 smithi057 ceph-mon[92072]: pgmap v17263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:57:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:03 smithi122 ceph-mon[125440]: pgmap v17263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:57:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:05 smithi136 ceph-mon[125702]: pgmap v17264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:57:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:05 smithi057 ceph-mon[92072]: pgmap v17264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:57:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:05 smithi122 ceph-mon[125440]: pgmap v17264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:57:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:57:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:57:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:57:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:07 smithi136 ceph-mon[125702]: pgmap v17265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:57:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:07 smithi136 ceph-mon[125702]: osdmap e1152: 12 total, 12 up, 12 in 2023-03-02T19:57:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:57:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:57:07.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:57:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:07 smithi057 ceph-mon[92072]: pgmap v17265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:57:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:07 smithi057 ceph-mon[92072]: osdmap e1152: 12 total, 12 up, 12 in 2023-03-02T19:57:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:57:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:57:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:57:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:07 smithi122 ceph-mon[125440]: pgmap v17265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T19:57:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:07 smithi122 ceph-mon[125440]: osdmap e1152: 12 total, 12 up, 12 in 2023-03-02T19:57:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:57:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:57:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:57:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:09 smithi136 ceph-mon[125702]: pgmap v17267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:57:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:09 smithi057 ceph-mon[92072]: pgmap v17267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:57:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:09 smithi122 ceph-mon[125440]: pgmap v17267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:57:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:11 smithi136 ceph-mon[125702]: pgmap v17268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:57:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:11 smithi057 ceph-mon[92072]: pgmap v17268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:57:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:11 smithi122 ceph-mon[125440]: pgmap v17268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:57:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:13 smithi136 ceph-mon[125702]: pgmap v17269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:57:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:13 smithi136 ceph-mon[125702]: osdmap e1153: 12 total, 12 up, 12 in 2023-03-02T19:57:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:13.849+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:57:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:13.850+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:57:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:13.850+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:57:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:13.850+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:57:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:13.850+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:57:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:13 smithi057 ceph-mon[92072]: pgmap v17269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:57:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:13 smithi057 ceph-mon[92072]: osdmap e1153: 12 total, 12 up, 12 in 2023-03-02T19:57:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:13 smithi122 ceph-mon[125440]: pgmap v17269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:57:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:13 smithi122 ceph-mon[125440]: osdmap e1153: 12 total, 12 up, 12 in 2023-03-02T19:57:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:15 smithi136 ceph-mon[125702]: pgmap v17271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:57:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:15 smithi057 ceph-mon[92072]: pgmap v17271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:57:15.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:15 smithi122 ceph-mon[125440]: pgmap v17271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:57:17.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:17 smithi136 ceph-mon[125702]: pgmap v17272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 11 op/s 2023-03-02T19:57:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:17 smithi057 ceph-mon[92072]: pgmap v17272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 11 op/s 2023-03-02T19:57:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:17 smithi122 ceph-mon[125440]: pgmap v17272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 11 op/s 2023-03-02T19:57:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:19 smithi057 ceph-mon[92072]: pgmap v17273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:57:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:19 smithi122 ceph-mon[125440]: pgmap v17273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:57:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:19 smithi136 ceph-mon[125702]: pgmap v17273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:57:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:21 smithi057 ceph-mon[92072]: pgmap v17274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:57:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:21 smithi122 ceph-mon[125440]: pgmap v17274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:57:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:21 smithi136 ceph-mon[125702]: pgmap v17274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:57:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:23 smithi057 ceph-mon[92072]: pgmap v17275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:57:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:23 smithi122 ceph-mon[125440]: pgmap v17275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:57:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:23 smithi136 ceph-mon[125702]: pgmap v17275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:57:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:25 smithi057 ceph-mon[92072]: pgmap v17276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:57:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:25 smithi122 ceph-mon[125440]: pgmap v17276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:57:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:25 smithi136 ceph-mon[125702]: pgmap v17276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:57:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:27 smithi057 ceph-mon[92072]: pgmap v17277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:27.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:27 smithi122 ceph-mon[125440]: pgmap v17277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:27 smithi136 ceph-mon[125702]: pgmap v17277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:28.861+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:57:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:28.861+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:57:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:28.862+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:57:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:28.862+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:57:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:28.862+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:57:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:29 smithi057 ceph-mon[92072]: pgmap v17278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:57:29.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:29 smithi122 ceph-mon[125440]: pgmap v17278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:57:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:29 smithi136 ceph-mon[125702]: pgmap v17278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:57:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:31 smithi057 ceph-mon[92072]: pgmap v17279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:31 smithi122 ceph-mon[125440]: pgmap v17279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:31 smithi136 ceph-mon[125702]: pgmap v17279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:33 smithi057 ceph-mon[92072]: pgmap v17280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:33 smithi122 ceph-mon[125440]: pgmap v17280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:33 smithi136 ceph-mon[125702]: pgmap v17280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:35.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:35 smithi057 ceph-mon[92072]: pgmap v17281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:35 smithi122 ceph-mon[125440]: pgmap v17281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:35 smithi136 ceph-mon[125702]: pgmap v17281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:37.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:37 smithi057 ceph-mon[92072]: pgmap v17282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:37.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:37 smithi122 ceph-mon[125440]: pgmap v17282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:37 smithi136 ceph-mon[125702]: pgmap v17282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:39 smithi057 ceph-mon[92072]: pgmap v17283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:39 smithi122 ceph-mon[125440]: pgmap v17283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:39 smithi136 ceph-mon[125702]: pgmap v17283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:41 smithi057 ceph-mon[92072]: pgmap v17284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:41 smithi122 ceph-mon[125440]: pgmap v17284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:41 smithi136 ceph-mon[125702]: pgmap v17284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:43.877+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:57:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:43.877+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:57:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:43.877+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:57:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:43.877+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:57:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:43.878+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:57:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:43 smithi057 ceph-mon[92072]: pgmap v17285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:43 smithi122 ceph-mon[125440]: pgmap v17285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:43 smithi136 ceph-mon[125702]: pgmap v17285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:45 smithi057 ceph-mon[92072]: pgmap v17286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:45 smithi122 ceph-mon[125440]: pgmap v17286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:45 smithi136 ceph-mon[125702]: pgmap v17286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:47.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:47 smithi057 ceph-mon[92072]: pgmap v17287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:47 smithi122 ceph-mon[125440]: pgmap v17287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:47 smithi136 ceph-mon[125702]: pgmap v17287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:49 smithi057 ceph-mon[92072]: pgmap v17288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:49 smithi122 ceph-mon[125440]: pgmap v17288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:49 smithi136 ceph-mon[125702]: pgmap v17288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:51 smithi057 ceph-mon[92072]: pgmap v17289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:51 smithi122 ceph-mon[125440]: pgmap v17289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:51 smithi136 ceph-mon[125702]: pgmap v17289: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:53 smithi057 ceph-mon[92072]: pgmap v17290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:53 smithi122 ceph-mon[125440]: pgmap v17290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:53 smithi136 ceph-mon[125702]: pgmap v17290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:57:55.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:55 smithi122 ceph-mon[125440]: pgmap v17291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:55 smithi136 ceph-mon[125702]: pgmap v17291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:56.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:55 smithi057 ceph-mon[92072]: pgmap v17291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:57 smithi122 ceph-mon[125440]: pgmap v17292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:57 smithi136 ceph-mon[125702]: pgmap v17292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:57 smithi057 ceph-mon[92072]: pgmap v17292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:57:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:58.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:57:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:58.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:57:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:58.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:57:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:58.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:57:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:57:58.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:57:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:57:59 smithi122 ceph-mon[125440]: pgmap v17293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:57:59 smithi136 ceph-mon[125702]: pgmap v17293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:57:59 smithi057 ceph-mon[92072]: pgmap v17293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:01 smithi122 ceph-mon[125440]: pgmap v17294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:01 smithi136 ceph-mon[125702]: pgmap v17294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:01 smithi057 ceph-mon[92072]: pgmap v17294: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:03 smithi136 ceph-mon[125702]: pgmap v17295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:58:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:03 smithi057 ceph-mon[92072]: pgmap v17295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:58:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:03 smithi122 ceph-mon[125440]: pgmap v17295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:58:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:05 smithi136 ceph-mon[125702]: pgmap v17296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:58:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:05 smithi057 ceph-mon[92072]: pgmap v17296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:58:06.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:05 smithi122 ceph-mon[125440]: pgmap v17296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:58:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:07 smithi136 ceph-mon[125702]: pgmap v17297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:58:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:07 smithi136 ceph-mon[125702]: osdmap e1154: 12 total, 12 up, 12 in 2023-03-02T19:58:08.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:58:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:07 smithi057 ceph-mon[92072]: pgmap v17297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:58:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:07 smithi057 ceph-mon[92072]: osdmap e1154: 12 total, 12 up, 12 in 2023-03-02T19:58:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:58:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:07 smithi122 ceph-mon[125440]: pgmap v17297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:58:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:07 smithi122 ceph-mon[125440]: osdmap e1154: 12 total, 12 up, 12 in 2023-03-02T19:58:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:58:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:58:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:58:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:58:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:58:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:58:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:58:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:58:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:58:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:58:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:09 smithi136 ceph-mon[125702]: pgmap v17299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:58:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:09 smithi057 ceph-mon[92072]: pgmap v17299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:58:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:09 smithi122 ceph-mon[125440]: pgmap v17299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:58:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:11 smithi136 ceph-mon[125702]: pgmap v17300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:58:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:11 smithi057 ceph-mon[92072]: pgmap v17300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:58:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:11 smithi122 ceph-mon[125440]: pgmap v17300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:58:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:13.904+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:58:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:13.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:58:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:13.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:58:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:13.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:58:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:13.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:58:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:13 smithi136 ceph-mon[125702]: pgmap v17301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:58:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:13 smithi136 ceph-mon[125702]: osdmap e1155: 12 total, 12 up, 12 in 2023-03-02T19:58:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:13 smithi057 ceph-mon[92072]: pgmap v17301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:58:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:13 smithi057 ceph-mon[92072]: osdmap e1155: 12 total, 12 up, 12 in 2023-03-02T19:58:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:13 smithi122 ceph-mon[125440]: pgmap v17301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:58:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:13 smithi122 ceph-mon[125440]: osdmap e1155: 12 total, 12 up, 12 in 2023-03-02T19:58:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:15 smithi136 ceph-mon[125702]: pgmap v17303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:58:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:15 smithi057 ceph-mon[92072]: pgmap v17303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:58:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:15 smithi122 ceph-mon[125440]: pgmap v17303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:58:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:17 smithi136 ceph-mon[125702]: pgmap v17304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T19:58:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:17 smithi057 ceph-mon[92072]: pgmap v17304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T19:58:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:17 smithi122 ceph-mon[125440]: pgmap v17304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T19:58:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:19 smithi136 ceph-mon[125702]: pgmap v17305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:58:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:19 smithi057 ceph-mon[92072]: pgmap v17305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:58:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:19 smithi122 ceph-mon[125440]: pgmap v17305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:58:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:21 smithi136 ceph-mon[125702]: pgmap v17306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:58:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:21 smithi057 ceph-mon[92072]: pgmap v17306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:58:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:21 smithi122 ceph-mon[125440]: pgmap v17306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:58:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:23 smithi136 ceph-mon[125702]: pgmap v17307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:58:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:23 smithi057 ceph-mon[92072]: pgmap v17307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:58:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:23 smithi122 ceph-mon[125440]: pgmap v17307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T19:58:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:25 smithi136 ceph-mon[125702]: pgmap v17308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:58:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:25 smithi057 ceph-mon[92072]: pgmap v17308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:58:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:25 smithi122 ceph-mon[125440]: pgmap v17308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T19:58:28.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:27 smithi136 ceph-mon[125702]: pgmap v17309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:27 smithi057 ceph-mon[92072]: pgmap v17309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:27 smithi122 ceph-mon[125440]: pgmap v17309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:28.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:58:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:28.921+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:58:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:28.921+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:58:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:28.921+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:58:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:28.921+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:58:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:29 smithi136 ceph-mon[125702]: pgmap v17310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:58:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:29 smithi057 ceph-mon[92072]: pgmap v17310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:58:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:29 smithi122 ceph-mon[125440]: pgmap v17310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T19:58:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:31 smithi136 ceph-mon[125702]: pgmap v17311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:31 smithi057 ceph-mon[92072]: pgmap v17311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:31 smithi122 ceph-mon[125440]: pgmap v17311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:33 smithi136 ceph-mon[125702]: pgmap v17312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:33 smithi057 ceph-mon[92072]: pgmap v17312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:33 smithi122 ceph-mon[125440]: pgmap v17312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:35 smithi136 ceph-mon[125702]: pgmap v17313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:36.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:35 smithi057 ceph-mon[92072]: pgmap v17313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:35 smithi122 ceph-mon[125440]: pgmap v17313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:37 smithi136 ceph-mon[125702]: pgmap v17314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:37 smithi057 ceph-mon[92072]: pgmap v17314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:37 smithi122 ceph-mon[125440]: pgmap v17314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:39 smithi136 ceph-mon[125702]: pgmap v17315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:40.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:39 smithi057 ceph-mon[92072]: pgmap v17315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:39 smithi122 ceph-mon[125440]: pgmap v17315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:41 smithi136 ceph-mon[125702]: pgmap v17316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:41 smithi057 ceph-mon[92072]: pgmap v17316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:42.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:41 smithi122 ceph-mon[125440]: pgmap v17316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:43.936+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:58:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:43.937+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:58:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:43.937+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:58:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:43.937+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:58:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:43.937+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:58:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:43 smithi136 ceph-mon[125702]: pgmap v17317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:43 smithi057 ceph-mon[92072]: pgmap v17317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:43 smithi122 ceph-mon[125440]: pgmap v17317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:45 smithi136 ceph-mon[125702]: pgmap v17318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:45 smithi057 ceph-mon[92072]: pgmap v17318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:45 smithi122 ceph-mon[125440]: pgmap v17318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:48.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:47 smithi136 ceph-mon[125702]: pgmap v17319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:47 smithi057 ceph-mon[92072]: pgmap v17319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:47 smithi122 ceph-mon[125440]: pgmap v17319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:49 smithi136 ceph-mon[125702]: pgmap v17320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:49 smithi057 ceph-mon[92072]: pgmap v17320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:49 smithi122 ceph-mon[125440]: pgmap v17320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:51 smithi057 ceph-mon[92072]: pgmap v17321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:51 smithi122 ceph-mon[125440]: pgmap v17321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:51 smithi136 ceph-mon[125702]: pgmap v17321: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:53 smithi057 ceph-mon[92072]: pgmap v17322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:53 smithi122 ceph-mon[125440]: pgmap v17322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:53 smithi136 ceph-mon[125702]: pgmap v17322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:58:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:55 smithi057 ceph-mon[92072]: pgmap v17323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:56.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:55 smithi122 ceph-mon[125440]: pgmap v17323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:55 smithi136 ceph-mon[125702]: pgmap v17323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:57 smithi057 ceph-mon[92072]: pgmap v17324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:57 smithi122 ceph-mon[125440]: pgmap v17324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:57 smithi136 ceph-mon[125702]: pgmap v17324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:58:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:58.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:58:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:58.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:58:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:58.942+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:58:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:58.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:58:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:58:58.942+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:59:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:58:59 smithi057 ceph-mon[92072]: pgmap v17325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:58:59 smithi122 ceph-mon[125440]: pgmap v17325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:58:59 smithi136 ceph-mon[125702]: pgmap v17325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:01 smithi057 ceph-mon[92072]: pgmap v17326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:01 smithi122 ceph-mon[125440]: pgmap v17326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:01 smithi136 ceph-mon[125702]: pgmap v17326: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:03 smithi057 ceph-mon[92072]: pgmap v17327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:59:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:03 smithi122 ceph-mon[125440]: pgmap v17327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:59:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:03 smithi136 ceph-mon[125702]: pgmap v17327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T19:59:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:05 smithi057 ceph-mon[92072]: pgmap v17328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:59:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:05 smithi122 ceph-mon[125440]: pgmap v17328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:59:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:05 smithi136 ceph-mon[125702]: pgmap v17328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:59:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:07 smithi057 ceph-mon[92072]: pgmap v17329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:59:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:07 smithi057 ceph-mon[92072]: osdmap e1156: 12 total, 12 up, 12 in 2023-03-02T19:59:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:07 smithi122 ceph-mon[125440]: pgmap v17329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:59:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:07 smithi122 ceph-mon[125440]: osdmap e1156: 12 total, 12 up, 12 in 2023-03-02T19:59:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:07 smithi136 ceph-mon[125702]: pgmap v17329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T19:59:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:07 smithi136 ceph-mon[125702]: osdmap e1156: 12 total, 12 up, 12 in 2023-03-02T19:59:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:08.426+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-02T19:59:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:08.426+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-02T19:59:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:08.426+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870096000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:59:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:08.426+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870096000 comp rx=0 tx=0).stop 2023-03-02T19:59:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:08.426+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.57:6800/1603975717, fault. 2023-03-02T19:59:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:08.426+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T19:59:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:08.426+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T19:59:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:08.426+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T19:59:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:08.426+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:59:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:08.426+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f5870019780 tx=0x7f5870056000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T19:59:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:59:09.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:59:09.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T19:59:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:09 smithi057 ceph-mon[92072]: pgmap v17331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:59:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:59:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:59:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:59:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:09 smithi122 ceph-mon[125440]: pgmap v17331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:59:10.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:59:10.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:59:10.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:59:10.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:09 smithi136 ceph-mon[125702]: pgmap v17331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:59:10.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T19:59:10.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T19:59:10.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T19:59:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:11 smithi057 ceph-mon[92072]: pgmap v17332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:59:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:11 smithi122 ceph-mon[125440]: pgmap v17332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:59:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:11 smithi136 ceph-mon[125702]: pgmap v17332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T19:59:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:13.054+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:59:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:13.054+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:59:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:13.055+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 250 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T19:59:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:13.055+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 251 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T19:59:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:13.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:59:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:13.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:59:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:13.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:59:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:13.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:59:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:13.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:59:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:13 smithi057 ceph-mon[92072]: pgmap v17333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:59:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:13 smithi057 ceph-mon[92072]: osdmap e1157: 12 total, 12 up, 12 in 2023-03-02T19:59:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:13 smithi122 ceph-mon[125440]: pgmap v17333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:59:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:13 smithi122 ceph-mon[125440]: osdmap e1157: 12 total, 12 up, 12 in 2023-03-02T19:59:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:13 smithi136 ceph-mon[125702]: pgmap v17333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T19:59:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:13 smithi136 ceph-mon[125702]: osdmap e1157: 12 total, 12 up, 12 in 2023-03-02T19:59:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:15 smithi057 ceph-mon[92072]: pgmap v17335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:59:16.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:15 smithi122 ceph-mon[125440]: pgmap v17335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:59:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:15 smithi136 ceph-mon[125702]: pgmap v17335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T19:59:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:17 smithi057 ceph-mon[92072]: pgmap v17336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T19:59:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:17 smithi122 ceph-mon[125440]: pgmap v17336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T19:59:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:17 smithi136 ceph-mon[125702]: pgmap v17336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T19:59:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:19 smithi057 ceph-mon[92072]: pgmap v17337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:59:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:19 smithi122 ceph-mon[125440]: pgmap v17337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:59:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:19 smithi136 ceph-mon[125702]: pgmap v17337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:59:22.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:21 smithi057 ceph-mon[92072]: pgmap v17338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:59:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:21 smithi122 ceph-mon[125440]: pgmap v17338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:59:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:21 smithi136 ceph-mon[125702]: pgmap v17338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T19:59:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:23 smithi057 ceph-mon[92072]: pgmap v17339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:59:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:23 smithi122 ceph-mon[125440]: pgmap v17339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:59:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:23 smithi136 ceph-mon[125702]: pgmap v17339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T19:59:25.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:24 smithi122 ceph-mon[125440]: pgmap v17340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:59:25.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:24 smithi136 ceph-mon[125702]: pgmap v17340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:59:25.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:24 smithi057 ceph-mon[92072]: pgmap v17340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T19:59:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:27 smithi057 ceph-mon[92072]: pgmap v17341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:27.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:27 smithi122 ceph-mon[125440]: pgmap v17341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:27.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:27 smithi136 ceph-mon[125702]: pgmap v17341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:28.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:28.968+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:59:28.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:28.968+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:59:28.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:28.968+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:59:28.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:28.968+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:59:28.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:28.968+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:59:29.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:29 smithi057 ceph-mon[92072]: pgmap v17342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:29.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:29 smithi122 ceph-mon[125440]: pgmap v17342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:29 smithi136 ceph-mon[125702]: pgmap v17342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:31.689 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:31 smithi057 ceph-mon[92072]: pgmap v17343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:31.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:31 smithi122 ceph-mon[125440]: pgmap v17343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:31 smithi136 ceph-mon[125702]: pgmap v17343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:33 smithi057 ceph-mon[92072]: pgmap v17344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:33 smithi122 ceph-mon[125440]: pgmap v17344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:33 smithi136 ceph-mon[125702]: pgmap v17344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:35.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:35 smithi057 ceph-mon[92072]: pgmap v17345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:35.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:35 smithi122 ceph-mon[125440]: pgmap v17345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:35.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:35 smithi136 ceph-mon[125702]: pgmap v17345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:37.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:37 smithi057 ceph-mon[92072]: pgmap v17346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:37 smithi122 ceph-mon[125440]: pgmap v17346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:37 smithi136 ceph-mon[125702]: pgmap v17346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:39.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:39 smithi057 ceph-mon[92072]: pgmap v17347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:39.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:39 smithi122 ceph-mon[125440]: pgmap v17347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:39 smithi136 ceph-mon[125702]: pgmap v17347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:41 smithi057 ceph-mon[92072]: pgmap v17348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:41 smithi122 ceph-mon[125440]: pgmap v17348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:41.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:41 smithi136 ceph-mon[125702]: pgmap v17348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:43.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:43 smithi122 ceph-mon[125440]: pgmap v17349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:43 smithi136 ceph-mon[125702]: pgmap v17349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:43 smithi057 ceph-mon[92072]: pgmap v17349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:43.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:59:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:43.982+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:59:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:43.982+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:59:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:43.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:59:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:43.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:59:45.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:45 smithi122 ceph-mon[125440]: pgmap v17350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:45 smithi136 ceph-mon[125702]: pgmap v17350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:45 smithi057 ceph-mon[92072]: pgmap v17350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:47.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:47 smithi122 ceph-mon[125440]: pgmap v17351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:47 smithi136 ceph-mon[125702]: pgmap v17351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:47.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:47 smithi057 ceph-mon[92072]: pgmap v17351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:49 smithi136 ceph-mon[125702]: pgmap v17352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:49 smithi057 ceph-mon[92072]: pgmap v17352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:49.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:49 smithi122 ceph-mon[125440]: pgmap v17352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:51 smithi136 ceph-mon[125702]: pgmap v17353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:51 smithi057 ceph-mon[92072]: pgmap v17353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:51 smithi122 ceph-mon[125440]: pgmap v17353: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:53 smithi136 ceph-mon[125702]: pgmap v17354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:53.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:53 smithi057 ceph-mon[92072]: pgmap v17354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:53 smithi122 ceph-mon[125440]: pgmap v17354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:55 smithi136 ceph-mon[125702]: pgmap v17355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:55.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:55 smithi057 ceph-mon[92072]: pgmap v17355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:55 smithi122 ceph-mon[125440]: pgmap v17355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:57 smithi136 ceph-mon[125702]: pgmap v17356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:57 smithi057 ceph-mon[92072]: pgmap v17356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:57.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:57 smithi122 ceph-mon[125440]: pgmap v17356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T19:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:58.993+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T19:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:58.993+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T19:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:58.993+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T19:59:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:58.993+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T19:59:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T19:59:58.993+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T19:59:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 19:59:59 smithi136 ceph-mon[125702]: pgmap v17357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 19:59:59 smithi057 ceph-mon[92072]: pgmap v17357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T19:59:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 19:59:59 smithi122 ceph-mon[125440]: pgmap v17357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T20:00:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T20:00:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T20:00:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:01 smithi136 ceph-mon[125702]: pgmap v17358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:01 smithi057 ceph-mon[92072]: pgmap v17358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:01 smithi122 ceph-mon[125440]: pgmap v17358: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:03.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:03 smithi136 ceph-mon[125702]: pgmap v17359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:00:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:03 smithi057 ceph-mon[92072]: pgmap v17359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:00:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:03 smithi122 ceph-mon[125440]: pgmap v17359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:00:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:05 smithi136 ceph-mon[125702]: pgmap v17360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:00:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:05 smithi057 ceph-mon[92072]: pgmap v17360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:00:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:05 smithi122 ceph-mon[125440]: pgmap v17360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:00:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:07 smithi136 ceph-mon[125702]: pgmap v17361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:00:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:07 smithi136 ceph-mon[125702]: osdmap e1158: 12 total, 12 up, 12 in 2023-03-02T20:00:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:07 smithi057 ceph-mon[92072]: pgmap v17361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:00:07.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:07 smithi057 ceph-mon[92072]: osdmap e1158: 12 total, 12 up, 12 in 2023-03-02T20:00:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:07 smithi122 ceph-mon[125440]: pgmap v17361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:00:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:07 smithi122 ceph-mon[125440]: osdmap e1158: 12 total, 12 up, 12 in 2023-03-02T20:00:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:09 smithi136 ceph-mon[125702]: pgmap v17363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:00:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:00:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:09 smithi057 ceph-mon[92072]: pgmap v17363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:00:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:00:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:09 smithi122 ceph-mon[125440]: pgmap v17363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:00:09.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:00:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:00:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:00:10.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:00:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:00:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:00:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:00:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:00:10.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:00:10.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:00:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:11 smithi136 ceph-mon[125702]: pgmap v17364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:00:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:11 smithi057 ceph-mon[92072]: pgmap v17364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:00:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:11 smithi122 ceph-mon[125440]: pgmap v17364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:14.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:14.010+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:00:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:14.010+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:00:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:14.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:00:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:14.010+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:00:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:13 smithi057 ceph-mon[92072]: pgmap v17365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:00:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:13 smithi057 ceph-mon[92072]: osdmap e1159: 12 total, 12 up, 12 in 2023-03-02T20:00:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:13 smithi122 ceph-mon[125440]: pgmap v17365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:00:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:13 smithi122 ceph-mon[125440]: osdmap e1159: 12 total, 12 up, 12 in 2023-03-02T20:00:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:13 smithi136 ceph-mon[125702]: pgmap v17365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:00:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:13 smithi136 ceph-mon[125702]: osdmap e1159: 12 total, 12 up, 12 in 2023-03-02T20:00:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:15 smithi057 ceph-mon[92072]: pgmap v17367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:00:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:15 smithi122 ceph-mon[125440]: pgmap v17367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:00:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:15 smithi136 ceph-mon[125702]: pgmap v17367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:00:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:17 smithi057 ceph-mon[92072]: pgmap v17368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:00:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:17 smithi122 ceph-mon[125440]: pgmap v17368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:00:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:17 smithi136 ceph-mon[125702]: pgmap v17368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:00:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:19 smithi057 ceph-mon[92072]: pgmap v17369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:00:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:19 smithi122 ceph-mon[125440]: pgmap v17369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:00:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:19 smithi136 ceph-mon[125702]: pgmap v17369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:00:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:21 smithi057 ceph-mon[92072]: pgmap v17370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:00:22.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:21 smithi122 ceph-mon[125440]: pgmap v17370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:00:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:21 smithi136 ceph-mon[125702]: pgmap v17370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:00:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:23 smithi057 ceph-mon[92072]: pgmap v17371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:00:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:23 smithi122 ceph-mon[125440]: pgmap v17371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:00:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:23 smithi136 ceph-mon[125702]: pgmap v17371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:00:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:25 smithi057 ceph-mon[92072]: pgmap v17372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:00:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:25 smithi122 ceph-mon[125440]: pgmap v17372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:00:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:25 smithi136 ceph-mon[125702]: pgmap v17372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:00:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:27 smithi057 ceph-mon[92072]: pgmap v17373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:27 smithi122 ceph-mon[125440]: pgmap v17373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:27 smithi136 ceph-mon[125702]: pgmap v17373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:29.022 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:29.020+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:00:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:29.020+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:00:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:29.020+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:00:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:29.020+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:00:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:29.020+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:00:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:29 smithi057 ceph-mon[92072]: pgmap v17374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:30.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:29 smithi122 ceph-mon[125440]: pgmap v17374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:29 smithi136 ceph-mon[125702]: pgmap v17374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:31 smithi057 ceph-mon[92072]: pgmap v17375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:00:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:31 smithi122 ceph-mon[125440]: pgmap v17375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:00:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:31 smithi136 ceph-mon[125702]: pgmap v17375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:00:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:33 smithi057 ceph-mon[92072]: pgmap v17376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:33 smithi122 ceph-mon[125440]: pgmap v17376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:33 smithi136 ceph-mon[125702]: pgmap v17376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:35 smithi057 ceph-mon[92072]: pgmap v17377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:00:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:35 smithi122 ceph-mon[125440]: pgmap v17377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:00:36.352 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:35 smithi136 ceph-mon[125702]: pgmap v17377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:00:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:37 smithi057 ceph-mon[92072]: pgmap v17378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:00:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:37 smithi122 ceph-mon[125440]: pgmap v17378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:00:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:37 smithi136 ceph-mon[125702]: pgmap v17378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:00:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:39 smithi136 ceph-mon[125702]: pgmap v17379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:39 smithi057 ceph-mon[92072]: pgmap v17379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:39 smithi122 ceph-mon[125440]: pgmap v17379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:41 smithi057 ceph-mon[92072]: pgmap v17380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:42.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:41 smithi122 ceph-mon[125440]: pgmap v17380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:41 smithi136 ceph-mon[125702]: pgmap v17380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:44.027+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:00:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:44.028+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:00:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:44.028+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:00:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:44.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:00:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:44.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:00:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:43 smithi122 ceph-mon[125440]: pgmap v17381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:43 smithi136 ceph-mon[125702]: pgmap v17381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:43 smithi057 ceph-mon[92072]: pgmap v17381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:44 smithi122 ceph-mon[125440]: pgmap v17382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:44 smithi136 ceph-mon[125702]: pgmap v17382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:44 smithi057 ceph-mon[92072]: pgmap v17382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:47.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:47 smithi057 ceph-mon[92072]: pgmap v17383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:47.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:47 smithi122 ceph-mon[125440]: pgmap v17383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:47.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:47 smithi136 ceph-mon[125702]: pgmap v17383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:49.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:49 smithi057 ceph-mon[92072]: pgmap v17384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:49 smithi122 ceph-mon[125440]: pgmap v17384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:49.779 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:49 smithi136 ceph-mon[125702]: pgmap v17384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:51 smithi057 ceph-mon[92072]: pgmap v17385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:51 smithi122 ceph-mon[125440]: pgmap v17385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:51 smithi136 ceph-mon[125702]: pgmap v17385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:53.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:53 smithi057 ceph-mon[92072]: pgmap v17386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:53 smithi122 ceph-mon[125440]: pgmap v17386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:53 smithi136 ceph-mon[125702]: pgmap v17386: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:55.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:55 smithi057 ceph-mon[92072]: pgmap v17387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:55.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:55 smithi122 ceph-mon[125440]: pgmap v17387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:55 smithi136 ceph-mon[125702]: pgmap v17387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:57 smithi122 ceph-mon[125440]: pgmap v17388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:57 smithi136 ceph-mon[125702]: pgmap v17388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:57.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:57 smithi057 ceph-mon[92072]: pgmap v17388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:00:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:59.044+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:00:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:59.044+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:00:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:59.044+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:00:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:59.044+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:00:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:00:59.044+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:00:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:00:59 smithi122 ceph-mon[125440]: pgmap v17389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:00:59 smithi136 ceph-mon[125702]: pgmap v17389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:00:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:00:59 smithi057 ceph-mon[92072]: pgmap v17389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:01 smithi122 ceph-mon[125440]: pgmap v17390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:01.819 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:01 smithi136 ceph-mon[125702]: pgmap v17390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:01 smithi057 ceph-mon[92072]: pgmap v17390: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:03 smithi122 ceph-mon[125440]: pgmap v17391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:01:03.756 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:03 smithi136 ceph-mon[125702]: pgmap v17391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:01:03.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:03 smithi057 ceph-mon[92072]: pgmap v17391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:01:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:05 smithi122 ceph-mon[125440]: pgmap v17392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:01:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:05 smithi136 ceph-mon[125702]: pgmap v17392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:01:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:05 smithi057 ceph-mon[92072]: pgmap v17392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:01:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:07 smithi136 ceph-mon[125702]: pgmap v17393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:01:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:07 smithi057 ceph-mon[92072]: pgmap v17393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:01:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:07 smithi122 ceph-mon[125440]: pgmap v17393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:01:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:09 smithi136 ceph-mon[125702]: pgmap v17394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:01:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:09 smithi057 ceph-mon[92072]: pgmap v17394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:01:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:09 smithi122 ceph-mon[125440]: pgmap v17394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:01:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:01:10.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:01:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:01:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:11 smithi136 ceph-mon[125702]: pgmap v17395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:01:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:01:11.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:01:11.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:01:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:11 smithi057 ceph-mon[92072]: pgmap v17395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:01:11.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:01:11.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:01:11.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:01:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:11 smithi122 ceph-mon[125440]: pgmap v17395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:01:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:01:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:01:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:01:13.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:12 smithi136 ceph-mon[125702]: osdmap e1160: 12 total, 12 up, 12 in 2023-03-02T20:01:13.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:12 smithi057 ceph-mon[92072]: osdmap e1160: 12 total, 12 up, 12 in 2023-03-02T20:01:13.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:12 smithi122 ceph-mon[125440]: osdmap e1160: 12 total, 12 up, 12 in 2023-03-02T20:01:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:14.054+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:01:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:14.054+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:01:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:14.054+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:01:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:14.054+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:01:14.058 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:14.054+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:01:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:13 smithi136 ceph-mon[125702]: pgmap v17397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:13 smithi057 ceph-mon[92072]: pgmap v17397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:13 smithi122 ceph-mon[125440]: pgmap v17397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:16.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:15 smithi136 ceph-mon[125702]: pgmap v17398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:15 smithi057 ceph-mon[92072]: pgmap v17398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:16.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:15 smithi122 ceph-mon[125440]: pgmap v17398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:17 smithi136 ceph-mon[125702]: pgmap v17399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:17 smithi057 ceph-mon[92072]: pgmap v17399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:17 smithi122 ceph-mon[125440]: pgmap v17399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:19 smithi136 ceph-mon[125702]: pgmap v17400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:01:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:19 smithi057 ceph-mon[92072]: pgmap v17400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:01:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:19 smithi122 ceph-mon[125440]: pgmap v17400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:01:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:21 smithi136 ceph-mon[125702]: pgmap v17401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:01:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:21 smithi057 ceph-mon[92072]: pgmap v17401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:01:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:21 smithi122 ceph-mon[125440]: pgmap v17401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:01:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:23 smithi136 ceph-mon[125702]: pgmap v17402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 197 B/s wr, 9 op/s 2023-03-02T20:01:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:23 smithi136 ceph-mon[125702]: osdmap e1161: 12 total, 12 up, 12 in 2023-03-02T20:01:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:23 smithi057 ceph-mon[92072]: pgmap v17402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 197 B/s wr, 9 op/s 2023-03-02T20:01:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:23 smithi057 ceph-mon[92072]: osdmap e1161: 12 total, 12 up, 12 in 2023-03-02T20:01:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:23 smithi122 ceph-mon[125440]: pgmap v17402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 197 B/s wr, 9 op/s 2023-03-02T20:01:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:23 smithi122 ceph-mon[125440]: osdmap e1161: 12 total, 12 up, 12 in 2023-03-02T20:01:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:25 smithi136 ceph-mon[125702]: pgmap v17404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:25 smithi057 ceph-mon[92072]: pgmap v17404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:25 smithi122 ceph-mon[125440]: pgmap v17404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:27 smithi136 ceph-mon[125702]: pgmap v17405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:27 smithi057 ceph-mon[92072]: pgmap v17405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:27 smithi122 ceph-mon[125440]: pgmap v17405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:01:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:29.063+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:01:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:29.064+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:01:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:29.064+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:01:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:29.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:01:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:29.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:01:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:29 smithi136 ceph-mon[125702]: pgmap v17406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:01:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:29 smithi057 ceph-mon[92072]: pgmap v17406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:01:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:29 smithi122 ceph-mon[125440]: pgmap v17406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:01:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:31 smithi136 ceph-mon[125702]: pgmap v17407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:01:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:31 smithi057 ceph-mon[92072]: pgmap v17407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:01:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:31 smithi122 ceph-mon[125440]: pgmap v17407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:01:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:33 smithi136 ceph-mon[125702]: pgmap v17408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:01:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:33 smithi057 ceph-mon[92072]: pgmap v17408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:01:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:33 smithi122 ceph-mon[125440]: pgmap v17408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:01:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:35 smithi136 ceph-mon[125702]: pgmap v17409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:01:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:35 smithi057 ceph-mon[92072]: pgmap v17409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:01:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:35 smithi122 ceph-mon[125440]: pgmap v17409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:01:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:37 smithi136 ceph-mon[125702]: pgmap v17410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:37 smithi057 ceph-mon[92072]: pgmap v17410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:37 smithi122 ceph-mon[125440]: pgmap v17410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:39 smithi136 ceph-mon[125702]: pgmap v17411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:39 smithi057 ceph-mon[92072]: pgmap v17411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:39 smithi122 ceph-mon[125440]: pgmap v17411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:41 smithi136 ceph-mon[125702]: pgmap v17412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:41 smithi057 ceph-mon[92072]: pgmap v17412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:42.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:41 smithi122 ceph-mon[125440]: pgmap v17412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:44.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:01:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:44.077+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:01:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:44.077+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:01:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:44.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:01:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:44.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:01:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:43 smithi136 ceph-mon[125702]: pgmap v17413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:43 smithi057 ceph-mon[92072]: pgmap v17413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:43 smithi122 ceph-mon[125440]: pgmap v17413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:45 smithi136 ceph-mon[125702]: pgmap v17414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:45 smithi057 ceph-mon[92072]: pgmap v17414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:45 smithi122 ceph-mon[125440]: pgmap v17414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:47 smithi136 ceph-mon[125702]: pgmap v17415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:47 smithi057 ceph-mon[92072]: pgmap v17415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:47 smithi122 ceph-mon[125440]: pgmap v17415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:49 smithi136 ceph-mon[125702]: pgmap v17416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:49 smithi057 ceph-mon[92072]: pgmap v17416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:49 smithi122 ceph-mon[125440]: pgmap v17416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:51 smithi136 ceph-mon[125702]: pgmap v17417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:51 smithi057 ceph-mon[92072]: pgmap v17417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:51 smithi122 ceph-mon[125440]: pgmap v17417: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:53 smithi057 ceph-mon[92072]: pgmap v17418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:53 smithi122 ceph-mon[125440]: pgmap v17418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:53 smithi136 ceph-mon[125702]: pgmap v17418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:01:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:55 smithi057 ceph-mon[92072]: pgmap v17419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:55 smithi122 ceph-mon[125440]: pgmap v17419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:55 smithi136 ceph-mon[125702]: pgmap v17419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:58.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:57 smithi057 ceph-mon[92072]: pgmap v17420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:57 smithi122 ceph-mon[125440]: pgmap v17420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:57 smithi136 ceph-mon[125702]: pgmap v17420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:01:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:59.083+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:01:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:59.083+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:01:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:59.083+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:01:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:59.083+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:01:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:01:59.083+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:02:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:01:59 smithi057 ceph-mon[92072]: pgmap v17421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:00.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:01:59 smithi122 ceph-mon[125440]: pgmap v17421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:01:59 smithi136 ceph-mon[125702]: pgmap v17421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:01 smithi057 ceph-mon[92072]: pgmap v17422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:01 smithi122 ceph-mon[125440]: pgmap v17422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:01 smithi136 ceph-mon[125702]: pgmap v17422: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:03 smithi057 ceph-mon[92072]: pgmap v17423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:02:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:03 smithi122 ceph-mon[125440]: pgmap v17423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:02:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:03 smithi136 ceph-mon[125702]: pgmap v17423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:02:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:05 smithi057 ceph-mon[92072]: pgmap v17424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:02:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:05 smithi122 ceph-mon[125440]: pgmap v17424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:02:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:05 smithi136 ceph-mon[125702]: pgmap v17424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:02:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:07 smithi057 ceph-mon[92072]: pgmap v17425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:02:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:07 smithi057 ceph-mon[92072]: osdmap e1162: 12 total, 12 up, 12 in 2023-03-02T20:02:08.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:07 smithi122 ceph-mon[125440]: pgmap v17425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:02:08.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:07 smithi122 ceph-mon[125440]: osdmap e1162: 12 total, 12 up, 12 in 2023-03-02T20:02:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:07 smithi136 ceph-mon[125702]: pgmap v17425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:02:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:07 smithi136 ceph-mon[125702]: osdmap e1162: 12 total, 12 up, 12 in 2023-03-02T20:02:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:09 smithi057 ceph-mon[92072]: pgmap v17427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:02:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:09 smithi122 ceph-mon[125440]: pgmap v17427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:02:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:09 smithi136 ceph-mon[125702]: pgmap v17427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:02:11.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:02:11.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:02:11.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:02:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:11 smithi057 ceph-mon[92072]: pgmap v17428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:02:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:11 smithi122 ceph-mon[125440]: pgmap v17428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:02:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:11 smithi136 ceph-mon[125702]: pgmap v17428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:02:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:13.080+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:02:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:13.080+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:02:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:13.080+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 251 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:02:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:13.080+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 252 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:02:14.100 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:14.097+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:02:14.101 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:14.097+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:02:14.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:14.097+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:02:14.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:14.098+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:02:14.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:14.098+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:02:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:13 smithi057 ceph-mon[92072]: pgmap v17429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:02:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:13 smithi057 ceph-mon[92072]: osdmap e1163: 12 total, 12 up, 12 in 2023-03-02T20:02:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:13 smithi122 ceph-mon[125440]: pgmap v17429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:02:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:13 smithi122 ceph-mon[125440]: osdmap e1163: 12 total, 12 up, 12 in 2023-03-02T20:02:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:13 smithi136 ceph-mon[125702]: pgmap v17429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:02:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:13 smithi136 ceph-mon[125702]: osdmap e1163: 12 total, 12 up, 12 in 2023-03-02T20:02:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:02:15.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:02:15.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:02:15.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:02:15.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:15.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:02:15.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:02:15.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:02:15.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:02:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:15 smithi057 ceph-mon[92072]: pgmap v17431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:02:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:15 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:02:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:15 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:02:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:15 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:02:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:15 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:02:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:15 smithi122 ceph-mon[125440]: pgmap v17431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:02:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:15 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:02:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:15 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:02:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:15 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:02:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:15 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:02:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:15 smithi136 ceph-mon[125702]: pgmap v17431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:02:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:15 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:02:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:15 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:02:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:15 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:02:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:15 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:02:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:17 smithi122 ceph-mon[125440]: pgmap v17432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T20:02:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:17 smithi136 ceph-mon[125702]: pgmap v17432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T20:02:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:17 smithi057 ceph-mon[92072]: pgmap v17432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T20:02:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:19 smithi122 ceph-mon[125440]: pgmap v17433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:02:20.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:19 smithi136 ceph-mon[125702]: pgmap v17433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:02:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:19 smithi057 ceph-mon[92072]: pgmap v17433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:02:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:21 smithi122 ceph-mon[125440]: pgmap v17434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:02:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:21 smithi136 ceph-mon[125702]: pgmap v17434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:02:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:21 smithi057 ceph-mon[92072]: pgmap v17434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:02:23.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:22 smithi136 ceph-mon[125702]: pgmap v17435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:02:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:22 smithi057 ceph-mon[92072]: pgmap v17435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:02:23.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:23 smithi122 ceph-mon[125440]: pgmap v17435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:02:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:25 smithi136 ceph-mon[125702]: pgmap v17436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:02:25.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:25 smithi057 ceph-mon[92072]: pgmap v17436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:02:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:25 smithi122 ceph-mon[125440]: pgmap v17436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:02:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:27 smithi136 ceph-mon[125702]: pgmap v17437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:27 smithi057 ceph-mon[92072]: pgmap v17437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:27.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:27 smithi122 ceph-mon[125440]: pgmap v17437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:29.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:29.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:02:29.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:29.101+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:02:29.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:29.101+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:02:29.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:29.101+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:02:29.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:29.101+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:02:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:29 smithi136 ceph-mon[125702]: pgmap v17438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:29 smithi057 ceph-mon[92072]: pgmap v17438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:29.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:29 smithi122 ceph-mon[125440]: pgmap v17438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:31 smithi136 ceph-mon[125702]: pgmap v17439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:31 smithi057 ceph-mon[92072]: pgmap v17439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:31 smithi122 ceph-mon[125440]: pgmap v17439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:33 smithi136 ceph-mon[125702]: pgmap v17440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:33.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:33 smithi057 ceph-mon[92072]: pgmap v17440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:33 smithi122 ceph-mon[125440]: pgmap v17440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:35.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:35 smithi136 ceph-mon[125702]: pgmap v17441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:35.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:35 smithi057 ceph-mon[92072]: pgmap v17441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:35 smithi122 ceph-mon[125440]: pgmap v17441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:37 smithi136 ceph-mon[125702]: pgmap v17442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:37 smithi057 ceph-mon[92072]: pgmap v17442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:37 smithi122 ceph-mon[125440]: pgmap v17442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:39 smithi136 ceph-mon[125702]: pgmap v17443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:39 smithi057 ceph-mon[92072]: pgmap v17443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:39.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:39 smithi122 ceph-mon[125440]: pgmap v17443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:41 smithi136 ceph-mon[125702]: pgmap v17444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:41 smithi057 ceph-mon[92072]: pgmap v17444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:41 smithi122 ceph-mon[125440]: pgmap v17444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:43 smithi136 ceph-mon[125702]: pgmap v17445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:43 smithi057 ceph-mon[92072]: pgmap v17445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:43 smithi122 ceph-mon[125440]: pgmap v17445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:44.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:02:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:44.107+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:02:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:44.107+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:02:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:44.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:02:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:44.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:02:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:45 smithi136 ceph-mon[125702]: pgmap v17446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:45 smithi057 ceph-mon[92072]: pgmap v17446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:45 smithi122 ceph-mon[125440]: pgmap v17446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:47 smithi136 ceph-mon[125702]: pgmap v17447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:47.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:47 smithi057 ceph-mon[92072]: pgmap v17447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:47 smithi122 ceph-mon[125440]: pgmap v17447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:49 smithi136 ceph-mon[125702]: pgmap v17448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:49 smithi057 ceph-mon[92072]: pgmap v17448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:49 smithi122 ceph-mon[125440]: pgmap v17448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:51 smithi136 ceph-mon[125702]: pgmap v17449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:51 smithi057 ceph-mon[92072]: pgmap v17449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:51 smithi122 ceph-mon[125440]: pgmap v17449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:53 smithi136 ceph-mon[125702]: pgmap v17450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:53 smithi057 ceph-mon[92072]: pgmap v17450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:53 smithi122 ceph-mon[125440]: pgmap v17450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:55 smithi136 ceph-mon[125702]: pgmap v17451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:55.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:55 smithi057 ceph-mon[92072]: pgmap v17451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:55 smithi122 ceph-mon[125440]: pgmap v17451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:57 smithi136 ceph-mon[125702]: pgmap v17452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:57 smithi057 ceph-mon[92072]: pgmap v17452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:57 smithi122 ceph-mon[125440]: pgmap v17452: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:02:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:59.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:02:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:59.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:02:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:59.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:02:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:59.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:02:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:02:59.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:02:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:02:59 smithi136 ceph-mon[125702]: pgmap v17453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:02:59 smithi057 ceph-mon[92072]: pgmap v17453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:02:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:02:59 smithi122 ceph-mon[125440]: pgmap v17453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:01.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:01 smithi136 ceph-mon[125702]: pgmap v17454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:01 smithi057 ceph-mon[92072]: pgmap v17454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:01 smithi122 ceph-mon[125440]: pgmap v17454: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:03.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:03 smithi136 ceph-mon[125702]: pgmap v17455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:03:03.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:03 smithi057 ceph-mon[92072]: pgmap v17455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:03:03.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:03 smithi122 ceph-mon[125440]: pgmap v17455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:03:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:05 smithi136 ceph-mon[125702]: pgmap v17456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:03:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:05 smithi057 ceph-mon[92072]: pgmap v17456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:03:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:05 smithi122 ceph-mon[125440]: pgmap v17456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:03:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:07 smithi136 ceph-mon[125702]: pgmap v17457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:03:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:07 smithi136 ceph-mon[125702]: osdmap e1164: 12 total, 12 up, 12 in 2023-03-02T20:03:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:07 smithi057 ceph-mon[92072]: pgmap v17457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:03:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:07 smithi057 ceph-mon[92072]: osdmap e1164: 12 total, 12 up, 12 in 2023-03-02T20:03:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:07 smithi122 ceph-mon[125440]: pgmap v17457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:03:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:07 smithi122 ceph-mon[125440]: osdmap e1164: 12 total, 12 up, 12 in 2023-03-02T20:03:09.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:09 smithi136 ceph-mon[125702]: pgmap v17459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:03:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:09 smithi057 ceph-mon[92072]: pgmap v17459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:03:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:09 smithi122 ceph-mon[125440]: pgmap v17459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:03:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:11 smithi136 ceph-mon[125702]: pgmap v17460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:03:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:11 smithi057 ceph-mon[92072]: pgmap v17460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:03:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:11 smithi122 ceph-mon[125440]: pgmap v17460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:03:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:13 smithi136 ceph-mon[125702]: pgmap v17461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:03:13.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:13 smithi136 ceph-mon[125702]: osdmap e1165: 12 total, 12 up, 12 in 2023-03-02T20:03:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:13 smithi057 ceph-mon[92072]: pgmap v17461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:03:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:13 smithi057 ceph-mon[92072]: osdmap e1165: 12 total, 12 up, 12 in 2023-03-02T20:03:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:13 smithi122 ceph-mon[125440]: pgmap v17461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:03:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:13 smithi122 ceph-mon[125440]: osdmap e1165: 12 total, 12 up, 12 in 2023-03-02T20:03:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:14.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:03:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:14.135+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:03:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:14.135+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:03:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:14.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:03:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:14.135+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:03:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:15 smithi136 ceph-mon[125702]: pgmap v17463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:03:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:03:15.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:03:15.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:03:15.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:03:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:15 smithi057 ceph-mon[92072]: pgmap v17463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:03:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:03:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:03:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:03:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:03:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:15 smithi122 ceph-mon[125440]: pgmap v17463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:03:15.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:03:15.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:03:15.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:03:15.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:03:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:17 smithi057 ceph-mon[92072]: pgmap v17464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:03:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:17 smithi122 ceph-mon[125440]: pgmap v17464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:03:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:17 smithi136 ceph-mon[125702]: pgmap v17464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:03:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:19 smithi057 ceph-mon[92072]: pgmap v17465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:03:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:19 smithi122 ceph-mon[125440]: pgmap v17465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:03:20.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:19 smithi136 ceph-mon[125702]: pgmap v17465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:03:21.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:21 smithi057 ceph-mon[92072]: pgmap v17466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:03:21.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:21 smithi122 ceph-mon[125440]: pgmap v17466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:03:22.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:21 smithi136 ceph-mon[125702]: pgmap v17466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:03:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:23 smithi057 ceph-mon[92072]: pgmap v17467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:03:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:23 smithi122 ceph-mon[125440]: pgmap v17467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:03:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:23 smithi136 ceph-mon[125702]: pgmap v17467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:03:25.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:25 smithi057 ceph-mon[92072]: pgmap v17468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:03:25.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:25 smithi122 ceph-mon[125440]: pgmap v17468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:03:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:25 smithi136 ceph-mon[125702]: pgmap v17468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:03:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:27 smithi057 ceph-mon[92072]: pgmap v17469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:27 smithi122 ceph-mon[125440]: pgmap v17469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:27 smithi136 ceph-mon[125702]: pgmap v17469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:29.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:03:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:29.136+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:03:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:29.136+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:03:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:29.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:03:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:29.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:03:29.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:29 smithi057 ceph-mon[92072]: pgmap v17470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:29 smithi122 ceph-mon[125440]: pgmap v17470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:29 smithi136 ceph-mon[125702]: pgmap v17470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:31 smithi057 ceph-mon[92072]: pgmap v17471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:31 smithi122 ceph-mon[125440]: pgmap v17471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:31 smithi136 ceph-mon[125702]: pgmap v17471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:33.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:33 smithi057 ceph-mon[92072]: pgmap v17472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:33 smithi122 ceph-mon[125440]: pgmap v17472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:33 smithi136 ceph-mon[125702]: pgmap v17472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:35.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:35 smithi057 ceph-mon[92072]: pgmap v17473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:35 smithi122 ceph-mon[125440]: pgmap v17473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:35 smithi136 ceph-mon[125702]: pgmap v17473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:37 smithi057 ceph-mon[92072]: pgmap v17474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:37 smithi122 ceph-mon[125440]: pgmap v17474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:37 smithi136 ceph-mon[125702]: pgmap v17474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:39 smithi057 ceph-mon[92072]: pgmap v17475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:39 smithi122 ceph-mon[125440]: pgmap v17475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:39 smithi136 ceph-mon[125702]: pgmap v17475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:41 smithi057 ceph-mon[92072]: pgmap v17476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:41.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:41 smithi122 ceph-mon[125440]: pgmap v17476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:41 smithi136 ceph-mon[125702]: pgmap v17476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:43.093+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:03:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:43.093+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:03:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:43.093+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 252 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:03:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:43.093+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 253 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:03:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:43 smithi057 ceph-mon[92072]: pgmap v17477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:43.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:43 smithi122 ceph-mon[125440]: pgmap v17477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:43 smithi136 ceph-mon[125702]: pgmap v17477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:44.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:03:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:44.151+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:03:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:44.151+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:03:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:44.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:03:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:44.151+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:03:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:45 smithi057 ceph-mon[92072]: pgmap v17478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:45 smithi122 ceph-mon[125440]: pgmap v17478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:46.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:45 smithi136 ceph-mon[125702]: pgmap v17478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:47.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:47 smithi057 ceph-mon[92072]: pgmap v17479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:47.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:47 smithi122 ceph-mon[125440]: pgmap v17479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:47 smithi136 ceph-mon[125702]: pgmap v17479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:49 smithi122 ceph-mon[125440]: pgmap v17480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:49 smithi136 ceph-mon[125702]: pgmap v17480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:49 smithi057 ceph-mon[92072]: pgmap v17480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:51 smithi122 ceph-mon[125440]: pgmap v17481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:51 smithi136 ceph-mon[125702]: pgmap v17481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:51 smithi057 ceph-mon[92072]: pgmap v17481: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:53 smithi122 ceph-mon[125440]: pgmap v17482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:53 smithi136 ceph-mon[125702]: pgmap v17482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:53 smithi057 ceph-mon[92072]: pgmap v17482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:03:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:55 smithi122 ceph-mon[125440]: pgmap v17483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:55 smithi136 ceph-mon[125702]: pgmap v17483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:55 smithi057 ceph-mon[92072]: pgmap v17483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:57 smithi122 ceph-mon[125440]: pgmap v17484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:57 smithi136 ceph-mon[125702]: pgmap v17484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:57 smithi057 ceph-mon[92072]: pgmap v17484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:03:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:59.164+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:03:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:59.164+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:03:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:59.164+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:03:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:59.164+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:03:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:03:59.164+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:04:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:03:59 smithi136 ceph-mon[125702]: pgmap v17485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:03:59 smithi057 ceph-mon[92072]: pgmap v17485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:03:59 smithi122 ceph-mon[125440]: pgmap v17485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:01 smithi136 ceph-mon[125702]: pgmap v17486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:01 smithi057 ceph-mon[92072]: pgmap v17486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:01 smithi122 ceph-mon[125440]: pgmap v17486: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:03 smithi136 ceph-mon[125702]: pgmap v17487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:04:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:03 smithi057 ceph-mon[92072]: pgmap v17487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:04:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:03 smithi122 ceph-mon[125440]: pgmap v17487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:04:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:05 smithi136 ceph-mon[125702]: pgmap v17488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:04:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:05 smithi057 ceph-mon[92072]: pgmap v17488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:04:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:05 smithi122 ceph-mon[125440]: pgmap v17488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:04:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:07 smithi136 ceph-mon[125702]: pgmap v17489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:04:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:07 smithi136 ceph-mon[125702]: osdmap e1166: 12 total, 12 up, 12 in 2023-03-02T20:04:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:07 smithi057 ceph-mon[92072]: pgmap v17489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:04:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:07 smithi057 ceph-mon[92072]: osdmap e1166: 12 total, 12 up, 12 in 2023-03-02T20:04:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:07 smithi122 ceph-mon[125440]: pgmap v17489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:04:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:07 smithi122 ceph-mon[125440]: osdmap e1166: 12 total, 12 up, 12 in 2023-03-02T20:04:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:09 smithi136 ceph-mon[125702]: pgmap v17491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:04:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:09 smithi057 ceph-mon[92072]: pgmap v17491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:04:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:09 smithi122 ceph-mon[125440]: pgmap v17491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:04:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:11 smithi136 ceph-mon[125702]: pgmap v17492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:04:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:11 smithi057 ceph-mon[92072]: pgmap v17492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:04:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:11 smithi122 ceph-mon[125440]: pgmap v17492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:04:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:13 smithi136 ceph-mon[125702]: pgmap v17493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:04:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:13 smithi136 ceph-mon[125702]: osdmap e1167: 12 total, 12 up, 12 in 2023-03-02T20:04:14.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:14.180+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:04:14.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:14.180+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:04:14.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:14.180+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:04:14.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:14.180+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:04:14.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:14.180+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:04:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:13 smithi057 ceph-mon[92072]: pgmap v17493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:04:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:13 smithi057 ceph-mon[92072]: osdmap e1167: 12 total, 12 up, 12 in 2023-03-02T20:04:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:13 smithi122 ceph-mon[125440]: pgmap v17493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:04:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:13 smithi122 ceph-mon[125440]: osdmap e1167: 12 total, 12 up, 12 in 2023-03-02T20:04:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:15 smithi136 ceph-mon[125702]: pgmap v17495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:04:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:04:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:15 smithi057 ceph-mon[92072]: pgmap v17495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:04:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:04:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:15 smithi122 ceph-mon[125440]: pgmap v17495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:04:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:04:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:17 smithi136 ceph-mon[125702]: pgmap v17496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:04:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:04:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:04:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:04:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:04:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:04:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:17 smithi057 ceph-mon[92072]: pgmap v17496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:04:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:04:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:04:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:04:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:04:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:04:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:17 smithi122 ceph-mon[125440]: pgmap v17496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:04:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:04:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:04:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:04:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:04:17.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:04:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:19 smithi136 ceph-mon[125702]: pgmap v17497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:04:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:19 smithi057 ceph-mon[92072]: pgmap v17497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:04:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:19 smithi122 ceph-mon[125440]: pgmap v17497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:04:21.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:21 smithi136 ceph-mon[125702]: pgmap v17498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:04:21.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:21 smithi057 ceph-mon[92072]: pgmap v17498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:04:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:21 smithi122 ceph-mon[125440]: pgmap v17498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:04:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:23 smithi136 ceph-mon[125702]: pgmap v17499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:04:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:23 smithi057 ceph-mon[92072]: pgmap v17499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:04:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:23 smithi122 ceph-mon[125440]: pgmap v17499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:04:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:25 smithi136 ceph-mon[125702]: pgmap v17500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:04:25.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:25 smithi057 ceph-mon[92072]: pgmap v17500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:04:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:25 smithi122 ceph-mon[125440]: pgmap v17500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:04:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:27 smithi136 ceph-mon[125702]: pgmap v17501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:27.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:27 smithi057 ceph-mon[92072]: pgmap v17501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:27.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:27 smithi122 ceph-mon[125440]: pgmap v17501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:29.195+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:04:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:29.195+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:04:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:29.195+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:04:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:29.195+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:04:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:29.195+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:04:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:29 smithi136 ceph-mon[125702]: pgmap v17502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:29.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:29 smithi057 ceph-mon[92072]: pgmap v17502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:29.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:29 smithi122 ceph-mon[125440]: pgmap v17502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:31 smithi136 ceph-mon[125702]: pgmap v17503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:31 smithi057 ceph-mon[92072]: pgmap v17503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:31 smithi122 ceph-mon[125440]: pgmap v17503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:33 smithi136 ceph-mon[125702]: pgmap v17504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:33.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:33 smithi057 ceph-mon[92072]: pgmap v17504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:33 smithi122 ceph-mon[125440]: pgmap v17504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:35.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:35 smithi136 ceph-mon[125702]: pgmap v17505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:35 smithi057 ceph-mon[92072]: pgmap v17505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:35 smithi122 ceph-mon[125440]: pgmap v17505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:37 smithi136 ceph-mon[125702]: pgmap v17506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:37 smithi057 ceph-mon[92072]: pgmap v17506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:37 smithi122 ceph-mon[125440]: pgmap v17506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:39 smithi136 ceph-mon[125702]: pgmap v17507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:39 smithi057 ceph-mon[92072]: pgmap v17507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:39 smithi122 ceph-mon[125440]: pgmap v17507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:41 smithi136 ceph-mon[125702]: pgmap v17508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:41 smithi057 ceph-mon[92072]: pgmap v17508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:41 smithi122 ceph-mon[125440]: pgmap v17508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:43 smithi136 ceph-mon[125702]: pgmap v17509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:43 smithi057 ceph-mon[92072]: pgmap v17509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:43.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:43 smithi122 ceph-mon[125440]: pgmap v17509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:44.209+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:04:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:44.209+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:04:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:44.209+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:04:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:44.209+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:04:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:44.209+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:04:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:45 smithi136 ceph-mon[125702]: pgmap v17510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:45 smithi057 ceph-mon[92072]: pgmap v17510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:45 smithi122 ceph-mon[125440]: pgmap v17510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:47 smithi136 ceph-mon[125702]: pgmap v17511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:47 smithi057 ceph-mon[92072]: pgmap v17511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:47 smithi122 ceph-mon[125440]: pgmap v17511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:49 smithi136 ceph-mon[125702]: pgmap v17512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:49 smithi057 ceph-mon[92072]: pgmap v17512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:49 smithi122 ceph-mon[125440]: pgmap v17512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:51 smithi136 ceph-mon[125702]: pgmap v17513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:51 smithi057 ceph-mon[92072]: pgmap v17513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:51 smithi122 ceph-mon[125440]: pgmap v17513: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:53 smithi136 ceph-mon[125702]: pgmap v17514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:53 smithi057 ceph-mon[92072]: pgmap v17514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:53 smithi122 ceph-mon[125440]: pgmap v17514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:55.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:55 smithi136 ceph-mon[125702]: pgmap v17515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:55.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:55 smithi057 ceph-mon[92072]: pgmap v17515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:55 smithi122 ceph-mon[125440]: pgmap v17515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:57.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:57 smithi136 ceph-mon[125702]: pgmap v17516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:57 smithi057 ceph-mon[92072]: pgmap v17516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:57 smithi122 ceph-mon[125440]: pgmap v17516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:59.224+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:04:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:59.225+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:04:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:59.225+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:04:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:59.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:04:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:04:59.225+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:04:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:04:59 smithi057 ceph-mon[92072]: pgmap v17517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:04:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:04:59 smithi122 ceph-mon[125440]: pgmap v17517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:04:59 smithi136 ceph-mon[125702]: pgmap v17517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:01 smithi057 ceph-mon[92072]: pgmap v17518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:01 smithi122 ceph-mon[125440]: pgmap v17518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:01 smithi136 ceph-mon[125702]: pgmap v17518: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:03.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:03 smithi057 ceph-mon[92072]: pgmap v17519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:05:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:03 smithi122 ceph-mon[125440]: pgmap v17519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:05:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:03 smithi136 ceph-mon[125702]: pgmap v17519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:05:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:05 smithi057 ceph-mon[92072]: pgmap v17520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:05:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:05 smithi122 ceph-mon[125440]: pgmap v17520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:05:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:05 smithi136 ceph-mon[125702]: pgmap v17520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:07 smithi057 ceph-mon[92072]: pgmap v17521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:07 smithi057 ceph-mon[92072]: osdmap e1168: 12 total, 12 up, 12 in 2023-03-02T20:05:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:07 smithi122 ceph-mon[125440]: pgmap v17521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:05:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:07 smithi122 ceph-mon[125440]: osdmap e1168: 12 total, 12 up, 12 in 2023-03-02T20:05:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:07 smithi136 ceph-mon[125702]: pgmap v17521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:05:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:07 smithi136 ceph-mon[125702]: osdmap e1168: 12 total, 12 up, 12 in 2023-03-02T20:05:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:09 smithi057 ceph-mon[92072]: pgmap v17523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:05:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:09 smithi122 ceph-mon[125440]: pgmap v17523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:05:10.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:09 smithi136 ceph-mon[125702]: pgmap v17523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:05:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:11 smithi057 ceph-mon[92072]: pgmap v17524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:05:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:11 smithi122 ceph-mon[125440]: pgmap v17524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:05:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:11 smithi136 ceph-mon[125702]: pgmap v17524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:05:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:13.106+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:05:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:13.106+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:05:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:13.106+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 253 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:05:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:13.107+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 254 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:05:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:13 smithi057 ceph-mon[92072]: pgmap v17525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:05:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:13 smithi057 ceph-mon[92072]: osdmap e1169: 12 total, 12 up, 12 in 2023-03-02T20:05:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:13 smithi122 ceph-mon[125440]: pgmap v17525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:05:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:13 smithi122 ceph-mon[125440]: osdmap e1169: 12 total, 12 up, 12 in 2023-03-02T20:05:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:13 smithi136 ceph-mon[125702]: pgmap v17525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:05:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:13 smithi136 ceph-mon[125702]: osdmap e1169: 12 total, 12 up, 12 in 2023-03-02T20:05:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:14.240+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:05:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:14.240+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:05:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:14.240+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:05:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:14.240+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:05:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:14.240+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:05:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:15 smithi057 ceph-mon[92072]: pgmap v17527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:05:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:15 smithi122 ceph-mon[125440]: pgmap v17527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:05:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:15 smithi136 ceph-mon[125702]: pgmap v17527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:05:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:17 smithi057 ceph-mon[92072]: pgmap v17528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:05:17.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:05:17.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:17.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:17 smithi122 ceph-mon[125440]: pgmap v17528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:05:17.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:05:17.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:17.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:17 smithi136 ceph-mon[125702]: pgmap v17528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:05:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:05:18.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:18.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:19.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:19.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:19.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:05:19.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:05:19.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:19.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:19.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:19.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:05:19.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:05:19.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:19.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:19.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:19.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:05:19.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:05:19.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:05:20.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:19 smithi136 ceph-mon[125702]: pgmap v17529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:05:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:19 smithi057 ceph-mon[92072]: pgmap v17529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:05:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:19 smithi122 ceph-mon[125440]: pgmap v17529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:05:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:21 smithi136 ceph-mon[125702]: pgmap v17530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:05:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:21 smithi057 ceph-mon[92072]: pgmap v17530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:05:22.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:21 smithi122 ceph-mon[125440]: pgmap v17530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:05:24.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:23 smithi136 ceph-mon[125702]: pgmap v17531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:05:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:23 smithi057 ceph-mon[92072]: pgmap v17531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:05:24.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:23 smithi122 ceph-mon[125440]: pgmap v17531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:05:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:25 smithi136 ceph-mon[125702]: pgmap v17532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:05:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:25 smithi057 ceph-mon[92072]: pgmap v17532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:05:26.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:25 smithi122 ceph-mon[125440]: pgmap v17532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:05:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:27 smithi136 ceph-mon[125702]: pgmap v17533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:27 smithi057 ceph-mon[92072]: pgmap v17533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:27 smithi122 ceph-mon[125440]: pgmap v17533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:29.241+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:05:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:29.241+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:05:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:29.241+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:05:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:29.241+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:05:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:29.241+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:05:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:29 smithi136 ceph-mon[125702]: pgmap v17534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:29 smithi057 ceph-mon[92072]: pgmap v17534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:29 smithi122 ceph-mon[125440]: pgmap v17534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:31 smithi136 ceph-mon[125702]: pgmap v17535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:31 smithi057 ceph-mon[92072]: pgmap v17535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:31 smithi122 ceph-mon[125440]: pgmap v17535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:33 smithi136 ceph-mon[125702]: pgmap v17536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:33 smithi057 ceph-mon[92072]: pgmap v17536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:33 smithi122 ceph-mon[125440]: pgmap v17536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:35 smithi136 ceph-mon[125702]: pgmap v17537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:35 smithi057 ceph-mon[92072]: pgmap v17537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:35 smithi122 ceph-mon[125440]: pgmap v17537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:37 smithi136 ceph-mon[125702]: pgmap v17538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:37 smithi057 ceph-mon[92072]: pgmap v17538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:37 smithi122 ceph-mon[125440]: pgmap v17538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:39 smithi136 ceph-mon[125702]: pgmap v17539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:39 smithi057 ceph-mon[92072]: pgmap v17539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:39 smithi122 ceph-mon[125440]: pgmap v17539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:41 smithi136 ceph-mon[125702]: pgmap v17540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:42.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:41 smithi057 ceph-mon[92072]: pgmap v17540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:42.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:41 smithi122 ceph-mon[125440]: pgmap v17540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:43 smithi136 ceph-mon[125702]: pgmap v17541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:43 smithi057 ceph-mon[92072]: pgmap v17541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:43 smithi122 ceph-mon[125440]: pgmap v17541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:44.257+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:05:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:44.257+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:05:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:44.257+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:05:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:44.257+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:05:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:44.257+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:05:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:45 smithi136 ceph-mon[125702]: pgmap v17542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:45 smithi057 ceph-mon[92072]: pgmap v17542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:45 smithi122 ceph-mon[125440]: pgmap v17542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:48.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:47 smithi136 ceph-mon[125702]: pgmap v17543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:47 smithi057 ceph-mon[92072]: pgmap v17543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:47 smithi122 ceph-mon[125440]: pgmap v17543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:49 smithi136 ceph-mon[125702]: pgmap v17544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:49 smithi057 ceph-mon[92072]: pgmap v17544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:49 smithi122 ceph-mon[125440]: pgmap v17544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:51 smithi136 ceph-mon[125702]: pgmap v17545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:51 smithi057 ceph-mon[92072]: pgmap v17545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:51 smithi122 ceph-mon[125440]: pgmap v17545: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:53 smithi057 ceph-mon[92072]: pgmap v17546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:54.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:53 smithi122 ceph-mon[125440]: pgmap v17546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:53 smithi136 ceph-mon[125702]: pgmap v17546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:05:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:55 smithi057 ceph-mon[92072]: pgmap v17547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:55 smithi122 ceph-mon[125440]: pgmap v17547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:55 smithi136 ceph-mon[125702]: pgmap v17547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:57 smithi057 ceph-mon[92072]: pgmap v17548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:58.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:57 smithi122 ceph-mon[125440]: pgmap v17548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:57 smithi136 ceph-mon[125702]: pgmap v17548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:05:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:59.271+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:05:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:59.272+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:05:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:59.272+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:05:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:59.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:05:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:05:59.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:06:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:05:59 smithi057 ceph-mon[92072]: pgmap v17549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:05:59 smithi122 ceph-mon[125440]: pgmap v17549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:05:59 smithi136 ceph-mon[125702]: pgmap v17549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:02.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:01 smithi057 ceph-mon[92072]: pgmap v17550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:01 smithi122 ceph-mon[125440]: pgmap v17550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:01 smithi136 ceph-mon[125702]: pgmap v17550: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:03 smithi057 ceph-mon[92072]: pgmap v17551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:06:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:03 smithi122 ceph-mon[125440]: pgmap v17551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:06:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:03 smithi136 ceph-mon[125702]: pgmap v17551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:06:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:05 smithi057 ceph-mon[92072]: pgmap v17552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:06:06.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:05 smithi122 ceph-mon[125440]: pgmap v17552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:06:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:05 smithi136 ceph-mon[125702]: pgmap v17552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:06:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:07 smithi057 ceph-mon[92072]: pgmap v17553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:06:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:07 smithi057 ceph-mon[92072]: osdmap e1170: 12 total, 12 up, 12 in 2023-03-02T20:06:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:07 smithi122 ceph-mon[125440]: pgmap v17553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:06:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:07 smithi122 ceph-mon[125440]: osdmap e1170: 12 total, 12 up, 12 in 2023-03-02T20:06:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:07 smithi136 ceph-mon[125702]: pgmap v17553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:06:08.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:07 smithi136 ceph-mon[125702]: osdmap e1170: 12 total, 12 up, 12 in 2023-03-02T20:06:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:09 smithi057 ceph-mon[92072]: pgmap v17555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:06:10.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:09 smithi122 ceph-mon[125440]: pgmap v17555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:06:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:09 smithi136 ceph-mon[125702]: pgmap v17555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:06:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:11 smithi057 ceph-mon[92072]: pgmap v17556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:06:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:11 smithi122 ceph-mon[125440]: pgmap v17556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:06:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:11 smithi136 ceph-mon[125702]: pgmap v17556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:06:14.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:13 smithi057 ceph-mon[92072]: pgmap v17557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:06:14.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:13 smithi057 ceph-mon[92072]: osdmap e1171: 12 total, 12 up, 12 in 2023-03-02T20:06:14.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:13 smithi122 ceph-mon[125440]: pgmap v17557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:06:14.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:13 smithi122 ceph-mon[125440]: osdmap e1171: 12 total, 12 up, 12 in 2023-03-02T20:06:14.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:14.285+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:06:14.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:14.286+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:06:14.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:14.286+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:06:14.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:14.286+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:06:14.289 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:14.286+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:06:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:13 smithi136 ceph-mon[125702]: pgmap v17557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:06:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:13 smithi136 ceph-mon[125702]: osdmap e1171: 12 total, 12 up, 12 in 2023-03-02T20:06:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:15 smithi057 ceph-mon[92072]: pgmap v17559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:06:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:15 smithi122 ceph-mon[125440]: pgmap v17559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:06:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:15 smithi136 ceph-mon[125702]: pgmap v17559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:06:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:17 smithi057 ceph-mon[92072]: pgmap v17560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T20:06:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:17 smithi122 ceph-mon[125440]: pgmap v17560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T20:06:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:17 smithi136 ceph-mon[125702]: pgmap v17560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T20:06:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:19 smithi136 ceph-mon[125702]: pgmap v17561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:06:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:06:19.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:06:19.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:06:19.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:06:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:19 smithi057 ceph-mon[92072]: pgmap v17561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:06:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:06:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:06:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:06:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:06:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:19 smithi122 ceph-mon[125440]: pgmap v17561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:06:19.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:06:19.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:06:19.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:06:19.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:06:21.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:21 smithi136 ceph-mon[125702]: pgmap v17562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:06:21.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:21 smithi057 ceph-mon[92072]: pgmap v17562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:06:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:21 smithi122 ceph-mon[125440]: pgmap v17562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:06:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:23 smithi136 ceph-mon[125702]: pgmap v17563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:06:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:23 smithi057 ceph-mon[92072]: pgmap v17563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:06:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:23 smithi122 ceph-mon[125440]: pgmap v17563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:06:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:25 smithi136 ceph-mon[125702]: pgmap v17564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:06:25.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:25 smithi057 ceph-mon[92072]: pgmap v17564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:06:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:25 smithi122 ceph-mon[125440]: pgmap v17564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:06:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:27 smithi136 ceph-mon[125702]: pgmap v17565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:27 smithi057 ceph-mon[92072]: pgmap v17565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:27.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:27 smithi122 ceph-mon[125440]: pgmap v17565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:29.302+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:06:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:29.302+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:06:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:29.302+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:06:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:29.302+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:06:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:29.302+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:06:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:29 smithi136 ceph-mon[125702]: pgmap v17566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:29.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:29 smithi057 ceph-mon[92072]: pgmap v17566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:29.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:29 smithi122 ceph-mon[125440]: pgmap v17566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:31 smithi136 ceph-mon[125702]: pgmap v17567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:31 smithi057 ceph-mon[92072]: pgmap v17567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:31 smithi122 ceph-mon[125440]: pgmap v17567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:33 smithi136 ceph-mon[125702]: pgmap v17568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:33.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:33 smithi057 ceph-mon[92072]: pgmap v17568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:33 smithi122 ceph-mon[125440]: pgmap v17568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:35.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:35 smithi136 ceph-mon[125702]: pgmap v17569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:35.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:35 smithi057 ceph-mon[92072]: pgmap v17569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:35 smithi122 ceph-mon[125440]: pgmap v17569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:37 smithi136 ceph-mon[125702]: pgmap v17570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:37 smithi057 ceph-mon[92072]: pgmap v17570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:37 smithi122 ceph-mon[125440]: pgmap v17570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:39 smithi136 ceph-mon[125702]: pgmap v17571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:39 smithi057 ceph-mon[92072]: pgmap v17571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:39 smithi122 ceph-mon[125440]: pgmap v17571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:41 smithi136 ceph-mon[125702]: pgmap v17572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:41 smithi057 ceph-mon[92072]: pgmap v17572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:41 smithi122 ceph-mon[125440]: pgmap v17572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:43 smithi136 ceph-mon[125702]: pgmap v17573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:43 smithi057 ceph-mon[92072]: pgmap v17573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:43.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:43 smithi122 ceph-mon[125440]: pgmap v17573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:44.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:06:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:44.317+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:06:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:44.317+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:06:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:44.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:06:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:44.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:06:45.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:45 smithi136 ceph-mon[125702]: pgmap v17574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:45 smithi057 ceph-mon[92072]: pgmap v17574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:45 smithi122 ceph-mon[125440]: pgmap v17574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:47.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:47 smithi057 ceph-mon[92072]: pgmap v17575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:47 smithi122 ceph-mon[125440]: pgmap v17575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:47 smithi136 ceph-mon[125702]: pgmap v17575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:49 smithi057 ceph-mon[92072]: pgmap v17576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:49 smithi122 ceph-mon[125440]: pgmap v17576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:49 smithi136 ceph-mon[125702]: pgmap v17576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:51 smithi057 ceph-mon[92072]: pgmap v17577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:51 smithi122 ceph-mon[125440]: pgmap v17577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:51 smithi136 ceph-mon[125702]: pgmap v17577: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:53.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:53 smithi057 ceph-mon[92072]: pgmap v17578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:53 smithi122 ceph-mon[125440]: pgmap v17578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:53 smithi136 ceph-mon[125702]: pgmap v17578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:55.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:55 smithi057 ceph-mon[92072]: pgmap v17579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:55 smithi122 ceph-mon[125440]: pgmap v17579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:55 smithi136 ceph-mon[125702]: pgmap v17579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:57 smithi057 ceph-mon[92072]: pgmap v17580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:57 smithi122 ceph-mon[125440]: pgmap v17580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:57 smithi136 ceph-mon[125702]: pgmap v17580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:06:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:59.329+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:06:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:59.329+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:06:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:59.329+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:06:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:59.329+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:06:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:06:59.329+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:06:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:06:59 smithi057 ceph-mon[92072]: pgmap v17581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:06:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:06:59 smithi122 ceph-mon[125440]: pgmap v17581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:06:59 smithi136 ceph-mon[125702]: pgmap v17581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:01 smithi057 ceph-mon[92072]: pgmap v17582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:01 smithi122 ceph-mon[125440]: pgmap v17582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:01 smithi136 ceph-mon[125702]: pgmap v17582: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:03.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:03 smithi057 ceph-mon[92072]: pgmap v17583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:07:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:03 smithi122 ceph-mon[125440]: pgmap v17583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:07:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:03 smithi136 ceph-mon[125702]: pgmap v17583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:07:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:05 smithi057 ceph-mon[92072]: pgmap v17584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:07:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:05 smithi122 ceph-mon[125440]: pgmap v17584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:07:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:05 smithi136 ceph-mon[125702]: pgmap v17584: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:07:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:07 smithi057 ceph-mon[92072]: pgmap v17585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:07:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:07 smithi122 ceph-mon[125440]: pgmap v17585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:07:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:07 smithi136 ceph-mon[125702]: pgmap v17585: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:07:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:09 smithi057 ceph-mon[92072]: pgmap v17586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:07:09.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:09 smithi122 ceph-mon[125440]: pgmap v17586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:07:10.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:09 smithi136 ceph-mon[125702]: pgmap v17586: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:07:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:11 smithi057 ceph-mon[92072]: pgmap v17587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:07:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:11 smithi122 ceph-mon[125440]: pgmap v17587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:07:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:11 smithi136 ceph-mon[125702]: pgmap v17587: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:07:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:12 smithi057 ceph-mon[92072]: osdmap e1172: 12 total, 12 up, 12 in 2023-03-02T20:07:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:12 smithi122 ceph-mon[125440]: osdmap e1172: 12 total, 12 up, 12 in 2023-03-02T20:07:13.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:12 smithi136 ceph-mon[125702]: osdmap e1172: 12 total, 12 up, 12 in 2023-03-02T20:07:13.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:13 smithi057 ceph-mon[92072]: pgmap v17589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:13 smithi122 ceph-mon[125440]: pgmap v17589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:13 smithi136 ceph-mon[125702]: pgmap v17589: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:14.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:07:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:14.333+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:07:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:14.333+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:07:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:14.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:07:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:14.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:07:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:15 smithi122 ceph-mon[125440]: pgmap v17590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:15 smithi136 ceph-mon[125702]: pgmap v17590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:15 smithi057 ceph-mon[92072]: pgmap v17590: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:17 smithi122 ceph-mon[125440]: pgmap v17591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:17 smithi136 ceph-mon[125702]: pgmap v17591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:17 smithi057 ceph-mon[92072]: pgmap v17591: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:19 smithi122 ceph-mon[125440]: pgmap v17592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:07:19.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:07:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:19 smithi136 ceph-mon[125702]: pgmap v17592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:07:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:07:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:19 smithi057 ceph-mon[92072]: pgmap v17592: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:07:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:07:20.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:07:20.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:07:20.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:07:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:07:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:07:21.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:07:21.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:07:21.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:07:21.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:07:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:21 smithi136 ceph-mon[125702]: pgmap v17593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:07:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:21 smithi057 ceph-mon[92072]: pgmap v17593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:07:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:21 smithi122 ceph-mon[125440]: pgmap v17593: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:07:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:23 smithi136 ceph-mon[125702]: pgmap v17594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 292 B/s wr, 14 op/s 2023-03-02T20:07:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:23 smithi136 ceph-mon[125702]: osdmap e1173: 12 total, 12 up, 12 in 2023-03-02T20:07:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:23 smithi057 ceph-mon[92072]: pgmap v17594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 292 B/s wr, 14 op/s 2023-03-02T20:07:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:23 smithi057 ceph-mon[92072]: osdmap e1173: 12 total, 12 up, 12 in 2023-03-02T20:07:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:23 smithi122 ceph-mon[125440]: pgmap v17594: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 292 B/s wr, 14 op/s 2023-03-02T20:07:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:23 smithi122 ceph-mon[125440]: osdmap e1173: 12 total, 12 up, 12 in 2023-03-02T20:07:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:25 smithi136 ceph-mon[125702]: pgmap v17596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:25 smithi057 ceph-mon[92072]: pgmap v17596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:25 smithi122 ceph-mon[125440]: pgmap v17596: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:28.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:27 smithi136 ceph-mon[125702]: pgmap v17597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:27 smithi057 ceph-mon[92072]: pgmap v17597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:27 smithi122 ceph-mon[125440]: pgmap v17597: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:07:29.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:29.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:07:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:29.336+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:07:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:29.336+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:07:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:29.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:07:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:29.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:07:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:29 smithi136 ceph-mon[125702]: pgmap v17598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:07:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:29 smithi057 ceph-mon[92072]: pgmap v17598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:07:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:29 smithi122 ceph-mon[125440]: pgmap v17598: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:07:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:31 smithi136 ceph-mon[125702]: pgmap v17599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:07:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:31 smithi057 ceph-mon[92072]: pgmap v17599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:07:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:31 smithi122 ceph-mon[125440]: pgmap v17599: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:07:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:33 smithi136 ceph-mon[125702]: pgmap v17600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:07:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:33 smithi057 ceph-mon[92072]: pgmap v17600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:07:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:33 smithi122 ceph-mon[125440]: pgmap v17600: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:07:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:35 smithi136 ceph-mon[125702]: pgmap v17601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:07:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:35 smithi057 ceph-mon[92072]: pgmap v17601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:07:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:35 smithi122 ceph-mon[125440]: pgmap v17601: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:07:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:37 smithi136 ceph-mon[125702]: pgmap v17602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:37 smithi057 ceph-mon[92072]: pgmap v17602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:37 smithi122 ceph-mon[125440]: pgmap v17602: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:39 smithi136 ceph-mon[125702]: pgmap v17603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:39 smithi057 ceph-mon[92072]: pgmap v17603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:39 smithi122 ceph-mon[125440]: pgmap v17603: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:41 smithi136 ceph-mon[125702]: pgmap v17604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:41 smithi057 ceph-mon[92072]: pgmap v17604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:42.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:41 smithi122 ceph-mon[125440]: pgmap v17604: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:43 smithi136 ceph-mon[125702]: pgmap v17605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:43 smithi057 ceph-mon[92072]: pgmap v17605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:43 smithi122 ceph-mon[125440]: pgmap v17605: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:44.341+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:07:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:44.341+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:07:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:44.341+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:07:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:44.341+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:07:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:44.342+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:07:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:45 smithi136 ceph-mon[125702]: pgmap v17606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:46.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:45 smithi057 ceph-mon[92072]: pgmap v17606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:45 smithi122 ceph-mon[125440]: pgmap v17606: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:47 smithi136 ceph-mon[125702]: pgmap v17607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:47 smithi057 ceph-mon[92072]: pgmap v17607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:48.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:47 smithi122 ceph-mon[125440]: pgmap v17607: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:49 smithi136 ceph-mon[125702]: pgmap v17608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:49 smithi057 ceph-mon[92072]: pgmap v17608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:50.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:49 smithi122 ceph-mon[125440]: pgmap v17608: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:51 smithi136 ceph-mon[125702]: pgmap v17609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:51 smithi057 ceph-mon[92072]: pgmap v17609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:52.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:51 smithi122 ceph-mon[125440]: pgmap v17609: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:53 smithi136 ceph-mon[125702]: pgmap v17610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:53 smithi057 ceph-mon[92072]: pgmap v17610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:53 smithi122 ceph-mon[125440]: pgmap v17610: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:07:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:55 smithi136 ceph-mon[125702]: pgmap v17611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:55 smithi057 ceph-mon[92072]: pgmap v17611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:55 smithi122 ceph-mon[125440]: pgmap v17611: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:57 smithi136 ceph-mon[125702]: pgmap v17612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:57 smithi057 ceph-mon[92072]: pgmap v17612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:58.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:57 smithi122 ceph-mon[125440]: pgmap v17612: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:07:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:59.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:07:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:59.357+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:07:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:59.357+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:07:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:59.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:07:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:07:59.357+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:08:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:07:59 smithi136 ceph-mon[125702]: pgmap v17613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:07:59 smithi057 ceph-mon[92072]: pgmap v17613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:07:59 smithi122 ceph-mon[125440]: pgmap v17613: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:01 smithi136 ceph-mon[125702]: pgmap v17614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:01 smithi057 ceph-mon[92072]: pgmap v17614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:01 smithi122 ceph-mon[125440]: pgmap v17614: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:03 smithi136 ceph-mon[125702]: pgmap v17615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:08:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:03 smithi057 ceph-mon[92072]: pgmap v17615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:08:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:03 smithi122 ceph-mon[125440]: pgmap v17615: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:08:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:05 smithi136 ceph-mon[125702]: pgmap v17616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:08:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:05 smithi057 ceph-mon[92072]: pgmap v17616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:08:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:05 smithi122 ceph-mon[125440]: pgmap v17616: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:08:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:07 smithi136 ceph-mon[125702]: pgmap v17617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:08:08.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:07 smithi136 ceph-mon[125702]: osdmap e1174: 12 total, 12 up, 12 in 2023-03-02T20:08:08.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:07 smithi057 ceph-mon[92072]: pgmap v17617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:08:08.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:07 smithi057 ceph-mon[92072]: osdmap e1174: 12 total, 12 up, 12 in 2023-03-02T20:08:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:07 smithi122 ceph-mon[125440]: pgmap v17617: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:08:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:07 smithi122 ceph-mon[125440]: osdmap e1174: 12 total, 12 up, 12 in 2023-03-02T20:08:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:09 smithi136 ceph-mon[125702]: pgmap v17619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:08:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:09 smithi057 ceph-mon[92072]: pgmap v17619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:08:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:09 smithi122 ceph-mon[125440]: pgmap v17619: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:08:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:11 smithi136 ceph-mon[125702]: pgmap v17620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:08:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:11 smithi057 ceph-mon[92072]: pgmap v17620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:08:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:11 smithi122 ceph-mon[125440]: pgmap v17620: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:08:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:13.133+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:08:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:13.133+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:08:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:13.133+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 255 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:08:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:13.134+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 254 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:08:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:13 smithi136 ceph-mon[125702]: pgmap v17621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:08:14.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:13 smithi136 ceph-mon[125702]: osdmap e1175: 12 total, 12 up, 12 in 2023-03-02T20:08:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:13 smithi057 ceph-mon[92072]: pgmap v17621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:08:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:13 smithi057 ceph-mon[92072]: osdmap e1175: 12 total, 12 up, 12 in 2023-03-02T20:08:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:13 smithi122 ceph-mon[125440]: pgmap v17621: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:08:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:13 smithi122 ceph-mon[125440]: osdmap e1175: 12 total, 12 up, 12 in 2023-03-02T20:08:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:14.372+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:08:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:14.372+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:08:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:14.372+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:08:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:14.372+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:08:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:14.373+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:08:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:15 smithi136 ceph-mon[125702]: pgmap v17623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:08:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:15 smithi057 ceph-mon[92072]: pgmap v17623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:08:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:15 smithi122 ceph-mon[125440]: pgmap v17623: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:08:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:17 smithi136 ceph-mon[125702]: pgmap v17624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:08:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:17 smithi057 ceph-mon[92072]: pgmap v17624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:08:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:17 smithi122 ceph-mon[125440]: pgmap v17624: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:08:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:19 smithi057 ceph-mon[92072]: pgmap v17625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:08:20.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:19 smithi122 ceph-mon[125440]: pgmap v17625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:08:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:19 smithi136 ceph-mon[125702]: pgmap v17625: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:08:21.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:08:21.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:08:21.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:08:22.125 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:21 smithi057 ceph-mon[92072]: pgmap v17626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:08:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:21 smithi122 ceph-mon[125440]: pgmap v17626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:08:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:21 smithi136 ceph-mon[125702]: pgmap v17626: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:08:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:23 smithi057 ceph-mon[92072]: pgmap v17627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:08:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:23 smithi122 ceph-mon[125440]: pgmap v17627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:08:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:23 smithi136 ceph-mon[125702]: pgmap v17627: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:08:25.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:08:25.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:08:25.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:08:25.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:08:25.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:08:25.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:25 smithi057 ceph-mon[92072]: pgmap v17628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T20:08:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:08:25.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:08:25.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:08:25.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:08:25.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:08:25.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:25 smithi122 ceph-mon[125440]: pgmap v17628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T20:08:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:08:25.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:08:25.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:08:25.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:08:25.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:08:25.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:25 smithi136 ceph-mon[125702]: pgmap v17628: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T20:08:27.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:27 smithi136 ceph-mon[125702]: pgmap v17629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T20:08:27.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:27 smithi057 ceph-mon[92072]: pgmap v17629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T20:08:27.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:27 smithi122 ceph-mon[125440]: pgmap v17629: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T20:08:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:29.388+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:08:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:29.388+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:08:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:29.388+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:08:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:29.388+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:08:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:29.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:08:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:29 smithi136 ceph-mon[125702]: pgmap v17630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:08:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:29 smithi057 ceph-mon[92072]: pgmap v17630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:08:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:29 smithi122 ceph-mon[125440]: pgmap v17630: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:08:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:31 smithi136 ceph-mon[125702]: pgmap v17631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:31.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:31 smithi057 ceph-mon[92072]: pgmap v17631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:31 smithi122 ceph-mon[125440]: pgmap v17631: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:33 smithi136 ceph-mon[125702]: pgmap v17632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:33.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:33 smithi057 ceph-mon[92072]: pgmap v17632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:33 smithi122 ceph-mon[125440]: pgmap v17632: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:35.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:35 smithi136 ceph-mon[125702]: pgmap v17633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:35.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:35 smithi057 ceph-mon[92072]: pgmap v17633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:35.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:35 smithi122 ceph-mon[125440]: pgmap v17633: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:37 smithi136 ceph-mon[125702]: pgmap v17634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:37 smithi057 ceph-mon[92072]: pgmap v17634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:37.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:37 smithi122 ceph-mon[125440]: pgmap v17634: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:39 smithi057 ceph-mon[92072]: pgmap v17635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:39 smithi122 ceph-mon[125440]: pgmap v17635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:39 smithi136 ceph-mon[125702]: pgmap v17635: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:41 smithi057 ceph-mon[92072]: pgmap v17636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:41 smithi122 ceph-mon[125440]: pgmap v17636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:41 smithi136 ceph-mon[125702]: pgmap v17636: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:43 smithi057 ceph-mon[92072]: pgmap v17637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:43 smithi122 ceph-mon[125440]: pgmap v17637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:43 smithi136 ceph-mon[125702]: pgmap v17637: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:44.398+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:08:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:44.398+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:08:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:44.398+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:08:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:44.398+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:08:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:44.398+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:08:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:45 smithi057 ceph-mon[92072]: pgmap v17638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:45 smithi122 ceph-mon[125440]: pgmap v17638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:45 smithi136 ceph-mon[125702]: pgmap v17638: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:47.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:47 smithi057 ceph-mon[92072]: pgmap v17639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:47 smithi122 ceph-mon[125440]: pgmap v17639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:47 smithi136 ceph-mon[125702]: pgmap v17639: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:49 smithi057 ceph-mon[92072]: pgmap v17640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:49 smithi122 ceph-mon[125440]: pgmap v17640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:49 smithi136 ceph-mon[125702]: pgmap v17640: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:51 smithi057 ceph-mon[92072]: pgmap v17641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:51 smithi122 ceph-mon[125440]: pgmap v17641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:51 smithi136 ceph-mon[125702]: pgmap v17641: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:53.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:53 smithi057 ceph-mon[92072]: pgmap v17642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:53.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:53 smithi122 ceph-mon[125440]: pgmap v17642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:53 smithi136 ceph-mon[125702]: pgmap v17642: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:55.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:55 smithi057 ceph-mon[92072]: pgmap v17643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:55.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:55 smithi122 ceph-mon[125440]: pgmap v17643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:55 smithi136 ceph-mon[125702]: pgmap v17643: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:57 smithi057 ceph-mon[92072]: pgmap v17644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:57 smithi122 ceph-mon[125440]: pgmap v17644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:57 smithi136 ceph-mon[125702]: pgmap v17644: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:08:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:59.414+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:08:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:59.414+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:08:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:59.414+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:08:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:59.414+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:08:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:08:59.414+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:08:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:08:59 smithi057 ceph-mon[92072]: pgmap v17645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:08:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:08:59 smithi122 ceph-mon[125440]: pgmap v17645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:08:59 smithi136 ceph-mon[125702]: pgmap v17645: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:01 smithi057 ceph-mon[92072]: pgmap v17646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:01 smithi122 ceph-mon[125440]: pgmap v17646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:01 smithi136 ceph-mon[125702]: pgmap v17646: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:03.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:03 smithi057 ceph-mon[92072]: pgmap v17647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:09:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:03 smithi122 ceph-mon[125440]: pgmap v17647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:09:04.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:03 smithi136 ceph-mon[125702]: pgmap v17647: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:09:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:05 smithi057 ceph-mon[92072]: pgmap v17648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:09:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:05 smithi122 ceph-mon[125440]: pgmap v17648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:09:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:05 smithi136 ceph-mon[125702]: pgmap v17648: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:09:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:07 smithi057 ceph-mon[92072]: pgmap v17649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:09:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:07 smithi057 ceph-mon[92072]: osdmap e1176: 12 total, 12 up, 12 in 2023-03-02T20:09:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:07 smithi122 ceph-mon[125440]: pgmap v17649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:09:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:07 smithi122 ceph-mon[125440]: osdmap e1176: 12 total, 12 up, 12 in 2023-03-02T20:09:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:07 smithi136 ceph-mon[125702]: pgmap v17649: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:09:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:07 smithi136 ceph-mon[125702]: osdmap e1176: 12 total, 12 up, 12 in 2023-03-02T20:09:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:09 smithi122 ceph-mon[125440]: pgmap v17651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:09:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:09 smithi136 ceph-mon[125702]: pgmap v17651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:09:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:09 smithi057 ceph-mon[92072]: pgmap v17651: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:09:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:11 smithi122 ceph-mon[125440]: pgmap v17652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:09:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:11 smithi136 ceph-mon[125702]: pgmap v17652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:09:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:11 smithi057 ceph-mon[92072]: pgmap v17652: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:09:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:13 smithi136 ceph-mon[125702]: pgmap v17653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:09:14.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:13 smithi136 ceph-mon[125702]: osdmap e1177: 12 total, 12 up, 12 in 2023-03-02T20:09:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:13 smithi057 ceph-mon[92072]: pgmap v17653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:09:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:13 smithi057 ceph-mon[92072]: osdmap e1177: 12 total, 12 up, 12 in 2023-03-02T20:09:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:13 smithi122 ceph-mon[125440]: pgmap v17653: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:09:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:13 smithi122 ceph-mon[125440]: osdmap e1177: 12 total, 12 up, 12 in 2023-03-02T20:09:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:14.428+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:09:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:14.429+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:09:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:14.429+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:09:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:14.429+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:09:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:14.429+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:09:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:15 smithi136 ceph-mon[125702]: pgmap v17655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:09:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:15 smithi057 ceph-mon[92072]: pgmap v17655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:09:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:15 smithi122 ceph-mon[125440]: pgmap v17655: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:09:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:17 smithi136 ceph-mon[125702]: pgmap v17656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:09:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:17 smithi057 ceph-mon[92072]: pgmap v17656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:09:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:17 smithi122 ceph-mon[125440]: pgmap v17656: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:09:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:19 smithi136 ceph-mon[125702]: pgmap v17657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:09:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:19 smithi057 ceph-mon[92072]: pgmap v17657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:09:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:19 smithi122 ceph-mon[125440]: pgmap v17657: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:09:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:21 smithi136 ceph-mon[125702]: pgmap v17658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:09:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:21 smithi057 ceph-mon[92072]: pgmap v17658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:09:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:21 smithi122 ceph-mon[125440]: pgmap v17658: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:09:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:23 smithi136 ceph-mon[125702]: pgmap v17659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T20:09:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:23 smithi057 ceph-mon[92072]: pgmap v17659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T20:09:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:23 smithi122 ceph-mon[125440]: pgmap v17659: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T20:09:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:09:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:09:25.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:09:26.013 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:25 smithi136 ceph-mon[125702]: pgmap v17660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:09:26.119 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:25 smithi122 ceph-mon[125440]: pgmap v17660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:09:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:25 smithi057 ceph-mon[92072]: pgmap v17660: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:09:28.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:27 smithi136 ceph-mon[125702]: pgmap v17661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:27 smithi057 ceph-mon[92072]: pgmap v17661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:28.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:27 smithi122 ceph-mon[125440]: pgmap v17661: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:29.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:09:29.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:09:29.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:09:29.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:09:29.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:09:29.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:09:29.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:09:29.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:29.444+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:09:29.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:29.445+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:09:29.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:29.445+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:09:29.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:29.445+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:09:29.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:29.445+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:09:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:29 smithi057 ceph-mon[92072]: pgmap v17662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:09:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:29 smithi122 ceph-mon[125440]: pgmap v17662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:09:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:29 smithi136 ceph-mon[125702]: pgmap v17662: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:09:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:31 smithi057 ceph-mon[92072]: pgmap v17663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:31 smithi122 ceph-mon[125440]: pgmap v17663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:31 smithi136 ceph-mon[125702]: pgmap v17663: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:33 smithi057 ceph-mon[92072]: pgmap v17664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:33 smithi122 ceph-mon[125440]: pgmap v17664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:34.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:33 smithi136 ceph-mon[125702]: pgmap v17664: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:35 smithi057 ceph-mon[92072]: pgmap v17665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:35 smithi122 ceph-mon[125440]: pgmap v17665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:35 smithi136 ceph-mon[125702]: pgmap v17665: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:37 smithi057 ceph-mon[92072]: pgmap v17666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:38.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:37 smithi122 ceph-mon[125440]: pgmap v17666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:37 smithi136 ceph-mon[125702]: pgmap v17666: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:39 smithi057 ceph-mon[92072]: pgmap v17667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:40.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:39 smithi122 ceph-mon[125440]: pgmap v17667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:39 smithi136 ceph-mon[125702]: pgmap v17667: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:41 smithi057 ceph-mon[92072]: pgmap v17668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:42.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:41 smithi122 ceph-mon[125440]: pgmap v17668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:41 smithi136 ceph-mon[125702]: pgmap v17668: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:43 smithi057 ceph-mon[92072]: pgmap v17669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:43 smithi122 ceph-mon[125440]: pgmap v17669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:43 smithi136 ceph-mon[125702]: pgmap v17669: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:44.460+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:09:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:44.461+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:09:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:44.461+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:09:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:44.461+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:09:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:44.461+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:09:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:45 smithi057 ceph-mon[92072]: pgmap v17670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:45 smithi122 ceph-mon[125440]: pgmap v17670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:45 smithi136 ceph-mon[125702]: pgmap v17670: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:47 smithi057 ceph-mon[92072]: pgmap v17671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:48.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:47 smithi122 ceph-mon[125440]: pgmap v17671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:48.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:47 smithi136 ceph-mon[125702]: pgmap v17671: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:49 smithi057 ceph-mon[92072]: pgmap v17672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:50.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:49 smithi122 ceph-mon[125440]: pgmap v17672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:49 smithi136 ceph-mon[125702]: pgmap v17672: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:52.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:51 smithi122 ceph-mon[125440]: pgmap v17673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:51 smithi136 ceph-mon[125702]: pgmap v17673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:51 smithi057 ceph-mon[92072]: pgmap v17673: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:54.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:53 smithi122 ceph-mon[125440]: pgmap v17674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:53 smithi136 ceph-mon[125702]: pgmap v17674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:53 smithi057 ceph-mon[92072]: pgmap v17674: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:09:56.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:55 smithi122 ceph-mon[125440]: pgmap v17675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:55 smithi136 ceph-mon[125702]: pgmap v17675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:55 smithi057 ceph-mon[92072]: pgmap v17675: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:58.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:57 smithi122 ceph-mon[125440]: pgmap v17676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:57 smithi136 ceph-mon[125702]: pgmap v17676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:58.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:57 smithi057 ceph-mon[92072]: pgmap v17676: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:09:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:59.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:09:59.474 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:59.470+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:09:59.474 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:59.470+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:09:59.474 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:59.470+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:09:59.474 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:09:59.471+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:10:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:09:59 smithi136 ceph-mon[125702]: pgmap v17677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:09:59 smithi057 ceph-mon[92072]: pgmap v17677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:09:59 smithi122 ceph-mon[125440]: pgmap v17677: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T20:10:01.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T20:10:01.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T20:10:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:01 smithi136 ceph-mon[125702]: pgmap v17678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:02.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:01 smithi057 ceph-mon[92072]: pgmap v17678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:01 smithi122 ceph-mon[125440]: pgmap v17678: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:03 smithi136 ceph-mon[125702]: pgmap v17679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:10:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:03 smithi057 ceph-mon[92072]: pgmap v17679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:10:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:03 smithi122 ceph-mon[125440]: pgmap v17679: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:10:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:05 smithi136 ceph-mon[125702]: pgmap v17680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:10:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:05 smithi057 ceph-mon[92072]: pgmap v17680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:10:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:05 smithi122 ceph-mon[125440]: pgmap v17680: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:10:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:07 smithi136 ceph-mon[125702]: pgmap v17681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:10:08.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:07 smithi136 ceph-mon[125702]: osdmap e1178: 12 total, 12 up, 12 in 2023-03-02T20:10:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:07 smithi057 ceph-mon[92072]: pgmap v17681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:10:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:07 smithi057 ceph-mon[92072]: osdmap e1178: 12 total, 12 up, 12 in 2023-03-02T20:10:08.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:07 smithi122 ceph-mon[125440]: pgmap v17681: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:10:08.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:07 smithi122 ceph-mon[125440]: osdmap e1178: 12 total, 12 up, 12 in 2023-03-02T20:10:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:09 smithi136 ceph-mon[125702]: pgmap v17683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:10:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:09 smithi057 ceph-mon[92072]: pgmap v17683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:10:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:09 smithi122 ceph-mon[125440]: pgmap v17683: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:10:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:11 smithi136 ceph-mon[125702]: pgmap v17684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:10:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:11 smithi057 ceph-mon[92072]: pgmap v17684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:10:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:11 smithi122 ceph-mon[125440]: pgmap v17684: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:10:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:13 smithi136 ceph-mon[125702]: pgmap v17685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:10:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:13 smithi136 ceph-mon[125702]: osdmap e1179: 12 total, 12 up, 12 in 2023-03-02T20:10:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:13 smithi057 ceph-mon[92072]: pgmap v17685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:10:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:13 smithi057 ceph-mon[92072]: osdmap e1179: 12 total, 12 up, 12 in 2023-03-02T20:10:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:13 smithi122 ceph-mon[125440]: pgmap v17685: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:10:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:13 smithi122 ceph-mon[125440]: osdmap e1179: 12 total, 12 up, 12 in 2023-03-02T20:10:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:14.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:10:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:14.481+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:10:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:14.481+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:10:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:14.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:10:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:14.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:10:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:15 smithi136 ceph-mon[125702]: pgmap v17687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:10:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:15 smithi057 ceph-mon[92072]: pgmap v17687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:10:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:15 smithi122 ceph-mon[125440]: pgmap v17687: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:10:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:18 smithi136 ceph-mon[125702]: pgmap v17688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T20:10:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:18 smithi057 ceph-mon[92072]: pgmap v17688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T20:10:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:18 smithi122 ceph-mon[125440]: pgmap v17688: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T20:10:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:20 smithi136 ceph-mon[125702]: pgmap v17689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:10:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:20 smithi057 ceph-mon[92072]: pgmap v17689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:10:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:20 smithi122 ceph-mon[125440]: pgmap v17689: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:10:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:22 smithi136 ceph-mon[125702]: pgmap v17690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:10:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:22 smithi057 ceph-mon[92072]: pgmap v17690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:10:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:22 smithi122 ceph-mon[125440]: pgmap v17690: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:10:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:24 smithi136 ceph-mon[125702]: pgmap v17691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:10:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:24 smithi057 ceph-mon[92072]: pgmap v17691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:10:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:24 smithi122 ceph-mon[125440]: pgmap v17691: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:10:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:26 smithi136 ceph-mon[125702]: pgmap v17692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:10:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:26 smithi057 ceph-mon[92072]: pgmap v17692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:10:26.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:26 smithi122 ceph-mon[125440]: pgmap v17692: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:10:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:28 smithi136 ceph-mon[125702]: pgmap v17693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:28 smithi057 ceph-mon[92072]: pgmap v17693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:28.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:28 smithi122 ceph-mon[125440]: pgmap v17693: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:29.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:10:29.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:10:29.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:10:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:29.486+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:10:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:29.487+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:10:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:29.487+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:10:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:29.487+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:10:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:29.487+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:10:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:30 smithi136 ceph-mon[125702]: pgmap v17694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:10:30.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:10:30.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:10:30.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:10:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:30 smithi057 ceph-mon[92072]: pgmap v17694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:10:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:10:30.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:10:30.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:10:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:30 smithi122 ceph-mon[125440]: pgmap v17694: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:10:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:10:30.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:10:30.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:10:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:31 smithi136 ceph-mon[125702]: pgmap v17695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:31.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:31 smithi057 ceph-mon[92072]: pgmap v17695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:31 smithi122 ceph-mon[125440]: pgmap v17695: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:33 smithi136 ceph-mon[125702]: pgmap v17696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:33 smithi057 ceph-mon[92072]: pgmap v17696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:33 smithi122 ceph-mon[125440]: pgmap v17696: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:35.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:35 smithi057 ceph-mon[92072]: pgmap v17697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:35 smithi122 ceph-mon[125440]: pgmap v17697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:35 smithi136 ceph-mon[125702]: pgmap v17697: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:37 smithi057 ceph-mon[92072]: pgmap v17698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:37 smithi122 ceph-mon[125440]: pgmap v17698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:37 smithi136 ceph-mon[125702]: pgmap v17698: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:39 smithi057 ceph-mon[92072]: pgmap v17699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:39 smithi122 ceph-mon[125440]: pgmap v17699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:39 smithi136 ceph-mon[125702]: pgmap v17699: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:41 smithi057 ceph-mon[92072]: pgmap v17700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:41 smithi122 ceph-mon[125440]: pgmap v17700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:41 smithi136 ceph-mon[125702]: pgmap v17700: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:43 smithi057 ceph-mon[92072]: pgmap v17701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:43.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:43 smithi122 ceph-mon[125440]: pgmap v17701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:43 smithi136 ceph-mon[125702]: pgmap v17701: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:44.505 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:44.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:10:44.505 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:44.503+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:10:44.505 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:44.503+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:10:44.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:44.503+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:10:44.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:44.503+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:10:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:45 smithi057 ceph-mon[92072]: pgmap v17702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:45.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:45 smithi122 ceph-mon[125440]: pgmap v17702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:45 smithi136 ceph-mon[125702]: pgmap v17702: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:47.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:47 smithi057 ceph-mon[92072]: pgmap v17703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:47.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:47 smithi122 ceph-mon[125440]: pgmap v17703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:47 smithi136 ceph-mon[125702]: pgmap v17703: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:49 smithi057 ceph-mon[92072]: pgmap v17704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:49 smithi122 ceph-mon[125440]: pgmap v17704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:49 smithi136 ceph-mon[125702]: pgmap v17704: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:51 smithi057 ceph-mon[92072]: pgmap v17705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:51 smithi122 ceph-mon[125440]: pgmap v17705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:51 smithi136 ceph-mon[125702]: pgmap v17705: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:53.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:53 smithi057 ceph-mon[92072]: pgmap v17706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:53.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:53 smithi122 ceph-mon[125440]: pgmap v17706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:53 smithi136 ceph-mon[125702]: pgmap v17706: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:55.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:55 smithi057 ceph-mon[92072]: pgmap v17707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:55 smithi122 ceph-mon[125440]: pgmap v17707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:55 smithi136 ceph-mon[125702]: pgmap v17707: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:57 smithi057 ceph-mon[92072]: pgmap v17708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:57 smithi122 ceph-mon[125440]: pgmap v17708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:57 smithi136 ceph-mon[125702]: pgmap v17708: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:10:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:59.508+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:10:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:59.508+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:10:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:59.508+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:10:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:59.508+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:10:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:10:59.509+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:10:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:10:59 smithi057 ceph-mon[92072]: pgmap v17709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:10:59.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:10:59 smithi122 ceph-mon[125440]: pgmap v17709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:10:59 smithi136 ceph-mon[125702]: pgmap v17709: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:01.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:01 smithi057 ceph-mon[92072]: pgmap v17710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:01.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:01 smithi122 ceph-mon[125440]: pgmap v17710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:01 smithi136 ceph-mon[125702]: pgmap v17710: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:03.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:03 smithi057 ceph-mon[92072]: pgmap v17711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:11:03.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:03 smithi122 ceph-mon[125440]: pgmap v17711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:11:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:03 smithi136 ceph-mon[125702]: pgmap v17711: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:11:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:05 smithi057 ceph-mon[92072]: pgmap v17712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:11:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:05 smithi122 ceph-mon[125440]: pgmap v17712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:11:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:05 smithi136 ceph-mon[125702]: pgmap v17712: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:11:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:07 smithi122 ceph-mon[125440]: pgmap v17713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:11:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:07 smithi122 ceph-mon[125440]: osdmap e1180: 12 total, 12 up, 12 in 2023-03-02T20:11:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:07 smithi136 ceph-mon[125702]: pgmap v17713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:11:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:07 smithi136 ceph-mon[125702]: osdmap e1180: 12 total, 12 up, 12 in 2023-03-02T20:11:08.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:07 smithi057 ceph-mon[92072]: pgmap v17713: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:11:08.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:07 smithi057 ceph-mon[92072]: osdmap e1180: 12 total, 12 up, 12 in 2023-03-02T20:11:09.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:09 smithi122 ceph-mon[125440]: pgmap v17715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:11:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:09 smithi136 ceph-mon[125702]: pgmap v17715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:11:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:09 smithi057 ceph-mon[92072]: pgmap v17715: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:11:11.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:11 smithi122 ceph-mon[125440]: pgmap v17716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:11:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:11 smithi136 ceph-mon[125702]: pgmap v17716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:11:12.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:11 smithi057 ceph-mon[92072]: pgmap v17716: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:11:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:13.160+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:11:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:13.160+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:11:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:13.160+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 256 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:11:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:13.160+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 255 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:11:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:13 smithi136 ceph-mon[125702]: pgmap v17717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:11:14.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:13 smithi136 ceph-mon[125702]: osdmap e1181: 12 total, 12 up, 12 in 2023-03-02T20:11:14.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:13 smithi057 ceph-mon[92072]: pgmap v17717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:11:14.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:13 smithi057 ceph-mon[92072]: osdmap e1181: 12 total, 12 up, 12 in 2023-03-02T20:11:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:13 smithi122 ceph-mon[125440]: pgmap v17717: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:11:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:13 smithi122 ceph-mon[125440]: osdmap e1181: 12 total, 12 up, 12 in 2023-03-02T20:11:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:14.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:11:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:14.514+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:11:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:14.514+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:11:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:14.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:11:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:14.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:11:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:15 smithi136 ceph-mon[125702]: pgmap v17719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:11:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:15 smithi057 ceph-mon[92072]: pgmap v17719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:11:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:15 smithi122 ceph-mon[125440]: pgmap v17719: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:11:18.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:17 smithi136 ceph-mon[125702]: pgmap v17720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:11:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:17 smithi057 ceph-mon[92072]: pgmap v17720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:11:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:17 smithi122 ceph-mon[125440]: pgmap v17720: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T20:11:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:19 smithi136 ceph-mon[125702]: pgmap v17721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:11:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:19 smithi057 ceph-mon[92072]: pgmap v17721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:11:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:19 smithi122 ceph-mon[125440]: pgmap v17721: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:11:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:21 smithi136 ceph-mon[125702]: pgmap v17722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:11:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:21 smithi057 ceph-mon[92072]: pgmap v17722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:11:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:21 smithi122 ceph-mon[125440]: pgmap v17722: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:11:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:23 smithi136 ceph-mon[125702]: pgmap v17723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:11:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:23 smithi057 ceph-mon[92072]: pgmap v17723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:11:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:23 smithi122 ceph-mon[125440]: pgmap v17723: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:11:26.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:25 smithi136 ceph-mon[125702]: pgmap v17724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:11:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:25 smithi057 ceph-mon[92072]: pgmap v17724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:11:26.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:25 smithi122 ceph-mon[125440]: pgmap v17724: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:11:28.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:27 smithi136 ceph-mon[125702]: pgmap v17725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:27 smithi057 ceph-mon[92072]: pgmap v17725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:27 smithi122 ceph-mon[125440]: pgmap v17725: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:29.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:29.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:11:29.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:29.529+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:11:29.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:29.529+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:11:29.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:29.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:11:29.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:29.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:11:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:29 smithi136 ceph-mon[125702]: pgmap v17726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:11:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:11:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:29 smithi057 ceph-mon[92072]: pgmap v17726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:11:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:11:30.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:29 smithi122 ceph-mon[125440]: pgmap v17726: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:11:30.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:11:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:31 smithi136 ceph-mon[125702]: pgmap v17727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:11:31.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:11:31.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:31 smithi057 ceph-mon[92072]: pgmap v17727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:31.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:11:31.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:11:31.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:31 smithi122 ceph-mon[125440]: pgmap v17727: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:31.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:31.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:11:31.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:11:31.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:11:33.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:33 smithi136 ceph-mon[125702]: pgmap v17728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:33 smithi057 ceph-mon[92072]: pgmap v17728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:33.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:33 smithi122 ceph-mon[125440]: pgmap v17728: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:35.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:35 smithi057 ceph-mon[92072]: pgmap v17729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:35.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:35 smithi122 ceph-mon[125440]: pgmap v17729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:35 smithi136 ceph-mon[125702]: pgmap v17729: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:37 smithi057 ceph-mon[92072]: pgmap v17730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:37.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:37 smithi122 ceph-mon[125440]: pgmap v17730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:37 smithi136 ceph-mon[125702]: pgmap v17730: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:39.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:39 smithi057 ceph-mon[92072]: pgmap v17731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:39.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:39 smithi122 ceph-mon[125440]: pgmap v17731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:39 smithi136 ceph-mon[125702]: pgmap v17731: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:41 smithi057 ceph-mon[92072]: pgmap v17732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:41.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:41 smithi122 ceph-mon[125440]: pgmap v17732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:41 smithi136 ceph-mon[125702]: pgmap v17732: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:43.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:43 smithi057 ceph-mon[92072]: pgmap v17733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:43.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:43 smithi122 ceph-mon[125440]: pgmap v17733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:43 smithi136 ceph-mon[125702]: pgmap v17733: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:44.532+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:11:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:44.532+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:11:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:44.532+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:11:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:44.532+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:11:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:44.532+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:11:45.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:45 smithi057 ceph-mon[92072]: pgmap v17734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:45 smithi122 ceph-mon[125440]: pgmap v17734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:45 smithi136 ceph-mon[125702]: pgmap v17734: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:47.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:47 smithi057 ceph-mon[92072]: pgmap v17735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:47 smithi122 ceph-mon[125440]: pgmap v17735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:47 smithi136 ceph-mon[125702]: pgmap v17735: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:49 smithi057 ceph-mon[92072]: pgmap v17736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:49.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:49 smithi122 ceph-mon[125440]: pgmap v17736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:50.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:49 smithi136 ceph-mon[125702]: pgmap v17736: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:51 smithi057 ceph-mon[92072]: pgmap v17737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:51 smithi122 ceph-mon[125440]: pgmap v17737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:51 smithi136 ceph-mon[125702]: pgmap v17737: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:53.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:53 smithi057 ceph-mon[92072]: pgmap v17738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:53 smithi122 ceph-mon[125440]: pgmap v17738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:53 smithi136 ceph-mon[125702]: pgmap v17738: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:11:55.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:55 smithi057 ceph-mon[92072]: pgmap v17739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:55.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:55 smithi122 ceph-mon[125440]: pgmap v17739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:55 smithi136 ceph-mon[125702]: pgmap v17739: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:57 smithi122 ceph-mon[125440]: pgmap v17740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:57 smithi136 ceph-mon[125702]: pgmap v17740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:58.165+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:11:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:58.165+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:11:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:58.166+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 256 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:11:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:58.166+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 257 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:11:58.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:57 smithi057 ceph-mon[92072]: pgmap v17740: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:11:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:59.536+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:11:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:59.536+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:11:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:59.536+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:11:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:59.536+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:11:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:11:59.536+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:11:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:11:59 smithi122 ceph-mon[125440]: pgmap v17741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:11:59 smithi136 ceph-mon[125702]: pgmap v17741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:11:59 smithi057 ceph-mon[92072]: pgmap v17741: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:01.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:01 smithi122 ceph-mon[125440]: pgmap v17742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:02.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:01 smithi136 ceph-mon[125702]: pgmap v17742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:02.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:01 smithi057 ceph-mon[92072]: pgmap v17742: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:03.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:03 smithi122 ceph-mon[125440]: pgmap v17743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:12:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:03 smithi136 ceph-mon[125702]: pgmap v17743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:12:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:03 smithi057 ceph-mon[92072]: pgmap v17743: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:12:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:05 smithi122 ceph-mon[125440]: pgmap v17744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:12:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:05 smithi136 ceph-mon[125702]: pgmap v17744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:12:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:05 smithi057 ceph-mon[92072]: pgmap v17744: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:12:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:07 smithi136 ceph-mon[125702]: pgmap v17745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:12:08.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:07 smithi136 ceph-mon[125702]: osdmap e1182: 12 total, 12 up, 12 in 2023-03-02T20:12:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:07 smithi057 ceph-mon[92072]: pgmap v17745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:12:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:07 smithi057 ceph-mon[92072]: osdmap e1182: 12 total, 12 up, 12 in 2023-03-02T20:12:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:07 smithi122 ceph-mon[125440]: pgmap v17745: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:12:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:07 smithi122 ceph-mon[125440]: osdmap e1182: 12 total, 12 up, 12 in 2023-03-02T20:12:10.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:09 smithi136 ceph-mon[125702]: pgmap v17747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:12:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:09 smithi057 ceph-mon[92072]: pgmap v17747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:12:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:09 smithi122 ceph-mon[125440]: pgmap v17747: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:12:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:11 smithi136 ceph-mon[125702]: pgmap v17748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:12:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:11 smithi057 ceph-mon[92072]: pgmap v17748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:12:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:11 smithi122 ceph-mon[125440]: pgmap v17748: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:12:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:13 smithi136 ceph-mon[125702]: pgmap v17749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:12:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:13 smithi136 ceph-mon[125702]: osdmap e1183: 12 total, 12 up, 12 in 2023-03-02T20:12:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:13 smithi057 ceph-mon[92072]: pgmap v17749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:12:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:13 smithi057 ceph-mon[92072]: osdmap e1183: 12 total, 12 up, 12 in 2023-03-02T20:12:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:13 smithi122 ceph-mon[125440]: pgmap v17749: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:12:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:13 smithi122 ceph-mon[125440]: osdmap e1183: 12 total, 12 up, 12 in 2023-03-02T20:12:14.553 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:14.551+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:12:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:14.552+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:12:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:14.552+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:12:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:14.552+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:12:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:14.552+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:12:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:15 smithi136 ceph-mon[125702]: pgmap v17751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:12:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:15 smithi057 ceph-mon[92072]: pgmap v17751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:12:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:15 smithi122 ceph-mon[125440]: pgmap v17751: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:12:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:17 smithi136 ceph-mon[125702]: pgmap v17752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 107 B/s wr, 8 op/s 2023-03-02T20:12:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:17 smithi057 ceph-mon[92072]: pgmap v17752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 107 B/s wr, 8 op/s 2023-03-02T20:12:18.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:17 smithi122 ceph-mon[125440]: pgmap v17752: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 107 B/s wr, 8 op/s 2023-03-02T20:12:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:19 smithi136 ceph-mon[125702]: pgmap v17753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:12:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:19 smithi057 ceph-mon[92072]: pgmap v17753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:12:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:19 smithi122 ceph-mon[125440]: pgmap v17753: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:12:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:21 smithi136 ceph-mon[125702]: pgmap v17754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:12:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:21 smithi057 ceph-mon[92072]: pgmap v17754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:12:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:21 smithi122 ceph-mon[125440]: pgmap v17754: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:12:24.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:23 smithi136 ceph-mon[125702]: pgmap v17755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:12:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:23 smithi057 ceph-mon[92072]: pgmap v17755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:12:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:23 smithi122 ceph-mon[125440]: pgmap v17755: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:12:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:25 smithi136 ceph-mon[125702]: pgmap v17756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:12:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:25 smithi057 ceph-mon[92072]: pgmap v17756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:12:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:25 smithi122 ceph-mon[125440]: pgmap v17756: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:12:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:27 smithi136 ceph-mon[125702]: pgmap v17757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:27 smithi057 ceph-mon[92072]: pgmap v17757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:27 smithi122 ceph-mon[125440]: pgmap v17757: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:29.557+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:12:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:29.557+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:12:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:29.557+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:12:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:29.557+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:12:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:29.557+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:12:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:29 smithi136 ceph-mon[125702]: pgmap v17758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:29 smithi057 ceph-mon[92072]: pgmap v17758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:29 smithi122 ceph-mon[125440]: pgmap v17758: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:30 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:12:31.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:30 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:12:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:30 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:12:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:31 smithi136 ceph-mon[125702]: pgmap v17759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:12:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:31 smithi057 ceph-mon[92072]: pgmap v17759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:12:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:31 smithi122 ceph-mon[125440]: pgmap v17759: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:12:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:33 smithi136 ceph-mon[125702]: pgmap v17760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:34.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:34.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:34.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:34.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:33 smithi057 ceph-mon[92072]: pgmap v17760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:33 smithi122 ceph-mon[125440]: pgmap v17760: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:35.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:35.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:12:35.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:12:35.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:35.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:35.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:35.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:12:35.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:12:35.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:35.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:35.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:35.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:12:35.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:12:35.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:12:35.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:12:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:35 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:12:36.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:35 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:12:36.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:35 smithi136 ceph-mon[125702]: pgmap v17761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:12:36.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:35 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:12:36.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:35 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:12:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:35 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:12:36.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:35 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:12:36.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:35 smithi057 ceph-mon[92072]: pgmap v17761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:12:36.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:35 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:12:36.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:35 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:12:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:35 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:12:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:35 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:12:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:35 smithi122 ceph-mon[125440]: pgmap v17761: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:12:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:35 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:12:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:35 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:12:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:37 smithi136 ceph-mon[125702]: pgmap v17762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:12:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:37 smithi057 ceph-mon[92072]: pgmap v17762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:12:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:37 smithi122 ceph-mon[125440]: pgmap v17762: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:12:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:39 smithi057 ceph-mon[92072]: pgmap v17763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:39 smithi122 ceph-mon[125440]: pgmap v17763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:39 smithi136 ceph-mon[125702]: pgmap v17763: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:41 smithi057 ceph-mon[92072]: pgmap v17764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:42.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:41 smithi122 ceph-mon[125440]: pgmap v17764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:41 smithi136 ceph-mon[125702]: pgmap v17764: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:43 smithi057 ceph-mon[92072]: pgmap v17765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:44.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:43 smithi122 ceph-mon[125440]: pgmap v17765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:43 smithi136 ceph-mon[125702]: pgmap v17765: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:44.573+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:12:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:44.573+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:12:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:44.573+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:12:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:44.573+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:12:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:44.573+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:12:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:45 smithi057 ceph-mon[92072]: pgmap v17766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:45 smithi122 ceph-mon[125440]: pgmap v17766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:45 smithi136 ceph-mon[125702]: pgmap v17766: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:47 smithi057 ceph-mon[92072]: pgmap v17767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:47 smithi122 ceph-mon[125440]: pgmap v17767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:47 smithi136 ceph-mon[125702]: pgmap v17767: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:49 smithi057 ceph-mon[92072]: pgmap v17768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:49 smithi122 ceph-mon[125440]: pgmap v17768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:49 smithi136 ceph-mon[125702]: pgmap v17768: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:51 smithi057 ceph-mon[92072]: pgmap v17769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:51 smithi122 ceph-mon[125440]: pgmap v17769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:51 smithi136 ceph-mon[125702]: pgmap v17769: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:53 smithi057 ceph-mon[92072]: pgmap v17770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:53 smithi122 ceph-mon[125440]: pgmap v17770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:53 smithi136 ceph-mon[125702]: pgmap v17770: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:12:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:55 smithi057 ceph-mon[92072]: pgmap v17771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:55 smithi122 ceph-mon[125440]: pgmap v17771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:56.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:55 smithi136 ceph-mon[125702]: pgmap v17771: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:57 smithi057 ceph-mon[92072]: pgmap v17772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:57 smithi122 ceph-mon[125440]: pgmap v17772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:57 smithi136 ceph-mon[125702]: pgmap v17772: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:12:59.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:59.584+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:12:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:59.584+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:12:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:59.584+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:12:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:59.584+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:12:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:12:59.584+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:13:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:12:59 smithi057 ceph-mon[92072]: pgmap v17773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:12:59 smithi122 ceph-mon[125440]: pgmap v17773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:12:59 smithi136 ceph-mon[125702]: pgmap v17773: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:01 smithi057 ceph-mon[92072]: pgmap v17774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:02.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:01 smithi122 ceph-mon[125440]: pgmap v17774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:01 smithi136 ceph-mon[125702]: pgmap v17774: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:03 smithi057 ceph-mon[92072]: pgmap v17775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:13:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:03 smithi122 ceph-mon[125440]: pgmap v17775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:13:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:03 smithi136 ceph-mon[125702]: pgmap v17775: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:13:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:05 smithi057 ceph-mon[92072]: pgmap v17776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:13:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:05 smithi122 ceph-mon[125440]: pgmap v17776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:13:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:05 smithi136 ceph-mon[125702]: pgmap v17776: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:13:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:07 smithi057 ceph-mon[92072]: pgmap v17777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:13:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:07 smithi057 ceph-mon[92072]: osdmap e1184: 12 total, 12 up, 12 in 2023-03-02T20:13:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:07 smithi122 ceph-mon[125440]: pgmap v17777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:13:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:07 smithi122 ceph-mon[125440]: osdmap e1184: 12 total, 12 up, 12 in 2023-03-02T20:13:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:07 smithi136 ceph-mon[125702]: pgmap v17777: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:13:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:07 smithi136 ceph-mon[125702]: osdmap e1184: 12 total, 12 up, 12 in 2023-03-02T20:13:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:09 smithi057 ceph-mon[92072]: pgmap v17779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:13:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:09 smithi122 ceph-mon[125440]: pgmap v17779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:13:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:09 smithi136 ceph-mon[125702]: pgmap v17779: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:13:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:11 smithi057 ceph-mon[92072]: pgmap v17780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:13:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:11 smithi122 ceph-mon[125440]: pgmap v17780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:13:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:11 smithi136 ceph-mon[125702]: pgmap v17780: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:13:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:13 smithi057 ceph-mon[92072]: pgmap v17781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:13:14.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:13 smithi057 ceph-mon[92072]: osdmap e1185: 12 total, 12 up, 12 in 2023-03-02T20:13:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:13 smithi122 ceph-mon[125440]: pgmap v17781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:13:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:13 smithi122 ceph-mon[125440]: osdmap e1185: 12 total, 12 up, 12 in 2023-03-02T20:13:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:13 smithi136 ceph-mon[125702]: pgmap v17781: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:13:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:13 smithi136 ceph-mon[125702]: osdmap e1185: 12 total, 12 up, 12 in 2023-03-02T20:13:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:14.600+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:13:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:14.601+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:13:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:14.601+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:13:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:14.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:13:14.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:14.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:13:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:15 smithi057 ceph-mon[92072]: pgmap v17783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T20:13:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:15 smithi122 ceph-mon[125440]: pgmap v17783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T20:13:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:15 smithi136 ceph-mon[125702]: pgmap v17783: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T20:13:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:17 smithi057 ceph-mon[92072]: pgmap v17784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:13:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:17 smithi122 ceph-mon[125440]: pgmap v17784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:13:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:17 smithi136 ceph-mon[125702]: pgmap v17784: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:13:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:19 smithi122 ceph-mon[125440]: pgmap v17785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:13:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:19 smithi136 ceph-mon[125702]: pgmap v17785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:13:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:19 smithi057 ceph-mon[92072]: pgmap v17785: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:13:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:21 smithi122 ceph-mon[125440]: pgmap v17786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:13:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:21 smithi136 ceph-mon[125702]: pgmap v17786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:13:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:21 smithi057 ceph-mon[92072]: pgmap v17786: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:13:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:23 smithi122 ceph-mon[125440]: pgmap v17787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:13:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:23 smithi136 ceph-mon[125702]: pgmap v17787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:13:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:23 smithi057 ceph-mon[92072]: pgmap v17787: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:13:26.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:25 smithi122 ceph-mon[125440]: pgmap v17788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:13:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:25 smithi136 ceph-mon[125702]: pgmap v17788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:13:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:25 smithi057 ceph-mon[92072]: pgmap v17788: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:13:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:27 smithi122 ceph-mon[125440]: pgmap v17789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:27 smithi136 ceph-mon[125702]: pgmap v17789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:27 smithi057 ceph-mon[92072]: pgmap v17789: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:29.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:29.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:13:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:29.613+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:13:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:29.613+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:13:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:29.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:13:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:29.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:13:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:29 smithi136 ceph-mon[125702]: pgmap v17790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:29 smithi057 ceph-mon[92072]: pgmap v17790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:29 smithi122 ceph-mon[125440]: pgmap v17790: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:31 smithi136 ceph-mon[125702]: pgmap v17791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:31 smithi057 ceph-mon[92072]: pgmap v17791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:32.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:31 smithi122 ceph-mon[125440]: pgmap v17791: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:33 smithi136 ceph-mon[125702]: pgmap v17792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:33 smithi057 ceph-mon[92072]: pgmap v17792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:33 smithi122 ceph-mon[125440]: pgmap v17792: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:35.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:13:35.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:13:35.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:13:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:35 smithi136 ceph-mon[125702]: pgmap v17793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:13:36.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:13:36.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:13:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:35 smithi057 ceph-mon[92072]: pgmap v17793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:13:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:13:36.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:13:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:35 smithi122 ceph-mon[125440]: pgmap v17793: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:13:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:13:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:13:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:37 smithi136 ceph-mon[125702]: pgmap v17794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:37 smithi057 ceph-mon[92072]: pgmap v17794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:37 smithi122 ceph-mon[125440]: pgmap v17794: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:39 smithi136 ceph-mon[125702]: pgmap v17795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:40.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:39 smithi057 ceph-mon[92072]: pgmap v17795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:39 smithi122 ceph-mon[125440]: pgmap v17795: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:42 smithi136 ceph-mon[125702]: pgmap v17796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:42 smithi057 ceph-mon[92072]: pgmap v17796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:42 smithi122 ceph-mon[125440]: pgmap v17796: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:44 smithi136 ceph-mon[125702]: pgmap v17797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:44 smithi057 ceph-mon[92072]: pgmap v17797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:44 smithi122 ceph-mon[125440]: pgmap v17797: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:44.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:13:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:44.626+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:13:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:44.626+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:13:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:44.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:13:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:44.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:13:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:46 smithi136 ceph-mon[125702]: pgmap v17798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:46 smithi057 ceph-mon[92072]: pgmap v17798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:46 smithi122 ceph-mon[125440]: pgmap v17798: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:48 smithi136 ceph-mon[125702]: pgmap v17799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:48 smithi057 ceph-mon[92072]: pgmap v17799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:48 smithi122 ceph-mon[125440]: pgmap v17799: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:50 smithi136 ceph-mon[125702]: pgmap v17800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:50 smithi057 ceph-mon[92072]: pgmap v17800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:50 smithi122 ceph-mon[125440]: pgmap v17800: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:52 smithi136 ceph-mon[125702]: pgmap v17801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:52 smithi057 ceph-mon[92072]: pgmap v17801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:52 smithi122 ceph-mon[125440]: pgmap v17801: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:54 smithi136 ceph-mon[125702]: pgmap v17802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:54 smithi057 ceph-mon[92072]: pgmap v17802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:54 smithi122 ceph-mon[125440]: pgmap v17802: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:13:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:56 smithi136 ceph-mon[125702]: pgmap v17803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:56 smithi057 ceph-mon[92072]: pgmap v17803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:56.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:56 smithi122 ceph-mon[125440]: pgmap v17803: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:13:58 smithi136 ceph-mon[125702]: pgmap v17804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:13:58 smithi057 ceph-mon[92072]: pgmap v17804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:13:58 smithi122 ceph-mon[125440]: pgmap v17804: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:13:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:59.634+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:13:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:59.634+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:13:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:59.634+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:13:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:59.634+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:13:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:13:59.634+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:14:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:00 smithi136 ceph-mon[125702]: pgmap v17805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:00 smithi057 ceph-mon[92072]: pgmap v17805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:00 smithi122 ceph-mon[125440]: pgmap v17805: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:02 smithi136 ceph-mon[125702]: pgmap v17806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:02 smithi057 ceph-mon[92072]: pgmap v17806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:02 smithi122 ceph-mon[125440]: pgmap v17806: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:04 smithi136 ceph-mon[125702]: pgmap v17807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:14:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:04 smithi057 ceph-mon[92072]: pgmap v17807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:14:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:04 smithi122 ceph-mon[125440]: pgmap v17807: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:14:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:06 smithi136 ceph-mon[125702]: pgmap v17808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:14:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:06 smithi057 ceph-mon[92072]: pgmap v17808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:14:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:06 smithi122 ceph-mon[125440]: pgmap v17808: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:14:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:07 smithi057 ceph-mon[92072]: pgmap v17809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:14:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:07 smithi122 ceph-mon[125440]: pgmap v17809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:14:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:07 smithi136 ceph-mon[125702]: pgmap v17809: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:14:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:08.426+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000037) for more than 900000000 us, fault. 2023-03-02T20:14:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:08.426+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f5870019780 tx=0x7f5870056000 comp rx=0 tx=0).stop 2023-03-02T20:14:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:08.426+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T20:14:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:08.426+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T20:14:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:08.426+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T20:14:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:08.426+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:14:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:08.427+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5870019800 tx=0x7f587008e000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T20:14:09.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:09 smithi057 ceph-mon[92072]: pgmap v17810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:14:09.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:09 smithi122 ceph-mon[125440]: pgmap v17810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:14:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:09 smithi136 ceph-mon[125702]: pgmap v17810: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:14:11.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:11 smithi057 ceph-mon[92072]: pgmap v17811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:14:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:11 smithi122 ceph-mon[125440]: pgmap v17811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:14:12.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:11 smithi136 ceph-mon[125702]: pgmap v17811: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:14:12.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:12 smithi122 ceph-mon[125440]: osdmap e1186: 12 total, 12 up, 12 in 2023-03-02T20:14:13.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:12 smithi136 ceph-mon[125702]: osdmap e1186: 12 total, 12 up, 12 in 2023-03-02T20:14:13.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:12 smithi057 ceph-mon[92072]: osdmap e1186: 12 total, 12 up, 12 in 2023-03-02T20:14:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:13.186+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:14:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:13.186+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:14:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:13.187+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 257 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:14:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:13.187+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 258 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:14:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:13 smithi122 ceph-mon[125440]: pgmap v17813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:13 smithi136 ceph-mon[125702]: pgmap v17813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:13 smithi057 ceph-mon[92072]: pgmap v17813: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:14.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:14.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:14:14.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:14.648+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:14:14.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:14.648+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:14:14.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:14.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:14:14.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:14.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:14:15.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:15 smithi122 ceph-mon[125440]: pgmap v17814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:15 smithi136 ceph-mon[125702]: pgmap v17814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:16.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:15 smithi057 ceph-mon[92072]: pgmap v17814: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:17 smithi136 ceph-mon[125702]: pgmap v17815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:17 smithi057 ceph-mon[92072]: pgmap v17815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:17 smithi122 ceph-mon[125440]: pgmap v17815: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:19 smithi136 ceph-mon[125702]: pgmap v17816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:14:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:19 smithi057 ceph-mon[92072]: pgmap v17816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:14:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:19 smithi122 ceph-mon[125440]: pgmap v17816: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:14:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:21 smithi136 ceph-mon[125702]: pgmap v17817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:14:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:21 smithi057 ceph-mon[92072]: pgmap v17817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:14:22.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:21 smithi122 ceph-mon[125440]: pgmap v17817: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:14:24.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:23 smithi136 ceph-mon[125702]: pgmap v17818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 192 B/s wr, 12 op/s 2023-03-02T20:14:24.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:23 smithi136 ceph-mon[125702]: osdmap e1187: 12 total, 12 up, 12 in 2023-03-02T20:14:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:23 smithi057 ceph-mon[92072]: pgmap v17818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 192 B/s wr, 12 op/s 2023-03-02T20:14:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:23 smithi057 ceph-mon[92072]: osdmap e1187: 12 total, 12 up, 12 in 2023-03-02T20:14:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:23 smithi122 ceph-mon[125440]: pgmap v17818: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 192 B/s wr, 12 op/s 2023-03-02T20:14:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:23 smithi122 ceph-mon[125440]: osdmap e1187: 12 total, 12 up, 12 in 2023-03-02T20:14:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:25 smithi136 ceph-mon[125702]: pgmap v17820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:25 smithi057 ceph-mon[92072]: pgmap v17820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:25 smithi122 ceph-mon[125440]: pgmap v17820: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:28.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:27 smithi136 ceph-mon[125702]: pgmap v17821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:27 smithi057 ceph-mon[92072]: pgmap v17821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:27 smithi122 ceph-mon[125440]: pgmap v17821: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:14:29.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:29.664+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:14:29.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:29.664+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:14:29.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:29.664+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:14:29.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:29.664+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:14:29.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:29.664+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:14:30.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:29 smithi136 ceph-mon[125702]: pgmap v17822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:14:30.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:29 smithi057 ceph-mon[92072]: pgmap v17822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:14:30.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:29 smithi122 ceph-mon[125440]: pgmap v17822: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:14:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:31 smithi136 ceph-mon[125702]: pgmap v17823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:14:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:31 smithi057 ceph-mon[92072]: pgmap v17823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:14:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:31 smithi122 ceph-mon[125440]: pgmap v17823: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:14:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:33 smithi136 ceph-mon[125702]: pgmap v17824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:14:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:33 smithi057 ceph-mon[92072]: pgmap v17824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:14:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:33 smithi122 ceph-mon[125440]: pgmap v17824: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:14:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:35 smithi136 ceph-mon[125702]: pgmap v17825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:14:36.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:14:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:35 smithi057 ceph-mon[92072]: pgmap v17825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:14:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:14:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:35 smithi122 ceph-mon[125440]: pgmap v17825: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:14:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:14:37.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:14:37.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:14:37.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:14:37.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:14:37.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:14:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:14:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:14:37.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:14:37.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:14:37.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:14:37.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:14:37.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:14:37.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:14:37.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:14:37.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:14:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:38 smithi136 ceph-mon[125702]: pgmap v17826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:38 smithi057 ceph-mon[92072]: pgmap v17826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:38 smithi122 ceph-mon[125440]: pgmap v17826: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:39 smithi057 ceph-mon[92072]: pgmap v17827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:39 smithi122 ceph-mon[125440]: pgmap v17827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:39 smithi136 ceph-mon[125702]: pgmap v17827: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:41 smithi057 ceph-mon[92072]: pgmap v17828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:41 smithi122 ceph-mon[125440]: pgmap v17828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:41 smithi136 ceph-mon[125702]: pgmap v17828: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:43.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:43 smithi122 ceph-mon[125440]: pgmap v17829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:43 smithi136 ceph-mon[125702]: pgmap v17829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:43 smithi057 ceph-mon[92072]: pgmap v17829: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:44.680+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:14:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:44.680+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:14:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:44.680+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:14:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:44.680+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:14:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:44.680+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:14:45.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:45 smithi122 ceph-mon[125440]: pgmap v17830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:45 smithi136 ceph-mon[125702]: pgmap v17830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:45 smithi057 ceph-mon[92072]: pgmap v17830: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:47 smithi136 ceph-mon[125702]: pgmap v17831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:47 smithi057 ceph-mon[92072]: pgmap v17831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:47 smithi122 ceph-mon[125440]: pgmap v17831: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:49 smithi136 ceph-mon[125702]: pgmap v17832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:49 smithi057 ceph-mon[92072]: pgmap v17832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:49 smithi122 ceph-mon[125440]: pgmap v17832: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:51 smithi136 ceph-mon[125702]: pgmap v17833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:51 smithi057 ceph-mon[92072]: pgmap v17833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:52.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:51 smithi122 ceph-mon[125440]: pgmap v17833: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:53 smithi136 ceph-mon[125702]: pgmap v17834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:53 smithi057 ceph-mon[92072]: pgmap v17834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:54.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:53 smithi122 ceph-mon[125440]: pgmap v17834: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:14:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:55 smithi136 ceph-mon[125702]: pgmap v17835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:55 smithi057 ceph-mon[92072]: pgmap v17835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:56.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:55 smithi122 ceph-mon[125440]: pgmap v17835: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:57 smithi136 ceph-mon[125702]: pgmap v17836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:57 smithi057 ceph-mon[92072]: pgmap v17836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:58.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:57 smithi122 ceph-mon[125440]: pgmap v17836: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:14:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:59.691+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:14:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:59.691+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:14:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:59.691+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:14:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:59.691+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:14:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:14:59.691+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:15:00.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:14:59 smithi136 ceph-mon[125702]: pgmap v17837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:14:59 smithi057 ceph-mon[92072]: pgmap v17837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:00.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:14:59 smithi122 ceph-mon[125440]: pgmap v17837: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:02.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:01 smithi136 ceph-mon[125702]: pgmap v17838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:02.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:01 smithi057 ceph-mon[92072]: pgmap v17838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:01 smithi122 ceph-mon[125440]: pgmap v17838: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:04.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:03 smithi136 ceph-mon[125702]: pgmap v17839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:15:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:03 smithi057 ceph-mon[92072]: pgmap v17839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:15:04.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:03 smithi122 ceph-mon[125440]: pgmap v17839: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:15:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:05 smithi136 ceph-mon[125702]: pgmap v17840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:15:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:05 smithi057 ceph-mon[92072]: pgmap v17840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:15:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:05 smithi122 ceph-mon[125440]: pgmap v17840: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:15:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:07 smithi136 ceph-mon[125702]: pgmap v17841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:15:08.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:07 smithi136 ceph-mon[125702]: osdmap e1188: 12 total, 12 up, 12 in 2023-03-02T20:15:08.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:07 smithi057 ceph-mon[92072]: pgmap v17841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:15:08.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:07 smithi057 ceph-mon[92072]: osdmap e1188: 12 total, 12 up, 12 in 2023-03-02T20:15:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:07 smithi122 ceph-mon[125440]: pgmap v17841: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:15:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:07 smithi122 ceph-mon[125440]: osdmap e1188: 12 total, 12 up, 12 in 2023-03-02T20:15:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:09 smithi136 ceph-mon[125702]: pgmap v17843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:15:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:09 smithi057 ceph-mon[92072]: pgmap v17843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:15:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:09 smithi122 ceph-mon[125440]: pgmap v17843: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:15:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:11 smithi136 ceph-mon[125702]: pgmap v17844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:15:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:11 smithi057 ceph-mon[92072]: pgmap v17844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:15:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:11 smithi122 ceph-mon[125440]: pgmap v17844: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:15:14.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:13 smithi136 ceph-mon[125702]: pgmap v17845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:15:14.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:13 smithi136 ceph-mon[125702]: osdmap e1189: 12 total, 12 up, 12 in 2023-03-02T20:15:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:13 smithi057 ceph-mon[92072]: pgmap v17845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:15:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:13 smithi057 ceph-mon[92072]: osdmap e1189: 12 total, 12 up, 12 in 2023-03-02T20:15:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:13 smithi122 ceph-mon[125440]: pgmap v17845: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:15:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:13 smithi122 ceph-mon[125440]: osdmap e1189: 12 total, 12 up, 12 in 2023-03-02T20:15:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:14.707+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:15:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:14.707+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:15:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:14.707+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:15:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:14.707+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:15:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:14.707+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:15:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:15 smithi136 ceph-mon[125702]: pgmap v17847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:15:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:15 smithi057 ceph-mon[92072]: pgmap v17847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:15:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:15 smithi122 ceph-mon[125440]: pgmap v17847: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:15:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:17 smithi136 ceph-mon[125702]: pgmap v17848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T20:15:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:17 smithi057 ceph-mon[92072]: pgmap v17848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T20:15:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:17 smithi122 ceph-mon[125440]: pgmap v17848: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T20:15:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:19 smithi136 ceph-mon[125702]: pgmap v17849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:15:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:19 smithi057 ceph-mon[92072]: pgmap v17849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:15:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:19 smithi122 ceph-mon[125440]: pgmap v17849: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:15:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:21 smithi136 ceph-mon[125702]: pgmap v17850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:15:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:21 smithi057 ceph-mon[92072]: pgmap v17850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:15:22.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:21 smithi122 ceph-mon[125440]: pgmap v17850: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:15:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:23 smithi136 ceph-mon[125702]: pgmap v17851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:15:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:23 smithi057 ceph-mon[92072]: pgmap v17851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:15:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:23 smithi122 ceph-mon[125440]: pgmap v17851: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:15:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:25 smithi136 ceph-mon[125702]: pgmap v17852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:15:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:25 smithi057 ceph-mon[92072]: pgmap v17852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:15:26.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:25 smithi122 ceph-mon[125440]: pgmap v17852: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:15:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:27 smithi136 ceph-mon[125702]: pgmap v17853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:28.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:27 smithi057 ceph-mon[92072]: pgmap v17853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:27 smithi122 ceph-mon[125440]: pgmap v17853: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:29.719+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:15:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:29.719+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:15:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:29.719+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:15:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:29.719+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:15:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:29.719+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:15:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:29 smithi136 ceph-mon[125702]: pgmap v17854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:29 smithi057 ceph-mon[92072]: pgmap v17854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:30.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:29 smithi122 ceph-mon[125440]: pgmap v17854: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:31 smithi136 ceph-mon[125702]: pgmap v17855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:31 smithi057 ceph-mon[92072]: pgmap v17855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:31 smithi122 ceph-mon[125440]: pgmap v17855: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:33 smithi136 ceph-mon[125702]: pgmap v17856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:34.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:33 smithi057 ceph-mon[92072]: pgmap v17856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:33 smithi122 ceph-mon[125440]: pgmap v17856: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:35 smithi057 ceph-mon[92072]: pgmap v17857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:35 smithi122 ceph-mon[125440]: pgmap v17857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:35 smithi136 ceph-mon[125702]: pgmap v17857: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:37 smithi057 ceph-mon[92072]: pgmap v17858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:15:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:38.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:38.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:38.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:38.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:37 smithi122 ceph-mon[125440]: pgmap v17858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:38.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:15:38.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:38.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:38.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:38.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:37 smithi136 ceph-mon[125702]: pgmap v17858: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:38.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:15:38.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:38.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:38.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:38.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:39.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:15:39.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:15:39.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:39.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:15:39.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:15:39.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:15:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:15:39.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:15:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:39 smithi057 ceph-mon[92072]: pgmap v17859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:39 smithi122 ceph-mon[125440]: pgmap v17859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:39 smithi136 ceph-mon[125702]: pgmap v17859: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:41 smithi057 ceph-mon[92072]: pgmap v17860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:42.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:41 smithi122 ceph-mon[125440]: pgmap v17860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:41 smithi136 ceph-mon[125702]: pgmap v17860: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:43 smithi057 ceph-mon[92072]: pgmap v17861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:43 smithi122 ceph-mon[125440]: pgmap v17861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:44.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:43 smithi136 ceph-mon[125702]: pgmap v17861: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:44.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:44.735+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:15:44.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:44.735+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:15:44.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:44.735+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:15:44.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:44.735+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:15:44.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:44.735+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:15:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:45 smithi057 ceph-mon[92072]: pgmap v17862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:45 smithi122 ceph-mon[125440]: pgmap v17862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:45 smithi136 ceph-mon[125702]: pgmap v17862: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:47 smithi057 ceph-mon[92072]: pgmap v17863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:48.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:47 smithi122 ceph-mon[125440]: pgmap v17863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:47 smithi136 ceph-mon[125702]: pgmap v17863: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:49 smithi057 ceph-mon[92072]: pgmap v17864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:50.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:49 smithi122 ceph-mon[125440]: pgmap v17864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:49 smithi136 ceph-mon[125702]: pgmap v17864: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:51 smithi057 ceph-mon[92072]: pgmap v17865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:52.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:51 smithi122 ceph-mon[125440]: pgmap v17865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:51 smithi136 ceph-mon[125702]: pgmap v17865: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:53 smithi057 ceph-mon[92072]: pgmap v17866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:53 smithi122 ceph-mon[125440]: pgmap v17866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:53 smithi136 ceph-mon[125702]: pgmap v17866: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:15:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:55 smithi057 ceph-mon[92072]: pgmap v17867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:55 smithi122 ceph-mon[125440]: pgmap v17867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:55 smithi136 ceph-mon[125702]: pgmap v17867: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:57 smithi057 ceph-mon[92072]: pgmap v17868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:58.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:57 smithi122 ceph-mon[125440]: pgmap v17868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:57 smithi136 ceph-mon[125702]: pgmap v17868: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:15:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:59.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:15:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:59.750+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:15:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:59.750+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:15:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:59.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:15:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:15:59.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:16:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:15:59 smithi057 ceph-mon[92072]: pgmap v17869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:00.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:15:59 smithi122 ceph-mon[125440]: pgmap v17869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:00.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:15:59 smithi136 ceph-mon[125702]: pgmap v17869: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:01 smithi057 ceph-mon[92072]: pgmap v17870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:01 smithi122 ceph-mon[125440]: pgmap v17870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:01 smithi136 ceph-mon[125702]: pgmap v17870: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:03 smithi057 ceph-mon[92072]: pgmap v17871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:16:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:03 smithi122 ceph-mon[125440]: pgmap v17871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:16:04.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:03 smithi136 ceph-mon[125702]: pgmap v17871: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:16:06.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:05 smithi057 ceph-mon[92072]: pgmap v17872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:16:06.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:05 smithi122 ceph-mon[125440]: pgmap v17872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:16:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:05 smithi136 ceph-mon[125702]: pgmap v17872: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:16:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:07 smithi057 ceph-mon[92072]: pgmap v17873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:16:08.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:07 smithi057 ceph-mon[92072]: osdmap e1190: 12 total, 12 up, 12 in 2023-03-02T20:16:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:07 smithi122 ceph-mon[125440]: pgmap v17873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:16:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:07 smithi122 ceph-mon[125440]: osdmap e1190: 12 total, 12 up, 12 in 2023-03-02T20:16:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:07 smithi136 ceph-mon[125702]: pgmap v17873: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:16:08.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:07 smithi136 ceph-mon[125702]: osdmap e1190: 12 total, 12 up, 12 in 2023-03-02T20:16:10.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:09 smithi057 ceph-mon[92072]: pgmap v17875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:16:10.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:09 smithi122 ceph-mon[125440]: pgmap v17875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:16:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:09 smithi136 ceph-mon[125702]: pgmap v17875: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:16:12.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:11 smithi057 ceph-mon[92072]: pgmap v17876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:16:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:11 smithi122 ceph-mon[125440]: pgmap v17876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:16:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:11 smithi136 ceph-mon[125702]: pgmap v17876: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:16:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:13 smithi057 ceph-mon[92072]: pgmap v17877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:16:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:13 smithi057 ceph-mon[92072]: osdmap e1191: 12 total, 12 up, 12 in 2023-03-02T20:16:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:13 smithi122 ceph-mon[125440]: pgmap v17877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:16:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:13 smithi122 ceph-mon[125440]: osdmap e1191: 12 total, 12 up, 12 in 2023-03-02T20:16:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:13 smithi136 ceph-mon[125702]: pgmap v17877: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:16:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:13 smithi136 ceph-mon[125702]: osdmap e1191: 12 total, 12 up, 12 in 2023-03-02T20:16:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:14.758+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:14.758+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:14.758+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:14.758+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:16:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:14.758+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:16:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:15 smithi057 ceph-mon[92072]: pgmap v17879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:16:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:15 smithi122 ceph-mon[125440]: pgmap v17879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:16:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:15 smithi136 ceph-mon[125702]: pgmap v17879: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:16:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:17 smithi122 ceph-mon[125440]: pgmap v17880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T20:16:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:17 smithi136 ceph-mon[125702]: pgmap v17880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T20:16:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:17 smithi057 ceph-mon[92072]: pgmap v17880: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T20:16:20.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:19 smithi122 ceph-mon[125440]: pgmap v17881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:16:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:19 smithi136 ceph-mon[125702]: pgmap v17881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:16:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:19 smithi057 ceph-mon[92072]: pgmap v17881: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:16:22.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:21 smithi122 ceph-mon[125440]: pgmap v17882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:16:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:21 smithi136 ceph-mon[125702]: pgmap v17882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:16:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:21 smithi057 ceph-mon[92072]: pgmap v17882: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:16:24.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:23 smithi122 ceph-mon[125440]: pgmap v17883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:16:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:23 smithi136 ceph-mon[125702]: pgmap v17883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:16:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:23 smithi057 ceph-mon[92072]: pgmap v17883: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:16:26.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:25 smithi122 ceph-mon[125440]: pgmap v17884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:16:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:25 smithi136 ceph-mon[125702]: pgmap v17884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:16:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:25 smithi057 ceph-mon[92072]: pgmap v17884: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:16:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:27 smithi136 ceph-mon[125702]: pgmap v17885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:27 smithi057 ceph-mon[92072]: pgmap v17885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:28.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:27 smithi122 ceph-mon[125440]: pgmap v17885: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:29.762+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:16:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:29.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:16:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:29.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:16:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:29.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:16:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:29.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:16:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:29 smithi136 ceph-mon[125702]: pgmap v17886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:29 smithi057 ceph-mon[92072]: pgmap v17886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:29 smithi122 ceph-mon[125440]: pgmap v17886: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:31 smithi136 ceph-mon[125702]: pgmap v17887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:31 smithi057 ceph-mon[92072]: pgmap v17887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:32.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:31 smithi122 ceph-mon[125440]: pgmap v17887: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:33 smithi136 ceph-mon[125702]: pgmap v17888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:33 smithi057 ceph-mon[92072]: pgmap v17888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:33 smithi122 ceph-mon[125440]: pgmap v17888: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:35 smithi136 ceph-mon[125702]: pgmap v17889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:35 smithi057 ceph-mon[92072]: pgmap v17889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:35 smithi122 ceph-mon[125440]: pgmap v17889: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:37 smithi136 ceph-mon[125702]: pgmap v17890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:37 smithi057 ceph-mon[92072]: pgmap v17890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:37 smithi122 ceph-mon[125440]: pgmap v17890: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:16:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:16:39.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:16:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:39 smithi136 ceph-mon[125702]: pgmap v17891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:16:40.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:16:40.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:16:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:39 smithi057 ceph-mon[92072]: pgmap v17891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:16:40.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:16:40.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:16:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:39 smithi122 ceph-mon[125440]: pgmap v17891: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:16:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:16:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:16:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:42 smithi136 ceph-mon[125702]: pgmap v17892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:42 smithi057 ceph-mon[92072]: pgmap v17892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:42 smithi122 ceph-mon[125440]: pgmap v17892: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:44 smithi136 ceph-mon[125702]: pgmap v17893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:44 smithi057 ceph-mon[92072]: pgmap v17893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:44 smithi122 ceph-mon[125440]: pgmap v17893: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:44.771 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:44.769+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:16:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:44.770+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:16:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:44.770+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:16:44.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:44.770+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:16:44.773 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:44.770+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:16:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:46 smithi136 ceph-mon[125702]: pgmap v17894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:46.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:46 smithi057 ceph-mon[92072]: pgmap v17894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:46 smithi122 ceph-mon[125440]: pgmap v17894: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:48 smithi136 ceph-mon[125702]: pgmap v17895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:48 smithi057 ceph-mon[92072]: pgmap v17895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:48 smithi122 ceph-mon[125440]: pgmap v17895: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:50 smithi136 ceph-mon[125702]: pgmap v17896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:50 smithi057 ceph-mon[92072]: pgmap v17896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:50 smithi122 ceph-mon[125440]: pgmap v17896: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:52 smithi136 ceph-mon[125702]: pgmap v17897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:52 smithi057 ceph-mon[92072]: pgmap v17897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:52 smithi122 ceph-mon[125440]: pgmap v17897: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:54 smithi136 ceph-mon[125702]: pgmap v17898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:54 smithi057 ceph-mon[92072]: pgmap v17898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:54 smithi122 ceph-mon[125440]: pgmap v17898: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:16:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:56 smithi136 ceph-mon[125702]: pgmap v17899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:56 smithi057 ceph-mon[92072]: pgmap v17899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:56.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:56 smithi122 ceph-mon[125440]: pgmap v17899: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:16:58 smithi136 ceph-mon[125702]: pgmap v17900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:16:58 smithi057 ceph-mon[92072]: pgmap v17900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:16:58 smithi122 ceph-mon[125440]: pgmap v17900: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:16:59.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:59.778+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:16:59.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:59.778+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:16:59.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:59.778+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:16:59.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:59.778+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:16:59.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:16:59.779+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:17:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:00 smithi136 ceph-mon[125702]: pgmap v17901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:00 smithi057 ceph-mon[92072]: pgmap v17901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:00 smithi122 ceph-mon[125440]: pgmap v17901: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:02 smithi136 ceph-mon[125702]: pgmap v17902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:02 smithi057 ceph-mon[92072]: pgmap v17902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:02 smithi122 ceph-mon[125440]: pgmap v17902: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:04 smithi136 ceph-mon[125702]: pgmap v17903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:17:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:04 smithi057 ceph-mon[92072]: pgmap v17903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:17:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:04 smithi122 ceph-mon[125440]: pgmap v17903: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:17:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:06 smithi136 ceph-mon[125702]: pgmap v17904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:17:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:06 smithi057 ceph-mon[92072]: pgmap v17904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:17:06.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:06 smithi122 ceph-mon[125440]: pgmap v17904: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:17:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:07 smithi136 ceph-mon[125702]: osdmap e1192: 12 total, 12 up, 12 in 2023-03-02T20:17:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:07 smithi057 ceph-mon[92072]: osdmap e1192: 12 total, 12 up, 12 in 2023-03-02T20:17:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:07 smithi122 ceph-mon[125440]: osdmap e1192: 12 total, 12 up, 12 in 2023-03-02T20:17:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:08 smithi136 ceph-mon[125702]: pgmap v17906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:17:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:08 smithi057 ceph-mon[92072]: pgmap v17906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:17:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:08 smithi122 ceph-mon[125440]: pgmap v17906: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:17:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:10 smithi057 ceph-mon[92072]: pgmap v17907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:17:10.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:10 smithi122 ceph-mon[125440]: pgmap v17907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:17:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:10 smithi136 ceph-mon[125702]: pgmap v17907: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:17:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:12 smithi057 ceph-mon[92072]: pgmap v17908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:17:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:12 smithi122 ceph-mon[125440]: pgmap v17908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:17:12.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:12 smithi136 ceph-mon[125702]: pgmap v17908: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:17:13.214 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:13.211+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:17:13.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:13.211+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:17:13.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:13.211+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 259 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:17:13.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:13.211+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 258 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:17:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:14 smithi057 ceph-mon[92072]: pgmap v17909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:17:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:14 smithi057 ceph-mon[92072]: osdmap e1193: 12 total, 12 up, 12 in 2023-03-02T20:17:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:14 smithi122 ceph-mon[125440]: pgmap v17909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:17:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:14 smithi122 ceph-mon[125440]: osdmap e1193: 12 total, 12 up, 12 in 2023-03-02T20:17:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:14 smithi136 ceph-mon[125702]: pgmap v17909: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:17:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:14 smithi136 ceph-mon[125702]: osdmap e1193: 12 total, 12 up, 12 in 2023-03-02T20:17:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:14.785+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:17:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:14.785+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:17:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:14.785+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:17:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:14.786+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:17:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:14.786+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:17:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:16 smithi057 ceph-mon[92072]: pgmap v17911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T20:17:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:16 smithi122 ceph-mon[125440]: pgmap v17911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T20:17:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:16 smithi136 ceph-mon[125702]: pgmap v17911: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 247 B/s wr, 12 op/s 2023-03-02T20:17:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:18 smithi057 ceph-mon[92072]: pgmap v17912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:17:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:18 smithi122 ceph-mon[125440]: pgmap v17912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:17:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:18 smithi136 ceph-mon[125702]: pgmap v17912: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:17:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:19 smithi136 ceph-mon[125702]: pgmap v17913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:17:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:19 smithi057 ceph-mon[92072]: pgmap v17913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:17:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:19 smithi122 ceph-mon[125440]: pgmap v17913: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:17:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:21 smithi136 ceph-mon[125702]: pgmap v17914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:17:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:21 smithi057 ceph-mon[92072]: pgmap v17914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:17:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:21 smithi122 ceph-mon[125440]: pgmap v17914: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:17:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:23 smithi136 ceph-mon[125702]: pgmap v17915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:17:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:23 smithi057 ceph-mon[92072]: pgmap v17915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:17:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:23 smithi122 ceph-mon[125440]: pgmap v17915: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:17:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:25 smithi136 ceph-mon[125702]: pgmap v17916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:17:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:25 smithi057 ceph-mon[92072]: pgmap v17916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:17:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:25 smithi122 ceph-mon[125440]: pgmap v17916: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:17:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:27 smithi136 ceph-mon[125702]: pgmap v17917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:27 smithi057 ceph-mon[92072]: pgmap v17917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:28.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:27 smithi122 ceph-mon[125440]: pgmap v17917: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:29.802+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:17:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:29.802+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:17:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:29.802+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:17:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:29.802+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:17:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:29.802+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:17:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:29 smithi136 ceph-mon[125702]: pgmap v17918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:29 smithi057 ceph-mon[92072]: pgmap v17918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:29 smithi122 ceph-mon[125440]: pgmap v17918: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:31 smithi136 ceph-mon[125702]: pgmap v17919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:31 smithi057 ceph-mon[92072]: pgmap v17919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:31 smithi122 ceph-mon[125440]: pgmap v17919: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:33 smithi136 ceph-mon[125702]: pgmap v17920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:33 smithi057 ceph-mon[92072]: pgmap v17920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:33 smithi122 ceph-mon[125440]: pgmap v17920: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:35 smithi136 ceph-mon[125702]: pgmap v17921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:35 smithi057 ceph-mon[92072]: pgmap v17921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:35 smithi122 ceph-mon[125440]: pgmap v17921: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:37 smithi136 ceph-mon[125702]: pgmap v17922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:37 smithi057 ceph-mon[92072]: pgmap v17922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:38.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:37 smithi122 ceph-mon[125440]: pgmap v17922: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:39 smithi136 ceph-mon[125702]: pgmap v17923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:17:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:39 smithi057 ceph-mon[92072]: pgmap v17923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:17:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:39 smithi122 ceph-mon[125440]: pgmap v17923: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:40.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:17:41.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:17:41.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:17:41.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:17:41.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:17:41.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:17:41.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:17:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:17:41.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:17:41.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:17:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:41 smithi057 ceph-mon[92072]: pgmap v17924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:42.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:41 smithi122 ceph-mon[125440]: pgmap v17924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:41 smithi136 ceph-mon[125702]: pgmap v17924: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:43 smithi057 ceph-mon[92072]: pgmap v17925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:43 smithi122 ceph-mon[125440]: pgmap v17925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:43 smithi136 ceph-mon[125702]: pgmap v17925: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:44.816+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:17:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:44.817+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:17:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:44.817+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:17:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:44.817+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:17:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:44.817+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:17:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:45 smithi057 ceph-mon[92072]: pgmap v17926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:45 smithi122 ceph-mon[125440]: pgmap v17926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:45 smithi136 ceph-mon[125702]: pgmap v17926: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:47 smithi057 ceph-mon[92072]: pgmap v17927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:48.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:47 smithi122 ceph-mon[125440]: pgmap v17927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:47 smithi136 ceph-mon[125702]: pgmap v17927: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:49 smithi057 ceph-mon[92072]: pgmap v17928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:49 smithi122 ceph-mon[125440]: pgmap v17928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:49 smithi136 ceph-mon[125702]: pgmap v17928: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:51 smithi122 ceph-mon[125440]: pgmap v17929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:51 smithi136 ceph-mon[125702]: pgmap v17929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:51 smithi057 ceph-mon[92072]: pgmap v17929: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:54.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:53 smithi122 ceph-mon[125440]: pgmap v17930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:54.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:53 smithi136 ceph-mon[125702]: pgmap v17930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:53 smithi057 ceph-mon[92072]: pgmap v17930: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:17:56.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:55 smithi122 ceph-mon[125440]: pgmap v17931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:55 smithi136 ceph-mon[125702]: pgmap v17931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:55 smithi057 ceph-mon[92072]: pgmap v17931: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:58.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:57 smithi122 ceph-mon[125440]: pgmap v17932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:57 smithi136 ceph-mon[125702]: pgmap v17932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:57 smithi057 ceph-mon[92072]: pgmap v17932: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:17:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:59.826+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:17:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:59.826+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:17:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:59.826+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:17:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:59.826+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:17:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:17:59.826+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:18:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:17:59 smithi136 ceph-mon[125702]: pgmap v17933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:17:59 smithi057 ceph-mon[92072]: pgmap v17933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:17:59 smithi122 ceph-mon[125440]: pgmap v17933: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:01 smithi136 ceph-mon[125702]: pgmap v17934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:01 smithi057 ceph-mon[92072]: pgmap v17934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:01 smithi122 ceph-mon[125440]: pgmap v17934: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:03 smithi136 ceph-mon[125702]: pgmap v17935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:18:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:03 smithi057 ceph-mon[92072]: pgmap v17935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:18:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:03 smithi122 ceph-mon[125440]: pgmap v17935: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:18:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:05 smithi136 ceph-mon[125702]: pgmap v17936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:18:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:05 smithi057 ceph-mon[92072]: pgmap v17936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:18:06.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:05 smithi122 ceph-mon[125440]: pgmap v17936: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:18:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:07 smithi136 ceph-mon[125702]: pgmap v17937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:18:08.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:07 smithi136 ceph-mon[125702]: osdmap e1194: 12 total, 12 up, 12 in 2023-03-02T20:18:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:07 smithi057 ceph-mon[92072]: pgmap v17937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:18:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:07 smithi057 ceph-mon[92072]: osdmap e1194: 12 total, 12 up, 12 in 2023-03-02T20:18:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:07 smithi122 ceph-mon[125440]: pgmap v17937: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:18:08.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:07 smithi122 ceph-mon[125440]: osdmap e1194: 12 total, 12 up, 12 in 2023-03-02T20:18:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:09 smithi136 ceph-mon[125702]: pgmap v17939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:18:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:09 smithi057 ceph-mon[92072]: pgmap v17939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:18:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:09 smithi122 ceph-mon[125440]: pgmap v17939: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:18:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:11 smithi136 ceph-mon[125702]: pgmap v17940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:18:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:11 smithi057 ceph-mon[92072]: pgmap v17940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:18:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:11 smithi122 ceph-mon[125440]: pgmap v17940: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:18:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:13 smithi136 ceph-mon[125702]: pgmap v17941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:18:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:13 smithi136 ceph-mon[125702]: osdmap e1195: 12 total, 12 up, 12 in 2023-03-02T20:18:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:13 smithi057 ceph-mon[92072]: pgmap v17941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:18:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:13 smithi057 ceph-mon[92072]: osdmap e1195: 12 total, 12 up, 12 in 2023-03-02T20:18:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:13 smithi122 ceph-mon[125440]: pgmap v17941: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:18:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:13 smithi122 ceph-mon[125440]: osdmap e1195: 12 total, 12 up, 12 in 2023-03-02T20:18:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:14.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:18:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:14.841+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:18:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:14.841+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:18:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:14.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:18:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:14.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:18:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:16 smithi136 ceph-mon[125702]: pgmap v17943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:18:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:15 smithi057 ceph-mon[92072]: pgmap v17943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:18:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:15 smithi122 ceph-mon[125440]: pgmap v17943: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:18:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:18 smithi136 ceph-mon[125702]: pgmap v17944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:18:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:18 smithi057 ceph-mon[92072]: pgmap v17944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:18:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:18 smithi122 ceph-mon[125440]: pgmap v17944: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T20:18:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:20 smithi136 ceph-mon[125702]: pgmap v17945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:18:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:20 smithi057 ceph-mon[92072]: pgmap v17945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:18:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:20 smithi122 ceph-mon[125440]: pgmap v17945: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:18:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:22 smithi136 ceph-mon[125702]: pgmap v17946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:18:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:22 smithi057 ceph-mon[92072]: pgmap v17946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:18:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:22 smithi122 ceph-mon[125440]: pgmap v17946: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:18:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:24 smithi136 ceph-mon[125702]: pgmap v17947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:18:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:24 smithi057 ceph-mon[92072]: pgmap v17947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:18:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:24 smithi122 ceph-mon[125440]: pgmap v17947: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:18:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:26 smithi136 ceph-mon[125702]: pgmap v17948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:18:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:26 smithi057 ceph-mon[92072]: pgmap v17948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:18:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:26 smithi122 ceph-mon[125440]: pgmap v17948: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:18:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:28 smithi136 ceph-mon[125702]: pgmap v17949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:28 smithi057 ceph-mon[92072]: pgmap v17949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:28 smithi122 ceph-mon[125440]: pgmap v17949: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:29.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:18:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:29.856+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:18:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:29.856+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:18:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:29.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:18:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:29.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:18:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:30 smithi136 ceph-mon[125702]: pgmap v17950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:30 smithi057 ceph-mon[92072]: pgmap v17950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:30 smithi122 ceph-mon[125440]: pgmap v17950: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:32 smithi136 ceph-mon[125702]: pgmap v17951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:32 smithi057 ceph-mon[92072]: pgmap v17951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:32.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:32 smithi122 ceph-mon[125440]: pgmap v17951: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:34 smithi136 ceph-mon[125702]: pgmap v17952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:34 smithi057 ceph-mon[92072]: pgmap v17952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:34 smithi122 ceph-mon[125440]: pgmap v17952: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:36 smithi136 ceph-mon[125702]: pgmap v17953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:36 smithi057 ceph-mon[92072]: pgmap v17953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:36 smithi122 ceph-mon[125440]: pgmap v17953: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:38 smithi136 ceph-mon[125702]: pgmap v17954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:38 smithi057 ceph-mon[92072]: pgmap v17954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:38 smithi122 ceph-mon[125440]: pgmap v17954: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:40 smithi136 ceph-mon[125702]: pgmap v17955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:18:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:40 smithi057 ceph-mon[92072]: pgmap v17955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:18:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:40 smithi122 ceph-mon[125440]: pgmap v17955: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:18:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:18:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:18:41.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:18:41.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:18:41.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:18:41.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:18:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:18:41.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:18:41.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:18:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:42 smithi136 ceph-mon[125702]: pgmap v17956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:42 smithi057 ceph-mon[92072]: pgmap v17956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:42 smithi122 ceph-mon[125440]: pgmap v17956: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:44 smithi136 ceph-mon[125702]: pgmap v17957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:44 smithi057 ceph-mon[92072]: pgmap v17957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:44 smithi122 ceph-mon[125440]: pgmap v17957: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:44.872+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:18:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:44.872+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:18:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:44.872+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:18:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:44.872+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:18:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:44.872+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:18:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:46 smithi136 ceph-mon[125702]: pgmap v17958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:46 smithi057 ceph-mon[92072]: pgmap v17958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:46 smithi122 ceph-mon[125440]: pgmap v17958: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:48.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:48 smithi136 ceph-mon[125702]: pgmap v17959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:48 smithi057 ceph-mon[92072]: pgmap v17959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:48 smithi122 ceph-mon[125440]: pgmap v17959: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:50 smithi136 ceph-mon[125702]: pgmap v17960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:50 smithi057 ceph-mon[92072]: pgmap v17960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:50 smithi122 ceph-mon[125440]: pgmap v17960: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:52 smithi136 ceph-mon[125702]: pgmap v17961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:52 smithi057 ceph-mon[92072]: pgmap v17961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:52 smithi122 ceph-mon[125440]: pgmap v17961: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:54 smithi057 ceph-mon[92072]: pgmap v17962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:54 smithi122 ceph-mon[125440]: pgmap v17962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:54 smithi136 ceph-mon[125702]: pgmap v17962: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:18:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:56 smithi057 ceph-mon[92072]: pgmap v17963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:56 smithi122 ceph-mon[125440]: pgmap v17963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:56 smithi136 ceph-mon[125702]: pgmap v17963: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:18:58 smithi057 ceph-mon[92072]: pgmap v17964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:18:58 smithi122 ceph-mon[125440]: pgmap v17964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:18:58 smithi136 ceph-mon[125702]: pgmap v17964: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:18:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:59.882+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:18:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:59.883+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:18:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:59.883+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:18:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:59.883+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:18:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:18:59.883+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:19:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:00 smithi057 ceph-mon[92072]: pgmap v17965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:00 smithi122 ceph-mon[125440]: pgmap v17965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:00 smithi136 ceph-mon[125702]: pgmap v17965: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:02 smithi057 ceph-mon[92072]: pgmap v17966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:02 smithi122 ceph-mon[125440]: pgmap v17966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:02 smithi136 ceph-mon[125702]: pgmap v17966: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:04 smithi057 ceph-mon[92072]: pgmap v17967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:19:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:04 smithi122 ceph-mon[125440]: pgmap v17967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:19:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:04 smithi136 ceph-mon[125702]: pgmap v17967: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:19:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:06 smithi057 ceph-mon[92072]: pgmap v17968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:19:06.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:06 smithi122 ceph-mon[125440]: pgmap v17968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:19:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:06 smithi136 ceph-mon[125702]: pgmap v17968: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:19:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:07 smithi057 ceph-mon[92072]: osdmap e1196: 12 total, 12 up, 12 in 2023-03-02T20:19:07.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:07 smithi122 ceph-mon[125440]: osdmap e1196: 12 total, 12 up, 12 in 2023-03-02T20:19:07.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:07 smithi136 ceph-mon[125702]: osdmap e1196: 12 total, 12 up, 12 in 2023-03-02T20:19:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:08 smithi057 ceph-mon[92072]: pgmap v17970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:19:08.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:08 smithi122 ceph-mon[125440]: pgmap v17970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:19:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:08 smithi136 ceph-mon[125702]: pgmap v17970: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:19:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:09 smithi136 ceph-mon[125702]: pgmap v17971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:19:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:09 smithi057 ceph-mon[92072]: pgmap v17971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:19:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:09 smithi122 ceph-mon[125440]: pgmap v17971: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:19:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:11 smithi136 ceph-mon[125702]: pgmap v17972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:19:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:11 smithi057 ceph-mon[92072]: pgmap v17972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:19:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:11 smithi122 ceph-mon[125440]: pgmap v17972: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:19:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:13 smithi136 ceph-mon[125702]: pgmap v17973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:19:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:13 smithi057 ceph-mon[92072]: pgmap v17973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:19:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:13 smithi122 ceph-mon[125440]: pgmap v17973: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:19:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:14.884+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:19:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:14.884+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:19:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:14.885+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:19:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:14.885+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:19:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:14.885+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:19:15.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:14 smithi136 ceph-mon[125702]: osdmap e1197: 12 total, 12 up, 12 in 2023-03-02T20:19:15.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:14 smithi057 ceph-mon[92072]: osdmap e1197: 12 total, 12 up, 12 in 2023-03-02T20:19:15.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:14 smithi122 ceph-mon[125440]: osdmap e1197: 12 total, 12 up, 12 in 2023-03-02T20:19:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:15 smithi136 ceph-mon[125702]: pgmap v17975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T20:19:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:15 smithi057 ceph-mon[92072]: pgmap v17975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T20:19:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:15 smithi122 ceph-mon[125440]: pgmap v17975: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-02T20:19:18.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:17 smithi136 ceph-mon[125702]: pgmap v17976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:19:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:17 smithi057 ceph-mon[92072]: pgmap v17976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:19:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:17 smithi122 ceph-mon[125440]: pgmap v17976: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:19:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:19 smithi136 ceph-mon[125702]: pgmap v17977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:19:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:19 smithi057 ceph-mon[92072]: pgmap v17977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:19:20.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:19 smithi122 ceph-mon[125440]: pgmap v17977: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:19:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:21 smithi136 ceph-mon[125702]: pgmap v17978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:19:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:21 smithi057 ceph-mon[92072]: pgmap v17978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:19:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:21 smithi122 ceph-mon[125440]: pgmap v17978: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:19:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:23 smithi136 ceph-mon[125702]: pgmap v17979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:19:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:23 smithi057 ceph-mon[92072]: pgmap v17979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:19:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:23 smithi122 ceph-mon[125440]: pgmap v17979: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:19:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:25 smithi136 ceph-mon[125702]: pgmap v17980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:19:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:25 smithi057 ceph-mon[92072]: pgmap v17980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:19:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:25 smithi122 ceph-mon[125440]: pgmap v17980: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:19:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:27 smithi136 ceph-mon[125702]: pgmap v17981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:27 smithi057 ceph-mon[92072]: pgmap v17981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:27 smithi122 ceph-mon[125440]: pgmap v17981: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:29.899+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:19:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:29.899+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:19:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:29.899+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:19:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:29.899+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:19:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:29.899+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:19:30.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:29 smithi136 ceph-mon[125702]: pgmap v17982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:29 smithi057 ceph-mon[92072]: pgmap v17982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:30.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:29 smithi122 ceph-mon[125440]: pgmap v17982: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:31 smithi136 ceph-mon[125702]: pgmap v17983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:31 smithi057 ceph-mon[92072]: pgmap v17983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:31 smithi122 ceph-mon[125440]: pgmap v17983: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:33 smithi136 ceph-mon[125702]: pgmap v17984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:33 smithi057 ceph-mon[92072]: pgmap v17984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:33 smithi122 ceph-mon[125440]: pgmap v17984: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:35 smithi136 ceph-mon[125702]: pgmap v17985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:35 smithi057 ceph-mon[92072]: pgmap v17985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:35 smithi122 ceph-mon[125440]: pgmap v17985: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:38.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:37 smithi136 ceph-mon[125702]: pgmap v17986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:37 smithi057 ceph-mon[92072]: pgmap v17986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:37 smithi122 ceph-mon[125440]: pgmap v17986: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:40.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:39 smithi136 ceph-mon[125702]: pgmap v17987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:39 smithi057 ceph-mon[92072]: pgmap v17987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:40.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:39 smithi122 ceph-mon[125440]: pgmap v17987: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:41 smithi136 ceph-mon[125702]: pgmap v17988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:42.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:19:42.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:19:42.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:19:42.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:19:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:41 smithi057 ceph-mon[92072]: pgmap v17988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:42.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:19:42.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:19:42.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:19:42.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:19:42.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:41 smithi122 ceph-mon[125440]: pgmap v17988: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:42.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:19:42.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:19:42.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:19:42.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:19:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:43 smithi136 ceph-mon[125702]: pgmap v17989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:43 smithi057 ceph-mon[92072]: pgmap v17989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:43 smithi122 ceph-mon[125440]: pgmap v17989: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:44.902+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:19:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:44.903+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:19:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:44.903+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:19:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:44.903+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:19:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:44.903+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:19:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:45 smithi136 ceph-mon[125702]: pgmap v17990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:45 smithi057 ceph-mon[92072]: pgmap v17990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:45 smithi122 ceph-mon[125440]: pgmap v17990: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:47 smithi136 ceph-mon[125702]: pgmap v17991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:47 smithi057 ceph-mon[92072]: pgmap v17991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:47 smithi122 ceph-mon[125440]: pgmap v17991: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:49 smithi057 ceph-mon[92072]: pgmap v17992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:50.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:49 smithi122 ceph-mon[125440]: pgmap v17992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:49 smithi136 ceph-mon[125702]: pgmap v17992: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:51 smithi057 ceph-mon[92072]: pgmap v17993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:52.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:51 smithi122 ceph-mon[125440]: pgmap v17993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:51 smithi136 ceph-mon[125702]: pgmap v17993: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:53 smithi057 ceph-mon[92072]: pgmap v17994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:54.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:53 smithi122 ceph-mon[125440]: pgmap v17994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:53 smithi136 ceph-mon[125702]: pgmap v17994: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:19:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:55 smithi057 ceph-mon[92072]: pgmap v17995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:56.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:55 smithi122 ceph-mon[125440]: pgmap v17995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:55 smithi136 ceph-mon[125702]: pgmap v17995: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:57 smithi057 ceph-mon[92072]: pgmap v17996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:58.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:57 smithi122 ceph-mon[125440]: pgmap v17996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:57 smithi136 ceph-mon[125702]: pgmap v17996: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:19:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:59.912+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:19:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:59.912+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:19:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:59.912+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:19:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:59.912+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:19:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:19:59.912+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:20:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:19:59 smithi057 ceph-mon[92072]: pgmap v17997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:19:59 smithi122 ceph-mon[125440]: pgmap v17997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:19:59 smithi136 ceph-mon[125702]: pgmap v17997: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:01.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T20:20:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T20:20:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T20:20:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:01 smithi057 ceph-mon[92072]: pgmap v17998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:01 smithi122 ceph-mon[125440]: pgmap v17998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:01 smithi136 ceph-mon[125702]: pgmap v17998: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:03 smithi057 ceph-mon[92072]: pgmap v17999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:20:04.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:03 smithi122 ceph-mon[125440]: pgmap v17999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:20:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:03 smithi136 ceph-mon[125702]: pgmap v17999: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:20:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:05 smithi057 ceph-mon[92072]: pgmap v18000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:20:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:05 smithi122 ceph-mon[125440]: pgmap v18000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:20:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:05 smithi136 ceph-mon[125702]: pgmap v18000: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:20:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:07 smithi057 ceph-mon[92072]: pgmap v18001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:20:08.221 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:07 smithi057 ceph-mon[92072]: osdmap e1198: 12 total, 12 up, 12 in 2023-03-02T20:20:08.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:07 smithi122 ceph-mon[125440]: pgmap v18001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:20:08.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:07 smithi122 ceph-mon[125440]: osdmap e1198: 12 total, 12 up, 12 in 2023-03-02T20:20:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:07 smithi136 ceph-mon[125702]: pgmap v18001: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:20:08.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:07 smithi136 ceph-mon[125702]: osdmap e1198: 12 total, 12 up, 12 in 2023-03-02T20:20:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:09 smithi057 ceph-mon[92072]: pgmap v18003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:20:10.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:09 smithi122 ceph-mon[125440]: pgmap v18003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:20:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:09 smithi136 ceph-mon[125702]: pgmap v18003: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:20:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:11 smithi057 ceph-mon[92072]: pgmap v18004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:20:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:11 smithi122 ceph-mon[125440]: pgmap v18004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:20:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:11 smithi136 ceph-mon[125702]: pgmap v18004: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:20:13.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:13.239+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:20:13.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:13.239+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:20:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:13.239+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 260 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:20:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:13.239+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:20:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:13.239+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 259 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:20:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:13.239+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:20:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:13.239+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 261 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:20:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:13.239+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 260 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:20:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:13 smithi057 ceph-mon[92072]: pgmap v18005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:20:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:13 smithi057 ceph-mon[92072]: osdmap e1199: 12 total, 12 up, 12 in 2023-03-02T20:20:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:13 smithi122 ceph-mon[125440]: pgmap v18005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:20:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:13 smithi122 ceph-mon[125440]: osdmap e1199: 12 total, 12 up, 12 in 2023-03-02T20:20:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:13 smithi136 ceph-mon[125702]: pgmap v18005: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:20:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:13 smithi136 ceph-mon[125702]: osdmap e1199: 12 total, 12 up, 12 in 2023-03-02T20:20:14.926 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:14.923+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:20:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:14.924+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:20:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:14.924+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:20:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:14.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:20:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:14.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:20:16.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:15 smithi057 ceph-mon[92072]: pgmap v18007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:20:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:15 smithi122 ceph-mon[125440]: pgmap v18007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:20:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:15 smithi136 ceph-mon[125702]: pgmap v18007: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:20:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:17 smithi057 ceph-mon[92072]: pgmap v18008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T20:20:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:17 smithi122 ceph-mon[125440]: pgmap v18008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T20:20:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:17 smithi136 ceph-mon[125702]: pgmap v18008: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T20:20:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:19 smithi057 ceph-mon[92072]: pgmap v18009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:20:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:19 smithi122 ceph-mon[125440]: pgmap v18009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:20:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:19 smithi136 ceph-mon[125702]: pgmap v18009: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:20:22.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:21 smithi057 ceph-mon[92072]: pgmap v18010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:20:22.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:21 smithi122 ceph-mon[125440]: pgmap v18010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:20:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:21 smithi136 ceph-mon[125702]: pgmap v18010: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:20:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:23 smithi057 ceph-mon[92072]: pgmap v18011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:20:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:23 smithi122 ceph-mon[125440]: pgmap v18011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:20:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:23 smithi136 ceph-mon[125702]: pgmap v18011: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:20:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:25 smithi057 ceph-mon[92072]: pgmap v18012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:20:26.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:25 smithi122 ceph-mon[125440]: pgmap v18012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:20:26.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:25 smithi136 ceph-mon[125702]: pgmap v18012: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:20:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:27 smithi057 ceph-mon[92072]: pgmap v18013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:28.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:27 smithi122 ceph-mon[125440]: pgmap v18013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:27 smithi136 ceph-mon[125702]: pgmap v18013: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:29.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:20:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:29.938+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:20:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:29.938+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:20:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:29.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:20:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:29.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:20:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:29 smithi057 ceph-mon[92072]: pgmap v18014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:29 smithi122 ceph-mon[125440]: pgmap v18014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:29 smithi136 ceph-mon[125702]: pgmap v18014: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:31 smithi057 ceph-mon[92072]: pgmap v18015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:31 smithi122 ceph-mon[125440]: pgmap v18015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:31 smithi136 ceph-mon[125702]: pgmap v18015: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:34.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:33 smithi122 ceph-mon[125440]: pgmap v18016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:33 smithi136 ceph-mon[125702]: pgmap v18016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:33 smithi057 ceph-mon[92072]: pgmap v18016: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:35 smithi122 ceph-mon[125440]: pgmap v18017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:35 smithi136 ceph-mon[125702]: pgmap v18017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:35 smithi057 ceph-mon[92072]: pgmap v18017: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:37 smithi122 ceph-mon[125440]: pgmap v18018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:37 smithi136 ceph-mon[125702]: pgmap v18018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:37 smithi057 ceph-mon[92072]: pgmap v18018: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:40.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:39 smithi122 ceph-mon[125440]: pgmap v18019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:39 smithi136 ceph-mon[125702]: pgmap v18019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:39 smithi057 ceph-mon[92072]: pgmap v18019: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:41 smithi136 ceph-mon[125702]: pgmap v18020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:42.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:20:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:41 smithi057 ceph-mon[92072]: pgmap v18020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:20:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:41 smithi122 ceph-mon[125440]: pgmap v18020: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:20:43.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:20:43.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:20:43.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:20:43.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:20:43.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:20:43.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:20:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:20:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:20:43.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:20:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:43 smithi136 ceph-mon[125702]: pgmap v18021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:43 smithi057 ceph-mon[92072]: pgmap v18021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:43 smithi122 ceph-mon[125440]: pgmap v18021: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:44.954+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:20:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:44.955+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:20:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:44.955+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:20:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:44.955+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:20:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:44.955+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:20:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:45 smithi136 ceph-mon[125702]: pgmap v18022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:45 smithi057 ceph-mon[92072]: pgmap v18022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:45 smithi122 ceph-mon[125440]: pgmap v18022: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:47 smithi136 ceph-mon[125702]: pgmap v18023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:47 smithi057 ceph-mon[92072]: pgmap v18023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:47 smithi122 ceph-mon[125440]: pgmap v18023: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:49 smithi136 ceph-mon[125702]: pgmap v18024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:49 smithi057 ceph-mon[92072]: pgmap v18024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:49 smithi122 ceph-mon[125440]: pgmap v18024: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:51 smithi136 ceph-mon[125702]: pgmap v18025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:51 smithi057 ceph-mon[92072]: pgmap v18025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:51 smithi122 ceph-mon[125440]: pgmap v18025: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:53 smithi136 ceph-mon[125702]: pgmap v18026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:53 smithi057 ceph-mon[92072]: pgmap v18026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:53 smithi122 ceph-mon[125440]: pgmap v18026: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:20:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:55 smithi136 ceph-mon[125702]: pgmap v18027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:55 smithi057 ceph-mon[92072]: pgmap v18027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:55 smithi122 ceph-mon[125440]: pgmap v18027: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:57 smithi136 ceph-mon[125702]: pgmap v18028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:57 smithi057 ceph-mon[92072]: pgmap v18028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:57 smithi122 ceph-mon[125440]: pgmap v18028: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:20:59.960 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:59.958+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:20:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:59.958+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:20:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:59.958+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:20:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:59.958+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:20:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:20:59.959+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:21:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:20:59 smithi136 ceph-mon[125702]: pgmap v18029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:20:59 smithi057 ceph-mon[92072]: pgmap v18029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:20:59 smithi122 ceph-mon[125440]: pgmap v18029: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:01 smithi136 ceph-mon[125702]: pgmap v18030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:01 smithi057 ceph-mon[92072]: pgmap v18030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:01 smithi122 ceph-mon[125440]: pgmap v18030: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:03 smithi136 ceph-mon[125702]: pgmap v18031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:21:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:03 smithi057 ceph-mon[92072]: pgmap v18031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:21:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:03 smithi122 ceph-mon[125440]: pgmap v18031: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:21:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:06 smithi136 ceph-mon[125702]: pgmap v18032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:21:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:06 smithi057 ceph-mon[92072]: pgmap v18032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:21:06.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:06 smithi122 ceph-mon[125440]: pgmap v18032: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:21:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:08 smithi136 ceph-mon[125702]: pgmap v18033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:21:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:08 smithi057 ceph-mon[92072]: pgmap v18033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:21:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:08 smithi122 ceph-mon[125440]: pgmap v18033: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:21:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:10 smithi136 ceph-mon[125702]: pgmap v18034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:21:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:10 smithi057 ceph-mon[92072]: pgmap v18034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:21:10.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:10 smithi122 ceph-mon[125440]: pgmap v18034: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:21:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:12 smithi136 ceph-mon[125702]: pgmap v18035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:21:12.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:12 smithi057 ceph-mon[92072]: pgmap v18035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:21:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:12 smithi122 ceph-mon[125440]: pgmap v18035: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:21:13.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:13 smithi136 ceph-mon[125702]: osdmap e1200: 12 total, 12 up, 12 in 2023-03-02T20:21:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:13 smithi057 ceph-mon[92072]: osdmap e1200: 12 total, 12 up, 12 in 2023-03-02T20:21:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:13 smithi122 ceph-mon[125440]: osdmap e1200: 12 total, 12 up, 12 in 2023-03-02T20:21:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:14 smithi136 ceph-mon[125702]: pgmap v18037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:14 smithi057 ceph-mon[92072]: pgmap v18037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:14 smithi122 ceph-mon[125440]: pgmap v18037: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:14.964+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:21:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:14.965+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:21:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:14.965+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:21:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:14.965+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:21:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:14.965+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:21:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:16 smithi136 ceph-mon[125702]: pgmap v18038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:16 smithi057 ceph-mon[92072]: pgmap v18038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:16 smithi122 ceph-mon[125440]: pgmap v18038: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:18 smithi136 ceph-mon[125702]: pgmap v18039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:18 smithi057 ceph-mon[92072]: pgmap v18039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:18 smithi122 ceph-mon[125440]: pgmap v18039: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:20 smithi136 ceph-mon[125702]: pgmap v18040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:21:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:20 smithi057 ceph-mon[92072]: pgmap v18040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:21:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:20 smithi122 ceph-mon[125440]: pgmap v18040: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:21:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:22 smithi136 ceph-mon[125702]: pgmap v18041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:21:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:22 smithi057 ceph-mon[92072]: pgmap v18041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:21:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:22 smithi122 ceph-mon[125440]: pgmap v18041: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:21:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:24 smithi136 ceph-mon[125702]: pgmap v18042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 196 B/s wr, 9 op/s 2023-03-02T20:21:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:24 smithi136 ceph-mon[125702]: osdmap e1201: 12 total, 12 up, 12 in 2023-03-02T20:21:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:24 smithi057 ceph-mon[92072]: pgmap v18042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 196 B/s wr, 9 op/s 2023-03-02T20:21:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:24 smithi057 ceph-mon[92072]: osdmap e1201: 12 total, 12 up, 12 in 2023-03-02T20:21:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:24 smithi122 ceph-mon[125440]: pgmap v18042: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 196 B/s wr, 9 op/s 2023-03-02T20:21:24.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:24 smithi122 ceph-mon[125440]: osdmap e1201: 12 total, 12 up, 12 in 2023-03-02T20:21:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:26 smithi136 ceph-mon[125702]: pgmap v18044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:26 smithi057 ceph-mon[92072]: pgmap v18044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:26 smithi122 ceph-mon[125440]: pgmap v18044: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:28 smithi136 ceph-mon[125702]: pgmap v18045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:28 smithi057 ceph-mon[92072]: pgmap v18045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:28 smithi122 ceph-mon[125440]: pgmap v18045: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:21:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:29.978+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:21:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:29.978+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:21:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:29.978+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:21:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:29.978+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:21:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:29.978+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:21:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:30 smithi136 ceph-mon[125702]: pgmap v18046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:21:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:30 smithi057 ceph-mon[92072]: pgmap v18046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:21:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:30 smithi122 ceph-mon[125440]: pgmap v18046: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:21:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:32 smithi136 ceph-mon[125702]: pgmap v18047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:21:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:32 smithi057 ceph-mon[92072]: pgmap v18047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:21:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:32 smithi122 ceph-mon[125440]: pgmap v18047: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:21:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:34 smithi136 ceph-mon[125702]: pgmap v18048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:21:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:34 smithi057 ceph-mon[92072]: pgmap v18048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:21:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:34 smithi122 ceph-mon[125440]: pgmap v18048: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:21:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:36 smithi136 ceph-mon[125702]: pgmap v18049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:21:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:36 smithi057 ceph-mon[92072]: pgmap v18049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:21:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:36 smithi122 ceph-mon[125440]: pgmap v18049: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:21:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:38 smithi136 ceph-mon[125702]: pgmap v18050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:38 smithi057 ceph-mon[92072]: pgmap v18050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:38 smithi122 ceph-mon[125440]: pgmap v18050: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:40.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:40 smithi136 ceph-mon[125702]: pgmap v18051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:40.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:40 smithi057 ceph-mon[92072]: pgmap v18051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:40 smithi122 ceph-mon[125440]: pgmap v18051: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:42 smithi136 ceph-mon[125702]: pgmap v18052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:42 smithi057 ceph-mon[92072]: pgmap v18052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:42 smithi122 ceph-mon[125440]: pgmap v18052: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:43.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:21:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:21:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:21:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:44 smithi057 ceph-mon[92072]: pgmap v18053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:21:44.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:21:44.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:21:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:44 smithi122 ceph-mon[125440]: pgmap v18053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:21:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:21:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:21:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:44 smithi136 ceph-mon[125702]: pgmap v18053: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:44.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:21:44.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:21:44.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:21:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:44.994+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:21:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:44.994+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:21:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:44.994+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:21:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:44.994+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:21:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:21:44.994+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:21:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:46 smithi057 ceph-mon[92072]: pgmap v18054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:46 smithi122 ceph-mon[125440]: pgmap v18054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:46 smithi136 ceph-mon[125702]: pgmap v18054: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:48 smithi057 ceph-mon[92072]: pgmap v18055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:48 smithi122 ceph-mon[125440]: pgmap v18055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:48 smithi136 ceph-mon[125702]: pgmap v18055: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:50 smithi057 ceph-mon[92072]: pgmap v18056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:50 smithi122 ceph-mon[125440]: pgmap v18056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:50 smithi136 ceph-mon[125702]: pgmap v18056: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:52 smithi057 ceph-mon[92072]: pgmap v18057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:52 smithi122 ceph-mon[125440]: pgmap v18057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:52 smithi136 ceph-mon[125702]: pgmap v18057: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:54 smithi057 ceph-mon[92072]: pgmap v18058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:54 smithi122 ceph-mon[125440]: pgmap v18058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:54 smithi136 ceph-mon[125702]: pgmap v18058: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:21:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:56 smithi057 ceph-mon[92072]: pgmap v18059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:56 smithi122 ceph-mon[125440]: pgmap v18059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:56 smithi136 ceph-mon[125702]: pgmap v18059: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:21:58 smithi057 ceph-mon[92072]: pgmap v18060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:21:58 smithi122 ceph-mon[125440]: pgmap v18060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:21:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:21:58 smithi136 ceph-mon[125702]: pgmap v18060: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:00.001+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:22:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:00.002+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:22:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:00.002+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:22:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:00.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:22:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:00.002+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:22:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:00 smithi057 ceph-mon[92072]: pgmap v18061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:00 smithi122 ceph-mon[125440]: pgmap v18061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:00 smithi136 ceph-mon[125702]: pgmap v18061: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:01.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:01 smithi057 ceph-mon[92072]: pgmap v18062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:01.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:01 smithi122 ceph-mon[125440]: pgmap v18062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:01 smithi136 ceph-mon[125702]: pgmap v18062: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:03.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:03 smithi136 ceph-mon[125702]: pgmap v18063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:22:03.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:03 smithi057 ceph-mon[92072]: pgmap v18063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:22:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:03 smithi122 ceph-mon[125440]: pgmap v18063: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:22:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:05 smithi136 ceph-mon[125702]: pgmap v18064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:22:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:05 smithi057 ceph-mon[92072]: pgmap v18064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:22:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:05 smithi122 ceph-mon[125440]: pgmap v18064: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:22:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:07 smithi136 ceph-mon[125702]: pgmap v18065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:22:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:07 smithi136 ceph-mon[125702]: osdmap e1202: 12 total, 12 up, 12 in 2023-03-02T20:22:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:07 smithi057 ceph-mon[92072]: pgmap v18065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:22:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:07 smithi057 ceph-mon[92072]: osdmap e1202: 12 total, 12 up, 12 in 2023-03-02T20:22:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:07 smithi122 ceph-mon[125440]: pgmap v18065: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:22:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:07 smithi122 ceph-mon[125440]: osdmap e1202: 12 total, 12 up, 12 in 2023-03-02T20:22:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:09 smithi136 ceph-mon[125702]: pgmap v18067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:22:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:09 smithi057 ceph-mon[92072]: pgmap v18067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:22:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:09 smithi122 ceph-mon[125440]: pgmap v18067: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:22:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:11 smithi136 ceph-mon[125702]: pgmap v18068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:22:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:11 smithi057 ceph-mon[92072]: pgmap v18068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:22:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:11 smithi122 ceph-mon[125440]: pgmap v18068: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:22:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:13 smithi136 ceph-mon[125702]: pgmap v18069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:22:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:13 smithi136 ceph-mon[125702]: osdmap e1203: 12 total, 12 up, 12 in 2023-03-02T20:22:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:13 smithi057 ceph-mon[92072]: pgmap v18069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:22:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:13 smithi057 ceph-mon[92072]: osdmap e1203: 12 total, 12 up, 12 in 2023-03-02T20:22:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:13 smithi122 ceph-mon[125440]: pgmap v18069: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:22:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:13 smithi122 ceph-mon[125440]: osdmap e1203: 12 total, 12 up, 12 in 2023-03-02T20:22:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:15.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:22:15.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:15.018+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:22:15.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:15.018+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:22:15.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:15.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:22:15.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:15.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:22:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:15 smithi136 ceph-mon[125702]: pgmap v18071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:22:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:15 smithi057 ceph-mon[92072]: pgmap v18071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:22:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:15 smithi122 ceph-mon[125440]: pgmap v18071: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:22:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:17 smithi057 ceph-mon[92072]: pgmap v18072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:22:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:17 smithi122 ceph-mon[125440]: pgmap v18072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:22:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:17 smithi136 ceph-mon[125702]: pgmap v18072: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:22:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:19 smithi057 ceph-mon[92072]: pgmap v18073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:22:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:19 smithi122 ceph-mon[125440]: pgmap v18073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:22:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:19 smithi136 ceph-mon[125702]: pgmap v18073: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:22:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:21 smithi057 ceph-mon[92072]: pgmap v18074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:22:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:21 smithi122 ceph-mon[125440]: pgmap v18074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:22:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:21 smithi136 ceph-mon[125702]: pgmap v18074: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:22:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:23 smithi057 ceph-mon[92072]: pgmap v18075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T20:22:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:23 smithi122 ceph-mon[125440]: pgmap v18075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T20:22:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:23 smithi136 ceph-mon[125702]: pgmap v18075: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T20:22:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:25 smithi057 ceph-mon[92072]: pgmap v18076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:22:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:25 smithi122 ceph-mon[125440]: pgmap v18076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:22:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:25 smithi136 ceph-mon[125702]: pgmap v18076: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:22:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:27 smithi057 ceph-mon[92072]: pgmap v18077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:22:28.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:27 smithi122 ceph-mon[125440]: pgmap v18077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:22:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:27 smithi136 ceph-mon[125702]: pgmap v18077: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:22:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:30.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:22:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:30.028+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:22:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:30.028+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:22:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:30.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:22:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:30.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:22:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:29 smithi057 ceph-mon[92072]: pgmap v18078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:29 smithi122 ceph-mon[125440]: pgmap v18078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:29 smithi136 ceph-mon[125702]: pgmap v18078: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:31 smithi057 ceph-mon[92072]: pgmap v18079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:31 smithi122 ceph-mon[125440]: pgmap v18079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:31 smithi136 ceph-mon[125702]: pgmap v18079: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:33 smithi057 ceph-mon[92072]: pgmap v18080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:33 smithi122 ceph-mon[125440]: pgmap v18080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:33 smithi136 ceph-mon[125702]: pgmap v18080: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:35 smithi057 ceph-mon[92072]: pgmap v18081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:35 smithi122 ceph-mon[125440]: pgmap v18081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:35 smithi136 ceph-mon[125702]: pgmap v18081: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:37 smithi057 ceph-mon[92072]: pgmap v18082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:37 smithi122 ceph-mon[125440]: pgmap v18082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:37 smithi136 ceph-mon[125702]: pgmap v18082: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:39 smithi057 ceph-mon[92072]: pgmap v18083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:39 smithi122 ceph-mon[125440]: pgmap v18083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:39 smithi136 ceph-mon[125702]: pgmap v18083: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:41 smithi057 ceph-mon[92072]: pgmap v18084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:42.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:41 smithi122 ceph-mon[125440]: pgmap v18084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:41 smithi136 ceph-mon[125702]: pgmap v18084: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:43 smithi057 ceph-mon[92072]: pgmap v18085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:22:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:43 smithi122 ceph-mon[125440]: pgmap v18085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:44.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:22:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:43 smithi136 ceph-mon[125702]: pgmap v18085: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:45.041+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:45.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:22:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:45.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:22:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:45.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:22:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:22:45.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:22:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:45 smithi057 ceph-mon[92072]: pgmap v18086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:45 smithi122 ceph-mon[125440]: pgmap v18086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:45 smithi136 ceph-mon[125702]: pgmap v18086: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:47.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: pgmap v18087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:47.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:22:47.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:22:47.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:22:47.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:22:47.689 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: pgmap v18087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:47.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:22:47.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:22:47.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.706 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:22:47.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:22:47.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: pgmap v18087: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:47.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:47.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:22:47.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:22:47.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:22:47.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:22:47.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:22:47.846 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:22:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:48 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:22:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:48 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:22:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:48 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:22:48.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:48 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:22:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:48 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:22:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:48 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:22:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:49 smithi136 ceph-mon[125702]: pgmap v18088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:49 smithi057 ceph-mon[92072]: pgmap v18088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:50.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:49 smithi122 ceph-mon[125440]: pgmap v18088: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:51 smithi136 ceph-mon[125702]: pgmap v18089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:51 smithi057 ceph-mon[92072]: pgmap v18089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:52.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:51 smithi122 ceph-mon[125440]: pgmap v18089: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:53 smithi136 ceph-mon[125702]: pgmap v18090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:53 smithi057 ceph-mon[92072]: pgmap v18090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:53 smithi122 ceph-mon[125440]: pgmap v18090: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:22:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:55 smithi136 ceph-mon[125702]: pgmap v18091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:55 smithi057 ceph-mon[92072]: pgmap v18091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:55 smithi122 ceph-mon[125440]: pgmap v18091: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:57 smithi057 ceph-mon[92072]: pgmap v18092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:57 smithi122 ceph-mon[125440]: pgmap v18092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:22:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:57 smithi136 ceph-mon[125702]: pgmap v18092: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:00.051+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:23:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:00.051+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:23:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:00.051+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:23:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:00.051+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:23:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:00.051+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:23:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:22:59 smithi057 ceph-mon[92072]: pgmap v18093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:22:59 smithi122 ceph-mon[125440]: pgmap v18093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:22:59 smithi136 ceph-mon[125702]: pgmap v18093: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:01 smithi057 ceph-mon[92072]: pgmap v18094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:02.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:01 smithi122 ceph-mon[125440]: pgmap v18094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:01 smithi136 ceph-mon[125702]: pgmap v18094: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:03 smithi057 ceph-mon[92072]: pgmap v18095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:23:04.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:03 smithi122 ceph-mon[125440]: pgmap v18095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:23:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:03 smithi136 ceph-mon[125702]: pgmap v18095: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:23:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:05 smithi057 ceph-mon[92072]: pgmap v18096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:23:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:05 smithi122 ceph-mon[125440]: pgmap v18096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:23:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:05 smithi136 ceph-mon[125702]: pgmap v18096: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:23:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:07 smithi057 ceph-mon[92072]: pgmap v18097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:23:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:07 smithi057 ceph-mon[92072]: osdmap e1204: 12 total, 12 up, 12 in 2023-03-02T20:23:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:07 smithi122 ceph-mon[125440]: pgmap v18097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:23:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:07 smithi122 ceph-mon[125440]: osdmap e1204: 12 total, 12 up, 12 in 2023-03-02T20:23:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:07 smithi136 ceph-mon[125702]: pgmap v18097: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:23:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:07 smithi136 ceph-mon[125702]: osdmap e1204: 12 total, 12 up, 12 in 2023-03-02T20:23:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:09 smithi057 ceph-mon[92072]: pgmap v18099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:23:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:09 smithi122 ceph-mon[125440]: pgmap v18099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:23:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:09 smithi136 ceph-mon[125702]: pgmap v18099: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:23:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:11 smithi057 ceph-mon[92072]: pgmap v18100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:23:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:11 smithi122 ceph-mon[125440]: pgmap v18100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:23:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:11 smithi136 ceph-mon[125702]: pgmap v18100: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:23:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:13.263+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:23:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:13.263+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:23:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:13.264+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 261 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:23:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:13.264+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 262 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:23:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:13 smithi057 ceph-mon[92072]: pgmap v18101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:23:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:13 smithi057 ceph-mon[92072]: osdmap e1205: 12 total, 12 up, 12 in 2023-03-02T20:23:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:13 smithi122 ceph-mon[125440]: pgmap v18101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:23:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:13 smithi122 ceph-mon[125440]: osdmap e1205: 12 total, 12 up, 12 in 2023-03-02T20:23:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:13 smithi136 ceph-mon[125702]: pgmap v18101: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:23:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:13 smithi136 ceph-mon[125702]: osdmap e1205: 12 total, 12 up, 12 in 2023-03-02T20:23:15.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:15.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:23:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:15.064+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:23:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:15.064+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:23:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:15.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:23:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:15.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:23:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:15 smithi057 ceph-mon[92072]: pgmap v18103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:23:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:15 smithi122 ceph-mon[125440]: pgmap v18103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:23:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:15 smithi136 ceph-mon[125702]: pgmap v18103: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:23:18.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:17 smithi057 ceph-mon[92072]: pgmap v18104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:23:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:17 smithi122 ceph-mon[125440]: pgmap v18104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:23:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:17 smithi136 ceph-mon[125702]: pgmap v18104: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:23:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:19 smithi057 ceph-mon[92072]: pgmap v18105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:23:20.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:19 smithi122 ceph-mon[125440]: pgmap v18105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:23:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:19 smithi136 ceph-mon[125702]: pgmap v18105: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:23:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:21 smithi057 ceph-mon[92072]: pgmap v18106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:23:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:21 smithi122 ceph-mon[125440]: pgmap v18106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:23:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:21 smithi136 ceph-mon[125702]: pgmap v18106: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:23:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:23 smithi057 ceph-mon[92072]: pgmap v18107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:23:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:23 smithi122 ceph-mon[125440]: pgmap v18107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:23:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:23 smithi136 ceph-mon[125702]: pgmap v18107: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:23:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:25 smithi057 ceph-mon[92072]: pgmap v18108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:23:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:25 smithi122 ceph-mon[125440]: pgmap v18108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:23:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:25 smithi136 ceph-mon[125702]: pgmap v18108: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:23:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:27 smithi057 ceph-mon[92072]: pgmap v18109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:28.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:27 smithi122 ceph-mon[125440]: pgmap v18109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:27 smithi136 ceph-mon[125702]: pgmap v18109: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:30.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:23:30.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:30.069+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:23:30.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:30.069+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:23:30.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:30.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:23:30.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:30.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:23:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:29 smithi057 ceph-mon[92072]: pgmap v18110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:29 smithi122 ceph-mon[125440]: pgmap v18110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:29 smithi136 ceph-mon[125702]: pgmap v18110: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:31 smithi057 ceph-mon[92072]: pgmap v18111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:31 smithi122 ceph-mon[125440]: pgmap v18111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:31 smithi136 ceph-mon[125702]: pgmap v18111: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:33 smithi057 ceph-mon[92072]: pgmap v18112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:33 smithi122 ceph-mon[125440]: pgmap v18112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:33 smithi136 ceph-mon[125702]: pgmap v18112: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:35 smithi057 ceph-mon[92072]: pgmap v18113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:35 smithi122 ceph-mon[125440]: pgmap v18113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:35 smithi136 ceph-mon[125702]: pgmap v18113: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:38.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:37 smithi122 ceph-mon[125440]: pgmap v18114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:37 smithi136 ceph-mon[125702]: pgmap v18114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:37 smithi057 ceph-mon[92072]: pgmap v18114: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:40.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:39 smithi122 ceph-mon[125440]: pgmap v18115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:39 smithi136 ceph-mon[125702]: pgmap v18115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:39 smithi057 ceph-mon[92072]: pgmap v18115: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:42.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:41 smithi122 ceph-mon[125440]: pgmap v18116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:41 smithi136 ceph-mon[125702]: pgmap v18116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:41 smithi057 ceph-mon[92072]: pgmap v18116: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:44.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:43 smithi122 ceph-mon[125440]: pgmap v18117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:43 smithi136 ceph-mon[125702]: pgmap v18117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:43 smithi057 ceph-mon[92072]: pgmap v18117: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:45.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:23:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:45.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:23:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:45.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:23:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:45.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:23:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:23:45.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:23:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:45 smithi136 ceph-mon[125702]: pgmap v18118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:45 smithi057 ceph-mon[92072]: pgmap v18118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:45 smithi122 ceph-mon[125440]: pgmap v18118: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:47 smithi136 ceph-mon[125702]: pgmap v18119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:48.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:23:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:47 smithi057 ceph-mon[92072]: pgmap v18119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:23:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:47 smithi122 ceph-mon[125440]: pgmap v18119: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:23:49.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:23:49.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:23:49.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:23:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:23:49.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:23:49.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:23:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:23:49.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:23:49.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:23:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:49 smithi136 ceph-mon[125702]: pgmap v18120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:49 smithi057 ceph-mon[92072]: pgmap v18120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:49 smithi122 ceph-mon[125440]: pgmap v18120: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:51 smithi136 ceph-mon[125702]: pgmap v18121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:51 smithi057 ceph-mon[92072]: pgmap v18121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:51 smithi122 ceph-mon[125440]: pgmap v18121: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:53 smithi136 ceph-mon[125702]: pgmap v18122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:53 smithi057 ceph-mon[92072]: pgmap v18122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:53 smithi122 ceph-mon[125440]: pgmap v18122: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:23:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:55 smithi136 ceph-mon[125702]: pgmap v18123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:55 smithi057 ceph-mon[92072]: pgmap v18123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:55 smithi122 ceph-mon[125440]: pgmap v18123: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:57 smithi136 ceph-mon[125702]: pgmap v18124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:57 smithi057 ceph-mon[92072]: pgmap v18124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:23:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:57 smithi122 ceph-mon[125440]: pgmap v18124: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:00.085+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:24:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:00.086+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:24:00.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:00.086+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:24:00.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:00.086+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:24:00.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:00.086+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:24:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:23:59 smithi136 ceph-mon[125702]: pgmap v18125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:23:59 smithi057 ceph-mon[92072]: pgmap v18125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:23:59 smithi122 ceph-mon[125440]: pgmap v18125: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:01 smithi136 ceph-mon[125702]: pgmap v18126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:01 smithi057 ceph-mon[92072]: pgmap v18126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:01 smithi122 ceph-mon[125440]: pgmap v18126: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:03 smithi136 ceph-mon[125702]: pgmap v18127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:24:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:03 smithi057 ceph-mon[92072]: pgmap v18127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:24:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:03 smithi122 ceph-mon[125440]: pgmap v18127: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:24:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:06 smithi136 ceph-mon[125702]: pgmap v18128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:24:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:06 smithi057 ceph-mon[92072]: pgmap v18128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:24:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:06 smithi122 ceph-mon[125440]: pgmap v18128: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:24:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:08 smithi136 ceph-mon[125702]: pgmap v18129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:24:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:08 smithi136 ceph-mon[125702]: osdmap e1206: 12 total, 12 up, 12 in 2023-03-02T20:24:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:08 smithi057 ceph-mon[92072]: pgmap v18129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:24:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:08 smithi057 ceph-mon[92072]: osdmap e1206: 12 total, 12 up, 12 in 2023-03-02T20:24:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:08 smithi122 ceph-mon[125440]: pgmap v18129: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:24:08.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:08 smithi122 ceph-mon[125440]: osdmap e1206: 12 total, 12 up, 12 in 2023-03-02T20:24:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:10 smithi136 ceph-mon[125702]: pgmap v18131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:24:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:10 smithi057 ceph-mon[92072]: pgmap v18131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:24:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:10 smithi122 ceph-mon[125440]: pgmap v18131: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:24:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:12 smithi136 ceph-mon[125702]: pgmap v18132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:24:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:12 smithi057 ceph-mon[92072]: pgmap v18132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:24:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:12 smithi122 ceph-mon[125440]: pgmap v18132: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:24:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:14 smithi136 ceph-mon[125702]: pgmap v18133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:24:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:14 smithi136 ceph-mon[125702]: osdmap e1207: 12 total, 12 up, 12 in 2023-03-02T20:24:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:14 smithi057 ceph-mon[92072]: pgmap v18133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:24:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:14 smithi057 ceph-mon[92072]: osdmap e1207: 12 total, 12 up, 12 in 2023-03-02T20:24:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:14 smithi122 ceph-mon[125440]: pgmap v18133: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:24:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:14 smithi122 ceph-mon[125440]: osdmap e1207: 12 total, 12 up, 12 in 2023-03-02T20:24:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:15.101+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:24:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:15.102+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:24:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:15.102+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:24:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:15.102+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:24:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:15.102+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:24:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:16 smithi136 ceph-mon[125702]: pgmap v18135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:24:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:16 smithi057 ceph-mon[92072]: pgmap v18135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:24:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:16 smithi122 ceph-mon[125440]: pgmap v18135: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:24:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:18 smithi136 ceph-mon[125702]: pgmap v18136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T20:24:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:18 smithi057 ceph-mon[92072]: pgmap v18136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T20:24:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:18 smithi122 ceph-mon[125440]: pgmap v18136: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T20:24:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:20 smithi136 ceph-mon[125702]: pgmap v18137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:24:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:20 smithi057 ceph-mon[92072]: pgmap v18137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:24:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:20 smithi122 ceph-mon[125440]: pgmap v18137: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:24:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:22 smithi136 ceph-mon[125702]: pgmap v18138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:24:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:22 smithi057 ceph-mon[92072]: pgmap v18138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:24:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:22 smithi122 ceph-mon[125440]: pgmap v18138: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:24:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:24 smithi136 ceph-mon[125702]: pgmap v18139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:24:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:24 smithi057 ceph-mon[92072]: pgmap v18139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:24:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:24 smithi122 ceph-mon[125440]: pgmap v18139: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:24:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:26 smithi136 ceph-mon[125702]: pgmap v18140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:24:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:26 smithi057 ceph-mon[92072]: pgmap v18140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:24:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:26 smithi122 ceph-mon[125440]: pgmap v18140: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:24:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:28 smithi136 ceph-mon[125702]: pgmap v18141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:28 smithi057 ceph-mon[92072]: pgmap v18141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:28 smithi122 ceph-mon[125440]: pgmap v18141: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:30.114+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:24:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:30.115+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:24:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:30.115+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:24:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:30.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:24:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:30.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:24:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:30 smithi136 ceph-mon[125702]: pgmap v18142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:24:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:30 smithi057 ceph-mon[92072]: pgmap v18142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:24:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:30 smithi122 ceph-mon[125440]: pgmap v18142: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:24:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:32 smithi136 ceph-mon[125702]: pgmap v18143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:32 smithi057 ceph-mon[92072]: pgmap v18143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:32 smithi122 ceph-mon[125440]: pgmap v18143: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:34 smithi136 ceph-mon[125702]: pgmap v18144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:34 smithi057 ceph-mon[92072]: pgmap v18144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:34 smithi122 ceph-mon[125440]: pgmap v18144: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:36 smithi136 ceph-mon[125702]: pgmap v18145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:36 smithi057 ceph-mon[92072]: pgmap v18145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:36 smithi122 ceph-mon[125440]: pgmap v18145: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:38 smithi136 ceph-mon[125702]: pgmap v18146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:38 smithi057 ceph-mon[92072]: pgmap v18146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:38 smithi122 ceph-mon[125440]: pgmap v18146: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:40 smithi136 ceph-mon[125702]: pgmap v18147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:40 smithi057 ceph-mon[92072]: pgmap v18147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:40 smithi122 ceph-mon[125440]: pgmap v18147: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:42 smithi136 ceph-mon[125702]: pgmap v18148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:42 smithi057 ceph-mon[92072]: pgmap v18148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:42 smithi122 ceph-mon[125440]: pgmap v18148: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:44 smithi136 ceph-mon[125702]: pgmap v18149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:24:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:44 smithi057 ceph-mon[92072]: pgmap v18149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:24:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:44 smithi122 ceph-mon[125440]: pgmap v18149: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:24:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:45.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:24:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:45.122+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:24:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:45.122+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:24:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:45.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:24:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:24:45.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:24:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:46 smithi057 ceph-mon[92072]: pgmap v18150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:46 smithi122 ceph-mon[125440]: pgmap v18150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:46 smithi136 ceph-mon[125702]: pgmap v18150: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:48 smithi057 ceph-mon[92072]: pgmap v18151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:48 smithi122 ceph-mon[125440]: pgmap v18151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:48 smithi136 ceph-mon[125702]: pgmap v18151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:24:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:24:49.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:24:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:24:49.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:24:49.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:24:49.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:24:49.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:24:49.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:24:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:50 smithi057 ceph-mon[92072]: pgmap v18152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:24:50.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:24:50.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:24:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:50 smithi122 ceph-mon[125440]: pgmap v18152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:24:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:24:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:24:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:50 smithi136 ceph-mon[125702]: pgmap v18152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:24:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:24:50.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:24:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:52 smithi057 ceph-mon[92072]: pgmap v18153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:52 smithi122 ceph-mon[125440]: pgmap v18153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:52 smithi136 ceph-mon[125702]: pgmap v18153: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:24:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:54 smithi057 ceph-mon[92072]: pgmap v18154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:54 smithi122 ceph-mon[125440]: pgmap v18154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:54 smithi136 ceph-mon[125702]: pgmap v18154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:24:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:56 smithi057 ceph-mon[92072]: pgmap v18155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:56 smithi122 ceph-mon[125440]: pgmap v18155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:56 smithi136 ceph-mon[125702]: pgmap v18155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:24:58 smithi057 ceph-mon[92072]: pgmap v18156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:24:58 smithi122 ceph-mon[125440]: pgmap v18156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:24:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:24:58 smithi136 ceph-mon[125702]: pgmap v18156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:00.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:25:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:00.137+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:25:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:00.137+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:25:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:00.137+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:25:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:00.137+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:25:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:00 smithi057 ceph-mon[92072]: pgmap v18157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:00 smithi122 ceph-mon[125440]: pgmap v18157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:00 smithi136 ceph-mon[125702]: pgmap v18157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:02 smithi057 ceph-mon[92072]: pgmap v18158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:02 smithi122 ceph-mon[125440]: pgmap v18158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:02 smithi136 ceph-mon[125702]: pgmap v18158: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:04.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:04 smithi057 ceph-mon[92072]: pgmap v18159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:25:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:04 smithi122 ceph-mon[125440]: pgmap v18159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:25:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:04 smithi136 ceph-mon[125702]: pgmap v18159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:25:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:06 smithi057 ceph-mon[92072]: pgmap v18160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:25:06.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:06 smithi122 ceph-mon[125440]: pgmap v18160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:25:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:06 smithi136 ceph-mon[125702]: pgmap v18160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:25:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:07 smithi057 ceph-mon[92072]: osdmap e1208: 12 total, 12 up, 12 in 2023-03-02T20:25:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:07 smithi122 ceph-mon[125440]: osdmap e1208: 12 total, 12 up, 12 in 2023-03-02T20:25:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:07 smithi136 ceph-mon[125702]: osdmap e1208: 12 total, 12 up, 12 in 2023-03-02T20:25:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:08 smithi057 ceph-mon[92072]: pgmap v18162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:25:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:08 smithi122 ceph-mon[125440]: pgmap v18162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:25:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:08 smithi136 ceph-mon[125702]: pgmap v18162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:25:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:10 smithi057 ceph-mon[92072]: pgmap v18163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:25:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:10 smithi122 ceph-mon[125440]: pgmap v18163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:25:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:10 smithi136 ceph-mon[125702]: pgmap v18163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:25:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:12 smithi057 ceph-mon[92072]: pgmap v18164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:25:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:12 smithi122 ceph-mon[125440]: pgmap v18164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:25:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:12 smithi136 ceph-mon[125702]: pgmap v18164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:25:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:14 smithi057 ceph-mon[92072]: pgmap v18165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:25:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:14 smithi057 ceph-mon[92072]: osdmap e1209: 12 total, 12 up, 12 in 2023-03-02T20:25:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:14 smithi122 ceph-mon[125440]: pgmap v18165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:25:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:14 smithi122 ceph-mon[125440]: osdmap e1209: 12 total, 12 up, 12 in 2023-03-02T20:25:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:14 smithi136 ceph-mon[125702]: pgmap v18165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:25:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:14 smithi136 ceph-mon[125702]: osdmap e1209: 12 total, 12 up, 12 in 2023-03-02T20:25:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:15.149+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:25:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:15.150+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:25:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:15.150+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:25:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:15.150+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:25:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:15.150+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:25:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:16 smithi122 ceph-mon[125440]: pgmap v18167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T20:25:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:16 smithi136 ceph-mon[125702]: pgmap v18167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T20:25:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:16 smithi057 ceph-mon[92072]: pgmap v18167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T20:25:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:17 smithi136 ceph-mon[125702]: pgmap v18168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:25:17.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:17 smithi057 ceph-mon[92072]: pgmap v18168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:25:17.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:17 smithi122 ceph-mon[125440]: pgmap v18168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:25:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:19 smithi057 ceph-mon[92072]: pgmap v18169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:25:20.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:19 smithi122 ceph-mon[125440]: pgmap v18169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:25:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:19 smithi136 ceph-mon[125702]: pgmap v18169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:25:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:21 smithi057 ceph-mon[92072]: pgmap v18170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:25:22.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:21 smithi122 ceph-mon[125440]: pgmap v18170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:25:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:21 smithi136 ceph-mon[125702]: pgmap v18170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:25:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:23 smithi057 ceph-mon[92072]: pgmap v18171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:25:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:23 smithi122 ceph-mon[125440]: pgmap v18171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:25:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:23 smithi136 ceph-mon[125702]: pgmap v18171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:25:26.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:25 smithi057 ceph-mon[92072]: pgmap v18172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:25:26.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:25 smithi122 ceph-mon[125440]: pgmap v18172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:25:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:25 smithi136 ceph-mon[125702]: pgmap v18172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:25:28.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:27 smithi057 ceph-mon[92072]: pgmap v18173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:28.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:27 smithi122 ceph-mon[125440]: pgmap v18173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:27 smithi136 ceph-mon[125702]: pgmap v18173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:30.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:25:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:30.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:25:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:30.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:25:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:30.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:25:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:30.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:25:30.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:29 smithi057 ceph-mon[92072]: pgmap v18174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:25:30.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:29 smithi122 ceph-mon[125440]: pgmap v18174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:25:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:29 smithi136 ceph-mon[125702]: pgmap v18174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:25:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:31 smithi057 ceph-mon[92072]: pgmap v18175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:31 smithi122 ceph-mon[125440]: pgmap v18175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:31 smithi136 ceph-mon[125702]: pgmap v18175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:33 smithi057 ceph-mon[92072]: pgmap v18176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:33 smithi122 ceph-mon[125440]: pgmap v18176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:33 smithi136 ceph-mon[125702]: pgmap v18176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:35 smithi057 ceph-mon[92072]: pgmap v18177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:35 smithi122 ceph-mon[125440]: pgmap v18177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:35 smithi136 ceph-mon[125702]: pgmap v18177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:37 smithi057 ceph-mon[92072]: pgmap v18178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:37 smithi122 ceph-mon[125440]: pgmap v18178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:37 smithi136 ceph-mon[125702]: pgmap v18178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:40.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:39 smithi057 ceph-mon[92072]: pgmap v18179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:39 smithi122 ceph-mon[125440]: pgmap v18179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:39 smithi136 ceph-mon[125702]: pgmap v18179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:41 smithi057 ceph-mon[92072]: pgmap v18180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:42.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:41 smithi122 ceph-mon[125440]: pgmap v18180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:41 smithi136 ceph-mon[125702]: pgmap v18180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:43 smithi057 ceph-mon[92072]: pgmap v18181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:43 smithi122 ceph-mon[125440]: pgmap v18181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:43 smithi136 ceph-mon[125702]: pgmap v18181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:45.166 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:45.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:25:45.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:45.164+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:25:45.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:45.164+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:25:45.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:45.164+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:25:45.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:25:45.164+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:25:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:45 smithi122 ceph-mon[125440]: pgmap v18182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:45 smithi136 ceph-mon[125702]: pgmap v18182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:45 smithi057 ceph-mon[92072]: pgmap v18182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:48.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:47 smithi122 ceph-mon[125440]: pgmap v18183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:47 smithi136 ceph-mon[125702]: pgmap v18183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:47 smithi057 ceph-mon[92072]: pgmap v18183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:50.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:49 smithi122 ceph-mon[125440]: pgmap v18184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:50.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:25:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:49 smithi136 ceph-mon[125702]: pgmap v18184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:25:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:49 smithi057 ceph-mon[92072]: pgmap v18184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:25:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:51 smithi136 ceph-mon[125702]: pgmap v18185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:51.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:25:51.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:25:51.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:51 smithi057 ceph-mon[92072]: pgmap v18185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:51.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:25:51.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:25:51.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:51.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:51 smithi122 ceph-mon[125440]: pgmap v18185: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:51.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:25:51.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:25:51.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:25:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:53 smithi136 ceph-mon[125702]: pgmap v18186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:53.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:53 smithi057 ceph-mon[92072]: pgmap v18186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:53 smithi122 ceph-mon[125440]: pgmap v18186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:25:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:55 smithi057 ceph-mon[92072]: pgmap v18187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:55 smithi122 ceph-mon[125440]: pgmap v18187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:55 smithi136 ceph-mon[125702]: pgmap v18187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:58.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:57 smithi057 ceph-mon[92072]: pgmap v18188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:58.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:57 smithi122 ceph-mon[125440]: pgmap v18188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:25:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:57 smithi136 ceph-mon[125702]: pgmap v18188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:00.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:00.178+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:26:00.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:00.178+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:26:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:00.178+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:26:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:00.179+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:26:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:00.179+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:26:00.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:25:59 smithi057 ceph-mon[92072]: pgmap v18189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:25:59 smithi122 ceph-mon[125440]: pgmap v18189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:25:59 smithi136 ceph-mon[125702]: pgmap v18189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:02.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:01 smithi057 ceph-mon[92072]: pgmap v18190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:01 smithi122 ceph-mon[125440]: pgmap v18190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:01 smithi136 ceph-mon[125702]: pgmap v18190: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:04.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:03 smithi057 ceph-mon[92072]: pgmap v18191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:26:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:03 smithi122 ceph-mon[125440]: pgmap v18191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:26:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:03 smithi136 ceph-mon[125702]: pgmap v18191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:26:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:05 smithi057 ceph-mon[92072]: pgmap v18192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:26:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:05 smithi122 ceph-mon[125440]: pgmap v18192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:26:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:05 smithi136 ceph-mon[125702]: pgmap v18192: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:26:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:07 smithi057 ceph-mon[92072]: pgmap v18193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:26:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:07 smithi057 ceph-mon[92072]: osdmap e1210: 12 total, 12 up, 12 in 2023-03-02T20:26:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:07 smithi122 ceph-mon[125440]: pgmap v18193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:26:08.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:07 smithi122 ceph-mon[125440]: osdmap e1210: 12 total, 12 up, 12 in 2023-03-02T20:26:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:07 smithi136 ceph-mon[125702]: pgmap v18193: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:26:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:07 smithi136 ceph-mon[125702]: osdmap e1210: 12 total, 12 up, 12 in 2023-03-02T20:26:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:09 smithi057 ceph-mon[92072]: pgmap v18195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:26:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:09 smithi122 ceph-mon[125440]: pgmap v18195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:26:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:09 smithi136 ceph-mon[125702]: pgmap v18195: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:26:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:11 smithi057 ceph-mon[92072]: pgmap v18196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:26:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:11 smithi122 ceph-mon[125440]: pgmap v18196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:26:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:11 smithi136 ceph-mon[125702]: pgmap v18196: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:26:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:13.289+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:26:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:13.289+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:26:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:13.290+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 262 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:26:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:13.290+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 263 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:26:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:13 smithi057 ceph-mon[92072]: pgmap v18197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:26:14.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:13 smithi057 ceph-mon[92072]: osdmap e1211: 12 total, 12 up, 12 in 2023-03-02T20:26:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:13 smithi122 ceph-mon[125440]: pgmap v18197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:26:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:13 smithi122 ceph-mon[125440]: osdmap e1211: 12 total, 12 up, 12 in 2023-03-02T20:26:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:13 smithi136 ceph-mon[125702]: pgmap v18197: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:26:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:13 smithi136 ceph-mon[125702]: osdmap e1211: 12 total, 12 up, 12 in 2023-03-02T20:26:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:15.193+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:26:15.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:15.193+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:26:15.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:15.193+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:26:15.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:15.193+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:26:15.196 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:15.193+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:26:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:15 smithi057 ceph-mon[92072]: pgmap v18199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:26:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:15 smithi122 ceph-mon[125440]: pgmap v18199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:26:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:15 smithi136 ceph-mon[125702]: pgmap v18199: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:26:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:17 smithi122 ceph-mon[125440]: pgmap v18200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:26:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:17 smithi136 ceph-mon[125702]: pgmap v18200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:26:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:17 smithi057 ceph-mon[92072]: pgmap v18200: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:26:20.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:19 smithi122 ceph-mon[125440]: pgmap v18201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:26:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:19 smithi136 ceph-mon[125702]: pgmap v18201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:26:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:19 smithi057 ceph-mon[92072]: pgmap v18201: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:26:22.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:21 smithi122 ceph-mon[125440]: pgmap v18202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:26:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:21 smithi136 ceph-mon[125702]: pgmap v18202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:26:22.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:21 smithi057 ceph-mon[92072]: pgmap v18202: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:26:24.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:23 smithi122 ceph-mon[125440]: pgmap v18203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:26:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:23 smithi136 ceph-mon[125702]: pgmap v18203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:26:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:23 smithi057 ceph-mon[92072]: pgmap v18203: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:26:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:25 smithi136 ceph-mon[125702]: pgmap v18204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:26:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:25 smithi057 ceph-mon[92072]: pgmap v18204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:26:26.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:25 smithi122 ceph-mon[125440]: pgmap v18204: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:26:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:27 smithi136 ceph-mon[125702]: pgmap v18205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:27 smithi057 ceph-mon[92072]: pgmap v18205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:28.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:27 smithi122 ceph-mon[125440]: pgmap v18205: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:30.201+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:26:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:30.202+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:26:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:30.202+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:26:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:30.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:26:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:30.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:26:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:29 smithi136 ceph-mon[125702]: pgmap v18206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:26:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:29 smithi057 ceph-mon[92072]: pgmap v18206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:26:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:29 smithi122 ceph-mon[125440]: pgmap v18206: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:26:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:31 smithi136 ceph-mon[125702]: pgmap v18207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:31 smithi057 ceph-mon[92072]: pgmap v18207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:32.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:31 smithi122 ceph-mon[125440]: pgmap v18207: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:33 smithi136 ceph-mon[125702]: pgmap v18208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:33 smithi057 ceph-mon[92072]: pgmap v18208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:33 smithi122 ceph-mon[125440]: pgmap v18208: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:35 smithi136 ceph-mon[125702]: pgmap v18209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:35 smithi057 ceph-mon[92072]: pgmap v18209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:35 smithi122 ceph-mon[125440]: pgmap v18209: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:37 smithi136 ceph-mon[125702]: pgmap v18210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:37 smithi057 ceph-mon[92072]: pgmap v18210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:37 smithi122 ceph-mon[125440]: pgmap v18210: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:39 smithi136 ceph-mon[125702]: pgmap v18211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:39 smithi057 ceph-mon[92072]: pgmap v18211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:39 smithi122 ceph-mon[125440]: pgmap v18211: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:41 smithi136 ceph-mon[125702]: pgmap v18212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:41 smithi057 ceph-mon[92072]: pgmap v18212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:41 smithi122 ceph-mon[125440]: pgmap v18212: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:43 smithi136 ceph-mon[125702]: pgmap v18213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:43 smithi057 ceph-mon[92072]: pgmap v18213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:43 smithi122 ceph-mon[125440]: pgmap v18213: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:45.217+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:26:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:45.218+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:26:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:45.218+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:26:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:45.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:26:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:26:45.218+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:26:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:45 smithi136 ceph-mon[125702]: pgmap v18214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:45 smithi057 ceph-mon[92072]: pgmap v18214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:45 smithi122 ceph-mon[125440]: pgmap v18214: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:48 smithi136 ceph-mon[125702]: pgmap v18215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:48 smithi057 ceph-mon[92072]: pgmap v18215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:48 smithi122 ceph-mon[125440]: pgmap v18215: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:50 smithi136 ceph-mon[125702]: pgmap v18216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:50 smithi057 ceph-mon[92072]: pgmap v18216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:50 smithi122 ceph-mon[125440]: pgmap v18216: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:52 smithi136 ceph-mon[125702]: pgmap v18217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:52.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:26:52.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:26:52.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:26:52.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:26:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:52 smithi057 ceph-mon[92072]: pgmap v18217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:52.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:26:52.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:26:52.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:26:52.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:26:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:52 smithi122 ceph-mon[125440]: pgmap v18217: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:26:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:26:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:26:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:26:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:54 smithi136 ceph-mon[125702]: pgmap v18218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:54 smithi057 ceph-mon[92072]: pgmap v18218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:54 smithi122 ceph-mon[125440]: pgmap v18218: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:26:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:56 smithi136 ceph-mon[125702]: pgmap v18219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:56 smithi057 ceph-mon[92072]: pgmap v18219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:56.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:56 smithi122 ceph-mon[125440]: pgmap v18219: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:26:58 smithi136 ceph-mon[125702]: pgmap v18220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:26:58 smithi057 ceph-mon[92072]: pgmap v18220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:26:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:26:58 smithi122 ceph-mon[125440]: pgmap v18220: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:00.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:27:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:00.221+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:27:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:00.221+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:27:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:00.221+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:27:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:00.221+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:27:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:00 smithi136 ceph-mon[125702]: pgmap v18221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:00 smithi057 ceph-mon[92072]: pgmap v18221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:00 smithi122 ceph-mon[125440]: pgmap v18221: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:02 smithi136 ceph-mon[125702]: pgmap v18222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:02 smithi057 ceph-mon[92072]: pgmap v18222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:02 smithi122 ceph-mon[125440]: pgmap v18222: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:04 smithi136 ceph-mon[125702]: pgmap v18223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:27:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:04 smithi057 ceph-mon[92072]: pgmap v18223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:27:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:04 smithi122 ceph-mon[125440]: pgmap v18223: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:27:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:06 smithi136 ceph-mon[125702]: pgmap v18224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:27:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:06 smithi057 ceph-mon[92072]: pgmap v18224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:27:06.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:06 smithi122 ceph-mon[125440]: pgmap v18224: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:27:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:08 smithi136 ceph-mon[125702]: pgmap v18225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:27:08.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:08 smithi136 ceph-mon[125702]: osdmap e1212: 12 total, 12 up, 12 in 2023-03-02T20:27:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:08 smithi057 ceph-mon[92072]: pgmap v18225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:27:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:08 smithi057 ceph-mon[92072]: osdmap e1212: 12 total, 12 up, 12 in 2023-03-02T20:27:08.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:08 smithi122 ceph-mon[125440]: pgmap v18225: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:27:08.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:08 smithi122 ceph-mon[125440]: osdmap e1212: 12 total, 12 up, 12 in 2023-03-02T20:27:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:10 smithi136 ceph-mon[125702]: pgmap v18227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:27:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:10 smithi057 ceph-mon[92072]: pgmap v18227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:27:10.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:10 smithi122 ceph-mon[125440]: pgmap v18227: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:27:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:12 smithi136 ceph-mon[125702]: pgmap v18228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:27:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:12 smithi057 ceph-mon[92072]: pgmap v18228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:27:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:12 smithi122 ceph-mon[125440]: pgmap v18228: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:27:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:14 smithi136 ceph-mon[125702]: pgmap v18229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:27:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:14 smithi136 ceph-mon[125702]: osdmap e1213: 12 total, 12 up, 12 in 2023-03-02T20:27:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:14 smithi057 ceph-mon[92072]: pgmap v18229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:27:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:14 smithi057 ceph-mon[92072]: osdmap e1213: 12 total, 12 up, 12 in 2023-03-02T20:27:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:14 smithi122 ceph-mon[125440]: pgmap v18229: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:27:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:14 smithi122 ceph-mon[125440]: osdmap e1213: 12 total, 12 up, 12 in 2023-03-02T20:27:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:15.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:27:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:15.230+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:27:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:15.230+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:27:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:15.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:27:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:15.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:27:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:16 smithi136 ceph-mon[125702]: pgmap v18231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:27:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:16 smithi057 ceph-mon[92072]: pgmap v18231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:27:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:16 smithi122 ceph-mon[125440]: pgmap v18231: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:27:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:18 smithi136 ceph-mon[125702]: pgmap v18232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T20:27:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:18 smithi057 ceph-mon[92072]: pgmap v18232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T20:27:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:18 smithi122 ceph-mon[125440]: pgmap v18232: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T20:27:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:20 smithi136 ceph-mon[125702]: pgmap v18233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:27:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:20 smithi057 ceph-mon[92072]: pgmap v18233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:27:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:20 smithi122 ceph-mon[125440]: pgmap v18233: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:27:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:22 smithi136 ceph-mon[125702]: pgmap v18234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:27:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:22 smithi057 ceph-mon[92072]: pgmap v18234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:27:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:22 smithi122 ceph-mon[125440]: pgmap v18234: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:27:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:24 smithi057 ceph-mon[92072]: pgmap v18235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:27:24.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:24 smithi122 ceph-mon[125440]: pgmap v18235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:27:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:24 smithi136 ceph-mon[125702]: pgmap v18235: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:27:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:26 smithi057 ceph-mon[92072]: pgmap v18236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:27:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:26 smithi122 ceph-mon[125440]: pgmap v18236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:27:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:26 smithi136 ceph-mon[125702]: pgmap v18236: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:27:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:28 smithi057 ceph-mon[92072]: pgmap v18237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:28.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:28 smithi122 ceph-mon[125440]: pgmap v18237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:28 smithi136 ceph-mon[125702]: pgmap v18237: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:30.238+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:27:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:30.238+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:27:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:30.238+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:27:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:30.238+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:27:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:30.238+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:27:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:30 smithi057 ceph-mon[92072]: pgmap v18238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:30 smithi122 ceph-mon[125440]: pgmap v18238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:30 smithi136 ceph-mon[125702]: pgmap v18238: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:32 smithi057 ceph-mon[92072]: pgmap v18239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:32 smithi122 ceph-mon[125440]: pgmap v18239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:32 smithi136 ceph-mon[125702]: pgmap v18239: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:34 smithi057 ceph-mon[92072]: pgmap v18240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:34 smithi122 ceph-mon[125440]: pgmap v18240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:34 smithi136 ceph-mon[125702]: pgmap v18240: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:36 smithi057 ceph-mon[92072]: pgmap v18241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:36 smithi122 ceph-mon[125440]: pgmap v18241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:36 smithi136 ceph-mon[125702]: pgmap v18241: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:38.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:38 smithi057 ceph-mon[92072]: pgmap v18242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:38 smithi122 ceph-mon[125440]: pgmap v18242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:38 smithi136 ceph-mon[125702]: pgmap v18242: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:40 smithi057 ceph-mon[92072]: pgmap v18243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:40 smithi122 ceph-mon[125440]: pgmap v18243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:40 smithi136 ceph-mon[125702]: pgmap v18243: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:42 smithi057 ceph-mon[92072]: pgmap v18244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:42 smithi122 ceph-mon[125440]: pgmap v18244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:42 smithi136 ceph-mon[125702]: pgmap v18244: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:44 smithi057 ceph-mon[92072]: pgmap v18245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:44 smithi122 ceph-mon[125440]: pgmap v18245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:44 smithi136 ceph-mon[125702]: pgmap v18245: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:45.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:27:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:45.245+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:27:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:45.245+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:27:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:45.245+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:27:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:27:45.245+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:27:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:46 smithi057 ceph-mon[92072]: pgmap v18246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:46 smithi122 ceph-mon[125440]: pgmap v18246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:46 smithi136 ceph-mon[125702]: pgmap v18246: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:48 smithi057 ceph-mon[92072]: pgmap v18247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:48 smithi122 ceph-mon[125440]: pgmap v18247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:48 smithi136 ceph-mon[125702]: pgmap v18247: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:50 smithi057 ceph-mon[92072]: pgmap v18248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:50 smithi122 ceph-mon[125440]: pgmap v18248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:50 smithi136 ceph-mon[125702]: pgmap v18248: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:52 smithi057 ceph-mon[92072]: pgmap v18249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:52.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:52 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:27:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:52 smithi122 ceph-mon[125440]: pgmap v18249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:52 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:27:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:52 smithi136 ceph-mon[125702]: pgmap v18249: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:52.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:52 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:27:53.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:27:53.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:27:53.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:27:53.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:27:53.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:27:53.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:27:53.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:27:53.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:27:53.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:27:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:54 smithi057 ceph-mon[92072]: pgmap v18250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:54 smithi122 ceph-mon[125440]: pgmap v18250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:54 smithi136 ceph-mon[125702]: pgmap v18250: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:27:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:56 smithi057 ceph-mon[92072]: pgmap v18251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:56 smithi122 ceph-mon[125440]: pgmap v18251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:56 smithi136 ceph-mon[125702]: pgmap v18251: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:27:58 smithi122 ceph-mon[125440]: pgmap v18252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:27:58 smithi136 ceph-mon[125702]: pgmap v18252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:27:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:27:58 smithi057 ceph-mon[92072]: pgmap v18252: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:00.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:28:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:00.261+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:28:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:00.261+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:28:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:00.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:28:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:00.261+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:28:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:00 smithi122 ceph-mon[125440]: pgmap v18253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:00 smithi136 ceph-mon[125702]: pgmap v18253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:00 smithi057 ceph-mon[92072]: pgmap v18253: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:02 smithi122 ceph-mon[125440]: pgmap v18254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:02 smithi136 ceph-mon[125702]: pgmap v18254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:02 smithi057 ceph-mon[92072]: pgmap v18254: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:04 smithi122 ceph-mon[125440]: pgmap v18255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:28:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:04 smithi136 ceph-mon[125702]: pgmap v18255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:28:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:04 smithi057 ceph-mon[92072]: pgmap v18255: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:28:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:06 smithi136 ceph-mon[125702]: pgmap v18256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:28:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:06 smithi057 ceph-mon[92072]: pgmap v18256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:28:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:06 smithi122 ceph-mon[125440]: pgmap v18256: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:28:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:07 smithi136 ceph-mon[125702]: osdmap e1214: 12 total, 12 up, 12 in 2023-03-02T20:28:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:07 smithi057 ceph-mon[92072]: osdmap e1214: 12 total, 12 up, 12 in 2023-03-02T20:28:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:07 smithi122 ceph-mon[125440]: osdmap e1214: 12 total, 12 up, 12 in 2023-03-02T20:28:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:08 smithi136 ceph-mon[125702]: pgmap v18258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:28:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:08 smithi057 ceph-mon[92072]: pgmap v18258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:28:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:08 smithi122 ceph-mon[125440]: pgmap v18258: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:28:10.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:09 smithi057 ceph-mon[92072]: pgmap v18259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:28:10.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:09 smithi122 ceph-mon[125440]: pgmap v18259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:28:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:09 smithi136 ceph-mon[125702]: pgmap v18259: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:28:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:11 smithi057 ceph-mon[92072]: pgmap v18260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:28:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:11 smithi122 ceph-mon[125440]: pgmap v18260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:28:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:11 smithi136 ceph-mon[125702]: pgmap v18260: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:28:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:13 smithi122 ceph-mon[125440]: pgmap v18261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:28:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:13 smithi136 ceph-mon[125702]: pgmap v18261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:28:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:13 smithi057 ceph-mon[92072]: pgmap v18261: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:28:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:15.273+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:28:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:15.273+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:28:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:15.273+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:28:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:15.273+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:28:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:15.273+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:28:15.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:14 smithi136 ceph-mon[125702]: osdmap e1215: 12 total, 12 up, 12 in 2023-03-02T20:28:15.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:14 smithi057 ceph-mon[92072]: osdmap e1215: 12 total, 12 up, 12 in 2023-03-02T20:28:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:14 smithi122 ceph-mon[125440]: osdmap e1215: 12 total, 12 up, 12 in 2023-03-02T20:28:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:15 smithi136 ceph-mon[125702]: pgmap v18263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 246 B/s wr, 12 op/s 2023-03-02T20:28:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:15 smithi057 ceph-mon[92072]: pgmap v18263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 246 B/s wr, 12 op/s 2023-03-02T20:28:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:15 smithi122 ceph-mon[125440]: pgmap v18263: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 246 B/s wr, 12 op/s 2023-03-02T20:28:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:17 smithi136 ceph-mon[125702]: pgmap v18264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:28:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:17 smithi057 ceph-mon[92072]: pgmap v18264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:28:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:17 smithi122 ceph-mon[125440]: pgmap v18264: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:28:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:19 smithi136 ceph-mon[125702]: pgmap v18265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:28:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:19 smithi057 ceph-mon[92072]: pgmap v18265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:28:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:19 smithi122 ceph-mon[125440]: pgmap v18265: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:28:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:21 smithi136 ceph-mon[125702]: pgmap v18266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:28:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:21 smithi057 ceph-mon[92072]: pgmap v18266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:28:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:21 smithi122 ceph-mon[125440]: pgmap v18266: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:28:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:23 smithi136 ceph-mon[125702]: pgmap v18267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:28:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:23 smithi057 ceph-mon[92072]: pgmap v18267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:28:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:23 smithi122 ceph-mon[125440]: pgmap v18267: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:28:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:25 smithi136 ceph-mon[125702]: pgmap v18268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:28:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:25 smithi057 ceph-mon[92072]: pgmap v18268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:28:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:25 smithi122 ceph-mon[125440]: pgmap v18268: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:28:28.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:28.310+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:28:28.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:28.310+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:28:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:28.310+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 264 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:28:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:28.310+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 263 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:28:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:27 smithi136 ceph-mon[125702]: pgmap v18269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:27 smithi057 ceph-mon[92072]: pgmap v18269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:27 smithi122 ceph-mon[125440]: pgmap v18269: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:30.288+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:28:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:30.289+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:28:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:30.289+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:28:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:30.289+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:28:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:30.289+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:28:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:29 smithi136 ceph-mon[125702]: pgmap v18270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:29 smithi057 ceph-mon[92072]: pgmap v18270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:29 smithi122 ceph-mon[125440]: pgmap v18270: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:32 smithi136 ceph-mon[125702]: pgmap v18271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:32 smithi057 ceph-mon[92072]: pgmap v18271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:32.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:32 smithi122 ceph-mon[125440]: pgmap v18271: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:34 smithi136 ceph-mon[125702]: pgmap v18272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:34 smithi057 ceph-mon[92072]: pgmap v18272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:34 smithi122 ceph-mon[125440]: pgmap v18272: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:36 smithi136 ceph-mon[125702]: pgmap v18273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:36 smithi057 ceph-mon[92072]: pgmap v18273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:36 smithi122 ceph-mon[125440]: pgmap v18273: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:38 smithi136 ceph-mon[125702]: pgmap v18274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:38 smithi057 ceph-mon[92072]: pgmap v18274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:38 smithi122 ceph-mon[125440]: pgmap v18274: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:40 smithi136 ceph-mon[125702]: pgmap v18275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:40 smithi057 ceph-mon[92072]: pgmap v18275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:40 smithi122 ceph-mon[125440]: pgmap v18275: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:42 smithi136 ceph-mon[125702]: pgmap v18276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:42 smithi057 ceph-mon[92072]: pgmap v18276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:42 smithi122 ceph-mon[125440]: pgmap v18276: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:44 smithi136 ceph-mon[125702]: pgmap v18277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:44 smithi057 ceph-mon[92072]: pgmap v18277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:44 smithi122 ceph-mon[125440]: pgmap v18277: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:45.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:45.291+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:28:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:45.291+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:28:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:45.291+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:28:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:45.291+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:28:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:28:45.291+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:28:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:46 smithi136 ceph-mon[125702]: pgmap v18278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:46 smithi057 ceph-mon[92072]: pgmap v18278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:46 smithi122 ceph-mon[125440]: pgmap v18278: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:48 smithi136 ceph-mon[125702]: pgmap v18279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:48 smithi057 ceph-mon[92072]: pgmap v18279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:48 smithi122 ceph-mon[125440]: pgmap v18279: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:50 smithi136 ceph-mon[125702]: pgmap v18280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:50 smithi057 ceph-mon[92072]: pgmap v18280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:50 smithi122 ceph-mon[125440]: pgmap v18280: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:52 smithi136 ceph-mon[125702]: pgmap v18281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:52 smithi057 ceph-mon[92072]: pgmap v18281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:52 smithi122 ceph-mon[125440]: pgmap v18281: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:53.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:28:53.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:28:53.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:28:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:54 smithi136 ceph-mon[125702]: pgmap v18282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:54.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:28:54.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:28:54.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:28:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:54 smithi057 ceph-mon[92072]: pgmap v18282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:54.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:28:54.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:28:54.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:28:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:54 smithi122 ceph-mon[125440]: pgmap v18282: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:28:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:28:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:28:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:28:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:56 smithi136 ceph-mon[125702]: pgmap v18283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:56 smithi057 ceph-mon[92072]: pgmap v18283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:56 smithi122 ceph-mon[125440]: pgmap v18283: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:28:58 smithi136 ceph-mon[125702]: pgmap v18284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:28:58 smithi057 ceph-mon[92072]: pgmap v18284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:28:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:28:58 smithi122 ceph-mon[125440]: pgmap v18284: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:00.306+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:29:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:00.306+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:29:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:00.306+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:29:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:00.306+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:29:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:00.306+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:29:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:00 smithi136 ceph-mon[125702]: pgmap v18285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:00 smithi057 ceph-mon[92072]: pgmap v18285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:00 smithi122 ceph-mon[125440]: pgmap v18285: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:02 smithi136 ceph-mon[125702]: pgmap v18286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:02 smithi057 ceph-mon[92072]: pgmap v18286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:02 smithi122 ceph-mon[125440]: pgmap v18286: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:04 smithi136 ceph-mon[125702]: pgmap v18287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:29:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:04 smithi057 ceph-mon[92072]: pgmap v18287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:29:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:04 smithi122 ceph-mon[125440]: pgmap v18287: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:29:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:06 smithi057 ceph-mon[92072]: pgmap v18288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:29:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:06 smithi122 ceph-mon[125440]: pgmap v18288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:29:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:06 smithi136 ceph-mon[125702]: pgmap v18288: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:29:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:07 smithi057 ceph-mon[92072]: osdmap e1216: 12 total, 12 up, 12 in 2023-03-02T20:29:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:07 smithi122 ceph-mon[125440]: osdmap e1216: 12 total, 12 up, 12 in 2023-03-02T20:29:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:07 smithi136 ceph-mon[125702]: osdmap e1216: 12 total, 12 up, 12 in 2023-03-02T20:29:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:08.427+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000217) for more than 900000000 us, fault. 2023-03-02T20:29:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:08.427+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5870019800 tx=0x7f587008e000 comp rx=0 tx=0).stop 2023-03-02T20:29:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:08.427+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T20:29:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:08.427+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T20:29:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:08.427+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T20:29:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:08.427+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:29:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:08.427+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5870019800 tx=0x7f58700b2070 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T20:29:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:08 smithi057 ceph-mon[92072]: pgmap v18290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:29:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:08 smithi122 ceph-mon[125440]: pgmap v18290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:29:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:08 smithi136 ceph-mon[125702]: pgmap v18290: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:29:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:10 smithi057 ceph-mon[92072]: pgmap v18291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:29:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:10 smithi122 ceph-mon[125440]: pgmap v18291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:29:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:10 smithi136 ceph-mon[125702]: pgmap v18291: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:29:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:12 smithi057 ceph-mon[92072]: pgmap v18292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:29:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:12 smithi122 ceph-mon[125440]: pgmap v18292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:29:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:12 smithi136 ceph-mon[125702]: pgmap v18292: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:29:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:13.315+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:29:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:13.315+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:29:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:13.316+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 265 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:29:13.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:13.316+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 264 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:29:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:14 smithi057 ceph-mon[92072]: pgmap v18293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:29:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:14 smithi057 ceph-mon[92072]: osdmap e1217: 12 total, 12 up, 12 in 2023-03-02T20:29:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:14 smithi122 ceph-mon[125440]: pgmap v18293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:29:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:14 smithi122 ceph-mon[125440]: osdmap e1217: 12 total, 12 up, 12 in 2023-03-02T20:29:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:14 smithi136 ceph-mon[125702]: pgmap v18293: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:29:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:14 smithi136 ceph-mon[125702]: osdmap e1217: 12 total, 12 up, 12 in 2023-03-02T20:29:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:15.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:29:15.325 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:15.321+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:29:15.325 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:15.321+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:29:15.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:15.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:29:15.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:15.321+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:29:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:16 smithi057 ceph-mon[92072]: pgmap v18295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:29:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:16 smithi122 ceph-mon[125440]: pgmap v18295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:29:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:16 smithi136 ceph-mon[125702]: pgmap v18295: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:29:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:18 smithi057 ceph-mon[92072]: pgmap v18296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:29:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:18 smithi122 ceph-mon[125440]: pgmap v18296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:29:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:18 smithi136 ceph-mon[125702]: pgmap v18296: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:29:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:20 smithi057 ceph-mon[92072]: pgmap v18297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:29:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:20 smithi122 ceph-mon[125440]: pgmap v18297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:29:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:20 smithi136 ceph-mon[125702]: pgmap v18297: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:29:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:22 smithi057 ceph-mon[92072]: pgmap v18298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:29:22.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:22 smithi122 ceph-mon[125440]: pgmap v18298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:29:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:22 smithi136 ceph-mon[125702]: pgmap v18298: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:29:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:24 smithi057 ceph-mon[92072]: pgmap v18299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:29:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:24 smithi122 ceph-mon[125440]: pgmap v18299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:29:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:24 smithi136 ceph-mon[125702]: pgmap v18299: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:29:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:26 smithi057 ceph-mon[92072]: pgmap v18300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:29:26.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:26 smithi122 ceph-mon[125440]: pgmap v18300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:29:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:26 smithi136 ceph-mon[125702]: pgmap v18300: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:29:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:28 smithi057 ceph-mon[92072]: pgmap v18301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:28 smithi122 ceph-mon[125440]: pgmap v18301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:28 smithi136 ceph-mon[125702]: pgmap v18301: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:30.337+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:29:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:30.337+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:29:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:30.337+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:29:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:30.337+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:29:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:30.337+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:29:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:30 smithi057 ceph-mon[92072]: pgmap v18302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:30 smithi122 ceph-mon[125440]: pgmap v18302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:30 smithi136 ceph-mon[125702]: pgmap v18302: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:32 smithi057 ceph-mon[92072]: pgmap v18303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:32 smithi122 ceph-mon[125440]: pgmap v18303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:32 smithi136 ceph-mon[125702]: pgmap v18303: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:34 smithi057 ceph-mon[92072]: pgmap v18304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:34 smithi122 ceph-mon[125440]: pgmap v18304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:34 smithi136 ceph-mon[125702]: pgmap v18304: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:36 smithi057 ceph-mon[92072]: pgmap v18305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:36 smithi122 ceph-mon[125440]: pgmap v18305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:36 smithi136 ceph-mon[125702]: pgmap v18305: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:38 smithi057 ceph-mon[92072]: pgmap v18306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:38 smithi122 ceph-mon[125440]: pgmap v18306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:38 smithi136 ceph-mon[125702]: pgmap v18306: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:40 smithi057 ceph-mon[92072]: pgmap v18307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:40 smithi122 ceph-mon[125440]: pgmap v18307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:40 smithi136 ceph-mon[125702]: pgmap v18307: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:42 smithi057 ceph-mon[92072]: pgmap v18308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:42 smithi122 ceph-mon[125440]: pgmap v18308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:42 smithi136 ceph-mon[125702]: pgmap v18308: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:44 smithi057 ceph-mon[92072]: pgmap v18309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:44 smithi122 ceph-mon[125440]: pgmap v18309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:44 smithi136 ceph-mon[125702]: pgmap v18309: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:45.355 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:45.353+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:29:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:45.353+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:29:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:45.353+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:29:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:45.353+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:29:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:29:45.353+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:29:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:46 smithi057 ceph-mon[92072]: pgmap v18310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:46 smithi122 ceph-mon[125440]: pgmap v18310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:46 smithi136 ceph-mon[125702]: pgmap v18310: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:48 smithi057 ceph-mon[92072]: pgmap v18311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:48 smithi122 ceph-mon[125440]: pgmap v18311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:48 smithi136 ceph-mon[125702]: pgmap v18311: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:50 smithi122 ceph-mon[125440]: pgmap v18312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:50 smithi136 ceph-mon[125702]: pgmap v18312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:50 smithi057 ceph-mon[92072]: pgmap v18312: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:52 smithi122 ceph-mon[125440]: pgmap v18313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:52 smithi136 ceph-mon[125702]: pgmap v18313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:52 smithi057 ceph-mon[92072]: pgmap v18313: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:54 smithi122 ceph-mon[125440]: pgmap v18314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:29:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:54 smithi136 ceph-mon[125702]: pgmap v18314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:54.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:29:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:54 smithi057 ceph-mon[92072]: pgmap v18314: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:29:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:29:55.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:29:55.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:29:55.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:29:55.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:29:55.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:29:55.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:29:55.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:29:55.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:29:55.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:29:56.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:56 smithi122 ceph-mon[125440]: pgmap v18315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:56 smithi136 ceph-mon[125702]: pgmap v18315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:56 smithi057 ceph-mon[92072]: pgmap v18315: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:29:58 smithi136 ceph-mon[125702]: pgmap v18316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:29:58 smithi057 ceph-mon[92072]: pgmap v18316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:29:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:29:58 smithi122 ceph-mon[125440]: pgmap v18316: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:00.368+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:00.368+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:00.368+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:00.368+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:30:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:00.368+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:30:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:00 smithi136 ceph-mon[125702]: pgmap v18317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T20:30:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:00 smithi057 ceph-mon[92072]: pgmap v18317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T20:30:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:00 smithi122 ceph-mon[125440]: pgmap v18317: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T20:30:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:02 smithi136 ceph-mon[125702]: pgmap v18318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:02 smithi057 ceph-mon[92072]: pgmap v18318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:02 smithi122 ceph-mon[125440]: pgmap v18318: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:04 smithi136 ceph-mon[125702]: pgmap v18319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:30:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:04 smithi057 ceph-mon[92072]: pgmap v18319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:30:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:04 smithi122 ceph-mon[125440]: pgmap v18319: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:30:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:06 smithi136 ceph-mon[125702]: pgmap v18320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:30:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:06 smithi057 ceph-mon[92072]: pgmap v18320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:30:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:06 smithi122 ceph-mon[125440]: pgmap v18320: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:30:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:07 smithi136 ceph-mon[125702]: osdmap e1218: 12 total, 12 up, 12 in 2023-03-02T20:30:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:07 smithi057 ceph-mon[92072]: osdmap e1218: 12 total, 12 up, 12 in 2023-03-02T20:30:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:07 smithi122 ceph-mon[125440]: osdmap e1218: 12 total, 12 up, 12 in 2023-03-02T20:30:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:08 smithi136 ceph-mon[125702]: pgmap v18322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:30:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:08 smithi057 ceph-mon[92072]: pgmap v18322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:30:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:08 smithi122 ceph-mon[125440]: pgmap v18322: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:30:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:09 smithi136 ceph-mon[125702]: pgmap v18323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:30:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:09 smithi057 ceph-mon[92072]: pgmap v18323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:30:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:09 smithi122 ceph-mon[125440]: pgmap v18323: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:30:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:11 smithi136 ceph-mon[125702]: pgmap v18324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:30:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:11 smithi057 ceph-mon[92072]: pgmap v18324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:30:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:11 smithi122 ceph-mon[125440]: pgmap v18324: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:30:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:13 smithi136 ceph-mon[125702]: pgmap v18325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:30:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:13 smithi136 ceph-mon[125702]: osdmap e1219: 12 total, 12 up, 12 in 2023-03-02T20:30:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:13 smithi057 ceph-mon[92072]: pgmap v18325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:30:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:13 smithi057 ceph-mon[92072]: osdmap e1219: 12 total, 12 up, 12 in 2023-03-02T20:30:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:13 smithi122 ceph-mon[125440]: pgmap v18325: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:30:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:13 smithi122 ceph-mon[125440]: osdmap e1219: 12 total, 12 up, 12 in 2023-03-02T20:30:15.374 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:15.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:30:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:15.371+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:30:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:15.371+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:30:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:15.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:30:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:15.371+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:30:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:15 smithi136 ceph-mon[125702]: pgmap v18327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T20:30:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:15 smithi057 ceph-mon[92072]: pgmap v18327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T20:30:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:15 smithi122 ceph-mon[125440]: pgmap v18327: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T20:30:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:17 smithi136 ceph-mon[125702]: pgmap v18328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:30:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:17 smithi057 ceph-mon[92072]: pgmap v18328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:30:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:17 smithi122 ceph-mon[125440]: pgmap v18328: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:30:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:19 smithi136 ceph-mon[125702]: pgmap v18329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:30:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:19 smithi057 ceph-mon[92072]: pgmap v18329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:30:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:19 smithi122 ceph-mon[125440]: pgmap v18329: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:30:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:21 smithi136 ceph-mon[125702]: pgmap v18330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:30:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:21 smithi057 ceph-mon[92072]: pgmap v18330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:30:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:21 smithi122 ceph-mon[125440]: pgmap v18330: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:30:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:23 smithi136 ceph-mon[125702]: pgmap v18331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:30:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:23 smithi057 ceph-mon[92072]: pgmap v18331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:30:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:23 smithi122 ceph-mon[125440]: pgmap v18331: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:30:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:25 smithi136 ceph-mon[125702]: pgmap v18332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:30:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:25 smithi057 ceph-mon[92072]: pgmap v18332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:30:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:25 smithi122 ceph-mon[125440]: pgmap v18332: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:30:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:28 smithi136 ceph-mon[125702]: pgmap v18333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:28 smithi057 ceph-mon[92072]: pgmap v18333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:28 smithi122 ceph-mon[125440]: pgmap v18333: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:30 smithi136 ceph-mon[125702]: pgmap v18334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:30.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:30.377+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:30.377+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:30.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:30.377+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:30:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:30 smithi057 ceph-mon[92072]: pgmap v18334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:30 smithi122 ceph-mon[125440]: pgmap v18334: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:32 smithi136 ceph-mon[125702]: pgmap v18335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:32 smithi057 ceph-mon[92072]: pgmap v18335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:32 smithi122 ceph-mon[125440]: pgmap v18335: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:34 smithi136 ceph-mon[125702]: pgmap v18336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:34 smithi057 ceph-mon[92072]: pgmap v18336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:34 smithi122 ceph-mon[125440]: pgmap v18336: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:36 smithi136 ceph-mon[125702]: pgmap v18337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:36 smithi057 ceph-mon[92072]: pgmap v18337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:36 smithi122 ceph-mon[125440]: pgmap v18337: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:38 smithi136 ceph-mon[125702]: pgmap v18338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:38 smithi057 ceph-mon[92072]: pgmap v18338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:38 smithi122 ceph-mon[125440]: pgmap v18338: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:40 smithi136 ceph-mon[125702]: pgmap v18339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:40 smithi057 ceph-mon[92072]: pgmap v18339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:40 smithi122 ceph-mon[125440]: pgmap v18339: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:42 smithi136 ceph-mon[125702]: pgmap v18340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:42 smithi057 ceph-mon[92072]: pgmap v18340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:42 smithi122 ceph-mon[125440]: pgmap v18340: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:44 smithi136 ceph-mon[125702]: pgmap v18341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:44 smithi057 ceph-mon[92072]: pgmap v18341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:44 smithi122 ceph-mon[125440]: pgmap v18341: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:45.393+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:30:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:45.393+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:30:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:45.394+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:30:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:45.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:30:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:30:45.394+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:30:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:46 smithi136 ceph-mon[125702]: pgmap v18342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:46 smithi057 ceph-mon[92072]: pgmap v18342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:46 smithi122 ceph-mon[125440]: pgmap v18342: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:48 smithi136 ceph-mon[125702]: pgmap v18343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:48 smithi057 ceph-mon[92072]: pgmap v18343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:48 smithi122 ceph-mon[125440]: pgmap v18343: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:50.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:50 smithi136 ceph-mon[125702]: pgmap v18344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:50 smithi057 ceph-mon[92072]: pgmap v18344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:50 smithi122 ceph-mon[125440]: pgmap v18344: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:52 smithi136 ceph-mon[125702]: pgmap v18345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:52 smithi057 ceph-mon[92072]: pgmap v18345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:52 smithi122 ceph-mon[125440]: pgmap v18345: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:54 smithi136 ceph-mon[125702]: pgmap v18346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:54 smithi057 ceph-mon[92072]: pgmap v18346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:54 smithi122 ceph-mon[125440]: pgmap v18346: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:30:55.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:30:55.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:30:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:30:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:56 smithi136 ceph-mon[125702]: pgmap v18347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:56.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:30:56.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:30:56.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:30:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:56 smithi057 ceph-mon[92072]: pgmap v18347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:30:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:30:56.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:30:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:56 smithi122 ceph-mon[125440]: pgmap v18347: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:56.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:30:56.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:30:56.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:30:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:30:58 smithi136 ceph-mon[125702]: pgmap v18348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:30:58 smithi057 ceph-mon[92072]: pgmap v18348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:30:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:30:58 smithi122 ceph-mon[125440]: pgmap v18348: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:00 smithi136 ceph-mon[125702]: pgmap v18349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:00.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:31:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:00.405+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:31:00.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:00.405+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:31:00.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:00.405+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:31:00.408 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:00.405+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:31:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:00 smithi057 ceph-mon[92072]: pgmap v18349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:00 smithi122 ceph-mon[125440]: pgmap v18349: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:02 smithi057 ceph-mon[92072]: pgmap v18350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:02 smithi122 ceph-mon[125440]: pgmap v18350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:02 smithi136 ceph-mon[125702]: pgmap v18350: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:04 smithi057 ceph-mon[92072]: pgmap v18351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:31:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:04 smithi122 ceph-mon[125440]: pgmap v18351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:31:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:04 smithi136 ceph-mon[125702]: pgmap v18351: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:31:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:06 smithi057 ceph-mon[92072]: pgmap v18352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:31:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:06 smithi122 ceph-mon[125440]: pgmap v18352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:31:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:06 smithi136 ceph-mon[125702]: pgmap v18352: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:31:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:07 smithi057 ceph-mon[92072]: osdmap e1220: 12 total, 12 up, 12 in 2023-03-02T20:31:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:07 smithi122 ceph-mon[125440]: osdmap e1220: 12 total, 12 up, 12 in 2023-03-02T20:31:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:07 smithi136 ceph-mon[125702]: osdmap e1220: 12 total, 12 up, 12 in 2023-03-02T20:31:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:08 smithi057 ceph-mon[92072]: pgmap v18354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:31:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:08 smithi122 ceph-mon[125440]: pgmap v18354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:31:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:08 smithi136 ceph-mon[125702]: pgmap v18354: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:31:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:10 smithi057 ceph-mon[92072]: pgmap v18355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:31:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:10 smithi122 ceph-mon[125440]: pgmap v18355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:31:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:10 smithi136 ceph-mon[125702]: pgmap v18355: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:31:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:12 smithi057 ceph-mon[92072]: pgmap v18356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:31:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:12 smithi122 ceph-mon[125440]: pgmap v18356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:31:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:12 smithi136 ceph-mon[125702]: pgmap v18356: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:31:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:14 smithi057 ceph-mon[92072]: pgmap v18357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:31:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:14 smithi057 ceph-mon[92072]: osdmap e1221: 12 total, 12 up, 12 in 2023-03-02T20:31:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:14 smithi122 ceph-mon[125440]: pgmap v18357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:31:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:14 smithi122 ceph-mon[125440]: osdmap e1221: 12 total, 12 up, 12 in 2023-03-02T20:31:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:14 smithi136 ceph-mon[125702]: pgmap v18357: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:31:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:14 smithi136 ceph-mon[125702]: osdmap e1221: 12 total, 12 up, 12 in 2023-03-02T20:31:15.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:15.406+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:31:15.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:15.406+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:31:15.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:15.406+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:31:15.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:15.406+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:31:15.409 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:15.406+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:31:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:16 smithi057 ceph-mon[92072]: pgmap v18359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:31:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:16 smithi122 ceph-mon[125440]: pgmap v18359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:31:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:16 smithi136 ceph-mon[125702]: pgmap v18359: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:31:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:18 smithi057 ceph-mon[92072]: pgmap v18360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:31:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:18 smithi122 ceph-mon[125440]: pgmap v18360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:31:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:18 smithi136 ceph-mon[125702]: pgmap v18360: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:31:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:20 smithi057 ceph-mon[92072]: pgmap v18361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:31:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:20 smithi122 ceph-mon[125440]: pgmap v18361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:31:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:20 smithi136 ceph-mon[125702]: pgmap v18361: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:31:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:22 smithi057 ceph-mon[92072]: pgmap v18362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:31:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:22 smithi122 ceph-mon[125440]: pgmap v18362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:31:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:22 smithi136 ceph-mon[125702]: pgmap v18362: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:31:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:24 smithi057 ceph-mon[92072]: pgmap v18363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:31:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:24 smithi122 ceph-mon[125440]: pgmap v18363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:31:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:24 smithi136 ceph-mon[125702]: pgmap v18363: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:31:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:26 smithi057 ceph-mon[92072]: pgmap v18364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:31:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:26 smithi122 ceph-mon[125440]: pgmap v18364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:31:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:26 smithi136 ceph-mon[125702]: pgmap v18364: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:31:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:28 smithi057 ceph-mon[92072]: pgmap v18365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:28 smithi122 ceph-mon[125440]: pgmap v18365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:28 smithi136 ceph-mon[125702]: pgmap v18365: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:30.418+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:31:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:30.418+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:31:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:30.418+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:31:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:30.418+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:31:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:30.418+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:31:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:30 smithi057 ceph-mon[92072]: pgmap v18366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:30 smithi122 ceph-mon[125440]: pgmap v18366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:30 smithi136 ceph-mon[125702]: pgmap v18366: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:32 smithi057 ceph-mon[92072]: pgmap v18367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:32 smithi122 ceph-mon[125440]: pgmap v18367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:32 smithi136 ceph-mon[125702]: pgmap v18367: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:34 smithi057 ceph-mon[92072]: pgmap v18368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:34 smithi122 ceph-mon[125440]: pgmap v18368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:34 smithi136 ceph-mon[125702]: pgmap v18368: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:36 smithi122 ceph-mon[125440]: pgmap v18369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:36 smithi136 ceph-mon[125702]: pgmap v18369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:36 smithi057 ceph-mon[92072]: pgmap v18369: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:38 smithi122 ceph-mon[125440]: pgmap v18370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:38 smithi136 ceph-mon[125702]: pgmap v18370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:38 smithi057 ceph-mon[92072]: pgmap v18370: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:40 smithi122 ceph-mon[125440]: pgmap v18371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:40 smithi136 ceph-mon[125702]: pgmap v18371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:40 smithi057 ceph-mon[92072]: pgmap v18371: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:42 smithi122 ceph-mon[125440]: pgmap v18372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:42 smithi136 ceph-mon[125702]: pgmap v18372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:42 smithi057 ceph-mon[92072]: pgmap v18372: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:44 smithi136 ceph-mon[125702]: pgmap v18373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:44 smithi057 ceph-mon[92072]: pgmap v18373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:44 smithi122 ceph-mon[125440]: pgmap v18373: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:45.423+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:31:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:45.424+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:31:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:45.424+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:31:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:45.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:31:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:31:45.424+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:31:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:46 smithi136 ceph-mon[125702]: pgmap v18374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:46 smithi057 ceph-mon[92072]: pgmap v18374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:46 smithi122 ceph-mon[125440]: pgmap v18374: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:48 smithi136 ceph-mon[125702]: pgmap v18375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:48 smithi057 ceph-mon[92072]: pgmap v18375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:48 smithi122 ceph-mon[125440]: pgmap v18375: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:50 smithi136 ceph-mon[125702]: pgmap v18376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:50 smithi057 ceph-mon[92072]: pgmap v18376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:50 smithi122 ceph-mon[125440]: pgmap v18376: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:52 smithi136 ceph-mon[125702]: pgmap v18377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:52 smithi057 ceph-mon[92072]: pgmap v18377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:52 smithi122 ceph-mon[125440]: pgmap v18377: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:54 smithi136 ceph-mon[125702]: pgmap v18378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:54 smithi057 ceph-mon[92072]: pgmap v18378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:54 smithi122 ceph-mon[125440]: pgmap v18378: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:31:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:56 smithi136 ceph-mon[125702]: pgmap v18379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:56.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:31:56.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:31:56.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:31:56.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:31:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:56 smithi057 ceph-mon[92072]: pgmap v18379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:56.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:31:56.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:31:56.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:31:56.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:31:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:56 smithi122 ceph-mon[125440]: pgmap v18379: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:31:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:31:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:31:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:31:58.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:31:58 smithi136 ceph-mon[125702]: pgmap v18380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:31:58 smithi057 ceph-mon[92072]: pgmap v18380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:31:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:31:58 smithi122 ceph-mon[125440]: pgmap v18380: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:00.434+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:32:00.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:00.435+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:32:00.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:00.435+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:32:00.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:00.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:32:00.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:00.435+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:32:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:00 smithi136 ceph-mon[125702]: pgmap v18381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:00 smithi057 ceph-mon[92072]: pgmap v18381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:00 smithi122 ceph-mon[125440]: pgmap v18381: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:02 smithi136 ceph-mon[125702]: pgmap v18382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:02 smithi057 ceph-mon[92072]: pgmap v18382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:02 smithi122 ceph-mon[125440]: pgmap v18382: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:03.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:03 smithi136 ceph-mon[125702]: pgmap v18383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:32:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:03 smithi057 ceph-mon[92072]: pgmap v18383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:32:03.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:03 smithi122 ceph-mon[125440]: pgmap v18383: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:32:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:05 smithi136 ceph-mon[125702]: pgmap v18384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:32:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:05 smithi057 ceph-mon[92072]: pgmap v18384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:32:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:05 smithi122 ceph-mon[125440]: pgmap v18384: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:32:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:08 smithi136 ceph-mon[125702]: pgmap v18385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:32:08.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:08 smithi136 ceph-mon[125702]: osdmap e1222: 12 total, 12 up, 12 in 2023-03-02T20:32:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:08 smithi057 ceph-mon[92072]: pgmap v18385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:32:08.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:08 smithi057 ceph-mon[92072]: osdmap e1222: 12 total, 12 up, 12 in 2023-03-02T20:32:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:08 smithi122 ceph-mon[125440]: pgmap v18385: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:32:08.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:08 smithi122 ceph-mon[125440]: osdmap e1222: 12 total, 12 up, 12 in 2023-03-02T20:32:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:10 smithi136 ceph-mon[125702]: pgmap v18387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:32:10.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:10 smithi057 ceph-mon[92072]: pgmap v18387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:32:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:10 smithi122 ceph-mon[125440]: pgmap v18387: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:32:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:12 smithi136 ceph-mon[125702]: pgmap v18388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:32:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:12 smithi057 ceph-mon[92072]: pgmap v18388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:32:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:12 smithi122 ceph-mon[125440]: pgmap v18388: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:32:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:13.343+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:32:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:13.343+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:32:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:13.343+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 266 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:32:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:13.343+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 265 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:32:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:14 smithi136 ceph-mon[125702]: pgmap v18389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:32:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:14 smithi136 ceph-mon[125702]: osdmap e1223: 12 total, 12 up, 12 in 2023-03-02T20:32:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:14 smithi057 ceph-mon[92072]: pgmap v18389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:32:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:14 smithi057 ceph-mon[92072]: osdmap e1223: 12 total, 12 up, 12 in 2023-03-02T20:32:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:14 smithi122 ceph-mon[125440]: pgmap v18389: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:32:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:14 smithi122 ceph-mon[125440]: osdmap e1223: 12 total, 12 up, 12 in 2023-03-02T20:32:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:15.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:32:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:15.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:32:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:15.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:32:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:15.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:32:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:15.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:32:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:16 smithi136 ceph-mon[125702]: pgmap v18391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:32:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:16 smithi057 ceph-mon[92072]: pgmap v18391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:32:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:16 smithi122 ceph-mon[125440]: pgmap v18391: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:32:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:18 smithi136 ceph-mon[125702]: pgmap v18392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:32:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:18 smithi057 ceph-mon[92072]: pgmap v18392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:32:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:18 smithi122 ceph-mon[125440]: pgmap v18392: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 106 B/s wr, 5 op/s 2023-03-02T20:32:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:20 smithi136 ceph-mon[125702]: pgmap v18393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:32:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:20 smithi057 ceph-mon[92072]: pgmap v18393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:32:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:20 smithi122 ceph-mon[125440]: pgmap v18393: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:32:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:22 smithi136 ceph-mon[125702]: pgmap v18394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:32:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:22 smithi057 ceph-mon[92072]: pgmap v18394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:32:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:22 smithi122 ceph-mon[125440]: pgmap v18394: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:32:24.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:24 smithi136 ceph-mon[125702]: pgmap v18395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:32:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:24 smithi057 ceph-mon[92072]: pgmap v18395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:32:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:24 smithi122 ceph-mon[125440]: pgmap v18395: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:32:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:26 smithi136 ceph-mon[125702]: pgmap v18396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:32:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:26 smithi057 ceph-mon[92072]: pgmap v18396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:32:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:26 smithi122 ceph-mon[125440]: pgmap v18396: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:32:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:28 smithi136 ceph-mon[125702]: pgmap v18397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:28 smithi057 ceph-mon[92072]: pgmap v18397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:28 smithi122 ceph-mon[125440]: pgmap v18397: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:30 smithi136 ceph-mon[125702]: pgmap v18398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:30 smithi057 ceph-mon[92072]: pgmap v18398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:30 smithi122 ceph-mon[125440]: pgmap v18398: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:30.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:32:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:30.457+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:32:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:30.457+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:32:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:30.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:32:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:30.457+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:32:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:32 smithi136 ceph-mon[125702]: pgmap v18399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:32 smithi057 ceph-mon[92072]: pgmap v18399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:32 smithi122 ceph-mon[125440]: pgmap v18399: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:34 smithi136 ceph-mon[125702]: pgmap v18400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:34 smithi057 ceph-mon[92072]: pgmap v18400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:34 smithi122 ceph-mon[125440]: pgmap v18400: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:36 smithi136 ceph-mon[125702]: pgmap v18401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:36 smithi057 ceph-mon[92072]: pgmap v18401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:36 smithi122 ceph-mon[125440]: pgmap v18401: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:38 smithi136 ceph-mon[125702]: pgmap v18402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:38 smithi057 ceph-mon[92072]: pgmap v18402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:38 smithi122 ceph-mon[125440]: pgmap v18402: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:40 smithi136 ceph-mon[125702]: pgmap v18403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:40 smithi057 ceph-mon[92072]: pgmap v18403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:40 smithi122 ceph-mon[125440]: pgmap v18403: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:42 smithi136 ceph-mon[125702]: pgmap v18404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:42 smithi057 ceph-mon[92072]: pgmap v18404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:42 smithi122 ceph-mon[125440]: pgmap v18404: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:44 smithi136 ceph-mon[125702]: pgmap v18405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:44 smithi057 ceph-mon[92072]: pgmap v18405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:44 smithi122 ceph-mon[125440]: pgmap v18405: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:45.461+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:32:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:45.461+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:32:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:45.461+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:32:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:45.461+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:32:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:32:45.461+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:32:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:46 smithi136 ceph-mon[125702]: pgmap v18406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:46 smithi057 ceph-mon[92072]: pgmap v18406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:46 smithi122 ceph-mon[125440]: pgmap v18406: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:48 smithi057 ceph-mon[92072]: pgmap v18407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:48 smithi122 ceph-mon[125440]: pgmap v18407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:48 smithi136 ceph-mon[125702]: pgmap v18407: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:50 smithi057 ceph-mon[92072]: pgmap v18408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:50 smithi122 ceph-mon[125440]: pgmap v18408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:50 smithi136 ceph-mon[125702]: pgmap v18408: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:52 smithi057 ceph-mon[92072]: pgmap v18409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:52 smithi122 ceph-mon[125440]: pgmap v18409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:52 smithi136 ceph-mon[125702]: pgmap v18409: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:54 smithi057 ceph-mon[92072]: pgmap v18410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:54 smithi122 ceph-mon[125440]: pgmap v18410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:54 smithi136 ceph-mon[125702]: pgmap v18410: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:32:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:56 smithi057 ceph-mon[92072]: pgmap v18411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:56 smithi122 ceph-mon[125440]: pgmap v18411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:56 smithi136 ceph-mon[125702]: pgmap v18411: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:57.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:32:57.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:32:57.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:32:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:32:58 smithi057 ceph-mon[92072]: pgmap v18412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:32:58 smithi122 ceph-mon[125440]: pgmap v18412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:32:58.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:32:58 smithi136 ceph-mon[125702]: pgmap v18412: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:00.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:33:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:00.473+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:33:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:00.473+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:33:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:00.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:33:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:00.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:33:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: pgmap v18413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: pgmap v18413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: pgmap v18413: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:00.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:00.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:33:01.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:33:01.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:33:01.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:33:01.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:33:01.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:33:01.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:01.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:33:01.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:33:01.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:33:01.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:33:01.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:33:01.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:33:01.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:33:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:33:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:33:01.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:33:01.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:33:01.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:33:01.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:33:01.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:33:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:02 smithi136 ceph-mon[125702]: pgmap v18414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:02 smithi057 ceph-mon[92072]: pgmap v18414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:02 smithi122 ceph-mon[125440]: pgmap v18414: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:04 smithi136 ceph-mon[125702]: pgmap v18415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:33:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:04 smithi057 ceph-mon[92072]: pgmap v18415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:33:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:04 smithi122 ceph-mon[125440]: pgmap v18415: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:33:05.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:05 smithi136 ceph-mon[125702]: pgmap v18416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:33:05.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:05 smithi057 ceph-mon[92072]: pgmap v18416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:33:05.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:05 smithi122 ceph-mon[125440]: pgmap v18416: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:33:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:07 smithi136 ceph-mon[125702]: osdmap e1224: 12 total, 12 up, 12 in 2023-03-02T20:33:07.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:07 smithi136 ceph-mon[125702]: pgmap v18418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:33:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:07 smithi057 ceph-mon[92072]: osdmap e1224: 12 total, 12 up, 12 in 2023-03-02T20:33:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:07 smithi057 ceph-mon[92072]: pgmap v18418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:33:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:07 smithi122 ceph-mon[125440]: osdmap e1224: 12 total, 12 up, 12 in 2023-03-02T20:33:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:07 smithi122 ceph-mon[125440]: pgmap v18418: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:33:10.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:10 smithi136 ceph-mon[125702]: pgmap v18419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:33:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:10 smithi057 ceph-mon[92072]: pgmap v18419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:33:10.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:10 smithi122 ceph-mon[125440]: pgmap v18419: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:33:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:12 smithi136 ceph-mon[125702]: pgmap v18420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:33:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:12 smithi057 ceph-mon[92072]: pgmap v18420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:33:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:12 smithi122 ceph-mon[125440]: pgmap v18420: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:33:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:14 smithi136 ceph-mon[125702]: pgmap v18421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:33:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:14 smithi136 ceph-mon[125702]: osdmap e1225: 12 total, 12 up, 12 in 2023-03-02T20:33:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:14 smithi057 ceph-mon[92072]: pgmap v18421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:33:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:14 smithi057 ceph-mon[92072]: osdmap e1225: 12 total, 12 up, 12 in 2023-03-02T20:33:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:14 smithi122 ceph-mon[125440]: pgmap v18421: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:33:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:14 smithi122 ceph-mon[125440]: osdmap e1225: 12 total, 12 up, 12 in 2023-03-02T20:33:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:15.483+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:33:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:15.484+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:33:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:15.484+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:33:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:15.484+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:33:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:15.484+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:33:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:16 smithi136 ceph-mon[125702]: pgmap v18423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T20:33:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:16 smithi057 ceph-mon[92072]: pgmap v18423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T20:33:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:16 smithi122 ceph-mon[125440]: pgmap v18423: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-02T20:33:18.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:18 smithi136 ceph-mon[125702]: pgmap v18424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:33:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:18 smithi057 ceph-mon[92072]: pgmap v18424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:33:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:18 smithi122 ceph-mon[125440]: pgmap v18424: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:33:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:20 smithi136 ceph-mon[125702]: pgmap v18425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:33:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:20 smithi057 ceph-mon[92072]: pgmap v18425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:33:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:20 smithi122 ceph-mon[125440]: pgmap v18425: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:33:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:22 smithi136 ceph-mon[125702]: pgmap v18426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:33:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:22 smithi057 ceph-mon[92072]: pgmap v18426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:33:22.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:22 smithi122 ceph-mon[125440]: pgmap v18426: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:33:24.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:24 smithi136 ceph-mon[125702]: pgmap v18427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:33:24.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:24 smithi057 ceph-mon[92072]: pgmap v18427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:33:24.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:24 smithi122 ceph-mon[125440]: pgmap v18427: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:33:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:26 smithi136 ceph-mon[125702]: pgmap v18428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:33:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:26 smithi057 ceph-mon[92072]: pgmap v18428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:33:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:26 smithi122 ceph-mon[125440]: pgmap v18428: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:33:28.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:28 smithi136 ceph-mon[125702]: pgmap v18429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:28 smithi057 ceph-mon[92072]: pgmap v18429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:28 smithi122 ceph-mon[125440]: pgmap v18429: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:30.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:30 smithi136 ceph-mon[125702]: pgmap v18430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:30 smithi057 ceph-mon[92072]: pgmap v18430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:30 smithi122 ceph-mon[125440]: pgmap v18430: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:30.485+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:33:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:30.485+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:33:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:30.485+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:33:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:30.485+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:33:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:30.485+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:33:32.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:32 smithi136 ceph-mon[125702]: pgmap v18431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:32 smithi057 ceph-mon[92072]: pgmap v18431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:32 smithi122 ceph-mon[125440]: pgmap v18431: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:34.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:34 smithi136 ceph-mon[125702]: pgmap v18432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:34 smithi057 ceph-mon[92072]: pgmap v18432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:34.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:34 smithi122 ceph-mon[125440]: pgmap v18432: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:36.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:36 smithi136 ceph-mon[125702]: pgmap v18433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:36 smithi057 ceph-mon[92072]: pgmap v18433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:36 smithi122 ceph-mon[125440]: pgmap v18433: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:38 smithi136 ceph-mon[125702]: pgmap v18434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:38 smithi057 ceph-mon[92072]: pgmap v18434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:38 smithi122 ceph-mon[125440]: pgmap v18434: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:40 smithi136 ceph-mon[125702]: pgmap v18435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:40 smithi057 ceph-mon[92072]: pgmap v18435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:40 smithi122 ceph-mon[125440]: pgmap v18435: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:42 smithi136 ceph-mon[125702]: pgmap v18436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:42 smithi057 ceph-mon[92072]: pgmap v18436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:42 smithi122 ceph-mon[125440]: pgmap v18436: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:44 smithi057 ceph-mon[92072]: pgmap v18437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:44 smithi122 ceph-mon[125440]: pgmap v18437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:44 smithi136 ceph-mon[125702]: pgmap v18437: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:45.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:33:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:45.496+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:33:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:45.496+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:33:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:45.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:33:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:33:45.496+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:33:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:46 smithi057 ceph-mon[92072]: pgmap v18438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:46 smithi122 ceph-mon[125440]: pgmap v18438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:46 smithi136 ceph-mon[125702]: pgmap v18438: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:48 smithi057 ceph-mon[92072]: pgmap v18439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:48 smithi122 ceph-mon[125440]: pgmap v18439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:48 smithi136 ceph-mon[125702]: pgmap v18439: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:50 smithi057 ceph-mon[92072]: pgmap v18440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:50 smithi122 ceph-mon[125440]: pgmap v18440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:50 smithi136 ceph-mon[125702]: pgmap v18440: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:52 smithi057 ceph-mon[92072]: pgmap v18441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:52 smithi122 ceph-mon[125440]: pgmap v18441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:52 smithi136 ceph-mon[125702]: pgmap v18441: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:54 smithi057 ceph-mon[92072]: pgmap v18442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:54 smithi122 ceph-mon[125440]: pgmap v18442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:54 smithi136 ceph-mon[125702]: pgmap v18442: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:33:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:56 smithi057 ceph-mon[92072]: pgmap v18443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:56.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:56 smithi122 ceph-mon[125440]: pgmap v18443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:56 smithi136 ceph-mon[125702]: pgmap v18443: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:33:58 smithi057 ceph-mon[92072]: pgmap v18444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:33:58 smithi122 ceph-mon[125440]: pgmap v18444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:33:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:33:58 smithi136 ceph-mon[125702]: pgmap v18444: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:00 smithi057 ceph-mon[92072]: pgmap v18445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:00 smithi122 ceph-mon[125440]: pgmap v18445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:00.509+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:34:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:00.510+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:34:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:00.510+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:34:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:00.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:34:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:00.510+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:34:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:00 smithi136 ceph-mon[125702]: pgmap v18445: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:01.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:34:01.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:34:01.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:34:01.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:01 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:34:01.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:34:01.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:34:01.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:34:01.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:01 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:34:01.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:34:01.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:34:01.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:34:01.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:01 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:34:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:02 smithi057 ceph-mon[92072]: pgmap v18446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:02 smithi122 ceph-mon[125440]: pgmap v18446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:02 smithi136 ceph-mon[125702]: pgmap v18446: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:04 smithi057 ceph-mon[92072]: pgmap v18447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:34:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:04 smithi122 ceph-mon[125440]: pgmap v18447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:34:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:04 smithi136 ceph-mon[125702]: pgmap v18447: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:34:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:06 smithi057 ceph-mon[92072]: pgmap v18448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:34:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:06 smithi122 ceph-mon[125440]: pgmap v18448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:34:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:06 smithi136 ceph-mon[125702]: pgmap v18448: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:34:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:08 smithi057 ceph-mon[92072]: pgmap v18449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:34:08.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:08 smithi122 ceph-mon[125440]: pgmap v18449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:34:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:08 smithi136 ceph-mon[125702]: pgmap v18449: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:34:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:10 smithi057 ceph-mon[92072]: pgmap v18450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:34:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:10 smithi122 ceph-mon[125440]: pgmap v18450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:34:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:10 smithi136 ceph-mon[125702]: pgmap v18450: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:34:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:12 smithi057 ceph-mon[92072]: pgmap v18451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:34:12.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:12 smithi057 ceph-mon[92072]: osdmap e1226: 12 total, 12 up, 12 in 2023-03-02T20:34:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:12 smithi122 ceph-mon[125440]: pgmap v18451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:34:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:12 smithi122 ceph-mon[125440]: osdmap e1226: 12 total, 12 up, 12 in 2023-03-02T20:34:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:12 smithi136 ceph-mon[125702]: pgmap v18451: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:34:12.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:12 smithi136 ceph-mon[125702]: osdmap e1226: 12 total, 12 up, 12 in 2023-03-02T20:34:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:14 smithi057 ceph-mon[92072]: pgmap v18453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:34:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:14 smithi057 ceph-mon[92072]: osdmap e1227: 12 total, 12 up, 12 in 2023-03-02T20:34:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:14 smithi122 ceph-mon[125440]: pgmap v18453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:34:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:14 smithi122 ceph-mon[125440]: osdmap e1227: 12 total, 12 up, 12 in 2023-03-02T20:34:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:14 smithi136 ceph-mon[125702]: pgmap v18453: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:34:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:14 smithi136 ceph-mon[125702]: osdmap e1227: 12 total, 12 up, 12 in 2023-03-02T20:34:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:15.520+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:34:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:15.520+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:34:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:15.520+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:34:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:15.520+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:34:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:15.520+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:34:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:16 smithi122 ceph-mon[125440]: pgmap v18455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:34:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:16 smithi136 ceph-mon[125702]: pgmap v18455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:34:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:16 smithi057 ceph-mon[92072]: pgmap v18455: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:34:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:18 smithi122 ceph-mon[125440]: pgmap v18456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T20:34:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:18 smithi136 ceph-mon[125702]: pgmap v18456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T20:34:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:18 smithi057 ceph-mon[92072]: pgmap v18456: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T20:34:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:20 smithi122 ceph-mon[125440]: pgmap v18457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T20:34:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:20 smithi136 ceph-mon[125702]: pgmap v18457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T20:34:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:20 smithi057 ceph-mon[92072]: pgmap v18457: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 13 op/s 2023-03-02T20:34:22.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:22 smithi122 ceph-mon[125440]: pgmap v18458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 324 B/s wr, 11 op/s 2023-03-02T20:34:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:22 smithi136 ceph-mon[125702]: pgmap v18458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 324 B/s wr, 11 op/s 2023-03-02T20:34:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:22 smithi057 ceph-mon[92072]: pgmap v18458: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 324 B/s wr, 11 op/s 2023-03-02T20:34:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:24 smithi136 ceph-mon[125702]: pgmap v18459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:34:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:24 smithi057 ceph-mon[92072]: pgmap v18459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:34:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:24 smithi122 ceph-mon[125440]: pgmap v18459: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:34:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:26 smithi136 ceph-mon[125702]: pgmap v18460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 193 B/s wr, 9 op/s 2023-03-02T20:34:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:26 smithi057 ceph-mon[92072]: pgmap v18460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 193 B/s wr, 9 op/s 2023-03-02T20:34:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:26 smithi122 ceph-mon[125440]: pgmap v18460: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 193 B/s wr, 9 op/s 2023-03-02T20:34:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:28 smithi136 ceph-mon[125702]: pgmap v18461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T20:34:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:28 smithi057 ceph-mon[92072]: pgmap v18461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T20:34:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:28 smithi122 ceph-mon[125440]: pgmap v18461: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-02T20:34:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:30.532+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:34:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:30.533+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:34:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:30.533+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:34:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:30.533+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:34:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:30.533+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:34:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:30 smithi136 ceph-mon[125702]: pgmap v18462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T20:34:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:30 smithi057 ceph-mon[92072]: pgmap v18462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T20:34:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:30 smithi122 ceph-mon[125440]: pgmap v18462: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-02T20:34:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:32 smithi136 ceph-mon[125702]: pgmap v18463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:32 smithi057 ceph-mon[92072]: pgmap v18463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:32 smithi122 ceph-mon[125440]: pgmap v18463: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:34 smithi136 ceph-mon[125702]: pgmap v18464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:34 smithi057 ceph-mon[92072]: pgmap v18464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:34 smithi122 ceph-mon[125440]: pgmap v18464: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:36 smithi136 ceph-mon[125702]: pgmap v18465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:36 smithi057 ceph-mon[92072]: pgmap v18465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:36 smithi122 ceph-mon[125440]: pgmap v18465: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:38 smithi136 ceph-mon[125702]: pgmap v18466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:38 smithi057 ceph-mon[92072]: pgmap v18466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:38 smithi122 ceph-mon[125440]: pgmap v18466: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:40 smithi136 ceph-mon[125702]: pgmap v18467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:40 smithi057 ceph-mon[92072]: pgmap v18467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:40 smithi122 ceph-mon[125440]: pgmap v18467: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:42 smithi136 ceph-mon[125702]: pgmap v18468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:42 smithi057 ceph-mon[92072]: pgmap v18468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:42.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:42 smithi122 ceph-mon[125440]: pgmap v18468: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:44 smithi136 ceph-mon[125702]: pgmap v18469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:44 smithi057 ceph-mon[92072]: pgmap v18469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:44 smithi122 ceph-mon[125440]: pgmap v18469: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:45.546+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:34:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:45.546+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:34:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:45.546+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:34:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:45.546+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:34:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:34:45.547+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:34:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:46 smithi136 ceph-mon[125702]: pgmap v18470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:46 smithi057 ceph-mon[92072]: pgmap v18470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:46 smithi122 ceph-mon[125440]: pgmap v18470: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:48 smithi136 ceph-mon[125702]: pgmap v18471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:48 smithi057 ceph-mon[92072]: pgmap v18471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:48 smithi122 ceph-mon[125440]: pgmap v18471: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:50 smithi136 ceph-mon[125702]: pgmap v18472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:50 smithi057 ceph-mon[92072]: pgmap v18472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:50 smithi122 ceph-mon[125440]: pgmap v18472: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:52 smithi136 ceph-mon[125702]: pgmap v18473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:52 smithi057 ceph-mon[92072]: pgmap v18473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:52 smithi122 ceph-mon[125440]: pgmap v18473: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:54 smithi136 ceph-mon[125702]: pgmap v18474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:54 smithi057 ceph-mon[92072]: pgmap v18474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:54 smithi122 ceph-mon[125440]: pgmap v18474: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:34:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:56 smithi136 ceph-mon[125702]: pgmap v18475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:56 smithi057 ceph-mon[92072]: pgmap v18475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:56 smithi122 ceph-mon[125440]: pgmap v18475: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:57.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:34:57 smithi136 ceph-mon[125702]: pgmap v18476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:57.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:34:57 smithi057 ceph-mon[92072]: pgmap v18476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:34:57.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:34:57 smithi122 ceph-mon[125440]: pgmap v18476: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:00.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:00 smithi136 ceph-mon[125702]: pgmap v18477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:00 smithi057 ceph-mon[92072]: pgmap v18477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:00 smithi122 ceph-mon[125440]: pgmap v18477: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:00.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:35:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:00.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:35:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:00.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:35:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:00.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:35:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:00.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:35:02.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:02 smithi136 ceph-mon[125702]: pgmap v18478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:02.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:35:02.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:35:02.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:35:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:02 smithi057 ceph-mon[92072]: pgmap v18478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:35:02.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:35:02.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:35:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:02 smithi122 ceph-mon[125440]: pgmap v18478: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:35:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:35:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:35:03.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:35:03.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:35:03.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:35:03.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:35:03.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:35:03.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:35:03.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:35:03.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:35:03.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:35:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:04 smithi136 ceph-mon[125702]: pgmap v18479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:35:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:04 smithi057 ceph-mon[92072]: pgmap v18479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:35:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:04 smithi122 ceph-mon[125440]: pgmap v18479: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:35:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:06 smithi136 ceph-mon[125702]: pgmap v18480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:35:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:06 smithi057 ceph-mon[92072]: pgmap v18480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:35:06.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:06 smithi122 ceph-mon[125440]: pgmap v18480: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:35:07.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:07 smithi136 ceph-mon[125702]: osdmap e1228: 12 total, 12 up, 12 in 2023-03-02T20:35:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:07 smithi057 ceph-mon[92072]: osdmap e1228: 12 total, 12 up, 12 in 2023-03-02T20:35:07.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:07 smithi122 ceph-mon[125440]: osdmap e1228: 12 total, 12 up, 12 in 2023-03-02T20:35:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:08 smithi136 ceph-mon[125702]: pgmap v18482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:35:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:08 smithi057 ceph-mon[92072]: pgmap v18482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:35:08.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:08 smithi122 ceph-mon[125440]: pgmap v18482: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:35:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:10 smithi136 ceph-mon[125702]: pgmap v18483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:35:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:10 smithi057 ceph-mon[92072]: pgmap v18483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:35:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:10 smithi122 ceph-mon[125440]: pgmap v18483: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:35:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:12 smithi136 ceph-mon[125702]: pgmap v18484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:35:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:12 smithi057 ceph-mon[92072]: pgmap v18484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:35:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:12 smithi122 ceph-mon[125440]: pgmap v18484: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:35:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:13.369+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:35:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:13.369+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:35:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:13.369+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 267 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:35:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:13.369+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 266 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:35:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:14 smithi057 ceph-mon[92072]: pgmap v18485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:35:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:14 smithi057 ceph-mon[92072]: osdmap e1229: 12 total, 12 up, 12 in 2023-03-02T20:35:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:14 smithi122 ceph-mon[125440]: pgmap v18485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:35:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:14 smithi122 ceph-mon[125440]: osdmap e1229: 12 total, 12 up, 12 in 2023-03-02T20:35:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:14 smithi136 ceph-mon[125702]: pgmap v18485: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:35:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:14 smithi136 ceph-mon[125702]: osdmap e1229: 12 total, 12 up, 12 in 2023-03-02T20:35:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:15.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:35:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:15.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:35:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:15.571+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:35:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:15.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:35:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:15.571+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:35:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:16 smithi057 ceph-mon[92072]: pgmap v18487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 11 op/s 2023-03-02T20:35:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:16 smithi122 ceph-mon[125440]: pgmap v18487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 11 op/s 2023-03-02T20:35:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:16 smithi136 ceph-mon[125702]: pgmap v18487: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 11 op/s 2023-03-02T20:35:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:18 smithi057 ceph-mon[92072]: pgmap v18488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:35:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:18 smithi122 ceph-mon[125440]: pgmap v18488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:35:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:18 smithi136 ceph-mon[125702]: pgmap v18488: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:35:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:20 smithi057 ceph-mon[92072]: pgmap v18489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:35:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:20 smithi122 ceph-mon[125440]: pgmap v18489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:35:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:20 smithi136 ceph-mon[125702]: pgmap v18489: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:35:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:22 smithi057 ceph-mon[92072]: pgmap v18490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:35:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:22 smithi122 ceph-mon[125440]: pgmap v18490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:35:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:22 smithi136 ceph-mon[125702]: pgmap v18490: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:35:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:24 smithi057 ceph-mon[92072]: pgmap v18491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:35:24.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:24 smithi122 ceph-mon[125440]: pgmap v18491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:35:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:24 smithi136 ceph-mon[125702]: pgmap v18491: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:35:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:26 smithi057 ceph-mon[92072]: pgmap v18492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:35:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:26 smithi122 ceph-mon[125440]: pgmap v18492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:35:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:26 smithi136 ceph-mon[125702]: pgmap v18492: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:35:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:28 smithi057 ceph-mon[92072]: pgmap v18493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:28.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:28 smithi122 ceph-mon[125440]: pgmap v18493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:28 smithi136 ceph-mon[125702]: pgmap v18493: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:30 smithi057 ceph-mon[92072]: pgmap v18494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:30 smithi122 ceph-mon[125440]: pgmap v18494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:30.580+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:35:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:30.580+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:35:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:30.580+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:35:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:30.580+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:35:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:30.580+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:35:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:30 smithi136 ceph-mon[125702]: pgmap v18494: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:32 smithi057 ceph-mon[92072]: pgmap v18495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:32.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:32 smithi122 ceph-mon[125440]: pgmap v18495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:32 smithi136 ceph-mon[125702]: pgmap v18495: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:34 smithi057 ceph-mon[92072]: pgmap v18496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:34 smithi122 ceph-mon[125440]: pgmap v18496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:34 smithi136 ceph-mon[125702]: pgmap v18496: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:36 smithi057 ceph-mon[92072]: pgmap v18497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:35:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:36 smithi122 ceph-mon[125440]: pgmap v18497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:35:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:36 smithi136 ceph-mon[125702]: pgmap v18497: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:35:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:38 smithi057 ceph-mon[92072]: pgmap v18498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:35:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:38 smithi122 ceph-mon[125440]: pgmap v18498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:35:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:38 smithi136 ceph-mon[125702]: pgmap v18498: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:35:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:40 smithi057 ceph-mon[92072]: pgmap v18499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:40 smithi122 ceph-mon[125440]: pgmap v18499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:40 smithi136 ceph-mon[125702]: pgmap v18499: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:42 smithi057 ceph-mon[92072]: pgmap v18500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:35:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:42 smithi122 ceph-mon[125440]: pgmap v18500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:35:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:42 smithi136 ceph-mon[125702]: pgmap v18500: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:35:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:44 smithi057 ceph-mon[92072]: pgmap v18501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:44 smithi122 ceph-mon[125440]: pgmap v18501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:44 smithi136 ceph-mon[125702]: pgmap v18501: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:35:45.596 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:45.593+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:35:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:45.593+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:35:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:45.593+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:35:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:45.593+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:35:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:35:45.593+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:35:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:46 smithi057 ceph-mon[92072]: pgmap v18502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:46 smithi122 ceph-mon[125440]: pgmap v18502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:46 smithi136 ceph-mon[125702]: pgmap v18502: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:48 smithi057 ceph-mon[92072]: pgmap v18503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:48 smithi122 ceph-mon[125440]: pgmap v18503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:48 smithi136 ceph-mon[125702]: pgmap v18503: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:35:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:50 smithi057 ceph-mon[92072]: pgmap v18504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:35:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:50 smithi122 ceph-mon[125440]: pgmap v18504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:35:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:50 smithi136 ceph-mon[125702]: pgmap v18504: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:35:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:52 smithi057 ceph-mon[92072]: pgmap v18505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T20:35:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:52 smithi122 ceph-mon[125440]: pgmap v18505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T20:35:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:52 smithi136 ceph-mon[125702]: pgmap v18505: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T20:35:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:54 smithi122 ceph-mon[125440]: pgmap v18506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:35:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:54 smithi136 ceph-mon[125702]: pgmap v18506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:35:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:54 smithi057 ceph-mon[92072]: pgmap v18506: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:35:56.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:56 smithi122 ceph-mon[125440]: pgmap v18507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T20:35:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:56 smithi136 ceph-mon[125702]: pgmap v18507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T20:35:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:56 smithi057 ceph-mon[92072]: pgmap v18507: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T20:35:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:35:58 smithi122 ceph-mon[125440]: pgmap v18508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T20:35:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:35:58 smithi136 ceph-mon[125702]: pgmap v18508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T20:35:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:35:58 smithi057 ceph-mon[92072]: pgmap v18508: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-02T20:36:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:00 smithi122 ceph-mon[125440]: pgmap v18509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:36:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:00 smithi136 ceph-mon[125702]: pgmap v18509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:36:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:00.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:36:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:00.602+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:36:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:00.602+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:36:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:00.602+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:36:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:00.602+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:36:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:00 smithi057 ceph-mon[92072]: pgmap v18509: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T20:36:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:02 smithi136 ceph-mon[125702]: pgmap v18510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:02 smithi057 ceph-mon[92072]: pgmap v18510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:02.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:02 smithi122 ceph-mon[125440]: pgmap v18510: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:03.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:36:03.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:03.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:36:03.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:36:03.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:04 smithi136 ceph-mon[125702]: pgmap v18511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:36:04.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:36:04.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:36:04.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:04 smithi057 ceph-mon[92072]: pgmap v18511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:36:04.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:36:04.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:36:04.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:04 smithi122 ceph-mon[125440]: pgmap v18511: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:36:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:36:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:36:04.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:36:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:06 smithi136 ceph-mon[125702]: pgmap v18512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:36:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:06 smithi057 ceph-mon[92072]: pgmap v18512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:36:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:06 smithi122 ceph-mon[125440]: pgmap v18512: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:36:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:07 smithi136 ceph-mon[125702]: osdmap e1230: 12 total, 12 up, 12 in 2023-03-02T20:36:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:07 smithi057 ceph-mon[92072]: osdmap e1230: 12 total, 12 up, 12 in 2023-03-02T20:36:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:07 smithi122 ceph-mon[125440]: osdmap e1230: 12 total, 12 up, 12 in 2023-03-02T20:36:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:08 smithi136 ceph-mon[125702]: pgmap v18514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:36:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:08 smithi057 ceph-mon[92072]: pgmap v18514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:36:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:08 smithi122 ceph-mon[125440]: pgmap v18514: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:36:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:10 smithi136 ceph-mon[125702]: pgmap v18515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:36:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:10 smithi057 ceph-mon[92072]: pgmap v18515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:36:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:10 smithi122 ceph-mon[125440]: pgmap v18515: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:36:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:12 smithi136 ceph-mon[125702]: pgmap v18516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:36:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:12 smithi057 ceph-mon[92072]: pgmap v18516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:36:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:12 smithi122 ceph-mon[125440]: pgmap v18516: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:36:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:14 smithi136 ceph-mon[125702]: pgmap v18517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:36:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:14 smithi136 ceph-mon[125702]: osdmap e1231: 12 total, 12 up, 12 in 2023-03-02T20:36:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:14 smithi057 ceph-mon[92072]: pgmap v18517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:36:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:14 smithi057 ceph-mon[92072]: osdmap e1231: 12 total, 12 up, 12 in 2023-03-02T20:36:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:14 smithi122 ceph-mon[125440]: pgmap v18517: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:36:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:14 smithi122 ceph-mon[125440]: osdmap e1231: 12 total, 12 up, 12 in 2023-03-02T20:36:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:15.603+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:36:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:15.603+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:36:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:15.603+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:36:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:15.603+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:36:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:15.603+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:36:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:16 smithi136 ceph-mon[125702]: pgmap v18519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T20:36:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:16 smithi057 ceph-mon[92072]: pgmap v18519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T20:36:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:16 smithi122 ceph-mon[125440]: pgmap v18519: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T20:36:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:18 smithi136 ceph-mon[125702]: pgmap v18520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:36:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:18 smithi057 ceph-mon[92072]: pgmap v18520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:36:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:18 smithi122 ceph-mon[125440]: pgmap v18520: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:36:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:20 smithi136 ceph-mon[125702]: pgmap v18521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:36:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:20 smithi057 ceph-mon[92072]: pgmap v18521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:36:20.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:20 smithi122 ceph-mon[125440]: pgmap v18521: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:36:22.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:22 smithi136 ceph-mon[125702]: pgmap v18522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:36:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:22 smithi057 ceph-mon[92072]: pgmap v18522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:36:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:22 smithi122 ceph-mon[125440]: pgmap v18522: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:36:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:24 smithi136 ceph-mon[125702]: pgmap v18523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:36:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:24 smithi057 ceph-mon[92072]: pgmap v18523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:36:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:24 smithi122 ceph-mon[125440]: pgmap v18523: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:36:26.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:26 smithi136 ceph-mon[125702]: pgmap v18524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:36:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:26 smithi057 ceph-mon[92072]: pgmap v18524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:36:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:26 smithi122 ceph-mon[125440]: pgmap v18524: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:36:28.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:28 smithi136 ceph-mon[125702]: pgmap v18525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:28 smithi057 ceph-mon[92072]: pgmap v18525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:28 smithi122 ceph-mon[125440]: pgmap v18525: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:30 smithi136 ceph-mon[125702]: pgmap v18526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:36:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:30.611+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:36:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:30.611+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:36:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:30.611+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:36:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:30.611+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:36:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:30.611+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:36:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:30 smithi057 ceph-mon[92072]: pgmap v18526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:36:30.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:30 smithi122 ceph-mon[125440]: pgmap v18526: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:36:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:32 smithi136 ceph-mon[125702]: pgmap v18527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:32 smithi057 ceph-mon[92072]: pgmap v18527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:32 smithi122 ceph-mon[125440]: pgmap v18527: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:34 smithi136 ceph-mon[125702]: pgmap v18528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:34 smithi057 ceph-mon[92072]: pgmap v18528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:34.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:34 smithi122 ceph-mon[125440]: pgmap v18528: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:36 smithi136 ceph-mon[125702]: pgmap v18529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:36:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:36 smithi057 ceph-mon[92072]: pgmap v18529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:36:36.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:36 smithi122 ceph-mon[125440]: pgmap v18529: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:36:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:38 smithi136 ceph-mon[125702]: pgmap v18530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:36:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:38 smithi057 ceph-mon[92072]: pgmap v18530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:36:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:38 smithi122 ceph-mon[125440]: pgmap v18530: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:36:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:40 smithi136 ceph-mon[125702]: pgmap v18531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:40 smithi057 ceph-mon[92072]: pgmap v18531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:40 smithi122 ceph-mon[125440]: pgmap v18531: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:41.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:41 smithi136 ceph-mon[125702]: pgmap v18532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:36:41.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:41 smithi057 ceph-mon[92072]: pgmap v18532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:36:41.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:41 smithi122 ceph-mon[125440]: pgmap v18532: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:36:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:43.382+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:36:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:43.382+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:36:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:43.382+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 268 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:36:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:43.382+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 267 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:36:44.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:43 smithi136 ceph-mon[125702]: pgmap v18533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:43 smithi057 ceph-mon[92072]: pgmap v18533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:44.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:43 smithi122 ceph-mon[125440]: pgmap v18533: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:45.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:36:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:45.626+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:36:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:45.626+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:36:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:45.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:36:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:36:45.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:36:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:46 smithi057 ceph-mon[92072]: pgmap v18534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:46.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:46 smithi122 ceph-mon[125440]: pgmap v18534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:46 smithi136 ceph-mon[125702]: pgmap v18534: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:48 smithi057 ceph-mon[92072]: pgmap v18535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:48.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:48 smithi122 ceph-mon[125440]: pgmap v18535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:48 smithi136 ceph-mon[125702]: pgmap v18535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:50.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:50 smithi057 ceph-mon[92072]: pgmap v18536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:50 smithi122 ceph-mon[125440]: pgmap v18536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:50 smithi136 ceph-mon[125702]: pgmap v18536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:52 smithi057 ceph-mon[92072]: pgmap v18537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:52 smithi122 ceph-mon[125440]: pgmap v18537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:52 smithi136 ceph-mon[125702]: pgmap v18537: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:54 smithi057 ceph-mon[92072]: pgmap v18538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:54 smithi122 ceph-mon[125440]: pgmap v18538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:54 smithi136 ceph-mon[125702]: pgmap v18538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:36:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:56 smithi057 ceph-mon[92072]: pgmap v18539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:56.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:56 smithi122 ceph-mon[125440]: pgmap v18539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:56 smithi136 ceph-mon[125702]: pgmap v18539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:36:58 smithi057 ceph-mon[92072]: pgmap v18540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:36:58 smithi122 ceph-mon[125440]: pgmap v18540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:36:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:36:58 smithi136 ceph-mon[125702]: pgmap v18540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:00 smithi057 ceph-mon[92072]: pgmap v18541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:00 smithi122 ceph-mon[125440]: pgmap v18541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:00 smithi136 ceph-mon[125702]: pgmap v18541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:00.640+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:37:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:00.641+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:37:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:00.641+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:37:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:00.641+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:37:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:00.641+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:37:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:02 smithi057 ceph-mon[92072]: pgmap v18542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:02 smithi122 ceph-mon[125440]: pgmap v18542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:02 smithi136 ceph-mon[125702]: pgmap v18542: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:04 smithi057 ceph-mon[92072]: pgmap v18543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:37:04.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:37:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:04 smithi122 ceph-mon[125440]: pgmap v18543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:37:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:37:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:04 smithi136 ceph-mon[125702]: pgmap v18543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:37:04.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:37:05.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:37:05.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:37:05.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:37:05.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:37:05.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:37:05.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:37:05.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:37:05.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:37:05.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:37:06.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:06 smithi057 ceph-mon[92072]: pgmap v18544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:37:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:06 smithi122 ceph-mon[125440]: pgmap v18544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:37:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:06 smithi136 ceph-mon[125702]: pgmap v18544: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:37:07.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:07 smithi057 ceph-mon[92072]: osdmap e1232: 12 total, 12 up, 12 in 2023-03-02T20:37:07.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:07 smithi122 ceph-mon[125440]: osdmap e1232: 12 total, 12 up, 12 in 2023-03-02T20:37:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:07 smithi136 ceph-mon[125702]: osdmap e1232: 12 total, 12 up, 12 in 2023-03-02T20:37:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:08 smithi057 ceph-mon[92072]: pgmap v18546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:37:08.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:08 smithi122 ceph-mon[125440]: pgmap v18546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:37:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:08 smithi136 ceph-mon[125702]: pgmap v18546: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:37:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:10 smithi057 ceph-mon[92072]: pgmap v18547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:37:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:10 smithi122 ceph-mon[125440]: pgmap v18547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:37:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:10 smithi136 ceph-mon[125702]: pgmap v18547: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:37:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:12 smithi057 ceph-mon[92072]: pgmap v18548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:37:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:12 smithi122 ceph-mon[125440]: pgmap v18548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:37:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:12 smithi136 ceph-mon[125702]: pgmap v18548: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:37:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:14 smithi057 ceph-mon[92072]: pgmap v18549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:37:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:14 smithi057 ceph-mon[92072]: osdmap e1233: 12 total, 12 up, 12 in 2023-03-02T20:37:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:14 smithi122 ceph-mon[125440]: pgmap v18549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:37:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:14 smithi122 ceph-mon[125440]: osdmap e1233: 12 total, 12 up, 12 in 2023-03-02T20:37:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:14 smithi136 ceph-mon[125702]: pgmap v18549: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:37:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:14 smithi136 ceph-mon[125702]: osdmap e1233: 12 total, 12 up, 12 in 2023-03-02T20:37:15.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:15.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:15.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:15.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:37:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:15.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:37:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:15.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:37:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:16 smithi122 ceph-mon[125440]: pgmap v18551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:37:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:16 smithi136 ceph-mon[125702]: pgmap v18551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:37:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:16 smithi057 ceph-mon[92072]: pgmap v18551: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:37:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:18 smithi122 ceph-mon[125440]: pgmap v18552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:37:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:18 smithi136 ceph-mon[125702]: pgmap v18552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:37:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:18 smithi057 ceph-mon[92072]: pgmap v18552: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:37:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:20 smithi136 ceph-mon[125702]: pgmap v18553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:37:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:20 smithi057 ceph-mon[92072]: pgmap v18553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:37:20.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:20 smithi122 ceph-mon[125440]: pgmap v18553: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:37:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:22 smithi136 ceph-mon[125702]: pgmap v18554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:37:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:22 smithi057 ceph-mon[92072]: pgmap v18554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:37:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:22 smithi122 ceph-mon[125440]: pgmap v18554: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:37:24.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:24 smithi136 ceph-mon[125702]: pgmap v18555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:37:24.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:24 smithi057 ceph-mon[92072]: pgmap v18555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:37:24.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:24 smithi122 ceph-mon[125440]: pgmap v18555: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:37:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:26 smithi136 ceph-mon[125702]: pgmap v18556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:37:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:26 smithi057 ceph-mon[92072]: pgmap v18556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:37:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:26 smithi122 ceph-mon[125440]: pgmap v18556: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:37:28.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:28 smithi136 ceph-mon[125702]: pgmap v18557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T20:37:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:28 smithi057 ceph-mon[92072]: pgmap v18557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T20:37:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:28 smithi122 ceph-mon[125440]: pgmap v18557: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-02T20:37:30.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:30 smithi136 ceph-mon[125702]: pgmap v18558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:37:30.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:30.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:37:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:30.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:37:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:30.650+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:37:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:30.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:37:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:30.650+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:37:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:30 smithi057 ceph-mon[92072]: pgmap v18558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:37:30.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:30 smithi122 ceph-mon[125440]: pgmap v18558: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:37:32.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:32 smithi136 ceph-mon[125702]: pgmap v18559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:32 smithi057 ceph-mon[92072]: pgmap v18559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:32 smithi122 ceph-mon[125440]: pgmap v18559: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:34 smithi136 ceph-mon[125702]: pgmap v18560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:34 smithi057 ceph-mon[92072]: pgmap v18560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:34.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:34 smithi122 ceph-mon[125440]: pgmap v18560: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:36.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:36 smithi136 ceph-mon[125702]: pgmap v18561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:37:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:36 smithi057 ceph-mon[92072]: pgmap v18561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:37:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:36 smithi122 ceph-mon[125440]: pgmap v18561: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:37:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:38 smithi136 ceph-mon[125702]: pgmap v18562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T20:37:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:38 smithi057 ceph-mon[92072]: pgmap v18562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T20:37:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:38 smithi122 ceph-mon[125440]: pgmap v18562: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-02T20:37:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:40 smithi136 ceph-mon[125702]: pgmap v18563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T20:37:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:40 smithi057 ceph-mon[92072]: pgmap v18563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T20:37:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:40 smithi122 ceph-mon[125440]: pgmap v18563: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-02T20:37:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:42 smithi136 ceph-mon[125702]: pgmap v18564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:37:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:42 smithi057 ceph-mon[92072]: pgmap v18564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:37:42.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:42 smithi122 ceph-mon[125440]: pgmap v18564: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:37:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:44 smithi136 ceph-mon[125702]: pgmap v18565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:44 smithi057 ceph-mon[92072]: pgmap v18565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:44 smithi122 ceph-mon[125440]: pgmap v18565: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:45.666+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:37:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:45.666+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:37:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:45.666+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:37:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:45.666+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:37:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:37:45.666+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:37:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:46 smithi136 ceph-mon[125702]: pgmap v18566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:46 smithi057 ceph-mon[92072]: pgmap v18566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:46 smithi122 ceph-mon[125440]: pgmap v18566: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:48.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:48 smithi136 ceph-mon[125702]: pgmap v18567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:37:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:48 smithi057 ceph-mon[92072]: pgmap v18567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:37:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:48 smithi122 ceph-mon[125440]: pgmap v18567: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:37:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:50 smithi136 ceph-mon[125702]: pgmap v18568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T20:37:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:50 smithi057 ceph-mon[92072]: pgmap v18568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T20:37:50.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:50 smithi122 ceph-mon[125440]: pgmap v18568: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T20:37:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:52 smithi136 ceph-mon[125702]: pgmap v18569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:52 smithi057 ceph-mon[92072]: pgmap v18569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:52 smithi122 ceph-mon[125440]: pgmap v18569: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:54 smithi136 ceph-mon[125702]: pgmap v18570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:54 smithi057 ceph-mon[92072]: pgmap v18570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:54 smithi122 ceph-mon[125440]: pgmap v18570: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:37:56.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:56 smithi136 ceph-mon[125702]: pgmap v18571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:56 smithi057 ceph-mon[92072]: pgmap v18571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:56 smithi122 ceph-mon[125440]: pgmap v18571: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:37:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:37:58 smithi136 ceph-mon[125702]: pgmap v18572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:37:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:37:58 smithi057 ceph-mon[92072]: pgmap v18572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:37:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:37:58 smithi122 ceph-mon[125440]: pgmap v18572: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:38:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:00 smithi136 ceph-mon[125702]: pgmap v18573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:00 smithi057 ceph-mon[92072]: pgmap v18573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:00.681+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:38:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:00.681+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:38:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:00.681+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:38:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:00.681+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:38:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:00.681+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:38:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:00 smithi122 ceph-mon[125440]: pgmap v18573: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:02 smithi136 ceph-mon[125702]: pgmap v18574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:02 smithi057 ceph-mon[92072]: pgmap v18574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:02 smithi122 ceph-mon[125440]: pgmap v18574: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:04.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:04 smithi136 ceph-mon[125702]: pgmap v18575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:38:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:04 smithi057 ceph-mon[92072]: pgmap v18575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:38:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:04 smithi122 ceph-mon[125440]: pgmap v18575: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:38:05.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:38:05.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:38:05.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:38:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:06 smithi136 ceph-mon[125702]: pgmap v18576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:38:06.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:38:06.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:38:06.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:38:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:06 smithi057 ceph-mon[92072]: pgmap v18576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:38:06.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:38:06.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:38:06.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:38:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:06 smithi122 ceph-mon[125440]: pgmap v18576: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:38:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:38:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:38:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:38:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:07 smithi057 ceph-mon[92072]: osdmap e1234: 12 total, 12 up, 12 in 2023-03-02T20:38:07.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:07 smithi057 ceph-mon[92072]: pgmap v18578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:38:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:07 smithi122 ceph-mon[125440]: osdmap e1234: 12 total, 12 up, 12 in 2023-03-02T20:38:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:07 smithi122 ceph-mon[125440]: pgmap v18578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:38:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:07 smithi136 ceph-mon[125702]: osdmap e1234: 12 total, 12 up, 12 in 2023-03-02T20:38:08.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:07 smithi136 ceph-mon[125702]: pgmap v18578: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:38:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:10 smithi057 ceph-mon[92072]: pgmap v18579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:38:10.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:10 smithi122 ceph-mon[125440]: pgmap v18579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:38:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:10 smithi136 ceph-mon[125702]: pgmap v18579: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:38:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:12 smithi057 ceph-mon[92072]: pgmap v18580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:38:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:12 smithi122 ceph-mon[125440]: pgmap v18580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:38:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:12 smithi136 ceph-mon[125702]: pgmap v18580: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:38:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:13.395+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:38:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:13.395+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:38:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:13.396+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 269 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:38:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:13.396+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 268 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:38:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:14 smithi057 ceph-mon[92072]: pgmap v18581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:38:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:14 smithi122 ceph-mon[125440]: pgmap v18581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:38:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:14 smithi136 ceph-mon[125702]: pgmap v18581: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:38:15.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:15 smithi057 ceph-mon[92072]: osdmap e1235: 12 total, 12 up, 12 in 2023-03-02T20:38:15.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:15 smithi122 ceph-mon[125440]: osdmap e1235: 12 total, 12 up, 12 in 2023-03-02T20:38:15.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:15 smithi136 ceph-mon[125702]: osdmap e1235: 12 total, 12 up, 12 in 2023-03-02T20:38:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:15.696+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:38:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:15.696+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:38:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:15.696+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:38:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:15.696+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:38:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:15.696+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:38:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:16 smithi057 ceph-mon[92072]: pgmap v18583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 254 B/s wr, 12 op/s 2023-03-02T20:38:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:16 smithi122 ceph-mon[125440]: pgmap v18583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 254 B/s wr, 12 op/s 2023-03-02T20:38:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:16 smithi136 ceph-mon[125702]: pgmap v18583: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 254 B/s wr, 12 op/s 2023-03-02T20:38:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:18 smithi057 ceph-mon[92072]: pgmap v18584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:38:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:18 smithi122 ceph-mon[125440]: pgmap v18584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:38:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:18 smithi136 ceph-mon[125702]: pgmap v18584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:38:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:20 smithi057 ceph-mon[92072]: pgmap v18585: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:38:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:20 smithi122 ceph-mon[125440]: pgmap v18585: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:38:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:20 smithi136 ceph-mon[125702]: pgmap v18585: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:38:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:22 smithi057 ceph-mon[92072]: pgmap v18586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:38:22.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:22 smithi122 ceph-mon[125440]: pgmap v18586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:38:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:22 smithi136 ceph-mon[125702]: pgmap v18586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:38:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:24 smithi057 ceph-mon[92072]: pgmap v18587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:38:24.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:24 smithi122 ceph-mon[125440]: pgmap v18587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:38:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:24 smithi136 ceph-mon[125702]: pgmap v18587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:38:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:26 smithi057 ceph-mon[92072]: pgmap v18588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:38:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:26 smithi122 ceph-mon[125440]: pgmap v18588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:38:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:26 smithi136 ceph-mon[125702]: pgmap v18588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:38:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:28 smithi057 ceph-mon[92072]: pgmap v18589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-03-02T20:38:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:28 smithi122 ceph-mon[125440]: pgmap v18589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-03-02T20:38:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:28 smithi136 ceph-mon[125702]: pgmap v18589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-03-02T20:38:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:30 smithi057 ceph-mon[92072]: pgmap v18590: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:30 smithi122 ceph-mon[125440]: pgmap v18590: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:30 smithi136 ceph-mon[125702]: pgmap v18590: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:30.712+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:38:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:30.712+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:38:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:30.712+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:38:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:30.712+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:38:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:30.712+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:38:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:32 smithi057 ceph-mon[92072]: pgmap v18591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:32 smithi122 ceph-mon[125440]: pgmap v18591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:32 smithi136 ceph-mon[125702]: pgmap v18591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:34 smithi122 ceph-mon[125440]: pgmap v18592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:38:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:34 smithi136 ceph-mon[125702]: pgmap v18592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:38:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:34 smithi057 ceph-mon[92072]: pgmap v18592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:38:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:36 smithi122 ceph-mon[125440]: pgmap v18593: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:36 smithi136 ceph-mon[125702]: pgmap v18593: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:36 smithi057 ceph-mon[92072]: pgmap v18593: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:38 smithi136 ceph-mon[125702]: pgmap v18594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:38:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:38 smithi057 ceph-mon[92072]: pgmap v18594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:38:38.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:38 smithi122 ceph-mon[125440]: pgmap v18594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:38:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:40 smithi136 ceph-mon[125702]: pgmap v18595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:40 smithi057 ceph-mon[92072]: pgmap v18595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:40.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:40 smithi122 ceph-mon[125440]: pgmap v18595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:42 smithi136 ceph-mon[125702]: pgmap v18596: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:42 smithi057 ceph-mon[92072]: pgmap v18596: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:42.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:42 smithi122 ceph-mon[125440]: pgmap v18596: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:44 smithi136 ceph-mon[125702]: pgmap v18597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:38:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:44 smithi057 ceph-mon[92072]: pgmap v18597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:38:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:44 smithi122 ceph-mon[125440]: pgmap v18597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:38:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:45.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:38:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:45.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:38:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:45.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:38:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:45.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:38:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:38:45.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:38:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:46 smithi136 ceph-mon[125702]: pgmap v18598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:46 smithi057 ceph-mon[92072]: pgmap v18598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:46 smithi122 ceph-mon[125440]: pgmap v18598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:48 smithi136 ceph-mon[125702]: pgmap v18599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:38:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:48 smithi057 ceph-mon[92072]: pgmap v18599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:38:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:48 smithi122 ceph-mon[125440]: pgmap v18599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:38:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:50 smithi136 ceph-mon[125702]: pgmap v18600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:50 smithi057 ceph-mon[92072]: pgmap v18600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:50 smithi122 ceph-mon[125440]: pgmap v18600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:38:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:52 smithi136 ceph-mon[125702]: pgmap v18601: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:52 smithi057 ceph-mon[92072]: pgmap v18601: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:52 smithi122 ceph-mon[125440]: pgmap v18601: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:54 smithi136 ceph-mon[125702]: pgmap v18602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:38:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:54 smithi057 ceph-mon[92072]: pgmap v18602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:38:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:54 smithi122 ceph-mon[125440]: pgmap v18602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:38:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:56 smithi136 ceph-mon[125702]: pgmap v18603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:56 smithi057 ceph-mon[92072]: pgmap v18603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:56 smithi122 ceph-mon[125440]: pgmap v18603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:38:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:38:58 smithi136 ceph-mon[125702]: pgmap v18604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:38:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:38:58 smithi057 ceph-mon[92072]: pgmap v18604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:38:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:38:58 smithi122 ceph-mon[125440]: pgmap v18604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:39:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:00 smithi136 ceph-mon[125702]: pgmap v18605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:00 smithi057 ceph-mon[92072]: pgmap v18605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:00 smithi122 ceph-mon[125440]: pgmap v18605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:00.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:39:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:00.743+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:39:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:00.743+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:39:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:00.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:39:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:00.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:39:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:02 smithi136 ceph-mon[125702]: pgmap v18606: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:02 smithi057 ceph-mon[92072]: pgmap v18606: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:02 smithi122 ceph-mon[125440]: pgmap v18606: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:04 smithi136 ceph-mon[125702]: pgmap v18607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:39:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:04 smithi057 ceph-mon[92072]: pgmap v18607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:39:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:04 smithi122 ceph-mon[125440]: pgmap v18607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:39:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:06 smithi136 ceph-mon[125702]: pgmap v18608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:39:06.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:39:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:06 smithi057 ceph-mon[92072]: pgmap v18608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:39:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:39:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:06 smithi122 ceph-mon[125440]: pgmap v18608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:39:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:39:07.554 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:07 smithi057 ceph-mon[92072]: osdmap e1236: 12 total, 12 up, 12 in 2023-03-02T20:39:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:07 smithi136 ceph-mon[125702]: osdmap e1236: 12 total, 12 up, 12 in 2023-03-02T20:39:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:07 smithi122 ceph-mon[125440]: osdmap e1236: 12 total, 12 up, 12 in 2023-03-02T20:39:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:08 smithi057 ceph-mon[92072]: pgmap v18610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:39:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:08 smithi136 ceph-mon[125702]: pgmap v18610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:39:08.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:08 smithi122 ceph-mon[125440]: pgmap v18610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:39:10.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:10 smithi136 ceph-mon[125702]: pgmap v18611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:39:10.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:39:10.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:39:10.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:39:10.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:39:10.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:39:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:10 smithi057 ceph-mon[92072]: pgmap v18611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:39:10.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:39:10.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:39:10.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:39:10.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:39:10.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:39:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:10 smithi122 ceph-mon[125440]: pgmap v18611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:39:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:39:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:39:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:39:10.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:39:10.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:39:12.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:12 smithi136 ceph-mon[125702]: pgmap v18612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:39:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:12 smithi057 ceph-mon[92072]: pgmap v18612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:39:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:12 smithi122 ceph-mon[125440]: pgmap v18612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:39:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:14 smithi136 ceph-mon[125702]: pgmap v18613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:39:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:14 smithi136 ceph-mon[125702]: osdmap e1237: 12 total, 12 up, 12 in 2023-03-02T20:39:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:14 smithi057 ceph-mon[92072]: pgmap v18613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:39:14.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:14 smithi057 ceph-mon[92072]: osdmap e1237: 12 total, 12 up, 12 in 2023-03-02T20:39:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:14 smithi122 ceph-mon[125440]: pgmap v18613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:39:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:14 smithi122 ceph-mon[125440]: osdmap e1237: 12 total, 12 up, 12 in 2023-03-02T20:39:15.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:15.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:39:15.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:15.754+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:39:15.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:15.754+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:39:15.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:15.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:39:15.758 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:15.754+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:39:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:16 smithi136 ceph-mon[125702]: pgmap v18615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T20:39:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:16 smithi057 ceph-mon[92072]: pgmap v18615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T20:39:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:16 smithi122 ceph-mon[125440]: pgmap v18615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T20:39:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:18 smithi136 ceph-mon[125702]: pgmap v18616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:39:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:18 smithi057 ceph-mon[92072]: pgmap v18616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:39:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:18 smithi122 ceph-mon[125440]: pgmap v18616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:39:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:20 smithi136 ceph-mon[125702]: pgmap v18617: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:39:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:20 smithi057 ceph-mon[92072]: pgmap v18617: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:39:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:20 smithi122 ceph-mon[125440]: pgmap v18617: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:39:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:22 smithi136 ceph-mon[125702]: pgmap v18618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:39:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:22 smithi057 ceph-mon[92072]: pgmap v18618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:39:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:22 smithi122 ceph-mon[125440]: pgmap v18618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:39:23.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:23 smithi057 ceph-mon[92072]: pgmap v18619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:39:23.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:23 smithi122 ceph-mon[125440]: pgmap v18619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:39:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:23 smithi136 ceph-mon[125702]: pgmap v18619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:39:26.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:26 smithi057 ceph-mon[92072]: pgmap v18620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:39:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:26 smithi122 ceph-mon[125440]: pgmap v18620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:39:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:26 smithi136 ceph-mon[125702]: pgmap v18620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:39:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:28 smithi057 ceph-mon[92072]: pgmap v18621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-03-02T20:39:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:28 smithi122 ceph-mon[125440]: pgmap v18621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-03-02T20:39:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:28 smithi136 ceph-mon[125702]: pgmap v18621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-03-02T20:39:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:30 smithi057 ceph-mon[92072]: pgmap v18622: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:30 smithi122 ceph-mon[125440]: pgmap v18622: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:30 smithi136 ceph-mon[125702]: pgmap v18622: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:30.762+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:39:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:30.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:39:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:30.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:39:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:30.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:39:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:30.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:39:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:32 smithi057 ceph-mon[92072]: pgmap v18623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:32 smithi122 ceph-mon[125440]: pgmap v18623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:32 smithi136 ceph-mon[125702]: pgmap v18623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:34 smithi057 ceph-mon[92072]: pgmap v18624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:39:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:34 smithi122 ceph-mon[125440]: pgmap v18624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:39:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:34 smithi136 ceph-mon[125702]: pgmap v18624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:39:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:36 smithi057 ceph-mon[92072]: pgmap v18625: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:36 smithi122 ceph-mon[125440]: pgmap v18625: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:36 smithi136 ceph-mon[125702]: pgmap v18625: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:38 smithi057 ceph-mon[92072]: pgmap v18626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:39:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:38 smithi122 ceph-mon[125440]: pgmap v18626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:39:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:38 smithi136 ceph-mon[125702]: pgmap v18626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:39:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:40 smithi057 ceph-mon[92072]: pgmap v18627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:40 smithi122 ceph-mon[125440]: pgmap v18627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:40 smithi136 ceph-mon[125702]: pgmap v18627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:42 smithi057 ceph-mon[92072]: pgmap v18628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:42 smithi122 ceph-mon[125440]: pgmap v18628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:42 smithi136 ceph-mon[125702]: pgmap v18628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:44 smithi057 ceph-mon[92072]: pgmap v18629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:39:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:44 smithi122 ceph-mon[125440]: pgmap v18629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:39:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:44 smithi136 ceph-mon[125702]: pgmap v18629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:45.778+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:45.779+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:45.779+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:45.779+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:39:45.779+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:39:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:46 smithi122 ceph-mon[125440]: pgmap v18630: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:46 smithi136 ceph-mon[125702]: pgmap v18630: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:46 smithi057 ceph-mon[92072]: pgmap v18630: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:48 smithi122 ceph-mon[125440]: pgmap v18631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:39:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:48 smithi136 ceph-mon[125702]: pgmap v18631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:39:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:48 smithi057 ceph-mon[92072]: pgmap v18631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:39:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:50 smithi122 ceph-mon[125440]: pgmap v18632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:50 smithi136 ceph-mon[125702]: pgmap v18632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:50 smithi057 ceph-mon[92072]: pgmap v18632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:39:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:52 smithi122 ceph-mon[125440]: pgmap v18633: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:52 smithi136 ceph-mon[125702]: pgmap v18633: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:52 smithi057 ceph-mon[92072]: pgmap v18633: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:54 smithi136 ceph-mon[125702]: pgmap v18634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:39:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:54 smithi057 ceph-mon[92072]: pgmap v18634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:39:54.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:54 smithi122 ceph-mon[125440]: pgmap v18634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:39:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:56 smithi136 ceph-mon[125702]: pgmap v18635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:56 smithi057 ceph-mon[92072]: pgmap v18635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:56.776 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:56 smithi122 ceph-mon[125440]: pgmap v18635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:39:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:39:58 smithi136 ceph-mon[125702]: pgmap v18636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:39:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:39:58 smithi057 ceph-mon[92072]: pgmap v18636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:39:58.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:39:58 smithi122 ceph-mon[125440]: pgmap v18636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:40:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:00 smithi136 ceph-mon[125702]: pgmap v18637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:40:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T20:40:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:00 smithi057 ceph-mon[92072]: pgmap v18637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:40:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T20:40:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:00 smithi122 ceph-mon[125440]: pgmap v18637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:40:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T20:40:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:00.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:40:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:00.783+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:40:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:00.783+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:40:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:00.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:40:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:00.783+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:40:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:02 smithi136 ceph-mon[125702]: pgmap v18638: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:02 smithi057 ceph-mon[92072]: pgmap v18638: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:02 smithi122 ceph-mon[125440]: pgmap v18638: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:04.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:04 smithi136 ceph-mon[125702]: pgmap v18639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:40:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:04 smithi057 ceph-mon[92072]: pgmap v18639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:40:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:04 smithi122 ceph-mon[125440]: pgmap v18639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:40:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:06 smithi136 ceph-mon[125702]: pgmap v18640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:40:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:06 smithi057 ceph-mon[92072]: pgmap v18640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:40:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:06 smithi122 ceph-mon[125440]: pgmap v18640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:40:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:08 smithi136 ceph-mon[125702]: pgmap v18641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T20:40:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:08 smithi057 ceph-mon[92072]: pgmap v18641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T20:40:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:08 smithi122 ceph-mon[125440]: pgmap v18641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T20:40:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:10 smithi057 ceph-mon[92072]: pgmap v18642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T20:40:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:40:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:10 smithi136 ceph-mon[125702]: pgmap v18642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T20:40:10.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:40:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:10 smithi122 ceph-mon[125440]: pgmap v18642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T20:40:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:40:12.265 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:12 smithi136 ceph-mon[125702]: pgmap v18643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:40:12.265 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:12 smithi136 ceph-mon[125702]: osdmap e1238: 12 total, 12 up, 12 in 2023-03-02T20:40:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:12 smithi122 ceph-mon[125440]: pgmap v18643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:40:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:12 smithi122 ceph-mon[125440]: osdmap e1238: 12 total, 12 up, 12 in 2023-03-02T20:40:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:12 smithi057 ceph-mon[92072]: pgmap v18643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:40:12.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:12 smithi057 ceph-mon[92072]: osdmap e1238: 12 total, 12 up, 12 in 2023-03-02T20:40:14.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:14 smithi057 ceph-mon[92072]: pgmap v18645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:40:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:40:14.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:14 smithi122 ceph-mon[125440]: pgmap v18645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:40:14.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:40:14.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:14 smithi136 ceph-mon[125702]: pgmap v18645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:40:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:40:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:40:15.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:15.795+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:40:15.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:15.796+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:40:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:15.796+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:40:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:15.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:40:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:15.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:40:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:16 smithi057 ceph-mon[92072]: pgmap v18646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:16.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:16 smithi122 ceph-mon[125440]: pgmap v18646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:16 smithi136 ceph-mon[125702]: pgmap v18646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:18 smithi057 ceph-mon[92072]: pgmap v18647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:40:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:18 smithi122 ceph-mon[125440]: pgmap v18647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:40:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:18 smithi136 ceph-mon[125702]: pgmap v18647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:40:20.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:20 smithi057 ceph-mon[92072]: pgmap v18648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:40:20.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:20 smithi057 ceph-mon[92072]: osdmap e1239: 12 total, 12 up, 12 in 2023-03-02T20:40:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:20 smithi122 ceph-mon[125440]: pgmap v18648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:40:20.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:20 smithi122 ceph-mon[125440]: osdmap e1239: 12 total, 12 up, 12 in 2023-03-02T20:40:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:20 smithi136 ceph-mon[125702]: pgmap v18648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:40:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:20 smithi136 ceph-mon[125702]: osdmap e1239: 12 total, 12 up, 12 in 2023-03-02T20:40:22.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:22 smithi057 ceph-mon[92072]: pgmap v18650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 323 B/s wr, 11 op/s 2023-03-02T20:40:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:22 smithi122 ceph-mon[125440]: pgmap v18650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 323 B/s wr, 11 op/s 2023-03-02T20:40:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:22 smithi136 ceph-mon[125702]: pgmap v18650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 323 B/s wr, 11 op/s 2023-03-02T20:40:24.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:24 smithi057 ceph-mon[92072]: pgmap v18651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:24.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:24 smithi122 ceph-mon[125440]: pgmap v18651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:24 smithi136 ceph-mon[125702]: pgmap v18651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:26.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:26 smithi057 ceph-mon[92072]: pgmap v18652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:26.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:26 smithi122 ceph-mon[125440]: pgmap v18652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:26 smithi136 ceph-mon[125702]: pgmap v18652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:40:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:28 smithi057 ceph-mon[92072]: pgmap v18653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:40:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:28 smithi122 ceph-mon[125440]: pgmap v18653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:40:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:28 smithi136 ceph-mon[125702]: pgmap v18653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:40:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:30 smithi057 ceph-mon[92072]: pgmap v18654: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:40:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:30 smithi122 ceph-mon[125440]: pgmap v18654: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:40:30.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:30 smithi136 ceph-mon[125702]: pgmap v18654: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:40:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:30.804+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:40:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:30.805+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:40:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:30.805+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:40:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:30.805+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:40:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:30.805+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:40:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:32 smithi057 ceph-mon[92072]: pgmap v18655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T20:40:32.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:32 smithi122 ceph-mon[125440]: pgmap v18655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T20:40:32.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:32 smithi136 ceph-mon[125702]: pgmap v18655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-02T20:40:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:34 smithi122 ceph-mon[125440]: pgmap v18656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:40:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:34 smithi136 ceph-mon[125702]: pgmap v18656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:40:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:34 smithi057 ceph-mon[92072]: pgmap v18656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:40:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:36 smithi122 ceph-mon[125440]: pgmap v18657: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:36 smithi136 ceph-mon[125702]: pgmap v18657: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:36 smithi057 ceph-mon[92072]: pgmap v18657: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:38 smithi136 ceph-mon[125702]: pgmap v18658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:40:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:38 smithi057 ceph-mon[92072]: pgmap v18658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:40:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:38 smithi122 ceph-mon[125440]: pgmap v18658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:40:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:40 smithi136 ceph-mon[125702]: pgmap v18659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:40:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:40 smithi057 ceph-mon[92072]: pgmap v18659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:40:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:40 smithi122 ceph-mon[125440]: pgmap v18659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:40:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:42 smithi136 ceph-mon[125702]: pgmap v18660: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:42 smithi057 ceph-mon[92072]: pgmap v18660: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:42.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:42 smithi122 ceph-mon[125440]: pgmap v18660: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:44 smithi136 ceph-mon[125702]: pgmap v18661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:40:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:44 smithi057 ceph-mon[92072]: pgmap v18661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:40:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:44 smithi122 ceph-mon[125440]: pgmap v18661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:40:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:45.816+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:40:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:45.816+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:40:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:45.816+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:40:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:45.816+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:40:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:40:45.816+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:40:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:46 smithi136 ceph-mon[125702]: pgmap v18662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:46 smithi057 ceph-mon[92072]: pgmap v18662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:46 smithi122 ceph-mon[125440]: pgmap v18662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:48 smithi136 ceph-mon[125702]: pgmap v18663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:40:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:48 smithi057 ceph-mon[92072]: pgmap v18663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:40:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:48 smithi122 ceph-mon[125440]: pgmap v18663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:40:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:50 smithi136 ceph-mon[125702]: pgmap v18664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:40:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:50 smithi057 ceph-mon[92072]: pgmap v18664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:40:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:50 smithi122 ceph-mon[125440]: pgmap v18664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:40:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:52 smithi136 ceph-mon[125702]: pgmap v18665: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:52 smithi057 ceph-mon[92072]: pgmap v18665: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:52.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:52 smithi122 ceph-mon[125440]: pgmap v18665: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:54 smithi136 ceph-mon[125702]: pgmap v18666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:40:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:54 smithi057 ceph-mon[92072]: pgmap v18666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:40:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:54 smithi122 ceph-mon[125440]: pgmap v18666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:40:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:56 smithi136 ceph-mon[125702]: pgmap v18667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:56 smithi057 ceph-mon[92072]: pgmap v18667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:56 smithi122 ceph-mon[125440]: pgmap v18667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:40:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:40:58 smithi136 ceph-mon[125702]: pgmap v18668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:40:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:40:58 smithi057 ceph-mon[92072]: pgmap v18668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:40:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:40:58 smithi122 ceph-mon[125440]: pgmap v18668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:00 smithi136 ceph-mon[125702]: pgmap v18669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:00 smithi057 ceph-mon[92072]: pgmap v18669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:00 smithi122 ceph-mon[125440]: pgmap v18669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:00.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:41:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:00.819+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:41:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:00.819+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:41:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:00.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:41:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:00.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:41:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:02 smithi136 ceph-mon[125702]: pgmap v18670: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:02 smithi057 ceph-mon[92072]: pgmap v18670: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:02 smithi122 ceph-mon[125440]: pgmap v18670: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:04 smithi136 ceph-mon[125702]: pgmap v18671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:41:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:04 smithi057 ceph-mon[92072]: pgmap v18671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:41:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:04 smithi122 ceph-mon[125440]: pgmap v18671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:41:06.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:06 smithi136 ceph-mon[125702]: pgmap v18672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:41:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:06 smithi057 ceph-mon[92072]: pgmap v18672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:41:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:06 smithi122 ceph-mon[125440]: pgmap v18672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:41:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:07 smithi136 ceph-mon[125702]: osdmap e1240: 12 total, 12 up, 12 in 2023-03-02T20:41:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:07 smithi057 ceph-mon[92072]: osdmap e1240: 12 total, 12 up, 12 in 2023-03-02T20:41:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:07 smithi122 ceph-mon[125440]: osdmap e1240: 12 total, 12 up, 12 in 2023-03-02T20:41:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:08 smithi136 ceph-mon[125702]: pgmap v18674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:41:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:08 smithi057 ceph-mon[92072]: pgmap v18674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:41:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:08 smithi122 ceph-mon[125440]: pgmap v18674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:41:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:10 smithi136 ceph-mon[125702]: pgmap v18675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:41:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:10 smithi057 ceph-mon[92072]: pgmap v18675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:41:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:10 smithi122 ceph-mon[125440]: pgmap v18675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:41:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:12 smithi136 ceph-mon[125702]: pgmap v18676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:41:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:12 smithi057 ceph-mon[92072]: pgmap v18676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:41:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:12 smithi122 ceph-mon[125440]: pgmap v18676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:41:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:13.421+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:41:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:13.421+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:41:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:13.421+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 270 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:41:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:13.421+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 269 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:41:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:14 smithi136 ceph-mon[125702]: pgmap v18677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:41:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:41:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:14 smithi136 ceph-mon[125702]: osdmap e1241: 12 total, 12 up, 12 in 2023-03-02T20:41:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:41:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:41:14.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:41:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:14 smithi057 ceph-mon[92072]: pgmap v18677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:41:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:41:14.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:14 smithi057 ceph-mon[92072]: osdmap e1241: 12 total, 12 up, 12 in 2023-03-02T20:41:14.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:41:14.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:41:14.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:41:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:14 smithi122 ceph-mon[125440]: pgmap v18677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:41:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:41:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:14 smithi122 ceph-mon[125440]: osdmap e1241: 12 total, 12 up, 12 in 2023-03-02T20:41:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:41:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:41:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:41:15.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:15.821+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:41:15.825 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:15.822+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:41:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:15.822+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:41:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:15.822+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:41:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:15.822+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:41:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:16 smithi136 ceph-mon[125702]: pgmap v18679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:41:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:16 smithi057 ceph-mon[92072]: pgmap v18679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:41:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:16 smithi122 ceph-mon[125440]: pgmap v18679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:41:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:18 smithi136 ceph-mon[125702]: pgmap v18680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:41:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:18 smithi057 ceph-mon[92072]: pgmap v18680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:41:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:18 smithi122 ceph-mon[125440]: pgmap v18680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:41:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:20 smithi136 ceph-mon[125702]: pgmap v18681: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:41:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:20 smithi057 ceph-mon[92072]: pgmap v18681: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:41:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:20 smithi122 ceph-mon[125440]: pgmap v18681: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:41:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:22 smithi136 ceph-mon[125702]: pgmap v18682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:41:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:22 smithi057 ceph-mon[92072]: pgmap v18682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:41:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:22 smithi122 ceph-mon[125440]: pgmap v18682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:41:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:24 smithi136 ceph-mon[125702]: pgmap v18683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:41:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:24 smithi057 ceph-mon[92072]: pgmap v18683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:41:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:24 smithi122 ceph-mon[125440]: pgmap v18683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:41:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:26 smithi136 ceph-mon[125702]: pgmap v18684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:41:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:26 smithi057 ceph-mon[92072]: pgmap v18684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:41:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:26 smithi122 ceph-mon[125440]: pgmap v18684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:41:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:28 smithi136 ceph-mon[125702]: pgmap v18685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:28 smithi057 ceph-mon[92072]: pgmap v18685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:28 smithi122 ceph-mon[125440]: pgmap v18685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:30 smithi057 ceph-mon[92072]: pgmap v18686: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:30 smithi122 ceph-mon[125440]: pgmap v18686: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:30.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:41:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:30.833+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:41:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:30.833+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:41:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:30.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:41:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:30.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:41:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:30 smithi136 ceph-mon[125702]: pgmap v18686: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:32 smithi057 ceph-mon[92072]: pgmap v18687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:32 smithi122 ceph-mon[125440]: pgmap v18687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:32 smithi136 ceph-mon[125702]: pgmap v18687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:34 smithi057 ceph-mon[92072]: pgmap v18688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:41:34.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:34 smithi122 ceph-mon[125440]: pgmap v18688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:41:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:34 smithi136 ceph-mon[125702]: pgmap v18688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:41:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:36 smithi057 ceph-mon[92072]: pgmap v18689: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:36 smithi122 ceph-mon[125440]: pgmap v18689: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:36 smithi136 ceph-mon[125702]: pgmap v18689: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:38 smithi057 ceph-mon[92072]: pgmap v18690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:38.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:38 smithi122 ceph-mon[125440]: pgmap v18690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:38 smithi136 ceph-mon[125702]: pgmap v18690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:40 smithi057 ceph-mon[92072]: pgmap v18691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:40 smithi122 ceph-mon[125440]: pgmap v18691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:40 smithi136 ceph-mon[125702]: pgmap v18691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:42 smithi057 ceph-mon[92072]: pgmap v18692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:42 smithi122 ceph-mon[125440]: pgmap v18692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:42 smithi136 ceph-mon[125702]: pgmap v18692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:44 smithi057 ceph-mon[92072]: pgmap v18693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:41:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:44 smithi122 ceph-mon[125440]: pgmap v18693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:41:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:44 smithi136 ceph-mon[125702]: pgmap v18693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:41:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:45.845+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:41:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:45.845+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:41:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:45.845+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:41:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:45.845+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:41:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:41:45.845+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:41:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:46 smithi122 ceph-mon[125440]: pgmap v18694: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:46 smithi136 ceph-mon[125702]: pgmap v18694: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:46 smithi057 ceph-mon[92072]: pgmap v18694: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:48 smithi122 ceph-mon[125440]: pgmap v18695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:48 smithi136 ceph-mon[125702]: pgmap v18695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:48 smithi057 ceph-mon[92072]: pgmap v18695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:50 smithi122 ceph-mon[125440]: pgmap v18696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:50 smithi136 ceph-mon[125702]: pgmap v18696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:50 smithi057 ceph-mon[92072]: pgmap v18696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:41:52.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:52 smithi122 ceph-mon[125440]: pgmap v18697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:52 smithi136 ceph-mon[125702]: pgmap v18697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:52 smithi057 ceph-mon[92072]: pgmap v18697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:54 smithi136 ceph-mon[125702]: pgmap v18698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:41:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:54 smithi057 ceph-mon[92072]: pgmap v18698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:41:54.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:54 smithi122 ceph-mon[125440]: pgmap v18698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:41:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:56 smithi136 ceph-mon[125702]: pgmap v18699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:56 smithi057 ceph-mon[92072]: pgmap v18699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:56 smithi122 ceph-mon[125440]: pgmap v18699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:41:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:41:58 smithi136 ceph-mon[125702]: pgmap v18700: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:41:58 smithi057 ceph-mon[92072]: pgmap v18700: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:41:58.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:41:58 smithi122 ceph-mon[125440]: pgmap v18700: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T20:42:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:00 smithi136 ceph-mon[125702]: pgmap v18701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:42:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:00 smithi057 ceph-mon[92072]: pgmap v18701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:42:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:00 smithi122 ceph-mon[125440]: pgmap v18701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:42:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:00.861+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:42:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:00.861+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:42:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:00.861+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:42:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:00.861+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:42:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:00.861+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:42:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:02 smithi136 ceph-mon[125702]: pgmap v18702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:02 smithi057 ceph-mon[92072]: pgmap v18702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:02 smithi122 ceph-mon[125440]: pgmap v18702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:04 smithi136 ceph-mon[125702]: pgmap v18703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:42:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:04 smithi057 ceph-mon[92072]: pgmap v18703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:42:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:04 smithi122 ceph-mon[125440]: pgmap v18703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:42:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:06 smithi136 ceph-mon[125702]: pgmap v18704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:42:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:06 smithi057 ceph-mon[92072]: pgmap v18704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:42:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:06 smithi122 ceph-mon[125440]: pgmap v18704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:42:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:07 smithi136 ceph-mon[125702]: osdmap e1242: 12 total, 12 up, 12 in 2023-03-02T20:42:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:07 smithi057 ceph-mon[92072]: osdmap e1242: 12 total, 12 up, 12 in 2023-03-02T20:42:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:07 smithi122 ceph-mon[125440]: osdmap e1242: 12 total, 12 up, 12 in 2023-03-02T20:42:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:08 smithi136 ceph-mon[125702]: pgmap v18706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 29 op/s 2023-03-02T20:42:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:08 smithi057 ceph-mon[92072]: pgmap v18706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 29 op/s 2023-03-02T20:42:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:08 smithi122 ceph-mon[125440]: pgmap v18706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 29 op/s 2023-03-02T20:42:10.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:10 smithi136 ceph-mon[125702]: pgmap v18707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:42:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:10 smithi057 ceph-mon[92072]: pgmap v18707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:42:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:10 smithi122 ceph-mon[125440]: pgmap v18707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:42:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:12 smithi136 ceph-mon[125702]: pgmap v18708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:42:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:12 smithi057 ceph-mon[92072]: pgmap v18708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:42:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:12 smithi122 ceph-mon[125440]: pgmap v18708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:42:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:14 smithi136 ceph-mon[125702]: pgmap v18709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:42:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:14 smithi136 ceph-mon[125702]: osdmap e1243: 12 total, 12 up, 12 in 2023-03-02T20:42:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:14 smithi057 ceph-mon[92072]: pgmap v18709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:42:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:14 smithi057 ceph-mon[92072]: osdmap e1243: 12 total, 12 up, 12 in 2023-03-02T20:42:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:14 smithi122 ceph-mon[125440]: pgmap v18709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:42:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:14 smithi122 ceph-mon[125440]: osdmap e1243: 12 total, 12 up, 12 in 2023-03-02T20:42:15.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:15 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:42:15.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:15 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:42:15.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:15 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:42:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:15.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:42:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:15.867+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:42:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:15.867+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:42:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:15.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:42:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:15.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:42:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:16 smithi136 ceph-mon[125702]: pgmap v18711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:42:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:42:16.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:42:16.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:16 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:16 smithi057 ceph-mon[92072]: pgmap v18711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:42:16.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:42:16.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:42:16.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:16 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:16 smithi122 ceph-mon[125440]: pgmap v18711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:42:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:16.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:42:16.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:42:16.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:16 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:42:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:18 smithi136 ceph-mon[125702]: pgmap v18712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:42:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:18 smithi057 ceph-mon[92072]: pgmap v18712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:42:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:18 smithi122 ceph-mon[125440]: pgmap v18712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:42:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:20 smithi136 ceph-mon[125702]: pgmap v18713: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:42:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:20 smithi057 ceph-mon[92072]: pgmap v18713: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:42:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:20 smithi122 ceph-mon[125440]: pgmap v18713: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:42:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:22 smithi136 ceph-mon[125702]: pgmap v18714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:42:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:22 smithi057 ceph-mon[92072]: pgmap v18714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:42:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:22 smithi122 ceph-mon[125440]: pgmap v18714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:42:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:24 smithi136 ceph-mon[125702]: pgmap v18715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:42:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:24 smithi057 ceph-mon[92072]: pgmap v18715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:42:24.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:24 smithi122 ceph-mon[125440]: pgmap v18715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:42:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:26 smithi136 ceph-mon[125702]: pgmap v18716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:42:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:26 smithi057 ceph-mon[92072]: pgmap v18716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:42:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:26 smithi122 ceph-mon[125440]: pgmap v18716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:42:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:28 smithi136 ceph-mon[125702]: pgmap v18717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:28 smithi057 ceph-mon[92072]: pgmap v18717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:28 smithi122 ceph-mon[125440]: pgmap v18717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:30 smithi136 ceph-mon[125702]: pgmap v18718: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:30 smithi057 ceph-mon[92072]: pgmap v18718: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:30 smithi122 ceph-mon[125440]: pgmap v18718: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:30.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:42:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:30.875+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:42:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:30.875+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:42:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:30.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:42:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:30.875+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:42:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:32 smithi136 ceph-mon[125702]: pgmap v18719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:32 smithi057 ceph-mon[92072]: pgmap v18719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:32 smithi122 ceph-mon[125440]: pgmap v18719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:34 smithi136 ceph-mon[125702]: pgmap v18720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:34 smithi057 ceph-mon[92072]: pgmap v18720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:34 smithi122 ceph-mon[125440]: pgmap v18720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:36 smithi136 ceph-mon[125702]: pgmap v18721: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:36 smithi057 ceph-mon[92072]: pgmap v18721: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:36 smithi122 ceph-mon[125440]: pgmap v18721: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:38 smithi057 ceph-mon[92072]: pgmap v18722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:38.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:38 smithi122 ceph-mon[125440]: pgmap v18722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:38.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:38 smithi136 ceph-mon[125702]: pgmap v18722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:40 smithi057 ceph-mon[92072]: pgmap v18723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:40.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:40 smithi122 ceph-mon[125440]: pgmap v18723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:40 smithi136 ceph-mon[125702]: pgmap v18723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:42 smithi057 ceph-mon[92072]: pgmap v18724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:42.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:42 smithi122 ceph-mon[125440]: pgmap v18724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:42 smithi136 ceph-mon[125702]: pgmap v18724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:44 smithi057 ceph-mon[92072]: pgmap v18725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:44 smithi122 ceph-mon[125440]: pgmap v18725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:44 smithi136 ceph-mon[125702]: pgmap v18725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:45.886+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:42:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:45.887+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:42:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:45.887+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:42:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:45.887+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:42:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:42:45.887+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:42:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:46 smithi057 ceph-mon[92072]: pgmap v18726: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:46 smithi122 ceph-mon[125440]: pgmap v18726: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:46 smithi136 ceph-mon[125702]: pgmap v18726: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:48 smithi057 ceph-mon[92072]: pgmap v18727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:48 smithi122 ceph-mon[125440]: pgmap v18727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:48 smithi136 ceph-mon[125702]: pgmap v18727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:50 smithi057 ceph-mon[92072]: pgmap v18728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:50 smithi122 ceph-mon[125440]: pgmap v18728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:50 smithi136 ceph-mon[125702]: pgmap v18728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:52 smithi057 ceph-mon[92072]: pgmap v18729: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:52 smithi122 ceph-mon[125440]: pgmap v18729: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:52 smithi136 ceph-mon[125702]: pgmap v18729: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:53.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:53 smithi057 ceph-mon[92072]: pgmap v18730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:53.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:53 smithi122 ceph-mon[125440]: pgmap v18730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:53 smithi136 ceph-mon[125702]: pgmap v18730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:56.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:56 smithi122 ceph-mon[125440]: pgmap v18731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:56 smithi136 ceph-mon[125702]: pgmap v18731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:56 smithi057 ceph-mon[92072]: pgmap v18731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:42:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:42:58 smithi136 ceph-mon[125702]: pgmap v18732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:42:58 smithi057 ceph-mon[92072]: pgmap v18732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:42:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:42:58 smithi122 ceph-mon[125440]: pgmap v18732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:00 smithi136 ceph-mon[125702]: pgmap v18733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:00 smithi057 ceph-mon[92072]: pgmap v18733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:00 smithi122 ceph-mon[125440]: pgmap v18733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:00.896+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:43:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:00.896+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:43:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:00.896+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:43:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:00.896+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:43:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:00.896+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:43:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:02 smithi136 ceph-mon[125702]: pgmap v18734: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:02 smithi057 ceph-mon[92072]: pgmap v18734: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:02 smithi122 ceph-mon[125440]: pgmap v18734: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:04 smithi136 ceph-mon[125702]: pgmap v18735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:43:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:04 smithi057 ceph-mon[92072]: pgmap v18735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:43:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:04 smithi122 ceph-mon[125440]: pgmap v18735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:43:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:06 smithi136 ceph-mon[125702]: pgmap v18736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:43:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:06 smithi057 ceph-mon[92072]: pgmap v18736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:43:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:06 smithi122 ceph-mon[125440]: pgmap v18736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:43:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:07 smithi136 ceph-mon[125702]: osdmap e1244: 12 total, 12 up, 12 in 2023-03-02T20:43:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:07 smithi057 ceph-mon[92072]: osdmap e1244: 12 total, 12 up, 12 in 2023-03-02T20:43:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:07 smithi122 ceph-mon[125440]: osdmap e1244: 12 total, 12 up, 12 in 2023-03-02T20:43:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:08 smithi136 ceph-mon[125702]: pgmap v18738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:43:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:08 smithi057 ceph-mon[92072]: pgmap v18738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:43:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:08 smithi122 ceph-mon[125440]: pgmap v18738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:43:10.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:10 smithi122 ceph-mon[125440]: pgmap v18739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:43:10.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:10 smithi122 ceph-mon[125440]: osdmap e1245: 12 total, 12 up, 12 in 2023-03-02T20:43:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:10 smithi136 ceph-mon[125702]: pgmap v18739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:43:10.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:10 smithi136 ceph-mon[125702]: osdmap e1245: 12 total, 12 up, 12 in 2023-03-02T20:43:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:10 smithi057 ceph-mon[92072]: pgmap v18739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:43:10.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:10 smithi057 ceph-mon[92072]: osdmap e1245: 12 total, 12 up, 12 in 2023-03-02T20:43:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:12 smithi136 ceph-mon[125702]: pgmap v18741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T20:43:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:12 smithi057 ceph-mon[92072]: pgmap v18741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T20:43:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:12 smithi122 ceph-mon[125440]: pgmap v18741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T20:43:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:14 smithi136 ceph-mon[125702]: pgmap v18742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:43:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:14 smithi057 ceph-mon[92072]: pgmap v18742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:43:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:14 smithi122 ceph-mon[125440]: pgmap v18742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:43:15.913 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:15.911+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:43:15.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:15.911+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:43:15.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:15.911+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:43:15.914 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:15.911+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:43:15.915 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:15.911+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:43:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:16 smithi136 ceph-mon[125702]: pgmap v18743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:43:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:16 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:43:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:16 smithi057 ceph-mon[92072]: pgmap v18743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:43:16.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:16 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:43:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:16 smithi122 ceph-mon[125440]: pgmap v18743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:43:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:16 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:43:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:18 smithi136 ceph-mon[125702]: pgmap v18744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:43:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:18 smithi057 ceph-mon[92072]: pgmap v18744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:43:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:18 smithi122 ceph-mon[125440]: pgmap v18744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:43:20.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: pgmap v18745: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:43:20.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:43:20.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:43:20.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: pgmap v18745: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:43:20.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:43:20.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:43:20.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: pgmap v18745: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:43:20.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:20.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:43:20.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:43:20.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:43:20.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:43:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:20 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:43:21.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:20 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:43:21.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:20 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:43:21.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:20 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:43:21.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:20 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:43:21.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:20 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:43:21.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:20 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:43:21.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:20 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:43:21.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:20 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:43:21.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:20 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:43:21.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:20 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:43:21.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:20 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:43:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:21 smithi136 ceph-mon[125702]: pgmap v18746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 88 B/s wr, 8 op/s 2023-03-02T20:43:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:21 smithi057 ceph-mon[92072]: pgmap v18746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 88 B/s wr, 8 op/s 2023-03-02T20:43:22.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:21 smithi122 ceph-mon[125440]: pgmap v18746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 88 B/s wr, 8 op/s 2023-03-02T20:43:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:23 smithi136 ceph-mon[125702]: pgmap v18747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T20:43:24.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:23 smithi057 ceph-mon[92072]: pgmap v18747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T20:43:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:23 smithi122 ceph-mon[125440]: pgmap v18747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T20:43:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:26 smithi136 ceph-mon[125702]: pgmap v18748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:26 smithi057 ceph-mon[92072]: pgmap v18748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:26 smithi122 ceph-mon[125440]: pgmap v18748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:28 smithi136 ceph-mon[125702]: pgmap v18749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:28 smithi057 ceph-mon[92072]: pgmap v18749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:28 smithi122 ceph-mon[125440]: pgmap v18749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:30.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:30 smithi136 ceph-mon[125702]: pgmap v18750: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:30 smithi057 ceph-mon[92072]: pgmap v18750: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:30 smithi122 ceph-mon[125440]: pgmap v18750: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:30.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:43:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:30.924+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:43:30.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:30.924+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:43:30.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:30.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:43:30.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:30.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:43:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:32 smithi136 ceph-mon[125702]: pgmap v18751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:32 smithi057 ceph-mon[92072]: pgmap v18751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:32 smithi122 ceph-mon[125440]: pgmap v18751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:34 smithi136 ceph-mon[125702]: pgmap v18752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:34 smithi057 ceph-mon[92072]: pgmap v18752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:34 smithi122 ceph-mon[125440]: pgmap v18752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:36 smithi136 ceph-mon[125702]: pgmap v18753: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:36 smithi057 ceph-mon[92072]: pgmap v18753: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:36 smithi122 ceph-mon[125440]: pgmap v18753: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:38 smithi136 ceph-mon[125702]: pgmap v18754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:38 smithi057 ceph-mon[92072]: pgmap v18754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:38 smithi122 ceph-mon[125440]: pgmap v18754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:40 smithi136 ceph-mon[125702]: pgmap v18755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:40 smithi057 ceph-mon[92072]: pgmap v18755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:40 smithi122 ceph-mon[125440]: pgmap v18755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:42 smithi136 ceph-mon[125702]: pgmap v18756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:42 smithi057 ceph-mon[92072]: pgmap v18756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:42.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:42 smithi122 ceph-mon[125440]: pgmap v18756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:44 smithi136 ceph-mon[125702]: pgmap v18757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:44 smithi057 ceph-mon[92072]: pgmap v18757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:44 smithi122 ceph-mon[125440]: pgmap v18757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:45.933+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:43:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:45.934+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:43:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:45.934+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:43:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:45.934+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:43:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:43:45.934+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:43:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:46 smithi136 ceph-mon[125702]: pgmap v18758: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:46 smithi057 ceph-mon[92072]: pgmap v18758: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:46 smithi122 ceph-mon[125440]: pgmap v18758: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:48 smithi136 ceph-mon[125702]: pgmap v18759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:48 smithi057 ceph-mon[92072]: pgmap v18759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:48 smithi122 ceph-mon[125440]: pgmap v18759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:50 smithi136 ceph-mon[125702]: pgmap v18760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:50 smithi057 ceph-mon[92072]: pgmap v18760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:50 smithi122 ceph-mon[125440]: pgmap v18760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:52 smithi136 ceph-mon[125702]: pgmap v18761: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:52 smithi057 ceph-mon[92072]: pgmap v18761: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:52.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:52 smithi122 ceph-mon[125440]: pgmap v18761: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:54 smithi136 ceph-mon[125702]: pgmap v18762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:54 smithi057 ceph-mon[92072]: pgmap v18762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:54 smithi122 ceph-mon[125440]: pgmap v18762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:56 smithi136 ceph-mon[125702]: pgmap v18763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:56 smithi057 ceph-mon[92072]: pgmap v18763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:56 smithi122 ceph-mon[125440]: pgmap v18763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:43:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:43:58 smithi136 ceph-mon[125702]: pgmap v18764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:43:58 smithi057 ceph-mon[92072]: pgmap v18764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:43:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:43:58 smithi122 ceph-mon[125440]: pgmap v18764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:00 smithi136 ceph-mon[125702]: pgmap v18765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:00 smithi057 ceph-mon[92072]: pgmap v18765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:00 smithi122 ceph-mon[125440]: pgmap v18765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:00.949+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:44:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:00.949+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:44:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:00.949+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:44:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:00.949+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:44:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:00.949+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:44:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:02 smithi136 ceph-mon[125702]: pgmap v18766: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:02 smithi057 ceph-mon[92072]: pgmap v18766: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:02 smithi122 ceph-mon[125440]: pgmap v18766: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:04 smithi136 ceph-mon[125702]: pgmap v18767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:44:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:04 smithi057 ceph-mon[92072]: pgmap v18767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:44:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:04 smithi122 ceph-mon[125440]: pgmap v18767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:44:06.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:06 smithi136 ceph-mon[125702]: pgmap v18768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:44:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:06 smithi057 ceph-mon[92072]: pgmap v18768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:44:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:06 smithi122 ceph-mon[125440]: pgmap v18768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:44:07.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:07 smithi136 ceph-mon[125702]: osdmap e1246: 12 total, 12 up, 12 in 2023-03-02T20:44:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:07 smithi057 ceph-mon[92072]: osdmap e1246: 12 total, 12 up, 12 in 2023-03-02T20:44:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:07 smithi122 ceph-mon[125440]: osdmap e1246: 12 total, 12 up, 12 in 2023-03-02T20:44:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:08.429+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900001364) for more than 900000000 us, fault. 2023-03-02T20:44:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:08.429+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5870019800 tx=0x7f58700b2070 comp rx=0 tx=0).stop 2023-03-02T20:44:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:08.429+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T20:44:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:08.429+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T20:44:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:08.429+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T20:44:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:08.429+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:44:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:08.430+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f5870027fb0 tx=0x7f587006c000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T20:44:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:08 smithi136 ceph-mon[125702]: pgmap v18770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:44:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:08 smithi057 ceph-mon[92072]: pgmap v18770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:44:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:08 smithi122 ceph-mon[125440]: pgmap v18770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:44:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:10 smithi136 ceph-mon[125702]: pgmap v18771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:44:10.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:10 smithi136 ceph-mon[125702]: osdmap e1247: 12 total, 12 up, 12 in 2023-03-02T20:44:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:10 smithi057 ceph-mon[92072]: pgmap v18771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:44:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:10 smithi057 ceph-mon[92072]: osdmap e1247: 12 total, 12 up, 12 in 2023-03-02T20:44:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:10 smithi122 ceph-mon[125440]: pgmap v18771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:44:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:10 smithi122 ceph-mon[125440]: osdmap e1247: 12 total, 12 up, 12 in 2023-03-02T20:44:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:12 smithi136 ceph-mon[125702]: pgmap v18773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T20:44:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:12 smithi057 ceph-mon[92072]: pgmap v18773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T20:44:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:12 smithi122 ceph-mon[125440]: pgmap v18773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-02T20:44:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:13.448+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:44:13.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:13.448+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:44:13.477 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:13.448+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 271 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:44:13.477 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:13.448+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 270 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006370 con 0x558558b6f6b0 2023-03-02T20:44:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:14 smithi136 ceph-mon[125702]: pgmap v18774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:44:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:14 smithi057 ceph-mon[92072]: pgmap v18774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:44:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:14 smithi122 ceph-mon[125440]: pgmap v18774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T20:44:15.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:15.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:44:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:15.951+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:44:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:15.951+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:44:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:15.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:44:15.955 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:15.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:44:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:16 smithi136 ceph-mon[125702]: pgmap v18775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:44:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:16 smithi057 ceph-mon[92072]: pgmap v18775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:44:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:16 smithi122 ceph-mon[125440]: pgmap v18775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:44:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:18 smithi136 ceph-mon[125702]: pgmap v18776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:44:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:18 smithi057 ceph-mon[92072]: pgmap v18776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:44:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:18 smithi122 ceph-mon[125440]: pgmap v18776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:44:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:20 smithi136 ceph-mon[125702]: pgmap v18777: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:44:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:44:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:20 smithi057 ceph-mon[92072]: pgmap v18777: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:44:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:44:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:20 smithi122 ceph-mon[125440]: pgmap v18777: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:44:20.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:44:21.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:44:21.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:44:21.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:44:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:44:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:44:21.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:44:21.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:44:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:44:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:44:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:22 smithi136 ceph-mon[125702]: pgmap v18778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 88 B/s wr, 8 op/s 2023-03-02T20:44:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:22 smithi057 ceph-mon[92072]: pgmap v18778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 88 B/s wr, 8 op/s 2023-03-02T20:44:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:22 smithi122 ceph-mon[125440]: pgmap v18778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 88 B/s wr, 8 op/s 2023-03-02T20:44:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:24 smithi136 ceph-mon[125702]: pgmap v18779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T20:44:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:24 smithi057 ceph-mon[92072]: pgmap v18779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T20:44:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:24 smithi122 ceph-mon[125440]: pgmap v18779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-02T20:44:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:26 smithi136 ceph-mon[125702]: pgmap v18780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:26 smithi057 ceph-mon[92072]: pgmap v18780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:26 smithi122 ceph-mon[125440]: pgmap v18780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:28.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:28 smithi136 ceph-mon[125702]: pgmap v18781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:28 smithi057 ceph-mon[92072]: pgmap v18781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:28 smithi122 ceph-mon[125440]: pgmap v18781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:30 smithi136 ceph-mon[125702]: pgmap v18782: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:30 smithi057 ceph-mon[92072]: pgmap v18782: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:30.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:30 smithi122 ceph-mon[125440]: pgmap v18782: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:30.961+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:44:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:30.961+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:44:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:30.961+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:44:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:30.961+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:44:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:30.962+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:44:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:32 smithi136 ceph-mon[125702]: pgmap v18783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:32 smithi057 ceph-mon[92072]: pgmap v18783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:32 smithi122 ceph-mon[125440]: pgmap v18783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:34 smithi136 ceph-mon[125702]: pgmap v18784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:34 smithi057 ceph-mon[92072]: pgmap v18784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:34 smithi122 ceph-mon[125440]: pgmap v18784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:36 smithi136 ceph-mon[125702]: pgmap v18785: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:36 smithi057 ceph-mon[92072]: pgmap v18785: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:36.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:36 smithi122 ceph-mon[125440]: pgmap v18785: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:38 smithi136 ceph-mon[125702]: pgmap v18786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:38 smithi057 ceph-mon[92072]: pgmap v18786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:38 smithi122 ceph-mon[125440]: pgmap v18786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:40 smithi136 ceph-mon[125702]: pgmap v18787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:40 smithi057 ceph-mon[92072]: pgmap v18787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:40 smithi122 ceph-mon[125440]: pgmap v18787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:42 smithi136 ceph-mon[125702]: pgmap v18788: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:42 smithi057 ceph-mon[92072]: pgmap v18788: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:42.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:42 smithi122 ceph-mon[125440]: pgmap v18788: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:44 smithi136 ceph-mon[125702]: pgmap v18789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:44 smithi057 ceph-mon[92072]: pgmap v18789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:44 smithi122 ceph-mon[125440]: pgmap v18789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:45.967+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:44:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:45.967+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:44:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:45.967+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:44:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:45.967+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:44:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:45.967+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:44:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:46 smithi136 ceph-mon[125702]: pgmap v18790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:46 smithi057 ceph-mon[92072]: pgmap v18790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:46 smithi122 ceph-mon[125440]: pgmap v18790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:48 smithi136 ceph-mon[125702]: pgmap v18791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:48 smithi057 ceph-mon[92072]: pgmap v18791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:48 smithi122 ceph-mon[125440]: pgmap v18791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:50 smithi136 ceph-mon[125702]: pgmap v18792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:50 smithi057 ceph-mon[92072]: pgmap v18792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:50 smithi122 ceph-mon[125440]: pgmap v18792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:52 smithi136 ceph-mon[125702]: pgmap v18793: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:52 smithi057 ceph-mon[92072]: pgmap v18793: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:52 smithi122 ceph-mon[125440]: pgmap v18793: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:54 smithi136 ceph-mon[125702]: pgmap v18794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:54 smithi057 ceph-mon[92072]: pgmap v18794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:54 smithi122 ceph-mon[125440]: pgmap v18794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:56 smithi136 ceph-mon[125702]: pgmap v18795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:56 smithi057 ceph-mon[92072]: pgmap v18795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:56 smithi122 ceph-mon[125440]: pgmap v18795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:44:58.456 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:58.454+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T20:44:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:58.454+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:44:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:58.454+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 271 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T20:44:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:44:58.454+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 272 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:44:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:44:58 smithi136 ceph-mon[125702]: pgmap v18796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:44:58 smithi057 ceph-mon[92072]: pgmap v18796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:44:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:44:58 smithi122 ceph-mon[125440]: pgmap v18796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:00 smithi136 ceph-mon[125702]: pgmap v18797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:00 smithi057 ceph-mon[92072]: pgmap v18797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:00 smithi122 ceph-mon[125440]: pgmap v18797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:00.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:45:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:00.975+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:45:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:00.975+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:45:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:00.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:45:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:00.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:45:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:02 smithi057 ceph-mon[92072]: pgmap v18798: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:02 smithi122 ceph-mon[125440]: pgmap v18798: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:02 smithi136 ceph-mon[125702]: pgmap v18798: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:04 smithi057 ceph-mon[92072]: pgmap v18799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:45:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:04 smithi122 ceph-mon[125440]: pgmap v18799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:45:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:04 smithi136 ceph-mon[125702]: pgmap v18799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:45:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:06 smithi057 ceph-mon[92072]: pgmap v18800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:45:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:06 smithi122 ceph-mon[125440]: pgmap v18800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:45:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:06 smithi136 ceph-mon[125702]: pgmap v18800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:45:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:07 smithi057 ceph-mon[92072]: osdmap e1248: 12 total, 12 up, 12 in 2023-03-02T20:45:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:07 smithi122 ceph-mon[125440]: osdmap e1248: 12 total, 12 up, 12 in 2023-03-02T20:45:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:07 smithi136 ceph-mon[125702]: osdmap e1248: 12 total, 12 up, 12 in 2023-03-02T20:45:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:08 smithi057 ceph-mon[92072]: pgmap v18802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:45:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:08 smithi122 ceph-mon[125440]: pgmap v18802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:45:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:08 smithi136 ceph-mon[125702]: pgmap v18802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:45:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:10 smithi057 ceph-mon[92072]: pgmap v18803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:45:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:10 smithi122 ceph-mon[125440]: pgmap v18803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:45:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:10 smithi136 ceph-mon[125702]: pgmap v18803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:45:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:12 smithi057 ceph-mon[92072]: pgmap v18804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:45:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:12 smithi122 ceph-mon[125440]: pgmap v18804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:45:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:12 smithi136 ceph-mon[125702]: pgmap v18804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:45:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:14 smithi057 ceph-mon[92072]: pgmap v18805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:45:14.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:14 smithi057 ceph-mon[92072]: osdmap e1249: 12 total, 12 up, 12 in 2023-03-02T20:45:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:14 smithi122 ceph-mon[125440]: pgmap v18805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:45:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:14 smithi122 ceph-mon[125440]: osdmap e1249: 12 total, 12 up, 12 in 2023-03-02T20:45:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:14 smithi136 ceph-mon[125702]: pgmap v18805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:45:14.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:14 smithi136 ceph-mon[125702]: osdmap e1249: 12 total, 12 up, 12 in 2023-03-02T20:45:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:15.984+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:45:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:15.985+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:45:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:15.985+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:45:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:15.985+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:45:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:15.985+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:45:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:16 smithi057 ceph-mon[92072]: pgmap v18807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:45:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:16 smithi122 ceph-mon[125440]: pgmap v18807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:45:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:16 smithi136 ceph-mon[125702]: pgmap v18807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:45:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:18 smithi057 ceph-mon[92072]: pgmap v18808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:45:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:18 smithi122 ceph-mon[125440]: pgmap v18808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:45:18.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:18 smithi136 ceph-mon[125702]: pgmap v18808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:45:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:20 smithi057 ceph-mon[92072]: pgmap v18809: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:45:20.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:20 smithi122 ceph-mon[125440]: pgmap v18809: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:45:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:20 smithi136 ceph-mon[125702]: pgmap v18809: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:45:21.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:45:21.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:21 smithi057 ceph-mon[92072]: pgmap v18810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:45:21.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:45:21.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:45:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:45:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:21 smithi122 ceph-mon[125440]: pgmap v18810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:45:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:45:21.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:45:21.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:45:21.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:21 smithi136 ceph-mon[125702]: pgmap v18810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:45:21.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:45:21.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:45:22.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:45:22.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:45:22.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:45:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:45:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:45:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:45:22.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:45:22.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:45:22.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:45:23.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:23 smithi057 ceph-mon[92072]: pgmap v18811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:45:23.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:23 smithi122 ceph-mon[125440]: pgmap v18811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:45:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:23 smithi136 ceph-mon[125702]: pgmap v18811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:45:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:26 smithi136 ceph-mon[125702]: pgmap v18812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:45:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:26 smithi057 ceph-mon[92072]: pgmap v18812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:45:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:26 smithi122 ceph-mon[125440]: pgmap v18812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:45:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:28 smithi136 ceph-mon[125702]: pgmap v18813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:28 smithi057 ceph-mon[92072]: pgmap v18813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:28 smithi122 ceph-mon[125440]: pgmap v18813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:30 smithi136 ceph-mon[125702]: pgmap v18814: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:30 smithi057 ceph-mon[92072]: pgmap v18814: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:30 smithi122 ceph-mon[125440]: pgmap v18814: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:31.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:45:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:31.000+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:45:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:31.000+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:45:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:31.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:45:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:31.000+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:45:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:32 smithi136 ceph-mon[125702]: pgmap v18815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:32 smithi057 ceph-mon[92072]: pgmap v18815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:32 smithi122 ceph-mon[125440]: pgmap v18815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:34 smithi136 ceph-mon[125702]: pgmap v18816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:34 smithi057 ceph-mon[92072]: pgmap v18816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:34 smithi122 ceph-mon[125440]: pgmap v18816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:36 smithi136 ceph-mon[125702]: pgmap v18817: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:36 smithi057 ceph-mon[92072]: pgmap v18817: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:36.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:36 smithi122 ceph-mon[125440]: pgmap v18817: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:38 smithi136 ceph-mon[125702]: pgmap v18818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:38 smithi057 ceph-mon[92072]: pgmap v18818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:38 smithi122 ceph-mon[125440]: pgmap v18818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:40 smithi136 ceph-mon[125702]: pgmap v18819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:40 smithi057 ceph-mon[92072]: pgmap v18819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:40.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:40 smithi122 ceph-mon[125440]: pgmap v18819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:42 smithi136 ceph-mon[125702]: pgmap v18820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:42 smithi057 ceph-mon[92072]: pgmap v18820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:42.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:42 smithi122 ceph-mon[125440]: pgmap v18820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:44 smithi136 ceph-mon[125702]: pgmap v18821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:44 smithi057 ceph-mon[92072]: pgmap v18821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:44 smithi122 ceph-mon[125440]: pgmap v18821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:46.013+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:45:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:46.013+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:45:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:46.013+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:45:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:46.013+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:45:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:45:46.014+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:45:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:46 smithi136 ceph-mon[125702]: pgmap v18822: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:46 smithi057 ceph-mon[92072]: pgmap v18822: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:46 smithi122 ceph-mon[125440]: pgmap v18822: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:48 smithi136 ceph-mon[125702]: pgmap v18823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:48 smithi057 ceph-mon[92072]: pgmap v18823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:48 smithi122 ceph-mon[125440]: pgmap v18823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:50 smithi136 ceph-mon[125702]: pgmap v18824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:50 smithi057 ceph-mon[92072]: pgmap v18824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:50 smithi122 ceph-mon[125440]: pgmap v18824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:52 smithi136 ceph-mon[125702]: pgmap v18825: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:52 smithi057 ceph-mon[92072]: pgmap v18825: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:52 smithi122 ceph-mon[125440]: pgmap v18825: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:54 smithi136 ceph-mon[125702]: pgmap v18826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:54 smithi057 ceph-mon[92072]: pgmap v18826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:54 smithi122 ceph-mon[125440]: pgmap v18826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:56 smithi136 ceph-mon[125702]: pgmap v18827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:56 smithi057 ceph-mon[92072]: pgmap v18827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:56 smithi122 ceph-mon[125440]: pgmap v18827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:45:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:45:58 smithi136 ceph-mon[125702]: pgmap v18828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:45:58 smithi057 ceph-mon[92072]: pgmap v18828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:45:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:45:58 smithi122 ceph-mon[125440]: pgmap v18828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:00 smithi136 ceph-mon[125702]: pgmap v18829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:00 smithi057 ceph-mon[92072]: pgmap v18829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:00 smithi122 ceph-mon[125440]: pgmap v18829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:01.032 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:01.030+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:46:01.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:01.030+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:46:01.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:01.030+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:46:01.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:01.030+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:46:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:01.030+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:46:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:02 smithi057 ceph-mon[92072]: pgmap v18830: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:02 smithi122 ceph-mon[125440]: pgmap v18830: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:02 smithi136 ceph-mon[125702]: pgmap v18830: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:04 smithi057 ceph-mon[92072]: pgmap v18831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:46:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:04 smithi122 ceph-mon[125440]: pgmap v18831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:46:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:04 smithi136 ceph-mon[125702]: pgmap v18831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:46:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:06 smithi057 ceph-mon[92072]: pgmap v18832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:46:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:06 smithi122 ceph-mon[125440]: pgmap v18832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:46:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:06 smithi136 ceph-mon[125702]: pgmap v18832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:46:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:07 smithi057 ceph-mon[92072]: osdmap e1250: 12 total, 12 up, 12 in 2023-03-02T20:46:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:07 smithi122 ceph-mon[125440]: osdmap e1250: 12 total, 12 up, 12 in 2023-03-02T20:46:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:07 smithi136 ceph-mon[125702]: osdmap e1250: 12 total, 12 up, 12 in 2023-03-02T20:46:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:08 smithi057 ceph-mon[92072]: pgmap v18834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:46:08.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:08 smithi122 ceph-mon[125440]: pgmap v18834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:46:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:08 smithi136 ceph-mon[125702]: pgmap v18834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:46:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:10 smithi057 ceph-mon[92072]: pgmap v18835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:46:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:10 smithi122 ceph-mon[125440]: pgmap v18835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:46:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:10 smithi136 ceph-mon[125702]: pgmap v18835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:46:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:12 smithi057 ceph-mon[92072]: pgmap v18836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:46:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:12 smithi122 ceph-mon[125440]: pgmap v18836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:46:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:12 smithi136 ceph-mon[125702]: pgmap v18836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:46:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:14 smithi057 ceph-mon[92072]: pgmap v18837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:46:14.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:14 smithi057 ceph-mon[92072]: osdmap e1251: 12 total, 12 up, 12 in 2023-03-02T20:46:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:14 smithi122 ceph-mon[125440]: pgmap v18837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:46:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:14 smithi122 ceph-mon[125440]: osdmap e1251: 12 total, 12 up, 12 in 2023-03-02T20:46:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:14 smithi136 ceph-mon[125702]: pgmap v18837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:46:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:14 smithi136 ceph-mon[125702]: osdmap e1251: 12 total, 12 up, 12 in 2023-03-02T20:46:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:16.031+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:46:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:16.031+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:46:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:16.031+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:46:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:16.031+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:46:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:16.031+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:46:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:16 smithi057 ceph-mon[92072]: pgmap v18839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:46:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:16 smithi122 ceph-mon[125440]: pgmap v18839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:46:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:16 smithi136 ceph-mon[125702]: pgmap v18839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:46:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:18 smithi057 ceph-mon[92072]: pgmap v18840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:46:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:18 smithi122 ceph-mon[125440]: pgmap v18840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:46:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:18 smithi136 ceph-mon[125702]: pgmap v18840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:46:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:20 smithi057 ceph-mon[92072]: pgmap v18841: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:46:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:20 smithi122 ceph-mon[125440]: pgmap v18841: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:46:20.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:20 smithi136 ceph-mon[125702]: pgmap v18841: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:46:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:22 smithi057 ceph-mon[92072]: pgmap v18842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:46:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:46:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:22 smithi122 ceph-mon[125440]: pgmap v18842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:46:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:46:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:22 smithi136 ceph-mon[125702]: pgmap v18842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:46:22.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:46:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:23 smithi136 ceph-mon[125702]: pgmap v18843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:46:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:46:23.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:46:23.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:23 smithi057 ceph-mon[92072]: pgmap v18843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:46:23.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:46:23.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:46:23.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:23 smithi122 ceph-mon[125440]: pgmap v18843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:46:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:46:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:46:23.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:46:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:26 smithi136 ceph-mon[125702]: pgmap v18844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:46:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:26 smithi057 ceph-mon[92072]: pgmap v18844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:46:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:26 smithi122 ceph-mon[125440]: pgmap v18844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:46:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:28 smithi136 ceph-mon[125702]: pgmap v18845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:28 smithi057 ceph-mon[92072]: pgmap v18845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:28 smithi122 ceph-mon[125440]: pgmap v18845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:30 smithi136 ceph-mon[125702]: pgmap v18846: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:30 smithi057 ceph-mon[92072]: pgmap v18846: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:30 smithi122 ceph-mon[125440]: pgmap v18846: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:31.037+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:46:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:31.037+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:46:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:31.037+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:46:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:31.037+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:46:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:31.037+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:46:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:32 smithi136 ceph-mon[125702]: pgmap v18847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:32 smithi057 ceph-mon[92072]: pgmap v18847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:32 smithi122 ceph-mon[125440]: pgmap v18847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:34 smithi136 ceph-mon[125702]: pgmap v18848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:34 smithi057 ceph-mon[92072]: pgmap v18848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:34 smithi122 ceph-mon[125440]: pgmap v18848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:36 smithi136 ceph-mon[125702]: pgmap v18849: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:36 smithi057 ceph-mon[92072]: pgmap v18849: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:36 smithi122 ceph-mon[125440]: pgmap v18849: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:38 smithi136 ceph-mon[125702]: pgmap v18850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:38 smithi057 ceph-mon[92072]: pgmap v18850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:38.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:38 smithi122 ceph-mon[125440]: pgmap v18850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:40 smithi136 ceph-mon[125702]: pgmap v18851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:40 smithi057 ceph-mon[92072]: pgmap v18851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:40 smithi122 ceph-mon[125440]: pgmap v18851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:42 smithi136 ceph-mon[125702]: pgmap v18852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:42 smithi057 ceph-mon[92072]: pgmap v18852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:42.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:42 smithi122 ceph-mon[125440]: pgmap v18852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:44 smithi136 ceph-mon[125702]: pgmap v18853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:44 smithi057 ceph-mon[92072]: pgmap v18853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:44 smithi122 ceph-mon[125440]: pgmap v18853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:46.041+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:46:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:46.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:46:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:46.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:46:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:46.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:46:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:46:46.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:46:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:46 smithi136 ceph-mon[125702]: pgmap v18854: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:46 smithi057 ceph-mon[92072]: pgmap v18854: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:46 smithi122 ceph-mon[125440]: pgmap v18854: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:48 smithi136 ceph-mon[125702]: pgmap v18855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:48 smithi057 ceph-mon[92072]: pgmap v18855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:48 smithi122 ceph-mon[125440]: pgmap v18855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:50 smithi136 ceph-mon[125702]: pgmap v18856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:50 smithi057 ceph-mon[92072]: pgmap v18856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:50 smithi122 ceph-mon[125440]: pgmap v18856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:52.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:52 smithi136 ceph-mon[125702]: pgmap v18857: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:52 smithi057 ceph-mon[92072]: pgmap v18857: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:52 smithi122 ceph-mon[125440]: pgmap v18857: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:54 smithi136 ceph-mon[125702]: pgmap v18858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:54 smithi057 ceph-mon[92072]: pgmap v18858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:54 smithi122 ceph-mon[125440]: pgmap v18858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:56 smithi136 ceph-mon[125702]: pgmap v18859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:56 smithi057 ceph-mon[92072]: pgmap v18859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:56 smithi122 ceph-mon[125440]: pgmap v18859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:46:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:46:58 smithi057 ceph-mon[92072]: pgmap v18860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:46:58 smithi122 ceph-mon[125440]: pgmap v18860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:46:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:46:58 smithi136 ceph-mon[125702]: pgmap v18860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:00 smithi057 ceph-mon[92072]: pgmap v18861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:00 smithi122 ceph-mon[125440]: pgmap v18861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:00 smithi136 ceph-mon[125702]: pgmap v18861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:01.057+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:47:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:01.057+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:47:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:01.057+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:47:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:01.057+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:47:01.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:01.057+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:47:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:02 smithi057 ceph-mon[92072]: pgmap v18862: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:02.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:02 smithi122 ceph-mon[125440]: pgmap v18862: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:02 smithi136 ceph-mon[125702]: pgmap v18862: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:04 smithi057 ceph-mon[92072]: pgmap v18863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:47:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:04 smithi122 ceph-mon[125440]: pgmap v18863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:47:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:04 smithi136 ceph-mon[125702]: pgmap v18863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:47:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:06 smithi057 ceph-mon[92072]: pgmap v18864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:47:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:06 smithi122 ceph-mon[125440]: pgmap v18864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:47:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:06 smithi136 ceph-mon[125702]: pgmap v18864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:47:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:08 smithi057 ceph-mon[92072]: pgmap v18865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:47:08.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:08 smithi122 ceph-mon[125440]: pgmap v18865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:47:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:08 smithi136 ceph-mon[125702]: pgmap v18865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:47:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:10 smithi057 ceph-mon[92072]: pgmap v18866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:47:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:10 smithi122 ceph-mon[125440]: pgmap v18866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:47:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:10 smithi136 ceph-mon[125702]: pgmap v18866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:47:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:12 smithi057 ceph-mon[92072]: pgmap v18867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:47:12.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:12 smithi057 ceph-mon[92072]: osdmap e1252: 12 total, 12 up, 12 in 2023-03-02T20:47:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:12 smithi122 ceph-mon[125440]: pgmap v18867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:47:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:12 smithi122 ceph-mon[125440]: osdmap e1252: 12 total, 12 up, 12 in 2023-03-02T20:47:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:12 smithi136 ceph-mon[125702]: pgmap v18867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:47:12.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:12 smithi136 ceph-mon[125702]: osdmap e1252: 12 total, 12 up, 12 in 2023-03-02T20:47:13.476 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:13.474+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T20:47:13.477 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:13.474+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:47:13.477 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:13.474+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 273 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:47:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:13.474+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 272 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T20:47:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:14 smithi057 ceph-mon[92072]: pgmap v18869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:14 smithi122 ceph-mon[125440]: pgmap v18869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:14 smithi136 ceph-mon[125702]: pgmap v18869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:16.059+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:47:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:16.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:47:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:16.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:47:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:16.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:47:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:16.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:47:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:16 smithi057 ceph-mon[92072]: pgmap v18870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:16 smithi122 ceph-mon[125440]: pgmap v18870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:16 smithi136 ceph-mon[125702]: pgmap v18870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:18 smithi057 ceph-mon[92072]: pgmap v18871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:47:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:18 smithi122 ceph-mon[125440]: pgmap v18871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:47:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:18 smithi136 ceph-mon[125702]: pgmap v18871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:47:20.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:20 smithi136 ceph-mon[125702]: pgmap v18872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:47:20.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:20 smithi136 ceph-mon[125702]: osdmap e1253: 12 total, 12 up, 12 in 2023-03-02T20:47:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:20 smithi057 ceph-mon[92072]: pgmap v18872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:47:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:20 smithi057 ceph-mon[92072]: osdmap e1253: 12 total, 12 up, 12 in 2023-03-02T20:47:20.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:20 smithi122 ceph-mon[125440]: pgmap v18872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T20:47:20.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:20 smithi122 ceph-mon[125440]: osdmap e1253: 12 total, 12 up, 12 in 2023-03-02T20:47:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:22 smithi136 ceph-mon[125702]: pgmap v18874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 323 B/s wr, 11 op/s 2023-03-02T20:47:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:22 smithi057 ceph-mon[92072]: pgmap v18874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 323 B/s wr, 11 op/s 2023-03-02T20:47:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:22 smithi122 ceph-mon[125440]: pgmap v18874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 323 B/s wr, 11 op/s 2023-03-02T20:47:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:24 smithi136 ceph-mon[125702]: pgmap v18875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:24.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:47:24.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:47:24.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:47:24.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:47:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:24 smithi057 ceph-mon[92072]: pgmap v18875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:24.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:47:24.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:47:24.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:47:24.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:47:24.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:24 smithi122 ceph-mon[125440]: pgmap v18875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:24.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:47:24.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:47:24.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:47:24.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:47:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:26 smithi136 ceph-mon[125702]: pgmap v18876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:26 smithi057 ceph-mon[92072]: pgmap v18876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:26 smithi122 ceph-mon[125440]: pgmap v18876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:47:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:28 smithi136 ceph-mon[125702]: pgmap v18877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:47:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:28 smithi057 ceph-mon[92072]: pgmap v18877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:47:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:28 smithi122 ceph-mon[125440]: pgmap v18877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:47:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:30 smithi136 ceph-mon[125702]: pgmap v18878: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:47:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:30 smithi057 ceph-mon[92072]: pgmap v18878: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:47:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:30 smithi122 ceph-mon[125440]: pgmap v18878: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:47:31.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:31.069+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:47:31.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:31.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:47:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:31.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:47:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:31.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:47:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:31.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:47:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:32 smithi136 ceph-mon[125702]: pgmap v18879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T20:47:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:32 smithi057 ceph-mon[92072]: pgmap v18879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T20:47:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:32 smithi122 ceph-mon[125440]: pgmap v18879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T20:47:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:34 smithi136 ceph-mon[125702]: pgmap v18880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:34 smithi057 ceph-mon[92072]: pgmap v18880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:34 smithi122 ceph-mon[125440]: pgmap v18880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:36.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:36 smithi136 ceph-mon[125702]: pgmap v18881: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:36 smithi057 ceph-mon[92072]: pgmap v18881: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:36 smithi122 ceph-mon[125440]: pgmap v18881: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:38.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:38 smithi136 ceph-mon[125702]: pgmap v18882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:38.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:38 smithi057 ceph-mon[92072]: pgmap v18882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:38.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:38 smithi122 ceph-mon[125440]: pgmap v18882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:40 smithi136 ceph-mon[125702]: pgmap v18883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:40 smithi057 ceph-mon[92072]: pgmap v18883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:40.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:40 smithi122 ceph-mon[125440]: pgmap v18883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:42 smithi136 ceph-mon[125702]: pgmap v18884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:42 smithi057 ceph-mon[92072]: pgmap v18884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:42.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:42 smithi122 ceph-mon[125440]: pgmap v18884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:44 smithi136 ceph-mon[125702]: pgmap v18885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:44 smithi057 ceph-mon[92072]: pgmap v18885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:44 smithi122 ceph-mon[125440]: pgmap v18885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:46.085+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:47:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:46.086+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:47:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:46.086+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:47:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:46.086+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:47:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:47:46.086+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:47:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:46 smithi057 ceph-mon[92072]: pgmap v18886: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:47:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:46 smithi122 ceph-mon[125440]: pgmap v18886: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:47:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:46 smithi136 ceph-mon[125702]: pgmap v18886: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:47:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:48 smithi057 ceph-mon[92072]: pgmap v18887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:48.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:48 smithi122 ceph-mon[125440]: pgmap v18887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:48 smithi136 ceph-mon[125702]: pgmap v18887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:50 smithi057 ceph-mon[92072]: pgmap v18888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:47:50.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:50 smithi122 ceph-mon[125440]: pgmap v18888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:47:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:50 smithi136 ceph-mon[125702]: pgmap v18888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:47:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:52 smithi057 ceph-mon[92072]: pgmap v18889: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:47:52.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:52 smithi122 ceph-mon[125440]: pgmap v18889: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:47:52.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:52 smithi136 ceph-mon[125702]: pgmap v18889: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:47:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:54 smithi057 ceph-mon[92072]: pgmap v18890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:54.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:54 smithi122 ceph-mon[125440]: pgmap v18890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:54 smithi136 ceph-mon[125702]: pgmap v18890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:56 smithi057 ceph-mon[92072]: pgmap v18891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:56 smithi122 ceph-mon[125440]: pgmap v18891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:56 smithi136 ceph-mon[125702]: pgmap v18891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:47:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:47:58 smithi057 ceph-mon[92072]: pgmap v18892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:58.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:47:58 smithi122 ceph-mon[125440]: pgmap v18892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:47:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:47:58 smithi136 ceph-mon[125702]: pgmap v18892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:00 smithi057 ceph-mon[92072]: pgmap v18893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:00 smithi122 ceph-mon[125440]: pgmap v18893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:00 smithi136 ceph-mon[125702]: pgmap v18893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:01.098+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:48:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:01.099+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:48:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:01.099+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:48:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:01.099+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:48:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:01.099+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:48:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:02 smithi057 ceph-mon[92072]: pgmap v18894: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:02.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:02 smithi122 ceph-mon[125440]: pgmap v18894: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:02 smithi136 ceph-mon[125702]: pgmap v18894: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:04 smithi057 ceph-mon[92072]: pgmap v18895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:48:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:04 smithi122 ceph-mon[125440]: pgmap v18895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:48:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:04 smithi136 ceph-mon[125702]: pgmap v18895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:48:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:06 smithi057 ceph-mon[92072]: pgmap v18896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:48:06.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:06 smithi122 ceph-mon[125440]: pgmap v18896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:48:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:06 smithi136 ceph-mon[125702]: pgmap v18896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:48:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:07 smithi057 ceph-mon[92072]: osdmap e1254: 12 total, 12 up, 12 in 2023-03-02T20:48:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:07 smithi122 ceph-mon[125440]: osdmap e1254: 12 total, 12 up, 12 in 2023-03-02T20:48:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:07 smithi136 ceph-mon[125702]: osdmap e1254: 12 total, 12 up, 12 in 2023-03-02T20:48:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:08 smithi057 ceph-mon[92072]: pgmap v18898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:48:08.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:08 smithi122 ceph-mon[125440]: pgmap v18898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:48:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:08 smithi136 ceph-mon[125702]: pgmap v18898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:48:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:10 smithi057 ceph-mon[92072]: pgmap v18899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:48:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:10 smithi122 ceph-mon[125440]: pgmap v18899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:48:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:10 smithi136 ceph-mon[125702]: pgmap v18899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:48:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:12 smithi057 ceph-mon[92072]: pgmap v18900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:48:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:12 smithi122 ceph-mon[125440]: pgmap v18900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:48:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:12 smithi136 ceph-mon[125702]: pgmap v18900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:48:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:14 smithi057 ceph-mon[92072]: pgmap v18901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:48:14.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:14 smithi057 ceph-mon[92072]: osdmap e1255: 12 total, 12 up, 12 in 2023-03-02T20:48:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:14 smithi122 ceph-mon[125440]: pgmap v18901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:48:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:14 smithi122 ceph-mon[125440]: osdmap e1255: 12 total, 12 up, 12 in 2023-03-02T20:48:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:14 smithi136 ceph-mon[125702]: pgmap v18901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:48:14.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:14 smithi136 ceph-mon[125702]: osdmap e1255: 12 total, 12 up, 12 in 2023-03-02T20:48:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:16.112+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:48:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:16.112+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:48:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:16.112+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:48:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:16.112+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:48:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:16.112+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:48:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:16 smithi057 ceph-mon[92072]: pgmap v18903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:48:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:16 smithi122 ceph-mon[125440]: pgmap v18903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:48:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:16 smithi136 ceph-mon[125702]: pgmap v18903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:48:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:18 smithi057 ceph-mon[92072]: pgmap v18904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:48:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:18 smithi122 ceph-mon[125440]: pgmap v18904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:48:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:18 smithi136 ceph-mon[125702]: pgmap v18904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:48:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:20 smithi057 ceph-mon[92072]: pgmap v18905: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:48:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:20 smithi122 ceph-mon[125440]: pgmap v18905: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:48:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:20 smithi136 ceph-mon[125702]: pgmap v18905: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:48:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:22 smithi122 ceph-mon[125440]: pgmap v18906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:48:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:22 smithi136 ceph-mon[125702]: pgmap v18906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:48:22.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:22 smithi057 ceph-mon[92072]: pgmap v18906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T20:48:23.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:23 smithi136 ceph-mon[125702]: pgmap v18907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T20:48:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:23 smithi057 ceph-mon[92072]: pgmap v18907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T20:48:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:23 smithi122 ceph-mon[125440]: pgmap v18907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T20:48:25.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:48:25.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:48:25.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:48:25.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:48:25.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:48:25.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:48:25.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:48:25.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:48:25.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:48:25.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:48:25.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:48:25.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:48:26.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:26 smithi136 ceph-mon[125702]: pgmap v18908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:48:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:26 smithi057 ceph-mon[92072]: pgmap v18908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:48:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:26 smithi122 ceph-mon[125440]: pgmap v18908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T20:48:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:28 smithi136 ceph-mon[125702]: pgmap v18909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:28 smithi057 ceph-mon[92072]: pgmap v18909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:28 smithi122 ceph-mon[125440]: pgmap v18909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:30 smithi136 ceph-mon[125702]: pgmap v18910: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:30 smithi057 ceph-mon[92072]: pgmap v18910: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:30 smithi122 ceph-mon[125440]: pgmap v18910: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:31.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:48:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:31.128+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:48:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:31.128+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:48:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:31.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:48:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:31.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:48:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:32 smithi136 ceph-mon[125702]: pgmap v18911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:32 smithi057 ceph-mon[92072]: pgmap v18911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:32 smithi122 ceph-mon[125440]: pgmap v18911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:34 smithi136 ceph-mon[125702]: pgmap v18912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:34 smithi057 ceph-mon[92072]: pgmap v18912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:34.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:34 smithi122 ceph-mon[125440]: pgmap v18912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:36 smithi136 ceph-mon[125702]: pgmap v18913: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:36 smithi057 ceph-mon[92072]: pgmap v18913: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:36 smithi122 ceph-mon[125440]: pgmap v18913: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:38 smithi136 ceph-mon[125702]: pgmap v18914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:38 smithi057 ceph-mon[92072]: pgmap v18914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:38 smithi122 ceph-mon[125440]: pgmap v18914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:40 smithi057 ceph-mon[92072]: pgmap v18915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:40.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:40 smithi122 ceph-mon[125440]: pgmap v18915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:40 smithi136 ceph-mon[125702]: pgmap v18915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:42 smithi057 ceph-mon[92072]: pgmap v18916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:42.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:42 smithi122 ceph-mon[125440]: pgmap v18916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:42 smithi136 ceph-mon[125702]: pgmap v18916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:44 smithi057 ceph-mon[92072]: pgmap v18917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:44 smithi122 ceph-mon[125440]: pgmap v18917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:44 smithi136 ceph-mon[125702]: pgmap v18917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:46.144+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:48:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:46.144+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:48:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:46.144+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:48:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:46.144+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:48:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:48:46.144+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:48:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:46 smithi057 ceph-mon[92072]: pgmap v18918: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:46 smithi122 ceph-mon[125440]: pgmap v18918: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:46 smithi136 ceph-mon[125702]: pgmap v18918: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:48 smithi057 ceph-mon[92072]: pgmap v18919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:48.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:48 smithi122 ceph-mon[125440]: pgmap v18919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:48 smithi136 ceph-mon[125702]: pgmap v18919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:50 smithi057 ceph-mon[92072]: pgmap v18920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:50.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:50 smithi122 ceph-mon[125440]: pgmap v18920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:50 smithi136 ceph-mon[125702]: pgmap v18920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:52 smithi057 ceph-mon[92072]: pgmap v18921: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:52.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:52 smithi122 ceph-mon[125440]: pgmap v18921: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:52 smithi136 ceph-mon[125702]: pgmap v18921: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:48:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:54 smithi057 ceph-mon[92072]: pgmap v18922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:54.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:54 smithi122 ceph-mon[125440]: pgmap v18922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:54 smithi136 ceph-mon[125702]: pgmap v18922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:56 smithi057 ceph-mon[92072]: pgmap v18923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:48:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:56 smithi122 ceph-mon[125440]: pgmap v18923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:48:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:56 smithi136 ceph-mon[125702]: pgmap v18923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:48:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:48:58 smithi057 ceph-mon[92072]: pgmap v18924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:58.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:48:58 smithi122 ceph-mon[125440]: pgmap v18924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:48:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:48:58 smithi136 ceph-mon[125702]: pgmap v18924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:00 smithi057 ceph-mon[92072]: pgmap v18925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:49:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:00 smithi122 ceph-mon[125440]: pgmap v18925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:49:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:00 smithi136 ceph-mon[125702]: pgmap v18925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:49:01.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:01.153+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:49:01.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:01.153+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:49:01.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:01.153+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:49:01.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:01.153+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:49:01.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:01.153+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:49:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:02 smithi057 ceph-mon[92072]: pgmap v18926: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:49:02.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:02 smithi122 ceph-mon[125440]: pgmap v18926: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:49:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:02 smithi136 ceph-mon[125702]: pgmap v18926: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:49:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:04 smithi057 ceph-mon[92072]: pgmap v18927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T20:49:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:04 smithi122 ceph-mon[125440]: pgmap v18927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T20:49:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:04 smithi136 ceph-mon[125702]: pgmap v18927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-02T20:49:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:06 smithi122 ceph-mon[125440]: pgmap v18928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:49:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:06 smithi136 ceph-mon[125702]: pgmap v18928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:49:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:06 smithi057 ceph-mon[92072]: pgmap v18928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:49:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:07 smithi122 ceph-mon[125440]: osdmap e1256: 12 total, 12 up, 12 in 2023-03-02T20:49:07.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:07 smithi122 ceph-mon[125440]: pgmap v18930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:49:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:07 smithi136 ceph-mon[125702]: osdmap e1256: 12 total, 12 up, 12 in 2023-03-02T20:49:07.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:07 smithi136 ceph-mon[125702]: pgmap v18930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:49:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:07 smithi057 ceph-mon[92072]: osdmap e1256: 12 total, 12 up, 12 in 2023-03-02T20:49:07.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:07 smithi057 ceph-mon[92072]: pgmap v18930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:49:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:10 smithi136 ceph-mon[125702]: pgmap v18931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:49:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:10 smithi057 ceph-mon[92072]: pgmap v18931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:49:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:10 smithi122 ceph-mon[125440]: pgmap v18931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:49:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:12 smithi136 ceph-mon[125702]: pgmap v18932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:49:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:12 smithi057 ceph-mon[92072]: pgmap v18932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:49:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:12 smithi122 ceph-mon[125440]: pgmap v18932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:49:14.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:14 smithi136 ceph-mon[125702]: pgmap v18933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:49:14.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:14 smithi136 ceph-mon[125702]: osdmap e1257: 12 total, 12 up, 12 in 2023-03-02T20:49:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:14 smithi057 ceph-mon[92072]: pgmap v18933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:49:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:14 smithi057 ceph-mon[92072]: osdmap e1257: 12 total, 12 up, 12 in 2023-03-02T20:49:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:14 smithi122 ceph-mon[125440]: pgmap v18933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:49:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:14 smithi122 ceph-mon[125440]: osdmap e1257: 12 total, 12 up, 12 in 2023-03-02T20:49:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:16.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:49:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:16.164+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:49:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:16.164+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:49:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:16.164+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:49:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:16.164+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:49:16.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:16 smithi136 ceph-mon[125702]: pgmap v18935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:49:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:16 smithi057 ceph-mon[92072]: pgmap v18935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:49:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:16 smithi122 ceph-mon[125440]: pgmap v18935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:49:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:18 smithi136 ceph-mon[125702]: pgmap v18936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:49:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:18 smithi057 ceph-mon[92072]: pgmap v18936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:49:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:18 smithi122 ceph-mon[125440]: pgmap v18936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:49:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:20 smithi057 ceph-mon[92072]: pgmap v18937: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:49:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:20 smithi122 ceph-mon[125440]: pgmap v18937: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:49:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:20 smithi136 ceph-mon[125702]: pgmap v18937: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:49:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:22 smithi057 ceph-mon[92072]: pgmap v18938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:49:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:22 smithi122 ceph-mon[125440]: pgmap v18938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:49:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:22 smithi136 ceph-mon[125702]: pgmap v18938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:49:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:24 smithi057 ceph-mon[92072]: pgmap v18939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:49:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:24 smithi122 ceph-mon[125440]: pgmap v18939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:49:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:24 smithi136 ceph-mon[125702]: pgmap v18939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:49:25.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:49:25.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:49:25.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:49:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:26 smithi057 ceph-mon[92072]: pgmap v18940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:49:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:49:26.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:49:26.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:26 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:49:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:26 smithi122 ceph-mon[125440]: pgmap v18940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:49:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:49:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:49:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:26 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:49:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:26 smithi136 ceph-mon[125702]: pgmap v18940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:49:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:49:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:49:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:26 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:49:28.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:28 smithi057 ceph-mon[92072]: pgmap v18941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:49:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:28 smithi122 ceph-mon[125440]: pgmap v18941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:49:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:28 smithi136 ceph-mon[125702]: pgmap v18941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:49:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:30 smithi057 ceph-mon[92072]: pgmap v18942: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:30.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:30 smithi122 ceph-mon[125440]: pgmap v18942: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:30 smithi136 ceph-mon[125702]: pgmap v18942: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:31.170+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:49:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:31.171+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:49:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:31.171+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:49:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:31.171+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:49:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:31.171+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:49:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:32 smithi057 ceph-mon[92072]: pgmap v18943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:32 smithi122 ceph-mon[125440]: pgmap v18943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:32 smithi136 ceph-mon[125702]: pgmap v18943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:34 smithi057 ceph-mon[92072]: pgmap v18944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:34 smithi122 ceph-mon[125440]: pgmap v18944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:34 smithi136 ceph-mon[125702]: pgmap v18944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:36 smithi057 ceph-mon[92072]: pgmap v18945: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:36 smithi122 ceph-mon[125440]: pgmap v18945: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:36 smithi136 ceph-mon[125702]: pgmap v18945: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:38 smithi057 ceph-mon[92072]: pgmap v18946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:38.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:38 smithi122 ceph-mon[125440]: pgmap v18946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:38 smithi136 ceph-mon[125702]: pgmap v18946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:40 smithi057 ceph-mon[92072]: pgmap v18947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:40 smithi122 ceph-mon[125440]: pgmap v18947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:40 smithi136 ceph-mon[125702]: pgmap v18947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:42 smithi057 ceph-mon[92072]: pgmap v18948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:42.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:42 smithi122 ceph-mon[125440]: pgmap v18948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:42.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:42 smithi136 ceph-mon[125702]: pgmap v18948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:44 smithi057 ceph-mon[92072]: pgmap v18949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:44 smithi122 ceph-mon[125440]: pgmap v18949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:44 smithi136 ceph-mon[125702]: pgmap v18949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:46.186+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:49:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:46.186+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:49:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:46.186+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:49:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:46.186+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:49:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:49:46.186+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:49:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:46 smithi057 ceph-mon[92072]: pgmap v18950: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:46 smithi122 ceph-mon[125440]: pgmap v18950: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:46 smithi136 ceph-mon[125702]: pgmap v18950: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:48 smithi057 ceph-mon[92072]: pgmap v18951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:48.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:48 smithi122 ceph-mon[125440]: pgmap v18951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:48.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:48 smithi136 ceph-mon[125702]: pgmap v18951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:50 smithi057 ceph-mon[92072]: pgmap v18952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:50.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:50 smithi122 ceph-mon[125440]: pgmap v18952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:50 smithi136 ceph-mon[125702]: pgmap v18952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:52.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:52 smithi122 ceph-mon[125440]: pgmap v18953: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:52 smithi136 ceph-mon[125702]: pgmap v18953: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:52.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:52 smithi057 ceph-mon[92072]: pgmap v18953: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:54.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:54 smithi122 ceph-mon[125440]: pgmap v18954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:54 smithi136 ceph-mon[125702]: pgmap v18954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:54.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:54 smithi057 ceph-mon[92072]: pgmap v18954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:56 smithi122 ceph-mon[125440]: pgmap v18955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:56 smithi136 ceph-mon[125702]: pgmap v18955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:56.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:56 smithi057 ceph-mon[92072]: pgmap v18955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:49:57 smithi136 ceph-mon[125702]: pgmap v18956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:57.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:49:57 smithi057 ceph-mon[92072]: pgmap v18956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:49:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:49:57 smithi122 ceph-mon[125440]: pgmap v18956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:00 smithi136 ceph-mon[125702]: pgmap v18957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T20:50:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:00 smithi057 ceph-mon[92072]: pgmap v18957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:50:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T20:50:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:00 smithi122 ceph-mon[125440]: pgmap v18957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:50:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T20:50:01.204 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:01.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:50:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:01.202+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:50:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:01.202+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:50:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:01.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:50:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:01.202+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:50:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:02 smithi136 ceph-mon[125702]: pgmap v18958: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:50:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:02 smithi057 ceph-mon[92072]: pgmap v18958: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:50:02.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:02 smithi122 ceph-mon[125440]: pgmap v18958: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T20:50:04.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:04 smithi136 ceph-mon[125702]: pgmap v18959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:50:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:04 smithi057 ceph-mon[92072]: pgmap v18959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:50:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:04 smithi122 ceph-mon[125440]: pgmap v18959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:50:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:06 smithi057 ceph-mon[92072]: pgmap v18960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:50:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:06 smithi122 ceph-mon[125440]: pgmap v18960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:50:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:06 smithi136 ceph-mon[125702]: pgmap v18960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T20:50:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:07 smithi057 ceph-mon[92072]: osdmap e1258: 12 total, 12 up, 12 in 2023-03-02T20:50:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:07 smithi122 ceph-mon[125440]: osdmap e1258: 12 total, 12 up, 12 in 2023-03-02T20:50:07.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:07 smithi136 ceph-mon[125702]: osdmap e1258: 12 total, 12 up, 12 in 2023-03-02T20:50:08.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:08 smithi057 ceph-mon[92072]: pgmap v18962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:50:08.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:08 smithi122 ceph-mon[125440]: pgmap v18962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:50:08.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:08 smithi136 ceph-mon[125702]: pgmap v18962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:50:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:10 smithi057 ceph-mon[92072]: pgmap v18963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:50:10.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:10 smithi122 ceph-mon[125440]: pgmap v18963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:50:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:10 smithi136 ceph-mon[125702]: pgmap v18963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:50:12.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:12 smithi057 ceph-mon[92072]: pgmap v18964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:50:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:12 smithi122 ceph-mon[125440]: pgmap v18964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:50:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:12 smithi136 ceph-mon[125702]: pgmap v18964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:50:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:13.498+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:50:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:13.498+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T20:50:13.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:13.498+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 274 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:50:13.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:13.499+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 273 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T20:50:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:14 smithi057 ceph-mon[92072]: pgmap v18965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:50:14.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:14 smithi057 ceph-mon[92072]: osdmap e1259: 12 total, 12 up, 12 in 2023-03-02T20:50:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:14 smithi122 ceph-mon[125440]: pgmap v18965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:50:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:14 smithi122 ceph-mon[125440]: osdmap e1259: 12 total, 12 up, 12 in 2023-03-02T20:50:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:14 smithi136 ceph-mon[125702]: pgmap v18965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:50:14.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:14 smithi136 ceph-mon[125702]: osdmap e1259: 12 total, 12 up, 12 in 2023-03-02T20:50:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:16.215+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:50:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:16.215+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:50:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:16.215+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:50:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:16.215+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:50:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:16.215+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:50:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:16 smithi057 ceph-mon[92072]: pgmap v18967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T20:50:16.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:16 smithi122 ceph-mon[125440]: pgmap v18967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T20:50:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:16 smithi136 ceph-mon[125702]: pgmap v18967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T20:50:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:18 smithi057 ceph-mon[92072]: pgmap v18968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:50:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:18 smithi122 ceph-mon[125440]: pgmap v18968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:50:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:18 smithi136 ceph-mon[125702]: pgmap v18968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:50:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:20 smithi057 ceph-mon[92072]: pgmap v18969: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:50:20.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:20 smithi122 ceph-mon[125440]: pgmap v18969: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:50:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:20 smithi136 ceph-mon[125702]: pgmap v18969: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:50:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:22 smithi057 ceph-mon[92072]: pgmap v18970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:50:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:22 smithi122 ceph-mon[125440]: pgmap v18970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:50:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:22 smithi136 ceph-mon[125702]: pgmap v18970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:50:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:24 smithi057 ceph-mon[92072]: pgmap v18971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:50:24.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:24 smithi122 ceph-mon[125440]: pgmap v18971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:50:24.723 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:24 smithi136 ceph-mon[125702]: pgmap v18971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:50:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:26 smithi057 ceph-mon[92072]: pgmap v18972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:50:26.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:50:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:26 smithi122 ceph-mon[125440]: pgmap v18972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:50:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:50:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:26 smithi136 ceph-mon[125702]: pgmap v18972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:50:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:50:27.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:50:27.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:50:27.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:50:27.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:50:27.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:50:27.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:50:27.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:50:27.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:50:27.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:50:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:28 smithi057 ceph-mon[92072]: pgmap v18973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:50:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:28 smithi122 ceph-mon[125440]: pgmap v18973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:50:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:28 smithi136 ceph-mon[125702]: pgmap v18973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:50:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:30 smithi057 ceph-mon[92072]: pgmap v18974: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:30.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:30 smithi122 ceph-mon[125440]: pgmap v18974: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:30 smithi136 ceph-mon[125702]: pgmap v18974: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:31.231+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:50:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:31.232+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:50:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:31.232+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:50:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:31.232+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:50:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:31.232+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:50:32.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:32 smithi057 ceph-mon[92072]: pgmap v18975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:32.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:32 smithi122 ceph-mon[125440]: pgmap v18975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:32 smithi136 ceph-mon[125702]: pgmap v18975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:34 smithi057 ceph-mon[92072]: pgmap v18976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:34.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:34 smithi122 ceph-mon[125440]: pgmap v18976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:34.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:34 smithi136 ceph-mon[125702]: pgmap v18976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:36 smithi057 ceph-mon[92072]: pgmap v18977: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:36.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:36 smithi122 ceph-mon[125440]: pgmap v18977: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:36 smithi136 ceph-mon[125702]: pgmap v18977: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:38 smithi057 ceph-mon[92072]: pgmap v18978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:38.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:38 smithi122 ceph-mon[125440]: pgmap v18978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:38 smithi136 ceph-mon[125702]: pgmap v18978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:40 smithi057 ceph-mon[92072]: pgmap v18979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:40.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:40 smithi122 ceph-mon[125440]: pgmap v18979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:40 smithi136 ceph-mon[125702]: pgmap v18979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:42.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:42 smithi122 ceph-mon[125440]: pgmap v18980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:42 smithi136 ceph-mon[125702]: pgmap v18980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:42 smithi057 ceph-mon[92072]: pgmap v18980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:44 smithi122 ceph-mon[125440]: pgmap v18981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:44.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:44 smithi136 ceph-mon[125702]: pgmap v18981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:44.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:44 smithi057 ceph-mon[92072]: pgmap v18981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:46.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:50:46.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:46.244+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:50:46.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:46.244+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:50:46.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:46.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:50:46.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:50:46.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:50:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:46 smithi122 ceph-mon[125440]: pgmap v18982: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:46 smithi136 ceph-mon[125702]: pgmap v18982: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:46.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:46 smithi057 ceph-mon[92072]: pgmap v18982: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:48 smithi136 ceph-mon[125702]: pgmap v18983: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:48 smithi057 ceph-mon[92072]: pgmap v18983: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:48.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:48 smithi122 ceph-mon[125440]: pgmap v18983: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:50 smithi136 ceph-mon[125702]: pgmap v18984: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:50.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:50 smithi057 ceph-mon[92072]: pgmap v18984: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:50.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:50 smithi122 ceph-mon[125440]: pgmap v18984: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:51.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:51 smithi136 ceph-mon[125702]: pgmap v18985: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:51.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:51 smithi057 ceph-mon[92072]: pgmap v18985: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:51.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:51 smithi122 ceph-mon[125440]: pgmap v18985: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:53 smithi136 ceph-mon[125702]: pgmap v18986: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:53 smithi057 ceph-mon[92072]: pgmap v18986: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:54.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:53 smithi122 ceph-mon[125440]: pgmap v18986: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:56 smithi057 ceph-mon[92072]: pgmap v18987: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:56.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:56 smithi122 ceph-mon[125440]: pgmap v18987: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:56 smithi136 ceph-mon[125702]: pgmap v18987: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:50:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:50:58 smithi057 ceph-mon[92072]: pgmap v18988: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:58.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:50:58 smithi122 ceph-mon[125440]: pgmap v18988: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:50:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:50:58 smithi136 ceph-mon[125702]: pgmap v18988: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:00 smithi057 ceph-mon[92072]: pgmap v18989: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:00.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:00 smithi122 ceph-mon[125440]: pgmap v18989: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:00 smithi136 ceph-mon[125702]: pgmap v18989: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:01.259+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:51:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:01.259+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:51:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:01.259+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:51:01.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:01.259+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:51:01.263 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:01.259+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:51:02.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:02 smithi057 ceph-mon[92072]: pgmap v18990: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:02.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:02 smithi122 ceph-mon[125440]: pgmap v18990: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:02.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:02 smithi136 ceph-mon[125702]: pgmap v18990: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:04.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:04 smithi057 ceph-mon[92072]: pgmap v18991: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:51:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:04 smithi122 ceph-mon[125440]: pgmap v18991: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:51:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:04 smithi136 ceph-mon[125702]: pgmap v18991: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:51:06.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:06 smithi057 ceph-mon[92072]: pgmap v18992: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:51:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:06 smithi122 ceph-mon[125440]: pgmap v18992: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:51:06.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:06 smithi136 ceph-mon[125702]: pgmap v18992: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:51:07.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:07 smithi057 ceph-mon[92072]: osdmap e1260: 12 total, 12 up, 12 in 2023-03-02T20:51:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:07 smithi122 ceph-mon[125440]: osdmap e1260: 12 total, 12 up, 12 in 2023-03-02T20:51:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:07 smithi136 ceph-mon[125702]: osdmap e1260: 12 total, 12 up, 12 in 2023-03-02T20:51:08.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:08 smithi057 ceph-mon[92072]: pgmap v18994: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:51:08.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:08 smithi122 ceph-mon[125440]: pgmap v18994: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:51:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:08 smithi136 ceph-mon[125702]: pgmap v18994: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:51:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:10 smithi057 ceph-mon[92072]: pgmap v18995: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:51:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:10 smithi122 ceph-mon[125440]: pgmap v18995: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:51:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:10 smithi136 ceph-mon[125702]: pgmap v18995: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:51:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:12 smithi057 ceph-mon[92072]: pgmap v18996: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:51:12.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:12 smithi122 ceph-mon[125440]: pgmap v18996: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:51:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:12 smithi136 ceph-mon[125702]: pgmap v18996: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:51:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:14 smithi057 ceph-mon[92072]: pgmap v18997: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:51:14.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:14 smithi057 ceph-mon[92072]: osdmap e1261: 12 total, 12 up, 12 in 2023-03-02T20:51:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:14 smithi122 ceph-mon[125440]: pgmap v18997: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:51:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:14 smithi122 ceph-mon[125440]: osdmap e1261: 12 total, 12 up, 12 in 2023-03-02T20:51:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:14 smithi136 ceph-mon[125702]: pgmap v18997: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:51:14.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:14 smithi136 ceph-mon[125702]: osdmap e1261: 12 total, 12 up, 12 in 2023-03-02T20:51:16.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:16.265+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:51:16.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:16.265+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:51:16.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:16.265+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:51:16.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:16.265+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:51:16.270 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:16.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:51:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:16 smithi057 ceph-mon[92072]: pgmap v18999: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:51:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:16 smithi122 ceph-mon[125440]: pgmap v18999: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:51:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:16 smithi136 ceph-mon[125702]: pgmap v18999: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:51:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:18 smithi057 ceph-mon[92072]: pgmap v19000: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:51:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:18 smithi122 ceph-mon[125440]: pgmap v19000: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:51:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:18 smithi136 ceph-mon[125702]: pgmap v19000: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:51:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:20 smithi057 ceph-mon[92072]: pgmap v19001: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:51:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:20 smithi122 ceph-mon[125440]: pgmap v19001: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:51:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:20 smithi136 ceph-mon[125702]: pgmap v19001: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:51:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:22 smithi057 ceph-mon[92072]: pgmap v19002: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:51:22.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:22 smithi122 ceph-mon[125440]: pgmap v19002: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:51:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:22 smithi136 ceph-mon[125702]: pgmap v19002: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:51:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:24 smithi057 ceph-mon[92072]: pgmap v19003: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:51:24.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:24 smithi122 ceph-mon[125440]: pgmap v19003: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:51:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:24 smithi136 ceph-mon[125702]: pgmap v19003: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:51:26.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:26 smithi122 ceph-mon[125440]: pgmap v19004: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:51:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:26 smithi136 ceph-mon[125702]: pgmap v19004: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:51:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:26 smithi057 ceph-mon[92072]: pgmap v19004: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:51:27.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:51:27.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:51:27.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:51:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:28 smithi122 ceph-mon[125440]: pgmap v19005: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:51:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:51:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:51:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:51:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:28 smithi136 ceph-mon[125702]: pgmap v19005: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:51:28.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:51:28.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:51:28.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:51:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:28 smithi057 ceph-mon[92072]: pgmap v19005: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:51:28.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:51:28.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:51:28.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:51:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:30 smithi136 ceph-mon[125702]: pgmap v19006: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:30 smithi057 ceph-mon[92072]: pgmap v19006: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:30.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:30 smithi122 ceph-mon[125440]: pgmap v19006: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:31.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:51:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:31.282+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:51:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:31.282+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:51:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:31.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:51:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:31.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:51:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:32 smithi136 ceph-mon[125702]: pgmap v19007: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:32.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:32 smithi057 ceph-mon[92072]: pgmap v19007: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:32 smithi122 ceph-mon[125440]: pgmap v19007: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:34 smithi136 ceph-mon[125702]: pgmap v19008: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:34 smithi057 ceph-mon[92072]: pgmap v19008: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:34.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:34 smithi122 ceph-mon[125440]: pgmap v19008: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:35.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:35 smithi136 ceph-mon[125702]: pgmap v19009: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:35.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:35 smithi057 ceph-mon[92072]: pgmap v19009: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:35.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:35 smithi122 ceph-mon[125440]: pgmap v19009: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:38 smithi136 ceph-mon[125702]: pgmap v19010: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:38 smithi057 ceph-mon[92072]: pgmap v19010: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:38 smithi122 ceph-mon[125440]: pgmap v19010: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:40 smithi057 ceph-mon[92072]: pgmap v19011: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:40.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:40 smithi122 ceph-mon[125440]: pgmap v19011: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:40 smithi136 ceph-mon[125702]: pgmap v19011: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:42 smithi057 ceph-mon[92072]: pgmap v19012: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:42.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:42 smithi122 ceph-mon[125440]: pgmap v19012: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:42 smithi136 ceph-mon[125702]: pgmap v19012: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:44 smithi057 ceph-mon[92072]: pgmap v19013: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:44 smithi122 ceph-mon[125440]: pgmap v19013: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:44 smithi136 ceph-mon[125702]: pgmap v19013: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:46.288+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:51:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:46.288+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:51:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:46.288+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:51:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:46.288+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:51:46.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:51:46.288+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:51:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:46 smithi057 ceph-mon[92072]: pgmap v19014: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:46 smithi122 ceph-mon[125440]: pgmap v19014: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:46 smithi136 ceph-mon[125702]: pgmap v19014: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:48 smithi057 ceph-mon[92072]: pgmap v19015: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:48.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:48 smithi122 ceph-mon[125440]: pgmap v19015: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:48 smithi136 ceph-mon[125702]: pgmap v19015: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:50 smithi057 ceph-mon[92072]: pgmap v19016: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:50.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:50 smithi122 ceph-mon[125440]: pgmap v19016: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:50 smithi136 ceph-mon[125702]: pgmap v19016: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:52 smithi057 ceph-mon[92072]: pgmap v19017: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:52.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:52 smithi122 ceph-mon[125440]: pgmap v19017: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:52 smithi136 ceph-mon[125702]: pgmap v19017: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:54 smithi057 ceph-mon[92072]: pgmap v19018: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:54 smithi122 ceph-mon[125440]: pgmap v19018: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:54 smithi136 ceph-mon[125702]: pgmap v19018: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:56 smithi057 ceph-mon[92072]: pgmap v19019: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:56 smithi122 ceph-mon[125440]: pgmap v19019: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:56 smithi136 ceph-mon[125702]: pgmap v19019: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:51:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:51:58 smithi057 ceph-mon[92072]: pgmap v19020: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:51:58 smithi122 ceph-mon[125440]: pgmap v19020: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:51:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:51:58 smithi136 ceph-mon[125702]: pgmap v19020: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:00 smithi057 ceph-mon[92072]: pgmap v19021: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:00 smithi122 ceph-mon[125440]: pgmap v19021: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:00 smithi136 ceph-mon[125702]: pgmap v19021: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:01.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:01.295+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:52:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:01.296+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:52:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:01.296+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:52:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:01.296+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:52:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:01.296+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:52:02.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:02 smithi122 ceph-mon[125440]: pgmap v19022: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:02 smithi136 ceph-mon[125702]: pgmap v19022: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:02 smithi057 ceph-mon[92072]: pgmap v19022: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:04.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:04 smithi122 ceph-mon[125440]: pgmap v19023: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:52:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:04 smithi136 ceph-mon[125702]: pgmap v19023: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:52:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:04 smithi057 ceph-mon[92072]: pgmap v19023: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:52:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:06 smithi122 ceph-mon[125440]: pgmap v19024: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:52:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:06 smithi136 ceph-mon[125702]: pgmap v19024: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:52:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:06 smithi057 ceph-mon[92072]: pgmap v19024: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:52:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:07 smithi136 ceph-mon[125702]: osdmap e1262: 12 total, 12 up, 12 in 2023-03-02T20:52:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:07 smithi057 ceph-mon[92072]: osdmap e1262: 12 total, 12 up, 12 in 2023-03-02T20:52:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:07 smithi122 ceph-mon[125440]: osdmap e1262: 12 total, 12 up, 12 in 2023-03-02T20:52:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:08 smithi136 ceph-mon[125702]: pgmap v19026: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:52:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:08 smithi057 ceph-mon[92072]: pgmap v19026: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:52:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:08 smithi122 ceph-mon[125440]: pgmap v19026: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:52:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:10 smithi136 ceph-mon[125702]: pgmap v19027: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:52:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:10 smithi057 ceph-mon[92072]: pgmap v19027: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:52:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:10 smithi122 ceph-mon[125440]: pgmap v19027: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:52:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:12 smithi136 ceph-mon[125702]: pgmap v19028: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:52:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:12 smithi057 ceph-mon[92072]: pgmap v19028: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:52:12.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:12 smithi122 ceph-mon[125440]: pgmap v19028: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:52:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:14 smithi136 ceph-mon[125702]: pgmap v19029: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:52:14.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:14 smithi136 ceph-mon[125702]: osdmap e1263: 12 total, 12 up, 12 in 2023-03-02T20:52:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:14 smithi057 ceph-mon[92072]: pgmap v19029: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:52:14.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:14 smithi057 ceph-mon[92072]: osdmap e1263: 12 total, 12 up, 12 in 2023-03-02T20:52:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:14 smithi122 ceph-mon[125440]: pgmap v19029: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:52:14.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:14 smithi122 ceph-mon[125440]: osdmap e1263: 12 total, 12 up, 12 in 2023-03-02T20:52:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:15 smithi136 ceph-mon[125702]: pgmap v19031: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:52:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:15 smithi057 ceph-mon[92072]: pgmap v19031: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:52:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:15 smithi122 ceph-mon[125440]: pgmap v19031: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:52:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:16.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:52:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:16.311+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:52:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:16.311+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:52:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:16.311+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:52:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:16.311+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:52:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:18 smithi136 ceph-mon[125702]: pgmap v19032: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:52:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:18 smithi057 ceph-mon[92072]: pgmap v19032: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:52:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:18 smithi122 ceph-mon[125440]: pgmap v19032: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:52:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:20 smithi057 ceph-mon[92072]: pgmap v19033: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:52:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:20 smithi122 ceph-mon[125440]: pgmap v19033: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:52:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:20 smithi136 ceph-mon[125702]: pgmap v19033: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:52:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:22 smithi057 ceph-mon[92072]: pgmap v19034: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:52:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:22 smithi122 ceph-mon[125440]: pgmap v19034: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:52:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:22 smithi136 ceph-mon[125702]: pgmap v19034: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:52:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:24 smithi057 ceph-mon[92072]: pgmap v19035: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:52:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:24 smithi122 ceph-mon[125440]: pgmap v19035: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:52:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:24 smithi136 ceph-mon[125702]: pgmap v19035: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:52:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:26 smithi057 ceph-mon[92072]: pgmap v19036: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:52:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:26 smithi122 ceph-mon[125440]: pgmap v19036: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:52:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:26 smithi136 ceph-mon[125702]: pgmap v19036: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:52:28.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:28 smithi057 ceph-mon[92072]: pgmap v19037: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:52:28.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:52:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:28 smithi122 ceph-mon[125440]: pgmap v19037: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:52:28.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:52:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:28 smithi136 ceph-mon[125702]: pgmap v19037: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:52:28.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:52:29.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:52:29.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:52:29.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:29 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:52:29.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:52:29.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:52:29.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:29 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:52:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:52:29.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:52:29.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:29 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:52:30.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:30 smithi057 ceph-mon[92072]: pgmap v19038: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:30 smithi122 ceph-mon[125440]: pgmap v19038: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:30 smithi136 ceph-mon[125702]: pgmap v19038: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:31.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:52:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:31.320+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:52:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:31.320+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:52:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:31.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:52:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:31.320+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:52:32.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:32 smithi057 ceph-mon[92072]: pgmap v19039: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:32.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:32 smithi122 ceph-mon[125440]: pgmap v19039: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:32 smithi136 ceph-mon[125702]: pgmap v19039: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:34.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:34 smithi057 ceph-mon[92072]: pgmap v19040: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:34.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:34 smithi122 ceph-mon[125440]: pgmap v19040: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:34 smithi136 ceph-mon[125702]: pgmap v19040: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:36 smithi057 ceph-mon[92072]: pgmap v19041: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:36 smithi122 ceph-mon[125440]: pgmap v19041: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:36 smithi136 ceph-mon[125702]: pgmap v19041: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:38.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:38 smithi057 ceph-mon[92072]: pgmap v19042: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:38 smithi122 ceph-mon[125440]: pgmap v19042: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:38 smithi136 ceph-mon[125702]: pgmap v19042: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:40 smithi057 ceph-mon[92072]: pgmap v19043: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:40 smithi122 ceph-mon[125440]: pgmap v19043: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:40 smithi136 ceph-mon[125702]: pgmap v19043: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:42.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:42 smithi122 ceph-mon[125440]: pgmap v19044: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:42 smithi136 ceph-mon[125702]: pgmap v19044: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:42 smithi057 ceph-mon[92072]: pgmap v19044: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:44.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:44 smithi122 ceph-mon[125440]: pgmap v19045: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:44 smithi136 ceph-mon[125702]: pgmap v19045: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:44.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:44 smithi057 ceph-mon[92072]: pgmap v19045: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:46.323+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:52:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:46.323+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:52:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:46.323+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:52:46.327 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:46.323+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:52:46.327 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:52:46.324+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:52:46.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:46 smithi122 ceph-mon[125440]: pgmap v19046: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:46 smithi136 ceph-mon[125702]: pgmap v19046: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:46.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:46 smithi057 ceph-mon[92072]: pgmap v19046: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:48.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:48 smithi122 ceph-mon[125440]: pgmap v19047: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:48 smithi136 ceph-mon[125702]: pgmap v19047: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:48 smithi057 ceph-mon[92072]: pgmap v19047: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:50 smithi136 ceph-mon[125702]: pgmap v19048: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:50.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:50 smithi057 ceph-mon[92072]: pgmap v19048: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:50 smithi122 ceph-mon[125440]: pgmap v19048: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:52 smithi136 ceph-mon[125702]: pgmap v19049: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:52.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:52 smithi057 ceph-mon[92072]: pgmap v19049: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:52 smithi122 ceph-mon[125440]: pgmap v19049: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:54 smithi136 ceph-mon[125702]: pgmap v19050: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:54.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:54 smithi057 ceph-mon[92072]: pgmap v19050: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:54 smithi122 ceph-mon[125440]: pgmap v19050: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:56 smithi136 ceph-mon[125702]: pgmap v19051: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:56.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:56 smithi057 ceph-mon[92072]: pgmap v19051: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:56 smithi122 ceph-mon[125440]: pgmap v19051: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:52:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:52:58 smithi136 ceph-mon[125702]: pgmap v19052: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:52:58 smithi057 ceph-mon[92072]: pgmap v19052: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:52:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:52:58 smithi122 ceph-mon[125440]: pgmap v19052: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:00 smithi136 ceph-mon[125702]: pgmap v19053: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:00 smithi057 ceph-mon[92072]: pgmap v19053: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:00 smithi122 ceph-mon[125440]: pgmap v19053: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:01.335+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:53:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:01.336+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:53:01.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:01.336+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:53:01.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:01.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:53:01.339 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:01.336+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:53:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:02 smithi136 ceph-mon[125702]: pgmap v19054: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:02 smithi057 ceph-mon[92072]: pgmap v19054: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:02 smithi122 ceph-mon[125440]: pgmap v19054: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:04 smithi136 ceph-mon[125702]: pgmap v19055: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:53:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:04 smithi057 ceph-mon[92072]: pgmap v19055: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:53:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:04 smithi122 ceph-mon[125440]: pgmap v19055: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:53:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:05 smithi136 ceph-mon[125702]: pgmap v19056: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:53:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:05 smithi057 ceph-mon[92072]: pgmap v19056: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:53:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:05 smithi122 ceph-mon[125440]: pgmap v19056: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:53:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:07 smithi136 ceph-mon[125702]: osdmap e1264: 12 total, 12 up, 12 in 2023-03-02T20:53:07.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:07 smithi136 ceph-mon[125702]: pgmap v19058: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:53:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:07 smithi057 ceph-mon[92072]: osdmap e1264: 12 total, 12 up, 12 in 2023-03-02T20:53:07.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:07 smithi057 ceph-mon[92072]: pgmap v19058: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:53:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:07 smithi122 ceph-mon[125440]: osdmap e1264: 12 total, 12 up, 12 in 2023-03-02T20:53:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:07 smithi122 ceph-mon[125440]: pgmap v19058: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:53:10.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:10 smithi057 ceph-mon[92072]: pgmap v19059: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:53:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:10 smithi122 ceph-mon[125440]: pgmap v19059: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:53:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:10 smithi136 ceph-mon[125702]: pgmap v19059: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:53:12.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:12 smithi057 ceph-mon[92072]: pgmap v19060: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:53:12.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:12 smithi122 ceph-mon[125440]: pgmap v19060: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:53:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:12 smithi136 ceph-mon[125702]: pgmap v19060: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:53:13.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:13.526+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T20:53:13.529 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:13.526+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:53:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:13.526+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 274 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T20:53:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:13.526+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:53:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:13.526+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 275 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T20:53:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:13.527+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:53:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:13.527+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 275 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006500 con 0x558558b6f6b0 2023-03-02T20:53:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:13.527+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 276 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:53:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:14 smithi057 ceph-mon[92072]: pgmap v19061: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:53:14.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:14 smithi057 ceph-mon[92072]: osdmap e1265: 12 total, 12 up, 12 in 2023-03-02T20:53:14.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:14 smithi122 ceph-mon[125440]: pgmap v19061: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:53:14.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:14 smithi122 ceph-mon[125440]: osdmap e1265: 12 total, 12 up, 12 in 2023-03-02T20:53:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:14 smithi136 ceph-mon[125702]: pgmap v19061: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:53:14.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:14 smithi136 ceph-mon[125702]: osdmap e1265: 12 total, 12 up, 12 in 2023-03-02T20:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:16.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:16.349+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:16.349+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:16.349+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:16.349+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:53:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:16 smithi057 ceph-mon[92072]: pgmap v19063: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:53:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:16 smithi122 ceph-mon[125440]: pgmap v19063: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:53:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:16 smithi136 ceph-mon[125702]: pgmap v19063: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-02T20:53:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:18 smithi057 ceph-mon[92072]: pgmap v19064: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:53:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:18 smithi122 ceph-mon[125440]: pgmap v19064: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:53:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:18 smithi136 ceph-mon[125702]: pgmap v19064: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:53:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:20 smithi122 ceph-mon[125440]: pgmap v19065: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:53:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:20 smithi136 ceph-mon[125702]: pgmap v19065: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:53:20.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:20 smithi057 ceph-mon[92072]: pgmap v19065: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:53:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:22 smithi122 ceph-mon[125440]: pgmap v19066: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:53:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:22 smithi136 ceph-mon[125702]: pgmap v19066: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:53:22.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:22 smithi057 ceph-mon[92072]: pgmap v19066: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:53:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:24 smithi122 ceph-mon[125440]: pgmap v19067: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:53:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:24 smithi136 ceph-mon[125702]: pgmap v19067: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:53:24.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:24 smithi057 ceph-mon[92072]: pgmap v19067: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T20:53:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:26 smithi122 ceph-mon[125440]: pgmap v19068: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:53:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:26 smithi136 ceph-mon[125702]: pgmap v19068: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:53:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:26 smithi057 ceph-mon[92072]: pgmap v19068: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T20:53:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:28 smithi136 ceph-mon[125702]: pgmap v19069: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:53:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:28 smithi057 ceph-mon[92072]: pgmap v19069: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:53:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:28 smithi122 ceph-mon[125440]: pgmap v19069: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T20:53:29.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:29 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:53:29.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:29 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:53:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:29 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:53:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:30 smithi136 ceph-mon[125702]: pgmap v19070: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:30 smithi057 ceph-mon[92072]: pgmap v19070: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:30 smithi122 ceph-mon[125440]: pgmap v19070: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:31.363+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:53:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:31.363+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:53:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:31.363+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:53:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:31.363+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:53:31.368 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:31.363+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:53:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: pgmap v19071: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: pgmap v19071: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:32.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: pgmap v19071: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:32.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:32.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:32.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:53:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:53:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:53:33.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:53:33.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:33.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:53:33.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:53:33.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:53:33.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:53:33.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T20:53:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T20:53:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T20:53:33.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:53:33.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:53:33.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:53:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:34 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:53:34.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:34 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:53:34.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:34 smithi136 ceph-mon[125702]: pgmap v19072: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:34 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:53:34.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:34 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:53:34.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:34 smithi057 ceph-mon[92072]: pgmap v19072: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:34 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T20:53:34.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:34 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T20:53:34.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:34 smithi122 ceph-mon[125440]: pgmap v19072: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:36 smithi136 ceph-mon[125702]: pgmap v19073: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:36 smithi057 ceph-mon[92072]: pgmap v19073: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:36 smithi122 ceph-mon[125440]: pgmap v19073: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:38 smithi136 ceph-mon[125702]: pgmap v19074: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:38 smithi057 ceph-mon[92072]: pgmap v19074: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:38 smithi122 ceph-mon[125440]: pgmap v19074: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:40.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:40 smithi057 ceph-mon[92072]: pgmap v19075: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:40 smithi122 ceph-mon[125440]: pgmap v19075: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:40 smithi136 ceph-mon[125702]: pgmap v19075: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:42.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:42 smithi057 ceph-mon[92072]: pgmap v19076: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:42.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:42 smithi122 ceph-mon[125440]: pgmap v19076: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:42 smithi136 ceph-mon[125702]: pgmap v19076: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:44.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:44 smithi057 ceph-mon[92072]: pgmap v19077: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:44 smithi122 ceph-mon[125440]: pgmap v19077: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:44 smithi136 ceph-mon[125702]: pgmap v19077: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:46.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:53:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:46.379+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:53:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:46.379+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:53:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:46.379+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:53:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:53:46.379+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:53:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:46 smithi057 ceph-mon[92072]: pgmap v19078: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:46 smithi122 ceph-mon[125440]: pgmap v19078: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:46 smithi136 ceph-mon[125702]: pgmap v19078: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:48.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:48 smithi057 ceph-mon[92072]: pgmap v19079: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:48 smithi122 ceph-mon[125440]: pgmap v19079: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:48 smithi136 ceph-mon[125702]: pgmap v19079: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:50 smithi057 ceph-mon[92072]: pgmap v19080: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:50 smithi122 ceph-mon[125440]: pgmap v19080: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:50 smithi136 ceph-mon[125702]: pgmap v19080: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:52 smithi057 ceph-mon[92072]: pgmap v19081: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:52 smithi122 ceph-mon[125440]: pgmap v19081: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:52 smithi136 ceph-mon[125702]: pgmap v19081: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:54 smithi057 ceph-mon[92072]: pgmap v19082: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:54 smithi122 ceph-mon[125440]: pgmap v19082: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:54 smithi136 ceph-mon[125702]: pgmap v19082: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:56 smithi122 ceph-mon[125440]: pgmap v19083: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:56 smithi136 ceph-mon[125702]: pgmap v19083: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:56.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:56 smithi057 ceph-mon[92072]: pgmap v19083: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:53:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:53:58 smithi122 ceph-mon[125440]: pgmap v19084: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:53:58 smithi136 ceph-mon[125702]: pgmap v19084: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:53:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:53:58 smithi057 ceph-mon[92072]: pgmap v19084: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:00 smithi122 ceph-mon[125440]: pgmap v19085: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:00 smithi136 ceph-mon[125702]: pgmap v19085: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:00 smithi057 ceph-mon[92072]: pgmap v19085: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:01.388+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:54:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:01.389+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:54:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:01.389+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:54:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:01.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:54:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:01.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:54:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:02 smithi136 ceph-mon[125702]: pgmap v19086: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:02 smithi057 ceph-mon[92072]: pgmap v19086: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:02 smithi122 ceph-mon[125440]: pgmap v19086: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:04 smithi136 ceph-mon[125702]: pgmap v19087: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:54:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:04 smithi057 ceph-mon[92072]: pgmap v19087: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:54:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:04 smithi122 ceph-mon[125440]: pgmap v19087: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:54:06.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:06 smithi136 ceph-mon[125702]: pgmap v19088: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:54:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:06 smithi057 ceph-mon[92072]: pgmap v19088: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:54:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:06 smithi122 ceph-mon[125440]: pgmap v19088: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:54:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:07 smithi136 ceph-mon[125702]: osdmap e1266: 12 total, 12 up, 12 in 2023-03-02T20:54:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:07 smithi057 ceph-mon[92072]: osdmap e1266: 12 total, 12 up, 12 in 2023-03-02T20:54:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:07 smithi122 ceph-mon[125440]: osdmap e1266: 12 total, 12 up, 12 in 2023-03-02T20:54:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:08 smithi136 ceph-mon[125702]: pgmap v19090: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:54:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:08 smithi057 ceph-mon[92072]: pgmap v19090: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:54:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:08 smithi122 ceph-mon[125440]: pgmap v19090: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:54:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:10 smithi136 ceph-mon[125702]: pgmap v19091: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:54:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:10 smithi057 ceph-mon[92072]: pgmap v19091: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:54:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:10 smithi122 ceph-mon[125440]: pgmap v19091: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:54:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:12 smithi136 ceph-mon[125702]: pgmap v19092: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:54:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:12 smithi057 ceph-mon[92072]: pgmap v19092: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:54:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:12 smithi122 ceph-mon[125440]: pgmap v19092: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:54:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:14 smithi136 ceph-mon[125702]: pgmap v19093: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:54:14.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:14 smithi136 ceph-mon[125702]: osdmap e1267: 12 total, 12 up, 12 in 2023-03-02T20:54:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:14 smithi057 ceph-mon[92072]: pgmap v19093: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:54:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:14 smithi057 ceph-mon[92072]: osdmap e1267: 12 total, 12 up, 12 in 2023-03-02T20:54:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:14 smithi122 ceph-mon[125440]: pgmap v19093: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:54:15.010 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:14 smithi122 ceph-mon[125440]: osdmap e1267: 12 total, 12 up, 12 in 2023-03-02T20:54:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:16.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:54:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:16.404+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:54:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:16.404+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:54:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:16.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:54:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:16.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:54:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:16 smithi136 ceph-mon[125702]: pgmap v19095: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:54:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:16 smithi057 ceph-mon[92072]: pgmap v19095: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:54:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:16 smithi122 ceph-mon[125440]: pgmap v19095: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:54:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:18 smithi136 ceph-mon[125702]: pgmap v19096: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:54:18.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:18 smithi057 ceph-mon[92072]: pgmap v19096: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:54:18.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:18 smithi122 ceph-mon[125440]: pgmap v19096: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:54:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:20 smithi057 ceph-mon[92072]: pgmap v19097: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:54:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:20 smithi122 ceph-mon[125440]: pgmap v19097: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:54:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:20 smithi136 ceph-mon[125702]: pgmap v19097: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:54:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:22 smithi057 ceph-mon[92072]: pgmap v19098: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:54:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:22 smithi122 ceph-mon[125440]: pgmap v19098: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:54:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:22 smithi136 ceph-mon[125702]: pgmap v19098: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:54:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:24 smithi122 ceph-mon[125440]: pgmap v19099: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:54:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:24 smithi136 ceph-mon[125702]: pgmap v19099: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:54:24.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:24 smithi057 ceph-mon[92072]: pgmap v19099: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:54:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:26 smithi122 ceph-mon[125440]: pgmap v19100: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:54:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:26 smithi136 ceph-mon[125702]: pgmap v19100: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:54:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:26 smithi057 ceph-mon[92072]: pgmap v19100: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:54:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:28 smithi122 ceph-mon[125440]: pgmap v19101: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:28 smithi136 ceph-mon[125702]: pgmap v19101: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:28 smithi057 ceph-mon[92072]: pgmap v19101: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:30 smithi122 ceph-mon[125440]: pgmap v19102: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:30 smithi136 ceph-mon[125702]: pgmap v19102: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:30 smithi057 ceph-mon[92072]: pgmap v19102: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:31.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:31.418+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:54:31.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:31.419+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:54:31.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:31.419+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:54:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:31.419+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:54:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:31.419+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:54:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:32 smithi136 ceph-mon[125702]: pgmap v19103: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:32.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:32 smithi057 ceph-mon[92072]: pgmap v19103: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:32 smithi122 ceph-mon[125440]: pgmap v19103: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:54:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:54:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:54:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:54:33.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:54:33.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:54:33.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:54:33.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:54:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:54:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:54:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:54:33.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:54:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:34 smithi136 ceph-mon[125702]: pgmap v19104: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:34 smithi057 ceph-mon[92072]: pgmap v19104: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:34 smithi122 ceph-mon[125440]: pgmap v19104: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:36 smithi136 ceph-mon[125702]: pgmap v19105: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:36 smithi057 ceph-mon[92072]: pgmap v19105: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:36 smithi122 ceph-mon[125440]: pgmap v19105: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:38 smithi136 ceph-mon[125702]: pgmap v19106: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:38 smithi057 ceph-mon[92072]: pgmap v19106: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:38 smithi122 ceph-mon[125440]: pgmap v19106: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:40 smithi136 ceph-mon[125702]: pgmap v19107: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:40 smithi057 ceph-mon[92072]: pgmap v19107: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:40 smithi122 ceph-mon[125440]: pgmap v19107: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:42 smithi136 ceph-mon[125702]: pgmap v19108: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:42 smithi057 ceph-mon[92072]: pgmap v19108: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:42 smithi122 ceph-mon[125440]: pgmap v19108: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:44 smithi136 ceph-mon[125702]: pgmap v19109: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:44.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:44 smithi057 ceph-mon[92072]: pgmap v19109: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:44 smithi122 ceph-mon[125440]: pgmap v19109: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:46.433+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:54:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:46.434+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:54:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:46.434+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:54:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:46.434+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:54:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:54:46.434+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:54:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:46 smithi136 ceph-mon[125702]: pgmap v19110: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:46.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:46 smithi057 ceph-mon[92072]: pgmap v19110: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:46 smithi122 ceph-mon[125440]: pgmap v19110: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:48 smithi136 ceph-mon[125702]: pgmap v19111: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:48 smithi057 ceph-mon[92072]: pgmap v19111: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:48 smithi122 ceph-mon[125440]: pgmap v19111: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:50 smithi057 ceph-mon[92072]: pgmap v19112: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:50 smithi122 ceph-mon[125440]: pgmap v19112: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:50 smithi136 ceph-mon[125702]: pgmap v19112: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:52 smithi057 ceph-mon[92072]: pgmap v19113: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:52 smithi122 ceph-mon[125440]: pgmap v19113: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:52 smithi136 ceph-mon[125702]: pgmap v19113: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:54 smithi057 ceph-mon[92072]: pgmap v19114: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:54 smithi122 ceph-mon[125440]: pgmap v19114: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:54 smithi136 ceph-mon[125702]: pgmap v19114: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:56 smithi057 ceph-mon[92072]: pgmap v19115: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:56 smithi122 ceph-mon[125440]: pgmap v19115: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:56 smithi136 ceph-mon[125702]: pgmap v19115: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:54:58.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:54:58 smithi057 ceph-mon[92072]: pgmap v19116: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:58.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:54:58 smithi122 ceph-mon[125440]: pgmap v19116: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:54:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:54:58 smithi136 ceph-mon[125702]: pgmap v19116: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:00 smithi122 ceph-mon[125440]: pgmap v19117: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:00 smithi136 ceph-mon[125702]: pgmap v19117: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:00 smithi057 ceph-mon[92072]: pgmap v19117: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:01.449+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:55:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:01.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:55:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:01.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:55:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:01.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:55:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:01.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:55:02.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:02 smithi122 ceph-mon[125440]: pgmap v19118: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:02 smithi136 ceph-mon[125702]: pgmap v19118: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:02 smithi057 ceph-mon[92072]: pgmap v19118: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:04 smithi136 ceph-mon[125702]: pgmap v19119: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:55:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:04 smithi057 ceph-mon[92072]: pgmap v19119: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:55:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:04 smithi122 ceph-mon[125440]: pgmap v19119: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:55:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:06 smithi136 ceph-mon[125702]: pgmap v19120: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:55:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:06 smithi057 ceph-mon[92072]: pgmap v19120: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:55:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:06 smithi122 ceph-mon[125440]: pgmap v19120: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:55:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:07 smithi136 ceph-mon[125702]: osdmap e1268: 12 total, 12 up, 12 in 2023-03-02T20:55:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:07 smithi057 ceph-mon[92072]: osdmap e1268: 12 total, 12 up, 12 in 2023-03-02T20:55:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:07 smithi122 ceph-mon[125440]: osdmap e1268: 12 total, 12 up, 12 in 2023-03-02T20:55:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:08 smithi136 ceph-mon[125702]: pgmap v19122: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:55:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:08 smithi057 ceph-mon[92072]: pgmap v19122: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:55:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:08 smithi122 ceph-mon[125440]: pgmap v19122: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:55:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:10 smithi136 ceph-mon[125702]: pgmap v19123: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:55:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:10 smithi057 ceph-mon[92072]: pgmap v19123: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:55:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:10 smithi122 ceph-mon[125440]: pgmap v19123: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:55:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:12 smithi136 ceph-mon[125702]: pgmap v19124: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:55:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:12 smithi057 ceph-mon[92072]: pgmap v19124: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:55:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:12 smithi122 ceph-mon[125440]: pgmap v19124: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:55:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:14 smithi136 ceph-mon[125702]: pgmap v19125: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:55:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:14 smithi136 ceph-mon[125702]: osdmap e1269: 12 total, 12 up, 12 in 2023-03-02T20:55:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:14 smithi057 ceph-mon[92072]: pgmap v19125: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:55:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:14 smithi057 ceph-mon[92072]: osdmap e1269: 12 total, 12 up, 12 in 2023-03-02T20:55:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:14 smithi122 ceph-mon[125440]: pgmap v19125: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:55:14.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:14 smithi122 ceph-mon[125440]: osdmap e1269: 12 total, 12 up, 12 in 2023-03-02T20:55:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:16.462+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:55:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:16.463+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:55:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:16.463+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:55:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:16.463+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:55:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:16.463+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:55:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:16 smithi136 ceph-mon[125702]: pgmap v19127: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:55:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:16 smithi057 ceph-mon[92072]: pgmap v19127: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:55:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:16 smithi122 ceph-mon[125440]: pgmap v19127: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T20:55:17.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:17 smithi136 ceph-mon[125702]: pgmap v19128: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:55:17.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:17 smithi057 ceph-mon[92072]: pgmap v19128: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:55:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:17 smithi122 ceph-mon[125440]: pgmap v19128: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:55:20.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:20 smithi057 ceph-mon[92072]: pgmap v19129: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:55:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:20 smithi122 ceph-mon[125440]: pgmap v19129: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:55:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:20 smithi136 ceph-mon[125702]: pgmap v19129: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:55:22.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:22 smithi057 ceph-mon[92072]: pgmap v19130: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:55:22.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:22 smithi122 ceph-mon[125440]: pgmap v19130: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:55:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:22 smithi136 ceph-mon[125702]: pgmap v19130: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:55:24.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:24 smithi122 ceph-mon[125440]: pgmap v19131: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:55:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:24 smithi136 ceph-mon[125702]: pgmap v19131: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:55:24.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:24 smithi057 ceph-mon[92072]: pgmap v19131: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:55:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:26 smithi122 ceph-mon[125440]: pgmap v19132: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:55:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:26 smithi136 ceph-mon[125702]: pgmap v19132: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:55:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:26 smithi057 ceph-mon[92072]: pgmap v19132: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:55:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:28 smithi122 ceph-mon[125440]: pgmap v19133: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:28 smithi136 ceph-mon[125702]: pgmap v19133: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:28 smithi057 ceph-mon[92072]: pgmap v19133: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:30.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:30 smithi122 ceph-mon[125440]: pgmap v19134: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:30 smithi136 ceph-mon[125702]: pgmap v19134: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:30 smithi057 ceph-mon[92072]: pgmap v19134: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:31.478+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:55:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:31.478+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:55:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:31.478+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:55:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:31.478+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:55:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:31.478+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:55:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:32 smithi136 ceph-mon[125702]: pgmap v19135: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:32.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:32 smithi057 ceph-mon[92072]: pgmap v19135: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:32 smithi122 ceph-mon[125440]: pgmap v19135: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:34 smithi136 ceph-mon[125702]: pgmap v19136: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:34 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:55:34.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:55:34.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:55:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:34 smithi057 ceph-mon[92072]: pgmap v19136: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:34 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:55:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:55:34.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:55:34.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:34 smithi122 ceph-mon[125440]: pgmap v19136: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:34.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:34 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:55:34.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:55:34.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:55:35.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:55:35.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:55:35.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:55:35.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:55:35.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:55:35.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:55:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:55:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:55:35.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:55:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:36 smithi136 ceph-mon[125702]: pgmap v19137: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:36 smithi057 ceph-mon[92072]: pgmap v19137: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:36 smithi122 ceph-mon[125440]: pgmap v19137: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:38 smithi136 ceph-mon[125702]: pgmap v19138: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:38 smithi057 ceph-mon[92072]: pgmap v19138: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:38 smithi122 ceph-mon[125440]: pgmap v19138: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:40 smithi136 ceph-mon[125702]: pgmap v19139: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:40 smithi057 ceph-mon[92072]: pgmap v19139: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:40 smithi122 ceph-mon[125440]: pgmap v19139: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:42 smithi136 ceph-mon[125702]: pgmap v19140: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:42 smithi057 ceph-mon[92072]: pgmap v19140: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:42 smithi122 ceph-mon[125440]: pgmap v19140: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:44 smithi136 ceph-mon[125702]: pgmap v19141: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:44.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:44 smithi057 ceph-mon[92072]: pgmap v19141: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:44 smithi122 ceph-mon[125440]: pgmap v19141: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:46.496 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:46.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:55:46.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:46.493+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:55:46.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:46.493+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:55:46.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:46.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:55:46.497 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:55:46.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:55:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:46 smithi136 ceph-mon[125702]: pgmap v19142: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:46.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:46 smithi057 ceph-mon[92072]: pgmap v19142: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:46 smithi122 ceph-mon[125440]: pgmap v19142: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:48 smithi136 ceph-mon[125702]: pgmap v19143: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:48 smithi057 ceph-mon[92072]: pgmap v19143: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:48 smithi122 ceph-mon[125440]: pgmap v19143: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:50 smithi136 ceph-mon[125702]: pgmap v19144: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:50.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:50 smithi057 ceph-mon[92072]: pgmap v19144: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:50 smithi122 ceph-mon[125440]: pgmap v19144: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:52 smithi136 ceph-mon[125702]: pgmap v19145: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:52.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:52 smithi057 ceph-mon[92072]: pgmap v19145: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:52 smithi122 ceph-mon[125440]: pgmap v19145: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:54 smithi136 ceph-mon[125702]: pgmap v19146: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:54.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:54 smithi057 ceph-mon[92072]: pgmap v19146: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:54 smithi122 ceph-mon[125440]: pgmap v19146: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:56 smithi136 ceph-mon[125702]: pgmap v19147: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:56.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:56 smithi057 ceph-mon[92072]: pgmap v19147: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:56 smithi122 ceph-mon[125440]: pgmap v19147: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:55:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:55:58 smithi136 ceph-mon[125702]: pgmap v19148: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:55:58 smithi057 ceph-mon[92072]: pgmap v19148: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:55:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:55:58 smithi122 ceph-mon[125440]: pgmap v19148: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:00 smithi136 ceph-mon[125702]: pgmap v19149: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:00 smithi057 ceph-mon[92072]: pgmap v19149: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:00 smithi122 ceph-mon[125440]: pgmap v19149: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:01.497+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:56:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:01.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:56:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:01.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:56:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:01.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:56:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:01.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:56:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:02 smithi136 ceph-mon[125702]: pgmap v19150: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:02 smithi057 ceph-mon[92072]: pgmap v19150: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:02 smithi122 ceph-mon[125440]: pgmap v19150: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:04 smithi136 ceph-mon[125702]: pgmap v19151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:56:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:04 smithi057 ceph-mon[92072]: pgmap v19151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:56:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:04 smithi122 ceph-mon[125440]: pgmap v19151: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:56:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:05 smithi136 ceph-mon[125702]: pgmap v19152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:56:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:05 smithi057 ceph-mon[92072]: pgmap v19152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:56:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:05 smithi122 ceph-mon[125440]: pgmap v19152: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:56:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:07 smithi136 ceph-mon[125702]: osdmap e1270: 12 total, 12 up, 12 in 2023-03-02T20:56:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:07 smithi136 ceph-mon[125702]: pgmap v19154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:56:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:07 smithi057 ceph-mon[92072]: osdmap e1270: 12 total, 12 up, 12 in 2023-03-02T20:56:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:07 smithi057 ceph-mon[92072]: pgmap v19154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:56:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:07 smithi122 ceph-mon[125440]: osdmap e1270: 12 total, 12 up, 12 in 2023-03-02T20:56:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:07 smithi122 ceph-mon[125440]: pgmap v19154: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:56:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:10 smithi122 ceph-mon[125440]: pgmap v19155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:56:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:10 smithi136 ceph-mon[125702]: pgmap v19155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:56:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:10 smithi057 ceph-mon[92072]: pgmap v19155: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:56:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:12 smithi136 ceph-mon[125702]: pgmap v19156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:56:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:12 smithi057 ceph-mon[92072]: pgmap v19156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:56:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:12 smithi122 ceph-mon[125440]: pgmap v19156: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:56:13.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:13.553+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:56:13.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:13.553+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T20:56:13.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:13.553+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 276 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T20:56:13.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:13.553+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 277 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:56:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:14 smithi136 ceph-mon[125702]: pgmap v19157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:56:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:14 smithi136 ceph-mon[125702]: osdmap e1271: 12 total, 12 up, 12 in 2023-03-02T20:56:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:14 smithi057 ceph-mon[92072]: pgmap v19157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:56:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:14 smithi057 ceph-mon[92072]: osdmap e1271: 12 total, 12 up, 12 in 2023-03-02T20:56:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:14 smithi122 ceph-mon[125440]: pgmap v19157: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:56:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:14 smithi122 ceph-mon[125440]: osdmap e1271: 12 total, 12 up, 12 in 2023-03-02T20:56:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:16.508+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:56:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:16.508+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:56:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:16.508+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:56:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:16.508+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:56:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:16.509+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:56:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:16 smithi136 ceph-mon[125702]: pgmap v19159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T20:56:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:16 smithi057 ceph-mon[92072]: pgmap v19159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T20:56:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:16 smithi122 ceph-mon[125440]: pgmap v19159: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 242 B/s wr, 12 op/s 2023-03-02T20:56:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:18 smithi136 ceph-mon[125702]: pgmap v19160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:56:18.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:18 smithi057 ceph-mon[92072]: pgmap v19160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:56:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:18 smithi122 ceph-mon[125440]: pgmap v19160: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:56:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:20 smithi136 ceph-mon[125702]: pgmap v19161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:56:20.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:20 smithi057 ceph-mon[92072]: pgmap v19161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:56:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:20 smithi122 ceph-mon[125440]: pgmap v19161: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:56:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:22 smithi136 ceph-mon[125702]: pgmap v19162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:56:22.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:22 smithi057 ceph-mon[92072]: pgmap v19162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:56:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:22 smithi122 ceph-mon[125440]: pgmap v19162: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:56:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:24 smithi136 ceph-mon[125702]: pgmap v19163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:56:24.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:24 smithi057 ceph-mon[92072]: pgmap v19163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:56:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:24 smithi122 ceph-mon[125440]: pgmap v19163: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:56:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:26 smithi136 ceph-mon[125702]: pgmap v19164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:56:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:26 smithi057 ceph-mon[92072]: pgmap v19164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:56:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:26 smithi122 ceph-mon[125440]: pgmap v19164: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:56:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:28 smithi136 ceph-mon[125702]: pgmap v19165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:28 smithi057 ceph-mon[92072]: pgmap v19165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:28 smithi122 ceph-mon[125440]: pgmap v19165: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:30 smithi136 ceph-mon[125702]: pgmap v19166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:30 smithi057 ceph-mon[92072]: pgmap v19166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:30 smithi122 ceph-mon[125440]: pgmap v19166: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:31.524+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:56:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:31.524+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:56:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:31.524+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:56:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:31.524+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:56:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:31.524+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:56:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:32 smithi136 ceph-mon[125702]: pgmap v19167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:32.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:32 smithi057 ceph-mon[92072]: pgmap v19167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:32 smithi122 ceph-mon[125440]: pgmap v19167: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:34 smithi136 ceph-mon[125702]: pgmap v19168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:34 smithi057 ceph-mon[92072]: pgmap v19168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:34 smithi122 ceph-mon[125440]: pgmap v19168: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:35.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:56:35.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:56:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:56:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:36 smithi136 ceph-mon[125702]: pgmap v19169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:56:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:56:36.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:36 smithi057 ceph-mon[92072]: pgmap v19169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:56:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:56:36.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:36 smithi122 ceph-mon[125440]: pgmap v19169: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:56:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:56:36.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:56:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:38 smithi136 ceph-mon[125702]: pgmap v19170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:38 smithi057 ceph-mon[92072]: pgmap v19170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:38 smithi122 ceph-mon[125440]: pgmap v19170: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:40 smithi136 ceph-mon[125702]: pgmap v19171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:40 smithi057 ceph-mon[92072]: pgmap v19171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:40 smithi122 ceph-mon[125440]: pgmap v19171: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:41 smithi136 ceph-mon[125702]: pgmap v19172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:41 smithi057 ceph-mon[92072]: pgmap v19172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:41 smithi122 ceph-mon[125440]: pgmap v19172: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:44 smithi057 ceph-mon[92072]: pgmap v19173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:44 smithi122 ceph-mon[125440]: pgmap v19173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:44 smithi136 ceph-mon[125702]: pgmap v19173: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:46.538+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:56:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:46.538+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:56:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:46.538+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:56:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:46.538+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:56:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:56:46.538+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:56:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:46 smithi136 ceph-mon[125702]: pgmap v19174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:46.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:46 smithi057 ceph-mon[92072]: pgmap v19174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:46 smithi122 ceph-mon[125440]: pgmap v19174: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:48 smithi136 ceph-mon[125702]: pgmap v19175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:48 smithi057 ceph-mon[92072]: pgmap v19175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:48 smithi122 ceph-mon[125440]: pgmap v19175: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:50 smithi136 ceph-mon[125702]: pgmap v19176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:50.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:50 smithi057 ceph-mon[92072]: pgmap v19176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:50 smithi122 ceph-mon[125440]: pgmap v19176: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:52 smithi136 ceph-mon[125702]: pgmap v19177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:52.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:52 smithi057 ceph-mon[92072]: pgmap v19177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:52 smithi122 ceph-mon[125440]: pgmap v19177: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:54 smithi136 ceph-mon[125702]: pgmap v19178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:54.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:54 smithi057 ceph-mon[92072]: pgmap v19178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:54 smithi122 ceph-mon[125440]: pgmap v19178: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:56 smithi136 ceph-mon[125702]: pgmap v19179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:56.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:56 smithi057 ceph-mon[92072]: pgmap v19179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:56 smithi122 ceph-mon[125440]: pgmap v19179: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:56:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:56:58 smithi136 ceph-mon[125702]: pgmap v19180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:56:58 smithi057 ceph-mon[92072]: pgmap v19180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:56:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:56:58 smithi122 ceph-mon[125440]: pgmap v19180: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:00 smithi136 ceph-mon[125702]: pgmap v19181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:00 smithi057 ceph-mon[92072]: pgmap v19181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:00 smithi122 ceph-mon[125440]: pgmap v19181: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:01.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:01.542+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:57:01.545 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:01.543+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:57:01.545 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:01.543+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:57:01.545 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:01.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:57:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:01.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:57:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:02 smithi136 ceph-mon[125702]: pgmap v19182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:02 smithi057 ceph-mon[92072]: pgmap v19182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:02 smithi122 ceph-mon[125440]: pgmap v19182: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:04.511 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:04 smithi136 ceph-mon[125702]: pgmap v19183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:57:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:04 smithi057 ceph-mon[92072]: pgmap v19183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:57:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:04 smithi122 ceph-mon[125440]: pgmap v19183: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:57:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:06 smithi136 ceph-mon[125702]: pgmap v19184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:57:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:06 smithi057 ceph-mon[92072]: pgmap v19184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:57:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:06 smithi122 ceph-mon[125440]: pgmap v19184: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:57:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:07 smithi136 ceph-mon[125702]: osdmap e1272: 12 total, 12 up, 12 in 2023-03-02T20:57:07.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:07 smithi136 ceph-mon[125702]: pgmap v19186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:57:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:07 smithi057 ceph-mon[92072]: osdmap e1272: 12 total, 12 up, 12 in 2023-03-02T20:57:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:07 smithi057 ceph-mon[92072]: pgmap v19186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:57:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:07 smithi122 ceph-mon[125440]: osdmap e1272: 12 total, 12 up, 12 in 2023-03-02T20:57:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:07 smithi122 ceph-mon[125440]: pgmap v19186: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:57:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:10 smithi136 ceph-mon[125702]: pgmap v19187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:57:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:10 smithi057 ceph-mon[92072]: pgmap v19187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:57:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:10 smithi122 ceph-mon[125440]: pgmap v19187: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:57:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:12 smithi136 ceph-mon[125702]: pgmap v19188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:57:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:12 smithi057 ceph-mon[92072]: pgmap v19188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:57:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:12 smithi122 ceph-mon[125440]: pgmap v19188: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:57:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:14 smithi136 ceph-mon[125702]: pgmap v19189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:57:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:14 smithi136 ceph-mon[125702]: osdmap e1273: 12 total, 12 up, 12 in 2023-03-02T20:57:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:14 smithi057 ceph-mon[92072]: pgmap v19189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:57:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:14 smithi057 ceph-mon[92072]: osdmap e1273: 12 total, 12 up, 12 in 2023-03-02T20:57:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:14 smithi122 ceph-mon[125440]: pgmap v19189: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:57:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:14 smithi122 ceph-mon[125440]: osdmap e1273: 12 total, 12 up, 12 in 2023-03-02T20:57:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:16.552+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:16.552+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:16.552+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:16.552+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:16.552+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:57:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:16 smithi136 ceph-mon[125702]: pgmap v19191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:57:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:16 smithi057 ceph-mon[92072]: pgmap v19191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:57:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:16 smithi122 ceph-mon[125440]: pgmap v19191: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:57:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:18 smithi136 ceph-mon[125702]: pgmap v19192: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:57:18.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:18 smithi057 ceph-mon[92072]: pgmap v19192: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:57:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:18 smithi122 ceph-mon[125440]: pgmap v19192: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:57:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:20 smithi136 ceph-mon[125702]: pgmap v19193: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:57:20.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:20 smithi057 ceph-mon[92072]: pgmap v19193: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:57:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:20 smithi122 ceph-mon[125440]: pgmap v19193: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:57:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:22 smithi136 ceph-mon[125702]: pgmap v19194: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:57:22.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:22 smithi057 ceph-mon[92072]: pgmap v19194: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:57:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:22 smithi122 ceph-mon[125440]: pgmap v19194: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:57:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:24 smithi136 ceph-mon[125702]: pgmap v19195: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:57:24.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:24 smithi057 ceph-mon[92072]: pgmap v19195: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:57:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:24 smithi122 ceph-mon[125440]: pgmap v19195: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:57:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:26 smithi136 ceph-mon[125702]: pgmap v19196: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:57:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:26 smithi057 ceph-mon[92072]: pgmap v19196: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:57:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:26 smithi122 ceph-mon[125440]: pgmap v19196: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:57:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:28 smithi136 ceph-mon[125702]: pgmap v19197: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:28 smithi057 ceph-mon[92072]: pgmap v19197: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:28 smithi122 ceph-mon[125440]: pgmap v19197: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:30 smithi136 ceph-mon[125702]: pgmap v19198: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:30 smithi057 ceph-mon[92072]: pgmap v19198: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:30 smithi122 ceph-mon[125440]: pgmap v19198: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:31.566+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:57:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:31.567+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:57:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:31.567+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:57:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:31.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:57:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:31.567+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:57:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:32 smithi136 ceph-mon[125702]: pgmap v19199: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:32.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:32 smithi057 ceph-mon[92072]: pgmap v19199: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:32 smithi122 ceph-mon[125440]: pgmap v19199: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:34 smithi136 ceph-mon[125702]: pgmap v19200: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:34 smithi057 ceph-mon[92072]: pgmap v19200: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:34 smithi122 ceph-mon[125440]: pgmap v19200: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:36 smithi136 ceph-mon[125702]: pgmap v19201: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:57:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:36 smithi057 ceph-mon[92072]: pgmap v19201: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:57:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:36 smithi122 ceph-mon[125440]: pgmap v19201: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:57:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:57:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:57:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:57:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:57:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:57:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:57:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:57:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:57:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:57:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:38 smithi136 ceph-mon[125702]: pgmap v19202: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:38 smithi057 ceph-mon[92072]: pgmap v19202: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:38 smithi122 ceph-mon[125440]: pgmap v19202: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:40 smithi136 ceph-mon[125702]: pgmap v19203: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:40 smithi057 ceph-mon[92072]: pgmap v19203: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:40 smithi122 ceph-mon[125440]: pgmap v19203: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:42 smithi136 ceph-mon[125702]: pgmap v19204: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:42 smithi057 ceph-mon[92072]: pgmap v19204: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:42 smithi122 ceph-mon[125440]: pgmap v19204: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:44 smithi136 ceph-mon[125702]: pgmap v19205: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:44.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:44 smithi057 ceph-mon[92072]: pgmap v19205: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:44 smithi122 ceph-mon[125440]: pgmap v19205: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:46.582+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:57:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:46.583+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:57:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:46.583+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:57:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:46.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:57:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:57:46.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:57:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:46 smithi136 ceph-mon[125702]: pgmap v19206: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:46.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:46 smithi057 ceph-mon[92072]: pgmap v19206: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:46 smithi122 ceph-mon[125440]: pgmap v19206: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:48 smithi136 ceph-mon[125702]: pgmap v19207: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:48.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:48 smithi057 ceph-mon[92072]: pgmap v19207: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:48 smithi122 ceph-mon[125440]: pgmap v19207: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:50 smithi136 ceph-mon[125702]: pgmap v19208: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:50.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:50 smithi057 ceph-mon[92072]: pgmap v19208: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:50 smithi122 ceph-mon[125440]: pgmap v19208: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:52 smithi136 ceph-mon[125702]: pgmap v19209: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:52.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:52 smithi057 ceph-mon[92072]: pgmap v19209: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:52 smithi122 ceph-mon[125440]: pgmap v19209: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:54 smithi136 ceph-mon[125702]: pgmap v19210: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:54.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:54 smithi057 ceph-mon[92072]: pgmap v19210: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:54 smithi122 ceph-mon[125440]: pgmap v19210: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:56 smithi136 ceph-mon[125702]: pgmap v19211: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:56.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:56 smithi057 ceph-mon[92072]: pgmap v19211: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:56 smithi122 ceph-mon[125440]: pgmap v19211: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:57:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:57:58 smithi136 ceph-mon[125702]: pgmap v19212: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:57:58 smithi057 ceph-mon[92072]: pgmap v19212: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:57:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:57:58 smithi122 ceph-mon[125440]: pgmap v19212: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:00 smithi136 ceph-mon[125702]: pgmap v19213: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:00 smithi057 ceph-mon[92072]: pgmap v19213: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:00 smithi122 ceph-mon[125440]: pgmap v19213: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:01.596+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:58:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:01.597+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:58:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:01.597+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:58:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:01.597+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:58:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:01.597+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:58:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:02 smithi136 ceph-mon[125702]: pgmap v19214: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:02.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:02 smithi057 ceph-mon[92072]: pgmap v19214: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:02 smithi122 ceph-mon[125440]: pgmap v19214: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:04 smithi136 ceph-mon[125702]: pgmap v19215: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:58:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:04 smithi057 ceph-mon[92072]: pgmap v19215: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:58:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:04 smithi122 ceph-mon[125440]: pgmap v19215: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:58:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:06 smithi136 ceph-mon[125702]: pgmap v19216: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:58:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:06 smithi057 ceph-mon[92072]: pgmap v19216: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:58:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:06 smithi122 ceph-mon[125440]: pgmap v19216: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:58:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:07 smithi136 ceph-mon[125702]: osdmap e1274: 12 total, 12 up, 12 in 2023-03-02T20:58:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:07 smithi136 ceph-mon[125702]: pgmap v19218: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:58:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:07 smithi057 ceph-mon[92072]: osdmap e1274: 12 total, 12 up, 12 in 2023-03-02T20:58:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:07 smithi057 ceph-mon[92072]: pgmap v19218: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:58:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:07 smithi122 ceph-mon[125440]: osdmap e1274: 12 total, 12 up, 12 in 2023-03-02T20:58:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:07 smithi122 ceph-mon[125440]: pgmap v19218: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:58:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:10 smithi136 ceph-mon[125702]: pgmap v19219: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:58:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:10 smithi057 ceph-mon[92072]: pgmap v19219: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:58:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:10 smithi122 ceph-mon[125440]: pgmap v19219: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:58:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:12 smithi136 ceph-mon[125702]: pgmap v19220: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:58:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:12 smithi057 ceph-mon[92072]: pgmap v19220: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:58:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:12 smithi122 ceph-mon[125440]: pgmap v19220: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:58:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:14 smithi136 ceph-mon[125702]: pgmap v19221: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:58:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:14 smithi136 ceph-mon[125702]: osdmap e1275: 12 total, 12 up, 12 in 2023-03-02T20:58:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:14 smithi057 ceph-mon[92072]: pgmap v19221: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:58:14.947 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:14 smithi057 ceph-mon[92072]: osdmap e1275: 12 total, 12 up, 12 in 2023-03-02T20:58:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:14 smithi122 ceph-mon[125440]: pgmap v19221: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:58:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:14 smithi122 ceph-mon[125440]: osdmap e1275: 12 total, 12 up, 12 in 2023-03-02T20:58:16.610 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:16.608+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:58:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:16.609+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:58:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:16.609+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:58:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:16.609+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:58:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:16.609+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:58:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:16 smithi136 ceph-mon[125702]: pgmap v19223: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:58:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:16 smithi057 ceph-mon[92072]: pgmap v19223: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:58:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:16 smithi122 ceph-mon[125440]: pgmap v19223: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T20:58:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:18 smithi136 ceph-mon[125702]: pgmap v19224: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:58:18.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:18 smithi057 ceph-mon[92072]: pgmap v19224: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:58:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:18 smithi122 ceph-mon[125440]: pgmap v19224: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:58:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:20 smithi136 ceph-mon[125702]: pgmap v19225: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:58:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:20 smithi057 ceph-mon[92072]: pgmap v19225: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:58:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:20 smithi122 ceph-mon[125440]: pgmap v19225: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:58:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:22 smithi136 ceph-mon[125702]: pgmap v19226: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:58:22.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:22 smithi057 ceph-mon[92072]: pgmap v19226: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:58:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:22 smithi122 ceph-mon[125440]: pgmap v19226: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:58:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:24 smithi136 ceph-mon[125702]: pgmap v19227: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:58:24.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:24 smithi057 ceph-mon[92072]: pgmap v19227: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:58:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:24 smithi122 ceph-mon[125440]: pgmap v19227: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:58:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:26 smithi136 ceph-mon[125702]: pgmap v19228: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:58:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:26 smithi057 ceph-mon[92072]: pgmap v19228: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:58:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:26 smithi122 ceph-mon[125440]: pgmap v19228: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:58:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:28 smithi136 ceph-mon[125702]: pgmap v19229: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:28 smithi057 ceph-mon[92072]: pgmap v19229: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:28 smithi122 ceph-mon[125440]: pgmap v19229: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:30 smithi136 ceph-mon[125702]: pgmap v19230: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:30 smithi057 ceph-mon[92072]: pgmap v19230: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:30 smithi122 ceph-mon[125440]: pgmap v19230: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:31.611+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:58:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:31.611+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:58:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:31.611+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:58:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:31.611+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:58:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:31.611+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:58:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:32 smithi136 ceph-mon[125702]: pgmap v19231: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:32 smithi057 ceph-mon[92072]: pgmap v19231: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:32 smithi122 ceph-mon[125440]: pgmap v19231: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:34 smithi136 ceph-mon[125702]: pgmap v19232: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:34 smithi057 ceph-mon[92072]: pgmap v19232: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:34 smithi122 ceph-mon[125440]: pgmap v19232: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:36 smithi136 ceph-mon[125702]: pgmap v19233: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:36.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:36 smithi057 ceph-mon[92072]: pgmap v19233: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:36 smithi122 ceph-mon[125440]: pgmap v19233: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:58:37.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:58:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:58:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:38 smithi136 ceph-mon[125702]: pgmap v19234: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:58:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:58:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:58:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:38 smithi057 ceph-mon[92072]: pgmap v19234: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:58:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:58:38.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:58:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:38 smithi122 ceph-mon[125440]: pgmap v19234: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:58:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:58:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:58:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:40 smithi136 ceph-mon[125702]: pgmap v19235: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:40 smithi057 ceph-mon[92072]: pgmap v19235: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:40 smithi122 ceph-mon[125440]: pgmap v19235: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:42 smithi136 ceph-mon[125702]: pgmap v19236: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:42 smithi057 ceph-mon[92072]: pgmap v19236: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:42 smithi122 ceph-mon[125440]: pgmap v19236: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:44 smithi136 ceph-mon[125702]: pgmap v19237: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:44.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:44 smithi057 ceph-mon[92072]: pgmap v19237: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:44 smithi122 ceph-mon[125440]: pgmap v19237: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:46.618+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:58:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:46.618+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:58:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:46.618+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:58:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:46.618+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:58:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:58:46.618+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:58:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:46 smithi136 ceph-mon[125702]: pgmap v19238: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:46 smithi057 ceph-mon[92072]: pgmap v19238: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:46 smithi122 ceph-mon[125440]: pgmap v19238: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:48 smithi136 ceph-mon[125702]: pgmap v19239: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:48 smithi057 ceph-mon[92072]: pgmap v19239: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:48 smithi122 ceph-mon[125440]: pgmap v19239: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:50 smithi136 ceph-mon[125702]: pgmap v19240: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:50 smithi057 ceph-mon[92072]: pgmap v19240: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:50 smithi122 ceph-mon[125440]: pgmap v19240: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:52 smithi136 ceph-mon[125702]: pgmap v19241: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:52 smithi057 ceph-mon[92072]: pgmap v19241: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:52 smithi122 ceph-mon[125440]: pgmap v19241: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:54 smithi136 ceph-mon[125702]: pgmap v19242: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:54 smithi057 ceph-mon[92072]: pgmap v19242: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:54 smithi122 ceph-mon[125440]: pgmap v19242: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:56 smithi136 ceph-mon[125702]: pgmap v19243: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:56 smithi057 ceph-mon[92072]: pgmap v19243: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:56 smithi122 ceph-mon[125440]: pgmap v19243: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:58:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:58:58 smithi136 ceph-mon[125702]: pgmap v19244: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:58:58 smithi057 ceph-mon[92072]: pgmap v19244: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:58:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:58:58 smithi122 ceph-mon[125440]: pgmap v19244: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:00 smithi136 ceph-mon[125702]: pgmap v19245: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:00 smithi057 ceph-mon[92072]: pgmap v19245: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:00 smithi122 ceph-mon[125440]: pgmap v19245: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:01.633+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:59:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:01.633+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:59:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:01.633+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:59:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:01.633+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:59:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:01.633+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:59:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:02 smithi136 ceph-mon[125702]: pgmap v19246: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:02 smithi057 ceph-mon[92072]: pgmap v19246: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:02 smithi122 ceph-mon[125440]: pgmap v19246: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:04 smithi136 ceph-mon[125702]: pgmap v19247: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:59:04.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:04 smithi057 ceph-mon[92072]: pgmap v19247: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:59:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:04 smithi122 ceph-mon[125440]: pgmap v19247: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T20:59:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:06 smithi136 ceph-mon[125702]: pgmap v19248: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:59:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:06 smithi057 ceph-mon[92072]: pgmap v19248: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:59:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:06 smithi122 ceph-mon[125440]: pgmap v19248: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T20:59:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:07 smithi136 ceph-mon[125702]: osdmap e1276: 12 total, 12 up, 12 in 2023-03-02T20:59:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:07 smithi057 ceph-mon[92072]: osdmap e1276: 12 total, 12 up, 12 in 2023-03-02T20:59:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:07 smithi122 ceph-mon[125440]: osdmap e1276: 12 total, 12 up, 12 in 2023-03-02T20:59:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:08.430+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000415) for more than 900000000 us, fault. 2023-03-02T20:59:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:08.430+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f5870027fb0 tx=0x7f587006c000 comp rx=0 tx=0).stop 2023-03-02T20:59:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:08.430+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T20:59:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:08.430+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T20:59:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:08.430+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T20:59:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:08.430+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:59:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:08.430+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870096000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T20:59:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:08 smithi136 ceph-mon[125702]: pgmap v19250: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:59:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:08 smithi057 ceph-mon[92072]: pgmap v19250: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:59:08.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:08 smithi122 ceph-mon[125440]: pgmap v19250: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:59:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:10 smithi136 ceph-mon[125702]: pgmap v19251: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:59:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:10 smithi057 ceph-mon[92072]: pgmap v19251: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:59:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:10 smithi122 ceph-mon[125440]: pgmap v19251: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:59:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:12 smithi136 ceph-mon[125702]: pgmap v19252: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:59:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:12 smithi057 ceph-mon[92072]: pgmap v19252: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:59:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:12 smithi122 ceph-mon[125440]: pgmap v19252: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T20:59:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:13.579+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:59:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:13.579+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T20:59:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:13.579+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 277 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T20:59:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:13.579+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 278 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T20:59:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:14 smithi136 ceph-mon[125702]: pgmap v19253: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:59:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:14 smithi136 ceph-mon[125702]: osdmap e1277: 12 total, 12 up, 12 in 2023-03-02T20:59:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:14 smithi057 ceph-mon[92072]: pgmap v19253: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:59:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:14 smithi057 ceph-mon[92072]: osdmap e1277: 12 total, 12 up, 12 in 2023-03-02T20:59:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:14 smithi122 ceph-mon[125440]: pgmap v19253: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T20:59:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:14 smithi122 ceph-mon[125440]: osdmap e1277: 12 total, 12 up, 12 in 2023-03-02T20:59:16.649 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:16.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:59:16.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:16.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:59:16.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:16.647+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:59:16.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:16.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:59:16.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:16.647+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:59:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:16 smithi136 ceph-mon[125702]: pgmap v19255: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 239 B/s wr, 11 op/s 2023-03-02T20:59:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:16 smithi057 ceph-mon[92072]: pgmap v19255: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 239 B/s wr, 11 op/s 2023-03-02T20:59:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:16 smithi122 ceph-mon[125440]: pgmap v19255: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 239 B/s wr, 11 op/s 2023-03-02T20:59:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:18 smithi136 ceph-mon[125702]: pgmap v19256: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:59:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:18 smithi057 ceph-mon[92072]: pgmap v19256: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:59:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:18 smithi122 ceph-mon[125440]: pgmap v19256: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:59:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:20 smithi136 ceph-mon[125702]: pgmap v19257: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:59:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:20 smithi057 ceph-mon[92072]: pgmap v19257: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:59:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:20 smithi122 ceph-mon[125440]: pgmap v19257: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:59:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:22 smithi136 ceph-mon[125702]: pgmap v19258: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:59:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:22 smithi057 ceph-mon[92072]: pgmap v19258: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:59:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:22 smithi122 ceph-mon[125440]: pgmap v19258: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T20:59:23.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:23 smithi136 ceph-mon[125702]: pgmap v19259: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:59:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:23 smithi057 ceph-mon[92072]: pgmap v19259: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:59:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:23 smithi122 ceph-mon[125440]: pgmap v19259: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T20:59:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:26 smithi136 ceph-mon[125702]: pgmap v19260: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:59:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:26 smithi057 ceph-mon[92072]: pgmap v19260: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:59:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:26 smithi122 ceph-mon[125440]: pgmap v19260: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T20:59:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:28 smithi136 ceph-mon[125702]: pgmap v19261: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:28.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:28 smithi057 ceph-mon[92072]: pgmap v19261: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:28 smithi122 ceph-mon[125440]: pgmap v19261: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:30 smithi136 ceph-mon[125702]: pgmap v19262: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:30 smithi057 ceph-mon[92072]: pgmap v19262: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:30 smithi122 ceph-mon[125440]: pgmap v19262: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:31.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:59:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:31.648+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:59:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:31.648+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:59:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:31.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:59:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:31.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:59:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:32 smithi136 ceph-mon[125702]: pgmap v19263: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:32.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:32 smithi057 ceph-mon[92072]: pgmap v19263: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:32 smithi122 ceph-mon[125440]: pgmap v19263: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:34 smithi136 ceph-mon[125702]: pgmap v19264: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:34 smithi057 ceph-mon[92072]: pgmap v19264: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:34 smithi122 ceph-mon[125440]: pgmap v19264: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:36 smithi136 ceph-mon[125702]: pgmap v19265: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:36 smithi057 ceph-mon[92072]: pgmap v19265: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:36 smithi122 ceph-mon[125440]: pgmap v19265: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:38 smithi136 ceph-mon[125702]: pgmap v19266: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:59:38.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:38 smithi057 ceph-mon[92072]: pgmap v19266: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:38.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:59:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:38 smithi122 ceph-mon[125440]: pgmap v19266: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T20:59:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:59:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:59:39.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:59:39.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:59:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:59:39.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:59:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T20:59:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T20:59:39.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T20:59:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:40 smithi136 ceph-mon[125702]: pgmap v19267: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:40 smithi057 ceph-mon[92072]: pgmap v19267: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:40 smithi122 ceph-mon[125440]: pgmap v19267: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:42 smithi136 ceph-mon[125702]: pgmap v19268: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:42 smithi057 ceph-mon[92072]: pgmap v19268: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:42 smithi122 ceph-mon[125440]: pgmap v19268: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:44 smithi136 ceph-mon[125702]: pgmap v19269: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:44.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:44 smithi057 ceph-mon[92072]: pgmap v19269: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:44 smithi122 ceph-mon[125440]: pgmap v19269: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:46.663+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T20:59:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:46.663+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T20:59:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:46.663+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T20:59:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:46.663+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T20:59:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T20:59:46.664+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T20:59:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:46 smithi136 ceph-mon[125702]: pgmap v19270: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:46 smithi057 ceph-mon[92072]: pgmap v19270: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:46.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:46 smithi122 ceph-mon[125440]: pgmap v19270: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:47 smithi136 ceph-mon[125702]: pgmap v19271: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:47.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:47 smithi057 ceph-mon[92072]: pgmap v19271: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:47.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:47 smithi122 ceph-mon[125440]: pgmap v19271: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:50 smithi136 ceph-mon[125702]: pgmap v19272: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:50 smithi057 ceph-mon[92072]: pgmap v19272: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:50 smithi122 ceph-mon[125440]: pgmap v19272: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:52 smithi136 ceph-mon[125702]: pgmap v19273: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:52 smithi057 ceph-mon[92072]: pgmap v19273: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:52 smithi122 ceph-mon[125440]: pgmap v19273: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:54 smithi136 ceph-mon[125702]: pgmap v19274: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:54.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:54 smithi057 ceph-mon[92072]: pgmap v19274: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:54 smithi122 ceph-mon[125440]: pgmap v19274: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:56 smithi136 ceph-mon[125702]: pgmap v19275: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:56 smithi057 ceph-mon[92072]: pgmap v19275: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:56 smithi122 ceph-mon[125440]: pgmap v19275: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T20:59:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 20:59:58 smithi136 ceph-mon[125702]: pgmap v19276: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 20:59:58 smithi057 ceph-mon[92072]: pgmap v19276: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T20:59:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 20:59:58 smithi122 ceph-mon[125440]: pgmap v19276: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:00 smithi136 ceph-mon[125702]: pgmap v19277: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T21:00:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:00 smithi057 ceph-mon[92072]: pgmap v19277: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:00.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T21:00:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:00 smithi122 ceph-mon[125440]: pgmap v19277: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T21:00:01.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:01.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:00:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:01.678+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:00:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:01.678+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:00:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:01.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:00:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:01.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:00:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:02 smithi136 ceph-mon[125702]: pgmap v19278: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:02 smithi057 ceph-mon[92072]: pgmap v19278: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:02 smithi122 ceph-mon[125440]: pgmap v19278: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:04 smithi136 ceph-mon[125702]: pgmap v19279: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:00:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:04 smithi057 ceph-mon[92072]: pgmap v19279: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:00:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:04 smithi122 ceph-mon[125440]: pgmap v19279: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:00:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:05 smithi136 ceph-mon[125702]: pgmap v19280: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:00:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:05 smithi057 ceph-mon[92072]: pgmap v19280: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:00:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:05 smithi122 ceph-mon[125440]: pgmap v19280: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:00:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:08 smithi057 ceph-mon[92072]: pgmap v19281: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:00:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:08 smithi122 ceph-mon[125440]: pgmap v19281: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:00:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:08 smithi136 ceph-mon[125702]: pgmap v19281: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:00:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:10 smithi136 ceph-mon[125702]: pgmap v19282: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:00:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:10 smithi057 ceph-mon[92072]: pgmap v19282: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:00:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:10 smithi122 ceph-mon[125440]: pgmap v19282: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:00:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:12 smithi136 ceph-mon[125702]: pgmap v19283: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:00:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:12 smithi136 ceph-mon[125702]: osdmap e1278: 12 total, 12 up, 12 in 2023-03-02T21:00:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:12 smithi057 ceph-mon[92072]: pgmap v19283: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:00:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:12 smithi057 ceph-mon[92072]: osdmap e1278: 12 total, 12 up, 12 in 2023-03-02T21:00:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:12 smithi122 ceph-mon[125440]: pgmap v19283: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:00:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:12 smithi122 ceph-mon[125440]: osdmap e1278: 12 total, 12 up, 12 in 2023-03-02T21:00:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:14 smithi136 ceph-mon[125702]: pgmap v19285: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:14.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:14 smithi057 ceph-mon[92072]: pgmap v19285: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:14 smithi122 ceph-mon[125440]: pgmap v19285: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:16.694+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:00:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:16.694+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:00:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:16.694+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:00:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:16.694+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:00:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:16.694+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:00:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:16 smithi136 ceph-mon[125702]: pgmap v19286: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:16 smithi057 ceph-mon[92072]: pgmap v19286: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:16 smithi122 ceph-mon[125440]: pgmap v19286: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:18 smithi136 ceph-mon[125702]: pgmap v19287: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:00:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:18 smithi057 ceph-mon[92072]: pgmap v19287: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:00:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:18 smithi122 ceph-mon[125440]: pgmap v19287: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:00:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:20 smithi136 ceph-mon[125702]: pgmap v19288: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:00:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:20 smithi136 ceph-mon[125702]: osdmap e1279: 12 total, 12 up, 12 in 2023-03-02T21:00:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:20 smithi057 ceph-mon[92072]: pgmap v19288: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:00:20.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:20 smithi057 ceph-mon[92072]: osdmap e1279: 12 total, 12 up, 12 in 2023-03-02T21:00:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:20 smithi122 ceph-mon[125440]: pgmap v19288: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:00:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:20 smithi122 ceph-mon[125440]: osdmap e1279: 12 total, 12 up, 12 in 2023-03-02T21:00:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:22 smithi136 ceph-mon[125702]: pgmap v19290: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 321 B/s wr, 10 op/s 2023-03-02T21:00:22.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:22 smithi057 ceph-mon[92072]: pgmap v19290: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 321 B/s wr, 10 op/s 2023-03-02T21:00:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:22 smithi122 ceph-mon[125440]: pgmap v19290: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 321 B/s wr, 10 op/s 2023-03-02T21:00:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:24 smithi136 ceph-mon[125702]: pgmap v19291: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:24 smithi057 ceph-mon[92072]: pgmap v19291: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:24 smithi122 ceph-mon[125440]: pgmap v19291: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:26 smithi136 ceph-mon[125702]: pgmap v19292: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:26 smithi057 ceph-mon[92072]: pgmap v19292: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:26 smithi122 ceph-mon[125440]: pgmap v19292: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:00:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:28 smithi136 ceph-mon[125702]: pgmap v19293: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:00:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:28 smithi057 ceph-mon[92072]: pgmap v19293: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:00:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:28 smithi122 ceph-mon[125440]: pgmap v19293: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:00:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:30 smithi136 ceph-mon[125702]: pgmap v19294: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:00:30.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:30 smithi057 ceph-mon[92072]: pgmap v19294: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:00:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:30 smithi122 ceph-mon[125440]: pgmap v19294: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:00:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:31.710+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:00:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:31.710+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:00:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:31.710+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:00:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:31.710+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:00:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:31.710+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:00:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:32 smithi136 ceph-mon[125702]: pgmap v19295: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T21:00:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:32 smithi057 ceph-mon[92072]: pgmap v19295: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T21:00:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:32 smithi122 ceph-mon[125440]: pgmap v19295: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T21:00:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:34 smithi136 ceph-mon[125702]: pgmap v19296: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:34.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:34 smithi057 ceph-mon[92072]: pgmap v19296: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:34 smithi122 ceph-mon[125440]: pgmap v19296: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:36 smithi136 ceph-mon[125702]: pgmap v19297: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:36 smithi057 ceph-mon[92072]: pgmap v19297: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:36 smithi122 ceph-mon[125440]: pgmap v19297: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:37.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:37 smithi136 ceph-mon[125702]: pgmap v19298: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:37.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:37 smithi057 ceph-mon[92072]: pgmap v19298: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:37.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:37 smithi122 ceph-mon[125440]: pgmap v19298: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:39.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:00:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:00:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:00:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:40 smithi136 ceph-mon[125702]: pgmap v19299: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:00:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:00:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:00:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:40 smithi057 ceph-mon[92072]: pgmap v19299: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:00:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:00:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:00:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:40 smithi122 ceph-mon[125440]: pgmap v19299: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:00:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:00:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:00:42.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:42 smithi136 ceph-mon[125702]: pgmap v19300: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:42 smithi057 ceph-mon[92072]: pgmap v19300: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:42 smithi122 ceph-mon[125440]: pgmap v19300: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:44.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:44 smithi136 ceph-mon[125702]: pgmap v19301: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:44 smithi057 ceph-mon[92072]: pgmap v19301: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:44.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:44 smithi122 ceph-mon[125440]: pgmap v19301: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:46.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:00:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:46.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:00:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:46.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:00:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:46.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:00:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:00:46.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:00:46.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:46 smithi136 ceph-mon[125702]: pgmap v19302: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:46 smithi057 ceph-mon[92072]: pgmap v19302: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:46 smithi122 ceph-mon[125440]: pgmap v19302: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:48 smithi136 ceph-mon[125702]: pgmap v19303: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:48 smithi057 ceph-mon[92072]: pgmap v19303: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:48 smithi122 ceph-mon[125440]: pgmap v19303: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:50 smithi136 ceph-mon[125702]: pgmap v19304: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:50 smithi057 ceph-mon[92072]: pgmap v19304: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:50 smithi122 ceph-mon[125440]: pgmap v19304: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:52 smithi136 ceph-mon[125702]: pgmap v19305: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:52 smithi057 ceph-mon[92072]: pgmap v19305: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:52 smithi122 ceph-mon[125440]: pgmap v19305: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:53.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:53 smithi136 ceph-mon[125702]: pgmap v19306: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:53 smithi057 ceph-mon[92072]: pgmap v19306: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:53.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:53 smithi122 ceph-mon[125440]: pgmap v19306: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:56 smithi136 ceph-mon[125702]: pgmap v19307: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:56 smithi057 ceph-mon[92072]: pgmap v19307: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:56 smithi122 ceph-mon[125440]: pgmap v19307: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:00:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:00:58 smithi136 ceph-mon[125702]: pgmap v19308: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:00:58 smithi057 ceph-mon[92072]: pgmap v19308: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:00:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:00:58 smithi122 ceph-mon[125440]: pgmap v19308: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:00 smithi136 ceph-mon[125702]: pgmap v19309: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:00 smithi057 ceph-mon[92072]: pgmap v19309: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:00 smithi122 ceph-mon[125440]: pgmap v19309: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:01.735+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:01:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:01.735+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:01:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:01.735+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:01:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:01.735+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:01:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:01.735+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:01:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:02 smithi136 ceph-mon[125702]: pgmap v19310: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:02 smithi057 ceph-mon[92072]: pgmap v19310: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:02 smithi122 ceph-mon[125440]: pgmap v19310: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:04 smithi136 ceph-mon[125702]: pgmap v19311: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:01:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:04 smithi057 ceph-mon[92072]: pgmap v19311: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:01:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:04 smithi122 ceph-mon[125440]: pgmap v19311: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:01:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:06 smithi136 ceph-mon[125702]: pgmap v19312: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:01:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:06 smithi057 ceph-mon[92072]: pgmap v19312: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:01:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:06 smithi122 ceph-mon[125440]: pgmap v19312: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:01:07.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:07 smithi136 ceph-mon[125702]: osdmap e1280: 12 total, 12 up, 12 in 2023-03-02T21:01:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:07 smithi057 ceph-mon[92072]: osdmap e1280: 12 total, 12 up, 12 in 2023-03-02T21:01:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:07 smithi122 ceph-mon[125440]: osdmap e1280: 12 total, 12 up, 12 in 2023-03-02T21:01:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:08 smithi136 ceph-mon[125702]: pgmap v19314: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:01:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:08 smithi057 ceph-mon[92072]: pgmap v19314: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:01:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:08 smithi122 ceph-mon[125440]: pgmap v19314: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:01:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:10 smithi136 ceph-mon[125702]: pgmap v19315: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:01:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:10 smithi057 ceph-mon[92072]: pgmap v19315: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:01:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:10 smithi122 ceph-mon[125440]: pgmap v19315: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:01:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:12 smithi136 ceph-mon[125702]: pgmap v19316: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:01:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:12 smithi057 ceph-mon[92072]: pgmap v19316: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:01:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:12 smithi122 ceph-mon[125440]: pgmap v19316: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:01:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:14 smithi136 ceph-mon[125702]: pgmap v19317: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:01:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:14 smithi136 ceph-mon[125702]: osdmap e1281: 12 total, 12 up, 12 in 2023-03-02T21:01:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:14 smithi057 ceph-mon[92072]: pgmap v19317: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:01:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:14 smithi057 ceph-mon[92072]: osdmap e1281: 12 total, 12 up, 12 in 2023-03-02T21:01:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:14 smithi122 ceph-mon[125440]: pgmap v19317: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:01:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:14 smithi122 ceph-mon[125440]: osdmap e1281: 12 total, 12 up, 12 in 2023-03-02T21:01:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:16.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:01:16.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:16.750+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:01:16.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:16.750+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:01:16.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:16.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:01:16.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:16.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:01:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:16 smithi136 ceph-mon[125702]: pgmap v19319: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:01:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:16 smithi057 ceph-mon[92072]: pgmap v19319: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:01:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:16 smithi122 ceph-mon[125440]: pgmap v19319: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:01:18.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:18 smithi136 ceph-mon[125702]: pgmap v19320: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:01:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:18 smithi057 ceph-mon[92072]: pgmap v19320: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:01:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:18 smithi122 ceph-mon[125440]: pgmap v19320: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:01:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:20 smithi136 ceph-mon[125702]: pgmap v19321: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:01:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:20 smithi057 ceph-mon[92072]: pgmap v19321: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:01:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:20 smithi122 ceph-mon[125440]: pgmap v19321: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:01:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:22 smithi136 ceph-mon[125702]: pgmap v19322: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:01:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:22 smithi057 ceph-mon[92072]: pgmap v19322: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:01:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:22 smithi122 ceph-mon[125440]: pgmap v19322: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:01:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:24 smithi136 ceph-mon[125702]: pgmap v19323: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:01:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:24 smithi057 ceph-mon[92072]: pgmap v19323: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:01:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:24 smithi122 ceph-mon[125440]: pgmap v19323: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:01:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:26 smithi136 ceph-mon[125702]: pgmap v19324: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:01:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:26 smithi057 ceph-mon[92072]: pgmap v19324: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:01:26.973 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:26 smithi122 ceph-mon[125440]: pgmap v19324: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:01:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:27 smithi136 ceph-mon[125702]: pgmap v19325: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:27 smithi057 ceph-mon[92072]: pgmap v19325: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:27.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:27 smithi122 ceph-mon[125440]: pgmap v19325: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:28.598+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:01:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:28.598+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:01:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:28.598+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 279 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:01:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:28.599+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 278 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:01:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:30 smithi136 ceph-mon[125702]: pgmap v19326: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:30 smithi057 ceph-mon[92072]: pgmap v19326: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:30 smithi122 ceph-mon[125440]: pgmap v19326: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:31.762+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:01:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:31.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:01:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:31.763+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:01:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:31.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:01:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:31.763+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:01:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:32 smithi136 ceph-mon[125702]: pgmap v19327: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:32 smithi057 ceph-mon[92072]: pgmap v19327: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:32 smithi122 ceph-mon[125440]: pgmap v19327: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:34.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:34 smithi136 ceph-mon[125702]: pgmap v19328: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:34 smithi057 ceph-mon[92072]: pgmap v19328: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:34.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:34 smithi122 ceph-mon[125440]: pgmap v19328: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:36 smithi136 ceph-mon[125702]: pgmap v19329: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:36 smithi057 ceph-mon[92072]: pgmap v19329: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:36 smithi122 ceph-mon[125440]: pgmap v19329: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:38.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:38 smithi136 ceph-mon[125702]: pgmap v19330: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:38 smithi057 ceph-mon[92072]: pgmap v19330: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:38 smithi122 ceph-mon[125440]: pgmap v19330: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:40 smithi136 ceph-mon[125702]: pgmap v19331: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:40.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:01:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:40 smithi057 ceph-mon[92072]: pgmap v19331: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:01:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:40 smithi122 ceph-mon[125440]: pgmap v19331: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:01:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:01:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:01:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:01:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:41 smithi136 ceph-mon[125702]: pgmap v19332: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:01:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:01:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:01:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:41 smithi057 ceph-mon[92072]: pgmap v19332: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:01:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:01:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:01:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:41 smithi122 ceph-mon[125440]: pgmap v19332: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:44 smithi122 ceph-mon[125440]: pgmap v19333: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:44 smithi136 ceph-mon[125702]: pgmap v19333: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:44 smithi057 ceph-mon[92072]: pgmap v19333: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:46.773+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:01:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:46.774+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:01:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:46.774+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:01:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:46.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:01:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:01:46.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:01:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:46 smithi136 ceph-mon[125702]: pgmap v19334: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:46 smithi057 ceph-mon[92072]: pgmap v19334: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:46 smithi122 ceph-mon[125440]: pgmap v19334: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:48 smithi136 ceph-mon[125702]: pgmap v19335: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:48 smithi057 ceph-mon[92072]: pgmap v19335: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:48 smithi122 ceph-mon[125440]: pgmap v19335: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:50.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:50 smithi136 ceph-mon[125702]: pgmap v19336: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:50 smithi057 ceph-mon[92072]: pgmap v19336: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:50 smithi122 ceph-mon[125440]: pgmap v19336: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:52.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:52 smithi136 ceph-mon[125702]: pgmap v19337: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:52 smithi057 ceph-mon[92072]: pgmap v19337: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:52 smithi122 ceph-mon[125440]: pgmap v19337: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:54.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:54 smithi136 ceph-mon[125702]: pgmap v19338: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:54 smithi057 ceph-mon[92072]: pgmap v19338: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:54 smithi122 ceph-mon[125440]: pgmap v19338: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:56 smithi136 ceph-mon[125702]: pgmap v19339: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:56 smithi057 ceph-mon[92072]: pgmap v19339: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:56 smithi122 ceph-mon[125440]: pgmap v19339: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:01:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:01:58 smithi136 ceph-mon[125702]: pgmap v19340: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:01:58 smithi057 ceph-mon[92072]: pgmap v19340: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:01:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:01:58 smithi122 ceph-mon[125440]: pgmap v19340: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:00 smithi136 ceph-mon[125702]: pgmap v19341: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:00 smithi057 ceph-mon[92072]: pgmap v19341: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:00 smithi122 ceph-mon[125440]: pgmap v19341: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:01.777+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:02:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:01.777+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:02:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:01.777+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:02:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:01.777+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:02:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:01.777+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:02:02.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:02 smithi136 ceph-mon[125702]: pgmap v19342: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:02 smithi057 ceph-mon[92072]: pgmap v19342: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:02 smithi122 ceph-mon[125440]: pgmap v19342: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:04.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:04 smithi136 ceph-mon[125702]: pgmap v19343: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:02:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:04 smithi057 ceph-mon[92072]: pgmap v19343: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:02:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:04 smithi122 ceph-mon[125440]: pgmap v19343: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:02:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:06 smithi136 ceph-mon[125702]: pgmap v19344: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:02:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:06 smithi057 ceph-mon[92072]: pgmap v19344: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:02:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:06 smithi122 ceph-mon[125440]: pgmap v19344: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:02:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:07 smithi136 ceph-mon[125702]: osdmap e1282: 12 total, 12 up, 12 in 2023-03-02T21:02:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:07 smithi057 ceph-mon[92072]: osdmap e1282: 12 total, 12 up, 12 in 2023-03-02T21:02:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:07 smithi122 ceph-mon[125440]: osdmap e1282: 12 total, 12 up, 12 in 2023-03-02T21:02:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:08 smithi136 ceph-mon[125702]: pgmap v19346: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:02:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:08 smithi057 ceph-mon[92072]: pgmap v19346: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:02:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:08 smithi122 ceph-mon[125440]: pgmap v19346: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:02:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:10 smithi136 ceph-mon[125702]: pgmap v19347: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:02:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:10 smithi057 ceph-mon[92072]: pgmap v19347: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:02:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:10 smithi122 ceph-mon[125440]: pgmap v19347: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:02:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:12 smithi136 ceph-mon[125702]: pgmap v19348: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:02:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:12 smithi057 ceph-mon[92072]: pgmap v19348: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:02:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:12 smithi122 ceph-mon[125440]: pgmap v19348: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:02:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:13.604+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:02:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:13.604+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:02:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:13.604+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 279 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:02:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:13.604+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 280 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:02:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:14 smithi136 ceph-mon[125702]: pgmap v19349: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:02:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:14 smithi057 ceph-mon[92072]: pgmap v19349: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:02:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:14 smithi122 ceph-mon[125440]: pgmap v19349: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:02:15.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:15 smithi136 ceph-mon[125702]: osdmap e1283: 12 total, 12 up, 12 in 2023-03-02T21:02:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:15 smithi057 ceph-mon[92072]: osdmap e1283: 12 total, 12 up, 12 in 2023-03-02T21:02:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:15 smithi122 ceph-mon[125440]: osdmap e1283: 12 total, 12 up, 12 in 2023-03-02T21:02:16.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:16.791+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:02:16.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:16.791+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:02:16.794 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:16.791+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:02:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:16.791+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:02:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:16.791+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:02:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:16 smithi136 ceph-mon[125702]: pgmap v19351: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 239 B/s wr, 11 op/s 2023-03-02T21:02:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:16 smithi057 ceph-mon[92072]: pgmap v19351: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 239 B/s wr, 11 op/s 2023-03-02T21:02:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:16 smithi122 ceph-mon[125440]: pgmap v19351: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 239 B/s wr, 11 op/s 2023-03-02T21:02:17.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:17 smithi136 ceph-mon[125702]: pgmap v19352: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:02:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:17 smithi057 ceph-mon[92072]: pgmap v19352: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:02:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:17 smithi122 ceph-mon[125440]: pgmap v19352: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:02:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:20 smithi136 ceph-mon[125702]: pgmap v19353: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:02:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:20 smithi057 ceph-mon[92072]: pgmap v19353: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:02:20.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:20 smithi122 ceph-mon[125440]: pgmap v19353: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:02:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:22 smithi136 ceph-mon[125702]: pgmap v19354: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:02:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:22 smithi057 ceph-mon[92072]: pgmap v19354: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:02:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:22 smithi122 ceph-mon[125440]: pgmap v19354: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:02:24.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:24 smithi136 ceph-mon[125702]: pgmap v19355: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:02:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:24 smithi057 ceph-mon[92072]: pgmap v19355: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:02:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:24 smithi122 ceph-mon[125440]: pgmap v19355: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:02:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:26 smithi136 ceph-mon[125702]: pgmap v19356: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:02:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:26 smithi057 ceph-mon[92072]: pgmap v19356: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:02:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:26 smithi122 ceph-mon[125440]: pgmap v19356: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:02:28.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:28 smithi136 ceph-mon[125702]: pgmap v19357: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:28 smithi057 ceph-mon[92072]: pgmap v19357: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:28 smithi122 ceph-mon[125440]: pgmap v19357: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:30.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:30 smithi136 ceph-mon[125702]: pgmap v19358: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:30 smithi057 ceph-mon[92072]: pgmap v19358: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:30 smithi122 ceph-mon[125440]: pgmap v19358: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:31.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:02:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:31.808+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:02:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:31.808+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:02:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:31.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:02:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:31.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:02:32.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:32 smithi136 ceph-mon[125702]: pgmap v19359: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:32 smithi057 ceph-mon[92072]: pgmap v19359: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:32 smithi122 ceph-mon[125440]: pgmap v19359: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:33 smithi057 ceph-mon[92072]: pgmap v19360: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:33.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:33 smithi122 ceph-mon[125440]: pgmap v19360: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:33 smithi136 ceph-mon[125702]: pgmap v19360: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:36 smithi136 ceph-mon[125702]: pgmap v19361: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:36 smithi057 ceph-mon[92072]: pgmap v19361: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:36 smithi122 ceph-mon[125440]: pgmap v19361: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:38 smithi136 ceph-mon[125702]: pgmap v19362: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:38 smithi057 ceph-mon[92072]: pgmap v19362: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:38 smithi122 ceph-mon[125440]: pgmap v19362: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:40 smithi136 ceph-mon[125702]: pgmap v19363: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:40 smithi057 ceph-mon[92072]: pgmap v19363: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:40 smithi122 ceph-mon[125440]: pgmap v19363: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:41.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:02:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:02:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:02:41.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:41 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:02:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:02:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:02:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:02:41.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:41 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:02:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:02:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:02:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:02:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:41 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:02:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:42 smithi136 ceph-mon[125702]: pgmap v19364: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:42 smithi057 ceph-mon[92072]: pgmap v19364: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:42 smithi122 ceph-mon[125440]: pgmap v19364: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:43 smithi057 ceph-mon[92072]: pgmap v19365: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:43 smithi122 ceph-mon[125440]: pgmap v19365: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:43 smithi136 ceph-mon[125702]: pgmap v19365: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:46.823 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:46.821+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:02:46.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:46.822+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:02:46.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:46.822+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:02:46.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:46.822+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:02:46.824 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:02:46.822+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:02:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:46 smithi136 ceph-mon[125702]: pgmap v19366: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:46 smithi057 ceph-mon[92072]: pgmap v19366: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:46 smithi122 ceph-mon[125440]: pgmap v19366: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:48.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:48 smithi136 ceph-mon[125702]: pgmap v19367: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:48 smithi057 ceph-mon[92072]: pgmap v19367: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:48.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:48 smithi122 ceph-mon[125440]: pgmap v19367: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:50 smithi136 ceph-mon[125702]: pgmap v19368: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:50 smithi057 ceph-mon[92072]: pgmap v19368: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:50.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:50 smithi122 ceph-mon[125440]: pgmap v19368: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:51 smithi057 ceph-mon[92072]: pgmap v19369: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:51.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:51 smithi122 ceph-mon[125440]: pgmap v19369: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:51 smithi136 ceph-mon[125702]: pgmap v19369: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:54 smithi136 ceph-mon[125702]: pgmap v19370: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:54 smithi057 ceph-mon[92072]: pgmap v19370: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:54 smithi122 ceph-mon[125440]: pgmap v19370: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:56 smithi136 ceph-mon[125702]: pgmap v19371: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:56 smithi057 ceph-mon[92072]: pgmap v19371: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:56 smithi122 ceph-mon[125440]: pgmap v19371: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:02:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:02:58 smithi136 ceph-mon[125702]: pgmap v19372: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:02:58 smithi057 ceph-mon[92072]: pgmap v19372: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:02:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:02:58 smithi122 ceph-mon[125440]: pgmap v19372: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:00 smithi136 ceph-mon[125702]: pgmap v19373: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:00 smithi057 ceph-mon[92072]: pgmap v19373: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:00.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:00 smithi122 ceph-mon[125440]: pgmap v19373: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:01.837+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:03:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:01.838+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:03:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:01.838+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:03:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:01.838+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:03:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:01.838+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:03:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:01 smithi057 ceph-mon[92072]: pgmap v19374: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:01 smithi122 ceph-mon[125440]: pgmap v19374: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:01 smithi136 ceph-mon[125702]: pgmap v19374: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:04 smithi136 ceph-mon[125702]: pgmap v19375: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:03:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:04 smithi057 ceph-mon[92072]: pgmap v19375: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:03:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:04 smithi122 ceph-mon[125440]: pgmap v19375: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:03:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:06 smithi136 ceph-mon[125702]: pgmap v19376: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:03:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:06 smithi057 ceph-mon[92072]: pgmap v19376: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:03:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:06 smithi122 ceph-mon[125440]: pgmap v19376: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:03:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:07 smithi136 ceph-mon[125702]: osdmap e1284: 12 total, 12 up, 12 in 2023-03-02T21:03:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:07 smithi057 ceph-mon[92072]: osdmap e1284: 12 total, 12 up, 12 in 2023-03-02T21:03:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:07 smithi122 ceph-mon[125440]: osdmap e1284: 12 total, 12 up, 12 in 2023-03-02T21:03:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:08 smithi057 ceph-mon[92072]: pgmap v19378: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:03:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:08 smithi122 ceph-mon[125440]: pgmap v19378: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:03:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:08 smithi136 ceph-mon[125702]: pgmap v19378: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:03:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:10 smithi136 ceph-mon[125702]: pgmap v19379: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:03:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:10 smithi057 ceph-mon[92072]: pgmap v19379: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:03:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:10 smithi122 ceph-mon[125440]: pgmap v19379: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:03:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:12 smithi136 ceph-mon[125702]: pgmap v19380: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:03:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:12 smithi057 ceph-mon[92072]: pgmap v19380: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:03:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:12 smithi122 ceph-mon[125440]: pgmap v19380: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:03:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:13 smithi057 ceph-mon[92072]: pgmap v19381: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:03:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:13 smithi122 ceph-mon[125440]: pgmap v19381: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:03:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:13 smithi136 ceph-mon[125702]: pgmap v19381: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:03:15.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:15 smithi136 ceph-mon[125702]: osdmap e1285: 12 total, 12 up, 12 in 2023-03-02T21:03:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:15 smithi057 ceph-mon[92072]: osdmap e1285: 12 total, 12 up, 12 in 2023-03-02T21:03:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:15 smithi122 ceph-mon[125440]: osdmap e1285: 12 total, 12 up, 12 in 2023-03-02T21:03:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:16 smithi136 ceph-mon[125702]: pgmap v19383: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:03:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:16.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:03:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:16.840+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:03:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:16.840+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:03:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:16.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:03:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:16.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:03:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:16 smithi057 ceph-mon[92072]: pgmap v19383: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:03:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:16 smithi122 ceph-mon[125440]: pgmap v19383: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:03:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:18 smithi057 ceph-mon[92072]: pgmap v19384: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:03:18.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:18 smithi122 ceph-mon[125440]: pgmap v19384: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:03:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:18 smithi136 ceph-mon[125702]: pgmap v19384: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:03:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:20 smithi136 ceph-mon[125702]: pgmap v19385: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:03:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:20 smithi057 ceph-mon[92072]: pgmap v19385: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:03:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:20 smithi122 ceph-mon[125440]: pgmap v19385: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:03:22.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:22 smithi136 ceph-mon[125702]: pgmap v19386: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:03:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:22 smithi057 ceph-mon[92072]: pgmap v19386: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:03:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:22 smithi122 ceph-mon[125440]: pgmap v19386: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:03:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:24 smithi136 ceph-mon[125702]: pgmap v19387: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T21:03:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:24 smithi057 ceph-mon[92072]: pgmap v19387: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T21:03:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:24 smithi122 ceph-mon[125440]: pgmap v19387: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2023-03-02T21:03:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:25 smithi057 ceph-mon[92072]: pgmap v19388: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:03:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:25 smithi122 ceph-mon[125440]: pgmap v19388: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:03:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:25 smithi136 ceph-mon[125702]: pgmap v19388: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:03:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:28 smithi136 ceph-mon[125702]: pgmap v19389: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:03:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:28 smithi057 ceph-mon[92072]: pgmap v19389: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:03:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:28 smithi122 ceph-mon[125440]: pgmap v19389: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:03:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:30 smithi136 ceph-mon[125702]: pgmap v19390: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:30 smithi057 ceph-mon[92072]: pgmap v19390: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:30 smithi122 ceph-mon[125440]: pgmap v19390: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:31.855 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:31.853+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:03:31.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:31.853+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:03:31.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:31.853+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:03:31.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:31.853+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:03:31.856 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:31.853+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:03:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:32 smithi136 ceph-mon[125702]: pgmap v19391: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:32 smithi057 ceph-mon[92072]: pgmap v19391: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:32.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:32 smithi122 ceph-mon[125440]: pgmap v19391: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:34 smithi057 ceph-mon[92072]: pgmap v19392: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:34 smithi122 ceph-mon[125440]: pgmap v19392: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:34 smithi136 ceph-mon[125702]: pgmap v19392: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:35 smithi057 ceph-mon[92072]: pgmap v19393: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:35 smithi122 ceph-mon[125440]: pgmap v19393: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:35 smithi136 ceph-mon[125702]: pgmap v19393: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:38 smithi136 ceph-mon[125702]: pgmap v19394: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:38 smithi057 ceph-mon[92072]: pgmap v19394: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:38.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:38 smithi122 ceph-mon[125440]: pgmap v19394: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:40 smithi136 ceph-mon[125702]: pgmap v19395: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:40 smithi057 ceph-mon[92072]: pgmap v19395: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:40 smithi122 ceph-mon[125440]: pgmap v19395: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:42 smithi057 ceph-mon[92072]: pgmap v19396: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:42.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:03:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:42 smithi122 ceph-mon[125440]: pgmap v19396: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:42.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:03:43.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:42 smithi136 ceph-mon[125702]: pgmap v19396: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:43.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:03:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:43 smithi057 ceph-mon[92072]: pgmap v19397: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:43.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:43 smithi122 ceph-mon[125440]: pgmap v19397: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:43 smithi136 ceph-mon[125702]: pgmap v19397: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: pgmap v19398: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:46.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:03:46.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:03:46.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:03:46.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:03:46.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:03:46.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:03:46.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: pgmap v19398: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:03:46.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:03:46.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:03:46.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:03:46.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:03:46.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:03:46.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: pgmap v19398: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:03:46.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:03:46.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:03:46.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:03:46.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:03:46.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:03:46.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:03:46.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:03:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:46.856+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:03:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:46.857+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:03:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:46.857+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:03:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:46.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:03:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:03:46.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:03:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:48 smithi136 ceph-mon[125702]: pgmap v19399: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:48 smithi057 ceph-mon[92072]: pgmap v19399: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:48 smithi122 ceph-mon[125440]: pgmap v19399: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:50 smithi136 ceph-mon[125702]: pgmap v19400: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:50 smithi057 ceph-mon[92072]: pgmap v19400: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:50 smithi122 ceph-mon[125440]: pgmap v19400: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:52 smithi136 ceph-mon[125702]: pgmap v19401: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:52 smithi057 ceph-mon[92072]: pgmap v19401: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:52.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:52 smithi122 ceph-mon[125440]: pgmap v19401: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:54.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:54 smithi057 ceph-mon[92072]: pgmap v19402: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:54.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:54 smithi122 ceph-mon[125440]: pgmap v19402: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:54 smithi136 ceph-mon[125702]: pgmap v19402: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:56.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:56 smithi057 ceph-mon[92072]: pgmap v19403: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:56 smithi122 ceph-mon[125440]: pgmap v19403: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:56 smithi136 ceph-mon[125702]: pgmap v19403: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:03:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:03:57 smithi057 ceph-mon[92072]: pgmap v19404: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:03:57 smithi122 ceph-mon[125440]: pgmap v19404: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:03:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:03:57 smithi136 ceph-mon[125702]: pgmap v19404: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:00 smithi136 ceph-mon[125702]: pgmap v19405: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:00 smithi057 ceph-mon[92072]: pgmap v19405: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:00 smithi122 ceph-mon[125440]: pgmap v19405: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:01.868+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:04:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:01.869+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:04:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:01.869+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:04:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:01.869+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:04:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:01.869+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:04:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:02 smithi057 ceph-mon[92072]: pgmap v19406: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:02.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:02 smithi122 ceph-mon[125440]: pgmap v19406: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:02 smithi136 ceph-mon[125702]: pgmap v19406: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:04 smithi057 ceph-mon[92072]: pgmap v19407: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:04:04.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:04 smithi122 ceph-mon[125440]: pgmap v19407: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:04:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:04 smithi136 ceph-mon[125702]: pgmap v19407: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:04:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:05 smithi057 ceph-mon[92072]: pgmap v19408: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:04:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:05 smithi122 ceph-mon[125440]: pgmap v19408: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:04:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:05 smithi136 ceph-mon[125702]: pgmap v19408: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:04:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:07 smithi057 ceph-mon[92072]: osdmap e1286: 12 total, 12 up, 12 in 2023-03-02T21:04:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:07 smithi057 ceph-mon[92072]: pgmap v19410: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:04:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:07 smithi122 ceph-mon[125440]: osdmap e1286: 12 total, 12 up, 12 in 2023-03-02T21:04:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:07 smithi122 ceph-mon[125440]: pgmap v19410: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:04:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:07 smithi136 ceph-mon[125702]: osdmap e1286: 12 total, 12 up, 12 in 2023-03-02T21:04:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:07 smithi136 ceph-mon[125702]: pgmap v19410: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:04:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:10 smithi057 ceph-mon[92072]: pgmap v19411: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:04:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:10 smithi122 ceph-mon[125440]: pgmap v19411: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:04:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:10 smithi136 ceph-mon[125702]: pgmap v19411: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:04:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:11 smithi057 ceph-mon[92072]: pgmap v19412: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:04:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:11 smithi122 ceph-mon[125440]: pgmap v19412: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:04:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:11 smithi136 ceph-mon[125702]: pgmap v19412: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:04:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:14 smithi136 ceph-mon[125702]: pgmap v19413: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:04:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:14 smithi057 ceph-mon[92072]: pgmap v19413: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:04:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:14 smithi122 ceph-mon[125440]: pgmap v19413: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:04:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:15 smithi057 ceph-mon[92072]: osdmap e1287: 12 total, 12 up, 12 in 2023-03-02T21:04:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:15 smithi122 ceph-mon[125440]: osdmap e1287: 12 total, 12 up, 12 in 2023-03-02T21:04:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:15 smithi136 ceph-mon[125702]: osdmap e1287: 12 total, 12 up, 12 in 2023-03-02T21:04:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:16.878+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:04:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:16.878+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:04:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:16.878+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:04:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:16.878+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:04:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:16.878+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:04:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:16 smithi057 ceph-mon[92072]: pgmap v19415: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:04:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:16 smithi122 ceph-mon[125440]: pgmap v19415: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:04:17.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:16 smithi136 ceph-mon[125702]: pgmap v19415: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:04:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:17 smithi057 ceph-mon[92072]: pgmap v19416: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:04:17.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:17 smithi122 ceph-mon[125440]: pgmap v19416: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:04:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:17 smithi136 ceph-mon[125702]: pgmap v19416: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:04:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:20 smithi057 ceph-mon[92072]: pgmap v19417: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:04:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:20 smithi122 ceph-mon[125440]: pgmap v19417: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:04:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:20 smithi136 ceph-mon[125702]: pgmap v19417: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:04:22.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:22 smithi057 ceph-mon[92072]: pgmap v19418: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:04:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:22 smithi122 ceph-mon[125440]: pgmap v19418: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:04:23.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:22 smithi136 ceph-mon[125702]: pgmap v19418: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:04:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:23 smithi057 ceph-mon[92072]: pgmap v19419: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:04:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:23 smithi122 ceph-mon[125440]: pgmap v19419: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:04:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:23 smithi136 ceph-mon[125702]: pgmap v19419: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:04:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:26 smithi057 ceph-mon[92072]: pgmap v19420: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:04:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:26 smithi122 ceph-mon[125440]: pgmap v19420: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:04:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:26 smithi136 ceph-mon[125702]: pgmap v19420: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:04:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:28 smithi057 ceph-mon[92072]: pgmap v19421: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:04:28.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:28 smithi122 ceph-mon[125440]: pgmap v19421: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:04:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:28 smithi136 ceph-mon[125702]: pgmap v19421: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:04:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:30 smithi057 ceph-mon[92072]: pgmap v19422: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:30.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:30 smithi122 ceph-mon[125440]: pgmap v19422: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:30 smithi136 ceph-mon[125702]: pgmap v19422: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:31.893+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:04:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:31.893+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:04:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:31.893+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:04:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:31.893+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:04:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:31.893+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:04:32.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:32 smithi057 ceph-mon[92072]: pgmap v19423: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:32 smithi122 ceph-mon[125440]: pgmap v19423: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:32 smithi136 ceph-mon[125702]: pgmap v19423: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:33.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:33 smithi057 ceph-mon[92072]: pgmap v19424: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:33 smithi122 ceph-mon[125440]: pgmap v19424: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:33 smithi136 ceph-mon[125702]: pgmap v19424: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:36 smithi057 ceph-mon[92072]: pgmap v19425: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:36 smithi122 ceph-mon[125440]: pgmap v19425: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:36 smithi136 ceph-mon[125702]: pgmap v19425: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:38 smithi057 ceph-mon[92072]: pgmap v19426: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:38.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:38 smithi122 ceph-mon[125440]: pgmap v19426: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:38 smithi136 ceph-mon[125702]: pgmap v19426: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:40 smithi057 ceph-mon[92072]: pgmap v19427: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:40.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:40 smithi122 ceph-mon[125440]: pgmap v19427: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:41.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:40 smithi136 ceph-mon[125702]: pgmap v19427: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:41.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:41 smithi057 ceph-mon[92072]: pgmap v19428: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:41 smithi122 ceph-mon[125440]: pgmap v19428: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:41 smithi136 ceph-mon[125702]: pgmap v19428: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:44 smithi136 ceph-mon[125702]: pgmap v19429: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:44 smithi057 ceph-mon[92072]: pgmap v19429: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:44 smithi122 ceph-mon[125440]: pgmap v19429: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:46.908+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:04:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:46.908+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:04:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:46.908+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:04:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:46.908+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:04:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:04:46.908+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:04:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:46 smithi057 ceph-mon[92072]: pgmap v19430: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:46.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:04:46.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:04:46.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:04:46.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:04:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:46 smithi122 ceph-mon[125440]: pgmap v19430: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:04:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:04:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:04:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:04:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:46 smithi136 ceph-mon[125702]: pgmap v19430: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:04:47.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:04:47.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:04:47.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:04:47.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:04:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:47 smithi057 ceph-mon[92072]: pgmap v19431: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:47 smithi122 ceph-mon[125440]: pgmap v19431: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:47 smithi136 ceph-mon[125702]: pgmap v19431: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:50 smithi057 ceph-mon[92072]: pgmap v19432: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:04:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:50 smithi122 ceph-mon[125440]: pgmap v19432: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:04:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:50 smithi136 ceph-mon[125702]: pgmap v19432: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:04:51.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:51 smithi057 ceph-mon[92072]: pgmap v19433: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:04:51.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:51 smithi122 ceph-mon[125440]: pgmap v19433: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:04:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:51 smithi136 ceph-mon[125702]: pgmap v19433: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:04:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:54 smithi136 ceph-mon[125702]: pgmap v19434: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:54 smithi057 ceph-mon[92072]: pgmap v19434: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:54.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:54 smithi122 ceph-mon[125440]: pgmap v19434: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:56 smithi057 ceph-mon[92072]: pgmap v19435: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:04:56.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:56 smithi122 ceph-mon[125440]: pgmap v19435: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:04:57.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:56 smithi136 ceph-mon[125702]: pgmap v19435: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:04:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:04:57 smithi057 ceph-mon[92072]: pgmap v19436: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:57.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:04:57 smithi122 ceph-mon[125440]: pgmap v19436: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:04:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:04:57 smithi136 ceph-mon[125702]: pgmap v19436: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:00 smithi057 ceph-mon[92072]: pgmap v19437: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:00 smithi122 ceph-mon[125440]: pgmap v19437: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:00 smithi136 ceph-mon[125702]: pgmap v19437: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:01.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:05:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:01.924+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:05:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:01.924+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:05:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:01.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:05:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:01.924+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:05:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:01 smithi057 ceph-mon[92072]: pgmap v19438: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:01 smithi122 ceph-mon[125440]: pgmap v19438: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:01 smithi136 ceph-mon[125702]: pgmap v19438: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:04 smithi136 ceph-mon[125702]: pgmap v19439: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:05:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:04 smithi057 ceph-mon[92072]: pgmap v19439: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:05:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:04 smithi122 ceph-mon[125440]: pgmap v19439: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:05:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:05 smithi057 ceph-mon[92072]: pgmap v19440: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:05:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:05 smithi122 ceph-mon[125440]: pgmap v19440: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:05:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:05 smithi136 ceph-mon[125702]: pgmap v19440: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:05:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:07 smithi057 ceph-mon[92072]: osdmap e1288: 12 total, 12 up, 12 in 2023-03-02T21:05:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:07 smithi057 ceph-mon[92072]: pgmap v19442: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:05:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:07 smithi122 ceph-mon[125440]: osdmap e1288: 12 total, 12 up, 12 in 2023-03-02T21:05:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:07 smithi122 ceph-mon[125440]: pgmap v19442: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:05:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:07 smithi136 ceph-mon[125702]: osdmap e1288: 12 total, 12 up, 12 in 2023-03-02T21:05:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:07 smithi136 ceph-mon[125702]: pgmap v19442: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:05:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:10 smithi057 ceph-mon[92072]: pgmap v19443: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:05:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:10 smithi122 ceph-mon[125440]: pgmap v19443: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:05:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:10 smithi136 ceph-mon[125702]: pgmap v19443: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:05:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:11 smithi057 ceph-mon[92072]: pgmap v19444: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:05:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:11 smithi122 ceph-mon[125440]: pgmap v19444: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:05:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:11 smithi136 ceph-mon[125702]: pgmap v19444: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:05:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:13.630+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:05:13.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:13.630+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:05:13.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:13.631+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 280 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:05:13.633 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:13.631+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 281 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:05:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:14 smithi136 ceph-mon[125702]: pgmap v19445: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:05:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:14 smithi057 ceph-mon[92072]: pgmap v19445: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:05:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:14 smithi122 ceph-mon[125440]: pgmap v19445: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:05:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:15 smithi057 ceph-mon[92072]: osdmap e1289: 12 total, 12 up, 12 in 2023-03-02T21:05:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:15 smithi057 ceph-mon[92072]: pgmap v19447: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T21:05:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:15 smithi122 ceph-mon[125440]: osdmap e1289: 12 total, 12 up, 12 in 2023-03-02T21:05:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:15 smithi122 ceph-mon[125440]: pgmap v19447: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T21:05:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:15 smithi136 ceph-mon[125702]: osdmap e1289: 12 total, 12 up, 12 in 2023-03-02T21:05:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:15 smithi136 ceph-mon[125702]: pgmap v19447: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 240 B/s wr, 12 op/s 2023-03-02T21:05:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:16.929+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:05:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:16.929+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:05:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:16.929+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:05:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:16.929+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:05:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:16.929+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:05:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:18 smithi136 ceph-mon[125702]: pgmap v19448: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:05:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:18 smithi057 ceph-mon[92072]: pgmap v19448: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:05:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:18 smithi122 ceph-mon[125440]: pgmap v19448: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:05:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:20 smithi136 ceph-mon[125702]: pgmap v19449: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:05:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:20 smithi057 ceph-mon[92072]: pgmap v19449: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:05:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:20 smithi122 ceph-mon[125440]: pgmap v19449: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:05:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:22 smithi136 ceph-mon[125702]: pgmap v19450: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:05:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:22 smithi057 ceph-mon[92072]: pgmap v19450: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:05:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:22 smithi122 ceph-mon[125440]: pgmap v19450: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:05:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:24 smithi136 ceph-mon[125702]: pgmap v19451: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:05:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:24 smithi057 ceph-mon[92072]: pgmap v19451: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:05:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:24 smithi122 ceph-mon[125440]: pgmap v19451: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:05:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:25 smithi057 ceph-mon[92072]: pgmap v19452: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:05:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:25 smithi122 ceph-mon[125440]: pgmap v19452: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:05:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:25 smithi136 ceph-mon[125702]: pgmap v19452: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:05:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:28 smithi136 ceph-mon[125702]: pgmap v19453: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:05:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:28 smithi057 ceph-mon[92072]: pgmap v19453: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:05:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:28 smithi122 ceph-mon[125440]: pgmap v19453: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:05:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:30 smithi136 ceph-mon[125702]: pgmap v19454: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:30 smithi057 ceph-mon[92072]: pgmap v19454: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:30 smithi122 ceph-mon[125440]: pgmap v19454: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:31.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:31.944+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:05:31.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:31.944+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:05:31.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:31.944+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:05:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:31.944+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:05:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:31.944+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:05:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:32 smithi136 ceph-mon[125702]: pgmap v19455: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:32 smithi057 ceph-mon[92072]: pgmap v19455: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:32 smithi122 ceph-mon[125440]: pgmap v19455: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:34 smithi136 ceph-mon[125702]: pgmap v19456: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:34 smithi057 ceph-mon[92072]: pgmap v19456: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:34 smithi122 ceph-mon[125440]: pgmap v19456: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:35 smithi057 ceph-mon[92072]: pgmap v19457: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:35 smithi122 ceph-mon[125440]: pgmap v19457: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:35 smithi136 ceph-mon[125702]: pgmap v19457: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:38 smithi136 ceph-mon[125702]: pgmap v19458: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:38 smithi057 ceph-mon[92072]: pgmap v19458: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:38 smithi122 ceph-mon[125440]: pgmap v19458: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:40 smithi136 ceph-mon[125702]: pgmap v19459: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:40 smithi057 ceph-mon[92072]: pgmap v19459: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:40 smithi122 ceph-mon[125440]: pgmap v19459: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:42 smithi136 ceph-mon[125702]: pgmap v19460: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:42 smithi057 ceph-mon[92072]: pgmap v19460: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:42 smithi122 ceph-mon[125440]: pgmap v19460: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:44 smithi136 ceph-mon[125702]: pgmap v19461: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:44 smithi057 ceph-mon[92072]: pgmap v19461: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:44 smithi122 ceph-mon[125440]: pgmap v19461: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:45 smithi057 ceph-mon[92072]: pgmap v19462: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:45 smithi122 ceph-mon[125440]: pgmap v19462: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:45 smithi136 ceph-mon[125702]: pgmap v19462: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:05:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:05:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:46.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:05:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:46.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:05:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:46.957+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:05:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:46.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:05:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:05:46.957+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:05:47.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:05:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:05:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:05:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:48 smithi057 ceph-mon[92072]: pgmap v19463: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:05:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:05:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:48 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:05:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:05:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:05:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:48 smithi122 ceph-mon[125440]: pgmap v19463: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:05:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:05:48.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:48 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:05:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:05:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:05:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:48 smithi136 ceph-mon[125702]: pgmap v19463: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:05:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:05:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:48 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:05:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:50 smithi136 ceph-mon[125702]: pgmap v19464: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:50 smithi057 ceph-mon[92072]: pgmap v19464: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:50 smithi122 ceph-mon[125440]: pgmap v19464: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:52 smithi136 ceph-mon[125702]: pgmap v19465: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:52 smithi057 ceph-mon[92072]: pgmap v19465: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:52 smithi122 ceph-mon[125440]: pgmap v19465: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:54 smithi136 ceph-mon[125702]: pgmap v19466: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:54 smithi057 ceph-mon[92072]: pgmap v19466: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:54 smithi122 ceph-mon[125440]: pgmap v19466: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:55 smithi057 ceph-mon[92072]: pgmap v19467: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:55 smithi122 ceph-mon[125440]: pgmap v19467: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:55 smithi136 ceph-mon[125702]: pgmap v19467: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:05:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:05:58 smithi136 ceph-mon[125702]: pgmap v19468: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:05:58 smithi057 ceph-mon[92072]: pgmap v19468: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:05:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:05:58 smithi122 ceph-mon[125440]: pgmap v19468: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:00 smithi136 ceph-mon[125702]: pgmap v19469: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:00 smithi057 ceph-mon[92072]: pgmap v19469: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:00 smithi122 ceph-mon[125440]: pgmap v19469: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:01.972 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:01.970+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:06:01.973 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:01.971+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:06:01.973 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:01.971+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:06:01.973 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:01.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:06:01.973 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:01.971+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:06:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:02 smithi136 ceph-mon[125702]: pgmap v19470: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:02 smithi057 ceph-mon[92072]: pgmap v19470: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:02 smithi122 ceph-mon[125440]: pgmap v19470: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:04 smithi136 ceph-mon[125702]: pgmap v19471: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:06:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:04 smithi057 ceph-mon[92072]: pgmap v19471: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:06:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:04 smithi122 ceph-mon[125440]: pgmap v19471: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:06:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:05 smithi057 ceph-mon[92072]: pgmap v19472: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:06:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:05 smithi122 ceph-mon[125440]: pgmap v19472: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:06:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:05 smithi136 ceph-mon[125702]: pgmap v19472: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:06:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:07 smithi057 ceph-mon[92072]: osdmap e1290: 12 total, 12 up, 12 in 2023-03-02T21:06:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:07 smithi057 ceph-mon[92072]: pgmap v19474: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:06:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:07 smithi122 ceph-mon[125440]: osdmap e1290: 12 total, 12 up, 12 in 2023-03-02T21:06:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:07 smithi122 ceph-mon[125440]: pgmap v19474: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:06:08.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:07 smithi136 ceph-mon[125702]: osdmap e1290: 12 total, 12 up, 12 in 2023-03-02T21:06:08.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:07 smithi136 ceph-mon[125702]: pgmap v19474: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:06:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:10 smithi136 ceph-mon[125702]: pgmap v19475: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:06:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:10 smithi057 ceph-mon[92072]: pgmap v19475: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:06:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:10 smithi122 ceph-mon[125440]: pgmap v19475: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:06:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:12 smithi136 ceph-mon[125702]: pgmap v19476: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:06:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:12 smithi057 ceph-mon[92072]: pgmap v19476: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:06:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:12 smithi122 ceph-mon[125440]: pgmap v19476: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:06:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:14 smithi136 ceph-mon[125702]: pgmap v19477: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:06:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:14 smithi057 ceph-mon[92072]: pgmap v19477: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:06:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:14 smithi122 ceph-mon[125440]: pgmap v19477: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:06:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:15 smithi057 ceph-mon[92072]: osdmap e1291: 12 total, 12 up, 12 in 2023-03-02T21:06:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:15 smithi057 ceph-mon[92072]: pgmap v19479: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T21:06:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:15 smithi122 ceph-mon[125440]: osdmap e1291: 12 total, 12 up, 12 in 2023-03-02T21:06:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:15 smithi122 ceph-mon[125440]: pgmap v19479: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T21:06:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:15 smithi136 ceph-mon[125702]: osdmap e1291: 12 total, 12 up, 12 in 2023-03-02T21:06:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:15 smithi136 ceph-mon[125702]: pgmap v19479: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T21:06:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:16.986+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:06:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:16.987+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:06:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:16.987+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:06:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:16.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:06:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:16.987+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:06:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:18 smithi136 ceph-mon[125702]: pgmap v19480: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:06:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:18 smithi057 ceph-mon[92072]: pgmap v19480: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:06:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:18 smithi122 ceph-mon[125440]: pgmap v19480: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:06:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:20 smithi136 ceph-mon[125702]: pgmap v19481: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:06:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:20 smithi057 ceph-mon[92072]: pgmap v19481: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:06:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:20 smithi122 ceph-mon[125440]: pgmap v19481: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:06:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:22 smithi136 ceph-mon[125702]: pgmap v19482: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:06:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:22 smithi057 ceph-mon[92072]: pgmap v19482: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:06:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:22 smithi122 ceph-mon[125440]: pgmap v19482: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:06:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:24 smithi136 ceph-mon[125702]: pgmap v19483: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:06:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:24 smithi057 ceph-mon[92072]: pgmap v19483: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:06:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:24 smithi122 ceph-mon[125440]: pgmap v19483: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:06:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:25 smithi057 ceph-mon[92072]: pgmap v19484: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:06:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:25 smithi122 ceph-mon[125440]: pgmap v19484: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:06:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:25 smithi136 ceph-mon[125702]: pgmap v19484: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:06:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:28 smithi136 ceph-mon[125702]: pgmap v19485: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:06:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:28 smithi057 ceph-mon[92072]: pgmap v19485: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:06:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:28 smithi122 ceph-mon[125440]: pgmap v19485: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:06:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:30 smithi136 ceph-mon[125702]: pgmap v19486: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:30 smithi057 ceph-mon[92072]: pgmap v19486: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:30 smithi122 ceph-mon[125440]: pgmap v19486: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:31.990+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:06:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:31.991+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:06:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:31.991+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:06:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:31.991+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:06:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:31.991+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:06:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:32 smithi136 ceph-mon[125702]: pgmap v19487: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:32 smithi057 ceph-mon[92072]: pgmap v19487: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:32 smithi122 ceph-mon[125440]: pgmap v19487: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:34 smithi136 ceph-mon[125702]: pgmap v19488: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:34 smithi057 ceph-mon[92072]: pgmap v19488: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:34 smithi122 ceph-mon[125440]: pgmap v19488: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:35 smithi057 ceph-mon[92072]: pgmap v19489: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:35 smithi122 ceph-mon[125440]: pgmap v19489: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:35 smithi136 ceph-mon[125702]: pgmap v19489: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:38 smithi136 ceph-mon[125702]: pgmap v19490: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:38 smithi057 ceph-mon[92072]: pgmap v19490: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:38 smithi122 ceph-mon[125440]: pgmap v19490: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:40 smithi136 ceph-mon[125702]: pgmap v19491: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:40 smithi057 ceph-mon[92072]: pgmap v19491: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:40 smithi122 ceph-mon[125440]: pgmap v19491: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:42 smithi136 ceph-mon[125702]: pgmap v19492: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:42 smithi057 ceph-mon[92072]: pgmap v19492: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:42 smithi122 ceph-mon[125440]: pgmap v19492: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:44 smithi136 ceph-mon[125702]: pgmap v19493: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:44 smithi057 ceph-mon[92072]: pgmap v19493: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:44 smithi122 ceph-mon[125440]: pgmap v19493: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:45 smithi057 ceph-mon[92072]: pgmap v19494: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:45 smithi122 ceph-mon[125440]: pgmap v19494: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:45 smithi136 ceph-mon[125702]: pgmap v19494: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:46.991+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:06:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:46.991+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:06:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:46.991+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:06:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:46.991+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:06:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:06:46.991+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:06:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:48 smithi136 ceph-mon[125702]: pgmap v19495: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:48 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:06:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:48 smithi057 ceph-mon[92072]: pgmap v19495: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:48 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:06:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:48 smithi122 ceph-mon[125440]: pgmap v19495: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:48.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:48 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:06:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:06:49.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:49 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:06:49.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:49 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:06:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:49 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:06:49.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:49 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:06:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:49 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:06:49.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:49 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:06:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:50 smithi136 ceph-mon[125702]: pgmap v19496: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:50 smithi057 ceph-mon[92072]: pgmap v19496: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:50 smithi122 ceph-mon[125440]: pgmap v19496: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:52 smithi136 ceph-mon[125702]: pgmap v19497: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:52 smithi057 ceph-mon[92072]: pgmap v19497: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:52 smithi122 ceph-mon[125440]: pgmap v19497: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:54 smithi136 ceph-mon[125702]: pgmap v19498: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:54 smithi057 ceph-mon[92072]: pgmap v19498: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:54 smithi122 ceph-mon[125440]: pgmap v19498: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:55 smithi057 ceph-mon[92072]: pgmap v19499: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:55 smithi122 ceph-mon[125440]: pgmap v19499: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:55 smithi136 ceph-mon[125702]: pgmap v19499: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:06:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:06:58 smithi136 ceph-mon[125702]: pgmap v19500: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:06:58 smithi057 ceph-mon[92072]: pgmap v19500: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:06:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:06:58 smithi122 ceph-mon[125440]: pgmap v19500: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:00 smithi136 ceph-mon[125702]: pgmap v19501: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:00 smithi057 ceph-mon[92072]: pgmap v19501: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:00 smithi122 ceph-mon[125440]: pgmap v19501: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:02.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:02.004+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:07:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:02.004+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:07:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:02.004+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:07:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:02.004+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:07:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:02.004+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:07:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:02 smithi136 ceph-mon[125702]: pgmap v19502: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:02 smithi057 ceph-mon[92072]: pgmap v19502: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:02 smithi122 ceph-mon[125440]: pgmap v19502: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:04.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:04 smithi136 ceph-mon[125702]: pgmap v19503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:07:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:04 smithi057 ceph-mon[92072]: pgmap v19503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:07:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:04 smithi122 ceph-mon[125440]: pgmap v19503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:07:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:05 smithi057 ceph-mon[92072]: pgmap v19504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:07:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:05 smithi122 ceph-mon[125440]: pgmap v19504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:07:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:05 smithi136 ceph-mon[125702]: pgmap v19504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:07:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:07 smithi057 ceph-mon[92072]: osdmap e1292: 12 total, 12 up, 12 in 2023-03-02T21:07:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:07 smithi057 ceph-mon[92072]: pgmap v19506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:07:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:07 smithi122 ceph-mon[125440]: osdmap e1292: 12 total, 12 up, 12 in 2023-03-02T21:07:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:07 smithi122 ceph-mon[125440]: pgmap v19506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:07:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:07 smithi136 ceph-mon[125702]: osdmap e1292: 12 total, 12 up, 12 in 2023-03-02T21:07:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:07 smithi136 ceph-mon[125702]: pgmap v19506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:07:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:10 smithi136 ceph-mon[125702]: pgmap v19507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:07:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:10 smithi057 ceph-mon[92072]: pgmap v19507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:07:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:10 smithi122 ceph-mon[125440]: pgmap v19507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:07:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:12 smithi136 ceph-mon[125702]: pgmap v19508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:07:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:12 smithi057 ceph-mon[92072]: pgmap v19508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:07:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:12 smithi122 ceph-mon[125440]: pgmap v19508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:07:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:14 smithi136 ceph-mon[125702]: pgmap v19509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:07:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:14 smithi057 ceph-mon[92072]: pgmap v19509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:07:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:14 smithi122 ceph-mon[125440]: pgmap v19509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:07:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:15 smithi057 ceph-mon[92072]: osdmap e1293: 12 total, 12 up, 12 in 2023-03-02T21:07:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:15 smithi057 ceph-mon[92072]: pgmap v19511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:07:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:15 smithi122 ceph-mon[125440]: osdmap e1293: 12 total, 12 up, 12 in 2023-03-02T21:07:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:15 smithi122 ceph-mon[125440]: pgmap v19511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:07:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:15 smithi136 ceph-mon[125702]: osdmap e1293: 12 total, 12 up, 12 in 2023-03-02T21:07:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:15 smithi136 ceph-mon[125702]: pgmap v19511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:07:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:17.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:07:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:17.018+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:07:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:17.018+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:07:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:17.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:07:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:17.018+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:07:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:18 smithi136 ceph-mon[125702]: pgmap v19512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:07:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:18 smithi057 ceph-mon[92072]: pgmap v19512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:07:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:18 smithi122 ceph-mon[125440]: pgmap v19512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:07:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:20 smithi136 ceph-mon[125702]: pgmap v19513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:07:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:20 smithi057 ceph-mon[92072]: pgmap v19513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:07:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:20 smithi122 ceph-mon[125440]: pgmap v19513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:07:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:22 smithi136 ceph-mon[125702]: pgmap v19514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:07:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:22 smithi057 ceph-mon[92072]: pgmap v19514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:07:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:22 smithi122 ceph-mon[125440]: pgmap v19514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:07:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:24 smithi136 ceph-mon[125702]: pgmap v19515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:07:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:24 smithi057 ceph-mon[92072]: pgmap v19515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:07:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:24 smithi122 ceph-mon[125440]: pgmap v19515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:07:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:25 smithi057 ceph-mon[92072]: pgmap v19516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:07:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:25 smithi122 ceph-mon[125440]: pgmap v19516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:07:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:25 smithi136 ceph-mon[125702]: pgmap v19516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:07:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:28 smithi136 ceph-mon[125702]: pgmap v19517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:07:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:28 smithi057 ceph-mon[92072]: pgmap v19517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:07:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:28 smithi122 ceph-mon[125440]: pgmap v19517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:07:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:30 smithi136 ceph-mon[125702]: pgmap v19518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:30 smithi057 ceph-mon[92072]: pgmap v19518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:30 smithi122 ceph-mon[125440]: pgmap v19518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:32.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:32.033+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:07:32.035 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:32.034+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:07:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:32.034+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:07:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:32.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:07:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:32.034+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:07:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:32 smithi136 ceph-mon[125702]: pgmap v19519: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:32 smithi057 ceph-mon[92072]: pgmap v19519: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:32 smithi122 ceph-mon[125440]: pgmap v19519: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:34 smithi136 ceph-mon[125702]: pgmap v19520: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:34 smithi057 ceph-mon[92072]: pgmap v19520: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:34 smithi122 ceph-mon[125440]: pgmap v19520: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:35 smithi057 ceph-mon[92072]: pgmap v19521: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:35 smithi122 ceph-mon[125440]: pgmap v19521: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:35 smithi136 ceph-mon[125702]: pgmap v19521: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:38 smithi136 ceph-mon[125702]: pgmap v19522: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:38 smithi057 ceph-mon[92072]: pgmap v19522: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:38 smithi122 ceph-mon[125440]: pgmap v19522: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:40 smithi136 ceph-mon[125702]: pgmap v19523: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:40 smithi057 ceph-mon[92072]: pgmap v19523: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:40 smithi122 ceph-mon[125440]: pgmap v19523: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:42 smithi136 ceph-mon[125702]: pgmap v19524: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:42 smithi057 ceph-mon[92072]: pgmap v19524: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:42.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:42 smithi122 ceph-mon[125440]: pgmap v19524: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:44 smithi136 ceph-mon[125702]: pgmap v19525: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:44 smithi057 ceph-mon[92072]: pgmap v19525: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:44 smithi122 ceph-mon[125440]: pgmap v19525: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:45.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:45 smithi057 ceph-mon[92072]: pgmap v19526: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:45 smithi122 ceph-mon[125440]: pgmap v19526: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:45 smithi136 ceph-mon[125702]: pgmap v19526: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:47.047+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:07:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:47.047+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:07:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:47.047+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:07:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:47.047+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:07:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:07:47.047+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:07:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:48 smithi136 ceph-mon[125702]: pgmap v19527: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:48 smithi057 ceph-mon[92072]: pgmap v19527: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:48 smithi122 ceph-mon[125440]: pgmap v19527: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:50 smithi136 ceph-mon[125702]: pgmap v19528: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:07:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:07:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:07:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:07:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:50 smithi057 ceph-mon[92072]: pgmap v19528: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:07:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:07:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:07:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:07:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:50 smithi122 ceph-mon[125440]: pgmap v19528: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:07:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:07:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:07:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:07:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:52 smithi136 ceph-mon[125702]: pgmap v19529: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:52 smithi057 ceph-mon[92072]: pgmap v19529: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:52 smithi122 ceph-mon[125440]: pgmap v19529: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:54 smithi136 ceph-mon[125702]: pgmap v19530: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:54 smithi057 ceph-mon[92072]: pgmap v19530: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:54 smithi122 ceph-mon[125440]: pgmap v19530: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:55.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:55 smithi057 ceph-mon[92072]: pgmap v19531: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:55.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:55 smithi122 ceph-mon[125440]: pgmap v19531: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:55 smithi136 ceph-mon[125702]: pgmap v19531: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:07:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:07:58 smithi136 ceph-mon[125702]: pgmap v19532: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:07:58 smithi057 ceph-mon[92072]: pgmap v19532: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:07:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:07:58 smithi122 ceph-mon[125440]: pgmap v19532: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:00 smithi136 ceph-mon[125702]: pgmap v19533: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:00 smithi057 ceph-mon[92072]: pgmap v19533: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:00 smithi122 ceph-mon[125440]: pgmap v19533: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:02.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:08:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:02.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:08:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:02.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:08:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:02.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:08:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:02.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:08:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:02 smithi136 ceph-mon[125702]: pgmap v19534: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:02 smithi057 ceph-mon[92072]: pgmap v19534: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:02 smithi122 ceph-mon[125440]: pgmap v19534: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:04 smithi136 ceph-mon[125702]: pgmap v19535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:08:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:04 smithi057 ceph-mon[92072]: pgmap v19535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:08:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:04 smithi122 ceph-mon[125440]: pgmap v19535: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:08:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:05 smithi057 ceph-mon[92072]: pgmap v19536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:08:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:05 smithi122 ceph-mon[125440]: pgmap v19536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:08:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:05 smithi136 ceph-mon[125702]: pgmap v19536: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:08:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:07 smithi122 ceph-mon[125440]: osdmap e1294: 12 total, 12 up, 12 in 2023-03-02T21:08:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:07 smithi122 ceph-mon[125440]: pgmap v19538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:08:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:07 smithi136 ceph-mon[125702]: osdmap e1294: 12 total, 12 up, 12 in 2023-03-02T21:08:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:07 smithi136 ceph-mon[125702]: pgmap v19538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:08:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:07 smithi057 ceph-mon[92072]: osdmap e1294: 12 total, 12 up, 12 in 2023-03-02T21:08:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:07 smithi057 ceph-mon[92072]: pgmap v19538: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:08:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:10 smithi136 ceph-mon[125702]: pgmap v19539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:08:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:10 smithi057 ceph-mon[92072]: pgmap v19539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:08:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:10 smithi122 ceph-mon[125440]: pgmap v19539: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:08:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:12 smithi136 ceph-mon[125702]: pgmap v19540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:08:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:12 smithi057 ceph-mon[92072]: pgmap v19540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:08:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:12 smithi122 ceph-mon[125440]: pgmap v19540: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:08:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:13.656+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:08:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:13.656+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:08:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:13.656+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 281 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:08:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:13.656+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 282 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:08:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:14 smithi136 ceph-mon[125702]: pgmap v19541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:08:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:14 smithi057 ceph-mon[92072]: pgmap v19541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:08:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:14 smithi122 ceph-mon[125440]: pgmap v19541: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:08:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:15 smithi057 ceph-mon[92072]: osdmap e1295: 12 total, 12 up, 12 in 2023-03-02T21:08:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:15 smithi057 ceph-mon[92072]: pgmap v19543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:08:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:15 smithi122 ceph-mon[125440]: osdmap e1295: 12 total, 12 up, 12 in 2023-03-02T21:08:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:15 smithi122 ceph-mon[125440]: pgmap v19543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:08:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:15 smithi136 ceph-mon[125702]: osdmap e1295: 12 total, 12 up, 12 in 2023-03-02T21:08:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:15 smithi136 ceph-mon[125702]: pgmap v19543: 97 pgs: 97 active+clean; 8.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-02T21:08:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:17.065+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:08:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:17.066+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:08:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:17.066+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:08:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:17.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:08:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:17.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:08:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:18 smithi136 ceph-mon[125702]: pgmap v19544: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:08:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:18 smithi057 ceph-mon[92072]: pgmap v19544: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:08:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:18 smithi122 ceph-mon[125440]: pgmap v19544: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:08:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:20 smithi136 ceph-mon[125702]: pgmap v19545: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:08:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:20 smithi057 ceph-mon[92072]: pgmap v19545: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:08:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:20 smithi122 ceph-mon[125440]: pgmap v19545: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:08:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:22 smithi136 ceph-mon[125702]: pgmap v19546: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:08:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:22 smithi057 ceph-mon[92072]: pgmap v19546: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:08:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:22 smithi122 ceph-mon[125440]: pgmap v19546: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:08:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:24 smithi136 ceph-mon[125702]: pgmap v19547: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:08:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:24 smithi057 ceph-mon[92072]: pgmap v19547: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:08:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:24 smithi122 ceph-mon[125440]: pgmap v19547: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:08:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:25 smithi057 ceph-mon[92072]: pgmap v19548: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:08:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:25 smithi122 ceph-mon[125440]: pgmap v19548: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:08:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:25 smithi136 ceph-mon[125702]: pgmap v19548: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:08:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:28 smithi136 ceph-mon[125702]: pgmap v19549: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:28 smithi057 ceph-mon[92072]: pgmap v19549: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:28 smithi122 ceph-mon[125440]: pgmap v19549: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:30 smithi136 ceph-mon[125702]: pgmap v19550: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:30 smithi057 ceph-mon[92072]: pgmap v19550: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:30 smithi122 ceph-mon[125440]: pgmap v19550: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:32.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:08:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:32.079+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:08:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:32.079+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:08:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:32.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:08:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:32.079+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:08:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:32 smithi136 ceph-mon[125702]: pgmap v19551: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:32 smithi057 ceph-mon[92072]: pgmap v19551: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:32 smithi122 ceph-mon[125440]: pgmap v19551: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:34 smithi136 ceph-mon[125702]: pgmap v19552: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:34 smithi057 ceph-mon[92072]: pgmap v19552: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:34 smithi122 ceph-mon[125440]: pgmap v19552: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:35.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:35 smithi057 ceph-mon[92072]: pgmap v19553: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:35 smithi122 ceph-mon[125440]: pgmap v19553: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:35 smithi136 ceph-mon[125702]: pgmap v19553: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:38 smithi136 ceph-mon[125702]: pgmap v19554: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:38 smithi057 ceph-mon[92072]: pgmap v19554: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:38 smithi122 ceph-mon[125440]: pgmap v19554: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:40 smithi136 ceph-mon[125702]: pgmap v19555: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:40 smithi057 ceph-mon[92072]: pgmap v19555: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:40.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:40 smithi122 ceph-mon[125440]: pgmap v19555: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:42 smithi136 ceph-mon[125702]: pgmap v19556: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:42 smithi057 ceph-mon[92072]: pgmap v19556: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:42 smithi122 ceph-mon[125440]: pgmap v19556: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:44 smithi136 ceph-mon[125702]: pgmap v19557: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:44 smithi057 ceph-mon[92072]: pgmap v19557: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:44 smithi122 ceph-mon[125440]: pgmap v19557: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:45.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:45 smithi122 ceph-mon[125440]: pgmap v19558: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:45 smithi136 ceph-mon[125702]: pgmap v19558: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:45 smithi057 ceph-mon[92072]: pgmap v19558: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:47.095+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:47.095+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:47.095+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:47.095+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:08:47.095+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:08:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:48 smithi136 ceph-mon[125702]: pgmap v19559: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:48 smithi057 ceph-mon[92072]: pgmap v19559: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:48 smithi122 ceph-mon[125440]: pgmap v19559: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:50 smithi136 ceph-mon[125702]: pgmap v19560: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:08:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:50 smithi057 ceph-mon[92072]: pgmap v19560: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:08:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:50 smithi122 ceph-mon[125440]: pgmap v19560: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:50.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:08:51.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:08:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:08:51.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:08:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:08:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:08:51.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:08:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:08:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:08:51.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:08:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:52 smithi136 ceph-mon[125702]: pgmap v19561: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:52 smithi057 ceph-mon[92072]: pgmap v19561: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:52 smithi122 ceph-mon[125440]: pgmap v19561: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:54 smithi136 ceph-mon[125702]: pgmap v19562: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:54 smithi057 ceph-mon[92072]: pgmap v19562: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:54 smithi122 ceph-mon[125440]: pgmap v19562: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:55.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:55 smithi122 ceph-mon[125440]: pgmap v19563: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:55 smithi136 ceph-mon[125702]: pgmap v19563: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:55 smithi057 ceph-mon[92072]: pgmap v19563: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:08:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:08:58 smithi136 ceph-mon[125702]: pgmap v19564: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:08:58 smithi057 ceph-mon[92072]: pgmap v19564: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:08:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:08:58 smithi122 ceph-mon[125440]: pgmap v19564: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:00 smithi136 ceph-mon[125702]: pgmap v19565: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:00 smithi057 ceph-mon[92072]: pgmap v19565: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:00 smithi122 ceph-mon[125440]: pgmap v19565: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:02.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:09:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:02.100+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:09:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:02.100+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:09:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:02.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:09:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:02.100+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:09:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:02 smithi136 ceph-mon[125702]: pgmap v19566: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:02 smithi057 ceph-mon[92072]: pgmap v19566: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:02 smithi122 ceph-mon[125440]: pgmap v19566: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:04 smithi136 ceph-mon[125702]: pgmap v19567: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:09:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:04 smithi057 ceph-mon[92072]: pgmap v19567: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:09:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:04 smithi122 ceph-mon[125440]: pgmap v19567: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:09:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:05 smithi122 ceph-mon[125440]: pgmap v19568: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:09:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:05 smithi136 ceph-mon[125702]: pgmap v19568: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:09:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:05 smithi057 ceph-mon[92072]: pgmap v19568: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:09:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:07 smithi122 ceph-mon[125440]: osdmap e1296: 12 total, 12 up, 12 in 2023-03-02T21:09:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:07 smithi122 ceph-mon[125440]: pgmap v19570: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:09:08.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:07 smithi136 ceph-mon[125702]: osdmap e1296: 12 total, 12 up, 12 in 2023-03-02T21:09:08.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:07 smithi136 ceph-mon[125702]: pgmap v19570: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:09:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:07 smithi057 ceph-mon[92072]: osdmap e1296: 12 total, 12 up, 12 in 2023-03-02T21:09:08.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:07 smithi057 ceph-mon[92072]: pgmap v19570: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:09:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:10 smithi136 ceph-mon[125702]: pgmap v19571: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:09:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:10 smithi057 ceph-mon[92072]: pgmap v19571: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:09:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:10 smithi122 ceph-mon[125440]: pgmap v19571: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:09:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:12 smithi136 ceph-mon[125702]: pgmap v19572: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:09:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:12 smithi057 ceph-mon[92072]: pgmap v19572: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:09:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:12 smithi122 ceph-mon[125440]: pgmap v19572: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:09:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:14 smithi136 ceph-mon[125702]: pgmap v19573: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:09:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:14 smithi057 ceph-mon[92072]: pgmap v19573: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:09:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:14 smithi122 ceph-mon[125440]: pgmap v19573: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:09:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:15 smithi057 ceph-mon[92072]: osdmap e1297: 12 total, 12 up, 12 in 2023-03-02T21:09:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:15 smithi057 ceph-mon[92072]: pgmap v19575: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T21:09:15.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:15 smithi122 ceph-mon[125440]: osdmap e1297: 12 total, 12 up, 12 in 2023-03-02T21:09:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:15 smithi122 ceph-mon[125440]: pgmap v19575: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T21:09:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:15 smithi136 ceph-mon[125702]: osdmap e1297: 12 total, 12 up, 12 in 2023-03-02T21:09:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:15 smithi136 ceph-mon[125702]: pgmap v19575: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T21:09:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:17.101+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:09:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:17.102+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:09:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:17.102+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:09:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:17.102+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:09:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:17.102+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:09:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:18 smithi136 ceph-mon[125702]: pgmap v19576: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:09:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:18 smithi057 ceph-mon[92072]: pgmap v19576: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:09:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:18 smithi122 ceph-mon[125440]: pgmap v19576: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:09:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:20 smithi136 ceph-mon[125702]: pgmap v19577: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:09:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:20 smithi057 ceph-mon[92072]: pgmap v19577: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:09:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:20 smithi122 ceph-mon[125440]: pgmap v19577: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:09:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:22 smithi136 ceph-mon[125702]: pgmap v19578: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:09:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:22 smithi057 ceph-mon[92072]: pgmap v19578: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:09:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:22 smithi122 ceph-mon[125440]: pgmap v19578: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:09:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:24 smithi136 ceph-mon[125702]: pgmap v19579: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:09:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:24 smithi057 ceph-mon[92072]: pgmap v19579: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:09:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:24 smithi122 ceph-mon[125440]: pgmap v19579: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:09:25.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:25 smithi122 ceph-mon[125440]: pgmap v19580: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:09:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:25 smithi136 ceph-mon[125702]: pgmap v19580: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:09:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:25 smithi057 ceph-mon[92072]: pgmap v19580: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:09:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:28 smithi136 ceph-mon[125702]: pgmap v19581: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:28 smithi057 ceph-mon[92072]: pgmap v19581: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:28 smithi122 ceph-mon[125440]: pgmap v19581: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:30 smithi136 ceph-mon[125702]: pgmap v19582: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:30 smithi057 ceph-mon[92072]: pgmap v19582: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:30 smithi122 ceph-mon[125440]: pgmap v19582: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:32.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:09:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:32.115+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:09:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:32.115+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:09:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:32.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:09:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:32.115+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:09:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:32 smithi136 ceph-mon[125702]: pgmap v19583: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:32 smithi057 ceph-mon[92072]: pgmap v19583: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:32 smithi122 ceph-mon[125440]: pgmap v19583: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:34 smithi136 ceph-mon[125702]: pgmap v19584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:34 smithi057 ceph-mon[92072]: pgmap v19584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:34 smithi122 ceph-mon[125440]: pgmap v19584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:35.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:35 smithi122 ceph-mon[125440]: pgmap v19585: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:35 smithi136 ceph-mon[125702]: pgmap v19585: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:35 smithi057 ceph-mon[92072]: pgmap v19585: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:38 smithi136 ceph-mon[125702]: pgmap v19586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:38 smithi057 ceph-mon[92072]: pgmap v19586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:38 smithi122 ceph-mon[125440]: pgmap v19586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:40 smithi136 ceph-mon[125702]: pgmap v19587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:40 smithi057 ceph-mon[92072]: pgmap v19587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:40 smithi122 ceph-mon[125440]: pgmap v19587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:42 smithi136 ceph-mon[125702]: pgmap v19588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:42 smithi057 ceph-mon[92072]: pgmap v19588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:42 smithi122 ceph-mon[125440]: pgmap v19588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:43.669+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:09:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:43.669+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:09:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:43.669+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 283 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:09:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:43.669+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 282 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:09:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:44 smithi136 ceph-mon[125702]: pgmap v19589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:44 smithi057 ceph-mon[92072]: pgmap v19589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:44 smithi122 ceph-mon[125440]: pgmap v19589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:45.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:45 smithi122 ceph-mon[125440]: pgmap v19590: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:45 smithi136 ceph-mon[125702]: pgmap v19590: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:45 smithi057 ceph-mon[92072]: pgmap v19590: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:47.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:09:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:47.124+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:09:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:47.124+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:09:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:47.124+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:09:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:09:47.124+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:09:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:48 smithi136 ceph-mon[125702]: pgmap v19591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:48 smithi057 ceph-mon[92072]: pgmap v19591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:48 smithi122 ceph-mon[125440]: pgmap v19591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:50 smithi136 ceph-mon[125702]: pgmap v19592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:50 smithi057 ceph-mon[92072]: pgmap v19592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:50 smithi122 ceph-mon[125440]: pgmap v19592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:51.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:09:51.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:09:51.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:09:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:52 smithi057 ceph-mon[92072]: pgmap v19593: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:52 smithi122 ceph-mon[125440]: pgmap v19593: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:52 smithi136 ceph-mon[125702]: pgmap v19593: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:54.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:54 smithi057 ceph-mon[92072]: pgmap v19594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:54 smithi122 ceph-mon[125440]: pgmap v19594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:54 smithi136 ceph-mon[125702]: pgmap v19594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:09:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:09:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:09:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:09:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:55 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:09:56.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:55 smithi136 ceph-mon[125702]: pgmap v19595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:09:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:09:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:09:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:09:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:55 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:09:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:55 smithi057 ceph-mon[92072]: pgmap v19595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:09:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:09:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:09:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:09:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:55 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:09:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:55 smithi122 ceph-mon[125440]: pgmap v19595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:09:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:09:58 smithi136 ceph-mon[125702]: pgmap v19596: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:09:58 smithi057 ceph-mon[92072]: pgmap v19596: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:09:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:09:58 smithi122 ceph-mon[125440]: pgmap v19596: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:00 smithi136 ceph-mon[125702]: pgmap v19597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T21:10:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:00 smithi057 ceph-mon[92072]: pgmap v19597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T21:10:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:00 smithi122 ceph-mon[125440]: pgmap v19597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T21:10:02.128 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:02.125+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:10:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:02.126+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:10:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:02.126+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:10:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:02.126+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:10:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:02.126+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:10:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:02 smithi057 ceph-mon[92072]: pgmap v19598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:02 smithi122 ceph-mon[125440]: pgmap v19598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:02 smithi136 ceph-mon[125702]: pgmap v19598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:04 smithi057 ceph-mon[92072]: pgmap v19599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:10:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:04 smithi122 ceph-mon[125440]: pgmap v19599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:10:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:04 smithi136 ceph-mon[125702]: pgmap v19599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:10:05.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:05 smithi122 ceph-mon[125440]: pgmap v19600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:10:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:05 smithi136 ceph-mon[125702]: pgmap v19600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:10:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:05 smithi057 ceph-mon[92072]: pgmap v19600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:10:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:07 smithi136 ceph-mon[125702]: osdmap e1298: 12 total, 12 up, 12 in 2023-03-02T21:10:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:07 smithi136 ceph-mon[125702]: pgmap v19602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:10:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:07 smithi057 ceph-mon[92072]: osdmap e1298: 12 total, 12 up, 12 in 2023-03-02T21:10:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:07 smithi057 ceph-mon[92072]: pgmap v19602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:10:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:07 smithi122 ceph-mon[125440]: osdmap e1298: 12 total, 12 up, 12 in 2023-03-02T21:10:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:07 smithi122 ceph-mon[125440]: pgmap v19602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:10:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:10 smithi136 ceph-mon[125702]: pgmap v19603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:10:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:10 smithi057 ceph-mon[92072]: pgmap v19603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:10:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:10 smithi122 ceph-mon[125440]: pgmap v19603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:10:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:12 smithi057 ceph-mon[92072]: pgmap v19604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:10:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:12 smithi122 ceph-mon[125440]: pgmap v19604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:10:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:12 smithi136 ceph-mon[125702]: pgmap v19604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:10:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:14 smithi057 ceph-mon[92072]: pgmap v19605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:10:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:14 smithi122 ceph-mon[125440]: pgmap v19605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:10:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:14 smithi136 ceph-mon[125702]: pgmap v19605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:10:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:15 smithi122 ceph-mon[125440]: osdmap e1299: 12 total, 12 up, 12 in 2023-03-02T21:10:15.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:15 smithi122 ceph-mon[125440]: pgmap v19607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T21:10:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:15 smithi136 ceph-mon[125702]: osdmap e1299: 12 total, 12 up, 12 in 2023-03-02T21:10:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:15 smithi136 ceph-mon[125702]: pgmap v19607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T21:10:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:15 smithi057 ceph-mon[92072]: osdmap e1299: 12 total, 12 up, 12 in 2023-03-02T21:10:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:15 smithi057 ceph-mon[92072]: pgmap v19607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 238 B/s wr, 12 op/s 2023-03-02T21:10:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:17.142+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:10:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:17.143+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:10:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:17.143+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:10:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:17.143+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:10:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:17.143+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:10:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:18 smithi136 ceph-mon[125702]: pgmap v19608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:10:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:18 smithi057 ceph-mon[92072]: pgmap v19608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:10:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:18 smithi122 ceph-mon[125440]: pgmap v19608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:10:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:20 smithi057 ceph-mon[92072]: pgmap v19609: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:10:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:20 smithi122 ceph-mon[125440]: pgmap v19609: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:10:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:20 smithi136 ceph-mon[125702]: pgmap v19609: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:10:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:22 smithi057 ceph-mon[92072]: pgmap v19610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:10:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:22 smithi122 ceph-mon[125440]: pgmap v19610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:10:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:22 smithi136 ceph-mon[125702]: pgmap v19610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:10:24.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:24 smithi057 ceph-mon[92072]: pgmap v19611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:10:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:24 smithi122 ceph-mon[125440]: pgmap v19611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:10:24.721 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:24 smithi136 ceph-mon[125702]: pgmap v19611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:10:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:25 smithi136 ceph-mon[125702]: pgmap v19612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:10:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:25 smithi057 ceph-mon[92072]: pgmap v19612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:10:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:25 smithi122 ceph-mon[125440]: pgmap v19612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:10:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:28 smithi057 ceph-mon[92072]: pgmap v19613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:28 smithi122 ceph-mon[125440]: pgmap v19613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:28 smithi136 ceph-mon[125702]: pgmap v19613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:30 smithi057 ceph-mon[92072]: pgmap v19614: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:30 smithi122 ceph-mon[125440]: pgmap v19614: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:30 smithi136 ceph-mon[125702]: pgmap v19614: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:32.152+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:10:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:32.152+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:10:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:32.152+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:10:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:32.152+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:10:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:32.152+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:10:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:32 smithi057 ceph-mon[92072]: pgmap v19615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:32 smithi122 ceph-mon[125440]: pgmap v19615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:32 smithi136 ceph-mon[125702]: pgmap v19615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:34 smithi057 ceph-mon[92072]: pgmap v19616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:34 smithi122 ceph-mon[125440]: pgmap v19616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:34 smithi136 ceph-mon[125702]: pgmap v19616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:35 smithi136 ceph-mon[125702]: pgmap v19617: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:35 smithi057 ceph-mon[92072]: pgmap v19617: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:35 smithi122 ceph-mon[125440]: pgmap v19617: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:38 smithi136 ceph-mon[125702]: pgmap v19618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:38 smithi057 ceph-mon[92072]: pgmap v19618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:38 smithi122 ceph-mon[125440]: pgmap v19618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:40 smithi136 ceph-mon[125702]: pgmap v19619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:40 smithi057 ceph-mon[92072]: pgmap v19619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:40 smithi122 ceph-mon[125440]: pgmap v19619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:42 smithi057 ceph-mon[92072]: pgmap v19620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:42 smithi122 ceph-mon[125440]: pgmap v19620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:42 smithi136 ceph-mon[125702]: pgmap v19620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:44 smithi057 ceph-mon[92072]: pgmap v19621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:44 smithi122 ceph-mon[125440]: pgmap v19621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:44 smithi136 ceph-mon[125702]: pgmap v19621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:45 smithi136 ceph-mon[125702]: pgmap v19622: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:46.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:45 smithi057 ceph-mon[92072]: pgmap v19622: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:45 smithi122 ceph-mon[125440]: pgmap v19622: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:47.159+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:10:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:47.159+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:10:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:47.159+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:10:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:47.159+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:10:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:10:47.159+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:10:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:48 smithi136 ceph-mon[125702]: pgmap v19623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:48 smithi057 ceph-mon[92072]: pgmap v19623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:48 smithi122 ceph-mon[125440]: pgmap v19623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:50 smithi057 ceph-mon[92072]: pgmap v19624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:50 smithi122 ceph-mon[125440]: pgmap v19624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:50 smithi136 ceph-mon[125702]: pgmap v19624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:52.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:52 smithi057 ceph-mon[92072]: pgmap v19625: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:52 smithi122 ceph-mon[125440]: pgmap v19625: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:52 smithi136 ceph-mon[125702]: pgmap v19625: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:54 smithi057 ceph-mon[92072]: pgmap v19626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:54 smithi122 ceph-mon[125440]: pgmap v19626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:54 smithi136 ceph-mon[125702]: pgmap v19626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:10:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:55 smithi136 ceph-mon[125702]: pgmap v19627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:10:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:55 smithi057 ceph-mon[92072]: pgmap v19627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:10:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:55 smithi122 ceph-mon[125440]: pgmap v19627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:10:58.438 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:58 smithi122 ceph-mon[125440]: pgmap v19628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:58 smithi057 ceph-mon[92072]: pgmap v19628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:58.758 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:58 smithi136 ceph-mon[125702]: pgmap v19628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:10:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:10:59.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:10:59.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:10:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:10:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:10:59.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:10:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:10:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:10:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:10:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:10:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:11:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:00 smithi122 ceph-mon[125440]: pgmap v19629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:00 smithi136 ceph-mon[125702]: pgmap v19629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:00 smithi057 ceph-mon[92072]: pgmap v19629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:02.170+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:11:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:02.170+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:11:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:02.170+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:11:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:02.170+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:11:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:02.170+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:11:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:02 smithi136 ceph-mon[125702]: pgmap v19630: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:02 smithi057 ceph-mon[92072]: pgmap v19630: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:02 smithi122 ceph-mon[125440]: pgmap v19630: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:04 smithi136 ceph-mon[125702]: pgmap v19631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:11:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:04 smithi057 ceph-mon[92072]: pgmap v19631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:11:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:04 smithi122 ceph-mon[125440]: pgmap v19631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:11:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:05 smithi136 ceph-mon[125702]: pgmap v19632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:11:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:05 smithi057 ceph-mon[92072]: pgmap v19632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:11:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:05 smithi122 ceph-mon[125440]: pgmap v19632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:11:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:07 smithi136 ceph-mon[125702]: osdmap e1300: 12 total, 12 up, 12 in 2023-03-02T21:11:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:07 smithi136 ceph-mon[125702]: pgmap v19634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:11:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:07 smithi057 ceph-mon[92072]: osdmap e1300: 12 total, 12 up, 12 in 2023-03-02T21:11:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:07 smithi057 ceph-mon[92072]: pgmap v19634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:11:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:07 smithi122 ceph-mon[125440]: osdmap e1300: 12 total, 12 up, 12 in 2023-03-02T21:11:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:07 smithi122 ceph-mon[125440]: pgmap v19634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:11:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:10 smithi057 ceph-mon[92072]: pgmap v19635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:11:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:10 smithi122 ceph-mon[125440]: pgmap v19635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:11:10.848 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:10 smithi136 ceph-mon[125702]: pgmap v19635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:11:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:12 smithi057 ceph-mon[92072]: pgmap v19636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:11:12.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:12 smithi122 ceph-mon[125440]: pgmap v19636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:11:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:12 smithi136 ceph-mon[125702]: pgmap v19636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:11:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:13.681+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:11:13.684 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:13.681+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:11:13.684 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:13.681+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 284 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:11:13.684 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:13.681+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 283 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:11:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:14 smithi057 ceph-mon[92072]: pgmap v19637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:11:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:14 smithi122 ceph-mon[125440]: pgmap v19637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:11:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:14 smithi136 ceph-mon[125702]: pgmap v19637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:11:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:15 smithi136 ceph-mon[125702]: osdmap e1301: 12 total, 12 up, 12 in 2023-03-02T21:11:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:15 smithi136 ceph-mon[125702]: pgmap v19639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 119 B/s wr, 7 op/s 2023-03-02T21:11:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:15 smithi057 ceph-mon[92072]: osdmap e1301: 12 total, 12 up, 12 in 2023-03-02T21:11:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:15 smithi057 ceph-mon[92072]: pgmap v19639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 119 B/s wr, 7 op/s 2023-03-02T21:11:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:15 smithi122 ceph-mon[125440]: osdmap e1301: 12 total, 12 up, 12 in 2023-03-02T21:11:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:15 smithi122 ceph-mon[125440]: pgmap v19639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 119 B/s wr, 7 op/s 2023-03-02T21:11:17.185 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:17.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:11:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:17.183+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:11:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:17.183+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:11:17.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:17.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:11:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:17.183+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:11:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:18 smithi057 ceph-mon[92072]: pgmap v19640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:11:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:18 smithi122 ceph-mon[125440]: pgmap v19640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:11:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:18 smithi136 ceph-mon[125702]: pgmap v19640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:11:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:20 smithi057 ceph-mon[92072]: pgmap v19641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:11:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:20 smithi122 ceph-mon[125440]: pgmap v19641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:11:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:20 smithi136 ceph-mon[125702]: pgmap v19641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:11:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:22 smithi057 ceph-mon[92072]: pgmap v19642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:11:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:22 smithi122 ceph-mon[125440]: pgmap v19642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:11:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:22 smithi136 ceph-mon[125702]: pgmap v19642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:11:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:24 smithi057 ceph-mon[92072]: pgmap v19643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:11:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:24 smithi122 ceph-mon[125440]: pgmap v19643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:11:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:24 smithi136 ceph-mon[125702]: pgmap v19643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:11:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:25 smithi136 ceph-mon[125702]: pgmap v19644: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:11:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:25 smithi057 ceph-mon[92072]: pgmap v19644: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:11:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:25 smithi122 ceph-mon[125440]: pgmap v19644: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:11:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:28 smithi057 ceph-mon[92072]: pgmap v19645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:28 smithi122 ceph-mon[125440]: pgmap v19645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:28 smithi136 ceph-mon[125702]: pgmap v19645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:30 smithi057 ceph-mon[92072]: pgmap v19646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:30 smithi122 ceph-mon[125440]: pgmap v19646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:30 smithi136 ceph-mon[125702]: pgmap v19646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:32.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:11:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:32.188+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:11:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:32.188+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:11:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:32.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:11:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:32.188+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:11:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:32 smithi057 ceph-mon[92072]: pgmap v19647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:32 smithi122 ceph-mon[125440]: pgmap v19647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:32 smithi136 ceph-mon[125702]: pgmap v19647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:34 smithi057 ceph-mon[92072]: pgmap v19648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:34 smithi122 ceph-mon[125440]: pgmap v19648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:34 smithi136 ceph-mon[125702]: pgmap v19648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:35 smithi136 ceph-mon[125702]: pgmap v19649: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:35 smithi057 ceph-mon[92072]: pgmap v19649: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:35 smithi122 ceph-mon[125440]: pgmap v19649: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:38 smithi057 ceph-mon[92072]: pgmap v19650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:38 smithi122 ceph-mon[125440]: pgmap v19650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:38 smithi136 ceph-mon[125702]: pgmap v19650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:40 smithi057 ceph-mon[92072]: pgmap v19651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:40 smithi122 ceph-mon[125440]: pgmap v19651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:40 smithi136 ceph-mon[125702]: pgmap v19651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:42 smithi057 ceph-mon[92072]: pgmap v19652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:42 smithi122 ceph-mon[125440]: pgmap v19652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:42 smithi136 ceph-mon[125702]: pgmap v19652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:44 smithi057 ceph-mon[92072]: pgmap v19653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:44 smithi122 ceph-mon[125440]: pgmap v19653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:44 smithi136 ceph-mon[125702]: pgmap v19653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:45 smithi136 ceph-mon[125702]: pgmap v19654: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:45 smithi057 ceph-mon[92072]: pgmap v19654: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:45 smithi122 ceph-mon[125440]: pgmap v19654: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:47.203+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:47.204+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:47.204+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:47.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:11:47.204+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:11:48.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:48 smithi057 ceph-mon[92072]: pgmap v19655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:48 smithi122 ceph-mon[125440]: pgmap v19655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:48 smithi136 ceph-mon[125702]: pgmap v19655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:50 smithi057 ceph-mon[92072]: pgmap v19656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:50 smithi122 ceph-mon[125440]: pgmap v19656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:50 smithi136 ceph-mon[125702]: pgmap v19656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:52 smithi057 ceph-mon[92072]: pgmap v19657: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:52 smithi122 ceph-mon[125440]: pgmap v19657: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:52 smithi136 ceph-mon[125702]: pgmap v19657: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:54 smithi057 ceph-mon[92072]: pgmap v19658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:54 smithi122 ceph-mon[125440]: pgmap v19658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:54 smithi136 ceph-mon[125702]: pgmap v19658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:55 smithi136 ceph-mon[125702]: pgmap v19659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:55 smithi057 ceph-mon[92072]: pgmap v19659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:55 smithi122 ceph-mon[125440]: pgmap v19659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:11:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:58 smithi057 ceph-mon[92072]: pgmap v19660: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:58 smithi122 ceph-mon[125440]: pgmap v19660: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:58 smithi136 ceph-mon[125702]: pgmap v19660: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:11:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:11:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:11:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:11:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:11:59.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:11:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:12:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:00 smithi057 ceph-mon[92072]: pgmap v19661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:12:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:12:00.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:12:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:00 smithi122 ceph-mon[125440]: pgmap v19661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:12:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:12:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:12:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:00 smithi136 ceph-mon[125702]: pgmap v19661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:12:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:12:00.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:12:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:02.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:12:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:02.220+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:12:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:02.220+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:12:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:02.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:12:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:02.220+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:12:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:02 smithi057 ceph-mon[92072]: pgmap v19662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:02 smithi122 ceph-mon[125440]: pgmap v19662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:02 smithi136 ceph-mon[125702]: pgmap v19662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:04 smithi057 ceph-mon[92072]: pgmap v19663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:12:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:04 smithi122 ceph-mon[125440]: pgmap v19663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:12:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:04 smithi136 ceph-mon[125702]: pgmap v19663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:12:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:05 smithi136 ceph-mon[125702]: pgmap v19664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:12:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:05 smithi057 ceph-mon[92072]: pgmap v19664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:12:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:05 smithi122 ceph-mon[125440]: pgmap v19664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:12:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:07 smithi136 ceph-mon[125702]: osdmap e1302: 12 total, 12 up, 12 in 2023-03-02T21:12:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:07 smithi136 ceph-mon[125702]: pgmap v19666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:12:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:07 smithi057 ceph-mon[92072]: osdmap e1302: 12 total, 12 up, 12 in 2023-03-02T21:12:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:07 smithi057 ceph-mon[92072]: pgmap v19666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:12:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:07 smithi122 ceph-mon[125440]: osdmap e1302: 12 total, 12 up, 12 in 2023-03-02T21:12:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:07 smithi122 ceph-mon[125440]: pgmap v19666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:12:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:10 smithi057 ceph-mon[92072]: pgmap v19667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:12:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:10 smithi122 ceph-mon[125440]: pgmap v19667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:12:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:10 smithi136 ceph-mon[125702]: pgmap v19667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:12:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:12 smithi057 ceph-mon[92072]: pgmap v19668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:12:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:12 smithi122 ceph-mon[125440]: pgmap v19668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:12:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:12 smithi136 ceph-mon[125702]: pgmap v19668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:12:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:14 smithi057 ceph-mon[92072]: pgmap v19669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:12:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:14 smithi122 ceph-mon[125440]: pgmap v19669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:12:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:14 smithi136 ceph-mon[125702]: pgmap v19669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:12:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:15 smithi136 ceph-mon[125702]: osdmap e1303: 12 total, 12 up, 12 in 2023-03-02T21:12:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:15 smithi136 ceph-mon[125702]: pgmap v19671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:12:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:15 smithi057 ceph-mon[92072]: osdmap e1303: 12 total, 12 up, 12 in 2023-03-02T21:12:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:15 smithi057 ceph-mon[92072]: pgmap v19671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:12:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:15 smithi122 ceph-mon[125440]: osdmap e1303: 12 total, 12 up, 12 in 2023-03-02T21:12:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:15 smithi122 ceph-mon[125440]: pgmap v19671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:12:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:17.221+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:12:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:17.221+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:12:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:17.221+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:12:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:17.221+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:12:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:17.221+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:12:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:18 smithi057 ceph-mon[92072]: pgmap v19672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:12:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:18 smithi122 ceph-mon[125440]: pgmap v19672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:12:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:18 smithi136 ceph-mon[125702]: pgmap v19672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:12:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:20 smithi057 ceph-mon[92072]: pgmap v19673: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:12:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:20 smithi122 ceph-mon[125440]: pgmap v19673: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:12:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:20 smithi136 ceph-mon[125702]: pgmap v19673: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:12:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:22 smithi057 ceph-mon[92072]: pgmap v19674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:12:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:22 smithi122 ceph-mon[125440]: pgmap v19674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:12:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:22 smithi136 ceph-mon[125702]: pgmap v19674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:12:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:24 smithi057 ceph-mon[92072]: pgmap v19675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:12:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:24 smithi122 ceph-mon[125440]: pgmap v19675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:12:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:24 smithi136 ceph-mon[125702]: pgmap v19675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:12:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:25 smithi136 ceph-mon[125702]: pgmap v19676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:12:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:25 smithi057 ceph-mon[92072]: pgmap v19676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:12:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:25 smithi122 ceph-mon[125440]: pgmap v19676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:12:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:28 smithi057 ceph-mon[92072]: pgmap v19677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:28 smithi122 ceph-mon[125440]: pgmap v19677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:28 smithi136 ceph-mon[125702]: pgmap v19677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:30 smithi057 ceph-mon[92072]: pgmap v19678: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:30 smithi122 ceph-mon[125440]: pgmap v19678: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:30 smithi136 ceph-mon[125702]: pgmap v19678: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:32.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:32.229+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:12:32.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:32.230+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:12:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:32.230+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:12:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:32.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:12:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:32.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:12:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:32 smithi057 ceph-mon[92072]: pgmap v19679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:32 smithi122 ceph-mon[125440]: pgmap v19679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:32 smithi136 ceph-mon[125702]: pgmap v19679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:34 smithi057 ceph-mon[92072]: pgmap v19680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:34 smithi122 ceph-mon[125440]: pgmap v19680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:34 smithi136 ceph-mon[125702]: pgmap v19680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:35 smithi136 ceph-mon[125702]: pgmap v19681: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:35 smithi057 ceph-mon[92072]: pgmap v19681: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:35 smithi122 ceph-mon[125440]: pgmap v19681: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:38 smithi057 ceph-mon[92072]: pgmap v19682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:38 smithi122 ceph-mon[125440]: pgmap v19682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:38 smithi136 ceph-mon[125702]: pgmap v19682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:40 smithi057 ceph-mon[92072]: pgmap v19683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:40 smithi122 ceph-mon[125440]: pgmap v19683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:40 smithi136 ceph-mon[125702]: pgmap v19683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:42 smithi057 ceph-mon[92072]: pgmap v19684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:42 smithi122 ceph-mon[125440]: pgmap v19684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:42 smithi136 ceph-mon[125702]: pgmap v19684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:44 smithi057 ceph-mon[92072]: pgmap v19685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:44 smithi122 ceph-mon[125440]: pgmap v19685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:44 smithi136 ceph-mon[125702]: pgmap v19685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:45 smithi136 ceph-mon[125702]: pgmap v19686: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:45 smithi057 ceph-mon[92072]: pgmap v19686: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:45 smithi122 ceph-mon[125440]: pgmap v19686: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:47.234+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:12:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:47.235+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:12:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:47.235+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:12:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:47.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:12:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:12:47.235+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:12:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:48 smithi057 ceph-mon[92072]: pgmap v19687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:48 smithi122 ceph-mon[125440]: pgmap v19687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:48 smithi136 ceph-mon[125702]: pgmap v19687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:50 smithi057 ceph-mon[92072]: pgmap v19688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:50 smithi122 ceph-mon[125440]: pgmap v19688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:50 smithi136 ceph-mon[125702]: pgmap v19688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:52 smithi057 ceph-mon[92072]: pgmap v19689: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:52.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:52 smithi122 ceph-mon[125440]: pgmap v19689: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:52 smithi136 ceph-mon[125702]: pgmap v19689: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:54 smithi057 ceph-mon[92072]: pgmap v19690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:54 smithi122 ceph-mon[125440]: pgmap v19690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:54 smithi136 ceph-mon[125702]: pgmap v19690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:55 smithi136 ceph-mon[125702]: pgmap v19691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:55 smithi057 ceph-mon[92072]: pgmap v19691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:55 smithi122 ceph-mon[125440]: pgmap v19691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:12:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:12:58 smithi057 ceph-mon[92072]: pgmap v19692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:12:58 smithi122 ceph-mon[125440]: pgmap v19692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:12:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:12:58 smithi136 ceph-mon[125702]: pgmap v19692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:00 smithi057 ceph-mon[92072]: pgmap v19693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:13:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:00 smithi122 ceph-mon[125440]: pgmap v19693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:13:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:00 smithi136 ceph-mon[125702]: pgmap v19693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:13:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:02.236+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:13:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:02.237+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:13:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:02.237+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:13:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:02.237+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:13:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:02.237+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:13:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:13:02.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:02 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:13:02.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:02 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:02 smithi057 ceph-mon[92072]: pgmap v19694: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:13:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:02 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:13:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:02 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:02 smithi122 ceph-mon[125440]: pgmap v19694: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:13:02.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:02 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:13:02.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:02 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:13:02.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:02 smithi136 ceph-mon[125702]: pgmap v19694: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:04 smithi057 ceph-mon[92072]: pgmap v19695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:13:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:04 smithi122 ceph-mon[125440]: pgmap v19695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:13:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:04 smithi136 ceph-mon[125702]: pgmap v19695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:13:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:05 smithi136 ceph-mon[125702]: pgmap v19696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:13:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:05 smithi057 ceph-mon[92072]: pgmap v19696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:13:06.255 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:05 smithi122 ceph-mon[125440]: pgmap v19696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:13:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:08 smithi057 ceph-mon[92072]: pgmap v19697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:13:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:08 smithi122 ceph-mon[125440]: pgmap v19697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:13:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:08 smithi136 ceph-mon[125702]: pgmap v19697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:13:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:10 smithi057 ceph-mon[92072]: pgmap v19698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:13:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:10 smithi122 ceph-mon[125440]: pgmap v19698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:13:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:10 smithi136 ceph-mon[125702]: pgmap v19698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:13:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:12 smithi057 ceph-mon[92072]: pgmap v19699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:13:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:12 smithi057 ceph-mon[92072]: osdmap e1304: 12 total, 12 up, 12 in 2023-03-02T21:13:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:12 smithi122 ceph-mon[125440]: pgmap v19699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:13:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:12 smithi122 ceph-mon[125440]: osdmap e1304: 12 total, 12 up, 12 in 2023-03-02T21:13:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:12 smithi136 ceph-mon[125702]: pgmap v19699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:13:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:12 smithi136 ceph-mon[125702]: osdmap e1304: 12 total, 12 up, 12 in 2023-03-02T21:13:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:14 smithi057 ceph-mon[92072]: pgmap v19701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:14 smithi122 ceph-mon[125440]: pgmap v19701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:14 smithi136 ceph-mon[125702]: pgmap v19701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:15 smithi136 ceph-mon[125702]: pgmap v19702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:15 smithi057 ceph-mon[92072]: pgmap v19702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:15 smithi122 ceph-mon[125440]: pgmap v19702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:17.250+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:13:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:17.250+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:13:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:17.250+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:13:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:17.250+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:13:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:17.250+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:13:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:18 smithi057 ceph-mon[92072]: pgmap v19703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:13:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:18 smithi122 ceph-mon[125440]: pgmap v19703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:13:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:18 smithi136 ceph-mon[125702]: pgmap v19703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:13:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:20 smithi057 ceph-mon[92072]: pgmap v19704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:13:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:20 smithi057 ceph-mon[92072]: osdmap e1305: 12 total, 12 up, 12 in 2023-03-02T21:13:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:20 smithi122 ceph-mon[125440]: pgmap v19704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:13:20.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:20 smithi122 ceph-mon[125440]: osdmap e1305: 12 total, 12 up, 12 in 2023-03-02T21:13:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:20 smithi136 ceph-mon[125702]: pgmap v19704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:13:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:20 smithi136 ceph-mon[125702]: osdmap e1305: 12 total, 12 up, 12 in 2023-03-02T21:13:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:22 smithi057 ceph-mon[92072]: pgmap v19706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T21:13:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:22 smithi122 ceph-mon[125440]: pgmap v19706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T21:13:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:22 smithi136 ceph-mon[125702]: pgmap v19706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T21:13:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:24 smithi057 ceph-mon[92072]: pgmap v19707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:24 smithi122 ceph-mon[125440]: pgmap v19707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:24 smithi136 ceph-mon[125702]: pgmap v19707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:25 smithi136 ceph-mon[125702]: pgmap v19708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:25 smithi057 ceph-mon[92072]: pgmap v19708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:25 smithi122 ceph-mon[125440]: pgmap v19708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:13:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:28 smithi057 ceph-mon[92072]: pgmap v19709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:13:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:28 smithi122 ceph-mon[125440]: pgmap v19709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:13:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:28 smithi136 ceph-mon[125702]: pgmap v19709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:13:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:30 smithi057 ceph-mon[92072]: pgmap v19710: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:13:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:30 smithi122 ceph-mon[125440]: pgmap v19710: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:13:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:30 smithi136 ceph-mon[125702]: pgmap v19710: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:13:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:32.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:13:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:32.266+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:13:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:32.266+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:13:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:32.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:13:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:32.266+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:13:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:32 smithi057 ceph-mon[92072]: pgmap v19711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T21:13:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:32 smithi122 ceph-mon[125440]: pgmap v19711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T21:13:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:32 smithi136 ceph-mon[125702]: pgmap v19711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T21:13:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:34 smithi057 ceph-mon[92072]: pgmap v19712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:34 smithi122 ceph-mon[125440]: pgmap v19712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:34 smithi136 ceph-mon[125702]: pgmap v19712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:35 smithi136 ceph-mon[125702]: pgmap v19713: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:35 smithi057 ceph-mon[92072]: pgmap v19713: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:35 smithi122 ceph-mon[125440]: pgmap v19713: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:38 smithi057 ceph-mon[92072]: pgmap v19714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:38 smithi122 ceph-mon[125440]: pgmap v19714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:38 smithi136 ceph-mon[125702]: pgmap v19714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:40 smithi057 ceph-mon[92072]: pgmap v19715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:40 smithi122 ceph-mon[125440]: pgmap v19715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:40 smithi136 ceph-mon[125702]: pgmap v19715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:42 smithi057 ceph-mon[92072]: pgmap v19716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:42 smithi122 ceph-mon[125440]: pgmap v19716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:42 smithi136 ceph-mon[125702]: pgmap v19716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:44 smithi057 ceph-mon[92072]: pgmap v19717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:44 smithi122 ceph-mon[125440]: pgmap v19717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:44 smithi136 ceph-mon[125702]: pgmap v19717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:45 smithi136 ceph-mon[125702]: pgmap v19718: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:45 smithi057 ceph-mon[92072]: pgmap v19718: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:45 smithi122 ceph-mon[125440]: pgmap v19718: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:47.274+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:13:47.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:47.274+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:13:47.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:47.274+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:13:47.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:47.274+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:13:47.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:13:47.274+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:13:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:48 smithi057 ceph-mon[92072]: pgmap v19719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:48 smithi122 ceph-mon[125440]: pgmap v19719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:48 smithi136 ceph-mon[125702]: pgmap v19719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:50 smithi057 ceph-mon[92072]: pgmap v19720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:50 smithi122 ceph-mon[125440]: pgmap v19720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:50 smithi136 ceph-mon[125702]: pgmap v19720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:52 smithi057 ceph-mon[92072]: pgmap v19721: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:52 smithi122 ceph-mon[125440]: pgmap v19721: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:52 smithi136 ceph-mon[125702]: pgmap v19721: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:13:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:54 smithi057 ceph-mon[92072]: pgmap v19722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:54 smithi122 ceph-mon[125440]: pgmap v19722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:54 smithi136 ceph-mon[125702]: pgmap v19722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:55 smithi136 ceph-mon[125702]: pgmap v19723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:13:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:55 smithi057 ceph-mon[92072]: pgmap v19723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:13:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:55 smithi122 ceph-mon[125440]: pgmap v19723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:13:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:13:58 smithi057 ceph-mon[92072]: pgmap v19724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:13:58 smithi122 ceph-mon[125440]: pgmap v19724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:13:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:13:58 smithi136 ceph-mon[125702]: pgmap v19724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:00 smithi057 ceph-mon[92072]: pgmap v19725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:14:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:00 smithi122 ceph-mon[125440]: pgmap v19725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:14:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:00 smithi136 ceph-mon[125702]: pgmap v19725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:14:01.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:01 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:14:01.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:01 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:14:01.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:01 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:14:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:02.289+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:14:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:02.290+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:14:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:02.290+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:14:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:02.290+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:14:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:02.290+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:14:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:02 smithi057 ceph-mon[92072]: pgmap v19726: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:14:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:02 smithi122 ceph-mon[125440]: pgmap v19726: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:14:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:02 smithi136 ceph-mon[125702]: pgmap v19726: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:14:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:04 smithi057 ceph-mon[92072]: pgmap v19727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:14:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:04 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:04 smithi122 ceph-mon[125440]: pgmap v19727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:14:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:04.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:04 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:04 smithi136 ceph-mon[125702]: pgmap v19727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:14:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:04 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.843 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:14:05.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:14:05.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:14:05.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:14:05.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:14:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:14:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:14:05.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:14:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:06 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:14:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:06 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:14:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:06 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:14:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:06 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:14:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:06 smithi136 ceph-mon[125702]: pgmap v19728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:14:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:06 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:14:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:06 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:14:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:06 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:14:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:06 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:14:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:06 smithi057 ceph-mon[92072]: pgmap v19728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:14:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:06 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:14:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:06 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:14:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:06 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:14:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:06 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:14:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:06 smithi122 ceph-mon[125440]: pgmap v19728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:14:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:07 smithi136 ceph-mon[125702]: osdmap e1306: 12 total, 12 up, 12 in 2023-03-02T21:14:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:07 smithi057 ceph-mon[92072]: osdmap e1306: 12 total, 12 up, 12 in 2023-03-02T21:14:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:07 smithi122 ceph-mon[125440]: osdmap e1306: 12 total, 12 up, 12 in 2023-03-02T21:14:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:08.432+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900001416) for more than 900000000 us, fault. 2023-03-02T21:14:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:08.432+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870096000 comp rx=0 tx=0).stop 2023-03-02T21:14:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:08.432+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d9f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T21:14:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:08.432+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d9f0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T21:14:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:08.432+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T21:14:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:08.432+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:14:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:08.433+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f5870027fb0 tx=0x7f58700b2070 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T21:14:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:08 smithi136 ceph-mon[125702]: pgmap v19730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:14:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:08 smithi057 ceph-mon[92072]: pgmap v19730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:14:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:08 smithi122 ceph-mon[125440]: pgmap v19730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:14:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:10 smithi136 ceph-mon[125702]: pgmap v19731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:14:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:10 smithi057 ceph-mon[92072]: pgmap v19731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:14:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:10 smithi122 ceph-mon[125440]: pgmap v19731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:14:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:12 smithi136 ceph-mon[125702]: pgmap v19732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:14:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:12 smithi057 ceph-mon[92072]: pgmap v19732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:14:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:12 smithi122 ceph-mon[125440]: pgmap v19732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:14:13.709 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:13.708+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:14:13.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:13.708+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:14:13.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:13.708+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 285 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:14:13.710 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:13.708+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 284 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:14:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:14 smithi136 ceph-mon[125702]: pgmap v19733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:14:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:14 smithi057 ceph-mon[92072]: pgmap v19733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:14:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:14 smithi122 ceph-mon[125440]: pgmap v19733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:14:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:15 smithi136 ceph-mon[125702]: osdmap e1307: 12 total, 12 up, 12 in 2023-03-02T21:14:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:15 smithi136 ceph-mon[125702]: pgmap v19735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T21:14:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:15 smithi057 ceph-mon[92072]: osdmap e1307: 12 total, 12 up, 12 in 2023-03-02T21:14:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:15 smithi057 ceph-mon[92072]: pgmap v19735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T21:14:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:15 smithi122 ceph-mon[125440]: osdmap e1307: 12 total, 12 up, 12 in 2023-03-02T21:14:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:15 smithi122 ceph-mon[125440]: pgmap v19735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-02T21:14:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:17.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:14:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:17.305+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:14:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:17.305+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:14:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:17.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:14:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:17.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:14:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:18 smithi057 ceph-mon[92072]: pgmap v19736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:14:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:18 smithi122 ceph-mon[125440]: pgmap v19736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:14:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:18 smithi136 ceph-mon[125702]: pgmap v19736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:14:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:20 smithi057 ceph-mon[92072]: pgmap v19737: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:14:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:20 smithi122 ceph-mon[125440]: pgmap v19737: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:14:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:20 smithi136 ceph-mon[125702]: pgmap v19737: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:14:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:22 smithi057 ceph-mon[92072]: pgmap v19738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:14:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:22 smithi122 ceph-mon[125440]: pgmap v19738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:14:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:22 smithi136 ceph-mon[125702]: pgmap v19738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:14:24.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:24 smithi057 ceph-mon[92072]: pgmap v19739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:14:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:24 smithi122 ceph-mon[125440]: pgmap v19739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:14:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:24 smithi136 ceph-mon[125702]: pgmap v19739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:14:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:25 smithi136 ceph-mon[125702]: pgmap v19740: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:14:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:25 smithi057 ceph-mon[92072]: pgmap v19740: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:14:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:25 smithi122 ceph-mon[125440]: pgmap v19740: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:14:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:28 smithi057 ceph-mon[92072]: pgmap v19741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:28 smithi122 ceph-mon[125440]: pgmap v19741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:28 smithi136 ceph-mon[125702]: pgmap v19741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:30 smithi057 ceph-mon[92072]: pgmap v19742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:30 smithi122 ceph-mon[125440]: pgmap v19742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:30 smithi136 ceph-mon[125702]: pgmap v19742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:32.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:14:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:32.317+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:14:32.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:32.317+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:14:32.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:32.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:14:32.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:32.317+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:14:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:32 smithi057 ceph-mon[92072]: pgmap v19743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:32 smithi122 ceph-mon[125440]: pgmap v19743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:32 smithi136 ceph-mon[125702]: pgmap v19743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:34 smithi057 ceph-mon[92072]: pgmap v19744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:34 smithi122 ceph-mon[125440]: pgmap v19744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:34 smithi136 ceph-mon[125702]: pgmap v19744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:35 smithi136 ceph-mon[125702]: pgmap v19745: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:35 smithi057 ceph-mon[92072]: pgmap v19745: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:35 smithi122 ceph-mon[125440]: pgmap v19745: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:38 smithi057 ceph-mon[92072]: pgmap v19746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:38 smithi122 ceph-mon[125440]: pgmap v19746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:38 smithi136 ceph-mon[125702]: pgmap v19746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:40 smithi057 ceph-mon[92072]: pgmap v19747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:40 smithi122 ceph-mon[125440]: pgmap v19747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:40 smithi136 ceph-mon[125702]: pgmap v19747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:42 smithi057 ceph-mon[92072]: pgmap v19748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:42 smithi122 ceph-mon[125440]: pgmap v19748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:42 smithi136 ceph-mon[125702]: pgmap v19748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:44 smithi057 ceph-mon[92072]: pgmap v19749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:44 smithi122 ceph-mon[125440]: pgmap v19749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:44 smithi136 ceph-mon[125702]: pgmap v19749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:45 smithi136 ceph-mon[125702]: pgmap v19750: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:45 smithi057 ceph-mon[92072]: pgmap v19750: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:45 smithi122 ceph-mon[125440]: pgmap v19750: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:47.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:14:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:47.333+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:14:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:47.333+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:14:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:47.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:14:47.336 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:14:47.333+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:14:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:48 smithi057 ceph-mon[92072]: pgmap v19751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:48 smithi122 ceph-mon[125440]: pgmap v19751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:48 smithi136 ceph-mon[125702]: pgmap v19751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:50 smithi057 ceph-mon[92072]: pgmap v19752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:50 smithi122 ceph-mon[125440]: pgmap v19752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:50 smithi136 ceph-mon[125702]: pgmap v19752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:52 smithi057 ceph-mon[92072]: pgmap v19753: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:52 smithi122 ceph-mon[125440]: pgmap v19753: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:52 smithi136 ceph-mon[125702]: pgmap v19753: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:54 smithi057 ceph-mon[92072]: pgmap v19754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:54 smithi122 ceph-mon[125440]: pgmap v19754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:54 smithi136 ceph-mon[125702]: pgmap v19754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:55 smithi136 ceph-mon[125702]: pgmap v19755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:55 smithi057 ceph-mon[92072]: pgmap v19755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:55 smithi122 ceph-mon[125440]: pgmap v19755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:14:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:14:58 smithi057 ceph-mon[92072]: pgmap v19756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:14:58 smithi122 ceph-mon[125440]: pgmap v19756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:14:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:14:58 smithi136 ceph-mon[125702]: pgmap v19756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:00 smithi057 ceph-mon[92072]: pgmap v19757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:00 smithi122 ceph-mon[125440]: pgmap v19757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:00 smithi136 ceph-mon[125702]: pgmap v19757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:02.349+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:15:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:02.349+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:15:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:02.349+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:15:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:02.349+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:15:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:02.349+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:15:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:02 smithi057 ceph-mon[92072]: pgmap v19758: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:02 smithi122 ceph-mon[125440]: pgmap v19758: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:02 smithi136 ceph-mon[125702]: pgmap v19758: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:04 smithi057 ceph-mon[92072]: pgmap v19759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:15:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:04 smithi122 ceph-mon[125440]: pgmap v19759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:15:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:04 smithi136 ceph-mon[125702]: pgmap v19759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:15:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:05 smithi136 ceph-mon[125702]: pgmap v19760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:15:06.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:15:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:05 smithi057 ceph-mon[92072]: pgmap v19760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:15:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:15:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:05 smithi122 ceph-mon[125440]: pgmap v19760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:15:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:15:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:15:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:15:07.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:15:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:15:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:15:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:15:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:15:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:15:07.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:15:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:07 smithi136 ceph-mon[125702]: osdmap e1308: 12 total, 12 up, 12 in 2023-03-02T21:15:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:07 smithi136 ceph-mon[125702]: pgmap v19762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:15:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:07 smithi057 ceph-mon[92072]: osdmap e1308: 12 total, 12 up, 12 in 2023-03-02T21:15:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:07 smithi057 ceph-mon[92072]: pgmap v19762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:15:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:07 smithi122 ceph-mon[125440]: osdmap e1308: 12 total, 12 up, 12 in 2023-03-02T21:15:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:07 smithi122 ceph-mon[125440]: pgmap v19762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:15:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:10 smithi057 ceph-mon[92072]: pgmap v19763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:15:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:10 smithi122 ceph-mon[125440]: pgmap v19763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:15:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:10 smithi136 ceph-mon[125702]: pgmap v19763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:15:12.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:12 smithi057 ceph-mon[92072]: pgmap v19764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:15:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:12 smithi122 ceph-mon[125440]: pgmap v19764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:15:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:12 smithi136 ceph-mon[125702]: pgmap v19764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:15:14.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:14 smithi057 ceph-mon[92072]: pgmap v19765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:15:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:14 smithi122 ceph-mon[125440]: pgmap v19765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:15:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:14 smithi136 ceph-mon[125702]: pgmap v19765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:15:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:15 smithi136 ceph-mon[125702]: osdmap e1309: 12 total, 12 up, 12 in 2023-03-02T21:15:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:15 smithi136 ceph-mon[125702]: pgmap v19767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:15:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:15 smithi057 ceph-mon[92072]: osdmap e1309: 12 total, 12 up, 12 in 2023-03-02T21:15:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:15 smithi057 ceph-mon[92072]: pgmap v19767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:15:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:15 smithi122 ceph-mon[125440]: osdmap e1309: 12 total, 12 up, 12 in 2023-03-02T21:15:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:15 smithi122 ceph-mon[125440]: pgmap v19767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:15:17.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:17.365+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:15:17.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:17.365+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:15:17.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:17.365+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:15:17.367 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:17.365+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:15:17.368 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:17.365+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:15:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:18 smithi057 ceph-mon[92072]: pgmap v19768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:15:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:18 smithi122 ceph-mon[125440]: pgmap v19768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:15:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:18 smithi136 ceph-mon[125702]: pgmap v19768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:15:20.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:20 smithi057 ceph-mon[92072]: pgmap v19769: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:15:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:20 smithi122 ceph-mon[125440]: pgmap v19769: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:15:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:20 smithi136 ceph-mon[125702]: pgmap v19769: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:15:22.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:22 smithi057 ceph-mon[92072]: pgmap v19770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:15:22.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:22 smithi122 ceph-mon[125440]: pgmap v19770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:15:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:22 smithi136 ceph-mon[125702]: pgmap v19770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:15:24.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:24 smithi122 ceph-mon[125440]: pgmap v19771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:15:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:24 smithi136 ceph-mon[125702]: pgmap v19771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:15:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:24 smithi057 ceph-mon[92072]: pgmap v19771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:15:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:25 smithi136 ceph-mon[125702]: pgmap v19772: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:15:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:25 smithi057 ceph-mon[92072]: pgmap v19772: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:15:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:25 smithi122 ceph-mon[125440]: pgmap v19772: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:15:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:28 smithi057 ceph-mon[92072]: pgmap v19773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:28 smithi122 ceph-mon[125440]: pgmap v19773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:28 smithi136 ceph-mon[125702]: pgmap v19773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:30 smithi057 ceph-mon[92072]: pgmap v19774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:30 smithi122 ceph-mon[125440]: pgmap v19774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:30 smithi136 ceph-mon[125702]: pgmap v19774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:32.374+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:15:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:32.374+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:15:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:32.374+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:15:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:32.374+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:15:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:32.374+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:15:32.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:32 smithi122 ceph-mon[125440]: pgmap v19775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:32 smithi136 ceph-mon[125702]: pgmap v19775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:32 smithi057 ceph-mon[92072]: pgmap v19775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:34.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:34 smithi122 ceph-mon[125440]: pgmap v19776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:34 smithi136 ceph-mon[125702]: pgmap v19776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:34 smithi057 ceph-mon[92072]: pgmap v19776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:35 smithi136 ceph-mon[125702]: pgmap v19777: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:35 smithi057 ceph-mon[92072]: pgmap v19777: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:35 smithi122 ceph-mon[125440]: pgmap v19777: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:15:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:38 smithi057 ceph-mon[92072]: pgmap v19778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:38 smithi122 ceph-mon[125440]: pgmap v19778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:38 smithi136 ceph-mon[125702]: pgmap v19778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:40 smithi057 ceph-mon[92072]: pgmap v19779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:40 smithi122 ceph-mon[125440]: pgmap v19779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:40 smithi136 ceph-mon[125702]: pgmap v19779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:42 smithi122 ceph-mon[125440]: pgmap v19780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:42 smithi136 ceph-mon[125702]: pgmap v19780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:42 smithi057 ceph-mon[92072]: pgmap v19780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:44 smithi122 ceph-mon[125440]: pgmap v19781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:44 smithi136 ceph-mon[125702]: pgmap v19781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:44 smithi057 ceph-mon[92072]: pgmap v19781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:45 smithi136 ceph-mon[125702]: pgmap v19782: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:45 smithi057 ceph-mon[92072]: pgmap v19782: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:45 smithi122 ceph-mon[125440]: pgmap v19782: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:47.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:15:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:47.389+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:15:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:47.389+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:15:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:47.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:15:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:15:47.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:15:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:48 smithi057 ceph-mon[92072]: pgmap v19783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T21:15:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:48 smithi122 ceph-mon[125440]: pgmap v19783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T21:15:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:48 smithi136 ceph-mon[125702]: pgmap v19783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T21:15:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:50 smithi057 ceph-mon[92072]: pgmap v19784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:50 smithi122 ceph-mon[125440]: pgmap v19784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:50 smithi136 ceph-mon[125702]: pgmap v19784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:52 smithi122 ceph-mon[125440]: pgmap v19785: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:52 smithi136 ceph-mon[125702]: pgmap v19785: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:52 smithi057 ceph-mon[92072]: pgmap v19785: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:54 smithi122 ceph-mon[125440]: pgmap v19786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:54 smithi136 ceph-mon[125702]: pgmap v19786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:54 smithi057 ceph-mon[92072]: pgmap v19786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:55 smithi136 ceph-mon[125702]: pgmap v19787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:55 smithi057 ceph-mon[92072]: pgmap v19787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:55 smithi122 ceph-mon[125440]: pgmap v19787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:15:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:15:58 smithi122 ceph-mon[125440]: pgmap v19788: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:15:58 smithi136 ceph-mon[125702]: pgmap v19788: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:15:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:15:58 smithi057 ceph-mon[92072]: pgmap v19788: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:00 smithi122 ceph-mon[125440]: pgmap v19789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:00 smithi136 ceph-mon[125702]: pgmap v19789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:00 smithi057 ceph-mon[92072]: pgmap v19789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:02.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:16:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:02.405+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:16:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:02.405+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:16:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:02.405+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:16:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:02.405+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:16:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:02 smithi122 ceph-mon[125440]: pgmap v19790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:02 smithi136 ceph-mon[125702]: pgmap v19790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:02 smithi057 ceph-mon[92072]: pgmap v19790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:04 smithi136 ceph-mon[125702]: pgmap v19791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:16:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:04 smithi057 ceph-mon[92072]: pgmap v19791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:16:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:04 smithi122 ceph-mon[125440]: pgmap v19791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:16:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:05 smithi136 ceph-mon[125702]: pgmap v19792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:16:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:05 smithi057 ceph-mon[92072]: pgmap v19792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:16:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:05 smithi122 ceph-mon[125440]: pgmap v19792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:16:07.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:16:07.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:16:07.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:16:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:07 smithi136 ceph-mon[125702]: osdmap e1310: 12 total, 12 up, 12 in 2023-03-02T21:16:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:16:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:16:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:07 smithi136 ceph-mon[125702]: pgmap v19794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:16:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:16:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:16:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:16:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:07 smithi057 ceph-mon[92072]: osdmap e1310: 12 total, 12 up, 12 in 2023-03-02T21:16:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:16:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:16:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:07 smithi057 ceph-mon[92072]: pgmap v19794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:16:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:16:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:16:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:16:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:07 smithi122 ceph-mon[125440]: osdmap e1310: 12 total, 12 up, 12 in 2023-03-02T21:16:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:16:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:16:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:07 smithi122 ceph-mon[125440]: pgmap v19794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:16:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:16:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:16:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:16:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:10 smithi057 ceph-mon[92072]: pgmap v19795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:16:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:10 smithi122 ceph-mon[125440]: pgmap v19795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:16:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:10 smithi136 ceph-mon[125702]: pgmap v19795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:16:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:12 smithi122 ceph-mon[125440]: pgmap v19796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:16:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:12 smithi136 ceph-mon[125702]: pgmap v19796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:16:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:12 smithi057 ceph-mon[92072]: pgmap v19796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:16:14.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:14 smithi122 ceph-mon[125440]: pgmap v19797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:16:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:14 smithi136 ceph-mon[125702]: pgmap v19797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:16:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:14 smithi057 ceph-mon[92072]: pgmap v19797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:16:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:15 smithi136 ceph-mon[125702]: osdmap e1311: 12 total, 12 up, 12 in 2023-03-02T21:16:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:15 smithi136 ceph-mon[125702]: pgmap v19799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:16:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:15 smithi057 ceph-mon[92072]: osdmap e1311: 12 total, 12 up, 12 in 2023-03-02T21:16:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:15 smithi057 ceph-mon[92072]: pgmap v19799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:16:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:15 smithi122 ceph-mon[125440]: osdmap e1311: 12 total, 12 up, 12 in 2023-03-02T21:16:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:15 smithi122 ceph-mon[125440]: pgmap v19799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:16:17.421 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:17.420+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:16:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:17.420+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:16:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:17.420+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:16:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:17.420+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:16:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:17.420+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:16:18.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:18 smithi122 ceph-mon[125440]: pgmap v19800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:16:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:18 smithi136 ceph-mon[125702]: pgmap v19800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:16:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:18 smithi057 ceph-mon[92072]: pgmap v19800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:16:20.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:20 smithi122 ceph-mon[125440]: pgmap v19801: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:16:20.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:20 smithi136 ceph-mon[125702]: pgmap v19801: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:16:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:20 smithi057 ceph-mon[92072]: pgmap v19801: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:16:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:22 smithi136 ceph-mon[125702]: pgmap v19802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:16:22.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:22 smithi057 ceph-mon[92072]: pgmap v19802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:16:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:22 smithi122 ceph-mon[125440]: pgmap v19802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:16:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:24 smithi136 ceph-mon[125702]: pgmap v19803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:16:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:24 smithi057 ceph-mon[92072]: pgmap v19803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:16:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:24 smithi122 ceph-mon[125440]: pgmap v19803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:16:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:25 smithi136 ceph-mon[125702]: pgmap v19804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:16:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:25 smithi057 ceph-mon[92072]: pgmap v19804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:16:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:25 smithi122 ceph-mon[125440]: pgmap v19804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:16:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:28 smithi122 ceph-mon[125440]: pgmap v19805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:16:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:28 smithi136 ceph-mon[125702]: pgmap v19805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:16:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:28 smithi057 ceph-mon[92072]: pgmap v19805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:16:30.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:30 smithi122 ceph-mon[125440]: pgmap v19806: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:30 smithi136 ceph-mon[125702]: pgmap v19806: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:30 smithi057 ceph-mon[92072]: pgmap v19806: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:32.422+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:16:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:32.423+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:16:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:32.423+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:16:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:32.423+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:16:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:32.423+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:16:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:32 smithi136 ceph-mon[125702]: pgmap v19807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:32 smithi057 ceph-mon[92072]: pgmap v19807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:32 smithi122 ceph-mon[125440]: pgmap v19807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:34 smithi136 ceph-mon[125702]: pgmap v19808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:34 smithi057 ceph-mon[92072]: pgmap v19808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:34.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:34 smithi122 ceph-mon[125440]: pgmap v19808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:35 smithi136 ceph-mon[125702]: pgmap v19809: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:35 smithi057 ceph-mon[92072]: pgmap v19809: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:35 smithi122 ceph-mon[125440]: pgmap v19809: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:38 smithi122 ceph-mon[125440]: pgmap v19810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:38 smithi136 ceph-mon[125702]: pgmap v19810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:38 smithi057 ceph-mon[92072]: pgmap v19810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:40 smithi122 ceph-mon[125440]: pgmap v19811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:40 smithi136 ceph-mon[125702]: pgmap v19811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:40 smithi057 ceph-mon[92072]: pgmap v19811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:42 smithi122 ceph-mon[125440]: pgmap v19812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:42 smithi136 ceph-mon[125702]: pgmap v19812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:42 smithi057 ceph-mon[92072]: pgmap v19812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:44 smithi136 ceph-mon[125702]: pgmap v19813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:44 smithi057 ceph-mon[92072]: pgmap v19813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:44 smithi122 ceph-mon[125440]: pgmap v19813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:45 smithi136 ceph-mon[125702]: pgmap v19814: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:45 smithi057 ceph-mon[92072]: pgmap v19814: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:45 smithi122 ceph-mon[125440]: pgmap v19814: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:47.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:16:47.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:47.425+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:16:47.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:47.425+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:16:47.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:47.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:16:47.428 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:16:47.425+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:16:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:48 smithi122 ceph-mon[125440]: pgmap v19815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:48 smithi136 ceph-mon[125702]: pgmap v19815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:48 smithi057 ceph-mon[92072]: pgmap v19815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:50 smithi122 ceph-mon[125440]: pgmap v19816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:50 smithi136 ceph-mon[125702]: pgmap v19816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:50 smithi057 ceph-mon[92072]: pgmap v19816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:52 smithi122 ceph-mon[125440]: pgmap v19817: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:52 smithi136 ceph-mon[125702]: pgmap v19817: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:52 smithi057 ceph-mon[92072]: pgmap v19817: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:54 smithi136 ceph-mon[125702]: pgmap v19818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:54 smithi057 ceph-mon[92072]: pgmap v19818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:54 smithi122 ceph-mon[125440]: pgmap v19818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:55 smithi136 ceph-mon[125702]: pgmap v19819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:55 smithi057 ceph-mon[92072]: pgmap v19819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:55 smithi122 ceph-mon[125440]: pgmap v19819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:16:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:16:58 smithi122 ceph-mon[125440]: pgmap v19820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:16:58 smithi136 ceph-mon[125702]: pgmap v19820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:16:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:16:58 smithi057 ceph-mon[92072]: pgmap v19820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:00 smithi122 ceph-mon[125440]: pgmap v19821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:00 smithi136 ceph-mon[125702]: pgmap v19821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:00 smithi057 ceph-mon[92072]: pgmap v19821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:02.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:17:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:02.436+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:17:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:02.436+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:17:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:02.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:17:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:02.437+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:17:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:02 smithi136 ceph-mon[125702]: pgmap v19822: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:02 smithi057 ceph-mon[92072]: pgmap v19822: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:02 smithi122 ceph-mon[125440]: pgmap v19822: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:04 smithi136 ceph-mon[125702]: pgmap v19823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:17:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:04 smithi057 ceph-mon[92072]: pgmap v19823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:17:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:04 smithi122 ceph-mon[125440]: pgmap v19823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:17:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:05 smithi136 ceph-mon[125702]: pgmap v19824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:17:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:05 smithi057 ceph-mon[92072]: pgmap v19824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:17:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:05 smithi122 ceph-mon[125440]: pgmap v19824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:17:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:07 smithi136 ceph-mon[125702]: osdmap e1312: 12 total, 12 up, 12 in 2023-03-02T21:17:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:07 smithi136 ceph-mon[125702]: pgmap v19826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:17:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:17:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:07 smithi057 ceph-mon[92072]: osdmap e1312: 12 total, 12 up, 12 in 2023-03-02T21:17:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:07 smithi057 ceph-mon[92072]: pgmap v19826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:17:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:17:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:07 smithi122 ceph-mon[125440]: osdmap e1312: 12 total, 12 up, 12 in 2023-03-02T21:17:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:07 smithi122 ceph-mon[125440]: pgmap v19826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:17:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:17:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:17:09.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:17:09.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:09 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:17:09.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:17:09.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:17:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:17:09.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:09 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:17:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:10 smithi136 ceph-mon[125702]: pgmap v19827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:17:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:10 smithi057 ceph-mon[92072]: pgmap v19827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:17:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:10 smithi122 ceph-mon[125440]: pgmap v19827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:17:12.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:12 smithi122 ceph-mon[125440]: pgmap v19828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:17:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:12 smithi136 ceph-mon[125702]: pgmap v19828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:17:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:12 smithi057 ceph-mon[92072]: pgmap v19828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:17:13.735 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:13.734+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:17:13.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:13.734+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:17:13.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:13.734+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 286 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:17:13.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:13.734+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 285 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:17:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:14 smithi136 ceph-mon[125702]: pgmap v19829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:17:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:14 smithi057 ceph-mon[92072]: pgmap v19829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:17:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:14 smithi122 ceph-mon[125440]: pgmap v19829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:17:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:15 smithi136 ceph-mon[125702]: osdmap e1313: 12 total, 12 up, 12 in 2023-03-02T21:17:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:15 smithi136 ceph-mon[125702]: pgmap v19831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:17:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:15 smithi057 ceph-mon[92072]: osdmap e1313: 12 total, 12 up, 12 in 2023-03-02T21:17:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:15 smithi057 ceph-mon[92072]: pgmap v19831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:17:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:15 smithi122 ceph-mon[125440]: osdmap e1313: 12 total, 12 up, 12 in 2023-03-02T21:17:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:15 smithi122 ceph-mon[125440]: pgmap v19831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:17:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:17.444+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:17:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:17.444+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:17:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:17.444+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:17:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:17.444+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:17:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:17.445+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:17:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:18 smithi136 ceph-mon[125702]: pgmap v19832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:17:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:18 smithi057 ceph-mon[92072]: pgmap v19832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:17:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:18 smithi122 ceph-mon[125440]: pgmap v19832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:17:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:20 smithi136 ceph-mon[125702]: pgmap v19833: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:17:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:20 smithi057 ceph-mon[92072]: pgmap v19833: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:17:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:20 smithi122 ceph-mon[125440]: pgmap v19833: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:17:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:22 smithi136 ceph-mon[125702]: pgmap v19834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:17:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:22 smithi057 ceph-mon[92072]: pgmap v19834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:17:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:22 smithi122 ceph-mon[125440]: pgmap v19834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:17:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:24 smithi136 ceph-mon[125702]: pgmap v19835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:17:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:24 smithi057 ceph-mon[92072]: pgmap v19835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:17:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:24 smithi122 ceph-mon[125440]: pgmap v19835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:17:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:25 smithi136 ceph-mon[125702]: pgmap v19836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:17:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:25 smithi057 ceph-mon[92072]: pgmap v19836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:17:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:25 smithi122 ceph-mon[125440]: pgmap v19836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:17:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:28 smithi136 ceph-mon[125702]: pgmap v19837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:17:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:28 smithi057 ceph-mon[92072]: pgmap v19837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:17:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:28 smithi122 ceph-mon[125440]: pgmap v19837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:17:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:30 smithi136 ceph-mon[125702]: pgmap v19838: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:30 smithi057 ceph-mon[92072]: pgmap v19838: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:30 smithi122 ceph-mon[125440]: pgmap v19838: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:32.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:17:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:32.451+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:17:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:32.451+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:17:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:32.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:17:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:32.451+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:17:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:32 smithi136 ceph-mon[125702]: pgmap v19839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:32 smithi057 ceph-mon[92072]: pgmap v19839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:32 smithi122 ceph-mon[125440]: pgmap v19839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:34 smithi136 ceph-mon[125702]: pgmap v19840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:34 smithi057 ceph-mon[92072]: pgmap v19840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:34 smithi122 ceph-mon[125440]: pgmap v19840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:35 smithi136 ceph-mon[125702]: pgmap v19841: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:35 smithi057 ceph-mon[92072]: pgmap v19841: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:35 smithi122 ceph-mon[125440]: pgmap v19841: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:38 smithi136 ceph-mon[125702]: pgmap v19842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:38 smithi057 ceph-mon[92072]: pgmap v19842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:38 smithi122 ceph-mon[125440]: pgmap v19842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:40 smithi136 ceph-mon[125702]: pgmap v19843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:40 smithi057 ceph-mon[92072]: pgmap v19843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:40 smithi122 ceph-mon[125440]: pgmap v19843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:42 smithi136 ceph-mon[125702]: pgmap v19844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:42 smithi057 ceph-mon[92072]: pgmap v19844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:42 smithi122 ceph-mon[125440]: pgmap v19844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:44 smithi136 ceph-mon[125702]: pgmap v19845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:44 smithi057 ceph-mon[92072]: pgmap v19845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:44 smithi122 ceph-mon[125440]: pgmap v19845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:45 smithi057 ceph-mon[92072]: pgmap v19846: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:45 smithi122 ceph-mon[125440]: pgmap v19846: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:45 smithi136 ceph-mon[125702]: pgmap v19846: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:47.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:17:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:47.465+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:17:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:47.465+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:17:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:47.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:17:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:47.465+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:17:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:48 smithi136 ceph-mon[125702]: pgmap v19847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:48 smithi057 ceph-mon[92072]: pgmap v19847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:48 smithi122 ceph-mon[125440]: pgmap v19847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:50 smithi136 ceph-mon[125702]: pgmap v19848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:50 smithi057 ceph-mon[92072]: pgmap v19848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:50 smithi122 ceph-mon[125440]: pgmap v19848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:52 smithi136 ceph-mon[125702]: pgmap v19849: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:52 smithi057 ceph-mon[92072]: pgmap v19849: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:52 smithi122 ceph-mon[125440]: pgmap v19849: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:54 smithi136 ceph-mon[125702]: pgmap v19850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:54 smithi057 ceph-mon[92072]: pgmap v19850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:54 smithi122 ceph-mon[125440]: pgmap v19850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:55 smithi057 ceph-mon[92072]: pgmap v19851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:55 smithi122 ceph-mon[125440]: pgmap v19851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:55 smithi136 ceph-mon[125702]: pgmap v19851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:17:58.741 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:58.740+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:17:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:58.740+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:17:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:58.741+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 287 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:17:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:17:58.741+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 286 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:17:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:17:58 smithi136 ceph-mon[125702]: pgmap v19852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:17:58 smithi057 ceph-mon[92072]: pgmap v19852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:17:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:17:58 smithi122 ceph-mon[125440]: pgmap v19852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:00 smithi136 ceph-mon[125702]: pgmap v19853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:00 smithi057 ceph-mon[92072]: pgmap v19853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:00 smithi122 ceph-mon[125440]: pgmap v19853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:02.480+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:18:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:02.481+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:18:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:02.481+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:18:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:02.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:18:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:02.481+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:18:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:02 smithi136 ceph-mon[125702]: pgmap v19854: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:02 smithi057 ceph-mon[92072]: pgmap v19854: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:02 smithi122 ceph-mon[125440]: pgmap v19854: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:04 smithi136 ceph-mon[125702]: pgmap v19855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:18:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:04 smithi057 ceph-mon[92072]: pgmap v19855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:18:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:04 smithi122 ceph-mon[125440]: pgmap v19855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:18:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:05 smithi057 ceph-mon[92072]: pgmap v19856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:18:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:05 smithi122 ceph-mon[125440]: pgmap v19856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:18:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:05 smithi136 ceph-mon[125702]: pgmap v19856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:18:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:07 smithi057 ceph-mon[92072]: osdmap e1314: 12 total, 12 up, 12 in 2023-03-02T21:18:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:07 smithi057 ceph-mon[92072]: pgmap v19858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:18:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:07 smithi122 ceph-mon[125440]: osdmap e1314: 12 total, 12 up, 12 in 2023-03-02T21:18:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:07 smithi122 ceph-mon[125440]: pgmap v19858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:18:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:07 smithi136 ceph-mon[125702]: osdmap e1314: 12 total, 12 up, 12 in 2023-03-02T21:18:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:07 smithi136 ceph-mon[125702]: pgmap v19858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:18:09.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:18:09.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:18:09.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:18:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:10 smithi136 ceph-mon[125702]: pgmap v19859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:18:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:18:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:18:10.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:18:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:10 smithi057 ceph-mon[92072]: pgmap v19859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:18:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:18:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:18:10.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:18:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:10 smithi122 ceph-mon[125440]: pgmap v19859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:18:10.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:18:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:18:10.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:18:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:12 smithi136 ceph-mon[125702]: pgmap v19860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:18:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:12 smithi057 ceph-mon[92072]: pgmap v19860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:18:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:12 smithi122 ceph-mon[125440]: pgmap v19860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:18:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:14 smithi136 ceph-mon[125702]: pgmap v19861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:18:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:14 smithi057 ceph-mon[92072]: pgmap v19861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:18:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:14 smithi122 ceph-mon[125440]: pgmap v19861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:18:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:15 smithi057 ceph-mon[92072]: osdmap e1315: 12 total, 12 up, 12 in 2023-03-02T21:18:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:15 smithi057 ceph-mon[92072]: pgmap v19863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 119 B/s wr, 5 op/s 2023-03-02T21:18:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:15 smithi122 ceph-mon[125440]: osdmap e1315: 12 total, 12 up, 12 in 2023-03-02T21:18:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:15 smithi122 ceph-mon[125440]: pgmap v19863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 119 B/s wr, 5 op/s 2023-03-02T21:18:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:15 smithi136 ceph-mon[125702]: osdmap e1315: 12 total, 12 up, 12 in 2023-03-02T21:18:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:15 smithi136 ceph-mon[125702]: pgmap v19863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 119 B/s wr, 5 op/s 2023-03-02T21:18:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:17.489+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:18:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:17.490+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:18:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:17.490+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:18:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:17.490+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:18:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:17.490+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:18:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:18 smithi136 ceph-mon[125702]: pgmap v19864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:18:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:18 smithi057 ceph-mon[92072]: pgmap v19864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:18:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:18 smithi122 ceph-mon[125440]: pgmap v19864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:18:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:20 smithi136 ceph-mon[125702]: pgmap v19865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:18:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:20 smithi057 ceph-mon[92072]: pgmap v19865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:18:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:20 smithi122 ceph-mon[125440]: pgmap v19865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:18:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:22 smithi136 ceph-mon[125702]: pgmap v19866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:18:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:22 smithi057 ceph-mon[92072]: pgmap v19866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:18:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:22 smithi122 ceph-mon[125440]: pgmap v19866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:18:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:24 smithi136 ceph-mon[125702]: pgmap v19867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:18:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:24 smithi057 ceph-mon[92072]: pgmap v19867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:18:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:24 smithi122 ceph-mon[125440]: pgmap v19867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:18:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:25 smithi057 ceph-mon[92072]: pgmap v19868: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:18:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:25 smithi122 ceph-mon[125440]: pgmap v19868: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:18:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:25 smithi136 ceph-mon[125702]: pgmap v19868: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:18:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:28 smithi136 ceph-mon[125702]: pgmap v19869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:18:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:28 smithi057 ceph-mon[92072]: pgmap v19869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:18:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:28 smithi122 ceph-mon[125440]: pgmap v19869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:18:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:30 smithi136 ceph-mon[125702]: pgmap v19870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:30 smithi057 ceph-mon[92072]: pgmap v19870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:30 smithi122 ceph-mon[125440]: pgmap v19870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:32.491+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:18:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:32.491+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:18:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:32.491+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:18:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:32.491+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:18:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:32.491+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:18:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:32 smithi136 ceph-mon[125702]: pgmap v19871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:32 smithi057 ceph-mon[92072]: pgmap v19871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:32 smithi122 ceph-mon[125440]: pgmap v19871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:34 smithi136 ceph-mon[125702]: pgmap v19872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:34 smithi057 ceph-mon[92072]: pgmap v19872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:34 smithi122 ceph-mon[125440]: pgmap v19872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:35 smithi057 ceph-mon[92072]: pgmap v19873: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:35 smithi122 ceph-mon[125440]: pgmap v19873: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:35 smithi136 ceph-mon[125702]: pgmap v19873: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:38 smithi136 ceph-mon[125702]: pgmap v19874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:38 smithi057 ceph-mon[92072]: pgmap v19874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:38 smithi122 ceph-mon[125440]: pgmap v19874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:40 smithi136 ceph-mon[125702]: pgmap v19875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:40 smithi057 ceph-mon[92072]: pgmap v19875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:40 smithi122 ceph-mon[125440]: pgmap v19875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:42 smithi136 ceph-mon[125702]: pgmap v19876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:42 smithi057 ceph-mon[92072]: pgmap v19876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:42 smithi122 ceph-mon[125440]: pgmap v19876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:44 smithi136 ceph-mon[125702]: pgmap v19877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:44 smithi057 ceph-mon[92072]: pgmap v19877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:44 smithi122 ceph-mon[125440]: pgmap v19877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:45 smithi057 ceph-mon[92072]: pgmap v19878: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:45 smithi122 ceph-mon[125440]: pgmap v19878: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:45 smithi136 ceph-mon[125702]: pgmap v19878: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:47.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:18:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:47.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:18:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:47.506+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:18:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:47.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:18:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:18:47.506+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:18:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:48 smithi136 ceph-mon[125702]: pgmap v19879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:48 smithi057 ceph-mon[92072]: pgmap v19879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:48 smithi122 ceph-mon[125440]: pgmap v19879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:50 smithi136 ceph-mon[125702]: pgmap v19880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:50 smithi057 ceph-mon[92072]: pgmap v19880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:50 smithi122 ceph-mon[125440]: pgmap v19880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:52 smithi136 ceph-mon[125702]: pgmap v19881: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:52 smithi057 ceph-mon[92072]: pgmap v19881: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:52 smithi122 ceph-mon[125440]: pgmap v19881: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:54 smithi136 ceph-mon[125702]: pgmap v19882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:54 smithi057 ceph-mon[92072]: pgmap v19882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:54 smithi122 ceph-mon[125440]: pgmap v19882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:55 smithi057 ceph-mon[92072]: pgmap v19883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:55 smithi122 ceph-mon[125440]: pgmap v19883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:55 smithi136 ceph-mon[125702]: pgmap v19883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:18:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:18:58 smithi136 ceph-mon[125702]: pgmap v19884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:18:58 smithi057 ceph-mon[92072]: pgmap v19884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:18:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:18:58 smithi122 ceph-mon[125440]: pgmap v19884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:00 smithi136 ceph-mon[125702]: pgmap v19885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:00 smithi057 ceph-mon[92072]: pgmap v19885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:00 smithi122 ceph-mon[125440]: pgmap v19885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:02.522+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:02.522+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:02.522+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:02.522+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:19:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:02.522+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:19:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:02 smithi136 ceph-mon[125702]: pgmap v19886: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:02 smithi057 ceph-mon[92072]: pgmap v19886: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:02 smithi122 ceph-mon[125440]: pgmap v19886: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:04 smithi136 ceph-mon[125702]: pgmap v19887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:19:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:04 smithi057 ceph-mon[92072]: pgmap v19887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:19:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:04 smithi122 ceph-mon[125440]: pgmap v19887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:19:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:05 smithi057 ceph-mon[92072]: pgmap v19888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:19:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:05 smithi122 ceph-mon[125440]: pgmap v19888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:19:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:05 smithi136 ceph-mon[125702]: pgmap v19888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:19:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:07 smithi057 ceph-mon[92072]: osdmap e1316: 12 total, 12 up, 12 in 2023-03-02T21:19:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:07 smithi057 ceph-mon[92072]: pgmap v19890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:19:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:07 smithi122 ceph-mon[125440]: osdmap e1316: 12 total, 12 up, 12 in 2023-03-02T21:19:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:07 smithi122 ceph-mon[125440]: pgmap v19890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:19:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:07 smithi136 ceph-mon[125702]: osdmap e1316: 12 total, 12 up, 12 in 2023-03-02T21:19:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:07 smithi136 ceph-mon[125702]: pgmap v19890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:19:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:10 smithi136 ceph-mon[125702]: pgmap v19891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:19:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:19:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:10 smithi057 ceph-mon[92072]: pgmap v19891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:19:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:19:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:10 smithi122 ceph-mon[125440]: pgmap v19891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:19:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:19:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:19:11.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:19:11.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:19:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:19:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:19:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:19:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:19:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:19:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:19:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:12 smithi136 ceph-mon[125702]: pgmap v19892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:19:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:12 smithi057 ceph-mon[92072]: pgmap v19892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:19:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:12 smithi122 ceph-mon[125440]: pgmap v19892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:19:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:14 smithi136 ceph-mon[125702]: pgmap v19893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:19:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:14 smithi057 ceph-mon[92072]: pgmap v19893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:19:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:14 smithi122 ceph-mon[125440]: pgmap v19893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:19:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:15 smithi057 ceph-mon[92072]: osdmap e1317: 12 total, 12 up, 12 in 2023-03-02T21:19:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:15 smithi057 ceph-mon[92072]: pgmap v19895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:19:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:15 smithi122 ceph-mon[125440]: osdmap e1317: 12 total, 12 up, 12 in 2023-03-02T21:19:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:15 smithi122 ceph-mon[125440]: pgmap v19895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:19:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:15 smithi136 ceph-mon[125702]: osdmap e1317: 12 total, 12 up, 12 in 2023-03-02T21:19:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:15 smithi136 ceph-mon[125702]: pgmap v19895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:19:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:17.538+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:19:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:17.539+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:19:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:17.539+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:19:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:17.539+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:19:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:17.539+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:19:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:18 smithi136 ceph-mon[125702]: pgmap v19896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:19:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:18 smithi057 ceph-mon[92072]: pgmap v19896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:19:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:18 smithi122 ceph-mon[125440]: pgmap v19896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:19:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:20 smithi136 ceph-mon[125702]: pgmap v19897: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:19:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:20 smithi057 ceph-mon[92072]: pgmap v19897: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:19:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:20 smithi122 ceph-mon[125440]: pgmap v19897: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:19:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:22 smithi136 ceph-mon[125702]: pgmap v19898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:19:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:22 smithi057 ceph-mon[92072]: pgmap v19898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:19:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:22 smithi122 ceph-mon[125440]: pgmap v19898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:19:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:24 smithi136 ceph-mon[125702]: pgmap v19899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:19:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:24 smithi057 ceph-mon[92072]: pgmap v19899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:19:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:24 smithi122 ceph-mon[125440]: pgmap v19899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:19:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:25 smithi057 ceph-mon[92072]: pgmap v19900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:19:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:25 smithi122 ceph-mon[125440]: pgmap v19900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:19:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:25 smithi136 ceph-mon[125702]: pgmap v19900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:19:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:28 smithi136 ceph-mon[125702]: pgmap v19901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:19:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:28 smithi057 ceph-mon[92072]: pgmap v19901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:19:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:28 smithi122 ceph-mon[125440]: pgmap v19901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:19:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:30 smithi136 ceph-mon[125702]: pgmap v19902: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:30 smithi057 ceph-mon[92072]: pgmap v19902: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:30 smithi122 ceph-mon[125440]: pgmap v19902: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:32.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:19:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:32.543+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:19:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:32.543+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:19:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:32.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:19:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:32.543+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:19:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:32 smithi136 ceph-mon[125702]: pgmap v19903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:32 smithi057 ceph-mon[92072]: pgmap v19903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:32 smithi122 ceph-mon[125440]: pgmap v19903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:34 smithi136 ceph-mon[125702]: pgmap v19904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:34 smithi057 ceph-mon[92072]: pgmap v19904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:34 smithi122 ceph-mon[125440]: pgmap v19904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:35 smithi057 ceph-mon[92072]: pgmap v19905: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:35 smithi122 ceph-mon[125440]: pgmap v19905: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:35 smithi136 ceph-mon[125702]: pgmap v19905: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:38 smithi136 ceph-mon[125702]: pgmap v19906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:38 smithi057 ceph-mon[92072]: pgmap v19906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:38 smithi122 ceph-mon[125440]: pgmap v19906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:40 smithi136 ceph-mon[125702]: pgmap v19907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:40 smithi057 ceph-mon[92072]: pgmap v19907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:40 smithi122 ceph-mon[125440]: pgmap v19907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:42 smithi136 ceph-mon[125702]: pgmap v19908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:42 smithi057 ceph-mon[92072]: pgmap v19908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:42 smithi122 ceph-mon[125440]: pgmap v19908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:44 smithi136 ceph-mon[125702]: pgmap v19909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:44 smithi057 ceph-mon[92072]: pgmap v19909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:44 smithi122 ceph-mon[125440]: pgmap v19909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:45 smithi057 ceph-mon[92072]: pgmap v19910: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:45 smithi122 ceph-mon[125440]: pgmap v19910: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:45 smithi136 ceph-mon[125702]: pgmap v19910: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:47.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:47.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:19:47.556 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:47.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:19:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:47.555+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:19:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:47.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:19:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:19:47.555+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:19:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:48 smithi136 ceph-mon[125702]: pgmap v19911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:48 smithi057 ceph-mon[92072]: pgmap v19911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:48 smithi122 ceph-mon[125440]: pgmap v19911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:50 smithi136 ceph-mon[125702]: pgmap v19912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:50 smithi057 ceph-mon[92072]: pgmap v19912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:50 smithi122 ceph-mon[125440]: pgmap v19912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:52 smithi136 ceph-mon[125702]: pgmap v19913: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:52 smithi057 ceph-mon[92072]: pgmap v19913: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:52 smithi122 ceph-mon[125440]: pgmap v19913: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:54 smithi136 ceph-mon[125702]: pgmap v19914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:54 smithi057 ceph-mon[92072]: pgmap v19914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:54 smithi122 ceph-mon[125440]: pgmap v19914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:55 smithi057 ceph-mon[92072]: pgmap v19915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:55 smithi122 ceph-mon[125440]: pgmap v19915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:55 smithi136 ceph-mon[125702]: pgmap v19915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:19:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:19:58 smithi136 ceph-mon[125702]: pgmap v19916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:19:58 smithi057 ceph-mon[92072]: pgmap v19916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:19:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:19:58 smithi122 ceph-mon[125440]: pgmap v19916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:00 smithi136 ceph-mon[125702]: pgmap v19917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T21:20:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:00 smithi057 ceph-mon[92072]: pgmap v19917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T21:20:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:00 smithi122 ceph-mon[125440]: pgmap v19917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T21:20:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:02.561+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:20:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:02.561+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:20:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:02.562+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:20:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:02.562+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:20:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:02.562+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:20:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:02 smithi136 ceph-mon[125702]: pgmap v19918: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:02 smithi057 ceph-mon[92072]: pgmap v19918: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:02 smithi122 ceph-mon[125440]: pgmap v19918: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:04 smithi136 ceph-mon[125702]: pgmap v19919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:20:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:04 smithi057 ceph-mon[92072]: pgmap v19919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:20:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:04 smithi122 ceph-mon[125440]: pgmap v19919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:20:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:05 smithi057 ceph-mon[92072]: pgmap v19920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:20:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:05 smithi122 ceph-mon[125440]: pgmap v19920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:20:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:05 smithi136 ceph-mon[125702]: pgmap v19920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:20:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:07 smithi057 ceph-mon[92072]: osdmap e1318: 12 total, 12 up, 12 in 2023-03-02T21:20:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:07 smithi057 ceph-mon[92072]: pgmap v19922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:20:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:07 smithi122 ceph-mon[125440]: osdmap e1318: 12 total, 12 up, 12 in 2023-03-02T21:20:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:07 smithi122 ceph-mon[125440]: pgmap v19922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:20:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:07 smithi136 ceph-mon[125702]: osdmap e1318: 12 total, 12 up, 12 in 2023-03-02T21:20:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:07 smithi136 ceph-mon[125702]: pgmap v19922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:20:10.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:10 smithi136 ceph-mon[125702]: pgmap v19923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:20:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:10 smithi057 ceph-mon[92072]: pgmap v19923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:20:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:10 smithi122 ceph-mon[125440]: pgmap v19923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:20:11.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:20:11.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:20:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:20:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:12 smithi136 ceph-mon[125702]: pgmap v19924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:20:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:20:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:20:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:20:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:12 smithi057 ceph-mon[92072]: pgmap v19924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:20:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:20:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:20:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:20:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:12 smithi122 ceph-mon[125440]: pgmap v19924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:20:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:20:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:20:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:20:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:13.759+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:20:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:13.759+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:20:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:13.760+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 288 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:20:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:13.760+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 287 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:20:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:14 smithi136 ceph-mon[125702]: pgmap v19925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:20:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:14 smithi057 ceph-mon[92072]: pgmap v19925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:20:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:14 smithi122 ceph-mon[125440]: pgmap v19925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:20:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:15 smithi057 ceph-mon[92072]: osdmap e1319: 12 total, 12 up, 12 in 2023-03-02T21:20:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:15 smithi057 ceph-mon[92072]: pgmap v19927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:20:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:15 smithi122 ceph-mon[125440]: osdmap e1319: 12 total, 12 up, 12 in 2023-03-02T21:20:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:15 smithi122 ceph-mon[125440]: pgmap v19927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:20:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:15 smithi136 ceph-mon[125702]: osdmap e1319: 12 total, 12 up, 12 in 2023-03-02T21:20:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:15 smithi136 ceph-mon[125702]: pgmap v19927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:20:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:17.578+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:20:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:17.578+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:20:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:17.578+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:20:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:17.578+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:20:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:17.578+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:20:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:18 smithi136 ceph-mon[125702]: pgmap v19928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:20:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:18 smithi057 ceph-mon[92072]: pgmap v19928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:20:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:18 smithi122 ceph-mon[125440]: pgmap v19928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:20:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:20 smithi136 ceph-mon[125702]: pgmap v19929: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:20:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:20 smithi057 ceph-mon[92072]: pgmap v19929: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:20:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:20 smithi122 ceph-mon[125440]: pgmap v19929: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:20:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:22 smithi136 ceph-mon[125702]: pgmap v19930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:20:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:22 smithi057 ceph-mon[92072]: pgmap v19930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:20:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:22 smithi122 ceph-mon[125440]: pgmap v19930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:20:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:24 smithi136 ceph-mon[125702]: pgmap v19931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:20:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:24 smithi057 ceph-mon[92072]: pgmap v19931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:20:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:24 smithi122 ceph-mon[125440]: pgmap v19931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:20:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:25 smithi057 ceph-mon[92072]: pgmap v19932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:20:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:25 smithi122 ceph-mon[125440]: pgmap v19932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:20:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:25 smithi136 ceph-mon[125702]: pgmap v19932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:20:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:28 smithi136 ceph-mon[125702]: pgmap v19933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:20:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:28 smithi057 ceph-mon[92072]: pgmap v19933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:20:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:28 smithi122 ceph-mon[125440]: pgmap v19933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:20:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:30 smithi136 ceph-mon[125702]: pgmap v19934: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:30 smithi057 ceph-mon[92072]: pgmap v19934: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:30 smithi122 ceph-mon[125440]: pgmap v19934: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:32.579+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:20:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:32.580+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:20:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:32.580+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:20:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:32.580+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:20:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:32.580+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:20:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:32 smithi136 ceph-mon[125702]: pgmap v19935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:32 smithi057 ceph-mon[92072]: pgmap v19935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:32 smithi122 ceph-mon[125440]: pgmap v19935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:34 smithi136 ceph-mon[125702]: pgmap v19936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:34 smithi057 ceph-mon[92072]: pgmap v19936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:34 smithi122 ceph-mon[125440]: pgmap v19936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:35 smithi057 ceph-mon[92072]: pgmap v19937: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:35 smithi122 ceph-mon[125440]: pgmap v19937: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:35 smithi136 ceph-mon[125702]: pgmap v19937: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:38 smithi136 ceph-mon[125702]: pgmap v19938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:38 smithi057 ceph-mon[92072]: pgmap v19938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:38 smithi122 ceph-mon[125440]: pgmap v19938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:40 smithi136 ceph-mon[125702]: pgmap v19939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:40 smithi057 ceph-mon[92072]: pgmap v19939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:40 smithi122 ceph-mon[125440]: pgmap v19939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:42 smithi136 ceph-mon[125702]: pgmap v19940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:42 smithi057 ceph-mon[92072]: pgmap v19940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:42 smithi122 ceph-mon[125440]: pgmap v19940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:44 smithi136 ceph-mon[125702]: pgmap v19941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:44.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:44 smithi057 ceph-mon[92072]: pgmap v19941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:44 smithi122 ceph-mon[125440]: pgmap v19941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:45 smithi057 ceph-mon[92072]: pgmap v19942: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:45 smithi122 ceph-mon[125440]: pgmap v19942: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:45 smithi136 ceph-mon[125702]: pgmap v19942: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:47.595+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:20:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:47.596+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:20:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:47.596+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:20:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:47.596+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:20:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:20:47.596+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:20:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:48 smithi136 ceph-mon[125702]: pgmap v19943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:48 smithi057 ceph-mon[92072]: pgmap v19943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:48 smithi122 ceph-mon[125440]: pgmap v19943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:50 smithi136 ceph-mon[125702]: pgmap v19944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:50 smithi057 ceph-mon[92072]: pgmap v19944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:50 smithi122 ceph-mon[125440]: pgmap v19944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:52 smithi136 ceph-mon[125702]: pgmap v19945: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:52 smithi057 ceph-mon[92072]: pgmap v19945: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:52 smithi122 ceph-mon[125440]: pgmap v19945: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:54 smithi136 ceph-mon[125702]: pgmap v19946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:54 smithi057 ceph-mon[92072]: pgmap v19946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:54 smithi122 ceph-mon[125440]: pgmap v19946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:55 smithi057 ceph-mon[92072]: pgmap v19947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:55 smithi122 ceph-mon[125440]: pgmap v19947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:55 smithi136 ceph-mon[125702]: pgmap v19947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:20:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:20:58 smithi136 ceph-mon[125702]: pgmap v19948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:20:58 smithi057 ceph-mon[92072]: pgmap v19948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:20:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:20:58 smithi122 ceph-mon[125440]: pgmap v19948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:00 smithi136 ceph-mon[125702]: pgmap v19949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:00 smithi057 ceph-mon[92072]: pgmap v19949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:00 smithi122 ceph-mon[125440]: pgmap v19949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:02.604+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:21:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:02.604+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:21:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:02.604+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:21:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:02.604+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:21:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:02.604+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:21:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:02 smithi136 ceph-mon[125702]: pgmap v19950: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:02 smithi057 ceph-mon[92072]: pgmap v19950: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:02 smithi122 ceph-mon[125440]: pgmap v19950: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:04 smithi136 ceph-mon[125702]: pgmap v19951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:21:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:04 smithi057 ceph-mon[92072]: pgmap v19951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:21:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:04 smithi122 ceph-mon[125440]: pgmap v19951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:21:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:05 smithi057 ceph-mon[92072]: pgmap v19952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:21:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:05 smithi122 ceph-mon[125440]: pgmap v19952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:21:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:05 smithi136 ceph-mon[125702]: pgmap v19952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:21:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:07 smithi057 ceph-mon[92072]: osdmap e1320: 12 total, 12 up, 12 in 2023-03-02T21:21:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:07 smithi057 ceph-mon[92072]: pgmap v19954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:21:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:07 smithi122 ceph-mon[125440]: osdmap e1320: 12 total, 12 up, 12 in 2023-03-02T21:21:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:07 smithi122 ceph-mon[125440]: pgmap v19954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:21:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:07 smithi136 ceph-mon[125702]: osdmap e1320: 12 total, 12 up, 12 in 2023-03-02T21:21:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:07 smithi136 ceph-mon[125702]: pgmap v19954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:21:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:10 smithi136 ceph-mon[125702]: pgmap v19955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:21:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:10 smithi057 ceph-mon[92072]: pgmap v19955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:21:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:10 smithi122 ceph-mon[125440]: pgmap v19955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:21:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:12 smithi136 ceph-mon[125702]: pgmap v19956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:21:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:21:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:21:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:21:12.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:21:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:12 smithi057 ceph-mon[92072]: pgmap v19956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:21:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:21:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:21:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:21:12.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:21:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:12 smithi122 ceph-mon[125440]: pgmap v19956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:21:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:21:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:21:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:21:12.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:21:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:14 smithi136 ceph-mon[125702]: pgmap v19957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:21:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:14 smithi057 ceph-mon[92072]: pgmap v19957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:21:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:14 smithi122 ceph-mon[125440]: pgmap v19957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:21:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:15 smithi057 ceph-mon[92072]: osdmap e1321: 12 total, 12 up, 12 in 2023-03-02T21:21:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:15 smithi057 ceph-mon[92072]: pgmap v19959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:21:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:15 smithi122 ceph-mon[125440]: osdmap e1321: 12 total, 12 up, 12 in 2023-03-02T21:21:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:15 smithi122 ceph-mon[125440]: pgmap v19959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:21:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:15 smithi136 ceph-mon[125702]: osdmap e1321: 12 total, 12 up, 12 in 2023-03-02T21:21:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:15 smithi136 ceph-mon[125702]: pgmap v19959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:21:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:17.620+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:21:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:17.621+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:21:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:17.621+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:21:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:17.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:21:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:17.621+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:21:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:18 smithi136 ceph-mon[125702]: pgmap v19960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:21:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:18 smithi057 ceph-mon[92072]: pgmap v19960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:21:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:18 smithi122 ceph-mon[125440]: pgmap v19960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:21:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:20 smithi136 ceph-mon[125702]: pgmap v19961: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:21:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:20 smithi057 ceph-mon[92072]: pgmap v19961: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:21:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:20 smithi122 ceph-mon[125440]: pgmap v19961: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:21:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:22 smithi136 ceph-mon[125702]: pgmap v19962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:21:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:22 smithi057 ceph-mon[92072]: pgmap v19962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:21:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:22 smithi122 ceph-mon[125440]: pgmap v19962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:21:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:24 smithi136 ceph-mon[125702]: pgmap v19963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:21:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:24 smithi057 ceph-mon[92072]: pgmap v19963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:21:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:24 smithi122 ceph-mon[125440]: pgmap v19963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:21:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:25 smithi057 ceph-mon[92072]: pgmap v19964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:21:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:25 smithi122 ceph-mon[125440]: pgmap v19964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:21:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:25 smithi136 ceph-mon[125702]: pgmap v19964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:21:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:28 smithi136 ceph-mon[125702]: pgmap v19965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:21:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:28 smithi057 ceph-mon[92072]: pgmap v19965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:21:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:28 smithi122 ceph-mon[125440]: pgmap v19965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:21:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:30 smithi136 ceph-mon[125702]: pgmap v19966: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:30 smithi057 ceph-mon[92072]: pgmap v19966: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:30 smithi122 ceph-mon[125440]: pgmap v19966: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:32.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:21:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:32.630+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:21:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:32.630+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:21:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:32.630+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:21:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:32.630+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:21:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:32 smithi136 ceph-mon[125702]: pgmap v19967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:32 smithi057 ceph-mon[92072]: pgmap v19967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:32 smithi122 ceph-mon[125440]: pgmap v19967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:34 smithi136 ceph-mon[125702]: pgmap v19968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:34 smithi057 ceph-mon[92072]: pgmap v19968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:34 smithi122 ceph-mon[125440]: pgmap v19968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:35 smithi057 ceph-mon[92072]: pgmap v19969: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:35 smithi122 ceph-mon[125440]: pgmap v19969: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:35 smithi136 ceph-mon[125702]: pgmap v19969: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:38 smithi136 ceph-mon[125702]: pgmap v19970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:38 smithi057 ceph-mon[92072]: pgmap v19970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:38 smithi122 ceph-mon[125440]: pgmap v19970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:40 smithi136 ceph-mon[125702]: pgmap v19971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:40 smithi057 ceph-mon[92072]: pgmap v19971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:40 smithi122 ceph-mon[125440]: pgmap v19971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:42 smithi136 ceph-mon[125702]: pgmap v19972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:42 smithi057 ceph-mon[92072]: pgmap v19972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:42 smithi122 ceph-mon[125440]: pgmap v19972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:44 smithi136 ceph-mon[125702]: pgmap v19973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:44 smithi057 ceph-mon[92072]: pgmap v19973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:44 smithi122 ceph-mon[125440]: pgmap v19973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:45 smithi057 ceph-mon[92072]: pgmap v19974: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:45 smithi122 ceph-mon[125440]: pgmap v19974: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:45 smithi136 ceph-mon[125702]: pgmap v19974: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:47.641+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:21:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:47.641+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:21:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:47.641+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:21:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:47.641+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:21:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:21:47.641+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:21:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:48 smithi136 ceph-mon[125702]: pgmap v19975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:48 smithi057 ceph-mon[92072]: pgmap v19975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:48 smithi122 ceph-mon[125440]: pgmap v19975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:50 smithi136 ceph-mon[125702]: pgmap v19976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:50 smithi057 ceph-mon[92072]: pgmap v19976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:50 smithi122 ceph-mon[125440]: pgmap v19976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:52 smithi136 ceph-mon[125702]: pgmap v19977: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:52 smithi057 ceph-mon[92072]: pgmap v19977: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:52 smithi122 ceph-mon[125440]: pgmap v19977: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:54 smithi136 ceph-mon[125702]: pgmap v19978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:54 smithi057 ceph-mon[92072]: pgmap v19978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:54 smithi122 ceph-mon[125440]: pgmap v19978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:55 smithi057 ceph-mon[92072]: pgmap v19979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:55 smithi122 ceph-mon[125440]: pgmap v19979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:55 smithi136 ceph-mon[125702]: pgmap v19979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:21:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:21:58 smithi136 ceph-mon[125702]: pgmap v19980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:21:58 smithi057 ceph-mon[92072]: pgmap v19980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:21:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:21:58 smithi122 ceph-mon[125440]: pgmap v19980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:00 smithi136 ceph-mon[125702]: pgmap v19981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:00 smithi057 ceph-mon[92072]: pgmap v19981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:00 smithi122 ceph-mon[125440]: pgmap v19981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:02.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:02.654+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:22:02.657 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:02.655+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:22:02.657 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:02.655+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:22:02.658 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:02.655+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:22:02.658 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:02.655+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:22:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:02 smithi136 ceph-mon[125702]: pgmap v19982: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:02 smithi057 ceph-mon[92072]: pgmap v19982: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:02 smithi122 ceph-mon[125440]: pgmap v19982: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:04 smithi136 ceph-mon[125702]: pgmap v19983: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:22:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:04 smithi057 ceph-mon[92072]: pgmap v19983: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:22:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:04 smithi122 ceph-mon[125440]: pgmap v19983: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:22:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:05 smithi057 ceph-mon[92072]: pgmap v19984: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:22:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:05 smithi122 ceph-mon[125440]: pgmap v19984: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:22:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:05 smithi136 ceph-mon[125702]: pgmap v19984: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:22:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:07 smithi057 ceph-mon[92072]: osdmap e1322: 12 total, 12 up, 12 in 2023-03-02T21:22:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:07 smithi057 ceph-mon[92072]: pgmap v19986: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:22:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:07 smithi122 ceph-mon[125440]: osdmap e1322: 12 total, 12 up, 12 in 2023-03-02T21:22:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:07 smithi122 ceph-mon[125440]: pgmap v19986: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:22:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:07 smithi136 ceph-mon[125702]: osdmap e1322: 12 total, 12 up, 12 in 2023-03-02T21:22:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:07 smithi136 ceph-mon[125702]: pgmap v19986: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:22:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:10 smithi136 ceph-mon[125702]: pgmap v19987: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:22:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:10 smithi057 ceph-mon[92072]: pgmap v19987: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:22:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:10 smithi122 ceph-mon[125440]: pgmap v19987: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:22:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:12 smithi136 ceph-mon[125702]: pgmap v19988: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:22:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:12 smithi057 ceph-mon[92072]: pgmap v19988: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:22:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:12 smithi122 ceph-mon[125440]: pgmap v19988: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:22:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:22:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:22:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:22:13.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:22:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:22:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:22:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:22:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:22:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:22:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:22:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:22:13.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:22:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:14 smithi136 ceph-mon[125702]: pgmap v19989: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:22:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:14 smithi057 ceph-mon[92072]: pgmap v19989: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:22:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:14 smithi122 ceph-mon[125440]: pgmap v19989: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:22:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:15 smithi057 ceph-mon[92072]: osdmap e1323: 12 total, 12 up, 12 in 2023-03-02T21:22:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:15 smithi057 ceph-mon[92072]: pgmap v19991: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:22:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:15 smithi122 ceph-mon[125440]: osdmap e1323: 12 total, 12 up, 12 in 2023-03-02T21:22:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:15 smithi122 ceph-mon[125440]: pgmap v19991: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:22:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:15 smithi136 ceph-mon[125702]: osdmap e1323: 12 total, 12 up, 12 in 2023-03-02T21:22:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:15 smithi136 ceph-mon[125702]: pgmap v19991: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:22:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:17.671+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:22:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:17.671+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:22:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:17.671+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:22:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:17.671+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:22:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:17.671+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:22:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:18 smithi136 ceph-mon[125702]: pgmap v19992: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:22:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:18 smithi057 ceph-mon[92072]: pgmap v19992: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:22:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:18 smithi122 ceph-mon[125440]: pgmap v19992: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:22:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:20 smithi136 ceph-mon[125702]: pgmap v19993: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:22:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:20 smithi057 ceph-mon[92072]: pgmap v19993: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:22:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:20 smithi122 ceph-mon[125440]: pgmap v19993: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:22:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:22 smithi136 ceph-mon[125702]: pgmap v19994: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:22:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:22 smithi057 ceph-mon[92072]: pgmap v19994: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:22:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:22 smithi122 ceph-mon[125440]: pgmap v19994: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:22:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:24 smithi136 ceph-mon[125702]: pgmap v19995: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:22:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:24 smithi057 ceph-mon[92072]: pgmap v19995: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:22:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:24 smithi122 ceph-mon[125440]: pgmap v19995: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:22:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:25 smithi057 ceph-mon[92072]: pgmap v19996: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:22:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:25 smithi122 ceph-mon[125440]: pgmap v19996: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:22:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:25 smithi136 ceph-mon[125702]: pgmap v19996: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:22:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:28 smithi136 ceph-mon[125702]: pgmap v19997: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:28 smithi057 ceph-mon[92072]: pgmap v19997: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:28 smithi122 ceph-mon[125440]: pgmap v19997: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:30 smithi136 ceph-mon[125702]: pgmap v19998: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:30 smithi057 ceph-mon[92072]: pgmap v19998: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:30 smithi122 ceph-mon[125440]: pgmap v19998: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:32.684+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:22:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:32.684+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:22:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:32.684+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:22:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:32.684+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:22:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:32.685+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:22:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:32 smithi136 ceph-mon[125702]: pgmap v19999: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:32 smithi057 ceph-mon[92072]: pgmap v19999: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:32 smithi122 ceph-mon[125440]: pgmap v19999: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:34 smithi136 ceph-mon[125702]: pgmap v20000: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:34 smithi057 ceph-mon[92072]: pgmap v20000: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:34 smithi122 ceph-mon[125440]: pgmap v20000: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:35 smithi057 ceph-mon[92072]: pgmap v20001: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:35 smithi122 ceph-mon[125440]: pgmap v20001: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:35 smithi136 ceph-mon[125702]: pgmap v20001: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:38 smithi136 ceph-mon[125702]: pgmap v20002: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:38 smithi057 ceph-mon[92072]: pgmap v20002: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:38 smithi122 ceph-mon[125440]: pgmap v20002: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:40 smithi136 ceph-mon[125702]: pgmap v20003: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:40 smithi057 ceph-mon[92072]: pgmap v20003: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:40 smithi122 ceph-mon[125440]: pgmap v20003: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:42 smithi136 ceph-mon[125702]: pgmap v20004: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:42 smithi057 ceph-mon[92072]: pgmap v20004: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:42 smithi122 ceph-mon[125440]: pgmap v20004: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:44 smithi136 ceph-mon[125702]: pgmap v20005: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:44 smithi057 ceph-mon[92072]: pgmap v20005: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:44 smithi122 ceph-mon[125440]: pgmap v20005: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:45 smithi122 ceph-mon[125440]: pgmap v20006: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:45 smithi136 ceph-mon[125702]: pgmap v20006: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:45 smithi057 ceph-mon[92072]: pgmap v20006: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:47.687+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:22:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:47.688+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:22:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:47.688+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:22:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:47.688+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:22:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:22:47.688+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:22:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:48 smithi136 ceph-mon[125702]: pgmap v20007: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:48 smithi057 ceph-mon[92072]: pgmap v20007: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:48 smithi122 ceph-mon[125440]: pgmap v20007: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:50 smithi136 ceph-mon[125702]: pgmap v20008: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:50 smithi057 ceph-mon[92072]: pgmap v20008: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:50 smithi122 ceph-mon[125440]: pgmap v20008: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:52 smithi136 ceph-mon[125702]: pgmap v20009: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:52 smithi057 ceph-mon[92072]: pgmap v20009: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:52 smithi122 ceph-mon[125440]: pgmap v20009: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:54 smithi136 ceph-mon[125702]: pgmap v20010: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:54 smithi057 ceph-mon[92072]: pgmap v20010: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:54 smithi122 ceph-mon[125440]: pgmap v20010: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:55 smithi057 ceph-mon[92072]: pgmap v20011: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:55 smithi122 ceph-mon[125440]: pgmap v20011: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:55 smithi136 ceph-mon[125702]: pgmap v20011: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:22:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:22:58 smithi136 ceph-mon[125702]: pgmap v20012: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:22:58 smithi057 ceph-mon[92072]: pgmap v20012: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:22:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:22:58 smithi122 ceph-mon[125440]: pgmap v20012: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:00 smithi136 ceph-mon[125702]: pgmap v20013: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:00 smithi057 ceph-mon[92072]: pgmap v20013: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:00 smithi122 ceph-mon[125440]: pgmap v20013: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:02.694+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:23:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:02.695+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:23:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:02.695+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:23:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:02.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:23:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:02.695+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:23:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:02 smithi136 ceph-mon[125702]: pgmap v20014: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:02 smithi057 ceph-mon[92072]: pgmap v20014: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:02 smithi122 ceph-mon[125440]: pgmap v20014: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:04 smithi136 ceph-mon[125702]: pgmap v20015: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:23:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:04 smithi057 ceph-mon[92072]: pgmap v20015: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:23:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:04 smithi122 ceph-mon[125440]: pgmap v20015: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:23:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:05 smithi122 ceph-mon[125440]: pgmap v20016: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:23:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:05 smithi136 ceph-mon[125702]: pgmap v20016: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:23:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:05 smithi057 ceph-mon[92072]: pgmap v20016: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:23:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:07 smithi122 ceph-mon[125440]: osdmap e1324: 12 total, 12 up, 12 in 2023-03-02T21:23:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:07 smithi122 ceph-mon[125440]: pgmap v20018: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:23:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:07 smithi136 ceph-mon[125702]: osdmap e1324: 12 total, 12 up, 12 in 2023-03-02T21:23:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:07 smithi136 ceph-mon[125702]: pgmap v20018: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:23:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:07 smithi057 ceph-mon[92072]: osdmap e1324: 12 total, 12 up, 12 in 2023-03-02T21:23:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:07 smithi057 ceph-mon[92072]: pgmap v20018: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:23:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:10 smithi136 ceph-mon[125702]: pgmap v20019: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:23:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:10 smithi057 ceph-mon[92072]: pgmap v20019: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:23:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:10 smithi122 ceph-mon[125440]: pgmap v20019: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:23:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:12 smithi136 ceph-mon[125702]: pgmap v20020: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:23:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:12 smithi057 ceph-mon[92072]: pgmap v20020: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:23:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:12 smithi122 ceph-mon[125440]: pgmap v20020: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:23:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:13.786+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:23:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:13.786+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:23:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:13.786+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 288 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:23:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:13.786+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 289 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:23:13.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:23:13.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:23:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:23:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:14 smithi136 ceph-mon[125702]: pgmap v20021: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:23:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:23:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:23:14.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:14 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:23:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:14 smithi057 ceph-mon[92072]: pgmap v20021: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:23:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:23:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:23:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:14 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:23:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:14 smithi122 ceph-mon[125440]: pgmap v20021: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:23:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:23:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:23:14.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:14 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:23:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:15 smithi057 ceph-mon[92072]: osdmap e1325: 12 total, 12 up, 12 in 2023-03-02T21:23:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:15 smithi057 ceph-mon[92072]: pgmap v20023: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:23:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:15 smithi122 ceph-mon[125440]: osdmap e1325: 12 total, 12 up, 12 in 2023-03-02T21:23:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:15 smithi122 ceph-mon[125440]: pgmap v20023: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:23:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:15 smithi136 ceph-mon[125702]: osdmap e1325: 12 total, 12 up, 12 in 2023-03-02T21:23:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:15 smithi136 ceph-mon[125702]: pgmap v20023: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:23:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:17.702+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:23:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:17.702+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:23:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:17.702+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:23:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:17.702+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:23:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:17.702+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:23:18.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:18 smithi136 ceph-mon[125702]: pgmap v20024: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:23:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:18 smithi057 ceph-mon[92072]: pgmap v20024: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:23:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:18 smithi122 ceph-mon[125440]: pgmap v20024: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:23:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:20 smithi136 ceph-mon[125702]: pgmap v20025: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:23:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:20 smithi057 ceph-mon[92072]: pgmap v20025: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:23:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:20 smithi122 ceph-mon[125440]: pgmap v20025: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:23:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:22 smithi136 ceph-mon[125702]: pgmap v20026: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:23:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:22 smithi057 ceph-mon[92072]: pgmap v20026: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:23:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:22 smithi122 ceph-mon[125440]: pgmap v20026: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:23:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:24 smithi136 ceph-mon[125702]: pgmap v20027: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:23:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:24 smithi057 ceph-mon[92072]: pgmap v20027: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:23:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:24 smithi122 ceph-mon[125440]: pgmap v20027: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:23:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:25 smithi122 ceph-mon[125440]: pgmap v20028: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:23:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:25 smithi136 ceph-mon[125702]: pgmap v20028: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:23:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:25 smithi057 ceph-mon[92072]: pgmap v20028: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:23:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:28 smithi136 ceph-mon[125702]: pgmap v20029: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:28 smithi057 ceph-mon[92072]: pgmap v20029: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:28 smithi122 ceph-mon[125440]: pgmap v20029: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:30 smithi136 ceph-mon[125702]: pgmap v20030: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:30 smithi057 ceph-mon[92072]: pgmap v20030: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:30 smithi122 ceph-mon[125440]: pgmap v20030: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:32.704+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:23:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:32.705+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:23:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:32.705+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:23:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:32.705+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:23:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:32.705+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:23:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:32 smithi136 ceph-mon[125702]: pgmap v20031: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:32 smithi057 ceph-mon[92072]: pgmap v20031: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:32 smithi122 ceph-mon[125440]: pgmap v20031: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:34 smithi136 ceph-mon[125702]: pgmap v20032: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:34 smithi057 ceph-mon[92072]: pgmap v20032: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:34 smithi122 ceph-mon[125440]: pgmap v20032: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:35 smithi122 ceph-mon[125440]: pgmap v20033: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:35 smithi136 ceph-mon[125702]: pgmap v20033: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:35 smithi057 ceph-mon[92072]: pgmap v20033: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:38 smithi136 ceph-mon[125702]: pgmap v20034: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:38 smithi057 ceph-mon[92072]: pgmap v20034: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:38 smithi122 ceph-mon[125440]: pgmap v20034: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:40 smithi136 ceph-mon[125702]: pgmap v20035: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:23:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:40 smithi057 ceph-mon[92072]: pgmap v20035: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:23:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:40 smithi122 ceph-mon[125440]: pgmap v20035: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:23:42.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:42 smithi136 ceph-mon[125702]: pgmap v20036: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:23:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:42 smithi057 ceph-mon[92072]: pgmap v20036: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:23:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:42 smithi122 ceph-mon[125440]: pgmap v20036: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:23:44.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:44 smithi136 ceph-mon[125702]: pgmap v20037: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:44 smithi057 ceph-mon[92072]: pgmap v20037: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:44 smithi122 ceph-mon[125440]: pgmap v20037: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:45 smithi136 ceph-mon[125702]: pgmap v20038: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:23:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:45 smithi057 ceph-mon[92072]: pgmap v20038: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:23:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:45 smithi122 ceph-mon[125440]: pgmap v20038: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:23:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:47.709+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:23:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:47.710+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:23:47.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:47.710+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:23:47.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:47.710+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:23:47.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:23:47.710+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:23:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:48 smithi136 ceph-mon[125702]: pgmap v20039: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:48 smithi057 ceph-mon[92072]: pgmap v20039: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:48 smithi122 ceph-mon[125440]: pgmap v20039: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:50.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:50 smithi136 ceph-mon[125702]: pgmap v20040: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:50 smithi057 ceph-mon[92072]: pgmap v20040: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:50 smithi122 ceph-mon[125440]: pgmap v20040: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:52.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:52 smithi136 ceph-mon[125702]: pgmap v20041: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:52 smithi057 ceph-mon[92072]: pgmap v20041: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:52 smithi122 ceph-mon[125440]: pgmap v20041: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:54.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:54 smithi136 ceph-mon[125702]: pgmap v20042: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:54 smithi057 ceph-mon[92072]: pgmap v20042: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:54 smithi122 ceph-mon[125440]: pgmap v20042: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:55 smithi136 ceph-mon[125702]: pgmap v20043: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:55 smithi057 ceph-mon[92072]: pgmap v20043: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:55 smithi122 ceph-mon[125440]: pgmap v20043: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:23:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:23:58 smithi136 ceph-mon[125702]: pgmap v20044: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:23:58 smithi057 ceph-mon[92072]: pgmap v20044: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:23:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:23:58 smithi122 ceph-mon[125440]: pgmap v20044: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:00.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:00 smithi136 ceph-mon[125702]: pgmap v20045: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:00 smithi057 ceph-mon[92072]: pgmap v20045: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:00 smithi122 ceph-mon[125440]: pgmap v20045: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:02.722+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:24:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:02.723+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:24:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:02.723+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:24:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:02.723+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:24:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:02.723+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:24:02.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:02 smithi136 ceph-mon[125702]: pgmap v20046: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:02 smithi057 ceph-mon[92072]: pgmap v20046: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:02 smithi122 ceph-mon[125440]: pgmap v20046: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:04.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:04 smithi136 ceph-mon[125702]: pgmap v20047: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:24:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:04 smithi057 ceph-mon[92072]: pgmap v20047: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:24:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:04 smithi122 ceph-mon[125440]: pgmap v20047: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:24:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:05 smithi122 ceph-mon[125440]: pgmap v20048: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:24:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:05 smithi136 ceph-mon[125702]: pgmap v20048: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:24:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:05 smithi057 ceph-mon[92072]: pgmap v20048: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:24:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:07 smithi136 ceph-mon[125702]: osdmap e1326: 12 total, 12 up, 12 in 2023-03-02T21:24:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:07 smithi136 ceph-mon[125702]: pgmap v20050: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:24:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:07 smithi057 ceph-mon[92072]: osdmap e1326: 12 total, 12 up, 12 in 2023-03-02T21:24:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:07 smithi057 ceph-mon[92072]: pgmap v20050: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:24:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:07 smithi122 ceph-mon[125440]: osdmap e1326: 12 total, 12 up, 12 in 2023-03-02T21:24:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:07 smithi122 ceph-mon[125440]: pgmap v20050: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:24:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:10 smithi136 ceph-mon[125702]: pgmap v20051: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:24:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:10 smithi057 ceph-mon[92072]: pgmap v20051: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:24:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:10 smithi122 ceph-mon[125440]: pgmap v20051: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:24:12.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:12 smithi136 ceph-mon[125702]: pgmap v20052: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:24:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:12 smithi057 ceph-mon[92072]: pgmap v20052: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:24:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:12 smithi122 ceph-mon[125440]: pgmap v20052: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:24:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:14 smithi136 ceph-mon[125702]: pgmap v20053: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:24:14.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:14 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:24:14.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:14 smithi057 ceph-mon[92072]: pgmap v20053: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:24:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:14 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:24:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:14 smithi122 ceph-mon[125440]: pgmap v20053: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:24:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:14 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:24:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:15 smithi122 ceph-mon[125440]: osdmap e1327: 12 total, 12 up, 12 in 2023-03-02T21:24:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:15 smithi122 ceph-mon[125440]: pgmap v20055: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:24:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:15 smithi136 ceph-mon[125702]: osdmap e1327: 12 total, 12 up, 12 in 2023-03-02T21:24:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:15 smithi136 ceph-mon[125702]: pgmap v20055: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:24:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:15 smithi057 ceph-mon[92072]: osdmap e1327: 12 total, 12 up, 12 in 2023-03-02T21:24:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:15 smithi057 ceph-mon[92072]: pgmap v20055: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:24:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:17.723+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:24:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:17.724+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:24:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:17.724+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:24:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:17.724+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:24:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:17.724+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:24:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: pgmap v20056: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:24:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:24:18.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:24:18.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:18 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: pgmap v20056: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:24:18.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:24:18.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:24:18.687 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:18 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: pgmap v20056: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:24:18.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:24:18.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:24:18.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:24:18.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:18 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:24:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:19 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:24:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:19 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:24:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:19 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:24:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:19 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:24:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:19 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:24:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:19 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:24:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:19 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:24:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:19 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:24:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:19 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:24:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:19 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:24:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:19 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:24:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:19 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:24:20.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:20 smithi136 ceph-mon[125702]: pgmap v20057: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:24:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:20 smithi057 ceph-mon[92072]: pgmap v20057: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:24:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:20 smithi122 ceph-mon[125440]: pgmap v20057: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:24:22.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:22 smithi136 ceph-mon[125702]: pgmap v20058: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:24:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:22 smithi057 ceph-mon[92072]: pgmap v20058: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:24:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:22 smithi122 ceph-mon[125440]: pgmap v20058: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:24:24.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:24 smithi136 ceph-mon[125702]: pgmap v20059: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:24:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:24 smithi057 ceph-mon[92072]: pgmap v20059: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:24:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:24 smithi122 ceph-mon[125440]: pgmap v20059: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:24:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:25 smithi136 ceph-mon[125702]: pgmap v20060: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:24:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:25 smithi057 ceph-mon[92072]: pgmap v20060: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:24:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:25 smithi122 ceph-mon[125440]: pgmap v20060: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:24:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:28 smithi136 ceph-mon[125702]: pgmap v20061: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:28 smithi057 ceph-mon[92072]: pgmap v20061: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:28 smithi122 ceph-mon[125440]: pgmap v20061: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:30.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:30 smithi136 ceph-mon[125702]: pgmap v20062: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:30 smithi057 ceph-mon[92072]: pgmap v20062: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:30 smithi122 ceph-mon[125440]: pgmap v20062: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:32.740+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:24:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:32.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:24:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:32.741+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:24:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:32.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:24:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:32.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:24:32.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:32 smithi136 ceph-mon[125702]: pgmap v20063: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:32 smithi057 ceph-mon[92072]: pgmap v20063: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:32 smithi122 ceph-mon[125440]: pgmap v20063: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:34.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:34 smithi136 ceph-mon[125702]: pgmap v20064: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:34 smithi057 ceph-mon[92072]: pgmap v20064: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:34 smithi122 ceph-mon[125440]: pgmap v20064: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:35 smithi136 ceph-mon[125702]: pgmap v20065: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:35 smithi057 ceph-mon[92072]: pgmap v20065: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:35 smithi122 ceph-mon[125440]: pgmap v20065: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:38.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:38 smithi136 ceph-mon[125702]: pgmap v20066: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:38 smithi057 ceph-mon[92072]: pgmap v20066: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:38 smithi122 ceph-mon[125440]: pgmap v20066: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:40.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:40 smithi136 ceph-mon[125702]: pgmap v20067: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:40 smithi057 ceph-mon[92072]: pgmap v20067: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:40 smithi122 ceph-mon[125440]: pgmap v20067: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:42 smithi057 ceph-mon[92072]: pgmap v20068: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:42 smithi122 ceph-mon[125440]: pgmap v20068: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:42 smithi136 ceph-mon[125702]: pgmap v20068: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:44 smithi057 ceph-mon[92072]: pgmap v20069: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:44 smithi122 ceph-mon[125440]: pgmap v20069: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:44 smithi136 ceph-mon[125702]: pgmap v20069: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:45 smithi136 ceph-mon[125702]: pgmap v20070: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:45 smithi057 ceph-mon[92072]: pgmap v20070: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:45 smithi122 ceph-mon[125440]: pgmap v20070: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:47.751 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:47.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:24:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:47.750+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:24:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:47.750+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:24:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:47.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:24:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:24:47.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:24:48.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:48 smithi136 ceph-mon[125702]: pgmap v20071: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:48 smithi057 ceph-mon[92072]: pgmap v20071: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:48 smithi122 ceph-mon[125440]: pgmap v20071: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:50 smithi057 ceph-mon[92072]: pgmap v20072: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:50 smithi122 ceph-mon[125440]: pgmap v20072: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:50 smithi136 ceph-mon[125702]: pgmap v20072: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:52 smithi057 ceph-mon[92072]: pgmap v20073: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:52 smithi122 ceph-mon[125440]: pgmap v20073: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:52 smithi136 ceph-mon[125702]: pgmap v20073: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:54 smithi057 ceph-mon[92072]: pgmap v20074: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:54 smithi122 ceph-mon[125440]: pgmap v20074: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:54 smithi136 ceph-mon[125702]: pgmap v20074: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:55 smithi136 ceph-mon[125702]: pgmap v20075: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:55 smithi057 ceph-mon[92072]: pgmap v20075: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:55 smithi122 ceph-mon[125440]: pgmap v20075: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:24:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:24:58 smithi136 ceph-mon[125702]: pgmap v20076: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:24:58 smithi057 ceph-mon[92072]: pgmap v20076: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:24:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:24:58 smithi122 ceph-mon[125440]: pgmap v20076: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:00 smithi057 ceph-mon[92072]: pgmap v20077: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:00 smithi122 ceph-mon[125440]: pgmap v20077: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:01.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:00 smithi136 ceph-mon[125702]: pgmap v20077: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:02.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:25:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:02.766+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:25:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:02.766+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:25:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:02.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:25:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:02.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:25:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:02 smithi057 ceph-mon[92072]: pgmap v20078: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:02 smithi122 ceph-mon[125440]: pgmap v20078: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:02 smithi136 ceph-mon[125702]: pgmap v20078: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:04 smithi057 ceph-mon[92072]: pgmap v20079: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:25:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:04 smithi122 ceph-mon[125440]: pgmap v20079: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:25:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:04 smithi136 ceph-mon[125702]: pgmap v20079: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:25:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:05 smithi136 ceph-mon[125702]: pgmap v20080: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:25:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:05 smithi057 ceph-mon[92072]: pgmap v20080: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:25:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:05 smithi122 ceph-mon[125440]: pgmap v20080: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:25:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:07 smithi136 ceph-mon[125702]: osdmap e1328: 12 total, 12 up, 12 in 2023-03-02T21:25:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:07 smithi136 ceph-mon[125702]: pgmap v20082: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:25:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:07 smithi057 ceph-mon[92072]: osdmap e1328: 12 total, 12 up, 12 in 2023-03-02T21:25:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:07 smithi057 ceph-mon[92072]: pgmap v20082: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:25:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:07 smithi122 ceph-mon[125440]: osdmap e1328: 12 total, 12 up, 12 in 2023-03-02T21:25:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:07 smithi122 ceph-mon[125440]: pgmap v20082: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:25:10.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:10 smithi136 ceph-mon[125702]: pgmap v20083: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:25:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:10 smithi057 ceph-mon[92072]: pgmap v20083: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:25:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:10 smithi122 ceph-mon[125440]: pgmap v20083: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:25:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:12 smithi057 ceph-mon[92072]: pgmap v20084: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:25:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:12 smithi122 ceph-mon[125440]: pgmap v20084: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:25:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:12 smithi136 ceph-mon[125702]: pgmap v20084: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:25:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:14 smithi057 ceph-mon[92072]: pgmap v20085: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:25:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:14 smithi122 ceph-mon[125440]: pgmap v20085: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:25:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:14 smithi136 ceph-mon[125702]: pgmap v20085: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:25:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:15 smithi136 ceph-mon[125702]: osdmap e1329: 12 total, 12 up, 12 in 2023-03-02T21:25:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:15 smithi136 ceph-mon[125702]: pgmap v20087: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:25:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:15 smithi057 ceph-mon[92072]: osdmap e1329: 12 total, 12 up, 12 in 2023-03-02T21:25:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:15 smithi057 ceph-mon[92072]: pgmap v20087: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:25:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:15 smithi122 ceph-mon[125440]: osdmap e1329: 12 total, 12 up, 12 in 2023-03-02T21:25:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:15 smithi122 ceph-mon[125440]: pgmap v20087: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:25:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:17.781+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:25:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:17.781+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:25:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:17.781+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:25:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:17.781+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:25:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:17.781+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:25:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:18 smithi057 ceph-mon[92072]: pgmap v20088: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:25:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:18 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:25:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:18 smithi122 ceph-mon[125440]: pgmap v20088: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:25:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:18 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:25:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:18 smithi136 ceph-mon[125702]: pgmap v20088: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:25:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:18 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:25:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:25:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:25:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:25:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:25:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:25:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:25:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:25:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:25:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:25:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:20 smithi057 ceph-mon[92072]: pgmap v20089: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:25:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:20 smithi122 ceph-mon[125440]: pgmap v20089: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:25:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:20 smithi136 ceph-mon[125702]: pgmap v20089: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:25:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:22 smithi057 ceph-mon[92072]: pgmap v20090: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:25:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:22 smithi122 ceph-mon[125440]: pgmap v20090: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:25:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:22 smithi136 ceph-mon[125702]: pgmap v20090: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:25:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:24 smithi057 ceph-mon[92072]: pgmap v20091: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:25:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:24 smithi122 ceph-mon[125440]: pgmap v20091: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:25:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:24 smithi136 ceph-mon[125702]: pgmap v20091: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:25:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:25 smithi136 ceph-mon[125702]: pgmap v20092: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:25:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:25 smithi057 ceph-mon[92072]: pgmap v20092: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:25:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:25 smithi122 ceph-mon[125440]: pgmap v20092: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:25:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:28 smithi057 ceph-mon[92072]: pgmap v20093: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:28 smithi122 ceph-mon[125440]: pgmap v20093: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:28 smithi136 ceph-mon[125702]: pgmap v20093: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:30 smithi057 ceph-mon[92072]: pgmap v20094: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:30 smithi122 ceph-mon[125440]: pgmap v20094: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:30 smithi136 ceph-mon[125702]: pgmap v20094: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:32.795+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:25:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:32.795+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:25:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:32.795+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:25:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:32.795+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:25:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:32.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:25:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:32 smithi057 ceph-mon[92072]: pgmap v20095: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:32 smithi122 ceph-mon[125440]: pgmap v20095: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:32 smithi136 ceph-mon[125702]: pgmap v20095: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:34 smithi057 ceph-mon[92072]: pgmap v20096: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:34 smithi122 ceph-mon[125440]: pgmap v20096: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:34 smithi136 ceph-mon[125702]: pgmap v20096: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:35 smithi136 ceph-mon[125702]: pgmap v20097: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:35 smithi057 ceph-mon[92072]: pgmap v20097: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:35 smithi122 ceph-mon[125440]: pgmap v20097: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:38 smithi057 ceph-mon[92072]: pgmap v20098: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:38 smithi122 ceph-mon[125440]: pgmap v20098: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:38 smithi136 ceph-mon[125702]: pgmap v20098: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:40 smithi057 ceph-mon[92072]: pgmap v20099: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:40 smithi122 ceph-mon[125440]: pgmap v20099: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:40 smithi136 ceph-mon[125702]: pgmap v20099: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:42 smithi057 ceph-mon[92072]: pgmap v20100: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:42 smithi122 ceph-mon[125440]: pgmap v20100: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:42 smithi136 ceph-mon[125702]: pgmap v20100: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:44 smithi057 ceph-mon[92072]: pgmap v20101: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:44 smithi122 ceph-mon[125440]: pgmap v20101: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:44 smithi136 ceph-mon[125702]: pgmap v20101: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:45 smithi136 ceph-mon[125702]: pgmap v20102: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:45 smithi057 ceph-mon[92072]: pgmap v20102: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:45 smithi122 ceph-mon[125440]: pgmap v20102: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:47.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:25:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:47.808+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:25:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:47.808+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:25:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:47.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:25:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:25:47.808+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:25:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:48 smithi057 ceph-mon[92072]: pgmap v20103: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:48 smithi122 ceph-mon[125440]: pgmap v20103: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:48 smithi136 ceph-mon[125702]: pgmap v20103: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:50 smithi057 ceph-mon[92072]: pgmap v20104: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:50 smithi122 ceph-mon[125440]: pgmap v20104: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:50 smithi136 ceph-mon[125702]: pgmap v20104: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:52 smithi057 ceph-mon[92072]: pgmap v20105: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:52 smithi122 ceph-mon[125440]: pgmap v20105: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:52 smithi136 ceph-mon[125702]: pgmap v20105: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:54 smithi057 ceph-mon[92072]: pgmap v20106: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:54 smithi122 ceph-mon[125440]: pgmap v20106: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:54 smithi136 ceph-mon[125702]: pgmap v20106: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:55 smithi136 ceph-mon[125702]: pgmap v20107: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:55 smithi057 ceph-mon[92072]: pgmap v20107: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:55 smithi122 ceph-mon[125440]: pgmap v20107: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:25:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:25:58 smithi057 ceph-mon[92072]: pgmap v20108: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:25:58 smithi122 ceph-mon[125440]: pgmap v20108: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:25:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:25:58 smithi136 ceph-mon[125702]: pgmap v20108: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:00 smithi057 ceph-mon[92072]: pgmap v20109: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:00 smithi122 ceph-mon[125440]: pgmap v20109: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:00 smithi136 ceph-mon[125702]: pgmap v20109: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:02.824+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:26:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:02.824+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:26:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:02.824+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:26:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:02.824+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:26:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:02.824+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:26:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:02 smithi057 ceph-mon[92072]: pgmap v20110: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:02 smithi122 ceph-mon[125440]: pgmap v20110: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:02 smithi136 ceph-mon[125702]: pgmap v20110: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:04 smithi057 ceph-mon[92072]: pgmap v20111: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:26:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:04 smithi122 ceph-mon[125440]: pgmap v20111: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:26:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:04 smithi136 ceph-mon[125702]: pgmap v20111: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:26:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:05 smithi136 ceph-mon[125702]: pgmap v20112: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:26:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:05 smithi057 ceph-mon[92072]: pgmap v20112: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:26:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:05 smithi122 ceph-mon[125440]: pgmap v20112: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:26:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:08 smithi057 ceph-mon[92072]: pgmap v20113: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:26:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:08 smithi122 ceph-mon[125440]: pgmap v20113: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:26:09.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:08 smithi136 ceph-mon[125702]: pgmap v20113: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:26:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:10 smithi057 ceph-mon[92072]: pgmap v20114: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:26:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:10 smithi122 ceph-mon[125440]: pgmap v20114: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:26:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:10 smithi136 ceph-mon[125702]: pgmap v20114: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:26:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:12 smithi057 ceph-mon[92072]: pgmap v20115: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:26:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:12 smithi057 ceph-mon[92072]: osdmap e1330: 12 total, 12 up, 12 in 2023-03-02T21:26:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:12 smithi122 ceph-mon[125440]: pgmap v20115: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:26:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:12 smithi122 ceph-mon[125440]: osdmap e1330: 12 total, 12 up, 12 in 2023-03-02T21:26:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:12 smithi136 ceph-mon[125702]: pgmap v20115: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:26:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:12 smithi136 ceph-mon[125702]: osdmap e1330: 12 total, 12 up, 12 in 2023-03-02T21:26:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:13.813+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:26:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:13.813+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:26:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:13.813+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 289 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:26:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:13.813+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:26:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:13.813+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 290 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:26:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:13.813+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:26:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:13.813+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 290 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:26:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:13.814+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 291 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:26:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:14 smithi057 ceph-mon[92072]: pgmap v20117: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:14 smithi122 ceph-mon[125440]: pgmap v20117: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:14 smithi136 ceph-mon[125702]: pgmap v20117: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:15 smithi136 ceph-mon[125702]: pgmap v20118: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:15 smithi057 ceph-mon[92072]: pgmap v20118: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:15 smithi122 ceph-mon[125440]: pgmap v20118: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:17.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:26:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:17.840+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:26:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:17.840+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:26:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:17.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:26:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:17.840+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:26:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:18 smithi057 ceph-mon[92072]: pgmap v20119: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:26:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:18 smithi122 ceph-mon[125440]: pgmap v20119: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:26:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:18 smithi136 ceph-mon[125702]: pgmap v20119: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:26:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:26:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:26:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:26:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:20 smithi136 ceph-mon[125702]: pgmap v20120: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:26:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:26:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:26:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:20 smithi136 ceph-mon[125702]: osdmap e1331: 12 total, 12 up, 12 in 2023-03-02T21:26:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:26:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:26:21.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:26:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:20 smithi057 ceph-mon[92072]: pgmap v20120: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:26:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:26:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:26:21.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:20 smithi057 ceph-mon[92072]: osdmap e1331: 12 total, 12 up, 12 in 2023-03-02T21:26:21.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:26:21.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:26:21.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:26:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:20 smithi122 ceph-mon[125440]: pgmap v20120: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-02T21:26:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:26:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:26:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:20 smithi122 ceph-mon[125440]: osdmap e1331: 12 total, 12 up, 12 in 2023-03-02T21:26:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:26:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:26:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:26:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:22 smithi136 ceph-mon[125702]: pgmap v20122: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T21:26:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:22 smithi057 ceph-mon[92072]: pgmap v20122: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T21:26:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:22 smithi122 ceph-mon[125440]: pgmap v20122: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2023-03-02T21:26:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:24 smithi136 ceph-mon[125702]: pgmap v20123: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:24 smithi057 ceph-mon[92072]: pgmap v20123: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:24 smithi122 ceph-mon[125440]: pgmap v20123: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:25 smithi136 ceph-mon[125702]: pgmap v20124: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:25 smithi057 ceph-mon[92072]: pgmap v20124: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:25 smithi122 ceph-mon[125440]: pgmap v20124: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:26:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:28 smithi057 ceph-mon[92072]: pgmap v20125: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:26:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:28 smithi122 ceph-mon[125440]: pgmap v20125: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:26:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:28 smithi136 ceph-mon[125702]: pgmap v20125: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:26:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:30 smithi057 ceph-mon[92072]: pgmap v20126: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:26:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:30 smithi122 ceph-mon[125440]: pgmap v20126: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:26:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:30 smithi136 ceph-mon[125702]: pgmap v20126: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:26:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:32.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:26:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:32.841+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:26:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:32.841+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:26:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:32.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:26:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:32.841+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:26:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:32 smithi057 ceph-mon[92072]: pgmap v20127: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T21:26:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:32 smithi122 ceph-mon[125440]: pgmap v20127: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T21:26:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:32 smithi136 ceph-mon[125702]: pgmap v20127: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-02T21:26:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:34 smithi057 ceph-mon[92072]: pgmap v20128: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:34 smithi122 ceph-mon[125440]: pgmap v20128: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:34 smithi136 ceph-mon[125702]: pgmap v20128: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:35 smithi136 ceph-mon[125702]: pgmap v20129: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:35 smithi057 ceph-mon[92072]: pgmap v20129: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:35 smithi122 ceph-mon[125440]: pgmap v20129: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:38 smithi057 ceph-mon[92072]: pgmap v20130: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:38 smithi122 ceph-mon[125440]: pgmap v20130: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:38 smithi136 ceph-mon[125702]: pgmap v20130: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:40 smithi057 ceph-mon[92072]: pgmap v20131: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:40 smithi122 ceph-mon[125440]: pgmap v20131: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:40 smithi136 ceph-mon[125702]: pgmap v20131: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:42 smithi057 ceph-mon[92072]: pgmap v20132: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:42 smithi122 ceph-mon[125440]: pgmap v20132: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:42 smithi136 ceph-mon[125702]: pgmap v20132: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:44 smithi057 ceph-mon[92072]: pgmap v20133: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:44 smithi122 ceph-mon[125440]: pgmap v20133: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:44 smithi136 ceph-mon[125702]: pgmap v20133: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:46 smithi136 ceph-mon[125702]: pgmap v20134: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:46 smithi057 ceph-mon[92072]: pgmap v20134: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:46 smithi122 ceph-mon[125440]: pgmap v20134: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:47.859 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:47.857+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:26:47.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:47.858+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:26:47.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:47.858+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:26:47.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:47.858+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:26:47.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:26:47.858+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:26:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:48 smithi057 ceph-mon[92072]: pgmap v20135: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:48 smithi122 ceph-mon[125440]: pgmap v20135: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:48 smithi136 ceph-mon[125702]: pgmap v20135: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:50 smithi057 ceph-mon[92072]: pgmap v20136: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:50 smithi122 ceph-mon[125440]: pgmap v20136: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:50 smithi136 ceph-mon[125702]: pgmap v20136: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:52 smithi057 ceph-mon[92072]: pgmap v20137: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:52 smithi122 ceph-mon[125440]: pgmap v20137: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:52 smithi136 ceph-mon[125702]: pgmap v20137: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:54 smithi057 ceph-mon[92072]: pgmap v20138: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:54 smithi122 ceph-mon[125440]: pgmap v20138: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:54 smithi136 ceph-mon[125702]: pgmap v20138: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:55 smithi136 ceph-mon[125702]: pgmap v20139: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:55 smithi057 ceph-mon[92072]: pgmap v20139: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:55 smithi122 ceph-mon[125440]: pgmap v20139: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:26:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:26:58 smithi057 ceph-mon[92072]: pgmap v20140: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:26:58 smithi122 ceph-mon[125440]: pgmap v20140: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:26:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:26:58 smithi136 ceph-mon[125702]: pgmap v20140: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:00 smithi057 ceph-mon[92072]: pgmap v20141: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:00 smithi122 ceph-mon[125440]: pgmap v20141: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:00 smithi136 ceph-mon[125702]: pgmap v20141: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:02.865+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:27:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:02.866+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:27:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:02.866+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:27:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:02.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:27:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:02.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:27:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:02 smithi057 ceph-mon[92072]: pgmap v20142: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:02 smithi122 ceph-mon[125440]: pgmap v20142: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:02 smithi136 ceph-mon[125702]: pgmap v20142: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:04 smithi057 ceph-mon[92072]: pgmap v20143: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:27:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:04 smithi122 ceph-mon[125440]: pgmap v20143: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:27:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:04 smithi136 ceph-mon[125702]: pgmap v20143: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:27:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:06 smithi136 ceph-mon[125702]: pgmap v20144: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:27:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:06 smithi057 ceph-mon[92072]: pgmap v20144: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:27:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:06 smithi122 ceph-mon[125440]: pgmap v20144: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:27:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:08 smithi136 ceph-mon[125702]: osdmap e1332: 12 total, 12 up, 12 in 2023-03-02T21:27:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:08 smithi136 ceph-mon[125702]: pgmap v20146: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:27:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:08 smithi057 ceph-mon[92072]: osdmap e1332: 12 total, 12 up, 12 in 2023-03-02T21:27:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:08 smithi057 ceph-mon[92072]: pgmap v20146: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:27:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:08 smithi122 ceph-mon[125440]: osdmap e1332: 12 total, 12 up, 12 in 2023-03-02T21:27:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:08 smithi122 ceph-mon[125440]: pgmap v20146: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:27:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:10 smithi057 ceph-mon[92072]: pgmap v20147: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:27:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:10 smithi122 ceph-mon[125440]: pgmap v20147: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:27:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:10 smithi136 ceph-mon[125702]: pgmap v20147: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:27:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:12 smithi057 ceph-mon[92072]: pgmap v20148: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:27:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:12 smithi122 ceph-mon[125440]: pgmap v20148: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:27:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:12 smithi136 ceph-mon[125702]: pgmap v20148: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:27:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:14 smithi057 ceph-mon[92072]: pgmap v20149: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:27:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:14 smithi122 ceph-mon[125440]: pgmap v20149: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:27:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:14 smithi136 ceph-mon[125702]: pgmap v20149: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:27:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:16 smithi136 ceph-mon[125702]: osdmap e1333: 12 total, 12 up, 12 in 2023-03-02T21:27:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:16 smithi136 ceph-mon[125702]: pgmap v20151: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:27:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:16 smithi057 ceph-mon[92072]: osdmap e1333: 12 total, 12 up, 12 in 2023-03-02T21:27:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:16 smithi057 ceph-mon[92072]: pgmap v20151: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:27:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:16 smithi122 ceph-mon[125440]: osdmap e1333: 12 total, 12 up, 12 in 2023-03-02T21:27:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:16 smithi122 ceph-mon[125440]: pgmap v20151: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:27:17.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:17.872+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:27:17.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:17.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:27:17.874 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:17.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:27:17.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:17.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:27:17.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:17.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:27:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:18 smithi057 ceph-mon[92072]: pgmap v20152: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:27:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:18 smithi122 ceph-mon[125440]: pgmap v20152: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:27:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:18 smithi136 ceph-mon[125702]: pgmap v20152: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:27:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:20 smithi057 ceph-mon[92072]: pgmap v20153: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:27:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:20 smithi122 ceph-mon[125440]: pgmap v20153: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:27:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:20 smithi136 ceph-mon[125702]: pgmap v20153: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:27:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:27:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:21.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:27:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:21.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:27:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:22 smithi057 ceph-mon[92072]: pgmap v20154: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:27:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:27:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:27:22.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:22 smithi122 ceph-mon[125440]: pgmap v20154: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:27:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:27:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:27:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:22 smithi136 ceph-mon[125702]: pgmap v20154: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:27:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:27:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:27:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:27:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:24 smithi057 ceph-mon[92072]: pgmap v20155: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:27:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:24 smithi122 ceph-mon[125440]: pgmap v20155: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:27:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:24 smithi136 ceph-mon[125702]: pgmap v20155: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:27:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:26 smithi136 ceph-mon[125702]: pgmap v20156: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:27:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:26 smithi057 ceph-mon[92072]: pgmap v20156: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:27:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:26 smithi122 ceph-mon[125440]: pgmap v20156: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:27:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:28 smithi057 ceph-mon[92072]: pgmap v20157: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:28 smithi122 ceph-mon[125440]: pgmap v20157: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:28 smithi136 ceph-mon[125702]: pgmap v20157: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:30 smithi057 ceph-mon[92072]: pgmap v20158: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:30 smithi122 ceph-mon[125440]: pgmap v20158: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:30 smithi136 ceph-mon[125702]: pgmap v20158: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:32.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:27:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:32.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:27:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:32.888+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:27:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:32.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:27:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:32.888+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:27:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:32 smithi057 ceph-mon[92072]: pgmap v20159: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:32 smithi122 ceph-mon[125440]: pgmap v20159: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:32 smithi136 ceph-mon[125702]: pgmap v20159: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:34 smithi057 ceph-mon[92072]: pgmap v20160: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:34 smithi122 ceph-mon[125440]: pgmap v20160: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:34 smithi136 ceph-mon[125702]: pgmap v20160: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:36 smithi136 ceph-mon[125702]: pgmap v20161: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:36 smithi057 ceph-mon[92072]: pgmap v20161: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:36 smithi122 ceph-mon[125440]: pgmap v20161: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:38 smithi057 ceph-mon[92072]: pgmap v20162: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:38 smithi122 ceph-mon[125440]: pgmap v20162: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:38 smithi136 ceph-mon[125702]: pgmap v20162: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:40 smithi057 ceph-mon[92072]: pgmap v20163: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:40 smithi122 ceph-mon[125440]: pgmap v20163: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:40 smithi136 ceph-mon[125702]: pgmap v20163: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:42 smithi057 ceph-mon[92072]: pgmap v20164: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:42 smithi122 ceph-mon[125440]: pgmap v20164: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:42 smithi136 ceph-mon[125702]: pgmap v20164: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:44 smithi057 ceph-mon[92072]: pgmap v20165: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:44 smithi122 ceph-mon[125440]: pgmap v20165: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:44 smithi136 ceph-mon[125702]: pgmap v20165: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:46 smithi136 ceph-mon[125702]: pgmap v20166: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:46 smithi057 ceph-mon[92072]: pgmap v20166: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:46 smithi122 ceph-mon[125440]: pgmap v20166: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:47.904+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:27:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:47.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:27:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:47.905+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:27:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:47.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:27:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:27:47.905+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:27:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:48 smithi057 ceph-mon[92072]: pgmap v20167: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:48 smithi122 ceph-mon[125440]: pgmap v20167: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:48 smithi136 ceph-mon[125702]: pgmap v20167: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:50 smithi057 ceph-mon[92072]: pgmap v20168: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:50 smithi122 ceph-mon[125440]: pgmap v20168: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:50 smithi136 ceph-mon[125702]: pgmap v20168: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:52 smithi057 ceph-mon[92072]: pgmap v20169: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:52 smithi122 ceph-mon[125440]: pgmap v20169: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:52 smithi136 ceph-mon[125702]: pgmap v20169: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:54 smithi057 ceph-mon[92072]: pgmap v20170: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:54 smithi122 ceph-mon[125440]: pgmap v20170: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:54 smithi136 ceph-mon[125702]: pgmap v20170: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:56 smithi136 ceph-mon[125702]: pgmap v20171: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:56 smithi057 ceph-mon[92072]: pgmap v20171: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:56 smithi122 ceph-mon[125440]: pgmap v20171: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:27:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:27:58 smithi057 ceph-mon[92072]: pgmap v20172: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:27:58 smithi122 ceph-mon[125440]: pgmap v20172: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:27:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:27:58 smithi136 ceph-mon[125702]: pgmap v20172: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:00 smithi057 ceph-mon[92072]: pgmap v20173: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:00 smithi122 ceph-mon[125440]: pgmap v20173: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:00 smithi136 ceph-mon[125702]: pgmap v20173: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:02.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:02.908+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:28:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:02.908+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:28:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:02.908+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:28:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:02.908+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:28:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:02.908+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:28:02.932 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:02 smithi057 ceph-mon[92072]: pgmap v20174: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:02 smithi122 ceph-mon[125440]: pgmap v20174: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:02 smithi136 ceph-mon[125702]: pgmap v20174: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:04 smithi057 ceph-mon[92072]: pgmap v20175: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:28:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:04 smithi122 ceph-mon[125440]: pgmap v20175: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:28:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:04 smithi136 ceph-mon[125702]: pgmap v20175: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:28:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:06 smithi136 ceph-mon[125702]: pgmap v20176: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:28:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:06 smithi057 ceph-mon[92072]: pgmap v20176: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:28:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:06 smithi122 ceph-mon[125440]: pgmap v20176: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:28:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:08 smithi136 ceph-mon[125702]: osdmap e1334: 12 total, 12 up, 12 in 2023-03-02T21:28:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:08 smithi136 ceph-mon[125702]: pgmap v20178: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:28:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:08 smithi057 ceph-mon[92072]: osdmap e1334: 12 total, 12 up, 12 in 2023-03-02T21:28:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:08 smithi057 ceph-mon[92072]: pgmap v20178: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:28:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:08 smithi122 ceph-mon[125440]: osdmap e1334: 12 total, 12 up, 12 in 2023-03-02T21:28:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:08 smithi122 ceph-mon[125440]: pgmap v20178: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:28:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:10 smithi057 ceph-mon[92072]: pgmap v20179: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:28:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:10 smithi122 ceph-mon[125440]: pgmap v20179: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:28:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:10 smithi136 ceph-mon[125702]: pgmap v20179: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:28:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:12 smithi057 ceph-mon[92072]: pgmap v20180: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:28:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:12 smithi122 ceph-mon[125440]: pgmap v20180: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:28:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:12 smithi136 ceph-mon[125702]: pgmap v20180: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:28:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:14 smithi057 ceph-mon[92072]: pgmap v20181: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:28:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:14 smithi122 ceph-mon[125440]: pgmap v20181: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:28:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:14 smithi136 ceph-mon[125702]: pgmap v20181: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:28:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:16 smithi136 ceph-mon[125702]: osdmap e1335: 12 total, 12 up, 12 in 2023-03-02T21:28:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:16 smithi136 ceph-mon[125702]: pgmap v20183: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:28:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:16 smithi057 ceph-mon[92072]: osdmap e1335: 12 total, 12 up, 12 in 2023-03-02T21:28:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:16 smithi057 ceph-mon[92072]: pgmap v20183: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:28:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:16 smithi122 ceph-mon[125440]: osdmap e1335: 12 total, 12 up, 12 in 2023-03-02T21:28:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:16 smithi122 ceph-mon[125440]: pgmap v20183: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:28:17.920 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:17.919+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:28:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:17.919+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:28:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:17.919+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:28:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:17.919+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:28:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:17.919+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:28:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:18 smithi057 ceph-mon[92072]: pgmap v20184: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:28:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:18 smithi122 ceph-mon[125440]: pgmap v20184: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:28:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:18 smithi136 ceph-mon[125702]: pgmap v20184: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:28:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:20 smithi057 ceph-mon[92072]: pgmap v20185: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:28:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:20 smithi122 ceph-mon[125440]: pgmap v20185: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:28:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:20 smithi136 ceph-mon[125702]: pgmap v20185: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:28:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:22 smithi057 ceph-mon[92072]: pgmap v20186: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:28:22.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:28:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:22 smithi122 ceph-mon[125440]: pgmap v20186: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:28:22.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:28:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:22 smithi136 ceph-mon[125702]: pgmap v20186: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:28:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:28:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:28:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:28:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:23 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:28:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:28:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:28:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:23 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:28:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:28:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:28:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:23 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:28:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:24 smithi136 ceph-mon[125702]: pgmap v20187: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:28:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:24 smithi057 ceph-mon[92072]: pgmap v20187: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:28:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:24 smithi122 ceph-mon[125440]: pgmap v20187: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:28:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:26 smithi136 ceph-mon[125702]: pgmap v20188: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:28:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:26 smithi057 ceph-mon[92072]: pgmap v20188: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:28:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:26 smithi122 ceph-mon[125440]: pgmap v20188: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:28:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:28 smithi057 ceph-mon[92072]: pgmap v20189: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:28 smithi122 ceph-mon[125440]: pgmap v20189: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:28 smithi136 ceph-mon[125702]: pgmap v20189: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:30 smithi057 ceph-mon[92072]: pgmap v20190: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:30 smithi122 ceph-mon[125440]: pgmap v20190: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:30 smithi136 ceph-mon[125702]: pgmap v20190: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:32 smithi057 ceph-mon[92072]: pgmap v20191: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:32.935 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:32.933+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:28:32.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:32.933+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:28:32.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:32.933+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:28:32.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:32.933+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:28:32.936 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:32.933+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:28:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:32 smithi122 ceph-mon[125440]: pgmap v20191: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:32 smithi136 ceph-mon[125702]: pgmap v20191: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:34 smithi057 ceph-mon[92072]: pgmap v20192: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:34 smithi122 ceph-mon[125440]: pgmap v20192: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:34 smithi136 ceph-mon[125702]: pgmap v20192: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:36 smithi136 ceph-mon[125702]: pgmap v20193: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:36 smithi057 ceph-mon[92072]: pgmap v20193: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:36 smithi122 ceph-mon[125440]: pgmap v20193: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:38 smithi057 ceph-mon[92072]: pgmap v20194: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:38 smithi122 ceph-mon[125440]: pgmap v20194: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:38 smithi136 ceph-mon[125702]: pgmap v20194: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:40 smithi057 ceph-mon[92072]: pgmap v20195: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:40 smithi122 ceph-mon[125440]: pgmap v20195: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:40 smithi136 ceph-mon[125702]: pgmap v20195: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:42 smithi057 ceph-mon[92072]: pgmap v20196: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:42 smithi122 ceph-mon[125440]: pgmap v20196: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:42 smithi136 ceph-mon[125702]: pgmap v20196: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:44.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:44 smithi057 ceph-mon[92072]: pgmap v20197: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:44 smithi122 ceph-mon[125440]: pgmap v20197: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:44 smithi136 ceph-mon[125702]: pgmap v20197: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:46 smithi136 ceph-mon[125702]: pgmap v20198: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:46 smithi057 ceph-mon[92072]: pgmap v20198: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:46 smithi122 ceph-mon[125440]: pgmap v20198: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:47.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:28:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:47.938+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:28:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:47.938+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:28:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:47.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:28:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:28:47.938+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:28:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:48 smithi057 ceph-mon[92072]: pgmap v20199: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:48 smithi122 ceph-mon[125440]: pgmap v20199: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:48 smithi136 ceph-mon[125702]: pgmap v20199: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:50 smithi057 ceph-mon[92072]: pgmap v20200: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:50 smithi122 ceph-mon[125440]: pgmap v20200: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:50 smithi136 ceph-mon[125702]: pgmap v20200: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:52.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:52 smithi057 ceph-mon[92072]: pgmap v20201: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:52 smithi122 ceph-mon[125440]: pgmap v20201: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:52 smithi136 ceph-mon[125702]: pgmap v20201: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:54.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:54 smithi057 ceph-mon[92072]: pgmap v20202: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:54 smithi122 ceph-mon[125440]: pgmap v20202: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:54 smithi136 ceph-mon[125702]: pgmap v20202: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:56 smithi136 ceph-mon[125702]: pgmap v20203: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:56 smithi057 ceph-mon[92072]: pgmap v20203: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:56 smithi122 ceph-mon[125440]: pgmap v20203: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:28:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:28:58 smithi057 ceph-mon[92072]: pgmap v20204: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:28:58 smithi122 ceph-mon[125440]: pgmap v20204: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:28:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:28:58 smithi136 ceph-mon[125702]: pgmap v20204: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:00 smithi057 ceph-mon[92072]: pgmap v20205: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:00 smithi122 ceph-mon[125440]: pgmap v20205: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:00 smithi136 ceph-mon[125702]: pgmap v20205: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:02 smithi057 ceph-mon[92072]: pgmap v20206: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:02.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:02.949+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:29:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:02 smithi122 ceph-mon[125440]: pgmap v20206: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:02.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:02.950+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:29:02.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:02.950+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:29:02.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:02.950+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:29:02.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:02.950+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:29:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:02 smithi136 ceph-mon[125702]: pgmap v20206: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:04 smithi057 ceph-mon[92072]: pgmap v20207: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:29:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:04 smithi122 ceph-mon[125440]: pgmap v20207: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:29:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:04 smithi136 ceph-mon[125702]: pgmap v20207: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:29:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:06 smithi136 ceph-mon[125702]: pgmap v20208: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:29:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:06 smithi057 ceph-mon[92072]: pgmap v20208: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:29:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:06 smithi122 ceph-mon[125440]: pgmap v20208: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:29:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:08 smithi136 ceph-mon[125702]: osdmap e1336: 12 total, 12 up, 12 in 2023-03-02T21:29:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:08 smithi136 ceph-mon[125702]: pgmap v20210: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:29:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:08 smithi057 ceph-mon[92072]: osdmap e1336: 12 total, 12 up, 12 in 2023-03-02T21:29:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:08 smithi057 ceph-mon[92072]: pgmap v20210: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:29:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:08.433+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000209) for more than 900000000 us, fault. 2023-03-02T21:29:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:08.433+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f5870027fb0 tx=0x7f58700b2070 comp rx=0 tx=0).stop 2023-03-02T21:29:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:08.433+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T21:29:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:08.433+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T21:29:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:08.433+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T21:29:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:08.433+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:29:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:08.434+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f58500057f0 tx=0x7f58700a2050 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T21:29:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:08 smithi122 ceph-mon[125440]: osdmap e1336: 12 total, 12 up, 12 in 2023-03-02T21:29:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:08 smithi122 ceph-mon[125440]: pgmap v20210: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:29:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:10 smithi057 ceph-mon[92072]: pgmap v20211: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:29:10.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:10 smithi122 ceph-mon[125440]: pgmap v20211: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:29:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:10 smithi136 ceph-mon[125702]: pgmap v20211: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:29:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:12 smithi057 ceph-mon[92072]: pgmap v20212: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:29:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:12 smithi122 ceph-mon[125440]: pgmap v20212: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:29:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:12 smithi136 ceph-mon[125702]: pgmap v20212: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:29:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:13.839+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:29:13.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:13.839+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:29:13.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:13.839+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 291 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:29:13.841 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:13.840+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 292 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:29:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:14 smithi057 ceph-mon[92072]: pgmap v20213: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:29:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:14 smithi122 ceph-mon[125440]: pgmap v20213: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:29:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:14 smithi136 ceph-mon[125702]: pgmap v20213: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:29:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:16 smithi136 ceph-mon[125702]: osdmap e1337: 12 total, 12 up, 12 in 2023-03-02T21:29:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:16 smithi136 ceph-mon[125702]: pgmap v20215: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:29:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:16 smithi057 ceph-mon[92072]: osdmap e1337: 12 total, 12 up, 12 in 2023-03-02T21:29:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:16 smithi057 ceph-mon[92072]: pgmap v20215: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:29:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:16 smithi122 ceph-mon[125440]: osdmap e1337: 12 total, 12 up, 12 in 2023-03-02T21:29:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:16 smithi122 ceph-mon[125440]: pgmap v20215: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:29:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:17.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:17.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:17.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:17.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:17.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:29:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:18 smithi057 ceph-mon[92072]: pgmap v20216: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:29:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:18 smithi122 ceph-mon[125440]: pgmap v20216: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:29:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:18 smithi136 ceph-mon[125702]: pgmap v20216: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:29:20.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:20 smithi057 ceph-mon[92072]: pgmap v20217: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:29:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:20 smithi122 ceph-mon[125440]: pgmap v20217: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:29:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:20 smithi136 ceph-mon[125702]: pgmap v20217: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:29:22.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:22 smithi057 ceph-mon[92072]: pgmap v20218: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:29:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:22 smithi122 ceph-mon[125440]: pgmap v20218: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:29:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:22 smithi136 ceph-mon[125702]: pgmap v20218: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:29:23.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:29:23.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:29:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:29:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:24 smithi057 ceph-mon[92072]: pgmap v20219: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:29:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:29:24.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:29:24.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:29:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:24 smithi122 ceph-mon[125440]: pgmap v20219: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:29:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:29:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:29:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:29:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:24 smithi136 ceph-mon[125702]: pgmap v20219: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:29:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:29:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:29:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:29:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:26 smithi136 ceph-mon[125702]: pgmap v20220: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:29:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:26 smithi057 ceph-mon[92072]: pgmap v20220: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:29:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:26 smithi122 ceph-mon[125440]: pgmap v20220: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:29:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:28 smithi057 ceph-mon[92072]: pgmap v20221: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:28 smithi122 ceph-mon[125440]: pgmap v20221: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:28 smithi136 ceph-mon[125702]: pgmap v20221: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:30.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:30 smithi057 ceph-mon[92072]: pgmap v20222: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:30 smithi122 ceph-mon[125440]: pgmap v20222: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:30 smithi136 ceph-mon[125702]: pgmap v20222: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:32.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:32 smithi057 ceph-mon[92072]: pgmap v20223: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:32 smithi122 ceph-mon[125440]: pgmap v20223: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:32.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:29:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:32.979+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:29:32.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:32.979+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:29:32.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:32.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:29:32.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:32.979+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:29:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:32 smithi136 ceph-mon[125702]: pgmap v20223: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:34.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:34 smithi057 ceph-mon[92072]: pgmap v20224: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:34 smithi122 ceph-mon[125440]: pgmap v20224: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:34 smithi136 ceph-mon[125702]: pgmap v20224: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:36 smithi136 ceph-mon[125702]: pgmap v20225: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:36 smithi057 ceph-mon[92072]: pgmap v20225: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:36 smithi122 ceph-mon[125440]: pgmap v20225: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:38 smithi057 ceph-mon[92072]: pgmap v20226: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:38 smithi122 ceph-mon[125440]: pgmap v20226: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:38 smithi136 ceph-mon[125702]: pgmap v20226: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:40 smithi057 ceph-mon[92072]: pgmap v20227: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:40 smithi122 ceph-mon[125440]: pgmap v20227: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:40 smithi136 ceph-mon[125702]: pgmap v20227: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:42.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:42 smithi057 ceph-mon[92072]: pgmap v20228: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:42 smithi122 ceph-mon[125440]: pgmap v20228: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:42 smithi136 ceph-mon[125702]: pgmap v20228: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:44 smithi122 ceph-mon[125440]: pgmap v20229: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:44 smithi136 ceph-mon[125702]: pgmap v20229: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:44 smithi057 ceph-mon[92072]: pgmap v20229: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:46 smithi136 ceph-mon[125702]: pgmap v20230: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:46 smithi057 ceph-mon[92072]: pgmap v20230: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:46 smithi122 ceph-mon[125440]: pgmap v20230: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:47.992+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:29:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:47.992+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:29:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:47.992+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:29:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:47.992+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:29:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:29:47.992+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:29:48.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:48 smithi057 ceph-mon[92072]: pgmap v20231: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:48 smithi122 ceph-mon[125440]: pgmap v20231: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:48 smithi136 ceph-mon[125702]: pgmap v20231: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:50.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:50 smithi057 ceph-mon[92072]: pgmap v20232: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:50 smithi122 ceph-mon[125440]: pgmap v20232: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:50 smithi136 ceph-mon[125702]: pgmap v20232: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:52 smithi122 ceph-mon[125440]: pgmap v20233: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:52 smithi136 ceph-mon[125702]: pgmap v20233: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:52 smithi057 ceph-mon[92072]: pgmap v20233: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:54.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:54 smithi122 ceph-mon[125440]: pgmap v20234: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:54 smithi136 ceph-mon[125702]: pgmap v20234: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:54 smithi057 ceph-mon[92072]: pgmap v20234: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:56 smithi136 ceph-mon[125702]: pgmap v20235: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:56 smithi057 ceph-mon[92072]: pgmap v20235: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:56 smithi122 ceph-mon[125440]: pgmap v20235: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:29:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:29:58 smithi057 ceph-mon[92072]: pgmap v20236: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:29:58 smithi122 ceph-mon[125440]: pgmap v20236: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:29:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:29:58 smithi136 ceph-mon[125702]: pgmap v20236: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:00 smithi057 ceph-mon[92072]: pgmap v20237: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:00.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T21:30:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:00 smithi122 ceph-mon[125440]: pgmap v20237: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T21:30:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:00 smithi136 ceph-mon[125702]: pgmap v20237: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T21:30:02.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:02 smithi057 ceph-mon[92072]: pgmap v20238: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:02 smithi122 ceph-mon[125440]: pgmap v20238: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:03.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:30:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:03.003+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:30:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:03.003+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:30:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:03.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:30:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:03.003+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:30:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:02 smithi136 ceph-mon[125702]: pgmap v20238: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:04.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:04 smithi057 ceph-mon[92072]: pgmap v20239: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:30:04.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:04 smithi122 ceph-mon[125440]: pgmap v20239: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:30:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:04 smithi136 ceph-mon[125702]: pgmap v20239: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:30:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:06 smithi136 ceph-mon[125702]: pgmap v20240: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:30:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:06 smithi057 ceph-mon[92072]: pgmap v20240: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:30:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:06 smithi122 ceph-mon[125440]: pgmap v20240: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:30:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:08 smithi136 ceph-mon[125702]: osdmap e1338: 12 total, 12 up, 12 in 2023-03-02T21:30:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:08 smithi136 ceph-mon[125702]: pgmap v20242: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:30:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:08 smithi057 ceph-mon[92072]: osdmap e1338: 12 total, 12 up, 12 in 2023-03-02T21:30:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:08 smithi057 ceph-mon[92072]: pgmap v20242: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:30:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:08 smithi122 ceph-mon[125440]: osdmap e1338: 12 total, 12 up, 12 in 2023-03-02T21:30:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:08 smithi122 ceph-mon[125440]: pgmap v20242: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:30:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:10 smithi057 ceph-mon[92072]: pgmap v20243: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:30:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:10 smithi122 ceph-mon[125440]: pgmap v20243: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:30:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:10 smithi136 ceph-mon[125702]: pgmap v20243: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:30:12.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:12 smithi057 ceph-mon[92072]: pgmap v20244: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:30:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:12 smithi122 ceph-mon[125440]: pgmap v20244: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:30:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:12 smithi136 ceph-mon[125702]: pgmap v20244: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:30:14.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:14 smithi057 ceph-mon[92072]: pgmap v20245: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T21:30:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:14 smithi122 ceph-mon[125440]: pgmap v20245: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T21:30:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:14 smithi136 ceph-mon[125702]: pgmap v20245: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-02T21:30:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:16 smithi136 ceph-mon[125702]: osdmap e1339: 12 total, 12 up, 12 in 2023-03-02T21:30:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:16 smithi136 ceph-mon[125702]: pgmap v20247: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 119 B/s wr, 5 op/s 2023-03-02T21:30:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:16 smithi057 ceph-mon[92072]: osdmap e1339: 12 total, 12 up, 12 in 2023-03-02T21:30:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:16 smithi057 ceph-mon[92072]: pgmap v20247: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 119 B/s wr, 5 op/s 2023-03-02T21:30:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:16 smithi122 ceph-mon[125440]: osdmap e1339: 12 total, 12 up, 12 in 2023-03-02T21:30:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:16 smithi122 ceph-mon[125440]: pgmap v20247: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 119 B/s wr, 5 op/s 2023-03-02T21:30:18.018 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:18.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:30:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:18.017+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:30:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:18.017+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:30:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:18.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:30:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:18.017+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:30:18.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:18 smithi057 ceph-mon[92072]: pgmap v20248: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T21:30:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:18 smithi122 ceph-mon[125440]: pgmap v20248: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T21:30:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:18 smithi136 ceph-mon[125702]: pgmap v20248: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T21:30:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:20 smithi122 ceph-mon[125440]: pgmap v20249: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T21:30:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:20 smithi136 ceph-mon[125702]: pgmap v20249: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T21:30:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:20 smithi057 ceph-mon[92072]: pgmap v20249: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T21:30:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:22 smithi122 ceph-mon[125440]: pgmap v20250: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T21:30:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:22 smithi136 ceph-mon[125702]: pgmap v20250: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T21:30:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:22 smithi057 ceph-mon[92072]: pgmap v20250: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-02T21:30:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:24 smithi122 ceph-mon[125440]: pgmap v20251: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:30:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:30:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:30:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:24 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:30:24.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:24 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:30:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:24 smithi136 ceph-mon[125702]: pgmap v20251: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:30:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:30:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:30:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:24 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:30:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:24 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:30:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:24 smithi057 ceph-mon[92072]: pgmap v20251: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:30:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:30:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:30:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:24 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:30:25.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:24 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:30:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:26 smithi136 ceph-mon[125702]: pgmap v20252: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:30:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:26 smithi057 ceph-mon[92072]: pgmap v20252: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:30:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:26 smithi122 ceph-mon[125440]: pgmap v20252: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:30:28.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:28 smithi057 ceph-mon[92072]: pgmap v20253: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:30:28.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:28 smithi122 ceph-mon[125440]: pgmap v20253: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:30:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:28 smithi136 ceph-mon[125702]: pgmap v20253: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:30:30.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:30 smithi122 ceph-mon[125440]: pgmap v20254: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:30 smithi136 ceph-mon[125702]: pgmap v20254: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:30 smithi057 ceph-mon[92072]: pgmap v20254: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:32.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:32 smithi122 ceph-mon[125440]: pgmap v20255: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:33.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:33.029+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:30:33.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:33.029+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:30:33.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:33.029+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:30:33.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:33.029+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:30:33.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:33.029+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:30:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:32 smithi136 ceph-mon[125702]: pgmap v20255: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:32 smithi057 ceph-mon[92072]: pgmap v20255: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:34.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:34 smithi122 ceph-mon[125440]: pgmap v20256: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:34 smithi136 ceph-mon[125702]: pgmap v20256: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:34 smithi057 ceph-mon[92072]: pgmap v20256: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:36 smithi136 ceph-mon[125702]: pgmap v20257: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:36 smithi057 ceph-mon[92072]: pgmap v20257: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:36 smithi122 ceph-mon[125440]: pgmap v20257: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:38.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:38 smithi057 ceph-mon[92072]: pgmap v20258: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:38 smithi122 ceph-mon[125440]: pgmap v20258: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:38 smithi136 ceph-mon[125702]: pgmap v20258: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:40.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:40 smithi122 ceph-mon[125440]: pgmap v20259: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:40 smithi136 ceph-mon[125702]: pgmap v20259: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:40 smithi057 ceph-mon[92072]: pgmap v20259: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:42.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:42 smithi122 ceph-mon[125440]: pgmap v20260: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:42 smithi136 ceph-mon[125702]: pgmap v20260: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:42 smithi057 ceph-mon[92072]: pgmap v20260: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:44.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:44 smithi122 ceph-mon[125440]: pgmap v20261: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:44 smithi136 ceph-mon[125702]: pgmap v20261: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:44 smithi057 ceph-mon[92072]: pgmap v20261: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:46 smithi136 ceph-mon[125702]: pgmap v20262: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:46 smithi057 ceph-mon[92072]: pgmap v20262: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:46 smithi122 ceph-mon[125440]: pgmap v20262: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:48.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:30:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:48.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:30:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:48.042+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:30:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:48.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:30:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:30:48.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:30:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:48 smithi122 ceph-mon[125440]: pgmap v20263: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:48 smithi136 ceph-mon[125702]: pgmap v20263: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:48 smithi057 ceph-mon[92072]: pgmap v20263: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:50.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:50 smithi122 ceph-mon[125440]: pgmap v20264: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:50 smithi136 ceph-mon[125702]: pgmap v20264: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:50 smithi057 ceph-mon[92072]: pgmap v20264: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:52.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:52 smithi122 ceph-mon[125440]: pgmap v20265: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:52 smithi136 ceph-mon[125702]: pgmap v20265: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:52 smithi057 ceph-mon[92072]: pgmap v20265: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:54 smithi136 ceph-mon[125702]: pgmap v20266: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:54 smithi057 ceph-mon[92072]: pgmap v20266: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:54 smithi122 ceph-mon[125440]: pgmap v20266: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:56 smithi136 ceph-mon[125702]: pgmap v20267: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:56 smithi057 ceph-mon[92072]: pgmap v20267: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:56 smithi122 ceph-mon[125440]: pgmap v20267: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:30:58.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:30:58 smithi122 ceph-mon[125440]: pgmap v20268: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:30:58 smithi136 ceph-mon[125702]: pgmap v20268: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:30:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:30:58 smithi057 ceph-mon[92072]: pgmap v20268: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:00.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:00 smithi122 ceph-mon[125440]: pgmap v20269: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:00 smithi136 ceph-mon[125702]: pgmap v20269: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:00 smithi057 ceph-mon[92072]: pgmap v20269: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:02.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:02 smithi122 ceph-mon[125440]: pgmap v20270: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:03.052+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:31:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:03.053+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:31:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:03.053+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:31:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:03.053+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:31:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:03.053+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:31:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:02 smithi136 ceph-mon[125702]: pgmap v20270: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:02 smithi057 ceph-mon[92072]: pgmap v20270: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:04 smithi136 ceph-mon[125702]: pgmap v20271: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:31:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:04 smithi057 ceph-mon[92072]: pgmap v20271: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:31:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:04 smithi122 ceph-mon[125440]: pgmap v20271: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:31:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:06 smithi136 ceph-mon[125702]: pgmap v20272: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:31:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:06 smithi057 ceph-mon[92072]: pgmap v20272: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:31:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:06 smithi122 ceph-mon[125440]: pgmap v20272: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:31:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:08 smithi057 ceph-mon[92072]: osdmap e1340: 12 total, 12 up, 12 in 2023-03-02T21:31:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:08 smithi057 ceph-mon[92072]: pgmap v20274: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:31:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:08 smithi122 ceph-mon[125440]: osdmap e1340: 12 total, 12 up, 12 in 2023-03-02T21:31:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:08 smithi122 ceph-mon[125440]: pgmap v20274: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:31:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:08 smithi136 ceph-mon[125702]: osdmap e1340: 12 total, 12 up, 12 in 2023-03-02T21:31:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:08 smithi136 ceph-mon[125702]: pgmap v20274: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:31:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:10 smithi122 ceph-mon[125440]: pgmap v20275: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:31:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:10 smithi136 ceph-mon[125702]: pgmap v20275: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:31:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:10 smithi057 ceph-mon[92072]: pgmap v20275: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:31:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:12 smithi122 ceph-mon[125440]: pgmap v20276: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:31:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:12 smithi136 ceph-mon[125702]: pgmap v20276: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:31:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:12 smithi057 ceph-mon[92072]: pgmap v20276: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:31:14.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:14 smithi122 ceph-mon[125440]: pgmap v20277: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:31:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:14 smithi136 ceph-mon[125702]: pgmap v20277: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:31:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:14 smithi057 ceph-mon[92072]: pgmap v20277: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:31:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:16 smithi136 ceph-mon[125702]: osdmap e1341: 12 total, 12 up, 12 in 2023-03-02T21:31:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:16 smithi136 ceph-mon[125702]: pgmap v20279: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:31:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:16 smithi057 ceph-mon[92072]: osdmap e1341: 12 total, 12 up, 12 in 2023-03-02T21:31:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:16 smithi057 ceph-mon[92072]: pgmap v20279: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:31:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:16 smithi122 ceph-mon[125440]: osdmap e1341: 12 total, 12 up, 12 in 2023-03-02T21:31:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:16 smithi122 ceph-mon[125440]: pgmap v20279: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:31:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:18.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:31:18.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:18.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:31:18.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:18.055+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:31:18.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:18.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:31:18.057 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:18.055+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:31:18.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:18 smithi122 ceph-mon[125440]: pgmap v20280: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:31:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:18 smithi136 ceph-mon[125702]: pgmap v20280: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:31:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:18 smithi057 ceph-mon[92072]: pgmap v20280: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:31:20.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:20 smithi122 ceph-mon[125440]: pgmap v20281: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:31:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:20 smithi136 ceph-mon[125702]: pgmap v20281: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:31:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:20 smithi057 ceph-mon[92072]: pgmap v20281: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:31:22.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:22 smithi122 ceph-mon[125440]: pgmap v20282: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:31:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:22 smithi136 ceph-mon[125702]: pgmap v20282: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:31:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:22 smithi057 ceph-mon[92072]: pgmap v20282: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:31:24.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:24 smithi122 ceph-mon[125440]: pgmap v20283: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:31:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:24 smithi136 ceph-mon[125702]: pgmap v20283: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:31:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:24 smithi057 ceph-mon[92072]: pgmap v20283: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:31:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:31:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:31:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:25 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:31:26.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:25 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:31:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:31:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:31:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:25 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:31:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:25 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:31:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:31:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:31:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:25 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:31:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:25 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:31:27.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:26 smithi136 ceph-mon[125702]: pgmap v20284: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:31:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:26 smithi057 ceph-mon[92072]: pgmap v20284: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:31:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:26 smithi122 ceph-mon[125440]: pgmap v20284: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:31:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:28 smithi136 ceph-mon[125702]: pgmap v20285: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:31:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:28 smithi057 ceph-mon[92072]: pgmap v20285: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:31:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:28 smithi122 ceph-mon[125440]: pgmap v20285: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:31:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:30 smithi136 ceph-mon[125702]: pgmap v20286: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:30 smithi057 ceph-mon[92072]: pgmap v20286: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:30 smithi122 ceph-mon[125440]: pgmap v20286: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:33.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:33.065+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:31:33.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:33.066+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:31:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:33.066+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:31:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:33.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:31:33.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:33.066+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:31:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:32 smithi136 ceph-mon[125702]: pgmap v20287: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:32 smithi057 ceph-mon[92072]: pgmap v20287: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:32 smithi122 ceph-mon[125440]: pgmap v20287: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:35.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:34 smithi136 ceph-mon[125702]: pgmap v20288: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:34 smithi057 ceph-mon[92072]: pgmap v20288: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:34 smithi122 ceph-mon[125440]: pgmap v20288: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:36 smithi057 ceph-mon[92072]: pgmap v20289: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:36 smithi122 ceph-mon[125440]: pgmap v20289: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:36 smithi136 ceph-mon[125702]: pgmap v20289: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:38.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:38 smithi122 ceph-mon[125440]: pgmap v20290: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:38 smithi136 ceph-mon[125702]: pgmap v20290: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:38 smithi057 ceph-mon[92072]: pgmap v20290: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:40 smithi136 ceph-mon[125702]: pgmap v20291: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:40 smithi057 ceph-mon[92072]: pgmap v20291: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:40 smithi122 ceph-mon[125440]: pgmap v20291: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:42 smithi136 ceph-mon[125702]: pgmap v20292: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:42 smithi057 ceph-mon[92072]: pgmap v20292: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:42 smithi122 ceph-mon[125440]: pgmap v20292: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:44 smithi136 ceph-mon[125702]: pgmap v20293: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:44 smithi057 ceph-mon[92072]: pgmap v20293: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:44 smithi122 ceph-mon[125440]: pgmap v20293: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:46 smithi136 ceph-mon[125702]: pgmap v20294: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:46 smithi057 ceph-mon[92072]: pgmap v20294: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:46 smithi122 ceph-mon[125440]: pgmap v20294: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:48.072 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:48.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:31:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:48.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:31:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:48.070+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:31:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:48.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:31:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:31:48.070+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:31:48.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:48 smithi122 ceph-mon[125440]: pgmap v20295: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:48 smithi136 ceph-mon[125702]: pgmap v20295: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:48 smithi057 ceph-mon[92072]: pgmap v20295: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:50 smithi136 ceph-mon[125702]: pgmap v20296: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:50 smithi057 ceph-mon[92072]: pgmap v20296: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:50 smithi122 ceph-mon[125440]: pgmap v20296: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:52 smithi136 ceph-mon[125702]: pgmap v20297: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:52 smithi057 ceph-mon[92072]: pgmap v20297: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:52 smithi122 ceph-mon[125440]: pgmap v20297: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:31:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:54 smithi136 ceph-mon[125702]: pgmap v20298: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:54 smithi057 ceph-mon[92072]: pgmap v20298: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:54 smithi122 ceph-mon[125440]: pgmap v20298: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:56 smithi057 ceph-mon[92072]: pgmap v20299: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:31:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:56 smithi122 ceph-mon[125440]: pgmap v20299: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:31:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:56 smithi136 ceph-mon[125702]: pgmap v20299: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:31:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:31:58 smithi136 ceph-mon[125702]: pgmap v20300: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:31:58 smithi057 ceph-mon[92072]: pgmap v20300: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:31:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:31:58 smithi122 ceph-mon[125440]: pgmap v20300: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:00 smithi136 ceph-mon[125702]: pgmap v20301: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:32:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:00 smithi057 ceph-mon[92072]: pgmap v20301: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:32:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:00 smithi122 ceph-mon[125440]: pgmap v20301: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:32:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:03.080+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:32:03.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:03.081+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:32:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:03.081+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:32:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:03.081+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:32:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:03.081+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:32:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:02 smithi136 ceph-mon[125702]: pgmap v20302: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:32:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:02 smithi057 ceph-mon[92072]: pgmap v20302: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:32:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:02 smithi122 ceph-mon[125440]: pgmap v20302: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:32:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:04 smithi136 ceph-mon[125702]: pgmap v20303: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:32:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:04 smithi057 ceph-mon[92072]: pgmap v20303: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:32:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:04 smithi122 ceph-mon[125440]: pgmap v20303: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:32:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:06 smithi057 ceph-mon[92072]: pgmap v20304: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:32:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:06 smithi122 ceph-mon[125440]: pgmap v20304: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:32:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:06 smithi136 ceph-mon[125702]: pgmap v20304: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:32:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:08 smithi057 ceph-mon[92072]: osdmap e1342: 12 total, 12 up, 12 in 2023-03-02T21:32:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:08 smithi057 ceph-mon[92072]: pgmap v20306: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:32:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:08 smithi122 ceph-mon[125440]: osdmap e1342: 12 total, 12 up, 12 in 2023-03-02T21:32:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:08 smithi122 ceph-mon[125440]: pgmap v20306: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:32:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:08 smithi136 ceph-mon[125702]: osdmap e1342: 12 total, 12 up, 12 in 2023-03-02T21:32:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:08 smithi136 ceph-mon[125702]: pgmap v20306: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:32:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:10 smithi136 ceph-mon[125702]: pgmap v20307: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:32:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:10 smithi057 ceph-mon[92072]: pgmap v20307: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:32:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:10 smithi122 ceph-mon[125440]: pgmap v20307: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:32:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:12 smithi136 ceph-mon[125702]: pgmap v20308: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:32:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:12 smithi057 ceph-mon[92072]: pgmap v20308: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:32:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:12 smithi122 ceph-mon[125440]: pgmap v20308: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:32:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:13.866+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:32:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:13.866+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:32:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:13.866+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 293 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:32:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:13.866+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 292 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:32:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:14 smithi136 ceph-mon[125702]: pgmap v20309: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:32:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:14 smithi057 ceph-mon[92072]: pgmap v20309: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:32:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:14 smithi122 ceph-mon[125440]: pgmap v20309: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:32:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:16 smithi057 ceph-mon[92072]: osdmap e1343: 12 total, 12 up, 12 in 2023-03-02T21:32:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:16 smithi057 ceph-mon[92072]: pgmap v20311: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:32:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:16 smithi122 ceph-mon[125440]: osdmap e1343: 12 total, 12 up, 12 in 2023-03-02T21:32:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:16 smithi122 ceph-mon[125440]: pgmap v20311: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:32:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:16 smithi136 ceph-mon[125702]: osdmap e1343: 12 total, 12 up, 12 in 2023-03-02T21:32:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:16 smithi136 ceph-mon[125702]: pgmap v20311: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:32:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:18.090+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:32:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:18.091+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:32:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:18.091+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:32:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:18.091+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:32:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:18.091+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:32:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:18 smithi136 ceph-mon[125702]: pgmap v20312: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:32:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:18 smithi057 ceph-mon[92072]: pgmap v20312: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:32:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:18 smithi122 ceph-mon[125440]: pgmap v20312: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:32:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:20 smithi136 ceph-mon[125702]: pgmap v20313: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:32:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:20 smithi057 ceph-mon[92072]: pgmap v20313: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:32:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:20 smithi122 ceph-mon[125440]: pgmap v20313: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:32:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:22 smithi136 ceph-mon[125702]: pgmap v20314: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:32:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:22 smithi057 ceph-mon[92072]: pgmap v20314: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:32:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:22 smithi122 ceph-mon[125440]: pgmap v20314: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:32:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:24 smithi136 ceph-mon[125702]: pgmap v20315: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:32:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:24 smithi057 ceph-mon[92072]: pgmap v20315: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:32:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:24 smithi122 ceph-mon[125440]: pgmap v20315: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:32:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:32:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:26 smithi057 ceph-mon[92072]: pgmap v20316: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:32:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:32:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:26 smithi122 ceph-mon[125440]: pgmap v20316: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:32:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:32:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:26 smithi136 ceph-mon[125702]: pgmap v20316: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:32:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:32:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:32:27.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:32:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:32:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:32:27.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:32:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:32:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:32:27.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:32:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:28 smithi057 ceph-mon[92072]: pgmap v20317: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:32:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:28 smithi122 ceph-mon[125440]: pgmap v20317: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:32:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:28 smithi136 ceph-mon[125702]: pgmap v20317: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:32:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:30 smithi136 ceph-mon[125702]: pgmap v20318: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:30 smithi057 ceph-mon[92072]: pgmap v20318: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:30 smithi122 ceph-mon[125440]: pgmap v20318: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:32 smithi136 ceph-mon[125702]: pgmap v20319: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:33.106+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:32:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:33.106+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:32:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:33.106+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:32:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:33.106+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:32:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:33.106+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:32:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:32 smithi057 ceph-mon[92072]: pgmap v20319: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:32 smithi122 ceph-mon[125440]: pgmap v20319: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:34 smithi136 ceph-mon[125702]: pgmap v20320: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:34 smithi057 ceph-mon[92072]: pgmap v20320: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:34 smithi122 ceph-mon[125440]: pgmap v20320: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:36 smithi057 ceph-mon[92072]: pgmap v20321: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:36 smithi122 ceph-mon[125440]: pgmap v20321: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:36 smithi136 ceph-mon[125702]: pgmap v20321: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:38 smithi136 ceph-mon[125702]: pgmap v20322: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:38 smithi057 ceph-mon[92072]: pgmap v20322: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:38 smithi122 ceph-mon[125440]: pgmap v20322: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:40 smithi136 ceph-mon[125702]: pgmap v20323: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:40 smithi057 ceph-mon[92072]: pgmap v20323: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:40 smithi122 ceph-mon[125440]: pgmap v20323: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:42 smithi136 ceph-mon[125702]: pgmap v20324: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:42 smithi057 ceph-mon[92072]: pgmap v20324: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:42 smithi122 ceph-mon[125440]: pgmap v20324: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:44 smithi136 ceph-mon[125702]: pgmap v20325: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:44 smithi057 ceph-mon[92072]: pgmap v20325: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:44 smithi122 ceph-mon[125440]: pgmap v20325: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:46 smithi057 ceph-mon[92072]: pgmap v20326: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:46 smithi122 ceph-mon[125440]: pgmap v20326: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:46 smithi136 ceph-mon[125702]: pgmap v20326: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:48.123 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:48.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:32:48.124 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:48.121+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:32:48.124 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:48.121+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:32:48.124 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:48.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:32:48.124 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:32:48.121+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:32:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:48 smithi136 ceph-mon[125702]: pgmap v20327: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:48 smithi057 ceph-mon[92072]: pgmap v20327: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:48 smithi122 ceph-mon[125440]: pgmap v20327: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:50 smithi136 ceph-mon[125702]: pgmap v20328: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:50 smithi057 ceph-mon[92072]: pgmap v20328: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:50 smithi122 ceph-mon[125440]: pgmap v20328: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:52 smithi136 ceph-mon[125702]: pgmap v20329: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:52 smithi057 ceph-mon[92072]: pgmap v20329: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:52 smithi122 ceph-mon[125440]: pgmap v20329: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:54 smithi136 ceph-mon[125702]: pgmap v20330: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:54 smithi057 ceph-mon[92072]: pgmap v20330: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:54 smithi122 ceph-mon[125440]: pgmap v20330: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:56 smithi057 ceph-mon[92072]: pgmap v20331: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:56 smithi122 ceph-mon[125440]: pgmap v20331: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:56 smithi136 ceph-mon[125702]: pgmap v20331: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:32:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:32:58 smithi136 ceph-mon[125702]: pgmap v20332: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:32:58 smithi057 ceph-mon[92072]: pgmap v20332: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:32:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:32:58 smithi122 ceph-mon[125440]: pgmap v20332: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:00 smithi136 ceph-mon[125702]: pgmap v20333: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:00 smithi057 ceph-mon[92072]: pgmap v20333: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:00 smithi122 ceph-mon[125440]: pgmap v20333: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:02 smithi136 ceph-mon[125702]: pgmap v20334: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:03.134+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:33:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:03.134+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:33:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:03.134+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:33:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:03.134+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:33:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:03.134+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:33:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:02 smithi057 ceph-mon[92072]: pgmap v20334: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:02 smithi122 ceph-mon[125440]: pgmap v20334: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:04 smithi136 ceph-mon[125702]: pgmap v20335: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:33:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:04 smithi057 ceph-mon[92072]: pgmap v20335: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:33:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:04 smithi122 ceph-mon[125440]: pgmap v20335: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:33:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:06 smithi057 ceph-mon[92072]: pgmap v20336: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:33:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:06 smithi122 ceph-mon[125440]: pgmap v20336: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:33:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:06 smithi136 ceph-mon[125702]: pgmap v20336: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:33:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:08 smithi057 ceph-mon[92072]: osdmap e1344: 12 total, 12 up, 12 in 2023-03-02T21:33:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:08 smithi057 ceph-mon[92072]: pgmap v20338: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:33:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:08 smithi122 ceph-mon[125440]: osdmap e1344: 12 total, 12 up, 12 in 2023-03-02T21:33:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:08 smithi122 ceph-mon[125440]: pgmap v20338: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:33:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:08 smithi136 ceph-mon[125702]: osdmap e1344: 12 total, 12 up, 12 in 2023-03-02T21:33:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:08 smithi136 ceph-mon[125702]: pgmap v20338: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:33:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:10 smithi136 ceph-mon[125702]: pgmap v20339: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:33:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:10 smithi057 ceph-mon[92072]: pgmap v20339: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:33:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:10 smithi122 ceph-mon[125440]: pgmap v20339: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:33:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:12 smithi136 ceph-mon[125702]: pgmap v20340: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:33:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:12 smithi057 ceph-mon[92072]: pgmap v20340: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:33:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:12 smithi122 ceph-mon[125440]: pgmap v20340: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:33:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:14 smithi136 ceph-mon[125702]: pgmap v20341: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:33:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:14 smithi057 ceph-mon[92072]: pgmap v20341: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:33:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:14 smithi122 ceph-mon[125440]: pgmap v20341: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:33:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:16 smithi057 ceph-mon[92072]: osdmap e1345: 12 total, 12 up, 12 in 2023-03-02T21:33:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:16 smithi057 ceph-mon[92072]: pgmap v20343: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:33:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:16 smithi122 ceph-mon[125440]: osdmap e1345: 12 total, 12 up, 12 in 2023-03-02T21:33:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:16 smithi122 ceph-mon[125440]: pgmap v20343: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:33:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:16 smithi136 ceph-mon[125702]: osdmap e1345: 12 total, 12 up, 12 in 2023-03-02T21:33:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:16 smithi136 ceph-mon[125702]: pgmap v20343: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 119 B/s wr, 6 op/s 2023-03-02T21:33:18.137 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:18.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:33:18.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:18.136+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:33:18.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:18.136+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:33:18.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:18.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:33:18.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:18.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:33:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:18 smithi136 ceph-mon[125702]: pgmap v20344: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:33:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:18 smithi057 ceph-mon[92072]: pgmap v20344: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:33:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:18 smithi122 ceph-mon[125440]: pgmap v20344: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:33:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:20 smithi136 ceph-mon[125702]: pgmap v20345: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:33:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:20 smithi057 ceph-mon[92072]: pgmap v20345: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:33:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:20 smithi122 ceph-mon[125440]: pgmap v20345: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:33:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:22 smithi136 ceph-mon[125702]: pgmap v20346: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:33:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:22 smithi057 ceph-mon[92072]: pgmap v20346: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:33:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:22 smithi122 ceph-mon[125440]: pgmap v20346: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:33:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:24 smithi136 ceph-mon[125702]: pgmap v20347: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:33:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:24 smithi057 ceph-mon[92072]: pgmap v20347: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:33:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:24 smithi122 ceph-mon[125440]: pgmap v20347: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:33:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:26 smithi057 ceph-mon[92072]: pgmap v20348: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:33:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:26 smithi122 ceph-mon[125440]: pgmap v20348: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:33:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:26 smithi136 ceph-mon[125702]: pgmap v20348: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:33:27.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:33:27.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:33:27.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:33:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:33:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:28 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:33:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:28 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:33:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:28 smithi057 ceph-mon[92072]: pgmap v20349: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:33:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:33:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:28 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:33:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:28 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:33:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:28 smithi122 ceph-mon[125440]: pgmap v20349: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:33:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:33:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:28 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:33:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:28 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:33:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:28 smithi136 ceph-mon[125702]: pgmap v20349: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:33:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:30 smithi136 ceph-mon[125702]: pgmap v20350: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:30 smithi057 ceph-mon[92072]: pgmap v20350: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:30 smithi122 ceph-mon[125440]: pgmap v20350: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:32 smithi136 ceph-mon[125702]: pgmap v20351: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:33.147+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:33:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:33.148+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:33:33.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:33.148+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:33:33.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:33.148+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:33:33.150 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:33.148+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:33:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:32 smithi057 ceph-mon[92072]: pgmap v20351: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:32 smithi122 ceph-mon[125440]: pgmap v20351: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:34 smithi136 ceph-mon[125702]: pgmap v20352: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:34 smithi057 ceph-mon[92072]: pgmap v20352: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:34 smithi122 ceph-mon[125440]: pgmap v20352: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:36 smithi057 ceph-mon[92072]: pgmap v20353: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:36 smithi122 ceph-mon[125440]: pgmap v20353: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:36 smithi136 ceph-mon[125702]: pgmap v20353: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:38 smithi136 ceph-mon[125702]: pgmap v20354: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:38 smithi057 ceph-mon[92072]: pgmap v20354: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:38 smithi122 ceph-mon[125440]: pgmap v20354: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:40 smithi136 ceph-mon[125702]: pgmap v20355: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:40 smithi057 ceph-mon[92072]: pgmap v20355: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:40 smithi122 ceph-mon[125440]: pgmap v20355: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:42 smithi136 ceph-mon[125702]: pgmap v20356: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:42 smithi057 ceph-mon[92072]: pgmap v20356: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:42 smithi122 ceph-mon[125440]: pgmap v20356: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:44 smithi136 ceph-mon[125702]: pgmap v20357: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:44 smithi057 ceph-mon[92072]: pgmap v20357: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:44 smithi122 ceph-mon[125440]: pgmap v20357: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:46 smithi057 ceph-mon[92072]: pgmap v20358: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:46 smithi122 ceph-mon[125440]: pgmap v20358: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:46 smithi136 ceph-mon[125702]: pgmap v20358: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:48.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:48.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:33:48.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:48.155+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:33:48.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:48.155+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:33:48.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:48.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:33:48.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:33:48.155+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:33:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:48 smithi136 ceph-mon[125702]: pgmap v20359: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:48 smithi057 ceph-mon[92072]: pgmap v20359: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:48 smithi122 ceph-mon[125440]: pgmap v20359: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:50 smithi136 ceph-mon[125702]: pgmap v20360: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:50 smithi057 ceph-mon[92072]: pgmap v20360: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:50 smithi122 ceph-mon[125440]: pgmap v20360: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:52 smithi136 ceph-mon[125702]: pgmap v20361: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:52 smithi057 ceph-mon[92072]: pgmap v20361: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:52 smithi122 ceph-mon[125440]: pgmap v20361: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:54 smithi136 ceph-mon[125702]: pgmap v20362: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:54 smithi057 ceph-mon[92072]: pgmap v20362: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:54 smithi122 ceph-mon[125440]: pgmap v20362: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:56 smithi057 ceph-mon[92072]: pgmap v20363: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:56 smithi122 ceph-mon[125440]: pgmap v20363: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:56 smithi136 ceph-mon[125702]: pgmap v20363: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:33:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:33:58 smithi136 ceph-mon[125702]: pgmap v20364: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:33:58 smithi057 ceph-mon[92072]: pgmap v20364: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:33:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:33:58 smithi122 ceph-mon[125440]: pgmap v20364: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:34:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:00 smithi136 ceph-mon[125702]: pgmap v20365: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:00 smithi057 ceph-mon[92072]: pgmap v20365: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:00 smithi122 ceph-mon[125440]: pgmap v20365: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:02 smithi136 ceph-mon[125702]: pgmap v20366: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:03.170 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:03.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:34:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:03.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:34:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:03.168+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:34:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:03.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:34:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:03.168+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:34:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:02 smithi057 ceph-mon[92072]: pgmap v20366: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:02 smithi122 ceph-mon[125440]: pgmap v20366: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:04 smithi136 ceph-mon[125702]: pgmap v20367: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:34:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:04 smithi057 ceph-mon[92072]: pgmap v20367: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:34:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:04 smithi122 ceph-mon[125440]: pgmap v20367: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:34:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:06 smithi057 ceph-mon[92072]: pgmap v20368: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:34:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:06 smithi122 ceph-mon[125440]: pgmap v20368: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:34:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:06 smithi136 ceph-mon[125702]: pgmap v20368: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:34:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:07 smithi057 ceph-mon[92072]: osdmap e1346: 12 total, 12 up, 12 in 2023-03-02T21:34:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:07 smithi122 ceph-mon[125440]: osdmap e1346: 12 total, 12 up, 12 in 2023-03-02T21:34:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:07 smithi136 ceph-mon[125702]: osdmap e1346: 12 total, 12 up, 12 in 2023-03-02T21:34:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:08 smithi057 ceph-mon[92072]: pgmap v20370: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:34:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:08 smithi122 ceph-mon[125440]: pgmap v20370: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:34:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:08 smithi136 ceph-mon[125702]: pgmap v20370: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:34:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:10 smithi136 ceph-mon[125702]: pgmap v20371: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:34:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:10 smithi057 ceph-mon[92072]: pgmap v20371: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:34:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:10 smithi122 ceph-mon[125440]: pgmap v20371: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:34:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:12 smithi136 ceph-mon[125702]: pgmap v20372: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T21:34:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:12 smithi057 ceph-mon[92072]: pgmap v20372: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T21:34:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:12 smithi122 ceph-mon[125440]: pgmap v20372: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-02T21:34:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:14 smithi136 ceph-mon[125702]: pgmap v20373: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:34:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:14 smithi057 ceph-mon[92072]: pgmap v20373: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:34:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:14 smithi122 ceph-mon[125440]: pgmap v20373: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:34:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:16 smithi057 ceph-mon[92072]: osdmap e1347: 12 total, 12 up, 12 in 2023-03-02T21:34:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:16 smithi057 ceph-mon[92072]: pgmap v20375: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:34:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:16 smithi122 ceph-mon[125440]: osdmap e1347: 12 total, 12 up, 12 in 2023-03-02T21:34:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:16 smithi122 ceph-mon[125440]: pgmap v20375: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:34:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:16 smithi136 ceph-mon[125702]: osdmap e1347: 12 total, 12 up, 12 in 2023-03-02T21:34:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:16 smithi136 ceph-mon[125702]: pgmap v20375: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:34:18.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:18.181+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:34:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:18.181+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:34:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:18.181+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:34:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:18.182+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:34:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:18.182+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:34:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:18 smithi136 ceph-mon[125702]: pgmap v20376: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:34:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:18 smithi057 ceph-mon[92072]: pgmap v20376: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:34:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:18 smithi122 ceph-mon[125440]: pgmap v20376: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:34:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:20 smithi136 ceph-mon[125702]: pgmap v20377: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:34:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:20 smithi057 ceph-mon[92072]: pgmap v20377: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:34:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:20 smithi122 ceph-mon[125440]: pgmap v20377: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:34:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:22 smithi136 ceph-mon[125702]: pgmap v20378: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-02T21:34:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:22 smithi057 ceph-mon[92072]: pgmap v20378: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-02T21:34:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:22 smithi122 ceph-mon[125440]: pgmap v20378: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-02T21:34:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:24 smithi136 ceph-mon[125702]: pgmap v20379: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:34:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:24 smithi057 ceph-mon[92072]: pgmap v20379: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:34:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:24 smithi122 ceph-mon[125440]: pgmap v20379: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:34:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:26 smithi057 ceph-mon[92072]: pgmap v20380: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:34:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:26 smithi122 ceph-mon[125440]: pgmap v20380: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:34:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:26 smithi136 ceph-mon[125702]: pgmap v20380: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:34:27.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:34:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:34:27.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:34:28.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:28 smithi057 ceph-mon[92072]: pgmap v20381: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:34:28.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:28 smithi122 ceph-mon[125440]: pgmap v20381: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:34:28.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:28 smithi136 ceph-mon[125702]: pgmap v20381: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:34:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:28.886+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:34:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:28.886+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:34:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:28.886+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 293 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:34:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:28.886+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 294 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:34:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:30 smithi136 ceph-mon[125702]: pgmap v20382: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:30 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:30 smithi057 ceph-mon[92072]: pgmap v20382: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:31.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:30 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:30 smithi122 ceph-mon[125440]: pgmap v20382: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:30 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:34:32.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:34:32.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:34:32.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:34:32.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:34:32.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:34:32.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:34:32.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:34:32.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:34:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:34:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:34:32.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:34:32.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:34:32.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:34:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:32 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:34:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:32 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:34:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:32 smithi136 ceph-mon[125702]: pgmap v20383: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:34:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:32 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:34:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:32 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:34:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:32 smithi057 ceph-mon[92072]: pgmap v20383: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:34:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:33.197+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:34:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:33.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:34:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:33.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:34:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:33.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:34:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:33.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:34:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:32 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:34:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:32 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:34:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:32 smithi122 ceph-mon[125440]: pgmap v20383: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:34:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:34 smithi136 ceph-mon[125702]: pgmap v20384: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:34:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:34 smithi057 ceph-mon[92072]: pgmap v20384: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:34:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:34 smithi122 ceph-mon[125440]: pgmap v20384: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:34:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:36 smithi057 ceph-mon[92072]: pgmap v20385: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:36 smithi122 ceph-mon[125440]: pgmap v20385: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:36 smithi136 ceph-mon[125702]: pgmap v20385: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:38 smithi136 ceph-mon[125702]: pgmap v20386: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:34:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:38 smithi057 ceph-mon[92072]: pgmap v20386: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:34:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:38 smithi122 ceph-mon[125440]: pgmap v20386: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:34:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:40 smithi136 ceph-mon[125702]: pgmap v20387: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:40 smithi057 ceph-mon[92072]: pgmap v20387: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:40 smithi122 ceph-mon[125440]: pgmap v20387: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:42 smithi136 ceph-mon[125702]: pgmap v20388: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:34:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:42 smithi057 ceph-mon[92072]: pgmap v20388: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:34:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:42 smithi122 ceph-mon[125440]: pgmap v20388: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:34:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:44 smithi136 ceph-mon[125702]: pgmap v20389: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:34:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:44 smithi057 ceph-mon[92072]: pgmap v20389: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:34:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:44 smithi122 ceph-mon[125440]: pgmap v20389: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:34:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:46 smithi057 ceph-mon[92072]: pgmap v20390: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:46 smithi122 ceph-mon[125440]: pgmap v20390: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:46 smithi136 ceph-mon[125702]: pgmap v20390: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:48.213+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:34:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:48.214+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:34:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:48.214+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:34:48.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:48.214+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:34:48.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:34:48.214+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:34:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:48 smithi136 ceph-mon[125702]: pgmap v20391: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:34:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:48 smithi057 ceph-mon[92072]: pgmap v20391: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:34:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:48 smithi122 ceph-mon[125440]: pgmap v20391: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:34:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:50 smithi136 ceph-mon[125702]: pgmap v20392: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:50 smithi057 ceph-mon[92072]: pgmap v20392: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:50 smithi122 ceph-mon[125440]: pgmap v20392: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:34:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:52 smithi136 ceph-mon[125702]: pgmap v20393: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-02T21:34:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:52 smithi057 ceph-mon[92072]: pgmap v20393: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-02T21:34:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:52 smithi122 ceph-mon[125440]: pgmap v20393: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-02T21:34:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:54 smithi136 ceph-mon[125702]: pgmap v20394: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-03-02T21:34:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:54 smithi057 ceph-mon[92072]: pgmap v20394: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-03-02T21:34:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:54 smithi122 ceph-mon[125440]: pgmap v20394: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-03-02T21:34:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:56 smithi057 ceph-mon[92072]: pgmap v20395: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:34:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:56 smithi122 ceph-mon[125440]: pgmap v20395: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:34:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:56 smithi136 ceph-mon[125702]: pgmap v20395: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:34:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:34:58 smithi136 ceph-mon[125702]: pgmap v20396: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:34:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:34:58 smithi057 ceph-mon[92072]: pgmap v20396: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:34:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:34:58 smithi122 ceph-mon[125440]: pgmap v20396: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:00 smithi136 ceph-mon[125702]: pgmap v20397: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:35:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:00 smithi057 ceph-mon[92072]: pgmap v20397: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:35:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:00 smithi122 ceph-mon[125440]: pgmap v20397: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:35:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:02 smithi136 ceph-mon[125702]: pgmap v20398: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:35:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:02 smithi057 ceph-mon[92072]: pgmap v20398: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:35:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:02 smithi122 ceph-mon[125440]: pgmap v20398: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:35:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:03.228+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:35:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:03.228+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:35:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:03.228+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:35:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:03.228+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:35:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:03.228+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:35:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:04 smithi136 ceph-mon[125702]: pgmap v20399: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:35:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:04 smithi057 ceph-mon[92072]: pgmap v20399: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:35:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:04 smithi122 ceph-mon[125440]: pgmap v20399: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:35:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:06 smithi057 ceph-mon[92072]: pgmap v20400: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:35:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:06 smithi122 ceph-mon[125440]: pgmap v20400: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:35:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:06 smithi136 ceph-mon[125702]: pgmap v20400: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:35:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:07 smithi057 ceph-mon[92072]: osdmap e1348: 12 total, 12 up, 12 in 2023-03-02T21:35:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:07 smithi122 ceph-mon[125440]: osdmap e1348: 12 total, 12 up, 12 in 2023-03-02T21:35:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:07 smithi136 ceph-mon[125702]: osdmap e1348: 12 total, 12 up, 12 in 2023-03-02T21:35:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:08 smithi057 ceph-mon[92072]: pgmap v20402: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:35:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:08 smithi122 ceph-mon[125440]: pgmap v20402: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:35:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:08 smithi136 ceph-mon[125702]: pgmap v20402: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:35:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:10 smithi136 ceph-mon[125702]: pgmap v20403: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:35:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:10 smithi136 ceph-mon[125702]: osdmap e1349: 12 total, 12 up, 12 in 2023-03-02T21:35:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:10 smithi057 ceph-mon[92072]: pgmap v20403: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:35:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:10 smithi057 ceph-mon[92072]: osdmap e1349: 12 total, 12 up, 12 in 2023-03-02T21:35:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:10 smithi122 ceph-mon[125440]: pgmap v20403: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:35:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:10 smithi122 ceph-mon[125440]: osdmap e1349: 12 total, 12 up, 12 in 2023-03-02T21:35:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:12 smithi136 ceph-mon[125702]: pgmap v20405: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:35:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:12 smithi057 ceph-mon[92072]: pgmap v20405: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:35:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:12 smithi122 ceph-mon[125440]: pgmap v20405: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:35:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:13.893+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:35:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:13.893+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:35:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:13.893+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 294 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:35:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:13.893+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 295 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:35:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:14 smithi136 ceph-mon[125702]: pgmap v20406: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T21:35:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:14 smithi057 ceph-mon[92072]: pgmap v20406: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T21:35:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:14 smithi122 ceph-mon[125440]: pgmap v20406: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-02T21:35:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:16 smithi057 ceph-mon[92072]: pgmap v20407: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:35:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:16 smithi122 ceph-mon[125440]: pgmap v20407: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:35:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:16 smithi136 ceph-mon[125702]: pgmap v20407: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:35:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:18.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:35:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:18.244+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:35:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:18.244+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:35:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:18.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:35:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:18.244+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:35:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:18 smithi136 ceph-mon[125702]: pgmap v20408: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:35:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:18 smithi057 ceph-mon[92072]: pgmap v20408: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:35:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:18 smithi122 ceph-mon[125440]: pgmap v20408: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:35:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:20 smithi136 ceph-mon[125702]: pgmap v20409: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:35:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:20 smithi057 ceph-mon[92072]: pgmap v20409: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:35:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:20 smithi122 ceph-mon[125440]: pgmap v20409: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:35:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:22 smithi136 ceph-mon[125702]: pgmap v20410: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:35:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:22 smithi057 ceph-mon[92072]: pgmap v20410: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:35:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:22 smithi122 ceph-mon[125440]: pgmap v20410: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:35:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:24 smithi136 ceph-mon[125702]: pgmap v20411: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:35:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:24 smithi057 ceph-mon[92072]: pgmap v20411: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:35:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:24 smithi122 ceph-mon[125440]: pgmap v20411: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:35:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:26 smithi057 ceph-mon[92072]: pgmap v20412: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:26 smithi122 ceph-mon[125440]: pgmap v20412: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:26 smithi136 ceph-mon[125702]: pgmap v20412: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:28 smithi136 ceph-mon[125702]: pgmap v20413: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:28 smithi057 ceph-mon[92072]: pgmap v20413: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:28 smithi122 ceph-mon[125440]: pgmap v20413: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:30 smithi136 ceph-mon[125702]: pgmap v20414: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:30 smithi057 ceph-mon[92072]: pgmap v20414: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:30 smithi122 ceph-mon[125440]: pgmap v20414: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:35:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:35:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:35:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:32 smithi136 ceph-mon[125702]: pgmap v20415: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:35:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:35:33.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:35:33.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:35:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:32 smithi057 ceph-mon[92072]: pgmap v20415: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:35:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:35:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:35:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:35:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:32 smithi122 ceph-mon[125440]: pgmap v20415: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:35:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:35:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:35:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:35:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:33.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:35:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:33.260+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:35:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:33.260+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:35:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:33.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:35:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:33.260+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:35:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:34 smithi136 ceph-mon[125702]: pgmap v20416: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:35:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:34 smithi057 ceph-mon[92072]: pgmap v20416: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:35:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:34 smithi122 ceph-mon[125440]: pgmap v20416: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:35:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:36 smithi057 ceph-mon[92072]: pgmap v20417: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:36 smithi122 ceph-mon[125440]: pgmap v20417: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:36 smithi136 ceph-mon[125702]: pgmap v20417: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:38 smithi136 ceph-mon[125702]: pgmap v20418: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:38 smithi057 ceph-mon[92072]: pgmap v20418: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:38 smithi122 ceph-mon[125440]: pgmap v20418: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:40 smithi136 ceph-mon[125702]: pgmap v20419: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:40 smithi057 ceph-mon[92072]: pgmap v20419: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:40 smithi122 ceph-mon[125440]: pgmap v20419: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:42 smithi136 ceph-mon[125702]: pgmap v20420: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:35:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:42 smithi057 ceph-mon[92072]: pgmap v20420: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:35:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:42 smithi122 ceph-mon[125440]: pgmap v20420: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:35:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:44 smithi136 ceph-mon[125702]: pgmap v20421: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:35:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:44 smithi057 ceph-mon[92072]: pgmap v20421: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:35:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:44 smithi122 ceph-mon[125440]: pgmap v20421: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:35:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:46 smithi057 ceph-mon[92072]: pgmap v20422: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:46 smithi122 ceph-mon[125440]: pgmap v20422: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:46 smithi136 ceph-mon[125702]: pgmap v20422: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:48.274+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:35:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:48.274+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:35:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:48.274+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:35:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:48.274+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:35:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:35:48.274+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:35:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:48 smithi136 ceph-mon[125702]: pgmap v20423: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:48 smithi057 ceph-mon[92072]: pgmap v20423: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:48 smithi122 ceph-mon[125440]: pgmap v20423: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:50 smithi136 ceph-mon[125702]: pgmap v20424: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:50 smithi057 ceph-mon[92072]: pgmap v20424: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:50 smithi122 ceph-mon[125440]: pgmap v20424: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:52 smithi136 ceph-mon[125702]: pgmap v20425: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:35:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:52 smithi057 ceph-mon[92072]: pgmap v20425: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:35:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:52 smithi122 ceph-mon[125440]: pgmap v20425: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:35:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:54 smithi136 ceph-mon[125702]: pgmap v20426: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:35:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:54 smithi057 ceph-mon[92072]: pgmap v20426: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:35:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:54 smithi122 ceph-mon[125440]: pgmap v20426: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:35:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:56 smithi057 ceph-mon[92072]: pgmap v20427: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:56 smithi122 ceph-mon[125440]: pgmap v20427: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:56 smithi136 ceph-mon[125702]: pgmap v20427: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:35:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:35:58 smithi136 ceph-mon[125702]: pgmap v20428: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:35:58 smithi057 ceph-mon[92072]: pgmap v20428: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:35:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:35:58 smithi122 ceph-mon[125440]: pgmap v20428: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:00 smithi136 ceph-mon[125702]: pgmap v20429: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:00 smithi057 ceph-mon[92072]: pgmap v20429: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:00 smithi122 ceph-mon[125440]: pgmap v20429: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:02 smithi136 ceph-mon[125702]: pgmap v20430: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:36:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:02 smithi057 ceph-mon[92072]: pgmap v20430: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:36:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:02 smithi122 ceph-mon[125440]: pgmap v20430: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:36:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:03.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:36:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:03.282+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:36:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:03.282+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:36:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:03.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:36:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:03.282+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:36:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:04 smithi136 ceph-mon[125702]: pgmap v20431: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:36:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:04 smithi057 ceph-mon[92072]: pgmap v20431: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:36:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:04 smithi122 ceph-mon[125440]: pgmap v20431: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:36:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:06 smithi057 ceph-mon[92072]: pgmap v20432: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:36:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:06 smithi122 ceph-mon[125440]: pgmap v20432: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:36:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:06 smithi136 ceph-mon[125702]: pgmap v20432: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:36:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:07 smithi057 ceph-mon[92072]: osdmap e1350: 12 total, 12 up, 12 in 2023-03-02T21:36:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:07 smithi122 ceph-mon[125440]: osdmap e1350: 12 total, 12 up, 12 in 2023-03-02T21:36:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:07 smithi136 ceph-mon[125702]: osdmap e1350: 12 total, 12 up, 12 in 2023-03-02T21:36:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:08 smithi057 ceph-mon[92072]: pgmap v20434: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:36:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:08 smithi122 ceph-mon[125440]: pgmap v20434: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:36:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:08 smithi136 ceph-mon[125702]: pgmap v20434: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:36:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:10 smithi136 ceph-mon[125702]: pgmap v20435: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:36:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:10 smithi136 ceph-mon[125702]: osdmap e1351: 12 total, 12 up, 12 in 2023-03-02T21:36:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:10 smithi057 ceph-mon[92072]: pgmap v20435: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:36:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:10 smithi057 ceph-mon[92072]: osdmap e1351: 12 total, 12 up, 12 in 2023-03-02T21:36:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:10 smithi122 ceph-mon[125440]: pgmap v20435: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:36:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:10 smithi122 ceph-mon[125440]: osdmap e1351: 12 total, 12 up, 12 in 2023-03-02T21:36:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:12 smithi136 ceph-mon[125702]: pgmap v20437: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:36:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:12 smithi057 ceph-mon[92072]: pgmap v20437: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:36:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:12 smithi122 ceph-mon[125440]: pgmap v20437: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:36:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:14 smithi136 ceph-mon[125702]: pgmap v20438: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:36:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:14 smithi057 ceph-mon[92072]: pgmap v20438: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:36:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:14 smithi122 ceph-mon[125440]: pgmap v20438: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:36:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:16 smithi057 ceph-mon[92072]: pgmap v20439: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:36:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:16 smithi122 ceph-mon[125440]: pgmap v20439: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:36:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:16 smithi136 ceph-mon[125702]: pgmap v20439: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:36:18.300 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:18.298+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:36:18.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:18.298+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:36:18.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:18.298+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:36:18.301 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:18.298+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:36:18.302 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:18.298+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:36:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:18 smithi136 ceph-mon[125702]: pgmap v20440: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:36:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:18 smithi057 ceph-mon[92072]: pgmap v20440: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:36:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:18 smithi122 ceph-mon[125440]: pgmap v20440: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:36:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:20 smithi136 ceph-mon[125702]: pgmap v20441: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:36:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:20 smithi057 ceph-mon[92072]: pgmap v20441: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:36:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:20 smithi122 ceph-mon[125440]: pgmap v20441: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:36:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:22 smithi136 ceph-mon[125702]: pgmap v20442: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:36:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:22 smithi057 ceph-mon[92072]: pgmap v20442: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:36:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:22 smithi122 ceph-mon[125440]: pgmap v20442: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:36:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:24 smithi136 ceph-mon[125702]: pgmap v20443: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:36:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:24 smithi057 ceph-mon[92072]: pgmap v20443: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:36:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:24 smithi122 ceph-mon[125440]: pgmap v20443: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:36:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:26 smithi057 ceph-mon[92072]: pgmap v20444: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:26 smithi122 ceph-mon[125440]: pgmap v20444: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:26 smithi136 ceph-mon[125702]: pgmap v20444: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:28 smithi136 ceph-mon[125702]: pgmap v20445: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:28 smithi057 ceph-mon[92072]: pgmap v20445: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:28 smithi122 ceph-mon[125440]: pgmap v20445: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:30 smithi136 ceph-mon[125702]: pgmap v20446: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:30 smithi057 ceph-mon[92072]: pgmap v20446: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:30 smithi122 ceph-mon[125440]: pgmap v20446: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:32 smithi136 ceph-mon[125702]: pgmap v20447: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:36:33.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:36:33.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:36:33.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:32 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:36:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:32 smithi057 ceph-mon[92072]: pgmap v20447: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:36:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:36:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:36:33.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:32 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:36:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:32 smithi122 ceph-mon[125440]: pgmap v20447: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:36:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:36:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:36:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:32 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:36:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:33.314+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:36:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:33.315+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:36:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:33.315+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:36:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:33.315+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:36:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:33.315+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:36:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:36:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:36:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:36:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:36:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:36:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:36:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:36:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:36:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:36:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:34 smithi136 ceph-mon[125702]: pgmap v20448: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:36:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:34 smithi057 ceph-mon[92072]: pgmap v20448: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:36:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:34 smithi122 ceph-mon[125440]: pgmap v20448: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:36:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:36 smithi057 ceph-mon[92072]: pgmap v20449: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:36 smithi122 ceph-mon[125440]: pgmap v20449: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:36 smithi136 ceph-mon[125702]: pgmap v20449: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:39.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:38 smithi136 ceph-mon[125702]: pgmap v20450: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:38 smithi057 ceph-mon[92072]: pgmap v20450: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:38 smithi122 ceph-mon[125440]: pgmap v20450: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:41.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:40 smithi136 ceph-mon[125702]: pgmap v20451: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:40 smithi057 ceph-mon[92072]: pgmap v20451: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:40 smithi122 ceph-mon[125440]: pgmap v20451: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:43.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:42 smithi136 ceph-mon[125702]: pgmap v20452: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:36:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:42 smithi057 ceph-mon[92072]: pgmap v20452: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:36:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:42 smithi122 ceph-mon[125440]: pgmap v20452: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:36:45.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:44 smithi136 ceph-mon[125702]: pgmap v20453: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:36:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:44 smithi057 ceph-mon[92072]: pgmap v20453: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:36:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:44 smithi122 ceph-mon[125440]: pgmap v20453: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:36:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:46 smithi057 ceph-mon[92072]: pgmap v20454: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:46 smithi122 ceph-mon[125440]: pgmap v20454: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:46 smithi136 ceph-mon[125702]: pgmap v20454: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:48.329+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:36:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:48.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:36:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:48.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:36:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:48.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:36:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:36:48.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:36:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:48 smithi136 ceph-mon[125702]: pgmap v20455: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:48 smithi057 ceph-mon[92072]: pgmap v20455: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:48 smithi122 ceph-mon[125440]: pgmap v20455: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:50 smithi136 ceph-mon[125702]: pgmap v20456: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:50 smithi057 ceph-mon[92072]: pgmap v20456: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:50 smithi122 ceph-mon[125440]: pgmap v20456: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:52 smithi136 ceph-mon[125702]: pgmap v20457: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:36:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:52 smithi057 ceph-mon[92072]: pgmap v20457: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:36:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:52 smithi122 ceph-mon[125440]: pgmap v20457: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:36:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:54 smithi136 ceph-mon[125702]: pgmap v20458: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:36:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:54 smithi057 ceph-mon[92072]: pgmap v20458: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:36:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:54 smithi122 ceph-mon[125440]: pgmap v20458: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:36:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:56 smithi122 ceph-mon[125440]: pgmap v20459: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:56 smithi136 ceph-mon[125702]: pgmap v20459: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:56 smithi057 ceph-mon[92072]: pgmap v20459: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:36:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:36:58 smithi136 ceph-mon[125702]: pgmap v20460: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:36:58 smithi057 ceph-mon[92072]: pgmap v20460: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:36:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:36:58 smithi122 ceph-mon[125440]: pgmap v20460: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:00 smithi136 ceph-mon[125702]: pgmap v20461: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:00 smithi057 ceph-mon[92072]: pgmap v20461: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:00 smithi122 ceph-mon[125440]: pgmap v20461: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:02 smithi136 ceph-mon[125702]: pgmap v20462: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:37:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:02 smithi057 ceph-mon[92072]: pgmap v20462: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:37:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:02 smithi122 ceph-mon[125440]: pgmap v20462: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:37:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:03.345+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:37:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:03.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:37:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:03.346+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:37:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:03.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:37:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:03.346+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:37:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:04 smithi136 ceph-mon[125702]: pgmap v20463: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:37:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:04 smithi057 ceph-mon[92072]: pgmap v20463: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:37:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:04 smithi122 ceph-mon[125440]: pgmap v20463: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:37:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:06 smithi057 ceph-mon[92072]: pgmap v20464: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:37:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:06 smithi122 ceph-mon[125440]: pgmap v20464: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:37:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:06 smithi136 ceph-mon[125702]: pgmap v20464: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:37:07.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:07 smithi057 ceph-mon[92072]: osdmap e1352: 12 total, 12 up, 12 in 2023-03-02T21:37:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:07 smithi122 ceph-mon[125440]: osdmap e1352: 12 total, 12 up, 12 in 2023-03-02T21:37:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:07 smithi136 ceph-mon[125702]: osdmap e1352: 12 total, 12 up, 12 in 2023-03-02T21:37:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:08 smithi122 ceph-mon[125440]: pgmap v20466: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:37:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:08 smithi136 ceph-mon[125702]: pgmap v20466: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:37:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:08 smithi057 ceph-mon[92072]: pgmap v20466: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:37:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:10 smithi136 ceph-mon[125702]: pgmap v20467: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:37:11.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:10 smithi136 ceph-mon[125702]: osdmap e1353: 12 total, 12 up, 12 in 2023-03-02T21:37:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:10 smithi057 ceph-mon[92072]: pgmap v20467: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:37:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:10 smithi057 ceph-mon[92072]: osdmap e1353: 12 total, 12 up, 12 in 2023-03-02T21:37:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:10 smithi122 ceph-mon[125440]: pgmap v20467: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:37:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:10 smithi122 ceph-mon[125440]: osdmap e1353: 12 total, 12 up, 12 in 2023-03-02T21:37:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:12 smithi136 ceph-mon[125702]: pgmap v20469: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:37:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:12 smithi057 ceph-mon[92072]: pgmap v20469: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:37:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:12 smithi122 ceph-mon[125440]: pgmap v20469: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:37:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:14 smithi136 ceph-mon[125702]: pgmap v20470: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:37:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:14 smithi057 ceph-mon[92072]: pgmap v20470: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:37:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:14 smithi122 ceph-mon[125440]: pgmap v20470: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:37:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:16 smithi122 ceph-mon[125440]: pgmap v20471: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:37:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:16 smithi136 ceph-mon[125702]: pgmap v20471: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:37:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:16 smithi057 ceph-mon[92072]: pgmap v20471: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:37:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:18.355+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:37:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:18.355+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:37:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:18.355+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:37:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:18.355+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:37:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:18.355+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:37:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:18 smithi136 ceph-mon[125702]: pgmap v20472: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:37:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:18 smithi057 ceph-mon[92072]: pgmap v20472: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:37:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:18 smithi122 ceph-mon[125440]: pgmap v20472: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:37:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:20 smithi136 ceph-mon[125702]: pgmap v20473: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:37:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:20 smithi057 ceph-mon[92072]: pgmap v20473: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:37:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:20 smithi122 ceph-mon[125440]: pgmap v20473: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:37:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:22 smithi136 ceph-mon[125702]: pgmap v20474: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:37:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:22 smithi057 ceph-mon[92072]: pgmap v20474: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:37:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:22 smithi122 ceph-mon[125440]: pgmap v20474: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:37:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:24 smithi136 ceph-mon[125702]: pgmap v20475: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:37:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:24 smithi057 ceph-mon[92072]: pgmap v20475: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:37:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:24 smithi122 ceph-mon[125440]: pgmap v20475: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:37:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:26 smithi122 ceph-mon[125440]: pgmap v20476: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:26 smithi136 ceph-mon[125702]: pgmap v20476: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:26 smithi057 ceph-mon[92072]: pgmap v20476: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:29.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:28 smithi136 ceph-mon[125702]: pgmap v20477: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:28 smithi057 ceph-mon[92072]: pgmap v20477: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:28 smithi122 ceph-mon[125440]: pgmap v20477: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:30 smithi136 ceph-mon[125702]: pgmap v20478: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:30 smithi057 ceph-mon[92072]: pgmap v20478: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:30 smithi122 ceph-mon[125440]: pgmap v20478: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:32 smithi136 ceph-mon[125702]: pgmap v20479: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:37:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:32 smithi057 ceph-mon[92072]: pgmap v20479: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:37:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:32 smithi122 ceph-mon[125440]: pgmap v20479: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:37:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:33.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:37:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:33.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:37:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:33.364+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:37:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:33.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:37:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:33.364+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:37:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:37:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:37:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:37:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:34 smithi136 ceph-mon[125702]: pgmap v20480: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:37:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:35.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:34 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:34 smithi057 ceph-mon[92072]: pgmap v20480: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:37:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:35.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:35.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:35.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:34 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:34 smithi122 ceph-mon[125440]: pgmap v20480: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:37:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:35.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:34 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:37:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:37:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:37:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:37:36.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:37:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:37:36.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:37:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:36 smithi136 ceph-mon[125702]: pgmap v20481: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:36 smithi057 ceph-mon[92072]: pgmap v20481: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:36 smithi122 ceph-mon[125440]: pgmap v20481: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:38 smithi057 ceph-mon[92072]: pgmap v20482: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:38 smithi122 ceph-mon[125440]: pgmap v20482: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:38 smithi136 ceph-mon[125702]: pgmap v20482: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:40 smithi057 ceph-mon[92072]: pgmap v20483: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:40 smithi122 ceph-mon[125440]: pgmap v20483: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:40 smithi136 ceph-mon[125702]: pgmap v20483: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:42 smithi057 ceph-mon[92072]: pgmap v20484: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-02T21:37:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:42 smithi122 ceph-mon[125440]: pgmap v20484: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-02T21:37:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:42 smithi136 ceph-mon[125702]: pgmap v20484: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-02T21:37:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:44 smithi057 ceph-mon[92072]: pgmap v20485: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-03-02T21:37:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:44 smithi122 ceph-mon[125440]: pgmap v20485: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-03-02T21:37:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:44 smithi136 ceph-mon[125702]: pgmap v20485: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-03-02T21:37:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:46 smithi122 ceph-mon[125440]: pgmap v20486: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:37:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:46 smithi136 ceph-mon[125702]: pgmap v20486: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:37:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:46 smithi057 ceph-mon[92072]: pgmap v20486: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:37:48.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:48.380+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:37:48.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:48.380+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:37:48.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:48.380+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:37:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:48.380+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:37:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:37:48.380+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:37:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:48 smithi136 ceph-mon[125702]: pgmap v20487: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:48 smithi057 ceph-mon[92072]: pgmap v20487: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:48 smithi122 ceph-mon[125440]: pgmap v20487: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:50 smithi136 ceph-mon[125702]: pgmap v20488: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:37:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:50 smithi057 ceph-mon[92072]: pgmap v20488: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:37:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:50 smithi122 ceph-mon[125440]: pgmap v20488: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:37:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:52 smithi136 ceph-mon[125702]: pgmap v20489: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-02T21:37:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:52 smithi057 ceph-mon[92072]: pgmap v20489: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-02T21:37:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:52 smithi122 ceph-mon[125440]: pgmap v20489: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-02T21:37:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:54 smithi136 ceph-mon[125702]: pgmap v20490: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:37:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:54 smithi057 ceph-mon[92072]: pgmap v20490: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:37:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:54 smithi122 ceph-mon[125440]: pgmap v20490: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:37:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:56 smithi122 ceph-mon[125440]: pgmap v20491: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:56 smithi136 ceph-mon[125702]: pgmap v20491: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:56 smithi057 ceph-mon[92072]: pgmap v20491: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:37:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:37:58 smithi136 ceph-mon[125702]: pgmap v20492: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:37:58 smithi057 ceph-mon[92072]: pgmap v20492: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:37:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:37:58 smithi122 ceph-mon[125440]: pgmap v20492: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:00 smithi136 ceph-mon[125702]: pgmap v20493: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:00 smithi057 ceph-mon[92072]: pgmap v20493: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:00 smithi122 ceph-mon[125440]: pgmap v20493: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:02 smithi136 ceph-mon[125702]: pgmap v20494: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:38:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:02 smithi057 ceph-mon[92072]: pgmap v20494: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:38:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:02 smithi122 ceph-mon[125440]: pgmap v20494: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:38:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:03.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:38:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:03.390+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:38:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:03.390+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:38:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:03.390+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:38:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:03.390+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:38:05.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:04 smithi136 ceph-mon[125702]: pgmap v20495: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:38:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:04 smithi057 ceph-mon[92072]: pgmap v20495: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:38:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:04 smithi122 ceph-mon[125440]: pgmap v20495: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:38:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:06 smithi122 ceph-mon[125440]: pgmap v20496: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:38:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:06 smithi136 ceph-mon[125702]: pgmap v20496: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:38:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:06 smithi057 ceph-mon[92072]: pgmap v20496: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:38:07.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:07 smithi122 ceph-mon[125440]: osdmap e1354: 12 total, 12 up, 12 in 2023-03-02T21:38:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:07 smithi136 ceph-mon[125702]: osdmap e1354: 12 total, 12 up, 12 in 2023-03-02T21:38:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:07 smithi057 ceph-mon[92072]: osdmap e1354: 12 total, 12 up, 12 in 2023-03-02T21:38:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:08 smithi136 ceph-mon[125702]: pgmap v20498: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:38:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:08 smithi057 ceph-mon[92072]: pgmap v20498: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:38:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:08 smithi122 ceph-mon[125440]: pgmap v20498: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:38:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:10 smithi136 ceph-mon[125702]: pgmap v20499: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:38:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:10 smithi057 ceph-mon[92072]: pgmap v20499: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:38:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:10 smithi122 ceph-mon[125440]: pgmap v20499: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:38:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:12 smithi136 ceph-mon[125702]: pgmap v20500: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:38:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:12 smithi057 ceph-mon[92072]: pgmap v20500: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:38:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:12 smithi122 ceph-mon[125440]: pgmap v20500: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:38:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:13.919+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:38:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:13.919+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:38:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:13.919+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 296 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:38:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:13.919+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 295 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:38:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:14 smithi136 ceph-mon[125702]: pgmap v20501: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:38:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:14 smithi057 ceph-mon[92072]: pgmap v20501: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:38:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:14 smithi122 ceph-mon[125440]: pgmap v20501: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:38:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:16 smithi122 ceph-mon[125440]: osdmap e1355: 12 total, 12 up, 12 in 2023-03-02T21:38:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:16 smithi122 ceph-mon[125440]: pgmap v20503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:38:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:16 smithi136 ceph-mon[125702]: osdmap e1355: 12 total, 12 up, 12 in 2023-03-02T21:38:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:16 smithi136 ceph-mon[125702]: pgmap v20503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:38:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:16 smithi057 ceph-mon[92072]: osdmap e1355: 12 total, 12 up, 12 in 2023-03-02T21:38:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:16 smithi057 ceph-mon[92072]: pgmap v20503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:38:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:18.402+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:38:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:18.403+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:38:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:18.403+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:38:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:18.403+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:38:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:18.403+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:38:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:18 smithi136 ceph-mon[125702]: pgmap v20504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:38:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:18 smithi057 ceph-mon[92072]: pgmap v20504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:38:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:18 smithi122 ceph-mon[125440]: pgmap v20504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:38:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:20 smithi136 ceph-mon[125702]: pgmap v20505: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:38:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:20 smithi057 ceph-mon[92072]: pgmap v20505: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:38:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:20 smithi122 ceph-mon[125440]: pgmap v20505: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:38:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:22 smithi136 ceph-mon[125702]: pgmap v20506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:38:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:22 smithi057 ceph-mon[92072]: pgmap v20506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:38:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:22 smithi122 ceph-mon[125440]: pgmap v20506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:38:25.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:24 smithi136 ceph-mon[125702]: pgmap v20507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:38:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:24 smithi057 ceph-mon[92072]: pgmap v20507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:38:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:24 smithi122 ceph-mon[125440]: pgmap v20507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:38:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:26 smithi136 ceph-mon[125702]: pgmap v20508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:38:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:26 smithi057 ceph-mon[92072]: pgmap v20508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:38:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:26 smithi122 ceph-mon[125440]: pgmap v20508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:38:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:28 smithi136 ceph-mon[125702]: pgmap v20509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:28 smithi057 ceph-mon[92072]: pgmap v20509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:28 smithi122 ceph-mon[125440]: pgmap v20509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:31.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:30 smithi136 ceph-mon[125702]: pgmap v20510: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:30 smithi057 ceph-mon[92072]: pgmap v20510: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:30 smithi122 ceph-mon[125440]: pgmap v20510: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:33.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:32 smithi136 ceph-mon[125702]: pgmap v20511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:38:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:32 smithi057 ceph-mon[92072]: pgmap v20511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:38:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:32 smithi122 ceph-mon[125440]: pgmap v20511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:38:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:33.416+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:38:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:33.416+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:38:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:33.416+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:38:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:33.416+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:38:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:33.416+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:38:35.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:34 smithi136 ceph-mon[125702]: pgmap v20512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:38:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:34 smithi057 ceph-mon[92072]: pgmap v20512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:38:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:34 smithi122 ceph-mon[125440]: pgmap v20512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:38:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:35 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:38:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:35 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:38:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:35 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:38:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:36 smithi136 ceph-mon[125702]: pgmap v20513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:37.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:38:37.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:38:37.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:38:37.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:36 smithi057 ceph-mon[92072]: pgmap v20513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:37.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:38:37.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:38:37.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:38:37.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:36 smithi122 ceph-mon[125440]: pgmap v20513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:37.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:38:37.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:38:37.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:38:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:38 smithi057 ceph-mon[92072]: pgmap v20514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:38 smithi122 ceph-mon[125440]: pgmap v20514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:38 smithi136 ceph-mon[125702]: pgmap v20514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:40 smithi057 ceph-mon[92072]: pgmap v20515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:40 smithi122 ceph-mon[125440]: pgmap v20515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:40 smithi136 ceph-mon[125702]: pgmap v20515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:42 smithi057 ceph-mon[92072]: pgmap v20516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:38:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:42 smithi122 ceph-mon[125440]: pgmap v20516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:38:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:42 smithi136 ceph-mon[125702]: pgmap v20516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:38:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:44 smithi057 ceph-mon[92072]: pgmap v20517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:38:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:44 smithi122 ceph-mon[125440]: pgmap v20517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:38:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:44 smithi136 ceph-mon[125702]: pgmap v20517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:38:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:46 smithi136 ceph-mon[125702]: pgmap v20518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:46 smithi057 ceph-mon[92072]: pgmap v20518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:46 smithi122 ceph-mon[125440]: pgmap v20518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:48.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:38:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:48.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:38:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:48.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:38:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:48.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:38:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:38:48.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:38:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:48 smithi136 ceph-mon[125702]: pgmap v20519: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:48 smithi057 ceph-mon[92072]: pgmap v20519: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:48 smithi122 ceph-mon[125440]: pgmap v20519: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:51.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:50 smithi136 ceph-mon[125702]: pgmap v20520: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:50 smithi057 ceph-mon[92072]: pgmap v20520: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:50 smithi122 ceph-mon[125440]: pgmap v20520: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:53.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:52 smithi136 ceph-mon[125702]: pgmap v20521: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:38:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:52 smithi057 ceph-mon[92072]: pgmap v20521: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:38:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:52 smithi122 ceph-mon[125440]: pgmap v20521: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:38:55.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:54 smithi136 ceph-mon[125702]: pgmap v20522: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:38:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:54 smithi057 ceph-mon[92072]: pgmap v20522: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:38:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:54 smithi122 ceph-mon[125440]: pgmap v20522: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:38:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:56 smithi136 ceph-mon[125702]: pgmap v20523: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:56 smithi057 ceph-mon[92072]: pgmap v20523: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:56 smithi122 ceph-mon[125440]: pgmap v20523: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:38:59.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:38:58 smithi136 ceph-mon[125702]: pgmap v20524: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:38:58 smithi057 ceph-mon[92072]: pgmap v20524: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:38:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:38:58 smithi122 ceph-mon[125440]: pgmap v20524: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:01.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:00 smithi136 ceph-mon[125702]: pgmap v20525: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:00 smithi057 ceph-mon[92072]: pgmap v20525: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:00 smithi122 ceph-mon[125440]: pgmap v20525: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:03.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:02 smithi136 ceph-mon[125702]: pgmap v20526: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:39:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:02 smithi057 ceph-mon[92072]: pgmap v20526: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:39:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:02 smithi122 ceph-mon[125440]: pgmap v20526: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:39:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:03.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:39:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:03.436+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:39:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:03.436+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:39:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:03.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:39:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:03.436+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:39:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:04 smithi057 ceph-mon[92072]: pgmap v20527: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:39:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:04 smithi122 ceph-mon[125440]: pgmap v20527: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:39:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:04 smithi136 ceph-mon[125702]: pgmap v20527: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:39:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:06 smithi136 ceph-mon[125702]: pgmap v20528: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:39:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:06 smithi057 ceph-mon[92072]: pgmap v20528: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:39:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:06 smithi122 ceph-mon[125440]: pgmap v20528: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:39:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:07 smithi136 ceph-mon[125702]: osdmap e1356: 12 total, 12 up, 12 in 2023-03-02T21:39:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:07 smithi057 ceph-mon[92072]: osdmap e1356: 12 total, 12 up, 12 in 2023-03-02T21:39:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:07 smithi122 ceph-mon[125440]: osdmap e1356: 12 total, 12 up, 12 in 2023-03-02T21:39:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:08 smithi136 ceph-mon[125702]: pgmap v20530: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:39:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:08 smithi057 ceph-mon[92072]: pgmap v20530: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:39:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:08 smithi122 ceph-mon[125440]: pgmap v20530: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:39:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:10 smithi136 ceph-mon[125702]: pgmap v20531: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:39:11.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:10 smithi136 ceph-mon[125702]: osdmap e1357: 12 total, 12 up, 12 in 2023-03-02T21:39:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:10 smithi057 ceph-mon[92072]: pgmap v20531: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:39:11.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:10 smithi057 ceph-mon[92072]: osdmap e1357: 12 total, 12 up, 12 in 2023-03-02T21:39:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:10 smithi122 ceph-mon[125440]: pgmap v20531: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:39:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:10 smithi122 ceph-mon[125440]: osdmap e1357: 12 total, 12 up, 12 in 2023-03-02T21:39:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:12 smithi136 ceph-mon[125702]: pgmap v20533: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:39:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:12 smithi057 ceph-mon[92072]: pgmap v20533: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:39:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:12 smithi122 ceph-mon[125440]: pgmap v20533: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:39:15.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:14 smithi136 ceph-mon[125702]: pgmap v20534: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:39:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:14 smithi057 ceph-mon[92072]: pgmap v20534: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:39:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:14 smithi122 ceph-mon[125440]: pgmap v20534: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:39:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:16 smithi136 ceph-mon[125702]: pgmap v20535: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:39:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:16 smithi057 ceph-mon[92072]: pgmap v20535: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:39:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:16 smithi122 ceph-mon[125440]: pgmap v20535: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:39:18.452 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:18.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:39:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:18.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:39:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:18.450+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:39:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:18.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:39:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:18.450+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:39:19.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:18 smithi136 ceph-mon[125702]: pgmap v20536: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:39:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:18 smithi057 ceph-mon[92072]: pgmap v20536: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:39:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:18 smithi122 ceph-mon[125440]: pgmap v20536: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:39:21.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:20 smithi136 ceph-mon[125702]: pgmap v20537: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:39:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:20 smithi057 ceph-mon[92072]: pgmap v20537: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:39:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:20 smithi122 ceph-mon[125440]: pgmap v20537: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:39:23.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:22 smithi136 ceph-mon[125702]: pgmap v20538: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:39:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:22 smithi057 ceph-mon[92072]: pgmap v20538: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:39:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:22 smithi122 ceph-mon[125440]: pgmap v20538: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 10 op/s 2023-03-02T21:39:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:24 smithi057 ceph-mon[92072]: pgmap v20539: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:39:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:24 smithi122 ceph-mon[125440]: pgmap v20539: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:39:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:24 smithi136 ceph-mon[125702]: pgmap v20539: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:39:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:26 smithi136 ceph-mon[125702]: pgmap v20540: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:26 smithi057 ceph-mon[92072]: pgmap v20540: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:26 smithi122 ceph-mon[125440]: pgmap v20540: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:29.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:28 smithi136 ceph-mon[125702]: pgmap v20541: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:28 smithi057 ceph-mon[92072]: pgmap v20541: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:28 smithi122 ceph-mon[125440]: pgmap v20541: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:31.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:30 smithi136 ceph-mon[125702]: pgmap v20542: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:30 smithi057 ceph-mon[92072]: pgmap v20542: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:30 smithi122 ceph-mon[125440]: pgmap v20542: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:32 smithi057 ceph-mon[92072]: pgmap v20543: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:39:33.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:32 smithi122 ceph-mon[125440]: pgmap v20543: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:39:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:32 smithi136 ceph-mon[125702]: pgmap v20543: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:39:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:33.466+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:39:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:33.466+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:39:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:33.466+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:39:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:33.466+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:39:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:33.466+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:39:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:34 smithi057 ceph-mon[92072]: pgmap v20544: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:39:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:34 smithi122 ceph-mon[125440]: pgmap v20544: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:39:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:34 smithi136 ceph-mon[125702]: pgmap v20544: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:39:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:36 smithi136 ceph-mon[125702]: pgmap v20545: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:36.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:39:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:36 smithi057 ceph-mon[92072]: pgmap v20545: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:36.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:39:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:36 smithi122 ceph-mon[125440]: pgmap v20545: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:36.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:39:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:39:37.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:39:37.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:37 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:39:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:39:37.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:39:37.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:37 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:39:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:39:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:39:37.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:37 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:39:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:38 smithi136 ceph-mon[125702]: pgmap v20546: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:38 smithi057 ceph-mon[92072]: pgmap v20546: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:38 smithi122 ceph-mon[125440]: pgmap v20546: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:40 smithi057 ceph-mon[92072]: pgmap v20547: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:40 smithi122 ceph-mon[125440]: pgmap v20547: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:40 smithi136 ceph-mon[125702]: pgmap v20547: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:42 smithi057 ceph-mon[92072]: pgmap v20548: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:39:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:42 smithi122 ceph-mon[125440]: pgmap v20548: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:39:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:42 smithi136 ceph-mon[125702]: pgmap v20548: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:39:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:44 smithi057 ceph-mon[92072]: pgmap v20549: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:39:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:44 smithi122 ceph-mon[125440]: pgmap v20549: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:39:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:44 smithi136 ceph-mon[125702]: pgmap v20549: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:39:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:46 smithi136 ceph-mon[125702]: pgmap v20550: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:46 smithi057 ceph-mon[92072]: pgmap v20550: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:46 smithi122 ceph-mon[125440]: pgmap v20550: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:48.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:39:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:48.482+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:39:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:48.482+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:39:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:48.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:39:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:39:48.482+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:39:49.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:48 smithi136 ceph-mon[125702]: pgmap v20551: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:48 smithi057 ceph-mon[92072]: pgmap v20551: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:48 smithi122 ceph-mon[125440]: pgmap v20551: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:50 smithi057 ceph-mon[92072]: pgmap v20552: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:50 smithi122 ceph-mon[125440]: pgmap v20552: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:50 smithi136 ceph-mon[125702]: pgmap v20552: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:52 smithi057 ceph-mon[92072]: pgmap v20553: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:39:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:52 smithi122 ceph-mon[125440]: pgmap v20553: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:39:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:52 smithi136 ceph-mon[125702]: pgmap v20553: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-03-02T21:39:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:54 smithi057 ceph-mon[92072]: pgmap v20554: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:39:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:54 smithi122 ceph-mon[125440]: pgmap v20554: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:39:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:54 smithi136 ceph-mon[125702]: pgmap v20554: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-02T21:39:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:56 smithi136 ceph-mon[125702]: pgmap v20555: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:56 smithi057 ceph-mon[92072]: pgmap v20555: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:56 smithi122 ceph-mon[125440]: pgmap v20555: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:39:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:39:58 smithi057 ceph-mon[92072]: pgmap v20556: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:39:58 smithi122 ceph-mon[125440]: pgmap v20556: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:39:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:39:58 smithi136 ceph-mon[125702]: pgmap v20556: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:00 smithi057 ceph-mon[92072]: pgmap v20557: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:01.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T21:40:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:00 smithi122 ceph-mon[125440]: pgmap v20557: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:01.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T21:40:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:00 smithi136 ceph-mon[125702]: pgmap v20557: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T21:40:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:02 smithi057 ceph-mon[92072]: pgmap v20558: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:40:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:02 smithi122 ceph-mon[125440]: pgmap v20558: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:40:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:02 smithi136 ceph-mon[125702]: pgmap v20558: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:40:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:03.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:40:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:03.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:40:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:03.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:40:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:03.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:40:03.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:03.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:40:05.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:04 smithi057 ceph-mon[92072]: pgmap v20559: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:40:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:04 smithi122 ceph-mon[125440]: pgmap v20559: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:40:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:04 smithi136 ceph-mon[125702]: pgmap v20559: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-02T21:40:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:06 smithi136 ceph-mon[125702]: pgmap v20560: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:40:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:06 smithi057 ceph-mon[92072]: pgmap v20560: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:40:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:06 smithi122 ceph-mon[125440]: pgmap v20560: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:40:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:07 smithi136 ceph-mon[125702]: osdmap e1358: 12 total, 12 up, 12 in 2023-03-02T21:40:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:07 smithi057 ceph-mon[92072]: osdmap e1358: 12 total, 12 up, 12 in 2023-03-02T21:40:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:07 smithi122 ceph-mon[125440]: osdmap e1358: 12 total, 12 up, 12 in 2023-03-02T21:40:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:08 smithi136 ceph-mon[125702]: pgmap v20562: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:40:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:08 smithi057 ceph-mon[92072]: pgmap v20562: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:40:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:08 smithi122 ceph-mon[125440]: pgmap v20562: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:40:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:10 smithi057 ceph-mon[92072]: pgmap v20563: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:40:11.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:10 smithi057 ceph-mon[92072]: osdmap e1359: 12 total, 12 up, 12 in 2023-03-02T21:40:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:10 smithi122 ceph-mon[125440]: pgmap v20563: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:40:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:10 smithi122 ceph-mon[125440]: osdmap e1359: 12 total, 12 up, 12 in 2023-03-02T21:40:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:10 smithi136 ceph-mon[125702]: pgmap v20563: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:40:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:10 smithi136 ceph-mon[125702]: osdmap e1359: 12 total, 12 up, 12 in 2023-03-02T21:40:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:12 smithi057 ceph-mon[92072]: pgmap v20565: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:40:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:12 smithi122 ceph-mon[125440]: pgmap v20565: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:40:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:12 smithi136 ceph-mon[125702]: pgmap v20565: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-03-02T21:40:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:14 smithi057 ceph-mon[92072]: pgmap v20566: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:40:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:14 smithi122 ceph-mon[125440]: pgmap v20566: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:40:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:14 smithi136 ceph-mon[125702]: pgmap v20566: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:40:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:16 smithi136 ceph-mon[125702]: pgmap v20567: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:40:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:16 smithi057 ceph-mon[92072]: pgmap v20567: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:40:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:16 smithi122 ceph-mon[125440]: pgmap v20567: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:40:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:18.505+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:40:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:18.505+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:40:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:18.505+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:40:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:18.505+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:40:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:18.505+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:40:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:18 smithi057 ceph-mon[92072]: pgmap v20568: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:40:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:18 smithi122 ceph-mon[125440]: pgmap v20568: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:40:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:18 smithi136 ceph-mon[125702]: pgmap v20568: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:40:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:20 smithi057 ceph-mon[92072]: pgmap v20569: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:40:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:20 smithi122 ceph-mon[125440]: pgmap v20569: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:40:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:20 smithi136 ceph-mon[125702]: pgmap v20569: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:40:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:22 smithi057 ceph-mon[92072]: pgmap v20570: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 11 op/s 2023-03-02T21:40:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:22 smithi122 ceph-mon[125440]: pgmap v20570: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 11 op/s 2023-03-02T21:40:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:22 smithi136 ceph-mon[125702]: pgmap v20570: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 88 B/s wr, 11 op/s 2023-03-02T21:40:25.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:24 smithi136 ceph-mon[125702]: pgmap v20571: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:40:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:24 smithi057 ceph-mon[92072]: pgmap v20571: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:40:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:24 smithi122 ceph-mon[125440]: pgmap v20571: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-03-02T21:40:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:26 smithi136 ceph-mon[125702]: pgmap v20572: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:26 smithi057 ceph-mon[92072]: pgmap v20572: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:26 smithi122 ceph-mon[125440]: pgmap v20572: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:28 smithi057 ceph-mon[92072]: pgmap v20573: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:28 smithi122 ceph-mon[125440]: pgmap v20573: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:28 smithi136 ceph-mon[125702]: pgmap v20573: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:30 smithi057 ceph-mon[92072]: pgmap v20574: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:31.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:30 smithi122 ceph-mon[125440]: pgmap v20574: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:30 smithi136 ceph-mon[125702]: pgmap v20574: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:32 smithi057 ceph-mon[92072]: pgmap v20575: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T21:40:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:32 smithi122 ceph-mon[125440]: pgmap v20575: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T21:40:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:32 smithi136 ceph-mon[125702]: pgmap v20575: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T21:40:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:33.517+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:40:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:33.517+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:40:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:33.517+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:40:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:33.517+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:40:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:33.517+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:40:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:34 smithi057 ceph-mon[92072]: pgmap v20576: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T21:40:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:34 smithi122 ceph-mon[125440]: pgmap v20576: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T21:40:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:34 smithi136 ceph-mon[125702]: pgmap v20576: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T21:40:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:36 smithi136 ceph-mon[125702]: pgmap v20577: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:36 smithi057 ceph-mon[92072]: pgmap v20577: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:36 smithi122 ceph-mon[125440]: pgmap v20577: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:37.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:40:37.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:40:37.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:40:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:38 smithi136 ceph-mon[125702]: pgmap v20578: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:38.597 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:38 smithi057 ceph-mon[92072]: pgmap v20578: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:38 smithi122 ceph-mon[125440]: pgmap v20578: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:40.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:40 smithi057 ceph-mon[92072]: pgmap v20579: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:40:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:40:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:40:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:40:40.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:40:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:40 smithi122 ceph-mon[125440]: pgmap v20579: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:40:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:40:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:40:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:40:41.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:40:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:40 smithi136 ceph-mon[125702]: pgmap v20579: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:40:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:40:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:40:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:40:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:40:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:42 smithi057 ceph-mon[92072]: pgmap v20580: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T21:40:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:42 smithi122 ceph-mon[125440]: pgmap v20580: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T21:40:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:42 smithi136 ceph-mon[125702]: pgmap v20580: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T21:40:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:44 smithi057 ceph-mon[92072]: pgmap v20581: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T21:40:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:44 smithi122 ceph-mon[125440]: pgmap v20581: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T21:40:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:44 smithi136 ceph-mon[125702]: pgmap v20581: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T21:40:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:46 smithi136 ceph-mon[125702]: pgmap v20582: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:46 smithi057 ceph-mon[92072]: pgmap v20582: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:46 smithi122 ceph-mon[125440]: pgmap v20582: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:48.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:48.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:40:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:48.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:40:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:48.530+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:40:48.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:48.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:40:48.533 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:40:48.530+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:40:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:48 smithi057 ceph-mon[92072]: pgmap v20583: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:48 smithi122 ceph-mon[125440]: pgmap v20583: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:48 smithi136 ceph-mon[125702]: pgmap v20583: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:50 smithi057 ceph-mon[92072]: pgmap v20584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:50 smithi122 ceph-mon[125440]: pgmap v20584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:50 smithi136 ceph-mon[125702]: pgmap v20584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:52 smithi057 ceph-mon[92072]: pgmap v20585: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T21:40:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:52 smithi122 ceph-mon[125440]: pgmap v20585: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T21:40:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:52 smithi136 ceph-mon[125702]: pgmap v20585: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-02T21:40:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:54 smithi057 ceph-mon[92072]: pgmap v20586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T21:40:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:54 smithi122 ceph-mon[125440]: pgmap v20586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T21:40:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:54 smithi136 ceph-mon[125702]: pgmap v20586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-02T21:40:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:56 smithi136 ceph-mon[125702]: pgmap v20587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:56 smithi057 ceph-mon[92072]: pgmap v20587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:56 smithi122 ceph-mon[125440]: pgmap v20587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:40:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:40:58 smithi057 ceph-mon[92072]: pgmap v20588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:40:58 smithi122 ceph-mon[125440]: pgmap v20588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:40:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:40:58 smithi136 ceph-mon[125702]: pgmap v20588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:00 smithi057 ceph-mon[92072]: pgmap v20589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:00 smithi122 ceph-mon[125440]: pgmap v20589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:00 smithi136 ceph-mon[125702]: pgmap v20589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:02 smithi057 ceph-mon[92072]: pgmap v20590: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-02T21:41:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:02 smithi122 ceph-mon[125440]: pgmap v20590: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-02T21:41:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:02 smithi136 ceph-mon[125702]: pgmap v20590: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-02T21:41:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:03.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:41:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:03.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:41:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:03.545+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:41:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:03.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:41:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:03.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:41:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:04 smithi057 ceph-mon[92072]: pgmap v20591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T21:41:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:04 smithi122 ceph-mon[125440]: pgmap v20591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T21:41:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:04 smithi136 ceph-mon[125702]: pgmap v20591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-02T21:41:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:06 smithi136 ceph-mon[125702]: pgmap v20592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:41:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:06 smithi057 ceph-mon[92072]: pgmap v20592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:41:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:06 smithi122 ceph-mon[125440]: pgmap v20592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:41:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:07 smithi136 ceph-mon[125702]: osdmap e1360: 12 total, 12 up, 12 in 2023-03-02T21:41:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:07 smithi057 ceph-mon[92072]: osdmap e1360: 12 total, 12 up, 12 in 2023-03-02T21:41:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:07 smithi122 ceph-mon[125440]: osdmap e1360: 12 total, 12 up, 12 in 2023-03-02T21:41:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:08 smithi136 ceph-mon[125702]: pgmap v20594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:41:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:08 smithi057 ceph-mon[92072]: pgmap v20594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:41:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:08 smithi122 ceph-mon[125440]: pgmap v20594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:41:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:10 smithi057 ceph-mon[92072]: pgmap v20595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:41:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:10 smithi057 ceph-mon[92072]: osdmap e1361: 12 total, 12 up, 12 in 2023-03-02T21:41:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:10 smithi122 ceph-mon[125440]: pgmap v20595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:41:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:10 smithi122 ceph-mon[125440]: osdmap e1361: 12 total, 12 up, 12 in 2023-03-02T21:41:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:10 smithi136 ceph-mon[125702]: pgmap v20595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:41:11.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:10 smithi136 ceph-mon[125702]: osdmap e1361: 12 total, 12 up, 12 in 2023-03-02T21:41:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:12 smithi057 ceph-mon[92072]: pgmap v20597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:41:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:12 smithi122 ceph-mon[125440]: pgmap v20597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:41:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:12 smithi136 ceph-mon[125702]: pgmap v20597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:41:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:13.946+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006700 con 0x558558b6f6b0 2023-03-02T21:41:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:13.946+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:41:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:13.946+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 297 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:41:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:13.946+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 296 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58700b4070 con 0x558558b6f6b0 2023-03-02T21:41:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:14 smithi057 ceph-mon[92072]: pgmap v20598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:41:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:14 smithi122 ceph-mon[125440]: pgmap v20598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:41:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:14 smithi136 ceph-mon[125702]: pgmap v20598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:41:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:16 smithi136 ceph-mon[125702]: pgmap v20599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:41:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:16 smithi057 ceph-mon[92072]: pgmap v20599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:41:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:16 smithi122 ceph-mon[125440]: pgmap v20599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:41:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:18.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:41:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:18.560+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:41:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:18.560+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:41:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:18.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:41:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:18.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:41:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:18 smithi057 ceph-mon[92072]: pgmap v20600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:41:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:18 smithi122 ceph-mon[125440]: pgmap v20600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:41:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:18 smithi136 ceph-mon[125702]: pgmap v20600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:41:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:20 smithi057 ceph-mon[92072]: pgmap v20601: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:41:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:20 smithi122 ceph-mon[125440]: pgmap v20601: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:41:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:20 smithi136 ceph-mon[125702]: pgmap v20601: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:41:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:22 smithi057 ceph-mon[92072]: pgmap v20602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-02T21:41:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:22 smithi122 ceph-mon[125440]: pgmap v20602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-02T21:41:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:22 smithi136 ceph-mon[125702]: pgmap v20602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-02T21:41:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:24 smithi057 ceph-mon[92072]: pgmap v20603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:24 smithi122 ceph-mon[125440]: pgmap v20603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:24 smithi136 ceph-mon[125702]: pgmap v20603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:26 smithi136 ceph-mon[125702]: pgmap v20604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:26 smithi057 ceph-mon[92072]: pgmap v20604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:26.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:26 smithi122 ceph-mon[125440]: pgmap v20604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:28 smithi057 ceph-mon[92072]: pgmap v20605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:28 smithi122 ceph-mon[125440]: pgmap v20605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:28 smithi136 ceph-mon[125702]: pgmap v20605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:30 smithi057 ceph-mon[92072]: pgmap v20606: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:30 smithi122 ceph-mon[125440]: pgmap v20606: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:30 smithi136 ceph-mon[125702]: pgmap v20606: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:32 smithi057 ceph-mon[92072]: pgmap v20607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:32 smithi122 ceph-mon[125440]: pgmap v20607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:32 smithi136 ceph-mon[125702]: pgmap v20607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:33.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:41:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:33.575+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:41:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:33.575+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:41:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:33.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:41:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:33.575+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:41:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:34 smithi057 ceph-mon[92072]: pgmap v20608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:35.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:34 smithi122 ceph-mon[125440]: pgmap v20608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:34 smithi136 ceph-mon[125702]: pgmap v20608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:36 smithi136 ceph-mon[125702]: pgmap v20609: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:36 smithi057 ceph-mon[92072]: pgmap v20609: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:36 smithi122 ceph-mon[125440]: pgmap v20609: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:39.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:38 smithi057 ceph-mon[92072]: pgmap v20610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:38 smithi122 ceph-mon[125440]: pgmap v20610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:38 smithi136 ceph-mon[125702]: pgmap v20610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:40 smithi057 ceph-mon[92072]: pgmap v20611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:41.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:41:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:40 smithi122 ceph-mon[125440]: pgmap v20611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:41.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:41:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:40 smithi136 ceph-mon[125702]: pgmap v20611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:41:42.934 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:42 smithi122 ceph-mon[125440]: pgmap v20612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:42 smithi057 ceph-mon[92072]: pgmap v20612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:43.209 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:42 smithi136 ceph-mon[125702]: pgmap v20612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:44 smithi057 ceph-mon[92072]: pgmap v20613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:45.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:41:45.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:41:45.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:44 smithi122 ceph-mon[125440]: pgmap v20613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:41:45.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:41:45.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:44 smithi136 ceph-mon[125702]: pgmap v20613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:41:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:41:45.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:41:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:46 smithi136 ceph-mon[125702]: pgmap v20614: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:46 smithi057 ceph-mon[92072]: pgmap v20614: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:46 smithi122 ceph-mon[125440]: pgmap v20614: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:48.585+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:41:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:48.585+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:41:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:48.585+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:41:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:48.585+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:41:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:41:48.585+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:41:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:48 smithi057 ceph-mon[92072]: pgmap v20615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:48 smithi122 ceph-mon[125440]: pgmap v20615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:48 smithi136 ceph-mon[125702]: pgmap v20615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:50 smithi057 ceph-mon[92072]: pgmap v20616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:50 smithi122 ceph-mon[125440]: pgmap v20616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:50 smithi136 ceph-mon[125702]: pgmap v20616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:52 smithi057 ceph-mon[92072]: pgmap v20617: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:53.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:52 smithi122 ceph-mon[125440]: pgmap v20617: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:52 smithi136 ceph-mon[125702]: pgmap v20617: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:54 smithi057 ceph-mon[92072]: pgmap v20618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:54 smithi122 ceph-mon[125440]: pgmap v20618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:54 smithi136 ceph-mon[125702]: pgmap v20618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:56 smithi136 ceph-mon[125702]: pgmap v20619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:56 smithi057 ceph-mon[92072]: pgmap v20619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:56 smithi122 ceph-mon[125440]: pgmap v20619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:41:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:41:58 smithi057 ceph-mon[92072]: pgmap v20620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:41:58 smithi122 ceph-mon[125440]: pgmap v20620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:41:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:41:58 smithi136 ceph-mon[125702]: pgmap v20620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:00 smithi057 ceph-mon[92072]: pgmap v20621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:00 smithi122 ceph-mon[125440]: pgmap v20621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:00 smithi136 ceph-mon[125702]: pgmap v20621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:02 smithi057 ceph-mon[92072]: pgmap v20622: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:42:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:02 smithi122 ceph-mon[125440]: pgmap v20622: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:42:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:02 smithi136 ceph-mon[125702]: pgmap v20622: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:42:03.602 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:03.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:42:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:03.601+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:42:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:03.601+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:42:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:03.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:42:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:03.601+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:42:05.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:04 smithi057 ceph-mon[92072]: pgmap v20623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:42:05.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:04 smithi122 ceph-mon[125440]: pgmap v20623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:42:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:04 smithi136 ceph-mon[125702]: pgmap v20623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:42:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:06 smithi136 ceph-mon[125702]: pgmap v20624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:42:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:06 smithi057 ceph-mon[92072]: pgmap v20624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:42:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:06 smithi122 ceph-mon[125440]: pgmap v20624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:42:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:07 smithi136 ceph-mon[125702]: osdmap e1362: 12 total, 12 up, 12 in 2023-03-02T21:42:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:07 smithi057 ceph-mon[92072]: osdmap e1362: 12 total, 12 up, 12 in 2023-03-02T21:42:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:07 smithi122 ceph-mon[125440]: osdmap e1362: 12 total, 12 up, 12 in 2023-03-02T21:42:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:08 smithi136 ceph-mon[125702]: pgmap v20626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:42:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:08 smithi057 ceph-mon[92072]: pgmap v20626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:42:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:08 smithi122 ceph-mon[125440]: pgmap v20626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:42:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:10 smithi057 ceph-mon[92072]: pgmap v20627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:42:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:10 smithi122 ceph-mon[125440]: pgmap v20627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:42:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:10 smithi136 ceph-mon[125702]: pgmap v20627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:42:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:12 smithi057 ceph-mon[92072]: pgmap v20628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:42:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:12 smithi122 ceph-mon[125440]: pgmap v20628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:42:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:12 smithi136 ceph-mon[125702]: pgmap v20628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:42:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:14 smithi057 ceph-mon[92072]: pgmap v20629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:42:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:14 smithi122 ceph-mon[125440]: pgmap v20629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:42:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:14 smithi136 ceph-mon[125702]: pgmap v20629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:42:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:16 smithi136 ceph-mon[125702]: osdmap e1363: 12 total, 12 up, 12 in 2023-03-02T21:42:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:16 smithi136 ceph-mon[125702]: pgmap v20631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:42:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:16 smithi057 ceph-mon[92072]: osdmap e1363: 12 total, 12 up, 12 in 2023-03-02T21:42:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:16 smithi057 ceph-mon[92072]: pgmap v20631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:42:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:16 smithi122 ceph-mon[125440]: osdmap e1363: 12 total, 12 up, 12 in 2023-03-02T21:42:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:16 smithi122 ceph-mon[125440]: pgmap v20631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:42:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:18.616+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:42:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:18.617+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:42:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:18.617+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:42:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:18.617+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:42:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:18.617+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:42:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:18 smithi057 ceph-mon[92072]: pgmap v20632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:42:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:18 smithi122 ceph-mon[125440]: pgmap v20632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:42:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:18 smithi136 ceph-mon[125702]: pgmap v20632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:42:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:20 smithi057 ceph-mon[92072]: pgmap v20633: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:42:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:20 smithi122 ceph-mon[125440]: pgmap v20633: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:42:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:20 smithi136 ceph-mon[125702]: pgmap v20633: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:42:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:22 smithi057 ceph-mon[92072]: pgmap v20634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:42:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:22 smithi122 ceph-mon[125440]: pgmap v20634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:42:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:22 smithi136 ceph-mon[125702]: pgmap v20634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:42:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:24 smithi057 ceph-mon[92072]: pgmap v20635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:42:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:24 smithi122 ceph-mon[125440]: pgmap v20635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:42:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:24 smithi136 ceph-mon[125702]: pgmap v20635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:42:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:26 smithi136 ceph-mon[125702]: pgmap v20636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:42:26.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:26 smithi057 ceph-mon[92072]: pgmap v20636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:42:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:26 smithi122 ceph-mon[125440]: pgmap v20636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:42:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:28 smithi057 ceph-mon[92072]: pgmap v20637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:42:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:28 smithi122 ceph-mon[125440]: pgmap v20637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:42:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:28 smithi136 ceph-mon[125702]: pgmap v20637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:42:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:30 smithi057 ceph-mon[92072]: pgmap v20638: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:30 smithi122 ceph-mon[125440]: pgmap v20638: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:30 smithi136 ceph-mon[125702]: pgmap v20638: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:32 smithi057 ceph-mon[92072]: pgmap v20639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:32 smithi122 ceph-mon[125440]: pgmap v20639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:32 smithi136 ceph-mon[125702]: pgmap v20639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:33.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:42:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:33.629+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:42:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:33.629+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:42:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:33.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:42:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:33.629+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:42:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:34 smithi057 ceph-mon[92072]: pgmap v20640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:34 smithi122 ceph-mon[125440]: pgmap v20640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:34 smithi136 ceph-mon[125702]: pgmap v20640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:36 smithi136 ceph-mon[125702]: pgmap v20641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:36 smithi057 ceph-mon[92072]: pgmap v20641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:36 smithi122 ceph-mon[125440]: pgmap v20641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:38 smithi057 ceph-mon[92072]: pgmap v20642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:38 smithi122 ceph-mon[125440]: pgmap v20642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:38 smithi136 ceph-mon[125702]: pgmap v20642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:40 smithi057 ceph-mon[92072]: pgmap v20643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:40 smithi122 ceph-mon[125440]: pgmap v20643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:40 smithi136 ceph-mon[125702]: pgmap v20643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:43.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:42 smithi057 ceph-mon[92072]: pgmap v20644: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:43.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:42 smithi122 ceph-mon[125440]: pgmap v20644: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:42 smithi136 ceph-mon[125702]: pgmap v20644: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:43.959+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:42:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:43.959+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:42:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:43.959+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 297 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:42:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:43.959+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 298 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:42:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:44 smithi057 ceph-mon[92072]: pgmap v20645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:42:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:44 smithi122 ceph-mon[125440]: pgmap v20645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:45.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:42:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:44 smithi136 ceph-mon[125702]: pgmap v20645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:42:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:42:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:42:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:46 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:42:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:46 smithi136 ceph-mon[125702]: pgmap v20646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:42:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:42:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:46 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:42:46.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:46 smithi057 ceph-mon[92072]: pgmap v20646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:42:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:42:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:46 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:42:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:46 smithi122 ceph-mon[125440]: pgmap v20646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:48.645+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:42:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:48.645+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:42:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:48.645+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:42:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:48.645+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:42:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:42:48.645+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:42:49.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:48 smithi057 ceph-mon[92072]: pgmap v20647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:48 smithi122 ceph-mon[125440]: pgmap v20647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:48 smithi136 ceph-mon[125702]: pgmap v20647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:50 smithi057 ceph-mon[92072]: pgmap v20648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:51.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:50 smithi122 ceph-mon[125440]: pgmap v20648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:50 smithi136 ceph-mon[125702]: pgmap v20648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:53.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:52 smithi057 ceph-mon[92072]: pgmap v20649: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:53.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:52 smithi122 ceph-mon[125440]: pgmap v20649: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:52 smithi136 ceph-mon[125702]: pgmap v20649: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:54 smithi057 ceph-mon[92072]: pgmap v20650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:54 smithi122 ceph-mon[125440]: pgmap v20650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:54 smithi136 ceph-mon[125702]: pgmap v20650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:56 smithi136 ceph-mon[125702]: pgmap v20651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:56 smithi057 ceph-mon[92072]: pgmap v20651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:56 smithi122 ceph-mon[125440]: pgmap v20651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:42:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:42:58 smithi057 ceph-mon[92072]: pgmap v20652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:42:58 smithi122 ceph-mon[125440]: pgmap v20652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:42:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:42:58 smithi136 ceph-mon[125702]: pgmap v20652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:00 smithi057 ceph-mon[92072]: pgmap v20653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:00 smithi122 ceph-mon[125440]: pgmap v20653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:00 smithi136 ceph-mon[125702]: pgmap v20653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:02 smithi057 ceph-mon[92072]: pgmap v20654: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:43:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:02 smithi122 ceph-mon[125440]: pgmap v20654: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:43:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:02 smithi136 ceph-mon[125702]: pgmap v20654: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:43:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:03.653+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:43:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:03.653+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:43:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:03.653+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:43:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:03.653+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:43:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:03.653+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:43:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:04 smithi057 ceph-mon[92072]: pgmap v20655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:43:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:04 smithi122 ceph-mon[125440]: pgmap v20655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:43:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:04 smithi136 ceph-mon[125702]: pgmap v20655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:43:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:06 smithi136 ceph-mon[125702]: pgmap v20656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:43:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:06 smithi057 ceph-mon[92072]: pgmap v20656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:43:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:06 smithi122 ceph-mon[125440]: pgmap v20656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:43:07.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:07 smithi136 ceph-mon[125702]: osdmap e1364: 12 total, 12 up, 12 in 2023-03-02T21:43:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:07 smithi057 ceph-mon[92072]: osdmap e1364: 12 total, 12 up, 12 in 2023-03-02T21:43:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:07 smithi122 ceph-mon[125440]: osdmap e1364: 12 total, 12 up, 12 in 2023-03-02T21:43:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:08 smithi136 ceph-mon[125702]: pgmap v20658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:43:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:08 smithi057 ceph-mon[92072]: pgmap v20658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:43:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:08 smithi122 ceph-mon[125440]: pgmap v20658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:43:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:10 smithi057 ceph-mon[92072]: pgmap v20659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:43:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:10 smithi057 ceph-mon[92072]: osdmap e1365: 12 total, 12 up, 12 in 2023-03-02T21:43:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:10 smithi122 ceph-mon[125440]: pgmap v20659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:43:11.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:10 smithi122 ceph-mon[125440]: osdmap e1365: 12 total, 12 up, 12 in 2023-03-02T21:43:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:10 smithi136 ceph-mon[125702]: pgmap v20659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:43:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:10 smithi136 ceph-mon[125702]: osdmap e1365: 12 total, 12 up, 12 in 2023-03-02T21:43:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:12 smithi057 ceph-mon[92072]: pgmap v20661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:43:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:12 smithi122 ceph-mon[125440]: pgmap v20661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:43:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:12 smithi136 ceph-mon[125702]: pgmap v20661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:43:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:14 smithi057 ceph-mon[92072]: pgmap v20662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:43:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:14 smithi122 ceph-mon[125440]: pgmap v20662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:43:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:14 smithi136 ceph-mon[125702]: pgmap v20662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:43:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:16 smithi136 ceph-mon[125702]: pgmap v20663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:43:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:16 smithi057 ceph-mon[92072]: pgmap v20663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:43:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:16 smithi122 ceph-mon[125440]: pgmap v20663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:43:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:18.665+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:43:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:18.666+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:43:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:18.666+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:43:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:18.666+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:43:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:18.666+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:43:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:18 smithi057 ceph-mon[92072]: pgmap v20664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:43:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:18 smithi122 ceph-mon[125440]: pgmap v20664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:43:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:18 smithi136 ceph-mon[125702]: pgmap v20664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:43:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:20 smithi057 ceph-mon[92072]: pgmap v20665: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:43:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:20 smithi122 ceph-mon[125440]: pgmap v20665: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:43:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:20 smithi136 ceph-mon[125702]: pgmap v20665: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:43:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:22 smithi057 ceph-mon[92072]: pgmap v20666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-02T21:43:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:22 smithi122 ceph-mon[125440]: pgmap v20666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-02T21:43:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:22 smithi136 ceph-mon[125702]: pgmap v20666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-02T21:43:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:24 smithi057 ceph-mon[92072]: pgmap v20667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:24 smithi122 ceph-mon[125440]: pgmap v20667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:24 smithi136 ceph-mon[125702]: pgmap v20667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:26 smithi136 ceph-mon[125702]: pgmap v20668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:26 smithi057 ceph-mon[92072]: pgmap v20668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:26 smithi122 ceph-mon[125440]: pgmap v20668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:28 smithi057 ceph-mon[92072]: pgmap v20669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:43:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:28 smithi122 ceph-mon[125440]: pgmap v20669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:43:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:28 smithi136 ceph-mon[125702]: pgmap v20669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:43:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:30 smithi057 ceph-mon[92072]: pgmap v20670: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:30 smithi122 ceph-mon[125440]: pgmap v20670: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:30 smithi136 ceph-mon[125702]: pgmap v20670: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:33.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:32 smithi057 ceph-mon[92072]: pgmap v20671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:32 smithi122 ceph-mon[125440]: pgmap v20671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:32 smithi136 ceph-mon[125702]: pgmap v20671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:33.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:33.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:43:33.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:33.678+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:43:33.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:33.678+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:43:33.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:33.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:43:33.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:33.678+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:43:35.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:34 smithi057 ceph-mon[92072]: pgmap v20672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:34 smithi122 ceph-mon[125440]: pgmap v20672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:34 smithi136 ceph-mon[125702]: pgmap v20672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:36 smithi136 ceph-mon[125702]: pgmap v20673: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:36 smithi057 ceph-mon[92072]: pgmap v20673: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:36 smithi122 ceph-mon[125440]: pgmap v20673: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:38 smithi057 ceph-mon[92072]: pgmap v20674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:38 smithi122 ceph-mon[125440]: pgmap v20674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:38 smithi136 ceph-mon[125702]: pgmap v20674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:40 smithi057 ceph-mon[92072]: pgmap v20675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:40 smithi122 ceph-mon[125440]: pgmap v20675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:40 smithi136 ceph-mon[125702]: pgmap v20675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:43.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:42 smithi057 ceph-mon[92072]: pgmap v20676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:42 smithi122 ceph-mon[125440]: pgmap v20676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:42 smithi136 ceph-mon[125702]: pgmap v20676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:45.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:44 smithi057 ceph-mon[92072]: pgmap v20677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:44 smithi122 ceph-mon[125440]: pgmap v20677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:44 smithi136 ceph-mon[125702]: pgmap v20677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:46 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:43:46.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:46 smithi136 ceph-mon[125702]: pgmap v20678: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:46 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:43:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:46 smithi057 ceph-mon[92072]: pgmap v20678: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:46 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:43:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:46 smithi122 ceph-mon[125440]: pgmap v20678: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:43:48.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:43:48.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:47 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:43:48.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:43:48.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:47 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:43:48.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:43:48.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:47 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:43:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:48.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:43:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:48.693+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:43:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:48.693+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:43:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:48.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:43:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:43:48.693+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:43:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:48 smithi136 ceph-mon[125702]: pgmap v20679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:48 smithi057 ceph-mon[92072]: pgmap v20679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:49.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:48 smithi122 ceph-mon[125440]: pgmap v20679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:50 smithi136 ceph-mon[125702]: pgmap v20680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:50 smithi057 ceph-mon[92072]: pgmap v20680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:50 smithi122 ceph-mon[125440]: pgmap v20680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:52 smithi136 ceph-mon[125702]: pgmap v20681: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:52 smithi057 ceph-mon[92072]: pgmap v20681: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:52 smithi122 ceph-mon[125440]: pgmap v20681: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:55.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:54 smithi057 ceph-mon[92072]: pgmap v20682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:55.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:54 smithi122 ceph-mon[125440]: pgmap v20682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:54 smithi136 ceph-mon[125702]: pgmap v20682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:56 smithi136 ceph-mon[125702]: pgmap v20683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:56 smithi057 ceph-mon[92072]: pgmap v20683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:56 smithi122 ceph-mon[125440]: pgmap v20683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:43:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:43:58 smithi057 ceph-mon[92072]: pgmap v20684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:43:58 smithi122 ceph-mon[125440]: pgmap v20684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:43:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:43:58 smithi136 ceph-mon[125702]: pgmap v20684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:00 smithi057 ceph-mon[92072]: pgmap v20685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:00 smithi122 ceph-mon[125440]: pgmap v20685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:00 smithi136 ceph-mon[125702]: pgmap v20685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:03.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:02 smithi057 ceph-mon[92072]: pgmap v20686: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:44:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:02 smithi122 ceph-mon[125440]: pgmap v20686: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:44:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:02 smithi136 ceph-mon[125702]: pgmap v20686: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:44:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:03.710+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:44:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:03.710+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:44:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:03.710+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:44:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:03.710+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:44:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:03.710+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:44:05.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:04 smithi057 ceph-mon[92072]: pgmap v20687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:44:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:04 smithi122 ceph-mon[125440]: pgmap v20687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:44:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:04 smithi136 ceph-mon[125702]: pgmap v20687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:44:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:06 smithi136 ceph-mon[125702]: pgmap v20688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:44:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:06 smithi057 ceph-mon[92072]: pgmap v20688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:44:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:06 smithi122 ceph-mon[125440]: pgmap v20688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:44:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:07 smithi136 ceph-mon[125702]: osdmap e1366: 12 total, 12 up, 12 in 2023-03-02T21:44:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:07 smithi057 ceph-mon[92072]: osdmap e1366: 12 total, 12 up, 12 in 2023-03-02T21:44:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:07 smithi122 ceph-mon[125440]: osdmap e1366: 12 total, 12 up, 12 in 2023-03-02T21:44:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:08.434+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000103) for more than 900000000 us, fault. 2023-03-02T21:44:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:08.434+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f58500057f0 tx=0x7f58700a2050 comp rx=0 tx=0).stop 2023-03-02T21:44:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:08.434+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T21:44:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:08.434+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T21:44:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:08.434+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T21:44:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:08.434+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:44:08.437 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:08.434+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870096000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T21:44:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:08 smithi136 ceph-mon[125702]: pgmap v20690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:44:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:08 smithi057 ceph-mon[92072]: pgmap v20690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:44:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:08 smithi122 ceph-mon[125440]: pgmap v20690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:44:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:10 smithi057 ceph-mon[92072]: pgmap v20691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:44:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:10 smithi122 ceph-mon[125440]: pgmap v20691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:44:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:10 smithi136 ceph-mon[125702]: pgmap v20691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:44:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:12 smithi057 ceph-mon[92072]: pgmap v20692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:44:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:12 smithi122 ceph-mon[125440]: pgmap v20692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:44:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:12 smithi136 ceph-mon[125702]: pgmap v20692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:44:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:13.973+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:44:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:13.973+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:44:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:13.973+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 298 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:44:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:13.973+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 299 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:44:15.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:14 smithi057 ceph-mon[92072]: pgmap v20693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:44:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:14 smithi122 ceph-mon[125440]: pgmap v20693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:44:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:14 smithi136 ceph-mon[125702]: pgmap v20693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:44:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:16 smithi136 ceph-mon[125702]: osdmap e1367: 12 total, 12 up, 12 in 2023-03-02T21:44:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:16 smithi136 ceph-mon[125702]: pgmap v20695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:44:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:16 smithi057 ceph-mon[92072]: osdmap e1367: 12 total, 12 up, 12 in 2023-03-02T21:44:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:16 smithi057 ceph-mon[92072]: pgmap v20695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:44:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:16 smithi122 ceph-mon[125440]: osdmap e1367: 12 total, 12 up, 12 in 2023-03-02T21:44:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:16 smithi122 ceph-mon[125440]: pgmap v20695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:44:18.727 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:18.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:44:18.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:18.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:44:18.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:18.726+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:44:18.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:18.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:44:18.728 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:18.726+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:44:19.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:18 smithi057 ceph-mon[92072]: pgmap v20696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:44:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:18 smithi122 ceph-mon[125440]: pgmap v20696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:44:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:18 smithi136 ceph-mon[125702]: pgmap v20696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:44:21.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:20 smithi057 ceph-mon[92072]: pgmap v20697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:44:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:20 smithi122 ceph-mon[125440]: pgmap v20697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:44:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:20 smithi136 ceph-mon[125702]: pgmap v20697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:44:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:22 smithi057 ceph-mon[92072]: pgmap v20698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:44:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:22 smithi122 ceph-mon[125440]: pgmap v20698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:44:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:22 smithi136 ceph-mon[125702]: pgmap v20698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:44:25.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:24 smithi057 ceph-mon[92072]: pgmap v20699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:44:25.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:24 smithi122 ceph-mon[125440]: pgmap v20699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:44:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:24 smithi136 ceph-mon[125702]: pgmap v20699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:44:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:26 smithi136 ceph-mon[125702]: pgmap v20700: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:44:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:26 smithi057 ceph-mon[92072]: pgmap v20700: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:44:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:26 smithi122 ceph-mon[125440]: pgmap v20700: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:44:29.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:28 smithi057 ceph-mon[92072]: pgmap v20701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:44:29.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:28 smithi122 ceph-mon[125440]: pgmap v20701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:44:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:28 smithi136 ceph-mon[125702]: pgmap v20701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:44:31.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:30 smithi057 ceph-mon[92072]: pgmap v20702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:30 smithi122 ceph-mon[125440]: pgmap v20702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:30 smithi136 ceph-mon[125702]: pgmap v20702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:33.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:32 smithi122 ceph-mon[125440]: pgmap v20703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:32 smithi136 ceph-mon[125702]: pgmap v20703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:32 smithi057 ceph-mon[92072]: pgmap v20703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:33.741+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:44:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:33.742+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:44:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:33.742+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:44:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:33.742+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:44:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:33.742+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:44:35.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:34 smithi122 ceph-mon[125440]: pgmap v20704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:34 smithi136 ceph-mon[125702]: pgmap v20704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:34 smithi057 ceph-mon[92072]: pgmap v20704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:36 smithi136 ceph-mon[125702]: pgmap v20705: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:36 smithi057 ceph-mon[92072]: pgmap v20705: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:36 smithi122 ceph-mon[125440]: pgmap v20705: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:39.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:38 smithi057 ceph-mon[92072]: pgmap v20706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:38 smithi122 ceph-mon[125440]: pgmap v20706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:38 smithi136 ceph-mon[125702]: pgmap v20706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:41.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:40 smithi057 ceph-mon[92072]: pgmap v20707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:40 smithi122 ceph-mon[125440]: pgmap v20707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:40 smithi136 ceph-mon[125702]: pgmap v20707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:43.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:42 smithi122 ceph-mon[125440]: pgmap v20708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:42 smithi136 ceph-mon[125702]: pgmap v20708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:42 smithi057 ceph-mon[92072]: pgmap v20708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:45.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:44 smithi122 ceph-mon[125440]: pgmap v20709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:44 smithi136 ceph-mon[125702]: pgmap v20709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:44 smithi057 ceph-mon[92072]: pgmap v20709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:46 smithi136 ceph-mon[125702]: pgmap v20710: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:46 smithi057 ceph-mon[92072]: pgmap v20710: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:46 smithi122 ceph-mon[125440]: pgmap v20710: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:47.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:47 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:44:47.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:47 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:44:47.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:47 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:44:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:48 smithi136 ceph-mon[125702]: pgmap v20711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:48 smithi057 ceph-mon[92072]: pgmap v20711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:48 smithi122 ceph-mon[125440]: pgmap v20711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:48.742+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:44:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:48.743+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:44:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:48.743+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:44:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:48.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:44:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:44:48.743+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:44:51.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: pgmap v20712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:51.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:50 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: pgmap v20712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:50 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: pgmap v20712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:51.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:51.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:51.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:50 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:51 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:44:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:51 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:44:52.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:51 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:44:52.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:51 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:44:52.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:52.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:52.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:44:52.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:44:52.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:51 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:44:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:51 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:44:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:51 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:44:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:51 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:44:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:44:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:44:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:51 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:44:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:51 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:44:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:51 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:44:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:51 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:44:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:44:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:44:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:44:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:44:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:52 smithi136 ceph-mon[125702]: pgmap v20713: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:52 smithi057 ceph-mon[92072]: pgmap v20713: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:52 smithi122 ceph-mon[125440]: pgmap v20713: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:54 smithi136 ceph-mon[125702]: pgmap v20714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:54 smithi057 ceph-mon[92072]: pgmap v20714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:54 smithi122 ceph-mon[125440]: pgmap v20714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:56 smithi136 ceph-mon[125702]: pgmap v20715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:56 smithi057 ceph-mon[92072]: pgmap v20715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:56 smithi122 ceph-mon[125440]: pgmap v20715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:44:59.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:44:58 smithi057 ceph-mon[92072]: pgmap v20716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:44:58 smithi122 ceph-mon[125440]: pgmap v20716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:44:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:44:58 smithi136 ceph-mon[125702]: pgmap v20716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:00 smithi057 ceph-mon[92072]: pgmap v20717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:00 smithi122 ceph-mon[125440]: pgmap v20717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:00 smithi136 ceph-mon[125702]: pgmap v20717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:03.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:02 smithi122 ceph-mon[125440]: pgmap v20718: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:45:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:02 smithi136 ceph-mon[125702]: pgmap v20718: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:45:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:02 smithi057 ceph-mon[92072]: pgmap v20718: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:45:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:03.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:45:03.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:03.750+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:45:03.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:03.750+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:45:03.753 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:03.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:45:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:03.750+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:45:05.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:04 smithi122 ceph-mon[125440]: pgmap v20719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:45:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:04 smithi136 ceph-mon[125702]: pgmap v20719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:45:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:04 smithi057 ceph-mon[92072]: pgmap v20719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:45:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:06 smithi136 ceph-mon[125702]: pgmap v20720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:45:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:06 smithi057 ceph-mon[92072]: pgmap v20720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:45:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:06 smithi122 ceph-mon[125440]: pgmap v20720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:45:07.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:07 smithi136 ceph-mon[125702]: osdmap e1368: 12 total, 12 up, 12 in 2023-03-02T21:45:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:07 smithi057 ceph-mon[92072]: osdmap e1368: 12 total, 12 up, 12 in 2023-03-02T21:45:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:07 smithi122 ceph-mon[125440]: osdmap e1368: 12 total, 12 up, 12 in 2023-03-02T21:45:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:08 smithi136 ceph-mon[125702]: pgmap v20722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:45:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:08 smithi057 ceph-mon[92072]: pgmap v20722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:45:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:08 smithi122 ceph-mon[125440]: pgmap v20722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:45:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:10 smithi057 ceph-mon[92072]: pgmap v20723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:45:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:10 smithi122 ceph-mon[125440]: pgmap v20723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:45:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:10 smithi136 ceph-mon[125702]: pgmap v20723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:45:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:12 smithi122 ceph-mon[125440]: pgmap v20724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:45:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:12 smithi136 ceph-mon[125702]: pgmap v20724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:45:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:12 smithi057 ceph-mon[92072]: pgmap v20724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:45:15.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:14 smithi122 ceph-mon[125440]: pgmap v20725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:45:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:14 smithi136 ceph-mon[125702]: pgmap v20725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:45:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:14 smithi057 ceph-mon[92072]: pgmap v20725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:45:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:16 smithi136 ceph-mon[125702]: osdmap e1369: 12 total, 12 up, 12 in 2023-03-02T21:45:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:16 smithi136 ceph-mon[125702]: pgmap v20727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:45:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:16 smithi057 ceph-mon[92072]: osdmap e1369: 12 total, 12 up, 12 in 2023-03-02T21:45:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:16 smithi057 ceph-mon[92072]: pgmap v20727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:45:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:16 smithi122 ceph-mon[125440]: osdmap e1369: 12 total, 12 up, 12 in 2023-03-02T21:45:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:16 smithi122 ceph-mon[125440]: pgmap v20727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:45:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:18.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:45:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:18.766+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:45:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:18.766+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:45:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:18.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:45:18.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:18.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:45:19.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:18 smithi122 ceph-mon[125440]: pgmap v20728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:45:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:18 smithi136 ceph-mon[125702]: pgmap v20728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:45:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:18 smithi057 ceph-mon[92072]: pgmap v20728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:45:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:20 smithi122 ceph-mon[125440]: pgmap v20729: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:45:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:20 smithi136 ceph-mon[125702]: pgmap v20729: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:45:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:20 smithi057 ceph-mon[92072]: pgmap v20729: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:45:23.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:22 smithi122 ceph-mon[125440]: pgmap v20730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:45:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:22 smithi136 ceph-mon[125702]: pgmap v20730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:45:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:22 smithi057 ceph-mon[92072]: pgmap v20730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:45:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:24 smithi136 ceph-mon[125702]: pgmap v20731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:45:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:24 smithi057 ceph-mon[92072]: pgmap v20731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:45:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:24 smithi122 ceph-mon[125440]: pgmap v20731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:45:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:26 smithi136 ceph-mon[125702]: pgmap v20732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:45:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:26 smithi057 ceph-mon[92072]: pgmap v20732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:45:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:26 smithi122 ceph-mon[125440]: pgmap v20732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:45:29.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:28 smithi122 ceph-mon[125440]: pgmap v20733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:45:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:28 smithi136 ceph-mon[125702]: pgmap v20733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:45:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:28 smithi057 ceph-mon[92072]: pgmap v20733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:45:31.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:30 smithi122 ceph-mon[125440]: pgmap v20734: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:30 smithi136 ceph-mon[125702]: pgmap v20734: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:30 smithi057 ceph-mon[92072]: pgmap v20734: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:33.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:32 smithi122 ceph-mon[125440]: pgmap v20735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:32 smithi136 ceph-mon[125702]: pgmap v20735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:33.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:32 smithi057 ceph-mon[92072]: pgmap v20735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:33.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:33.782+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:45:33.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:33.782+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:45:33.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:33.782+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:45:33.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:33.782+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:45:33.784 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:33.782+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:45:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:34 smithi136 ceph-mon[125702]: pgmap v20736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:34 smithi057 ceph-mon[92072]: pgmap v20736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:34 smithi122 ceph-mon[125440]: pgmap v20736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:36 smithi136 ceph-mon[125702]: pgmap v20737: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:36 smithi057 ceph-mon[92072]: pgmap v20737: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:36 smithi122 ceph-mon[125440]: pgmap v20737: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:39.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:38 smithi122 ceph-mon[125440]: pgmap v20738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:38 smithi136 ceph-mon[125702]: pgmap v20738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:38 smithi057 ceph-mon[92072]: pgmap v20738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:41.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:40 smithi122 ceph-mon[125440]: pgmap v20739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:40 smithi136 ceph-mon[125702]: pgmap v20739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:40 smithi057 ceph-mon[92072]: pgmap v20739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:42 smithi136 ceph-mon[125702]: pgmap v20740: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:42 smithi057 ceph-mon[92072]: pgmap v20740: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:42 smithi122 ceph-mon[125440]: pgmap v20740: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:44 smithi136 ceph-mon[125702]: pgmap v20741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:44 smithi057 ceph-mon[92072]: pgmap v20741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:44 smithi122 ceph-mon[125440]: pgmap v20741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:46 smithi136 ceph-mon[125702]: pgmap v20742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:46 smithi057 ceph-mon[92072]: pgmap v20742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:46 smithi122 ceph-mon[125440]: pgmap v20742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:48.796+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:45:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:48.797+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:45:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:48.797+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:45:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:48.797+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:45:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:45:48.797+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:45:49.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:48 smithi122 ceph-mon[125440]: pgmap v20743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:48 smithi136 ceph-mon[125702]: pgmap v20743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:48 smithi057 ceph-mon[92072]: pgmap v20743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:50 smithi136 ceph-mon[125702]: pgmap v20744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:50 smithi057 ceph-mon[92072]: pgmap v20744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:50 smithi122 ceph-mon[125440]: pgmap v20744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:45:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:45:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:45:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:51 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:45:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:45:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:45:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:45:52.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:51 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:45:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:45:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:45:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:45:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:51 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:45:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:52 smithi136 ceph-mon[125702]: pgmap v20745: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:52 smithi057 ceph-mon[92072]: pgmap v20745: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:52 smithi122 ceph-mon[125440]: pgmap v20745: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:54 smithi136 ceph-mon[125702]: pgmap v20746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:54 smithi057 ceph-mon[92072]: pgmap v20746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:54 smithi122 ceph-mon[125440]: pgmap v20746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:56 smithi057 ceph-mon[92072]: pgmap v20747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:56 smithi122 ceph-mon[125440]: pgmap v20747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:56 smithi136 ceph-mon[125702]: pgmap v20747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:45:59.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:45:58 smithi122 ceph-mon[125440]: pgmap v20748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:45:58 smithi136 ceph-mon[125702]: pgmap v20748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:45:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:45:58 smithi057 ceph-mon[92072]: pgmap v20748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:00 smithi136 ceph-mon[125702]: pgmap v20749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:00 smithi057 ceph-mon[92072]: pgmap v20749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:00 smithi122 ceph-mon[125440]: pgmap v20749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:02 smithi136 ceph-mon[125702]: pgmap v20750: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:46:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:02 smithi057 ceph-mon[92072]: pgmap v20750: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:46:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:02 smithi122 ceph-mon[125440]: pgmap v20750: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:46:03.804 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:03.802+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:46:03.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:03.802+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:46:03.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:03.802+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:46:03.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:03.802+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:46:03.805 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:03.802+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:46:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:04 smithi136 ceph-mon[125702]: pgmap v20751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:46:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:04 smithi057 ceph-mon[92072]: pgmap v20751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:46:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:04 smithi122 ceph-mon[125440]: pgmap v20751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:46:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:06 smithi057 ceph-mon[92072]: pgmap v20752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:46:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:06 smithi122 ceph-mon[125440]: pgmap v20752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:46:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:06 smithi136 ceph-mon[125702]: pgmap v20752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:46:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:07 smithi057 ceph-mon[92072]: osdmap e1370: 12 total, 12 up, 12 in 2023-03-02T21:46:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:07 smithi122 ceph-mon[125440]: osdmap e1370: 12 total, 12 up, 12 in 2023-03-02T21:46:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:07 smithi136 ceph-mon[125702]: osdmap e1370: 12 total, 12 up, 12 in 2023-03-02T21:46:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:08 smithi057 ceph-mon[92072]: pgmap v20754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:46:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:08 smithi122 ceph-mon[125440]: pgmap v20754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:46:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:08 smithi136 ceph-mon[125702]: pgmap v20754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:46:11.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:10 smithi122 ceph-mon[125440]: pgmap v20755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:46:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:10 smithi136 ceph-mon[125702]: pgmap v20755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:46:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:10 smithi057 ceph-mon[92072]: pgmap v20755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:46:13.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:12 smithi122 ceph-mon[125440]: pgmap v20756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:46:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:12 smithi136 ceph-mon[125702]: pgmap v20756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:46:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:12 smithi057 ceph-mon[92072]: pgmap v20756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:46:15.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:14 smithi136 ceph-mon[125702]: pgmap v20757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:46:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:14 smithi057 ceph-mon[92072]: pgmap v20757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:46:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:14 smithi122 ceph-mon[125440]: pgmap v20757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:46:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:16 smithi136 ceph-mon[125702]: osdmap e1371: 12 total, 12 up, 12 in 2023-03-02T21:46:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:16 smithi136 ceph-mon[125702]: pgmap v20759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:46:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:16 smithi057 ceph-mon[92072]: osdmap e1371: 12 total, 12 up, 12 in 2023-03-02T21:46:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:16 smithi057 ceph-mon[92072]: pgmap v20759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:46:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:16 smithi122 ceph-mon[125440]: osdmap e1371: 12 total, 12 up, 12 in 2023-03-02T21:46:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:16 smithi122 ceph-mon[125440]: pgmap v20759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:46:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:18.809+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:46:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:18.810+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:46:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:18.810+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:46:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:18.810+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:46:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:18.810+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:46:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:18 smithi136 ceph-mon[125702]: pgmap v20760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:46:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:18 smithi057 ceph-mon[92072]: pgmap v20760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:46:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:18 smithi122 ceph-mon[125440]: pgmap v20760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:46:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:20 smithi136 ceph-mon[125702]: pgmap v20761: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:46:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:20 smithi057 ceph-mon[92072]: pgmap v20761: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:46:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:20 smithi122 ceph-mon[125440]: pgmap v20761: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:46:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:22 smithi136 ceph-mon[125702]: pgmap v20762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:46:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:22 smithi057 ceph-mon[92072]: pgmap v20762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:46:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:22 smithi122 ceph-mon[125440]: pgmap v20762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:46:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:24 smithi136 ceph-mon[125702]: pgmap v20763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:46:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:24 smithi057 ceph-mon[92072]: pgmap v20763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:46:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:24 smithi122 ceph-mon[125440]: pgmap v20763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:46:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:26 smithi057 ceph-mon[92072]: pgmap v20764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:46:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:26 smithi122 ceph-mon[125440]: pgmap v20764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:46:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:26 smithi136 ceph-mon[125702]: pgmap v20764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:46:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:28 smithi136 ceph-mon[125702]: pgmap v20765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:46:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:28 smithi057 ceph-mon[92072]: pgmap v20765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:46:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:28 smithi122 ceph-mon[125440]: pgmap v20765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:46:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:30 smithi136 ceph-mon[125702]: pgmap v20766: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:30 smithi057 ceph-mon[92072]: pgmap v20766: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:30 smithi122 ceph-mon[125440]: pgmap v20766: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:32 smithi136 ceph-mon[125702]: pgmap v20767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:32 smithi057 ceph-mon[92072]: pgmap v20767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:32 smithi122 ceph-mon[125440]: pgmap v20767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:33.814+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:46:33.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:33.814+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:46:33.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:33.814+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:46:33.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:33.814+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:46:33.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:33.814+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:46:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:34 smithi136 ceph-mon[125702]: pgmap v20768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:34 smithi057 ceph-mon[92072]: pgmap v20768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:34 smithi122 ceph-mon[125440]: pgmap v20768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:36 smithi057 ceph-mon[92072]: pgmap v20769: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:36 smithi122 ceph-mon[125440]: pgmap v20769: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:36 smithi136 ceph-mon[125702]: pgmap v20769: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:38 smithi136 ceph-mon[125702]: pgmap v20770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:38 smithi057 ceph-mon[92072]: pgmap v20770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:38 smithi122 ceph-mon[125440]: pgmap v20770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:40 smithi136 ceph-mon[125702]: pgmap v20771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:40 smithi057 ceph-mon[92072]: pgmap v20771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:40 smithi122 ceph-mon[125440]: pgmap v20771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:42 smithi136 ceph-mon[125702]: pgmap v20772: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:42 smithi057 ceph-mon[92072]: pgmap v20772: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:42 smithi122 ceph-mon[125440]: pgmap v20772: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:44 smithi136 ceph-mon[125702]: pgmap v20773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:44 smithi057 ceph-mon[92072]: pgmap v20773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:44 smithi122 ceph-mon[125440]: pgmap v20773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:46 smithi057 ceph-mon[92072]: pgmap v20774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:46 smithi122 ceph-mon[125440]: pgmap v20774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:46 smithi136 ceph-mon[125702]: pgmap v20774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:48.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:46:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:48.819+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:46:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:48.819+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:46:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:48.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:46:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:46:48.819+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:46:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:48 smithi136 ceph-mon[125702]: pgmap v20775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:48 smithi057 ceph-mon[92072]: pgmap v20775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:48 smithi122 ceph-mon[125440]: pgmap v20775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:50 smithi136 ceph-mon[125702]: pgmap v20776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:50 smithi057 ceph-mon[92072]: pgmap v20776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:50 smithi122 ceph-mon[125440]: pgmap v20776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:51 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:46:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:51 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:46:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:51 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:46:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:52 smithi136 ceph-mon[125702]: pgmap v20777: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:46:53.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:52 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:46:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:52 smithi057 ceph-mon[92072]: pgmap v20777: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:46:53.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:52 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:46:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:52 smithi122 ceph-mon[125440]: pgmap v20777: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:53.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:46:53.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:52 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:46:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:46:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:46:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:46:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:46:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:46:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:46:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:46:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:46:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:46:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:54 smithi136 ceph-mon[125702]: pgmap v20778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:54 smithi057 ceph-mon[92072]: pgmap v20778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:54 smithi122 ceph-mon[125440]: pgmap v20778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:56 smithi057 ceph-mon[92072]: pgmap v20779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:56 smithi122 ceph-mon[125440]: pgmap v20779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:56 smithi136 ceph-mon[125702]: pgmap v20779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:46:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:46:58 smithi136 ceph-mon[125702]: pgmap v20780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:59.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:46:58 smithi057 ceph-mon[92072]: pgmap v20780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:46:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:46:58 smithi122 ceph-mon[125440]: pgmap v20780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:00 smithi136 ceph-mon[125702]: pgmap v20781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:00 smithi057 ceph-mon[92072]: pgmap v20781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:00 smithi122 ceph-mon[125440]: pgmap v20781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:02 smithi136 ceph-mon[125702]: pgmap v20782: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:47:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:02 smithi057 ceph-mon[92072]: pgmap v20782: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:47:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:02 smithi122 ceph-mon[125440]: pgmap v20782: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:47:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:03.830+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:47:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:03.830+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:47:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:03.830+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:47:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:03.830+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:47:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:03.830+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:47:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:04 smithi136 ceph-mon[125702]: pgmap v20783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:47:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:04 smithi057 ceph-mon[92072]: pgmap v20783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:47:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:04 smithi122 ceph-mon[125440]: pgmap v20783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:47:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:06 smithi057 ceph-mon[92072]: pgmap v20784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:47:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:06 smithi122 ceph-mon[125440]: pgmap v20784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:47:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:06 smithi136 ceph-mon[125702]: pgmap v20784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:47:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:07 smithi057 ceph-mon[92072]: osdmap e1372: 12 total, 12 up, 12 in 2023-03-02T21:47:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:07 smithi122 ceph-mon[125440]: osdmap e1372: 12 total, 12 up, 12 in 2023-03-02T21:47:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:07 smithi136 ceph-mon[125702]: osdmap e1372: 12 total, 12 up, 12 in 2023-03-02T21:47:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:08 smithi057 ceph-mon[92072]: pgmap v20786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:47:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:08 smithi122 ceph-mon[125440]: pgmap v20786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:47:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:08 smithi136 ceph-mon[125702]: pgmap v20786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:47:11.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:10 smithi136 ceph-mon[125702]: pgmap v20787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:47:11.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:10 smithi136 ceph-mon[125702]: osdmap e1373: 12 total, 12 up, 12 in 2023-03-02T21:47:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:10 smithi057 ceph-mon[92072]: pgmap v20787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:47:11.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:10 smithi057 ceph-mon[92072]: osdmap e1373: 12 total, 12 up, 12 in 2023-03-02T21:47:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:10 smithi122 ceph-mon[125440]: pgmap v20787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:47:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:10 smithi122 ceph-mon[125440]: osdmap e1373: 12 total, 12 up, 12 in 2023-03-02T21:47:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:12 smithi136 ceph-mon[125702]: pgmap v20789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:47:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:12 smithi057 ceph-mon[92072]: pgmap v20789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:47:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:12 smithi122 ceph-mon[125440]: pgmap v20789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:47:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:14.000+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:47:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:14.000+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:47:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:14.000+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 299 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:47:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:14.000+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 300 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:47:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:14 smithi136 ceph-mon[125702]: pgmap v20790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:47:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:14 smithi057 ceph-mon[92072]: pgmap v20790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:47:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:14 smithi122 ceph-mon[125440]: pgmap v20790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-02T21:47:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:16 smithi057 ceph-mon[92072]: pgmap v20791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:47:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:16 smithi122 ceph-mon[125440]: pgmap v20791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:47:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:16 smithi136 ceph-mon[125702]: pgmap v20791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:47:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:18.833+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:47:18.835 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:18.833+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:47:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:18.833+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:47:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:18.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:47:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:18.834+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:47:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:18 smithi136 ceph-mon[125702]: pgmap v20792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:47:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:18 smithi057 ceph-mon[92072]: pgmap v20792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:47:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:18 smithi122 ceph-mon[125440]: pgmap v20792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:47:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:20 smithi136 ceph-mon[125702]: pgmap v20793: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:47:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:20 smithi057 ceph-mon[92072]: pgmap v20793: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:47:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:20 smithi122 ceph-mon[125440]: pgmap v20793: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:47:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:22 smithi136 ceph-mon[125702]: pgmap v20794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-02T21:47:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:22 smithi057 ceph-mon[92072]: pgmap v20794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-02T21:47:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:22 smithi122 ceph-mon[125440]: pgmap v20794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-02T21:47:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:24 smithi136 ceph-mon[125702]: pgmap v20795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:24 smithi057 ceph-mon[92072]: pgmap v20795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:25.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:24 smithi122 ceph-mon[125440]: pgmap v20795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:26 smithi057 ceph-mon[92072]: pgmap v20796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:26 smithi122 ceph-mon[125440]: pgmap v20796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:26 smithi136 ceph-mon[125702]: pgmap v20796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:28 smithi136 ceph-mon[125702]: pgmap v20797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:47:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:28 smithi057 ceph-mon[92072]: pgmap v20797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:47:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:28 smithi122 ceph-mon[125440]: pgmap v20797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:47:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:30 smithi136 ceph-mon[125702]: pgmap v20798: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:30 smithi057 ceph-mon[92072]: pgmap v20798: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:30 smithi122 ceph-mon[125440]: pgmap v20798: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:32 smithi136 ceph-mon[125702]: pgmap v20799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:32 smithi057 ceph-mon[92072]: pgmap v20799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:32 smithi122 ceph-mon[125440]: pgmap v20799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:33.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:47:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:33.846+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:47:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:33.846+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:47:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:33.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:47:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:33.846+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:47:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:34 smithi136 ceph-mon[125702]: pgmap v20800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:34 smithi057 ceph-mon[92072]: pgmap v20800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:34 smithi122 ceph-mon[125440]: pgmap v20800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:36 smithi057 ceph-mon[92072]: pgmap v20801: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:36 smithi122 ceph-mon[125440]: pgmap v20801: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:36 smithi136 ceph-mon[125702]: pgmap v20801: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:38 smithi136 ceph-mon[125702]: pgmap v20802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:38 smithi057 ceph-mon[92072]: pgmap v20802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:38 smithi122 ceph-mon[125440]: pgmap v20802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:40 smithi136 ceph-mon[125702]: pgmap v20803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:40 smithi057 ceph-mon[92072]: pgmap v20803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:40 smithi122 ceph-mon[125440]: pgmap v20803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:42 smithi136 ceph-mon[125702]: pgmap v20804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:42 smithi057 ceph-mon[92072]: pgmap v20804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:42 smithi122 ceph-mon[125440]: pgmap v20804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:44 smithi136 ceph-mon[125702]: pgmap v20805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:44 smithi057 ceph-mon[92072]: pgmap v20805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:44 smithi122 ceph-mon[125440]: pgmap v20805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:46 smithi057 ceph-mon[92072]: pgmap v20806: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:46 smithi122 ceph-mon[125440]: pgmap v20806: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:46 smithi136 ceph-mon[125702]: pgmap v20806: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:48.862+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:47:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:48.862+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:47:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:48.862+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:47:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:48.862+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:47:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:47:48.862+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:47:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:48 smithi136 ceph-mon[125702]: pgmap v20807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:48 smithi057 ceph-mon[92072]: pgmap v20807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:48 smithi122 ceph-mon[125440]: pgmap v20807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:50 smithi136 ceph-mon[125702]: pgmap v20808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:50 smithi057 ceph-mon[92072]: pgmap v20808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:50 smithi122 ceph-mon[125440]: pgmap v20808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:52 smithi136 ceph-mon[125702]: pgmap v20809: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:52 smithi057 ceph-mon[92072]: pgmap v20809: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:52 smithi122 ceph-mon[125440]: pgmap v20809: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:53 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:47:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:54.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:53 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:53 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:47:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:53 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:53 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:47:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:53 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:54 smithi136 ceph-mon[125702]: pgmap v20810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:55.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:47:55.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:54 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:47:55.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:54 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:54 smithi057 ceph-mon[92072]: pgmap v20810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:55.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:47:55.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:54 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:47:55.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:54 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:54 smithi122 ceph-mon[125440]: pgmap v20810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:47:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:54 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:47:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:54 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:47:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:56 smithi057 ceph-mon[92072]: pgmap v20811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:56 smithi122 ceph-mon[125440]: pgmap v20811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:56 smithi136 ceph-mon[125702]: pgmap v20811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:47:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:47:58 smithi136 ceph-mon[125702]: pgmap v20812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:47:58 smithi057 ceph-mon[92072]: pgmap v20812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:47:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:47:58 smithi122 ceph-mon[125440]: pgmap v20812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:00 smithi136 ceph-mon[125702]: pgmap v20813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:00 smithi057 ceph-mon[92072]: pgmap v20813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:00 smithi122 ceph-mon[125440]: pgmap v20813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:02 smithi136 ceph-mon[125702]: pgmap v20814: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:48:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:02 smithi057 ceph-mon[92072]: pgmap v20814: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:48:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:02 smithi122 ceph-mon[125440]: pgmap v20814: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:48:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:03.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:48:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:03.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:48:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:03.873+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:48:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:03.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:48:03.877 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:03.873+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:48:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:05 smithi136 ceph-mon[125702]: pgmap v20815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:48:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:05 smithi057 ceph-mon[92072]: pgmap v20815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:48:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:05 smithi122 ceph-mon[125440]: pgmap v20815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:48:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:06 smithi057 ceph-mon[92072]: pgmap v20816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:48:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:06 smithi122 ceph-mon[125440]: pgmap v20816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:48:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:06 smithi136 ceph-mon[125702]: pgmap v20816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:48:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:07 smithi057 ceph-mon[92072]: osdmap e1374: 12 total, 12 up, 12 in 2023-03-02T21:48:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:07 smithi122 ceph-mon[125440]: osdmap e1374: 12 total, 12 up, 12 in 2023-03-02T21:48:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:07 smithi136 ceph-mon[125702]: osdmap e1374: 12 total, 12 up, 12 in 2023-03-02T21:48:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:08 smithi057 ceph-mon[92072]: pgmap v20818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:48:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:08 smithi122 ceph-mon[125440]: pgmap v20818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:48:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:08 smithi136 ceph-mon[125702]: pgmap v20818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:48:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:10 smithi136 ceph-mon[125702]: pgmap v20819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:48:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:10 smithi057 ceph-mon[92072]: pgmap v20819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:48:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:10 smithi122 ceph-mon[125440]: pgmap v20819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:48:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:12 smithi136 ceph-mon[125702]: pgmap v20820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:48:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:12 smithi057 ceph-mon[92072]: pgmap v20820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:48:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:12 smithi122 ceph-mon[125440]: pgmap v20820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:48:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:14 smithi136 ceph-mon[125702]: pgmap v20821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:48:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:14 smithi057 ceph-mon[92072]: pgmap v20821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:48:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:14 smithi122 ceph-mon[125440]: pgmap v20821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:48:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:16 smithi057 ceph-mon[92072]: osdmap e1375: 12 total, 12 up, 12 in 2023-03-02T21:48:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:16 smithi057 ceph-mon[92072]: pgmap v20823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:48:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:16 smithi122 ceph-mon[125440]: osdmap e1375: 12 total, 12 up, 12 in 2023-03-02T21:48:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:16 smithi122 ceph-mon[125440]: pgmap v20823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:48:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:16 smithi136 ceph-mon[125702]: osdmap e1375: 12 total, 12 up, 12 in 2023-03-02T21:48:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:16 smithi136 ceph-mon[125702]: pgmap v20823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:48:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:18.890+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:48:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:18.890+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:48:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:18.890+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:48:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:18.890+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:48:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:18.890+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:48:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:18 smithi136 ceph-mon[125702]: pgmap v20824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:48:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:18 smithi057 ceph-mon[92072]: pgmap v20824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:48:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:18 smithi122 ceph-mon[125440]: pgmap v20824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:48:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:20 smithi136 ceph-mon[125702]: pgmap v20825: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:48:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:20 smithi057 ceph-mon[92072]: pgmap v20825: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:48:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:20 smithi122 ceph-mon[125440]: pgmap v20825: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:48:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:22 smithi136 ceph-mon[125702]: pgmap v20826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:48:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:22 smithi057 ceph-mon[92072]: pgmap v20826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:48:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:22 smithi122 ceph-mon[125440]: pgmap v20826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:48:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:25 smithi136 ceph-mon[125702]: pgmap v20827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:48:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:25 smithi057 ceph-mon[92072]: pgmap v20827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:48:25.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:25 smithi122 ceph-mon[125440]: pgmap v20827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:48:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:26 smithi057 ceph-mon[92072]: pgmap v20828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:48:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:26 smithi122 ceph-mon[125440]: pgmap v20828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:48:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:26 smithi136 ceph-mon[125702]: pgmap v20828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:48:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:28 smithi136 ceph-mon[125702]: pgmap v20829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:48:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:28 smithi057 ceph-mon[92072]: pgmap v20829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:48:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:28 smithi122 ceph-mon[125440]: pgmap v20829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:48:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:30 smithi136 ceph-mon[125702]: pgmap v20830: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:30 smithi057 ceph-mon[92072]: pgmap v20830: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:30 smithi122 ceph-mon[125440]: pgmap v20830: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:33 smithi136 ceph-mon[125702]: pgmap v20831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:33 smithi057 ceph-mon[92072]: pgmap v20831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:33 smithi122 ceph-mon[125440]: pgmap v20831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:33.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:33.906+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:48:33.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:33.906+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:48:33.908 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:33.906+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:48:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:33.906+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:48:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:33.906+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:48:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:35 smithi136 ceph-mon[125702]: pgmap v20832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:35 smithi057 ceph-mon[92072]: pgmap v20832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:35 smithi122 ceph-mon[125440]: pgmap v20832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:36 smithi057 ceph-mon[92072]: pgmap v20833: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:36 smithi122 ceph-mon[125440]: pgmap v20833: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:36 smithi136 ceph-mon[125702]: pgmap v20833: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:38 smithi136 ceph-mon[125702]: pgmap v20834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:38 smithi057 ceph-mon[92072]: pgmap v20834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:38 smithi122 ceph-mon[125440]: pgmap v20834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:40 smithi136 ceph-mon[125702]: pgmap v20835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:40 smithi057 ceph-mon[92072]: pgmap v20835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:41.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:40 smithi122 ceph-mon[125440]: pgmap v20835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:43 smithi136 ceph-mon[125702]: pgmap v20836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:43 smithi057 ceph-mon[92072]: pgmap v20836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:43 smithi122 ceph-mon[125440]: pgmap v20836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:45 smithi136 ceph-mon[125702]: pgmap v20837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:45 smithi057 ceph-mon[92072]: pgmap v20837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:45 smithi122 ceph-mon[125440]: pgmap v20837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:46 smithi057 ceph-mon[92072]: pgmap v20838: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:46 smithi122 ceph-mon[125440]: pgmap v20838: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:46 smithi136 ceph-mon[125702]: pgmap v20838: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:48.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:48:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:48.921+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:48:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:48.921+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:48:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:48.921+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:48:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:48:48.921+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:48:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:48 smithi136 ceph-mon[125702]: pgmap v20839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:48 smithi057 ceph-mon[92072]: pgmap v20839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:48 smithi122 ceph-mon[125440]: pgmap v20839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:50 smithi136 ceph-mon[125702]: pgmap v20840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:50 smithi057 ceph-mon[92072]: pgmap v20840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:50 smithi122 ceph-mon[125440]: pgmap v20840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:53.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:53 smithi136 ceph-mon[125702]: pgmap v20841: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:53.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:53 smithi057 ceph-mon[92072]: pgmap v20841: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:53.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:53 smithi122 ceph-mon[125440]: pgmap v20841: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:55 smithi136 ceph-mon[125702]: pgmap v20842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:55.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:55 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:48:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:55 smithi057 ceph-mon[92072]: pgmap v20842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:55.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:55 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:48:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:55 smithi122 ceph-mon[125440]: pgmap v20842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:55 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:48:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:48:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:48:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:56 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:48:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:56 smithi057 ceph-mon[92072]: pgmap v20843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:48:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:48:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:56 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:48:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:56 smithi122 ceph-mon[125440]: pgmap v20843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:48:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:48:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:56 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:48:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:56 smithi136 ceph-mon[125702]: pgmap v20843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:48:59.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:48:58 smithi136 ceph-mon[125702]: pgmap v20844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:59.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:48:58 smithi057 ceph-mon[92072]: pgmap v20844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:48:59.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:48:58 smithi122 ceph-mon[125440]: pgmap v20844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:01 smithi136 ceph-mon[125702]: pgmap v20845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:00 smithi057 ceph-mon[92072]: pgmap v20845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:01 smithi122 ceph-mon[125440]: pgmap v20845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:03 smithi136 ceph-mon[125702]: pgmap v20846: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:49:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:03 smithi057 ceph-mon[92072]: pgmap v20846: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:49:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:03 smithi122 ceph-mon[125440]: pgmap v20846: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:49:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:03.925+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:49:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:03.925+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:49:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:03.925+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:49:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:03.925+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:49:03.929 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:03.925+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:49:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:05 smithi136 ceph-mon[125702]: pgmap v20847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:49:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:05 smithi057 ceph-mon[92072]: pgmap v20847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:49:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:05 smithi122 ceph-mon[125440]: pgmap v20847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:49:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:06 smithi057 ceph-mon[92072]: pgmap v20848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:49:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:06 smithi122 ceph-mon[125440]: pgmap v20848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:49:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:06 smithi136 ceph-mon[125702]: pgmap v20848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:49:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:07 smithi057 ceph-mon[92072]: osdmap e1376: 12 total, 12 up, 12 in 2023-03-02T21:49:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:07 smithi122 ceph-mon[125440]: osdmap e1376: 12 total, 12 up, 12 in 2023-03-02T21:49:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:07 smithi136 ceph-mon[125702]: osdmap e1376: 12 total, 12 up, 12 in 2023-03-02T21:49:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:08 smithi057 ceph-mon[92072]: pgmap v20850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:49:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:08 smithi122 ceph-mon[125440]: pgmap v20850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:49:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:08 smithi136 ceph-mon[125702]: pgmap v20850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:49:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:11 smithi136 ceph-mon[125702]: pgmap v20851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:49:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:11 smithi057 ceph-mon[92072]: pgmap v20851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:49:11.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:11 smithi122 ceph-mon[125440]: pgmap v20851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:49:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:13 smithi136 ceph-mon[125702]: pgmap v20852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:49:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:13 smithi057 ceph-mon[92072]: pgmap v20852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:49:13.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:13 smithi122 ceph-mon[125440]: pgmap v20852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:49:15.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:15 smithi136 ceph-mon[125702]: pgmap v20853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:49:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:15 smithi057 ceph-mon[92072]: pgmap v20853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:49:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:15 smithi122 ceph-mon[125440]: pgmap v20853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:49:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:16 smithi057 ceph-mon[92072]: osdmap e1377: 12 total, 12 up, 12 in 2023-03-02T21:49:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:16 smithi057 ceph-mon[92072]: pgmap v20855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:49:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:16 smithi122 ceph-mon[125440]: osdmap e1377: 12 total, 12 up, 12 in 2023-03-02T21:49:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:16 smithi122 ceph-mon[125440]: pgmap v20855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:49:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:16 smithi136 ceph-mon[125702]: osdmap e1377: 12 total, 12 up, 12 in 2023-03-02T21:49:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:16 smithi136 ceph-mon[125702]: pgmap v20855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:49:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:18.935+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:49:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:18.935+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:49:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:18.935+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:49:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:18.935+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:49:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:18.935+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:49:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:19 smithi136 ceph-mon[125702]: pgmap v20856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:49:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:19 smithi057 ceph-mon[92072]: pgmap v20856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:49:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:19 smithi122 ceph-mon[125440]: pgmap v20856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:49:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:21 smithi136 ceph-mon[125702]: pgmap v20857: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:49:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:21 smithi057 ceph-mon[92072]: pgmap v20857: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:49:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:21 smithi122 ceph-mon[125440]: pgmap v20857: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:49:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:23 smithi136 ceph-mon[125702]: pgmap v20858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:49:23.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:23 smithi057 ceph-mon[92072]: pgmap v20858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:49:23.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:23 smithi122 ceph-mon[125440]: pgmap v20858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:49:25.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:25 smithi136 ceph-mon[125702]: pgmap v20859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:49:25.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:25 smithi057 ceph-mon[92072]: pgmap v20859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:49:25.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:25 smithi122 ceph-mon[125440]: pgmap v20859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:49:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:26 smithi057 ceph-mon[92072]: pgmap v20860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:49:26.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:26 smithi122 ceph-mon[125440]: pgmap v20860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:49:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:26 smithi136 ceph-mon[125702]: pgmap v20860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:49:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:29 smithi136 ceph-mon[125702]: pgmap v20861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:29 smithi057 ceph-mon[92072]: pgmap v20861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:29 smithi122 ceph-mon[125440]: pgmap v20861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:31 smithi136 ceph-mon[125702]: pgmap v20862: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:31 smithi057 ceph-mon[92072]: pgmap v20862: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:31 smithi122 ceph-mon[125440]: pgmap v20862: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:33 smithi136 ceph-mon[125702]: pgmap v20863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:33 smithi057 ceph-mon[92072]: pgmap v20863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:33 smithi122 ceph-mon[125440]: pgmap v20863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:33.950+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:49:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:33.951+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:49:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:33.951+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:49:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:33.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:49:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:33.951+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:49:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:35 smithi136 ceph-mon[125702]: pgmap v20864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:35 smithi057 ceph-mon[92072]: pgmap v20864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:35.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:35 smithi122 ceph-mon[125440]: pgmap v20864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:36.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:36 smithi057 ceph-mon[92072]: pgmap v20865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:36.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:36 smithi122 ceph-mon[125440]: pgmap v20865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:36 smithi136 ceph-mon[125702]: pgmap v20865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:39 smithi136 ceph-mon[125702]: pgmap v20866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:39 smithi057 ceph-mon[92072]: pgmap v20866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:39 smithi122 ceph-mon[125440]: pgmap v20866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:41 smithi136 ceph-mon[125702]: pgmap v20867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:41 smithi057 ceph-mon[92072]: pgmap v20867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:41 smithi122 ceph-mon[125440]: pgmap v20867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:43 smithi136 ceph-mon[125702]: pgmap v20868: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:43 smithi057 ceph-mon[92072]: pgmap v20868: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:43 smithi122 ceph-mon[125440]: pgmap v20868: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:45 smithi136 ceph-mon[125702]: pgmap v20869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:45.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:45 smithi057 ceph-mon[92072]: pgmap v20869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:45 smithi122 ceph-mon[125440]: pgmap v20869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:46 smithi057 ceph-mon[92072]: pgmap v20870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:46.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:46 smithi122 ceph-mon[125440]: pgmap v20870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:46 smithi136 ceph-mon[125702]: pgmap v20870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:48.960+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:49:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:48.960+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:49:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:48.960+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:49:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:48.960+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:49:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:49:48.961+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:49:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:49 smithi136 ceph-mon[125702]: pgmap v20871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:49 smithi057 ceph-mon[92072]: pgmap v20871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:49 smithi122 ceph-mon[125440]: pgmap v20871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:51.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:51 smithi136 ceph-mon[125702]: pgmap v20872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:51 smithi057 ceph-mon[92072]: pgmap v20872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:51 smithi122 ceph-mon[125440]: pgmap v20872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:52 smithi136 ceph-mon[125702]: pgmap v20873: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:52 smithi057 ceph-mon[92072]: pgmap v20873: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:52 smithi122 ceph-mon[125440]: pgmap v20873: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:55 smithi136 ceph-mon[125702]: pgmap v20874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:55 smithi057 ceph-mon[92072]: pgmap v20874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:55 smithi122 ceph-mon[125440]: pgmap v20874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:56 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:49:56.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:56 smithi057 ceph-mon[92072]: pgmap v20875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:56 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:49:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:56 smithi122 ceph-mon[125440]: pgmap v20875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:56 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:49:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:56 smithi136 ceph-mon[125702]: pgmap v20875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:49:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:49:57.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:49:57.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:49:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:49:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:49:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:49:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:49:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:49:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:49:58 smithi057 ceph-mon[92072]: pgmap v20876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:49:58 smithi122 ceph-mon[125440]: pgmap v20876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:49:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:49:58 smithi136 ceph-mon[125702]: pgmap v20876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:00 smithi136 ceph-mon[125702]: pgmap v20877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:00.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T21:50:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:00 smithi057 ceph-mon[92072]: pgmap v20877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T21:50:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:00 smithi122 ceph-mon[125440]: pgmap v20877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:00.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T21:50:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:03 smithi136 ceph-mon[125702]: pgmap v20878: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:50:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:03 smithi057 ceph-mon[92072]: pgmap v20878: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:50:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:03 smithi122 ceph-mon[125440]: pgmap v20878: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:50:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:03.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:50:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:03.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:50:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:03.963+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:50:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:03.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:50:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:03.963+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:50:05.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:05 smithi136 ceph-mon[125702]: pgmap v20879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:50:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:05 smithi057 ceph-mon[92072]: pgmap v20879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:50:05.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:05 smithi122 ceph-mon[125440]: pgmap v20879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:50:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:06 smithi057 ceph-mon[92072]: pgmap v20880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:50:06.703 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:06 smithi122 ceph-mon[125440]: pgmap v20880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:50:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:06 smithi136 ceph-mon[125702]: pgmap v20880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:50:07.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:07 smithi057 ceph-mon[92072]: osdmap e1378: 12 total, 12 up, 12 in 2023-03-02T21:50:07.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:07 smithi122 ceph-mon[125440]: osdmap e1378: 12 total, 12 up, 12 in 2023-03-02T21:50:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:07 smithi136 ceph-mon[125702]: osdmap e1378: 12 total, 12 up, 12 in 2023-03-02T21:50:08.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:08 smithi057 ceph-mon[92072]: pgmap v20882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:50:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:08 smithi122 ceph-mon[125440]: pgmap v20882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:50:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:08 smithi136 ceph-mon[125702]: pgmap v20882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:50:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:11 smithi136 ceph-mon[125702]: pgmap v20883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:50:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:11 smithi057 ceph-mon[92072]: pgmap v20883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:50:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:11 smithi122 ceph-mon[125440]: pgmap v20883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:50:13.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:13 smithi136 ceph-mon[125702]: pgmap v20884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:50:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:13 smithi057 ceph-mon[92072]: pgmap v20884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:50:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:13 smithi122 ceph-mon[125440]: pgmap v20884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:50:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:14.024+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:50:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:14.024+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:50:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:14.025+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 301 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:50:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:14.025+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 300 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:50:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:14 smithi136 ceph-mon[125702]: pgmap v20885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:50:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:14 smithi057 ceph-mon[92072]: pgmap v20885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:50:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:14 smithi122 ceph-mon[125440]: pgmap v20885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:50:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:16 smithi057 ceph-mon[92072]: osdmap e1379: 12 total, 12 up, 12 in 2023-03-02T21:50:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:16 smithi057 ceph-mon[92072]: pgmap v20887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:50:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:16 smithi122 ceph-mon[125440]: osdmap e1379: 12 total, 12 up, 12 in 2023-03-02T21:50:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:16 smithi122 ceph-mon[125440]: pgmap v20887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:50:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:16 smithi136 ceph-mon[125702]: osdmap e1379: 12 total, 12 up, 12 in 2023-03-02T21:50:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:16 smithi136 ceph-mon[125702]: pgmap v20887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:50:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:18.978+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:50:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:18.978+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:50:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:18.978+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:50:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:18.978+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:50:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:18.978+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:50:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:19 smithi136 ceph-mon[125702]: pgmap v20888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:50:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:19 smithi057 ceph-mon[92072]: pgmap v20888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:50:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:19 smithi122 ceph-mon[125440]: pgmap v20888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:50:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:21 smithi136 ceph-mon[125702]: pgmap v20889: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:50:21.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:21 smithi057 ceph-mon[92072]: pgmap v20889: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:50:21.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:21 smithi122 ceph-mon[125440]: pgmap v20889: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:50:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:23 smithi136 ceph-mon[125702]: pgmap v20890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:50:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:23 smithi057 ceph-mon[92072]: pgmap v20890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:50:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:23 smithi122 ceph-mon[125440]: pgmap v20890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:50:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:24 smithi136 ceph-mon[125702]: pgmap v20891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:50:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:24 smithi057 ceph-mon[92072]: pgmap v20891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:50:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:24 smithi122 ceph-mon[125440]: pgmap v20891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:50:26.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:26 smithi057 ceph-mon[92072]: pgmap v20892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:50:26.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:26 smithi122 ceph-mon[125440]: pgmap v20892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:50:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:26 smithi136 ceph-mon[125702]: pgmap v20892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:50:29.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:29 smithi136 ceph-mon[125702]: pgmap v20893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:29 smithi057 ceph-mon[92072]: pgmap v20893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:29.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:29 smithi122 ceph-mon[125440]: pgmap v20893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:31.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:31 smithi136 ceph-mon[125702]: pgmap v20894: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:31 smithi057 ceph-mon[92072]: pgmap v20894: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:31 smithi122 ceph-mon[125440]: pgmap v20894: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:32 smithi136 ceph-mon[125702]: pgmap v20895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:32 smithi057 ceph-mon[92072]: pgmap v20895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:32 smithi122 ceph-mon[125440]: pgmap v20895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:33.989+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:50:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:33.989+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:50:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:33.989+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:50:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:33.989+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:50:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:33.989+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:50:35.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:35 smithi136 ceph-mon[125702]: pgmap v20896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:35.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:35 smithi057 ceph-mon[92072]: pgmap v20896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:35.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:35 smithi122 ceph-mon[125440]: pgmap v20896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:36.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:36 smithi057 ceph-mon[92072]: pgmap v20897: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:36.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:36 smithi122 ceph-mon[125440]: pgmap v20897: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:36 smithi136 ceph-mon[125702]: pgmap v20897: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:39.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:39 smithi136 ceph-mon[125702]: pgmap v20898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:39 smithi057 ceph-mon[92072]: pgmap v20898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:39 smithi122 ceph-mon[125440]: pgmap v20898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:41 smithi136 ceph-mon[125702]: pgmap v20899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:41 smithi057 ceph-mon[92072]: pgmap v20899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:41 smithi122 ceph-mon[125440]: pgmap v20899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:42.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:42 smithi136 ceph-mon[125702]: pgmap v20900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:42 smithi057 ceph-mon[92072]: pgmap v20900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:42 smithi122 ceph-mon[125440]: pgmap v20900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:45.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:45 smithi136 ceph-mon[125702]: pgmap v20901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:45.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:45 smithi057 ceph-mon[92072]: pgmap v20901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:45.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:45 smithi122 ceph-mon[125440]: pgmap v20901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:46 smithi057 ceph-mon[92072]: pgmap v20902: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:46 smithi122 ceph-mon[125440]: pgmap v20902: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:46 smithi136 ceph-mon[125702]: pgmap v20902: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:49.004+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:50:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:49.004+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:50:49.007 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:49.004+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:50:49.007 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:49.004+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:50:49.007 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:49.004+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:50:49.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:49 smithi136 ceph-mon[125702]: pgmap v20903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:49.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:49 smithi057 ceph-mon[92072]: pgmap v20903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:49.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:49 smithi122 ceph-mon[125440]: pgmap v20903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:51.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:51 smithi136 ceph-mon[125702]: pgmap v20904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:51.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:51 smithi057 ceph-mon[92072]: pgmap v20904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:51.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:51 smithi122 ceph-mon[125440]: pgmap v20904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:52 smithi136 ceph-mon[125702]: pgmap v20905: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:52 smithi057 ceph-mon[92072]: pgmap v20905: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:52 smithi122 ceph-mon[125440]: pgmap v20905: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:55.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:55 smithi136 ceph-mon[125702]: pgmap v20906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:55.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:55 smithi057 ceph-mon[92072]: pgmap v20906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:55.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:55 smithi122 ceph-mon[125440]: pgmap v20906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:56 smithi057 ceph-mon[92072]: pgmap v20907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:56.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:56 smithi122 ceph-mon[125440]: pgmap v20907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:56 smithi136 ceph-mon[125702]: pgmap v20907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:50:57.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:50:57.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:50:57.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:50:57.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:57 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:50:57.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:50:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:50:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:50:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:57 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:50:57.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:50:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:50:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:50:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:57 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:50:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:50:58 smithi122 ceph-mon[125440]: pgmap v20908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:50:58 smithi136 ceph-mon[125702]: pgmap v20908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:50:58 smithi057 ceph-mon[92072]: pgmap v20908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:50:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:59.032+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:50:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:59.032+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:50:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:59.032+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 302 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:50:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:50:59.032+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 301 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:51:01.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:01 smithi136 ceph-mon[125702]: pgmap v20909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:01.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:01 smithi057 ceph-mon[92072]: pgmap v20909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:01.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:01 smithi122 ceph-mon[125440]: pgmap v20909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:03.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:03 smithi136 ceph-mon[125702]: pgmap v20910: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:51:03.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:03 smithi057 ceph-mon[92072]: pgmap v20910: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:51:03.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:03 smithi122 ceph-mon[125440]: pgmap v20910: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:51:04.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:04.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:51:04.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:04.019+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:51:04.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:04.019+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:51:04.021 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:04.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:51:04.022 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:04.019+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:51:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:04 smithi136 ceph-mon[125702]: pgmap v20911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:51:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:04 smithi057 ceph-mon[92072]: pgmap v20911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:51:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:04 smithi122 ceph-mon[125440]: pgmap v20911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:51:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:06 smithi057 ceph-mon[92072]: pgmap v20912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:51:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:06 smithi122 ceph-mon[125440]: pgmap v20912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:51:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:06 smithi136 ceph-mon[125702]: pgmap v20912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:51:07.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:07 smithi122 ceph-mon[125440]: osdmap e1380: 12 total, 12 up, 12 in 2023-03-02T21:51:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:07 smithi136 ceph-mon[125702]: osdmap e1380: 12 total, 12 up, 12 in 2023-03-02T21:51:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:07 smithi057 ceph-mon[92072]: osdmap e1380: 12 total, 12 up, 12 in 2023-03-02T21:51:08.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:08 smithi122 ceph-mon[125440]: pgmap v20914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:51:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:08 smithi136 ceph-mon[125702]: pgmap v20914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:51:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:08 smithi057 ceph-mon[92072]: pgmap v20914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:51:11.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:11 smithi136 ceph-mon[125702]: pgmap v20915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:51:11.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:11 smithi057 ceph-mon[92072]: pgmap v20915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:51:11.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:11 smithi122 ceph-mon[125440]: pgmap v20915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:51:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:12 smithi136 ceph-mon[125702]: pgmap v20916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:51:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:12 smithi057 ceph-mon[92072]: pgmap v20916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:51:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:12 smithi122 ceph-mon[125440]: pgmap v20916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:51:15.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:15 smithi136 ceph-mon[125702]: pgmap v20917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:51:15.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:15 smithi057 ceph-mon[92072]: pgmap v20917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:51:15.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:15 smithi122 ceph-mon[125440]: pgmap v20917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:51:16.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:16 smithi057 ceph-mon[92072]: osdmap e1381: 12 total, 12 up, 12 in 2023-03-02T21:51:16.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:16 smithi057 ceph-mon[92072]: pgmap v20919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:51:16.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:16 smithi122 ceph-mon[125440]: osdmap e1381: 12 total, 12 up, 12 in 2023-03-02T21:51:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:16 smithi122 ceph-mon[125440]: pgmap v20919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:51:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:16 smithi136 ceph-mon[125702]: osdmap e1381: 12 total, 12 up, 12 in 2023-03-02T21:51:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:16 smithi136 ceph-mon[125702]: pgmap v20919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:51:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:19.027+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:51:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:19.028+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:51:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:19.028+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:51:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:19.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:51:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:19.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:51:19.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:19 smithi136 ceph-mon[125702]: pgmap v20920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:51:19.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:19 smithi057 ceph-mon[92072]: pgmap v20920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:51:19.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:19 smithi122 ceph-mon[125440]: pgmap v20920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:51:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:20 smithi136 ceph-mon[125702]: pgmap v20921: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:51:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:20 smithi057 ceph-mon[92072]: pgmap v20921: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:51:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:20 smithi122 ceph-mon[125440]: pgmap v20921: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:51:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:23 smithi136 ceph-mon[125702]: pgmap v20922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:51:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:23 smithi057 ceph-mon[92072]: pgmap v20922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:51:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:23 smithi122 ceph-mon[125440]: pgmap v20922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:51:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:24 smithi136 ceph-mon[125702]: pgmap v20923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:51:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:24 smithi057 ceph-mon[92072]: pgmap v20923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:51:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:24 smithi122 ceph-mon[125440]: pgmap v20923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:51:26.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:26 smithi122 ceph-mon[125440]: pgmap v20924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:51:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:26 smithi136 ceph-mon[125702]: pgmap v20924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:51:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:26 smithi057 ceph-mon[92072]: pgmap v20924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:51:29.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:29 smithi136 ceph-mon[125702]: pgmap v20925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:29.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:29 smithi057 ceph-mon[92072]: pgmap v20925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:29.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:29 smithi122 ceph-mon[125440]: pgmap v20925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:30 smithi136 ceph-mon[125702]: pgmap v20926: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:30 smithi057 ceph-mon[92072]: pgmap v20926: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:30 smithi122 ceph-mon[125440]: pgmap v20926: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:32 smithi136 ceph-mon[125702]: pgmap v20927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:32 smithi057 ceph-mon[92072]: pgmap v20927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:32 smithi122 ceph-mon[125440]: pgmap v20927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:34.044+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:51:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:34.044+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:51:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:34.044+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:51:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:34.044+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:51:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:34.044+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:51:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:34 smithi057 ceph-mon[92072]: pgmap v20928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:34 smithi122 ceph-mon[125440]: pgmap v20928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:34 smithi136 ceph-mon[125702]: pgmap v20928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:36.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:36 smithi122 ceph-mon[125440]: pgmap v20929: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:36 smithi136 ceph-mon[125702]: pgmap v20929: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:36 smithi057 ceph-mon[92072]: pgmap v20929: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:38 smithi057 ceph-mon[92072]: pgmap v20930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:38 smithi122 ceph-mon[125440]: pgmap v20930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:38 smithi136 ceph-mon[125702]: pgmap v20930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:40 smithi057 ceph-mon[92072]: pgmap v20931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:40 smithi122 ceph-mon[125440]: pgmap v20931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:40 smithi136 ceph-mon[125702]: pgmap v20931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:42 smithi057 ceph-mon[92072]: pgmap v20932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:42 smithi122 ceph-mon[125440]: pgmap v20932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:42 smithi136 ceph-mon[125702]: pgmap v20932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:44 smithi057 ceph-mon[92072]: pgmap v20933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:44 smithi122 ceph-mon[125440]: pgmap v20933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:44 smithi136 ceph-mon[125702]: pgmap v20933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:46 smithi122 ceph-mon[125440]: pgmap v20934: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:46 smithi136 ceph-mon[125702]: pgmap v20934: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:46 smithi057 ceph-mon[92072]: pgmap v20934: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:48 smithi057 ceph-mon[92072]: pgmap v20935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:48 smithi122 ceph-mon[125440]: pgmap v20935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:48 smithi136 ceph-mon[125702]: pgmap v20935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:49.048+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:51:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:49.049+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:51:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:49.049+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:51:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:49.049+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:51:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:51:49.049+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:51:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:50 smithi057 ceph-mon[92072]: pgmap v20936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:50 smithi122 ceph-mon[125440]: pgmap v20936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:50 smithi136 ceph-mon[125702]: pgmap v20936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:52 smithi057 ceph-mon[92072]: pgmap v20937: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:52 smithi122 ceph-mon[125440]: pgmap v20937: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:52 smithi136 ceph-mon[125702]: pgmap v20937: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:54 smithi057 ceph-mon[92072]: pgmap v20938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:54 smithi122 ceph-mon[125440]: pgmap v20938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:54 smithi136 ceph-mon[125702]: pgmap v20938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:56 smithi122 ceph-mon[125440]: pgmap v20939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:56.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:56 smithi136 ceph-mon[125702]: pgmap v20939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:56.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:56 smithi057 ceph-mon[92072]: pgmap v20939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:51:57.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:57 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:51:57.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:57 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:51:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:57 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:51:58.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:58 smithi136 ceph-mon[125702]: pgmap v20940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:51:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:58 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:51:58.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:51:58 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:51:58.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:58 smithi057 ceph-mon[92072]: pgmap v20940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:51:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:58 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:51:58.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:51:58 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:51:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:58 smithi122 ceph-mon[125440]: pgmap v20940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:51:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:51:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:58 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:51:58.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:51:58 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:52:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:00 smithi057 ceph-mon[92072]: pgmap v20941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:00 smithi122 ceph-mon[125440]: pgmap v20941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:00 smithi136 ceph-mon[125702]: pgmap v20941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:02 smithi057 ceph-mon[92072]: pgmap v20942: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:52:02.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:02 smithi122 ceph-mon[125440]: pgmap v20942: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:52:02.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:02 smithi136 ceph-mon[125702]: pgmap v20942: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:52:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:04.064+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:52:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:04.065+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:52:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:04.065+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:52:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:04.065+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:52:04.068 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:04.065+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:52:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:04 smithi057 ceph-mon[92072]: pgmap v20943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:52:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:04 smithi122 ceph-mon[125440]: pgmap v20943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:52:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:04 smithi136 ceph-mon[125702]: pgmap v20943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:52:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:06 smithi136 ceph-mon[125702]: pgmap v20944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:52:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:06 smithi057 ceph-mon[92072]: pgmap v20944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:52:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:06 smithi122 ceph-mon[125440]: pgmap v20944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:52:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:07 smithi136 ceph-mon[125702]: osdmap e1382: 12 total, 12 up, 12 in 2023-03-02T21:52:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:07 smithi057 ceph-mon[92072]: osdmap e1382: 12 total, 12 up, 12 in 2023-03-02T21:52:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:07 smithi122 ceph-mon[125440]: osdmap e1382: 12 total, 12 up, 12 in 2023-03-02T21:52:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:08 smithi136 ceph-mon[125702]: pgmap v20946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:52:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:08 smithi057 ceph-mon[92072]: pgmap v20946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:52:08.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:08 smithi122 ceph-mon[125440]: pgmap v20946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:52:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:10 smithi057 ceph-mon[92072]: pgmap v20947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:52:10.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:10 smithi122 ceph-mon[125440]: pgmap v20947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:52:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:10 smithi136 ceph-mon[125702]: pgmap v20947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:52:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:12 smithi057 ceph-mon[92072]: pgmap v20948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:52:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:12 smithi122 ceph-mon[125440]: pgmap v20948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:52:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:12 smithi136 ceph-mon[125702]: pgmap v20948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:52:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:14 smithi057 ceph-mon[92072]: pgmap v20949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:52:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:14 smithi122 ceph-mon[125440]: pgmap v20949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:52:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:14 smithi136 ceph-mon[125702]: pgmap v20949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:52:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:16 smithi122 ceph-mon[125440]: osdmap e1383: 12 total, 12 up, 12 in 2023-03-02T21:52:16.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:16 smithi122 ceph-mon[125440]: pgmap v20951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:52:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:16 smithi136 ceph-mon[125702]: osdmap e1383: 12 total, 12 up, 12 in 2023-03-02T21:52:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:16 smithi136 ceph-mon[125702]: pgmap v20951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:52:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:16 smithi057 ceph-mon[92072]: osdmap e1383: 12 total, 12 up, 12 in 2023-03-02T21:52:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:16 smithi057 ceph-mon[92072]: pgmap v20951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:52:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:18 smithi057 ceph-mon[92072]: pgmap v20952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:52:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:18 smithi122 ceph-mon[125440]: pgmap v20952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:52:18.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:18 smithi136 ceph-mon[125702]: pgmap v20952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:52:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:19.076+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:52:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:19.077+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:52:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:19.077+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:52:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:19.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:52:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:19.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:52:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:20 smithi057 ceph-mon[92072]: pgmap v20953: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:52:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:20 smithi122 ceph-mon[125440]: pgmap v20953: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:52:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:20 smithi136 ceph-mon[125702]: pgmap v20953: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:52:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:22 smithi057 ceph-mon[92072]: pgmap v20954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:52:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:22 smithi122 ceph-mon[125440]: pgmap v20954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:52:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:22 smithi136 ceph-mon[125702]: pgmap v20954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:52:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:24 smithi057 ceph-mon[92072]: pgmap v20955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:52:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:24 smithi122 ceph-mon[125440]: pgmap v20955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:52:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:24 smithi136 ceph-mon[125702]: pgmap v20955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:52:26.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:26 smithi136 ceph-mon[125702]: pgmap v20956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:52:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:26 smithi057 ceph-mon[92072]: pgmap v20956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:52:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:26 smithi122 ceph-mon[125440]: pgmap v20956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:52:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:28 smithi057 ceph-mon[92072]: pgmap v20957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:28 smithi122 ceph-mon[125440]: pgmap v20957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:28 smithi136 ceph-mon[125702]: pgmap v20957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:30 smithi057 ceph-mon[92072]: pgmap v20958: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:30.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:30 smithi122 ceph-mon[125440]: pgmap v20958: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:30 smithi136 ceph-mon[125702]: pgmap v20958: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:32.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:32 smithi057 ceph-mon[92072]: pgmap v20959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:32.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:32 smithi122 ceph-mon[125440]: pgmap v20959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:32 smithi136 ceph-mon[125702]: pgmap v20959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:34.092+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:52:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:34.092+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:52:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:34.092+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:52:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:34.092+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:52:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:34.092+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:52:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:34 smithi057 ceph-mon[92072]: pgmap v20960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:34 smithi122 ceph-mon[125440]: pgmap v20960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:34.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:34 smithi136 ceph-mon[125702]: pgmap v20960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:36 smithi136 ceph-mon[125702]: pgmap v20961: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:36 smithi057 ceph-mon[92072]: pgmap v20961: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:36.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:36 smithi122 ceph-mon[125440]: pgmap v20961: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:38 smithi057 ceph-mon[92072]: pgmap v20962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:38 smithi122 ceph-mon[125440]: pgmap v20962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:38.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:38 smithi136 ceph-mon[125702]: pgmap v20962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:40.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:40 smithi057 ceph-mon[92072]: pgmap v20963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:40 smithi122 ceph-mon[125440]: pgmap v20963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:40.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:40 smithi136 ceph-mon[125702]: pgmap v20963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:42 smithi057 ceph-mon[92072]: pgmap v20964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:42 smithi122 ceph-mon[125440]: pgmap v20964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:42 smithi136 ceph-mon[125702]: pgmap v20964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:44 smithi057 ceph-mon[92072]: pgmap v20965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:44 smithi122 ceph-mon[125440]: pgmap v20965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:44 smithi136 ceph-mon[125702]: pgmap v20965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:46 smithi136 ceph-mon[125702]: pgmap v20966: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:46 smithi057 ceph-mon[92072]: pgmap v20966: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:46 smithi122 ceph-mon[125440]: pgmap v20966: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:48 smithi057 ceph-mon[92072]: pgmap v20967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:48 smithi122 ceph-mon[125440]: pgmap v20967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:48 smithi136 ceph-mon[125702]: pgmap v20967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:49.106+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:52:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:49.107+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:52:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:49.107+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:52:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:49.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:52:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:52:49.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:52:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:50 smithi057 ceph-mon[92072]: pgmap v20968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:50 smithi122 ceph-mon[125440]: pgmap v20968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:50 smithi136 ceph-mon[125702]: pgmap v20968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:52 smithi057 ceph-mon[92072]: pgmap v20969: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:52 smithi122 ceph-mon[125440]: pgmap v20969: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:52 smithi136 ceph-mon[125702]: pgmap v20969: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:54 smithi057 ceph-mon[92072]: pgmap v20970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:54 smithi122 ceph-mon[125440]: pgmap v20970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:54 smithi136 ceph-mon[125702]: pgmap v20970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:56 smithi136 ceph-mon[125702]: pgmap v20971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:56 smithi057 ceph-mon[92072]: pgmap v20971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:56 smithi122 ceph-mon[125440]: pgmap v20971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:52:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:58 smithi057 ceph-mon[92072]: pgmap v20972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:58 smithi122 ceph-mon[125440]: pgmap v20972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:58 smithi136 ceph-mon[125702]: pgmap v20972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:52:59.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:52:59.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:52:59.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:52:59.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:52:59 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:52:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:52:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:52:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:52:59.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:52:59 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:52:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:52:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:52:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:52:59.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:52:59 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:53:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:00 smithi057 ceph-mon[92072]: pgmap v20973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:00 smithi122 ceph-mon[125440]: pgmap v20973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:00 smithi136 ceph-mon[125702]: pgmap v20973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:02 smithi057 ceph-mon[92072]: pgmap v20974: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:53:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:02 smithi122 ceph-mon[125440]: pgmap v20974: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:53:02.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:02 smithi136 ceph-mon[125702]: pgmap v20974: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:53:04.124 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:04.122+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:53:04.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:04.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:53:04.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:04.123+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:53:04.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:04.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:53:04.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:04.123+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:53:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:04 smithi057 ceph-mon[92072]: pgmap v20975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:53:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:04 smithi122 ceph-mon[125440]: pgmap v20975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:53:04.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:04 smithi136 ceph-mon[125702]: pgmap v20975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:53:06.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:06 smithi136 ceph-mon[125702]: pgmap v20976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:53:06.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:06 smithi057 ceph-mon[92072]: pgmap v20976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:53:06.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:06 smithi122 ceph-mon[125440]: pgmap v20976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:53:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:07 smithi136 ceph-mon[125702]: osdmap e1384: 12 total, 12 up, 12 in 2023-03-02T21:53:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:07 smithi057 ceph-mon[92072]: osdmap e1384: 12 total, 12 up, 12 in 2023-03-02T21:53:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:07 smithi122 ceph-mon[125440]: osdmap e1384: 12 total, 12 up, 12 in 2023-03-02T21:53:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:08 smithi136 ceph-mon[125702]: pgmap v20978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:53:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:08 smithi057 ceph-mon[92072]: pgmap v20978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:53:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:08 smithi122 ceph-mon[125440]: pgmap v20978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:53:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:10 smithi057 ceph-mon[92072]: pgmap v20979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:53:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:10 smithi122 ceph-mon[125440]: pgmap v20979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:53:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:10 smithi136 ceph-mon[125702]: pgmap v20979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:53:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:12 smithi057 ceph-mon[92072]: pgmap v20980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:53:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:12 smithi122 ceph-mon[125440]: pgmap v20980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:53:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:12 smithi136 ceph-mon[125702]: pgmap v20980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:53:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:14.051+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:53:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:14.051+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:53:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:14.051+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 302 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:53:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:14.051+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 303 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:53:14.112 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:14 smithi057 ceph-mon[92072]: pgmap v20981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:53:14.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:14 smithi122 ceph-mon[125440]: pgmap v20981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:53:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:14 smithi136 ceph-mon[125702]: pgmap v20981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:53:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:16 smithi136 ceph-mon[125702]: osdmap e1385: 12 total, 12 up, 12 in 2023-03-02T21:53:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:16 smithi136 ceph-mon[125702]: pgmap v20983: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:53:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:16 smithi057 ceph-mon[92072]: osdmap e1385: 12 total, 12 up, 12 in 2023-03-02T21:53:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:16 smithi057 ceph-mon[92072]: pgmap v20983: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:53:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:16 smithi122 ceph-mon[125440]: osdmap e1385: 12 total, 12 up, 12 in 2023-03-02T21:53:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:16 smithi122 ceph-mon[125440]: pgmap v20983: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:53:18.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:18 smithi057 ceph-mon[92072]: pgmap v20984: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:53:18.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:18 smithi122 ceph-mon[125440]: pgmap v20984: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:53:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:18 smithi136 ceph-mon[125702]: pgmap v20984: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:53:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:19.128+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:53:19.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:19.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:53:19.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:19.129+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:53:19.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:19.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:53:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:19.129+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:53:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:20 smithi057 ceph-mon[92072]: pgmap v20985: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:53:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:20 smithi122 ceph-mon[125440]: pgmap v20985: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:53:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:20 smithi136 ceph-mon[125702]: pgmap v20985: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:53:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:22 smithi057 ceph-mon[92072]: pgmap v20986: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:53:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:22 smithi122 ceph-mon[125440]: pgmap v20986: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:53:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:22 smithi136 ceph-mon[125702]: pgmap v20986: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:53:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:24 smithi057 ceph-mon[92072]: pgmap v20987: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:53:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:24 smithi122 ceph-mon[125440]: pgmap v20987: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:53:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:24 smithi136 ceph-mon[125702]: pgmap v20987: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:53:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:26 smithi136 ceph-mon[125702]: pgmap v20988: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:53:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:26 smithi057 ceph-mon[92072]: pgmap v20988: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:53:26.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:26 smithi122 ceph-mon[125440]: pgmap v20988: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:53:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:28 smithi057 ceph-mon[92072]: pgmap v20989: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:28.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:28 smithi122 ceph-mon[125440]: pgmap v20989: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:28.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:28 smithi136 ceph-mon[125702]: pgmap v20989: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:30.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:30 smithi057 ceph-mon[92072]: pgmap v20990: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:30 smithi122 ceph-mon[125440]: pgmap v20990: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:30.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:30 smithi136 ceph-mon[125702]: pgmap v20990: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:32.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:32 smithi057 ceph-mon[92072]: pgmap v20991: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:32.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:32 smithi122 ceph-mon[125440]: pgmap v20991: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:32 smithi136 ceph-mon[125702]: pgmap v20991: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:34.143+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:53:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:34.143+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:53:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:34.143+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:53:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:34.143+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:53:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:34.143+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:53:34.440 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:34 smithi057 ceph-mon[92072]: pgmap v20992: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:34 smithi122 ceph-mon[125440]: pgmap v20992: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:34 smithi136 ceph-mon[125702]: pgmap v20992: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:36.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:36 smithi136 ceph-mon[125702]: pgmap v20993: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:36 smithi057 ceph-mon[92072]: pgmap v20993: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:36 smithi122 ceph-mon[125440]: pgmap v20993: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:38 smithi057 ceph-mon[92072]: pgmap v20994: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:38.459 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:38 smithi122 ceph-mon[125440]: pgmap v20994: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:38.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:38 smithi136 ceph-mon[125702]: pgmap v20994: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:40 smithi057 ceph-mon[92072]: pgmap v20995: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:40 smithi122 ceph-mon[125440]: pgmap v20995: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:40 smithi136 ceph-mon[125702]: pgmap v20995: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:42 smithi057 ceph-mon[92072]: pgmap v20996: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:42 smithi122 ceph-mon[125440]: pgmap v20996: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:42 smithi136 ceph-mon[125702]: pgmap v20996: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:44 smithi057 ceph-mon[92072]: pgmap v20997: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:44 smithi122 ceph-mon[125440]: pgmap v20997: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:44 smithi136 ceph-mon[125702]: pgmap v20997: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:46 smithi136 ceph-mon[125702]: pgmap v20998: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:46 smithi057 ceph-mon[92072]: pgmap v20998: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:46.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:46 smithi122 ceph-mon[125440]: pgmap v20998: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:48.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:48 smithi057 ceph-mon[92072]: pgmap v20999: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:48 smithi122 ceph-mon[125440]: pgmap v20999: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:48 smithi136 ceph-mon[125702]: pgmap v20999: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:49.158+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:53:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:49.159+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:53:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:49.159+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:53:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:49.159+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:53:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:53:49.159+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:53:50.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:50 smithi057 ceph-mon[92072]: pgmap v21000: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:50 smithi122 ceph-mon[125440]: pgmap v21000: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:50 smithi136 ceph-mon[125702]: pgmap v21000: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:52.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:52 smithi057 ceph-mon[92072]: pgmap v21001: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:52 smithi122 ceph-mon[125440]: pgmap v21001: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:52 smithi136 ceph-mon[125702]: pgmap v21001: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:54 smithi057 ceph-mon[92072]: pgmap v21002: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:54 smithi122 ceph-mon[125440]: pgmap v21002: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:54.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:54 smithi136 ceph-mon[125702]: pgmap v21002: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:56.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:56 smithi136 ceph-mon[125702]: pgmap v21003: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:56 smithi057 ceph-mon[92072]: pgmap v21003: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:56 smithi122 ceph-mon[125440]: pgmap v21003: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:53:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:58 smithi057 ceph-mon[92072]: pgmap v21004: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:58 smithi122 ceph-mon[125440]: pgmap v21004: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:58.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:58 smithi136 ceph-mon[125702]: pgmap v21004: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:53:59.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:53:59 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:53:59.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:53:59 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:53:59.707 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:53:59 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:54:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:54:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:54:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:00 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:54:00.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:00 smithi136 ceph-mon[125702]: pgmap v21005: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:00.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:54:00.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:54:00.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:00 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:54:00.686 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:00 smithi057 ceph-mon[92072]: pgmap v21005: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:54:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:54:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:00 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:54:00.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:00 smithi122 ceph-mon[125440]: pgmap v21005: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:02 smithi057 ceph-mon[92072]: pgmap v21006: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:54:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:02 smithi122 ceph-mon[125440]: pgmap v21006: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:54:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:02 smithi136 ceph-mon[125702]: pgmap v21006: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:54:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:04.162+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:54:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:04.162+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:54:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:04.162+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:54:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:04.162+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:54:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:04.163+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:54:04.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:04 smithi057 ceph-mon[92072]: pgmap v21007: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:54:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:04 smithi122 ceph-mon[125440]: pgmap v21007: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:54:04.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:04 smithi136 ceph-mon[125702]: pgmap v21007: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:54:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:06 smithi136 ceph-mon[125702]: pgmap v21008: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:54:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:06 smithi057 ceph-mon[92072]: pgmap v21008: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:54:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:06 smithi122 ceph-mon[125440]: pgmap v21008: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:54:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:07 smithi136 ceph-mon[125702]: osdmap e1386: 12 total, 12 up, 12 in 2023-03-02T21:54:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:07 smithi057 ceph-mon[92072]: osdmap e1386: 12 total, 12 up, 12 in 2023-03-02T21:54:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:07 smithi122 ceph-mon[125440]: osdmap e1386: 12 total, 12 up, 12 in 2023-03-02T21:54:08.851 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:08 smithi136 ceph-mon[125702]: pgmap v21010: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:54:08.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:08 smithi057 ceph-mon[92072]: pgmap v21010: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:54:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:08 smithi122 ceph-mon[125440]: pgmap v21010: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:54:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:10 smithi057 ceph-mon[92072]: pgmap v21011: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:54:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:10 smithi122 ceph-mon[125440]: pgmap v21011: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:54:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:10 smithi136 ceph-mon[125702]: pgmap v21011: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:54:12.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:12 smithi057 ceph-mon[92072]: pgmap v21012: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:54:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:12 smithi122 ceph-mon[125440]: pgmap v21012: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:54:12.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:12 smithi136 ceph-mon[125702]: pgmap v21012: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:54:14.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:14 smithi057 ceph-mon[92072]: pgmap v21013: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:54:14.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:14 smithi122 ceph-mon[125440]: pgmap v21013: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:54:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:14 smithi136 ceph-mon[125702]: pgmap v21013: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:54:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:16 smithi136 ceph-mon[125702]: osdmap e1387: 12 total, 12 up, 12 in 2023-03-02T21:54:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:16 smithi136 ceph-mon[125702]: pgmap v21015: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:54:16.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:16 smithi057 ceph-mon[92072]: osdmap e1387: 12 total, 12 up, 12 in 2023-03-02T21:54:16.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:16 smithi057 ceph-mon[92072]: pgmap v21015: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:54:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:16 smithi122 ceph-mon[125440]: osdmap e1387: 12 total, 12 up, 12 in 2023-03-02T21:54:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:16 smithi122 ceph-mon[125440]: pgmap v21015: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:54:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:18 smithi057 ceph-mon[92072]: pgmap v21016: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:54:18.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:18 smithi122 ceph-mon[125440]: pgmap v21016: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:54:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:18 smithi136 ceph-mon[125702]: pgmap v21016: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:54:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:19.176+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:54:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:19.176+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:54:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:19.176+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:54:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:19.176+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:54:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:19.176+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:54:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:20 smithi057 ceph-mon[92072]: pgmap v21017: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:54:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:20 smithi122 ceph-mon[125440]: pgmap v21017: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:54:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:20 smithi136 ceph-mon[125702]: pgmap v21017: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:54:22.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:22 smithi057 ceph-mon[92072]: pgmap v21018: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:54:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:22 smithi122 ceph-mon[125440]: pgmap v21018: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:54:22.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:22 smithi136 ceph-mon[125702]: pgmap v21018: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:54:24.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:24 smithi057 ceph-mon[92072]: pgmap v21019: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:54:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:24 smithi122 ceph-mon[125440]: pgmap v21019: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:54:24.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:24 smithi136 ceph-mon[125702]: pgmap v21019: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:54:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:26 smithi136 ceph-mon[125702]: pgmap v21020: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:54:26.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:26 smithi057 ceph-mon[92072]: pgmap v21020: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:54:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:26 smithi122 ceph-mon[125440]: pgmap v21020: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:54:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:28 smithi057 ceph-mon[92072]: pgmap v21021: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:28.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:28 smithi122 ceph-mon[125440]: pgmap v21021: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:28 smithi136 ceph-mon[125702]: pgmap v21021: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:30 smithi057 ceph-mon[92072]: pgmap v21022: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:30.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:30 smithi122 ceph-mon[125440]: pgmap v21022: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:30.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:30 smithi136 ceph-mon[125702]: pgmap v21022: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:32 smithi057 ceph-mon[92072]: pgmap v21023: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:32 smithi122 ceph-mon[125440]: pgmap v21023: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:32 smithi136 ceph-mon[125702]: pgmap v21023: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:34.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:54:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:34.191+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:54:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:34.191+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:54:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:34.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:54:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:34.191+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:54:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:34 smithi057 ceph-mon[92072]: pgmap v21024: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:34 smithi122 ceph-mon[125440]: pgmap v21024: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:34 smithi136 ceph-mon[125702]: pgmap v21024: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:36 smithi136 ceph-mon[125702]: pgmap v21025: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:36 smithi057 ceph-mon[92072]: pgmap v21025: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:36 smithi122 ceph-mon[125440]: pgmap v21025: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:38 smithi057 ceph-mon[92072]: pgmap v21026: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:38 smithi122 ceph-mon[125440]: pgmap v21026: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:38.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:38 smithi136 ceph-mon[125702]: pgmap v21026: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:40 smithi057 ceph-mon[92072]: pgmap v21027: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:40 smithi122 ceph-mon[125440]: pgmap v21027: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:40.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:40 smithi136 ceph-mon[125702]: pgmap v21027: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:42 smithi057 ceph-mon[92072]: pgmap v21028: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:42 smithi122 ceph-mon[125440]: pgmap v21028: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:42 smithi136 ceph-mon[125702]: pgmap v21028: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:44 smithi057 ceph-mon[92072]: pgmap v21029: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:44.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:44 smithi122 ceph-mon[125440]: pgmap v21029: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:44 smithi136 ceph-mon[125702]: pgmap v21029: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:46 smithi136 ceph-mon[125702]: pgmap v21030: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:46.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:46 smithi057 ceph-mon[92072]: pgmap v21030: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:46.958 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:46 smithi122 ceph-mon[125440]: pgmap v21030: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:48 smithi057 ceph-mon[92072]: pgmap v21031: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:48 smithi122 ceph-mon[125440]: pgmap v21031: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:48.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:48 smithi136 ceph-mon[125702]: pgmap v21031: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:49.207+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:54:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:49.207+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:54:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:49.207+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:54:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:49.207+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:54:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:54:49.207+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:54:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:50 smithi057 ceph-mon[92072]: pgmap v21032: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:50.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:50 smithi122 ceph-mon[125440]: pgmap v21032: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:50.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:50 smithi136 ceph-mon[125702]: pgmap v21032: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:52 smithi057 ceph-mon[92072]: pgmap v21033: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:52.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:52 smithi122 ceph-mon[125440]: pgmap v21033: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:52 smithi136 ceph-mon[125702]: pgmap v21033: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:54 smithi057 ceph-mon[92072]: pgmap v21034: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:54 smithi122 ceph-mon[125440]: pgmap v21034: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:54.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:54 smithi136 ceph-mon[125702]: pgmap v21034: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:56 smithi136 ceph-mon[125702]: pgmap v21035: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:56.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:56 smithi057 ceph-mon[92072]: pgmap v21035: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:56.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:56 smithi122 ceph-mon[125440]: pgmap v21035: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:54:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:54:58 smithi057 ceph-mon[92072]: pgmap v21036: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:58.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:54:58 smithi122 ceph-mon[125440]: pgmap v21036: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:54:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:54:58 smithi136 ceph-mon[125702]: pgmap v21036: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:00 smithi057 ceph-mon[92072]: pgmap v21037: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:00.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:00 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:55:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:00 smithi122 ceph-mon[125440]: pgmap v21037: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:00 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:55:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:00 smithi136 ceph-mon[125702]: pgmap v21037: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:00.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:00 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:55:02.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:02 smithi057 ceph-mon[92072]: pgmap v21038: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:55:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:02 smithi122 ceph-mon[125440]: pgmap v21038: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:55:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:02 smithi136 ceph-mon[125702]: pgmap v21038: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:55:04.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:04.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:55:04.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:04.224+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:55:04.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:04.224+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:55:04.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:04.224+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:55:04.226 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:04.224+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:55:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.346 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:55:04.346 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:55:04.346 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:03 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.441 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.441 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.441 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:55:04.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:55:04.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:03 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:04.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T21:55:04.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:55:04.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:55:04.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:03 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:55:05.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:04 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:55:05.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:04 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:55:05.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:04 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:55:05.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:04 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:55:05.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:04 smithi136 ceph-mon[125702]: pgmap v21039: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:55:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:04 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:55:05.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:04 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:55:05.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:04 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:55:05.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:04 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:55:05.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:04 smithi057 ceph-mon[92072]: pgmap v21039: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:55:05.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:04 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T21:55:05.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:04 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T21:55:05.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:04 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T21:55:05.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:04 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T21:55:05.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:04 smithi122 ceph-mon[125440]: pgmap v21039: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:55:06.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:06 smithi136 ceph-mon[125702]: pgmap v21040: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:55:06.941 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:06 smithi057 ceph-mon[92072]: pgmap v21040: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:55:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:06 smithi122 ceph-mon[125440]: pgmap v21040: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:55:07.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:07 smithi136 ceph-mon[125702]: osdmap e1388: 12 total, 12 up, 12 in 2023-03-02T21:55:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:07 smithi057 ceph-mon[92072]: osdmap e1388: 12 total, 12 up, 12 in 2023-03-02T21:55:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:07 smithi122 ceph-mon[125440]: osdmap e1388: 12 total, 12 up, 12 in 2023-03-02T21:55:08.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:08 smithi136 ceph-mon[125702]: pgmap v21042: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:55:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:08 smithi057 ceph-mon[92072]: pgmap v21042: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:55:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:08 smithi122 ceph-mon[125440]: pgmap v21042: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:55:10.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:10 smithi057 ceph-mon[92072]: pgmap v21043: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:55:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:10 smithi122 ceph-mon[125440]: pgmap v21043: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:55:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:10 smithi136 ceph-mon[125702]: pgmap v21043: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:55:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:12 smithi057 ceph-mon[92072]: pgmap v21044: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:55:12.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:12 smithi122 ceph-mon[125440]: pgmap v21044: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:55:12.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:12 smithi136 ceph-mon[125702]: pgmap v21044: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:55:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:14 smithi057 ceph-mon[92072]: pgmap v21045: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:55:14.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:14 smithi122 ceph-mon[125440]: pgmap v21045: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:55:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:14 smithi136 ceph-mon[125702]: pgmap v21045: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:55:16.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:16 smithi136 ceph-mon[125702]: osdmap e1389: 12 total, 12 up, 12 in 2023-03-02T21:55:16.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:16 smithi136 ceph-mon[125702]: pgmap v21047: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:55:16.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:16 smithi057 ceph-mon[92072]: osdmap e1389: 12 total, 12 up, 12 in 2023-03-02T21:55:16.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:16 smithi057 ceph-mon[92072]: pgmap v21047: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:55:16.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:16 smithi122 ceph-mon[125440]: osdmap e1389: 12 total, 12 up, 12 in 2023-03-02T21:55:16.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:16 smithi122 ceph-mon[125440]: pgmap v21047: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:55:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:18 smithi057 ceph-mon[92072]: pgmap v21048: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:55:18.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:18 smithi122 ceph-mon[125440]: pgmap v21048: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:55:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:18 smithi136 ceph-mon[125702]: pgmap v21048: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:55:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:19.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:55:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:19.230+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:55:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:19.230+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:55:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:19.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:55:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:19.230+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:55:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:20 smithi057 ceph-mon[92072]: pgmap v21049: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:55:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:20 smithi122 ceph-mon[125440]: pgmap v21049: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:55:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:20 smithi136 ceph-mon[125702]: pgmap v21049: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:55:22.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:22 smithi057 ceph-mon[92072]: pgmap v21050: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:55:22.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:22 smithi122 ceph-mon[125440]: pgmap v21050: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:55:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:22 smithi136 ceph-mon[125702]: pgmap v21050: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:55:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:24 smithi057 ceph-mon[92072]: pgmap v21051: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:55:24.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:24 smithi122 ceph-mon[125440]: pgmap v21051: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:55:24.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:24 smithi136 ceph-mon[125702]: pgmap v21051: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:55:26.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:26 smithi136 ceph-mon[125702]: pgmap v21052: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:55:26.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:26 smithi057 ceph-mon[92072]: pgmap v21052: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:55:26.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:26 smithi122 ceph-mon[125440]: pgmap v21052: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:55:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:28 smithi057 ceph-mon[92072]: pgmap v21053: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:28.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:28 smithi122 ceph-mon[125440]: pgmap v21053: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:28.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:28 smithi136 ceph-mon[125702]: pgmap v21053: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:30 smithi057 ceph-mon[92072]: pgmap v21054: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:30.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:30 smithi122 ceph-mon[125440]: pgmap v21054: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:30.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:30 smithi136 ceph-mon[125702]: pgmap v21054: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:32.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:32 smithi057 ceph-mon[92072]: pgmap v21055: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:32.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:32 smithi122 ceph-mon[125440]: pgmap v21055: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:32.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:32 smithi136 ceph-mon[125702]: pgmap v21055: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:34.243+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:55:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:34.243+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:55:34.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:34.243+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:55:34.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:34.243+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:55:34.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:34.243+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:55:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:34 smithi057 ceph-mon[92072]: pgmap v21056: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:34 smithi122 ceph-mon[125440]: pgmap v21056: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:34.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:34 smithi136 ceph-mon[125702]: pgmap v21056: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:36 smithi136 ceph-mon[125702]: pgmap v21057: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:36.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:36 smithi057 ceph-mon[92072]: pgmap v21057: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:36.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:36 smithi122 ceph-mon[125440]: pgmap v21057: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:38 smithi057 ceph-mon[92072]: pgmap v21058: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:38.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:38 smithi122 ceph-mon[125440]: pgmap v21058: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:38.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:38 smithi136 ceph-mon[125702]: pgmap v21058: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:40 smithi057 ceph-mon[92072]: pgmap v21059: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:40.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:40 smithi122 ceph-mon[125440]: pgmap v21059: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:40.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:40 smithi136 ceph-mon[125702]: pgmap v21059: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:42 smithi057 ceph-mon[92072]: pgmap v21060: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:42 smithi122 ceph-mon[125440]: pgmap v21060: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:42.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:42 smithi136 ceph-mon[125702]: pgmap v21060: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:44.440 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:44 smithi057 ceph-mon[92072]: pgmap v21061: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:44 smithi122 ceph-mon[125440]: pgmap v21061: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:44 smithi136 ceph-mon[125702]: pgmap v21061: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:46.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:46 smithi136 ceph-mon[125702]: pgmap v21062: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:46.942 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:46 smithi057 ceph-mon[92072]: pgmap v21062: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:46.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:46 smithi122 ceph-mon[125440]: pgmap v21062: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:48 smithi057 ceph-mon[92072]: pgmap v21063: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:48 smithi122 ceph-mon[125440]: pgmap v21063: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:48.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:48 smithi136 ceph-mon[125702]: pgmap v21063: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:49.249+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:55:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:49.249+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:55:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:49.249+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:55:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:49.249+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:55:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:55:49.249+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:55:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:50 smithi057 ceph-mon[92072]: pgmap v21064: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:50.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:50 smithi122 ceph-mon[125440]: pgmap v21064: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:50 smithi136 ceph-mon[125702]: pgmap v21064: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:52 smithi057 ceph-mon[92072]: pgmap v21065: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:52.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:52 smithi122 ceph-mon[125440]: pgmap v21065: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:52.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:52 smithi136 ceph-mon[125702]: pgmap v21065: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:54.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:54 smithi057 ceph-mon[92072]: pgmap v21066: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:54 smithi122 ceph-mon[125440]: pgmap v21066: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:54 smithi136 ceph-mon[125702]: pgmap v21066: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:56 smithi136 ceph-mon[125702]: pgmap v21067: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:56.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:56 smithi057 ceph-mon[92072]: pgmap v21067: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:56.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:56 smithi122 ceph-mon[125440]: pgmap v21067: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:55:58.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:55:58 smithi057 ceph-mon[92072]: pgmap v21068: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:55:58 smithi122 ceph-mon[125440]: pgmap v21068: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:55:58.604 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:55:58 smithi136 ceph-mon[125702]: pgmap v21068: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:00 smithi057 ceph-mon[92072]: pgmap v21069: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:00 smithi122 ceph-mon[125440]: pgmap v21069: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:00 smithi136 ceph-mon[125702]: pgmap v21069: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:02 smithi057 ceph-mon[92072]: pgmap v21070: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:56:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:02 smithi122 ceph-mon[125440]: pgmap v21070: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:56:02.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:02 smithi136 ceph-mon[125702]: pgmap v21070: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:56:04.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:04.262+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:56:04.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:04.263+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:56:04.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:04.263+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:56:04.268 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:04.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:56:04.269 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:04.263+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:56:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:04 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:56:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:04 smithi057 ceph-mon[92072]: pgmap v21071: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:56:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:04 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:56:04.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:04 smithi122 ceph-mon[125440]: pgmap v21071: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:56:04.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:04 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:56:04.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:04 smithi136 ceph-mon[125702]: pgmap v21071: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:56:05.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:56:05.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:56:05.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:05 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:56:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:56:05.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:56:05.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:05 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:56:05.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:56:05.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:56:05.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:05 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:56:06.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:06 smithi136 ceph-mon[125702]: pgmap v21072: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:56:06.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:06 smithi057 ceph-mon[92072]: pgmap v21072: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:56:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:06 smithi122 ceph-mon[125440]: pgmap v21072: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:56:07.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:07 smithi136 ceph-mon[125702]: osdmap e1390: 12 total, 12 up, 12 in 2023-03-02T21:56:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:07 smithi057 ceph-mon[92072]: osdmap e1390: 12 total, 12 up, 12 in 2023-03-02T21:56:07.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:07 smithi122 ceph-mon[125440]: osdmap e1390: 12 total, 12 up, 12 in 2023-03-02T21:56:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:08 smithi136 ceph-mon[125702]: pgmap v21074: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:56:08.941 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:08 smithi057 ceph-mon[92072]: pgmap v21074: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:56:08.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:08 smithi122 ceph-mon[125440]: pgmap v21074: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:56:10.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:10 smithi057 ceph-mon[92072]: pgmap v21075: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:56:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:10 smithi122 ceph-mon[125440]: pgmap v21075: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:56:10.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:10 smithi136 ceph-mon[125702]: pgmap v21075: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:56:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:12 smithi057 ceph-mon[92072]: pgmap v21076: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:56:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:12 smithi122 ceph-mon[125440]: pgmap v21076: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:56:12.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:12 smithi136 ceph-mon[125702]: pgmap v21076: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:56:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:14.077+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:56:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:14.077+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:56:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:14.077+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 303 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:56:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:14.077+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 304 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:56:14.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:14 smithi057 ceph-mon[92072]: pgmap v21077: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:56:14.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:14 smithi122 ceph-mon[125440]: pgmap v21077: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:56:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:14 smithi136 ceph-mon[125702]: pgmap v21077: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:56:16.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:16 smithi136 ceph-mon[125702]: osdmap e1391: 12 total, 12 up, 12 in 2023-03-02T21:56:16.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:16 smithi136 ceph-mon[125702]: pgmap v21079: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:56:16.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:16 smithi057 ceph-mon[92072]: osdmap e1391: 12 total, 12 up, 12 in 2023-03-02T21:56:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:16 smithi057 ceph-mon[92072]: pgmap v21079: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:56:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:16 smithi122 ceph-mon[125440]: osdmap e1391: 12 total, 12 up, 12 in 2023-03-02T21:56:16.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:16 smithi122 ceph-mon[125440]: pgmap v21079: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:56:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:18 smithi057 ceph-mon[92072]: pgmap v21080: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:56:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:18 smithi122 ceph-mon[125440]: pgmap v21080: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:56:18.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:18 smithi136 ceph-mon[125702]: pgmap v21080: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:56:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:19.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:56:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:19.272+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:56:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:19.272+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:56:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:19.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:56:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:19.272+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:56:20.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:20 smithi057 ceph-mon[92072]: pgmap v21081: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:56:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:20 smithi122 ceph-mon[125440]: pgmap v21081: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:56:20.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:20 smithi136 ceph-mon[125702]: pgmap v21081: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:56:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:22 smithi057 ceph-mon[92072]: pgmap v21082: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:56:22.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:22 smithi122 ceph-mon[125440]: pgmap v21082: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:56:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:22 smithi136 ceph-mon[125702]: pgmap v21082: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:56:24.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:24 smithi057 ceph-mon[92072]: pgmap v21083: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:56:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:24 smithi122 ceph-mon[125440]: pgmap v21083: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:56:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:24 smithi136 ceph-mon[125702]: pgmap v21083: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T21:56:26.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:26 smithi136 ceph-mon[125702]: pgmap v21084: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:56:26.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:26 smithi057 ceph-mon[92072]: pgmap v21084: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:56:26.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:26 smithi122 ceph-mon[125440]: pgmap v21084: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T21:56:28.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:28 smithi057 ceph-mon[92072]: pgmap v21085: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:28.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:28 smithi122 ceph-mon[125440]: pgmap v21085: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:28 smithi136 ceph-mon[125702]: pgmap v21085: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:30.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:30 smithi057 ceph-mon[92072]: pgmap v21086: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:30 smithi122 ceph-mon[125440]: pgmap v21086: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:30.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:30 smithi136 ceph-mon[125702]: pgmap v21086: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:32 smithi057 ceph-mon[92072]: pgmap v21087: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:32.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:32 smithi122 ceph-mon[125440]: pgmap v21087: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:32.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:32 smithi136 ceph-mon[125702]: pgmap v21087: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:34.288+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:56:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:34.288+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:56:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:34.288+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:56:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:34.288+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:56:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:34.288+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:56:34.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:34 smithi057 ceph-mon[92072]: pgmap v21088: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:56:34.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:34 smithi122 ceph-mon[125440]: pgmap v21088: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:56:34.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:34 smithi136 ceph-mon[125702]: pgmap v21088: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:56:36.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:36 smithi136 ceph-mon[125702]: pgmap v21089: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:56:36.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:36 smithi057 ceph-mon[92072]: pgmap v21089: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:56:36.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:36 smithi122 ceph-mon[125440]: pgmap v21089: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:56:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:38 smithi057 ceph-mon[92072]: pgmap v21090: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:38.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:38 smithi122 ceph-mon[125440]: pgmap v21090: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:38 smithi136 ceph-mon[125702]: pgmap v21090: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:40 smithi057 ceph-mon[92072]: pgmap v21091: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:56:40.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:40 smithi122 ceph-mon[125440]: pgmap v21091: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:56:40.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:40 smithi136 ceph-mon[125702]: pgmap v21091: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T21:56:42.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:42 smithi057 ceph-mon[92072]: pgmap v21092: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:42 smithi122 ceph-mon[125440]: pgmap v21092: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:42.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:42 smithi136 ceph-mon[125702]: pgmap v21092: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:44.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:44 smithi057 ceph-mon[92072]: pgmap v21093: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:44.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:44 smithi122 ceph-mon[125440]: pgmap v21093: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:44.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:44 smithi136 ceph-mon[125702]: pgmap v21093: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:46.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:46 smithi136 ceph-mon[125702]: pgmap v21094: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:46.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:46 smithi057 ceph-mon[92072]: pgmap v21094: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:46.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:46 smithi122 ceph-mon[125440]: pgmap v21094: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:48 smithi057 ceph-mon[92072]: pgmap v21095: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:48.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:48 smithi122 ceph-mon[125440]: pgmap v21095: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:48.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:48 smithi136 ceph-mon[125702]: pgmap v21095: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:49.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:56:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:49.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:56:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:49.293+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:56:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:49.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:56:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:56:49.293+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:56:50.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:50 smithi057 ceph-mon[92072]: pgmap v21096: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:50.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:50 smithi122 ceph-mon[125440]: pgmap v21096: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:50 smithi136 ceph-mon[125702]: pgmap v21096: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:52 smithi057 ceph-mon[92072]: pgmap v21097: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:52.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:52 smithi122 ceph-mon[125440]: pgmap v21097: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:52.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:52 smithi136 ceph-mon[125702]: pgmap v21097: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:54 smithi057 ceph-mon[92072]: pgmap v21098: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:54.455 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:54 smithi122 ceph-mon[125440]: pgmap v21098: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:54 smithi136 ceph-mon[125702]: pgmap v21098: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:56.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:56 smithi136 ceph-mon[125702]: pgmap v21099: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:56.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:56 smithi057 ceph-mon[92072]: pgmap v21099: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:56.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:56 smithi122 ceph-mon[125440]: pgmap v21099: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:56:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:56:58 smithi057 ceph-mon[92072]: pgmap v21100: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:58.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:56:58 smithi122 ceph-mon[125440]: pgmap v21100: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:56:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:56:58 smithi136 ceph-mon[125702]: pgmap v21100: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:00 smithi057 ceph-mon[92072]: pgmap v21101: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:00.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:00 smithi122 ceph-mon[125440]: pgmap v21101: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:00.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:00 smithi136 ceph-mon[125702]: pgmap v21101: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:02 smithi057 ceph-mon[92072]: pgmap v21102: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:57:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:02 smithi122 ceph-mon[125440]: pgmap v21102: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:57:02.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:02 smithi136 ceph-mon[125702]: pgmap v21102: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:57:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:04.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:57:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:04.310+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:57:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:04.310+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:57:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:04.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:57:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:04.310+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:57:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:04 smithi057 ceph-mon[92072]: pgmap v21103: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:57:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:04 smithi122 ceph-mon[125440]: pgmap v21103: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:57:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:04 smithi136 ceph-mon[125702]: pgmap v21103: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:57:05.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:05 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:57:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:05 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:57:05.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:05 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:57:06.853 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:57:06.854 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:57:06.854 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:06 smithi136 ceph-mon[125702]: pgmap v21104: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:57:06.854 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:57:06.854 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:57:06.854 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:06 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:57:06.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:57:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:57:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:06 smithi057 ceph-mon[92072]: pgmap v21104: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:57:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:57:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:57:06.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:06 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:57:06.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:57:06.977 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:57:06.978 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:06 smithi122 ceph-mon[125440]: pgmap v21104: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:57:06.978 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:57:06.978 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:57:06.978 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:06 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:57:07.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:07 smithi136 ceph-mon[125702]: osdmap e1392: 12 total, 12 up, 12 in 2023-03-02T21:57:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:07 smithi057 ceph-mon[92072]: osdmap e1392: 12 total, 12 up, 12 in 2023-03-02T21:57:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:07 smithi122 ceph-mon[125440]: osdmap e1392: 12 total, 12 up, 12 in 2023-03-02T21:57:08.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:08 smithi136 ceph-mon[125702]: pgmap v21106: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:57:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:08 smithi057 ceph-mon[92072]: pgmap v21106: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:57:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:08 smithi122 ceph-mon[125440]: pgmap v21106: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:57:10.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:10 smithi057 ceph-mon[92072]: pgmap v21107: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:57:10.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:10 smithi122 ceph-mon[125440]: pgmap v21107: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:57:10.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:10 smithi136 ceph-mon[125702]: pgmap v21107: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:57:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:12 smithi057 ceph-mon[92072]: pgmap v21108: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:57:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:12 smithi122 ceph-mon[125440]: pgmap v21108: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:57:12.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:12 smithi136 ceph-mon[125702]: pgmap v21108: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:57:14.439 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:14 smithi057 ceph-mon[92072]: pgmap v21109: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:57:14.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:14 smithi122 ceph-mon[125440]: pgmap v21109: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:57:14.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:14 smithi136 ceph-mon[125702]: pgmap v21109: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:57:16.853 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:16 smithi136 ceph-mon[125702]: osdmap e1393: 12 total, 12 up, 12 in 2023-03-02T21:57:16.853 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:16 smithi136 ceph-mon[125702]: pgmap v21111: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:57:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:16 smithi057 ceph-mon[92072]: osdmap e1393: 12 total, 12 up, 12 in 2023-03-02T21:57:16.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:16 smithi057 ceph-mon[92072]: pgmap v21111: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:57:16.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:16 smithi122 ceph-mon[125440]: osdmap e1393: 12 total, 12 up, 12 in 2023-03-02T21:57:16.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:16 smithi122 ceph-mon[125440]: pgmap v21111: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-02T21:57:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:18 smithi057 ceph-mon[92072]: pgmap v21112: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:57:18.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:18 smithi122 ceph-mon[125440]: pgmap v21112: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:57:18.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:18 smithi136 ceph-mon[125702]: pgmap v21112: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:57:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:19.326+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:57:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:19.326+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:57:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:19.326+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:57:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:19.326+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:57:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:19.326+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:57:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:20 smithi057 ceph-mon[92072]: pgmap v21113: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:57:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:20 smithi122 ceph-mon[125440]: pgmap v21113: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:57:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:20 smithi136 ceph-mon[125702]: pgmap v21113: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:57:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:22 smithi057 ceph-mon[92072]: pgmap v21114: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:57:22.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:22 smithi122 ceph-mon[125440]: pgmap v21114: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:57:22.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:22 smithi136 ceph-mon[125702]: pgmap v21114: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:57:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:24 smithi057 ceph-mon[92072]: pgmap v21115: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:57:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:24 smithi122 ceph-mon[125440]: pgmap v21115: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:57:24.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:24 smithi136 ceph-mon[125702]: pgmap v21115: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:57:26.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:26 smithi136 ceph-mon[125702]: pgmap v21116: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:57:26.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:26 smithi057 ceph-mon[92072]: pgmap v21116: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:57:26.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:26 smithi122 ceph-mon[125440]: pgmap v21116: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:57:29.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:29 smithi057 ceph-mon[92072]: pgmap v21117: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:57:29.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:29 smithi122 ceph-mon[125440]: pgmap v21117: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:57:29.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:29 smithi136 ceph-mon[125702]: pgmap v21117: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:57:31.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:31 smithi136 ceph-mon[125702]: pgmap v21118: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:31.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:31 smithi057 ceph-mon[92072]: pgmap v21118: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:31.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:31 smithi122 ceph-mon[125440]: pgmap v21118: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:33 smithi136 ceph-mon[125702]: pgmap v21119: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:33.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:33 smithi057 ceph-mon[92072]: pgmap v21119: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:33.958 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:33 smithi122 ceph-mon[125440]: pgmap v21119: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:34.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:57:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:34.340+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:57:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:34.340+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:57:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:34.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:57:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:34.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:57:35.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:35 smithi136 ceph-mon[125702]: pgmap v21120: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:35.942 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:35 smithi057 ceph-mon[92072]: pgmap v21120: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:35 smithi122 ceph-mon[125440]: pgmap v21120: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:37.851 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:37 smithi136 ceph-mon[125702]: pgmap v21121: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:37.951 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:37 smithi057 ceph-mon[92072]: pgmap v21121: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:37.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:37 smithi122 ceph-mon[125440]: pgmap v21121: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:39.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:39 smithi136 ceph-mon[125702]: pgmap v21122: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:39.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:39 smithi057 ceph-mon[92072]: pgmap v21122: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:39.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:39 smithi122 ceph-mon[125440]: pgmap v21122: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:41.844 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:41 smithi136 ceph-mon[125702]: pgmap v21123: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:41.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:41 smithi057 ceph-mon[92072]: pgmap v21123: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:41.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:41 smithi122 ceph-mon[125440]: pgmap v21123: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:43.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:43 smithi136 ceph-mon[125702]: pgmap v21124: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:43.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:43 smithi057 ceph-mon[92072]: pgmap v21124: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:43.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:43 smithi122 ceph-mon[125440]: pgmap v21124: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:45.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:45 smithi136 ceph-mon[125702]: pgmap v21125: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:45.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:45 smithi057 ceph-mon[92072]: pgmap v21125: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:45.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:45 smithi122 ceph-mon[125440]: pgmap v21125: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:47.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:47 smithi136 ceph-mon[125702]: pgmap v21126: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:47.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:47 smithi057 ceph-mon[92072]: pgmap v21126: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:47.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:47 smithi122 ceph-mon[125440]: pgmap v21126: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:49.347+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:57:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:49.348+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:57:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:49.348+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:57:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:49.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:57:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:57:49.348+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:57:49.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:49 smithi057 ceph-mon[92072]: pgmap v21127: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:49.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:49 smithi122 ceph-mon[125440]: pgmap v21127: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:50.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:49 smithi136 ceph-mon[125702]: pgmap v21127: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:51.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:51 smithi057 ceph-mon[92072]: pgmap v21128: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:51.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:51 smithi122 ceph-mon[125440]: pgmap v21128: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:52.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:51 smithi136 ceph-mon[125702]: pgmap v21128: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:53.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:53 smithi057 ceph-mon[92072]: pgmap v21129: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:53.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:53 smithi122 ceph-mon[125440]: pgmap v21129: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:54.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:53 smithi136 ceph-mon[125702]: pgmap v21129: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:55.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:55 smithi057 ceph-mon[92072]: pgmap v21130: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:55.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:55 smithi122 ceph-mon[125440]: pgmap v21130: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:55 smithi136 ceph-mon[125702]: pgmap v21130: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:57.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:57 smithi057 ceph-mon[92072]: pgmap v21131: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:57 smithi122 ceph-mon[125440]: pgmap v21131: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:57 smithi136 ceph-mon[125702]: pgmap v21131: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:57:59.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:57:59 smithi057 ceph-mon[92072]: pgmap v21132: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:57:59.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:57:59 smithi122 ceph-mon[125440]: pgmap v21132: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:57:59 smithi136 ceph-mon[125702]: pgmap v21132: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:01.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:01 smithi057 ceph-mon[92072]: pgmap v21133: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:01.955 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:01 smithi122 ceph-mon[125440]: pgmap v21133: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:02.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:01 smithi136 ceph-mon[125702]: pgmap v21133: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:03.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:03 smithi057 ceph-mon[92072]: pgmap v21134: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:58:03.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:03 smithi122 ceph-mon[125440]: pgmap v21134: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:58:04.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:03 smithi136 ceph-mon[125702]: pgmap v21134: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:58:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:04.363+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:58:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:04.363+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:58:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:04.363+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:58:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:04.363+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:58:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:04.363+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:58:05.938 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:05 smithi057 ceph-mon[92072]: pgmap v21135: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:58:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:05 smithi122 ceph-mon[125440]: pgmap v21135: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:58:06.098 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:05 smithi136 ceph-mon[125702]: pgmap v21135: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:58:06.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:06 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:58:06.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:06 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:58:07.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:06 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:58:07.640 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:07 smithi122 ceph-mon[125440]: pgmap v21136: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:58:07.641 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:07 smithi122 ceph-mon[125440]: osdmap e1394: 12 total, 12 up, 12 in 2023-03-02T21:58:07.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:07 smithi057 ceph-mon[92072]: pgmap v21136: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:58:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:07 smithi057 ceph-mon[92072]: osdmap e1394: 12 total, 12 up, 12 in 2023-03-02T21:58:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:07.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:07 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:07.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:07 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:07 smithi136 ceph-mon[125702]: pgmap v21136: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T21:58:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:07 smithi136 ceph-mon[125702]: osdmap e1394: 12 total, 12 up, 12 in 2023-03-02T21:58:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:08.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:07 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:08.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:58:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:58:08.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:58:08.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:58:08.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:58:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:58:09.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:58:09.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:09 smithi057 ceph-mon[92072]: pgmap v21138: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:58:09.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:09 smithi122 ceph-mon[125440]: pgmap v21138: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:58:10.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:09 smithi136 ceph-mon[125702]: pgmap v21138: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:58:11.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:11 smithi057 ceph-mon[92072]: pgmap v21139: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:58:11.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:11 smithi122 ceph-mon[125440]: pgmap v21139: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:58:12.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:11 smithi136 ceph-mon[125702]: pgmap v21139: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:58:13.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:13 smithi057 ceph-mon[92072]: pgmap v21140: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:58:13.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:13 smithi122 ceph-mon[125440]: pgmap v21140: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:58:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:13 smithi136 ceph-mon[125702]: pgmap v21140: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:58:15.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:15 smithi057 ceph-mon[92072]: pgmap v21141: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:58:15.937 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:15 smithi057 ceph-mon[92072]: osdmap e1395: 12 total, 12 up, 12 in 2023-03-02T21:58:15.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:15 smithi122 ceph-mon[125440]: pgmap v21141: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:58:15.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:15 smithi122 ceph-mon[125440]: osdmap e1395: 12 total, 12 up, 12 in 2023-03-02T21:58:16.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:15 smithi136 ceph-mon[125702]: pgmap v21141: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:58:16.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:15 smithi136 ceph-mon[125702]: osdmap e1395: 12 total, 12 up, 12 in 2023-03-02T21:58:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:17 smithi057 ceph-mon[92072]: pgmap v21143: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T21:58:17.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:17 smithi122 ceph-mon[125440]: pgmap v21143: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T21:58:18.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:17 smithi136 ceph-mon[125702]: pgmap v21143: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-02T21:58:19.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:19.369+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:58:19.372 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:19.369+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:58:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:19.369+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:58:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:19.369+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:58:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:19.369+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:58:19.936 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:19 smithi057 ceph-mon[92072]: pgmap v21144: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:58:19.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:19 smithi122 ceph-mon[125440]: pgmap v21144: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:58:20.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:19 smithi136 ceph-mon[125702]: pgmap v21144: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:58:21.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:21 smithi122 ceph-mon[125440]: pgmap v21145: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:58:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:21 smithi136 ceph-mon[125702]: pgmap v21145: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:58:22.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:21 smithi057 ceph-mon[92072]: pgmap v21145: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:58:23.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:23 smithi122 ceph-mon[125440]: pgmap v21146: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:58:24.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:23 smithi136 ceph-mon[125702]: pgmap v21146: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:58:24.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:23 smithi057 ceph-mon[92072]: pgmap v21146: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:58:25.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:25 smithi122 ceph-mon[125440]: pgmap v21147: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:58:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:25 smithi136 ceph-mon[125702]: pgmap v21147: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:58:26.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:25 smithi057 ceph-mon[92072]: pgmap v21147: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:58:28.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:27 smithi136 ceph-mon[125702]: pgmap v21148: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:58:28.190 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:27 smithi057 ceph-mon[92072]: pgmap v21148: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:58:28.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:27 smithi122 ceph-mon[125440]: pgmap v21148: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:58:30.097 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:29 smithi136 ceph-mon[125702]: pgmap v21149: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:58:30.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:29 smithi057 ceph-mon[92072]: pgmap v21149: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:58:30.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:29 smithi122 ceph-mon[125440]: pgmap v21149: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:58:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:31 smithi136 ceph-mon[125702]: pgmap v21150: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:31 smithi057 ceph-mon[92072]: pgmap v21150: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:32.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:31 smithi122 ceph-mon[125440]: pgmap v21150: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:34.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:33 smithi136 ceph-mon[125702]: pgmap v21151: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:33 smithi057 ceph-mon[92072]: pgmap v21151: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:33 smithi122 ceph-mon[125440]: pgmap v21151: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:34.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:58:34.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:34.385+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:58:34.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:34.385+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:58:34.387 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:34.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:58:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:34.385+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:58:36.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:35 smithi136 ceph-mon[125702]: pgmap v21152: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:36.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:35 smithi057 ceph-mon[92072]: pgmap v21152: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:36.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:35 smithi122 ceph-mon[125440]: pgmap v21152: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:38.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:37 smithi136 ceph-mon[125702]: pgmap v21153: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:38.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:37 smithi057 ceph-mon[92072]: pgmap v21153: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:38.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:37 smithi122 ceph-mon[125440]: pgmap v21153: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:40.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:39 smithi136 ceph-mon[125702]: pgmap v21154: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:39 smithi057 ceph-mon[92072]: pgmap v21154: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:39 smithi122 ceph-mon[125440]: pgmap v21154: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:41 smithi136 ceph-mon[125702]: pgmap v21155: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:41 smithi057 ceph-mon[92072]: pgmap v21155: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:41 smithi122 ceph-mon[125440]: pgmap v21155: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:44.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:43 smithi136 ceph-mon[125702]: pgmap v21156: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:43 smithi057 ceph-mon[92072]: pgmap v21156: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:44.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:43 smithi122 ceph-mon[125440]: pgmap v21156: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:46.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:45 smithi136 ceph-mon[125702]: pgmap v21157: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:45 smithi057 ceph-mon[92072]: pgmap v21157: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:46.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:45 smithi122 ceph-mon[125440]: pgmap v21157: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:47 smithi136 ceph-mon[125702]: pgmap v21158: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:47 smithi057 ceph-mon[92072]: pgmap v21158: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:48.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:47 smithi122 ceph-mon[125440]: pgmap v21158: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:49.391+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:58:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:49.392+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:58:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:49.392+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:58:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:49.392+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:58:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:58:49.392+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:58:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:49 smithi136 ceph-mon[125702]: pgmap v21159: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:50.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:49 smithi057 ceph-mon[92072]: pgmap v21159: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:49 smithi122 ceph-mon[125440]: pgmap v21159: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:51 smithi136 ceph-mon[125702]: pgmap v21160: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:51 smithi057 ceph-mon[92072]: pgmap v21160: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:51 smithi122 ceph-mon[125440]: pgmap v21160: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:54.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:53 smithi136 ceph-mon[125702]: pgmap v21161: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:54.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:53 smithi057 ceph-mon[92072]: pgmap v21161: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:54.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:53 smithi122 ceph-mon[125440]: pgmap v21161: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:58:56.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:55 smithi136 ceph-mon[125702]: pgmap v21162: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:55 smithi057 ceph-mon[92072]: pgmap v21162: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:55 smithi122 ceph-mon[125440]: pgmap v21162: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:58.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:57 smithi136 ceph-mon[125702]: pgmap v21163: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:57 smithi057 ceph-mon[92072]: pgmap v21163: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:58:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:57 smithi122 ceph-mon[125440]: pgmap v21163: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:58:59 smithi136 ceph-mon[125702]: pgmap v21164: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:00.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:58:59 smithi057 ceph-mon[92072]: pgmap v21164: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:00.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:58:59 smithi122 ceph-mon[125440]: pgmap v21164: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:01 smithi136 ceph-mon[125702]: pgmap v21165: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:01 smithi057 ceph-mon[92072]: pgmap v21165: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:01 smithi122 ceph-mon[125440]: pgmap v21165: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:03 smithi136 ceph-mon[125702]: pgmap v21166: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:59:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:03 smithi057 ceph-mon[92072]: pgmap v21166: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:59:04.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:03 smithi122 ceph-mon[125440]: pgmap v21166: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T21:59:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:04.406+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:59:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:04.407+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:59:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:04.407+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:59:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:04.407+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:59:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:04.407+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:59:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:05 smithi136 ceph-mon[125702]: pgmap v21167: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:59:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:05 smithi057 ceph-mon[92072]: pgmap v21167: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:59:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:05 smithi122 ceph-mon[125440]: pgmap v21167: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:59:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:07 smithi136 ceph-mon[125702]: pgmap v21168: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:59:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:07 smithi136 ceph-mon[125702]: osdmap e1396: 12 total, 12 up, 12 in 2023-03-02T21:59:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:07 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:59:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:07 smithi057 ceph-mon[92072]: pgmap v21168: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:59:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:07 smithi057 ceph-mon[92072]: osdmap e1396: 12 total, 12 up, 12 in 2023-03-02T21:59:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:07 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:59:08.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:07 smithi122 ceph-mon[125440]: pgmap v21168: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T21:59:08.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:07 smithi122 ceph-mon[125440]: osdmap e1396: 12 total, 12 up, 12 in 2023-03-02T21:59:08.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:07 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T21:59:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:08.434+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000291) for more than 900000000 us, fault. 2023-03-02T21:59:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:08.434+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870096000 comp rx=0 tx=0).stop 2023-03-02T21:59:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:08.434+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 msgr2=0x7f58680a9870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T21:59:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:08.434+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T21:59:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:08.434+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T21:59:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:08.434+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:59:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:08.435+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f5870019780 tx=0x7f58700b2050 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T21:59:09.093 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:59:09.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:59:09.094 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:08 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:59:09.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:59:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:59:09.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:08 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:59:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T21:59:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T21:59:09.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:08 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T21:59:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:09 smithi136 ceph-mon[125702]: pgmap v21170: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:59:10.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:09 smithi057 ceph-mon[92072]: pgmap v21170: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:59:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:09 smithi122 ceph-mon[125440]: pgmap v21170: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:59:12.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:11 smithi136 ceph-mon[125702]: pgmap v21171: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:59:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:11 smithi057 ceph-mon[92072]: pgmap v21171: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:59:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:11 smithi122 ceph-mon[125440]: pgmap v21171: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T21:59:14.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:14.103+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:59:14.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:14.103+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:59:14.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:14.103+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 304 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 612+0+0 (secure 0 0 0) 0x7f58500036e0 con 0x558558b6f6b0 2023-03-02T21:59:14.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:14.103+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 305 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 783+0+0 (secure 0 0 0) 0x7f5858006560 con 0x7f5880105ae0 2023-03-02T21:59:14.105 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:14.103+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:59:14.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:14.103+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:59:14.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:14.104+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 305 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f5850006420 con 0x558558b6f6b0 2023-03-02T21:59:14.106 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:14.104+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 306 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T21:59:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:13 smithi057 ceph-mon[92072]: pgmap v21172: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:59:14.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:13 smithi122 ceph-mon[125440]: pgmap v21172: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:59:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:13 smithi136 ceph-mon[125702]: pgmap v21172: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:59:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:15 smithi057 ceph-mon[92072]: pgmap v21173: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:59:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:15 smithi057 ceph-mon[92072]: osdmap e1397: 12 total, 12 up, 12 in 2023-03-02T21:59:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:15 smithi122 ceph-mon[125440]: pgmap v21173: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:59:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:15 smithi122 ceph-mon[125440]: osdmap e1397: 12 total, 12 up, 12 in 2023-03-02T21:59:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:15 smithi136 ceph-mon[125702]: pgmap v21173: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T21:59:16.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:15 smithi136 ceph-mon[125702]: osdmap e1397: 12 total, 12 up, 12 in 2023-03-02T21:59:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:17 smithi057 ceph-mon[92072]: pgmap v21175: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T21:59:18.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:17 smithi122 ceph-mon[125440]: pgmap v21175: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T21:59:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:17 smithi136 ceph-mon[125702]: pgmap v21175: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T21:59:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:19.417+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:59:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:19.417+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:59:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:19.417+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:59:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:19.417+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:59:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:19.417+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:59:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:19 smithi057 ceph-mon[92072]: pgmap v21176: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:59:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:19 smithi122 ceph-mon[125440]: pgmap v21176: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:59:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:19 smithi136 ceph-mon[125702]: pgmap v21176: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:59:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:21 smithi057 ceph-mon[92072]: pgmap v21177: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:59:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:21 smithi122 ceph-mon[125440]: pgmap v21177: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:59:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:21 smithi136 ceph-mon[125702]: pgmap v21177: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T21:59:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:23 smithi057 ceph-mon[92072]: pgmap v21178: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:59:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:23 smithi122 ceph-mon[125440]: pgmap v21178: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:59:24.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:23 smithi136 ceph-mon[125702]: pgmap v21178: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:59:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:25 smithi057 ceph-mon[92072]: pgmap v21179: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:59:26.206 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:25 smithi122 ceph-mon[125440]: pgmap v21179: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:59:26.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:25 smithi136 ceph-mon[125702]: pgmap v21179: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T21:59:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:27 smithi057 ceph-mon[92072]: pgmap v21180: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:59:28.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:27 smithi122 ceph-mon[125440]: pgmap v21180: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:59:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:27 smithi136 ceph-mon[125702]: pgmap v21180: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T21:59:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:29 smithi057 ceph-mon[92072]: pgmap v21181: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:59:30.204 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:29 smithi122 ceph-mon[125440]: pgmap v21181: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:59:30.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:29 smithi136 ceph-mon[125702]: pgmap v21181: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T21:59:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:31 smithi057 ceph-mon[92072]: pgmap v21182: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:31 smithi122 ceph-mon[125440]: pgmap v21182: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:31 smithi136 ceph-mon[125702]: pgmap v21182: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:34.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:33 smithi057 ceph-mon[92072]: pgmap v21183: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:33 smithi122 ceph-mon[125440]: pgmap v21183: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:33 smithi136 ceph-mon[125702]: pgmap v21183: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:34.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:34.433+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:59:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:34.433+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:59:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:34.433+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:59:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:34.433+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:59:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:34.433+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:59:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:35 smithi057 ceph-mon[92072]: pgmap v21184: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:36.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:35 smithi122 ceph-mon[125440]: pgmap v21184: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:35 smithi136 ceph-mon[125702]: pgmap v21184: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:38.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:37 smithi057 ceph-mon[92072]: pgmap v21185: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:37 smithi122 ceph-mon[125440]: pgmap v21185: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:37 smithi136 ceph-mon[125702]: pgmap v21185: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:39 smithi057 ceph-mon[92072]: pgmap v21186: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:40.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:39 smithi122 ceph-mon[125440]: pgmap v21186: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:40.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:39 smithi136 ceph-mon[125702]: pgmap v21186: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:42.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:41 smithi057 ceph-mon[92072]: pgmap v21187: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:42.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:41 smithi122 ceph-mon[125440]: pgmap v21187: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:42.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:41 smithi136 ceph-mon[125702]: pgmap v21187: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:44.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:43 smithi057 ceph-mon[92072]: pgmap v21188: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:43 smithi122 ceph-mon[125440]: pgmap v21188: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:43 smithi136 ceph-mon[125702]: pgmap v21188: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:45 smithi057 ceph-mon[92072]: pgmap v21189: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:45 smithi122 ceph-mon[125440]: pgmap v21189: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:45 smithi136 ceph-mon[125702]: pgmap v21189: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:47 smithi057 ceph-mon[92072]: pgmap v21190: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:47 smithi122 ceph-mon[125440]: pgmap v21190: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:47 smithi136 ceph-mon[125702]: pgmap v21190: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:49.448 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:49.447+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T21:59:49.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:49.447+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T21:59:49.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:49.447+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T21:59:49.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:49.447+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T21:59:49.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T21:59:49.447+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T21:59:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:49 smithi057 ceph-mon[92072]: pgmap v21191: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:49 smithi122 ceph-mon[125440]: pgmap v21191: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:49 smithi136 ceph-mon[125702]: pgmap v21191: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:51 smithi057 ceph-mon[92072]: pgmap v21192: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:52.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:51 smithi122 ceph-mon[125440]: pgmap v21192: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:51 smithi136 ceph-mon[125702]: pgmap v21192: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:53 smithi122 ceph-mon[125440]: pgmap v21193: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:53 smithi136 ceph-mon[125702]: pgmap v21193: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:53 smithi057 ceph-mon[92072]: pgmap v21193: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T21:59:56.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:55 smithi122 ceph-mon[125440]: pgmap v21194: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:55 smithi136 ceph-mon[125702]: pgmap v21194: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:55 smithi057 ceph-mon[92072]: pgmap v21194: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:58.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:57 smithi122 ceph-mon[125440]: pgmap v21195: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:58.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:57 smithi136 ceph-mon[125702]: pgmap v21195: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T21:59:58.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:57 smithi057 ceph-mon[92072]: pgmap v21195: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:00.346 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 21:59:59 smithi136 ceph-mon[125702]: pgmap v21196: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:00.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 21:59:59 smithi057 ceph-mon[92072]: pgmap v21196: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 21:59:59 smithi122 ceph-mon[125440]: pgmap v21196: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T22:00:01.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T22:00:01.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T22:00:02.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:01 smithi136 ceph-mon[125702]: pgmap v21197: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:02.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:01 smithi057 ceph-mon[92072]: pgmap v21197: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:02.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:01 smithi122 ceph-mon[125440]: pgmap v21197: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:03 smithi136 ceph-mon[125702]: pgmap v21198: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:00:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:03 smithi057 ceph-mon[92072]: pgmap v21198: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:00:04.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:03 smithi122 ceph-mon[125440]: pgmap v21198: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:00:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:04.461+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:00:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:04.461+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:00:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:04.461+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:00:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:04.461+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:00:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:04.461+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:00:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:05 smithi136 ceph-mon[125702]: pgmap v21199: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:00:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:05 smithi057 ceph-mon[92072]: pgmap v21199: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:00:06.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:05 smithi122 ceph-mon[125440]: pgmap v21199: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:00:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:07 smithi136 ceph-mon[125702]: pgmap v21200: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:00:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:07 smithi136 ceph-mon[125702]: osdmap e1398: 12 total, 12 up, 12 in 2023-03-02T22:00:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:07 smithi057 ceph-mon[92072]: pgmap v21200: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:00:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:07 smithi057 ceph-mon[92072]: osdmap e1398: 12 total, 12 up, 12 in 2023-03-02T22:00:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:07 smithi122 ceph-mon[125440]: pgmap v21200: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:00:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:07 smithi122 ceph-mon[125440]: osdmap e1398: 12 total, 12 up, 12 in 2023-03-02T22:00:09.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:08 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:00:09.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:08 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:00:09.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:08 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:00:10.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:10 smithi136 ceph-mon[125702]: pgmap v21202: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:00:10.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:00:10.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:00:10.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:00:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:09 smithi057 ceph-mon[92072]: pgmap v21202: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:00:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:00:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:00:10.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:09 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:00:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:10 smithi122 ceph-mon[125440]: pgmap v21202: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:00:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:00:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:00:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:00:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:12 smithi136 ceph-mon[125702]: pgmap v21203: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:00:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:12 smithi057 ceph-mon[92072]: pgmap v21203: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:00:12.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:12 smithi122 ceph-mon[125440]: pgmap v21203: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:00:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:14 smithi136 ceph-mon[125702]: pgmap v21204: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:00:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:14 smithi057 ceph-mon[92072]: pgmap v21204: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:00:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:14 smithi122 ceph-mon[125440]: pgmap v21204: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:00:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:16 smithi136 ceph-mon[125702]: pgmap v21205: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:00:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:16 smithi136 ceph-mon[125702]: osdmap e1399: 12 total, 12 up, 12 in 2023-03-02T22:00:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:16 smithi057 ceph-mon[92072]: pgmap v21205: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:00:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:16 smithi057 ceph-mon[92072]: osdmap e1399: 12 total, 12 up, 12 in 2023-03-02T22:00:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:16 smithi122 ceph-mon[125440]: pgmap v21205: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:00:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:16 smithi122 ceph-mon[125440]: osdmap e1399: 12 total, 12 up, 12 in 2023-03-02T22:00:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:18 smithi136 ceph-mon[125702]: pgmap v21207: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T22:00:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:18 smithi057 ceph-mon[92072]: pgmap v21207: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T22:00:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:18 smithi122 ceph-mon[125440]: pgmap v21207: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T22:00:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:19.477+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:00:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:19.477+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:00:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:19.477+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:00:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:19.477+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:00:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:19.477+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:00:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:20 smithi136 ceph-mon[125702]: pgmap v21208: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:00:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:20 smithi057 ceph-mon[92072]: pgmap v21208: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:00:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:20 smithi122 ceph-mon[125440]: pgmap v21208: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:00:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:22 smithi136 ceph-mon[125702]: pgmap v21209: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:00:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:22 smithi057 ceph-mon[92072]: pgmap v21209: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:00:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:22 smithi122 ceph-mon[125440]: pgmap v21209: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:00:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:24 smithi136 ceph-mon[125702]: pgmap v21210: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:00:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:24 smithi057 ceph-mon[92072]: pgmap v21210: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:00:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:24 smithi122 ceph-mon[125440]: pgmap v21210: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:00:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:26 smithi136 ceph-mon[125702]: pgmap v21211: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:00:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:26 smithi057 ceph-mon[92072]: pgmap v21211: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:00:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:26 smithi122 ceph-mon[125440]: pgmap v21211: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:00:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:28 smithi136 ceph-mon[125702]: pgmap v21212: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:00:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:28 smithi057 ceph-mon[92072]: pgmap v21212: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:00:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:28 smithi122 ceph-mon[125440]: pgmap v21212: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:00:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:30 smithi136 ceph-mon[125702]: pgmap v21213: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:30 smithi057 ceph-mon[92072]: pgmap v21213: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:30.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:30 smithi122 ceph-mon[125440]: pgmap v21213: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:32 smithi136 ceph-mon[125702]: pgmap v21214: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:32 smithi057 ceph-mon[92072]: pgmap v21214: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:32 smithi122 ceph-mon[125440]: pgmap v21214: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:34 smithi136 ceph-mon[125702]: pgmap v21215: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:34.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:34 smithi057 ceph-mon[92072]: pgmap v21215: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:34 smithi122 ceph-mon[125440]: pgmap v21215: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:34.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:00:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:34.493+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:00:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:34.493+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:00:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:34.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:00:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:34.493+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:00:36.344 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:36 smithi136 ceph-mon[125702]: pgmap v21216: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:36.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:36 smithi057 ceph-mon[92072]: pgmap v21216: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:36.458 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:36 smithi122 ceph-mon[125440]: pgmap v21216: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:38 smithi136 ceph-mon[125702]: pgmap v21217: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:38 smithi057 ceph-mon[92072]: pgmap v21217: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:38 smithi122 ceph-mon[125440]: pgmap v21217: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:40 smithi136 ceph-mon[125702]: pgmap v21218: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:40 smithi057 ceph-mon[92072]: pgmap v21218: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:40.457 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:40 smithi122 ceph-mon[125440]: pgmap v21218: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:42.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:42 smithi136 ceph-mon[125702]: pgmap v21219: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:42 smithi057 ceph-mon[92072]: pgmap v21219: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:42.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:42 smithi122 ceph-mon[125440]: pgmap v21219: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:44 smithi136 ceph-mon[125702]: pgmap v21220: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:44.438 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:44 smithi057 ceph-mon[92072]: pgmap v21220: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:44.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:44 smithi122 ceph-mon[125440]: pgmap v21220: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:46.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:46 smithi136 ceph-mon[125702]: pgmap v21221: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:46.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:46 smithi057 ceph-mon[92072]: pgmap v21221: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:46.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:46 smithi122 ceph-mon[125440]: pgmap v21221: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:48 smithi057 ceph-mon[92072]: pgmap v21222: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:48 smithi122 ceph-mon[125440]: pgmap v21222: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:48 smithi136 ceph-mon[125702]: pgmap v21222: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:49.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:00:49.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:49.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:00:49.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:49.498+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:00:49.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:49.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:00:49.502 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:00:49.498+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:00:50.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:50 smithi057 ceph-mon[92072]: pgmap v21223: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:50 smithi122 ceph-mon[125440]: pgmap v21223: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:50 smithi136 ceph-mon[125702]: pgmap v21223: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:52 smithi057 ceph-mon[92072]: pgmap v21224: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:52 smithi122 ceph-mon[125440]: pgmap v21224: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:52 smithi136 ceph-mon[125702]: pgmap v21224: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:54 smithi057 ceph-mon[92072]: pgmap v21225: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:54.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:54 smithi122 ceph-mon[125440]: pgmap v21225: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:54.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:54 smithi136 ceph-mon[125702]: pgmap v21225: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:56 smithi057 ceph-mon[92072]: pgmap v21226: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:56.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:56 smithi122 ceph-mon[125440]: pgmap v21226: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:56 smithi136 ceph-mon[125702]: pgmap v21226: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:57.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:57 smithi057 ceph-mon[92072]: pgmap v21227: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:57.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:57 smithi122 ceph-mon[125440]: pgmap v21227: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:57.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:57 smithi136 ceph-mon[125702]: pgmap v21227: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:00:59.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:00:59 smithi136 ceph-mon[125702]: pgmap v21228: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:59.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:00:59 smithi057 ceph-mon[92072]: pgmap v21228: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:00:59.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:00:59 smithi122 ceph-mon[125440]: pgmap v21228: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:01.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:01 smithi122 ceph-mon[125440]: pgmap v21229: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:01.875 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:01 smithi136 ceph-mon[125702]: pgmap v21229: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:01 smithi057 ceph-mon[92072]: pgmap v21229: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:03 smithi057 ceph-mon[92072]: pgmap v21230: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:01:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:03 smithi122 ceph-mon[125440]: pgmap v21230: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:01:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:03 smithi136 ceph-mon[125702]: pgmap v21230: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:01:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:04.513+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:01:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:04.514+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:01:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:04.514+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:01:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:04.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:01:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:04.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:01:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:05 smithi057 ceph-mon[92072]: pgmap v21231: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:01:09.123 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:07 smithi057 ceph-mon[92072]: pgmap v21232: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:01:09.123 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:07 smithi057 ceph-mon[92072]: osdmap e1400: 12 total, 12 up, 12 in 2023-03-02T22:01:09.124 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:05 smithi136 ceph-mon[125702]: pgmap v21231: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:01:09.124 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:07 smithi136 ceph-mon[125702]: pgmap v21232: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:01:09.124 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:07 smithi136 ceph-mon[125702]: osdmap e1400: 12 total, 12 up, 12 in 2023-03-02T22:01:09.125 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:05 smithi122 ceph-mon[125440]: pgmap v21231: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:01:09.125 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:07 smithi122 ceph-mon[125440]: pgmap v21232: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:01:09.125 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:07 smithi122 ceph-mon[125440]: osdmap e1400: 12 total, 12 up, 12 in 2023-03-02T22:01:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:09 smithi057 ceph-mon[92072]: pgmap v21234: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:01:09.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:09 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:01:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:09 smithi122 ceph-mon[125440]: pgmap v21234: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:01:09.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:09 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:01:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:09 smithi136 ceph-mon[125702]: pgmap v21234: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:01:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:09 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:01:10.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:01:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:01:10.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:10 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:01:10.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:01:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:01:10.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:10 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:01:11.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:01:11.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:01:11.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:10 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:01:11.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:11 smithi057 ceph-mon[92072]: pgmap v21235: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:01:11.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:11 smithi122 ceph-mon[125440]: pgmap v21235: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:01:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:11 smithi136 ceph-mon[125702]: pgmap v21235: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:01:13.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:13 smithi057 ceph-mon[92072]: pgmap v21236: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:01:13.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:13 smithi122 ceph-mon[125440]: pgmap v21236: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:01:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:13 smithi136 ceph-mon[125702]: pgmap v21236: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:01:15.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:15 smithi057 ceph-mon[92072]: pgmap v21237: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:01:15.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:15 smithi057 ceph-mon[92072]: osdmap e1401: 12 total, 12 up, 12 in 2023-03-02T22:01:15.956 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:15 smithi122 ceph-mon[125440]: pgmap v21237: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:01:15.957 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:15 smithi122 ceph-mon[125440]: osdmap e1401: 12 total, 12 up, 12 in 2023-03-02T22:01:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:15 smithi136 ceph-mon[125702]: pgmap v21237: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:01:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:15 smithi136 ceph-mon[125702]: osdmap e1401: 12 total, 12 up, 12 in 2023-03-02T22:01:17.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:17 smithi057 ceph-mon[92072]: pgmap v21239: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T22:01:17.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:17 smithi122 ceph-mon[125440]: pgmap v21239: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T22:01:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:17 smithi136 ceph-mon[125702]: pgmap v21239: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T22:01:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:19.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:01:19.529 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:19.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:01:19.529 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:19.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:01:19.529 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:19.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:01:19.529 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:19.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:01:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:19 smithi057 ceph-mon[92072]: pgmap v21240: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:01:19.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:19 smithi122 ceph-mon[125440]: pgmap v21240: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:01:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:19 smithi136 ceph-mon[125702]: pgmap v21240: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:01:21.935 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:21 smithi057 ceph-mon[92072]: pgmap v21241: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:01:21.954 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:21 smithi122 ceph-mon[125440]: pgmap v21241: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:01:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:21 smithi136 ceph-mon[125702]: pgmap v21241: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:01:23.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:23 smithi057 ceph-mon[92072]: pgmap v21242: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:01:23.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:23 smithi122 ceph-mon[125440]: pgmap v21242: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:01:24.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:23 smithi136 ceph-mon[125702]: pgmap v21242: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:01:25.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:25 smithi057 ceph-mon[92072]: pgmap v21243: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:01:25.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:25 smithi122 ceph-mon[125440]: pgmap v21243: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:01:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:25 smithi136 ceph-mon[125702]: pgmap v21243: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:01:27.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:27 smithi057 ceph-mon[92072]: pgmap v21244: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:01:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:27 smithi122 ceph-mon[125440]: pgmap v21244: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:01:28.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:27 smithi136 ceph-mon[125702]: pgmap v21244: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:01:29.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:29 smithi057 ceph-mon[92072]: pgmap v21245: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:01:29.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:29 smithi122 ceph-mon[125440]: pgmap v21245: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:01:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:29 smithi136 ceph-mon[125702]: pgmap v21245: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:01:31.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:31 smithi122 ceph-mon[125440]: pgmap v21246: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:32.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:31 smithi136 ceph-mon[125702]: pgmap v21246: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:31 smithi057 ceph-mon[92072]: pgmap v21246: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:33.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:33 smithi122 ceph-mon[125440]: pgmap v21247: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:34.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:33 smithi136 ceph-mon[125702]: pgmap v21247: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:33 smithi057 ceph-mon[92072]: pgmap v21247: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:34.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:34.534+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:01:34.536 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:34.534+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:01:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:34.534+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:01:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:34.534+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:01:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:34.535+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:01:35.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:35 smithi122 ceph-mon[125440]: pgmap v21248: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:35 smithi136 ceph-mon[125702]: pgmap v21248: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:35 smithi057 ceph-mon[92072]: pgmap v21248: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:37 smithi136 ceph-mon[125702]: pgmap v21249: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:37 smithi057 ceph-mon[92072]: pgmap v21249: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:37 smithi122 ceph-mon[125440]: pgmap v21249: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:39 smithi136 ceph-mon[125702]: pgmap v21250: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:39 smithi057 ceph-mon[92072]: pgmap v21250: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:39 smithi122 ceph-mon[125440]: pgmap v21250: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:42.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:41 smithi136 ceph-mon[125702]: pgmap v21251: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:41 smithi057 ceph-mon[92072]: pgmap v21251: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:41 smithi122 ceph-mon[125440]: pgmap v21251: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:43 smithi136 ceph-mon[125702]: pgmap v21252: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:44.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:43 smithi057 ceph-mon[92072]: pgmap v21252: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:43 smithi122 ceph-mon[125440]: pgmap v21252: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:45 smithi136 ceph-mon[125702]: pgmap v21253: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:46.185 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:45 smithi057 ceph-mon[92072]: pgmap v21253: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:45 smithi122 ceph-mon[125440]: pgmap v21253: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:48.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:47 smithi136 ceph-mon[125702]: pgmap v21254: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:47 smithi057 ceph-mon[92072]: pgmap v21254: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:47 smithi122 ceph-mon[125440]: pgmap v21254: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:49.545+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:01:49.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:49.546+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:01:49.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:49.546+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:01:49.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:49.546+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:01:49.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:01:49.546+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:01:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:49 smithi136 ceph-mon[125702]: pgmap v21255: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:49 smithi057 ceph-mon[92072]: pgmap v21255: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:49 smithi122 ceph-mon[125440]: pgmap v21255: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:51 smithi136 ceph-mon[125702]: pgmap v21256: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:51 smithi057 ceph-mon[92072]: pgmap v21256: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:51 smithi122 ceph-mon[125440]: pgmap v21256: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:53 smithi136 ceph-mon[125702]: pgmap v21257: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:53 smithi057 ceph-mon[92072]: pgmap v21257: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:53 smithi122 ceph-mon[125440]: pgmap v21257: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:01:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:55 smithi136 ceph-mon[125702]: pgmap v21258: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:55 smithi057 ceph-mon[92072]: pgmap v21258: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:55 smithi122 ceph-mon[125440]: pgmap v21258: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:57 smithi136 ceph-mon[125702]: pgmap v21259: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:57 smithi057 ceph-mon[92072]: pgmap v21259: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:01:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:57 smithi122 ceph-mon[125440]: pgmap v21259: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:01:59 smithi136 ceph-mon[125702]: pgmap v21260: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:01:59 smithi057 ceph-mon[92072]: pgmap v21260: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:01:59 smithi122 ceph-mon[125440]: pgmap v21260: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:01 smithi136 ceph-mon[125702]: pgmap v21261: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:01 smithi057 ceph-mon[92072]: pgmap v21261: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:01 smithi122 ceph-mon[125440]: pgmap v21261: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:04.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:03 smithi136 ceph-mon[125702]: pgmap v21262: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:02:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:03 smithi057 ceph-mon[92072]: pgmap v21262: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:02:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:03 smithi122 ceph-mon[125440]: pgmap v21262: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:02:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:04.559+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:02:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:04.560+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:02:04.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:04.560+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:02:04.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:04.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:02:04.562 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:04.560+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:02:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:05 smithi136 ceph-mon[125702]: pgmap v21263: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:02:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:05 smithi057 ceph-mon[92072]: pgmap v21263: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:02:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:05 smithi122 ceph-mon[125440]: pgmap v21263: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:02:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:07 smithi136 ceph-mon[125702]: pgmap v21264: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:02:08.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:07 smithi136 ceph-mon[125702]: osdmap e1402: 12 total, 12 up, 12 in 2023-03-02T22:02:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:07 smithi057 ceph-mon[92072]: pgmap v21264: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:02:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:07 smithi057 ceph-mon[92072]: osdmap e1402: 12 total, 12 up, 12 in 2023-03-02T22:02:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:07 smithi122 ceph-mon[125440]: pgmap v21264: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:02:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:07 smithi122 ceph-mon[125440]: osdmap e1402: 12 total, 12 up, 12 in 2023-03-02T22:02:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:09 smithi136 ceph-mon[125702]: pgmap v21266: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:02:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:09 smithi057 ceph-mon[92072]: pgmap v21266: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:02:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:09 smithi122 ceph-mon[125440]: pgmap v21266: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:02:11.092 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:10 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:02:11.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:10 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:02:11.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:10 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:02:12.121 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:11 smithi136 ceph-mon[125702]: pgmap v21267: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:02:12.122 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:02:12.122 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:02:12.122 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:11 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:02:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:11 smithi057 ceph-mon[92072]: pgmap v21267: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:02:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:02:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:02:12.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:11 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:02:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:11 smithi122 ceph-mon[125440]: pgmap v21267: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:02:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:02:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:02:12.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:11 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:02:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:13 smithi136 ceph-mon[125702]: pgmap v21268: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:02:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:14.129+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:02:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:14.129+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:02:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:14.129+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 306 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:02:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:14.129+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 307 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:02:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:13 smithi057 ceph-mon[92072]: pgmap v21268: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:02:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:13 smithi122 ceph-mon[125440]: pgmap v21268: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:02:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:15 smithi136 ceph-mon[125702]: pgmap v21269: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:02:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:15 smithi136 ceph-mon[125702]: osdmap e1403: 12 total, 12 up, 12 in 2023-03-02T22:02:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:15 smithi057 ceph-mon[92072]: pgmap v21269: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:02:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:15 smithi057 ceph-mon[92072]: osdmap e1403: 12 total, 12 up, 12 in 2023-03-02T22:02:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:15 smithi122 ceph-mon[125440]: pgmap v21269: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:02:16.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:15 smithi122 ceph-mon[125440]: osdmap e1403: 12 total, 12 up, 12 in 2023-03-02T22:02:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:17 smithi136 ceph-mon[125702]: pgmap v21271: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:02:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:17 smithi057 ceph-mon[92072]: pgmap v21271: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:02:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:17 smithi122 ceph-mon[125440]: pgmap v21271: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:02:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:19.566+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:02:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:19.566+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:02:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:19.566+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:02:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:19.566+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:02:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:19.566+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:02:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:19 smithi136 ceph-mon[125702]: pgmap v21272: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:02:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:19 smithi057 ceph-mon[92072]: pgmap v21272: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:02:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:19 smithi122 ceph-mon[125440]: pgmap v21272: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:02:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:21 smithi136 ceph-mon[125702]: pgmap v21273: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:02:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:21 smithi057 ceph-mon[92072]: pgmap v21273: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:02:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:21 smithi122 ceph-mon[125440]: pgmap v21273: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:02:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:23 smithi136 ceph-mon[125702]: pgmap v21274: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:02:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:23 smithi057 ceph-mon[92072]: pgmap v21274: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:02:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:23 smithi122 ceph-mon[125440]: pgmap v21274: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:02:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:25 smithi136 ceph-mon[125702]: pgmap v21275: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:02:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:25 smithi057 ceph-mon[92072]: pgmap v21275: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:02:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:25 smithi122 ceph-mon[125440]: pgmap v21275: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:02:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:27 smithi057 ceph-mon[92072]: pgmap v21276: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:02:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:27 smithi122 ceph-mon[125440]: pgmap v21276: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:02:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:27 smithi136 ceph-mon[125702]: pgmap v21276: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:02:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:29 smithi057 ceph-mon[92072]: pgmap v21277: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:29 smithi122 ceph-mon[125440]: pgmap v21277: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:29 smithi136 ceph-mon[125702]: pgmap v21277: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:31 smithi057 ceph-mon[92072]: pgmap v21278: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:31 smithi122 ceph-mon[125440]: pgmap v21278: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:31 smithi136 ceph-mon[125702]: pgmap v21278: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:33 smithi057 ceph-mon[92072]: pgmap v21279: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:33 smithi122 ceph-mon[125440]: pgmap v21279: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:33 smithi136 ceph-mon[125702]: pgmap v21279: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:34.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:02:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:34.583+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:02:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:34.583+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:02:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:34.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:02:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:34.583+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:02:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:35 smithi057 ceph-mon[92072]: pgmap v21280: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:36.205 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:35 smithi122 ceph-mon[125440]: pgmap v21280: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:35 smithi136 ceph-mon[125702]: pgmap v21280: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:37 smithi057 ceph-mon[92072]: pgmap v21281: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:37 smithi122 ceph-mon[125440]: pgmap v21281: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:37 smithi136 ceph-mon[125702]: pgmap v21281: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:39 smithi057 ceph-mon[92072]: pgmap v21282: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:40.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:39 smithi122 ceph-mon[125440]: pgmap v21282: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:39 smithi136 ceph-mon[125702]: pgmap v21282: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:42.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:41 smithi057 ceph-mon[92072]: pgmap v21283: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:41 smithi122 ceph-mon[125440]: pgmap v21283: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:41 smithi136 ceph-mon[125702]: pgmap v21283: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:43 smithi057 ceph-mon[92072]: pgmap v21284: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:44.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:43 smithi122 ceph-mon[125440]: pgmap v21284: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:43 smithi136 ceph-mon[125702]: pgmap v21284: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:45 smithi057 ceph-mon[92072]: pgmap v21285: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:45 smithi122 ceph-mon[125440]: pgmap v21285: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:46.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:45 smithi136 ceph-mon[125702]: pgmap v21285: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:47 smithi057 ceph-mon[92072]: pgmap v21286: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:48.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:47 smithi122 ceph-mon[125440]: pgmap v21286: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:47 smithi136 ceph-mon[125702]: pgmap v21286: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:49.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:02:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:49.598+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:02:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:49.598+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:02:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:49.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:02:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:02:49.598+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:02:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:49 smithi057 ceph-mon[92072]: pgmap v21287: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:50.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:49 smithi122 ceph-mon[125440]: pgmap v21287: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:49 smithi136 ceph-mon[125702]: pgmap v21287: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:51 smithi057 ceph-mon[92072]: pgmap v21288: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:51 smithi122 ceph-mon[125440]: pgmap v21288: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:52.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:51 smithi136 ceph-mon[125702]: pgmap v21288: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:53 smithi057 ceph-mon[92072]: pgmap v21289: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:53 smithi122 ceph-mon[125440]: pgmap v21289: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:53 smithi136 ceph-mon[125702]: pgmap v21289: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:02:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:55 smithi057 ceph-mon[92072]: pgmap v21290: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:55 smithi122 ceph-mon[125440]: pgmap v21290: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:55 smithi136 ceph-mon[125702]: pgmap v21290: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:57 smithi057 ceph-mon[92072]: pgmap v21291: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:57 smithi122 ceph-mon[125440]: pgmap v21291: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:02:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:57 smithi136 ceph-mon[125702]: pgmap v21291: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:02:59 smithi122 ceph-mon[125440]: pgmap v21292: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:02:59 smithi136 ceph-mon[125702]: pgmap v21292: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:02:59 smithi057 ceph-mon[92072]: pgmap v21292: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:01 smithi122 ceph-mon[125440]: pgmap v21293: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:01 smithi136 ceph-mon[125702]: pgmap v21293: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:01 smithi057 ceph-mon[92072]: pgmap v21293: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:03 smithi122 ceph-mon[125440]: pgmap v21294: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:03:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:03 smithi136 ceph-mon[125702]: pgmap v21294: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:03:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:03 smithi057 ceph-mon[92072]: pgmap v21294: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:03:04.615 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:04.613+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:03:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:04.614+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:03:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:04.614+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:03:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:04.614+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:03:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:04.614+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:03:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:05 smithi122 ceph-mon[125440]: pgmap v21295: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:03:06.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:05 smithi136 ceph-mon[125702]: pgmap v21295: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:03:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:05 smithi057 ceph-mon[92072]: pgmap v21295: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:03:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:07 smithi136 ceph-mon[125702]: pgmap v21296: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:03:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:07 smithi136 ceph-mon[125702]: osdmap e1404: 12 total, 12 up, 12 in 2023-03-02T22:03:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:07 smithi057 ceph-mon[92072]: pgmap v21296: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:03:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:07 smithi057 ceph-mon[92072]: osdmap e1404: 12 total, 12 up, 12 in 2023-03-02T22:03:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:07 smithi122 ceph-mon[125440]: pgmap v21296: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:03:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:07 smithi122 ceph-mon[125440]: osdmap e1404: 12 total, 12 up, 12 in 2023-03-02T22:03:10.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:09 smithi136 ceph-mon[125702]: pgmap v21298: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:03:10.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:09 smithi057 ceph-mon[92072]: pgmap v21298: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:03:10.456 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:09 smithi122 ceph-mon[125440]: pgmap v21298: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:03:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:11 smithi136 ceph-mon[125702]: pgmap v21299: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:03:12.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:11 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:03:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:11 smithi057 ceph-mon[92072]: pgmap v21299: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:03:12.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:11 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:03:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:11 smithi122 ceph-mon[125440]: pgmap v21299: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:03:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:11 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:03:13.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:03:13.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:03:13.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:12 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:03:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:03:13.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:03:13.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:12 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:03:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:03:13.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:03:13.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:12 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:03:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:14 smithi136 ceph-mon[125702]: pgmap v21300: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:03:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:14 smithi057 ceph-mon[92072]: pgmap v21300: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:03:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:14 smithi122 ceph-mon[125440]: pgmap v21300: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:03:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:16 smithi136 ceph-mon[125702]: pgmap v21301: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:03:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:16 smithi136 ceph-mon[125702]: osdmap e1405: 12 total, 12 up, 12 in 2023-03-02T22:03:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:16 smithi057 ceph-mon[92072]: pgmap v21301: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:03:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:16 smithi057 ceph-mon[92072]: osdmap e1405: 12 total, 12 up, 12 in 2023-03-02T22:03:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:16 smithi122 ceph-mon[125440]: pgmap v21301: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:03:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:16 smithi122 ceph-mon[125440]: osdmap e1405: 12 total, 12 up, 12 in 2023-03-02T22:03:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:18 smithi136 ceph-mon[125702]: pgmap v21303: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T22:03:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:18 smithi057 ceph-mon[92072]: pgmap v21303: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T22:03:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:18 smithi122 ceph-mon[125440]: pgmap v21303: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T22:03:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:19.618+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:03:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:19.618+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:03:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:19.618+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:03:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:19.618+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:03:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:19.618+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:03:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:20 smithi136 ceph-mon[125702]: pgmap v21304: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:03:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:20 smithi057 ceph-mon[92072]: pgmap v21304: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:03:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:20 smithi122 ceph-mon[125440]: pgmap v21304: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:03:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:22 smithi136 ceph-mon[125702]: pgmap v21305: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:03:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:22 smithi057 ceph-mon[92072]: pgmap v21305: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:03:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:22 smithi122 ceph-mon[125440]: pgmap v21305: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:03:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:24 smithi136 ceph-mon[125702]: pgmap v21306: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:03:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:24 smithi057 ceph-mon[92072]: pgmap v21306: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:03:24.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:24 smithi122 ceph-mon[125440]: pgmap v21306: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:03:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:26 smithi136 ceph-mon[125702]: pgmap v21307: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:03:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:26 smithi057 ceph-mon[92072]: pgmap v21307: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:03:26.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:26 smithi122 ceph-mon[125440]: pgmap v21307: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:03:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:28 smithi136 ceph-mon[125702]: pgmap v21308: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:03:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:28 smithi057 ceph-mon[92072]: pgmap v21308: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:03:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:28 smithi122 ceph-mon[125440]: pgmap v21308: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:03:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:30 smithi136 ceph-mon[125702]: pgmap v21309: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:30 smithi057 ceph-mon[92072]: pgmap v21309: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:30 smithi122 ceph-mon[125440]: pgmap v21309: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:32 smithi136 ceph-mon[125702]: pgmap v21310: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:32 smithi057 ceph-mon[92072]: pgmap v21310: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:32 smithi122 ceph-mon[125440]: pgmap v21310: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:34 smithi136 ceph-mon[125702]: pgmap v21311: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:34 smithi057 ceph-mon[92072]: pgmap v21311: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:34 smithi122 ceph-mon[125440]: pgmap v21311: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:34.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:03:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:34.626+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:03:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:34.626+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:03:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:34.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:03:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:34.626+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:03:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:36 smithi057 ceph-mon[92072]: pgmap v21312: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:36.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:36 smithi122 ceph-mon[125440]: pgmap v21312: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:36 smithi136 ceph-mon[125702]: pgmap v21312: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:38 smithi057 ceph-mon[92072]: pgmap v21313: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:38 smithi122 ceph-mon[125440]: pgmap v21313: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:38 smithi136 ceph-mon[125702]: pgmap v21313: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:40 smithi057 ceph-mon[92072]: pgmap v21314: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:40 smithi122 ceph-mon[125440]: pgmap v21314: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:40 smithi136 ceph-mon[125702]: pgmap v21314: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:42 smithi057 ceph-mon[92072]: pgmap v21315: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:42 smithi122 ceph-mon[125440]: pgmap v21315: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:42 smithi136 ceph-mon[125702]: pgmap v21315: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:44 smithi057 ceph-mon[92072]: pgmap v21316: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:44 smithi122 ceph-mon[125440]: pgmap v21316: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:44 smithi136 ceph-mon[125702]: pgmap v21316: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:46 smithi057 ceph-mon[92072]: pgmap v21317: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:46 smithi122 ceph-mon[125440]: pgmap v21317: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:46 smithi136 ceph-mon[125702]: pgmap v21317: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:48 smithi057 ceph-mon[92072]: pgmap v21318: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:48 smithi122 ceph-mon[125440]: pgmap v21318: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:48.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:48 smithi136 ceph-mon[125702]: pgmap v21318: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:49.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:49.643+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:03:49.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:49.643+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:03:49.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:49.643+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:03:49.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:49.643+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:03:49.645 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:03:49.643+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:03:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:50 smithi057 ceph-mon[92072]: pgmap v21319: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:50 smithi122 ceph-mon[125440]: pgmap v21319: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:50.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:50 smithi136 ceph-mon[125702]: pgmap v21319: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:52 smithi057 ceph-mon[92072]: pgmap v21320: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:52.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:52 smithi122 ceph-mon[125440]: pgmap v21320: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:52 smithi136 ceph-mon[125702]: pgmap v21320: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:54 smithi057 ceph-mon[92072]: pgmap v21321: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:54 smithi122 ceph-mon[125440]: pgmap v21321: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:54.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:54 smithi136 ceph-mon[125702]: pgmap v21321: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:55.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:55 smithi057 ceph-mon[92072]: pgmap v21322: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:55.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:55 smithi122 ceph-mon[125440]: pgmap v21322: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:55.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:55 smithi136 ceph-mon[125702]: pgmap v21322: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:57.939 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:57 smithi057 ceph-mon[92072]: pgmap v21323: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:57.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:57 smithi122 ceph-mon[125440]: pgmap v21323: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:57 smithi136 ceph-mon[125702]: pgmap v21323: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:03:59.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:03:59 smithi057 ceph-mon[92072]: pgmap v21324: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:03:59.953 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:03:59 smithi122 ceph-mon[125440]: pgmap v21324: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:03:59 smithi136 ceph-mon[125702]: pgmap v21324: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:01.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:01 smithi057 ceph-mon[92072]: pgmap v21325: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:01.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:01 smithi122 ceph-mon[125440]: pgmap v21325: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:01 smithi136 ceph-mon[125702]: pgmap v21325: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:03.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:03 smithi057 ceph-mon[92072]: pgmap v21326: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:04:03.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:03 smithi122 ceph-mon[125440]: pgmap v21326: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:04:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:03 smithi136 ceph-mon[125702]: pgmap v21326: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:04:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:04.659+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:04:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:04.659+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:04:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:04.659+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:04:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:04.659+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:04:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:04.659+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:04:05.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:05 smithi057 ceph-mon[92072]: pgmap v21327: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:04:05.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:05 smithi122 ceph-mon[125440]: pgmap v21327: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:04:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:05 smithi136 ceph-mon[125702]: pgmap v21327: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:04:07.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:07 smithi122 ceph-mon[125440]: pgmap v21328: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:04:07.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:07 smithi122 ceph-mon[125440]: osdmap e1406: 12 total, 12 up, 12 in 2023-03-02T22:04:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:07 smithi136 ceph-mon[125702]: pgmap v21328: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:04:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:07 smithi136 ceph-mon[125702]: osdmap e1406: 12 total, 12 up, 12 in 2023-03-02T22:04:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:07 smithi057 ceph-mon[92072]: pgmap v21328: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:04:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:07 smithi057 ceph-mon[92072]: osdmap e1406: 12 total, 12 up, 12 in 2023-03-02T22:04:09.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:09 smithi122 ceph-mon[125440]: pgmap v21330: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:04:10.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:09 smithi136 ceph-mon[125702]: pgmap v21330: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:04:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:09 smithi057 ceph-mon[92072]: pgmap v21330: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:04:11.952 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:11 smithi122 ceph-mon[125440]: pgmap v21331: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:04:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:11 smithi136 ceph-mon[125702]: pgmap v21331: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:04:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:11 smithi057 ceph-mon[92072]: pgmap v21331: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:04:12.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:12 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:04:13.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:12 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:04:13.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:12 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:04:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:13 smithi136 ceph-mon[125702]: pgmap v21332: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:04:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:04:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:04:14.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:13 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:04:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:13 smithi057 ceph-mon[92072]: pgmap v21332: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:04:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:04:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:04:14.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:13 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:04:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:13 smithi122 ceph-mon[125440]: pgmap v21332: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:04:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:04:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:04:14.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:13 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:04:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:15 smithi136 ceph-mon[125702]: pgmap v21333: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:04:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:15 smithi136 ceph-mon[125702]: osdmap e1407: 12 total, 12 up, 12 in 2023-03-02T22:04:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:15 smithi057 ceph-mon[92072]: pgmap v21333: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:04:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:15 smithi057 ceph-mon[92072]: osdmap e1407: 12 total, 12 up, 12 in 2023-03-02T22:04:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:15 smithi122 ceph-mon[125440]: pgmap v21333: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:04:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:15 smithi122 ceph-mon[125440]: osdmap e1407: 12 total, 12 up, 12 in 2023-03-02T22:04:18.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:17 smithi136 ceph-mon[125702]: pgmap v21335: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T22:04:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:17 smithi057 ceph-mon[92072]: pgmap v21335: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T22:04:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:17 smithi122 ceph-mon[125440]: pgmap v21335: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-02T22:04:19.676 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:19.675+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:04:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:19.675+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:04:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:19.675+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:04:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:19.675+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:04:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:19.675+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:04:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:19 smithi136 ceph-mon[125702]: pgmap v21336: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:04:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:19 smithi057 ceph-mon[92072]: pgmap v21336: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:04:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:19 smithi122 ceph-mon[125440]: pgmap v21336: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:04:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:21 smithi136 ceph-mon[125702]: pgmap v21337: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:04:22.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:21 smithi057 ceph-mon[92072]: pgmap v21337: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:04:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:21 smithi122 ceph-mon[125440]: pgmap v21337: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:04:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:23 smithi136 ceph-mon[125702]: pgmap v21338: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:04:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:23 smithi057 ceph-mon[92072]: pgmap v21338: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:04:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:23 smithi122 ceph-mon[125440]: pgmap v21338: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:04:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:25 smithi136 ceph-mon[125702]: pgmap v21339: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:04:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:25 smithi057 ceph-mon[92072]: pgmap v21339: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:04:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:25 smithi122 ceph-mon[125440]: pgmap v21339: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:04:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:27 smithi136 ceph-mon[125702]: pgmap v21340: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:04:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:27 smithi057 ceph-mon[92072]: pgmap v21340: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:04:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:27 smithi122 ceph-mon[125440]: pgmap v21340: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:04:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:29 smithi136 ceph-mon[125702]: pgmap v21341: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:29 smithi057 ceph-mon[92072]: pgmap v21341: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:29 smithi122 ceph-mon[125440]: pgmap v21341: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:31 smithi136 ceph-mon[125702]: pgmap v21342: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:31 smithi057 ceph-mon[92072]: pgmap v21342: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:31 smithi122 ceph-mon[125440]: pgmap v21342: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:33 smithi136 ceph-mon[125702]: pgmap v21343: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:33 smithi057 ceph-mon[92072]: pgmap v21343: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:33 smithi122 ceph-mon[125440]: pgmap v21343: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:34.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:34.677+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:04:34.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:34.677+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:04:34.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:34.677+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:04:34.680 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:34.677+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:04:34.681 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:34.677+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:04:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:35 smithi136 ceph-mon[125702]: pgmap v21344: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:35 smithi057 ceph-mon[92072]: pgmap v21344: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:35 smithi122 ceph-mon[125440]: pgmap v21344: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:37 smithi136 ceph-mon[125702]: pgmap v21345: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:37 smithi057 ceph-mon[92072]: pgmap v21345: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:38.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:37 smithi122 ceph-mon[125440]: pgmap v21345: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:39 smithi136 ceph-mon[125702]: pgmap v21346: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:39 smithi057 ceph-mon[92072]: pgmap v21346: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:39 smithi122 ceph-mon[125440]: pgmap v21346: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:41 smithi136 ceph-mon[125702]: pgmap v21347: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:41 smithi057 ceph-mon[92072]: pgmap v21347: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:41 smithi122 ceph-mon[125440]: pgmap v21347: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:43 smithi136 ceph-mon[125702]: pgmap v21348: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:43 smithi057 ceph-mon[92072]: pgmap v21348: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:43 smithi122 ceph-mon[125440]: pgmap v21348: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:45 smithi136 ceph-mon[125702]: pgmap v21349: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:45 smithi057 ceph-mon[92072]: pgmap v21349: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:45 smithi122 ceph-mon[125440]: pgmap v21349: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:47 smithi136 ceph-mon[125702]: pgmap v21350: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:47 smithi057 ceph-mon[92072]: pgmap v21350: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:47 smithi122 ceph-mon[125440]: pgmap v21350: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:49.693 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:49.691+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:04:49.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:49.692+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:04:49.694 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:49.692+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:04:49.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:49.692+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:04:49.695 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:04:49.692+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:04:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:49 smithi136 ceph-mon[125702]: pgmap v21351: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:49 smithi057 ceph-mon[92072]: pgmap v21351: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:49 smithi122 ceph-mon[125440]: pgmap v21351: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:51 smithi136 ceph-mon[125702]: pgmap v21352: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:51 smithi057 ceph-mon[92072]: pgmap v21352: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:51 smithi122 ceph-mon[125440]: pgmap v21352: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:53 smithi136 ceph-mon[125702]: pgmap v21353: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:53 smithi057 ceph-mon[92072]: pgmap v21353: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:53 smithi122 ceph-mon[125440]: pgmap v21353: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:04:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:55 smithi136 ceph-mon[125702]: pgmap v21354: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:55 smithi057 ceph-mon[92072]: pgmap v21354: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:55 smithi122 ceph-mon[125440]: pgmap v21354: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:58.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:57 smithi136 ceph-mon[125702]: pgmap v21355: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:57 smithi057 ceph-mon[92072]: pgmap v21355: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:04:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:57 smithi122 ceph-mon[125440]: pgmap v21355: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:04:59 smithi136 ceph-mon[125702]: pgmap v21356: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:04:59 smithi057 ceph-mon[92072]: pgmap v21356: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:04:59 smithi122 ceph-mon[125440]: pgmap v21356: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:01 smithi136 ceph-mon[125702]: pgmap v21357: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:01 smithi057 ceph-mon[92072]: pgmap v21357: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:01 smithi122 ceph-mon[125440]: pgmap v21357: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:03 smithi136 ceph-mon[125702]: pgmap v21358: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:05:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:03 smithi057 ceph-mon[92072]: pgmap v21358: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:05:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:03 smithi122 ceph-mon[125440]: pgmap v21358: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:05:04.701 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:04.699+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:05:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:04.700+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:05:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:04.700+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:05:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:04.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:05:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:04.700+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:05:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:05 smithi136 ceph-mon[125702]: pgmap v21359: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:05:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:05 smithi057 ceph-mon[92072]: pgmap v21359: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:05:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:05 smithi122 ceph-mon[125440]: pgmap v21359: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:05:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:07 smithi057 ceph-mon[92072]: pgmap v21360: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:05:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:07 smithi057 ceph-mon[92072]: osdmap e1408: 12 total, 12 up, 12 in 2023-03-02T22:05:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:07 smithi122 ceph-mon[125440]: pgmap v21360: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:05:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:07 smithi122 ceph-mon[125440]: osdmap e1408: 12 total, 12 up, 12 in 2023-03-02T22:05:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:07 smithi136 ceph-mon[125702]: pgmap v21360: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:05:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:07 smithi136 ceph-mon[125702]: osdmap e1408: 12 total, 12 up, 12 in 2023-03-02T22:05:10.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:09 smithi057 ceph-mon[92072]: pgmap v21362: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:05:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:09 smithi122 ceph-mon[125440]: pgmap v21362: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:05:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:09 smithi136 ceph-mon[125702]: pgmap v21362: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:05:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:11 smithi057 ceph-mon[92072]: pgmap v21363: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:05:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:11 smithi122 ceph-mon[125440]: pgmap v21363: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:05:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:11 smithi136 ceph-mon[125702]: pgmap v21363: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:05:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:14.156+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:05:14.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:14.156+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:05:14.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:14.156+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 307 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:05:14.158 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:14.156+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 308 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:05:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:13 smithi057 ceph-mon[92072]: pgmap v21364: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:05:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:13 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:05:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:13 smithi122 ceph-mon[125440]: pgmap v21364: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:05:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:13 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:05:14.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:13 smithi136 ceph-mon[125702]: pgmap v21364: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:05:14.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:13 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:05:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:15 smithi057 ceph-mon[92072]: pgmap v21365: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:05:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:15 smithi057 ceph-mon[92072]: osdmap e1409: 12 total, 12 up, 12 in 2023-03-02T22:05:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:15 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:15 smithi122 ceph-mon[125440]: pgmap v21365: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:05:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:15 smithi122 ceph-mon[125440]: osdmap e1409: 12 total, 12 up, 12 in 2023-03-02T22:05:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:15 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:15 smithi136 ceph-mon[125702]: pgmap v21365: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:05:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:15 smithi136 ceph-mon[125702]: osdmap e1409: 12 total, 12 up, 12 in 2023-03-02T22:05:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:15 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.465 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.466 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.466 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.483 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.483 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.483 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.502 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.503 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.503 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.503 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.503 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.503 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.504 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.504 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.504 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.504 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.504 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.504 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.506 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.506 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.507 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.507 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.507 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:05:17.507 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:05:17.507 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.508 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.524 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.525 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.525 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.525 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.525 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.525 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.525 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.536 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.537 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.537 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.537 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.538 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.539 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.539 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.539 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.539 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.539 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.539 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.540 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.540 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.540 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.540 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:05:17.540 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:05:17.540 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.592 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:05:17.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:05:17.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:05:17.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:05:18.487 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:18 smithi057 ceph-mon[92072]: pgmap v21367: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:05:18.487 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:18 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T22:05:18.487 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:18 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T22:05:18.487 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:18 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T22:05:18.488 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:18 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T22:05:18.527 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:18 smithi122 ceph-mon[125440]: pgmap v21367: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:05:18.528 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:18 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T22:05:18.528 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:18 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T22:05:18.528 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:18 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T22:05:18.528 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:18 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T22:05:18.612 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:18 smithi136 ceph-mon[125702]: pgmap v21367: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:05:18.612 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:18 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T22:05:18.612 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:18 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T22:05:18.613 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:18 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T22:05:18.613 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:18 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T22:05:19.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:19.714+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:05:19.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:19.715+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:05:19.716 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:19.715+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:05:19.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:19.715+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:05:19.717 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:19.715+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:05:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:20 smithi057 ceph-mon[92072]: pgmap v21368: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:05:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:20 smithi122 ceph-mon[125440]: pgmap v21368: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:05:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:20 smithi136 ceph-mon[125702]: pgmap v21368: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:05:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:22 smithi057 ceph-mon[92072]: pgmap v21369: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:05:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:22 smithi122 ceph-mon[125440]: pgmap v21369: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:05:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:22 smithi136 ceph-mon[125702]: pgmap v21369: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:05:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:23 smithi057 ceph-mon[92072]: pgmap v21370: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:05:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:23 smithi122 ceph-mon[125440]: pgmap v21370: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:05:23.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:23 smithi136 ceph-mon[125702]: pgmap v21370: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:05:25.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:25 smithi136 ceph-mon[125702]: pgmap v21371: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:05:25.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:25 smithi057 ceph-mon[92072]: pgmap v21371: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:05:25.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:25 smithi122 ceph-mon[125440]: pgmap v21371: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:05:27.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:27 smithi122 ceph-mon[125440]: pgmap v21372: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:05:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:27 smithi136 ceph-mon[125702]: pgmap v21372: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:05:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:27 smithi057 ceph-mon[92072]: pgmap v21372: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:05:29.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:29 smithi122 ceph-mon[125440]: pgmap v21373: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:29 smithi136 ceph-mon[125702]: pgmap v21373: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:29 smithi057 ceph-mon[92072]: pgmap v21373: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:31.951 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:31 smithi122 ceph-mon[125440]: pgmap v21374: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:31 smithi136 ceph-mon[125702]: pgmap v21374: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:31 smithi057 ceph-mon[92072]: pgmap v21374: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:33 smithi136 ceph-mon[125702]: pgmap v21375: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:33 smithi057 ceph-mon[92072]: pgmap v21375: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:33 smithi122 ceph-mon[125440]: pgmap v21375: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:34.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:34.727+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:05:34.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:34.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:05:34.730 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:34.728+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:05:34.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:34.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:05:34.731 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:34.728+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:05:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:35 smithi136 ceph-mon[125702]: pgmap v21376: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:35 smithi057 ceph-mon[92072]: pgmap v21376: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:35 smithi122 ceph-mon[125440]: pgmap v21376: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:37 smithi136 ceph-mon[125702]: pgmap v21377: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:37 smithi057 ceph-mon[92072]: pgmap v21377: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:37 smithi122 ceph-mon[125440]: pgmap v21377: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:39 smithi136 ceph-mon[125702]: pgmap v21378: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:39 smithi057 ceph-mon[92072]: pgmap v21378: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:39 smithi122 ceph-mon[125440]: pgmap v21378: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:41 smithi136 ceph-mon[125702]: pgmap v21379: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:41 smithi057 ceph-mon[92072]: pgmap v21379: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:41 smithi122 ceph-mon[125440]: pgmap v21379: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:43 smithi136 ceph-mon[125702]: pgmap v21380: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:43 smithi057 ceph-mon[92072]: pgmap v21380: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:43 smithi122 ceph-mon[125440]: pgmap v21380: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:45 smithi136 ceph-mon[125702]: pgmap v21381: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:45 smithi057 ceph-mon[92072]: pgmap v21381: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:45 smithi122 ceph-mon[125440]: pgmap v21381: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:47 smithi136 ceph-mon[125702]: pgmap v21382: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:47 smithi057 ceph-mon[92072]: pgmap v21382: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:47 smithi122 ceph-mon[125440]: pgmap v21382: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:49.732+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:05:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:49.732+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:05:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:49.732+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:05:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:49.732+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:05:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:05:49.732+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:05:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:49 smithi136 ceph-mon[125702]: pgmap v21383: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:49 smithi057 ceph-mon[92072]: pgmap v21383: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:49 smithi122 ceph-mon[125440]: pgmap v21383: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:51 smithi136 ceph-mon[125702]: pgmap v21384: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:51 smithi057 ceph-mon[92072]: pgmap v21384: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:51 smithi122 ceph-mon[125440]: pgmap v21384: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:53 smithi136 ceph-mon[125702]: pgmap v21385: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:53 smithi057 ceph-mon[92072]: pgmap v21385: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:53 smithi122 ceph-mon[125440]: pgmap v21385: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:05:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:55 smithi136 ceph-mon[125702]: pgmap v21386: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:56.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:55 smithi057 ceph-mon[92072]: pgmap v21386: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:56.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:55 smithi122 ceph-mon[125440]: pgmap v21386: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:57 smithi136 ceph-mon[125702]: pgmap v21387: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:57 smithi057 ceph-mon[92072]: pgmap v21387: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:05:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:57 smithi122 ceph-mon[125440]: pgmap v21387: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:05:59 smithi136 ceph-mon[125702]: pgmap v21388: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:05:59 smithi057 ceph-mon[92072]: pgmap v21388: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:05:59 smithi122 ceph-mon[125440]: pgmap v21388: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:01 smithi136 ceph-mon[125702]: pgmap v21389: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:01 smithi057 ceph-mon[92072]: pgmap v21389: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:02.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:01 smithi122 ceph-mon[125440]: pgmap v21389: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:03 smithi136 ceph-mon[125702]: pgmap v21390: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:06:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:03 smithi057 ceph-mon[92072]: pgmap v21390: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:06:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:03 smithi122 ceph-mon[125440]: pgmap v21390: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:06:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:04.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:06:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:04.736+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:06:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:04.736+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:06:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:04.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:06:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:04.736+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:06:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:05 smithi136 ceph-mon[125702]: pgmap v21391: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:06:06.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:05 smithi057 ceph-mon[92072]: pgmap v21391: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:06:06.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:05 smithi122 ceph-mon[125440]: pgmap v21391: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:06:08.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:07 smithi136 ceph-mon[125702]: pgmap v21392: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:06:08.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:07 smithi136 ceph-mon[125702]: osdmap e1410: 12 total, 12 up, 12 in 2023-03-02T22:06:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:07 smithi057 ceph-mon[92072]: pgmap v21392: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:06:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:07 smithi057 ceph-mon[92072]: osdmap e1410: 12 total, 12 up, 12 in 2023-03-02T22:06:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:07 smithi122 ceph-mon[125440]: pgmap v21392: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:06:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:07 smithi122 ceph-mon[125440]: osdmap e1410: 12 total, 12 up, 12 in 2023-03-02T22:06:10.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:09 smithi136 ceph-mon[125702]: pgmap v21394: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:06:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:09 smithi057 ceph-mon[92072]: pgmap v21394: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:06:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:09 smithi122 ceph-mon[125440]: pgmap v21394: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:06:12.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:11 smithi136 ceph-mon[125702]: pgmap v21395: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:06:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:11 smithi057 ceph-mon[92072]: pgmap v21395: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:06:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:11 smithi122 ceph-mon[125440]: pgmap v21395: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:06:14.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:13 smithi136 ceph-mon[125702]: pgmap v21396: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:06:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:13 smithi057 ceph-mon[92072]: pgmap v21396: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:06:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:13 smithi122 ceph-mon[125440]: pgmap v21396: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:06:16.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:15 smithi136 ceph-mon[125702]: pgmap v21397: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:06:16.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:15 smithi136 ceph-mon[125702]: osdmap e1411: 12 total, 12 up, 12 in 2023-03-02T22:06:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:15 smithi057 ceph-mon[92072]: pgmap v21397: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:06:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:15 smithi057 ceph-mon[92072]: osdmap e1411: 12 total, 12 up, 12 in 2023-03-02T22:06:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:15 smithi122 ceph-mon[125440]: pgmap v21397: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:06:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:15 smithi122 ceph-mon[125440]: osdmap e1411: 12 total, 12 up, 12 in 2023-03-02T22:06:18.095 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:17 smithi136 ceph-mon[125702]: pgmap v21399: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 216 B/s wr, 6 op/s 2023-03-02T22:06:18.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:06:18.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:06:18.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:06:18.096 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:17 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:06:18.193 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:17 smithi057 ceph-mon[92072]: pgmap v21399: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 216 B/s wr, 6 op/s 2023-03-02T22:06:18.194 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:06:18.194 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:06:18.194 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:06:18.194 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:17 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:06:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:17 smithi122 ceph-mon[125440]: pgmap v21399: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 216 B/s wr, 6 op/s 2023-03-02T22:06:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:06:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:06:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:06:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:17 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:06:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:19.752+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:06:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:19.752+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:06:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:19.752+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:06:19.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:19.752+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:06:19.755 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:19.752+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:06:20.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:19 smithi136 ceph-mon[125702]: pgmap v21400: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:06:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:19 smithi057 ceph-mon[92072]: pgmap v21400: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:06:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:19 smithi122 ceph-mon[125440]: pgmap v21400: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:06:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:21 smithi136 ceph-mon[125702]: pgmap v21401: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:06:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:21 smithi057 ceph-mon[92072]: pgmap v21401: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:06:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:21 smithi122 ceph-mon[125440]: pgmap v21401: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:06:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:23 smithi136 ceph-mon[125702]: pgmap v21402: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:06:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:23 smithi057 ceph-mon[92072]: pgmap v21402: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:06:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:23 smithi122 ceph-mon[125440]: pgmap v21402: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:06:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:25 smithi136 ceph-mon[125702]: pgmap v21403: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:06:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:25 smithi057 ceph-mon[92072]: pgmap v21403: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:06:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:25 smithi122 ceph-mon[125440]: pgmap v21403: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:06:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:27 smithi136 ceph-mon[125702]: pgmap v21404: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:06:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:27 smithi057 ceph-mon[92072]: pgmap v21404: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:06:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:27 smithi122 ceph-mon[125440]: pgmap v21404: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:06:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:29 smithi136 ceph-mon[125702]: pgmap v21405: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:29 smithi057 ceph-mon[92072]: pgmap v21405: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:29 smithi122 ceph-mon[125440]: pgmap v21405: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:31 smithi136 ceph-mon[125702]: pgmap v21406: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:31 smithi057 ceph-mon[92072]: pgmap v21406: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:31 smithi122 ceph-mon[125440]: pgmap v21406: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:33 smithi136 ceph-mon[125702]: pgmap v21407: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:33 smithi057 ceph-mon[92072]: pgmap v21407: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:33 smithi122 ceph-mon[125440]: pgmap v21407: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:34.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:34.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:06:34.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:34.766+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:06:34.768 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:34.766+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:06:34.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:34.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:06:34.769 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:34.766+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:06:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:35 smithi057 ceph-mon[92072]: pgmap v21408: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:35 smithi122 ceph-mon[125440]: pgmap v21408: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:35 smithi136 ceph-mon[125702]: pgmap v21408: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:37 smithi057 ceph-mon[92072]: pgmap v21409: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:37 smithi122 ceph-mon[125440]: pgmap v21409: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:37 smithi136 ceph-mon[125702]: pgmap v21409: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:39 smithi057 ceph-mon[92072]: pgmap v21410: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:39 smithi122 ceph-mon[125440]: pgmap v21410: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:39 smithi136 ceph-mon[125702]: pgmap v21410: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:41 smithi057 ceph-mon[92072]: pgmap v21411: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:41 smithi122 ceph-mon[125440]: pgmap v21411: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:41 smithi136 ceph-mon[125702]: pgmap v21411: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:43 smithi057 ceph-mon[92072]: pgmap v21412: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:43 smithi122 ceph-mon[125440]: pgmap v21412: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:43 smithi136 ceph-mon[125702]: pgmap v21412: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:45 smithi057 ceph-mon[92072]: pgmap v21413: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:46.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:45 smithi122 ceph-mon[125440]: pgmap v21413: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:45 smithi136 ceph-mon[125702]: pgmap v21413: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:47 smithi057 ceph-mon[92072]: pgmap v21414: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:47 smithi122 ceph-mon[125440]: pgmap v21414: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:47 smithi136 ceph-mon[125702]: pgmap v21414: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:49.774 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:49.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:06:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:49.772+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:06:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:49.772+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:06:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:49.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:06:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:06:49.772+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:06:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:49 smithi057 ceph-mon[92072]: pgmap v21415: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:49 smithi122 ceph-mon[125440]: pgmap v21415: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:49 smithi136 ceph-mon[125702]: pgmap v21415: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:51 smithi057 ceph-mon[92072]: pgmap v21416: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:51 smithi122 ceph-mon[125440]: pgmap v21416: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:51 smithi136 ceph-mon[125702]: pgmap v21416: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:53 smithi057 ceph-mon[92072]: pgmap v21417: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:54.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:53 smithi122 ceph-mon[125440]: pgmap v21417: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:53 smithi136 ceph-mon[125702]: pgmap v21417: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:06:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:55 smithi057 ceph-mon[92072]: pgmap v21418: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:55 smithi122 ceph-mon[125440]: pgmap v21418: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:55 smithi136 ceph-mon[125702]: pgmap v21418: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:57 smithi057 ceph-mon[92072]: pgmap v21419: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:57 smithi122 ceph-mon[125440]: pgmap v21419: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:06:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:57 smithi136 ceph-mon[125702]: pgmap v21419: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:06:59 smithi057 ceph-mon[92072]: pgmap v21420: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:00.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:06:59 smithi122 ceph-mon[125440]: pgmap v21420: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:06:59 smithi136 ceph-mon[125702]: pgmap v21420: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:01 smithi057 ceph-mon[92072]: pgmap v21421: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:01 smithi122 ceph-mon[125440]: pgmap v21421: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:01 smithi136 ceph-mon[125702]: pgmap v21421: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:03 smithi057 ceph-mon[92072]: pgmap v21422: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:07:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:03 smithi122 ceph-mon[125440]: pgmap v21422: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:07:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:03 smithi136 ceph-mon[125702]: pgmap v21422: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:07:04.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:04.774+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:07:04.776 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:04.775+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:07:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:04.775+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:07:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:04.775+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:07:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:04.775+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:07:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:05 smithi057 ceph-mon[92072]: pgmap v21423: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:07:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:05 smithi122 ceph-mon[125440]: pgmap v21423: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:07:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:05 smithi136 ceph-mon[125702]: pgmap v21423: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:07:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:07 smithi057 ceph-mon[92072]: pgmap v21424: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:07:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:07 smithi057 ceph-mon[92072]: osdmap e1412: 12 total, 12 up, 12 in 2023-03-02T22:07:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:07 smithi122 ceph-mon[125440]: pgmap v21424: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:07:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:07 smithi122 ceph-mon[125440]: osdmap e1412: 12 total, 12 up, 12 in 2023-03-02T22:07:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:07 smithi136 ceph-mon[125702]: pgmap v21424: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:07:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:07 smithi136 ceph-mon[125702]: osdmap e1412: 12 total, 12 up, 12 in 2023-03-02T22:07:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:09 smithi057 ceph-mon[92072]: pgmap v21426: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:07:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:09 smithi122 ceph-mon[125440]: pgmap v21426: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:07:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:09 smithi136 ceph-mon[125702]: pgmap v21426: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:07:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:11 smithi122 ceph-mon[125440]: pgmap v21427: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:07:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:11 smithi136 ceph-mon[125702]: pgmap v21427: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:07:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:11 smithi057 ceph-mon[92072]: pgmap v21427: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:07:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:13 smithi122 ceph-mon[125440]: pgmap v21428: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:07:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:13 smithi136 ceph-mon[125702]: pgmap v21428: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:07:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:13 smithi057 ceph-mon[92072]: pgmap v21428: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:07:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:15 smithi122 ceph-mon[125440]: pgmap v21429: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:07:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:15 smithi122 ceph-mon[125440]: osdmap e1413: 12 total, 12 up, 12 in 2023-03-02T22:07:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:15 smithi136 ceph-mon[125702]: pgmap v21429: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:07:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:15 smithi136 ceph-mon[125702]: osdmap e1413: 12 total, 12 up, 12 in 2023-03-02T22:07:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:15 smithi057 ceph-mon[92072]: pgmap v21429: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:07:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:15 smithi057 ceph-mon[92072]: osdmap e1413: 12 total, 12 up, 12 in 2023-03-02T22:07:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:17 smithi136 ceph-mon[125702]: pgmap v21431: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:07:18.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:17 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:07:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:17 smithi057 ceph-mon[92072]: pgmap v21431: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:07:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:17 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:07:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:17 smithi122 ceph-mon[125440]: pgmap v21431: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:07:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:17 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:07:19.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:19 smithi122 ceph-mon[125440]: pgmap v21432: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:07:19.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:07:19.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:07:19.704 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:07:19.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:07:19.705 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:19.790+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:19.790+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:19.790+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:19.790+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:19.791+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:07:19.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:19 smithi136 ceph-mon[125702]: pgmap v21432: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:07:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:07:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:07:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:07:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:07:19.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:07:19.933 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:19 smithi057 ceph-mon[92072]: pgmap v21432: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:07:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:07:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:07:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:07:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:07:19.934 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:07:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:21 smithi136 ceph-mon[125702]: pgmap v21433: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:07:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:21 smithi057 ceph-mon[92072]: pgmap v21433: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:07:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:21 smithi122 ceph-mon[125440]: pgmap v21433: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:07:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:23 smithi136 ceph-mon[125702]: pgmap v21434: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:07:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:23 smithi057 ceph-mon[92072]: pgmap v21434: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:07:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:23 smithi122 ceph-mon[125440]: pgmap v21434: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:07:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:25 smithi136 ceph-mon[125702]: pgmap v21435: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:07:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:25 smithi057 ceph-mon[92072]: pgmap v21435: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:07:26.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:25 smithi122 ceph-mon[125440]: pgmap v21435: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:07:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:27 smithi136 ceph-mon[125702]: pgmap v21436: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:07:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:27 smithi057 ceph-mon[92072]: pgmap v21436: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:07:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:27 smithi122 ceph-mon[125440]: pgmap v21436: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:07:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:29.174+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:07:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:29.174+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:07:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:29.174+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 308 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:07:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:29.174+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 309 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:07:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:29 smithi136 ceph-mon[125702]: pgmap v21437: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:29 smithi057 ceph-mon[92072]: pgmap v21437: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:29 smithi122 ceph-mon[125440]: pgmap v21437: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:31 smithi136 ceph-mon[125702]: pgmap v21438: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:31 smithi057 ceph-mon[92072]: pgmap v21438: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:31 smithi122 ceph-mon[125440]: pgmap v21438: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:33 smithi136 ceph-mon[125702]: pgmap v21439: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:33 smithi057 ceph-mon[92072]: pgmap v21439: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:33 smithi122 ceph-mon[125440]: pgmap v21439: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:34.806+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:07:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:34.806+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:07:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:34.806+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:07:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:34.806+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:07:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:34.806+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:07:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:35 smithi136 ceph-mon[125702]: pgmap v21440: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:35 smithi057 ceph-mon[92072]: pgmap v21440: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:35 smithi122 ceph-mon[125440]: pgmap v21440: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:37 smithi136 ceph-mon[125702]: pgmap v21441: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:37 smithi057 ceph-mon[92072]: pgmap v21441: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:37 smithi122 ceph-mon[125440]: pgmap v21441: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:39 smithi136 ceph-mon[125702]: pgmap v21442: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:39 smithi057 ceph-mon[92072]: pgmap v21442: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:39 smithi122 ceph-mon[125440]: pgmap v21442: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:41 smithi136 ceph-mon[125702]: pgmap v21443: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:41 smithi057 ceph-mon[92072]: pgmap v21443: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:41 smithi122 ceph-mon[125440]: pgmap v21443: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:43 smithi136 ceph-mon[125702]: pgmap v21444: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:43 smithi057 ceph-mon[92072]: pgmap v21444: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:43 smithi122 ceph-mon[125440]: pgmap v21444: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:45 smithi136 ceph-mon[125702]: pgmap v21445: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:45 smithi057 ceph-mon[92072]: pgmap v21445: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:45 smithi122 ceph-mon[125440]: pgmap v21445: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:47 smithi136 ceph-mon[125702]: pgmap v21446: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:47 smithi057 ceph-mon[92072]: pgmap v21446: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:47 smithi122 ceph-mon[125440]: pgmap v21446: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:49.814+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:07:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:49.814+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:07:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:49.814+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:07:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:49.814+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:07:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:07:49.814+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:07:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:49 smithi136 ceph-mon[125702]: pgmap v21447: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:49 smithi057 ceph-mon[92072]: pgmap v21447: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:49 smithi122 ceph-mon[125440]: pgmap v21447: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:51 smithi136 ceph-mon[125702]: pgmap v21448: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:51 smithi057 ceph-mon[92072]: pgmap v21448: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:51 smithi122 ceph-mon[125440]: pgmap v21448: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:53 smithi136 ceph-mon[125702]: pgmap v21449: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:53 smithi057 ceph-mon[92072]: pgmap v21449: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:53 smithi122 ceph-mon[125440]: pgmap v21449: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:07:56.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:55 smithi136 ceph-mon[125702]: pgmap v21450: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:55 smithi057 ceph-mon[92072]: pgmap v21450: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:55 smithi122 ceph-mon[125440]: pgmap v21450: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:58.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:57 smithi136 ceph-mon[125702]: pgmap v21451: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:57 smithi057 ceph-mon[92072]: pgmap v21451: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:07:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:57 smithi122 ceph-mon[125440]: pgmap v21451: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:00.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:07:59 smithi136 ceph-mon[125702]: pgmap v21452: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:07:59 smithi057 ceph-mon[92072]: pgmap v21452: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:07:59 smithi122 ceph-mon[125440]: pgmap v21452: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:02.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:01 smithi136 ceph-mon[125702]: pgmap v21453: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:01 smithi057 ceph-mon[92072]: pgmap v21453: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:01 smithi122 ceph-mon[125440]: pgmap v21453: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:04.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:03 smithi136 ceph-mon[125702]: pgmap v21454: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:08:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:03 smithi057 ceph-mon[92072]: pgmap v21454: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:08:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:03 smithi122 ceph-mon[125440]: pgmap v21454: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:08:04.829 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:04.827+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:08:04.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:04.828+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:08:04.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:04.828+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:08:04.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:04.828+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:08:04.830 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:04.828+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:08:06.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:05 smithi136 ceph-mon[125702]: pgmap v21455: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:08:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:05 smithi057 ceph-mon[92072]: pgmap v21455: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:08:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:05 smithi122 ceph-mon[125440]: pgmap v21455: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:08:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:07 smithi057 ceph-mon[92072]: pgmap v21456: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:08:08.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:07 smithi057 ceph-mon[92072]: osdmap e1414: 12 total, 12 up, 12 in 2023-03-02T22:08:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:07 smithi122 ceph-mon[125440]: pgmap v21456: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:08:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:07 smithi122 ceph-mon[125440]: osdmap e1414: 12 total, 12 up, 12 in 2023-03-02T22:08:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:07 smithi136 ceph-mon[125702]: pgmap v21456: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:08:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:07 smithi136 ceph-mon[125702]: osdmap e1414: 12 total, 12 up, 12 in 2023-03-02T22:08:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:09 smithi057 ceph-mon[92072]: pgmap v21458: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:08:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:09 smithi122 ceph-mon[125440]: pgmap v21458: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:08:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:09 smithi136 ceph-mon[125702]: pgmap v21458: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:08:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:11 smithi057 ceph-mon[92072]: pgmap v21459: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:08:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:11 smithi122 ceph-mon[125440]: pgmap v21459: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:08:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:11 smithi136 ceph-mon[125702]: pgmap v21459: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:08:14.182 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:14.180+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:08:14.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:14.180+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:08:14.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:14.181+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 309 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:08:14.183 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:14.181+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 310 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:08:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:13 smithi057 ceph-mon[92072]: pgmap v21460: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:08:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:13 smithi122 ceph-mon[125440]: pgmap v21460: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:08:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:13 smithi136 ceph-mon[125702]: pgmap v21460: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:08:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:15 smithi057 ceph-mon[92072]: pgmap v21461: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:08:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:15 smithi057 ceph-mon[92072]: osdmap e1415: 12 total, 12 up, 12 in 2023-03-02T22:08:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:15 smithi122 ceph-mon[125440]: pgmap v21461: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:08:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:15 smithi122 ceph-mon[125440]: osdmap e1415: 12 total, 12 up, 12 in 2023-03-02T22:08:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:15 smithi136 ceph-mon[125702]: pgmap v21461: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:08:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:15 smithi136 ceph-mon[125702]: osdmap e1415: 12 total, 12 up, 12 in 2023-03-02T22:08:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:17 smithi057 ceph-mon[92072]: pgmap v21463: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:08:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:17 smithi122 ceph-mon[125440]: pgmap v21463: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:08:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:17 smithi136 ceph-mon[125702]: pgmap v21463: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:08:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:19.843+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:08:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:19.843+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:08:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:19.843+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:08:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:19.843+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:08:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:19.843+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:08:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:19 smithi057 ceph-mon[92072]: pgmap v21464: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:08:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:19 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:08:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:20.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:19 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:19 smithi122 ceph-mon[125440]: pgmap v21464: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:08:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:19 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:08:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:19 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:19 smithi136 ceph-mon[125702]: pgmap v21464: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:08:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:19 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:08:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:20.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:19 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:21.188 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:21.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:21.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:08:21.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:20 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:08:21.189 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:20 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:21.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:08:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:20 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:08:21.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:20 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:21.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:21.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:08:21.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:20 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:08:21.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:20 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:08:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:21 smithi122 ceph-mon[125440]: pgmap v21465: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:08:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:21 smithi136 ceph-mon[125702]: pgmap v21465: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:08:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:21 smithi057 ceph-mon[92072]: pgmap v21465: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:08:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:23 smithi136 ceph-mon[125702]: pgmap v21466: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:08:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:23 smithi057 ceph-mon[92072]: pgmap v21466: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:08:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:23 smithi122 ceph-mon[125440]: pgmap v21466: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:08:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:25 smithi136 ceph-mon[125702]: pgmap v21467: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:08:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:25 smithi057 ceph-mon[92072]: pgmap v21467: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:08:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:25 smithi122 ceph-mon[125440]: pgmap v21467: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:08:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:27 smithi136 ceph-mon[125702]: pgmap v21468: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:08:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:27 smithi057 ceph-mon[92072]: pgmap v21468: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:08:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:27 smithi122 ceph-mon[125440]: pgmap v21468: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:08:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:29 smithi136 ceph-mon[125702]: pgmap v21469: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:29 smithi057 ceph-mon[92072]: pgmap v21469: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:29 smithi122 ceph-mon[125440]: pgmap v21469: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:31 smithi136 ceph-mon[125702]: pgmap v21470: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:31 smithi057 ceph-mon[92072]: pgmap v21470: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:31 smithi122 ceph-mon[125440]: pgmap v21470: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:33 smithi136 ceph-mon[125702]: pgmap v21471: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:33 smithi057 ceph-mon[92072]: pgmap v21471: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:33 smithi122 ceph-mon[125440]: pgmap v21471: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:34.858+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:08:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:34.859+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:08:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:34.859+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:08:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:34.859+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:08:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:34.859+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:08:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:36 smithi136 ceph-mon[125702]: pgmap v21472: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:35 smithi057 ceph-mon[92072]: pgmap v21472: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:36 smithi122 ceph-mon[125440]: pgmap v21472: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:38 smithi136 ceph-mon[125702]: pgmap v21473: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:38 smithi057 ceph-mon[92072]: pgmap v21473: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:38 smithi122 ceph-mon[125440]: pgmap v21473: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:40 smithi136 ceph-mon[125702]: pgmap v21474: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:40 smithi057 ceph-mon[92072]: pgmap v21474: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:40 smithi122 ceph-mon[125440]: pgmap v21474: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:42 smithi136 ceph-mon[125702]: pgmap v21475: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:42 smithi057 ceph-mon[92072]: pgmap v21475: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:42 smithi122 ceph-mon[125440]: pgmap v21475: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:44 smithi136 ceph-mon[125702]: pgmap v21476: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:44 smithi057 ceph-mon[92072]: pgmap v21476: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:44 smithi122 ceph-mon[125440]: pgmap v21476: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:46 smithi136 ceph-mon[125702]: pgmap v21477: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:46 smithi057 ceph-mon[92072]: pgmap v21477: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:46 smithi122 ceph-mon[125440]: pgmap v21477: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:48 smithi136 ceph-mon[125702]: pgmap v21478: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:48 smithi057 ceph-mon[92072]: pgmap v21478: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:48 smithi122 ceph-mon[125440]: pgmap v21478: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:49.866+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:08:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:49.867+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:08:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:49.867+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:08:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:49.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:08:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:08:49.867+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:08:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:50 smithi136 ceph-mon[125702]: pgmap v21479: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:50 smithi057 ceph-mon[92072]: pgmap v21479: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:50 smithi122 ceph-mon[125440]: pgmap v21479: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:52 smithi136 ceph-mon[125702]: pgmap v21480: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:52 smithi057 ceph-mon[92072]: pgmap v21480: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:52 smithi122 ceph-mon[125440]: pgmap v21480: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:54 smithi136 ceph-mon[125702]: pgmap v21481: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:54 smithi057 ceph-mon[92072]: pgmap v21481: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:54 smithi122 ceph-mon[125440]: pgmap v21481: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:08:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:56 smithi136 ceph-mon[125702]: pgmap v21482: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:56 smithi057 ceph-mon[92072]: pgmap v21482: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:56 smithi122 ceph-mon[125440]: pgmap v21482: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:08:58 smithi136 ceph-mon[125702]: pgmap v21483: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:08:58 smithi057 ceph-mon[92072]: pgmap v21483: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:08:58.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:08:58 smithi122 ceph-mon[125440]: pgmap v21483: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:00 smithi136 ceph-mon[125702]: pgmap v21484: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:00 smithi057 ceph-mon[92072]: pgmap v21484: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:00 smithi122 ceph-mon[125440]: pgmap v21484: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:02 smithi136 ceph-mon[125702]: pgmap v21485: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:02 smithi057 ceph-mon[92072]: pgmap v21485: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:02 smithi122 ceph-mon[125440]: pgmap v21485: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:04 smithi136 ceph-mon[125702]: pgmap v21486: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:09:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:04 smithi057 ceph-mon[92072]: pgmap v21486: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:09:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:04 smithi122 ceph-mon[125440]: pgmap v21486: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:09:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:04.879+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:09:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:04.879+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:09:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:04.879+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:09:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:04.879+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:09:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:04.879+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:09:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:06 smithi057 ceph-mon[92072]: pgmap v21487: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:09:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:06 smithi122 ceph-mon[125440]: pgmap v21487: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:09:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:06 smithi136 ceph-mon[125702]: pgmap v21487: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:09:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:08 smithi057 ceph-mon[92072]: pgmap v21488: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:09:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:08 smithi057 ceph-mon[92072]: osdmap e1416: 12 total, 12 up, 12 in 2023-03-02T22:09:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:08 smithi122 ceph-mon[125440]: pgmap v21488: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:09:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:08 smithi122 ceph-mon[125440]: osdmap e1416: 12 total, 12 up, 12 in 2023-03-02T22:09:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:08 smithi136 ceph-mon[125702]: pgmap v21488: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:09:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:08 smithi136 ceph-mon[125702]: osdmap e1416: 12 total, 12 up, 12 in 2023-03-02T22:09:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:10 smithi057 ceph-mon[92072]: pgmap v21490: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:09:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:10 smithi122 ceph-mon[125440]: pgmap v21490: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:09:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:10 smithi136 ceph-mon[125702]: pgmap v21490: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:09:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:12 smithi057 ceph-mon[92072]: pgmap v21491: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:09:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:12 smithi122 ceph-mon[125440]: pgmap v21491: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:09:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:12 smithi136 ceph-mon[125702]: pgmap v21491: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:09:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:14 smithi057 ceph-mon[92072]: pgmap v21492: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:09:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:14 smithi122 ceph-mon[125440]: pgmap v21492: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:09:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:14 smithi136 ceph-mon[125702]: pgmap v21492: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:09:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:16 smithi057 ceph-mon[92072]: pgmap v21493: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:09:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:16 smithi057 ceph-mon[92072]: osdmap e1417: 12 total, 12 up, 12 in 2023-03-02T22:09:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:16 smithi122 ceph-mon[125440]: pgmap v21493: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:09:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:16 smithi122 ceph-mon[125440]: osdmap e1417: 12 total, 12 up, 12 in 2023-03-02T22:09:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:16 smithi136 ceph-mon[125702]: pgmap v21493: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:09:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:16 smithi136 ceph-mon[125702]: osdmap e1417: 12 total, 12 up, 12 in 2023-03-02T22:09:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:18 smithi057 ceph-mon[92072]: pgmap v21495: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T22:09:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:18 smithi122 ceph-mon[125440]: pgmap v21495: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T22:09:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:18 smithi136 ceph-mon[125702]: pgmap v21495: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 111 B/s wr, 5 op/s 2023-03-02T22:09:19.887 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:19.886+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:09:19.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:19.886+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:09:19.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:19.886+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:09:19.888 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:19.886+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:09:19.889 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:19.886+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:09:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:20 smithi057 ceph-mon[92072]: pgmap v21496: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:09:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:20 smithi122 ceph-mon[125440]: pgmap v21496: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:09:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:20 smithi136 ceph-mon[125702]: pgmap v21496: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:09:22.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:21 smithi136 ceph-mon[125702]: pgmap v21497: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:09:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:09:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:09:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:09:22.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:21 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:09:22.186 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:21 smithi057 ceph-mon[92072]: pgmap v21497: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:09:22.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:09:22.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:09:22.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:09:22.187 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:21 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:09:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:21 smithi122 ceph-mon[125440]: pgmap v21497: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:09:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:09:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:09:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:09:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:21 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:09:24.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:23 smithi136 ceph-mon[125702]: pgmap v21498: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:09:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:23 smithi057 ceph-mon[92072]: pgmap v21498: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:09:24.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:23 smithi122 ceph-mon[125440]: pgmap v21498: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:09:26.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:25 smithi136 ceph-mon[125702]: pgmap v21499: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:09:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:25 smithi057 ceph-mon[92072]: pgmap v21499: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:09:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:25 smithi122 ceph-mon[125440]: pgmap v21499: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:09:28.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:27 smithi136 ceph-mon[125702]: pgmap v21500: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:09:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:27 smithi057 ceph-mon[92072]: pgmap v21500: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:09:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:27 smithi122 ceph-mon[125440]: pgmap v21500: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:09:30.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:29 smithi136 ceph-mon[125702]: pgmap v21501: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:29 smithi057 ceph-mon[92072]: pgmap v21501: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:29 smithi122 ceph-mon[125440]: pgmap v21501: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:31 smithi136 ceph-mon[125702]: pgmap v21502: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:31 smithi057 ceph-mon[92072]: pgmap v21502: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:31 smithi122 ceph-mon[125440]: pgmap v21502: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:33 smithi136 ceph-mon[125702]: pgmap v21503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:33 smithi057 ceph-mon[92072]: pgmap v21503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:33 smithi122 ceph-mon[125440]: pgmap v21503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:34.894+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:09:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:34.895+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:09:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:34.895+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:09:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:34.895+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:09:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:34.895+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:09:36.091 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:35 smithi136 ceph-mon[125702]: pgmap v21504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:35 smithi057 ceph-mon[92072]: pgmap v21504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:35 smithi122 ceph-mon[125440]: pgmap v21504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:37 smithi136 ceph-mon[125702]: pgmap v21505: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:37 smithi057 ceph-mon[92072]: pgmap v21505: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:37 smithi122 ceph-mon[125440]: pgmap v21505: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:39 smithi136 ceph-mon[125702]: pgmap v21506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:39 smithi057 ceph-mon[92072]: pgmap v21506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:39 smithi122 ceph-mon[125440]: pgmap v21506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:41 smithi136 ceph-mon[125702]: pgmap v21507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:41 smithi057 ceph-mon[92072]: pgmap v21507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:41 smithi122 ceph-mon[125440]: pgmap v21507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:43 smithi136 ceph-mon[125702]: pgmap v21508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:43 smithi057 ceph-mon[92072]: pgmap v21508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:43 smithi122 ceph-mon[125440]: pgmap v21508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:45 smithi136 ceph-mon[125702]: pgmap v21509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:45 smithi057 ceph-mon[92072]: pgmap v21509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:45 smithi122 ceph-mon[125440]: pgmap v21509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:47 smithi136 ceph-mon[125702]: pgmap v21510: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:47 smithi057 ceph-mon[92072]: pgmap v21510: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:47 smithi122 ceph-mon[125440]: pgmap v21510: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:49.907+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:09:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:49.907+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:09:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:49.907+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:09:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:49.907+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:09:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:09:49.908+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:09:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:49 smithi057 ceph-mon[92072]: pgmap v21511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:49 smithi122 ceph-mon[125440]: pgmap v21511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:49 smithi136 ceph-mon[125702]: pgmap v21511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:51 smithi057 ceph-mon[92072]: pgmap v21512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:51 smithi122 ceph-mon[125440]: pgmap v21512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:51 smithi136 ceph-mon[125702]: pgmap v21512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:53 smithi057 ceph-mon[92072]: pgmap v21513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:53 smithi122 ceph-mon[125440]: pgmap v21513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:53 smithi136 ceph-mon[125702]: pgmap v21513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:09:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:55 smithi057 ceph-mon[92072]: pgmap v21514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:55 smithi122 ceph-mon[125440]: pgmap v21514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:55 smithi136 ceph-mon[125702]: pgmap v21514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:57 smithi057 ceph-mon[92072]: pgmap v21515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:57 smithi122 ceph-mon[125440]: pgmap v21515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:09:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:57 smithi136 ceph-mon[125702]: pgmap v21515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:09:59 smithi057 ceph-mon[92072]: pgmap v21516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:09:59 smithi122 ceph-mon[125440]: pgmap v21516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:09:59 smithi136 ceph-mon[125702]: pgmap v21516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:01.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T22:10:01.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T22:10:01.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T22:10:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:01 smithi057 ceph-mon[92072]: pgmap v21517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:01 smithi122 ceph-mon[125440]: pgmap v21517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:01 smithi136 ceph-mon[125702]: pgmap v21517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:03 smithi057 ceph-mon[92072]: pgmap v21518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:10:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:03 smithi122 ceph-mon[125440]: pgmap v21518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:10:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:03 smithi136 ceph-mon[125702]: pgmap v21518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:10:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:04.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:10:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:04.920+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:10:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:04.920+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:10:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:04.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:10:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:04.920+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:10:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:05 smithi057 ceph-mon[92072]: pgmap v21519: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:10:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:05 smithi122 ceph-mon[125440]: pgmap v21519: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:10:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:05 smithi136 ceph-mon[125702]: pgmap v21519: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:10:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:07 smithi057 ceph-mon[92072]: pgmap v21520: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:10:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:07 smithi057 ceph-mon[92072]: osdmap e1418: 12 total, 12 up, 12 in 2023-03-02T22:10:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:07 smithi122 ceph-mon[125440]: pgmap v21520: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:10:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:07 smithi122 ceph-mon[125440]: osdmap e1418: 12 total, 12 up, 12 in 2023-03-02T22:10:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:07 smithi136 ceph-mon[125702]: pgmap v21520: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:10:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:07 smithi136 ceph-mon[125702]: osdmap e1418: 12 total, 12 up, 12 in 2023-03-02T22:10:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:09 smithi057 ceph-mon[92072]: pgmap v21522: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:10:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:09 smithi122 ceph-mon[125440]: pgmap v21522: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:10:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:09 smithi136 ceph-mon[125702]: pgmap v21522: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:10:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:11 smithi057 ceph-mon[92072]: pgmap v21523: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:10:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:11 smithi122 ceph-mon[125440]: pgmap v21523: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:10:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:11 smithi136 ceph-mon[125702]: pgmap v21523: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:10:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:13 smithi057 ceph-mon[92072]: pgmap v21524: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:10:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:13 smithi122 ceph-mon[125440]: pgmap v21524: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:10:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:13 smithi136 ceph-mon[125702]: pgmap v21524: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:10:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:15 smithi057 ceph-mon[92072]: pgmap v21525: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:10:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:15 smithi057 ceph-mon[92072]: osdmap e1419: 12 total, 12 up, 12 in 2023-03-02T22:10:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:15 smithi122 ceph-mon[125440]: pgmap v21525: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:10:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:15 smithi122 ceph-mon[125440]: osdmap e1419: 12 total, 12 up, 12 in 2023-03-02T22:10:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:15 smithi136 ceph-mon[125702]: pgmap v21525: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:10:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:15 smithi136 ceph-mon[125702]: osdmap e1419: 12 total, 12 up, 12 in 2023-03-02T22:10:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:17 smithi057 ceph-mon[92072]: pgmap v21527: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:10:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:17 smithi122 ceph-mon[125440]: pgmap v21527: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:10:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:17 smithi136 ceph-mon[125702]: pgmap v21527: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:10:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:19.936+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:10:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:19.936+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:10:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:19.936+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:10:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:19.936+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:10:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:19.936+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:10:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:19 smithi057 ceph-mon[92072]: pgmap v21528: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:10:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:19 smithi122 ceph-mon[125440]: pgmap v21528: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:10:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:19 smithi136 ceph-mon[125702]: pgmap v21528: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:10:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:21 smithi057 ceph-mon[92072]: pgmap v21529: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:10:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:21 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:10:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:21 smithi122 ceph-mon[125440]: pgmap v21529: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:10:22.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:21 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:10:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:21 smithi136 ceph-mon[125702]: pgmap v21529: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:10:22.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:21 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:10:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:10:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:22 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:10:23.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:22 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:10:23.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:10:23.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:22 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:10:23.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:22 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:10:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:10:23.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:22 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:10:23.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:22 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:10:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:23 smithi057 ceph-mon[92072]: pgmap v21530: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:10:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:23 smithi122 ceph-mon[125440]: pgmap v21530: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:10:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:23 smithi136 ceph-mon[125702]: pgmap v21530: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:10:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:25 smithi057 ceph-mon[92072]: pgmap v21531: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:10:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:25 smithi122 ceph-mon[125440]: pgmap v21531: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:10:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:25 smithi136 ceph-mon[125702]: pgmap v21531: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:10:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:27 smithi057 ceph-mon[92072]: pgmap v21532: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:10:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:27 smithi122 ceph-mon[125440]: pgmap v21532: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:10:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:27 smithi136 ceph-mon[125702]: pgmap v21532: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:10:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:29 smithi122 ceph-mon[125440]: pgmap v21533: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:29 smithi136 ceph-mon[125702]: pgmap v21533: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:29 smithi057 ceph-mon[92072]: pgmap v21533: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:31 smithi122 ceph-mon[125440]: pgmap v21534: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:31 smithi136 ceph-mon[125702]: pgmap v21534: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:31 smithi057 ceph-mon[92072]: pgmap v21534: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:34.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:33 smithi122 ceph-mon[125440]: pgmap v21535: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:33 smithi136 ceph-mon[125702]: pgmap v21535: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:33 smithi057 ceph-mon[92072]: pgmap v21535: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:34.950+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:10:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:34.950+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:10:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:34.950+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:10:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:34.950+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:10:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:34.950+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:10:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:35 smithi122 ceph-mon[125440]: pgmap v21536: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:35 smithi136 ceph-mon[125702]: pgmap v21536: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:35 smithi057 ceph-mon[92072]: pgmap v21536: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:37 smithi136 ceph-mon[125702]: pgmap v21537: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:37 smithi057 ceph-mon[92072]: pgmap v21537: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:37 smithi122 ceph-mon[125440]: pgmap v21537: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:39 smithi136 ceph-mon[125702]: pgmap v21538: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:39 smithi057 ceph-mon[92072]: pgmap v21538: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:39 smithi122 ceph-mon[125440]: pgmap v21538: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:41 smithi136 ceph-mon[125702]: pgmap v21539: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:41 smithi057 ceph-mon[92072]: pgmap v21539: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:41 smithi122 ceph-mon[125440]: pgmap v21539: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:43 smithi136 ceph-mon[125702]: pgmap v21540: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:43 smithi057 ceph-mon[92072]: pgmap v21540: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:43 smithi122 ceph-mon[125440]: pgmap v21540: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:45 smithi136 ceph-mon[125702]: pgmap v21541: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:45 smithi057 ceph-mon[92072]: pgmap v21541: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:45 smithi122 ceph-mon[125440]: pgmap v21541: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:47 smithi136 ceph-mon[125702]: pgmap v21542: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:47 smithi057 ceph-mon[92072]: pgmap v21542: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:47 smithi122 ceph-mon[125440]: pgmap v21542: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:10:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:49.965+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:10:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:49.966+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:10:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:49.966+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:10:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:49.966+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:10:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:10:49.966+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:10:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:49 smithi136 ceph-mon[125702]: pgmap v21543: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:49 smithi057 ceph-mon[92072]: pgmap v21543: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:49 smithi122 ceph-mon[125440]: pgmap v21543: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:51 smithi136 ceph-mon[125702]: pgmap v21544: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:10:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:51 smithi057 ceph-mon[92072]: pgmap v21544: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:10:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:51 smithi122 ceph-mon[125440]: pgmap v21544: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:10:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:54 smithi136 ceph-mon[125702]: pgmap v21545: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:54 smithi057 ceph-mon[92072]: pgmap v21545: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:54.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:54 smithi122 ceph-mon[125440]: pgmap v21545: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:10:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:56 smithi136 ceph-mon[125702]: pgmap v21546: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:10:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:56 smithi057 ceph-mon[92072]: pgmap v21546: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:10:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:56 smithi122 ceph-mon[125440]: pgmap v21546: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:10:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:10:58 smithi136 ceph-mon[125702]: pgmap v21547: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:10:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:10:58 smithi057 ceph-mon[92072]: pgmap v21547: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:10:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:10:58 smithi122 ceph-mon[125440]: pgmap v21547: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:11:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:00 smithi136 ceph-mon[125702]: pgmap v21548: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:00 smithi057 ceph-mon[92072]: pgmap v21548: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:00 smithi122 ceph-mon[125440]: pgmap v21548: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:02 smithi136 ceph-mon[125702]: pgmap v21549: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:02 smithi057 ceph-mon[92072]: pgmap v21549: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:02 smithi122 ceph-mon[125440]: pgmap v21549: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:04 smithi136 ceph-mon[125702]: pgmap v21550: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:11:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:04 smithi057 ceph-mon[92072]: pgmap v21550: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:11:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:04 smithi122 ceph-mon[125440]: pgmap v21550: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:11:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:04.975+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:11:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:04.976+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:11:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:04.976+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:11:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:04.976+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:11:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:04.976+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:11:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:06 smithi136 ceph-mon[125702]: pgmap v21551: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:11:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:06 smithi057 ceph-mon[92072]: pgmap v21551: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:11:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:06 smithi122 ceph-mon[125440]: pgmap v21551: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:11:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:08 smithi136 ceph-mon[125702]: pgmap v21552: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:11:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:08 smithi136 ceph-mon[125702]: osdmap e1420: 12 total, 12 up, 12 in 2023-03-02T22:11:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:08 smithi057 ceph-mon[92072]: pgmap v21552: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:11:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:08 smithi057 ceph-mon[92072]: osdmap e1420: 12 total, 12 up, 12 in 2023-03-02T22:11:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:08 smithi122 ceph-mon[125440]: pgmap v21552: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:11:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:08 smithi122 ceph-mon[125440]: osdmap e1420: 12 total, 12 up, 12 in 2023-03-02T22:11:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:10 smithi136 ceph-mon[125702]: pgmap v21554: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:11:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:10 smithi057 ceph-mon[92072]: pgmap v21554: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:11:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:10 smithi122 ceph-mon[125440]: pgmap v21554: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:11:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:12 smithi136 ceph-mon[125702]: pgmap v21555: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:11:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:12 smithi057 ceph-mon[92072]: pgmap v21555: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:11:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:12 smithi122 ceph-mon[125440]: pgmap v21555: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:11:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:14.207+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:11:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:14.207+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:11:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:14.207+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 310 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:11:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:14.207+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 311 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:11:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:14 smithi136 ceph-mon[125702]: pgmap v21556: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:11:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:14 smithi057 ceph-mon[92072]: pgmap v21556: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:11:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:14 smithi122 ceph-mon[125440]: pgmap v21556: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:11:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:16 smithi136 ceph-mon[125702]: pgmap v21557: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:11:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:16 smithi136 ceph-mon[125702]: osdmap e1421: 12 total, 12 up, 12 in 2023-03-02T22:11:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:16 smithi057 ceph-mon[92072]: pgmap v21557: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:11:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:16 smithi057 ceph-mon[92072]: osdmap e1421: 12 total, 12 up, 12 in 2023-03-02T22:11:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:16 smithi122 ceph-mon[125440]: pgmap v21557: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:11:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:16 smithi122 ceph-mon[125440]: osdmap e1421: 12 total, 12 up, 12 in 2023-03-02T22:11:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:18 smithi136 ceph-mon[125702]: pgmap v21559: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T22:11:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:18 smithi057 ceph-mon[92072]: pgmap v21559: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T22:11:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:18 smithi122 ceph-mon[125440]: pgmap v21559: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T22:11:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:19.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:11:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:19.982+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:11:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:19.982+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:11:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:19.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:11:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:19.982+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:11:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:20 smithi136 ceph-mon[125702]: pgmap v21560: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:11:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:20 smithi057 ceph-mon[92072]: pgmap v21560: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:11:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:20 smithi122 ceph-mon[125440]: pgmap v21560: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:11:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:22 smithi136 ceph-mon[125702]: pgmap v21561: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:11:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:22 smithi057 ceph-mon[92072]: pgmap v21561: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:11:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:22 smithi122 ceph-mon[125440]: pgmap v21561: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:11:23.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:23 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:11:23.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:23 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:11:23.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:23 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:11:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:24 smithi136 ceph-mon[125702]: pgmap v21562: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:11:24.343 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:24 smithi057 ceph-mon[92072]: pgmap v21562: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:11:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:24 smithi122 ceph-mon[125440]: pgmap v21562: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:11:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:26 smithi057 ceph-mon[92072]: pgmap v21563: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:11:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:26 smithi136 ceph-mon[125702]: pgmap v21563: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:11:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:26 smithi122 ceph-mon[125440]: pgmap v21563: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:11:27.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:27 smithi057 ceph-mon[92072]: pgmap v21564: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:11:27.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:11:27.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:11:27.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:11:27.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:27 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:11:27.688 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:27 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:11:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:27 smithi122 ceph-mon[125440]: pgmap v21564: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:11:27.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:11:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:11:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:11:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:27 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:11:27.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:27 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:11:27.861 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:27 smithi136 ceph-mon[125702]: pgmap v21564: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:11:27.861 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:11:27.861 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:11:27.861 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:11:27.862 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:27 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:11:27.862 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:27 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:11:29.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:29 smithi057 ceph-mon[92072]: pgmap v21565: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:29.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:29 smithi122 ceph-mon[125440]: pgmap v21565: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:29.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:29 smithi136 ceph-mon[125702]: pgmap v21565: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:32.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:31 smithi136 ceph-mon[125702]: pgmap v21566: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:31 smithi057 ceph-mon[92072]: pgmap v21566: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:31 smithi122 ceph-mon[125440]: pgmap v21566: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:34.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:33 smithi136 ceph-mon[125702]: pgmap v21567: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:34.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:33 smithi057 ceph-mon[92072]: pgmap v21567: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:34.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:33 smithi122 ceph-mon[125440]: pgmap v21567: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:34.998 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:34.996+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:11:34.998 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:34.997+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:11:34.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:34.997+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:11:34.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:34.997+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:11:34.999 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:34.997+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:11:36.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:35 smithi136 ceph-mon[125702]: pgmap v21568: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:11:36.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:35 smithi057 ceph-mon[92072]: pgmap v21568: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:11:36.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:35 smithi122 ceph-mon[125440]: pgmap v21568: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:11:38.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:37 smithi136 ceph-mon[125702]: pgmap v21569: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:11:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:37 smithi057 ceph-mon[92072]: pgmap v21569: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:11:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:37 smithi122 ceph-mon[125440]: pgmap v21569: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:11:40.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:39 smithi136 ceph-mon[125702]: pgmap v21570: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:39 smithi057 ceph-mon[92072]: pgmap v21570: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:39 smithi122 ceph-mon[125440]: pgmap v21570: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:42.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:41 smithi136 ceph-mon[125702]: pgmap v21571: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:11:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:41 smithi057 ceph-mon[92072]: pgmap v21571: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:11:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:41 smithi122 ceph-mon[125440]: pgmap v21571: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-02T22:11:44.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:43 smithi136 ceph-mon[125702]: pgmap v21572: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:43 smithi057 ceph-mon[92072]: pgmap v21572: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:43 smithi122 ceph-mon[125440]: pgmap v21572: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:46.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:45 smithi136 ceph-mon[125702]: pgmap v21573: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:45 smithi057 ceph-mon[92072]: pgmap v21573: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:45 smithi122 ceph-mon[125440]: pgmap v21573: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:48.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:47 smithi136 ceph-mon[125702]: pgmap v21574: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:47 smithi057 ceph-mon[92072]: pgmap v21574: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:47 smithi122 ceph-mon[125440]: pgmap v21574: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:50.012+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:11:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:50.013+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:11:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:50.013+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:11:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:50.013+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:11:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:11:50.013+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:11:50.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:49 smithi136 ceph-mon[125702]: pgmap v21575: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:49 smithi057 ceph-mon[92072]: pgmap v21575: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:49 smithi122 ceph-mon[125440]: pgmap v21575: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:52.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:51 smithi136 ceph-mon[125702]: pgmap v21576: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:51 smithi057 ceph-mon[92072]: pgmap v21576: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:51 smithi122 ceph-mon[125440]: pgmap v21576: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:54.090 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:53 smithi136 ceph-mon[125702]: pgmap v21577: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:53 smithi057 ceph-mon[92072]: pgmap v21577: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:53 smithi122 ceph-mon[125440]: pgmap v21577: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:11:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:55 smithi057 ceph-mon[92072]: pgmap v21578: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:55 smithi122 ceph-mon[125440]: pgmap v21578: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:55 smithi136 ceph-mon[125702]: pgmap v21578: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:57 smithi057 ceph-mon[92072]: pgmap v21579: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:57 smithi122 ceph-mon[125440]: pgmap v21579: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:11:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:57 smithi136 ceph-mon[125702]: pgmap v21579: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:11:59 smithi057 ceph-mon[92072]: pgmap v21580: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:11:59 smithi122 ceph-mon[125440]: pgmap v21580: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:11:59 smithi136 ceph-mon[125702]: pgmap v21580: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:01 smithi057 ceph-mon[92072]: pgmap v21581: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:01 smithi122 ceph-mon[125440]: pgmap v21581: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:01 smithi136 ceph-mon[125702]: pgmap v21581: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:03 smithi057 ceph-mon[92072]: pgmap v21582: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:12:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:03 smithi122 ceph-mon[125440]: pgmap v21582: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:12:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:03 smithi136 ceph-mon[125702]: pgmap v21582: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:12:05.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:05.028+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:12:05.030 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:05.029+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:12:05.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:05.029+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:12:05.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:05.029+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:12:05.031 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:05.029+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:12:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:05 smithi057 ceph-mon[92072]: pgmap v21583: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:12:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:05 smithi122 ceph-mon[125440]: pgmap v21583: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:12:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:05 smithi136 ceph-mon[125702]: pgmap v21583: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:12:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:07 smithi057 ceph-mon[92072]: pgmap v21584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:12:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:07 smithi057 ceph-mon[92072]: osdmap e1422: 12 total, 12 up, 12 in 2023-03-02T22:12:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:07 smithi122 ceph-mon[125440]: pgmap v21584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:12:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:07 smithi122 ceph-mon[125440]: osdmap e1422: 12 total, 12 up, 12 in 2023-03-02T22:12:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:07 smithi136 ceph-mon[125702]: pgmap v21584: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:12:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:07 smithi136 ceph-mon[125702]: osdmap e1422: 12 total, 12 up, 12 in 2023-03-02T22:12:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:09 smithi057 ceph-mon[92072]: pgmap v21586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:12:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:09 smithi122 ceph-mon[125440]: pgmap v21586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:12:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:09 smithi136 ceph-mon[125702]: pgmap v21586: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:12:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:11 smithi057 ceph-mon[92072]: pgmap v21587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:12:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:11 smithi122 ceph-mon[125440]: pgmap v21587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:12:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:11 smithi136 ceph-mon[125702]: pgmap v21587: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:12:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:13 smithi057 ceph-mon[92072]: pgmap v21588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:12:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:13 smithi122 ceph-mon[125440]: pgmap v21588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:12:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:13 smithi136 ceph-mon[125702]: pgmap v21588: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:12:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:15 smithi057 ceph-mon[92072]: pgmap v21589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:12:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:15 smithi057 ceph-mon[92072]: osdmap e1423: 12 total, 12 up, 12 in 2023-03-02T22:12:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:15 smithi122 ceph-mon[125440]: pgmap v21589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:12:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:15 smithi122 ceph-mon[125440]: osdmap e1423: 12 total, 12 up, 12 in 2023-03-02T22:12:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:15 smithi136 ceph-mon[125702]: pgmap v21589: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:12:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:15 smithi136 ceph-mon[125702]: osdmap e1423: 12 total, 12 up, 12 in 2023-03-02T22:12:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:17 smithi057 ceph-mon[92072]: pgmap v21591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:12:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:17 smithi122 ceph-mon[125440]: pgmap v21591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:12:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:17 smithi136 ceph-mon[125702]: pgmap v21591: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:12:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:20.042+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:12:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:20.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:12:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:20.043+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:12:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:20.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:12:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:20.043+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:12:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:19 smithi057 ceph-mon[92072]: pgmap v21592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:12:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:19 smithi122 ceph-mon[125440]: pgmap v21592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:12:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:19 smithi136 ceph-mon[125702]: pgmap v21592: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:12:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:21 smithi057 ceph-mon[92072]: pgmap v21593: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:12:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:21 smithi122 ceph-mon[125440]: pgmap v21593: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:12:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:21 smithi136 ceph-mon[125702]: pgmap v21593: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:12:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:23 smithi057 ceph-mon[92072]: pgmap v21594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:12:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:23 smithi122 ceph-mon[125440]: pgmap v21594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:12:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:23 smithi136 ceph-mon[125702]: pgmap v21594: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:12:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:25 smithi057 ceph-mon[92072]: pgmap v21595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:12:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:25 smithi122 ceph-mon[125440]: pgmap v21595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:12:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:25 smithi136 ceph-mon[125702]: pgmap v21595: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:12:27.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:26 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:12:27.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:26 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:12:27.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:26 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:12:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:27 smithi057 ceph-mon[92072]: pgmap v21596: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:12:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:27 smithi122 ceph-mon[125440]: pgmap v21596: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:12:28.338 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:27 smithi136 ceph-mon[125702]: pgmap v21596: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:12:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:29 smithi057 ceph-mon[92072]: pgmap v21597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:12:30.196 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:29 smithi136 ceph-mon[125702]: pgmap v21597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:12:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:29 smithi122 ceph-mon[125440]: pgmap v21597: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:12:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:12:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:12:31.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:12:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:12:31.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:12:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:12:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:12:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:32 smithi136 ceph-mon[125702]: pgmap v21598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:32.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:32 smithi057 ceph-mon[92072]: pgmap v21598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:32 smithi122 ceph-mon[125440]: pgmap v21598: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:34 smithi136 ceph-mon[125702]: pgmap v21599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:34 smithi057 ceph-mon[92072]: pgmap v21599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:34 smithi122 ceph-mon[125440]: pgmap v21599: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:35.059+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:12:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:35.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:12:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:35.060+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:12:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:35.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:12:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:35.060+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:12:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:36 smithi136 ceph-mon[125702]: pgmap v21600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:36 smithi057 ceph-mon[92072]: pgmap v21600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:36 smithi122 ceph-mon[125440]: pgmap v21600: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:38 smithi136 ceph-mon[125702]: pgmap v21601: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:38 smithi057 ceph-mon[92072]: pgmap v21601: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:38 smithi122 ceph-mon[125440]: pgmap v21601: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:40 smithi136 ceph-mon[125702]: pgmap v21602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:40 smithi057 ceph-mon[92072]: pgmap v21602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:40 smithi122 ceph-mon[125440]: pgmap v21602: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:42 smithi136 ceph-mon[125702]: pgmap v21603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:42 smithi057 ceph-mon[92072]: pgmap v21603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:42 smithi122 ceph-mon[125440]: pgmap v21603: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:44 smithi136 ceph-mon[125702]: pgmap v21604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:44 smithi057 ceph-mon[92072]: pgmap v21604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:44 smithi122 ceph-mon[125440]: pgmap v21604: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:46 smithi136 ceph-mon[125702]: pgmap v21605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:46 smithi057 ceph-mon[92072]: pgmap v21605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:46 smithi122 ceph-mon[125440]: pgmap v21605: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:48 smithi136 ceph-mon[125702]: pgmap v21606: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:48 smithi057 ceph-mon[92072]: pgmap v21606: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:48 smithi122 ceph-mon[125440]: pgmap v21606: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:50.061+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:12:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:50.062+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:12:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:50.062+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:12:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:50.062+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:12:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:12:50.062+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:12:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:50 smithi136 ceph-mon[125702]: pgmap v21607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:50 smithi057 ceph-mon[92072]: pgmap v21607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:50 smithi122 ceph-mon[125440]: pgmap v21607: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:52 smithi136 ceph-mon[125702]: pgmap v21608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:52 smithi057 ceph-mon[92072]: pgmap v21608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:52 smithi122 ceph-mon[125440]: pgmap v21608: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:54 smithi136 ceph-mon[125702]: pgmap v21609: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:54 smithi057 ceph-mon[92072]: pgmap v21609: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:54 smithi122 ceph-mon[125440]: pgmap v21609: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:12:56.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:56 smithi057 ceph-mon[92072]: pgmap v21610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:56 smithi122 ceph-mon[125440]: pgmap v21610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:56.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:56 smithi136 ceph-mon[125702]: pgmap v21610: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:12:58 smithi057 ceph-mon[92072]: pgmap v21611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:12:58 smithi122 ceph-mon[125440]: pgmap v21611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:12:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:12:58 smithi136 ceph-mon[125702]: pgmap v21611: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:00 smithi057 ceph-mon[92072]: pgmap v21612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:00 smithi122 ceph-mon[125440]: pgmap v21612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:00 smithi136 ceph-mon[125702]: pgmap v21612: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:02 smithi057 ceph-mon[92072]: pgmap v21613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:02 smithi122 ceph-mon[125440]: pgmap v21613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:02 smithi136 ceph-mon[125702]: pgmap v21613: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:04.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:04 smithi057 ceph-mon[92072]: pgmap v21614: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:13:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:04 smithi122 ceph-mon[125440]: pgmap v21614: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:13:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:04 smithi136 ceph-mon[125702]: pgmap v21614: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:13:05.078 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:05.077+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:13:05.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:05.078+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:13:05.079 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:05.078+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:13:05.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:05.078+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:13:05.080 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:05.078+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:13:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:06 smithi057 ceph-mon[92072]: pgmap v21615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:13:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:06 smithi122 ceph-mon[125440]: pgmap v21615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:13:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:06 smithi136 ceph-mon[125702]: pgmap v21615: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:13:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:08 smithi057 ceph-mon[92072]: pgmap v21616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:13:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:08 smithi057 ceph-mon[92072]: osdmap e1424: 12 total, 12 up, 12 in 2023-03-02T22:13:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:08 smithi122 ceph-mon[125440]: pgmap v21616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:13:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:08 smithi122 ceph-mon[125440]: osdmap e1424: 12 total, 12 up, 12 in 2023-03-02T22:13:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:08 smithi136 ceph-mon[125702]: pgmap v21616: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:13:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:08 smithi136 ceph-mon[125702]: osdmap e1424: 12 total, 12 up, 12 in 2023-03-02T22:13:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:10 smithi057 ceph-mon[92072]: pgmap v21618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:13:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:10 smithi122 ceph-mon[125440]: pgmap v21618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:13:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:10 smithi136 ceph-mon[125702]: pgmap v21618: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:13:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:12 smithi057 ceph-mon[92072]: pgmap v21619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:13:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:12 smithi122 ceph-mon[125440]: pgmap v21619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:13:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:12 smithi136 ceph-mon[125702]: pgmap v21619: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:13:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:14 smithi057 ceph-mon[92072]: pgmap v21620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:13:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:14 smithi122 ceph-mon[125440]: pgmap v21620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:13:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:14 smithi136 ceph-mon[125702]: pgmap v21620: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:13:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:16 smithi057 ceph-mon[92072]: pgmap v21621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:13:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:16 smithi057 ceph-mon[92072]: osdmap e1425: 12 total, 12 up, 12 in 2023-03-02T22:13:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:16 smithi122 ceph-mon[125440]: pgmap v21621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:13:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:16 smithi122 ceph-mon[125440]: osdmap e1425: 12 total, 12 up, 12 in 2023-03-02T22:13:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:16 smithi136 ceph-mon[125702]: pgmap v21621: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:13:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:16 smithi136 ceph-mon[125702]: osdmap e1425: 12 total, 12 up, 12 in 2023-03-02T22:13:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:18 smithi057 ceph-mon[92072]: pgmap v21623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T22:13:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:18 smithi122 ceph-mon[125440]: pgmap v21623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T22:13:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:18 smithi136 ceph-mon[125702]: pgmap v21623: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-02T22:13:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:20.091+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:13:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:20.091+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:13:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:20.091+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:13:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:20.091+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:13:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:20.091+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:13:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:20 smithi057 ceph-mon[92072]: pgmap v21624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:13:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:20 smithi122 ceph-mon[125440]: pgmap v21624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:13:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:20 smithi136 ceph-mon[125702]: pgmap v21624: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:13:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:22 smithi057 ceph-mon[92072]: pgmap v21625: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:13:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:22 smithi122 ceph-mon[125440]: pgmap v21625: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:13:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:22 smithi136 ceph-mon[125702]: pgmap v21625: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:13:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:24 smithi057 ceph-mon[92072]: pgmap v21626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:13:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:24 smithi122 ceph-mon[125440]: pgmap v21626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:13:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:24 smithi136 ceph-mon[125702]: pgmap v21626: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:13:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:26 smithi057 ceph-mon[92072]: pgmap v21627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:13:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:26 smithi122 ceph-mon[125440]: pgmap v21627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:13:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:26 smithi136 ceph-mon[125702]: pgmap v21627: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:13:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:28 smithi057 ceph-mon[92072]: pgmap v21628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:13:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:28 smithi122 ceph-mon[125440]: pgmap v21628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:13:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:28 smithi136 ceph-mon[125702]: pgmap v21628: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:13:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:30 smithi057 ceph-mon[92072]: pgmap v21629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:13:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:30 smithi122 ceph-mon[125440]: pgmap v21629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:13:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:30 smithi136 ceph-mon[125702]: pgmap v21629: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:13:31.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:13:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:13:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:13:31.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:31 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:13:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:13:31.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:13:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:13:31.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:31 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:13:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:13:31.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:13:31.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:13:31.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:31 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:13:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:32 smithi122 ceph-mon[125440]: pgmap v21630: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:32 smithi136 ceph-mon[125702]: pgmap v21630: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:32 smithi057 ceph-mon[92072]: pgmap v21630: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:34 smithi122 ceph-mon[125440]: pgmap v21631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:34 smithi136 ceph-mon[125702]: pgmap v21631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:34 smithi057 ceph-mon[92072]: pgmap v21631: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:35.109 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:35.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:13:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:35.107+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:13:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:35.107+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:13:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:35.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:13:35.110 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:35.107+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:13:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:36 smithi122 ceph-mon[125440]: pgmap v21632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:36 smithi136 ceph-mon[125702]: pgmap v21632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:36 smithi057 ceph-mon[92072]: pgmap v21632: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:38 smithi122 ceph-mon[125440]: pgmap v21633: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:38 smithi136 ceph-mon[125702]: pgmap v21633: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:38 smithi057 ceph-mon[92072]: pgmap v21633: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:40 smithi136 ceph-mon[125702]: pgmap v21634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:40 smithi057 ceph-mon[92072]: pgmap v21634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:40 smithi122 ceph-mon[125440]: pgmap v21634: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:42 smithi136 ceph-mon[125702]: pgmap v21635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:42 smithi057 ceph-mon[92072]: pgmap v21635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:42 smithi122 ceph-mon[125440]: pgmap v21635: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:44 smithi136 ceph-mon[125702]: pgmap v21636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:44 smithi057 ceph-mon[92072]: pgmap v21636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:44 smithi122 ceph-mon[125440]: pgmap v21636: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:46 smithi136 ceph-mon[125702]: pgmap v21637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:46 smithi057 ceph-mon[92072]: pgmap v21637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:46 smithi122 ceph-mon[125440]: pgmap v21637: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:48 smithi136 ceph-mon[125702]: pgmap v21638: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:48 smithi057 ceph-mon[92072]: pgmap v21638: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:48 smithi122 ceph-mon[125440]: pgmap v21638: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:50.124+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:13:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:50.124+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:13:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:50.124+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:13:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:50.124+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:13:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:13:50.124+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:13:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:50 smithi136 ceph-mon[125702]: pgmap v21639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:50 smithi057 ceph-mon[92072]: pgmap v21639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:50 smithi122 ceph-mon[125440]: pgmap v21639: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:52 smithi136 ceph-mon[125702]: pgmap v21640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:52 smithi057 ceph-mon[92072]: pgmap v21640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:52 smithi122 ceph-mon[125440]: pgmap v21640: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:53.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:53 smithi136 ceph-mon[125702]: pgmap v21641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:53.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:53 smithi057 ceph-mon[92072]: pgmap v21641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:53.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:53 smithi122 ceph-mon[125440]: pgmap v21641: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:13:55.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:55 smithi057 ceph-mon[92072]: pgmap v21642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:55.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:55 smithi122 ceph-mon[125440]: pgmap v21642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:55.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:55 smithi136 ceph-mon[125702]: pgmap v21642: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:57 smithi057 ceph-mon[92072]: pgmap v21643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:57 smithi122 ceph-mon[125440]: pgmap v21643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:13:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:57 smithi136 ceph-mon[125702]: pgmap v21643: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:13:59 smithi057 ceph-mon[92072]: pgmap v21644: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:13:59 smithi122 ceph-mon[125440]: pgmap v21644: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:13:59 smithi136 ceph-mon[125702]: pgmap v21644: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:01 smithi057 ceph-mon[92072]: pgmap v21645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:01 smithi122 ceph-mon[125440]: pgmap v21645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:01 smithi136 ceph-mon[125702]: pgmap v21645: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:03 smithi057 ceph-mon[92072]: pgmap v21646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:14:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:03 smithi122 ceph-mon[125440]: pgmap v21646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:14:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:03 smithi136 ceph-mon[125702]: pgmap v21646: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:14:05.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:05.136+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:14:05.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:05.137+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:14:05.138 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:05.137+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:14:05.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:05.137+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:14:05.139 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:05.137+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:14:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:05 smithi057 ceph-mon[92072]: pgmap v21647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:14:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:05 smithi122 ceph-mon[125440]: pgmap v21647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:14:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:05 smithi136 ceph-mon[125702]: pgmap v21647: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:14:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:07 smithi057 ceph-mon[92072]: pgmap v21648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:14:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:07 smithi057 ceph-mon[92072]: osdmap e1426: 12 total, 12 up, 12 in 2023-03-02T22:14:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:07 smithi122 ceph-mon[125440]: pgmap v21648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:14:08.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:07 smithi122 ceph-mon[125440]: osdmap e1426: 12 total, 12 up, 12 in 2023-03-02T22:14:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:07 smithi136 ceph-mon[125702]: pgmap v21648: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:14:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:07 smithi136 ceph-mon[125702]: osdmap e1426: 12 total, 12 up, 12 in 2023-03-02T22:14:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:08.436+0000 7f5884d9b700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000431) for more than 900000000 us, fault. 2023-03-02T22:14:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:08.436+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f5870019780 tx=0x7f58700b2050 comp rx=0 tx=0).stop 2023-03-02T22:14:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:08.436+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 msgr2=0x7f586809d7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-03-02T22:14:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:08.436+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809d410 0x7f586809d7e0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-02T22:14:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:08.436+0000 7f587dffb700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-02T22:14:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:08.437+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:14:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:08.438+0000 7f5884d9b700 1 --2- 172.21.15.57:0/4000526380 >> [v2:172.21.15.57:6800/1603975717,v1:172.21.15.57:6801/1603975717] conn(0x7f586809c730 0x7f58680a9870 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f5870019800 tx=0x7f5870042000 comp rx=0 tx=0).ready entity=mgr.25273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-02T22:14:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:09 smithi057 ceph-mon[92072]: pgmap v21650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:14:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:09 smithi122 ceph-mon[125440]: pgmap v21650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:14:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:09 smithi136 ceph-mon[125702]: pgmap v21650: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:14:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:11 smithi057 ceph-mon[92072]: pgmap v21651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:14:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:11 smithi122 ceph-mon[125440]: pgmap v21651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:14:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:11 smithi136 ceph-mon[125702]: pgmap v21651: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:14:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:13 smithi057 ceph-mon[92072]: pgmap v21652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:14:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:13 smithi122 ceph-mon[125440]: pgmap v21652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:14:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:14.234+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:14:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:14.234+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:14:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:14.234+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 312 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:14:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:14.234+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 311 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:14:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:13 smithi136 ceph-mon[125702]: pgmap v21652: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:14:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:15 smithi057 ceph-mon[92072]: pgmap v21653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:14:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:15 smithi057 ceph-mon[92072]: osdmap e1427: 12 total, 12 up, 12 in 2023-03-02T22:14:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:15 smithi122 ceph-mon[125440]: pgmap v21653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:14:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:15 smithi122 ceph-mon[125440]: osdmap e1427: 12 total, 12 up, 12 in 2023-03-02T22:14:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:15 smithi136 ceph-mon[125702]: pgmap v21653: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:14:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:15 smithi136 ceph-mon[125702]: osdmap e1427: 12 total, 12 up, 12 in 2023-03-02T22:14:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:17 smithi057 ceph-mon[92072]: pgmap v21655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:14:18.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:17 smithi122 ceph-mon[125440]: pgmap v21655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:14:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:17 smithi136 ceph-mon[125702]: pgmap v21655: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:14:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:20.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:14:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:20.139+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:14:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:20.139+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:14:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:20.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:14:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:20.139+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:14:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:19 smithi057 ceph-mon[92072]: pgmap v21656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:14:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:19 smithi122 ceph-mon[125440]: pgmap v21656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:14:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:19 smithi136 ceph-mon[125702]: pgmap v21656: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:14:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:21 smithi057 ceph-mon[92072]: pgmap v21657: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:14:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:21 smithi122 ceph-mon[125440]: pgmap v21657: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:14:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:21 smithi136 ceph-mon[125702]: pgmap v21657: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:14:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:23 smithi057 ceph-mon[92072]: pgmap v21658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:14:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:23 smithi122 ceph-mon[125440]: pgmap v21658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:14:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:23 smithi136 ceph-mon[125702]: pgmap v21658: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:14:26.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:25 smithi057 ceph-mon[92072]: pgmap v21659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:14:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:25 smithi122 ceph-mon[125440]: pgmap v21659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:14:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:25 smithi136 ceph-mon[125702]: pgmap v21659: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:14:28.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:27 smithi057 ceph-mon[92072]: pgmap v21660: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:14:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:27 smithi122 ceph-mon[125440]: pgmap v21660: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:14:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:27 smithi136 ceph-mon[125702]: pgmap v21660: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:14:30.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:29 smithi057 ceph-mon[92072]: pgmap v21661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:14:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:29 smithi122 ceph-mon[125440]: pgmap v21661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:14:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:29 smithi136 ceph-mon[125702]: pgmap v21661: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:14:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:31 smithi057 ceph-mon[92072]: pgmap v21662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:32.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:31 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:14:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:31 smithi122 ceph-mon[125440]: pgmap v21662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:32.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:31 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:14:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:31 smithi136 ceph-mon[125702]: pgmap v21662: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:31 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:14:33.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:33 smithi057 ceph-mon[92072]: pgmap v21663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:14:33.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:14:33.685 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:33 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.721 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.721 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.721 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:33 smithi122 ceph-mon[125440]: pgmap v21663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:33.721 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.721 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.721 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.722 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.722 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:14:33.722 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:14:33.722 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:33 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:33 smithi136 ceph-mon[125702]: pgmap v21663: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.841 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:14:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:14:33.842 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:33 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:14:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:35.153+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:14:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:35.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:14:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:35.154+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:14:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:35.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:14:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:35.154+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:14:35.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:35 smithi057 ceph-mon[92072]: pgmap v21664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:35.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:35 smithi122 ceph-mon[125440]: pgmap v21664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:35.840 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:35 smithi136 ceph-mon[125702]: pgmap v21664: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:38.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:37 smithi057 ceph-mon[92072]: pgmap v21665: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:38.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:37 smithi122 ceph-mon[125440]: pgmap v21665: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:37 smithi136 ceph-mon[125702]: pgmap v21665: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:40.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:39 smithi057 ceph-mon[92072]: pgmap v21666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:40.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:39 smithi122 ceph-mon[125440]: pgmap v21666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:39 smithi136 ceph-mon[125702]: pgmap v21666: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:42.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:41 smithi057 ceph-mon[92072]: pgmap v21667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:42.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:41 smithi122 ceph-mon[125440]: pgmap v21667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:41 smithi136 ceph-mon[125702]: pgmap v21667: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:44.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:43 smithi057 ceph-mon[92072]: pgmap v21668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:44.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:43 smithi122 ceph-mon[125440]: pgmap v21668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:43 smithi136 ceph-mon[125702]: pgmap v21668: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:46.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:45 smithi057 ceph-mon[92072]: pgmap v21669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:46.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:45 smithi122 ceph-mon[125440]: pgmap v21669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:45 smithi136 ceph-mon[125702]: pgmap v21669: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:48.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:47 smithi057 ceph-mon[92072]: pgmap v21670: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:48.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:47 smithi122 ceph-mon[125440]: pgmap v21670: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:47 smithi136 ceph-mon[125702]: pgmap v21670: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:50.170+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:14:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:50.171+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:14:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:50.171+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:14:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:50.171+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:14:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:14:50.171+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:14:50.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:49 smithi057 ceph-mon[92072]: pgmap v21671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:50.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:49 smithi122 ceph-mon[125440]: pgmap v21671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:49 smithi136 ceph-mon[125702]: pgmap v21671: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:52.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:51 smithi057 ceph-mon[92072]: pgmap v21672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:52.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:51 smithi122 ceph-mon[125440]: pgmap v21672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:51 smithi136 ceph-mon[125702]: pgmap v21672: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:54.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:53 smithi057 ceph-mon[92072]: pgmap v21673: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:54.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:53 smithi122 ceph-mon[125440]: pgmap v21673: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:53 smithi136 ceph-mon[125702]: pgmap v21673: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:14:56.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:55 smithi057 ceph-mon[92072]: pgmap v21674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:56.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:55 smithi122 ceph-mon[125440]: pgmap v21674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:55 smithi136 ceph-mon[125702]: pgmap v21674: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:58.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:57 smithi057 ceph-mon[92072]: pgmap v21675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:58.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:57 smithi122 ceph-mon[125440]: pgmap v21675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:14:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:57 smithi136 ceph-mon[125702]: pgmap v21675: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:00.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:14:59 smithi057 ceph-mon[92072]: pgmap v21676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:00.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:14:59 smithi122 ceph-mon[125440]: pgmap v21676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:14:59 smithi136 ceph-mon[125702]: pgmap v21676: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:02.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:01 smithi057 ceph-mon[92072]: pgmap v21677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:02.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:01 smithi122 ceph-mon[125440]: pgmap v21677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:01 smithi136 ceph-mon[125702]: pgmap v21677: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:04.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:03 smithi057 ceph-mon[92072]: pgmap v21678: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:15:04.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:03 smithi122 ceph-mon[125440]: pgmap v21678: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:15:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:03 smithi136 ceph-mon[125702]: pgmap v21678: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:15:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:05.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:15:05.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:05.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:15:05.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:05.185+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:15:05.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:05.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:15:05.187 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:05.185+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:15:06.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:05 smithi057 ceph-mon[92072]: pgmap v21679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:15:06.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:05 smithi122 ceph-mon[125440]: pgmap v21679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:15:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:05 smithi136 ceph-mon[125702]: pgmap v21679: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:15:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:07 smithi057 ceph-mon[92072]: pgmap v21680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:15:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:07 smithi057 ceph-mon[92072]: osdmap e1428: 12 total, 12 up, 12 in 2023-03-02T22:15:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:07 smithi122 ceph-mon[125440]: pgmap v21680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:15:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:07 smithi122 ceph-mon[125440]: osdmap e1428: 12 total, 12 up, 12 in 2023-03-02T22:15:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:07 smithi136 ceph-mon[125702]: pgmap v21680: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:15:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:07 smithi136 ceph-mon[125702]: osdmap e1428: 12 total, 12 up, 12 in 2023-03-02T22:15:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:09 smithi057 ceph-mon[92072]: pgmap v21682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:15:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:09 smithi122 ceph-mon[125440]: pgmap v21682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:15:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:09 smithi136 ceph-mon[125702]: pgmap v21682: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:15:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:11 smithi057 ceph-mon[92072]: pgmap v21683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:15:12.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:11 smithi122 ceph-mon[125440]: pgmap v21683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:15:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:11 smithi136 ceph-mon[125702]: pgmap v21683: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:15:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:13 smithi057 ceph-mon[92072]: pgmap v21684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:15:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:13 smithi122 ceph-mon[125440]: pgmap v21684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:15:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:13 smithi136 ceph-mon[125702]: pgmap v21684: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:15:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:15 smithi057 ceph-mon[92072]: pgmap v21685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:15:16.184 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:15 smithi057 ceph-mon[92072]: osdmap e1429: 12 total, 12 up, 12 in 2023-03-02T22:15:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:15 smithi122 ceph-mon[125440]: pgmap v21685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:15:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:15 smithi122 ceph-mon[125440]: osdmap e1429: 12 total, 12 up, 12 in 2023-03-02T22:15:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:15 smithi136 ceph-mon[125702]: pgmap v21685: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:15:16.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:15 smithi136 ceph-mon[125702]: osdmap e1429: 12 total, 12 up, 12 in 2023-03-02T22:15:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:17 smithi057 ceph-mon[92072]: pgmap v21687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:15:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:17 smithi122 ceph-mon[125440]: pgmap v21687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:15:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:17 smithi136 ceph-mon[125702]: pgmap v21687: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 B/s wr, 5 op/s 2023-03-02T22:15:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:19 smithi057 ceph-mon[92072]: pgmap v21688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:15:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:20.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:15:20.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:20.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:15:20.200 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:20.198+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:15:20.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:20.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:15:20.201 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:20.198+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:15:20.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:19 smithi122 ceph-mon[125440]: pgmap v21688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:15:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:19 smithi136 ceph-mon[125702]: pgmap v21688: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:15:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:21 smithi122 ceph-mon[125440]: pgmap v21689: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:15:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:21 smithi136 ceph-mon[125702]: pgmap v21689: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:15:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:21 smithi057 ceph-mon[92072]: pgmap v21689: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:15:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:23 smithi122 ceph-mon[125440]: pgmap v21690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T22:15:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:23 smithi136 ceph-mon[125702]: pgmap v21690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T22:15:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:23 smithi057 ceph-mon[92072]: pgmap v21690: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T22:15:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:25 smithi122 ceph-mon[125440]: pgmap v21691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T22:15:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:25 smithi136 ceph-mon[125702]: pgmap v21691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T22:15:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:25 smithi057 ceph-mon[92072]: pgmap v21691: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-02T22:15:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:27 smithi122 ceph-mon[125440]: pgmap v21692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:15:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:27 smithi136 ceph-mon[125702]: pgmap v21692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:15:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:27 smithi057 ceph-mon[92072]: pgmap v21692: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:15:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:29 smithi122 ceph-mon[125440]: pgmap v21693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:29 smithi136 ceph-mon[125702]: pgmap v21693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:29 smithi057 ceph-mon[92072]: pgmap v21693: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:32.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:31 smithi122 ceph-mon[125440]: pgmap v21694: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:31 smithi136 ceph-mon[125702]: pgmap v21694: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:31 smithi057 ceph-mon[92072]: pgmap v21694: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:33.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:32 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:15:33.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:32 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:15:33.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:32 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:15:34.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:33 smithi136 ceph-mon[125702]: pgmap v21695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:33 smithi057 ceph-mon[92072]: pgmap v21695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:33 smithi122 ceph-mon[125440]: pgmap v21695: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:35.213+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:15:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:35.214+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:15:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:35.214+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:15:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:35.214+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:15:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:35.214+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:15:36.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:35 smithi136 ceph-mon[125702]: pgmap v21696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:36.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:35 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.441 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:35 smithi057 ceph-mon[92072]: pgmap v21696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:36.441 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.442 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:35 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:35 smithi122 ceph-mon[125440]: pgmap v21696: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:36.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:35 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:37.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.342 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T22:15:37.343 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T22:15:37.345 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.347 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.347 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.347 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.348 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.348 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.348 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.348 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.348 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.348 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.348 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:15:37.349 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:15:37.349 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:36 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T22:15:37.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T22:15:37.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.435 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.436 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:15:37.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:15:37.437 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:36 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi122 to 196.1M 2023-03-02T22:15:37.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi122 to 205709414: error parsing value: Value '205709414' is below minimum 939524096 2023-03-02T22:15:37.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.453 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-03-02T22:15:37.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:15:37.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:15:37.454 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:36 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:15:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:37 smithi136 ceph-mon[125702]: pgmap v21697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:37 smithi136 ceph-mon[125702]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T22:15:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:37 smithi136 ceph-mon[125702]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T22:15:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:37 smithi057 ceph-mon[92072]: pgmap v21697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:37 smithi057 ceph-mon[92072]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T22:15:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:37 smithi057 ceph-mon[92072]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T22:15:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:37 smithi122 ceph-mon[125440]: pgmap v21697: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:37 smithi122 ceph-mon[125440]: Adjusting osd_memory_target on smithi136 to 196.2M 2023-03-02T22:15:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:37 smithi122 ceph-mon[125440]: Unable to set osd_memory_target on smithi136 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-03-02T22:15:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:39 smithi136 ceph-mon[125702]: pgmap v21698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:39 smithi057 ceph-mon[92072]: pgmap v21698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:39 smithi122 ceph-mon[125440]: pgmap v21698: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:41 smithi136 ceph-mon[125702]: pgmap v21699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:41 smithi057 ceph-mon[92072]: pgmap v21699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:41 smithi122 ceph-mon[125440]: pgmap v21699: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:44.245+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:15:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:44.245+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:15:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:44.245+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 313 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:15:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:44.245+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 312 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:15:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:43 smithi136 ceph-mon[125702]: pgmap v21700: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:43 smithi057 ceph-mon[92072]: pgmap v21700: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:43 smithi122 ceph-mon[125440]: pgmap v21700: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:45 smithi136 ceph-mon[125702]: pgmap v21701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:45 smithi057 ceph-mon[92072]: pgmap v21701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:45 smithi122 ceph-mon[125440]: pgmap v21701: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:47 smithi136 ceph-mon[125702]: pgmap v21702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:47 smithi057 ceph-mon[92072]: pgmap v21702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:47 smithi122 ceph-mon[125440]: pgmap v21702: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:50.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:50.222+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:15:50.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:50.222+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:15:50.224 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:50.223+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:15:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:50.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:15:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:15:50.223+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:15:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:49 smithi136 ceph-mon[125702]: pgmap v21703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:49 smithi057 ceph-mon[92072]: pgmap v21703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:49 smithi122 ceph-mon[125440]: pgmap v21703: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:51 smithi136 ceph-mon[125702]: pgmap v21704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:51 smithi057 ceph-mon[92072]: pgmap v21704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:51 smithi122 ceph-mon[125440]: pgmap v21704: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:53 smithi136 ceph-mon[125702]: pgmap v21705: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:53 smithi057 ceph-mon[92072]: pgmap v21705: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:53 smithi122 ceph-mon[125440]: pgmap v21705: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:15:56.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:56 smithi136 ceph-mon[125702]: pgmap v21706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:56 smithi057 ceph-mon[92072]: pgmap v21706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:56 smithi122 ceph-mon[125440]: pgmap v21706: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:15:58 smithi136 ceph-mon[125702]: pgmap v21707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:15:58 smithi057 ceph-mon[92072]: pgmap v21707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:15:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:15:58 smithi122 ceph-mon[125440]: pgmap v21707: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:00 smithi136 ceph-mon[125702]: pgmap v21708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:00 smithi057 ceph-mon[92072]: pgmap v21708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:00 smithi122 ceph-mon[125440]: pgmap v21708: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:02 smithi136 ceph-mon[125702]: pgmap v21709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:02 smithi057 ceph-mon[92072]: pgmap v21709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:02 smithi122 ceph-mon[125440]: pgmap v21709: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:04 smithi136 ceph-mon[125702]: pgmap v21710: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:16:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:04 smithi057 ceph-mon[92072]: pgmap v21710: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:16:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:04 smithi122 ceph-mon[125440]: pgmap v21710: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:16:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:05.238+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:16:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:05.238+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:16:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:05.238+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:16:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:05.238+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:16:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:05.238+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:16:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:06 smithi136 ceph-mon[125702]: pgmap v21711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:16:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:06 smithi057 ceph-mon[92072]: pgmap v21711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:16:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:06 smithi122 ceph-mon[125440]: pgmap v21711: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:16:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:08 smithi136 ceph-mon[125702]: pgmap v21712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:16:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:08 smithi136 ceph-mon[125702]: osdmap e1430: 12 total, 12 up, 12 in 2023-03-02T22:16:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:08 smithi057 ceph-mon[92072]: pgmap v21712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:16:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:08 smithi057 ceph-mon[92072]: osdmap e1430: 12 total, 12 up, 12 in 2023-03-02T22:16:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:08 smithi122 ceph-mon[125440]: pgmap v21712: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:16:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:08 smithi122 ceph-mon[125440]: osdmap e1430: 12 total, 12 up, 12 in 2023-03-02T22:16:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:10 smithi136 ceph-mon[125702]: pgmap v21714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:16:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:10 smithi057 ceph-mon[92072]: pgmap v21714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:16:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:10 smithi122 ceph-mon[125440]: pgmap v21714: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:16:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:12 smithi136 ceph-mon[125702]: pgmap v21715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:16:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:12 smithi057 ceph-mon[92072]: pgmap v21715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:16:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:12 smithi122 ceph-mon[125440]: pgmap v21715: 97 pgs: 97 active+clean; 8.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:16:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:14 smithi136 ceph-mon[125702]: pgmap v21716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:16:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:14 smithi057 ceph-mon[92072]: pgmap v21716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:16:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:14 smithi122 ceph-mon[125440]: pgmap v21716: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:16:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:16 smithi136 ceph-mon[125702]: pgmap v21717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:16:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:16 smithi136 ceph-mon[125702]: osdmap e1431: 12 total, 12 up, 12 in 2023-03-02T22:16:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:16 smithi057 ceph-mon[92072]: pgmap v21717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:16:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:16 smithi057 ceph-mon[92072]: osdmap e1431: 12 total, 12 up, 12 in 2023-03-02T22:16:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:16 smithi122 ceph-mon[125440]: pgmap v21717: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:16:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:16 smithi122 ceph-mon[125440]: osdmap e1431: 12 total, 12 up, 12 in 2023-03-02T22:16:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:18 smithi136 ceph-mon[125702]: pgmap v21719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:16:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:18 smithi057 ceph-mon[92072]: pgmap v21719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:16:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:18 smithi122 ceph-mon[125440]: pgmap v21719: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:16:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:20.254+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:16:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:20.254+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:16:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:20.254+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:16:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:20.254+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:16:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:20.254+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:16:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:20 smithi136 ceph-mon[125702]: pgmap v21720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:16:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:20 smithi057 ceph-mon[92072]: pgmap v21720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:16:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:20 smithi122 ceph-mon[125440]: pgmap v21720: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:16:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:22 smithi136 ceph-mon[125702]: pgmap v21721: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:16:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:22 smithi057 ceph-mon[92072]: pgmap v21721: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:16:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:22 smithi122 ceph-mon[125440]: pgmap v21721: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:16:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:24 smithi136 ceph-mon[125702]: pgmap v21722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:16:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:24 smithi057 ceph-mon[92072]: pgmap v21722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:16:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:24 smithi122 ceph-mon[125440]: pgmap v21722: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:16:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:26 smithi136 ceph-mon[125702]: pgmap v21723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:16:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:26 smithi057 ceph-mon[92072]: pgmap v21723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:16:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:26 smithi122 ceph-mon[125440]: pgmap v21723: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:16:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:28 smithi136 ceph-mon[125702]: pgmap v21724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:16:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:28 smithi057 ceph-mon[92072]: pgmap v21724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:16:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:28 smithi122 ceph-mon[125440]: pgmap v21724: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:16:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:30 smithi136 ceph-mon[125702]: pgmap v21725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:30 smithi057 ceph-mon[92072]: pgmap v21725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:30 smithi122 ceph-mon[125440]: pgmap v21725: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:32 smithi136 ceph-mon[125702]: pgmap v21726: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:32 smithi057 ceph-mon[92072]: pgmap v21726: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:32 smithi122 ceph-mon[125440]: pgmap v21726: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:34 smithi136 ceph-mon[125702]: pgmap v21727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:34 smithi057 ceph-mon[92072]: pgmap v21727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:34 smithi122 ceph-mon[125440]: pgmap v21727: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:35.271 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:35.270+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:16:35.271 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:35.270+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:16:35.272 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:35.270+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:16:35.272 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:35.270+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:16:35.272 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:35.270+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:16:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:36 smithi136 ceph-mon[125702]: pgmap v21728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:36 smithi057 ceph-mon[92072]: pgmap v21728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:36 smithi122 ceph-mon[125440]: pgmap v21728: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:37.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:16:37.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:16:37.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:16:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:38 smithi136 ceph-mon[125702]: pgmap v21729: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:16:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:16:38.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:38 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:16:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:38 smithi057 ceph-mon[92072]: pgmap v21729: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:16:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:16:38.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:38 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:16:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:38 smithi122 ceph-mon[125440]: pgmap v21729: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:16:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:16:38.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:38 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:16:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:40 smithi136 ceph-mon[125702]: pgmap v21730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:40 smithi057 ceph-mon[92072]: pgmap v21730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:40 smithi122 ceph-mon[125440]: pgmap v21730: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:42 smithi057 ceph-mon[92072]: pgmap v21731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:42 smithi122 ceph-mon[125440]: pgmap v21731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:42 smithi136 ceph-mon[125702]: pgmap v21731: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:44 smithi057 ceph-mon[92072]: pgmap v21732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:44 smithi122 ceph-mon[125440]: pgmap v21732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:44 smithi136 ceph-mon[125702]: pgmap v21732: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:46 smithi057 ceph-mon[92072]: pgmap v21733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:46 smithi122 ceph-mon[125440]: pgmap v21733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:46 smithi136 ceph-mon[125702]: pgmap v21733: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:48 smithi057 ceph-mon[92072]: pgmap v21734: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:48 smithi122 ceph-mon[125440]: pgmap v21734: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:48 smithi136 ceph-mon[125702]: pgmap v21734: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:50.283+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:50.283+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:50.283+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:50.283+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:16:50.283+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:16:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:50 smithi057 ceph-mon[92072]: pgmap v21735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:50 smithi122 ceph-mon[125440]: pgmap v21735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:50 smithi136 ceph-mon[125702]: pgmap v21735: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:52 smithi057 ceph-mon[92072]: pgmap v21736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:52 smithi122 ceph-mon[125440]: pgmap v21736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:52 smithi136 ceph-mon[125702]: pgmap v21736: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:54 smithi057 ceph-mon[92072]: pgmap v21737: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:54 smithi122 ceph-mon[125440]: pgmap v21737: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:54 smithi136 ceph-mon[125702]: pgmap v21737: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:16:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:56 smithi057 ceph-mon[92072]: pgmap v21738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:56 smithi122 ceph-mon[125440]: pgmap v21738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:56 smithi136 ceph-mon[125702]: pgmap v21738: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:16:58 smithi057 ceph-mon[92072]: pgmap v21739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:16:58 smithi122 ceph-mon[125440]: pgmap v21739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:16:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:16:58 smithi136 ceph-mon[125702]: pgmap v21739: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:00 smithi057 ceph-mon[92072]: pgmap v21740: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:00 smithi122 ceph-mon[125440]: pgmap v21740: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:00 smithi136 ceph-mon[125702]: pgmap v21740: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:02 smithi057 ceph-mon[92072]: pgmap v21741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:02 smithi122 ceph-mon[125440]: pgmap v21741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:02 smithi136 ceph-mon[125702]: pgmap v21741: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:04 smithi057 ceph-mon[92072]: pgmap v21742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:17:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:04 smithi122 ceph-mon[125440]: pgmap v21742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:17:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:04 smithi136 ceph-mon[125702]: pgmap v21742: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:17:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:05.291+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:17:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:05.292+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:17:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:05.292+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:17:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:05.292+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:17:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:05.292+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:17:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:06 smithi057 ceph-mon[92072]: pgmap v21743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:17:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:06 smithi122 ceph-mon[125440]: pgmap v21743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:17:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:06 smithi136 ceph-mon[125702]: pgmap v21743: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:17:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:07 smithi057 ceph-mon[92072]: pgmap v21744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:17:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:07 smithi057 ceph-mon[92072]: osdmap e1432: 12 total, 12 up, 12 in 2023-03-02T22:17:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:07 smithi122 ceph-mon[125440]: pgmap v21744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:17:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:07 smithi122 ceph-mon[125440]: osdmap e1432: 12 total, 12 up, 12 in 2023-03-02T22:17:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:07 smithi136 ceph-mon[125702]: pgmap v21744: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:17:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:07 smithi136 ceph-mon[125702]: osdmap e1432: 12 total, 12 up, 12 in 2023-03-02T22:17:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:09 smithi057 ceph-mon[92072]: pgmap v21746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:17:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:09 smithi122 ceph-mon[125440]: pgmap v21746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:17:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:09 smithi136 ceph-mon[125702]: pgmap v21746: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:17:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:11 smithi057 ceph-mon[92072]: pgmap v21747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:17:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:11 smithi122 ceph-mon[125440]: pgmap v21747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:17:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:11 smithi136 ceph-mon[125702]: pgmap v21747: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:17:14.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:13 smithi057 ceph-mon[92072]: pgmap v21748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:17:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:13 smithi122 ceph-mon[125440]: pgmap v21748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:17:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:14.259+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:17:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:14.259+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:17:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:14.259+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 313 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:17:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:14.259+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 314 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:17:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:13 smithi136 ceph-mon[125702]: pgmap v21748: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:17:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:15 smithi057 ceph-mon[92072]: pgmap v21749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:17:16.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:15 smithi057 ceph-mon[92072]: osdmap e1433: 12 total, 12 up, 12 in 2023-03-02T22:17:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:15 smithi122 ceph-mon[125440]: pgmap v21749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:17:16.202 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:15 smithi122 ceph-mon[125440]: osdmap e1433: 12 total, 12 up, 12 in 2023-03-02T22:17:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:15 smithi136 ceph-mon[125702]: pgmap v21749: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:17:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:15 smithi136 ceph-mon[125702]: osdmap e1433: 12 total, 12 up, 12 in 2023-03-02T22:17:18.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:17 smithi057 ceph-mon[92072]: pgmap v21751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:17:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:17 smithi122 ceph-mon[125440]: pgmap v21751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:17:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:17 smithi136 ceph-mon[125702]: pgmap v21751: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:17:20.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:19 smithi057 ceph-mon[92072]: pgmap v21752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:17:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:19 smithi122 ceph-mon[125440]: pgmap v21752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:17:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:20.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:17:20.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:20.305+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:17:20.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:20.305+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:17:20.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:20.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:17:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:20.305+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:17:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:19 smithi136 ceph-mon[125702]: pgmap v21752: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:17:22.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:21 smithi057 ceph-mon[92072]: pgmap v21753: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:17:22.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:21 smithi122 ceph-mon[125440]: pgmap v21753: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:17:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:21 smithi136 ceph-mon[125702]: pgmap v21753: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:17:24.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:23 smithi057 ceph-mon[92072]: pgmap v21754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:17:24.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:23 smithi122 ceph-mon[125440]: pgmap v21754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:17:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:23 smithi136 ceph-mon[125702]: pgmap v21754: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:17:26.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:25 smithi122 ceph-mon[125440]: pgmap v21755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:17:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:25 smithi136 ceph-mon[125702]: pgmap v21755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:17:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:25 smithi057 ceph-mon[92072]: pgmap v21755: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:17:28.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:27 smithi122 ceph-mon[125440]: pgmap v21756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:17:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:27 smithi136 ceph-mon[125702]: pgmap v21756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:17:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:27 smithi057 ceph-mon[92072]: pgmap v21756: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:17:30.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:29 smithi122 ceph-mon[125440]: pgmap v21757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:29 smithi136 ceph-mon[125702]: pgmap v21757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:29 smithi057 ceph-mon[92072]: pgmap v21757: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:31 smithi136 ceph-mon[125702]: pgmap v21758: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:31 smithi057 ceph-mon[92072]: pgmap v21758: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:31 smithi122 ceph-mon[125440]: pgmap v21758: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:33 smithi136 ceph-mon[125702]: pgmap v21759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:33 smithi057 ceph-mon[92072]: pgmap v21759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:33 smithi122 ceph-mon[125440]: pgmap v21759: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:35.318+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:17:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:35.319+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:17:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:35.319+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:17:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:35.319+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:17:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:35.319+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:17:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:35 smithi136 ceph-mon[125702]: pgmap v21760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:35 smithi057 ceph-mon[92072]: pgmap v21760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:35 smithi122 ceph-mon[125440]: pgmap v21760: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:37 smithi136 ceph-mon[125702]: pgmap v21761: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:37 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:17:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:37 smithi057 ceph-mon[92072]: pgmap v21761: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:37 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:17:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:37 smithi122 ceph-mon[125440]: pgmap v21761: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:37 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:17:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:17:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:17:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:17:39.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:17:39.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:17:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:17:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:17:39.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:17:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:17:39.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:17:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:17:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:17:39.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:17:39.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:17:39.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:17:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:40 smithi057 ceph-mon[92072]: pgmap v21762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:40 smithi122 ceph-mon[125440]: pgmap v21762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:40 smithi136 ceph-mon[125702]: pgmap v21762: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:42 smithi057 ceph-mon[92072]: pgmap v21763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:42 smithi122 ceph-mon[125440]: pgmap v21763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:42 smithi136 ceph-mon[125702]: pgmap v21763: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:44 smithi057 ceph-mon[92072]: pgmap v21764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:44 smithi122 ceph-mon[125440]: pgmap v21764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:44 smithi136 ceph-mon[125702]: pgmap v21764: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:46 smithi057 ceph-mon[92072]: pgmap v21765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:46 smithi122 ceph-mon[125440]: pgmap v21765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:46 smithi136 ceph-mon[125702]: pgmap v21765: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:48 smithi057 ceph-mon[92072]: pgmap v21766: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:48 smithi122 ceph-mon[125440]: pgmap v21766: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:48 smithi136 ceph-mon[125702]: pgmap v21766: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:50.330+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:17:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:50.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:17:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:50.330+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:17:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:50.331+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:17:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:17:50.331+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:17:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:50 smithi057 ceph-mon[92072]: pgmap v21767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:50 smithi122 ceph-mon[125440]: pgmap v21767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:50 smithi136 ceph-mon[125702]: pgmap v21767: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:52 smithi057 ceph-mon[92072]: pgmap v21768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:52 smithi122 ceph-mon[125440]: pgmap v21768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:52 smithi136 ceph-mon[125702]: pgmap v21768: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:54 smithi057 ceph-mon[92072]: pgmap v21769: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:54 smithi122 ceph-mon[125440]: pgmap v21769: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:54 smithi136 ceph-mon[125702]: pgmap v21769: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:17:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:56 smithi057 ceph-mon[92072]: pgmap v21770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:56 smithi122 ceph-mon[125440]: pgmap v21770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:56 smithi136 ceph-mon[125702]: pgmap v21770: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:17:58 smithi057 ceph-mon[92072]: pgmap v21771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:17:58 smithi122 ceph-mon[125440]: pgmap v21771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:17:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:17:58 smithi136 ceph-mon[125702]: pgmap v21771: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:00 smithi057 ceph-mon[92072]: pgmap v21772: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:00 smithi122 ceph-mon[125440]: pgmap v21772: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:00 smithi136 ceph-mon[125702]: pgmap v21772: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:02 smithi057 ceph-mon[92072]: pgmap v21773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:02 smithi122 ceph-mon[125440]: pgmap v21773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:02 smithi136 ceph-mon[125702]: pgmap v21773: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:04 smithi057 ceph-mon[92072]: pgmap v21774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:18:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:04 smithi122 ceph-mon[125440]: pgmap v21774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:18:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:04 smithi136 ceph-mon[125702]: pgmap v21774: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:18:05.341 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:05.340+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:18:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:05.340+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:18:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:05.341+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:18:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:05.341+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:18:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:05.341+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:18:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:06 smithi057 ceph-mon[92072]: pgmap v21775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:18:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:06 smithi122 ceph-mon[125440]: pgmap v21775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:18:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:06 smithi136 ceph-mon[125702]: pgmap v21775: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:18:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:07 smithi057 ceph-mon[92072]: pgmap v21776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:18:08.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:07 smithi057 ceph-mon[92072]: osdmap e1434: 12 total, 12 up, 12 in 2023-03-02T22:18:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:07 smithi122 ceph-mon[125440]: pgmap v21776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:18:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:07 smithi122 ceph-mon[125440]: osdmap e1434: 12 total, 12 up, 12 in 2023-03-02T22:18:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:07 smithi136 ceph-mon[125702]: pgmap v21776: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:18:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:07 smithi136 ceph-mon[125702]: osdmap e1434: 12 total, 12 up, 12 in 2023-03-02T22:18:10.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:09 smithi057 ceph-mon[92072]: pgmap v21778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:18:10.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:09 smithi122 ceph-mon[125440]: pgmap v21778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:18:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:09 smithi136 ceph-mon[125702]: pgmap v21778: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:18:12.183 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:11 smithi057 ceph-mon[92072]: pgmap v21779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:18:12.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:11 smithi122 ceph-mon[125440]: pgmap v21779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:18:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:11 smithi136 ceph-mon[125702]: pgmap v21779: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:18:14.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:13 smithi122 ceph-mon[125440]: pgmap v21780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:18:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:13 smithi136 ceph-mon[125702]: pgmap v21780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:18:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:13 smithi057 ceph-mon[92072]: pgmap v21780: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:18:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:15 smithi122 ceph-mon[125440]: pgmap v21781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:18:16.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:15 smithi122 ceph-mon[125440]: osdmap e1435: 12 total, 12 up, 12 in 2023-03-02T22:18:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:15 smithi136 ceph-mon[125702]: pgmap v21781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:18:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:15 smithi136 ceph-mon[125702]: osdmap e1435: 12 total, 12 up, 12 in 2023-03-02T22:18:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:15 smithi057 ceph-mon[92072]: pgmap v21781: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:18:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:15 smithi057 ceph-mon[92072]: osdmap e1435: 12 total, 12 up, 12 in 2023-03-02T22:18:18.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:17 smithi122 ceph-mon[125440]: pgmap v21783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:18:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:17 smithi136 ceph-mon[125702]: pgmap v21783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:18:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:17 smithi057 ceph-mon[92072]: pgmap v21783: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:18:20.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:19 smithi122 ceph-mon[125440]: pgmap v21784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:18:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:19 smithi136 ceph-mon[125702]: pgmap v21784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:18:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:20.344+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:18:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:20.345+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:18:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:20.345+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:18:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:20.345+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:18:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:20.345+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:18:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:19 smithi057 ceph-mon[92072]: pgmap v21784: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:18:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:21 smithi136 ceph-mon[125702]: pgmap v21785: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:18:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:21 smithi057 ceph-mon[92072]: pgmap v21785: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:18:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:21 smithi122 ceph-mon[125440]: pgmap v21785: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:18:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:23 smithi136 ceph-mon[125702]: pgmap v21786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:18:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:23 smithi057 ceph-mon[92072]: pgmap v21786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:18:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:23 smithi122 ceph-mon[125440]: pgmap v21786: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:18:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:25 smithi136 ceph-mon[125702]: pgmap v21787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:18:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:25 smithi057 ceph-mon[92072]: pgmap v21787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:18:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:25 smithi122 ceph-mon[125440]: pgmap v21787: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:18:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:27 smithi136 ceph-mon[125702]: pgmap v21788: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:18:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:27 smithi057 ceph-mon[92072]: pgmap v21788: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:18:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:27 smithi122 ceph-mon[125440]: pgmap v21788: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:18:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:29 smithi136 ceph-mon[125702]: pgmap v21789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:29 smithi057 ceph-mon[92072]: pgmap v21789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:29 smithi122 ceph-mon[125440]: pgmap v21789: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:31 smithi136 ceph-mon[125702]: pgmap v21790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:31 smithi057 ceph-mon[92072]: pgmap v21790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:31 smithi122 ceph-mon[125440]: pgmap v21790: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:33 smithi136 ceph-mon[125702]: pgmap v21791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:33 smithi057 ceph-mon[92072]: pgmap v21791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:33 smithi122 ceph-mon[125440]: pgmap v21791: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:35.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:18:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:35.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:18:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:35.360+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:18:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:35.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:18:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:35.360+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:18:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:35 smithi136 ceph-mon[125702]: pgmap v21792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:35 smithi057 ceph-mon[92072]: pgmap v21792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:35 smithi122 ceph-mon[125440]: pgmap v21792: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:37 smithi136 ceph-mon[125702]: pgmap v21793: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:37 smithi057 ceph-mon[92072]: pgmap v21793: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:37 smithi122 ceph-mon[125440]: pgmap v21793: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:39 smithi136 ceph-mon[125702]: pgmap v21794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:39 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:18:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:39 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:39 smithi057 ceph-mon[92072]: pgmap v21794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:39 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:18:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:40.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:39 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:40.459 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:39 smithi122 ceph-mon[125440]: pgmap v21794: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:40.459 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:39 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:18:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:39 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:18:41.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:40 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:18:41.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:40 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:18:41.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:40 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:18:41.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:40 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:18:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:40 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:18:41.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:40 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:18:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:41 smithi136 ceph-mon[125702]: pgmap v21795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:41 smithi057 ceph-mon[92072]: pgmap v21795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:41 smithi122 ceph-mon[125440]: pgmap v21795: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:44 smithi136 ceph-mon[125702]: pgmap v21796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:44 smithi057 ceph-mon[92072]: pgmap v21796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:44 smithi122 ceph-mon[125440]: pgmap v21796: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:46 smithi136 ceph-mon[125702]: pgmap v21797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:46 smithi057 ceph-mon[92072]: pgmap v21797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:46 smithi122 ceph-mon[125440]: pgmap v21797: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:48 smithi136 ceph-mon[125702]: pgmap v21798: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:48 smithi057 ceph-mon[92072]: pgmap v21798: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:48 smithi122 ceph-mon[125440]: pgmap v21798: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:50 smithi136 ceph-mon[125702]: pgmap v21799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:50.362+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:18:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:50.362+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:18:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:50.362+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:18:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:50.362+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:18:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:18:50.362+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:18:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:50 smithi057 ceph-mon[92072]: pgmap v21799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:50 smithi122 ceph-mon[125440]: pgmap v21799: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:52 smithi136 ceph-mon[125702]: pgmap v21800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:52 smithi057 ceph-mon[92072]: pgmap v21800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:52 smithi122 ceph-mon[125440]: pgmap v21800: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:54 smithi136 ceph-mon[125702]: pgmap v21801: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:54 smithi057 ceph-mon[92072]: pgmap v21801: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:54 smithi122 ceph-mon[125440]: pgmap v21801: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:18:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:56 smithi136 ceph-mon[125702]: pgmap v21802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:56 smithi057 ceph-mon[92072]: pgmap v21802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:56 smithi122 ceph-mon[125440]: pgmap v21802: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:18:58 smithi136 ceph-mon[125702]: pgmap v21803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:18:58 smithi057 ceph-mon[92072]: pgmap v21803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:18:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:18:58 smithi122 ceph-mon[125440]: pgmap v21803: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:00 smithi136 ceph-mon[125702]: pgmap v21804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:00 smithi057 ceph-mon[92072]: pgmap v21804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:00 smithi122 ceph-mon[125440]: pgmap v21804: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:02 smithi136 ceph-mon[125702]: pgmap v21805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:02 smithi057 ceph-mon[92072]: pgmap v21805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:02 smithi122 ceph-mon[125440]: pgmap v21805: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:04 smithi136 ceph-mon[125702]: pgmap v21806: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:19:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:04 smithi057 ceph-mon[92072]: pgmap v21806: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:19:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:04 smithi122 ceph-mon[125440]: pgmap v21806: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:19:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:05.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:19:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:05.378+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:19:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:05.378+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:19:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:05.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:19:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:05.378+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:19:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:06 smithi136 ceph-mon[125702]: pgmap v21807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:19:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:06 smithi057 ceph-mon[92072]: pgmap v21807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:19:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:06 smithi122 ceph-mon[125440]: pgmap v21807: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:19:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:08 smithi136 ceph-mon[125702]: pgmap v21808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:19:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:08 smithi136 ceph-mon[125702]: osdmap e1436: 12 total, 12 up, 12 in 2023-03-02T22:19:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:08 smithi057 ceph-mon[92072]: pgmap v21808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:19:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:08 smithi057 ceph-mon[92072]: osdmap e1436: 12 total, 12 up, 12 in 2023-03-02T22:19:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:08 smithi122 ceph-mon[125440]: pgmap v21808: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:19:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:08 smithi122 ceph-mon[125440]: osdmap e1436: 12 total, 12 up, 12 in 2023-03-02T22:19:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:10 smithi136 ceph-mon[125702]: pgmap v21810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:19:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:10 smithi057 ceph-mon[92072]: pgmap v21810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:19:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:10 smithi122 ceph-mon[125440]: pgmap v21810: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:19:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:12 smithi136 ceph-mon[125702]: pgmap v21811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:19:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:12 smithi057 ceph-mon[92072]: pgmap v21811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:19:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:12 smithi122 ceph-mon[125440]: pgmap v21811: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:19:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:14 smithi136 ceph-mon[125702]: pgmap v21812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:19:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:14 smithi057 ceph-mon[92072]: pgmap v21812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:19:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:14 smithi122 ceph-mon[125440]: pgmap v21812: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:19:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:16 smithi136 ceph-mon[125702]: pgmap v21813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:19:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:16 smithi136 ceph-mon[125702]: osdmap e1437: 12 total, 12 up, 12 in 2023-03-02T22:19:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:16 smithi057 ceph-mon[92072]: pgmap v21813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:19:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:16 smithi057 ceph-mon[92072]: osdmap e1437: 12 total, 12 up, 12 in 2023-03-02T22:19:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:16 smithi122 ceph-mon[125440]: pgmap v21813: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:19:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:16 smithi122 ceph-mon[125440]: osdmap e1437: 12 total, 12 up, 12 in 2023-03-02T22:19:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:18 smithi057 ceph-mon[92072]: pgmap v21815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:19:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:18 smithi122 ceph-mon[125440]: pgmap v21815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:19:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:18 smithi136 ceph-mon[125702]: pgmap v21815: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:19:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:20.389+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:19:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:20.390+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:19:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:20.390+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:19:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:20.390+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:19:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:20.390+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:19:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:20 smithi057 ceph-mon[92072]: pgmap v21816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:19:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:20 smithi122 ceph-mon[125440]: pgmap v21816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:19:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:20 smithi136 ceph-mon[125702]: pgmap v21816: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:19:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:22 smithi057 ceph-mon[92072]: pgmap v21817: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:19:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:22 smithi122 ceph-mon[125440]: pgmap v21817: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:19:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:22 smithi136 ceph-mon[125702]: pgmap v21817: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:19:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:24 smithi057 ceph-mon[92072]: pgmap v21818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:19:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:24 smithi122 ceph-mon[125440]: pgmap v21818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:19:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:24 smithi136 ceph-mon[125702]: pgmap v21818: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:19:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:26 smithi057 ceph-mon[92072]: pgmap v21819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:19:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:26 smithi122 ceph-mon[125440]: pgmap v21819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:19:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:26 smithi136 ceph-mon[125702]: pgmap v21819: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:19:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:28 smithi057 ceph-mon[92072]: pgmap v21820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:19:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:28 smithi122 ceph-mon[125440]: pgmap v21820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:19:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:28 smithi136 ceph-mon[125702]: pgmap v21820: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-02T22:19:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:30 smithi057 ceph-mon[92072]: pgmap v21821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:30 smithi122 ceph-mon[125440]: pgmap v21821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:30 smithi136 ceph-mon[125702]: pgmap v21821: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:32 smithi057 ceph-mon[92072]: pgmap v21822: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:32 smithi122 ceph-mon[125440]: pgmap v21822: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:32 smithi136 ceph-mon[125702]: pgmap v21822: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:34 smithi057 ceph-mon[92072]: pgmap v21823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:34 smithi122 ceph-mon[125440]: pgmap v21823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:34 smithi136 ceph-mon[125702]: pgmap v21823: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:35.404 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:35.403+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:19:35.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:35.404+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:19:35.405 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:35.404+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:19:35.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:35.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:19:35.406 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:35.404+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:19:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:36 smithi057 ceph-mon[92072]: pgmap v21824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:36 smithi122 ceph-mon[125440]: pgmap v21824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:36 smithi136 ceph-mon[125702]: pgmap v21824: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:38 smithi057 ceph-mon[92072]: pgmap v21825: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:38 smithi122 ceph-mon[125440]: pgmap v21825: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:38 smithi136 ceph-mon[125702]: pgmap v21825: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:40 smithi057 ceph-mon[92072]: pgmap v21826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:40 smithi122 ceph-mon[125440]: pgmap v21826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:40 smithi136 ceph-mon[125702]: pgmap v21826: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:41.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:41 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:19:41.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:41 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:19:41.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:41 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:19:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:42 smithi057 ceph-mon[92072]: pgmap v21827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:19:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:19:42.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:42 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:19:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:42 smithi122 ceph-mon[125440]: pgmap v21827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:19:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:19:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:42 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:19:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:42 smithi136 ceph-mon[125702]: pgmap v21827: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:19:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:19:42.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:42 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:19:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:44 smithi057 ceph-mon[92072]: pgmap v21828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:44 smithi122 ceph-mon[125440]: pgmap v21828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:44 smithi136 ceph-mon[125702]: pgmap v21828: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:46 smithi057 ceph-mon[92072]: pgmap v21829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:46 smithi122 ceph-mon[125440]: pgmap v21829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:46 smithi136 ceph-mon[125702]: pgmap v21829: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:48 smithi057 ceph-mon[92072]: pgmap v21830: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:48 smithi122 ceph-mon[125440]: pgmap v21830: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:48 smithi136 ceph-mon[125702]: pgmap v21830: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:50.419 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:50.417+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:19:50.420 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:50.418+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:19:50.420 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:50.418+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:19:50.420 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:50.418+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:19:50.420 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:19:50.418+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:19:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:50 smithi057 ceph-mon[92072]: pgmap v21831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:50 smithi122 ceph-mon[125440]: pgmap v21831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:50 smithi136 ceph-mon[125702]: pgmap v21831: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:52 smithi057 ceph-mon[92072]: pgmap v21832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:52 smithi122 ceph-mon[125440]: pgmap v21832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:52 smithi136 ceph-mon[125702]: pgmap v21832: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:54 smithi122 ceph-mon[125440]: pgmap v21833: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:54 smithi136 ceph-mon[125702]: pgmap v21833: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:54 smithi057 ceph-mon[92072]: pgmap v21833: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:19:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:56 smithi122 ceph-mon[125440]: pgmap v21834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:56 smithi136 ceph-mon[125702]: pgmap v21834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:56 smithi057 ceph-mon[92072]: pgmap v21834: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:19:58 smithi122 ceph-mon[125440]: pgmap v21835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:19:58 smithi136 ceph-mon[125702]: pgmap v21835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:19:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:19:58 smithi057 ceph-mon[92072]: pgmap v21835: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:00 smithi122 ceph-mon[125440]: pgmap v21836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:00.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:00 smithi122 ceph-mon[125440]: overall HEALTH_OK 2023-03-02T22:20:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:00 smithi136 ceph-mon[125702]: pgmap v21836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:00 smithi136 ceph-mon[125702]: overall HEALTH_OK 2023-03-02T22:20:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:00 smithi057 ceph-mon[92072]: pgmap v21836: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:00 smithi057 ceph-mon[92072]: overall HEALTH_OK 2023-03-02T22:20:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:02 smithi122 ceph-mon[125440]: pgmap v21837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:02 smithi136 ceph-mon[125702]: pgmap v21837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:02 smithi057 ceph-mon[92072]: pgmap v21837: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:04 smithi136 ceph-mon[125702]: pgmap v21838: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:20:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:04 smithi057 ceph-mon[92072]: pgmap v21838: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:20:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:04 smithi122 ceph-mon[125440]: pgmap v21838: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:20:05.432 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:05.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:20:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:05.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:20:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:05.430+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:20:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:05.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:20:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:05.430+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:20:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:06 smithi136 ceph-mon[125702]: pgmap v21839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:20:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:06 smithi057 ceph-mon[92072]: pgmap v21839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:20:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:06 smithi122 ceph-mon[125440]: pgmap v21839: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:20:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:07 smithi122 ceph-mon[125440]: pgmap v21840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:20:08.201 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:07 smithi122 ceph-mon[125440]: osdmap e1438: 12 total, 12 up, 12 in 2023-03-02T22:20:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:07 smithi136 ceph-mon[125702]: pgmap v21840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:20:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:07 smithi136 ceph-mon[125702]: osdmap e1438: 12 total, 12 up, 12 in 2023-03-02T22:20:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:07 smithi057 ceph-mon[92072]: pgmap v21840: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:20:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:07 smithi057 ceph-mon[92072]: osdmap e1438: 12 total, 12 up, 12 in 2023-03-02T22:20:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:09 smithi136 ceph-mon[125702]: pgmap v21842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:20:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:09 smithi057 ceph-mon[92072]: pgmap v21842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:20:10.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:09 smithi122 ceph-mon[125440]: pgmap v21842: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:20:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:11 smithi136 ceph-mon[125702]: pgmap v21843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:20:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:11 smithi057 ceph-mon[92072]: pgmap v21843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:20:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:11 smithi122 ceph-mon[125440]: pgmap v21843: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:20:14.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:14.286+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:20:14.287 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:14.286+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:20:14.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:14.287+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 314 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:20:14.288 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:14.287+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 315 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:20:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:13 smithi136 ceph-mon[125702]: pgmap v21844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:20:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:13 smithi057 ceph-mon[92072]: pgmap v21844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:20:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:13 smithi122 ceph-mon[125440]: pgmap v21844: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:20:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:15 smithi136 ceph-mon[125702]: pgmap v21845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:20:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:15 smithi136 ceph-mon[125702]: osdmap e1439: 12 total, 12 up, 12 in 2023-03-02T22:20:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:15 smithi057 ceph-mon[92072]: pgmap v21845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:20:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:15 smithi057 ceph-mon[92072]: osdmap e1439: 12 total, 12 up, 12 in 2023-03-02T22:20:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:15 smithi122 ceph-mon[125440]: pgmap v21845: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:20:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:15 smithi122 ceph-mon[125440]: osdmap e1439: 12 total, 12 up, 12 in 2023-03-02T22:20:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:17 smithi136 ceph-mon[125702]: pgmap v21847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:20:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:17 smithi057 ceph-mon[92072]: pgmap v21847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:20:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:17 smithi122 ceph-mon[125440]: pgmap v21847: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:20:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:19 smithi136 ceph-mon[125702]: pgmap v21848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:20:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:19 smithi057 ceph-mon[92072]: pgmap v21848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:20:20.448 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:20.447+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:20:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:20.447+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:20:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:20.447+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:20:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:20.447+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:20:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:20.448+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:20:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:19 smithi122 ceph-mon[125440]: pgmap v21848: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:20:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:21 smithi136 ceph-mon[125702]: pgmap v21849: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:20:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:21 smithi057 ceph-mon[92072]: pgmap v21849: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:20:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:21 smithi122 ceph-mon[125440]: pgmap v21849: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:20:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:23 smithi136 ceph-mon[125702]: pgmap v21850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:20:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:23 smithi057 ceph-mon[92072]: pgmap v21850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:20:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:23 smithi122 ceph-mon[125440]: pgmap v21850: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:20:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:25 smithi136 ceph-mon[125702]: pgmap v21851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:20:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:25 smithi057 ceph-mon[92072]: pgmap v21851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:20:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:25 smithi122 ceph-mon[125440]: pgmap v21851: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:20:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:27 smithi136 ceph-mon[125702]: pgmap v21852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:20:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:27 smithi057 ceph-mon[92072]: pgmap v21852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:20:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:27 smithi122 ceph-mon[125440]: pgmap v21852: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:20:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:29 smithi136 ceph-mon[125702]: pgmap v21853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:29 smithi057 ceph-mon[92072]: pgmap v21853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:29 smithi122 ceph-mon[125440]: pgmap v21853: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:31 smithi136 ceph-mon[125702]: pgmap v21854: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:31 smithi057 ceph-mon[92072]: pgmap v21854: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:31 smithi122 ceph-mon[125440]: pgmap v21854: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:34.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:33 smithi136 ceph-mon[125702]: pgmap v21855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:33 smithi057 ceph-mon[92072]: pgmap v21855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:33 smithi122 ceph-mon[125440]: pgmap v21855: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:35.463+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:20:35.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:35.463+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:20:35.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:35.464+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:20:35.465 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:35.464+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:20:35.466 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:35.464+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:20:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:36 smithi136 ceph-mon[125702]: pgmap v21856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:36 smithi057 ceph-mon[92072]: pgmap v21856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:36 smithi122 ceph-mon[125440]: pgmap v21856: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:38 smithi136 ceph-mon[125702]: pgmap v21857: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:38 smithi057 ceph-mon[92072]: pgmap v21857: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:38 smithi122 ceph-mon[125440]: pgmap v21857: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:40.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:40 smithi136 ceph-mon[125702]: pgmap v21858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:40 smithi057 ceph-mon[92072]: pgmap v21858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:40 smithi122 ceph-mon[125440]: pgmap v21858: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:42 smithi136 ceph-mon[125702]: pgmap v21859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:20:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:42 smithi057 ceph-mon[92072]: pgmap v21859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:20:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:42 smithi122 ceph-mon[125440]: pgmap v21859: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:20:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:20:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:20:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:20:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:20:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:20:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:20:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:20:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:20:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:20:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:44 smithi136 ceph-mon[125702]: pgmap v21860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:44 smithi057 ceph-mon[92072]: pgmap v21860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:44 smithi122 ceph-mon[125440]: pgmap v21860: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:46 smithi136 ceph-mon[125702]: pgmap v21861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:46 smithi057 ceph-mon[92072]: pgmap v21861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:46 smithi122 ceph-mon[125440]: pgmap v21861: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:48 smithi136 ceph-mon[125702]: pgmap v21862: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:48 smithi057 ceph-mon[92072]: pgmap v21862: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:48 smithi122 ceph-mon[125440]: pgmap v21862: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:50 smithi136 ceph-mon[125702]: pgmap v21863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:50 smithi057 ceph-mon[92072]: pgmap v21863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:50 smithi122 ceph-mon[125440]: pgmap v21863: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:50.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:20:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:50.473+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:20:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:50.473+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:20:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:50.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:20:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:20:50.473+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:20:52.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:52 smithi136 ceph-mon[125702]: pgmap v21864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:52 smithi057 ceph-mon[92072]: pgmap v21864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:52 smithi122 ceph-mon[125440]: pgmap v21864: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:54.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:54 smithi136 ceph-mon[125702]: pgmap v21865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:54 smithi057 ceph-mon[92072]: pgmap v21865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:54 smithi122 ceph-mon[125440]: pgmap v21865: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:20:56.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:56 smithi136 ceph-mon[125702]: pgmap v21866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:56 smithi057 ceph-mon[92072]: pgmap v21866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:56 smithi122 ceph-mon[125440]: pgmap v21866: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:58.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:20:58 smithi136 ceph-mon[125702]: pgmap v21867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:20:58 smithi057 ceph-mon[92072]: pgmap v21867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:20:58.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:20:58 smithi122 ceph-mon[125440]: pgmap v21867: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:00.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:00 smithi136 ceph-mon[125702]: pgmap v21868: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:00 smithi057 ceph-mon[92072]: pgmap v21868: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:00 smithi122 ceph-mon[125440]: pgmap v21868: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:02.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:02 smithi136 ceph-mon[125702]: pgmap v21869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:02 smithi057 ceph-mon[92072]: pgmap v21869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:02 smithi122 ceph-mon[125440]: pgmap v21869: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:04.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:04 smithi136 ceph-mon[125702]: pgmap v21870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:21:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:04 smithi057 ceph-mon[92072]: pgmap v21870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:21:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:04 smithi122 ceph-mon[125440]: pgmap v21870: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:21:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:05.487+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:21:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:05.487+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:21:05.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:05.487+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:21:05.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:05.487+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:21:05.490 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:05.487+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:21:06.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:06 smithi136 ceph-mon[125702]: pgmap v21871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:21:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:06 smithi057 ceph-mon[92072]: pgmap v21871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:21:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:06 smithi122 ceph-mon[125440]: pgmap v21871: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:21:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:08 smithi057 ceph-mon[92072]: pgmap v21872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:21:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:08 smithi057 ceph-mon[92072]: osdmap e1440: 12 total, 12 up, 12 in 2023-03-02T22:21:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:08 smithi122 ceph-mon[125440]: pgmap v21872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:21:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:08 smithi122 ceph-mon[125440]: osdmap e1440: 12 total, 12 up, 12 in 2023-03-02T22:21:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:08 smithi136 ceph-mon[125702]: pgmap v21872: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:21:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:08 smithi136 ceph-mon[125702]: osdmap e1440: 12 total, 12 up, 12 in 2023-03-02T22:21:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:10 smithi057 ceph-mon[92072]: pgmap v21874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:21:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:10 smithi122 ceph-mon[125440]: pgmap v21874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:21:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:10 smithi136 ceph-mon[125702]: pgmap v21874: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:21:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:12 smithi057 ceph-mon[92072]: pgmap v21875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:21:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:12 smithi122 ceph-mon[125440]: pgmap v21875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:21:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:12 smithi136 ceph-mon[125702]: pgmap v21875: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:21:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:14 smithi057 ceph-mon[92072]: pgmap v21876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:21:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:14 smithi122 ceph-mon[125440]: pgmap v21876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:21:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:14 smithi136 ceph-mon[125702]: pgmap v21876: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:21:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:16 smithi057 ceph-mon[92072]: pgmap v21877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:21:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:16 smithi057 ceph-mon[92072]: osdmap e1441: 12 total, 12 up, 12 in 2023-03-02T22:21:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:16 smithi122 ceph-mon[125440]: pgmap v21877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:21:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:16 smithi122 ceph-mon[125440]: osdmap e1441: 12 total, 12 up, 12 in 2023-03-02T22:21:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:16 smithi136 ceph-mon[125702]: pgmap v21877: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:21:16.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:16 smithi136 ceph-mon[125702]: osdmap e1441: 12 total, 12 up, 12 in 2023-03-02T22:21:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:18 smithi057 ceph-mon[92072]: pgmap v21879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:21:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:18 smithi122 ceph-mon[125440]: pgmap v21879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:21:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:18 smithi136 ceph-mon[125702]: pgmap v21879: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:21:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:20 smithi057 ceph-mon[92072]: pgmap v21880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:21:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:20 smithi122 ceph-mon[125440]: pgmap v21880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:21:20.503 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:20.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:21:20.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:20.502+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:21:20.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:20.502+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:21:20.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:20.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:21:20.504 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:20.502+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:21:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:20 smithi136 ceph-mon[125702]: pgmap v21880: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:21:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:22 smithi057 ceph-mon[92072]: pgmap v21881: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:21:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:22 smithi122 ceph-mon[125440]: pgmap v21881: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:21:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:22 smithi136 ceph-mon[125702]: pgmap v21881: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:21:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:24 smithi057 ceph-mon[92072]: pgmap v21882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:21:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:24 smithi122 ceph-mon[125440]: pgmap v21882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:21:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:24 smithi136 ceph-mon[125702]: pgmap v21882: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:21:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:26 smithi057 ceph-mon[92072]: pgmap v21883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:21:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:26 smithi122 ceph-mon[125440]: pgmap v21883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:21:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:26 smithi136 ceph-mon[125702]: pgmap v21883: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:21:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:28 smithi057 ceph-mon[92072]: pgmap v21884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:21:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:28 smithi122 ceph-mon[125440]: pgmap v21884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:21:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:28 smithi136 ceph-mon[125702]: pgmap v21884: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:21:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:30 smithi057 ceph-mon[92072]: pgmap v21885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:30 smithi122 ceph-mon[125440]: pgmap v21885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:30 smithi136 ceph-mon[125702]: pgmap v21885: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:32 smithi057 ceph-mon[92072]: pgmap v21886: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:32 smithi122 ceph-mon[125440]: pgmap v21886: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:32 smithi136 ceph-mon[125702]: pgmap v21886: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:34 smithi057 ceph-mon[92072]: pgmap v21887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:34 smithi122 ceph-mon[125440]: pgmap v21887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:34 smithi136 ceph-mon[125702]: pgmap v21887: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:35.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:21:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:35.514+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:21:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:35.514+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:21:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:35.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:21:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:35.514+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:21:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:36 smithi057 ceph-mon[92072]: pgmap v21888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:36 smithi122 ceph-mon[125440]: pgmap v21888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:36 smithi136 ceph-mon[125702]: pgmap v21888: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:38 smithi057 ceph-mon[92072]: pgmap v21889: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:38 smithi122 ceph-mon[125440]: pgmap v21889: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:38 smithi136 ceph-mon[125702]: pgmap v21889: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:40 smithi057 ceph-mon[92072]: pgmap v21890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:40 smithi122 ceph-mon[125440]: pgmap v21890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:40 smithi136 ceph-mon[125702]: pgmap v21890: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:42 smithi057 ceph-mon[92072]: pgmap v21891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:42 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:21:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:42 smithi122 ceph-mon[125440]: pgmap v21891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:42.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:42 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:21:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:42 smithi136 ceph-mon[125702]: pgmap v21891: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:42 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:21:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:21:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:21:43.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:43 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:21:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:21:43.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:21:43.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:43 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:21:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:21:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:21:43.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:43 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:21:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:44 smithi122 ceph-mon[125440]: pgmap v21892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:44 smithi136 ceph-mon[125702]: pgmap v21892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:44 smithi057 ceph-mon[92072]: pgmap v21892: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:46 smithi122 ceph-mon[125440]: pgmap v21893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:46 smithi136 ceph-mon[125702]: pgmap v21893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:46 smithi057 ceph-mon[92072]: pgmap v21893: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:48 smithi136 ceph-mon[125702]: pgmap v21894: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:48 smithi057 ceph-mon[92072]: pgmap v21894: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:48 smithi122 ceph-mon[125440]: pgmap v21894: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:50.517+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:21:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:50.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:21:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:50.518+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:21:50.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:50.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:21:50.520 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:21:50.518+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:21:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:50 smithi136 ceph-mon[125702]: pgmap v21895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:50.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:50 smithi057 ceph-mon[92072]: pgmap v21895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:50 smithi122 ceph-mon[125440]: pgmap v21895: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:52 smithi136 ceph-mon[125702]: pgmap v21896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:52 smithi057 ceph-mon[92072]: pgmap v21896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:52 smithi122 ceph-mon[125440]: pgmap v21896: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:54 smithi136 ceph-mon[125702]: pgmap v21897: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:54 smithi057 ceph-mon[92072]: pgmap v21897: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:54 smithi122 ceph-mon[125440]: pgmap v21897: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:21:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:56 smithi136 ceph-mon[125702]: pgmap v21898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:56 smithi057 ceph-mon[92072]: pgmap v21898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:56 smithi122 ceph-mon[125440]: pgmap v21898: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:21:58 smithi136 ceph-mon[125702]: pgmap v21899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:21:58 smithi057 ceph-mon[92072]: pgmap v21899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:21:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:21:58 smithi122 ceph-mon[125440]: pgmap v21899: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:00 smithi136 ceph-mon[125702]: pgmap v21900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:00 smithi057 ceph-mon[92072]: pgmap v21900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:00 smithi122 ceph-mon[125440]: pgmap v21900: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:02 smithi136 ceph-mon[125702]: pgmap v21901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:02 smithi057 ceph-mon[92072]: pgmap v21901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:02 smithi122 ceph-mon[125440]: pgmap v21901: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:04 smithi136 ceph-mon[125702]: pgmap v21902: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:22:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:04 smithi057 ceph-mon[92072]: pgmap v21902: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:22:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:04 smithi122 ceph-mon[125440]: pgmap v21902: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:22:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:05.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:22:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:05.529+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:22:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:05.529+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:22:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:05.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:22:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:05.529+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:22:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:06 smithi136 ceph-mon[125702]: pgmap v21903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:22:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:06 smithi057 ceph-mon[92072]: pgmap v21903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:22:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:06 smithi122 ceph-mon[125440]: pgmap v21903: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:22:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:07 smithi136 ceph-mon[125702]: pgmap v21904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:22:08.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:07 smithi136 ceph-mon[125702]: osdmap e1442: 12 total, 12 up, 12 in 2023-03-02T22:22:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:07 smithi057 ceph-mon[92072]: pgmap v21904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:22:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:07 smithi057 ceph-mon[92072]: osdmap e1442: 12 total, 12 up, 12 in 2023-03-02T22:22:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:07 smithi122 ceph-mon[125440]: pgmap v21904: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:22:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:07 smithi122 ceph-mon[125440]: osdmap e1442: 12 total, 12 up, 12 in 2023-03-02T22:22:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:09 smithi136 ceph-mon[125702]: pgmap v21906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:22:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:09 smithi057 ceph-mon[92072]: pgmap v21906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:22:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:09 smithi122 ceph-mon[125440]: pgmap v21906: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:22:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:11 smithi136 ceph-mon[125702]: pgmap v21907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:22:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:11 smithi057 ceph-mon[92072]: pgmap v21907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:22:12.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:11 smithi122 ceph-mon[125440]: pgmap v21907: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:22:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:13 smithi136 ceph-mon[125702]: pgmap v21908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:22:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:13 smithi057 ceph-mon[92072]: pgmap v21908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:22:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:13 smithi122 ceph-mon[125440]: pgmap v21908: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:22:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:16 smithi136 ceph-mon[125702]: pgmap v21909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:22:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:16 smithi136 ceph-mon[125702]: osdmap e1443: 12 total, 12 up, 12 in 2023-03-02T22:22:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:16 smithi057 ceph-mon[92072]: pgmap v21909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:22:16.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:16 smithi057 ceph-mon[92072]: osdmap e1443: 12 total, 12 up, 12 in 2023-03-02T22:22:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:16 smithi122 ceph-mon[125440]: pgmap v21909: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:22:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:16 smithi122 ceph-mon[125440]: osdmap e1443: 12 total, 12 up, 12 in 2023-03-02T22:22:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:18 smithi136 ceph-mon[125702]: pgmap v21911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:22:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:18 smithi057 ceph-mon[92072]: pgmap v21911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:22:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:18 smithi122 ceph-mon[125440]: pgmap v21911: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:22:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:20 smithi136 ceph-mon[125702]: pgmap v21912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:22:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:20 smithi057 ceph-mon[92072]: pgmap v21912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:22:20.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:20 smithi122 ceph-mon[125440]: pgmap v21912: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:22:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:20.536+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:22:20.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:20.537+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:22:20.542 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:20.537+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:22:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:20.537+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:22:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:20.537+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:22:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:22 smithi136 ceph-mon[125702]: pgmap v21913: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:22:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:22 smithi057 ceph-mon[92072]: pgmap v21913: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:22:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:22 smithi122 ceph-mon[125440]: pgmap v21913: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:22:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:24 smithi136 ceph-mon[125702]: pgmap v21914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:22:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:24 smithi057 ceph-mon[92072]: pgmap v21914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:22:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:24 smithi122 ceph-mon[125440]: pgmap v21914: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:22:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:26 smithi136 ceph-mon[125702]: pgmap v21915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:22:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:26 smithi057 ceph-mon[92072]: pgmap v21915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:22:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:26 smithi122 ceph-mon[125440]: pgmap v21915: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:22:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:28 smithi136 ceph-mon[125702]: pgmap v21916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:22:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:28 smithi057 ceph-mon[92072]: pgmap v21916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:22:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:28 smithi122 ceph-mon[125440]: pgmap v21916: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:22:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:30 smithi136 ceph-mon[125702]: pgmap v21917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:30 smithi057 ceph-mon[92072]: pgmap v21917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:30 smithi122 ceph-mon[125440]: pgmap v21917: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:32 smithi136 ceph-mon[125702]: pgmap v21918: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:32 smithi057 ceph-mon[92072]: pgmap v21918: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:32 smithi122 ceph-mon[125440]: pgmap v21918: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:34.357 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:34 smithi136 ceph-mon[125702]: pgmap v21919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:34.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:34 smithi057 ceph-mon[92072]: pgmap v21919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:34 smithi122 ceph-mon[125440]: pgmap v21919: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:35.550 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:35.549+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:22:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:35.549+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:22:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:35.549+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:22:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:35.549+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:22:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:35.549+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:22:36.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:36 smithi136 ceph-mon[125702]: pgmap v21920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:36.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:36 smithi057 ceph-mon[92072]: pgmap v21920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:36 smithi122 ceph-mon[125440]: pgmap v21920: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:38.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:38 smithi136 ceph-mon[125702]: pgmap v21921: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:38.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:38 smithi057 ceph-mon[92072]: pgmap v21921: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:38.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:38 smithi122 ceph-mon[125440]: pgmap v21921: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:40.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:40 smithi136 ceph-mon[125702]: pgmap v21922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:40.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:40 smithi057 ceph-mon[92072]: pgmap v21922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:40.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:40 smithi122 ceph-mon[125440]: pgmap v21922: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:42.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:42 smithi136 ceph-mon[125702]: pgmap v21923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:42.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:42 smithi057 ceph-mon[92072]: pgmap v21923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:42.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:42 smithi122 ceph-mon[125440]: pgmap v21923: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:43.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:43 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:22:43.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:43 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:22:43.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:43 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:22:44.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:44 smithi136 ceph-mon[125702]: pgmap v21924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:22:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:22:44.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:44 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:22:44.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:44 smithi057 ceph-mon[92072]: pgmap v21924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:22:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:22:44.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:44 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:22:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:44 smithi122 ceph-mon[125440]: pgmap v21924: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:44.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:22:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:22:44.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:44 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:22:46.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:46 smithi136 ceph-mon[125702]: pgmap v21925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:46.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:46 smithi057 ceph-mon[92072]: pgmap v21925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:46.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:46 smithi122 ceph-mon[125440]: pgmap v21925: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:48.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:48 smithi136 ceph-mon[125702]: pgmap v21926: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:48.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:48 smithi057 ceph-mon[92072]: pgmap v21926: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:48.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:48 smithi122 ceph-mon[125440]: pgmap v21926: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:50.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:50 smithi136 ceph-mon[125702]: pgmap v21927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:50.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:50 smithi057 ceph-mon[92072]: pgmap v21927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:50.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:50 smithi122 ceph-mon[125440]: pgmap v21927: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:50.565+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:22:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:50.565+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:22:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:50.565+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:22:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:50.565+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:22:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:22:50.565+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:22:52.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:52 smithi057 ceph-mon[92072]: pgmap v21928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:52.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:52 smithi122 ceph-mon[125440]: pgmap v21928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:52.488 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:52 smithi136 ceph-mon[125702]: pgmap v21928: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:54.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:54 smithi057 ceph-mon[92072]: pgmap v21929: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:54.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:54 smithi122 ceph-mon[125440]: pgmap v21929: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:54 smithi136 ceph-mon[125702]: pgmap v21929: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:22:56.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:56 smithi057 ceph-mon[92072]: pgmap v21930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:56.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:56 smithi122 ceph-mon[125440]: pgmap v21930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:56 smithi136 ceph-mon[125702]: pgmap v21930: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:58.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:22:58 smithi057 ceph-mon[92072]: pgmap v21931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:58.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:22:58 smithi122 ceph-mon[125440]: pgmap v21931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:22:58.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:22:58 smithi136 ceph-mon[125702]: pgmap v21931: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:00.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:00 smithi057 ceph-mon[92072]: pgmap v21932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:00.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:00 smithi122 ceph-mon[125440]: pgmap v21932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:00 smithi136 ceph-mon[125702]: pgmap v21932: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:02.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:02 smithi057 ceph-mon[92072]: pgmap v21933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:02.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:02 smithi122 ceph-mon[125440]: pgmap v21933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:02.594 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:02 smithi136 ceph-mon[125702]: pgmap v21933: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:04.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:04 smithi057 ceph-mon[92072]: pgmap v21934: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:23:04.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:04 smithi122 ceph-mon[125440]: pgmap v21934: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:23:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:04 smithi136 ceph-mon[125702]: pgmap v21934: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:23:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:05.581+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:23:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:05.581+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:23:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:05.581+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:23:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:05.581+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:23:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:05.581+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:23:06.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:06 smithi057 ceph-mon[92072]: pgmap v21935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:23:06.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:06 smithi122 ceph-mon[125440]: pgmap v21935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:23:06.593 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:06 smithi136 ceph-mon[125702]: pgmap v21935: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:23:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:08 smithi057 ceph-mon[92072]: pgmap v21936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:23:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:08 smithi057 ceph-mon[92072]: osdmap e1444: 12 total, 12 up, 12 in 2023-03-02T22:23:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:08 smithi122 ceph-mon[125440]: pgmap v21936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:23:08.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:08 smithi122 ceph-mon[125440]: osdmap e1444: 12 total, 12 up, 12 in 2023-03-02T22:23:08.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:08 smithi136 ceph-mon[125702]: pgmap v21936: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-02T22:23:08.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:08 smithi136 ceph-mon[125702]: osdmap e1444: 12 total, 12 up, 12 in 2023-03-02T22:23:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:10 smithi057 ceph-mon[92072]: pgmap v21938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:23:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:10 smithi122 ceph-mon[125440]: pgmap v21938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:23:10.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:10 smithi136 ceph-mon[125702]: pgmap v21938: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:23:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:12 smithi057 ceph-mon[92072]: pgmap v21939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:23:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:12 smithi122 ceph-mon[125440]: pgmap v21939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:23:12.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:12 smithi136 ceph-mon[125702]: pgmap v21939: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:23:14.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:14.305+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:23:14.307 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:14.305+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:23:14.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:14.305+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 316 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:23:14.308 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:14.305+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 315 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 409+0+0 (secure 0 0 0) 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:23:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:14 smithi057 ceph-mon[92072]: pgmap v21940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:23:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:14 smithi122 ceph-mon[125440]: pgmap v21940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:23:14.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:14 smithi136 ceph-mon[125702]: pgmap v21940: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:23:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:16 smithi057 ceph-mon[92072]: pgmap v21941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:23:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:16 smithi057 ceph-mon[92072]: osdmap e1445: 12 total, 12 up, 12 in 2023-03-02T22:23:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:16 smithi122 ceph-mon[125440]: pgmap v21941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:23:16.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:16 smithi122 ceph-mon[125440]: osdmap e1445: 12 total, 12 up, 12 in 2023-03-02T22:23:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:16 smithi136 ceph-mon[125702]: pgmap v21941: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:23:16.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:16 smithi136 ceph-mon[125702]: osdmap e1445: 12 total, 12 up, 12 in 2023-03-02T22:23:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:18 smithi057 ceph-mon[92072]: pgmap v21943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:23:18.452 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:18 smithi122 ceph-mon[125440]: pgmap v21943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:23:18.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:18 smithi136 ceph-mon[125702]: pgmap v21943: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 109 B/s wr, 5 op/s 2023-03-02T22:23:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:20 smithi057 ceph-mon[92072]: pgmap v21944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:23:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:20 smithi122 ceph-mon[125440]: pgmap v21944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:23:20.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:20 smithi136 ceph-mon[125702]: pgmap v21944: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:23:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:20.595+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:23:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:20.595+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:23:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:20.595+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:23:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:20.595+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:23:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:20.596+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:23:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:22 smithi057 ceph-mon[92072]: pgmap v21945: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:23:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:22 smithi122 ceph-mon[125440]: pgmap v21945: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:23:22.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:22 smithi136 ceph-mon[125702]: pgmap v21945: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:23:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:24 smithi057 ceph-mon[92072]: pgmap v21946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:23:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:24 smithi122 ceph-mon[125440]: pgmap v21946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:23:24.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:24 smithi136 ceph-mon[125702]: pgmap v21946: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:23:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:26 smithi057 ceph-mon[92072]: pgmap v21947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:23:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:26 smithi122 ceph-mon[125440]: pgmap v21947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:23:26.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:26 smithi136 ceph-mon[125702]: pgmap v21947: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-02T22:23:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:28 smithi057 ceph-mon[92072]: pgmap v21948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:23:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:28 smithi122 ceph-mon[125440]: pgmap v21948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:23:28.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:28 smithi136 ceph-mon[125702]: pgmap v21948: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:23:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:30 smithi122 ceph-mon[125440]: pgmap v21949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T22:23:30.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:30 smithi136 ceph-mon[125702]: pgmap v21949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T22:23:30.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:30 smithi057 ceph-mon[92072]: pgmap v21949: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T22:23:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:32 smithi122 ceph-mon[125440]: pgmap v21950: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T22:23:32.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:32 smithi136 ceph-mon[125702]: pgmap v21950: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T22:23:32.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:32 smithi057 ceph-mon[92072]: pgmap v21950: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T22:23:34.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:34 smithi122 ceph-mon[125440]: pgmap v21951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T22:23:34.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:34 smithi136 ceph-mon[125702]: pgmap v21951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T22:23:34.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:34 smithi057 ceph-mon[92072]: pgmap v21951: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T22:23:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:35.611+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:23:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:35.611+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:23:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:35.611+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:23:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:35.612+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:23:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:35.612+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:23:36.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:36 smithi122 ceph-mon[125440]: pgmap v21952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T22:23:36.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:36 smithi136 ceph-mon[125702]: pgmap v21952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T22:23:36.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:36 smithi057 ceph-mon[92072]: pgmap v21952: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T22:23:38.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:38 smithi136 ceph-mon[125702]: pgmap v21953: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T22:23:38.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:38 smithi057 ceph-mon[92072]: pgmap v21953: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T22:23:38.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:38 smithi122 ceph-mon[125440]: pgmap v21953: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-02T22:23:40.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:40 smithi136 ceph-mon[125702]: pgmap v21954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T22:23:40.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:40 smithi057 ceph-mon[92072]: pgmap v21954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T22:23:40.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:40 smithi122 ceph-mon[125440]: pgmap v21954: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-02T22:23:42.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:42 smithi136 ceph-mon[125702]: pgmap v21955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:42.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:42 smithi057 ceph-mon[92072]: pgmap v21955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:42.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:42 smithi122 ceph-mon[125440]: pgmap v21955: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:44 smithi136 ceph-mon[125702]: pgmap v21956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:44.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:44 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:23:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:44 smithi057 ceph-mon[92072]: pgmap v21956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:44.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:44 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:23:44.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:44 smithi122 ceph-mon[125440]: pgmap v21956: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:44.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:44 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-02T22:23:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:23:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:45 smithi136 ceph-mon[125702]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:23:45.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:45 smithi136 ceph-mon[125702]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:23:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:23:45.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:45 smithi057 ceph-mon[92072]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:23:45.684 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:45 smithi057 ceph-mon[92072]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:23:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-02T22:23:45.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:45 smithi122 ceph-mon[125440]: from='mgr.25273 172.21.15.57:0/1166745031' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-02T22:23:45.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:45 smithi122 ceph-mon[125440]: from='mgr.25273 ' entity='mgr.x' 2023-03-02T22:23:46.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:46 smithi136 ceph-mon[125702]: pgmap v21957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:46.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:46 smithi057 ceph-mon[92072]: pgmap v21957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:46.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:46 smithi122 ceph-mon[125440]: pgmap v21957: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:48.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:48 smithi136 ceph-mon[125702]: pgmap v21958: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:48.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:48 smithi057 ceph-mon[92072]: pgmap v21958: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:48.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:48 smithi122 ceph-mon[125440]: pgmap v21958: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:50.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:50 smithi136 ceph-mon[125702]: pgmap v21959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:50.624+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:23:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:50.625+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:23:50.627 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:50.625+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:23:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:50.625+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:23:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:50.625+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:23:50.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:50 smithi057 ceph-mon[92072]: pgmap v21959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:50.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:50 smithi122 ceph-mon[125440]: pgmap v21959: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:52.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:52 smithi136 ceph-mon[125702]: pgmap v21960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:52.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:52 smithi057 ceph-mon[92072]: pgmap v21960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:52.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:52 smithi122 ceph-mon[125440]: pgmap v21960: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:54.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:54 smithi136 ceph-mon[125702]: pgmap v21961: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:54.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:54 smithi057 ceph-mon[92072]: pgmap v21961: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:54.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:54 smithi122 ceph-mon[125440]: pgmap v21961: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:23:56.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:56 smithi136 ceph-mon[125702]: pgmap v21962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:56.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:56 smithi057 ceph-mon[92072]: pgmap v21962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:56.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:56 smithi122 ceph-mon[125440]: pgmap v21962: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:58.591 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:23:58 smithi136 ceph-mon[125702]: pgmap v21963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:58.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:23:58 smithi057 ceph-mon[92072]: pgmap v21963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:58.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:23:58 smithi122 ceph-mon[125440]: pgmap v21963: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:23:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:59.310+0000 7f585effd700 1 -- 172.21.15.57:0/783025844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:23:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:59.310+0000 7f587cff9700 1 -- 172.21.15.57:0/4000526380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:23:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:59.311+0000 7f585ffff700 1 -- 172.21.15.57:0/783025844 <== mon.1 v2:172.21.15.136:3300/0 316 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58500063a0 con 0x558558b6f6b0 2023-03-02T22:23:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:23:59.311+0000 7f587dffb700 1 -- 172.21.15.57:0/4000526380 <== mon.1 v2:172.21.15.136:3300/0 317 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (secure 0 0 0) 0x7f58580066f0 con 0x7f5880105ae0 2023-03-02T22:24:00.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:00 smithi136 ceph-mon[125702]: pgmap v21964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:24:00.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:00 smithi057 ceph-mon[92072]: pgmap v21964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:24:00.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:00 smithi122 ceph-mon[125440]: pgmap v21964: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-02T22:24:02.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:02 smithi136 ceph-mon[125702]: pgmap v21965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:24:02.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:02 smithi057 ceph-mon[92072]: pgmap v21965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:24:02.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:02 smithi122 ceph-mon[125440]: pgmap v21965: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:24:04.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:04 smithi136 ceph-mon[125702]: pgmap v21966: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:24:04.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:04 smithi057 ceph-mon[92072]: pgmap v21966: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:24:04.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:04 smithi122 ceph-mon[125440]: pgmap v21966: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-02T22:24:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:24:05.633+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:24:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:24:05.634+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:24:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:24:05.634+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:24:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:24:05.634+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:24:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:24:05.634+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:24:06.590 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:06 smithi136 ceph-mon[125702]: pgmap v21967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T22:24:06.683 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:06 smithi057 ceph-mon[92072]: pgmap v21967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T22:24:06.701 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:06 smithi122 ceph-mon[125440]: pgmap v21967: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T22:24:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:08 smithi136 ceph-mon[125702]: pgmap v21968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T22:24:08.341 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:08 smithi136 ceph-mon[125702]: osdmap e1446: 12 total, 12 up, 12 in 2023-03-02T22:24:08.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:08 smithi057 ceph-mon[92072]: pgmap v21968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T22:24:08.434 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:08 smithi057 ceph-mon[92072]: osdmap e1446: 12 total, 12 up, 12 in 2023-03-02T22:24:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:08 smithi122 ceph-mon[125440]: pgmap v21968: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-02T22:24:08.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:08 smithi122 ceph-mon[125440]: osdmap e1446: 12 total, 12 up, 12 in 2023-03-02T22:24:10.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:10 smithi136 ceph-mon[125702]: pgmap v21970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:24:10.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:10 smithi057 ceph-mon[92072]: pgmap v21970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:24:10.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:10 smithi122 ceph-mon[125440]: pgmap v21970: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:24:12.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:12 smithi136 ceph-mon[125702]: pgmap v21971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:24:12.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:12 smithi057 ceph-mon[92072]: pgmap v21971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:24:12.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:12 smithi122 ceph-mon[125440]: pgmap v21971: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-02T22:24:14.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:14 smithi136 ceph-mon[125702]: pgmap v21972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:24:14.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:14 smithi057 ceph-mon[92072]: pgmap v21972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:24:14.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:14 smithi122 ceph-mon[125440]: pgmap v21972: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:24:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:16 smithi136 ceph-mon[125702]: pgmap v21973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:24:16.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:16 smithi136 ceph-mon[125702]: osdmap e1447: 12 total, 12 up, 12 in 2023-03-02T22:24:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:16 smithi057 ceph-mon[92072]: pgmap v21973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:24:16.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:16 smithi057 ceph-mon[92072]: osdmap e1447: 12 total, 12 up, 12 in 2023-03-02T22:24:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:16 smithi122 ceph-mon[125440]: pgmap v21973: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-02T22:24:16.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:16 smithi122 ceph-mon[125440]: osdmap e1447: 12 total, 12 up, 12 in 2023-03-02T22:24:18.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:18 smithi136 ceph-mon[125702]: pgmap v21975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:24:18.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:18 smithi057 ceph-mon[92072]: pgmap v21975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:24:18.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:18 smithi122 ceph-mon[125440]: pgmap v21975: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 107 B/s wr, 5 op/s 2023-03-02T22:24:20.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:20 smithi136 ceph-mon[125702]: pgmap v21976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:24:20.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:20 smithi057 ceph-mon[92072]: pgmap v21976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:24:20.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:20 smithi122 ceph-mon[125440]: pgmap v21976: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:24:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:24:20.648+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-02T22:24:20.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:24:20.649+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-02T22:24:20.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:24:20.649+0000 7f587ffff700 1 -- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 msgr2=0x558558d80110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-02T22:24:20.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:24:20.649+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-02T22:24:20.653 INFO:teuthology.task.background_exec.ubuntu@smithi057.front.sepia.ceph.com.smithi057.stderr:2023-03-02T22:24:20.649+0000 7f587ffff700 1 --2- 172.21.15.57:0/783025844 >> [v2:172.21.15.122:6838/316639764,v1:172.21.15.122:6839/316639764] conn(0x558558d7dd00 0x558558d80110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2023-03-02T22:24:22.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:22 smithi136 ceph-mon[125702]: pgmap v21977: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:24:22.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:22 smithi057 ceph-mon[92072]: pgmap v21977: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:22 smithi122 ceph-mon[125440]: pgmap v21977: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-02T22:24:24.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:24 smithi136 ceph-mon[125702]: pgmap v21978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:24:24.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:24 smithi057 ceph-mon[92072]: pgmap v21978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:24:24.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:24 smithi122 ceph-mon[125440]: pgmap v21978: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:24:26.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:26 smithi136 ceph-mon[125702]: pgmap v21979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:24:26.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:26 smithi057 ceph-mon[92072]: pgmap v21979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:24:26.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:26 smithi122 ceph-mon[125440]: pgmap v21979: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-02T22:24:28.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:28 smithi136 ceph-mon[125702]: pgmap v21980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:24:28.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:28 smithi057 ceph-mon[92072]: pgmap v21980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:24:28.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:28 smithi122 ceph-mon[125440]: pgmap v21980: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-02T22:24:30.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:30 smithi136 ceph-mon[125702]: pgmap v21981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:24:30.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:30 smithi057 ceph-mon[92072]: pgmap v21981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:24:30.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:30 smithi122 ceph-mon[125440]: pgmap v21981: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-02T22:24:32.340 INFO:journalctl@ceph.mon.c.smithi136.stdout:Mar 02 22:24:32 smithi136 ceph-mon[125702]: pgmap v21982: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:24:32.433 INFO:journalctl@ceph.mon.a.smithi057.stdout:Mar 02 22:24:32 smithi057 ceph-mon[92072]: pgmap v21982: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:24:32.451 INFO:journalctl@ceph.mon.b.smithi122.stdout:Mar 02 22:24:32 smithi122 ceph-mon[125440]: pgmap v21982: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-02T22:24:34.582 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-03-02T22:24:35.668 DEBUG:teuthology.task.console_log:Killing console logger for smithi057 2023-03-02T22:24:36.429 DEBUG:teuthology.task.console_log:Killing console logger for smithi122 2023-03-02T22:24:36.444 DEBUG:teuthology.task.console_log:Killing console logger for smithi136 2023-03-02T22:24:36.462 DEBUG:teuthology.exit:Finished running handlers